2024-04-19T02:47:22.791 INFO:root:teuthology version: 0.0.1.dev269+g9481b1d 2024-04-19T02:47:22.792 DEBUG:teuthology.run:Teuthology command: teuthology --description powercycle/osd/{clusters/3osd-1per-target ignorelist_health objectstore/bluestore-comp-zlib powercycle/default supported-all-distro/ubuntu_20.04 tasks/admin_socket_objecter_requests thrashosds-health} --verbose --owner scheduled_teuthology@teuthology --name teuthology-2024-04-18_22:32:02-powercycle-reef-distro-default-smithi --archive /home/teuthworker/archive/teuthology-2024-04-18_22:32:02-powercycle-reef-distro-default-smithi/7662873 -- /home/teuthworker/archive/teuthology-2024-04-18_22:32:02-powercycle-reef-distro-default-smithi/7662873/orig.config.yaml 2024-04-19T02:47:22.824 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-19T02:47:22.899 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-04-18_22:32:02-powercycle-reef-distro-default-smithi/7662873 branch: reef description: powercycle/osd/{clusters/3osd-1per-target ignorelist_health objectstore/bluestore-comp-zlib powercycle/default supported-all-distro/ubuntu_20.04 tasks/admin_socket_objecter_requests thrashosds-health} email: ceph-qa@ceph.com first_in_suite: false job_id: '7662873' kernel: kdb: 1 sha1: distro ktype: distro last_in_suite: false machine_type: smithi name: teuthology-2024-04-18_22:32:02-powercycle-reef-distro-default-smithi no_nested_subset: false nuke-on-error: true os_type: ubuntu os_version: '20.04' overrides: admin_socket: branch: reef ceph: conf: client.0: admin socket: /var/run/ceph/ceph-$name.asok mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: bluestore block size: 96636764160 bluestore compression algorithm: zlib bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd blocked scrub grace period: 3600 osd failsafe full ratio: 0.95 osd max markdown count: 1000 osd objectstore: bluestore flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(MDS_TRIM\) - \(MDS_SLOW_REQUEST\) - MDS_SLOW_METADATA_IO - Behind on trimming - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(OSD_ - \(PG_ - \(POOL_ - \(CACHE_POOL_ - \(SMALLER_PGP_NUM\) - \(OBJECT_ - \(SLOW_OPS\) - \(REQUEST_SLOW\) - \(TOO_FEW_PGS\) - slow request - timeout on replica - late reservation from sha1: 646b8c7d293d8ec31a40c69f7b3237b19c1be24d ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} install: ceph: flavor: default sha1: 646b8c7d293d8ec31a40c69f7b3237b19c1be24d thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: reef sha1: 646b8c7d293d8ec31a40c69f7b3237b19c1be24d owner: scheduled_teuthology@teuthology priority: 930 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mon.b - mon.c - mgr.x - mgr.y - mds.a - client.0 - - osd.0 - - osd.1 - - osd.2 seed: 2879 sha1: 646b8c7d293d8ec31a40c69f7b3237b19c1be24d sleep_before_teardown: 0 subset: 2/4 suite: powercycle suite_branch: reef suite_path: /home/teuthworker/src/git.ceph.com_ceph_646b8c7d293d8ec31a40c69f7b3237b19c1be24d/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: 646b8c7d293d8ec31a40c69f7b3237b19c1be24d targets: smithi096.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM= smithi097.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM= smithi134.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM= smithi144.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM= tasks: - install: extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - ceph: null - thrashosds: chance_down: 1.0 powercycle: true timeout: 600 - radosbench: clients: - client.0 time: 60 - admin_socket: client.0: objecter_requests: test: http://git.ceph.com/?p={repo};a=blob_plain;f=src/test/admin_socket/objecter_requests;hb={branch} teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17 timestamp: 2024-04-18_22:32:02 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-04-19T02:47:22.900 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_646b8c7d293d8ec31a40c69f7b3237b19c1be24d/qa; will attempt to use it 2024-04-19T02:47:22.900 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_646b8c7d293d8ec31a40c69f7b3237b19c1be24d/qa/tasks 2024-04-19T02:47:22.900 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-04-19T02:47:22.902 INFO:teuthology.task.internal:Checking packages... 2024-04-19T02:47:22.925 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '646b8c7d293d8ec31a40c69f7b3237b19c1be24d' 2024-04-19T02:47:22.925 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-19T02:47:22.925 INFO:teuthology.packaging:ref: None 2024-04-19T02:47:22.925 INFO:teuthology.packaging:tag: None 2024-04-19T02:47:22.925 INFO:teuthology.packaging:branch: reef 2024-04-19T02:47:22.925 INFO:teuthology.packaging:sha1: 646b8c7d293d8ec31a40c69f7b3237b19c1be24d 2024-04-19T02:47:22.926 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&ref=reef 2024-04-19T02:47:23.389 INFO:teuthology.task.internal:Found packages for ceph version 18.2.2-1237-g646b8c7d-1focal 2024-04-19T02:47:23.391 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-04-19T02:47:23.397 INFO:teuthology.task.internal:no buildpackages task found 2024-04-19T02:47:23.397 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-04-19T02:47:23.402 INFO:teuthology.task.internal:Saving configuration 2024-04-19T02:47:23.416 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-04-19T02:47:23.421 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-19T02:47:23.447 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi096.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-18_22:32:02-powercycle-reef-distro-default-smithi/7662873', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-19 02:41:25.335165', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGETOy3xONfbx7kUFCNiUtRLNfkcrcEsWzPdq6Np/6Bw'} 2024-04-19T02:47:23.474 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi097.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-18_22:32:02-powercycle-reef-distro-default-smithi/7662873', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-19 02:41:25.337323', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGETOy3xONfbx7kUFCNiUtRLNfkcrcEsWzPdq6Np/6Bw'} 2024-04-19T02:47:23.496 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi134.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-18_22:32:02-powercycle-reef-distro-default-smithi/7662873', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-19 02:41:25.333880', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGETOy3xONfbx7kUFCNiUtRLNfkcrcEsWzPdq6Np/6Bw'} 2024-04-19T02:47:23.520 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi144.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-18_22:32:02-powercycle-reef-distro-default-smithi/7662873', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-19 02:41:25.336219', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGETOy3xONfbx7kUFCNiUtRLNfkcrcEsWzPdq6Np/6Bw'} 2024-04-19T02:47:23.520 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-04-19T02:47:23.526 INFO:teuthology.task.internal:roles: ubuntu@smithi096.front.sepia.ceph.com - ['mon.a', 'mon.b', 'mon.c', 'mgr.x', 'mgr.y', 'mds.a', 'client.0'] 2024-04-19T02:47:23.526 INFO:teuthology.task.internal:roles: ubuntu@smithi097.front.sepia.ceph.com - ['osd.0'] 2024-04-19T02:47:23.526 INFO:teuthology.task.internal:roles: ubuntu@smithi134.front.sepia.ceph.com - ['osd.1'] 2024-04-19T02:47:23.526 INFO:teuthology.task.internal:roles: ubuntu@smithi144.front.sepia.ceph.com - ['osd.2'] 2024-04-19T02:47:23.527 INFO:teuthology.run_tasks:Running task console_log... 2024-04-19T02:47:23.657 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fb6df7e7280>, signals=[15]) 2024-04-19T02:47:23.657 INFO:teuthology.run_tasks:Running task internal.connect... 2024-04-19T02:47:23.664 INFO:teuthology.task.internal:Opening connections... 2024-04-19T02:47:23.664 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi096.front.sepia.ceph.com 2024-04-19T02:47:23.666 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi096.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-19T02:47:23.756 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi097.front.sepia.ceph.com 2024-04-19T02:47:23.757 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-19T02:47:23.850 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi134.front.sepia.ceph.com 2024-04-19T02:47:23.851 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-19T02:47:23.946 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi144.front.sepia.ceph.com 2024-04-19T02:47:23.947 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-19T02:47:24.044 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-04-19T02:47:24.050 DEBUG:teuthology.orchestra.run.smithi096:> uname -m 2024-04-19T02:47:24.057 INFO:teuthology.orchestra.run.smithi096.stdout:x86_64 2024-04-19T02:47:24.057 DEBUG:teuthology.orchestra.run.smithi096:> cat /etc/os-release 2024-04-19T02:47:24.106 INFO:teuthology.orchestra.run.smithi096.stdout:NAME="Ubuntu" 2024-04-19T02:47:24.107 INFO:teuthology.orchestra.run.smithi096.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2024-04-19T02:47:24.107 INFO:teuthology.orchestra.run.smithi096.stdout:ID=ubuntu 2024-04-19T02:47:24.107 INFO:teuthology.orchestra.run.smithi096.stdout:ID_LIKE=debian 2024-04-19T02:47:24.107 INFO:teuthology.orchestra.run.smithi096.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2024-04-19T02:47:24.107 INFO:teuthology.orchestra.run.smithi096.stdout:VERSION_ID="20.04" 2024-04-19T02:47:24.107 INFO:teuthology.orchestra.run.smithi096.stdout:HOME_URL="https://www.ubuntu.com/" 2024-04-19T02:47:24.107 INFO:teuthology.orchestra.run.smithi096.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-04-19T02:47:24.107 INFO:teuthology.orchestra.run.smithi096.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-04-19T02:47:24.107 INFO:teuthology.orchestra.run.smithi096.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-04-19T02:47:24.107 INFO:teuthology.orchestra.run.smithi096.stdout:VERSION_CODENAME=focal 2024-04-19T02:47:24.107 INFO:teuthology.orchestra.run.smithi096.stdout:UBUNTU_CODENAME=focal 2024-04-19T02:47:24.108 INFO:teuthology.lock.ops:Updating smithi096.front.sepia.ceph.com on lock server 2024-04-19T02:47:24.128 DEBUG:teuthology.orchestra.run.smithi097:> uname -m 2024-04-19T02:47:24.134 INFO:teuthology.orchestra.run.smithi097.stdout:x86_64 2024-04-19T02:47:24.135 DEBUG:teuthology.orchestra.run.smithi097:> cat /etc/os-release 2024-04-19T02:47:24.141 INFO:teuthology.orchestra.run.smithi097.stdout:NAME="Ubuntu" 2024-04-19T02:47:24.141 INFO:teuthology.orchestra.run.smithi097.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2024-04-19T02:47:24.141 INFO:teuthology.orchestra.run.smithi097.stdout:ID=ubuntu 2024-04-19T02:47:24.141 INFO:teuthology.orchestra.run.smithi097.stdout:ID_LIKE=debian 2024-04-19T02:47:24.141 INFO:teuthology.orchestra.run.smithi097.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2024-04-19T02:47:24.141 INFO:teuthology.orchestra.run.smithi097.stdout:VERSION_ID="20.04" 2024-04-19T02:47:24.141 INFO:teuthology.orchestra.run.smithi097.stdout:HOME_URL="https://www.ubuntu.com/" 2024-04-19T02:47:24.141 INFO:teuthology.orchestra.run.smithi097.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-04-19T02:47:24.141 INFO:teuthology.orchestra.run.smithi097.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-04-19T02:47:24.141 INFO:teuthology.orchestra.run.smithi097.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-04-19T02:47:24.141 INFO:teuthology.orchestra.run.smithi097.stdout:VERSION_CODENAME=focal 2024-04-19T02:47:24.141 INFO:teuthology.orchestra.run.smithi097.stdout:UBUNTU_CODENAME=focal 2024-04-19T02:47:24.142 INFO:teuthology.lock.ops:Updating smithi097.front.sepia.ceph.com on lock server 2024-04-19T02:47:24.161 DEBUG:teuthology.orchestra.run.smithi134:> uname -m 2024-04-19T02:47:24.168 INFO:teuthology.orchestra.run.smithi134.stdout:x86_64 2024-04-19T02:47:24.169 DEBUG:teuthology.orchestra.run.smithi134:> cat /etc/os-release 2024-04-19T02:47:24.219 INFO:teuthology.orchestra.run.smithi134.stdout:NAME="Ubuntu" 2024-04-19T02:47:24.220 INFO:teuthology.orchestra.run.smithi134.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2024-04-19T02:47:24.220 INFO:teuthology.orchestra.run.smithi134.stdout:ID=ubuntu 2024-04-19T02:47:24.220 INFO:teuthology.orchestra.run.smithi134.stdout:ID_LIKE=debian 2024-04-19T02:47:24.220 INFO:teuthology.orchestra.run.smithi134.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2024-04-19T02:47:24.220 INFO:teuthology.orchestra.run.smithi134.stdout:VERSION_ID="20.04" 2024-04-19T02:47:24.220 INFO:teuthology.orchestra.run.smithi134.stdout:HOME_URL="https://www.ubuntu.com/" 2024-04-19T02:47:24.220 INFO:teuthology.orchestra.run.smithi134.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-04-19T02:47:24.220 INFO:teuthology.orchestra.run.smithi134.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-04-19T02:47:24.220 INFO:teuthology.orchestra.run.smithi134.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-04-19T02:47:24.220 INFO:teuthology.orchestra.run.smithi134.stdout:VERSION_CODENAME=focal 2024-04-19T02:47:24.220 INFO:teuthology.orchestra.run.smithi134.stdout:UBUNTU_CODENAME=focal 2024-04-19T02:47:24.221 INFO:teuthology.lock.ops:Updating smithi134.front.sepia.ceph.com on lock server 2024-04-19T02:47:24.244 DEBUG:teuthology.orchestra.run.smithi144:> uname -m 2024-04-19T02:47:24.251 INFO:teuthology.orchestra.run.smithi144.stdout:x86_64 2024-04-19T02:47:24.251 DEBUG:teuthology.orchestra.run.smithi144:> cat /etc/os-release 2024-04-19T02:47:24.301 INFO:teuthology.orchestra.run.smithi144.stdout:NAME="Ubuntu" 2024-04-19T02:47:24.301 INFO:teuthology.orchestra.run.smithi144.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2024-04-19T02:47:24.301 INFO:teuthology.orchestra.run.smithi144.stdout:ID=ubuntu 2024-04-19T02:47:24.301 INFO:teuthology.orchestra.run.smithi144.stdout:ID_LIKE=debian 2024-04-19T02:47:24.301 INFO:teuthology.orchestra.run.smithi144.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2024-04-19T02:47:24.301 INFO:teuthology.orchestra.run.smithi144.stdout:VERSION_ID="20.04" 2024-04-19T02:47:24.301 INFO:teuthology.orchestra.run.smithi144.stdout:HOME_URL="https://www.ubuntu.com/" 2024-04-19T02:47:24.301 INFO:teuthology.orchestra.run.smithi144.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-04-19T02:47:24.301 INFO:teuthology.orchestra.run.smithi144.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-04-19T02:47:24.301 INFO:teuthology.orchestra.run.smithi144.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-04-19T02:47:24.302 INFO:teuthology.orchestra.run.smithi144.stdout:VERSION_CODENAME=focal 2024-04-19T02:47:24.302 INFO:teuthology.orchestra.run.smithi144.stdout:UBUNTU_CODENAME=focal 2024-04-19T02:47:24.302 INFO:teuthology.lock.ops:Updating smithi144.front.sepia.ceph.com on lock server 2024-04-19T02:47:24.319 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-04-19T02:47:24.328 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-04-19T02:47:24.341 INFO:teuthology.task.internal:Checking for old test directory... 2024-04-19T02:47:24.341 DEBUG:teuthology.orchestra.run.smithi096:> test '!' -e /home/ubuntu/cephtest 2024-04-19T02:47:24.344 DEBUG:teuthology.orchestra.run.smithi097:> test '!' -e /home/ubuntu/cephtest 2024-04-19T02:47:24.346 DEBUG:teuthology.orchestra.run.smithi134:> test '!' -e /home/ubuntu/cephtest 2024-04-19T02:47:24.349 DEBUG:teuthology.orchestra.run.smithi144:> test '!' -e /home/ubuntu/cephtest 2024-04-19T02:47:24.355 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-04-19T02:47:24.360 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-04-19T02:47:24.360 DEBUG:teuthology.orchestra.run.smithi096:> test -z $(ls -A /var/lib/ceph) 2024-04-19T02:47:24.390 DEBUG:teuthology.orchestra.run.smithi097:> test -z $(ls -A /var/lib/ceph) 2024-04-19T02:47:24.394 DEBUG:teuthology.orchestra.run.smithi134:> test -z $(ls -A /var/lib/ceph) 2024-04-19T02:47:24.398 DEBUG:teuthology.orchestra.run.smithi144:> test -z $(ls -A /var/lib/ceph) 2024-04-19T02:47:24.421 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-04-19T02:47:24.499 INFO:teuthology.run_tasks:Running task kernel... 2024-04-19T02:47:24.513 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-04-19T02:47:24.514 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'osd.0': {'kdb': 1, 'sha1': 'distro'}, 'osd.1': {'kdb': 1, 'sha1': 'distro'}, 'osd.2': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-04-19T02:47:24.514 DEBUG:teuthology.orchestra.run.smithi096:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-19T02:47:24.514 DEBUG:teuthology.orchestra.run.smithi097:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-19T02:47:24.515 DEBUG:teuthology.orchestra.run.smithi134:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-19T02:47:24.515 DEBUG:teuthology.orchestra.run.smithi144:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-19T02:47:24.520 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-19T02:47:24.521 DEBUG:teuthology.orchestra.run.smithi097:> uname -r 2024-04-19T02:47:24.522 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-19T02:47:24.522 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-19T02:47:24.522 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-19T02:47:24.523 DEBUG:teuthology.orchestra.run.smithi144:> uname -r 2024-04-19T02:47:24.524 DEBUG:teuthology.orchestra.run.smithi096:> uname -r 2024-04-19T02:47:24.524 DEBUG:teuthology.orchestra.run.smithi134:> uname -r 2024-04-19T02:47:24.570 INFO:teuthology.orchestra.run.smithi134.stdout:5.4.0-124-generic 2024-04-19T02:47:24.571 INFO:teuthology.task.kernel:Running kernel on smithi134: 5.4.0-124-generic 2024-04-19T02:47:24.571 DEBUG:teuthology.orchestra.run.smithi134:> sudo apt-get clean 2024-04-19T02:47:24.572 INFO:teuthology.orchestra.run.smithi096.stdout:5.4.0-124-generic 2024-04-19T02:47:24.573 INFO:teuthology.orchestra.run.smithi097.stdout:5.4.0-124-generic 2024-04-19T02:47:24.573 INFO:teuthology.task.kernel:Running kernel on smithi096: 5.4.0-124-generic 2024-04-19T02:47:24.573 DEBUG:teuthology.orchestra.run.smithi096:> sudo apt-get clean 2024-04-19T02:47:24.573 INFO:teuthology.task.kernel:Running kernel on smithi097: 5.4.0-124-generic 2024-04-19T02:47:24.573 DEBUG:teuthology.orchestra.run.smithi097:> sudo apt-get clean 2024-04-19T02:47:24.575 INFO:teuthology.orchestra.run.smithi144.stdout:5.4.0-124-generic 2024-04-19T02:47:24.575 INFO:teuthology.task.kernel:Running kernel on smithi144: 5.4.0-124-generic 2024-04-19T02:47:24.575 DEBUG:teuthology.orchestra.run.smithi144:> sudo apt-get clean 2024-04-19T02:47:24.661 DEBUG:teuthology.orchestra.run.smithi144:> sudo apt-get update 2024-04-19T02:47:24.664 DEBUG:teuthology.orchestra.run.smithi096:> sudo apt-get update 2024-04-19T02:47:24.671 DEBUG:teuthology.orchestra.run.smithi134:> sudo apt-get update 2024-04-19T02:47:24.743 DEBUG:teuthology.orchestra.run.smithi097:> sudo apt-get update 2024-04-19T02:47:24.879 INFO:teuthology.orchestra.run.smithi144.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2024-04-19T02:47:24.879 INFO:teuthology.orchestra.run.smithi144.stdout:Get:2 http://security.ubuntu.com/ubuntu focal-security InRelease [114 kB] 2024-04-19T02:47:24.884 INFO:teuthology.orchestra.run.smithi096.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2024-04-19T02:47:24.894 INFO:teuthology.orchestra.run.smithi144.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease [114 kB] 2024-04-19T02:47:24.910 INFO:teuthology.orchestra.run.smithi096.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates InRelease [114 kB] 2024-04-19T02:47:24.938 INFO:teuthology.orchestra.run.smithi096.stdout:Get:3 http://security.ubuntu.com/ubuntu focal-security InRelease [114 kB] 2024-04-19T02:47:24.956 INFO:teuthology.orchestra.run.smithi134.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2024-04-19T02:47:24.958 INFO:teuthology.orchestra.run.smithi134.stdout:Get:2 http://security.ubuntu.com/ubuntu focal-security InRelease [114 kB] 2024-04-19T02:47:24.978 INFO:teuthology.orchestra.run.smithi097.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2024-04-19T02:47:24.978 INFO:teuthology.orchestra.run.smithi097.stdout:Get:2 http://security.ubuntu.com/ubuntu focal-security InRelease [114 kB] 2024-04-19T02:47:24.991 INFO:teuthology.orchestra.run.smithi097.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease [114 kB] 2024-04-19T02:47:25.021 INFO:teuthology.orchestra.run.smithi134.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease [114 kB] 2024-04-19T02:47:25.063 INFO:teuthology.orchestra.run.smithi144.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease [108 kB] 2024-04-19T02:47:25.066 INFO:teuthology.orchestra.run.smithi096.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease [108 kB] 2024-04-19T02:47:25.228 INFO:teuthology.orchestra.run.smithi097.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease [108 kB] 2024-04-19T02:47:25.290 INFO:teuthology.orchestra.run.smithi096.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 Packages [3,266 kB] 2024-04-19T02:47:25.290 INFO:teuthology.orchestra.run.smithi144.stdout:Get:5 http://security.ubuntu.com/ubuntu focal-security/main amd64 Packages [2,856 kB] 2024-04-19T02:47:25.387 INFO:teuthology.orchestra.run.smithi097.stdout:Get:5 http://security.ubuntu.com/ubuntu focal-security/main i386 Packages [737 kB] 2024-04-19T02:47:25.399 INFO:teuthology.orchestra.run.smithi134.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease [108 kB] 2024-04-19T02:47:25.445 INFO:teuthology.orchestra.run.smithi144.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main i386 Packages [967 kB] 2024-04-19T02:47:25.481 INFO:teuthology.orchestra.run.smithi134.stdout:Get:5 http://security.ubuntu.com/ubuntu focal-security/main i386 Packages [737 kB] 2024-04-19T02:47:25.545 INFO:teuthology.orchestra.run.smithi097.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 Packages [3,266 kB] 2024-04-19T02:47:25.608 INFO:teuthology.orchestra.run.smithi144.stdout:Get:7 http://security.ubuntu.com/ubuntu focal-security/main i386 Packages [737 kB] 2024-04-19T02:47:25.616 INFO:teuthology.orchestra.run.smithi096.stdout:Get:6 http://security.ubuntu.com/ubuntu focal-security/main amd64 Packages [2,856 kB] 2024-04-19T02:47:25.620 INFO:teuthology.orchestra.run.smithi134.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 Packages [3,266 kB] 2024-04-19T02:47:25.624 INFO:teuthology.orchestra.run.smithi144.stdout:Get:8 http://security.ubuntu.com/ubuntu focal-security/main Translation-en [432 kB] 2024-04-19T02:47:25.633 INFO:teuthology.orchestra.run.smithi144.stdout:Get:9 http://security.ubuntu.com/ubuntu focal-security/main amd64 c-n-f Metadata [13.2 kB] 2024-04-19T02:47:25.633 INFO:teuthology.orchestra.run.smithi144.stdout:Get:10 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 Packages [2,735 kB] 2024-04-19T02:47:25.652 INFO:teuthology.orchestra.run.smithi097.stdout:Get:7 http://security.ubuntu.com/ubuntu focal-security/main amd64 Packages [2,856 kB] 2024-04-19T02:47:25.714 INFO:teuthology.orchestra.run.smithi096.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main i386 Packages [967 kB] 2024-04-19T02:47:25.739 INFO:teuthology.orchestra.run.smithi144.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 Packages [3,266 kB] 2024-04-19T02:47:25.859 INFO:teuthology.orchestra.run.smithi144.stdout:Get:12 http://security.ubuntu.com/ubuntu focal-security/restricted i386 Packages [36.4 kB] 2024-04-19T02:47:25.861 INFO:teuthology.orchestra.run.smithi144.stdout:Get:13 http://security.ubuntu.com/ubuntu focal-security/restricted Translation-en [381 kB] 2024-04-19T02:47:25.868 INFO:teuthology.orchestra.run.smithi144.stdout:Get:14 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 c-n-f Metadata [552 B] 2024-04-19T02:47:25.868 INFO:teuthology.orchestra.run.smithi144.stdout:Get:15 http://security.ubuntu.com/ubuntu focal-security/universe i386 Packages [656 kB] 2024-04-19T02:47:25.880 INFO:teuthology.orchestra.run.smithi144.stdout:Get:16 http://security.ubuntu.com/ubuntu focal-security/universe amd64 Packages [954 kB] 2024-04-19T02:47:25.880 INFO:teuthology.orchestra.run.smithi096.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main Translation-en [517 kB] 2024-04-19T02:47:25.884 INFO:teuthology.orchestra.run.smithi096.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 c-n-f Metadata [17.2 kB] 2024-04-19T02:47:25.884 INFO:teuthology.orchestra.run.smithi096.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal-updates/restricted i386 Packages [37.7 kB] 2024-04-19T02:47:25.884 INFO:teuthology.orchestra.run.smithi144.stdout:Get:17 http://security.ubuntu.com/ubuntu focal-security/universe Translation-en [201 kB] 2024-04-19T02:47:25.885 INFO:teuthology.orchestra.run.smithi096.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 Packages [2,889 kB] 2024-04-19T02:47:25.901 INFO:teuthology.orchestra.run.smithi144.stdout:Get:18 http://security.ubuntu.com/ubuntu focal-security/universe amd64 c-n-f Metadata [19.2 kB] 2024-04-19T02:47:25.902 INFO:teuthology.orchestra.run.smithi144.stdout:Get:19 http://security.ubuntu.com/ubuntu focal-security/multiverse i386 Packages [7,200 B] 2024-04-19T02:47:25.902 INFO:teuthology.orchestra.run.smithi144.stdout:Get:20 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 Packages [24.0 kB] 2024-04-19T02:47:25.913 INFO:teuthology.orchestra.run.smithi097.stdout:Get:8 http://security.ubuntu.com/ubuntu focal-security/main Translation-en [432 kB] 2024-04-19T02:47:25.930 INFO:teuthology.orchestra.run.smithi097.stdout:Get:9 http://security.ubuntu.com/ubuntu focal-security/main amd64 c-n-f Metadata [13.2 kB] 2024-04-19T02:47:25.931 INFO:teuthology.orchestra.run.smithi097.stdout:Get:10 http://security.ubuntu.com/ubuntu focal-security/restricted i386 Packages [36.4 kB] 2024-04-19T02:47:25.932 INFO:teuthology.orchestra.run.smithi097.stdout:Get:11 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 Packages [2,735 kB] 2024-04-19T02:47:25.944 INFO:teuthology.orchestra.run.smithi144.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/main Translation-en [517 kB] 2024-04-19T02:47:25.956 INFO:teuthology.orchestra.run.smithi144.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 c-n-f Metadata [17.2 kB] 2024-04-19T02:47:25.957 INFO:teuthology.orchestra.run.smithi144.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/restricted i386 Packages [37.7 kB] 2024-04-19T02:47:25.958 INFO:teuthology.orchestra.run.smithi144.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 Packages [2,889 kB] 2024-04-19T02:47:25.961 INFO:teuthology.orchestra.run.smithi096.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/restricted Translation-en [403 kB] 2024-04-19T02:47:25.985 INFO:teuthology.orchestra.run.smithi096.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 c-n-f Metadata [552 B] 2024-04-19T02:47:25.985 INFO:teuthology.orchestra.run.smithi096.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 Packages [1,181 kB] 2024-04-19T02:47:26.006 INFO:teuthology.orchestra.run.smithi144.stdout:Get:25 http://security.ubuntu.com/ubuntu focal-security/multiverse Translation-en [5,904 B] 2024-04-19T02:47:26.007 INFO:teuthology.orchestra.run.smithi144.stdout:Get:26 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 c-n-f Metadata [548 B] 2024-04-19T02:47:26.014 INFO:teuthology.orchestra.run.smithi097.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/main i386 Packages [967 kB] 2024-04-19T02:47:26.075 INFO:teuthology.orchestra.run.smithi097.stdout:Get:13 http://security.ubuntu.com/ubuntu focal-security/restricted Translation-en [381 kB] 2024-04-19T02:47:26.083 INFO:teuthology.orchestra.run.smithi097.stdout:Get:14 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 c-n-f Metadata [552 B] 2024-04-19T02:47:26.084 INFO:teuthology.orchestra.run.smithi097.stdout:Get:15 http://security.ubuntu.com/ubuntu focal-security/universe amd64 Packages [954 kB] 2024-04-19T02:47:26.100 INFO:teuthology.orchestra.run.smithi144.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal-updates/restricted Translation-en [403 kB] 2024-04-19T02:47:26.107 INFO:teuthology.orchestra.run.smithi096.stdout:Get:15 http://security.ubuntu.com/ubuntu focal-security/main i386 Packages [737 kB] 2024-04-19T02:47:26.108 INFO:teuthology.orchestra.run.smithi144.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 c-n-f Metadata [552 B] 2024-04-19T02:47:26.108 INFO:teuthology.orchestra.run.smithi144.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 Packages [1,181 kB] 2024-04-19T02:47:26.113 INFO:teuthology.orchestra.run.smithi097.stdout:Get:16 http://security.ubuntu.com/ubuntu focal-security/universe i386 Packages [656 kB] 2024-04-19T02:47:26.115 INFO:teuthology.orchestra.run.smithi097.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal-updates/main Translation-en [517 kB] 2024-04-19T02:47:26.120 INFO:teuthology.orchestra.run.smithi096.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal-updates/universe i386 Packages [783 kB] 2024-04-19T02:47:26.122 INFO:teuthology.orchestra.run.smithi096.stdout:Get:17 http://security.ubuntu.com/ubuntu focal-security/main Translation-en [432 kB] 2024-04-19T02:47:26.130 INFO:teuthology.orchestra.run.smithi096.stdout:Get:18 http://security.ubuntu.com/ubuntu focal-security/main amd64 c-n-f Metadata [13.2 kB] 2024-04-19T02:47:26.130 INFO:teuthology.orchestra.run.smithi096.stdout:Get:19 http://security.ubuntu.com/ubuntu focal-security/restricted i386 Packages [36.4 kB] 2024-04-19T02:47:26.131 INFO:teuthology.orchestra.run.smithi096.stdout:Get:20 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 Packages [2,735 kB] 2024-04-19T02:47:26.133 INFO:teuthology.orchestra.run.smithi096.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/universe Translation-en [283 kB] 2024-04-19T02:47:26.136 INFO:teuthology.orchestra.run.smithi096.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 c-n-f Metadata [25.7 kB] 2024-04-19T02:47:26.136 INFO:teuthology.orchestra.run.smithi096.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 Packages [26.2 kB] 2024-04-19T02:47:26.137 INFO:teuthology.orchestra.run.smithi096.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/multiverse i386 Packages [8,444 B] 2024-04-19T02:47:26.137 INFO:teuthology.orchestra.run.smithi096.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/multiverse Translation-en [7,880 B] 2024-04-19T02:47:26.138 INFO:teuthology.orchestra.run.smithi097.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 c-n-f Metadata [17.2 kB] 2024-04-19T02:47:26.138 INFO:teuthology.orchestra.run.smithi097.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal-updates/restricted i386 Packages [37.7 kB] 2024-04-19T02:47:26.138 INFO:teuthology.orchestra.run.smithi096.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 c-n-f Metadata [620 B] 2024-04-19T02:47:26.138 INFO:teuthology.orchestra.run.smithi096.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 Packages [45.7 kB] 2024-04-19T02:47:26.138 INFO:teuthology.orchestra.run.smithi096.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal-backports/main i386 Packages [36.1 kB] 2024-04-19T02:47:26.139 INFO:teuthology.orchestra.run.smithi097.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 Packages [2,889 kB] 2024-04-19T02:47:26.167 INFO:teuthology.orchestra.run.smithi096.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 c-n-f Metadata [1,420 B] 2024-04-19T02:47:26.172 INFO:teuthology.orchestra.run.smithi097.stdout:Get:21 http://security.ubuntu.com/ubuntu focal-security/universe Translation-en [201 kB] 2024-04-19T02:47:26.175 INFO:teuthology.orchestra.run.smithi097.stdout:Get:22 http://security.ubuntu.com/ubuntu focal-security/universe amd64 c-n-f Metadata [19.2 kB] 2024-04-19T02:47:26.175 INFO:teuthology.orchestra.run.smithi097.stdout:Get:23 http://security.ubuntu.com/ubuntu focal-security/multiverse i386 Packages [7,200 B] 2024-04-19T02:47:26.175 INFO:teuthology.orchestra.run.smithi097.stdout:Get:24 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 Packages [24.0 kB] 2024-04-19T02:47:26.176 INFO:teuthology.orchestra.run.smithi097.stdout:Get:25 http://security.ubuntu.com/ubuntu focal-security/multiverse Translation-en [5,904 B] 2024-04-19T02:47:26.176 INFO:teuthology.orchestra.run.smithi097.stdout:Get:26 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 c-n-f Metadata [548 B] 2024-04-19T02:47:26.181 INFO:teuthology.orchestra.run.smithi144.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal-updates/universe i386 Packages [783 kB] 2024-04-19T02:47:26.186 INFO:teuthology.orchestra.run.smithi097.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal-updates/restricted Translation-en [403 kB] 2024-04-19T02:47:26.189 INFO:teuthology.orchestra.run.smithi144.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal-updates/universe Translation-en [283 kB] 2024-04-19T02:47:26.191 INFO:teuthology.orchestra.run.smithi144.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 c-n-f Metadata [25.7 kB] 2024-04-19T02:47:26.192 INFO:teuthology.orchestra.run.smithi097.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 c-n-f Metadata [552 B] 2024-04-19T02:47:26.192 INFO:teuthology.orchestra.run.smithi097.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 Packages [1,181 kB] 2024-04-19T02:47:26.192 INFO:teuthology.orchestra.run.smithi144.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal-updates/multiverse i386 Packages [8,444 B] 2024-04-19T02:47:26.193 INFO:teuthology.orchestra.run.smithi144.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 Packages [26.2 kB] 2024-04-19T02:47:26.193 INFO:teuthology.orchestra.run.smithi144.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal-updates/multiverse Translation-en [7,880 B] 2024-04-19T02:47:26.193 INFO:teuthology.orchestra.run.smithi144.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 c-n-f Metadata [620 B] 2024-04-19T02:47:26.194 INFO:teuthology.orchestra.run.smithi144.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal-backports/main i386 Packages [36.1 kB] 2024-04-19T02:47:26.194 INFO:teuthology.orchestra.run.smithi144.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 Packages [45.7 kB] 2024-04-19T02:47:26.210 INFO:teuthology.orchestra.run.smithi096.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal-backports/universe i386 Packages [13.8 kB] 2024-04-19T02:47:26.211 INFO:teuthology.orchestra.run.smithi096.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 Packages [25.0 kB] 2024-04-19T02:47:26.212 INFO:teuthology.orchestra.run.smithi096.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 c-n-f Metadata [880 B] 2024-04-19T02:47:26.213 INFO:teuthology.orchestra.run.smithi096.stdout:Get:33 http://security.ubuntu.com/ubuntu focal-security/restricted Translation-en [381 kB] 2024-04-19T02:47:26.216 INFO:teuthology.orchestra.run.smithi097.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal-updates/universe i386 Packages [783 kB] 2024-04-19T02:47:26.221 INFO:teuthology.orchestra.run.smithi096.stdout:Get:34 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 c-n-f Metadata [552 B] 2024-04-19T02:47:26.221 INFO:teuthology.orchestra.run.smithi096.stdout:Get:35 http://security.ubuntu.com/ubuntu focal-security/universe amd64 Packages [954 kB] 2024-04-19T02:47:26.226 INFO:teuthology.orchestra.run.smithi097.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal-updates/universe Translation-en [283 kB] 2024-04-19T02:47:26.230 INFO:teuthology.orchestra.run.smithi097.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 c-n-f Metadata [25.7 kB] 2024-04-19T02:47:26.230 INFO:teuthology.orchestra.run.smithi097.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 Packages [26.2 kB] 2024-04-19T02:47:26.231 INFO:teuthology.orchestra.run.smithi097.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal-updates/multiverse i386 Packages [8,444 B] 2024-04-19T02:47:26.231 INFO:teuthology.orchestra.run.smithi097.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal-updates/multiverse Translation-en [7,880 B] 2024-04-19T02:47:26.231 INFO:teuthology.orchestra.run.smithi144.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 c-n-f Metadata [1,420 B] 2024-04-19T02:47:26.231 INFO:teuthology.orchestra.run.smithi144.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal-backports/universe i386 Packages [13.8 kB] 2024-04-19T02:47:26.232 INFO:teuthology.orchestra.run.smithi144.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 Packages [25.0 kB] 2024-04-19T02:47:26.232 INFO:teuthology.orchestra.run.smithi144.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 c-n-f Metadata [880 B] 2024-04-19T02:47:26.238 INFO:teuthology.orchestra.run.smithi097.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 c-n-f Metadata [620 B] 2024-04-19T02:47:26.238 INFO:teuthology.orchestra.run.smithi097.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal-backports/main i386 Packages [36.1 kB] 2024-04-19T02:47:26.238 INFO:teuthology.orchestra.run.smithi097.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 Packages [45.7 kB] 2024-04-19T02:47:26.240 INFO:teuthology.orchestra.run.smithi096.stdout:Get:36 http://security.ubuntu.com/ubuntu focal-security/universe i386 Packages [656 kB] 2024-04-19T02:47:26.258 INFO:teuthology.orchestra.run.smithi097.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 c-n-f Metadata [1,420 B] 2024-04-19T02:47:26.258 INFO:teuthology.orchestra.run.smithi097.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal-backports/universe i386 Packages [13.8 kB] 2024-04-19T02:47:26.259 INFO:teuthology.orchestra.run.smithi097.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 Packages [25.0 kB] 2024-04-19T02:47:26.259 INFO:teuthology.orchestra.run.smithi097.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 c-n-f Metadata [880 B] 2024-04-19T02:47:26.423 INFO:teuthology.orchestra.run.smithi096.stdout:Get:37 http://security.ubuntu.com/ubuntu focal-security/universe Translation-en [201 kB] 2024-04-19T02:47:26.858 INFO:teuthology.orchestra.run.smithi096.stdout:Get:38 http://security.ubuntu.com/ubuntu focal-security/universe amd64 c-n-f Metadata [19.2 kB] 2024-04-19T02:47:26.864 INFO:teuthology.orchestra.run.smithi096.stdout:Get:39 http://security.ubuntu.com/ubuntu focal-security/multiverse i386 Packages [7,200 B] 2024-04-19T02:47:26.866 INFO:teuthology.orchestra.run.smithi096.stdout:Get:40 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 Packages [24.0 kB] 2024-04-19T02:47:26.873 INFO:teuthology.orchestra.run.smithi096.stdout:Get:41 http://security.ubuntu.com/ubuntu focal-security/multiverse Translation-en [5,904 B] 2024-04-19T02:47:26.875 INFO:teuthology.orchestra.run.smithi096.stdout:Get:42 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 c-n-f Metadata [548 B] 2024-04-19T02:47:26.954 INFO:teuthology.orchestra.run.smithi134.stdout:Get:7 http://security.ubuntu.com/ubuntu focal-security/main amd64 Packages [2,856 kB] 2024-04-19T02:47:28.108 INFO:teuthology.orchestra.run.smithi134.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main i386 Packages [967 kB] 2024-04-19T02:47:28.361 INFO:teuthology.orchestra.run.smithi134.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-updates/main Translation-en [517 kB] 2024-04-19T02:47:28.405 INFO:teuthology.orchestra.run.smithi134.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 c-n-f Metadata [17.2 kB] 2024-04-19T02:47:28.430 INFO:teuthology.orchestra.run.smithi134.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 Packages [2,889 kB] 2024-04-19T02:47:28.514 INFO:teuthology.orchestra.run.smithi134.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/restricted i386 Packages [37.7 kB] 2024-04-19T02:47:28.535 INFO:teuthology.orchestra.run.smithi134.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal-updates/restricted Translation-en [403 kB] 2024-04-19T02:47:28.562 INFO:teuthology.orchestra.run.smithi134.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 c-n-f Metadata [552 B] 2024-04-19T02:47:28.583 INFO:teuthology.orchestra.run.smithi134.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 Packages [1,181 kB] 2024-04-19T02:47:28.652 INFO:teuthology.orchestra.run.smithi134.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal-updates/universe i386 Packages [783 kB] 2024-04-19T02:47:28.683 INFO:teuthology.orchestra.run.smithi134.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal-updates/universe Translation-en [283 kB] 2024-04-19T02:47:28.706 INFO:teuthology.orchestra.run.smithi134.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 c-n-f Metadata [25.7 kB] 2024-04-19T02:47:28.733 INFO:teuthology.orchestra.run.smithi134.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal-updates/multiverse i386 Packages [8,444 B] 2024-04-19T02:47:28.763 INFO:teuthology.orchestra.run.smithi134.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 Packages [26.2 kB] 2024-04-19T02:47:28.796 INFO:teuthology.orchestra.run.smithi134.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/multiverse Translation-en [7,880 B] 2024-04-19T02:47:28.822 INFO:teuthology.orchestra.run.smithi134.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 c-n-f Metadata [620 B] 2024-04-19T02:47:28.905 INFO:teuthology.orchestra.run.smithi134.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 Packages [45.7 kB] 2024-04-19T02:47:28.937 INFO:teuthology.orchestra.run.smithi134.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-backports/main i386 Packages [36.1 kB] 2024-04-19T02:47:28.962 INFO:teuthology.orchestra.run.smithi134.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 c-n-f Metadata [1,420 B] 2024-04-19T02:47:28.998 INFO:teuthology.orchestra.run.smithi134.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal-backports/universe i386 Packages [13.8 kB] 2024-04-19T02:47:29.036 INFO:teuthology.orchestra.run.smithi134.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 Packages [25.0 kB] 2024-04-19T02:47:29.063 INFO:teuthology.orchestra.run.smithi134.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 c-n-f Metadata [880 B] 2024-04-19T02:47:29.731 INFO:teuthology.orchestra.run.smithi144.stdout:Fetched 19.9 MB in 3s (6,506 kB/s) 2024-04-19T02:47:29.824 INFO:teuthology.orchestra.run.smithi096.stdout:Fetched 19.9 MB in 3s (6,345 kB/s) 2024-04-19T02:47:29.963 INFO:teuthology.orchestra.run.smithi097.stdout:Fetched 19.9 MB in 3s (6,101 kB/s) 2024-04-19T02:47:31.182 INFO:teuthology.orchestra.run.smithi144.stdout:Reading package lists... 2024-04-19T02:47:31.209 DEBUG:teuthology.orchestra.run.smithi144:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-04-19T02:47:31.278 INFO:teuthology.orchestra.run.smithi144.stdout:Reading package lists... 2024-04-19T02:47:31.372 INFO:teuthology.orchestra.run.smithi096.stdout:Reading package lists... 2024-04-19T02:47:31.398 DEBUG:teuthology.orchestra.run.smithi096:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-04-19T02:47:31.437 INFO:teuthology.orchestra.run.smithi097.stdout:Reading package lists... 2024-04-19T02:47:31.462 DEBUG:teuthology.orchestra.run.smithi097:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-04-19T02:47:31.467 INFO:teuthology.orchestra.run.smithi096.stdout:Reading package lists... 2024-04-19T02:47:31.487 INFO:teuthology.orchestra.run.smithi144.stdout:Building dependency tree... 2024-04-19T02:47:31.488 INFO:teuthology.orchestra.run.smithi144.stdout:Reading state information... 2024-04-19T02:47:31.533 INFO:teuthology.orchestra.run.smithi097.stdout:Reading package lists... 2024-04-19T02:47:31.674 INFO:teuthology.orchestra.run.smithi096.stdout:Building dependency tree... 2024-04-19T02:47:31.675 INFO:teuthology.orchestra.run.smithi096.stdout:Reading state information... 2024-04-19T02:47:31.688 INFO:teuthology.orchestra.run.smithi144.stdout:The following additional packages will be installed: 2024-04-19T02:47:31.689 INFO:teuthology.orchestra.run.smithi144.stdout: linux-generic linux-headers-5.4.0-177 linux-headers-5.4.0-177-generic 2024-04-19T02:47:31.689 INFO:teuthology.orchestra.run.smithi144.stdout: linux-headers-generic linux-image-5.4.0-177-generic 2024-04-19T02:47:31.689 INFO:teuthology.orchestra.run.smithi144.stdout: linux-modules-5.4.0-177-generic linux-modules-extra-5.4.0-177-generic 2024-04-19T02:47:31.690 INFO:teuthology.orchestra.run.smithi144.stdout:Suggested packages: 2024-04-19T02:47:31.690 INFO:teuthology.orchestra.run.smithi144.stdout: fdutils linux-doc | linux-source-5.4.0 linux-tools 2024-04-19T02:47:31.690 INFO:teuthology.orchestra.run.smithi144.stdout:Recommended packages: 2024-04-19T02:47:31.690 INFO:teuthology.orchestra.run.smithi144.stdout: thermald 2024-04-19T02:47:31.744 INFO:teuthology.orchestra.run.smithi097.stdout:Building dependency tree... 2024-04-19T02:47:31.745 INFO:teuthology.orchestra.run.smithi097.stdout:Reading state information... 2024-04-19T02:47:31.748 INFO:teuthology.orchestra.run.smithi144.stdout:The following NEW packages will be installed: 2024-04-19T02:47:31.748 INFO:teuthology.orchestra.run.smithi144.stdout: linux-headers-5.4.0-177 linux-headers-5.4.0-177-generic 2024-04-19T02:47:31.748 INFO:teuthology.orchestra.run.smithi144.stdout: linux-image-5.4.0-177-generic linux-modules-5.4.0-177-generic 2024-04-19T02:47:31.748 INFO:teuthology.orchestra.run.smithi144.stdout: linux-modules-extra-5.4.0-177-generic 2024-04-19T02:47:31.750 INFO:teuthology.orchestra.run.smithi144.stdout:The following packages will be upgraded: 2024-04-19T02:47:31.750 INFO:teuthology.orchestra.run.smithi144.stdout: linux-generic linux-headers-generic linux-image-generic 2024-04-19T02:47:31.865 INFO:teuthology.orchestra.run.smithi096.stdout:The following additional packages will be installed: 2024-04-19T02:47:31.865 INFO:teuthology.orchestra.run.smithi096.stdout: linux-generic linux-headers-5.4.0-177 linux-headers-5.4.0-177-generic 2024-04-19T02:47:31.866 INFO:teuthology.orchestra.run.smithi096.stdout: linux-headers-generic linux-image-5.4.0-177-generic 2024-04-19T02:47:31.866 INFO:teuthology.orchestra.run.smithi096.stdout: linux-modules-5.4.0-177-generic linux-modules-extra-5.4.0-177-generic 2024-04-19T02:47:31.867 INFO:teuthology.orchestra.run.smithi096.stdout:Suggested packages: 2024-04-19T02:47:31.867 INFO:teuthology.orchestra.run.smithi096.stdout: fdutils linux-doc | linux-source-5.4.0 linux-tools 2024-04-19T02:47:31.867 INFO:teuthology.orchestra.run.smithi096.stdout:Recommended packages: 2024-04-19T02:47:31.867 INFO:teuthology.orchestra.run.smithi096.stdout: thermald 2024-04-19T02:47:31.923 INFO:teuthology.orchestra.run.smithi096.stdout:The following NEW packages will be installed: 2024-04-19T02:47:31.923 INFO:teuthology.orchestra.run.smithi096.stdout: linux-headers-5.4.0-177 linux-headers-5.4.0-177-generic 2024-04-19T02:47:31.923 INFO:teuthology.orchestra.run.smithi096.stdout: linux-image-5.4.0-177-generic linux-modules-5.4.0-177-generic 2024-04-19T02:47:31.924 INFO:teuthology.orchestra.run.smithi096.stdout: linux-modules-extra-5.4.0-177-generic 2024-04-19T02:47:31.925 INFO:teuthology.orchestra.run.smithi096.stdout:The following packages will be upgraded: 2024-04-19T02:47:31.925 INFO:teuthology.orchestra.run.smithi096.stdout: linux-generic linux-headers-generic linux-image-generic 2024-04-19T02:47:31.932 INFO:teuthology.orchestra.run.smithi144.stdout:3 upgraded, 5 newly installed, 0 to remove and 298 not upgraded. 2024-04-19T02:47:31.932 INFO:teuthology.orchestra.run.smithi144.stdout:Need to get 77.1 MB of archives. 2024-04-19T02:47:31.932 INFO:teuthology.orchestra.run.smithi144.stdout:After this operation, 380 MB of additional disk space will be used. 2024-04-19T02:47:31.932 INFO:teuthology.orchestra.run.smithi144.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-5.4.0-177-generic amd64 5.4.0-177.197 [15.0 MB] 2024-04-19T02:47:31.937 INFO:teuthology.orchestra.run.smithi097.stdout:The following additional packages will be installed: 2024-04-19T02:47:31.937 INFO:teuthology.orchestra.run.smithi097.stdout: linux-generic linux-headers-5.4.0-177 linux-headers-5.4.0-177-generic 2024-04-19T02:47:31.937 INFO:teuthology.orchestra.run.smithi097.stdout: linux-headers-generic linux-image-5.4.0-177-generic 2024-04-19T02:47:31.937 INFO:teuthology.orchestra.run.smithi097.stdout: linux-modules-5.4.0-177-generic linux-modules-extra-5.4.0-177-generic 2024-04-19T02:47:31.938 INFO:teuthology.orchestra.run.smithi097.stdout:Suggested packages: 2024-04-19T02:47:31.938 INFO:teuthology.orchestra.run.smithi097.stdout: fdutils linux-doc | linux-source-5.4.0 linux-tools 2024-04-19T02:47:31.939 INFO:teuthology.orchestra.run.smithi097.stdout:Recommended packages: 2024-04-19T02:47:31.939 INFO:teuthology.orchestra.run.smithi097.stdout: thermald 2024-04-19T02:47:32.007 INFO:teuthology.orchestra.run.smithi097.stdout:The following NEW packages will be installed: 2024-04-19T02:47:32.008 INFO:teuthology.orchestra.run.smithi097.stdout: linux-headers-5.4.0-177 linux-headers-5.4.0-177-generic 2024-04-19T02:47:32.008 INFO:teuthology.orchestra.run.smithi097.stdout: linux-image-5.4.0-177-generic linux-modules-5.4.0-177-generic 2024-04-19T02:47:32.008 INFO:teuthology.orchestra.run.smithi097.stdout: linux-modules-extra-5.4.0-177-generic 2024-04-19T02:47:32.009 INFO:teuthology.orchestra.run.smithi097.stdout:The following packages will be upgraded: 2024-04-19T02:47:32.010 INFO:teuthology.orchestra.run.smithi097.stdout: linux-generic linux-headers-generic linux-image-generic 2024-04-19T02:47:32.082 INFO:teuthology.orchestra.run.smithi097.stdout:3 upgraded, 5 newly installed, 0 to remove and 298 not upgraded. 2024-04-19T02:47:32.082 INFO:teuthology.orchestra.run.smithi097.stdout:Need to get 77.1 MB of archives. 2024-04-19T02:47:32.082 INFO:teuthology.orchestra.run.smithi097.stdout:After this operation, 380 MB of additional disk space will be used. 2024-04-19T02:47:32.082 INFO:teuthology.orchestra.run.smithi097.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-5.4.0-177-generic amd64 5.4.0-177.197 [15.0 MB] 2024-04-19T02:47:32.109 INFO:teuthology.orchestra.run.smithi096.stdout:3 upgraded, 5 newly installed, 0 to remove and 298 not upgraded. 2024-04-19T02:47:32.109 INFO:teuthology.orchestra.run.smithi096.stdout:Need to get 77.1 MB of archives. 2024-04-19T02:47:32.109 INFO:teuthology.orchestra.run.smithi096.stdout:After this operation, 380 MB of additional disk space will be used. 2024-04-19T02:47:32.109 INFO:teuthology.orchestra.run.smithi096.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-5.4.0-177-generic amd64 5.4.0-177.197 [15.0 MB] 2024-04-19T02:47:32.138 INFO:teuthology.orchestra.run.smithi134.stdout:Get:29 http://security.ubuntu.com/ubuntu focal-security/main Translation-en [432 kB] 2024-04-19T02:47:32.873 INFO:teuthology.orchestra.run.smithi097.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-5.4.0-177-generic amd64 5.4.0-177.197 [10.5 MB] 2024-04-19T02:47:32.931 INFO:teuthology.orchestra.run.smithi134.stdout:Get:30 http://security.ubuntu.com/ubuntu focal-security/main amd64 c-n-f Metadata [13.2 kB] 2024-04-19T02:47:32.945 INFO:teuthology.orchestra.run.smithi134.stdout:Get:31 http://security.ubuntu.com/ubuntu focal-security/restricted i386 Packages [36.4 kB] 2024-04-19T02:47:33.005 INFO:teuthology.orchestra.run.smithi134.stdout:Get:32 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 Packages [2,735 kB] 2024-04-19T02:47:33.071 INFO:teuthology.orchestra.run.smithi144.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-5.4.0-177-generic amd64 5.4.0-177.197 [10.5 MB] 2024-04-19T02:47:33.202 INFO:teuthology.orchestra.run.smithi097.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-extra-5.4.0-177-generic amd64 5.4.0-177.197 [39.2 MB] 2024-04-19T02:47:33.338 INFO:teuthology.orchestra.run.smithi144.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-extra-5.4.0-177-generic amd64 5.4.0-177.197 [39.2 MB] 2024-04-19T02:47:34.250 INFO:teuthology.orchestra.run.smithi097.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-generic amd64 5.4.0.177.175 [1,900 B] 2024-04-19T02:47:34.251 INFO:teuthology.orchestra.run.smithi097.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-generic amd64 5.4.0.177.175 [2,612 B] 2024-04-19T02:47:34.251 INFO:teuthology.orchestra.run.smithi097.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-177 all 5.4.0-177.197 [11.0 MB] 2024-04-19T02:47:34.390 INFO:teuthology.orchestra.run.smithi097.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-177-generic amd64 5.4.0-177.197 [1,377 kB] 2024-04-19T02:47:34.409 INFO:teuthology.orchestra.run.smithi097.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-generic amd64 5.4.0.177.175 [2,480 B] 2024-04-19T02:47:34.625 INFO:teuthology.orchestra.run.smithi144.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-generic amd64 5.4.0.177.175 [1,900 B] 2024-04-19T02:47:34.626 INFO:teuthology.orchestra.run.smithi144.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-generic amd64 5.4.0.177.175 [2,612 B] 2024-04-19T02:47:34.626 INFO:teuthology.orchestra.run.smithi144.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-177 all 5.4.0-177.197 [11.0 MB] 2024-04-19T02:47:34.904 INFO:teuthology.orchestra.run.smithi144.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-177-generic amd64 5.4.0-177.197 [1,377 kB] 2024-04-19T02:47:34.930 INFO:teuthology.orchestra.run.smithi144.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-generic amd64 5.4.0.177.175 [2,480 B] 2024-04-19T02:47:35.062 INFO:teuthology.orchestra.run.smithi097.stdout:Fetched 77.1 MB in 2s (32.2 MB/s) 2024-04-19T02:47:35.246 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package linux-modules-5.4.0-177-generic. 2024-04-19T02:47:35.598 INFO:teuthology.orchestra.run.smithi144.stdout:Fetched 77.1 MB in 3s (24.3 MB/s) 2024-04-19T02:47:35.789 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package linux-modules-5.4.0-177-generic. 2024-04-19T02:47:37.027 INFO:teuthology.orchestra.run.smithi097.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 104373 files and directories currently installed.) 2024-04-19T02:47:37.032 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../0-linux-modules-5.4.0-177-generic_5.4.0-177.197_amd64.deb ... 2024-04-19T02:47:37.085 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking linux-modules-5.4.0-177-generic (5.4.0-177.197) ... 2024-04-19T02:47:37.545 INFO:teuthology.orchestra.run.smithi144.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 104373 files and directories currently installed.) 2024-04-19T02:47:37.550 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../0-linux-modules-5.4.0-177-generic_5.4.0-177.197_amd64.deb ... 2024-04-19T02:47:37.638 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking linux-modules-5.4.0-177-generic (5.4.0-177.197) ... 2024-04-19T02:47:37.718 INFO:teuthology.orchestra.run.smithi134.stdout:Get:33 http://security.ubuntu.com/ubuntu focal-security/restricted Translation-en [381 kB] 2024-04-19T02:47:38.330 INFO:teuthology.orchestra.run.smithi134.stdout:Get:34 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 c-n-f Metadata [552 B] 2024-04-19T02:47:38.331 INFO:teuthology.orchestra.run.smithi134.stdout:Get:35 http://security.ubuntu.com/ubuntu focal-security/universe i386 Packages [656 kB] 2024-04-19T02:47:38.968 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package linux-image-5.4.0-177-generic. 2024-04-19T02:47:38.982 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../1-linux-image-5.4.0-177-generic_5.4.0-177.197_amd64.deb ... 2024-04-19T02:47:39.086 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking linux-image-5.4.0-177-generic (5.4.0-177.197) ... 2024-04-19T02:47:39.170 INFO:teuthology.orchestra.run.smithi134.stdout:Get:36 http://security.ubuntu.com/ubuntu focal-security/universe amd64 Packages [954 kB] 2024-04-19T02:47:39.520 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package linux-image-5.4.0-177-generic. 2024-04-19T02:47:39.536 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../1-linux-image-5.4.0-177-generic_5.4.0-177.197_amd64.deb ... 2024-04-19T02:47:39.644 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking linux-image-5.4.0-177-generic (5.4.0-177.197) ... 2024-04-19T02:47:40.380 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package linux-modules-extra-5.4.0-177-generic. 2024-04-19T02:47:40.394 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../2-linux-modules-extra-5.4.0-177-generic_5.4.0-177.197_amd64.deb ... 2024-04-19T02:47:40.429 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking linux-modules-extra-5.4.0-177-generic (5.4.0-177.197) ... 2024-04-19T02:47:40.756 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package linux-modules-extra-5.4.0-177-generic. 2024-04-19T02:47:40.769 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../2-linux-modules-extra-5.4.0-177-generic_5.4.0-177.197_amd64.deb ... 2024-04-19T02:47:40.787 INFO:teuthology.orchestra.run.smithi134.stdout:Get:37 http://security.ubuntu.com/ubuntu focal-security/universe Translation-en [201 kB] 2024-04-19T02:47:40.814 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking linux-modules-extra-5.4.0-177-generic (5.4.0-177.197) ... 2024-04-19T02:47:41.220 INFO:teuthology.orchestra.run.smithi134.stdout:Get:38 http://security.ubuntu.com/ubuntu focal-security/universe amd64 c-n-f Metadata [19.2 kB] 2024-04-19T02:47:41.225 INFO:teuthology.orchestra.run.smithi134.stdout:Get:39 http://security.ubuntu.com/ubuntu focal-security/multiverse i386 Packages [7,200 B] 2024-04-19T02:47:41.227 INFO:teuthology.orchestra.run.smithi134.stdout:Get:40 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 Packages [24.0 kB] 2024-04-19T02:47:41.234 INFO:teuthology.orchestra.run.smithi134.stdout:Get:41 http://security.ubuntu.com/ubuntu focal-security/multiverse Translation-en [5,904 B] 2024-04-19T02:47:41.236 INFO:teuthology.orchestra.run.smithi134.stdout:Get:42 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 c-n-f Metadata [548 B] 2024-04-19T02:47:43.285 INFO:teuthology.orchestra.run.smithi134.stdout:Fetched 19.9 MB in 16s (1,208 kB/s) 2024-04-19T02:47:44.774 INFO:teuthology.orchestra.run.smithi134.stdout:Reading package lists... 2024-04-19T02:47:44.803 DEBUG:teuthology.orchestra.run.smithi134:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-04-19T02:47:44.876 INFO:teuthology.orchestra.run.smithi134.stdout:Reading package lists... 2024-04-19T02:47:44.877 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../3-linux-generic_5.4.0.177.175_amd64.deb ... 2024-04-19T02:47:45.001 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking linux-generic (5.4.0.177.175) over (5.4.0.124.125) ... 2024-04-19T02:47:45.088 INFO:teuthology.orchestra.run.smithi134.stdout:Building dependency tree... 2024-04-19T02:47:45.088 INFO:teuthology.orchestra.run.smithi134.stdout:Reading state information... 2024-04-19T02:47:45.291 INFO:teuthology.orchestra.run.smithi134.stdout:The following additional packages will be installed: 2024-04-19T02:47:45.291 INFO:teuthology.orchestra.run.smithi134.stdout: linux-generic linux-headers-5.4.0-177 linux-headers-5.4.0-177-generic 2024-04-19T02:47:45.291 INFO:teuthology.orchestra.run.smithi134.stdout: linux-headers-generic linux-image-5.4.0-177-generic 2024-04-19T02:47:45.291 INFO:teuthology.orchestra.run.smithi134.stdout: linux-modules-5.4.0-177-generic linux-modules-extra-5.4.0-177-generic 2024-04-19T02:47:45.292 INFO:teuthology.orchestra.run.smithi134.stdout:Suggested packages: 2024-04-19T02:47:45.292 INFO:teuthology.orchestra.run.smithi134.stdout: fdutils linux-doc | linux-source-5.4.0 linux-tools 2024-04-19T02:47:45.292 INFO:teuthology.orchestra.run.smithi134.stdout:Recommended packages: 2024-04-19T02:47:45.292 INFO:teuthology.orchestra.run.smithi134.stdout: thermald 2024-04-19T02:47:45.354 INFO:teuthology.orchestra.run.smithi134.stdout:The following NEW packages will be installed: 2024-04-19T02:47:45.354 INFO:teuthology.orchestra.run.smithi134.stdout: linux-headers-5.4.0-177 linux-headers-5.4.0-177-generic 2024-04-19T02:47:45.354 INFO:teuthology.orchestra.run.smithi134.stdout: linux-image-5.4.0-177-generic linux-modules-5.4.0-177-generic 2024-04-19T02:47:45.355 INFO:teuthology.orchestra.run.smithi134.stdout: linux-modules-extra-5.4.0-177-generic 2024-04-19T02:47:45.356 INFO:teuthology.orchestra.run.smithi134.stdout:The following packages will be upgraded: 2024-04-19T02:47:45.357 INFO:teuthology.orchestra.run.smithi134.stdout: linux-generic linux-headers-generic linux-image-generic 2024-04-19T02:47:45.363 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../4-linux-image-generic_5.4.0.177.175_amd64.deb ... 2024-04-19T02:47:45.414 INFO:teuthology.orchestra.run.smithi134.stdout:3 upgraded, 5 newly installed, 0 to remove and 298 not upgraded. 2024-04-19T02:47:45.414 INFO:teuthology.orchestra.run.smithi134.stdout:Need to get 77.1 MB of archives. 2024-04-19T02:47:45.414 INFO:teuthology.orchestra.run.smithi134.stdout:After this operation, 380 MB of additional disk space will be used. 2024-04-19T02:47:45.414 INFO:teuthology.orchestra.run.smithi134.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-5.4.0-177-generic amd64 5.4.0-177.197 [15.0 MB] 2024-04-19T02:47:45.488 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking linux-image-generic (5.4.0.177.175) over (5.4.0.124.125) ... 2024-04-19T02:47:45.693 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../3-linux-generic_5.4.0.177.175_amd64.deb ... 2024-04-19T02:47:45.818 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package linux-headers-5.4.0-177. 2024-04-19T02:47:45.819 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking linux-generic (5.4.0.177.175) over (5.4.0.124.125) ... 2024-04-19T02:47:45.831 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../5-linux-headers-5.4.0-177_5.4.0-177.197_all.deb ... 2024-04-19T02:47:45.876 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking linux-headers-5.4.0-177 (5.4.0-177.197) ... 2024-04-19T02:47:45.941 INFO:teuthology.orchestra.run.smithi134.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-5.4.0-177-generic amd64 5.4.0-177.197 [10.5 MB] 2024-04-19T02:47:46.105 INFO:teuthology.orchestra.run.smithi134.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-extra-5.4.0-177-generic amd64 5.4.0-177.197 [39.2 MB] 2024-04-19T02:47:46.145 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../4-linux-image-generic_5.4.0.177.175_amd64.deb ... 2024-04-19T02:47:46.298 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking linux-image-generic (5.4.0.177.175) over (5.4.0.124.125) ... 2024-04-19T02:47:46.651 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package linux-headers-5.4.0-177. 2024-04-19T02:47:46.667 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../5-linux-headers-5.4.0-177_5.4.0-177.197_all.deb ... 2024-04-19T02:47:46.709 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking linux-headers-5.4.0-177 (5.4.0-177.197) ... 2024-04-19T02:47:46.908 INFO:teuthology.orchestra.run.smithi134.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-generic amd64 5.4.0.177.175 [1,900 B] 2024-04-19T02:47:46.908 INFO:teuthology.orchestra.run.smithi134.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-generic amd64 5.4.0.177.175 [2,612 B] 2024-04-19T02:47:46.908 INFO:teuthology.orchestra.run.smithi134.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-177 all 5.4.0-177.197 [11.0 MB] 2024-04-19T02:47:47.210 INFO:teuthology.orchestra.run.smithi134.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-177-generic amd64 5.4.0-177.197 [1,377 kB] 2024-04-19T02:47:47.251 INFO:teuthology.orchestra.run.smithi134.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-generic amd64 5.4.0.177.175 [2,480 B] 2024-04-19T02:47:47.972 INFO:teuthology.orchestra.run.smithi134.stdout:Fetched 77.1 MB in 2s (40.8 MB/s) 2024-04-19T02:47:48.155 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package linux-modules-5.4.0-177-generic. 2024-04-19T02:47:49.227 INFO:teuthology.orchestra.run.smithi096.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-5.4.0-177-generic amd64 5.4.0-177.197 [10.5 MB] 2024-04-19T02:47:49.885 INFO:teuthology.orchestra.run.smithi134.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 104373 files and directories currently installed.) 2024-04-19T02:47:49.890 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../0-linux-modules-5.4.0-177-generic_5.4.0-177.197_amd64.deb ... 2024-04-19T02:47:49.986 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking linux-modules-5.4.0-177-generic (5.4.0-177.197) ... 2024-04-19T02:47:51.150 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package linux-headers-5.4.0-177-generic. 2024-04-19T02:47:51.173 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../6-linux-headers-5.4.0-177-generic_5.4.0-177.197_amd64.deb ... 2024-04-19T02:47:51.217 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking linux-headers-5.4.0-177-generic (5.4.0-177.197) ... 2024-04-19T02:47:52.062 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package linux-image-5.4.0-177-generic. 2024-04-19T02:47:52.075 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../1-linux-image-5.4.0-177-generic_5.4.0-177.197_amd64.deb ... 2024-04-19T02:47:52.178 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking linux-image-5.4.0-177-generic (5.4.0-177.197) ... 2024-04-19T02:47:52.870 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package linux-headers-5.4.0-177-generic. 2024-04-19T02:47:52.893 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../6-linux-headers-5.4.0-177-generic_5.4.0-177.197_amd64.deb ... 2024-04-19T02:47:52.936 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking linux-headers-5.4.0-177-generic (5.4.0-177.197) ... 2024-04-19T02:47:53.273 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package linux-modules-extra-5.4.0-177-generic. 2024-04-19T02:47:53.289 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../2-linux-modules-extra-5.4.0-177-generic_5.4.0-177.197_amd64.deb ... 2024-04-19T02:47:53.331 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking linux-modules-extra-5.4.0-177-generic (5.4.0-177.197) ... 2024-04-19T02:47:53.829 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../7-linux-headers-generic_5.4.0.177.175_amd64.deb ... 2024-04-19T02:47:53.957 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking linux-headers-generic (5.4.0.177.175) over (5.4.0.124.125) ... 2024-04-19T02:47:54.280 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up linux-modules-5.4.0-177-generic (5.4.0-177.197) ... 2024-04-19T02:47:55.262 INFO:teuthology.orchestra.run.smithi096.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-extra-5.4.0-177-generic amd64 5.4.0-177.197 [39.2 MB] 2024-04-19T02:47:55.478 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../7-linux-headers-generic_5.4.0.177.175_amd64.deb ... 2024-04-19T02:47:55.489 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up linux-headers-5.4.0-177 (5.4.0-177.197) ... 2024-04-19T02:47:55.615 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking linux-headers-generic (5.4.0.177.175) over (5.4.0.124.125) ... 2024-04-19T02:47:55.723 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up linux-headers-5.4.0-177-generic (5.4.0-177.197) ... 2024-04-19T02:47:55.850 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up linux-image-5.4.0-177-generic (5.4.0-177.197) ... 2024-04-19T02:47:56.226 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up linux-modules-5.4.0-177-generic (5.4.0-177.197) ... 2024-04-19T02:47:56.997 INFO:teuthology.orchestra.run.smithi097.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.4.0-177-generic 2024-04-19T02:47:56.997 INFO:teuthology.orchestra.run.smithi097.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.4.0-177-generic 2024-04-19T02:47:57.118 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up linux-headers-generic (5.4.0.177.175) ... 2024-04-19T02:47:57.244 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up linux-modules-extra-5.4.0-177-generic (5.4.0-177.197) ... 2024-04-19T02:47:57.437 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up linux-headers-5.4.0-177 (5.4.0-177.197) ... 2024-04-19T02:47:57.563 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up linux-headers-5.4.0-177-generic (5.4.0-177.197) ... 2024-04-19T02:47:57.723 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up linux-image-5.4.0-177-generic (5.4.0-177.197) ... 2024-04-19T02:47:58.086 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../3-linux-generic_5.4.0.177.175_amd64.deb ... 2024-04-19T02:47:58.212 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking linux-generic (5.4.0.177.175) over (5.4.0.124.125) ... 2024-04-19T02:47:58.429 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up linux-image-generic (5.4.0.177.175) ... 2024-04-19T02:47:58.545 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../4-linux-image-generic_5.4.0.177.175_amd64.deb ... 2024-04-19T02:47:58.555 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up linux-generic (5.4.0.177.175) ... 2024-04-19T02:47:58.681 INFO:teuthology.orchestra.run.smithi097.stdout:Processing triggers for linux-image-5.4.0-177-generic (5.4.0-177.197) ... 2024-04-19T02:47:58.699 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking linux-image-generic (5.4.0.177.175) over (5.4.0.124.125) ... 2024-04-19T02:47:58.760 INFO:teuthology.orchestra.run.smithi097.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-04-19T02:47:58.760 INFO:teuthology.orchestra.run.smithi097.stdout:update-initramfs: Generating /boot/initrd.img-5.4.0-177-generic 2024-04-19T02:47:58.882 INFO:teuthology.orchestra.run.smithi144.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.4.0-177-generic 2024-04-19T02:47:58.882 INFO:teuthology.orchestra.run.smithi144.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.4.0-177-generic 2024-04-19T02:47:59.017 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up linux-headers-generic (5.4.0.177.175) ... 2024-04-19T02:47:59.018 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package linux-headers-5.4.0-177. 2024-04-19T02:47:59.033 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../5-linux-headers-5.4.0-177_5.4.0-177.197_all.deb ... 2024-04-19T02:47:59.076 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking linux-headers-5.4.0-177 (5.4.0-177.197) ... 2024-04-19T02:47:59.159 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up linux-modules-extra-5.4.0-177-generic (5.4.0-177.197) ... 2024-04-19T02:48:00.353 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up linux-image-generic (5.4.0.177.175) ... 2024-04-19T02:48:00.479 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up linux-generic (5.4.0.177.175) ... 2024-04-19T02:48:00.630 INFO:teuthology.orchestra.run.smithi144.stdout:Processing triggers for linux-image-5.4.0-177-generic (5.4.0-177.197) ... 2024-04-19T02:48:00.696 INFO:teuthology.orchestra.run.smithi144.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-04-19T02:48:00.696 INFO:teuthology.orchestra.run.smithi144.stdout:update-initramfs: Generating /boot/initrd.img-5.4.0-177-generic 2024-04-19T02:48:05.026 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package linux-headers-5.4.0-177-generic. 2024-04-19T02:48:05.049 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../6-linux-headers-5.4.0-177-generic_5.4.0-177.197_amd64.deb ... 2024-04-19T02:48:05.109 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking linux-headers-5.4.0-177-generic (5.4.0-177.197) ... 2024-04-19T02:48:08.030 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../7-linux-headers-generic_5.4.0.177.175_amd64.deb ... 2024-04-19T02:48:08.158 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking linux-headers-generic (5.4.0.177.175) over (5.4.0.124.125) ... 2024-04-19T02:48:08.511 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up linux-modules-5.4.0-177-generic (5.4.0-177.197) ... 2024-04-19T02:48:09.731 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up linux-headers-5.4.0-177 (5.4.0-177.197) ... 2024-04-19T02:48:09.832 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up linux-headers-5.4.0-177-generic (5.4.0-177.197) ... 2024-04-19T02:48:09.933 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up linux-image-5.4.0-177-generic (5.4.0-177.197) ... 2024-04-19T02:48:11.087 INFO:teuthology.orchestra.run.smithi134.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.4.0-177-generic 2024-04-19T02:48:11.087 INFO:teuthology.orchestra.run.smithi134.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.4.0-177-generic 2024-04-19T02:48:11.218 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up linux-headers-generic (5.4.0.177.175) ... 2024-04-19T02:48:11.344 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up linux-modules-extra-5.4.0-177-generic (5.4.0-177.197) ... 2024-04-19T02:48:12.529 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up linux-image-generic (5.4.0.177.175) ... 2024-04-19T02:48:12.655 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up linux-generic (5.4.0.177.175) ... 2024-04-19T02:48:12.757 INFO:teuthology.orchestra.run.smithi134.stdout:Processing triggers for linux-image-5.4.0-177-generic (5.4.0-177.197) ... 2024-04-19T02:48:12.839 INFO:teuthology.orchestra.run.smithi134.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-04-19T02:48:12.839 INFO:teuthology.orchestra.run.smithi134.stdout:update-initramfs: Generating /boot/initrd.img-5.4.0-177-generic 2024-04-19T02:48:20.469 INFO:teuthology.orchestra.run.smithi097.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-04-19T02:48:20.469 INFO:teuthology.orchestra.run.smithi097.stdout:Sourcing file `/etc/default/grub' 2024-04-19T02:48:20.476 INFO:teuthology.orchestra.run.smithi097.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-19T02:48:20.488 INFO:teuthology.orchestra.run.smithi097.stdout:Generating grub configuration file ... 2024-04-19T02:48:20.795 INFO:teuthology.orchestra.run.smithi097.stdout:Found linux image: /boot/vmlinuz-5.4.0-177-generic 2024-04-19T02:48:20.820 INFO:teuthology.orchestra.run.smithi097.stdout:Found initrd image: /boot/initrd.img-5.4.0-177-generic 2024-04-19T02:48:21.210 INFO:teuthology.orchestra.run.smithi097.stdout:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2024-04-19T02:48:21.221 INFO:teuthology.orchestra.run.smithi097.stdout:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2024-04-19T02:48:22.868 INFO:teuthology.orchestra.run.smithi144.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-04-19T02:48:22.868 INFO:teuthology.orchestra.run.smithi144.stdout:Sourcing file `/etc/default/grub' 2024-04-19T02:48:22.889 INFO:teuthology.orchestra.run.smithi144.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-19T02:48:22.900 INFO:teuthology.orchestra.run.smithi144.stdout:Generating grub configuration file ... 2024-04-19T02:48:22.989 INFO:teuthology.orchestra.run.smithi097.stdout:done 2024-04-19T02:48:23.234 INFO:teuthology.orchestra.run.smithi144.stdout:Found linux image: /boot/vmlinuz-5.4.0-177-generic 2024-04-19T02:48:23.253 INFO:teuthology.orchestra.run.smithi144.stdout:Found initrd image: /boot/initrd.img-5.4.0-177-generic 2024-04-19T02:48:23.392 DEBUG:teuthology.orchestra.run.smithi097:> dpkg -s linux-image-generic 2024-04-19T02:48:23.441 INFO:teuthology.orchestra.run.smithi097.stdout:Package: linux-image-generic 2024-04-19T02:48:23.441 INFO:teuthology.orchestra.run.smithi097.stdout:Status: install ok installed 2024-04-19T02:48:23.441 INFO:teuthology.orchestra.run.smithi097.stdout:Priority: optional 2024-04-19T02:48:23.441 INFO:teuthology.orchestra.run.smithi097.stdout:Section: kernel 2024-04-19T02:48:23.441 INFO:teuthology.orchestra.run.smithi097.stdout:Installed-Size: 20 2024-04-19T02:48:23.441 INFO:teuthology.orchestra.run.smithi097.stdout:Maintainer: Ubuntu Kernel Team 2024-04-19T02:48:23.441 INFO:teuthology.orchestra.run.smithi097.stdout:Architecture: amd64 2024-04-19T02:48:23.441 INFO:teuthology.orchestra.run.smithi097.stdout:Source: linux-meta 2024-04-19T02:48:23.441 INFO:teuthology.orchestra.run.smithi097.stdout:Version: 5.4.0.177.175 2024-04-19T02:48:23.441 INFO:teuthology.orchestra.run.smithi097.stdout:Provides: virtualbox-guest-modules (= 6.1.50-dfsg-1~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.17) 2024-04-19T02:48:23.442 INFO:teuthology.orchestra.run.smithi097.stdout:Depends: linux-image-5.4.0-177-generic, linux-modules-extra-5.4.0-177-generic, linux-firmware, intel-microcode, amd64-microcode 2024-04-19T02:48:23.442 INFO:teuthology.orchestra.run.smithi097.stdout:Recommends: thermald 2024-04-19T02:48:23.442 INFO:teuthology.orchestra.run.smithi097.stdout:Description: Generic Linux kernel image 2024-04-19T02:48:23.442 INFO:teuthology.orchestra.run.smithi097.stdout: This package will always depend on the latest generic kernel image 2024-04-19T02:48:23.442 INFO:teuthology.orchestra.run.smithi097.stdout: available. 2024-04-19T02:48:23.442 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.4.0-124-generic Expected: 5.4.0-177-generic 2024-04-19T02:48:23.442 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-04-19T02:48:23.442 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-04-19T02:48:23.442 INFO:teuthology.task.kernel:Installing distro kernel on osd.0... 2024-04-19T02:48:23.442 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi097.front.sepia.ceph.com, path=None, version=distro) 2024-04-19T02:48:23.443 DEBUG:teuthology.orchestra.run.smithi097:> sudo apt-get clean 2024-04-19T02:48:23.539 DEBUG:teuthology.orchestra.run.smithi097:> sudo apt-get update 2024-04-19T02:48:23.629 INFO:teuthology.orchestra.run.smithi144.stdout:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2024-04-19T02:48:23.641 INFO:teuthology.orchestra.run.smithi144.stdout:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2024-04-19T02:48:23.722 INFO:teuthology.orchestra.run.smithi097.stdout:Hit:1 http://security.ubuntu.com/ubuntu focal-security InRelease 2024-04-19T02:48:23.723 INFO:teuthology.orchestra.run.smithi097.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal InRelease 2024-04-19T02:48:23.767 INFO:teuthology.orchestra.run.smithi097.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2024-04-19T02:48:23.828 INFO:teuthology.orchestra.run.smithi097.stdout:Hit:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2024-04-19T02:48:25.517 INFO:teuthology.orchestra.run.smithi097.stdout:Reading package lists... 2024-04-19T02:48:25.544 DEBUG:teuthology.orchestra.run.smithi097:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-04-19T02:48:25.612 INFO:teuthology.orchestra.run.smithi097.stdout:Reading package lists... 2024-04-19T02:48:25.665 INFO:teuthology.orchestra.run.smithi144.stdout:done 2024-04-19T02:48:25.824 INFO:teuthology.orchestra.run.smithi097.stdout:Building dependency tree... 2024-04-19T02:48:25.825 INFO:teuthology.orchestra.run.smithi097.stdout:Reading state information... 2024-04-19T02:48:26.020 DEBUG:teuthology.orchestra.run.smithi144:> dpkg -s linux-image-generic 2024-04-19T02:48:26.058 INFO:teuthology.orchestra.run.smithi097.stdout:linux-image-generic is already the newest version (5.4.0.177.175). 2024-04-19T02:48:26.058 INFO:teuthology.orchestra.run.smithi097.stdout:0 upgraded, 0 newly installed, 0 to remove and 298 not upgraded. 2024-04-19T02:48:26.060 DEBUG:teuthology.orchestra.run.smithi097:> dpkg -s linux-image-generic 2024-04-19T02:48:26.074 INFO:teuthology.orchestra.run.smithi144.stdout:Package: linux-image-generic 2024-04-19T02:48:26.075 INFO:teuthology.orchestra.run.smithi144.stdout:Status: install ok installed 2024-04-19T02:48:26.075 INFO:teuthology.orchestra.run.smithi144.stdout:Priority: optional 2024-04-19T02:48:26.075 INFO:teuthology.orchestra.run.smithi144.stdout:Section: kernel 2024-04-19T02:48:26.075 INFO:teuthology.orchestra.run.smithi144.stdout:Installed-Size: 20 2024-04-19T02:48:26.075 INFO:teuthology.orchestra.run.smithi144.stdout:Maintainer: Ubuntu Kernel Team 2024-04-19T02:48:26.075 INFO:teuthology.orchestra.run.smithi144.stdout:Architecture: amd64 2024-04-19T02:48:26.075 INFO:teuthology.orchestra.run.smithi144.stdout:Source: linux-meta 2024-04-19T02:48:26.075 INFO:teuthology.orchestra.run.smithi144.stdout:Version: 5.4.0.177.175 2024-04-19T02:48:26.075 INFO:teuthology.orchestra.run.smithi144.stdout:Provides: virtualbox-guest-modules (= 6.1.50-dfsg-1~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.17) 2024-04-19T02:48:26.075 INFO:teuthology.orchestra.run.smithi144.stdout:Depends: linux-image-5.4.0-177-generic, linux-modules-extra-5.4.0-177-generic, linux-firmware, intel-microcode, amd64-microcode 2024-04-19T02:48:26.075 INFO:teuthology.orchestra.run.smithi144.stdout:Recommends: thermald 2024-04-19T02:48:26.075 INFO:teuthology.orchestra.run.smithi144.stdout:Description: Generic Linux kernel image 2024-04-19T02:48:26.075 INFO:teuthology.orchestra.run.smithi144.stdout: This package will always depend on the latest generic kernel image 2024-04-19T02:48:26.075 INFO:teuthology.orchestra.run.smithi144.stdout: available. 2024-04-19T02:48:26.076 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.4.0-124-generic Expected: 5.4.0-177-generic 2024-04-19T02:48:26.076 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-04-19T02:48:26.076 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-04-19T02:48:26.076 INFO:teuthology.task.kernel:Installing distro kernel on osd.2... 2024-04-19T02:48:26.076 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi144.front.sepia.ceph.com, path=None, version=distro) 2024-04-19T02:48:26.076 DEBUG:teuthology.orchestra.run.smithi144:> sudo apt-get clean 2024-04-19T02:48:26.081 INFO:teuthology.orchestra.run.smithi097.stdout:Package: linux-image-generic 2024-04-19T02:48:26.081 INFO:teuthology.orchestra.run.smithi097.stdout:Status: install ok installed 2024-04-19T02:48:26.081 INFO:teuthology.orchestra.run.smithi097.stdout:Priority: optional 2024-04-19T02:48:26.081 INFO:teuthology.orchestra.run.smithi097.stdout:Section: kernel 2024-04-19T02:48:26.081 INFO:teuthology.orchestra.run.smithi097.stdout:Installed-Size: 20 2024-04-19T02:48:26.081 INFO:teuthology.orchestra.run.smithi097.stdout:Maintainer: Ubuntu Kernel Team 2024-04-19T02:48:26.081 INFO:teuthology.orchestra.run.smithi097.stdout:Architecture: amd64 2024-04-19T02:48:26.082 INFO:teuthology.orchestra.run.smithi097.stdout:Source: linux-meta 2024-04-19T02:48:26.082 INFO:teuthology.orchestra.run.smithi097.stdout:Version: 5.4.0.177.175 2024-04-19T02:48:26.082 INFO:teuthology.orchestra.run.smithi097.stdout:Provides: virtualbox-guest-modules (= 6.1.50-dfsg-1~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.17) 2024-04-19T02:48:26.082 INFO:teuthology.orchestra.run.smithi097.stdout:Depends: linux-image-5.4.0-177-generic, linux-modules-extra-5.4.0-177-generic, linux-firmware, intel-microcode, amd64-microcode 2024-04-19T02:48:26.082 INFO:teuthology.orchestra.run.smithi097.stdout:Recommends: thermald 2024-04-19T02:48:26.082 INFO:teuthology.orchestra.run.smithi097.stdout:Description: Generic Linux kernel image 2024-04-19T02:48:26.082 INFO:teuthology.orchestra.run.smithi097.stdout: This package will always depend on the latest generic kernel image 2024-04-19T02:48:26.082 INFO:teuthology.orchestra.run.smithi097.stdout: available. 2024-04-19T02:48:26.083 DEBUG:teuthology.orchestra.run.smithi097:> mktemp 2024-04-19T02:48:26.088 INFO:teuthology.orchestra.run.smithi097.stdout:/tmp/tmp.Bud40STckF 2024-04-19T02:48:26.088 DEBUG:teuthology.orchestra.run.smithi097:> sudo cp /boot/grub/grub.cfg /tmp/tmp.Bud40STckF 2024-04-19T02:48:26.099 DEBUG:teuthology.orchestra.run.smithi097:> sudo chmod 0666 /tmp/tmp.Bud40STckF 2024-04-19T02:48:26.168 DEBUG:teuthology.orchestra.run.smithi144:> sudo apt-get update 2024-04-19T02:48:26.187 DEBUG:teuthology.orchestra.remote:smithi097:/tmp/tmp.Bud40STckF is 9KB 2024-04-19T02:48:26.200 DEBUG:teuthology.orchestra.run.smithi097:> rm -fr /tmp/tmp.Bud40STckF 2024-04-19T02:48:26.206 DEBUG:teuthology.orchestra.run.smithi097:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-04-19T02:48:26.264 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-04-19T02:48:26.264 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-04-19T02:48:26.264 DEBUG:teuthology.orchestra.run.smithi097:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-04-19T02:48:26.298 INFO:teuthology.task.kernel:Distro Kernel Version: 5.4.0-177-generic 2024-04-19T02:48:26.299 DEBUG:teuthology.orchestra.run.smithi097:> sudo update-grub 2024-04-19T02:48:26.350 INFO:teuthology.orchestra.run.smithi144.stdout:Hit:1 http://security.ubuntu.com/ubuntu focal-security InRelease 2024-04-19T02:48:26.414 INFO:teuthology.orchestra.run.smithi144.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal InRelease 2024-04-19T02:48:26.496 INFO:teuthology.orchestra.run.smithi144.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2024-04-19T02:48:26.579 INFO:teuthology.orchestra.run.smithi144.stdout:Hit:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2024-04-19T02:48:27.537 INFO:teuthology.orchestra.run.smithi097.stderr:Sourcing file `/etc/default/grub' 2024-04-19T02:48:27.538 INFO:teuthology.orchestra.run.smithi097.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-19T02:48:27.554 INFO:teuthology.orchestra.run.smithi097.stderr:Generating grub configuration file ... 2024-04-19T02:48:27.812 INFO:teuthology.orchestra.run.smithi097.stderr:Found linux image: /boot/vmlinuz-5.4.0-177-generic 2024-04-19T02:48:27.824 INFO:teuthology.orchestra.run.smithi097.stderr:Found initrd image: /boot/initrd.img-5.4.0-177-generic 2024-04-19T02:48:28.134 INFO:teuthology.orchestra.run.smithi144.stdout:Reading package lists... 2024-04-19T02:48:28.159 DEBUG:teuthology.orchestra.run.smithi144:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-04-19T02:48:28.177 INFO:teuthology.orchestra.run.smithi097.stderr:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2024-04-19T02:48:28.189 INFO:teuthology.orchestra.run.smithi097.stderr:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2024-04-19T02:48:28.225 INFO:teuthology.orchestra.run.smithi144.stdout:Reading package lists... 2024-04-19T02:48:28.413 INFO:teuthology.orchestra.run.smithi144.stdout:Building dependency tree... 2024-04-19T02:48:28.414 INFO:teuthology.orchestra.run.smithi144.stdout:Reading state information... 2024-04-19T02:48:28.632 INFO:teuthology.orchestra.run.smithi144.stdout:linux-image-generic is already the newest version (5.4.0.177.175). 2024-04-19T02:48:28.632 INFO:teuthology.orchestra.run.smithi144.stdout:0 upgraded, 0 newly installed, 0 to remove and 298 not upgraded. 2024-04-19T02:48:28.634 DEBUG:teuthology.orchestra.run.smithi144:> dpkg -s linux-image-generic 2024-04-19T02:48:28.655 INFO:teuthology.orchestra.run.smithi144.stdout:Package: linux-image-generic 2024-04-19T02:48:28.655 INFO:teuthology.orchestra.run.smithi144.stdout:Status: install ok installed 2024-04-19T02:48:28.655 INFO:teuthology.orchestra.run.smithi144.stdout:Priority: optional 2024-04-19T02:48:28.655 INFO:teuthology.orchestra.run.smithi144.stdout:Section: kernel 2024-04-19T02:48:28.655 INFO:teuthology.orchestra.run.smithi144.stdout:Installed-Size: 20 2024-04-19T02:48:28.655 INFO:teuthology.orchestra.run.smithi144.stdout:Maintainer: Ubuntu Kernel Team 2024-04-19T02:48:28.655 INFO:teuthology.orchestra.run.smithi144.stdout:Architecture: amd64 2024-04-19T02:48:28.655 INFO:teuthology.orchestra.run.smithi144.stdout:Source: linux-meta 2024-04-19T02:48:28.656 INFO:teuthology.orchestra.run.smithi144.stdout:Version: 5.4.0.177.175 2024-04-19T02:48:28.656 INFO:teuthology.orchestra.run.smithi144.stdout:Provides: virtualbox-guest-modules (= 6.1.50-dfsg-1~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.17) 2024-04-19T02:48:28.656 INFO:teuthology.orchestra.run.smithi144.stdout:Depends: linux-image-5.4.0-177-generic, linux-modules-extra-5.4.0-177-generic, linux-firmware, intel-microcode, amd64-microcode 2024-04-19T02:48:28.656 INFO:teuthology.orchestra.run.smithi144.stdout:Recommends: thermald 2024-04-19T02:48:28.656 INFO:teuthology.orchestra.run.smithi144.stdout:Description: Generic Linux kernel image 2024-04-19T02:48:28.656 INFO:teuthology.orchestra.run.smithi144.stdout: This package will always depend on the latest generic kernel image 2024-04-19T02:48:28.656 INFO:teuthology.orchestra.run.smithi144.stdout: available. 2024-04-19T02:48:28.656 DEBUG:teuthology.orchestra.run.smithi144:> mktemp 2024-04-19T02:48:28.661 INFO:teuthology.orchestra.run.smithi144.stdout:/tmp/tmp.YNn0WTBpKp 2024-04-19T02:48:28.661 DEBUG:teuthology.orchestra.run.smithi144:> sudo cp /boot/grub/grub.cfg /tmp/tmp.YNn0WTBpKp 2024-04-19T02:48:28.732 DEBUG:teuthology.orchestra.run.smithi144:> sudo chmod 0666 /tmp/tmp.YNn0WTBpKp 2024-04-19T02:48:28.781 DEBUG:teuthology.orchestra.remote:smithi144:/tmp/tmp.YNn0WTBpKp is 9KB 2024-04-19T02:48:28.795 DEBUG:teuthology.orchestra.run.smithi144:> rm -fr /tmp/tmp.YNn0WTBpKp 2024-04-19T02:48:28.801 DEBUG:teuthology.orchestra.run.smithi144:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-04-19T02:48:28.857 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-04-19T02:48:28.857 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-04-19T02:48:28.857 DEBUG:teuthology.orchestra.run.smithi144:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-04-19T02:48:28.897 INFO:teuthology.task.kernel:Distro Kernel Version: 5.4.0-177-generic 2024-04-19T02:48:28.897 DEBUG:teuthology.orchestra.run.smithi144:> sudo update-grub 2024-04-19T02:48:28.921 INFO:teuthology.orchestra.run.smithi097.stderr:done 2024-04-19T02:48:28.923 DEBUG:teuthology.orchestra.run.smithi097:> sudo shutdown -r now 2024-04-19T02:48:29.462 INFO:teuthology.orchestra.run.smithi096.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-generic amd64 5.4.0.177.175 [1,900 B] 2024-04-19T02:48:29.462 INFO:teuthology.orchestra.run.smithi096.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-generic amd64 5.4.0.177.175 [2,612 B] 2024-04-19T02:48:29.463 INFO:teuthology.orchestra.run.smithi096.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-177 all 5.4.0-177.197 [11.0 MB] 2024-04-19T02:48:30.109 INFO:teuthology.orchestra.run.smithi144.stderr:Sourcing file `/etc/default/grub' 2024-04-19T02:48:30.121 INFO:teuthology.orchestra.run.smithi144.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-19T02:48:30.139 INFO:teuthology.orchestra.run.smithi144.stderr:Generating grub configuration file ... 2024-04-19T02:48:30.357 INFO:teuthology.orchestra.run.smithi144.stderr:Found linux image: /boot/vmlinuz-5.4.0-177-generic 2024-04-19T02:48:30.369 INFO:teuthology.orchestra.run.smithi144.stderr:Found initrd image: /boot/initrd.img-5.4.0-177-generic 2024-04-19T02:48:30.715 INFO:teuthology.orchestra.run.smithi144.stderr:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2024-04-19T02:48:30.726 INFO:teuthology.orchestra.run.smithi144.stderr:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2024-04-19T02:48:31.694 INFO:teuthology.orchestra.run.smithi144.stderr:done 2024-04-19T02:48:31.696 DEBUG:teuthology.orchestra.run.smithi144:> sudo shutdown -r now 2024-04-19T02:48:34.483 INFO:teuthology.orchestra.run.smithi134.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-04-19T02:48:34.483 INFO:teuthology.orchestra.run.smithi134.stdout:Sourcing file `/etc/default/grub' 2024-04-19T02:48:34.490 INFO:teuthology.orchestra.run.smithi134.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-19T02:48:34.500 INFO:teuthology.orchestra.run.smithi134.stdout:Generating grub configuration file ... 2024-04-19T02:48:34.843 INFO:teuthology.orchestra.run.smithi134.stdout:Found linux image: /boot/vmlinuz-5.4.0-177-generic 2024-04-19T02:48:34.868 INFO:teuthology.orchestra.run.smithi134.stdout:Found initrd image: /boot/initrd.img-5.4.0-177-generic 2024-04-19T02:48:35.281 INFO:teuthology.orchestra.run.smithi134.stdout:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2024-04-19T02:48:35.297 INFO:teuthology.orchestra.run.smithi134.stdout:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2024-04-19T02:48:37.937 INFO:teuthology.orchestra.run.smithi134.stdout:done 2024-04-19T02:48:38.320 DEBUG:teuthology.orchestra.run.smithi134:> dpkg -s linux-image-generic 2024-04-19T02:48:38.369 INFO:teuthology.orchestra.run.smithi134.stdout:Package: linux-image-generic 2024-04-19T02:48:38.369 INFO:teuthology.orchestra.run.smithi134.stdout:Status: install ok installed 2024-04-19T02:48:38.370 INFO:teuthology.orchestra.run.smithi134.stdout:Priority: optional 2024-04-19T02:48:38.370 INFO:teuthology.orchestra.run.smithi134.stdout:Section: kernel 2024-04-19T02:48:38.370 INFO:teuthology.orchestra.run.smithi134.stdout:Installed-Size: 20 2024-04-19T02:48:38.370 INFO:teuthology.orchestra.run.smithi134.stdout:Maintainer: Ubuntu Kernel Team 2024-04-19T02:48:38.370 INFO:teuthology.orchestra.run.smithi134.stdout:Architecture: amd64 2024-04-19T02:48:38.370 INFO:teuthology.orchestra.run.smithi134.stdout:Source: linux-meta 2024-04-19T02:48:38.370 INFO:teuthology.orchestra.run.smithi134.stdout:Version: 5.4.0.177.175 2024-04-19T02:48:38.370 INFO:teuthology.orchestra.run.smithi134.stdout:Provides: virtualbox-guest-modules (= 6.1.50-dfsg-1~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.17) 2024-04-19T02:48:38.371 INFO:teuthology.orchestra.run.smithi134.stdout:Depends: linux-image-5.4.0-177-generic, linux-modules-extra-5.4.0-177-generic, linux-firmware, intel-microcode, amd64-microcode 2024-04-19T02:48:38.371 INFO:teuthology.orchestra.run.smithi134.stdout:Recommends: thermald 2024-04-19T02:48:38.371 INFO:teuthology.orchestra.run.smithi134.stdout:Description: Generic Linux kernel image 2024-04-19T02:48:38.371 INFO:teuthology.orchestra.run.smithi134.stdout: This package will always depend on the latest generic kernel image 2024-04-19T02:48:38.371 INFO:teuthology.orchestra.run.smithi134.stdout: available. 2024-04-19T02:48:38.371 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.4.0-124-generic Expected: 5.4.0-177-generic 2024-04-19T02:48:38.372 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-04-19T02:48:38.372 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-04-19T02:48:38.372 INFO:teuthology.task.kernel:Installing distro kernel on osd.1... 2024-04-19T02:48:38.372 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi134.front.sepia.ceph.com, path=None, version=distro) 2024-04-19T02:48:38.372 DEBUG:teuthology.orchestra.run.smithi134:> sudo apt-get clean 2024-04-19T02:48:38.462 DEBUG:teuthology.orchestra.run.smithi134:> sudo apt-get update 2024-04-19T02:48:38.671 INFO:teuthology.orchestra.run.smithi134.stdout:Hit:1 http://security.ubuntu.com/ubuntu focal-security InRelease 2024-04-19T02:48:38.709 INFO:teuthology.orchestra.run.smithi134.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal InRelease 2024-04-19T02:48:38.791 INFO:teuthology.orchestra.run.smithi134.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2024-04-19T02:48:38.872 INFO:teuthology.orchestra.run.smithi134.stdout:Hit:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2024-04-19T02:48:40.465 INFO:teuthology.orchestra.run.smithi134.stdout:Reading package lists... 2024-04-19T02:48:40.493 DEBUG:teuthology.orchestra.run.smithi134:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-04-19T02:48:40.558 INFO:teuthology.orchestra.run.smithi134.stdout:Reading package lists... 2024-04-19T02:48:40.790 INFO:teuthology.orchestra.run.smithi134.stdout:Building dependency tree... 2024-04-19T02:48:40.791 INFO:teuthology.orchestra.run.smithi134.stdout:Reading state information... 2024-04-19T02:48:41.027 INFO:teuthology.orchestra.run.smithi134.stdout:linux-image-generic is already the newest version (5.4.0.177.175). 2024-04-19T02:48:41.027 INFO:teuthology.orchestra.run.smithi134.stdout:0 upgraded, 0 newly installed, 0 to remove and 298 not upgraded. 2024-04-19T02:48:41.029 DEBUG:teuthology.orchestra.run.smithi134:> dpkg -s linux-image-generic 2024-04-19T02:48:41.052 INFO:teuthology.orchestra.run.smithi134.stdout:Package: linux-image-generic 2024-04-19T02:48:41.052 INFO:teuthology.orchestra.run.smithi134.stdout:Status: install ok installed 2024-04-19T02:48:41.052 INFO:teuthology.orchestra.run.smithi134.stdout:Priority: optional 2024-04-19T02:48:41.052 INFO:teuthology.orchestra.run.smithi134.stdout:Section: kernel 2024-04-19T02:48:41.052 INFO:teuthology.orchestra.run.smithi134.stdout:Installed-Size: 20 2024-04-19T02:48:41.052 INFO:teuthology.orchestra.run.smithi134.stdout:Maintainer: Ubuntu Kernel Team 2024-04-19T02:48:41.052 INFO:teuthology.orchestra.run.smithi134.stdout:Architecture: amd64 2024-04-19T02:48:41.053 INFO:teuthology.orchestra.run.smithi134.stdout:Source: linux-meta 2024-04-19T02:48:41.053 INFO:teuthology.orchestra.run.smithi134.stdout:Version: 5.4.0.177.175 2024-04-19T02:48:41.053 INFO:teuthology.orchestra.run.smithi134.stdout:Provides: virtualbox-guest-modules (= 6.1.50-dfsg-1~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.17) 2024-04-19T02:48:41.053 INFO:teuthology.orchestra.run.smithi134.stdout:Depends: linux-image-5.4.0-177-generic, linux-modules-extra-5.4.0-177-generic, linux-firmware, intel-microcode, amd64-microcode 2024-04-19T02:48:41.053 INFO:teuthology.orchestra.run.smithi134.stdout:Recommends: thermald 2024-04-19T02:48:41.053 INFO:teuthology.orchestra.run.smithi134.stdout:Description: Generic Linux kernel image 2024-04-19T02:48:41.053 INFO:teuthology.orchestra.run.smithi134.stdout: This package will always depend on the latest generic kernel image 2024-04-19T02:48:41.053 INFO:teuthology.orchestra.run.smithi134.stdout: available. 2024-04-19T02:48:41.053 DEBUG:teuthology.orchestra.run.smithi134:> mktemp 2024-04-19T02:48:41.062 INFO:teuthology.orchestra.run.smithi134.stdout:/tmp/tmp.LaIxtDRtUD 2024-04-19T02:48:41.062 DEBUG:teuthology.orchestra.run.smithi134:> sudo cp /boot/grub/grub.cfg /tmp/tmp.LaIxtDRtUD 2024-04-19T02:48:41.120 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod 0666 /tmp/tmp.LaIxtDRtUD 2024-04-19T02:48:41.159 DEBUG:teuthology.orchestra.remote:smithi134:/tmp/tmp.LaIxtDRtUD is 9KB 2024-04-19T02:48:41.172 DEBUG:teuthology.orchestra.run.smithi134:> rm -fr /tmp/tmp.LaIxtDRtUD 2024-04-19T02:48:41.178 DEBUG:teuthology.orchestra.run.smithi134:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-04-19T02:48:41.235 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-04-19T02:48:41.235 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-04-19T02:48:41.235 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-04-19T02:48:41.282 INFO:teuthology.task.kernel:Distro Kernel Version: 5.4.0-177-generic 2024-04-19T02:48:41.282 DEBUG:teuthology.orchestra.run.smithi134:> sudo update-grub 2024-04-19T02:48:42.411 INFO:teuthology.orchestra.run.smithi096.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-177-generic amd64 5.4.0-177.197 [1,377 kB] 2024-04-19T02:48:42.604 INFO:teuthology.orchestra.run.smithi134.stderr:Sourcing file `/etc/default/grub' 2024-04-19T02:48:42.609 INFO:teuthology.orchestra.run.smithi134.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-19T02:48:42.617 INFO:teuthology.orchestra.run.smithi134.stderr:Generating grub configuration file ... 2024-04-19T02:48:42.946 INFO:teuthology.orchestra.run.smithi134.stderr:Found linux image: /boot/vmlinuz-5.4.0-177-generic 2024-04-19T02:48:42.958 INFO:teuthology.orchestra.run.smithi134.stderr:Found initrd image: /boot/initrd.img-5.4.0-177-generic 2024-04-19T02:48:43.382 INFO:teuthology.orchestra.run.smithi134.stderr:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2024-04-19T02:48:43.394 INFO:teuthology.orchestra.run.smithi134.stderr:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2024-04-19T02:48:43.575 INFO:teuthology.orchestra.run.smithi096.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-generic amd64 5.4.0.177.175 [2,480 B] 2024-04-19T02:48:44.314 INFO:teuthology.orchestra.run.smithi096.stdout:Fetched 77.1 MB in 1min 12s (1,076 kB/s) 2024-04-19T02:48:44.518 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package linux-modules-5.4.0-177-generic. 2024-04-19T02:48:45.036 INFO:teuthology.orchestra.run.smithi134.stderr:done 2024-04-19T02:48:45.038 DEBUG:teuthology.orchestra.run.smithi134:> sudo shutdown -r now 2024-04-19T02:48:46.259 INFO:teuthology.orchestra.run.smithi096.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 104373 files and directories currently installed.) 2024-04-19T02:48:46.263 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../0-linux-modules-5.4.0-177-generic_5.4.0-177.197_amd64.deb ... 2024-04-19T02:48:46.373 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking linux-modules-5.4.0-177-generic (5.4.0-177.197) ... 2024-04-19T02:48:48.376 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package linux-image-5.4.0-177-generic. 2024-04-19T02:48:48.392 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../1-linux-image-5.4.0-177-generic_5.4.0-177.197_amd64.deb ... 2024-04-19T02:48:48.498 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking linux-image-5.4.0-177-generic (5.4.0-177.197) ... 2024-04-19T02:48:49.562 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package linux-modules-extra-5.4.0-177-generic. 2024-04-19T02:48:49.577 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../2-linux-modules-extra-5.4.0-177-generic_5.4.0-177.197_amd64.deb ... 2024-04-19T02:48:49.637 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking linux-modules-extra-5.4.0-177-generic (5.4.0-177.197) ... 2024-04-19T02:48:54.411 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../3-linux-generic_5.4.0.177.175_amd64.deb ... 2024-04-19T02:48:54.537 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking linux-generic (5.4.0.177.175) over (5.4.0.124.125) ... 2024-04-19T02:48:54.881 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../4-linux-image-generic_5.4.0.177.175_amd64.deb ... 2024-04-19T02:48:55.024 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking linux-image-generic (5.4.0.177.175) over (5.4.0.124.125) ... 2024-04-19T02:48:55.353 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package linux-headers-5.4.0-177. 2024-04-19T02:48:55.367 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../5-linux-headers-5.4.0-177_5.4.0-177.197_all.deb ... 2024-04-19T02:48:55.419 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking linux-headers-5.4.0-177 (5.4.0-177.197) ... 2024-04-19T02:48:58.926 INFO:teuthology.task.kernel:Checking client osd.0 for new kernel version... 2024-04-19T02:48:58.926 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi097.front.sepia.ceph.com' 2024-04-19T02:48:58.927 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-19T02:49:01.530 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package linux-headers-5.4.0-177-generic. 2024-04-19T02:49:01.554 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../6-linux-headers-5.4.0-177-generic_5.4.0-177.197_amd64.deb ... 2024-04-19T02:49:01.605 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking linux-headers-5.4.0-177-generic (5.4.0-177.197) ... 2024-04-19T02:49:01.699 INFO:teuthology.task.kernel:Checking client osd.2 for new kernel version... 2024-04-19T02:49:01.700 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi144.front.sepia.ceph.com' 2024-04-19T02:49:01.700 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-19T02:49:04.372 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../7-linux-headers-generic_5.4.0.177.175_amd64.deb ... 2024-04-19T02:49:04.525 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking linux-headers-generic (5.4.0.177.175) over (5.4.0.124.125) ... 2024-04-19T02:49:04.868 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up linux-modules-5.4.0-177-generic (5.4.0-177.197) ... 2024-04-19T02:49:06.080 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up linux-headers-5.4.0-177 (5.4.0-177.197) ... 2024-04-19T02:49:06.231 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up linux-headers-5.4.0-177-generic (5.4.0-177.197) ... 2024-04-19T02:49:06.358 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up linux-image-5.4.0-177-generic (5.4.0-177.197) ... 2024-04-19T02:49:07.528 INFO:teuthology.orchestra.run.smithi096.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.4.0-177-generic 2024-04-19T02:49:07.528 INFO:teuthology.orchestra.run.smithi096.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.4.0-177-generic 2024-04-19T02:49:07.662 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up linux-headers-generic (5.4.0.177.175) ... 2024-04-19T02:49:07.810 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up linux-modules-extra-5.4.0-177-generic (5.4.0-177.197) ... 2024-04-19T02:49:09.004 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up linux-image-generic (5.4.0.177.175) ... 2024-04-19T02:49:09.138 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up linux-generic (5.4.0.177.175) ... 2024-04-19T02:49:09.273 INFO:teuthology.orchestra.run.smithi096.stdout:Processing triggers for linux-image-5.4.0-177-generic (5.4.0-177.197) ... 2024-04-19T02:49:09.371 INFO:teuthology.orchestra.run.smithi096.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-04-19T02:49:09.371 INFO:teuthology.orchestra.run.smithi096.stdout:update-initramfs: Generating /boot/initrd.img-5.4.0-177-generic 2024-04-19T02:49:15.041 INFO:teuthology.task.kernel:Checking client osd.1 for new kernel version... 2024-04-19T02:49:15.042 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi134.front.sepia.ceph.com' 2024-04-19T02:49:15.042 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-19T02:49:17.346 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.97 2024-04-19T02:49:20.158 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.144 2024-04-19T02:49:26.347 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi097.front.sepia.ceph.com' 2024-04-19T02:49:26.348 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-19T02:49:29.159 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi144.front.sepia.ceph.com' 2024-04-19T02:49:29.159 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-19T02:49:29.410 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.97 2024-04-19T02:49:31.756 INFO:teuthology.orchestra.run.smithi096.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-04-19T02:49:31.756 INFO:teuthology.orchestra.run.smithi096.stdout:Sourcing file `/etc/default/grub' 2024-04-19T02:49:31.773 INFO:teuthology.orchestra.run.smithi096.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-19T02:49:31.790 INFO:teuthology.orchestra.run.smithi096.stdout:Generating grub configuration file ... 2024-04-19T02:49:32.182 INFO:teuthology.orchestra.run.smithi096.stdout:Found linux image: /boot/vmlinuz-5.4.0-177-generic 2024-04-19T02:49:32.214 INFO:teuthology.orchestra.run.smithi096.stdout:Found initrd image: /boot/initrd.img-5.4.0-177-generic 2024-04-19T02:49:32.222 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.144 2024-04-19T02:49:32.709 INFO:teuthology.orchestra.run.smithi096.stdout:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2024-04-19T02:49:32.721 INFO:teuthology.orchestra.run.smithi096.stdout:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2024-04-19T02:49:33.470 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.134 2024-04-19T02:49:35.476 INFO:teuthology.orchestra.run.smithi096.stdout:done 2024-04-19T02:49:35.907 DEBUG:teuthology.orchestra.run.smithi096:> dpkg -s linux-image-generic 2024-04-19T02:49:35.963 INFO:teuthology.orchestra.run.smithi096.stdout:Package: linux-image-generic 2024-04-19T02:49:35.964 INFO:teuthology.orchestra.run.smithi096.stdout:Status: install ok installed 2024-04-19T02:49:35.964 INFO:teuthology.orchestra.run.smithi096.stdout:Priority: optional 2024-04-19T02:49:35.964 INFO:teuthology.orchestra.run.smithi096.stdout:Section: kernel 2024-04-19T02:49:35.964 INFO:teuthology.orchestra.run.smithi096.stdout:Installed-Size: 20 2024-04-19T02:49:35.964 INFO:teuthology.orchestra.run.smithi096.stdout:Maintainer: Ubuntu Kernel Team 2024-04-19T02:49:35.964 INFO:teuthology.orchestra.run.smithi096.stdout:Architecture: amd64 2024-04-19T02:49:35.964 INFO:teuthology.orchestra.run.smithi096.stdout:Source: linux-meta 2024-04-19T02:49:35.964 INFO:teuthology.orchestra.run.smithi096.stdout:Version: 5.4.0.177.175 2024-04-19T02:49:35.964 INFO:teuthology.orchestra.run.smithi096.stdout:Provides: virtualbox-guest-modules (= 6.1.50-dfsg-1~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.17) 2024-04-19T02:49:35.964 INFO:teuthology.orchestra.run.smithi096.stdout:Depends: linux-image-5.4.0-177-generic, linux-modules-extra-5.4.0-177-generic, linux-firmware, intel-microcode, amd64-microcode 2024-04-19T02:49:35.964 INFO:teuthology.orchestra.run.smithi096.stdout:Recommends: thermald 2024-04-19T02:49:35.964 INFO:teuthology.orchestra.run.smithi096.stdout:Description: Generic Linux kernel image 2024-04-19T02:49:35.964 INFO:teuthology.orchestra.run.smithi096.stdout: This package will always depend on the latest generic kernel image 2024-04-19T02:49:35.964 INFO:teuthology.orchestra.run.smithi096.stdout: available. 2024-04-19T02:49:35.965 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.4.0-124-generic Expected: 5.4.0-177-generic 2024-04-19T02:49:35.965 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-04-19T02:49:35.965 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-04-19T02:49:35.965 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-04-19T02:49:35.965 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi096.front.sepia.ceph.com, path=None, version=distro) 2024-04-19T02:49:35.965 DEBUG:teuthology.orchestra.run.smithi096:> sudo apt-get clean 2024-04-19T02:49:36.070 DEBUG:teuthology.orchestra.run.smithi096:> sudo apt-get update 2024-04-19T02:49:36.272 INFO:teuthology.orchestra.run.smithi096.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2024-04-19T02:49:36.272 INFO:teuthology.orchestra.run.smithi096.stdout:Hit:2 http://security.ubuntu.com/ubuntu focal-security InRelease 2024-04-19T02:49:36.322 INFO:teuthology.orchestra.run.smithi096.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2024-04-19T02:49:36.379 INFO:teuthology.orchestra.run.smithi096.stdout:Hit:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2024-04-19T02:49:38.086 INFO:teuthology.orchestra.run.smithi096.stdout:Reading package lists... 2024-04-19T02:49:38.112 DEBUG:teuthology.orchestra.run.smithi096:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-04-19T02:49:38.179 INFO:teuthology.orchestra.run.smithi096.stdout:Reading package lists... 2024-04-19T02:49:38.391 INFO:teuthology.orchestra.run.smithi096.stdout:Building dependency tree... 2024-04-19T02:49:38.391 INFO:teuthology.orchestra.run.smithi096.stdout:Reading state information... 2024-04-19T02:49:38.618 INFO:teuthology.orchestra.run.smithi096.stdout:linux-image-generic is already the newest version (5.4.0.177.175). 2024-04-19T02:49:38.619 INFO:teuthology.orchestra.run.smithi096.stdout:0 upgraded, 0 newly installed, 0 to remove and 298 not upgraded. 2024-04-19T02:49:38.620 DEBUG:teuthology.orchestra.run.smithi096:> dpkg -s linux-image-generic 2024-04-19T02:49:38.640 INFO:teuthology.orchestra.run.smithi096.stdout:Package: linux-image-generic 2024-04-19T02:49:38.641 INFO:teuthology.orchestra.run.smithi096.stdout:Status: install ok installed 2024-04-19T02:49:38.641 INFO:teuthology.orchestra.run.smithi096.stdout:Priority: optional 2024-04-19T02:49:38.641 INFO:teuthology.orchestra.run.smithi096.stdout:Section: kernel 2024-04-19T02:49:38.641 INFO:teuthology.orchestra.run.smithi096.stdout:Installed-Size: 20 2024-04-19T02:49:38.641 INFO:teuthology.orchestra.run.smithi096.stdout:Maintainer: Ubuntu Kernel Team 2024-04-19T02:49:38.641 INFO:teuthology.orchestra.run.smithi096.stdout:Architecture: amd64 2024-04-19T02:49:38.641 INFO:teuthology.orchestra.run.smithi096.stdout:Source: linux-meta 2024-04-19T02:49:38.641 INFO:teuthology.orchestra.run.smithi096.stdout:Version: 5.4.0.177.175 2024-04-19T02:49:38.641 INFO:teuthology.orchestra.run.smithi096.stdout:Provides: virtualbox-guest-modules (= 6.1.50-dfsg-1~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.17) 2024-04-19T02:49:38.641 INFO:teuthology.orchestra.run.smithi096.stdout:Depends: linux-image-5.4.0-177-generic, linux-modules-extra-5.4.0-177-generic, linux-firmware, intel-microcode, amd64-microcode 2024-04-19T02:49:38.641 INFO:teuthology.orchestra.run.smithi096.stdout:Recommends: thermald 2024-04-19T02:49:38.641 INFO:teuthology.orchestra.run.smithi096.stdout:Description: Generic Linux kernel image 2024-04-19T02:49:38.641 INFO:teuthology.orchestra.run.smithi096.stdout: This package will always depend on the latest generic kernel image 2024-04-19T02:49:38.642 INFO:teuthology.orchestra.run.smithi096.stdout: available. 2024-04-19T02:49:38.642 DEBUG:teuthology.orchestra.run.smithi096:> mktemp 2024-04-19T02:49:38.690 INFO:teuthology.orchestra.run.smithi096.stdout:/tmp/tmp.p0JluaMGcA 2024-04-19T02:49:38.690 DEBUG:teuthology.orchestra.run.smithi096:> sudo cp /boot/grub/grub.cfg /tmp/tmp.p0JluaMGcA 2024-04-19T02:49:38.706 DEBUG:teuthology.orchestra.run.smithi096:> sudo chmod 0666 /tmp/tmp.p0JluaMGcA 2024-04-19T02:49:38.737 DEBUG:teuthology.orchestra.remote:smithi096:/tmp/tmp.p0JluaMGcA is 9KB 2024-04-19T02:49:38.752 DEBUG:teuthology.orchestra.run.smithi096:> rm -fr /tmp/tmp.p0JluaMGcA 2024-04-19T02:49:38.758 DEBUG:teuthology.orchestra.run.smithi096:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-04-19T02:49:38.816 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-04-19T02:49:38.816 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-04-19T02:49:38.816 DEBUG:teuthology.orchestra.run.smithi096:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-04-19T02:49:38.849 INFO:teuthology.task.kernel:Distro Kernel Version: 5.4.0-177-generic 2024-04-19T02:49:38.849 DEBUG:teuthology.orchestra.run.smithi096:> sudo update-grub 2024-04-19T02:49:40.221 INFO:teuthology.orchestra.run.smithi096.stderr:Sourcing file `/etc/default/grub' 2024-04-19T02:49:40.229 INFO:teuthology.orchestra.run.smithi096.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-19T02:49:40.239 INFO:teuthology.orchestra.run.smithi096.stderr:Generating grub configuration file ... 2024-04-19T02:49:40.602 INFO:teuthology.orchestra.run.smithi096.stderr:Found linux image: /boot/vmlinuz-5.4.0-177-generic 2024-04-19T02:49:40.614 INFO:teuthology.orchestra.run.smithi096.stderr:Found initrd image: /boot/initrd.img-5.4.0-177-generic 2024-04-19T02:49:41.053 INFO:teuthology.orchestra.run.smithi096.stderr:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2024-04-19T02:49:41.064 INFO:teuthology.orchestra.run.smithi096.stderr:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2024-04-19T02:49:41.411 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi097.front.sepia.ceph.com' 2024-04-19T02:49:41.412 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-19T02:49:42.471 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi134.front.sepia.ceph.com' 2024-04-19T02:49:42.471 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-19T02:49:42.700 INFO:teuthology.orchestra.run.smithi096.stderr:done 2024-04-19T02:49:42.701 DEBUG:teuthology.orchestra.run.smithi096:> sudo shutdown -r now 2024-04-19T02:49:44.224 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi144.front.sepia.ceph.com' 2024-04-19T02:49:44.225 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-19T02:49:45.534 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.134 2024-04-19T02:49:57.537 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi134.front.sepia.ceph.com' 2024-04-19T02:49:57.537 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-19T02:50:12.718 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-19T02:50:12.719 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi096.front.sepia.ceph.com' 2024-04-19T02:50:12.720 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi096.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-19T02:50:13.144 DEBUG:teuthology.orchestra.run.smithi097:> true 2024-04-19T02:50:13.717 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi097.front.sepia.ceph.com' 2024-04-19T02:50:13.717 INFO:teuthology.task.kernel:Checking kernel version of osd.0, want "5.4.0-177-generic"... 2024-04-19T02:50:13.718 DEBUG:teuthology.orchestra.run.smithi097:> uname -r 2024-04-19T02:50:13.724 INFO:teuthology.orchestra.run.smithi097.stdout:5.4.0-177-generic 2024-04-19T02:50:13.724 DEBUG:teuthology.task.kernel:current kernel version is 5.4.0-177-generic vs 5.4.0-177-generic 2024-04-19T02:50:13.724 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-19T02:50:13.724 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-19T02:50:14.725 INFO:teuthology.task.kernel:Enabling kdb on osd.0... 2024-04-19T02:50:14.725 DEBUG:teuthology.orchestra.run.smithi097:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-19T02:50:14.821 INFO:teuthology.orchestra.run.smithi097.stdout:ttyS1 2024-04-19T02:50:14.840 DEBUG:teuthology.parallel:result is None 2024-04-19T02:50:15.946 DEBUG:teuthology.orchestra.run.smithi144:> true 2024-04-19T02:50:16.519 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi144.front.sepia.ceph.com' 2024-04-19T02:50:16.519 INFO:teuthology.task.kernel:Checking kernel version of osd.2, want "5.4.0-177-generic"... 2024-04-19T02:50:16.520 DEBUG:teuthology.orchestra.run.smithi144:> uname -r 2024-04-19T02:50:16.566 INFO:teuthology.orchestra.run.smithi144.stdout:5.4.0-177-generic 2024-04-19T02:50:16.566 DEBUG:teuthology.task.kernel:current kernel version is 5.4.0-177-generic vs 5.4.0-177-generic 2024-04-19T02:50:16.567 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-19T02:50:16.567 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-19T02:50:17.567 INFO:teuthology.task.kernel:Enabling kdb on osd.2... 2024-04-19T02:50:17.568 DEBUG:teuthology.orchestra.run.smithi144:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-19T02:50:17.661 INFO:teuthology.orchestra.run.smithi144.stdout:ttyS1 2024-04-19T02:50:17.683 DEBUG:teuthology.parallel:result is None 2024-04-19T02:50:29.270 DEBUG:teuthology.orchestra.run.smithi134:> true 2024-04-19T02:50:29.863 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi134.front.sepia.ceph.com' 2024-04-19T02:50:29.864 INFO:teuthology.task.kernel:Checking kernel version of osd.1, want "5.4.0-177-generic"... 2024-04-19T02:50:29.864 DEBUG:teuthology.orchestra.run.smithi134:> uname -r 2024-04-19T02:50:29.910 INFO:teuthology.orchestra.run.smithi134.stdout:5.4.0-177-generic 2024-04-19T02:50:29.910 DEBUG:teuthology.task.kernel:current kernel version is 5.4.0-177-generic vs 5.4.0-177-generic 2024-04-19T02:50:29.910 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-19T02:50:29.911 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-19T02:50:30.911 INFO:teuthology.task.kernel:Enabling kdb on osd.1... 2024-04-19T02:50:30.911 DEBUG:teuthology.orchestra.run.smithi134:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-19T02:50:31.007 INFO:teuthology.orchestra.run.smithi134.stdout:ttyS1 2024-04-19T02:50:31.043 DEBUG:teuthology.parallel:result is None 2024-04-19T02:50:31.070 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.96 2024-04-19T02:50:40.072 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi096.front.sepia.ceph.com' 2024-04-19T02:50:40.072 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi096.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-19T02:50:43.134 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.96 2024-04-19T02:50:55.155 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi096.front.sepia.ceph.com' 2024-04-19T02:50:55.156 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi096.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-19T02:51:13.567 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.96 2024-04-19T02:51:28.567 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi096.front.sepia.ceph.com' 2024-04-19T02:51:28.568 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi096.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-19T02:51:28.810 DEBUG:teuthology.orchestra.run.smithi096:> true 2024-04-19T02:51:29.416 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi096.front.sepia.ceph.com' 2024-04-19T02:51:29.416 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.4.0-177-generic"... 2024-04-19T02:51:29.416 DEBUG:teuthology.orchestra.run.smithi096:> uname -r 2024-04-19T02:51:29.422 INFO:teuthology.orchestra.run.smithi096.stdout:5.4.0-177-generic 2024-04-19T02:51:29.423 DEBUG:teuthology.task.kernel:current kernel version is 5.4.0-177-generic vs 5.4.0-177-generic 2024-04-19T02:51:29.423 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-19T02:51:29.423 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-19T02:51:30.424 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-04-19T02:51:30.424 DEBUG:teuthology.orchestra.run.smithi096:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-19T02:51:30.530 INFO:teuthology.orchestra.run.smithi096.stdout:ttyS1 2024-04-19T02:51:30.558 DEBUG:teuthology.parallel:result is None 2024-04-19T02:51:30.559 INFO:teuthology.run_tasks:Running task internal.base... 2024-04-19T02:51:30.566 INFO:teuthology.task.internal:Creating test directory... 2024-04-19T02:51:30.567 DEBUG:teuthology.orchestra.run.smithi096:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-19T02:51:30.569 DEBUG:teuthology.orchestra.run.smithi097:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-19T02:51:30.571 DEBUG:teuthology.orchestra.run.smithi134:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-19T02:51:30.574 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-19T02:51:30.581 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-04-19T02:51:30.588 INFO:teuthology.run_tasks:Running task internal.archive... 2024-04-19T02:51:30.598 INFO:teuthology.task.internal:Creating archive directory... 2024-04-19T02:51:30.598 DEBUG:teuthology.orchestra.run.smithi096:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-19T02:51:30.617 DEBUG:teuthology.orchestra.run.smithi097:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-19T02:51:30.623 DEBUG:teuthology.orchestra.run.smithi134:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-19T02:51:30.625 DEBUG:teuthology.orchestra.run.smithi144:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-19T02:51:30.649 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-04-19T02:51:30.655 INFO:teuthology.task.internal:Enabling coredump saving... 2024-04-19T02:51:30.656 DEBUG:teuthology.orchestra.run.smithi096:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-19T02:51:30.658 DEBUG:teuthology.orchestra.run.smithi097:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-19T02:51:30.660 DEBUG:teuthology.orchestra.run.smithi134:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-19T02:51:30.663 DEBUG:teuthology.orchestra.run.smithi144:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-19T02:51:30.674 INFO:teuthology.orchestra.run.smithi096.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-19T02:51:30.682 INFO:teuthology.orchestra.run.smithi134.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-19T02:51:30.683 INFO:teuthology.orchestra.run.smithi144.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-19T02:51:30.685 INFO:teuthology.orchestra.run.smithi096.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-19T02:51:30.693 INFO:teuthology.orchestra.run.smithi134.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-19T02:51:30.693 INFO:teuthology.orchestra.run.smithi144.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-19T02:51:30.700 INFO:teuthology.orchestra.run.smithi097.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-19T02:51:30.712 INFO:teuthology.orchestra.run.smithi097.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-19T02:51:30.714 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-04-19T02:51:30.721 INFO:teuthology.task.internal:Configuring sudo... 2024-04-19T02:51:30.722 DEBUG:teuthology.orchestra.run.smithi096:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-19T02:51:30.724 DEBUG:teuthology.orchestra.run.smithi097:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-19T02:51:30.726 DEBUG:teuthology.orchestra.run.smithi134:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-19T02:51:30.728 DEBUG:teuthology.orchestra.run.smithi144:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-19T02:51:30.755 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-04-19T02:51:30.764 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-04-19T02:51:30.764 DEBUG:teuthology.orchestra.run.smithi096:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-19T02:51:30.781 DEBUG:teuthology.orchestra.run.smithi097:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-19T02:51:30.784 DEBUG:teuthology.orchestra.run.smithi134:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-19T02:51:30.786 DEBUG:teuthology.orchestra.run.smithi144:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-19T02:51:30.793 DEBUG:teuthology.orchestra.run.smithi096:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-19T02:51:30.799 DEBUG:teuthology.orchestra.run.smithi096:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-19T02:51:30.806 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-04-19T02:51:30.806 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-19T02:51:30.875 DEBUG:teuthology.orchestra.run.smithi097:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-19T02:51:30.882 DEBUG:teuthology.orchestra.run.smithi097:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-19T02:51:30.930 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-04-19T02:51:30.930 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-19T02:51:30.949 DEBUG:teuthology.orchestra.run.smithi134:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-19T02:51:30.956 DEBUG:teuthology.orchestra.run.smithi134:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-19T02:51:30.963 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-04-19T02:51:30.963 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-19T02:51:31.029 DEBUG:teuthology.orchestra.run.smithi144:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-19T02:51:31.036 DEBUG:teuthology.orchestra.run.smithi144:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-19T02:51:31.043 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-04-19T02:51:31.043 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-19T02:51:31.064 DEBUG:teuthology.orchestra.run.smithi096:> sudo service rsyslog restart 2024-04-19T02:51:31.066 DEBUG:teuthology.orchestra.run.smithi097:> sudo service rsyslog restart 2024-04-19T02:51:31.068 DEBUG:teuthology.orchestra.run.smithi134:> sudo service rsyslog restart 2024-04-19T02:51:31.071 DEBUG:teuthology.orchestra.run.smithi144:> sudo service rsyslog restart 2024-04-19T02:51:31.119 INFO:teuthology.run_tasks:Running task internal.timer... 2024-04-19T02:51:31.127 INFO:teuthology.task.internal:Starting timer... 2024-04-19T02:51:31.127 INFO:teuthology.run_tasks:Running task pcp... 2024-04-19T02:51:31.137 INFO:teuthology.run_tasks:Running task selinux... 2024-04-19T02:51:31.145 DEBUG:teuthology.task.selinux:Excluding smithi096: OS 'ubuntu' does not support SELinux 2024-04-19T02:51:31.145 DEBUG:teuthology.task.selinux:Excluding smithi097: OS 'ubuntu' does not support SELinux 2024-04-19T02:51:31.145 DEBUG:teuthology.task.selinux:Excluding smithi134: OS 'ubuntu' does not support SELinux 2024-04-19T02:51:31.146 DEBUG:teuthology.task.selinux:Excluding smithi144: OS 'ubuntu' does not support SELinux 2024-04-19T02:51:31.146 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-04-19T02:51:31.146 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-04-19T02:51:31.146 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-04-19T02:51:31.146 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-04-19T02:51:31.155 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-04-19T02:51:31.161 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-04-19T02:51:31.303 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-04-19T02:51:31.319 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-04-19T02:51:31.320 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi096.front.sepia.ceph.com,smithi097.front.sepia.ceph.com,smithi134.front.sepia.ceph.com,smithi144.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-04-19T02:57:12.987 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi096.front.sepia.ceph.com'), Remote(name='ubuntu@smithi097.front.sepia.ceph.com'), Remote(name='ubuntu@smithi134.front.sepia.ceph.com'), Remote(name='ubuntu@smithi144.front.sepia.ceph.com')] 2024-04-19T02:57:12.988 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi096.front.sepia.ceph.com' 2024-04-19T02:57:12.989 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi096.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-19T02:57:13.087 DEBUG:teuthology.orchestra.run.smithi096:> true 2024-04-19T02:57:13.216 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi096.front.sepia.ceph.com' 2024-04-19T02:57:13.217 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi097.front.sepia.ceph.com' 2024-04-19T02:57:13.217 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-19T02:57:13.305 DEBUG:teuthology.orchestra.run.smithi097:> true 2024-04-19T02:57:13.427 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi097.front.sepia.ceph.com' 2024-04-19T02:57:13.428 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi134.front.sepia.ceph.com' 2024-04-19T02:57:13.428 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-19T02:57:13.529 DEBUG:teuthology.orchestra.run.smithi134:> true 2024-04-19T02:57:13.652 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi134.front.sepia.ceph.com' 2024-04-19T02:57:13.652 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi144.front.sepia.ceph.com' 2024-04-19T02:57:13.653 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi144.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-19T02:57:13.742 DEBUG:teuthology.orchestra.run.smithi144:> true 2024-04-19T02:57:13.867 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi144.front.sepia.ceph.com' 2024-04-19T02:57:13.869 INFO:teuthology.run_tasks:Running task clock... 2024-04-19T02:57:13.880 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-04-19T02:57:13.880 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-19T02:57:13.881 DEBUG:teuthology.orchestra.run.smithi096:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-19T02:57:13.883 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-19T02:57:13.883 DEBUG:teuthology.orchestra.run.smithi097:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-19T02:57:13.885 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-19T02:57:13.885 DEBUG:teuthology.orchestra.run.smithi134:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-19T02:57:13.887 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-19T02:57:13.887 DEBUG:teuthology.orchestra.run.smithi144:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-19T02:57:13.916 INFO:teuthology.orchestra.run.smithi096.stdout:19 Apr 02:57:13 ntpd[12953]: ntpd 4.2.8p12@1.3728-o (1): Starting 2024-04-19T02:57:13.916 INFO:teuthology.orchestra.run.smithi096.stdout:19 Apr 02:57:13 ntpd[12953]: Command line: ntpd -gq 2024-04-19T02:57:13.917 INFO:teuthology.orchestra.run.smithi096.stdout:19 Apr 02:57:13 ntpd[12953]: proto: precision = 0.092 usec (-23) 2024-04-19T02:57:13.917 INFO:teuthology.orchestra.run.smithi096.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-19T02:57:13.918 INFO:teuthology.orchestra.run.smithi096.stdout:19 Apr 02:57:13 ntpd[12953]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-19T02:57:13.918 INFO:teuthology.orchestra.run.smithi096.stdout:19 Apr 02:57:13 ntpd[12953]: restrict ::: KOD does nothing without LIMITED. 2024-04-19T02:57:13.918 INFO:teuthology.orchestra.run.smithi096.stderr:restrict ::: KOD does nothing without LIMITED. 2024-04-19T02:57:13.919 INFO:teuthology.orchestra.run.smithi096.stdout:19 Apr 02:57:13 ntpd[12953]: Listen and drop on 0 v6wildcard [::]:123 2024-04-19T02:57:13.919 INFO:teuthology.orchestra.run.smithi096.stdout:19 Apr 02:57:13 ntpd[12953]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-04-19T02:57:13.919 INFO:teuthology.orchestra.run.smithi096.stdout:19 Apr 02:57:13 ntpd[12953]: Listen normally on 2 lo 127.0.0.1:123 2024-04-19T02:57:13.920 INFO:teuthology.orchestra.run.smithi096.stdout:19 Apr 02:57:13 ntpd[12953]: Listen normally on 3 enp3s0f1 172.21.15.96:123 2024-04-19T02:57:13.920 INFO:teuthology.orchestra.run.smithi096.stdout:19 Apr 02:57:13 ntpd[12953]: Listen normally on 4 lo [::1]:123 2024-04-19T02:57:13.920 INFO:teuthology.orchestra.run.smithi096.stdout:19 Apr 02:57:13 ntpd[12953]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:cc0d%5]:123 2024-04-19T02:57:13.920 INFO:teuthology.orchestra.run.smithi096.stdout:19 Apr 02:57:13 ntpd[12953]: Listening on routing socket on fd #22 for interface updates 2024-04-19T02:57:13.920 INFO:teuthology.orchestra.run.smithi134.stdout:19 Apr 02:57:13 ntpd[12936]: ntpd 4.2.8p12@1.3728-o (1): Starting 2024-04-19T02:57:13.920 INFO:teuthology.orchestra.run.smithi134.stdout:19 Apr 02:57:13 ntpd[12936]: Command line: ntpd -gq 2024-04-19T02:57:13.921 INFO:teuthology.orchestra.run.smithi097.stdout:19 Apr 02:57:13 ntpd[13017]: ntpd 4.2.8p12@1.3728-o (1): Starting 2024-04-19T02:57:13.921 INFO:teuthology.orchestra.run.smithi097.stdout:19 Apr 02:57:13 ntpd[13017]: Command line: ntpd -gq 2024-04-19T02:57:13.921 INFO:teuthology.orchestra.run.smithi097.stdout:19 Apr 02:57:13 ntpd[13017]: proto: precision = 0.060 usec (-24) 2024-04-19T02:57:13.921 INFO:teuthology.orchestra.run.smithi097.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-19T02:57:13.922 INFO:teuthology.orchestra.run.smithi097.stdout:19 Apr 02:57:13 ntpd[13017]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-19T02:57:13.922 INFO:teuthology.orchestra.run.smithi097.stderr:restrict ::: KOD does nothing without LIMITED. 2024-04-19T02:57:13.923 INFO:teuthology.orchestra.run.smithi097.stdout:19 Apr 02:57:13 ntpd[13017]: restrict ::: KOD does nothing without LIMITED. 2024-04-19T02:57:13.923 INFO:teuthology.orchestra.run.smithi097.stdout:19 Apr 02:57:13 ntpd[13017]: Listen and drop on 0 v6wildcard [::]:123 2024-04-19T02:57:13.923 INFO:teuthology.orchestra.run.smithi097.stdout:19 Apr 02:57:13 ntpd[13017]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-04-19T02:57:13.923 INFO:teuthology.orchestra.run.smithi097.stdout:19 Apr 02:57:13 ntpd[13017]: Listen normally on 2 lo 127.0.0.1:123 2024-04-19T02:57:13.923 INFO:teuthology.orchestra.run.smithi097.stdout:19 Apr 02:57:13 ntpd[13017]: Listen normally on 3 enp3s0f1 172.21.15.97:123 2024-04-19T02:57:13.923 INFO:teuthology.orchestra.run.smithi097.stdout:19 Apr 02:57:13 ntpd[13017]: Listen normally on 4 lo [::1]:123 2024-04-19T02:57:13.923 INFO:teuthology.orchestra.run.smithi097.stdout:19 Apr 02:57:13 ntpd[13017]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:d805%5]:123 2024-04-19T02:57:13.923 INFO:teuthology.orchestra.run.smithi097.stdout:19 Apr 02:57:13 ntpd[13017]: Listening on routing socket on fd #22 for interface updates 2024-04-19T02:57:13.924 INFO:teuthology.orchestra.run.smithi134.stdout:19 Apr 02:57:13 ntpd[12936]: proto: precision = 0.062 usec (-24) 2024-04-19T02:57:13.924 INFO:teuthology.orchestra.run.smithi134.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-19T02:57:13.925 INFO:teuthology.orchestra.run.smithi144.stdout:19 Apr 02:57:13 ntpd[12978]: ntpd 4.2.8p12@1.3728-o (1): Starting 2024-04-19T02:57:13.925 INFO:teuthology.orchestra.run.smithi144.stdout:19 Apr 02:57:13 ntpd[12978]: Command line: ntpd -gq 2024-04-19T02:57:13.925 INFO:teuthology.orchestra.run.smithi144.stdout:19 Apr 02:57:13 ntpd[12978]: proto: precision = 0.116 usec (-23) 2024-04-19T02:57:13.925 INFO:teuthology.orchestra.run.smithi144.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-19T02:57:13.926 INFO:teuthology.orchestra.run.smithi134.stdout:19 Apr 02:57:13 ntpd[12936]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-19T02:57:13.926 INFO:teuthology.orchestra.run.smithi134.stdout:19 Apr 02:57:13 ntpd[12936]: restrict ::: KOD does nothing without LIMITED. 2024-04-19T02:57:13.926 INFO:teuthology.orchestra.run.smithi144.stdout:19 Apr 02:57:13 ntpd[12978]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-19T02:57:13.926 INFO:teuthology.orchestra.run.smithi134.stderr:restrict ::: KOD does nothing without LIMITED. 2024-04-19T02:57:13.926 INFO:teuthology.orchestra.run.smithi144.stderr:restrict ::: KOD does nothing without LIMITED. 2024-04-19T02:57:13.928 INFO:teuthology.orchestra.run.smithi134.stdout:19 Apr 02:57:13 ntpd[12936]: Listen and drop on 0 v6wildcard [::]:123 2024-04-19T02:57:13.928 INFO:teuthology.orchestra.run.smithi134.stdout:19 Apr 02:57:13 ntpd[12936]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-04-19T02:57:13.928 INFO:teuthology.orchestra.run.smithi134.stdout:19 Apr 02:57:13 ntpd[12936]: Listen normally on 2 lo 127.0.0.1:123 2024-04-19T02:57:13.928 INFO:teuthology.orchestra.run.smithi134.stdout:19 Apr 02:57:13 ntpd[12936]: Listen normally on 3 enp3s0f1 172.21.15.134:123 2024-04-19T02:57:13.928 INFO:teuthology.orchestra.run.smithi134.stdout:19 Apr 02:57:13 ntpd[12936]: Listen normally on 4 lo [::1]:123 2024-04-19T02:57:13.928 INFO:teuthology.orchestra.run.smithi134.stdout:19 Apr 02:57:13 ntpd[12936]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:6de9%5]:123 2024-04-19T02:57:13.928 INFO:teuthology.orchestra.run.smithi134.stdout:19 Apr 02:57:13 ntpd[12936]: Listening on routing socket on fd #22 for interface updates 2024-04-19T02:57:13.929 INFO:teuthology.orchestra.run.smithi144.stdout:19 Apr 02:57:13 ntpd[12978]: restrict ::: KOD does nothing without LIMITED. 2024-04-19T02:57:13.929 INFO:teuthology.orchestra.run.smithi144.stdout:19 Apr 02:57:13 ntpd[12978]: Listen and drop on 0 v6wildcard [::]:123 2024-04-19T02:57:13.929 INFO:teuthology.orchestra.run.smithi144.stdout:19 Apr 02:57:13 ntpd[12978]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-04-19T02:57:13.929 INFO:teuthology.orchestra.run.smithi144.stdout:19 Apr 02:57:13 ntpd[12978]: Listen normally on 2 lo 127.0.0.1:123 2024-04-19T02:57:13.929 INFO:teuthology.orchestra.run.smithi144.stdout:19 Apr 02:57:13 ntpd[12978]: Listen normally on 3 enp3s0f1 172.21.15.144:123 2024-04-19T02:57:13.929 INFO:teuthology.orchestra.run.smithi144.stdout:19 Apr 02:57:13 ntpd[12978]: Listen normally on 4 lo [::1]:123 2024-04-19T02:57:13.929 INFO:teuthology.orchestra.run.smithi144.stdout:19 Apr 02:57:13 ntpd[12978]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:7f5f%5]:123 2024-04-19T02:57:13.929 INFO:teuthology.orchestra.run.smithi144.stdout:19 Apr 02:57:13 ntpd[12978]: Listening on routing socket on fd #22 for interface updates 2024-04-19T02:57:14.917 INFO:teuthology.orchestra.run.smithi096.stderr:19 Apr 02:57:14 ntpd[12953]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T02:57:14.917 INFO:teuthology.orchestra.run.smithi096.stderr:19 Apr 02:57:14 ntpd[12953]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T02:57:14.917 INFO:teuthology.orchestra.run.smithi096.stderr:19 Apr 02:57:14 ntpd[12953]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T02:57:14.917 INFO:teuthology.orchestra.run.smithi096.stderr:19 Apr 02:57:14 ntpd[12953]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T02:57:14.917 INFO:teuthology.orchestra.run.smithi096.stderr:19 Apr 02:57:14 ntpd[12953]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-19T02:57:14.917 INFO:teuthology.orchestra.run.smithi096.stderr:19 Apr 02:57:14 ntpd[12953]: can't open /var/log/ntpstats/peerstats.20240419: Permission denied 2024-04-19T02:57:14.918 INFO:teuthology.orchestra.run.smithi097.stderr:19 Apr 02:57:14 ntpd[13017]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T02:57:14.918 INFO:teuthology.orchestra.run.smithi097.stderr:19 Apr 02:57:14 ntpd[13017]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T02:57:14.919 INFO:teuthology.orchestra.run.smithi097.stderr:19 Apr 02:57:14 ntpd[13017]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T02:57:14.919 INFO:teuthology.orchestra.run.smithi097.stderr:19 Apr 02:57:14 ntpd[13017]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T02:57:14.919 INFO:teuthology.orchestra.run.smithi097.stderr:19 Apr 02:57:14 ntpd[13017]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-19T02:57:14.919 INFO:teuthology.orchestra.run.smithi097.stderr:19 Apr 02:57:14 ntpd[13017]: can't open /var/log/ntpstats/peerstats.20240419: Permission denied 2024-04-19T02:57:14.921 INFO:teuthology.orchestra.run.smithi134.stderr:19 Apr 02:57:14 ntpd[12936]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T02:57:14.921 INFO:teuthology.orchestra.run.smithi134.stderr:19 Apr 02:57:14 ntpd[12936]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T02:57:14.921 INFO:teuthology.orchestra.run.smithi134.stderr:19 Apr 02:57:14 ntpd[12936]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T02:57:14.922 INFO:teuthology.orchestra.run.smithi134.stderr:19 Apr 02:57:14 ntpd[12936]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T02:57:14.922 INFO:teuthology.orchestra.run.smithi134.stderr:19 Apr 02:57:14 ntpd[12936]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-19T02:57:14.922 INFO:teuthology.orchestra.run.smithi134.stderr:19 Apr 02:57:14 ntpd[12936]: can't open /var/log/ntpstats/peerstats.20240419: Permission denied 2024-04-19T02:57:14.923 INFO:teuthology.orchestra.run.smithi144.stderr:19 Apr 02:57:14 ntpd[12978]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T02:57:14.923 INFO:teuthology.orchestra.run.smithi144.stderr:19 Apr 02:57:14 ntpd[12978]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T02:57:14.924 INFO:teuthology.orchestra.run.smithi144.stderr:19 Apr 02:57:14 ntpd[12978]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T02:57:14.924 INFO:teuthology.orchestra.run.smithi144.stderr:19 Apr 02:57:14 ntpd[12978]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T02:57:14.924 INFO:teuthology.orchestra.run.smithi144.stderr:19 Apr 02:57:14 ntpd[12978]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T02:57:14.924 INFO:teuthology.orchestra.run.smithi144.stderr:19 Apr 02:57:14 ntpd[12978]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T02:57:14.924 INFO:teuthology.orchestra.run.smithi144.stderr:19 Apr 02:57:14 ntpd[12978]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-19T02:57:14.924 INFO:teuthology.orchestra.run.smithi144.stderr:19 Apr 02:57:14 ntpd[12978]: can't open /var/log/ntpstats/peerstats.20240419: Permission denied 2024-04-19T02:57:14.924 INFO:teuthology.orchestra.run.smithi144.stderr:19 Apr 02:57:14 ntpd[12978]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T02:57:14.924 INFO:teuthology.orchestra.run.smithi144.stderr:19 Apr 02:57:14 ntpd[12978]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T02:57:14.924 INFO:teuthology.orchestra.run.smithi144.stderr:19 Apr 02:57:14 ntpd[12978]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-19T02:57:14.924 INFO:teuthology.orchestra.run.smithi144.stderr:19 Apr 02:57:14 ntpd[12978]: can't open /var/log/ntpstats/peerstats.20240419: Permission denied 2024-04-19T02:57:15.917 INFO:teuthology.orchestra.run.smithi096.stderr:19 Apr 02:57:15 ntpd[12953]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T02:57:15.917 INFO:teuthology.orchestra.run.smithi096.stderr:19 Apr 02:57:15 ntpd[12953]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T02:57:15.917 INFO:teuthology.orchestra.run.smithi096.stderr:19 Apr 02:57:15 ntpd[12953]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T02:57:15.917 INFO:teuthology.orchestra.run.smithi096.stderr:19 Apr 02:57:15 ntpd[12953]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T02:57:15.917 INFO:teuthology.orchestra.run.smithi096.stderr:19 Apr 02:57:15 ntpd[12953]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-19T02:57:15.917 INFO:teuthology.orchestra.run.smithi096.stderr:19 Apr 02:57:15 ntpd[12953]: can't open /var/log/ntpstats/peerstats.20240419: Permission denied 2024-04-19T02:57:15.919 INFO:teuthology.orchestra.run.smithi097.stderr:19 Apr 02:57:15 ntpd[13017]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T02:57:15.919 INFO:teuthology.orchestra.run.smithi097.stderr:19 Apr 02:57:15 ntpd[13017]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T02:57:15.919 INFO:teuthology.orchestra.run.smithi097.stderr:19 Apr 02:57:15 ntpd[13017]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T02:57:15.919 INFO:teuthology.orchestra.run.smithi097.stderr:19 Apr 02:57:15 ntpd[13017]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T02:57:15.919 INFO:teuthology.orchestra.run.smithi097.stderr:19 Apr 02:57:15 ntpd[13017]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T02:57:15.919 INFO:teuthology.orchestra.run.smithi097.stderr:19 Apr 02:57:15 ntpd[13017]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T02:57:15.920 INFO:teuthology.orchestra.run.smithi097.stderr:19 Apr 02:57:15 ntpd[13017]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-19T02:57:15.920 INFO:teuthology.orchestra.run.smithi097.stderr:19 Apr 02:57:15 ntpd[13017]: can't open /var/log/ntpstats/peerstats.20240419: Permission denied 2024-04-19T02:57:15.921 INFO:teuthology.orchestra.run.smithi134.stderr:19 Apr 02:57:15 ntpd[12936]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T02:57:15.921 INFO:teuthology.orchestra.run.smithi134.stderr:19 Apr 02:57:15 ntpd[12936]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T02:57:15.921 INFO:teuthology.orchestra.run.smithi134.stderr:19 Apr 02:57:15 ntpd[12936]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T02:57:15.921 INFO:teuthology.orchestra.run.smithi134.stderr:19 Apr 02:57:15 ntpd[12936]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T02:57:15.921 INFO:teuthology.orchestra.run.smithi134.stderr:19 Apr 02:57:15 ntpd[12936]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-19T02:57:15.921 INFO:teuthology.orchestra.run.smithi134.stderr:19 Apr 02:57:15 ntpd[12936]: can't open /var/log/ntpstats/peerstats.20240419: Permission denied 2024-04-19T02:57:15.922 INFO:teuthology.orchestra.run.smithi144.stderr:19 Apr 02:57:15 ntpd[12978]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T02:57:15.922 INFO:teuthology.orchestra.run.smithi144.stderr:19 Apr 02:57:15 ntpd[12978]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T02:57:16.916 INFO:teuthology.orchestra.run.smithi096.stderr:19 Apr 02:57:16 ntpd[12953]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T02:57:16.917 INFO:teuthology.orchestra.run.smithi096.stderr:19 Apr 02:57:16 ntpd[12953]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T02:57:16.917 INFO:teuthology.orchestra.run.smithi096.stderr:19 Apr 02:57:16 ntpd[12953]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T02:57:16.917 INFO:teuthology.orchestra.run.smithi096.stderr:19 Apr 02:57:16 ntpd[12953]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T02:57:16.917 INFO:teuthology.orchestra.run.smithi096.stderr:19 Apr 02:57:16 ntpd[12953]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-19T02:57:16.917 INFO:teuthology.orchestra.run.smithi096.stderr:19 Apr 02:57:16 ntpd[12953]: can't open /var/log/ntpstats/peerstats.20240419: Permission denied 2024-04-19T02:57:16.919 INFO:teuthology.orchestra.run.smithi097.stderr:19 Apr 02:57:16 ntpd[13017]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T02:57:16.919 INFO:teuthology.orchestra.run.smithi097.stderr:19 Apr 02:57:16 ntpd[13017]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T02:57:16.919 INFO:teuthology.orchestra.run.smithi097.stderr:19 Apr 02:57:16 ntpd[13017]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T02:57:16.919 INFO:teuthology.orchestra.run.smithi097.stderr:19 Apr 02:57:16 ntpd[13017]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T02:57:16.919 INFO:teuthology.orchestra.run.smithi097.stderr:19 Apr 02:57:16 ntpd[13017]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-19T02:57:16.919 INFO:teuthology.orchestra.run.smithi097.stderr:19 Apr 02:57:16 ntpd[13017]: can't open /var/log/ntpstats/peerstats.20240419: Permission denied 2024-04-19T02:57:16.921 INFO:teuthology.orchestra.run.smithi134.stderr:19 Apr 02:57:16 ntpd[12936]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T02:57:16.921 INFO:teuthology.orchestra.run.smithi134.stderr:19 Apr 02:57:16 ntpd[12936]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T02:57:16.921 INFO:teuthology.orchestra.run.smithi134.stderr:19 Apr 02:57:16 ntpd[12936]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T02:57:16.921 INFO:teuthology.orchestra.run.smithi134.stderr:19 Apr 02:57:16 ntpd[12936]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T02:57:16.922 INFO:teuthology.orchestra.run.smithi134.stderr:19 Apr 02:57:16 ntpd[12936]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-19T02:57:16.922 INFO:teuthology.orchestra.run.smithi134.stderr:19 Apr 02:57:16 ntpd[12936]: can't open /var/log/ntpstats/peerstats.20240419: Permission denied 2024-04-19T02:57:16.923 INFO:teuthology.orchestra.run.smithi144.stderr:19 Apr 02:57:16 ntpd[12978]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T02:57:16.923 INFO:teuthology.orchestra.run.smithi144.stderr:19 Apr 02:57:16 ntpd[12978]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T02:57:16.923 INFO:teuthology.orchestra.run.smithi144.stderr:19 Apr 02:57:16 ntpd[12978]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T02:57:16.923 INFO:teuthology.orchestra.run.smithi144.stderr:19 Apr 02:57:16 ntpd[12978]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T02:57:16.924 INFO:teuthology.orchestra.run.smithi144.stderr:19 Apr 02:57:16 ntpd[12978]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T02:57:16.924 INFO:teuthology.orchestra.run.smithi144.stderr:19 Apr 02:57:16 ntpd[12978]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T02:57:16.924 INFO:teuthology.orchestra.run.smithi144.stderr:19 Apr 02:57:16 ntpd[12978]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-19T02:57:16.924 INFO:teuthology.orchestra.run.smithi144.stderr:19 Apr 02:57:16 ntpd[12978]: can't open /var/log/ntpstats/peerstats.20240419: Permission denied 2024-04-19T02:57:16.924 INFO:teuthology.orchestra.run.smithi144.stderr:19 Apr 02:57:16 ntpd[12978]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T02:57:16.924 INFO:teuthology.orchestra.run.smithi144.stderr:19 Apr 02:57:16 ntpd[12978]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T02:57:16.924 INFO:teuthology.orchestra.run.smithi144.stderr:19 Apr 02:57:16 ntpd[12978]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-19T02:57:16.924 INFO:teuthology.orchestra.run.smithi144.stderr:19 Apr 02:57:16 ntpd[12978]: can't open /var/log/ntpstats/peerstats.20240419: Permission denied 2024-04-19T02:57:17.917 INFO:teuthology.orchestra.run.smithi096.stderr:19 Apr 02:57:17 ntpd[12953]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T02:57:17.917 INFO:teuthology.orchestra.run.smithi096.stderr:19 Apr 02:57:17 ntpd[12953]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T02:57:17.917 INFO:teuthology.orchestra.run.smithi096.stderr:19 Apr 02:57:17 ntpd[12953]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T02:57:17.917 INFO:teuthology.orchestra.run.smithi096.stderr:19 Apr 02:57:17 ntpd[12953]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T02:57:17.917 INFO:teuthology.orchestra.run.smithi096.stderr:19 Apr 02:57:17 ntpd[12953]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T02:57:17.917 INFO:teuthology.orchestra.run.smithi096.stderr:19 Apr 02:57:17 ntpd[12953]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T02:57:17.917 INFO:teuthology.orchestra.run.smithi096.stderr:19 Apr 02:57:17 ntpd[12953]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-19T02:57:17.917 INFO:teuthology.orchestra.run.smithi096.stderr:19 Apr 02:57:17 ntpd[12953]: can't open /var/log/ntpstats/peerstats.20240419: Permission denied 2024-04-19T02:57:17.919 INFO:teuthology.orchestra.run.smithi097.stderr:19 Apr 02:57:17 ntpd[13017]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T02:57:17.919 INFO:teuthology.orchestra.run.smithi097.stderr:19 Apr 02:57:17 ntpd[13017]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T02:57:17.919 INFO:teuthology.orchestra.run.smithi097.stderr:19 Apr 02:57:17 ntpd[13017]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T02:57:17.919 INFO:teuthology.orchestra.run.smithi097.stderr:19 Apr 02:57:17 ntpd[13017]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T02:57:17.919 INFO:teuthology.orchestra.run.smithi097.stderr:19 Apr 02:57:17 ntpd[13017]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-19T02:57:17.919 INFO:teuthology.orchestra.run.smithi097.stderr:19 Apr 02:57:17 ntpd[13017]: can't open /var/log/ntpstats/peerstats.20240419: Permission denied 2024-04-19T02:57:17.921 INFO:teuthology.orchestra.run.smithi134.stderr:19 Apr 02:57:17 ntpd[12936]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T02:57:17.922 INFO:teuthology.orchestra.run.smithi134.stderr:19 Apr 02:57:17 ntpd[12936]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T02:57:17.922 INFO:teuthology.orchestra.run.smithi134.stderr:19 Apr 02:57:17 ntpd[12936]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T02:57:17.922 INFO:teuthology.orchestra.run.smithi134.stderr:19 Apr 02:57:17 ntpd[12936]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T02:57:17.922 INFO:teuthology.orchestra.run.smithi134.stderr:19 Apr 02:57:17 ntpd[12936]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T02:57:17.922 INFO:teuthology.orchestra.run.smithi134.stderr:19 Apr 02:57:17 ntpd[12936]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T02:57:17.922 INFO:teuthology.orchestra.run.smithi134.stderr:19 Apr 02:57:17 ntpd[12936]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-19T02:57:17.922 INFO:teuthology.orchestra.run.smithi134.stderr:19 Apr 02:57:17 ntpd[12936]: can't open /var/log/ntpstats/peerstats.20240419: Permission denied 2024-04-19T02:57:17.922 INFO:teuthology.orchestra.run.smithi134.stderr:19 Apr 02:57:17 ntpd[12936]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T02:57:17.922 INFO:teuthology.orchestra.run.smithi134.stderr:19 Apr 02:57:17 ntpd[12936]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T02:57:17.922 INFO:teuthology.orchestra.run.smithi134.stderr:19 Apr 02:57:17 ntpd[12936]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-19T02:57:17.922 INFO:teuthology.orchestra.run.smithi134.stderr:19 Apr 02:57:17 ntpd[12936]: can't open /var/log/ntpstats/peerstats.20240419: Permission denied 2024-04-19T02:57:18.917 INFO:teuthology.orchestra.run.smithi096.stderr:19 Apr 02:57:18 ntpd[12953]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T02:57:18.917 INFO:teuthology.orchestra.run.smithi096.stderr:19 Apr 02:57:18 ntpd[12953]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T02:57:18.917 INFO:teuthology.orchestra.run.smithi096.stderr:19 Apr 02:57:18 ntpd[12953]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T02:57:18.917 INFO:teuthology.orchestra.run.smithi096.stderr:19 Apr 02:57:18 ntpd[12953]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T02:57:18.917 INFO:teuthology.orchestra.run.smithi096.stderr:19 Apr 02:57:18 ntpd[12953]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T02:57:18.917 INFO:teuthology.orchestra.run.smithi096.stderr:19 Apr 02:57:18 ntpd[12953]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T02:57:18.918 INFO:teuthology.orchestra.run.smithi096.stderr:19 Apr 02:57:18 ntpd[12953]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-19T02:57:18.918 INFO:teuthology.orchestra.run.smithi096.stderr:19 Apr 02:57:18 ntpd[12953]: can't open /var/log/ntpstats/peerstats.20240419: Permission denied 2024-04-19T02:57:18.918 INFO:teuthology.orchestra.run.smithi096.stderr:19 Apr 02:57:18 ntpd[12953]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T02:57:18.918 INFO:teuthology.orchestra.run.smithi096.stderr:19 Apr 02:57:18 ntpd[12953]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T02:57:18.918 INFO:teuthology.orchestra.run.smithi096.stderr:19 Apr 02:57:18 ntpd[12953]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-19T02:57:18.918 INFO:teuthology.orchestra.run.smithi096.stderr:19 Apr 02:57:18 ntpd[12953]: can't open /var/log/ntpstats/peerstats.20240419: Permission denied 2024-04-19T02:57:18.919 INFO:teuthology.orchestra.run.smithi097.stderr:19 Apr 02:57:18 ntpd[13017]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T02:57:18.919 INFO:teuthology.orchestra.run.smithi097.stderr:19 Apr 02:57:18 ntpd[13017]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T02:57:18.919 INFO:teuthology.orchestra.run.smithi097.stderr:19 Apr 02:57:18 ntpd[13017]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T02:57:18.919 INFO:teuthology.orchestra.run.smithi097.stderr:19 Apr 02:57:18 ntpd[13017]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T02:57:18.919 INFO:teuthology.orchestra.run.smithi097.stderr:19 Apr 02:57:18 ntpd[13017]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T02:57:18.920 INFO:teuthology.orchestra.run.smithi097.stderr:19 Apr 02:57:18 ntpd[13017]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T02:57:18.920 INFO:teuthology.orchestra.run.smithi097.stderr:19 Apr 02:57:18 ntpd[13017]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-19T02:57:18.920 INFO:teuthology.orchestra.run.smithi097.stderr:19 Apr 02:57:18 ntpd[13017]: can't open /var/log/ntpstats/peerstats.20240419: Permission denied 2024-04-19T02:57:18.920 INFO:teuthology.orchestra.run.smithi097.stderr:19 Apr 02:57:18 ntpd[13017]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T02:57:18.920 INFO:teuthology.orchestra.run.smithi097.stderr:19 Apr 02:57:18 ntpd[13017]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T02:57:18.920 INFO:teuthology.orchestra.run.smithi097.stderr:19 Apr 02:57:18 ntpd[13017]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-19T02:57:18.920 INFO:teuthology.orchestra.run.smithi097.stderr:19 Apr 02:57:18 ntpd[13017]: can't open /var/log/ntpstats/peerstats.20240419: Permission denied 2024-04-19T02:57:18.921 INFO:teuthology.orchestra.run.smithi134.stderr:19 Apr 02:57:18 ntpd[12936]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T02:57:18.921 INFO:teuthology.orchestra.run.smithi134.stderr:19 Apr 02:57:18 ntpd[12936]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T02:57:18.921 INFO:teuthology.orchestra.run.smithi134.stderr:19 Apr 02:57:18 ntpd[12936]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T02:57:18.921 INFO:teuthology.orchestra.run.smithi134.stderr:19 Apr 02:57:18 ntpd[12936]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T02:57:18.921 INFO:teuthology.orchestra.run.smithi134.stderr:19 Apr 02:57:18 ntpd[12936]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T02:57:18.921 INFO:teuthology.orchestra.run.smithi134.stderr:19 Apr 02:57:18 ntpd[12936]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T02:57:18.921 INFO:teuthology.orchestra.run.smithi134.stderr:19 Apr 02:57:18 ntpd[12936]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-19T02:57:18.922 INFO:teuthology.orchestra.run.smithi134.stderr:19 Apr 02:57:18 ntpd[12936]: can't open /var/log/ntpstats/peerstats.20240419: Permission denied 2024-04-19T02:57:18.923 INFO:teuthology.orchestra.run.smithi144.stderr:19 Apr 02:57:18 ntpd[12978]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T02:57:18.924 INFO:teuthology.orchestra.run.smithi144.stderr:19 Apr 02:57:18 ntpd[12978]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T02:57:18.924 INFO:teuthology.orchestra.run.smithi144.stderr:19 Apr 02:57:18 ntpd[12978]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T02:57:18.924 INFO:teuthology.orchestra.run.smithi144.stderr:19 Apr 02:57:18 ntpd[12978]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T02:57:18.924 INFO:teuthology.orchestra.run.smithi144.stderr:19 Apr 02:57:18 ntpd[12978]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T02:57:18.924 INFO:teuthology.orchestra.run.smithi144.stderr:19 Apr 02:57:18 ntpd[12978]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T02:57:18.924 INFO:teuthology.orchestra.run.smithi144.stderr:19 Apr 02:57:18 ntpd[12978]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T02:57:18.924 INFO:teuthology.orchestra.run.smithi144.stderr:19 Apr 02:57:18 ntpd[12978]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T02:57:18.924 INFO:teuthology.orchestra.run.smithi144.stderr:19 Apr 02:57:18 ntpd[12978]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-19T02:57:18.924 INFO:teuthology.orchestra.run.smithi144.stderr:19 Apr 02:57:18 ntpd[12978]: can't open /var/log/ntpstats/peerstats.20240419: Permission denied 2024-04-19T02:57:18.924 INFO:teuthology.orchestra.run.smithi144.stderr:19 Apr 02:57:18 ntpd[12978]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T02:57:18.924 INFO:teuthology.orchestra.run.smithi144.stderr:19 Apr 02:57:18 ntpd[12978]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T02:57:18.924 INFO:teuthology.orchestra.run.smithi144.stderr:19 Apr 02:57:18 ntpd[12978]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-19T02:57:18.924 INFO:teuthology.orchestra.run.smithi144.stderr:19 Apr 02:57:18 ntpd[12978]: can't open /var/log/ntpstats/peerstats.20240419: Permission denied 2024-04-19T02:57:18.924 INFO:teuthology.orchestra.run.smithi144.stderr:19 Apr 02:57:18 ntpd[12978]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T02:57:18.924 INFO:teuthology.orchestra.run.smithi144.stderr:19 Apr 02:57:18 ntpd[12978]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T02:57:18.925 INFO:teuthology.orchestra.run.smithi144.stderr:19 Apr 02:57:18 ntpd[12978]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-19T02:57:18.925 INFO:teuthology.orchestra.run.smithi144.stderr:19 Apr 02:57:18 ntpd[12978]: can't open /var/log/ntpstats/peerstats.20240419: Permission denied 2024-04-19T02:57:19.917 INFO:teuthology.orchestra.run.smithi096.stderr:19 Apr 02:57:19 ntpd[12953]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T02:57:19.917 INFO:teuthology.orchestra.run.smithi096.stderr:19 Apr 02:57:19 ntpd[12953]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T02:57:19.917 INFO:teuthology.orchestra.run.smithi096.stderr:19 Apr 02:57:19 ntpd[12953]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T02:57:19.917 INFO:teuthology.orchestra.run.smithi096.stderr:19 Apr 02:57:19 ntpd[12953]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T02:57:19.917 INFO:teuthology.orchestra.run.smithi096.stderr:19 Apr 02:57:19 ntpd[12953]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-19T02:57:19.917 INFO:teuthology.orchestra.run.smithi096.stderr:19 Apr 02:57:19 ntpd[12953]: can't open /var/log/ntpstats/peerstats.20240419: Permission denied 2024-04-19T02:57:19.919 INFO:teuthology.orchestra.run.smithi097.stderr:19 Apr 02:57:19 ntpd[13017]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T02:57:19.919 INFO:teuthology.orchestra.run.smithi097.stderr:19 Apr 02:57:19 ntpd[13017]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T02:57:19.919 INFO:teuthology.orchestra.run.smithi097.stderr:19 Apr 02:57:19 ntpd[13017]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T02:57:19.919 INFO:teuthology.orchestra.run.smithi097.stderr:19 Apr 02:57:19 ntpd[13017]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T02:57:19.919 INFO:teuthology.orchestra.run.smithi097.stderr:19 Apr 02:57:19 ntpd[13017]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-19T02:57:19.919 INFO:teuthology.orchestra.run.smithi097.stderr:19 Apr 02:57:19 ntpd[13017]: can't open /var/log/ntpstats/peerstats.20240419: Permission denied 2024-04-19T02:57:19.921 INFO:teuthology.orchestra.run.smithi134.stderr:19 Apr 02:57:19 ntpd[12936]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T02:57:19.921 INFO:teuthology.orchestra.run.smithi134.stderr:19 Apr 02:57:19 ntpd[12936]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T02:57:19.922 INFO:teuthology.orchestra.run.smithi134.stderr:19 Apr 02:57:19 ntpd[12936]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T02:57:19.922 INFO:teuthology.orchestra.run.smithi134.stderr:19 Apr 02:57:19 ntpd[12936]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T02:57:19.922 INFO:teuthology.orchestra.run.smithi134.stderr:19 Apr 02:57:19 ntpd[12936]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T02:57:19.922 INFO:teuthology.orchestra.run.smithi134.stderr:19 Apr 02:57:19 ntpd[12936]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T02:57:19.922 INFO:teuthology.orchestra.run.smithi134.stderr:19 Apr 02:57:19 ntpd[12936]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-19T02:57:19.922 INFO:teuthology.orchestra.run.smithi134.stderr:19 Apr 02:57:19 ntpd[12936]: can't open /var/log/ntpstats/peerstats.20240419: Permission denied 2024-04-19T02:57:19.922 INFO:teuthology.orchestra.run.smithi134.stderr:19 Apr 02:57:19 ntpd[12936]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T02:57:19.922 INFO:teuthology.orchestra.run.smithi134.stderr:19 Apr 02:57:19 ntpd[12936]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T02:57:19.922 INFO:teuthology.orchestra.run.smithi134.stderr:19 Apr 02:57:19 ntpd[12936]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-19T02:57:19.922 INFO:teuthology.orchestra.run.smithi134.stderr:19 Apr 02:57:19 ntpd[12936]: can't open /var/log/ntpstats/peerstats.20240419: Permission denied 2024-04-19T02:57:20.917 INFO:teuthology.orchestra.run.smithi096.stderr:19 Apr 02:57:20 ntpd[12953]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T02:57:20.917 INFO:teuthology.orchestra.run.smithi096.stderr:19 Apr 02:57:20 ntpd[12953]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T02:57:20.917 INFO:teuthology.orchestra.run.smithi096.stderr:19 Apr 02:57:20 ntpd[12953]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T02:57:20.917 INFO:teuthology.orchestra.run.smithi096.stderr:19 Apr 02:57:20 ntpd[12953]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T02:57:20.917 INFO:teuthology.orchestra.run.smithi096.stderr:19 Apr 02:57:20 ntpd[12953]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T02:57:20.917 INFO:teuthology.orchestra.run.smithi096.stderr:19 Apr 02:57:20 ntpd[12953]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T02:57:20.917 INFO:teuthology.orchestra.run.smithi096.stderr:19 Apr 02:57:20 ntpd[12953]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-19T02:57:20.917 INFO:teuthology.orchestra.run.smithi096.stderr:19 Apr 02:57:20 ntpd[12953]: can't open /var/log/ntpstats/peerstats.20240419: Permission denied 2024-04-19T02:57:20.917 INFO:teuthology.orchestra.run.smithi096.stdout:19 Apr 02:57:20 ntpd[12953]: ntpd: time slew -0.001351 s 2024-04-19T02:57:20.918 INFO:teuthology.orchestra.run.smithi096.stdout:ntpd: time slew -0.001351s 2024-04-19T02:57:20.918 INFO:teuthology.orchestra.run.smithi096.stderr:19 Apr 02:57:20 ntpd[12953]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-04-19T02:57:20.918 INFO:teuthology.orchestra.run.smithi096.stderr:19 Apr 02:57:20 ntpd[12953]: can't open /var/log/ntpstats/loopstats.20240419: Permission denied 2024-04-19T02:57:20.919 INFO:teuthology.orchestra.run.smithi097.stderr:19 Apr 02:57:20 ntpd[13017]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T02:57:20.919 INFO:teuthology.orchestra.run.smithi097.stderr:19 Apr 02:57:20 ntpd[13017]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T02:57:20.919 INFO:teuthology.orchestra.run.smithi097.stderr:19 Apr 02:57:20 ntpd[13017]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T02:57:20.919 INFO:teuthology.orchestra.run.smithi097.stderr:19 Apr 02:57:20 ntpd[13017]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T02:57:20.919 INFO:teuthology.orchestra.run.smithi097.stderr:19 Apr 02:57:20 ntpd[13017]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T02:57:20.919 INFO:teuthology.orchestra.run.smithi097.stderr:19 Apr 02:57:20 ntpd[13017]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T02:57:20.919 INFO:teuthology.orchestra.run.smithi097.stderr:19 Apr 02:57:20 ntpd[13017]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-19T02:57:20.919 INFO:teuthology.orchestra.run.smithi097.stderr:19 Apr 02:57:20 ntpd[13017]: can't open /var/log/ntpstats/peerstats.20240419: Permission denied 2024-04-19T02:57:20.920 INFO:teuthology.orchestra.run.smithi097.stdout:19 Apr 02:57:20 ntpd[13017]: ntpd: time slew +0.001886 s 2024-04-19T02:57:20.920 INFO:teuthology.orchestra.run.smithi097.stdout:ntpd: time slew +0.001886s 2024-04-19T02:57:20.920 INFO:teuthology.orchestra.run.smithi097.stderr:19 Apr 02:57:20 ntpd[13017]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-04-19T02:57:20.921 INFO:teuthology.orchestra.run.smithi097.stderr:19 Apr 02:57:20 ntpd[13017]: can't open /var/log/ntpstats/loopstats.20240419: Permission denied 2024-04-19T02:57:20.922 INFO:teuthology.orchestra.run.smithi134.stderr:19 Apr 02:57:20 ntpd[12936]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T02:57:20.922 INFO:teuthology.orchestra.run.smithi134.stderr:19 Apr 02:57:20 ntpd[12936]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T02:57:20.922 INFO:teuthology.orchestra.run.smithi134.stderr:19 Apr 02:57:20 ntpd[12936]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T02:57:20.922 INFO:teuthology.orchestra.run.smithi134.stderr:19 Apr 02:57:20 ntpd[12936]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T02:57:20.922 INFO:teuthology.orchestra.run.smithi134.stderr:19 Apr 02:57:20 ntpd[12936]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-19T02:57:20.922 INFO:teuthology.orchestra.run.smithi134.stderr:19 Apr 02:57:20 ntpd[12936]: can't open /var/log/ntpstats/peerstats.20240419: Permission denied 2024-04-19T02:57:20.923 INFO:teuthology.orchestra.run.smithi134.stdout:19 Apr 02:57:20 ntpd[12936]: ntpd: time slew +0.000031 s 2024-04-19T02:57:20.923 INFO:teuthology.orchestra.run.smithi134.stdout:ntpd: time slew +0.000031s 2024-04-19T02:57:20.923 INFO:teuthology.orchestra.run.smithi134.stderr:19 Apr 02:57:20 ntpd[12936]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-04-19T02:57:20.923 INFO:teuthology.orchestra.run.smithi134.stderr:19 Apr 02:57:20 ntpd[12936]: can't open /var/log/ntpstats/loopstats.20240419: Permission denied 2024-04-19T02:57:20.924 INFO:teuthology.orchestra.run.smithi144.stderr:19 Apr 02:57:20 ntpd[12978]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T02:57:20.924 INFO:teuthology.orchestra.run.smithi144.stderr:19 Apr 02:57:20 ntpd[12978]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T02:57:20.924 INFO:teuthology.orchestra.run.smithi144.stderr:19 Apr 02:57:20 ntpd[12978]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T02:57:20.925 INFO:teuthology.orchestra.run.smithi144.stderr:19 Apr 02:57:20 ntpd[12978]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T02:57:20.925 INFO:teuthology.orchestra.run.smithi144.stderr:19 Apr 02:57:20 ntpd[12978]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T02:57:20.925 INFO:teuthology.orchestra.run.smithi144.stderr:19 Apr 02:57:20 ntpd[12978]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T02:57:20.925 INFO:teuthology.orchestra.run.smithi144.stderr:19 Apr 02:57:20 ntpd[12978]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-19T02:57:20.925 INFO:teuthology.orchestra.run.smithi144.stderr:19 Apr 02:57:20 ntpd[12978]: can't open /var/log/ntpstats/rawstats.20240419: Permission denied 2024-04-19T02:57:20.925 INFO:teuthology.orchestra.run.smithi144.stderr:19 Apr 02:57:20 ntpd[12978]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-19T02:57:20.925 INFO:teuthology.orchestra.run.smithi144.stderr:19 Apr 02:57:20 ntpd[12978]: can't open /var/log/ntpstats/peerstats.20240419: Permission denied 2024-04-19T02:57:20.925 INFO:teuthology.orchestra.run.smithi144.stdout:19 Apr 02:57:20 ntpd[12978]: ntpd: time slew +0.000484 s 2024-04-19T02:57:20.925 INFO:teuthology.orchestra.run.smithi144.stdout:ntpd: time slew +0.000484s 2024-04-19T02:57:20.926 INFO:teuthology.orchestra.run.smithi144.stderr:19 Apr 02:57:20 ntpd[12978]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-04-19T02:57:20.926 INFO:teuthology.orchestra.run.smithi144.stderr:19 Apr 02:57:20 ntpd[12978]: can't open /var/log/ntpstats/loopstats.20240419: Permission denied 2024-04-19T02:57:20.985 INFO:teuthology.orchestra.run.smithi096.stdout: remote refid st t when poll reach delay offset jitter 2024-04-19T02:57:20.985 INFO:teuthology.orchestra.run.smithi096.stdout:============================================================================== 2024-04-19T02:57:20.985 INFO:teuthology.orchestra.run.smithi096.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-04-19T02:57:20.985 INFO:teuthology.orchestra.run.smithi096.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-04-19T02:57:20.985 INFO:teuthology.orchestra.run.smithi096.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-04-19T02:57:20.986 INFO:teuthology.orchestra.run.smithi096.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-04-19T02:57:20.994 INFO:teuthology.orchestra.run.smithi134.stdout: remote refid st t when poll reach delay offset jitter 2024-04-19T02:57:20.994 INFO:teuthology.orchestra.run.smithi134.stdout:============================================================================== 2024-04-19T02:57:20.994 INFO:teuthology.orchestra.run.smithi134.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-04-19T02:57:20.994 INFO:teuthology.orchestra.run.smithi134.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-04-19T02:57:20.994 INFO:teuthology.orchestra.run.smithi134.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-04-19T02:57:20.994 INFO:teuthology.orchestra.run.smithi134.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-04-19T02:57:20.995 INFO:teuthology.orchestra.run.smithi144.stdout: remote refid st t when poll reach delay offset jitter 2024-04-19T02:57:20.995 INFO:teuthology.orchestra.run.smithi144.stdout:============================================================================== 2024-04-19T02:57:20.995 INFO:teuthology.orchestra.run.smithi144.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-04-19T02:57:20.995 INFO:teuthology.orchestra.run.smithi144.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-04-19T02:57:20.995 INFO:teuthology.orchestra.run.smithi144.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-04-19T02:57:20.995 INFO:teuthology.orchestra.run.smithi144.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-04-19T02:57:21.008 INFO:teuthology.orchestra.run.smithi097.stdout: remote refid st t when poll reach delay offset jitter 2024-04-19T02:57:21.009 INFO:teuthology.orchestra.run.smithi097.stdout:============================================================================== 2024-04-19T02:57:21.009 INFO:teuthology.orchestra.run.smithi097.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-04-19T02:57:21.009 INFO:teuthology.orchestra.run.smithi097.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-04-19T02:57:21.009 INFO:teuthology.orchestra.run.smithi097.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-04-19T02:57:21.009 INFO:teuthology.orchestra.run.smithi097.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2024-04-19T02:57:21.011 INFO:teuthology.run_tasks:Running task install... 2024-04-19T02:57:21.024 DEBUG:teuthology.task.install:project ceph 2024-04-19T02:57:21.024 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '646b8c7d293d8ec31a40c69f7b3237b19c1be24d'}} 2024-04-19T02:57:21.024 DEBUG:teuthology.task.install:config {'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': '646b8c7d293d8ec31a40c69f7b3237b19c1be24d'} 2024-04-19T02:57:21.024 INFO:teuthology.task.install:Using flavor: default 2024-04-19T02:57:21.031 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-04-19T02:57:21.031 INFO:teuthology.task.install:extra packages: [] 2024-04-19T02:57:21.031 DEBUG:teuthology.orchestra.run.smithi096:> sudo apt-key list | grep Ceph 2024-04-19T02:57:21.032 DEBUG:teuthology.orchestra.run.smithi097:> sudo apt-key list | grep Ceph 2024-04-19T02:57:21.032 DEBUG:teuthology.orchestra.run.smithi134:> sudo apt-key list | grep Ceph 2024-04-19T02:57:21.033 DEBUG:teuthology.orchestra.run.smithi144:> sudo apt-key list | grep Ceph 2024-04-19T02:57:21.132 INFO:teuthology.orchestra.run.smithi096.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2024-04-19T02:57:21.133 INFO:teuthology.orchestra.run.smithi097.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2024-04-19T02:57:21.134 INFO:teuthology.orchestra.run.smithi134.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2024-04-19T02:57:21.144 INFO:teuthology.orchestra.run.smithi144.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2024-04-19T02:57:21.194 INFO:teuthology.orchestra.run.smithi097.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-04-19T02:57:21.194 INFO:teuthology.orchestra.run.smithi097.stdout:uid [ unknown] Ceph.com (release key) 2024-04-19T02:57:21.195 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-04-19T02:57:21.195 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev on remote deb x86_64 2024-04-19T02:57:21.195 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=646b8c7d293d8ec31a40c69f7b3237b19c1be24d 2024-04-19T02:57:21.201 INFO:teuthology.orchestra.run.smithi134.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-04-19T02:57:21.202 INFO:teuthology.orchestra.run.smithi134.stdout:uid [ unknown] Ceph.com (release key) 2024-04-19T02:57:21.202 INFO:teuthology.orchestra.run.smithi096.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-04-19T02:57:21.202 INFO:teuthology.orchestra.run.smithi096.stdout:uid [ unknown] Ceph.com (release key) 2024-04-19T02:57:21.202 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-04-19T02:57:21.202 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev on remote deb x86_64 2024-04-19T02:57:21.202 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=646b8c7d293d8ec31a40c69f7b3237b19c1be24d 2024-04-19T02:57:21.204 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-04-19T02:57:21.204 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev on remote deb x86_64 2024-04-19T02:57:21.204 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=646b8c7d293d8ec31a40c69f7b3237b19c1be24d 2024-04-19T02:57:21.209 INFO:teuthology.orchestra.run.smithi144.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-04-19T02:57:21.209 INFO:teuthology.orchestra.run.smithi144.stdout:uid [ unknown] Ceph.com (release key) 2024-04-19T02:57:21.210 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-04-19T02:57:21.210 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev on remote deb x86_64 2024-04-19T02:57:21.210 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=646b8c7d293d8ec31a40c69f7b3237b19c1be24d 2024-04-19T02:57:21.355 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default/ 2024-04-19T02:57:21.355 INFO:teuthology.task.install.deb:Package version is 18.2.2-1237-g646b8c7d-1focal 2024-04-19T02:57:21.416 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default/ 2024-04-19T02:57:21.416 INFO:teuthology.task.install.deb:Package version is 18.2.2-1237-g646b8c7d-1focal 2024-04-19T02:57:21.434 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default/ 2024-04-19T02:57:21.435 INFO:teuthology.task.install.deb:Package version is 18.2.2-1237-g646b8c7d-1focal 2024-04-19T02:57:21.439 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default/ 2024-04-19T02:57:21.439 INFO:teuthology.task.install.deb:Package version is 18.2.2-1237-g646b8c7d-1focal 2024-04-19T02:57:21.471 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-04-19T02:57:21.471 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-04-19T02:57:21.489 DEBUG:teuthology.orchestra.run.smithi144:> sudo apt-get update 2024-04-19T02:57:21.529 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-04-19T02:57:21.529 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-04-19T02:57:21.546 DEBUG:teuthology.orchestra.run.smithi097:> sudo apt-get update 2024-04-19T02:57:21.607 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-04-19T02:57:21.607 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-04-19T02:57:21.621 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-04-19T02:57:21.621 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-04-19T02:57:21.623 DEBUG:teuthology.orchestra.run.smithi096:> sudo apt-get update 2024-04-19T02:57:21.638 DEBUG:teuthology.orchestra.run.smithi134:> sudo apt-get update 2024-04-19T02:57:21.682 INFO:teuthology.orchestra.run.smithi144.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2024-04-19T02:57:21.692 INFO:teuthology.orchestra.run.smithi144.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2024-04-19T02:57:21.713 INFO:teuthology.orchestra.run.smithi144.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2024-04-19T02:57:21.730 INFO:teuthology.orchestra.run.smithi144.stdout:Ign:4 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal InRelease 2024-04-19T02:57:21.740 INFO:teuthology.orchestra.run.smithi097.stdout:Hit:1 http://security.ubuntu.com/ubuntu focal-security InRelease 2024-04-19T02:57:21.740 INFO:teuthology.orchestra.run.smithi097.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal InRelease 2024-04-19T02:57:21.750 INFO:teuthology.orchestra.run.smithi097.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2024-04-19T02:57:21.751 INFO:teuthology.orchestra.run.smithi144.stdout:Get:5 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal Release [7,662 B] 2024-04-19T02:57:21.771 INFO:teuthology.orchestra.run.smithi097.stdout:Hit:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2024-04-19T02:57:21.774 INFO:teuthology.orchestra.run.smithi144.stdout:Ign:6 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal Release.gpg 2024-04-19T02:57:21.783 INFO:teuthology.orchestra.run.smithi097.stdout:Ign:5 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal InRelease 2024-04-19T02:57:21.791 INFO:teuthology.orchestra.run.smithi134.stdout:Hit:1 http://security.ubuntu.com/ubuntu focal-security InRelease 2024-04-19T02:57:21.793 INFO:teuthology.orchestra.run.smithi144.stdout:Hit:7 http://security.ubuntu.com/ubuntu focal-security InRelease 2024-04-19T02:57:21.795 INFO:teuthology.orchestra.run.smithi144.stdout:Get:8 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main i386 Packages [3,427 B] 2024-04-19T02:57:21.805 INFO:teuthology.orchestra.run.smithi097.stdout:Get:6 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal Release [7,662 B] 2024-04-19T02:57:21.815 INFO:teuthology.orchestra.run.smithi096.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2024-04-19T02:57:21.824 INFO:teuthology.orchestra.run.smithi096.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2024-04-19T02:57:21.828 INFO:teuthology.orchestra.run.smithi097.stdout:Ign:7 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal Release.gpg 2024-04-19T02:57:21.830 INFO:teuthology.orchestra.run.smithi144.stdout:Get:9 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 Packages [17.3 kB] 2024-04-19T02:57:21.837 INFO:teuthology.orchestra.run.smithi134.stdout:Ign:2 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal InRelease 2024-04-19T02:57:21.845 INFO:teuthology.orchestra.run.smithi096.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2024-04-19T02:57:21.849 INFO:teuthology.orchestra.run.smithi097.stdout:Get:8 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main i386 Packages [3,427 B] 2024-04-19T02:57:21.859 INFO:teuthology.orchestra.run.smithi134.stdout:Get:3 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal Release [7,662 B] 2024-04-19T02:57:21.860 INFO:teuthology.orchestra.run.smithi096.stdout:Ign:4 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal InRelease 2024-04-19T02:57:21.882 INFO:teuthology.orchestra.run.smithi134.stdout:Ign:4 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal Release.gpg 2024-04-19T02:57:21.882 INFO:teuthology.orchestra.run.smithi096.stdout:Get:5 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal Release [7,662 B] 2024-04-19T02:57:21.883 INFO:teuthology.orchestra.run.smithi097.stdout:Get:9 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 Packages [17.3 kB] 2024-04-19T02:57:21.901 INFO:teuthology.orchestra.run.smithi134.stdout:Hit:5 http://archive.ubuntu.com/ubuntu focal InRelease 2024-04-19T02:57:21.902 INFO:teuthology.orchestra.run.smithi134.stdout:Get:6 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 Packages [17.3 kB] 2024-04-19T02:57:21.904 INFO:teuthology.orchestra.run.smithi096.stdout:Ign:6 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal Release.gpg 2024-04-19T02:57:21.926 INFO:teuthology.orchestra.run.smithi096.stdout:Hit:7 http://security.ubuntu.com/ubuntu focal-security InRelease 2024-04-19T02:57:21.926 INFO:teuthology.orchestra.run.smithi096.stdout:Get:8 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 Packages [17.3 kB] 2024-04-19T02:57:21.934 INFO:teuthology.orchestra.run.smithi134.stdout:Get:7 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main i386 Packages [3,427 B] 2024-04-19T02:57:21.962 INFO:teuthology.orchestra.run.smithi096.stdout:Get:9 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main i386 Packages [3,427 B] 2024-04-19T02:57:21.983 INFO:teuthology.orchestra.run.smithi134.stdout:Hit:8 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2024-04-19T02:57:22.065 INFO:teuthology.orchestra.run.smithi134.stdout:Hit:9 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2024-04-19T02:57:22.323 INFO:teuthology.orchestra.run.smithi144.stdout:Fetched 28.4 kB in 1s (45.1 kB/s) 2024-04-19T02:57:22.390 INFO:teuthology.orchestra.run.smithi097.stdout:Fetched 28.4 kB in 1s (44.6 kB/s) 2024-04-19T02:57:22.447 INFO:teuthology.orchestra.run.smithi134.stdout:Fetched 28.4 kB in 1s (44.5 kB/s) 2024-04-19T02:57:22.459 INFO:teuthology.orchestra.run.smithi096.stdout:Fetched 28.4 kB in 1s (45.0 kB/s) 2024-04-19T02:57:23.435 INFO:teuthology.orchestra.run.smithi144.stdout:Reading package lists... 2024-04-19T02:57:23.462 DEBUG:teuthology.orchestra.run.smithi144:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.2.2-1237-g646b8c7d-1focal cephadm=18.2.2-1237-g646b8c7d-1focal ceph-mds=18.2.2-1237-g646b8c7d-1focal ceph-mgr=18.2.2-1237-g646b8c7d-1focal ceph-common=18.2.2-1237-g646b8c7d-1focal ceph-fuse=18.2.2-1237-g646b8c7d-1focal ceph-test=18.2.2-1237-g646b8c7d-1focal ceph-volume=18.2.2-1237-g646b8c7d-1focal radosgw=18.2.2-1237-g646b8c7d-1focal python3-rados=18.2.2-1237-g646b8c7d-1focal python3-rgw=18.2.2-1237-g646b8c7d-1focal python3-cephfs=18.2.2-1237-g646b8c7d-1focal python3-rbd=18.2.2-1237-g646b8c7d-1focal libcephfs2=18.2.2-1237-g646b8c7d-1focal libcephfs-dev=18.2.2-1237-g646b8c7d-1focal librados2=18.2.2-1237-g646b8c7d-1focal librbd1=18.2.2-1237-g646b8c7d-1focal rbd-fuse=18.2.2-1237-g646b8c7d-1focal 2024-04-19T02:57:23.499 INFO:teuthology.orchestra.run.smithi097.stdout:Reading package lists... 2024-04-19T02:57:23.526 DEBUG:teuthology.orchestra.run.smithi097:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.2.2-1237-g646b8c7d-1focal cephadm=18.2.2-1237-g646b8c7d-1focal ceph-mds=18.2.2-1237-g646b8c7d-1focal ceph-mgr=18.2.2-1237-g646b8c7d-1focal ceph-common=18.2.2-1237-g646b8c7d-1focal ceph-fuse=18.2.2-1237-g646b8c7d-1focal ceph-test=18.2.2-1237-g646b8c7d-1focal ceph-volume=18.2.2-1237-g646b8c7d-1focal radosgw=18.2.2-1237-g646b8c7d-1focal python3-rados=18.2.2-1237-g646b8c7d-1focal python3-rgw=18.2.2-1237-g646b8c7d-1focal python3-cephfs=18.2.2-1237-g646b8c7d-1focal python3-rbd=18.2.2-1237-g646b8c7d-1focal libcephfs2=18.2.2-1237-g646b8c7d-1focal libcephfs-dev=18.2.2-1237-g646b8c7d-1focal librados2=18.2.2-1237-g646b8c7d-1focal librbd1=18.2.2-1237-g646b8c7d-1focal rbd-fuse=18.2.2-1237-g646b8c7d-1focal 2024-04-19T02:57:23.529 INFO:teuthology.orchestra.run.smithi144.stdout:Reading package lists... 2024-04-19T02:57:23.556 INFO:teuthology.orchestra.run.smithi134.stdout:Reading package lists... 2024-04-19T02:57:23.579 INFO:teuthology.orchestra.run.smithi096.stdout:Reading package lists... 2024-04-19T02:57:23.582 DEBUG:teuthology.orchestra.run.smithi134:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.2.2-1237-g646b8c7d-1focal cephadm=18.2.2-1237-g646b8c7d-1focal ceph-mds=18.2.2-1237-g646b8c7d-1focal ceph-mgr=18.2.2-1237-g646b8c7d-1focal ceph-common=18.2.2-1237-g646b8c7d-1focal ceph-fuse=18.2.2-1237-g646b8c7d-1focal ceph-test=18.2.2-1237-g646b8c7d-1focal ceph-volume=18.2.2-1237-g646b8c7d-1focal radosgw=18.2.2-1237-g646b8c7d-1focal python3-rados=18.2.2-1237-g646b8c7d-1focal python3-rgw=18.2.2-1237-g646b8c7d-1focal python3-cephfs=18.2.2-1237-g646b8c7d-1focal python3-rbd=18.2.2-1237-g646b8c7d-1focal libcephfs2=18.2.2-1237-g646b8c7d-1focal libcephfs-dev=18.2.2-1237-g646b8c7d-1focal librados2=18.2.2-1237-g646b8c7d-1focal librbd1=18.2.2-1237-g646b8c7d-1focal rbd-fuse=18.2.2-1237-g646b8c7d-1focal 2024-04-19T02:57:23.601 INFO:teuthology.orchestra.run.smithi097.stdout:Reading package lists... 2024-04-19T02:57:23.605 DEBUG:teuthology.orchestra.run.smithi096:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.2.2-1237-g646b8c7d-1focal cephadm=18.2.2-1237-g646b8c7d-1focal ceph-mds=18.2.2-1237-g646b8c7d-1focal ceph-mgr=18.2.2-1237-g646b8c7d-1focal ceph-common=18.2.2-1237-g646b8c7d-1focal ceph-fuse=18.2.2-1237-g646b8c7d-1focal ceph-test=18.2.2-1237-g646b8c7d-1focal ceph-volume=18.2.2-1237-g646b8c7d-1focal radosgw=18.2.2-1237-g646b8c7d-1focal python3-rados=18.2.2-1237-g646b8c7d-1focal python3-rgw=18.2.2-1237-g646b8c7d-1focal python3-cephfs=18.2.2-1237-g646b8c7d-1focal python3-rbd=18.2.2-1237-g646b8c7d-1focal libcephfs2=18.2.2-1237-g646b8c7d-1focal libcephfs-dev=18.2.2-1237-g646b8c7d-1focal librados2=18.2.2-1237-g646b8c7d-1focal librbd1=18.2.2-1237-g646b8c7d-1focal rbd-fuse=18.2.2-1237-g646b8c7d-1focal 2024-04-19T02:57:23.655 INFO:teuthology.orchestra.run.smithi134.stdout:Reading package lists... 2024-04-19T02:57:23.671 INFO:teuthology.orchestra.run.smithi096.stdout:Reading package lists... 2024-04-19T02:57:23.739 INFO:teuthology.orchestra.run.smithi144.stdout:Building dependency tree... 2024-04-19T02:57:23.740 INFO:teuthology.orchestra.run.smithi144.stdout:Reading state information... 2024-04-19T02:57:23.811 INFO:teuthology.orchestra.run.smithi097.stdout:Building dependency tree... 2024-04-19T02:57:23.812 INFO:teuthology.orchestra.run.smithi097.stdout:Reading state information... 2024-04-19T02:57:23.866 INFO:teuthology.orchestra.run.smithi134.stdout:Building dependency tree... 2024-04-19T02:57:23.866 INFO:teuthology.orchestra.run.smithi134.stdout:Reading state information... 2024-04-19T02:57:23.882 INFO:teuthology.orchestra.run.smithi096.stdout:Building dependency tree... 2024-04-19T02:57:23.883 INFO:teuthology.orchestra.run.smithi096.stdout:Reading state information... 2024-04-19T02:57:23.931 INFO:teuthology.orchestra.run.smithi144.stdout:The following packages were automatically installed and are no longer required: 2024-04-19T02:57:23.933 INFO:teuthology.orchestra.run.smithi144.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2024-04-19T02:57:23.933 INFO:teuthology.orchestra.run.smithi144.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-19T02:57:23.933 INFO:teuthology.orchestra.run.smithi144.stdout:The following additional packages will be installed: 2024-04-19T02:57:23.933 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-04-19T02:57:23.935 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd fonts-mathjax jq 2024-04-19T02:57:23.936 INFO:teuthology.orchestra.run.smithi144.stdout: libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc libjs-underscore 2024-04-19T02:57:23.936 INFO:teuthology.orchestra.run.smithi144.stdout: liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 libpcre2-16-0 2024-04-19T02:57:23.936 INFO:teuthology.orchestra.run.smithi144.stdout: libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 libradosstriper1 2024-04-19T02:57:23.936 INFO:teuthology.orchestra.run.smithi144.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 nvme-cli 2024-04-19T02:57:23.936 INFO:teuthology.orchestra.run.smithi144.stdout: python-asyncssh-doc python-natsort-doc python-pastedeploy-tpl 2024-04-19T02:57:23.936 INFO:teuthology.orchestra.run.smithi144.stdout: python3-asyncssh python3-atomicwrites python3-attr python3-bcrypt 2024-04-19T02:57:23.936 INFO:teuthology.orchestra.run.smithi144.stdout: python3-blinker python3-bs4 python3-cachetools python3-ceph-argparse 2024-04-19T02:57:23.936 INFO:teuthology.orchestra.run.smithi144.stdout: python3-ceph-common python3-cherrypy3 python3-cryptography python3-decorator 2024-04-19T02:57:23.936 INFO:teuthology.orchestra.run.smithi144.stdout: python3-google-auth python3-html5lib python3-jinja2 python3-joblib 2024-04-19T02:57:23.936 INFO:teuthology.orchestra.run.smithi144.stdout: python3-jwt python3-kubernetes python3-logutils python3-lxml python3-mako 2024-04-19T02:57:23.936 INFO:teuthology.orchestra.run.smithi144.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-openssl 2024-04-19T02:57:23.936 INFO:teuthology.orchestra.run.smithi144.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2024-04-19T02:57:23.936 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2024-04-19T02:57:23.937 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pytest 2024-04-19T02:57:23.937 INFO:teuthology.orchestra.run.smithi144.stdout: python3-repoze.lru python3-requests-oauthlib python3-routes python3-rsa 2024-04-19T02:57:23.937 INFO:teuthology.orchestra.run.smithi144.stdout: python3-scipy python3-simplegeneric python3-simplejson 2024-04-19T02:57:23.937 INFO:teuthology.orchestra.run.smithi144.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2024-04-19T02:57:23.937 INFO:teuthology.orchestra.run.smithi144.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2024-04-19T02:57:23.937 INFO:teuthology.orchestra.run.smithi144.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2024-04-19T02:57:23.937 INFO:teuthology.orchestra.run.smithi144.stdout: qttranslations5-l10n socat xmlstarlet 2024-04-19T02:57:23.937 INFO:teuthology.orchestra.run.smithi144.stdout:Suggested packages: 2024-04-19T02:57:23.937 INFO:teuthology.orchestra.run.smithi144.stdout: python3-influxdb fonts-mathjax-extras fonts-stix libjs-mathjax-doc 2024-04-19T02:57:23.937 INFO:teuthology.orchestra.run.smithi144.stdout: python-attr-doc python-blinker-doc python-cryptography-doc 2024-04-19T02:57:23.937 INFO:teuthology.orchestra.run.smithi144.stdout: python3-cryptography-vectors python3-genshi python-jinja2-doc python3-crypto 2024-04-19T02:57:23.937 INFO:teuthology.orchestra.run.smithi144.stdout: python3-lxml-dbg python-lxml-doc python3-beaker python-mako-doc 2024-04-19T02:57:23.937 INFO:teuthology.orchestra.run.smithi144.stdout: python-openssl-doc python3-openssl-dbg httpd-wsgi libapache2-mod-python 2024-04-19T02:57:23.937 INFO:teuthology.orchestra.run.smithi144.stdout: libapache2-mod-scgi libjs-mochikit python-pecan-doc python-psutil-doc 2024-04-19T02:57:23.938 INFO:teuthology.orchestra.run.smithi144.stdout: subversion python-pyinotify-doc python-scipy-doc python3-dap 2024-04-19T02:57:23.938 INFO:teuthology.orchestra.run.smithi144.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-04-19T02:57:23.938 INFO:teuthology.orchestra.run.smithi144.stdout: python-webtest-doc python-werkzeug-doc python3-termcolor python3-watchdog 2024-04-19T02:57:23.938 INFO:teuthology.orchestra.run.smithi144.stdout:Recommended packages: 2024-04-19T02:57:23.938 INFO:teuthology.orchestra.run.smithi144.stdout: btrfs-tools 2024-04-19T02:57:24.001 INFO:teuthology.orchestra.run.smithi097.stdout:The following packages were automatically installed and are no longer required: 2024-04-19T02:57:24.003 INFO:teuthology.orchestra.run.smithi097.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2024-04-19T02:57:24.003 INFO:teuthology.orchestra.run.smithi097.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-19T02:57:24.003 INFO:teuthology.orchestra.run.smithi097.stdout:The following additional packages will be installed: 2024-04-19T02:57:24.003 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-04-19T02:57:24.003 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd fonts-mathjax jq 2024-04-19T02:57:24.003 INFO:teuthology.orchestra.run.smithi097.stdout: libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc libjs-underscore 2024-04-19T02:57:24.003 INFO:teuthology.orchestra.run.smithi097.stdout: liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 libpcre2-16-0 2024-04-19T02:57:24.003 INFO:teuthology.orchestra.run.smithi097.stdout: libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 libradosstriper1 2024-04-19T02:57:24.004 INFO:teuthology.orchestra.run.smithi097.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 nvme-cli 2024-04-19T02:57:24.004 INFO:teuthology.orchestra.run.smithi097.stdout: python-asyncssh-doc python-natsort-doc python-pastedeploy-tpl 2024-04-19T02:57:24.004 INFO:teuthology.orchestra.run.smithi097.stdout: python3-asyncssh python3-atomicwrites python3-attr python3-bcrypt 2024-04-19T02:57:24.004 INFO:teuthology.orchestra.run.smithi097.stdout: python3-blinker python3-bs4 python3-cachetools python3-ceph-argparse 2024-04-19T02:57:24.004 INFO:teuthology.orchestra.run.smithi097.stdout: python3-ceph-common python3-cherrypy3 python3-cryptography python3-decorator 2024-04-19T02:57:24.004 INFO:teuthology.orchestra.run.smithi097.stdout: python3-google-auth python3-html5lib python3-jinja2 python3-joblib 2024-04-19T02:57:24.004 INFO:teuthology.orchestra.run.smithi097.stdout: python3-jwt python3-kubernetes python3-logutils python3-lxml python3-mako 2024-04-19T02:57:24.004 INFO:teuthology.orchestra.run.smithi097.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-openssl 2024-04-19T02:57:24.004 INFO:teuthology.orchestra.run.smithi097.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2024-04-19T02:57:24.004 INFO:teuthology.orchestra.run.smithi097.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2024-04-19T02:57:24.005 INFO:teuthology.orchestra.run.smithi097.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pytest 2024-04-19T02:57:24.005 INFO:teuthology.orchestra.run.smithi097.stdout: python3-repoze.lru python3-requests-oauthlib python3-routes python3-rsa 2024-04-19T02:57:24.005 INFO:teuthology.orchestra.run.smithi097.stdout: python3-scipy python3-simplegeneric python3-simplejson 2024-04-19T02:57:24.005 INFO:teuthology.orchestra.run.smithi097.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2024-04-19T02:57:24.005 INFO:teuthology.orchestra.run.smithi097.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2024-04-19T02:57:24.005 INFO:teuthology.orchestra.run.smithi097.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2024-04-19T02:57:24.005 INFO:teuthology.orchestra.run.smithi097.stdout: qttranslations5-l10n socat xmlstarlet 2024-04-19T02:57:24.005 INFO:teuthology.orchestra.run.smithi097.stdout:Suggested packages: 2024-04-19T02:57:24.005 INFO:teuthology.orchestra.run.smithi097.stdout: python3-influxdb fonts-mathjax-extras fonts-stix libjs-mathjax-doc 2024-04-19T02:57:24.006 INFO:teuthology.orchestra.run.smithi097.stdout: python-attr-doc python-blinker-doc python-cryptography-doc 2024-04-19T02:57:24.006 INFO:teuthology.orchestra.run.smithi097.stdout: python3-cryptography-vectors python3-genshi python-jinja2-doc python3-crypto 2024-04-19T02:57:24.006 INFO:teuthology.orchestra.run.smithi097.stdout: python3-lxml-dbg python-lxml-doc python3-beaker python-mako-doc 2024-04-19T02:57:24.006 INFO:teuthology.orchestra.run.smithi097.stdout: python-openssl-doc python3-openssl-dbg httpd-wsgi libapache2-mod-python 2024-04-19T02:57:24.006 INFO:teuthology.orchestra.run.smithi097.stdout: libapache2-mod-scgi libjs-mochikit python-pecan-doc python-psutil-doc 2024-04-19T02:57:24.006 INFO:teuthology.orchestra.run.smithi097.stdout: subversion python-pyinotify-doc python-scipy-doc python3-dap 2024-04-19T02:57:24.006 INFO:teuthology.orchestra.run.smithi097.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-04-19T02:57:24.006 INFO:teuthology.orchestra.run.smithi097.stdout: python-webtest-doc python-werkzeug-doc python3-termcolor python3-watchdog 2024-04-19T02:57:24.006 INFO:teuthology.orchestra.run.smithi097.stdout:Recommended packages: 2024-04-19T02:57:24.006 INFO:teuthology.orchestra.run.smithi097.stdout: btrfs-tools 2024-04-19T02:57:24.049 INFO:teuthology.orchestra.run.smithi144.stdout:The following NEW packages will be installed: 2024-04-19T02:57:24.049 INFO:teuthology.orchestra.run.smithi144.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-04-19T02:57:24.049 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-04-19T02:57:24.049 INFO:teuthology.orchestra.run.smithi144.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-04-19T02:57:24.051 INFO:teuthology.orchestra.run.smithi144.stdout: fonts-mathjax jq libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 2024-04-19T02:57:24.052 INFO:teuthology.orchestra.run.smithi144.stdout: libjs-mathjax libjs-sphinxdoc libjs-underscore liblbfgsb0 liblttng-ust0 2024-04-19T02:57:24.052 INFO:teuthology.orchestra.run.smithi144.stdout: liblua5.3-0 liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-04-19T02:57:24.052 INFO:teuthology.orchestra.run.smithi144.stdout: libqt5network5 librabbitmq4 libradosstriper1 librdkafka1 librgw2 2024-04-19T02:57:24.052 INFO:teuthology.orchestra.run.smithi144.stdout: libsqlite3-mod-ceph libthrift-0.13.0 nvme-cli python-asyncssh-doc 2024-04-19T02:57:24.052 INFO:teuthology.orchestra.run.smithi144.stdout: python-natsort-doc python-pastedeploy-tpl python3-asyncssh 2024-04-19T02:57:24.052 INFO:teuthology.orchestra.run.smithi144.stdout: python3-atomicwrites python3-attr python3-bcrypt python3-blinker python3-bs4 2024-04-19T02:57:24.052 INFO:teuthology.orchestra.run.smithi144.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-04-19T02:57:24.052 INFO:teuthology.orchestra.run.smithi144.stdout: python3-cherrypy3 python3-cryptography python3-decorator python3-google-auth 2024-04-19T02:57:24.052 INFO:teuthology.orchestra.run.smithi144.stdout: python3-html5lib python3-jinja2 python3-joblib python3-jwt 2024-04-19T02:57:24.052 INFO:teuthology.orchestra.run.smithi144.stdout: python3-kubernetes python3-logutils python3-lxml python3-mako 2024-04-19T02:57:24.052 INFO:teuthology.orchestra.run.smithi144.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-openssl 2024-04-19T02:57:24.052 INFO:teuthology.orchestra.run.smithi144.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2024-04-19T02:57:24.052 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2024-04-19T02:57:24.053 INFO:teuthology.orchestra.run.smithi144.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pytest 2024-04-19T02:57:24.053 INFO:teuthology.orchestra.run.smithi144.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests-oauthlib 2024-04-19T02:57:24.053 INFO:teuthology.orchestra.run.smithi144.stdout: python3-rgw python3-routes python3-rsa python3-scipy python3-simplegeneric 2024-04-19T02:57:24.053 INFO:teuthology.orchestra.run.smithi144.stdout: python3-simplejson python3-singledispatch python3-sklearn 2024-04-19T02:57:24.053 INFO:teuthology.orchestra.run.smithi144.stdout: python3-sklearn-lib python3-soupsieve python3-tempita python3-waitress 2024-04-19T02:57:24.053 INFO:teuthology.orchestra.run.smithi144.stdout: python3-wcwidth python3-webencodings python3-webob python3-websocket 2024-04-19T02:57:24.053 INFO:teuthology.orchestra.run.smithi144.stdout: python3-webtest python3-werkzeug qttranslations5-l10n radosgw rbd-fuse socat 2024-04-19T02:57:24.053 INFO:teuthology.orchestra.run.smithi144.stdout: xmlstarlet 2024-04-19T02:57:24.053 INFO:teuthology.orchestra.run.smithi144.stdout:The following packages will be upgraded: 2024-04-19T02:57:24.054 INFO:teuthology.orchestra.run.smithi144.stdout: librados2 librbd1 2024-04-19T02:57:24.055 INFO:teuthology.orchestra.run.smithi134.stdout:The following packages were automatically installed and are no longer required: 2024-04-19T02:57:24.055 INFO:teuthology.orchestra.run.smithi134.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2024-04-19T02:57:24.055 INFO:teuthology.orchestra.run.smithi134.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-19T02:57:24.055 INFO:teuthology.orchestra.run.smithi134.stdout:The following additional packages will be installed: 2024-04-19T02:57:24.055 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-04-19T02:57:24.055 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd fonts-mathjax jq 2024-04-19T02:57:24.055 INFO:teuthology.orchestra.run.smithi134.stdout: libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc libjs-underscore 2024-04-19T02:57:24.055 INFO:teuthology.orchestra.run.smithi134.stdout: liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 libpcre2-16-0 2024-04-19T02:57:24.055 INFO:teuthology.orchestra.run.smithi134.stdout: libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 libradosstriper1 2024-04-19T02:57:24.056 INFO:teuthology.orchestra.run.smithi134.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 nvme-cli 2024-04-19T02:57:24.057 INFO:teuthology.orchestra.run.smithi134.stdout: python-asyncssh-doc python-natsort-doc python-pastedeploy-tpl 2024-04-19T02:57:24.057 INFO:teuthology.orchestra.run.smithi134.stdout: python3-asyncssh python3-atomicwrites python3-attr python3-bcrypt 2024-04-19T02:57:24.057 INFO:teuthology.orchestra.run.smithi134.stdout: python3-blinker python3-bs4 python3-cachetools python3-ceph-argparse 2024-04-19T02:57:24.057 INFO:teuthology.orchestra.run.smithi134.stdout: python3-ceph-common python3-cherrypy3 python3-cryptography python3-decorator 2024-04-19T02:57:24.057 INFO:teuthology.orchestra.run.smithi134.stdout: python3-google-auth python3-html5lib python3-jinja2 python3-joblib 2024-04-19T02:57:24.057 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jwt python3-kubernetes python3-logutils python3-lxml python3-mako 2024-04-19T02:57:24.057 INFO:teuthology.orchestra.run.smithi134.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-openssl 2024-04-19T02:57:24.057 INFO:teuthology.orchestra.run.smithi134.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2024-04-19T02:57:24.058 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2024-04-19T02:57:24.058 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pytest 2024-04-19T02:57:24.058 INFO:teuthology.orchestra.run.smithi134.stdout: python3-repoze.lru python3-requests-oauthlib python3-routes python3-rsa 2024-04-19T02:57:24.058 INFO:teuthology.orchestra.run.smithi134.stdout: python3-scipy python3-simplegeneric python3-simplejson 2024-04-19T02:57:24.058 INFO:teuthology.orchestra.run.smithi134.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2024-04-19T02:57:24.058 INFO:teuthology.orchestra.run.smithi134.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2024-04-19T02:57:24.058 INFO:teuthology.orchestra.run.smithi134.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2024-04-19T02:57:24.058 INFO:teuthology.orchestra.run.smithi134.stdout: qttranslations5-l10n socat xmlstarlet 2024-04-19T02:57:24.058 INFO:teuthology.orchestra.run.smithi134.stdout:Suggested packages: 2024-04-19T02:57:24.058 INFO:teuthology.orchestra.run.smithi134.stdout: python3-influxdb fonts-mathjax-extras fonts-stix libjs-mathjax-doc 2024-04-19T02:57:24.058 INFO:teuthology.orchestra.run.smithi134.stdout: python-attr-doc python-blinker-doc python-cryptography-doc 2024-04-19T02:57:24.058 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cryptography-vectors python3-genshi python-jinja2-doc python3-crypto 2024-04-19T02:57:24.058 INFO:teuthology.orchestra.run.smithi134.stdout: python3-lxml-dbg python-lxml-doc python3-beaker python-mako-doc 2024-04-19T02:57:24.059 INFO:teuthology.orchestra.run.smithi134.stdout: python-openssl-doc python3-openssl-dbg httpd-wsgi libapache2-mod-python 2024-04-19T02:57:24.059 INFO:teuthology.orchestra.run.smithi134.stdout: libapache2-mod-scgi libjs-mochikit python-pecan-doc python-psutil-doc 2024-04-19T02:57:24.059 INFO:teuthology.orchestra.run.smithi134.stdout: subversion python-pyinotify-doc python-scipy-doc python3-dap 2024-04-19T02:57:24.059 INFO:teuthology.orchestra.run.smithi134.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-04-19T02:57:24.059 INFO:teuthology.orchestra.run.smithi134.stdout: python-webtest-doc python-werkzeug-doc python3-termcolor python3-watchdog 2024-04-19T02:57:24.059 INFO:teuthology.orchestra.run.smithi134.stdout:Recommended packages: 2024-04-19T02:57:24.059 INFO:teuthology.orchestra.run.smithi134.stdout: btrfs-tools 2024-04-19T02:57:24.079 INFO:teuthology.orchestra.run.smithi096.stdout:The following packages were automatically installed and are no longer required: 2024-04-19T02:57:24.080 INFO:teuthology.orchestra.run.smithi096.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2024-04-19T02:57:24.080 INFO:teuthology.orchestra.run.smithi096.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-19T02:57:24.080 INFO:teuthology.orchestra.run.smithi096.stdout:The following additional packages will be installed: 2024-04-19T02:57:24.080 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-04-19T02:57:24.081 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd fonts-mathjax jq 2024-04-19T02:57:24.081 INFO:teuthology.orchestra.run.smithi096.stdout: libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc libjs-underscore 2024-04-19T02:57:24.081 INFO:teuthology.orchestra.run.smithi096.stdout: liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 libpcre2-16-0 2024-04-19T02:57:24.081 INFO:teuthology.orchestra.run.smithi096.stdout: libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 libradosstriper1 2024-04-19T02:57:24.081 INFO:teuthology.orchestra.run.smithi096.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 nvme-cli 2024-04-19T02:57:24.081 INFO:teuthology.orchestra.run.smithi096.stdout: python-asyncssh-doc python-natsort-doc python-pastedeploy-tpl 2024-04-19T02:57:24.081 INFO:teuthology.orchestra.run.smithi096.stdout: python3-asyncssh python3-atomicwrites python3-attr python3-bcrypt 2024-04-19T02:57:24.081 INFO:teuthology.orchestra.run.smithi096.stdout: python3-blinker python3-bs4 python3-cachetools python3-ceph-argparse 2024-04-19T02:57:24.081 INFO:teuthology.orchestra.run.smithi096.stdout: python3-ceph-common python3-cherrypy3 python3-cryptography python3-decorator 2024-04-19T02:57:24.082 INFO:teuthology.orchestra.run.smithi096.stdout: python3-google-auth python3-html5lib python3-jinja2 python3-joblib 2024-04-19T02:57:24.082 INFO:teuthology.orchestra.run.smithi096.stdout: python3-jwt python3-kubernetes python3-logutils python3-lxml python3-mako 2024-04-19T02:57:24.082 INFO:teuthology.orchestra.run.smithi096.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-openssl 2024-04-19T02:57:24.082 INFO:teuthology.orchestra.run.smithi096.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2024-04-19T02:57:24.082 INFO:teuthology.orchestra.run.smithi096.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2024-04-19T02:57:24.082 INFO:teuthology.orchestra.run.smithi096.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pytest 2024-04-19T02:57:24.082 INFO:teuthology.orchestra.run.smithi096.stdout: python3-repoze.lru python3-requests-oauthlib python3-routes python3-rsa 2024-04-19T02:57:24.082 INFO:teuthology.orchestra.run.smithi096.stdout: python3-scipy python3-simplegeneric python3-simplejson 2024-04-19T02:57:24.082 INFO:teuthology.orchestra.run.smithi096.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2024-04-19T02:57:24.082 INFO:teuthology.orchestra.run.smithi096.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2024-04-19T02:57:24.082 INFO:teuthology.orchestra.run.smithi096.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2024-04-19T02:57:24.082 INFO:teuthology.orchestra.run.smithi096.stdout: qttranslations5-l10n socat xmlstarlet 2024-04-19T02:57:24.083 INFO:teuthology.orchestra.run.smithi096.stdout:Suggested packages: 2024-04-19T02:57:24.083 INFO:teuthology.orchestra.run.smithi096.stdout: python3-influxdb fonts-mathjax-extras fonts-stix libjs-mathjax-doc 2024-04-19T02:57:24.083 INFO:teuthology.orchestra.run.smithi096.stdout: python-attr-doc python-blinker-doc python-cryptography-doc 2024-04-19T02:57:24.083 INFO:teuthology.orchestra.run.smithi096.stdout: python3-cryptography-vectors python3-genshi python-jinja2-doc python3-crypto 2024-04-19T02:57:24.083 INFO:teuthology.orchestra.run.smithi096.stdout: python3-lxml-dbg python-lxml-doc python3-beaker python-mako-doc 2024-04-19T02:57:24.083 INFO:teuthology.orchestra.run.smithi096.stdout: python-openssl-doc python3-openssl-dbg httpd-wsgi libapache2-mod-python 2024-04-19T02:57:24.083 INFO:teuthology.orchestra.run.smithi096.stdout: libapache2-mod-scgi libjs-mochikit python-pecan-doc python-psutil-doc 2024-04-19T02:57:24.083 INFO:teuthology.orchestra.run.smithi096.stdout: subversion python-pyinotify-doc python-scipy-doc python3-dap 2024-04-19T02:57:24.083 INFO:teuthology.orchestra.run.smithi096.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-04-19T02:57:24.083 INFO:teuthology.orchestra.run.smithi096.stdout: python-webtest-doc python-werkzeug-doc python3-termcolor python3-watchdog 2024-04-19T02:57:24.083 INFO:teuthology.orchestra.run.smithi096.stdout:Recommended packages: 2024-04-19T02:57:24.083 INFO:teuthology.orchestra.run.smithi096.stdout: btrfs-tools 2024-04-19T02:57:24.125 INFO:teuthology.orchestra.run.smithi097.stdout:The following NEW packages will be installed: 2024-04-19T02:57:24.125 INFO:teuthology.orchestra.run.smithi097.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-04-19T02:57:24.125 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-04-19T02:57:24.125 INFO:teuthology.orchestra.run.smithi097.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-04-19T02:57:24.125 INFO:teuthology.orchestra.run.smithi097.stdout: fonts-mathjax jq libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 2024-04-19T02:57:24.125 INFO:teuthology.orchestra.run.smithi097.stdout: libjs-mathjax libjs-sphinxdoc libjs-underscore liblbfgsb0 liblttng-ust0 2024-04-19T02:57:24.126 INFO:teuthology.orchestra.run.smithi097.stdout: liblua5.3-0 liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-04-19T02:57:24.126 INFO:teuthology.orchestra.run.smithi097.stdout: libqt5network5 librabbitmq4 libradosstriper1 librdkafka1 librgw2 2024-04-19T02:57:24.126 INFO:teuthology.orchestra.run.smithi097.stdout: libsqlite3-mod-ceph libthrift-0.13.0 nvme-cli python-asyncssh-doc 2024-04-19T02:57:24.127 INFO:teuthology.orchestra.run.smithi097.stdout: python-natsort-doc python-pastedeploy-tpl python3-asyncssh 2024-04-19T02:57:24.127 INFO:teuthology.orchestra.run.smithi097.stdout: python3-atomicwrites python3-attr python3-bcrypt python3-blinker python3-bs4 2024-04-19T02:57:24.127 INFO:teuthology.orchestra.run.smithi097.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-04-19T02:57:24.127 INFO:teuthology.orchestra.run.smithi097.stdout: python3-cherrypy3 python3-cryptography python3-decorator python3-google-auth 2024-04-19T02:57:24.127 INFO:teuthology.orchestra.run.smithi097.stdout: python3-html5lib python3-jinja2 python3-joblib python3-jwt 2024-04-19T02:57:24.127 INFO:teuthology.orchestra.run.smithi097.stdout: python3-kubernetes python3-logutils python3-lxml python3-mako 2024-04-19T02:57:24.127 INFO:teuthology.orchestra.run.smithi097.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-openssl 2024-04-19T02:57:24.127 INFO:teuthology.orchestra.run.smithi097.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2024-04-19T02:57:24.127 INFO:teuthology.orchestra.run.smithi097.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2024-04-19T02:57:24.127 INFO:teuthology.orchestra.run.smithi097.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pytest 2024-04-19T02:57:24.127 INFO:teuthology.orchestra.run.smithi097.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests-oauthlib 2024-04-19T02:57:24.127 INFO:teuthology.orchestra.run.smithi097.stdout: python3-rgw python3-routes python3-rsa python3-scipy python3-simplegeneric 2024-04-19T02:57:24.127 INFO:teuthology.orchestra.run.smithi097.stdout: python3-simplejson python3-singledispatch python3-sklearn 2024-04-19T02:57:24.127 INFO:teuthology.orchestra.run.smithi097.stdout: python3-sklearn-lib python3-soupsieve python3-tempita python3-waitress 2024-04-19T02:57:24.127 INFO:teuthology.orchestra.run.smithi097.stdout: python3-wcwidth python3-webencodings python3-webob python3-websocket 2024-04-19T02:57:24.128 INFO:teuthology.orchestra.run.smithi097.stdout: python3-webtest python3-werkzeug qttranslations5-l10n radosgw rbd-fuse socat 2024-04-19T02:57:24.128 INFO:teuthology.orchestra.run.smithi097.stdout: xmlstarlet 2024-04-19T02:57:24.128 INFO:teuthology.orchestra.run.smithi097.stdout:The following packages will be upgraded: 2024-04-19T02:57:24.128 INFO:teuthology.orchestra.run.smithi097.stdout: librados2 librbd1 2024-04-19T02:57:24.176 INFO:teuthology.orchestra.run.smithi134.stdout:The following NEW packages will be installed: 2024-04-19T02:57:24.176 INFO:teuthology.orchestra.run.smithi134.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-04-19T02:57:24.176 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-04-19T02:57:24.176 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-04-19T02:57:24.176 INFO:teuthology.orchestra.run.smithi134.stdout: fonts-mathjax jq libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 2024-04-19T02:57:24.177 INFO:teuthology.orchestra.run.smithi134.stdout: libjs-mathjax libjs-sphinxdoc libjs-underscore liblbfgsb0 liblttng-ust0 2024-04-19T02:57:24.177 INFO:teuthology.orchestra.run.smithi134.stdout: liblua5.3-0 liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-04-19T02:57:24.177 INFO:teuthology.orchestra.run.smithi134.stdout: libqt5network5 librabbitmq4 libradosstriper1 librdkafka1 librgw2 2024-04-19T02:57:24.178 INFO:teuthology.orchestra.run.smithi134.stdout: libsqlite3-mod-ceph libthrift-0.13.0 nvme-cli python-asyncssh-doc 2024-04-19T02:57:24.178 INFO:teuthology.orchestra.run.smithi134.stdout: python-natsort-doc python-pastedeploy-tpl python3-asyncssh 2024-04-19T02:57:24.178 INFO:teuthology.orchestra.run.smithi134.stdout: python3-atomicwrites python3-attr python3-bcrypt python3-blinker python3-bs4 2024-04-19T02:57:24.178 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-04-19T02:57:24.178 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cherrypy3 python3-cryptography python3-decorator python3-google-auth 2024-04-19T02:57:24.178 INFO:teuthology.orchestra.run.smithi134.stdout: python3-html5lib python3-jinja2 python3-joblib python3-jwt 2024-04-19T02:57:24.178 INFO:teuthology.orchestra.run.smithi134.stdout: python3-kubernetes python3-logutils python3-lxml python3-mako 2024-04-19T02:57:24.178 INFO:teuthology.orchestra.run.smithi134.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-openssl 2024-04-19T02:57:24.178 INFO:teuthology.orchestra.run.smithi134.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2024-04-19T02:57:24.178 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2024-04-19T02:57:24.178 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pytest 2024-04-19T02:57:24.178 INFO:teuthology.orchestra.run.smithi134.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests-oauthlib 2024-04-19T02:57:24.179 INFO:teuthology.orchestra.run.smithi134.stdout: python3-rgw python3-routes python3-rsa python3-scipy python3-simplegeneric 2024-04-19T02:57:24.179 INFO:teuthology.orchestra.run.smithi134.stdout: python3-simplejson python3-singledispatch python3-sklearn 2024-04-19T02:57:24.179 INFO:teuthology.orchestra.run.smithi134.stdout: python3-sklearn-lib python3-soupsieve python3-tempita python3-waitress 2024-04-19T02:57:24.179 INFO:teuthology.orchestra.run.smithi134.stdout: python3-wcwidth python3-webencodings python3-webob python3-websocket 2024-04-19T02:57:24.179 INFO:teuthology.orchestra.run.smithi134.stdout: python3-webtest python3-werkzeug qttranslations5-l10n radosgw rbd-fuse socat 2024-04-19T02:57:24.179 INFO:teuthology.orchestra.run.smithi134.stdout: xmlstarlet 2024-04-19T02:57:24.179 INFO:teuthology.orchestra.run.smithi134.stdout:The following packages will be upgraded: 2024-04-19T02:57:24.179 INFO:teuthology.orchestra.run.smithi134.stdout: librados2 librbd1 2024-04-19T02:57:24.198 INFO:teuthology.orchestra.run.smithi097.stdout:2 upgraded, 110 newly installed, 0 to remove and 277 not upgraded. 2024-04-19T02:57:24.199 INFO:teuthology.orchestra.run.smithi097.stdout:Need to get 198 MB of archives. 2024-04-19T02:57:24.199 INFO:teuthology.orchestra.run.smithi097.stdout:After this operation, 975 MB of additional disk space will be used. 2024-04-19T02:57:24.199 INFO:teuthology.orchestra.run.smithi097.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal/main amd64 liblttng-ust0 amd64 2.11.0-1 [160 kB] 2024-04-19T02:57:24.205 INFO:teuthology.orchestra.run.smithi096.stdout:The following NEW packages will be installed: 2024-04-19T02:57:24.205 INFO:teuthology.orchestra.run.smithi096.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-04-19T02:57:24.205 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-04-19T02:57:24.205 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-04-19T02:57:24.206 INFO:teuthology.orchestra.run.smithi144.stdout:2 upgraded, 110 newly installed, 0 to remove and 277 not upgraded. 2024-04-19T02:57:24.206 INFO:teuthology.orchestra.run.smithi144.stdout:Need to get 198 MB of archives. 2024-04-19T02:57:24.206 INFO:teuthology.orchestra.run.smithi144.stdout:After this operation, 975 MB of additional disk space will be used. 2024-04-19T02:57:24.206 INFO:teuthology.orchestra.run.smithi144.stdout:Get:1 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 librbd1 amd64 18.2.2-1237-g646b8c7d-1focal [3,444 kB] 2024-04-19T02:57:24.207 INFO:teuthology.orchestra.run.smithi096.stdout: fonts-mathjax jq libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 2024-04-19T02:57:24.207 INFO:teuthology.orchestra.run.smithi096.stdout: libjs-mathjax libjs-sphinxdoc libjs-underscore liblbfgsb0 liblttng-ust0 2024-04-19T02:57:24.207 INFO:teuthology.orchestra.run.smithi096.stdout: liblua5.3-0 liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-04-19T02:57:24.207 INFO:teuthology.orchestra.run.smithi096.stdout: libqt5network5 librabbitmq4 libradosstriper1 librdkafka1 librgw2 2024-04-19T02:57:24.207 INFO:teuthology.orchestra.run.smithi096.stdout: libsqlite3-mod-ceph libthrift-0.13.0 nvme-cli python-asyncssh-doc 2024-04-19T02:57:24.207 INFO:teuthology.orchestra.run.smithi096.stdout: python-natsort-doc python-pastedeploy-tpl python3-asyncssh 2024-04-19T02:57:24.207 INFO:teuthology.orchestra.run.smithi096.stdout: python3-atomicwrites python3-attr python3-bcrypt python3-blinker python3-bs4 2024-04-19T02:57:24.208 INFO:teuthology.orchestra.run.smithi096.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-04-19T02:57:24.208 INFO:teuthology.orchestra.run.smithi096.stdout: python3-cherrypy3 python3-cryptography python3-decorator python3-google-auth 2024-04-19T02:57:24.208 INFO:teuthology.orchestra.run.smithi096.stdout: python3-html5lib python3-jinja2 python3-joblib python3-jwt 2024-04-19T02:57:24.208 INFO:teuthology.orchestra.run.smithi096.stdout: python3-kubernetes python3-logutils python3-lxml python3-mako 2024-04-19T02:57:24.208 INFO:teuthology.orchestra.run.smithi096.stdout: python3-markupsafe python3-natsort python3-oauthlib python3-openssl 2024-04-19T02:57:24.208 INFO:teuthology.orchestra.run.smithi096.stdout: python3-packaging python3-paste python3-pastedeploy python3-pastescript 2024-04-19T02:57:24.208 INFO:teuthology.orchestra.run.smithi096.stdout: python3-pecan python3-pluggy python3-prettytable python3-psutil python3-py 2024-04-19T02:57:24.208 INFO:teuthology.orchestra.run.smithi096.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pytest 2024-04-19T02:57:24.208 INFO:teuthology.orchestra.run.smithi096.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests-oauthlib 2024-04-19T02:57:24.208 INFO:teuthology.orchestra.run.smithi096.stdout: python3-rgw python3-routes python3-rsa python3-scipy python3-simplegeneric 2024-04-19T02:57:24.208 INFO:teuthology.orchestra.run.smithi096.stdout: python3-simplejson python3-singledispatch python3-sklearn 2024-04-19T02:57:24.208 INFO:teuthology.orchestra.run.smithi096.stdout: python3-sklearn-lib python3-soupsieve python3-tempita python3-waitress 2024-04-19T02:57:24.209 INFO:teuthology.orchestra.run.smithi096.stdout: python3-wcwidth python3-webencodings python3-webob python3-websocket 2024-04-19T02:57:24.209 INFO:teuthology.orchestra.run.smithi096.stdout: python3-webtest python3-werkzeug qttranslations5-l10n radosgw rbd-fuse socat 2024-04-19T02:57:24.209 INFO:teuthology.orchestra.run.smithi096.stdout: xmlstarlet 2024-04-19T02:57:24.209 INFO:teuthology.orchestra.run.smithi096.stdout:The following packages will be upgraded: 2024-04-19T02:57:24.209 INFO:teuthology.orchestra.run.smithi096.stdout: librados2 librbd1 2024-04-19T02:57:24.247 INFO:teuthology.orchestra.run.smithi144.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal/main amd64 liblttng-ust0 amd64 2.11.0-1 [160 kB] 2024-04-19T02:57:24.249 INFO:teuthology.orchestra.run.smithi134.stdout:2 upgraded, 110 newly installed, 0 to remove and 277 not upgraded. 2024-04-19T02:57:24.249 INFO:teuthology.orchestra.run.smithi134.stdout:Need to get 198 MB of archives. 2024-04-19T02:57:24.249 INFO:teuthology.orchestra.run.smithi134.stdout:After this operation, 975 MB of additional disk space will be used. 2024-04-19T02:57:24.249 INFO:teuthology.orchestra.run.smithi134.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal/main amd64 liblttng-ust0 amd64 2.11.0-1 [160 kB] 2024-04-19T02:57:24.299 INFO:teuthology.orchestra.run.smithi097.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal/universe amd64 libdouble-conversion3 amd64 3.1.5-4ubuntu1 [37.9 kB] 2024-04-19T02:57:24.302 INFO:teuthology.orchestra.run.smithi097.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libpcre2-16-0 amd64 10.34-7ubuntu0.1 [181 kB] 2024-04-19T02:57:24.324 INFO:teuthology.orchestra.run.smithi097.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5core5a amd64 5.12.8+dfsg-0ubuntu2.1 [2,006 kB] 2024-04-19T02:57:24.345 INFO:teuthology.orchestra.run.smithi134.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal/universe amd64 libdouble-conversion3 amd64 3.1.5-4ubuntu1 [37.9 kB] 2024-04-19T02:57:24.348 INFO:teuthology.orchestra.run.smithi134.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libpcre2-16-0 amd64 10.34-7ubuntu0.1 [181 kB] 2024-04-19T02:57:24.359 INFO:teuthology.orchestra.run.smithi097.stdout:Get:5 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 librbd1 amd64 18.2.2-1237-g646b8c7d-1focal [3,444 kB] 2024-04-19T02:57:24.370 INFO:teuthology.orchestra.run.smithi134.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5core5a amd64 5.12.8+dfsg-0ubuntu2.1 [2,006 kB] 2024-04-19T02:57:24.378 INFO:teuthology.orchestra.run.smithi096.stdout:2 upgraded, 110 newly installed, 0 to remove and 277 not upgraded. 2024-04-19T02:57:24.378 INFO:teuthology.orchestra.run.smithi096.stdout:Need to get 198 MB of archives. 2024-04-19T02:57:24.379 INFO:teuthology.orchestra.run.smithi096.stdout:After this operation, 975 MB of additional disk space will be used. 2024-04-19T02:57:24.379 INFO:teuthology.orchestra.run.smithi096.stdout:Get:1 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 librbd1 amd64 18.2.2-1237-g646b8c7d-1focal [3,444 kB] 2024-04-19T02:57:24.387 INFO:teuthology.orchestra.run.smithi097.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5dbus5 amd64 5.12.8+dfsg-0ubuntu2.1 [208 kB] 2024-04-19T02:57:24.390 INFO:teuthology.orchestra.run.smithi097.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5network5 amd64 5.12.8+dfsg-0ubuntu2.1 [673 kB] 2024-04-19T02:57:24.398 INFO:teuthology.orchestra.run.smithi097.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/universe amd64 libthrift-0.13.0 amd64 0.13.0-2build2 [249 kB] 2024-04-19T02:57:24.401 INFO:teuthology.orchestra.run.smithi097.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-prettytable all 0.7.2-5 [20.1 kB] 2024-04-19T02:57:24.401 INFO:teuthology.orchestra.run.smithi097.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal/main amd64 liblua5.3-0 amd64 5.3.3-1.1ubuntu2 [116 kB] 2024-04-19T02:57:24.401 INFO:teuthology.orchestra.run.smithi096.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal/main amd64 liblttng-ust0 amd64 2.11.0-1 [160 kB] 2024-04-19T02:57:24.402 INFO:teuthology.orchestra.run.smithi097.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal/main amd64 librabbitmq4 amd64 0.10.0-1 [35.8 kB] 2024-04-19T02:57:24.402 INFO:teuthology.orchestra.run.smithi097.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal/universe amd64 librdkafka1 amd64 1.2.1-1ubuntu1 [410 kB] 2024-04-19T02:57:24.407 INFO:teuthology.orchestra.run.smithi097.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal/main amd64 liboath0 amd64 2.6.1-1.3 [44.7 kB] 2024-04-19T02:57:24.407 INFO:teuthology.orchestra.run.smithi097.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cherrypy3 all 8.9.1-6 [160 kB] 2024-04-19T02:57:24.409 INFO:teuthology.orchestra.run.smithi097.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-natsort all 7.0.1-1 [29.2 kB] 2024-04-19T02:57:24.413 INFO:teuthology.orchestra.run.smithi144.stdout:Get:3 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 librados2 amd64 18.2.2-1237-g646b8c7d-1focal [4,030 kB] 2024-04-19T02:57:24.416 INFO:teuthology.orchestra.run.smithi134.stdout:Get:5 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 librbd1 amd64 18.2.2-1237-g646b8c7d-1focal [3,444 kB] 2024-04-19T02:57:24.430 INFO:teuthology.orchestra.run.smithi097.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-logutils all 0.3.3-7 [17.3 kB] 2024-04-19T02:57:24.431 INFO:teuthology.orchestra.run.smithi097.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-markupsafe amd64 1.1.0-1build2 [13.9 kB] 2024-04-19T02:57:24.432 INFO:teuthology.orchestra.run.smithi097.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-mako all 1.1.0+ds1-1ubuntu2.1 [59.2 kB] 2024-04-19T02:57:24.433 INFO:teuthology.orchestra.run.smithi134.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5dbus5 amd64 5.12.8+dfsg-0ubuntu2.1 [208 kB] 2024-04-19T02:57:24.434 INFO:teuthology.orchestra.run.smithi097.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-04-19T02:57:24.434 INFO:teuthology.orchestra.run.smithi097.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-singledispatch all 3.4.0.3-2build1 [7,128 B] 2024-04-19T02:57:24.435 INFO:teuthology.orchestra.run.smithi097.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webob all 1:1.8.5-2 [84.4 kB] 2024-04-19T02:57:24.437 INFO:teuthology.orchestra.run.smithi134.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5network5 amd64 5.12.8+dfsg-0ubuntu2.1 [673 kB] 2024-04-19T02:57:24.438 INFO:teuthology.orchestra.run.smithi097.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-soupsieve all 1.9.5+dfsg-1 [29.1 kB] 2024-04-19T02:57:24.438 INFO:teuthology.orchestra.run.smithi097.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bs4 all 4.8.2-1 [83.0 kB] 2024-04-19T02:57:24.439 INFO:teuthology.orchestra.run.smithi097.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-waitress all 1.4.1-1ubuntu0.1 [81.4 kB] 2024-04-19T02:57:24.444 INFO:teuthology.orchestra.run.smithi134.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/universe amd64 libthrift-0.13.0 amd64 0.13.0-2build2 [249 kB] 2024-04-19T02:57:24.446 INFO:teuthology.orchestra.run.smithi134.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-prettytable all 0.7.2-5 [20.1 kB] 2024-04-19T02:57:24.446 INFO:teuthology.orchestra.run.smithi134.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal/main amd64 liblua5.3-0 amd64 5.3.3-1.1ubuntu2 [116 kB] 2024-04-19T02:57:24.447 INFO:teuthology.orchestra.run.smithi134.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal/main amd64 librabbitmq4 amd64 0.10.0-1 [35.8 kB] 2024-04-19T02:57:24.447 INFO:teuthology.orchestra.run.smithi134.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal/universe amd64 librdkafka1 amd64 1.2.1-1ubuntu1 [410 kB] 2024-04-19T02:57:24.450 INFO:teuthology.orchestra.run.smithi134.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal/main amd64 liboath0 amd64 2.6.1-1.3 [44.7 kB] 2024-04-19T02:57:24.450 INFO:teuthology.orchestra.run.smithi134.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cherrypy3 all 8.9.1-6 [160 kB] 2024-04-19T02:57:24.452 INFO:teuthology.orchestra.run.smithi097.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-tempita all 0.5.2-6 [14.8 kB] 2024-04-19T02:57:24.453 INFO:teuthology.orchestra.run.smithi134.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-natsort all 7.0.1-1 [29.2 kB] 2024-04-19T02:57:24.461 INFO:teuthology.orchestra.run.smithi097.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-paste all 3.4.0+dfsg1-1 [456 kB] 2024-04-19T02:57:24.469 INFO:teuthology.orchestra.run.smithi097.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 python-pastedeploy-tpl all 2.1.0-1 [5,016 B] 2024-04-19T02:57:24.470 INFO:teuthology.orchestra.run.smithi097.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastedeploy all 2.1.0-1 [26.5 kB] 2024-04-19T02:57:24.470 INFO:teuthology.orchestra.run.smithi097.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webtest all 2.0.32-2 [28.2 kB] 2024-04-19T02:57:24.470 INFO:teuthology.orchestra.run.smithi097.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pecan all 1.3.3-3ubuntu1 [85.8 kB] 2024-04-19T02:57:24.472 INFO:teuthology.orchestra.run.smithi097.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-werkzeug all 0.16.1+dfsg1-2ubuntu0.1 [183 kB] 2024-04-19T02:57:24.472 INFO:teuthology.orchestra.run.smithi134.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-logutils all 0.3.3-7 [17.3 kB] 2024-04-19T02:57:24.473 INFO:teuthology.orchestra.run.smithi134.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-markupsafe amd64 1.1.0-1build2 [13.9 kB] 2024-04-19T02:57:24.473 INFO:teuthology.orchestra.run.smithi134.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-mako all 1.1.0+ds1-1ubuntu2.1 [59.2 kB] 2024-04-19T02:57:24.475 INFO:teuthology.orchestra.run.smithi097.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-cryptography amd64 2.8-3ubuntu0.3 [211 kB] 2024-04-19T02:57:24.475 INFO:teuthology.orchestra.run.smithi134.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-04-19T02:57:24.476 INFO:teuthology.orchestra.run.smithi134.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-singledispatch all 3.4.0.3-2build1 [7,128 B] 2024-04-19T02:57:24.476 INFO:teuthology.orchestra.run.smithi134.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webob all 1:1.8.5-2 [84.4 kB] 2024-04-19T02:57:24.477 INFO:teuthology.orchestra.run.smithi097.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-openssl all 19.0.0-1build1 [43.3 kB] 2024-04-19T02:57:24.477 INFO:teuthology.orchestra.run.smithi097.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-asyncssh all 1.12.2-1 [152 kB] 2024-04-19T02:57:24.478 INFO:teuthology.orchestra.run.smithi134.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-soupsieve all 1.9.5+dfsg-1 [29.1 kB] 2024-04-19T02:57:24.479 INFO:teuthology.orchestra.run.smithi134.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bs4 all 4.8.2-1 [83.0 kB] 2024-04-19T02:57:24.481 INFO:teuthology.orchestra.run.smithi134.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-waitress all 1.4.1-1ubuntu0.1 [81.4 kB] 2024-04-19T02:57:24.495 INFO:teuthology.orchestra.run.smithi097.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-jinja2 all 2.10.1-2ubuntu0.2 [95.9 kB] 2024-04-19T02:57:24.496 INFO:teuthology.orchestra.run.smithi097.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bcrypt amd64 3.1.7-2ubuntu1 [30.4 kB] 2024-04-19T02:57:24.497 INFO:teuthology.orchestra.run.smithi097.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-jwt all 1.7.1-2ubuntu2.1 [18.0 kB] 2024-04-19T02:57:24.497 INFO:teuthology.orchestra.run.smithi134.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-tempita all 0.5.2-6 [14.8 kB] 2024-04-19T02:57:24.497 INFO:teuthology.orchestra.run.smithi134.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-paste all 3.4.0+dfsg1-1 [456 kB] 2024-04-19T02:57:24.498 INFO:teuthology.orchestra.run.smithi097.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-attr all 19.3.0-2 [33.9 kB] 2024-04-19T02:57:24.498 INFO:teuthology.orchestra.run.smithi097.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pluggy all 0.13.0-2 [18.4 kB] 2024-04-19T02:57:24.498 INFO:teuthology.orchestra.run.smithi097.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 python3-py all 1.8.1-1ubuntu0.1 [65.6 kB] 2024-04-19T02:57:24.502 INFO:teuthology.orchestra.run.smithi134.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 python-pastedeploy-tpl all 2.1.0-1 [5,016 B] 2024-04-19T02:57:24.517 INFO:teuthology.orchestra.run.smithi097.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-atomicwrites all 1.1.5-2build1 [7,016 B] 2024-04-19T02:57:24.517 INFO:teuthology.orchestra.run.smithi097.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-packaging all 20.3-1 [26.8 kB] 2024-04-19T02:57:24.518 INFO:teuthology.orchestra.run.smithi097.stdout:Get:43 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-wcwidth all 0.1.8+dfsg1-3 [17.4 kB] 2024-04-19T02:57:24.519 INFO:teuthology.orchestra.run.smithi097.stdout:Get:44 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pytest all 4.6.9-1 [178 kB] 2024-04-19T02:57:24.520 INFO:teuthology.orchestra.run.smithi134.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastedeploy all 2.1.0-1 [26.5 kB] 2024-04-19T02:57:24.522 INFO:teuthology.orchestra.run.smithi134.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webtest all 2.0.32-2 [28.2 kB] 2024-04-19T02:57:24.523 INFO:teuthology.orchestra.run.smithi134.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pecan all 1.3.3-3ubuntu1 [85.8 kB] 2024-04-19T02:57:24.525 INFO:teuthology.orchestra.run.smithi134.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-werkzeug all 0.16.1+dfsg1-2ubuntu0.1 [183 kB] 2024-04-19T02:57:24.528 INFO:teuthology.orchestra.run.smithi134.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-cryptography amd64 2.8-3ubuntu0.3 [211 kB] 2024-04-19T02:57:24.531 INFO:teuthology.orchestra.run.smithi134.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-openssl all 19.0.0-1build1 [43.3 kB] 2024-04-19T02:57:24.531 INFO:teuthology.orchestra.run.smithi134.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-asyncssh all 1.12.2-1 [152 kB] 2024-04-19T02:57:24.539 INFO:teuthology.orchestra.run.smithi097.stdout:Get:45 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-04-19T02:57:24.540 INFO:teuthology.orchestra.run.smithi097.stdout:Get:46 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libjs-underscore all 1.9.1~dfsg-1ubuntu0.20.04.1 [99.5 kB] 2024-04-19T02:57:24.541 INFO:teuthology.orchestra.run.smithi134.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-jinja2 all 2.10.1-2ubuntu0.2 [95.9 kB] 2024-04-19T02:57:24.542 INFO:teuthology.orchestra.run.smithi097.stdout:Get:47 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-sphinxdoc all 1.8.5-7ubuntu3 [97.1 kB] 2024-04-19T02:57:24.542 INFO:teuthology.orchestra.run.smithi134.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bcrypt amd64 3.1.7-2ubuntu1 [30.4 kB] 2024-04-19T02:57:24.543 INFO:teuthology.orchestra.run.smithi134.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-jwt all 1.7.1-2ubuntu2.1 [18.0 kB] 2024-04-19T02:57:24.543 INFO:teuthology.orchestra.run.smithi097.stdout:Get:48 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-routes all 2.4.1-2 [88.1 kB] 2024-04-19T02:57:24.545 INFO:teuthology.orchestra.run.smithi097.stdout:Get:49 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-decorator all 4.4.2-0ubuntu1 [10.3 kB] 2024-04-19T02:57:24.545 INFO:teuthology.orchestra.run.smithi097.stdout:Get:50 http://archive.ubuntu.com/ubuntu focal/universe amd64 liblbfgsb0 amd64 3.0+dfsg.3-7build1 [29.5 kB] 2024-04-19T02:57:24.555 INFO:teuthology.orchestra.run.smithi144.stdout:Get:4 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 libcephfs2 amd64 18.2.2-1237-g646b8c7d-1focal [744 kB] 2024-04-19T02:57:24.560 INFO:teuthology.orchestra.run.smithi097.stdout:Get:51 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-scipy amd64 1.3.3-3build1 [11.1 MB] 2024-04-19T02:57:24.562 INFO:teuthology.orchestra.run.smithi134.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-attr all 19.3.0-2 [33.9 kB] 2024-04-19T02:57:24.563 INFO:teuthology.orchestra.run.smithi134.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pluggy all 0.13.0-2 [18.4 kB] 2024-04-19T02:57:24.563 INFO:teuthology.orchestra.run.smithi134.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 python3-py all 1.8.1-1ubuntu0.1 [65.6 kB] 2024-04-19T02:57:24.565 INFO:teuthology.orchestra.run.smithi134.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-atomicwrites all 1.1.5-2build1 [7,016 B] 2024-04-19T02:57:24.566 INFO:teuthology.orchestra.run.smithi134.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-packaging all 20.3-1 [26.8 kB] 2024-04-19T02:57:24.567 INFO:teuthology.orchestra.run.smithi134.stdout:Get:43 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-wcwidth all 0.1.8+dfsg1-3 [17.4 kB] 2024-04-19T02:57:24.568 INFO:teuthology.orchestra.run.smithi134.stdout:Get:44 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pytest all 4.6.9-1 [178 kB] 2024-04-19T02:57:24.582 INFO:teuthology.orchestra.run.smithi144.stdout:Get:5 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 python3-rados amd64 18.2.2-1237-g646b8c7d-1focal [387 kB] 2024-04-19T02:57:24.591 INFO:teuthology.orchestra.run.smithi134.stdout:Get:45 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-04-19T02:57:24.592 INFO:teuthology.orchestra.run.smithi134.stdout:Get:46 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libjs-underscore all 1.9.1~dfsg-1ubuntu0.20.04.1 [99.5 kB] 2024-04-19T02:57:24.594 INFO:teuthology.orchestra.run.smithi134.stdout:Get:47 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-sphinxdoc all 1.8.5-7ubuntu3 [97.1 kB] 2024-04-19T02:57:24.597 INFO:teuthology.orchestra.run.smithi144.stdout:Get:6 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-argparse all 18.2.2-1237-g646b8c7d-1focal [31.9 kB] 2024-04-19T02:57:24.598 INFO:teuthology.orchestra.run.smithi144.stdout:Get:7 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 python3-cephfs amd64 18.2.2-1237-g646b8c7d-1focal [200 kB] 2024-04-19T02:57:24.605 INFO:teuthology.orchestra.run.smithi144.stdout:Get:8 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-common all 18.2.2-1237-g646b8c7d-1focal [62.4 kB] 2024-04-19T02:57:24.607 INFO:teuthology.orchestra.run.smithi144.stdout:Get:9 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 python3-rbd amd64 18.2.2-1237-g646b8c7d-1focal [364 kB] 2024-04-19T02:57:24.619 INFO:teuthology.orchestra.run.smithi144.stdout:Get:10 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 librgw2 amd64 18.2.2-1237-g646b8c7d-1focal [6,591 kB] 2024-04-19T02:57:24.620 INFO:teuthology.orchestra.run.smithi134.stdout:Get:48 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-routes all 2.4.1-2 [88.1 kB] 2024-04-19T02:57:24.622 INFO:teuthology.orchestra.run.smithi134.stdout:Get:49 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-decorator all 4.4.2-0ubuntu1 [10.3 kB] 2024-04-19T02:57:24.622 INFO:teuthology.orchestra.run.smithi134.stdout:Get:50 http://archive.ubuntu.com/ubuntu focal/universe amd64 liblbfgsb0 amd64 3.0+dfsg.3-7build1 [29.5 kB] 2024-04-19T02:57:24.623 INFO:teuthology.orchestra.run.smithi134.stdout:Get:51 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-scipy amd64 1.3.3-3build1 [11.1 MB] 2024-04-19T02:57:24.643 INFO:teuthology.orchestra.run.smithi144.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal/universe amd64 libdouble-conversion3 amd64 3.1.5-4ubuntu1 [37.9 kB] 2024-04-19T02:57:24.657 INFO:teuthology.orchestra.run.smithi144.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libpcre2-16-0 amd64 10.34-7ubuntu0.1 [181 kB] 2024-04-19T02:57:24.718 INFO:teuthology.orchestra.run.smithi097.stdout:Get:52 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn-lib amd64 0.22.2.post1+dfsg-5 [2,358 kB] 2024-04-19T02:57:24.741 INFO:teuthology.orchestra.run.smithi144.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5core5a amd64 5.12.8+dfsg-0ubuntu2.1 [2,006 kB] 2024-04-19T02:57:24.763 INFO:teuthology.orchestra.run.smithi097.stdout:Get:53 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-joblib all 0.14.0-3 [192 kB] 2024-04-19T02:57:24.765 INFO:teuthology.orchestra.run.smithi097.stdout:Get:54 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn all 0.22.2.post1+dfsg-5 [1,773 kB] 2024-04-19T02:57:24.799 INFO:teuthology.orchestra.run.smithi097.stdout:Get:55 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cachetools all 4.0.0-1 [9,820 B] 2024-04-19T02:57:24.799 INFO:teuthology.orchestra.run.smithi097.stdout:Get:56 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1 all 0.4.2-3build1 [46.7 kB] 2024-04-19T02:57:24.800 INFO:teuthology.orchestra.run.smithi097.stdout:Get:57 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1-modules all 0.2.1-0.2build1 [32.9 kB] 2024-04-19T02:57:24.801 INFO:teuthology.orchestra.run.smithi097.stdout:Get:58 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-rsa all 4.0-3 [24.7 kB] 2024-04-19T02:57:24.801 INFO:teuthology.orchestra.run.smithi097.stdout:Get:59 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-google-auth all 1.5.1-2 [35.6 kB] 2024-04-19T02:57:24.802 INFO:teuthology.orchestra.run.smithi097.stdout:Get:60 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-blinker all 1.4+dfsg1-0.3ubuntu1 [13.2 kB] 2024-04-19T02:57:24.803 INFO:teuthology.orchestra.run.smithi134.stdout:Get:52 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn-lib amd64 0.22.2.post1+dfsg-5 [2,358 kB] 2024-04-19T02:57:24.803 INFO:teuthology.orchestra.run.smithi097.stdout:Get:61 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-oauthlib all 3.1.0-1ubuntu2 [84.8 kB] 2024-04-19T02:57:24.808 INFO:teuthology.orchestra.run.smithi096.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/universe amd64 libdouble-conversion3 amd64 3.1.5-4ubuntu1 [37.9 kB] 2024-04-19T02:57:24.811 INFO:teuthology.orchestra.run.smithi097.stdout:Get:62 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-requests-oauthlib all 1.0.0-1.1build1 [16.8 kB] 2024-04-19T02:57:24.812 INFO:teuthology.orchestra.run.smithi097.stdout:Get:63 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-websocket all 0.53.0-2ubuntu1 [32.3 kB] 2024-04-19T02:57:24.821 INFO:teuthology.orchestra.run.smithi096.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libpcre2-16-0 amd64 10.34-7ubuntu0.1 [181 kB] 2024-04-19T02:57:24.823 INFO:teuthology.orchestra.run.smithi134.stdout:Get:53 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-joblib all 0.14.0-3 [192 kB] 2024-04-19T02:57:24.825 INFO:teuthology.orchestra.run.smithi134.stdout:Get:54 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn all 0.22.2.post1+dfsg-5 [1,773 kB] 2024-04-19T02:57:24.840 INFO:teuthology.orchestra.run.smithi097.stdout:Get:64 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-kubernetes all 7.0.0~a1-2 [271 kB] 2024-04-19T02:57:24.843 INFO:teuthology.orchestra.run.smithi097.stdout:Get:65 http://archive.ubuntu.com/ubuntu focal/universe amd64 libonig5 amd64 6.9.4-1 [142 kB] 2024-04-19T02:57:24.845 INFO:teuthology.orchestra.run.smithi097.stdout:Get:66 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libjq1 amd64 1.6-1ubuntu0.20.04.1 [121 kB] 2024-04-19T02:57:24.847 INFO:teuthology.orchestra.run.smithi097.stdout:Get:67 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 jq amd64 1.6-1ubuntu0.20.04.1 [50.2 kB] 2024-04-19T02:57:24.848 INFO:teuthology.orchestra.run.smithi134.stdout:Get:55 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cachetools all 4.0.0-1 [9,820 B] 2024-04-19T02:57:24.848 INFO:teuthology.orchestra.run.smithi134.stdout:Get:56 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1 all 0.4.2-3build1 [46.7 kB] 2024-04-19T02:57:24.848 INFO:teuthology.orchestra.run.smithi134.stdout:Get:57 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1-modules all 0.2.1-0.2build1 [32.9 kB] 2024-04-19T02:57:24.848 INFO:teuthology.orchestra.run.smithi097.stdout:Get:68 http://archive.ubuntu.com/ubuntu focal/main amd64 socat amd64 1.7.3.3-2 [323 kB] 2024-04-19T02:57:24.849 INFO:teuthology.orchestra.run.smithi134.stdout:Get:58 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-rsa all 4.0-3 [24.7 kB] 2024-04-19T02:57:24.849 INFO:teuthology.orchestra.run.smithi134.stdout:Get:59 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-google-auth all 1.5.1-2 [35.6 kB] 2024-04-19T02:57:24.850 INFO:teuthology.orchestra.run.smithi134.stdout:Get:60 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-blinker all 1.4+dfsg1-0.3ubuntu1 [13.2 kB] 2024-04-19T02:57:24.850 INFO:teuthology.orchestra.run.smithi134.stdout:Get:61 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-oauthlib all 3.1.0-1ubuntu2 [84.8 kB] 2024-04-19T02:57:24.851 INFO:teuthology.orchestra.run.smithi097.stdout:Get:69 http://archive.ubuntu.com/ubuntu focal/universe amd64 xmlstarlet amd64 1.6.1-2build1 [267 kB] 2024-04-19T02:57:24.854 INFO:teuthology.orchestra.run.smithi097.stdout:Get:70 http://archive.ubuntu.com/ubuntu focal/universe amd64 fonts-mathjax all 2.7.4+dfsg-1 [2,208 kB] 2024-04-19T02:57:24.866 INFO:teuthology.orchestra.run.smithi144.stdout:Get:14 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 python3-rgw amd64 18.2.2-1237-g646b8c7d-1focal [113 kB] 2024-04-19T02:57:24.868 INFO:teuthology.orchestra.run.smithi144.stdout:Get:15 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 libradosstriper1 amd64 18.2.2-1237-g646b8c7d-1focal [476 kB] 2024-04-19T02:57:24.870 INFO:teuthology.orchestra.run.smithi134.stdout:Get:62 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-requests-oauthlib all 1.0.0-1.1build1 [16.8 kB] 2024-04-19T02:57:24.871 INFO:teuthology.orchestra.run.smithi134.stdout:Get:63 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-websocket all 0.53.0-2ubuntu1 [32.3 kB] 2024-04-19T02:57:24.873 INFO:teuthology.orchestra.run.smithi097.stdout:Get:71 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 nvme-cli amd64 1.9-1ubuntu0.1 [283 kB] 2024-04-19T02:57:24.879 INFO:teuthology.orchestra.run.smithi097.stdout:Get:72 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-asyncssh-doc all 1.12.2-1 [258 kB] 2024-04-19T02:57:24.881 INFO:teuthology.orchestra.run.smithi097.stdout:Get:73 http://archive.ubuntu.com/ubuntu focal/universe amd64 libjs-mathjax all 2.7.4+dfsg-1 [5,654 kB] 2024-04-19T02:57:24.886 INFO:teuthology.orchestra.run.smithi144.stdout:Get:16 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 ceph-common amd64 18.2.2-1237-g646b8c7d-1focal [25.1 MB] 2024-04-19T02:57:24.897 INFO:teuthology.orchestra.run.smithi134.stdout:Get:64 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-kubernetes all 7.0.0~a1-2 [271 kB] 2024-04-19T02:57:24.902 INFO:teuthology.orchestra.run.smithi134.stdout:Get:65 http://archive.ubuntu.com/ubuntu focal/universe amd64 libonig5 amd64 6.9.4-1 [142 kB] 2024-04-19T02:57:24.905 INFO:teuthology.orchestra.run.smithi134.stdout:Get:66 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libjq1 amd64 1.6-1ubuntu0.20.04.1 [121 kB] 2024-04-19T02:57:24.907 INFO:teuthology.orchestra.run.smithi096.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5core5a amd64 5.12.8+dfsg-0ubuntu2.1 [2,006 kB] 2024-04-19T02:57:24.909 INFO:teuthology.orchestra.run.smithi134.stdout:Get:67 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 jq amd64 1.6-1ubuntu0.20.04.1 [50.2 kB] 2024-04-19T02:57:24.910 INFO:teuthology.orchestra.run.smithi134.stdout:Get:68 http://archive.ubuntu.com/ubuntu focal/main amd64 socat amd64 1.7.3.3-2 [323 kB] 2024-04-19T02:57:24.914 INFO:teuthology.orchestra.run.smithi134.stdout:Get:69 http://archive.ubuntu.com/ubuntu focal/universe amd64 xmlstarlet amd64 1.6.1-2build1 [267 kB] 2024-04-19T02:57:24.916 INFO:teuthology.orchestra.run.smithi134.stdout:Get:70 http://archive.ubuntu.com/ubuntu focal/universe amd64 fonts-mathjax all 2.7.4+dfsg-1 [2,208 kB] 2024-04-19T02:57:24.956 INFO:teuthology.orchestra.run.smithi134.stdout:Get:71 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 nvme-cli amd64 1.9-1ubuntu0.1 [283 kB] 2024-04-19T02:57:24.960 INFO:teuthology.orchestra.run.smithi134.stdout:Get:72 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-asyncssh-doc all 1.12.2-1 [258 kB] 2024-04-19T02:57:24.963 INFO:teuthology.orchestra.run.smithi134.stdout:Get:73 http://archive.ubuntu.com/ubuntu focal/universe amd64 libjs-mathjax all 2.7.4+dfsg-1 [5,654 kB] 2024-04-19T02:57:24.984 INFO:teuthology.orchestra.run.smithi144.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5dbus5 amd64 5.12.8+dfsg-0ubuntu2.1 [208 kB] 2024-04-19T02:57:24.994 INFO:teuthology.orchestra.run.smithi144.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5network5 amd64 5.12.8+dfsg-0ubuntu2.1 [673 kB] 2024-04-19T02:57:24.997 INFO:teuthology.orchestra.run.smithi097.stdout:Get:74 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-natsort-doc all 7.0.1-1 [103 kB] 2024-04-19T02:57:24.998 INFO:teuthology.orchestra.run.smithi097.stdout:Get:75 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webencodings all 0.5.1-1ubuntu1 [11.0 kB] 2024-04-19T02:57:24.998 INFO:teuthology.orchestra.run.smithi097.stdout:Get:76 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-html5lib all 1.0.1-2 [84.3 kB] 2024-04-19T02:57:24.999 INFO:teuthology.orchestra.run.smithi097.stdout:Get:77 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-lxml amd64 4.5.0-1ubuntu0.5 [1,384 kB] 2024-04-19T02:57:25.016 INFO:teuthology.orchestra.run.smithi097.stdout:Get:78 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-04-19T02:57:25.016 INFO:teuthology.orchestra.run.smithi097.stdout:Get:79 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-psutil amd64 5.5.1-1ubuntu4 [141 kB] 2024-04-19T02:57:25.017 INFO:teuthology.orchestra.run.smithi097.stdout:Get:80 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyinotify all 0.9.6-1.2ubuntu1 [24.8 kB] 2024-04-19T02:57:25.017 INFO:teuthology.orchestra.run.smithi097.stdout:Get:81 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplejson amd64 3.16.0-2ubuntu2 [50.8 kB] 2024-04-19T02:57:25.018 INFO:teuthology.orchestra.run.smithi097.stdout:Get:82 http://archive.ubuntu.com/ubuntu focal/universe amd64 qttranslations5-l10n all 5.12.8-0ubuntu1 [1,486 kB] 2024-04-19T02:57:25.023 INFO:teuthology.orchestra.run.smithi144.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal/universe amd64 libthrift-0.13.0 amd64 0.13.0-2build2 [249 kB] 2024-04-19T02:57:25.032 INFO:teuthology.orchestra.run.smithi144.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-prettytable all 0.7.2-5 [20.1 kB] 2024-04-19T02:57:25.032 INFO:teuthology.orchestra.run.smithi144.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal/main amd64 liblua5.3-0 amd64 5.3.3-1.1ubuntu2 [116 kB] 2024-04-19T02:57:25.036 INFO:teuthology.orchestra.run.smithi144.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal/main amd64 librabbitmq4 amd64 0.10.0-1 [35.8 kB] 2024-04-19T02:57:25.036 INFO:teuthology.orchestra.run.smithi144.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal/universe amd64 librdkafka1 amd64 1.2.1-1ubuntu1 [410 kB] 2024-04-19T02:57:25.043 INFO:teuthology.orchestra.run.smithi134.stdout:Get:74 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-natsort-doc all 7.0.1-1 [103 kB] 2024-04-19T02:57:25.043 INFO:teuthology.orchestra.run.smithi134.stdout:Get:75 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webencodings all 0.5.1-1ubuntu1 [11.0 kB] 2024-04-19T02:57:25.043 INFO:teuthology.orchestra.run.smithi134.stdout:Get:76 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-html5lib all 1.0.1-2 [84.3 kB] 2024-04-19T02:57:25.044 INFO:teuthology.orchestra.run.smithi134.stdout:Get:77 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-lxml amd64 4.5.0-1ubuntu0.5 [1,384 kB] 2024-04-19T02:57:25.056 INFO:teuthology.orchestra.run.smithi134.stdout:Get:78 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-04-19T02:57:25.057 INFO:teuthology.orchestra.run.smithi134.stdout:Get:79 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-psutil amd64 5.5.1-1ubuntu4 [141 kB] 2024-04-19T02:57:25.058 INFO:teuthology.orchestra.run.smithi134.stdout:Get:80 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyinotify all 0.9.6-1.2ubuntu1 [24.8 kB] 2024-04-19T02:57:25.058 INFO:teuthology.orchestra.run.smithi134.stdout:Get:81 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplejson amd64 3.16.0-2ubuntu2 [50.8 kB] 2024-04-19T02:57:25.058 INFO:teuthology.orchestra.run.smithi134.stdout:Get:82 http://archive.ubuntu.com/ubuntu focal/universe amd64 qttranslations5-l10n all 5.12.8-0ubuntu1 [1,486 kB] 2024-04-19T02:57:25.151 INFO:teuthology.orchestra.run.smithi096.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5dbus5 amd64 5.12.8+dfsg-0ubuntu2.1 [208 kB] 2024-04-19T02:57:25.162 INFO:teuthology.orchestra.run.smithi096.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5network5 amd64 5.12.8+dfsg-0ubuntu2.1 [673 kB] 2024-04-19T02:57:25.190 INFO:teuthology.orchestra.run.smithi096.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/universe amd64 libthrift-0.13.0 amd64 0.13.0-2build2 [249 kB] 2024-04-19T02:57:25.199 INFO:teuthology.orchestra.run.smithi096.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-prettytable all 0.7.2-5 [20.1 kB] 2024-04-19T02:57:25.199 INFO:teuthology.orchestra.run.smithi096.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal/main amd64 liblua5.3-0 amd64 5.3.3-1.1ubuntu2 [116 kB] 2024-04-19T02:57:25.203 INFO:teuthology.orchestra.run.smithi096.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal/main amd64 librabbitmq4 amd64 0.10.0-1 [35.8 kB] 2024-04-19T02:57:25.204 INFO:teuthology.orchestra.run.smithi096.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal/universe amd64 librdkafka1 amd64 1.2.1-1ubuntu1 [410 kB] 2024-04-19T02:57:25.213 INFO:teuthology.orchestra.run.smithi144.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal/main amd64 liboath0 amd64 2.6.1-1.3 [44.7 kB] 2024-04-19T02:57:25.381 INFO:teuthology.orchestra.run.smithi096.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal/main amd64 liboath0 amd64 2.6.1-1.3 [44.7 kB] 2024-04-19T02:57:25.467 INFO:teuthology.orchestra.run.smithi144.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cherrypy3 all 8.9.1-6 [160 kB] 2024-04-19T02:57:25.630 INFO:teuthology.orchestra.run.smithi096.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cherrypy3 all 8.9.1-6 [160 kB] 2024-04-19T02:57:25.640 INFO:teuthology.orchestra.run.smithi144.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-natsort all 7.0.1-1 [29.2 kB] 2024-04-19T02:57:25.655 INFO:teuthology.orchestra.run.smithi144.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-logutils all 0.3.3-7 [17.3 kB] 2024-04-19T02:57:25.663 INFO:teuthology.orchestra.run.smithi144.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-markupsafe amd64 1.1.0-1build2 [13.9 kB] 2024-04-19T02:57:25.670 INFO:teuthology.orchestra.run.smithi144.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-mako all 1.1.0+ds1-1ubuntu2.1 [59.2 kB] 2024-04-19T02:57:25.698 INFO:teuthology.orchestra.run.smithi144.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-04-19T02:57:25.704 INFO:teuthology.orchestra.run.smithi144.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-singledispatch all 3.4.0.3-2build1 [7,128 B] 2024-04-19T02:57:25.709 INFO:teuthology.orchestra.run.smithi144.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webob all 1:1.8.5-2 [84.4 kB] 2024-04-19T02:57:25.736 INFO:teuthology.orchestra.run.smithi144.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-soupsieve all 1.9.5+dfsg-1 [29.1 kB] 2024-04-19T02:57:25.743 INFO:teuthology.orchestra.run.smithi144.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bs4 all 4.8.2-1 [83.0 kB] 2024-04-19T02:57:25.801 INFO:teuthology.orchestra.run.smithi096.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-natsort all 7.0.1-1 [29.2 kB] 2024-04-19T02:57:25.814 INFO:teuthology.orchestra.run.smithi096.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-logutils all 0.3.3-7 [17.3 kB] 2024-04-19T02:57:25.823 INFO:teuthology.orchestra.run.smithi096.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-markupsafe amd64 1.1.0-1build2 [13.9 kB] 2024-04-19T02:57:25.829 INFO:teuthology.orchestra.run.smithi096.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-mako all 1.1.0+ds1-1ubuntu2.1 [59.2 kB] 2024-04-19T02:57:25.856 INFO:teuthology.orchestra.run.smithi096.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-04-19T02:57:25.861 INFO:teuthology.orchestra.run.smithi096.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-singledispatch all 3.4.0.3-2build1 [7,128 B] 2024-04-19T02:57:25.865 INFO:teuthology.orchestra.run.smithi096.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webob all 1:1.8.5-2 [84.4 kB] 2024-04-19T02:57:25.896 INFO:teuthology.orchestra.run.smithi096.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-soupsieve all 1.9.5+dfsg-1 [29.1 kB] 2024-04-19T02:57:25.903 INFO:teuthology.orchestra.run.smithi096.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bs4 all 4.8.2-1 [83.0 kB] 2024-04-19T02:57:25.927 INFO:teuthology.orchestra.run.smithi144.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-waitress all 1.4.1-1ubuntu0.1 [81.4 kB] 2024-04-19T02:57:25.982 INFO:teuthology.orchestra.run.smithi144.stdout:Get:36 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 ceph-base amd64 18.2.2-1237-g646b8c7d-1focal [9,603 kB] 2024-04-19T02:57:26.089 INFO:teuthology.orchestra.run.smithi096.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-waitress all 1.4.1-1ubuntu0.1 [81.4 kB] 2024-04-19T02:57:26.218 INFO:teuthology.orchestra.run.smithi096.stdout:Get:25 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 librados2 amd64 18.2.2-1237-g646b8c7d-1focal [4,030 kB] 2024-04-19T02:57:26.224 INFO:teuthology.orchestra.run.smithi144.stdout:Get:37 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-modules-core all 18.2.2-1237-g646b8c7d-1focal [238 kB] 2024-04-19T02:57:26.232 INFO:teuthology.orchestra.run.smithi144.stdout:Get:38 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 libsqlite3-mod-ceph amd64 18.2.2-1237-g646b8c7d-1focal [147 kB] 2024-04-19T02:57:26.237 INFO:teuthology.orchestra.run.smithi144.stdout:Get:39 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr amd64 18.2.2-1237-g646b8c7d-1focal [1,572 kB] 2024-04-19T02:57:26.250 INFO:teuthology.orchestra.run.smithi144.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-tempita all 0.5.2-6 [14.8 kB] 2024-04-19T02:57:26.261 INFO:teuthology.orchestra.run.smithi144.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-paste all 3.4.0+dfsg1-1 [456 kB] 2024-04-19T02:57:26.300 INFO:teuthology.orchestra.run.smithi144.stdout:Get:42 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 ceph-mon amd64 18.2.2-1237-g646b8c7d-1focal [6,636 kB] 2024-04-19T02:57:26.412 INFO:teuthology.orchestra.run.smithi096.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-tempita all 0.5.2-6 [14.8 kB] 2024-04-19T02:57:26.423 INFO:teuthology.orchestra.run.smithi096.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-paste all 3.4.0+dfsg1-1 [456 kB] 2024-04-19T02:57:26.498 INFO:teuthology.orchestra.run.smithi144.stdout:Get:43 http://archive.ubuntu.com/ubuntu focal/main amd64 python-pastedeploy-tpl all 2.1.0-1 [5,016 B] 2024-04-19T02:57:26.498 INFO:teuthology.orchestra.run.smithi144.stdout:Get:44 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastedeploy all 2.1.0-1 [26.5 kB] 2024-04-19T02:57:26.504 INFO:teuthology.orchestra.run.smithi144.stdout:Get:45 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webtest all 2.0.32-2 [28.2 kB] 2024-04-19T02:57:26.511 INFO:teuthology.orchestra.run.smithi144.stdout:Get:46 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pecan all 1.3.3-3ubuntu1 [85.8 kB] 2024-04-19T02:57:26.527 INFO:teuthology.orchestra.run.smithi144.stdout:Get:47 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-werkzeug all 0.16.1+dfsg1-2ubuntu0.1 [183 kB] 2024-04-19T02:57:26.554 INFO:teuthology.orchestra.run.smithi144.stdout:Get:48 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-cryptography amd64 2.8-3ubuntu0.3 [211 kB] 2024-04-19T02:57:26.564 INFO:teuthology.orchestra.run.smithi144.stdout:Get:49 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 ceph-osd amd64 18.2.2-1237-g646b8c7d-1focal [24.5 MB] 2024-04-19T02:57:26.580 INFO:teuthology.orchestra.run.smithi144.stdout:Get:50 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-openssl all 19.0.0-1build1 [43.3 kB] 2024-04-19T02:57:26.586 INFO:teuthology.orchestra.run.smithi144.stdout:Get:51 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-asyncssh all 1.12.2-1 [152 kB] 2024-04-19T02:57:26.765 INFO:teuthology.orchestra.run.smithi144.stdout:Get:52 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-jinja2 all 2.10.1-2ubuntu0.2 [95.9 kB] 2024-04-19T02:57:26.826 INFO:teuthology.orchestra.run.smithi096.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 python-pastedeploy-tpl all 2.1.0-1 [5,016 B] 2024-04-19T02:57:26.830 INFO:teuthology.orchestra.run.smithi096.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastedeploy all 2.1.0-1 [26.5 kB] 2024-04-19T02:57:26.845 INFO:teuthology.orchestra.run.smithi096.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webtest all 2.0.32-2 [28.2 kB] 2024-04-19T02:57:26.864 INFO:teuthology.orchestra.run.smithi096.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pecan all 1.3.3-3ubuntu1 [85.8 kB] 2024-04-19T02:57:26.919 INFO:teuthology.orchestra.run.smithi097.stdout:Get:83 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 librados2 amd64 18.2.2-1237-g646b8c7d-1focal [4,030 kB] 2024-04-19T02:57:26.946 INFO:teuthology.orchestra.run.smithi096.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-werkzeug all 0.16.1+dfsg1-2ubuntu0.1 [183 kB] 2024-04-19T02:57:27.110 INFO:teuthology.orchestra.run.smithi144.stdout:Get:53 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bcrypt amd64 3.1.7-2ubuntu1 [30.4 kB] 2024-04-19T02:57:27.129 INFO:teuthology.orchestra.run.smithi144.stdout:Get:54 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-jwt all 1.7.1-2ubuntu2.1 [18.0 kB] 2024-04-19T02:57:27.141 INFO:teuthology.orchestra.run.smithi144.stdout:Get:55 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-attr all 19.3.0-2 [33.9 kB] 2024-04-19T02:57:27.161 INFO:teuthology.orchestra.run.smithi144.stdout:Get:56 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pluggy all 0.13.0-2 [18.4 kB] 2024-04-19T02:57:27.174 INFO:teuthology.orchestra.run.smithi144.stdout:Get:57 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 python3-py all 1.8.1-1ubuntu0.1 [65.6 kB] 2024-04-19T02:57:27.186 INFO:teuthology.orchestra.run.smithi096.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-cryptography amd64 2.8-3ubuntu0.3 [211 kB] 2024-04-19T02:57:27.227 INFO:teuthology.orchestra.run.smithi144.stdout:Get:58 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-atomicwrites all 1.1.5-2build1 [7,016 B] 2024-04-19T02:57:27.231 INFO:teuthology.orchestra.run.smithi144.stdout:Get:59 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-packaging all 20.3-1 [26.8 kB] 2024-04-19T02:57:27.241 INFO:teuthology.orchestra.run.smithi134.stdout:Get:83 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 librados2 amd64 18.2.2-1237-g646b8c7d-1focal [4,030 kB] 2024-04-19T02:57:27.247 INFO:teuthology.orchestra.run.smithi144.stdout:Get:60 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-wcwidth all 0.1.8+dfsg1-3 [17.4 kB] 2024-04-19T02:57:27.256 INFO:teuthology.orchestra.run.smithi144.stdout:Get:61 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pytest all 4.6.9-1 [178 kB] 2024-04-19T02:57:27.310 INFO:teuthology.orchestra.run.smithi144.stdout:Get:62 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-04-19T02:57:27.477 INFO:teuthology.orchestra.run.smithi144.stdout:Get:63 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libjs-underscore all 1.9.1~dfsg-1ubuntu0.20.04.1 [99.5 kB] 2024-04-19T02:57:27.521 INFO:teuthology.orchestra.run.smithi096.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-openssl all 19.0.0-1build1 [43.3 kB] 2024-04-19T02:57:27.596 INFO:teuthology.orchestra.run.smithi096.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-asyncssh all 1.12.2-1 [152 kB] 2024-04-19T02:57:27.630 INFO:teuthology.orchestra.run.smithi144.stdout:Get:64 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 ceph amd64 18.2.2-1237-g646b8c7d-1focal [13.7 kB] 2024-04-19T02:57:27.631 INFO:teuthology.orchestra.run.smithi144.stdout:Get:65 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 ceph-fuse amd64 18.2.2-1237-g646b8c7d-1focal [853 kB] 2024-04-19T02:57:27.645 INFO:teuthology.orchestra.run.smithi144.stdout:Get:66 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 ceph-mds amd64 18.2.2-1237-g646b8c7d-1focal [2,290 kB] 2024-04-19T02:57:27.680 INFO:teuthology.orchestra.run.smithi144.stdout:Get:67 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 cephadm amd64 18.2.2-1237-g646b8c7d-1focal [237 kB] 2024-04-19T02:57:27.696 INFO:teuthology.orchestra.run.smithi144.stdout:Get:68 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-cephadm all 18.2.2-1237-g646b8c7d-1focal [142 kB] 2024-04-19T02:57:27.700 INFO:teuthology.orchestra.run.smithi144.stdout:Get:69 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-dashboard all 18.2.2-1237-g646b8c7d-1focal [7,011 kB] 2024-04-19T02:57:27.826 INFO:teuthology.orchestra.run.smithi144.stdout:Get:70 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-sphinxdoc all 1.8.5-7ubuntu3 [97.1 kB] 2024-04-19T02:57:27.884 INFO:teuthology.orchestra.run.smithi144.stdout:Get:71 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-routes all 2.4.1-2 [88.1 kB] 2024-04-19T02:57:27.950 INFO:teuthology.orchestra.run.smithi144.stdout:Get:72 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-decorator all 4.4.2-0ubuntu1 [10.3 kB] 2024-04-19T02:57:27.957 INFO:teuthology.orchestra.run.smithi144.stdout:Get:73 http://archive.ubuntu.com/ubuntu focal/universe amd64 liblbfgsb0 amd64 3.0+dfsg.3-7build1 [29.5 kB] 2024-04-19T02:57:27.965 INFO:teuthology.orchestra.run.smithi096.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-jinja2 all 2.10.1-2ubuntu0.2 [95.9 kB] 2024-04-19T02:57:27.972 INFO:teuthology.orchestra.run.smithi144.stdout:Get:74 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-scipy amd64 1.3.3-3build1 [11.1 MB] 2024-04-19T02:57:28.000 INFO:teuthology.orchestra.run.smithi144.stdout:Get:75 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-local all 18.2.2-1237-g646b8c7d-1focal [7,891 kB] 2024-04-19T02:57:28.162 INFO:teuthology.orchestra.run.smithi097.stdout:Get:84 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 libcephfs2 amd64 18.2.2-1237-g646b8c7d-1focal [744 kB] 2024-04-19T02:57:28.245 INFO:teuthology.orchestra.run.smithi096.stdout:Get:37 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 libcephfs2 amd64 18.2.2-1237-g646b8c7d-1focal [744 kB] 2024-04-19T02:57:28.312 INFO:teuthology.orchestra.run.smithi096.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bcrypt amd64 3.1.7-2ubuntu1 [30.4 kB] 2024-04-19T02:57:28.331 INFO:teuthology.orchestra.run.smithi096.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-jwt all 1.7.1-2ubuntu2.1 [18.0 kB] 2024-04-19T02:57:28.343 INFO:teuthology.orchestra.run.smithi096.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-attr all 19.3.0-2 [33.9 kB] 2024-04-19T02:57:28.345 INFO:teuthology.orchestra.run.smithi144.stdout:Get:76 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-k8sevents all 18.2.2-1237-g646b8c7d-1focal [13.8 kB] 2024-04-19T02:57:28.345 INFO:teuthology.orchestra.run.smithi144.stdout:Get:77 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 ceph-test amd64 18.2.2-1237-g646b8c7d-1focal [46.7 MB] 2024-04-19T02:57:28.364 INFO:teuthology.orchestra.run.smithi096.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pluggy all 0.13.0-2 [18.4 kB] 2024-04-19T02:57:28.377 INFO:teuthology.orchestra.run.smithi096.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 python3-py all 1.8.1-1ubuntu0.1 [65.6 kB] 2024-04-19T02:57:28.378 INFO:teuthology.orchestra.run.smithi097.stdout:Get:85 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 python3-rados amd64 18.2.2-1237-g646b8c7d-1focal [387 kB] 2024-04-19T02:57:28.432 INFO:teuthology.orchestra.run.smithi096.stdout:Get:43 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-atomicwrites all 1.1.5-2build1 [7,016 B] 2024-04-19T02:57:28.435 INFO:teuthology.orchestra.run.smithi096.stdout:Get:44 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-packaging all 20.3-1 [26.8 kB] 2024-04-19T02:57:28.450 INFO:teuthology.orchestra.run.smithi096.stdout:Get:45 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-wcwidth all 0.1.8+dfsg1-3 [17.4 kB] 2024-04-19T02:57:28.460 INFO:teuthology.orchestra.run.smithi096.stdout:Get:46 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pytest all 4.6.9-1 [178 kB] 2024-04-19T02:57:28.478 INFO:teuthology.orchestra.run.smithi097.stdout:Get:86 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-argparse all 18.2.2-1237-g646b8c7d-1focal [31.9 kB] 2024-04-19T02:57:28.480 INFO:teuthology.orchestra.run.smithi144.stdout:Get:78 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn-lib amd64 0.22.2.post1+dfsg-5 [2,358 kB] 2024-04-19T02:57:28.485 INFO:teuthology.orchestra.run.smithi097.stdout:Get:87 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 python3-cephfs amd64 18.2.2-1237-g646b8c7d-1focal [200 kB] 2024-04-19T02:57:28.515 INFO:teuthology.orchestra.run.smithi096.stdout:Get:47 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-04-19T02:57:28.546 INFO:teuthology.orchestra.run.smithi097.stdout:Get:88 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-common all 18.2.2-1237-g646b8c7d-1focal [62.4 kB] 2024-04-19T02:57:28.550 INFO:teuthology.orchestra.run.smithi096.stdout:Get:48 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 python3-rados amd64 18.2.2-1237-g646b8c7d-1focal [387 kB] 2024-04-19T02:57:28.554 INFO:teuthology.orchestra.run.smithi144.stdout:Get:79 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-joblib all 0.14.0-3 [192 kB] 2024-04-19T02:57:28.557 INFO:teuthology.orchestra.run.smithi144.stdout:Get:80 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn all 0.22.2.post1+dfsg-5 [1,773 kB] 2024-04-19T02:57:28.558 INFO:teuthology.orchestra.run.smithi097.stdout:Get:89 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 python3-rbd amd64 18.2.2-1237-g646b8c7d-1focal [364 kB] 2024-04-19T02:57:28.596 INFO:teuthology.orchestra.run.smithi144.stdout:Get:81 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cachetools all 4.0.0-1 [9,820 B] 2024-04-19T02:57:28.596 INFO:teuthology.orchestra.run.smithi144.stdout:Get:82 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1 all 0.4.2-3build1 [46.7 kB] 2024-04-19T02:57:28.674 INFO:teuthology.orchestra.run.smithi097.stdout:Get:90 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 librgw2 amd64 18.2.2-1237-g646b8c7d-1focal [6,591 kB] 2024-04-19T02:57:28.682 INFO:teuthology.orchestra.run.smithi096.stdout:Get:49 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libjs-underscore all 1.9.1~dfsg-1ubuntu0.20.04.1 [99.5 kB] 2024-04-19T02:57:28.726 INFO:teuthology.orchestra.run.smithi096.stdout:Get:50 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-argparse all 18.2.2-1237-g646b8c7d-1focal [31.9 kB] 2024-04-19T02:57:28.730 INFO:teuthology.orchestra.run.smithi096.stdout:Get:51 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 python3-cephfs amd64 18.2.2-1237-g646b8c7d-1focal [200 kB] 2024-04-19T02:57:28.760 INFO:teuthology.orchestra.run.smithi144.stdout:Get:83 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1-modules all 0.2.1-0.2build1 [32.9 kB] 2024-04-19T02:57:28.800 INFO:teuthology.orchestra.run.smithi096.stdout:Get:52 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-common all 18.2.2-1237-g646b8c7d-1focal [62.4 kB] 2024-04-19T02:57:28.850 INFO:teuthology.orchestra.run.smithi096.stdout:Get:53 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 python3-rbd amd64 18.2.2-1237-g646b8c7d-1focal [364 kB] 2024-04-19T02:57:28.969 INFO:teuthology.orchestra.run.smithi144.stdout:Get:84 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-rsa all 4.0-3 [24.7 kB] 2024-04-19T02:57:28.986 INFO:teuthology.orchestra.run.smithi096.stdout:Get:54 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 librgw2 amd64 18.2.2-1237-g646b8c7d-1focal [6,591 kB] 2024-04-19T02:57:29.015 INFO:teuthology.orchestra.run.smithi144.stdout:Get:85 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-google-auth all 1.5.1-2 [35.6 kB] 2024-04-19T02:57:29.035 INFO:teuthology.orchestra.run.smithi096.stdout:Get:55 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-sphinxdoc all 1.8.5-7ubuntu3 [97.1 kB] 2024-04-19T02:57:29.084 INFO:teuthology.orchestra.run.smithi144.stdout:Get:86 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-blinker all 1.4+dfsg1-0.3ubuntu1 [13.2 kB] 2024-04-19T02:57:29.093 INFO:teuthology.orchestra.run.smithi096.stdout:Get:56 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-routes all 2.4.1-2 [88.1 kB] 2024-04-19T02:57:29.113 INFO:teuthology.orchestra.run.smithi144.stdout:Get:87 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-oauthlib all 3.1.0-1ubuntu2 [84.8 kB] 2024-04-19T02:57:29.166 INFO:teuthology.orchestra.run.smithi096.stdout:Get:57 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-decorator all 4.4.2-0ubuntu1 [10.3 kB] 2024-04-19T02:57:29.175 INFO:teuthology.orchestra.run.smithi096.stdout:Get:58 http://archive.ubuntu.com/ubuntu focal/universe amd64 liblbfgsb0 amd64 3.0+dfsg.3-7build1 [29.5 kB] 2024-04-19T02:57:29.188 INFO:teuthology.orchestra.run.smithi144.stdout:Get:88 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-requests-oauthlib all 1.0.0-1.1build1 [16.8 kB] 2024-04-19T02:57:29.193 INFO:teuthology.orchestra.run.smithi096.stdout:Get:59 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-scipy amd64 1.3.3-3build1 [11.1 MB] 2024-04-19T02:57:29.198 INFO:teuthology.orchestra.run.smithi144.stdout:Get:89 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-websocket all 0.53.0-2ubuntu1 [32.3 kB] 2024-04-19T02:57:29.220 INFO:teuthology.orchestra.run.smithi144.stdout:Get:90 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-kubernetes all 7.0.0~a1-2 [271 kB] 2024-04-19T02:57:29.315 INFO:teuthology.orchestra.run.smithi144.stdout:Get:91 http://archive.ubuntu.com/ubuntu focal/universe amd64 libonig5 amd64 6.9.4-1 [142 kB] 2024-04-19T02:57:29.346 INFO:teuthology.orchestra.run.smithi144.stdout:Get:92 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libjq1 amd64 1.6-1ubuntu0.20.04.1 [121 kB] 2024-04-19T02:57:29.367 INFO:teuthology.orchestra.run.smithi144.stdout:Get:93 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 jq amd64 1.6-1ubuntu0.20.04.1 [50.2 kB] 2024-04-19T02:57:29.538 INFO:teuthology.orchestra.run.smithi144.stdout:Get:94 http://archive.ubuntu.com/ubuntu focal/main amd64 socat amd64 1.7.3.3-2 [323 kB] 2024-04-19T02:57:29.787 INFO:teuthology.orchestra.run.smithi134.stdout:Get:84 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 libcephfs2 amd64 18.2.2-1237-g646b8c7d-1focal [744 kB] 2024-04-19T02:57:29.793 INFO:teuthology.orchestra.run.smithi096.stdout:Get:60 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn-lib amd64 0.22.2.post1+dfsg-5 [2,358 kB] 2024-04-19T02:57:30.005 INFO:teuthology.orchestra.run.smithi096.stdout:Get:61 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-joblib all 0.14.0-3 [192 kB] 2024-04-19T02:57:30.009 INFO:teuthology.orchestra.run.smithi096.stdout:Get:62 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn all 0.22.2.post1+dfsg-5 [1,773 kB] 2024-04-19T02:57:30.029 INFO:teuthology.orchestra.run.smithi144.stdout:Get:95 http://archive.ubuntu.com/ubuntu focal/universe amd64 xmlstarlet amd64 1.6.1-2build1 [267 kB] 2024-04-19T02:57:30.078 INFO:teuthology.orchestra.run.smithi144.stdout:Get:96 http://archive.ubuntu.com/ubuntu focal/universe amd64 fonts-mathjax all 2.7.4+dfsg-1 [2,208 kB] 2024-04-19T02:57:30.277 INFO:teuthology.orchestra.run.smithi096.stdout:Get:63 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cachetools all 4.0.0-1 [9,820 B] 2024-04-19T02:57:30.277 INFO:teuthology.orchestra.run.smithi096.stdout:Get:64 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1 all 0.4.2-3build1 [46.7 kB] 2024-04-19T02:57:30.308 INFO:teuthology.orchestra.run.smithi144.stdout:Get:97 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 nvme-cli amd64 1.9-1ubuntu0.1 [283 kB] 2024-04-19T02:57:30.319 INFO:teuthology.orchestra.run.smithi144.stdout:Get:98 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-asyncssh-doc all 1.12.2-1 [258 kB] 2024-04-19T02:57:30.328 INFO:teuthology.orchestra.run.smithi144.stdout:Get:99 http://archive.ubuntu.com/ubuntu focal/universe amd64 libjs-mathjax all 2.7.4+dfsg-1 [5,654 kB] 2024-04-19T02:57:30.382 INFO:teuthology.orchestra.run.smithi134.stdout:Get:85 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 python3-rados amd64 18.2.2-1237-g646b8c7d-1focal [387 kB] 2024-04-19T02:57:30.445 INFO:teuthology.orchestra.run.smithi096.stdout:Get:65 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1-modules all 0.2.1-0.2build1 [32.9 kB] 2024-04-19T02:57:30.483 INFO:teuthology.orchestra.run.smithi144.stdout:Get:100 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-natsort-doc all 7.0.1-1 [103 kB] 2024-04-19T02:57:30.485 INFO:teuthology.orchestra.run.smithi144.stdout:Get:101 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webencodings all 0.5.1-1ubuntu1 [11.0 kB] 2024-04-19T02:57:30.485 INFO:teuthology.orchestra.run.smithi144.stdout:Get:102 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-html5lib all 1.0.1-2 [84.3 kB] 2024-04-19T02:57:30.486 INFO:teuthology.orchestra.run.smithi144.stdout:Get:103 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-lxml amd64 4.5.0-1ubuntu0.5 [1,384 kB] 2024-04-19T02:57:30.534 INFO:teuthology.orchestra.run.smithi144.stdout:Get:104 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-04-19T02:57:30.629 INFO:teuthology.orchestra.run.smithi134.stdout:Get:86 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-argparse all 18.2.2-1237-g646b8c7d-1focal [31.9 kB] 2024-04-19T02:57:30.642 INFO:teuthology.orchestra.run.smithi096.stdout:Get:66 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-rsa all 4.0-3 [24.7 kB] 2024-04-19T02:57:30.672 INFO:teuthology.orchestra.run.smithi134.stdout:Get:87 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 python3-cephfs amd64 18.2.2-1237-g646b8c7d-1focal [200 kB] 2024-04-19T02:57:30.690 INFO:teuthology.orchestra.run.smithi096.stdout:Get:67 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-google-auth all 1.5.1-2 [35.6 kB] 2024-04-19T02:57:30.699 INFO:teuthology.orchestra.run.smithi144.stdout:Get:105 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-psutil amd64 5.5.1-1ubuntu4 [141 kB] 2024-04-19T02:57:30.793 INFO:teuthology.orchestra.run.smithi097.stdout:Get:91 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 python3-rgw amd64 18.2.2-1237-g646b8c7d-1focal [113 kB] 2024-04-19T02:57:30.802 INFO:teuthology.orchestra.run.smithi096.stdout:Get:68 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-blinker all 1.4+dfsg1-0.3ubuntu1 [13.2 kB] 2024-04-19T02:57:30.834 INFO:teuthology.orchestra.run.smithi097.stdout:Get:92 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 libradosstriper1 amd64 18.2.2-1237-g646b8c7d-1focal [476 kB] 2024-04-19T02:57:30.865 INFO:teuthology.orchestra.run.smithi096.stdout:Get:69 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-oauthlib all 3.1.0-1ubuntu2 [84.8 kB] 2024-04-19T02:57:30.877 INFO:teuthology.orchestra.run.smithi134.stdout:Get:88 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-common all 18.2.2-1237-g646b8c7d-1focal [62.4 kB] 2024-04-19T02:57:30.890 INFO:teuthology.orchestra.run.smithi134.stdout:Get:89 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 python3-rbd amd64 18.2.2-1237-g646b8c7d-1focal [364 kB] 2024-04-19T02:57:30.980 INFO:teuthology.orchestra.run.smithi097.stdout:Get:93 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 ceph-common amd64 18.2.2-1237-g646b8c7d-1focal [25.1 MB] 2024-04-19T02:57:30.990 INFO:teuthology.orchestra.run.smithi096.stdout:Get:70 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-requests-oauthlib all 1.0.0-1.1build1 [16.8 kB] 2024-04-19T02:57:31.001 INFO:teuthology.orchestra.run.smithi096.stdout:Get:71 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-websocket all 0.53.0-2ubuntu1 [32.3 kB] 2024-04-19T02:57:31.025 INFO:teuthology.orchestra.run.smithi096.stdout:Get:72 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-kubernetes all 7.0.0~a1-2 [271 kB] 2024-04-19T02:57:31.080 INFO:teuthology.orchestra.run.smithi144.stdout:Get:106 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyinotify all 0.9.6-1.2ubuntu1 [24.8 kB] 2024-04-19T02:57:31.090 INFO:teuthology.orchestra.run.smithi144.stdout:Get:107 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplejson amd64 3.16.0-2ubuntu2 [50.8 kB] 2024-04-19T02:57:31.112 INFO:teuthology.orchestra.run.smithi144.stdout:Get:108 http://archive.ubuntu.com/ubuntu focal/universe amd64 qttranslations5-l10n all 5.12.8-0ubuntu1 [1,486 kB] 2024-04-19T02:57:31.173 INFO:teuthology.orchestra.run.smithi134.stdout:Get:90 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 librgw2 amd64 18.2.2-1237-g646b8c7d-1focal [6,591 kB] 2024-04-19T02:57:31.223 INFO:teuthology.orchestra.run.smithi096.stdout:Get:73 http://archive.ubuntu.com/ubuntu focal/universe amd64 libonig5 amd64 6.9.4-1 [142 kB] 2024-04-19T02:57:31.380 INFO:teuthology.orchestra.run.smithi144.stdout:Get:109 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 ceph-volume all 18.2.2-1237-g646b8c7d-1focal [119 kB] 2024-04-19T02:57:31.383 INFO:teuthology.orchestra.run.smithi144.stdout:Get:110 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 libcephfs-dev amd64 18.2.2-1237-g646b8c7d-1focal [37.4 kB] 2024-04-19T02:57:31.384 INFO:teuthology.orchestra.run.smithi144.stdout:Get:111 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 radosgw amd64 18.2.2-1237-g646b8c7d-1focal [13.4 MB] 2024-04-19T02:57:31.498 INFO:teuthology.orchestra.run.smithi096.stdout:Get:74 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libjq1 amd64 1.6-1ubuntu0.20.04.1 [121 kB] 2024-04-19T02:57:31.622 INFO:teuthology.orchestra.run.smithi096.stdout:Get:75 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 jq amd64 1.6-1ubuntu0.20.04.1 [50.2 kB] 2024-04-19T02:57:31.829 INFO:teuthology.orchestra.run.smithi096.stdout:Get:76 http://archive.ubuntu.com/ubuntu focal/main amd64 socat amd64 1.7.3.3-2 [323 kB] 2024-04-19T02:57:32.468 INFO:teuthology.orchestra.run.smithi096.stdout:Get:77 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 python3-rgw amd64 18.2.2-1237-g646b8c7d-1focal [113 kB] 2024-04-19T02:57:32.570 INFO:teuthology.orchestra.run.smithi096.stdout:Get:78 http://archive.ubuntu.com/ubuntu focal/universe amd64 xmlstarlet amd64 1.6.1-2build1 [267 kB] 2024-04-19T02:57:32.676 INFO:teuthology.orchestra.run.smithi096.stdout:Get:79 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 libradosstriper1 amd64 18.2.2-1237-g646b8c7d-1focal [476 kB] 2024-04-19T02:57:32.910 INFO:teuthology.orchestra.run.smithi096.stdout:Get:80 http://archive.ubuntu.com/ubuntu focal/universe amd64 fonts-mathjax all 2.7.4+dfsg-1 [2,208 kB] 2024-04-19T02:57:33.030 INFO:teuthology.orchestra.run.smithi096.stdout:Get:81 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 ceph-common amd64 18.2.2-1237-g646b8c7d-1focal [25.1 MB] 2024-04-19T02:57:33.708 INFO:teuthology.orchestra.run.smithi144.stdout:Get:112 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 rbd-fuse amd64 18.2.2-1237-g646b8c7d-1focal [107 kB] 2024-04-19T02:57:34.349 INFO:teuthology.orchestra.run.smithi144.stdout:Fetched 198 MB in 10s (20.6 MB/s) 2024-04-19T02:57:34.564 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2024-04-19T02:57:34.620 INFO:teuthology.orchestra.run.smithi144.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 141729 files and directories currently installed.) 2024-04-19T02:57:34.624 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../000-liblttng-ust0_2.11.0-1_amd64.deb ... 2024-04-19T02:57:34.706 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking liblttng-ust0:amd64 (2.11.0-1) ... 2024-04-19T02:57:35.091 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-04-19T02:57:35.108 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.5-4ubuntu1_amd64.deb ... 2024-04-19T02:57:35.149 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2024-04-19T02:57:35.528 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-04-19T02:57:35.544 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../002-libpcre2-16-0_10.34-7ubuntu0.1_amd64.deb ... 2024-04-19T02:57:35.586 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2024-04-19T02:57:35.863 INFO:teuthology.orchestra.run.smithi096.stdout:Get:82 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 nvme-cli amd64 1.9-1ubuntu0.1 [283 kB] 2024-04-19T02:57:36.022 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-04-19T02:57:36.042 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../003-libqt5core5a_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2024-04-19T02:57:36.083 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-04-19T02:57:36.356 INFO:teuthology.orchestra.run.smithi096.stdout:Get:83 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-asyncssh-doc all 1.12.2-1 [258 kB] 2024-04-19T02:57:36.601 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-04-19T02:57:36.619 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../004-libqt5dbus5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2024-04-19T02:57:36.637 INFO:teuthology.orchestra.run.smithi096.stdout:Get:84 http://archive.ubuntu.com/ubuntu focal/universe amd64 libjs-mathjax all 2.7.4+dfsg-1 [5,654 kB] 2024-04-19T02:57:36.640 INFO:teuthology.orchestra.run.smithi134.stdout:Get:91 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 python3-rgw amd64 18.2.2-1237-g646b8c7d-1focal [113 kB] 2024-04-19T02:57:36.659 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-04-19T02:57:36.730 INFO:teuthology.orchestra.run.smithi134.stdout:Get:92 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 libradosstriper1 amd64 18.2.2-1237-g646b8c7d-1focal [476 kB] 2024-04-19T02:57:37.029 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-04-19T02:57:37.046 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../005-libqt5network5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2024-04-19T02:57:37.084 INFO:teuthology.orchestra.run.smithi134.stdout:Get:93 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 ceph-common amd64 18.2.2-1237-g646b8c7d-1focal [25.1 MB] 2024-04-19T02:57:37.087 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-04-19T02:57:37.432 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package libthrift-0.13.0. 2024-04-19T02:57:37.449 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../006-libthrift-0.13.0_0.13.0-2build2_amd64.deb ... 2024-04-19T02:57:37.490 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking libthrift-0.13.0 (0.13.0-2build2) ... 2024-04-19T02:57:37.871 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../007-librbd1_18.2.2-1237-g646b8c7d-1focal_amd64.deb ... 2024-04-19T02:57:38.019 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking librbd1 (18.2.2-1237-g646b8c7d-1focal) over (15.2.17-0ubuntu0.20.04.6) ... 2024-04-19T02:57:38.724 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../008-librados2_18.2.2-1237-g646b8c7d-1focal_amd64.deb ... 2024-04-19T02:57:38.823 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking librados2 (18.2.2-1237-g646b8c7d-1focal) over (15.2.17-0ubuntu0.20.04.6) ... 2024-04-19T02:57:39.560 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package libcephfs2. 2024-04-19T02:57:39.579 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../009-libcephfs2_18.2.2-1237-g646b8c7d-1focal_amd64.deb ... 2024-04-19T02:57:39.619 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking libcephfs2 (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T02:57:39.980 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python3-rados. 2024-04-19T02:57:39.995 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../010-python3-rados_18.2.2-1237-g646b8c7d-1focal_amd64.deb ... 2024-04-19T02:57:40.038 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python3-rados (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T02:57:40.382 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-04-19T02:57:40.398 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../011-python3-ceph-argparse_18.2.2-1237-g646b8c7d-1focal_all.deb ... 2024-04-19T02:57:40.432 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python3-ceph-argparse (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T02:57:40.693 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python3-cephfs. 2024-04-19T02:57:40.709 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../012-python3-cephfs_18.2.2-1237-g646b8c7d-1focal_amd64.deb ... 2024-04-19T02:57:40.751 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python3-cephfs (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T02:57:41.104 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python3-ceph-common. 2024-04-19T02:57:41.119 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../013-python3-ceph-common_18.2.2-1237-g646b8c7d-1focal_all.deb ... 2024-04-19T02:57:41.162 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python3-ceph-common (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T02:57:41.506 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python3-prettytable. 2024-04-19T02:57:41.522 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../014-python3-prettytable_0.7.2-5_all.deb ... 2024-04-19T02:57:41.634 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python3-prettytable (0.7.2-5) ... 2024-04-19T02:57:42.001 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python3-rbd. 2024-04-19T02:57:42.020 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../015-python3-rbd_18.2.2-1237-g646b8c7d-1focal_amd64.deb ... 2024-04-19T02:57:42.059 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python3-rbd (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T02:57:42.362 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package liblua5.3-0:amd64. 2024-04-19T02:57:42.380 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../016-liblua5.3-0_5.3.3-1.1ubuntu2_amd64.deb ... 2024-04-19T02:57:42.420 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2024-04-19T02:57:42.823 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package librabbitmq4:amd64. 2024-04-19T02:57:42.839 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../017-librabbitmq4_0.10.0-1_amd64.deb ... 2024-04-19T02:57:42.881 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking librabbitmq4:amd64 (0.10.0-1) ... 2024-04-19T02:57:43.268 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-04-19T02:57:43.285 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../018-librdkafka1_1.2.1-1ubuntu1_amd64.deb ... 2024-04-19T02:57:43.351 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2024-04-19T02:57:43.662 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package librgw2. 2024-04-19T02:57:43.680 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../019-librgw2_18.2.2-1237-g646b8c7d-1focal_amd64.deb ... 2024-04-19T02:57:43.745 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking librgw2 (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T02:57:44.046 INFO:teuthology.orchestra.run.smithi097.stdout:Get:94 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 ceph-base amd64 18.2.2-1237-g646b8c7d-1focal [9,603 kB] 2024-04-19T02:57:44.343 INFO:teuthology.orchestra.run.smithi096.stdout:Get:85 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-natsort-doc all 7.0.1-1 [103 kB] 2024-04-19T02:57:44.567 INFO:teuthology.orchestra.run.smithi096.stdout:Get:86 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webencodings all 0.5.1-1ubuntu1 [11.0 kB] 2024-04-19T02:57:44.574 INFO:teuthology.orchestra.run.smithi096.stdout:Get:87 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-html5lib all 1.0.1-2 [84.3 kB] 2024-04-19T02:57:44.638 INFO:teuthology.orchestra.run.smithi096.stdout:Get:88 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-lxml amd64 4.5.0-1ubuntu0.5 [1,384 kB] 2024-04-19T02:57:44.648 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python3-rgw. 2024-04-19T02:57:44.663 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../020-python3-rgw_18.2.2-1237-g646b8c7d-1focal_amd64.deb ... 2024-04-19T02:57:44.706 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python3-rgw (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T02:57:45.084 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package liboath0. 2024-04-19T02:57:45.100 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../021-liboath0_2.6.1-1.3_amd64.deb ... 2024-04-19T02:57:45.150 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking liboath0 (2.6.1-1.3) ... 2024-04-19T02:57:45.487 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package libradosstriper1. 2024-04-19T02:57:45.502 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../022-libradosstriper1_18.2.2-1237-g646b8c7d-1focal_amd64.deb ... 2024-04-19T02:57:45.545 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking libradosstriper1 (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T02:57:46.048 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package ceph-common. 2024-04-19T02:57:46.067 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../023-ceph-common_18.2.2-1237-g646b8c7d-1focal_amd64.deb ... 2024-04-19T02:57:46.106 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking ceph-common (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T02:57:46.552 INFO:teuthology.orchestra.run.smithi096.stdout:Get:89 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-04-19T02:57:46.795 INFO:teuthology.orchestra.run.smithi096.stdout:Get:90 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-psutil amd64 5.5.1-1ubuntu4 [141 kB] 2024-04-19T02:57:47.222 INFO:teuthology.orchestra.run.smithi096.stdout:Get:91 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyinotify all 0.9.6-1.2ubuntu1 [24.8 kB] 2024-04-19T02:57:47.249 INFO:teuthology.orchestra.run.smithi096.stdout:Get:92 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplejson amd64 3.16.0-2ubuntu2 [50.8 kB] 2024-04-19T02:57:47.251 INFO:teuthology.orchestra.run.smithi096.stdout:Get:93 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 ceph-base amd64 18.2.2-1237-g646b8c7d-1focal [9,603 kB] 2024-04-19T02:57:47.267 INFO:teuthology.orchestra.run.smithi096.stdout:Get:94 http://archive.ubuntu.com/ubuntu focal/universe amd64 qttranslations5-l10n all 5.12.8-0ubuntu1 [1,486 kB] 2024-04-19T02:57:48.612 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package ceph-base. 2024-04-19T02:57:48.629 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../024-ceph-base_18.2.2-1237-g646b8c7d-1focal_amd64.deb ... 2024-04-19T02:57:48.680 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking ceph-base (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T02:57:49.950 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python3-cherrypy3. 2024-04-19T02:57:49.965 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../025-python3-cherrypy3_8.9.1-6_all.deb ... 2024-04-19T02:57:49.999 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python3-cherrypy3 (8.9.1-6) ... 2024-04-19T02:57:50.361 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python3-natsort. 2024-04-19T02:57:50.377 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../026-python3-natsort_7.0.1-1_all.deb ... 2024-04-19T02:57:50.419 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python3-natsort (7.0.1-1) ... 2024-04-19T02:57:50.714 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python3-logutils. 2024-04-19T02:57:50.732 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../027-python3-logutils_0.3.3-7_all.deb ... 2024-04-19T02:57:50.764 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python3-logutils (0.3.3-7) ... 2024-04-19T02:57:51.050 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python3-markupsafe. 2024-04-19T02:57:51.066 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../028-python3-markupsafe_1.1.0-1build2_amd64.deb ... 2024-04-19T02:57:51.117 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python3-markupsafe (1.1.0-1build2) ... 2024-04-19T02:57:51.436 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python3-mako. 2024-04-19T02:57:51.455 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../029-python3-mako_1.1.0+ds1-1ubuntu2.1_all.deb ... 2024-04-19T02:57:51.494 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2024-04-19T02:57:51.856 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python3-simplegeneric. 2024-04-19T02:57:51.872 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../030-python3-simplegeneric_0.8.1-3_all.deb ... 2024-04-19T02:57:51.914 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-04-19T02:57:52.292 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python3-singledispatch. 2024-04-19T02:57:52.309 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../031-python3-singledispatch_3.4.0.3-2build1_all.deb ... 2024-04-19T02:57:52.350 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python3-singledispatch (3.4.0.3-2build1) ... 2024-04-19T02:57:52.678 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python3-webob. 2024-04-19T02:57:52.694 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../032-python3-webob_1%3a1.8.5-2_all.deb ... 2024-04-19T02:57:52.736 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python3-webob (1:1.8.5-2) ... 2024-04-19T02:57:53.106 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python3-soupsieve. 2024-04-19T02:57:53.122 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../033-python3-soupsieve_1.9.5+dfsg-1_all.deb ... 2024-04-19T02:57:53.156 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python3-soupsieve (1.9.5+dfsg-1) ... 2024-04-19T02:57:53.486 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python3-bs4. 2024-04-19T02:57:53.503 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../034-python3-bs4_4.8.2-1_all.deb ... 2024-04-19T02:57:53.542 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python3-bs4 (4.8.2-1) ... 2024-04-19T02:57:53.591 INFO:teuthology.orchestra.run.smithi097.stdout:Get:95 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-modules-core all 18.2.2-1237-g646b8c7d-1focal [238 kB] 2024-04-19T02:57:53.785 INFO:teuthology.orchestra.run.smithi097.stdout:Get:96 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 libsqlite3-mod-ceph amd64 18.2.2-1237-g646b8c7d-1focal [147 kB] 2024-04-19T02:57:53.881 INFO:teuthology.orchestra.run.smithi097.stdout:Get:97 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr amd64 18.2.2-1237-g646b8c7d-1focal [1,572 kB] 2024-04-19T02:57:53.928 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python3-waitress. 2024-04-19T02:57:53.945 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../035-python3-waitress_1.4.1-1ubuntu0.1_all.deb ... 2024-04-19T02:57:53.990 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python3-waitress (1.4.1-1ubuntu0.1) ... 2024-04-19T02:57:54.340 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python3-tempita. 2024-04-19T02:57:54.356 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../036-python3-tempita_0.5.2-6_all.deb ... 2024-04-19T02:57:54.399 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python3-tempita (0.5.2-6) ... 2024-04-19T02:57:54.734 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python3-paste. 2024-04-19T02:57:54.753 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../037-python3-paste_3.4.0+dfsg1-1_all.deb ... 2024-04-19T02:57:54.793 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python3-paste (3.4.0+dfsg1-1) ... 2024-04-19T02:57:54.834 INFO:teuthology.orchestra.run.smithi096.stdout:Get:95 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-modules-core all 18.2.2-1237-g646b8c7d-1focal [238 kB] 2024-04-19T02:57:54.977 INFO:teuthology.orchestra.run.smithi096.stdout:Get:96 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 libsqlite3-mod-ceph amd64 18.2.2-1237-g646b8c7d-1focal [147 kB] 2024-04-19T02:57:54.988 INFO:teuthology.orchestra.run.smithi097.stdout:Get:98 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 ceph-mon amd64 18.2.2-1237-g646b8c7d-1focal [6,636 kB] 2024-04-19T02:57:55.068 INFO:teuthology.orchestra.run.smithi096.stdout:Get:97 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr amd64 18.2.2-1237-g646b8c7d-1focal [1,572 kB] 2024-04-19T02:57:55.129 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-04-19T02:57:55.148 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../038-python-pastedeploy-tpl_2.1.0-1_all.deb ... 2024-04-19T02:57:55.187 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python-pastedeploy-tpl (2.1.0-1) ... 2024-04-19T02:57:55.515 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python3-pastedeploy. 2024-04-19T02:57:55.533 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../039-python3-pastedeploy_2.1.0-1_all.deb ... 2024-04-19T02:57:55.574 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python3-pastedeploy (2.1.0-1) ... 2024-04-19T02:57:55.918 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python3-webtest. 2024-04-19T02:57:55.934 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../040-python3-webtest_2.0.32-2_all.deb ... 2024-04-19T02:57:55.997 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python3-webtest (2.0.32-2) ... 2024-04-19T02:57:56.079 INFO:teuthology.orchestra.run.smithi096.stdout:Get:98 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 ceph-mon amd64 18.2.2-1237-g646b8c7d-1focal [6,636 kB] 2024-04-19T02:57:56.262 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python3-pecan. 2024-04-19T02:57:56.281 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../041-python3-pecan_1.3.3-3ubuntu1_all.deb ... 2024-04-19T02:57:56.312 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python3-pecan (1.3.3-3ubuntu1) ... 2024-04-19T02:57:56.659 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python3-werkzeug. 2024-04-19T02:57:56.675 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../042-python3-werkzeug_0.16.1+dfsg1-2ubuntu0.1_all.deb ... 2024-04-19T02:57:56.725 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2024-04-19T02:57:57.045 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-04-19T02:57:57.062 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../043-ceph-mgr-modules-core_18.2.2-1237-g646b8c7d-1focal_all.deb ... 2024-04-19T02:57:57.103 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking ceph-mgr-modules-core (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T02:57:57.594 INFO:teuthology.orchestra.run.smithi134.stdout:Get:94 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 ceph-base amd64 18.2.2-1237-g646b8c7d-1focal [9,603 kB] 2024-04-19T02:57:57.750 INFO:teuthology.orchestra.run.smithi097.stdout:Get:99 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 ceph-osd amd64 18.2.2-1237-g646b8c7d-1focal [24.5 MB] 2024-04-19T02:57:58.291 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-04-19T02:57:58.308 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../044-libsqlite3-mod-ceph_18.2.2-1237-g646b8c7d-1focal_amd64.deb ... 2024-04-19T02:57:58.374 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking libsqlite3-mod-ceph (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T02:57:58.727 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python3-cryptography. 2024-04-19T02:57:58.747 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../045-python3-cryptography_2.8-3ubuntu0.3_amd64.deb ... 2024-04-19T02:57:58.794 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python3-cryptography (2.8-3ubuntu0.3) ... 2024-04-19T02:57:58.889 INFO:teuthology.orchestra.run.smithi096.stdout:Get:99 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 ceph-osd amd64 18.2.2-1237-g646b8c7d-1focal [24.5 MB] 2024-04-19T02:57:59.173 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python3-openssl. 2024-04-19T02:57:59.192 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../046-python3-openssl_19.0.0-1build1_all.deb ... 2024-04-19T02:57:59.231 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python3-openssl (19.0.0-1build1) ... 2024-04-19T02:57:59.575 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package ceph-mgr. 2024-04-19T02:57:59.598 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../047-ceph-mgr_18.2.2-1237-g646b8c7d-1focal_amd64.deb ... 2024-04-19T02:57:59.634 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking ceph-mgr (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T02:58:00.146 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package ceph-mon. 2024-04-19T02:58:00.164 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../048-ceph-mon_18.2.2-1237-g646b8c7d-1focal_amd64.deb ... 2024-04-19T02:58:00.203 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking ceph-mon (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T02:58:01.132 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package ceph-osd. 2024-04-19T02:58:01.149 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../049-ceph-osd_18.2.2-1237-g646b8c7d-1focal_amd64.deb ... 2024-04-19T02:58:01.190 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking ceph-osd (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T02:58:03.385 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package ceph. 2024-04-19T02:58:03.401 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../050-ceph_18.2.2-1237-g646b8c7d-1focal_amd64.deb ... 2024-04-19T02:58:03.468 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking ceph (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T02:58:03.813 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package ceph-fuse. 2024-04-19T02:58:03.829 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../051-ceph-fuse_18.2.2-1237-g646b8c7d-1focal_amd64.deb ... 2024-04-19T02:58:03.887 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking ceph-fuse (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T02:58:04.148 INFO:teuthology.orchestra.run.smithi096.stdout:Get:100 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 ceph amd64 18.2.2-1237-g646b8c7d-1focal [13.7 kB] 2024-04-19T02:58:04.149 INFO:teuthology.orchestra.run.smithi096.stdout:Get:101 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 ceph-fuse amd64 18.2.2-1237-g646b8c7d-1focal [853 kB] 2024-04-19T02:58:04.256 INFO:teuthology.orchestra.run.smithi096.stdout:Get:102 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 ceph-mds amd64 18.2.2-1237-g646b8c7d-1focal [2,290 kB] 2024-04-19T02:58:04.332 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package ceph-mds. 2024-04-19T02:58:04.349 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../052-ceph-mds_18.2.2-1237-g646b8c7d-1focal_amd64.deb ... 2024-04-19T02:58:04.390 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking ceph-mds (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T02:58:04.647 INFO:teuthology.orchestra.run.smithi096.stdout:Get:103 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 cephadm amd64 18.2.2-1237-g646b8c7d-1focal [237 kB] 2024-04-19T02:58:04.688 INFO:teuthology.orchestra.run.smithi096.stdout:Get:104 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-cephadm all 18.2.2-1237-g646b8c7d-1focal [142 kB] 2024-04-19T02:58:04.713 INFO:teuthology.orchestra.run.smithi096.stdout:Get:105 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-dashboard all 18.2.2-1237-g646b8c7d-1focal [7,011 kB] 2024-04-19T02:58:04.943 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package cephadm. 2024-04-19T02:58:04.959 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../053-cephadm_18.2.2-1237-g646b8c7d-1focal_amd64.deb ... 2024-04-19T02:58:05.035 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking cephadm (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T02:58:05.346 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python3-asyncssh. 2024-04-19T02:58:05.362 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../054-python3-asyncssh_1.12.2-1_all.deb ... 2024-04-19T02:58:05.413 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python3-asyncssh (1.12.2-1) ... 2024-04-19T02:58:05.782 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python3-jinja2. 2024-04-19T02:58:05.800 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../055-python3-jinja2_2.10.1-2ubuntu0.2_all.deb ... 2024-04-19T02:58:05.840 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python3-jinja2 (2.10.1-2ubuntu0.2) ... 2024-04-19T02:58:05.992 INFO:teuthology.orchestra.run.smithi096.stdout:Get:106 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-local all 18.2.2-1237-g646b8c7d-1focal [7,891 kB] 2024-04-19T02:58:06.168 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-04-19T02:58:06.187 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../056-ceph-mgr-cephadm_18.2.2-1237-g646b8c7d-1focal_all.deb ... 2024-04-19T02:58:06.226 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking ceph-mgr-cephadm (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T02:58:06.588 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python3-bcrypt. 2024-04-19T02:58:06.605 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../057-python3-bcrypt_3.1.7-2ubuntu1_amd64.deb ... 2024-04-19T02:58:06.646 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python3-bcrypt (3.1.7-2ubuntu1) ... 2024-04-19T02:58:06.957 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python3-jwt. 2024-04-19T02:58:06.975 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../058-python3-jwt_1.7.1-2ubuntu2.1_all.deb ... 2024-04-19T02:58:07.015 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python3-jwt (1.7.1-2ubuntu2.1) ... 2024-04-19T02:58:07.352 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python3-attr. 2024-04-19T02:58:07.369 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../059-python3-attr_19.3.0-2_all.deb ... 2024-04-19T02:58:07.373 INFO:teuthology.orchestra.run.smithi134.stdout:Get:95 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-modules-core all 18.2.2-1237-g646b8c7d-1focal [238 kB] 2024-04-19T02:58:07.410 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python3-attr (19.3.0-2) ... 2024-04-19T02:58:07.483 INFO:teuthology.orchestra.run.smithi134.stdout:Get:96 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 libsqlite3-mod-ceph amd64 18.2.2-1237-g646b8c7d-1focal [147 kB] 2024-04-19T02:58:07.538 INFO:teuthology.orchestra.run.smithi134.stdout:Get:97 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr amd64 18.2.2-1237-g646b8c7d-1focal [1,572 kB] 2024-04-19T02:58:07.710 INFO:teuthology.orchestra.run.smithi096.stdout:Get:107 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-k8sevents all 18.2.2-1237-g646b8c7d-1focal [13.8 kB] 2024-04-19T02:58:07.710 INFO:teuthology.orchestra.run.smithi096.stdout:Get:108 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 ceph-test amd64 18.2.2-1237-g646b8c7d-1focal [46.7 MB] 2024-04-19T02:58:07.771 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python3-pluggy. 2024-04-19T02:58:07.787 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../060-python3-pluggy_0.13.0-2_all.deb ... 2024-04-19T02:58:07.829 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python3-pluggy (0.13.0-2) ... 2024-04-19T02:58:08.191 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python3-py. 2024-04-19T02:58:08.208 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../061-python3-py_1.8.1-1ubuntu0.1_all.deb ... 2024-04-19T02:58:08.240 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python3-py (1.8.1-1ubuntu0.1) ... 2024-04-19T02:58:08.321 INFO:teuthology.orchestra.run.smithi134.stdout:Get:98 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 ceph-mon amd64 18.2.2-1237-g646b8c7d-1focal [6,636 kB] 2024-04-19T02:58:08.594 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python3-atomicwrites. 2024-04-19T02:58:08.610 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../062-python3-atomicwrites_1.1.5-2build1_all.deb ... 2024-04-19T02:58:08.652 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python3-atomicwrites (1.1.5-2build1) ... 2024-04-19T02:58:08.988 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python3-packaging. 2024-04-19T02:58:09.005 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../063-python3-packaging_20.3-1_all.deb ... 2024-04-19T02:58:09.046 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python3-packaging (20.3-1) ... 2024-04-19T02:58:09.383 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python3-wcwidth. 2024-04-19T02:58:09.398 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../064-python3-wcwidth_0.1.8+dfsg1-3_all.deb ... 2024-04-19T02:58:09.440 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python3-wcwidth (0.1.8+dfsg1-3) ... 2024-04-19T02:58:09.760 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python3-pytest. 2024-04-19T02:58:09.779 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../065-python3-pytest_4.6.9-1_all.deb ... 2024-04-19T02:58:09.817 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python3-pytest (4.6.9-1) ... 2024-04-19T02:58:10.203 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python3-repoze.lru. 2024-04-19T02:58:10.220 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../066-python3-repoze.lru_0.7-2_all.deb ... 2024-04-19T02:58:10.261 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-04-19T02:58:10.530 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package libjs-underscore. 2024-04-19T02:58:10.548 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../067-libjs-underscore_1.9.1~dfsg-1ubuntu0.20.04.1_all.deb ... 2024-04-19T02:58:10.588 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2024-04-19T02:58:10.865 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package libjs-sphinxdoc. 2024-04-19T02:58:10.873 INFO:teuthology.orchestra.run.smithi097.stdout:Get:100 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 ceph amd64 18.2.2-1237-g646b8c7d-1focal [13.7 kB] 2024-04-19T02:58:10.873 INFO:teuthology.orchestra.run.smithi097.stdout:Get:101 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 ceph-fuse amd64 18.2.2-1237-g646b8c7d-1focal [853 kB] 2024-04-19T02:58:10.883 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../068-libjs-sphinxdoc_1.8.5-7ubuntu3_all.deb ... 2024-04-19T02:58:10.900 INFO:teuthology.orchestra.run.smithi134.stdout:Get:99 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 ceph-osd amd64 18.2.2-1237-g646b8c7d-1focal [24.5 MB] 2024-04-19T02:58:10.923 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2024-04-19T02:58:10.947 INFO:teuthology.orchestra.run.smithi097.stdout:Get:102 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 ceph-mds amd64 18.2.2-1237-g646b8c7d-1focal [2,290 kB] 2024-04-19T02:58:11.268 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python3-routes. 2024-04-19T02:58:11.284 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../069-python3-routes_2.4.1-2_all.deb ... 2024-04-19T02:58:11.325 INFO:teuthology.orchestra.run.smithi097.stdout:Get:103 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 cephadm amd64 18.2.2-1237-g646b8c7d-1focal [237 kB] 2024-04-19T02:58:11.334 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python3-routes (2.4.1-2) ... 2024-04-19T02:58:11.344 INFO:teuthology.orchestra.run.smithi097.stdout:Get:104 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-cephadm all 18.2.2-1237-g646b8c7d-1focal [142 kB] 2024-04-19T02:58:11.381 INFO:teuthology.orchestra.run.smithi097.stdout:Get:105 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-dashboard all 18.2.2-1237-g646b8c7d-1focal [7,011 kB] 2024-04-19T02:58:11.688 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-04-19T02:58:11.705 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../070-ceph-mgr-dashboard_18.2.2-1237-g646b8c7d-1focal_all.deb ... 2024-04-19T02:58:11.746 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking ceph-mgr-dashboard (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T02:58:12.372 INFO:teuthology.orchestra.run.smithi097.stdout:Get:106 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-local all 18.2.2-1237-g646b8c7d-1focal [7,891 kB] 2024-04-19T02:58:13.235 INFO:teuthology.orchestra.run.smithi097.stdout:Get:107 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-k8sevents all 18.2.2-1237-g646b8c7d-1focal [13.8 kB] 2024-04-19T02:58:13.236 INFO:teuthology.orchestra.run.smithi097.stdout:Get:108 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 ceph-test amd64 18.2.2-1237-g646b8c7d-1focal [46.7 MB] 2024-04-19T02:58:13.246 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python3-decorator. 2024-04-19T02:58:13.262 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../071-python3-decorator_4.4.2-0ubuntu1_all.deb ... 2024-04-19T02:58:13.604 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python3-decorator (4.4.2-0ubuntu1) ... 2024-04-19T02:58:13.915 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package liblbfgsb0:amd64. 2024-04-19T02:58:13.931 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../072-liblbfgsb0_3.0+dfsg.3-7build1_amd64.deb ... 2024-04-19T02:58:13.964 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2024-04-19T02:58:14.313 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python3-scipy. 2024-04-19T02:58:14.330 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../073-python3-scipy_1.3.3-3build1_amd64.deb ... 2024-04-19T02:58:14.371 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python3-scipy (1.3.3-3build1) ... 2024-04-19T02:58:15.729 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python3-sklearn-lib. 2024-04-19T02:58:15.748 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../074-python3-sklearn-lib_0.22.2.post1+dfsg-5_amd64.deb ... 2024-04-19T02:58:15.812 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2024-04-19T02:58:16.383 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python3-joblib. 2024-04-19T02:58:16.401 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../075-python3-joblib_0.14.0-3_all.deb ... 2024-04-19T02:58:16.440 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python3-joblib (0.14.0-3) ... 2024-04-19T02:58:16.836 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python3-sklearn. 2024-04-19T02:58:16.852 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../076-python3-sklearn_0.22.2.post1+dfsg-5_all.deb ... 2024-04-19T02:58:16.894 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python3-sklearn (0.22.2.post1+dfsg-5) ... 2024-04-19T02:58:17.619 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-04-19T02:58:17.637 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../077-ceph-mgr-diskprediction-local_18.2.2-1237-g646b8c7d-1focal_all.deb ... 2024-04-19T02:58:17.677 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking ceph-mgr-diskprediction-local (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T02:58:17.962 INFO:teuthology.orchestra.run.smithi096.stdout:Get:109 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 ceph-volume all 18.2.2-1237-g646b8c7d-1focal [119 kB] 2024-04-19T02:58:17.964 INFO:teuthology.orchestra.run.smithi096.stdout:Get:110 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 libcephfs-dev amd64 18.2.2-1237-g646b8c7d-1focal [37.4 kB] 2024-04-19T02:58:17.965 INFO:teuthology.orchestra.run.smithi096.stdout:Get:111 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 radosgw amd64 18.2.2-1237-g646b8c7d-1focal [13.4 MB] 2024-04-19T02:58:17.967 INFO:teuthology.orchestra.run.smithi097.stdout:Get:109 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 ceph-volume all 18.2.2-1237-g646b8c7d-1focal [119 kB] 2024-04-19T02:58:17.969 INFO:teuthology.orchestra.run.smithi097.stdout:Get:110 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 libcephfs-dev amd64 18.2.2-1237-g646b8c7d-1focal [37.4 kB] 2024-04-19T02:58:17.971 INFO:teuthology.orchestra.run.smithi097.stdout:Get:111 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 radosgw amd64 18.2.2-1237-g646b8c7d-1focal [13.4 MB] 2024-04-19T02:58:18.806 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python3-cachetools. 2024-04-19T02:58:18.822 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../078-python3-cachetools_4.0.0-1_all.deb ... 2024-04-19T02:58:18.874 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python3-cachetools (4.0.0-1) ... 2024-04-19T02:58:18.931 INFO:teuthology.orchestra.run.smithi097.stdout:Get:112 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 rbd-fuse amd64 18.2.2-1237-g646b8c7d-1focal [107 kB] 2024-04-19T02:58:19.125 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python3-pyasn1. 2024-04-19T02:58:19.142 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../079-python3-pyasn1_0.4.2-3build1_all.deb ... 2024-04-19T02:58:19.175 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python3-pyasn1 (0.4.2-3build1) ... 2024-04-19T02:58:19.520 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-04-19T02:58:19.539 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../080-python3-pyasn1-modules_0.2.1-0.2build1_all.deb ... 2024-04-19T02:58:19.568 INFO:teuthology.orchestra.run.smithi097.stdout:Fetched 198 MB in 55s (3,622 kB/s) 2024-04-19T02:58:19.577 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2build1) ... 2024-04-19T02:58:19.640 INFO:teuthology.orchestra.run.smithi096.stdout:Get:112 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 rbd-fuse amd64 18.2.2-1237-g646b8c7d-1focal [107 kB] 2024-04-19T02:58:19.750 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2024-04-19T02:58:19.807 INFO:teuthology.orchestra.run.smithi097.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 141729 files and directories currently installed.) 2024-04-19T02:58:19.811 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../000-liblttng-ust0_2.11.0-1_amd64.deb ... 2024-04-19T02:58:19.907 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking liblttng-ust0:amd64 (2.11.0-1) ... 2024-04-19T02:58:19.983 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python3-rsa. 2024-04-19T02:58:20.004 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../081-python3-rsa_4.0-3_all.deb ... 2024-04-19T02:58:20.058 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python3-rsa (4.0-3) ... 2024-04-19T02:58:20.290 INFO:teuthology.orchestra.run.smithi096.stdout:Fetched 198 MB in 55s (3,581 kB/s) 2024-04-19T02:58:20.336 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-04-19T02:58:20.354 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.5-4ubuntu1_amd64.deb ... 2024-04-19T02:58:20.370 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python3-google-auth. 2024-04-19T02:58:20.389 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../082-python3-google-auth_1.5.1-2_all.deb ... 2024-04-19T02:58:20.394 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2024-04-19T02:58:20.453 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python3-google-auth (1.5.1-2) ... 2024-04-19T02:58:20.489 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2024-04-19T02:58:20.549 INFO:teuthology.orchestra.run.smithi096.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 141729 files and directories currently installed.) 2024-04-19T02:58:20.553 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../000-liblttng-ust0_2.11.0-1_amd64.deb ... 2024-04-19T02:58:20.655 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking liblttng-ust0:amd64 (2.11.0-1) ... 2024-04-19T02:58:20.747 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-04-19T02:58:20.757 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python3-blinker. 2024-04-19T02:58:20.764 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../002-libpcre2-16-0_10.34-7ubuntu0.1_amd64.deb ... 2024-04-19T02:58:20.776 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../083-python3-blinker_1.4+dfsg1-0.3ubuntu1_all.deb ... 2024-04-19T02:58:20.797 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2024-04-19T02:58:20.840 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2024-04-19T02:58:21.008 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-04-19T02:58:21.025 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.5-4ubuntu1_amd64.deb ... 2024-04-19T02:58:21.058 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2024-04-19T02:58:21.144 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python3-oauthlib. 2024-04-19T02:58:21.161 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../084-python3-oauthlib_3.1.0-1ubuntu2_all.deb ... 2024-04-19T02:58:21.227 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python3-oauthlib (3.1.0-1ubuntu2) ... 2024-04-19T02:58:21.285 INFO:teuthology.orchestra.run.smithi134.stdout:Get:100 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 ceph amd64 18.2.2-1237-g646b8c7d-1focal [13.7 kB] 2024-04-19T02:58:21.286 INFO:teuthology.orchestra.run.smithi134.stdout:Get:101 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 ceph-fuse amd64 18.2.2-1237-g646b8c7d-1focal [853 kB] 2024-04-19T02:58:21.309 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-04-19T02:58:21.324 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../003-libqt5core5a_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2024-04-19T02:58:21.378 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-04-19T02:58:21.378 INFO:teuthology.orchestra.run.smithi134.stdout:Get:102 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 ceph-mds amd64 18.2.2-1237-g646b8c7d-1focal [2,290 kB] 2024-04-19T02:58:21.428 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-04-19T02:58:21.444 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../002-libpcre2-16-0_10.34-7ubuntu0.1_amd64.deb ... 2024-04-19T02:58:21.487 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2024-04-19T02:58:21.607 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-04-19T02:58:21.628 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../085-python3-requests-oauthlib_1.0.0-1.1build1_all.deb ... 2024-04-19T02:58:21.665 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python3-requests-oauthlib (1.0.0-1.1build1) ... 2024-04-19T02:58:21.819 INFO:teuthology.orchestra.run.smithi134.stdout:Get:103 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 cephadm amd64 18.2.2-1237-g646b8c7d-1focal [237 kB] 2024-04-19T02:58:21.872 INFO:teuthology.orchestra.run.smithi134.stdout:Get:104 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-cephadm all 18.2.2-1237-g646b8c7d-1focal [142 kB] 2024-04-19T02:58:21.889 INFO:teuthology.orchestra.run.smithi134.stdout:Get:105 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-dashboard all 18.2.2-1237-g646b8c7d-1focal [7,011 kB] 2024-04-19T02:58:21.929 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-04-19T02:58:21.949 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../004-libqt5dbus5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2024-04-19T02:58:21.985 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python3-websocket. 2024-04-19T02:58:21.987 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-04-19T02:58:22.002 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../086-python3-websocket_0.53.0-2ubuntu1_all.deb ... 2024-04-19T02:58:22.007 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-04-19T02:58:22.027 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../003-libqt5core5a_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2024-04-19T02:58:22.043 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python3-websocket (0.53.0-2ubuntu1) ... 2024-04-19T02:58:22.075 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-04-19T02:58:22.363 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python3-kubernetes. 2024-04-19T02:58:22.379 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../087-python3-kubernetes_7.0.0~a1-2_all.deb ... 2024-04-19T02:58:22.391 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-04-19T02:58:22.407 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../005-libqt5network5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2024-04-19T02:58:22.421 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python3-kubernetes (7.0.0~a1-2) ... 2024-04-19T02:58:22.449 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-04-19T02:58:22.543 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-04-19T02:58:22.562 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../004-libqt5dbus5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2024-04-19T02:58:22.601 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-04-19T02:58:22.885 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libthrift-0.13.0. 2024-04-19T02:58:22.902 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../006-libthrift-0.13.0_0.13.0-2build2_amd64.deb ... 2024-04-19T02:58:22.944 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libthrift-0.13.0 (0.13.0-2build2) ... 2024-04-19T02:58:22.997 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-04-19T02:58:23.009 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-04-19T02:58:23.016 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../005-libqt5network5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2024-04-19T02:58:23.026 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../088-ceph-mgr-k8sevents_18.2.2-1237-g646b8c7d-1focal_all.deb ... 2024-04-19T02:58:23.067 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking ceph-mgr-k8sevents (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T02:58:23.080 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-04-19T02:58:23.162 INFO:teuthology.orchestra.run.smithi134.stdout:Get:106 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-local all 18.2.2-1237-g646b8c7d-1focal [7,891 kB] 2024-04-19T02:58:23.338 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../007-librbd1_18.2.2-1237-g646b8c7d-1focal_amd64.deb ... 2024-04-19T02:58:23.420 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package libonig5:amd64. 2024-04-19T02:58:23.439 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking librbd1 (18.2.2-1237-g646b8c7d-1focal) over (15.2.17-0ubuntu0.20.04.6) ... 2024-04-19T02:58:23.440 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../089-libonig5_6.9.4-1_amd64.deb ... 2024-04-19T02:58:23.474 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package libthrift-0.13.0. 2024-04-19T02:58:23.493 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../006-libthrift-0.13.0_0.13.0-2build2_amd64.deb ... 2024-04-19T02:58:23.503 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking libonig5:amd64 (6.9.4-1) ... 2024-04-19T02:58:23.533 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking libthrift-0.13.0 (0.13.0-2build2) ... 2024-04-19T02:58:23.888 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../007-librbd1_18.2.2-1237-g646b8c7d-1focal_amd64.deb ... 2024-04-19T02:58:23.890 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package libjq1:amd64. 2024-04-19T02:58:23.909 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../090-libjq1_1.6-1ubuntu0.20.04.1_amd64.deb ... 2024-04-19T02:58:23.948 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2024-04-19T02:58:24.012 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking librbd1 (18.2.2-1237-g646b8c7d-1focal) over (15.2.17-0ubuntu0.20.04.6) ... 2024-04-19T02:58:24.167 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../008-librados2_18.2.2-1237-g646b8c7d-1focal_amd64.deb ... 2024-04-19T02:58:24.217 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package jq. 2024-04-19T02:58:24.234 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../091-jq_1.6-1ubuntu0.20.04.1_amd64.deb ... 2024-04-19T02:58:24.292 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking jq (1.6-1ubuntu0.20.04.1) ... 2024-04-19T02:58:24.310 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking librados2 (18.2.2-1237-g646b8c7d-1focal) over (15.2.17-0ubuntu0.20.04.6) ... 2024-04-19T02:58:24.373 INFO:teuthology.orchestra.run.smithi134.stdout:Get:107 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-k8sevents all 18.2.2-1237-g646b8c7d-1focal [13.8 kB] 2024-04-19T02:58:24.374 INFO:teuthology.orchestra.run.smithi134.stdout:Get:108 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 ceph-test amd64 18.2.2-1237-g646b8c7d-1focal [46.7 MB] 2024-04-19T02:58:24.545 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package socat. 2024-04-19T02:58:24.562 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../092-socat_1.7.3.3-2_amd64.deb ... 2024-04-19T02:58:24.603 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking socat (1.7.3.3-2) ... 2024-04-19T02:58:24.733 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../008-librados2_18.2.2-1237-g646b8c7d-1focal_amd64.deb ... 2024-04-19T02:58:24.883 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking librados2 (18.2.2-1237-g646b8c7d-1focal) over (15.2.17-0ubuntu0.20.04.6) ... 2024-04-19T02:58:24.948 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package xmlstarlet. 2024-04-19T02:58:24.965 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../093-xmlstarlet_1.6.1-2build1_amd64.deb ... 2024-04-19T02:58:25.040 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking xmlstarlet (1.6.1-2build1) ... 2024-04-19T02:58:25.080 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libcephfs2. 2024-04-19T02:58:25.099 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../009-libcephfs2_18.2.2-1237-g646b8c7d-1focal_amd64.deb ... 2024-04-19T02:58:25.172 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libcephfs2 (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T02:58:25.369 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package ceph-test. 2024-04-19T02:58:25.386 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../094-ceph-test_18.2.2-1237-g646b8c7d-1focal_amd64.deb ... 2024-04-19T02:58:25.452 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking ceph-test (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T02:58:25.500 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-rados. 2024-04-19T02:58:25.518 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../010-python3-rados_18.2.2-1237-g646b8c7d-1focal_amd64.deb ... 2024-04-19T02:58:25.549 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-rados (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T02:58:25.662 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package libcephfs2. 2024-04-19T02:58:25.680 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../009-libcephfs2_18.2.2-1237-g646b8c7d-1focal_amd64.deb ... 2024-04-19T02:58:25.720 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking libcephfs2 (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T02:58:25.936 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-04-19T02:58:25.952 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../011-python3-ceph-argparse_18.2.2-1237-g646b8c7d-1focal_all.deb ... 2024-04-19T02:58:25.994 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-ceph-argparse (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T02:58:26.073 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-rados. 2024-04-19T02:58:26.089 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../010-python3-rados_18.2.2-1237-g646b8c7d-1focal_amd64.deb ... 2024-04-19T02:58:26.131 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-rados (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T02:58:26.313 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-cephfs. 2024-04-19T02:58:26.332 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../012-python3-cephfs_18.2.2-1237-g646b8c7d-1focal_amd64.deb ... 2024-04-19T02:58:26.371 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-cephfs (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T02:58:26.501 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-04-19T02:58:26.520 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../011-python3-ceph-argparse_18.2.2-1237-g646b8c7d-1focal_all.deb ... 2024-04-19T02:58:26.559 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-ceph-argparse (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T02:58:26.758 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-ceph-common. 2024-04-19T02:58:26.774 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../013-python3-ceph-common_18.2.2-1237-g646b8c7d-1focal_all.deb ... 2024-04-19T02:58:26.807 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-ceph-common (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T02:58:26.837 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-cephfs. 2024-04-19T02:58:26.856 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../012-python3-cephfs_18.2.2-1237-g646b8c7d-1focal_amd64.deb ... 2024-04-19T02:58:26.895 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-cephfs (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T02:58:27.136 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-prettytable. 2024-04-19T02:58:27.154 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../014-python3-prettytable_0.7.2-5_all.deb ... 2024-04-19T02:58:27.219 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-prettytable (0.7.2-5) ... 2024-04-19T02:58:27.273 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-ceph-common. 2024-04-19T02:58:27.289 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../013-python3-ceph-common_18.2.2-1237-g646b8c7d-1focal_all.deb ... 2024-04-19T02:58:27.331 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-ceph-common (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T02:58:27.481 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-rbd. 2024-04-19T02:58:27.498 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../015-python3-rbd_18.2.2-1237-g646b8c7d-1focal_amd64.deb ... 2024-04-19T02:58:27.538 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-rbd (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T02:58:27.668 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-prettytable. 2024-04-19T02:58:27.687 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../014-python3-prettytable_0.7.2-5_all.deb ... 2024-04-19T02:58:27.726 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-prettytable (0.7.2-5) ... 2024-04-19T02:58:27.958 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package liblua5.3-0:amd64. 2024-04-19T02:58:27.975 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../016-liblua5.3-0_5.3.3-1.1ubuntu2_amd64.deb ... 2024-04-19T02:58:28.004 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-rbd. 2024-04-19T02:58:28.016 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2024-04-19T02:58:28.021 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../015-python3-rbd_18.2.2-1237-g646b8c7d-1focal_amd64.deb ... 2024-04-19T02:58:28.062 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-rbd (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T02:58:28.419 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package librabbitmq4:amd64. 2024-04-19T02:58:28.432 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package liblua5.3-0:amd64. 2024-04-19T02:58:28.435 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../017-librabbitmq4_0.10.0-1_amd64.deb ... 2024-04-19T02:58:28.451 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../016-liblua5.3-0_5.3.3-1.1ubuntu2_amd64.deb ... 2024-04-19T02:58:28.477 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking librabbitmq4:amd64 (0.10.0-1) ... 2024-04-19T02:58:28.490 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2024-04-19T02:58:28.856 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-04-19T02:58:28.860 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package librabbitmq4:amd64. 2024-04-19T02:58:28.874 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../018-librdkafka1_1.2.1-1ubuntu1_amd64.deb ... 2024-04-19T02:58:28.877 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../017-librabbitmq4_0.10.0-1_amd64.deb ... 2024-04-19T02:58:28.914 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2024-04-19T02:58:28.940 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking librabbitmq4:amd64 (0.10.0-1) ... 2024-04-19T02:58:29.317 INFO:teuthology.orchestra.run.smithi134.stdout:Get:109 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 ceph-volume all 18.2.2-1237-g646b8c7d-1focal [119 kB] 2024-04-19T02:58:29.319 INFO:teuthology.orchestra.run.smithi134.stdout:Get:110 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 libcephfs-dev amd64 18.2.2-1237-g646b8c7d-1focal [37.4 kB] 2024-04-19T02:58:29.320 INFO:teuthology.orchestra.run.smithi134.stdout:Get:111 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 radosgw amd64 18.2.2-1237-g646b8c7d-1focal [13.4 MB] 2024-04-19T02:58:29.321 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-04-19T02:58:29.333 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package librgw2. 2024-04-19T02:58:29.340 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../018-librdkafka1_1.2.1-1ubuntu1_amd64.deb ... 2024-04-19T02:58:29.353 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../019-librgw2_18.2.2-1237-g646b8c7d-1focal_amd64.deb ... 2024-04-19T02:58:29.379 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2024-04-19T02:58:29.391 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking librgw2 (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T02:58:29.473 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package ceph-volume. 2024-04-19T02:58:29.490 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../095-ceph-volume_18.2.2-1237-g646b8c7d-1focal_all.deb ... 2024-04-19T02:58:29.531 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking ceph-volume (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T02:58:29.741 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package librgw2. 2024-04-19T02:58:29.760 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../019-librgw2_18.2.2-1237-g646b8c7d-1focal_amd64.deb ... 2024-04-19T02:58:29.799 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking librgw2 (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T02:58:29.843 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package fonts-mathjax. 2024-04-19T02:58:29.864 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../096-fonts-mathjax_2.7.4+dfsg-1_all.deb ... 2024-04-19T02:58:29.901 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking fonts-mathjax (2.7.4+dfsg-1) ... 2024-04-19T02:58:30.096 INFO:teuthology.orchestra.run.smithi134.stdout:Get:112 https://1.chacra.ceph.com/r/ceph/reef/646b8c7d293d8ec31a40c69f7b3237b19c1be24d/ubuntu/focal/flavors/default focal/main amd64 rbd-fuse amd64 18.2.2-1237-g646b8c7d-1focal [107 kB] 2024-04-19T02:58:30.319 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-rgw. 2024-04-19T02:58:30.339 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../020-python3-rgw_18.2.2-1237-g646b8c7d-1focal_amd64.deb ... 2024-04-19T02:58:30.378 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-rgw (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T02:58:30.422 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package libcephfs-dev. 2024-04-19T02:58:30.446 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../097-libcephfs-dev_18.2.2-1237-g646b8c7d-1focal_amd64.deb ... 2024-04-19T02:58:30.480 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking libcephfs-dev (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T02:58:30.677 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-rgw. 2024-04-19T02:58:30.694 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../020-python3-rgw_18.2.2-1237-g646b8c7d-1focal_amd64.deb ... 2024-04-19T02:58:30.735 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-rgw (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T02:58:30.742 INFO:teuthology.orchestra.run.smithi134.stdout:Fetched 198 MB in 1min 6s (3,011 kB/s) 2024-04-19T02:58:30.757 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package liboath0. 2024-04-19T02:58:30.775 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../021-liboath0_2.6.1-1.3_amd64.deb ... 2024-04-19T02:58:30.814 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking liboath0 (2.6.1-1.3) ... 2024-04-19T02:58:30.909 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package nvme-cli. 2024-04-19T02:58:30.926 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../098-nvme-cli_1.9-1ubuntu0.1_amd64.deb ... 2024-04-19T02:58:30.942 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2024-04-19T02:58:30.998 INFO:teuthology.orchestra.run.smithi134.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 141729 files and directories currently installed.) 2024-04-19T02:58:30.998 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking nvme-cli (1.9-1ubuntu0.1) ... 2024-04-19T02:58:31.003 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../000-liblttng-ust0_2.11.0-1_amd64.deb ... 2024-04-19T02:58:31.121 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package liboath0. 2024-04-19T02:58:31.124 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking liblttng-ust0:amd64 (2.11.0-1) ... 2024-04-19T02:58:31.142 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../021-liboath0_2.6.1-1.3_amd64.deb ... 2024-04-19T02:58:31.183 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libradosstriper1. 2024-04-19T02:58:31.188 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking liboath0 (2.6.1-1.3) ... 2024-04-19T02:58:31.201 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../022-libradosstriper1_18.2.2-1237-g646b8c7d-1focal_amd64.deb ... 2024-04-19T02:58:31.242 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libradosstriper1 (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T02:58:31.323 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-04-19T02:58:31.340 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../099-python-asyncssh-doc_1.12.2-1_all.deb ... 2024-04-19T02:58:31.405 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python-asyncssh-doc (1.12.2-1) ... 2024-04-19T02:58:31.478 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-04-19T02:58:31.493 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.5-4ubuntu1_amd64.deb ... 2024-04-19T02:58:31.541 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package libradosstriper1. 2024-04-19T02:58:31.552 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2024-04-19T02:58:31.557 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../022-libradosstriper1_18.2.2-1237-g646b8c7d-1focal_amd64.deb ... 2024-04-19T02:58:31.599 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking libradosstriper1 (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T02:58:31.779 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package ceph-common. 2024-04-19T02:58:31.791 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package libjs-mathjax. 2024-04-19T02:58:31.795 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../023-ceph-common_18.2.2-1237-g646b8c7d-1focal_amd64.deb ... 2024-04-19T02:58:31.808 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../100-libjs-mathjax_2.7.4+dfsg-1_all.deb ... 2024-04-19T02:58:31.850 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking libjs-mathjax (2.7.4+dfsg-1) ... 2024-04-19T02:58:31.878 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking ceph-common (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T02:58:31.896 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-04-19T02:58:31.915 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../002-libpcre2-16-0_10.34-7ubuntu0.1_amd64.deb ... 2024-04-19T02:58:31.954 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2024-04-19T02:58:32.011 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package ceph-common. 2024-04-19T02:58:32.028 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../023-ceph-common_18.2.2-1237-g646b8c7d-1focal_amd64.deb ... 2024-04-19T02:58:32.069 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking ceph-common (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T02:58:32.508 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-04-19T02:58:32.526 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../003-libqt5core5a_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2024-04-19T02:58:32.576 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-04-19T02:58:33.061 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-04-19T02:58:33.077 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../004-libqt5dbus5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2024-04-19T02:58:33.111 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-04-19T02:58:33.539 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-04-19T02:58:33.555 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../005-libqt5network5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2024-04-19T02:58:33.597 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-04-19T02:58:33.608 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python-natsort-doc. 2024-04-19T02:58:33.627 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../101-python-natsort-doc_7.0.1-1_all.deb ... 2024-04-19T02:58:33.692 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python-natsort-doc (7.0.1-1) ... 2024-04-19T02:58:34.020 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python3-webencodings. 2024-04-19T02:58:34.041 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../102-python3-webencodings_0.5.1-1ubuntu1_all.deb ... 2024-04-19T02:58:34.075 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package libthrift-0.13.0. 2024-04-19T02:58:34.086 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python3-webencodings (0.5.1-1ubuntu1) ... 2024-04-19T02:58:34.091 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../006-libthrift-0.13.0_0.13.0-2build2_amd64.deb ... 2024-04-19T02:58:34.134 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking libthrift-0.13.0 (0.13.0-2build2) ... 2024-04-19T02:58:34.372 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python3-html5lib. 2024-04-19T02:58:34.392 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../103-python3-html5lib_1.0.1-2_all.deb ... 2024-04-19T02:58:34.434 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package ceph-base. 2024-04-19T02:58:34.450 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../024-ceph-base_18.2.2-1237-g646b8c7d-1focal_amd64.deb ... 2024-04-19T02:58:34.463 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python3-html5lib (1.0.1-2) ... 2024-04-19T02:58:34.502 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking ceph-base (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T02:58:34.514 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../007-librbd1_18.2.2-1237-g646b8c7d-1focal_amd64.deb ... 2024-04-19T02:58:34.558 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package ceph-base. 2024-04-19T02:58:34.574 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../024-ceph-base_18.2.2-1237-g646b8c7d-1focal_amd64.deb ... 2024-04-19T02:58:34.612 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking librbd1 (18.2.2-1237-g646b8c7d-1focal) over (15.2.17-0ubuntu0.20.04.6) ... 2024-04-19T02:58:34.660 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking ceph-base (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T02:58:34.828 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python3-lxml:amd64. 2024-04-19T02:58:34.848 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../104-python3-lxml_4.5.0-1ubuntu0.5_amd64.deb ... 2024-04-19T02:58:34.878 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2024-04-19T02:58:35.348 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python3-pastescript. 2024-04-19T02:58:35.358 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../008-librados2_18.2.2-1237-g646b8c7d-1focal_amd64.deb ... 2024-04-19T02:58:35.368 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../105-python3-pastescript_2.0.2-4_all.deb ... 2024-04-19T02:58:35.406 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-04-19T02:58:35.516 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking librados2 (18.2.2-1237-g646b8c7d-1focal) over (15.2.17-0ubuntu0.20.04.6) ... 2024-04-19T02:58:35.760 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python3-psutil. 2024-04-19T02:58:35.778 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../106-python3-psutil_5.5.1-1ubuntu4_amd64.deb ... 2024-04-19T02:58:35.805 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-cherrypy3. 2024-04-19T02:58:35.817 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python3-psutil (5.5.1-1ubuntu4) ... 2024-04-19T02:58:35.822 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../025-python3-cherrypy3_8.9.1-6_all.deb ... 2024-04-19T02:58:35.863 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-cherrypy3 (8.9.1-6) ... 2024-04-19T02:58:35.996 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-cherrypy3. 2024-04-19T02:58:36.016 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../025-python3-cherrypy3_8.9.1-6_all.deb ... 2024-04-19T02:58:36.054 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-cherrypy3 (8.9.1-6) ... 2024-04-19T02:58:36.156 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python3-pyinotify. 2024-04-19T02:58:36.178 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../107-python3-pyinotify_0.9.6-1.2ubuntu1_all.deb ... 2024-04-19T02:58:36.214 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python3-pyinotify (0.9.6-1.2ubuntu1) ... 2024-04-19T02:58:36.258 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-natsort. 2024-04-19T02:58:36.275 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../026-python3-natsort_7.0.1-1_all.deb ... 2024-04-19T02:58:36.286 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package libcephfs2. 2024-04-19T02:58:36.303 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../009-libcephfs2_18.2.2-1237-g646b8c7d-1focal_amd64.deb ... 2024-04-19T02:58:36.316 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-natsort (7.0.1-1) ... 2024-04-19T02:58:36.344 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking libcephfs2 (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T02:58:36.449 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-natsort. 2024-04-19T02:58:36.466 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../026-python3-natsort_7.0.1-1_all.deb ... 2024-04-19T02:58:36.541 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-natsort (7.0.1-1) ... 2024-04-19T02:58:36.567 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package python3-simplejson. 2024-04-19T02:58:36.584 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../108-python3-simplejson_3.16.0-2ubuntu2_amd64.deb ... 2024-04-19T02:58:36.625 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking python3-simplejson (3.16.0-2ubuntu2) ... 2024-04-19T02:58:36.687 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-logutils. 2024-04-19T02:58:36.703 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../027-python3-logutils_0.3.3-7_all.deb ... 2024-04-19T02:58:36.745 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-logutils (0.3.3-7) ... 2024-04-19T02:58:36.747 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-rados. 2024-04-19T02:58:36.764 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../010-python3-rados_18.2.2-1237-g646b8c7d-1focal_amd64.deb ... 2024-04-19T02:58:36.805 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-rados (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T02:58:36.886 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-logutils. 2024-04-19T02:58:36.903 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../027-python3-logutils_0.3.3-7_all.deb ... 2024-04-19T02:58:36.936 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-04-19T02:58:36.944 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-logutils (0.3.3-7) ... 2024-04-19T02:58:36.954 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../109-qttranslations5-l10n_5.12.8-0ubuntu1_all.deb ... 2024-04-19T02:58:36.995 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking qttranslations5-l10n (5.12.8-0ubuntu1) ... 2024-04-19T02:58:37.095 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-markupsafe. 2024-04-19T02:58:37.114 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../028-python3-markupsafe_1.1.0-1build2_amd64.deb ... 2024-04-19T02:58:37.156 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-markupsafe (1.1.0-1build2) ... 2024-04-19T02:58:37.166 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-04-19T02:58:37.185 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../011-python3-ceph-argparse_18.2.2-1237-g646b8c7d-1focal_all.deb ... 2024-04-19T02:58:37.249 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-ceph-argparse (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T02:58:37.297 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-markupsafe. 2024-04-19T02:58:37.313 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../028-python3-markupsafe_1.1.0-1build2_amd64.deb ... 2024-04-19T02:58:37.355 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-markupsafe (1.1.0-1build2) ... 2024-04-19T02:58:37.492 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-mako. 2024-04-19T02:58:37.508 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../029-python3-mako_1.1.0+ds1-1ubuntu2.1_all.deb ... 2024-04-19T02:58:37.535 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-cephfs. 2024-04-19T02:58:37.554 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../012-python3-cephfs_18.2.2-1237-g646b8c7d-1focal_amd64.deb ... 2024-04-19T02:58:37.592 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2024-04-19T02:58:37.593 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-cephfs (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T02:58:37.692 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-mako. 2024-04-19T02:58:37.709 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../029-python3-mako_1.1.0+ds1-1ubuntu2.1_all.deb ... 2024-04-19T02:58:37.715 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package radosgw. 2024-04-19T02:58:37.733 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../110-radosgw_18.2.2-1237-g646b8c7d-1focal_amd64.deb ... 2024-04-19T02:58:37.750 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2024-04-19T02:58:37.772 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking radosgw (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T02:58:37.954 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-simplegeneric. 2024-04-19T02:58:37.971 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-ceph-common. 2024-04-19T02:58:37.971 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../030-python3-simplegeneric_0.8.1-3_all.deb ... 2024-04-19T02:58:37.990 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../013-python3-ceph-common_18.2.2-1237-g646b8c7d-1focal_all.deb ... 2024-04-19T02:58:38.029 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-ceph-common (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T02:58:38.045 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-04-19T02:58:38.103 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-simplegeneric. 2024-04-19T02:58:38.119 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../030-python3-simplegeneric_0.8.1-3_all.deb ... 2024-04-19T02:58:38.161 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-04-19T02:58:38.373 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-prettytable. 2024-04-19T02:58:38.389 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../014-python3-prettytable_0.7.2-5_all.deb ... 2024-04-19T02:58:38.390 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-singledispatch. 2024-04-19T02:58:38.407 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../031-python3-singledispatch_3.4.0.3-2build1_all.deb ... 2024-04-19T02:58:38.465 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-prettytable (0.7.2-5) ... 2024-04-19T02:58:38.470 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-singledispatch (3.4.0.3-2build1) ... 2024-04-19T02:58:38.498 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-singledispatch. 2024-04-19T02:58:38.514 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../031-python3-singledispatch_3.4.0.3-2build1_all.deb ... 2024-04-19T02:58:38.556 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-singledispatch (3.4.0.3-2build1) ... 2024-04-19T02:58:38.734 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-rbd. 2024-04-19T02:58:38.750 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../015-python3-rbd_18.2.2-1237-g646b8c7d-1focal_amd64.deb ... 2024-04-19T02:58:38.784 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-rbd (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T02:58:38.801 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-webob. 2024-04-19T02:58:38.821 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../032-python3-webob_1%3a1.8.5-2_all.deb ... 2024-04-19T02:58:38.859 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-webob (1:1.8.5-2) ... 2024-04-19T02:58:38.892 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-webob. 2024-04-19T02:58:38.909 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../032-python3-webob_1%3a1.8.5-2_all.deb ... 2024-04-19T02:58:38.950 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-webob (1:1.8.5-2) ... 2024-04-19T02:58:39.104 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package liblua5.3-0:amd64. 2024-04-19T02:58:39.122 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../016-liblua5.3-0_5.3.3-1.1ubuntu2_amd64.deb ... 2024-04-19T02:58:39.161 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package rbd-fuse. 2024-04-19T02:58:39.178 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2024-04-19T02:58:39.181 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../111-rbd-fuse_18.2.2-1237-g646b8c7d-1focal_amd64.deb ... 2024-04-19T02:58:39.219 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking rbd-fuse (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T02:58:39.254 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-soupsieve. 2024-04-19T02:58:39.271 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../033-python3-soupsieve_1.9.5+dfsg-1_all.deb ... 2024-04-19T02:58:39.303 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-soupsieve. 2024-04-19T02:58:39.312 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-soupsieve (1.9.5+dfsg-1) ... 2024-04-19T02:58:39.319 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../033-python3-soupsieve_1.9.5+dfsg-1_all.deb ... 2024-04-19T02:58:39.386 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-soupsieve (1.9.5+dfsg-1) ... 2024-04-19T02:58:39.552 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python3-attr (19.3.0-2) ... 2024-04-19T02:58:39.581 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package librabbitmq4:amd64. 2024-04-19T02:58:39.597 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../017-librabbitmq4_0.10.0-1_amd64.deb ... 2024-04-19T02:58:39.672 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking librabbitmq4:amd64 (0.10.0-1) ... 2024-04-19T02:58:39.682 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-bs4. 2024-04-19T02:58:39.699 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../034-python3-bs4_4.8.2-1_all.deb ... 2024-04-19T02:58:39.731 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-bs4. 2024-04-19T02:58:39.740 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-bs4 (4.8.2-1) ... 2024-04-19T02:58:39.747 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../034-python3-bs4_4.8.2-1_all.deb ... 2024-04-19T02:58:39.789 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-bs4 (4.8.2-1) ... 2024-04-19T02:58:39.849 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up librabbitmq4:amd64 (0.10.0-1) ... 2024-04-19T02:58:39.983 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2024-04-19T02:58:40.042 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-04-19T02:58:40.059 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../018-librdkafka1_1.2.1-1ubuntu1_amd64.deb ... 2024-04-19T02:58:40.100 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2024-04-19T02:58:40.118 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up nvme-cli (1.9-1ubuntu0.1) ... 2024-04-19T02:58:40.143 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-waitress. 2024-04-19T02:58:40.159 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../035-python3-waitress_1.4.1-1ubuntu0.1_all.deb ... 2024-04-19T02:58:40.160 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-waitress. 2024-04-19T02:58:40.175 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../035-python3-waitress_1.4.1-1ubuntu0.1_all.deb ... 2024-04-19T02:58:40.205 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-waitress (1.4.1-1ubuntu0.1) ... 2024-04-19T02:58:40.221 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-waitress (1.4.1-1ubuntu0.1) ... 2024-04-19T02:58:40.327 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up cephadm (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T02:58:40.478 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package librgw2. 2024-04-19T02:58:40.495 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../019-librgw2_18.2.2-1237-g646b8c7d-1focal_amd64.deb ... 2024-04-19T02:58:40.536 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking librgw2 (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T02:58:40.588 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-tempita. 2024-04-19T02:58:40.588 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-tempita. 2024-04-19T02:58:40.605 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../036-python3-tempita_0.5.2-6_all.deb ... 2024-04-19T02:58:40.606 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../036-python3-tempita_0.5.2-6_all.deb ... 2024-04-19T02:58:40.646 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-tempita (0.5.2-6) ... 2024-04-19T02:58:40.646 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-tempita (0.5.2-6) ... 2024-04-19T02:58:40.904 INFO:teuthology.orchestra.run.smithi144.stdout:Adding system user cephadm....done 2024-04-19T02:58:40.966 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-paste. 2024-04-19T02:58:40.974 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-paste. 2024-04-19T02:58:40.985 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../037-python3-paste_3.4.0+dfsg1-1_all.deb ... 2024-04-19T02:58:40.990 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../037-python3-paste_3.4.0+dfsg1-1_all.deb ... 2024-04-19T02:58:41.033 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-paste (3.4.0+dfsg1-1) ... 2024-04-19T02:58:41.049 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-paste (3.4.0+dfsg1-1) ... 2024-04-19T02:58:41.100 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up fonts-mathjax (2.7.4+dfsg-1) ... 2024-04-19T02:58:41.226 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python3-waitress (1.4.1-1ubuntu0.1) ... 2024-04-19T02:58:41.394 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-04-19T02:58:41.394 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-04-19T02:58:41.411 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../038-python-pastedeploy-tpl_2.1.0-1_all.deb ... 2024-04-19T02:58:41.412 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../038-python-pastedeploy-tpl_2.1.0-1_all.deb ... 2024-04-19T02:58:41.452 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python-pastedeploy-tpl (2.1.0-1) ... 2024-04-19T02:58:41.472 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-rgw. 2024-04-19T02:58:41.477 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python-pastedeploy-tpl (2.1.0-1) ... 2024-04-19T02:58:41.488 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../020-python3-rgw_18.2.2-1237-g646b8c7d-1focal_amd64.deb ... 2024-04-19T02:58:41.530 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-rgw (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T02:58:41.578 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-04-19T02:58:41.772 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-pastedeploy. 2024-04-19T02:58:41.791 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../039-python3-pastedeploy_2.1.0-1_all.deb ... 2024-04-19T02:58:41.814 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-pastedeploy. 2024-04-19T02:58:41.830 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-pastedeploy (2.1.0-1) ... 2024-04-19T02:58:41.831 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../039-python3-pastedeploy_2.1.0-1_all.deb ... 2024-04-19T02:58:41.874 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-pastedeploy (2.1.0-1) ... 2024-04-19T02:58:41.875 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up libjs-mathjax (2.7.4+dfsg-1) ... 2024-04-19T02:58:41.958 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package liboath0. 2024-04-19T02:58:41.975 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../021-liboath0_2.6.1-1.3_amd64.deb ... 2024-04-19T02:58:41.997 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up liboath0 (2.6.1-1.3) ... 2024-04-19T02:58:42.016 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking liboath0 (2.6.1-1.3) ... 2024-04-19T02:58:42.148 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python3-py (1.8.1-1ubuntu0.1) ... 2024-04-19T02:58:42.166 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-webtest. 2024-04-19T02:58:42.184 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../040-python3-webtest_2.0.32-2_all.deb ... 2024-04-19T02:58:42.225 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-webtest (2.0.32-2) ... 2024-04-19T02:58:42.233 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-webtest. 2024-04-19T02:58:42.251 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../040-python3-webtest_2.0.32-2_all.deb ... 2024-04-19T02:58:42.291 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-webtest (2.0.32-2) ... 2024-04-19T02:58:42.379 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package libradosstriper1. 2024-04-19T02:58:42.398 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../022-libradosstriper1_18.2.2-1237-g646b8c7d-1focal_amd64.deb ... 2024-04-19T02:58:42.444 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking libradosstriper1 (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T02:58:42.494 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python3-joblib (0.14.0-3) ... 2024-04-19T02:58:42.569 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-pecan. 2024-04-19T02:58:42.585 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../041-python3-pecan_1.3.3-3ubuntu1_all.deb ... 2024-04-19T02:58:42.652 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-pecan (1.3.3-3ubuntu1) ... 2024-04-19T02:58:42.678 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-pecan. 2024-04-19T02:58:42.695 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../041-python3-pecan_1.3.3-3ubuntu1_all.deb ... 2024-04-19T02:58:42.736 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-pecan (1.3.3-3ubuntu1) ... 2024-04-19T02:58:42.914 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package ceph-common. 2024-04-19T02:58:42.926 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python3-jwt (1.7.1-2ubuntu2.1) ... 2024-04-19T02:58:42.931 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../023-ceph-common_18.2.2-1237-g646b8c7d-1focal_amd64.deb ... 2024-04-19T02:58:42.972 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking ceph-common (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T02:58:43.024 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-werkzeug. 2024-04-19T02:58:43.041 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../042-python3-werkzeug_0.16.1+dfsg1-2ubuntu0.1_all.deb ... 2024-04-19T02:58:43.082 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2024-04-19T02:58:43.150 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-werkzeug. 2024-04-19T02:58:43.167 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../042-python3-werkzeug_0.16.1+dfsg1-2ubuntu0.1_all.deb ... 2024-04-19T02:58:43.199 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2024-04-19T02:58:43.236 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python3-cachetools (4.0.0-1) ... 2024-04-19T02:58:43.519 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-04-19T02:58:43.536 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../043-ceph-mgr-modules-core_18.2.2-1237-g646b8c7d-1focal_all.deb ... 2024-04-19T02:58:43.554 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python3-bcrypt (3.1.7-2ubuntu1) ... 2024-04-19T02:58:43.594 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking ceph-mgr-modules-core (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T02:58:43.827 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-04-19T02:58:43.847 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../043-ceph-mgr-modules-core_18.2.2-1237-g646b8c7d-1focal_all.deb ... 2024-04-19T02:58:43.872 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python3-pyinotify (0.9.6-1.2ubuntu1) ... 2024-04-19T02:58:43.885 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking ceph-mgr-modules-core (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T02:58:44.166 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-04-19T02:58:44.181 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python3-ceph-argparse (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T02:58:44.183 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../044-libsqlite3-mod-ceph_18.2.2-1237-g646b8c7d-1focal_amd64.deb ... 2024-04-19T02:58:44.257 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libsqlite3-mod-ceph (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T02:58:44.277 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-04-19T02:58:44.296 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../044-libsqlite3-mod-ceph_18.2.2-1237-g646b8c7d-1focal_amd64.deb ... 2024-04-19T02:58:44.334 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking libsqlite3-mod-ceph (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T02:58:44.610 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-cryptography. 2024-04-19T02:58:44.630 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../045-python3-cryptography_2.8-3ubuntu0.3_amd64.deb ... 2024-04-19T02:58:44.693 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-cryptography (2.8-3ubuntu0.3) ... 2024-04-19T02:58:44.695 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-cryptography. 2024-04-19T02:58:44.711 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../045-python3-cryptography_2.8-3ubuntu0.3_amd64.deb ... 2024-04-19T02:58:44.753 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-cryptography (2.8-3ubuntu0.3) ... 2024-04-19T02:58:44.774 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2024-04-19T02:58:44.916 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python3-markupsafe (1.1.0-1build2) ... 2024-04-19T02:58:45.098 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-openssl. 2024-04-19T02:58:45.113 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../046-python3-openssl_19.0.0-1build1_all.deb ... 2024-04-19T02:58:45.141 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-openssl. 2024-04-19T02:58:45.160 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../046-python3-openssl_19.0.0-1build1_all.deb ... 2024-04-19T02:58:45.181 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-openssl (19.0.0-1build1) ... 2024-04-19T02:58:45.199 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-openssl (19.0.0-1build1) ... 2024-04-19T02:58:45.218 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python3-webencodings (0.5.1-1ubuntu1) ... 2024-04-19T02:58:45.461 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package ceph-base. 2024-04-19T02:58:45.476 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../024-ceph-base_18.2.2-1237-g646b8c7d-1focal_amd64.deb ... 2024-04-19T02:58:45.502 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2024-04-19T02:58:45.529 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking ceph-base (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T02:58:45.550 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package ceph-mgr. 2024-04-19T02:58:45.567 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../047-ceph-mgr_18.2.2-1237-g646b8c7d-1focal_amd64.deb ... 2024-04-19T02:58:45.619 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package ceph-mgr. 2024-04-19T02:58:45.633 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking ceph-mgr (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T02:58:45.639 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../047-ceph-mgr_18.2.2-1237-g646b8c7d-1focal_amd64.deb ... 2024-04-19T02:58:45.653 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python3-psutil (5.5.1-1ubuntu4) ... 2024-04-19T02:58:45.677 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking ceph-mgr (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T02:58:46.022 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python3-natsort (7.0.1-1) ... 2024-04-19T02:58:46.179 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package ceph-mon. 2024-04-19T02:58:46.195 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../048-ceph-mon_18.2.2-1237-g646b8c7d-1focal_amd64.deb ... 2024-04-19T02:58:46.197 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package ceph-mon. 2024-04-19T02:58:46.216 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../048-ceph-mon_18.2.2-1237-g646b8c7d-1focal_amd64.deb ... 2024-04-19T02:58:46.237 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking ceph-mon (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T02:58:46.255 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking ceph-mon (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T02:58:46.338 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python3-atomicwrites (1.1.5-2build1) ... 2024-04-19T02:58:46.623 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python3-simplejson (3.16.0-2ubuntu2) ... 2024-04-19T02:58:46.856 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-cherrypy3. 2024-04-19T02:58:46.872 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../025-python3-cherrypy3_8.9.1-6_all.deb ... 2024-04-19T02:58:46.939 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-cherrypy3 (8.9.1-6) ... 2024-04-19T02:58:47.007 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python3-decorator (4.4.2-0ubuntu1) ... 2024-04-19T02:58:47.225 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package ceph-osd. 2024-04-19T02:58:47.245 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../049-ceph-osd_18.2.2-1237-g646b8c7d-1focal_amd64.deb ... 2024-04-19T02:58:47.259 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package ceph-osd. 2024-04-19T02:58:47.277 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../049-ceph-osd_18.2.2-1237-g646b8c7d-1focal_amd64.deb ... 2024-04-19T02:58:47.290 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking ceph-osd (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T02:58:47.301 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-natsort. 2024-04-19T02:58:47.317 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking ceph-osd (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T02:58:47.319 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../026-python3-natsort_7.0.1-1_all.deb ... 2024-04-19T02:58:47.342 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python3-jinja2 (2.10.1-2ubuntu0.2) ... 2024-04-19T02:58:47.359 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-natsort (7.0.1-1) ... 2024-04-19T02:58:47.701 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python3-tempita (0.5.2-6) ... 2024-04-19T02:58:48.002 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python3-packaging (20.3-1) ... 2024-04-19T02:58:48.088 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-logutils. 2024-04-19T02:58:48.106 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../027-python3-logutils_0.3.3-7_all.deb ... 2024-04-19T02:58:48.145 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-logutils (0.3.3-7) ... 2024-04-19T02:58:48.303 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python-pastedeploy-tpl (2.1.0-1) ... 2024-04-19T02:58:48.429 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up qttranslations5-l10n (5.12.8-0ubuntu1) ... 2024-04-19T02:58:48.473 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-markupsafe. 2024-04-19T02:58:48.492 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../028-python3-markupsafe_1.1.0-1build2_amd64.deb ... 2024-04-19T02:58:48.555 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python3-wcwidth (0.1.8+dfsg1-3) ... 2024-04-19T02:58:48.573 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-markupsafe (1.1.0-1build2) ... 2024-04-19T02:58:48.873 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python3-paste (3.4.0+dfsg1-1) ... 2024-04-19T02:58:48.909 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-mako. 2024-04-19T02:58:48.925 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../029-python3-mako_1.1.0+ds1-1ubuntu2.1_all.deb ... 2024-04-19T02:58:48.968 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2024-04-19T02:58:49.267 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2024-04-19T02:58:49.346 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-simplegeneric. 2024-04-19T02:58:49.364 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../030-python3-simplegeneric_0.8.1-3_all.deb ... 2024-04-19T02:58:49.404 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-04-19T02:58:49.553 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package ceph. 2024-04-19T02:58:49.572 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../050-ceph_18.2.2-1237-g646b8c7d-1focal_amd64.deb ... 2024-04-19T02:58:49.651 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python3-cryptography (2.8-3ubuntu0.3) ... 2024-04-19T02:58:49.653 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking ceph (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T02:58:49.773 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-singledispatch. 2024-04-19T02:58:49.793 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../031-python3-singledispatch_3.4.0.3-2build1_all.deb ... 2024-04-19T02:58:49.831 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-singledispatch (3.4.0.3-2build1) ... 2024-04-19T02:58:49.886 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package ceph. 2024-04-19T02:58:49.903 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../050-ceph_18.2.2-1237-g646b8c7d-1focal_amd64.deb ... 2024-04-19T02:58:49.944 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking ceph (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T02:58:50.015 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package ceph-fuse. 2024-04-19T02:58:50.028 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up socat (1.7.3.3-2) ... 2024-04-19T02:58:50.029 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../051-ceph-fuse_18.2.2-1237-g646b8c7d-1focal_amd64.deb ... 2024-04-19T02:58:50.072 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking ceph-fuse (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T02:58:50.142 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-webob. 2024-04-19T02:58:50.162 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../032-python3-webob_1%3a1.8.5-2_all.deb ... 2024-04-19T02:58:50.176 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python3-ceph-common (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T02:58:50.200 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-webob (1:1.8.5-2) ... 2024-04-19T02:58:50.338 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package ceph-fuse. 2024-04-19T02:58:50.355 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../051-ceph-fuse_18.2.2-1237-g646b8c7d-1focal_amd64.deb ... 2024-04-19T02:58:50.396 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking ceph-fuse (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T02:58:50.514 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-04-19T02:58:50.534 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package ceph-mds. 2024-04-19T02:58:50.550 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../052-ceph-mds_18.2.2-1237-g646b8c7d-1focal_amd64.deb ... 2024-04-19T02:58:50.587 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-soupsieve. 2024-04-19T02:58:50.592 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking ceph-mds (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T02:58:50.603 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../033-python3-soupsieve_1.9.5+dfsg-1_all.deb ... 2024-04-19T02:58:50.645 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-soupsieve (1.9.5+dfsg-1) ... 2024-04-19T02:58:50.673 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python3-html5lib (1.0.1-2) ... 2024-04-19T02:58:50.841 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package ceph-mds. 2024-04-19T02:58:50.861 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../052-ceph-mds_18.2.2-1237-g646b8c7d-1focal_amd64.deb ... 2024-04-19T02:58:50.933 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking ceph-mds (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T02:58:51.014 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-bs4. 2024-04-19T02:58:51.031 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../034-python3-bs4_4.8.2-1_all.deb ... 2024-04-19T02:58:51.033 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2024-04-19T02:58:51.072 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-bs4 (4.8.2-1) ... 2024-04-19T02:58:51.120 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package cephadm. 2024-04-19T02:58:51.137 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../053-cephadm_18.2.2-1237-g646b8c7d-1focal_amd64.deb ... 2024-04-19T02:58:51.159 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up xmlstarlet (1.6.1-2build1) ... 2024-04-19T02:58:51.178 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking cephadm (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T02:58:51.285 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python3-pluggy (0.13.0-2) ... 2024-04-19T02:58:51.484 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-waitress. 2024-04-19T02:58:51.502 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../035-python3-waitress_1.4.1-1ubuntu0.1_all.deb ... 2024-04-19T02:58:51.523 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-asyncssh. 2024-04-19T02:58:51.527 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package cephadm. 2024-04-19T02:58:51.539 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../054-python3-asyncssh_1.12.2-1_all.deb ... 2024-04-19T02:58:51.544 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../053-cephadm_18.2.2-1237-g646b8c7d-1focal_amd64.deb ... 2024-04-19T02:58:51.545 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-waitress (1.4.1-1ubuntu0.1) ... 2024-04-19T02:58:51.581 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-asyncssh (1.12.2-1) ... 2024-04-19T02:58:51.607 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking cephadm (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T02:58:51.611 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2024-04-19T02:58:51.904 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-tempita. 2024-04-19T02:58:51.920 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../036-python3-tempita_0.5.2-6_all.deb ... 2024-04-19T02:58:51.955 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-asyncssh. 2024-04-19T02:58:51.968 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-jinja2. 2024-04-19T02:58:51.970 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-04-19T02:58:51.972 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../054-python3-asyncssh_1.12.2-1_all.deb ... 2024-04-19T02:58:51.978 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-tempita (0.5.2-6) ... 2024-04-19T02:58:51.985 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../055-python3-jinja2_2.10.1-2ubuntu0.2_all.deb ... 2024-04-19T02:58:52.013 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-asyncssh (1.12.2-1) ... 2024-04-19T02:58:52.026 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-jinja2 (2.10.1-2ubuntu0.2) ... 2024-04-19T02:58:52.133 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2024-04-19T02:58:52.259 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python3-pyasn1 (0.4.2-3build1) ... 2024-04-19T02:58:52.298 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-paste. 2024-04-19T02:58:52.317 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../037-python3-paste_3.4.0+dfsg1-1_all.deb ... 2024-04-19T02:58:52.364 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-paste (3.4.0+dfsg1-1) ... 2024-04-19T02:58:52.370 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-04-19T02:58:52.387 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../056-ceph-mgr-cephadm_18.2.2-1237-g646b8c7d-1focal_all.deb ... 2024-04-19T02:58:52.429 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking ceph-mgr-cephadm (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T02:58:52.433 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-jinja2. 2024-04-19T02:58:52.449 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../055-python3-jinja2_2.10.1-2ubuntu0.2_all.deb ... 2024-04-19T02:58:52.515 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-jinja2 (2.10.1-2ubuntu0.2) ... 2024-04-19T02:58:52.585 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python3-singledispatch (3.4.0.3-2build1) ... 2024-04-19T02:58:52.701 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-04-19T02:58:52.721 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../038-python-pastedeploy-tpl_2.1.0-1_all.deb ... 2024-04-19T02:58:52.759 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python-pastedeploy-tpl (2.1.0-1) ... 2024-04-19T02:58:52.791 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-bcrypt. 2024-04-19T02:58:52.806 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../057-python3-bcrypt_3.1.7-2ubuntu1_amd64.deb ... 2024-04-19T02:58:52.849 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-bcrypt (3.1.7-2ubuntu1) ... 2024-04-19T02:58:52.886 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-04-19T02:58:52.903 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python3-logutils (0.3.3-7) ... 2024-04-19T02:58:52.903 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../056-ceph-mgr-cephadm_18.2.2-1237-g646b8c7d-1focal_all.deb ... 2024-04-19T02:58:52.963 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking ceph-mgr-cephadm (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T02:58:53.103 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-pastedeploy. 2024-04-19T02:58:53.123 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../039-python3-pastedeploy_2.1.0-1_all.deb ... 2024-04-19T02:58:53.187 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-pastedeploy (2.1.0-1) ... 2024-04-19T02:58:53.193 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-jwt. 2024-04-19T02:58:53.209 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../058-python3-jwt_1.7.1-2ubuntu2.1_all.deb ... 2024-04-19T02:58:53.212 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up liblttng-ust0:amd64 (2.11.0-1) ... 2024-04-19T02:58:53.293 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-jwt (1.7.1-2ubuntu2.1) ... 2024-04-19T02:58:53.364 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-bcrypt. 2024-04-19T02:58:53.371 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-04-19T02:58:53.380 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../057-python3-bcrypt_3.1.7-2ubuntu1_amd64.deb ... 2024-04-19T02:58:53.447 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-bcrypt (3.1.7-2ubuntu1) ... 2024-04-19T02:58:53.523 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-webtest. 2024-04-19T02:58:53.539 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../040-python3-webtest_2.0.32-2_all.deb ... 2024-04-19T02:58:53.582 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-webtest (2.0.32-2) ... 2024-04-19T02:58:53.631 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-attr. 2024-04-19T02:58:53.646 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../059-python3-attr_19.3.0-2_all.deb ... 2024-04-19T02:58:53.664 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python3-prettytable (0.7.2-5) ... 2024-04-19T02:58:53.688 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-attr (19.3.0-2) ... 2024-04-19T02:58:53.766 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-jwt. 2024-04-19T02:58:53.783 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../058-python3-jwt_1.7.1-2ubuntu2.1_all.deb ... 2024-04-19T02:58:53.825 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-jwt (1.7.1-2ubuntu2.1) ... 2024-04-19T02:58:53.959 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-pecan. 2024-04-19T02:58:53.965 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python3-soupsieve (1.9.5+dfsg-1) ... 2024-04-19T02:58:53.975 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../041-python3-pecan_1.3.3-3ubuntu1_all.deb ... 2024-04-19T02:58:54.017 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-pecan (1.3.3-3ubuntu1) ... 2024-04-19T02:58:54.075 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-pluggy. 2024-04-19T02:58:54.092 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../060-python3-pluggy_0.13.0-2_all.deb ... 2024-04-19T02:58:54.125 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-pluggy (0.13.0-2) ... 2024-04-19T02:58:54.211 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-attr. 2024-04-19T02:58:54.228 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../059-python3-attr_19.3.0-2_all.deb ... 2024-04-19T02:58:54.269 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-attr (19.3.0-2) ... 2024-04-19T02:58:54.317 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python3-websocket (0.53.0-2ubuntu1) ... 2024-04-19T02:58:54.430 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-werkzeug. 2024-04-19T02:58:54.447 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../042-python3-werkzeug_0.16.1+dfsg1-2ubuntu0.1_all.deb ... 2024-04-19T02:58:54.461 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-py. 2024-04-19T02:58:54.477 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../061-python3-py_1.8.1-1ubuntu0.1_all.deb ... 2024-04-19T02:58:54.488 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2024-04-19T02:58:54.519 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-py (1.8.1-1ubuntu0.1) ... 2024-04-19T02:58:54.672 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-pluggy. 2024-04-19T02:58:54.688 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../060-python3-pluggy_0.13.0-2_all.deb ... 2024-04-19T02:58:54.716 INFO:teuthology.orchestra.run.smithi144.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2024-04-19T02:58:54.730 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-pluggy (0.13.0-2) ... 2024-04-19T02:58:54.799 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-04-19T02:58:54.816 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../043-ceph-mgr-modules-core_18.2.2-1237-g646b8c7d-1focal_all.deb ... 2024-04-19T02:58:54.864 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-atomicwrites. 2024-04-19T02:58:54.880 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../062-python3-atomicwrites_1.1.5-2build1_all.deb ... 2024-04-19T02:58:54.891 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking ceph-mgr-modules-core (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T02:58:54.922 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-atomicwrites (1.1.5-2build1) ... 2024-04-19T02:58:54.978 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up libonig5:amd64 (6.9.4-1) ... 2024-04-19T02:58:55.084 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-py. 2024-04-19T02:58:55.103 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../061-python3-py_1.8.1-1ubuntu0.1_all.deb ... 2024-04-19T02:58:55.103 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2024-04-19T02:58:55.141 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-py (1.8.1-1ubuntu0.1) ... 2024-04-19T02:58:55.250 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-packaging. 2024-04-19T02:58:55.266 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../063-python3-packaging_20.3-1_all.deb ... 2024-04-19T02:58:55.308 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-packaging (20.3-1) ... 2024-04-19T02:58:55.312 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-04-19T02:58:55.328 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../044-libsqlite3-mod-ceph_18.2.2-1237-g646b8c7d-1focal_amd64.deb ... 2024-04-19T02:58:55.387 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking libsqlite3-mod-ceph (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T02:58:55.463 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python3-cherrypy3 (8.9.1-6) ... 2024-04-19T02:58:55.512 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-atomicwrites. 2024-04-19T02:58:55.530 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../062-python3-atomicwrites_1.1.5-2build1_all.deb ... 2024-04-19T02:58:55.561 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-atomicwrites (1.1.5-2build1) ... 2024-04-19T02:58:55.636 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-wcwidth. 2024-04-19T02:58:55.653 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../064-python3-wcwidth_0.1.8+dfsg1-3_all.deb ... 2024-04-19T02:58:55.694 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-wcwidth (0.1.8+dfsg1-3) ... 2024-04-19T02:58:55.756 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-cryptography. 2024-04-19T02:58:55.772 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../045-python3-cryptography_2.8-3ubuntu0.3_amd64.deb ... 2024-04-19T02:58:55.842 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2024-04-19T02:58:55.844 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-cryptography (2.8-3ubuntu0.3) ... 2024-04-19T02:58:55.889 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-packaging. 2024-04-19T02:58:55.907 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../063-python3-packaging_20.3-1_all.deb ... 2024-04-19T02:58:55.981 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-packaging (20.3-1) ... 2024-04-19T02:58:55.993 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2024-04-19T02:58:56.047 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-pytest. 2024-04-19T02:58:56.063 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../065-python3-pytest_4.6.9-1_all.deb ... 2024-04-19T02:58:56.102 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python3-webob (1:1.8.5-2) ... 2024-04-19T02:58:56.105 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-pytest (4.6.9-1) ... 2024-04-19T02:58:56.243 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-openssl. 2024-04-19T02:58:56.260 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../046-python3-openssl_19.0.0-1build1_all.deb ... 2024-04-19T02:58:56.325 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-openssl (19.0.0-1build1) ... 2024-04-19T02:58:56.326 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-wcwidth. 2024-04-19T02:58:56.343 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../064-python3-wcwidth_0.1.8+dfsg1-3_all.deb ... 2024-04-19T02:58:56.408 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-wcwidth (0.1.8+dfsg1-3) ... 2024-04-19T02:58:56.445 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2024-04-19T02:58:56.476 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-repoze.lru. 2024-04-19T02:58:56.493 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../066-python3-repoze.lru_0.7-2_all.deb ... 2024-04-19T02:58:56.561 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-04-19T02:58:56.713 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package ceph-mgr. 2024-04-19T02:58:56.729 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../047-ceph-mgr_18.2.2-1237-g646b8c7d-1focal_amd64.deb ... 2024-04-19T02:58:56.745 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-pytest. 2024-04-19T02:58:56.762 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../065-python3-pytest_4.6.9-1_all.deb ... 2024-04-19T02:58:56.763 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python3-scipy (1.3.3-3build1) ... 2024-04-19T02:58:56.770 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking ceph-mgr (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T02:58:56.803 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-pytest (4.6.9-1) ... 2024-04-19T02:58:56.827 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package libjs-underscore. 2024-04-19T02:58:56.846 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../067-libjs-underscore_1.9.1~dfsg-1ubuntu0.20.04.1_all.deb ... 2024-04-19T02:58:56.905 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2024-04-19T02:58:57.180 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package libjs-sphinxdoc. 2024-04-19T02:58:57.196 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../068-libjs-sphinxdoc_1.8.5-7ubuntu3_all.deb ... 2024-04-19T02:58:57.215 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-repoze.lru. 2024-04-19T02:58:57.232 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../066-python3-repoze.lru_0.7-2_all.deb ... 2024-04-19T02:58:57.260 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2024-04-19T02:58:57.273 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-04-19T02:58:57.299 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package ceph-mon. 2024-04-19T02:58:57.318 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../048-ceph-mon_18.2.2-1237-g646b8c7d-1focal_amd64.deb ... 2024-04-19T02:58:57.357 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking ceph-mon (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T02:58:57.583 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-routes. 2024-04-19T02:58:57.593 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libjs-underscore. 2024-04-19T02:58:57.599 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../069-python3-routes_2.4.1-2_all.deb ... 2024-04-19T02:58:57.611 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../067-libjs-underscore_1.9.1~dfsg-1ubuntu0.20.04.1_all.deb ... 2024-04-19T02:58:57.651 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2024-04-19T02:58:57.658 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-routes (2.4.1-2) ... 2024-04-19T02:58:57.945 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libjs-sphinxdoc. 2024-04-19T02:58:57.964 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../068-libjs-sphinxdoc_1.8.5-7ubuntu3_all.deb ... 2024-04-19T02:58:58.019 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-04-19T02:58:58.039 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../070-ceph-mgr-dashboard_18.2.2-1237-g646b8c7d-1focal_all.deb ... 2024-04-19T02:58:58.039 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2024-04-19T02:58:58.077 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking ceph-mgr-dashboard (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T02:58:58.293 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2024-04-19T02:58:58.336 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package ceph-osd. 2024-04-19T02:58:58.352 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../049-ceph-osd_18.2.2-1237-g646b8c7d-1focal_amd64.deb ... 2024-04-19T02:58:58.389 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-routes. 2024-04-19T02:58:58.394 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking ceph-osd (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T02:58:58.405 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../069-python3-routes_2.4.1-2_all.deb ... 2024-04-19T02:58:58.412 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python3-pytest (4.6.9-1) ... 2024-04-19T02:58:58.473 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-routes (2.4.1-2) ... 2024-04-19T02:58:58.797 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python3-openssl (19.0.0-1build1) ... 2024-04-19T02:58:58.826 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-04-19T02:58:58.843 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../070-ceph-mgr-dashboard_18.2.2-1237-g646b8c7d-1focal_all.deb ... 2024-04-19T02:58:58.884 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking ceph-mgr-dashboard (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T02:58:59.106 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python3-pastedeploy (2.1.0-1) ... 2024-04-19T02:58:59.422 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-04-19T02:58:59.550 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python3-bs4 (4.8.2-1) ... 2024-04-19T02:58:59.558 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-decorator. 2024-04-19T02:58:59.576 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../071-python3-decorator_4.4.2-0ubuntu1_all.deb ... 2024-04-19T02:58:59.616 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-decorator (4.4.2-0ubuntu1) ... 2024-04-19T02:58:59.910 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python3-oauthlib (3.1.0-1ubuntu2) ... 2024-04-19T02:58:59.952 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package liblbfgsb0:amd64. 2024-04-19T02:58:59.968 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../072-liblbfgsb0_3.0+dfsg.3-7build1_amd64.deb ... 2024-04-19T02:59:00.010 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2024-04-19T02:59:00.228 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python3-asyncssh (1.12.2-1) ... 2024-04-19T02:59:00.339 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-scipy. 2024-04-19T02:59:00.357 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../073-python3-scipy_1.3.3-3build1_amd64.deb ... 2024-04-19T02:59:00.397 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-scipy (1.3.3-3build1) ... 2024-04-19T02:59:00.398 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-decorator. 2024-04-19T02:59:00.418 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../071-python3-decorator_4.4.2-0ubuntu1_all.deb ... 2024-04-19T02:59:00.458 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-decorator (4.4.2-0ubuntu1) ... 2024-04-19T02:59:00.572 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package ceph. 2024-04-19T02:59:00.591 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../050-ceph_18.2.2-1237-g646b8c7d-1focal_amd64.deb ... 2024-04-19T02:59:00.613 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2build1) ... 2024-04-19T02:59:00.630 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking ceph (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T02:59:00.821 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package liblbfgsb0:amd64. 2024-04-19T02:59:00.841 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../072-liblbfgsb0_3.0+dfsg.3-7build1_amd64.deb ... 2024-04-19T02:59:00.879 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2024-04-19T02:59:00.930 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python3-sklearn (0.22.2.post1+dfsg-5) ... 2024-04-19T02:59:00.984 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package ceph-fuse. 2024-04-19T02:59:01.001 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../051-ceph-fuse_18.2.2-1237-g646b8c7d-1focal_amd64.deb ... 2024-04-19T02:59:01.076 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking ceph-fuse (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T02:59:01.241 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-scipy. 2024-04-19T02:59:01.259 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../073-python3-scipy_1.3.3-3build1_amd64.deb ... 2024-04-19T02:59:01.299 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-scipy (1.3.3-3build1) ... 2024-04-19T02:59:01.595 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package ceph-mds. 2024-04-19T02:59:01.612 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../052-ceph-mds_18.2.2-1237-g646b8c7d-1focal_amd64.deb ... 2024-04-19T02:59:01.653 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking ceph-mds (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T02:59:01.794 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-sklearn-lib. 2024-04-19T02:59:01.813 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../074-python3-sklearn-lib_0.22.2.post1+dfsg-5_amd64.deb ... 2024-04-19T02:59:01.852 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2024-04-19T02:59:01.986 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2024-04-19T02:59:02.137 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python-natsort-doc (7.0.1-1) ... 2024-04-19T02:59:02.148 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package cephadm. 2024-04-19T02:59:02.166 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../053-cephadm_18.2.2-1237-g646b8c7d-1focal_amd64.deb ... 2024-04-19T02:59:02.207 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking cephadm (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T02:59:02.263 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up jq (1.6-1ubuntu0.20.04.1) ... 2024-04-19T02:59:02.389 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python3-rsa (4.0-3) ... 2024-04-19T02:59:02.413 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-joblib. 2024-04-19T02:59:02.430 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../075-python3-joblib_0.14.0-3_all.deb ... 2024-04-19T02:59:02.504 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-joblib (0.14.0-3) ... 2024-04-19T02:59:02.592 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-asyncssh. 2024-04-19T02:59:02.610 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../054-python3-asyncssh_1.12.2-1_all.deb ... 2024-04-19T02:59:02.651 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-asyncssh (1.12.2-1) ... 2024-04-19T02:59:02.716 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-sklearn-lib. 2024-04-19T02:59:02.732 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up libthrift-0.13.0 (0.13.0-2build2) ... 2024-04-19T02:59:02.733 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../074-python3-sklearn-lib_0.22.2.post1+dfsg-5_amd64.deb ... 2024-04-19T02:59:02.774 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2024-04-19T02:59:02.883 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python3-webtest (2.0.32-2) ... 2024-04-19T02:59:02.883 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-sklearn. 2024-04-19T02:59:02.900 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../076-python3-sklearn_0.22.2.post1+dfsg-5_all.deb ... 2024-04-19T02:59:02.941 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-sklearn (0.22.2.post1+dfsg-5) ... 2024-04-19T02:59:03.112 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-jinja2. 2024-04-19T02:59:03.130 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../055-python3-jinja2_2.10.1-2ubuntu0.2_all.deb ... 2024-04-19T02:59:03.170 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-jinja2 (2.10.1-2ubuntu0.2) ... 2024-04-19T02:59:03.184 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python3-requests-oauthlib (1.0.0-1.1build1) ... 2024-04-19T02:59:03.344 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-joblib. 2024-04-19T02:59:03.363 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../075-python3-joblib_0.14.0-3_all.deb ... 2024-04-19T02:59:03.402 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-joblib (0.14.0-3) ... 2024-04-19T02:59:03.510 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-04-19T02:59:03.565 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-04-19T02:59:03.582 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../056-ceph-mgr-cephadm_18.2.2-1237-g646b8c7d-1focal_all.deb ... 2024-04-19T02:59:03.623 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking ceph-mgr-cephadm (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T02:59:03.659 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-04-19T02:59:03.675 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../077-ceph-mgr-diskprediction-local_18.2.2-1237-g646b8c7d-1focal_all.deb ... 2024-04-19T02:59:03.717 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking ceph-mgr-diskprediction-local (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T02:59:03.828 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python3-pecan (1.3.3-3ubuntu1) ... 2024-04-19T02:59:03.848 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-sklearn. 2024-04-19T02:59:03.864 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../076-python3-sklearn_0.22.2.post1+dfsg-5_all.deb ... 2024-04-19T02:59:03.906 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-sklearn (0.22.2.post1+dfsg-5) ... 2024-04-19T02:59:04.027 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-bcrypt. 2024-04-19T02:59:04.046 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../057-python3-bcrypt_3.1.7-2ubuntu1_amd64.deb ... 2024-04-19T02:59:04.092 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-bcrypt (3.1.7-2ubuntu1) ... 2024-04-19T02:59:04.205 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up librados2 (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T02:59:04.331 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python-asyncssh-doc (1.12.2-1) ... 2024-04-19T02:59:04.428 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-jwt. 2024-04-19T02:59:04.446 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../058-python3-jwt_1.7.1-2ubuntu2.1_all.deb ... 2024-04-19T02:59:04.482 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up librgw2 (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T02:59:04.486 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-jwt (1.7.1-2ubuntu2.1) ... 2024-04-19T02:59:04.600 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up libsqlite3-mod-ceph (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T02:59:04.640 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-04-19T02:59:04.656 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../077-ceph-mgr-diskprediction-local_18.2.2-1237-g646b8c7d-1focal_all.deb ... 2024-04-19T02:59:04.715 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking ceph-mgr-diskprediction-local (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T02:59:04.831 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-attr. 2024-04-19T02:59:04.844 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up libcephfs2 (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T02:59:04.850 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../059-python3-attr_19.3.0-2_all.deb ... 2024-04-19T02:59:04.853 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-cachetools. 2024-04-19T02:59:04.870 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../078-python3-cachetools_4.0.0-1_all.deb ... 2024-04-19T02:59:04.889 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-attr (19.3.0-2) ... 2024-04-19T02:59:04.911 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-cachetools (4.0.0-1) ... 2024-04-19T02:59:04.976 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python3-routes (2.4.1-2) ... 2024-04-19T02:59:05.240 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-pyasn1. 2024-04-19T02:59:05.257 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../079-python3-pyasn1_0.4.2-3build1_all.deb ... 2024-04-19T02:59:05.275 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-pluggy. 2024-04-19T02:59:05.289 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up libradosstriper1 (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T02:59:05.291 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../060-python3-pluggy_0.13.0-2_all.deb ... 2024-04-19T02:59:05.298 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-pyasn1 (0.4.2-3build1) ... 2024-04-19T02:59:05.333 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-pluggy (0.13.0-2) ... 2024-04-19T02:59:05.414 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python3-google-auth (1.5.1-2) ... 2024-04-19T02:59:05.651 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-04-19T02:59:05.669 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../080-python3-pyasn1-modules_0.2.1-0.2build1_all.deb ... 2024-04-19T02:59:05.678 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-py. 2024-04-19T02:59:05.693 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../061-python3-py_1.8.1-1ubuntu0.1_all.deb ... 2024-04-19T02:59:05.700 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up librbd1 (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T02:59:05.709 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2build1) ... 2024-04-19T02:59:05.777 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-py (1.8.1-1ubuntu0.1) ... 2024-04-19T02:59:05.826 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up ceph-mgr-modules-core (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T02:59:05.926 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-cachetools. 2024-04-19T02:59:05.943 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../078-python3-cachetools_4.0.0-1_all.deb ... 2024-04-19T02:59:05.984 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-cachetools (4.0.0-1) ... 2024-04-19T02:59:05.985 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up ceph-fuse (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T02:59:06.114 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-atomicwrites. 2024-04-19T02:59:06.133 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../062-python3-atomicwrites_1.1.5-2build1_all.deb ... 2024-04-19T02:59:06.172 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-atomicwrites (1.1.5-2build1) ... 2024-04-19T02:59:06.173 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-rsa. 2024-04-19T02:59:06.193 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../081-python3-rsa_4.0-3_all.deb ... 2024-04-19T02:59:06.204 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-19T02:59:06.204 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-19T02:59:06.232 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-rsa (4.0-3) ... 2024-04-19T02:59:06.345 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-pyasn1. 2024-04-19T02:59:06.361 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../079-python3-pyasn1_0.4.2-3build1_all.deb ... 2024-04-19T02:59:06.403 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-pyasn1 (0.4.2-3build1) ... 2024-04-19T02:59:06.533 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-packaging. 2024-04-19T02:59:06.549 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../063-python3-packaging_20.3-1_all.deb ... 2024-04-19T02:59:06.561 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-google-auth. 2024-04-19T02:59:06.580 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../082-python3-google-auth_1.5.1-2_all.deb ... 2024-04-19T02:59:06.591 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-packaging (20.3-1) ... 2024-04-19T02:59:06.618 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-google-auth (1.5.1-2) ... 2024-04-19T02:59:06.653 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up libcephfs-dev (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T02:59:06.773 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-04-19T02:59:06.794 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../080-python3-pyasn1-modules_0.2.1-0.2build1_all.deb ... 2024-04-19T02:59:06.804 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python3-rados (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T02:59:06.831 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2build1) ... 2024-04-19T02:59:06.923 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-wcwidth. 2024-04-19T02:59:06.930 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python3-kubernetes (7.0.0~a1-2) ... 2024-04-19T02:59:06.940 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../064-python3-wcwidth_0.1.8+dfsg1-3_all.deb ... 2024-04-19T02:59:06.956 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-blinker. 2024-04-19T02:59:06.976 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../083-python3-blinker_1.4+dfsg1-0.3ubuntu1_all.deb ... 2024-04-19T02:59:07.006 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-wcwidth (0.1.8+dfsg1-3) ... 2024-04-19T02:59:07.014 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2024-04-19T02:59:07.270 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-rsa. 2024-04-19T02:59:07.288 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../081-python3-rsa_4.0-3_all.deb ... 2024-04-19T02:59:07.328 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-rsa (4.0-3) ... 2024-04-19T02:59:07.342 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-pytest. 2024-04-19T02:59:07.351 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-oauthlib. 2024-04-19T02:59:07.360 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../065-python3-pytest_4.6.9-1_all.deb ... 2024-04-19T02:59:07.371 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../084-python3-oauthlib_3.1.0-1ubuntu2_all.deb ... 2024-04-19T02:59:07.400 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-pytest (4.6.9-1) ... 2024-04-19T02:59:07.409 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-oauthlib (3.1.0-1ubuntu2) ... 2024-04-19T02:59:07.708 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-google-auth. 2024-04-19T02:59:07.724 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../082-python3-google-auth_1.5.1-2_all.deb ... 2024-04-19T02:59:07.766 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-google-auth (1.5.1-2) ... 2024-04-19T02:59:07.771 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-04-19T02:59:07.779 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-repoze.lru. 2024-04-19T02:59:07.787 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../085-python3-requests-oauthlib_1.0.0-1.1build1_all.deb ... 2024-04-19T02:59:07.798 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../066-python3-repoze.lru_0.7-2_all.deb ... 2024-04-19T02:59:07.829 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-requests-oauthlib (1.0.0-1.1build1) ... 2024-04-19T02:59:07.837 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-04-19T02:59:07.877 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python3-rbd (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T02:59:08.002 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up rbd-fuse (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T02:59:08.115 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package libjs-underscore. 2024-04-19T02:59:08.128 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python3-rgw (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T02:59:08.131 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../067-libjs-underscore_1.9.1~dfsg-1ubuntu0.20.04.1_all.deb ... 2024-04-19T02:59:08.145 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-blinker. 2024-04-19T02:59:08.163 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../083-python3-blinker_1.4+dfsg1-0.3ubuntu1_all.deb ... 2024-04-19T02:59:08.182 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-websocket. 2024-04-19T02:59:08.198 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2024-04-19T02:59:08.199 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../086-python3-websocket_0.53.0-2ubuntu1_all.deb ... 2024-04-19T02:59:08.203 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2024-04-19T02:59:08.241 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-websocket (0.53.0-2ubuntu1) ... 2024-04-19T02:59:08.262 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up python3-cephfs (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T02:59:08.388 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up ceph-common (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T02:59:08.492 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package libjs-sphinxdoc. 2024-04-19T02:59:08.508 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../068-libjs-sphinxdoc_1.8.5-7ubuntu3_all.deb ... 2024-04-19T02:59:08.542 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2024-04-19T02:59:08.571 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-oauthlib. 2024-04-19T02:59:08.579 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-kubernetes. 2024-04-19T02:59:08.590 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../084-python3-oauthlib_3.1.0-1ubuntu2_all.deb ... 2024-04-19T02:59:08.597 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../087-python3-kubernetes_7.0.0~a1-2_all.deb ... 2024-04-19T02:59:08.641 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-oauthlib (3.1.0-1ubuntu2) ... 2024-04-19T02:59:08.662 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-kubernetes (7.0.0~a1-2) ... 2024-04-19T02:59:08.928 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-routes. 2024-04-19T02:59:08.946 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../069-python3-routes_2.4.1-2_all.deb ... 2024-04-19T02:59:08.966 INFO:teuthology.orchestra.run.smithi144.stdout:Adding group ceph....done 2024-04-19T02:59:08.986 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-routes (2.4.1-2) ... 2024-04-19T02:59:08.995 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-04-19T02:59:09.012 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../085-python3-requests-oauthlib_1.0.0-1.1build1_all.deb ... 2024-04-19T02:59:09.086 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-requests-oauthlib (1.0.0-1.1build1) ... 2024-04-19T02:59:09.217 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-04-19T02:59:09.234 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../088-ceph-mgr-k8sevents_18.2.2-1237-g646b8c7d-1focal_all.deb ... 2024-04-19T02:59:09.275 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking ceph-mgr-k8sevents (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T02:59:09.318 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-04-19T02:59:09.330 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../070-ceph-mgr-dashboard_18.2.2-1237-g646b8c7d-1focal_all.deb ... 2024-04-19T02:59:09.351 INFO:teuthology.orchestra.run.smithi144.stdout:Adding system user ceph....done 2024-04-19T02:59:09.394 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking ceph-mgr-dashboard (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T02:59:09.422 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-websocket. 2024-04-19T02:59:09.440 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../086-python3-websocket_0.53.0-2ubuntu1_all.deb ... 2024-04-19T02:59:09.506 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-websocket (0.53.0-2ubuntu1) ... 2024-04-19T02:59:09.519 INFO:teuthology.orchestra.run.smithi144.stdout:Setting system user ceph properties....done 2024-04-19T02:59:09.544 INFO:teuthology.orchestra.run.smithi144.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-04-19T02:59:09.637 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package libonig5:amd64. 2024-04-19T02:59:09.654 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../089-libonig5_6.9.4-1_amd64.deb ... 2024-04-19T02:59:09.694 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-04-19T02:59:09.720 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking libonig5:amd64 (6.9.4-1) ... 2024-04-19T02:59:09.826 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-kubernetes. 2024-04-19T02:59:09.842 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../087-python3-kubernetes_7.0.0~a1-2_all.deb ... 2024-04-19T02:59:09.884 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-kubernetes (7.0.0~a1-2) ... 2024-04-19T02:59:10.009 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-04-19T02:59:10.063 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package libjq1:amd64. 2024-04-19T02:59:10.081 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../090-libjq1_1.6-1ubuntu0.20.04.1_amd64.deb ... 2024-04-19T02:59:10.122 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2024-04-19T02:59:10.426 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package jq. 2024-04-19T02:59:10.445 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../091-jq_1.6-1ubuntu0.20.04.1_amd64.deb ... 2024-04-19T02:59:10.448 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up ceph-test (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T02:59:10.484 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking jq (1.6-1ubuntu0.20.04.1) ... 2024-04-19T02:59:10.548 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-04-19T02:59:10.564 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../088-ceph-mgr-k8sevents_18.2.2-1237-g646b8c7d-1focal_all.deb ... 2024-04-19T02:59:10.606 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking ceph-mgr-k8sevents (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T02:59:10.608 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up radosgw (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T02:59:10.737 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package socat. 2024-04-19T02:59:10.753 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../092-socat_1.7.3.3-2_amd64.deb ... 2024-04-19T02:59:10.811 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking socat (1.7.3.3-2) ... 2024-04-19T02:59:10.863 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-decorator. 2024-04-19T02:59:10.879 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../071-python3-decorator_4.4.2-0ubuntu1_all.deb ... 2024-04-19T02:59:10.922 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-decorator (4.4.2-0ubuntu1) ... 2024-04-19T02:59:10.992 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libonig5:amd64. 2024-04-19T02:59:11.009 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../089-libonig5_6.9.4-1_amd64.deb ... 2024-04-19T02:59:11.050 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libonig5:amd64 (6.9.4-1) ... 2024-04-19T02:59:11.093 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-19T02:59:11.093 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-19T02:59:11.157 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package xmlstarlet. 2024-04-19T02:59:11.174 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../093-xmlstarlet_1.6.1-2build1_amd64.deb ... 2024-04-19T02:59:11.215 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking xmlstarlet (1.6.1-2build1) ... 2024-04-19T02:59:11.283 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package liblbfgsb0:amd64. 2024-04-19T02:59:11.300 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../072-liblbfgsb0_3.0+dfsg.3-7build1_amd64.deb ... 2024-04-19T02:59:11.341 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2024-04-19T02:59:11.461 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libjq1:amd64. 2024-04-19T02:59:11.480 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../090-libjq1_1.6-1ubuntu0.20.04.1_amd64.deb ... 2024-04-19T02:59:11.519 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2024-04-19T02:59:11.526 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up ceph-base (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T02:59:11.586 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package ceph-test. 2024-04-19T02:59:11.602 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../094-ceph-test_18.2.2-1237-g646b8c7d-1focal_amd64.deb ... 2024-04-19T02:59:11.644 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking ceph-test (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T02:59:11.744 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-scipy. 2024-04-19T02:59:11.763 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../073-python3-scipy_1.3.3-3build1_amd64.deb ... 2024-04-19T02:59:11.803 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-scipy (1.3.3-3build1) ... 2024-04-19T02:59:11.856 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package jq. 2024-04-19T02:59:11.878 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../091-jq_1.6-1ubuntu0.20.04.1_amd64.deb ... 2024-04-19T02:59:11.885 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-04-19T02:59:11.914 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking jq (1.6-1ubuntu0.20.04.1) ... 2024-04-19T02:59:12.205 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package socat. 2024-04-19T02:59:12.218 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../092-socat_1.7.3.3-2_amd64.deb ... 2024-04-19T02:59:12.259 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking socat (1.7.3.3-2) ... 2024-04-19T02:59:12.304 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up ceph-mds (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T02:59:12.529 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-19T02:59:12.529 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-19T02:59:12.612 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package xmlstarlet. 2024-04-19T02:59:12.631 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../093-xmlstarlet_1.6.1-2build1_amd64.deb ... 2024-04-19T02:59:12.670 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking xmlstarlet (1.6.1-2build1) ... 2024-04-19T02:59:12.980 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up ceph-mgr (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T02:59:13.058 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package ceph-test. 2024-04-19T02:59:13.077 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../094-ceph-test_18.2.2-1237-g646b8c7d-1focal_amd64.deb ... 2024-04-19T02:59:13.116 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking ceph-test (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T02:59:13.176 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-sklearn-lib. 2024-04-19T02:59:13.199 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../074-python3-sklearn-lib_0.22.2.post1+dfsg-5_amd64.deb ... 2024-04-19T02:59:13.203 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-19T02:59:13.203 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-19T02:59:13.234 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2024-04-19T02:59:13.673 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up ceph-osd (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T02:59:13.822 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-joblib. 2024-04-19T02:59:13.839 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../075-python3-joblib_0.14.0-3_all.deb ... 2024-04-19T02:59:13.879 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-joblib (0.14.0-3) ... 2024-04-19T02:59:14.169 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-19T02:59:14.169 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-19T02:59:14.300 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-sklearn. 2024-04-19T02:59:14.316 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../076-python3-sklearn_0.22.2.post1+dfsg-5_all.deb ... 2024-04-19T02:59:14.357 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-sklearn (0.22.2.post1+dfsg-5) ... 2024-04-19T02:59:14.616 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up ceph-mgr-k8sevents (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T02:59:14.742 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up ceph-mgr-diskprediction-local (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T02:59:14.910 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up ceph-mon (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T02:59:15.134 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-19T02:59:15.135 INFO:teuthology.orchestra.run.smithi144.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-19T02:59:15.174 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-04-19T02:59:15.194 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../077-ceph-mgr-diskprediction-local_18.2.2-1237-g646b8c7d-1focal_all.deb ... 2024-04-19T02:59:15.232 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking ceph-mgr-diskprediction-local (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T02:59:15.670 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up ceph-mgr-cephadm (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T02:59:15.813 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up ceph (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T02:59:15.865 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package ceph-volume. 2024-04-19T02:59:15.882 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../095-ceph-volume_18.2.2-1237-g646b8c7d-1focal_all.deb ... 2024-04-19T02:59:15.923 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking ceph-volume (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T02:59:15.972 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up ceph-mgr-dashboard (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T02:59:16.115 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up ceph-volume (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T02:59:16.235 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package fonts-mathjax. 2024-04-19T02:59:16.255 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../096-fonts-mathjax_2.7.4+dfsg-1_all.deb ... 2024-04-19T02:59:16.293 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking fonts-mathjax (2.7.4+dfsg-1) ... 2024-04-19T02:59:16.426 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-cachetools. 2024-04-19T02:59:16.443 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../078-python3-cachetools_4.0.0-1_all.deb ... 2024-04-19T02:59:16.484 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-cachetools (4.0.0-1) ... 2024-04-19T02:59:16.493 INFO:teuthology.orchestra.run.smithi144.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2024-04-19T02:59:16.645 INFO:teuthology.orchestra.run.smithi144.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2024-04-19T02:59:16.805 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package libcephfs-dev. 2024-04-19T02:59:16.824 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../097-libcephfs-dev_18.2.2-1237-g646b8c7d-1focal_amd64.deb ... 2024-04-19T02:59:16.862 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-pyasn1. 2024-04-19T02:59:16.863 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking libcephfs-dev (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T02:59:16.880 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../079-python3-pyasn1_0.4.2-3build1_all.deb ... 2024-04-19T02:59:16.920 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-pyasn1 (0.4.2-3build1) ... 2024-04-19T02:59:16.921 INFO:teuthology.orchestra.run.smithi144.stdout:Processing triggers for man-db (2.9.1-1) ... 2024-04-19T02:59:17.315 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-04-19T02:59:17.332 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../080-python3-pyasn1-modules_0.2.1-0.2build1_all.deb ... 2024-04-19T02:59:17.342 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package nvme-cli. 2024-04-19T02:59:17.361 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../098-nvme-cli_1.9-1ubuntu0.1_amd64.deb ... 2024-04-19T02:59:17.373 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2build1) ... 2024-04-19T02:59:17.418 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking nvme-cli (1.9-1ubuntu0.1) ... 2024-04-19T02:59:17.445 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package ceph-volume. 2024-04-19T02:59:17.464 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../095-ceph-volume_18.2.2-1237-g646b8c7d-1focal_all.deb ... 2024-04-19T02:59:17.536 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking ceph-volume (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T02:59:17.773 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-04-19T02:59:17.787 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-rsa. 2024-04-19T02:59:17.792 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../099-python-asyncssh-doc_1.12.2-1_all.deb ... 2024-04-19T02:59:17.806 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../081-python3-rsa_4.0-3_all.deb ... 2024-04-19T02:59:17.831 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python-asyncssh-doc (1.12.2-1) ... 2024-04-19T02:59:17.836 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-rsa (4.0-3) ... 2024-04-19T02:59:17.865 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package fonts-mathjax. 2024-04-19T02:59:17.884 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../096-fonts-mathjax_2.7.4+dfsg-1_all.deb ... 2024-04-19T02:59:17.925 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking fonts-mathjax (2.7.4+dfsg-1) ... 2024-04-19T02:59:18.226 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package libjs-mathjax. 2024-04-19T02:59:18.245 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../100-libjs-mathjax_2.7.4+dfsg-1_all.deb ... 2024-04-19T02:59:18.284 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking libjs-mathjax (2.7.4+dfsg-1) ... 2024-04-19T02:59:18.424 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-google-auth. 2024-04-19T02:59:18.441 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../082-python3-google-auth_1.5.1-2_all.deb ... 2024-04-19T02:59:18.482 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-google-auth (1.5.1-2) ... 2024-04-19T02:59:18.512 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libcephfs-dev. 2024-04-19T02:59:18.529 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../097-libcephfs-dev_18.2.2-1237-g646b8c7d-1focal_amd64.deb ... 2024-04-19T02:59:18.570 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libcephfs-dev (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T02:59:18.869 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-blinker. 2024-04-19T02:59:18.885 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../083-python3-blinker_1.4+dfsg1-0.3ubuntu1_all.deb ... 2024-04-19T02:59:18.935 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2024-04-19T02:59:19.014 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package nvme-cli. 2024-04-19T02:59:19.032 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../098-nvme-cli_1.9-1ubuntu0.1_amd64.deb ... 2024-04-19T02:59:19.090 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking nvme-cli (1.9-1ubuntu0.1) ... 2024-04-19T02:59:19.273 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-oauthlib. 2024-04-19T02:59:19.291 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../084-python3-oauthlib_3.1.0-1ubuntu2_all.deb ... 2024-04-19T02:59:19.356 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-oauthlib (3.1.0-1ubuntu2) ... 2024-04-19T02:59:19.428 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-04-19T02:59:19.448 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../099-python-asyncssh-doc_1.12.2-1_all.deb ... 2024-04-19T02:59:19.487 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python-asyncssh-doc (1.12.2-1) ... 2024-04-19T02:59:19.701 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-04-19T02:59:19.721 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../085-python3-requests-oauthlib_1.0.0-1.1build1_all.deb ... 2024-04-19T02:59:19.759 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-requests-oauthlib (1.0.0-1.1build1) ... 2024-04-19T02:59:19.798 INFO:teuthology.orchestra.run.smithi144.stdout:Processing triggers for fontconfig (2.13.1-2ubuntu3) ... 2024-04-19T02:59:19.915 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python-natsort-doc. 2024-04-19T02:59:19.923 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libjs-mathjax. 2024-04-19T02:59:19.937 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../101-python-natsort-doc_7.0.1-1_all.deb ... 2024-04-19T02:59:19.939 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../100-libjs-mathjax_2.7.4+dfsg-1_all.deb ... 2024-04-19T02:59:19.981 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libjs-mathjax (2.7.4+dfsg-1) ... 2024-04-19T02:59:20.015 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python-natsort-doc (7.0.1-1) ... 2024-04-19T02:59:20.138 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-websocket. 2024-04-19T02:59:20.154 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../086-python3-websocket_0.53.0-2ubuntu1_all.deb ... 2024-04-19T02:59:20.195 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-websocket (0.53.0-2ubuntu1) ... 2024-04-19T02:59:20.361 INFO:teuthology.orchestra.run.smithi144.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-19T02:59:20.364 DEBUG:teuthology.orchestra.run.smithi144:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev libaio-dev libtool-bin uuid-dev xfslibs-dev 2024-04-19T02:59:20.368 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-webencodings. 2024-04-19T02:59:20.389 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../102-python3-webencodings_0.5.1-1ubuntu1_all.deb ... 2024-04-19T02:59:20.418 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-webencodings (0.5.1-1ubuntu1) ... 2024-04-19T02:59:20.434 INFO:teuthology.orchestra.run.smithi144.stdout:Reading package lists... 2024-04-19T02:59:20.574 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-kubernetes. 2024-04-19T02:59:20.594 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../087-python3-kubernetes_7.0.0~a1-2_all.deb ... 2024-04-19T02:59:20.631 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-kubernetes (7.0.0~a1-2) ... 2024-04-19T02:59:20.649 INFO:teuthology.orchestra.run.smithi144.stdout:Building dependency tree... 2024-04-19T02:59:20.649 INFO:teuthology.orchestra.run.smithi144.stdout:Reading state information... 2024-04-19T02:59:20.764 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-html5lib. 2024-04-19T02:59:20.785 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../103-python3-html5lib_1.0.1-2_all.deb ... 2024-04-19T02:59:20.822 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-html5lib (1.0.1-2) ... 2024-04-19T02:59:20.862 INFO:teuthology.orchestra.run.smithi144.stdout:bison is already the newest version (2:3.5.1+dfsg-1). 2024-04-19T02:59:20.862 INFO:teuthology.orchestra.run.smithi144.stdout:flex is already the newest version (2.6.4-6.2). 2024-04-19T02:59:20.862 INFO:teuthology.orchestra.run.smithi144.stdout:libtool-bin is already the newest version (2.4.6-14). 2024-04-19T02:59:20.862 INFO:teuthology.orchestra.run.smithi144.stdout:xfslibs-dev is already the newest version (5.3.0-1ubuntu2). 2024-04-19T02:59:20.862 INFO:teuthology.orchestra.run.smithi144.stdout:The following packages were automatically installed and are no longer required: 2024-04-19T02:59:20.863 INFO:teuthology.orchestra.run.smithi144.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2024-04-19T02:59:20.863 INFO:teuthology.orchestra.run.smithi144.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-19T02:59:20.864 INFO:teuthology.orchestra.run.smithi144.stdout:Suggested packages: 2024-04-19T02:59:20.864 INFO:teuthology.orchestra.run.smithi144.stdout: libssl-doc 2024-04-19T02:59:20.904 INFO:teuthology.orchestra.run.smithi144.stdout:The following NEW packages will be installed: 2024-04-19T02:59:20.905 INFO:teuthology.orchestra.run.smithi144.stdout: libaio-dev libelf-dev libssl-dev 2024-04-19T02:59:20.907 INFO:teuthology.orchestra.run.smithi144.stdout:The following packages will be upgraded: 2024-04-19T02:59:20.907 INFO:teuthology.orchestra.run.smithi144.stdout: libdw1 libelf1 libssl1.1 libuuid1 uuid-dev 2024-04-19T02:59:20.983 INFO:teuthology.orchestra.run.smithi144.stdout:5 upgraded, 3 newly installed, 0 to remove and 272 not upgraded. 2024-04-19T02:59:20.983 INFO:teuthology.orchestra.run.smithi144.stdout:Need to get 3,303 kB of archives. 2024-04-19T02:59:20.983 INFO:teuthology.orchestra.run.smithi144.stdout:After this operation, 8,471 kB of additional disk space will be used. 2024-04-19T02:59:20.983 INFO:teuthology.orchestra.run.smithi144.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 uuid-dev amd64 2.34-0.1ubuntu9.6 [33.6 kB] 2024-04-19T02:59:21.049 INFO:teuthology.orchestra.run.smithi144.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libuuid1 amd64 2.34-0.1ubuntu9.6 [20.0 kB] 2024-04-19T02:59:21.061 INFO:teuthology.orchestra.run.smithi144.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libdw1 amd64 0.176-1.1ubuntu0.1 [226 kB] 2024-04-19T02:59:21.136 INFO:teuthology.orchestra.run.smithi144.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libelf1 amd64 0.176-1.1ubuntu0.1 [44.2 kB] 2024-04-19T02:59:21.143 INFO:teuthology.orchestra.run.smithi144.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl1.1 amd64 1.1.1f-1ubuntu2.22 [1,323 kB] 2024-04-19T02:59:21.186 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-lxml:amd64. 2024-04-19T02:59:21.202 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../104-python3-lxml_4.5.0-1ubuntu0.5_amd64.deb ... 2024-04-19T02:59:21.212 INFO:teuthology.orchestra.run.smithi144.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal/main amd64 libaio-dev amd64 0.3.112-5 [13.7 kB] 2024-04-19T02:59:21.212 INFO:teuthology.orchestra.run.smithi144.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libelf-dev amd64 0.176-1.1ubuntu0.1 [57.1 kB] 2024-04-19T02:59:21.213 INFO:teuthology.orchestra.run.smithi144.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl-dev amd64 1.1.1f-1ubuntu2.22 [1,586 kB] 2024-04-19T02:59:21.220 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-04-19T02:59:21.238 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../088-ceph-mgr-k8sevents_18.2.2-1237-g646b8c7d-1focal_all.deb ... 2024-04-19T02:59:21.243 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2024-04-19T02:59:21.303 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking ceph-mgr-k8sevents (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T02:59:21.552 INFO:teuthology.orchestra.run.smithi144.stdout:Preconfiguring packages ... 2024-04-19T02:59:21.681 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package libonig5:amd64. 2024-04-19T02:59:21.691 INFO:teuthology.orchestra.run.smithi144.stdout:Fetched 3,303 kB in 0s (9,972 kB/s) 2024-04-19T02:59:21.697 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../089-libonig5_6.9.4-1_amd64.deb ... 2024-04-19T02:59:21.739 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking libonig5:amd64 (6.9.4-1) ... 2024-04-19T02:59:21.755 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-pastescript. 2024-04-19T02:59:21.772 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../105-python3-pastescript_2.0.2-4_all.deb ... 2024-04-19T02:59:21.833 INFO:teuthology.orchestra.run.smithi144.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 153031 files and directories currently installed.) 2024-04-19T02:59:21.837 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../uuid-dev_2.34-0.1ubuntu9.6_amd64.deb ... 2024-04-19T02:59:21.839 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-04-19T02:59:21.970 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking uuid-dev:amd64 (2.34-0.1ubuntu9.6) over (2.34-0.1ubuntu9.3) ... 2024-04-19T02:59:22.059 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python-natsort-doc. 2024-04-19T02:59:22.077 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../101-python-natsort-doc_7.0.1-1_all.deb ... 2024-04-19T02:59:22.117 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python-natsort-doc (7.0.1-1) ... 2024-04-19T02:59:22.133 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package libjq1:amd64. 2024-04-19T02:59:22.149 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../090-libjq1_1.6-1ubuntu0.20.04.1_amd64.deb ... 2024-04-19T02:59:22.191 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2024-04-19T02:59:22.211 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-psutil. 2024-04-19T02:59:22.228 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../106-python3-psutil_5.5.1-1ubuntu4_amd64.deb ... 2024-04-19T02:59:22.269 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-psutil (5.5.1-1ubuntu4) ... 2024-04-19T02:59:22.435 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../libuuid1_2.34-0.1ubuntu9.6_amd64.deb ... 2024-04-19T02:59:22.503 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package jq. 2024-04-19T02:59:22.520 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../091-jq_1.6-1ubuntu0.20.04.1_amd64.deb ... 2024-04-19T02:59:22.522 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-webencodings. 2024-04-19T02:59:22.543 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../102-python3-webencodings_0.5.1-1ubuntu1_all.deb ... 2024-04-19T02:59:22.561 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking jq (1.6-1ubuntu0.20.04.1) ... 2024-04-19T02:59:22.581 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-webencodings (0.5.1-1ubuntu1) ... 2024-04-19T02:59:22.613 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-pyinotify. 2024-04-19T02:59:22.633 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../107-python3-pyinotify_0.9.6-1.2ubuntu1_all.deb ... 2024-04-19T02:59:22.634 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking libuuid1:amd64 (2.34-0.1ubuntu9.6) over (2.34-0.1ubuntu9.3) ... 2024-04-19T02:59:22.671 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-pyinotify (0.9.6-1.2ubuntu1) ... 2024-04-19T02:59:22.855 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package socat. 2024-04-19T02:59:22.872 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../092-socat_1.7.3.3-2_amd64.deb ... 2024-04-19T02:59:22.913 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking socat (1.7.3.3-2) ... 2024-04-19T02:59:22.934 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-html5lib. 2024-04-19T02:59:22.951 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../103-python3-html5lib_1.0.1-2_all.deb ... 2024-04-19T02:59:22.984 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-html5lib (1.0.1-2) ... 2024-04-19T02:59:22.985 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up libuuid1:amd64 (2.34-0.1ubuntu9.6) ... 2024-04-19T02:59:23.007 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package python3-simplejson. 2024-04-19T02:59:23.024 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../108-python3-simplejson_3.16.0-2ubuntu2_amd64.deb ... 2024-04-19T02:59:23.065 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking python3-simplejson (3.16.0-2ubuntu2) ... 2024-04-19T02:59:23.283 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package xmlstarlet. 2024-04-19T02:59:23.300 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../093-xmlstarlet_1.6.1-2build1_amd64.deb ... 2024-04-19T02:59:23.341 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking xmlstarlet (1.6.1-2build1) ... 2024-04-19T02:59:23.379 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-04-19T02:59:23.396 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-lxml:amd64. 2024-04-19T02:59:23.400 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../109-qttranslations5-l10n_5.12.8-0ubuntu1_all.deb ... 2024-04-19T02:59:23.413 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../104-python3-lxml_4.5.0-1ubuntu0.5_amd64.deb ... 2024-04-19T02:59:23.437 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking qttranslations5-l10n (5.12.8-0ubuntu1) ... 2024-04-19T02:59:23.445 INFO:teuthology.orchestra.run.smithi144.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 153031 files and directories currently installed.) 2024-04-19T02:59:23.450 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../0-libdw1_0.176-1.1ubuntu0.1_amd64.deb ... 2024-04-19T02:59:23.454 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2024-04-19T02:59:23.583 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking libdw1:amd64 (0.176-1.1ubuntu0.1) over (0.176-1.1build1) ... 2024-04-19T02:59:23.762 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package ceph-test. 2024-04-19T02:59:23.778 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../094-ceph-test_18.2.2-1237-g646b8c7d-1focal_amd64.deb ... 2024-04-19T02:59:23.820 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking ceph-test (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T02:59:23.984 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-pastescript. 2024-04-19T02:59:24.001 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../105-python3-pastescript_2.0.2-4_all.deb ... 2024-04-19T02:59:24.069 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-04-19T02:59:24.082 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../1-libelf1_0.176-1.1ubuntu0.1_amd64.deb ... 2024-04-19T02:59:24.174 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package radosgw. 2024-04-19T02:59:24.193 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../110-radosgw_18.2.2-1237-g646b8c7d-1focal_amd64.deb ... 2024-04-19T02:59:24.214 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking libelf1:amd64 (0.176-1.1ubuntu0.1) over (0.176-1.1build1) ... 2024-04-19T02:59:24.232 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking radosgw (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T02:59:24.416 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-psutil. 2024-04-19T02:59:24.433 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../106-python3-psutil_5.5.1-1ubuntu4_amd64.deb ... 2024-04-19T02:59:24.506 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-psutil (5.5.1-1ubuntu4) ... 2024-04-19T02:59:24.711 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../2-libssl1.1_1.1.1f-1ubuntu2.22_amd64.deb ... 2024-04-19T02:59:24.851 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-pyinotify. 2024-04-19T02:59:24.869 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking libssl1.1:amd64 (1.1.1f-1ubuntu2.22) over (1.1.1f-1ubuntu2.16) ... 2024-04-19T02:59:24.871 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../107-python3-pyinotify_0.9.6-1.2ubuntu1_all.deb ... 2024-04-19T02:59:24.909 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-pyinotify (0.9.6-1.2ubuntu1) ... 2024-04-19T02:59:25.281 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-04-19T02:59:25.286 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package python3-simplejson. 2024-04-19T02:59:25.301 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../3-libaio-dev_0.3.112-5_amd64.deb ... 2024-04-19T02:59:25.305 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../108-python3-simplejson_3.16.0-2ubuntu2_amd64.deb ... 2024-04-19T02:59:25.331 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking libaio-dev:amd64 (0.3.112-5) ... 2024-04-19T02:59:25.370 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking python3-simplejson (3.16.0-2ubuntu2) ... 2024-04-19T02:59:25.609 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-04-19T02:59:25.626 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../4-libelf-dev_0.176-1.1ubuntu0.1_amd64.deb ... 2024-04-19T02:59:25.667 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking libelf-dev:amd64 (0.176-1.1ubuntu0.1) ... 2024-04-19T02:59:25.668 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package rbd-fuse. 2024-04-19T02:59:25.686 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../111-rbd-fuse_18.2.2-1237-g646b8c7d-1focal_amd64.deb ... 2024-04-19T02:59:25.698 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-04-19T02:59:25.714 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../109-qttranslations5-l10n_5.12.8-0ubuntu1_all.deb ... 2024-04-19T02:59:25.726 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking rbd-fuse (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T02:59:25.756 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking qttranslations5-l10n (5.12.8-0ubuntu1) ... 2024-04-19T02:59:26.062 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-attr (19.3.0-2) ... 2024-04-19T02:59:26.138 INFO:teuthology.orchestra.run.smithi144.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-04-19T02:59:26.155 INFO:teuthology.orchestra.run.smithi144.stdout:Preparing to unpack .../5-libssl-dev_1.1.1f-1ubuntu2.22_amd64.deb ... 2024-04-19T02:59:26.196 INFO:teuthology.orchestra.run.smithi144.stdout:Unpacking libssl-dev:amd64 (1.1.1f-1ubuntu2.22) ... 2024-04-19T02:59:26.381 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up librabbitmq4:amd64 (0.10.0-1) ... 2024-04-19T02:59:26.510 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package radosgw. 2024-04-19T02:59:26.515 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2024-04-19T02:59:26.528 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../110-radosgw_18.2.2-1237-g646b8c7d-1focal_amd64.deb ... 2024-04-19T02:59:26.595 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking radosgw (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T02:59:26.624 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up nvme-cli (1.9-1ubuntu0.1) ... 2024-04-19T02:59:26.667 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up libssl1.1:amd64 (1.1.1f-1ubuntu2.22) ... 2024-04-19T02:59:26.851 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up cephadm (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T02:59:26.976 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up libaio-dev:amd64 (0.3.112-5) ... 2024-04-19T02:59:27.127 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up uuid-dev:amd64 (2.34-0.1ubuntu9.6) ... 2024-04-19T02:59:27.253 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up libssl-dev:amd64 (1.1.1f-1ubuntu2.22) ... 2024-04-19T02:59:27.379 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up libelf1:amd64 (0.176-1.1ubuntu0.1) ... 2024-04-19T02:59:27.435 INFO:teuthology.orchestra.run.smithi096.stdout:Adding system user cephadm....done 2024-04-19T02:59:27.538 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up libdw1:amd64 (0.176-1.1ubuntu0.1) ... 2024-04-19T02:59:27.632 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up fonts-mathjax (2.7.4+dfsg-1) ... 2024-04-19T02:59:27.689 INFO:teuthology.orchestra.run.smithi144.stdout:Setting up libelf-dev:amd64 (0.176-1.1ubuntu0.1) ... 2024-04-19T02:59:27.758 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-waitress (1.4.1-1ubuntu0.1) ... 2024-04-19T02:59:27.836 INFO:teuthology.orchestra.run.smithi144.stdout:Processing triggers for man-db (2.9.1-1) ... 2024-04-19T02:59:28.029 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package rbd-fuse. 2024-04-19T02:59:28.046 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../111-rbd-fuse_18.2.2-1237-g646b8c7d-1focal_amd64.deb ... 2024-04-19T02:59:28.074 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package ceph-volume. 2024-04-19T02:59:28.087 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking rbd-fuse (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T02:59:28.092 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../095-ceph-volume_18.2.2-1237-g646b8c7d-1focal_all.deb ... 2024-04-19T02:59:28.101 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-04-19T02:59:28.132 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking ceph-volume (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T02:59:28.394 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up libjs-mathjax (2.7.4+dfsg-1) ... 2024-04-19T02:59:28.442 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-attr (19.3.0-2) ... 2024-04-19T02:59:28.478 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package fonts-mathjax. 2024-04-19T02:59:28.495 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../096-fonts-mathjax_2.7.4+dfsg-1_all.deb ... 2024-04-19T02:59:28.512 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up liboath0 (2.6.1-1.3) ... 2024-04-19T02:59:28.536 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking fonts-mathjax (2.7.4+dfsg-1) ... 2024-04-19T02:59:28.663 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-py (1.8.1-1ubuntu0.1) ... 2024-04-19T02:59:28.750 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up librabbitmq4:amd64 (0.10.0-1) ... 2024-04-19T02:59:28.901 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2024-04-19T02:59:29.006 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-joblib (0.14.0-3) ... 2024-04-19T02:59:29.018 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up nvme-cli (1.9-1ubuntu0.1) ... 2024-04-19T02:59:29.132 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package libcephfs-dev. 2024-04-19T02:59:29.151 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../097-libcephfs-dev_18.2.2-1237-g646b8c7d-1focal_amd64.deb ... 2024-04-19T02:59:29.214 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking libcephfs-dev (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T02:59:29.237 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up cephadm (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T02:59:29.327 INFO:teuthology.orchestra.run.smithi144.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2024-04-19T02:59:29.424 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-jwt (1.7.1-2ubuntu2.1) ... 2024-04-19T02:59:29.568 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package nvme-cli. 2024-04-19T02:59:29.587 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../098-nvme-cli_1.9-1ubuntu0.1_amd64.deb ... 2024-04-19T02:59:29.666 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking nvme-cli (1.9-1ubuntu0.1) ... 2024-04-19T02:59:29.751 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-cachetools (4.0.0-1) ... 2024-04-19T02:59:29.816 INFO:teuthology.orchestra.run.smithi144.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-19T02:59:29.820 DEBUG:teuthology.parallel:result is None 2024-04-19T02:59:29.871 INFO:teuthology.orchestra.run.smithi097.stdout:Adding system user cephadm....done 2024-04-19T02:59:30.006 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-04-19T02:59:30.023 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../099-python-asyncssh-doc_1.12.2-1_all.deb ... 2024-04-19T02:59:30.051 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up fonts-mathjax (2.7.4+dfsg-1) ... 2024-04-19T02:59:30.064 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python-asyncssh-doc (1.12.2-1) ... 2024-04-19T02:59:30.069 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-bcrypt (3.1.7-2ubuntu1) ... 2024-04-19T02:59:30.178 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-waitress (1.4.1-1ubuntu0.1) ... 2024-04-19T02:59:30.345 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-pyinotify (0.9.6-1.2ubuntu1) ... 2024-04-19T02:59:30.509 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package libjs-mathjax. 2024-04-19T02:59:30.525 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../100-libjs-mathjax_2.7.4+dfsg-1_all.deb ... 2024-04-19T02:59:30.570 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking libjs-mathjax (2.7.4+dfsg-1) ... 2024-04-19T02:59:30.579 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-04-19T02:59:30.662 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-ceph-argparse (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T02:59:30.930 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libjs-mathjax (2.7.4+dfsg-1) ... 2024-04-19T02:59:30.972 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2024-04-19T02:59:31.056 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up liboath0 (2.6.1-1.3) ... 2024-04-19T02:59:31.098 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-markupsafe (1.1.0-1build2) ... 2024-04-19T02:59:31.207 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-py (1.8.1-1ubuntu0.1) ... 2024-04-19T02:59:31.424 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-webencodings (0.5.1-1ubuntu1) ... 2024-04-19T02:59:31.559 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-joblib (0.14.0-3) ... 2024-04-19T02:59:31.733 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2024-04-19T02:59:31.892 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-psutil (5.5.1-1ubuntu4) ... 2024-04-19T02:59:32.011 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-jwt (1.7.1-2ubuntu2.1) ... 2024-04-19T02:59:32.277 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-natsort (7.0.1-1) ... 2024-04-19T02:59:32.337 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-cachetools (4.0.0-1) ... 2024-04-19T02:59:32.385 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python-natsort-doc. 2024-04-19T02:59:32.405 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../101-python-natsort-doc_7.0.1-1_all.deb ... 2024-04-19T02:59:32.459 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python-natsort-doc (7.0.1-1) ... 2024-04-19T02:59:32.561 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-atomicwrites (1.1.5-2build1) ... 2024-04-19T02:59:32.639 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-bcrypt (3.1.7-2ubuntu1) ... 2024-04-19T02:59:32.832 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-webencodings. 2024-04-19T02:59:32.849 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../102-python3-webencodings_0.5.1-1ubuntu1_all.deb ... 2024-04-19T02:59:32.854 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-simplejson (3.16.0-2ubuntu2) ... 2024-04-19T02:59:32.923 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-pyinotify (0.9.6-1.2ubuntu1) ... 2024-04-19T02:59:32.923 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-webencodings (0.5.1-1ubuntu1) ... 2024-04-19T02:59:33.238 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-decorator (4.4.2-0ubuntu1) ... 2024-04-19T02:59:33.243 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-html5lib. 2024-04-19T02:59:33.249 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-ceph-argparse (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T02:59:33.263 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../103-python3-html5lib_1.0.1-2_all.deb ... 2024-04-19T02:59:33.301 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-html5lib (1.0.1-2) ... 2024-04-19T02:59:33.550 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2024-04-19T02:59:33.564 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-jinja2 (2.10.1-2ubuntu0.2) ... 2024-04-19T02:59:33.696 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-lxml:amd64. 2024-04-19T02:59:33.701 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-markupsafe (1.1.0-1build2) ... 2024-04-19T02:59:33.713 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../104-python3-lxml_4.5.0-1ubuntu0.5_amd64.deb ... 2024-04-19T02:59:33.762 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2024-04-19T02:59:33.899 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-tempita (0.5.2-6) ... 2024-04-19T02:59:33.994 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-webencodings (0.5.1-1ubuntu1) ... 2024-04-19T02:59:34.192 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-packaging (20.3-1) ... 2024-04-19T02:59:34.269 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-pastescript. 2024-04-19T02:59:34.285 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../105-python3-pastescript_2.0.2-4_all.deb ... 2024-04-19T02:59:34.295 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2024-04-19T02:59:34.326 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-04-19T02:59:34.471 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-psutil (5.5.1-1ubuntu4) ... 2024-04-19T02:59:34.484 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python-pastedeploy-tpl (2.1.0-1) ... 2024-04-19T02:59:34.610 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up qttranslations5-l10n (5.12.8-0ubuntu1) ... 2024-04-19T02:59:34.705 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-psutil. 2024-04-19T02:59:34.722 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../106-python3-psutil_5.5.1-1ubuntu4_amd64.deb ... 2024-04-19T02:59:34.736 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-wcwidth (0.1.8+dfsg1-3) ... 2024-04-19T02:59:34.763 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-psutil (5.5.1-1ubuntu4) ... 2024-04-19T02:59:34.881 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-natsort (7.0.1-1) ... 2024-04-19T02:59:35.037 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-paste (3.4.0+dfsg1-1) ... 2024-04-19T02:59:35.158 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-pyinotify. 2024-04-19T02:59:35.176 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../107-python3-pyinotify_0.9.6-1.2ubuntu1_all.deb ... 2024-04-19T02:59:35.181 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-atomicwrites (1.1.5-2build1) ... 2024-04-19T02:59:35.216 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-pyinotify (0.9.6-1.2ubuntu1) ... 2024-04-19T02:59:35.464 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2024-04-19T02:59:35.524 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-simplejson (3.16.0-2ubuntu2) ... 2024-04-19T02:59:35.586 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-simplejson. 2024-04-19T02:59:35.606 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../108-python3-simplejson_3.16.0-2ubuntu2_amd64.deb ... 2024-04-19T02:59:35.643 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-simplejson (3.16.0-2ubuntu2) ... 2024-04-19T02:59:35.884 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-decorator (4.4.2-0ubuntu1) ... 2024-04-19T02:59:35.886 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-cryptography (2.8-3ubuntu0.3) ... 2024-04-19T02:59:35.955 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-04-19T02:59:35.972 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../109-qttranslations5-l10n_5.12.8-0ubuntu1_all.deb ... 2024-04-19T02:59:36.013 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking qttranslations5-l10n (5.12.8-0ubuntu1) ... 2024-04-19T02:59:36.218 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-jinja2 (2.10.1-2ubuntu0.2) ... 2024-04-19T02:59:36.275 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up socat (1.7.3.3-2) ... 2024-04-19T02:59:36.401 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-ceph-common (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T02:59:36.561 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-tempita (0.5.2-6) ... 2024-04-19T02:59:36.728 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-04-19T02:59:36.767 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package radosgw. 2024-04-19T02:59:36.785 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../110-radosgw_18.2.2-1237-g646b8c7d-1focal_amd64.deb ... 2024-04-19T02:59:36.825 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking radosgw (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T02:59:36.853 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-html5lib (1.0.1-2) ... 2024-04-19T02:59:36.904 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-packaging (20.3-1) ... 2024-04-19T02:59:37.205 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python-pastedeploy-tpl (2.1.0-1) ... 2024-04-19T02:59:37.213 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2024-04-19T02:59:37.364 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up xmlstarlet (1.6.1-2build1) ... 2024-04-19T02:59:37.365 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up qttranslations5-l10n (5.12.8-0ubuntu1) ... 2024-04-19T02:59:37.490 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-pluggy (0.13.0-2) ... 2024-04-19T02:59:37.491 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-wcwidth (0.1.8+dfsg1-3) ... 2024-04-19T02:59:37.766 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2024-04-19T02:59:37.833 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-paste (3.4.0+dfsg1-1) ... 2024-04-19T02:59:38.101 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-04-19T02:59:38.227 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2024-04-19T02:59:38.253 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package rbd-fuse. 2024-04-19T02:59:38.259 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2024-04-19T02:59:38.272 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../111-rbd-fuse_18.2.2-1237-g646b8c7d-1focal_amd64.deb ... 2024-04-19T02:59:38.336 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking rbd-fuse (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T02:59:38.353 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-pyasn1 (0.4.2-3build1) ... 2024-04-19T02:59:38.619 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-cryptography (2.8-3ubuntu0.3) ... 2024-04-19T02:59:38.680 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-attr (19.3.0-2) ... 2024-04-19T02:59:38.713 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-singledispatch (3.4.0.3-2build1) ... 2024-04-19T02:59:38.975 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up librabbitmq4:amd64 (0.10.0-1) ... 2024-04-19T02:59:39.021 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up socat (1.7.3.3-2) ... 2024-04-19T02:59:39.030 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-logutils (0.3.3-7) ... 2024-04-19T02:59:39.134 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2024-04-19T02:59:39.181 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-ceph-common (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T02:59:39.288 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up nvme-cli (1.9-1ubuntu0.1) ... 2024-04-19T02:59:39.331 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up liblttng-ust0:amd64 (2.11.0-1) ... 2024-04-19T02:59:39.458 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-04-19T02:59:39.495 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up cephadm (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T02:59:39.515 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-04-19T02:59:39.674 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-html5lib (1.0.1-2) ... 2024-04-19T02:59:39.770 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-prettytable (0.7.2-5) ... 2024-04-19T02:59:40.004 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2024-04-19T02:59:40.096 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-soupsieve (1.9.5+dfsg-1) ... 2024-04-19T02:59:40.129 INFO:teuthology.orchestra.run.smithi134.stdout:Adding system user cephadm....done 2024-04-19T02:59:40.155 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up xmlstarlet (1.6.1-2build1) ... 2024-04-19T02:59:40.314 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-pluggy (0.13.0-2) ... 2024-04-19T02:59:40.326 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up fonts-mathjax (2.7.4+dfsg-1) ... 2024-04-19T02:59:40.397 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-websocket (0.53.0-2ubuntu1) ... 2024-04-19T02:59:40.452 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-waitress (1.4.1-1ubuntu0.1) ... 2024-04-19T02:59:40.615 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2024-04-19T02:59:40.776 INFO:teuthology.orchestra.run.smithi096.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2024-04-19T02:59:40.846 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-04-19T02:59:40.933 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-04-19T02:59:41.049 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up libonig5:amd64 (6.9.4-1) ... 2024-04-19T02:59:41.101 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2024-04-19T02:59:41.130 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up libjs-mathjax (2.7.4+dfsg-1) ... 2024-04-19T02:59:41.175 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2024-04-19T02:59:41.260 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-pyasn1 (0.4.2-3build1) ... 2024-04-19T02:59:41.289 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up liboath0 (2.6.1-1.3) ... 2024-04-19T02:59:41.424 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-py (1.8.1-1ubuntu0.1) ... 2024-04-19T02:59:41.510 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-cherrypy3 (8.9.1-6) ... 2024-04-19T02:59:41.570 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-singledispatch (3.4.0.3-2build1) ... 2024-04-19T02:59:41.792 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-joblib (0.14.0-3) ... 2024-04-19T02:59:41.861 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2024-04-19T02:59:41.913 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-logutils (0.3.3-7) ... 2024-04-19T02:59:42.002 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2024-04-19T02:59:42.129 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-webob (1:1.8.5-2) ... 2024-04-19T02:59:42.206 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up liblttng-ust0:amd64 (2.11.0-1) ... 2024-04-19T02:59:42.244 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-jwt (1.7.1-2ubuntu2.1) ... 2024-04-19T02:59:42.359 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-04-19T02:59:42.466 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2024-04-19T02:59:42.546 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-cachetools (4.0.0-1) ... 2024-04-19T02:59:42.649 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-prettytable (0.7.2-5) ... 2024-04-19T02:59:42.782 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-scipy (1.3.3-3build1) ... 2024-04-19T02:59:42.839 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-bcrypt (3.1.7-2ubuntu1) ... 2024-04-19T02:59:42.950 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-soupsieve (1.9.5+dfsg-1) ... 2024-04-19T02:59:43.157 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-pyinotify (0.9.6-1.2ubuntu1) ... 2024-04-19T02:59:43.294 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-websocket (0.53.0-2ubuntu1) ... 2024-04-19T02:59:43.486 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-ceph-argparse (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T02:59:43.634 INFO:teuthology.orchestra.run.smithi097.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2024-04-19T02:59:43.784 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2024-04-19T02:59:43.907 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libonig5:amd64 (6.9.4-1) ... 2024-04-19T02:59:43.943 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-markupsafe (1.1.0-1build2) ... 2024-04-19T02:59:44.057 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2024-04-19T02:59:44.228 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-webencodings (0.5.1-1ubuntu1) ... 2024-04-19T02:59:44.256 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2024-04-19T02:59:44.367 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-cherrypy3 (8.9.1-6) ... 2024-04-19T02:59:44.382 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-pytest (4.6.9-1) ... 2024-04-19T02:59:44.520 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2024-04-19T02:59:44.679 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-psutil (5.5.1-1ubuntu4) ... 2024-04-19T02:59:44.750 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-openssl (19.0.0-1build1) ... 2024-04-19T02:59:44.760 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2024-04-19T02:59:44.919 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2024-04-19T02:59:45.046 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-webob (1:1.8.5-2) ... 2024-04-19T02:59:45.051 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-pastedeploy (2.1.0-1) ... 2024-04-19T02:59:45.056 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-natsort (7.0.1-1) ... 2024-04-19T02:59:45.352 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-04-19T02:59:45.397 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2024-04-19T02:59:45.440 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-atomicwrites (1.1.5-2build1) ... 2024-04-19T02:59:45.478 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-bs4 (4.8.2-1) ... 2024-04-19T02:59:45.689 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-scipy (1.3.3-3build1) ... 2024-04-19T02:59:45.725 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-simplejson (3.16.0-2ubuntu2) ... 2024-04-19T02:59:45.813 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-oauthlib (3.1.0-1ubuntu2) ... 2024-04-19T02:59:46.076 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-decorator (4.4.2-0ubuntu1) ... 2024-04-19T02:59:46.142 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-asyncssh (1.12.2-1) ... 2024-04-19T02:59:46.402 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-jinja2 (2.10.1-2ubuntu0.2) ... 2024-04-19T02:59:46.525 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2build1) ... 2024-04-19T02:59:46.745 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-tempita (0.5.2-6) ... 2024-04-19T02:59:46.868 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-sklearn (0.22.2.post1+dfsg-5) ... 2024-04-19T02:59:47.063 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-packaging (20.3-1) ... 2024-04-19T02:59:47.196 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2024-04-19T02:59:47.322 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-pytest (4.6.9-1) ... 2024-04-19T02:59:47.389 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python-pastedeploy-tpl (2.1.0-1) ... 2024-04-19T02:59:47.523 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up qttranslations5-l10n (5.12.8-0ubuntu1) ... 2024-04-19T02:59:47.674 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-wcwidth (0.1.8+dfsg1-3) ... 2024-04-19T02:59:47.732 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-openssl (19.0.0-1build1) ... 2024-04-19T02:59:47.915 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2024-04-19T02:59:47.959 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-paste (3.4.0+dfsg1-1) ... 2024-04-19T02:59:48.041 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python-natsort-doc (7.0.1-1) ... 2024-04-19T02:59:48.100 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-pastedeploy (2.1.0-1) ... 2024-04-19T02:59:48.209 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up jq (1.6-1ubuntu0.20.04.1) ... 2024-04-19T02:59:48.334 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-rsa (4.0-3) ... 2024-04-19T02:59:48.367 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-04-19T02:59:48.394 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2024-04-19T02:59:48.535 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-bs4 (4.8.2-1) ... 2024-04-19T02:59:48.636 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up libthrift-0.13.0 (0.13.0-2build2) ... 2024-04-19T02:59:48.754 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-cryptography (2.8-3ubuntu0.3) ... 2024-04-19T02:59:48.762 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-webtest (2.0.32-2) ... 2024-04-19T02:59:48.878 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-oauthlib (3.1.0-1ubuntu2) ... 2024-04-19T02:59:49.063 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-requests-oauthlib (1.0.0-1.1build1) ... 2024-04-19T02:59:49.263 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-asyncssh (1.12.2-1) ... 2024-04-19T02:59:49.356 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-04-19T02:59:49.464 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up socat (1.7.3.3-2) ... 2024-04-19T02:59:49.598 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-ceph-common (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T02:59:49.674 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-pecan (1.3.3-3ubuntu1) ... 2024-04-19T02:59:49.681 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2build1) ... 2024-04-19T02:59:49.975 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-04-19T02:59:50.024 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-sklearn (0.22.2.post1+dfsg-5) ... 2024-04-19T02:59:50.034 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up librados2 (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T02:59:50.109 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-html5lib (1.0.1-2) ... 2024-04-19T02:59:50.160 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python-asyncssh-doc (1.12.2-1) ... 2024-04-19T02:59:50.286 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up librgw2 (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T02:59:50.505 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2024-04-19T02:59:50.653 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up xmlstarlet (1.6.1-2build1) ... 2024-04-19T02:59:50.790 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-pluggy (0.13.0-2) ... 2024-04-19T02:59:50.845 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up libsqlite3-mod-ceph (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T02:59:51.067 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2024-04-19T02:59:51.081 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up libcephfs2 (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T02:59:51.104 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2024-04-19T02:59:51.207 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-routes (2.4.1-2) ... 2024-04-19T02:59:51.264 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python-natsort-doc (7.0.1-1) ... 2024-04-19T02:59:51.390 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up jq (1.6-1ubuntu0.20.04.1) ... 2024-04-19T02:59:51.426 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-04-19T02:59:51.494 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up libradosstriper1 (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T02:59:51.541 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-rsa (4.0-3) ... 2024-04-19T02:59:51.552 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2024-04-19T02:59:51.620 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-google-auth (1.5.1-2) ... 2024-04-19T02:59:51.711 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-pyasn1 (0.4.2-3build1) ... 2024-04-19T02:59:51.850 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libthrift-0.13.0 (0.13.0-2build2) ... 2024-04-19T02:59:51.922 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up librbd1 (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T02:59:52.010 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-webtest (2.0.32-2) ... 2024-04-19T02:59:52.038 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-singledispatch (3.4.0.3-2build1) ... 2024-04-19T02:59:52.048 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up ceph-mgr-modules-core (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T02:59:52.207 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up ceph-fuse (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T02:59:52.311 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-requests-oauthlib (1.0.0-1.1build1) ... 2024-04-19T02:59:52.372 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-logutils (0.3.3-7) ... 2024-04-19T02:59:52.433 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-19T02:59:52.433 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-19T02:59:52.645 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-04-19T02:59:52.682 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up liblttng-ust0:amd64 (2.11.0-1) ... 2024-04-19T02:59:52.800 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-04-19T02:59:52.909 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up libcephfs-dev (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T02:59:52.963 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-pecan (1.3.3-3ubuntu1) ... 2024-04-19T02:59:53.034 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-rados (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T02:59:53.134 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-prettytable (0.7.2-5) ... 2024-04-19T02:59:53.169 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-kubernetes (7.0.0~a1-2) ... 2024-04-19T02:59:53.365 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up librados2 (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T02:59:53.427 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-soupsieve (1.9.5+dfsg-1) ... 2024-04-19T02:59:53.518 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python-asyncssh-doc (1.12.2-1) ... 2024-04-19T02:59:53.642 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up librgw2 (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T02:59:53.745 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-websocket (0.53.0-2ubuntu1) ... 2024-04-19T02:59:53.810 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libsqlite3-mod-ceph (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T02:59:54.046 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libcephfs2 (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T02:59:54.098 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-rbd (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T02:59:54.139 INFO:teuthology.orchestra.run.smithi134.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2024-04-19T02:59:54.193 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-routes (2.4.1-2) ... 2024-04-19T02:59:54.223 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up rbd-fuse (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T02:59:54.375 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-rgw (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T02:59:54.400 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up libonig5:amd64 (6.9.4-1) ... 2024-04-19T02:59:54.499 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libradosstriper1 (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T02:59:54.500 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up python3-cephfs (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T02:59:54.551 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2024-04-19T02:59:54.626 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up ceph-common (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T02:59:54.652 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-google-auth (1.5.1-2) ... 2024-04-19T02:59:54.869 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-cherrypy3 (8.9.1-6) ... 2024-04-19T02:59:54.960 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up librbd1 (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T02:59:55.119 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up ceph-mgr-modules-core (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T02:59:55.212 INFO:teuthology.orchestra.run.smithi096.stdout:Adding group ceph....done 2024-04-19T02:59:55.228 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2024-04-19T02:59:55.245 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up ceph-fuse (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T02:59:55.388 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2024-04-19T02:59:55.492 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-19T02:59:55.492 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-19T02:59:55.547 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-webob (1:1.8.5-2) ... 2024-04-19T02:59:55.605 INFO:teuthology.orchestra.run.smithi096.stdout:Adding system user ceph....done 2024-04-19T02:59:55.801 INFO:teuthology.orchestra.run.smithi096.stdout:Setting system user ceph properties....done 2024-04-19T02:59:55.828 INFO:teuthology.orchestra.run.smithi096.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-04-19T02:59:55.882 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2024-04-19T02:59:55.947 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libcephfs-dev (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T02:59:55.973 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-04-19T02:59:56.166 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-scipy (1.3.3-3build1) ... 2024-04-19T02:59:56.296 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-04-19T02:59:56.440 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-rados (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T02:59:56.649 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-kubernetes (7.0.0~a1-2) ... 2024-04-19T02:59:56.778 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up ceph-test (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T02:59:56.929 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up radosgw (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T02:59:57.428 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-19T02:59:57.429 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-19T02:59:57.553 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-rbd (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T02:59:57.674 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2024-04-19T02:59:57.687 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up rbd-fuse (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T02:59:57.824 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-pytest (4.6.9-1) ... 2024-04-19T02:59:57.846 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-rgw (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T02:59:57.872 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up ceph-base (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T02:59:58.006 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up python3-cephfs (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T02:59:58.115 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up ceph-common (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T02:59:58.226 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-openssl (19.0.0-1build1) ... 2024-04-19T02:59:58.284 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-04-19T02:59:58.527 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-pastedeploy (2.1.0-1) ... 2024-04-19T02:59:58.709 INFO:teuthology.orchestra.run.smithi097.stdout:Adding group ceph....done 2024-04-19T02:59:58.740 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up ceph-mds (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T02:59:58.812 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2024-04-19T02:59:58.957 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-bs4 (4.8.2-1) ... 2024-04-19T02:59:58.971 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-19T02:59:58.971 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-19T02:59:59.136 INFO:teuthology.orchestra.run.smithi097.stdout:Adding system user ceph....done 2024-04-19T02:59:59.304 INFO:teuthology.orchestra.run.smithi097.stdout:Setting system user ceph properties....done 2024-04-19T02:59:59.314 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-oauthlib (3.1.0-1ubuntu2) ... 2024-04-19T02:59:59.354 INFO:teuthology.orchestra.run.smithi097.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-04-19T02:59:59.459 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up ceph-mgr (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T02:59:59.508 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-04-19T02:59:59.658 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-asyncssh (1.12.2-1) ... 2024-04-19T02:59:59.694 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-19T02:59:59.694 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-19T02:59:59.813 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-04-19T03:00:00.059 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2build1) ... 2024-04-19T03:00:00.185 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up ceph-osd (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T03:00:00.275 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up ceph-test (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T03:00:00.401 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up radosgw (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T03:00:00.418 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-sklearn (0.22.2.post1+dfsg-5) ... 2024-04-19T03:00:00.680 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-19T03:00:00.680 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-19T03:00:00.905 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-19T03:00:00.905 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-19T03:00:01.238 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up ceph-mgr-k8sevents (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T03:00:01.328 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up ceph-base (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T03:00:01.363 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up ceph-mgr-diskprediction-local (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T03:00:01.466 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2024-04-19T03:00:01.506 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up ceph-mon (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T03:00:01.575 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python-natsort-doc (7.0.1-1) ... 2024-04-19T03:00:01.734 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up jq (1.6-1ubuntu0.20.04.1) ... 2024-04-19T03:00:01.737 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-04-19T03:00:01.752 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-19T03:00:01.752 INFO:teuthology.orchestra.run.smithi096.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-19T03:00:01.893 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-rsa (4.0-3) ... 2024-04-19T03:00:02.186 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up libthrift-0.13.0 (0.13.0-2build2) ... 2024-04-19T03:00:02.197 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up ceph-mds (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T03:00:02.216 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up ceph-mgr-cephadm (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T03:00:02.312 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-webtest (2.0.32-2) ... 2024-04-19T03:00:02.383 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up ceph (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T03:00:02.468 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-19T03:00:02.468 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-19T03:00:02.509 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up ceph-mgr-dashboard (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T03:00:02.639 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-requests-oauthlib (1.0.0-1.1build1) ... 2024-04-19T03:00:02.677 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up ceph-volume (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T03:00:02.915 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up ceph-mgr (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T03:00:02.923 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-04-19T03:00:03.047 INFO:teuthology.orchestra.run.smithi096.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2024-04-19T03:00:03.186 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-19T03:00:03.186 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-19T03:00:03.198 INFO:teuthology.orchestra.run.smithi096.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2024-04-19T03:00:03.249 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-pecan (1.3.3-3ubuntu1) ... 2024-04-19T03:00:03.500 INFO:teuthology.orchestra.run.smithi096.stdout:Processing triggers for man-db (2.9.1-1) ... 2024-04-19T03:00:03.635 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up librados2 (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T03:00:03.684 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up ceph-osd (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T03:00:03.761 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python-asyncssh-doc (1.12.2-1) ... 2024-04-19T03:00:03.920 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up librgw2 (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T03:00:04.080 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up libsqlite3-mod-ceph (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T03:00:04.218 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-19T03:00:04.218 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-19T03:00:04.325 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up libcephfs2 (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T03:00:04.476 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-routes (2.4.1-2) ... 2024-04-19T03:00:04.669 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up ceph-mgr-k8sevents (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T03:00:04.795 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up ceph-mgr-diskprediction-local (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T03:00:04.819 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up libradosstriper1 (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T03:00:04.945 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-google-auth (1.5.1-2) ... 2024-04-19T03:00:04.971 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up ceph-mon (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T03:00:05.230 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-19T03:00:05.231 INFO:teuthology.orchestra.run.smithi097.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-19T03:00:05.322 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up librbd1 (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T03:00:05.457 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up ceph-mgr-modules-core (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T03:00:05.607 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up ceph-fuse (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T03:00:05.673 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up ceph-mgr-cephadm (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T03:00:05.832 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-19T03:00:05.832 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-19T03:00:05.849 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up ceph (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T03:00:06.008 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up ceph-mgr-dashboard (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T03:00:06.151 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up ceph-volume (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T03:00:06.309 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up libcephfs-dev (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T03:00:06.378 INFO:teuthology.orchestra.run.smithi096.stdout:Processing triggers for fontconfig (2.13.1-2ubuntu3) ... 2024-04-19T03:00:06.435 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-rados (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T03:00:06.537 INFO:teuthology.orchestra.run.smithi097.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2024-04-19T03:00:06.586 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-kubernetes (7.0.0~a1-2) ... 2024-04-19T03:00:06.722 INFO:teuthology.orchestra.run.smithi097.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2024-04-19T03:00:06.973 INFO:teuthology.orchestra.run.smithi096.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-19T03:00:06.976 DEBUG:teuthology.orchestra.run.smithi096:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev libaio-dev libtool-bin uuid-dev xfslibs-dev 2024-04-19T03:00:07.016 INFO:teuthology.orchestra.run.smithi097.stdout:Processing triggers for man-db (2.9.1-1) ... 2024-04-19T03:00:07.048 INFO:teuthology.orchestra.run.smithi096.stdout:Reading package lists... 2024-04-19T03:00:07.261 INFO:teuthology.orchestra.run.smithi096.stdout:Building dependency tree... 2024-04-19T03:00:07.262 INFO:teuthology.orchestra.run.smithi096.stdout:Reading state information... 2024-04-19T03:00:07.472 INFO:teuthology.orchestra.run.smithi096.stdout:bison is already the newest version (2:3.5.1+dfsg-1). 2024-04-19T03:00:07.472 INFO:teuthology.orchestra.run.smithi096.stdout:flex is already the newest version (2.6.4-6.2). 2024-04-19T03:00:07.472 INFO:teuthology.orchestra.run.smithi096.stdout:libtool-bin is already the newest version (2.4.6-14). 2024-04-19T03:00:07.472 INFO:teuthology.orchestra.run.smithi096.stdout:xfslibs-dev is already the newest version (5.3.0-1ubuntu2). 2024-04-19T03:00:07.473 INFO:teuthology.orchestra.run.smithi096.stdout:The following packages were automatically installed and are no longer required: 2024-04-19T03:00:07.473 INFO:teuthology.orchestra.run.smithi096.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2024-04-19T03:00:07.473 INFO:teuthology.orchestra.run.smithi096.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-19T03:00:07.475 INFO:teuthology.orchestra.run.smithi096.stdout:Suggested packages: 2024-04-19T03:00:07.475 INFO:teuthology.orchestra.run.smithi096.stdout: libssl-doc 2024-04-19T03:00:07.511 INFO:teuthology.orchestra.run.smithi096.stdout:The following NEW packages will be installed: 2024-04-19T03:00:07.512 INFO:teuthology.orchestra.run.smithi096.stdout: libaio-dev libelf-dev libssl-dev 2024-04-19T03:00:07.513 INFO:teuthology.orchestra.run.smithi096.stdout:The following packages will be upgraded: 2024-04-19T03:00:07.514 INFO:teuthology.orchestra.run.smithi096.stdout: libdw1 libelf1 libssl1.1 libuuid1 uuid-dev 2024-04-19T03:00:07.523 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-rbd (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T03:00:07.649 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up rbd-fuse (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T03:00:07.801 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-rgw (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T03:00:07.927 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-cephfs (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T03:00:08.070 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up ceph-common (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T03:00:08.697 INFO:teuthology.orchestra.run.smithi134.stdout:Adding group ceph....done 2024-04-19T03:00:09.099 INFO:teuthology.orchestra.run.smithi134.stdout:Adding system user ceph....done 2024-04-19T03:00:09.300 INFO:teuthology.orchestra.run.smithi134.stdout:Setting system user ceph properties....done 2024-04-19T03:00:09.322 INFO:teuthology.orchestra.run.smithi134.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-04-19T03:00:09.474 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-04-19T03:00:09.790 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-04-19T03:00:09.860 INFO:teuthology.orchestra.run.smithi097.stdout:Processing triggers for fontconfig (2.13.1-2ubuntu3) ... 2024-04-19T03:00:10.263 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up ceph-test (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T03:00:10.388 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up radosgw (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T03:00:10.433 INFO:teuthology.orchestra.run.smithi097.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-19T03:00:10.435 DEBUG:teuthology.orchestra.run.smithi097:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev libaio-dev libtool-bin uuid-dev xfslibs-dev 2024-04-19T03:00:10.509 INFO:teuthology.orchestra.run.smithi097.stdout:Reading package lists... 2024-04-19T03:00:10.721 INFO:teuthology.orchestra.run.smithi097.stdout:Building dependency tree... 2024-04-19T03:00:10.722 INFO:teuthology.orchestra.run.smithi097.stdout:Reading state information... 2024-04-19T03:00:10.908 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-19T03:00:10.908 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-19T03:00:10.933 INFO:teuthology.orchestra.run.smithi097.stdout:bison is already the newest version (2:3.5.1+dfsg-1). 2024-04-19T03:00:10.933 INFO:teuthology.orchestra.run.smithi097.stdout:flex is already the newest version (2.6.4-6.2). 2024-04-19T03:00:10.933 INFO:teuthology.orchestra.run.smithi097.stdout:libtool-bin is already the newest version (2.4.6-14). 2024-04-19T03:00:10.934 INFO:teuthology.orchestra.run.smithi097.stdout:xfslibs-dev is already the newest version (5.3.0-1ubuntu2). 2024-04-19T03:00:10.934 INFO:teuthology.orchestra.run.smithi097.stdout:The following packages were automatically installed and are no longer required: 2024-04-19T03:00:10.934 INFO:teuthology.orchestra.run.smithi097.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2024-04-19T03:00:10.935 INFO:teuthology.orchestra.run.smithi097.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-19T03:00:10.935 INFO:teuthology.orchestra.run.smithi097.stdout:Suggested packages: 2024-04-19T03:00:10.936 INFO:teuthology.orchestra.run.smithi097.stdout: libssl-doc 2024-04-19T03:00:10.975 INFO:teuthology.orchestra.run.smithi097.stdout:The following NEW packages will be installed: 2024-04-19T03:00:10.977 INFO:teuthology.orchestra.run.smithi097.stdout: libaio-dev libelf-dev libssl-dev 2024-04-19T03:00:10.978 INFO:teuthology.orchestra.run.smithi097.stdout:The following packages will be upgraded: 2024-04-19T03:00:10.979 INFO:teuthology.orchestra.run.smithi097.stdout: libdw1 libelf1 libssl1.1 libuuid1 uuid-dev 2024-04-19T03:00:11.357 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up ceph-base (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T03:00:11.777 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-04-19T03:00:12.226 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up ceph-mds (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T03:00:12.466 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-19T03:00:12.466 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-19T03:00:12.808 INFO:teuthology.orchestra.run.smithi096.stdout:5 upgraded, 3 newly installed, 0 to remove and 272 not upgraded. 2024-04-19T03:00:12.808 INFO:teuthology.orchestra.run.smithi096.stdout:Need to get 3,303 kB of archives. 2024-04-19T03:00:12.808 INFO:teuthology.orchestra.run.smithi096.stdout:After this operation, 8,471 kB of additional disk space will be used. 2024-04-19T03:00:12.808 INFO:teuthology.orchestra.run.smithi096.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 uuid-dev amd64 2.34-0.1ubuntu9.6 [33.6 kB] 2024-04-19T03:00:12.869 INFO:teuthology.orchestra.run.smithi096.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libuuid1 amd64 2.34-0.1ubuntu9.6 [20.0 kB] 2024-04-19T03:00:12.878 INFO:teuthology.orchestra.run.smithi096.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libdw1 amd64 0.176-1.1ubuntu0.1 [226 kB] 2024-04-19T03:00:12.936 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up ceph-mgr (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T03:00:12.941 INFO:teuthology.orchestra.run.smithi096.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libelf1 amd64 0.176-1.1ubuntu0.1 [44.2 kB] 2024-04-19T03:00:12.945 INFO:teuthology.orchestra.run.smithi096.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl1.1 amd64 1.1.1f-1ubuntu2.22 [1,323 kB] 2024-04-19T03:00:13.007 INFO:teuthology.orchestra.run.smithi096.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal/main amd64 libaio-dev amd64 0.3.112-5 [13.7 kB] 2024-04-19T03:00:13.007 INFO:teuthology.orchestra.run.smithi096.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libelf-dev amd64 0.176-1.1ubuntu0.1 [57.1 kB] 2024-04-19T03:00:13.008 INFO:teuthology.orchestra.run.smithi096.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl-dev amd64 1.1.1f-1ubuntu2.22 [1,586 kB] 2024-04-19T03:00:13.164 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-19T03:00:13.164 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-19T03:00:13.343 INFO:teuthology.orchestra.run.smithi096.stdout:Preconfiguring packages ... 2024-04-19T03:00:13.468 INFO:teuthology.orchestra.run.smithi096.stdout:Fetched 3,303 kB in 6s (599 kB/s) 2024-04-19T03:00:13.612 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up ceph-osd (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T03:00:13.617 INFO:teuthology.orchestra.run.smithi096.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 153031 files and directories currently installed.) 2024-04-19T03:00:13.621 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../uuid-dev_2.34-0.1ubuntu9.6_amd64.deb ... 2024-04-19T03:00:13.781 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking uuid-dev:amd64 (2.34-0.1ubuntu9.6) over (2.34-0.1ubuntu9.3) ... 2024-04-19T03:00:14.107 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-19T03:00:14.107 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-19T03:00:14.265 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../libuuid1_2.34-0.1ubuntu9.6_amd64.deb ... 2024-04-19T03:00:14.479 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking libuuid1:amd64 (2.34-0.1ubuntu9.6) over (2.34-0.1ubuntu9.3) ... 2024-04-19T03:00:14.580 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up ceph-mgr-k8sevents (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T03:00:14.781 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up ceph-mgr-diskprediction-local (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T03:00:14.849 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up libuuid1:amd64 (2.34-0.1ubuntu9.6) ... 2024-04-19T03:00:15.315 INFO:teuthology.orchestra.run.smithi096.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 153031 files and directories currently installed.) 2024-04-19T03:00:15.320 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../0-libdw1_0.176-1.1ubuntu0.1_amd64.deb ... 2024-04-19T03:00:15.434 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up ceph-mon (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T03:00:15.453 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking libdw1:amd64 (0.176-1.1ubuntu0.1) over (0.176-1.1build1) ... 2024-04-19T03:00:15.675 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-19T03:00:15.675 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-19T03:00:15.967 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../1-libelf1_0.176-1.1ubuntu0.1_amd64.deb ... 2024-04-19T03:00:16.092 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking libelf1:amd64 (0.176-1.1ubuntu0.1) over (0.176-1.1build1) ... 2024-04-19T03:00:16.127 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up ceph-mgr-cephadm (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T03:00:16.270 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up ceph (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T03:00:16.437 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up ceph-mgr-dashboard (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T03:00:16.605 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up ceph-volume (18.2.2-1237-g646b8c7d-1focal) ... 2024-04-19T03:00:16.977 INFO:teuthology.orchestra.run.smithi134.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2024-04-19T03:00:17.061 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../2-libssl1.1_1.1.1f-1ubuntu2.22_amd64.deb ... 2024-04-19T03:00:17.162 INFO:teuthology.orchestra.run.smithi134.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2024-04-19T03:00:17.426 INFO:teuthology.orchestra.run.smithi097.stdout:5 upgraded, 3 newly installed, 0 to remove and 272 not upgraded. 2024-04-19T03:00:17.426 INFO:teuthology.orchestra.run.smithi097.stdout:Need to get 3,303 kB of archives. 2024-04-19T03:00:17.427 INFO:teuthology.orchestra.run.smithi097.stdout:After this operation, 8,471 kB of additional disk space will be used. 2024-04-19T03:00:17.427 INFO:teuthology.orchestra.run.smithi097.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 uuid-dev amd64 2.34-0.1ubuntu9.6 [33.6 kB] 2024-04-19T03:00:17.446 INFO:teuthology.orchestra.run.smithi134.stdout:Processing triggers for man-db (2.9.1-1) ... 2024-04-19T03:00:17.466 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking libssl1.1:amd64 (1.1.1f-1ubuntu2.22) over (1.1.1f-1ubuntu2.16) ... 2024-04-19T03:00:17.487 INFO:teuthology.orchestra.run.smithi097.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libuuid1 amd64 2.34-0.1ubuntu9.6 [20.0 kB] 2024-04-19T03:00:17.496 INFO:teuthology.orchestra.run.smithi097.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libdw1 amd64 0.176-1.1ubuntu0.1 [226 kB] 2024-04-19T03:00:17.548 INFO:teuthology.orchestra.run.smithi097.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libelf1 amd64 0.176-1.1ubuntu0.1 [44.2 kB] 2024-04-19T03:00:17.553 INFO:teuthology.orchestra.run.smithi097.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl1.1 amd64 1.1.1f-1ubuntu2.22 [1,323 kB] 2024-04-19T03:00:17.601 INFO:teuthology.orchestra.run.smithi097.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal/main amd64 libaio-dev amd64 0.3.112-5 [13.7 kB] 2024-04-19T03:00:17.601 INFO:teuthology.orchestra.run.smithi097.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libelf-dev amd64 0.176-1.1ubuntu0.1 [57.1 kB] 2024-04-19T03:00:17.602 INFO:teuthology.orchestra.run.smithi097.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl-dev amd64 1.1.1f-1ubuntu2.22 [1,586 kB] 2024-04-19T03:00:17.919 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-04-19T03:00:17.936 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../3-libaio-dev_0.3.112-5_amd64.deb ... 2024-04-19T03:00:17.939 INFO:teuthology.orchestra.run.smithi097.stdout:Preconfiguring packages ... 2024-04-19T03:00:17.977 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking libaio-dev:amd64 (0.3.112-5) ... 2024-04-19T03:00:18.083 INFO:teuthology.orchestra.run.smithi097.stdout:Fetched 3,303 kB in 7s (498 kB/s) 2024-04-19T03:00:18.263 INFO:teuthology.orchestra.run.smithi097.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 153031 files and directories currently installed.) 2024-04-19T03:00:18.268 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../uuid-dev_2.34-0.1ubuntu9.6_amd64.deb ... 2024-04-19T03:00:18.272 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-04-19T03:00:18.292 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../4-libelf-dev_0.176-1.1ubuntu0.1_amd64.deb ... 2024-04-19T03:00:18.330 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking libelf-dev:amd64 (0.176-1.1ubuntu0.1) ... 2024-04-19T03:00:18.424 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking uuid-dev:amd64 (2.34-0.1ubuntu9.6) over (2.34-0.1ubuntu9.3) ... 2024-04-19T03:00:18.633 INFO:teuthology.orchestra.run.smithi096.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-04-19T03:00:18.653 INFO:teuthology.orchestra.run.smithi096.stdout:Preparing to unpack .../5-libssl-dev_1.1.1f-1ubuntu2.22_amd64.deb ... 2024-04-19T03:00:18.683 INFO:teuthology.orchestra.run.smithi096.stdout:Unpacking libssl-dev:amd64 (1.1.1f-1ubuntu2.22) ... 2024-04-19T03:00:18.963 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../libuuid1_2.34-0.1ubuntu9.6_amd64.deb ... 2024-04-19T03:00:19.170 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up libssl1.1:amd64 (1.1.1f-1ubuntu2.22) ... 2024-04-19T03:00:19.172 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libuuid1:amd64 (2.34-0.1ubuntu9.6) over (2.34-0.1ubuntu9.3) ... 2024-04-19T03:00:19.505 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up libaio-dev:amd64 (0.3.112-5) ... 2024-04-19T03:00:19.530 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libuuid1:amd64 (2.34-0.1ubuntu9.6) ... 2024-04-19T03:00:19.639 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up uuid-dev:amd64 (2.34-0.1ubuntu9.6) ... 2024-04-19T03:00:19.741 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up libssl-dev:amd64 (1.1.1f-1ubuntu2.22) ... 2024-04-19T03:00:19.858 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up libelf1:amd64 (0.176-1.1ubuntu0.1) ... 2024-04-19T03:00:19.935 INFO:teuthology.orchestra.run.smithi097.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 153031 files and directories currently installed.) 2024-04-19T03:00:19.940 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../0-libdw1_0.176-1.1ubuntu0.1_amd64.deb ... 2024-04-19T03:00:20.017 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up libdw1:amd64 (0.176-1.1ubuntu0.1) ... 2024-04-19T03:00:20.079 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libdw1:amd64 (0.176-1.1ubuntu0.1) over (0.176-1.1build1) ... 2024-04-19T03:00:20.143 INFO:teuthology.orchestra.run.smithi096.stdout:Setting up libelf-dev:amd64 (0.176-1.1ubuntu0.1) ... 2024-04-19T03:00:20.270 INFO:teuthology.orchestra.run.smithi096.stdout:Processing triggers for man-db (2.9.1-1) ... 2024-04-19T03:00:20.315 INFO:teuthology.orchestra.run.smithi134.stdout:Processing triggers for fontconfig (2.13.1-2ubuntu3) ... 2024-04-19T03:00:20.563 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../1-libelf1_0.176-1.1ubuntu0.1_amd64.deb ... 2024-04-19T03:00:20.718 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libelf1:amd64 (0.176-1.1ubuntu0.1) over (0.176-1.1build1) ... 2024-04-19T03:00:21.248 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../2-libssl1.1_1.1.1f-1ubuntu2.22_amd64.deb ... 2024-04-19T03:00:21.415 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libssl1.1:amd64 (1.1.1f-1ubuntu2.22) over (1.1.1f-1ubuntu2.16) ... 2024-04-19T03:00:21.625 INFO:teuthology.orchestra.run.smithi134.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-19T03:00:21.627 DEBUG:teuthology.orchestra.run.smithi134:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev libaio-dev libtool-bin uuid-dev xfslibs-dev 2024-04-19T03:00:21.696 INFO:teuthology.orchestra.run.smithi134.stdout:Reading package lists... 2024-04-19T03:00:21.805 INFO:teuthology.orchestra.run.smithi096.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2024-04-19T03:00:21.902 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-04-19T03:00:21.908 INFO:teuthology.orchestra.run.smithi134.stdout:Building dependency tree... 2024-04-19T03:00:21.909 INFO:teuthology.orchestra.run.smithi134.stdout:Reading state information... 2024-04-19T03:00:21.919 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../3-libaio-dev_0.3.112-5_amd64.deb ... 2024-04-19T03:00:21.960 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libaio-dev:amd64 (0.3.112-5) ... 2024-04-19T03:00:22.106 INFO:teuthology.orchestra.run.smithi134.stdout:bison is already the newest version (2:3.5.1+dfsg-1). 2024-04-19T03:00:22.107 INFO:teuthology.orchestra.run.smithi134.stdout:flex is already the newest version (2.6.4-6.2). 2024-04-19T03:00:22.107 INFO:teuthology.orchestra.run.smithi134.stdout:libtool-bin is already the newest version (2.4.6-14). 2024-04-19T03:00:22.107 INFO:teuthology.orchestra.run.smithi134.stdout:xfslibs-dev is already the newest version (5.3.0-1ubuntu2). 2024-04-19T03:00:22.107 INFO:teuthology.orchestra.run.smithi134.stdout:The following packages were automatically installed and are no longer required: 2024-04-19T03:00:22.107 INFO:teuthology.orchestra.run.smithi134.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2024-04-19T03:00:22.107 INFO:teuthology.orchestra.run.smithi134.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-19T03:00:22.109 INFO:teuthology.orchestra.run.smithi134.stdout:Suggested packages: 2024-04-19T03:00:22.109 INFO:teuthology.orchestra.run.smithi134.stdout: libssl-doc 2024-04-19T03:00:22.147 INFO:teuthology.orchestra.run.smithi134.stdout:The following NEW packages will be installed: 2024-04-19T03:00:22.148 INFO:teuthology.orchestra.run.smithi134.stdout: libaio-dev libelf-dev libssl-dev 2024-04-19T03:00:22.149 INFO:teuthology.orchestra.run.smithi134.stdout:The following packages will be upgraded: 2024-04-19T03:00:22.150 INFO:teuthology.orchestra.run.smithi134.stdout: libdw1 libelf1 libssl1.1 libuuid1 uuid-dev 2024-04-19T03:00:22.214 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-04-19T03:00:22.232 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../4-libelf-dev_0.176-1.1ubuntu0.1_amd64.deb ... 2024-04-19T03:00:22.254 INFO:teuthology.orchestra.run.smithi096.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-19T03:00:22.260 DEBUG:teuthology.parallel:result is None 2024-04-19T03:00:22.305 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libelf-dev:amd64 (0.176-1.1ubuntu0.1) ... 2024-04-19T03:00:22.332 INFO:teuthology.orchestra.run.smithi134.stdout:5 upgraded, 3 newly installed, 0 to remove and 272 not upgraded. 2024-04-19T03:00:22.332 INFO:teuthology.orchestra.run.smithi134.stdout:Need to get 3,303 kB of archives. 2024-04-19T03:00:22.333 INFO:teuthology.orchestra.run.smithi134.stdout:After this operation, 8,471 kB of additional disk space will be used. 2024-04-19T03:00:22.333 INFO:teuthology.orchestra.run.smithi134.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 uuid-dev amd64 2.34-0.1ubuntu9.6 [33.6 kB] 2024-04-19T03:00:22.549 INFO:teuthology.orchestra.run.smithi134.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libuuid1 amd64 2.34-0.1ubuntu9.6 [20.0 kB] 2024-04-19T03:00:22.581 INFO:teuthology.orchestra.run.smithi134.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libdw1 amd64 0.176-1.1ubuntu0.1 [226 kB] 2024-04-19T03:00:22.818 INFO:teuthology.orchestra.run.smithi134.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libelf1 amd64 0.176-1.1ubuntu0.1 [44.2 kB] 2024-04-19T03:00:22.837 INFO:teuthology.orchestra.run.smithi134.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl1.1 amd64 1.1.1f-1ubuntu2.22 [1,323 kB] 2024-04-19T03:00:23.037 INFO:teuthology.orchestra.run.smithi134.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal/main amd64 libaio-dev amd64 0.3.112-5 [13.7 kB] 2024-04-19T03:00:23.037 INFO:teuthology.orchestra.run.smithi134.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libelf-dev amd64 0.176-1.1ubuntu0.1 [57.1 kB] 2024-04-19T03:00:23.041 INFO:teuthology.orchestra.run.smithi134.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libssl-dev amd64 1.1.1f-1ubuntu2.22 [1,586 kB] 2024-04-19T03:00:23.084 INFO:teuthology.orchestra.run.smithi097.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-04-19T03:00:23.104 INFO:teuthology.orchestra.run.smithi097.stdout:Preparing to unpack .../5-libssl-dev_1.1.1f-1ubuntu2.22_amd64.deb ... 2024-04-19T03:00:23.355 INFO:teuthology.orchestra.run.smithi097.stdout:Unpacking libssl-dev:amd64 (1.1.1f-1ubuntu2.22) ... 2024-04-19T03:00:23.431 INFO:teuthology.orchestra.run.smithi134.stdout:Preconfiguring packages ... 2024-04-19T03:00:23.578 INFO:teuthology.orchestra.run.smithi134.stdout:Fetched 3,303 kB in 1s (3,436 kB/s) 2024-04-19T03:00:23.734 INFO:teuthology.orchestra.run.smithi134.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 153031 files and directories currently installed.) 2024-04-19T03:00:23.738 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../uuid-dev_2.34-0.1ubuntu9.6_amd64.deb ... 2024-04-19T03:00:23.870 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking uuid-dev:amd64 (2.34-0.1ubuntu9.6) over (2.34-0.1ubuntu9.3) ... 2024-04-19T03:00:23.945 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libssl1.1:amd64 (1.1.1f-1ubuntu2.22) ... 2024-04-19T03:00:24.290 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libaio-dev:amd64 (0.3.112-5) ... 2024-04-19T03:00:24.379 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../libuuid1_2.34-0.1ubuntu9.6_amd64.deb ... 2024-04-19T03:00:24.450 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up uuid-dev:amd64 (2.34-0.1ubuntu9.6) ... 2024-04-19T03:00:24.576 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libssl-dev:amd64 (1.1.1f-1ubuntu2.22) ... 2024-04-19T03:00:24.576 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking libuuid1:amd64 (2.34-0.1ubuntu9.6) over (2.34-0.1ubuntu9.3) ... 2024-04-19T03:00:24.743 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libelf1:amd64 (0.176-1.1ubuntu0.1) ... 2024-04-19T03:00:24.891 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up libuuid1:amd64 (2.34-0.1ubuntu9.6) ... 2024-04-19T03:00:24.905 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libdw1:amd64 (0.176-1.1ubuntu0.1) ... 2024-04-19T03:00:25.031 INFO:teuthology.orchestra.run.smithi097.stdout:Setting up libelf-dev:amd64 (0.176-1.1ubuntu0.1) ... 2024-04-19T03:00:25.191 INFO:teuthology.orchestra.run.smithi097.stdout:Processing triggers for man-db (2.9.1-1) ... 2024-04-19T03:00:25.378 INFO:teuthology.orchestra.run.smithi134.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 153031 files and directories currently installed.) 2024-04-19T03:00:25.383 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../0-libdw1_0.176-1.1ubuntu0.1_amd64.deb ... 2024-04-19T03:00:25.550 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking libdw1:amd64 (0.176-1.1ubuntu0.1) over (0.176-1.1build1) ... 2024-04-19T03:00:26.059 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../1-libelf1_0.176-1.1ubuntu0.1_amd64.deb ... 2024-04-19T03:00:26.231 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking libelf1:amd64 (0.176-1.1ubuntu0.1) over (0.176-1.1build1) ... 2024-04-19T03:00:26.735 INFO:teuthology.orchestra.run.smithi097.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2024-04-19T03:00:27.083 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../2-libssl1.1_1.1.1f-1ubuntu2.22_amd64.deb ... 2024-04-19T03:00:27.220 INFO:teuthology.orchestra.run.smithi097.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-19T03:00:27.224 DEBUG:teuthology.parallel:result is None 2024-04-19T03:00:27.228 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking libssl1.1:amd64 (1.1.1f-1ubuntu2.22) over (1.1.1f-1ubuntu2.16) ... 2024-04-19T03:00:27.707 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-04-19T03:00:27.725 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../3-libaio-dev_0.3.112-5_amd64.deb ... 2024-04-19T03:00:27.765 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking libaio-dev:amd64 (0.3.112-5) ... 2024-04-19T03:00:28.044 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-04-19T03:00:28.063 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../4-libelf-dev_0.176-1.1ubuntu0.1_amd64.deb ... 2024-04-19T03:00:28.102 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking libelf-dev:amd64 (0.176-1.1ubuntu0.1) ... 2024-04-19T03:00:28.421 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-04-19T03:00:28.441 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../5-libssl-dev_1.1.1f-1ubuntu2.22_amd64.deb ... 2024-04-19T03:00:28.479 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking libssl-dev:amd64 (1.1.1f-1ubuntu2.22) ... 2024-04-19T03:00:28.992 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up libssl1.1:amd64 (1.1.1f-1ubuntu2.22) ... 2024-04-19T03:00:29.301 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up libaio-dev:amd64 (0.3.112-5) ... 2024-04-19T03:00:29.452 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up uuid-dev:amd64 (2.34-0.1ubuntu9.6) ... 2024-04-19T03:00:29.578 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up libssl-dev:amd64 (1.1.1f-1ubuntu2.22) ... 2024-04-19T03:00:29.729 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up libelf1:amd64 (0.176-1.1ubuntu0.1) ... 2024-04-19T03:00:29.880 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up libdw1:amd64 (0.176-1.1ubuntu0.1) ... 2024-04-19T03:00:30.006 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up libelf-dev:amd64 (0.176-1.1ubuntu0.1) ... 2024-04-19T03:00:30.167 INFO:teuthology.orchestra.run.smithi134.stdout:Processing triggers for man-db (2.9.1-1) ... 2024-04-19T03:00:31.669 INFO:teuthology.orchestra.run.smithi134.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2024-04-19T03:00:32.610 INFO:teuthology.orchestra.run.smithi134.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-19T03:00:32.614 DEBUG:teuthology.parallel:result is None 2024-04-19T03:00:32.615 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=646b8c7d293d8ec31a40c69f7b3237b19c1be24d 2024-04-19T03:00:32.759 DEBUG:teuthology.orchestra.run.smithi096:> dpkg-query -W -f '${Version}' ceph 2024-04-19T03:00:32.783 INFO:teuthology.orchestra.run.smithi096.stdout:18.2.2-1237-g646b8c7d-1focal 2024-04-19T03:00:32.784 INFO:teuthology.packaging:The installed version of ceph is 18.2.2-1237-g646b8c7d-1focal 2024-04-19T03:00:32.784 INFO:teuthology.task.install:The correct ceph version 18.2.2-1237-g646b8c7d-1focal is installed. 2024-04-19T03:00:32.787 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=646b8c7d293d8ec31a40c69f7b3237b19c1be24d 2024-04-19T03:00:33.058 DEBUG:teuthology.orchestra.run.smithi097:> dpkg-query -W -f '${Version}' ceph 2024-04-19T03:00:33.084 INFO:teuthology.orchestra.run.smithi097.stdout:18.2.2-1237-g646b8c7d-1focal 2024-04-19T03:00:33.084 INFO:teuthology.packaging:The installed version of ceph is 18.2.2-1237-g646b8c7d-1focal 2024-04-19T03:00:33.085 INFO:teuthology.task.install:The correct ceph version 18.2.2-1237-g646b8c7d-1focal is installed. 2024-04-19T03:00:33.086 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=646b8c7d293d8ec31a40c69f7b3237b19c1be24d 2024-04-19T03:00:33.228 DEBUG:teuthology.orchestra.run.smithi134:> dpkg-query -W -f '${Version}' ceph 2024-04-19T03:00:33.253 INFO:teuthology.orchestra.run.smithi134.stdout:18.2.2-1237-g646b8c7d-1focal 2024-04-19T03:00:33.253 INFO:teuthology.packaging:The installed version of ceph is 18.2.2-1237-g646b8c7d-1focal 2024-04-19T03:00:33.253 INFO:teuthology.task.install:The correct ceph version 18.2.2-1237-g646b8c7d-1focal is installed. 2024-04-19T03:00:33.255 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=646b8c7d293d8ec31a40c69f7b3237b19c1be24d 2024-04-19T03:00:33.397 DEBUG:teuthology.orchestra.run.smithi144:> dpkg-query -W -f '${Version}' ceph 2024-04-19T03:00:33.420 INFO:teuthology.orchestra.run.smithi144.stdout:18.2.2-1237-g646b8c7d-1focal 2024-04-19T03:00:33.420 INFO:teuthology.packaging:The installed version of ceph is 18.2.2-1237-g646b8c7d-1focal 2024-04-19T03:00:33.420 INFO:teuthology.task.install:The correct ceph version 18.2.2-1237-g646b8c7d-1focal is installed. 2024-04-19T03:00:33.422 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-04-19T03:00:33.423 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-04-19T03:00:33.423 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-19T03:00:33.440 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-04-19T03:00:33.440 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-19T03:00:33.456 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-04-19T03:00:33.456 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-19T03:00:33.474 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-04-19T03:00:33.474 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-19T03:00:33.490 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-04-19T03:00:33.491 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-04-19T03:00:33.491 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd of=/usr/bin/daemon-helper 2024-04-19T03:00:33.505 DEBUG:teuthology.orchestra.run.smithi096:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-19T03:00:33.518 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-04-19T03:00:33.518 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd of=/usr/bin/daemon-helper 2024-04-19T03:00:33.534 DEBUG:teuthology.orchestra.run.smithi097:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-19T03:00:33.594 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-04-19T03:00:33.594 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/usr/bin/daemon-helper 2024-04-19T03:00:33.610 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-19T03:00:33.667 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-04-19T03:00:33.667 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd of=/usr/bin/daemon-helper 2024-04-19T03:00:33.683 DEBUG:teuthology.orchestra.run.smithi144:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-19T03:00:33.696 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-04-19T03:00:33.697 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-04-19T03:00:33.697 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-19T03:00:33.712 DEBUG:teuthology.orchestra.run.smithi096:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-19T03:00:33.724 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-04-19T03:00:33.724 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-19T03:00:33.739 DEBUG:teuthology.orchestra.run.smithi097:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-19T03:00:33.796 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-04-19T03:00:33.796 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-19T03:00:33.813 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-19T03:00:33.823 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-04-19T03:00:33.823 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-19T03:00:33.839 DEBUG:teuthology.orchestra.run.smithi144:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-19T03:00:33.897 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-04-19T03:00:33.897 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-04-19T03:00:33.897 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd of=/usr/bin/stdin-killer 2024-04-19T03:00:33.913 DEBUG:teuthology.orchestra.run.smithi096:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-19T03:00:33.969 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-04-19T03:00:33.969 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd of=/usr/bin/stdin-killer 2024-04-19T03:00:33.986 DEBUG:teuthology.orchestra.run.smithi097:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-19T03:00:33.996 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-04-19T03:00:33.996 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/usr/bin/stdin-killer 2024-04-19T03:00:34.012 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-19T03:00:34.021 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-04-19T03:00:34.021 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd of=/usr/bin/stdin-killer 2024-04-19T03:00:34.037 DEBUG:teuthology.orchestra.run.smithi144:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-19T03:00:34.094 INFO:teuthology.run_tasks:Running task ceph... 2024-04-19T03:00:34.181 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-04-19T03:00:34.182 DEBUG:teuthology.orchestra.run.smithi096:> sudo chmod 777 /var/log/ceph 2024-04-19T03:00:34.184 DEBUG:teuthology.orchestra.run.smithi097:> sudo chmod 777 /var/log/ceph 2024-04-19T03:00:34.186 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod 777 /var/log/ceph 2024-04-19T03:00:34.188 DEBUG:teuthology.orchestra.run.smithi144:> sudo chmod 777 /var/log/ceph 2024-04-19T03:00:34.204 INFO:tasks.ceph:Disabling ceph logrotate... 2024-04-19T03:00:34.204 DEBUG:teuthology.orchestra.run.smithi096:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-19T03:00:34.206 DEBUG:teuthology.orchestra.run.smithi097:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-19T03:00:34.208 DEBUG:teuthology.orchestra.run.smithi134:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-19T03:00:34.245 DEBUG:teuthology.orchestra.run.smithi144:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-19T03:00:34.261 INFO:tasks.ceph:Creating extra log directories... 2024-04-19T03:00:34.261 DEBUG:teuthology.orchestra.run.smithi096:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-19T03:00:34.263 DEBUG:teuthology.orchestra.run.smithi097:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-19T03:00:34.266 DEBUG:teuthology.orchestra.run.smithi134:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-19T03:00:34.268 DEBUG:teuthology.orchestra.run.smithi144:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-19T03:00:34.330 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-04-19T03:00:34.330 INFO:tasks.ceph:config {'conf': {'client.0': {'admin socket': '/var/run/ceph/ceph-$name.asok'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression algorithm': 'zlib', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(MDS_TRIM\\)', '\\(MDS_SLOW_REQUEST\\)', 'MDS_SLOW_METADATA_IO', 'Behind on trimming', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-04-19T03:00:34.330 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/teuthology-2024-04-18_22:32:02-powercycle-reef-distro-default-smithi/7662873', 'branch': 'reef', 'description': 'powercycle/osd/{clusters/3osd-1per-target ignorelist_health objectstore/bluestore-comp-zlib powercycle/default supported-all-distro/ubuntu_20.04 tasks/admin_socket_objecter_requests thrashosds-health}', 'email': 'ceph-qa@ceph.com', 'first_in_suite': False, 'job_id': '7662873', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'teuthology-2024-04-18_22:32:02-powercycle-reef-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'os_type': 'ubuntu', 'os_version': '20.04', 'overrides': {'admin_socket': {'branch': 'reef'}, 'ceph': {'conf': {'client.0': {'admin socket': '/var/run/ceph/ceph-$name.asok'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression algorithm': 'zlib', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(MDS_TRIM\\)', '\\(MDS_SLOW_REQUEST\\)', 'MDS_SLOW_METADATA_IO', 'Behind on trimming', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from'], 'sha1': '646b8c7d293d8ec31a40c69f7b3237b19c1be24d'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'install': {'ceph': {'flavor': 'default', 'sha1': '646b8c7d293d8ec31a40c69f7b3237b19c1be24d'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'reef', 'sha1': '646b8c7d293d8ec31a40c69f7b3237b19c1be24d'}}, 'owner': 'scheduled_teuthology@teuthology', 'priority': 930, 'repo': 'https://git.ceph.com/ceph.git', 'roles': [['mon.a', 'mon.b', 'mon.c', 'mgr.x', 'mgr.y', 'mds.a', 'client.0'], ['osd.0'], ['osd.1'], ['osd.2']], 'seed': 2879, 'sha1': '646b8c7d293d8ec31a40c69f7b3237b19c1be24d', 'sleep_before_teardown': 0, 'subset': '2/4', 'suite': 'powercycle', 'suite_branch': 'reef', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph_646b8c7d293d8ec31a40c69f7b3237b19c1be24d/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph.git', 'suite_sha1': '646b8c7d293d8ec31a40c69f7b3237b19c1be24d', 'targets': {'smithi096.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM=', 'smithi097.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM=', 'smithi134.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM=', 'smithi144.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': '646b8c7d293d8ec31a40c69f7b3237b19c1be24d'}}, {'ceph': None}, {'thrashosds': {'chance_down': 1.0, 'powercycle': True, 'timeout': 600}}, {'radosbench': {'clients': ['client.0'], 'time': 60}}, {'admin_socket': {'client.0': {'objecter_requests': {'test': 'http://git.ceph.com/?p={repo};a=blob_plain;f=src/test/admin_socket/objecter_requests;hb={branch}'}}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17', 'timestamp': '2024-04-18_22:32:02', 'tube': 'smithi', 'user': 'teuthology', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-04-19T03:00:34.331 DEBUG:teuthology.orchestra.run.smithi096:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-19T03:00:34.333 DEBUG:teuthology.orchestra.run.smithi097:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-19T03:00:34.335 DEBUG:teuthology.orchestra.run.smithi134:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-19T03:00:34.337 DEBUG:teuthology.orchestra.run.smithi144:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-19T03:00:34.345 DEBUG:teuthology.orchestra.run.smithi096:> sudo install -d -m0777 -- /var/run/ceph 2024-04-19T03:00:34.347 DEBUG:teuthology.orchestra.run.smithi097:> sudo install -d -m0777 -- /var/run/ceph 2024-04-19T03:00:34.384 DEBUG:teuthology.orchestra.run.smithi134:> sudo install -d -m0777 -- /var/run/ceph 2024-04-19T03:00:34.386 DEBUG:teuthology.orchestra.run.smithi144:> sudo install -d -m0777 -- /var/run/ceph 2024-04-19T03:00:34.402 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-04-19T03:00:34.402 DEBUG:teuthology.orchestra.run.smithi097:> dd if=/scratch_devs of=/dev/stdout 2024-04-19T03:00:34.407 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-19T03:00:34.407 DEBUG:teuthology.orchestra.run.smithi097:> stat /dev/vg_nvme/lv_1 2024-04-19T03:00:34.413 INFO:teuthology.orchestra.run.smithi097.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-19T03:00:34.413 INFO:teuthology.orchestra.run.smithi097.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-19T03:00:34.413 INFO:teuthology.orchestra.run.smithi097.stdout:Device: 6h/6d Inode: 358 Links: 1 2024-04-19T03:00:34.413 INFO:teuthology.orchestra.run.smithi097.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-19T03:00:34.413 INFO:teuthology.orchestra.run.smithi097.stdout:Access: 2024-04-19 02:55:38.883703727 +0000 2024-04-19T03:00:34.413 INFO:teuthology.orchestra.run.smithi097.stdout:Modify: 2024-04-19 02:55:38.667708701 +0000 2024-04-19T03:00:34.413 INFO:teuthology.orchestra.run.smithi097.stdout:Change: 2024-04-19 02:55:38.667708701 +0000 2024-04-19T03:00:34.413 INFO:teuthology.orchestra.run.smithi097.stdout: Birth: - 2024-04-19T03:00:34.413 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-19T03:00:34.423 INFO:teuthology.orchestra.run.smithi097.stderr:1+0 records in 2024-04-19T03:00:34.423 INFO:teuthology.orchestra.run.smithi097.stderr:1+0 records out 2024-04-19T03:00:34.424 INFO:teuthology.orchestra.run.smithi097.stderr:512 bytes copied, 0.000433786 s, 1.2 MB/s 2024-04-19T03:00:34.425 DEBUG:teuthology.orchestra.run.smithi097:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-19T03:00:34.475 DEBUG:teuthology.orchestra.run.smithi097:> stat /dev/vg_nvme/lv_2 2024-04-19T03:00:34.482 INFO:teuthology.orchestra.run.smithi097.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-19T03:00:34.482 INFO:teuthology.orchestra.run.smithi097.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-19T03:00:34.482 INFO:teuthology.orchestra.run.smithi097.stdout:Device: 6h/6d Inode: 365 Links: 1 2024-04-19T03:00:34.482 INFO:teuthology.orchestra.run.smithi097.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-19T03:00:34.482 INFO:teuthology.orchestra.run.smithi097.stdout:Access: 2024-04-19 02:55:39.315693778 +0000 2024-04-19T03:00:34.482 INFO:teuthology.orchestra.run.smithi097.stdout:Modify: 2024-04-19 02:55:39.111698476 +0000 2024-04-19T03:00:34.482 INFO:teuthology.orchestra.run.smithi097.stdout:Change: 2024-04-19 02:55:39.111698476 +0000 2024-04-19T03:00:34.482 INFO:teuthology.orchestra.run.smithi097.stdout: Birth: - 2024-04-19T03:00:34.483 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-19T03:00:34.494 INFO:teuthology.orchestra.run.smithi097.stderr:1+0 records in 2024-04-19T03:00:34.494 INFO:teuthology.orchestra.run.smithi097.stderr:1+0 records out 2024-04-19T03:00:34.494 INFO:teuthology.orchestra.run.smithi097.stderr:512 bytes copied, 0.00042164 s, 1.2 MB/s 2024-04-19T03:00:34.495 DEBUG:teuthology.orchestra.run.smithi097:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-19T03:00:34.502 DEBUG:teuthology.orchestra.run.smithi097:> stat /dev/vg_nvme/lv_3 2024-04-19T03:00:34.508 INFO:teuthology.orchestra.run.smithi097.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-19T03:00:34.508 INFO:teuthology.orchestra.run.smithi097.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-19T03:00:34.508 INFO:teuthology.orchestra.run.smithi097.stdout:Device: 6h/6d Inode: 369 Links: 1 2024-04-19T03:00:34.508 INFO:teuthology.orchestra.run.smithi097.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-19T03:00:34.508 INFO:teuthology.orchestra.run.smithi097.stdout:Access: 2024-04-19 02:55:39.547688436 +0000 2024-04-19T03:00:34.508 INFO:teuthology.orchestra.run.smithi097.stdout:Modify: 2024-04-19 02:55:39.543688527 +0000 2024-04-19T03:00:34.508 INFO:teuthology.orchestra.run.smithi097.stdout:Change: 2024-04-19 02:55:39.543688527 +0000 2024-04-19T03:00:34.508 INFO:teuthology.orchestra.run.smithi097.stdout: Birth: - 2024-04-19T03:00:34.509 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-19T03:00:34.565 INFO:teuthology.orchestra.run.smithi097.stderr:1+0 records in 2024-04-19T03:00:34.565 INFO:teuthology.orchestra.run.smithi097.stderr:1+0 records out 2024-04-19T03:00:34.565 INFO:teuthology.orchestra.run.smithi097.stderr:512 bytes copied, 0.000391951 s, 1.3 MB/s 2024-04-19T03:00:34.566 DEBUG:teuthology.orchestra.run.smithi097:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-19T03:00:34.574 DEBUG:teuthology.orchestra.run.smithi097:> stat /dev/vg_nvme/lv_4 2024-04-19T03:00:34.580 INFO:teuthology.orchestra.run.smithi097.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-19T03:00:34.581 INFO:teuthology.orchestra.run.smithi097.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-19T03:00:34.581 INFO:teuthology.orchestra.run.smithi097.stdout:Device: 6h/6d Inode: 377 Links: 1 2024-04-19T03:00:34.581 INFO:teuthology.orchestra.run.smithi097.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-19T03:00:34.581 INFO:teuthology.orchestra.run.smithi097.stdout:Access: 2024-04-19 02:55:40.195673511 +0000 2024-04-19T03:00:34.581 INFO:teuthology.orchestra.run.smithi097.stdout:Modify: 2024-04-19 02:55:39.999678024 +0000 2024-04-19T03:00:34.581 INFO:teuthology.orchestra.run.smithi097.stdout:Change: 2024-04-19 02:55:39.999678024 +0000 2024-04-19T03:00:34.581 INFO:teuthology.orchestra.run.smithi097.stdout: Birth: - 2024-04-19T03:00:34.581 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-19T03:00:34.636 INFO:teuthology.orchestra.run.smithi097.stderr:1+0 records in 2024-04-19T03:00:34.637 INFO:teuthology.orchestra.run.smithi097.stderr:1+0 records out 2024-04-19T03:00:34.637 INFO:teuthology.orchestra.run.smithi097.stderr:512 bytes copied, 0.000369582 s, 1.4 MB/s 2024-04-19T03:00:34.638 DEBUG:teuthology.orchestra.run.smithi097:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-19T03:00:34.644 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1'} 2024-04-19T03:00:34.644 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-04-19T03:00:34.645 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/scratch_devs of=/dev/stdout 2024-04-19T03:00:34.651 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-19T03:00:34.652 DEBUG:teuthology.orchestra.run.smithi134:> stat /dev/vg_nvme/lv_1 2024-04-19T03:00:34.659 INFO:teuthology.orchestra.run.smithi134.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-19T03:00:34.659 INFO:teuthology.orchestra.run.smithi134.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-19T03:00:34.659 INFO:teuthology.orchestra.run.smithi134.stdout:Device: 6h/6d Inode: 360 Links: 1 2024-04-19T03:00:34.659 INFO:teuthology.orchestra.run.smithi134.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-19T03:00:34.659 INFO:teuthology.orchestra.run.smithi134.stdout:Access: 2024-04-19 02:55:40.212287837 +0000 2024-04-19T03:00:34.659 INFO:teuthology.orchestra.run.smithi134.stdout:Modify: 2024-04-19 02:55:39.996292820 +0000 2024-04-19T03:00:34.659 INFO:teuthology.orchestra.run.smithi134.stdout:Change: 2024-04-19 02:55:39.996292820 +0000 2024-04-19T03:00:34.659 INFO:teuthology.orchestra.run.smithi134.stdout: Birth: - 2024-04-19T03:00:34.659 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-19T03:00:34.714 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records in 2024-04-19T03:00:34.715 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records out 2024-04-19T03:00:34.715 INFO:teuthology.orchestra.run.smithi134.stderr:512 bytes copied, 0.000436861 s, 1.2 MB/s 2024-04-19T03:00:34.716 DEBUG:teuthology.orchestra.run.smithi134:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-19T03:00:34.724 DEBUG:teuthology.orchestra.run.smithi134:> stat /dev/vg_nvme/lv_2 2024-04-19T03:00:34.731 INFO:teuthology.orchestra.run.smithi134.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-19T03:00:34.731 INFO:teuthology.orchestra.run.smithi134.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-19T03:00:34.731 INFO:teuthology.orchestra.run.smithi134.stdout:Device: 6h/6d Inode: 364 Links: 1 2024-04-19T03:00:34.731 INFO:teuthology.orchestra.run.smithi134.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-19T03:00:34.732 INFO:teuthology.orchestra.run.smithi134.stdout:Access: 2024-04-19 02:55:40.668277318 +0000 2024-04-19T03:00:34.733 INFO:teuthology.orchestra.run.smithi134.stdout:Modify: 2024-04-19 02:55:40.452282301 +0000 2024-04-19T03:00:34.733 INFO:teuthology.orchestra.run.smithi134.stdout:Change: 2024-04-19 02:55:40.452282301 +0000 2024-04-19T03:00:34.733 INFO:teuthology.orchestra.run.smithi134.stdout: Birth: - 2024-04-19T03:00:34.733 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-19T03:00:34.747 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records in 2024-04-19T03:00:34.747 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records out 2024-04-19T03:00:34.747 INFO:teuthology.orchestra.run.smithi134.stderr:512 bytes copied, 0.000353726 s, 1.4 MB/s 2024-04-19T03:00:34.748 DEBUG:teuthology.orchestra.run.smithi134:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-19T03:00:34.800 DEBUG:teuthology.orchestra.run.smithi134:> stat /dev/vg_nvme/lv_3 2024-04-19T03:00:34.808 INFO:teuthology.orchestra.run.smithi134.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-19T03:00:34.808 INFO:teuthology.orchestra.run.smithi134.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-19T03:00:34.808 INFO:teuthology.orchestra.run.smithi134.stdout:Device: 6h/6d Inode: 371 Links: 1 2024-04-19T03:00:34.808 INFO:teuthology.orchestra.run.smithi134.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-19T03:00:34.808 INFO:teuthology.orchestra.run.smithi134.stdout:Access: 2024-04-19 02:55:40.880272428 +0000 2024-04-19T03:00:34.808 INFO:teuthology.orchestra.run.smithi134.stdout:Modify: 2024-04-19 02:55:40.876272521 +0000 2024-04-19T03:00:34.808 INFO:teuthology.orchestra.run.smithi134.stdout:Change: 2024-04-19 02:55:40.876272521 +0000 2024-04-19T03:00:34.808 INFO:teuthology.orchestra.run.smithi134.stdout: Birth: - 2024-04-19T03:00:34.808 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-19T03:00:34.820 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records in 2024-04-19T03:00:34.820 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records out 2024-04-19T03:00:34.820 INFO:teuthology.orchestra.run.smithi134.stderr:512 bytes copied, 0.000393591 s, 1.3 MB/s 2024-04-19T03:00:34.821 DEBUG:teuthology.orchestra.run.smithi134:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-19T03:00:34.872 DEBUG:teuthology.orchestra.run.smithi134:> stat /dev/vg_nvme/lv_4 2024-04-19T03:00:34.880 INFO:teuthology.orchestra.run.smithi134.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-19T03:00:34.880 INFO:teuthology.orchestra.run.smithi134.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-19T03:00:34.880 INFO:teuthology.orchestra.run.smithi134.stdout:Device: 6h/6d Inode: 379 Links: 1 2024-04-19T03:00:34.880 INFO:teuthology.orchestra.run.smithi134.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-19T03:00:34.880 INFO:teuthology.orchestra.run.smithi134.stdout:Access: 2024-04-19 02:55:41.552256928 +0000 2024-04-19T03:00:34.880 INFO:teuthology.orchestra.run.smithi134.stdout:Modify: 2024-04-19 02:55:41.320262279 +0000 2024-04-19T03:00:34.880 INFO:teuthology.orchestra.run.smithi134.stdout:Change: 2024-04-19 02:55:41.320262279 +0000 2024-04-19T03:00:34.880 INFO:teuthology.orchestra.run.smithi134.stdout: Birth: - 2024-04-19T03:00:34.880 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-19T03:00:34.892 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records in 2024-04-19T03:00:34.892 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records out 2024-04-19T03:00:34.892 INFO:teuthology.orchestra.run.smithi134.stderr:512 bytes copied, 0.000364192 s, 1.4 MB/s 2024-04-19T03:00:34.893 DEBUG:teuthology.orchestra.run.smithi134:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-19T03:00:34.944 INFO:tasks.ceph:osd dev map: {'osd.1': '/dev/vg_nvme/lv_1'} 2024-04-19T03:00:34.945 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-04-19T03:00:34.945 DEBUG:teuthology.orchestra.run.smithi144:> dd if=/scratch_devs of=/dev/stdout 2024-04-19T03:00:34.953 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-19T03:00:34.953 DEBUG:teuthology.orchestra.run.smithi144:> stat /dev/vg_nvme/lv_1 2024-04-19T03:00:35.004 INFO:teuthology.orchestra.run.smithi144.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-19T03:00:35.004 INFO:teuthology.orchestra.run.smithi144.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-19T03:00:35.004 INFO:teuthology.orchestra.run.smithi144.stdout:Device: 6h/6d Inode: 359 Links: 1 2024-04-19T03:00:35.004 INFO:teuthology.orchestra.run.smithi144.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-19T03:00:35.005 INFO:teuthology.orchestra.run.smithi144.stdout:Access: 2024-04-19 02:55:39.762885038 +0000 2024-04-19T03:00:35.005 INFO:teuthology.orchestra.run.smithi144.stdout:Modify: 2024-04-19 02:55:39.530890384 +0000 2024-04-19T03:00:35.005 INFO:teuthology.orchestra.run.smithi144.stdout:Change: 2024-04-19 02:55:39.530890384 +0000 2024-04-19T03:00:35.005 INFO:teuthology.orchestra.run.smithi144.stdout: Birth: - 2024-04-19T03:00:35.006 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-19T03:00:35.017 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-04-19T03:00:35.017 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-04-19T03:00:35.017 INFO:teuthology.orchestra.run.smithi144.stderr:512 bytes copied, 0.000447183 s, 1.1 MB/s 2024-04-19T03:00:35.018 DEBUG:teuthology.orchestra.run.smithi144:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-19T03:00:35.026 DEBUG:teuthology.orchestra.run.smithi144:> stat /dev/vg_nvme/lv_2 2024-04-19T03:00:35.073 INFO:teuthology.orchestra.run.smithi144.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-19T03:00:35.074 INFO:teuthology.orchestra.run.smithi144.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-19T03:00:35.074 INFO:teuthology.orchestra.run.smithi144.stdout:Device: 6h/6d Inode: 366 Links: 1 2024-04-19T03:00:35.074 INFO:teuthology.orchestra.run.smithi144.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-19T03:00:35.074 INFO:teuthology.orchestra.run.smithi144.stdout:Access: 2024-04-19 02:55:40.210874714 +0000 2024-04-19T03:00:35.074 INFO:teuthology.orchestra.run.smithi144.stdout:Modify: 2024-04-19 02:55:39.990879784 +0000 2024-04-19T03:00:35.074 INFO:teuthology.orchestra.run.smithi144.stdout:Change: 2024-04-19 02:55:39.990879784 +0000 2024-04-19T03:00:35.074 INFO:teuthology.orchestra.run.smithi144.stdout: Birth: - 2024-04-19T03:00:35.074 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-19T03:00:35.085 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-04-19T03:00:35.085 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-04-19T03:00:35.085 INFO:teuthology.orchestra.run.smithi144.stderr:512 bytes copied, 0.000397215 s, 1.3 MB/s 2024-04-19T03:00:35.086 DEBUG:teuthology.orchestra.run.smithi144:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-19T03:00:35.093 DEBUG:teuthology.orchestra.run.smithi144:> stat /dev/vg_nvme/lv_3 2024-04-19T03:00:35.141 INFO:teuthology.orchestra.run.smithi144.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-19T03:00:35.142 INFO:teuthology.orchestra.run.smithi144.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-19T03:00:35.142 INFO:teuthology.orchestra.run.smithi144.stdout:Device: 6h/6d Inode: 371 Links: 1 2024-04-19T03:00:35.142 INFO:teuthology.orchestra.run.smithi144.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-19T03:00:35.142 INFO:teuthology.orchestra.run.smithi144.stdout:Access: 2024-04-19 02:55:40.650864574 +0000 2024-04-19T03:00:35.142 INFO:teuthology.orchestra.run.smithi144.stdout:Modify: 2024-04-19 02:55:40.430869644 +0000 2024-04-19T03:00:35.142 INFO:teuthology.orchestra.run.smithi144.stdout:Change: 2024-04-19 02:55:40.430869644 +0000 2024-04-19T03:00:35.142 INFO:teuthology.orchestra.run.smithi144.stdout: Birth: - 2024-04-19T03:00:35.142 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-19T03:00:35.153 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-04-19T03:00:35.154 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-04-19T03:00:35.154 INFO:teuthology.orchestra.run.smithi144.stderr:512 bytes copied, 0.000425511 s, 1.2 MB/s 2024-04-19T03:00:35.155 DEBUG:teuthology.orchestra.run.smithi144:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-19T03:00:35.163 DEBUG:teuthology.orchestra.run.smithi144:> stat /dev/vg_nvme/lv_4 2024-04-19T03:00:35.213 INFO:teuthology.orchestra.run.smithi144.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-19T03:00:35.214 INFO:teuthology.orchestra.run.smithi144.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-19T03:00:35.214 INFO:teuthology.orchestra.run.smithi144.stdout:Device: 6h/6d Inode: 380 Links: 1 2024-04-19T03:00:35.214 INFO:teuthology.orchestra.run.smithi144.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-19T03:00:35.214 INFO:teuthology.orchestra.run.smithi144.stdout:Access: 2024-04-19 02:55:41.106854066 +0000 2024-04-19T03:00:35.214 INFO:teuthology.orchestra.run.smithi144.stdout:Modify: 2024-04-19 02:55:40.886859136 +0000 2024-04-19T03:00:35.214 INFO:teuthology.orchestra.run.smithi144.stdout:Change: 2024-04-19 02:55:40.886859136 +0000 2024-04-19T03:00:35.214 INFO:teuthology.orchestra.run.smithi144.stdout: Birth: - 2024-04-19T03:00:35.214 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-19T03:00:35.226 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records in 2024-04-19T03:00:35.226 INFO:teuthology.orchestra.run.smithi144.stderr:1+0 records out 2024-04-19T03:00:35.226 INFO:teuthology.orchestra.run.smithi144.stderr:512 bytes copied, 0.000366689 s, 1.4 MB/s 2024-04-19T03:00:35.227 DEBUG:teuthology.orchestra.run.smithi144:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-19T03:00:35.236 INFO:tasks.ceph:osd dev map: {'osd.2': '/dev/vg_nvme/lv_1'} 2024-04-19T03:00:35.236 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi097.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi134.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi144.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1'}} 2024-04-19T03:00:35.236 INFO:tasks.ceph:Generating config... 2024-04-19T03:00:35.237 INFO:tasks.ceph:[client.0] admin socket = /var/run/ceph/ceph-$name.asok 2024-04-19T03:00:35.237 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-04-19T03:00:35.237 INFO:tasks.ceph:[mgr] debug ms = 1 2024-04-19T03:00:35.237 INFO:tasks.ceph:[mon] debug mon = 20 2024-04-19T03:00:35.237 INFO:tasks.ceph:[mon] debug ms = 1 2024-04-19T03:00:35.237 INFO:tasks.ceph:[mon] debug paxos = 20 2024-04-19T03:00:35.238 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-04-19T03:00:35.238 INFO:tasks.ceph:[osd] bluestore compression algorithm = zlib 2024-04-19T03:00:35.238 INFO:tasks.ceph:[osd] bluestore compression mode = aggressive 2024-04-19T03:00:35.238 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-04-19T03:00:35.238 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-04-19T03:00:35.238 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-04-19T03:00:35.238 INFO:tasks.ceph:[osd] debug ms = 1 2024-04-19T03:00:35.238 INFO:tasks.ceph:[osd] debug osd = 20 2024-04-19T03:00:35.238 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-04-19T03:00:35.238 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-04-19T03:00:35.238 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-04-19T03:00:35.238 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-04-19T03:00:35.238 INFO:tasks.ceph:[osd] osd blocked scrub grace period = 3600 2024-04-19T03:00:35.238 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-04-19T03:00:35.239 INFO:tasks.ceph:[osd] osd max markdown count = 1000 2024-04-19T03:00:35.239 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-04-19T03:00:35.239 INFO:tasks.ceph:Setting up mon.a... 2024-04-19T03:00:35.239 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-04-19T03:00:35.281 INFO:teuthology.orchestra.run.smithi096.stdout:creating /etc/ceph/ceph.keyring 2024-04-19T03:00:35.301 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-04-19T03:00:35.341 DEBUG:teuthology.orchestra.run.smithi096:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-19T03:00:35.355 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.96'), ('mon.b', '[v2:172.21.15.96:3301,v1:172.21.15.96:6790]'), ('mon.c', '[v2:172.21.15.96:3302,v1:172.21.15.96:6791]')] 2024-04-19T03:00:35.356 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.96,[v2:172.21.15.96:3301,v1:172.21.15.96:6790],[v2:172.21.15.96:3302,v1:172.21.15.96:6791]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore compression algorithm': 'zlib', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore'}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false'}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok'}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'client.0': {'admin socket': '/var/run/ceph/ceph-$name.asok'}} 2024-04-19T03:00:35.356 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-04-19T03:00:35.357 DEBUG:teuthology.orchestra.run.smithi096:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-04-19T03:00:35.404 DEBUG:teuthology.orchestra.run.smithi096:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.96 --addv b '[v2:172.21.15.96:3301,v1:172.21.15.96:6790]' --addv c '[v2:172.21.15.96:3302,v1:172.21.15.96:6791]' --print /home/ubuntu/cephtest/ceph.monmap 2024-04-19T03:00:35.447 INFO:teuthology.orchestra.run.smithi096.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-04-19T03:00:35.447 INFO:teuthology.orchestra.run.smithi096.stdout:monmaptool: generated fsid c6cc8e09-11d4-48de-9a6c-4d70ed3c3789 2024-04-19T03:00:35.447 INFO:teuthology.orchestra.run.smithi096.stdout:setting min_mon_release = pacific 2024-04-19T03:00:35.447 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 0 2024-04-19T03:00:35.447 INFO:teuthology.orchestra.run.smithi096.stdout:fsid c6cc8e09-11d4-48de-9a6c-4d70ed3c3789 2024-04-19T03:00:35.447 INFO:teuthology.orchestra.run.smithi096.stdout:last_changed 2024-04-19T03:00:35.447298+0000 2024-04-19T03:00:35.447 INFO:teuthology.orchestra.run.smithi096.stdout:created 2024-04-19T03:00:35.447298+0000 2024-04-19T03:00:35.447 INFO:teuthology.orchestra.run.smithi096.stdout:min_mon_release 16 (pacific) 2024-04-19T03:00:35.448 INFO:teuthology.orchestra.run.smithi096.stdout:election_strategy: 1 2024-04-19T03:00:35.448 INFO:teuthology.orchestra.run.smithi096.stdout:0: [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] mon.a 2024-04-19T03:00:35.448 INFO:teuthology.orchestra.run.smithi096.stdout:1: [v2:172.21.15.96:3301/0,v1:172.21.15.96:6790/0] mon.b 2024-04-19T03:00:35.448 INFO:teuthology.orchestra.run.smithi096.stdout:2: [v2:172.21.15.96:3302/0,v1:172.21.15.96:6791/0] mon.c 2024-04-19T03:00:35.448 INFO:teuthology.orchestra.run.smithi096.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-04-19T03:00:35.449 DEBUG:teuthology.orchestra.run.smithi096:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-04-19T03:00:35.453 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID c6cc8e09-11d4-48de-9a6c-4d70ed3c3789... 2024-04-19T03:00:35.454 DEBUG:teuthology.orchestra.run.smithi096:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-19T03:00:35.456 DEBUG:teuthology.orchestra.run.smithi097:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-19T03:00:35.459 DEBUG:teuthology.orchestra.run.smithi134:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-19T03:00:35.461 DEBUG:teuthology.orchestra.run.smithi144:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-19T03:00:35.485 INFO:teuthology.orchestra.run.smithi096.stdout:[global] 2024-04-19T03:00:35.485 INFO:teuthology.orchestra.run.smithi096.stdout: chdir = "" 2024-04-19T03:00:35.485 INFO:teuthology.orchestra.run.smithi096.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-19T03:00:35.485 INFO:teuthology.orchestra.run.smithi096.stdout: auth supported = cephx 2024-04-19T03:00:35.485 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-19T03:00:35.485 INFO:teuthology.orchestra.run.smithi096.stdout: filestore xattr use omap = true 2024-04-19T03:00:35.485 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-19T03:00:35.486 INFO:teuthology.orchestra.run.smithi096.stdout: mon clock drift allowed = 1.000 2024-04-19T03:00:35.486 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-19T03:00:35.486 INFO:teuthology.orchestra.run.smithi096.stdout: osd crush chooseleaf type = 0 2024-04-19T03:00:35.486 INFO:teuthology.orchestra.run.smithi096.stdout: auth debug = true 2024-04-19T03:00:35.486 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-19T03:00:35.486 INFO:teuthology.orchestra.run.smithi096.stdout: ms die on old message = true 2024-04-19T03:00:35.486 INFO:teuthology.orchestra.run.smithi096.stdout: ms die on bug = true 2024-04-19T03:00:35.486 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-19T03:00:35.486 INFO:teuthology.orchestra.run.smithi096.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-19T03:00:35.486 INFO:teuthology.orchestra.run.smithi096.stdout: mon pg warn max object skew = 0 2024-04-19T03:00:35.486 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-19T03:00:35.486 INFO:teuthology.orchestra.run.smithi096.stdout: # disable pg_autoscaler by default for new pools 2024-04-19T03:00:35.487 INFO:teuthology.orchestra.run.smithi096.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-19T03:00:35.487 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-19T03:00:35.487 INFO:teuthology.orchestra.run.smithi096.stdout: osd pool default size = 2 2024-04-19T03:00:35.487 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-19T03:00:35.487 INFO:teuthology.orchestra.run.smithi096.stdout: mon osd allow primary affinity = true 2024-04-19T03:00:35.487 INFO:teuthology.orchestra.run.smithi096.stdout: mon osd allow pg remap = true 2024-04-19T03:00:35.487 INFO:teuthology.orchestra.run.smithi096.stdout: mon warn on legacy crush tunables = false 2024-04-19T03:00:35.487 INFO:teuthology.orchestra.run.smithi096.stdout: mon warn on crush straw calc version zero = false 2024-04-19T03:00:35.487 INFO:teuthology.orchestra.run.smithi096.stdout: mon warn on no sortbitwise = false 2024-04-19T03:00:35.487 INFO:teuthology.orchestra.run.smithi096.stdout: mon warn on osd down out interval zero = false 2024-04-19T03:00:35.487 INFO:teuthology.orchestra.run.smithi096.stdout: mon warn on too few osds = false 2024-04-19T03:00:35.488 INFO:teuthology.orchestra.run.smithi096.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-19T03:00:35.488 INFO:teuthology.orchestra.run.smithi096.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-19T03:00:35.488 INFO:teuthology.orchestra.run.smithi096.stdout: mon_allow_pool_size_one = true 2024-04-19T03:00:35.488 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-19T03:00:35.488 INFO:teuthology.orchestra.run.smithi096.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-19T03:00:35.488 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-19T03:00:35.488 INFO:teuthology.orchestra.run.smithi096.stdout: osd default data pool replay window = 5 2024-04-19T03:00:35.488 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-19T03:00:35.488 INFO:teuthology.orchestra.run.smithi096.stdout: mon allow pool delete = true 2024-04-19T03:00:35.488 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-19T03:00:35.488 INFO:teuthology.orchestra.run.smithi096.stdout: mon cluster log file level = debug 2024-04-19T03:00:35.488 INFO:teuthology.orchestra.run.smithi096.stdout: debug asserts on shutdown = true 2024-04-19T03:00:35.488 INFO:teuthology.orchestra.run.smithi096.stdout: mon health detail to clog = false 2024-04-19T03:00:35.489 INFO:teuthology.orchestra.run.smithi096.stdout: mon host = "172.21.15.96,[v2:172.21.15.96:3301,v1:172.21.15.96:6790],[v2:172.21.15.96:3302,v1:172.21.15.96:6791]" 2024-04-19T03:00:35.489 INFO:teuthology.orchestra.run.smithi096.stdout: fsid = c6cc8e09-11d4-48de-9a6c-4d70ed3c3789 2024-04-19T03:00:35.489 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-19T03:00:35.489 INFO:teuthology.orchestra.run.smithi096.stdout:[osd] 2024-04-19T03:00:35.489 INFO:teuthology.orchestra.run.smithi096.stdout: osd journal size = 100 2024-04-19T03:00:35.489 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-19T03:00:35.489 INFO:teuthology.orchestra.run.smithi096.stdout: osd scrub load threshold = 5.0 2024-04-19T03:00:35.489 INFO:teuthology.orchestra.run.smithi096.stdout: osd scrub max interval = 600 2024-04-19T03:00:35.489 INFO:teuthology.orchestra.run.smithi096.stdout: osd mclock profile = high_recovery_ops 2024-04-19T03:00:35.489 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-19T03:00:35.489 INFO:teuthology.orchestra.run.smithi096.stdout: osd recover clone overlap = true 2024-04-19T03:00:35.489 INFO:teuthology.orchestra.run.smithi096.stdout: osd recovery max chunk = 1048576 2024-04-19T03:00:35.489 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-19T03:00:35.490 INFO:teuthology.orchestra.run.smithi096.stdout: osd debug shutdown = true 2024-04-19T03:00:35.490 INFO:teuthology.orchestra.run.smithi096.stdout: osd debug op order = true 2024-04-19T03:00:35.490 INFO:teuthology.orchestra.run.smithi096.stdout: osd debug verify stray on activate = true 2024-04-19T03:00:35.490 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-19T03:00:35.490 INFO:teuthology.orchestra.run.smithi096.stdout: osd open classes on start = true 2024-04-19T03:00:35.490 INFO:teuthology.orchestra.run.smithi096.stdout: osd debug pg log writeout = true 2024-04-19T03:00:35.490 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-19T03:00:35.490 INFO:teuthology.orchestra.run.smithi096.stdout: osd deep scrub update digest min age = 30 2024-04-19T03:00:35.490 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-19T03:00:35.490 INFO:teuthology.orchestra.run.smithi096.stdout: osd map max advance = 10 2024-04-19T03:00:35.490 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-19T03:00:35.490 INFO:teuthology.orchestra.run.smithi096.stdout: journal zero on create = true 2024-04-19T03:00:35.491 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-19T03:00:35.491 INFO:teuthology.orchestra.run.smithi096.stdout: filestore ondisk finisher threads = 3 2024-04-19T03:00:35.491 INFO:teuthology.orchestra.run.smithi096.stdout: filestore apply finisher threads = 3 2024-04-19T03:00:35.491 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-19T03:00:35.491 INFO:teuthology.orchestra.run.smithi096.stdout: bdev debug aio = true 2024-04-19T03:00:35.491 INFO:teuthology.orchestra.run.smithi096.stdout: osd debug misdirected ops = true 2024-04-19T03:00:35.491 INFO:teuthology.orchestra.run.smithi096.stdout: bluestore block size = 96636764160 2024-04-19T03:00:35.491 INFO:teuthology.orchestra.run.smithi096.stdout: bluestore compression algorithm = zlib 2024-04-19T03:00:35.491 INFO:teuthology.orchestra.run.smithi096.stdout: bluestore compression mode = aggressive 2024-04-19T03:00:35.491 INFO:teuthology.orchestra.run.smithi096.stdout: bluestore fsck on mount = True 2024-04-19T03:00:35.491 INFO:teuthology.orchestra.run.smithi096.stdout: debug bluefs = 1/20 2024-04-19T03:00:35.491 INFO:teuthology.orchestra.run.smithi096.stdout: debug bluestore = 1/20 2024-04-19T03:00:35.491 INFO:teuthology.orchestra.run.smithi096.stdout: debug ms = 1 2024-04-19T03:00:35.492 INFO:teuthology.orchestra.run.smithi096.stdout: debug osd = 20 2024-04-19T03:00:35.492 INFO:teuthology.orchestra.run.smithi096.stdout: debug rocksdb = 4/10 2024-04-19T03:00:35.492 INFO:teuthology.orchestra.run.smithi096.stdout: mon osd backfillfull_ratio = 0.85 2024-04-19T03:00:35.492 INFO:teuthology.orchestra.run.smithi096.stdout: mon osd full ratio = 0.9 2024-04-19T03:00:35.492 INFO:teuthology.orchestra.run.smithi096.stdout: mon osd nearfull ratio = 0.8 2024-04-19T03:00:35.492 INFO:teuthology.orchestra.run.smithi096.stdout: osd blocked scrub grace period = 3600 2024-04-19T03:00:35.492 INFO:teuthology.orchestra.run.smithi096.stdout: osd failsafe full ratio = 0.95 2024-04-19T03:00:35.492 INFO:teuthology.orchestra.run.smithi096.stdout: osd max markdown count = 1000 2024-04-19T03:00:35.492 INFO:teuthology.orchestra.run.smithi096.stdout: osd objectstore = bluestore 2024-04-19T03:00:35.492 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-19T03:00:35.492 INFO:teuthology.orchestra.run.smithi096.stdout:[mgr] 2024-04-19T03:00:35.492 INFO:teuthology.orchestra.run.smithi096.stdout: debug ms = 1 2024-04-19T03:00:35.493 INFO:teuthology.orchestra.run.smithi096.stdout: debug mgr = 20 2024-04-19T03:00:35.493 INFO:teuthology.orchestra.run.smithi096.stdout: debug mon = 20 2024-04-19T03:00:35.493 INFO:teuthology.orchestra.run.smithi096.stdout: debug auth = 20 2024-04-19T03:00:35.493 INFO:teuthology.orchestra.run.smithi096.stdout: mon reweight min pgs per osd = 4 2024-04-19T03:00:35.493 INFO:teuthology.orchestra.run.smithi096.stdout: mon reweight min bytes per osd = 10 2024-04-19T03:00:35.493 INFO:teuthology.orchestra.run.smithi096.stdout: mgr/telemetry/nag = false 2024-04-19T03:00:35.493 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-19T03:00:35.493 INFO:teuthology.orchestra.run.smithi096.stdout:[mon] 2024-04-19T03:00:35.493 INFO:teuthology.orchestra.run.smithi096.stdout: debug ms = 1 2024-04-19T03:00:35.493 INFO:teuthology.orchestra.run.smithi096.stdout: debug mon = 20 2024-04-19T03:00:35.493 INFO:teuthology.orchestra.run.smithi096.stdout: debug paxos = 20 2024-04-19T03:00:35.493 INFO:teuthology.orchestra.run.smithi096.stdout: debug auth = 20 2024-04-19T03:00:35.493 INFO:teuthology.orchestra.run.smithi096.stdout: mon data avail warn = 5 2024-04-19T03:00:35.493 INFO:teuthology.orchestra.run.smithi096.stdout: mon mgr mkfs grace = 240 2024-04-19T03:00:35.494 INFO:teuthology.orchestra.run.smithi096.stdout: mon reweight min pgs per osd = 4 2024-04-19T03:00:35.494 INFO:teuthology.orchestra.run.smithi096.stdout: mon osd reporter subtree level = osd 2024-04-19T03:00:35.494 INFO:teuthology.orchestra.run.smithi096.stdout: mon osd prime pg temp = true 2024-04-19T03:00:35.494 INFO:teuthology.orchestra.run.smithi096.stdout: mon reweight min bytes per osd = 10 2024-04-19T03:00:35.494 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-19T03:00:35.494 INFO:teuthology.orchestra.run.smithi096.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-19T03:00:35.494 INFO:teuthology.orchestra.run.smithi096.stdout: auth mon ticket ttl = 660 # 11m 2024-04-19T03:00:35.494 INFO:teuthology.orchestra.run.smithi096.stdout: auth service ticket ttl = 240 # 4m 2024-04-19T03:00:35.494 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-19T03:00:35.494 INFO:teuthology.orchestra.run.smithi096.stdout: # don't complain about insecure global_id in the test suite 2024-04-19T03:00:35.494 INFO:teuthology.orchestra.run.smithi096.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-19T03:00:35.494 INFO:teuthology.orchestra.run.smithi096.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-19T03:00:35.494 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-19T03:00:35.495 INFO:teuthology.orchestra.run.smithi096.stdout: # 1m isn't quite enough 2024-04-19T03:00:35.495 INFO:teuthology.orchestra.run.smithi096.stdout: mon_down_mkfs_grace = 2m 2024-04-19T03:00:35.495 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-19T03:00:35.495 INFO:teuthology.orchestra.run.smithi096.stdout: mon_warn_on_filestore_osds = false 2024-04-19T03:00:35.495 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-19T03:00:35.495 INFO:teuthology.orchestra.run.smithi096.stdout:[client] 2024-04-19T03:00:35.495 INFO:teuthology.orchestra.run.smithi096.stdout: rgw cache enabled = true 2024-04-19T03:00:35.495 INFO:teuthology.orchestra.run.smithi096.stdout: rgw enable ops log = true 2024-04-19T03:00:35.495 INFO:teuthology.orchestra.run.smithi096.stdout: rgw enable usage log = true 2024-04-19T03:00:35.495 INFO:teuthology.orchestra.run.smithi096.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-19T03:00:35.495 INFO:teuthology.orchestra.run.smithi096.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-19T03:00:35.495 INFO:teuthology.orchestra.run.smithi096.stdout:[mon.a] 2024-04-19T03:00:35.495 INFO:teuthology.orchestra.run.smithi096.stdout:[mon.b] 2024-04-19T03:00:35.495 INFO:teuthology.orchestra.run.smithi096.stdout:[mon.c] 2024-04-19T03:00:35.495 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.a] 2024-04-19T03:00:35.496 INFO:teuthology.orchestra.run.smithi096.stdout:[client.0] 2024-04-19T03:00:35.496 INFO:teuthology.orchestra.run.smithi096.stdout: admin socket = /var/run/ceph/ceph-$name.asok 2024-04-19T03:00:35.496 INFO:teuthology.orchestra.run.smithi134.stdout:[global] 2024-04-19T03:00:35.497 INFO:teuthology.orchestra.run.smithi134.stdout: chdir = "" 2024-04-19T03:00:35.497 INFO:teuthology.orchestra.run.smithi134.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-19T03:00:35.497 INFO:teuthology.orchestra.run.smithi134.stdout: auth supported = cephx 2024-04-19T03:00:35.497 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-19T03:00:35.497 INFO:teuthology.orchestra.run.smithi134.stdout: filestore xattr use omap = true 2024-04-19T03:00:35.497 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-19T03:00:35.497 INFO:teuthology.orchestra.run.smithi134.stdout: mon clock drift allowed = 1.000 2024-04-19T03:00:35.497 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-19T03:00:35.497 INFO:teuthology.orchestra.run.smithi134.stdout: osd crush chooseleaf type = 0 2024-04-19T03:00:35.497 INFO:teuthology.orchestra.run.smithi134.stdout: auth debug = true 2024-04-19T03:00:35.497 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-19T03:00:35.497 INFO:teuthology.orchestra.run.smithi134.stdout: ms die on old message = true 2024-04-19T03:00:35.497 INFO:teuthology.orchestra.run.smithi134.stdout: ms die on bug = true 2024-04-19T03:00:35.498 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-19T03:00:35.498 INFO:teuthology.orchestra.run.smithi134.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-19T03:00:35.498 INFO:teuthology.orchestra.run.smithi134.stdout: mon pg warn max object skew = 0 2024-04-19T03:00:35.498 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-19T03:00:35.498 INFO:teuthology.orchestra.run.smithi134.stdout: # disable pg_autoscaler by default for new pools 2024-04-19T03:00:35.498 INFO:teuthology.orchestra.run.smithi134.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-19T03:00:35.498 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-19T03:00:35.498 INFO:teuthology.orchestra.run.smithi134.stdout: osd pool default size = 2 2024-04-19T03:00:35.498 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-19T03:00:35.498 INFO:teuthology.orchestra.run.smithi134.stdout: mon osd allow primary affinity = true 2024-04-19T03:00:35.498 INFO:teuthology.orchestra.run.smithi134.stdout: mon osd allow pg remap = true 2024-04-19T03:00:35.498 INFO:teuthology.orchestra.run.smithi134.stdout: mon warn on legacy crush tunables = false 2024-04-19T03:00:35.499 INFO:teuthology.orchestra.run.smithi134.stdout: mon warn on crush straw calc version zero = false 2024-04-19T03:00:35.499 INFO:teuthology.orchestra.run.smithi134.stdout: mon warn on no sortbitwise = false 2024-04-19T03:00:35.499 INFO:teuthology.orchestra.run.smithi134.stdout: mon warn on osd down out interval zero = false 2024-04-19T03:00:35.499 INFO:teuthology.orchestra.run.smithi134.stdout: mon warn on too few osds = false 2024-04-19T03:00:35.499 INFO:teuthology.orchestra.run.smithi134.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-19T03:00:35.499 INFO:teuthology.orchestra.run.smithi134.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-19T03:00:35.499 INFO:teuthology.orchestra.run.smithi134.stdout: mon_allow_pool_size_one = true 2024-04-19T03:00:35.499 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-19T03:00:35.499 INFO:teuthology.orchestra.run.smithi134.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-19T03:00:35.499 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-19T03:00:35.499 INFO:teuthology.orchestra.run.smithi134.stdout: osd default data pool replay window = 5 2024-04-19T03:00:35.499 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-19T03:00:35.499 INFO:teuthology.orchestra.run.smithi134.stdout: mon allow pool delete = true 2024-04-19T03:00:35.500 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-19T03:00:35.500 INFO:teuthology.orchestra.run.smithi134.stdout: mon cluster log file level = debug 2024-04-19T03:00:35.500 INFO:teuthology.orchestra.run.smithi134.stdout: debug asserts on shutdown = true 2024-04-19T03:00:35.500 INFO:teuthology.orchestra.run.smithi134.stdout: mon health detail to clog = false 2024-04-19T03:00:35.500 INFO:teuthology.orchestra.run.smithi134.stdout: mon host = "172.21.15.96,[v2:172.21.15.96:3301,v1:172.21.15.96:6790],[v2:172.21.15.96:3302,v1:172.21.15.96:6791]" 2024-04-19T03:00:35.500 INFO:teuthology.orchestra.run.smithi134.stdout: fsid = c6cc8e09-11d4-48de-9a6c-4d70ed3c3789 2024-04-19T03:00:35.500 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-19T03:00:35.500 INFO:teuthology.orchestra.run.smithi134.stdout:[osd] 2024-04-19T03:00:35.500 INFO:teuthology.orchestra.run.smithi134.stdout: osd journal size = 100 2024-04-19T03:00:35.500 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-19T03:00:35.500 INFO:teuthology.orchestra.run.smithi134.stdout: osd scrub load threshold = 5.0 2024-04-19T03:00:35.500 INFO:teuthology.orchestra.run.smithi134.stdout: osd scrub max interval = 600 2024-04-19T03:00:35.500 INFO:teuthology.orchestra.run.smithi134.stdout: osd mclock profile = high_recovery_ops 2024-04-19T03:00:35.500 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-19T03:00:35.501 INFO:teuthology.orchestra.run.smithi134.stdout: osd recover clone overlap = true 2024-04-19T03:00:35.501 INFO:teuthology.orchestra.run.smithi134.stdout: osd recovery max chunk = 1048576 2024-04-19T03:00:35.501 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-19T03:00:35.501 INFO:teuthology.orchestra.run.smithi134.stdout: osd debug shutdown = true 2024-04-19T03:00:35.501 INFO:teuthology.orchestra.run.smithi134.stdout: osd debug op order = true 2024-04-19T03:00:35.501 INFO:teuthology.orchestra.run.smithi134.stdout: osd debug verify stray on activate = true 2024-04-19T03:00:35.501 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-19T03:00:35.501 INFO:teuthology.orchestra.run.smithi134.stdout: osd open classes on start = true 2024-04-19T03:00:35.501 INFO:teuthology.orchestra.run.smithi134.stdout: osd debug pg log writeout = true 2024-04-19T03:00:35.501 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-19T03:00:35.501 INFO:teuthology.orchestra.run.smithi134.stdout: osd deep scrub update digest min age = 30 2024-04-19T03:00:35.501 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-19T03:00:35.502 INFO:teuthology.orchestra.run.smithi134.stdout: osd map max advance = 10 2024-04-19T03:00:35.502 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-19T03:00:35.502 INFO:teuthology.orchestra.run.smithi134.stdout: journal zero on create = true 2024-04-19T03:00:35.502 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-19T03:00:35.502 INFO:teuthology.orchestra.run.smithi134.stdout: filestore ondisk finisher threads = 3 2024-04-19T03:00:35.502 INFO:teuthology.orchestra.run.smithi134.stdout: filestore apply finisher threads = 3 2024-04-19T03:00:35.502 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-19T03:00:35.502 INFO:teuthology.orchestra.run.smithi134.stdout: bdev debug aio = true 2024-04-19T03:00:35.502 INFO:teuthology.orchestra.run.smithi134.stdout: osd debug misdirected ops = true 2024-04-19T03:00:35.502 INFO:teuthology.orchestra.run.smithi134.stdout: bluestore block size = 96636764160 2024-04-19T03:00:35.502 INFO:teuthology.orchestra.run.smithi134.stdout: bluestore compression algorithm = zlib 2024-04-19T03:00:35.502 INFO:teuthology.orchestra.run.smithi134.stdout: bluestore compression mode = aggressive 2024-04-19T03:00:35.502 INFO:teuthology.orchestra.run.smithi134.stdout: bluestore fsck on mount = True 2024-04-19T03:00:35.502 INFO:teuthology.orchestra.run.smithi134.stdout: debug bluefs = 1/20 2024-04-19T03:00:35.502 INFO:teuthology.orchestra.run.smithi134.stdout: debug bluestore = 1/20 2024-04-19T03:00:35.503 INFO:teuthology.orchestra.run.smithi134.stdout: debug ms = 1 2024-04-19T03:00:35.503 INFO:teuthology.orchestra.run.smithi134.stdout: debug osd = 20 2024-04-19T03:00:35.503 INFO:teuthology.orchestra.run.smithi134.stdout: debug rocksdb = 4/10 2024-04-19T03:00:35.503 INFO:teuthology.orchestra.run.smithi134.stdout: mon osd backfillfull_ratio = 0.85 2024-04-19T03:00:35.503 INFO:teuthology.orchestra.run.smithi134.stdout: mon osd full ratio = 0.9 2024-04-19T03:00:35.503 INFO:teuthology.orchestra.run.smithi134.stdout: mon osd nearfull ratio = 0.8 2024-04-19T03:00:35.503 INFO:teuthology.orchestra.run.smithi134.stdout: osd blocked scrub grace period = 3600 2024-04-19T03:00:35.503 INFO:teuthology.orchestra.run.smithi134.stdout: osd failsafe full ratio = 0.95 2024-04-19T03:00:35.503 INFO:teuthology.orchestra.run.smithi134.stdout: osd max markdown count = 1000 2024-04-19T03:00:35.503 INFO:teuthology.orchestra.run.smithi134.stdout: osd objectstore = bluestore 2024-04-19T03:00:35.503 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-19T03:00:35.503 INFO:teuthology.orchestra.run.smithi134.stdout:[mgr] 2024-04-19T03:00:35.503 INFO:teuthology.orchestra.run.smithi134.stdout: debug ms = 1 2024-04-19T03:00:35.504 INFO:teuthology.orchestra.run.smithi134.stdout: debug mgr = 20 2024-04-19T03:00:35.504 INFO:teuthology.orchestra.run.smithi134.stdout: debug mon = 20 2024-04-19T03:00:35.504 INFO:teuthology.orchestra.run.smithi134.stdout: debug auth = 20 2024-04-19T03:00:35.504 INFO:teuthology.orchestra.run.smithi134.stdout: mon reweight min pgs per osd = 4 2024-04-19T03:00:35.504 INFO:teuthology.orchestra.run.smithi134.stdout: mon reweight min bytes per osd = 10 2024-04-19T03:00:35.504 INFO:teuthology.orchestra.run.smithi134.stdout: mgr/telemetry/nag = false 2024-04-19T03:00:35.504 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-19T03:00:35.504 INFO:teuthology.orchestra.run.smithi134.stdout:[mon] 2024-04-19T03:00:35.504 INFO:teuthology.orchestra.run.smithi134.stdout: debug ms = 1 2024-04-19T03:00:35.504 INFO:teuthology.orchestra.run.smithi134.stdout: debug mon = 20 2024-04-19T03:00:35.504 INFO:teuthology.orchestra.run.smithi134.stdout: debug paxos = 20 2024-04-19T03:00:35.504 INFO:teuthology.orchestra.run.smithi134.stdout: debug auth = 20 2024-04-19T03:00:35.504 INFO:teuthology.orchestra.run.smithi134.stdout: mon data avail warn = 5 2024-04-19T03:00:35.504 INFO:teuthology.orchestra.run.smithi134.stdout: mon mgr mkfs grace = 240 2024-04-19T03:00:35.505 INFO:teuthology.orchestra.run.smithi134.stdout: mon reweight min pgs per osd = 4 2024-04-19T03:00:35.505 INFO:teuthology.orchestra.run.smithi134.stdout: mon osd reporter subtree level = osd 2024-04-19T03:00:35.505 INFO:teuthology.orchestra.run.smithi134.stdout: mon osd prime pg temp = true 2024-04-19T03:00:35.505 INFO:teuthology.orchestra.run.smithi134.stdout: mon reweight min bytes per osd = 10 2024-04-19T03:00:35.505 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-19T03:00:35.505 INFO:teuthology.orchestra.run.smithi134.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-19T03:00:35.505 INFO:teuthology.orchestra.run.smithi134.stdout: auth mon ticket ttl = 660 # 11m 2024-04-19T03:00:35.505 INFO:teuthology.orchestra.run.smithi134.stdout: auth service ticket ttl = 240 # 4m 2024-04-19T03:00:35.505 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-19T03:00:35.505 INFO:teuthology.orchestra.run.smithi134.stdout: # don't complain about insecure global_id in the test suite 2024-04-19T03:00:35.505 INFO:teuthology.orchestra.run.smithi134.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-19T03:00:35.505 INFO:teuthology.orchestra.run.smithi134.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-19T03:00:35.505 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-19T03:00:35.505 INFO:teuthology.orchestra.run.smithi134.stdout: # 1m isn't quite enough 2024-04-19T03:00:35.506 INFO:teuthology.orchestra.run.smithi134.stdout: mon_down_mkfs_grace = 2m 2024-04-19T03:00:35.506 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-19T03:00:35.506 INFO:teuthology.orchestra.run.smithi134.stdout: mon_warn_on_filestore_osds = false 2024-04-19T03:00:35.506 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-04-19T03:00:35.506 INFO:teuthology.orchestra.run.smithi134.stdout:[client] 2024-04-19T03:00:35.506 INFO:teuthology.orchestra.run.smithi134.stdout: rgw cache enabled = true 2024-04-19T03:00:35.506 INFO:teuthology.orchestra.run.smithi134.stdout: rgw enable ops log = true 2024-04-19T03:00:35.506 INFO:teuthology.orchestra.run.smithi134.stdout: rgw enable usage log = true 2024-04-19T03:00:35.506 INFO:teuthology.orchestra.run.smithi134.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-19T03:00:35.506 INFO:teuthology.orchestra.run.smithi134.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-19T03:00:35.506 INFO:teuthology.orchestra.run.smithi134.stdout:[mon.a] 2024-04-19T03:00:35.506 INFO:teuthology.orchestra.run.smithi134.stdout:[mon.b] 2024-04-19T03:00:35.506 INFO:teuthology.orchestra.run.smithi134.stdout:[mon.c] 2024-04-19T03:00:35.507 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.a] 2024-04-19T03:00:35.507 INFO:teuthology.orchestra.run.smithi134.stdout:[client.0] 2024-04-19T03:00:35.507 INFO:teuthology.orchestra.run.smithi134.stdout: admin socket = /var/run/ceph/ceph-$name.asok 2024-04-19T03:00:35.507 INFO:teuthology.orchestra.run.smithi097.stdout:[global] 2024-04-19T03:00:35.507 INFO:teuthology.orchestra.run.smithi097.stdout: chdir = "" 2024-04-19T03:00:35.507 INFO:teuthology.orchestra.run.smithi097.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-19T03:00:35.509 INFO:teuthology.orchestra.run.smithi097.stdout: auth supported = cephx 2024-04-19T03:00:35.509 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-04-19T03:00:35.509 INFO:teuthology.orchestra.run.smithi097.stdout: filestore xattr use omap = true 2024-04-19T03:00:35.509 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-04-19T03:00:35.510 INFO:teuthology.orchestra.run.smithi097.stdout: mon clock drift allowed = 1.000 2024-04-19T03:00:35.510 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-04-19T03:00:35.510 INFO:teuthology.orchestra.run.smithi097.stdout: osd crush chooseleaf type = 0 2024-04-19T03:00:35.510 INFO:teuthology.orchestra.run.smithi097.stdout: auth debug = true 2024-04-19T03:00:35.510 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-04-19T03:00:35.510 INFO:teuthology.orchestra.run.smithi097.stdout: ms die on old message = true 2024-04-19T03:00:35.510 INFO:teuthology.orchestra.run.smithi097.stdout: ms die on bug = true 2024-04-19T03:00:35.510 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-04-19T03:00:35.510 INFO:teuthology.orchestra.run.smithi097.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-19T03:00:35.510 INFO:teuthology.orchestra.run.smithi097.stdout: mon pg warn max object skew = 0 2024-04-19T03:00:35.510 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-04-19T03:00:35.510 INFO:teuthology.orchestra.run.smithi097.stdout: # disable pg_autoscaler by default for new pools 2024-04-19T03:00:35.510 INFO:teuthology.orchestra.run.smithi097.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-19T03:00:35.510 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-04-19T03:00:35.511 INFO:teuthology.orchestra.run.smithi097.stdout: osd pool default size = 2 2024-04-19T03:00:35.511 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-04-19T03:00:35.511 INFO:teuthology.orchestra.run.smithi097.stdout: mon osd allow primary affinity = true 2024-04-19T03:00:35.511 INFO:teuthology.orchestra.run.smithi097.stdout: mon osd allow pg remap = true 2024-04-19T03:00:35.511 INFO:teuthology.orchestra.run.smithi097.stdout: mon warn on legacy crush tunables = false 2024-04-19T03:00:35.511 INFO:teuthology.orchestra.run.smithi097.stdout: mon warn on crush straw calc version zero = false 2024-04-19T03:00:35.511 INFO:teuthology.orchestra.run.smithi097.stdout: mon warn on no sortbitwise = false 2024-04-19T03:00:35.511 INFO:teuthology.orchestra.run.smithi097.stdout: mon warn on osd down out interval zero = false 2024-04-19T03:00:35.511 INFO:teuthology.orchestra.run.smithi097.stdout: mon warn on too few osds = false 2024-04-19T03:00:35.511 INFO:teuthology.orchestra.run.smithi097.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-19T03:00:35.511 INFO:teuthology.orchestra.run.smithi097.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-19T03:00:35.511 INFO:teuthology.orchestra.run.smithi097.stdout: mon_allow_pool_size_one = true 2024-04-19T03:00:35.511 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-04-19T03:00:35.512 INFO:teuthology.orchestra.run.smithi097.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-19T03:00:35.512 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-04-19T03:00:35.512 INFO:teuthology.orchestra.run.smithi097.stdout: osd default data pool replay window = 5 2024-04-19T03:00:35.512 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-04-19T03:00:35.512 INFO:teuthology.orchestra.run.smithi097.stdout: mon allow pool delete = true 2024-04-19T03:00:35.512 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-04-19T03:00:35.512 INFO:teuthology.orchestra.run.smithi097.stdout: mon cluster log file level = debug 2024-04-19T03:00:35.512 INFO:teuthology.orchestra.run.smithi097.stdout: debug asserts on shutdown = true 2024-04-19T03:00:35.512 INFO:teuthology.orchestra.run.smithi097.stdout: mon health detail to clog = false 2024-04-19T03:00:35.512 INFO:teuthology.orchestra.run.smithi097.stdout: mon host = "172.21.15.96,[v2:172.21.15.96:3301,v1:172.21.15.96:6790],[v2:172.21.15.96:3302,v1:172.21.15.96:6791]" 2024-04-19T03:00:35.512 INFO:teuthology.orchestra.run.smithi097.stdout: fsid = c6cc8e09-11d4-48de-9a6c-4d70ed3c3789 2024-04-19T03:00:35.512 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-04-19T03:00:35.512 INFO:teuthology.orchestra.run.smithi097.stdout:[osd] 2024-04-19T03:00:35.512 INFO:teuthology.orchestra.run.smithi097.stdout: osd journal size = 100 2024-04-19T03:00:35.513 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-04-19T03:00:35.513 INFO:teuthology.orchestra.run.smithi097.stdout: osd scrub load threshold = 5.0 2024-04-19T03:00:35.513 INFO:teuthology.orchestra.run.smithi097.stdout: osd scrub max interval = 600 2024-04-19T03:00:35.513 INFO:teuthology.orchestra.run.smithi097.stdout: osd mclock profile = high_recovery_ops 2024-04-19T03:00:35.513 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-04-19T03:00:35.513 INFO:teuthology.orchestra.run.smithi097.stdout: osd recover clone overlap = true 2024-04-19T03:00:35.513 INFO:teuthology.orchestra.run.smithi097.stdout: osd recovery max chunk = 1048576 2024-04-19T03:00:35.513 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-04-19T03:00:35.513 INFO:teuthology.orchestra.run.smithi097.stdout: osd debug shutdown = true 2024-04-19T03:00:35.513 INFO:teuthology.orchestra.run.smithi097.stdout: osd debug op order = true 2024-04-19T03:00:35.513 INFO:teuthology.orchestra.run.smithi097.stdout: osd debug verify stray on activate = true 2024-04-19T03:00:35.513 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-04-19T03:00:35.513 INFO:teuthology.orchestra.run.smithi097.stdout: osd open classes on start = true 2024-04-19T03:00:35.513 INFO:teuthology.orchestra.run.smithi097.stdout: osd debug pg log writeout = true 2024-04-19T03:00:35.514 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-04-19T03:00:35.514 INFO:teuthology.orchestra.run.smithi097.stdout: osd deep scrub update digest min age = 30 2024-04-19T03:00:35.514 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-04-19T03:00:35.514 INFO:teuthology.orchestra.run.smithi097.stdout: osd map max advance = 10 2024-04-19T03:00:35.514 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-04-19T03:00:35.514 INFO:teuthology.orchestra.run.smithi097.stdout: journal zero on create = true 2024-04-19T03:00:35.514 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-04-19T03:00:35.514 INFO:teuthology.orchestra.run.smithi097.stdout: filestore ondisk finisher threads = 3 2024-04-19T03:00:35.514 INFO:teuthology.orchestra.run.smithi097.stdout: filestore apply finisher threads = 3 2024-04-19T03:00:35.514 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-04-19T03:00:35.514 INFO:teuthology.orchestra.run.smithi097.stdout: bdev debug aio = true 2024-04-19T03:00:35.514 INFO:teuthology.orchestra.run.smithi097.stdout: osd debug misdirected ops = true 2024-04-19T03:00:35.514 INFO:teuthology.orchestra.run.smithi097.stdout: bluestore block size = 96636764160 2024-04-19T03:00:35.515 INFO:teuthology.orchestra.run.smithi097.stdout: bluestore compression algorithm = zlib 2024-04-19T03:00:35.515 INFO:teuthology.orchestra.run.smithi097.stdout: bluestore compression mode = aggressive 2024-04-19T03:00:35.515 INFO:teuthology.orchestra.run.smithi097.stdout: bluestore fsck on mount = True 2024-04-19T03:00:35.515 INFO:teuthology.orchestra.run.smithi097.stdout: debug bluefs = 1/20 2024-04-19T03:00:35.515 INFO:teuthology.orchestra.run.smithi097.stdout: debug bluestore = 1/20 2024-04-19T03:00:35.515 INFO:teuthology.orchestra.run.smithi097.stdout: debug ms = 1 2024-04-19T03:00:35.515 INFO:teuthology.orchestra.run.smithi097.stdout: debug osd = 20 2024-04-19T03:00:35.515 INFO:teuthology.orchestra.run.smithi097.stdout: debug rocksdb = 4/10 2024-04-19T03:00:35.515 INFO:teuthology.orchestra.run.smithi097.stdout: mon osd backfillfull_ratio = 0.85 2024-04-19T03:00:35.515 INFO:teuthology.orchestra.run.smithi097.stdout: mon osd full ratio = 0.9 2024-04-19T03:00:35.515 INFO:teuthology.orchestra.run.smithi097.stdout: mon osd nearfull ratio = 0.8 2024-04-19T03:00:35.515 INFO:teuthology.orchestra.run.smithi097.stdout: osd blocked scrub grace period = 3600 2024-04-19T03:00:35.515 INFO:teuthology.orchestra.run.smithi097.stdout: osd failsafe full ratio = 0.95 2024-04-19T03:00:35.515 INFO:teuthology.orchestra.run.smithi097.stdout: osd max markdown count = 1000 2024-04-19T03:00:35.516 INFO:teuthology.orchestra.run.smithi097.stdout: osd objectstore = bluestore 2024-04-19T03:00:35.516 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-04-19T03:00:35.516 INFO:teuthology.orchestra.run.smithi097.stdout:[mgr] 2024-04-19T03:00:35.516 INFO:teuthology.orchestra.run.smithi097.stdout: debug ms = 1 2024-04-19T03:00:35.516 INFO:teuthology.orchestra.run.smithi097.stdout: debug mgr = 20 2024-04-19T03:00:35.516 INFO:teuthology.orchestra.run.smithi097.stdout: debug mon = 20 2024-04-19T03:00:35.516 INFO:teuthology.orchestra.run.smithi097.stdout: debug auth = 20 2024-04-19T03:00:35.516 INFO:teuthology.orchestra.run.smithi097.stdout: mon reweight min pgs per osd = 4 2024-04-19T03:00:35.516 INFO:teuthology.orchestra.run.smithi097.stdout: mon reweight min bytes per osd = 10 2024-04-19T03:00:35.516 INFO:teuthology.orchestra.run.smithi097.stdout: mgr/telemetry/nag = false 2024-04-19T03:00:35.516 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-04-19T03:00:35.516 INFO:teuthology.orchestra.run.smithi097.stdout:[mon] 2024-04-19T03:00:35.516 INFO:teuthology.orchestra.run.smithi097.stdout: debug ms = 1 2024-04-19T03:00:35.516 INFO:teuthology.orchestra.run.smithi097.stdout: debug mon = 20 2024-04-19T03:00:35.516 INFO:teuthology.orchestra.run.smithi097.stdout: debug paxos = 20 2024-04-19T03:00:35.517 INFO:teuthology.orchestra.run.smithi097.stdout: debug auth = 20 2024-04-19T03:00:35.517 INFO:teuthology.orchestra.run.smithi097.stdout: mon data avail warn = 5 2024-04-19T03:00:35.517 INFO:teuthology.orchestra.run.smithi097.stdout: mon mgr mkfs grace = 240 2024-04-19T03:00:35.517 INFO:teuthology.orchestra.run.smithi097.stdout: mon reweight min pgs per osd = 4 2024-04-19T03:00:35.517 INFO:teuthology.orchestra.run.smithi097.stdout: mon osd reporter subtree level = osd 2024-04-19T03:00:35.517 INFO:teuthology.orchestra.run.smithi097.stdout: mon osd prime pg temp = true 2024-04-19T03:00:35.517 INFO:teuthology.orchestra.run.smithi097.stdout: mon reweight min bytes per osd = 10 2024-04-19T03:00:35.517 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-04-19T03:00:35.517 INFO:teuthology.orchestra.run.smithi097.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-19T03:00:35.517 INFO:teuthology.orchestra.run.smithi097.stdout: auth mon ticket ttl = 660 # 11m 2024-04-19T03:00:35.517 INFO:teuthology.orchestra.run.smithi097.stdout: auth service ticket ttl = 240 # 4m 2024-04-19T03:00:35.517 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-04-19T03:00:35.517 INFO:teuthology.orchestra.run.smithi097.stdout: # don't complain about insecure global_id in the test suite 2024-04-19T03:00:35.517 INFO:teuthology.orchestra.run.smithi097.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-19T03:00:35.517 INFO:teuthology.orchestra.run.smithi097.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-19T03:00:35.518 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-04-19T03:00:35.518 INFO:teuthology.orchestra.run.smithi097.stdout: # 1m isn't quite enough 2024-04-19T03:00:35.518 INFO:teuthology.orchestra.run.smithi097.stdout: mon_down_mkfs_grace = 2m 2024-04-19T03:00:35.518 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-04-19T03:00:35.518 INFO:teuthology.orchestra.run.smithi097.stdout: mon_warn_on_filestore_osds = false 2024-04-19T03:00:35.518 INFO:teuthology.orchestra.run.smithi097.stdout: 2024-04-19T03:00:35.518 INFO:teuthology.orchestra.run.smithi097.stdout:[client] 2024-04-19T03:00:35.518 INFO:teuthology.orchestra.run.smithi097.stdout: rgw cache enabled = true 2024-04-19T03:00:35.518 INFO:teuthology.orchestra.run.smithi097.stdout: rgw enable ops log = true 2024-04-19T03:00:35.518 INFO:teuthology.orchestra.run.smithi097.stdout: rgw enable usage log = true 2024-04-19T03:00:35.518 INFO:teuthology.orchestra.run.smithi097.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-19T03:00:35.518 INFO:teuthology.orchestra.run.smithi097.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-19T03:00:35.518 INFO:teuthology.orchestra.run.smithi097.stdout:[mon.a] 2024-04-19T03:00:35.518 INFO:teuthology.orchestra.run.smithi097.stdout:[mon.b] 2024-04-19T03:00:35.519 INFO:teuthology.orchestra.run.smithi097.stdout:[mon.c] 2024-04-19T03:00:35.519 INFO:teuthology.orchestra.run.smithi097.stdout:[mds.a] 2024-04-19T03:00:35.519 INFO:teuthology.orchestra.run.smithi097.stdout:[client.0] 2024-04-19T03:00:35.519 INFO:teuthology.orchestra.run.smithi097.stdout: admin socket = /var/run/ceph/ceph-$name.asok 2024-04-19T03:00:35.521 INFO:teuthology.orchestra.run.smithi144.stdout:[global] 2024-04-19T03:00:35.521 INFO:teuthology.orchestra.run.smithi144.stdout: chdir = "" 2024-04-19T03:00:35.521 INFO:teuthology.orchestra.run.smithi144.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-19T03:00:35.521 INFO:teuthology.orchestra.run.smithi144.stdout: auth supported = cephx 2024-04-19T03:00:35.522 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-04-19T03:00:35.522 INFO:teuthology.orchestra.run.smithi144.stdout: filestore xattr use omap = true 2024-04-19T03:00:35.522 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-04-19T03:00:35.522 INFO:teuthology.orchestra.run.smithi144.stdout: mon clock drift allowed = 1.000 2024-04-19T03:00:35.522 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-04-19T03:00:35.522 INFO:teuthology.orchestra.run.smithi144.stdout: osd crush chooseleaf type = 0 2024-04-19T03:00:35.522 INFO:teuthology.orchestra.run.smithi144.stdout: auth debug = true 2024-04-19T03:00:35.522 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-04-19T03:00:35.522 INFO:teuthology.orchestra.run.smithi144.stdout: ms die on old message = true 2024-04-19T03:00:35.522 INFO:teuthology.orchestra.run.smithi144.stdout: ms die on bug = true 2024-04-19T03:00:35.523 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-04-19T03:00:35.523 INFO:teuthology.orchestra.run.smithi144.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-19T03:00:35.523 INFO:teuthology.orchestra.run.smithi144.stdout: mon pg warn max object skew = 0 2024-04-19T03:00:35.523 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-04-19T03:00:35.523 INFO:teuthology.orchestra.run.smithi144.stdout: # disable pg_autoscaler by default for new pools 2024-04-19T03:00:35.523 INFO:teuthology.orchestra.run.smithi144.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-19T03:00:35.523 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-04-19T03:00:35.523 INFO:teuthology.orchestra.run.smithi144.stdout: osd pool default size = 2 2024-04-19T03:00:35.523 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-04-19T03:00:35.523 INFO:teuthology.orchestra.run.smithi144.stdout: mon osd allow primary affinity = true 2024-04-19T03:00:35.523 INFO:teuthology.orchestra.run.smithi144.stdout: mon osd allow pg remap = true 2024-04-19T03:00:35.523 INFO:teuthology.orchestra.run.smithi144.stdout: mon warn on legacy crush tunables = false 2024-04-19T03:00:35.523 INFO:teuthology.orchestra.run.smithi144.stdout: mon warn on crush straw calc version zero = false 2024-04-19T03:00:35.523 INFO:teuthology.orchestra.run.smithi144.stdout: mon warn on no sortbitwise = false 2024-04-19T03:00:35.524 INFO:teuthology.orchestra.run.smithi144.stdout: mon warn on osd down out interval zero = false 2024-04-19T03:00:35.524 INFO:teuthology.orchestra.run.smithi144.stdout: mon warn on too few osds = false 2024-04-19T03:00:35.524 INFO:teuthology.orchestra.run.smithi144.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-19T03:00:35.524 INFO:teuthology.orchestra.run.smithi144.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-19T03:00:35.524 INFO:teuthology.orchestra.run.smithi144.stdout: mon_allow_pool_size_one = true 2024-04-19T03:00:35.524 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-04-19T03:00:35.524 INFO:teuthology.orchestra.run.smithi144.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-19T03:00:35.524 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-04-19T03:00:35.524 INFO:teuthology.orchestra.run.smithi144.stdout: osd default data pool replay window = 5 2024-04-19T03:00:35.524 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-04-19T03:00:35.524 INFO:teuthology.orchestra.run.smithi144.stdout: mon allow pool delete = true 2024-04-19T03:00:35.524 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-04-19T03:00:35.524 INFO:teuthology.orchestra.run.smithi144.stdout: mon cluster log file level = debug 2024-04-19T03:00:35.524 INFO:teuthology.orchestra.run.smithi144.stdout: debug asserts on shutdown = true 2024-04-19T03:00:35.524 INFO:teuthology.orchestra.run.smithi144.stdout: mon health detail to clog = false 2024-04-19T03:00:35.525 INFO:teuthology.orchestra.run.smithi144.stdout: mon host = "172.21.15.96,[v2:172.21.15.96:3301,v1:172.21.15.96:6790],[v2:172.21.15.96:3302,v1:172.21.15.96:6791]" 2024-04-19T03:00:35.525 INFO:teuthology.orchestra.run.smithi144.stdout: fsid = c6cc8e09-11d4-48de-9a6c-4d70ed3c3789 2024-04-19T03:00:35.525 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-04-19T03:00:35.525 INFO:teuthology.orchestra.run.smithi144.stdout:[osd] 2024-04-19T03:00:35.525 INFO:teuthology.orchestra.run.smithi144.stdout: osd journal size = 100 2024-04-19T03:00:35.525 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-04-19T03:00:35.525 INFO:teuthology.orchestra.run.smithi144.stdout: osd scrub load threshold = 5.0 2024-04-19T03:00:35.525 INFO:teuthology.orchestra.run.smithi144.stdout: osd scrub max interval = 600 2024-04-19T03:00:35.525 INFO:teuthology.orchestra.run.smithi144.stdout: osd mclock profile = high_recovery_ops 2024-04-19T03:00:35.525 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-04-19T03:00:35.525 INFO:teuthology.orchestra.run.smithi144.stdout: osd recover clone overlap = true 2024-04-19T03:00:35.525 INFO:teuthology.orchestra.run.smithi144.stdout: osd recovery max chunk = 1048576 2024-04-19T03:00:35.525 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-04-19T03:00:35.525 INFO:teuthology.orchestra.run.smithi144.stdout: osd debug shutdown = true 2024-04-19T03:00:35.526 INFO:teuthology.orchestra.run.smithi144.stdout: osd debug op order = true 2024-04-19T03:00:35.526 INFO:teuthology.orchestra.run.smithi144.stdout: osd debug verify stray on activate = true 2024-04-19T03:00:35.526 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-04-19T03:00:35.526 INFO:teuthology.orchestra.run.smithi144.stdout: osd open classes on start = true 2024-04-19T03:00:35.526 INFO:teuthology.orchestra.run.smithi144.stdout: osd debug pg log writeout = true 2024-04-19T03:00:35.526 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-04-19T03:00:35.526 INFO:teuthology.orchestra.run.smithi144.stdout: osd deep scrub update digest min age = 30 2024-04-19T03:00:35.526 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-04-19T03:00:35.526 INFO:teuthology.orchestra.run.smithi144.stdout: osd map max advance = 10 2024-04-19T03:00:35.526 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-04-19T03:00:35.526 INFO:teuthology.orchestra.run.smithi144.stdout: journal zero on create = true 2024-04-19T03:00:35.526 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-04-19T03:00:35.526 INFO:teuthology.orchestra.run.smithi144.stdout: filestore ondisk finisher threads = 3 2024-04-19T03:00:35.527 INFO:teuthology.orchestra.run.smithi144.stdout: filestore apply finisher threads = 3 2024-04-19T03:00:35.527 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-04-19T03:00:35.527 INFO:teuthology.orchestra.run.smithi144.stdout: bdev debug aio = true 2024-04-19T03:00:35.527 INFO:teuthology.orchestra.run.smithi144.stdout: osd debug misdirected ops = true 2024-04-19T03:00:35.527 INFO:teuthology.orchestra.run.smithi144.stdout: bluestore block size = 96636764160 2024-04-19T03:00:35.527 INFO:teuthology.orchestra.run.smithi144.stdout: bluestore compression algorithm = zlib 2024-04-19T03:00:35.527 INFO:teuthology.orchestra.run.smithi144.stdout: bluestore compression mode = aggressive 2024-04-19T03:00:35.527 INFO:teuthology.orchestra.run.smithi144.stdout: bluestore fsck on mount = True 2024-04-19T03:00:35.527 INFO:teuthology.orchestra.run.smithi144.stdout: debug bluefs = 1/20 2024-04-19T03:00:35.527 INFO:teuthology.orchestra.run.smithi144.stdout: debug bluestore = 1/20 2024-04-19T03:00:35.527 INFO:teuthology.orchestra.run.smithi144.stdout: debug ms = 1 2024-04-19T03:00:35.527 INFO:teuthology.orchestra.run.smithi144.stdout: debug osd = 20 2024-04-19T03:00:35.527 INFO:teuthology.orchestra.run.smithi144.stdout: debug rocksdb = 4/10 2024-04-19T03:00:35.527 INFO:teuthology.orchestra.run.smithi144.stdout: mon osd backfillfull_ratio = 0.85 2024-04-19T03:00:35.528 INFO:teuthology.orchestra.run.smithi144.stdout: mon osd full ratio = 0.9 2024-04-19T03:00:35.528 INFO:teuthology.orchestra.run.smithi144.stdout: mon osd nearfull ratio = 0.8 2024-04-19T03:00:35.528 INFO:teuthology.orchestra.run.smithi144.stdout: osd blocked scrub grace period = 3600 2024-04-19T03:00:35.528 INFO:teuthology.orchestra.run.smithi144.stdout: osd failsafe full ratio = 0.95 2024-04-19T03:00:35.528 INFO:teuthology.orchestra.run.smithi144.stdout: osd max markdown count = 1000 2024-04-19T03:00:35.528 INFO:teuthology.orchestra.run.smithi144.stdout: osd objectstore = bluestore 2024-04-19T03:00:35.528 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-04-19T03:00:35.528 INFO:teuthology.orchestra.run.smithi144.stdout:[mgr] 2024-04-19T03:00:35.528 INFO:teuthology.orchestra.run.smithi144.stdout: debug ms = 1 2024-04-19T03:00:35.528 INFO:teuthology.orchestra.run.smithi144.stdout: debug mgr = 20 2024-04-19T03:00:35.528 INFO:teuthology.orchestra.run.smithi144.stdout: debug mon = 20 2024-04-19T03:00:35.528 INFO:teuthology.orchestra.run.smithi144.stdout: debug auth = 20 2024-04-19T03:00:35.528 INFO:teuthology.orchestra.run.smithi144.stdout: mon reweight min pgs per osd = 4 2024-04-19T03:00:35.528 INFO:teuthology.orchestra.run.smithi144.stdout: mon reweight min bytes per osd = 10 2024-04-19T03:00:35.528 INFO:teuthology.orchestra.run.smithi144.stdout: mgr/telemetry/nag = false 2024-04-19T03:00:35.529 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-04-19T03:00:35.529 INFO:teuthology.orchestra.run.smithi144.stdout:[mon] 2024-04-19T03:00:35.529 INFO:teuthology.orchestra.run.smithi144.stdout: debug ms = 1 2024-04-19T03:00:35.529 INFO:teuthology.orchestra.run.smithi144.stdout: debug mon = 20 2024-04-19T03:00:35.529 INFO:teuthology.orchestra.run.smithi144.stdout: debug paxos = 20 2024-04-19T03:00:35.529 INFO:teuthology.orchestra.run.smithi144.stdout: debug auth = 20 2024-04-19T03:00:35.529 INFO:teuthology.orchestra.run.smithi144.stdout: mon data avail warn = 5 2024-04-19T03:00:35.529 INFO:teuthology.orchestra.run.smithi144.stdout: mon mgr mkfs grace = 240 2024-04-19T03:00:35.529 INFO:teuthology.orchestra.run.smithi144.stdout: mon reweight min pgs per osd = 4 2024-04-19T03:00:35.529 INFO:teuthology.orchestra.run.smithi144.stdout: mon osd reporter subtree level = osd 2024-04-19T03:00:35.529 INFO:teuthology.orchestra.run.smithi144.stdout: mon osd prime pg temp = true 2024-04-19T03:00:35.529 INFO:teuthology.orchestra.run.smithi144.stdout: mon reweight min bytes per osd = 10 2024-04-19T03:00:35.529 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-04-19T03:00:35.529 INFO:teuthology.orchestra.run.smithi144.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-19T03:00:35.529 INFO:teuthology.orchestra.run.smithi144.stdout: auth mon ticket ttl = 660 # 11m 2024-04-19T03:00:35.530 INFO:teuthology.orchestra.run.smithi144.stdout: auth service ticket ttl = 240 # 4m 2024-04-19T03:00:35.530 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-04-19T03:00:35.530 INFO:teuthology.orchestra.run.smithi144.stdout: # don't complain about insecure global_id in the test suite 2024-04-19T03:00:35.530 INFO:teuthology.orchestra.run.smithi144.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-19T03:00:35.530 INFO:teuthology.orchestra.run.smithi144.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-19T03:00:35.530 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-04-19T03:00:35.530 INFO:teuthology.orchestra.run.smithi144.stdout: # 1m isn't quite enough 2024-04-19T03:00:35.530 INFO:teuthology.orchestra.run.smithi144.stdout: mon_down_mkfs_grace = 2m 2024-04-19T03:00:35.530 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-04-19T03:00:35.530 INFO:teuthology.orchestra.run.smithi144.stdout: mon_warn_on_filestore_osds = false 2024-04-19T03:00:35.530 INFO:teuthology.orchestra.run.smithi144.stdout: 2024-04-19T03:00:35.530 INFO:teuthology.orchestra.run.smithi144.stdout:[client] 2024-04-19T03:00:35.530 INFO:teuthology.orchestra.run.smithi144.stdout: rgw cache enabled = true 2024-04-19T03:00:35.531 INFO:teuthology.orchestra.run.smithi144.stdout: rgw enable ops log = true 2024-04-19T03:00:35.531 INFO:teuthology.orchestra.run.smithi144.stdout: rgw enable usage log = true 2024-04-19T03:00:35.531 INFO:teuthology.orchestra.run.smithi144.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-19T03:00:35.531 INFO:teuthology.orchestra.run.smithi144.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-19T03:00:35.531 INFO:teuthology.orchestra.run.smithi144.stdout:[mon.a] 2024-04-19T03:00:35.531 INFO:teuthology.orchestra.run.smithi144.stdout:[mon.b] 2024-04-19T03:00:35.531 INFO:teuthology.orchestra.run.smithi144.stdout:[mon.c] 2024-04-19T03:00:35.531 INFO:teuthology.orchestra.run.smithi144.stdout:[mds.a] 2024-04-19T03:00:35.531 INFO:teuthology.orchestra.run.smithi144.stdout:[client.0] 2024-04-19T03:00:35.531 INFO:teuthology.orchestra.run.smithi144.stdout: admin socket = /var/run/ceph/ceph-$name.asok 2024-04-19T03:00:35.531 INFO:tasks.ceph:Creating admin key on mon.a... 2024-04-19T03:00:35.532 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-04-19T03:00:35.615 INFO:tasks.ceph:Copying monmap to all nodes... 2024-04-19T03:00:35.616 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-04-19T03:00:35.616 DEBUG:teuthology.orchestra.run.smithi096:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-04-19T03:00:35.620 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-04-19T03:00:35.620 DEBUG:teuthology.orchestra.run.smithi096:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-04-19T03:00:35.625 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi096.front.sepia.ceph.com 2024-04-19T03:00:35.625 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-04-19T03:00:35.625 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-19T03:00:35.625 DEBUG:teuthology.orchestra.run.smithi096:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-19T03:00:35.645 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-04-19T03:00:35.645 DEBUG:teuthology.orchestra.run.smithi096:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-19T03:00:35.692 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi097.front.sepia.ceph.com 2024-04-19T03:00:35.692 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-04-19T03:00:35.692 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-19T03:00:35.693 DEBUG:teuthology.orchestra.run.smithi097:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-19T03:00:35.719 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-04-19T03:00:35.719 DEBUG:teuthology.orchestra.run.smithi097:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-19T03:00:35.725 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi134.front.sepia.ceph.com 2024-04-19T03:00:35.725 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-04-19T03:00:35.725 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-19T03:00:35.725 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-19T03:00:35.748 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-04-19T03:00:35.748 DEBUG:teuthology.orchestra.run.smithi134:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-19T03:00:35.754 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi144.front.sepia.ceph.com 2024-04-19T03:00:35.755 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-04-19T03:00:35.755 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-19T03:00:35.755 DEBUG:teuthology.orchestra.run.smithi144:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-19T03:00:35.782 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-04-19T03:00:35.782 DEBUG:teuthology.orchestra.run.smithi144:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-19T03:00:35.787 INFO:tasks.ceph:Setting up mon nodes... 2024-04-19T03:00:35.787 INFO:tasks.ceph:Setting up mgr nodes... 2024-04-19T03:00:35.787 DEBUG:teuthology.orchestra.run.smithi096:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-04-19T03:00:35.837 INFO:teuthology.orchestra.run.smithi096.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-04-19T03:00:35.840 DEBUG:teuthology.orchestra.run.smithi096:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-04-19T03:00:35.888 INFO:teuthology.orchestra.run.smithi096.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-04-19T03:00:35.891 INFO:tasks.ceph:Setting up mds nodes... 2024-04-19T03:00:35.891 DEBUG:teuthology.orchestra.run.smithi096:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-04-19T03:00:35.936 INFO:teuthology.orchestra.run.smithi096.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-04-19T03:00:35.939 DEBUG:teuthology.orchestra.run.smithi096:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-04-19T03:00:35.950 INFO:tasks.ceph_client:Setting up client nodes... 2024-04-19T03:00:35.950 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-04-19T03:00:36.034 INFO:teuthology.orchestra.run.smithi096.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-04-19T03:00:36.047 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-04-19T03:00:36.048 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi097.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi134.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi144.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1'}} 2024-04-19T03:00:36.048 DEBUG:teuthology.orchestra.run.smithi097:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-04-19T03:00:36.064 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1'} 2024-04-19T03:00:36.064 INFO:tasks.ceph:role: osd.0 2024-04-19T03:00:36.064 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi097.front.sepia.ceph.com 2024-04-19T03:00:36.065 DEBUG:teuthology.orchestra.run.smithi097:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-19T03:00:36.640 INFO:teuthology.orchestra.run.smithi097.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-19T03:00:36.640 INFO:teuthology.orchestra.run.smithi097.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-19T03:00:36.641 INFO:teuthology.orchestra.run.smithi097.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-19T03:00:36.641 INFO:teuthology.orchestra.run.smithi097.stdout: = reflink=1 2024-04-19T03:00:36.641 INFO:teuthology.orchestra.run.smithi097.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-19T03:00:36.641 INFO:teuthology.orchestra.run.smithi097.stdout: = sunit=0 swidth=0 blks 2024-04-19T03:00:36.641 INFO:teuthology.orchestra.run.smithi097.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-19T03:00:36.641 INFO:teuthology.orchestra.run.smithi097.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-19T03:00:36.641 INFO:teuthology.orchestra.run.smithi097.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-19T03:00:36.641 INFO:teuthology.orchestra.run.smithi097.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-19T03:00:36.642 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi097.front.sepia.ceph.com -o noatime 2024-04-19T03:00:36.643 DEBUG:teuthology.orchestra.run.smithi097:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-04-19T03:00:36.735 DEBUG:teuthology.orchestra.run.smithi097:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-04-19T03:00:36.748 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-19T03:00:36.748 INFO:teuthology.orchestra.run.smithi097.stderr:sudo: /sbin/restorecon: command not found 2024-04-19T03:00:36.748 DEBUG:teuthology.orchestra.run.smithi097:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-19T03:00:36.863 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-19T03:00:36.854+0000 7f88d95d3880 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-04-19T03:00:36.865 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-19T03:00:36.854+0000 7f88d95d3880 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-04-19T03:00:36.865 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-19T03:00:36.854+0000 7f88d95d3880 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-19T03:00:36.865 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-19T03:00:36.854+0000 7f88d95d3880 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-19T03:00:36.865 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-19T03:00:36.854+0000 7f88d95d3880 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-19T03:00:36.870 INFO:teuthology.orchestra.run.smithi097.stderr:2024-04-19T03:00:36.858+0000 7f88d95d3880 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-04-19T03:00:39.910 DEBUG:teuthology.orchestra.run.smithi097:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-04-19T03:00:39.927 DEBUG:teuthology.orchestra.run.smithi134:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-04-19T03:00:39.943 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1'} 2024-04-19T03:00:39.943 INFO:tasks.ceph:role: osd.1 2024-04-19T03:00:39.943 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi134.front.sepia.ceph.com 2024-04-19T03:00:39.944 DEBUG:teuthology.orchestra.run.smithi134:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-19T03:00:40.493 INFO:teuthology.orchestra.run.smithi134.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-19T03:00:40.493 INFO:teuthology.orchestra.run.smithi134.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-19T03:00:40.493 INFO:teuthology.orchestra.run.smithi134.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-19T03:00:40.493 INFO:teuthology.orchestra.run.smithi134.stdout: = reflink=1 2024-04-19T03:00:40.493 INFO:teuthology.orchestra.run.smithi134.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-19T03:00:40.493 INFO:teuthology.orchestra.run.smithi134.stdout: = sunit=0 swidth=0 blks 2024-04-19T03:00:40.494 INFO:teuthology.orchestra.run.smithi134.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-19T03:00:40.494 INFO:teuthology.orchestra.run.smithi134.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-19T03:00:40.494 INFO:teuthology.orchestra.run.smithi134.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-19T03:00:40.494 INFO:teuthology.orchestra.run.smithi134.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-19T03:00:40.495 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi134.front.sepia.ceph.com -o noatime 2024-04-19T03:00:40.495 DEBUG:teuthology.orchestra.run.smithi134:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-1 2024-04-19T03:00:40.585 DEBUG:teuthology.orchestra.run.smithi134:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-04-19T03:00:40.597 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-19T03:00:40.597 INFO:teuthology.orchestra.run.smithi134.stderr:sudo: /sbin/restorecon: command not found 2024-04-19T03:00:40.598 DEBUG:teuthology.orchestra.run.smithi134:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-19T03:00:40.730 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-19T03:00:40.725+0000 7f1b7842a880 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-04-19T03:00:40.733 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-19T03:00:40.729+0000 7f1b7842a880 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-04-19T03:00:40.733 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-19T03:00:40.729+0000 7f1b7842a880 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-19T03:00:40.733 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-19T03:00:40.729+0000 7f1b7842a880 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-19T03:00:40.733 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-19T03:00:40.729+0000 7f1b7842a880 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-19T03:00:40.737 INFO:teuthology.orchestra.run.smithi134.stderr:2024-04-19T03:00:40.733+0000 7f1b7842a880 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-04-19T03:00:43.740 DEBUG:teuthology.orchestra.run.smithi134:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-04-19T03:00:43.755 DEBUG:teuthology.orchestra.run.smithi144:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-04-19T03:00:43.771 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1'} 2024-04-19T03:00:43.771 INFO:tasks.ceph:role: osd.2 2024-04-19T03:00:43.772 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi144.front.sepia.ceph.com 2024-04-19T03:00:43.772 DEBUG:teuthology.orchestra.run.smithi144:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-19T03:00:44.345 INFO:teuthology.orchestra.run.smithi144.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-19T03:00:44.345 INFO:teuthology.orchestra.run.smithi144.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-19T03:00:44.345 INFO:teuthology.orchestra.run.smithi144.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-19T03:00:44.345 INFO:teuthology.orchestra.run.smithi144.stdout: = reflink=1 2024-04-19T03:00:44.345 INFO:teuthology.orchestra.run.smithi144.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-19T03:00:44.345 INFO:teuthology.orchestra.run.smithi144.stdout: = sunit=0 swidth=0 blks 2024-04-19T03:00:44.345 INFO:teuthology.orchestra.run.smithi144.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-19T03:00:44.345 INFO:teuthology.orchestra.run.smithi144.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-19T03:00:44.345 INFO:teuthology.orchestra.run.smithi144.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-19T03:00:44.345 INFO:teuthology.orchestra.run.smithi144.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-19T03:00:44.347 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi144.front.sepia.ceph.com -o noatime 2024-04-19T03:00:44.347 DEBUG:teuthology.orchestra.run.smithi144:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-2 2024-04-19T03:00:44.432 DEBUG:teuthology.orchestra.run.smithi144:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-04-19T03:00:44.444 INFO:teuthology.orchestra.run.smithi144.stderr:sudo: /sbin/restorecon: command not found 2024-04-19T03:00:44.445 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-19T03:00:44.446 DEBUG:teuthology.orchestra.run.smithi144:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-19T03:00:44.530 INFO:teuthology.orchestra.run.smithi144.stderr:2024-04-19T03:00:44.522+0000 7f2c98168880 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-04-19T03:00:44.530 INFO:teuthology.orchestra.run.smithi144.stderr:2024-04-19T03:00:44.522+0000 7f2c98168880 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-04-19T03:00:44.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-04-19T03:00:44.522+0000 7f2c98168880 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-19T03:00:44.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-04-19T03:00:44.522+0000 7f2c98168880 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-19T03:00:44.531 INFO:teuthology.orchestra.run.smithi144.stderr:2024-04-19T03:00:44.522+0000 7f2c98168880 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-19T03:00:44.539 INFO:teuthology.orchestra.run.smithi144.stderr:2024-04-19T03:00:44.538+0000 7f2c98168880 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-04-19T03:00:47.567 DEBUG:teuthology.orchestra.run.smithi144:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-04-19T03:00:47.584 INFO:tasks.ceph:Reading keys from all nodes... 2024-04-19T03:00:47.584 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-04-19T03:00:47.585 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-04-19T03:00:47.601 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-04-19T03:00:47.601 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-04-19T03:00:47.656 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-04-19T03:00:47.656 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-04-19T03:00:47.666 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-04-19T03:00:47.666 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-04-19T03:00:47.681 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-04-19T03:00:47.682 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-04-19T03:00:47.698 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-04-19T03:00:47.698 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-04-19T03:00:47.714 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2024-04-19T03:00:47.714 DEBUG:teuthology.orchestra.run.smithi096:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-04-19T03:00:47.721 INFO:tasks.ceph:Adding keys to all mons... 2024-04-19T03:00:47.721 DEBUG:teuthology.orchestra.run.smithi096:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-19T03:00:47.775 INFO:teuthology.orchestra.run.smithi096.stdout:[mgr.x] 2024-04-19T03:00:47.775 INFO:teuthology.orchestra.run.smithi096.stdout: key = AQBT3iFmckXrMRAA90XPX8Pr1W8vyjgc248yHA== 2024-04-19T03:00:47.775 INFO:teuthology.orchestra.run.smithi096.stdout:[mgr.y] 2024-04-19T03:00:47.776 INFO:teuthology.orchestra.run.smithi096.stdout: key = AQBT3iFm7ojxNBAAhIYzDSxB3Zdty7OMH2m+yw== 2024-04-19T03:00:47.776 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.a] 2024-04-19T03:00:47.776 INFO:teuthology.orchestra.run.smithi096.stdout: key = AQBT3iFmzS3ZNxAAeKSfGCAIgupbFveSElAtXA== 2024-04-19T03:00:47.776 INFO:teuthology.orchestra.run.smithi096.stdout:[osd.0] 2024-04-19T03:00:47.776 INFO:teuthology.orchestra.run.smithi096.stdout: key = AQBU3iFmVwAxMxAASxAoS7YE/4DSY91w8adC1A== 2024-04-19T03:00:47.776 INFO:teuthology.orchestra.run.smithi096.stdout:[osd.1] 2024-04-19T03:00:47.776 INFO:teuthology.orchestra.run.smithi096.stdout: key = AQBY3iFmaRGLKxAAZjr50CjcZ6gI4kZfKDZ9rA== 2024-04-19T03:00:47.776 INFO:teuthology.orchestra.run.smithi096.stdout:[osd.2] 2024-04-19T03:00:47.776 INFO:teuthology.orchestra.run.smithi096.stdout: key = AQBc3iFmLWaHHxAAW/IiHR5zoSs+wlPAirV4wA== 2024-04-19T03:00:47.776 INFO:teuthology.orchestra.run.smithi096.stdout:[client.0] 2024-04-19T03:00:47.776 INFO:teuthology.orchestra.run.smithi096.stdout: key = AQBU3iFmH34JAhAA9pGB75vd6OqzwjEzg3t/ig== 2024-04-19T03:00:47.777 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-19T03:00:47.825 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-19T03:00:47.873 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-19T03:00:47.924 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-19T03:00:47.971 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-19T03:00:48.013 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-19T03:00:48.060 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-19T03:00:48.111 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-04-19T03:00:48.111 DEBUG:teuthology.orchestra.run.smithi096:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-04-19T03:00:48.121 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-19T03:00:48.219 DEBUG:teuthology.orchestra.run.smithi096:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-04-19T03:00:48.237 DEBUG:teuthology.orchestra.run.smithi096:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-04-19T03:00:48.297 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-19T03:00:48.392 DEBUG:teuthology.orchestra.run.smithi096:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-04-19T03:00:48.407 DEBUG:teuthology.orchestra.run.smithi096:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-04-19T03:00:48.423 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-19T03:00:48.500 DEBUG:teuthology.orchestra.run.smithi096:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-04-19T03:00:48.516 DEBUG:teuthology.orchestra.run.smithi096:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-19T03:00:48.520 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-04-19T03:00:48.521 INFO:tasks.ceph.mon.a:Restarting daemon 2024-04-19T03:00:48.521 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-04-19T03:00:48.563 INFO:tasks.ceph.mon.a:Started 2024-04-19T03:00:48.564 INFO:tasks.ceph.mon.b:Restarting daemon 2024-04-19T03:00:48.564 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-04-19T03:00:48.566 INFO:tasks.ceph.mon.b:Started 2024-04-19T03:00:48.566 INFO:tasks.ceph.mon.c:Restarting daemon 2024-04-19T03:00:48.566 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-04-19T03:00:48.568 INFO:tasks.ceph.mon.c:Started 2024-04-19T03:00:48.568 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-04-19T03:00:48.569 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-04-19T03:00:48.569 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-04-19T03:00:48.571 INFO:tasks.ceph.mgr.x:Started 2024-04-19T03:00:48.571 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-04-19T03:00:48.571 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-04-19T03:00:48.573 INFO:tasks.ceph.mgr.y:Started 2024-04-19T03:00:48.574 INFO:tasks.ceph:Setting crush tunables to default 2024-04-19T03:00:48.574 DEBUG:teuthology.orchestra.run.smithi096:> sudo ceph --cluster ceph osd crush tunables default 2024-04-19T03:00:53.859 INFO:teuthology.orchestra.run.smithi096.stderr:adjusted tunables profile to default 2024-04-19T03:00:53.872 INFO:tasks.ceph:check_enable_crimson: False 2024-04-19T03:00:53.872 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-04-19T03:00:53.873 DEBUG:teuthology.orchestra.run.smithi097:> set -ex 2024-04-19T03:00:53.873 DEBUG:teuthology.orchestra.run.smithi097:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-04-19T03:00:53.888 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-04-19T03:00:53.888 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-04-19T03:00:53.904 DEBUG:teuthology.orchestra.run.smithi144:> set -ex 2024-04-19T03:00:53.904 DEBUG:teuthology.orchestra.run.smithi144:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-04-19T03:00:53.921 DEBUG:teuthology.orchestra.run.smithi144:> sudo ceph --cluster ceph osd new 05ecb884-2c30-44f7-aa14-90154f9bbe9a 0 2024-04-19T03:00:54.192 INFO:teuthology.orchestra.run.smithi144.stdout:0 2024-04-19T03:00:54.207 DEBUG:teuthology.orchestra.run.smithi144:> sudo ceph --cluster ceph osd new efc873e0-69c3-4a57-8ee5-41f836b65f47 1 2024-04-19T03:00:54.423 INFO:teuthology.orchestra.run.smithi144.stdout:1 2024-04-19T03:00:54.438 DEBUG:teuthology.orchestra.run.smithi144:> sudo ceph --cluster ceph osd new 229278a0-dd93-4234-9065-e4f2f6188ef2 2 2024-04-19T03:00:54.649 INFO:teuthology.orchestra.run.smithi144.stdout:2 2024-04-19T03:00:54.665 INFO:tasks.ceph.osd.0:Restarting daemon 2024-04-19T03:00:54.665 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-04-19T03:00:54.668 INFO:tasks.ceph.osd.0:Started 2024-04-19T03:00:54.668 INFO:tasks.ceph.osd.1:Restarting daemon 2024-04-19T03:00:54.668 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-04-19T03:00:54.670 INFO:tasks.ceph.osd.1:Started 2024-04-19T03:00:54.670 INFO:tasks.ceph.osd.2:Restarting daemon 2024-04-19T03:00:54.670 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-04-19T03:00:54.673 INFO:tasks.ceph.osd.2:Started 2024-04-19T03:00:54.673 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-19T03:00:54.868 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-19T03:00:54.868 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":5,"fsid":"c6cc8e09-11d4-48de-9a6c-4d70ed3c3789","created":"2024-04-19T03:00:53.746146+0000","modified":"2024-04-19T03:00:54.640172+0000","last_up_change":"0.000000","last_in_change":"2024-04-19T03:00:54.640172+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"05ecb884-2c30-44f7-aa14-90154f9bbe9a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"efc873e0-69c3-4a57-8ee5-41f836b65f47","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"229278a0-dd93-4234-9065-e4f2f6188ef2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-19T03:00:54.880 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-04-19T03:00:54.880 INFO:tasks.ceph:Waiting for OSDs to come up 2024-04-19T03:00:54.920 INFO:tasks.ceph.mgr.y.smithi096.stderr:2024-04-19T03:00:54.916+0000 7f68b3edd2c0 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-19T03:00:54.920 INFO:tasks.ceph.mgr.x.smithi096.stderr:2024-04-19T03:00:54.916+0000 7f2dd16672c0 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-19T03:00:55.183 DEBUG:teuthology.orchestra.run.smithi096:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-19T03:00:55.283 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-04-19T03:00:55.276+0000 7f359b6e4880 -1 Falling back to public interface 2024-04-19T03:00:55.288 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:00:55.285+0000 7f252c57b880 -1 Falling back to public interface 2024-04-19T03:00:55.294 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:00:55.289+0000 7fd8b4b37880 -1 Falling back to public interface 2024-04-19T03:00:55.370 INFO:teuthology.misc.health.smithi096.stdout: 2024-04-19T03:00:55.370 INFO:teuthology.misc.health.smithi096.stdout:{"epoch":5,"fsid":"c6cc8e09-11d4-48de-9a6c-4d70ed3c3789","created":"2024-04-19T03:00:53.746146+0000","modified":"2024-04-19T03:00:54.640172+0000","last_up_change":"0.000000","last_in_change":"2024-04-19T03:00:54.640172+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"05ecb884-2c30-44f7-aa14-90154f9bbe9a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"efc873e0-69c3-4a57-8ee5-41f836b65f47","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"229278a0-dd93-4234-9065-e4f2f6188ef2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-19T03:00:55.381 DEBUG:teuthology.misc:0 of 3 OSDs are up 2024-04-19T03:00:55.566 INFO:tasks.ceph.mgr.y.smithi096.stderr:2024-04-19T03:00:55.564+0000 7f68b3edd2c0 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-19T03:00:55.567 INFO:tasks.ceph.mgr.x.smithi096.stderr:2024-04-19T03:00:55.564+0000 7f2dd16672c0 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-19T03:00:55.626 INFO:tasks.ceph.mgr.y.smithi096.stderr:2024-04-19T03:00:55.620+0000 7f68b3edd2c0 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-19T03:00:55.626 INFO:tasks.ceph.mgr.x.smithi096.stderr:2024-04-19T03:00:55.620+0000 7f2dd16672c0 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-19T03:00:55.802 INFO:tasks.ceph.mgr.x.smithi096.stderr:2024-04-19T03:00:55.796+0000 7f2dd16672c0 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-19T03:00:55.803 INFO:tasks.ceph.mgr.y.smithi096.stderr:2024-04-19T03:00:55.800+0000 7f68b3edd2c0 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-19T03:00:56.022 INFO:tasks.ceph.mgr.x.smithi096.stderr:2024-04-19T03:00:56.016+0000 7f2dd16672c0 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-19T03:00:56.023 INFO:tasks.ceph.mgr.y.smithi096.stderr:2024-04-19T03:00:56.020+0000 7f68b3edd2c0 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-19T03:00:56.073 INFO:tasks.ceph.mgr.x.smithi096.stderr:2024-04-19T03:00:56.068+0000 7f2dd16672c0 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-19T03:00:56.076 INFO:tasks.ceph.mgr.y.smithi096.stderr:2024-04-19T03:00:56.072+0000 7f68b3edd2c0 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-19T03:00:56.274 INFO:tasks.ceph.mgr.y.smithi096.stderr:2024-04-19T03:00:56.272+0000 7f68b3edd2c0 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-19T03:00:56.275 INFO:tasks.ceph.mgr.x.smithi096.stderr:2024-04-19T03:00:56.272+0000 7f2dd16672c0 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-19T03:00:56.341 INFO:tasks.ceph.mgr.x.smithi096.stderr:2024-04-19T03:00:56.336+0000 7f2dd16672c0 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-19T03:00:56.341 INFO:tasks.ceph.mgr.y.smithi096.stderr:2024-04-19T03:00:56.336+0000 7f68b3edd2c0 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-19T03:00:56.406 INFO:tasks.ceph.mgr.x.smithi096.stderr:2024-04-19T03:00:56.404+0000 7f2dd16672c0 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-19T03:00:56.409 INFO:tasks.ceph.mgr.y.smithi096.stderr:2024-04-19T03:00:56.404+0000 7f68b3edd2c0 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-19T03:00:56.806 INFO:tasks.ceph.mgr.x.smithi096.stderr:2024-04-19T03:00:56.804+0000 7f2dd16672c0 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-19T03:00:56.809 INFO:tasks.ceph.mgr.y.smithi096.stderr:2024-04-19T03:00:56.804+0000 7f68b3edd2c0 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-19T03:00:56.926 INFO:tasks.ceph.mgr.x.smithi096.stderr:2024-04-19T03:00:56.920+0000 7f2dd16672c0 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-19T03:00:56.928 INFO:tasks.ceph.mgr.y.smithi096.stderr:2024-04-19T03:00:56.924+0000 7f68b3edd2c0 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-19T03:00:57.263 INFO:tasks.ceph.mgr.x.smithi096.stderr:2024-04-19T03:00:57.260+0000 7f2dd16672c0 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-19T03:00:57.270 INFO:tasks.ceph.mgr.y.smithi096.stderr:2024-04-19T03:00:57.268+0000 7f68b3edd2c0 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-19T03:00:57.453 INFO:tasks.ceph.mgr.x.smithi096.stderr:2024-04-19T03:00:57.448+0000 7f2dd16672c0 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-19T03:00:57.453 INFO:tasks.ceph.mgr.y.smithi096.stderr:2024-04-19T03:00:57.448+0000 7f68b3edd2c0 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-19T03:00:57.523 INFO:tasks.ceph.mgr.x.smithi096.stderr:2024-04-19T03:00:57.520+0000 7f2dd16672c0 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-19T03:00:57.523 INFO:tasks.ceph.mgr.y.smithi096.stderr:2024-04-19T03:00:57.520+0000 7f68b3edd2c0 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-19T03:00:57.690 INFO:tasks.ceph.mgr.x.smithi096.stderr:2024-04-19T03:00:57.684+0000 7f2dd16672c0 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-19T03:00:57.690 INFO:tasks.ceph.mgr.y.smithi096.stderr:2024-04-19T03:00:57.684+0000 7f68b3edd2c0 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-19T03:00:58.286 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-04-19T03:00:58.280+0000 7f359b6e4880 -1 osd.0 0 log_to_monitors true 2024-04-19T03:00:58.405 INFO:tasks.ceph.mgr.x.smithi096.stderr:2024-04-19T03:00:58.400+0000 7f2dd16672c0 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-19T03:00:58.407 INFO:tasks.ceph.mgr.y.smithi096.stderr:2024-04-19T03:00:58.404+0000 7f68b3edd2c0 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-19T03:00:58.476 INFO:tasks.ceph.mgr.y.smithi096.stderr:2024-04-19T03:00:58.472+0000 7f68b3edd2c0 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-19T03:00:58.477 INFO:tasks.ceph.mgr.x.smithi096.stderr:2024-04-19T03:00:58.472+0000 7f2dd16672c0 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-19T03:00:58.666 INFO:tasks.ceph.mgr.x.smithi096.stderr:2024-04-19T03:00:58.664+0000 7f2dd16672c0 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-19T03:00:58.666 INFO:tasks.ceph.mgr.y.smithi096.stderr:2024-04-19T03:00:58.664+0000 7f68b3edd2c0 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-19T03:00:58.735 INFO:tasks.ceph.mgr.x.smithi096.stderr:2024-04-19T03:00:58.732+0000 7f2dd16672c0 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-19T03:00:58.736 INFO:tasks.ceph.mgr.y.smithi096.stderr:2024-04-19T03:00:58.732+0000 7f68b3edd2c0 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-19T03:00:58.753 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:00:58.749+0000 7f252c57b880 -1 osd.2 0 log_to_monitors true 2024-04-19T03:00:58.816 INFO:tasks.ceph.mgr.x.smithi096.stderr:2024-04-19T03:00:58.812+0000 7f2dd16672c0 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-19T03:00:58.816 INFO:tasks.ceph.mgr.y.smithi096.stderr:2024-04-19T03:00:58.812+0000 7f68b3edd2c0 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-19T03:00:59.074 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:00:59.069+0000 7fd8b4b37880 -1 osd.1 0 log_to_monitors true 2024-04-19T03:00:59.142 INFO:tasks.ceph.mgr.y.smithi096.stderr:2024-04-19T03:00:59.140+0000 7f68b3edd2c0 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-19T03:00:59.147 INFO:tasks.ceph.mgr.x.smithi096.stderr:2024-04-19T03:00:59.144+0000 7f2dd16672c0 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-19T03:00:59.221 INFO:tasks.ceph.mgr.y.smithi096.stderr:2024-04-19T03:00:59.216+0000 7f68b3edd2c0 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-19T03:00:59.221 INFO:tasks.ceph.mgr.x.smithi096.stderr:2024-04-19T03:00:59.216+0000 7f2dd16672c0 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-19T03:00:59.930 INFO:tasks.ceph.mgr.x.smithi096.stderr:2024-04-19T03:00:59.928+0000 7f2dd16672c0 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-19T03:00:59.931 INFO:tasks.ceph.mgr.y.smithi096.stderr:2024-04-19T03:00:59.928+0000 7f68b3edd2c0 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-19T03:01:00.959 INFO:tasks.ceph.mgr.y.smithi096.stderr:2024-04-19T03:01:00.956+0000 7f689aa53700 -1 mgr.server handle_report got status from non-daemon mon.c 2024-04-19T03:01:00.959 INFO:tasks.ceph.mgr.y.smithi096.stderr:2024-04-19T03:01:00.956+0000 7f689aa53700 -1 mgr.server handle_report got status from non-daemon mon.b 2024-04-19T03:01:01.683 DEBUG:teuthology.orchestra.run.smithi096:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-19T03:01:01.977 INFO:teuthology.misc.health.smithi096.stdout: 2024-04-19T03:01:01.977 INFO:teuthology.misc.health.smithi096.stdout:{"epoch":8,"fsid":"c6cc8e09-11d4-48de-9a6c-4d70ed3c3789","created":"2024-04-19T03:00:53.746146+0000","modified":"2024-04-19T03:01:00.368935+0000","last_up_change":"0.000000","last_in_change":"2024-04-19T03:00:54.640172+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"05ecb884-2c30-44f7-aa14-90154f9bbe9a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"efc873e0-69c3-4a57-8ee5-41f836b65f47","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"229278a0-dd93-4234-9065-e4f2f6188ef2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-19T03:01:01.990 DEBUG:teuthology.misc:0 of 3 OSDs are up 2024-04-19T03:01:02.374 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-04-19T03:01:02.368+0000 7f3597523700 -1 osd.0 0 waiting for initial osdmap 2024-04-19T03:01:02.379 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-04-19T03:01:02.372+0000 7f358efd2700 -1 osd.0 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-19T03:01:03.476 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:01:03.469+0000 7fd8b12fd700 -1 osd.1 0 waiting for initial osdmap 2024-04-19T03:01:03.480 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:01:03.477+0000 7fd8a8425700 -1 osd.1 9 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-19T03:01:03.497 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:01:03.493+0000 7f2528d41700 -1 osd.2 0 waiting for initial osdmap 2024-04-19T03:01:03.503 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:01:03.501+0000 7f251fe69700 -1 osd.2 9 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-19T03:01:08.293 DEBUG:teuthology.orchestra.run.smithi096:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-19T03:01:08.698 INFO:teuthology.misc.health.smithi096.stdout: 2024-04-19T03:01:08.698 INFO:teuthology.misc.health.smithi096.stdout:{"epoch":14,"fsid":"c6cc8e09-11d4-48de-9a6c-4d70ed3c3789","created":"2024-04-19T03:00:53.746146+0000","modified":"2024-04-19T03:01:08.534107+0000","last_up_change":"2024-04-19T03:01:04.501086+0000","last_in_change":"2024-04-19T03:00:54.640172+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-19T03:01:05.999591+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"05ecb884-2c30-44f7-aa14-90154f9bbe9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":18245},{"type":"v1","addr":"172.21.15.97:6801","nonce":18245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":18245},{"type":"v1","addr":"172.21.15.97:6803","nonce":18245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":18245},{"type":"v1","addr":"172.21.15.97:6807","nonce":18245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6804","nonce":18245},{"type":"v1","addr":"172.21.15.97:6805","nonce":18245}]},"public_addr":"172.21.15.97:6801/18245","cluster_addr":"172.21.15.97:6803/18245","heartbeat_back_addr":"172.21.15.97:6807/18245","heartbeat_front_addr":"172.21.15.97:6805/18245","state":["exists","up"]},{"osd":1,"uuid":"efc873e0-69c3-4a57-8ee5-41f836b65f47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":18145},{"type":"v1","addr":"172.21.15.134:6801","nonce":18145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":18145},{"type":"v1","addr":"172.21.15.134:6803","nonce":18145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":18145},{"type":"v1","addr":"172.21.15.134:6807","nonce":18145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":18145},{"type":"v1","addr":"172.21.15.134:6805","nonce":18145}]},"public_addr":"172.21.15.134:6801/18145","cluster_addr":"172.21.15.134:6803/18145","heartbeat_back_addr":"172.21.15.134:6807/18145","heartbeat_front_addr":"172.21.15.134:6805/18145","state":["exists","up"]},{"osd":2,"uuid":"229278a0-dd93-4234-9065-e4f2f6188ef2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":18223},{"type":"v1","addr":"172.21.15.144:6801","nonce":18223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":18223},{"type":"v1","addr":"172.21.15.144:6803","nonce":18223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":18223},{"type":"v1","addr":"172.21.15.144:6807","nonce":18223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":18223},{"type":"v1","addr":"172.21.15.144:6805","nonce":18223}]},"public_addr":"172.21.15.144:6801/18223","cluster_addr":"172.21.15.144:6803/18223","heartbeat_back_addr":"172.21.15.144:6807/18223","heartbeat_front_addr":"172.21.15.144:6805/18223","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T03:00:59.302574+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T03:01:00.064174+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T03:00:59.735582+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-19T03:01:08.716 DEBUG:teuthology.misc:3 of 3 OSDs are up 2024-04-19T03:01:08.716 INFO:tasks.ceph:Creating RBD pool 2024-04-19T03:01:08.716 DEBUG:teuthology.orchestra.run.smithi096:> sudo ceph --cluster ceph osd pool create rbd 8 2024-04-19T03:01:09.592 INFO:teuthology.orchestra.run.smithi096.stderr:pool 'rbd' created 2024-04-19T03:01:09.603 DEBUG:teuthology.orchestra.run.smithi096:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2024-04-19T03:01:10.598 INFO:teuthology.orchestra.run.smithi096.stderr:enabled application 'rbd' on pool 'rbd' 2024-04-19T03:01:10.612 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-04-19T03:01:10.612 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-19T03:01:10.613 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-19T03:01:10.615 INFO:tasks.ceph.mds.a:Started 2024-04-19T03:01:10.615 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-04-19T03:01:10.615 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-19T03:01:10.692 INFO:tasks.ceph.mds.a.smithi096.stdout:starting mds.a at 2024-04-19T03:01:10.910 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-19T03:01:10.910 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":16,"fsid":"c6cc8e09-11d4-48de-9a6c-4d70ed3c3789","created":"2024-04-19T03:00:53.746146+0000","modified":"2024-04-19T03:01:10.581774+0000","last_up_change":"2024-04-19T03:01:04.501086+0000","last_in_change":"2024-04-19T03:00:54.640172+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-19T03:01:05.999591+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-19T03:01:09.051757+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"05ecb884-2c30-44f7-aa14-90154f9bbe9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":18245},{"type":"v1","addr":"172.21.15.97:6801","nonce":18245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":18245},{"type":"v1","addr":"172.21.15.97:6803","nonce":18245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":18245},{"type":"v1","addr":"172.21.15.97:6807","nonce":18245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6804","nonce":18245},{"type":"v1","addr":"172.21.15.97:6805","nonce":18245}]},"public_addr":"172.21.15.97:6801/18245","cluster_addr":"172.21.15.97:6803/18245","heartbeat_back_addr":"172.21.15.97:6807/18245","heartbeat_front_addr":"172.21.15.97:6805/18245","state":["exists","up"]},{"osd":1,"uuid":"efc873e0-69c3-4a57-8ee5-41f836b65f47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":18145},{"type":"v1","addr":"172.21.15.134:6801","nonce":18145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":18145},{"type":"v1","addr":"172.21.15.134:6803","nonce":18145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":18145},{"type":"v1","addr":"172.21.15.134:6807","nonce":18145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":18145},{"type":"v1","addr":"172.21.15.134:6805","nonce":18145}]},"public_addr":"172.21.15.134:6801/18145","cluster_addr":"172.21.15.134:6803/18145","heartbeat_back_addr":"172.21.15.134:6807/18145","heartbeat_front_addr":"172.21.15.134:6805/18145","state":["exists","up"]},{"osd":2,"uuid":"229278a0-dd93-4234-9065-e4f2f6188ef2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":18223},{"type":"v1","addr":"172.21.15.144:6801","nonce":18223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":18223},{"type":"v1","addr":"172.21.15.144:6803","nonce":18223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":18223},{"type":"v1","addr":"172.21.15.144:6807","nonce":18223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":18223},{"type":"v1","addr":"172.21.15.144:6805","nonce":18223}]},"public_addr":"172.21.15.144:6801/18223","cluster_addr":"172.21.15.144:6803/18223","heartbeat_back_addr":"172.21.15.144:6807/18223","heartbeat_front_addr":"172.21.15.144:6805/18223","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T03:00:59.302574+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T03:01:00.064174+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T03:00:59.735582+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-19T03:01:10.929 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-19T03:01:05.999591+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '14', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-19T03:01:09.051757+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-19T03:01:10.929 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-19T03:01:11.231 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 1 2024-04-19T03:01:11.245 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-04-19T03:01:11.542 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 8 2024-04-19T03:01:11.556 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-19T03:01:11.885 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-19T03:01:11.885 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4202,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.96:6803/3386968674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":3386968674},{"type":"v1","addr":"172.21.15.96:6803","nonce":3386968674}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[]} 2024-04-19T03:01:11.889 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 2 2024-04-19T03:01:11.899 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-19T03:01:12.188 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-19T03:01:12.188 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":17,"fsid":"c6cc8e09-11d4-48de-9a6c-4d70ed3c3789","created":"2024-04-19T03:00:53.746146+0000","modified":"2024-04-19T03:01:11.588859+0000","last_up_change":"2024-04-19T03:01:04.501086+0000","last_in_change":"2024-04-19T03:00:54.640172+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-19T03:01:05.999591+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-19T03:01:09.051757+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"05ecb884-2c30-44f7-aa14-90154f9bbe9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":18245},{"type":"v1","addr":"172.21.15.97:6801","nonce":18245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":18245},{"type":"v1","addr":"172.21.15.97:6803","nonce":18245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":18245},{"type":"v1","addr":"172.21.15.97:6807","nonce":18245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6804","nonce":18245},{"type":"v1","addr":"172.21.15.97:6805","nonce":18245}]},"public_addr":"172.21.15.97:6801/18245","cluster_addr":"172.21.15.97:6803/18245","heartbeat_back_addr":"172.21.15.97:6807/18245","heartbeat_front_addr":"172.21.15.97:6805/18245","state":["exists","up"]},{"osd":1,"uuid":"efc873e0-69c3-4a57-8ee5-41f836b65f47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":18145},{"type":"v1","addr":"172.21.15.134:6801","nonce":18145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":18145},{"type":"v1","addr":"172.21.15.134:6803","nonce":18145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":18145},{"type":"v1","addr":"172.21.15.134:6807","nonce":18145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":18145},{"type":"v1","addr":"172.21.15.134:6805","nonce":18145}]},"public_addr":"172.21.15.134:6801/18145","cluster_addr":"172.21.15.134:6803/18145","heartbeat_back_addr":"172.21.15.134:6807/18145","heartbeat_front_addr":"172.21.15.134:6805/18145","state":["exists","up"]},{"osd":2,"uuid":"229278a0-dd93-4234-9065-e4f2f6188ef2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":18223},{"type":"v1","addr":"172.21.15.144:6801","nonce":18223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":18223},{"type":"v1","addr":"172.21.15.144:6803","nonce":18223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":18223},{"type":"v1","addr":"172.21.15.144:6807","nonce":18223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":18223},{"type":"v1","addr":"172.21.15.144:6805","nonce":18223}]},"public_addr":"172.21.15.144:6801/18223","cluster_addr":"172.21.15.144:6803/18223","heartbeat_back_addr":"172.21.15.144:6807/18223","heartbeat_front_addr":"172.21.15.144:6805/18223","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T03:00:59.302574+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T03:01:00.064174+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T03:00:59.735582+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-19T03:01:12.201 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-19T03:01:05.999591+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '14', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-19T03:01:09.051757+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-19T03:01:12.202 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-19T03:01:12.504 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 1 2024-04-19T03:01:12.518 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-04-19T03:01:12.812 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 8 2024-04-19T03:01:12.827 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-19T03:01:13.122 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-19T03:01:13.122 INFO:teuthology.orchestra.run.smithi096.stdout:[ 2024-04-19T03:01:13.122 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-19T03:01:13.122 INFO:teuthology.orchestra.run.smithi096.stdout: "poolnum": 1, 2024-04-19T03:01:13.122 INFO:teuthology.orchestra.run.smithi096.stdout: "poolname": ".mgr" 2024-04-19T03:01:13.122 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-19T03:01:13.122 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-19T03:01:13.123 INFO:teuthology.orchestra.run.smithi096.stdout: "poolnum": 2, 2024-04-19T03:01:13.123 INFO:teuthology.orchestra.run.smithi096.stdout: "poolname": "rbd" 2024-04-19T03:01:13.123 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-19T03:01:13.123 INFO:teuthology.orchestra.run.smithi096.stdout:] 2024-04-19T03:01:13.136 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-19T03:01:13.137 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-19T03:01:13.624 INFO:teuthology.orchestra.run.smithi096.stderr:pool 'cephfs_metadata' created 2024-04-19T03:01:13.636 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-04-19T03:01:14.634 INFO:teuthology.orchestra.run.smithi096.stderr:pool 'cephfs_data' created 2024-04-19T03:01:14.647 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-19T03:01:14.999 INFO:teuthology.orchestra.run.smithi096.stderr:new fs with metadata pool 3 and data pool 4 2024-04-19T03:01:15.011 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-19T03:01:15.303 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-19T03:01:15.303 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":20,"fsid":"c6cc8e09-11d4-48de-9a6c-4d70ed3c3789","created":"2024-04-19T03:00:53.746146+0000","modified":"2024-04-19T03:01:14.988714+0000","last_up_change":"2024-04-19T03:01:04.501086+0000","last_in_change":"2024-04-19T03:00:54.640172+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-19T03:01:05.999591+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-19T03:01:09.051757+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-19T03:01:13.479163+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-19T03:01:13.992441+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"05ecb884-2c30-44f7-aa14-90154f9bbe9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":18245},{"type":"v1","addr":"172.21.15.97:6801","nonce":18245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":18245},{"type":"v1","addr":"172.21.15.97:6803","nonce":18245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":18245},{"type":"v1","addr":"172.21.15.97:6807","nonce":18245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6804","nonce":18245},{"type":"v1","addr":"172.21.15.97:6805","nonce":18245}]},"public_addr":"172.21.15.97:6801/18245","cluster_addr":"172.21.15.97:6803/18245","heartbeat_back_addr":"172.21.15.97:6807/18245","heartbeat_front_addr":"172.21.15.97:6805/18245","state":["exists","up"]},{"osd":1,"uuid":"efc873e0-69c3-4a57-8ee5-41f836b65f47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":18145},{"type":"v1","addr":"172.21.15.134:6801","nonce":18145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":18145},{"type":"v1","addr":"172.21.15.134:6803","nonce":18145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":18145},{"type":"v1","addr":"172.21.15.134:6807","nonce":18145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":18145},{"type":"v1","addr":"172.21.15.134:6805","nonce":18145}]},"public_addr":"172.21.15.134:6801/18145","cluster_addr":"172.21.15.134:6803/18145","heartbeat_back_addr":"172.21.15.134:6807/18145","heartbeat_front_addr":"172.21.15.134:6805/18145","state":["exists","up"]},{"osd":2,"uuid":"229278a0-dd93-4234-9065-e4f2f6188ef2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":18223},{"type":"v1","addr":"172.21.15.144:6801","nonce":18223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":18223},{"type":"v1","addr":"172.21.15.144:6803","nonce":18223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":18223},{"type":"v1","addr":"172.21.15.144:6807","nonce":18223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":18223},{"type":"v1","addr":"172.21.15.144:6805","nonce":18223}]},"public_addr":"172.21.15.144:6801/18223","cluster_addr":"172.21.15.144:6803/18223","heartbeat_back_addr":"172.21.15.144:6807/18223","heartbeat_front_addr":"172.21.15.144:6805/18223","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T03:00:59.302574+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T03:01:00.064174+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T03:00:59.735582+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-19T03:01:15.318 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-19T03:01:15.616 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-19T03:01:15.616 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":20,"fsid":"c6cc8e09-11d4-48de-9a6c-4d70ed3c3789","created":"2024-04-19T03:00:53.746146+0000","modified":"2024-04-19T03:01:14.988714+0000","last_up_change":"2024-04-19T03:01:04.501086+0000","last_in_change":"2024-04-19T03:00:54.640172+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-19T03:01:05.999591+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-19T03:01:09.051757+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-19T03:01:13.479163+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-19T03:01:13.992441+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"05ecb884-2c30-44f7-aa14-90154f9bbe9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":18245},{"type":"v1","addr":"172.21.15.97:6801","nonce":18245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":18245},{"type":"v1","addr":"172.21.15.97:6803","nonce":18245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":18245},{"type":"v1","addr":"172.21.15.97:6807","nonce":18245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6804","nonce":18245},{"type":"v1","addr":"172.21.15.97:6805","nonce":18245}]},"public_addr":"172.21.15.97:6801/18245","cluster_addr":"172.21.15.97:6803/18245","heartbeat_back_addr":"172.21.15.97:6807/18245","heartbeat_front_addr":"172.21.15.97:6805/18245","state":["exists","up"]},{"osd":1,"uuid":"efc873e0-69c3-4a57-8ee5-41f836b65f47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":18145},{"type":"v1","addr":"172.21.15.134:6801","nonce":18145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":18145},{"type":"v1","addr":"172.21.15.134:6803","nonce":18145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":18145},{"type":"v1","addr":"172.21.15.134:6807","nonce":18145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":18145},{"type":"v1","addr":"172.21.15.134:6805","nonce":18145}]},"public_addr":"172.21.15.134:6801/18145","cluster_addr":"172.21.15.134:6803/18145","heartbeat_back_addr":"172.21.15.134:6807/18145","heartbeat_front_addr":"172.21.15.134:6805/18145","state":["exists","up"]},{"osd":2,"uuid":"229278a0-dd93-4234-9065-e4f2f6188ef2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":18223},{"type":"v1","addr":"172.21.15.144:6801","nonce":18223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":18223},{"type":"v1","addr":"172.21.15.144:6803","nonce":18223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":18223},{"type":"v1","addr":"172.21.15.144:6807","nonce":18223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":18223},{"type":"v1","addr":"172.21.15.144:6805","nonce":18223}]},"public_addr":"172.21.15.144:6801/18223","cluster_addr":"172.21.15.144:6803/18223","heartbeat_back_addr":"172.21.15.144:6807/18223","heartbeat_front_addr":"172.21.15.144:6805/18223","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T03:00:59.302574+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T03:01:00.064174+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T03:00:59.735582+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-19T03:01:15.630 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-19T03:01:16.020 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-04-19T03:01:16.020 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-19T03:01:17.029 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-19T03:01:17.030 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-19T03:01:17.367 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-19T03:01:17.367 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":5,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-19T03:01:14.989437+0000","modified":"2024-04-19T03:01:17.001353+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4202},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4202":{"gid":4202,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.96:6803/3386968674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":3386968674},{"type":"v1","addr":"172.21.15.96:6803","nonce":3386968674}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-19T03:01:17.370 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 5 2024-04-19T03:01:17.381 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-19T03:01:17.681 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-19T03:01:17.681 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":21,"fsid":"c6cc8e09-11d4-48de-9a6c-4d70ed3c3789","created":"2024-04-19T03:00:53.746146+0000","modified":"2024-04-19T03:01:15.992289+0000","last_up_change":"2024-04-19T03:01:04.501086+0000","last_in_change":"2024-04-19T03:00:54.640172+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-19T03:01:05.999591+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-19T03:01:09.051757+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-19T03:01:13.479163+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-19T03:01:13.992441+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"05ecb884-2c30-44f7-aa14-90154f9bbe9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":18245},{"type":"v1","addr":"172.21.15.97:6801","nonce":18245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":18245},{"type":"v1","addr":"172.21.15.97:6803","nonce":18245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":18245},{"type":"v1","addr":"172.21.15.97:6807","nonce":18245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6804","nonce":18245},{"type":"v1","addr":"172.21.15.97:6805","nonce":18245}]},"public_addr":"172.21.15.97:6801/18245","cluster_addr":"172.21.15.97:6803/18245","heartbeat_back_addr":"172.21.15.97:6807/18245","heartbeat_front_addr":"172.21.15.97:6805/18245","state":["exists","up"]},{"osd":1,"uuid":"efc873e0-69c3-4a57-8ee5-41f836b65f47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":18145},{"type":"v1","addr":"172.21.15.134:6801","nonce":18145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":18145},{"type":"v1","addr":"172.21.15.134:6803","nonce":18145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":18145},{"type":"v1","addr":"172.21.15.134:6807","nonce":18145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":18145},{"type":"v1","addr":"172.21.15.134:6805","nonce":18145}]},"public_addr":"172.21.15.134:6801/18145","cluster_addr":"172.21.15.134:6803/18145","heartbeat_back_addr":"172.21.15.134:6807/18145","heartbeat_front_addr":"172.21.15.134:6805/18145","state":["exists","up"]},{"osd":2,"uuid":"229278a0-dd93-4234-9065-e4f2f6188ef2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":18223},{"type":"v1","addr":"172.21.15.144:6801","nonce":18223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":18223},{"type":"v1","addr":"172.21.15.144:6803","nonce":18223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":18223},{"type":"v1","addr":"172.21.15.144:6807","nonce":18223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":18223},{"type":"v1","addr":"172.21.15.144:6805","nonce":18223}]},"public_addr":"172.21.15.144:6801/18223","cluster_addr":"172.21.15.144:6803/18223","heartbeat_back_addr":"172.21.15.144:6807/18223","heartbeat_front_addr":"172.21.15.144:6805/18223","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T03:00:59.302574+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T03:01:00.064174+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T03:00:59.735582+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-19T03:01:17.694 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-19T03:01:17.695 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-19T03:01:18.002 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-19T03:01:18.005 INFO:teuthology.orchestra.run.smithi096.stderr:dumped all 2024-04-19T03:01:18.016 INFO:teuthology.orchestra.run.smithi096.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2024-04-19T03:01:17.943902+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":174,"acting":174,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":38,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":93912,"kb_used_data":560,"kb_used_omap":4,"kb_used_meta":93307,"kb_avail":283021608,"statfs":{"total":289910292480,"available":289814126592,"internally_reserved":0,"allocated":573440,"data_stored":1320361,"data_compressed":14482,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":4782,"internal_metadata":95546706},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.326899"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-04-19T03:01:14.636530+0000","last_change":"2024-04-19T03:01:14.636530+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.636530+0000","last_undegraded":"2024-04-19T03:01:14.636530+0000","last_fullsized":"2024-04-19T03:01:14.636530+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:13:26.030579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-04-19T03:01:14.638657+0000","last_change":"2024-04-19T03:01:14.638657+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.638657+0000","last_undegraded":"2024-04-19T03:01:14.638657+0000","last_fullsized":"2024-04-19T03:01:14.638657+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:48:13.389356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-04-19T03:01:14.641392+0000","last_change":"2024-04-19T03:01:14.641392+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.641392+0000","last_undegraded":"2024-04-19T03:01:14.641392+0000","last_fullsized":"2024-04-19T03:01:14.641392+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:35:19.436344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-04-19T03:01:14.638667+0000","last_change":"2024-04-19T03:01:14.638667+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.638667+0000","last_undegraded":"2024-04-19T03:01:14.638667+0000","last_fullsized":"2024-04-19T03:01:14.638667+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:30:22.360053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-04-19T03:01:14.631489+0000","last_change":"2024-04-19T03:01:14.631489+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.631489+0000","last_undegraded":"2024-04-19T03:01:14.631489+0000","last_fullsized":"2024-04-19T03:01:14.631489+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:31:51.982582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-04-19T03:01:14.638578+0000","last_change":"2024-04-19T03:01:14.638578+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.638578+0000","last_undegraded":"2024-04-19T03:01:14.638578+0000","last_fullsized":"2024-04-19T03:01:14.638578+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:22:58.349159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-04-19T03:01:14.636323+0000","last_change":"2024-04-19T03:01:14.636323+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.636323+0000","last_undegraded":"2024-04-19T03:01:14.636323+0000","last_fullsized":"2024-04-19T03:01:14.636323+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:48:13.389356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-04-19T03:01:14.640018+0000","last_change":"2024-04-19T03:01:14.640018+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.640018+0000","last_undegraded":"2024-04-19T03:01:14.640018+0000","last_fullsized":"2024-04-19T03:01:14.640018+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:09:23.427311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T03:01:14.615919+0000","last_change":"2024-04-19T03:01:14.615919+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.615919+0000","last_undegraded":"2024-04-19T03:01:14.615919+0000","last_fullsized":"2024-04-19T03:01:14.615919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-04-19T03:01:14.637573+0000","last_change":"2024-04-19T03:01:14.637573+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.637573+0000","last_undegraded":"2024-04-19T03:01:14.637573+0000","last_fullsized":"2024-04-19T03:01:14.637573+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:10:21.967941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-04-19T03:01:14.641049+0000","last_change":"2024-04-19T03:01:14.641049+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.641049+0000","last_undegraded":"2024-04-19T03:01:14.641049+0000","last_fullsized":"2024-04-19T03:01:14.641049+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:10:56.732208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-04-19T03:01:14.638345+0000","last_change":"2024-04-19T03:01:14.638345+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.638345+0000","last_undegraded":"2024-04-19T03:01:14.638345+0000","last_fullsized":"2024-04-19T03:01:14.638345+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:09:23.427311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-04-19T03:01:14.636683+0000","last_change":"2024-04-19T03:01:14.636683+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.636683+0000","last_undegraded":"2024-04-19T03:01:14.636683+0000","last_fullsized":"2024-04-19T03:01:14.636683+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:07:57.843767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-04-19T03:01:14.636154+0000","last_change":"2024-04-19T03:01:14.636154+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.636154+0000","last_undegraded":"2024-04-19T03:01:14.636154+0000","last_fullsized":"2024-04-19T03:01:14.636154+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:21:36.129346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-04-19T03:01:14.634523+0000","last_change":"2024-04-19T03:01:14.634523+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.634523+0000","last_undegraded":"2024-04-19T03:01:14.634523+0000","last_fullsized":"2024-04-19T03:01:14.634523+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:01:54.253963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-04-19T03:01:14.638699+0000","last_change":"2024-04-19T03:01:14.638699+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.638699+0000","last_undegraded":"2024-04-19T03:01:14.638699+0000","last_fullsized":"2024-04-19T03:01:14.638699+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:40:59.453079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T03:01:14.615919+0000","last_change":"2024-04-19T03:01:14.615919+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.615919+0000","last_undegraded":"2024-04-19T03:01:14.615919+0000","last_fullsized":"2024-04-19T03:01:14.615919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-04-19T03:01:14.632656+0000","last_change":"2024-04-19T03:01:14.632656+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.632656+0000","last_undegraded":"2024-04-19T03:01:14.632656+0000","last_fullsized":"2024-04-19T03:01:14.632656+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:40:20.790332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T03:01:14.615919+0000","last_change":"2024-04-19T03:01:14.615919+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.615919+0000","last_undegraded":"2024-04-19T03:01:14.615919+0000","last_fullsized":"2024-04-19T03:01:14.615919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-04-19T03:01:14.637003+0000","last_change":"2024-04-19T03:01:14.637003+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.637003+0000","last_undegraded":"2024-04-19T03:01:14.637003+0000","last_fullsized":"2024-04-19T03:01:14.637003+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:39:54.289444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-04-19T03:01:14.633108+0000","last_change":"2024-04-19T03:01:14.633108+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.633108+0000","last_undegraded":"2024-04-19T03:01:14.633108+0000","last_fullsized":"2024-04-19T03:01:14.633108+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:10:21.967941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-04-19T03:01:14.636810+0000","last_change":"2024-04-19T03:01:14.636810+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.636810+0000","last_undegraded":"2024-04-19T03:01:14.636810+0000","last_fullsized":"2024-04-19T03:01:14.636810+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:30:22.360053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T03:01:14.615919+0000","last_change":"2024-04-19T03:01:14.615919+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.615919+0000","last_undegraded":"2024-04-19T03:01:14.615919+0000","last_fullsized":"2024-04-19T03:01:14.615919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-04-19T03:01:14.638185+0000","last_change":"2024-04-19T03:01:14.638185+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.638185+0000","last_undegraded":"2024-04-19T03:01:14.638185+0000","last_fullsized":"2024-04-19T03:01:14.638185+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:37:35.950318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-04-19T03:01:14.634353+0000","last_change":"2024-04-19T03:01:14.634353+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.634353+0000","last_undegraded":"2024-04-19T03:01:14.634353+0000","last_fullsized":"2024-04-19T03:01:14.634353+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:56:44.307812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T03:01:14.615919+0000","last_change":"2024-04-19T03:01:14.615919+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.615919+0000","last_undegraded":"2024-04-19T03:01:14.615919+0000","last_fullsized":"2024-04-19T03:01:14.615919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-04-19T03:01:14.640726+0000","last_change":"2024-04-19T03:01:14.640726+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.640726+0000","last_undegraded":"2024-04-19T03:01:14.640726+0000","last_fullsized":"2024-04-19T03:01:14.640726+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:06:35.813797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-04-19T03:01:14.631256+0000","last_change":"2024-04-19T03:01:14.631256+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.631256+0000","last_undegraded":"2024-04-19T03:01:14.631256+0000","last_fullsized":"2024-04-19T03:01:14.631256+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:50:06.490191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T03:01:14.615919+0000","last_change":"2024-04-19T03:01:14.615919+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.615919+0000","last_undegraded":"2024-04-19T03:01:14.615919+0000","last_fullsized":"2024-04-19T03:01:14.615919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-04-19T03:01:14.630855+0000","last_change":"2024-04-19T03:01:14.630855+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.630855+0000","last_undegraded":"2024-04-19T03:01:14.630855+0000","last_fullsized":"2024-04-19T03:01:14.630855+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:10:42.079294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T03:01:14.615919+0000","last_change":"2024-04-19T03:01:14.615919+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.615919+0000","last_undegraded":"2024-04-19T03:01:14.615919+0000","last_fullsized":"2024-04-19T03:01:14.615919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-04-19T03:01:14.637332+0000","last_change":"2024-04-19T03:01:14.637332+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.637332+0000","last_undegraded":"2024-04-19T03:01:14.637332+0000","last_fullsized":"2024-04-19T03:01:14.637332+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:54:54.463918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-04-19T03:01:14.635649+0000","last_change":"2024-04-19T03:01:14.635649+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.635649+0000","last_undegraded":"2024-04-19T03:01:14.635649+0000","last_fullsized":"2024-04-19T03:01:14.635649+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:55:34.102680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T03:01:14.654351+0000","last_change":"2024-04-19T03:01:14.651050+0000","last_active":"2024-04-19T03:01:14.654351+0000","last_peered":"2024-04-19T03:01:14.654351+0000","last_clean":"2024-04-19T03:01:14.654351+0000","last_became_active":"2024-04-19T03:01:14.650679+0000","last_became_peered":"2024-04-19T03:01:14.650679+0000","last_unstale":"2024-04-19T03:01:14.654351+0000","last_undegraded":"2024-04-19T03:01:14.654351+0000","last_fullsized":"2024-04-19T03:01:14.654351+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:37:03.684394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-04-19T03:01:14.636520+0000","last_change":"2024-04-19T03:01:14.636520+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.636520+0000","last_undegraded":"2024-04-19T03:01:14.636520+0000","last_fullsized":"2024-04-19T03:01:14.636520+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:40:12.179703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-04-19T03:01:13.624457+0000","last_change":"2024-04-19T03:01:13.624457+0000","last_active":"2024-04-19T03:01:13.604133+0000","last_peered":"2024-04-19T03:01:13.604133+0000","last_clean":"2024-04-19T03:01:13.604133+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:13.624457+0000","last_undegraded":"2024-04-19T03:01:13.624457+0000","last_fullsized":"2024-04-19T03:01:13.624457+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:40:53.463388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T03:01:14.615919+0000","last_change":"2024-04-19T03:01:14.615919+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.615919+0000","last_undegraded":"2024-04-19T03:01:14.615919+0000","last_fullsized":"2024-04-19T03:01:14.615919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T03:01:14.650574+0000","last_change":"2024-04-19T03:01:14.649074+0000","last_active":"2024-04-19T03:01:14.650574+0000","last_peered":"2024-04-19T03:01:14.650574+0000","last_clean":"2024-04-19T03:01:14.650574+0000","last_became_active":"2024-04-19T03:01:14.648217+0000","last_became_peered":"2024-04-19T03:01:14.648217+0000","last_unstale":"2024-04-19T03:01:14.650574+0000","last_undegraded":"2024-04-19T03:01:14.650574+0000","last_fullsized":"2024-04-19T03:01:14.650574+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:57:05.238043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T03:01:14.615919+0000","last_change":"2024-04-19T03:01:14.615919+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.615919+0000","last_undegraded":"2024-04-19T03:01:14.615919+0000","last_fullsized":"2024-04-19T03:01:14.615919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T03:01:14.651960+0000","last_change":"2024-04-19T03:01:14.649044+0000","last_active":"2024-04-19T03:01:14.651960+0000","last_peered":"2024-04-19T03:01:14.651960+0000","last_clean":"2024-04-19T03:01:14.651960+0000","last_became_active":"2024-04-19T03:01:14.648859+0000","last_became_peered":"2024-04-19T03:01:14.648859+0000","last_unstale":"2024-04-19T03:01:14.651960+0000","last_undegraded":"2024-04-19T03:01:14.651960+0000","last_fullsized":"2024-04-19T03:01:14.651960+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:30:45.925657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T03:01:14.652044+0000","last_change":"2024-04-19T03:01:14.649839+0000","last_active":"2024-04-19T03:01:14.652044+0000","last_peered":"2024-04-19T03:01:14.652044+0000","last_clean":"2024-04-19T03:01:14.652044+0000","last_became_active":"2024-04-19T03:01:14.649571+0000","last_became_peered":"2024-04-19T03:01:14.649571+0000","last_unstale":"2024-04-19T03:01:14.652044+0000","last_undegraded":"2024-04-19T03:01:14.652044+0000","last_fullsized":"2024-04-19T03:01:14.652044+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:03:57.839660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-04-19T03:01:14.634133+0000","last_change":"2024-04-19T03:01:14.634133+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.634133+0000","last_undegraded":"2024-04-19T03:01:14.634133+0000","last_fullsized":"2024-04-19T03:01:14.634133+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:54:54.463918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T03:01:14.646089+0000","last_change":"2024-04-19T03:01:14.645075+0000","last_active":"2024-04-19T03:01:14.646089+0000","last_peered":"2024-04-19T03:01:14.646089+0000","last_clean":"2024-04-19T03:01:14.646089+0000","last_became_active":"2024-04-19T03:01:14.644790+0000","last_became_peered":"2024-04-19T03:01:14.644790+0000","last_unstale":"2024-04-19T03:01:14.646089+0000","last_undegraded":"2024-04-19T03:01:14.646089+0000","last_fullsized":"2024-04-19T03:01:14.646089+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:55:15.035769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-04-19T03:01:14.637118+0000","last_change":"2024-04-19T03:01:14.637118+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.637118+0000","last_undegraded":"2024-04-19T03:01:14.637118+0000","last_fullsized":"2024-04-19T03:01:14.637118+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:13:06.902769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T03:01:14.652024+0000","last_change":"2024-04-19T03:01:14.649826+0000","last_active":"2024-04-19T03:01:14.652024+0000","last_peered":"2024-04-19T03:01:14.652024+0000","last_clean":"2024-04-19T03:01:14.652024+0000","last_became_active":"2024-04-19T03:01:14.649565+0000","last_became_peered":"2024-04-19T03:01:14.649565+0000","last_unstale":"2024-04-19T03:01:14.652024+0000","last_undegraded":"2024-04-19T03:01:14.652024+0000","last_fullsized":"2024-04-19T03:01:14.652024+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:36:00.962931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-04-19T03:01:14.635329+0000","last_change":"2024-04-19T03:01:14.635329+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.635329+0000","last_undegraded":"2024-04-19T03:01:14.635329+0000","last_fullsized":"2024-04-19T03:01:14.635329+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:50:06.490191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T03:01:14.654439+0000","last_change":"2024-04-19T03:01:14.651201+0000","last_active":"2024-04-19T03:01:14.654439+0000","last_peered":"2024-04-19T03:01:14.654439+0000","last_clean":"2024-04-19T03:01:14.654439+0000","last_became_active":"2024-04-19T03:01:14.650942+0000","last_became_peered":"2024-04-19T03:01:14.650942+0000","last_unstale":"2024-04-19T03:01:14.654439+0000","last_undegraded":"2024-04-19T03:01:14.654439+0000","last_fullsized":"2024-04-19T03:01:14.654439+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:02:13.190917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T03:01:14.615919+0000","last_change":"2024-04-19T03:01:14.615919+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.615919+0000","last_undegraded":"2024-04-19T03:01:14.615919+0000","last_fullsized":"2024-04-19T03:01:14.615919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-04-19T03:01:13.622856+0000","last_change":"2024-04-19T03:01:13.622856+0000","last_active":"2024-04-19T03:01:13.604133+0000","last_peered":"2024-04-19T03:01:13.604133+0000","last_clean":"2024-04-19T03:01:13.604133+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:13.622856+0000","last_undegraded":"2024-04-19T03:01:13.622856+0000","last_fullsized":"2024-04-19T03:01:13.622856+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:33:45.550646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-04-19T03:01:14.633289+0000","last_change":"2024-04-19T03:01:14.633289+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.633289+0000","last_undegraded":"2024-04-19T03:01:14.633289+0000","last_fullsized":"2024-04-19T03:01:14.633289+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:54:04.518505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T03:01:14.654389+0000","last_change":"2024-04-19T03:01:14.651004+0000","last_active":"2024-04-19T03:01:14.654389+0000","last_peered":"2024-04-19T03:01:14.654389+0000","last_clean":"2024-04-19T03:01:14.654389+0000","last_became_active":"2024-04-19T03:01:14.650635+0000","last_became_peered":"2024-04-19T03:01:14.650635+0000","last_unstale":"2024-04-19T03:01:14.654389+0000","last_undegraded":"2024-04-19T03:01:14.654389+0000","last_fullsized":"2024-04-19T03:01:14.654389+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:57:15.575819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-04-19T03:01:14.638921+0000","last_change":"2024-04-19T03:01:14.638921+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.638921+0000","last_undegraded":"2024-04-19T03:01:14.638921+0000","last_fullsized":"2024-04-19T03:01:14.638921+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:51:06.208551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T03:01:14.646112+0000","last_change":"2024-04-19T03:01:14.644582+0000","last_active":"2024-04-19T03:01:14.646112+0000","last_peered":"2024-04-19T03:01:14.646112+0000","last_clean":"2024-04-19T03:01:14.646112+0000","last_became_active":"2024-04-19T03:01:14.644101+0000","last_became_peered":"2024-04-19T03:01:14.644101+0000","last_unstale":"2024-04-19T03:01:14.646112+0000","last_undegraded":"2024-04-19T03:01:14.646112+0000","last_fullsized":"2024-04-19T03:01:14.646112+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:28:24.652864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-04-19T03:01:14.635506+0000","last_change":"2024-04-19T03:01:14.635506+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.635506+0000","last_undegraded":"2024-04-19T03:01:14.635506+0000","last_fullsized":"2024-04-19T03:01:14.635506+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:16:20.475837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T03:01:14.645341+0000","last_change":"2024-04-19T03:01:14.643840+0000","last_active":"2024-04-19T03:01:14.645341+0000","last_peered":"2024-04-19T03:01:14.645341+0000","last_clean":"2024-04-19T03:01:14.645341+0000","last_became_active":"2024-04-19T03:01:14.643503+0000","last_became_peered":"2024-04-19T03:01:14.643503+0000","last_unstale":"2024-04-19T03:01:14.645341+0000","last_undegraded":"2024-04-19T03:01:14.645341+0000","last_fullsized":"2024-04-19T03:01:14.645341+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:09:33.801275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T03:01:14.615919+0000","last_change":"2024-04-19T03:01:14.615919+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.615919+0000","last_undegraded":"2024-04-19T03:01:14.615919+0000","last_fullsized":"2024-04-19T03:01:14.615919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"14'157","reported_seq":210,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-19T03:01:13.623161+0000","last_change":"2024-04-19T03:01:07.538434+0000","last_active":"2024-04-19T03:01:13.623161+0000","last_peered":"2024-04-19T03:01:13.623161+0000","last_clean":"2024-04-19T03:01:13.623161+0000","last_became_active":"2024-04-19T03:01:07.537856+0000","last_became_peered":"2024-04-19T03:01:07.537856+0000","last_unstale":"2024-04-19T03:01:13.623161+0000","last_undegraded":"2024-04-19T03:01:13.623161+0000","last_fullsized":"2024-04-19T03:01:13.623161+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:06.516863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:06.516863+0000","last_clean_scrub_stamp":"2024-04-19T03:01:06.516863+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:36:46.386286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-19T03:01:13.623664+0000","last_change":"2024-04-19T03:01:10.602869+0000","last_active":"2024-04-19T03:01:13.623664+0000","last_peered":"2024-04-19T03:01:13.623664+0000","last_clean":"2024-04-19T03:01:13.623664+0000","last_became_active":"2024-04-19T03:01:10.601965+0000","last_became_peered":"2024-04-19T03:01:10.601965+0000","last_unstale":"2024-04-19T03:01:13.623664+0000","last_undegraded":"2024-04-19T03:01:13.623664+0000","last_fullsized":"2024-04-19T03:01:13.623664+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_clean_scrub_stamp":"2024-04-19T03:01:09.578660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:14:41.316871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-04-19T03:01:13.622079+0000","last_change":"2024-04-19T03:01:13.622079+0000","last_active":"2024-04-19T03:01:13.604133+0000","last_peered":"2024-04-19T03:01:13.604133+0000","last_clean":"2024-04-19T03:01:13.604133+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:13.622079+0000","last_undegraded":"2024-04-19T03:01:13.622079+0000","last_fullsized":"2024-04-19T03:01:13.622079+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:24:40.181164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-04-19T03:01:14.633873+0000","last_change":"2024-04-19T03:01:14.633873+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.633873+0000","last_undegraded":"2024-04-19T03:01:14.633873+0000","last_fullsized":"2024-04-19T03:01:14.633873+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:00:35.372657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-19T03:01:13.623112+0000","last_change":"2024-04-19T03:01:10.602194+0000","last_active":"2024-04-19T03:01:13.623112+0000","last_peered":"2024-04-19T03:01:13.623112+0000","last_clean":"2024-04-19T03:01:13.623112+0000","last_became_active":"2024-04-19T03:01:10.601381+0000","last_became_peered":"2024-04-19T03:01:10.601381+0000","last_unstale":"2024-04-19T03:01:13.623112+0000","last_undegraded":"2024-04-19T03:01:13.623112+0000","last_fullsized":"2024-04-19T03:01:13.623112+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_clean_scrub_stamp":"2024-04-19T03:01:09.578660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:42:26.594095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-04-19T03:01:13.622230+0000","last_change":"2024-04-19T03:01:13.622230+0000","last_active":"2024-04-19T03:01:13.604133+0000","last_peered":"2024-04-19T03:01:13.604133+0000","last_clean":"2024-04-19T03:01:13.604133+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:13.622230+0000","last_undegraded":"2024-04-19T03:01:13.622230+0000","last_fullsized":"2024-04-19T03:01:13.622230+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:41:26.108674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-04-19T03:01:14.635678+0000","last_change":"2024-04-19T03:01:14.635678+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.635678+0000","last_undegraded":"2024-04-19T03:01:14.635678+0000","last_fullsized":"2024-04-19T03:01:14.635678+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:54:04.518505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-19T03:01:13.627044+0000","last_change":"2024-04-19T03:01:10.600207+0000","last_active":"2024-04-19T03:01:13.627044+0000","last_peered":"2024-04-19T03:01:13.627044+0000","last_clean":"2024-04-19T03:01:13.627044+0000","last_became_active":"2024-04-19T03:01:10.599209+0000","last_became_peered":"2024-04-19T03:01:10.599209+0000","last_unstale":"2024-04-19T03:01:13.627044+0000","last_undegraded":"2024-04-19T03:01:13.627044+0000","last_fullsized":"2024-04-19T03:01:13.627044+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_clean_scrub_stamp":"2024-04-19T03:01:09.578660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:30:25.748140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T03:01:14.650674+0000","last_change":"2024-04-19T03:01:14.649068+0000","last_active":"2024-04-19T03:01:14.650674+0000","last_peered":"2024-04-19T03:01:14.650674+0000","last_clean":"2024-04-19T03:01:14.650674+0000","last_became_active":"2024-04-19T03:01:14.648082+0000","last_became_peered":"2024-04-19T03:01:14.648082+0000","last_unstale":"2024-04-19T03:01:14.650674+0000","last_undegraded":"2024-04-19T03:01:14.650674+0000","last_fullsized":"2024-04-19T03:01:14.650674+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:30:14.489117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T03:01:14.615919+0000","last_change":"2024-04-19T03:01:14.615919+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.615919+0000","last_undegraded":"2024-04-19T03:01:14.615919+0000","last_fullsized":"2024-04-19T03:01:14.615919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-19T03:01:13.623103+0000","last_change":"2024-04-19T03:01:10.601386+0000","last_active":"2024-04-19T03:01:13.623103+0000","last_peered":"2024-04-19T03:01:13.623103+0000","last_clean":"2024-04-19T03:01:13.623103+0000","last_became_active":"2024-04-19T03:01:10.600732+0000","last_became_peered":"2024-04-19T03:01:10.600732+0000","last_unstale":"2024-04-19T03:01:13.623103+0000","last_undegraded":"2024-04-19T03:01:13.623103+0000","last_fullsized":"2024-04-19T03:01:13.623103+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_clean_scrub_stamp":"2024-04-19T03:01:09.578660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:34:53.138338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T03:01:14.654457+0000","last_change":"2024-04-19T03:01:14.651363+0000","last_active":"2024-04-19T03:01:14.654457+0000","last_peered":"2024-04-19T03:01:14.654457+0000","last_clean":"2024-04-19T03:01:14.654457+0000","last_became_active":"2024-04-19T03:01:14.651020+0000","last_became_peered":"2024-04-19T03:01:14.651020+0000","last_unstale":"2024-04-19T03:01:14.654457+0000","last_undegraded":"2024-04-19T03:01:14.654457+0000","last_fullsized":"2024-04-19T03:01:14.654457+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:44:36.043345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T03:01:14.615919+0000","last_change":"2024-04-19T03:01:14.615919+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.615919+0000","last_undegraded":"2024-04-19T03:01:14.615919+0000","last_fullsized":"2024-04-19T03:01:14.615919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T03:01:14.659873+0000","last_change":"2024-04-19T03:01:14.651740+0000","last_active":"2024-04-19T03:01:14.659873+0000","last_peered":"2024-04-19T03:01:14.659873+0000","last_clean":"2024-04-19T03:01:14.659873+0000","last_became_active":"2024-04-19T03:01:14.651491+0000","last_became_peered":"2024-04-19T03:01:14.651491+0000","last_unstale":"2024-04-19T03:01:14.659873+0000","last_undegraded":"2024-04-19T03:01:14.659873+0000","last_fullsized":"2024-04-19T03:01:14.659873+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:42:15.864988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-19T03:01:13.627316+0000","last_change":"2024-04-19T03:01:10.601062+0000","last_active":"2024-04-19T03:01:13.627316+0000","last_peered":"2024-04-19T03:01:13.627316+0000","last_clean":"2024-04-19T03:01:13.627316+0000","last_became_active":"2024-04-19T03:01:10.600334+0000","last_became_peered":"2024-04-19T03:01:10.600334+0000","last_unstale":"2024-04-19T03:01:13.627316+0000","last_undegraded":"2024-04-19T03:01:13.627316+0000","last_fullsized":"2024-04-19T03:01:13.627316+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_clean_scrub_stamp":"2024-04-19T03:01:09.578660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:51:38.307752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-04-19T03:01:14.635161+0000","last_change":"2024-04-19T03:01:14.635161+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.635161+0000","last_undegraded":"2024-04-19T03:01:14.635161+0000","last_fullsized":"2024-04-19T03:01:14.635161+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:22:58.349159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-04-19T03:01:13.622643+0000","last_change":"2024-04-19T03:01:13.622643+0000","last_active":"2024-04-19T03:01:13.604133+0000","last_peered":"2024-04-19T03:01:13.604133+0000","last_clean":"2024-04-19T03:01:13.604133+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:13.622643+0000","last_undegraded":"2024-04-19T03:01:13.622643+0000","last_fullsized":"2024-04-19T03:01:13.622643+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:40:40.193720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-19T03:01:13.628856+0000","last_change":"2024-04-19T03:01:10.603139+0000","last_active":"2024-04-19T03:01:13.628856+0000","last_peered":"2024-04-19T03:01:13.628856+0000","last_clean":"2024-04-19T03:01:13.628856+0000","last_became_active":"2024-04-19T03:01:10.602397+0000","last_became_peered":"2024-04-19T03:01:10.602397+0000","last_unstale":"2024-04-19T03:01:13.628856+0000","last_undegraded":"2024-04-19T03:01:13.628856+0000","last_fullsized":"2024-04-19T03:01:13.628856+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_clean_scrub_stamp":"2024-04-19T03:01:09.578660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:36:00.072157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-04-19T03:01:14.634209+0000","last_change":"2024-04-19T03:01:14.634209+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.634209+0000","last_undegraded":"2024-04-19T03:01:14.634209+0000","last_fullsized":"2024-04-19T03:01:14.634209+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:39:54.289444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-04-19T03:01:13.622569+0000","last_change":"2024-04-19T03:01:13.622569+0000","last_active":"2024-04-19T03:01:13.604133+0000","last_peered":"2024-04-19T03:01:13.604133+0000","last_clean":"2024-04-19T03:01:13.604133+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:13.622569+0000","last_undegraded":"2024-04-19T03:01:13.622569+0000","last_fullsized":"2024-04-19T03:01:13.622569+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:28:14.128657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-19T03:01:13.628367+0000","last_change":"2024-04-19T03:01:10.599894+0000","last_active":"2024-04-19T03:01:13.628367+0000","last_peered":"2024-04-19T03:01:13.628367+0000","last_clean":"2024-04-19T03:01:13.628367+0000","last_became_active":"2024-04-19T03:01:10.599202+0000","last_became_peered":"2024-04-19T03:01:10.599202+0000","last_unstale":"2024-04-19T03:01:13.628367+0000","last_undegraded":"2024-04-19T03:01:13.628367+0000","last_fullsized":"2024-04-19T03:01:13.628367+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_clean_scrub_stamp":"2024-04-19T03:01:09.578660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:59:34.386302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T03:01:14.615919+0000","last_change":"2024-04-19T03:01:14.615919+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.615919+0000","last_undegraded":"2024-04-19T03:01:14.615919+0000","last_fullsized":"2024-04-19T03:01:14.615919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-04-19T03:01:13.622364+0000","last_change":"2024-04-19T03:01:13.622364+0000","last_active":"2024-04-19T03:01:13.604133+0000","last_peered":"2024-04-19T03:01:13.604133+0000","last_clean":"2024-04-19T03:01:13.604133+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:13.622364+0000","last_undegraded":"2024-04-19T03:01:13.622364+0000","last_fullsized":"2024-04-19T03:01:13.622364+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:32:41.909038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-19T03:01:13.624003+0000","last_change":"2024-04-19T03:01:10.602274+0000","last_active":"2024-04-19T03:01:13.624003+0000","last_peered":"2024-04-19T03:01:13.624003+0000","last_clean":"2024-04-19T03:01:13.624003+0000","last_became_active":"2024-04-19T03:01:10.601487+0000","last_became_peered":"2024-04-19T03:01:10.601487+0000","last_unstale":"2024-04-19T03:01:13.624003+0000","last_undegraded":"2024-04-19T03:01:13.624003+0000","last_fullsized":"2024-04-19T03:01:13.624003+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_clean_scrub_stamp":"2024-04-19T03:01:09.578660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:26:16.712446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-04-19T03:01:14.635200+0000","last_change":"2024-04-19T03:01:14.635200+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.635200+0000","last_undegraded":"2024-04-19T03:01:14.635200+0000","last_fullsized":"2024-04-19T03:01:14.635200+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:40:59.453079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-04-19T03:01:14.635874+0000","last_change":"2024-04-19T03:01:14.635874+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.635874+0000","last_undegraded":"2024-04-19T03:01:14.635874+0000","last_fullsized":"2024-04-19T03:01:14.635874+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:59:49.270245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T03:01:14.651985+0000","last_change":"2024-04-19T03:01:14.649577+0000","last_active":"2024-04-19T03:01:14.651985+0000","last_peered":"2024-04-19T03:01:14.651985+0000","last_clean":"2024-04-19T03:01:14.651985+0000","last_became_active":"2024-04-19T03:01:14.649284+0000","last_became_peered":"2024-04-19T03:01:14.649284+0000","last_unstale":"2024-04-19T03:01:14.651985+0000","last_undegraded":"2024-04-19T03:01:14.651985+0000","last_fullsized":"2024-04-19T03:01:14.651985+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:01:22.214742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T03:01:14.615919+0000","last_change":"2024-04-19T03:01:14.615919+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.615919+0000","last_undegraded":"2024-04-19T03:01:14.615919+0000","last_fullsized":"2024-04-19T03:01:14.615919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T03:01:14.650412+0000","last_change":"2024-04-19T03:01:14.648703+0000","last_active":"2024-04-19T03:01:14.650412+0000","last_peered":"2024-04-19T03:01:14.650412+0000","last_clean":"2024-04-19T03:01:14.650412+0000","last_became_active":"2024-04-19T03:01:14.648258+0000","last_became_peered":"2024-04-19T03:01:14.648258+0000","last_unstale":"2024-04-19T03:01:14.650412+0000","last_undegraded":"2024-04-19T03:01:14.650412+0000","last_fullsized":"2024-04-19T03:01:14.650412+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:30:35.593258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T03:01:14.659856+0000","last_change":"2024-04-19T03:01:14.651753+0000","last_active":"2024-04-19T03:01:14.659856+0000","last_peered":"2024-04-19T03:01:14.659856+0000","last_clean":"2024-04-19T03:01:14.659856+0000","last_became_active":"2024-04-19T03:01:14.651458+0000","last_became_peered":"2024-04-19T03:01:14.651458+0000","last_unstale":"2024-04-19T03:01:14.659856+0000","last_undegraded":"2024-04-19T03:01:14.659856+0000","last_fullsized":"2024-04-19T03:01:14.659856+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:58:28.669306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T03:01:14.615919+0000","last_change":"2024-04-19T03:01:14.615919+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.615919+0000","last_undegraded":"2024-04-19T03:01:14.615919+0000","last_fullsized":"2024-04-19T03:01:14.615919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-04-19T03:01:13.624713+0000","last_change":"2024-04-19T03:01:13.624713+0000","last_active":"2024-04-19T03:01:13.604133+0000","last_peered":"2024-04-19T03:01:13.604133+0000","last_clean":"2024-04-19T03:01:13.604133+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:13.624713+0000","last_undegraded":"2024-04-19T03:01:13.624713+0000","last_fullsized":"2024-04-19T03:01:13.624713+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:22:38.096801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T03:01:14.615919+0000","last_change":"2024-04-19T03:01:14.615919+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.615919+0000","last_undegraded":"2024-04-19T03:01:14.615919+0000","last_fullsized":"2024-04-19T03:01:14.615919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-04-19T03:01:14.631624+0000","last_change":"2024-04-19T03:01:14.631624+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.631624+0000","last_undegraded":"2024-04-19T03:01:14.631624+0000","last_fullsized":"2024-04-19T03:01:14.631624+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:40:53.477682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-04-19T03:01:13.622719+0000","last_change":"2024-04-19T03:01:13.622719+0000","last_active":"2024-04-19T03:01:13.604133+0000","last_peered":"2024-04-19T03:01:13.604133+0000","last_clean":"2024-04-19T03:01:13.604133+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:13.622719+0000","last_undegraded":"2024-04-19T03:01:13.622719+0000","last_fullsized":"2024-04-19T03:01:13.622719+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:05:36.752017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T03:01:14.615919+0000","last_change":"2024-04-19T03:01:14.615919+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.615919+0000","last_undegraded":"2024-04-19T03:01:14.615919+0000","last_fullsized":"2024-04-19T03:01:14.615919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-04-19T03:01:13.624540+0000","last_change":"2024-04-19T03:01:13.624540+0000","last_active":"2024-04-19T03:01:13.604133+0000","last_peered":"2024-04-19T03:01:13.604133+0000","last_clean":"2024-04-19T03:01:13.604133+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:13.624540+0000","last_undegraded":"2024-04-19T03:01:13.624540+0000","last_fullsized":"2024-04-19T03:01:13.624540+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:56:15.348940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-04-19T03:01:14.637577+0000","last_change":"2024-04-19T03:01:14.637577+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.637577+0000","last_undegraded":"2024-04-19T03:01:14.637577+0000","last_fullsized":"2024-04-19T03:01:14.637577+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:10:56.732208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T03:01:14.652127+0000","last_change":"2024-04-19T03:01:14.651050+0000","last_active":"2024-04-19T03:01:14.652127+0000","last_peered":"2024-04-19T03:01:14.652127+0000","last_clean":"2024-04-19T03:01:14.652127+0000","last_became_active":"2024-04-19T03:01:14.650639+0000","last_became_peered":"2024-04-19T03:01:14.650639+0000","last_unstale":"2024-04-19T03:01:14.652127+0000","last_undegraded":"2024-04-19T03:01:14.652127+0000","last_fullsized":"2024-04-19T03:01:14.652127+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:41:49.783896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-04-19T03:01:14.636855+0000","last_change":"2024-04-19T03:01:14.636855+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.636855+0000","last_undegraded":"2024-04-19T03:01:14.636855+0000","last_fullsized":"2024-04-19T03:01:14.636855+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:36:36.363535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T03:01:14.650442+0000","last_change":"2024-04-19T03:01:14.648823+0000","last_active":"2024-04-19T03:01:14.650442+0000","last_peered":"2024-04-19T03:01:14.650442+0000","last_clean":"2024-04-19T03:01:14.650442+0000","last_became_active":"2024-04-19T03:01:14.648337+0000","last_became_peered":"2024-04-19T03:01:14.648337+0000","last_unstale":"2024-04-19T03:01:14.650442+0000","last_undegraded":"2024-04-19T03:01:14.650442+0000","last_fullsized":"2024-04-19T03:01:14.650442+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:08:46.250118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-04-19T03:01:14.637651+0000","last_change":"2024-04-19T03:01:14.637651+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.637651+0000","last_undegraded":"2024-04-19T03:01:14.637651+0000","last_fullsized":"2024-04-19T03:01:14.637651+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:56:44.307812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T03:01:14.654356+0000","last_change":"2024-04-19T03:01:14.651049+0000","last_active":"2024-04-19T03:01:14.654356+0000","last_peered":"2024-04-19T03:01:14.654356+0000","last_clean":"2024-04-19T03:01:14.654356+0000","last_became_active":"2024-04-19T03:01:14.650646+0000","last_became_peered":"2024-04-19T03:01:14.650646+0000","last_unstale":"2024-04-19T03:01:14.654356+0000","last_undegraded":"2024-04-19T03:01:14.654356+0000","last_fullsized":"2024-04-19T03:01:14.654356+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:33:59.716591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-04-19T03:01:14.633087+0000","last_change":"2024-04-19T03:01:14.633087+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.633087+0000","last_undegraded":"2024-04-19T03:01:14.633087+0000","last_fullsized":"2024-04-19T03:01:14.633087+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:13:06.902769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T03:01:14.650679+0000","last_change":"2024-04-19T03:01:14.649277+0000","last_active":"2024-04-19T03:01:14.650679+0000","last_peered":"2024-04-19T03:01:14.650679+0000","last_clean":"2024-04-19T03:01:14.650679+0000","last_became_active":"2024-04-19T03:01:14.648614+0000","last_became_peered":"2024-04-19T03:01:14.648614+0000","last_unstale":"2024-04-19T03:01:14.650679+0000","last_undegraded":"2024-04-19T03:01:14.650679+0000","last_fullsized":"2024-04-19T03:01:14.650679+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:34:05.922324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-04-19T03:01:14.630820+0000","last_change":"2024-04-19T03:01:14.630820+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.630820+0000","last_undegraded":"2024-04-19T03:01:14.630820+0000","last_fullsized":"2024-04-19T03:01:14.630820+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:14:57.922917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-04-19T03:01:13.624316+0000","last_change":"2024-04-19T03:01:13.624316+0000","last_active":"2024-04-19T03:01:13.604133+0000","last_peered":"2024-04-19T03:01:13.604133+0000","last_clean":"2024-04-19T03:01:13.604133+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:13.624316+0000","last_undegraded":"2024-04-19T03:01:13.624316+0000","last_fullsized":"2024-04-19T03:01:13.624316+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:56:05.481089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-04-19T03:01:14.633427+0000","last_change":"2024-04-19T03:01:14.633427+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.633427+0000","last_undegraded":"2024-04-19T03:01:14.633427+0000","last_fullsized":"2024-04-19T03:01:14.633427+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:13:26.030579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-04-19T03:01:13.626135+0000","last_change":"2024-04-19T03:01:13.626135+0000","last_active":"2024-04-19T03:01:13.604133+0000","last_peered":"2024-04-19T03:01:13.604133+0000","last_clean":"2024-04-19T03:01:13.604133+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:13.626135+0000","last_undegraded":"2024-04-19T03:01:13.626135+0000","last_fullsized":"2024-04-19T03:01:13.626135+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:09:04.022991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":92,"acting":92,"num_store_stats":2},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":14482,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":10,"seq":42949672967,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31332,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340508,"statfs":{"total":96636764160,"available":96604680192,"internally_reserved":0,"allocated":221184,"data_stored":642541,"data_compressed":7241,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55800000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71699999999999997}]}]},{"osd":1,"up_from":10,"seq":42949672966,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31324,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340516,"statfs":{"total":96636764160,"available":96604688384,"internally_reserved":0,"allocated":212992,"data_stored":638003,"data_compressed":7241,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67200000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64400000000000002}]}]},{"osd":0,"up_from":9,"seq":38654705669,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31256,"kb_used_data":136,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340584,"statfs":{"total":96636764160,"available":96604758016,"internally_reserved":0,"allocated":139264,"data_stored":39817,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64700000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":7241,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":7241,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-19T03:01:18.021 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-19T03:01:18.369 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-19T03:01:18.372 INFO:teuthology.orchestra.run.smithi096.stderr:dumped all 2024-04-19T03:01:18.383 INFO:teuthology.orchestra.run.smithi096.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2024-04-19T03:01:17.943902+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":174,"acting":174,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":38,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":93912,"kb_used_data":560,"kb_used_omap":4,"kb_used_meta":93307,"kb_avail":283021608,"statfs":{"total":289910292480,"available":289814126592,"internally_reserved":0,"allocated":573440,"data_stored":1320361,"data_compressed":14482,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":4782,"internal_metadata":95546706},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.326899"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-04-19T03:01:14.636530+0000","last_change":"2024-04-19T03:01:14.636530+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.636530+0000","last_undegraded":"2024-04-19T03:01:14.636530+0000","last_fullsized":"2024-04-19T03:01:14.636530+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:13:26.030579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-04-19T03:01:14.638657+0000","last_change":"2024-04-19T03:01:14.638657+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.638657+0000","last_undegraded":"2024-04-19T03:01:14.638657+0000","last_fullsized":"2024-04-19T03:01:14.638657+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:48:13.389356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-04-19T03:01:14.641392+0000","last_change":"2024-04-19T03:01:14.641392+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.641392+0000","last_undegraded":"2024-04-19T03:01:14.641392+0000","last_fullsized":"2024-04-19T03:01:14.641392+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:35:19.436344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-04-19T03:01:14.638667+0000","last_change":"2024-04-19T03:01:14.638667+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.638667+0000","last_undegraded":"2024-04-19T03:01:14.638667+0000","last_fullsized":"2024-04-19T03:01:14.638667+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:30:22.360053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-04-19T03:01:14.631489+0000","last_change":"2024-04-19T03:01:14.631489+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.631489+0000","last_undegraded":"2024-04-19T03:01:14.631489+0000","last_fullsized":"2024-04-19T03:01:14.631489+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:31:51.982582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-04-19T03:01:14.638578+0000","last_change":"2024-04-19T03:01:14.638578+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.638578+0000","last_undegraded":"2024-04-19T03:01:14.638578+0000","last_fullsized":"2024-04-19T03:01:14.638578+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:22:58.349159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-04-19T03:01:14.636323+0000","last_change":"2024-04-19T03:01:14.636323+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.636323+0000","last_undegraded":"2024-04-19T03:01:14.636323+0000","last_fullsized":"2024-04-19T03:01:14.636323+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:48:13.389356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-04-19T03:01:14.640018+0000","last_change":"2024-04-19T03:01:14.640018+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.640018+0000","last_undegraded":"2024-04-19T03:01:14.640018+0000","last_fullsized":"2024-04-19T03:01:14.640018+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:09:23.427311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T03:01:14.615919+0000","last_change":"2024-04-19T03:01:14.615919+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.615919+0000","last_undegraded":"2024-04-19T03:01:14.615919+0000","last_fullsized":"2024-04-19T03:01:14.615919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-04-19T03:01:14.637573+0000","last_change":"2024-04-19T03:01:14.637573+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.637573+0000","last_undegraded":"2024-04-19T03:01:14.637573+0000","last_fullsized":"2024-04-19T03:01:14.637573+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:10:21.967941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-04-19T03:01:14.641049+0000","last_change":"2024-04-19T03:01:14.641049+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.641049+0000","last_undegraded":"2024-04-19T03:01:14.641049+0000","last_fullsized":"2024-04-19T03:01:14.641049+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:10:56.732208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-04-19T03:01:14.638345+0000","last_change":"2024-04-19T03:01:14.638345+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.638345+0000","last_undegraded":"2024-04-19T03:01:14.638345+0000","last_fullsized":"2024-04-19T03:01:14.638345+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:09:23.427311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-04-19T03:01:14.636683+0000","last_change":"2024-04-19T03:01:14.636683+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.636683+0000","last_undegraded":"2024-04-19T03:01:14.636683+0000","last_fullsized":"2024-04-19T03:01:14.636683+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:07:57.843767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-04-19T03:01:14.636154+0000","last_change":"2024-04-19T03:01:14.636154+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.636154+0000","last_undegraded":"2024-04-19T03:01:14.636154+0000","last_fullsized":"2024-04-19T03:01:14.636154+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:21:36.129346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-04-19T03:01:14.634523+0000","last_change":"2024-04-19T03:01:14.634523+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.634523+0000","last_undegraded":"2024-04-19T03:01:14.634523+0000","last_fullsized":"2024-04-19T03:01:14.634523+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:01:54.253963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-04-19T03:01:14.638699+0000","last_change":"2024-04-19T03:01:14.638699+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.638699+0000","last_undegraded":"2024-04-19T03:01:14.638699+0000","last_fullsized":"2024-04-19T03:01:14.638699+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:40:59.453079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T03:01:14.615919+0000","last_change":"2024-04-19T03:01:14.615919+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.615919+0000","last_undegraded":"2024-04-19T03:01:14.615919+0000","last_fullsized":"2024-04-19T03:01:14.615919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-04-19T03:01:14.632656+0000","last_change":"2024-04-19T03:01:14.632656+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.632656+0000","last_undegraded":"2024-04-19T03:01:14.632656+0000","last_fullsized":"2024-04-19T03:01:14.632656+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:40:20.790332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T03:01:14.615919+0000","last_change":"2024-04-19T03:01:14.615919+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.615919+0000","last_undegraded":"2024-04-19T03:01:14.615919+0000","last_fullsized":"2024-04-19T03:01:14.615919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-04-19T03:01:14.637003+0000","last_change":"2024-04-19T03:01:14.637003+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.637003+0000","last_undegraded":"2024-04-19T03:01:14.637003+0000","last_fullsized":"2024-04-19T03:01:14.637003+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:39:54.289444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-04-19T03:01:14.633108+0000","last_change":"2024-04-19T03:01:14.633108+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.633108+0000","last_undegraded":"2024-04-19T03:01:14.633108+0000","last_fullsized":"2024-04-19T03:01:14.633108+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:10:21.967941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-04-19T03:01:14.636810+0000","last_change":"2024-04-19T03:01:14.636810+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.636810+0000","last_undegraded":"2024-04-19T03:01:14.636810+0000","last_fullsized":"2024-04-19T03:01:14.636810+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:30:22.360053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T03:01:14.615919+0000","last_change":"2024-04-19T03:01:14.615919+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.615919+0000","last_undegraded":"2024-04-19T03:01:14.615919+0000","last_fullsized":"2024-04-19T03:01:14.615919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-04-19T03:01:14.638185+0000","last_change":"2024-04-19T03:01:14.638185+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.638185+0000","last_undegraded":"2024-04-19T03:01:14.638185+0000","last_fullsized":"2024-04-19T03:01:14.638185+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:37:35.950318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-04-19T03:01:14.634353+0000","last_change":"2024-04-19T03:01:14.634353+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.634353+0000","last_undegraded":"2024-04-19T03:01:14.634353+0000","last_fullsized":"2024-04-19T03:01:14.634353+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:56:44.307812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T03:01:14.615919+0000","last_change":"2024-04-19T03:01:14.615919+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.615919+0000","last_undegraded":"2024-04-19T03:01:14.615919+0000","last_fullsized":"2024-04-19T03:01:14.615919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-04-19T03:01:14.640726+0000","last_change":"2024-04-19T03:01:14.640726+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.640726+0000","last_undegraded":"2024-04-19T03:01:14.640726+0000","last_fullsized":"2024-04-19T03:01:14.640726+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:06:35.813797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-04-19T03:01:14.631256+0000","last_change":"2024-04-19T03:01:14.631256+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.631256+0000","last_undegraded":"2024-04-19T03:01:14.631256+0000","last_fullsized":"2024-04-19T03:01:14.631256+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:50:06.490191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T03:01:14.615919+0000","last_change":"2024-04-19T03:01:14.615919+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.615919+0000","last_undegraded":"2024-04-19T03:01:14.615919+0000","last_fullsized":"2024-04-19T03:01:14.615919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-04-19T03:01:14.630855+0000","last_change":"2024-04-19T03:01:14.630855+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.630855+0000","last_undegraded":"2024-04-19T03:01:14.630855+0000","last_fullsized":"2024-04-19T03:01:14.630855+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:10:42.079294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T03:01:14.615919+0000","last_change":"2024-04-19T03:01:14.615919+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.615919+0000","last_undegraded":"2024-04-19T03:01:14.615919+0000","last_fullsized":"2024-04-19T03:01:14.615919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-04-19T03:01:14.637332+0000","last_change":"2024-04-19T03:01:14.637332+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.637332+0000","last_undegraded":"2024-04-19T03:01:14.637332+0000","last_fullsized":"2024-04-19T03:01:14.637332+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:54:54.463918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-04-19T03:01:14.635649+0000","last_change":"2024-04-19T03:01:14.635649+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.635649+0000","last_undegraded":"2024-04-19T03:01:14.635649+0000","last_fullsized":"2024-04-19T03:01:14.635649+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:55:34.102680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T03:01:14.654351+0000","last_change":"2024-04-19T03:01:14.651050+0000","last_active":"2024-04-19T03:01:14.654351+0000","last_peered":"2024-04-19T03:01:14.654351+0000","last_clean":"2024-04-19T03:01:14.654351+0000","last_became_active":"2024-04-19T03:01:14.650679+0000","last_became_peered":"2024-04-19T03:01:14.650679+0000","last_unstale":"2024-04-19T03:01:14.654351+0000","last_undegraded":"2024-04-19T03:01:14.654351+0000","last_fullsized":"2024-04-19T03:01:14.654351+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:37:03.684394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-04-19T03:01:14.636520+0000","last_change":"2024-04-19T03:01:14.636520+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.636520+0000","last_undegraded":"2024-04-19T03:01:14.636520+0000","last_fullsized":"2024-04-19T03:01:14.636520+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:40:12.179703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-04-19T03:01:13.624457+0000","last_change":"2024-04-19T03:01:13.624457+0000","last_active":"2024-04-19T03:01:13.604133+0000","last_peered":"2024-04-19T03:01:13.604133+0000","last_clean":"2024-04-19T03:01:13.604133+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:13.624457+0000","last_undegraded":"2024-04-19T03:01:13.624457+0000","last_fullsized":"2024-04-19T03:01:13.624457+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:40:53.463388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T03:01:14.615919+0000","last_change":"2024-04-19T03:01:14.615919+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.615919+0000","last_undegraded":"2024-04-19T03:01:14.615919+0000","last_fullsized":"2024-04-19T03:01:14.615919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T03:01:14.650574+0000","last_change":"2024-04-19T03:01:14.649074+0000","last_active":"2024-04-19T03:01:14.650574+0000","last_peered":"2024-04-19T03:01:14.650574+0000","last_clean":"2024-04-19T03:01:14.650574+0000","last_became_active":"2024-04-19T03:01:14.648217+0000","last_became_peered":"2024-04-19T03:01:14.648217+0000","last_unstale":"2024-04-19T03:01:14.650574+0000","last_undegraded":"2024-04-19T03:01:14.650574+0000","last_fullsized":"2024-04-19T03:01:14.650574+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:57:05.238043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T03:01:14.615919+0000","last_change":"2024-04-19T03:01:14.615919+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.615919+0000","last_undegraded":"2024-04-19T03:01:14.615919+0000","last_fullsized":"2024-04-19T03:01:14.615919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T03:01:14.651960+0000","last_change":"2024-04-19T03:01:14.649044+0000","last_active":"2024-04-19T03:01:14.651960+0000","last_peered":"2024-04-19T03:01:14.651960+0000","last_clean":"2024-04-19T03:01:14.651960+0000","last_became_active":"2024-04-19T03:01:14.648859+0000","last_became_peered":"2024-04-19T03:01:14.648859+0000","last_unstale":"2024-04-19T03:01:14.651960+0000","last_undegraded":"2024-04-19T03:01:14.651960+0000","last_fullsized":"2024-04-19T03:01:14.651960+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:30:45.925657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T03:01:14.652044+0000","last_change":"2024-04-19T03:01:14.649839+0000","last_active":"2024-04-19T03:01:14.652044+0000","last_peered":"2024-04-19T03:01:14.652044+0000","last_clean":"2024-04-19T03:01:14.652044+0000","last_became_active":"2024-04-19T03:01:14.649571+0000","last_became_peered":"2024-04-19T03:01:14.649571+0000","last_unstale":"2024-04-19T03:01:14.652044+0000","last_undegraded":"2024-04-19T03:01:14.652044+0000","last_fullsized":"2024-04-19T03:01:14.652044+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:03:57.839660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-04-19T03:01:14.634133+0000","last_change":"2024-04-19T03:01:14.634133+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.634133+0000","last_undegraded":"2024-04-19T03:01:14.634133+0000","last_fullsized":"2024-04-19T03:01:14.634133+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:54:54.463918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T03:01:14.646089+0000","last_change":"2024-04-19T03:01:14.645075+0000","last_active":"2024-04-19T03:01:14.646089+0000","last_peered":"2024-04-19T03:01:14.646089+0000","last_clean":"2024-04-19T03:01:14.646089+0000","last_became_active":"2024-04-19T03:01:14.644790+0000","last_became_peered":"2024-04-19T03:01:14.644790+0000","last_unstale":"2024-04-19T03:01:14.646089+0000","last_undegraded":"2024-04-19T03:01:14.646089+0000","last_fullsized":"2024-04-19T03:01:14.646089+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:55:15.035769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-04-19T03:01:14.637118+0000","last_change":"2024-04-19T03:01:14.637118+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.637118+0000","last_undegraded":"2024-04-19T03:01:14.637118+0000","last_fullsized":"2024-04-19T03:01:14.637118+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:13:06.902769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T03:01:14.652024+0000","last_change":"2024-04-19T03:01:14.649826+0000","last_active":"2024-04-19T03:01:14.652024+0000","last_peered":"2024-04-19T03:01:14.652024+0000","last_clean":"2024-04-19T03:01:14.652024+0000","last_became_active":"2024-04-19T03:01:14.649565+0000","last_became_peered":"2024-04-19T03:01:14.649565+0000","last_unstale":"2024-04-19T03:01:14.652024+0000","last_undegraded":"2024-04-19T03:01:14.652024+0000","last_fullsized":"2024-04-19T03:01:14.652024+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:36:00.962931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-04-19T03:01:14.635329+0000","last_change":"2024-04-19T03:01:14.635329+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.635329+0000","last_undegraded":"2024-04-19T03:01:14.635329+0000","last_fullsized":"2024-04-19T03:01:14.635329+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:50:06.490191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T03:01:14.654439+0000","last_change":"2024-04-19T03:01:14.651201+0000","last_active":"2024-04-19T03:01:14.654439+0000","last_peered":"2024-04-19T03:01:14.654439+0000","last_clean":"2024-04-19T03:01:14.654439+0000","last_became_active":"2024-04-19T03:01:14.650942+0000","last_became_peered":"2024-04-19T03:01:14.650942+0000","last_unstale":"2024-04-19T03:01:14.654439+0000","last_undegraded":"2024-04-19T03:01:14.654439+0000","last_fullsized":"2024-04-19T03:01:14.654439+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:02:13.190917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T03:01:14.615919+0000","last_change":"2024-04-19T03:01:14.615919+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.615919+0000","last_undegraded":"2024-04-19T03:01:14.615919+0000","last_fullsized":"2024-04-19T03:01:14.615919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-04-19T03:01:13.622856+0000","last_change":"2024-04-19T03:01:13.622856+0000","last_active":"2024-04-19T03:01:13.604133+0000","last_peered":"2024-04-19T03:01:13.604133+0000","last_clean":"2024-04-19T03:01:13.604133+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:13.622856+0000","last_undegraded":"2024-04-19T03:01:13.622856+0000","last_fullsized":"2024-04-19T03:01:13.622856+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:33:45.550646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-04-19T03:01:14.633289+0000","last_change":"2024-04-19T03:01:14.633289+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.633289+0000","last_undegraded":"2024-04-19T03:01:14.633289+0000","last_fullsized":"2024-04-19T03:01:14.633289+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:54:04.518505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T03:01:14.654389+0000","last_change":"2024-04-19T03:01:14.651004+0000","last_active":"2024-04-19T03:01:14.654389+0000","last_peered":"2024-04-19T03:01:14.654389+0000","last_clean":"2024-04-19T03:01:14.654389+0000","last_became_active":"2024-04-19T03:01:14.650635+0000","last_became_peered":"2024-04-19T03:01:14.650635+0000","last_unstale":"2024-04-19T03:01:14.654389+0000","last_undegraded":"2024-04-19T03:01:14.654389+0000","last_fullsized":"2024-04-19T03:01:14.654389+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:57:15.575819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-04-19T03:01:14.638921+0000","last_change":"2024-04-19T03:01:14.638921+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.638921+0000","last_undegraded":"2024-04-19T03:01:14.638921+0000","last_fullsized":"2024-04-19T03:01:14.638921+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:51:06.208551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T03:01:14.646112+0000","last_change":"2024-04-19T03:01:14.644582+0000","last_active":"2024-04-19T03:01:14.646112+0000","last_peered":"2024-04-19T03:01:14.646112+0000","last_clean":"2024-04-19T03:01:14.646112+0000","last_became_active":"2024-04-19T03:01:14.644101+0000","last_became_peered":"2024-04-19T03:01:14.644101+0000","last_unstale":"2024-04-19T03:01:14.646112+0000","last_undegraded":"2024-04-19T03:01:14.646112+0000","last_fullsized":"2024-04-19T03:01:14.646112+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:28:24.652864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-04-19T03:01:14.635506+0000","last_change":"2024-04-19T03:01:14.635506+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.635506+0000","last_undegraded":"2024-04-19T03:01:14.635506+0000","last_fullsized":"2024-04-19T03:01:14.635506+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:16:20.475837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T03:01:14.645341+0000","last_change":"2024-04-19T03:01:14.643840+0000","last_active":"2024-04-19T03:01:14.645341+0000","last_peered":"2024-04-19T03:01:14.645341+0000","last_clean":"2024-04-19T03:01:14.645341+0000","last_became_active":"2024-04-19T03:01:14.643503+0000","last_became_peered":"2024-04-19T03:01:14.643503+0000","last_unstale":"2024-04-19T03:01:14.645341+0000","last_undegraded":"2024-04-19T03:01:14.645341+0000","last_fullsized":"2024-04-19T03:01:14.645341+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:09:33.801275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T03:01:14.615919+0000","last_change":"2024-04-19T03:01:14.615919+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.615919+0000","last_undegraded":"2024-04-19T03:01:14.615919+0000","last_fullsized":"2024-04-19T03:01:14.615919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"14'157","reported_seq":210,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-19T03:01:13.623161+0000","last_change":"2024-04-19T03:01:07.538434+0000","last_active":"2024-04-19T03:01:13.623161+0000","last_peered":"2024-04-19T03:01:13.623161+0000","last_clean":"2024-04-19T03:01:13.623161+0000","last_became_active":"2024-04-19T03:01:07.537856+0000","last_became_peered":"2024-04-19T03:01:07.537856+0000","last_unstale":"2024-04-19T03:01:13.623161+0000","last_undegraded":"2024-04-19T03:01:13.623161+0000","last_fullsized":"2024-04-19T03:01:13.623161+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:06.516863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:06.516863+0000","last_clean_scrub_stamp":"2024-04-19T03:01:06.516863+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:36:46.386286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-19T03:01:13.623664+0000","last_change":"2024-04-19T03:01:10.602869+0000","last_active":"2024-04-19T03:01:13.623664+0000","last_peered":"2024-04-19T03:01:13.623664+0000","last_clean":"2024-04-19T03:01:13.623664+0000","last_became_active":"2024-04-19T03:01:10.601965+0000","last_became_peered":"2024-04-19T03:01:10.601965+0000","last_unstale":"2024-04-19T03:01:13.623664+0000","last_undegraded":"2024-04-19T03:01:13.623664+0000","last_fullsized":"2024-04-19T03:01:13.623664+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_clean_scrub_stamp":"2024-04-19T03:01:09.578660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:14:41.316871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-04-19T03:01:13.622079+0000","last_change":"2024-04-19T03:01:13.622079+0000","last_active":"2024-04-19T03:01:13.604133+0000","last_peered":"2024-04-19T03:01:13.604133+0000","last_clean":"2024-04-19T03:01:13.604133+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:13.622079+0000","last_undegraded":"2024-04-19T03:01:13.622079+0000","last_fullsized":"2024-04-19T03:01:13.622079+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:24:40.181164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-04-19T03:01:14.633873+0000","last_change":"2024-04-19T03:01:14.633873+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.633873+0000","last_undegraded":"2024-04-19T03:01:14.633873+0000","last_fullsized":"2024-04-19T03:01:14.633873+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:00:35.372657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-19T03:01:13.623112+0000","last_change":"2024-04-19T03:01:10.602194+0000","last_active":"2024-04-19T03:01:13.623112+0000","last_peered":"2024-04-19T03:01:13.623112+0000","last_clean":"2024-04-19T03:01:13.623112+0000","last_became_active":"2024-04-19T03:01:10.601381+0000","last_became_peered":"2024-04-19T03:01:10.601381+0000","last_unstale":"2024-04-19T03:01:13.623112+0000","last_undegraded":"2024-04-19T03:01:13.623112+0000","last_fullsized":"2024-04-19T03:01:13.623112+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_clean_scrub_stamp":"2024-04-19T03:01:09.578660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:42:26.594095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-04-19T03:01:13.622230+0000","last_change":"2024-04-19T03:01:13.622230+0000","last_active":"2024-04-19T03:01:13.604133+0000","last_peered":"2024-04-19T03:01:13.604133+0000","last_clean":"2024-04-19T03:01:13.604133+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:13.622230+0000","last_undegraded":"2024-04-19T03:01:13.622230+0000","last_fullsized":"2024-04-19T03:01:13.622230+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:41:26.108674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-04-19T03:01:14.635678+0000","last_change":"2024-04-19T03:01:14.635678+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.635678+0000","last_undegraded":"2024-04-19T03:01:14.635678+0000","last_fullsized":"2024-04-19T03:01:14.635678+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:54:04.518505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-19T03:01:13.627044+0000","last_change":"2024-04-19T03:01:10.600207+0000","last_active":"2024-04-19T03:01:13.627044+0000","last_peered":"2024-04-19T03:01:13.627044+0000","last_clean":"2024-04-19T03:01:13.627044+0000","last_became_active":"2024-04-19T03:01:10.599209+0000","last_became_peered":"2024-04-19T03:01:10.599209+0000","last_unstale":"2024-04-19T03:01:13.627044+0000","last_undegraded":"2024-04-19T03:01:13.627044+0000","last_fullsized":"2024-04-19T03:01:13.627044+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_clean_scrub_stamp":"2024-04-19T03:01:09.578660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:30:25.748140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T03:01:14.650674+0000","last_change":"2024-04-19T03:01:14.649068+0000","last_active":"2024-04-19T03:01:14.650674+0000","last_peered":"2024-04-19T03:01:14.650674+0000","last_clean":"2024-04-19T03:01:14.650674+0000","last_became_active":"2024-04-19T03:01:14.648082+0000","last_became_peered":"2024-04-19T03:01:14.648082+0000","last_unstale":"2024-04-19T03:01:14.650674+0000","last_undegraded":"2024-04-19T03:01:14.650674+0000","last_fullsized":"2024-04-19T03:01:14.650674+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:30:14.489117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T03:01:14.615919+0000","last_change":"2024-04-19T03:01:14.615919+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.615919+0000","last_undegraded":"2024-04-19T03:01:14.615919+0000","last_fullsized":"2024-04-19T03:01:14.615919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-19T03:01:13.623103+0000","last_change":"2024-04-19T03:01:10.601386+0000","last_active":"2024-04-19T03:01:13.623103+0000","last_peered":"2024-04-19T03:01:13.623103+0000","last_clean":"2024-04-19T03:01:13.623103+0000","last_became_active":"2024-04-19T03:01:10.600732+0000","last_became_peered":"2024-04-19T03:01:10.600732+0000","last_unstale":"2024-04-19T03:01:13.623103+0000","last_undegraded":"2024-04-19T03:01:13.623103+0000","last_fullsized":"2024-04-19T03:01:13.623103+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_clean_scrub_stamp":"2024-04-19T03:01:09.578660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:34:53.138338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T03:01:14.654457+0000","last_change":"2024-04-19T03:01:14.651363+0000","last_active":"2024-04-19T03:01:14.654457+0000","last_peered":"2024-04-19T03:01:14.654457+0000","last_clean":"2024-04-19T03:01:14.654457+0000","last_became_active":"2024-04-19T03:01:14.651020+0000","last_became_peered":"2024-04-19T03:01:14.651020+0000","last_unstale":"2024-04-19T03:01:14.654457+0000","last_undegraded":"2024-04-19T03:01:14.654457+0000","last_fullsized":"2024-04-19T03:01:14.654457+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:44:36.043345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T03:01:14.615919+0000","last_change":"2024-04-19T03:01:14.615919+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.615919+0000","last_undegraded":"2024-04-19T03:01:14.615919+0000","last_fullsized":"2024-04-19T03:01:14.615919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T03:01:14.659873+0000","last_change":"2024-04-19T03:01:14.651740+0000","last_active":"2024-04-19T03:01:14.659873+0000","last_peered":"2024-04-19T03:01:14.659873+0000","last_clean":"2024-04-19T03:01:14.659873+0000","last_became_active":"2024-04-19T03:01:14.651491+0000","last_became_peered":"2024-04-19T03:01:14.651491+0000","last_unstale":"2024-04-19T03:01:14.659873+0000","last_undegraded":"2024-04-19T03:01:14.659873+0000","last_fullsized":"2024-04-19T03:01:14.659873+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:42:15.864988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-19T03:01:13.627316+0000","last_change":"2024-04-19T03:01:10.601062+0000","last_active":"2024-04-19T03:01:13.627316+0000","last_peered":"2024-04-19T03:01:13.627316+0000","last_clean":"2024-04-19T03:01:13.627316+0000","last_became_active":"2024-04-19T03:01:10.600334+0000","last_became_peered":"2024-04-19T03:01:10.600334+0000","last_unstale":"2024-04-19T03:01:13.627316+0000","last_undegraded":"2024-04-19T03:01:13.627316+0000","last_fullsized":"2024-04-19T03:01:13.627316+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_clean_scrub_stamp":"2024-04-19T03:01:09.578660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:51:38.307752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-04-19T03:01:14.635161+0000","last_change":"2024-04-19T03:01:14.635161+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.635161+0000","last_undegraded":"2024-04-19T03:01:14.635161+0000","last_fullsized":"2024-04-19T03:01:14.635161+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:22:58.349159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-04-19T03:01:13.622643+0000","last_change":"2024-04-19T03:01:13.622643+0000","last_active":"2024-04-19T03:01:13.604133+0000","last_peered":"2024-04-19T03:01:13.604133+0000","last_clean":"2024-04-19T03:01:13.604133+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:13.622643+0000","last_undegraded":"2024-04-19T03:01:13.622643+0000","last_fullsized":"2024-04-19T03:01:13.622643+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:40:40.193720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-19T03:01:13.628856+0000","last_change":"2024-04-19T03:01:10.603139+0000","last_active":"2024-04-19T03:01:13.628856+0000","last_peered":"2024-04-19T03:01:13.628856+0000","last_clean":"2024-04-19T03:01:13.628856+0000","last_became_active":"2024-04-19T03:01:10.602397+0000","last_became_peered":"2024-04-19T03:01:10.602397+0000","last_unstale":"2024-04-19T03:01:13.628856+0000","last_undegraded":"2024-04-19T03:01:13.628856+0000","last_fullsized":"2024-04-19T03:01:13.628856+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_clean_scrub_stamp":"2024-04-19T03:01:09.578660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:36:00.072157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-04-19T03:01:14.634209+0000","last_change":"2024-04-19T03:01:14.634209+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.634209+0000","last_undegraded":"2024-04-19T03:01:14.634209+0000","last_fullsized":"2024-04-19T03:01:14.634209+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:39:54.289444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-04-19T03:01:13.622569+0000","last_change":"2024-04-19T03:01:13.622569+0000","last_active":"2024-04-19T03:01:13.604133+0000","last_peered":"2024-04-19T03:01:13.604133+0000","last_clean":"2024-04-19T03:01:13.604133+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:13.622569+0000","last_undegraded":"2024-04-19T03:01:13.622569+0000","last_fullsized":"2024-04-19T03:01:13.622569+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:28:14.128657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-19T03:01:13.628367+0000","last_change":"2024-04-19T03:01:10.599894+0000","last_active":"2024-04-19T03:01:13.628367+0000","last_peered":"2024-04-19T03:01:13.628367+0000","last_clean":"2024-04-19T03:01:13.628367+0000","last_became_active":"2024-04-19T03:01:10.599202+0000","last_became_peered":"2024-04-19T03:01:10.599202+0000","last_unstale":"2024-04-19T03:01:13.628367+0000","last_undegraded":"2024-04-19T03:01:13.628367+0000","last_fullsized":"2024-04-19T03:01:13.628367+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_clean_scrub_stamp":"2024-04-19T03:01:09.578660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:59:34.386302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T03:01:14.615919+0000","last_change":"2024-04-19T03:01:14.615919+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.615919+0000","last_undegraded":"2024-04-19T03:01:14.615919+0000","last_fullsized":"2024-04-19T03:01:14.615919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-04-19T03:01:13.622364+0000","last_change":"2024-04-19T03:01:13.622364+0000","last_active":"2024-04-19T03:01:13.604133+0000","last_peered":"2024-04-19T03:01:13.604133+0000","last_clean":"2024-04-19T03:01:13.604133+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:13.622364+0000","last_undegraded":"2024-04-19T03:01:13.622364+0000","last_fullsized":"2024-04-19T03:01:13.622364+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:32:41.909038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-19T03:01:13.624003+0000","last_change":"2024-04-19T03:01:10.602274+0000","last_active":"2024-04-19T03:01:13.624003+0000","last_peered":"2024-04-19T03:01:13.624003+0000","last_clean":"2024-04-19T03:01:13.624003+0000","last_became_active":"2024-04-19T03:01:10.601487+0000","last_became_peered":"2024-04-19T03:01:10.601487+0000","last_unstale":"2024-04-19T03:01:13.624003+0000","last_undegraded":"2024-04-19T03:01:13.624003+0000","last_fullsized":"2024-04-19T03:01:13.624003+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_clean_scrub_stamp":"2024-04-19T03:01:09.578660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:26:16.712446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-04-19T03:01:14.635200+0000","last_change":"2024-04-19T03:01:14.635200+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.635200+0000","last_undegraded":"2024-04-19T03:01:14.635200+0000","last_fullsized":"2024-04-19T03:01:14.635200+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:40:59.453079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-04-19T03:01:14.635874+0000","last_change":"2024-04-19T03:01:14.635874+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.635874+0000","last_undegraded":"2024-04-19T03:01:14.635874+0000","last_fullsized":"2024-04-19T03:01:14.635874+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:59:49.270245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T03:01:14.651985+0000","last_change":"2024-04-19T03:01:14.649577+0000","last_active":"2024-04-19T03:01:14.651985+0000","last_peered":"2024-04-19T03:01:14.651985+0000","last_clean":"2024-04-19T03:01:14.651985+0000","last_became_active":"2024-04-19T03:01:14.649284+0000","last_became_peered":"2024-04-19T03:01:14.649284+0000","last_unstale":"2024-04-19T03:01:14.651985+0000","last_undegraded":"2024-04-19T03:01:14.651985+0000","last_fullsized":"2024-04-19T03:01:14.651985+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:01:22.214742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T03:01:14.615919+0000","last_change":"2024-04-19T03:01:14.615919+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.615919+0000","last_undegraded":"2024-04-19T03:01:14.615919+0000","last_fullsized":"2024-04-19T03:01:14.615919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T03:01:14.650412+0000","last_change":"2024-04-19T03:01:14.648703+0000","last_active":"2024-04-19T03:01:14.650412+0000","last_peered":"2024-04-19T03:01:14.650412+0000","last_clean":"2024-04-19T03:01:14.650412+0000","last_became_active":"2024-04-19T03:01:14.648258+0000","last_became_peered":"2024-04-19T03:01:14.648258+0000","last_unstale":"2024-04-19T03:01:14.650412+0000","last_undegraded":"2024-04-19T03:01:14.650412+0000","last_fullsized":"2024-04-19T03:01:14.650412+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:30:35.593258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T03:01:14.659856+0000","last_change":"2024-04-19T03:01:14.651753+0000","last_active":"2024-04-19T03:01:14.659856+0000","last_peered":"2024-04-19T03:01:14.659856+0000","last_clean":"2024-04-19T03:01:14.659856+0000","last_became_active":"2024-04-19T03:01:14.651458+0000","last_became_peered":"2024-04-19T03:01:14.651458+0000","last_unstale":"2024-04-19T03:01:14.659856+0000","last_undegraded":"2024-04-19T03:01:14.659856+0000","last_fullsized":"2024-04-19T03:01:14.659856+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:58:28.669306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T03:01:14.615919+0000","last_change":"2024-04-19T03:01:14.615919+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.615919+0000","last_undegraded":"2024-04-19T03:01:14.615919+0000","last_fullsized":"2024-04-19T03:01:14.615919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-04-19T03:01:13.624713+0000","last_change":"2024-04-19T03:01:13.624713+0000","last_active":"2024-04-19T03:01:13.604133+0000","last_peered":"2024-04-19T03:01:13.604133+0000","last_clean":"2024-04-19T03:01:13.604133+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:13.624713+0000","last_undegraded":"2024-04-19T03:01:13.624713+0000","last_fullsized":"2024-04-19T03:01:13.624713+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:22:38.096801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T03:01:14.615919+0000","last_change":"2024-04-19T03:01:14.615919+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.615919+0000","last_undegraded":"2024-04-19T03:01:14.615919+0000","last_fullsized":"2024-04-19T03:01:14.615919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-04-19T03:01:14.631624+0000","last_change":"2024-04-19T03:01:14.631624+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.631624+0000","last_undegraded":"2024-04-19T03:01:14.631624+0000","last_fullsized":"2024-04-19T03:01:14.631624+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:40:53.477682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-04-19T03:01:13.622719+0000","last_change":"2024-04-19T03:01:13.622719+0000","last_active":"2024-04-19T03:01:13.604133+0000","last_peered":"2024-04-19T03:01:13.604133+0000","last_clean":"2024-04-19T03:01:13.604133+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:13.622719+0000","last_undegraded":"2024-04-19T03:01:13.622719+0000","last_fullsized":"2024-04-19T03:01:13.622719+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:05:36.752017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T03:01:14.615919+0000","last_change":"2024-04-19T03:01:14.615919+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.615919+0000","last_undegraded":"2024-04-19T03:01:14.615919+0000","last_fullsized":"2024-04-19T03:01:14.615919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-04-19T03:01:13.624540+0000","last_change":"2024-04-19T03:01:13.624540+0000","last_active":"2024-04-19T03:01:13.604133+0000","last_peered":"2024-04-19T03:01:13.604133+0000","last_clean":"2024-04-19T03:01:13.604133+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:13.624540+0000","last_undegraded":"2024-04-19T03:01:13.624540+0000","last_fullsized":"2024-04-19T03:01:13.624540+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:56:15.348940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-04-19T03:01:14.637577+0000","last_change":"2024-04-19T03:01:14.637577+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.637577+0000","last_undegraded":"2024-04-19T03:01:14.637577+0000","last_fullsized":"2024-04-19T03:01:14.637577+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:10:56.732208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T03:01:14.652127+0000","last_change":"2024-04-19T03:01:14.651050+0000","last_active":"2024-04-19T03:01:14.652127+0000","last_peered":"2024-04-19T03:01:14.652127+0000","last_clean":"2024-04-19T03:01:14.652127+0000","last_became_active":"2024-04-19T03:01:14.650639+0000","last_became_peered":"2024-04-19T03:01:14.650639+0000","last_unstale":"2024-04-19T03:01:14.652127+0000","last_undegraded":"2024-04-19T03:01:14.652127+0000","last_fullsized":"2024-04-19T03:01:14.652127+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:41:49.783896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-04-19T03:01:14.636855+0000","last_change":"2024-04-19T03:01:14.636855+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.636855+0000","last_undegraded":"2024-04-19T03:01:14.636855+0000","last_fullsized":"2024-04-19T03:01:14.636855+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:36:36.363535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T03:01:14.650442+0000","last_change":"2024-04-19T03:01:14.648823+0000","last_active":"2024-04-19T03:01:14.650442+0000","last_peered":"2024-04-19T03:01:14.650442+0000","last_clean":"2024-04-19T03:01:14.650442+0000","last_became_active":"2024-04-19T03:01:14.648337+0000","last_became_peered":"2024-04-19T03:01:14.648337+0000","last_unstale":"2024-04-19T03:01:14.650442+0000","last_undegraded":"2024-04-19T03:01:14.650442+0000","last_fullsized":"2024-04-19T03:01:14.650442+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:08:46.250118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-04-19T03:01:14.637651+0000","last_change":"2024-04-19T03:01:14.637651+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.637651+0000","last_undegraded":"2024-04-19T03:01:14.637651+0000","last_fullsized":"2024-04-19T03:01:14.637651+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:56:44.307812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T03:01:14.654356+0000","last_change":"2024-04-19T03:01:14.651049+0000","last_active":"2024-04-19T03:01:14.654356+0000","last_peered":"2024-04-19T03:01:14.654356+0000","last_clean":"2024-04-19T03:01:14.654356+0000","last_became_active":"2024-04-19T03:01:14.650646+0000","last_became_peered":"2024-04-19T03:01:14.650646+0000","last_unstale":"2024-04-19T03:01:14.654356+0000","last_undegraded":"2024-04-19T03:01:14.654356+0000","last_fullsized":"2024-04-19T03:01:14.654356+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:33:59.716591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-04-19T03:01:14.633087+0000","last_change":"2024-04-19T03:01:14.633087+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.633087+0000","last_undegraded":"2024-04-19T03:01:14.633087+0000","last_fullsized":"2024-04-19T03:01:14.633087+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:13:06.902769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T03:01:14.650679+0000","last_change":"2024-04-19T03:01:14.649277+0000","last_active":"2024-04-19T03:01:14.650679+0000","last_peered":"2024-04-19T03:01:14.650679+0000","last_clean":"2024-04-19T03:01:14.650679+0000","last_became_active":"2024-04-19T03:01:14.648614+0000","last_became_peered":"2024-04-19T03:01:14.648614+0000","last_unstale":"2024-04-19T03:01:14.650679+0000","last_undegraded":"2024-04-19T03:01:14.650679+0000","last_fullsized":"2024-04-19T03:01:14.650679+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:34:05.922324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-04-19T03:01:14.630820+0000","last_change":"2024-04-19T03:01:14.630820+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.630820+0000","last_undegraded":"2024-04-19T03:01:14.630820+0000","last_fullsized":"2024-04-19T03:01:14.630820+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:14:57.922917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-04-19T03:01:13.624316+0000","last_change":"2024-04-19T03:01:13.624316+0000","last_active":"2024-04-19T03:01:13.604133+0000","last_peered":"2024-04-19T03:01:13.604133+0000","last_clean":"2024-04-19T03:01:13.604133+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:13.624316+0000","last_undegraded":"2024-04-19T03:01:13.624316+0000","last_fullsized":"2024-04-19T03:01:13.624316+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:56:05.481089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-04-19T03:01:14.633427+0000","last_change":"2024-04-19T03:01:14.633427+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.633427+0000","last_undegraded":"2024-04-19T03:01:14.633427+0000","last_fullsized":"2024-04-19T03:01:14.633427+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:13:26.030579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-04-19T03:01:13.626135+0000","last_change":"2024-04-19T03:01:13.626135+0000","last_active":"2024-04-19T03:01:13.604133+0000","last_peered":"2024-04-19T03:01:13.604133+0000","last_clean":"2024-04-19T03:01:13.604133+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:13.626135+0000","last_undegraded":"2024-04-19T03:01:13.626135+0000","last_fullsized":"2024-04-19T03:01:13.626135+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:09:04.022991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":92,"acting":92,"num_store_stats":2},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":14482,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":10,"seq":42949672967,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31332,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340508,"statfs":{"total":96636764160,"available":96604680192,"internally_reserved":0,"allocated":221184,"data_stored":642541,"data_compressed":7241,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55800000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71699999999999997}]}]},{"osd":1,"up_from":10,"seq":42949672966,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31324,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340516,"statfs":{"total":96636764160,"available":96604688384,"internally_reserved":0,"allocated":212992,"data_stored":638003,"data_compressed":7241,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67200000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64400000000000002}]}]},{"osd":0,"up_from":9,"seq":38654705669,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31256,"kb_used_data":136,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340584,"statfs":{"total":96636764160,"available":96604758016,"internally_reserved":0,"allocated":139264,"data_stored":39817,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64700000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":7241,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":7241,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-19T03:01:18.387 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-19T03:01:18.694 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-19T03:01:18.696 INFO:teuthology.orchestra.run.smithi096.stderr:dumped all 2024-04-19T03:01:18.707 INFO:teuthology.orchestra.run.smithi096.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2024-04-19T03:01:17.943902+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":174,"acting":174,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":38,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":93912,"kb_used_data":560,"kb_used_omap":4,"kb_used_meta":93307,"kb_avail":283021608,"statfs":{"total":289910292480,"available":289814126592,"internally_reserved":0,"allocated":573440,"data_stored":1320361,"data_compressed":14482,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":4782,"internal_metadata":95546706},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.326899"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-04-19T03:01:14.636530+0000","last_change":"2024-04-19T03:01:14.636530+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.636530+0000","last_undegraded":"2024-04-19T03:01:14.636530+0000","last_fullsized":"2024-04-19T03:01:14.636530+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:13:26.030579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-04-19T03:01:14.638657+0000","last_change":"2024-04-19T03:01:14.638657+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.638657+0000","last_undegraded":"2024-04-19T03:01:14.638657+0000","last_fullsized":"2024-04-19T03:01:14.638657+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:48:13.389356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-04-19T03:01:14.641392+0000","last_change":"2024-04-19T03:01:14.641392+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.641392+0000","last_undegraded":"2024-04-19T03:01:14.641392+0000","last_fullsized":"2024-04-19T03:01:14.641392+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:35:19.436344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-04-19T03:01:14.638667+0000","last_change":"2024-04-19T03:01:14.638667+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.638667+0000","last_undegraded":"2024-04-19T03:01:14.638667+0000","last_fullsized":"2024-04-19T03:01:14.638667+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:30:22.360053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-04-19T03:01:14.631489+0000","last_change":"2024-04-19T03:01:14.631489+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.631489+0000","last_undegraded":"2024-04-19T03:01:14.631489+0000","last_fullsized":"2024-04-19T03:01:14.631489+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:31:51.982582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-04-19T03:01:14.638578+0000","last_change":"2024-04-19T03:01:14.638578+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.638578+0000","last_undegraded":"2024-04-19T03:01:14.638578+0000","last_fullsized":"2024-04-19T03:01:14.638578+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:22:58.349159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-04-19T03:01:14.636323+0000","last_change":"2024-04-19T03:01:14.636323+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.636323+0000","last_undegraded":"2024-04-19T03:01:14.636323+0000","last_fullsized":"2024-04-19T03:01:14.636323+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:48:13.389356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-04-19T03:01:14.640018+0000","last_change":"2024-04-19T03:01:14.640018+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.640018+0000","last_undegraded":"2024-04-19T03:01:14.640018+0000","last_fullsized":"2024-04-19T03:01:14.640018+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:09:23.427311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T03:01:14.615919+0000","last_change":"2024-04-19T03:01:14.615919+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.615919+0000","last_undegraded":"2024-04-19T03:01:14.615919+0000","last_fullsized":"2024-04-19T03:01:14.615919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-04-19T03:01:14.637573+0000","last_change":"2024-04-19T03:01:14.637573+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.637573+0000","last_undegraded":"2024-04-19T03:01:14.637573+0000","last_fullsized":"2024-04-19T03:01:14.637573+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:10:21.967941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-04-19T03:01:14.641049+0000","last_change":"2024-04-19T03:01:14.641049+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.641049+0000","last_undegraded":"2024-04-19T03:01:14.641049+0000","last_fullsized":"2024-04-19T03:01:14.641049+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:10:56.732208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-04-19T03:01:14.638345+0000","last_change":"2024-04-19T03:01:14.638345+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.638345+0000","last_undegraded":"2024-04-19T03:01:14.638345+0000","last_fullsized":"2024-04-19T03:01:14.638345+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:09:23.427311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-04-19T03:01:14.636683+0000","last_change":"2024-04-19T03:01:14.636683+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.636683+0000","last_undegraded":"2024-04-19T03:01:14.636683+0000","last_fullsized":"2024-04-19T03:01:14.636683+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:07:57.843767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-04-19T03:01:14.636154+0000","last_change":"2024-04-19T03:01:14.636154+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.636154+0000","last_undegraded":"2024-04-19T03:01:14.636154+0000","last_fullsized":"2024-04-19T03:01:14.636154+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:21:36.129346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-04-19T03:01:14.634523+0000","last_change":"2024-04-19T03:01:14.634523+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.634523+0000","last_undegraded":"2024-04-19T03:01:14.634523+0000","last_fullsized":"2024-04-19T03:01:14.634523+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:01:54.253963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-04-19T03:01:14.638699+0000","last_change":"2024-04-19T03:01:14.638699+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.638699+0000","last_undegraded":"2024-04-19T03:01:14.638699+0000","last_fullsized":"2024-04-19T03:01:14.638699+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:40:59.453079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T03:01:14.615919+0000","last_change":"2024-04-19T03:01:14.615919+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.615919+0000","last_undegraded":"2024-04-19T03:01:14.615919+0000","last_fullsized":"2024-04-19T03:01:14.615919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-04-19T03:01:14.632656+0000","last_change":"2024-04-19T03:01:14.632656+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.632656+0000","last_undegraded":"2024-04-19T03:01:14.632656+0000","last_fullsized":"2024-04-19T03:01:14.632656+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:40:20.790332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T03:01:14.615919+0000","last_change":"2024-04-19T03:01:14.615919+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.615919+0000","last_undegraded":"2024-04-19T03:01:14.615919+0000","last_fullsized":"2024-04-19T03:01:14.615919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-04-19T03:01:14.637003+0000","last_change":"2024-04-19T03:01:14.637003+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.637003+0000","last_undegraded":"2024-04-19T03:01:14.637003+0000","last_fullsized":"2024-04-19T03:01:14.637003+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:39:54.289444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-04-19T03:01:14.633108+0000","last_change":"2024-04-19T03:01:14.633108+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.633108+0000","last_undegraded":"2024-04-19T03:01:14.633108+0000","last_fullsized":"2024-04-19T03:01:14.633108+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:10:21.967941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-04-19T03:01:14.636810+0000","last_change":"2024-04-19T03:01:14.636810+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.636810+0000","last_undegraded":"2024-04-19T03:01:14.636810+0000","last_fullsized":"2024-04-19T03:01:14.636810+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:30:22.360053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T03:01:14.615919+0000","last_change":"2024-04-19T03:01:14.615919+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.615919+0000","last_undegraded":"2024-04-19T03:01:14.615919+0000","last_fullsized":"2024-04-19T03:01:14.615919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-04-19T03:01:14.638185+0000","last_change":"2024-04-19T03:01:14.638185+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.638185+0000","last_undegraded":"2024-04-19T03:01:14.638185+0000","last_fullsized":"2024-04-19T03:01:14.638185+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:37:35.950318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-04-19T03:01:14.634353+0000","last_change":"2024-04-19T03:01:14.634353+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.634353+0000","last_undegraded":"2024-04-19T03:01:14.634353+0000","last_fullsized":"2024-04-19T03:01:14.634353+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:56:44.307812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T03:01:14.615919+0000","last_change":"2024-04-19T03:01:14.615919+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.615919+0000","last_undegraded":"2024-04-19T03:01:14.615919+0000","last_fullsized":"2024-04-19T03:01:14.615919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-04-19T03:01:14.640726+0000","last_change":"2024-04-19T03:01:14.640726+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.640726+0000","last_undegraded":"2024-04-19T03:01:14.640726+0000","last_fullsized":"2024-04-19T03:01:14.640726+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:06:35.813797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-04-19T03:01:14.631256+0000","last_change":"2024-04-19T03:01:14.631256+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.631256+0000","last_undegraded":"2024-04-19T03:01:14.631256+0000","last_fullsized":"2024-04-19T03:01:14.631256+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:50:06.490191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T03:01:14.615919+0000","last_change":"2024-04-19T03:01:14.615919+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.615919+0000","last_undegraded":"2024-04-19T03:01:14.615919+0000","last_fullsized":"2024-04-19T03:01:14.615919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-04-19T03:01:14.630855+0000","last_change":"2024-04-19T03:01:14.630855+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.630855+0000","last_undegraded":"2024-04-19T03:01:14.630855+0000","last_fullsized":"2024-04-19T03:01:14.630855+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:10:42.079294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T03:01:14.615919+0000","last_change":"2024-04-19T03:01:14.615919+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.615919+0000","last_undegraded":"2024-04-19T03:01:14.615919+0000","last_fullsized":"2024-04-19T03:01:14.615919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-04-19T03:01:14.637332+0000","last_change":"2024-04-19T03:01:14.637332+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.637332+0000","last_undegraded":"2024-04-19T03:01:14.637332+0000","last_fullsized":"2024-04-19T03:01:14.637332+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:54:54.463918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-04-19T03:01:14.635649+0000","last_change":"2024-04-19T03:01:14.635649+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.635649+0000","last_undegraded":"2024-04-19T03:01:14.635649+0000","last_fullsized":"2024-04-19T03:01:14.635649+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:55:34.102680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T03:01:14.654351+0000","last_change":"2024-04-19T03:01:14.651050+0000","last_active":"2024-04-19T03:01:14.654351+0000","last_peered":"2024-04-19T03:01:14.654351+0000","last_clean":"2024-04-19T03:01:14.654351+0000","last_became_active":"2024-04-19T03:01:14.650679+0000","last_became_peered":"2024-04-19T03:01:14.650679+0000","last_unstale":"2024-04-19T03:01:14.654351+0000","last_undegraded":"2024-04-19T03:01:14.654351+0000","last_fullsized":"2024-04-19T03:01:14.654351+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:37:03.684394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-04-19T03:01:14.636520+0000","last_change":"2024-04-19T03:01:14.636520+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.636520+0000","last_undegraded":"2024-04-19T03:01:14.636520+0000","last_fullsized":"2024-04-19T03:01:14.636520+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:40:12.179703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-04-19T03:01:13.624457+0000","last_change":"2024-04-19T03:01:13.624457+0000","last_active":"2024-04-19T03:01:13.604133+0000","last_peered":"2024-04-19T03:01:13.604133+0000","last_clean":"2024-04-19T03:01:13.604133+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:13.624457+0000","last_undegraded":"2024-04-19T03:01:13.624457+0000","last_fullsized":"2024-04-19T03:01:13.624457+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:40:53.463388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T03:01:14.615919+0000","last_change":"2024-04-19T03:01:14.615919+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.615919+0000","last_undegraded":"2024-04-19T03:01:14.615919+0000","last_fullsized":"2024-04-19T03:01:14.615919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T03:01:14.650574+0000","last_change":"2024-04-19T03:01:14.649074+0000","last_active":"2024-04-19T03:01:14.650574+0000","last_peered":"2024-04-19T03:01:14.650574+0000","last_clean":"2024-04-19T03:01:14.650574+0000","last_became_active":"2024-04-19T03:01:14.648217+0000","last_became_peered":"2024-04-19T03:01:14.648217+0000","last_unstale":"2024-04-19T03:01:14.650574+0000","last_undegraded":"2024-04-19T03:01:14.650574+0000","last_fullsized":"2024-04-19T03:01:14.650574+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:57:05.238043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T03:01:14.615919+0000","last_change":"2024-04-19T03:01:14.615919+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.615919+0000","last_undegraded":"2024-04-19T03:01:14.615919+0000","last_fullsized":"2024-04-19T03:01:14.615919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T03:01:14.651960+0000","last_change":"2024-04-19T03:01:14.649044+0000","last_active":"2024-04-19T03:01:14.651960+0000","last_peered":"2024-04-19T03:01:14.651960+0000","last_clean":"2024-04-19T03:01:14.651960+0000","last_became_active":"2024-04-19T03:01:14.648859+0000","last_became_peered":"2024-04-19T03:01:14.648859+0000","last_unstale":"2024-04-19T03:01:14.651960+0000","last_undegraded":"2024-04-19T03:01:14.651960+0000","last_fullsized":"2024-04-19T03:01:14.651960+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:30:45.925657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T03:01:14.652044+0000","last_change":"2024-04-19T03:01:14.649839+0000","last_active":"2024-04-19T03:01:14.652044+0000","last_peered":"2024-04-19T03:01:14.652044+0000","last_clean":"2024-04-19T03:01:14.652044+0000","last_became_active":"2024-04-19T03:01:14.649571+0000","last_became_peered":"2024-04-19T03:01:14.649571+0000","last_unstale":"2024-04-19T03:01:14.652044+0000","last_undegraded":"2024-04-19T03:01:14.652044+0000","last_fullsized":"2024-04-19T03:01:14.652044+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:03:57.839660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-04-19T03:01:14.634133+0000","last_change":"2024-04-19T03:01:14.634133+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.634133+0000","last_undegraded":"2024-04-19T03:01:14.634133+0000","last_fullsized":"2024-04-19T03:01:14.634133+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:54:54.463918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T03:01:14.646089+0000","last_change":"2024-04-19T03:01:14.645075+0000","last_active":"2024-04-19T03:01:14.646089+0000","last_peered":"2024-04-19T03:01:14.646089+0000","last_clean":"2024-04-19T03:01:14.646089+0000","last_became_active":"2024-04-19T03:01:14.644790+0000","last_became_peered":"2024-04-19T03:01:14.644790+0000","last_unstale":"2024-04-19T03:01:14.646089+0000","last_undegraded":"2024-04-19T03:01:14.646089+0000","last_fullsized":"2024-04-19T03:01:14.646089+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:55:15.035769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-04-19T03:01:14.637118+0000","last_change":"2024-04-19T03:01:14.637118+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.637118+0000","last_undegraded":"2024-04-19T03:01:14.637118+0000","last_fullsized":"2024-04-19T03:01:14.637118+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:13:06.902769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T03:01:14.652024+0000","last_change":"2024-04-19T03:01:14.649826+0000","last_active":"2024-04-19T03:01:14.652024+0000","last_peered":"2024-04-19T03:01:14.652024+0000","last_clean":"2024-04-19T03:01:14.652024+0000","last_became_active":"2024-04-19T03:01:14.649565+0000","last_became_peered":"2024-04-19T03:01:14.649565+0000","last_unstale":"2024-04-19T03:01:14.652024+0000","last_undegraded":"2024-04-19T03:01:14.652024+0000","last_fullsized":"2024-04-19T03:01:14.652024+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:36:00.962931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-04-19T03:01:14.635329+0000","last_change":"2024-04-19T03:01:14.635329+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.635329+0000","last_undegraded":"2024-04-19T03:01:14.635329+0000","last_fullsized":"2024-04-19T03:01:14.635329+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:50:06.490191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T03:01:14.654439+0000","last_change":"2024-04-19T03:01:14.651201+0000","last_active":"2024-04-19T03:01:14.654439+0000","last_peered":"2024-04-19T03:01:14.654439+0000","last_clean":"2024-04-19T03:01:14.654439+0000","last_became_active":"2024-04-19T03:01:14.650942+0000","last_became_peered":"2024-04-19T03:01:14.650942+0000","last_unstale":"2024-04-19T03:01:14.654439+0000","last_undegraded":"2024-04-19T03:01:14.654439+0000","last_fullsized":"2024-04-19T03:01:14.654439+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:02:13.190917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T03:01:14.615919+0000","last_change":"2024-04-19T03:01:14.615919+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.615919+0000","last_undegraded":"2024-04-19T03:01:14.615919+0000","last_fullsized":"2024-04-19T03:01:14.615919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-04-19T03:01:13.622856+0000","last_change":"2024-04-19T03:01:13.622856+0000","last_active":"2024-04-19T03:01:13.604133+0000","last_peered":"2024-04-19T03:01:13.604133+0000","last_clean":"2024-04-19T03:01:13.604133+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:13.622856+0000","last_undegraded":"2024-04-19T03:01:13.622856+0000","last_fullsized":"2024-04-19T03:01:13.622856+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:33:45.550646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-04-19T03:01:14.633289+0000","last_change":"2024-04-19T03:01:14.633289+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.633289+0000","last_undegraded":"2024-04-19T03:01:14.633289+0000","last_fullsized":"2024-04-19T03:01:14.633289+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:54:04.518505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T03:01:14.654389+0000","last_change":"2024-04-19T03:01:14.651004+0000","last_active":"2024-04-19T03:01:14.654389+0000","last_peered":"2024-04-19T03:01:14.654389+0000","last_clean":"2024-04-19T03:01:14.654389+0000","last_became_active":"2024-04-19T03:01:14.650635+0000","last_became_peered":"2024-04-19T03:01:14.650635+0000","last_unstale":"2024-04-19T03:01:14.654389+0000","last_undegraded":"2024-04-19T03:01:14.654389+0000","last_fullsized":"2024-04-19T03:01:14.654389+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:57:15.575819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-04-19T03:01:14.638921+0000","last_change":"2024-04-19T03:01:14.638921+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.638921+0000","last_undegraded":"2024-04-19T03:01:14.638921+0000","last_fullsized":"2024-04-19T03:01:14.638921+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:51:06.208551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T03:01:14.646112+0000","last_change":"2024-04-19T03:01:14.644582+0000","last_active":"2024-04-19T03:01:14.646112+0000","last_peered":"2024-04-19T03:01:14.646112+0000","last_clean":"2024-04-19T03:01:14.646112+0000","last_became_active":"2024-04-19T03:01:14.644101+0000","last_became_peered":"2024-04-19T03:01:14.644101+0000","last_unstale":"2024-04-19T03:01:14.646112+0000","last_undegraded":"2024-04-19T03:01:14.646112+0000","last_fullsized":"2024-04-19T03:01:14.646112+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:28:24.652864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-04-19T03:01:14.635506+0000","last_change":"2024-04-19T03:01:14.635506+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.635506+0000","last_undegraded":"2024-04-19T03:01:14.635506+0000","last_fullsized":"2024-04-19T03:01:14.635506+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:16:20.475837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T03:01:14.645341+0000","last_change":"2024-04-19T03:01:14.643840+0000","last_active":"2024-04-19T03:01:14.645341+0000","last_peered":"2024-04-19T03:01:14.645341+0000","last_clean":"2024-04-19T03:01:14.645341+0000","last_became_active":"2024-04-19T03:01:14.643503+0000","last_became_peered":"2024-04-19T03:01:14.643503+0000","last_unstale":"2024-04-19T03:01:14.645341+0000","last_undegraded":"2024-04-19T03:01:14.645341+0000","last_fullsized":"2024-04-19T03:01:14.645341+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:09:33.801275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T03:01:14.615919+0000","last_change":"2024-04-19T03:01:14.615919+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.615919+0000","last_undegraded":"2024-04-19T03:01:14.615919+0000","last_fullsized":"2024-04-19T03:01:14.615919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"14'157","reported_seq":210,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-19T03:01:13.623161+0000","last_change":"2024-04-19T03:01:07.538434+0000","last_active":"2024-04-19T03:01:13.623161+0000","last_peered":"2024-04-19T03:01:13.623161+0000","last_clean":"2024-04-19T03:01:13.623161+0000","last_became_active":"2024-04-19T03:01:07.537856+0000","last_became_peered":"2024-04-19T03:01:07.537856+0000","last_unstale":"2024-04-19T03:01:13.623161+0000","last_undegraded":"2024-04-19T03:01:13.623161+0000","last_fullsized":"2024-04-19T03:01:13.623161+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:06.516863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:06.516863+0000","last_clean_scrub_stamp":"2024-04-19T03:01:06.516863+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:36:46.386286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-19T03:01:13.623664+0000","last_change":"2024-04-19T03:01:10.602869+0000","last_active":"2024-04-19T03:01:13.623664+0000","last_peered":"2024-04-19T03:01:13.623664+0000","last_clean":"2024-04-19T03:01:13.623664+0000","last_became_active":"2024-04-19T03:01:10.601965+0000","last_became_peered":"2024-04-19T03:01:10.601965+0000","last_unstale":"2024-04-19T03:01:13.623664+0000","last_undegraded":"2024-04-19T03:01:13.623664+0000","last_fullsized":"2024-04-19T03:01:13.623664+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_clean_scrub_stamp":"2024-04-19T03:01:09.578660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:14:41.316871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-04-19T03:01:13.622079+0000","last_change":"2024-04-19T03:01:13.622079+0000","last_active":"2024-04-19T03:01:13.604133+0000","last_peered":"2024-04-19T03:01:13.604133+0000","last_clean":"2024-04-19T03:01:13.604133+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:13.622079+0000","last_undegraded":"2024-04-19T03:01:13.622079+0000","last_fullsized":"2024-04-19T03:01:13.622079+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:24:40.181164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-04-19T03:01:14.633873+0000","last_change":"2024-04-19T03:01:14.633873+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.633873+0000","last_undegraded":"2024-04-19T03:01:14.633873+0000","last_fullsized":"2024-04-19T03:01:14.633873+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:00:35.372657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-19T03:01:13.623112+0000","last_change":"2024-04-19T03:01:10.602194+0000","last_active":"2024-04-19T03:01:13.623112+0000","last_peered":"2024-04-19T03:01:13.623112+0000","last_clean":"2024-04-19T03:01:13.623112+0000","last_became_active":"2024-04-19T03:01:10.601381+0000","last_became_peered":"2024-04-19T03:01:10.601381+0000","last_unstale":"2024-04-19T03:01:13.623112+0000","last_undegraded":"2024-04-19T03:01:13.623112+0000","last_fullsized":"2024-04-19T03:01:13.623112+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_clean_scrub_stamp":"2024-04-19T03:01:09.578660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:42:26.594095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-04-19T03:01:13.622230+0000","last_change":"2024-04-19T03:01:13.622230+0000","last_active":"2024-04-19T03:01:13.604133+0000","last_peered":"2024-04-19T03:01:13.604133+0000","last_clean":"2024-04-19T03:01:13.604133+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:13.622230+0000","last_undegraded":"2024-04-19T03:01:13.622230+0000","last_fullsized":"2024-04-19T03:01:13.622230+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:41:26.108674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-04-19T03:01:14.635678+0000","last_change":"2024-04-19T03:01:14.635678+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.635678+0000","last_undegraded":"2024-04-19T03:01:14.635678+0000","last_fullsized":"2024-04-19T03:01:14.635678+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:54:04.518505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-19T03:01:13.627044+0000","last_change":"2024-04-19T03:01:10.600207+0000","last_active":"2024-04-19T03:01:13.627044+0000","last_peered":"2024-04-19T03:01:13.627044+0000","last_clean":"2024-04-19T03:01:13.627044+0000","last_became_active":"2024-04-19T03:01:10.599209+0000","last_became_peered":"2024-04-19T03:01:10.599209+0000","last_unstale":"2024-04-19T03:01:13.627044+0000","last_undegraded":"2024-04-19T03:01:13.627044+0000","last_fullsized":"2024-04-19T03:01:13.627044+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_clean_scrub_stamp":"2024-04-19T03:01:09.578660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:30:25.748140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T03:01:14.650674+0000","last_change":"2024-04-19T03:01:14.649068+0000","last_active":"2024-04-19T03:01:14.650674+0000","last_peered":"2024-04-19T03:01:14.650674+0000","last_clean":"2024-04-19T03:01:14.650674+0000","last_became_active":"2024-04-19T03:01:14.648082+0000","last_became_peered":"2024-04-19T03:01:14.648082+0000","last_unstale":"2024-04-19T03:01:14.650674+0000","last_undegraded":"2024-04-19T03:01:14.650674+0000","last_fullsized":"2024-04-19T03:01:14.650674+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:30:14.489117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T03:01:14.615919+0000","last_change":"2024-04-19T03:01:14.615919+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.615919+0000","last_undegraded":"2024-04-19T03:01:14.615919+0000","last_fullsized":"2024-04-19T03:01:14.615919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-19T03:01:13.623103+0000","last_change":"2024-04-19T03:01:10.601386+0000","last_active":"2024-04-19T03:01:13.623103+0000","last_peered":"2024-04-19T03:01:13.623103+0000","last_clean":"2024-04-19T03:01:13.623103+0000","last_became_active":"2024-04-19T03:01:10.600732+0000","last_became_peered":"2024-04-19T03:01:10.600732+0000","last_unstale":"2024-04-19T03:01:13.623103+0000","last_undegraded":"2024-04-19T03:01:13.623103+0000","last_fullsized":"2024-04-19T03:01:13.623103+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_clean_scrub_stamp":"2024-04-19T03:01:09.578660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:34:53.138338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T03:01:14.654457+0000","last_change":"2024-04-19T03:01:14.651363+0000","last_active":"2024-04-19T03:01:14.654457+0000","last_peered":"2024-04-19T03:01:14.654457+0000","last_clean":"2024-04-19T03:01:14.654457+0000","last_became_active":"2024-04-19T03:01:14.651020+0000","last_became_peered":"2024-04-19T03:01:14.651020+0000","last_unstale":"2024-04-19T03:01:14.654457+0000","last_undegraded":"2024-04-19T03:01:14.654457+0000","last_fullsized":"2024-04-19T03:01:14.654457+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:44:36.043345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T03:01:14.615919+0000","last_change":"2024-04-19T03:01:14.615919+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.615919+0000","last_undegraded":"2024-04-19T03:01:14.615919+0000","last_fullsized":"2024-04-19T03:01:14.615919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T03:01:14.659873+0000","last_change":"2024-04-19T03:01:14.651740+0000","last_active":"2024-04-19T03:01:14.659873+0000","last_peered":"2024-04-19T03:01:14.659873+0000","last_clean":"2024-04-19T03:01:14.659873+0000","last_became_active":"2024-04-19T03:01:14.651491+0000","last_became_peered":"2024-04-19T03:01:14.651491+0000","last_unstale":"2024-04-19T03:01:14.659873+0000","last_undegraded":"2024-04-19T03:01:14.659873+0000","last_fullsized":"2024-04-19T03:01:14.659873+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:42:15.864988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-19T03:01:13.627316+0000","last_change":"2024-04-19T03:01:10.601062+0000","last_active":"2024-04-19T03:01:13.627316+0000","last_peered":"2024-04-19T03:01:13.627316+0000","last_clean":"2024-04-19T03:01:13.627316+0000","last_became_active":"2024-04-19T03:01:10.600334+0000","last_became_peered":"2024-04-19T03:01:10.600334+0000","last_unstale":"2024-04-19T03:01:13.627316+0000","last_undegraded":"2024-04-19T03:01:13.627316+0000","last_fullsized":"2024-04-19T03:01:13.627316+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_clean_scrub_stamp":"2024-04-19T03:01:09.578660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:51:38.307752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-04-19T03:01:14.635161+0000","last_change":"2024-04-19T03:01:14.635161+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.635161+0000","last_undegraded":"2024-04-19T03:01:14.635161+0000","last_fullsized":"2024-04-19T03:01:14.635161+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:22:58.349159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-04-19T03:01:13.622643+0000","last_change":"2024-04-19T03:01:13.622643+0000","last_active":"2024-04-19T03:01:13.604133+0000","last_peered":"2024-04-19T03:01:13.604133+0000","last_clean":"2024-04-19T03:01:13.604133+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:13.622643+0000","last_undegraded":"2024-04-19T03:01:13.622643+0000","last_fullsized":"2024-04-19T03:01:13.622643+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:40:40.193720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-19T03:01:13.628856+0000","last_change":"2024-04-19T03:01:10.603139+0000","last_active":"2024-04-19T03:01:13.628856+0000","last_peered":"2024-04-19T03:01:13.628856+0000","last_clean":"2024-04-19T03:01:13.628856+0000","last_became_active":"2024-04-19T03:01:10.602397+0000","last_became_peered":"2024-04-19T03:01:10.602397+0000","last_unstale":"2024-04-19T03:01:13.628856+0000","last_undegraded":"2024-04-19T03:01:13.628856+0000","last_fullsized":"2024-04-19T03:01:13.628856+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_clean_scrub_stamp":"2024-04-19T03:01:09.578660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:36:00.072157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-04-19T03:01:14.634209+0000","last_change":"2024-04-19T03:01:14.634209+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.634209+0000","last_undegraded":"2024-04-19T03:01:14.634209+0000","last_fullsized":"2024-04-19T03:01:14.634209+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:39:54.289444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-04-19T03:01:13.622569+0000","last_change":"2024-04-19T03:01:13.622569+0000","last_active":"2024-04-19T03:01:13.604133+0000","last_peered":"2024-04-19T03:01:13.604133+0000","last_clean":"2024-04-19T03:01:13.604133+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:13.622569+0000","last_undegraded":"2024-04-19T03:01:13.622569+0000","last_fullsized":"2024-04-19T03:01:13.622569+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:28:14.128657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-19T03:01:13.628367+0000","last_change":"2024-04-19T03:01:10.599894+0000","last_active":"2024-04-19T03:01:13.628367+0000","last_peered":"2024-04-19T03:01:13.628367+0000","last_clean":"2024-04-19T03:01:13.628367+0000","last_became_active":"2024-04-19T03:01:10.599202+0000","last_became_peered":"2024-04-19T03:01:10.599202+0000","last_unstale":"2024-04-19T03:01:13.628367+0000","last_undegraded":"2024-04-19T03:01:13.628367+0000","last_fullsized":"2024-04-19T03:01:13.628367+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_clean_scrub_stamp":"2024-04-19T03:01:09.578660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:59:34.386302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T03:01:14.615919+0000","last_change":"2024-04-19T03:01:14.615919+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.615919+0000","last_undegraded":"2024-04-19T03:01:14.615919+0000","last_fullsized":"2024-04-19T03:01:14.615919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-04-19T03:01:13.622364+0000","last_change":"2024-04-19T03:01:13.622364+0000","last_active":"2024-04-19T03:01:13.604133+0000","last_peered":"2024-04-19T03:01:13.604133+0000","last_clean":"2024-04-19T03:01:13.604133+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:13.622364+0000","last_undegraded":"2024-04-19T03:01:13.622364+0000","last_fullsized":"2024-04-19T03:01:13.622364+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:32:41.909038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-19T03:01:13.624003+0000","last_change":"2024-04-19T03:01:10.602274+0000","last_active":"2024-04-19T03:01:13.624003+0000","last_peered":"2024-04-19T03:01:13.624003+0000","last_clean":"2024-04-19T03:01:13.624003+0000","last_became_active":"2024-04-19T03:01:10.601487+0000","last_became_peered":"2024-04-19T03:01:10.601487+0000","last_unstale":"2024-04-19T03:01:13.624003+0000","last_undegraded":"2024-04-19T03:01:13.624003+0000","last_fullsized":"2024-04-19T03:01:13.624003+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_clean_scrub_stamp":"2024-04-19T03:01:09.578660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:26:16.712446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-04-19T03:01:14.635200+0000","last_change":"2024-04-19T03:01:14.635200+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.635200+0000","last_undegraded":"2024-04-19T03:01:14.635200+0000","last_fullsized":"2024-04-19T03:01:14.635200+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:40:59.453079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-04-19T03:01:14.635874+0000","last_change":"2024-04-19T03:01:14.635874+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.635874+0000","last_undegraded":"2024-04-19T03:01:14.635874+0000","last_fullsized":"2024-04-19T03:01:14.635874+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:59:49.270245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T03:01:14.651985+0000","last_change":"2024-04-19T03:01:14.649577+0000","last_active":"2024-04-19T03:01:14.651985+0000","last_peered":"2024-04-19T03:01:14.651985+0000","last_clean":"2024-04-19T03:01:14.651985+0000","last_became_active":"2024-04-19T03:01:14.649284+0000","last_became_peered":"2024-04-19T03:01:14.649284+0000","last_unstale":"2024-04-19T03:01:14.651985+0000","last_undegraded":"2024-04-19T03:01:14.651985+0000","last_fullsized":"2024-04-19T03:01:14.651985+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:01:22.214742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T03:01:14.615919+0000","last_change":"2024-04-19T03:01:14.615919+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.615919+0000","last_undegraded":"2024-04-19T03:01:14.615919+0000","last_fullsized":"2024-04-19T03:01:14.615919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T03:01:14.650412+0000","last_change":"2024-04-19T03:01:14.648703+0000","last_active":"2024-04-19T03:01:14.650412+0000","last_peered":"2024-04-19T03:01:14.650412+0000","last_clean":"2024-04-19T03:01:14.650412+0000","last_became_active":"2024-04-19T03:01:14.648258+0000","last_became_peered":"2024-04-19T03:01:14.648258+0000","last_unstale":"2024-04-19T03:01:14.650412+0000","last_undegraded":"2024-04-19T03:01:14.650412+0000","last_fullsized":"2024-04-19T03:01:14.650412+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:30:35.593258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T03:01:14.659856+0000","last_change":"2024-04-19T03:01:14.651753+0000","last_active":"2024-04-19T03:01:14.659856+0000","last_peered":"2024-04-19T03:01:14.659856+0000","last_clean":"2024-04-19T03:01:14.659856+0000","last_became_active":"2024-04-19T03:01:14.651458+0000","last_became_peered":"2024-04-19T03:01:14.651458+0000","last_unstale":"2024-04-19T03:01:14.659856+0000","last_undegraded":"2024-04-19T03:01:14.659856+0000","last_fullsized":"2024-04-19T03:01:14.659856+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:58:28.669306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T03:01:14.615919+0000","last_change":"2024-04-19T03:01:14.615919+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.615919+0000","last_undegraded":"2024-04-19T03:01:14.615919+0000","last_fullsized":"2024-04-19T03:01:14.615919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-04-19T03:01:13.624713+0000","last_change":"2024-04-19T03:01:13.624713+0000","last_active":"2024-04-19T03:01:13.604133+0000","last_peered":"2024-04-19T03:01:13.604133+0000","last_clean":"2024-04-19T03:01:13.604133+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:13.624713+0000","last_undegraded":"2024-04-19T03:01:13.624713+0000","last_fullsized":"2024-04-19T03:01:13.624713+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:22:38.096801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T03:01:14.615919+0000","last_change":"2024-04-19T03:01:14.615919+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.615919+0000","last_undegraded":"2024-04-19T03:01:14.615919+0000","last_fullsized":"2024-04-19T03:01:14.615919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-04-19T03:01:14.631624+0000","last_change":"2024-04-19T03:01:14.631624+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.631624+0000","last_undegraded":"2024-04-19T03:01:14.631624+0000","last_fullsized":"2024-04-19T03:01:14.631624+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:40:53.477682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-04-19T03:01:13.622719+0000","last_change":"2024-04-19T03:01:13.622719+0000","last_active":"2024-04-19T03:01:13.604133+0000","last_peered":"2024-04-19T03:01:13.604133+0000","last_clean":"2024-04-19T03:01:13.604133+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:13.622719+0000","last_undegraded":"2024-04-19T03:01:13.622719+0000","last_fullsized":"2024-04-19T03:01:13.622719+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:05:36.752017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T03:01:14.615919+0000","last_change":"2024-04-19T03:01:14.615919+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.615919+0000","last_undegraded":"2024-04-19T03:01:14.615919+0000","last_fullsized":"2024-04-19T03:01:14.615919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-04-19T03:01:13.624540+0000","last_change":"2024-04-19T03:01:13.624540+0000","last_active":"2024-04-19T03:01:13.604133+0000","last_peered":"2024-04-19T03:01:13.604133+0000","last_clean":"2024-04-19T03:01:13.604133+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:13.624540+0000","last_undegraded":"2024-04-19T03:01:13.624540+0000","last_fullsized":"2024-04-19T03:01:13.624540+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:56:15.348940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-04-19T03:01:14.637577+0000","last_change":"2024-04-19T03:01:14.637577+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.637577+0000","last_undegraded":"2024-04-19T03:01:14.637577+0000","last_fullsized":"2024-04-19T03:01:14.637577+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:10:56.732208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T03:01:14.652127+0000","last_change":"2024-04-19T03:01:14.651050+0000","last_active":"2024-04-19T03:01:14.652127+0000","last_peered":"2024-04-19T03:01:14.652127+0000","last_clean":"2024-04-19T03:01:14.652127+0000","last_became_active":"2024-04-19T03:01:14.650639+0000","last_became_peered":"2024-04-19T03:01:14.650639+0000","last_unstale":"2024-04-19T03:01:14.652127+0000","last_undegraded":"2024-04-19T03:01:14.652127+0000","last_fullsized":"2024-04-19T03:01:14.652127+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:41:49.783896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-04-19T03:01:14.636855+0000","last_change":"2024-04-19T03:01:14.636855+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.636855+0000","last_undegraded":"2024-04-19T03:01:14.636855+0000","last_fullsized":"2024-04-19T03:01:14.636855+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:36:36.363535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T03:01:14.650442+0000","last_change":"2024-04-19T03:01:14.648823+0000","last_active":"2024-04-19T03:01:14.650442+0000","last_peered":"2024-04-19T03:01:14.650442+0000","last_clean":"2024-04-19T03:01:14.650442+0000","last_became_active":"2024-04-19T03:01:14.648337+0000","last_became_peered":"2024-04-19T03:01:14.648337+0000","last_unstale":"2024-04-19T03:01:14.650442+0000","last_undegraded":"2024-04-19T03:01:14.650442+0000","last_fullsized":"2024-04-19T03:01:14.650442+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:08:46.250118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-04-19T03:01:14.637651+0000","last_change":"2024-04-19T03:01:14.637651+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.637651+0000","last_undegraded":"2024-04-19T03:01:14.637651+0000","last_fullsized":"2024-04-19T03:01:14.637651+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:56:44.307812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T03:01:14.654356+0000","last_change":"2024-04-19T03:01:14.651049+0000","last_active":"2024-04-19T03:01:14.654356+0000","last_peered":"2024-04-19T03:01:14.654356+0000","last_clean":"2024-04-19T03:01:14.654356+0000","last_became_active":"2024-04-19T03:01:14.650646+0000","last_became_peered":"2024-04-19T03:01:14.650646+0000","last_unstale":"2024-04-19T03:01:14.654356+0000","last_undegraded":"2024-04-19T03:01:14.654356+0000","last_fullsized":"2024-04-19T03:01:14.654356+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:33:59.716591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-04-19T03:01:14.633087+0000","last_change":"2024-04-19T03:01:14.633087+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.633087+0000","last_undegraded":"2024-04-19T03:01:14.633087+0000","last_fullsized":"2024-04-19T03:01:14.633087+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:13:06.902769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T03:01:14.650679+0000","last_change":"2024-04-19T03:01:14.649277+0000","last_active":"2024-04-19T03:01:14.650679+0000","last_peered":"2024-04-19T03:01:14.650679+0000","last_clean":"2024-04-19T03:01:14.650679+0000","last_became_active":"2024-04-19T03:01:14.648614+0000","last_became_peered":"2024-04-19T03:01:14.648614+0000","last_unstale":"2024-04-19T03:01:14.650679+0000","last_undegraded":"2024-04-19T03:01:14.650679+0000","last_fullsized":"2024-04-19T03:01:14.650679+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:34:05.922324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-04-19T03:01:14.630820+0000","last_change":"2024-04-19T03:01:14.630820+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.630820+0000","last_undegraded":"2024-04-19T03:01:14.630820+0000","last_fullsized":"2024-04-19T03:01:14.630820+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:14:57.922917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-04-19T03:01:13.624316+0000","last_change":"2024-04-19T03:01:13.624316+0000","last_active":"2024-04-19T03:01:13.604133+0000","last_peered":"2024-04-19T03:01:13.604133+0000","last_clean":"2024-04-19T03:01:13.604133+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:13.624316+0000","last_undegraded":"2024-04-19T03:01:13.624316+0000","last_fullsized":"2024-04-19T03:01:13.624316+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:56:05.481089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-04-19T03:01:14.633427+0000","last_change":"2024-04-19T03:01:14.633427+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.633427+0000","last_undegraded":"2024-04-19T03:01:14.633427+0000","last_fullsized":"2024-04-19T03:01:14.633427+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:13:26.030579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-04-19T03:01:13.626135+0000","last_change":"2024-04-19T03:01:13.626135+0000","last_active":"2024-04-19T03:01:13.604133+0000","last_peered":"2024-04-19T03:01:13.604133+0000","last_clean":"2024-04-19T03:01:13.604133+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:13.626135+0000","last_undegraded":"2024-04-19T03:01:13.626135+0000","last_fullsized":"2024-04-19T03:01:13.626135+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:09:04.022991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":92,"acting":92,"num_store_stats":2},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":14482,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":10,"seq":42949672967,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31332,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340508,"statfs":{"total":96636764160,"available":96604680192,"internally_reserved":0,"allocated":221184,"data_stored":642541,"data_compressed":7241,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55800000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71699999999999997}]}]},{"osd":1,"up_from":10,"seq":42949672966,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31324,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340516,"statfs":{"total":96636764160,"available":96604688384,"internally_reserved":0,"allocated":212992,"data_stored":638003,"data_compressed":7241,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67200000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64400000000000002}]}]},{"osd":0,"up_from":9,"seq":38654705669,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31256,"kb_used_data":136,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340584,"statfs":{"total":96636764160,"available":96604758016,"internally_reserved":0,"allocated":139264,"data_stored":39817,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64700000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":7241,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":7241,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-19T03:01:18.711 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3f is not active+clean 2024-04-19T03:01:18.711 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-04-19T03:01:14.636530+0000', 'last_change': '2024-04-19T03:01:14.636530+0000', 'last_active': '2024-04-19T03:01:14.615919+0000', 'last_peered': '2024-04-19T03:01:14.615919+0000', 'last_clean': '2024-04-19T03:01:14.615919+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T03:01:14.636530+0000', 'last_undegraded': '2024-04-19T03:01:14.636530+0000', 'last_fullsized': '2024-04-19T03:01:14.636530+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T03:01:14.615919+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T03:01:14.615919+0000', 'last_clean_scrub_stamp': '2024-04-19T03:01:14.615919+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-04-20T10:13:26.030579+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-19T03:01:18.711 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3e is not active+clean 2024-04-19T03:01:18.711 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-04-19T03:01:14.638657+0000', 'last_change': '2024-04-19T03:01:14.638657+0000', 'last_active': '2024-04-19T03:01:14.615919+0000', 'last_peered': '2024-04-19T03:01:14.615919+0000', 'last_clean': '2024-04-19T03:01:14.615919+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T03:01:14.638657+0000', 'last_undegraded': '2024-04-19T03:01:14.638657+0000', 'last_fullsized': '2024-04-19T03:01:14.638657+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T03:01:14.615919+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T03:01:14.615919+0000', 'last_clean_scrub_stamp': '2024-04-19T03:01:14.615919+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-04-20T09:48:13.389356+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-19T03:01:18.712 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3d is not active+clean 2024-04-19T03:01:18.712 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-04-19T03:01:14.641392+0000', 'last_change': '2024-04-19T03:01:14.641392+0000', 'last_active': '2024-04-19T03:01:14.615919+0000', 'last_peered': '2024-04-19T03:01:14.615919+0000', 'last_clean': '2024-04-19T03:01:14.615919+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T03:01:14.641392+0000', 'last_undegraded': '2024-04-19T03:01:14.641392+0000', 'last_fullsized': '2024-04-19T03:01:14.641392+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T03:01:14.615919+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T03:01:14.615919+0000', 'last_clean_scrub_stamp': '2024-04-19T03:01:14.615919+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-04-20T14:35:19.436344+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-19T03:01:18.712 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3c is not active+clean 2024-04-19T03:01:18.712 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-04-19T03:01:14.638667+0000', 'last_change': '2024-04-19T03:01:14.638667+0000', 'last_active': '2024-04-19T03:01:14.615919+0000', 'last_peered': '2024-04-19T03:01:14.615919+0000', 'last_clean': '2024-04-19T03:01:14.615919+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T03:01:14.638667+0000', 'last_undegraded': '2024-04-19T03:01:14.638667+0000', 'last_fullsized': '2024-04-19T03:01:14.638667+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T03:01:14.615919+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T03:01:14.615919+0000', 'last_clean_scrub_stamp': '2024-04-19T03:01:14.615919+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-04-20T08:30:22.360053+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-19T03:01:18.712 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3b is not active+clean 2024-04-19T03:01:18.712 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-04-19T03:01:14.631489+0000', 'last_change': '2024-04-19T03:01:14.631489+0000', 'last_active': '2024-04-19T03:01:14.615919+0000', 'last_peered': '2024-04-19T03:01:14.615919+0000', 'last_clean': '2024-04-19T03:01:14.615919+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T03:01:14.631489+0000', 'last_undegraded': '2024-04-19T03:01:14.631489+0000', 'last_fullsized': '2024-04-19T03:01:14.631489+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T03:01:14.615919+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T03:01:14.615919+0000', 'last_clean_scrub_stamp': '2024-04-19T03:01:14.615919+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-04-20T13:31:51.982582+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-19T03:01:18.712 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3a is not active+clean 2024-04-19T03:01:18.712 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-04-19T03:01:14.638578+0000', 'last_change': '2024-04-19T03:01:14.638578+0000', 'last_active': '2024-04-19T03:01:14.615919+0000', 'last_peered': '2024-04-19T03:01:14.615919+0000', 'last_clean': '2024-04-19T03:01:14.615919+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T03:01:14.638578+0000', 'last_undegraded': '2024-04-19T03:01:14.638578+0000', 'last_fullsized': '2024-04-19T03:01:14.638578+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T03:01:14.615919+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T03:01:14.615919+0000', 'last_clean_scrub_stamp': '2024-04-19T03:01:14.615919+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-04-20T05:22:58.349159+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-19T03:01:18.712 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.39 is not active+clean 2024-04-19T03:01:18.712 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-04-19T03:01:14.636323+0000', 'last_change': '2024-04-19T03:01:14.636323+0000', 'last_active': '2024-04-19T03:01:14.615919+0000', 'last_peered': '2024-04-19T03:01:14.615919+0000', 'last_clean': '2024-04-19T03:01:14.615919+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T03:01:14.636323+0000', 'last_undegraded': '2024-04-19T03:01:14.636323+0000', 'last_fullsized': '2024-04-19T03:01:14.636323+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T03:01:14.615919+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T03:01:14.615919+0000', 'last_clean_scrub_stamp': '2024-04-19T03:01:14.615919+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-04-20T09:48:13.389356+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-19T03:01:18.712 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.38 is not active+clean 2024-04-19T03:01:18.713 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.38', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-04-19T03:01:14.640018+0000', 'last_change': '2024-04-19T03:01:14.640018+0000', 'last_active': '2024-04-19T03:01:14.615919+0000', 'last_peered': '2024-04-19T03:01:14.615919+0000', 'last_clean': '2024-04-19T03:01:14.615919+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T03:01:14.640018+0000', 'last_undegraded': '2024-04-19T03:01:14.640018+0000', 'last_fullsized': '2024-04-19T03:01:14.640018+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T03:01:14.615919+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T03:01:14.615919+0000', 'last_clean_scrub_stamp': '2024-04-19T03:01:14.615919+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-04-20T08:09:23.427311+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-19T03:01:18.713 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.37 is not active+clean 2024-04-19T03:01:18.713 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-19T03:01:14.615919+0000', 'last_change': '2024-04-19T03:01:14.615919+0000', 'last_active': '2024-04-19T03:01:14.615919+0000', 'last_peered': '2024-04-19T03:01:14.615919+0000', 'last_clean': '2024-04-19T03:01:14.615919+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T03:01:14.615919+0000', 'last_undegraded': '2024-04-19T03:01:14.615919+0000', 'last_fullsized': '2024-04-19T03:01:14.615919+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T03:01:14.615919+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T03:01:14.615919+0000', 'last_clean_scrub_stamp': '2024-04-19T03:01:14.615919+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-19T03:01:18.713 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.36 is not active+clean 2024-04-19T03:01:18.713 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-04-19T03:01:14.637573+0000', 'last_change': '2024-04-19T03:01:14.637573+0000', 'last_active': '2024-04-19T03:01:14.615919+0000', 'last_peered': '2024-04-19T03:01:14.615919+0000', 'last_clean': '2024-04-19T03:01:14.615919+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T03:01:14.637573+0000', 'last_undegraded': '2024-04-19T03:01:14.637573+0000', 'last_fullsized': '2024-04-19T03:01:14.637573+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T03:01:14.615919+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T03:01:14.615919+0000', 'last_clean_scrub_stamp': '2024-04-19T03:01:14.615919+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-04-20T14:10:21.967941+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-19T03:01:18.713 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.35 is not active+clean 2024-04-19T03:01:18.713 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-04-19T03:01:14.641049+0000', 'last_change': '2024-04-19T03:01:14.641049+0000', 'last_active': '2024-04-19T03:01:14.615919+0000', 'last_peered': '2024-04-19T03:01:14.615919+0000', 'last_clean': '2024-04-19T03:01:14.615919+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T03:01:14.641049+0000', 'last_undegraded': '2024-04-19T03:01:14.641049+0000', 'last_fullsized': '2024-04-19T03:01:14.641049+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T03:01:14.615919+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T03:01:14.615919+0000', 'last_clean_scrub_stamp': '2024-04-19T03:01:14.615919+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-04-20T07:10:56.732208+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-19T03:01:18.713 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.34 is not active+clean 2024-04-19T03:01:18.713 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-04-19T03:01:14.638345+0000', 'last_change': '2024-04-19T03:01:14.638345+0000', 'last_active': '2024-04-19T03:01:14.615919+0000', 'last_peered': '2024-04-19T03:01:14.615919+0000', 'last_clean': '2024-04-19T03:01:14.615919+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T03:01:14.638345+0000', 'last_undegraded': '2024-04-19T03:01:14.638345+0000', 'last_fullsized': '2024-04-19T03:01:14.638345+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T03:01:14.615919+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T03:01:14.615919+0000', 'last_clean_scrub_stamp': '2024-04-19T03:01:14.615919+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-04-20T08:09:23.427311+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-19T03:01:18.713 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.33 is not active+clean 2024-04-19T03:01:18.713 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.33', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-04-19T03:01:14.636683+0000', 'last_change': '2024-04-19T03:01:14.636683+0000', 'last_active': '2024-04-19T03:01:14.615919+0000', 'last_peered': '2024-04-19T03:01:14.615919+0000', 'last_clean': '2024-04-19T03:01:14.615919+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T03:01:14.636683+0000', 'last_undegraded': '2024-04-19T03:01:14.636683+0000', 'last_fullsized': '2024-04-19T03:01:14.636683+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T03:01:14.615919+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T03:01:14.615919+0000', 'last_clean_scrub_stamp': '2024-04-19T03:01:14.615919+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-04-20T03:07:57.843767+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-19T03:01:18.714 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.32 is not active+clean 2024-04-19T03:01:18.714 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.32', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-04-19T03:01:14.636154+0000', 'last_change': '2024-04-19T03:01:14.636154+0000', 'last_active': '2024-04-19T03:01:14.615919+0000', 'last_peered': '2024-04-19T03:01:14.615919+0000', 'last_clean': '2024-04-19T03:01:14.615919+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T03:01:14.636154+0000', 'last_undegraded': '2024-04-19T03:01:14.636154+0000', 'last_fullsized': '2024-04-19T03:01:14.636154+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T03:01:14.615919+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T03:01:14.615919+0000', 'last_clean_scrub_stamp': '2024-04-19T03:01:14.615919+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-04-20T12:21:36.129346+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-19T03:01:18.714 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.31 is not active+clean 2024-04-19T03:01:18.714 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.31', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-04-19T03:01:14.634523+0000', 'last_change': '2024-04-19T03:01:14.634523+0000', 'last_active': '2024-04-19T03:01:14.615919+0000', 'last_peered': '2024-04-19T03:01:14.615919+0000', 'last_clean': '2024-04-19T03:01:14.615919+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T03:01:14.634523+0000', 'last_undegraded': '2024-04-19T03:01:14.634523+0000', 'last_fullsized': '2024-04-19T03:01:14.634523+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T03:01:14.615919+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T03:01:14.615919+0000', 'last_clean_scrub_stamp': '2024-04-19T03:01:14.615919+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-04-20T05:01:54.253963+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-19T03:01:18.714 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.30 is not active+clean 2024-04-19T03:01:18.714 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-04-19T03:01:14.638699+0000', 'last_change': '2024-04-19T03:01:14.638699+0000', 'last_active': '2024-04-19T03:01:14.615919+0000', 'last_peered': '2024-04-19T03:01:14.615919+0000', 'last_clean': '2024-04-19T03:01:14.615919+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T03:01:14.638699+0000', 'last_undegraded': '2024-04-19T03:01:14.638699+0000', 'last_fullsized': '2024-04-19T03:01:14.638699+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T03:01:14.615919+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T03:01:14.615919+0000', 'last_clean_scrub_stamp': '2024-04-19T03:01:14.615919+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-04-20T13:40:59.453079+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-19T03:01:18.714 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2f is not active+clean 2024-04-19T03:01:18.714 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-19T03:01:14.615919+0000', 'last_change': '2024-04-19T03:01:14.615919+0000', 'last_active': '2024-04-19T03:01:14.615919+0000', 'last_peered': '2024-04-19T03:01:14.615919+0000', 'last_clean': '2024-04-19T03:01:14.615919+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T03:01:14.615919+0000', 'last_undegraded': '2024-04-19T03:01:14.615919+0000', 'last_fullsized': '2024-04-19T03:01:14.615919+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T03:01:14.615919+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T03:01:14.615919+0000', 'last_clean_scrub_stamp': '2024-04-19T03:01:14.615919+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-19T03:01:18.714 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2e is not active+clean 2024-04-19T03:01:18.714 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-04-19T03:01:14.632656+0000', 'last_change': '2024-04-19T03:01:14.632656+0000', 'last_active': '2024-04-19T03:01:14.615919+0000', 'last_peered': '2024-04-19T03:01:14.615919+0000', 'last_clean': '2024-04-19T03:01:14.615919+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T03:01:14.632656+0000', 'last_undegraded': '2024-04-19T03:01:14.632656+0000', 'last_fullsized': '2024-04-19T03:01:14.632656+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T03:01:14.615919+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T03:01:14.615919+0000', 'last_clean_scrub_stamp': '2024-04-19T03:01:14.615919+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-04-20T14:40:20.790332+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-19T03:01:18.715 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2d is not active+clean 2024-04-19T03:01:18.715 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-19T03:01:14.615919+0000', 'last_change': '2024-04-19T03:01:14.615919+0000', 'last_active': '2024-04-19T03:01:14.615919+0000', 'last_peered': '2024-04-19T03:01:14.615919+0000', 'last_clean': '2024-04-19T03:01:14.615919+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T03:01:14.615919+0000', 'last_undegraded': '2024-04-19T03:01:14.615919+0000', 'last_fullsized': '2024-04-19T03:01:14.615919+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T03:01:14.615919+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T03:01:14.615919+0000', 'last_clean_scrub_stamp': '2024-04-19T03:01:14.615919+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-19T03:01:18.715 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2c is not active+clean 2024-04-19T03:01:18.715 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-04-19T03:01:14.637003+0000', 'last_change': '2024-04-19T03:01:14.637003+0000', 'last_active': '2024-04-19T03:01:14.615919+0000', 'last_peered': '2024-04-19T03:01:14.615919+0000', 'last_clean': '2024-04-19T03:01:14.615919+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T03:01:14.637003+0000', 'last_undegraded': '2024-04-19T03:01:14.637003+0000', 'last_fullsized': '2024-04-19T03:01:14.637003+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T03:01:14.615919+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T03:01:14.615919+0000', 'last_clean_scrub_stamp': '2024-04-19T03:01:14.615919+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-04-20T11:39:54.289444+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-19T03:01:18.715 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2b is not active+clean 2024-04-19T03:01:18.715 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-04-19T03:01:14.633108+0000', 'last_change': '2024-04-19T03:01:14.633108+0000', 'last_active': '2024-04-19T03:01:14.615919+0000', 'last_peered': '2024-04-19T03:01:14.615919+0000', 'last_clean': '2024-04-19T03:01:14.615919+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T03:01:14.633108+0000', 'last_undegraded': '2024-04-19T03:01:14.633108+0000', 'last_fullsized': '2024-04-19T03:01:14.633108+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T03:01:14.615919+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T03:01:14.615919+0000', 'last_clean_scrub_stamp': '2024-04-19T03:01:14.615919+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-04-20T14:10:21.967941+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-19T03:01:18.715 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2a is not active+clean 2024-04-19T03:01:18.715 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-04-19T03:01:14.636810+0000', 'last_change': '2024-04-19T03:01:14.636810+0000', 'last_active': '2024-04-19T03:01:14.615919+0000', 'last_peered': '2024-04-19T03:01:14.615919+0000', 'last_clean': '2024-04-19T03:01:14.615919+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T03:01:14.636810+0000', 'last_undegraded': '2024-04-19T03:01:14.636810+0000', 'last_fullsized': '2024-04-19T03:01:14.636810+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T03:01:14.615919+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T03:01:14.615919+0000', 'last_clean_scrub_stamp': '2024-04-19T03:01:14.615919+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-04-20T08:30:22.360053+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-19T03:01:18.715 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.29 is not active+clean 2024-04-19T03:01:18.715 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-19T03:01:14.615919+0000', 'last_change': '2024-04-19T03:01:14.615919+0000', 'last_active': '2024-04-19T03:01:14.615919+0000', 'last_peered': '2024-04-19T03:01:14.615919+0000', 'last_clean': '2024-04-19T03:01:14.615919+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T03:01:14.615919+0000', 'last_undegraded': '2024-04-19T03:01:14.615919+0000', 'last_fullsized': '2024-04-19T03:01:14.615919+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T03:01:14.615919+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T03:01:14.615919+0000', 'last_clean_scrub_stamp': '2024-04-19T03:01:14.615919+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-19T03:01:18.715 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.28 is not active+clean 2024-04-19T03:01:18.715 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-04-19T03:01:14.638185+0000', 'last_change': '2024-04-19T03:01:14.638185+0000', 'last_active': '2024-04-19T03:01:14.615919+0000', 'last_peered': '2024-04-19T03:01:14.615919+0000', 'last_clean': '2024-04-19T03:01:14.615919+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T03:01:14.638185+0000', 'last_undegraded': '2024-04-19T03:01:14.638185+0000', 'last_fullsized': '2024-04-19T03:01:14.638185+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T03:01:14.615919+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T03:01:14.615919+0000', 'last_clean_scrub_stamp': '2024-04-19T03:01:14.615919+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-04-20T08:37:35.950318+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-19T03:01:18.716 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.27 is not active+clean 2024-04-19T03:01:18.716 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-04-19T03:01:14.634353+0000', 'last_change': '2024-04-19T03:01:14.634353+0000', 'last_active': '2024-04-19T03:01:14.615919+0000', 'last_peered': '2024-04-19T03:01:14.615919+0000', 'last_clean': '2024-04-19T03:01:14.615919+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T03:01:14.634353+0000', 'last_undegraded': '2024-04-19T03:01:14.634353+0000', 'last_fullsized': '2024-04-19T03:01:14.634353+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T03:01:14.615919+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T03:01:14.615919+0000', 'last_clean_scrub_stamp': '2024-04-19T03:01:14.615919+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-04-20T07:56:44.307812+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-19T03:01:18.716 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.26 is not active+clean 2024-04-19T03:01:18.716 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-19T03:01:14.615919+0000', 'last_change': '2024-04-19T03:01:14.615919+0000', 'last_active': '2024-04-19T03:01:14.615919+0000', 'last_peered': '2024-04-19T03:01:14.615919+0000', 'last_clean': '2024-04-19T03:01:14.615919+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T03:01:14.615919+0000', 'last_undegraded': '2024-04-19T03:01:14.615919+0000', 'last_fullsized': '2024-04-19T03:01:14.615919+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T03:01:14.615919+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T03:01:14.615919+0000', 'last_clean_scrub_stamp': '2024-04-19T03:01:14.615919+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-19T03:01:18.716 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.25 is not active+clean 2024-04-19T03:01:18.716 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.25', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-04-19T03:01:14.640726+0000', 'last_change': '2024-04-19T03:01:14.640726+0000', 'last_active': '2024-04-19T03:01:14.615919+0000', 'last_peered': '2024-04-19T03:01:14.615919+0000', 'last_clean': '2024-04-19T03:01:14.615919+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T03:01:14.640726+0000', 'last_undegraded': '2024-04-19T03:01:14.640726+0000', 'last_fullsized': '2024-04-19T03:01:14.640726+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T03:01:14.615919+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T03:01:14.615919+0000', 'last_clean_scrub_stamp': '2024-04-19T03:01:14.615919+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-04-20T08:06:35.813797+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-19T03:01:18.716 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.24 is not active+clean 2024-04-19T03:01:18.716 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.24', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-04-19T03:01:14.631256+0000', 'last_change': '2024-04-19T03:01:14.631256+0000', 'last_active': '2024-04-19T03:01:14.615919+0000', 'last_peered': '2024-04-19T03:01:14.615919+0000', 'last_clean': '2024-04-19T03:01:14.615919+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T03:01:14.631256+0000', 'last_undegraded': '2024-04-19T03:01:14.631256+0000', 'last_fullsized': '2024-04-19T03:01:14.631256+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T03:01:14.615919+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T03:01:14.615919+0000', 'last_clean_scrub_stamp': '2024-04-19T03:01:14.615919+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-04-20T09:50:06.490191+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-19T03:01:18.716 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.23 is not active+clean 2024-04-19T03:01:18.716 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-19T03:01:14.615919+0000', 'last_change': '2024-04-19T03:01:14.615919+0000', 'last_active': '2024-04-19T03:01:14.615919+0000', 'last_peered': '2024-04-19T03:01:14.615919+0000', 'last_clean': '2024-04-19T03:01:14.615919+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T03:01:14.615919+0000', 'last_undegraded': '2024-04-19T03:01:14.615919+0000', 'last_fullsized': '2024-04-19T03:01:14.615919+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T03:01:14.615919+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T03:01:14.615919+0000', 'last_clean_scrub_stamp': '2024-04-19T03:01:14.615919+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-19T03:01:18.716 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.22 is not active+clean 2024-04-19T03:01:18.717 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-04-19T03:01:14.630855+0000', 'last_change': '2024-04-19T03:01:14.630855+0000', 'last_active': '2024-04-19T03:01:14.615919+0000', 'last_peered': '2024-04-19T03:01:14.615919+0000', 'last_clean': '2024-04-19T03:01:14.615919+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T03:01:14.630855+0000', 'last_undegraded': '2024-04-19T03:01:14.630855+0000', 'last_fullsized': '2024-04-19T03:01:14.630855+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T03:01:14.615919+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T03:01:14.615919+0000', 'last_clean_scrub_stamp': '2024-04-19T03:01:14.615919+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-04-20T11:10:42.079294+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-19T03:01:18.717 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.21 is not active+clean 2024-04-19T03:01:18.717 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-19T03:01:14.615919+0000', 'last_change': '2024-04-19T03:01:14.615919+0000', 'last_active': '2024-04-19T03:01:14.615919+0000', 'last_peered': '2024-04-19T03:01:14.615919+0000', 'last_clean': '2024-04-19T03:01:14.615919+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T03:01:14.615919+0000', 'last_undegraded': '2024-04-19T03:01:14.615919+0000', 'last_fullsized': '2024-04-19T03:01:14.615919+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T03:01:14.615919+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T03:01:14.615919+0000', 'last_clean_scrub_stamp': '2024-04-19T03:01:14.615919+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-19T03:01:18.717 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.20 is not active+clean 2024-04-19T03:01:18.717 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-04-19T03:01:14.637332+0000', 'last_change': '2024-04-19T03:01:14.637332+0000', 'last_active': '2024-04-19T03:01:14.615919+0000', 'last_peered': '2024-04-19T03:01:14.615919+0000', 'last_clean': '2024-04-19T03:01:14.615919+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T03:01:14.637332+0000', 'last_undegraded': '2024-04-19T03:01:14.637332+0000', 'last_fullsized': '2024-04-19T03:01:14.637332+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T03:01:14.615919+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T03:01:14.615919+0000', 'last_clean_scrub_stamp': '2024-04-19T03:01:14.615919+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-04-20T08:54:54.463918+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-19T03:01:18.717 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.14 is not active+clean 2024-04-19T03:01:18.717 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-04-19T03:01:14.635649+0000', 'last_change': '2024-04-19T03:01:14.635649+0000', 'last_active': '2024-04-19T03:01:14.615919+0000', 'last_peered': '2024-04-19T03:01:14.615919+0000', 'last_clean': '2024-04-19T03:01:14.615919+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T03:01:14.635649+0000', 'last_undegraded': '2024-04-19T03:01:14.635649+0000', 'last_fullsized': '2024-04-19T03:01:14.635649+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T03:01:14.615919+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T03:01:14.615919+0000', 'last_clean_scrub_stamp': '2024-04-19T03:01:14.615919+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-04-20T07:55:34.102680+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-19T03:01:18.717 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.15 is not active+clean 2024-04-19T03:01:18.717 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-04-19T03:01:14.636520+0000', 'last_change': '2024-04-19T03:01:14.636520+0000', 'last_active': '2024-04-19T03:01:14.615919+0000', 'last_peered': '2024-04-19T03:01:14.615919+0000', 'last_clean': '2024-04-19T03:01:14.615919+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T03:01:14.636520+0000', 'last_undegraded': '2024-04-19T03:01:14.636520+0000', 'last_fullsized': '2024-04-19T03:01:14.636520+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T03:01:14.615919+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T03:01:14.615919+0000', 'last_clean_scrub_stamp': '2024-04-19T03:01:14.615919+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-04-20T10:40:12.179703+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-19T03:01:18.717 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.12 is not active+clean 2024-04-19T03:01:18.717 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-04-19T03:01:13.624457+0000', 'last_change': '2024-04-19T03:01:13.624457+0000', 'last_active': '2024-04-19T03:01:13.604133+0000', 'last_peered': '2024-04-19T03:01:13.604133+0000', 'last_clean': '2024-04-19T03:01:13.604133+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T03:01:13.624457+0000', 'last_undegraded': '2024-04-19T03:01:13.624457+0000', 'last_fullsized': '2024-04-19T03:01:13.624457+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T03:01:13.604133+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T03:01:13.604133+0000', 'last_clean_scrub_stamp': '2024-04-19T03:01:13.604133+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-04-20T13:40:53.463388+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-19T03:01:18.718 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.16 is not active+clean 2024-04-19T03:01:18.718 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-19T03:01:14.615919+0000', 'last_change': '2024-04-19T03:01:14.615919+0000', 'last_active': '2024-04-19T03:01:14.615919+0000', 'last_peered': '2024-04-19T03:01:14.615919+0000', 'last_clean': '2024-04-19T03:01:14.615919+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T03:01:14.615919+0000', 'last_undegraded': '2024-04-19T03:01:14.615919+0000', 'last_fullsized': '2024-04-19T03:01:14.615919+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T03:01:14.615919+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T03:01:14.615919+0000', 'last_clean_scrub_stamp': '2024-04-19T03:01:14.615919+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-19T03:01:18.718 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.17 is not active+clean 2024-04-19T03:01:18.718 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-19T03:01:14.615919+0000', 'last_change': '2024-04-19T03:01:14.615919+0000', 'last_active': '2024-04-19T03:01:14.615919+0000', 'last_peered': '2024-04-19T03:01:14.615919+0000', 'last_clean': '2024-04-19T03:01:14.615919+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T03:01:14.615919+0000', 'last_undegraded': '2024-04-19T03:01:14.615919+0000', 'last_fullsized': '2024-04-19T03:01:14.615919+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T03:01:14.615919+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T03:01:14.615919+0000', 'last_clean_scrub_stamp': '2024-04-19T03:01:14.615919+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-19T03:01:18.718 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.8 is not active+clean 2024-04-19T03:01:18.718 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-04-19T03:01:14.634133+0000', 'last_change': '2024-04-19T03:01:14.634133+0000', 'last_active': '2024-04-19T03:01:14.615919+0000', 'last_peered': '2024-04-19T03:01:14.615919+0000', 'last_clean': '2024-04-19T03:01:14.615919+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T03:01:14.634133+0000', 'last_undegraded': '2024-04-19T03:01:14.634133+0000', 'last_fullsized': '2024-04-19T03:01:14.634133+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T03:01:14.615919+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T03:01:14.615919+0000', 'last_clean_scrub_stamp': '2024-04-19T03:01:14.615919+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-04-20T08:54:54.463918+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-19T03:01:18.718 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.9 is not active+clean 2024-04-19T03:01:18.718 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-04-19T03:01:14.637118+0000', 'last_change': '2024-04-19T03:01:14.637118+0000', 'last_active': '2024-04-19T03:01:14.615919+0000', 'last_peered': '2024-04-19T03:01:14.615919+0000', 'last_clean': '2024-04-19T03:01:14.615919+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T03:01:14.637118+0000', 'last_undegraded': '2024-04-19T03:01:14.637118+0000', 'last_fullsized': '2024-04-19T03:01:14.637118+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T03:01:14.615919+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T03:01:14.615919+0000', 'last_clean_scrub_stamp': '2024-04-19T03:01:14.615919+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-04-20T11:13:06.902769+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-19T03:01:18.718 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.a is not active+clean 2024-04-19T03:01:18.718 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-04-19T03:01:14.635329+0000', 'last_change': '2024-04-19T03:01:14.635329+0000', 'last_active': '2024-04-19T03:01:14.615919+0000', 'last_peered': '2024-04-19T03:01:14.615919+0000', 'last_clean': '2024-04-19T03:01:14.615919+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T03:01:14.635329+0000', 'last_undegraded': '2024-04-19T03:01:14.635329+0000', 'last_fullsized': '2024-04-19T03:01:14.635329+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T03:01:14.615919+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T03:01:14.615919+0000', 'last_clean_scrub_stamp': '2024-04-19T03:01:14.615919+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-04-20T09:50:06.490191+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-19T03:01:18.718 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.b is not active+clean 2024-04-19T03:01:18.719 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-19T03:01:14.615919+0000', 'last_change': '2024-04-19T03:01:14.615919+0000', 'last_active': '2024-04-19T03:01:14.615919+0000', 'last_peered': '2024-04-19T03:01:14.615919+0000', 'last_clean': '2024-04-19T03:01:14.615919+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T03:01:14.615919+0000', 'last_undegraded': '2024-04-19T03:01:14.615919+0000', 'last_fullsized': '2024-04-19T03:01:14.615919+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T03:01:14.615919+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T03:01:14.615919+0000', 'last_clean_scrub_stamp': '2024-04-19T03:01:14.615919+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-19T03:01:18.719 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.b is not active+clean 2024-04-19T03:01:18.719 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-04-19T03:01:13.622856+0000', 'last_change': '2024-04-19T03:01:13.622856+0000', 'last_active': '2024-04-19T03:01:13.604133+0000', 'last_peered': '2024-04-19T03:01:13.604133+0000', 'last_clean': '2024-04-19T03:01:13.604133+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T03:01:13.622856+0000', 'last_undegraded': '2024-04-19T03:01:13.622856+0000', 'last_fullsized': '2024-04-19T03:01:13.622856+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T03:01:13.604133+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T03:01:13.604133+0000', 'last_clean_scrub_stamp': '2024-04-19T03:01:13.604133+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-04-20T04:33:45.550646+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-19T03:01:18.719 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.c is not active+clean 2024-04-19T03:01:18.719 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-04-19T03:01:14.633289+0000', 'last_change': '2024-04-19T03:01:14.633289+0000', 'last_active': '2024-04-19T03:01:14.615919+0000', 'last_peered': '2024-04-19T03:01:14.615919+0000', 'last_clean': '2024-04-19T03:01:14.615919+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T03:01:14.633289+0000', 'last_undegraded': '2024-04-19T03:01:14.633289+0000', 'last_fullsized': '2024-04-19T03:01:14.633289+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T03:01:14.615919+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T03:01:14.615919+0000', 'last_clean_scrub_stamp': '2024-04-19T03:01:14.615919+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-04-20T13:54:04.518505+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-19T03:01:18.719 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.d is not active+clean 2024-04-19T03:01:18.719 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-04-19T03:01:14.638921+0000', 'last_change': '2024-04-19T03:01:14.638921+0000', 'last_active': '2024-04-19T03:01:14.615919+0000', 'last_peered': '2024-04-19T03:01:14.615919+0000', 'last_clean': '2024-04-19T03:01:14.615919+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T03:01:14.638921+0000', 'last_undegraded': '2024-04-19T03:01:14.638921+0000', 'last_fullsized': '2024-04-19T03:01:14.638921+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T03:01:14.615919+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T03:01:14.615919+0000', 'last_clean_scrub_stamp': '2024-04-19T03:01:14.615919+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-04-20T06:51:06.208551+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-19T03:01:18.719 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.e is not active+clean 2024-04-19T03:01:18.719 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-04-19T03:01:14.635506+0000', 'last_change': '2024-04-19T03:01:14.635506+0000', 'last_active': '2024-04-19T03:01:14.615919+0000', 'last_peered': '2024-04-19T03:01:14.615919+0000', 'last_clean': '2024-04-19T03:01:14.615919+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T03:01:14.635506+0000', 'last_undegraded': '2024-04-19T03:01:14.635506+0000', 'last_fullsized': '2024-04-19T03:01:14.635506+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T03:01:14.615919+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T03:01:14.615919+0000', 'last_clean_scrub_stamp': '2024-04-19T03:01:14.615919+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-04-20T12:16:20.475837+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-19T03:01:18.719 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.f is not active+clean 2024-04-19T03:01:18.719 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-19T03:01:14.615919+0000', 'last_change': '2024-04-19T03:01:14.615919+0000', 'last_active': '2024-04-19T03:01:14.615919+0000', 'last_peered': '2024-04-19T03:01:14.615919+0000', 'last_clean': '2024-04-19T03:01:14.615919+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T03:01:14.615919+0000', 'last_undegraded': '2024-04-19T03:01:14.615919+0000', 'last_fullsized': '2024-04-19T03:01:14.615919+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T03:01:14.615919+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T03:01:14.615919+0000', 'last_clean_scrub_stamp': '2024-04-19T03:01:14.615919+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-19T03:01:18.720 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2 is not active+clean 2024-04-19T03:01:18.720 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-04-19T03:01:13.622079+0000', 'last_change': '2024-04-19T03:01:13.622079+0000', 'last_active': '2024-04-19T03:01:13.604133+0000', 'last_peered': '2024-04-19T03:01:13.604133+0000', 'last_clean': '2024-04-19T03:01:13.604133+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T03:01:13.622079+0000', 'last_undegraded': '2024-04-19T03:01:13.622079+0000', 'last_fullsized': '2024-04-19T03:01:13.622079+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T03:01:13.604133+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T03:01:13.604133+0000', 'last_clean_scrub_stamp': '2024-04-19T03:01:13.604133+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-04-20T04:24:40.181164+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-19T03:01:18.720 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.5 is not active+clean 2024-04-19T03:01:18.720 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-04-19T03:01:14.633873+0000', 'last_change': '2024-04-19T03:01:14.633873+0000', 'last_active': '2024-04-19T03:01:14.615919+0000', 'last_peered': '2024-04-19T03:01:14.615919+0000', 'last_clean': '2024-04-19T03:01:14.615919+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T03:01:14.633873+0000', 'last_undegraded': '2024-04-19T03:01:14.633873+0000', 'last_fullsized': '2024-04-19T03:01:14.633873+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T03:01:14.615919+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T03:01:14.615919+0000', 'last_clean_scrub_stamp': '2024-04-19T03:01:14.615919+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-04-20T05:00:35.372657+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-19T03:01:18.720 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1 is not active+clean 2024-04-19T03:01:18.720 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-04-19T03:01:13.622230+0000', 'last_change': '2024-04-19T03:01:13.622230+0000', 'last_active': '2024-04-19T03:01:13.604133+0000', 'last_peered': '2024-04-19T03:01:13.604133+0000', 'last_clean': '2024-04-19T03:01:13.604133+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T03:01:13.622230+0000', 'last_undegraded': '2024-04-19T03:01:13.622230+0000', 'last_fullsized': '2024-04-19T03:01:13.622230+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T03:01:13.604133+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T03:01:13.604133+0000', 'last_clean_scrub_stamp': '2024-04-19T03:01:13.604133+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-04-20T13:41:26.108674+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-19T03:01:18.720 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.6 is not active+clean 2024-04-19T03:01:18.720 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-04-19T03:01:14.635678+0000', 'last_change': '2024-04-19T03:01:14.635678+0000', 'last_active': '2024-04-19T03:01:14.615919+0000', 'last_peered': '2024-04-19T03:01:14.615919+0000', 'last_clean': '2024-04-19T03:01:14.615919+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T03:01:14.635678+0000', 'last_undegraded': '2024-04-19T03:01:14.635678+0000', 'last_fullsized': '2024-04-19T03:01:14.635678+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T03:01:14.615919+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T03:01:14.615919+0000', 'last_clean_scrub_stamp': '2024-04-19T03:01:14.615919+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-04-20T13:54:04.518505+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-19T03:01:18.720 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.7 is not active+clean 2024-04-19T03:01:18.720 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-19T03:01:14.615919+0000', 'last_change': '2024-04-19T03:01:14.615919+0000', 'last_active': '2024-04-19T03:01:14.615919+0000', 'last_peered': '2024-04-19T03:01:14.615919+0000', 'last_clean': '2024-04-19T03:01:14.615919+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T03:01:14.615919+0000', 'last_undegraded': '2024-04-19T03:01:14.615919+0000', 'last_fullsized': '2024-04-19T03:01:14.615919+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T03:01:14.615919+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T03:01:14.615919+0000', 'last_clean_scrub_stamp': '2024-04-19T03:01:14.615919+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-19T03:01:18.720 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.4 is not active+clean 2024-04-19T03:01:18.721 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-19T03:01:14.615919+0000', 'last_change': '2024-04-19T03:01:14.615919+0000', 'last_active': '2024-04-19T03:01:14.615919+0000', 'last_peered': '2024-04-19T03:01:14.615919+0000', 'last_clean': '2024-04-19T03:01:14.615919+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T03:01:14.615919+0000', 'last_undegraded': '2024-04-19T03:01:14.615919+0000', 'last_fullsized': '2024-04-19T03:01:14.615919+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T03:01:14.615919+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T03:01:14.615919+0000', 'last_clean_scrub_stamp': '2024-04-19T03:01:14.615919+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-19T03:01:18.721 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2 is not active+clean 2024-04-19T03:01:18.721 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-04-19T03:01:14.635161+0000', 'last_change': '2024-04-19T03:01:14.635161+0000', 'last_active': '2024-04-19T03:01:14.615919+0000', 'last_peered': '2024-04-19T03:01:14.615919+0000', 'last_clean': '2024-04-19T03:01:14.615919+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T03:01:14.635161+0000', 'last_undegraded': '2024-04-19T03:01:14.635161+0000', 'last_fullsized': '2024-04-19T03:01:14.635161+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T03:01:14.615919+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T03:01:14.615919+0000', 'last_clean_scrub_stamp': '2024-04-19T03:01:14.615919+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-04-20T05:22:58.349159+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-19T03:01:18.721 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.4 is not active+clean 2024-04-19T03:01:18.721 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-04-19T03:01:13.622643+0000', 'last_change': '2024-04-19T03:01:13.622643+0000', 'last_active': '2024-04-19T03:01:13.604133+0000', 'last_peered': '2024-04-19T03:01:13.604133+0000', 'last_clean': '2024-04-19T03:01:13.604133+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T03:01:13.622643+0000', 'last_undegraded': '2024-04-19T03:01:13.622643+0000', 'last_fullsized': '2024-04-19T03:01:13.622643+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T03:01:13.604133+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T03:01:13.604133+0000', 'last_clean_scrub_stamp': '2024-04-19T03:01:13.604133+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-04-20T04:40:40.193720+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-19T03:01:18.721 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3 is not active+clean 2024-04-19T03:01:18.721 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-04-19T03:01:14.634209+0000', 'last_change': '2024-04-19T03:01:14.634209+0000', 'last_active': '2024-04-19T03:01:14.615919+0000', 'last_peered': '2024-04-19T03:01:14.615919+0000', 'last_clean': '2024-04-19T03:01:14.615919+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T03:01:14.634209+0000', 'last_undegraded': '2024-04-19T03:01:14.634209+0000', 'last_fullsized': '2024-04-19T03:01:14.634209+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T03:01:14.615919+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T03:01:14.615919+0000', 'last_clean_scrub_stamp': '2024-04-19T03:01:14.615919+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-04-20T11:39:54.289444+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-19T03:01:18.721 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.7 is not active+clean 2024-04-19T03:01:18.721 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-04-19T03:01:13.622569+0000', 'last_change': '2024-04-19T03:01:13.622569+0000', 'last_active': '2024-04-19T03:01:13.604133+0000', 'last_peered': '2024-04-19T03:01:13.604133+0000', 'last_clean': '2024-04-19T03:01:13.604133+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T03:01:13.622569+0000', 'last_undegraded': '2024-04-19T03:01:13.622569+0000', 'last_fullsized': '2024-04-19T03:01:13.622569+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T03:01:13.604133+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T03:01:13.604133+0000', 'last_clean_scrub_stamp': '2024-04-19T03:01:13.604133+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-04-20T03:28:14.128657+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-19T03:01:18.721 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.0 is not active+clean 2024-04-19T03:01:18.721 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-19T03:01:14.615919+0000', 'last_change': '2024-04-19T03:01:14.615919+0000', 'last_active': '2024-04-19T03:01:14.615919+0000', 'last_peered': '2024-04-19T03:01:14.615919+0000', 'last_clean': '2024-04-19T03:01:14.615919+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T03:01:14.615919+0000', 'last_undegraded': '2024-04-19T03:01:14.615919+0000', 'last_fullsized': '2024-04-19T03:01:14.615919+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T03:01:14.615919+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T03:01:14.615919+0000', 'last_clean_scrub_stamp': '2024-04-19T03:01:14.615919+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-19T03:01:18.722 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.6 is not active+clean 2024-04-19T03:01:18.722 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-04-19T03:01:13.622364+0000', 'last_change': '2024-04-19T03:01:13.622364+0000', 'last_active': '2024-04-19T03:01:13.604133+0000', 'last_peered': '2024-04-19T03:01:13.604133+0000', 'last_clean': '2024-04-19T03:01:13.604133+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T03:01:13.622364+0000', 'last_undegraded': '2024-04-19T03:01:13.622364+0000', 'last_fullsized': '2024-04-19T03:01:13.622364+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T03:01:13.604133+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T03:01:13.604133+0000', 'last_clean_scrub_stamp': '2024-04-19T03:01:13.604133+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-04-20T10:32:41.909038+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-19T03:01:18.722 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1 is not active+clean 2024-04-19T03:01:18.722 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-04-19T03:01:14.635200+0000', 'last_change': '2024-04-19T03:01:14.635200+0000', 'last_active': '2024-04-19T03:01:14.615919+0000', 'last_peered': '2024-04-19T03:01:14.615919+0000', 'last_clean': '2024-04-19T03:01:14.615919+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T03:01:14.635200+0000', 'last_undegraded': '2024-04-19T03:01:14.635200+0000', 'last_fullsized': '2024-04-19T03:01:14.635200+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T03:01:14.615919+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T03:01:14.615919+0000', 'last_clean_scrub_stamp': '2024-04-19T03:01:14.615919+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-04-20T13:40:59.453079+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-19T03:01:18.722 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.13 is not active+clean 2024-04-19T03:01:18.722 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-04-19T03:01:14.635874+0000', 'last_change': '2024-04-19T03:01:14.635874+0000', 'last_active': '2024-04-19T03:01:14.615919+0000', 'last_peered': '2024-04-19T03:01:14.615919+0000', 'last_clean': '2024-04-19T03:01:14.615919+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T03:01:14.635874+0000', 'last_undegraded': '2024-04-19T03:01:14.635874+0000', 'last_fullsized': '2024-04-19T03:01:14.635874+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T03:01:14.615919+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T03:01:14.615919+0000', 'last_clean_scrub_stamp': '2024-04-19T03:01:14.615919+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-04-20T08:59:49.270245+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-19T03:01:18.722 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.12 is not active+clean 2024-04-19T03:01:18.722 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-19T03:01:14.615919+0000', 'last_change': '2024-04-19T03:01:14.615919+0000', 'last_active': '2024-04-19T03:01:14.615919+0000', 'last_peered': '2024-04-19T03:01:14.615919+0000', 'last_clean': '2024-04-19T03:01:14.615919+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T03:01:14.615919+0000', 'last_undegraded': '2024-04-19T03:01:14.615919+0000', 'last_fullsized': '2024-04-19T03:01:14.615919+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T03:01:14.615919+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T03:01:14.615919+0000', 'last_clean_scrub_stamp': '2024-04-19T03:01:14.615919+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-19T03:01:18.722 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.11 is not active+clean 2024-04-19T03:01:18.722 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-19T03:01:14.615919+0000', 'last_change': '2024-04-19T03:01:14.615919+0000', 'last_active': '2024-04-19T03:01:14.615919+0000', 'last_peered': '2024-04-19T03:01:14.615919+0000', 'last_clean': '2024-04-19T03:01:14.615919+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T03:01:14.615919+0000', 'last_undegraded': '2024-04-19T03:01:14.615919+0000', 'last_fullsized': '2024-04-19T03:01:14.615919+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T03:01:14.615919+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T03:01:14.615919+0000', 'last_clean_scrub_stamp': '2024-04-19T03:01:14.615919+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-19T03:01:18.723 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.17 is not active+clean 2024-04-19T03:01:18.723 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-04-19T03:01:13.624713+0000', 'last_change': '2024-04-19T03:01:13.624713+0000', 'last_active': '2024-04-19T03:01:13.604133+0000', 'last_peered': '2024-04-19T03:01:13.604133+0000', 'last_clean': '2024-04-19T03:01:13.604133+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T03:01:13.624713+0000', 'last_undegraded': '2024-04-19T03:01:13.624713+0000', 'last_fullsized': '2024-04-19T03:01:13.624713+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T03:01:13.604133+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T03:01:13.604133+0000', 'last_clean_scrub_stamp': '2024-04-19T03:01:13.604133+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-04-20T05:22:38.096801+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-19T03:01:18.723 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.10 is not active+clean 2024-04-19T03:01:18.723 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-19T03:01:14.615919+0000', 'last_change': '2024-04-19T03:01:14.615919+0000', 'last_active': '2024-04-19T03:01:14.615919+0000', 'last_peered': '2024-04-19T03:01:14.615919+0000', 'last_clean': '2024-04-19T03:01:14.615919+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T03:01:14.615919+0000', 'last_undegraded': '2024-04-19T03:01:14.615919+0000', 'last_fullsized': '2024-04-19T03:01:14.615919+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T03:01:14.615919+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T03:01:14.615919+0000', 'last_clean_scrub_stamp': '2024-04-19T03:01:14.615919+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-19T03:01:18.723 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1f is not active+clean 2024-04-19T03:01:18.723 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-04-19T03:01:14.631624+0000', 'last_change': '2024-04-19T03:01:14.631624+0000', 'last_active': '2024-04-19T03:01:14.615919+0000', 'last_peered': '2024-04-19T03:01:14.615919+0000', 'last_clean': '2024-04-19T03:01:14.615919+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T03:01:14.631624+0000', 'last_undegraded': '2024-04-19T03:01:14.631624+0000', 'last_fullsized': '2024-04-19T03:01:14.631624+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T03:01:14.615919+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T03:01:14.615919+0000', 'last_clean_scrub_stamp': '2024-04-19T03:01:14.615919+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-04-20T14:40:53.477682+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-19T03:01:18.723 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.18 is not active+clean 2024-04-19T03:01:18.723 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-04-19T03:01:13.622719+0000', 'last_change': '2024-04-19T03:01:13.622719+0000', 'last_active': '2024-04-19T03:01:13.604133+0000', 'last_peered': '2024-04-19T03:01:13.604133+0000', 'last_clean': '2024-04-19T03:01:13.604133+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T03:01:13.622719+0000', 'last_undegraded': '2024-04-19T03:01:13.622719+0000', 'last_fullsized': '2024-04-19T03:01:13.622719+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T03:01:13.604133+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T03:01:13.604133+0000', 'last_clean_scrub_stamp': '2024-04-19T03:01:13.604133+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-04-20T06:05:36.752017+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-19T03:01:18.723 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1e is not active+clean 2024-04-19T03:01:18.723 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-19T03:01:14.615919+0000', 'last_change': '2024-04-19T03:01:14.615919+0000', 'last_active': '2024-04-19T03:01:14.615919+0000', 'last_peered': '2024-04-19T03:01:14.615919+0000', 'last_clean': '2024-04-19T03:01:14.615919+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T03:01:14.615919+0000', 'last_undegraded': '2024-04-19T03:01:14.615919+0000', 'last_fullsized': '2024-04-19T03:01:14.615919+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T03:01:14.615919+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T03:01:14.615919+0000', 'last_clean_scrub_stamp': '2024-04-19T03:01:14.615919+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-19T03:01:18.723 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.19 is not active+clean 2024-04-19T03:01:18.724 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-04-19T03:01:13.624540+0000', 'last_change': '2024-04-19T03:01:13.624540+0000', 'last_active': '2024-04-19T03:01:13.604133+0000', 'last_peered': '2024-04-19T03:01:13.604133+0000', 'last_clean': '2024-04-19T03:01:13.604133+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T03:01:13.624540+0000', 'last_undegraded': '2024-04-19T03:01:13.624540+0000', 'last_fullsized': '2024-04-19T03:01:13.624540+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T03:01:13.604133+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T03:01:13.604133+0000', 'last_clean_scrub_stamp': '2024-04-19T03:01:13.604133+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-04-20T09:56:15.348940+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-19T03:01:18.724 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1d is not active+clean 2024-04-19T03:01:18.724 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-04-19T03:01:14.637577+0000', 'last_change': '2024-04-19T03:01:14.637577+0000', 'last_active': '2024-04-19T03:01:14.615919+0000', 'last_peered': '2024-04-19T03:01:14.615919+0000', 'last_clean': '2024-04-19T03:01:14.615919+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T03:01:14.637577+0000', 'last_undegraded': '2024-04-19T03:01:14.637577+0000', 'last_fullsized': '2024-04-19T03:01:14.637577+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T03:01:14.615919+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T03:01:14.615919+0000', 'last_clean_scrub_stamp': '2024-04-19T03:01:14.615919+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-04-20T07:10:56.732208+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-19T03:01:18.724 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1c is not active+clean 2024-04-19T03:01:18.724 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-04-19T03:01:14.636855+0000', 'last_change': '2024-04-19T03:01:14.636855+0000', 'last_active': '2024-04-19T03:01:14.615919+0000', 'last_peered': '2024-04-19T03:01:14.615919+0000', 'last_clean': '2024-04-19T03:01:14.615919+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T03:01:14.636855+0000', 'last_undegraded': '2024-04-19T03:01:14.636855+0000', 'last_fullsized': '2024-04-19T03:01:14.636855+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T03:01:14.615919+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T03:01:14.615919+0000', 'last_clean_scrub_stamp': '2024-04-19T03:01:14.615919+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-04-20T03:36:36.363535+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-19T03:01:18.724 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1b is not active+clean 2024-04-19T03:01:18.724 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-04-19T03:01:14.637651+0000', 'last_change': '2024-04-19T03:01:14.637651+0000', 'last_active': '2024-04-19T03:01:14.615919+0000', 'last_peered': '2024-04-19T03:01:14.615919+0000', 'last_clean': '2024-04-19T03:01:14.615919+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T03:01:14.637651+0000', 'last_undegraded': '2024-04-19T03:01:14.637651+0000', 'last_fullsized': '2024-04-19T03:01:14.637651+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T03:01:14.615919+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T03:01:14.615919+0000', 'last_clean_scrub_stamp': '2024-04-19T03:01:14.615919+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-04-20T07:56:44.307812+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-19T03:01:18.724 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1a is not active+clean 2024-04-19T03:01:18.724 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-04-19T03:01:14.633087+0000', 'last_change': '2024-04-19T03:01:14.633087+0000', 'last_active': '2024-04-19T03:01:14.615919+0000', 'last_peered': '2024-04-19T03:01:14.615919+0000', 'last_clean': '2024-04-19T03:01:14.615919+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T03:01:14.633087+0000', 'last_undegraded': '2024-04-19T03:01:14.633087+0000', 'last_fullsized': '2024-04-19T03:01:14.633087+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T03:01:14.615919+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T03:01:14.615919+0000', 'last_clean_scrub_stamp': '2024-04-19T03:01:14.615919+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-04-20T11:13:06.902769+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-19T03:01:18.724 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.19 is not active+clean 2024-04-19T03:01:18.724 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-04-19T03:01:14.630820+0000', 'last_change': '2024-04-19T03:01:14.630820+0000', 'last_active': '2024-04-19T03:01:14.615919+0000', 'last_peered': '2024-04-19T03:01:14.615919+0000', 'last_clean': '2024-04-19T03:01:14.615919+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T03:01:14.630820+0000', 'last_undegraded': '2024-04-19T03:01:14.630820+0000', 'last_fullsized': '2024-04-19T03:01:14.630820+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T03:01:14.615919+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T03:01:14.615919+0000', 'last_clean_scrub_stamp': '2024-04-19T03:01:14.615919+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-04-20T05:14:57.922917+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-19T03:01:18.725 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1e is not active+clean 2024-04-19T03:01:18.725 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-04-19T03:01:13.624316+0000', 'last_change': '2024-04-19T03:01:13.624316+0000', 'last_active': '2024-04-19T03:01:13.604133+0000', 'last_peered': '2024-04-19T03:01:13.604133+0000', 'last_clean': '2024-04-19T03:01:13.604133+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T03:01:13.624316+0000', 'last_undegraded': '2024-04-19T03:01:13.624316+0000', 'last_fullsized': '2024-04-19T03:01:13.624316+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T03:01:13.604133+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T03:01:13.604133+0000', 'last_clean_scrub_stamp': '2024-04-19T03:01:13.604133+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-04-20T03:56:05.481089+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-19T03:01:18.725 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.18 is not active+clean 2024-04-19T03:01:18.725 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 19, 'state': 'creating+peering', 'last_fresh': '2024-04-19T03:01:14.633427+0000', 'last_change': '2024-04-19T03:01:14.633427+0000', 'last_active': '2024-04-19T03:01:14.615919+0000', 'last_peered': '2024-04-19T03:01:14.615919+0000', 'last_clean': '2024-04-19T03:01:14.615919+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T03:01:14.633427+0000', 'last_undegraded': '2024-04-19T03:01:14.633427+0000', 'last_fullsized': '2024-04-19T03:01:14.633427+0000', 'mapping_epoch': 19, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 19, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T03:01:14.615919+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T03:01:14.615919+0000', 'last_clean_scrub_stamp': '2024-04-19T03:01:14.615919+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-04-20T10:13:26.030579+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-19T03:01:18.725 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1f is not active+clean 2024-04-19T03:01:18.725 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 18, 'state': 'creating+peering', 'last_fresh': '2024-04-19T03:01:13.626135+0000', 'last_change': '2024-04-19T03:01:13.626135+0000', 'last_active': '2024-04-19T03:01:13.604133+0000', 'last_peered': '2024-04-19T03:01:13.604133+0000', 'last_clean': '2024-04-19T03:01:13.604133+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-19T03:01:13.626135+0000', 'last_undegraded': '2024-04-19T03:01:13.626135+0000', 'last_fullsized': '2024-04-19T03:01:13.626135+0000', 'mapping_epoch': 18, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 18, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-19T03:01:13.604133+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-19T03:01:13.604133+0000', 'last_clean_scrub_stamp': '2024-04-19T03:01:13.604133+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-04-20T06:09:04.022991+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-19T03:01:18.725 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-19T03:01:19.083 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-19T03:01:19.083 INFO:teuthology.orchestra.run.smithi096.stdout:{"fsid":"c6cc8e09-11d4-48de-9a6c-4d70ed3c3789","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":25,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":21,"num_osds":3,"num_up_osds":3,"osd_up_since":1713495664,"num_in_osds":3,"osd_in_since":1713495654,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":58},{"state_name":"active+clean","count":29},{"state_name":"unknown","count":18}],"num_pgs":105,"num_pools":4,"num_objects":2,"data_bytes":590368,"bytes_used":96165888,"bytes_avail":289814126592,"bytes_total":289910292480,"unknown_pgs_ratio":0.17142857611179352,"inactive_pgs_ratio":0.55238097906112671},"fsmap":{"epoch":5,"id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"a","status":"up:active","gid":4202}],"up:standby":0},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":1,"modified":"2024-04-19T03:00:53.748211+0000","services":{}},"progress_events":{}} 2024-04-19T03:01:19.098 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-04-19T03:01:19.098 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-19T03:01:19.399 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-19T03:01:19.400 INFO:teuthology.orchestra.run.smithi096.stderr:dumped all 2024-04-19T03:01:19.413 INFO:teuthology.orchestra.run.smithi096.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2024-04-19T03:01:17.943902+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":174,"acting":174,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":38,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":93912,"kb_used_data":560,"kb_used_omap":4,"kb_used_meta":93307,"kb_avail":283021608,"statfs":{"total":289910292480,"available":289814126592,"internally_reserved":0,"allocated":573440,"data_stored":1320361,"data_compressed":14482,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":4782,"internal_metadata":95546706},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.326899"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-04-19T03:01:14.636530+0000","last_change":"2024-04-19T03:01:14.636530+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.636530+0000","last_undegraded":"2024-04-19T03:01:14.636530+0000","last_fullsized":"2024-04-19T03:01:14.636530+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:13:26.030579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-04-19T03:01:14.638657+0000","last_change":"2024-04-19T03:01:14.638657+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.638657+0000","last_undegraded":"2024-04-19T03:01:14.638657+0000","last_fullsized":"2024-04-19T03:01:14.638657+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:48:13.389356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-04-19T03:01:14.641392+0000","last_change":"2024-04-19T03:01:14.641392+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.641392+0000","last_undegraded":"2024-04-19T03:01:14.641392+0000","last_fullsized":"2024-04-19T03:01:14.641392+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:35:19.436344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-04-19T03:01:14.638667+0000","last_change":"2024-04-19T03:01:14.638667+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.638667+0000","last_undegraded":"2024-04-19T03:01:14.638667+0000","last_fullsized":"2024-04-19T03:01:14.638667+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:30:22.360053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-04-19T03:01:14.631489+0000","last_change":"2024-04-19T03:01:14.631489+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.631489+0000","last_undegraded":"2024-04-19T03:01:14.631489+0000","last_fullsized":"2024-04-19T03:01:14.631489+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:31:51.982582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-04-19T03:01:14.638578+0000","last_change":"2024-04-19T03:01:14.638578+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.638578+0000","last_undegraded":"2024-04-19T03:01:14.638578+0000","last_fullsized":"2024-04-19T03:01:14.638578+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:22:58.349159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-04-19T03:01:14.636323+0000","last_change":"2024-04-19T03:01:14.636323+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.636323+0000","last_undegraded":"2024-04-19T03:01:14.636323+0000","last_fullsized":"2024-04-19T03:01:14.636323+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:48:13.389356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-04-19T03:01:14.640018+0000","last_change":"2024-04-19T03:01:14.640018+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.640018+0000","last_undegraded":"2024-04-19T03:01:14.640018+0000","last_fullsized":"2024-04-19T03:01:14.640018+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:09:23.427311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T03:01:14.615919+0000","last_change":"2024-04-19T03:01:14.615919+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.615919+0000","last_undegraded":"2024-04-19T03:01:14.615919+0000","last_fullsized":"2024-04-19T03:01:14.615919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-04-19T03:01:14.637573+0000","last_change":"2024-04-19T03:01:14.637573+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.637573+0000","last_undegraded":"2024-04-19T03:01:14.637573+0000","last_fullsized":"2024-04-19T03:01:14.637573+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:10:21.967941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-04-19T03:01:14.641049+0000","last_change":"2024-04-19T03:01:14.641049+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.641049+0000","last_undegraded":"2024-04-19T03:01:14.641049+0000","last_fullsized":"2024-04-19T03:01:14.641049+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:10:56.732208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-04-19T03:01:14.638345+0000","last_change":"2024-04-19T03:01:14.638345+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.638345+0000","last_undegraded":"2024-04-19T03:01:14.638345+0000","last_fullsized":"2024-04-19T03:01:14.638345+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:09:23.427311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-04-19T03:01:14.636683+0000","last_change":"2024-04-19T03:01:14.636683+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.636683+0000","last_undegraded":"2024-04-19T03:01:14.636683+0000","last_fullsized":"2024-04-19T03:01:14.636683+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:07:57.843767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-04-19T03:01:14.636154+0000","last_change":"2024-04-19T03:01:14.636154+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.636154+0000","last_undegraded":"2024-04-19T03:01:14.636154+0000","last_fullsized":"2024-04-19T03:01:14.636154+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:21:36.129346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-04-19T03:01:14.634523+0000","last_change":"2024-04-19T03:01:14.634523+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.634523+0000","last_undegraded":"2024-04-19T03:01:14.634523+0000","last_fullsized":"2024-04-19T03:01:14.634523+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:01:54.253963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-04-19T03:01:14.638699+0000","last_change":"2024-04-19T03:01:14.638699+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.638699+0000","last_undegraded":"2024-04-19T03:01:14.638699+0000","last_fullsized":"2024-04-19T03:01:14.638699+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:40:59.453079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T03:01:14.615919+0000","last_change":"2024-04-19T03:01:14.615919+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.615919+0000","last_undegraded":"2024-04-19T03:01:14.615919+0000","last_fullsized":"2024-04-19T03:01:14.615919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-04-19T03:01:14.632656+0000","last_change":"2024-04-19T03:01:14.632656+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.632656+0000","last_undegraded":"2024-04-19T03:01:14.632656+0000","last_fullsized":"2024-04-19T03:01:14.632656+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:40:20.790332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T03:01:14.615919+0000","last_change":"2024-04-19T03:01:14.615919+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.615919+0000","last_undegraded":"2024-04-19T03:01:14.615919+0000","last_fullsized":"2024-04-19T03:01:14.615919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-04-19T03:01:14.637003+0000","last_change":"2024-04-19T03:01:14.637003+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.637003+0000","last_undegraded":"2024-04-19T03:01:14.637003+0000","last_fullsized":"2024-04-19T03:01:14.637003+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:39:54.289444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-04-19T03:01:14.633108+0000","last_change":"2024-04-19T03:01:14.633108+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.633108+0000","last_undegraded":"2024-04-19T03:01:14.633108+0000","last_fullsized":"2024-04-19T03:01:14.633108+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:10:21.967941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-04-19T03:01:14.636810+0000","last_change":"2024-04-19T03:01:14.636810+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.636810+0000","last_undegraded":"2024-04-19T03:01:14.636810+0000","last_fullsized":"2024-04-19T03:01:14.636810+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:30:22.360053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T03:01:14.615919+0000","last_change":"2024-04-19T03:01:14.615919+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.615919+0000","last_undegraded":"2024-04-19T03:01:14.615919+0000","last_fullsized":"2024-04-19T03:01:14.615919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-04-19T03:01:14.638185+0000","last_change":"2024-04-19T03:01:14.638185+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.638185+0000","last_undegraded":"2024-04-19T03:01:14.638185+0000","last_fullsized":"2024-04-19T03:01:14.638185+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:37:35.950318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-04-19T03:01:14.634353+0000","last_change":"2024-04-19T03:01:14.634353+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.634353+0000","last_undegraded":"2024-04-19T03:01:14.634353+0000","last_fullsized":"2024-04-19T03:01:14.634353+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:56:44.307812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T03:01:14.615919+0000","last_change":"2024-04-19T03:01:14.615919+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.615919+0000","last_undegraded":"2024-04-19T03:01:14.615919+0000","last_fullsized":"2024-04-19T03:01:14.615919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-04-19T03:01:14.640726+0000","last_change":"2024-04-19T03:01:14.640726+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.640726+0000","last_undegraded":"2024-04-19T03:01:14.640726+0000","last_fullsized":"2024-04-19T03:01:14.640726+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:06:35.813797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-04-19T03:01:14.631256+0000","last_change":"2024-04-19T03:01:14.631256+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.631256+0000","last_undegraded":"2024-04-19T03:01:14.631256+0000","last_fullsized":"2024-04-19T03:01:14.631256+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:50:06.490191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T03:01:14.615919+0000","last_change":"2024-04-19T03:01:14.615919+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.615919+0000","last_undegraded":"2024-04-19T03:01:14.615919+0000","last_fullsized":"2024-04-19T03:01:14.615919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-04-19T03:01:14.630855+0000","last_change":"2024-04-19T03:01:14.630855+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.630855+0000","last_undegraded":"2024-04-19T03:01:14.630855+0000","last_fullsized":"2024-04-19T03:01:14.630855+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:10:42.079294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T03:01:14.615919+0000","last_change":"2024-04-19T03:01:14.615919+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.615919+0000","last_undegraded":"2024-04-19T03:01:14.615919+0000","last_fullsized":"2024-04-19T03:01:14.615919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-04-19T03:01:14.637332+0000","last_change":"2024-04-19T03:01:14.637332+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.637332+0000","last_undegraded":"2024-04-19T03:01:14.637332+0000","last_fullsized":"2024-04-19T03:01:14.637332+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:54:54.463918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-04-19T03:01:14.635649+0000","last_change":"2024-04-19T03:01:14.635649+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.635649+0000","last_undegraded":"2024-04-19T03:01:14.635649+0000","last_fullsized":"2024-04-19T03:01:14.635649+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:55:34.102680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T03:01:14.654351+0000","last_change":"2024-04-19T03:01:14.651050+0000","last_active":"2024-04-19T03:01:14.654351+0000","last_peered":"2024-04-19T03:01:14.654351+0000","last_clean":"2024-04-19T03:01:14.654351+0000","last_became_active":"2024-04-19T03:01:14.650679+0000","last_became_peered":"2024-04-19T03:01:14.650679+0000","last_unstale":"2024-04-19T03:01:14.654351+0000","last_undegraded":"2024-04-19T03:01:14.654351+0000","last_fullsized":"2024-04-19T03:01:14.654351+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:37:03.684394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-04-19T03:01:14.636520+0000","last_change":"2024-04-19T03:01:14.636520+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.636520+0000","last_undegraded":"2024-04-19T03:01:14.636520+0000","last_fullsized":"2024-04-19T03:01:14.636520+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:40:12.179703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-04-19T03:01:13.624457+0000","last_change":"2024-04-19T03:01:13.624457+0000","last_active":"2024-04-19T03:01:13.604133+0000","last_peered":"2024-04-19T03:01:13.604133+0000","last_clean":"2024-04-19T03:01:13.604133+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:13.624457+0000","last_undegraded":"2024-04-19T03:01:13.624457+0000","last_fullsized":"2024-04-19T03:01:13.624457+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:40:53.463388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T03:01:14.615919+0000","last_change":"2024-04-19T03:01:14.615919+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.615919+0000","last_undegraded":"2024-04-19T03:01:14.615919+0000","last_fullsized":"2024-04-19T03:01:14.615919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T03:01:14.650574+0000","last_change":"2024-04-19T03:01:14.649074+0000","last_active":"2024-04-19T03:01:14.650574+0000","last_peered":"2024-04-19T03:01:14.650574+0000","last_clean":"2024-04-19T03:01:14.650574+0000","last_became_active":"2024-04-19T03:01:14.648217+0000","last_became_peered":"2024-04-19T03:01:14.648217+0000","last_unstale":"2024-04-19T03:01:14.650574+0000","last_undegraded":"2024-04-19T03:01:14.650574+0000","last_fullsized":"2024-04-19T03:01:14.650574+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:57:05.238043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T03:01:14.615919+0000","last_change":"2024-04-19T03:01:14.615919+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.615919+0000","last_undegraded":"2024-04-19T03:01:14.615919+0000","last_fullsized":"2024-04-19T03:01:14.615919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T03:01:14.651960+0000","last_change":"2024-04-19T03:01:14.649044+0000","last_active":"2024-04-19T03:01:14.651960+0000","last_peered":"2024-04-19T03:01:14.651960+0000","last_clean":"2024-04-19T03:01:14.651960+0000","last_became_active":"2024-04-19T03:01:14.648859+0000","last_became_peered":"2024-04-19T03:01:14.648859+0000","last_unstale":"2024-04-19T03:01:14.651960+0000","last_undegraded":"2024-04-19T03:01:14.651960+0000","last_fullsized":"2024-04-19T03:01:14.651960+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:30:45.925657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T03:01:14.652044+0000","last_change":"2024-04-19T03:01:14.649839+0000","last_active":"2024-04-19T03:01:14.652044+0000","last_peered":"2024-04-19T03:01:14.652044+0000","last_clean":"2024-04-19T03:01:14.652044+0000","last_became_active":"2024-04-19T03:01:14.649571+0000","last_became_peered":"2024-04-19T03:01:14.649571+0000","last_unstale":"2024-04-19T03:01:14.652044+0000","last_undegraded":"2024-04-19T03:01:14.652044+0000","last_fullsized":"2024-04-19T03:01:14.652044+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:03:57.839660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-04-19T03:01:14.634133+0000","last_change":"2024-04-19T03:01:14.634133+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.634133+0000","last_undegraded":"2024-04-19T03:01:14.634133+0000","last_fullsized":"2024-04-19T03:01:14.634133+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:54:54.463918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T03:01:14.646089+0000","last_change":"2024-04-19T03:01:14.645075+0000","last_active":"2024-04-19T03:01:14.646089+0000","last_peered":"2024-04-19T03:01:14.646089+0000","last_clean":"2024-04-19T03:01:14.646089+0000","last_became_active":"2024-04-19T03:01:14.644790+0000","last_became_peered":"2024-04-19T03:01:14.644790+0000","last_unstale":"2024-04-19T03:01:14.646089+0000","last_undegraded":"2024-04-19T03:01:14.646089+0000","last_fullsized":"2024-04-19T03:01:14.646089+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:55:15.035769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-04-19T03:01:14.637118+0000","last_change":"2024-04-19T03:01:14.637118+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.637118+0000","last_undegraded":"2024-04-19T03:01:14.637118+0000","last_fullsized":"2024-04-19T03:01:14.637118+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:13:06.902769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T03:01:14.652024+0000","last_change":"2024-04-19T03:01:14.649826+0000","last_active":"2024-04-19T03:01:14.652024+0000","last_peered":"2024-04-19T03:01:14.652024+0000","last_clean":"2024-04-19T03:01:14.652024+0000","last_became_active":"2024-04-19T03:01:14.649565+0000","last_became_peered":"2024-04-19T03:01:14.649565+0000","last_unstale":"2024-04-19T03:01:14.652024+0000","last_undegraded":"2024-04-19T03:01:14.652024+0000","last_fullsized":"2024-04-19T03:01:14.652024+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:36:00.962931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-04-19T03:01:14.635329+0000","last_change":"2024-04-19T03:01:14.635329+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.635329+0000","last_undegraded":"2024-04-19T03:01:14.635329+0000","last_fullsized":"2024-04-19T03:01:14.635329+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:50:06.490191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T03:01:14.654439+0000","last_change":"2024-04-19T03:01:14.651201+0000","last_active":"2024-04-19T03:01:14.654439+0000","last_peered":"2024-04-19T03:01:14.654439+0000","last_clean":"2024-04-19T03:01:14.654439+0000","last_became_active":"2024-04-19T03:01:14.650942+0000","last_became_peered":"2024-04-19T03:01:14.650942+0000","last_unstale":"2024-04-19T03:01:14.654439+0000","last_undegraded":"2024-04-19T03:01:14.654439+0000","last_fullsized":"2024-04-19T03:01:14.654439+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:02:13.190917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T03:01:14.615919+0000","last_change":"2024-04-19T03:01:14.615919+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.615919+0000","last_undegraded":"2024-04-19T03:01:14.615919+0000","last_fullsized":"2024-04-19T03:01:14.615919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-04-19T03:01:13.622856+0000","last_change":"2024-04-19T03:01:13.622856+0000","last_active":"2024-04-19T03:01:13.604133+0000","last_peered":"2024-04-19T03:01:13.604133+0000","last_clean":"2024-04-19T03:01:13.604133+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:13.622856+0000","last_undegraded":"2024-04-19T03:01:13.622856+0000","last_fullsized":"2024-04-19T03:01:13.622856+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:33:45.550646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-04-19T03:01:14.633289+0000","last_change":"2024-04-19T03:01:14.633289+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.633289+0000","last_undegraded":"2024-04-19T03:01:14.633289+0000","last_fullsized":"2024-04-19T03:01:14.633289+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:54:04.518505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T03:01:14.654389+0000","last_change":"2024-04-19T03:01:14.651004+0000","last_active":"2024-04-19T03:01:14.654389+0000","last_peered":"2024-04-19T03:01:14.654389+0000","last_clean":"2024-04-19T03:01:14.654389+0000","last_became_active":"2024-04-19T03:01:14.650635+0000","last_became_peered":"2024-04-19T03:01:14.650635+0000","last_unstale":"2024-04-19T03:01:14.654389+0000","last_undegraded":"2024-04-19T03:01:14.654389+0000","last_fullsized":"2024-04-19T03:01:14.654389+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:57:15.575819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-04-19T03:01:14.638921+0000","last_change":"2024-04-19T03:01:14.638921+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.638921+0000","last_undegraded":"2024-04-19T03:01:14.638921+0000","last_fullsized":"2024-04-19T03:01:14.638921+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:51:06.208551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T03:01:14.646112+0000","last_change":"2024-04-19T03:01:14.644582+0000","last_active":"2024-04-19T03:01:14.646112+0000","last_peered":"2024-04-19T03:01:14.646112+0000","last_clean":"2024-04-19T03:01:14.646112+0000","last_became_active":"2024-04-19T03:01:14.644101+0000","last_became_peered":"2024-04-19T03:01:14.644101+0000","last_unstale":"2024-04-19T03:01:14.646112+0000","last_undegraded":"2024-04-19T03:01:14.646112+0000","last_fullsized":"2024-04-19T03:01:14.646112+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:28:24.652864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-04-19T03:01:14.635506+0000","last_change":"2024-04-19T03:01:14.635506+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.635506+0000","last_undegraded":"2024-04-19T03:01:14.635506+0000","last_fullsized":"2024-04-19T03:01:14.635506+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:16:20.475837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T03:01:14.645341+0000","last_change":"2024-04-19T03:01:14.643840+0000","last_active":"2024-04-19T03:01:14.645341+0000","last_peered":"2024-04-19T03:01:14.645341+0000","last_clean":"2024-04-19T03:01:14.645341+0000","last_became_active":"2024-04-19T03:01:14.643503+0000","last_became_peered":"2024-04-19T03:01:14.643503+0000","last_unstale":"2024-04-19T03:01:14.645341+0000","last_undegraded":"2024-04-19T03:01:14.645341+0000","last_fullsized":"2024-04-19T03:01:14.645341+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:09:33.801275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T03:01:14.615919+0000","last_change":"2024-04-19T03:01:14.615919+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.615919+0000","last_undegraded":"2024-04-19T03:01:14.615919+0000","last_fullsized":"2024-04-19T03:01:14.615919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"14'157","reported_seq":210,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-19T03:01:13.623161+0000","last_change":"2024-04-19T03:01:07.538434+0000","last_active":"2024-04-19T03:01:13.623161+0000","last_peered":"2024-04-19T03:01:13.623161+0000","last_clean":"2024-04-19T03:01:13.623161+0000","last_became_active":"2024-04-19T03:01:07.537856+0000","last_became_peered":"2024-04-19T03:01:07.537856+0000","last_unstale":"2024-04-19T03:01:13.623161+0000","last_undegraded":"2024-04-19T03:01:13.623161+0000","last_fullsized":"2024-04-19T03:01:13.623161+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:06.516863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:06.516863+0000","last_clean_scrub_stamp":"2024-04-19T03:01:06.516863+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:36:46.386286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-19T03:01:13.623664+0000","last_change":"2024-04-19T03:01:10.602869+0000","last_active":"2024-04-19T03:01:13.623664+0000","last_peered":"2024-04-19T03:01:13.623664+0000","last_clean":"2024-04-19T03:01:13.623664+0000","last_became_active":"2024-04-19T03:01:10.601965+0000","last_became_peered":"2024-04-19T03:01:10.601965+0000","last_unstale":"2024-04-19T03:01:13.623664+0000","last_undegraded":"2024-04-19T03:01:13.623664+0000","last_fullsized":"2024-04-19T03:01:13.623664+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_clean_scrub_stamp":"2024-04-19T03:01:09.578660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:14:41.316871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-04-19T03:01:13.622079+0000","last_change":"2024-04-19T03:01:13.622079+0000","last_active":"2024-04-19T03:01:13.604133+0000","last_peered":"2024-04-19T03:01:13.604133+0000","last_clean":"2024-04-19T03:01:13.604133+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:13.622079+0000","last_undegraded":"2024-04-19T03:01:13.622079+0000","last_fullsized":"2024-04-19T03:01:13.622079+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:24:40.181164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-04-19T03:01:14.633873+0000","last_change":"2024-04-19T03:01:14.633873+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.633873+0000","last_undegraded":"2024-04-19T03:01:14.633873+0000","last_fullsized":"2024-04-19T03:01:14.633873+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:00:35.372657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-19T03:01:13.623112+0000","last_change":"2024-04-19T03:01:10.602194+0000","last_active":"2024-04-19T03:01:13.623112+0000","last_peered":"2024-04-19T03:01:13.623112+0000","last_clean":"2024-04-19T03:01:13.623112+0000","last_became_active":"2024-04-19T03:01:10.601381+0000","last_became_peered":"2024-04-19T03:01:10.601381+0000","last_unstale":"2024-04-19T03:01:13.623112+0000","last_undegraded":"2024-04-19T03:01:13.623112+0000","last_fullsized":"2024-04-19T03:01:13.623112+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_clean_scrub_stamp":"2024-04-19T03:01:09.578660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:42:26.594095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-04-19T03:01:13.622230+0000","last_change":"2024-04-19T03:01:13.622230+0000","last_active":"2024-04-19T03:01:13.604133+0000","last_peered":"2024-04-19T03:01:13.604133+0000","last_clean":"2024-04-19T03:01:13.604133+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:13.622230+0000","last_undegraded":"2024-04-19T03:01:13.622230+0000","last_fullsized":"2024-04-19T03:01:13.622230+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:41:26.108674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-04-19T03:01:14.635678+0000","last_change":"2024-04-19T03:01:14.635678+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.635678+0000","last_undegraded":"2024-04-19T03:01:14.635678+0000","last_fullsized":"2024-04-19T03:01:14.635678+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:54:04.518505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-19T03:01:13.627044+0000","last_change":"2024-04-19T03:01:10.600207+0000","last_active":"2024-04-19T03:01:13.627044+0000","last_peered":"2024-04-19T03:01:13.627044+0000","last_clean":"2024-04-19T03:01:13.627044+0000","last_became_active":"2024-04-19T03:01:10.599209+0000","last_became_peered":"2024-04-19T03:01:10.599209+0000","last_unstale":"2024-04-19T03:01:13.627044+0000","last_undegraded":"2024-04-19T03:01:13.627044+0000","last_fullsized":"2024-04-19T03:01:13.627044+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_clean_scrub_stamp":"2024-04-19T03:01:09.578660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:30:25.748140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T03:01:14.650674+0000","last_change":"2024-04-19T03:01:14.649068+0000","last_active":"2024-04-19T03:01:14.650674+0000","last_peered":"2024-04-19T03:01:14.650674+0000","last_clean":"2024-04-19T03:01:14.650674+0000","last_became_active":"2024-04-19T03:01:14.648082+0000","last_became_peered":"2024-04-19T03:01:14.648082+0000","last_unstale":"2024-04-19T03:01:14.650674+0000","last_undegraded":"2024-04-19T03:01:14.650674+0000","last_fullsized":"2024-04-19T03:01:14.650674+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:30:14.489117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T03:01:14.615919+0000","last_change":"2024-04-19T03:01:14.615919+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.615919+0000","last_undegraded":"2024-04-19T03:01:14.615919+0000","last_fullsized":"2024-04-19T03:01:14.615919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-19T03:01:13.623103+0000","last_change":"2024-04-19T03:01:10.601386+0000","last_active":"2024-04-19T03:01:13.623103+0000","last_peered":"2024-04-19T03:01:13.623103+0000","last_clean":"2024-04-19T03:01:13.623103+0000","last_became_active":"2024-04-19T03:01:10.600732+0000","last_became_peered":"2024-04-19T03:01:10.600732+0000","last_unstale":"2024-04-19T03:01:13.623103+0000","last_undegraded":"2024-04-19T03:01:13.623103+0000","last_fullsized":"2024-04-19T03:01:13.623103+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_clean_scrub_stamp":"2024-04-19T03:01:09.578660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:34:53.138338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T03:01:14.654457+0000","last_change":"2024-04-19T03:01:14.651363+0000","last_active":"2024-04-19T03:01:14.654457+0000","last_peered":"2024-04-19T03:01:14.654457+0000","last_clean":"2024-04-19T03:01:14.654457+0000","last_became_active":"2024-04-19T03:01:14.651020+0000","last_became_peered":"2024-04-19T03:01:14.651020+0000","last_unstale":"2024-04-19T03:01:14.654457+0000","last_undegraded":"2024-04-19T03:01:14.654457+0000","last_fullsized":"2024-04-19T03:01:14.654457+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:44:36.043345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T03:01:14.615919+0000","last_change":"2024-04-19T03:01:14.615919+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.615919+0000","last_undegraded":"2024-04-19T03:01:14.615919+0000","last_fullsized":"2024-04-19T03:01:14.615919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T03:01:14.659873+0000","last_change":"2024-04-19T03:01:14.651740+0000","last_active":"2024-04-19T03:01:14.659873+0000","last_peered":"2024-04-19T03:01:14.659873+0000","last_clean":"2024-04-19T03:01:14.659873+0000","last_became_active":"2024-04-19T03:01:14.651491+0000","last_became_peered":"2024-04-19T03:01:14.651491+0000","last_unstale":"2024-04-19T03:01:14.659873+0000","last_undegraded":"2024-04-19T03:01:14.659873+0000","last_fullsized":"2024-04-19T03:01:14.659873+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:42:15.864988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-19T03:01:13.627316+0000","last_change":"2024-04-19T03:01:10.601062+0000","last_active":"2024-04-19T03:01:13.627316+0000","last_peered":"2024-04-19T03:01:13.627316+0000","last_clean":"2024-04-19T03:01:13.627316+0000","last_became_active":"2024-04-19T03:01:10.600334+0000","last_became_peered":"2024-04-19T03:01:10.600334+0000","last_unstale":"2024-04-19T03:01:13.627316+0000","last_undegraded":"2024-04-19T03:01:13.627316+0000","last_fullsized":"2024-04-19T03:01:13.627316+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_clean_scrub_stamp":"2024-04-19T03:01:09.578660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:51:38.307752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-04-19T03:01:14.635161+0000","last_change":"2024-04-19T03:01:14.635161+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.635161+0000","last_undegraded":"2024-04-19T03:01:14.635161+0000","last_fullsized":"2024-04-19T03:01:14.635161+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:22:58.349159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-04-19T03:01:13.622643+0000","last_change":"2024-04-19T03:01:13.622643+0000","last_active":"2024-04-19T03:01:13.604133+0000","last_peered":"2024-04-19T03:01:13.604133+0000","last_clean":"2024-04-19T03:01:13.604133+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:13.622643+0000","last_undegraded":"2024-04-19T03:01:13.622643+0000","last_fullsized":"2024-04-19T03:01:13.622643+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:40:40.193720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-19T03:01:13.628856+0000","last_change":"2024-04-19T03:01:10.603139+0000","last_active":"2024-04-19T03:01:13.628856+0000","last_peered":"2024-04-19T03:01:13.628856+0000","last_clean":"2024-04-19T03:01:13.628856+0000","last_became_active":"2024-04-19T03:01:10.602397+0000","last_became_peered":"2024-04-19T03:01:10.602397+0000","last_unstale":"2024-04-19T03:01:13.628856+0000","last_undegraded":"2024-04-19T03:01:13.628856+0000","last_fullsized":"2024-04-19T03:01:13.628856+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_clean_scrub_stamp":"2024-04-19T03:01:09.578660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:36:00.072157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-04-19T03:01:14.634209+0000","last_change":"2024-04-19T03:01:14.634209+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.634209+0000","last_undegraded":"2024-04-19T03:01:14.634209+0000","last_fullsized":"2024-04-19T03:01:14.634209+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:39:54.289444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-04-19T03:01:13.622569+0000","last_change":"2024-04-19T03:01:13.622569+0000","last_active":"2024-04-19T03:01:13.604133+0000","last_peered":"2024-04-19T03:01:13.604133+0000","last_clean":"2024-04-19T03:01:13.604133+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:13.622569+0000","last_undegraded":"2024-04-19T03:01:13.622569+0000","last_fullsized":"2024-04-19T03:01:13.622569+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:28:14.128657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-19T03:01:13.628367+0000","last_change":"2024-04-19T03:01:10.599894+0000","last_active":"2024-04-19T03:01:13.628367+0000","last_peered":"2024-04-19T03:01:13.628367+0000","last_clean":"2024-04-19T03:01:13.628367+0000","last_became_active":"2024-04-19T03:01:10.599202+0000","last_became_peered":"2024-04-19T03:01:10.599202+0000","last_unstale":"2024-04-19T03:01:13.628367+0000","last_undegraded":"2024-04-19T03:01:13.628367+0000","last_fullsized":"2024-04-19T03:01:13.628367+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_clean_scrub_stamp":"2024-04-19T03:01:09.578660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:59:34.386302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T03:01:14.615919+0000","last_change":"2024-04-19T03:01:14.615919+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.615919+0000","last_undegraded":"2024-04-19T03:01:14.615919+0000","last_fullsized":"2024-04-19T03:01:14.615919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-04-19T03:01:13.622364+0000","last_change":"2024-04-19T03:01:13.622364+0000","last_active":"2024-04-19T03:01:13.604133+0000","last_peered":"2024-04-19T03:01:13.604133+0000","last_clean":"2024-04-19T03:01:13.604133+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:13.622364+0000","last_undegraded":"2024-04-19T03:01:13.622364+0000","last_fullsized":"2024-04-19T03:01:13.622364+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:32:41.909038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-19T03:01:13.624003+0000","last_change":"2024-04-19T03:01:10.602274+0000","last_active":"2024-04-19T03:01:13.624003+0000","last_peered":"2024-04-19T03:01:13.624003+0000","last_clean":"2024-04-19T03:01:13.624003+0000","last_became_active":"2024-04-19T03:01:10.601487+0000","last_became_peered":"2024-04-19T03:01:10.601487+0000","last_unstale":"2024-04-19T03:01:13.624003+0000","last_undegraded":"2024-04-19T03:01:13.624003+0000","last_fullsized":"2024-04-19T03:01:13.624003+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_clean_scrub_stamp":"2024-04-19T03:01:09.578660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:26:16.712446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-04-19T03:01:14.635200+0000","last_change":"2024-04-19T03:01:14.635200+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.635200+0000","last_undegraded":"2024-04-19T03:01:14.635200+0000","last_fullsized":"2024-04-19T03:01:14.635200+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:40:59.453079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-04-19T03:01:14.635874+0000","last_change":"2024-04-19T03:01:14.635874+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.635874+0000","last_undegraded":"2024-04-19T03:01:14.635874+0000","last_fullsized":"2024-04-19T03:01:14.635874+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:59:49.270245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T03:01:14.651985+0000","last_change":"2024-04-19T03:01:14.649577+0000","last_active":"2024-04-19T03:01:14.651985+0000","last_peered":"2024-04-19T03:01:14.651985+0000","last_clean":"2024-04-19T03:01:14.651985+0000","last_became_active":"2024-04-19T03:01:14.649284+0000","last_became_peered":"2024-04-19T03:01:14.649284+0000","last_unstale":"2024-04-19T03:01:14.651985+0000","last_undegraded":"2024-04-19T03:01:14.651985+0000","last_fullsized":"2024-04-19T03:01:14.651985+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:01:22.214742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T03:01:14.615919+0000","last_change":"2024-04-19T03:01:14.615919+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.615919+0000","last_undegraded":"2024-04-19T03:01:14.615919+0000","last_fullsized":"2024-04-19T03:01:14.615919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T03:01:14.650412+0000","last_change":"2024-04-19T03:01:14.648703+0000","last_active":"2024-04-19T03:01:14.650412+0000","last_peered":"2024-04-19T03:01:14.650412+0000","last_clean":"2024-04-19T03:01:14.650412+0000","last_became_active":"2024-04-19T03:01:14.648258+0000","last_became_peered":"2024-04-19T03:01:14.648258+0000","last_unstale":"2024-04-19T03:01:14.650412+0000","last_undegraded":"2024-04-19T03:01:14.650412+0000","last_fullsized":"2024-04-19T03:01:14.650412+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:30:35.593258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T03:01:14.659856+0000","last_change":"2024-04-19T03:01:14.651753+0000","last_active":"2024-04-19T03:01:14.659856+0000","last_peered":"2024-04-19T03:01:14.659856+0000","last_clean":"2024-04-19T03:01:14.659856+0000","last_became_active":"2024-04-19T03:01:14.651458+0000","last_became_peered":"2024-04-19T03:01:14.651458+0000","last_unstale":"2024-04-19T03:01:14.659856+0000","last_undegraded":"2024-04-19T03:01:14.659856+0000","last_fullsized":"2024-04-19T03:01:14.659856+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:58:28.669306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T03:01:14.615919+0000","last_change":"2024-04-19T03:01:14.615919+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.615919+0000","last_undegraded":"2024-04-19T03:01:14.615919+0000","last_fullsized":"2024-04-19T03:01:14.615919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-04-19T03:01:13.624713+0000","last_change":"2024-04-19T03:01:13.624713+0000","last_active":"2024-04-19T03:01:13.604133+0000","last_peered":"2024-04-19T03:01:13.604133+0000","last_clean":"2024-04-19T03:01:13.604133+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:13.624713+0000","last_undegraded":"2024-04-19T03:01:13.624713+0000","last_fullsized":"2024-04-19T03:01:13.624713+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:22:38.096801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T03:01:14.615919+0000","last_change":"2024-04-19T03:01:14.615919+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.615919+0000","last_undegraded":"2024-04-19T03:01:14.615919+0000","last_fullsized":"2024-04-19T03:01:14.615919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-04-19T03:01:14.631624+0000","last_change":"2024-04-19T03:01:14.631624+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.631624+0000","last_undegraded":"2024-04-19T03:01:14.631624+0000","last_fullsized":"2024-04-19T03:01:14.631624+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:40:53.477682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-04-19T03:01:13.622719+0000","last_change":"2024-04-19T03:01:13.622719+0000","last_active":"2024-04-19T03:01:13.604133+0000","last_peered":"2024-04-19T03:01:13.604133+0000","last_clean":"2024-04-19T03:01:13.604133+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:13.622719+0000","last_undegraded":"2024-04-19T03:01:13.622719+0000","last_fullsized":"2024-04-19T03:01:13.622719+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:05:36.752017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-19T03:01:14.615919+0000","last_change":"2024-04-19T03:01:14.615919+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.615919+0000","last_undegraded":"2024-04-19T03:01:14.615919+0000","last_fullsized":"2024-04-19T03:01:14.615919+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-04-19T03:01:13.624540+0000","last_change":"2024-04-19T03:01:13.624540+0000","last_active":"2024-04-19T03:01:13.604133+0000","last_peered":"2024-04-19T03:01:13.604133+0000","last_clean":"2024-04-19T03:01:13.604133+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:13.624540+0000","last_undegraded":"2024-04-19T03:01:13.624540+0000","last_fullsized":"2024-04-19T03:01:13.624540+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:56:15.348940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-04-19T03:01:14.637577+0000","last_change":"2024-04-19T03:01:14.637577+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.637577+0000","last_undegraded":"2024-04-19T03:01:14.637577+0000","last_fullsized":"2024-04-19T03:01:14.637577+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:10:56.732208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T03:01:14.652127+0000","last_change":"2024-04-19T03:01:14.651050+0000","last_active":"2024-04-19T03:01:14.652127+0000","last_peered":"2024-04-19T03:01:14.652127+0000","last_clean":"2024-04-19T03:01:14.652127+0000","last_became_active":"2024-04-19T03:01:14.650639+0000","last_became_peered":"2024-04-19T03:01:14.650639+0000","last_unstale":"2024-04-19T03:01:14.652127+0000","last_undegraded":"2024-04-19T03:01:14.652127+0000","last_fullsized":"2024-04-19T03:01:14.652127+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:41:49.783896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-04-19T03:01:14.636855+0000","last_change":"2024-04-19T03:01:14.636855+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.636855+0000","last_undegraded":"2024-04-19T03:01:14.636855+0000","last_fullsized":"2024-04-19T03:01:14.636855+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:36:36.363535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T03:01:14.650442+0000","last_change":"2024-04-19T03:01:14.648823+0000","last_active":"2024-04-19T03:01:14.650442+0000","last_peered":"2024-04-19T03:01:14.650442+0000","last_clean":"2024-04-19T03:01:14.650442+0000","last_became_active":"2024-04-19T03:01:14.648337+0000","last_became_peered":"2024-04-19T03:01:14.648337+0000","last_unstale":"2024-04-19T03:01:14.650442+0000","last_undegraded":"2024-04-19T03:01:14.650442+0000","last_fullsized":"2024-04-19T03:01:14.650442+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:08:46.250118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-04-19T03:01:14.637651+0000","last_change":"2024-04-19T03:01:14.637651+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.637651+0000","last_undegraded":"2024-04-19T03:01:14.637651+0000","last_fullsized":"2024-04-19T03:01:14.637651+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:56:44.307812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T03:01:14.654356+0000","last_change":"2024-04-19T03:01:14.651049+0000","last_active":"2024-04-19T03:01:14.654356+0000","last_peered":"2024-04-19T03:01:14.654356+0000","last_clean":"2024-04-19T03:01:14.654356+0000","last_became_active":"2024-04-19T03:01:14.650646+0000","last_became_peered":"2024-04-19T03:01:14.650646+0000","last_unstale":"2024-04-19T03:01:14.654356+0000","last_undegraded":"2024-04-19T03:01:14.654356+0000","last_fullsized":"2024-04-19T03:01:14.654356+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:33:59.716591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-04-19T03:01:14.633087+0000","last_change":"2024-04-19T03:01:14.633087+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.633087+0000","last_undegraded":"2024-04-19T03:01:14.633087+0000","last_fullsized":"2024-04-19T03:01:14.633087+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:13:06.902769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-19T03:01:14.650679+0000","last_change":"2024-04-19T03:01:14.649277+0000","last_active":"2024-04-19T03:01:14.650679+0000","last_peered":"2024-04-19T03:01:14.650679+0000","last_clean":"2024-04-19T03:01:14.650679+0000","last_became_active":"2024-04-19T03:01:14.648614+0000","last_became_peered":"2024-04-19T03:01:14.648614+0000","last_unstale":"2024-04-19T03:01:14.650679+0000","last_undegraded":"2024-04-19T03:01:14.650679+0000","last_fullsized":"2024-04-19T03:01:14.650679+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:34:05.922324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-04-19T03:01:14.630820+0000","last_change":"2024-04-19T03:01:14.630820+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.630820+0000","last_undegraded":"2024-04-19T03:01:14.630820+0000","last_fullsized":"2024-04-19T03:01:14.630820+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:14:57.922917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-04-19T03:01:13.624316+0000","last_change":"2024-04-19T03:01:13.624316+0000","last_active":"2024-04-19T03:01:13.604133+0000","last_peered":"2024-04-19T03:01:13.604133+0000","last_clean":"2024-04-19T03:01:13.604133+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:13.624316+0000","last_undegraded":"2024-04-19T03:01:13.624316+0000","last_fullsized":"2024-04-19T03:01:13.624316+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:56:05.481089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":1,"reported_epoch":19,"state":"creating+peering","last_fresh":"2024-04-19T03:01:14.633427+0000","last_change":"2024-04-19T03:01:14.633427+0000","last_active":"2024-04-19T03:01:14.615919+0000","last_peered":"2024-04-19T03:01:14.615919+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:14.633427+0000","last_undegraded":"2024-04-19T03:01:14.633427+0000","last_fullsized":"2024-04-19T03:01:14.633427+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:13:26.030579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":1,"reported_epoch":18,"state":"creating+peering","last_fresh":"2024-04-19T03:01:13.626135+0000","last_change":"2024-04-19T03:01:13.626135+0000","last_active":"2024-04-19T03:01:13.604133+0000","last_peered":"2024-04-19T03:01:13.604133+0000","last_clean":"2024-04-19T03:01:13.604133+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-19T03:01:13.626135+0000","last_undegraded":"2024-04-19T03:01:13.626135+0000","last_fullsized":"2024-04-19T03:01:13.626135+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:09:04.022991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":92,"acting":92,"num_store_stats":2},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":14482,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":10,"seq":42949672967,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31332,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340508,"statfs":{"total":96636764160,"available":96604680192,"internally_reserved":0,"allocated":221184,"data_stored":642541,"data_compressed":7241,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55800000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71699999999999997}]}]},{"osd":1,"up_from":10,"seq":42949672966,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31324,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340516,"statfs":{"total":96636764160,"available":96604688384,"internally_reserved":0,"allocated":212992,"data_stored":638003,"data_compressed":7241,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67200000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64400000000000002}]}]},{"osd":0,"up_from":9,"seq":38654705669,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31256,"kb_used_data":136,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340584,"statfs":{"total":96636764160,"available":96604758016,"internally_reserved":0,"allocated":139264,"data_stored":39817,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64700000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":7241,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":7241,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-19T03:01:22.417 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-19T03:01:22.728 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-19T03:01:22.731 INFO:teuthology.orchestra.run.smithi096.stderr:dumped all 2024-04-19T03:01:22.742 INFO:teuthology.orchestra.run.smithi096.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2024-04-19T03:01:21.945126+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":247,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":195,"ondisk_log_size":195,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":94052,"kb_used_data":704,"kb_used_omap":4,"kb_used_meta":93307,"kb_avail":283021468,"statfs":{"total":289910292480,"available":289813983232,"internally_reserved":0,"allocated":720896,"data_stored":1370902,"data_compressed":14482,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":4782,"internal_metadata":95546706},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.317999"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.023489+0000","last_change":"2024-04-19T03:01:15.019292+0000","last_active":"2024-04-19T03:01:15.023489+0000","last_peered":"2024-04-19T03:01:15.023489+0000","last_clean":"2024-04-19T03:01:15.023489+0000","last_became_active":"2024-04-19T03:01:15.017907+0000","last_became_peered":"2024-04-19T03:01:15.017907+0000","last_unstale":"2024-04-19T03:01:15.023489+0000","last_undegraded":"2024-04-19T03:01:15.023489+0000","last_fullsized":"2024-04-19T03:01:15.023489+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:13:26.030579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.023194+0000","last_change":"2024-04-19T03:01:15.018719+0000","last_active":"2024-04-19T03:01:15.023194+0000","last_peered":"2024-04-19T03:01:15.023194+0000","last_clean":"2024-04-19T03:01:15.023194+0000","last_became_active":"2024-04-19T03:01:15.018070+0000","last_became_peered":"2024-04-19T03:01:15.018070+0000","last_unstale":"2024-04-19T03:01:15.023194+0000","last_undegraded":"2024-04-19T03:01:15.023194+0000","last_fullsized":"2024-04-19T03:01:15.023194+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:48:13.389356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.018237+0000","last_change":"2024-04-19T03:01:15.015884+0000","last_active":"2024-04-19T03:01:15.018237+0000","last_peered":"2024-04-19T03:01:15.018237+0000","last_clean":"2024-04-19T03:01:15.018237+0000","last_became_active":"2024-04-19T03:01:15.014599+0000","last_became_peered":"2024-04-19T03:01:15.014599+0000","last_unstale":"2024-04-19T03:01:15.018237+0000","last_undegraded":"2024-04-19T03:01:15.018237+0000","last_fullsized":"2024-04-19T03:01:15.018237+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:35:19.436344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.018134+0000","last_change":"2024-04-19T03:01:15.015186+0000","last_active":"2024-04-19T03:01:15.018134+0000","last_peered":"2024-04-19T03:01:15.018134+0000","last_clean":"2024-04-19T03:01:15.018134+0000","last_became_active":"2024-04-19T03:01:15.014218+0000","last_became_peered":"2024-04-19T03:01:15.014218+0000","last_unstale":"2024-04-19T03:01:15.018134+0000","last_undegraded":"2024-04-19T03:01:15.018134+0000","last_fullsized":"2024-04-19T03:01:15.018134+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:30:22.360053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.023421+0000","last_change":"2024-04-19T03:01:15.019382+0000","last_active":"2024-04-19T03:01:15.023421+0000","last_peered":"2024-04-19T03:01:15.023421+0000","last_clean":"2024-04-19T03:01:15.023421+0000","last_became_active":"2024-04-19T03:01:15.017859+0000","last_became_peered":"2024-04-19T03:01:15.017859+0000","last_unstale":"2024-04-19T03:01:15.023421+0000","last_undegraded":"2024-04-19T03:01:15.023421+0000","last_fullsized":"2024-04-19T03:01:15.023421+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:31:51.982582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.019273+0000","last_change":"2024-04-19T03:01:15.016989+0000","last_active":"2024-04-19T03:01:15.019273+0000","last_peered":"2024-04-19T03:01:15.019273+0000","last_clean":"2024-04-19T03:01:15.019273+0000","last_became_active":"2024-04-19T03:01:15.016569+0000","last_became_peered":"2024-04-19T03:01:15.016569+0000","last_unstale":"2024-04-19T03:01:15.019273+0000","last_undegraded":"2024-04-19T03:01:15.019273+0000","last_fullsized":"2024-04-19T03:01:15.019273+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:22:58.349159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.019190+0000","last_change":"2024-04-19T03:01:15.016925+0000","last_active":"2024-04-19T03:01:15.019190+0000","last_peered":"2024-04-19T03:01:15.019190+0000","last_clean":"2024-04-19T03:01:15.019190+0000","last_became_active":"2024-04-19T03:01:15.016589+0000","last_became_peered":"2024-04-19T03:01:15.016589+0000","last_unstale":"2024-04-19T03:01:15.019190+0000","last_undegraded":"2024-04-19T03:01:15.019190+0000","last_fullsized":"2024-04-19T03:01:15.019190+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:48:13.389356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.022180+0000","last_change":"2024-04-19T03:01:15.018969+0000","last_active":"2024-04-19T03:01:15.022180+0000","last_peered":"2024-04-19T03:01:15.022180+0000","last_clean":"2024-04-19T03:01:15.022180+0000","last_became_active":"2024-04-19T03:01:15.016895+0000","last_became_peered":"2024-04-19T03:01:15.016895+0000","last_unstale":"2024-04-19T03:01:15.022180+0000","last_undegraded":"2024-04-19T03:01:15.022180+0000","last_fullsized":"2024-04-19T03:01:15.022180+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:09:23.427311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-19T03:01:18.092387+0000","last_change":"2024-04-19T03:01:15.018526+0000","last_active":"2024-04-19T03:01:18.092387+0000","last_peered":"2024-04-19T03:01:18.092387+0000","last_clean":"2024-04-19T03:01:18.092387+0000","last_became_active":"2024-04-19T03:01:15.018268+0000","last_became_peered":"2024-04-19T03:01:15.018268+0000","last_unstale":"2024-04-19T03:01:18.092387+0000","last_undegraded":"2024-04-19T03:01:18.092387+0000","last_fullsized":"2024-04-19T03:01:18.092387+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:17:52.453165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.023176+0000","last_change":"2024-04-19T03:01:15.018499+0000","last_active":"2024-04-19T03:01:15.023176+0000","last_peered":"2024-04-19T03:01:15.023176+0000","last_clean":"2024-04-19T03:01:15.023176+0000","last_became_active":"2024-04-19T03:01:15.017894+0000","last_became_peered":"2024-04-19T03:01:15.017894+0000","last_unstale":"2024-04-19T03:01:15.023176+0000","last_undegraded":"2024-04-19T03:01:15.023176+0000","last_fullsized":"2024-04-19T03:01:15.023176+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:10:21.967941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.019491+0000","last_change":"2024-04-19T03:01:15.017525+0000","last_active":"2024-04-19T03:01:15.019491+0000","last_peered":"2024-04-19T03:01:15.019491+0000","last_clean":"2024-04-19T03:01:15.019491+0000","last_became_active":"2024-04-19T03:01:15.016887+0000","last_became_peered":"2024-04-19T03:01:15.016887+0000","last_unstale":"2024-04-19T03:01:15.019491+0000","last_undegraded":"2024-04-19T03:01:15.019491+0000","last_fullsized":"2024-04-19T03:01:15.019491+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:10:56.732208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.023561+0000","last_change":"2024-04-19T03:01:15.020240+0000","last_active":"2024-04-19T03:01:15.023561+0000","last_peered":"2024-04-19T03:01:15.023561+0000","last_clean":"2024-04-19T03:01:15.023561+0000","last_became_active":"2024-04-19T03:01:15.019820+0000","last_became_peered":"2024-04-19T03:01:15.019820+0000","last_unstale":"2024-04-19T03:01:15.023561+0000","last_undegraded":"2024-04-19T03:01:15.023561+0000","last_fullsized":"2024-04-19T03:01:15.023561+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:09:23.427311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.023234+0000","last_change":"2024-04-19T03:01:15.018712+0000","last_active":"2024-04-19T03:01:15.023234+0000","last_peered":"2024-04-19T03:01:15.023234+0000","last_clean":"2024-04-19T03:01:15.023234+0000","last_became_active":"2024-04-19T03:01:15.017970+0000","last_became_peered":"2024-04-19T03:01:15.017970+0000","last_unstale":"2024-04-19T03:01:15.023234+0000","last_undegraded":"2024-04-19T03:01:15.023234+0000","last_fullsized":"2024-04-19T03:01:15.023234+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:07:57.843767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.013382+0000","last_change":"2024-04-19T03:01:15.010960+0000","last_active":"2024-04-19T03:01:15.013382+0000","last_peered":"2024-04-19T03:01:15.013382+0000","last_clean":"2024-04-19T03:01:15.013382+0000","last_became_active":"2024-04-19T03:01:15.010472+0000","last_became_peered":"2024-04-19T03:01:15.010472+0000","last_unstale":"2024-04-19T03:01:15.013382+0000","last_undegraded":"2024-04-19T03:01:15.013382+0000","last_fullsized":"2024-04-19T03:01:15.013382+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:21:36.129346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.017090+0000","last_change":"2024-04-19T03:01:15.014574+0000","last_active":"2024-04-19T03:01:15.017090+0000","last_peered":"2024-04-19T03:01:15.017090+0000","last_clean":"2024-04-19T03:01:15.017090+0000","last_became_active":"2024-04-19T03:01:15.014096+0000","last_became_peered":"2024-04-19T03:01:15.014096+0000","last_unstale":"2024-04-19T03:01:15.017090+0000","last_undegraded":"2024-04-19T03:01:15.017090+0000","last_fullsized":"2024-04-19T03:01:15.017090+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:01:54.253963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.022131+0000","last_change":"2024-04-19T03:01:15.018778+0000","last_active":"2024-04-19T03:01:15.022131+0000","last_peered":"2024-04-19T03:01:15.022131+0000","last_clean":"2024-04-19T03:01:15.022131+0000","last_became_active":"2024-04-19T03:01:15.016809+0000","last_became_peered":"2024-04-19T03:01:15.016809+0000","last_unstale":"2024-04-19T03:01:15.022131+0000","last_undegraded":"2024-04-19T03:01:15.022131+0000","last_fullsized":"2024-04-19T03:01:15.022131+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:40:59.453079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-19T03:01:18.093156+0000","last_change":"2024-04-19T03:01:15.011516+0000","last_active":"2024-04-19T03:01:18.093156+0000","last_peered":"2024-04-19T03:01:18.093156+0000","last_clean":"2024-04-19T03:01:18.093156+0000","last_became_active":"2024-04-19T03:01:15.011056+0000","last_became_peered":"2024-04-19T03:01:15.011056+0000","last_unstale":"2024-04-19T03:01:18.093156+0000","last_undegraded":"2024-04-19T03:01:18.093156+0000","last_fullsized":"2024-04-19T03:01:18.093156+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:35:50.354787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.022947+0000","last_change":"2024-04-19T03:01:15.017257+0000","last_active":"2024-04-19T03:01:15.022947+0000","last_peered":"2024-04-19T03:01:15.022947+0000","last_clean":"2024-04-19T03:01:15.022947+0000","last_became_active":"2024-04-19T03:01:15.016062+0000","last_became_peered":"2024-04-19T03:01:15.016062+0000","last_unstale":"2024-04-19T03:01:15.022947+0000","last_undegraded":"2024-04-19T03:01:15.022947+0000","last_fullsized":"2024-04-19T03:01:15.022947+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:40:20.790332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-19T03:01:18.092291+0000","last_change":"2024-04-19T03:01:15.011065+0000","last_active":"2024-04-19T03:01:18.092291+0000","last_peered":"2024-04-19T03:01:18.092291+0000","last_clean":"2024-04-19T03:01:18.092291+0000","last_became_active":"2024-04-19T03:01:15.010330+0000","last_became_peered":"2024-04-19T03:01:15.010330+0000","last_unstale":"2024-04-19T03:01:18.092291+0000","last_undegraded":"2024-04-19T03:01:18.092291+0000","last_fullsized":"2024-04-19T03:01:18.092291+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:56:10.495533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.021464+0000","last_change":"2024-04-19T03:01:15.017812+0000","last_active":"2024-04-19T03:01:15.021464+0000","last_peered":"2024-04-19T03:01:15.021464+0000","last_clean":"2024-04-19T03:01:15.021464+0000","last_became_active":"2024-04-19T03:01:15.016891+0000","last_became_peered":"2024-04-19T03:01:15.016891+0000","last_unstale":"2024-04-19T03:01:15.021464+0000","last_undegraded":"2024-04-19T03:01:15.021464+0000","last_fullsized":"2024-04-19T03:01:15.021464+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:39:54.289444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.024134+0000","last_change":"2024-04-19T03:01:15.019143+0000","last_active":"2024-04-19T03:01:15.024134+0000","last_peered":"2024-04-19T03:01:15.024134+0000","last_clean":"2024-04-19T03:01:15.024134+0000","last_became_active":"2024-04-19T03:01:15.017757+0000","last_became_peered":"2024-04-19T03:01:15.017757+0000","last_unstale":"2024-04-19T03:01:15.024134+0000","last_undegraded":"2024-04-19T03:01:15.024134+0000","last_fullsized":"2024-04-19T03:01:15.024134+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:10:21.967941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.023544+0000","last_change":"2024-04-19T03:01:15.020108+0000","last_active":"2024-04-19T03:01:15.023544+0000","last_peered":"2024-04-19T03:01:15.023544+0000","last_clean":"2024-04-19T03:01:15.023544+0000","last_became_active":"2024-04-19T03:01:15.018978+0000","last_became_peered":"2024-04-19T03:01:15.018978+0000","last_unstale":"2024-04-19T03:01:15.023544+0000","last_undegraded":"2024-04-19T03:01:15.023544+0000","last_fullsized":"2024-04-19T03:01:15.023544+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:30:22.360053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-19T03:01:18.090964+0000","last_change":"2024-04-19T03:01:15.016877+0000","last_active":"2024-04-19T03:01:18.090964+0000","last_peered":"2024-04-19T03:01:18.090964+0000","last_clean":"2024-04-19T03:01:18.090964+0000","last_became_active":"2024-04-19T03:01:15.016245+0000","last_became_peered":"2024-04-19T03:01:15.016245+0000","last_unstale":"2024-04-19T03:01:18.090964+0000","last_undegraded":"2024-04-19T03:01:18.090964+0000","last_fullsized":"2024-04-19T03:01:18.090964+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:38:07.846380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.023272+0000","last_change":"2024-04-19T03:01:15.018809+0000","last_active":"2024-04-19T03:01:15.023272+0000","last_peered":"2024-04-19T03:01:15.023272+0000","last_clean":"2024-04-19T03:01:15.023272+0000","last_became_active":"2024-04-19T03:01:15.017549+0000","last_became_peered":"2024-04-19T03:01:15.017549+0000","last_unstale":"2024-04-19T03:01:15.023272+0000","last_undegraded":"2024-04-19T03:01:15.023272+0000","last_fullsized":"2024-04-19T03:01:15.023272+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:37:35.950318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.023709+0000","last_change":"2024-04-19T03:01:15.020443+0000","last_active":"2024-04-19T03:01:15.023709+0000","last_peered":"2024-04-19T03:01:15.023709+0000","last_clean":"2024-04-19T03:01:15.023709+0000","last_became_active":"2024-04-19T03:01:15.018780+0000","last_became_peered":"2024-04-19T03:01:15.018780+0000","last_unstale":"2024-04-19T03:01:15.023709+0000","last_undegraded":"2024-04-19T03:01:15.023709+0000","last_fullsized":"2024-04-19T03:01:15.023709+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:56:44.307812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-19T03:01:18.093128+0000","last_change":"2024-04-19T03:01:15.017487+0000","last_active":"2024-04-19T03:01:18.093128+0000","last_peered":"2024-04-19T03:01:18.093128+0000","last_clean":"2024-04-19T03:01:18.093128+0000","last_became_active":"2024-04-19T03:01:15.016183+0000","last_became_peered":"2024-04-19T03:01:15.016183+0000","last_unstale":"2024-04-19T03:01:18.093128+0000","last_undegraded":"2024-04-19T03:01:18.093128+0000","last_fullsized":"2024-04-19T03:01:18.093128+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:44:37.487013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.018261+0000","last_change":"2024-04-19T03:01:15.016117+0000","last_active":"2024-04-19T03:01:15.018261+0000","last_peered":"2024-04-19T03:01:15.018261+0000","last_clean":"2024-04-19T03:01:15.018261+0000","last_became_active":"2024-04-19T03:01:15.015415+0000","last_became_peered":"2024-04-19T03:01:15.015415+0000","last_unstale":"2024-04-19T03:01:15.018261+0000","last_undegraded":"2024-04-19T03:01:15.018261+0000","last_fullsized":"2024-04-19T03:01:15.018261+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:06:35.813797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.023502+0000","last_change":"2024-04-19T03:01:15.020098+0000","last_active":"2024-04-19T03:01:15.023502+0000","last_peered":"2024-04-19T03:01:15.023502+0000","last_clean":"2024-04-19T03:01:15.023502+0000","last_became_active":"2024-04-19T03:01:15.019064+0000","last_became_peered":"2024-04-19T03:01:15.019064+0000","last_unstale":"2024-04-19T03:01:15.023502+0000","last_undegraded":"2024-04-19T03:01:15.023502+0000","last_fullsized":"2024-04-19T03:01:15.023502+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:50:06.490191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-19T03:01:18.092158+0000","last_change":"2024-04-19T03:01:15.013746+0000","last_active":"2024-04-19T03:01:18.092158+0000","last_peered":"2024-04-19T03:01:18.092158+0000","last_clean":"2024-04-19T03:01:18.092158+0000","last_became_active":"2024-04-19T03:01:15.011865+0000","last_became_peered":"2024-04-19T03:01:15.011865+0000","last_unstale":"2024-04-19T03:01:18.092158+0000","last_undegraded":"2024-04-19T03:01:18.092158+0000","last_fullsized":"2024-04-19T03:01:18.092158+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:32:23.606804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.023434+0000","last_change":"2024-04-19T03:01:15.019787+0000","last_active":"2024-04-19T03:01:15.023434+0000","last_peered":"2024-04-19T03:01:15.023434+0000","last_clean":"2024-04-19T03:01:15.023434+0000","last_became_active":"2024-04-19T03:01:15.018350+0000","last_became_peered":"2024-04-19T03:01:15.018350+0000","last_unstale":"2024-04-19T03:01:15.023434+0000","last_undegraded":"2024-04-19T03:01:15.023434+0000","last_fullsized":"2024-04-19T03:01:15.023434+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:10:42.079294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-19T03:01:18.090924+0000","last_change":"2024-04-19T03:01:15.012900+0000","last_active":"2024-04-19T03:01:18.090924+0000","last_peered":"2024-04-19T03:01:18.090924+0000","last_clean":"2024-04-19T03:01:18.090924+0000","last_became_active":"2024-04-19T03:01:15.012416+0000","last_became_peered":"2024-04-19T03:01:15.012416+0000","last_unstale":"2024-04-19T03:01:18.090924+0000","last_undegraded":"2024-04-19T03:01:18.090924+0000","last_fullsized":"2024-04-19T03:01:18.090924+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:57:14.847455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.024190+0000","last_change":"2024-04-19T03:01:15.019278+0000","last_active":"2024-04-19T03:01:15.024190+0000","last_peered":"2024-04-19T03:01:15.024190+0000","last_clean":"2024-04-19T03:01:15.024190+0000","last_became_active":"2024-04-19T03:01:15.017779+0000","last_became_peered":"2024-04-19T03:01:15.017779+0000","last_unstale":"2024-04-19T03:01:15.024190+0000","last_undegraded":"2024-04-19T03:01:15.024190+0000","last_fullsized":"2024-04-19T03:01:15.024190+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:54:54.463918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.022801+0000","last_change":"2024-04-19T03:01:15.016669+0000","last_active":"2024-04-19T03:01:15.022801+0000","last_peered":"2024-04-19T03:01:15.022801+0000","last_clean":"2024-04-19T03:01:15.022801+0000","last_became_active":"2024-04-19T03:01:15.016286+0000","last_became_peered":"2024-04-19T03:01:15.016286+0000","last_unstale":"2024-04-19T03:01:15.022801+0000","last_undegraded":"2024-04-19T03:01:15.022801+0000","last_fullsized":"2024-04-19T03:01:15.022801+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:55:34.102680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"20'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.019438+0000","last_change":"2024-04-19T03:01:14.651050+0000","last_active":"2024-04-19T03:01:15.019438+0000","last_peered":"2024-04-19T03:01:15.019438+0000","last_clean":"2024-04-19T03:01:15.019438+0000","last_became_active":"2024-04-19T03:01:14.650679+0000","last_became_peered":"2024-04-19T03:01:14.650679+0000","last_unstale":"2024-04-19T03:01:15.019438+0000","last_undegraded":"2024-04-19T03:01:15.019438+0000","last_fullsized":"2024-04-19T03:01:15.019438+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:37:03.684394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.022892+0000","last_change":"2024-04-19T03:01:15.017124+0000","last_active":"2024-04-19T03:01:15.022892+0000","last_peered":"2024-04-19T03:01:15.022892+0000","last_clean":"2024-04-19T03:01:15.022892+0000","last_became_active":"2024-04-19T03:01:15.016535+0000","last_became_peered":"2024-04-19T03:01:15.016535+0000","last_unstale":"2024-04-19T03:01:15.022892+0000","last_undegraded":"2024-04-19T03:01:15.022892+0000","last_fullsized":"2024-04-19T03:01:15.022892+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:40:12.179703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.002737+0000","last_change":"2024-04-19T03:01:14.646594+0000","last_active":"2024-04-19T03:01:15.002737+0000","last_peered":"2024-04-19T03:01:15.002737+0000","last_clean":"2024-04-19T03:01:15.002737+0000","last_became_active":"2024-04-19T03:01:14.646122+0000","last_became_peered":"2024-04-19T03:01:14.646122+0000","last_unstale":"2024-04-19T03:01:15.002737+0000","last_undegraded":"2024-04-19T03:01:15.002737+0000","last_fullsized":"2024-04-19T03:01:15.002737+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:40:53.463388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-19T03:01:18.093362+0000","last_change":"2024-04-19T03:01:15.017420+0000","last_active":"2024-04-19T03:01:18.093362+0000","last_peered":"2024-04-19T03:01:18.093362+0000","last_clean":"2024-04-19T03:01:18.093362+0000","last_became_active":"2024-04-19T03:01:15.015840+0000","last_became_peered":"2024-04-19T03:01:15.015840+0000","last_unstale":"2024-04-19T03:01:18.093362+0000","last_undegraded":"2024-04-19T03:01:18.093362+0000","last_fullsized":"2024-04-19T03:01:18.093362+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:05:05.266293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.004873+0000","last_change":"2024-04-19T03:01:14.649074+0000","last_active":"2024-04-19T03:01:15.004873+0000","last_peered":"2024-04-19T03:01:15.004873+0000","last_clean":"2024-04-19T03:01:15.004873+0000","last_became_active":"2024-04-19T03:01:14.648217+0000","last_became_peered":"2024-04-19T03:01:14.648217+0000","last_unstale":"2024-04-19T03:01:15.004873+0000","last_undegraded":"2024-04-19T03:01:15.004873+0000","last_fullsized":"2024-04-19T03:01:15.004873+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:57:05.238043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-19T03:01:18.092638+0000","last_change":"2024-04-19T03:01:15.017136+0000","last_active":"2024-04-19T03:01:18.092638+0000","last_peered":"2024-04-19T03:01:18.092638+0000","last_clean":"2024-04-19T03:01:18.092638+0000","last_became_active":"2024-04-19T03:01:15.016550+0000","last_became_peered":"2024-04-19T03:01:15.016550+0000","last_unstale":"2024-04-19T03:01:18.092638+0000","last_undegraded":"2024-04-19T03:01:18.092638+0000","last_fullsized":"2024-04-19T03:01:18.092638+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:55:37.697481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"20'8","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.023332+0000","last_change":"2024-04-19T03:01:14.649044+0000","last_active":"2024-04-19T03:01:15.023332+0000","last_peered":"2024-04-19T03:01:15.023332+0000","last_clean":"2024-04-19T03:01:15.023332+0000","last_became_active":"2024-04-19T03:01:14.648859+0000","last_became_peered":"2024-04-19T03:01:14.648859+0000","last_unstale":"2024-04-19T03:01:15.023332+0000","last_undegraded":"2024-04-19T03:01:15.023332+0000","last_fullsized":"2024-04-19T03:01:15.023332+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:30:45.925657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"20'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.015096+0000","last_change":"2024-04-19T03:01:14.649839+0000","last_active":"2024-04-19T03:01:15.015096+0000","last_peered":"2024-04-19T03:01:15.015096+0000","last_clean":"2024-04-19T03:01:15.015096+0000","last_became_active":"2024-04-19T03:01:14.649571+0000","last_became_peered":"2024-04-19T03:01:14.649571+0000","last_unstale":"2024-04-19T03:01:15.015096+0000","last_undegraded":"2024-04-19T03:01:15.015096+0000","last_fullsized":"2024-04-19T03:01:15.015096+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:03:57.839660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.023786+0000","last_change":"2024-04-19T03:01:15.021047+0000","last_active":"2024-04-19T03:01:15.023786+0000","last_peered":"2024-04-19T03:01:15.023786+0000","last_clean":"2024-04-19T03:01:15.023786+0000","last_became_active":"2024-04-19T03:01:15.019792+0000","last_became_peered":"2024-04-19T03:01:15.019792+0000","last_unstale":"2024-04-19T03:01:15.023786+0000","last_undegraded":"2024-04-19T03:01:15.023786+0000","last_fullsized":"2024-04-19T03:01:15.023786+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:54:54.463918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"20'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.019933+0000","last_change":"2024-04-19T03:01:14.645075+0000","last_active":"2024-04-19T03:01:15.019933+0000","last_peered":"2024-04-19T03:01:15.019933+0000","last_clean":"2024-04-19T03:01:15.019933+0000","last_became_active":"2024-04-19T03:01:14.644790+0000","last_became_peered":"2024-04-19T03:01:14.644790+0000","last_unstale":"2024-04-19T03:01:15.019933+0000","last_undegraded":"2024-04-19T03:01:15.019933+0000","last_fullsized":"2024-04-19T03:01:15.019933+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:55:15.035769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.021374+0000","last_change":"2024-04-19T03:01:15.016330+0000","last_active":"2024-04-19T03:01:15.021374+0000","last_peered":"2024-04-19T03:01:15.021374+0000","last_clean":"2024-04-19T03:01:15.021374+0000","last_became_active":"2024-04-19T03:01:15.015644+0000","last_became_peered":"2024-04-19T03:01:15.015644+0000","last_unstale":"2024-04-19T03:01:15.021374+0000","last_undegraded":"2024-04-19T03:01:15.021374+0000","last_fullsized":"2024-04-19T03:01:15.021374+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:13:06.902769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"20'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.015911+0000","last_change":"2024-04-19T03:01:14.649826+0000","last_active":"2024-04-19T03:01:15.015911+0000","last_peered":"2024-04-19T03:01:15.015911+0000","last_clean":"2024-04-19T03:01:15.015911+0000","last_became_active":"2024-04-19T03:01:14.649565+0000","last_became_peered":"2024-04-19T03:01:14.649565+0000","last_unstale":"2024-04-19T03:01:15.015911+0000","last_undegraded":"2024-04-19T03:01:15.015911+0000","last_fullsized":"2024-04-19T03:01:15.015911+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:36:00.962931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.021994+0000","last_change":"2024-04-19T03:01:15.018099+0000","last_active":"2024-04-19T03:01:15.021994+0000","last_peered":"2024-04-19T03:01:15.021994+0000","last_clean":"2024-04-19T03:01:15.021994+0000","last_became_active":"2024-04-19T03:01:15.017536+0000","last_became_peered":"2024-04-19T03:01:15.017536+0000","last_unstale":"2024-04-19T03:01:15.021994+0000","last_undegraded":"2024-04-19T03:01:15.021994+0000","last_fullsized":"2024-04-19T03:01:15.021994+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:50:06.490191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.006366+0000","last_change":"2024-04-19T03:01:14.651201+0000","last_active":"2024-04-19T03:01:15.006366+0000","last_peered":"2024-04-19T03:01:15.006366+0000","last_clean":"2024-04-19T03:01:15.006366+0000","last_became_active":"2024-04-19T03:01:14.650942+0000","last_became_peered":"2024-04-19T03:01:14.650942+0000","last_unstale":"2024-04-19T03:01:15.006366+0000","last_undegraded":"2024-04-19T03:01:15.006366+0000","last_fullsized":"2024-04-19T03:01:15.006366+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:02:13.190917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-19T03:01:18.092211+0000","last_change":"2024-04-19T03:01:15.017458+0000","last_active":"2024-04-19T03:01:18.092211+0000","last_peered":"2024-04-19T03:01:18.092211+0000","last_clean":"2024-04-19T03:01:18.092211+0000","last_became_active":"2024-04-19T03:01:15.016653+0000","last_became_peered":"2024-04-19T03:01:15.016653+0000","last_unstale":"2024-04-19T03:01:18.092211+0000","last_undegraded":"2024-04-19T03:01:18.092211+0000","last_fullsized":"2024-04-19T03:01:18.092211+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:52:28.671365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"20'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.016958+0000","last_change":"2024-04-19T03:01:14.647553+0000","last_active":"2024-04-19T03:01:15.016958+0000","last_peered":"2024-04-19T03:01:15.016958+0000","last_clean":"2024-04-19T03:01:15.016958+0000","last_became_active":"2024-04-19T03:01:14.647147+0000","last_became_peered":"2024-04-19T03:01:14.647147+0000","last_unstale":"2024-04-19T03:01:15.016958+0000","last_undegraded":"2024-04-19T03:01:15.016958+0000","last_fullsized":"2024-04-19T03:01:15.016958+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:33:45.550646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.021494+0000","last_change":"2024-04-19T03:01:15.018012+0000","last_active":"2024-04-19T03:01:15.021494+0000","last_peered":"2024-04-19T03:01:15.021494+0000","last_clean":"2024-04-19T03:01:15.021494+0000","last_became_active":"2024-04-19T03:01:15.017086+0000","last_became_peered":"2024-04-19T03:01:15.017086+0000","last_unstale":"2024-04-19T03:01:15.021494+0000","last_undegraded":"2024-04-19T03:01:15.021494+0000","last_fullsized":"2024-04-19T03:01:15.021494+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:54:04.518505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.001920+0000","last_change":"2024-04-19T03:01:14.651004+0000","last_active":"2024-04-19T03:01:15.001920+0000","last_peered":"2024-04-19T03:01:15.001920+0000","last_clean":"2024-04-19T03:01:15.001920+0000","last_became_active":"2024-04-19T03:01:14.650635+0000","last_became_peered":"2024-04-19T03:01:14.650635+0000","last_unstale":"2024-04-19T03:01:15.001920+0000","last_undegraded":"2024-04-19T03:01:15.001920+0000","last_fullsized":"2024-04-19T03:01:15.001920+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:57:15.575819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.018174+0000","last_change":"2024-04-19T03:01:15.015685+0000","last_active":"2024-04-19T03:01:15.018174+0000","last_peered":"2024-04-19T03:01:15.018174+0000","last_clean":"2024-04-19T03:01:15.018174+0000","last_became_active":"2024-04-19T03:01:15.014847+0000","last_became_peered":"2024-04-19T03:01:15.014847+0000","last_unstale":"2024-04-19T03:01:15.018174+0000","last_undegraded":"2024-04-19T03:01:15.018174+0000","last_fullsized":"2024-04-19T03:01:15.018174+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:51:06.208551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.005141+0000","last_change":"2024-04-19T03:01:14.644582+0000","last_active":"2024-04-19T03:01:15.005141+0000","last_peered":"2024-04-19T03:01:15.005141+0000","last_clean":"2024-04-19T03:01:15.005141+0000","last_became_active":"2024-04-19T03:01:14.644101+0000","last_became_peered":"2024-04-19T03:01:14.644101+0000","last_unstale":"2024-04-19T03:01:15.005141+0000","last_undegraded":"2024-04-19T03:01:15.005141+0000","last_fullsized":"2024-04-19T03:01:15.005141+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:28:24.652864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.017755+0000","last_change":"2024-04-19T03:01:15.014818+0000","last_active":"2024-04-19T03:01:15.017755+0000","last_peered":"2024-04-19T03:01:15.017755+0000","last_clean":"2024-04-19T03:01:15.017755+0000","last_became_active":"2024-04-19T03:01:15.014421+0000","last_became_peered":"2024-04-19T03:01:15.014421+0000","last_unstale":"2024-04-19T03:01:15.017755+0000","last_undegraded":"2024-04-19T03:01:15.017755+0000","last_fullsized":"2024-04-19T03:01:15.017755+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:16:20.475837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.008183+0000","last_change":"2024-04-19T03:01:14.643840+0000","last_active":"2024-04-19T03:01:15.008183+0000","last_peered":"2024-04-19T03:01:15.008183+0000","last_clean":"2024-04-19T03:01:15.008183+0000","last_became_active":"2024-04-19T03:01:14.643503+0000","last_became_peered":"2024-04-19T03:01:14.643503+0000","last_unstale":"2024-04-19T03:01:15.008183+0000","last_undegraded":"2024-04-19T03:01:15.008183+0000","last_fullsized":"2024-04-19T03:01:15.008183+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:09:33.801275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-19T03:01:18.092763+0000","last_change":"2024-04-19T03:01:15.012607+0000","last_active":"2024-04-19T03:01:18.092763+0000","last_peered":"2024-04-19T03:01:18.092763+0000","last_clean":"2024-04-19T03:01:18.092763+0000","last_became_active":"2024-04-19T03:01:15.012152+0000","last_became_peered":"2024-04-19T03:01:15.012152+0000","last_unstale":"2024-04-19T03:01:18.092763+0000","last_undegraded":"2024-04-19T03:01:18.092763+0000","last_fullsized":"2024-04-19T03:01:18.092763+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:57:36.794409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"14'157","reported_seq":212,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.004135+0000","last_change":"2024-04-19T03:01:07.538434+0000","last_active":"2024-04-19T03:01:15.004135+0000","last_peered":"2024-04-19T03:01:15.004135+0000","last_clean":"2024-04-19T03:01:15.004135+0000","last_became_active":"2024-04-19T03:01:07.537856+0000","last_became_peered":"2024-04-19T03:01:07.537856+0000","last_unstale":"2024-04-19T03:01:15.004135+0000","last_undegraded":"2024-04-19T03:01:15.004135+0000","last_fullsized":"2024-04-19T03:01:15.004135+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:06.516863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:06.516863+0000","last_clean_scrub_stamp":"2024-04-19T03:01:06.516863+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:36:46.386286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.006445+0000","last_change":"2024-04-19T03:01:10.602869+0000","last_active":"2024-04-19T03:01:15.006445+0000","last_peered":"2024-04-19T03:01:15.006445+0000","last_clean":"2024-04-19T03:01:15.006445+0000","last_became_active":"2024-04-19T03:01:10.601965+0000","last_became_peered":"2024-04-19T03:01:10.601965+0000","last_unstale":"2024-04-19T03:01:15.006445+0000","last_undegraded":"2024-04-19T03:01:15.006445+0000","last_fullsized":"2024-04-19T03:01:15.006445+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_clean_scrub_stamp":"2024-04-19T03:01:09.578660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:14:41.316871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.001643+0000","last_change":"2024-04-19T03:01:14.643201+0000","last_active":"2024-04-19T03:01:15.001643+0000","last_peered":"2024-04-19T03:01:15.001643+0000","last_clean":"2024-04-19T03:01:15.001643+0000","last_became_active":"2024-04-19T03:01:14.642885+0000","last_became_peered":"2024-04-19T03:01:14.642885+0000","last_unstale":"2024-04-19T03:01:15.001643+0000","last_undegraded":"2024-04-19T03:01:15.001643+0000","last_fullsized":"2024-04-19T03:01:15.001643+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:24:40.181164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.019181+0000","last_change":"2024-04-19T03:01:15.016104+0000","last_active":"2024-04-19T03:01:15.019181+0000","last_peered":"2024-04-19T03:01:15.019181+0000","last_clean":"2024-04-19T03:01:15.019181+0000","last_became_active":"2024-04-19T03:01:15.015386+0000","last_became_peered":"2024-04-19T03:01:15.015386+0000","last_unstale":"2024-04-19T03:01:15.019181+0000","last_undegraded":"2024-04-19T03:01:15.019181+0000","last_fullsized":"2024-04-19T03:01:15.019181+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:00:35.372657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.003912+0000","last_change":"2024-04-19T03:01:10.602194+0000","last_active":"2024-04-19T03:01:15.003912+0000","last_peered":"2024-04-19T03:01:15.003912+0000","last_clean":"2024-04-19T03:01:15.003912+0000","last_became_active":"2024-04-19T03:01:10.601381+0000","last_became_peered":"2024-04-19T03:01:10.601381+0000","last_unstale":"2024-04-19T03:01:15.003912+0000","last_undegraded":"2024-04-19T03:01:15.003912+0000","last_fullsized":"2024-04-19T03:01:15.003912+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_clean_scrub_stamp":"2024-04-19T03:01:09.578660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:42:26.594095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.003098+0000","last_change":"2024-04-19T03:01:14.647365+0000","last_active":"2024-04-19T03:01:15.003098+0000","last_peered":"2024-04-19T03:01:15.003098+0000","last_clean":"2024-04-19T03:01:15.003098+0000","last_became_active":"2024-04-19T03:01:14.646950+0000","last_became_peered":"2024-04-19T03:01:14.646950+0000","last_unstale":"2024-04-19T03:01:15.003098+0000","last_undegraded":"2024-04-19T03:01:15.003098+0000","last_fullsized":"2024-04-19T03:01:15.003098+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:41:26.108674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.023211+0000","last_change":"2024-04-19T03:01:15.018728+0000","last_active":"2024-04-19T03:01:15.023211+0000","last_peered":"2024-04-19T03:01:15.023211+0000","last_clean":"2024-04-19T03:01:15.023211+0000","last_became_active":"2024-04-19T03:01:15.017287+0000","last_became_peered":"2024-04-19T03:01:15.017287+0000","last_unstale":"2024-04-19T03:01:15.023211+0000","last_undegraded":"2024-04-19T03:01:15.023211+0000","last_fullsized":"2024-04-19T03:01:15.023211+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:54:04.518505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.003231+0000","last_change":"2024-04-19T03:01:10.600207+0000","last_active":"2024-04-19T03:01:15.003231+0000","last_peered":"2024-04-19T03:01:15.003231+0000","last_clean":"2024-04-19T03:01:15.003231+0000","last_became_active":"2024-04-19T03:01:10.599209+0000","last_became_peered":"2024-04-19T03:01:10.599209+0000","last_unstale":"2024-04-19T03:01:15.003231+0000","last_undegraded":"2024-04-19T03:01:15.003231+0000","last_fullsized":"2024-04-19T03:01:15.003231+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_clean_scrub_stamp":"2024-04-19T03:01:09.578660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:30:25.748140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.008341+0000","last_change":"2024-04-19T03:01:14.649068+0000","last_active":"2024-04-19T03:01:15.008341+0000","last_peered":"2024-04-19T03:01:15.008341+0000","last_clean":"2024-04-19T03:01:15.008341+0000","last_became_active":"2024-04-19T03:01:14.648082+0000","last_became_peered":"2024-04-19T03:01:14.648082+0000","last_unstale":"2024-04-19T03:01:15.008341+0000","last_undegraded":"2024-04-19T03:01:15.008341+0000","last_fullsized":"2024-04-19T03:01:15.008341+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:30:14.489117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-19T03:01:18.092872+0000","last_change":"2024-04-19T03:01:15.012147+0000","last_active":"2024-04-19T03:01:18.092872+0000","last_peered":"2024-04-19T03:01:18.092872+0000","last_clean":"2024-04-19T03:01:18.092872+0000","last_became_active":"2024-04-19T03:01:15.011421+0000","last_became_peered":"2024-04-19T03:01:15.011421+0000","last_unstale":"2024-04-19T03:01:18.092872+0000","last_undegraded":"2024-04-19T03:01:18.092872+0000","last_fullsized":"2024-04-19T03:01:18.092872+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:50:51.928641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.002185+0000","last_change":"2024-04-19T03:01:10.601386+0000","last_active":"2024-04-19T03:01:15.002185+0000","last_peered":"2024-04-19T03:01:15.002185+0000","last_clean":"2024-04-19T03:01:15.002185+0000","last_became_active":"2024-04-19T03:01:10.600732+0000","last_became_peered":"2024-04-19T03:01:10.600732+0000","last_unstale":"2024-04-19T03:01:15.002185+0000","last_undegraded":"2024-04-19T03:01:15.002185+0000","last_fullsized":"2024-04-19T03:01:15.002185+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_clean_scrub_stamp":"2024-04-19T03:01:09.578660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:34:53.138338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.006322+0000","last_change":"2024-04-19T03:01:14.651363+0000","last_active":"2024-04-19T03:01:15.006322+0000","last_peered":"2024-04-19T03:01:15.006322+0000","last_clean":"2024-04-19T03:01:15.006322+0000","last_became_active":"2024-04-19T03:01:14.651020+0000","last_became_peered":"2024-04-19T03:01:14.651020+0000","last_unstale":"2024-04-19T03:01:15.006322+0000","last_undegraded":"2024-04-19T03:01:15.006322+0000","last_fullsized":"2024-04-19T03:01:15.006322+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:44:36.043345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-19T03:01:18.092601+0000","last_change":"2024-04-19T03:01:15.017182+0000","last_active":"2024-04-19T03:01:18.092601+0000","last_peered":"2024-04-19T03:01:18.092601+0000","last_clean":"2024-04-19T03:01:18.092601+0000","last_became_active":"2024-04-19T03:01:15.016258+0000","last_became_peered":"2024-04-19T03:01:15.016258+0000","last_unstale":"2024-04-19T03:01:18.092601+0000","last_undegraded":"2024-04-19T03:01:18.092601+0000","last_fullsized":"2024-04-19T03:01:18.092601+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:27:25.351590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.004000+0000","last_change":"2024-04-19T03:01:14.651740+0000","last_active":"2024-04-19T03:01:15.004000+0000","last_peered":"2024-04-19T03:01:15.004000+0000","last_clean":"2024-04-19T03:01:15.004000+0000","last_became_active":"2024-04-19T03:01:14.651491+0000","last_became_peered":"2024-04-19T03:01:14.651491+0000","last_unstale":"2024-04-19T03:01:15.004000+0000","last_undegraded":"2024-04-19T03:01:15.004000+0000","last_fullsized":"2024-04-19T03:01:15.004000+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:42:15.864988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.006158+0000","last_change":"2024-04-19T03:01:10.601062+0000","last_active":"2024-04-19T03:01:15.006158+0000","last_peered":"2024-04-19T03:01:15.006158+0000","last_clean":"2024-04-19T03:01:15.006158+0000","last_became_active":"2024-04-19T03:01:10.600334+0000","last_became_peered":"2024-04-19T03:01:10.600334+0000","last_unstale":"2024-04-19T03:01:15.006158+0000","last_undegraded":"2024-04-19T03:01:15.006158+0000","last_fullsized":"2024-04-19T03:01:15.006158+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_clean_scrub_stamp":"2024-04-19T03:01:09.578660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:51:38.307752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.023683+0000","last_change":"2024-04-19T03:01:15.020501+0000","last_active":"2024-04-19T03:01:15.023683+0000","last_peered":"2024-04-19T03:01:15.023683+0000","last_clean":"2024-04-19T03:01:15.023683+0000","last_became_active":"2024-04-19T03:01:15.019019+0000","last_became_peered":"2024-04-19T03:01:15.019019+0000","last_unstale":"2024-04-19T03:01:15.023683+0000","last_undegraded":"2024-04-19T03:01:15.023683+0000","last_fullsized":"2024-04-19T03:01:15.023683+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:22:58.349159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.006058+0000","last_change":"2024-04-19T03:01:14.643098+0000","last_active":"2024-04-19T03:01:15.006058+0000","last_peered":"2024-04-19T03:01:15.006058+0000","last_clean":"2024-04-19T03:01:15.006058+0000","last_became_active":"2024-04-19T03:01:14.642789+0000","last_became_peered":"2024-04-19T03:01:14.642789+0000","last_unstale":"2024-04-19T03:01:15.006058+0000","last_undegraded":"2024-04-19T03:01:15.006058+0000","last_fullsized":"2024-04-19T03:01:15.006058+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:40:40.193720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.005646+0000","last_change":"2024-04-19T03:01:10.603139+0000","last_active":"2024-04-19T03:01:15.005646+0000","last_peered":"2024-04-19T03:01:15.005646+0000","last_clean":"2024-04-19T03:01:15.005646+0000","last_became_active":"2024-04-19T03:01:10.602397+0000","last_became_peered":"2024-04-19T03:01:10.602397+0000","last_unstale":"2024-04-19T03:01:15.005646+0000","last_undegraded":"2024-04-19T03:01:15.005646+0000","last_fullsized":"2024-04-19T03:01:15.005646+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_clean_scrub_stamp":"2024-04-19T03:01:09.578660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:36:00.072157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.023512+0000","last_change":"2024-04-19T03:01:15.020052+0000","last_active":"2024-04-19T03:01:15.023512+0000","last_peered":"2024-04-19T03:01:15.023512+0000","last_clean":"2024-04-19T03:01:15.023512+0000","last_became_active":"2024-04-19T03:01:15.019144+0000","last_became_peered":"2024-04-19T03:01:15.019144+0000","last_unstale":"2024-04-19T03:01:15.023512+0000","last_undegraded":"2024-04-19T03:01:15.023512+0000","last_fullsized":"2024-04-19T03:01:15.023512+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:39:54.289444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"20'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.019383+0000","last_change":"2024-04-19T03:01:14.643328+0000","last_active":"2024-04-19T03:01:15.019383+0000","last_peered":"2024-04-19T03:01:15.019383+0000","last_clean":"2024-04-19T03:01:15.019383+0000","last_became_active":"2024-04-19T03:01:14.643001+0000","last_became_peered":"2024-04-19T03:01:14.643001+0000","last_unstale":"2024-04-19T03:01:15.019383+0000","last_undegraded":"2024-04-19T03:01:15.019383+0000","last_fullsized":"2024-04-19T03:01:15.019383+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:28:14.128657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.006138+0000","last_change":"2024-04-19T03:01:10.599894+0000","last_active":"2024-04-19T03:01:15.006138+0000","last_peered":"2024-04-19T03:01:15.006138+0000","last_clean":"2024-04-19T03:01:15.006138+0000","last_became_active":"2024-04-19T03:01:10.599202+0000","last_became_peered":"2024-04-19T03:01:10.599202+0000","last_unstale":"2024-04-19T03:01:15.006138+0000","last_undegraded":"2024-04-19T03:01:15.006138+0000","last_fullsized":"2024-04-19T03:01:15.006138+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_clean_scrub_stamp":"2024-04-19T03:01:09.578660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:59:34.386302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-19T03:01:18.091060+0000","last_change":"2024-04-19T03:01:15.016429+0000","last_active":"2024-04-19T03:01:18.091060+0000","last_peered":"2024-04-19T03:01:18.091060+0000","last_clean":"2024-04-19T03:01:18.091060+0000","last_became_active":"2024-04-19T03:01:15.015945+0000","last_became_peered":"2024-04-19T03:01:15.015945+0000","last_unstale":"2024-04-19T03:01:18.091060+0000","last_undegraded":"2024-04-19T03:01:18.091060+0000","last_fullsized":"2024-04-19T03:01:18.091060+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:43:17.785352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.005999+0000","last_change":"2024-04-19T03:01:14.647170+0000","last_active":"2024-04-19T03:01:15.005999+0000","last_peered":"2024-04-19T03:01:15.005999+0000","last_clean":"2024-04-19T03:01:15.005999+0000","last_became_active":"2024-04-19T03:01:14.646622+0000","last_became_peered":"2024-04-19T03:01:14.646622+0000","last_unstale":"2024-04-19T03:01:15.005999+0000","last_undegraded":"2024-04-19T03:01:15.005999+0000","last_fullsized":"2024-04-19T03:01:15.005999+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:32:41.909038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.001377+0000","last_change":"2024-04-19T03:01:10.602274+0000","last_active":"2024-04-19T03:01:15.001377+0000","last_peered":"2024-04-19T03:01:15.001377+0000","last_clean":"2024-04-19T03:01:15.001377+0000","last_became_active":"2024-04-19T03:01:10.601487+0000","last_became_peered":"2024-04-19T03:01:10.601487+0000","last_unstale":"2024-04-19T03:01:15.001377+0000","last_undegraded":"2024-04-19T03:01:15.001377+0000","last_fullsized":"2024-04-19T03:01:15.001377+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_clean_scrub_stamp":"2024-04-19T03:01:09.578660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:26:16.712446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.023281+0000","last_change":"2024-04-19T03:01:15.018914+0000","last_active":"2024-04-19T03:01:15.023281+0000","last_peered":"2024-04-19T03:01:15.023281+0000","last_clean":"2024-04-19T03:01:15.023281+0000","last_became_active":"2024-04-19T03:01:15.018276+0000","last_became_peered":"2024-04-19T03:01:15.018276+0000","last_unstale":"2024-04-19T03:01:15.023281+0000","last_undegraded":"2024-04-19T03:01:15.023281+0000","last_fullsized":"2024-04-19T03:01:15.023281+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:40:59.453079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.018690+0000","last_change":"2024-04-19T03:01:15.015855+0000","last_active":"2024-04-19T03:01:15.018690+0000","last_peered":"2024-04-19T03:01:15.018690+0000","last_clean":"2024-04-19T03:01:15.018690+0000","last_became_active":"2024-04-19T03:01:15.015358+0000","last_became_peered":"2024-04-19T03:01:15.015358+0000","last_unstale":"2024-04-19T03:01:15.018690+0000","last_undegraded":"2024-04-19T03:01:15.018690+0000","last_fullsized":"2024-04-19T03:01:15.018690+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:59:49.270245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"20'6","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.029460+0000","last_change":"2024-04-19T03:01:14.649577+0000","last_active":"2024-04-19T03:01:15.029460+0000","last_peered":"2024-04-19T03:01:15.029460+0000","last_clean":"2024-04-19T03:01:15.029460+0000","last_became_active":"2024-04-19T03:01:14.649284+0000","last_became_peered":"2024-04-19T03:01:14.649284+0000","last_unstale":"2024-04-19T03:01:15.029460+0000","last_undegraded":"2024-04-19T03:01:15.029460+0000","last_fullsized":"2024-04-19T03:01:15.029460+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:01:22.214742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-19T03:01:18.091377+0000","last_change":"2024-04-19T03:01:15.013509+0000","last_active":"2024-04-19T03:01:18.091377+0000","last_peered":"2024-04-19T03:01:18.091377+0000","last_clean":"2024-04-19T03:01:18.091377+0000","last_became_active":"2024-04-19T03:01:15.012694+0000","last_became_peered":"2024-04-19T03:01:15.012694+0000","last_unstale":"2024-04-19T03:01:18.091377+0000","last_undegraded":"2024-04-19T03:01:18.091377+0000","last_fullsized":"2024-04-19T03:01:18.091377+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:13:47.056938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"20'3","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.019366+0000","last_change":"2024-04-19T03:01:14.648703+0000","last_active":"2024-04-19T03:01:15.019366+0000","last_peered":"2024-04-19T03:01:15.019366+0000","last_clean":"2024-04-19T03:01:15.019366+0000","last_became_active":"2024-04-19T03:01:14.648258+0000","last_became_peered":"2024-04-19T03:01:14.648258+0000","last_unstale":"2024-04-19T03:01:15.019366+0000","last_undegraded":"2024-04-19T03:01:15.019366+0000","last_fullsized":"2024-04-19T03:01:15.019366+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:30:35.593258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.001904+0000","last_change":"2024-04-19T03:01:14.651753+0000","last_active":"2024-04-19T03:01:15.001904+0000","last_peered":"2024-04-19T03:01:15.001904+0000","last_clean":"2024-04-19T03:01:15.001904+0000","last_became_active":"2024-04-19T03:01:14.651458+0000","last_became_peered":"2024-04-19T03:01:14.651458+0000","last_unstale":"2024-04-19T03:01:15.001904+0000","last_undegraded":"2024-04-19T03:01:15.001904+0000","last_fullsized":"2024-04-19T03:01:15.001904+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:58:28.669306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-19T03:01:18.091195+0000","last_change":"2024-04-19T03:01:15.016094+0000","last_active":"2024-04-19T03:01:18.091195+0000","last_peered":"2024-04-19T03:01:18.091195+0000","last_clean":"2024-04-19T03:01:18.091195+0000","last_became_active":"2024-04-19T03:01:15.015379+0000","last_became_peered":"2024-04-19T03:01:15.015379+0000","last_unstale":"2024-04-19T03:01:18.091195+0000","last_undegraded":"2024-04-19T03:01:18.091195+0000","last_fullsized":"2024-04-19T03:01:18.091195+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:42:11.854631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.006982+0000","last_change":"2024-04-19T03:01:14.647282+0000","last_active":"2024-04-19T03:01:15.006982+0000","last_peered":"2024-04-19T03:01:15.006982+0000","last_clean":"2024-04-19T03:01:15.006982+0000","last_became_active":"2024-04-19T03:01:14.646878+0000","last_became_peered":"2024-04-19T03:01:14.646878+0000","last_unstale":"2024-04-19T03:01:15.006982+0000","last_undegraded":"2024-04-19T03:01:15.006982+0000","last_fullsized":"2024-04-19T03:01:15.006982+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:22:38.096801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-19T03:01:18.090981+0000","last_change":"2024-04-19T03:01:15.013187+0000","last_active":"2024-04-19T03:01:18.090981+0000","last_peered":"2024-04-19T03:01:18.090981+0000","last_clean":"2024-04-19T03:01:18.090981+0000","last_became_active":"2024-04-19T03:01:15.011542+0000","last_became_peered":"2024-04-19T03:01:15.011542+0000","last_unstale":"2024-04-19T03:01:18.090981+0000","last_undegraded":"2024-04-19T03:01:18.090981+0000","last_fullsized":"2024-04-19T03:01:18.090981+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:53:13.646525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.023738+0000","last_change":"2024-04-19T03:01:15.020635+0000","last_active":"2024-04-19T03:01:15.023738+0000","last_peered":"2024-04-19T03:01:15.023738+0000","last_clean":"2024-04-19T03:01:15.023738+0000","last_became_active":"2024-04-19T03:01:15.019917+0000","last_became_peered":"2024-04-19T03:01:15.019917+0000","last_unstale":"2024-04-19T03:01:15.023738+0000","last_undegraded":"2024-04-19T03:01:15.023738+0000","last_fullsized":"2024-04-19T03:01:15.023738+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:40:53.477682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.005373+0000","last_change":"2024-04-19T03:01:14.643239+0000","last_active":"2024-04-19T03:01:15.005373+0000","last_peered":"2024-04-19T03:01:15.005373+0000","last_clean":"2024-04-19T03:01:15.005373+0000","last_became_active":"2024-04-19T03:01:14.642959+0000","last_became_peered":"2024-04-19T03:01:14.642959+0000","last_unstale":"2024-04-19T03:01:15.005373+0000","last_undegraded":"2024-04-19T03:01:15.005373+0000","last_fullsized":"2024-04-19T03:01:15.005373+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:05:36.752017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-19T03:01:18.092865+0000","last_change":"2024-04-19T03:01:15.017708+0000","last_active":"2024-04-19T03:01:18.092865+0000","last_peered":"2024-04-19T03:01:18.092865+0000","last_clean":"2024-04-19T03:01:18.092865+0000","last_became_active":"2024-04-19T03:01:15.016726+0000","last_became_peered":"2024-04-19T03:01:15.016726+0000","last_unstale":"2024-04-19T03:01:18.092865+0000","last_undegraded":"2024-04-19T03:01:18.092865+0000","last_fullsized":"2024-04-19T03:01:18.092865+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:07:47.395052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.003022+0000","last_change":"2024-04-19T03:01:14.647744+0000","last_active":"2024-04-19T03:01:15.003022+0000","last_peered":"2024-04-19T03:01:15.003022+0000","last_clean":"2024-04-19T03:01:15.003022+0000","last_became_active":"2024-04-19T03:01:14.647463+0000","last_became_peered":"2024-04-19T03:01:14.647463+0000","last_unstale":"2024-04-19T03:01:15.003022+0000","last_undegraded":"2024-04-19T03:01:15.003022+0000","last_fullsized":"2024-04-19T03:01:15.003022+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:56:15.348940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.023345+0000","last_change":"2024-04-19T03:01:15.019045+0000","last_active":"2024-04-19T03:01:15.023345+0000","last_peered":"2024-04-19T03:01:15.023345+0000","last_clean":"2024-04-19T03:01:15.023345+0000","last_became_active":"2024-04-19T03:01:15.017982+0000","last_became_peered":"2024-04-19T03:01:15.017982+0000","last_unstale":"2024-04-19T03:01:15.023345+0000","last_undegraded":"2024-04-19T03:01:15.023345+0000","last_fullsized":"2024-04-19T03:01:15.023345+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:10:56.732208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"20'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.020345+0000","last_change":"2024-04-19T03:01:14.651050+0000","last_active":"2024-04-19T03:01:15.020345+0000","last_peered":"2024-04-19T03:01:15.020345+0000","last_clean":"2024-04-19T03:01:15.020345+0000","last_became_active":"2024-04-19T03:01:14.650639+0000","last_became_peered":"2024-04-19T03:01:14.650639+0000","last_unstale":"2024-04-19T03:01:15.020345+0000","last_undegraded":"2024-04-19T03:01:15.020345+0000","last_fullsized":"2024-04-19T03:01:15.020345+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:41:49.783896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.022916+0000","last_change":"2024-04-19T03:01:15.017319+0000","last_active":"2024-04-19T03:01:15.022916+0000","last_peered":"2024-04-19T03:01:15.022916+0000","last_clean":"2024-04-19T03:01:15.022916+0000","last_became_active":"2024-04-19T03:01:15.016815+0000","last_became_peered":"2024-04-19T03:01:15.016815+0000","last_unstale":"2024-04-19T03:01:15.022916+0000","last_undegraded":"2024-04-19T03:01:15.022916+0000","last_fullsized":"2024-04-19T03:01:15.022916+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:36:36.363535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"20'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.018447+0000","last_change":"2024-04-19T03:01:14.648823+0000","last_active":"2024-04-19T03:01:15.018447+0000","last_peered":"2024-04-19T03:01:15.018447+0000","last_clean":"2024-04-19T03:01:15.018447+0000","last_became_active":"2024-04-19T03:01:14.648337+0000","last_became_peered":"2024-04-19T03:01:14.648337+0000","last_unstale":"2024-04-19T03:01:15.018447+0000","last_undegraded":"2024-04-19T03:01:15.018447+0000","last_fullsized":"2024-04-19T03:01:15.018447+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:08:46.250118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.018663+0000","last_change":"2024-04-19T03:01:15.014773+0000","last_active":"2024-04-19T03:01:15.018663+0000","last_peered":"2024-04-19T03:01:15.018663+0000","last_clean":"2024-04-19T03:01:15.018663+0000","last_became_active":"2024-04-19T03:01:15.013919+0000","last_became_peered":"2024-04-19T03:01:15.013919+0000","last_unstale":"2024-04-19T03:01:15.018663+0000","last_undegraded":"2024-04-19T03:01:15.018663+0000","last_fullsized":"2024-04-19T03:01:15.018663+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:56:44.307812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"20'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.018107+0000","last_change":"2024-04-19T03:01:14.651049+0000","last_active":"2024-04-19T03:01:15.018107+0000","last_peered":"2024-04-19T03:01:15.018107+0000","last_clean":"2024-04-19T03:01:15.018107+0000","last_became_active":"2024-04-19T03:01:14.650646+0000","last_became_peered":"2024-04-19T03:01:14.650646+0000","last_unstale":"2024-04-19T03:01:15.018107+0000","last_undegraded":"2024-04-19T03:01:15.018107+0000","last_fullsized":"2024-04-19T03:01:15.018107+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:33:59.716591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.022142+0000","last_change":"2024-04-19T03:01:15.017860+0000","last_active":"2024-04-19T03:01:15.022142+0000","last_peered":"2024-04-19T03:01:15.022142+0000","last_clean":"2024-04-19T03:01:15.022142+0000","last_became_active":"2024-04-19T03:01:15.017355+0000","last_became_peered":"2024-04-19T03:01:15.017355+0000","last_unstale":"2024-04-19T03:01:15.022142+0000","last_undegraded":"2024-04-19T03:01:15.022142+0000","last_fullsized":"2024-04-19T03:01:15.022142+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:13:06.902769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"20'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.022312+0000","last_change":"2024-04-19T03:01:14.649277+0000","last_active":"2024-04-19T03:01:15.022312+0000","last_peered":"2024-04-19T03:01:15.022312+0000","last_clean":"2024-04-19T03:01:15.022312+0000","last_became_active":"2024-04-19T03:01:14.648614+0000","last_became_peered":"2024-04-19T03:01:14.648614+0000","last_unstale":"2024-04-19T03:01:15.022312+0000","last_undegraded":"2024-04-19T03:01:15.022312+0000","last_fullsized":"2024-04-19T03:01:15.022312+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:34:05.922324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.023028+0000","last_change":"2024-04-19T03:01:15.017986+0000","last_active":"2024-04-19T03:01:15.023028+0000","last_peered":"2024-04-19T03:01:15.023028+0000","last_clean":"2024-04-19T03:01:15.023028+0000","last_became_active":"2024-04-19T03:01:15.017080+0000","last_became_peered":"2024-04-19T03:01:15.017080+0000","last_unstale":"2024-04-19T03:01:15.023028+0000","last_undegraded":"2024-04-19T03:01:15.023028+0000","last_fullsized":"2024-04-19T03:01:15.023028+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:14:57.922917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"20'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.019052+0000","last_change":"2024-04-19T03:01:14.644015+0000","last_active":"2024-04-19T03:01:15.019052+0000","last_peered":"2024-04-19T03:01:15.019052+0000","last_clean":"2024-04-19T03:01:15.019052+0000","last_became_active":"2024-04-19T03:01:14.643769+0000","last_became_peered":"2024-04-19T03:01:14.643769+0000","last_unstale":"2024-04-19T03:01:15.019052+0000","last_undegraded":"2024-04-19T03:01:15.019052+0000","last_fullsized":"2024-04-19T03:01:15.019052+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:56:05.481089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.024302+0000","last_change":"2024-04-19T03:01:15.019466+0000","last_active":"2024-04-19T03:01:15.024302+0000","last_peered":"2024-04-19T03:01:15.024302+0000","last_clean":"2024-04-19T03:01:15.024302+0000","last_became_active":"2024-04-19T03:01:15.018819+0000","last_became_peered":"2024-04-19T03:01:15.018819+0000","last_unstale":"2024-04-19T03:01:15.024302+0000","last_undegraded":"2024-04-19T03:01:15.024302+0000","last_fullsized":"2024-04-19T03:01:15.024302+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:13:26.030579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"20'4","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.020064+0000","last_change":"2024-04-19T03:01:14.647358+0000","last_active":"2024-04-19T03:01:15.020064+0000","last_peered":"2024-04-19T03:01:15.020064+0000","last_clean":"2024-04-19T03:01:15.020064+0000","last_became_active":"2024-04-19T03:01:14.646998+0000","last_became_peered":"2024-04-19T03:01:14.646998+0000","last_unstale":"2024-04-19T03:01:15.020064+0000","last_undegraded":"2024-04-19T03:01:15.020064+0000","last_fullsized":"2024-04-19T03:01:15.020064+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:09:04.022991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":14482,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":10,"seq":42949672968,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31380,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340460,"statfs":{"total":96636764160,"available":96604631040,"internally_reserved":0,"allocated":270336,"data_stored":654544,"data_compressed":7241,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80500000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64300000000000002}]}]},{"osd":1,"up_from":10,"seq":42949672967,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31372,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340468,"statfs":{"total":96636764160,"available":96604639232,"internally_reserved":0,"allocated":262144,"data_stored":653928,"data_compressed":7241,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66700000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70199999999999996}]}]},{"osd":0,"up_from":9,"seq":38654705670,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31300,"kb_used_data":184,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340540,"statfs":{"total":96636764160,"available":96604712960,"internally_reserved":0,"allocated":188416,"data_stored":62430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70299999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80100000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":7241,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":7241,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-19T03:01:22.746 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-19T03:01:22.746 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-04-19T03:01:22.746 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-04-19T03:01:22.747 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-04-19T03:01:22.747 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-04-19T03:01:23.139 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-19T03:01:23.154 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":5,"flags":0,"active_gid":4140,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6800","nonce":17198},{"type":"v1","addr":"172.21.15.96:6801","nonce":17198}]},"active_addr":"172.21.15.96:6801/17198","active_change":"2024-04-19T03:00:59.933072+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4137,"name":"x","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.96:0","nonce":2792201939}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.96:0","nonce":3589238956}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.96:0","nonce":62468933}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.96:0","nonce":4067322378}]}]} 2024-04-19T03:01:23.158 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-04-19T03:01:23.158 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-04-19T03:01:23.158 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-19T03:01:23.456 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-19T03:01:23.456 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":21,"fsid":"c6cc8e09-11d4-48de-9a6c-4d70ed3c3789","created":"2024-04-19T03:00:53.746146+0000","modified":"2024-04-19T03:01:15.992289+0000","last_up_change":"2024-04-19T03:01:04.501086+0000","last_in_change":"2024-04-19T03:00:54.640172+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-19T03:01:05.999591+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-19T03:01:09.051757+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-19T03:01:13.479163+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-19T03:01:13.992441+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"05ecb884-2c30-44f7-aa14-90154f9bbe9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":18245},{"type":"v1","addr":"172.21.15.97:6801","nonce":18245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":18245},{"type":"v1","addr":"172.21.15.97:6803","nonce":18245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":18245},{"type":"v1","addr":"172.21.15.97:6807","nonce":18245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6804","nonce":18245},{"type":"v1","addr":"172.21.15.97:6805","nonce":18245}]},"public_addr":"172.21.15.97:6801/18245","cluster_addr":"172.21.15.97:6803/18245","heartbeat_back_addr":"172.21.15.97:6807/18245","heartbeat_front_addr":"172.21.15.97:6805/18245","state":["exists","up"]},{"osd":1,"uuid":"efc873e0-69c3-4a57-8ee5-41f836b65f47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":18145},{"type":"v1","addr":"172.21.15.134:6801","nonce":18145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":18145},{"type":"v1","addr":"172.21.15.134:6803","nonce":18145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":18145},{"type":"v1","addr":"172.21.15.134:6807","nonce":18145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":18145},{"type":"v1","addr":"172.21.15.134:6805","nonce":18145}]},"public_addr":"172.21.15.134:6801/18145","cluster_addr":"172.21.15.134:6803/18145","heartbeat_back_addr":"172.21.15.134:6807/18145","heartbeat_front_addr":"172.21.15.134:6805/18145","state":["exists","up"]},{"osd":2,"uuid":"229278a0-dd93-4234-9065-e4f2f6188ef2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":18223},{"type":"v1","addr":"172.21.15.144:6801","nonce":18223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":18223},{"type":"v1","addr":"172.21.15.144:6803","nonce":18223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":18223},{"type":"v1","addr":"172.21.15.144:6807","nonce":18223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":18223},{"type":"v1","addr":"172.21.15.144:6805","nonce":18223}]},"public_addr":"172.21.15.144:6801/18223","cluster_addr":"172.21.15.144:6803/18223","heartbeat_back_addr":"172.21.15.144:6807/18223","heartbeat_front_addr":"172.21.15.144:6805/18223","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T03:00:59.302574+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T03:01:00.064174+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T03:00:59.735582+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-19T03:01:23.471 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-04-19T03:01:23.471 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-19T03:01:23.771 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-19T03:01:23.772 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":21,"fsid":"c6cc8e09-11d4-48de-9a6c-4d70ed3c3789","created":"2024-04-19T03:00:53.746146+0000","modified":"2024-04-19T03:01:15.992289+0000","last_up_change":"2024-04-19T03:01:04.501086+0000","last_in_change":"2024-04-19T03:00:54.640172+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-19T03:01:05.999591+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-19T03:01:09.051757+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-19T03:01:13.479163+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-19T03:01:13.992441+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"05ecb884-2c30-44f7-aa14-90154f9bbe9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":18245},{"type":"v1","addr":"172.21.15.97:6801","nonce":18245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":18245},{"type":"v1","addr":"172.21.15.97:6803","nonce":18245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":18245},{"type":"v1","addr":"172.21.15.97:6807","nonce":18245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6804","nonce":18245},{"type":"v1","addr":"172.21.15.97:6805","nonce":18245}]},"public_addr":"172.21.15.97:6801/18245","cluster_addr":"172.21.15.97:6803/18245","heartbeat_back_addr":"172.21.15.97:6807/18245","heartbeat_front_addr":"172.21.15.97:6805/18245","state":["exists","up"]},{"osd":1,"uuid":"efc873e0-69c3-4a57-8ee5-41f836b65f47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":18145},{"type":"v1","addr":"172.21.15.134:6801","nonce":18145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":18145},{"type":"v1","addr":"172.21.15.134:6803","nonce":18145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":18145},{"type":"v1","addr":"172.21.15.134:6807","nonce":18145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":18145},{"type":"v1","addr":"172.21.15.134:6805","nonce":18145}]},"public_addr":"172.21.15.134:6801/18145","cluster_addr":"172.21.15.134:6803/18145","heartbeat_back_addr":"172.21.15.134:6807/18145","heartbeat_front_addr":"172.21.15.134:6805/18145","state":["exists","up"]},{"osd":2,"uuid":"229278a0-dd93-4234-9065-e4f2f6188ef2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":18223},{"type":"v1","addr":"172.21.15.144:6801","nonce":18223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":18223},{"type":"v1","addr":"172.21.15.144:6803","nonce":18223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":18223},{"type":"v1","addr":"172.21.15.144:6807","nonce":18223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":18223},{"type":"v1","addr":"172.21.15.144:6805","nonce":18223}]},"public_addr":"172.21.15.144:6801/18223","cluster_addr":"172.21.15.144:6803/18223","heartbeat_back_addr":"172.21.15.144:6807/18223","heartbeat_front_addr":"172.21.15.144:6805/18223","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T03:00:59.302574+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T03:01:00.064174+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T03:00:59.735582+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-19T03:01:23.786 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-04-19T03:01:23.786 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-04-19T03:01:23.787 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-04-19T03:01:23.928 INFO:teuthology.orchestra.run.smithi096.stdout:38654705671 2024-04-19T03:01:23.929 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-19T03:01:23.935 INFO:teuthology.orchestra.run.smithi096.stdout:42949672968 2024-04-19T03:01:23.936 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-19T03:01:23.940 INFO:teuthology.orchestra.run.smithi096.stdout:42949672969 2024-04-19T03:01:23.940 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-19T03:01:24.226 INFO:teuthology.orchestra.run.smithi096.stdout:42949672968 2024-04-19T03:01:24.230 INFO:teuthology.orchestra.run.smithi096.stdout:42949672967 2024-04-19T03:01:24.235 INFO:teuthology.orchestra.run.smithi096.stdout:38654705670 2024-04-19T03:01:24.245 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672968 got 42949672967 for osd.1 2024-04-19T03:01:24.247 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672969 got 42949672968 for osd.2 2024-04-19T03:01:24.249 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705671 got 38654705670 for osd.0 2024-04-19T03:01:25.246 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-19T03:01:25.247 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-19T03:01:25.250 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-19T03:01:25.555 INFO:teuthology.orchestra.run.smithi096.stdout:42949672968 2024-04-19T03:01:25.561 INFO:teuthology.orchestra.run.smithi096.stdout:42949672969 2024-04-19T03:01:25.573 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672968 got 42949672968 for osd.1 2024-04-19T03:01:25.573 DEBUG:teuthology.parallel:result is None 2024-04-19T03:01:25.574 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672969 got 42949672969 for osd.2 2024-04-19T03:01:25.574 DEBUG:teuthology.parallel:result is None 2024-04-19T03:01:25.621 INFO:teuthology.orchestra.run.smithi096.stdout:38654705671 2024-04-19T03:01:25.635 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705671 got 38654705671 for osd.0 2024-04-19T03:01:25.635 DEBUG:teuthology.parallel:result is None 2024-04-19T03:01:25.635 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-19T03:01:25.635 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-19T03:01:25.951 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-19T03:01:25.953 INFO:teuthology.orchestra.run.smithi096.stderr:dumped all 2024-04-19T03:01:25.964 INFO:teuthology.orchestra.run.smithi096.stdout:{"pg_ready":true,"pg_map":{"version":27,"stamp":"2024-04-19T03:01:23.945984+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":94052,"kb_used_data":704,"kb_used_omap":4,"kb_used_meta":93307,"kb_avail":283021468,"statfs":{"total":289910292480,"available":289813983232,"internally_reserved":0,"allocated":720896,"data_stored":1370902,"data_compressed":14482,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":4782,"internal_metadata":95546706},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.951998"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.023489+0000","last_change":"2024-04-19T03:01:15.019292+0000","last_active":"2024-04-19T03:01:15.023489+0000","last_peered":"2024-04-19T03:01:15.023489+0000","last_clean":"2024-04-19T03:01:15.023489+0000","last_became_active":"2024-04-19T03:01:15.017907+0000","last_became_peered":"2024-04-19T03:01:15.017907+0000","last_unstale":"2024-04-19T03:01:15.023489+0000","last_undegraded":"2024-04-19T03:01:15.023489+0000","last_fullsized":"2024-04-19T03:01:15.023489+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:13:26.030579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.023194+0000","last_change":"2024-04-19T03:01:15.018719+0000","last_active":"2024-04-19T03:01:15.023194+0000","last_peered":"2024-04-19T03:01:15.023194+0000","last_clean":"2024-04-19T03:01:15.023194+0000","last_became_active":"2024-04-19T03:01:15.018070+0000","last_became_peered":"2024-04-19T03:01:15.018070+0000","last_unstale":"2024-04-19T03:01:15.023194+0000","last_undegraded":"2024-04-19T03:01:15.023194+0000","last_fullsized":"2024-04-19T03:01:15.023194+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:48:13.389356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.018237+0000","last_change":"2024-04-19T03:01:15.015884+0000","last_active":"2024-04-19T03:01:15.018237+0000","last_peered":"2024-04-19T03:01:15.018237+0000","last_clean":"2024-04-19T03:01:15.018237+0000","last_became_active":"2024-04-19T03:01:15.014599+0000","last_became_peered":"2024-04-19T03:01:15.014599+0000","last_unstale":"2024-04-19T03:01:15.018237+0000","last_undegraded":"2024-04-19T03:01:15.018237+0000","last_fullsized":"2024-04-19T03:01:15.018237+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:35:19.436344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.018134+0000","last_change":"2024-04-19T03:01:15.015186+0000","last_active":"2024-04-19T03:01:15.018134+0000","last_peered":"2024-04-19T03:01:15.018134+0000","last_clean":"2024-04-19T03:01:15.018134+0000","last_became_active":"2024-04-19T03:01:15.014218+0000","last_became_peered":"2024-04-19T03:01:15.014218+0000","last_unstale":"2024-04-19T03:01:15.018134+0000","last_undegraded":"2024-04-19T03:01:15.018134+0000","last_fullsized":"2024-04-19T03:01:15.018134+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:30:22.360053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.023421+0000","last_change":"2024-04-19T03:01:15.019382+0000","last_active":"2024-04-19T03:01:15.023421+0000","last_peered":"2024-04-19T03:01:15.023421+0000","last_clean":"2024-04-19T03:01:15.023421+0000","last_became_active":"2024-04-19T03:01:15.017859+0000","last_became_peered":"2024-04-19T03:01:15.017859+0000","last_unstale":"2024-04-19T03:01:15.023421+0000","last_undegraded":"2024-04-19T03:01:15.023421+0000","last_fullsized":"2024-04-19T03:01:15.023421+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:31:51.982582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.019273+0000","last_change":"2024-04-19T03:01:15.016989+0000","last_active":"2024-04-19T03:01:15.019273+0000","last_peered":"2024-04-19T03:01:15.019273+0000","last_clean":"2024-04-19T03:01:15.019273+0000","last_became_active":"2024-04-19T03:01:15.016569+0000","last_became_peered":"2024-04-19T03:01:15.016569+0000","last_unstale":"2024-04-19T03:01:15.019273+0000","last_undegraded":"2024-04-19T03:01:15.019273+0000","last_fullsized":"2024-04-19T03:01:15.019273+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:22:58.349159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.019190+0000","last_change":"2024-04-19T03:01:15.016925+0000","last_active":"2024-04-19T03:01:15.019190+0000","last_peered":"2024-04-19T03:01:15.019190+0000","last_clean":"2024-04-19T03:01:15.019190+0000","last_became_active":"2024-04-19T03:01:15.016589+0000","last_became_peered":"2024-04-19T03:01:15.016589+0000","last_unstale":"2024-04-19T03:01:15.019190+0000","last_undegraded":"2024-04-19T03:01:15.019190+0000","last_fullsized":"2024-04-19T03:01:15.019190+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:48:13.389356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.022180+0000","last_change":"2024-04-19T03:01:15.018969+0000","last_active":"2024-04-19T03:01:15.022180+0000","last_peered":"2024-04-19T03:01:15.022180+0000","last_clean":"2024-04-19T03:01:15.022180+0000","last_became_active":"2024-04-19T03:01:15.016895+0000","last_became_peered":"2024-04-19T03:01:15.016895+0000","last_unstale":"2024-04-19T03:01:15.022180+0000","last_undegraded":"2024-04-19T03:01:15.022180+0000","last_fullsized":"2024-04-19T03:01:15.022180+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:09:23.427311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-19T03:01:18.092387+0000","last_change":"2024-04-19T03:01:15.018526+0000","last_active":"2024-04-19T03:01:18.092387+0000","last_peered":"2024-04-19T03:01:18.092387+0000","last_clean":"2024-04-19T03:01:18.092387+0000","last_became_active":"2024-04-19T03:01:15.018268+0000","last_became_peered":"2024-04-19T03:01:15.018268+0000","last_unstale":"2024-04-19T03:01:18.092387+0000","last_undegraded":"2024-04-19T03:01:18.092387+0000","last_fullsized":"2024-04-19T03:01:18.092387+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:17:52.453165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.023176+0000","last_change":"2024-04-19T03:01:15.018499+0000","last_active":"2024-04-19T03:01:15.023176+0000","last_peered":"2024-04-19T03:01:15.023176+0000","last_clean":"2024-04-19T03:01:15.023176+0000","last_became_active":"2024-04-19T03:01:15.017894+0000","last_became_peered":"2024-04-19T03:01:15.017894+0000","last_unstale":"2024-04-19T03:01:15.023176+0000","last_undegraded":"2024-04-19T03:01:15.023176+0000","last_fullsized":"2024-04-19T03:01:15.023176+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:10:21.967941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.019491+0000","last_change":"2024-04-19T03:01:15.017525+0000","last_active":"2024-04-19T03:01:15.019491+0000","last_peered":"2024-04-19T03:01:15.019491+0000","last_clean":"2024-04-19T03:01:15.019491+0000","last_became_active":"2024-04-19T03:01:15.016887+0000","last_became_peered":"2024-04-19T03:01:15.016887+0000","last_unstale":"2024-04-19T03:01:15.019491+0000","last_undegraded":"2024-04-19T03:01:15.019491+0000","last_fullsized":"2024-04-19T03:01:15.019491+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:10:56.732208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.023561+0000","last_change":"2024-04-19T03:01:15.020240+0000","last_active":"2024-04-19T03:01:15.023561+0000","last_peered":"2024-04-19T03:01:15.023561+0000","last_clean":"2024-04-19T03:01:15.023561+0000","last_became_active":"2024-04-19T03:01:15.019820+0000","last_became_peered":"2024-04-19T03:01:15.019820+0000","last_unstale":"2024-04-19T03:01:15.023561+0000","last_undegraded":"2024-04-19T03:01:15.023561+0000","last_fullsized":"2024-04-19T03:01:15.023561+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:09:23.427311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.023234+0000","last_change":"2024-04-19T03:01:15.018712+0000","last_active":"2024-04-19T03:01:15.023234+0000","last_peered":"2024-04-19T03:01:15.023234+0000","last_clean":"2024-04-19T03:01:15.023234+0000","last_became_active":"2024-04-19T03:01:15.017970+0000","last_became_peered":"2024-04-19T03:01:15.017970+0000","last_unstale":"2024-04-19T03:01:15.023234+0000","last_undegraded":"2024-04-19T03:01:15.023234+0000","last_fullsized":"2024-04-19T03:01:15.023234+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:07:57.843767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.013382+0000","last_change":"2024-04-19T03:01:15.010960+0000","last_active":"2024-04-19T03:01:15.013382+0000","last_peered":"2024-04-19T03:01:15.013382+0000","last_clean":"2024-04-19T03:01:15.013382+0000","last_became_active":"2024-04-19T03:01:15.010472+0000","last_became_peered":"2024-04-19T03:01:15.010472+0000","last_unstale":"2024-04-19T03:01:15.013382+0000","last_undegraded":"2024-04-19T03:01:15.013382+0000","last_fullsized":"2024-04-19T03:01:15.013382+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:21:36.129346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.017090+0000","last_change":"2024-04-19T03:01:15.014574+0000","last_active":"2024-04-19T03:01:15.017090+0000","last_peered":"2024-04-19T03:01:15.017090+0000","last_clean":"2024-04-19T03:01:15.017090+0000","last_became_active":"2024-04-19T03:01:15.014096+0000","last_became_peered":"2024-04-19T03:01:15.014096+0000","last_unstale":"2024-04-19T03:01:15.017090+0000","last_undegraded":"2024-04-19T03:01:15.017090+0000","last_fullsized":"2024-04-19T03:01:15.017090+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:01:54.253963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.022131+0000","last_change":"2024-04-19T03:01:15.018778+0000","last_active":"2024-04-19T03:01:15.022131+0000","last_peered":"2024-04-19T03:01:15.022131+0000","last_clean":"2024-04-19T03:01:15.022131+0000","last_became_active":"2024-04-19T03:01:15.016809+0000","last_became_peered":"2024-04-19T03:01:15.016809+0000","last_unstale":"2024-04-19T03:01:15.022131+0000","last_undegraded":"2024-04-19T03:01:15.022131+0000","last_fullsized":"2024-04-19T03:01:15.022131+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:40:59.453079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-19T03:01:18.093156+0000","last_change":"2024-04-19T03:01:15.011516+0000","last_active":"2024-04-19T03:01:18.093156+0000","last_peered":"2024-04-19T03:01:18.093156+0000","last_clean":"2024-04-19T03:01:18.093156+0000","last_became_active":"2024-04-19T03:01:15.011056+0000","last_became_peered":"2024-04-19T03:01:15.011056+0000","last_unstale":"2024-04-19T03:01:18.093156+0000","last_undegraded":"2024-04-19T03:01:18.093156+0000","last_fullsized":"2024-04-19T03:01:18.093156+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:35:50.354787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.022947+0000","last_change":"2024-04-19T03:01:15.017257+0000","last_active":"2024-04-19T03:01:15.022947+0000","last_peered":"2024-04-19T03:01:15.022947+0000","last_clean":"2024-04-19T03:01:15.022947+0000","last_became_active":"2024-04-19T03:01:15.016062+0000","last_became_peered":"2024-04-19T03:01:15.016062+0000","last_unstale":"2024-04-19T03:01:15.022947+0000","last_undegraded":"2024-04-19T03:01:15.022947+0000","last_fullsized":"2024-04-19T03:01:15.022947+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:40:20.790332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-19T03:01:18.092291+0000","last_change":"2024-04-19T03:01:15.011065+0000","last_active":"2024-04-19T03:01:18.092291+0000","last_peered":"2024-04-19T03:01:18.092291+0000","last_clean":"2024-04-19T03:01:18.092291+0000","last_became_active":"2024-04-19T03:01:15.010330+0000","last_became_peered":"2024-04-19T03:01:15.010330+0000","last_unstale":"2024-04-19T03:01:18.092291+0000","last_undegraded":"2024-04-19T03:01:18.092291+0000","last_fullsized":"2024-04-19T03:01:18.092291+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:56:10.495533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.021464+0000","last_change":"2024-04-19T03:01:15.017812+0000","last_active":"2024-04-19T03:01:15.021464+0000","last_peered":"2024-04-19T03:01:15.021464+0000","last_clean":"2024-04-19T03:01:15.021464+0000","last_became_active":"2024-04-19T03:01:15.016891+0000","last_became_peered":"2024-04-19T03:01:15.016891+0000","last_unstale":"2024-04-19T03:01:15.021464+0000","last_undegraded":"2024-04-19T03:01:15.021464+0000","last_fullsized":"2024-04-19T03:01:15.021464+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:39:54.289444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.024134+0000","last_change":"2024-04-19T03:01:15.019143+0000","last_active":"2024-04-19T03:01:15.024134+0000","last_peered":"2024-04-19T03:01:15.024134+0000","last_clean":"2024-04-19T03:01:15.024134+0000","last_became_active":"2024-04-19T03:01:15.017757+0000","last_became_peered":"2024-04-19T03:01:15.017757+0000","last_unstale":"2024-04-19T03:01:15.024134+0000","last_undegraded":"2024-04-19T03:01:15.024134+0000","last_fullsized":"2024-04-19T03:01:15.024134+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:10:21.967941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.023544+0000","last_change":"2024-04-19T03:01:15.020108+0000","last_active":"2024-04-19T03:01:15.023544+0000","last_peered":"2024-04-19T03:01:15.023544+0000","last_clean":"2024-04-19T03:01:15.023544+0000","last_became_active":"2024-04-19T03:01:15.018978+0000","last_became_peered":"2024-04-19T03:01:15.018978+0000","last_unstale":"2024-04-19T03:01:15.023544+0000","last_undegraded":"2024-04-19T03:01:15.023544+0000","last_fullsized":"2024-04-19T03:01:15.023544+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:30:22.360053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-19T03:01:18.090964+0000","last_change":"2024-04-19T03:01:15.016877+0000","last_active":"2024-04-19T03:01:18.090964+0000","last_peered":"2024-04-19T03:01:18.090964+0000","last_clean":"2024-04-19T03:01:18.090964+0000","last_became_active":"2024-04-19T03:01:15.016245+0000","last_became_peered":"2024-04-19T03:01:15.016245+0000","last_unstale":"2024-04-19T03:01:18.090964+0000","last_undegraded":"2024-04-19T03:01:18.090964+0000","last_fullsized":"2024-04-19T03:01:18.090964+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:38:07.846380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.023272+0000","last_change":"2024-04-19T03:01:15.018809+0000","last_active":"2024-04-19T03:01:15.023272+0000","last_peered":"2024-04-19T03:01:15.023272+0000","last_clean":"2024-04-19T03:01:15.023272+0000","last_became_active":"2024-04-19T03:01:15.017549+0000","last_became_peered":"2024-04-19T03:01:15.017549+0000","last_unstale":"2024-04-19T03:01:15.023272+0000","last_undegraded":"2024-04-19T03:01:15.023272+0000","last_fullsized":"2024-04-19T03:01:15.023272+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:37:35.950318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.023709+0000","last_change":"2024-04-19T03:01:15.020443+0000","last_active":"2024-04-19T03:01:15.023709+0000","last_peered":"2024-04-19T03:01:15.023709+0000","last_clean":"2024-04-19T03:01:15.023709+0000","last_became_active":"2024-04-19T03:01:15.018780+0000","last_became_peered":"2024-04-19T03:01:15.018780+0000","last_unstale":"2024-04-19T03:01:15.023709+0000","last_undegraded":"2024-04-19T03:01:15.023709+0000","last_fullsized":"2024-04-19T03:01:15.023709+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:56:44.307812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-19T03:01:18.093128+0000","last_change":"2024-04-19T03:01:15.017487+0000","last_active":"2024-04-19T03:01:18.093128+0000","last_peered":"2024-04-19T03:01:18.093128+0000","last_clean":"2024-04-19T03:01:18.093128+0000","last_became_active":"2024-04-19T03:01:15.016183+0000","last_became_peered":"2024-04-19T03:01:15.016183+0000","last_unstale":"2024-04-19T03:01:18.093128+0000","last_undegraded":"2024-04-19T03:01:18.093128+0000","last_fullsized":"2024-04-19T03:01:18.093128+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:44:37.487013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.018261+0000","last_change":"2024-04-19T03:01:15.016117+0000","last_active":"2024-04-19T03:01:15.018261+0000","last_peered":"2024-04-19T03:01:15.018261+0000","last_clean":"2024-04-19T03:01:15.018261+0000","last_became_active":"2024-04-19T03:01:15.015415+0000","last_became_peered":"2024-04-19T03:01:15.015415+0000","last_unstale":"2024-04-19T03:01:15.018261+0000","last_undegraded":"2024-04-19T03:01:15.018261+0000","last_fullsized":"2024-04-19T03:01:15.018261+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:06:35.813797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.023502+0000","last_change":"2024-04-19T03:01:15.020098+0000","last_active":"2024-04-19T03:01:15.023502+0000","last_peered":"2024-04-19T03:01:15.023502+0000","last_clean":"2024-04-19T03:01:15.023502+0000","last_became_active":"2024-04-19T03:01:15.019064+0000","last_became_peered":"2024-04-19T03:01:15.019064+0000","last_unstale":"2024-04-19T03:01:15.023502+0000","last_undegraded":"2024-04-19T03:01:15.023502+0000","last_fullsized":"2024-04-19T03:01:15.023502+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:50:06.490191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-19T03:01:18.092158+0000","last_change":"2024-04-19T03:01:15.013746+0000","last_active":"2024-04-19T03:01:18.092158+0000","last_peered":"2024-04-19T03:01:18.092158+0000","last_clean":"2024-04-19T03:01:18.092158+0000","last_became_active":"2024-04-19T03:01:15.011865+0000","last_became_peered":"2024-04-19T03:01:15.011865+0000","last_unstale":"2024-04-19T03:01:18.092158+0000","last_undegraded":"2024-04-19T03:01:18.092158+0000","last_fullsized":"2024-04-19T03:01:18.092158+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:32:23.606804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.023434+0000","last_change":"2024-04-19T03:01:15.019787+0000","last_active":"2024-04-19T03:01:15.023434+0000","last_peered":"2024-04-19T03:01:15.023434+0000","last_clean":"2024-04-19T03:01:15.023434+0000","last_became_active":"2024-04-19T03:01:15.018350+0000","last_became_peered":"2024-04-19T03:01:15.018350+0000","last_unstale":"2024-04-19T03:01:15.023434+0000","last_undegraded":"2024-04-19T03:01:15.023434+0000","last_fullsized":"2024-04-19T03:01:15.023434+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:10:42.079294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-19T03:01:18.090924+0000","last_change":"2024-04-19T03:01:15.012900+0000","last_active":"2024-04-19T03:01:18.090924+0000","last_peered":"2024-04-19T03:01:18.090924+0000","last_clean":"2024-04-19T03:01:18.090924+0000","last_became_active":"2024-04-19T03:01:15.012416+0000","last_became_peered":"2024-04-19T03:01:15.012416+0000","last_unstale":"2024-04-19T03:01:18.090924+0000","last_undegraded":"2024-04-19T03:01:18.090924+0000","last_fullsized":"2024-04-19T03:01:18.090924+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:57:14.847455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.024190+0000","last_change":"2024-04-19T03:01:15.019278+0000","last_active":"2024-04-19T03:01:15.024190+0000","last_peered":"2024-04-19T03:01:15.024190+0000","last_clean":"2024-04-19T03:01:15.024190+0000","last_became_active":"2024-04-19T03:01:15.017779+0000","last_became_peered":"2024-04-19T03:01:15.017779+0000","last_unstale":"2024-04-19T03:01:15.024190+0000","last_undegraded":"2024-04-19T03:01:15.024190+0000","last_fullsized":"2024-04-19T03:01:15.024190+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:54:54.463918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.022801+0000","last_change":"2024-04-19T03:01:15.016669+0000","last_active":"2024-04-19T03:01:15.022801+0000","last_peered":"2024-04-19T03:01:15.022801+0000","last_clean":"2024-04-19T03:01:15.022801+0000","last_became_active":"2024-04-19T03:01:15.016286+0000","last_became_peered":"2024-04-19T03:01:15.016286+0000","last_unstale":"2024-04-19T03:01:15.022801+0000","last_undegraded":"2024-04-19T03:01:15.022801+0000","last_fullsized":"2024-04-19T03:01:15.022801+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:55:34.102680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"20'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.019438+0000","last_change":"2024-04-19T03:01:14.651050+0000","last_active":"2024-04-19T03:01:15.019438+0000","last_peered":"2024-04-19T03:01:15.019438+0000","last_clean":"2024-04-19T03:01:15.019438+0000","last_became_active":"2024-04-19T03:01:14.650679+0000","last_became_peered":"2024-04-19T03:01:14.650679+0000","last_unstale":"2024-04-19T03:01:15.019438+0000","last_undegraded":"2024-04-19T03:01:15.019438+0000","last_fullsized":"2024-04-19T03:01:15.019438+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:37:03.684394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.022892+0000","last_change":"2024-04-19T03:01:15.017124+0000","last_active":"2024-04-19T03:01:15.022892+0000","last_peered":"2024-04-19T03:01:15.022892+0000","last_clean":"2024-04-19T03:01:15.022892+0000","last_became_active":"2024-04-19T03:01:15.016535+0000","last_became_peered":"2024-04-19T03:01:15.016535+0000","last_unstale":"2024-04-19T03:01:15.022892+0000","last_undegraded":"2024-04-19T03:01:15.022892+0000","last_fullsized":"2024-04-19T03:01:15.022892+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:40:12.179703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.002737+0000","last_change":"2024-04-19T03:01:14.646594+0000","last_active":"2024-04-19T03:01:15.002737+0000","last_peered":"2024-04-19T03:01:15.002737+0000","last_clean":"2024-04-19T03:01:15.002737+0000","last_became_active":"2024-04-19T03:01:14.646122+0000","last_became_peered":"2024-04-19T03:01:14.646122+0000","last_unstale":"2024-04-19T03:01:15.002737+0000","last_undegraded":"2024-04-19T03:01:15.002737+0000","last_fullsized":"2024-04-19T03:01:15.002737+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:40:53.463388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-19T03:01:18.093362+0000","last_change":"2024-04-19T03:01:15.017420+0000","last_active":"2024-04-19T03:01:18.093362+0000","last_peered":"2024-04-19T03:01:18.093362+0000","last_clean":"2024-04-19T03:01:18.093362+0000","last_became_active":"2024-04-19T03:01:15.015840+0000","last_became_peered":"2024-04-19T03:01:15.015840+0000","last_unstale":"2024-04-19T03:01:18.093362+0000","last_undegraded":"2024-04-19T03:01:18.093362+0000","last_fullsized":"2024-04-19T03:01:18.093362+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:05:05.266293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.004873+0000","last_change":"2024-04-19T03:01:14.649074+0000","last_active":"2024-04-19T03:01:15.004873+0000","last_peered":"2024-04-19T03:01:15.004873+0000","last_clean":"2024-04-19T03:01:15.004873+0000","last_became_active":"2024-04-19T03:01:14.648217+0000","last_became_peered":"2024-04-19T03:01:14.648217+0000","last_unstale":"2024-04-19T03:01:15.004873+0000","last_undegraded":"2024-04-19T03:01:15.004873+0000","last_fullsized":"2024-04-19T03:01:15.004873+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:57:05.238043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-19T03:01:18.092638+0000","last_change":"2024-04-19T03:01:15.017136+0000","last_active":"2024-04-19T03:01:18.092638+0000","last_peered":"2024-04-19T03:01:18.092638+0000","last_clean":"2024-04-19T03:01:18.092638+0000","last_became_active":"2024-04-19T03:01:15.016550+0000","last_became_peered":"2024-04-19T03:01:15.016550+0000","last_unstale":"2024-04-19T03:01:18.092638+0000","last_undegraded":"2024-04-19T03:01:18.092638+0000","last_fullsized":"2024-04-19T03:01:18.092638+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:55:37.697481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"20'8","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.023332+0000","last_change":"2024-04-19T03:01:14.649044+0000","last_active":"2024-04-19T03:01:15.023332+0000","last_peered":"2024-04-19T03:01:15.023332+0000","last_clean":"2024-04-19T03:01:15.023332+0000","last_became_active":"2024-04-19T03:01:14.648859+0000","last_became_peered":"2024-04-19T03:01:14.648859+0000","last_unstale":"2024-04-19T03:01:15.023332+0000","last_undegraded":"2024-04-19T03:01:15.023332+0000","last_fullsized":"2024-04-19T03:01:15.023332+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:30:45.925657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"20'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.015096+0000","last_change":"2024-04-19T03:01:14.649839+0000","last_active":"2024-04-19T03:01:15.015096+0000","last_peered":"2024-04-19T03:01:15.015096+0000","last_clean":"2024-04-19T03:01:15.015096+0000","last_became_active":"2024-04-19T03:01:14.649571+0000","last_became_peered":"2024-04-19T03:01:14.649571+0000","last_unstale":"2024-04-19T03:01:15.015096+0000","last_undegraded":"2024-04-19T03:01:15.015096+0000","last_fullsized":"2024-04-19T03:01:15.015096+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:03:57.839660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.023786+0000","last_change":"2024-04-19T03:01:15.021047+0000","last_active":"2024-04-19T03:01:15.023786+0000","last_peered":"2024-04-19T03:01:15.023786+0000","last_clean":"2024-04-19T03:01:15.023786+0000","last_became_active":"2024-04-19T03:01:15.019792+0000","last_became_peered":"2024-04-19T03:01:15.019792+0000","last_unstale":"2024-04-19T03:01:15.023786+0000","last_undegraded":"2024-04-19T03:01:15.023786+0000","last_fullsized":"2024-04-19T03:01:15.023786+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:54:54.463918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"20'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.019933+0000","last_change":"2024-04-19T03:01:14.645075+0000","last_active":"2024-04-19T03:01:15.019933+0000","last_peered":"2024-04-19T03:01:15.019933+0000","last_clean":"2024-04-19T03:01:15.019933+0000","last_became_active":"2024-04-19T03:01:14.644790+0000","last_became_peered":"2024-04-19T03:01:14.644790+0000","last_unstale":"2024-04-19T03:01:15.019933+0000","last_undegraded":"2024-04-19T03:01:15.019933+0000","last_fullsized":"2024-04-19T03:01:15.019933+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:55:15.035769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.021374+0000","last_change":"2024-04-19T03:01:15.016330+0000","last_active":"2024-04-19T03:01:15.021374+0000","last_peered":"2024-04-19T03:01:15.021374+0000","last_clean":"2024-04-19T03:01:15.021374+0000","last_became_active":"2024-04-19T03:01:15.015644+0000","last_became_peered":"2024-04-19T03:01:15.015644+0000","last_unstale":"2024-04-19T03:01:15.021374+0000","last_undegraded":"2024-04-19T03:01:15.021374+0000","last_fullsized":"2024-04-19T03:01:15.021374+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:13:06.902769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"20'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.015911+0000","last_change":"2024-04-19T03:01:14.649826+0000","last_active":"2024-04-19T03:01:15.015911+0000","last_peered":"2024-04-19T03:01:15.015911+0000","last_clean":"2024-04-19T03:01:15.015911+0000","last_became_active":"2024-04-19T03:01:14.649565+0000","last_became_peered":"2024-04-19T03:01:14.649565+0000","last_unstale":"2024-04-19T03:01:15.015911+0000","last_undegraded":"2024-04-19T03:01:15.015911+0000","last_fullsized":"2024-04-19T03:01:15.015911+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:36:00.962931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.021994+0000","last_change":"2024-04-19T03:01:15.018099+0000","last_active":"2024-04-19T03:01:15.021994+0000","last_peered":"2024-04-19T03:01:15.021994+0000","last_clean":"2024-04-19T03:01:15.021994+0000","last_became_active":"2024-04-19T03:01:15.017536+0000","last_became_peered":"2024-04-19T03:01:15.017536+0000","last_unstale":"2024-04-19T03:01:15.021994+0000","last_undegraded":"2024-04-19T03:01:15.021994+0000","last_fullsized":"2024-04-19T03:01:15.021994+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:50:06.490191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.006366+0000","last_change":"2024-04-19T03:01:14.651201+0000","last_active":"2024-04-19T03:01:15.006366+0000","last_peered":"2024-04-19T03:01:15.006366+0000","last_clean":"2024-04-19T03:01:15.006366+0000","last_became_active":"2024-04-19T03:01:14.650942+0000","last_became_peered":"2024-04-19T03:01:14.650942+0000","last_unstale":"2024-04-19T03:01:15.006366+0000","last_undegraded":"2024-04-19T03:01:15.006366+0000","last_fullsized":"2024-04-19T03:01:15.006366+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:02:13.190917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-19T03:01:18.092211+0000","last_change":"2024-04-19T03:01:15.017458+0000","last_active":"2024-04-19T03:01:18.092211+0000","last_peered":"2024-04-19T03:01:18.092211+0000","last_clean":"2024-04-19T03:01:18.092211+0000","last_became_active":"2024-04-19T03:01:15.016653+0000","last_became_peered":"2024-04-19T03:01:15.016653+0000","last_unstale":"2024-04-19T03:01:18.092211+0000","last_undegraded":"2024-04-19T03:01:18.092211+0000","last_fullsized":"2024-04-19T03:01:18.092211+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:52:28.671365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"20'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.016958+0000","last_change":"2024-04-19T03:01:14.647553+0000","last_active":"2024-04-19T03:01:15.016958+0000","last_peered":"2024-04-19T03:01:15.016958+0000","last_clean":"2024-04-19T03:01:15.016958+0000","last_became_active":"2024-04-19T03:01:14.647147+0000","last_became_peered":"2024-04-19T03:01:14.647147+0000","last_unstale":"2024-04-19T03:01:15.016958+0000","last_undegraded":"2024-04-19T03:01:15.016958+0000","last_fullsized":"2024-04-19T03:01:15.016958+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:33:45.550646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.021494+0000","last_change":"2024-04-19T03:01:15.018012+0000","last_active":"2024-04-19T03:01:15.021494+0000","last_peered":"2024-04-19T03:01:15.021494+0000","last_clean":"2024-04-19T03:01:15.021494+0000","last_became_active":"2024-04-19T03:01:15.017086+0000","last_became_peered":"2024-04-19T03:01:15.017086+0000","last_unstale":"2024-04-19T03:01:15.021494+0000","last_undegraded":"2024-04-19T03:01:15.021494+0000","last_fullsized":"2024-04-19T03:01:15.021494+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:54:04.518505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.001920+0000","last_change":"2024-04-19T03:01:14.651004+0000","last_active":"2024-04-19T03:01:15.001920+0000","last_peered":"2024-04-19T03:01:15.001920+0000","last_clean":"2024-04-19T03:01:15.001920+0000","last_became_active":"2024-04-19T03:01:14.650635+0000","last_became_peered":"2024-04-19T03:01:14.650635+0000","last_unstale":"2024-04-19T03:01:15.001920+0000","last_undegraded":"2024-04-19T03:01:15.001920+0000","last_fullsized":"2024-04-19T03:01:15.001920+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:57:15.575819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.018174+0000","last_change":"2024-04-19T03:01:15.015685+0000","last_active":"2024-04-19T03:01:15.018174+0000","last_peered":"2024-04-19T03:01:15.018174+0000","last_clean":"2024-04-19T03:01:15.018174+0000","last_became_active":"2024-04-19T03:01:15.014847+0000","last_became_peered":"2024-04-19T03:01:15.014847+0000","last_unstale":"2024-04-19T03:01:15.018174+0000","last_undegraded":"2024-04-19T03:01:15.018174+0000","last_fullsized":"2024-04-19T03:01:15.018174+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:51:06.208551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.005141+0000","last_change":"2024-04-19T03:01:14.644582+0000","last_active":"2024-04-19T03:01:15.005141+0000","last_peered":"2024-04-19T03:01:15.005141+0000","last_clean":"2024-04-19T03:01:15.005141+0000","last_became_active":"2024-04-19T03:01:14.644101+0000","last_became_peered":"2024-04-19T03:01:14.644101+0000","last_unstale":"2024-04-19T03:01:15.005141+0000","last_undegraded":"2024-04-19T03:01:15.005141+0000","last_fullsized":"2024-04-19T03:01:15.005141+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:28:24.652864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.017755+0000","last_change":"2024-04-19T03:01:15.014818+0000","last_active":"2024-04-19T03:01:15.017755+0000","last_peered":"2024-04-19T03:01:15.017755+0000","last_clean":"2024-04-19T03:01:15.017755+0000","last_became_active":"2024-04-19T03:01:15.014421+0000","last_became_peered":"2024-04-19T03:01:15.014421+0000","last_unstale":"2024-04-19T03:01:15.017755+0000","last_undegraded":"2024-04-19T03:01:15.017755+0000","last_fullsized":"2024-04-19T03:01:15.017755+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:16:20.475837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.008183+0000","last_change":"2024-04-19T03:01:14.643840+0000","last_active":"2024-04-19T03:01:15.008183+0000","last_peered":"2024-04-19T03:01:15.008183+0000","last_clean":"2024-04-19T03:01:15.008183+0000","last_became_active":"2024-04-19T03:01:14.643503+0000","last_became_peered":"2024-04-19T03:01:14.643503+0000","last_unstale":"2024-04-19T03:01:15.008183+0000","last_undegraded":"2024-04-19T03:01:15.008183+0000","last_fullsized":"2024-04-19T03:01:15.008183+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:09:33.801275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-19T03:01:18.092763+0000","last_change":"2024-04-19T03:01:15.012607+0000","last_active":"2024-04-19T03:01:18.092763+0000","last_peered":"2024-04-19T03:01:18.092763+0000","last_clean":"2024-04-19T03:01:18.092763+0000","last_became_active":"2024-04-19T03:01:15.012152+0000","last_became_peered":"2024-04-19T03:01:15.012152+0000","last_unstale":"2024-04-19T03:01:18.092763+0000","last_undegraded":"2024-04-19T03:01:18.092763+0000","last_fullsized":"2024-04-19T03:01:18.092763+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:57:36.794409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"14'157","reported_seq":212,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.004135+0000","last_change":"2024-04-19T03:01:07.538434+0000","last_active":"2024-04-19T03:01:15.004135+0000","last_peered":"2024-04-19T03:01:15.004135+0000","last_clean":"2024-04-19T03:01:15.004135+0000","last_became_active":"2024-04-19T03:01:07.537856+0000","last_became_peered":"2024-04-19T03:01:07.537856+0000","last_unstale":"2024-04-19T03:01:15.004135+0000","last_undegraded":"2024-04-19T03:01:15.004135+0000","last_fullsized":"2024-04-19T03:01:15.004135+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:06.516863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:06.516863+0000","last_clean_scrub_stamp":"2024-04-19T03:01:06.516863+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:36:46.386286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.006445+0000","last_change":"2024-04-19T03:01:10.602869+0000","last_active":"2024-04-19T03:01:15.006445+0000","last_peered":"2024-04-19T03:01:15.006445+0000","last_clean":"2024-04-19T03:01:15.006445+0000","last_became_active":"2024-04-19T03:01:10.601965+0000","last_became_peered":"2024-04-19T03:01:10.601965+0000","last_unstale":"2024-04-19T03:01:15.006445+0000","last_undegraded":"2024-04-19T03:01:15.006445+0000","last_fullsized":"2024-04-19T03:01:15.006445+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_clean_scrub_stamp":"2024-04-19T03:01:09.578660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:14:41.316871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.001643+0000","last_change":"2024-04-19T03:01:14.643201+0000","last_active":"2024-04-19T03:01:15.001643+0000","last_peered":"2024-04-19T03:01:15.001643+0000","last_clean":"2024-04-19T03:01:15.001643+0000","last_became_active":"2024-04-19T03:01:14.642885+0000","last_became_peered":"2024-04-19T03:01:14.642885+0000","last_unstale":"2024-04-19T03:01:15.001643+0000","last_undegraded":"2024-04-19T03:01:15.001643+0000","last_fullsized":"2024-04-19T03:01:15.001643+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:24:40.181164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.019181+0000","last_change":"2024-04-19T03:01:15.016104+0000","last_active":"2024-04-19T03:01:15.019181+0000","last_peered":"2024-04-19T03:01:15.019181+0000","last_clean":"2024-04-19T03:01:15.019181+0000","last_became_active":"2024-04-19T03:01:15.015386+0000","last_became_peered":"2024-04-19T03:01:15.015386+0000","last_unstale":"2024-04-19T03:01:15.019181+0000","last_undegraded":"2024-04-19T03:01:15.019181+0000","last_fullsized":"2024-04-19T03:01:15.019181+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:00:35.372657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.003912+0000","last_change":"2024-04-19T03:01:10.602194+0000","last_active":"2024-04-19T03:01:15.003912+0000","last_peered":"2024-04-19T03:01:15.003912+0000","last_clean":"2024-04-19T03:01:15.003912+0000","last_became_active":"2024-04-19T03:01:10.601381+0000","last_became_peered":"2024-04-19T03:01:10.601381+0000","last_unstale":"2024-04-19T03:01:15.003912+0000","last_undegraded":"2024-04-19T03:01:15.003912+0000","last_fullsized":"2024-04-19T03:01:15.003912+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_clean_scrub_stamp":"2024-04-19T03:01:09.578660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:42:26.594095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.003098+0000","last_change":"2024-04-19T03:01:14.647365+0000","last_active":"2024-04-19T03:01:15.003098+0000","last_peered":"2024-04-19T03:01:15.003098+0000","last_clean":"2024-04-19T03:01:15.003098+0000","last_became_active":"2024-04-19T03:01:14.646950+0000","last_became_peered":"2024-04-19T03:01:14.646950+0000","last_unstale":"2024-04-19T03:01:15.003098+0000","last_undegraded":"2024-04-19T03:01:15.003098+0000","last_fullsized":"2024-04-19T03:01:15.003098+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:41:26.108674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.023211+0000","last_change":"2024-04-19T03:01:15.018728+0000","last_active":"2024-04-19T03:01:15.023211+0000","last_peered":"2024-04-19T03:01:15.023211+0000","last_clean":"2024-04-19T03:01:15.023211+0000","last_became_active":"2024-04-19T03:01:15.017287+0000","last_became_peered":"2024-04-19T03:01:15.017287+0000","last_unstale":"2024-04-19T03:01:15.023211+0000","last_undegraded":"2024-04-19T03:01:15.023211+0000","last_fullsized":"2024-04-19T03:01:15.023211+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:54:04.518505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.003231+0000","last_change":"2024-04-19T03:01:10.600207+0000","last_active":"2024-04-19T03:01:15.003231+0000","last_peered":"2024-04-19T03:01:15.003231+0000","last_clean":"2024-04-19T03:01:15.003231+0000","last_became_active":"2024-04-19T03:01:10.599209+0000","last_became_peered":"2024-04-19T03:01:10.599209+0000","last_unstale":"2024-04-19T03:01:15.003231+0000","last_undegraded":"2024-04-19T03:01:15.003231+0000","last_fullsized":"2024-04-19T03:01:15.003231+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_clean_scrub_stamp":"2024-04-19T03:01:09.578660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:30:25.748140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.008341+0000","last_change":"2024-04-19T03:01:14.649068+0000","last_active":"2024-04-19T03:01:15.008341+0000","last_peered":"2024-04-19T03:01:15.008341+0000","last_clean":"2024-04-19T03:01:15.008341+0000","last_became_active":"2024-04-19T03:01:14.648082+0000","last_became_peered":"2024-04-19T03:01:14.648082+0000","last_unstale":"2024-04-19T03:01:15.008341+0000","last_undegraded":"2024-04-19T03:01:15.008341+0000","last_fullsized":"2024-04-19T03:01:15.008341+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:30:14.489117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-19T03:01:18.092872+0000","last_change":"2024-04-19T03:01:15.012147+0000","last_active":"2024-04-19T03:01:18.092872+0000","last_peered":"2024-04-19T03:01:18.092872+0000","last_clean":"2024-04-19T03:01:18.092872+0000","last_became_active":"2024-04-19T03:01:15.011421+0000","last_became_peered":"2024-04-19T03:01:15.011421+0000","last_unstale":"2024-04-19T03:01:18.092872+0000","last_undegraded":"2024-04-19T03:01:18.092872+0000","last_fullsized":"2024-04-19T03:01:18.092872+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:50:51.928641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.002185+0000","last_change":"2024-04-19T03:01:10.601386+0000","last_active":"2024-04-19T03:01:15.002185+0000","last_peered":"2024-04-19T03:01:15.002185+0000","last_clean":"2024-04-19T03:01:15.002185+0000","last_became_active":"2024-04-19T03:01:10.600732+0000","last_became_peered":"2024-04-19T03:01:10.600732+0000","last_unstale":"2024-04-19T03:01:15.002185+0000","last_undegraded":"2024-04-19T03:01:15.002185+0000","last_fullsized":"2024-04-19T03:01:15.002185+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_clean_scrub_stamp":"2024-04-19T03:01:09.578660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:34:53.138338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.006322+0000","last_change":"2024-04-19T03:01:14.651363+0000","last_active":"2024-04-19T03:01:15.006322+0000","last_peered":"2024-04-19T03:01:15.006322+0000","last_clean":"2024-04-19T03:01:15.006322+0000","last_became_active":"2024-04-19T03:01:14.651020+0000","last_became_peered":"2024-04-19T03:01:14.651020+0000","last_unstale":"2024-04-19T03:01:15.006322+0000","last_undegraded":"2024-04-19T03:01:15.006322+0000","last_fullsized":"2024-04-19T03:01:15.006322+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:44:36.043345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-19T03:01:18.092601+0000","last_change":"2024-04-19T03:01:15.017182+0000","last_active":"2024-04-19T03:01:18.092601+0000","last_peered":"2024-04-19T03:01:18.092601+0000","last_clean":"2024-04-19T03:01:18.092601+0000","last_became_active":"2024-04-19T03:01:15.016258+0000","last_became_peered":"2024-04-19T03:01:15.016258+0000","last_unstale":"2024-04-19T03:01:18.092601+0000","last_undegraded":"2024-04-19T03:01:18.092601+0000","last_fullsized":"2024-04-19T03:01:18.092601+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:27:25.351590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.004000+0000","last_change":"2024-04-19T03:01:14.651740+0000","last_active":"2024-04-19T03:01:15.004000+0000","last_peered":"2024-04-19T03:01:15.004000+0000","last_clean":"2024-04-19T03:01:15.004000+0000","last_became_active":"2024-04-19T03:01:14.651491+0000","last_became_peered":"2024-04-19T03:01:14.651491+0000","last_unstale":"2024-04-19T03:01:15.004000+0000","last_undegraded":"2024-04-19T03:01:15.004000+0000","last_fullsized":"2024-04-19T03:01:15.004000+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:42:15.864988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.006158+0000","last_change":"2024-04-19T03:01:10.601062+0000","last_active":"2024-04-19T03:01:15.006158+0000","last_peered":"2024-04-19T03:01:15.006158+0000","last_clean":"2024-04-19T03:01:15.006158+0000","last_became_active":"2024-04-19T03:01:10.600334+0000","last_became_peered":"2024-04-19T03:01:10.600334+0000","last_unstale":"2024-04-19T03:01:15.006158+0000","last_undegraded":"2024-04-19T03:01:15.006158+0000","last_fullsized":"2024-04-19T03:01:15.006158+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_clean_scrub_stamp":"2024-04-19T03:01:09.578660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:51:38.307752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.023683+0000","last_change":"2024-04-19T03:01:15.020501+0000","last_active":"2024-04-19T03:01:15.023683+0000","last_peered":"2024-04-19T03:01:15.023683+0000","last_clean":"2024-04-19T03:01:15.023683+0000","last_became_active":"2024-04-19T03:01:15.019019+0000","last_became_peered":"2024-04-19T03:01:15.019019+0000","last_unstale":"2024-04-19T03:01:15.023683+0000","last_undegraded":"2024-04-19T03:01:15.023683+0000","last_fullsized":"2024-04-19T03:01:15.023683+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:22:58.349159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.006058+0000","last_change":"2024-04-19T03:01:14.643098+0000","last_active":"2024-04-19T03:01:15.006058+0000","last_peered":"2024-04-19T03:01:15.006058+0000","last_clean":"2024-04-19T03:01:15.006058+0000","last_became_active":"2024-04-19T03:01:14.642789+0000","last_became_peered":"2024-04-19T03:01:14.642789+0000","last_unstale":"2024-04-19T03:01:15.006058+0000","last_undegraded":"2024-04-19T03:01:15.006058+0000","last_fullsized":"2024-04-19T03:01:15.006058+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:40:40.193720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.005646+0000","last_change":"2024-04-19T03:01:10.603139+0000","last_active":"2024-04-19T03:01:15.005646+0000","last_peered":"2024-04-19T03:01:15.005646+0000","last_clean":"2024-04-19T03:01:15.005646+0000","last_became_active":"2024-04-19T03:01:10.602397+0000","last_became_peered":"2024-04-19T03:01:10.602397+0000","last_unstale":"2024-04-19T03:01:15.005646+0000","last_undegraded":"2024-04-19T03:01:15.005646+0000","last_fullsized":"2024-04-19T03:01:15.005646+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_clean_scrub_stamp":"2024-04-19T03:01:09.578660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:36:00.072157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.023512+0000","last_change":"2024-04-19T03:01:15.020052+0000","last_active":"2024-04-19T03:01:15.023512+0000","last_peered":"2024-04-19T03:01:15.023512+0000","last_clean":"2024-04-19T03:01:15.023512+0000","last_became_active":"2024-04-19T03:01:15.019144+0000","last_became_peered":"2024-04-19T03:01:15.019144+0000","last_unstale":"2024-04-19T03:01:15.023512+0000","last_undegraded":"2024-04-19T03:01:15.023512+0000","last_fullsized":"2024-04-19T03:01:15.023512+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:39:54.289444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"20'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.019383+0000","last_change":"2024-04-19T03:01:14.643328+0000","last_active":"2024-04-19T03:01:15.019383+0000","last_peered":"2024-04-19T03:01:15.019383+0000","last_clean":"2024-04-19T03:01:15.019383+0000","last_became_active":"2024-04-19T03:01:14.643001+0000","last_became_peered":"2024-04-19T03:01:14.643001+0000","last_unstale":"2024-04-19T03:01:15.019383+0000","last_undegraded":"2024-04-19T03:01:15.019383+0000","last_fullsized":"2024-04-19T03:01:15.019383+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:28:14.128657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.006138+0000","last_change":"2024-04-19T03:01:10.599894+0000","last_active":"2024-04-19T03:01:15.006138+0000","last_peered":"2024-04-19T03:01:15.006138+0000","last_clean":"2024-04-19T03:01:15.006138+0000","last_became_active":"2024-04-19T03:01:10.599202+0000","last_became_peered":"2024-04-19T03:01:10.599202+0000","last_unstale":"2024-04-19T03:01:15.006138+0000","last_undegraded":"2024-04-19T03:01:15.006138+0000","last_fullsized":"2024-04-19T03:01:15.006138+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_clean_scrub_stamp":"2024-04-19T03:01:09.578660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:59:34.386302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-19T03:01:18.091060+0000","last_change":"2024-04-19T03:01:15.016429+0000","last_active":"2024-04-19T03:01:18.091060+0000","last_peered":"2024-04-19T03:01:18.091060+0000","last_clean":"2024-04-19T03:01:18.091060+0000","last_became_active":"2024-04-19T03:01:15.015945+0000","last_became_peered":"2024-04-19T03:01:15.015945+0000","last_unstale":"2024-04-19T03:01:18.091060+0000","last_undegraded":"2024-04-19T03:01:18.091060+0000","last_fullsized":"2024-04-19T03:01:18.091060+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:43:17.785352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"21'1","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-19T03:01:18.093734+0000","last_change":"2024-04-19T03:01:14.647170+0000","last_active":"2024-04-19T03:01:18.093734+0000","last_peered":"2024-04-19T03:01:18.093734+0000","last_clean":"2024-04-19T03:01:18.093734+0000","last_became_active":"2024-04-19T03:01:14.646622+0000","last_became_peered":"2024-04-19T03:01:14.646622+0000","last_unstale":"2024-04-19T03:01:18.093734+0000","last_undegraded":"2024-04-19T03:01:18.093734+0000","last_fullsized":"2024-04-19T03:01:18.093734+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:32:41.909038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.001377+0000","last_change":"2024-04-19T03:01:10.602274+0000","last_active":"2024-04-19T03:01:15.001377+0000","last_peered":"2024-04-19T03:01:15.001377+0000","last_clean":"2024-04-19T03:01:15.001377+0000","last_became_active":"2024-04-19T03:01:10.601487+0000","last_became_peered":"2024-04-19T03:01:10.601487+0000","last_unstale":"2024-04-19T03:01:15.001377+0000","last_undegraded":"2024-04-19T03:01:15.001377+0000","last_fullsized":"2024-04-19T03:01:15.001377+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_clean_scrub_stamp":"2024-04-19T03:01:09.578660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:26:16.712446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.023281+0000","last_change":"2024-04-19T03:01:15.018914+0000","last_active":"2024-04-19T03:01:15.023281+0000","last_peered":"2024-04-19T03:01:15.023281+0000","last_clean":"2024-04-19T03:01:15.023281+0000","last_became_active":"2024-04-19T03:01:15.018276+0000","last_became_peered":"2024-04-19T03:01:15.018276+0000","last_unstale":"2024-04-19T03:01:15.023281+0000","last_undegraded":"2024-04-19T03:01:15.023281+0000","last_fullsized":"2024-04-19T03:01:15.023281+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:40:59.453079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.018690+0000","last_change":"2024-04-19T03:01:15.015855+0000","last_active":"2024-04-19T03:01:15.018690+0000","last_peered":"2024-04-19T03:01:15.018690+0000","last_clean":"2024-04-19T03:01:15.018690+0000","last_became_active":"2024-04-19T03:01:15.015358+0000","last_became_peered":"2024-04-19T03:01:15.015358+0000","last_unstale":"2024-04-19T03:01:15.018690+0000","last_undegraded":"2024-04-19T03:01:15.018690+0000","last_fullsized":"2024-04-19T03:01:15.018690+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:59:49.270245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"20'6","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.029460+0000","last_change":"2024-04-19T03:01:14.649577+0000","last_active":"2024-04-19T03:01:15.029460+0000","last_peered":"2024-04-19T03:01:15.029460+0000","last_clean":"2024-04-19T03:01:15.029460+0000","last_became_active":"2024-04-19T03:01:14.649284+0000","last_became_peered":"2024-04-19T03:01:14.649284+0000","last_unstale":"2024-04-19T03:01:15.029460+0000","last_undegraded":"2024-04-19T03:01:15.029460+0000","last_fullsized":"2024-04-19T03:01:15.029460+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:01:22.214742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-19T03:01:18.091377+0000","last_change":"2024-04-19T03:01:15.013509+0000","last_active":"2024-04-19T03:01:18.091377+0000","last_peered":"2024-04-19T03:01:18.091377+0000","last_clean":"2024-04-19T03:01:18.091377+0000","last_became_active":"2024-04-19T03:01:15.012694+0000","last_became_peered":"2024-04-19T03:01:15.012694+0000","last_unstale":"2024-04-19T03:01:18.091377+0000","last_undegraded":"2024-04-19T03:01:18.091377+0000","last_fullsized":"2024-04-19T03:01:18.091377+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:13:47.056938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"20'3","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.019366+0000","last_change":"2024-04-19T03:01:14.648703+0000","last_active":"2024-04-19T03:01:15.019366+0000","last_peered":"2024-04-19T03:01:15.019366+0000","last_clean":"2024-04-19T03:01:15.019366+0000","last_became_active":"2024-04-19T03:01:14.648258+0000","last_became_peered":"2024-04-19T03:01:14.648258+0000","last_unstale":"2024-04-19T03:01:15.019366+0000","last_undegraded":"2024-04-19T03:01:15.019366+0000","last_fullsized":"2024-04-19T03:01:15.019366+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:30:35.593258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.001904+0000","last_change":"2024-04-19T03:01:14.651753+0000","last_active":"2024-04-19T03:01:15.001904+0000","last_peered":"2024-04-19T03:01:15.001904+0000","last_clean":"2024-04-19T03:01:15.001904+0000","last_became_active":"2024-04-19T03:01:14.651458+0000","last_became_peered":"2024-04-19T03:01:14.651458+0000","last_unstale":"2024-04-19T03:01:15.001904+0000","last_undegraded":"2024-04-19T03:01:15.001904+0000","last_fullsized":"2024-04-19T03:01:15.001904+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:58:28.669306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-19T03:01:18.091195+0000","last_change":"2024-04-19T03:01:15.016094+0000","last_active":"2024-04-19T03:01:18.091195+0000","last_peered":"2024-04-19T03:01:18.091195+0000","last_clean":"2024-04-19T03:01:18.091195+0000","last_became_active":"2024-04-19T03:01:15.015379+0000","last_became_peered":"2024-04-19T03:01:15.015379+0000","last_unstale":"2024-04-19T03:01:18.091195+0000","last_undegraded":"2024-04-19T03:01:18.091195+0000","last_fullsized":"2024-04-19T03:01:18.091195+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:42:11.854631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.006982+0000","last_change":"2024-04-19T03:01:14.647282+0000","last_active":"2024-04-19T03:01:15.006982+0000","last_peered":"2024-04-19T03:01:15.006982+0000","last_clean":"2024-04-19T03:01:15.006982+0000","last_became_active":"2024-04-19T03:01:14.646878+0000","last_became_peered":"2024-04-19T03:01:14.646878+0000","last_unstale":"2024-04-19T03:01:15.006982+0000","last_undegraded":"2024-04-19T03:01:15.006982+0000","last_fullsized":"2024-04-19T03:01:15.006982+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:22:38.096801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-19T03:01:18.090981+0000","last_change":"2024-04-19T03:01:15.013187+0000","last_active":"2024-04-19T03:01:18.090981+0000","last_peered":"2024-04-19T03:01:18.090981+0000","last_clean":"2024-04-19T03:01:18.090981+0000","last_became_active":"2024-04-19T03:01:15.011542+0000","last_became_peered":"2024-04-19T03:01:15.011542+0000","last_unstale":"2024-04-19T03:01:18.090981+0000","last_undegraded":"2024-04-19T03:01:18.090981+0000","last_fullsized":"2024-04-19T03:01:18.090981+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:53:13.646525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.023738+0000","last_change":"2024-04-19T03:01:15.020635+0000","last_active":"2024-04-19T03:01:15.023738+0000","last_peered":"2024-04-19T03:01:15.023738+0000","last_clean":"2024-04-19T03:01:15.023738+0000","last_became_active":"2024-04-19T03:01:15.019917+0000","last_became_peered":"2024-04-19T03:01:15.019917+0000","last_unstale":"2024-04-19T03:01:15.023738+0000","last_undegraded":"2024-04-19T03:01:15.023738+0000","last_fullsized":"2024-04-19T03:01:15.023738+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:40:53.477682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.005373+0000","last_change":"2024-04-19T03:01:14.643239+0000","last_active":"2024-04-19T03:01:15.005373+0000","last_peered":"2024-04-19T03:01:15.005373+0000","last_clean":"2024-04-19T03:01:15.005373+0000","last_became_active":"2024-04-19T03:01:14.642959+0000","last_became_peered":"2024-04-19T03:01:14.642959+0000","last_unstale":"2024-04-19T03:01:15.005373+0000","last_undegraded":"2024-04-19T03:01:15.005373+0000","last_fullsized":"2024-04-19T03:01:15.005373+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:05:36.752017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-19T03:01:18.092865+0000","last_change":"2024-04-19T03:01:15.017708+0000","last_active":"2024-04-19T03:01:18.092865+0000","last_peered":"2024-04-19T03:01:18.092865+0000","last_clean":"2024-04-19T03:01:18.092865+0000","last_became_active":"2024-04-19T03:01:15.016726+0000","last_became_peered":"2024-04-19T03:01:15.016726+0000","last_unstale":"2024-04-19T03:01:18.092865+0000","last_undegraded":"2024-04-19T03:01:18.092865+0000","last_fullsized":"2024-04-19T03:01:18.092865+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:07:47.395052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.003022+0000","last_change":"2024-04-19T03:01:14.647744+0000","last_active":"2024-04-19T03:01:15.003022+0000","last_peered":"2024-04-19T03:01:15.003022+0000","last_clean":"2024-04-19T03:01:15.003022+0000","last_became_active":"2024-04-19T03:01:14.647463+0000","last_became_peered":"2024-04-19T03:01:14.647463+0000","last_unstale":"2024-04-19T03:01:15.003022+0000","last_undegraded":"2024-04-19T03:01:15.003022+0000","last_fullsized":"2024-04-19T03:01:15.003022+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:56:15.348940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.023345+0000","last_change":"2024-04-19T03:01:15.019045+0000","last_active":"2024-04-19T03:01:15.023345+0000","last_peered":"2024-04-19T03:01:15.023345+0000","last_clean":"2024-04-19T03:01:15.023345+0000","last_became_active":"2024-04-19T03:01:15.017982+0000","last_became_peered":"2024-04-19T03:01:15.017982+0000","last_unstale":"2024-04-19T03:01:15.023345+0000","last_undegraded":"2024-04-19T03:01:15.023345+0000","last_fullsized":"2024-04-19T03:01:15.023345+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:10:56.732208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"20'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.020345+0000","last_change":"2024-04-19T03:01:14.651050+0000","last_active":"2024-04-19T03:01:15.020345+0000","last_peered":"2024-04-19T03:01:15.020345+0000","last_clean":"2024-04-19T03:01:15.020345+0000","last_became_active":"2024-04-19T03:01:14.650639+0000","last_became_peered":"2024-04-19T03:01:14.650639+0000","last_unstale":"2024-04-19T03:01:15.020345+0000","last_undegraded":"2024-04-19T03:01:15.020345+0000","last_fullsized":"2024-04-19T03:01:15.020345+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:41:49.783896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.022916+0000","last_change":"2024-04-19T03:01:15.017319+0000","last_active":"2024-04-19T03:01:15.022916+0000","last_peered":"2024-04-19T03:01:15.022916+0000","last_clean":"2024-04-19T03:01:15.022916+0000","last_became_active":"2024-04-19T03:01:15.016815+0000","last_became_peered":"2024-04-19T03:01:15.016815+0000","last_unstale":"2024-04-19T03:01:15.022916+0000","last_undegraded":"2024-04-19T03:01:15.022916+0000","last_fullsized":"2024-04-19T03:01:15.022916+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:36:36.363535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"20'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.018447+0000","last_change":"2024-04-19T03:01:14.648823+0000","last_active":"2024-04-19T03:01:15.018447+0000","last_peered":"2024-04-19T03:01:15.018447+0000","last_clean":"2024-04-19T03:01:15.018447+0000","last_became_active":"2024-04-19T03:01:14.648337+0000","last_became_peered":"2024-04-19T03:01:14.648337+0000","last_unstale":"2024-04-19T03:01:15.018447+0000","last_undegraded":"2024-04-19T03:01:15.018447+0000","last_fullsized":"2024-04-19T03:01:15.018447+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:08:46.250118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.018663+0000","last_change":"2024-04-19T03:01:15.014773+0000","last_active":"2024-04-19T03:01:15.018663+0000","last_peered":"2024-04-19T03:01:15.018663+0000","last_clean":"2024-04-19T03:01:15.018663+0000","last_became_active":"2024-04-19T03:01:15.013919+0000","last_became_peered":"2024-04-19T03:01:15.013919+0000","last_unstale":"2024-04-19T03:01:15.018663+0000","last_undegraded":"2024-04-19T03:01:15.018663+0000","last_fullsized":"2024-04-19T03:01:15.018663+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:56:44.307812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"20'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.018107+0000","last_change":"2024-04-19T03:01:14.651049+0000","last_active":"2024-04-19T03:01:15.018107+0000","last_peered":"2024-04-19T03:01:15.018107+0000","last_clean":"2024-04-19T03:01:15.018107+0000","last_became_active":"2024-04-19T03:01:14.650646+0000","last_became_peered":"2024-04-19T03:01:14.650646+0000","last_unstale":"2024-04-19T03:01:15.018107+0000","last_undegraded":"2024-04-19T03:01:15.018107+0000","last_fullsized":"2024-04-19T03:01:15.018107+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:33:59.716591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.022142+0000","last_change":"2024-04-19T03:01:15.017860+0000","last_active":"2024-04-19T03:01:15.022142+0000","last_peered":"2024-04-19T03:01:15.022142+0000","last_clean":"2024-04-19T03:01:15.022142+0000","last_became_active":"2024-04-19T03:01:15.017355+0000","last_became_peered":"2024-04-19T03:01:15.017355+0000","last_unstale":"2024-04-19T03:01:15.022142+0000","last_undegraded":"2024-04-19T03:01:15.022142+0000","last_fullsized":"2024-04-19T03:01:15.022142+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:13:06.902769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"20'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.022312+0000","last_change":"2024-04-19T03:01:14.649277+0000","last_active":"2024-04-19T03:01:15.022312+0000","last_peered":"2024-04-19T03:01:15.022312+0000","last_clean":"2024-04-19T03:01:15.022312+0000","last_became_active":"2024-04-19T03:01:14.648614+0000","last_became_peered":"2024-04-19T03:01:14.648614+0000","last_unstale":"2024-04-19T03:01:15.022312+0000","last_undegraded":"2024-04-19T03:01:15.022312+0000","last_fullsized":"2024-04-19T03:01:15.022312+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:34:05.922324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.023028+0000","last_change":"2024-04-19T03:01:15.017986+0000","last_active":"2024-04-19T03:01:15.023028+0000","last_peered":"2024-04-19T03:01:15.023028+0000","last_clean":"2024-04-19T03:01:15.023028+0000","last_became_active":"2024-04-19T03:01:15.017080+0000","last_became_peered":"2024-04-19T03:01:15.017080+0000","last_unstale":"2024-04-19T03:01:15.023028+0000","last_undegraded":"2024-04-19T03:01:15.023028+0000","last_fullsized":"2024-04-19T03:01:15.023028+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:14:57.922917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"20'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.019052+0000","last_change":"2024-04-19T03:01:14.644015+0000","last_active":"2024-04-19T03:01:15.019052+0000","last_peered":"2024-04-19T03:01:15.019052+0000","last_clean":"2024-04-19T03:01:15.019052+0000","last_became_active":"2024-04-19T03:01:14.643769+0000","last_became_peered":"2024-04-19T03:01:14.643769+0000","last_unstale":"2024-04-19T03:01:15.019052+0000","last_undegraded":"2024-04-19T03:01:15.019052+0000","last_fullsized":"2024-04-19T03:01:15.019052+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:56:05.481089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.024302+0000","last_change":"2024-04-19T03:01:15.019466+0000","last_active":"2024-04-19T03:01:15.024302+0000","last_peered":"2024-04-19T03:01:15.024302+0000","last_clean":"2024-04-19T03:01:15.024302+0000","last_became_active":"2024-04-19T03:01:15.018819+0000","last_became_peered":"2024-04-19T03:01:15.018819+0000","last_unstale":"2024-04-19T03:01:15.024302+0000","last_undegraded":"2024-04-19T03:01:15.024302+0000","last_fullsized":"2024-04-19T03:01:15.024302+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:13:26.030579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"20'4","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.020064+0000","last_change":"2024-04-19T03:01:14.647358+0000","last_active":"2024-04-19T03:01:15.020064+0000","last_peered":"2024-04-19T03:01:15.020064+0000","last_clean":"2024-04-19T03:01:15.020064+0000","last_became_active":"2024-04-19T03:01:14.646998+0000","last_became_peered":"2024-04-19T03:01:14.646998+0000","last_unstale":"2024-04-19T03:01:15.020064+0000","last_undegraded":"2024-04-19T03:01:15.020064+0000","last_fullsized":"2024-04-19T03:01:15.020064+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:09:04.022991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":14482,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":10,"seq":42949672969,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31380,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340460,"statfs":{"total":96636764160,"available":96604631040,"internally_reserved":0,"allocated":270336,"data_stored":654544,"data_compressed":7241,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56299999999999994}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64400000000000002}]}]},{"osd":1,"up_from":10,"seq":42949672968,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31372,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340468,"statfs":{"total":96636764160,"available":96604639232,"internally_reserved":0,"allocated":262144,"data_stored":653928,"data_compressed":7241,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60399999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72599999999999998}]}]},{"osd":0,"up_from":9,"seq":38654705671,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31300,"kb_used_data":184,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340540,"statfs":{"total":96636764160,"available":96604712960,"internally_reserved":0,"allocated":188416,"data_stored":62430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.623}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73199999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":7241,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":7241,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-19T03:01:25.969 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-19T03:01:26.275 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-19T03:01:26.279 INFO:teuthology.orchestra.run.smithi096.stderr:dumped all 2024-04-19T03:01:26.291 INFO:teuthology.orchestra.run.smithi096.stdout:{"pg_ready":true,"pg_map":{"version":28,"stamp":"2024-04-19T03:01:25.946496+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":94052,"kb_used_data":704,"kb_used_omap":4,"kb_used_meta":93307,"kb_avail":283021468,"statfs":{"total":289910292480,"available":289813983232,"internally_reserved":0,"allocated":720896,"data_stored":1370902,"data_compressed":14482,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":4782,"internal_metadata":95546706},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.003030"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.023489+0000","last_change":"2024-04-19T03:01:15.019292+0000","last_active":"2024-04-19T03:01:15.023489+0000","last_peered":"2024-04-19T03:01:15.023489+0000","last_clean":"2024-04-19T03:01:15.023489+0000","last_became_active":"2024-04-19T03:01:15.017907+0000","last_became_peered":"2024-04-19T03:01:15.017907+0000","last_unstale":"2024-04-19T03:01:15.023489+0000","last_undegraded":"2024-04-19T03:01:15.023489+0000","last_fullsized":"2024-04-19T03:01:15.023489+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:13:26.030579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.023194+0000","last_change":"2024-04-19T03:01:15.018719+0000","last_active":"2024-04-19T03:01:15.023194+0000","last_peered":"2024-04-19T03:01:15.023194+0000","last_clean":"2024-04-19T03:01:15.023194+0000","last_became_active":"2024-04-19T03:01:15.018070+0000","last_became_peered":"2024-04-19T03:01:15.018070+0000","last_unstale":"2024-04-19T03:01:15.023194+0000","last_undegraded":"2024-04-19T03:01:15.023194+0000","last_fullsized":"2024-04-19T03:01:15.023194+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:48:13.389356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.018237+0000","last_change":"2024-04-19T03:01:15.015884+0000","last_active":"2024-04-19T03:01:15.018237+0000","last_peered":"2024-04-19T03:01:15.018237+0000","last_clean":"2024-04-19T03:01:15.018237+0000","last_became_active":"2024-04-19T03:01:15.014599+0000","last_became_peered":"2024-04-19T03:01:15.014599+0000","last_unstale":"2024-04-19T03:01:15.018237+0000","last_undegraded":"2024-04-19T03:01:15.018237+0000","last_fullsized":"2024-04-19T03:01:15.018237+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:35:19.436344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.018134+0000","last_change":"2024-04-19T03:01:15.015186+0000","last_active":"2024-04-19T03:01:15.018134+0000","last_peered":"2024-04-19T03:01:15.018134+0000","last_clean":"2024-04-19T03:01:15.018134+0000","last_became_active":"2024-04-19T03:01:15.014218+0000","last_became_peered":"2024-04-19T03:01:15.014218+0000","last_unstale":"2024-04-19T03:01:15.018134+0000","last_undegraded":"2024-04-19T03:01:15.018134+0000","last_fullsized":"2024-04-19T03:01:15.018134+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:30:22.360053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.023421+0000","last_change":"2024-04-19T03:01:15.019382+0000","last_active":"2024-04-19T03:01:15.023421+0000","last_peered":"2024-04-19T03:01:15.023421+0000","last_clean":"2024-04-19T03:01:15.023421+0000","last_became_active":"2024-04-19T03:01:15.017859+0000","last_became_peered":"2024-04-19T03:01:15.017859+0000","last_unstale":"2024-04-19T03:01:15.023421+0000","last_undegraded":"2024-04-19T03:01:15.023421+0000","last_fullsized":"2024-04-19T03:01:15.023421+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:31:51.982582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.019273+0000","last_change":"2024-04-19T03:01:15.016989+0000","last_active":"2024-04-19T03:01:15.019273+0000","last_peered":"2024-04-19T03:01:15.019273+0000","last_clean":"2024-04-19T03:01:15.019273+0000","last_became_active":"2024-04-19T03:01:15.016569+0000","last_became_peered":"2024-04-19T03:01:15.016569+0000","last_unstale":"2024-04-19T03:01:15.019273+0000","last_undegraded":"2024-04-19T03:01:15.019273+0000","last_fullsized":"2024-04-19T03:01:15.019273+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:22:58.349159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.019190+0000","last_change":"2024-04-19T03:01:15.016925+0000","last_active":"2024-04-19T03:01:15.019190+0000","last_peered":"2024-04-19T03:01:15.019190+0000","last_clean":"2024-04-19T03:01:15.019190+0000","last_became_active":"2024-04-19T03:01:15.016589+0000","last_became_peered":"2024-04-19T03:01:15.016589+0000","last_unstale":"2024-04-19T03:01:15.019190+0000","last_undegraded":"2024-04-19T03:01:15.019190+0000","last_fullsized":"2024-04-19T03:01:15.019190+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:48:13.389356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.022180+0000","last_change":"2024-04-19T03:01:15.018969+0000","last_active":"2024-04-19T03:01:15.022180+0000","last_peered":"2024-04-19T03:01:15.022180+0000","last_clean":"2024-04-19T03:01:15.022180+0000","last_became_active":"2024-04-19T03:01:15.016895+0000","last_became_peered":"2024-04-19T03:01:15.016895+0000","last_unstale":"2024-04-19T03:01:15.022180+0000","last_undegraded":"2024-04-19T03:01:15.022180+0000","last_fullsized":"2024-04-19T03:01:15.022180+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:09:23.427311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-19T03:01:18.092387+0000","last_change":"2024-04-19T03:01:15.018526+0000","last_active":"2024-04-19T03:01:18.092387+0000","last_peered":"2024-04-19T03:01:18.092387+0000","last_clean":"2024-04-19T03:01:18.092387+0000","last_became_active":"2024-04-19T03:01:15.018268+0000","last_became_peered":"2024-04-19T03:01:15.018268+0000","last_unstale":"2024-04-19T03:01:18.092387+0000","last_undegraded":"2024-04-19T03:01:18.092387+0000","last_fullsized":"2024-04-19T03:01:18.092387+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:17:52.453165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.023176+0000","last_change":"2024-04-19T03:01:15.018499+0000","last_active":"2024-04-19T03:01:15.023176+0000","last_peered":"2024-04-19T03:01:15.023176+0000","last_clean":"2024-04-19T03:01:15.023176+0000","last_became_active":"2024-04-19T03:01:15.017894+0000","last_became_peered":"2024-04-19T03:01:15.017894+0000","last_unstale":"2024-04-19T03:01:15.023176+0000","last_undegraded":"2024-04-19T03:01:15.023176+0000","last_fullsized":"2024-04-19T03:01:15.023176+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:10:21.967941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.019491+0000","last_change":"2024-04-19T03:01:15.017525+0000","last_active":"2024-04-19T03:01:15.019491+0000","last_peered":"2024-04-19T03:01:15.019491+0000","last_clean":"2024-04-19T03:01:15.019491+0000","last_became_active":"2024-04-19T03:01:15.016887+0000","last_became_peered":"2024-04-19T03:01:15.016887+0000","last_unstale":"2024-04-19T03:01:15.019491+0000","last_undegraded":"2024-04-19T03:01:15.019491+0000","last_fullsized":"2024-04-19T03:01:15.019491+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:10:56.732208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.023561+0000","last_change":"2024-04-19T03:01:15.020240+0000","last_active":"2024-04-19T03:01:15.023561+0000","last_peered":"2024-04-19T03:01:15.023561+0000","last_clean":"2024-04-19T03:01:15.023561+0000","last_became_active":"2024-04-19T03:01:15.019820+0000","last_became_peered":"2024-04-19T03:01:15.019820+0000","last_unstale":"2024-04-19T03:01:15.023561+0000","last_undegraded":"2024-04-19T03:01:15.023561+0000","last_fullsized":"2024-04-19T03:01:15.023561+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:09:23.427311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.023234+0000","last_change":"2024-04-19T03:01:15.018712+0000","last_active":"2024-04-19T03:01:15.023234+0000","last_peered":"2024-04-19T03:01:15.023234+0000","last_clean":"2024-04-19T03:01:15.023234+0000","last_became_active":"2024-04-19T03:01:15.017970+0000","last_became_peered":"2024-04-19T03:01:15.017970+0000","last_unstale":"2024-04-19T03:01:15.023234+0000","last_undegraded":"2024-04-19T03:01:15.023234+0000","last_fullsized":"2024-04-19T03:01:15.023234+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:07:57.843767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.013382+0000","last_change":"2024-04-19T03:01:15.010960+0000","last_active":"2024-04-19T03:01:15.013382+0000","last_peered":"2024-04-19T03:01:15.013382+0000","last_clean":"2024-04-19T03:01:15.013382+0000","last_became_active":"2024-04-19T03:01:15.010472+0000","last_became_peered":"2024-04-19T03:01:15.010472+0000","last_unstale":"2024-04-19T03:01:15.013382+0000","last_undegraded":"2024-04-19T03:01:15.013382+0000","last_fullsized":"2024-04-19T03:01:15.013382+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:21:36.129346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.017090+0000","last_change":"2024-04-19T03:01:15.014574+0000","last_active":"2024-04-19T03:01:15.017090+0000","last_peered":"2024-04-19T03:01:15.017090+0000","last_clean":"2024-04-19T03:01:15.017090+0000","last_became_active":"2024-04-19T03:01:15.014096+0000","last_became_peered":"2024-04-19T03:01:15.014096+0000","last_unstale":"2024-04-19T03:01:15.017090+0000","last_undegraded":"2024-04-19T03:01:15.017090+0000","last_fullsized":"2024-04-19T03:01:15.017090+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:01:54.253963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.022131+0000","last_change":"2024-04-19T03:01:15.018778+0000","last_active":"2024-04-19T03:01:15.022131+0000","last_peered":"2024-04-19T03:01:15.022131+0000","last_clean":"2024-04-19T03:01:15.022131+0000","last_became_active":"2024-04-19T03:01:15.016809+0000","last_became_peered":"2024-04-19T03:01:15.016809+0000","last_unstale":"2024-04-19T03:01:15.022131+0000","last_undegraded":"2024-04-19T03:01:15.022131+0000","last_fullsized":"2024-04-19T03:01:15.022131+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:40:59.453079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-19T03:01:18.093156+0000","last_change":"2024-04-19T03:01:15.011516+0000","last_active":"2024-04-19T03:01:18.093156+0000","last_peered":"2024-04-19T03:01:18.093156+0000","last_clean":"2024-04-19T03:01:18.093156+0000","last_became_active":"2024-04-19T03:01:15.011056+0000","last_became_peered":"2024-04-19T03:01:15.011056+0000","last_unstale":"2024-04-19T03:01:18.093156+0000","last_undegraded":"2024-04-19T03:01:18.093156+0000","last_fullsized":"2024-04-19T03:01:18.093156+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:35:50.354787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.022947+0000","last_change":"2024-04-19T03:01:15.017257+0000","last_active":"2024-04-19T03:01:15.022947+0000","last_peered":"2024-04-19T03:01:15.022947+0000","last_clean":"2024-04-19T03:01:15.022947+0000","last_became_active":"2024-04-19T03:01:15.016062+0000","last_became_peered":"2024-04-19T03:01:15.016062+0000","last_unstale":"2024-04-19T03:01:15.022947+0000","last_undegraded":"2024-04-19T03:01:15.022947+0000","last_fullsized":"2024-04-19T03:01:15.022947+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:40:20.790332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-19T03:01:18.092291+0000","last_change":"2024-04-19T03:01:15.011065+0000","last_active":"2024-04-19T03:01:18.092291+0000","last_peered":"2024-04-19T03:01:18.092291+0000","last_clean":"2024-04-19T03:01:18.092291+0000","last_became_active":"2024-04-19T03:01:15.010330+0000","last_became_peered":"2024-04-19T03:01:15.010330+0000","last_unstale":"2024-04-19T03:01:18.092291+0000","last_undegraded":"2024-04-19T03:01:18.092291+0000","last_fullsized":"2024-04-19T03:01:18.092291+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:56:10.495533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.021464+0000","last_change":"2024-04-19T03:01:15.017812+0000","last_active":"2024-04-19T03:01:15.021464+0000","last_peered":"2024-04-19T03:01:15.021464+0000","last_clean":"2024-04-19T03:01:15.021464+0000","last_became_active":"2024-04-19T03:01:15.016891+0000","last_became_peered":"2024-04-19T03:01:15.016891+0000","last_unstale":"2024-04-19T03:01:15.021464+0000","last_undegraded":"2024-04-19T03:01:15.021464+0000","last_fullsized":"2024-04-19T03:01:15.021464+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:39:54.289444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.024134+0000","last_change":"2024-04-19T03:01:15.019143+0000","last_active":"2024-04-19T03:01:15.024134+0000","last_peered":"2024-04-19T03:01:15.024134+0000","last_clean":"2024-04-19T03:01:15.024134+0000","last_became_active":"2024-04-19T03:01:15.017757+0000","last_became_peered":"2024-04-19T03:01:15.017757+0000","last_unstale":"2024-04-19T03:01:15.024134+0000","last_undegraded":"2024-04-19T03:01:15.024134+0000","last_fullsized":"2024-04-19T03:01:15.024134+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:10:21.967941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.023544+0000","last_change":"2024-04-19T03:01:15.020108+0000","last_active":"2024-04-19T03:01:15.023544+0000","last_peered":"2024-04-19T03:01:15.023544+0000","last_clean":"2024-04-19T03:01:15.023544+0000","last_became_active":"2024-04-19T03:01:15.018978+0000","last_became_peered":"2024-04-19T03:01:15.018978+0000","last_unstale":"2024-04-19T03:01:15.023544+0000","last_undegraded":"2024-04-19T03:01:15.023544+0000","last_fullsized":"2024-04-19T03:01:15.023544+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:30:22.360053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-19T03:01:18.090964+0000","last_change":"2024-04-19T03:01:15.016877+0000","last_active":"2024-04-19T03:01:18.090964+0000","last_peered":"2024-04-19T03:01:18.090964+0000","last_clean":"2024-04-19T03:01:18.090964+0000","last_became_active":"2024-04-19T03:01:15.016245+0000","last_became_peered":"2024-04-19T03:01:15.016245+0000","last_unstale":"2024-04-19T03:01:18.090964+0000","last_undegraded":"2024-04-19T03:01:18.090964+0000","last_fullsized":"2024-04-19T03:01:18.090964+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:38:07.846380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.023272+0000","last_change":"2024-04-19T03:01:15.018809+0000","last_active":"2024-04-19T03:01:15.023272+0000","last_peered":"2024-04-19T03:01:15.023272+0000","last_clean":"2024-04-19T03:01:15.023272+0000","last_became_active":"2024-04-19T03:01:15.017549+0000","last_became_peered":"2024-04-19T03:01:15.017549+0000","last_unstale":"2024-04-19T03:01:15.023272+0000","last_undegraded":"2024-04-19T03:01:15.023272+0000","last_fullsized":"2024-04-19T03:01:15.023272+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:37:35.950318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.023709+0000","last_change":"2024-04-19T03:01:15.020443+0000","last_active":"2024-04-19T03:01:15.023709+0000","last_peered":"2024-04-19T03:01:15.023709+0000","last_clean":"2024-04-19T03:01:15.023709+0000","last_became_active":"2024-04-19T03:01:15.018780+0000","last_became_peered":"2024-04-19T03:01:15.018780+0000","last_unstale":"2024-04-19T03:01:15.023709+0000","last_undegraded":"2024-04-19T03:01:15.023709+0000","last_fullsized":"2024-04-19T03:01:15.023709+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:56:44.307812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-19T03:01:18.093128+0000","last_change":"2024-04-19T03:01:15.017487+0000","last_active":"2024-04-19T03:01:18.093128+0000","last_peered":"2024-04-19T03:01:18.093128+0000","last_clean":"2024-04-19T03:01:18.093128+0000","last_became_active":"2024-04-19T03:01:15.016183+0000","last_became_peered":"2024-04-19T03:01:15.016183+0000","last_unstale":"2024-04-19T03:01:18.093128+0000","last_undegraded":"2024-04-19T03:01:18.093128+0000","last_fullsized":"2024-04-19T03:01:18.093128+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:44:37.487013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.018261+0000","last_change":"2024-04-19T03:01:15.016117+0000","last_active":"2024-04-19T03:01:15.018261+0000","last_peered":"2024-04-19T03:01:15.018261+0000","last_clean":"2024-04-19T03:01:15.018261+0000","last_became_active":"2024-04-19T03:01:15.015415+0000","last_became_peered":"2024-04-19T03:01:15.015415+0000","last_unstale":"2024-04-19T03:01:15.018261+0000","last_undegraded":"2024-04-19T03:01:15.018261+0000","last_fullsized":"2024-04-19T03:01:15.018261+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:06:35.813797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.023502+0000","last_change":"2024-04-19T03:01:15.020098+0000","last_active":"2024-04-19T03:01:15.023502+0000","last_peered":"2024-04-19T03:01:15.023502+0000","last_clean":"2024-04-19T03:01:15.023502+0000","last_became_active":"2024-04-19T03:01:15.019064+0000","last_became_peered":"2024-04-19T03:01:15.019064+0000","last_unstale":"2024-04-19T03:01:15.023502+0000","last_undegraded":"2024-04-19T03:01:15.023502+0000","last_fullsized":"2024-04-19T03:01:15.023502+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:50:06.490191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-19T03:01:18.092158+0000","last_change":"2024-04-19T03:01:15.013746+0000","last_active":"2024-04-19T03:01:18.092158+0000","last_peered":"2024-04-19T03:01:18.092158+0000","last_clean":"2024-04-19T03:01:18.092158+0000","last_became_active":"2024-04-19T03:01:15.011865+0000","last_became_peered":"2024-04-19T03:01:15.011865+0000","last_unstale":"2024-04-19T03:01:18.092158+0000","last_undegraded":"2024-04-19T03:01:18.092158+0000","last_fullsized":"2024-04-19T03:01:18.092158+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:32:23.606804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.023434+0000","last_change":"2024-04-19T03:01:15.019787+0000","last_active":"2024-04-19T03:01:15.023434+0000","last_peered":"2024-04-19T03:01:15.023434+0000","last_clean":"2024-04-19T03:01:15.023434+0000","last_became_active":"2024-04-19T03:01:15.018350+0000","last_became_peered":"2024-04-19T03:01:15.018350+0000","last_unstale":"2024-04-19T03:01:15.023434+0000","last_undegraded":"2024-04-19T03:01:15.023434+0000","last_fullsized":"2024-04-19T03:01:15.023434+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:10:42.079294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-19T03:01:18.090924+0000","last_change":"2024-04-19T03:01:15.012900+0000","last_active":"2024-04-19T03:01:18.090924+0000","last_peered":"2024-04-19T03:01:18.090924+0000","last_clean":"2024-04-19T03:01:18.090924+0000","last_became_active":"2024-04-19T03:01:15.012416+0000","last_became_peered":"2024-04-19T03:01:15.012416+0000","last_unstale":"2024-04-19T03:01:18.090924+0000","last_undegraded":"2024-04-19T03:01:18.090924+0000","last_fullsized":"2024-04-19T03:01:18.090924+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:57:14.847455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.024190+0000","last_change":"2024-04-19T03:01:15.019278+0000","last_active":"2024-04-19T03:01:15.024190+0000","last_peered":"2024-04-19T03:01:15.024190+0000","last_clean":"2024-04-19T03:01:15.024190+0000","last_became_active":"2024-04-19T03:01:15.017779+0000","last_became_peered":"2024-04-19T03:01:15.017779+0000","last_unstale":"2024-04-19T03:01:15.024190+0000","last_undegraded":"2024-04-19T03:01:15.024190+0000","last_fullsized":"2024-04-19T03:01:15.024190+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:54:54.463918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.022801+0000","last_change":"2024-04-19T03:01:15.016669+0000","last_active":"2024-04-19T03:01:15.022801+0000","last_peered":"2024-04-19T03:01:15.022801+0000","last_clean":"2024-04-19T03:01:15.022801+0000","last_became_active":"2024-04-19T03:01:15.016286+0000","last_became_peered":"2024-04-19T03:01:15.016286+0000","last_unstale":"2024-04-19T03:01:15.022801+0000","last_undegraded":"2024-04-19T03:01:15.022801+0000","last_fullsized":"2024-04-19T03:01:15.022801+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:55:34.102680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"20'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.019438+0000","last_change":"2024-04-19T03:01:14.651050+0000","last_active":"2024-04-19T03:01:15.019438+0000","last_peered":"2024-04-19T03:01:15.019438+0000","last_clean":"2024-04-19T03:01:15.019438+0000","last_became_active":"2024-04-19T03:01:14.650679+0000","last_became_peered":"2024-04-19T03:01:14.650679+0000","last_unstale":"2024-04-19T03:01:15.019438+0000","last_undegraded":"2024-04-19T03:01:15.019438+0000","last_fullsized":"2024-04-19T03:01:15.019438+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:37:03.684394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.022892+0000","last_change":"2024-04-19T03:01:15.017124+0000","last_active":"2024-04-19T03:01:15.022892+0000","last_peered":"2024-04-19T03:01:15.022892+0000","last_clean":"2024-04-19T03:01:15.022892+0000","last_became_active":"2024-04-19T03:01:15.016535+0000","last_became_peered":"2024-04-19T03:01:15.016535+0000","last_unstale":"2024-04-19T03:01:15.022892+0000","last_undegraded":"2024-04-19T03:01:15.022892+0000","last_fullsized":"2024-04-19T03:01:15.022892+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:40:12.179703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.002737+0000","last_change":"2024-04-19T03:01:14.646594+0000","last_active":"2024-04-19T03:01:15.002737+0000","last_peered":"2024-04-19T03:01:15.002737+0000","last_clean":"2024-04-19T03:01:15.002737+0000","last_became_active":"2024-04-19T03:01:14.646122+0000","last_became_peered":"2024-04-19T03:01:14.646122+0000","last_unstale":"2024-04-19T03:01:15.002737+0000","last_undegraded":"2024-04-19T03:01:15.002737+0000","last_fullsized":"2024-04-19T03:01:15.002737+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:40:53.463388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-19T03:01:18.093362+0000","last_change":"2024-04-19T03:01:15.017420+0000","last_active":"2024-04-19T03:01:18.093362+0000","last_peered":"2024-04-19T03:01:18.093362+0000","last_clean":"2024-04-19T03:01:18.093362+0000","last_became_active":"2024-04-19T03:01:15.015840+0000","last_became_peered":"2024-04-19T03:01:15.015840+0000","last_unstale":"2024-04-19T03:01:18.093362+0000","last_undegraded":"2024-04-19T03:01:18.093362+0000","last_fullsized":"2024-04-19T03:01:18.093362+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:05:05.266293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.004873+0000","last_change":"2024-04-19T03:01:14.649074+0000","last_active":"2024-04-19T03:01:15.004873+0000","last_peered":"2024-04-19T03:01:15.004873+0000","last_clean":"2024-04-19T03:01:15.004873+0000","last_became_active":"2024-04-19T03:01:14.648217+0000","last_became_peered":"2024-04-19T03:01:14.648217+0000","last_unstale":"2024-04-19T03:01:15.004873+0000","last_undegraded":"2024-04-19T03:01:15.004873+0000","last_fullsized":"2024-04-19T03:01:15.004873+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:57:05.238043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-19T03:01:18.092638+0000","last_change":"2024-04-19T03:01:15.017136+0000","last_active":"2024-04-19T03:01:18.092638+0000","last_peered":"2024-04-19T03:01:18.092638+0000","last_clean":"2024-04-19T03:01:18.092638+0000","last_became_active":"2024-04-19T03:01:15.016550+0000","last_became_peered":"2024-04-19T03:01:15.016550+0000","last_unstale":"2024-04-19T03:01:18.092638+0000","last_undegraded":"2024-04-19T03:01:18.092638+0000","last_fullsized":"2024-04-19T03:01:18.092638+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:55:37.697481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"20'8","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.023332+0000","last_change":"2024-04-19T03:01:14.649044+0000","last_active":"2024-04-19T03:01:15.023332+0000","last_peered":"2024-04-19T03:01:15.023332+0000","last_clean":"2024-04-19T03:01:15.023332+0000","last_became_active":"2024-04-19T03:01:14.648859+0000","last_became_peered":"2024-04-19T03:01:14.648859+0000","last_unstale":"2024-04-19T03:01:15.023332+0000","last_undegraded":"2024-04-19T03:01:15.023332+0000","last_fullsized":"2024-04-19T03:01:15.023332+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:30:45.925657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"20'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.015096+0000","last_change":"2024-04-19T03:01:14.649839+0000","last_active":"2024-04-19T03:01:15.015096+0000","last_peered":"2024-04-19T03:01:15.015096+0000","last_clean":"2024-04-19T03:01:15.015096+0000","last_became_active":"2024-04-19T03:01:14.649571+0000","last_became_peered":"2024-04-19T03:01:14.649571+0000","last_unstale":"2024-04-19T03:01:15.015096+0000","last_undegraded":"2024-04-19T03:01:15.015096+0000","last_fullsized":"2024-04-19T03:01:15.015096+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:03:57.839660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.023786+0000","last_change":"2024-04-19T03:01:15.021047+0000","last_active":"2024-04-19T03:01:15.023786+0000","last_peered":"2024-04-19T03:01:15.023786+0000","last_clean":"2024-04-19T03:01:15.023786+0000","last_became_active":"2024-04-19T03:01:15.019792+0000","last_became_peered":"2024-04-19T03:01:15.019792+0000","last_unstale":"2024-04-19T03:01:15.023786+0000","last_undegraded":"2024-04-19T03:01:15.023786+0000","last_fullsized":"2024-04-19T03:01:15.023786+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:54:54.463918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"20'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.019933+0000","last_change":"2024-04-19T03:01:14.645075+0000","last_active":"2024-04-19T03:01:15.019933+0000","last_peered":"2024-04-19T03:01:15.019933+0000","last_clean":"2024-04-19T03:01:15.019933+0000","last_became_active":"2024-04-19T03:01:14.644790+0000","last_became_peered":"2024-04-19T03:01:14.644790+0000","last_unstale":"2024-04-19T03:01:15.019933+0000","last_undegraded":"2024-04-19T03:01:15.019933+0000","last_fullsized":"2024-04-19T03:01:15.019933+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:55:15.035769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.021374+0000","last_change":"2024-04-19T03:01:15.016330+0000","last_active":"2024-04-19T03:01:15.021374+0000","last_peered":"2024-04-19T03:01:15.021374+0000","last_clean":"2024-04-19T03:01:15.021374+0000","last_became_active":"2024-04-19T03:01:15.015644+0000","last_became_peered":"2024-04-19T03:01:15.015644+0000","last_unstale":"2024-04-19T03:01:15.021374+0000","last_undegraded":"2024-04-19T03:01:15.021374+0000","last_fullsized":"2024-04-19T03:01:15.021374+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:13:06.902769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"20'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.015911+0000","last_change":"2024-04-19T03:01:14.649826+0000","last_active":"2024-04-19T03:01:15.015911+0000","last_peered":"2024-04-19T03:01:15.015911+0000","last_clean":"2024-04-19T03:01:15.015911+0000","last_became_active":"2024-04-19T03:01:14.649565+0000","last_became_peered":"2024-04-19T03:01:14.649565+0000","last_unstale":"2024-04-19T03:01:15.015911+0000","last_undegraded":"2024-04-19T03:01:15.015911+0000","last_fullsized":"2024-04-19T03:01:15.015911+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:36:00.962931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.021994+0000","last_change":"2024-04-19T03:01:15.018099+0000","last_active":"2024-04-19T03:01:15.021994+0000","last_peered":"2024-04-19T03:01:15.021994+0000","last_clean":"2024-04-19T03:01:15.021994+0000","last_became_active":"2024-04-19T03:01:15.017536+0000","last_became_peered":"2024-04-19T03:01:15.017536+0000","last_unstale":"2024-04-19T03:01:15.021994+0000","last_undegraded":"2024-04-19T03:01:15.021994+0000","last_fullsized":"2024-04-19T03:01:15.021994+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:50:06.490191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.006366+0000","last_change":"2024-04-19T03:01:14.651201+0000","last_active":"2024-04-19T03:01:15.006366+0000","last_peered":"2024-04-19T03:01:15.006366+0000","last_clean":"2024-04-19T03:01:15.006366+0000","last_became_active":"2024-04-19T03:01:14.650942+0000","last_became_peered":"2024-04-19T03:01:14.650942+0000","last_unstale":"2024-04-19T03:01:15.006366+0000","last_undegraded":"2024-04-19T03:01:15.006366+0000","last_fullsized":"2024-04-19T03:01:15.006366+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:02:13.190917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-19T03:01:18.092211+0000","last_change":"2024-04-19T03:01:15.017458+0000","last_active":"2024-04-19T03:01:18.092211+0000","last_peered":"2024-04-19T03:01:18.092211+0000","last_clean":"2024-04-19T03:01:18.092211+0000","last_became_active":"2024-04-19T03:01:15.016653+0000","last_became_peered":"2024-04-19T03:01:15.016653+0000","last_unstale":"2024-04-19T03:01:18.092211+0000","last_undegraded":"2024-04-19T03:01:18.092211+0000","last_fullsized":"2024-04-19T03:01:18.092211+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:52:28.671365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"20'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.016958+0000","last_change":"2024-04-19T03:01:14.647553+0000","last_active":"2024-04-19T03:01:15.016958+0000","last_peered":"2024-04-19T03:01:15.016958+0000","last_clean":"2024-04-19T03:01:15.016958+0000","last_became_active":"2024-04-19T03:01:14.647147+0000","last_became_peered":"2024-04-19T03:01:14.647147+0000","last_unstale":"2024-04-19T03:01:15.016958+0000","last_undegraded":"2024-04-19T03:01:15.016958+0000","last_fullsized":"2024-04-19T03:01:15.016958+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:33:45.550646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.021494+0000","last_change":"2024-04-19T03:01:15.018012+0000","last_active":"2024-04-19T03:01:15.021494+0000","last_peered":"2024-04-19T03:01:15.021494+0000","last_clean":"2024-04-19T03:01:15.021494+0000","last_became_active":"2024-04-19T03:01:15.017086+0000","last_became_peered":"2024-04-19T03:01:15.017086+0000","last_unstale":"2024-04-19T03:01:15.021494+0000","last_undegraded":"2024-04-19T03:01:15.021494+0000","last_fullsized":"2024-04-19T03:01:15.021494+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:54:04.518505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.001920+0000","last_change":"2024-04-19T03:01:14.651004+0000","last_active":"2024-04-19T03:01:15.001920+0000","last_peered":"2024-04-19T03:01:15.001920+0000","last_clean":"2024-04-19T03:01:15.001920+0000","last_became_active":"2024-04-19T03:01:14.650635+0000","last_became_peered":"2024-04-19T03:01:14.650635+0000","last_unstale":"2024-04-19T03:01:15.001920+0000","last_undegraded":"2024-04-19T03:01:15.001920+0000","last_fullsized":"2024-04-19T03:01:15.001920+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:57:15.575819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.018174+0000","last_change":"2024-04-19T03:01:15.015685+0000","last_active":"2024-04-19T03:01:15.018174+0000","last_peered":"2024-04-19T03:01:15.018174+0000","last_clean":"2024-04-19T03:01:15.018174+0000","last_became_active":"2024-04-19T03:01:15.014847+0000","last_became_peered":"2024-04-19T03:01:15.014847+0000","last_unstale":"2024-04-19T03:01:15.018174+0000","last_undegraded":"2024-04-19T03:01:15.018174+0000","last_fullsized":"2024-04-19T03:01:15.018174+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:51:06.208551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.005141+0000","last_change":"2024-04-19T03:01:14.644582+0000","last_active":"2024-04-19T03:01:15.005141+0000","last_peered":"2024-04-19T03:01:15.005141+0000","last_clean":"2024-04-19T03:01:15.005141+0000","last_became_active":"2024-04-19T03:01:14.644101+0000","last_became_peered":"2024-04-19T03:01:14.644101+0000","last_unstale":"2024-04-19T03:01:15.005141+0000","last_undegraded":"2024-04-19T03:01:15.005141+0000","last_fullsized":"2024-04-19T03:01:15.005141+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:28:24.652864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.017755+0000","last_change":"2024-04-19T03:01:15.014818+0000","last_active":"2024-04-19T03:01:15.017755+0000","last_peered":"2024-04-19T03:01:15.017755+0000","last_clean":"2024-04-19T03:01:15.017755+0000","last_became_active":"2024-04-19T03:01:15.014421+0000","last_became_peered":"2024-04-19T03:01:15.014421+0000","last_unstale":"2024-04-19T03:01:15.017755+0000","last_undegraded":"2024-04-19T03:01:15.017755+0000","last_fullsized":"2024-04-19T03:01:15.017755+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:16:20.475837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.008183+0000","last_change":"2024-04-19T03:01:14.643840+0000","last_active":"2024-04-19T03:01:15.008183+0000","last_peered":"2024-04-19T03:01:15.008183+0000","last_clean":"2024-04-19T03:01:15.008183+0000","last_became_active":"2024-04-19T03:01:14.643503+0000","last_became_peered":"2024-04-19T03:01:14.643503+0000","last_unstale":"2024-04-19T03:01:15.008183+0000","last_undegraded":"2024-04-19T03:01:15.008183+0000","last_fullsized":"2024-04-19T03:01:15.008183+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:09:33.801275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-19T03:01:18.092763+0000","last_change":"2024-04-19T03:01:15.012607+0000","last_active":"2024-04-19T03:01:18.092763+0000","last_peered":"2024-04-19T03:01:18.092763+0000","last_clean":"2024-04-19T03:01:18.092763+0000","last_became_active":"2024-04-19T03:01:15.012152+0000","last_became_peered":"2024-04-19T03:01:15.012152+0000","last_unstale":"2024-04-19T03:01:18.092763+0000","last_undegraded":"2024-04-19T03:01:18.092763+0000","last_fullsized":"2024-04-19T03:01:18.092763+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:57:36.794409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"14'157","reported_seq":212,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.004135+0000","last_change":"2024-04-19T03:01:07.538434+0000","last_active":"2024-04-19T03:01:15.004135+0000","last_peered":"2024-04-19T03:01:15.004135+0000","last_clean":"2024-04-19T03:01:15.004135+0000","last_became_active":"2024-04-19T03:01:07.537856+0000","last_became_peered":"2024-04-19T03:01:07.537856+0000","last_unstale":"2024-04-19T03:01:15.004135+0000","last_undegraded":"2024-04-19T03:01:15.004135+0000","last_fullsized":"2024-04-19T03:01:15.004135+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:06.516863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:06.516863+0000","last_clean_scrub_stamp":"2024-04-19T03:01:06.516863+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:36:46.386286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.006445+0000","last_change":"2024-04-19T03:01:10.602869+0000","last_active":"2024-04-19T03:01:15.006445+0000","last_peered":"2024-04-19T03:01:15.006445+0000","last_clean":"2024-04-19T03:01:15.006445+0000","last_became_active":"2024-04-19T03:01:10.601965+0000","last_became_peered":"2024-04-19T03:01:10.601965+0000","last_unstale":"2024-04-19T03:01:15.006445+0000","last_undegraded":"2024-04-19T03:01:15.006445+0000","last_fullsized":"2024-04-19T03:01:15.006445+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_clean_scrub_stamp":"2024-04-19T03:01:09.578660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:14:41.316871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.001643+0000","last_change":"2024-04-19T03:01:14.643201+0000","last_active":"2024-04-19T03:01:15.001643+0000","last_peered":"2024-04-19T03:01:15.001643+0000","last_clean":"2024-04-19T03:01:15.001643+0000","last_became_active":"2024-04-19T03:01:14.642885+0000","last_became_peered":"2024-04-19T03:01:14.642885+0000","last_unstale":"2024-04-19T03:01:15.001643+0000","last_undegraded":"2024-04-19T03:01:15.001643+0000","last_fullsized":"2024-04-19T03:01:15.001643+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:24:40.181164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.019181+0000","last_change":"2024-04-19T03:01:15.016104+0000","last_active":"2024-04-19T03:01:15.019181+0000","last_peered":"2024-04-19T03:01:15.019181+0000","last_clean":"2024-04-19T03:01:15.019181+0000","last_became_active":"2024-04-19T03:01:15.015386+0000","last_became_peered":"2024-04-19T03:01:15.015386+0000","last_unstale":"2024-04-19T03:01:15.019181+0000","last_undegraded":"2024-04-19T03:01:15.019181+0000","last_fullsized":"2024-04-19T03:01:15.019181+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:00:35.372657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.003912+0000","last_change":"2024-04-19T03:01:10.602194+0000","last_active":"2024-04-19T03:01:15.003912+0000","last_peered":"2024-04-19T03:01:15.003912+0000","last_clean":"2024-04-19T03:01:15.003912+0000","last_became_active":"2024-04-19T03:01:10.601381+0000","last_became_peered":"2024-04-19T03:01:10.601381+0000","last_unstale":"2024-04-19T03:01:15.003912+0000","last_undegraded":"2024-04-19T03:01:15.003912+0000","last_fullsized":"2024-04-19T03:01:15.003912+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_clean_scrub_stamp":"2024-04-19T03:01:09.578660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:42:26.594095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.003098+0000","last_change":"2024-04-19T03:01:14.647365+0000","last_active":"2024-04-19T03:01:15.003098+0000","last_peered":"2024-04-19T03:01:15.003098+0000","last_clean":"2024-04-19T03:01:15.003098+0000","last_became_active":"2024-04-19T03:01:14.646950+0000","last_became_peered":"2024-04-19T03:01:14.646950+0000","last_unstale":"2024-04-19T03:01:15.003098+0000","last_undegraded":"2024-04-19T03:01:15.003098+0000","last_fullsized":"2024-04-19T03:01:15.003098+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:41:26.108674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.023211+0000","last_change":"2024-04-19T03:01:15.018728+0000","last_active":"2024-04-19T03:01:15.023211+0000","last_peered":"2024-04-19T03:01:15.023211+0000","last_clean":"2024-04-19T03:01:15.023211+0000","last_became_active":"2024-04-19T03:01:15.017287+0000","last_became_peered":"2024-04-19T03:01:15.017287+0000","last_unstale":"2024-04-19T03:01:15.023211+0000","last_undegraded":"2024-04-19T03:01:15.023211+0000","last_fullsized":"2024-04-19T03:01:15.023211+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:54:04.518505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.003231+0000","last_change":"2024-04-19T03:01:10.600207+0000","last_active":"2024-04-19T03:01:15.003231+0000","last_peered":"2024-04-19T03:01:15.003231+0000","last_clean":"2024-04-19T03:01:15.003231+0000","last_became_active":"2024-04-19T03:01:10.599209+0000","last_became_peered":"2024-04-19T03:01:10.599209+0000","last_unstale":"2024-04-19T03:01:15.003231+0000","last_undegraded":"2024-04-19T03:01:15.003231+0000","last_fullsized":"2024-04-19T03:01:15.003231+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_clean_scrub_stamp":"2024-04-19T03:01:09.578660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:30:25.748140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.008341+0000","last_change":"2024-04-19T03:01:14.649068+0000","last_active":"2024-04-19T03:01:15.008341+0000","last_peered":"2024-04-19T03:01:15.008341+0000","last_clean":"2024-04-19T03:01:15.008341+0000","last_became_active":"2024-04-19T03:01:14.648082+0000","last_became_peered":"2024-04-19T03:01:14.648082+0000","last_unstale":"2024-04-19T03:01:15.008341+0000","last_undegraded":"2024-04-19T03:01:15.008341+0000","last_fullsized":"2024-04-19T03:01:15.008341+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:30:14.489117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-19T03:01:18.092872+0000","last_change":"2024-04-19T03:01:15.012147+0000","last_active":"2024-04-19T03:01:18.092872+0000","last_peered":"2024-04-19T03:01:18.092872+0000","last_clean":"2024-04-19T03:01:18.092872+0000","last_became_active":"2024-04-19T03:01:15.011421+0000","last_became_peered":"2024-04-19T03:01:15.011421+0000","last_unstale":"2024-04-19T03:01:18.092872+0000","last_undegraded":"2024-04-19T03:01:18.092872+0000","last_fullsized":"2024-04-19T03:01:18.092872+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:50:51.928641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.002185+0000","last_change":"2024-04-19T03:01:10.601386+0000","last_active":"2024-04-19T03:01:15.002185+0000","last_peered":"2024-04-19T03:01:15.002185+0000","last_clean":"2024-04-19T03:01:15.002185+0000","last_became_active":"2024-04-19T03:01:10.600732+0000","last_became_peered":"2024-04-19T03:01:10.600732+0000","last_unstale":"2024-04-19T03:01:15.002185+0000","last_undegraded":"2024-04-19T03:01:15.002185+0000","last_fullsized":"2024-04-19T03:01:15.002185+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_clean_scrub_stamp":"2024-04-19T03:01:09.578660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:34:53.138338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.006322+0000","last_change":"2024-04-19T03:01:14.651363+0000","last_active":"2024-04-19T03:01:15.006322+0000","last_peered":"2024-04-19T03:01:15.006322+0000","last_clean":"2024-04-19T03:01:15.006322+0000","last_became_active":"2024-04-19T03:01:14.651020+0000","last_became_peered":"2024-04-19T03:01:14.651020+0000","last_unstale":"2024-04-19T03:01:15.006322+0000","last_undegraded":"2024-04-19T03:01:15.006322+0000","last_fullsized":"2024-04-19T03:01:15.006322+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:44:36.043345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-19T03:01:18.092601+0000","last_change":"2024-04-19T03:01:15.017182+0000","last_active":"2024-04-19T03:01:18.092601+0000","last_peered":"2024-04-19T03:01:18.092601+0000","last_clean":"2024-04-19T03:01:18.092601+0000","last_became_active":"2024-04-19T03:01:15.016258+0000","last_became_peered":"2024-04-19T03:01:15.016258+0000","last_unstale":"2024-04-19T03:01:18.092601+0000","last_undegraded":"2024-04-19T03:01:18.092601+0000","last_fullsized":"2024-04-19T03:01:18.092601+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:27:25.351590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.004000+0000","last_change":"2024-04-19T03:01:14.651740+0000","last_active":"2024-04-19T03:01:15.004000+0000","last_peered":"2024-04-19T03:01:15.004000+0000","last_clean":"2024-04-19T03:01:15.004000+0000","last_became_active":"2024-04-19T03:01:14.651491+0000","last_became_peered":"2024-04-19T03:01:14.651491+0000","last_unstale":"2024-04-19T03:01:15.004000+0000","last_undegraded":"2024-04-19T03:01:15.004000+0000","last_fullsized":"2024-04-19T03:01:15.004000+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:42:15.864988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.006158+0000","last_change":"2024-04-19T03:01:10.601062+0000","last_active":"2024-04-19T03:01:15.006158+0000","last_peered":"2024-04-19T03:01:15.006158+0000","last_clean":"2024-04-19T03:01:15.006158+0000","last_became_active":"2024-04-19T03:01:10.600334+0000","last_became_peered":"2024-04-19T03:01:10.600334+0000","last_unstale":"2024-04-19T03:01:15.006158+0000","last_undegraded":"2024-04-19T03:01:15.006158+0000","last_fullsized":"2024-04-19T03:01:15.006158+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_clean_scrub_stamp":"2024-04-19T03:01:09.578660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:51:38.307752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.023683+0000","last_change":"2024-04-19T03:01:15.020501+0000","last_active":"2024-04-19T03:01:15.023683+0000","last_peered":"2024-04-19T03:01:15.023683+0000","last_clean":"2024-04-19T03:01:15.023683+0000","last_became_active":"2024-04-19T03:01:15.019019+0000","last_became_peered":"2024-04-19T03:01:15.019019+0000","last_unstale":"2024-04-19T03:01:15.023683+0000","last_undegraded":"2024-04-19T03:01:15.023683+0000","last_fullsized":"2024-04-19T03:01:15.023683+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:22:58.349159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.006058+0000","last_change":"2024-04-19T03:01:14.643098+0000","last_active":"2024-04-19T03:01:15.006058+0000","last_peered":"2024-04-19T03:01:15.006058+0000","last_clean":"2024-04-19T03:01:15.006058+0000","last_became_active":"2024-04-19T03:01:14.642789+0000","last_became_peered":"2024-04-19T03:01:14.642789+0000","last_unstale":"2024-04-19T03:01:15.006058+0000","last_undegraded":"2024-04-19T03:01:15.006058+0000","last_fullsized":"2024-04-19T03:01:15.006058+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:40:40.193720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.005646+0000","last_change":"2024-04-19T03:01:10.603139+0000","last_active":"2024-04-19T03:01:15.005646+0000","last_peered":"2024-04-19T03:01:15.005646+0000","last_clean":"2024-04-19T03:01:15.005646+0000","last_became_active":"2024-04-19T03:01:10.602397+0000","last_became_peered":"2024-04-19T03:01:10.602397+0000","last_unstale":"2024-04-19T03:01:15.005646+0000","last_undegraded":"2024-04-19T03:01:15.005646+0000","last_fullsized":"2024-04-19T03:01:15.005646+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_clean_scrub_stamp":"2024-04-19T03:01:09.578660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:36:00.072157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.023512+0000","last_change":"2024-04-19T03:01:15.020052+0000","last_active":"2024-04-19T03:01:15.023512+0000","last_peered":"2024-04-19T03:01:15.023512+0000","last_clean":"2024-04-19T03:01:15.023512+0000","last_became_active":"2024-04-19T03:01:15.019144+0000","last_became_peered":"2024-04-19T03:01:15.019144+0000","last_unstale":"2024-04-19T03:01:15.023512+0000","last_undegraded":"2024-04-19T03:01:15.023512+0000","last_fullsized":"2024-04-19T03:01:15.023512+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:39:54.289444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"20'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.019383+0000","last_change":"2024-04-19T03:01:14.643328+0000","last_active":"2024-04-19T03:01:15.019383+0000","last_peered":"2024-04-19T03:01:15.019383+0000","last_clean":"2024-04-19T03:01:15.019383+0000","last_became_active":"2024-04-19T03:01:14.643001+0000","last_became_peered":"2024-04-19T03:01:14.643001+0000","last_unstale":"2024-04-19T03:01:15.019383+0000","last_undegraded":"2024-04-19T03:01:15.019383+0000","last_fullsized":"2024-04-19T03:01:15.019383+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:28:14.128657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.006138+0000","last_change":"2024-04-19T03:01:10.599894+0000","last_active":"2024-04-19T03:01:15.006138+0000","last_peered":"2024-04-19T03:01:15.006138+0000","last_clean":"2024-04-19T03:01:15.006138+0000","last_became_active":"2024-04-19T03:01:10.599202+0000","last_became_peered":"2024-04-19T03:01:10.599202+0000","last_unstale":"2024-04-19T03:01:15.006138+0000","last_undegraded":"2024-04-19T03:01:15.006138+0000","last_fullsized":"2024-04-19T03:01:15.006138+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_clean_scrub_stamp":"2024-04-19T03:01:09.578660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:59:34.386302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-19T03:01:18.091060+0000","last_change":"2024-04-19T03:01:15.016429+0000","last_active":"2024-04-19T03:01:18.091060+0000","last_peered":"2024-04-19T03:01:18.091060+0000","last_clean":"2024-04-19T03:01:18.091060+0000","last_became_active":"2024-04-19T03:01:15.015945+0000","last_became_peered":"2024-04-19T03:01:15.015945+0000","last_unstale":"2024-04-19T03:01:18.091060+0000","last_undegraded":"2024-04-19T03:01:18.091060+0000","last_fullsized":"2024-04-19T03:01:18.091060+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:43:17.785352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"21'1","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-19T03:01:18.093734+0000","last_change":"2024-04-19T03:01:14.647170+0000","last_active":"2024-04-19T03:01:18.093734+0000","last_peered":"2024-04-19T03:01:18.093734+0000","last_clean":"2024-04-19T03:01:18.093734+0000","last_became_active":"2024-04-19T03:01:14.646622+0000","last_became_peered":"2024-04-19T03:01:14.646622+0000","last_unstale":"2024-04-19T03:01:18.093734+0000","last_undegraded":"2024-04-19T03:01:18.093734+0000","last_fullsized":"2024-04-19T03:01:18.093734+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:32:41.909038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.001377+0000","last_change":"2024-04-19T03:01:10.602274+0000","last_active":"2024-04-19T03:01:15.001377+0000","last_peered":"2024-04-19T03:01:15.001377+0000","last_clean":"2024-04-19T03:01:15.001377+0000","last_became_active":"2024-04-19T03:01:10.601487+0000","last_became_peered":"2024-04-19T03:01:10.601487+0000","last_unstale":"2024-04-19T03:01:15.001377+0000","last_undegraded":"2024-04-19T03:01:15.001377+0000","last_fullsized":"2024-04-19T03:01:15.001377+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_clean_scrub_stamp":"2024-04-19T03:01:09.578660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:26:16.712446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.023281+0000","last_change":"2024-04-19T03:01:15.018914+0000","last_active":"2024-04-19T03:01:15.023281+0000","last_peered":"2024-04-19T03:01:15.023281+0000","last_clean":"2024-04-19T03:01:15.023281+0000","last_became_active":"2024-04-19T03:01:15.018276+0000","last_became_peered":"2024-04-19T03:01:15.018276+0000","last_unstale":"2024-04-19T03:01:15.023281+0000","last_undegraded":"2024-04-19T03:01:15.023281+0000","last_fullsized":"2024-04-19T03:01:15.023281+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:40:59.453079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.018690+0000","last_change":"2024-04-19T03:01:15.015855+0000","last_active":"2024-04-19T03:01:15.018690+0000","last_peered":"2024-04-19T03:01:15.018690+0000","last_clean":"2024-04-19T03:01:15.018690+0000","last_became_active":"2024-04-19T03:01:15.015358+0000","last_became_peered":"2024-04-19T03:01:15.015358+0000","last_unstale":"2024-04-19T03:01:15.018690+0000","last_undegraded":"2024-04-19T03:01:15.018690+0000","last_fullsized":"2024-04-19T03:01:15.018690+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:59:49.270245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"20'6","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.029460+0000","last_change":"2024-04-19T03:01:14.649577+0000","last_active":"2024-04-19T03:01:15.029460+0000","last_peered":"2024-04-19T03:01:15.029460+0000","last_clean":"2024-04-19T03:01:15.029460+0000","last_became_active":"2024-04-19T03:01:14.649284+0000","last_became_peered":"2024-04-19T03:01:14.649284+0000","last_unstale":"2024-04-19T03:01:15.029460+0000","last_undegraded":"2024-04-19T03:01:15.029460+0000","last_fullsized":"2024-04-19T03:01:15.029460+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:01:22.214742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-19T03:01:18.091377+0000","last_change":"2024-04-19T03:01:15.013509+0000","last_active":"2024-04-19T03:01:18.091377+0000","last_peered":"2024-04-19T03:01:18.091377+0000","last_clean":"2024-04-19T03:01:18.091377+0000","last_became_active":"2024-04-19T03:01:15.012694+0000","last_became_peered":"2024-04-19T03:01:15.012694+0000","last_unstale":"2024-04-19T03:01:18.091377+0000","last_undegraded":"2024-04-19T03:01:18.091377+0000","last_fullsized":"2024-04-19T03:01:18.091377+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:13:47.056938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"20'3","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.019366+0000","last_change":"2024-04-19T03:01:14.648703+0000","last_active":"2024-04-19T03:01:15.019366+0000","last_peered":"2024-04-19T03:01:15.019366+0000","last_clean":"2024-04-19T03:01:15.019366+0000","last_became_active":"2024-04-19T03:01:14.648258+0000","last_became_peered":"2024-04-19T03:01:14.648258+0000","last_unstale":"2024-04-19T03:01:15.019366+0000","last_undegraded":"2024-04-19T03:01:15.019366+0000","last_fullsized":"2024-04-19T03:01:15.019366+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:30:35.593258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.001904+0000","last_change":"2024-04-19T03:01:14.651753+0000","last_active":"2024-04-19T03:01:15.001904+0000","last_peered":"2024-04-19T03:01:15.001904+0000","last_clean":"2024-04-19T03:01:15.001904+0000","last_became_active":"2024-04-19T03:01:14.651458+0000","last_became_peered":"2024-04-19T03:01:14.651458+0000","last_unstale":"2024-04-19T03:01:15.001904+0000","last_undegraded":"2024-04-19T03:01:15.001904+0000","last_fullsized":"2024-04-19T03:01:15.001904+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:58:28.669306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-19T03:01:18.091195+0000","last_change":"2024-04-19T03:01:15.016094+0000","last_active":"2024-04-19T03:01:18.091195+0000","last_peered":"2024-04-19T03:01:18.091195+0000","last_clean":"2024-04-19T03:01:18.091195+0000","last_became_active":"2024-04-19T03:01:15.015379+0000","last_became_peered":"2024-04-19T03:01:15.015379+0000","last_unstale":"2024-04-19T03:01:18.091195+0000","last_undegraded":"2024-04-19T03:01:18.091195+0000","last_fullsized":"2024-04-19T03:01:18.091195+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:42:11.854631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.006982+0000","last_change":"2024-04-19T03:01:14.647282+0000","last_active":"2024-04-19T03:01:15.006982+0000","last_peered":"2024-04-19T03:01:15.006982+0000","last_clean":"2024-04-19T03:01:15.006982+0000","last_became_active":"2024-04-19T03:01:14.646878+0000","last_became_peered":"2024-04-19T03:01:14.646878+0000","last_unstale":"2024-04-19T03:01:15.006982+0000","last_undegraded":"2024-04-19T03:01:15.006982+0000","last_fullsized":"2024-04-19T03:01:15.006982+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:22:38.096801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-19T03:01:18.090981+0000","last_change":"2024-04-19T03:01:15.013187+0000","last_active":"2024-04-19T03:01:18.090981+0000","last_peered":"2024-04-19T03:01:18.090981+0000","last_clean":"2024-04-19T03:01:18.090981+0000","last_became_active":"2024-04-19T03:01:15.011542+0000","last_became_peered":"2024-04-19T03:01:15.011542+0000","last_unstale":"2024-04-19T03:01:18.090981+0000","last_undegraded":"2024-04-19T03:01:18.090981+0000","last_fullsized":"2024-04-19T03:01:18.090981+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:53:13.646525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.023738+0000","last_change":"2024-04-19T03:01:15.020635+0000","last_active":"2024-04-19T03:01:15.023738+0000","last_peered":"2024-04-19T03:01:15.023738+0000","last_clean":"2024-04-19T03:01:15.023738+0000","last_became_active":"2024-04-19T03:01:15.019917+0000","last_became_peered":"2024-04-19T03:01:15.019917+0000","last_unstale":"2024-04-19T03:01:15.023738+0000","last_undegraded":"2024-04-19T03:01:15.023738+0000","last_fullsized":"2024-04-19T03:01:15.023738+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:40:53.477682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.005373+0000","last_change":"2024-04-19T03:01:14.643239+0000","last_active":"2024-04-19T03:01:15.005373+0000","last_peered":"2024-04-19T03:01:15.005373+0000","last_clean":"2024-04-19T03:01:15.005373+0000","last_became_active":"2024-04-19T03:01:14.642959+0000","last_became_peered":"2024-04-19T03:01:14.642959+0000","last_unstale":"2024-04-19T03:01:15.005373+0000","last_undegraded":"2024-04-19T03:01:15.005373+0000","last_fullsized":"2024-04-19T03:01:15.005373+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:05:36.752017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-19T03:01:18.092865+0000","last_change":"2024-04-19T03:01:15.017708+0000","last_active":"2024-04-19T03:01:18.092865+0000","last_peered":"2024-04-19T03:01:18.092865+0000","last_clean":"2024-04-19T03:01:18.092865+0000","last_became_active":"2024-04-19T03:01:15.016726+0000","last_became_peered":"2024-04-19T03:01:15.016726+0000","last_unstale":"2024-04-19T03:01:18.092865+0000","last_undegraded":"2024-04-19T03:01:18.092865+0000","last_fullsized":"2024-04-19T03:01:18.092865+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:07:47.395052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.003022+0000","last_change":"2024-04-19T03:01:14.647744+0000","last_active":"2024-04-19T03:01:15.003022+0000","last_peered":"2024-04-19T03:01:15.003022+0000","last_clean":"2024-04-19T03:01:15.003022+0000","last_became_active":"2024-04-19T03:01:14.647463+0000","last_became_peered":"2024-04-19T03:01:14.647463+0000","last_unstale":"2024-04-19T03:01:15.003022+0000","last_undegraded":"2024-04-19T03:01:15.003022+0000","last_fullsized":"2024-04-19T03:01:15.003022+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:56:15.348940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.023345+0000","last_change":"2024-04-19T03:01:15.019045+0000","last_active":"2024-04-19T03:01:15.023345+0000","last_peered":"2024-04-19T03:01:15.023345+0000","last_clean":"2024-04-19T03:01:15.023345+0000","last_became_active":"2024-04-19T03:01:15.017982+0000","last_became_peered":"2024-04-19T03:01:15.017982+0000","last_unstale":"2024-04-19T03:01:15.023345+0000","last_undegraded":"2024-04-19T03:01:15.023345+0000","last_fullsized":"2024-04-19T03:01:15.023345+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:10:56.732208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"20'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.020345+0000","last_change":"2024-04-19T03:01:14.651050+0000","last_active":"2024-04-19T03:01:15.020345+0000","last_peered":"2024-04-19T03:01:15.020345+0000","last_clean":"2024-04-19T03:01:15.020345+0000","last_became_active":"2024-04-19T03:01:14.650639+0000","last_became_peered":"2024-04-19T03:01:14.650639+0000","last_unstale":"2024-04-19T03:01:15.020345+0000","last_undegraded":"2024-04-19T03:01:15.020345+0000","last_fullsized":"2024-04-19T03:01:15.020345+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:41:49.783896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.022916+0000","last_change":"2024-04-19T03:01:15.017319+0000","last_active":"2024-04-19T03:01:15.022916+0000","last_peered":"2024-04-19T03:01:15.022916+0000","last_clean":"2024-04-19T03:01:15.022916+0000","last_became_active":"2024-04-19T03:01:15.016815+0000","last_became_peered":"2024-04-19T03:01:15.016815+0000","last_unstale":"2024-04-19T03:01:15.022916+0000","last_undegraded":"2024-04-19T03:01:15.022916+0000","last_fullsized":"2024-04-19T03:01:15.022916+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:36:36.363535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"20'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.018447+0000","last_change":"2024-04-19T03:01:14.648823+0000","last_active":"2024-04-19T03:01:15.018447+0000","last_peered":"2024-04-19T03:01:15.018447+0000","last_clean":"2024-04-19T03:01:15.018447+0000","last_became_active":"2024-04-19T03:01:14.648337+0000","last_became_peered":"2024-04-19T03:01:14.648337+0000","last_unstale":"2024-04-19T03:01:15.018447+0000","last_undegraded":"2024-04-19T03:01:15.018447+0000","last_fullsized":"2024-04-19T03:01:15.018447+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:08:46.250118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.018663+0000","last_change":"2024-04-19T03:01:15.014773+0000","last_active":"2024-04-19T03:01:15.018663+0000","last_peered":"2024-04-19T03:01:15.018663+0000","last_clean":"2024-04-19T03:01:15.018663+0000","last_became_active":"2024-04-19T03:01:15.013919+0000","last_became_peered":"2024-04-19T03:01:15.013919+0000","last_unstale":"2024-04-19T03:01:15.018663+0000","last_undegraded":"2024-04-19T03:01:15.018663+0000","last_fullsized":"2024-04-19T03:01:15.018663+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:56:44.307812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"20'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.018107+0000","last_change":"2024-04-19T03:01:14.651049+0000","last_active":"2024-04-19T03:01:15.018107+0000","last_peered":"2024-04-19T03:01:15.018107+0000","last_clean":"2024-04-19T03:01:15.018107+0000","last_became_active":"2024-04-19T03:01:14.650646+0000","last_became_peered":"2024-04-19T03:01:14.650646+0000","last_unstale":"2024-04-19T03:01:15.018107+0000","last_undegraded":"2024-04-19T03:01:15.018107+0000","last_fullsized":"2024-04-19T03:01:15.018107+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:33:59.716591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.022142+0000","last_change":"2024-04-19T03:01:15.017860+0000","last_active":"2024-04-19T03:01:15.022142+0000","last_peered":"2024-04-19T03:01:15.022142+0000","last_clean":"2024-04-19T03:01:15.022142+0000","last_became_active":"2024-04-19T03:01:15.017355+0000","last_became_peered":"2024-04-19T03:01:15.017355+0000","last_unstale":"2024-04-19T03:01:15.022142+0000","last_undegraded":"2024-04-19T03:01:15.022142+0000","last_fullsized":"2024-04-19T03:01:15.022142+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:13:06.902769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"20'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.022312+0000","last_change":"2024-04-19T03:01:14.649277+0000","last_active":"2024-04-19T03:01:15.022312+0000","last_peered":"2024-04-19T03:01:15.022312+0000","last_clean":"2024-04-19T03:01:15.022312+0000","last_became_active":"2024-04-19T03:01:14.648614+0000","last_became_peered":"2024-04-19T03:01:14.648614+0000","last_unstale":"2024-04-19T03:01:15.022312+0000","last_undegraded":"2024-04-19T03:01:15.022312+0000","last_fullsized":"2024-04-19T03:01:15.022312+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:34:05.922324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.023028+0000","last_change":"2024-04-19T03:01:15.017986+0000","last_active":"2024-04-19T03:01:15.023028+0000","last_peered":"2024-04-19T03:01:15.023028+0000","last_clean":"2024-04-19T03:01:15.023028+0000","last_became_active":"2024-04-19T03:01:15.017080+0000","last_became_peered":"2024-04-19T03:01:15.017080+0000","last_unstale":"2024-04-19T03:01:15.023028+0000","last_undegraded":"2024-04-19T03:01:15.023028+0000","last_fullsized":"2024-04-19T03:01:15.023028+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:14:57.922917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"20'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.019052+0000","last_change":"2024-04-19T03:01:14.644015+0000","last_active":"2024-04-19T03:01:15.019052+0000","last_peered":"2024-04-19T03:01:15.019052+0000","last_clean":"2024-04-19T03:01:15.019052+0000","last_became_active":"2024-04-19T03:01:14.643769+0000","last_became_peered":"2024-04-19T03:01:14.643769+0000","last_unstale":"2024-04-19T03:01:15.019052+0000","last_undegraded":"2024-04-19T03:01:15.019052+0000","last_fullsized":"2024-04-19T03:01:15.019052+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:56:05.481089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.024302+0000","last_change":"2024-04-19T03:01:15.019466+0000","last_active":"2024-04-19T03:01:15.024302+0000","last_peered":"2024-04-19T03:01:15.024302+0000","last_clean":"2024-04-19T03:01:15.024302+0000","last_became_active":"2024-04-19T03:01:15.018819+0000","last_became_peered":"2024-04-19T03:01:15.018819+0000","last_unstale":"2024-04-19T03:01:15.024302+0000","last_undegraded":"2024-04-19T03:01:15.024302+0000","last_fullsized":"2024-04-19T03:01:15.024302+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:13:26.030579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"20'4","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.020064+0000","last_change":"2024-04-19T03:01:14.647358+0000","last_active":"2024-04-19T03:01:15.020064+0000","last_peered":"2024-04-19T03:01:15.020064+0000","last_clean":"2024-04-19T03:01:15.020064+0000","last_became_active":"2024-04-19T03:01:14.646998+0000","last_became_peered":"2024-04-19T03:01:14.646998+0000","last_unstale":"2024-04-19T03:01:15.020064+0000","last_undegraded":"2024-04-19T03:01:15.020064+0000","last_fullsized":"2024-04-19T03:01:15.020064+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:09:04.022991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":14482,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":10,"seq":42949672970,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31380,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340460,"statfs":{"total":96636764160,"available":96604631040,"internally_reserved":0,"allocated":270336,"data_stored":654544,"data_compressed":7241,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56299999999999994}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64400000000000002}]}]},{"osd":1,"up_from":10,"seq":42949672969,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31372,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340468,"statfs":{"total":96636764160,"available":96604639232,"internally_reserved":0,"allocated":262144,"data_stored":653928,"data_compressed":7241,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60399999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72599999999999998}]}]},{"osd":0,"up_from":9,"seq":38654705672,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31300,"kb_used_data":184,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340540,"statfs":{"total":96636764160,"available":96604712960,"internally_reserved":0,"allocated":188416,"data_stored":62430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.623}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73199999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":7241,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":7241,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-19T03:01:26.295 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-19T03:01:26.295 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-04-19T03:01:26.295 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-04-19T03:01:26.295 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-19T03:01:26.622 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-19T03:01:26.622 INFO:teuthology.orchestra.run.smithi096.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-04-19T03:01:26.637 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-04-19T03:01:26.637 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-19T03:01:26.933 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-19T03:01:26.933 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":21,"fsid":"c6cc8e09-11d4-48de-9a6c-4d70ed3c3789","created":"2024-04-19T03:00:53.746146+0000","modified":"2024-04-19T03:01:15.992289+0000","last_up_change":"2024-04-19T03:01:04.501086+0000","last_in_change":"2024-04-19T03:00:54.640172+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-19T03:01:05.999591+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-19T03:01:09.051757+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-19T03:01:13.479163+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-19T03:01:13.992441+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"05ecb884-2c30-44f7-aa14-90154f9bbe9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":18245},{"type":"v1","addr":"172.21.15.97:6801","nonce":18245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":18245},{"type":"v1","addr":"172.21.15.97:6803","nonce":18245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":18245},{"type":"v1","addr":"172.21.15.97:6807","nonce":18245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6804","nonce":18245},{"type":"v1","addr":"172.21.15.97:6805","nonce":18245}]},"public_addr":"172.21.15.97:6801/18245","cluster_addr":"172.21.15.97:6803/18245","heartbeat_back_addr":"172.21.15.97:6807/18245","heartbeat_front_addr":"172.21.15.97:6805/18245","state":["exists","up"]},{"osd":1,"uuid":"efc873e0-69c3-4a57-8ee5-41f836b65f47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":18145},{"type":"v1","addr":"172.21.15.134:6801","nonce":18145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":18145},{"type":"v1","addr":"172.21.15.134:6803","nonce":18145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":18145},{"type":"v1","addr":"172.21.15.134:6807","nonce":18145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":18145},{"type":"v1","addr":"172.21.15.134:6805","nonce":18145}]},"public_addr":"172.21.15.134:6801/18145","cluster_addr":"172.21.15.134:6803/18145","heartbeat_back_addr":"172.21.15.134:6807/18145","heartbeat_front_addr":"172.21.15.134:6805/18145","state":["exists","up"]},{"osd":2,"uuid":"229278a0-dd93-4234-9065-e4f2f6188ef2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":18223},{"type":"v1","addr":"172.21.15.144:6801","nonce":18223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":18223},{"type":"v1","addr":"172.21.15.144:6803","nonce":18223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":18223},{"type":"v1","addr":"172.21.15.144:6807","nonce":18223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":18223},{"type":"v1","addr":"172.21.15.144:6805","nonce":18223}]},"public_addr":"172.21.15.144:6801/18223","cluster_addr":"172.21.15.144:6803/18223","heartbeat_back_addr":"172.21.15.144:6807/18223","heartbeat_front_addr":"172.21.15.144:6805/18223","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T03:00:59.302574+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T03:01:00.064174+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T03:00:59.735582+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-19T03:01:26.948 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-19T03:01:05.999591+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '14', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-19T03:01:09.051757+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-19T03:01:13.479163+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-04-19T03:01:13.992441+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-19T03:01:26.948 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-19T03:01:27.247 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 1 2024-04-19T03:01:27.261 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-04-19T03:01:27.557 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 8 2024-04-19T03:01:27.576 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-19T03:01:27.873 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 32 2024-04-19T03:01:27.889 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-19T03:01:28.191 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 64 2024-04-19T03:01:28.206 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-19T03:01:28.544 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-19T03:01:28.544 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":5,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-19T03:01:14.989437+0000","modified":"2024-04-19T03:01:17.001353+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4202},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4202":{"gid":4202,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.96:6803/3386968674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":3386968674},{"type":"v1","addr":"172.21.15.96:6803","nonce":3386968674}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-19T03:01:28.548 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 5 2024-04-19T03:01:28.558 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-19T03:01:28.856 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-19T03:01:28.857 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":21,"fsid":"c6cc8e09-11d4-48de-9a6c-4d70ed3c3789","created":"2024-04-19T03:00:53.746146+0000","modified":"2024-04-19T03:01:15.992289+0000","last_up_change":"2024-04-19T03:01:04.501086+0000","last_in_change":"2024-04-19T03:00:54.640172+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-19T03:01:05.999591+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-19T03:01:09.051757+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-19T03:01:13.479163+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-19T03:01:13.992441+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"05ecb884-2c30-44f7-aa14-90154f9bbe9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":18245},{"type":"v1","addr":"172.21.15.97:6801","nonce":18245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":18245},{"type":"v1","addr":"172.21.15.97:6803","nonce":18245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":18245},{"type":"v1","addr":"172.21.15.97:6807","nonce":18245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6804","nonce":18245},{"type":"v1","addr":"172.21.15.97:6805","nonce":18245}]},"public_addr":"172.21.15.97:6801/18245","cluster_addr":"172.21.15.97:6803/18245","heartbeat_back_addr":"172.21.15.97:6807/18245","heartbeat_front_addr":"172.21.15.97:6805/18245","state":["exists","up"]},{"osd":1,"uuid":"efc873e0-69c3-4a57-8ee5-41f836b65f47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":18145},{"type":"v1","addr":"172.21.15.134:6801","nonce":18145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":18145},{"type":"v1","addr":"172.21.15.134:6803","nonce":18145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":18145},{"type":"v1","addr":"172.21.15.134:6807","nonce":18145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":18145},{"type":"v1","addr":"172.21.15.134:6805","nonce":18145}]},"public_addr":"172.21.15.134:6801/18145","cluster_addr":"172.21.15.134:6803/18145","heartbeat_back_addr":"172.21.15.134:6807/18145","heartbeat_front_addr":"172.21.15.134:6805/18145","state":["exists","up"]},{"osd":2,"uuid":"229278a0-dd93-4234-9065-e4f2f6188ef2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":18223},{"type":"v1","addr":"172.21.15.144:6801","nonce":18223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":18223},{"type":"v1","addr":"172.21.15.144:6803","nonce":18223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":18223},{"type":"v1","addr":"172.21.15.144:6807","nonce":18223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":18223},{"type":"v1","addr":"172.21.15.144:6805","nonce":18223}]},"public_addr":"172.21.15.144:6801/18223","cluster_addr":"172.21.15.144:6803/18223","heartbeat_back_addr":"172.21.15.144:6807/18223","heartbeat_front_addr":"172.21.15.144:6805/18223","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T03:00:59.302574+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T03:01:00.064174+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T03:00:59.735582+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-19T03:01:28.871 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-19T03:01:05.999591+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '14', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-19T03:01:09.051757+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-19T03:01:13.479163+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-04-19T03:01:13.992441+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-19T03:01:28.872 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-19T03:01:29.178 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 1 2024-04-19T03:01:29.192 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-04-19T03:01:29.499 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 8 2024-04-19T03:01:29.514 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-19T03:01:29.813 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 32 2024-04-19T03:01:29.834 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-19T03:01:30.131 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 64 2024-04-19T03:01:30.150 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-19T03:01:30.470 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-19T03:01:30.470 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":5,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-19T03:01:14.989437+0000","modified":"2024-04-19T03:01:17.001353+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4202},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4202":{"gid":4202,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.96:6803/3386968674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":3386968674},{"type":"v1","addr":"172.21.15.96:6803","nonce":3386968674}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-19T03:01:30.473 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 5 2024-04-19T03:01:30.484 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-19T03:01:30.787 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-19T03:01:30.787 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":21,"fsid":"c6cc8e09-11d4-48de-9a6c-4d70ed3c3789","created":"2024-04-19T03:00:53.746146+0000","modified":"2024-04-19T03:01:15.992289+0000","last_up_change":"2024-04-19T03:01:04.501086+0000","last_in_change":"2024-04-19T03:00:54.640172+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-19T03:01:05.999591+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-19T03:01:09.051757+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-19T03:01:13.479163+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-19T03:01:13.992441+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"05ecb884-2c30-44f7-aa14-90154f9bbe9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":18245},{"type":"v1","addr":"172.21.15.97:6801","nonce":18245}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":18245},{"type":"v1","addr":"172.21.15.97:6803","nonce":18245}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":18245},{"type":"v1","addr":"172.21.15.97:6807","nonce":18245}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6804","nonce":18245},{"type":"v1","addr":"172.21.15.97:6805","nonce":18245}]},"public_addr":"172.21.15.97:6801/18245","cluster_addr":"172.21.15.97:6803/18245","heartbeat_back_addr":"172.21.15.97:6807/18245","heartbeat_front_addr":"172.21.15.97:6805/18245","state":["exists","up"]},{"osd":1,"uuid":"efc873e0-69c3-4a57-8ee5-41f836b65f47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":18145},{"type":"v1","addr":"172.21.15.134:6801","nonce":18145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":18145},{"type":"v1","addr":"172.21.15.134:6803","nonce":18145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":18145},{"type":"v1","addr":"172.21.15.134:6807","nonce":18145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":18145},{"type":"v1","addr":"172.21.15.134:6805","nonce":18145}]},"public_addr":"172.21.15.134:6801/18145","cluster_addr":"172.21.15.134:6803/18145","heartbeat_back_addr":"172.21.15.134:6807/18145","heartbeat_front_addr":"172.21.15.134:6805/18145","state":["exists","up"]},{"osd":2,"uuid":"229278a0-dd93-4234-9065-e4f2f6188ef2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":18223},{"type":"v1","addr":"172.21.15.144:6801","nonce":18223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":18223},{"type":"v1","addr":"172.21.15.144:6803","nonce":18223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":18223},{"type":"v1","addr":"172.21.15.144:6807","nonce":18223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":18223},{"type":"v1","addr":"172.21.15.144:6805","nonce":18223}]},"public_addr":"172.21.15.144:6801/18223","cluster_addr":"172.21.15.144:6803/18223","heartbeat_back_addr":"172.21.15.144:6807/18223","heartbeat_front_addr":"172.21.15.144:6805/18223","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T03:00:59.302574+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T03:01:00.064174+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T03:00:59.735582+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-19T03:01:30.802 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-19T03:01:31.127 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-19T03:01:31.128 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":5,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-19T03:01:14.989437+0000","modified":"2024-04-19T03:01:17.001353+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4202},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4202":{"gid":4202,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.96:6803/3386968674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":3386968674},{"type":"v1","addr":"172.21.15.96:6803","nonce":3386968674}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-19T03:01:31.131 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 5 2024-04-19T03:01:31.242 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 5, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-19T03:01:14.989437+0000', 'modified': '2024-04-19T03:01:17.001353+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4202}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4202': {'gid': 4202, 'name': 'a', 'rank': 0, 'incarnation': 3, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.96:6803/3386968674', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.96:6802', 'nonce': 3386968674}, {'type': 'v1', 'addr': '172.21.15.96:6803', 'nonce': 3386968674}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-04-19T03:01:31.242 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-19T03:01:31.243 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-04-19T03:01:31.380 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-19T03:01:31.376+0000 7f3a3f7fe700 0 client.4650 ms_handle_reset on v2:172.21.15.96:6802/3386968674 2024-04-19T03:01:31.405 INFO:teuthology.orchestra.run.smithi096.stderr:2024-04-19T03:01:31.400+0000 7f3a3f7fe700 0 client.4656 ms_handle_reset on v2:172.21.15.96:6802/3386968674 2024-04-19T03:01:31.405 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-04-19T03:01:31.405 INFO:teuthology.orchestra.run.smithi096.stdout: "cluster_fsid": "c6cc8e09-11d4-48de-9a6c-4d70ed3c3789", 2024-04-19T03:01:31.406 INFO:teuthology.orchestra.run.smithi096.stdout: "whoami": 0, 2024-04-19T03:01:31.406 INFO:teuthology.orchestra.run.smithi096.stdout: "id": 4202, 2024-04-19T03:01:31.406 INFO:teuthology.orchestra.run.smithi096.stdout: "want_state": "up:active", 2024-04-19T03:01:31.406 INFO:teuthology.orchestra.run.smithi096.stdout: "state": "up:active", 2024-04-19T03:01:31.406 INFO:teuthology.orchestra.run.smithi096.stdout: "fs_name": "cephfs", 2024-04-19T03:01:31.406 INFO:teuthology.orchestra.run.smithi096.stdout: "rank_uptime": 16.412347464, 2024-04-19T03:01:31.406 INFO:teuthology.orchestra.run.smithi096.stdout: "mdsmap_epoch": 5, 2024-04-19T03:01:31.406 INFO:teuthology.orchestra.run.smithi096.stdout: "osdmap_epoch": 21, 2024-04-19T03:01:31.406 INFO:teuthology.orchestra.run.smithi096.stdout: "osdmap_epoch_barrier": 21, 2024-04-19T03:01:31.406 INFO:teuthology.orchestra.run.smithi096.stdout: "uptime": 20.712726365000002 2024-04-19T03:01:31.406 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-04-19T03:01:31.419 INFO:teuthology.run_tasks:Running task thrashosds... 2024-04-19T03:01:31.430 INFO:tasks.thrashosds:config is {'chance_down': 1.0, 'powercycle': True, 'timeout': 600, 'sighup_delay': 0.1, 'optrack_toggle_delay': 2.0, 'dump_ops_enable': 'true', 'noscrub_toggle_delay': 2.0, 'random_eio': 0.0} 2024-04-19T03:01:31.430 INFO:tasks.thrashosds:overrides is {'admin_socket': {'branch': 'reef'}, 'ceph': {'conf': {'client.0': {'admin socket': '/var/run/ceph/ceph-$name.asok'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression algorithm': 'zlib', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(MDS_TRIM\\)', '\\(MDS_SLOW_REQUEST\\)', 'MDS_SLOW_METADATA_IO', 'Behind on trimming', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from'], 'sha1': '646b8c7d293d8ec31a40c69f7b3237b19c1be24d'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'install': {'ceph': {'flavor': 'default', 'sha1': '646b8c7d293d8ec31a40c69f7b3237b19c1be24d'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'reef', 'sha1': '646b8c7d293d8ec31a40c69f7b3237b19c1be24d'}} 2024-04-19T03:01:31.430 INFO:tasks.thrashosds:config is {'chance_down': 1.0, 'powercycle': True, 'timeout': 600, 'sighup_delay': 0.1, 'optrack_toggle_delay': 2.0, 'dump_ops_enable': 'true', 'noscrub_toggle_delay': 2.0, 'random_eio': 0.0, 'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5} 2024-04-19T03:01:31.430 INFO:tasks.thrashosds:Doing preliminary sync to avoid collateral damage... 2024-04-19T03:01:31.431 DEBUG:teuthology.orchestra.run.smithi096:> sync 2024-04-19T03:01:31.781 DEBUG:teuthology.orchestra.run.smithi097:> sync 2024-04-19T03:01:31.836 DEBUG:teuthology.orchestra.run.smithi134:> sync 2024-04-19T03:01:31.937 DEBUG:teuthology.orchestra.run.smithi144:> sync 2024-04-19T03:01:32.140 DEBUG:tasks.thrashosds:checking console status of smithi096 2024-04-19T03:01:32.140 DEBUG:teuthology.orchestra.console.smithi096:Waiting for login prompt 2024-04-19T03:01:32.140 DEBUG:teuthology.orchestra.console.smithi096:pexpect command: console -M conserver.front.sepia.ceph.com -p 3109 -f smithi096 2024-04-19T03:01:32.267 DEBUG:teuthology.orchestra.console.smithi096:expect before: [Enter `^Ec?' for help] 2024-04-19T03:01:32.267 DEBUG:teuthology.orchestra.console.smithi096:expect after: smithi096 login: 2024-04-19T03:01:32.319 DEBUG:teuthology.orchestra.console.smithi096:console disconnect output: [Enter `^Ec?' for help] smithi096 login: [disconnect] 2024-04-19T03:01:32.420 DEBUG:tasks.thrashosds:checking console status of smithi097 2024-04-19T03:01:32.420 DEBUG:teuthology.orchestra.console.smithi097:Waiting for login prompt 2024-04-19T03:01:32.420 DEBUG:teuthology.orchestra.console.smithi097:pexpect command: console -M conserver.front.sepia.ceph.com -p 3109 -f smithi097 2024-04-19T03:01:32.585 DEBUG:teuthology.orchestra.console.smithi097:expect before: [Enter `^Ec?' for help] 2024-04-19T03:01:32.586 DEBUG:teuthology.orchestra.console.smithi097:expect after: smithi097 login: 2024-04-19T03:01:32.637 DEBUG:teuthology.orchestra.console.smithi097:console disconnect output: [Enter `^Ec?' for help] smithi097 login: [disconnect] 2024-04-19T03:01:32.739 DEBUG:tasks.thrashosds:checking console status of smithi134 2024-04-19T03:01:32.739 DEBUG:teuthology.orchestra.console.smithi134:Waiting for login prompt 2024-04-19T03:01:32.739 DEBUG:teuthology.orchestra.console.smithi134:pexpect command: console -M conserver.front.sepia.ceph.com -p 3109 -f smithi134 2024-04-19T03:01:32.881 DEBUG:teuthology.orchestra.console.smithi134:expect before: [Enter `^Ec?' for help] 2024-04-19T03:01:32.881 DEBUG:teuthology.orchestra.console.smithi134:expect after: smithi134 login: 2024-04-19T03:01:32.933 DEBUG:teuthology.orchestra.console.smithi134:console disconnect output: [Enter `^Ec?' for help] smithi134 login: [disconnect] 2024-04-19T03:01:33.034 DEBUG:tasks.thrashosds:checking console status of smithi144 2024-04-19T03:01:33.034 DEBUG:teuthology.orchestra.console.smithi144:Waiting for login prompt 2024-04-19T03:01:33.034 DEBUG:teuthology.orchestra.console.smithi144:pexpect command: console -M conserver.front.sepia.ceph.com -p 3109 -f smithi144 2024-04-19T03:01:33.136 DEBUG:teuthology.orchestra.console.smithi144:expect before: [Enter `^Ec?' for help] 2024-04-19T03:01:33.136 DEBUG:teuthology.orchestra.console.smithi144:expect after: smithi144 login: 2024-04-19T03:01:33.189 DEBUG:teuthology.orchestra.console.smithi144:console disconnect output: [Enter `^Ec?' for help] smithi144 login: [disconnect] 2024-04-19T03:01:33.290 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr_debug_aggressive_pg_num_changes true 2024-04-19T03:01:33.632 INFO:tasks.thrashosds:Beginning thrashosds... 2024-04-19T03:01:33.632 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-19T03:01:33.632 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-19T03:01:33.935 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-19T03:01:33.938 INFO:teuthology.orchestra.run.smithi096.stderr:dumped all 2024-04-19T03:01:33.950 INFO:teuthology.orchestra.run.smithi096.stdout:{"pg_ready":true,"pg_map":{"version":31,"stamp":"2024-04-19T03:01:31.948427+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":94052,"kb_used_data":704,"kb_used_omap":4,"kb_used_meta":93307,"kb_avail":283021468,"statfs":{"total":289910292480,"available":289813983232,"internally_reserved":0,"allocated":720896,"data_stored":1370902,"data_compressed":14482,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":4782,"internal_metadata":95546706},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1780,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004037"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.023489+0000","last_change":"2024-04-19T03:01:15.019292+0000","last_active":"2024-04-19T03:01:15.023489+0000","last_peered":"2024-04-19T03:01:15.023489+0000","last_clean":"2024-04-19T03:01:15.023489+0000","last_became_active":"2024-04-19T03:01:15.017907+0000","last_became_peered":"2024-04-19T03:01:15.017907+0000","last_unstale":"2024-04-19T03:01:15.023489+0000","last_undegraded":"2024-04-19T03:01:15.023489+0000","last_fullsized":"2024-04-19T03:01:15.023489+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:13:26.030579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.023194+0000","last_change":"2024-04-19T03:01:15.018719+0000","last_active":"2024-04-19T03:01:15.023194+0000","last_peered":"2024-04-19T03:01:15.023194+0000","last_clean":"2024-04-19T03:01:15.023194+0000","last_became_active":"2024-04-19T03:01:15.018070+0000","last_became_peered":"2024-04-19T03:01:15.018070+0000","last_unstale":"2024-04-19T03:01:15.023194+0000","last_undegraded":"2024-04-19T03:01:15.023194+0000","last_fullsized":"2024-04-19T03:01:15.023194+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:48:13.389356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.018237+0000","last_change":"2024-04-19T03:01:15.015884+0000","last_active":"2024-04-19T03:01:15.018237+0000","last_peered":"2024-04-19T03:01:15.018237+0000","last_clean":"2024-04-19T03:01:15.018237+0000","last_became_active":"2024-04-19T03:01:15.014599+0000","last_became_peered":"2024-04-19T03:01:15.014599+0000","last_unstale":"2024-04-19T03:01:15.018237+0000","last_undegraded":"2024-04-19T03:01:15.018237+0000","last_fullsized":"2024-04-19T03:01:15.018237+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:35:19.436344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.018134+0000","last_change":"2024-04-19T03:01:15.015186+0000","last_active":"2024-04-19T03:01:15.018134+0000","last_peered":"2024-04-19T03:01:15.018134+0000","last_clean":"2024-04-19T03:01:15.018134+0000","last_became_active":"2024-04-19T03:01:15.014218+0000","last_became_peered":"2024-04-19T03:01:15.014218+0000","last_unstale":"2024-04-19T03:01:15.018134+0000","last_undegraded":"2024-04-19T03:01:15.018134+0000","last_fullsized":"2024-04-19T03:01:15.018134+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:30:22.360053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.023421+0000","last_change":"2024-04-19T03:01:15.019382+0000","last_active":"2024-04-19T03:01:15.023421+0000","last_peered":"2024-04-19T03:01:15.023421+0000","last_clean":"2024-04-19T03:01:15.023421+0000","last_became_active":"2024-04-19T03:01:15.017859+0000","last_became_peered":"2024-04-19T03:01:15.017859+0000","last_unstale":"2024-04-19T03:01:15.023421+0000","last_undegraded":"2024-04-19T03:01:15.023421+0000","last_fullsized":"2024-04-19T03:01:15.023421+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:31:51.982582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.019273+0000","last_change":"2024-04-19T03:01:15.016989+0000","last_active":"2024-04-19T03:01:15.019273+0000","last_peered":"2024-04-19T03:01:15.019273+0000","last_clean":"2024-04-19T03:01:15.019273+0000","last_became_active":"2024-04-19T03:01:15.016569+0000","last_became_peered":"2024-04-19T03:01:15.016569+0000","last_unstale":"2024-04-19T03:01:15.019273+0000","last_undegraded":"2024-04-19T03:01:15.019273+0000","last_fullsized":"2024-04-19T03:01:15.019273+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:22:58.349159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.019190+0000","last_change":"2024-04-19T03:01:15.016925+0000","last_active":"2024-04-19T03:01:15.019190+0000","last_peered":"2024-04-19T03:01:15.019190+0000","last_clean":"2024-04-19T03:01:15.019190+0000","last_became_active":"2024-04-19T03:01:15.016589+0000","last_became_peered":"2024-04-19T03:01:15.016589+0000","last_unstale":"2024-04-19T03:01:15.019190+0000","last_undegraded":"2024-04-19T03:01:15.019190+0000","last_fullsized":"2024-04-19T03:01:15.019190+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:48:13.389356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.022180+0000","last_change":"2024-04-19T03:01:15.018969+0000","last_active":"2024-04-19T03:01:15.022180+0000","last_peered":"2024-04-19T03:01:15.022180+0000","last_clean":"2024-04-19T03:01:15.022180+0000","last_became_active":"2024-04-19T03:01:15.016895+0000","last_became_peered":"2024-04-19T03:01:15.016895+0000","last_unstale":"2024-04-19T03:01:15.022180+0000","last_undegraded":"2024-04-19T03:01:15.022180+0000","last_fullsized":"2024-04-19T03:01:15.022180+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:09:23.427311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-19T03:01:18.092387+0000","last_change":"2024-04-19T03:01:15.018526+0000","last_active":"2024-04-19T03:01:18.092387+0000","last_peered":"2024-04-19T03:01:18.092387+0000","last_clean":"2024-04-19T03:01:18.092387+0000","last_became_active":"2024-04-19T03:01:15.018268+0000","last_became_peered":"2024-04-19T03:01:15.018268+0000","last_unstale":"2024-04-19T03:01:18.092387+0000","last_undegraded":"2024-04-19T03:01:18.092387+0000","last_fullsized":"2024-04-19T03:01:18.092387+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:17:52.453165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.023176+0000","last_change":"2024-04-19T03:01:15.018499+0000","last_active":"2024-04-19T03:01:15.023176+0000","last_peered":"2024-04-19T03:01:15.023176+0000","last_clean":"2024-04-19T03:01:15.023176+0000","last_became_active":"2024-04-19T03:01:15.017894+0000","last_became_peered":"2024-04-19T03:01:15.017894+0000","last_unstale":"2024-04-19T03:01:15.023176+0000","last_undegraded":"2024-04-19T03:01:15.023176+0000","last_fullsized":"2024-04-19T03:01:15.023176+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:10:21.967941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.019491+0000","last_change":"2024-04-19T03:01:15.017525+0000","last_active":"2024-04-19T03:01:15.019491+0000","last_peered":"2024-04-19T03:01:15.019491+0000","last_clean":"2024-04-19T03:01:15.019491+0000","last_became_active":"2024-04-19T03:01:15.016887+0000","last_became_peered":"2024-04-19T03:01:15.016887+0000","last_unstale":"2024-04-19T03:01:15.019491+0000","last_undegraded":"2024-04-19T03:01:15.019491+0000","last_fullsized":"2024-04-19T03:01:15.019491+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:10:56.732208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.023561+0000","last_change":"2024-04-19T03:01:15.020240+0000","last_active":"2024-04-19T03:01:15.023561+0000","last_peered":"2024-04-19T03:01:15.023561+0000","last_clean":"2024-04-19T03:01:15.023561+0000","last_became_active":"2024-04-19T03:01:15.019820+0000","last_became_peered":"2024-04-19T03:01:15.019820+0000","last_unstale":"2024-04-19T03:01:15.023561+0000","last_undegraded":"2024-04-19T03:01:15.023561+0000","last_fullsized":"2024-04-19T03:01:15.023561+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:09:23.427311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.023234+0000","last_change":"2024-04-19T03:01:15.018712+0000","last_active":"2024-04-19T03:01:15.023234+0000","last_peered":"2024-04-19T03:01:15.023234+0000","last_clean":"2024-04-19T03:01:15.023234+0000","last_became_active":"2024-04-19T03:01:15.017970+0000","last_became_peered":"2024-04-19T03:01:15.017970+0000","last_unstale":"2024-04-19T03:01:15.023234+0000","last_undegraded":"2024-04-19T03:01:15.023234+0000","last_fullsized":"2024-04-19T03:01:15.023234+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:07:57.843767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.013382+0000","last_change":"2024-04-19T03:01:15.010960+0000","last_active":"2024-04-19T03:01:15.013382+0000","last_peered":"2024-04-19T03:01:15.013382+0000","last_clean":"2024-04-19T03:01:15.013382+0000","last_became_active":"2024-04-19T03:01:15.010472+0000","last_became_peered":"2024-04-19T03:01:15.010472+0000","last_unstale":"2024-04-19T03:01:15.013382+0000","last_undegraded":"2024-04-19T03:01:15.013382+0000","last_fullsized":"2024-04-19T03:01:15.013382+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:21:36.129346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.017090+0000","last_change":"2024-04-19T03:01:15.014574+0000","last_active":"2024-04-19T03:01:15.017090+0000","last_peered":"2024-04-19T03:01:15.017090+0000","last_clean":"2024-04-19T03:01:15.017090+0000","last_became_active":"2024-04-19T03:01:15.014096+0000","last_became_peered":"2024-04-19T03:01:15.014096+0000","last_unstale":"2024-04-19T03:01:15.017090+0000","last_undegraded":"2024-04-19T03:01:15.017090+0000","last_fullsized":"2024-04-19T03:01:15.017090+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:01:54.253963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.022131+0000","last_change":"2024-04-19T03:01:15.018778+0000","last_active":"2024-04-19T03:01:15.022131+0000","last_peered":"2024-04-19T03:01:15.022131+0000","last_clean":"2024-04-19T03:01:15.022131+0000","last_became_active":"2024-04-19T03:01:15.016809+0000","last_became_peered":"2024-04-19T03:01:15.016809+0000","last_unstale":"2024-04-19T03:01:15.022131+0000","last_undegraded":"2024-04-19T03:01:15.022131+0000","last_fullsized":"2024-04-19T03:01:15.022131+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:40:59.453079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-19T03:01:18.093156+0000","last_change":"2024-04-19T03:01:15.011516+0000","last_active":"2024-04-19T03:01:18.093156+0000","last_peered":"2024-04-19T03:01:18.093156+0000","last_clean":"2024-04-19T03:01:18.093156+0000","last_became_active":"2024-04-19T03:01:15.011056+0000","last_became_peered":"2024-04-19T03:01:15.011056+0000","last_unstale":"2024-04-19T03:01:18.093156+0000","last_undegraded":"2024-04-19T03:01:18.093156+0000","last_fullsized":"2024-04-19T03:01:18.093156+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:35:50.354787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.022947+0000","last_change":"2024-04-19T03:01:15.017257+0000","last_active":"2024-04-19T03:01:15.022947+0000","last_peered":"2024-04-19T03:01:15.022947+0000","last_clean":"2024-04-19T03:01:15.022947+0000","last_became_active":"2024-04-19T03:01:15.016062+0000","last_became_peered":"2024-04-19T03:01:15.016062+0000","last_unstale":"2024-04-19T03:01:15.022947+0000","last_undegraded":"2024-04-19T03:01:15.022947+0000","last_fullsized":"2024-04-19T03:01:15.022947+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:40:20.790332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-19T03:01:18.092291+0000","last_change":"2024-04-19T03:01:15.011065+0000","last_active":"2024-04-19T03:01:18.092291+0000","last_peered":"2024-04-19T03:01:18.092291+0000","last_clean":"2024-04-19T03:01:18.092291+0000","last_became_active":"2024-04-19T03:01:15.010330+0000","last_became_peered":"2024-04-19T03:01:15.010330+0000","last_unstale":"2024-04-19T03:01:18.092291+0000","last_undegraded":"2024-04-19T03:01:18.092291+0000","last_fullsized":"2024-04-19T03:01:18.092291+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:56:10.495533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.021464+0000","last_change":"2024-04-19T03:01:15.017812+0000","last_active":"2024-04-19T03:01:15.021464+0000","last_peered":"2024-04-19T03:01:15.021464+0000","last_clean":"2024-04-19T03:01:15.021464+0000","last_became_active":"2024-04-19T03:01:15.016891+0000","last_became_peered":"2024-04-19T03:01:15.016891+0000","last_unstale":"2024-04-19T03:01:15.021464+0000","last_undegraded":"2024-04-19T03:01:15.021464+0000","last_fullsized":"2024-04-19T03:01:15.021464+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:39:54.289444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.024134+0000","last_change":"2024-04-19T03:01:15.019143+0000","last_active":"2024-04-19T03:01:15.024134+0000","last_peered":"2024-04-19T03:01:15.024134+0000","last_clean":"2024-04-19T03:01:15.024134+0000","last_became_active":"2024-04-19T03:01:15.017757+0000","last_became_peered":"2024-04-19T03:01:15.017757+0000","last_unstale":"2024-04-19T03:01:15.024134+0000","last_undegraded":"2024-04-19T03:01:15.024134+0000","last_fullsized":"2024-04-19T03:01:15.024134+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:10:21.967941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.023544+0000","last_change":"2024-04-19T03:01:15.020108+0000","last_active":"2024-04-19T03:01:15.023544+0000","last_peered":"2024-04-19T03:01:15.023544+0000","last_clean":"2024-04-19T03:01:15.023544+0000","last_became_active":"2024-04-19T03:01:15.018978+0000","last_became_peered":"2024-04-19T03:01:15.018978+0000","last_unstale":"2024-04-19T03:01:15.023544+0000","last_undegraded":"2024-04-19T03:01:15.023544+0000","last_fullsized":"2024-04-19T03:01:15.023544+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:30:22.360053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-19T03:01:18.090964+0000","last_change":"2024-04-19T03:01:15.016877+0000","last_active":"2024-04-19T03:01:18.090964+0000","last_peered":"2024-04-19T03:01:18.090964+0000","last_clean":"2024-04-19T03:01:18.090964+0000","last_became_active":"2024-04-19T03:01:15.016245+0000","last_became_peered":"2024-04-19T03:01:15.016245+0000","last_unstale":"2024-04-19T03:01:18.090964+0000","last_undegraded":"2024-04-19T03:01:18.090964+0000","last_fullsized":"2024-04-19T03:01:18.090964+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:38:07.846380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.023272+0000","last_change":"2024-04-19T03:01:15.018809+0000","last_active":"2024-04-19T03:01:15.023272+0000","last_peered":"2024-04-19T03:01:15.023272+0000","last_clean":"2024-04-19T03:01:15.023272+0000","last_became_active":"2024-04-19T03:01:15.017549+0000","last_became_peered":"2024-04-19T03:01:15.017549+0000","last_unstale":"2024-04-19T03:01:15.023272+0000","last_undegraded":"2024-04-19T03:01:15.023272+0000","last_fullsized":"2024-04-19T03:01:15.023272+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:37:35.950318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.023709+0000","last_change":"2024-04-19T03:01:15.020443+0000","last_active":"2024-04-19T03:01:15.023709+0000","last_peered":"2024-04-19T03:01:15.023709+0000","last_clean":"2024-04-19T03:01:15.023709+0000","last_became_active":"2024-04-19T03:01:15.018780+0000","last_became_peered":"2024-04-19T03:01:15.018780+0000","last_unstale":"2024-04-19T03:01:15.023709+0000","last_undegraded":"2024-04-19T03:01:15.023709+0000","last_fullsized":"2024-04-19T03:01:15.023709+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:56:44.307812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-19T03:01:18.093128+0000","last_change":"2024-04-19T03:01:15.017487+0000","last_active":"2024-04-19T03:01:18.093128+0000","last_peered":"2024-04-19T03:01:18.093128+0000","last_clean":"2024-04-19T03:01:18.093128+0000","last_became_active":"2024-04-19T03:01:15.016183+0000","last_became_peered":"2024-04-19T03:01:15.016183+0000","last_unstale":"2024-04-19T03:01:18.093128+0000","last_undegraded":"2024-04-19T03:01:18.093128+0000","last_fullsized":"2024-04-19T03:01:18.093128+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:44:37.487013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.018261+0000","last_change":"2024-04-19T03:01:15.016117+0000","last_active":"2024-04-19T03:01:15.018261+0000","last_peered":"2024-04-19T03:01:15.018261+0000","last_clean":"2024-04-19T03:01:15.018261+0000","last_became_active":"2024-04-19T03:01:15.015415+0000","last_became_peered":"2024-04-19T03:01:15.015415+0000","last_unstale":"2024-04-19T03:01:15.018261+0000","last_undegraded":"2024-04-19T03:01:15.018261+0000","last_fullsized":"2024-04-19T03:01:15.018261+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:06:35.813797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.023502+0000","last_change":"2024-04-19T03:01:15.020098+0000","last_active":"2024-04-19T03:01:15.023502+0000","last_peered":"2024-04-19T03:01:15.023502+0000","last_clean":"2024-04-19T03:01:15.023502+0000","last_became_active":"2024-04-19T03:01:15.019064+0000","last_became_peered":"2024-04-19T03:01:15.019064+0000","last_unstale":"2024-04-19T03:01:15.023502+0000","last_undegraded":"2024-04-19T03:01:15.023502+0000","last_fullsized":"2024-04-19T03:01:15.023502+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:50:06.490191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-19T03:01:18.092158+0000","last_change":"2024-04-19T03:01:15.013746+0000","last_active":"2024-04-19T03:01:18.092158+0000","last_peered":"2024-04-19T03:01:18.092158+0000","last_clean":"2024-04-19T03:01:18.092158+0000","last_became_active":"2024-04-19T03:01:15.011865+0000","last_became_peered":"2024-04-19T03:01:15.011865+0000","last_unstale":"2024-04-19T03:01:18.092158+0000","last_undegraded":"2024-04-19T03:01:18.092158+0000","last_fullsized":"2024-04-19T03:01:18.092158+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:32:23.606804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.023434+0000","last_change":"2024-04-19T03:01:15.019787+0000","last_active":"2024-04-19T03:01:15.023434+0000","last_peered":"2024-04-19T03:01:15.023434+0000","last_clean":"2024-04-19T03:01:15.023434+0000","last_became_active":"2024-04-19T03:01:15.018350+0000","last_became_peered":"2024-04-19T03:01:15.018350+0000","last_unstale":"2024-04-19T03:01:15.023434+0000","last_undegraded":"2024-04-19T03:01:15.023434+0000","last_fullsized":"2024-04-19T03:01:15.023434+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:10:42.079294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-19T03:01:18.090924+0000","last_change":"2024-04-19T03:01:15.012900+0000","last_active":"2024-04-19T03:01:18.090924+0000","last_peered":"2024-04-19T03:01:18.090924+0000","last_clean":"2024-04-19T03:01:18.090924+0000","last_became_active":"2024-04-19T03:01:15.012416+0000","last_became_peered":"2024-04-19T03:01:15.012416+0000","last_unstale":"2024-04-19T03:01:18.090924+0000","last_undegraded":"2024-04-19T03:01:18.090924+0000","last_fullsized":"2024-04-19T03:01:18.090924+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:57:14.847455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.024190+0000","last_change":"2024-04-19T03:01:15.019278+0000","last_active":"2024-04-19T03:01:15.024190+0000","last_peered":"2024-04-19T03:01:15.024190+0000","last_clean":"2024-04-19T03:01:15.024190+0000","last_became_active":"2024-04-19T03:01:15.017779+0000","last_became_peered":"2024-04-19T03:01:15.017779+0000","last_unstale":"2024-04-19T03:01:15.024190+0000","last_undegraded":"2024-04-19T03:01:15.024190+0000","last_fullsized":"2024-04-19T03:01:15.024190+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:54:54.463918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.022801+0000","last_change":"2024-04-19T03:01:15.016669+0000","last_active":"2024-04-19T03:01:15.022801+0000","last_peered":"2024-04-19T03:01:15.022801+0000","last_clean":"2024-04-19T03:01:15.022801+0000","last_became_active":"2024-04-19T03:01:15.016286+0000","last_became_peered":"2024-04-19T03:01:15.016286+0000","last_unstale":"2024-04-19T03:01:15.022801+0000","last_undegraded":"2024-04-19T03:01:15.022801+0000","last_fullsized":"2024-04-19T03:01:15.022801+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:55:34.102680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"20'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.019438+0000","last_change":"2024-04-19T03:01:14.651050+0000","last_active":"2024-04-19T03:01:15.019438+0000","last_peered":"2024-04-19T03:01:15.019438+0000","last_clean":"2024-04-19T03:01:15.019438+0000","last_became_active":"2024-04-19T03:01:14.650679+0000","last_became_peered":"2024-04-19T03:01:14.650679+0000","last_unstale":"2024-04-19T03:01:15.019438+0000","last_undegraded":"2024-04-19T03:01:15.019438+0000","last_fullsized":"2024-04-19T03:01:15.019438+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:37:03.684394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.022892+0000","last_change":"2024-04-19T03:01:15.017124+0000","last_active":"2024-04-19T03:01:15.022892+0000","last_peered":"2024-04-19T03:01:15.022892+0000","last_clean":"2024-04-19T03:01:15.022892+0000","last_became_active":"2024-04-19T03:01:15.016535+0000","last_became_peered":"2024-04-19T03:01:15.016535+0000","last_unstale":"2024-04-19T03:01:15.022892+0000","last_undegraded":"2024-04-19T03:01:15.022892+0000","last_fullsized":"2024-04-19T03:01:15.022892+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:40:12.179703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.002737+0000","last_change":"2024-04-19T03:01:14.646594+0000","last_active":"2024-04-19T03:01:15.002737+0000","last_peered":"2024-04-19T03:01:15.002737+0000","last_clean":"2024-04-19T03:01:15.002737+0000","last_became_active":"2024-04-19T03:01:14.646122+0000","last_became_peered":"2024-04-19T03:01:14.646122+0000","last_unstale":"2024-04-19T03:01:15.002737+0000","last_undegraded":"2024-04-19T03:01:15.002737+0000","last_fullsized":"2024-04-19T03:01:15.002737+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:40:53.463388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-19T03:01:18.093362+0000","last_change":"2024-04-19T03:01:15.017420+0000","last_active":"2024-04-19T03:01:18.093362+0000","last_peered":"2024-04-19T03:01:18.093362+0000","last_clean":"2024-04-19T03:01:18.093362+0000","last_became_active":"2024-04-19T03:01:15.015840+0000","last_became_peered":"2024-04-19T03:01:15.015840+0000","last_unstale":"2024-04-19T03:01:18.093362+0000","last_undegraded":"2024-04-19T03:01:18.093362+0000","last_fullsized":"2024-04-19T03:01:18.093362+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:05:05.266293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.004873+0000","last_change":"2024-04-19T03:01:14.649074+0000","last_active":"2024-04-19T03:01:15.004873+0000","last_peered":"2024-04-19T03:01:15.004873+0000","last_clean":"2024-04-19T03:01:15.004873+0000","last_became_active":"2024-04-19T03:01:14.648217+0000","last_became_peered":"2024-04-19T03:01:14.648217+0000","last_unstale":"2024-04-19T03:01:15.004873+0000","last_undegraded":"2024-04-19T03:01:15.004873+0000","last_fullsized":"2024-04-19T03:01:15.004873+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:57:05.238043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-19T03:01:18.092638+0000","last_change":"2024-04-19T03:01:15.017136+0000","last_active":"2024-04-19T03:01:18.092638+0000","last_peered":"2024-04-19T03:01:18.092638+0000","last_clean":"2024-04-19T03:01:18.092638+0000","last_became_active":"2024-04-19T03:01:15.016550+0000","last_became_peered":"2024-04-19T03:01:15.016550+0000","last_unstale":"2024-04-19T03:01:18.092638+0000","last_undegraded":"2024-04-19T03:01:18.092638+0000","last_fullsized":"2024-04-19T03:01:18.092638+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:55:37.697481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"20'8","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.023332+0000","last_change":"2024-04-19T03:01:14.649044+0000","last_active":"2024-04-19T03:01:15.023332+0000","last_peered":"2024-04-19T03:01:15.023332+0000","last_clean":"2024-04-19T03:01:15.023332+0000","last_became_active":"2024-04-19T03:01:14.648859+0000","last_became_peered":"2024-04-19T03:01:14.648859+0000","last_unstale":"2024-04-19T03:01:15.023332+0000","last_undegraded":"2024-04-19T03:01:15.023332+0000","last_fullsized":"2024-04-19T03:01:15.023332+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:30:45.925657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"20'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.015096+0000","last_change":"2024-04-19T03:01:14.649839+0000","last_active":"2024-04-19T03:01:15.015096+0000","last_peered":"2024-04-19T03:01:15.015096+0000","last_clean":"2024-04-19T03:01:15.015096+0000","last_became_active":"2024-04-19T03:01:14.649571+0000","last_became_peered":"2024-04-19T03:01:14.649571+0000","last_unstale":"2024-04-19T03:01:15.015096+0000","last_undegraded":"2024-04-19T03:01:15.015096+0000","last_fullsized":"2024-04-19T03:01:15.015096+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:03:57.839660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.023786+0000","last_change":"2024-04-19T03:01:15.021047+0000","last_active":"2024-04-19T03:01:15.023786+0000","last_peered":"2024-04-19T03:01:15.023786+0000","last_clean":"2024-04-19T03:01:15.023786+0000","last_became_active":"2024-04-19T03:01:15.019792+0000","last_became_peered":"2024-04-19T03:01:15.019792+0000","last_unstale":"2024-04-19T03:01:15.023786+0000","last_undegraded":"2024-04-19T03:01:15.023786+0000","last_fullsized":"2024-04-19T03:01:15.023786+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:54:54.463918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"20'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.019933+0000","last_change":"2024-04-19T03:01:14.645075+0000","last_active":"2024-04-19T03:01:15.019933+0000","last_peered":"2024-04-19T03:01:15.019933+0000","last_clean":"2024-04-19T03:01:15.019933+0000","last_became_active":"2024-04-19T03:01:14.644790+0000","last_became_peered":"2024-04-19T03:01:14.644790+0000","last_unstale":"2024-04-19T03:01:15.019933+0000","last_undegraded":"2024-04-19T03:01:15.019933+0000","last_fullsized":"2024-04-19T03:01:15.019933+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:55:15.035769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.021374+0000","last_change":"2024-04-19T03:01:15.016330+0000","last_active":"2024-04-19T03:01:15.021374+0000","last_peered":"2024-04-19T03:01:15.021374+0000","last_clean":"2024-04-19T03:01:15.021374+0000","last_became_active":"2024-04-19T03:01:15.015644+0000","last_became_peered":"2024-04-19T03:01:15.015644+0000","last_unstale":"2024-04-19T03:01:15.021374+0000","last_undegraded":"2024-04-19T03:01:15.021374+0000","last_fullsized":"2024-04-19T03:01:15.021374+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:13:06.902769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"20'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.015911+0000","last_change":"2024-04-19T03:01:14.649826+0000","last_active":"2024-04-19T03:01:15.015911+0000","last_peered":"2024-04-19T03:01:15.015911+0000","last_clean":"2024-04-19T03:01:15.015911+0000","last_became_active":"2024-04-19T03:01:14.649565+0000","last_became_peered":"2024-04-19T03:01:14.649565+0000","last_unstale":"2024-04-19T03:01:15.015911+0000","last_undegraded":"2024-04-19T03:01:15.015911+0000","last_fullsized":"2024-04-19T03:01:15.015911+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:36:00.962931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.021994+0000","last_change":"2024-04-19T03:01:15.018099+0000","last_active":"2024-04-19T03:01:15.021994+0000","last_peered":"2024-04-19T03:01:15.021994+0000","last_clean":"2024-04-19T03:01:15.021994+0000","last_became_active":"2024-04-19T03:01:15.017536+0000","last_became_peered":"2024-04-19T03:01:15.017536+0000","last_unstale":"2024-04-19T03:01:15.021994+0000","last_undegraded":"2024-04-19T03:01:15.021994+0000","last_fullsized":"2024-04-19T03:01:15.021994+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:50:06.490191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.006366+0000","last_change":"2024-04-19T03:01:14.651201+0000","last_active":"2024-04-19T03:01:15.006366+0000","last_peered":"2024-04-19T03:01:15.006366+0000","last_clean":"2024-04-19T03:01:15.006366+0000","last_became_active":"2024-04-19T03:01:14.650942+0000","last_became_peered":"2024-04-19T03:01:14.650942+0000","last_unstale":"2024-04-19T03:01:15.006366+0000","last_undegraded":"2024-04-19T03:01:15.006366+0000","last_fullsized":"2024-04-19T03:01:15.006366+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:02:13.190917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-19T03:01:18.092211+0000","last_change":"2024-04-19T03:01:15.017458+0000","last_active":"2024-04-19T03:01:18.092211+0000","last_peered":"2024-04-19T03:01:18.092211+0000","last_clean":"2024-04-19T03:01:18.092211+0000","last_became_active":"2024-04-19T03:01:15.016653+0000","last_became_peered":"2024-04-19T03:01:15.016653+0000","last_unstale":"2024-04-19T03:01:18.092211+0000","last_undegraded":"2024-04-19T03:01:18.092211+0000","last_fullsized":"2024-04-19T03:01:18.092211+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:52:28.671365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"20'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.016958+0000","last_change":"2024-04-19T03:01:14.647553+0000","last_active":"2024-04-19T03:01:15.016958+0000","last_peered":"2024-04-19T03:01:15.016958+0000","last_clean":"2024-04-19T03:01:15.016958+0000","last_became_active":"2024-04-19T03:01:14.647147+0000","last_became_peered":"2024-04-19T03:01:14.647147+0000","last_unstale":"2024-04-19T03:01:15.016958+0000","last_undegraded":"2024-04-19T03:01:15.016958+0000","last_fullsized":"2024-04-19T03:01:15.016958+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:33:45.550646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.021494+0000","last_change":"2024-04-19T03:01:15.018012+0000","last_active":"2024-04-19T03:01:15.021494+0000","last_peered":"2024-04-19T03:01:15.021494+0000","last_clean":"2024-04-19T03:01:15.021494+0000","last_became_active":"2024-04-19T03:01:15.017086+0000","last_became_peered":"2024-04-19T03:01:15.017086+0000","last_unstale":"2024-04-19T03:01:15.021494+0000","last_undegraded":"2024-04-19T03:01:15.021494+0000","last_fullsized":"2024-04-19T03:01:15.021494+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:54:04.518505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.001920+0000","last_change":"2024-04-19T03:01:14.651004+0000","last_active":"2024-04-19T03:01:15.001920+0000","last_peered":"2024-04-19T03:01:15.001920+0000","last_clean":"2024-04-19T03:01:15.001920+0000","last_became_active":"2024-04-19T03:01:14.650635+0000","last_became_peered":"2024-04-19T03:01:14.650635+0000","last_unstale":"2024-04-19T03:01:15.001920+0000","last_undegraded":"2024-04-19T03:01:15.001920+0000","last_fullsized":"2024-04-19T03:01:15.001920+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:57:15.575819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.018174+0000","last_change":"2024-04-19T03:01:15.015685+0000","last_active":"2024-04-19T03:01:15.018174+0000","last_peered":"2024-04-19T03:01:15.018174+0000","last_clean":"2024-04-19T03:01:15.018174+0000","last_became_active":"2024-04-19T03:01:15.014847+0000","last_became_peered":"2024-04-19T03:01:15.014847+0000","last_unstale":"2024-04-19T03:01:15.018174+0000","last_undegraded":"2024-04-19T03:01:15.018174+0000","last_fullsized":"2024-04-19T03:01:15.018174+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:51:06.208551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.005141+0000","last_change":"2024-04-19T03:01:14.644582+0000","last_active":"2024-04-19T03:01:15.005141+0000","last_peered":"2024-04-19T03:01:15.005141+0000","last_clean":"2024-04-19T03:01:15.005141+0000","last_became_active":"2024-04-19T03:01:14.644101+0000","last_became_peered":"2024-04-19T03:01:14.644101+0000","last_unstale":"2024-04-19T03:01:15.005141+0000","last_undegraded":"2024-04-19T03:01:15.005141+0000","last_fullsized":"2024-04-19T03:01:15.005141+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:28:24.652864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.017755+0000","last_change":"2024-04-19T03:01:15.014818+0000","last_active":"2024-04-19T03:01:15.017755+0000","last_peered":"2024-04-19T03:01:15.017755+0000","last_clean":"2024-04-19T03:01:15.017755+0000","last_became_active":"2024-04-19T03:01:15.014421+0000","last_became_peered":"2024-04-19T03:01:15.014421+0000","last_unstale":"2024-04-19T03:01:15.017755+0000","last_undegraded":"2024-04-19T03:01:15.017755+0000","last_fullsized":"2024-04-19T03:01:15.017755+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:16:20.475837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.008183+0000","last_change":"2024-04-19T03:01:14.643840+0000","last_active":"2024-04-19T03:01:15.008183+0000","last_peered":"2024-04-19T03:01:15.008183+0000","last_clean":"2024-04-19T03:01:15.008183+0000","last_became_active":"2024-04-19T03:01:14.643503+0000","last_became_peered":"2024-04-19T03:01:14.643503+0000","last_unstale":"2024-04-19T03:01:15.008183+0000","last_undegraded":"2024-04-19T03:01:15.008183+0000","last_fullsized":"2024-04-19T03:01:15.008183+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:09:33.801275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-19T03:01:18.092763+0000","last_change":"2024-04-19T03:01:15.012607+0000","last_active":"2024-04-19T03:01:18.092763+0000","last_peered":"2024-04-19T03:01:18.092763+0000","last_clean":"2024-04-19T03:01:18.092763+0000","last_became_active":"2024-04-19T03:01:15.012152+0000","last_became_peered":"2024-04-19T03:01:15.012152+0000","last_unstale":"2024-04-19T03:01:18.092763+0000","last_undegraded":"2024-04-19T03:01:18.092763+0000","last_fullsized":"2024-04-19T03:01:18.092763+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:57:36.794409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"14'157","reported_seq":212,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.004135+0000","last_change":"2024-04-19T03:01:07.538434+0000","last_active":"2024-04-19T03:01:15.004135+0000","last_peered":"2024-04-19T03:01:15.004135+0000","last_clean":"2024-04-19T03:01:15.004135+0000","last_became_active":"2024-04-19T03:01:07.537856+0000","last_became_peered":"2024-04-19T03:01:07.537856+0000","last_unstale":"2024-04-19T03:01:15.004135+0000","last_undegraded":"2024-04-19T03:01:15.004135+0000","last_fullsized":"2024-04-19T03:01:15.004135+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:06.516863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:06.516863+0000","last_clean_scrub_stamp":"2024-04-19T03:01:06.516863+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:36:46.386286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.006445+0000","last_change":"2024-04-19T03:01:10.602869+0000","last_active":"2024-04-19T03:01:15.006445+0000","last_peered":"2024-04-19T03:01:15.006445+0000","last_clean":"2024-04-19T03:01:15.006445+0000","last_became_active":"2024-04-19T03:01:10.601965+0000","last_became_peered":"2024-04-19T03:01:10.601965+0000","last_unstale":"2024-04-19T03:01:15.006445+0000","last_undegraded":"2024-04-19T03:01:15.006445+0000","last_fullsized":"2024-04-19T03:01:15.006445+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_clean_scrub_stamp":"2024-04-19T03:01:09.578660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:14:41.316871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.001643+0000","last_change":"2024-04-19T03:01:14.643201+0000","last_active":"2024-04-19T03:01:15.001643+0000","last_peered":"2024-04-19T03:01:15.001643+0000","last_clean":"2024-04-19T03:01:15.001643+0000","last_became_active":"2024-04-19T03:01:14.642885+0000","last_became_peered":"2024-04-19T03:01:14.642885+0000","last_unstale":"2024-04-19T03:01:15.001643+0000","last_undegraded":"2024-04-19T03:01:15.001643+0000","last_fullsized":"2024-04-19T03:01:15.001643+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:24:40.181164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.019181+0000","last_change":"2024-04-19T03:01:15.016104+0000","last_active":"2024-04-19T03:01:15.019181+0000","last_peered":"2024-04-19T03:01:15.019181+0000","last_clean":"2024-04-19T03:01:15.019181+0000","last_became_active":"2024-04-19T03:01:15.015386+0000","last_became_peered":"2024-04-19T03:01:15.015386+0000","last_unstale":"2024-04-19T03:01:15.019181+0000","last_undegraded":"2024-04-19T03:01:15.019181+0000","last_fullsized":"2024-04-19T03:01:15.019181+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:00:35.372657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.003912+0000","last_change":"2024-04-19T03:01:10.602194+0000","last_active":"2024-04-19T03:01:15.003912+0000","last_peered":"2024-04-19T03:01:15.003912+0000","last_clean":"2024-04-19T03:01:15.003912+0000","last_became_active":"2024-04-19T03:01:10.601381+0000","last_became_peered":"2024-04-19T03:01:10.601381+0000","last_unstale":"2024-04-19T03:01:15.003912+0000","last_undegraded":"2024-04-19T03:01:15.003912+0000","last_fullsized":"2024-04-19T03:01:15.003912+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_clean_scrub_stamp":"2024-04-19T03:01:09.578660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:42:26.594095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.003098+0000","last_change":"2024-04-19T03:01:14.647365+0000","last_active":"2024-04-19T03:01:15.003098+0000","last_peered":"2024-04-19T03:01:15.003098+0000","last_clean":"2024-04-19T03:01:15.003098+0000","last_became_active":"2024-04-19T03:01:14.646950+0000","last_became_peered":"2024-04-19T03:01:14.646950+0000","last_unstale":"2024-04-19T03:01:15.003098+0000","last_undegraded":"2024-04-19T03:01:15.003098+0000","last_fullsized":"2024-04-19T03:01:15.003098+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:41:26.108674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.023211+0000","last_change":"2024-04-19T03:01:15.018728+0000","last_active":"2024-04-19T03:01:15.023211+0000","last_peered":"2024-04-19T03:01:15.023211+0000","last_clean":"2024-04-19T03:01:15.023211+0000","last_became_active":"2024-04-19T03:01:15.017287+0000","last_became_peered":"2024-04-19T03:01:15.017287+0000","last_unstale":"2024-04-19T03:01:15.023211+0000","last_undegraded":"2024-04-19T03:01:15.023211+0000","last_fullsized":"2024-04-19T03:01:15.023211+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:54:04.518505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.003231+0000","last_change":"2024-04-19T03:01:10.600207+0000","last_active":"2024-04-19T03:01:15.003231+0000","last_peered":"2024-04-19T03:01:15.003231+0000","last_clean":"2024-04-19T03:01:15.003231+0000","last_became_active":"2024-04-19T03:01:10.599209+0000","last_became_peered":"2024-04-19T03:01:10.599209+0000","last_unstale":"2024-04-19T03:01:15.003231+0000","last_undegraded":"2024-04-19T03:01:15.003231+0000","last_fullsized":"2024-04-19T03:01:15.003231+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_clean_scrub_stamp":"2024-04-19T03:01:09.578660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:30:25.748140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.008341+0000","last_change":"2024-04-19T03:01:14.649068+0000","last_active":"2024-04-19T03:01:15.008341+0000","last_peered":"2024-04-19T03:01:15.008341+0000","last_clean":"2024-04-19T03:01:15.008341+0000","last_became_active":"2024-04-19T03:01:14.648082+0000","last_became_peered":"2024-04-19T03:01:14.648082+0000","last_unstale":"2024-04-19T03:01:15.008341+0000","last_undegraded":"2024-04-19T03:01:15.008341+0000","last_fullsized":"2024-04-19T03:01:15.008341+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:30:14.489117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-19T03:01:18.092872+0000","last_change":"2024-04-19T03:01:15.012147+0000","last_active":"2024-04-19T03:01:18.092872+0000","last_peered":"2024-04-19T03:01:18.092872+0000","last_clean":"2024-04-19T03:01:18.092872+0000","last_became_active":"2024-04-19T03:01:15.011421+0000","last_became_peered":"2024-04-19T03:01:15.011421+0000","last_unstale":"2024-04-19T03:01:18.092872+0000","last_undegraded":"2024-04-19T03:01:18.092872+0000","last_fullsized":"2024-04-19T03:01:18.092872+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:50:51.928641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.002185+0000","last_change":"2024-04-19T03:01:10.601386+0000","last_active":"2024-04-19T03:01:15.002185+0000","last_peered":"2024-04-19T03:01:15.002185+0000","last_clean":"2024-04-19T03:01:15.002185+0000","last_became_active":"2024-04-19T03:01:10.600732+0000","last_became_peered":"2024-04-19T03:01:10.600732+0000","last_unstale":"2024-04-19T03:01:15.002185+0000","last_undegraded":"2024-04-19T03:01:15.002185+0000","last_fullsized":"2024-04-19T03:01:15.002185+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_clean_scrub_stamp":"2024-04-19T03:01:09.578660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:34:53.138338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.006322+0000","last_change":"2024-04-19T03:01:14.651363+0000","last_active":"2024-04-19T03:01:15.006322+0000","last_peered":"2024-04-19T03:01:15.006322+0000","last_clean":"2024-04-19T03:01:15.006322+0000","last_became_active":"2024-04-19T03:01:14.651020+0000","last_became_peered":"2024-04-19T03:01:14.651020+0000","last_unstale":"2024-04-19T03:01:15.006322+0000","last_undegraded":"2024-04-19T03:01:15.006322+0000","last_fullsized":"2024-04-19T03:01:15.006322+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:44:36.043345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-19T03:01:18.092601+0000","last_change":"2024-04-19T03:01:15.017182+0000","last_active":"2024-04-19T03:01:18.092601+0000","last_peered":"2024-04-19T03:01:18.092601+0000","last_clean":"2024-04-19T03:01:18.092601+0000","last_became_active":"2024-04-19T03:01:15.016258+0000","last_became_peered":"2024-04-19T03:01:15.016258+0000","last_unstale":"2024-04-19T03:01:18.092601+0000","last_undegraded":"2024-04-19T03:01:18.092601+0000","last_fullsized":"2024-04-19T03:01:18.092601+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:27:25.351590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.004000+0000","last_change":"2024-04-19T03:01:14.651740+0000","last_active":"2024-04-19T03:01:15.004000+0000","last_peered":"2024-04-19T03:01:15.004000+0000","last_clean":"2024-04-19T03:01:15.004000+0000","last_became_active":"2024-04-19T03:01:14.651491+0000","last_became_peered":"2024-04-19T03:01:14.651491+0000","last_unstale":"2024-04-19T03:01:15.004000+0000","last_undegraded":"2024-04-19T03:01:15.004000+0000","last_fullsized":"2024-04-19T03:01:15.004000+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:42:15.864988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.006158+0000","last_change":"2024-04-19T03:01:10.601062+0000","last_active":"2024-04-19T03:01:15.006158+0000","last_peered":"2024-04-19T03:01:15.006158+0000","last_clean":"2024-04-19T03:01:15.006158+0000","last_became_active":"2024-04-19T03:01:10.600334+0000","last_became_peered":"2024-04-19T03:01:10.600334+0000","last_unstale":"2024-04-19T03:01:15.006158+0000","last_undegraded":"2024-04-19T03:01:15.006158+0000","last_fullsized":"2024-04-19T03:01:15.006158+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_clean_scrub_stamp":"2024-04-19T03:01:09.578660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:51:38.307752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.023683+0000","last_change":"2024-04-19T03:01:15.020501+0000","last_active":"2024-04-19T03:01:15.023683+0000","last_peered":"2024-04-19T03:01:15.023683+0000","last_clean":"2024-04-19T03:01:15.023683+0000","last_became_active":"2024-04-19T03:01:15.019019+0000","last_became_peered":"2024-04-19T03:01:15.019019+0000","last_unstale":"2024-04-19T03:01:15.023683+0000","last_undegraded":"2024-04-19T03:01:15.023683+0000","last_fullsized":"2024-04-19T03:01:15.023683+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:22:58.349159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.006058+0000","last_change":"2024-04-19T03:01:14.643098+0000","last_active":"2024-04-19T03:01:15.006058+0000","last_peered":"2024-04-19T03:01:15.006058+0000","last_clean":"2024-04-19T03:01:15.006058+0000","last_became_active":"2024-04-19T03:01:14.642789+0000","last_became_peered":"2024-04-19T03:01:14.642789+0000","last_unstale":"2024-04-19T03:01:15.006058+0000","last_undegraded":"2024-04-19T03:01:15.006058+0000","last_fullsized":"2024-04-19T03:01:15.006058+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:40:40.193720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.005646+0000","last_change":"2024-04-19T03:01:10.603139+0000","last_active":"2024-04-19T03:01:15.005646+0000","last_peered":"2024-04-19T03:01:15.005646+0000","last_clean":"2024-04-19T03:01:15.005646+0000","last_became_active":"2024-04-19T03:01:10.602397+0000","last_became_peered":"2024-04-19T03:01:10.602397+0000","last_unstale":"2024-04-19T03:01:15.005646+0000","last_undegraded":"2024-04-19T03:01:15.005646+0000","last_fullsized":"2024-04-19T03:01:15.005646+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_clean_scrub_stamp":"2024-04-19T03:01:09.578660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:36:00.072157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.023512+0000","last_change":"2024-04-19T03:01:15.020052+0000","last_active":"2024-04-19T03:01:15.023512+0000","last_peered":"2024-04-19T03:01:15.023512+0000","last_clean":"2024-04-19T03:01:15.023512+0000","last_became_active":"2024-04-19T03:01:15.019144+0000","last_became_peered":"2024-04-19T03:01:15.019144+0000","last_unstale":"2024-04-19T03:01:15.023512+0000","last_undegraded":"2024-04-19T03:01:15.023512+0000","last_fullsized":"2024-04-19T03:01:15.023512+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:39:54.289444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"20'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.019383+0000","last_change":"2024-04-19T03:01:14.643328+0000","last_active":"2024-04-19T03:01:15.019383+0000","last_peered":"2024-04-19T03:01:15.019383+0000","last_clean":"2024-04-19T03:01:15.019383+0000","last_became_active":"2024-04-19T03:01:14.643001+0000","last_became_peered":"2024-04-19T03:01:14.643001+0000","last_unstale":"2024-04-19T03:01:15.019383+0000","last_undegraded":"2024-04-19T03:01:15.019383+0000","last_fullsized":"2024-04-19T03:01:15.019383+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:28:14.128657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.006138+0000","last_change":"2024-04-19T03:01:10.599894+0000","last_active":"2024-04-19T03:01:15.006138+0000","last_peered":"2024-04-19T03:01:15.006138+0000","last_clean":"2024-04-19T03:01:15.006138+0000","last_became_active":"2024-04-19T03:01:10.599202+0000","last_became_peered":"2024-04-19T03:01:10.599202+0000","last_unstale":"2024-04-19T03:01:15.006138+0000","last_undegraded":"2024-04-19T03:01:15.006138+0000","last_fullsized":"2024-04-19T03:01:15.006138+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_clean_scrub_stamp":"2024-04-19T03:01:09.578660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:59:34.386302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-19T03:01:18.091060+0000","last_change":"2024-04-19T03:01:15.016429+0000","last_active":"2024-04-19T03:01:18.091060+0000","last_peered":"2024-04-19T03:01:18.091060+0000","last_clean":"2024-04-19T03:01:18.091060+0000","last_became_active":"2024-04-19T03:01:15.015945+0000","last_became_peered":"2024-04-19T03:01:15.015945+0000","last_unstale":"2024-04-19T03:01:18.091060+0000","last_undegraded":"2024-04-19T03:01:18.091060+0000","last_fullsized":"2024-04-19T03:01:18.091060+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:43:17.785352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"21'1","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-19T03:01:18.093734+0000","last_change":"2024-04-19T03:01:14.647170+0000","last_active":"2024-04-19T03:01:18.093734+0000","last_peered":"2024-04-19T03:01:18.093734+0000","last_clean":"2024-04-19T03:01:18.093734+0000","last_became_active":"2024-04-19T03:01:14.646622+0000","last_became_peered":"2024-04-19T03:01:14.646622+0000","last_unstale":"2024-04-19T03:01:18.093734+0000","last_undegraded":"2024-04-19T03:01:18.093734+0000","last_fullsized":"2024-04-19T03:01:18.093734+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:32:41.909038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.001377+0000","last_change":"2024-04-19T03:01:10.602274+0000","last_active":"2024-04-19T03:01:15.001377+0000","last_peered":"2024-04-19T03:01:15.001377+0000","last_clean":"2024-04-19T03:01:15.001377+0000","last_became_active":"2024-04-19T03:01:10.601487+0000","last_became_peered":"2024-04-19T03:01:10.601487+0000","last_unstale":"2024-04-19T03:01:15.001377+0000","last_undegraded":"2024-04-19T03:01:15.001377+0000","last_fullsized":"2024-04-19T03:01:15.001377+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_clean_scrub_stamp":"2024-04-19T03:01:09.578660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:26:16.712446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.023281+0000","last_change":"2024-04-19T03:01:15.018914+0000","last_active":"2024-04-19T03:01:15.023281+0000","last_peered":"2024-04-19T03:01:15.023281+0000","last_clean":"2024-04-19T03:01:15.023281+0000","last_became_active":"2024-04-19T03:01:15.018276+0000","last_became_peered":"2024-04-19T03:01:15.018276+0000","last_unstale":"2024-04-19T03:01:15.023281+0000","last_undegraded":"2024-04-19T03:01:15.023281+0000","last_fullsized":"2024-04-19T03:01:15.023281+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:40:59.453079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.018690+0000","last_change":"2024-04-19T03:01:15.015855+0000","last_active":"2024-04-19T03:01:15.018690+0000","last_peered":"2024-04-19T03:01:15.018690+0000","last_clean":"2024-04-19T03:01:15.018690+0000","last_became_active":"2024-04-19T03:01:15.015358+0000","last_became_peered":"2024-04-19T03:01:15.015358+0000","last_unstale":"2024-04-19T03:01:15.018690+0000","last_undegraded":"2024-04-19T03:01:15.018690+0000","last_fullsized":"2024-04-19T03:01:15.018690+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:59:49.270245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"20'6","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.029460+0000","last_change":"2024-04-19T03:01:14.649577+0000","last_active":"2024-04-19T03:01:15.029460+0000","last_peered":"2024-04-19T03:01:15.029460+0000","last_clean":"2024-04-19T03:01:15.029460+0000","last_became_active":"2024-04-19T03:01:14.649284+0000","last_became_peered":"2024-04-19T03:01:14.649284+0000","last_unstale":"2024-04-19T03:01:15.029460+0000","last_undegraded":"2024-04-19T03:01:15.029460+0000","last_fullsized":"2024-04-19T03:01:15.029460+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:01:22.214742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-19T03:01:18.091377+0000","last_change":"2024-04-19T03:01:15.013509+0000","last_active":"2024-04-19T03:01:18.091377+0000","last_peered":"2024-04-19T03:01:18.091377+0000","last_clean":"2024-04-19T03:01:18.091377+0000","last_became_active":"2024-04-19T03:01:15.012694+0000","last_became_peered":"2024-04-19T03:01:15.012694+0000","last_unstale":"2024-04-19T03:01:18.091377+0000","last_undegraded":"2024-04-19T03:01:18.091377+0000","last_fullsized":"2024-04-19T03:01:18.091377+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:13:47.056938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"20'3","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.019366+0000","last_change":"2024-04-19T03:01:14.648703+0000","last_active":"2024-04-19T03:01:15.019366+0000","last_peered":"2024-04-19T03:01:15.019366+0000","last_clean":"2024-04-19T03:01:15.019366+0000","last_became_active":"2024-04-19T03:01:14.648258+0000","last_became_peered":"2024-04-19T03:01:14.648258+0000","last_unstale":"2024-04-19T03:01:15.019366+0000","last_undegraded":"2024-04-19T03:01:15.019366+0000","last_fullsized":"2024-04-19T03:01:15.019366+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:30:35.593258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.001904+0000","last_change":"2024-04-19T03:01:14.651753+0000","last_active":"2024-04-19T03:01:15.001904+0000","last_peered":"2024-04-19T03:01:15.001904+0000","last_clean":"2024-04-19T03:01:15.001904+0000","last_became_active":"2024-04-19T03:01:14.651458+0000","last_became_peered":"2024-04-19T03:01:14.651458+0000","last_unstale":"2024-04-19T03:01:15.001904+0000","last_undegraded":"2024-04-19T03:01:15.001904+0000","last_fullsized":"2024-04-19T03:01:15.001904+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:58:28.669306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-19T03:01:18.091195+0000","last_change":"2024-04-19T03:01:15.016094+0000","last_active":"2024-04-19T03:01:18.091195+0000","last_peered":"2024-04-19T03:01:18.091195+0000","last_clean":"2024-04-19T03:01:18.091195+0000","last_became_active":"2024-04-19T03:01:15.015379+0000","last_became_peered":"2024-04-19T03:01:15.015379+0000","last_unstale":"2024-04-19T03:01:18.091195+0000","last_undegraded":"2024-04-19T03:01:18.091195+0000","last_fullsized":"2024-04-19T03:01:18.091195+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:42:11.854631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.006982+0000","last_change":"2024-04-19T03:01:14.647282+0000","last_active":"2024-04-19T03:01:15.006982+0000","last_peered":"2024-04-19T03:01:15.006982+0000","last_clean":"2024-04-19T03:01:15.006982+0000","last_became_active":"2024-04-19T03:01:14.646878+0000","last_became_peered":"2024-04-19T03:01:14.646878+0000","last_unstale":"2024-04-19T03:01:15.006982+0000","last_undegraded":"2024-04-19T03:01:15.006982+0000","last_fullsized":"2024-04-19T03:01:15.006982+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:22:38.096801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-19T03:01:18.090981+0000","last_change":"2024-04-19T03:01:15.013187+0000","last_active":"2024-04-19T03:01:18.090981+0000","last_peered":"2024-04-19T03:01:18.090981+0000","last_clean":"2024-04-19T03:01:18.090981+0000","last_became_active":"2024-04-19T03:01:15.011542+0000","last_became_peered":"2024-04-19T03:01:15.011542+0000","last_unstale":"2024-04-19T03:01:18.090981+0000","last_undegraded":"2024-04-19T03:01:18.090981+0000","last_fullsized":"2024-04-19T03:01:18.090981+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:53:13.646525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.023738+0000","last_change":"2024-04-19T03:01:15.020635+0000","last_active":"2024-04-19T03:01:15.023738+0000","last_peered":"2024-04-19T03:01:15.023738+0000","last_clean":"2024-04-19T03:01:15.023738+0000","last_became_active":"2024-04-19T03:01:15.019917+0000","last_became_peered":"2024-04-19T03:01:15.019917+0000","last_unstale":"2024-04-19T03:01:15.023738+0000","last_undegraded":"2024-04-19T03:01:15.023738+0000","last_fullsized":"2024-04-19T03:01:15.023738+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:40:53.477682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.005373+0000","last_change":"2024-04-19T03:01:14.643239+0000","last_active":"2024-04-19T03:01:15.005373+0000","last_peered":"2024-04-19T03:01:15.005373+0000","last_clean":"2024-04-19T03:01:15.005373+0000","last_became_active":"2024-04-19T03:01:14.642959+0000","last_became_peered":"2024-04-19T03:01:14.642959+0000","last_unstale":"2024-04-19T03:01:15.005373+0000","last_undegraded":"2024-04-19T03:01:15.005373+0000","last_fullsized":"2024-04-19T03:01:15.005373+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:05:36.752017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-19T03:01:18.092865+0000","last_change":"2024-04-19T03:01:15.017708+0000","last_active":"2024-04-19T03:01:18.092865+0000","last_peered":"2024-04-19T03:01:18.092865+0000","last_clean":"2024-04-19T03:01:18.092865+0000","last_became_active":"2024-04-19T03:01:15.016726+0000","last_became_peered":"2024-04-19T03:01:15.016726+0000","last_unstale":"2024-04-19T03:01:18.092865+0000","last_undegraded":"2024-04-19T03:01:18.092865+0000","last_fullsized":"2024-04-19T03:01:18.092865+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:07:47.395052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.003022+0000","last_change":"2024-04-19T03:01:14.647744+0000","last_active":"2024-04-19T03:01:15.003022+0000","last_peered":"2024-04-19T03:01:15.003022+0000","last_clean":"2024-04-19T03:01:15.003022+0000","last_became_active":"2024-04-19T03:01:14.647463+0000","last_became_peered":"2024-04-19T03:01:14.647463+0000","last_unstale":"2024-04-19T03:01:15.003022+0000","last_undegraded":"2024-04-19T03:01:15.003022+0000","last_fullsized":"2024-04-19T03:01:15.003022+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:56:15.348940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.023345+0000","last_change":"2024-04-19T03:01:15.019045+0000","last_active":"2024-04-19T03:01:15.023345+0000","last_peered":"2024-04-19T03:01:15.023345+0000","last_clean":"2024-04-19T03:01:15.023345+0000","last_became_active":"2024-04-19T03:01:15.017982+0000","last_became_peered":"2024-04-19T03:01:15.017982+0000","last_unstale":"2024-04-19T03:01:15.023345+0000","last_undegraded":"2024-04-19T03:01:15.023345+0000","last_fullsized":"2024-04-19T03:01:15.023345+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:10:56.732208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"20'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.020345+0000","last_change":"2024-04-19T03:01:14.651050+0000","last_active":"2024-04-19T03:01:15.020345+0000","last_peered":"2024-04-19T03:01:15.020345+0000","last_clean":"2024-04-19T03:01:15.020345+0000","last_became_active":"2024-04-19T03:01:14.650639+0000","last_became_peered":"2024-04-19T03:01:14.650639+0000","last_unstale":"2024-04-19T03:01:15.020345+0000","last_undegraded":"2024-04-19T03:01:15.020345+0000","last_fullsized":"2024-04-19T03:01:15.020345+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:41:49.783896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.022916+0000","last_change":"2024-04-19T03:01:15.017319+0000","last_active":"2024-04-19T03:01:15.022916+0000","last_peered":"2024-04-19T03:01:15.022916+0000","last_clean":"2024-04-19T03:01:15.022916+0000","last_became_active":"2024-04-19T03:01:15.016815+0000","last_became_peered":"2024-04-19T03:01:15.016815+0000","last_unstale":"2024-04-19T03:01:15.022916+0000","last_undegraded":"2024-04-19T03:01:15.022916+0000","last_fullsized":"2024-04-19T03:01:15.022916+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:36:36.363535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"20'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.018447+0000","last_change":"2024-04-19T03:01:14.648823+0000","last_active":"2024-04-19T03:01:15.018447+0000","last_peered":"2024-04-19T03:01:15.018447+0000","last_clean":"2024-04-19T03:01:15.018447+0000","last_became_active":"2024-04-19T03:01:14.648337+0000","last_became_peered":"2024-04-19T03:01:14.648337+0000","last_unstale":"2024-04-19T03:01:15.018447+0000","last_undegraded":"2024-04-19T03:01:15.018447+0000","last_fullsized":"2024-04-19T03:01:15.018447+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:08:46.250118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.018663+0000","last_change":"2024-04-19T03:01:15.014773+0000","last_active":"2024-04-19T03:01:15.018663+0000","last_peered":"2024-04-19T03:01:15.018663+0000","last_clean":"2024-04-19T03:01:15.018663+0000","last_became_active":"2024-04-19T03:01:15.013919+0000","last_became_peered":"2024-04-19T03:01:15.013919+0000","last_unstale":"2024-04-19T03:01:15.018663+0000","last_undegraded":"2024-04-19T03:01:15.018663+0000","last_fullsized":"2024-04-19T03:01:15.018663+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:56:44.307812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"20'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.018107+0000","last_change":"2024-04-19T03:01:14.651049+0000","last_active":"2024-04-19T03:01:15.018107+0000","last_peered":"2024-04-19T03:01:15.018107+0000","last_clean":"2024-04-19T03:01:15.018107+0000","last_became_active":"2024-04-19T03:01:14.650646+0000","last_became_peered":"2024-04-19T03:01:14.650646+0000","last_unstale":"2024-04-19T03:01:15.018107+0000","last_undegraded":"2024-04-19T03:01:15.018107+0000","last_fullsized":"2024-04-19T03:01:15.018107+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:33:59.716591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.022142+0000","last_change":"2024-04-19T03:01:15.017860+0000","last_active":"2024-04-19T03:01:15.022142+0000","last_peered":"2024-04-19T03:01:15.022142+0000","last_clean":"2024-04-19T03:01:15.022142+0000","last_became_active":"2024-04-19T03:01:15.017355+0000","last_became_peered":"2024-04-19T03:01:15.017355+0000","last_unstale":"2024-04-19T03:01:15.022142+0000","last_undegraded":"2024-04-19T03:01:15.022142+0000","last_fullsized":"2024-04-19T03:01:15.022142+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:13:06.902769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"20'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.022312+0000","last_change":"2024-04-19T03:01:14.649277+0000","last_active":"2024-04-19T03:01:15.022312+0000","last_peered":"2024-04-19T03:01:15.022312+0000","last_clean":"2024-04-19T03:01:15.022312+0000","last_became_active":"2024-04-19T03:01:14.648614+0000","last_became_peered":"2024-04-19T03:01:14.648614+0000","last_unstale":"2024-04-19T03:01:15.022312+0000","last_undegraded":"2024-04-19T03:01:15.022312+0000","last_fullsized":"2024-04-19T03:01:15.022312+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:34:05.922324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.023028+0000","last_change":"2024-04-19T03:01:15.017986+0000","last_active":"2024-04-19T03:01:15.023028+0000","last_peered":"2024-04-19T03:01:15.023028+0000","last_clean":"2024-04-19T03:01:15.023028+0000","last_became_active":"2024-04-19T03:01:15.017080+0000","last_became_peered":"2024-04-19T03:01:15.017080+0000","last_unstale":"2024-04-19T03:01:15.023028+0000","last_undegraded":"2024-04-19T03:01:15.023028+0000","last_fullsized":"2024-04-19T03:01:15.023028+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:14:57.922917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"20'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.019052+0000","last_change":"2024-04-19T03:01:14.644015+0000","last_active":"2024-04-19T03:01:15.019052+0000","last_peered":"2024-04-19T03:01:15.019052+0000","last_clean":"2024-04-19T03:01:15.019052+0000","last_became_active":"2024-04-19T03:01:14.643769+0000","last_became_peered":"2024-04-19T03:01:14.643769+0000","last_unstale":"2024-04-19T03:01:15.019052+0000","last_undegraded":"2024-04-19T03:01:15.019052+0000","last_fullsized":"2024-04-19T03:01:15.019052+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:56:05.481089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.024302+0000","last_change":"2024-04-19T03:01:15.019466+0000","last_active":"2024-04-19T03:01:15.024302+0000","last_peered":"2024-04-19T03:01:15.024302+0000","last_clean":"2024-04-19T03:01:15.024302+0000","last_became_active":"2024-04-19T03:01:15.018819+0000","last_became_peered":"2024-04-19T03:01:15.018819+0000","last_unstale":"2024-04-19T03:01:15.024302+0000","last_undegraded":"2024-04-19T03:01:15.024302+0000","last_fullsized":"2024-04-19T03:01:15.024302+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:13:26.030579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"20'4","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.020064+0000","last_change":"2024-04-19T03:01:14.647358+0000","last_active":"2024-04-19T03:01:15.020064+0000","last_peered":"2024-04-19T03:01:15.020064+0000","last_clean":"2024-04-19T03:01:15.020064+0000","last_became_active":"2024-04-19T03:01:14.646998+0000","last_became_peered":"2024-04-19T03:01:14.646998+0000","last_unstale":"2024-04-19T03:01:15.020064+0000","last_undegraded":"2024-04-19T03:01:15.020064+0000","last_fullsized":"2024-04-19T03:01:15.020064+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:09:04.022991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":14482,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":10,"seq":42949672971,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31380,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340460,"statfs":{"total":96636764160,"available":96604631040,"internally_reserved":0,"allocated":270336,"data_stored":654544,"data_compressed":7241,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54900000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65900000000000003}]}]},{"osd":1,"up_from":10,"seq":42949672970,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31372,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340468,"statfs":{"total":96636764160,"available":96604639232,"internally_reserved":0,"allocated":262144,"data_stored":653928,"data_compressed":7241,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53100000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69799999999999995}]}]},{"osd":0,"up_from":9,"seq":38654705673,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31300,"kb_used_data":184,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340540,"statfs":{"total":96636764160,"available":96604712960,"internally_reserved":0,"allocated":188416,"data_stored":62430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55400000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":7241,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":7241,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-19T03:01:33.955 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-19T03:01:34.266 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-19T03:01:34.268 INFO:teuthology.orchestra.run.smithi096.stderr:dumped all 2024-04-19T03:01:34.279 INFO:teuthology.orchestra.run.smithi096.stdout:{"pg_ready":true,"pg_map":{"version":32,"stamp":"2024-04-19T03:01:33.949286+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":94052,"kb_used_data":704,"kb_used_omap":4,"kb_used_meta":93307,"kb_avail":283021468,"statfs":{"total":289910292480,"available":289813983232,"internally_reserved":0,"allocated":720896,"data_stored":1370902,"data_compressed":14482,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":4782,"internal_metadata":95546706},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004159"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.023489+0000","last_change":"2024-04-19T03:01:15.019292+0000","last_active":"2024-04-19T03:01:15.023489+0000","last_peered":"2024-04-19T03:01:15.023489+0000","last_clean":"2024-04-19T03:01:15.023489+0000","last_became_active":"2024-04-19T03:01:15.017907+0000","last_became_peered":"2024-04-19T03:01:15.017907+0000","last_unstale":"2024-04-19T03:01:15.023489+0000","last_undegraded":"2024-04-19T03:01:15.023489+0000","last_fullsized":"2024-04-19T03:01:15.023489+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:13:26.030579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.023194+0000","last_change":"2024-04-19T03:01:15.018719+0000","last_active":"2024-04-19T03:01:15.023194+0000","last_peered":"2024-04-19T03:01:15.023194+0000","last_clean":"2024-04-19T03:01:15.023194+0000","last_became_active":"2024-04-19T03:01:15.018070+0000","last_became_peered":"2024-04-19T03:01:15.018070+0000","last_unstale":"2024-04-19T03:01:15.023194+0000","last_undegraded":"2024-04-19T03:01:15.023194+0000","last_fullsized":"2024-04-19T03:01:15.023194+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:48:13.389356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.018237+0000","last_change":"2024-04-19T03:01:15.015884+0000","last_active":"2024-04-19T03:01:15.018237+0000","last_peered":"2024-04-19T03:01:15.018237+0000","last_clean":"2024-04-19T03:01:15.018237+0000","last_became_active":"2024-04-19T03:01:15.014599+0000","last_became_peered":"2024-04-19T03:01:15.014599+0000","last_unstale":"2024-04-19T03:01:15.018237+0000","last_undegraded":"2024-04-19T03:01:15.018237+0000","last_fullsized":"2024-04-19T03:01:15.018237+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:35:19.436344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.018134+0000","last_change":"2024-04-19T03:01:15.015186+0000","last_active":"2024-04-19T03:01:15.018134+0000","last_peered":"2024-04-19T03:01:15.018134+0000","last_clean":"2024-04-19T03:01:15.018134+0000","last_became_active":"2024-04-19T03:01:15.014218+0000","last_became_peered":"2024-04-19T03:01:15.014218+0000","last_unstale":"2024-04-19T03:01:15.018134+0000","last_undegraded":"2024-04-19T03:01:15.018134+0000","last_fullsized":"2024-04-19T03:01:15.018134+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:30:22.360053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.023421+0000","last_change":"2024-04-19T03:01:15.019382+0000","last_active":"2024-04-19T03:01:15.023421+0000","last_peered":"2024-04-19T03:01:15.023421+0000","last_clean":"2024-04-19T03:01:15.023421+0000","last_became_active":"2024-04-19T03:01:15.017859+0000","last_became_peered":"2024-04-19T03:01:15.017859+0000","last_unstale":"2024-04-19T03:01:15.023421+0000","last_undegraded":"2024-04-19T03:01:15.023421+0000","last_fullsized":"2024-04-19T03:01:15.023421+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:31:51.982582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.019273+0000","last_change":"2024-04-19T03:01:15.016989+0000","last_active":"2024-04-19T03:01:15.019273+0000","last_peered":"2024-04-19T03:01:15.019273+0000","last_clean":"2024-04-19T03:01:15.019273+0000","last_became_active":"2024-04-19T03:01:15.016569+0000","last_became_peered":"2024-04-19T03:01:15.016569+0000","last_unstale":"2024-04-19T03:01:15.019273+0000","last_undegraded":"2024-04-19T03:01:15.019273+0000","last_fullsized":"2024-04-19T03:01:15.019273+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:22:58.349159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.019190+0000","last_change":"2024-04-19T03:01:15.016925+0000","last_active":"2024-04-19T03:01:15.019190+0000","last_peered":"2024-04-19T03:01:15.019190+0000","last_clean":"2024-04-19T03:01:15.019190+0000","last_became_active":"2024-04-19T03:01:15.016589+0000","last_became_peered":"2024-04-19T03:01:15.016589+0000","last_unstale":"2024-04-19T03:01:15.019190+0000","last_undegraded":"2024-04-19T03:01:15.019190+0000","last_fullsized":"2024-04-19T03:01:15.019190+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:48:13.389356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.022180+0000","last_change":"2024-04-19T03:01:15.018969+0000","last_active":"2024-04-19T03:01:15.022180+0000","last_peered":"2024-04-19T03:01:15.022180+0000","last_clean":"2024-04-19T03:01:15.022180+0000","last_became_active":"2024-04-19T03:01:15.016895+0000","last_became_peered":"2024-04-19T03:01:15.016895+0000","last_unstale":"2024-04-19T03:01:15.022180+0000","last_undegraded":"2024-04-19T03:01:15.022180+0000","last_fullsized":"2024-04-19T03:01:15.022180+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:09:23.427311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-19T03:01:18.092387+0000","last_change":"2024-04-19T03:01:15.018526+0000","last_active":"2024-04-19T03:01:18.092387+0000","last_peered":"2024-04-19T03:01:18.092387+0000","last_clean":"2024-04-19T03:01:18.092387+0000","last_became_active":"2024-04-19T03:01:15.018268+0000","last_became_peered":"2024-04-19T03:01:15.018268+0000","last_unstale":"2024-04-19T03:01:18.092387+0000","last_undegraded":"2024-04-19T03:01:18.092387+0000","last_fullsized":"2024-04-19T03:01:18.092387+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:17:52.453165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.023176+0000","last_change":"2024-04-19T03:01:15.018499+0000","last_active":"2024-04-19T03:01:15.023176+0000","last_peered":"2024-04-19T03:01:15.023176+0000","last_clean":"2024-04-19T03:01:15.023176+0000","last_became_active":"2024-04-19T03:01:15.017894+0000","last_became_peered":"2024-04-19T03:01:15.017894+0000","last_unstale":"2024-04-19T03:01:15.023176+0000","last_undegraded":"2024-04-19T03:01:15.023176+0000","last_fullsized":"2024-04-19T03:01:15.023176+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:10:21.967941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.019491+0000","last_change":"2024-04-19T03:01:15.017525+0000","last_active":"2024-04-19T03:01:15.019491+0000","last_peered":"2024-04-19T03:01:15.019491+0000","last_clean":"2024-04-19T03:01:15.019491+0000","last_became_active":"2024-04-19T03:01:15.016887+0000","last_became_peered":"2024-04-19T03:01:15.016887+0000","last_unstale":"2024-04-19T03:01:15.019491+0000","last_undegraded":"2024-04-19T03:01:15.019491+0000","last_fullsized":"2024-04-19T03:01:15.019491+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:10:56.732208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.023561+0000","last_change":"2024-04-19T03:01:15.020240+0000","last_active":"2024-04-19T03:01:15.023561+0000","last_peered":"2024-04-19T03:01:15.023561+0000","last_clean":"2024-04-19T03:01:15.023561+0000","last_became_active":"2024-04-19T03:01:15.019820+0000","last_became_peered":"2024-04-19T03:01:15.019820+0000","last_unstale":"2024-04-19T03:01:15.023561+0000","last_undegraded":"2024-04-19T03:01:15.023561+0000","last_fullsized":"2024-04-19T03:01:15.023561+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:09:23.427311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.023234+0000","last_change":"2024-04-19T03:01:15.018712+0000","last_active":"2024-04-19T03:01:15.023234+0000","last_peered":"2024-04-19T03:01:15.023234+0000","last_clean":"2024-04-19T03:01:15.023234+0000","last_became_active":"2024-04-19T03:01:15.017970+0000","last_became_peered":"2024-04-19T03:01:15.017970+0000","last_unstale":"2024-04-19T03:01:15.023234+0000","last_undegraded":"2024-04-19T03:01:15.023234+0000","last_fullsized":"2024-04-19T03:01:15.023234+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:07:57.843767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.013382+0000","last_change":"2024-04-19T03:01:15.010960+0000","last_active":"2024-04-19T03:01:15.013382+0000","last_peered":"2024-04-19T03:01:15.013382+0000","last_clean":"2024-04-19T03:01:15.013382+0000","last_became_active":"2024-04-19T03:01:15.010472+0000","last_became_peered":"2024-04-19T03:01:15.010472+0000","last_unstale":"2024-04-19T03:01:15.013382+0000","last_undegraded":"2024-04-19T03:01:15.013382+0000","last_fullsized":"2024-04-19T03:01:15.013382+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:21:36.129346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.017090+0000","last_change":"2024-04-19T03:01:15.014574+0000","last_active":"2024-04-19T03:01:15.017090+0000","last_peered":"2024-04-19T03:01:15.017090+0000","last_clean":"2024-04-19T03:01:15.017090+0000","last_became_active":"2024-04-19T03:01:15.014096+0000","last_became_peered":"2024-04-19T03:01:15.014096+0000","last_unstale":"2024-04-19T03:01:15.017090+0000","last_undegraded":"2024-04-19T03:01:15.017090+0000","last_fullsized":"2024-04-19T03:01:15.017090+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:01:54.253963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.022131+0000","last_change":"2024-04-19T03:01:15.018778+0000","last_active":"2024-04-19T03:01:15.022131+0000","last_peered":"2024-04-19T03:01:15.022131+0000","last_clean":"2024-04-19T03:01:15.022131+0000","last_became_active":"2024-04-19T03:01:15.016809+0000","last_became_peered":"2024-04-19T03:01:15.016809+0000","last_unstale":"2024-04-19T03:01:15.022131+0000","last_undegraded":"2024-04-19T03:01:15.022131+0000","last_fullsized":"2024-04-19T03:01:15.022131+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:40:59.453079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-19T03:01:18.093156+0000","last_change":"2024-04-19T03:01:15.011516+0000","last_active":"2024-04-19T03:01:18.093156+0000","last_peered":"2024-04-19T03:01:18.093156+0000","last_clean":"2024-04-19T03:01:18.093156+0000","last_became_active":"2024-04-19T03:01:15.011056+0000","last_became_peered":"2024-04-19T03:01:15.011056+0000","last_unstale":"2024-04-19T03:01:18.093156+0000","last_undegraded":"2024-04-19T03:01:18.093156+0000","last_fullsized":"2024-04-19T03:01:18.093156+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:35:50.354787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.022947+0000","last_change":"2024-04-19T03:01:15.017257+0000","last_active":"2024-04-19T03:01:15.022947+0000","last_peered":"2024-04-19T03:01:15.022947+0000","last_clean":"2024-04-19T03:01:15.022947+0000","last_became_active":"2024-04-19T03:01:15.016062+0000","last_became_peered":"2024-04-19T03:01:15.016062+0000","last_unstale":"2024-04-19T03:01:15.022947+0000","last_undegraded":"2024-04-19T03:01:15.022947+0000","last_fullsized":"2024-04-19T03:01:15.022947+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:40:20.790332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-19T03:01:18.092291+0000","last_change":"2024-04-19T03:01:15.011065+0000","last_active":"2024-04-19T03:01:18.092291+0000","last_peered":"2024-04-19T03:01:18.092291+0000","last_clean":"2024-04-19T03:01:18.092291+0000","last_became_active":"2024-04-19T03:01:15.010330+0000","last_became_peered":"2024-04-19T03:01:15.010330+0000","last_unstale":"2024-04-19T03:01:18.092291+0000","last_undegraded":"2024-04-19T03:01:18.092291+0000","last_fullsized":"2024-04-19T03:01:18.092291+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:56:10.495533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.021464+0000","last_change":"2024-04-19T03:01:15.017812+0000","last_active":"2024-04-19T03:01:15.021464+0000","last_peered":"2024-04-19T03:01:15.021464+0000","last_clean":"2024-04-19T03:01:15.021464+0000","last_became_active":"2024-04-19T03:01:15.016891+0000","last_became_peered":"2024-04-19T03:01:15.016891+0000","last_unstale":"2024-04-19T03:01:15.021464+0000","last_undegraded":"2024-04-19T03:01:15.021464+0000","last_fullsized":"2024-04-19T03:01:15.021464+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:39:54.289444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.024134+0000","last_change":"2024-04-19T03:01:15.019143+0000","last_active":"2024-04-19T03:01:15.024134+0000","last_peered":"2024-04-19T03:01:15.024134+0000","last_clean":"2024-04-19T03:01:15.024134+0000","last_became_active":"2024-04-19T03:01:15.017757+0000","last_became_peered":"2024-04-19T03:01:15.017757+0000","last_unstale":"2024-04-19T03:01:15.024134+0000","last_undegraded":"2024-04-19T03:01:15.024134+0000","last_fullsized":"2024-04-19T03:01:15.024134+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:10:21.967941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.023544+0000","last_change":"2024-04-19T03:01:15.020108+0000","last_active":"2024-04-19T03:01:15.023544+0000","last_peered":"2024-04-19T03:01:15.023544+0000","last_clean":"2024-04-19T03:01:15.023544+0000","last_became_active":"2024-04-19T03:01:15.018978+0000","last_became_peered":"2024-04-19T03:01:15.018978+0000","last_unstale":"2024-04-19T03:01:15.023544+0000","last_undegraded":"2024-04-19T03:01:15.023544+0000","last_fullsized":"2024-04-19T03:01:15.023544+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:30:22.360053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-19T03:01:18.090964+0000","last_change":"2024-04-19T03:01:15.016877+0000","last_active":"2024-04-19T03:01:18.090964+0000","last_peered":"2024-04-19T03:01:18.090964+0000","last_clean":"2024-04-19T03:01:18.090964+0000","last_became_active":"2024-04-19T03:01:15.016245+0000","last_became_peered":"2024-04-19T03:01:15.016245+0000","last_unstale":"2024-04-19T03:01:18.090964+0000","last_undegraded":"2024-04-19T03:01:18.090964+0000","last_fullsized":"2024-04-19T03:01:18.090964+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:38:07.846380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.023272+0000","last_change":"2024-04-19T03:01:15.018809+0000","last_active":"2024-04-19T03:01:15.023272+0000","last_peered":"2024-04-19T03:01:15.023272+0000","last_clean":"2024-04-19T03:01:15.023272+0000","last_became_active":"2024-04-19T03:01:15.017549+0000","last_became_peered":"2024-04-19T03:01:15.017549+0000","last_unstale":"2024-04-19T03:01:15.023272+0000","last_undegraded":"2024-04-19T03:01:15.023272+0000","last_fullsized":"2024-04-19T03:01:15.023272+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:37:35.950318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.023709+0000","last_change":"2024-04-19T03:01:15.020443+0000","last_active":"2024-04-19T03:01:15.023709+0000","last_peered":"2024-04-19T03:01:15.023709+0000","last_clean":"2024-04-19T03:01:15.023709+0000","last_became_active":"2024-04-19T03:01:15.018780+0000","last_became_peered":"2024-04-19T03:01:15.018780+0000","last_unstale":"2024-04-19T03:01:15.023709+0000","last_undegraded":"2024-04-19T03:01:15.023709+0000","last_fullsized":"2024-04-19T03:01:15.023709+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:56:44.307812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-19T03:01:18.093128+0000","last_change":"2024-04-19T03:01:15.017487+0000","last_active":"2024-04-19T03:01:18.093128+0000","last_peered":"2024-04-19T03:01:18.093128+0000","last_clean":"2024-04-19T03:01:18.093128+0000","last_became_active":"2024-04-19T03:01:15.016183+0000","last_became_peered":"2024-04-19T03:01:15.016183+0000","last_unstale":"2024-04-19T03:01:18.093128+0000","last_undegraded":"2024-04-19T03:01:18.093128+0000","last_fullsized":"2024-04-19T03:01:18.093128+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:44:37.487013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.018261+0000","last_change":"2024-04-19T03:01:15.016117+0000","last_active":"2024-04-19T03:01:15.018261+0000","last_peered":"2024-04-19T03:01:15.018261+0000","last_clean":"2024-04-19T03:01:15.018261+0000","last_became_active":"2024-04-19T03:01:15.015415+0000","last_became_peered":"2024-04-19T03:01:15.015415+0000","last_unstale":"2024-04-19T03:01:15.018261+0000","last_undegraded":"2024-04-19T03:01:15.018261+0000","last_fullsized":"2024-04-19T03:01:15.018261+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:06:35.813797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.023502+0000","last_change":"2024-04-19T03:01:15.020098+0000","last_active":"2024-04-19T03:01:15.023502+0000","last_peered":"2024-04-19T03:01:15.023502+0000","last_clean":"2024-04-19T03:01:15.023502+0000","last_became_active":"2024-04-19T03:01:15.019064+0000","last_became_peered":"2024-04-19T03:01:15.019064+0000","last_unstale":"2024-04-19T03:01:15.023502+0000","last_undegraded":"2024-04-19T03:01:15.023502+0000","last_fullsized":"2024-04-19T03:01:15.023502+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:50:06.490191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-19T03:01:18.092158+0000","last_change":"2024-04-19T03:01:15.013746+0000","last_active":"2024-04-19T03:01:18.092158+0000","last_peered":"2024-04-19T03:01:18.092158+0000","last_clean":"2024-04-19T03:01:18.092158+0000","last_became_active":"2024-04-19T03:01:15.011865+0000","last_became_peered":"2024-04-19T03:01:15.011865+0000","last_unstale":"2024-04-19T03:01:18.092158+0000","last_undegraded":"2024-04-19T03:01:18.092158+0000","last_fullsized":"2024-04-19T03:01:18.092158+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:32:23.606804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.023434+0000","last_change":"2024-04-19T03:01:15.019787+0000","last_active":"2024-04-19T03:01:15.023434+0000","last_peered":"2024-04-19T03:01:15.023434+0000","last_clean":"2024-04-19T03:01:15.023434+0000","last_became_active":"2024-04-19T03:01:15.018350+0000","last_became_peered":"2024-04-19T03:01:15.018350+0000","last_unstale":"2024-04-19T03:01:15.023434+0000","last_undegraded":"2024-04-19T03:01:15.023434+0000","last_fullsized":"2024-04-19T03:01:15.023434+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:10:42.079294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-19T03:01:18.090924+0000","last_change":"2024-04-19T03:01:15.012900+0000","last_active":"2024-04-19T03:01:18.090924+0000","last_peered":"2024-04-19T03:01:18.090924+0000","last_clean":"2024-04-19T03:01:18.090924+0000","last_became_active":"2024-04-19T03:01:15.012416+0000","last_became_peered":"2024-04-19T03:01:15.012416+0000","last_unstale":"2024-04-19T03:01:18.090924+0000","last_undegraded":"2024-04-19T03:01:18.090924+0000","last_fullsized":"2024-04-19T03:01:18.090924+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:57:14.847455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.024190+0000","last_change":"2024-04-19T03:01:15.019278+0000","last_active":"2024-04-19T03:01:15.024190+0000","last_peered":"2024-04-19T03:01:15.024190+0000","last_clean":"2024-04-19T03:01:15.024190+0000","last_became_active":"2024-04-19T03:01:15.017779+0000","last_became_peered":"2024-04-19T03:01:15.017779+0000","last_unstale":"2024-04-19T03:01:15.024190+0000","last_undegraded":"2024-04-19T03:01:15.024190+0000","last_fullsized":"2024-04-19T03:01:15.024190+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:54:54.463918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.022801+0000","last_change":"2024-04-19T03:01:15.016669+0000","last_active":"2024-04-19T03:01:15.022801+0000","last_peered":"2024-04-19T03:01:15.022801+0000","last_clean":"2024-04-19T03:01:15.022801+0000","last_became_active":"2024-04-19T03:01:15.016286+0000","last_became_peered":"2024-04-19T03:01:15.016286+0000","last_unstale":"2024-04-19T03:01:15.022801+0000","last_undegraded":"2024-04-19T03:01:15.022801+0000","last_fullsized":"2024-04-19T03:01:15.022801+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:55:34.102680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"20'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.019438+0000","last_change":"2024-04-19T03:01:14.651050+0000","last_active":"2024-04-19T03:01:15.019438+0000","last_peered":"2024-04-19T03:01:15.019438+0000","last_clean":"2024-04-19T03:01:15.019438+0000","last_became_active":"2024-04-19T03:01:14.650679+0000","last_became_peered":"2024-04-19T03:01:14.650679+0000","last_unstale":"2024-04-19T03:01:15.019438+0000","last_undegraded":"2024-04-19T03:01:15.019438+0000","last_fullsized":"2024-04-19T03:01:15.019438+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:37:03.684394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.022892+0000","last_change":"2024-04-19T03:01:15.017124+0000","last_active":"2024-04-19T03:01:15.022892+0000","last_peered":"2024-04-19T03:01:15.022892+0000","last_clean":"2024-04-19T03:01:15.022892+0000","last_became_active":"2024-04-19T03:01:15.016535+0000","last_became_peered":"2024-04-19T03:01:15.016535+0000","last_unstale":"2024-04-19T03:01:15.022892+0000","last_undegraded":"2024-04-19T03:01:15.022892+0000","last_fullsized":"2024-04-19T03:01:15.022892+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:40:12.179703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.002737+0000","last_change":"2024-04-19T03:01:14.646594+0000","last_active":"2024-04-19T03:01:15.002737+0000","last_peered":"2024-04-19T03:01:15.002737+0000","last_clean":"2024-04-19T03:01:15.002737+0000","last_became_active":"2024-04-19T03:01:14.646122+0000","last_became_peered":"2024-04-19T03:01:14.646122+0000","last_unstale":"2024-04-19T03:01:15.002737+0000","last_undegraded":"2024-04-19T03:01:15.002737+0000","last_fullsized":"2024-04-19T03:01:15.002737+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:40:53.463388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-19T03:01:18.093362+0000","last_change":"2024-04-19T03:01:15.017420+0000","last_active":"2024-04-19T03:01:18.093362+0000","last_peered":"2024-04-19T03:01:18.093362+0000","last_clean":"2024-04-19T03:01:18.093362+0000","last_became_active":"2024-04-19T03:01:15.015840+0000","last_became_peered":"2024-04-19T03:01:15.015840+0000","last_unstale":"2024-04-19T03:01:18.093362+0000","last_undegraded":"2024-04-19T03:01:18.093362+0000","last_fullsized":"2024-04-19T03:01:18.093362+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:05:05.266293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.004873+0000","last_change":"2024-04-19T03:01:14.649074+0000","last_active":"2024-04-19T03:01:15.004873+0000","last_peered":"2024-04-19T03:01:15.004873+0000","last_clean":"2024-04-19T03:01:15.004873+0000","last_became_active":"2024-04-19T03:01:14.648217+0000","last_became_peered":"2024-04-19T03:01:14.648217+0000","last_unstale":"2024-04-19T03:01:15.004873+0000","last_undegraded":"2024-04-19T03:01:15.004873+0000","last_fullsized":"2024-04-19T03:01:15.004873+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:57:05.238043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-19T03:01:18.092638+0000","last_change":"2024-04-19T03:01:15.017136+0000","last_active":"2024-04-19T03:01:18.092638+0000","last_peered":"2024-04-19T03:01:18.092638+0000","last_clean":"2024-04-19T03:01:18.092638+0000","last_became_active":"2024-04-19T03:01:15.016550+0000","last_became_peered":"2024-04-19T03:01:15.016550+0000","last_unstale":"2024-04-19T03:01:18.092638+0000","last_undegraded":"2024-04-19T03:01:18.092638+0000","last_fullsized":"2024-04-19T03:01:18.092638+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:55:37.697481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"20'8","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.023332+0000","last_change":"2024-04-19T03:01:14.649044+0000","last_active":"2024-04-19T03:01:15.023332+0000","last_peered":"2024-04-19T03:01:15.023332+0000","last_clean":"2024-04-19T03:01:15.023332+0000","last_became_active":"2024-04-19T03:01:14.648859+0000","last_became_peered":"2024-04-19T03:01:14.648859+0000","last_unstale":"2024-04-19T03:01:15.023332+0000","last_undegraded":"2024-04-19T03:01:15.023332+0000","last_fullsized":"2024-04-19T03:01:15.023332+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:30:45.925657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"20'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.015096+0000","last_change":"2024-04-19T03:01:14.649839+0000","last_active":"2024-04-19T03:01:15.015096+0000","last_peered":"2024-04-19T03:01:15.015096+0000","last_clean":"2024-04-19T03:01:15.015096+0000","last_became_active":"2024-04-19T03:01:14.649571+0000","last_became_peered":"2024-04-19T03:01:14.649571+0000","last_unstale":"2024-04-19T03:01:15.015096+0000","last_undegraded":"2024-04-19T03:01:15.015096+0000","last_fullsized":"2024-04-19T03:01:15.015096+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:03:57.839660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.023786+0000","last_change":"2024-04-19T03:01:15.021047+0000","last_active":"2024-04-19T03:01:15.023786+0000","last_peered":"2024-04-19T03:01:15.023786+0000","last_clean":"2024-04-19T03:01:15.023786+0000","last_became_active":"2024-04-19T03:01:15.019792+0000","last_became_peered":"2024-04-19T03:01:15.019792+0000","last_unstale":"2024-04-19T03:01:15.023786+0000","last_undegraded":"2024-04-19T03:01:15.023786+0000","last_fullsized":"2024-04-19T03:01:15.023786+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:54:54.463918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"20'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.019933+0000","last_change":"2024-04-19T03:01:14.645075+0000","last_active":"2024-04-19T03:01:15.019933+0000","last_peered":"2024-04-19T03:01:15.019933+0000","last_clean":"2024-04-19T03:01:15.019933+0000","last_became_active":"2024-04-19T03:01:14.644790+0000","last_became_peered":"2024-04-19T03:01:14.644790+0000","last_unstale":"2024-04-19T03:01:15.019933+0000","last_undegraded":"2024-04-19T03:01:15.019933+0000","last_fullsized":"2024-04-19T03:01:15.019933+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:55:15.035769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.021374+0000","last_change":"2024-04-19T03:01:15.016330+0000","last_active":"2024-04-19T03:01:15.021374+0000","last_peered":"2024-04-19T03:01:15.021374+0000","last_clean":"2024-04-19T03:01:15.021374+0000","last_became_active":"2024-04-19T03:01:15.015644+0000","last_became_peered":"2024-04-19T03:01:15.015644+0000","last_unstale":"2024-04-19T03:01:15.021374+0000","last_undegraded":"2024-04-19T03:01:15.021374+0000","last_fullsized":"2024-04-19T03:01:15.021374+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:13:06.902769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"20'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.015911+0000","last_change":"2024-04-19T03:01:14.649826+0000","last_active":"2024-04-19T03:01:15.015911+0000","last_peered":"2024-04-19T03:01:15.015911+0000","last_clean":"2024-04-19T03:01:15.015911+0000","last_became_active":"2024-04-19T03:01:14.649565+0000","last_became_peered":"2024-04-19T03:01:14.649565+0000","last_unstale":"2024-04-19T03:01:15.015911+0000","last_undegraded":"2024-04-19T03:01:15.015911+0000","last_fullsized":"2024-04-19T03:01:15.015911+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:36:00.962931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.021994+0000","last_change":"2024-04-19T03:01:15.018099+0000","last_active":"2024-04-19T03:01:15.021994+0000","last_peered":"2024-04-19T03:01:15.021994+0000","last_clean":"2024-04-19T03:01:15.021994+0000","last_became_active":"2024-04-19T03:01:15.017536+0000","last_became_peered":"2024-04-19T03:01:15.017536+0000","last_unstale":"2024-04-19T03:01:15.021994+0000","last_undegraded":"2024-04-19T03:01:15.021994+0000","last_fullsized":"2024-04-19T03:01:15.021994+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:50:06.490191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.006366+0000","last_change":"2024-04-19T03:01:14.651201+0000","last_active":"2024-04-19T03:01:15.006366+0000","last_peered":"2024-04-19T03:01:15.006366+0000","last_clean":"2024-04-19T03:01:15.006366+0000","last_became_active":"2024-04-19T03:01:14.650942+0000","last_became_peered":"2024-04-19T03:01:14.650942+0000","last_unstale":"2024-04-19T03:01:15.006366+0000","last_undegraded":"2024-04-19T03:01:15.006366+0000","last_fullsized":"2024-04-19T03:01:15.006366+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:02:13.190917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-19T03:01:18.092211+0000","last_change":"2024-04-19T03:01:15.017458+0000","last_active":"2024-04-19T03:01:18.092211+0000","last_peered":"2024-04-19T03:01:18.092211+0000","last_clean":"2024-04-19T03:01:18.092211+0000","last_became_active":"2024-04-19T03:01:15.016653+0000","last_became_peered":"2024-04-19T03:01:15.016653+0000","last_unstale":"2024-04-19T03:01:18.092211+0000","last_undegraded":"2024-04-19T03:01:18.092211+0000","last_fullsized":"2024-04-19T03:01:18.092211+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:52:28.671365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"20'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.016958+0000","last_change":"2024-04-19T03:01:14.647553+0000","last_active":"2024-04-19T03:01:15.016958+0000","last_peered":"2024-04-19T03:01:15.016958+0000","last_clean":"2024-04-19T03:01:15.016958+0000","last_became_active":"2024-04-19T03:01:14.647147+0000","last_became_peered":"2024-04-19T03:01:14.647147+0000","last_unstale":"2024-04-19T03:01:15.016958+0000","last_undegraded":"2024-04-19T03:01:15.016958+0000","last_fullsized":"2024-04-19T03:01:15.016958+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:33:45.550646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.021494+0000","last_change":"2024-04-19T03:01:15.018012+0000","last_active":"2024-04-19T03:01:15.021494+0000","last_peered":"2024-04-19T03:01:15.021494+0000","last_clean":"2024-04-19T03:01:15.021494+0000","last_became_active":"2024-04-19T03:01:15.017086+0000","last_became_peered":"2024-04-19T03:01:15.017086+0000","last_unstale":"2024-04-19T03:01:15.021494+0000","last_undegraded":"2024-04-19T03:01:15.021494+0000","last_fullsized":"2024-04-19T03:01:15.021494+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:54:04.518505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.001920+0000","last_change":"2024-04-19T03:01:14.651004+0000","last_active":"2024-04-19T03:01:15.001920+0000","last_peered":"2024-04-19T03:01:15.001920+0000","last_clean":"2024-04-19T03:01:15.001920+0000","last_became_active":"2024-04-19T03:01:14.650635+0000","last_became_peered":"2024-04-19T03:01:14.650635+0000","last_unstale":"2024-04-19T03:01:15.001920+0000","last_undegraded":"2024-04-19T03:01:15.001920+0000","last_fullsized":"2024-04-19T03:01:15.001920+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:57:15.575819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.018174+0000","last_change":"2024-04-19T03:01:15.015685+0000","last_active":"2024-04-19T03:01:15.018174+0000","last_peered":"2024-04-19T03:01:15.018174+0000","last_clean":"2024-04-19T03:01:15.018174+0000","last_became_active":"2024-04-19T03:01:15.014847+0000","last_became_peered":"2024-04-19T03:01:15.014847+0000","last_unstale":"2024-04-19T03:01:15.018174+0000","last_undegraded":"2024-04-19T03:01:15.018174+0000","last_fullsized":"2024-04-19T03:01:15.018174+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:51:06.208551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.005141+0000","last_change":"2024-04-19T03:01:14.644582+0000","last_active":"2024-04-19T03:01:15.005141+0000","last_peered":"2024-04-19T03:01:15.005141+0000","last_clean":"2024-04-19T03:01:15.005141+0000","last_became_active":"2024-04-19T03:01:14.644101+0000","last_became_peered":"2024-04-19T03:01:14.644101+0000","last_unstale":"2024-04-19T03:01:15.005141+0000","last_undegraded":"2024-04-19T03:01:15.005141+0000","last_fullsized":"2024-04-19T03:01:15.005141+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:28:24.652864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.017755+0000","last_change":"2024-04-19T03:01:15.014818+0000","last_active":"2024-04-19T03:01:15.017755+0000","last_peered":"2024-04-19T03:01:15.017755+0000","last_clean":"2024-04-19T03:01:15.017755+0000","last_became_active":"2024-04-19T03:01:15.014421+0000","last_became_peered":"2024-04-19T03:01:15.014421+0000","last_unstale":"2024-04-19T03:01:15.017755+0000","last_undegraded":"2024-04-19T03:01:15.017755+0000","last_fullsized":"2024-04-19T03:01:15.017755+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:16:20.475837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.008183+0000","last_change":"2024-04-19T03:01:14.643840+0000","last_active":"2024-04-19T03:01:15.008183+0000","last_peered":"2024-04-19T03:01:15.008183+0000","last_clean":"2024-04-19T03:01:15.008183+0000","last_became_active":"2024-04-19T03:01:14.643503+0000","last_became_peered":"2024-04-19T03:01:14.643503+0000","last_unstale":"2024-04-19T03:01:15.008183+0000","last_undegraded":"2024-04-19T03:01:15.008183+0000","last_fullsized":"2024-04-19T03:01:15.008183+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:09:33.801275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-19T03:01:18.092763+0000","last_change":"2024-04-19T03:01:15.012607+0000","last_active":"2024-04-19T03:01:18.092763+0000","last_peered":"2024-04-19T03:01:18.092763+0000","last_clean":"2024-04-19T03:01:18.092763+0000","last_became_active":"2024-04-19T03:01:15.012152+0000","last_became_peered":"2024-04-19T03:01:15.012152+0000","last_unstale":"2024-04-19T03:01:18.092763+0000","last_undegraded":"2024-04-19T03:01:18.092763+0000","last_fullsized":"2024-04-19T03:01:18.092763+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:57:36.794409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"14'157","reported_seq":212,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.004135+0000","last_change":"2024-04-19T03:01:07.538434+0000","last_active":"2024-04-19T03:01:15.004135+0000","last_peered":"2024-04-19T03:01:15.004135+0000","last_clean":"2024-04-19T03:01:15.004135+0000","last_became_active":"2024-04-19T03:01:07.537856+0000","last_became_peered":"2024-04-19T03:01:07.537856+0000","last_unstale":"2024-04-19T03:01:15.004135+0000","last_undegraded":"2024-04-19T03:01:15.004135+0000","last_fullsized":"2024-04-19T03:01:15.004135+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:06.516863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:06.516863+0000","last_clean_scrub_stamp":"2024-04-19T03:01:06.516863+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:36:46.386286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.006445+0000","last_change":"2024-04-19T03:01:10.602869+0000","last_active":"2024-04-19T03:01:15.006445+0000","last_peered":"2024-04-19T03:01:15.006445+0000","last_clean":"2024-04-19T03:01:15.006445+0000","last_became_active":"2024-04-19T03:01:10.601965+0000","last_became_peered":"2024-04-19T03:01:10.601965+0000","last_unstale":"2024-04-19T03:01:15.006445+0000","last_undegraded":"2024-04-19T03:01:15.006445+0000","last_fullsized":"2024-04-19T03:01:15.006445+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_clean_scrub_stamp":"2024-04-19T03:01:09.578660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:14:41.316871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.001643+0000","last_change":"2024-04-19T03:01:14.643201+0000","last_active":"2024-04-19T03:01:15.001643+0000","last_peered":"2024-04-19T03:01:15.001643+0000","last_clean":"2024-04-19T03:01:15.001643+0000","last_became_active":"2024-04-19T03:01:14.642885+0000","last_became_peered":"2024-04-19T03:01:14.642885+0000","last_unstale":"2024-04-19T03:01:15.001643+0000","last_undegraded":"2024-04-19T03:01:15.001643+0000","last_fullsized":"2024-04-19T03:01:15.001643+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:24:40.181164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.019181+0000","last_change":"2024-04-19T03:01:15.016104+0000","last_active":"2024-04-19T03:01:15.019181+0000","last_peered":"2024-04-19T03:01:15.019181+0000","last_clean":"2024-04-19T03:01:15.019181+0000","last_became_active":"2024-04-19T03:01:15.015386+0000","last_became_peered":"2024-04-19T03:01:15.015386+0000","last_unstale":"2024-04-19T03:01:15.019181+0000","last_undegraded":"2024-04-19T03:01:15.019181+0000","last_fullsized":"2024-04-19T03:01:15.019181+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:00:35.372657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.003912+0000","last_change":"2024-04-19T03:01:10.602194+0000","last_active":"2024-04-19T03:01:15.003912+0000","last_peered":"2024-04-19T03:01:15.003912+0000","last_clean":"2024-04-19T03:01:15.003912+0000","last_became_active":"2024-04-19T03:01:10.601381+0000","last_became_peered":"2024-04-19T03:01:10.601381+0000","last_unstale":"2024-04-19T03:01:15.003912+0000","last_undegraded":"2024-04-19T03:01:15.003912+0000","last_fullsized":"2024-04-19T03:01:15.003912+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_clean_scrub_stamp":"2024-04-19T03:01:09.578660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:42:26.594095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.003098+0000","last_change":"2024-04-19T03:01:14.647365+0000","last_active":"2024-04-19T03:01:15.003098+0000","last_peered":"2024-04-19T03:01:15.003098+0000","last_clean":"2024-04-19T03:01:15.003098+0000","last_became_active":"2024-04-19T03:01:14.646950+0000","last_became_peered":"2024-04-19T03:01:14.646950+0000","last_unstale":"2024-04-19T03:01:15.003098+0000","last_undegraded":"2024-04-19T03:01:15.003098+0000","last_fullsized":"2024-04-19T03:01:15.003098+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:41:26.108674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.023211+0000","last_change":"2024-04-19T03:01:15.018728+0000","last_active":"2024-04-19T03:01:15.023211+0000","last_peered":"2024-04-19T03:01:15.023211+0000","last_clean":"2024-04-19T03:01:15.023211+0000","last_became_active":"2024-04-19T03:01:15.017287+0000","last_became_peered":"2024-04-19T03:01:15.017287+0000","last_unstale":"2024-04-19T03:01:15.023211+0000","last_undegraded":"2024-04-19T03:01:15.023211+0000","last_fullsized":"2024-04-19T03:01:15.023211+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:54:04.518505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.003231+0000","last_change":"2024-04-19T03:01:10.600207+0000","last_active":"2024-04-19T03:01:15.003231+0000","last_peered":"2024-04-19T03:01:15.003231+0000","last_clean":"2024-04-19T03:01:15.003231+0000","last_became_active":"2024-04-19T03:01:10.599209+0000","last_became_peered":"2024-04-19T03:01:10.599209+0000","last_unstale":"2024-04-19T03:01:15.003231+0000","last_undegraded":"2024-04-19T03:01:15.003231+0000","last_fullsized":"2024-04-19T03:01:15.003231+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_clean_scrub_stamp":"2024-04-19T03:01:09.578660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:30:25.748140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.008341+0000","last_change":"2024-04-19T03:01:14.649068+0000","last_active":"2024-04-19T03:01:15.008341+0000","last_peered":"2024-04-19T03:01:15.008341+0000","last_clean":"2024-04-19T03:01:15.008341+0000","last_became_active":"2024-04-19T03:01:14.648082+0000","last_became_peered":"2024-04-19T03:01:14.648082+0000","last_unstale":"2024-04-19T03:01:15.008341+0000","last_undegraded":"2024-04-19T03:01:15.008341+0000","last_fullsized":"2024-04-19T03:01:15.008341+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:30:14.489117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-19T03:01:18.092872+0000","last_change":"2024-04-19T03:01:15.012147+0000","last_active":"2024-04-19T03:01:18.092872+0000","last_peered":"2024-04-19T03:01:18.092872+0000","last_clean":"2024-04-19T03:01:18.092872+0000","last_became_active":"2024-04-19T03:01:15.011421+0000","last_became_peered":"2024-04-19T03:01:15.011421+0000","last_unstale":"2024-04-19T03:01:18.092872+0000","last_undegraded":"2024-04-19T03:01:18.092872+0000","last_fullsized":"2024-04-19T03:01:18.092872+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:50:51.928641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.002185+0000","last_change":"2024-04-19T03:01:10.601386+0000","last_active":"2024-04-19T03:01:15.002185+0000","last_peered":"2024-04-19T03:01:15.002185+0000","last_clean":"2024-04-19T03:01:15.002185+0000","last_became_active":"2024-04-19T03:01:10.600732+0000","last_became_peered":"2024-04-19T03:01:10.600732+0000","last_unstale":"2024-04-19T03:01:15.002185+0000","last_undegraded":"2024-04-19T03:01:15.002185+0000","last_fullsized":"2024-04-19T03:01:15.002185+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_clean_scrub_stamp":"2024-04-19T03:01:09.578660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:34:53.138338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.006322+0000","last_change":"2024-04-19T03:01:14.651363+0000","last_active":"2024-04-19T03:01:15.006322+0000","last_peered":"2024-04-19T03:01:15.006322+0000","last_clean":"2024-04-19T03:01:15.006322+0000","last_became_active":"2024-04-19T03:01:14.651020+0000","last_became_peered":"2024-04-19T03:01:14.651020+0000","last_unstale":"2024-04-19T03:01:15.006322+0000","last_undegraded":"2024-04-19T03:01:15.006322+0000","last_fullsized":"2024-04-19T03:01:15.006322+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:44:36.043345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-19T03:01:18.092601+0000","last_change":"2024-04-19T03:01:15.017182+0000","last_active":"2024-04-19T03:01:18.092601+0000","last_peered":"2024-04-19T03:01:18.092601+0000","last_clean":"2024-04-19T03:01:18.092601+0000","last_became_active":"2024-04-19T03:01:15.016258+0000","last_became_peered":"2024-04-19T03:01:15.016258+0000","last_unstale":"2024-04-19T03:01:18.092601+0000","last_undegraded":"2024-04-19T03:01:18.092601+0000","last_fullsized":"2024-04-19T03:01:18.092601+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:27:25.351590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.004000+0000","last_change":"2024-04-19T03:01:14.651740+0000","last_active":"2024-04-19T03:01:15.004000+0000","last_peered":"2024-04-19T03:01:15.004000+0000","last_clean":"2024-04-19T03:01:15.004000+0000","last_became_active":"2024-04-19T03:01:14.651491+0000","last_became_peered":"2024-04-19T03:01:14.651491+0000","last_unstale":"2024-04-19T03:01:15.004000+0000","last_undegraded":"2024-04-19T03:01:15.004000+0000","last_fullsized":"2024-04-19T03:01:15.004000+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:42:15.864988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.006158+0000","last_change":"2024-04-19T03:01:10.601062+0000","last_active":"2024-04-19T03:01:15.006158+0000","last_peered":"2024-04-19T03:01:15.006158+0000","last_clean":"2024-04-19T03:01:15.006158+0000","last_became_active":"2024-04-19T03:01:10.600334+0000","last_became_peered":"2024-04-19T03:01:10.600334+0000","last_unstale":"2024-04-19T03:01:15.006158+0000","last_undegraded":"2024-04-19T03:01:15.006158+0000","last_fullsized":"2024-04-19T03:01:15.006158+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_clean_scrub_stamp":"2024-04-19T03:01:09.578660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:51:38.307752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.023683+0000","last_change":"2024-04-19T03:01:15.020501+0000","last_active":"2024-04-19T03:01:15.023683+0000","last_peered":"2024-04-19T03:01:15.023683+0000","last_clean":"2024-04-19T03:01:15.023683+0000","last_became_active":"2024-04-19T03:01:15.019019+0000","last_became_peered":"2024-04-19T03:01:15.019019+0000","last_unstale":"2024-04-19T03:01:15.023683+0000","last_undegraded":"2024-04-19T03:01:15.023683+0000","last_fullsized":"2024-04-19T03:01:15.023683+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:22:58.349159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.006058+0000","last_change":"2024-04-19T03:01:14.643098+0000","last_active":"2024-04-19T03:01:15.006058+0000","last_peered":"2024-04-19T03:01:15.006058+0000","last_clean":"2024-04-19T03:01:15.006058+0000","last_became_active":"2024-04-19T03:01:14.642789+0000","last_became_peered":"2024-04-19T03:01:14.642789+0000","last_unstale":"2024-04-19T03:01:15.006058+0000","last_undegraded":"2024-04-19T03:01:15.006058+0000","last_fullsized":"2024-04-19T03:01:15.006058+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:40:40.193720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.005646+0000","last_change":"2024-04-19T03:01:10.603139+0000","last_active":"2024-04-19T03:01:15.005646+0000","last_peered":"2024-04-19T03:01:15.005646+0000","last_clean":"2024-04-19T03:01:15.005646+0000","last_became_active":"2024-04-19T03:01:10.602397+0000","last_became_peered":"2024-04-19T03:01:10.602397+0000","last_unstale":"2024-04-19T03:01:15.005646+0000","last_undegraded":"2024-04-19T03:01:15.005646+0000","last_fullsized":"2024-04-19T03:01:15.005646+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_clean_scrub_stamp":"2024-04-19T03:01:09.578660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:36:00.072157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.023512+0000","last_change":"2024-04-19T03:01:15.020052+0000","last_active":"2024-04-19T03:01:15.023512+0000","last_peered":"2024-04-19T03:01:15.023512+0000","last_clean":"2024-04-19T03:01:15.023512+0000","last_became_active":"2024-04-19T03:01:15.019144+0000","last_became_peered":"2024-04-19T03:01:15.019144+0000","last_unstale":"2024-04-19T03:01:15.023512+0000","last_undegraded":"2024-04-19T03:01:15.023512+0000","last_fullsized":"2024-04-19T03:01:15.023512+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:39:54.289444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"20'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.019383+0000","last_change":"2024-04-19T03:01:14.643328+0000","last_active":"2024-04-19T03:01:15.019383+0000","last_peered":"2024-04-19T03:01:15.019383+0000","last_clean":"2024-04-19T03:01:15.019383+0000","last_became_active":"2024-04-19T03:01:14.643001+0000","last_became_peered":"2024-04-19T03:01:14.643001+0000","last_unstale":"2024-04-19T03:01:15.019383+0000","last_undegraded":"2024-04-19T03:01:15.019383+0000","last_fullsized":"2024-04-19T03:01:15.019383+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:28:14.128657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.006138+0000","last_change":"2024-04-19T03:01:10.599894+0000","last_active":"2024-04-19T03:01:15.006138+0000","last_peered":"2024-04-19T03:01:15.006138+0000","last_clean":"2024-04-19T03:01:15.006138+0000","last_became_active":"2024-04-19T03:01:10.599202+0000","last_became_peered":"2024-04-19T03:01:10.599202+0000","last_unstale":"2024-04-19T03:01:15.006138+0000","last_undegraded":"2024-04-19T03:01:15.006138+0000","last_fullsized":"2024-04-19T03:01:15.006138+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_clean_scrub_stamp":"2024-04-19T03:01:09.578660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:59:34.386302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-19T03:01:18.091060+0000","last_change":"2024-04-19T03:01:15.016429+0000","last_active":"2024-04-19T03:01:18.091060+0000","last_peered":"2024-04-19T03:01:18.091060+0000","last_clean":"2024-04-19T03:01:18.091060+0000","last_became_active":"2024-04-19T03:01:15.015945+0000","last_became_peered":"2024-04-19T03:01:15.015945+0000","last_unstale":"2024-04-19T03:01:18.091060+0000","last_undegraded":"2024-04-19T03:01:18.091060+0000","last_fullsized":"2024-04-19T03:01:18.091060+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:43:17.785352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"21'1","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-19T03:01:18.093734+0000","last_change":"2024-04-19T03:01:14.647170+0000","last_active":"2024-04-19T03:01:18.093734+0000","last_peered":"2024-04-19T03:01:18.093734+0000","last_clean":"2024-04-19T03:01:18.093734+0000","last_became_active":"2024-04-19T03:01:14.646622+0000","last_became_peered":"2024-04-19T03:01:14.646622+0000","last_unstale":"2024-04-19T03:01:18.093734+0000","last_undegraded":"2024-04-19T03:01:18.093734+0000","last_fullsized":"2024-04-19T03:01:18.093734+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:32:41.909038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.001377+0000","last_change":"2024-04-19T03:01:10.602274+0000","last_active":"2024-04-19T03:01:15.001377+0000","last_peered":"2024-04-19T03:01:15.001377+0000","last_clean":"2024-04-19T03:01:15.001377+0000","last_became_active":"2024-04-19T03:01:10.601487+0000","last_became_peered":"2024-04-19T03:01:10.601487+0000","last_unstale":"2024-04-19T03:01:15.001377+0000","last_undegraded":"2024-04-19T03:01:15.001377+0000","last_fullsized":"2024-04-19T03:01:15.001377+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_clean_scrub_stamp":"2024-04-19T03:01:09.578660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:26:16.712446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.023281+0000","last_change":"2024-04-19T03:01:15.018914+0000","last_active":"2024-04-19T03:01:15.023281+0000","last_peered":"2024-04-19T03:01:15.023281+0000","last_clean":"2024-04-19T03:01:15.023281+0000","last_became_active":"2024-04-19T03:01:15.018276+0000","last_became_peered":"2024-04-19T03:01:15.018276+0000","last_unstale":"2024-04-19T03:01:15.023281+0000","last_undegraded":"2024-04-19T03:01:15.023281+0000","last_fullsized":"2024-04-19T03:01:15.023281+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:40:59.453079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.018690+0000","last_change":"2024-04-19T03:01:15.015855+0000","last_active":"2024-04-19T03:01:15.018690+0000","last_peered":"2024-04-19T03:01:15.018690+0000","last_clean":"2024-04-19T03:01:15.018690+0000","last_became_active":"2024-04-19T03:01:15.015358+0000","last_became_peered":"2024-04-19T03:01:15.015358+0000","last_unstale":"2024-04-19T03:01:15.018690+0000","last_undegraded":"2024-04-19T03:01:15.018690+0000","last_fullsized":"2024-04-19T03:01:15.018690+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:59:49.270245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"20'6","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.029460+0000","last_change":"2024-04-19T03:01:14.649577+0000","last_active":"2024-04-19T03:01:15.029460+0000","last_peered":"2024-04-19T03:01:15.029460+0000","last_clean":"2024-04-19T03:01:15.029460+0000","last_became_active":"2024-04-19T03:01:14.649284+0000","last_became_peered":"2024-04-19T03:01:14.649284+0000","last_unstale":"2024-04-19T03:01:15.029460+0000","last_undegraded":"2024-04-19T03:01:15.029460+0000","last_fullsized":"2024-04-19T03:01:15.029460+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:01:22.214742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-19T03:01:18.091377+0000","last_change":"2024-04-19T03:01:15.013509+0000","last_active":"2024-04-19T03:01:18.091377+0000","last_peered":"2024-04-19T03:01:18.091377+0000","last_clean":"2024-04-19T03:01:18.091377+0000","last_became_active":"2024-04-19T03:01:15.012694+0000","last_became_peered":"2024-04-19T03:01:15.012694+0000","last_unstale":"2024-04-19T03:01:18.091377+0000","last_undegraded":"2024-04-19T03:01:18.091377+0000","last_fullsized":"2024-04-19T03:01:18.091377+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:13:47.056938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"20'3","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.019366+0000","last_change":"2024-04-19T03:01:14.648703+0000","last_active":"2024-04-19T03:01:15.019366+0000","last_peered":"2024-04-19T03:01:15.019366+0000","last_clean":"2024-04-19T03:01:15.019366+0000","last_became_active":"2024-04-19T03:01:14.648258+0000","last_became_peered":"2024-04-19T03:01:14.648258+0000","last_unstale":"2024-04-19T03:01:15.019366+0000","last_undegraded":"2024-04-19T03:01:15.019366+0000","last_fullsized":"2024-04-19T03:01:15.019366+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:30:35.593258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.001904+0000","last_change":"2024-04-19T03:01:14.651753+0000","last_active":"2024-04-19T03:01:15.001904+0000","last_peered":"2024-04-19T03:01:15.001904+0000","last_clean":"2024-04-19T03:01:15.001904+0000","last_became_active":"2024-04-19T03:01:14.651458+0000","last_became_peered":"2024-04-19T03:01:14.651458+0000","last_unstale":"2024-04-19T03:01:15.001904+0000","last_undegraded":"2024-04-19T03:01:15.001904+0000","last_fullsized":"2024-04-19T03:01:15.001904+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:58:28.669306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-19T03:01:18.091195+0000","last_change":"2024-04-19T03:01:15.016094+0000","last_active":"2024-04-19T03:01:18.091195+0000","last_peered":"2024-04-19T03:01:18.091195+0000","last_clean":"2024-04-19T03:01:18.091195+0000","last_became_active":"2024-04-19T03:01:15.015379+0000","last_became_peered":"2024-04-19T03:01:15.015379+0000","last_unstale":"2024-04-19T03:01:18.091195+0000","last_undegraded":"2024-04-19T03:01:18.091195+0000","last_fullsized":"2024-04-19T03:01:18.091195+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:42:11.854631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.006982+0000","last_change":"2024-04-19T03:01:14.647282+0000","last_active":"2024-04-19T03:01:15.006982+0000","last_peered":"2024-04-19T03:01:15.006982+0000","last_clean":"2024-04-19T03:01:15.006982+0000","last_became_active":"2024-04-19T03:01:14.646878+0000","last_became_peered":"2024-04-19T03:01:14.646878+0000","last_unstale":"2024-04-19T03:01:15.006982+0000","last_undegraded":"2024-04-19T03:01:15.006982+0000","last_fullsized":"2024-04-19T03:01:15.006982+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:22:38.096801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-19T03:01:18.090981+0000","last_change":"2024-04-19T03:01:15.013187+0000","last_active":"2024-04-19T03:01:18.090981+0000","last_peered":"2024-04-19T03:01:18.090981+0000","last_clean":"2024-04-19T03:01:18.090981+0000","last_became_active":"2024-04-19T03:01:15.011542+0000","last_became_peered":"2024-04-19T03:01:15.011542+0000","last_unstale":"2024-04-19T03:01:18.090981+0000","last_undegraded":"2024-04-19T03:01:18.090981+0000","last_fullsized":"2024-04-19T03:01:18.090981+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:53:13.646525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.023738+0000","last_change":"2024-04-19T03:01:15.020635+0000","last_active":"2024-04-19T03:01:15.023738+0000","last_peered":"2024-04-19T03:01:15.023738+0000","last_clean":"2024-04-19T03:01:15.023738+0000","last_became_active":"2024-04-19T03:01:15.019917+0000","last_became_peered":"2024-04-19T03:01:15.019917+0000","last_unstale":"2024-04-19T03:01:15.023738+0000","last_undegraded":"2024-04-19T03:01:15.023738+0000","last_fullsized":"2024-04-19T03:01:15.023738+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:40:53.477682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.005373+0000","last_change":"2024-04-19T03:01:14.643239+0000","last_active":"2024-04-19T03:01:15.005373+0000","last_peered":"2024-04-19T03:01:15.005373+0000","last_clean":"2024-04-19T03:01:15.005373+0000","last_became_active":"2024-04-19T03:01:14.642959+0000","last_became_peered":"2024-04-19T03:01:14.642959+0000","last_unstale":"2024-04-19T03:01:15.005373+0000","last_undegraded":"2024-04-19T03:01:15.005373+0000","last_fullsized":"2024-04-19T03:01:15.005373+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:05:36.752017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-04-19T03:01:18.092865+0000","last_change":"2024-04-19T03:01:15.017708+0000","last_active":"2024-04-19T03:01:18.092865+0000","last_peered":"2024-04-19T03:01:18.092865+0000","last_clean":"2024-04-19T03:01:18.092865+0000","last_became_active":"2024-04-19T03:01:15.016726+0000","last_became_peered":"2024-04-19T03:01:15.016726+0000","last_unstale":"2024-04-19T03:01:18.092865+0000","last_undegraded":"2024-04-19T03:01:18.092865+0000","last_fullsized":"2024-04-19T03:01:18.092865+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:07:47.395052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.003022+0000","last_change":"2024-04-19T03:01:14.647744+0000","last_active":"2024-04-19T03:01:15.003022+0000","last_peered":"2024-04-19T03:01:15.003022+0000","last_clean":"2024-04-19T03:01:15.003022+0000","last_became_active":"2024-04-19T03:01:14.647463+0000","last_became_peered":"2024-04-19T03:01:14.647463+0000","last_unstale":"2024-04-19T03:01:15.003022+0000","last_undegraded":"2024-04-19T03:01:15.003022+0000","last_fullsized":"2024-04-19T03:01:15.003022+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:56:15.348940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.023345+0000","last_change":"2024-04-19T03:01:15.019045+0000","last_active":"2024-04-19T03:01:15.023345+0000","last_peered":"2024-04-19T03:01:15.023345+0000","last_clean":"2024-04-19T03:01:15.023345+0000","last_became_active":"2024-04-19T03:01:15.017982+0000","last_became_peered":"2024-04-19T03:01:15.017982+0000","last_unstale":"2024-04-19T03:01:15.023345+0000","last_undegraded":"2024-04-19T03:01:15.023345+0000","last_fullsized":"2024-04-19T03:01:15.023345+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:10:56.732208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"20'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.020345+0000","last_change":"2024-04-19T03:01:14.651050+0000","last_active":"2024-04-19T03:01:15.020345+0000","last_peered":"2024-04-19T03:01:15.020345+0000","last_clean":"2024-04-19T03:01:15.020345+0000","last_became_active":"2024-04-19T03:01:14.650639+0000","last_became_peered":"2024-04-19T03:01:14.650639+0000","last_unstale":"2024-04-19T03:01:15.020345+0000","last_undegraded":"2024-04-19T03:01:15.020345+0000","last_fullsized":"2024-04-19T03:01:15.020345+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:41:49.783896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.022916+0000","last_change":"2024-04-19T03:01:15.017319+0000","last_active":"2024-04-19T03:01:15.022916+0000","last_peered":"2024-04-19T03:01:15.022916+0000","last_clean":"2024-04-19T03:01:15.022916+0000","last_became_active":"2024-04-19T03:01:15.016815+0000","last_became_peered":"2024-04-19T03:01:15.016815+0000","last_unstale":"2024-04-19T03:01:15.022916+0000","last_undegraded":"2024-04-19T03:01:15.022916+0000","last_fullsized":"2024-04-19T03:01:15.022916+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:36:36.363535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"20'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.018447+0000","last_change":"2024-04-19T03:01:14.648823+0000","last_active":"2024-04-19T03:01:15.018447+0000","last_peered":"2024-04-19T03:01:15.018447+0000","last_clean":"2024-04-19T03:01:15.018447+0000","last_became_active":"2024-04-19T03:01:14.648337+0000","last_became_peered":"2024-04-19T03:01:14.648337+0000","last_unstale":"2024-04-19T03:01:15.018447+0000","last_undegraded":"2024-04-19T03:01:15.018447+0000","last_fullsized":"2024-04-19T03:01:15.018447+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:08:46.250118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.018663+0000","last_change":"2024-04-19T03:01:15.014773+0000","last_active":"2024-04-19T03:01:15.018663+0000","last_peered":"2024-04-19T03:01:15.018663+0000","last_clean":"2024-04-19T03:01:15.018663+0000","last_became_active":"2024-04-19T03:01:15.013919+0000","last_became_peered":"2024-04-19T03:01:15.013919+0000","last_unstale":"2024-04-19T03:01:15.018663+0000","last_undegraded":"2024-04-19T03:01:15.018663+0000","last_fullsized":"2024-04-19T03:01:15.018663+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:56:44.307812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"20'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.018107+0000","last_change":"2024-04-19T03:01:14.651049+0000","last_active":"2024-04-19T03:01:15.018107+0000","last_peered":"2024-04-19T03:01:15.018107+0000","last_clean":"2024-04-19T03:01:15.018107+0000","last_became_active":"2024-04-19T03:01:14.650646+0000","last_became_peered":"2024-04-19T03:01:14.650646+0000","last_unstale":"2024-04-19T03:01:15.018107+0000","last_undegraded":"2024-04-19T03:01:15.018107+0000","last_fullsized":"2024-04-19T03:01:15.018107+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:33:59.716591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.022142+0000","last_change":"2024-04-19T03:01:15.017860+0000","last_active":"2024-04-19T03:01:15.022142+0000","last_peered":"2024-04-19T03:01:15.022142+0000","last_clean":"2024-04-19T03:01:15.022142+0000","last_became_active":"2024-04-19T03:01:15.017355+0000","last_became_peered":"2024-04-19T03:01:15.017355+0000","last_unstale":"2024-04-19T03:01:15.022142+0000","last_undegraded":"2024-04-19T03:01:15.022142+0000","last_fullsized":"2024-04-19T03:01:15.022142+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:13:06.902769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"20'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.022312+0000","last_change":"2024-04-19T03:01:14.649277+0000","last_active":"2024-04-19T03:01:15.022312+0000","last_peered":"2024-04-19T03:01:15.022312+0000","last_clean":"2024-04-19T03:01:15.022312+0000","last_became_active":"2024-04-19T03:01:14.648614+0000","last_became_peered":"2024-04-19T03:01:14.648614+0000","last_unstale":"2024-04-19T03:01:15.022312+0000","last_undegraded":"2024-04-19T03:01:15.022312+0000","last_fullsized":"2024-04-19T03:01:15.022312+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:34:05.922324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.023028+0000","last_change":"2024-04-19T03:01:15.017986+0000","last_active":"2024-04-19T03:01:15.023028+0000","last_peered":"2024-04-19T03:01:15.023028+0000","last_clean":"2024-04-19T03:01:15.023028+0000","last_became_active":"2024-04-19T03:01:15.017080+0000","last_became_peered":"2024-04-19T03:01:15.017080+0000","last_unstale":"2024-04-19T03:01:15.023028+0000","last_undegraded":"2024-04-19T03:01:15.023028+0000","last_fullsized":"2024-04-19T03:01:15.023028+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:14:57.922917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"20'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.019052+0000","last_change":"2024-04-19T03:01:14.644015+0000","last_active":"2024-04-19T03:01:15.019052+0000","last_peered":"2024-04-19T03:01:15.019052+0000","last_clean":"2024-04-19T03:01:15.019052+0000","last_became_active":"2024-04-19T03:01:14.643769+0000","last_became_peered":"2024-04-19T03:01:14.643769+0000","last_unstale":"2024-04-19T03:01:15.019052+0000","last_undegraded":"2024-04-19T03:01:15.019052+0000","last_fullsized":"2024-04-19T03:01:15.019052+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:56:05.481089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.024302+0000","last_change":"2024-04-19T03:01:15.019466+0000","last_active":"2024-04-19T03:01:15.024302+0000","last_peered":"2024-04-19T03:01:15.024302+0000","last_clean":"2024-04-19T03:01:15.024302+0000","last_became_active":"2024-04-19T03:01:15.018819+0000","last_became_peered":"2024-04-19T03:01:15.018819+0000","last_unstale":"2024-04-19T03:01:15.024302+0000","last_undegraded":"2024-04-19T03:01:15.024302+0000","last_fullsized":"2024-04-19T03:01:15.024302+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:13:26.030579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"20'4","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-19T03:01:15.020064+0000","last_change":"2024-04-19T03:01:14.647358+0000","last_active":"2024-04-19T03:01:15.020064+0000","last_peered":"2024-04-19T03:01:15.020064+0000","last_clean":"2024-04-19T03:01:15.020064+0000","last_became_active":"2024-04-19T03:01:14.646998+0000","last_became_peered":"2024-04-19T03:01:14.646998+0000","last_unstale":"2024-04-19T03:01:15.020064+0000","last_undegraded":"2024-04-19T03:01:15.020064+0000","last_fullsized":"2024-04-19T03:01:15.020064+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:09:04.022991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":14482,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":10,"seq":42949672971,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31380,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340460,"statfs":{"total":96636764160,"available":96604631040,"internally_reserved":0,"allocated":270336,"data_stored":654544,"data_compressed":7241,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54900000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65900000000000003}]}]},{"osd":1,"up_from":10,"seq":42949672970,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31372,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340468,"statfs":{"total":96636764160,"available":96604639232,"internally_reserved":0,"allocated":262144,"data_stored":653928,"data_compressed":7241,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53100000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69799999999999995}]}]},{"osd":0,"up_from":9,"seq":38654705673,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31300,"kb_used_data":184,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340540,"statfs":{"total":96636764160,"available":96604712960,"internally_reserved":0,"allocated":188416,"data_stored":62430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55400000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":7241,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":7241,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-19T03:01:34.283 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-19T03:01:34.283 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump 2024-04-19T03:01:34.577 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 21 2024-04-19T03:01:34.578 INFO:teuthology.orchestra.run.smithi096.stdout:fsid c6cc8e09-11d4-48de-9a6c-4d70ed3c3789 2024-04-19T03:01:34.578 INFO:teuthology.orchestra.run.smithi096.stdout:created 2024-04-19T03:00:53.746146+0000 2024-04-19T03:01:34.578 INFO:teuthology.orchestra.run.smithi096.stdout:modified 2024-04-19T03:01:15.992289+0000 2024-04-19T03:01:34.578 INFO:teuthology.orchestra.run.smithi096.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-04-19T03:01:34.578 INFO:teuthology.orchestra.run.smithi096.stdout:crush_version 5 2024-04-19T03:01:34.578 INFO:teuthology.orchestra.run.smithi096.stdout:full_ratio 0.95 2024-04-19T03:01:34.578 INFO:teuthology.orchestra.run.smithi096.stdout:backfillfull_ratio 0.9 2024-04-19T03:01:34.578 INFO:teuthology.orchestra.run.smithi096.stdout:nearfull_ratio 0.85 2024-04-19T03:01:34.578 INFO:teuthology.orchestra.run.smithi096.stdout:require_min_compat_client luminous 2024-04-19T03:01:34.578 INFO:teuthology.orchestra.run.smithi096.stdout:min_compat_client jewel 2024-04-19T03:01:34.578 INFO:teuthology.orchestra.run.smithi096.stdout:require_osd_release reef 2024-04-19T03:01:34.579 INFO:teuthology.orchestra.run.smithi096.stdout:stretch_mode_enabled false 2024-04-19T03:01:34.579 INFO:teuthology.orchestra.run.smithi096.stdout:pool 1 '.mgr' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 14 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 2.99 2024-04-19T03:01:34.579 INFO:teuthology.orchestra.run.smithi096.stdout:pool 2 'rbd' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 8 pgp_num 8 autoscale_mode off last_change 17 flags hashpspool stripe_width 0 application rbd read_balance_score 1.50 2024-04-19T03:01:34.579 INFO:teuthology.orchestra.run.smithi096.stdout:pool 3 'cephfs_metadata' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 20 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 1.13 2024-04-19T03:01:34.579 INFO:teuthology.orchestra.run.smithi096.stdout:pool 4 'cephfs_data' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 21 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.9 application cephfs read_balance_score 1.13 2024-04-19T03:01:34.579 INFO:teuthology.orchestra.run.smithi096.stdout:max_osd 3 2024-04-19T03:01:34.579 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 up in weight 1 up_from 9 up_thru 19 down_at 0 last_clean_interval [0,0) [v2:172.21.15.97:6800/18245,v1:172.21.15.97:6801/18245] [v2:172.21.15.97:6802/18245,v1:172.21.15.97:6803/18245] exists,up 05ecb884-2c30-44f7-aa14-90154f9bbe9a 2024-04-19T03:01:34.579 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 up in weight 1 up_from 10 up_thru 19 down_at 0 last_clean_interval [0,0) [v2:172.21.15.134:6800/18145,v1:172.21.15.134:6801/18145] [v2:172.21.15.134:6802/18145,v1:172.21.15.134:6803/18145] exists,up efc873e0-69c3-4a57-8ee5-41f836b65f47 2024-04-19T03:01:34.579 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 up in weight 1 up_from 10 up_thru 19 down_at 0 last_clean_interval [0,0) [v2:172.21.15.144:6800/18223,v1:172.21.15.144:6801/18223] [v2:172.21.15.144:6802/18223,v1:172.21.15.144:6803/18223] exists,up 229278a0-dd93-4234-9065-e4f2f6188ef2 2024-04-19T03:01:34.597 INFO:tasks.ceph.ceph_manager.ceph:['osd.0 up in weight 1 up_from 9 up_thru 19 down_at 0 last_clean_interval [0,0) [v2:172.21.15.97:6800/18245,v1:172.21.15.97:6801/18245] [v2:172.21.15.97:6802/18245,v1:172.21.15.97:6803/18245] exists,up 05ecb884-2c30-44f7-aa14-90154f9bbe9a', 'osd.1 up in weight 1 up_from 10 up_thru 19 down_at 0 last_clean_interval [0,0) [v2:172.21.15.134:6800/18145,v1:172.21.15.134:6801/18145] [v2:172.21.15.134:6802/18145,v1:172.21.15.134:6803/18145] exists,up efc873e0-69c3-4a57-8ee5-41f836b65f47', 'osd.2 up in weight 1 up_from 10 up_thru 19 down_at 0 last_clean_interval [0,0) [v2:172.21.15.144:6800/18223,v1:172.21.15.144:6801/18223] [v2:172.21.15.144:6802/18223,v1:172.21.15.144:6803/18223] exists,up 229278a0-dd93-4234-9065-e4f2f6188ef2'] 2024-04-19T03:01:34.597 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok config show 2024-04-19T03:01:34.696 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-04-19T03:01:34.697 INFO:teuthology.orchestra.run.smithi096.stdout: "name": "mon.a", 2024-04-19T03:01:34.697 INFO:teuthology.orchestra.run.smithi096.stdout: "cluster": "ceph", 2024-04-19T03:01:34.697 INFO:teuthology.orchestra.run.smithi096.stdout: "admin_socket": "/var/run/ceph/ceph-mon.a.asok", 2024-04-19T03:01:34.697 INFO:teuthology.orchestra.run.smithi096.stdout: "admin_socket_mode": "", 2024-04-19T03:01:34.697 INFO:teuthology.orchestra.run.smithi096.stdout: "auth_allow_insecure_global_id_reclaim": "true", 2024-04-19T03:01:34.697 INFO:teuthology.orchestra.run.smithi096.stdout: "auth_client_required": "cephx, none", 2024-04-19T03:01:34.697 INFO:teuthology.orchestra.run.smithi096.stdout: "auth_cluster_required": "cephx", 2024-04-19T03:01:34.697 INFO:teuthology.orchestra.run.smithi096.stdout: "auth_debug": "true", 2024-04-19T03:01:34.697 INFO:teuthology.orchestra.run.smithi096.stdout: "auth_expose_insecure_global_id_reclaim": "true", 2024-04-19T03:01:34.697 INFO:teuthology.orchestra.run.smithi096.stdout: "auth_mon_ticket_ttl": "660.000000", 2024-04-19T03:01:34.697 INFO:teuthology.orchestra.run.smithi096.stdout: "auth_service_required": "cephx", 2024-04-19T03:01:34.698 INFO:teuthology.orchestra.run.smithi096.stdout: "auth_service_ticket_ttl": "240.000000", 2024-04-19T03:01:34.698 INFO:teuthology.orchestra.run.smithi096.stdout: "auth_supported": "cephx", 2024-04-19T03:01:34.698 INFO:teuthology.orchestra.run.smithi096.stdout: "bdev_aio": "true", 2024-04-19T03:01:34.698 INFO:teuthology.orchestra.run.smithi096.stdout: "bdev_aio_max_queue_depth": "1024", 2024-04-19T03:01:34.698 INFO:teuthology.orchestra.run.smithi096.stdout: "bdev_aio_poll_ms": "250", 2024-04-19T03:01:34.698 INFO:teuthology.orchestra.run.smithi096.stdout: "bdev_aio_reap_max": "16", 2024-04-19T03:01:34.698 INFO:teuthology.orchestra.run.smithi096.stdout: "bdev_async_discard": "false", 2024-04-19T03:01:34.698 INFO:teuthology.orchestra.run.smithi096.stdout: "bdev_block_size": "4096", 2024-04-19T03:01:34.698 INFO:teuthology.orchestra.run.smithi096.stdout: "bdev_debug_aio": "false", 2024-04-19T03:01:34.698 INFO:teuthology.orchestra.run.smithi096.stdout: "bdev_debug_aio_log_age": "5.000000", 2024-04-19T03:01:34.698 INFO:teuthology.orchestra.run.smithi096.stdout: "bdev_debug_aio_suicide_timeout": "60.000000", 2024-04-19T03:01:34.698 INFO:teuthology.orchestra.run.smithi096.stdout: "bdev_debug_inflight_ios": "false", 2024-04-19T03:01:34.698 INFO:teuthology.orchestra.run.smithi096.stdout: "bdev_enable_discard": "false", 2024-04-19T03:01:34.698 INFO:teuthology.orchestra.run.smithi096.stdout: "bdev_flock_retry": "3", 2024-04-19T03:01:34.699 INFO:teuthology.orchestra.run.smithi096.stdout: "bdev_flock_retry_interval": "0.100000", 2024-04-19T03:01:34.699 INFO:teuthology.orchestra.run.smithi096.stdout: "bdev_inject_crash": "0", 2024-04-19T03:01:34.699 INFO:teuthology.orchestra.run.smithi096.stdout: "bdev_inject_crash_flush_delay": "2", 2024-04-19T03:01:34.699 INFO:teuthology.orchestra.run.smithi096.stdout: "bdev_ioring": "false", 2024-04-19T03:01:34.699 INFO:teuthology.orchestra.run.smithi096.stdout: "bdev_ioring_hipri": "false", 2024-04-19T03:01:34.699 INFO:teuthology.orchestra.run.smithi096.stdout: "bdev_ioring_sqthread_poll": "false", 2024-04-19T03:01:34.699 INFO:teuthology.orchestra.run.smithi096.stdout: "bdev_nvme_unbind_from_kernel": "false", 2024-04-19T03:01:34.699 INFO:teuthology.orchestra.run.smithi096.stdout: "bdev_read_buffer_alignment": "4096", 2024-04-19T03:01:34.699 INFO:teuthology.orchestra.run.smithi096.stdout: "bdev_read_preallocated_huge_buffers": "", 2024-04-19T03:01:34.699 INFO:teuthology.orchestra.run.smithi096.stdout: "bdev_type": "", 2024-04-19T03:01:34.699 INFO:teuthology.orchestra.run.smithi096.stdout: "bluefs_alloc_size": "1048576", 2024-04-19T03:01:34.699 INFO:teuthology.orchestra.run.smithi096.stdout: "bluefs_allocator": "hybrid", 2024-04-19T03:01:34.699 INFO:teuthology.orchestra.run.smithi096.stdout: "bluefs_buffered_io": "true", 2024-04-19T03:01:34.700 INFO:teuthology.orchestra.run.smithi096.stdout: "bluefs_check_for_zeros": "false", 2024-04-19T03:01:34.700 INFO:teuthology.orchestra.run.smithi096.stdout: "bluefs_check_volume_selector_often": "false", 2024-04-19T03:01:34.700 INFO:teuthology.orchestra.run.smithi096.stdout: "bluefs_check_volume_selector_on_umount": "false", 2024-04-19T03:01:34.700 INFO:teuthology.orchestra.run.smithi096.stdout: "bluefs_compact_log_sync": "false", 2024-04-19T03:01:34.700 INFO:teuthology.orchestra.run.smithi096.stdout: "bluefs_failed_shared_alloc_cooldown": "600.000000", 2024-04-19T03:01:34.700 INFO:teuthology.orchestra.run.smithi096.stdout: "bluefs_log_compact_min_ratio": "5.000000", 2024-04-19T03:01:34.700 INFO:teuthology.orchestra.run.smithi096.stdout: "bluefs_log_compact_min_size": "16777216", 2024-04-19T03:01:34.700 INFO:teuthology.orchestra.run.smithi096.stdout: "bluefs_log_replay_check_allocations": "true", 2024-04-19T03:01:34.700 INFO:teuthology.orchestra.run.smithi096.stdout: "bluefs_max_log_runway": "4194304", 2024-04-19T03:01:34.700 INFO:teuthology.orchestra.run.smithi096.stdout: "bluefs_max_prefetch": "1048576", 2024-04-19T03:01:34.700 INFO:teuthology.orchestra.run.smithi096.stdout: "bluefs_min_flush_size": "524288", 2024-04-19T03:01:34.700 INFO:teuthology.orchestra.run.smithi096.stdout: "bluefs_min_log_runway": "1048576", 2024-04-19T03:01:34.700 INFO:teuthology.orchestra.run.smithi096.stdout: "bluefs_replay_recovery": "false", 2024-04-19T03:01:34.700 INFO:teuthology.orchestra.run.smithi096.stdout: "bluefs_replay_recovery_disable_compact": "false", 2024-04-19T03:01:34.701 INFO:teuthology.orchestra.run.smithi096.stdout: "bluefs_shared_alloc_size": "65536", 2024-04-19T03:01:34.701 INFO:teuthology.orchestra.run.smithi096.stdout: "bluefs_sync_write": "false", 2024-04-19T03:01:34.701 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_2q_cache_kin_ratio": "0.500000", 2024-04-19T03:01:34.701 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_2q_cache_kout_ratio": "0.500000", 2024-04-19T03:01:34.701 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_alloc_stats_dump_interval": "86400.000000", 2024-04-19T03:01:34.701 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_allocation_from_file": "true", 2024-04-19T03:01:34.701 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_allocator": "hybrid", 2024-04-19T03:01:34.701 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_avl_alloc_bf_free_pct": "4", 2024-04-19T03:01:34.701 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_avl_alloc_bf_threshold": "131072", 2024-04-19T03:01:34.701 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_avl_alloc_ff_max_search_bytes": "16777216", 2024-04-19T03:01:34.701 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_avl_alloc_ff_max_search_count": "100", 2024-04-19T03:01:34.701 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_bitmapallocator_blocks_per_zone": "1024", 2024-04-19T03:01:34.701 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_bitmapallocator_span_size": "1024", 2024-04-19T03:01:34.702 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_blobid_prealloc": "10240", 2024-04-19T03:01:34.702 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_block_create": "true", 2024-04-19T03:01:34.702 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_block_db_create": "false", 2024-04-19T03:01:34.702 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_block_db_path": "", 2024-04-19T03:01:34.702 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_block_db_size": "0", 2024-04-19T03:01:34.702 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_block_path": "", 2024-04-19T03:01:34.702 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_block_preallocate_file": "false", 2024-04-19T03:01:34.702 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_block_size": "107374182400", 2024-04-19T03:01:34.702 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_block_wal_create": "false", 2024-04-19T03:01:34.702 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_block_wal_path": "", 2024-04-19T03:01:34.702 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_block_wal_size": "100663296", 2024-04-19T03:01:34.702 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_bluefs": "true", 2024-04-19T03:01:34.702 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_bluefs_alloc_failure_dump_interval": "0.000000", 2024-04-19T03:01:34.703 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_bluefs_env_mirror": "false", 2024-04-19T03:01:34.703 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_bluefs_max_free": "10737418240", 2024-04-19T03:01:34.703 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_cache_age_bin_interval": "1.000000", 2024-04-19T03:01:34.703 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_cache_age_bins_data": "1 2 6 24 120 720 0 0 0 0", 2024-04-19T03:01:34.703 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_cache_age_bins_kv": "1 2 6 24 120 720 0 0 0 0", 2024-04-19T03:01:34.703 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_cache_age_bins_kv_onode": "0 0 0 0 0 0 0 0 0 720", 2024-04-19T03:01:34.703 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_cache_age_bins_meta": "1 2 6 24 120 720 0 0 0 0", 2024-04-19T03:01:34.703 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_cache_autotune": "true", 2024-04-19T03:01:34.703 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_cache_autotune_interval": "5.000000", 2024-04-19T03:01:34.703 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_cache_kv_onode_ratio": "0.040000", 2024-04-19T03:01:34.703 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_cache_kv_ratio": "0.450000", 2024-04-19T03:01:34.703 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_cache_meta_ratio": "0.450000", 2024-04-19T03:01:34.703 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_cache_size": "0", 2024-04-19T03:01:34.704 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_cache_size_hdd": "1073741824", 2024-04-19T03:01:34.704 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_cache_size_ssd": "3221225472", 2024-04-19T03:01:34.704 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_cache_trim_interval": "0.050000", 2024-04-19T03:01:34.704 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_cache_trim_max_skip_pinned": "1000", 2024-04-19T03:01:34.704 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_cache_type": "2q", 2024-04-19T03:01:34.704 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_cleaner_sleep_interval": "5.000000", 2024-04-19T03:01:34.704 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_clone_cow": "true", 2024-04-19T03:01:34.704 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_compression_algorithm": "snappy", 2024-04-19T03:01:34.704 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_compression_max_blob_size": "0", 2024-04-19T03:01:34.704 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_compression_max_blob_size_hdd": "65536", 2024-04-19T03:01:34.704 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_compression_max_blob_size_ssd": "65536", 2024-04-19T03:01:34.704 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_compression_min_blob_size": "0", 2024-04-19T03:01:34.704 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_compression_min_blob_size_hdd": "8192", 2024-04-19T03:01:34.704 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_compression_min_blob_size_ssd": "65536", 2024-04-19T03:01:34.705 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_compression_mode": "none", 2024-04-19T03:01:34.705 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_compression_required_ratio": "0.875000", 2024-04-19T03:01:34.705 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_csum_type": "crc32c", 2024-04-19T03:01:34.705 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_debug_enforce_settings": "default", 2024-04-19T03:01:34.705 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_debug_freelist": "false", 2024-04-19T03:01:34.705 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_debug_fsck_abort": "false", 2024-04-19T03:01:34.705 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_debug_inject_allocation_from_file_failure": "0.000000", 2024-04-19T03:01:34.705 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_debug_inject_bug21040": "false", 2024-04-19T03:01:34.705 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_debug_inject_csum_err_probability": "0.000000", 2024-04-19T03:01:34.705 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_debug_inject_read_err": "false", 2024-04-19T03:01:34.705 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_debug_legacy_omap": "false", 2024-04-19T03:01:34.705 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_debug_no_reuse_blocks": "false", 2024-04-19T03:01:34.705 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_debug_omit_block_device_write": "false", 2024-04-19T03:01:34.706 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_debug_omit_kv_commit": "false", 2024-04-19T03:01:34.706 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_debug_permit_any_bdev_label": "false", 2024-04-19T03:01:34.706 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_debug_prefill": "0.000000", 2024-04-19T03:01:34.706 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_debug_prefragment_max": "1048576", 2024-04-19T03:01:34.706 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_debug_random_read_err": "0.000000", 2024-04-19T03:01:34.706 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_debug_randomize_serial_transaction": "0", 2024-04-19T03:01:34.706 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_debug_small_allocations": "0", 2024-04-19T03:01:34.706 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_debug_too_many_blobs_threshold": "24576", 2024-04-19T03:01:34.706 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_default_buffered_read": "true", 2024-04-19T03:01:34.706 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_default_buffered_write": "false", 2024-04-19T03:01:34.706 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_deferred_batch_ops": "0", 2024-04-19T03:01:34.706 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_deferred_batch_ops_hdd": "64", 2024-04-19T03:01:34.706 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_deferred_batch_ops_ssd": "16", 2024-04-19T03:01:34.707 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_extent_map_inline_shard_prealloc_size": "256", 2024-04-19T03:01:34.707 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_extent_map_shard_max_size": "1200", 2024-04-19T03:01:34.707 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_extent_map_shard_min_size": "150", 2024-04-19T03:01:34.707 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_extent_map_shard_target_size": "500", 2024-04-19T03:01:34.707 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_extent_map_shard_target_size_slop": "0.200000", 2024-04-19T03:01:34.707 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_fail_eio": "false", 2024-04-19T03:01:34.707 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_freelist_blocks_per_key": "128", 2024-04-19T03:01:34.707 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_fsck_error_on_no_per_pg_omap": "false", 2024-04-19T03:01:34.707 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_fsck_error_on_no_per_pool_omap": "false", 2024-04-19T03:01:34.707 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_fsck_error_on_no_per_pool_stats": "false", 2024-04-19T03:01:34.707 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_fsck_on_mkfs": "true", 2024-04-19T03:01:34.707 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_fsck_on_mkfs_deep": "false", 2024-04-19T03:01:34.707 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_fsck_on_mount": "false", 2024-04-19T03:01:34.707 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_fsck_on_mount_deep": "false", 2024-04-19T03:01:34.707 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_fsck_on_umount": "false", 2024-04-19T03:01:34.708 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_fsck_on_umount_deep": "false", 2024-04-19T03:01:34.708 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_fsck_quick_fix_on_mount": "false", 2024-04-19T03:01:34.708 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_fsck_quick_fix_threads": "2", 2024-04-19T03:01:34.708 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_fsck_read_bytes_cap": "67108864", 2024-04-19T03:01:34.708 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_fsck_shared_blob_tracker_size": "0.031250", 2024-04-19T03:01:34.708 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_gc_enable_blob_threshold": "0", 2024-04-19T03:01:34.708 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_gc_enable_total_threshold": "0", 2024-04-19T03:01:34.708 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_hybrid_alloc_mem_cap": "67108864", 2024-04-19T03:01:34.708 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_ignore_data_csum": "false", 2024-04-19T03:01:34.708 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_kv_sync_util_logging_s": "10.000000", 2024-04-19T03:01:34.708 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_kvbackend": "rocksdb", 2024-04-19T03:01:34.708 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_log_collection_list_age": "60.000000", 2024-04-19T03:01:34.708 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_log_omap_iterator_age": "5.000000", 2024-04-19T03:01:34.708 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_log_op_age": "5.000000", 2024-04-19T03:01:34.709 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_max_alloc_size": "0", 2024-04-19T03:01:34.709 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_max_blob_size": "0", 2024-04-19T03:01:34.709 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_max_blob_size_hdd": "65536", 2024-04-19T03:01:34.709 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_max_blob_size_ssd": "65536", 2024-04-19T03:01:34.709 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_max_defer_interval": "3.000000", 2024-04-19T03:01:34.709 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_max_deferred_txc": "32", 2024-04-19T03:01:34.709 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_min_alloc_size": "0", 2024-04-19T03:01:34.709 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_min_alloc_size_hdd": "4096", 2024-04-19T03:01:34.709 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_min_alloc_size_ssd": "4096", 2024-04-19T03:01:34.709 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_nid_prealloc": "1024", 2024-04-19T03:01:34.709 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_prefer_deferred_size": "0", 2024-04-19T03:01:34.709 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_prefer_deferred_size_hdd": "65536", 2024-04-19T03:01:34.709 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_prefer_deferred_size_ssd": "0", 2024-04-19T03:01:34.710 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_qfsck_on_mount": "true", 2024-04-19T03:01:34.710 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_retry_disk_reads": "3", 2024-04-19T03:01:34.710 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_rocksdb_cf": "true", 2024-04-19T03:01:34.710 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_rocksdb_cfs": "m(3) p(3,0-12) O(3,0-13)=block_cache={type=binned_lru} L=min_write_buffer_number_to_merge=32 P=min_write_buffer_number_to_merge=32", 2024-04-19T03:01:34.710 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_rocksdb_options": "compression=kLZ4Compression,max_write_buffer_number=64,min_write_buffer_number_to_merge=6,compaction_style=kCompactionStyleLevel,write_buffer_size=16777216,max_background_jobs=4,level0_file_num_compaction_trigger=8,max_bytes_for_level_base=1073741824,max_bytes_for_level_multiplier=8,compaction_readahead_size=2MB,max_total_wal_size=1073741824,writable_file_max_buffer_size=0", 2024-04-19T03:01:34.710 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_rocksdb_options_annex": "", 2024-04-19T03:01:34.710 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_spdk_coremask": "0x1", 2024-04-19T03:01:34.710 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_spdk_io_sleep": "5", 2024-04-19T03:01:34.710 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_spdk_max_io_completion": "0", 2024-04-19T03:01:34.710 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_spdk_mem": "512", 2024-04-19T03:01:34.710 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_sync_submit_transaction": "false", 2024-04-19T03:01:34.710 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_throttle_bytes": "67108864", 2024-04-19T03:01:34.710 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_throttle_cost_per_io": "0", 2024-04-19T03:01:34.711 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_throttle_cost_per_io_hdd": "670000", 2024-04-19T03:01:34.711 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_throttle_cost_per_io_ssd": "4000", 2024-04-19T03:01:34.711 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_throttle_deferred_bytes": "134217728", 2024-04-19T03:01:34.711 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_throttle_trace_rate": "0.000000", 2024-04-19T03:01:34.711 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_tracing": "false", 2024-04-19T03:01:34.711 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_use_optimal_io_size_for_min_alloc_size": "false", 2024-04-19T03:01:34.711 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_volume_selection_policy": "use_some_extra", 2024-04-19T03:01:34.711 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_volume_selection_reserved": "0", 2024-04-19T03:01:34.711 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_volume_selection_reserved_factor": "2.000000", 2024-04-19T03:01:34.711 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_warn_on_bluefs_spillover": "true", 2024-04-19T03:01:34.711 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_warn_on_legacy_statfs": "true", 2024-04-19T03:01:34.711 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_warn_on_no_per_pg_omap": "false", 2024-04-19T03:01:34.711 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_warn_on_no_per_pool_omap": "true", 2024-04-19T03:01:34.711 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_warn_on_spurious_read_errors": "true", 2024-04-19T03:01:34.712 INFO:teuthology.orchestra.run.smithi096.stdout: "bluestore_zero_block_detection": "false", 2024-04-19T03:01:34.712 INFO:teuthology.orchestra.run.smithi096.stdout: "cephadm_path": "/usr/sbin/cephadm", 2024-04-19T03:01:34.712 INFO:teuthology.orchestra.run.smithi096.stdout: "cephfs_mirror_action_update_interval": "2", 2024-04-19T03:01:34.712 INFO:teuthology.orchestra.run.smithi096.stdout: "cephfs_mirror_directory_scan_interval": "10", 2024-04-19T03:01:34.712 INFO:teuthology.orchestra.run.smithi096.stdout: "cephfs_mirror_max_concurrent_directory_syncs": "3", 2024-04-19T03:01:34.712 INFO:teuthology.orchestra.run.smithi096.stdout: "cephfs_mirror_max_consecutive_failures_per_directory": "10", 2024-04-19T03:01:34.712 INFO:teuthology.orchestra.run.smithi096.stdout: "cephfs_mirror_max_snapshot_sync_per_cycle": "3", 2024-04-19T03:01:34.712 INFO:teuthology.orchestra.run.smithi096.stdout: "cephfs_mirror_mount_timeout": "10", 2024-04-19T03:01:34.712 INFO:teuthology.orchestra.run.smithi096.stdout: "cephfs_mirror_perf_stats_prio": "5", 2024-04-19T03:01:34.712 INFO:teuthology.orchestra.run.smithi096.stdout: "cephfs_mirror_restart_mirror_on_blocklist_interval": "30", 2024-04-19T03:01:34.712 INFO:teuthology.orchestra.run.smithi096.stdout: "cephfs_mirror_restart_mirror_on_failure_interval": "20", 2024-04-19T03:01:34.712 INFO:teuthology.orchestra.run.smithi096.stdout: "cephfs_mirror_retry_failed_directories_interval": "60", 2024-04-19T03:01:34.712 INFO:teuthology.orchestra.run.smithi096.stdout: "cephsqlite_blocklist_dead_locker": "true", 2024-04-19T03:01:34.712 INFO:teuthology.orchestra.run.smithi096.stdout: "cephsqlite_lock_renewal_interval": "2000", 2024-04-19T03:01:34.713 INFO:teuthology.orchestra.run.smithi096.stdout: "cephsqlite_lock_renewal_timeout": "30000", 2024-04-19T03:01:34.713 INFO:teuthology.orchestra.run.smithi096.stdout: "cephx_cluster_require_signatures": "false", 2024-04-19T03:01:34.713 INFO:teuthology.orchestra.run.smithi096.stdout: "cephx_cluster_require_version": "2", 2024-04-19T03:01:34.713 INFO:teuthology.orchestra.run.smithi096.stdout: "cephx_require_signatures": "false", 2024-04-19T03:01:34.713 INFO:teuthology.orchestra.run.smithi096.stdout: "cephx_require_version": "2", 2024-04-19T03:01:34.713 INFO:teuthology.orchestra.run.smithi096.stdout: "cephx_service_require_signatures": "false", 2024-04-19T03:01:34.713 INFO:teuthology.orchestra.run.smithi096.stdout: "cephx_service_require_version": "2", 2024-04-19T03:01:34.713 INFO:teuthology.orchestra.run.smithi096.stdout: "cephx_sign_messages": "true", 2024-04-19T03:01:34.713 INFO:teuthology.orchestra.run.smithi096.stdout: "chdir": "", 2024-04-19T03:01:34.713 INFO:teuthology.orchestra.run.smithi096.stdout: "client_acl_type": "", 2024-04-19T03:01:34.713 INFO:teuthology.orchestra.run.smithi096.stdout: "client_asio_thread_count": "2", 2024-04-19T03:01:34.713 INFO:teuthology.orchestra.run.smithi096.stdout: "client_cache_mid": "0.750000", 2024-04-19T03:01:34.713 INFO:teuthology.orchestra.run.smithi096.stdout: "client_cache_size": "16384", 2024-04-19T03:01:34.714 INFO:teuthology.orchestra.run.smithi096.stdout: "client_caps_release_delay": "5", 2024-04-19T03:01:34.714 INFO:teuthology.orchestra.run.smithi096.stdout: "client_check_pool_perm": "true", 2024-04-19T03:01:34.714 INFO:teuthology.orchestra.run.smithi096.stdout: "client_collect_and_send_global_metrics": "false", 2024-04-19T03:01:34.714 INFO:teuthology.orchestra.run.smithi096.stdout: "client_debug_force_sync_read": "false", 2024-04-19T03:01:34.714 INFO:teuthology.orchestra.run.smithi096.stdout: "client_debug_getattr_caps": "false", 2024-04-19T03:01:34.714 INFO:teuthology.orchestra.run.smithi096.stdout: "client_debug_inject_tick_delay": "0", 2024-04-19T03:01:34.714 INFO:teuthology.orchestra.run.smithi096.stdout: "client_die_on_failed_dentry_invalidate": "true", 2024-04-19T03:01:34.714 INFO:teuthology.orchestra.run.smithi096.stdout: "client_die_on_failed_remount": "false", 2024-04-19T03:01:34.714 INFO:teuthology.orchestra.run.smithi096.stdout: "client_dirsize_rbytes": "true", 2024-04-19T03:01:34.714 INFO:teuthology.orchestra.run.smithi096.stdout: "client_force_lazyio": "false", 2024-04-19T03:01:34.714 INFO:teuthology.orchestra.run.smithi096.stdout: "client_fs": "", 2024-04-19T03:01:34.714 INFO:teuthology.orchestra.run.smithi096.stdout: "client_inject_fixed_oldest_tid": "false", 2024-04-19T03:01:34.714 INFO:teuthology.orchestra.run.smithi096.stdout: "client_inject_release_failure": "false", 2024-04-19T03:01:34.715 INFO:teuthology.orchestra.run.smithi096.stdout: "client_max_inline_size": "4096", 2024-04-19T03:01:34.715 INFO:teuthology.orchestra.run.smithi096.stdout: "client_max_retries_on_remount_failure": "5", 2024-04-19T03:01:34.715 INFO:teuthology.orchestra.run.smithi096.stdout: "client_mds_namespace": "", 2024-04-19T03:01:34.715 INFO:teuthology.orchestra.run.smithi096.stdout: "client_metadata": "", 2024-04-19T03:01:34.715 INFO:teuthology.orchestra.run.smithi096.stdout: "client_mount_gid": "-1", 2024-04-19T03:01:34.715 INFO:teuthology.orchestra.run.smithi096.stdout: "client_mount_timeout": "300", 2024-04-19T03:01:34.715 INFO:teuthology.orchestra.run.smithi096.stdout: "client_mount_uid": "-1", 2024-04-19T03:01:34.715 INFO:teuthology.orchestra.run.smithi096.stdout: "client_mountpoint": "/", 2024-04-19T03:01:34.715 INFO:teuthology.orchestra.run.smithi096.stdout: "client_notify_timeout": "10", 2024-04-19T03:01:34.715 INFO:teuthology.orchestra.run.smithi096.stdout: "client_oc": "true", 2024-04-19T03:01:34.715 INFO:teuthology.orchestra.run.smithi096.stdout: "client_oc_max_dirty": "104857600", 2024-04-19T03:01:34.715 INFO:teuthology.orchestra.run.smithi096.stdout: "client_oc_max_dirty_age": "5.000000", 2024-04-19T03:01:34.715 INFO:teuthology.orchestra.run.smithi096.stdout: "client_oc_max_objects": "1000", 2024-04-19T03:01:34.716 INFO:teuthology.orchestra.run.smithi096.stdout: "client_oc_size": "209715200", 2024-04-19T03:01:34.716 INFO:teuthology.orchestra.run.smithi096.stdout: "client_oc_target_dirty": "8388608", 2024-04-19T03:01:34.716 INFO:teuthology.orchestra.run.smithi096.stdout: "client_permissions": "true", 2024-04-19T03:01:34.716 INFO:teuthology.orchestra.run.smithi096.stdout: "client_quota": "true", 2024-04-19T03:01:34.716 INFO:teuthology.orchestra.run.smithi096.stdout: "client_quota_df": "true", 2024-04-19T03:01:34.716 INFO:teuthology.orchestra.run.smithi096.stdout: "client_readahead_max_bytes": "0", 2024-04-19T03:01:34.716 INFO:teuthology.orchestra.run.smithi096.stdout: "client_readahead_max_periods": "4", 2024-04-19T03:01:34.716 INFO:teuthology.orchestra.run.smithi096.stdout: "client_readahead_min": "131072", 2024-04-19T03:01:34.716 INFO:teuthology.orchestra.run.smithi096.stdout: "client_reconnect_stale": "false", 2024-04-19T03:01:34.716 INFO:teuthology.orchestra.run.smithi096.stdout: "client_shutdown_timeout": "30", 2024-04-19T03:01:34.716 INFO:teuthology.orchestra.run.smithi096.stdout: "client_snapdir": ".snap", 2024-04-19T03:01:34.716 INFO:teuthology.orchestra.run.smithi096.stdout: "client_tick_interval": "1", 2024-04-19T03:01:34.716 INFO:teuthology.orchestra.run.smithi096.stdout: "client_trace": "", 2024-04-19T03:01:34.716 INFO:teuthology.orchestra.run.smithi096.stdout: "client_try_dentry_invalidate": "false", 2024-04-19T03:01:34.716 INFO:teuthology.orchestra.run.smithi096.stdout: "client_use_faked_inos": "false", 2024-04-19T03:01:34.717 INFO:teuthology.orchestra.run.smithi096.stdout: "client_use_random_mds": "false", 2024-04-19T03:01:34.717 INFO:teuthology.orchestra.run.smithi096.stdout: "clog_to_graylog": "false", 2024-04-19T03:01:34.717 INFO:teuthology.orchestra.run.smithi096.stdout: "clog_to_graylog_host": "127.0.0.1", 2024-04-19T03:01:34.717 INFO:teuthology.orchestra.run.smithi096.stdout: "clog_to_graylog_port": "12201", 2024-04-19T03:01:34.717 INFO:teuthology.orchestra.run.smithi096.stdout: "clog_to_monitors": "default=true", 2024-04-19T03:01:34.717 INFO:teuthology.orchestra.run.smithi096.stdout: "clog_to_syslog": "false", 2024-04-19T03:01:34.717 INFO:teuthology.orchestra.run.smithi096.stdout: "clog_to_syslog_facility": "default=daemon audit=local0", 2024-04-19T03:01:34.717 INFO:teuthology.orchestra.run.smithi096.stdout: "clog_to_syslog_level": "info", 2024-04-19T03:01:34.717 INFO:teuthology.orchestra.run.smithi096.stdout: "cluster_addr": "-", 2024-04-19T03:01:34.717 INFO:teuthology.orchestra.run.smithi096.stdout: "cluster_network": "", 2024-04-19T03:01:34.717 INFO:teuthology.orchestra.run.smithi096.stdout: "cluster_network_interface": "", 2024-04-19T03:01:34.717 INFO:teuthology.orchestra.run.smithi096.stdout: "compressor_zlib_isal": "false", 2024-04-19T03:01:34.717 INFO:teuthology.orchestra.run.smithi096.stdout: "compressor_zlib_level": "5", 2024-04-19T03:01:34.717 INFO:teuthology.orchestra.run.smithi096.stdout: "compressor_zlib_winsize": "-15", 2024-04-19T03:01:34.718 INFO:teuthology.orchestra.run.smithi096.stdout: "compressor_zstd_level": "1", 2024-04-19T03:01:34.718 INFO:teuthology.orchestra.run.smithi096.stdout: "container_image": "docker.io/ceph/daemon-base:latest-master-devel", 2024-04-19T03:01:34.718 INFO:teuthology.orchestra.run.smithi096.stdout: "crash_dir": "/var/lib/ceph/crash", 2024-04-19T03:01:34.718 INFO:teuthology.orchestra.run.smithi096.stdout: "crimson_alien_op_num_threads": "6", 2024-04-19T03:01:34.718 INFO:teuthology.orchestra.run.smithi096.stdout: "crimson_alien_thread_cpu_cores": "", 2024-04-19T03:01:34.718 INFO:teuthology.orchestra.run.smithi096.stdout: "crimson_osd_obc_lru_size": "10", 2024-04-19T03:01:34.718 INFO:teuthology.orchestra.run.smithi096.stdout: "crimson_osd_scheduler_concurrency": "0", 2024-04-19T03:01:34.718 INFO:teuthology.orchestra.run.smithi096.stdout: "crimson_seastar_smp": "1", 2024-04-19T03:01:34.718 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_location": "", 2024-04-19T03:01:34.718 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_location_hook": "", 2024-04-19T03:01:34.718 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_location_hook_timeout": "10", 2024-04-19T03:01:34.718 INFO:teuthology.orchestra.run.smithi096.stdout: "daemonize": "false", 2024-04-19T03:01:34.718 INFO:teuthology.orchestra.run.smithi096.stdout: "daos_pool": "tank", 2024-04-19T03:01:34.719 INFO:teuthology.orchestra.run.smithi096.stdout: "dbstore_config_uri": "file:/var/lib/ceph/radosgw/dbstore-config.db", 2024-04-19T03:01:34.719 INFO:teuthology.orchestra.run.smithi096.stdout: "dbstore_db_dir": "/var/lib/ceph/radosgw", 2024-04-19T03:01:34.719 INFO:teuthology.orchestra.run.smithi096.stdout: "dbstore_db_name_prefix": "dbstore", 2024-04-19T03:01:34.719 INFO:teuthology.orchestra.run.smithi096.stdout: "debug_alienstore": "0/5", 2024-04-19T03:01:34.719 INFO:teuthology.orchestra.run.smithi096.stdout: "debug_allow_any_pool_priority": "false", 2024-04-19T03:01:34.719 INFO:teuthology.orchestra.run.smithi096.stdout: "debug_asok": "1/5", 2024-04-19T03:01:34.719 INFO:teuthology.orchestra.run.smithi096.stdout: "debug_asok_assert_abort": "false", 2024-04-19T03:01:34.719 INFO:teuthology.orchestra.run.smithi096.stdout: "debug_asserts_on_shutdown": "true", 2024-04-19T03:01:34.719 INFO:teuthology.orchestra.run.smithi096.stdout: "debug_auth": "20/20", 2024-04-19T03:01:34.719 INFO:teuthology.orchestra.run.smithi096.stdout: "debug_bdev": "1/3", 2024-04-19T03:01:34.719 INFO:teuthology.orchestra.run.smithi096.stdout: "debug_bluefs": "1/5", 2024-04-19T03:01:34.719 INFO:teuthology.orchestra.run.smithi096.stdout: "debug_bluestore": "1/5", 2024-04-19T03:01:34.719 INFO:teuthology.orchestra.run.smithi096.stdout: "debug_buffer": "0/1", 2024-04-19T03:01:34.719 INFO:teuthology.orchestra.run.smithi096.stdout: "debug_ceph_exporter": "1/5", 2024-04-19T03:01:34.719 INFO:teuthology.orchestra.run.smithi096.stdout: "debug_cephfs_mirror": "0/5", 2024-04-19T03:01:34.720 INFO:teuthology.orchestra.run.smithi096.stdout: "debug_cephsqlite": "0/5", 2024-04-19T03:01:34.720 INFO:teuthology.orchestra.run.smithi096.stdout: "debug_client": "0/5", 2024-04-19T03:01:34.720 INFO:teuthology.orchestra.run.smithi096.stdout: "debug_compressor": "1/5", 2024-04-19T03:01:34.720 INFO:teuthology.orchestra.run.smithi096.stdout: "debug_context": "0/1", 2024-04-19T03:01:34.720 INFO:teuthology.orchestra.run.smithi096.stdout: "debug_crush": "1/1", 2024-04-19T03:01:34.720 INFO:teuthology.orchestra.run.smithi096.stdout: "debug_crypto": "1/5", 2024-04-19T03:01:34.720 INFO:teuthology.orchestra.run.smithi096.stdout: "debug_cyanstore": "0/5", 2024-04-19T03:01:34.720 INFO:teuthology.orchestra.run.smithi096.stdout: "debug_deliberately_leak_memory": "false", 2024-04-19T03:01:34.720 INFO:teuthology.orchestra.run.smithi096.stdout: "debug_disable_randomized_ping": "false", 2024-04-19T03:01:34.720 INFO:teuthology.orchestra.run.smithi096.stdout: "debug_dpdk": "1/5", 2024-04-19T03:01:34.720 INFO:teuthology.orchestra.run.smithi096.stdout: "debug_eventtrace": "1/5", 2024-04-19T03:01:34.720 INFO:teuthology.orchestra.run.smithi096.stdout: "debug_filer": "0/1", 2024-04-19T03:01:34.720 INFO:teuthology.orchestra.run.smithi096.stdout: "debug_filestore": "1/3", 2024-04-19T03:01:34.720 INFO:teuthology.orchestra.run.smithi096.stdout: "debug_finisher": "1/1", 2024-04-19T03:01:34.720 INFO:teuthology.orchestra.run.smithi096.stdout: "debug_fuse": "1/5", 2024-04-19T03:01:34.720 INFO:teuthology.orchestra.run.smithi096.stdout: "debug_heartbeat_testing_span": "0", 2024-04-19T03:01:34.721 INFO:teuthology.orchestra.run.smithi096.stdout: "debug_heartbeatmap": "1/5", 2024-04-19T03:01:34.721 INFO:teuthology.orchestra.run.smithi096.stdout: "debug_immutable_obj_cache": "0/5", 2024-04-19T03:01:34.721 INFO:teuthology.orchestra.run.smithi096.stdout: "debug_javaclient": "1/5", 2024-04-19T03:01:34.721 INFO:teuthology.orchestra.run.smithi096.stdout: "debug_journal": "1/3", 2024-04-19T03:01:34.721 INFO:teuthology.orchestra.run.smithi096.stdout: "debug_journaler": "0/5", 2024-04-19T03:01:34.721 INFO:teuthology.orchestra.run.smithi096.stdout: "debug_kstore": "1/5", 2024-04-19T03:01:34.721 INFO:teuthology.orchestra.run.smithi096.stdout: "debug_leveldb": "4/5", 2024-04-19T03:01:34.721 INFO:teuthology.orchestra.run.smithi096.stdout: "debug_lockdep": "0/1", 2024-04-19T03:01:34.721 INFO:teuthology.orchestra.run.smithi096.stdout: "debug_mclock": "1/5", 2024-04-19T03:01:34.721 INFO:teuthology.orchestra.run.smithi096.stdout: "debug_mds": "1/5", 2024-04-19T03:01:34.721 INFO:teuthology.orchestra.run.smithi096.stdout: "debug_mds_balancer": "1/5", 2024-04-19T03:01:34.721 INFO:teuthology.orchestra.run.smithi096.stdout: "debug_mds_locker": "1/5", 2024-04-19T03:01:34.721 INFO:teuthology.orchestra.run.smithi096.stdout: "debug_mds_log": "1/5", 2024-04-19T03:01:34.721 INFO:teuthology.orchestra.run.smithi096.stdout: "debug_mds_log_expire": "1/5", 2024-04-19T03:01:34.722 INFO:teuthology.orchestra.run.smithi096.stdout: "debug_mds_migrator": "1/5", 2024-04-19T03:01:34.722 INFO:teuthology.orchestra.run.smithi096.stdout: "debug_memstore": "1/5", 2024-04-19T03:01:34.722 INFO:teuthology.orchestra.run.smithi096.stdout: "debug_mgr": "2/5", 2024-04-19T03:01:34.722 INFO:teuthology.orchestra.run.smithi096.stdout: "debug_mgrc": "1/5", 2024-04-19T03:01:34.722 INFO:teuthology.orchestra.run.smithi096.stdout: "debug_mon": "20/20", 2024-04-19T03:01:34.722 INFO:teuthology.orchestra.run.smithi096.stdout: "debug_monc": "0/10", 2024-04-19T03:01:34.722 INFO:teuthology.orchestra.run.smithi096.stdout: "debug_ms": "1/1", 2024-04-19T03:01:34.722 INFO:teuthology.orchestra.run.smithi096.stdout: "debug_none": "0/5", 2024-04-19T03:01:34.722 INFO:teuthology.orchestra.run.smithi096.stdout: "debug_objclass": "0/5", 2024-04-19T03:01:34.722 INFO:teuthology.orchestra.run.smithi096.stdout: "debug_objectcacher": "0/5", 2024-04-19T03:01:34.722 INFO:teuthology.orchestra.run.smithi096.stdout: "debug_objecter": "0/1", 2024-04-19T03:01:34.722 INFO:teuthology.orchestra.run.smithi096.stdout: "debug_optracker": "0/5", 2024-04-19T03:01:34.722 INFO:teuthology.orchestra.run.smithi096.stdout: "debug_osd": "1/5", 2024-04-19T03:01:34.722 INFO:teuthology.orchestra.run.smithi096.stdout: "debug_paxos": "20/20", 2024-04-19T03:01:34.723 INFO:teuthology.orchestra.run.smithi096.stdout: "debug_perfcounter": "1/5", 2024-04-19T03:01:34.723 INFO:teuthology.orchestra.run.smithi096.stdout: "debug_prioritycache": "1/5", 2024-04-19T03:01:34.723 INFO:teuthology.orchestra.run.smithi096.stdout: "debug_rados": "0/5", 2024-04-19T03:01:34.723 INFO:teuthology.orchestra.run.smithi096.stdout: "debug_rbd": "0/5", 2024-04-19T03:01:34.723 INFO:teuthology.orchestra.run.smithi096.stdout: "debug_rbd_mirror": "0/5", 2024-04-19T03:01:34.723 INFO:teuthology.orchestra.run.smithi096.stdout: "debug_rbd_pwl": "0/5", 2024-04-19T03:01:34.723 INFO:teuthology.orchestra.run.smithi096.stdout: "debug_rbd_replay": "0/5", 2024-04-19T03:01:34.723 INFO:teuthology.orchestra.run.smithi096.stdout: "debug_refs": "0/0", 2024-04-19T03:01:34.723 INFO:teuthology.orchestra.run.smithi096.stdout: "debug_reserver": "1/1", 2024-04-19T03:01:34.723 INFO:teuthology.orchestra.run.smithi096.stdout: "debug_rgw": "1/5", 2024-04-19T03:01:34.723 INFO:teuthology.orchestra.run.smithi096.stdout: "debug_rgw_access": "1/5", 2024-04-19T03:01:34.723 INFO:teuthology.orchestra.run.smithi096.stdout: "debug_rgw_datacache": "1/5", 2024-04-19T03:01:34.723 INFO:teuthology.orchestra.run.smithi096.stdout: "debug_rgw_dbstore": "1/5", 2024-04-19T03:01:34.723 INFO:teuthology.orchestra.run.smithi096.stdout: "debug_rgw_flight": "1/5", 2024-04-19T03:01:34.723 INFO:teuthology.orchestra.run.smithi096.stdout: "debug_rgw_sync": "1/5", 2024-04-19T03:01:34.724 INFO:teuthology.orchestra.run.smithi096.stdout: "debug_rocksdb": "4/5", 2024-04-19T03:01:34.724 INFO:teuthology.orchestra.run.smithi096.stdout: "debug_seastore": "0/5", 2024-04-19T03:01:34.724 INFO:teuthology.orchestra.run.smithi096.stdout: "debug_seastore_backref": "0/5", 2024-04-19T03:01:34.724 INFO:teuthology.orchestra.run.smithi096.stdout: "debug_seastore_cache": "0/5", 2024-04-19T03:01:34.724 INFO:teuthology.orchestra.run.smithi096.stdout: "debug_seastore_cleaner": "0/5", 2024-04-19T03:01:34.724 INFO:teuthology.orchestra.run.smithi096.stdout: "debug_seastore_device": "0/5", 2024-04-19T03:01:34.724 INFO:teuthology.orchestra.run.smithi096.stdout: "debug_seastore_epm": "0/5", 2024-04-19T03:01:34.724 INFO:teuthology.orchestra.run.smithi096.stdout: "debug_seastore_fixedkv_tree": "0/5", 2024-04-19T03:01:34.724 INFO:teuthology.orchestra.run.smithi096.stdout: "debug_seastore_journal": "0/5", 2024-04-19T03:01:34.724 INFO:teuthology.orchestra.run.smithi096.stdout: "debug_seastore_lba": "0/5", 2024-04-19T03:01:34.724 INFO:teuthology.orchestra.run.smithi096.stdout: "debug_seastore_odata": "0/5", 2024-04-19T03:01:34.724 INFO:teuthology.orchestra.run.smithi096.stdout: "debug_seastore_omap": "0/5", 2024-04-19T03:01:34.724 INFO:teuthology.orchestra.run.smithi096.stdout: "debug_seastore_onode": "0/5", 2024-04-19T03:01:34.724 INFO:teuthology.orchestra.run.smithi096.stdout: "debug_seastore_t": "0/5", 2024-04-19T03:01:34.725 INFO:teuthology.orchestra.run.smithi096.stdout: "debug_seastore_tm": "0/5", 2024-04-19T03:01:34.725 INFO:teuthology.orchestra.run.smithi096.stdout: "debug_striper": "0/1", 2024-04-19T03:01:34.725 INFO:teuthology.orchestra.run.smithi096.stdout: "debug_test": "0/5", 2024-04-19T03:01:34.725 INFO:teuthology.orchestra.run.smithi096.stdout: "debug_throttle": "1/1", 2024-04-19T03:01:34.725 INFO:teuthology.orchestra.run.smithi096.stdout: "debug_timer": "0/1", 2024-04-19T03:01:34.725 INFO:teuthology.orchestra.run.smithi096.stdout: "debug_tp": "0/5", 2024-04-19T03:01:34.725 INFO:teuthology.orchestra.run.smithi096.stdout: "defer_client_eviction_on_laggy_osds": "false", 2024-04-19T03:01:34.725 INFO:teuthology.orchestra.run.smithi096.stdout: "device_failure_prediction_mode": "none", 2024-04-19T03:01:34.725 INFO:teuthology.orchestra.run.smithi096.stdout: "enable_experimental_unrecoverable_data_corrupting_features": "", 2024-04-19T03:01:34.725 INFO:teuthology.orchestra.run.smithi096.stdout: "erasure_code_dir": "/usr/lib/ceph/erasure-code", 2024-04-19T03:01:34.725 INFO:teuthology.orchestra.run.smithi096.stdout: "err_to_graylog": "false", 2024-04-19T03:01:34.725 INFO:teuthology.orchestra.run.smithi096.stdout: "err_to_journald": "false", 2024-04-19T03:01:34.725 INFO:teuthology.orchestra.run.smithi096.stdout: "err_to_stderr": "true", 2024-04-19T03:01:34.726 INFO:teuthology.orchestra.run.smithi096.stdout: "err_to_syslog": "false", 2024-04-19T03:01:34.726 INFO:teuthology.orchestra.run.smithi096.stdout: "event_tracing": "false", 2024-04-19T03:01:34.726 INFO:teuthology.orchestra.run.smithi096.stdout: "exporter_addr": "0.0.0.0", 2024-04-19T03:01:34.726 INFO:teuthology.orchestra.run.smithi096.stdout: "exporter_http_port": "9926", 2024-04-19T03:01:34.726 INFO:teuthology.orchestra.run.smithi096.stdout: "exporter_prio_limit": "5", 2024-04-19T03:01:34.726 INFO:teuthology.orchestra.run.smithi096.stdout: "exporter_sock_dir": "/var/run/ceph/", 2024-04-19T03:01:34.726 INFO:teuthology.orchestra.run.smithi096.stdout: "exporter_sort_metrics": "true", 2024-04-19T03:01:34.726 INFO:teuthology.orchestra.run.smithi096.stdout: "exporter_stats_period": "5", 2024-04-19T03:01:34.726 INFO:teuthology.orchestra.run.smithi096.stdout: "fake_statfs_for_testing": "0", 2024-04-19T03:01:34.726 INFO:teuthology.orchestra.run.smithi096.stdout: "fatal_signal_handlers": "true", 2024-04-19T03:01:34.726 INFO:teuthology.orchestra.run.smithi096.stdout: "filer_max_purge_ops": "10", 2024-04-19T03:01:34.726 INFO:teuthology.orchestra.run.smithi096.stdout: "filer_max_truncate_ops": "128", 2024-04-19T03:01:34.726 INFO:teuthology.orchestra.run.smithi096.stdout: "filestore_apply_finisher_threads": "1", 2024-04-19T03:01:34.727 INFO:teuthology.orchestra.run.smithi096.stdout: "filestore_blackhole": "false", 2024-04-19T03:01:34.727 INFO:teuthology.orchestra.run.smithi096.stdout: "filestore_btrfs_clone_range": "true", 2024-04-19T03:01:34.727 INFO:teuthology.orchestra.run.smithi096.stdout: "filestore_btrfs_snap": "true", 2024-04-19T03:01:34.727 INFO:teuthology.orchestra.run.smithi096.stdout: "filestore_caller_concurrency": "10", 2024-04-19T03:01:34.727 INFO:teuthology.orchestra.run.smithi096.stdout: "filestore_collect_device_partition_information": "true", 2024-04-19T03:01:34.727 INFO:teuthology.orchestra.run.smithi096.stdout: "filestore_commit_timeout": "600.000000", 2024-04-19T03:01:34.727 INFO:teuthology.orchestra.run.smithi096.stdout: "filestore_debug_inject_read_err": "false", 2024-04-19T03:01:34.727 INFO:teuthology.orchestra.run.smithi096.stdout: "filestore_debug_omap_check": "false", 2024-04-19T03:01:34.727 INFO:teuthology.orchestra.run.smithi096.stdout: "filestore_debug_random_read_err": "0.000000", 2024-04-19T03:01:34.727 INFO:teuthology.orchestra.run.smithi096.stdout: "filestore_debug_verify_split": "false", 2024-04-19T03:01:34.727 INFO:teuthology.orchestra.run.smithi096.stdout: "filestore_dump_file": "", 2024-04-19T03:01:34.727 INFO:teuthology.orchestra.run.smithi096.stdout: "filestore_expected_throughput_bytes": "209715200.000000", 2024-04-19T03:01:34.727 INFO:teuthology.orchestra.run.smithi096.stdout: "filestore_expected_throughput_ops": "200.000000", 2024-04-19T03:01:34.728 INFO:teuthology.orchestra.run.smithi096.stdout: "filestore_fadvise": "true", 2024-04-19T03:01:34.728 INFO:teuthology.orchestra.run.smithi096.stdout: "filestore_fail_eio": "true", 2024-04-19T03:01:34.728 INFO:teuthology.orchestra.run.smithi096.stdout: "filestore_fd_cache_shards": "16", 2024-04-19T03:01:34.728 INFO:teuthology.orchestra.run.smithi096.stdout: "filestore_fd_cache_size": "128", 2024-04-19T03:01:34.728 INFO:teuthology.orchestra.run.smithi096.stdout: "filestore_fiemap": "false", 2024-04-19T03:01:34.728 INFO:teuthology.orchestra.run.smithi096.stdout: "filestore_fiemap_threshold": "4096", 2024-04-19T03:01:34.728 INFO:teuthology.orchestra.run.smithi096.stdout: "filestore_fsync_flushes_journal_data": "false", 2024-04-19T03:01:34.728 INFO:teuthology.orchestra.run.smithi096.stdout: "filestore_index_retry_probability": "0.000000", 2024-04-19T03:01:34.728 INFO:teuthology.orchestra.run.smithi096.stdout: "filestore_inject_stall": "0", 2024-04-19T03:01:34.728 INFO:teuthology.orchestra.run.smithi096.stdout: "filestore_journal_parallel": "false", 2024-04-19T03:01:34.728 INFO:teuthology.orchestra.run.smithi096.stdout: "filestore_journal_trailing": "false", 2024-04-19T03:01:34.728 INFO:teuthology.orchestra.run.smithi096.stdout: "filestore_journal_writeahead": "false", 2024-04-19T03:01:34.728 INFO:teuthology.orchestra.run.smithi096.stdout: "filestore_kill_at": "0", 2024-04-19T03:01:34.728 INFO:teuthology.orchestra.run.smithi096.stdout: "filestore_max_alloc_hint_size": "1048576", 2024-04-19T03:01:34.729 INFO:teuthology.orchestra.run.smithi096.stdout: "filestore_max_inline_xattr_size": "0", 2024-04-19T03:01:34.729 INFO:teuthology.orchestra.run.smithi096.stdout: "filestore_max_inline_xattr_size_btrfs": "2048", 2024-04-19T03:01:34.729 INFO:teuthology.orchestra.run.smithi096.stdout: "filestore_max_inline_xattr_size_other": "512", 2024-04-19T03:01:34.729 INFO:teuthology.orchestra.run.smithi096.stdout: "filestore_max_inline_xattr_size_xfs": "65536", 2024-04-19T03:01:34.729 INFO:teuthology.orchestra.run.smithi096.stdout: "filestore_max_inline_xattrs": "0", 2024-04-19T03:01:34.729 INFO:teuthology.orchestra.run.smithi096.stdout: "filestore_max_inline_xattrs_btrfs": "10", 2024-04-19T03:01:34.729 INFO:teuthology.orchestra.run.smithi096.stdout: "filestore_max_inline_xattrs_other": "2", 2024-04-19T03:01:34.729 INFO:teuthology.orchestra.run.smithi096.stdout: "filestore_max_inline_xattrs_xfs": "10", 2024-04-19T03:01:34.729 INFO:teuthology.orchestra.run.smithi096.stdout: "filestore_max_sync_interval": "5.000000", 2024-04-19T03:01:34.729 INFO:teuthology.orchestra.run.smithi096.stdout: "filestore_max_xattr_value_size": "0", 2024-04-19T03:01:34.729 INFO:teuthology.orchestra.run.smithi096.stdout: "filestore_max_xattr_value_size_btrfs": "65536", 2024-04-19T03:01:34.729 INFO:teuthology.orchestra.run.smithi096.stdout: "filestore_max_xattr_value_size_other": "1024", 2024-04-19T03:01:34.729 INFO:teuthology.orchestra.run.smithi096.stdout: "filestore_max_xattr_value_size_xfs": "65536", 2024-04-19T03:01:34.729 INFO:teuthology.orchestra.run.smithi096.stdout: "filestore_merge_threshold": "-10", 2024-04-19T03:01:34.730 INFO:teuthology.orchestra.run.smithi096.stdout: "filestore_min_sync_interval": "0.010000", 2024-04-19T03:01:34.730 INFO:teuthology.orchestra.run.smithi096.stdout: "filestore_odsync_write": "false", 2024-04-19T03:01:34.730 INFO:teuthology.orchestra.run.smithi096.stdout: "filestore_omap_backend": "rocksdb", 2024-04-19T03:01:34.730 INFO:teuthology.orchestra.run.smithi096.stdout: "filestore_omap_backend_path": "", 2024-04-19T03:01:34.730 INFO:teuthology.orchestra.run.smithi096.stdout: "filestore_omap_header_cache_size": "1024", 2024-04-19T03:01:34.730 INFO:teuthology.orchestra.run.smithi096.stdout: "filestore_ondisk_finisher_threads": "1", 2024-04-19T03:01:34.730 INFO:teuthology.orchestra.run.smithi096.stdout: "filestore_op_thread_suicide_timeout": "180", 2024-04-19T03:01:34.730 INFO:teuthology.orchestra.run.smithi096.stdout: "filestore_op_thread_timeout": "60", 2024-04-19T03:01:34.730 INFO:teuthology.orchestra.run.smithi096.stdout: "filestore_op_threads": "2", 2024-04-19T03:01:34.730 INFO:teuthology.orchestra.run.smithi096.stdout: "filestore_punch_hole": "false", 2024-04-19T03:01:34.730 INFO:teuthology.orchestra.run.smithi096.stdout: "filestore_queue_high_delay_multiple": "0.000000", 2024-04-19T03:01:34.730 INFO:teuthology.orchestra.run.smithi096.stdout: "filestore_queue_high_delay_multiple_bytes": "0.000000", 2024-04-19T03:01:34.730 INFO:teuthology.orchestra.run.smithi096.stdout: "filestore_queue_high_delay_multiple_ops": "0.000000", 2024-04-19T03:01:34.730 INFO:teuthology.orchestra.run.smithi096.stdout: "filestore_queue_high_threshhold": "0.900000", 2024-04-19T03:01:34.731 INFO:teuthology.orchestra.run.smithi096.stdout: "filestore_queue_low_threshhold": "0.300000", 2024-04-19T03:01:34.731 INFO:teuthology.orchestra.run.smithi096.stdout: "filestore_queue_max_bytes": "104857600", 2024-04-19T03:01:34.731 INFO:teuthology.orchestra.run.smithi096.stdout: "filestore_queue_max_delay_multiple": "0.000000", 2024-04-19T03:01:34.731 INFO:teuthology.orchestra.run.smithi096.stdout: "filestore_queue_max_delay_multiple_bytes": "0.000000", 2024-04-19T03:01:34.731 INFO:teuthology.orchestra.run.smithi096.stdout: "filestore_queue_max_delay_multiple_ops": "0.000000", 2024-04-19T03:01:34.731 INFO:teuthology.orchestra.run.smithi096.stdout: "filestore_queue_max_ops": "50", 2024-04-19T03:01:34.731 INFO:teuthology.orchestra.run.smithi096.stdout: "filestore_rocksdb_options": "max_background_jobs=10,compaction_readahead_size=2097152,compression=kNoCompression", 2024-04-19T03:01:34.731 INFO:teuthology.orchestra.run.smithi096.stdout: "filestore_seek_data_hole": "false", 2024-04-19T03:01:34.731 INFO:teuthology.orchestra.run.smithi096.stdout: "filestore_sloppy_crc": "false", 2024-04-19T03:01:34.731 INFO:teuthology.orchestra.run.smithi096.stdout: "filestore_sloppy_crc_block_size": "65536", 2024-04-19T03:01:34.731 INFO:teuthology.orchestra.run.smithi096.stdout: "filestore_splice": "false", 2024-04-19T03:01:34.731 INFO:teuthology.orchestra.run.smithi096.stdout: "filestore_split_multiple": "2", 2024-04-19T03:01:34.731 INFO:teuthology.orchestra.run.smithi096.stdout: "filestore_split_rand_factor": "20", 2024-04-19T03:01:34.731 INFO:teuthology.orchestra.run.smithi096.stdout: "filestore_update_to": "1000", 2024-04-19T03:01:34.732 INFO:teuthology.orchestra.run.smithi096.stdout: "filestore_wbthrottle_btrfs_bytes_hard_limit": "419430400", 2024-04-19T03:01:34.732 INFO:teuthology.orchestra.run.smithi096.stdout: "filestore_wbthrottle_btrfs_bytes_start_flusher": "41943040", 2024-04-19T03:01:34.732 INFO:teuthology.orchestra.run.smithi096.stdout: "filestore_wbthrottle_btrfs_inodes_hard_limit": "5000", 2024-04-19T03:01:34.732 INFO:teuthology.orchestra.run.smithi096.stdout: "filestore_wbthrottle_btrfs_inodes_start_flusher": "500", 2024-04-19T03:01:34.732 INFO:teuthology.orchestra.run.smithi096.stdout: "filestore_wbthrottle_btrfs_ios_hard_limit": "5000", 2024-04-19T03:01:34.732 INFO:teuthology.orchestra.run.smithi096.stdout: "filestore_wbthrottle_btrfs_ios_start_flusher": "500", 2024-04-19T03:01:34.732 INFO:teuthology.orchestra.run.smithi096.stdout: "filestore_wbthrottle_enable": "true", 2024-04-19T03:01:34.732 INFO:teuthology.orchestra.run.smithi096.stdout: "filestore_wbthrottle_xfs_bytes_hard_limit": "419430400", 2024-04-19T03:01:34.732 INFO:teuthology.orchestra.run.smithi096.stdout: "filestore_wbthrottle_xfs_bytes_start_flusher": "41943040", 2024-04-19T03:01:34.732 INFO:teuthology.orchestra.run.smithi096.stdout: "filestore_wbthrottle_xfs_inodes_hard_limit": "5000", 2024-04-19T03:01:34.732 INFO:teuthology.orchestra.run.smithi096.stdout: "filestore_wbthrottle_xfs_inodes_start_flusher": "500", 2024-04-19T03:01:34.732 INFO:teuthology.orchestra.run.smithi096.stdout: "filestore_wbthrottle_xfs_ios_hard_limit": "5000", 2024-04-19T03:01:34.732 INFO:teuthology.orchestra.run.smithi096.stdout: "filestore_wbthrottle_xfs_ios_start_flusher": "500", 2024-04-19T03:01:34.733 INFO:teuthology.orchestra.run.smithi096.stdout: "filestore_xfs_extsize": "false", 2024-04-19T03:01:34.733 INFO:teuthology.orchestra.run.smithi096.stdout: "filestore_zfs_snap": "false", 2024-04-19T03:01:34.733 INFO:teuthology.orchestra.run.smithi096.stdout: "fio_dir": "/tmp/fio", 2024-04-19T03:01:34.733 INFO:teuthology.orchestra.run.smithi096.stdout: "fsid": "c6cc8e09-11d4-48de-9a6c-4d70ed3c3789", 2024-04-19T03:01:34.733 INFO:teuthology.orchestra.run.smithi096.stdout: "fuse_allow_other": "true", 2024-04-19T03:01:34.733 INFO:teuthology.orchestra.run.smithi096.stdout: "fuse_atomic_o_trunc": "true", 2024-04-19T03:01:34.733 INFO:teuthology.orchestra.run.smithi096.stdout: "fuse_big_writes": "true", 2024-04-19T03:01:34.733 INFO:teuthology.orchestra.run.smithi096.stdout: "fuse_debug": "false", 2024-04-19T03:01:34.733 INFO:teuthology.orchestra.run.smithi096.stdout: "fuse_default_permissions": "false", 2024-04-19T03:01:34.733 INFO:teuthology.orchestra.run.smithi096.stdout: "fuse_disable_pagecache": "false", 2024-04-19T03:01:34.733 INFO:teuthology.orchestra.run.smithi096.stdout: "fuse_max_write": "0", 2024-04-19T03:01:34.733 INFO:teuthology.orchestra.run.smithi096.stdout: "fuse_multithreaded": "true", 2024-04-19T03:01:34.733 INFO:teuthology.orchestra.run.smithi096.stdout: "fuse_require_active_mds": "true", 2024-04-19T03:01:34.733 INFO:teuthology.orchestra.run.smithi096.stdout: "fuse_set_user_groups": "true", 2024-04-19T03:01:34.734 INFO:teuthology.orchestra.run.smithi096.stdout: "fuse_splice_move": "true", 2024-04-19T03:01:34.734 INFO:teuthology.orchestra.run.smithi096.stdout: "fuse_splice_read": "true", 2024-04-19T03:01:34.734 INFO:teuthology.orchestra.run.smithi096.stdout: "fuse_splice_write": "true", 2024-04-19T03:01:34.734 INFO:teuthology.orchestra.run.smithi096.stdout: "fuse_syncfs_on_mksnap": "true", 2024-04-19T03:01:34.734 INFO:teuthology.orchestra.run.smithi096.stdout: "fuse_use_invalidate_cb": "true", 2024-04-19T03:01:34.734 INFO:teuthology.orchestra.run.smithi096.stdout: "gss_ktab_client_file": "/var/lib/ceph/mon.a/gss_client_mon.a.ktab", 2024-04-19T03:01:34.734 INFO:teuthology.orchestra.run.smithi096.stdout: "gss_target_name": "ceph", 2024-04-19T03:01:34.734 INFO:teuthology.orchestra.run.smithi096.stdout: "heartbeat_file": "", 2024-04-19T03:01:34.734 INFO:teuthology.orchestra.run.smithi096.stdout: "heartbeat_inject_failure": "0", 2024-04-19T03:01:34.734 INFO:teuthology.orchestra.run.smithi096.stdout: "heartbeat_interval": "5", 2024-04-19T03:01:34.734 INFO:teuthology.orchestra.run.smithi096.stdout: "host": "smithi096", 2024-04-19T03:01:34.734 INFO:teuthology.orchestra.run.smithi096.stdout: "immutable_object_cache_client_dedicated_thread_num": "2", 2024-04-19T03:01:34.734 INFO:teuthology.orchestra.run.smithi096.stdout: "immutable_object_cache_max_inflight_ops": "128", 2024-04-19T03:01:34.735 INFO:teuthology.orchestra.run.smithi096.stdout: "immutable_object_cache_max_size": "1073741824", 2024-04-19T03:01:34.735 INFO:teuthology.orchestra.run.smithi096.stdout: "immutable_object_cache_path": "/tmp/ceph_immutable_object_cache", 2024-04-19T03:01:34.735 INFO:teuthology.orchestra.run.smithi096.stdout: "immutable_object_cache_qos_bps_burst": "0", 2024-04-19T03:01:34.735 INFO:teuthology.orchestra.run.smithi096.stdout: "immutable_object_cache_qos_bps_burst_seconds": "1", 2024-04-19T03:01:34.735 INFO:teuthology.orchestra.run.smithi096.stdout: "immutable_object_cache_qos_bps_limit": "0", 2024-04-19T03:01:34.735 INFO:teuthology.orchestra.run.smithi096.stdout: "immutable_object_cache_qos_iops_burst": "0", 2024-04-19T03:01:34.735 INFO:teuthology.orchestra.run.smithi096.stdout: "immutable_object_cache_qos_iops_burst_seconds": "1", 2024-04-19T03:01:34.735 INFO:teuthology.orchestra.run.smithi096.stdout: "immutable_object_cache_qos_iops_limit": "0", 2024-04-19T03:01:34.735 INFO:teuthology.orchestra.run.smithi096.stdout: "immutable_object_cache_qos_schedule_tick_min": "50", 2024-04-19T03:01:34.735 INFO:teuthology.orchestra.run.smithi096.stdout: "immutable_object_cache_sock": "/var/run/ceph/immutable_object_cache_sock", 2024-04-19T03:01:34.735 INFO:teuthology.orchestra.run.smithi096.stdout: "immutable_object_cache_watermark": "0.900000", 2024-04-19T03:01:34.735 INFO:teuthology.orchestra.run.smithi096.stdout: "inject_early_sigterm": "false", 2024-04-19T03:01:34.735 INFO:teuthology.orchestra.run.smithi096.stdout: "jaeger_agent_port": "6799", 2024-04-19T03:01:34.735 INFO:teuthology.orchestra.run.smithi096.stdout: "jaeger_tracing_enable": "false", 2024-04-19T03:01:34.736 INFO:teuthology.orchestra.run.smithi096.stdout: "journal_aio": "true", 2024-04-19T03:01:34.736 INFO:teuthology.orchestra.run.smithi096.stdout: "journal_align_min_size": "65536", 2024-04-19T03:01:34.736 INFO:teuthology.orchestra.run.smithi096.stdout: "journal_block_align": "true", 2024-04-19T03:01:34.736 INFO:teuthology.orchestra.run.smithi096.stdout: "journal_block_size": "4096", 2024-04-19T03:01:34.736 INFO:teuthology.orchestra.run.smithi096.stdout: "journal_dio": "true", 2024-04-19T03:01:34.736 INFO:teuthology.orchestra.run.smithi096.stdout: "journal_discard": "false", 2024-04-19T03:01:34.736 INFO:teuthology.orchestra.run.smithi096.stdout: "journal_force_aio": "false", 2024-04-19T03:01:34.736 INFO:teuthology.orchestra.run.smithi096.stdout: "journal_ignore_corruption": "false", 2024-04-19T03:01:34.736 INFO:teuthology.orchestra.run.smithi096.stdout: "journal_max_write_bytes": "10485760", 2024-04-19T03:01:34.736 INFO:teuthology.orchestra.run.smithi096.stdout: "journal_max_write_entries": "100", 2024-04-19T03:01:34.736 INFO:teuthology.orchestra.run.smithi096.stdout: "journal_replay_from": "0", 2024-04-19T03:01:34.736 INFO:teuthology.orchestra.run.smithi096.stdout: "journal_throttle_high_multiple": "0.000000", 2024-04-19T03:01:34.737 INFO:teuthology.orchestra.run.smithi096.stdout: "journal_throttle_high_threshhold": "0.900000", 2024-04-19T03:01:34.737 INFO:teuthology.orchestra.run.smithi096.stdout: "journal_throttle_low_threshhold": "0.600000", 2024-04-19T03:01:34.737 INFO:teuthology.orchestra.run.smithi096.stdout: "journal_throttle_max_multiple": "0.000000", 2024-04-19T03:01:34.737 INFO:teuthology.orchestra.run.smithi096.stdout: "journal_write_header_frequency": "0", 2024-04-19T03:01:34.737 INFO:teuthology.orchestra.run.smithi096.stdout: "journal_zero_on_create": "false", 2024-04-19T03:01:34.737 INFO:teuthology.orchestra.run.smithi096.stdout: "journaler_prefetch_periods": "10", 2024-04-19T03:01:34.737 INFO:teuthology.orchestra.run.smithi096.stdout: "journaler_prezero_periods": "5", 2024-04-19T03:01:34.737 INFO:teuthology.orchestra.run.smithi096.stdout: "journaler_write_head_interval": "15", 2024-04-19T03:01:34.737 INFO:teuthology.orchestra.run.smithi096.stdout: "key": "", 2024-04-19T03:01:34.737 INFO:teuthology.orchestra.run.smithi096.stdout: "keyfile": "", 2024-04-19T03:01:34.737 INFO:teuthology.orchestra.run.smithi096.stdout: "keyring": "/var/lib/ceph/mon/ceph-a/keyring", 2024-04-19T03:01:34.737 INFO:teuthology.orchestra.run.smithi096.stdout: "kstore_backend": "rocksdb", 2024-04-19T03:01:34.737 INFO:teuthology.orchestra.run.smithi096.stdout: "kstore_default_stripe_size": "65536", 2024-04-19T03:01:34.737 INFO:teuthology.orchestra.run.smithi096.stdout: "kstore_fsck_on_mount": "false", 2024-04-19T03:01:34.738 INFO:teuthology.orchestra.run.smithi096.stdout: "kstore_fsck_on_mount_deep": "true", 2024-04-19T03:01:34.738 INFO:teuthology.orchestra.run.smithi096.stdout: "kstore_max_bytes": "67108864", 2024-04-19T03:01:34.738 INFO:teuthology.orchestra.run.smithi096.stdout: "kstore_max_ops": "512", 2024-04-19T03:01:34.738 INFO:teuthology.orchestra.run.smithi096.stdout: "kstore_nid_prealloc": "1024", 2024-04-19T03:01:34.738 INFO:teuthology.orchestra.run.smithi096.stdout: "kstore_onode_map_size": "1024", 2024-04-19T03:01:34.738 INFO:teuthology.orchestra.run.smithi096.stdout: "kstore_rocksdb_options": "compression=kNoCompression", 2024-04-19T03:01:34.738 INFO:teuthology.orchestra.run.smithi096.stdout: "kstore_sync_submit_transaction": "false", 2024-04-19T03:01:34.738 INFO:teuthology.orchestra.run.smithi096.stdout: "kstore_sync_transaction": "false", 2024-04-19T03:01:34.738 INFO:teuthology.orchestra.run.smithi096.stdout: "leveldb_block_size": "65536", 2024-04-19T03:01:34.738 INFO:teuthology.orchestra.run.smithi096.stdout: "leveldb_bloom_size": "0", 2024-04-19T03:01:34.738 INFO:teuthology.orchestra.run.smithi096.stdout: "leveldb_cache_size": "536870912", 2024-04-19T03:01:34.738 INFO:teuthology.orchestra.run.smithi096.stdout: "leveldb_compact_on_mount": "false", 2024-04-19T03:01:34.738 INFO:teuthology.orchestra.run.smithi096.stdout: "leveldb_compression": "false", 2024-04-19T03:01:34.738 INFO:teuthology.orchestra.run.smithi096.stdout: "leveldb_log": "", 2024-04-19T03:01:34.739 INFO:teuthology.orchestra.run.smithi096.stdout: "leveldb_log_to_ceph_log": "true", 2024-04-19T03:01:34.739 INFO:teuthology.orchestra.run.smithi096.stdout: "leveldb_max_open_files": "0", 2024-04-19T03:01:34.739 INFO:teuthology.orchestra.run.smithi096.stdout: "leveldb_paranoid": "false", 2024-04-19T03:01:34.739 INFO:teuthology.orchestra.run.smithi096.stdout: "leveldb_write_buffer_size": "33554432", 2024-04-19T03:01:34.739 INFO:teuthology.orchestra.run.smithi096.stdout: "librados_thread_count": "2", 2024-04-19T03:01:34.739 INFO:teuthology.orchestra.run.smithi096.stdout: "lockdep": "false", 2024-04-19T03:01:34.739 INFO:teuthology.orchestra.run.smithi096.stdout: "lockdep_force_backtrace": "false", 2024-04-19T03:01:34.739 INFO:teuthology.orchestra.run.smithi096.stdout: "log_coarse_timestamps": "true", 2024-04-19T03:01:34.739 INFO:teuthology.orchestra.run.smithi096.stdout: "log_file": "/var/log/ceph/ceph-mon.a.log", 2024-04-19T03:01:34.739 INFO:teuthology.orchestra.run.smithi096.stdout: "log_flush_on_exit": "false", 2024-04-19T03:01:34.739 INFO:teuthology.orchestra.run.smithi096.stdout: "log_graylog_host": "127.0.0.1", 2024-04-19T03:01:34.739 INFO:teuthology.orchestra.run.smithi096.stdout: "log_graylog_port": "12201", 2024-04-19T03:01:34.739 INFO:teuthology.orchestra.run.smithi096.stdout: "log_max_new": "1000", 2024-04-19T03:01:34.739 INFO:teuthology.orchestra.run.smithi096.stdout: "log_max_recent": "10000", 2024-04-19T03:01:34.740 INFO:teuthology.orchestra.run.smithi096.stdout: "log_stderr_prefix": "", 2024-04-19T03:01:34.740 INFO:teuthology.orchestra.run.smithi096.stdout: "log_stop_at_utilization": "0.970000", 2024-04-19T03:01:34.740 INFO:teuthology.orchestra.run.smithi096.stdout: "log_to_file": "true", 2024-04-19T03:01:34.740 INFO:teuthology.orchestra.run.smithi096.stdout: "log_to_graylog": "false", 2024-04-19T03:01:34.740 INFO:teuthology.orchestra.run.smithi096.stdout: "log_to_journald": "false", 2024-04-19T03:01:34.740 INFO:teuthology.orchestra.run.smithi096.stdout: "log_to_stderr": "false", 2024-04-19T03:01:34.740 INFO:teuthology.orchestra.run.smithi096.stdout: "log_to_syslog": "false", 2024-04-19T03:01:34.740 INFO:teuthology.orchestra.run.smithi096.stdout: "max_rotating_auth_attempts": "10", 2024-04-19T03:01:34.740 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_abort_on_newly_corrupt_dentry": "true", 2024-04-19T03:01:34.740 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_action_on_write_error": "1", 2024-04-19T03:01:34.740 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_alternate_name_max": "8192", 2024-04-19T03:01:34.740 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_asio_thread_count": "2", 2024-04-19T03:01:34.740 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_bal_export_pin": "true", 2024-04-19T03:01:34.740 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_bal_fragment_dirs": "true", 2024-04-19T03:01:34.741 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_bal_fragment_fast_factor": "1.500000", 2024-04-19T03:01:34.741 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_bal_fragment_interval": "5", 2024-04-19T03:01:34.741 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_bal_fragment_size_max": "100000", 2024-04-19T03:01:34.741 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_bal_idle_threshold": "0.000000", 2024-04-19T03:01:34.741 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_bal_interval": "10", 2024-04-19T03:01:34.741 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_bal_max": "-1", 2024-04-19T03:01:34.741 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_bal_max_until": "-1", 2024-04-19T03:01:34.741 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_bal_merge_size": "50", 2024-04-19T03:01:34.741 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_bal_midchunk": "0.300000", 2024-04-19T03:01:34.741 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_bal_min_rebalance": "0.100000", 2024-04-19T03:01:34.741 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_bal_min_start": "0.200000", 2024-04-19T03:01:34.741 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_bal_minchunk": "0.001000", 2024-04-19T03:01:34.741 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_bal_mode": "0", 2024-04-19T03:01:34.742 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_bal_need_max": "1.200000", 2024-04-19T03:01:34.742 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_bal_need_min": "0.800000", 2024-04-19T03:01:34.742 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_bal_replicate_threshold": "8000.000000", 2024-04-19T03:01:34.742 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_bal_sample_interval": "3.000000", 2024-04-19T03:01:34.742 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_bal_split_bits": "3", 2024-04-19T03:01:34.742 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_bal_split_rd": "25000.000000", 2024-04-19T03:01:34.742 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_bal_split_size": "10000", 2024-04-19T03:01:34.742 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_bal_split_wr": "10000.000000", 2024-04-19T03:01:34.742 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_bal_target_decay": "10.000000", 2024-04-19T03:01:34.742 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_bal_unreplicate_threshold": "0.000000", 2024-04-19T03:01:34.742 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_beacon_grace": "15.000000", 2024-04-19T03:01:34.742 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_beacon_interval": "4.000000", 2024-04-19T03:01:34.743 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_beacon_mon_down_grace": "60", 2024-04-19T03:01:34.743 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_cache_memory_limit": "4294967296", 2024-04-19T03:01:34.743 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_cache_mid": "0.700000", 2024-04-19T03:01:34.743 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_cache_release_free_interval": "10", 2024-04-19T03:01:34.743 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_cache_reservation": "0.050000", 2024-04-19T03:01:34.743 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_cache_trim_decay_rate": "1.000000", 2024-04-19T03:01:34.743 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_cache_trim_interval": "1", 2024-04-19T03:01:34.743 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_cache_trim_threshold": "262144", 2024-04-19T03:01:34.743 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_cap_acquisition_throttle_retry_request_timeout": "0.500000", 2024-04-19T03:01:34.743 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_cap_revoke_eviction_timeout": "0.000000", 2024-04-19T03:01:34.743 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_client_delegate_inos_pct": "50", 2024-04-19T03:01:34.743 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_client_prealloc_inos": "1000", 2024-04-19T03:01:34.743 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_client_writeable_range_max_inc_objs": "1024", 2024-04-19T03:01:34.743 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_connect_bootstrapping": "false", 2024-04-19T03:01:34.744 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_damage_table_max_entries": "10000", 2024-04-19T03:01:34.744 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_data": "/var/lib/ceph/mds/ceph-a", 2024-04-19T03:01:34.744 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_debug_auth_pins": "false", 2024-04-19T03:01:34.744 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_debug_frag": "false", 2024-04-19T03:01:34.744 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_debug_scatterstat": "false", 2024-04-19T03:01:34.744 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_debug_subtrees": "false", 2024-04-19T03:01:34.744 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_decay_halflife": "5.000000", 2024-04-19T03:01:34.744 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_default_dir_hash": "2", 2024-04-19T03:01:34.744 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_defer_session_stale": "true", 2024-04-19T03:01:34.744 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_deny_all_reconnect": "false", 2024-04-19T03:01:34.744 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_dir_keys_per_op": "16384", 2024-04-19T03:01:34.744 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_dir_max_commit_size": "10", 2024-04-19T03:01:34.744 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_dir_max_entries": "0", 2024-04-19T03:01:34.744 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_dir_prefetch": "true", 2024-04-19T03:01:34.744 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_dirstat_min_interval": "1.000000", 2024-04-19T03:01:34.745 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_dump_cache_after_rejoin": "false", 2024-04-19T03:01:34.745 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_dump_cache_on_map": "false", 2024-04-19T03:01:34.745 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_dump_cache_threshold_file": "0", 2024-04-19T03:01:34.745 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_dump_cache_threshold_formatter": "1073741824", 2024-04-19T03:01:34.745 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_early_reply": "true", 2024-04-19T03:01:34.745 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_enable_op_tracker": "true", 2024-04-19T03:01:34.745 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_enforce_unique_name": "true", 2024-04-19T03:01:34.745 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_export_ephemeral_distributed": "true", 2024-04-19T03:01:34.745 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_export_ephemeral_distributed_factor": "2.000000", 2024-04-19T03:01:34.745 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_export_ephemeral_random": "true", 2024-04-19T03:01:34.745 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_export_ephemeral_random_max": "0.010000", 2024-04-19T03:01:34.745 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_extraordinary_events_dump_interval": "0", 2024-04-19T03:01:34.745 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_forward_all_requests_to_auth": "false", 2024-04-19T03:01:34.746 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_freeze_tree_timeout": "30.000000", 2024-04-19T03:01:34.746 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_fscrypt_last_block_max_size": "4096", 2024-04-19T03:01:34.746 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_go_bad_corrupt_dentry": "true", 2024-04-19T03:01:34.746 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_hack_allow_loading_invalid_metadata": "false", 2024-04-19T03:01:34.746 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_health_cache_threshold": "1.500000", 2024-04-19T03:01:34.746 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_health_summarize_threshold": "10", 2024-04-19T03:01:34.746 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_heartbeat_grace": "15.000000", 2024-04-19T03:01:34.746 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_heartbeat_reset_grace": "1000", 2024-04-19T03:01:34.746 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_inject_health_dummy": "false", 2024-04-19T03:01:34.746 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_inject_journal_corrupt_dentry_first": "0.000000", 2024-04-19T03:01:34.746 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_inject_migrator_session_race": "false", 2024-04-19T03:01:34.746 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_inject_rename_corrupt_dentry_first": "0.000000", 2024-04-19T03:01:34.746 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_inject_skip_replaying_inotable": "false", 2024-04-19T03:01:34.746 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_inject_traceless_reply_probability": "0.000000", 2024-04-19T03:01:34.747 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_join_fs": "", 2024-04-19T03:01:34.747 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_journal_format": "1", 2024-04-19T03:01:34.747 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_kill_create_at": "0", 2024-04-19T03:01:34.747 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_kill_export_at": "0", 2024-04-19T03:01:34.747 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_kill_import_at": "0", 2024-04-19T03:01:34.747 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_kill_journal_at": "0", 2024-04-19T03:01:34.747 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_kill_journal_expire_at": "0", 2024-04-19T03:01:34.747 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_kill_journal_replay_at": "0", 2024-04-19T03:01:34.747 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_kill_link_at": "0", 2024-04-19T03:01:34.747 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_kill_mdstable_at": "0", 2024-04-19T03:01:34.747 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_kill_openc_at": "0", 2024-04-19T03:01:34.747 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_kill_rename_at": "0", 2024-04-19T03:01:34.747 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_kill_skip_replaying_inotable": "false", 2024-04-19T03:01:34.747 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_log_events_per_segment": "1024", 2024-04-19T03:01:34.748 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_log_max_events": "-1", 2024-04-19T03:01:34.748 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_log_max_segments": "128", 2024-04-19T03:01:34.748 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_log_pause": "false", 2024-04-19T03:01:34.748 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_log_segment_size": "0", 2024-04-19T03:01:34.748 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_log_skip_corrupt_events": "false", 2024-04-19T03:01:34.748 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_log_warn_factor": "2.000000", 2024-04-19T03:01:34.748 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_max_caps_per_client": "1048576", 2024-04-19T03:01:34.748 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_max_completed_flushes": "100000", 2024-04-19T03:01:34.748 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_max_completed_requests": "100000", 2024-04-19T03:01:34.748 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_max_export_size": "20971520", 2024-04-19T03:01:34.748 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_max_file_recover": "32", 2024-04-19T03:01:34.748 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_max_purge_files": "64", 2024-04-19T03:01:34.748 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_max_purge_ops": "8192", 2024-04-19T03:01:34.748 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_max_purge_ops_per_pg": "0.500000", 2024-04-19T03:01:34.749 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_max_scrub_ops_in_progress": "5", 2024-04-19T03:01:34.749 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_max_snaps_per_dir": "100", 2024-04-19T03:01:34.749 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_metrics_update_interval": "2", 2024-04-19T03:01:34.749 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_min_caps_per_client": "100", 2024-04-19T03:01:34.749 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_min_caps_working_set": "10000", 2024-04-19T03:01:34.749 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_mon_shutdown_timeout": "5.000000", 2024-04-19T03:01:34.749 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_numa_node": "-1", 2024-04-19T03:01:34.749 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_oft_prefetch_dirfrags": "false", 2024-04-19T03:01:34.749 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_op_complaint_time": "30.000000", 2024-04-19T03:01:34.749 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_op_history_duration": "600", 2024-04-19T03:01:34.749 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_op_history_size": "20", 2024-04-19T03:01:34.749 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_op_history_slow_op_size": "20", 2024-04-19T03:01:34.749 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_op_history_slow_op_threshold": "10", 2024-04-19T03:01:34.749 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_op_log_threshold": "5", 2024-04-19T03:01:34.750 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_ping_grace": "15", 2024-04-19T03:01:34.750 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_ping_interval": "5", 2024-04-19T03:01:34.750 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_purge_queue_busy_flush_period": "1.000000", 2024-04-19T03:01:34.750 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_recall_global_max_decay_threshold": "131072", 2024-04-19T03:01:34.750 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_recall_max_caps": "30000", 2024-04-19T03:01:34.750 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_recall_max_decay_rate": "1.500000", 2024-04-19T03:01:34.750 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_recall_max_decay_threshold": "131072", 2024-04-19T03:01:34.750 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_recall_warning_decay_rate": "60.000000", 2024-04-19T03:01:34.750 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_recall_warning_threshold": "262144", 2024-04-19T03:01:34.750 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_reconnect_timeout": "45.000000", 2024-04-19T03:01:34.750 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_replay_interval": "1.000000", 2024-04-19T03:01:34.750 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_replay_unsafe_with_closed_session": "false", 2024-04-19T03:01:34.750 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_request_load_average_decay_rate": "60.000000", 2024-04-19T03:01:34.750 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_root_ino_gid": "0", 2024-04-19T03:01:34.751 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_root_ino_uid": "0", 2024-04-19T03:01:34.751 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_scatter_nudge_interval": "5.000000", 2024-04-19T03:01:34.751 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_session_blocklist_on_evict": "true", 2024-04-19T03:01:34.751 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_session_blocklist_on_timeout": "true", 2024-04-19T03:01:34.751 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_session_cache_liveness_decay_rate": "300.000000", 2024-04-19T03:01:34.751 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_session_cache_liveness_magnitude": "10", 2024-04-19T03:01:34.751 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_session_cap_acquisition_decay_rate": "30.000000", 2024-04-19T03:01:34.751 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_session_cap_acquisition_throttle": "100000", 2024-04-19T03:01:34.751 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_session_max_caps_throttle_ratio": "1.100000", 2024-04-19T03:01:34.751 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_session_metadata_threshold": "16777216", 2024-04-19T03:01:34.751 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_sessionmap_keys_per_op": "1024", 2024-04-19T03:01:34.751 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_shutdown_check": "0", 2024-04-19T03:01:34.751 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_skip_ino": "0", 2024-04-19T03:01:34.751 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_sleep_rank_change": "0.000000", 2024-04-19T03:01:34.752 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_snap_max_uid": "4294967294", 2024-04-19T03:01:34.752 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_snap_min_uid": "0", 2024-04-19T03:01:34.752 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_snap_rstat": "false", 2024-04-19T03:01:34.752 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_standby_replay_damaged": "false", 2024-04-19T03:01:34.752 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_symlink_recovery": "true", 2024-04-19T03:01:34.752 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_task_status_update_interval": "2.000000", 2024-04-19T03:01:34.752 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_thrash_exports": "0", 2024-04-19T03:01:34.752 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_thrash_fragments": "0", 2024-04-19T03:01:34.752 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_tick_interval": "5.000000", 2024-04-19T03:01:34.752 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_valgrind_exit": "false", 2024-04-19T03:01:34.752 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_verify_backtrace": "1", 2024-04-19T03:01:34.752 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_verify_scatter": "false", 2024-04-19T03:01:34.752 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_wipe_ino_prealloc": "false", 2024-04-19T03:01:34.752 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_wipe_sessions": "false", 2024-04-19T03:01:34.753 INFO:teuthology.orchestra.run.smithi096.stdout: "mempool_debug": "false", 2024-04-19T03:01:34.753 INFO:teuthology.orchestra.run.smithi096.stdout: "memstore_debug_omit_block_device_write": "false", 2024-04-19T03:01:34.753 INFO:teuthology.orchestra.run.smithi096.stdout: "memstore_device_bytes": "1073741824", 2024-04-19T03:01:34.753 INFO:teuthology.orchestra.run.smithi096.stdout: "memstore_page_set": "false", 2024-04-19T03:01:34.753 INFO:teuthology.orchestra.run.smithi096.stdout: "memstore_page_size": "65536", 2024-04-19T03:01:34.753 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr_client_bytes": "134217728", 2024-04-19T03:01:34.753 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr_client_messages": "512", 2024-04-19T03:01:34.753 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr_client_service_daemon_unregister_timeout": "1.000000", 2024-04-19T03:01:34.753 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr_connect_retry_interval": "1.000000", 2024-04-19T03:01:34.753 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr_data": "/var/lib/ceph/mgr/ceph-a", 2024-04-19T03:01:34.753 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr_debug_aggressive_pg_num_changes": "false", 2024-04-19T03:01:34.753 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr_disabled_modules": "", 2024-04-19T03:01:34.753 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr_initial_modules": "restful iostat nfs", 2024-04-19T03:01:34.754 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr_max_pg_num_change": "128", 2024-04-19T03:01:34.754 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr_mds_bytes": "134217728", 2024-04-19T03:01:34.754 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr_mds_messages": "128", 2024-04-19T03:01:34.754 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr_module_path": "/usr/share/ceph/mgr", 2024-04-19T03:01:34.754 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr_mon_bytes": "134217728", 2024-04-19T03:01:34.754 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr_mon_messages": "128", 2024-04-19T03:01:34.754 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr_osd_bytes": "536870912", 2024-04-19T03:01:34.754 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr_osd_messages": "8192", 2024-04-19T03:01:34.754 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr_pool": "true", 2024-04-19T03:01:34.754 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr_service_beacon_grace": "60.000000", 2024-04-19T03:01:34.754 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr_standby_modules": "true", 2024-04-19T03:01:34.754 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr_stats_period": "5", 2024-04-19T03:01:34.754 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr_stats_threshold": "5", 2024-04-19T03:01:34.755 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr_tick_period": "2", 2024-04-19T03:01:34.755 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr_ttl_cache_expire_seconds": "0", 2024-04-19T03:01:34.755 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_accept_timeout_factor": "2.000000", 2024-04-19T03:01:34.755 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_allow_pool_delete": "true", 2024-04-19T03:01:34.755 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_allow_pool_size_one": "true", 2024-04-19T03:01:34.755 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_auth_validate_all_caps": "true", 2024-04-19T03:01:34.755 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_cache_target_full_warn_ratio": "0.660000", 2024-04-19T03:01:34.755 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_clean_pg_upmaps_per_chunk": "256", 2024-04-19T03:01:34.755 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_client_bytes": "104857600", 2024-04-19T03:01:34.755 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_client_directed_command_retry": "2", 2024-04-19T03:01:34.755 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_client_hunt_interval": "3.000000", 2024-04-19T03:01:34.755 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_client_hunt_interval_backoff": "1.500000", 2024-04-19T03:01:34.755 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_client_hunt_interval_max_multiple": "10.000000", 2024-04-19T03:01:34.756 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_client_hunt_interval_min_multiple": "1.000000", 2024-04-19T03:01:34.756 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_client_hunt_parallel": "3", 2024-04-19T03:01:34.756 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_client_log_interval": "1.000000", 2024-04-19T03:01:34.756 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_client_max_log_entries_per_message": "1000", 2024-04-19T03:01:34.756 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_client_ping_interval": "10.000000", 2024-04-19T03:01:34.756 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_client_ping_timeout": "30.000000", 2024-04-19T03:01:34.756 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_clock_drift_allowed": "1.000000", 2024-04-19T03:01:34.756 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_clock_drift_warn_backoff": "5.000000", 2024-04-19T03:01:34.756 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_cluster_log_file": "default=/var/log/ceph/ceph.$channel.log cluster=/var/log/ceph/ceph.log", 2024-04-19T03:01:34.756 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_cluster_log_file_level": "debug", 2024-04-19T03:01:34.756 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_cluster_log_to_file": "true", 2024-04-19T03:01:34.756 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_cluster_log_to_graylog": "false", 2024-04-19T03:01:34.756 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_cluster_log_to_graylog_host": "127.0.0.1", 2024-04-19T03:01:34.756 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_cluster_log_to_graylog_port": "12201", 2024-04-19T03:01:34.757 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_cluster_log_to_journald": "false", 2024-04-19T03:01:34.757 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_cluster_log_to_stderr": "false", 2024-04-19T03:01:34.757 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_cluster_log_to_syslog": "default=false", 2024-04-19T03:01:34.757 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_cluster_log_to_syslog_facility": "daemon", 2024-04-19T03:01:34.757 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_cluster_log_to_syslog_level": "info", 2024-04-19T03:01:34.757 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_compact_on_bootstrap": "false", 2024-04-19T03:01:34.757 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_compact_on_start": "false", 2024-04-19T03:01:34.757 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_compact_on_trim": "true", 2024-04-19T03:01:34.757 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_con_tracker_persist_interval": "10", 2024-04-19T03:01:34.757 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_con_tracker_score_halflife": "43200", 2024-04-19T03:01:34.757 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_config_key_max_entry_size": "65536", 2024-04-19T03:01:34.757 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_cpu_threads": "4", 2024-04-19T03:01:34.757 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_crush_min_required_version": "hammer", 2024-04-19T03:01:34.757 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_daemon_bytes": "419430400", 2024-04-19T03:01:34.758 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_data": "/var/lib/ceph/mon/ceph-a", 2024-04-19T03:01:34.758 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_data_avail_crit": "5", 2024-04-19T03:01:34.758 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_data_avail_warn": "5", 2024-04-19T03:01:34.758 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_data_size_warn": "16106127360", 2024-04-19T03:01:34.758 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_debug_block_osdmap_trim": "false", 2024-04-19T03:01:34.758 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_debug_deprecated_as_obsolete": "false", 2024-04-19T03:01:34.758 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_debug_dump_json": "false", 2024-04-19T03:01:34.758 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_debug_dump_location": "/var/log/ceph/ceph-mon.a.tdump", 2024-04-19T03:01:34.758 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_debug_dump_transactions": "false", 2024-04-19T03:01:34.758 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_debug_extra_checks": "false", 2024-04-19T03:01:34.758 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_debug_no_initial_persistent_features": "false", 2024-04-19T03:01:34.758 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_debug_no_require_bluestore_for_ec_overwrites": "false", 2024-04-19T03:01:34.758 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_debug_no_require_quincy": "false", 2024-04-19T03:01:34.758 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_debug_no_require_reef": "false", 2024-04-19T03:01:34.759 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_debug_unsafe_allow_tier_with_nonempty_snaps": "false", 2024-04-19T03:01:34.759 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_delta_reset_interval": "10.000000", 2024-04-19T03:01:34.759 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_dns_srv_name": "ceph-mon", 2024-04-19T03:01:34.759 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_down_mkfs_grace": "120", 2024-04-19T03:01:34.759 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_election_default_strategy": "1", 2024-04-19T03:01:34.759 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_election_timeout": "5.000000", 2024-04-19T03:01:34.759 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_elector_ignore_propose_margin": "0.000500", 2024-04-19T03:01:34.759 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_elector_ping_divisor": "2", 2024-04-19T03:01:34.759 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_elector_ping_timeout": "2.000000", 2024-04-19T03:01:34.759 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_enable_op_tracker": "true", 2024-04-19T03:01:34.759 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_fake_pool_delete": "false", 2024-04-19T03:01:34.759 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_force_quorum_join": "false", 2024-04-19T03:01:34.759 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_globalid_prealloc": "10000", 2024-04-19T03:01:34.759 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_health_detail_to_clog": "false", 2024-04-19T03:01:34.760 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_health_log_update_period": "5", 2024-04-19T03:01:34.760 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_health_max_detail": "50", 2024-04-19T03:01:34.760 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_health_to_clog": "true", 2024-04-19T03:01:34.760 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_health_to_clog_interval": "600", 2024-04-19T03:01:34.760 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_health_to_clog_tick_interval": "60.000000", 2024-04-19T03:01:34.760 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_host": "172.21.15.96,[v2:172.21.15.96:3301,v1:172.21.15.96:6790],[v2:172.21.15.96:3302,v1:172.21.15.96:6791]", 2024-04-19T03:01:34.760 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_host_override": "", 2024-04-19T03:01:34.760 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_initial_members": "", 2024-04-19T03:01:34.760 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_inject_pg_merge_bounce_probability": "0.000000", 2024-04-19T03:01:34.760 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_inject_sync_get_chunk_delay": "0.000000", 2024-04-19T03:01:34.760 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_inject_transaction_delay_max": "10.000000", 2024-04-19T03:01:34.760 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_inject_transaction_delay_probability": "0.000000", 2024-04-19T03:01:34.760 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_keyvaluedb": "rocksdb", 2024-04-19T03:01:34.761 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_lease": "5.000000", 2024-04-19T03:01:34.761 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_lease_ack_timeout_factor": "2.000000", 2024-04-19T03:01:34.761 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_lease_renew_interval_factor": "0.600000", 2024-04-19T03:01:34.761 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_log_full_interval": "50", 2024-04-19T03:01:34.761 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_log_max": "10000", 2024-04-19T03:01:34.761 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_log_max_summary": "50", 2024-04-19T03:01:34.761 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_max_log_entries_per_event": "4096", 2024-04-19T03:01:34.761 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_max_log_epochs": "500", 2024-04-19T03:01:34.761 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_max_mdsmap_epochs": "500", 2024-04-19T03:01:34.761 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_max_mgrmap_epochs": "500", 2024-04-19T03:01:34.761 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_max_osd": "10000", 2024-04-19T03:01:34.761 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_max_pg_per_osd": "10000", 2024-04-19T03:01:34.761 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_max_pool_pg_num": "65536", 2024-04-19T03:01:34.761 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_max_snap_prune_per_epoch": "100", 2024-04-19T03:01:34.761 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_mds_blocklist_interval": "86400.000000", 2024-04-19T03:01:34.762 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_mds_force_trim_to": "0", 2024-04-19T03:01:34.762 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_mds_skip_sanity": "false", 2024-04-19T03:01:34.762 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_memory_autotune": "true", 2024-04-19T03:01:34.762 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_memory_target": "2147483648", 2024-04-19T03:01:34.762 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_mgr_beacon_grace": "30", 2024-04-19T03:01:34.762 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_mgr_blocklist_interval": "86400.000000", 2024-04-19T03:01:34.762 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_mgr_digest_period": "5", 2024-04-19T03:01:34.762 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_mgr_inactive_grace": "60", 2024-04-19T03:01:34.762 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_mgr_mkfs_grace": "240", 2024-04-19T03:01:34.762 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_mgr_proxy_client_bytes_ratio": "0.300000", 2024-04-19T03:01:34.762 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_min_osdmap_epochs": "500", 2024-04-19T03:01:34.762 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_op_complaint_time": "30", 2024-04-19T03:01:34.762 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_op_history_duration": "600", 2024-04-19T03:01:34.763 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_op_history_size": "20", 2024-04-19T03:01:34.763 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_op_history_slow_op_size": "20", 2024-04-19T03:01:34.763 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_op_history_slow_op_threshold": "10", 2024-04-19T03:01:34.763 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_op_log_threshold": "5", 2024-04-19T03:01:34.763 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_osd_adjust_down_out_interval": "true", 2024-04-19T03:01:34.763 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_osd_adjust_heartbeat_grace": "true", 2024-04-19T03:01:34.763 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_osd_auto_mark_auto_out_in": "true", 2024-04-19T03:01:34.763 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_osd_auto_mark_in": "false", 2024-04-19T03:01:34.763 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_osd_auto_mark_new_in": "true", 2024-04-19T03:01:34.763 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_osd_backfillfull_ratio": "0.900000", 2024-04-19T03:01:34.763 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_osd_blocklist_default_expire": "3600.000000", 2024-04-19T03:01:34.763 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_osd_cache_size": "500", 2024-04-19T03:01:34.763 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_osd_cache_size_min": "134217728", 2024-04-19T03:01:34.763 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_osd_crush_smoke_test": "true", 2024-04-19T03:01:34.764 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_osd_destroyed_out_interval": "600", 2024-04-19T03:01:34.764 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_osd_down_out_interval": "600", 2024-04-19T03:01:34.764 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_osd_down_out_subtree_limit": "rack", 2024-04-19T03:01:34.764 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_osd_err_op_age_ratio": "128.000000", 2024-04-19T03:01:34.764 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_osd_force_trim_to": "0", 2024-04-19T03:01:34.764 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_osd_full_ratio": "0.950000", 2024-04-19T03:01:34.764 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_osd_initial_require_min_compat_client": "luminous", 2024-04-19T03:01:34.764 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_osd_laggy_halflife": "3600", 2024-04-19T03:01:34.764 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_osd_laggy_max_interval": "300", 2024-04-19T03:01:34.764 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_osd_laggy_weight": "0.300000", 2024-04-19T03:01:34.764 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_osd_mapping_pgs_per_chunk": "4096", 2024-04-19T03:01:34.764 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_osd_max_creating_pgs": "1024", 2024-04-19T03:01:34.764 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_osd_max_initial_pgs": "1024", 2024-04-19T03:01:34.764 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_osd_min_down_reporters": "2", 2024-04-19T03:01:34.765 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_osd_min_in_ratio": "0.750000", 2024-04-19T03:01:34.765 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_osd_min_up_ratio": "0.300000", 2024-04-19T03:01:34.765 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_osd_nearfull_ratio": "0.850000", 2024-04-19T03:01:34.765 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_osd_prime_pg_temp": "true", 2024-04-19T03:01:34.765 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_osd_prime_pg_temp_max_estimate": "0.250000", 2024-04-19T03:01:34.765 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_osd_prime_pg_temp_max_time": "0.500000", 2024-04-19T03:01:34.765 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_osd_report_timeout": "900", 2024-04-19T03:01:34.765 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_osd_reporter_subtree_level": "osd", 2024-04-19T03:01:34.765 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_osd_snap_trim_queue_warn_on": "32768", 2024-04-19T03:01:34.765 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_osd_warn_num_repaired": "10", 2024-04-19T03:01:34.765 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_osd_warn_op_age": "32.000000", 2024-04-19T03:01:34.765 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_osdmap_full_prune_enabled": "true", 2024-04-19T03:01:34.765 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_osdmap_full_prune_interval": "10", 2024-04-19T03:01:34.765 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_osdmap_full_prune_min": "10000", 2024-04-19T03:01:34.765 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_osdmap_full_prune_txsize": "100", 2024-04-19T03:01:34.766 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_pg_check_down_all_threshold": "0.500000", 2024-04-19T03:01:34.766 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_pg_stuck_threshold": "60", 2024-04-19T03:01:34.766 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_pg_warn_max_object_skew": "0.000000", 2024-04-19T03:01:34.766 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_pg_warn_min_objects": "10000", 2024-04-19T03:01:34.766 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_pg_warn_min_per_osd": "0", 2024-04-19T03:01:34.766 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_pg_warn_min_pool_objects": "1000", 2024-04-19T03:01:34.766 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_pool_quota_crit_threshold": "0", 2024-04-19T03:01:34.766 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_pool_quota_warn_threshold": "0", 2024-04-19T03:01:34.766 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_probe_timeout": "2.000000", 2024-04-19T03:01:34.766 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_reweight_max_change": "0.050000", 2024-04-19T03:01:34.766 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_reweight_max_osds": "4", 2024-04-19T03:01:34.766 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_reweight_min_bytes_per_osd": "10", 2024-04-19T03:01:34.766 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_reweight_min_pgs_per_osd": "4", 2024-04-19T03:01:34.766 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_rocksdb_options": "write_buffer_size=33554432,compression=kNoCompression,level_compaction_dynamic_level_bytes=true", 2024-04-19T03:01:34.767 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_scrub_inject_crc_mismatch": "0.000000", 2024-04-19T03:01:34.767 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_scrub_inject_missing_keys": "0.000000", 2024-04-19T03:01:34.767 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_scrub_interval": "86400", 2024-04-19T03:01:34.767 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_scrub_max_keys": "100", 2024-04-19T03:01:34.767 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_scrub_timeout": "300", 2024-04-19T03:01:34.767 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_session_timeout": "300", 2024-04-19T03:01:34.767 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_smart_report_timeout": "5", 2024-04-19T03:01:34.767 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_stat_smooth_intervals": "6", 2024-04-19T03:01:34.767 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_stretch_cluster_recovery_ratio": "0.600000", 2024-04-19T03:01:34.767 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_stretch_pool_min_size": "2", 2024-04-19T03:01:34.767 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_stretch_pool_size": "4", 2024-04-19T03:01:34.767 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_stretch_recovery_min_wait": "15.000000", 2024-04-19T03:01:34.767 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_subscribe_interval": "86400.000000", 2024-04-19T03:01:34.767 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_sync_debug": "false", 2024-04-19T03:01:34.768 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_sync_max_payload_keys": "2000", 2024-04-19T03:01:34.768 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_sync_max_payload_size": "1048576", 2024-04-19T03:01:34.768 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_sync_provider_kill_at": "0", 2024-04-19T03:01:34.768 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_sync_requester_kill_at": "0", 2024-04-19T03:01:34.768 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_sync_timeout": "60.000000", 2024-04-19T03:01:34.768 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_target_pg_per_osd": "100", 2024-04-19T03:01:34.768 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_tick_interval": "5", 2024-04-19T03:01:34.768 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_timecheck_interval": "300.000000", 2024-04-19T03:01:34.768 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_timecheck_skew_interval": "30.000000", 2024-04-19T03:01:34.768 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_use_min_delay_socket": "false", 2024-04-19T03:01:34.768 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_warn_older_version_delay": "604800", 2024-04-19T03:01:34.768 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_warn_on_cache_pools_without_hit_sets": "true", 2024-04-19T03:01:34.768 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_warn_on_crush_straw_calc_version_zero": "false", 2024-04-19T03:01:34.769 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_warn_on_degraded_stretch_mode": "true", 2024-04-19T03:01:34.769 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_warn_on_filestore_osds": "false", 2024-04-19T03:01:34.769 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_warn_on_insecure_global_id_reclaim": "false", 2024-04-19T03:01:34.769 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_warn_on_insecure_global_id_reclaim_allowed": "false", 2024-04-19T03:01:34.769 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_warn_on_legacy_crush_tunables": "false", 2024-04-19T03:01:34.769 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_warn_on_misplaced": "false", 2024-04-19T03:01:34.769 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_warn_on_msgr2_not_enabled": "true", 2024-04-19T03:01:34.769 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_warn_on_older_version": "true", 2024-04-19T03:01:34.769 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_warn_on_osd_down_out_interval_zero": "false", 2024-04-19T03:01:34.769 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_warn_on_pool_no_app": "true", 2024-04-19T03:01:34.769 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_warn_on_pool_no_redundancy": "false", 2024-04-19T03:01:34.769 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_warn_on_pool_pg_num_not_power_of_two": "false", 2024-04-19T03:01:34.769 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_warn_on_slow_ping_ratio": "0.050000", 2024-04-19T03:01:34.769 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_warn_on_slow_ping_time": "0.000000", 2024-04-19T03:01:34.770 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_warn_on_too_few_osds": "false", 2024-04-19T03:01:34.770 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_warn_pg_not_deep_scrubbed_ratio": "0.750000", 2024-04-19T03:01:34.770 INFO:teuthology.orchestra.run.smithi096.stdout: "mon_warn_pg_not_scrubbed_ratio": "0.500000", 2024-04-19T03:01:34.770 INFO:teuthology.orchestra.run.smithi096.stdout: "monmap": "", 2024-04-19T03:01:34.770 INFO:teuthology.orchestra.run.smithi096.stdout: "motr_admin_endpoint": "192.168.180.182@tcp:12345:4:1", 2024-04-19T03:01:34.770 INFO:teuthology.orchestra.run.smithi096.stdout: "motr_admin_fid": "0x7200000000000001:0x0", 2024-04-19T03:01:34.770 INFO:teuthology.orchestra.run.smithi096.stdout: "motr_ha_endpoint": "192.168.180.182@tcp:12345:1:1", 2024-04-19T03:01:34.770 INFO:teuthology.orchestra.run.smithi096.stdout: "motr_my_endpoint": "192.168.180.182@tcp:12345:4:1", 2024-04-19T03:01:34.770 INFO:teuthology.orchestra.run.smithi096.stdout: "motr_my_fid": "0x7200000000000001:0x0", 2024-04-19T03:01:34.770 INFO:teuthology.orchestra.run.smithi096.stdout: "motr_profile_fid": "0x7000000000000001:0x0", 2024-04-19T03:01:34.770 INFO:teuthology.orchestra.run.smithi096.stdout: "motr_tracing_enabled": "false", 2024-04-19T03:01:34.770 INFO:teuthology.orchestra.run.smithi096.stdout: "ms_async_op_threads": "3", 2024-04-19T03:01:34.770 INFO:teuthology.orchestra.run.smithi096.stdout: "ms_async_rdma_buffer_size": "131072", 2024-04-19T03:01:34.770 INFO:teuthology.orchestra.run.smithi096.stdout: "ms_async_rdma_cm": "false", 2024-04-19T03:01:34.771 INFO:teuthology.orchestra.run.smithi096.stdout: "ms_async_rdma_device_name": "", 2024-04-19T03:01:34.771 INFO:teuthology.orchestra.run.smithi096.stdout: "ms_async_rdma_dscp": "96", 2024-04-19T03:01:34.771 INFO:teuthology.orchestra.run.smithi096.stdout: "ms_async_rdma_enable_hugepage": "false", 2024-04-19T03:01:34.771 INFO:teuthology.orchestra.run.smithi096.stdout: "ms_async_rdma_gid_idx": "0", 2024-04-19T03:01:34.771 INFO:teuthology.orchestra.run.smithi096.stdout: "ms_async_rdma_local_gid": "", 2024-04-19T03:01:34.771 INFO:teuthology.orchestra.run.smithi096.stdout: "ms_async_rdma_polling_us": "1000", 2024-04-19T03:01:34.771 INFO:teuthology.orchestra.run.smithi096.stdout: "ms_async_rdma_port_num": "1", 2024-04-19T03:01:34.771 INFO:teuthology.orchestra.run.smithi096.stdout: "ms_async_rdma_receive_buffers": "32768", 2024-04-19T03:01:34.771 INFO:teuthology.orchestra.run.smithi096.stdout: "ms_async_rdma_receive_queue_len": "4096", 2024-04-19T03:01:34.771 INFO:teuthology.orchestra.run.smithi096.stdout: "ms_async_rdma_roce_ver": "1", 2024-04-19T03:01:34.771 INFO:teuthology.orchestra.run.smithi096.stdout: "ms_async_rdma_send_buffers": "1024", 2024-04-19T03:01:34.771 INFO:teuthology.orchestra.run.smithi096.stdout: "ms_async_rdma_sl": "3", 2024-04-19T03:01:34.771 INFO:teuthology.orchestra.run.smithi096.stdout: "ms_async_rdma_support_srq": "true", 2024-04-19T03:01:34.771 INFO:teuthology.orchestra.run.smithi096.stdout: "ms_async_rdma_type": "ib", 2024-04-19T03:01:34.772 INFO:teuthology.orchestra.run.smithi096.stdout: "ms_async_reap_threshold": "5", 2024-04-19T03:01:34.772 INFO:teuthology.orchestra.run.smithi096.stdout: "ms_bind_before_connect": "false", 2024-04-19T03:01:34.772 INFO:teuthology.orchestra.run.smithi096.stdout: "ms_bind_ipv4": "true", 2024-04-19T03:01:34.772 INFO:teuthology.orchestra.run.smithi096.stdout: "ms_bind_ipv6": "false", 2024-04-19T03:01:34.772 INFO:teuthology.orchestra.run.smithi096.stdout: "ms_bind_msgr1": "true", 2024-04-19T03:01:34.772 INFO:teuthology.orchestra.run.smithi096.stdout: "ms_bind_msgr2": "true", 2024-04-19T03:01:34.772 INFO:teuthology.orchestra.run.smithi096.stdout: "ms_bind_port_max": "7568", 2024-04-19T03:01:34.772 INFO:teuthology.orchestra.run.smithi096.stdout: "ms_bind_port_min": "6800", 2024-04-19T03:01:34.772 INFO:teuthology.orchestra.run.smithi096.stdout: "ms_bind_prefer_ipv4": "false", 2024-04-19T03:01:34.772 INFO:teuthology.orchestra.run.smithi096.stdout: "ms_bind_retry_count": "3", 2024-04-19T03:01:34.772 INFO:teuthology.orchestra.run.smithi096.stdout: "ms_bind_retry_delay": "5", 2024-04-19T03:01:34.772 INFO:teuthology.orchestra.run.smithi096.stdout: "ms_blackhole_client": "false", 2024-04-19T03:01:34.772 INFO:teuthology.orchestra.run.smithi096.stdout: "ms_blackhole_mds": "false", 2024-04-19T03:01:34.772 INFO:teuthology.orchestra.run.smithi096.stdout: "ms_blackhole_mgr": "false", 2024-04-19T03:01:34.773 INFO:teuthology.orchestra.run.smithi096.stdout: "ms_blackhole_mon": "false", 2024-04-19T03:01:34.773 INFO:teuthology.orchestra.run.smithi096.stdout: "ms_blackhole_osd": "false", 2024-04-19T03:01:34.773 INFO:teuthology.orchestra.run.smithi096.stdout: "ms_client_mode": "crc secure", 2024-04-19T03:01:34.773 INFO:teuthology.orchestra.run.smithi096.stdout: "ms_cluster_mode": "crc secure", 2024-04-19T03:01:34.773 INFO:teuthology.orchestra.run.smithi096.stdout: "ms_cluster_type": "", 2024-04-19T03:01:34.773 INFO:teuthology.orchestra.run.smithi096.stdout: "ms_compress_secure": "false", 2024-04-19T03:01:34.773 INFO:teuthology.orchestra.run.smithi096.stdout: "ms_connection_idle_timeout": "900", 2024-04-19T03:01:34.773 INFO:teuthology.orchestra.run.smithi096.stdout: "ms_connection_ready_timeout": "10", 2024-04-19T03:01:34.773 INFO:teuthology.orchestra.run.smithi096.stdout: "ms_crc_data": "true", 2024-04-19T03:01:34.773 INFO:teuthology.orchestra.run.smithi096.stdout: "ms_crc_header": "true", 2024-04-19T03:01:34.773 INFO:teuthology.orchestra.run.smithi096.stdout: "ms_die_on_bad_msg": "false", 2024-04-19T03:01:34.773 INFO:teuthology.orchestra.run.smithi096.stdout: "ms_die_on_bug": "true", 2024-04-19T03:01:34.773 INFO:teuthology.orchestra.run.smithi096.stdout: "ms_die_on_old_message": "true", 2024-04-19T03:01:34.773 INFO:teuthology.orchestra.run.smithi096.stdout: "ms_die_on_skipped_message": "false", 2024-04-19T03:01:34.774 INFO:teuthology.orchestra.run.smithi096.stdout: "ms_die_on_unhandled_msg": "false", 2024-04-19T03:01:34.774 INFO:teuthology.orchestra.run.smithi096.stdout: "ms_dispatch_throttle_bytes": "104857600", 2024-04-19T03:01:34.774 INFO:teuthology.orchestra.run.smithi096.stdout: "ms_dpdk_coremask": "0xF", 2024-04-19T03:01:34.774 INFO:teuthology.orchestra.run.smithi096.stdout: "ms_dpdk_debug_allow_loopback": "false", 2024-04-19T03:01:34.774 INFO:teuthology.orchestra.run.smithi096.stdout: "ms_dpdk_devs_allowlist": "", 2024-04-19T03:01:34.774 INFO:teuthology.orchestra.run.smithi096.stdout: "ms_dpdk_enable_tso": "true", 2024-04-19T03:01:34.774 INFO:teuthology.orchestra.run.smithi096.stdout: "ms_dpdk_gateway_ipv4_addr": "", 2024-04-19T03:01:34.774 INFO:teuthology.orchestra.run.smithi096.stdout: "ms_dpdk_host_ipv4_addr": "", 2024-04-19T03:01:34.774 INFO:teuthology.orchestra.run.smithi096.stdout: "ms_dpdk_hugepages": "", 2024-04-19T03:01:34.774 INFO:teuthology.orchestra.run.smithi096.stdout: "ms_dpdk_hw_flow_control": "true", 2024-04-19T03:01:34.774 INFO:teuthology.orchestra.run.smithi096.stdout: "ms_dpdk_hw_queue_weight": "1.000000", 2024-04-19T03:01:34.774 INFO:teuthology.orchestra.run.smithi096.stdout: "ms_dpdk_lro": "true", 2024-04-19T03:01:34.774 INFO:teuthology.orchestra.run.smithi096.stdout: "ms_dpdk_memory_channel": "4", 2024-04-19T03:01:34.774 INFO:teuthology.orchestra.run.smithi096.stdout: "ms_dpdk_netmask_ipv4_addr": "", 2024-04-19T03:01:34.775 INFO:teuthology.orchestra.run.smithi096.stdout: "ms_dpdk_pmd": "", 2024-04-19T03:01:34.775 INFO:teuthology.orchestra.run.smithi096.stdout: "ms_dpdk_port_id": "0", 2024-04-19T03:01:34.775 INFO:teuthology.orchestra.run.smithi096.stdout: "ms_dpdk_rx_buffer_count_per_core": "8192", 2024-04-19T03:01:34.775 INFO:teuthology.orchestra.run.smithi096.stdout: "ms_dump_corrupt_message_level": "1", 2024-04-19T03:01:34.775 INFO:teuthology.orchestra.run.smithi096.stdout: "ms_dump_on_send": "false", 2024-04-19T03:01:34.775 INFO:teuthology.orchestra.run.smithi096.stdout: "ms_initial_backoff": "0.200000", 2024-04-19T03:01:34.775 INFO:teuthology.orchestra.run.smithi096.stdout: "ms_inject_delay_max": "1.000000", 2024-04-19T03:01:34.775 INFO:teuthology.orchestra.run.smithi096.stdout: "ms_inject_delay_probability": "0.000000", 2024-04-19T03:01:34.775 INFO:teuthology.orchestra.run.smithi096.stdout: "ms_inject_delay_type": "", 2024-04-19T03:01:34.775 INFO:teuthology.orchestra.run.smithi096.stdout: "ms_inject_internal_delays": "0.000000", 2024-04-19T03:01:34.775 INFO:teuthology.orchestra.run.smithi096.stdout: "ms_inject_network_congestion": "0", 2024-04-19T03:01:34.775 INFO:teuthology.orchestra.run.smithi096.stdout: "ms_inject_socket_failures": "0", 2024-04-19T03:01:34.775 INFO:teuthology.orchestra.run.smithi096.stdout: "ms_learn_addr_from_peer": "true", 2024-04-19T03:01:34.776 INFO:teuthology.orchestra.run.smithi096.stdout: "ms_max_accept_failures": "4", 2024-04-19T03:01:34.776 INFO:teuthology.orchestra.run.smithi096.stdout: "ms_max_backoff": "15.000000", 2024-04-19T03:01:34.776 INFO:teuthology.orchestra.run.smithi096.stdout: "ms_mon_client_mode": "secure crc", 2024-04-19T03:01:34.776 INFO:teuthology.orchestra.run.smithi096.stdout: "ms_mon_cluster_mode": "secure crc", 2024-04-19T03:01:34.776 INFO:teuthology.orchestra.run.smithi096.stdout: "ms_mon_service_mode": "secure crc", 2024-04-19T03:01:34.776 INFO:teuthology.orchestra.run.smithi096.stdout: "ms_osd_compress_min_size": "1024", 2024-04-19T03:01:34.776 INFO:teuthology.orchestra.run.smithi096.stdout: "ms_osd_compress_mode": "none", 2024-04-19T03:01:34.776 INFO:teuthology.orchestra.run.smithi096.stdout: "ms_osd_compression_algorithm": "snappy", 2024-04-19T03:01:34.776 INFO:teuthology.orchestra.run.smithi096.stdout: "ms_pq_max_tokens_per_priority": "16777216", 2024-04-19T03:01:34.776 INFO:teuthology.orchestra.run.smithi096.stdout: "ms_pq_min_cost": "65536", 2024-04-19T03:01:34.776 INFO:teuthology.orchestra.run.smithi096.stdout: "ms_public_type": "", 2024-04-19T03:01:34.776 INFO:teuthology.orchestra.run.smithi096.stdout: "ms_service_mode": "crc secure", 2024-04-19T03:01:34.776 INFO:teuthology.orchestra.run.smithi096.stdout: "ms_tcp_listen_backlog": "512", 2024-04-19T03:01:34.776 INFO:teuthology.orchestra.run.smithi096.stdout: "ms_tcp_nodelay": "true", 2024-04-19T03:01:34.777 INFO:teuthology.orchestra.run.smithi096.stdout: "ms_tcp_prefetch_max_size": "4096", 2024-04-19T03:01:34.777 INFO:teuthology.orchestra.run.smithi096.stdout: "ms_tcp_rcvbuf": "0", 2024-04-19T03:01:34.777 INFO:teuthology.orchestra.run.smithi096.stdout: "ms_type": "async+posix", 2024-04-19T03:01:34.777 INFO:teuthology.orchestra.run.smithi096.stdout: "no_config_file": "false", 2024-04-19T03:01:34.777 INFO:teuthology.orchestra.run.smithi096.stdout: "objecter_completion_locks_per_session": "32", 2024-04-19T03:01:34.777 INFO:teuthology.orchestra.run.smithi096.stdout: "objecter_debug_inject_relock_delay": "false", 2024-04-19T03:01:34.777 INFO:teuthology.orchestra.run.smithi096.stdout: "objecter_inflight_op_bytes": "104857600", 2024-04-19T03:01:34.777 INFO:teuthology.orchestra.run.smithi096.stdout: "objecter_inflight_ops": "1024", 2024-04-19T03:01:34.777 INFO:teuthology.orchestra.run.smithi096.stdout: "objecter_inject_no_watch_ping": "false", 2024-04-19T03:01:34.777 INFO:teuthology.orchestra.run.smithi096.stdout: "objecter_retry_writes_after_first_reply": "false", 2024-04-19T03:01:34.777 INFO:teuthology.orchestra.run.smithi096.stdout: "objecter_tick_interval": "5.000000", 2024-04-19T03:01:34.777 INFO:teuthology.orchestra.run.smithi096.stdout: "objecter_timeout": "10.000000", 2024-04-19T03:01:34.777 INFO:teuthology.orchestra.run.smithi096.stdout: "objectstore_blackhole": "false", 2024-04-19T03:01:34.777 INFO:teuthology.orchestra.run.smithi096.stdout: "openssl_engine_opts": "", 2024-04-19T03:01:34.778 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_agent_delay_time": "5.000000", 2024-04-19T03:01:34.778 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_agent_hist_halflife": "1000", 2024-04-19T03:01:34.778 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_agent_max_low_ops": "2", 2024-04-19T03:01:34.778 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_agent_max_ops": "4", 2024-04-19T03:01:34.778 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_agent_min_evict_effort": "0.100000", 2024-04-19T03:01:34.778 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_agent_quantize_effort": "0.100000", 2024-04-19T03:01:34.778 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_agent_slop": "0.020000", 2024-04-19T03:01:34.778 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_aggregated_slow_ops_logging": "true", 2024-04-19T03:01:34.778 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_allow_recovery_below_min_size": "true", 2024-04-19T03:01:34.778 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_asio_thread_count": "2", 2024-04-19T03:01:34.778 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_async_recovery_min_cost": "100", 2024-04-19T03:01:34.778 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_auto_mark_unfound_lost": "false", 2024-04-19T03:01:34.778 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_backfill_retry_interval": "30.000000", 2024-04-19T03:01:34.778 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_backfill_scan_max": "512", 2024-04-19T03:01:34.779 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_backfill_scan_min": "64", 2024-04-19T03:01:34.779 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_backoff_on_degraded": "false", 2024-04-19T03:01:34.779 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_backoff_on_peering": "false", 2024-04-19T03:01:34.779 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_backoff_on_unfound": "true", 2024-04-19T03:01:34.779 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_beacon_report_interval": "300", 2024-04-19T03:01:34.779 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_bench_duration": "30", 2024-04-19T03:01:34.779 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_bench_large_size_max_throughput": "104857600", 2024-04-19T03:01:34.779 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_bench_max_block_size": "67108864", 2024-04-19T03:01:34.779 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_bench_small_size_max_iops": "100", 2024-04-19T03:01:34.779 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_blkin_trace_all": "false", 2024-04-19T03:01:34.779 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_blocked_scrub_grace_period": "120", 2024-04-19T03:01:34.779 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_calc_pg_upmaps_aggressively": "true", 2024-04-19T03:01:34.779 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_calc_pg_upmaps_aggressively_fast": "true", 2024-04-19T03:01:34.779 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_calc_pg_upmaps_local_fallback_retries": "100", 2024-04-19T03:01:34.779 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_check_for_log_corruption": "false", 2024-04-19T03:01:34.780 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_check_max_object_name_len_on_startup": "true", 2024-04-19T03:01:34.780 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_class_default_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo", 2024-04-19T03:01:34.780 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_class_dir": "/usr/lib/rados-classes", 2024-04-19T03:01:34.780 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_class_load_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo", 2024-04-19T03:01:34.780 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_class_update_on_start": "true", 2024-04-19T03:01:34.780 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_client_message_cap": "256", 2024-04-19T03:01:34.780 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_client_message_size_cap": "524288000", 2024-04-19T03:01:34.780 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_client_op_priority": "63", 2024-04-19T03:01:34.780 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_client_watch_timeout": "30", 2024-04-19T03:01:34.780 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_command_max_records": "256", 2024-04-19T03:01:34.780 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_compact_on_start": "false", 2024-04-19T03:01:34.780 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_copyfrom_max_chunk": "8388608", 2024-04-19T03:01:34.780 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_crush_chooseleaf_type": "0", 2024-04-19T03:01:34.780 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_crush_initial_weight": "-1.000000", 2024-04-19T03:01:34.781 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_crush_update_on_start": "true", 2024-04-19T03:01:34.781 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_crush_update_weight_set": "true", 2024-04-19T03:01:34.781 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_data": "/var/lib/ceph/osd/ceph-a", 2024-04-19T03:01:34.781 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_debug_crash_on_ignored_backoff": "false", 2024-04-19T03:01:34.781 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_debug_deep_scrub_sleep": "0.000000", 2024-04-19T03:01:34.781 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_debug_drop_ping_duration": "0", 2024-04-19T03:01:34.781 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_debug_drop_ping_probability": "0.000000", 2024-04-19T03:01:34.781 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_debug_feed_pullee": "-1", 2024-04-19T03:01:34.781 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_debug_inject_copyfrom_error": "false", 2024-04-19T03:01:34.781 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_debug_inject_dispatch_delay_duration": "0.100000", 2024-04-19T03:01:34.781 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_debug_inject_dispatch_delay_probability": "0.000000", 2024-04-19T03:01:34.781 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_debug_misdirected_ops": "false", 2024-04-19T03:01:34.781 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_debug_no_acting_change": "false", 2024-04-19T03:01:34.782 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_debug_no_purge_strays": "false", 2024-04-19T03:01:34.782 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_debug_op_order": "false", 2024-04-19T03:01:34.782 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_debug_pg_log_writeout": "false", 2024-04-19T03:01:34.782 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_debug_pretend_recovery_active": "false", 2024-04-19T03:01:34.782 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_debug_random_push_read_error": "0.000000", 2024-04-19T03:01:34.782 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_debug_reject_backfill_probability": "0.000000", 2024-04-19T03:01:34.782 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_debug_shutdown": "false", 2024-04-19T03:01:34.782 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_debug_skip_full_check_in_backfill_reservation": "false", 2024-04-19T03:01:34.782 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_debug_skip_full_check_in_recovery": "false", 2024-04-19T03:01:34.782 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_debug_verify_cached_snaps": "false", 2024-04-19T03:01:34.782 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_debug_verify_missing_on_start": "false", 2024-04-19T03:01:34.782 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_debug_verify_snaps": "false", 2024-04-19T03:01:34.782 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_debug_verify_stray_on_activate": "false", 2024-04-19T03:01:34.783 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_deep_scrub_interval": "604800.000000", 2024-04-19T03:01:34.783 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_deep_scrub_keys": "1024", 2024-04-19T03:01:34.783 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_deep_scrub_large_omap_object_key_threshold": "200000", 2024-04-19T03:01:34.783 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_deep_scrub_large_omap_object_value_sum_threshold": "1073741824", 2024-04-19T03:01:34.783 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_deep_scrub_randomize_ratio": "0.150000", 2024-04-19T03:01:34.783 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_deep_scrub_stride": "524288", 2024-04-19T03:01:34.783 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_deep_scrub_update_digest_min_age": "7200", 2024-04-19T03:01:34.783 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_default_data_pool_replay_window": "5", 2024-04-19T03:01:34.783 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_default_notify_timeout": "30", 2024-04-19T03:01:34.783 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_delete_sleep": "0.000000", 2024-04-19T03:01:34.783 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_delete_sleep_hdd": "5.000000", 2024-04-19T03:01:34.783 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_delete_sleep_hybrid": "1.000000", 2024-04-19T03:01:34.783 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_delete_sleep_ssd": "1.000000", 2024-04-19T03:01:34.783 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_discard_disconnected_ops": "true", 2024-04-19T03:01:34.784 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_enable_op_tracker": "true", 2024-04-19T03:01:34.784 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_erasure_code_plugins": "jerasure lrc", 2024-04-19T03:01:34.784 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_extblkdev_plugins": "vdo", 2024-04-19T03:01:34.784 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_failsafe_full_ratio": "0.970000", 2024-04-19T03:01:34.784 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_fast_fail_on_connection_refused": "true", 2024-04-19T03:01:34.784 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_fast_info": "true", 2024-04-19T03:01:34.784 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_fast_shutdown": "true", 2024-04-19T03:01:34.784 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_fast_shutdown_notify_mon": "true", 2024-04-19T03:01:34.784 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_fast_shutdown_timeout": "15", 2024-04-19T03:01:34.784 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_find_best_info_ignore_history_les": "false", 2024-04-19T03:01:34.784 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_force_auth_primary_missing_objects": "100", 2024-04-19T03:01:34.784 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_force_recovery_pg_log_entries_factor": "1.300000", 2024-04-19T03:01:34.784 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_function_tracing": "false", 2024-04-19T03:01:34.784 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_heartbeat_grace": "20", 2024-04-19T03:01:34.785 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_heartbeat_interval": "6", 2024-04-19T03:01:34.785 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_heartbeat_min_healthy_ratio": "0.330000", 2024-04-19T03:01:34.785 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_heartbeat_min_peers": "10", 2024-04-19T03:01:34.785 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_heartbeat_min_size": "2000", 2024-04-19T03:01:34.785 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_heartbeat_stale": "600", 2024-04-19T03:01:34.785 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_heartbeat_use_min_delay_socket": "false", 2024-04-19T03:01:34.785 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_hit_set_max_size": "100000", 2024-04-19T03:01:34.785 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_hit_set_min_size": "1000", 2024-04-19T03:01:34.785 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_hit_set_namespace": ".ceph-internal", 2024-04-19T03:01:34.785 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_ignore_stale_divergent_priors": "false", 2024-04-19T03:01:34.785 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_inject_bad_map_crc_probability": "0.000000", 2024-04-19T03:01:34.785 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_inject_failure_on_pg_removal": "false", 2024-04-19T03:01:34.785 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_journal": "/var/lib/ceph/osd/ceph-a/journal", 2024-04-19T03:01:34.785 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_journal_flush_on_shutdown": "true", 2024-04-19T03:01:34.786 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_journal_size": "5120", 2024-04-19T03:01:34.786 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_kill_backfill_at": "0", 2024-04-19T03:01:34.786 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_loop_before_reset_tphandle": "64", 2024-04-19T03:01:34.786 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_map_cache_size": "50", 2024-04-19T03:01:34.786 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_map_dedup": "true", 2024-04-19T03:01:34.786 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_map_message_max": "40", 2024-04-19T03:01:34.786 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_map_message_max_bytes": "10485760", 2024-04-19T03:01:34.786 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_map_share_max_epochs": "40", 2024-04-19T03:01:34.786 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_max_attr_name_len": "100", 2024-04-19T03:01:34.786 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_max_attr_size": "0", 2024-04-19T03:01:34.786 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_max_backfills": "1", 2024-04-19T03:01:34.786 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_max_markdown_count": "5", 2024-04-19T03:01:34.786 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_max_markdown_period": "600", 2024-04-19T03:01:34.786 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_max_object_name_len": "2048", 2024-04-19T03:01:34.787 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_max_object_namespace_len": "256", 2024-04-19T03:01:34.787 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_max_object_size": "134217728", 2024-04-19T03:01:34.787 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_max_omap_bytes_per_request": "1073741824", 2024-04-19T03:01:34.787 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_max_omap_entries_per_request": "1024", 2024-04-19T03:01:34.787 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_max_pg_blocked_by": "16", 2024-04-19T03:01:34.787 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_max_pg_log_entries": "10000", 2024-04-19T03:01:34.787 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_max_pg_per_osd_hard_ratio": "3.000000", 2024-04-19T03:01:34.787 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_max_pgls": "1024", 2024-04-19T03:01:34.787 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_max_push_cost": "8388608", 2024-04-19T03:01:34.787 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_max_push_objects": "10", 2024-04-19T03:01:34.787 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_max_scrubs": "3", 2024-04-19T03:01:34.787 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_max_snap_prune_intervals_per_epoch": "512", 2024-04-19T03:01:34.787 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_max_trimming_pgs": "2", 2024-04-19T03:01:34.787 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_max_write_op_reply_len": "64", 2024-04-19T03:01:34.788 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_max_write_size": "90", 2024-04-19T03:01:34.788 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_mclock_force_run_benchmark_on_init": "false", 2024-04-19T03:01:34.788 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_mclock_iops_capacity_threshold_hdd": "500.000000", 2024-04-19T03:01:34.788 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_mclock_iops_capacity_threshold_ssd": "80000.000000", 2024-04-19T03:01:34.788 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_mclock_max_capacity_iops_hdd": "315.000000", 2024-04-19T03:01:34.788 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_mclock_max_capacity_iops_ssd": "21500.000000", 2024-04-19T03:01:34.788 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_mclock_max_sequential_bandwidth_hdd": "157286400", 2024-04-19T03:01:34.788 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_mclock_max_sequential_bandwidth_ssd": "1258291200", 2024-04-19T03:01:34.788 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_mclock_override_recovery_settings": "false", 2024-04-19T03:01:34.788 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_mclock_profile": "balanced", 2024-04-19T03:01:34.788 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_mclock_scheduler_anticipation_timeout": "0.000000", 2024-04-19T03:01:34.788 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_mclock_scheduler_background_best_effort_lim": "0.000000", 2024-04-19T03:01:34.788 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_mclock_scheduler_background_best_effort_res": "0.000000", 2024-04-19T03:01:34.788 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_mclock_scheduler_background_best_effort_wgt": "1", 2024-04-19T03:01:34.789 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_mclock_scheduler_background_recovery_lim": "0.000000", 2024-04-19T03:01:34.789 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_mclock_scheduler_background_recovery_res": "0.000000", 2024-04-19T03:01:34.789 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_mclock_scheduler_background_recovery_wgt": "1", 2024-04-19T03:01:34.789 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_mclock_scheduler_client_lim": "0.000000", 2024-04-19T03:01:34.789 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_mclock_scheduler_client_res": "0.000000", 2024-04-19T03:01:34.789 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_mclock_scheduler_client_wgt": "1", 2024-04-19T03:01:34.789 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_mclock_skip_benchmark": "false", 2024-04-19T03:01:34.789 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_memory_base": "805306368", 2024-04-19T03:01:34.789 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_memory_cache_min": "134217728", 2024-04-19T03:01:34.789 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_memory_cache_resize_interval": "1.000000", 2024-04-19T03:01:34.789 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_memory_expected_fragmentation": "0.150000", 2024-04-19T03:01:34.789 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_memory_target": "4294967296", 2024-04-19T03:01:34.789 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_memory_target_autotune": "false", 2024-04-19T03:01:34.789 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_memory_target_cgroup_limit_ratio": "0.800000", 2024-04-19T03:01:34.789 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_min_pg_log_entries": "250", 2024-04-19T03:01:34.790 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_min_recovery_priority": "0", 2024-04-19T03:01:34.790 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_mon_heartbeat_interval": "30", 2024-04-19T03:01:34.790 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_mon_heartbeat_stat_stale": "3600", 2024-04-19T03:01:34.790 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_mon_report_interval": "5", 2024-04-19T03:01:34.790 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_mon_report_max_in_flight": "2", 2024-04-19T03:01:34.790 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_mon_shutdown_timeout": "5.000000", 2024-04-19T03:01:34.790 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_num_cache_shards": "32", 2024-04-19T03:01:34.790 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_num_op_tracker_shard": "32", 2024-04-19T03:01:34.790 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_numa_auto_affinity": "true", 2024-04-19T03:01:34.790 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_numa_node": "-1", 2024-04-19T03:01:34.790 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_numa_prefer_iface": "true", 2024-04-19T03:01:34.790 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_object_clean_region_max_num_intervals": "10", 2024-04-19T03:01:34.790 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_objecter_finishers": "1", 2024-04-19T03:01:34.790 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_objectstore": "bluestore", 2024-04-19T03:01:34.791 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_objectstore_fuse": "false", 2024-04-19T03:01:34.791 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_objectstore_tracing": "false", 2024-04-19T03:01:34.791 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_op_complaint_time": "30.000000", 2024-04-19T03:01:34.791 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_op_history_duration": "600", 2024-04-19T03:01:34.791 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_op_history_size": "20", 2024-04-19T03:01:34.791 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_op_history_slow_op_size": "20", 2024-04-19T03:01:34.791 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_op_history_slow_op_threshold": "10.000000", 2024-04-19T03:01:34.791 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_op_log_threshold": "5", 2024-04-19T03:01:34.791 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_op_num_shards": "0", 2024-04-19T03:01:34.791 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_op_num_shards_hdd": "5", 2024-04-19T03:01:34.791 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_op_num_shards_ssd": "8", 2024-04-19T03:01:34.791 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_op_num_threads_per_shard": "0", 2024-04-19T03:01:34.791 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_op_num_threads_per_shard_hdd": "1", 2024-04-19T03:01:34.791 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_op_num_threads_per_shard_ssd": "2", 2024-04-19T03:01:34.792 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_op_pq_max_tokens_per_priority": "4194304", 2024-04-19T03:01:34.792 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_op_pq_min_cost": "65536", 2024-04-19T03:01:34.792 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_op_queue": "mclock_scheduler", 2024-04-19T03:01:34.792 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_op_queue_cut_off": "high", 2024-04-19T03:01:34.792 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_op_thread_suicide_timeout": "150", 2024-04-19T03:01:34.792 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_op_thread_timeout": "15", 2024-04-19T03:01:34.792 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_open_classes_on_start": "true", 2024-04-19T03:01:34.792 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_os_flags": "0", 2024-04-19T03:01:34.792 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_peering_op_priority": "255", 2024-04-19T03:01:34.792 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_pg_delete_cost": "1048576", 2024-04-19T03:01:34.792 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_pg_delete_priority": "5", 2024-04-19T03:01:34.792 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_pg_epoch_max_lag_factor": "2.000000", 2024-04-19T03:01:34.792 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_pg_epoch_persisted_max_stale": "40", 2024-04-19T03:01:34.792 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_pg_log_dups_tracked": "3000", 2024-04-19T03:01:34.793 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_pg_log_trim_max": "10000", 2024-04-19T03:01:34.793 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_pg_log_trim_min": "100", 2024-04-19T03:01:34.793 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_pg_max_concurrent_snap_trims": "2", 2024-04-19T03:01:34.793 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_pg_object_context_cache_count": "64", 2024-04-19T03:01:34.793 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_pg_stat_report_interval_max": "500", 2024-04-19T03:01:34.793 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_pool_default_cache_max_evict_check_size": "10", 2024-04-19T03:01:34.793 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_pool_default_cache_min_evict_age": "0", 2024-04-19T03:01:34.793 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_pool_default_cache_min_flush_age": "0", 2024-04-19T03:01:34.793 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_pool_default_cache_target_dirty_high_ratio": "0.600000", 2024-04-19T03:01:34.793 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_pool_default_cache_target_dirty_ratio": "0.400000", 2024-04-19T03:01:34.793 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_pool_default_cache_target_full_ratio": "0.800000", 2024-04-19T03:01:34.793 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_pool_default_crimson": "false", 2024-04-19T03:01:34.793 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_pool_default_crush_rule": "-1", 2024-04-19T03:01:34.793 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_pool_default_ec_fast_read": "false", 2024-04-19T03:01:34.793 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_pool_default_erasure_code_profile": "plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd", 2024-04-19T03:01:34.794 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_pool_default_flag_bulk": "false", 2024-04-19T03:01:34.794 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_pool_default_flag_hashpspool": "true", 2024-04-19T03:01:34.794 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_pool_default_flag_nodelete": "false", 2024-04-19T03:01:34.794 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_pool_default_flag_nopgchange": "false", 2024-04-19T03:01:34.794 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_pool_default_flag_nosizechange": "false", 2024-04-19T03:01:34.794 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_pool_default_flags": "0", 2024-04-19T03:01:34.794 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_pool_default_hit_set_bloom_fpp": "0.050000", 2024-04-19T03:01:34.794 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_pool_default_min_size": "0", 2024-04-19T03:01:34.794 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_pool_default_pg_autoscale_mode": "off", 2024-04-19T03:01:34.794 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_pool_default_pg_num": "32", 2024-04-19T03:01:34.794 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_pool_default_pgp_num": "0", 2024-04-19T03:01:34.794 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_pool_default_read_lease_ratio": "0.800000", 2024-04-19T03:01:34.794 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_pool_default_size": "2", 2024-04-19T03:01:34.794 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_pool_default_type": "replicated", 2024-04-19T03:01:34.795 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_pool_erasure_code_stripe_unit": "4096", 2024-04-19T03:01:34.795 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_pool_use_gmt_hitset": "true", 2024-04-19T03:01:34.795 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_push_per_object_cost": "1000", 2024-04-19T03:01:34.795 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_read_ec_check_for_errors": "false", 2024-04-19T03:01:34.795 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_recover_clone_overlap": "true", 2024-04-19T03:01:34.795 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_recover_clone_overlap_limit": "10", 2024-04-19T03:01:34.795 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_recovery_cost": "20971520", 2024-04-19T03:01:34.795 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_recovery_delay_start": "0.000000", 2024-04-19T03:01:34.795 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_recovery_max_active": "0", 2024-04-19T03:01:34.795 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_recovery_max_active_hdd": "3", 2024-04-19T03:01:34.795 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_recovery_max_active_ssd": "10", 2024-04-19T03:01:34.795 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_recovery_max_chunk": "8388608", 2024-04-19T03:01:34.795 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_recovery_max_omap_entries_per_chunk": "8096", 2024-04-19T03:01:34.795 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_recovery_max_single_start": "1", 2024-04-19T03:01:34.796 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_recovery_op_priority": "3", 2024-04-19T03:01:34.796 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_recovery_op_warn_multiple": "16", 2024-04-19T03:01:34.796 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_recovery_priority": "5", 2024-04-19T03:01:34.796 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_recovery_retry_interval": "30.000000", 2024-04-19T03:01:34.796 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_recovery_sleep": "0.000000", 2024-04-19T03:01:34.796 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_recovery_sleep_hdd": "0.100000", 2024-04-19T03:01:34.796 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_recovery_sleep_hybrid": "0.025000", 2024-04-19T03:01:34.796 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_recovery_sleep_ssd": "0.000000", 2024-04-19T03:01:34.796 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_repair_during_recovery": "false", 2024-04-19T03:01:34.796 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_requested_scrub_priority": "120", 2024-04-19T03:01:34.796 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_rocksdb_iterator_bounds_enabled": "true", 2024-04-19T03:01:34.796 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_rollback_to_cluster_snap": "", 2024-04-19T03:01:34.796 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_scrub_auto_repair": "false", 2024-04-19T03:01:34.796 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_scrub_auto_repair_num_errors": "5", 2024-04-19T03:01:34.797 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_scrub_backoff_ratio": "0.660000", 2024-04-19T03:01:34.797 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_scrub_begin_hour": "0", 2024-04-19T03:01:34.797 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_scrub_begin_week_day": "0", 2024-04-19T03:01:34.797 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_scrub_chunk_max": "25", 2024-04-19T03:01:34.797 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_scrub_chunk_min": "5", 2024-04-19T03:01:34.797 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_scrub_cost": "52428800", 2024-04-19T03:01:34.797 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_scrub_during_recovery": "false", 2024-04-19T03:01:34.797 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_scrub_end_hour": "0", 2024-04-19T03:01:34.797 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_scrub_end_week_day": "0", 2024-04-19T03:01:34.797 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_scrub_event_cost": "4096", 2024-04-19T03:01:34.797 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_scrub_extended_sleep": "0.000000", 2024-04-19T03:01:34.797 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_scrub_interval_randomize_ratio": "0.500000", 2024-04-19T03:01:34.797 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_scrub_invalid_stats": "true", 2024-04-19T03:01:34.797 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_scrub_load_threshold": "0.500000", 2024-04-19T03:01:34.798 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_scrub_max_interval": "604800.000000", 2024-04-19T03:01:34.798 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_scrub_max_preemptions": "5", 2024-04-19T03:01:34.798 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_scrub_min_interval": "86400.000000", 2024-04-19T03:01:34.798 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_scrub_priority": "5", 2024-04-19T03:01:34.798 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_scrub_reservation_timeout": "5000", 2024-04-19T03:01:34.798 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_scrub_sleep": "0.000000", 2024-04-19T03:01:34.798 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_scrub_slow_reservation_response": "2200", 2024-04-19T03:01:34.798 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_shallow_scrub_chunk_max": "100", 2024-04-19T03:01:34.798 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_shallow_scrub_chunk_min": "50", 2024-04-19T03:01:34.798 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_shutdown_pgref_assert": "false", 2024-04-19T03:01:34.798 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_skip_data_digest": "false", 2024-04-19T03:01:34.798 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_smart_report_timeout": "5", 2024-04-19T03:01:34.798 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_snap_trim_cost": "1048576", 2024-04-19T03:01:34.798 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_snap_trim_priority": "5", 2024-04-19T03:01:34.799 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_snap_trim_sleep": "0.000000", 2024-04-19T03:01:34.799 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_snap_trim_sleep_hdd": "5.000000", 2024-04-19T03:01:34.799 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_snap_trim_sleep_hybrid": "2.000000", 2024-04-19T03:01:34.799 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_snap_trim_sleep_ssd": "0.000000", 2024-04-19T03:01:34.799 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_stats_update_period_not_scrubbing": "120", 2024-04-19T03:01:34.799 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_stats_update_period_scrubbing": "15", 2024-04-19T03:01:34.799 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_target_pg_log_entries_per_osd": "300000", 2024-04-19T03:01:34.799 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_target_transaction_size": "30", 2024-04-19T03:01:34.799 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_tier_default_cache_hit_set_count": "4", 2024-04-19T03:01:34.799 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_tier_default_cache_hit_set_grade_decay_rate": "20", 2024-04-19T03:01:34.799 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_tier_default_cache_hit_set_period": "1200", 2024-04-19T03:01:34.799 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_tier_default_cache_hit_set_search_last_n": "1", 2024-04-19T03:01:34.799 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_tier_default_cache_hit_set_type": "bloom", 2024-04-19T03:01:34.799 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_tier_default_cache_min_read_recency_for_promote": "1", 2024-04-19T03:01:34.799 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_tier_default_cache_min_write_recency_for_promote": "1", 2024-04-19T03:01:34.800 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_tier_default_cache_mode": "writeback", 2024-04-19T03:01:34.800 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_tier_promote_max_bytes_sec": "5242880", 2024-04-19T03:01:34.800 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_tier_promote_max_objects_sec": "25", 2024-04-19T03:01:34.800 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_tracing": "false", 2024-04-19T03:01:34.800 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_use_stale_snap": "false", 2024-04-19T03:01:34.800 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_uuid": "00000000-0000-0000-0000-000000000000", 2024-04-19T03:01:34.800 INFO:teuthology.orchestra.run.smithi096.stdout: "osdc_blkin_trace_all": "false", 2024-04-19T03:01:34.800 INFO:teuthology.orchestra.run.smithi096.stdout: "paxos_kill_at": "0", 2024-04-19T03:01:34.800 INFO:teuthology.orchestra.run.smithi096.stdout: "paxos_max_join_drift": "10", 2024-04-19T03:01:34.800 INFO:teuthology.orchestra.run.smithi096.stdout: "paxos_min": "500", 2024-04-19T03:01:34.800 INFO:teuthology.orchestra.run.smithi096.stdout: "paxos_min_wait": "0.050000", 2024-04-19T03:01:34.800 INFO:teuthology.orchestra.run.smithi096.stdout: "paxos_propose_interval": "1.000000", 2024-04-19T03:01:34.800 INFO:teuthology.orchestra.run.smithi096.stdout: "paxos_service_trim_max": "500", 2024-04-19T03:01:34.801 INFO:teuthology.orchestra.run.smithi096.stdout: "paxos_service_trim_max_multiplier": "20", 2024-04-19T03:01:34.801 INFO:teuthology.orchestra.run.smithi096.stdout: "paxos_service_trim_min": "250", 2024-04-19T03:01:34.801 INFO:teuthology.orchestra.run.smithi096.stdout: "paxos_stash_full_interval": "25", 2024-04-19T03:01:34.801 INFO:teuthology.orchestra.run.smithi096.stdout: "paxos_trim_max": "500", 2024-04-19T03:01:34.801 INFO:teuthology.orchestra.run.smithi096.stdout: "paxos_trim_min": "250", 2024-04-19T03:01:34.801 INFO:teuthology.orchestra.run.smithi096.stdout: "perf": "true", 2024-04-19T03:01:34.801 INFO:teuthology.orchestra.run.smithi096.stdout: "pid_file": "/var/run/ceph/ceph-mon.a.pid", 2024-04-19T03:01:34.801 INFO:teuthology.orchestra.run.smithi096.stdout: "plugin_crypto_accelerator": "crypto_isal", 2024-04-19T03:01:34.801 INFO:teuthology.orchestra.run.smithi096.stdout: "plugin_dir": "/usr/lib/ceph", 2024-04-19T03:01:34.801 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addr": "-", 2024-04-19T03:01:34.801 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addrv": "", 2024-04-19T03:01:34.801 INFO:teuthology.orchestra.run.smithi096.stdout: "public_bind_addr": "-", 2024-04-19T03:01:34.801 INFO:teuthology.orchestra.run.smithi096.stdout: "public_network": "", 2024-04-19T03:01:34.801 INFO:teuthology.orchestra.run.smithi096.stdout: "public_network_interface": "", 2024-04-19T03:01:34.802 INFO:teuthology.orchestra.run.smithi096.stdout: "qat_compressor_enabled": "false", 2024-04-19T03:01:34.802 INFO:teuthology.orchestra.run.smithi096.stdout: "qat_compressor_session_max_number": "256", 2024-04-19T03:01:34.802 INFO:teuthology.orchestra.run.smithi096.stdout: "rados_mon_op_timeout": "0", 2024-04-19T03:01:34.802 INFO:teuthology.orchestra.run.smithi096.stdout: "rados_osd_op_timeout": "0", 2024-04-19T03:01:34.802 INFO:teuthology.orchestra.run.smithi096.stdout: "rados_tracing": "false", 2024-04-19T03:01:34.802 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_atime_update_interval": "60", 2024-04-19T03:01:34.802 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_auto_exclusive_lock_until_manual_request": "true", 2024-04-19T03:01:34.802 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_balance_parent_reads": "false", 2024-04-19T03:01:34.802 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_balance_snap_reads": "false", 2024-04-19T03:01:34.802 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_blkin_trace_all": "false", 2024-04-19T03:01:34.802 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_blocklist_expire_seconds": "0", 2024-04-19T03:01:34.802 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_blocklist_on_break_lock": "true", 2024-04-19T03:01:34.802 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_cache": "true", 2024-04-19T03:01:34.802 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_cache_block_writes_upfront": "false", 2024-04-19T03:01:34.803 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_cache_max_dirty": "25165824", 2024-04-19T03:01:34.803 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_cache_max_dirty_age": "1.000000", 2024-04-19T03:01:34.803 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_cache_max_dirty_object": "0", 2024-04-19T03:01:34.803 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_cache_policy": "writearound", 2024-04-19T03:01:34.803 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_cache_size": "33554432", 2024-04-19T03:01:34.803 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_cache_target_dirty": "16777216", 2024-04-19T03:01:34.803 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_cache_writethrough_until_flush": "true", 2024-04-19T03:01:34.803 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_clone_copy_on_read": "false", 2024-04-19T03:01:34.803 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_compression_hint": "none", 2024-04-19T03:01:34.803 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_concurrent_management_ops": "10", 2024-04-19T03:01:34.803 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_config_pool_override_update_timestamp": "0", 2024-04-19T03:01:34.803 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_default_clone_format": "auto", 2024-04-19T03:01:34.803 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_default_data_pool": "", 2024-04-19T03:01:34.804 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_default_features": "61", 2024-04-19T03:01:34.804 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_default_format": "2", 2024-04-19T03:01:34.804 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_default_map_options": "", 2024-04-19T03:01:34.804 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_default_order": "22", 2024-04-19T03:01:34.804 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_default_pool": "rbd", 2024-04-19T03:01:34.804 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_default_snapshot_quiesce_mode": "required", 2024-04-19T03:01:34.804 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_default_stripe_count": "0", 2024-04-19T03:01:34.804 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_default_stripe_unit": "0", 2024-04-19T03:01:34.804 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_disable_zero_copy_writes": "true", 2024-04-19T03:01:34.804 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_discard_granularity_bytes": "65536", 2024-04-19T03:01:34.804 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_discard_on_zeroed_write_same": "true", 2024-04-19T03:01:34.804 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_enable_alloc_hint": "true", 2024-04-19T03:01:34.804 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_invalidate_object_map_on_timeout": "true", 2024-04-19T03:01:34.804 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_io_scheduler": "simple", 2024-04-19T03:01:34.805 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_io_scheduler_simple_max_delay": "0", 2024-04-19T03:01:34.805 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_journal_commit_age": "5.000000", 2024-04-19T03:01:34.805 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_journal_max_concurrent_object_sets": "0", 2024-04-19T03:01:34.805 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_journal_max_payload_bytes": "16384", 2024-04-19T03:01:34.805 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_journal_object_flush_age": "0.000000", 2024-04-19T03:01:34.805 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_journal_object_flush_bytes": "1048576", 2024-04-19T03:01:34.805 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_journal_object_flush_interval": "0", 2024-04-19T03:01:34.805 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_journal_object_max_in_flight_appends": "0", 2024-04-19T03:01:34.805 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_journal_object_writethrough_until_flush": "true", 2024-04-19T03:01:34.805 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_journal_order": "24", 2024-04-19T03:01:34.805 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_journal_pool": "", 2024-04-19T03:01:34.805 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_journal_splay_width": "4", 2024-04-19T03:01:34.805 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_localize_parent_reads": "false", 2024-04-19T03:01:34.805 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_localize_snap_reads": "false", 2024-04-19T03:01:34.806 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_mirror_concurrent_image_deletions": "1", 2024-04-19T03:01:34.806 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_mirror_concurrent_image_syncs": "5", 2024-04-19T03:01:34.806 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_mirror_delete_retry_interval": "30.000000", 2024-04-19T03:01:34.806 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_mirror_image_perf_stats_prio": "5", 2024-04-19T03:01:34.806 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_mirror_image_policy_migration_throttle": "300", 2024-04-19T03:01:34.806 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_mirror_image_policy_rebalance_timeout": "0.000000", 2024-04-19T03:01:34.806 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_mirror_image_policy_type": "simple", 2024-04-19T03:01:34.806 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_mirror_image_policy_update_throttle_interval": "1.000000", 2024-04-19T03:01:34.806 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_mirror_image_state_check_interval": "30", 2024-04-19T03:01:34.806 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_mirror_journal_commit_age": "5.000000", 2024-04-19T03:01:34.806 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_mirror_journal_poll_age": "5.000000", 2024-04-19T03:01:34.806 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_mirror_leader_heartbeat_interval": "5", 2024-04-19T03:01:34.806 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_mirror_leader_max_acquire_attempts_before_break": "3", 2024-04-19T03:01:34.806 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_mirror_leader_max_missed_heartbeats": "2", 2024-04-19T03:01:34.806 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_mirror_memory_autotune": "true", 2024-04-19T03:01:34.807 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_mirror_memory_base": "805306368", 2024-04-19T03:01:34.807 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_mirror_memory_cache_autotune_interval": "30.000000", 2024-04-19T03:01:34.807 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_mirror_memory_cache_min": "134217728", 2024-04-19T03:01:34.807 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_mirror_memory_cache_resize_interval": "5.000000", 2024-04-19T03:01:34.807 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_mirror_memory_expected_fragmentation": "0.150000", 2024-04-19T03:01:34.807 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_mirror_memory_target": "4294967296", 2024-04-19T03:01:34.807 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_mirror_perf_stats_prio": "5", 2024-04-19T03:01:34.807 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_mirror_pool_replayers_refresh_interval": "30", 2024-04-19T03:01:34.807 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_mirror_sync_point_update_age": "30.000000", 2024-04-19T03:01:34.807 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_mirroring_delete_delay": "0", 2024-04-19T03:01:34.807 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_mirroring_max_mirroring_snapshots": "5", 2024-04-19T03:01:34.807 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_mirroring_replay_delay": "0", 2024-04-19T03:01:34.807 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_mirroring_resync_after_disconnect": "false", 2024-04-19T03:01:34.807 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_move_parent_to_trash_on_remove": "false", 2024-04-19T03:01:34.808 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_move_to_trash_on_remove": "false", 2024-04-19T03:01:34.808 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_move_to_trash_on_remove_expire_seconds": "0", 2024-04-19T03:01:34.808 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_mtime_update_interval": "60", 2024-04-19T03:01:34.808 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_non_blocking_aio": "true", 2024-04-19T03:01:34.808 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_op_thread_timeout": "60", 2024-04-19T03:01:34.808 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_op_threads": "1", 2024-04-19T03:01:34.808 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_parent_cache_enabled": "false", 2024-04-19T03:01:34.808 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_persistent_cache_mode": "disabled", 2024-04-19T03:01:34.808 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_persistent_cache_path": "/tmp", 2024-04-19T03:01:34.808 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_persistent_cache_size": "1073741824", 2024-04-19T03:01:34.808 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_plugins": "", 2024-04-19T03:01:34.808 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_qos_bps_burst": "0", 2024-04-19T03:01:34.808 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_qos_bps_burst_seconds": "1", 2024-04-19T03:01:34.808 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_qos_bps_limit": "0", 2024-04-19T03:01:34.808 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_qos_exclude_ops": "0", 2024-04-19T03:01:34.809 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_qos_iops_burst": "0", 2024-04-19T03:01:34.809 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_qos_iops_burst_seconds": "1", 2024-04-19T03:01:34.809 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_qos_iops_limit": "0", 2024-04-19T03:01:34.809 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_qos_read_bps_burst": "0", 2024-04-19T03:01:34.809 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_qos_read_bps_burst_seconds": "1", 2024-04-19T03:01:34.809 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_qos_read_bps_limit": "0", 2024-04-19T03:01:34.809 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_qos_read_iops_burst": "0", 2024-04-19T03:01:34.809 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_qos_read_iops_burst_seconds": "1", 2024-04-19T03:01:34.809 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_qos_read_iops_limit": "0", 2024-04-19T03:01:34.809 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_qos_schedule_tick_min": "50", 2024-04-19T03:01:34.809 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_qos_write_bps_burst": "0", 2024-04-19T03:01:34.809 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_qos_write_bps_burst_seconds": "1", 2024-04-19T03:01:34.809 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_qos_write_bps_limit": "0", 2024-04-19T03:01:34.810 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_qos_write_iops_burst": "0", 2024-04-19T03:01:34.810 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_qos_write_iops_burst_seconds": "1", 2024-04-19T03:01:34.810 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_qos_write_iops_limit": "0", 2024-04-19T03:01:34.810 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_quiesce_notification_attempts": "10", 2024-04-19T03:01:34.810 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_read_from_replica_policy": "default", 2024-04-19T03:01:34.810 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_readahead_disable_after_bytes": "52428800", 2024-04-19T03:01:34.810 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_readahead_max_bytes": "524288", 2024-04-19T03:01:34.810 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_readahead_trigger_requests": "10", 2024-04-19T03:01:34.810 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_request_timed_out_seconds": "30", 2024-04-19T03:01:34.810 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_skip_partial_discard": "true", 2024-04-19T03:01:34.810 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_sparse_read_threshold_bytes": "65536", 2024-04-19T03:01:34.810 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_tracing": "false", 2024-04-19T03:01:34.810 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_validate_names": "true", 2024-04-19T03:01:34.810 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd_validate_pool": "true", 2024-04-19T03:01:34.811 INFO:teuthology.orchestra.run.smithi096.stdout: "restapi_base_url": "", 2024-04-19T03:01:34.811 INFO:teuthology.orchestra.run.smithi096.stdout: "restapi_log_level": "", 2024-04-19T03:01:34.811 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_acl_grants_max_num": "100", 2024-04-19T03:01:34.811 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_admin_entry": "admin", 2024-04-19T03:01:34.811 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_allow_notification_secrets_in_cleartext": "false", 2024-04-19T03:01:34.811 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_backend_store": "rados", 2024-04-19T03:01:34.811 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_barbican_url": "", 2024-04-19T03:01:34.811 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_beast_enable_async": "true", 2024-04-19T03:01:34.811 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_bucket_default_quota_max_objects": "-1", 2024-04-19T03:01:34.811 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_bucket_default_quota_max_size": "-1", 2024-04-19T03:01:34.811 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_bucket_index_max_aio": "128", 2024-04-19T03:01:34.811 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_bucket_index_transaction_instrumentation": "false", 2024-04-19T03:01:34.811 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_bucket_quota_cache_size": "10000", 2024-04-19T03:01:34.812 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_bucket_quota_ttl": "600", 2024-04-19T03:01:34.812 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_bucket_sync_spawn_window": "20", 2024-04-19T03:01:34.812 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_cache_enabled": "true", 2024-04-19T03:01:34.812 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_cache_expiry_interval": "900", 2024-04-19T03:01:34.812 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_cache_lru_size": "10000", 2024-04-19T03:01:34.812 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_config_store": "rados", 2024-04-19T03:01:34.812 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_content_length_compat": "false", 2024-04-19T03:01:34.812 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_copy_obj_progress": "true", 2024-04-19T03:01:34.812 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_copy_obj_progress_every_bytes": "1048576", 2024-04-19T03:01:34.812 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_cors_rules_max_num": "100", 2024-04-19T03:01:34.812 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_cross_domain_policy": "", 2024-04-19T03:01:34.812 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_crypt_default_encryption_key": "", 2024-04-19T03:01:34.812 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_crypt_kmip_addr": "", 2024-04-19T03:01:34.812 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_crypt_kmip_ca_path": "", 2024-04-19T03:01:34.813 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_crypt_kmip_client_cert": "", 2024-04-19T03:01:34.813 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_crypt_kmip_client_key": "", 2024-04-19T03:01:34.813 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_crypt_kmip_kms_key_template": "", 2024-04-19T03:01:34.813 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_crypt_kmip_password": "", 2024-04-19T03:01:34.813 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_crypt_kmip_s3_key_template": "$keyid", 2024-04-19T03:01:34.813 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_crypt_kmip_username": "", 2024-04-19T03:01:34.813 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_crypt_require_ssl": "true", 2024-04-19T03:01:34.813 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_crypt_s3_kms_backend": "barbican", 2024-04-19T03:01:34.813 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_crypt_s3_kms_encryption_keys": "", 2024-04-19T03:01:34.813 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_crypt_sse_s3_backend": "vault", 2024-04-19T03:01:34.813 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_crypt_sse_s3_key_template": "%bucket_id", 2024-04-19T03:01:34.813 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_crypt_sse_s3_vault_addr": "", 2024-04-19T03:01:34.813 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_crypt_sse_s3_vault_auth": "token", 2024-04-19T03:01:34.813 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_crypt_sse_s3_vault_namespace": "", 2024-04-19T03:01:34.814 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_crypt_sse_s3_vault_prefix": "", 2024-04-19T03:01:34.814 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_crypt_sse_s3_vault_secret_engine": "transit", 2024-04-19T03:01:34.814 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_crypt_sse_s3_vault_ssl_cacert": "", 2024-04-19T03:01:34.814 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_crypt_sse_s3_vault_ssl_clientcert": "", 2024-04-19T03:01:34.814 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_crypt_sse_s3_vault_ssl_clientkey": "", 2024-04-19T03:01:34.814 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_crypt_sse_s3_vault_token_file": "", 2024-04-19T03:01:34.814 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_crypt_sse_s3_vault_verify_ssl": "true", 2024-04-19T03:01:34.814 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_crypt_suppress_logs": "true", 2024-04-19T03:01:34.814 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_crypt_vault_addr": "", 2024-04-19T03:01:34.814 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_crypt_vault_auth": "token", 2024-04-19T03:01:34.814 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_crypt_vault_namespace": "", 2024-04-19T03:01:34.814 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_crypt_vault_prefix": "", 2024-04-19T03:01:34.814 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_crypt_vault_secret_engine": "transit", 2024-04-19T03:01:34.815 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_crypt_vault_ssl_cacert": "", 2024-04-19T03:01:34.815 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_crypt_vault_ssl_clientcert": "", 2024-04-19T03:01:34.815 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_crypt_vault_ssl_clientkey": "", 2024-04-19T03:01:34.815 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_crypt_vault_token_file": "", 2024-04-19T03:01:34.815 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_crypt_vault_verify_ssl": "true", 2024-04-19T03:01:34.815 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_curl_buffersize": "524288", 2024-04-19T03:01:34.815 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_curl_low_speed_limit": "1024", 2024-04-19T03:01:34.815 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_curl_low_speed_time": "300", 2024-04-19T03:01:34.815 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_curl_tcp_keepalive": "0", 2024-04-19T03:01:34.815 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_curl_wait_timeout_ms": "1000", 2024-04-19T03:01:34.815 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_d3n_l1_datacache_persistent_path": "/tmp/rgw_datacache/", 2024-04-19T03:01:34.815 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_d3n_l1_datacache_size": "1073741824", 2024-04-19T03:01:34.815 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_d3n_l1_evict_cache_on_start": "true", 2024-04-19T03:01:34.815 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_d3n_l1_eviction_policy": "lru", 2024-04-19T03:01:34.816 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_d3n_l1_fadvise": "4", 2024-04-19T03:01:34.816 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_d3n_l1_local_datacache_enabled": "false", 2024-04-19T03:01:34.816 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_d3n_libaio_aio_num": "64", 2024-04-19T03:01:34.816 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_d3n_libaio_aio_threads": "20", 2024-04-19T03:01:34.816 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_data": "/var/lib/ceph/radosgw/ceph-a", 2024-04-19T03:01:34.816 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_data_log_changes_size": "1000", 2024-04-19T03:01:34.816 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_data_log_num_shards": "128", 2024-04-19T03:01:34.816 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_data_log_obj_prefix": "data_log", 2024-04-19T03:01:34.816 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_data_log_window": "30", 2024-04-19T03:01:34.816 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_data_notify_interval_msec": "0", 2024-04-19T03:01:34.816 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_data_sync_poll_interval": "20", 2024-04-19T03:01:34.816 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_data_sync_spawn_window": "20", 2024-04-19T03:01:34.816 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_debug_inject_olh_cancel_modification_err": "false", 2024-04-19T03:01:34.816 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_debug_inject_set_olh_err": "0", 2024-04-19T03:01:34.817 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_default_data_log_backing": "fifo", 2024-04-19T03:01:34.817 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_default_realm_info_oid": "default.realm", 2024-04-19T03:01:34.817 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_default_region_info_oid": "default.region", 2024-04-19T03:01:34.817 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_default_zone_info_oid": "default.zone", 2024-04-19T03:01:34.817 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_default_zonegroup_info_oid": "default.zonegroup", 2024-04-19T03:01:34.817 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_defer_to_bucket_acls": "", 2024-04-19T03:01:34.817 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_delete_multi_obj_max_num": "1000", 2024-04-19T03:01:34.817 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_dmclock_admin_lim": "0.000000", 2024-04-19T03:01:34.817 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_dmclock_admin_res": "100.000000", 2024-04-19T03:01:34.817 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_dmclock_admin_wgt": "100.000000", 2024-04-19T03:01:34.817 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_dmclock_auth_lim": "0.000000", 2024-04-19T03:01:34.817 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_dmclock_auth_res": "200.000000", 2024-04-19T03:01:34.817 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_dmclock_auth_wgt": "100.000000", 2024-04-19T03:01:34.817 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_dmclock_data_lim": "0.000000", 2024-04-19T03:01:34.818 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_dmclock_data_res": "500.000000", 2024-04-19T03:01:34.818 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_dmclock_data_wgt": "500.000000", 2024-04-19T03:01:34.818 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_dmclock_metadata_lim": "0.000000", 2024-04-19T03:01:34.818 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_dmclock_metadata_res": "500.000000", 2024-04-19T03:01:34.818 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_dmclock_metadata_wgt": "500.000000", 2024-04-19T03:01:34.818 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_dns_name": "", 2024-04-19T03:01:34.818 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_dns_s3website_name": "", 2024-04-19T03:01:34.818 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_dynamic_resharding": "true", 2024-04-19T03:01:34.818 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_enable_apis": "s3, s3website, swift, swift_auth, admin, sts, iam, notifications", 2024-04-19T03:01:34.818 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_enable_gc_threads": "true", 2024-04-19T03:01:34.818 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_enable_lc_threads": "true", 2024-04-19T03:01:34.818 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_enable_ops_log": "false", 2024-04-19T03:01:34.818 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_enable_quota_threads": "true", 2024-04-19T03:01:34.819 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_enable_static_website": "false", 2024-04-19T03:01:34.819 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_enable_usage_log": "false", 2024-04-19T03:01:34.819 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_enforce_swift_acls": "true", 2024-04-19T03:01:34.819 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_exit_timeout_secs": "120", 2024-04-19T03:01:34.819 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_expose_bucket": "false", 2024-04-19T03:01:34.819 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_extended_http_attrs": "", 2024-04-19T03:01:34.819 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_filter": "none", 2024-04-19T03:01:34.819 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_frontend_defaults": "beast ssl_certificate=config://rgw/cert/$realm/$zone.crt ssl_private_key=config://rgw/cert/$realm/$zone.key", 2024-04-19T03:01:34.819 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_frontends": "beast port=7480", 2024-04-19T03:01:34.819 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_gc_max_concurrent_io": "10", 2024-04-19T03:01:34.819 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_gc_max_deferred": "50", 2024-04-19T03:01:34.819 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_gc_max_deferred_entries_size": "3072", 2024-04-19T03:01:34.819 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_gc_max_objs": "32", 2024-04-19T03:01:34.819 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_gc_max_queue_size": "134213632", 2024-04-19T03:01:34.820 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_gc_max_trim_chunk": "16", 2024-04-19T03:01:34.820 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_gc_obj_min_wait": "7200", 2024-04-19T03:01:34.820 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_gc_processor_max_time": "3600", 2024-04-19T03:01:34.820 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_gc_processor_period": "3600", 2024-04-19T03:01:34.820 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_get_obj_max_req_size": "4194304", 2024-04-19T03:01:34.820 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_get_obj_window_size": "16777216", 2024-04-19T03:01:34.820 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_healthcheck_disabling_path": "", 2024-04-19T03:01:34.820 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_ignore_get_invalid_range": "false", 2024-04-19T03:01:34.820 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_init_timeout": "300", 2024-04-19T03:01:34.820 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_inject_notify_timeout_probability": "0.000000", 2024-04-19T03:01:34.820 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_json_config": "/var/lib/ceph/radosgw/config.json", 2024-04-19T03:01:34.820 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_keystone_accepted_admin_roles": "", 2024-04-19T03:01:34.820 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_keystone_accepted_roles": "Member, admin", 2024-04-19T03:01:34.820 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_keystone_admin_domain": "", 2024-04-19T03:01:34.821 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_keystone_admin_password": "", 2024-04-19T03:01:34.821 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_keystone_admin_password_path": "", 2024-04-19T03:01:34.821 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_keystone_admin_project": "", 2024-04-19T03:01:34.821 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_keystone_admin_tenant": "", 2024-04-19T03:01:34.821 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_keystone_admin_token": "", 2024-04-19T03:01:34.821 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_keystone_admin_token_path": "", 2024-04-19T03:01:34.821 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_keystone_admin_user": "", 2024-04-19T03:01:34.821 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_keystone_api_version": "2", 2024-04-19T03:01:34.821 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_keystone_barbican_domain": "", 2024-04-19T03:01:34.821 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_keystone_barbican_password": "", 2024-04-19T03:01:34.821 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_keystone_barbican_project": "", 2024-04-19T03:01:34.821 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_keystone_barbican_tenant": "", 2024-04-19T03:01:34.821 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_keystone_barbican_user": "", 2024-04-19T03:01:34.821 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_keystone_expired_token_cache_expiration": "3600", 2024-04-19T03:01:34.821 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_keystone_implicit_tenants": "false", 2024-04-19T03:01:34.822 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_keystone_service_token_accepted_roles": "admin", 2024-04-19T03:01:34.822 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_keystone_service_token_enabled": "false", 2024-04-19T03:01:34.822 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_keystone_token_cache_size": "10000", 2024-04-19T03:01:34.822 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_keystone_url": "", 2024-04-19T03:01:34.822 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_keystone_verify_ssl": "true", 2024-04-19T03:01:34.822 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_lc_debug_interval": "-1", 2024-04-19T03:01:34.822 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_lc_lock_max_time": "90", 2024-04-19T03:01:34.822 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_lc_max_objs": "32", 2024-04-19T03:01:34.822 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_lc_max_rules": "1000", 2024-04-19T03:01:34.822 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_lc_max_worker": "3", 2024-04-19T03:01:34.822 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_lc_max_wp_worker": "3", 2024-04-19T03:01:34.822 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_lc_thread_delay": "0", 2024-04-19T03:01:34.822 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_ldap_binddn": "uid=admin,cn=users,dc=example,dc=com", 2024-04-19T03:01:34.823 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_ldap_dnattr": "uid", 2024-04-19T03:01:34.823 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_ldap_searchdn": "cn=users,cn=accounts,dc=example,dc=com", 2024-04-19T03:01:34.823 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_ldap_searchfilter": "", 2024-04-19T03:01:34.823 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_ldap_secret": "/etc/openldap/secret", 2024-04-19T03:01:34.823 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_ldap_uri": "ldaps://", 2024-04-19T03:01:34.823 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_lifecycle_work_time": "00:00-06:00", 2024-04-19T03:01:34.823 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_list_bucket_min_readahead": "1000", 2024-04-19T03:01:34.823 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_list_buckets_max_chunk": "1000", 2024-04-19T03:01:34.823 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_log_http_headers": "", 2024-04-19T03:01:34.823 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_log_nonexistent_bucket": "false", 2024-04-19T03:01:34.823 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_log_object_name": "%Y-%m-%d-%H-%i-%n", 2024-04-19T03:01:34.823 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_log_object_name_utc": "false", 2024-04-19T03:01:34.823 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_luarocks_location": "/tmp/luarocks", 2024-04-19T03:01:34.824 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_max_attr_name_len": "0", 2024-04-19T03:01:34.824 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_max_attr_size": "0", 2024-04-19T03:01:34.824 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_max_attrs_num_in_req": "0", 2024-04-19T03:01:34.824 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_max_chunk_size": "4194304", 2024-04-19T03:01:34.824 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_max_concurrent_requests": "1024", 2024-04-19T03:01:34.824 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_max_copy_obj_concurrent_io": "10", 2024-04-19T03:01:34.824 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_max_dynamic_shards": "1999", 2024-04-19T03:01:34.824 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_max_listing_results": "1000", 2024-04-19T03:01:34.824 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_max_notify_retries": "10", 2024-04-19T03:01:34.824 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_max_objs_per_shard": "100000", 2024-04-19T03:01:34.824 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_max_put_param_size": "1048576", 2024-04-19T03:01:34.824 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_max_put_size": "5368709120", 2024-04-19T03:01:34.824 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_max_slo_entries": "1000", 2024-04-19T03:01:34.824 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_md_log_max_shards": "64", 2024-04-19T03:01:34.825 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_md_notify_interval_msec": "200", 2024-04-19T03:01:34.825 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_meta_sync_poll_interval": "20", 2024-04-19T03:01:34.825 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_meta_sync_spawn_window": "20", 2024-04-19T03:01:34.825 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_mime_types_file": "/etc/mime.types", 2024-04-19T03:01:34.825 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_mp_lock_max_time": "600", 2024-04-19T03:01:34.825 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_multi_obj_del_max_aio": "16", 2024-04-19T03:01:34.825 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_multipart_min_part_size": "5242880", 2024-04-19T03:01:34.825 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_multipart_part_upload_limit": "10000", 2024-04-19T03:01:34.825 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_nfs_fhcache_partitions": "3", 2024-04-19T03:01:34.825 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_nfs_fhcache_size": "2017", 2024-04-19T03:01:34.825 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_nfs_frontends": "rgw-nfs", 2024-04-19T03:01:34.825 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_nfs_lru_lane_hiwat": "911", 2024-04-19T03:01:34.825 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_nfs_lru_lanes": "5", 2024-04-19T03:01:34.825 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_nfs_max_gc": "300", 2024-04-19T03:01:34.826 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_nfs_namespace_expire_secs": "300", 2024-04-19T03:01:34.826 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_nfs_run_gc_threads": "false", 2024-04-19T03:01:34.826 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_nfs_run_lc_threads": "false", 2024-04-19T03:01:34.826 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_nfs_run_quota_threads": "false", 2024-04-19T03:01:34.826 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_nfs_run_sync_thread": "false", 2024-04-19T03:01:34.826 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_nfs_s3_fast_attrs": "false", 2024-04-19T03:01:34.826 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_nfs_write_completion_interval_s": "10", 2024-04-19T03:01:34.826 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_num_async_rados_threads": "32", 2024-04-19T03:01:34.826 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_num_control_oids": "8", 2024-04-19T03:01:34.826 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_numa_node": "-1", 2024-04-19T03:01:34.826 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_obj_stripe_size": "4194304", 2024-04-19T03:01:34.826 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_obj_tombstone_cache_size": "1000", 2024-04-19T03:01:34.827 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_objexp_chunk_size": "100", 2024-04-19T03:01:34.827 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_objexp_gc_interval": "600", 2024-04-19T03:01:34.827 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_objexp_hints_num_shards": "127", 2024-04-19T03:01:34.827 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_olh_pending_timeout_sec": "3600", 2024-04-19T03:01:34.827 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_op_thread_suicide_timeout": "0", 2024-04-19T03:01:34.827 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_op_thread_timeout": "600", 2024-04-19T03:01:34.827 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_op_tracing": "false", 2024-04-19T03:01:34.827 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_opa_token": "", 2024-04-19T03:01:34.827 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_opa_url": "", 2024-04-19T03:01:34.827 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_opa_verify_ssl": "true", 2024-04-19T03:01:34.827 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_ops_log_data_backlog": "5242880", 2024-04-19T03:01:34.827 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_ops_log_file_path": "/var/log/ceph/ops-log-ceph-mon.a.log", 2024-04-19T03:01:34.827 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_ops_log_rados": "false", 2024-04-19T03:01:34.828 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_ops_log_socket_path": "", 2024-04-19T03:01:34.828 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_override_bucket_index_max_shards": "0", 2024-04-19T03:01:34.828 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_pending_bucket_index_op_expiration": "120", 2024-04-19T03:01:34.828 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_period_latest_epoch_info_oid": ".latest_epoch", 2024-04-19T03:01:34.828 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_period_push_interval": "2.000000", 2024-04-19T03:01:34.828 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_period_push_interval_max": "30.000000", 2024-04-19T03:01:34.828 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_period_root_pool": ".rgw.root", 2024-04-19T03:01:34.828 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_policy_reject_invalid_principals": "true", 2024-04-19T03:01:34.828 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_print_continue": "true", 2024-04-19T03:01:34.828 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_print_prohibited_content_length": "false", 2024-04-19T03:01:34.828 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_put_obj_max_window_size": "67108864", 2024-04-19T03:01:34.828 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_put_obj_min_window_size": "16777216", 2024-04-19T03:01:34.828 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_rados_pool_autoscale_bias": "4.000000", 2024-04-19T03:01:34.828 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_rados_pool_recovery_priority": "5", 2024-04-19T03:01:34.829 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_rados_tracing": "false", 2024-04-19T03:01:34.829 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_realm": "", 2024-04-19T03:01:34.829 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_realm_id": "", 2024-04-19T03:01:34.829 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_realm_root_pool": ".rgw.root", 2024-04-19T03:01:34.829 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_region": "", 2024-04-19T03:01:34.829 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_region_root_pool": ".rgw.root", 2024-04-19T03:01:34.829 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_relaxed_region_enforcement": "false", 2024-04-19T03:01:34.829 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_relaxed_s3_bucket_names": "false", 2024-04-19T03:01:34.829 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_remote_addr_param": "REMOTE_ADDR", 2024-04-19T03:01:34.829 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_request_uri": "", 2024-04-19T03:01:34.829 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_reshard_batch_size": "64", 2024-04-19T03:01:34.829 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_reshard_bucket_lock_duration": "360", 2024-04-19T03:01:34.829 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_reshard_max_aio": "128", 2024-04-19T03:01:34.829 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_reshard_num_logs": "16", 2024-04-19T03:01:34.830 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_reshard_thread_interval": "600", 2024-04-19T03:01:34.830 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_resolve_cname": "false", 2024-04-19T03:01:34.830 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_rest_getusage_op_compat": "false", 2024-04-19T03:01:34.830 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_run_sync_thread": "true", 2024-04-19T03:01:34.830 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_s3_auth_order": "sts, external, local", 2024-04-19T03:01:34.830 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_s3_auth_use_keystone": "false", 2024-04-19T03:01:34.830 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_s3_auth_use_ldap": "false", 2024-04-19T03:01:34.830 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_s3_auth_use_rados": "true", 2024-04-19T03:01:34.830 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_s3_auth_use_sts": "false", 2024-04-19T03:01:34.830 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_s3_client_max_sig_ver": "-1", 2024-04-19T03:01:34.830 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_s3_success_create_obj_status": "0", 2024-04-19T03:01:34.830 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_safe_max_objects_per_shard": "102400", 2024-04-19T03:01:34.830 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_scheduler_type": "throttler", 2024-04-19T03:01:34.831 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_script_uri": "", 2024-04-19T03:01:34.831 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_service_provider_name": "", 2024-04-19T03:01:34.831 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_shard_warning_threshold": "90.000000", 2024-04-19T03:01:34.831 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_sts_client_id": "", 2024-04-19T03:01:34.831 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_sts_client_secret": "", 2024-04-19T03:01:34.831 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_sts_entry": "sts", 2024-04-19T03:01:34.831 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_sts_key": "sts", 2024-04-19T03:01:34.831 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_sts_max_session_duration": "43200", 2024-04-19T03:01:34.831 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_sts_min_session_duration": "900", 2024-04-19T03:01:34.831 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_sts_token_introspection_url": "", 2024-04-19T03:01:34.831 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_swift_account_in_url": "false", 2024-04-19T03:01:34.831 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_swift_auth_entry": "auth", 2024-04-19T03:01:34.831 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_swift_auth_url": "", 2024-04-19T03:01:34.832 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_swift_custom_header": "", 2024-04-19T03:01:34.832 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_swift_enforce_content_length": "false", 2024-04-19T03:01:34.832 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_swift_need_stats": "true", 2024-04-19T03:01:34.832 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_swift_tenant_name": "", 2024-04-19T03:01:34.832 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_swift_token_expiration": "86400", 2024-04-19T03:01:34.832 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_swift_url": "", 2024-04-19T03:01:34.832 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_swift_url_prefix": "swift", 2024-04-19T03:01:34.832 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_swift_versioning_enabled": "false", 2024-04-19T03:01:34.832 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_sync_data_full_inject_err_probability": "0.000000", 2024-04-19T03:01:34.832 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_sync_data_inject_err_probability": "0.000000", 2024-04-19T03:01:34.832 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_sync_lease_period": "120", 2024-04-19T03:01:34.832 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_sync_log_trim_concurrent_buckets": "4", 2024-04-19T03:01:34.832 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_sync_log_trim_interval": "1200", 2024-04-19T03:01:34.832 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_sync_log_trim_max_buckets": "16", 2024-04-19T03:01:34.832 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_sync_log_trim_min_cold_buckets": "4", 2024-04-19T03:01:34.833 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_sync_meta_inject_err_probability": "0.000000", 2024-04-19T03:01:34.833 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_sync_obj_etag_verify": "false", 2024-04-19T03:01:34.833 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_sync_trace_history_size": "4096", 2024-04-19T03:01:34.833 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_sync_trace_per_node_log_size": "32", 2024-04-19T03:01:34.833 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_sync_trace_servicemap_update_interval": "10", 2024-04-19T03:01:34.833 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_thread_pool_size": "512", 2024-04-19T03:01:34.833 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_torrent_comment": "", 2024-04-19T03:01:34.833 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_torrent_createby": "", 2024-04-19T03:01:34.833 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_torrent_encoding": "", 2024-04-19T03:01:34.833 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_torrent_flag": "false", 2024-04-19T03:01:34.833 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_torrent_origin": "", 2024-04-19T03:01:34.833 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_torrent_sha_unit": "524288", 2024-04-19T03:01:34.833 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_torrent_tracker": "", 2024-04-19T03:01:34.834 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_trust_forwarded_https": "false", 2024-04-19T03:01:34.834 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_usage_log_flush_threshold": "1024", 2024-04-19T03:01:34.834 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_usage_log_tick_interval": "30", 2024-04-19T03:01:34.834 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_usage_max_shards": "32", 2024-04-19T03:01:34.834 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_usage_max_user_shards": "1", 2024-04-19T03:01:34.834 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_use_opa_authz": "false", 2024-04-19T03:01:34.834 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_user_default_quota_max_objects": "-1", 2024-04-19T03:01:34.834 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_user_default_quota_max_size": "-1", 2024-04-19T03:01:34.834 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_user_max_buckets": "1000", 2024-04-19T03:01:34.834 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_user_policies_max_num": "100", 2024-04-19T03:01:34.834 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_user_quota_bucket_sync_interval": "180", 2024-04-19T03:01:34.834 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_user_quota_sync_idle_users": "false", 2024-04-19T03:01:34.834 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_user_quota_sync_interval": "86400", 2024-04-19T03:01:34.834 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_user_quota_sync_wait_time": "86400", 2024-04-19T03:01:34.835 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_user_unique_email": "true", 2024-04-19T03:01:34.835 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_verify_ssl": "true", 2024-04-19T03:01:34.835 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_website_routing_rules_max_num": "50", 2024-04-19T03:01:34.835 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_zone": "", 2024-04-19T03:01:34.835 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_zone_id": "", 2024-04-19T03:01:34.835 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_zone_root_pool": ".rgw.root", 2024-04-19T03:01:34.835 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_zonegroup": "", 2024-04-19T03:01:34.835 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_zonegroup_id": "", 2024-04-19T03:01:34.835 INFO:teuthology.orchestra.run.smithi096.stdout: "rgw_zonegroup_root_pool": ".rgw.root", 2024-04-19T03:01:34.835 INFO:teuthology.orchestra.run.smithi096.stdout: "rgwlc_auto_session_clear": "true", 2024-04-19T03:01:34.835 INFO:teuthology.orchestra.run.smithi096.stdout: "rgwlc_skip_bucket_step": "false", 2024-04-19T03:01:34.835 INFO:teuthology.orchestra.run.smithi096.stdout: "rocksdb_block_size": "4096", 2024-04-19T03:01:34.835 INFO:teuthology.orchestra.run.smithi096.stdout: "rocksdb_bloom_bits_per_key": "20", 2024-04-19T03:01:34.836 INFO:teuthology.orchestra.run.smithi096.stdout: "rocksdb_cache_index_and_filter_blocks": "true", 2024-04-19T03:01:34.836 INFO:teuthology.orchestra.run.smithi096.stdout: "rocksdb_cache_index_and_filter_blocks_with_high_priority": "false", 2024-04-19T03:01:34.836 INFO:teuthology.orchestra.run.smithi096.stdout: "rocksdb_cache_row_ratio": "0.000000", 2024-04-19T03:01:34.836 INFO:teuthology.orchestra.run.smithi096.stdout: "rocksdb_cache_shard_bits": "4", 2024-04-19T03:01:34.836 INFO:teuthology.orchestra.run.smithi096.stdout: "rocksdb_cache_size": "536870912", 2024-04-19T03:01:34.836 INFO:teuthology.orchestra.run.smithi096.stdout: "rocksdb_cache_type": "binned_lru", 2024-04-19T03:01:34.836 INFO:teuthology.orchestra.run.smithi096.stdout: "rocksdb_cf_compact_on_deletion": "true", 2024-04-19T03:01:34.836 INFO:teuthology.orchestra.run.smithi096.stdout: "rocksdb_cf_compact_on_deletion_sliding_window": "32768", 2024-04-19T03:01:34.836 INFO:teuthology.orchestra.run.smithi096.stdout: "rocksdb_cf_compact_on_deletion_trigger": "16384", 2024-04-19T03:01:34.836 INFO:teuthology.orchestra.run.smithi096.stdout: "rocksdb_collect_compaction_stats": "false", 2024-04-19T03:01:34.836 INFO:teuthology.orchestra.run.smithi096.stdout: "rocksdb_collect_extended_stats": "false", 2024-04-19T03:01:34.836 INFO:teuthology.orchestra.run.smithi096.stdout: "rocksdb_collect_memory_stats": "false", 2024-04-19T03:01:34.836 INFO:teuthology.orchestra.run.smithi096.stdout: "rocksdb_delete_range_threshold": "1048576", 2024-04-19T03:01:34.836 INFO:teuthology.orchestra.run.smithi096.stdout: "rocksdb_index_type": "binary_search", 2024-04-19T03:01:34.837 INFO:teuthology.orchestra.run.smithi096.stdout: "rocksdb_log_to_ceph_log": "true", 2024-04-19T03:01:34.837 INFO:teuthology.orchestra.run.smithi096.stdout: "rocksdb_metadata_block_size": "4096", 2024-04-19T03:01:34.837 INFO:teuthology.orchestra.run.smithi096.stdout: "rocksdb_partition_filters": "false", 2024-04-19T03:01:34.837 INFO:teuthology.orchestra.run.smithi096.stdout: "rocksdb_perf": "false", 2024-04-19T03:01:34.837 INFO:teuthology.orchestra.run.smithi096.stdout: "rocksdb_pin_l0_filter_and_index_blocks_in_cache": "false", 2024-04-19T03:01:34.837 INFO:teuthology.orchestra.run.smithi096.stdout: "rotating_keys_bootstrap_timeout": "30", 2024-04-19T03:01:34.837 INFO:teuthology.orchestra.run.smithi096.stdout: "rotating_keys_renewal_timeout": "10", 2024-04-19T03:01:34.837 INFO:teuthology.orchestra.run.smithi096.stdout: "run_dir": "/var/run/ceph", 2024-04-19T03:01:34.837 INFO:teuthology.orchestra.run.smithi096.stdout: "seastore_block_create": "true", 2024-04-19T03:01:34.837 INFO:teuthology.orchestra.run.smithi096.stdout: "seastore_cache_lru_size": "67108864", 2024-04-19T03:01:34.837 INFO:teuthology.orchestra.run.smithi096.stdout: "seastore_cbjournal_size": "5368709120", 2024-04-19T03:01:34.837 INFO:teuthology.orchestra.run.smithi096.stdout: "seastore_default_max_object_size": "16777216", 2024-04-19T03:01:34.837 INFO:teuthology.orchestra.run.smithi096.stdout: "seastore_default_object_metadata_reservation": "16777216", 2024-04-19T03:01:34.837 INFO:teuthology.orchestra.run.smithi096.stdout: "seastore_device_size": "53687091200", 2024-04-19T03:01:34.838 INFO:teuthology.orchestra.run.smithi096.stdout: "seastore_journal_batch_capacity": "16", 2024-04-19T03:01:34.838 INFO:teuthology.orchestra.run.smithi096.stdout: "seastore_journal_batch_flush_size": "16777216", 2024-04-19T03:01:34.838 INFO:teuthology.orchestra.run.smithi096.stdout: "seastore_journal_batch_preferred_fullness": "0.950000", 2024-04-19T03:01:34.838 INFO:teuthology.orchestra.run.smithi096.stdout: "seastore_journal_iodepth_limit": "5", 2024-04-19T03:01:34.838 INFO:teuthology.orchestra.run.smithi096.stdout: "seastore_main_device_type": "SSD", 2024-04-19T03:01:34.838 INFO:teuthology.orchestra.run.smithi096.stdout: "seastore_max_concurrent_transactions": "8", 2024-04-19T03:01:34.838 INFO:teuthology.orchestra.run.smithi096.stdout: "seastore_multiple_tiers_default_evict_ratio": "0.600000", 2024-04-19T03:01:34.838 INFO:teuthology.orchestra.run.smithi096.stdout: "seastore_multiple_tiers_fast_evict_ratio": "0.700000", 2024-04-19T03:01:34.838 INFO:teuthology.orchestra.run.smithi096.stdout: "seastore_multiple_tiers_stop_evict_ratio": "0.500000", 2024-04-19T03:01:34.838 INFO:teuthology.orchestra.run.smithi096.stdout: "seastore_obj_data_write_amplification": "1.250000", 2024-04-19T03:01:34.838 INFO:teuthology.orchestra.run.smithi096.stdout: "seastore_segment_size": "67108864", 2024-04-19T03:01:34.838 INFO:teuthology.orchestra.run.smithi096.stdout: "set_keepcaps": "false", 2024-04-19T03:01:34.838 INFO:teuthology.orchestra.run.smithi096.stdout: "setgroup": "", 2024-04-19T03:01:34.838 INFO:teuthology.orchestra.run.smithi096.stdout: "setuser": "", 2024-04-19T03:01:34.839 INFO:teuthology.orchestra.run.smithi096.stdout: "setuser_match_path": "", 2024-04-19T03:01:34.839 INFO:teuthology.orchestra.run.smithi096.stdout: "target_max_misplaced_ratio": "0.050000", 2024-04-19T03:01:34.839 INFO:teuthology.orchestra.run.smithi096.stdout: "thp": "false", 2024-04-19T03:01:34.839 INFO:teuthology.orchestra.run.smithi096.stdout: "threadpool_default_timeout": "60", 2024-04-19T03:01:34.839 INFO:teuthology.orchestra.run.smithi096.stdout: "threadpool_empty_queue_max_wait": "2", 2024-04-19T03:01:34.839 INFO:teuthology.orchestra.run.smithi096.stdout: "throttler_perf_counter": "true" 2024-04-19T03:01:34.839 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-04-19T03:01:34.841 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0 2024-04-19T03:01:34.983 INFO:teuthology.orchestra.run.smithi096.stdout:mon.a: {} 2024-04-19T03:01:34.995 INFO:teuthology.orchestra.run.smithi096.stdout:mon.b: {} 2024-04-19T03:01:35.008 INFO:teuthology.orchestra.run.smithi096.stdout:mon.c: {} 2024-04-19T03:01:35.010 INFO:teuthology.orchestra.run.smithi096.stderr:mon.a: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-04-19T03:01:35.010 INFO:teuthology.orchestra.run.smithi096.stderr:mon.b: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-04-19T03:01:35.010 INFO:teuthology.orchestra.run.smithi096.stderr:mon.c: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-04-19T03:01:35.022 INFO:tasks.thrashosds.thrasher:Unable to test ceph-objectstore-tool, powercycle testing 2024-04-19T03:01:35.023 INFO:teuthology.run_tasks:Running task radosbench... 2024-04-19T03:01:35.035 INFO:tasks.radosbench:Beginning radosbench... 2024-04-19T03:01:35.035 INFO:tasks.ceph.ceph_manager.ceph:creating pool_name unique_pool_0 2024-04-19T03:01:35.035 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create unique_pool_0 16 2024-04-19T03:01:35.036 INFO:tasks.thrashosds.thrasher:starting do_thrash 2024-04-19T03:01:35.036 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-04-19T03:01:35.036 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-19T03:01:35.036 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap 2024-04-19T03:01:35.036 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-04-19T03:01:35.037 INFO:tasks.thrashosds.thrasher:starting do_sighup with a delay of 0.1 2024-04-19T03:01:35.037 INFO:tasks.thrashosds.thrasher:starting do_optrack_toggle with a delay of 2.0 2024-04-19T03:01:35.037 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-19T03:01:35.038 INFO:tasks.thrashosds.thrasher:starting do_dump_ops 2024-04-19T03:01:35.038 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T03:01:35.038 INFO:tasks.thrashosds.thrasher:starting do_noscrub_toggle with a delay of 2.0 2024-04-19T03:01:35.039 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-19T03:01:35.040 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-04-19T03:01:35.033+0000 7f35986ab700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18243) UID: 0 2024-04-19T03:01:35.139 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:01:35.136+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:01:35.155 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-04-19T03:01:35.156 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [], 2024-04-19T03:01:35.156 INFO:teuthology.orchestra.run.smithi097.stdout: "num_ops": 0 2024-04-19T03:01:35.156 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-04-19T03:01:35.167 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T03:01:35.197 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0: {} 2024-04-19T03:01:35.222 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1: {} 2024-04-19T03:01:35.239 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-04-19T03:01:35.233+0000 7f35986ab700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18243) UID: 0 2024-04-19T03:01:35.256 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2: {} 2024-04-19T03:01:35.258 INFO:teuthology.orchestra.run.smithi096.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T03:01:35.258 INFO:teuthology.orchestra.run.smithi096.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-19T03:01:35.258 INFO:teuthology.orchestra.run.smithi096.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-19T03:01:35.274 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-04-19T03:01:35.274 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:01:35.283 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T03:01:35.340 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:01:35.340+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:01:35.350 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-19T03:01:35.350 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-04-19T03:01:35.350 INFO:teuthology.orchestra.run.smithi096.stdout: "epoch": 21, 2024-04-19T03:01:35.350 INFO:teuthology.orchestra.run.smithi096.stdout: "fsid": "c6cc8e09-11d4-48de-9a6c-4d70ed3c3789", 2024-04-19T03:01:35.350 INFO:teuthology.orchestra.run.smithi096.stdout: "created": "2024-04-19T03:00:53.746146+0000", 2024-04-19T03:01:35.350 INFO:teuthology.orchestra.run.smithi096.stdout: "modified": "2024-04-19T03:01:15.992289+0000", 2024-04-19T03:01:35.350 INFO:teuthology.orchestra.run.smithi096.stdout: "last_up_change": "2024-04-19T03:01:04.501086+0000", 2024-04-19T03:01:35.350 INFO:teuthology.orchestra.run.smithi096.stdout: "last_in_change": "2024-04-19T03:00:54.640172+0000", 2024-04-19T03:01:35.350 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-04-19T03:01:35.351 INFO:teuthology.orchestra.run.smithi096.stdout: "flags_num": 5799936, 2024-04-19T03:01:35.351 INFO:teuthology.orchestra.run.smithi096.stdout: "flags_set": [ 2024-04-19T03:01:35.351 INFO:teuthology.orchestra.run.smithi096.stdout: "pglog_hardlimit", 2024-04-19T03:01:35.351 INFO:teuthology.orchestra.run.smithi096.stdout: "purged_snapdirs", 2024-04-19T03:01:35.351 INFO:teuthology.orchestra.run.smithi096.stdout: "recovery_deletes", 2024-04-19T03:01:35.351 INFO:teuthology.orchestra.run.smithi096.stdout: "sortbitwise" 2024-04-19T03:01:35.351 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-19T03:01:35.351 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_version": 5, 2024-04-19T03:01:35.351 INFO:teuthology.orchestra.run.smithi096.stdout: "full_ratio": 0.94999998807907104, 2024-04-19T03:01:35.352 INFO:teuthology.orchestra.run.smithi096.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-04-19T03:01:35.353 INFO:teuthology.orchestra.run.smithi096.stdout: "nearfull_ratio": 0.85000002384185791, 2024-04-19T03:01:35.353 INFO:teuthology.orchestra.run.smithi096.stdout: "cluster_snapshot": "", 2024-04-19T03:01:35.353 INFO:teuthology.orchestra.run.smithi096.stdout: "pool_max": 4, 2024-04-19T03:01:35.353 INFO:teuthology.orchestra.run.smithi096.stdout: "max_osd": 3, 2024-04-19T03:01:35.353 INFO:teuthology.orchestra.run.smithi096.stdout: "require_min_compat_client": "luminous", 2024-04-19T03:01:35.353 INFO:teuthology.orchestra.run.smithi096.stdout: "min_compat_client": "jewel", 2024-04-19T03:01:35.353 INFO:teuthology.orchestra.run.smithi096.stdout: "require_osd_release": "reef", 2024-04-19T03:01:35.353 INFO:teuthology.orchestra.run.smithi096.stdout: "allow_crimson": false, 2024-04-19T03:01:35.353 INFO:teuthology.orchestra.run.smithi096.stdout: "pools": [ 2024-04-19T03:01:35.353 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-19T03:01:35.353 INFO:teuthology.orchestra.run.smithi096.stdout: "pool": 1, 2024-04-19T03:01:35.353 INFO:teuthology.orchestra.run.smithi096.stdout: "pool_name": ".mgr", 2024-04-19T03:01:35.354 INFO:teuthology.orchestra.run.smithi096.stdout: "create_time": "2024-04-19T03:01:05.999591+0000", 2024-04-19T03:01:35.354 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-19T03:01:35.354 INFO:teuthology.orchestra.run.smithi096.stdout: "flags_names": "hashpspool", 2024-04-19T03:01:35.354 INFO:teuthology.orchestra.run.smithi096.stdout: "type": 1, 2024-04-19T03:01:35.354 INFO:teuthology.orchestra.run.smithi096.stdout: "size": 2, 2024-04-19T03:01:35.354 INFO:teuthology.orchestra.run.smithi096.stdout: "min_size": 1, 2024-04-19T03:01:35.354 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_rule": 0, 2024-04-19T03:01:35.354 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_count": 0, 2024-04-19T03:01:35.354 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_target": 0, 2024-04-19T03:01:35.354 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_barrier": 0, 2024-04-19T03:01:35.354 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-19T03:01:35.354 INFO:teuthology.orchestra.run.smithi096.stdout: "object_hash": 2, 2024-04-19T03:01:35.354 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_autoscale_mode": "off", 2024-04-19T03:01:35.355 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num": 1, 2024-04-19T03:01:35.355 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_placement_num": 1, 2024-04-19T03:01:35.355 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_placement_num_target": 1, 2024-04-19T03:01:35.355 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num_target": 1, 2024-04-19T03:01:35.355 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num_pending": 1, 2024-04-19T03:01:35.355 INFO:teuthology.orchestra.run.smithi096.stdout: "last_pg_merge_meta": { 2024-04-19T03:01:35.355 INFO:teuthology.orchestra.run.smithi096.stdout: "source_pgid": "0.0", 2024-04-19T03:01:35.355 INFO:teuthology.orchestra.run.smithi096.stdout: "ready_epoch": 0, 2024-04-19T03:01:35.355 INFO:teuthology.orchestra.run.smithi096.stdout: "last_epoch_started": 0, 2024-04-19T03:01:35.355 INFO:teuthology.orchestra.run.smithi096.stdout: "last_epoch_clean": 0, 2024-04-19T03:01:35.355 INFO:teuthology.orchestra.run.smithi096.stdout: "source_version": "0'0", 2024-04-19T03:01:35.355 INFO:teuthology.orchestra.run.smithi096.stdout: "target_version": "0'0" 2024-04-19T03:01:35.355 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-19T03:01:35.355 INFO:teuthology.orchestra.run.smithi096.stdout: "last_change": "14", 2024-04-19T03:01:35.356 INFO:teuthology.orchestra.run.smithi096.stdout: "last_force_op_resend": "0", 2024-04-19T03:01:35.356 INFO:teuthology.orchestra.run.smithi096.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-19T03:01:35.356 INFO:teuthology.orchestra.run.smithi096.stdout: "last_force_op_resend_preluminous": "0", 2024-04-19T03:01:35.356 INFO:teuthology.orchestra.run.smithi096.stdout: "auid": 0, 2024-04-19T03:01:35.356 INFO:teuthology.orchestra.run.smithi096.stdout: "snap_mode": "selfmanaged", 2024-04-19T03:01:35.356 INFO:teuthology.orchestra.run.smithi096.stdout: "snap_seq": 0, 2024-04-19T03:01:35.356 INFO:teuthology.orchestra.run.smithi096.stdout: "snap_epoch": 0, 2024-04-19T03:01:35.356 INFO:teuthology.orchestra.run.smithi096.stdout: "pool_snaps": [], 2024-04-19T03:01:35.356 INFO:teuthology.orchestra.run.smithi096.stdout: "removed_snaps": "[]", 2024-04-19T03:01:35.356 INFO:teuthology.orchestra.run.smithi096.stdout: "quota_max_bytes": 0, 2024-04-19T03:01:35.356 INFO:teuthology.orchestra.run.smithi096.stdout: "quota_max_objects": 0, 2024-04-19T03:01:35.357 INFO:teuthology.orchestra.run.smithi096.stdout: "tiers": [], 2024-04-19T03:01:35.357 INFO:teuthology.orchestra.run.smithi096.stdout: "tier_of": -1, 2024-04-19T03:01:35.357 INFO:teuthology.orchestra.run.smithi096.stdout: "read_tier": -1, 2024-04-19T03:01:35.357 INFO:teuthology.orchestra.run.smithi096.stdout: "write_tier": -1, 2024-04-19T03:01:35.357 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_mode": "none", 2024-04-19T03:01:35.357 INFO:teuthology.orchestra.run.smithi096.stdout: "target_max_bytes": 0, 2024-04-19T03:01:35.357 INFO:teuthology.orchestra.run.smithi096.stdout: "target_max_objects": 0, 2024-04-19T03:01:35.357 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-19T03:01:35.357 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-19T03:01:35.357 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-19T03:01:35.357 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_min_flush_age": 0, 2024-04-19T03:01:35.357 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_min_evict_age": 0, 2024-04-19T03:01:35.358 INFO:teuthology.orchestra.run.smithi096.stdout: "erasure_code_profile": "", 2024-04-19T03:01:35.358 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_params": { 2024-04-19T03:01:35.358 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "none" 2024-04-19T03:01:35.358 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-19T03:01:35.358 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_period": 0, 2024-04-19T03:01:35.358 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_count": 0, 2024-04-19T03:01:35.358 INFO:teuthology.orchestra.run.smithi096.stdout: "use_gmt_hitset": true, 2024-04-19T03:01:35.358 INFO:teuthology.orchestra.run.smithi096.stdout: "min_read_recency_for_promote": 0, 2024-04-19T03:01:35.358 INFO:teuthology.orchestra.run.smithi096.stdout: "min_write_recency_for_promote": 0, 2024-04-19T03:01:35.358 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_grade_decay_rate": 0, 2024-04-19T03:01:35.358 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_search_last_n": 0, 2024-04-19T03:01:35.358 INFO:teuthology.orchestra.run.smithi096.stdout: "grade_table": [], 2024-04-19T03:01:35.358 INFO:teuthology.orchestra.run.smithi096.stdout: "stripe_width": 0, 2024-04-19T03:01:35.359 INFO:teuthology.orchestra.run.smithi096.stdout: "expected_num_objects": 0, 2024-04-19T03:01:35.359 INFO:teuthology.orchestra.run.smithi096.stdout: "fast_read": false, 2024-04-19T03:01:35.359 INFO:teuthology.orchestra.run.smithi096.stdout: "options": { 2024-04-19T03:01:35.359 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num_max": 32, 2024-04-19T03:01:35.359 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num_min": 1 2024-04-19T03:01:35.359 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-19T03:01:35.359 INFO:teuthology.orchestra.run.smithi096.stdout: "application_metadata": { 2024-04-19T03:01:35.359 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": {} 2024-04-19T03:01:35.359 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-19T03:01:35.359 INFO:teuthology.orchestra.run.smithi096.stdout: "read_balance": { 2024-04-19T03:01:35.359 INFO:teuthology.orchestra.run.smithi096.stdout: "score_acting": 2.9900000095367432, 2024-04-19T03:01:35.359 INFO:teuthology.orchestra.run.smithi096.stdout: "score_stable": 2.9900000095367432, 2024-04-19T03:01:35.359 INFO:teuthology.orchestra.run.smithi096.stdout: "optimal_score": 0.67000001668930054, 2024-04-19T03:01:35.359 INFO:teuthology.orchestra.run.smithi096.stdout: "raw_score_acting": 2, 2024-04-19T03:01:35.359 INFO:teuthology.orchestra.run.smithi096.stdout: "raw_score_stable": 2, 2024-04-19T03:01:35.360 INFO:teuthology.orchestra.run.smithi096.stdout: "primary_affinity_weighted": 1, 2024-04-19T03:01:35.360 INFO:teuthology.orchestra.run.smithi096.stdout: "average_primary_affinity": 1, 2024-04-19T03:01:35.360 INFO:teuthology.orchestra.run.smithi096.stdout: "average_primary_affinity_weighted": 1 2024-04-19T03:01:35.360 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-19T03:01:35.360 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-19T03:01:35.360 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-19T03:01:35.360 INFO:teuthology.orchestra.run.smithi096.stdout: "pool": 2, 2024-04-19T03:01:35.360 INFO:teuthology.orchestra.run.smithi096.stdout: "pool_name": "rbd", 2024-04-19T03:01:35.360 INFO:teuthology.orchestra.run.smithi096.stdout: "create_time": "2024-04-19T03:01:09.051757+0000", 2024-04-19T03:01:35.360 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-19T03:01:35.360 INFO:teuthology.orchestra.run.smithi096.stdout: "flags_names": "hashpspool", 2024-04-19T03:01:35.360 INFO:teuthology.orchestra.run.smithi096.stdout: "type": 1, 2024-04-19T03:01:35.361 INFO:teuthology.orchestra.run.smithi096.stdout: "size": 2, 2024-04-19T03:01:35.361 INFO:teuthology.orchestra.run.smithi096.stdout: "min_size": 1, 2024-04-19T03:01:35.361 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_rule": 0, 2024-04-19T03:01:35.361 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_count": 0, 2024-04-19T03:01:35.361 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_target": 0, 2024-04-19T03:01:35.361 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_barrier": 0, 2024-04-19T03:01:35.361 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-19T03:01:35.361 INFO:teuthology.orchestra.run.smithi096.stdout: "object_hash": 2, 2024-04-19T03:01:35.361 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_autoscale_mode": "off", 2024-04-19T03:01:35.361 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num": 8, 2024-04-19T03:01:35.361 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_placement_num": 8, 2024-04-19T03:01:35.362 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_placement_num_target": 8, 2024-04-19T03:01:35.362 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num_target": 8, 2024-04-19T03:01:35.362 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num_pending": 8, 2024-04-19T03:01:35.362 INFO:teuthology.orchestra.run.smithi096.stdout: "last_pg_merge_meta": { 2024-04-19T03:01:35.362 INFO:teuthology.orchestra.run.smithi096.stdout: "source_pgid": "0.0", 2024-04-19T03:01:35.362 INFO:teuthology.orchestra.run.smithi096.stdout: "ready_epoch": 0, 2024-04-19T03:01:35.362 INFO:teuthology.orchestra.run.smithi096.stdout: "last_epoch_started": 0, 2024-04-19T03:01:35.362 INFO:teuthology.orchestra.run.smithi096.stdout: "last_epoch_clean": 0, 2024-04-19T03:01:35.362 INFO:teuthology.orchestra.run.smithi096.stdout: "source_version": "0'0", 2024-04-19T03:01:35.362 INFO:teuthology.orchestra.run.smithi096.stdout: "target_version": "0'0" 2024-04-19T03:01:35.362 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-19T03:01:35.362 INFO:teuthology.orchestra.run.smithi096.stdout: "last_change": "17", 2024-04-19T03:01:35.363 INFO:teuthology.orchestra.run.smithi096.stdout: "last_force_op_resend": "0", 2024-04-19T03:01:35.363 INFO:teuthology.orchestra.run.smithi096.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-19T03:01:35.363 INFO:teuthology.orchestra.run.smithi096.stdout: "last_force_op_resend_preluminous": "0", 2024-04-19T03:01:35.363 INFO:teuthology.orchestra.run.smithi096.stdout: "auid": 0, 2024-04-19T03:01:35.363 INFO:teuthology.orchestra.run.smithi096.stdout: "snap_mode": "selfmanaged", 2024-04-19T03:01:35.363 INFO:teuthology.orchestra.run.smithi096.stdout: "snap_seq": 0, 2024-04-19T03:01:35.363 INFO:teuthology.orchestra.run.smithi096.stdout: "snap_epoch": 0, 2024-04-19T03:01:35.363 INFO:teuthology.orchestra.run.smithi096.stdout: "pool_snaps": [], 2024-04-19T03:01:35.363 INFO:teuthology.orchestra.run.smithi096.stdout: "removed_snaps": "[]", 2024-04-19T03:01:35.363 INFO:teuthology.orchestra.run.smithi096.stdout: "quota_max_bytes": 0, 2024-04-19T03:01:35.363 INFO:teuthology.orchestra.run.smithi096.stdout: "quota_max_objects": 0, 2024-04-19T03:01:35.363 INFO:teuthology.orchestra.run.smithi096.stdout: "tiers": [], 2024-04-19T03:01:35.363 INFO:teuthology.orchestra.run.smithi096.stdout: "tier_of": -1, 2024-04-19T03:01:35.363 INFO:teuthology.orchestra.run.smithi096.stdout: "read_tier": -1, 2024-04-19T03:01:35.364 INFO:teuthology.orchestra.run.smithi096.stdout: "write_tier": -1, 2024-04-19T03:01:35.364 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_mode": "none", 2024-04-19T03:01:35.364 INFO:teuthology.orchestra.run.smithi096.stdout: "target_max_bytes": 0, 2024-04-19T03:01:35.364 INFO:teuthology.orchestra.run.smithi096.stdout: "target_max_objects": 0, 2024-04-19T03:01:35.364 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-19T03:01:35.364 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-19T03:01:35.364 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-19T03:01:35.364 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_min_flush_age": 0, 2024-04-19T03:01:35.364 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_min_evict_age": 0, 2024-04-19T03:01:35.364 INFO:teuthology.orchestra.run.smithi096.stdout: "erasure_code_profile": "", 2024-04-19T03:01:35.364 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_params": { 2024-04-19T03:01:35.364 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "none" 2024-04-19T03:01:35.364 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-19T03:01:35.365 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_period": 0, 2024-04-19T03:01:35.365 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_count": 0, 2024-04-19T03:01:35.365 INFO:teuthology.orchestra.run.smithi096.stdout: "use_gmt_hitset": true, 2024-04-19T03:01:35.365 INFO:teuthology.orchestra.run.smithi096.stdout: "min_read_recency_for_promote": 0, 2024-04-19T03:01:35.365 INFO:teuthology.orchestra.run.smithi096.stdout: "min_write_recency_for_promote": 0, 2024-04-19T03:01:35.365 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_grade_decay_rate": 0, 2024-04-19T03:01:35.365 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_search_last_n": 0, 2024-04-19T03:01:35.365 INFO:teuthology.orchestra.run.smithi096.stdout: "grade_table": [], 2024-04-19T03:01:35.365 INFO:teuthology.orchestra.run.smithi096.stdout: "stripe_width": 0, 2024-04-19T03:01:35.365 INFO:teuthology.orchestra.run.smithi096.stdout: "expected_num_objects": 0, 2024-04-19T03:01:35.365 INFO:teuthology.orchestra.run.smithi096.stdout: "fast_read": false, 2024-04-19T03:01:35.365 INFO:teuthology.orchestra.run.smithi096.stdout: "options": {}, 2024-04-19T03:01:35.366 INFO:teuthology.orchestra.run.smithi096.stdout: "application_metadata": { 2024-04-19T03:01:35.366 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd": {} 2024-04-19T03:01:35.366 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-19T03:01:35.366 INFO:teuthology.orchestra.run.smithi096.stdout: "read_balance": { 2024-04-19T03:01:35.366 INFO:teuthology.orchestra.run.smithi096.stdout: "score_acting": 1.5, 2024-04-19T03:01:35.366 INFO:teuthology.orchestra.run.smithi096.stdout: "score_stable": 1.5, 2024-04-19T03:01:35.366 INFO:teuthology.orchestra.run.smithi096.stdout: "optimal_score": 1, 2024-04-19T03:01:35.366 INFO:teuthology.orchestra.run.smithi096.stdout: "raw_score_acting": 1.5, 2024-04-19T03:01:35.366 INFO:teuthology.orchestra.run.smithi096.stdout: "raw_score_stable": 1.5, 2024-04-19T03:01:35.366 INFO:teuthology.orchestra.run.smithi096.stdout: "primary_affinity_weighted": 1, 2024-04-19T03:01:35.366 INFO:teuthology.orchestra.run.smithi096.stdout: "average_primary_affinity": 1, 2024-04-19T03:01:35.367 INFO:teuthology.orchestra.run.smithi096.stdout: "average_primary_affinity_weighted": 1 2024-04-19T03:01:35.367 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-19T03:01:35.367 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-19T03:01:35.367 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-19T03:01:35.367 INFO:teuthology.orchestra.run.smithi096.stdout: "pool": 3, 2024-04-19T03:01:35.367 INFO:teuthology.orchestra.run.smithi096.stdout: "pool_name": "cephfs_metadata", 2024-04-19T03:01:35.367 INFO:teuthology.orchestra.run.smithi096.stdout: "create_time": "2024-04-19T03:01:13.479163+0000", 2024-04-19T03:01:35.367 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-19T03:01:35.367 INFO:teuthology.orchestra.run.smithi096.stdout: "flags_names": "hashpspool", 2024-04-19T03:01:35.367 INFO:teuthology.orchestra.run.smithi096.stdout: "type": 1, 2024-04-19T03:01:35.367 INFO:teuthology.orchestra.run.smithi096.stdout: "size": 2, 2024-04-19T03:01:35.367 INFO:teuthology.orchestra.run.smithi096.stdout: "min_size": 1, 2024-04-19T03:01:35.367 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_rule": 0, 2024-04-19T03:01:35.368 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_count": 0, 2024-04-19T03:01:35.368 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_target": 0, 2024-04-19T03:01:35.368 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_barrier": 0, 2024-04-19T03:01:35.369 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-19T03:01:35.369 INFO:teuthology.orchestra.run.smithi096.stdout: "object_hash": 2, 2024-04-19T03:01:35.369 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_autoscale_mode": "off", 2024-04-19T03:01:35.369 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num": 32, 2024-04-19T03:01:35.369 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_placement_num": 32, 2024-04-19T03:01:35.369 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_placement_num_target": 32, 2024-04-19T03:01:35.369 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num_target": 32, 2024-04-19T03:01:35.369 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num_pending": 32, 2024-04-19T03:01:35.369 INFO:teuthology.orchestra.run.smithi096.stdout: "last_pg_merge_meta": { 2024-04-19T03:01:35.369 INFO:teuthology.orchestra.run.smithi096.stdout: "source_pgid": "0.0", 2024-04-19T03:01:35.369 INFO:teuthology.orchestra.run.smithi096.stdout: "ready_epoch": 0, 2024-04-19T03:01:35.369 INFO:teuthology.orchestra.run.smithi096.stdout: "last_epoch_started": 0, 2024-04-19T03:01:35.370 INFO:teuthology.orchestra.run.smithi096.stdout: "last_epoch_clean": 0, 2024-04-19T03:01:35.370 INFO:teuthology.orchestra.run.smithi096.stdout: "source_version": "0'0", 2024-04-19T03:01:35.370 INFO:teuthology.orchestra.run.smithi096.stdout: "target_version": "0'0" 2024-04-19T03:01:35.370 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-19T03:01:35.370 INFO:teuthology.orchestra.run.smithi096.stdout: "last_change": "20", 2024-04-19T03:01:35.370 INFO:teuthology.orchestra.run.smithi096.stdout: "last_force_op_resend": "0", 2024-04-19T03:01:35.370 INFO:teuthology.orchestra.run.smithi096.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-19T03:01:35.370 INFO:teuthology.orchestra.run.smithi096.stdout: "last_force_op_resend_preluminous": "0", 2024-04-19T03:01:35.370 INFO:teuthology.orchestra.run.smithi096.stdout: "auid": 0, 2024-04-19T03:01:35.370 INFO:teuthology.orchestra.run.smithi096.stdout: "snap_mode": "selfmanaged", 2024-04-19T03:01:35.371 INFO:teuthology.orchestra.run.smithi096.stdout: "snap_seq": 0, 2024-04-19T03:01:35.371 INFO:teuthology.orchestra.run.smithi096.stdout: "snap_epoch": 0, 2024-04-19T03:01:35.371 INFO:teuthology.orchestra.run.smithi096.stdout: "pool_snaps": [], 2024-04-19T03:01:35.371 INFO:teuthology.orchestra.run.smithi096.stdout: "removed_snaps": "[]", 2024-04-19T03:01:35.371 INFO:teuthology.orchestra.run.smithi096.stdout: "quota_max_bytes": 0, 2024-04-19T03:01:35.371 INFO:teuthology.orchestra.run.smithi096.stdout: "quota_max_objects": 0, 2024-04-19T03:01:35.371 INFO:teuthology.orchestra.run.smithi096.stdout: "tiers": [], 2024-04-19T03:01:35.371 INFO:teuthology.orchestra.run.smithi096.stdout: "tier_of": -1, 2024-04-19T03:01:35.371 INFO:teuthology.orchestra.run.smithi096.stdout: "read_tier": -1, 2024-04-19T03:01:35.371 INFO:teuthology.orchestra.run.smithi096.stdout: "write_tier": -1, 2024-04-19T03:01:35.371 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_mode": "none", 2024-04-19T03:01:35.371 INFO:teuthology.orchestra.run.smithi096.stdout: "target_max_bytes": 0, 2024-04-19T03:01:35.372 INFO:teuthology.orchestra.run.smithi096.stdout: "target_max_objects": 0, 2024-04-19T03:01:35.372 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-19T03:01:35.372 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-19T03:01:35.372 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-19T03:01:35.372 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_min_flush_age": 0, 2024-04-19T03:01:35.372 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_min_evict_age": 0, 2024-04-19T03:01:35.372 INFO:teuthology.orchestra.run.smithi096.stdout: "erasure_code_profile": "", 2024-04-19T03:01:35.372 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_params": { 2024-04-19T03:01:35.372 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "none" 2024-04-19T03:01:35.372 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-19T03:01:35.372 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_period": 0, 2024-04-19T03:01:35.372 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_count": 0, 2024-04-19T03:01:35.372 INFO:teuthology.orchestra.run.smithi096.stdout: "use_gmt_hitset": true, 2024-04-19T03:01:35.373 INFO:teuthology.orchestra.run.smithi096.stdout: "min_read_recency_for_promote": 0, 2024-04-19T03:01:35.373 INFO:teuthology.orchestra.run.smithi096.stdout: "min_write_recency_for_promote": 0, 2024-04-19T03:01:35.373 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_grade_decay_rate": 0, 2024-04-19T03:01:35.373 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_search_last_n": 0, 2024-04-19T03:01:35.373 INFO:teuthology.orchestra.run.smithi096.stdout: "grade_table": [], 2024-04-19T03:01:35.373 INFO:teuthology.orchestra.run.smithi096.stdout: "stripe_width": 0, 2024-04-19T03:01:35.373 INFO:teuthology.orchestra.run.smithi096.stdout: "expected_num_objects": 0, 2024-04-19T03:01:35.373 INFO:teuthology.orchestra.run.smithi096.stdout: "fast_read": false, 2024-04-19T03:01:35.373 INFO:teuthology.orchestra.run.smithi096.stdout: "options": { 2024-04-19T03:01:35.373 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_autoscale_bias": 4, 2024-04-19T03:01:35.373 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num_min": 16, 2024-04-19T03:01:35.373 INFO:teuthology.orchestra.run.smithi096.stdout: "recovery_priority": 5 2024-04-19T03:01:35.373 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-19T03:01:35.374 INFO:teuthology.orchestra.run.smithi096.stdout: "application_metadata": { 2024-04-19T03:01:35.374 INFO:teuthology.orchestra.run.smithi096.stdout: "cephfs": { 2024-04-19T03:01:35.374 INFO:teuthology.orchestra.run.smithi096.stdout: "metadata": "cephfs" 2024-04-19T03:01:35.374 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-19T03:01:35.374 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-19T03:01:35.374 INFO:teuthology.orchestra.run.smithi096.stdout: "read_balance": { 2024-04-19T03:01:35.374 INFO:teuthology.orchestra.run.smithi096.stdout: "score_acting": 1.1299999952316284, 2024-04-19T03:01:35.374 INFO:teuthology.orchestra.run.smithi096.stdout: "score_stable": 1.1299999952316284, 2024-04-19T03:01:35.374 INFO:teuthology.orchestra.run.smithi096.stdout: "optimal_score": 1, 2024-04-19T03:01:35.374 INFO:teuthology.orchestra.run.smithi096.stdout: "raw_score_acting": 1.1299999952316284, 2024-04-19T03:01:35.374 INFO:teuthology.orchestra.run.smithi096.stdout: "raw_score_stable": 1.1299999952316284, 2024-04-19T03:01:35.374 INFO:teuthology.orchestra.run.smithi096.stdout: "primary_affinity_weighted": 1, 2024-04-19T03:01:35.375 INFO:teuthology.orchestra.run.smithi096.stdout: "average_primary_affinity": 1, 2024-04-19T03:01:35.375 INFO:teuthology.orchestra.run.smithi096.stdout: "average_primary_affinity_weighted": 1 2024-04-19T03:01:35.375 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-19T03:01:35.375 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-19T03:01:35.375 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-19T03:01:35.375 INFO:teuthology.orchestra.run.smithi096.stdout: "pool": 4, 2024-04-19T03:01:35.375 INFO:teuthology.orchestra.run.smithi096.stdout: "pool_name": "cephfs_data", 2024-04-19T03:01:35.375 INFO:teuthology.orchestra.run.smithi096.stdout: "create_time": "2024-04-19T03:01:13.992441+0000", 2024-04-19T03:01:35.375 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-19T03:01:35.375 INFO:teuthology.orchestra.run.smithi096.stdout: "flags_names": "hashpspool", 2024-04-19T03:01:35.375 INFO:teuthology.orchestra.run.smithi096.stdout: "type": 1, 2024-04-19T03:01:35.375 INFO:teuthology.orchestra.run.smithi096.stdout: "size": 2, 2024-04-19T03:01:35.376 INFO:teuthology.orchestra.run.smithi096.stdout: "min_size": 1, 2024-04-19T03:01:35.376 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_rule": 0, 2024-04-19T03:01:35.376 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_count": 0, 2024-04-19T03:01:35.376 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_target": 0, 2024-04-19T03:01:35.376 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_barrier": 0, 2024-04-19T03:01:35.376 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-19T03:01:35.376 INFO:teuthology.orchestra.run.smithi096.stdout: "object_hash": 2, 2024-04-19T03:01:35.376 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_autoscale_mode": "off", 2024-04-19T03:01:35.376 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num": 64, 2024-04-19T03:01:35.376 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_placement_num": 64, 2024-04-19T03:01:35.376 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_placement_num_target": 64, 2024-04-19T03:01:35.376 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num_target": 64, 2024-04-19T03:01:35.376 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num_pending": 64, 2024-04-19T03:01:35.376 INFO:teuthology.orchestra.run.smithi096.stdout: "last_pg_merge_meta": { 2024-04-19T03:01:35.377 INFO:teuthology.orchestra.run.smithi096.stdout: "source_pgid": "0.0", 2024-04-19T03:01:35.377 INFO:teuthology.orchestra.run.smithi096.stdout: "ready_epoch": 0, 2024-04-19T03:01:35.377 INFO:teuthology.orchestra.run.smithi096.stdout: "last_epoch_started": 0, 2024-04-19T03:01:35.377 INFO:teuthology.orchestra.run.smithi096.stdout: "last_epoch_clean": 0, 2024-04-19T03:01:35.377 INFO:teuthology.orchestra.run.smithi096.stdout: "source_version": "0'0", 2024-04-19T03:01:35.377 INFO:teuthology.orchestra.run.smithi096.stdout: "target_version": "0'0" 2024-04-19T03:01:35.377 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-19T03:01:35.377 INFO:teuthology.orchestra.run.smithi096.stdout: "last_change": "21", 2024-04-19T03:01:35.377 INFO:teuthology.orchestra.run.smithi096.stdout: "last_force_op_resend": "0", 2024-04-19T03:01:35.377 INFO:teuthology.orchestra.run.smithi096.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-19T03:01:35.377 INFO:teuthology.orchestra.run.smithi096.stdout: "last_force_op_resend_preluminous": "0", 2024-04-19T03:01:35.377 INFO:teuthology.orchestra.run.smithi096.stdout: "auid": 0, 2024-04-19T03:01:35.377 INFO:teuthology.orchestra.run.smithi096.stdout: "snap_mode": "selfmanaged", 2024-04-19T03:01:35.377 INFO:teuthology.orchestra.run.smithi096.stdout: "snap_seq": 0, 2024-04-19T03:01:35.378 INFO:teuthology.orchestra.run.smithi096.stdout: "snap_epoch": 0, 2024-04-19T03:01:35.378 INFO:teuthology.orchestra.run.smithi096.stdout: "pool_snaps": [], 2024-04-19T03:01:35.378 INFO:teuthology.orchestra.run.smithi096.stdout: "removed_snaps": "[]", 2024-04-19T03:01:35.378 INFO:teuthology.orchestra.run.smithi096.stdout: "quota_max_bytes": 0, 2024-04-19T03:01:35.378 INFO:teuthology.orchestra.run.smithi096.stdout: "quota_max_objects": 0, 2024-04-19T03:01:35.378 INFO:teuthology.orchestra.run.smithi096.stdout: "tiers": [], 2024-04-19T03:01:35.378 INFO:teuthology.orchestra.run.smithi096.stdout: "tier_of": -1, 2024-04-19T03:01:35.378 INFO:teuthology.orchestra.run.smithi096.stdout: "read_tier": -1, 2024-04-19T03:01:35.378 INFO:teuthology.orchestra.run.smithi096.stdout: "write_tier": -1, 2024-04-19T03:01:35.378 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_mode": "none", 2024-04-19T03:01:35.378 INFO:teuthology.orchestra.run.smithi096.stdout: "target_max_bytes": 0, 2024-04-19T03:01:35.378 INFO:teuthology.orchestra.run.smithi096.stdout: "target_max_objects": 0, 2024-04-19T03:01:35.378 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-19T03:01:35.379 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-19T03:01:35.379 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-19T03:01:35.379 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_min_flush_age": 0, 2024-04-19T03:01:35.379 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_min_evict_age": 0, 2024-04-19T03:01:35.379 INFO:teuthology.orchestra.run.smithi096.stdout: "erasure_code_profile": "", 2024-04-19T03:01:35.379 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_params": { 2024-04-19T03:01:35.379 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "none" 2024-04-19T03:01:35.379 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-19T03:01:35.379 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_period": 0, 2024-04-19T03:01:35.379 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_count": 0, 2024-04-19T03:01:35.379 INFO:teuthology.orchestra.run.smithi096.stdout: "use_gmt_hitset": true, 2024-04-19T03:01:35.379 INFO:teuthology.orchestra.run.smithi096.stdout: "min_read_recency_for_promote": 0, 2024-04-19T03:01:35.380 INFO:teuthology.orchestra.run.smithi096.stdout: "min_write_recency_for_promote": 0, 2024-04-19T03:01:35.380 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_grade_decay_rate": 0, 2024-04-19T03:01:35.380 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_search_last_n": 0, 2024-04-19T03:01:35.380 INFO:teuthology.orchestra.run.smithi096.stdout: "grade_table": [], 2024-04-19T03:01:35.380 INFO:teuthology.orchestra.run.smithi096.stdout: "stripe_width": 0, 2024-04-19T03:01:35.380 INFO:teuthology.orchestra.run.smithi096.stdout: "expected_num_objects": 0, 2024-04-19T03:01:35.380 INFO:teuthology.orchestra.run.smithi096.stdout: "fast_read": false, 2024-04-19T03:01:35.380 INFO:teuthology.orchestra.run.smithi096.stdout: "options": { 2024-04-19T03:01:35.380 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num_min": 64, 2024-04-19T03:01:35.380 INFO:teuthology.orchestra.run.smithi096.stdout: "target_size_ratio": 0.89999997615814209 2024-04-19T03:01:35.380 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-19T03:01:35.380 INFO:teuthology.orchestra.run.smithi096.stdout: "application_metadata": { 2024-04-19T03:01:35.380 INFO:teuthology.orchestra.run.smithi096.stdout: "cephfs": { 2024-04-19T03:01:35.381 INFO:teuthology.orchestra.run.smithi096.stdout: "data": "cephfs" 2024-04-19T03:01:35.381 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-19T03:01:35.381 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-19T03:01:35.381 INFO:teuthology.orchestra.run.smithi096.stdout: "read_balance": { 2024-04-19T03:01:35.381 INFO:teuthology.orchestra.run.smithi096.stdout: "score_acting": 1.1299999952316284, 2024-04-19T03:01:35.381 INFO:teuthology.orchestra.run.smithi096.stdout: "score_stable": 1.1299999952316284, 2024-04-19T03:01:35.381 INFO:teuthology.orchestra.run.smithi096.stdout: "optimal_score": 1, 2024-04-19T03:01:35.381 INFO:teuthology.orchestra.run.smithi096.stdout: "raw_score_acting": 1.1299999952316284, 2024-04-19T03:01:35.381 INFO:teuthology.orchestra.run.smithi096.stdout: "raw_score_stable": 1.1299999952316284, 2024-04-19T03:01:35.381 INFO:teuthology.orchestra.run.smithi096.stdout: "primary_affinity_weighted": 1, 2024-04-19T03:01:35.381 INFO:teuthology.orchestra.run.smithi096.stdout: "average_primary_affinity": 1, 2024-04-19T03:01:35.381 INFO:teuthology.orchestra.run.smithi096.stdout: "average_primary_affinity_weighted": 1 2024-04-19T03:01:35.381 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-19T03:01:35.382 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-19T03:01:35.382 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-19T03:01:35.382 INFO:teuthology.orchestra.run.smithi096.stdout: "osds": [ 2024-04-19T03:01:35.382 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-19T03:01:35.382 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": 0, 2024-04-19T03:01:35.382 INFO:teuthology.orchestra.run.smithi096.stdout: "uuid": "05ecb884-2c30-44f7-aa14-90154f9bbe9a", 2024-04-19T03:01:35.382 INFO:teuthology.orchestra.run.smithi096.stdout: "up": 1, 2024-04-19T03:01:35.382 INFO:teuthology.orchestra.run.smithi096.stdout: "in": 1, 2024-04-19T03:01:35.382 INFO:teuthology.orchestra.run.smithi096.stdout: "weight": 1, 2024-04-19T03:01:35.382 INFO:teuthology.orchestra.run.smithi096.stdout: "primary_affinity": 1, 2024-04-19T03:01:35.382 INFO:teuthology.orchestra.run.smithi096.stdout: "last_clean_begin": 0, 2024-04-19T03:01:35.382 INFO:teuthology.orchestra.run.smithi096.stdout: "last_clean_end": 0, 2024-04-19T03:01:35.383 INFO:teuthology.orchestra.run.smithi096.stdout: "up_from": 9, 2024-04-19T03:01:35.383 INFO:teuthology.orchestra.run.smithi096.stdout: "up_thru": 19, 2024-04-19T03:01:35.383 INFO:teuthology.orchestra.run.smithi096.stdout: "down_at": 0, 2024-04-19T03:01:35.383 INFO:teuthology.orchestra.run.smithi096.stdout: "lost_at": 0, 2024-04-19T03:01:35.383 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addrs": { 2024-04-19T03:01:35.383 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-19T03:01:35.383 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-19T03:01:35.383 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-19T03:01:35.383 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.97:6800", 2024-04-19T03:01:35.383 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 18245 2024-04-19T03:01:35.383 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-19T03:01:35.383 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-19T03:01:35.383 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-19T03:01:35.384 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.97:6801", 2024-04-19T03:01:35.384 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 18245 2024-04-19T03:01:35.384 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-19T03:01:35.384 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-19T03:01:35.384 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-19T03:01:35.384 INFO:teuthology.orchestra.run.smithi096.stdout: "cluster_addrs": { 2024-04-19T03:01:35.384 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-19T03:01:35.384 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-19T03:01:35.384 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-19T03:01:35.384 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.97:6802", 2024-04-19T03:01:35.384 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 18245 2024-04-19T03:01:35.384 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-19T03:01:35.385 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-19T03:01:35.385 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-19T03:01:35.385 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.97:6803", 2024-04-19T03:01:35.385 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 18245 2024-04-19T03:01:35.385 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-19T03:01:35.385 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-19T03:01:35.385 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-19T03:01:35.385 INFO:teuthology.orchestra.run.smithi096.stdout: "heartbeat_back_addrs": { 2024-04-19T03:01:35.385 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-19T03:01:35.385 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-19T03:01:35.385 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-19T03:01:35.386 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.97:6806", 2024-04-19T03:01:35.386 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 18245 2024-04-19T03:01:35.386 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-19T03:01:35.386 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-19T03:01:35.386 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-19T03:01:35.386 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.97:6807", 2024-04-19T03:01:35.386 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 18245 2024-04-19T03:01:35.386 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-19T03:01:35.386 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-19T03:01:35.386 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-19T03:01:35.386 INFO:teuthology.orchestra.run.smithi096.stdout: "heartbeat_front_addrs": { 2024-04-19T03:01:35.386 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-19T03:01:35.386 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-19T03:01:35.387 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-19T03:01:35.387 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.97:6804", 2024-04-19T03:01:35.387 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 18245 2024-04-19T03:01:35.387 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-19T03:01:35.387 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-19T03:01:35.387 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-19T03:01:35.387 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.97:6805", 2024-04-19T03:01:35.387 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 18245 2024-04-19T03:01:35.387 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-19T03:01:35.387 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-19T03:01:35.387 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-19T03:01:35.387 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addr": "172.21.15.97:6801/18245", 2024-04-19T03:01:35.387 INFO:teuthology.orchestra.run.smithi096.stdout: "cluster_addr": "172.21.15.97:6803/18245", 2024-04-19T03:01:35.387 INFO:teuthology.orchestra.run.smithi096.stdout: "heartbeat_back_addr": "172.21.15.97:6807/18245", 2024-04-19T03:01:35.388 INFO:teuthology.orchestra.run.smithi096.stdout: "heartbeat_front_addr": "172.21.15.97:6805/18245", 2024-04-19T03:01:35.388 INFO:teuthology.orchestra.run.smithi096.stdout: "state": [ 2024-04-19T03:01:35.388 INFO:teuthology.orchestra.run.smithi096.stdout: "exists", 2024-04-19T03:01:35.388 INFO:teuthology.orchestra.run.smithi096.stdout: "up" 2024-04-19T03:01:35.388 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-19T03:01:35.388 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-19T03:01:35.388 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-19T03:01:35.388 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": 1, 2024-04-19T03:01:35.388 INFO:teuthology.orchestra.run.smithi096.stdout: "uuid": "efc873e0-69c3-4a57-8ee5-41f836b65f47", 2024-04-19T03:01:35.388 INFO:teuthology.orchestra.run.smithi096.stdout: "up": 1, 2024-04-19T03:01:35.388 INFO:teuthology.orchestra.run.smithi096.stdout: "in": 1, 2024-04-19T03:01:35.388 INFO:teuthology.orchestra.run.smithi096.stdout: "weight": 1, 2024-04-19T03:01:35.388 INFO:teuthology.orchestra.run.smithi096.stdout: "primary_affinity": 1, 2024-04-19T03:01:35.388 INFO:teuthology.orchestra.run.smithi096.stdout: "last_clean_begin": 0, 2024-04-19T03:01:35.389 INFO:teuthology.orchestra.run.smithi096.stdout: "last_clean_end": 0, 2024-04-19T03:01:35.389 INFO:teuthology.orchestra.run.smithi096.stdout: "up_from": 10, 2024-04-19T03:01:35.389 INFO:teuthology.orchestra.run.smithi096.stdout: "up_thru": 19, 2024-04-19T03:01:35.389 INFO:teuthology.orchestra.run.smithi096.stdout: "down_at": 0, 2024-04-19T03:01:35.389 INFO:teuthology.orchestra.run.smithi096.stdout: "lost_at": 0, 2024-04-19T03:01:35.389 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addrs": { 2024-04-19T03:01:35.389 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-19T03:01:35.389 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-19T03:01:35.389 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-19T03:01:35.389 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.134:6800", 2024-04-19T03:01:35.389 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 18145 2024-04-19T03:01:35.389 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-19T03:01:35.389 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-19T03:01:35.389 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-19T03:01:35.390 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.134:6801", 2024-04-19T03:01:35.390 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 18145 2024-04-19T03:01:35.390 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-19T03:01:35.390 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-19T03:01:35.390 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-19T03:01:35.390 INFO:teuthology.orchestra.run.smithi096.stdout: "cluster_addrs": { 2024-04-19T03:01:35.390 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-19T03:01:35.390 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-19T03:01:35.390 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-19T03:01:35.390 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.134:6802", 2024-04-19T03:01:35.390 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 18145 2024-04-19T03:01:35.391 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-19T03:01:35.391 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-19T03:01:35.391 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-19T03:01:35.391 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.134:6803", 2024-04-19T03:01:35.391 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 18145 2024-04-19T03:01:35.391 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-19T03:01:35.391 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-19T03:01:35.391 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-19T03:01:35.391 INFO:teuthology.orchestra.run.smithi096.stdout: "heartbeat_back_addrs": { 2024-04-19T03:01:35.391 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-19T03:01:35.391 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-19T03:01:35.391 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-19T03:01:35.392 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.134:6806", 2024-04-19T03:01:35.392 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 18145 2024-04-19T03:01:35.392 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-19T03:01:35.392 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-19T03:01:35.392 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-19T03:01:35.392 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.134:6807", 2024-04-19T03:01:35.392 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 18145 2024-04-19T03:01:35.392 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-19T03:01:35.392 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-19T03:01:35.392 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-19T03:01:35.392 INFO:teuthology.orchestra.run.smithi096.stdout: "heartbeat_front_addrs": { 2024-04-19T03:01:35.392 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-19T03:01:35.392 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-19T03:01:35.393 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-19T03:01:35.393 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.134:6804", 2024-04-19T03:01:35.393 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 18145 2024-04-19T03:01:35.393 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-19T03:01:35.393 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-19T03:01:35.393 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-19T03:01:35.393 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.134:6805", 2024-04-19T03:01:35.393 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 18145 2024-04-19T03:01:35.393 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-19T03:01:35.393 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-19T03:01:35.393 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-19T03:01:35.393 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addr": "172.21.15.134:6801/18145", 2024-04-19T03:01:35.393 INFO:teuthology.orchestra.run.smithi096.stdout: "cluster_addr": "172.21.15.134:6803/18145", 2024-04-19T03:01:35.394 INFO:teuthology.orchestra.run.smithi096.stdout: "heartbeat_back_addr": "172.21.15.134:6807/18145", 2024-04-19T03:01:35.394 INFO:teuthology.orchestra.run.smithi096.stdout: "heartbeat_front_addr": "172.21.15.134:6805/18145", 2024-04-19T03:01:35.394 INFO:teuthology.orchestra.run.smithi096.stdout: "state": [ 2024-04-19T03:01:35.394 INFO:teuthology.orchestra.run.smithi096.stdout: "exists", 2024-04-19T03:01:35.394 INFO:teuthology.orchestra.run.smithi096.stdout: "up" 2024-04-19T03:01:35.394 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-19T03:01:35.394 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-19T03:01:35.394 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-19T03:01:35.394 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": 2, 2024-04-19T03:01:35.394 INFO:teuthology.orchestra.run.smithi096.stdout: "uuid": "229278a0-dd93-4234-9065-e4f2f6188ef2", 2024-04-19T03:01:35.394 INFO:teuthology.orchestra.run.smithi096.stdout: "up": 1, 2024-04-19T03:01:35.394 INFO:teuthology.orchestra.run.smithi096.stdout: "in": 1, 2024-04-19T03:01:35.394 INFO:teuthology.orchestra.run.smithi096.stdout: "weight": 1, 2024-04-19T03:01:35.394 INFO:teuthology.orchestra.run.smithi096.stdout: "primary_affinity": 1, 2024-04-19T03:01:35.395 INFO:teuthology.orchestra.run.smithi096.stdout: "last_clean_begin": 0, 2024-04-19T03:01:35.395 INFO:teuthology.orchestra.run.smithi096.stdout: "last_clean_end": 0, 2024-04-19T03:01:35.395 INFO:teuthology.orchestra.run.smithi096.stdout: "up_from": 10, 2024-04-19T03:01:35.395 INFO:teuthology.orchestra.run.smithi096.stdout: "up_thru": 19, 2024-04-19T03:01:35.395 INFO:teuthology.orchestra.run.smithi096.stdout: "down_at": 0, 2024-04-19T03:01:35.395 INFO:teuthology.orchestra.run.smithi096.stdout: "lost_at": 0, 2024-04-19T03:01:35.395 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addrs": { 2024-04-19T03:01:35.395 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-19T03:01:35.395 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-19T03:01:35.395 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-19T03:01:35.395 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.144:6800", 2024-04-19T03:01:35.395 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 18223 2024-04-19T03:01:35.395 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-19T03:01:35.396 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-19T03:01:35.396 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-19T03:01:35.396 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.144:6801", 2024-04-19T03:01:35.396 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 18223 2024-04-19T03:01:35.396 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-19T03:01:35.396 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-19T03:01:35.396 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-19T03:01:35.396 INFO:teuthology.orchestra.run.smithi096.stdout: "cluster_addrs": { 2024-04-19T03:01:35.396 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-19T03:01:35.396 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-19T03:01:35.396 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-19T03:01:35.396 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.144:6802", 2024-04-19T03:01:35.396 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 18223 2024-04-19T03:01:35.396 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-19T03:01:35.397 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-19T03:01:35.397 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-19T03:01:35.397 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.144:6803", 2024-04-19T03:01:35.397 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 18223 2024-04-19T03:01:35.397 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-19T03:01:35.397 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-19T03:01:35.397 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-19T03:01:35.397 INFO:teuthology.orchestra.run.smithi096.stdout: "heartbeat_back_addrs": { 2024-04-19T03:01:35.397 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-19T03:01:35.397 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-19T03:01:35.397 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-19T03:01:35.397 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.144:6806", 2024-04-19T03:01:35.397 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 18223 2024-04-19T03:01:35.397 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-19T03:01:35.398 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-19T03:01:35.398 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-19T03:01:35.398 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.144:6807", 2024-04-19T03:01:35.398 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 18223 2024-04-19T03:01:35.398 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-19T03:01:35.398 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-19T03:01:35.398 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-19T03:01:35.398 INFO:teuthology.orchestra.run.smithi096.stdout: "heartbeat_front_addrs": { 2024-04-19T03:01:35.398 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-19T03:01:35.398 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-19T03:01:35.398 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-19T03:01:35.398 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.144:6804", 2024-04-19T03:01:35.398 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 18223 2024-04-19T03:01:35.399 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-19T03:01:35.399 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-19T03:01:35.399 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-19T03:01:35.399 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.144:6805", 2024-04-19T03:01:35.399 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 18223 2024-04-19T03:01:35.399 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-19T03:01:35.399 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-19T03:01:35.399 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-19T03:01:35.399 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addr": "172.21.15.144:6801/18223", 2024-04-19T03:01:35.399 INFO:teuthology.orchestra.run.smithi096.stdout: "cluster_addr": "172.21.15.144:6803/18223", 2024-04-19T03:01:35.399 INFO:teuthology.orchestra.run.smithi096.stdout: "heartbeat_back_addr": "172.21.15.144:6807/18223", 2024-04-19T03:01:35.399 INFO:teuthology.orchestra.run.smithi096.stdout: "heartbeat_front_addr": "172.21.15.144:6805/18223", 2024-04-19T03:01:35.400 INFO:teuthology.orchestra.run.smithi096.stdout: "state": [ 2024-04-19T03:01:35.400 INFO:teuthology.orchestra.run.smithi096.stdout: "exists", 2024-04-19T03:01:35.400 INFO:teuthology.orchestra.run.smithi096.stdout: "up" 2024-04-19T03:01:35.400 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-19T03:01:35.400 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-19T03:01:35.400 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-19T03:01:35.400 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_xinfo": [ 2024-04-19T03:01:35.400 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-19T03:01:35.400 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": 0, 2024-04-19T03:01:35.400 INFO:teuthology.orchestra.run.smithi096.stdout: "down_stamp": "0.000000", 2024-04-19T03:01:35.400 INFO:teuthology.orchestra.run.smithi096.stdout: "laggy_probability": 0, 2024-04-19T03:01:35.400 INFO:teuthology.orchestra.run.smithi096.stdout: "laggy_interval": 0, 2024-04-19T03:01:35.400 INFO:teuthology.orchestra.run.smithi096.stdout: "features": 4540138322906710015, 2024-04-19T03:01:35.400 INFO:teuthology.orchestra.run.smithi096.stdout: "old_weight": 0, 2024-04-19T03:01:35.401 INFO:teuthology.orchestra.run.smithi096.stdout: "last_purged_snaps_scrub": "2024-04-19T03:00:59.302574+0000", 2024-04-19T03:01:35.401 INFO:teuthology.orchestra.run.smithi096.stdout: "dead_epoch": 0 2024-04-19T03:01:35.401 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-19T03:01:35.401 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-19T03:01:35.401 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": 1, 2024-04-19T03:01:35.401 INFO:teuthology.orchestra.run.smithi096.stdout: "down_stamp": "0.000000", 2024-04-19T03:01:35.401 INFO:teuthology.orchestra.run.smithi096.stdout: "laggy_probability": 0, 2024-04-19T03:01:35.401 INFO:teuthology.orchestra.run.smithi096.stdout: "laggy_interval": 0, 2024-04-19T03:01:35.401 INFO:teuthology.orchestra.run.smithi096.stdout: "features": 4540138322906710015, 2024-04-19T03:01:35.401 INFO:teuthology.orchestra.run.smithi096.stdout: "old_weight": 0, 2024-04-19T03:01:35.401 INFO:teuthology.orchestra.run.smithi096.stdout: "last_purged_snaps_scrub": "2024-04-19T03:01:00.064174+0000", 2024-04-19T03:01:35.401 INFO:teuthology.orchestra.run.smithi096.stdout: "dead_epoch": 0 2024-04-19T03:01:35.401 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-19T03:01:35.402 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-19T03:01:35.402 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": 2, 2024-04-19T03:01:35.402 INFO:teuthology.orchestra.run.smithi096.stdout: "down_stamp": "0.000000", 2024-04-19T03:01:35.402 INFO:teuthology.orchestra.run.smithi096.stdout: "laggy_probability": 0, 2024-04-19T03:01:35.402 INFO:teuthology.orchestra.run.smithi096.stdout: "laggy_interval": 0, 2024-04-19T03:01:35.402 INFO:teuthology.orchestra.run.smithi096.stdout: "features": 4540138322906710015, 2024-04-19T03:01:35.402 INFO:teuthology.orchestra.run.smithi096.stdout: "old_weight": 0, 2024-04-19T03:01:35.402 INFO:teuthology.orchestra.run.smithi096.stdout: "last_purged_snaps_scrub": "2024-04-19T03:00:59.735582+0000", 2024-04-19T03:01:35.402 INFO:teuthology.orchestra.run.smithi096.stdout: "dead_epoch": 0 2024-04-19T03:01:35.402 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-19T03:01:35.402 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-19T03:01:35.402 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_upmap": [], 2024-04-19T03:01:35.402 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_upmap_items": [], 2024-04-19T03:01:35.403 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_upmap_primaries": [], 2024-04-19T03:01:35.403 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_temp": [], 2024-04-19T03:01:35.403 INFO:teuthology.orchestra.run.smithi096.stdout: "primary_temp": [], 2024-04-19T03:01:35.403 INFO:teuthology.orchestra.run.smithi096.stdout: "blocklist": {}, 2024-04-19T03:01:35.403 INFO:teuthology.orchestra.run.smithi096.stdout: "range_blocklist": {}, 2024-04-19T03:01:35.403 INFO:teuthology.orchestra.run.smithi096.stdout: "erasure_code_profiles": { 2024-04-19T03:01:35.403 INFO:teuthology.orchestra.run.smithi096.stdout: "default": { 2024-04-19T03:01:35.403 INFO:teuthology.orchestra.run.smithi096.stdout: "crush-failure-domain": "osd", 2024-04-19T03:01:35.403 INFO:teuthology.orchestra.run.smithi096.stdout: "k": "2", 2024-04-19T03:01:35.403 INFO:teuthology.orchestra.run.smithi096.stdout: "m": "1", 2024-04-19T03:01:35.403 INFO:teuthology.orchestra.run.smithi096.stdout: "plugin": "jerasure", 2024-04-19T03:01:35.403 INFO:teuthology.orchestra.run.smithi096.stdout: "technique": "reed_sol_van" 2024-04-19T03:01:35.404 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-19T03:01:35.404 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-19T03:01:35.404 INFO:teuthology.orchestra.run.smithi096.stdout: "removed_snaps_queue": [], 2024-04-19T03:01:35.404 INFO:teuthology.orchestra.run.smithi096.stdout: "new_removed_snaps": [], 2024-04-19T03:01:35.404 INFO:teuthology.orchestra.run.smithi096.stdout: "new_purged_snaps": [], 2024-04-19T03:01:35.404 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_node_flags": {}, 2024-04-19T03:01:35.404 INFO:teuthology.orchestra.run.smithi096.stdout: "device_class_flags": {}, 2024-04-19T03:01:35.404 INFO:teuthology.orchestra.run.smithi096.stdout: "stretch_mode": { 2024-04-19T03:01:35.404 INFO:teuthology.orchestra.run.smithi096.stdout: "stretch_mode_enabled": false, 2024-04-19T03:01:35.404 INFO:teuthology.orchestra.run.smithi096.stdout: "stretch_bucket_count": 0, 2024-04-19T03:01:35.404 INFO:teuthology.orchestra.run.smithi096.stdout: "degraded_stretch_mode": 0, 2024-04-19T03:01:35.404 INFO:teuthology.orchestra.run.smithi096.stdout: "recovering_stretch_mode": 0, 2024-04-19T03:01:35.404 INFO:teuthology.orchestra.run.smithi096.stdout: "stretch_mode_bucket": 0 2024-04-19T03:01:35.404 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-19T03:01:35.405 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-04-19T03:01:35.406 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-04-19T03:01:35.406 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:01:35.407 INFO:tasks.thrashosds.thrasher:j is {'epoch': 21, 'fsid': 'c6cc8e09-11d4-48de-9a6c-4d70ed3c3789', 'created': '2024-04-19T03:00:53.746146+0000', 'modified': '2024-04-19T03:01:15.992289+0000', 'last_up_change': '2024-04-19T03:01:04.501086+0000', 'last_in_change': '2024-04-19T03:00:54.640172+0000', 'flags': 'sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5799936, 'flags_set': ['pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 5, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 4, 'max_osd': 3, 'require_min_compat_client': 'luminous', 'min_compat_client': 'jewel', 'require_osd_release': 'reef', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-19T03:01:05.999591+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '14', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-19T03:01:09.051757+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-19T03:01:13.479163+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-04-19T03:01:13.992441+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}], 'osds': [{'osd': 0, 'uuid': '05ecb884-2c30-44f7-aa14-90154f9bbe9a', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 9, 'up_thru': 19, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.97:6800', 'nonce': 18245}, {'type': 'v1', 'addr': '172.21.15.97:6801', 'nonce': 18245}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.97:6802', 'nonce': 18245}, {'type': 'v1', 'addr': '172.21.15.97:6803', 'nonce': 18245}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.97:6806', 'nonce': 18245}, {'type': 'v1', 'addr': '172.21.15.97:6807', 'nonce': 18245}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.97:6804', 'nonce': 18245}, {'type': 'v1', 'addr': '172.21.15.97:6805', 'nonce': 18245}]}, 'public_addr': '172.21.15.97:6801/18245', 'cluster_addr': '172.21.15.97:6803/18245', 'heartbeat_back_addr': '172.21.15.97:6807/18245', 'heartbeat_front_addr': '172.21.15.97:6805/18245', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': 'efc873e0-69c3-4a57-8ee5-41f836b65f47', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 10, 'up_thru': 19, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6800', 'nonce': 18145}, {'type': 'v1', 'addr': '172.21.15.134:6801', 'nonce': 18145}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6802', 'nonce': 18145}, {'type': 'v1', 'addr': '172.21.15.134:6803', 'nonce': 18145}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6806', 'nonce': 18145}, {'type': 'v1', 'addr': '172.21.15.134:6807', 'nonce': 18145}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6804', 'nonce': 18145}, {'type': 'v1', 'addr': '172.21.15.134:6805', 'nonce': 18145}]}, 'public_addr': '172.21.15.134:6801/18145', 'cluster_addr': '172.21.15.134:6803/18145', 'heartbeat_back_addr': '172.21.15.134:6807/18145', 'heartbeat_front_addr': '172.21.15.134:6805/18145', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '229278a0-dd93-4234-9065-e4f2f6188ef2', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 10, 'up_thru': 19, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.144:6800', 'nonce': 18223}, {'type': 'v1', 'addr': '172.21.15.144:6801', 'nonce': 18223}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.144:6802', 'nonce': 18223}, {'type': 'v1', 'addr': '172.21.15.144:6803', 'nonce': 18223}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.144:6806', 'nonce': 18223}, {'type': 'v1', 'addr': '172.21.15.144:6807', 'nonce': 18223}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.144:6804', 'nonce': 18223}, {'type': 'v1', 'addr': '172.21.15.144:6805', 'nonce': 18223}]}, 'public_addr': '172.21.15.144:6801/18223', 'cluster_addr': '172.21.15.144:6803/18223', 'heartbeat_back_addr': '172.21.15.144:6807/18223', 'heartbeat_front_addr': '172.21.15.144:6805/18223', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-19T03:00:59.302574+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-19T03:01:00.064174+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-19T03:00:59.735582+0000', 'dead_epoch': 0}], 'pg_upmap': [], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-04-19T03:01:35.407 INFO:tasks.thrashosds.thrasher:No pg_upmap entries; doing nothing 2024-04-19T03:01:35.408 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T03:01:35.441 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:01:35.437+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:01:35.523 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-19T03:01:35.523 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:01:35.533 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T03:01:35.541 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:01:35.540+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:01:35.641 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-19T03:01:35.641 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:01:35.642 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-04-19T03:01:35.637+0000 7f35986ab700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18243) UID: 0 2024-04-19T03:01:35.650 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T03:01:35.740 INFO:teuthology.orchestra.run.smithi096.stderr:pool 'unique_pool_0' created 2024-04-19T03:01:35.740 INFO:teuthology.orchestra.run.smithi096.stderr:noscrub is set 2024-04-19T03:01:35.745 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:01:35.740+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:01:35.753 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool application enable unique_pool_0 rados --yes-i-really-mean-it || true 2024-04-19T03:01:35.756 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-19T03:01:35.756 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:01:35.766 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T03:01:35.844 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:01:35.841+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:01:35.881 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-04-19T03:01:35.881 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:01:35.892 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T03:01:35.945 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:01:35.941+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:01:36.001 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-04-19T03:01:36.001 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:01:36.011 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T03:01:36.046 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-04-19T03:01:36.041+0000 7f35986ab700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18243) UID: 0 2024-04-19T03:01:36.119 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-04-19T03:01:36.119 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:01:36.129 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T03:01:36.176 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-04-19T03:01:36.173+0000 7f35986ab700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18243) UID: 0 2024-04-19T03:01:36.246 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-04-19T03:01:36.246 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:01:36.247 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:01:36.244+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:01:36.256 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T03:01:36.348 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:01:36.345+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:01:36.359 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-04-19T03:01:36.359 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:01:36.369 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T03:01:36.450 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:01:36.445+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:01:36.471 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-04-19T03:01:36.471 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:01:36.483 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T03:01:36.550 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-04-19T03:01:36.545+0000 7f35986ab700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18243) UID: 0 2024-04-19T03:01:36.597 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-19T03:01:36.597 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:01:36.607 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T03:01:36.652 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-04-19T03:01:36.649+0000 7f35986ab700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18243) UID: 0 2024-04-19T03:01:36.710 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-19T03:01:36.710 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:01:36.720 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T03:01:36.748 INFO:teuthology.orchestra.run.smithi096.stderr:enabled application 'rados' on pool 'unique_pool_0' 2024-04-19T03:01:36.752 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:01:36.752+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:01:36.825 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-19T03:01:36.825 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:01:36.834 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T03:01:36.879 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:01:36.877+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:01:36.943 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-04-19T03:01:36.943 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:01:36.953 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T03:01:36.954 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:01:36.949+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:01:37.055 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:01:37.052+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:01:37.057 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-04-19T03:01:37.057 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:01:37.068 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T03:01:37.156 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-04-19T03:01:37.153+0000 7f35986ab700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18243) UID: 0 2024-04-19T03:01:37.174 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-04-19T03:01:37.174 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:01:37.184 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T03:01:37.257 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-04-19T03:01:37.253+0000 7f35986ab700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18243) UID: 0 2024-04-19T03:01:37.273 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-19T03:01:37.301 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-04-19T03:01:37.301 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:01:37.311 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T03:01:37.357 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:01:37.353+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:01:37.418 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-04-19T03:01:37.418 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:01:37.426 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0: {} 2024-04-19T03:01:37.431 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T03:01:37.449 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1: {} 2024-04-19T03:01:37.471 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2: {} 2024-04-19T03:01:37.473 INFO:teuthology.orchestra.run.smithi096.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T03:01:37.473 INFO:teuthology.orchestra.run.smithi096.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-19T03:01:37.473 INFO:teuthology.orchestra.run.smithi096.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-19T03:01:37.476 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-04-19T03:01:37.473+0000 7f35986ab700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18243) UID: 0 2024-04-19T03:01:37.538 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-04-19T03:01:37.538 INFO:teuthology.orchestra.run.smithi097.stdout: "size": 20, 2024-04-19T03:01:37.538 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 600, 2024-04-19T03:01:37.538 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [ 2024-04-19T03:01:37.538 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.538 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:01:37.538 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:14.996966+0000", 2024-04-19T03:01:37.538 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 22.535241542000001, 2024-04-19T03:01:37.538 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.018946704000000002, 2024-04-19T03:01:37.539 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:01:37.539 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:37.539 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:01:37.539 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.539 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:01:37.539 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.996966+0000", 2024-04-19T03:01:37.539 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:37.539 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:37.539 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.539 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:01:37.539 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.996966+0000", 2024-04-19T03:01:37.539 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:37.539 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:37.539 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.540 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:01:37.540 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.996964+0000", 2024-04-19T03:01:37.540 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999971 2024-04-19T03:01:37.540 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:37.540 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.540 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:01:37.540 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.996982+0000", 2024-04-19T03:01:37.540 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.8306999999999999e-05 2024-04-19T03:01:37.540 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:37.540 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.540 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:01:37.540 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997027+0000", 2024-04-19T03:01:37.540 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.5274000000000001e-05 2024-04-19T03:01:37.540 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:37.541 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.541 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:01:37.541 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997047+0000", 2024-04-19T03:01:37.541 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.9726999999999999e-05 2024-04-19T03:01:37.541 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:37.541 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.541 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:37.541 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997203+0000", 2024-04-19T03:01:37.541 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000155847 2024-04-19T03:01:37.541 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:37.541 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.541 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op must wait for map", 2024-04-19T03:01:37.541 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997249+0000", 2024-04-19T03:01:37.541 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.5824e-05 2024-04-19T03:01:37.542 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:37.542 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.542 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:37.542 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.007264+0000", 2024-04-19T03:01:37.542 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.010015909 2024-04-19T03:01:37.542 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:37.542 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.542 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:01:37.542 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.007394+0000", 2024-04-19T03:01:37.542 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012931999999999999 2024-04-19T03:01:37.542 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:37.542 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.543 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-04-19T03:01:37.543 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.007537+0000", 2024-04-19T03:01:37.543 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014365 2024-04-19T03:01:37.543 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:37.543 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.543 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:01:37.543 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.012444+0000", 2024-04-19T03:01:37.543 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0049067260000000001 2024-04-19T03:01:37.543 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:37.543 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.543 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:37.543 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.015791+0000", 2024-04-19T03:01:37.543 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0033471109999999998 2024-04-19T03:01:37.544 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:37.544 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.544 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:01:37.544 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.015845+0000", 2024-04-19T03:01:37.544 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.4236e-05 2024-04-19T03:01:37.544 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:37.544 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.544 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:01:37.544 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.015913+0000", 2024-04-19T03:01:37.544 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.7397000000000005e-05 2024-04-19T03:01:37.544 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:37.544 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:37.544 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:37.544 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:37.545 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.545 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(mds.0.3:14 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:01:37.545 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:14.997079+0000", 2024-04-19T03:01:37.545 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 22.535128958000001, 2024-04-19T03:01:37.545 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.021951970000000001, 2024-04-19T03:01:37.545 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:01:37.545 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:37.545 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:01:37.545 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.545 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:01:37.545 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997079+0000", 2024-04-19T03:01:37.545 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:37.545 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:37.545 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.546 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:01:37.546 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997079+0000", 2024-04-19T03:01:37.546 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:37.546 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:37.546 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.546 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:01:37.546 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997077+0000", 2024-04-19T03:01:37.546 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999986 2024-04-19T03:01:37.546 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:37.546 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.546 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:01:37.546 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997087+0000", 2024-04-19T03:01:37.546 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.006e-05 2024-04-19T03:01:37.547 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:37.547 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.547 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:01:37.547 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997105+0000", 2024-04-19T03:01:37.547 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.8026999999999999e-05 2024-04-19T03:01:37.547 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:37.547 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.547 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:01:37.547 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997135+0000", 2024-04-19T03:01:37.547 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.9643000000000001e-05 2024-04-19T03:01:37.547 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:37.547 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.547 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:37.547 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997208+0000", 2024-04-19T03:01:37.548 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.3419999999999998e-05 2024-04-19T03:01:37.548 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:37.548 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.548 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op must wait for map", 2024-04-19T03:01:37.548 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997244+0000", 2024-04-19T03:01:37.548 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.5367000000000002e-05 2024-04-19T03:01:37.548 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:37.548 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.548 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:37.548 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.007357+0000", 2024-04-19T03:01:37.548 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.010112703000000001 2024-04-19T03:01:37.548 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:37.548 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.549 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:01:37.549 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.007479+0000", 2024-04-19T03:01:37.549 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012279599999999999 2024-04-19T03:01:37.549 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:37.549 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.549 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 1", 2024-04-19T03:01:37.549 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.007610+0000", 2024-04-19T03:01:37.549 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00013093499999999999 2024-04-19T03:01:37.549 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:37.549 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.549 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:01:37.549 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.012526+0000", 2024-04-19T03:01:37.549 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0049157519999999998 2024-04-19T03:01:37.549 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:37.549 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.550 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:37.550 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.018959+0000", 2024-04-19T03:01:37.550 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0064326009999999996 2024-04-19T03:01:37.550 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:37.550 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.550 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:01:37.550 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.019005+0000", 2024-04-19T03:01:37.550 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.6066999999999998e-05 2024-04-19T03:01:37.550 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:37.550 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.550 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:01:37.550 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.019031+0000", 2024-04-19T03:01:37.550 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.6009000000000001e-05 2024-04-19T03:01:37.550 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:37.551 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:37.551 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:37.551 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:37.551 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.551 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:01:37.551 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:14.997149+0000", 2024-04-19T03:01:37.551 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 22.535058337999999, 2024-04-19T03:01:37.551 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.021805590999999999, 2024-04-19T03:01:37.551 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:01:37.551 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:37.551 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:01:37.551 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.551 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:01:37.551 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997149+0000", 2024-04-19T03:01:37.552 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:37.552 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:37.552 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.552 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:01:37.552 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997149+0000", 2024-04-19T03:01:37.552 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:37.552 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:37.552 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.552 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:01:37.552 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997148+0000", 2024-04-19T03:01:37.552 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2024-04-19T03:01:37.552 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:37.553 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.553 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:01:37.553 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997166+0000", 2024-04-19T03:01:37.553 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.8233e-05 2024-04-19T03:01:37.553 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:37.553 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.553 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:01:37.553 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997182+0000", 2024-04-19T03:01:37.553 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5999999999999999e-05 2024-04-19T03:01:37.553 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:37.553 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.554 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:01:37.554 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997195+0000", 2024-04-19T03:01:37.554 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.252e-05 2024-04-19T03:01:37.554 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:37.554 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.554 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:37.554 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997348+0000", 2024-04-19T03:01:37.554 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000153115 2024-04-19T03:01:37.554 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:37.554 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.554 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:01:37.554 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997354+0000", 2024-04-19T03:01:37.554 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.9359999999999996e-06 2024-04-19T03:01:37.555 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:37.555 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.555 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:37.555 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.008147+0000", 2024-04-19T03:01:37.555 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.010793127 2024-04-19T03:01:37.555 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:37.555 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.555 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:01:37.555 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.008225+0000", 2024-04-19T03:01:37.555 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.7935999999999994e-05 2024-04-19T03:01:37.555 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:37.555 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.555 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-04-19T03:01:37.555 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.008377+0000", 2024-04-19T03:01:37.556 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00015159099999999999 2024-04-19T03:01:37.556 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:37.556 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.556 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:01:37.556 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.012629+0000", 2024-04-19T03:01:37.556 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0042520420000000001 2024-04-19T03:01:37.556 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:37.556 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.556 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:37.556 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.018871+0000", 2024-04-19T03:01:37.556 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0062425060000000001 2024-04-19T03:01:37.556 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:37.556 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.556 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:01:37.556 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.018910+0000", 2024-04-19T03:01:37.557 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.8482999999999997e-05 2024-04-19T03:01:37.557 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:37.557 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.557 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:01:37.557 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.018955+0000", 2024-04-19T03:01:37.557 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.5252e-05 2024-04-19T03:01:37.557 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:37.557 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:37.557 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:37.557 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:37.557 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.557 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(mds.0.3:36 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:01:37.557 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:14.997207+0000", 2024-04-19T03:01:37.557 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 22.535000788000001, 2024-04-19T03:01:37.558 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.022210431999999999, 2024-04-19T03:01:37.558 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:01:37.558 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:37.558 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:01:37.558 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.558 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:01:37.558 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997207+0000", 2024-04-19T03:01:37.558 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:37.558 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:37.558 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.558 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:01:37.558 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997207+0000", 2024-04-19T03:01:37.558 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:37.559 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:37.559 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.559 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:01:37.559 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997206+0000", 2024-04-19T03:01:37.559 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2024-04-19T03:01:37.559 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:37.559 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.559 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:01:37.559 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997218+0000", 2024-04-19T03:01:37.559 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2607e-05 2024-04-19T03:01:37.559 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:37.559 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.559 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:01:37.559 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997234+0000", 2024-04-19T03:01:37.559 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5583999999999999e-05 2024-04-19T03:01:37.560 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:37.560 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.560 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:01:37.560 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997248+0000", 2024-04-19T03:01:37.560 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4270000000000001e-05 2024-04-19T03:01:37.560 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:37.560 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.560 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:37.560 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997397+0000", 2024-04-19T03:01:37.560 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0001482 2024-04-19T03:01:37.560 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:37.560 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.560 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:01:37.561 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997407+0000", 2024-04-19T03:01:37.561 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0944000000000001e-05 2024-04-19T03:01:37.561 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:37.561 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.561 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:37.561 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.008173+0000", 2024-04-19T03:01:37.561 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.010765378000000001 2024-04-19T03:01:37.561 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:37.561 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.561 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:01:37.561 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.008278+0000", 2024-04-19T03:01:37.561 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00010538 2024-04-19T03:01:37.561 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:37.561 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.562 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 1", 2024-04-19T03:01:37.562 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.008423+0000", 2024-04-19T03:01:37.562 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014525599999999999 2024-04-19T03:01:37.562 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:37.562 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.562 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:01:37.562 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.012734+0000", 2024-04-19T03:01:37.562 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0043108590000000002 2024-04-19T03:01:37.562 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:37.562 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.562 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:37.562 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.019318+0000", 2024-04-19T03:01:37.563 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0065836130000000003 2024-04-19T03:01:37.563 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:37.563 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.563 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:01:37.563 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.019382+0000", 2024-04-19T03:01:37.563 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.3925999999999997e-05 2024-04-19T03:01:37.563 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:37.563 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.563 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:01:37.563 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.019417+0000", 2024-04-19T03:01:37.563 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.5454999999999999e-05 2024-04-19T03:01:37.563 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:37.563 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:37.563 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:37.563 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:37.564 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.564 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(mds.0.3:15 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:01:37.564 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:14.997260+0000", 2024-04-19T03:01:37.564 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 22.534947636999998, 2024-04-19T03:01:37.564 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.021842842000000001, 2024-04-19T03:01:37.564 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:01:37.564 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:37.564 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:01:37.564 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.564 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:01:37.564 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997260+0000", 2024-04-19T03:01:37.564 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:37.564 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:37.564 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.565 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:01:37.565 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997260+0000", 2024-04-19T03:01:37.565 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:37.565 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:37.565 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.565 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:01:37.565 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997259+0000", 2024-04-19T03:01:37.565 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999995 2024-04-19T03:01:37.565 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:37.565 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.565 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:01:37.566 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997270+0000", 2024-04-19T03:01:37.566 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0312999999999999e-05 2024-04-19T03:01:37.566 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:37.566 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.566 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:01:37.566 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997279+0000", 2024-04-19T03:01:37.567 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.7770000000000008e-06 2024-04-19T03:01:37.567 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:37.567 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.567 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:01:37.567 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997286+0000", 2024-04-19T03:01:37.567 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.0129999999999996e-06 2024-04-19T03:01:37.567 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:37.568 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.568 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:37.568 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997433+0000", 2024-04-19T03:01:37.568 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014774699999999999 2024-04-19T03:01:37.568 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:37.568 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.568 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:01:37.568 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997443+0000", 2024-04-19T03:01:37.568 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.414e-06 2024-04-19T03:01:37.568 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:37.568 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.568 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:37.568 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.008673+0000", 2024-04-19T03:01:37.568 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.011230789999999999 2024-04-19T03:01:37.569 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:37.569 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.569 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:01:37.569 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.008808+0000", 2024-04-19T03:01:37.569 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000134346 2024-04-19T03:01:37.569 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:37.569 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.569 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-04-19T03:01:37.569 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.008922+0000", 2024-04-19T03:01:37.569 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000114444 2024-04-19T03:01:37.569 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:37.569 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.569 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:01:37.569 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.013442+0000", 2024-04-19T03:01:37.570 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0045193439999999998 2024-04-19T03:01:37.570 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:37.570 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.570 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:37.570 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.019005+0000", 2024-04-19T03:01:37.570 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00556333 2024-04-19T03:01:37.570 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:37.570 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.570 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:01:37.570 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.019049+0000", 2024-04-19T03:01:37.570 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.4240000000000003e-05 2024-04-19T03:01:37.570 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:37.570 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.571 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:01:37.571 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.019103+0000", 2024-04-19T03:01:37.571 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.3706999999999999e-05 2024-04-19T03:01:37.571 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:37.571 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:37.571 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:37.571 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:37.571 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.571 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(mds.0.3:17 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:01:37.571 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:14.997292+0000", 2024-04-19T03:01:37.571 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 22.534915909999999, 2024-04-19T03:01:37.571 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.019573165999999999, 2024-04-19T03:01:37.571 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:01:37.571 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:37.572 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:01:37.572 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.572 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:01:37.572 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997292+0000", 2024-04-19T03:01:37.572 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:37.572 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:37.572 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.572 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:01:37.572 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997292+0000", 2024-04-19T03:01:37.572 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:37.572 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:37.572 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.572 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:01:37.572 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997291+0000", 2024-04-19T03:01:37.573 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999995 2024-04-19T03:01:37.573 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:37.573 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.573 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:01:37.573 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997297+0000", 2024-04-19T03:01:37.573 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.3900000000000001e-06 2024-04-19T03:01:37.573 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:37.573 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.573 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:01:37.573 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997316+0000", 2024-04-19T03:01:37.573 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.9406e-05 2024-04-19T03:01:37.573 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:37.573 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.573 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:01:37.573 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997353+0000", 2024-04-19T03:01:37.574 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.6563999999999998e-05 2024-04-19T03:01:37.574 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:37.574 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.574 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:37.574 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997447+0000", 2024-04-19T03:01:37.574 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.4463999999999995e-05 2024-04-19T03:01:37.574 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:37.574 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.574 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op must wait for map", 2024-04-19T03:01:37.574 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997458+0000", 2024-04-19T03:01:37.574 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0817e-05 2024-04-19T03:01:37.574 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:37.574 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.575 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:37.575 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.002013+0000", 2024-04-19T03:01:37.575 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.004555229 2024-04-19T03:01:37.575 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:37.575 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.575 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:01:37.575 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.002943+0000", 2024-04-19T03:01:37.575 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00092983200000000001 2024-04-19T03:01:37.575 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:37.575 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.575 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-04-19T03:01:37.575 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.003257+0000", 2024-04-19T03:01:37.575 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00031455399999999998 2024-04-19T03:01:37.575 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:37.576 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.576 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:01:37.576 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.014107+0000", 2024-04-19T03:01:37.576 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.010849648 2024-04-19T03:01:37.576 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:37.576 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.576 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:37.576 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.016767+0000", 2024-04-19T03:01:37.576 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0026594990000000001 2024-04-19T03:01:37.576 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:37.576 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.576 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:01:37.576 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.016825+0000", 2024-04-19T03:01:37.576 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.8264000000000003e-05 2024-04-19T03:01:37.577 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:37.577 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.577 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:01:37.577 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.016865+0000", 2024-04-19T03:01:37.577 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.0108999999999998e-05 2024-04-19T03:01:37.577 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:37.577 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:37.577 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:37.578 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:37.578 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.578 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(mds.0.3:22 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:01:37.578 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:14.997383+0000", 2024-04-19T03:01:37.578 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 22.534825130000002, 2024-04-19T03:01:37.578 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.019634641000000001, 2024-04-19T03:01:37.578 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:01:37.578 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "started", 2024-04-19T03:01:37.578 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:01:37.578 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.578 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:01:37.578 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997383+0000", 2024-04-19T03:01:37.578 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:37.579 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:37.579 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.579 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:01:37.579 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997383+0000", 2024-04-19T03:01:37.579 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:37.579 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:37.579 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.579 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:01:37.579 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997381+0000", 2024-04-19T03:01:37.579 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999986 2024-04-19T03:01:37.579 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:37.579 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.579 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:01:37.579 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997399+0000", 2024-04-19T03:01:37.580 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.802e-05 2024-04-19T03:01:37.580 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:37.580 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.580 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:01:37.580 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997417+0000", 2024-04-19T03:01:37.580 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.7581e-05 2024-04-19T03:01:37.580 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:37.580 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.580 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:01:37.580 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997429+0000", 2024-04-19T03:01:37.580 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1803e-05 2024-04-19T03:01:37.580 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:37.580 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.580 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:37.581 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997540+0000", 2024-04-19T03:01:37.581 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000111397 2024-04-19T03:01:37.581 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:37.581 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.581 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:01:37.581 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997552+0000", 2024-04-19T03:01:37.581 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1643e-05 2024-04-19T03:01:37.581 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:37.581 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.581 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:37.581 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.006836+0000", 2024-04-19T03:01:37.581 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0092841940000000008 2024-04-19T03:01:37.581 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:37.581 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.582 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:01:37.582 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.006982+0000", 2024-04-19T03:01:37.582 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014572899999999999 2024-04-19T03:01:37.582 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:37.582 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.582 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:01:37.582 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.017017+0000", 2024-04-19T03:01:37.582 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.010035571 2024-04-19T03:01:37.582 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:37.582 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:37.582 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:37.582 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:37.582 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.583 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(mds.0.3:23 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:01:37.583 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:14.997449+0000", 2024-04-19T03:01:37.583 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 22.534758588999999, 2024-04-19T03:01:37.583 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.022679250000000001, 2024-04-19T03:01:37.583 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:01:37.583 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "started", 2024-04-19T03:01:37.583 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:01:37.583 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.583 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:01:37.583 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997449+0000", 2024-04-19T03:01:37.583 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:37.583 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:37.583 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.583 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:01:37.584 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997449+0000", 2024-04-19T03:01:37.584 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:37.584 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:37.584 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.584 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:01:37.584 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997448+0000", 2024-04-19T03:01:37.584 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999995 2024-04-19T03:01:37.584 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:37.584 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.584 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:01:37.584 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997452+0000", 2024-04-19T03:01:37.584 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.0369999999999996e-06 2024-04-19T03:01:37.584 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:37.584 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.585 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:01:37.585 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997461+0000", 2024-04-19T03:01:37.585 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.6100000000000006e-06 2024-04-19T03:01:37.585 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:37.585 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.585 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:01:37.585 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997468+0000", 2024-04-19T03:01:37.585 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.8360000000000003e-06 2024-04-19T03:01:37.585 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:37.585 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.585 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:37.585 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997546+0000", 2024-04-19T03:01:37.585 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.7956999999999999e-05 2024-04-19T03:01:37.586 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:37.586 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.586 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:01:37.586 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997555+0000", 2024-04-19T03:01:37.586 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.2269999999999999e-06 2024-04-19T03:01:37.586 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:37.586 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.586 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:37.586 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.010065+0000", 2024-04-19T03:01:37.586 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.012509457999999999 2024-04-19T03:01:37.586 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:37.586 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.586 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:01:37.586 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.010187+0000", 2024-04-19T03:01:37.587 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000122059 2024-04-19T03:01:37.587 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:37.587 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.587 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:01:37.587 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.020128+0000", 2024-04-19T03:01:37.587 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0099417529999999994 2024-04-19T03:01:37.587 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:37.587 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:37.587 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:37.587 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:37.587 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.587 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(mds.0.3:25 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:01:37.587 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:14.997485+0000", 2024-04-19T03:01:37.588 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 22.534723122999999, 2024-04-19T03:01:37.588 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.021633427, 2024-04-19T03:01:37.588 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:01:37.588 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "started", 2024-04-19T03:01:37.588 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:01:37.588 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.588 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:01:37.588 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997485+0000", 2024-04-19T03:01:37.588 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:37.588 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:37.588 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.588 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:01:37.588 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997485+0000", 2024-04-19T03:01:37.588 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:37.589 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:37.589 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.589 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:01:37.589 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997484+0000", 2024-04-19T03:01:37.589 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2024-04-19T03:01:37.589 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:37.589 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.589 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:01:37.589 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997490+0000", 2024-04-19T03:01:37.589 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.857e-06 2024-04-19T03:01:37.589 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:37.589 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.589 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:01:37.589 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997505+0000", 2024-04-19T03:01:37.590 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.518e-05 2024-04-19T03:01:37.590 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:37.590 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.590 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:01:37.590 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997520+0000", 2024-04-19T03:01:37.590 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5026e-05 2024-04-19T03:01:37.590 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:37.590 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.590 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:37.590 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997607+0000", 2024-04-19T03:01:37.590 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.7107000000000005e-05 2024-04-19T03:01:37.590 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:37.590 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.591 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op must wait for map", 2024-04-19T03:01:37.591 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997614+0000", 2024-04-19T03:01:37.591 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.0539999999999997e-06 2024-04-19T03:01:37.591 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:37.591 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.591 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:37.591 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.009808+0000", 2024-04-19T03:01:37.591 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.012194371000000001 2024-04-19T03:01:37.591 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:37.591 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.591 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:01:37.591 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.010107+0000", 2024-04-19T03:01:37.591 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000298731 2024-04-19T03:01:37.591 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:37.592 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.592 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:01:37.592 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.019118+0000", 2024-04-19T03:01:37.592 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0090109839999999997 2024-04-19T03:01:37.592 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:37.592 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:37.592 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:37.592 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:37.592 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.592 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "pg_update_log_missing(3.1a epoch 20/18 rep_tid 3 entries 20'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:24 0.000000 -2 ObjectCleanRegions clean_offsets: [0~18446744073709551615], clean_omap: 1, new_object: 0 trim_to 0'0 roll_forward_to 0'0)", 2024-04-19T03:01:37.592 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:15.009291+0000", 2024-04-19T03:01:37.592 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 22.522916922, 2024-04-19T03:01:37.592 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0050397879999999999, 2024-04-19T03:01:37.592 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:01:37.593 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "reached pg", 2024-04-19T03:01:37.593 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:01:37.593 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.593 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:01:37.593 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.009291+0000", 2024-04-19T03:01:37.593 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:37.593 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:37.593 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.593 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:01:37.593 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.009291+0000", 2024-04-19T03:01:37.593 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:37.593 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:37.593 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.593 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:01:37.593 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.009290+0000", 2024-04-19T03:01:37.594 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2024-04-19T03:01:37.594 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:37.594 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.594 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:01:37.594 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.009300+0000", 2024-04-19T03:01:37.594 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0446e-05 2024-04-19T03:01:37.594 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:37.594 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.594 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:01:37.594 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.009312+0000", 2024-04-19T03:01:37.594 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1286e-05 2024-04-19T03:01:37.594 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:37.594 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.595 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:01:37.595 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.009326+0000", 2024-04-19T03:01:37.595 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.455e-05 2024-04-19T03:01:37.595 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:37.595 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.595 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:37.595 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.012362+0000", 2024-04-19T03:01:37.595 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0030354980000000002 2024-04-19T03:01:37.595 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:37.595 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.595 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:01:37.595 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.014331+0000", 2024-04-19T03:01:37.595 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00196897 2024-04-19T03:01:37.595 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:37.596 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:37.596 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:37.596 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:37.596 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.596 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(mds.0.3:12 3.1c e20/18 3:3ed09add:::607.00000000:head v 20'1, mlcod=0'0)", 2024-04-19T03:01:37.596 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:15.011275+0000", 2024-04-19T03:01:37.596 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 22.520932245000001, 2024-04-19T03:01:37.596 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0029139779999999998, 2024-04-19T03:01:37.596 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:01:37.596 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:37.596 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:01:37.596 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.596 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:01:37.597 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.011275+0000", 2024-04-19T03:01:37.597 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:37.597 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:37.597 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.597 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:01:37.597 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.011275+0000", 2024-04-19T03:01:37.597 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:37.597 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:37.597 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.597 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:01:37.597 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.011275+0000", 2024-04-19T03:01:37.597 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999995 2024-04-19T03:01:37.597 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:37.597 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.598 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:01:37.598 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.011281+0000", 2024-04-19T03:01:37.598 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.7239999999999997e-06 2024-04-19T03:01:37.598 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:37.598 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.598 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:01:37.598 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.011287+0000", 2024-04-19T03:01:37.598 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.3080000000000004e-06 2024-04-19T03:01:37.598 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:37.598 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.598 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:01:37.598 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.011294+0000", 2024-04-19T03:01:37.598 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.8560000000000001e-06 2024-04-19T03:01:37.598 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:37.599 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.599 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:37.599 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.011344+0000", 2024-04-19T03:01:37.599 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.0151999999999997e-05 2024-04-19T03:01:37.599 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:37.599 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.599 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:01:37.599 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.011368+0000", 2024-04-19T03:01:37.599 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.3328000000000001e-05 2024-04-19T03:01:37.599 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:37.599 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.599 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:01:37.599 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.014142+0000", 2024-04-19T03:01:37.599 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.002774908 2024-04-19T03:01:37.600 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:37.600 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.600 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:01:37.600 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.014189+0000", 2024-04-19T03:01:37.600 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.6966999999999999e-05 2024-04-19T03:01:37.600 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:37.600 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:37.600 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:37.600 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:37.600 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.600 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(mds.0.3:37 3.13 e20/18 3:cd5a64a3:::100.00000000:head v 20'1, mlcod=0'0)", 2024-04-19T03:01:37.600 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:15.011340+0000", 2024-04-19T03:01:37.600 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 22.520867366000001, 2024-04-19T03:01:37.600 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0051866550000000001, 2024-04-19T03:01:37.601 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:01:37.601 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:37.601 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:01:37.601 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.601 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:01:37.601 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.011340+0000", 2024-04-19T03:01:37.601 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:37.601 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:37.601 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.601 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:01:37.601 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.011340+0000", 2024-04-19T03:01:37.601 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:37.601 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:37.601 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.602 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:01:37.602 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.011340+0000", 2024-04-19T03:01:37.602 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2024-04-19T03:01:37.602 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:37.602 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.602 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:01:37.602 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.011362+0000", 2024-04-19T03:01:37.602 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.2357999999999998e-05 2024-04-19T03:01:37.602 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:37.602 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.602 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:01:37.602 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.011375+0000", 2024-04-19T03:01:37.602 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.323e-05 2024-04-19T03:01:37.603 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:37.603 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.603 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:01:37.603 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.011394+0000", 2024-04-19T03:01:37.603 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.8907999999999999e-05 2024-04-19T03:01:37.603 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:37.603 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.603 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:37.603 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.013182+0000", 2024-04-19T03:01:37.603 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0017877850000000001 2024-04-19T03:01:37.603 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:37.603 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.603 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:01:37.603 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.013199+0000", 2024-04-19T03:01:37.604 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.7309999999999999e-05 2024-04-19T03:01:37.604 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:37.604 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.604 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:01:37.604 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.016493+0000", 2024-04-19T03:01:37.604 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.003293668 2024-04-19T03:01:37.604 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:37.604 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.604 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:01:37.604 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.016527+0000", 2024-04-19T03:01:37.604 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.4131999999999998e-05 2024-04-19T03:01:37.604 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:37.604 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:37.604 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:37.605 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:37.605 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.605 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(mds.0.3:16 3.13 e20/18 3:c91d4a1d:::mds0_inotable:head v 20'2, mlcod=0'0)", 2024-04-19T03:01:37.605 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:15.011402+0000", 2024-04-19T03:01:37.605 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 22.520805982999999, 2024-04-19T03:01:37.605 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0053040359999999998, 2024-04-19T03:01:37.605 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:01:37.605 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:37.605 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:01:37.605 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.605 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:01:37.605 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.011402+0000", 2024-04-19T03:01:37.605 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:37.605 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:37.606 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.606 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:01:37.606 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.011402+0000", 2024-04-19T03:01:37.606 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:37.606 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:37.606 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.606 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:01:37.606 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.011401+0000", 2024-04-19T03:01:37.606 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999995 2024-04-19T03:01:37.606 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:37.606 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.606 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:01:37.606 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.011458+0000", 2024-04-19T03:01:37.606 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.6229e-05 2024-04-19T03:01:37.607 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:37.607 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.607 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:01:37.607 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.011467+0000", 2024-04-19T03:01:37.607 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.7650000000000005e-06 2024-04-19T03:01:37.607 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:37.607 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.607 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:01:37.607 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.011473+0000", 2024-04-19T03:01:37.607 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.6219999999999997e-06 2024-04-19T03:01:37.607 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:37.607 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.607 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:37.607 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.013645+0000", 2024-04-19T03:01:37.608 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0021723889999999998 2024-04-19T03:01:37.608 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:37.608 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.608 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:01:37.608 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.013666+0000", 2024-04-19T03:01:37.608 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.0214999999999999e-05 2024-04-19T03:01:37.608 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:37.608 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.608 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:01:37.608 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.016684+0000", 2024-04-19T03:01:37.608 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.003018827 2024-04-19T03:01:37.608 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:37.608 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.609 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:01:37.609 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.016706+0000", 2024-04-19T03:01:37.609 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.1404e-05 2024-04-19T03:01:37.609 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:37.609 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:37.609 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:37.609 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:37.609 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.609 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(mds.0.3:34 3.1c e20/18 3:3ed09add:::607.00000000:head v 20'2, mlcod=0'0)", 2024-04-19T03:01:37.609 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:15.013031+0000", 2024-04-19T03:01:37.609 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 22.519177048, 2024-04-19T03:01:37.609 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0024946059999999999, 2024-04-19T03:01:37.609 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:01:37.609 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:37.610 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:01:37.610 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.610 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:01:37.610 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.013031+0000", 2024-04-19T03:01:37.610 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:37.610 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:37.610 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.610 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:01:37.610 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.013031+0000", 2024-04-19T03:01:37.610 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:37.610 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:37.610 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.610 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:01:37.611 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.013030+0000", 2024-04-19T03:01:37.611 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999995 2024-04-19T03:01:37.611 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:37.611 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.611 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:01:37.611 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.013039+0000", 2024-04-19T03:01:37.611 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.5129999999999996e-06 2024-04-19T03:01:37.611 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:37.611 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.611 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:01:37.611 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.013050+0000", 2024-04-19T03:01:37.611 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1035e-05 2024-04-19T03:01:37.611 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:37.612 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.612 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:01:37.612 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.013057+0000", 2024-04-19T03:01:37.612 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.3950000000000003e-06 2024-04-19T03:01:37.612 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:37.612 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.612 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:37.612 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.013169+0000", 2024-04-19T03:01:37.612 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000112093 2024-04-19T03:01:37.612 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:37.612 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.612 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:01:37.612 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.013205+0000", 2024-04-19T03:01:37.612 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.6183000000000002e-05 2024-04-19T03:01:37.612 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:37.613 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.613 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:01:37.613 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.015475+0000", 2024-04-19T03:01:37.613 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0022702569999999999 2024-04-19T03:01:37.613 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:37.613 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.613 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:01:37.613 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.015525+0000", 2024-04-19T03:01:37.613 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.9784999999999999e-05 2024-04-19T03:01:37.613 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:37.613 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:37.613 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:37.613 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:37.614 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.614 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e20/18 ondisk, result = 0)", 2024-04-19T03:01:37.614 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:15.015497+0000", 2024-04-19T03:01:37.614 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 22.516710555, 2024-04-19T03:01:37.614 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00042559299999999999, 2024-04-19T03:01:37.614 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:01:37.614 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "started", 2024-04-19T03:01:37.614 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:01:37.614 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.614 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:01:37.614 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.015497+0000", 2024-04-19T03:01:37.614 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:37.614 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:37.615 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.615 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:01:37.615 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.015497+0000", 2024-04-19T03:01:37.615 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:37.615 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:37.615 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.615 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:01:37.615 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.015497+0000", 2024-04-19T03:01:37.615 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999995 2024-04-19T03:01:37.615 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:37.615 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.615 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:01:37.616 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.015500+0000", 2024-04-19T03:01:37.616 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.653e-06 2024-04-19T03:01:37.616 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:37.616 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.616 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:01:37.616 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.015514+0000", 2024-04-19T03:01:37.616 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.3619e-05 2024-04-19T03:01:37.616 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:37.616 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.616 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:01:37.616 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.015522+0000", 2024-04-19T03:01:37.616 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.8359999999999992e-06 2024-04-19T03:01:37.616 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:37.616 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.617 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:37.617 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.015774+0000", 2024-04-19T03:01:37.617 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00025170900000000003 2024-04-19T03:01:37.617 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:37.617 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.617 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:01:37.617 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.015782+0000", 2024-04-19T03:01:37.617 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.6770000000000001e-06 2024-04-19T03:01:37.617 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:37.617 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.617 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:01:37.617 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.015923+0000", 2024-04-19T03:01:37.617 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014055900000000001 2024-04-19T03:01:37.618 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:37.618 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:37.618 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:37.618 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:37.618 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.618 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop_reply(mds.0.3:17 3.b e20/18 ondisk, result = 0)", 2024-04-19T03:01:37.618 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:15.015583+0000", 2024-04-19T03:01:37.618 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 22.516624557, 2024-04-19T03:01:37.618 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0012882709999999999, 2024-04-19T03:01:37.618 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:01:37.618 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "started", 2024-04-19T03:01:37.618 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:01:37.618 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.619 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:01:37.619 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.015583+0000", 2024-04-19T03:01:37.619 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:37.619 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:37.619 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.619 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:01:37.619 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.015583+0000", 2024-04-19T03:01:37.619 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:37.619 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:37.619 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.619 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:01:37.619 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.015583+0000", 2024-04-19T03:01:37.619 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999995 2024-04-19T03:01:37.619 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:37.620 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.620 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:01:37.620 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.015586+0000", 2024-04-19T03:01:37.620 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.4979999999999998e-06 2024-04-19T03:01:37.620 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:37.620 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.620 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:01:37.620 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.015595+0000", 2024-04-19T03:01:37.620 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.4649999999999994e-06 2024-04-19T03:01:37.620 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:37.620 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.620 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:01:37.620 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.015601+0000", 2024-04-19T03:01:37.620 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.2570000000000004e-06 2024-04-19T03:01:37.621 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:37.621 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.621 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:37.621 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.016742+0000", 2024-04-19T03:01:37.621 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0011415900000000001 2024-04-19T03:01:37.621 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:37.621 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.621 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:01:37.621 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.016750+0000", 2024-04-19T03:01:37.621 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.695e-06 2024-04-19T03:01:37.621 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:37.621 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.621 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:01:37.621 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.016871+0000", 2024-04-19T03:01:37.622 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000121304 2024-04-19T03:01:37.622 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:37.622 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:37.622 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:37.622 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:37.622 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.622 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "pg_update_log_missing_reply(3.b epoch 20/18 rep_tid 1 lcod 20'2)", 2024-04-19T03:01:37.622 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:15.015606+0000", 2024-04-19T03:01:37.622 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 22.516601643000001, 2024-04-19T03:01:37.622 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001418423, 2024-04-19T03:01:37.622 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:01:37.622 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "reached pg", 2024-04-19T03:01:37.622 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:01:37.623 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.623 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:01:37.623 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.015606+0000", 2024-04-19T03:01:37.623 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:37.623 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:37.623 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.623 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:01:37.623 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.015606+0000", 2024-04-19T03:01:37.623 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:37.623 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:37.623 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.623 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:01:37.623 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.015606+0000", 2024-04-19T03:01:37.623 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999995 2024-04-19T03:01:37.624 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:37.624 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.624 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:01:37.624 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.015608+0000", 2024-04-19T03:01:37.624 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.836e-06 2024-04-19T03:01:37.624 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:37.624 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.624 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:01:37.624 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.015615+0000", 2024-04-19T03:01:37.624 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.8059999999999997e-06 2024-04-19T03:01:37.624 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:37.624 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.624 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:01:37.624 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.015621+0000", 2024-04-19T03:01:37.624 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.1040000000000003e-06 2024-04-19T03:01:37.625 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:37.625 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.625 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:37.625 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.016927+0000", 2024-04-19T03:01:37.625 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001305676 2024-04-19T03:01:37.625 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:37.625 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.625 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:01:37.625 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.017024+0000", 2024-04-19T03:01:37.625 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.7418999999999997e-05 2024-04-19T03:01:37.625 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:37.625 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:37.625 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:37.626 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:37.626 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.626 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop_reply(mds.0.3:15 3.1f e20/18 ondisk, result = 0)", 2024-04-19T03:01:37.626 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:15.018866+0000", 2024-04-19T03:01:37.626 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 22.513341221000001, 2024-04-19T03:01:37.626 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00026444800000000003, 2024-04-19T03:01:37.626 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:01:37.626 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "started", 2024-04-19T03:01:37.626 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:01:37.626 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.626 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:01:37.626 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.018866+0000", 2024-04-19T03:01:37.626 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:37.626 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:37.627 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.627 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:01:37.627 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.018866+0000", 2024-04-19T03:01:37.627 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:37.627 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:37.627 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.627 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:01:37.627 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.018866+0000", 2024-04-19T03:01:37.627 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999995 2024-04-19T03:01:37.627 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:37.627 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.627 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:01:37.627 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.018870+0000", 2024-04-19T03:01:37.628 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.1999999999999996e-06 2024-04-19T03:01:37.628 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:37.628 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.628 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:01:37.628 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.018876+0000", 2024-04-19T03:01:37.628 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.1890000000000004e-06 2024-04-19T03:01:37.628 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:37.628 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.628 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:01:37.628 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.018882+0000", 2024-04-19T03:01:37.628 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.8989999999999998e-06 2024-04-19T03:01:37.628 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:37.628 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.628 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:37.629 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.018994+0000", 2024-04-19T03:01:37.629 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00011137900000000001 2024-04-19T03:01:37.629 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:37.629 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.629 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:01:37.629 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.019000+0000", 2024-04-19T03:01:37.629 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.9270000000000002e-06 2024-04-19T03:01:37.629 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:37.629 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.629 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:01:37.629 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.019131+0000", 2024-04-19T03:01:37.629 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00013133099999999999 2024-04-19T03:01:37.629 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:37.629 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:37.630 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:37.630 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:37.630 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.630 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2024-04-19T03:01:37.630 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:20.693149+0000", 2024-04-19T03:01:37.630 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 16.839058326, 2024-04-19T03:01:37.630 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0032864869999999998, 2024-04-19T03:01:37.630 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:01:37.630 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:37.630 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:01:37.630 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.630 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:01:37.630 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:20.693149+0000", 2024-04-19T03:01:37.631 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:37.631 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:37.631 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.631 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:01:37.631 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:20.693149+0000", 2024-04-19T03:01:37.631 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:37.631 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:37.631 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.631 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:01:37.631 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:20.693146+0000", 2024-04-19T03:01:37.631 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999967 2024-04-19T03:01:37.631 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:37.631 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.631 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:01:37.632 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:20.693170+0000", 2024-04-19T03:01:37.632 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.3433000000000001e-05 2024-04-19T03:01:37.632 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:37.633 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.633 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:01:37.633 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:20.693209+0000", 2024-04-19T03:01:37.633 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.9376999999999999e-05 2024-04-19T03:01:37.633 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:37.633 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.634 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:01:37.634 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:20.693226+0000", 2024-04-19T03:01:37.634 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.7269e-05 2024-04-19T03:01:37.634 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:37.634 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.634 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:37.634 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:20.693329+0000", 2024-04-19T03:01:37.634 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00010257 2024-04-19T03:01:37.634 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:37.634 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.634 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:01:37.634 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:20.693585+0000", 2024-04-19T03:01:37.634 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00025644300000000002 2024-04-19T03:01:37.635 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:37.635 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.635 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-04-19T03:01:37.635 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:20.693779+0000", 2024-04-19T03:01:37.635 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00019388599999999999 2024-04-19T03:01:37.635 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:37.635 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.635 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:01:37.635 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:20.695109+0000", 2024-04-19T03:01:37.635 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0013295430000000001 2024-04-19T03:01:37.635 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:37.635 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.635 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:37.636 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:20.696276+0000", 2024-04-19T03:01:37.636 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0011674299999999999 2024-04-19T03:01:37.636 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:37.636 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.636 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:01:37.636 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:20.696373+0000", 2024-04-19T03:01:37.636 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.6892999999999995e-05 2024-04-19T03:01:37.636 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:37.636 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.636 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:01:37.636 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:20.696436+0000", 2024-04-19T03:01:37.636 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.2773000000000004e-05 2024-04-19T03:01:37.636 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:37.636 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:37.637 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:37.637 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:37.637 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.637 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop_reply(mds.0.3:39 3.6 e21/18 ondisk, result = 0)", 2024-04-19T03:01:37.637 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:20.696060+0000", 2024-04-19T03:01:37.637 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 16.836148004000002, 2024-04-19T03:01:37.637 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00039142199999999999, 2024-04-19T03:01:37.637 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:01:37.637 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "started", 2024-04-19T03:01:37.637 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:01:37.637 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.637 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:01:37.637 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:20.696060+0000", 2024-04-19T03:01:37.637 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:37.638 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:37.638 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.638 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:01:37.638 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:20.696060+0000", 2024-04-19T03:01:37.638 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:37.638 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:37.638 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.638 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:01:37.638 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:20.696058+0000", 2024-04-19T03:01:37.638 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999981 2024-04-19T03:01:37.638 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:37.638 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.638 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:01:37.638 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:20.696072+0000", 2024-04-19T03:01:37.639 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4209999999999999e-05 2024-04-19T03:01:37.639 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:37.639 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.639 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:01:37.639 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:20.696104+0000", 2024-04-19T03:01:37.639 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1816999999999997e-05 2024-04-19T03:01:37.639 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:37.639 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.639 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:01:37.639 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:20.696118+0000", 2024-04-19T03:01:37.639 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.3720000000000001e-05 2024-04-19T03:01:37.639 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:37.639 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.639 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:37.640 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:20.696243+0000", 2024-04-19T03:01:37.640 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012587300000000001 2024-04-19T03:01:37.640 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:37.640 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.640 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:01:37.640 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:20.696259+0000", 2024-04-19T03:01:37.640 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.509e-05 2024-04-19T03:01:37.640 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:37.640 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:37.640 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:01:37.640 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:20.696451+0000", 2024-04-19T03:01:37.640 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00019259600000000001 2024-04-19T03:01:37.640 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:37.640 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:37.641 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:37.641 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:37.641 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:37.641 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-04-19T03:01:37.643 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T03:01:37.643 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-04-19T03:01:37.637+0000 7f35986ab700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18243) UID: 0 2024-04-19T03:01:37.744 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:01:37.744+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:01:37.753 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-19T03:01:37.757 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-19T03:01:37.757 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-04-19T03:01:37.757 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 0 2024-04-19T03:01:37.757 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-19T03:01:37.761 DEBUG:teuthology.orchestra.run.smithi096:> /bin/sh -c 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --no-log-to-stderr --name client.0 -b 65536 --object-size 65536 -p unique_pool_0 bench 60 write' 2024-04-19T03:01:37.763 INFO:teuthology.run_tasks:Running task admin_socket... 2024-04-19T03:01:37.774 DEBUG:tasks.admin_socket:Running admin socket tests on client.0 2024-04-19T03:01:37.774 DEBUG:teuthology.orchestra.run.smithi096:> mkdir -- /home/ubuntu/cephtest/admin_socket_client.0 && while test '!' -e /var/run/ceph/ceph-client.0.asok ; do sleep 1 ; done 2024-04-19T03:01:37.775 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T03:01:37.818 INFO:tasks.radosbench.radosbench.0.smithi096.stdout:hints = 1 2024-04-19T03:01:37.819 INFO:tasks.radosbench.radosbench.0.smithi096.stdout:Maintaining 16 concurrent writes of 65536 bytes to objects of size 65536 for up to 60 seconds or 0 objects 2024-04-19T03:01:37.819 INFO:tasks.radosbench.radosbench.0.smithi096.stdout:Object prefix: benchmark_data_smithi096_19531 2024-04-19T03:01:37.819 INFO:tasks.radosbench.radosbench.0.smithi096.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-04-19T03:01:37.819 INFO:tasks.radosbench.radosbench.0.smithi096.stdout: 0 0 0 0 0 0 - 0 2024-04-19T03:01:37.844 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:01:37.841+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:01:37.905 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-19T03:01:37.906 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-04-19T03:01:37.906 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-04-19T03:01:37.906 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-04-19T03:01:37.906 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-19T03:01:37.917 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T03:01:37.945 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-04-19T03:01:37.941+0000 7f35986ab700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18243) UID: 0 2024-04-19T03:01:38.039 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-19T03:01:38.040 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-04-19T03:01:38.040 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-04-19T03:01:38.040 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-04-19T03:01:38.040 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.040 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:9 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:01:38.040 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:14.999380+0000", 2024-04-19T03:01:38.040 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 23.037551463, 2024-04-19T03:01:38.040 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.019009906, 2024-04-19T03:01:38.040 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:01:38.040 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:38.040 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:01:38.040 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.040 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:01:38.040 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999380+0000", 2024-04-19T03:01:38.041 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:38.041 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.041 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.041 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:01:38.041 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999380+0000", 2024-04-19T03:01:38.041 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:38.041 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.041 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.041 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:01:38.041 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999377+0000", 2024-04-19T03:01:38.041 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999971 2024-04-19T03:01:38.041 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.041 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.041 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:01:38.042 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999393+0000", 2024-04-19T03:01:38.042 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5665999999999999e-05 2024-04-19T03:01:38.042 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.042 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.042 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:01:38.042 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999416+0000", 2024-04-19T03:01:38.042 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3030000000000001e-05 2024-04-19T03:01:38.042 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.042 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.042 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:01:38.042 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999439+0000", 2024-04-19T03:01:38.045 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3203000000000001e-05 2024-04-19T03:01:38.045 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.045 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.045 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:38.045 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999564+0000", 2024-04-19T03:01:38.046 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012492800000000001 2024-04-19T03:01:38.046 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.046 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.046 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op must wait for map", 2024-04-19T03:01:38.046 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999573+0000", 2024-04-19T03:01:38.046 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.7129999999999994e-06 2024-04-19T03:01:38.046 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.046 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.046 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:38.046 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.005623+0000", 2024-04-19T03:01:38.046 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0060502120000000001 2024-04-19T03:01:38.046 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.046 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.046 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:01:38.047 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.006510+0000", 2024-04-19T03:01:38.047 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00088656 2024-04-19T03:01:38.047 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.047 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.047 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-04-19T03:01:38.047 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.008004+0000", 2024-04-19T03:01:38.047 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0014948240000000001 2024-04-19T03:01:38.047 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.047 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.047 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:01:38.047 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.011874+0000", 2024-04-19T03:01:38.047 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0038699630000000001 2024-04-19T03:01:38.047 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.047 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.048 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:38.048 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.018000+0000", 2024-04-19T03:01:38.048 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0061254389999999999 2024-04-19T03:01:38.048 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.048 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.048 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:01:38.048 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.018281+0000", 2024-04-19T03:01:38.048 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00028121400000000001 2024-04-19T03:01:38.048 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.048 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.048 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:01:38.048 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.018390+0000", 2024-04-19T03:01:38.048 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010899 2024-04-19T03:01:38.048 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:38.049 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:01:38.049 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:38.049 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.049 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.049 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:10 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:01:38.049 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:14.999496+0000", 2024-04-19T03:01:38.049 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 23.037435928000001, 2024-04-19T03:01:38.049 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.022720497999999999, 2024-04-19T03:01:38.049 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:01:38.049 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:38.049 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:01:38.049 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.049 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:01:38.049 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999496+0000", 2024-04-19T03:01:38.050 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:38.050 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.050 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.050 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:01:38.050 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999496+0000", 2024-04-19T03:01:38.050 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:38.050 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.050 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.050 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:01:38.050 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999494+0000", 2024-04-19T03:01:38.050 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:01:38.050 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.050 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.050 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:01:38.051 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999503+0000", 2024-04-19T03:01:38.051 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.5930000000000006e-06 2024-04-19T03:01:38.051 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.051 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.051 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:01:38.051 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999523+0000", 2024-04-19T03:01:38.051 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9553000000000001e-05 2024-04-19T03:01:38.051 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.051 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.051 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:01:38.051 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999538+0000", 2024-04-19T03:01:38.051 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5702999999999999e-05 2024-04-19T03:01:38.051 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.051 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.052 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:38.052 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999608+0000", 2024-04-19T03:01:38.052 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.9912000000000004e-05 2024-04-19T03:01:38.052 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.052 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.052 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op must wait for map", 2024-04-19T03:01:38.052 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999626+0000", 2024-04-19T03:01:38.052 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8207e-05 2024-04-19T03:01:38.052 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.052 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.052 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:38.052 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.010765+0000", 2024-04-19T03:01:38.052 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011138719 2024-04-19T03:01:38.052 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.052 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.053 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:01:38.053 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.010906+0000", 2024-04-19T03:01:38.053 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014095899999999999 2024-04-19T03:01:38.053 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.053 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.053 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-04-19T03:01:38.053 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.011472+0000", 2024-04-19T03:01:38.053 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00056629300000000005 2024-04-19T03:01:38.053 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.053 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.053 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:01:38.053 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.013217+0000", 2024-04-19T03:01:38.053 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001744317 2024-04-19T03:01:38.053 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.054 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.054 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:38.054 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.022083+0000", 2024-04-19T03:01:38.054 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0088663849999999992 2024-04-19T03:01:38.054 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.054 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.054 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:01:38.054 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.022124+0000", 2024-04-19T03:01:38.054 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.057e-05 2024-04-19T03:01:38.054 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.054 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.054 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:01:38.054 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.022216+0000", 2024-04-19T03:01:38.054 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.2417000000000006e-05 2024-04-19T03:01:38.055 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:38.055 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:01:38.055 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:38.055 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.055 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.055 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:13 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:01:38.055 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:14.999564+0000", 2024-04-19T03:01:38.055 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 23.037367046, 2024-04-19T03:01:38.055 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.019594777000000001, 2024-04-19T03:01:38.055 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:01:38.055 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:38.055 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:01:38.055 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.055 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:01:38.055 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999564+0000", 2024-04-19T03:01:38.056 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:38.056 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.056 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.056 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:01:38.056 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999564+0000", 2024-04-19T03:01:38.056 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:38.056 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.056 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.056 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:01:38.056 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999563+0000", 2024-04-19T03:01:38.056 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:01:38.056 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.056 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.057 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:01:38.057 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999582+0000", 2024-04-19T03:01:38.057 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8151999999999998e-05 2024-04-19T03:01:38.057 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.057 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.057 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:01:38.057 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999599+0000", 2024-04-19T03:01:38.057 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7583000000000001e-05 2024-04-19T03:01:38.057 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.057 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.057 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:01:38.057 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999618+0000", 2024-04-19T03:01:38.057 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8989999999999999e-05 2024-04-19T03:01:38.057 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.057 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.058 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:38.058 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999692+0000", 2024-04-19T03:01:38.058 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3561999999999998e-05 2024-04-19T03:01:38.058 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.058 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.058 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op must wait for map", 2024-04-19T03:01:38.058 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999698+0000", 2024-04-19T03:01:38.058 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7159999999999997e-06 2024-04-19T03:01:38.058 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.058 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.058 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:38.058 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.007836+0000", 2024-04-19T03:01:38.058 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0081376520000000004 2024-04-19T03:01:38.059 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.059 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.059 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:01:38.059 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.008208+0000", 2024-04-19T03:01:38.059 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00037223699999999998 2024-04-19T03:01:38.059 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.059 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.059 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-04-19T03:01:38.059 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.008516+0000", 2024-04-19T03:01:38.059 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000308227 2024-04-19T03:01:38.059 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.059 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.059 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:01:38.059 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.011585+0000", 2024-04-19T03:01:38.060 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0030680659999999999 2024-04-19T03:01:38.060 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.060 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.060 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:38.060 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.018871+0000", 2024-04-19T03:01:38.060 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0072861369999999998 2024-04-19T03:01:38.060 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.060 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.060 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:01:38.060 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.019067+0000", 2024-04-19T03:01:38.060 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00019672099999999999 2024-04-19T03:01:38.060 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.060 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.060 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:01:38.060 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.019159+0000", 2024-04-19T03:01:38.061 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1829999999999993e-05 2024-04-19T03:01:38.061 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:38.061 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:01:38.061 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:38.061 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.061 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.061 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:31 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:01:38.061 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:14.999649+0000", 2024-04-19T03:01:38.061 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 23.037282928, 2024-04-19T03:01:38.061 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.018882121000000002, 2024-04-19T03:01:38.061 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:01:38.061 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:38.061 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:01:38.061 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.062 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:01:38.062 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999649+0000", 2024-04-19T03:01:38.062 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:38.062 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.062 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.062 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:01:38.062 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999649+0000", 2024-04-19T03:01:38.062 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:38.062 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.062 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.062 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:01:38.062 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999647+0000", 2024-04-19T03:01:38.062 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:01:38.063 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.063 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.063 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:01:38.063 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999657+0000", 2024-04-19T03:01:38.063 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.3729999999999999e-06 2024-04-19T03:01:38.063 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.063 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.063 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:01:38.063 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999675+0000", 2024-04-19T03:01:38.063 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8522999999999999e-05 2024-04-19T03:01:38.063 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.063 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.063 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:01:38.063 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999689+0000", 2024-04-19T03:01:38.064 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.347e-05 2024-04-19T03:01:38.064 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.064 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.064 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:38.064 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999761+0000", 2024-04-19T03:01:38.064 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.1904999999999997e-05 2024-04-19T03:01:38.064 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.064 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.064 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:01:38.064 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999766+0000", 2024-04-19T03:01:38.064 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6069999999999998e-06 2024-04-19T03:01:38.064 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.064 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.065 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:38.065 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.010040+0000", 2024-04-19T03:01:38.065 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.010273381 2024-04-19T03:01:38.065 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.065 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.065 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:01:38.065 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.010260+0000", 2024-04-19T03:01:38.065 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00022003300000000001 2024-04-19T03:01:38.065 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.065 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.065 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-04-19T03:01:38.065 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.010415+0000", 2024-04-19T03:01:38.065 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015515599999999999 2024-04-19T03:01:38.065 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.066 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.066 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:01:38.066 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.013206+0000", 2024-04-19T03:01:38.066 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0027915010000000001 2024-04-19T03:01:38.066 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.066 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.066 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:38.066 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.018438+0000", 2024-04-19T03:01:38.066 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0052313469999999999 2024-04-19T03:01:38.066 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.066 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.066 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:01:38.066 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.018491+0000", 2024-04-19T03:01:38.066 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3554000000000003e-05 2024-04-19T03:01:38.067 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.067 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.067 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:01:38.067 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.018531+0000", 2024-04-19T03:01:38.067 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9384000000000001e-05 2024-04-19T03:01:38.067 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:38.067 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:01:38.067 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:38.067 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.067 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.067 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:32 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:01:38.067 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:14.999712+0000", 2024-04-19T03:01:38.067 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 23.037219685, 2024-04-19T03:01:38.067 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.022635437000000001, 2024-04-19T03:01:38.068 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:01:38.068 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:38.068 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:01:38.068 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.068 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:01:38.068 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999712+0000", 2024-04-19T03:01:38.068 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:38.068 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.068 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.068 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:01:38.068 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999712+0000", 2024-04-19T03:01:38.068 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:38.068 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.068 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.068 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:01:38.069 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999711+0000", 2024-04-19T03:01:38.069 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:01:38.069 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.069 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.069 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:01:38.069 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999719+0000", 2024-04-19T03:01:38.069 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.354e-06 2024-04-19T03:01:38.069 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.069 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.069 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:01:38.069 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999735+0000", 2024-04-19T03:01:38.069 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6288999999999999e-05 2024-04-19T03:01:38.069 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.070 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.070 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:01:38.070 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999749+0000", 2024-04-19T03:01:38.070 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3492999999999999e-05 2024-04-19T03:01:38.070 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.070 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.070 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:38.070 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999811+0000", 2024-04-19T03:01:38.070 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2298999999999994e-05 2024-04-19T03:01:38.070 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.070 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.070 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:01:38.070 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999817+0000", 2024-04-19T03:01:38.071 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2169999999999999e-06 2024-04-19T03:01:38.071 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.071 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.071 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:38.071 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.011836+0000", 2024-04-19T03:01:38.071 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.012018008 2024-04-19T03:01:38.071 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.071 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.071 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:01:38.071 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.011897+0000", 2024-04-19T03:01:38.071 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1111000000000005e-05 2024-04-19T03:01:38.071 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.071 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.071 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-04-19T03:01:38.072 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.011980+0000", 2024-04-19T03:01:38.072 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3003999999999993e-05 2024-04-19T03:01:38.072 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.072 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.072 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:01:38.072 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.013863+0000", 2024-04-19T03:01:38.072 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001883804 2024-04-19T03:01:38.072 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.072 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.072 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:38.072 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.022257+0000", 2024-04-19T03:01:38.072 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0083938290000000002 2024-04-19T03:01:38.072 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.072 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.073 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:01:38.073 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.022310+0000", 2024-04-19T03:01:38.073 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.236e-05 2024-04-19T03:01:38.073 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.073 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.073 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:01:38.073 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.022347+0000", 2024-04-19T03:01:38.073 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7653e-05 2024-04-19T03:01:38.073 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:38.073 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:01:38.073 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:38.073 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.073 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.073 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:35 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:01:38.073 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:14.999772+0000", 2024-04-19T03:01:38.074 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 23.037159406000001, 2024-04-19T03:01:38.074 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020205530999999999, 2024-04-19T03:01:38.074 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:01:38.074 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:38.074 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:01:38.074 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.074 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:01:38.074 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999772+0000", 2024-04-19T03:01:38.074 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:38.074 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.074 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.074 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:01:38.074 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999772+0000", 2024-04-19T03:01:38.075 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:38.075 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.075 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.075 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:01:38.075 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999771+0000", 2024-04-19T03:01:38.075 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:01:38.075 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.075 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.075 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:01:38.075 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999778+0000", 2024-04-19T03:01:38.075 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2200000000000003e-06 2024-04-19T03:01:38.075 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.075 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.075 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:01:38.076 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999794+0000", 2024-04-19T03:01:38.076 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5798999999999999e-05 2024-04-19T03:01:38.076 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.076 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.076 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:01:38.076 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999809+0000", 2024-04-19T03:01:38.076 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.469e-05 2024-04-19T03:01:38.076 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.076 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.076 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:38.076 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999915+0000", 2024-04-19T03:01:38.076 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000105658 2024-04-19T03:01:38.076 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.077 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.077 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:01:38.077 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999927+0000", 2024-04-19T03:01:38.077 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.201e-05 2024-04-19T03:01:38.077 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.077 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.077 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:38.077 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.009841+0000", 2024-04-19T03:01:38.077 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0099147039999999999 2024-04-19T03:01:38.077 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.077 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.077 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:01:38.077 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.009941+0000", 2024-04-19T03:01:38.077 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.9461000000000002e-05 2024-04-19T03:01:38.078 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.078 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.078 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-04-19T03:01:38.078 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.010101+0000", 2024-04-19T03:01:38.078 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016028599999999999 2024-04-19T03:01:38.078 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.078 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.078 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:01:38.078 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.011787+0000", 2024-04-19T03:01:38.078 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001685513 2024-04-19T03:01:38.078 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.078 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.078 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:38.078 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.019889+0000", 2024-04-19T03:01:38.079 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0081026559999999997 2024-04-19T03:01:38.079 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.079 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.079 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:01:38.079 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.019932+0000", 2024-04-19T03:01:38.079 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2385000000000002e-05 2024-04-19T03:01:38.079 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.079 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.079 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:01:38.079 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.019978+0000", 2024-04-19T03:01:38.079 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6093000000000001e-05 2024-04-19T03:01:38.079 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:38.079 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:01:38.079 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:38.080 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.080 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.080 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:18 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:01:38.080 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:14.999834+0000", 2024-04-19T03:01:38.080 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 23.037097321000001, 2024-04-19T03:01:38.080 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.019567312999999999, 2024-04-19T03:01:38.080 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:01:38.080 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:38.080 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:01:38.080 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.080 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:01:38.080 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999834+0000", 2024-04-19T03:01:38.080 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:38.080 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.081 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.081 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:01:38.081 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999834+0000", 2024-04-19T03:01:38.081 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:38.081 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.081 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.081 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:01:38.081 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999833+0000", 2024-04-19T03:01:38.081 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:01:38.081 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.081 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.081 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:01:38.081 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999842+0000", 2024-04-19T03:01:38.081 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.2269999999999999e-06 2024-04-19T03:01:38.082 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.082 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.082 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:01:38.082 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999860+0000", 2024-04-19T03:01:38.082 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8456000000000001e-05 2024-04-19T03:01:38.082 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.082 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.082 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:01:38.082 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999874+0000", 2024-04-19T03:01:38.082 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3263e-05 2024-04-19T03:01:38.082 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.082 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.082 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:38.083 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999934+0000", 2024-04-19T03:01:38.083 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0888999999999999e-05 2024-04-19T03:01:38.083 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.083 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.083 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:01:38.083 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999940+0000", 2024-04-19T03:01:38.083 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4330000000000003e-06 2024-04-19T03:01:38.083 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.083 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.083 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:38.083 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.010943+0000", 2024-04-19T03:01:38.083 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011002786000000001 2024-04-19T03:01:38.083 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.084 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.084 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:01:38.084 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.011078+0000", 2024-04-19T03:01:38.084 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013541000000000001 2024-04-19T03:01:38.084 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.084 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.084 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-04-19T03:01:38.084 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.011172+0000", 2024-04-19T03:01:38.084 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.3459000000000001e-05 2024-04-19T03:01:38.084 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.084 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.084 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:01:38.084 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.013211+0000", 2024-04-19T03:01:38.084 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0020397710000000001 2024-04-19T03:01:38.085 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.085 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.085 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:38.085 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.019320+0000", 2024-04-19T03:01:38.085 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0061089969999999997 2024-04-19T03:01:38.085 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.085 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.085 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:01:38.085 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.019364+0000", 2024-04-19T03:01:38.085 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4158e-05 2024-04-19T03:01:38.085 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.085 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.085 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:01:38.085 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.019402+0000", 2024-04-19T03:01:38.086 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7011000000000002e-05 2024-04-19T03:01:38.086 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:38.086 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:01:38.086 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:38.086 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.086 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.086 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:21 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:01:38.086 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:14.999896+0000", 2024-04-19T03:01:38.086 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 23.037035501999998, 2024-04-19T03:01:38.086 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.018618866000000001, 2024-04-19T03:01:38.086 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:01:38.086 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-19T03:01:38.086 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:01:38.087 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.087 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:01:38.087 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999896+0000", 2024-04-19T03:01:38.087 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:38.087 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.087 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.087 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:01:38.087 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999896+0000", 2024-04-19T03:01:38.087 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:38.087 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.087 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.087 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:01:38.087 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999895+0000", 2024-04-19T03:01:38.087 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:01:38.088 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.088 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.088 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:01:38.088 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999901+0000", 2024-04-19T03:01:38.088 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4529999999999999e-06 2024-04-19T03:01:38.088 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.088 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.088 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:01:38.088 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999918+0000", 2024-04-19T03:01:38.088 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6897000000000001e-05 2024-04-19T03:01:38.088 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.088 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.088 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:01:38.089 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999931+0000", 2024-04-19T03:01:38.089 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.309e-05 2024-04-19T03:01:38.089 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.089 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.089 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:38.089 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.000027+0000", 2024-04-19T03:01:38.089 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.5880999999999999e-05 2024-04-19T03:01:38.089 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.089 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.089 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op must wait for map", 2024-04-19T03:01:38.089 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.000040+0000", 2024-04-19T03:01:38.089 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3083e-05 2024-04-19T03:01:38.089 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.089 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.090 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:38.090 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.004961+0000", 2024-04-19T03:01:38.090 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0049206079999999999 2024-04-19T03:01:38.090 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.090 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.090 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:01:38.090 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.005261+0000", 2024-04-19T03:01:38.090 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00030041699999999998 2024-04-19T03:01:38.090 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.090 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.090 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:01:38.090 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.018515+0000", 2024-04-19T03:01:38.091 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013253534000000001 2024-04-19T03:01:38.091 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:38.091 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:01:38.091 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:38.091 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.091 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.091 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:24 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:01:38.091 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:14.999964+0000", 2024-04-19T03:01:38.091 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 23.036968006999999, 2024-04-19T03:01:38.091 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020451446000000002, 2024-04-19T03:01:38.091 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:01:38.091 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-19T03:01:38.091 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:01:38.092 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.092 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:01:38.092 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999964+0000", 2024-04-19T03:01:38.092 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:38.092 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.092 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.092 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:01:38.092 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999964+0000", 2024-04-19T03:01:38.092 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:38.092 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.092 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.092 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:01:38.092 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999963+0000", 2024-04-19T03:01:38.092 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:01:38.093 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.093 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.093 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:01:38.093 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999969+0000", 2024-04-19T03:01:38.093 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0270000000000001e-06 2024-04-19T03:01:38.093 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.093 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.093 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:01:38.093 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999984+0000", 2024-04-19T03:01:38.093 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5903e-05 2024-04-19T03:01:38.093 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.093 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.093 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:01:38.093 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999998+0000", 2024-04-19T03:01:38.094 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3076e-05 2024-04-19T03:01:38.094 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.094 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.094 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:38.094 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.000078+0000", 2024-04-19T03:01:38.094 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0525000000000006e-05 2024-04-19T03:01:38.094 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.094 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.094 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op must wait for map", 2024-04-19T03:01:38.094 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.000084+0000", 2024-04-19T03:01:38.094 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8370000000000002e-06 2024-04-19T03:01:38.094 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.094 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.094 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:38.095 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.008819+0000", 2024-04-19T03:01:38.095 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0087349019999999993 2024-04-19T03:01:38.095 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.095 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.095 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:01:38.095 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.009018+0000", 2024-04-19T03:01:38.095 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000198989 2024-04-19T03:01:38.095 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.095 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.095 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:01:38.095 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.020415+0000", 2024-04-19T03:01:38.095 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011397157 2024-04-19T03:01:38.095 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:38.095 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:01:38.096 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:38.096 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.096 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.096 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:1 5.8 5:14972bfe:::benchmark_data_smithi096_19531_object0:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-19T03:01:38.096 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:37.821337+0000", 2024-04-19T03:01:38.096 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.21559413899999999, 2024-04-19T03:01:38.096 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011847326, 2024-04-19T03:01:38.096 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:01:38.096 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:38.096 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:01:38.096 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:01:38.096 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:38.096 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 1 2024-04-19T03:01:38.097 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.097 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:01:38.097 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.097 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:01:38.097 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:37.821337+0000", 2024-04-19T03:01:38.097 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:38.097 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.097 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.097 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:01:38.097 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:37.821337+0000", 2024-04-19T03:01:38.097 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:38.097 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.097 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.097 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:01:38.097 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:37.821334+0000", 2024-04-19T03:01:38.098 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999967 2024-04-19T03:01:38.098 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.098 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.098 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:01:38.098 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:37.821575+0000", 2024-04-19T03:01:38.098 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000240685 2024-04-19T03:01:38.098 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.098 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.098 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:01:38.098 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:37.821606+0000", 2024-04-19T03:01:38.098 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1279000000000003e-05 2024-04-19T03:01:38.098 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.098 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.099 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:01:38.099 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:37.821631+0000", 2024-04-19T03:01:38.099 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5173000000000001e-05 2024-04-19T03:01:38.099 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.099 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.099 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:38.099 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:37.821774+0000", 2024-04-19T03:01:38.099 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0001426 2024-04-19T03:01:38.099 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.099 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.099 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op must wait for map", 2024-04-19T03:01:38.099 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:37.821782+0000", 2024-04-19T03:01:38.099 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.8059999999999995e-06 2024-04-19T03:01:38.099 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.100 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.100 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:38.100 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:37.826115+0000", 2024-04-19T03:01:38.100 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0043334439999999997 2024-04-19T03:01:38.100 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.100 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.100 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:01:38.100 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:37.826351+0000", 2024-04-19T03:01:38.100 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00023643899999999999 2024-04-19T03:01:38.100 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.100 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.100 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:01:38.100 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:37.826610+0000", 2024-04-19T03:01:38.100 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00025838599999999999 2024-04-19T03:01:38.101 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.101 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.101 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:01:38.101 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:37.831516+0000", 2024-04-19T03:01:38.101 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0049057479999999997 2024-04-19T03:01:38.101 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.101 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.101 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:38.101 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:37.833046+0000", 2024-04-19T03:01:38.101 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001530879 2024-04-19T03:01:38.101 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.101 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.101 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:01:38.101 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:37.833123+0000", 2024-04-19T03:01:38.101 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.6948999999999998e-05 2024-04-19T03:01:38.102 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.102 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.102 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:01:38.102 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:37.833185+0000", 2024-04-19T03:01:38.102 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1284999999999993e-05 2024-04-19T03:01:38.102 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:38.102 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:01:38.102 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:38.102 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.102 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.102 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:7 5.d 5:bbb7dc2d:::benchmark_data_smithi096_19531_object6:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-19T03:01:38.102 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:37.821673+0000", 2024-04-19T03:01:38.102 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.215258223, 2024-04-19T03:01:38.102 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.012325292, 2024-04-19T03:01:38.103 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:01:38.103 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:38.103 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:01:38.103 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:01:38.103 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:38.103 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 7 2024-04-19T03:01:38.103 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.103 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:01:38.103 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.103 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:01:38.103 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:37.821673+0000", 2024-04-19T03:01:38.103 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:38.103 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.103 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.103 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:01:38.104 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:37.821673+0000", 2024-04-19T03:01:38.104 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:38.104 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.104 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.104 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:01:38.104 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:37.821672+0000", 2024-04-19T03:01:38.104 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:01:38.104 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.104 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.104 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:01:38.104 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:37.821848+0000", 2024-04-19T03:01:38.104 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000176124 2024-04-19T03:01:38.104 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.104 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.104 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:01:38.105 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:37.821869+0000", 2024-04-19T03:01:38.105 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1092000000000001e-05 2024-04-19T03:01:38.105 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.105 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.105 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:01:38.105 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:37.821889+0000", 2024-04-19T03:01:38.105 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9624e-05 2024-04-19T03:01:38.105 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.105 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.105 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:38.105 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:37.821959+0000", 2024-04-19T03:01:38.105 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.0213e-05 2024-04-19T03:01:38.105 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.105 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.105 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op must wait for map", 2024-04-19T03:01:38.106 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:37.821965+0000", 2024-04-19T03:01:38.106 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4250000000000003e-06 2024-04-19T03:01:38.106 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.106 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.106 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:38.106 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:37.825930+0000", 2024-04-19T03:01:38.106 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0039644329999999998 2024-04-19T03:01:38.106 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.106 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.106 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:01:38.106 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:37.826085+0000", 2024-04-19T03:01:38.106 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000155363 2024-04-19T03:01:38.106 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.106 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.107 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-04-19T03:01:38.107 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:37.826230+0000", 2024-04-19T03:01:38.107 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014456500000000001 2024-04-19T03:01:38.107 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.107 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.107 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:01:38.107 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:37.832945+0000", 2024-04-19T03:01:38.107 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0067155770000000004 2024-04-19T03:01:38.107 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.107 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.107 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:38.107 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:37.833942+0000", 2024-04-19T03:01:38.107 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00099707500000000004 2024-04-19T03:01:38.107 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.108 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.108 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:01:38.108 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:37.833975+0000", 2024-04-19T03:01:38.108 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2765000000000002e-05 2024-04-19T03:01:38.108 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.108 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.108 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:01:38.108 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:37.833999+0000", 2024-04-19T03:01:38.108 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3652999999999999e-05 2024-04-19T03:01:38.108 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:38.108 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:01:38.108 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:38.108 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.108 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.108 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:10 5.d 5:bcad0b2c:::benchmark_data_smithi096_19531_object9:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-19T03:01:38.109 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:37.821923+0000", 2024-04-19T03:01:38.109 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.21500893500000001, 2024-04-19T03:01:38.109 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.014433605, 2024-04-19T03:01:38.109 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:01:38.109 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:38.109 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:01:38.109 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:01:38.109 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:38.109 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 10 2024-04-19T03:01:38.109 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.109 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:01:38.109 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.109 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:01:38.109 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:37.821923+0000", 2024-04-19T03:01:38.110 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:38.110 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.110 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.110 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:01:38.110 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:37.821923+0000", 2024-04-19T03:01:38.110 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:38.110 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.110 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.110 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:01:38.110 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:37.821922+0000", 2024-04-19T03:01:38.110 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:01:38.110 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.110 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.110 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:01:38.111 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:37.822058+0000", 2024-04-19T03:01:38.111 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013657799999999999 2024-04-19T03:01:38.111 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.111 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.111 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:01:38.111 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:37.822102+0000", 2024-04-19T03:01:38.111 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4255999999999998e-05 2024-04-19T03:01:38.111 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.111 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.111 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:01:38.111 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:37.822118+0000", 2024-04-19T03:01:38.111 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5685999999999999e-05 2024-04-19T03:01:38.111 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.111 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.112 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:38.112 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:37.822198+0000", 2024-04-19T03:01:38.112 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0165000000000002e-05 2024-04-19T03:01:38.112 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.112 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.112 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:01:38.112 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:37.822204+0000", 2024-04-19T03:01:38.112 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4399999999999996e-06 2024-04-19T03:01:38.112 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.112 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.112 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:38.112 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:37.827330+0000", 2024-04-19T03:01:38.112 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0051261120000000004 2024-04-19T03:01:38.112 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.112 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.113 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:01:38.113 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:37.827630+0000", 2024-04-19T03:01:38.113 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00029984400000000001 2024-04-19T03:01:38.113 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.113 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.113 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-04-19T03:01:38.113 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:37.827982+0000", 2024-04-19T03:01:38.113 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00035224300000000002 2024-04-19T03:01:38.113 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.113 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.113 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:01:38.113 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:37.832967+0000", 2024-04-19T03:01:38.113 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0049855810000000002 2024-04-19T03:01:38.114 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.114 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.114 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:38.114 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:37.836261+0000", 2024-04-19T03:01:38.114 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.003293018 2024-04-19T03:01:38.114 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.114 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.114 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:01:38.114 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:37.836296+0000", 2024-04-19T03:01:38.114 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5769999999999998e-05 2024-04-19T03:01:38.114 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.114 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.114 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:01:38.115 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:37.836356+0000", 2024-04-19T03:01:38.115 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9914999999999998e-05 2024-04-19T03:01:38.115 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:38.115 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:01:38.115 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:38.115 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.115 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.115 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:11 5.8 5:1e8524a1:::benchmark_data_smithi096_19531_object10:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-19T03:01:38.115 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:37.822191+0000", 2024-04-19T03:01:38.115 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.214740343, 2024-04-19T03:01:38.115 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013059213, 2024-04-19T03:01:38.115 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:01:38.115 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:38.115 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:01:38.116 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:01:38.116 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:38.116 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 11 2024-04-19T03:01:38.116 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.116 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:01:38.116 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.116 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:01:38.116 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:37.822191+0000", 2024-04-19T03:01:38.116 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:38.116 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.116 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.116 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:01:38.116 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:37.822191+0000", 2024-04-19T03:01:38.116 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:38.117 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.117 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.117 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:01:38.117 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:37.822190+0000", 2024-04-19T03:01:38.117 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:01:38.117 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.117 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.117 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:01:38.117 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:37.822303+0000", 2024-04-19T03:01:38.117 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000113618 2024-04-19T03:01:38.117 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.117 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.117 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:01:38.117 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:37.822322+0000", 2024-04-19T03:01:38.118 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8669e-05 2024-04-19T03:01:38.118 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.118 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.118 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:01:38.118 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:37.822345+0000", 2024-04-19T03:01:38.118 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2764000000000001e-05 2024-04-19T03:01:38.118 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.118 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.118 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:38.118 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:37.822450+0000", 2024-04-19T03:01:38.118 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000105548 2024-04-19T03:01:38.118 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.118 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.118 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:01:38.119 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:37.822457+0000", 2024-04-19T03:01:38.119 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.8399999999999997e-06 2024-04-19T03:01:38.119 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.119 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.119 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:38.119 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:37.828139+0000", 2024-04-19T03:01:38.119 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.005682098 2024-04-19T03:01:38.119 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.119 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.119 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:01:38.119 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:37.828327+0000", 2024-04-19T03:01:38.119 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00018784800000000001 2024-04-19T03:01:38.119 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.119 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.120 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:01:38.120 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:37.828541+0000", 2024-04-19T03:01:38.120 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000214014 2024-04-19T03:01:38.120 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.120 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.120 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:01:38.120 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:37.831544+0000", 2024-04-19T03:01:38.120 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.003002635 2024-04-19T03:01:38.120 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.120 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.120 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:38.120 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:37.835196+0000", 2024-04-19T03:01:38.120 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0036520939999999998 2024-04-19T03:01:38.120 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.121 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.121 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:01:38.121 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:37.835228+0000", 2024-04-19T03:01:38.121 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2385000000000002e-05 2024-04-19T03:01:38.121 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.121 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.121 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:01:38.121 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:37.835250+0000", 2024-04-19T03:01:38.121 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2096999999999999e-05 2024-04-19T03:01:38.121 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:38.121 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:01:38.121 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:38.121 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.121 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.122 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:14 5.4 5:27cfffc1:::benchmark_data_smithi096_19531_object13:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-19T03:01:38.122 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:37.822381+0000", 2024-04-19T03:01:38.122 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.21455099699999999, 2024-04-19T03:01:38.122 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0094642979999999995, 2024-04-19T03:01:38.122 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:01:38.122 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:38.122 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:01:38.122 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:01:38.122 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:38.122 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 14 2024-04-19T03:01:38.122 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.122 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:01:38.122 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.122 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:01:38.123 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:37.822381+0000", 2024-04-19T03:01:38.123 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:38.123 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.123 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.123 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:01:38.123 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:37.822381+0000", 2024-04-19T03:01:38.123 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:38.123 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.123 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.123 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:01:38.123 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:37.822379+0000", 2024-04-19T03:01:38.123 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:01:38.123 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.123 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.124 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:01:38.124 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:37.822504+0000", 2024-04-19T03:01:38.124 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000124201 2024-04-19T03:01:38.124 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.124 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.124 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:01:38.124 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:37.822520+0000", 2024-04-19T03:01:38.124 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5892999999999998e-05 2024-04-19T03:01:38.124 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.124 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.124 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:01:38.124 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:37.822534+0000", 2024-04-19T03:01:38.124 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4763000000000001e-05 2024-04-19T03:01:38.124 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.125 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.125 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:38.125 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:37.822653+0000", 2024-04-19T03:01:38.125 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011856100000000001 2024-04-19T03:01:38.125 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.125 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.125 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op must wait for map", 2024-04-19T03:01:38.125 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:37.822664+0000", 2024-04-19T03:01:38.125 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1185999999999999e-05 2024-04-19T03:01:38.125 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.125 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.125 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:38.125 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:37.828115+0000", 2024-04-19T03:01:38.126 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0054509129999999999 2024-04-19T03:01:38.126 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.126 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.126 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:01:38.126 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:37.828311+0000", 2024-04-19T03:01:38.126 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00019577 2024-04-19T03:01:38.126 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.126 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.126 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:01:38.126 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:37.828490+0000", 2024-04-19T03:01:38.126 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000179106 2024-04-19T03:01:38.126 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.126 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.127 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:01:38.127 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:37.831569+0000", 2024-04-19T03:01:38.127 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0030792060000000001 2024-04-19T03:01:38.127 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.127 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.127 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:38.127 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:37.831783+0000", 2024-04-19T03:01:38.127 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00021446 2024-04-19T03:01:38.127 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.127 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.127 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:01:38.127 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:37.831820+0000", 2024-04-19T03:01:38.127 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6272000000000001e-05 2024-04-19T03:01:38.128 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.128 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.128 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:01:38.128 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:37.831845+0000", 2024-04-19T03:01:38.128 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5049999999999999e-05 2024-04-19T03:01:38.128 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:38.128 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:01:38.128 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:38.128 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.128 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.128 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:49 5.0 5:0caf2ef0:::benchmark_data_smithi096_19531_object48:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-19T03:01:38.128 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:37.845665+0000", 2024-04-19T03:01:38.128 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.19126700699999999, 2024-04-19T03:01:38.128 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0097340059999999999, 2024-04-19T03:01:38.129 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:01:38.129 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:38.129 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:01:38.129 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:01:38.129 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:38.129 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 49 2024-04-19T03:01:38.129 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.129 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:01:38.129 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.129 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:01:38.129 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:37.845665+0000", 2024-04-19T03:01:38.129 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:38.129 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.129 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.130 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:01:38.130 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:37.845665+0000", 2024-04-19T03:01:38.130 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:38.130 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.130 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.130 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:01:38.130 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:37.845663+0000", 2024-04-19T03:01:38.130 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:01:38.130 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.130 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.130 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:01:38.130 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:37.845720+0000", 2024-04-19T03:01:38.130 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6493999999999998e-05 2024-04-19T03:01:38.130 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.131 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.131 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:01:38.131 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:37.845731+0000", 2024-04-19T03:01:38.131 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1198e-05 2024-04-19T03:01:38.131 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.131 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.131 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:01:38.131 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:37.845739+0000", 2024-04-19T03:01:38.131 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.6499999999999996e-06 2024-04-19T03:01:38.131 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.131 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.131 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:38.131 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:37.845825+0000", 2024-04-19T03:01:38.131 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.6532000000000004e-05 2024-04-19T03:01:38.132 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.132 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.132 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:01:38.132 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:37.845963+0000", 2024-04-19T03:01:38.132 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013806699999999999 2024-04-19T03:01:38.132 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.132 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.132 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:01:38.132 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:37.846128+0000", 2024-04-19T03:01:38.132 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016452 2024-04-19T03:01:38.132 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.132 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.132 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:01:38.133 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:37.851598+0000", 2024-04-19T03:01:38.133 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0054704089999999999 2024-04-19T03:01:38.133 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.133 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.133 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:38.133 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:37.855303+0000", 2024-04-19T03:01:38.133 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0037050020000000002 2024-04-19T03:01:38.133 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.133 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.133 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:01:38.133 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:37.855359+0000", 2024-04-19T03:01:38.133 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5753e-05 2024-04-19T03:01:38.133 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.133 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.134 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:01:38.134 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:37.855399+0000", 2024-04-19T03:01:38.134 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9431000000000002e-05 2024-04-19T03:01:38.134 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:38.134 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:01:38.134 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:38.134 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.134 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.134 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:50 5.b 5:de506242:::benchmark_data_smithi096_19531_object49:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-19T03:01:38.134 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:37.846172+0000", 2024-04-19T03:01:38.134 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.190759435, 2024-04-19T03:01:38.134 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0092331050000000001, 2024-04-19T03:01:38.134 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:01:38.135 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:38.135 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:01:38.135 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:01:38.135 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:38.135 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 50 2024-04-19T03:01:38.135 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.135 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:01:38.135 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.135 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:01:38.135 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:37.846172+0000", 2024-04-19T03:01:38.135 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:38.135 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.135 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.135 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:01:38.135 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:37.846172+0000", 2024-04-19T03:01:38.136 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:38.136 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.136 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.136 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:01:38.136 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:37.846171+0000", 2024-04-19T03:01:38.136 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:01:38.136 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.136 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.136 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:01:38.136 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:37.846228+0000", 2024-04-19T03:01:38.136 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6483000000000001e-05 2024-04-19T03:01:38.136 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.136 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.136 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:01:38.137 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:37.846264+0000", 2024-04-19T03:01:38.137 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6362000000000002e-05 2024-04-19T03:01:38.137 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.137 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.137 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:01:38.137 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:37.846272+0000", 2024-04-19T03:01:38.137 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.7680000000000008e-06 2024-04-19T03:01:38.137 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.137 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.137 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:38.137 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:37.846362+0000", 2024-04-19T03:01:38.137 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.0081999999999996e-05 2024-04-19T03:01:38.137 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.137 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.138 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:01:38.138 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:37.846588+0000", 2024-04-19T03:01:38.138 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00022641 2024-04-19T03:01:38.138 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.138 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.138 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:01:38.138 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:37.846765+0000", 2024-04-19T03:01:38.138 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00017665199999999999 2024-04-19T03:01:38.138 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.138 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.138 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:01:38.138 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:37.851679+0000", 2024-04-19T03:01:38.138 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0049145009999999999 2024-04-19T03:01:38.138 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.139 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.139 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:38.139 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:37.855329+0000", 2024-04-19T03:01:38.139 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0036495080000000001 2024-04-19T03:01:38.139 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.139 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.139 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:01:38.139 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:37.855360+0000", 2024-04-19T03:01:38.139 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0857e-05 2024-04-19T03:01:38.139 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.139 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.139 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:01:38.139 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:37.855405+0000", 2024-04-19T03:01:38.140 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5473000000000003e-05 2024-04-19T03:01:38.140 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:38.140 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:01:38.140 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:38.140 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.140 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.140 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:52 5.b 5:d5eed1de:::benchmark_data_smithi096_19531_object51:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-19T03:01:38.140 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:37.846562+0000", 2024-04-19T03:01:38.140 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.19036977999999999, 2024-04-19T03:01:38.140 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0090955640000000004, 2024-04-19T03:01:38.140 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:01:38.140 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:38.140 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:01:38.140 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:01:38.141 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:38.141 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 52 2024-04-19T03:01:38.141 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.141 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:01:38.141 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.141 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:01:38.141 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:37.846562+0000", 2024-04-19T03:01:38.141 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:38.141 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.141 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.141 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:01:38.141 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:37.846562+0000", 2024-04-19T03:01:38.141 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:38.141 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.142 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.142 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:01:38.142 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:37.846561+0000", 2024-04-19T03:01:38.142 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:01:38.142 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.142 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.142 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:01:38.142 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:37.846654+0000", 2024-04-19T03:01:38.142 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.3364999999999998e-05 2024-04-19T03:01:38.142 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.142 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.142 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:01:38.142 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:37.846665+0000", 2024-04-19T03:01:38.143 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0105999999999999e-05 2024-04-19T03:01:38.143 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.143 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.143 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:01:38.143 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:37.846670+0000", 2024-04-19T03:01:38.143 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8159999999999999e-06 2024-04-19T03:01:38.143 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.143 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.143 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:38.143 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:37.847835+0000", 2024-04-19T03:01:38.143 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0011644190000000001 2024-04-19T03:01:38.143 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.143 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.143 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:01:38.144 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:37.848022+0000", 2024-04-19T03:01:38.144 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000186925 2024-04-19T03:01:38.144 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.144 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.144 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:01:38.144 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:37.848339+0000", 2024-04-19T03:01:38.144 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00031754299999999999 2024-04-19T03:01:38.144 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.144 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.144 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:01:38.144 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:37.851760+0000", 2024-04-19T03:01:38.144 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0034209980000000002 2024-04-19T03:01:38.144 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.144 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.145 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:38.145 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:37.855564+0000", 2024-04-19T03:01:38.145 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.003804067 2024-04-19T03:01:38.145 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.145 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.145 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:01:38.145 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:37.855617+0000", 2024-04-19T03:01:38.145 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2876e-05 2024-04-19T03:01:38.145 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.145 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.145 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:01:38.145 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:37.855657+0000", 2024-04-19T03:01:38.145 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.0098000000000001e-05 2024-04-19T03:01:38.145 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:38.146 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:01:38.146 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:38.146 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.146 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.146 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:236 5.b 5:d6684ced:::benchmark_data_smithi096_19531_object235:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-19T03:01:38.146 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:37.908634+0000", 2024-04-19T03:01:38.146 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.12829765700000001, 2024-04-19T03:01:38.146 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0085862119999999993, 2024-04-19T03:01:38.146 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:01:38.146 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:38.146 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:01:38.146 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:01:38.146 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:38.146 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 236 2024-04-19T03:01:38.147 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.147 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:01:38.147 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.147 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:01:38.147 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:37.908634+0000", 2024-04-19T03:01:38.147 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:38.147 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.147 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.147 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:01:38.147 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:37.908634+0000", 2024-04-19T03:01:38.147 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:38.147 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.147 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.147 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:01:38.148 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:37.908633+0000", 2024-04-19T03:01:38.148 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:01:38.148 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.148 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.148 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:01:38.148 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:37.908712+0000", 2024-04-19T03:01:38.148 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.8986999999999994e-05 2024-04-19T03:01:38.148 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.148 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.148 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:01:38.148 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:37.908724+0000", 2024-04-19T03:01:38.148 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.254e-05 2024-04-19T03:01:38.148 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.148 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.149 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:01:38.149 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:37.908748+0000", 2024-04-19T03:01:38.149 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3943000000000001e-05 2024-04-19T03:01:38.149 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.149 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.149 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:38.149 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:37.909919+0000", 2024-04-19T03:01:38.149 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0011711429999999999 2024-04-19T03:01:38.149 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.149 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.149 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:01:38.149 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:37.910094+0000", 2024-04-19T03:01:38.149 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00017486100000000001 2024-04-19T03:01:38.149 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.150 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.150 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:01:38.150 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:37.910302+0000", 2024-04-19T03:01:38.150 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00020819299999999999 2024-04-19T03:01:38.150 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.150 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.150 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:01:38.150 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:37.911982+0000", 2024-04-19T03:01:38.150 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00167969 2024-04-19T03:01:38.150 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.150 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.150 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:38.150 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:37.917139+0000", 2024-04-19T03:01:38.151 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0051569169999999996 2024-04-19T03:01:38.151 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.151 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.151 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:01:38.151 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:37.917185+0000", 2024-04-19T03:01:38.151 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6066000000000002e-05 2024-04-19T03:01:38.151 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.151 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.151 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:01:38.151 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:37.917220+0000", 2024-04-19T03:01:38.151 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4984999999999998e-05 2024-04-19T03:01:38.151 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:38.151 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:01:38.152 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:38.152 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.152 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.152 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:291 5.e 5:76152a97:::benchmark_data_smithi096_19531_object290:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-19T03:01:38.152 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:37.928764+0000", 2024-04-19T03:01:38.152 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.10816758899999999, 2024-04-19T03:01:38.152 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0096736789999999993, 2024-04-19T03:01:38.152 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:01:38.152 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:38.152 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:01:38.152 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:01:38.152 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:38.152 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 291 2024-04-19T03:01:38.152 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.153 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:01:38.153 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.153 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:01:38.153 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:37.928764+0000", 2024-04-19T03:01:38.153 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:38.153 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.153 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.153 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:01:38.153 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:37.928764+0000", 2024-04-19T03:01:38.153 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:38.153 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.153 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.153 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:01:38.153 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:37.928763+0000", 2024-04-19T03:01:38.153 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:01:38.154 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.154 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.154 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:01:38.154 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:37.928800+0000", 2024-04-19T03:01:38.154 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6415999999999998e-05 2024-04-19T03:01:38.154 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.154 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.154 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:01:38.154 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:37.928807+0000", 2024-04-19T03:01:38.154 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.1219999999999997e-06 2024-04-19T03:01:38.154 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.154 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.154 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:01:38.155 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:37.928812+0000", 2024-04-19T03:01:38.155 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5799999999999999e-06 2024-04-19T03:01:38.155 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.155 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.155 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:38.155 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:37.931645+0000", 2024-04-19T03:01:38.155 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0028325809999999998 2024-04-19T03:01:38.155 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.155 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.155 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:01:38.155 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:37.931829+0000", 2024-04-19T03:01:38.155 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00018394 2024-04-19T03:01:38.155 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.155 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.156 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:01:38.156 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:37.932003+0000", 2024-04-19T03:01:38.156 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00017431099999999999 2024-04-19T03:01:38.156 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.156 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.156 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:38.156 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:37.935219+0000", 2024-04-19T03:01:38.156 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.003216006 2024-04-19T03:01:38.156 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.156 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.156 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:01:38.156 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:37.938186+0000", 2024-04-19T03:01:38.156 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00296722 2024-04-19T03:01:38.156 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.157 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.157 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:01:38.157 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:37.938402+0000", 2024-04-19T03:01:38.157 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00021558600000000001 2024-04-19T03:01:38.157 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.157 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.157 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:01:38.157 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:37.938438+0000", 2024-04-19T03:01:38.157 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5525000000000003e-05 2024-04-19T03:01:38.157 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:38.157 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:01:38.157 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:38.157 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.157 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.158 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:492 5.b 5:d6120df8:::benchmark_data_smithi096_19531_object491:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-19T03:01:38.158 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:38.008956+0000", 2024-04-19T03:01:38.158 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.027975605000000001, 2024-04-19T03:01:38.158 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0088558089999999992, 2024-04-19T03:01:38.158 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:01:38.158 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:38.158 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:01:38.158 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:01:38.158 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:38.158 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 492 2024-04-19T03:01:38.158 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.158 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:01:38.158 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.158 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:01:38.159 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:38.008956+0000", 2024-04-19T03:01:38.159 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:38.159 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.159 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.159 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:01:38.159 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:38.008956+0000", 2024-04-19T03:01:38.159 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:38.159 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.159 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.159 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:01:38.159 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:38.008955+0000", 2024-04-19T03:01:38.159 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:01:38.159 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.159 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.160 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:01:38.160 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:38.009027+0000", 2024-04-19T03:01:38.160 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2162000000000005e-05 2024-04-19T03:01:38.160 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.160 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.160 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:01:38.160 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:38.009034+0000", 2024-04-19T03:01:38.160 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4019999999999999e-06 2024-04-19T03:01:38.160 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.160 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.160 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:01:38.160 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:38.009038+0000", 2024-04-19T03:01:38.160 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2100000000000003e-06 2024-04-19T03:01:38.160 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.161 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.161 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:38.161 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:38.010667+0000", 2024-04-19T03:01:38.161 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0016287929999999999 2024-04-19T03:01:38.161 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.161 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.161 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:01:38.161 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:38.010898+0000", 2024-04-19T03:01:38.161 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000231122 2024-04-19T03:01:38.161 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.161 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.161 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:01:38.161 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:38.011116+0000", 2024-04-19T03:01:38.161 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000218493 2024-04-19T03:01:38.162 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.162 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.162 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:38.162 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:38.015136+0000", 2024-04-19T03:01:38.162 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0040202579999999996 2024-04-19T03:01:38.162 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.162 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.162 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:01:38.162 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:38.017721+0000", 2024-04-19T03:01:38.162 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0025844750000000001 2024-04-19T03:01:38.162 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.162 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.162 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:01:38.162 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:38.017769+0000", 2024-04-19T03:01:38.163 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7834000000000003e-05 2024-04-19T03:01:38.163 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:38.163 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:38.163 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:01:38.163 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:38.017812+0000", 2024-04-19T03:01:38.163 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3007999999999999e-05 2024-04-19T03:01:38.163 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:38.163 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:01:38.163 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:38.163 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:38.163 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:01:38.163 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-19T03:01:38.165 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T03:01:38.165 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-04-19T03:01:38.161+0000 7f35986ab700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18243) UID: 0 2024-04-19T03:01:38.265 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:01:38.261+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:01:38.293 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-04-19T03:01:38.293 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [ 2024-04-19T03:01:38.293 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.293 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:1259 5.9 5:9333723d:::benchmark_data_smithi096_19531_object1258:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-19T03:01:38.293 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:01:38.290700+0000", 2024-04-19T03:01:38.293 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.00053546500000000005, 2024-04-19T03:01:38.294 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00056268400000000004, 2024-04-19T03:01:38.294 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:01:38.294 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:01:38.294 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:01:38.294 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:01:38.294 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:38.294 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 1259 2024-04-19T03:01:38.294 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.294 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:01:38.294 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.294 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:01:38.294 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:38.290700+0000", 2024-04-19T03:01:38.294 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:38.295 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.295 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.295 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:01:38.295 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:38.290700+0000", 2024-04-19T03:01:38.295 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:38.295 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.295 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.295 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:01:38.295 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:38.290699+0000", 2024-04-19T03:01:38.295 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:01:38.295 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.295 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.295 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:01:38.296 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:38.290755+0000", 2024-04-19T03:01:38.296 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5989000000000002e-05 2024-04-19T03:01:38.296 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.296 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.296 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:01:38.296 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:38.290762+0000", 2024-04-19T03:01:38.296 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.781e-06 2024-04-19T03:01:38.296 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.296 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.296 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:01:38.296 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:38.290795+0000", 2024-04-19T03:01:38.296 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3667000000000001e-05 2024-04-19T03:01:38.296 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.296 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.297 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:01:38.297 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:38.290848+0000", 2024-04-19T03:01:38.297 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2518000000000001e-05 2024-04-19T03:01:38.297 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.297 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.297 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:01:38.297 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:38.291001+0000", 2024-04-19T03:01:38.297 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00015313600000000001 2024-04-19T03:01:38.297 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.297 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.297 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:01:38.297 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:38.291174+0000", 2024-04-19T03:01:38.297 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00017327900000000001 2024-04-19T03:01:38.297 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:38.298 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:01:38.298 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:38.298 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.298 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.298 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:1260 5.9 5.16446f49 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-19T03:01:38.298 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:01:38.290805+0000", 2024-04-19T03:01:38.298 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.000429694, 2024-04-19T03:01:38.298 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00053402600000000005, 2024-04-19T03:01:38.298 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:01:38.298 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-04-19T03:01:38.298 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:01:38.298 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:01:38.298 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:38.299 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 1260 2024-04-19T03:01:38.299 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.299 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:01:38.299 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.299 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:01:38.299 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:38.290805+0000", 2024-04-19T03:01:38.299 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:38.299 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.299 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.299 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:01:38.299 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:38.290805+0000", 2024-04-19T03:01:38.299 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:38.299 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.299 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.300 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:01:38.300 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:38.290805+0000", 2024-04-19T03:01:38.300 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:01:38.300 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.300 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.300 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:01:38.300 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:38.290839+0000", 2024-04-19T03:01:38.300 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4489000000000001e-05 2024-04-19T03:01:38.300 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.300 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.300 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:01:38.300 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:38.290846+0000", 2024-04-19T03:01:38.300 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0119999999999999e-06 2024-04-19T03:01:38.301 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.301 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.301 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:01:38.301 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:38.290852+0000", 2024-04-19T03:01:38.301 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9209999999999997e-06 2024-04-19T03:01:38.301 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:38.301 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:01:38.301 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:38.301 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.301 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.301 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:1242 5.9 5:9ae7846e:::benchmark_data_smithi096_19531_object1241:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-19T03:01:38.301 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:01:38.285845+0000", 2024-04-19T03:01:38.301 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0053896700000000001, 2024-04-19T03:01:38.301 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0055488170000000002, 2024-04-19T03:01:38.302 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:01:38.302 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:01:38.302 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:01:38.302 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:01:38.302 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:38.302 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 1242 2024-04-19T03:01:38.302 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.302 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:01:38.302 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.302 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:01:38.302 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:38.285845+0000", 2024-04-19T03:01:38.302 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:38.302 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.303 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.303 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:01:38.303 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:38.285845+0000", 2024-04-19T03:01:38.303 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:38.303 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.303 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.303 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:01:38.303 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:38.285845+0000", 2024-04-19T03:01:38.303 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:01:38.303 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.303 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.303 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:01:38.303 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:38.285925+0000", 2024-04-19T03:01:38.303 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0345000000000004e-05 2024-04-19T03:01:38.304 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.304 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.304 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:01:38.304 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:38.285935+0000", 2024-04-19T03:01:38.304 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.662e-06 2024-04-19T03:01:38.304 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.304 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.304 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:01:38.304 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:38.285942+0000", 2024-04-19T03:01:38.304 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.9380000000000003e-06 2024-04-19T03:01:38.304 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.304 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.304 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:01:38.304 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:38.286002+0000", 2024-04-19T03:01:38.305 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0231e-05 2024-04-19T03:01:38.305 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.305 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.305 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:01:38.305 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:38.286194+0000", 2024-04-19T03:01:38.305 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000191998 2024-04-19T03:01:38.305 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.305 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.305 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:01:38.305 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:38.286385+0000", 2024-04-19T03:01:38.305 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000190843 2024-04-19T03:01:38.305 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.305 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.305 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:01:38.306 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:38.289774+0000", 2024-04-19T03:01:38.306 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0033892919999999999 2024-04-19T03:01:38.306 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:38.306 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:01:38.306 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:38.306 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.306 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.306 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:1251 5.f 5:fc4634c3:::benchmark_data_smithi096_19531_object1250:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-19T03:01:38.306 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:01:38.287570+0000", 2024-04-19T03:01:38.306 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0036646859999999999, 2024-04-19T03:01:38.306 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0038977619999999999, 2024-04-19T03:01:38.306 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:01:38.306 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:01:38.307 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:01:38.307 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:01:38.307 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:38.307 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 1251 2024-04-19T03:01:38.307 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.307 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:01:38.307 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.307 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:01:38.307 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:38.287570+0000", 2024-04-19T03:01:38.307 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:38.307 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.307 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.307 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:01:38.307 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:38.287570+0000", 2024-04-19T03:01:38.308 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:38.308 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.308 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.308 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:01:38.308 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:38.287570+0000", 2024-04-19T03:01:38.308 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:01:38.308 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.308 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.308 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:01:38.308 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:38.287648+0000", 2024-04-19T03:01:38.308 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8925999999999996e-05 2024-04-19T03:01:38.308 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.308 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.309 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:01:38.309 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:38.287663+0000", 2024-04-19T03:01:38.309 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4336e-05 2024-04-19T03:01:38.309 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.309 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.309 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:01:38.309 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:38.287671+0000", 2024-04-19T03:01:38.309 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0139999999999998e-06 2024-04-19T03:01:38.309 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.309 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.309 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:01:38.309 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:38.287769+0000", 2024-04-19T03:01:38.309 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.7931999999999997e-05 2024-04-19T03:01:38.309 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.309 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.310 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:01:38.310 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:38.287951+0000", 2024-04-19T03:01:38.310 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00018196 2024-04-19T03:01:38.310 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.310 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.310 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:01:38.310 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:38.288091+0000", 2024-04-19T03:01:38.310 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000139961 2024-04-19T03:01:38.310 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.310 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.310 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:01:38.310 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:38.289673+0000", 2024-04-19T03:01:38.311 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001582328 2024-04-19T03:01:38.311 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:38.311 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:01:38.311 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:38.311 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.311 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.311 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:1253 5.9 5:98af81a8:::benchmark_data_smithi096_19531_object1252:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-19T03:01:38.311 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:01:38.288049+0000", 2024-04-19T03:01:38.311 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0031862069999999999, 2024-04-19T03:01:38.311 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.003492677, 2024-04-19T03:01:38.311 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:01:38.311 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:01:38.311 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:01:38.311 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:01:38.312 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:38.312 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 1253 2024-04-19T03:01:38.312 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.312 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:01:38.312 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.312 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:01:38.312 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:38.288049+0000", 2024-04-19T03:01:38.312 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:38.312 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.312 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.312 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:01:38.312 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:38.288049+0000", 2024-04-19T03:01:38.312 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:38.312 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.313 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.313 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:01:38.313 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:38.288048+0000", 2024-04-19T03:01:38.313 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:01:38.313 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.313 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.313 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:01:38.313 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:38.288170+0000", 2024-04-19T03:01:38.313 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000121988 2024-04-19T03:01:38.313 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.313 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.313 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:01:38.313 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:38.288180+0000", 2024-04-19T03:01:38.313 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0485999999999999e-05 2024-04-19T03:01:38.314 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.314 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.314 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:01:38.314 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:38.288187+0000", 2024-04-19T03:01:38.314 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5590000000000002e-06 2024-04-19T03:01:38.314 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.314 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.314 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:01:38.314 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:38.288685+0000", 2024-04-19T03:01:38.314 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00049792800000000002 2024-04-19T03:01:38.314 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.314 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.314 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:01:38.315 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:38.288904+0000", 2024-04-19T03:01:38.315 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000219027 2024-04-19T03:01:38.315 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.315 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.315 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:01:38.315 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:38.288974+0000", 2024-04-19T03:01:38.315 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0073999999999993e-05 2024-04-19T03:01:38.315 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.315 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.315 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:01:38.315 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:38.290414+0000", 2024-04-19T03:01:38.315 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0014400459999999999 2024-04-19T03:01:38.315 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:38.315 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:01:38.316 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:38.316 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.316 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.316 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:1255 5.7 5:e6ce68c3:::benchmark_data_smithi096_19531_object1254:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-19T03:01:38.316 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:01:38.289257+0000", 2024-04-19T03:01:38.316 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.001978048, 2024-04-19T03:01:38.316 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.002324399, 2024-04-19T03:01:38.316 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:01:38.316 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:01:38.316 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:01:38.316 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:01:38.316 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:38.316 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 1255 2024-04-19T03:01:38.316 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.317 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:01:38.317 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.317 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:01:38.317 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:38.289257+0000", 2024-04-19T03:01:38.317 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:38.317 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.317 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.317 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:01:38.317 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:38.289257+0000", 2024-04-19T03:01:38.317 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:38.317 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.317 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.317 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:01:38.318 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:38.289256+0000", 2024-04-19T03:01:38.318 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:01:38.318 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.318 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.318 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:01:38.318 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:38.289356+0000", 2024-04-19T03:01:38.318 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.9751000000000001e-05 2024-04-19T03:01:38.318 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.318 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.318 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:01:38.318 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:38.289372+0000", 2024-04-19T03:01:38.318 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6242000000000001e-05 2024-04-19T03:01:38.318 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.318 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.319 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:01:38.319 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:38.289378+0000", 2024-04-19T03:01:38.319 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4439999999999996e-06 2024-04-19T03:01:38.319 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.319 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.319 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:01:38.319 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:38.289413+0000", 2024-04-19T03:01:38.319 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4066000000000002e-05 2024-04-19T03:01:38.319 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.319 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.319 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:01:38.319 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:38.289494+0000", 2024-04-19T03:01:38.319 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.1892999999999997e-05 2024-04-19T03:01:38.320 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.320 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.320 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-04-19T03:01:38.320 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:38.289613+0000", 2024-04-19T03:01:38.320 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000118818 2024-04-19T03:01:38.320 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.320 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.320 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:01:38.320 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:38.290807+0000", 2024-04-19T03:01:38.320 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001193883 2024-04-19T03:01:38.320 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:38.320 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:01:38.320 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:38.320 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.321 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.321 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:1256 5.1 5:8d8b4adc:::benchmark_data_smithi096_19531_object1255:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-19T03:01:38.321 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:01:38.290403+0000", 2024-04-19T03:01:38.321 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.00083224899999999997, 2024-04-19T03:01:38.321 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001247172, 2024-04-19T03:01:38.321 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:01:38.321 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:01:38.321 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:01:38.321 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:01:38.321 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:38.321 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 1256 2024-04-19T03:01:38.321 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.321 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:01:38.321 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.322 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:01:38.322 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:38.290403+0000", 2024-04-19T03:01:38.322 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:38.322 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.322 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.322 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:01:38.322 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:38.290403+0000", 2024-04-19T03:01:38.322 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:38.322 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.322 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.322 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:01:38.322 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:38.290402+0000", 2024-04-19T03:01:38.322 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:01:38.323 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.323 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.323 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:01:38.323 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:38.290461+0000", 2024-04-19T03:01:38.323 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8870999999999999e-05 2024-04-19T03:01:38.323 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.323 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.323 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:01:38.323 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:38.290476+0000", 2024-04-19T03:01:38.323 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.5835999999999999e-05 2024-04-19T03:01:38.323 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.323 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.323 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:01:38.323 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:38.290501+0000", 2024-04-19T03:01:38.324 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.4456000000000001e-05 2024-04-19T03:01:38.324 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.324 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.324 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:01:38.324 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:38.290541+0000", 2024-04-19T03:01:38.324 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9745e-05 2024-04-19T03:01:38.324 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.324 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.324 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:01:38.324 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:38.290663+0000", 2024-04-19T03:01:38.324 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00012280599999999999 2024-04-19T03:01:38.324 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.324 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.324 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-04-19T03:01:38.325 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:38.290824+0000", 2024-04-19T03:01:38.325 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00016031800000000001 2024-04-19T03:01:38.325 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:38.325 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:01:38.325 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:38.325 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:38.325 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-04-19T03:01:38.325 INFO:teuthology.orchestra.run.smithi144.stdout: "num_ops": 7 2024-04-19T03:01:38.325 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-04-19T03:01:38.326 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T03:01:38.366 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:01:38.361+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:01:38.458 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-04-19T03:01:38.458 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2024-04-19T03:01:38.458 INFO:teuthology.orchestra.run.smithi144.stdout: "complaint_time": 30, 2024-04-19T03:01:38.458 INFO:teuthology.orchestra.run.smithi144.stdout: "num_blocked_ops": 0 2024-04-19T03:01:38.458 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-04-19T03:01:38.466 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:01:38.464+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:01:38.470 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T03:01:38.567 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:01:38.565+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:01:38.643 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-04-19T03:01:38.643 INFO:teuthology.orchestra.run.smithi144.stdout: "size": 20, 2024-04-19T03:01:38.643 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 600, 2024-04-19T03:01:38.643 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [ 2024-04-19T03:01:38.643 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.643 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4159.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-19T03:01:38.643 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:01:07.935136+0000", 2024-04-19T03:01:38.643 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 30.703174400999998, 2024-04-19T03:01:38.643 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.020235135000000001, 2024-04-19T03:01:38.643 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:01:38.643 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:38.644 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:01:38.644 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4159", 2024-04-19T03:01:38.644 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3589238956", 2024-04-19T03:01:38.644 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 115 2024-04-19T03:01:38.644 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.644 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:01:38.644 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.644 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:01:38.644 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:07.935136+0000", 2024-04-19T03:01:38.644 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:38.644 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.644 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.644 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:01:38.644 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:07.935136+0000", 2024-04-19T03:01:38.645 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:38.645 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.645 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.645 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:01:38.645 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:07.935134+0000", 2024-04-19T03:01:38.645 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999981 2024-04-19T03:01:38.645 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.645 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.645 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:01:38.645 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:07.935339+0000", 2024-04-19T03:01:38.645 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000204694 2024-04-19T03:01:38.645 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.645 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.645 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:01:38.646 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:07.935363+0000", 2024-04-19T03:01:38.646 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.4006e-05 2024-04-19T03:01:38.646 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.646 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.646 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:01:38.646 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:07.935378+0000", 2024-04-19T03:01:38.646 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.56e-05 2024-04-19T03:01:38.646 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.646 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.646 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:01:38.646 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:07.949002+0000", 2024-04-19T03:01:38.646 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.013623464 2024-04-19T03:01:38.646 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.647 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.647 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:01:38.647 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:07.949147+0000", 2024-04-19T03:01:38.647 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00014565199999999999 2024-04-19T03:01:38.647 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.647 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.647 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:01:38.647 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:07.949356+0000", 2024-04-19T03:01:38.647 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000208626 2024-04-19T03:01:38.647 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.647 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.647 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:01:38.647 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:07.951254+0000", 2024-04-19T03:01:38.647 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001898081 2024-04-19T03:01:38.647 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.648 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.648 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:38.648 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:07.955276+0000", 2024-04-19T03:01:38.648 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0040218279999999999 2024-04-19T03:01:38.648 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.648 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.648 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:01:38.648 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:07.955315+0000", 2024-04-19T03:01:38.648 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9063999999999997e-05 2024-04-19T03:01:38.648 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.648 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.648 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:01:38.648 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:07.955371+0000", 2024-04-19T03:01:38.648 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5899999999999997e-05 2024-04-19T03:01:38.648 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:38.649 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:01:38.649 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:38.649 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.649 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.649 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4159.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-19T03:01:38.649 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:01:07.935397+0000", 2024-04-19T03:01:38.649 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 30.702912870999999, 2024-04-19T03:01:38.649 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.020241816999999999, 2024-04-19T03:01:38.649 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:01:38.649 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:38.649 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:01:38.649 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4159", 2024-04-19T03:01:38.649 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3589238956", 2024-04-19T03:01:38.649 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 116 2024-04-19T03:01:38.650 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.650 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:01:38.650 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.650 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:01:38.650 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:07.935397+0000", 2024-04-19T03:01:38.650 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:38.650 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.650 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.650 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:01:38.650 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:07.935397+0000", 2024-04-19T03:01:38.650 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:38.650 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.650 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.651 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:01:38.651 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:07.935396+0000", 2024-04-19T03:01:38.651 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999986 2024-04-19T03:01:38.651 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.651 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.651 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:01:38.651 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:07.935407+0000", 2024-04-19T03:01:38.651 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0842999999999999e-05 2024-04-19T03:01:38.651 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.651 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.651 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:01:38.651 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:07.935424+0000", 2024-04-19T03:01:38.651 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7193e-05 2024-04-19T03:01:38.651 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.652 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.652 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:01:38.652 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:07.935440+0000", 2024-04-19T03:01:38.652 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.626e-05 2024-04-19T03:01:38.652 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.652 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.652 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:01:38.652 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:07.950487+0000", 2024-04-19T03:01:38.652 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.015046992 2024-04-19T03:01:38.652 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.652 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.652 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:01:38.652 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:07.950602+0000", 2024-04-19T03:01:38.652 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000115048 2024-04-19T03:01:38.652 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.653 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.653 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:01:38.653 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:07.950693+0000", 2024-04-19T03:01:38.653 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.1364000000000001e-05 2024-04-19T03:01:38.653 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.653 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.653 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:01:38.653 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:07.951956+0000", 2024-04-19T03:01:38.653 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001262832 2024-04-19T03:01:38.653 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.653 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.653 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:38.653 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:07.955473+0000", 2024-04-19T03:01:38.653 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0035168209999999998 2024-04-19T03:01:38.654 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.654 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.654 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:01:38.654 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:07.955570+0000", 2024-04-19T03:01:38.654 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.7175000000000004e-05 2024-04-19T03:01:38.654 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.654 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.654 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:01:38.654 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:07.955639+0000", 2024-04-19T03:01:38.654 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8699000000000001e-05 2024-04-19T03:01:38.654 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:38.654 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:01:38.654 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:38.654 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.655 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.655 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4159.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-19T03:01:38.655 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:01:07.935454+0000", 2024-04-19T03:01:38.655 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 30.702856188999998, 2024-04-19T03:01:38.655 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.020337788999999998, 2024-04-19T03:01:38.655 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:01:38.655 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:38.655 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:01:38.655 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4159", 2024-04-19T03:01:38.655 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3589238956", 2024-04-19T03:01:38.655 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 117 2024-04-19T03:01:38.655 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.657 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:01:38.657 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.657 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:01:38.657 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:07.935454+0000", 2024-04-19T03:01:38.657 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:38.658 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.658 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.658 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:01:38.658 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:07.935454+0000", 2024-04-19T03:01:38.658 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:38.658 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.658 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.658 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:01:38.658 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:07.935453+0000", 2024-04-19T03:01:38.658 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:01:38.658 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.658 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.658 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:01:38.658 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:07.935464+0000", 2024-04-19T03:01:38.659 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1409999999999999e-05 2024-04-19T03:01:38.659 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.659 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.659 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:01:38.659 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:07.935485+0000", 2024-04-19T03:01:38.659 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0380000000000001e-05 2024-04-19T03:01:38.659 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.659 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.659 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:01:38.659 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:07.935501+0000", 2024-04-19T03:01:38.659 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6419999999999999e-05 2024-04-19T03:01:38.659 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.659 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.659 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:01:38.660 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:07.951288+0000", 2024-04-19T03:01:38.660 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.015786969000000001 2024-04-19T03:01:38.660 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.660 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.660 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:01:38.660 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:07.951404+0000", 2024-04-19T03:01:38.660 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000115977 2024-04-19T03:01:38.660 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.660 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.660 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:01:38.660 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:07.951629+0000", 2024-04-19T03:01:38.660 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000224634 2024-04-19T03:01:38.660 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.660 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.661 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:01:38.661 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:07.952689+0000", 2024-04-19T03:01:38.661 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001060374 2024-04-19T03:01:38.661 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.661 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.661 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:38.661 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:07.955706+0000", 2024-04-19T03:01:38.661 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0030169149999999998 2024-04-19T03:01:38.661 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.661 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.661 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:01:38.661 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:07.955741+0000", 2024-04-19T03:01:38.661 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5160999999999998e-05 2024-04-19T03:01:38.661 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.662 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.662 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:01:38.662 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:07.955792+0000", 2024-04-19T03:01:38.662 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0609000000000003e-05 2024-04-19T03:01:38.662 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:38.662 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:01:38.662 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:38.662 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.662 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.662 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4159.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-19T03:01:38.662 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:01:08.150835+0000", 2024-04-19T03:01:38.662 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 30.487474622000001, 2024-04-19T03:01:38.662 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.020342419, 2024-04-19T03:01:38.662 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:01:38.663 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:38.663 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:01:38.663 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4159", 2024-04-19T03:01:38.663 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3589238956", 2024-04-19T03:01:38.663 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 139 2024-04-19T03:01:38.663 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.663 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:01:38.663 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.663 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:01:38.663 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.150835+0000", 2024-04-19T03:01:38.663 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:38.663 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.663 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.663 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:01:38.664 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.150835+0000", 2024-04-19T03:01:38.664 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:38.664 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.664 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.664 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:01:38.664 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.150834+0000", 2024-04-19T03:01:38.664 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:01:38.664 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.664 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.664 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:01:38.664 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.150844+0000", 2024-04-19T03:01:38.664 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.927e-06 2024-04-19T03:01:38.664 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.664 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.664 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:01:38.665 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.150866+0000", 2024-04-19T03:01:38.665 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.211e-05 2024-04-19T03:01:38.665 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.665 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.665 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:01:38.665 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.150899+0000", 2024-04-19T03:01:38.665 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2452e-05 2024-04-19T03:01:38.665 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.665 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.665 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:01:38.665 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.167067+0000", 2024-04-19T03:01:38.665 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.016167737000000001 2024-04-19T03:01:38.665 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.666 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.666 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:01:38.666 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.167210+0000", 2024-04-19T03:01:38.666 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00014319300000000001 2024-04-19T03:01:38.666 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.666 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.666 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:01:38.666 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.167389+0000", 2024-04-19T03:01:38.666 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000179075 2024-04-19T03:01:38.666 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.666 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.666 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:01:38.666 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.170083+0000", 2024-04-19T03:01:38.667 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.002694307 2024-04-19T03:01:38.667 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.667 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.667 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:38.667 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.171088+0000", 2024-04-19T03:01:38.667 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001004429 2024-04-19T03:01:38.667 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.667 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.667 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:01:38.667 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.171147+0000", 2024-04-19T03:01:38.667 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9197999999999998e-05 2024-04-19T03:01:38.667 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.667 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.667 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:01:38.668 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.171178+0000", 2024-04-19T03:01:38.668 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.1137999999999999e-05 2024-04-19T03:01:38.668 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:38.668 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:01:38.668 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:38.668 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.668 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.668 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4159.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-19T03:01:38.668 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:01:08.150915+0000", 2024-04-19T03:01:38.668 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 30.487394945999998, 2024-04-19T03:01:38.668 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.020502679999999999, 2024-04-19T03:01:38.668 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:01:38.668 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:38.668 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:01:38.669 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4159", 2024-04-19T03:01:38.669 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3589238956", 2024-04-19T03:01:38.669 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 140 2024-04-19T03:01:38.669 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.669 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:01:38.669 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.669 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:01:38.669 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.150915+0000", 2024-04-19T03:01:38.669 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:38.669 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.669 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.669 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:01:38.669 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.150915+0000", 2024-04-19T03:01:38.669 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:38.670 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.670 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.670 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:01:38.670 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.150914+0000", 2024-04-19T03:01:38.670 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999986 2024-04-19T03:01:38.670 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.670 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.670 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:01:38.670 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.151066+0000", 2024-04-19T03:01:38.670 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00015186400000000001 2024-04-19T03:01:38.670 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.670 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.671 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:01:38.671 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.151120+0000", 2024-04-19T03:01:38.671 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4042999999999997e-05 2024-04-19T03:01:38.671 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.671 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.671 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:01:38.671 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.151155+0000", 2024-04-19T03:01:38.671 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4941999999999999e-05 2024-04-19T03:01:38.671 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.671 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.671 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:01:38.671 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.168222+0000", 2024-04-19T03:01:38.671 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.017066939999999999 2024-04-19T03:01:38.671 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.671 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.672 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:01:38.672 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.168305+0000", 2024-04-19T03:01:38.672 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.3642999999999999e-05 2024-04-19T03:01:38.672 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.672 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.672 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:01:38.672 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.168385+0000", 2024-04-19T03:01:38.672 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9647999999999994e-05 2024-04-19T03:01:38.672 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.672 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.672 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:01:38.672 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.170514+0000", 2024-04-19T03:01:38.672 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0021286370000000001 2024-04-19T03:01:38.672 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.673 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.673 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:38.673 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.171252+0000", 2024-04-19T03:01:38.673 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00073828499999999998 2024-04-19T03:01:38.673 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.673 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.673 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:01:38.673 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.171353+0000", 2024-04-19T03:01:38.673 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000100839 2024-04-19T03:01:38.673 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.673 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.673 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:01:38.673 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.171418+0000", 2024-04-19T03:01:38.673 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5048999999999993e-05 2024-04-19T03:01:38.674 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:38.674 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:01:38.674 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:38.674 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.674 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.674 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4159.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-19T03:01:38.674 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:01:08.151173+0000", 2024-04-19T03:01:38.674 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 30.487137424, 2024-04-19T03:01:38.674 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.023083023000000001, 2024-04-19T03:01:38.674 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:01:38.674 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:38.674 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:01:38.674 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4159", 2024-04-19T03:01:38.675 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3589238956", 2024-04-19T03:01:38.675 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 141 2024-04-19T03:01:38.675 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.675 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:01:38.675 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.675 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:01:38.675 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.151173+0000", 2024-04-19T03:01:38.675 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:38.675 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.675 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.675 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:01:38.675 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.151173+0000", 2024-04-19T03:01:38.675 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:38.675 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.676 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.676 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:01:38.676 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.151171+0000", 2024-04-19T03:01:38.676 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:01:38.676 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.676 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.676 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:01:38.676 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.151182+0000", 2024-04-19T03:01:38.676 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0730000000000001e-05 2024-04-19T03:01:38.676 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.676 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.676 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:01:38.676 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.151203+0000", 2024-04-19T03:01:38.676 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0387e-05 2024-04-19T03:01:38.677 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.677 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.677 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:01:38.677 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.151225+0000", 2024-04-19T03:01:38.677 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2643e-05 2024-04-19T03:01:38.677 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.677 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.677 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:01:38.677 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.169207+0000", 2024-04-19T03:01:38.677 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.017981561 2024-04-19T03:01:38.677 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.677 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.677 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:01:38.677 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.169386+0000", 2024-04-19T03:01:38.677 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000178758 2024-04-19T03:01:38.678 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.678 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.678 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:01:38.678 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.169546+0000", 2024-04-19T03:01:38.678 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000160781 2024-04-19T03:01:38.678 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.678 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.678 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:01:38.678 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.171444+0000", 2024-04-19T03:01:38.678 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0018980309999999999 2024-04-19T03:01:38.678 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.678 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.678 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:38.678 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.174165+0000", 2024-04-19T03:01:38.679 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0027204920000000001 2024-04-19T03:01:38.679 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.679 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.679 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:01:38.679 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.174228+0000", 2024-04-19T03:01:38.679 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2774000000000006e-05 2024-04-19T03:01:38.679 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.679 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.679 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:01:38.679 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.174256+0000", 2024-04-19T03:01:38.679 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.8045999999999999e-05 2024-04-19T03:01:38.679 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:38.679 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:01:38.679 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:38.680 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.680 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.680 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4159.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-19T03:01:38.680 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:01:08.347807+0000", 2024-04-19T03:01:38.680 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 30.290503416, 2024-04-19T03:01:38.680 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.021589991999999999, 2024-04-19T03:01:38.680 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:01:38.680 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:38.680 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:01:38.680 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4159", 2024-04-19T03:01:38.680 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3589238956", 2024-04-19T03:01:38.680 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 165 2024-04-19T03:01:38.680 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.680 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:01:38.681 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.681 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:01:38.681 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.347807+0000", 2024-04-19T03:01:38.681 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:38.681 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.681 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.681 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:01:38.681 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.347807+0000", 2024-04-19T03:01:38.681 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:38.681 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.681 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.681 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:01:38.681 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.347806+0000", 2024-04-19T03:01:38.681 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:01:38.682 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.682 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.682 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:01:38.682 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.347812+0000", 2024-04-19T03:01:38.682 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.066e-06 2024-04-19T03:01:38.682 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.682 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.682 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:01:38.682 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.347818+0000", 2024-04-19T03:01:38.682 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5550000000000002e-06 2024-04-19T03:01:38.682 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.682 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.682 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:01:38.682 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.347822+0000", 2024-04-19T03:01:38.683 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.561e-06 2024-04-19T03:01:38.683 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.683 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.683 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:01:38.683 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.365703+0000", 2024-04-19T03:01:38.683 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.017880566000000001 2024-04-19T03:01:38.683 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.683 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.683 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:01:38.683 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.365805+0000", 2024-04-19T03:01:38.683 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00010213900000000001 2024-04-19T03:01:38.683 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.683 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.684 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:01:38.684 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.365928+0000", 2024-04-19T03:01:38.684 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00012337900000000001 2024-04-19T03:01:38.684 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.684 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.684 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:38.684 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.367353+0000", 2024-04-19T03:01:38.684 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001424397 2024-04-19T03:01:38.684 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.684 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.684 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:01:38.684 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.369260+0000", 2024-04-19T03:01:38.684 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0019069130000000001 2024-04-19T03:01:38.684 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.684 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.685 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:01:38.685 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.369342+0000", 2024-04-19T03:01:38.685 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2423999999999996e-05 2024-04-19T03:01:38.685 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.685 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.685 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:01:38.685 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.369397+0000", 2024-04-19T03:01:38.685 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4481999999999998e-05 2024-04-19T03:01:38.685 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:38.685 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:01:38.685 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:38.685 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.686 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.686 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4159.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-19T03:01:38.686 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:01:08.539135+0000", 2024-04-19T03:01:38.686 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 30.099175158000001, 2024-04-19T03:01:38.686 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.021590602, 2024-04-19T03:01:38.686 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:01:38.686 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:38.686 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:01:38.686 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4159", 2024-04-19T03:01:38.686 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3589238956", 2024-04-19T03:01:38.686 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 188 2024-04-19T03:01:38.686 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.686 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:01:38.687 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.687 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:01:38.687 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.539135+0000", 2024-04-19T03:01:38.687 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:38.687 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.687 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.687 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:01:38.687 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.539135+0000", 2024-04-19T03:01:38.687 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:38.687 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.687 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.687 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:01:38.687 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.539134+0000", 2024-04-19T03:01:38.687 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:01:38.687 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.688 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.688 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:01:38.688 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.539228+0000", 2024-04-19T03:01:38.688 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.3771999999999996e-05 2024-04-19T03:01:38.688 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.688 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.688 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:01:38.688 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.539243+0000", 2024-04-19T03:01:38.688 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4707e-05 2024-04-19T03:01:38.688 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.688 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.688 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:01:38.688 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.539250+0000", 2024-04-19T03:01:38.688 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7190000000000001e-06 2024-04-19T03:01:38.689 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.689 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.689 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:01:38.689 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.553787+0000", 2024-04-19T03:01:38.689 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.014536248999999999 2024-04-19T03:01:38.689 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.689 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.689 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:01:38.689 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.553857+0000", 2024-04-19T03:01:38.689 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0675999999999999e-05 2024-04-19T03:01:38.689 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.689 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.689 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:01:38.690 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.553953+0000", 2024-04-19T03:01:38.690 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.5420999999999993e-05 2024-04-19T03:01:38.690 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.690 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.690 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:01:38.690 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.555569+0000", 2024-04-19T03:01:38.690 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001616625 2024-04-19T03:01:38.690 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.690 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.690 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:38.690 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.560644+0000", 2024-04-19T03:01:38.690 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0050749660000000002 2024-04-19T03:01:38.690 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.691 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.691 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:01:38.691 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.560690+0000", 2024-04-19T03:01:38.691 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6041000000000002e-05 2024-04-19T03:01:38.691 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.691 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.691 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:01:38.691 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.560726+0000", 2024-04-19T03:01:38.691 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5188999999999998e-05 2024-04-19T03:01:38.691 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:38.691 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:01:38.691 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:38.691 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.692 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.692 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4159.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-19T03:01:38.692 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:01:08.539259+0000", 2024-04-19T03:01:38.692 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 30.099050689999999, 2024-04-19T03:01:38.692 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.021552071999999999, 2024-04-19T03:01:38.692 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:01:38.692 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:38.692 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:01:38.692 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4159", 2024-04-19T03:01:38.692 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3589238956", 2024-04-19T03:01:38.692 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 189 2024-04-19T03:01:38.692 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.692 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:01:38.692 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.692 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:01:38.693 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.539259+0000", 2024-04-19T03:01:38.693 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:38.693 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.693 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.693 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:01:38.693 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.539259+0000", 2024-04-19T03:01:38.693 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:38.693 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.693 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.693 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:01:38.693 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.539259+0000", 2024-04-19T03:01:38.693 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:01:38.693 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.694 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.694 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:01:38.694 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.539268+0000", 2024-04-19T03:01:38.694 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.5359999999999998e-06 2024-04-19T03:01:38.694 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.694 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.694 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:01:38.694 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.539291+0000", 2024-04-19T03:01:38.694 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2687000000000001e-05 2024-04-19T03:01:38.694 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.694 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.694 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:01:38.694 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.539298+0000", 2024-04-19T03:01:38.695 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.883e-06 2024-04-19T03:01:38.695 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.695 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.695 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:01:38.695 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.554957+0000", 2024-04-19T03:01:38.695 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.015659019999999999 2024-04-19T03:01:38.695 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.695 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.695 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:01:38.695 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.555010+0000", 2024-04-19T03:01:38.695 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2985999999999997e-05 2024-04-19T03:01:38.695 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.695 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.695 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:01:38.696 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.555094+0000", 2024-04-19T03:01:38.696 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4530000000000006e-05 2024-04-19T03:01:38.696 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.696 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.696 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:01:38.696 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.556093+0000", 2024-04-19T03:01:38.696 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00099903300000000008 2024-04-19T03:01:38.696 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.696 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.696 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:38.696 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.560759+0000", 2024-04-19T03:01:38.696 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0046654369999999997 2024-04-19T03:01:38.696 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.696 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.697 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:01:38.697 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.560789+0000", 2024-04-19T03:01:38.697 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0638e-05 2024-04-19T03:01:38.697 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.697 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.697 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:01:38.697 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.560811+0000", 2024-04-19T03:01:38.697 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2167999999999998e-05 2024-04-19T03:01:38.697 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:38.697 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:01:38.697 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:38.697 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.697 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.697 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:8 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:01:38.698 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:01:14.998165+0000", 2024-04-19T03:01:38.698 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 23.640145009000001, 2024-04-19T03:01:38.698 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.024541001, 2024-04-19T03:01:38.698 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:01:38.698 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:38.698 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:01:38.698 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.698 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:01:38.698 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998165+0000", 2024-04-19T03:01:38.698 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:38.698 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.698 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.698 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:01:38.699 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998165+0000", 2024-04-19T03:01:38.699 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:38.699 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.699 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.699 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:01:38.699 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998164+0000", 2024-04-19T03:01:38.699 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:01:38.699 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.699 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.699 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:01:38.699 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998170+0000", 2024-04-19T03:01:38.699 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2939999999999996e-06 2024-04-19T03:01:38.699 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.699 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.700 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:01:38.700 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998179+0000", 2024-04-19T03:01:38.700 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.5540000000000003e-06 2024-04-19T03:01:38.700 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.700 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.700 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:01:38.700 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998188+0000", 2024-04-19T03:01:38.700 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2959999999999999e-06 2024-04-19T03:01:38.700 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.700 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.700 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:01:38.700 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998332+0000", 2024-04-19T03:01:38.700 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00014474 2024-04-19T03:01:38.701 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.701 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.701 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:01:38.701 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998337+0000", 2024-04-19T03:01:38.701 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6909999999999996e-06 2024-04-19T03:01:38.701 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.701 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.701 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:01:38.701 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.010222+0000", 2024-04-19T03:01:38.701 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011885178 2024-04-19T03:01:38.701 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.701 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.701 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:01:38.701 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.010342+0000", 2024-04-19T03:01:38.702 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00011991500000000001 2024-04-19T03:01:38.702 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.702 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.702 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:01:38.702 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.010506+0000", 2024-04-19T03:01:38.702 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00016429699999999999 2024-04-19T03:01:38.702 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.702 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.702 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:01:38.702 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.014525+0000", 2024-04-19T03:01:38.702 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0040189839999999998 2024-04-19T03:01:38.702 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.702 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.702 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:38.703 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.022600+0000", 2024-04-19T03:01:38.703 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0080741990000000007 2024-04-19T03:01:38.703 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.703 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.703 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:01:38.703 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.022670+0000", 2024-04-19T03:01:38.703 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0743999999999999e-05 2024-04-19T03:01:38.703 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.703 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.703 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:01:38.703 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.022706+0000", 2024-04-19T03:01:38.703 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5782999999999999e-05 2024-04-19T03:01:38.703 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:38.703 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:01:38.704 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:38.704 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.704 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.704 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:27 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:01:38.704 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:01:14.998436+0000", 2024-04-19T03:01:38.704 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 23.639874355, 2024-04-19T03:01:38.704 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.024406325999999999, 2024-04-19T03:01:38.704 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:01:38.704 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:38.704 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:01:38.704 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.704 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:01:38.704 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998436+0000", 2024-04-19T03:01:38.705 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:38.705 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.705 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.705 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:01:38.705 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998436+0000", 2024-04-19T03:01:38.705 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:38.705 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.705 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.705 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:01:38.705 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998435+0000", 2024-04-19T03:01:38.705 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:01:38.705 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.705 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.705 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:01:38.705 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998445+0000", 2024-04-19T03:01:38.706 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0349e-05 2024-04-19T03:01:38.706 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.706 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.706 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:01:38.706 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998453+0000", 2024-04-19T03:01:38.706 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0399999999999993e-06 2024-04-19T03:01:38.706 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.706 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.706 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:01:38.706 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998461+0000", 2024-04-19T03:01:38.706 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9780000000000005e-06 2024-04-19T03:01:38.706 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.706 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.706 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:01:38.707 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998515+0000", 2024-04-19T03:01:38.707 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3097999999999999e-05 2024-04-19T03:01:38.707 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.707 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.707 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:01:38.707 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998520+0000", 2024-04-19T03:01:38.707 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9220000000000002e-06 2024-04-19T03:01:38.707 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.707 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.707 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:01:38.707 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.011258+0000", 2024-04-19T03:01:38.707 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.012737735 2024-04-19T03:01:38.707 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.707 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.708 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:01:38.708 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.011566+0000", 2024-04-19T03:01:38.708 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00030826200000000001 2024-04-19T03:01:38.708 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.708 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.708 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:01:38.708 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.011996+0000", 2024-04-19T03:01:38.708 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00042912000000000001 2024-04-19T03:01:38.708 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.708 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.708 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:01:38.708 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.014533+0000", 2024-04-19T03:01:38.708 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.002537423 2024-04-19T03:01:38.708 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.709 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.709 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:38.709 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.022756+0000", 2024-04-19T03:01:38.709 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0082231530000000004 2024-04-19T03:01:38.709 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.709 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.709 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:01:38.709 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.022807+0000", 2024-04-19T03:01:38.709 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0852e-05 2024-04-19T03:01:38.709 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.709 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.709 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:01:38.709 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.022842+0000", 2024-04-19T03:01:38.709 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5058000000000002e-05 2024-04-19T03:01:38.709 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:38.710 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:01:38.710 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:38.710 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.710 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.710 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:28 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:01:38.710 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:01:14.998476+0000", 2024-04-19T03:01:38.710 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 23.639834433000001, 2024-04-19T03:01:38.710 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.024656784000000001, 2024-04-19T03:01:38.710 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:01:38.710 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:38.710 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:01:38.710 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.710 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:01:38.711 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998476+0000", 2024-04-19T03:01:38.711 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:38.711 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.711 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.711 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:01:38.711 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998476+0000", 2024-04-19T03:01:38.711 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:38.711 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.711 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.711 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:01:38.711 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998475+0000", 2024-04-19T03:01:38.711 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:01:38.711 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.711 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.711 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:01:38.712 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998484+0000", 2024-04-19T03:01:38.712 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.7770000000000008e-06 2024-04-19T03:01:38.712 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.712 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.712 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:01:38.712 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998495+0000", 2024-04-19T03:01:38.712 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0726e-05 2024-04-19T03:01:38.712 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.712 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.712 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:01:38.712 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998503+0000", 2024-04-19T03:01:38.712 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.8780000000000004e-06 2024-04-19T03:01:38.712 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.712 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.713 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:01:38.713 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998579+0000", 2024-04-19T03:01:38.713 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5160999999999994e-05 2024-04-19T03:01:38.713 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.713 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.713 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:01:38.713 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998586+0000", 2024-04-19T03:01:38.713 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8520000000000004e-06 2024-04-19T03:01:38.713 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.713 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.713 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:01:38.713 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.012423+0000", 2024-04-19T03:01:38.713 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.013836667 2024-04-19T03:01:38.713 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.714 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.714 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:01:38.714 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.012532+0000", 2024-04-19T03:01:38.714 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000108565 2024-04-19T03:01:38.714 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.714 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.714 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:01:38.714 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.012655+0000", 2024-04-19T03:01:38.714 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00012344600000000001 2024-04-19T03:01:38.714 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.714 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.714 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:01:38.714 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.015680+0000", 2024-04-19T03:01:38.715 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0030246470000000001 2024-04-19T03:01:38.715 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.715 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.715 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:38.715 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.023091+0000", 2024-04-19T03:01:38.715 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0074116030000000001 2024-04-19T03:01:38.715 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.715 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.715 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:01:38.715 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.023115+0000", 2024-04-19T03:01:38.715 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.3091999999999998e-05 2024-04-19T03:01:38.715 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.715 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.715 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:01:38.716 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.023132+0000", 2024-04-19T03:01:38.716 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7901999999999999e-05 2024-04-19T03:01:38.716 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:38.716 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:01:38.716 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:38.716 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.716 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.716 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:29 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:01:38.716 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:01:14.998527+0000", 2024-04-19T03:01:38.716 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 23.639782893, 2024-04-19T03:01:38.716 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.024738599999999999, 2024-04-19T03:01:38.716 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:01:38.716 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:38.716 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:01:38.717 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.717 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:01:38.717 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998527+0000", 2024-04-19T03:01:38.717 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:38.717 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.717 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.717 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:01:38.717 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998527+0000", 2024-04-19T03:01:38.717 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:38.717 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.717 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.717 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:01:38.717 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998527+0000", 2024-04-19T03:01:38.717 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:01:38.718 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.718 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.718 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:01:38.718 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998531+0000", 2024-04-19T03:01:38.718 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9450000000000001e-06 2024-04-19T03:01:38.718 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.718 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.718 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:01:38.718 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998541+0000", 2024-04-19T03:01:38.718 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.4320000000000005e-06 2024-04-19T03:01:38.718 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.718 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.718 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:01:38.718 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998548+0000", 2024-04-19T03:01:38.719 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.221e-06 2024-04-19T03:01:38.719 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.719 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.719 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:01:38.719 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998620+0000", 2024-04-19T03:01:38.719 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.1676999999999998e-05 2024-04-19T03:01:38.719 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.719 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.719 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:01:38.719 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998624+0000", 2024-04-19T03:01:38.719 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4850000000000003e-06 2024-04-19T03:01:38.719 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.719 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.719 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:01:38.720 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.013261+0000", 2024-04-19T03:01:38.720 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.014636451999999999 2024-04-19T03:01:38.720 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.720 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.720 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:01:38.720 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.013364+0000", 2024-04-19T03:01:38.720 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000102885 2024-04-19T03:01:38.720 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.720 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.720 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:01:38.720 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.013481+0000", 2024-04-19T03:01:38.720 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00011783299999999999 2024-04-19T03:01:38.720 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.720 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.721 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:01:38.721 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.016265+0000", 2024-04-19T03:01:38.721 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0027834539999999999 2024-04-19T03:01:38.721 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.721 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.721 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:38.721 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.023180+0000", 2024-04-19T03:01:38.721 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0069149399999999996 2024-04-19T03:01:38.721 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.721 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.721 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:01:38.721 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.023230+0000", 2024-04-19T03:01:38.721 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0220999999999999e-05 2024-04-19T03:01:38.721 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.722 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.722 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:01:38.722 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.023266+0000", 2024-04-19T03:01:38.722 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5703e-05 2024-04-19T03:01:38.722 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:38.722 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:01:38.722 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:38.722 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.722 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.722 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:30 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:01:38.722 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:01:14.998577+0000", 2024-04-19T03:01:38.722 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 23.639732786, 2024-04-19T03:01:38.722 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.024774022999999999, 2024-04-19T03:01:38.722 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:01:38.723 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:38.723 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:01:38.723 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.723 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:01:38.723 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998577+0000", 2024-04-19T03:01:38.723 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:38.723 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.723 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.723 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:01:38.723 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998577+0000", 2024-04-19T03:01:38.723 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:38.723 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.723 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.723 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:01:38.724 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998576+0000", 2024-04-19T03:01:38.724 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:01:38.724 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.724 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.724 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:01:38.724 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998583+0000", 2024-04-19T03:01:38.724 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8850000000000001e-06 2024-04-19T03:01:38.724 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.724 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.724 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:01:38.724 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998597+0000", 2024-04-19T03:01:38.724 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.362e-05 2024-04-19T03:01:38.724 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.724 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.724 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:01:38.725 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998607+0000", 2024-04-19T03:01:38.725 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0389e-05 2024-04-19T03:01:38.725 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.725 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.725 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:01:38.725 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998713+0000", 2024-04-19T03:01:38.725 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000105338 2024-04-19T03:01:38.725 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.725 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.725 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:01:38.725 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998720+0000", 2024-04-19T03:01:38.725 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2370000000000003e-06 2024-04-19T03:01:38.725 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.725 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.726 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:01:38.726 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.014014+0000", 2024-04-19T03:01:38.726 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.015294116999999999 2024-04-19T03:01:38.726 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.726 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.726 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:01:38.726 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.014091+0000", 2024-04-19T03:01:38.726 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7148000000000001e-05 2024-04-19T03:01:38.726 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.726 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.726 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:01:38.726 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.014271+0000", 2024-04-19T03:01:38.726 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00017962699999999999 2024-04-19T03:01:38.726 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.727 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.727 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:01:38.727 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.018024+0000", 2024-04-19T03:01:38.727 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0037529809999999999 2024-04-19T03:01:38.727 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.727 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.727 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:38.727 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.023303+0000", 2024-04-19T03:01:38.727 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0052793099999999997 2024-04-19T03:01:38.727 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.727 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.727 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:01:38.727 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.023331+0000", 2024-04-19T03:01:38.728 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.8013000000000001e-05 2024-04-19T03:01:38.728 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.728 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.728 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:01:38.728 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.023351+0000", 2024-04-19T03:01:38.728 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0225999999999999e-05 2024-04-19T03:01:38.728 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:38.728 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:01:38.728 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:38.728 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.728 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.728 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:33 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:01:38.728 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:01:14.998625+0000", 2024-04-19T03:01:38.728 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 23.639685389, 2024-04-19T03:01:38.729 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.024007338999999999, 2024-04-19T03:01:38.729 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:01:38.729 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:38.729 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:01:38.729 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.729 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:01:38.729 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998625+0000", 2024-04-19T03:01:38.729 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:38.729 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.729 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.729 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:01:38.729 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998625+0000", 2024-04-19T03:01:38.729 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:38.729 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.730 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.730 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:01:38.730 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998623+0000", 2024-04-19T03:01:38.730 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999986 2024-04-19T03:01:38.730 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.730 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.730 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:01:38.730 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998632+0000", 2024-04-19T03:01:38.730 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9279999999999999e-06 2024-04-19T03:01:38.730 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.730 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.730 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:01:38.730 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998642+0000", 2024-04-19T03:01:38.731 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0063e-05 2024-04-19T03:01:38.731 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.731 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.731 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:01:38.731 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998649+0000", 2024-04-19T03:01:38.731 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4799999999999998e-06 2024-04-19T03:01:38.731 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.731 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.731 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:01:38.731 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998730+0000", 2024-04-19T03:01:38.731 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.1514999999999995e-05 2024-04-19T03:01:38.731 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.731 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.731 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:01:38.732 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998741+0000", 2024-04-19T03:01:38.732 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1029999999999999e-05 2024-04-19T03:01:38.732 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.732 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.732 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:01:38.732 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.010202+0000", 2024-04-19T03:01:38.732 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011460529000000001 2024-04-19T03:01:38.732 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.732 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.732 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:01:38.732 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.010292+0000", 2024-04-19T03:01:38.732 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.0382000000000003e-05 2024-04-19T03:01:38.732 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.732 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.732 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:01:38.733 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.010391+0000", 2024-04-19T03:01:38.733 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.8491000000000003e-05 2024-04-19T03:01:38.733 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.733 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.733 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:01:38.733 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.013800+0000", 2024-04-19T03:01:38.733 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0034090219999999998 2024-04-19T03:01:38.733 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.733 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.733 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:38.733 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.022564+0000", 2024-04-19T03:01:38.733 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0087639950000000001 2024-04-19T03:01:38.733 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.733 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.734 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:01:38.734 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.022601+0000", 2024-04-19T03:01:38.734 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7363999999999997e-05 2024-04-19T03:01:38.734 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.734 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.734 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:01:38.734 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.022632+0000", 2024-04-19T03:01:38.734 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0917000000000002e-05 2024-04-19T03:01:38.734 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:38.734 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:01:38.734 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:38.734 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.734 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.735 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:37 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:01:38.735 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:01:14.998739+0000", 2024-04-19T03:01:38.735 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 23.639571448000002, 2024-04-19T03:01:38.735 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.020573188999999999, 2024-04-19T03:01:38.735 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:01:38.735 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:38.735 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:01:38.735 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.735 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:01:38.735 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998739+0000", 2024-04-19T03:01:38.735 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:38.735 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.735 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.735 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:01:38.735 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998739+0000", 2024-04-19T03:01:38.736 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:38.736 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.736 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.736 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:01:38.736 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998738+0000", 2024-04-19T03:01:38.736 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:01:38.736 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.736 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.736 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:01:38.736 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998755+0000", 2024-04-19T03:01:38.736 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7105999999999999e-05 2024-04-19T03:01:38.736 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.736 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.736 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:01:38.737 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998764+0000", 2024-04-19T03:01:38.737 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.1279999999999997e-06 2024-04-19T03:01:38.737 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.737 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.737 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:01:38.737 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998771+0000", 2024-04-19T03:01:38.737 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6939999999999998e-06 2024-04-19T03:01:38.737 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.737 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.737 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:01:38.737 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998843+0000", 2024-04-19T03:01:38.737 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.1695999999999999e-05 2024-04-19T03:01:38.737 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.737 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.737 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op must wait for map", 2024-04-19T03:01:38.738 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998852+0000", 2024-04-19T03:01:38.738 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.0799999999999995e-06 2024-04-19T03:01:38.738 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.738 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.738 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:01:38.738 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.006513+0000", 2024-04-19T03:01:38.738 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0076610020000000001 2024-04-19T03:01:38.738 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.738 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.738 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:01:38.738 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.006670+0000", 2024-04-19T03:01:38.738 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000157529 2024-04-19T03:01:38.738 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.738 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.739 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-04-19T03:01:38.739 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.006863+0000", 2024-04-19T03:01:38.739 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000192597 2024-04-19T03:01:38.739 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.739 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.739 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:01:38.739 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.012404+0000", 2024-04-19T03:01:38.739 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0055415220000000001 2024-04-19T03:01:38.739 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.739 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.739 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:38.739 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.019171+0000", 2024-04-19T03:01:38.739 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0067666829999999999 2024-04-19T03:01:38.739 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.740 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.740 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:01:38.740 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.019228+0000", 2024-04-19T03:01:38.740 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7145999999999998e-05 2024-04-19T03:01:38.740 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.740 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.740 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:01:38.740 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.019312+0000", 2024-04-19T03:01:38.740 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.3591999999999995e-05 2024-04-19T03:01:38.740 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:38.740 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:01:38.740 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:38.740 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.741 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.741 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:01:38.741 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:01:14.998792+0000", 2024-04-19T03:01:38.741 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 23.639518519999999, 2024-04-19T03:01:38.741 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.023951813999999998, 2024-04-19T03:01:38.741 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:01:38.741 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:38.741 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:01:38.741 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.741 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:01:38.741 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998792+0000", 2024-04-19T03:01:38.741 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:38.741 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.741 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.742 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:01:38.742 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998792+0000", 2024-04-19T03:01:38.742 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:38.742 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.742 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.742 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:01:38.742 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998791+0000", 2024-04-19T03:01:38.742 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:01:38.742 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.742 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.742 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:01:38.742 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998796+0000", 2024-04-19T03:01:38.742 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9649999999999999e-06 2024-04-19T03:01:38.743 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.743 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.743 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:01:38.743 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998809+0000", 2024-04-19T03:01:38.743 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3254e-05 2024-04-19T03:01:38.743 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.743 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.743 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:01:38.743 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998816+0000", 2024-04-19T03:01:38.743 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.472e-06 2024-04-19T03:01:38.743 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.743 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.743 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:01:38.744 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998899+0000", 2024-04-19T03:01:38.744 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.3676000000000003e-05 2024-04-19T03:01:38.744 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.744 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.744 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:01:38.744 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998908+0000", 2024-04-19T03:01:38.744 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6940000000000001e-06 2024-04-19T03:01:38.744 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.744 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.744 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:01:38.744 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.010818+0000", 2024-04-19T03:01:38.744 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011910482999999999 2024-04-19T03:01:38.744 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.744 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.745 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:01:38.745 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.010959+0000", 2024-04-19T03:01:38.745 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00014018900000000001 2024-04-19T03:01:38.745 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.745 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.745 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:01:38.745 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.011185+0000", 2024-04-19T03:01:38.745 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000226085 2024-04-19T03:01:38.745 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.745 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.745 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:01:38.745 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.014479+0000", 2024-04-19T03:01:38.745 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0032938260000000001 2024-04-19T03:01:38.746 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.746 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.746 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:38.746 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.022697+0000", 2024-04-19T03:01:38.746 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0082186029999999997 2024-04-19T03:01:38.746 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.746 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.746 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:01:38.746 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.022724+0000", 2024-04-19T03:01:38.746 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.6503999999999999e-05 2024-04-19T03:01:38.746 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.746 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.746 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:01:38.746 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.022743+0000", 2024-04-19T03:01:38.746 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9663000000000001e-05 2024-04-19T03:01:38.747 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:38.747 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:01:38.747 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:38.747 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.747 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.747 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:01:38.747 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:01:14.998870+0000", 2024-04-19T03:01:38.747 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 23.639440318999998, 2024-04-19T03:01:38.747 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.024280578000000001, 2024-04-19T03:01:38.747 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:01:38.747 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:38.747 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:01:38.747 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.747 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:01:38.748 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998870+0000", 2024-04-19T03:01:38.748 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:38.748 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.748 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.748 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:01:38.748 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998870+0000", 2024-04-19T03:01:38.748 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:38.748 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.748 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.748 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:01:38.748 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998869+0000", 2024-04-19T03:01:38.748 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:01:38.748 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.748 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.749 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:01:38.749 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998879+0000", 2024-04-19T03:01:38.749 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.8689999999999999e-06 2024-04-19T03:01:38.749 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.749 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.749 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:01:38.749 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998893+0000", 2024-04-19T03:01:38.749 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4436999999999999e-05 2024-04-19T03:01:38.749 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.749 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.749 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:01:38.749 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998904+0000", 2024-04-19T03:01:38.749 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0657e-05 2024-04-19T03:01:38.749 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.749 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.750 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:01:38.750 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998972+0000", 2024-04-19T03:01:38.750 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8121999999999996e-05 2024-04-19T03:01:38.750 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.750 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.750 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:01:38.750 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998980+0000", 2024-04-19T03:01:38.750 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7170000000000008e-06 2024-04-19T03:01:38.750 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.750 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.750 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:01:38.750 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.011666+0000", 2024-04-19T03:01:38.750 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.012686507 2024-04-19T03:01:38.751 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.751 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.751 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:01:38.751 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.012403+0000", 2024-04-19T03:01:38.751 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00073661899999999999 2024-04-19T03:01:38.751 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.751 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.751 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:01:38.751 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.012788+0000", 2024-04-19T03:01:38.751 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00038495800000000002 2024-04-19T03:01:38.751 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.751 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.752 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:01:38.752 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.015713+0000", 2024-04-19T03:01:38.752 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0029255879999999998 2024-04-19T03:01:38.752 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.752 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.752 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:38.752 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.023066+0000", 2024-04-19T03:01:38.752 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.007352903 2024-04-19T03:01:38.752 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.752 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.752 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:01:38.752 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.023113+0000", 2024-04-19T03:01:38.752 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7163000000000002e-05 2024-04-19T03:01:38.752 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.753 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.753 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:01:38.753 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.023150+0000", 2024-04-19T03:01:38.753 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6881000000000001e-05 2024-04-19T03:01:38.753 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:38.753 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:01:38.753 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:38.753 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.753 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.753 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:16 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:01:38.753 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:01:14.998920+0000", 2024-04-19T03:01:38.753 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 23.639390274, 2024-04-19T03:01:38.753 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.020562114999999999, 2024-04-19T03:01:38.753 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:01:38.753 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:38.754 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:01:38.754 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.754 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:01:38.754 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998920+0000", 2024-04-19T03:01:38.754 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:38.754 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.754 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.754 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:01:38.754 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998920+0000", 2024-04-19T03:01:38.754 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:38.754 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.754 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.754 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:01:38.755 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998919+0000", 2024-04-19T03:01:38.755 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:01:38.755 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.755 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.755 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:01:38.755 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998925+0000", 2024-04-19T03:01:38.755 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5370000000000003e-06 2024-04-19T03:01:38.755 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.755 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.755 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:01:38.755 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998943+0000", 2024-04-19T03:01:38.755 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7549000000000001e-05 2024-04-19T03:01:38.755 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.755 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.755 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:01:38.756 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998955+0000", 2024-04-19T03:01:38.756 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1977000000000001e-05 2024-04-19T03:01:38.756 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.756 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.756 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:01:38.756 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.999009+0000", 2024-04-19T03:01:38.756 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3667e-05 2024-04-19T03:01:38.756 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.756 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.756 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:01:38.756 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.999013+0000", 2024-04-19T03:01:38.756 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8829999999999997e-06 2024-04-19T03:01:38.756 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.756 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.757 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:01:38.757 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.007476+0000", 2024-04-19T03:01:38.757 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0084621569999999997 2024-04-19T03:01:38.757 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.757 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.757 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:01:38.757 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.007626+0000", 2024-04-19T03:01:38.757 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00015079199999999999 2024-04-19T03:01:38.757 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.757 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.757 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-04-19T03:01:38.757 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.007765+0000", 2024-04-19T03:01:38.757 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000138376 2024-04-19T03:01:38.757 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.758 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.758 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:01:38.758 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.012418+0000", 2024-04-19T03:01:38.758 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0046528200000000002 2024-04-19T03:01:38.758 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.758 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.758 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:38.758 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.019380+0000", 2024-04-19T03:01:38.758 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0069621960000000004 2024-04-19T03:01:38.758 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.758 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.758 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:01:38.758 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.019437+0000", 2024-04-19T03:01:38.759 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7226999999999999e-05 2024-04-19T03:01:38.759 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.759 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.759 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:01:38.759 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.019482+0000", 2024-04-19T03:01:38.759 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4857000000000001e-05 2024-04-19T03:01:38.759 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:38.759 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:01:38.759 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:38.759 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.759 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.759 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:20 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:01:38.759 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:01:14.999024+0000", 2024-04-19T03:01:38.759 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 23.639286046999999, 2024-04-19T03:01:38.760 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.024212818000000001, 2024-04-19T03:01:38.760 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:01:38.760 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-04-19T03:01:38.760 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:01:38.760 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.760 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:01:38.760 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.999024+0000", 2024-04-19T03:01:38.760 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:38.760 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.760 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.760 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:01:38.760 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.999024+0000", 2024-04-19T03:01:38.760 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:38.760 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.761 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.761 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:01:38.761 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.999023+0000", 2024-04-19T03:01:38.761 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:01:38.761 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.761 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.761 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:01:38.761 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.999029+0000", 2024-04-19T03:01:38.761 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2709999999999998e-06 2024-04-19T03:01:38.761 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.761 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.761 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:01:38.761 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.999045+0000", 2024-04-19T03:01:38.761 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.5840000000000001e-05 2024-04-19T03:01:38.762 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.762 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.762 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:01:38.762 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.999057+0000", 2024-04-19T03:01:38.762 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1897e-05 2024-04-19T03:01:38.762 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.762 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.762 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:01:38.762 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.999136+0000", 2024-04-19T03:01:38.762 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8842000000000002e-05 2024-04-19T03:01:38.762 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.762 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.762 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:01:38.762 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.999144+0000", 2024-04-19T03:01:38.763 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.3110000000000006e-06 2024-04-19T03:01:38.763 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.763 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.763 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:01:38.763 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.013338+0000", 2024-04-19T03:01:38.763 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.014194217 2024-04-19T03:01:38.763 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.763 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.763 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:01:38.763 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.013485+0000", 2024-04-19T03:01:38.763 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000146787 2024-04-19T03:01:38.763 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:38.763 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:38.763 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:01:38.764 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.023237+0000", 2024-04-19T03:01:38.764 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0097517899999999998 2024-04-19T03:01:38.764 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:38.764 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:01:38.764 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:38.764 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:38.764 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:01:38.764 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-04-19T03:01:38.765 INFO:teuthology.orchestra.run.smithi096.stderr:nodeep-scrub is set 2024-04-19T03:01:38.765 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:01:38.764+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:01:38.766 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T03:01:38.783 DEBUG:tasks.admin_socket:Testing objecter_requests with config {'test': 'http://git.ceph.com/?p={repo};a=blob_plain;f=src/test/admin_socket/objecter_requests;hb={branch}', 'branch': 'reef'} 2024-04-19T03:01:38.784 DEBUG:teuthology.orchestra.run.smithi096:> wget -q -O /home/ubuntu/cephtest/admin_socket_client.0/objecter_requests -- 'http://git.ceph.com/?p=ceph.git;a=blob_plain;f=src/test/admin_socket/objecter_requests;hb=reef' && chmod u=rx -- /home/ubuntu/cephtest/admin_socket_client.0/objecter_requests 2024-04-19T03:01:38.819 INFO:tasks.radosbench.radosbench.0.smithi096.stdout: 1 16 2745 2729 170.553 170.562 0.00400324 0.00583882 2024-04-19T03:01:38.866 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:01:38.864+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:01:38.896 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-04-19T03:01:38.896 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [ 2024-04-19T03:01:38.896 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:38.897 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4755.0:2945 5.3 5:cbcdf5bc:::benchmark_data_smithi096_19531_object2944:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-19T03:01:38.897 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:38.889650+0000", 2024-04-19T03:01:38.897 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 0.0031688010000000002, 2024-04-19T03:01:38.897 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0032021110000000001, 2024-04-19T03:01:38.897 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:01:38.897 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:01:38.897 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-04-19T03:01:38.897 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4755", 2024-04-19T03:01:38.897 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:38.897 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 2945 2024-04-19T03:01:38.897 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:38.897 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:01:38.897 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:38.897 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:01:38.898 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.889650+0000", 2024-04-19T03:01:38.898 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:38.898 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:38.898 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:38.898 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:01:38.898 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.889650+0000", 2024-04-19T03:01:38.898 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:38.898 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:38.898 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:38.898 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:01:38.898 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.889649+0000", 2024-04-19T03:01:38.898 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2024-04-19T03:01:38.898 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:38.898 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:38.899 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:01:38.899 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.889758+0000", 2024-04-19T03:01:38.899 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000109294 2024-04-19T03:01:38.899 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:38.899 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:38.899 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:01:38.899 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.889782+0000", 2024-04-19T03:01:38.899 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.4292000000000001e-05 2024-04-19T03:01:38.899 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:38.899 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:38.899 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:01:38.899 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.889800+0000", 2024-04-19T03:01:38.899 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.774e-05 2024-04-19T03:01:38.899 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:38.900 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:38.900 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:38.900 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.889869+0000", 2024-04-19T03:01:38.900 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.8926999999999999e-05 2024-04-19T03:01:38.900 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:38.900 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:38.900 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:01:38.900 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.890021+0000", 2024-04-19T03:01:38.900 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00015162300000000001 2024-04-19T03:01:38.900 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:38.900 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:38.900 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-04-19T03:01:38.900 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.890173+0000", 2024-04-19T03:01:38.900 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00015244 2024-04-19T03:01:38.901 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:38.901 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:38.901 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:01:38.901 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.892750+0000", 2024-04-19T03:01:38.901 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0025768079999999999 2024-04-19T03:01:38.901 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:38.901 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:38.901 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:38.901 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:38.901 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:38.901 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4755.0:2948 5.c 5:32f727c3:::benchmark_data_smithi096_19531_object2947:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-19T03:01:38.901 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:38.889904+0000", 2024-04-19T03:01:38.901 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 0.0029146100000000002, 2024-04-19T03:01:38.901 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0030453260000000001, 2024-04-19T03:01:38.902 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:01:38.902 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:01:38.902 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-04-19T03:01:38.902 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4755", 2024-04-19T03:01:38.902 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:38.902 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 2948 2024-04-19T03:01:38.902 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:38.902 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:01:38.902 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:38.902 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:01:38.902 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.889904+0000", 2024-04-19T03:01:38.902 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:38.902 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:38.902 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:38.903 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:01:38.903 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.889904+0000", 2024-04-19T03:01:38.903 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:38.903 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:38.903 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:38.903 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:01:38.903 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.889903+0000", 2024-04-19T03:01:38.903 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999995 2024-04-19T03:01:38.903 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:38.903 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:38.903 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:01:38.903 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.889952+0000", 2024-04-19T03:01:38.903 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.8780999999999999e-05 2024-04-19T03:01:38.903 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:38.903 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:38.904 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:01:38.904 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.889958+0000", 2024-04-19T03:01:38.904 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.2099999999999998e-06 2024-04-19T03:01:38.904 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:38.904 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:38.904 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:01:38.904 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.889963+0000", 2024-04-19T03:01:38.904 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.1509999999999997e-06 2024-04-19T03:01:38.904 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:38.904 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:38.904 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:38.904 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.890009+0000", 2024-04-19T03:01:38.904 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.6594000000000001e-05 2024-04-19T03:01:38.904 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:38.905 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:38.905 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:01:38.905 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.890477+0000", 2024-04-19T03:01:38.905 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000468021 2024-04-19T03:01:38.905 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:38.905 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:38.905 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-04-19T03:01:38.905 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.890700+0000", 2024-04-19T03:01:38.905 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00022239100000000001 2024-04-19T03:01:38.905 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:38.905 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:38.905 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:38.905 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:38.905 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:38.906 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4755.0:2946 5.b e25/22 5:d138c1ad:::benchmark_data_smithi096_19531_object2945:head v 25'181, mlcod=25'179)", 2024-04-19T03:01:38.906 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:38.890270+0000", 2024-04-19T03:01:38.906 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 0.0025483599999999999, 2024-04-19T03:01:38.906 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0027570670000000002, 2024-04-19T03:01:38.906 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:01:38.906 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "started", 2024-04-19T03:01:38.906 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:01:38.906 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:38.906 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:01:38.906 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.890270+0000", 2024-04-19T03:01:38.906 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:38.906 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:38.906 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:38.906 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:01:38.907 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.890270+0000", 2024-04-19T03:01:38.907 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:38.907 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:38.907 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:38.907 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:01:38.907 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.890269+0000", 2024-04-19T03:01:38.907 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2024-04-19T03:01:38.907 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:38.907 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:38.907 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:01:38.907 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.890407+0000", 2024-04-19T03:01:38.907 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00013789100000000001 2024-04-19T03:01:38.907 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:38.907 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:38.908 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:01:38.908 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.890417+0000", 2024-04-19T03:01:38.908 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.5219999999999996e-06 2024-04-19T03:01:38.908 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:38.908 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:38.908 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:01:38.908 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.890423+0000", 2024-04-19T03:01:38.908 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.319e-06 2024-04-19T03:01:38.908 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:38.908 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:38.908 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:38.908 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.890482+0000", 2024-04-19T03:01:38.908 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.8805999999999999e-05 2024-04-19T03:01:38.908 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:38.908 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:38.909 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:01:38.909 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.890501+0000", 2024-04-19T03:01:38.909 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.9202999999999999e-05 2024-04-19T03:01:38.909 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:38.909 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:38.909 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:38.909 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:38.909 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:38.909 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4755.0:2949 5.0 e25/22 5:0bdca5d1:::benchmark_data_smithi096_19531_object2948:head v 25'198, mlcod=25'196)", 2024-04-19T03:01:38.909 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:38.890582+0000", 2024-04-19T03:01:38.909 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 0.0022370020000000001, 2024-04-19T03:01:38.909 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0025232200000000001, 2024-04-19T03:01:38.909 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:01:38.909 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "started", 2024-04-19T03:01:38.910 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:01:38.910 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:38.910 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:01:38.910 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.890582+0000", 2024-04-19T03:01:38.910 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:38.910 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:38.910 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:38.910 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:01:38.910 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.890582+0000", 2024-04-19T03:01:38.910 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:38.910 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:38.910 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:38.910 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:01:38.911 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.890581+0000", 2024-04-19T03:01:38.911 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2024-04-19T03:01:38.911 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:38.911 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:38.911 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:01:38.911 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.890645+0000", 2024-04-19T03:01:38.911 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.4430000000000005e-05 2024-04-19T03:01:38.911 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:38.911 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:38.911 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:01:38.911 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.890656+0000", 2024-04-19T03:01:38.911 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0523000000000001e-05 2024-04-19T03:01:38.911 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:38.911 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:38.912 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:01:38.912 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.890663+0000", 2024-04-19T03:01:38.912 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.5190000000000003e-06 2024-04-19T03:01:38.912 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:38.912 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:38.912 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:38.912 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.890753+0000", 2024-04-19T03:01:38.912 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.0179000000000005e-05 2024-04-19T03:01:38.912 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:38.912 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:38.912 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:01:38.912 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.890776+0000", 2024-04-19T03:01:38.912 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.2693000000000001e-05 2024-04-19T03:01:38.912 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:38.913 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:38.913 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:38.913 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:38.913 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:38.913 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4755.0:2952 5.5 5:a9757b44:::benchmark_data_smithi096_19531_object2951:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-19T03:01:38.913 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:38.890395+0000", 2024-04-19T03:01:38.913 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 0.0024239119999999999, 2024-04-19T03:01:38.913 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0027732109999999998, 2024-04-19T03:01:38.913 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:01:38.913 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:01:38.913 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-04-19T03:01:38.913 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4755", 2024-04-19T03:01:38.914 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:38.914 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 2952 2024-04-19T03:01:38.914 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:38.914 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:01:38.914 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:38.914 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:01:38.914 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.890395+0000", 2024-04-19T03:01:38.914 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:38.914 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:38.914 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:38.914 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:01:38.914 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.890395+0000", 2024-04-19T03:01:38.914 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:38.915 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:38.915 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:38.915 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:01:38.915 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.890394+0000", 2024-04-19T03:01:38.915 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2024-04-19T03:01:38.915 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:38.915 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:38.915 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:01:38.915 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.890778+0000", 2024-04-19T03:01:38.915 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00038411000000000001 2024-04-19T03:01:38.915 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:38.915 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:38.915 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:01:38.915 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.890811+0000", 2024-04-19T03:01:38.916 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.2877999999999999e-05 2024-04-19T03:01:38.916 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:38.916 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:38.916 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:01:38.916 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.890820+0000", 2024-04-19T03:01:38.916 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.4970000000000007e-06 2024-04-19T03:01:38.916 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:38.916 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:38.916 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:38.916 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.890893+0000", 2024-04-19T03:01:38.916 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.3047999999999996e-05 2024-04-19T03:01:38.916 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:38.916 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:38.916 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:01:38.916 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.891009+0000", 2024-04-19T03:01:38.917 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000115809 2024-04-19T03:01:38.917 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:38.917 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:38.917 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-04-19T03:01:38.917 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.891098+0000", 2024-04-19T03:01:38.917 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.9549000000000006e-05 2024-04-19T03:01:38.917 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:38.917 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:38.917 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:38.917 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:38.917 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:38.917 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4755.0:2950 5.1 e25/22 5:86f471e5:::benchmark_data_smithi096_19531_object2949:head v 25'194, mlcod=25'191)", 2024-04-19T03:01:38.917 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:38.890979+0000", 2024-04-19T03:01:38.917 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 0.0018393649999999999, 2024-04-19T03:01:38.918 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0022634230000000001, 2024-04-19T03:01:38.918 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:01:38.918 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "started", 2024-04-19T03:01:38.918 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:01:38.918 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:38.918 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:01:38.918 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.890979+0000", 2024-04-19T03:01:38.918 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:38.918 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:38.918 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:38.918 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:01:38.918 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.890979+0000", 2024-04-19T03:01:38.918 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:38.918 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:38.919 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:38.919 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:01:38.919 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.890979+0000", 2024-04-19T03:01:38.919 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999995 2024-04-19T03:01:38.919 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:38.919 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:38.919 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:01:38.919 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.891022+0000", 2024-04-19T03:01:38.919 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.3718999999999999e-05 2024-04-19T03:01:38.919 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:38.919 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:38.919 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:01:38.919 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.891031+0000", 2024-04-19T03:01:38.919 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.4889999999999995e-06 2024-04-19T03:01:38.919 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:38.920 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:38.920 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:01:38.920 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.891037+0000", 2024-04-19T03:01:38.920 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.1720000000000004e-06 2024-04-19T03:01:38.920 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:38.920 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:38.920 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:38.920 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.891189+0000", 2024-04-19T03:01:38.920 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00015157500000000001 2024-04-19T03:01:38.920 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:38.920 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:38.920 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:01:38.920 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.891211+0000", 2024-04-19T03:01:38.920 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.1994e-05 2024-04-19T03:01:38.921 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:38.921 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:38.921 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:38.921 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:38.921 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:38.921 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4755.0:2951 5.8 e25/22 5:1992570c:::benchmark_data_smithi096_19531_object2950:head v 25'185, mlcod=25'181)", 2024-04-19T03:01:38.921 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:38.891072+0000", 2024-04-19T03:01:38.921 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 0.0017464749999999999, 2024-04-19T03:01:38.921 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0022300660000000002, 2024-04-19T03:01:38.921 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:01:38.921 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "started", 2024-04-19T03:01:38.921 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:01:38.921 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:38.921 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:01:38.921 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.891072+0000", 2024-04-19T03:01:38.922 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:38.922 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:38.922 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:38.922 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:01:38.922 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.891072+0000", 2024-04-19T03:01:38.922 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:38.922 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:38.922 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:38.922 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:01:38.922 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.891071+0000", 2024-04-19T03:01:38.922 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999995 2024-04-19T03:01:38.922 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:38.922 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:38.922 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:01:38.923 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.891103+0000", 2024-04-19T03:01:38.923 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1424999999999998e-05 2024-04-19T03:01:38.923 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:38.923 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:38.923 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:01:38.923 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.891111+0000", 2024-04-19T03:01:38.923 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.3769999999999996e-06 2024-04-19T03:01:38.923 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:38.923 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:38.923 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:01:38.923 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.891117+0000", 2024-04-19T03:01:38.923 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.6339999999999998e-06 2024-04-19T03:01:38.923 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:38.923 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:38.924 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:38.924 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.891196+0000", 2024-04-19T03:01:38.924 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.9233999999999994e-05 2024-04-19T03:01:38.924 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:38.924 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:38.924 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:01:38.924 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.891213+0000", 2024-04-19T03:01:38.924 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.7218999999999999e-05 2024-04-19T03:01:38.924 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:38.924 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:38.924 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:38.924 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:38.924 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:38.925 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4755.0:2953 5.a 5:5b561c2d:::benchmark_data_smithi096_19531_object2952:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-19T03:01:38.925 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:38.892438+0000", 2024-04-19T03:01:38.925 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 0.00038087499999999997, 2024-04-19T03:01:38.925 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00093608299999999999, 2024-04-19T03:01:38.925 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:01:38.925 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:01:38.925 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-04-19T03:01:38.925 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4755", 2024-04-19T03:01:38.925 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:38.925 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 2953 2024-04-19T03:01:38.925 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:38.925 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:01:38.925 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:38.926 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:01:38.926 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.892438+0000", 2024-04-19T03:01:38.926 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:38.926 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:38.926 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:38.926 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:01:38.926 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.892438+0000", 2024-04-19T03:01:38.926 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:38.926 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:38.926 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:38.926 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:01:38.926 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.892436+0000", 2024-04-19T03:01:38.926 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2024-04-19T03:01:38.927 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:38.927 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:38.927 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:01:38.927 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.892563+0000", 2024-04-19T03:01:38.927 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012649199999999999 2024-04-19T03:01:38.927 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:38.927 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:38.927 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:01:38.927 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.892571+0000", 2024-04-19T03:01:38.927 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.4039999999999995e-06 2024-04-19T03:01:38.927 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:38.927 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:38.927 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:01:38.927 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.892583+0000", 2024-04-19T03:01:38.928 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1218e-05 2024-04-19T03:01:38.928 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:38.928 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:38.928 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:38.928 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.892635+0000", 2024-04-19T03:01:38.928 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.2553999999999999e-05 2024-04-19T03:01:38.928 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:38.928 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:38.928 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:01:38.928 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.892816+0000", 2024-04-19T03:01:38.928 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000180886 2024-04-19T03:01:38.928 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:38.928 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:38.928 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 1", 2024-04-19T03:01:38.929 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.892949+0000", 2024-04-19T03:01:38.929 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00013300200000000001 2024-04-19T03:01:38.929 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:38.929 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:38.929 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:38.929 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:38.929 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:38.929 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4755.0:2956 5.c 5:3a39e2af:::benchmark_data_smithi096_19531_object2955:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-19T03:01:38.929 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:38.892596+0000", 2024-04-19T03:01:38.929 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 0.00022243499999999999, 2024-04-19T03:01:38.929 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000863596, 2024-04-19T03:01:38.929 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:01:38.929 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:01:38.929 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-04-19T03:01:38.929 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4755", 2024-04-19T03:01:38.930 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:38.930 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 2956 2024-04-19T03:01:38.930 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:38.930 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:01:38.930 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:38.930 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:01:38.930 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.892596+0000", 2024-04-19T03:01:38.930 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:38.930 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:38.930 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:38.930 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:01:38.930 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.892596+0000", 2024-04-19T03:01:38.930 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:38.931 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:38.931 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:38.931 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:01:38.931 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.892595+0000", 2024-04-19T03:01:38.931 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999995 2024-04-19T03:01:38.931 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:38.931 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:38.931 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:01:38.931 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.892635+0000", 2024-04-19T03:01:38.931 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.9252999999999998e-05 2024-04-19T03:01:38.931 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:38.931 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:38.931 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:01:38.932 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.892647+0000", 2024-04-19T03:01:38.932 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1905e-05 2024-04-19T03:01:38.932 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:38.932 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:38.932 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:01:38.932 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.892653+0000", 2024-04-19T03:01:38.932 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.0769999999999996e-06 2024-04-19T03:01:38.932 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:38.932 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:38.932 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:38.932 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.892714+0000", 2024-04-19T03:01:38.932 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.1679000000000004e-05 2024-04-19T03:01:38.932 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:38.932 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:38.933 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:01:38.933 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.892860+0000", 2024-04-19T03:01:38.933 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014546700000000001 2024-04-19T03:01:38.933 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:38.933 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:38.933 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-04-19T03:01:38.933 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.893022+0000", 2024-04-19T03:01:38.933 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00016232599999999999 2024-04-19T03:01:38.933 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:38.933 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:38.933 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:38.933 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:38.933 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:38.933 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4755.0:2957 5.c 5.b4238fbc (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-19T03:01:38.934 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:38.893253+0000", 2024-04-19T03:01:38.934 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 4294967295.9995656, 2024-04-19T03:01:38.934 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00028901699999999997, 2024-04-19T03:01:38.934 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:01:38.934 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "queued for pg", 2024-04-19T03:01:38.934 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-04-19T03:01:38.934 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4755", 2024-04-19T03:01:38.934 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:38.934 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 2957 2024-04-19T03:01:38.934 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:38.934 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:01:38.934 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:38.934 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:01:38.934 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.893253+0000", 2024-04-19T03:01:38.935 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:38.935 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:38.935 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:38.935 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:01:38.935 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.893253+0000", 2024-04-19T03:01:38.935 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:38.935 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:38.935 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:38.935 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:01:38.935 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.893252+0000", 2024-04-19T03:01:38.935 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2024-04-19T03:01:38.935 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:38.935 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:38.935 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:01:38.936 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.893287+0000", 2024-04-19T03:01:38.936 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.5172999999999997e-05 2024-04-19T03:01:38.936 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:38.936 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:38.936 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:01:38.936 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.893297+0000", 2024-04-19T03:01:38.936 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0209e-05 2024-04-19T03:01:38.936 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:38.936 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:38.936 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:01:38.936 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.893307+0000", 2024-04-19T03:01:38.936 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.3419999999999997e-06 2024-04-19T03:01:38.936 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:38.936 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:38.936 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:38.937 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:38.937 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:38.937 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4755.0:2959 5.5 5:ade08c69:::benchmark_data_smithi096_19531_object2958:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-19T03:01:38.937 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:38.893315+0000", 2024-04-19T03:01:38.937 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 4294967295.9995036, 2024-04-19T03:01:38.937 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00028700200000000001, 2024-04-19T03:01:38.937 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:01:38.937 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "started", 2024-04-19T03:01:38.937 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-04-19T03:01:38.937 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4755", 2024-04-19T03:01:38.937 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:38.937 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 2959 2024-04-19T03:01:38.937 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:38.938 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:01:38.938 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:38.938 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:01:38.938 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.893315+0000", 2024-04-19T03:01:38.938 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:38.938 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:38.938 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:38.938 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:01:38.938 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.893315+0000", 2024-04-19T03:01:38.938 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:38.938 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:38.938 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:38.938 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:01:38.938 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.893314+0000", 2024-04-19T03:01:38.939 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999995 2024-04-19T03:01:38.939 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:38.939 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:38.939 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:01:38.939 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.893347+0000", 2024-04-19T03:01:38.939 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.3086999999999997e-05 2024-04-19T03:01:38.939 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:38.939 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:38.939 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:01:38.939 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.893355+0000", 2024-04-19T03:01:38.939 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.4390000000000003e-06 2024-04-19T03:01:38.939 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:38.939 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:38.939 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:01:38.940 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.893360+0000", 2024-04-19T03:01:38.940 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.7309999999999998e-06 2024-04-19T03:01:38.940 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:38.940 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:38.940 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:38.940 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.893401+0000", 2024-04-19T03:01:38.940 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.0674999999999999e-05 2024-04-19T03:01:38.940 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:38.940 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:38.940 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:01:38.940 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.893542+0000", 2024-04-19T03:01:38.940 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014051600000000001 2024-04-19T03:01:38.940 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:38.940 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:38.941 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:38.941 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:38.941 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:38.941 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4755.0:2955 5.e e25/22 5:7270e931:::benchmark_data_smithi096_19531_object2954:head v 25'162, mlcod=25'160)", 2024-04-19T03:01:38.941 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:38.893152+0000", 2024-04-19T03:01:38.941 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 4294967295.9996662, 2024-04-19T03:01:38.941 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00051930800000000001, 2024-04-19T03:01:38.941 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:01:38.941 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "started", 2024-04-19T03:01:38.941 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:01:38.941 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:38.941 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:01:38.941 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.893152+0000", 2024-04-19T03:01:38.941 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:38.942 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:38.942 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:38.942 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:01:38.942 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.893152+0000", 2024-04-19T03:01:38.942 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:38.942 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:38.942 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:38.942 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:01:38.942 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.893152+0000", 2024-04-19T03:01:38.942 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2024-04-19T03:01:38.942 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:38.942 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:38.942 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:01:38.943 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.893319+0000", 2024-04-19T03:01:38.943 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00016777799999999999 2024-04-19T03:01:38.943 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:38.943 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:38.943 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:01:38.943 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.893363+0000", 2024-04-19T03:01:38.943 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.3327e-05 2024-04-19T03:01:38.943 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:38.943 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:38.943 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:01:38.943 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.893369+0000", 2024-04-19T03:01:38.943 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.7959999999999998e-06 2024-04-19T03:01:38.943 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:38.943 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:38.943 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:38.944 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.893483+0000", 2024-04-19T03:01:38.944 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000113231 2024-04-19T03:01:38.944 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:38.944 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:38.944 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:01:38.944 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.893500+0000", 2024-04-19T03:01:38.944 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.7218999999999999e-05 2024-04-19T03:01:38.944 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:38.944 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:38.944 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:38.944 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:38.944 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:38.944 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4755.0:2954 5.7 e25/22 5:e189aec8:::benchmark_data_smithi096_19531_object2953:head v 25'158, mlcod=25'155)", 2024-04-19T03:01:38.944 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:38.893386+0000", 2024-04-19T03:01:38.945 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 4294967295.9994326, 2024-04-19T03:01:38.945 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00035446400000000003, 2024-04-19T03:01:38.945 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:01:38.945 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "started", 2024-04-19T03:01:38.945 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:01:38.945 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:38.945 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:01:38.945 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.893386+0000", 2024-04-19T03:01:38.945 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:38.945 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:38.945 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:38.945 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:01:38.945 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.893386+0000", 2024-04-19T03:01:38.945 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:38.945 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:38.946 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:38.946 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:01:38.946 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.893385+0000", 2024-04-19T03:01:38.946 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999995 2024-04-19T03:01:38.946 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:38.946 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:38.946 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:01:38.946 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.893421+0000", 2024-04-19T03:01:38.946 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.6069999999999999e-05 2024-04-19T03:01:38.946 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:38.946 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:38.946 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:01:38.946 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.893430+0000", 2024-04-19T03:01:38.946 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.4989999999999994e-06 2024-04-19T03:01:38.947 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:38.947 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:38.947 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:01:38.947 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.893436+0000", 2024-04-19T03:01:38.947 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.4649999999999999e-06 2024-04-19T03:01:38.947 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:38.947 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:38.947 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:38.947 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.893482+0000", 2024-04-19T03:01:38.947 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.6075000000000002e-05 2024-04-19T03:01:38.947 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:38.947 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:38.947 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:01:38.947 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.893502+0000", 2024-04-19T03:01:38.947 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.9451000000000001e-05 2024-04-19T03:01:38.948 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:38.948 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:38.948 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:38.948 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:38.948 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2024-04-19T03:01:38.948 INFO:teuthology.orchestra.run.smithi097.stdout: "num_ops": 13 2024-04-19T03:01:38.948 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-04-19T03:01:38.949 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T03:01:38.967 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:01:38.965+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:01:39.070 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:01:39.068+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:01:39.087 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-04-19T03:01:39.087 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [], 2024-04-19T03:01:39.087 INFO:teuthology.orchestra.run.smithi097.stdout: "complaint_time": 30, 2024-04-19T03:01:39.087 INFO:teuthology.orchestra.run.smithi097.stdout: "num_blocked_ops": 0 2024-04-19T03:01:39.087 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-04-19T03:01:39.101 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T03:01:39.171 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:01:39.168+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:01:39.233 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-04-19T03:01:39.234 INFO:teuthology.orchestra.run.smithi097.stdout: "size": 20, 2024-04-19T03:01:39.234 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 600, 2024-04-19T03:01:39.234 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [ 2024-04-19T03:01:39.234 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.234 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:01:39.234 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:14.996966+0000", 2024-04-19T03:01:39.234 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 24.231990199999998, 2024-04-19T03:01:39.234 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.018946704000000002, 2024-04-19T03:01:39.234 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:01:39.234 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:39.234 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:01:39.235 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.235 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:01:39.235 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.996966+0000", 2024-04-19T03:01:39.235 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:39.235 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.235 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.235 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:01:39.235 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.996966+0000", 2024-04-19T03:01:39.235 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:39.235 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.235 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.235 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:01:39.235 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.996964+0000", 2024-04-19T03:01:39.235 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999971 2024-04-19T03:01:39.236 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.236 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.236 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:01:39.236 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.996982+0000", 2024-04-19T03:01:39.236 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.8306999999999999e-05 2024-04-19T03:01:39.236 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.236 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.236 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:01:39.236 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997027+0000", 2024-04-19T03:01:39.236 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.5274000000000001e-05 2024-04-19T03:01:39.236 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.236 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.236 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:01:39.236 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997047+0000", 2024-04-19T03:01:39.237 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.9726999999999999e-05 2024-04-19T03:01:39.237 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.237 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.237 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:39.237 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997203+0000", 2024-04-19T03:01:39.237 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000155847 2024-04-19T03:01:39.237 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.237 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.237 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op must wait for map", 2024-04-19T03:01:39.237 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997249+0000", 2024-04-19T03:01:39.237 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.5824e-05 2024-04-19T03:01:39.237 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.237 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.237 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:39.238 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.007264+0000", 2024-04-19T03:01:39.238 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.010015909 2024-04-19T03:01:39.238 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.238 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.238 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:01:39.238 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.007394+0000", 2024-04-19T03:01:39.238 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012931999999999999 2024-04-19T03:01:39.238 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.238 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.238 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-04-19T03:01:39.238 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.007537+0000", 2024-04-19T03:01:39.238 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014365 2024-04-19T03:01:39.238 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.238 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.239 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:01:39.239 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.012444+0000", 2024-04-19T03:01:39.239 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0049067260000000001 2024-04-19T03:01:39.239 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.239 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.239 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:39.239 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.015791+0000", 2024-04-19T03:01:39.239 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0033471109999999998 2024-04-19T03:01:39.239 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.239 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.239 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:01:39.239 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.015845+0000", 2024-04-19T03:01:39.239 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.4236e-05 2024-04-19T03:01:39.239 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.240 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.240 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:01:39.240 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.015913+0000", 2024-04-19T03:01:39.240 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.7397000000000005e-05 2024-04-19T03:01:39.240 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:39.240 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:39.240 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:39.240 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.240 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.240 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(mds.0.3:14 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:01:39.240 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:14.997079+0000", 2024-04-19T03:01:39.240 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 24.231877615999998, 2024-04-19T03:01:39.240 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.021951970000000001, 2024-04-19T03:01:39.240 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:01:39.241 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:39.241 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:01:39.241 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.241 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:01:39.241 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997079+0000", 2024-04-19T03:01:39.241 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:39.241 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.241 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.241 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:01:39.241 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997079+0000", 2024-04-19T03:01:39.241 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:39.241 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.242 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.242 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:01:39.242 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997077+0000", 2024-04-19T03:01:39.242 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999986 2024-04-19T03:01:39.242 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.242 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.242 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:01:39.242 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997087+0000", 2024-04-19T03:01:39.242 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.006e-05 2024-04-19T03:01:39.242 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.242 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.243 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:01:39.243 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997105+0000", 2024-04-19T03:01:39.243 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.8026999999999999e-05 2024-04-19T03:01:39.243 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.243 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.243 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:01:39.243 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997135+0000", 2024-04-19T03:01:39.243 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.9643000000000001e-05 2024-04-19T03:01:39.243 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.243 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.243 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:39.243 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997208+0000", 2024-04-19T03:01:39.243 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.3419999999999998e-05 2024-04-19T03:01:39.244 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.244 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.244 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op must wait for map", 2024-04-19T03:01:39.244 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997244+0000", 2024-04-19T03:01:39.244 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.5367000000000002e-05 2024-04-19T03:01:39.244 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.244 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.244 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:39.244 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.007357+0000", 2024-04-19T03:01:39.244 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.010112703000000001 2024-04-19T03:01:39.244 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.244 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.245 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:01:39.245 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.007479+0000", 2024-04-19T03:01:39.245 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012279599999999999 2024-04-19T03:01:39.245 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.245 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.245 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 1", 2024-04-19T03:01:39.245 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.007610+0000", 2024-04-19T03:01:39.245 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00013093499999999999 2024-04-19T03:01:39.245 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.245 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.245 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:01:39.245 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.012526+0000", 2024-04-19T03:01:39.245 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0049157519999999998 2024-04-19T03:01:39.245 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.246 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.246 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:39.246 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.018959+0000", 2024-04-19T03:01:39.246 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0064326009999999996 2024-04-19T03:01:39.246 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.246 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.246 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:01:39.246 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.019005+0000", 2024-04-19T03:01:39.246 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.6066999999999998e-05 2024-04-19T03:01:39.246 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.246 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.246 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:01:39.247 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.019031+0000", 2024-04-19T03:01:39.247 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.6009000000000001e-05 2024-04-19T03:01:39.247 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:39.247 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:39.247 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:39.247 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.247 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.247 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:01:39.247 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:14.997149+0000", 2024-04-19T03:01:39.247 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 24.231806996, 2024-04-19T03:01:39.247 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.021805590999999999, 2024-04-19T03:01:39.248 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:01:39.248 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:39.248 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:01:39.248 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.248 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:01:39.248 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997149+0000", 2024-04-19T03:01:39.248 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:39.248 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.248 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.248 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:01:39.248 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997149+0000", 2024-04-19T03:01:39.249 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:39.249 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.249 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.249 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:01:39.249 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997148+0000", 2024-04-19T03:01:39.249 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2024-04-19T03:01:39.249 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.249 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.249 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:01:39.249 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997166+0000", 2024-04-19T03:01:39.249 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.8233e-05 2024-04-19T03:01:39.250 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.250 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.250 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:01:39.250 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997182+0000", 2024-04-19T03:01:39.250 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5999999999999999e-05 2024-04-19T03:01:39.250 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.250 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.250 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:01:39.250 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997195+0000", 2024-04-19T03:01:39.250 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.252e-05 2024-04-19T03:01:39.251 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.251 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.251 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:39.251 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997348+0000", 2024-04-19T03:01:39.251 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000153115 2024-04-19T03:01:39.251 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.251 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.251 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:01:39.251 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997354+0000", 2024-04-19T03:01:39.251 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.9359999999999996e-06 2024-04-19T03:01:39.251 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.252 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.252 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:39.252 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.008147+0000", 2024-04-19T03:01:39.252 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.010793127 2024-04-19T03:01:39.252 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.252 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.252 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:01:39.252 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.008225+0000", 2024-04-19T03:01:39.252 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.7935999999999994e-05 2024-04-19T03:01:39.252 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.252 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.252 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-04-19T03:01:39.253 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.008377+0000", 2024-04-19T03:01:39.253 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00015159099999999999 2024-04-19T03:01:39.253 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.253 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.253 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:01:39.253 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.012629+0000", 2024-04-19T03:01:39.253 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0042520420000000001 2024-04-19T03:01:39.253 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.253 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.253 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:39.253 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.018871+0000", 2024-04-19T03:01:39.253 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0062425060000000001 2024-04-19T03:01:39.253 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.253 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.254 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:01:39.254 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.018910+0000", 2024-04-19T03:01:39.254 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.8482999999999997e-05 2024-04-19T03:01:39.254 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.254 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.254 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:01:39.254 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.018955+0000", 2024-04-19T03:01:39.254 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.5252e-05 2024-04-19T03:01:39.254 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:39.254 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:39.255 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:39.255 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.255 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.255 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(mds.0.3:36 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:01:39.255 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:14.997207+0000", 2024-04-19T03:01:39.255 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 24.231749445999998, 2024-04-19T03:01:39.255 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.022210431999999999, 2024-04-19T03:01:39.255 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:01:39.255 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:39.255 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:01:39.255 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.255 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:01:39.255 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997207+0000", 2024-04-19T03:01:39.256 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:39.256 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.256 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.256 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:01:39.256 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997207+0000", 2024-04-19T03:01:39.256 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:39.256 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.256 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.256 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:01:39.256 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997206+0000", 2024-04-19T03:01:39.256 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2024-04-19T03:01:39.257 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.257 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.257 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:01:39.257 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997218+0000", 2024-04-19T03:01:39.257 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2607e-05 2024-04-19T03:01:39.257 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.257 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.257 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:01:39.257 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997234+0000", 2024-04-19T03:01:39.257 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5583999999999999e-05 2024-04-19T03:01:39.257 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.257 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.257 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:01:39.258 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997248+0000", 2024-04-19T03:01:39.258 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4270000000000001e-05 2024-04-19T03:01:39.258 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.258 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.258 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:39.258 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997397+0000", 2024-04-19T03:01:39.258 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0001482 2024-04-19T03:01:39.258 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.258 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.258 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:01:39.258 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997407+0000", 2024-04-19T03:01:39.258 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0944000000000001e-05 2024-04-19T03:01:39.259 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.259 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.259 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:39.259 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.008173+0000", 2024-04-19T03:01:39.259 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.010765378000000001 2024-04-19T03:01:39.259 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.259 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.259 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:01:39.259 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.008278+0000", 2024-04-19T03:01:39.259 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00010538 2024-04-19T03:01:39.259 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.259 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.260 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 1", 2024-04-19T03:01:39.260 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.008423+0000", 2024-04-19T03:01:39.260 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014525599999999999 2024-04-19T03:01:39.260 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.260 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.260 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:01:39.260 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.012734+0000", 2024-04-19T03:01:39.260 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0043108590000000002 2024-04-19T03:01:39.260 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.260 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.261 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:39.261 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.019318+0000", 2024-04-19T03:01:39.261 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0065836130000000003 2024-04-19T03:01:39.261 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.261 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.261 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:01:39.261 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.019382+0000", 2024-04-19T03:01:39.261 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.3925999999999997e-05 2024-04-19T03:01:39.261 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.261 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.261 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:01:39.261 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.019417+0000", 2024-04-19T03:01:39.262 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.5454999999999999e-05 2024-04-19T03:01:39.262 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:39.262 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:39.262 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:39.262 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.262 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.262 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(mds.0.3:15 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:01:39.262 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:14.997260+0000", 2024-04-19T03:01:39.262 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 24.231696294999999, 2024-04-19T03:01:39.262 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.021842842000000001, 2024-04-19T03:01:39.262 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:01:39.263 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:39.263 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:01:39.263 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.263 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:01:39.263 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997260+0000", 2024-04-19T03:01:39.263 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:39.263 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.263 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.263 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:01:39.263 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997260+0000", 2024-04-19T03:01:39.264 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:39.264 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.264 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.264 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:01:39.264 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997259+0000", 2024-04-19T03:01:39.264 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999995 2024-04-19T03:01:39.264 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.264 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.264 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:01:39.264 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997270+0000", 2024-04-19T03:01:39.264 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0312999999999999e-05 2024-04-19T03:01:39.264 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.265 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.265 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:01:39.265 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997279+0000", 2024-04-19T03:01:39.265 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.7770000000000008e-06 2024-04-19T03:01:39.265 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.265 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.265 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:01:39.265 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997286+0000", 2024-04-19T03:01:39.265 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.0129999999999996e-06 2024-04-19T03:01:39.265 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.266 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.266 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:39.266 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997433+0000", 2024-04-19T03:01:39.266 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014774699999999999 2024-04-19T03:01:39.266 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.266 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.266 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:01:39.266 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997443+0000", 2024-04-19T03:01:39.266 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.414e-06 2024-04-19T03:01:39.266 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.267 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.267 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:39.267 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.008673+0000", 2024-04-19T03:01:39.267 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.011230789999999999 2024-04-19T03:01:39.267 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.267 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.267 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:01:39.267 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.008808+0000", 2024-04-19T03:01:39.267 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000134346 2024-04-19T03:01:39.267 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.267 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.268 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-04-19T03:01:39.268 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.008922+0000", 2024-04-19T03:01:39.268 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000114444 2024-04-19T03:01:39.268 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.268 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.268 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:01:39.268 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.013442+0000", 2024-04-19T03:01:39.268 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0045193439999999998 2024-04-19T03:01:39.268 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.268 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.268 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:39.269 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.019005+0000", 2024-04-19T03:01:39.269 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00556333 2024-04-19T03:01:39.269 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.269 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.269 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:01:39.269 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.019049+0000", 2024-04-19T03:01:39.269 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.4240000000000003e-05 2024-04-19T03:01:39.269 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.269 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.269 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:01:39.269 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.019103+0000", 2024-04-19T03:01:39.269 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.3706999999999999e-05 2024-04-19T03:01:39.270 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:39.270 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:39.270 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:39.270 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.270 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.270 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(mds.0.3:17 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:01:39.270 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:14.997292+0000", 2024-04-19T03:01:39.270 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 24.231664567999999, 2024-04-19T03:01:39.270 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.019573165999999999, 2024-04-19T03:01:39.270 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:01:39.270 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:39.270 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:01:39.270 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.271 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:01:39.271 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997292+0000", 2024-04-19T03:01:39.271 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:39.271 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.271 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.271 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:01:39.271 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997292+0000", 2024-04-19T03:01:39.271 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:39.271 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.271 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.271 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:01:39.271 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997291+0000", 2024-04-19T03:01:39.271 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999995 2024-04-19T03:01:39.272 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.272 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.272 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:01:39.272 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997297+0000", 2024-04-19T03:01:39.272 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.3900000000000001e-06 2024-04-19T03:01:39.272 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.272 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.272 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:01:39.272 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997316+0000", 2024-04-19T03:01:39.272 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.9406e-05 2024-04-19T03:01:39.272 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.273 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.273 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:01:39.273 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997353+0000", 2024-04-19T03:01:39.273 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.6563999999999998e-05 2024-04-19T03:01:39.273 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.274 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.274 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:39.274 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997447+0000", 2024-04-19T03:01:39.274 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.4463999999999995e-05 2024-04-19T03:01:39.274 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.274 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.274 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op must wait for map", 2024-04-19T03:01:39.274 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997458+0000", 2024-04-19T03:01:39.274 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0817e-05 2024-04-19T03:01:39.274 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.274 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.274 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:39.274 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.002013+0000", 2024-04-19T03:01:39.275 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.004555229 2024-04-19T03:01:39.275 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.275 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.275 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:01:39.275 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.002943+0000", 2024-04-19T03:01:39.275 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00092983200000000001 2024-04-19T03:01:39.275 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.275 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.275 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-04-19T03:01:39.275 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.003257+0000", 2024-04-19T03:01:39.275 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00031455399999999998 2024-04-19T03:01:39.275 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.275 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.275 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:01:39.276 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.014107+0000", 2024-04-19T03:01:39.276 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.010849648 2024-04-19T03:01:39.276 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.276 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.276 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:39.276 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.016767+0000", 2024-04-19T03:01:39.276 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0026594990000000001 2024-04-19T03:01:39.276 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.276 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.276 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:01:39.276 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.016825+0000", 2024-04-19T03:01:39.276 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.8264000000000003e-05 2024-04-19T03:01:39.276 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.276 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.277 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:01:39.277 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.016865+0000", 2024-04-19T03:01:39.277 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.0108999999999998e-05 2024-04-19T03:01:39.277 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:39.277 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:39.277 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:39.277 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.277 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.277 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(mds.0.3:22 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:01:39.277 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:14.997383+0000", 2024-04-19T03:01:39.277 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 24.231573787999999, 2024-04-19T03:01:39.277 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.019634641000000001, 2024-04-19T03:01:39.277 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:01:39.277 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "started", 2024-04-19T03:01:39.278 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:01:39.278 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.278 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:01:39.278 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997383+0000", 2024-04-19T03:01:39.278 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:39.278 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.278 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.278 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:01:39.278 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997383+0000", 2024-04-19T03:01:39.279 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:39.279 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.279 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.279 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:01:39.279 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997381+0000", 2024-04-19T03:01:39.279 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999986 2024-04-19T03:01:39.279 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.279 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.279 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:01:39.279 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997399+0000", 2024-04-19T03:01:39.279 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.802e-05 2024-04-19T03:01:39.279 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.279 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.279 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:01:39.280 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997417+0000", 2024-04-19T03:01:39.280 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.7581e-05 2024-04-19T03:01:39.280 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.280 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.280 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:01:39.280 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997429+0000", 2024-04-19T03:01:39.280 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1803e-05 2024-04-19T03:01:39.280 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.280 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.280 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:39.280 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997540+0000", 2024-04-19T03:01:39.280 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000111397 2024-04-19T03:01:39.280 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.280 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.280 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:01:39.281 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997552+0000", 2024-04-19T03:01:39.281 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1643e-05 2024-04-19T03:01:39.281 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.281 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.281 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:39.281 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.006836+0000", 2024-04-19T03:01:39.281 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0092841940000000008 2024-04-19T03:01:39.281 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.281 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.281 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:01:39.281 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.006982+0000", 2024-04-19T03:01:39.281 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014572899999999999 2024-04-19T03:01:39.281 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.281 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.282 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:01:39.282 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.017017+0000", 2024-04-19T03:01:39.282 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.010035571 2024-04-19T03:01:39.282 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:39.282 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:39.282 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:39.282 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.282 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.282 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(mds.0.3:23 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:01:39.282 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:14.997449+0000", 2024-04-19T03:01:39.282 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 24.231507247, 2024-04-19T03:01:39.282 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.022679250000000001, 2024-04-19T03:01:39.282 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:01:39.283 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "started", 2024-04-19T03:01:39.283 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:01:39.283 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.283 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:01:39.283 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997449+0000", 2024-04-19T03:01:39.283 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:39.283 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.283 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.283 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:01:39.283 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997449+0000", 2024-04-19T03:01:39.283 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:39.283 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.283 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.284 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:01:39.284 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997448+0000", 2024-04-19T03:01:39.284 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999995 2024-04-19T03:01:39.284 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.284 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.284 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:01:39.284 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997452+0000", 2024-04-19T03:01:39.284 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.0369999999999996e-06 2024-04-19T03:01:39.284 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.284 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.284 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:01:39.284 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997461+0000", 2024-04-19T03:01:39.284 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.6100000000000006e-06 2024-04-19T03:01:39.284 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.285 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.285 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:01:39.285 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997468+0000", 2024-04-19T03:01:39.285 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.8360000000000003e-06 2024-04-19T03:01:39.285 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.285 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.285 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:39.285 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997546+0000", 2024-04-19T03:01:39.285 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.7956999999999999e-05 2024-04-19T03:01:39.285 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.285 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.285 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:01:39.285 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997555+0000", 2024-04-19T03:01:39.285 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.2269999999999999e-06 2024-04-19T03:01:39.286 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.286 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.286 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:39.286 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.010065+0000", 2024-04-19T03:01:39.286 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.012509457999999999 2024-04-19T03:01:39.286 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.286 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.286 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:01:39.286 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.010187+0000", 2024-04-19T03:01:39.286 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000122059 2024-04-19T03:01:39.286 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.286 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.286 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:01:39.287 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.020128+0000", 2024-04-19T03:01:39.287 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0099417529999999994 2024-04-19T03:01:39.287 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:39.287 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:39.287 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:39.287 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.287 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.287 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(mds.0.3:25 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:01:39.287 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:14.997485+0000", 2024-04-19T03:01:39.287 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 24.231471781, 2024-04-19T03:01:39.287 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.021633427, 2024-04-19T03:01:39.287 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:01:39.287 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "started", 2024-04-19T03:01:39.288 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:01:39.288 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.288 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:01:39.288 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997485+0000", 2024-04-19T03:01:39.288 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:39.288 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.288 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.288 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:01:39.288 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997485+0000", 2024-04-19T03:01:39.288 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:39.288 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.288 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.288 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:01:39.289 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997484+0000", 2024-04-19T03:01:39.289 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2024-04-19T03:01:39.289 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.289 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.289 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:01:39.289 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997490+0000", 2024-04-19T03:01:39.289 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.857e-06 2024-04-19T03:01:39.289 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.289 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.289 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:01:39.289 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997505+0000", 2024-04-19T03:01:39.290 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.518e-05 2024-04-19T03:01:39.290 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.290 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.290 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:01:39.290 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997520+0000", 2024-04-19T03:01:39.290 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5026e-05 2024-04-19T03:01:39.290 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.290 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.290 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:39.290 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997607+0000", 2024-04-19T03:01:39.290 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.7107000000000005e-05 2024-04-19T03:01:39.290 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.291 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.291 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op must wait for map", 2024-04-19T03:01:39.291 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997614+0000", 2024-04-19T03:01:39.291 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.0539999999999997e-06 2024-04-19T03:01:39.291 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.291 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.291 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:39.291 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.009808+0000", 2024-04-19T03:01:39.291 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.012194371000000001 2024-04-19T03:01:39.291 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.291 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.291 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:01:39.291 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.010107+0000", 2024-04-19T03:01:39.291 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000298731 2024-04-19T03:01:39.292 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.292 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.292 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:01:39.292 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.019118+0000", 2024-04-19T03:01:39.292 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0090109839999999997 2024-04-19T03:01:39.292 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:39.292 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:39.292 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:39.292 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.292 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.292 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4755.0:1118 5.a 5:574e94d1:::benchmark_data_smithi096_19531_object1117:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-19T03:01:39.292 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:38.233189+0000", 2024-04-19T03:01:39.292 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 0.99576706199999998, 2024-04-19T03:01:39.292 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.011322258, 2024-04-19T03:01:39.293 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:01:39.293 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:39.293 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-04-19T03:01:39.293 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4755", 2024-04-19T03:01:39.293 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:39.293 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 1118 2024-04-19T03:01:39.293 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.293 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:01:39.293 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.293 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:01:39.293 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.233189+0000", 2024-04-19T03:01:39.293 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:39.293 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.293 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.293 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:01:39.294 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.233189+0000", 2024-04-19T03:01:39.294 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:39.294 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.294 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.294 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:01:39.294 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.233188+0000", 2024-04-19T03:01:39.294 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2024-04-19T03:01:39.294 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.294 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.294 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:01:39.294 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.233316+0000", 2024-04-19T03:01:39.294 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012753299999999999 2024-04-19T03:01:39.294 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.295 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.295 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:01:39.295 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.233330+0000", 2024-04-19T03:01:39.295 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4317e-05 2024-04-19T03:01:39.295 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.295 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.295 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:01:39.295 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.233348+0000", 2024-04-19T03:01:39.295 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.7989e-05 2024-04-19T03:01:39.295 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.295 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.295 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:39.295 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.233448+0000", 2024-04-19T03:01:39.295 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.9508999999999999e-05 2024-04-19T03:01:39.296 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.296 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.296 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:01:39.296 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.233570+0000", 2024-04-19T03:01:39.296 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012247199999999999 2024-04-19T03:01:39.296 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.296 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.296 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 1", 2024-04-19T03:01:39.296 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.233695+0000", 2024-04-19T03:01:39.296 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012449499999999999 2024-04-19T03:01:39.296 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.296 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.297 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:39.297 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.236730+0000", 2024-04-19T03:01:39.297 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0030358680000000002 2024-04-19T03:01:39.297 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.297 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.297 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:01:39.297 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.244431+0000", 2024-04-19T03:01:39.297 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0077005470000000003 2024-04-19T03:01:39.297 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.297 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.297 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:01:39.297 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.244472+0000", 2024-04-19T03:01:39.297 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.1443999999999998e-05 2024-04-19T03:01:39.297 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.298 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.298 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:01:39.298 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.244512+0000", 2024-04-19T03:01:39.298 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.9156999999999998e-05 2024-04-19T03:01:39.298 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:39.298 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:39.298 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:39.298 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.298 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.298 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4755.0:1286 5.3 5:cc96b4b1:::benchmark_data_smithi096_19531_object1285:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-19T03:01:39.298 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:38.298083+0000", 2024-04-19T03:01:39.298 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 0.93087299599999995, 2024-04-19T03:01:39.298 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.01153859, 2024-04-19T03:01:39.298 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:01:39.299 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:39.299 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-04-19T03:01:39.299 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4755", 2024-04-19T03:01:39.299 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:39.299 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 1286 2024-04-19T03:01:39.299 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.299 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:01:39.299 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.299 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:01:39.299 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.298083+0000", 2024-04-19T03:01:39.299 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:39.300 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.300 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.300 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:01:39.300 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.298083+0000", 2024-04-19T03:01:39.300 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:39.300 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.300 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.300 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:01:39.300 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.298083+0000", 2024-04-19T03:01:39.300 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999995 2024-04-19T03:01:39.300 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.301 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.301 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:01:39.301 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.298174+0000", 2024-04-19T03:01:39.301 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.1042e-05 2024-04-19T03:01:39.301 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.301 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.301 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:01:39.301 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.298182+0000", 2024-04-19T03:01:39.301 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.8639999999999996e-06 2024-04-19T03:01:39.301 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.301 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.301 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:01:39.301 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.298189+0000", 2024-04-19T03:01:39.301 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.8109999999999997e-06 2024-04-19T03:01:39.302 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.302 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.302 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:39.302 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.302217+0000", 2024-04-19T03:01:39.302 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0040280519999999998 2024-04-19T03:01:39.302 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.302 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.302 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:01:39.302 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.302301+0000", 2024-04-19T03:01:39.302 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.4470999999999998e-05 2024-04-19T03:01:39.302 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.302 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.302 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-04-19T03:01:39.302 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.302408+0000", 2024-04-19T03:01:39.303 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000106859 2024-04-19T03:01:39.303 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.303 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.303 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:39.303 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.304746+0000", 2024-04-19T03:01:39.303 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0023379120000000001 2024-04-19T03:01:39.303 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.303 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.303 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:01:39.303 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.309539+0000", 2024-04-19T03:01:39.303 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0047926740000000002 2024-04-19T03:01:39.303 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.303 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.303 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:01:39.304 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.309587+0000", 2024-04-19T03:01:39.304 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.8605e-05 2024-04-19T03:01:39.304 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.304 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.304 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:01:39.304 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.309622+0000", 2024-04-19T03:01:39.304 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.4835000000000001e-05 2024-04-19T03:01:39.304 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:39.304 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:39.304 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:39.304 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.304 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.304 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4755.0:1287 5.3 5:cd0a836c:::benchmark_data_smithi096_19531_object1286:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-19T03:01:39.304 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:38.298199+0000", 2024-04-19T03:01:39.305 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 0.93075780500000005, 2024-04-19T03:01:39.305 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.011479652, 2024-04-19T03:01:39.305 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:01:39.305 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:39.305 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-04-19T03:01:39.305 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4755", 2024-04-19T03:01:39.305 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:39.305 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 1287 2024-04-19T03:01:39.305 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.305 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:01:39.305 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.305 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:01:39.305 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.298199+0000", 2024-04-19T03:01:39.305 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:39.306 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.306 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.306 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:01:39.306 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.298199+0000", 2024-04-19T03:01:39.306 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:39.306 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.306 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.306 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:01:39.306 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.298198+0000", 2024-04-19T03:01:39.306 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999995 2024-04-19T03:01:39.306 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.306 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.306 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:01:39.306 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.298257+0000", 2024-04-19T03:01:39.307 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.9268000000000002e-05 2024-04-19T03:01:39.307 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.307 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.307 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:01:39.307 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.298268+0000", 2024-04-19T03:01:39.307 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0829000000000001e-05 2024-04-19T03:01:39.307 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.307 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.307 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:01:39.307 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.298274+0000", 2024-04-19T03:01:39.307 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.7810000000000002e-06 2024-04-19T03:01:39.307 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.307 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.307 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:39.308 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.303347+0000", 2024-04-19T03:01:39.308 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0050733549999999999 2024-04-19T03:01:39.308 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.308 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.308 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:01:39.308 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.303449+0000", 2024-04-19T03:01:39.308 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000101716 2024-04-19T03:01:39.308 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.308 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.308 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-04-19T03:01:39.309 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.303574+0000", 2024-04-19T03:01:39.309 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012509899999999999 2024-04-19T03:01:39.309 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.309 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.309 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:39.309 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.305521+0000", 2024-04-19T03:01:39.309 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001947107 2024-04-19T03:01:39.309 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.309 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.309 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:01:39.309 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.309631+0000", 2024-04-19T03:01:39.309 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0041096789999999998 2024-04-19T03:01:39.309 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.309 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.310 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:01:39.310 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.309658+0000", 2024-04-19T03:01:39.310 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.7466000000000001e-05 2024-04-19T03:01:39.310 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.310 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.310 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:01:39.310 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.309678+0000", 2024-04-19T03:01:39.310 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.0027999999999999e-05 2024-04-19T03:01:39.310 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:39.310 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:39.310 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:39.310 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.311 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.311 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4755.0:2541 5.a 5:559851b8:::benchmark_data_smithi096_19531_object2540:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-19T03:01:39.311 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:38.734628+0000", 2024-04-19T03:01:39.311 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 0.49432860499999998, 2024-04-19T03:01:39.311 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.011852089999999999, 2024-04-19T03:01:39.311 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:01:39.311 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:39.311 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-04-19T03:01:39.311 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4755", 2024-04-19T03:01:39.311 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:39.311 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 2541 2024-04-19T03:01:39.311 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.311 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:01:39.312 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.312 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:01:39.312 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.734628+0000", 2024-04-19T03:01:39.312 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:39.312 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.312 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.312 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:01:39.312 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.734628+0000", 2024-04-19T03:01:39.312 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:39.312 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.312 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.312 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:01:39.312 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.734627+0000", 2024-04-19T03:01:39.313 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2024-04-19T03:01:39.313 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.313 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.313 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:01:39.313 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.734717+0000", 2024-04-19T03:01:39.313 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.0206999999999999e-05 2024-04-19T03:01:39.313 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.313 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.313 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:01:39.313 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.734737+0000", 2024-04-19T03:01:39.313 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.0265999999999999e-05 2024-04-19T03:01:39.313 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.313 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.313 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:01:39.314 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.734744+0000", 2024-04-19T03:01:39.314 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.4409999999999998e-06 2024-04-19T03:01:39.314 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.314 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.314 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:39.314 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.735425+0000", 2024-04-19T03:01:39.314 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00068099899999999995 2024-04-19T03:01:39.314 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.314 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.314 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:01:39.314 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.735565+0000", 2024-04-19T03:01:39.314 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014048500000000001 2024-04-19T03:01:39.315 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.315 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.315 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 1", 2024-04-19T03:01:39.315 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.735733+0000", 2024-04-19T03:01:39.315 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00016728700000000001 2024-04-19T03:01:39.315 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.315 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.315 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:39.315 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.741844+0000", 2024-04-19T03:01:39.315 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0061117690000000004 2024-04-19T03:01:39.315 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.315 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.315 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:01:39.315 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.746401+0000", 2024-04-19T03:01:39.316 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0045563899999999996 2024-04-19T03:01:39.316 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.316 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.316 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:01:39.316 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.746446+0000", 2024-04-19T03:01:39.316 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.5417999999999998e-05 2024-04-19T03:01:39.316 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.316 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.316 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:01:39.316 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.746480+0000", 2024-04-19T03:01:39.316 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.3563999999999999e-05 2024-04-19T03:01:39.316 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:39.316 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:39.317 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:39.317 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.317 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.317 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4755.0:2554 5.a 5:578b51bf:::benchmark_data_smithi096_19531_object2553:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-19T03:01:39.317 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:38.737533+0000", 2024-04-19T03:01:39.317 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 0.49142372400000001, 2024-04-19T03:01:39.317 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.011966071999999999, 2024-04-19T03:01:39.317 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:01:39.317 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:39.317 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-04-19T03:01:39.317 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4755", 2024-04-19T03:01:39.317 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:39.317 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 2554 2024-04-19T03:01:39.318 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.318 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:01:39.318 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.318 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:01:39.318 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.737533+0000", 2024-04-19T03:01:39.318 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:39.318 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.318 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.318 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:01:39.318 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.737533+0000", 2024-04-19T03:01:39.318 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:39.318 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.319 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.319 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:01:39.319 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.737532+0000", 2024-04-19T03:01:39.319 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999995 2024-04-19T03:01:39.319 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.319 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.319 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:01:39.319 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.737629+0000", 2024-04-19T03:01:39.319 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.7090999999999996e-05 2024-04-19T03:01:39.319 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.319 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.319 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:01:39.319 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.737646+0000", 2024-04-19T03:01:39.320 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.7263999999999999e-05 2024-04-19T03:01:39.320 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.320 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.320 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:01:39.320 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.737656+0000", 2024-04-19T03:01:39.320 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.4380000000000001e-06 2024-04-19T03:01:39.320 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.320 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.320 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:39.320 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.745271+0000", 2024-04-19T03:01:39.320 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0076152549999999996 2024-04-19T03:01:39.320 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.320 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.321 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:01:39.321 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.745380+0000", 2024-04-19T03:01:39.321 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00010886 2024-04-19T03:01:39.321 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.321 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.321 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 1", 2024-04-19T03:01:39.321 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.745534+0000", 2024-04-19T03:01:39.321 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00015456000000000001 2024-04-19T03:01:39.321 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.321 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.321 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:01:39.321 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.748168+0000", 2024-04-19T03:01:39.321 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0026332959999999998 2024-04-19T03:01:39.321 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.322 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.322 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:39.322 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.748839+0000", 2024-04-19T03:01:39.322 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00067164000000000004 2024-04-19T03:01:39.322 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.322 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.322 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:01:39.322 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.749453+0000", 2024-04-19T03:01:39.322 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00061381700000000001 2024-04-19T03:01:39.322 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.322 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.322 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:01:39.322 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.749499+0000", 2024-04-19T03:01:39.322 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.5507000000000003e-05 2024-04-19T03:01:39.323 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:39.323 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:39.323 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:39.323 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.323 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.323 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4755.0:3004 5.6 5:658337c5:::benchmark_data_smithi096_19531_object3003:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-19T03:01:39.323 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:38.908609+0000", 2024-04-19T03:01:39.323 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 0.32034779600000002, 2024-04-19T03:01:39.323 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.011722379, 2024-04-19T03:01:39.323 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:01:39.323 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:39.323 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-04-19T03:01:39.323 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4755", 2024-04-19T03:01:39.323 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:39.324 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 3004 2024-04-19T03:01:39.324 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.324 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:01:39.324 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.324 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:01:39.324 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.908609+0000", 2024-04-19T03:01:39.324 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:39.324 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.324 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.324 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:01:39.324 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.908609+0000", 2024-04-19T03:01:39.324 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:39.324 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.324 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.325 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:01:39.325 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.908608+0000", 2024-04-19T03:01:39.325 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999995 2024-04-19T03:01:39.325 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.325 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.325 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:01:39.325 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.908675+0000", 2024-04-19T03:01:39.325 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.7108999999999997e-05 2024-04-19T03:01:39.325 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.325 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.325 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:01:39.325 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.908686+0000", 2024-04-19T03:01:39.325 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0732e-05 2024-04-19T03:01:39.325 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.326 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.326 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:01:39.326 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.908694+0000", 2024-04-19T03:01:39.326 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.2930000000000001e-06 2024-04-19T03:01:39.326 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.326 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.326 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:39.326 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.912596+0000", 2024-04-19T03:01:39.326 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.003902422 2024-04-19T03:01:39.326 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.326 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.326 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:01:39.326 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.912740+0000", 2024-04-19T03:01:39.326 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014406099999999999 2024-04-19T03:01:39.327 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.327 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.327 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-04-19T03:01:39.327 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.912936+0000", 2024-04-19T03:01:39.327 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00019509599999999999 2024-04-19T03:01:39.327 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.327 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.327 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:39.327 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.917445+0000", 2024-04-19T03:01:39.327 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0045092750000000001 2024-04-19T03:01:39.327 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.327 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.327 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:01:39.327 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.920257+0000", 2024-04-19T03:01:39.328 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0028124640000000002 2024-04-19T03:01:39.328 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.328 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.328 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:01:39.328 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.920296+0000", 2024-04-19T03:01:39.328 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.8478e-05 2024-04-19T03:01:39.328 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.328 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.328 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:01:39.328 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.920331+0000", 2024-04-19T03:01:39.328 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.5162e-05 2024-04-19T03:01:39.328 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:39.328 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:39.328 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:39.328 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.329 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.329 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4755.0:3801 5.3 5:c840485b:::benchmark_data_smithi096_19531_object3800:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-19T03:01:39.329 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:39.210152+0000", 2024-04-19T03:01:39.329 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 0.018804669999999999, 2024-04-19T03:01:39.329 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.011245458, 2024-04-19T03:01:39.329 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:01:39.329 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:39.329 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-04-19T03:01:39.329 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4755", 2024-04-19T03:01:39.329 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:39.329 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 3801 2024-04-19T03:01:39.329 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.329 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:01:39.329 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.330 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:01:39.330 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:39.210152+0000", 2024-04-19T03:01:39.330 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:39.330 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.330 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.330 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:01:39.330 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:39.210152+0000", 2024-04-19T03:01:39.330 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:39.330 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.330 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.330 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:01:39.331 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:39.210151+0000", 2024-04-19T03:01:39.331 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2024-04-19T03:01:39.331 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.331 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.331 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:01:39.331 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:39.210260+0000", 2024-04-19T03:01:39.331 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000108962 2024-04-19T03:01:39.331 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.331 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.331 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:01:39.331 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:39.210281+0000", 2024-04-19T03:01:39.331 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.1013e-05 2024-04-19T03:01:39.331 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.331 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.332 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:01:39.332 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:39.210306+0000", 2024-04-19T03:01:39.332 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.5503e-05 2024-04-19T03:01:39.332 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.332 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.332 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:39.332 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:39.210375+0000", 2024-04-19T03:01:39.332 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.8360000000000003e-05 2024-04-19T03:01:39.332 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.332 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.332 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:01:39.332 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:39.210494+0000", 2024-04-19T03:01:39.332 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000119154 2024-04-19T03:01:39.333 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.333 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.333 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-04-19T03:01:39.333 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:39.210624+0000", 2024-04-19T03:01:39.333 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00013040600000000001 2024-04-19T03:01:39.333 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.333 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.333 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:01:39.333 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:39.212957+0000", 2024-04-19T03:01:39.333 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0023325630000000002 2024-04-19T03:01:39.333 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.333 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.333 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:39.333 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:39.221325+0000", 2024-04-19T03:01:39.334 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0083684439999999992 2024-04-19T03:01:39.334 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.334 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.334 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:01:39.334 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:39.221358+0000", 2024-04-19T03:01:39.334 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.3114999999999997e-05 2024-04-19T03:01:39.334 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.334 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.334 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:01:39.334 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:39.221397+0000", 2024-04-19T03:01:39.334 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.8846e-05 2024-04-19T03:01:39.334 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:39.334 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:39.334 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:39.335 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.335 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.335 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4755.0:3803 5.6 5:678d4a6b:::benchmark_data_smithi096_19531_object3802:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-19T03:01:39.335 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:39.210318+0000", 2024-04-19T03:01:39.335 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 0.018638049, 2024-04-19T03:01:39.335 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.013528874, 2024-04-19T03:01:39.335 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:01:39.335 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:39.335 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-04-19T03:01:39.335 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4755", 2024-04-19T03:01:39.335 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:39.335 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 3803 2024-04-19T03:01:39.335 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.335 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:01:39.336 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.336 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:01:39.336 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:39.210318+0000", 2024-04-19T03:01:39.336 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:39.336 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.336 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.336 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:01:39.336 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:39.210318+0000", 2024-04-19T03:01:39.336 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:39.336 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.336 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.336 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:01:39.336 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:39.210318+0000", 2024-04-19T03:01:39.336 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2024-04-19T03:01:39.336 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.337 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.337 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:01:39.337 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:39.210411+0000", 2024-04-19T03:01:39.337 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.2949999999999996e-05 2024-04-19T03:01:39.337 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.337 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.337 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:01:39.337 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:39.210423+0000", 2024-04-19T03:01:39.337 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2119e-05 2024-04-19T03:01:39.337 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.337 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.337 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:01:39.337 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:39.210429+0000", 2024-04-19T03:01:39.337 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.5409999999999997e-06 2024-04-19T03:01:39.338 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.338 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.338 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:39.338 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:39.210477+0000", 2024-04-19T03:01:39.338 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.7673999999999998e-05 2024-04-19T03:01:39.338 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.338 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.338 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:01:39.338 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:39.210609+0000", 2024-04-19T03:01:39.338 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00013191400000000001 2024-04-19T03:01:39.338 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.338 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.338 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-04-19T03:01:39.339 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:39.210755+0000", 2024-04-19T03:01:39.339 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014639699999999999 2024-04-19T03:01:39.339 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.339 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.339 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:01:39.339 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:39.215050+0000", 2024-04-19T03:01:39.339 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0042952060000000002 2024-04-19T03:01:39.339 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.339 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.339 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:39.339 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:39.223788+0000", 2024-04-19T03:01:39.339 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0087373529999999998 2024-04-19T03:01:39.339 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.339 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.340 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:01:39.340 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:39.223822+0000", 2024-04-19T03:01:39.340 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.4545000000000002e-05 2024-04-19T03:01:39.340 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.340 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.340 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:01:39.340 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:39.223847+0000", 2024-04-19T03:01:39.340 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.4899e-05 2024-04-19T03:01:39.340 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:39.340 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:39.340 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:39.340 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.340 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.340 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4755.0:3804 5.6 5:631563b7:::benchmark_data_smithi096_19531_object3803:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-19T03:01:39.340 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:39.211389+0000", 2024-04-19T03:01:39.341 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 0.017567358000000002, 2024-04-19T03:01:39.341 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.012667085999999999, 2024-04-19T03:01:39.341 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:01:39.341 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:39.341 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-04-19T03:01:39.341 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4755", 2024-04-19T03:01:39.341 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:39.341 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 3804 2024-04-19T03:01:39.341 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.341 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:01:39.341 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.341 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:01:39.341 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:39.211389+0000", 2024-04-19T03:01:39.341 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:39.342 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.342 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.342 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:01:39.342 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:39.211389+0000", 2024-04-19T03:01:39.342 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:39.342 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.342 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.342 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:01:39.342 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:39.211388+0000", 2024-04-19T03:01:39.342 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999986 2024-04-19T03:01:39.342 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.342 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.342 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:01:39.342 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:39.211460+0000", 2024-04-19T03:01:39.343 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.2653999999999999e-05 2024-04-19T03:01:39.343 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.343 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.343 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:01:39.343 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:39.211472+0000", 2024-04-19T03:01:39.343 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1549000000000001e-05 2024-04-19T03:01:39.343 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.343 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.343 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:01:39.343 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:39.211481+0000", 2024-04-19T03:01:39.343 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.6680000000000007e-06 2024-04-19T03:01:39.343 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.343 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.343 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:39.344 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:39.211711+0000", 2024-04-19T03:01:39.344 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00023037700000000001 2024-04-19T03:01:39.344 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.344 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.344 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:01:39.344 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:39.211817+0000", 2024-04-19T03:01:39.344 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000105524 2024-04-19T03:01:39.344 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.344 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.344 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-04-19T03:01:39.344 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:39.211899+0000", 2024-04-19T03:01:39.344 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.1926000000000001e-05 2024-04-19T03:01:39.344 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.344 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.345 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:01:39.345 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:39.215057+0000", 2024-04-19T03:01:39.345 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0031585279999999999 2024-04-19T03:01:39.345 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.345 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.345 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:39.345 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:39.223976+0000", 2024-04-19T03:01:39.345 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.008918469 2024-04-19T03:01:39.345 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.345 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.345 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:01:39.345 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:39.224017+0000", 2024-04-19T03:01:39.345 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.1652e-05 2024-04-19T03:01:39.345 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.346 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.346 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:01:39.346 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:39.224056+0000", 2024-04-19T03:01:39.346 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.8936000000000001e-05 2024-04-19T03:01:39.346 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:39.346 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:39.346 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:39.346 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.346 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.346 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4755.0:3805 5.6 5:67ca77e0:::benchmark_data_smithi096_19531_object3804:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-19T03:01:39.346 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:39.211489+0000", 2024-04-19T03:01:39.346 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 0.017467652, 2024-04-19T03:01:39.346 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.012727723999999999, 2024-04-19T03:01:39.347 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:01:39.347 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:39.347 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-04-19T03:01:39.347 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4755", 2024-04-19T03:01:39.347 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:39.347 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 3805 2024-04-19T03:01:39.347 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.347 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:01:39.347 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.347 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:01:39.347 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:39.211489+0000", 2024-04-19T03:01:39.347 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:39.347 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.347 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.347 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:01:39.348 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:39.211489+0000", 2024-04-19T03:01:39.348 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:39.348 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.348 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.348 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:01:39.348 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:39.211488+0000", 2024-04-19T03:01:39.348 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999995 2024-04-19T03:01:39.348 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.348 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.348 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:01:39.348 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:39.211528+0000", 2024-04-19T03:01:39.348 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.9740000000000002e-05 2024-04-19T03:01:39.348 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.348 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.349 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:01:39.349 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:39.211536+0000", 2024-04-19T03:01:39.349 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.9130000000000003e-06 2024-04-19T03:01:39.349 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.349 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.349 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:01:39.349 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:39.211542+0000", 2024-04-19T03:01:39.349 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.8599999999999998e-06 2024-04-19T03:01:39.349 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.349 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.349 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:39.349 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:39.213004+0000", 2024-04-19T03:01:39.349 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0014621160000000001 2024-04-19T03:01:39.349 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.349 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.350 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:01:39.350 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:39.213139+0000", 2024-04-19T03:01:39.350 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00013563299999999999 2024-04-19T03:01:39.350 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.350 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.350 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-04-19T03:01:39.350 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:39.213227+0000", 2024-04-19T03:01:39.350 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.7322000000000002e-05 2024-04-19T03:01:39.350 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.350 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.350 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:01:39.350 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:39.215063+0000", 2024-04-19T03:01:39.350 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0018363629999999999 2024-04-19T03:01:39.351 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.351 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.351 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:39.351 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:39.224122+0000", 2024-04-19T03:01:39.351 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0090587979999999999 2024-04-19T03:01:39.351 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.351 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.351 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:01:39.351 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:39.224176+0000", 2024-04-19T03:01:39.351 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.4645999999999998e-05 2024-04-19T03:01:39.351 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.351 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.351 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:01:39.351 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:39.224216+0000", 2024-04-19T03:01:39.351 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.9956000000000002e-05 2024-04-19T03:01:39.352 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:39.352 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:39.352 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:39.352 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.352 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.352 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4755.0:3807 5.6 5:668f066b:::benchmark_data_smithi096_19531_object3806:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-19T03:01:39.352 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:39.212665+0000", 2024-04-19T03:01:39.352 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 0.016291408, 2024-04-19T03:01:39.352 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.011688258999999999, 2024-04-19T03:01:39.352 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:01:39.352 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:39.352 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-04-19T03:01:39.352 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4755", 2024-04-19T03:01:39.353 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:39.353 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 3807 2024-04-19T03:01:39.353 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.353 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:01:39.353 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.353 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:01:39.353 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:39.212665+0000", 2024-04-19T03:01:39.353 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:39.353 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.353 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.353 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:01:39.353 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:39.212665+0000", 2024-04-19T03:01:39.353 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:39.353 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.354 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.354 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:01:39.354 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:39.212664+0000", 2024-04-19T03:01:39.354 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2024-04-19T03:01:39.354 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.354 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.354 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:01:39.354 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:39.212736+0000", 2024-04-19T03:01:39.354 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.2078999999999999e-05 2024-04-19T03:01:39.354 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.354 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.354 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:01:39.354 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:39.212747+0000", 2024-04-19T03:01:39.355 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1089e-05 2024-04-19T03:01:39.355 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.355 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.355 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:01:39.355 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:39.212754+0000", 2024-04-19T03:01:39.355 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.058e-06 2024-04-19T03:01:39.355 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.355 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.355 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:39.355 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:39.214124+0000", 2024-04-19T03:01:39.355 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0013694619999999999 2024-04-19T03:01:39.355 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.355 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.355 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:01:39.355 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:39.214218+0000", 2024-04-19T03:01:39.356 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.4668999999999998e-05 2024-04-19T03:01:39.356 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.356 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.356 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-04-19T03:01:39.356 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:39.214308+0000", 2024-04-19T03:01:39.356 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.9635000000000005e-05 2024-04-19T03:01:39.356 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.356 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.356 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:01:39.356 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:39.215513+0000", 2024-04-19T03:01:39.356 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0012048600000000001 2024-04-19T03:01:39.356 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.356 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.356 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:39.357 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:39.224264+0000", 2024-04-19T03:01:39.357 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0087506470000000003 2024-04-19T03:01:39.357 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.357 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.357 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:01:39.357 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:39.224312+0000", 2024-04-19T03:01:39.357 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.8854999999999999e-05 2024-04-19T03:01:39.357 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:39.357 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:39.357 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:01:39.357 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:39.224353+0000", 2024-04-19T03:01:39.357 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.0815000000000001e-05 2024-04-19T03:01:39.357 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:39.357 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:39.358 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:39.358 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:39.358 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:39.358 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-04-19T03:01:39.359 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:01:39.357+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:01:39.360 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --admin-daemon /var/run/ceph/ceph-client.0.asok objecter_requests 2024-04-19T03:01:39.361 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T03:01:39.460 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-04-19T03:01:39.453+0000 7f35986ab700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18243) UID: 0 2024-04-19T03:01:39.473 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-04-19T03:01:39.473 INFO:teuthology.orchestra.run.smithi096.stdout: "ops": [ 2024-04-19T03:01:39.473 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-19T03:01:39.473 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 4479, 2024-04-19T03:01:39.473 INFO:teuthology.orchestra.run.smithi096.stdout: "pg": "5.13e440da", 2024-04-19T03:01:39.473 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": 0, 2024-04-19T03:01:39.474 INFO:teuthology.orchestra.run.smithi096.stdout: "object_id": "benchmark_data_smithi096_19531_object4478", 2024-04-19T03:01:39.474 INFO:teuthology.orchestra.run.smithi096.stdout: "object_locator": "@5", 2024-04-19T03:01:39.474 INFO:teuthology.orchestra.run.smithi096.stdout: "target_object_id": "benchmark_data_smithi096_19531_object4478", 2024-04-19T03:01:39.474 INFO:teuthology.orchestra.run.smithi096.stdout: "target_object_locator": "@5", 2024-04-19T03:01:39.474 INFO:teuthology.orchestra.run.smithi096.stdout: "paused": 0, 2024-04-19T03:01:39.474 INFO:teuthology.orchestra.run.smithi096.stdout: "used_replica": 0, 2024-04-19T03:01:39.475 INFO:teuthology.orchestra.run.smithi096.stdout: "precalc_pgid": 0, 2024-04-19T03:01:39.475 INFO:teuthology.orchestra.run.smithi096.stdout: "last_sent": "634.605513s", 2024-04-19T03:01:39.475 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 0.0039999199999999997, 2024-04-19T03:01:39.475 INFO:teuthology.orchestra.run.smithi096.stdout: "attempts": 1, 2024-04-19T03:01:39.475 INFO:teuthology.orchestra.run.smithi096.stdout: "snapid": "head", 2024-04-19T03:01:39.475 INFO:teuthology.orchestra.run.smithi096.stdout: "snap_context": "0=[]", 2024-04-19T03:01:39.475 INFO:teuthology.orchestra.run.smithi096.stdout: "mtime": "2024-04-19T03:01:39.469807+0000", 2024-04-19T03:01:39.475 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_ops": [ 2024-04-19T03:01:39.475 INFO:teuthology.orchestra.run.smithi096.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-04-19T03:01:39.475 INFO:teuthology.orchestra.run.smithi096.stdout: "write 0~65536 in=65536b" 2024-04-19T03:01:39.475 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-19T03:01:39.475 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-19T03:01:39.475 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-19T03:01:39.475 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 4482, 2024-04-19T03:01:39.476 INFO:teuthology.orchestra.run.smithi096.stdout: "pg": "5.f5e40736", 2024-04-19T03:01:39.476 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": 0, 2024-04-19T03:01:39.477 INFO:teuthology.orchestra.run.smithi096.stdout: "object_id": "benchmark_data_smithi096_19531_object4481", 2024-04-19T03:01:39.477 INFO:teuthology.orchestra.run.smithi096.stdout: "object_locator": "@5", 2024-04-19T03:01:39.477 INFO:teuthology.orchestra.run.smithi096.stdout: "target_object_id": "benchmark_data_smithi096_19531_object4481", 2024-04-19T03:01:39.477 INFO:teuthology.orchestra.run.smithi096.stdout: "target_object_locator": "@5", 2024-04-19T03:01:39.477 INFO:teuthology.orchestra.run.smithi096.stdout: "paused": 0, 2024-04-19T03:01:39.477 INFO:teuthology.orchestra.run.smithi096.stdout: "used_replica": 0, 2024-04-19T03:01:39.477 INFO:teuthology.orchestra.run.smithi096.stdout: "precalc_pgid": 0, 2024-04-19T03:01:39.478 INFO:teuthology.orchestra.run.smithi096.stdout: "last_sent": "634.605513s", 2024-04-19T03:01:39.478 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 0.0039999199999999997, 2024-04-19T03:01:39.478 INFO:teuthology.orchestra.run.smithi096.stdout: "attempts": 1, 2024-04-19T03:01:39.478 INFO:teuthology.orchestra.run.smithi096.stdout: "snapid": "head", 2024-04-19T03:01:39.478 INFO:teuthology.orchestra.run.smithi096.stdout: "snap_context": "0=[]", 2024-04-19T03:01:39.478 INFO:teuthology.orchestra.run.smithi096.stdout: "mtime": "2024-04-19T03:01:39.470004+0000", 2024-04-19T03:01:39.478 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_ops": [ 2024-04-19T03:01:39.478 INFO:teuthology.orchestra.run.smithi096.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-04-19T03:01:39.478 INFO:teuthology.orchestra.run.smithi096.stdout: "write 0~65536 in=65536b" 2024-04-19T03:01:39.478 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-19T03:01:39.478 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-19T03:01:39.478 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-19T03:01:39.479 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 4484, 2024-04-19T03:01:39.479 INFO:teuthology.orchestra.run.smithi096.stdout: "pg": "5.71d4ad2c", 2024-04-19T03:01:39.479 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": 0, 2024-04-19T03:01:39.479 INFO:teuthology.orchestra.run.smithi096.stdout: "object_id": "benchmark_data_smithi096_19531_object4483", 2024-04-19T03:01:39.479 INFO:teuthology.orchestra.run.smithi096.stdout: "object_locator": "@5", 2024-04-19T03:01:39.479 INFO:teuthology.orchestra.run.smithi096.stdout: "target_object_id": "benchmark_data_smithi096_19531_object4483", 2024-04-19T03:01:39.479 INFO:teuthology.orchestra.run.smithi096.stdout: "target_object_locator": "@5", 2024-04-19T03:01:39.479 INFO:teuthology.orchestra.run.smithi096.stdout: "paused": 0, 2024-04-19T03:01:39.479 INFO:teuthology.orchestra.run.smithi096.stdout: "used_replica": 0, 2024-04-19T03:01:39.480 INFO:teuthology.orchestra.run.smithi096.stdout: "precalc_pgid": 0, 2024-04-19T03:01:39.480 INFO:teuthology.orchestra.run.smithi096.stdout: "last_sent": "634.605513s", 2024-04-19T03:01:39.480 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 0.0039999199999999997, 2024-04-19T03:01:39.480 INFO:teuthology.orchestra.run.smithi096.stdout: "attempts": 1, 2024-04-19T03:01:39.480 INFO:teuthology.orchestra.run.smithi096.stdout: "snapid": "head", 2024-04-19T03:01:39.480 INFO:teuthology.orchestra.run.smithi096.stdout: "snap_context": "0=[]", 2024-04-19T03:01:39.480 INFO:teuthology.orchestra.run.smithi096.stdout: "mtime": "2024-04-19T03:01:39.470084+0000", 2024-04-19T03:01:39.480 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_ops": [ 2024-04-19T03:01:39.480 INFO:teuthology.orchestra.run.smithi096.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-04-19T03:01:39.480 INFO:teuthology.orchestra.run.smithi096.stdout: "write 0~65536 in=65536b" 2024-04-19T03:01:39.480 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-19T03:01:39.481 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-19T03:01:39.481 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-19T03:01:39.481 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 4487, 2024-04-19T03:01:39.481 INFO:teuthology.orchestra.run.smithi096.stdout: "pg": "5.9974e393", 2024-04-19T03:01:39.481 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": 0, 2024-04-19T03:01:39.481 INFO:teuthology.orchestra.run.smithi096.stdout: "object_id": "benchmark_data_smithi096_19531_object4486", 2024-04-19T03:01:39.481 INFO:teuthology.orchestra.run.smithi096.stdout: "object_locator": "@5", 2024-04-19T03:01:39.481 INFO:teuthology.orchestra.run.smithi096.stdout: "target_object_id": "benchmark_data_smithi096_19531_object4486", 2024-04-19T03:01:39.481 INFO:teuthology.orchestra.run.smithi096.stdout: "target_object_locator": "@5", 2024-04-19T03:01:39.481 INFO:teuthology.orchestra.run.smithi096.stdout: "paused": 0, 2024-04-19T03:01:39.481 INFO:teuthology.orchestra.run.smithi096.stdout: "used_replica": 0, 2024-04-19T03:01:39.481 INFO:teuthology.orchestra.run.smithi096.stdout: "precalc_pgid": 0, 2024-04-19T03:01:39.481 INFO:teuthology.orchestra.run.smithi096.stdout: "last_sent": "634.609513s", 2024-04-19T03:01:39.482 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 0, 2024-04-19T03:01:39.482 INFO:teuthology.orchestra.run.smithi096.stdout: "attempts": 1, 2024-04-19T03:01:39.482 INFO:teuthology.orchestra.run.smithi096.stdout: "snapid": "head", 2024-04-19T03:01:39.482 INFO:teuthology.orchestra.run.smithi096.stdout: "snap_context": "0=[]", 2024-04-19T03:01:39.482 INFO:teuthology.orchestra.run.smithi096.stdout: "mtime": "2024-04-19T03:01:39.471583+0000", 2024-04-19T03:01:39.482 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_ops": [ 2024-04-19T03:01:39.483 INFO:teuthology.orchestra.run.smithi096.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-04-19T03:01:39.483 INFO:teuthology.orchestra.run.smithi096.stdout: "write 0~65536 in=65536b" 2024-04-19T03:01:39.483 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-19T03:01:39.483 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-19T03:01:39.483 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-19T03:01:39.483 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 4488, 2024-04-19T03:01:39.483 INFO:teuthology.orchestra.run.smithi096.stdout: "pg": "5.998273e6", 2024-04-19T03:01:39.483 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": 0, 2024-04-19T03:01:39.483 INFO:teuthology.orchestra.run.smithi096.stdout: "object_id": "benchmark_data_smithi096_19531_object4487", 2024-04-19T03:01:39.483 INFO:teuthology.orchestra.run.smithi096.stdout: "object_locator": "@5", 2024-04-19T03:01:39.484 INFO:teuthology.orchestra.run.smithi096.stdout: "target_object_id": "benchmark_data_smithi096_19531_object4487", 2024-04-19T03:01:39.484 INFO:teuthology.orchestra.run.smithi096.stdout: "target_object_locator": "@5", 2024-04-19T03:01:39.484 INFO:teuthology.orchestra.run.smithi096.stdout: "paused": 0, 2024-04-19T03:01:39.484 INFO:teuthology.orchestra.run.smithi096.stdout: "used_replica": 0, 2024-04-19T03:01:39.484 INFO:teuthology.orchestra.run.smithi096.stdout: "precalc_pgid": 0, 2024-04-19T03:01:39.484 INFO:teuthology.orchestra.run.smithi096.stdout: "last_sent": "634.609513s", 2024-04-19T03:01:39.484 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 0, 2024-04-19T03:01:39.484 INFO:teuthology.orchestra.run.smithi096.stdout: "attempts": 1, 2024-04-19T03:01:39.484 INFO:teuthology.orchestra.run.smithi096.stdout: "snapid": "head", 2024-04-19T03:01:39.484 INFO:teuthology.orchestra.run.smithi096.stdout: "snap_context": "0=[]", 2024-04-19T03:01:39.485 INFO:teuthology.orchestra.run.smithi096.stdout: "mtime": "2024-04-19T03:01:39.472434+0000", 2024-04-19T03:01:39.485 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_ops": [ 2024-04-19T03:01:39.485 INFO:teuthology.orchestra.run.smithi096.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-04-19T03:01:39.485 INFO:teuthology.orchestra.run.smithi096.stdout: "write 0~65536 in=65536b" 2024-04-19T03:01:39.485 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-19T03:01:39.485 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-19T03:01:39.485 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-19T03:01:39.485 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 4491, 2024-04-19T03:01:39.485 INFO:teuthology.orchestra.run.smithi096.stdout: "pg": "5.34b4998c", 2024-04-19T03:01:39.486 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": 0, 2024-04-19T03:01:39.486 INFO:teuthology.orchestra.run.smithi096.stdout: "object_id": "benchmark_data_smithi096_19531_object4490", 2024-04-19T03:01:39.486 INFO:teuthology.orchestra.run.smithi096.stdout: "object_locator": "@5", 2024-04-19T03:01:39.486 INFO:teuthology.orchestra.run.smithi096.stdout: "target_object_id": "benchmark_data_smithi096_19531_object4490", 2024-04-19T03:01:39.487 INFO:teuthology.orchestra.run.smithi096.stdout: "target_object_locator": "@5", 2024-04-19T03:01:39.487 INFO:teuthology.orchestra.run.smithi096.stdout: "paused": 0, 2024-04-19T03:01:39.487 INFO:teuthology.orchestra.run.smithi096.stdout: "used_replica": 0, 2024-04-19T03:01:39.487 INFO:teuthology.orchestra.run.smithi096.stdout: "precalc_pgid": 0, 2024-04-19T03:01:39.487 INFO:teuthology.orchestra.run.smithi096.stdout: "last_sent": "634.609513s", 2024-04-19T03:01:39.487 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 0, 2024-04-19T03:01:39.487 INFO:teuthology.orchestra.run.smithi096.stdout: "attempts": 1, 2024-04-19T03:01:39.487 INFO:teuthology.orchestra.run.smithi096.stdout: "snapid": "head", 2024-04-19T03:01:39.487 INFO:teuthology.orchestra.run.smithi096.stdout: "snap_context": "0=[]", 2024-04-19T03:01:39.487 INFO:teuthology.orchestra.run.smithi096.stdout: "mtime": "2024-04-19T03:01:39.472477+0000", 2024-04-19T03:01:39.487 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_ops": [ 2024-04-19T03:01:39.488 INFO:teuthology.orchestra.run.smithi096.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-04-19T03:01:39.488 INFO:teuthology.orchestra.run.smithi096.stdout: "write 0~65536 in=65536b" 2024-04-19T03:01:39.488 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-19T03:01:39.488 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-19T03:01:39.488 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-19T03:01:39.488 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 4492, 2024-04-19T03:01:39.488 INFO:teuthology.orchestra.run.smithi096.stdout: "pg": "5.34b61176", 2024-04-19T03:01:39.488 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": 0, 2024-04-19T03:01:39.488 INFO:teuthology.orchestra.run.smithi096.stdout: "object_id": "benchmark_data_smithi096_19531_object4491", 2024-04-19T03:01:39.488 INFO:teuthology.orchestra.run.smithi096.stdout: "object_locator": "@5", 2024-04-19T03:01:39.488 INFO:teuthology.orchestra.run.smithi096.stdout: "target_object_id": "benchmark_data_smithi096_19531_object4491", 2024-04-19T03:01:39.488 INFO:teuthology.orchestra.run.smithi096.stdout: "target_object_locator": "@5", 2024-04-19T03:01:39.489 INFO:teuthology.orchestra.run.smithi096.stdout: "paused": 0, 2024-04-19T03:01:39.489 INFO:teuthology.orchestra.run.smithi096.stdout: "used_replica": 0, 2024-04-19T03:01:39.489 INFO:teuthology.orchestra.run.smithi096.stdout: "precalc_pgid": 0, 2024-04-19T03:01:39.489 INFO:teuthology.orchestra.run.smithi096.stdout: "last_sent": "634.609513s", 2024-04-19T03:01:39.489 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 0, 2024-04-19T03:01:39.489 INFO:teuthology.orchestra.run.smithi096.stdout: "attempts": 1, 2024-04-19T03:01:39.489 INFO:teuthology.orchestra.run.smithi096.stdout: "snapid": "head", 2024-04-19T03:01:39.489 INFO:teuthology.orchestra.run.smithi096.stdout: "snap_context": "0=[]", 2024-04-19T03:01:39.489 INFO:teuthology.orchestra.run.smithi096.stdout: "mtime": "2024-04-19T03:01:39.472648+0000", 2024-04-19T03:01:39.489 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_ops": [ 2024-04-19T03:01:39.489 INFO:teuthology.orchestra.run.smithi096.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-04-19T03:01:39.489 INFO:teuthology.orchestra.run.smithi096.stdout: "write 0~65536 in=65536b" 2024-04-19T03:01:39.489 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-19T03:01:39.489 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-19T03:01:39.490 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-19T03:01:39.490 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 4480, 2024-04-19T03:01:39.490 INFO:teuthology.orchestra.run.smithi096.stdout: "pg": "5.14212498", 2024-04-19T03:01:39.490 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": 1, 2024-04-19T03:01:39.490 INFO:teuthology.orchestra.run.smithi096.stdout: "object_id": "benchmark_data_smithi096_19531_object4479", 2024-04-19T03:01:39.490 INFO:teuthology.orchestra.run.smithi096.stdout: "object_locator": "@5", 2024-04-19T03:01:39.490 INFO:teuthology.orchestra.run.smithi096.stdout: "target_object_id": "benchmark_data_smithi096_19531_object4479", 2024-04-19T03:01:39.490 INFO:teuthology.orchestra.run.smithi096.stdout: "target_object_locator": "@5", 2024-04-19T03:01:39.490 INFO:teuthology.orchestra.run.smithi096.stdout: "paused": 0, 2024-04-19T03:01:39.490 INFO:teuthology.orchestra.run.smithi096.stdout: "used_replica": 0, 2024-04-19T03:01:39.490 INFO:teuthology.orchestra.run.smithi096.stdout: "precalc_pgid": 0, 2024-04-19T03:01:39.490 INFO:teuthology.orchestra.run.smithi096.stdout: "last_sent": "634.605513s", 2024-04-19T03:01:39.491 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 0.0039999199999999997, 2024-04-19T03:01:39.491 INFO:teuthology.orchestra.run.smithi096.stdout: "attempts": 1, 2024-04-19T03:01:39.491 INFO:teuthology.orchestra.run.smithi096.stdout: "snapid": "head", 2024-04-19T03:01:39.491 INFO:teuthology.orchestra.run.smithi096.stdout: "snap_context": "0=[]", 2024-04-19T03:01:39.491 INFO:teuthology.orchestra.run.smithi096.stdout: "mtime": "2024-04-19T03:01:39.469835+0000", 2024-04-19T03:01:39.491 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_ops": [ 2024-04-19T03:01:39.491 INFO:teuthology.orchestra.run.smithi096.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-04-19T03:01:39.491 INFO:teuthology.orchestra.run.smithi096.stdout: "write 0~65536 in=65536b" 2024-04-19T03:01:39.491 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-19T03:01:39.491 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-19T03:01:39.491 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-19T03:01:39.491 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 4481, 2024-04-19T03:01:39.491 INFO:teuthology.orchestra.run.smithi096.stdout: "pg": "5.f5e81f3e", 2024-04-19T03:01:39.491 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": 1, 2024-04-19T03:01:39.492 INFO:teuthology.orchestra.run.smithi096.stdout: "object_id": "benchmark_data_smithi096_19531_object4480", 2024-04-19T03:01:39.492 INFO:teuthology.orchestra.run.smithi096.stdout: "object_locator": "@5", 2024-04-19T03:01:39.492 INFO:teuthology.orchestra.run.smithi096.stdout: "target_object_id": "benchmark_data_smithi096_19531_object4480", 2024-04-19T03:01:39.492 INFO:teuthology.orchestra.run.smithi096.stdout: "target_object_locator": "@5", 2024-04-19T03:01:39.492 INFO:teuthology.orchestra.run.smithi096.stdout: "paused": 0, 2024-04-19T03:01:39.492 INFO:teuthology.orchestra.run.smithi096.stdout: "used_replica": 0, 2024-04-19T03:01:39.492 INFO:teuthology.orchestra.run.smithi096.stdout: "precalc_pgid": 0, 2024-04-19T03:01:39.492 INFO:teuthology.orchestra.run.smithi096.stdout: "last_sent": "634.605513s", 2024-04-19T03:01:39.492 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 0.0039999199999999997, 2024-04-19T03:01:39.492 INFO:teuthology.orchestra.run.smithi096.stdout: "attempts": 1, 2024-04-19T03:01:39.492 INFO:teuthology.orchestra.run.smithi096.stdout: "snapid": "head", 2024-04-19T03:01:39.492 INFO:teuthology.orchestra.run.smithi096.stdout: "snap_context": "0=[]", 2024-04-19T03:01:39.492 INFO:teuthology.orchestra.run.smithi096.stdout: "mtime": "2024-04-19T03:01:39.469849+0000", 2024-04-19T03:01:39.493 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_ops": [ 2024-04-19T03:01:39.493 INFO:teuthology.orchestra.run.smithi096.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-04-19T03:01:39.493 INFO:teuthology.orchestra.run.smithi096.stdout: "write 0~65536 in=65536b" 2024-04-19T03:01:39.493 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-19T03:01:39.493 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-19T03:01:39.493 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-19T03:01:39.493 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 4486, 2024-04-19T03:01:39.493 INFO:teuthology.orchestra.run.smithi096.stdout: "pg": "5.f956fb0", 2024-04-19T03:01:39.493 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": 1, 2024-04-19T03:01:39.493 INFO:teuthology.orchestra.run.smithi096.stdout: "object_id": "benchmark_data_smithi096_19531_object4485", 2024-04-19T03:01:39.493 INFO:teuthology.orchestra.run.smithi096.stdout: "object_locator": "@5", 2024-04-19T03:01:39.493 INFO:teuthology.orchestra.run.smithi096.stdout: "target_object_id": "benchmark_data_smithi096_19531_object4485", 2024-04-19T03:01:39.493 INFO:teuthology.orchestra.run.smithi096.stdout: "target_object_locator": "@5", 2024-04-19T03:01:39.494 INFO:teuthology.orchestra.run.smithi096.stdout: "paused": 0, 2024-04-19T03:01:39.494 INFO:teuthology.orchestra.run.smithi096.stdout: "used_replica": 0, 2024-04-19T03:01:39.494 INFO:teuthology.orchestra.run.smithi096.stdout: "precalc_pgid": 0, 2024-04-19T03:01:39.494 INFO:teuthology.orchestra.run.smithi096.stdout: "last_sent": "634.609513s", 2024-04-19T03:01:39.494 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 0, 2024-04-19T03:01:39.494 INFO:teuthology.orchestra.run.smithi096.stdout: "attempts": 1, 2024-04-19T03:01:39.494 INFO:teuthology.orchestra.run.smithi096.stdout: "snapid": "head", 2024-04-19T03:01:39.494 INFO:teuthology.orchestra.run.smithi096.stdout: "snap_context": "0=[]", 2024-04-19T03:01:39.494 INFO:teuthology.orchestra.run.smithi096.stdout: "mtime": "2024-04-19T03:01:39.471529+0000", 2024-04-19T03:01:39.494 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_ops": [ 2024-04-19T03:01:39.494 INFO:teuthology.orchestra.run.smithi096.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-04-19T03:01:39.495 INFO:teuthology.orchestra.run.smithi096.stdout: "write 0~65536 in=65536b" 2024-04-19T03:01:39.495 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-19T03:01:39.495 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-19T03:01:39.495 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-19T03:01:39.495 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 4489, 2024-04-19T03:01:39.495 INFO:teuthology.orchestra.run.smithi096.stdout: "pg": "5.e3ef1920", 2024-04-19T03:01:39.495 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": 1, 2024-04-19T03:01:39.495 INFO:teuthology.orchestra.run.smithi096.stdout: "object_id": "benchmark_data_smithi096_19531_object4488", 2024-04-19T03:01:39.495 INFO:teuthology.orchestra.run.smithi096.stdout: "object_locator": "@5", 2024-04-19T03:01:39.496 INFO:teuthology.orchestra.run.smithi096.stdout: "target_object_id": "benchmark_data_smithi096_19531_object4488", 2024-04-19T03:01:39.496 INFO:teuthology.orchestra.run.smithi096.stdout: "target_object_locator": "@5", 2024-04-19T03:01:39.496 INFO:teuthology.orchestra.run.smithi096.stdout: "paused": 0, 2024-04-19T03:01:39.496 INFO:teuthology.orchestra.run.smithi096.stdout: "used_replica": 0, 2024-04-19T03:01:39.496 INFO:teuthology.orchestra.run.smithi096.stdout: "precalc_pgid": 0, 2024-04-19T03:01:39.496 INFO:teuthology.orchestra.run.smithi096.stdout: "last_sent": "634.609513s", 2024-04-19T03:01:39.496 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 0, 2024-04-19T03:01:39.496 INFO:teuthology.orchestra.run.smithi096.stdout: "attempts": 1, 2024-04-19T03:01:39.497 INFO:teuthology.orchestra.run.smithi096.stdout: "snapid": "head", 2024-04-19T03:01:39.497 INFO:teuthology.orchestra.run.smithi096.stdout: "snap_context": "0=[]", 2024-04-19T03:01:39.497 INFO:teuthology.orchestra.run.smithi096.stdout: "mtime": "2024-04-19T03:01:39.472453+0000", 2024-04-19T03:01:39.497 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_ops": [ 2024-04-19T03:01:39.497 INFO:teuthology.orchestra.run.smithi096.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-04-19T03:01:39.497 INFO:teuthology.orchestra.run.smithi096.stdout: "write 0~65536 in=65536b" 2024-04-19T03:01:39.497 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-19T03:01:39.497 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-19T03:01:39.497 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-19T03:01:39.497 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 4483, 2024-04-19T03:01:39.498 INFO:teuthology.orchestra.run.smithi096.stdout: "pg": "5.71db9952", 2024-04-19T03:01:39.498 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": 2, 2024-04-19T03:01:39.498 INFO:teuthology.orchestra.run.smithi096.stdout: "object_id": "benchmark_data_smithi096_19531_object4482", 2024-04-19T03:01:39.498 INFO:teuthology.orchestra.run.smithi096.stdout: "object_locator": "@5", 2024-04-19T03:01:39.498 INFO:teuthology.orchestra.run.smithi096.stdout: "target_object_id": "benchmark_data_smithi096_19531_object4482", 2024-04-19T03:01:39.498 INFO:teuthology.orchestra.run.smithi096.stdout: "target_object_locator": "@5", 2024-04-19T03:01:39.498 INFO:teuthology.orchestra.run.smithi096.stdout: "paused": 0, 2024-04-19T03:01:39.498 INFO:teuthology.orchestra.run.smithi096.stdout: "used_replica": 0, 2024-04-19T03:01:39.498 INFO:teuthology.orchestra.run.smithi096.stdout: "precalc_pgid": 0, 2024-04-19T03:01:39.498 INFO:teuthology.orchestra.run.smithi096.stdout: "last_sent": "634.605513s", 2024-04-19T03:01:39.498 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 0.0039999199999999997, 2024-04-19T03:01:39.499 INFO:teuthology.orchestra.run.smithi096.stdout: "attempts": 1, 2024-04-19T03:01:39.499 INFO:teuthology.orchestra.run.smithi096.stdout: "snapid": "head", 2024-04-19T03:01:39.499 INFO:teuthology.orchestra.run.smithi096.stdout: "snap_context": "0=[]", 2024-04-19T03:01:39.499 INFO:teuthology.orchestra.run.smithi096.stdout: "mtime": "2024-04-19T03:01:39.470064+0000", 2024-04-19T03:01:39.499 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_ops": [ 2024-04-19T03:01:39.499 INFO:teuthology.orchestra.run.smithi096.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-04-19T03:01:39.499 INFO:teuthology.orchestra.run.smithi096.stdout: "write 0~65536 in=65536b" 2024-04-19T03:01:39.499 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-19T03:01:39.499 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-19T03:01:39.499 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-19T03:01:39.499 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 4490, 2024-04-19T03:01:39.499 INFO:teuthology.orchestra.run.smithi096.stdout: "pg": "5.e37561e2", 2024-04-19T03:01:39.500 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": 2, 2024-04-19T03:01:39.500 INFO:teuthology.orchestra.run.smithi096.stdout: "object_id": "benchmark_data_smithi096_19531_object4489", 2024-04-19T03:01:39.500 INFO:teuthology.orchestra.run.smithi096.stdout: "object_locator": "@5", 2024-04-19T03:01:39.500 INFO:teuthology.orchestra.run.smithi096.stdout: "target_object_id": "benchmark_data_smithi096_19531_object4489", 2024-04-19T03:01:39.500 INFO:teuthology.orchestra.run.smithi096.stdout: "target_object_locator": "@5", 2024-04-19T03:01:39.500 INFO:teuthology.orchestra.run.smithi096.stdout: "paused": 0, 2024-04-19T03:01:39.500 INFO:teuthology.orchestra.run.smithi096.stdout: "used_replica": 0, 2024-04-19T03:01:39.500 INFO:teuthology.orchestra.run.smithi096.stdout: "precalc_pgid": 0, 2024-04-19T03:01:39.500 INFO:teuthology.orchestra.run.smithi096.stdout: "last_sent": "634.609513s", 2024-04-19T03:01:39.500 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 0, 2024-04-19T03:01:39.500 INFO:teuthology.orchestra.run.smithi096.stdout: "attempts": 1, 2024-04-19T03:01:39.500 INFO:teuthology.orchestra.run.smithi096.stdout: "snapid": "head", 2024-04-19T03:01:39.500 INFO:teuthology.orchestra.run.smithi096.stdout: "snap_context": "0=[]", 2024-04-19T03:01:39.501 INFO:teuthology.orchestra.run.smithi096.stdout: "mtime": "2024-04-19T03:01:39.472467+0000", 2024-04-19T03:01:39.501 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_ops": [ 2024-04-19T03:01:39.501 INFO:teuthology.orchestra.run.smithi096.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-04-19T03:01:39.501 INFO:teuthology.orchestra.run.smithi096.stdout: "write 0~65536 in=65536b" 2024-04-19T03:01:39.501 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-19T03:01:39.501 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-19T03:01:39.501 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-19T03:01:39.501 INFO:teuthology.orchestra.run.smithi096.stdout: "tid": 4494, 2024-04-19T03:01:39.501 INFO:teuthology.orchestra.run.smithi096.stdout: "pg": "5.741d007f", 2024-04-19T03:01:39.501 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": 2, 2024-04-19T03:01:39.501 INFO:teuthology.orchestra.run.smithi096.stdout: "object_id": "benchmark_data_smithi096_19531_object4493", 2024-04-19T03:01:39.501 INFO:teuthology.orchestra.run.smithi096.stdout: "object_locator": "@5", 2024-04-19T03:01:39.501 INFO:teuthology.orchestra.run.smithi096.stdout: "target_object_id": "benchmark_data_smithi096_19531_object4493", 2024-04-19T03:01:39.502 INFO:teuthology.orchestra.run.smithi096.stdout: "target_object_locator": "@5", 2024-04-19T03:01:39.502 INFO:teuthology.orchestra.run.smithi096.stdout: "paused": 0, 2024-04-19T03:01:39.502 INFO:teuthology.orchestra.run.smithi096.stdout: "used_replica": 0, 2024-04-19T03:01:39.502 INFO:teuthology.orchestra.run.smithi096.stdout: "precalc_pgid": 0, 2024-04-19T03:01:39.502 INFO:teuthology.orchestra.run.smithi096.stdout: "last_sent": "634.609513s", 2024-04-19T03:01:39.502 INFO:teuthology.orchestra.run.smithi096.stdout: "age": 0, 2024-04-19T03:01:39.502 INFO:teuthology.orchestra.run.smithi096.stdout: "attempts": 1, 2024-04-19T03:01:39.502 INFO:teuthology.orchestra.run.smithi096.stdout: "snapid": "head", 2024-04-19T03:01:39.502 INFO:teuthology.orchestra.run.smithi096.stdout: "snap_context": "0=[]", 2024-04-19T03:01:39.502 INFO:teuthology.orchestra.run.smithi096.stdout: "mtime": "2024-04-19T03:01:39.473268+0000", 2024-04-19T03:01:39.503 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_ops": [ 2024-04-19T03:01:39.503 INFO:teuthology.orchestra.run.smithi096.stdout: "set-alloc-hint object_size 65536 write_size 65536", 2024-04-19T03:01:39.503 INFO:teuthology.orchestra.run.smithi096.stdout: "write 0~65536 in=65536b" 2024-04-19T03:01:39.503 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-19T03:01:39.503 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-19T03:01:39.503 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-19T03:01:39.503 INFO:teuthology.orchestra.run.smithi096.stdout: "linger_ops": [], 2024-04-19T03:01:39.503 INFO:teuthology.orchestra.run.smithi096.stdout: "pool_ops": [], 2024-04-19T03:01:39.503 INFO:teuthology.orchestra.run.smithi096.stdout: "pool_stat_ops": [], 2024-04-19T03:01:39.503 INFO:teuthology.orchestra.run.smithi096.stdout: "statfs_ops": [], 2024-04-19T03:01:39.503 INFO:teuthology.orchestra.run.smithi096.stdout: "command_ops": [] 2024-04-19T03:01:39.503 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-04-19T03:01:39.504 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-19T03:01:39.507 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-19T03:01:39.507 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-04-19T03:01:39.507 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:39.507 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:4496 5.b 5:d614d939:::benchmark_data_smithi096_19531_object4495:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-19T03:01:39.507 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:39.475970+0000", 2024-04-19T03:01:39.507 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0029072540000000002, 2024-04-19T03:01:39.508 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0029491869999999998, 2024-04-19T03:01:39.508 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:01:39.508 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:01:39.508 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:01:39.508 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:01:39.508 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:39.508 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 4496 2024-04-19T03:01:39.508 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:39.508 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:01:39.508 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:39.508 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:01:39.509 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:39.475970+0000", 2024-04-19T03:01:39.509 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:39.509 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:39.509 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:39.509 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:01:39.509 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:39.475970+0000", 2024-04-19T03:01:39.509 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:39.509 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:39.509 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:39.509 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:01:39.509 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:39.475969+0000", 2024-04-19T03:01:39.510 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:01:39.510 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:39.510 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:39.510 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:01:39.510 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:39.476034+0000", 2024-04-19T03:01:39.510 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5073000000000005e-05 2024-04-19T03:01:39.510 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:39.510 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:39.510 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:01:39.510 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:39.476045+0000", 2024-04-19T03:01:39.510 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0801999999999999e-05 2024-04-19T03:01:39.510 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:39.510 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:39.511 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:01:39.511 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:39.476052+0000", 2024-04-19T03:01:39.511 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.357e-06 2024-04-19T03:01:39.511 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:39.511 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:39.511 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:39.511 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:39.476104+0000", 2024-04-19T03:01:39.511 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1990000000000002e-05 2024-04-19T03:01:39.511 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:39.511 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:39.511 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:01:39.511 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:39.476286+0000", 2024-04-19T03:01:39.511 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000181359 2024-04-19T03:01:39.512 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:39.512 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:39.512 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:01:39.512 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:39.476446+0000", 2024-04-19T03:01:39.512 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000160123 2024-04-19T03:01:39.512 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:39.512 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:39.512 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:01:39.513 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:39.478634+0000", 2024-04-19T03:01:39.513 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0021876669999999999 2024-04-19T03:01:39.513 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:39.513 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:01:39.513 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:39.513 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:39.513 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:39.513 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:4497 5.0 5:0d853265:::benchmark_data_smithi096_19531_object4496:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-19T03:01:39.513 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:39.476070+0000", 2024-04-19T03:01:39.513 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0028074100000000002, 2024-04-19T03:01:39.513 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0029989729999999998, 2024-04-19T03:01:39.513 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:01:39.513 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:01:39.514 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:01:39.514 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:01:39.514 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:39.514 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 4497 2024-04-19T03:01:39.514 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:39.514 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:01:39.514 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:39.514 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:01:39.514 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:39.476070+0000", 2024-04-19T03:01:39.514 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:39.514 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:39.515 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:39.515 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:01:39.515 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:39.476070+0000", 2024-04-19T03:01:39.515 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:39.515 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:39.515 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:39.515 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:01:39.515 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:39.476069+0000", 2024-04-19T03:01:39.515 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:01:39.515 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:39.515 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:39.515 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:01:39.515 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:39.476120+0000", 2024-04-19T03:01:39.516 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0949000000000003e-05 2024-04-19T03:01:39.516 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:39.516 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:39.516 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:01:39.516 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:39.476126+0000", 2024-04-19T03:01:39.516 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0460000000000002e-06 2024-04-19T03:01:39.516 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:39.516 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:39.516 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:01:39.516 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:39.476132+0000", 2024-04-19T03:01:39.516 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4690000000000002e-06 2024-04-19T03:01:39.517 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:39.517 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:39.517 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:39.517 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:39.476183+0000", 2024-04-19T03:01:39.517 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0399000000000003e-05 2024-04-19T03:01:39.517 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:39.517 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:39.517 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:01:39.517 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:39.476284+0000", 2024-04-19T03:01:39.517 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000101399 2024-04-19T03:01:39.517 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:39.517 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:39.517 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:01:39.517 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:39.476393+0000", 2024-04-19T03:01:39.518 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010873499999999999 2024-04-19T03:01:39.518 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:39.518 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:39.518 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:01:39.518 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:39.478137+0000", 2024-04-19T03:01:39.518 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0017438670000000001 2024-04-19T03:01:39.518 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:39.518 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:01:39.518 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:39.518 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:39.518 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:39.518 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:4499 5.4 5:2fc3269e:::benchmark_data_smithi096_19531_object4498:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-19T03:01:39.518 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:39.476216+0000", 2024-04-19T03:01:39.519 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0026611489999999998, 2024-04-19T03:01:39.519 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0030094050000000002, 2024-04-19T03:01:39.519 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:01:39.519 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:01:39.519 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:01:39.519 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:01:39.519 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:39.519 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 4499 2024-04-19T03:01:39.519 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:39.519 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:01:39.519 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:39.519 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:01:39.519 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:39.476216+0000", 2024-04-19T03:01:39.519 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:39.520 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:39.520 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:39.520 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:01:39.520 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:39.476216+0000", 2024-04-19T03:01:39.520 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:39.520 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:39.520 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:39.520 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:01:39.520 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:39.476215+0000", 2024-04-19T03:01:39.520 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:01:39.520 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:39.520 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:39.520 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:01:39.521 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:39.476308+0000", 2024-04-19T03:01:39.521 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.3018999999999998e-05 2024-04-19T03:01:39.521 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:39.521 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:39.521 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:01:39.521 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:39.476334+0000", 2024-04-19T03:01:39.521 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5775999999999999e-05 2024-04-19T03:01:39.521 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:39.521 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:39.521 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:01:39.521 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:39.476339+0000", 2024-04-19T03:01:39.522 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2680000000000002e-06 2024-04-19T03:01:39.522 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:39.522 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:39.522 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:39.522 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:39.476388+0000", 2024-04-19T03:01:39.522 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8801000000000003e-05 2024-04-19T03:01:39.522 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:39.522 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:39.522 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:01:39.522 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:39.476527+0000", 2024-04-19T03:01:39.523 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013915100000000001 2024-04-19T03:01:39.523 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:39.523 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:39.523 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:01:39.523 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:39.476738+0000", 2024-04-19T03:01:39.523 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00021049999999999999 2024-04-19T03:01:39.523 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:39.523 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:01:39.523 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:39.523 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:39.523 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:39.523 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:4500 5.4 5:2c1bec3e:::benchmark_data_smithi096_19531_object4499:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-19T03:01:39.524 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:39.476354+0000", 2024-04-19T03:01:39.524 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0025231659999999999, 2024-04-19T03:01:39.524 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0030061200000000001, 2024-04-19T03:01:39.524 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:01:39.524 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:01:39.524 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:01:39.524 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:01:39.525 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:39.525 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 4500 2024-04-19T03:01:39.525 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:39.525 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:01:39.525 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:39.525 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:01:39.526 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:39.476354+0000", 2024-04-19T03:01:39.526 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:39.526 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:39.526 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:39.526 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:01:39.526 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:39.476354+0000", 2024-04-19T03:01:39.526 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:39.526 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:39.527 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:39.527 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:01:39.527 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:39.476353+0000", 2024-04-19T03:01:39.527 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:01:39.527 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:39.527 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:39.527 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:01:39.527 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:39.476399+0000", 2024-04-19T03:01:39.527 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5858e-05 2024-04-19T03:01:39.527 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:39.527 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:39.528 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:01:39.528 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:39.476408+0000", 2024-04-19T03:01:39.528 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1330000000000005e-06 2024-04-19T03:01:39.528 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:39.528 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:39.528 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:01:39.528 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:39.476413+0000", 2024-04-19T03:01:39.528 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8740000000000003e-06 2024-04-19T03:01:39.528 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:39.528 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:39.528 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:39.528 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:39.477952+0000", 2024-04-19T03:01:39.529 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001538654 2024-04-19T03:01:39.529 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:39.529 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:39.529 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:01:39.529 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:39.478145+0000", 2024-04-19T03:01:39.529 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000193501 2024-04-19T03:01:39.529 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:39.529 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:39.529 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:01:39.529 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:39.478374+0000", 2024-04-19T03:01:39.529 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00022931399999999999 2024-04-19T03:01:39.529 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:39.530 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:01:39.530 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:39.530 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:39.530 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:39.530 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:4503 5.4 5.98a25104 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-19T03:01:39.530 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:39.476565+0000", 2024-04-19T03:01:39.530 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0023118460000000002, 2024-04-19T03:01:39.530 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0029075350000000002, 2024-04-19T03:01:39.530 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:01:39.530 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-04-19T03:01:39.530 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:01:39.530 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:01:39.530 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:39.530 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 4503 2024-04-19T03:01:39.531 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:39.531 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:01:39.531 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:39.531 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:01:39.531 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:39.476565+0000", 2024-04-19T03:01:39.531 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:39.531 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:39.531 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:39.531 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:01:39.531 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:39.476565+0000", 2024-04-19T03:01:39.531 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:39.531 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:39.531 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:39.532 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:01:39.532 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:39.476565+0000", 2024-04-19T03:01:39.532 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:01:39.532 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:39.532 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:39.532 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:01:39.532 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:39.476628+0000", 2024-04-19T03:01:39.532 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3355000000000006e-05 2024-04-19T03:01:39.532 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:39.532 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:39.533 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:01:39.533 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:39.476646+0000", 2024-04-19T03:01:39.533 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8134999999999998e-05 2024-04-19T03:01:39.533 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:39.533 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:39.533 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:01:39.533 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:39.476652+0000", 2024-04-19T03:01:39.533 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2400000000000004e-06 2024-04-19T03:01:39.533 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:39.533 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:01:39.534 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:39.534 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:39.534 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-04-19T03:01:39.534 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 5 2024-04-19T03:01:39.534 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-19T03:01:39.534 DEBUG:tasks.admin_socket:admin socket command objecter_requests returned { "ops": [ { "tid": 4479, "pg": "5.13e440da", "osd": 0, "object_id": "benchmark_data_smithi096_19531_object4478", "object_locator": "@5", "target_object_id": "benchmark_data_smithi096_19531_object4478", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "634.605513s", "age": 0.0039999199999999997, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-04-19T03:01:39.469807+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 4482, "pg": "5.f5e40736", "osd": 0, "object_id": "benchmark_data_smithi096_19531_object4481", "object_locator": "@5", "target_object_id": "benchmark_data_smithi096_19531_object4481", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "634.605513s", "age": 0.0039999199999999997, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-04-19T03:01:39.470004+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 4484, "pg": "5.71d4ad2c", "osd": 0, "object_id": "benchmark_data_smithi096_19531_object4483", "object_locator": "@5", "target_object_id": "benchmark_data_smithi096_19531_object4483", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "634.605513s", "age": 0.0039999199999999997, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-04-19T03:01:39.470084+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 4487, "pg": "5.9974e393", "osd": 0, "object_id": "benchmark_data_smithi096_19531_object4486", "object_locator": "@5", "target_object_id": "benchmark_data_smithi096_19531_object4486", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "634.609513s", "age": 0, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-04-19T03:01:39.471583+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 4488, "pg": "5.998273e6", "osd": 0, "object_id": "benchmark_data_smithi096_19531_object4487", "object_locator": "@5", "target_object_id": "benchmark_data_smithi096_19531_object4487", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "634.609513s", "age": 0, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-04-19T03:01:39.472434+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 4491, "pg": "5.34b4998c", "osd": 0, "object_id": "benchmark_data_smithi096_19531_object4490", "object_locator": "@5", "target_object_id": "benchmark_data_smithi096_19531_object4490", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "634.609513s", "age": 0, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-04-19T03:01:39.472477+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 4492, "pg": "5.34b61176", "osd": 0, "object_id": "benchmark_data_smithi096_19531_object4491", "object_locator": "@5", "target_object_id": "benchmark_data_smithi096_19531_object4491", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "634.609513s", "age": 0, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-04-19T03:01:39.472648+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 4480, "pg": "5.14212498", "osd": 1, "object_id": "benchmark_data_smithi096_19531_object4479", "object_locator": "@5", "target_object_id": "benchmark_data_smithi096_19531_object4479", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "634.605513s", "age": 0.0039999199999999997, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-04-19T03:01:39.469835+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 4481, "pg": "5.f5e81f3e", "osd": 1, "object_id": "benchmark_data_smithi096_19531_object4480", "object_locator": "@5", "target_object_id": "benchmark_data_smithi096_19531_object4480", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "634.605513s", "age": 0.0039999199999999997, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-04-19T03:01:39.469849+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 4486, "pg": "5.f956fb0", "osd": 1, "object_id": "benchmark_data_smithi096_19531_object4485", "object_locator": "@5", "target_object_id": "benchmark_data_smithi096_19531_object4485", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "634.609513s", "age": 0, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-04-19T03:01:39.471529+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 4489, "pg": "5.e3ef1920", "osd": 1, "object_id": "benchmark_data_smithi096_19531_object4488", "object_locator": "@5", "target_object_id": "benchmark_data_smithi096_19531_object4488", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "634.609513s", "age": 0, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-04-19T03:01:39.472453+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 4483, "pg": "5.71db9952", "osd": 2, "object_id": "benchmark_data_smithi096_19531_object4482", "object_locator": "@5", "target_object_id": "benchmark_data_smithi096_19531_object4482", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "634.605513s", "age": 0.0039999199999999997, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-04-19T03:01:39.470064+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 4490, "pg": "5.e37561e2", "osd": 2, "object_id": "benchmark_data_smithi096_19531_object4489", "object_locator": "@5", "target_object_id": "benchmark_data_smithi096_19531_object4489", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "634.609513s", "age": 0, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-04-19T03:01:39.472467+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] }, { "tid": 4494, "pg": "5.741d007f", "osd": 2, "object_id": "benchmark_data_smithi096_19531_object4493", "object_locator": "@5", "target_object_id": "benchmark_data_smithi096_19531_object4493", "target_object_locator": "@5", "paused": 0, "used_replica": 0, "precalc_pgid": 0, "last_sent": "634.609513s", "age": 0, "attempts": 1, "snapid": "head", "snap_context": "0=[]", "mtime": "2024-04-19T03:01:39.473268+0000", "osd_ops": [ "set-alloc-hint object_size 65536 write_size 65536", "write 0~65536 in=65536b" ] } ], "linger_ops": [], "pool_ops": [], "pool_stat_ops": [], "statfs_ops": [], "command_ops": [] } 2024-04-19T03:01:39.535 DEBUG:teuthology.orchestra.run.smithi096:> /home/ubuntu/cephtest/admin_socket_client.0/objecter_requests 2024-04-19T03:01:39.535 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T03:01:39.560 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:01:39.557+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:01:39.587 DEBUG:teuthology.orchestra.run.smithi096:> rm -rf -- /home/ubuntu/cephtest/admin_socket_client.0 2024-04-19T03:01:39.593 DEBUG:teuthology.parallel:result is None 2024-04-19T03:01:39.593 DEBUG:teuthology.run_tasks:Unwinding manager radosbench 2024-04-19T03:01:39.602 INFO:tasks.radosbench:joining radosbench (timing out after 2100s) 2024-04-19T03:01:39.602 INFO:teuthology.orchestra.run:waiting for 2100 2024-04-19T03:01:39.661 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:01:39.660+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:01:39.664 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-19T03:01:39.664 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-04-19T03:01:39.664 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-04-19T03:01:39.664 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-04-19T03:01:39.664 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-19T03:01:39.677 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T03:01:39.699 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0: {} 2024-04-19T03:01:39.720 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1: {} 2024-04-19T03:01:39.740 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2: {} 2024-04-19T03:01:39.742 INFO:teuthology.orchestra.run.smithi096.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T03:01:39.742 INFO:teuthology.orchestra.run.smithi096.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-19T03:01:39.742 INFO:teuthology.orchestra.run.smithi096.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-19T03:01:39.762 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:01:39.760+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:01:39.797 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-19T03:01:39.797 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:01:39.810 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T03:01:39.819 INFO:tasks.radosbench.radosbench.0.smithi096.stdout: 2 16 5446 5430 169.674 168.812 0.00705558 0.00587863 2024-04-19T03:01:39.862 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:01:39.857+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:01:39.937 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-04-19T03:01:39.937 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:01:39.949 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T03:01:39.964 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-04-19T03:01:39.957+0000 7f35986ab700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18243) UID: 0 2024-04-19T03:01:40.064 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:01:40.064+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:01:40.067 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-04-19T03:01:40.067 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:01:40.080 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T03:01:40.165 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:01:40.164+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:01:40.208 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-04-19T03:01:40.208 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:01:40.220 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T03:01:40.268 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-04-19T03:01:40.261+0000 7f35986ab700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18243) UID: 0 2024-04-19T03:01:40.351 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-04-19T03:01:40.351 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:01:40.363 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T03:01:40.367 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:01:40.365+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:01:40.408 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-04-19T03:01:40.409 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-19T03:01:40.409 INFO:tasks.thrashosds.thrasher:inject_pause on osd.2 2024-04-19T03:01:40.409 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-04-19T03:01:40.409 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-04-19T03:01:40.409 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok config set filestore_inject_stall 3 2024-04-19T03:01:40.469 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:01:40.465+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:01:40.490 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-04-19T03:01:40.491 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:01:40.503 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T03:01:40.543 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-04-19T03:01:40.543 INFO:teuthology.orchestra.run.smithi144.stdout: "success": "filestore_inject_stall = '' (not observed, change may require restart) " 2024-04-19T03:01:40.543 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-04-19T03:01:40.570 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:01:40.565+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:01:40.631 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-04-19T03:01:40.631 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:01:40.645 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T03:01:40.688 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:01:40.688+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:01:40.768 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-19T03:01:40.771 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:01:40.769+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:01:40.775 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-19T03:01:40.775 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:01:40.787 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T03:01:40.819 INFO:tasks.radosbench.radosbench.0.smithi096.stdout: 3 16 8086 8070 168.11 165 0.00684524 0.00593616 2024-04-19T03:01:40.872 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:01:40.872+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:01:40.913 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-19T03:01:40.913 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:01:40.927 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T03:01:40.972 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:01:40.972+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:01:41.073 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:01:41.069+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:01:41.110 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-19T03:01:41.110 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:01:41.119 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T03:01:41.173 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-04-19T03:01:41.169+0000 7f35986ab700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18243) UID: 0 2024-04-19T03:01:41.254 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-04-19T03:01:41.254 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:01:41.266 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T03:01:41.274 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-04-19T03:01:41.269+0000 7f35986ab700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18243) UID: 0 2024-04-19T03:01:41.375 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:01:41.373+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:01:41.393 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-04-19T03:01:41.393 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:01:41.404 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T03:01:41.476 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:01:41.473+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:01:41.526 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-04-19T03:01:41.526 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:01:41.541 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T03:01:41.577 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:01:41.576+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:01:41.669 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-04-19T03:01:41.669 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:01:41.677 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:01:41.673+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:01:41.683 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T03:01:41.754 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-19T03:01:41.778 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:01:41.776+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:01:41.783 INFO:teuthology.orchestra.run.smithi096.stderr:noscrub is unset 2024-04-19T03:01:41.812 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-04-19T03:01:41.812 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:01:41.819 INFO:tasks.radosbench.radosbench.0.smithi096.stdout: 4 16 10693 10677 166.812 162.938 0.00321772 0.00598398 2024-04-19T03:01:41.825 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T03:01:41.879 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-04-19T03:01:41.873+0000 7f35986ab700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18243) UID: 0 2024-04-19T03:01:41.908 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0: {} 2024-04-19T03:01:41.929 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1: {} 2024-04-19T03:01:41.954 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-04-19T03:01:41.954 INFO:teuthology.orchestra.run.smithi097.stdout: "size": 20, 2024-04-19T03:01:41.954 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 600, 2024-04-19T03:01:41.954 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [ 2024-04-19T03:01:41.954 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:41.954 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:01:41.954 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:14.996966+0000", 2024-04-19T03:01:41.954 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 26.952524968999999, 2024-04-19T03:01:41.954 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.018946704000000002, 2024-04-19T03:01:41.954 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:01:41.955 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:41.955 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:01:41.955 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:41.955 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:01:41.955 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.996966+0000", 2024-04-19T03:01:41.955 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:41.955 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:41.955 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:41.955 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:01:41.955 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.996966+0000", 2024-04-19T03:01:41.955 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:41.955 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:41.955 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:41.956 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:01:41.956 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.996964+0000", 2024-04-19T03:01:41.956 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999971 2024-04-19T03:01:41.956 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:41.956 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:41.956 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:01:41.956 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.996982+0000", 2024-04-19T03:01:41.956 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.8306999999999999e-05 2024-04-19T03:01:41.956 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:41.956 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:41.956 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:01:41.956 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997027+0000", 2024-04-19T03:01:41.956 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.5274000000000001e-05 2024-04-19T03:01:41.957 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:41.957 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:41.957 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:01:41.957 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997047+0000", 2024-04-19T03:01:41.957 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.9726999999999999e-05 2024-04-19T03:01:41.957 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:41.957 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:41.957 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:41.957 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997203+0000", 2024-04-19T03:01:41.957 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000155847 2024-04-19T03:01:41.957 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:41.957 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:41.957 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op must wait for map", 2024-04-19T03:01:41.957 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997249+0000", 2024-04-19T03:01:41.958 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.5824e-05 2024-04-19T03:01:41.958 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:41.958 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:41.958 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:41.958 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.007264+0000", 2024-04-19T03:01:41.958 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.010015909 2024-04-19T03:01:41.958 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:41.958 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:41.958 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:01:41.958 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.007394+0000", 2024-04-19T03:01:41.958 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012931999999999999 2024-04-19T03:01:41.958 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:41.959 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:41.959 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-04-19T03:01:41.959 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.007537+0000", 2024-04-19T03:01:41.959 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014365 2024-04-19T03:01:41.959 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:41.959 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:41.959 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:01:41.959 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.012444+0000", 2024-04-19T03:01:41.959 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0049067260000000001 2024-04-19T03:01:41.959 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:41.959 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:41.959 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:41.959 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.015791+0000", 2024-04-19T03:01:41.959 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0033471109999999998 2024-04-19T03:01:41.960 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:41.960 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:41.960 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:01:41.960 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.015845+0000", 2024-04-19T03:01:41.960 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.4236e-05 2024-04-19T03:01:41.960 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:41.960 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:41.960 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:01:41.960 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.015913+0000", 2024-04-19T03:01:41.960 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.7397000000000005e-05 2024-04-19T03:01:41.960 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:41.960 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:41.960 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:41.960 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:41.960 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:41.961 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(mds.0.3:14 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:01:41.961 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:14.997079+0000", 2024-04-19T03:01:41.961 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 26.952412384999999, 2024-04-19T03:01:41.961 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.021951970000000001, 2024-04-19T03:01:41.961 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:01:41.961 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:41.961 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:01:41.961 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:41.961 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:01:41.961 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997079+0000", 2024-04-19T03:01:41.961 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:41.961 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:41.961 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:41.961 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:01:41.962 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997079+0000", 2024-04-19T03:01:41.962 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:41.962 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:41.962 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:41.962 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:01:41.962 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997077+0000", 2024-04-19T03:01:41.962 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999986 2024-04-19T03:01:41.962 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:41.962 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:41.962 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:01:41.962 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997087+0000", 2024-04-19T03:01:41.962 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.006e-05 2024-04-19T03:01:41.962 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:41.963 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:41.963 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:01:41.963 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997105+0000", 2024-04-19T03:01:41.963 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.8026999999999999e-05 2024-04-19T03:01:41.963 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:41.963 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:41.963 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:01:41.963 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997135+0000", 2024-04-19T03:01:41.963 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.9643000000000001e-05 2024-04-19T03:01:41.963 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:41.963 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:41.964 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:41.964 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997208+0000", 2024-04-19T03:01:41.964 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.3419999999999998e-05 2024-04-19T03:01:41.964 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:41.964 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:41.964 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op must wait for map", 2024-04-19T03:01:41.964 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997244+0000", 2024-04-19T03:01:41.964 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.5367000000000002e-05 2024-04-19T03:01:41.965 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:41.965 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:41.965 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:41.965 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.007357+0000", 2024-04-19T03:01:41.965 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.010112703000000001 2024-04-19T03:01:41.965 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:41.965 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:41.965 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:01:41.965 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.007479+0000", 2024-04-19T03:01:41.966 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012279599999999999 2024-04-19T03:01:41.966 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:41.966 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:41.966 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 1", 2024-04-19T03:01:41.966 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.007610+0000", 2024-04-19T03:01:41.966 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00013093499999999999 2024-04-19T03:01:41.966 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:41.966 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:41.966 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:01:41.966 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.012526+0000", 2024-04-19T03:01:41.966 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0049157519999999998 2024-04-19T03:01:41.966 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:41.967 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:41.967 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:41.967 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.018959+0000", 2024-04-19T03:01:41.967 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0064326009999999996 2024-04-19T03:01:41.967 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:41.967 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:41.967 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:01:41.967 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.019005+0000", 2024-04-19T03:01:41.967 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.6066999999999998e-05 2024-04-19T03:01:41.967 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:41.967 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:41.967 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:01:41.967 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.019031+0000", 2024-04-19T03:01:41.968 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.6009000000000001e-05 2024-04-19T03:01:41.968 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:41.968 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:41.968 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:41.968 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:41.968 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:41.968 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:01:41.968 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:14.997149+0000", 2024-04-19T03:01:41.968 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 26.952341765, 2024-04-19T03:01:41.968 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.021805590999999999, 2024-04-19T03:01:41.968 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:01:41.969 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:41.969 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:01:41.969 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:41.969 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:01:41.969 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997149+0000", 2024-04-19T03:01:41.969 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:41.969 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:41.969 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:41.969 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:01:41.969 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997149+0000", 2024-04-19T03:01:41.969 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:41.969 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:41.970 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:41.970 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:01:41.970 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997148+0000", 2024-04-19T03:01:41.970 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2024-04-19T03:01:41.970 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:41.970 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:41.970 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:01:41.970 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997166+0000", 2024-04-19T03:01:41.970 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.8233e-05 2024-04-19T03:01:41.970 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:41.970 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:41.970 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:01:41.970 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997182+0000", 2024-04-19T03:01:41.971 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5999999999999999e-05 2024-04-19T03:01:41.971 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:41.971 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:41.971 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:01:41.971 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997195+0000", 2024-04-19T03:01:41.971 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.252e-05 2024-04-19T03:01:41.971 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:41.971 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:41.971 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:41.971 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997348+0000", 2024-04-19T03:01:41.971 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000153115 2024-04-19T03:01:41.971 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:41.972 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:41.972 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:01:41.972 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997354+0000", 2024-04-19T03:01:41.972 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.9359999999999996e-06 2024-04-19T03:01:41.972 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:41.972 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:41.972 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:41.972 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.008147+0000", 2024-04-19T03:01:41.972 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.010793127 2024-04-19T03:01:41.972 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:41.972 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:41.972 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:01:41.972 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.008225+0000", 2024-04-19T03:01:41.973 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.7935999999999994e-05 2024-04-19T03:01:41.973 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:41.973 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:41.973 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-04-19T03:01:41.973 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.008377+0000", 2024-04-19T03:01:41.973 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00015159099999999999 2024-04-19T03:01:41.973 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:41.973 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:41.973 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:01:41.973 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.012629+0000", 2024-04-19T03:01:41.973 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0042520420000000001 2024-04-19T03:01:41.973 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:41.974 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:41.974 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:41.974 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.018871+0000", 2024-04-19T03:01:41.974 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0062425060000000001 2024-04-19T03:01:41.974 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:41.974 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:41.974 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:01:41.974 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.018910+0000", 2024-04-19T03:01:41.974 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.8482999999999997e-05 2024-04-19T03:01:41.974 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:41.974 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:41.975 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:01:41.975 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.018955+0000", 2024-04-19T03:01:41.975 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.5252e-05 2024-04-19T03:01:41.975 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:41.975 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:41.975 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:41.975 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:41.975 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:41.975 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(mds.0.3:36 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:01:41.975 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:14.997207+0000", 2024-04-19T03:01:41.975 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 26.952284214999999, 2024-04-19T03:01:41.975 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.022210431999999999, 2024-04-19T03:01:41.975 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:01:41.976 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:41.976 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:01:41.976 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:41.976 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:01:41.976 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997207+0000", 2024-04-19T03:01:41.976 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:41.976 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:41.976 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:41.976 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:01:41.976 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997207+0000", 2024-04-19T03:01:41.976 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:41.976 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:41.977 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:41.977 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:01:41.977 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997206+0000", 2024-04-19T03:01:41.977 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2024-04-19T03:01:41.977 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:41.977 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:41.977 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:01:41.977 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997218+0000", 2024-04-19T03:01:41.977 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2607e-05 2024-04-19T03:01:41.977 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:41.977 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:41.977 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:01:41.978 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997234+0000", 2024-04-19T03:01:41.978 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5583999999999999e-05 2024-04-19T03:01:41.978 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:41.978 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:41.978 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:01:41.978 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997248+0000", 2024-04-19T03:01:41.978 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4270000000000001e-05 2024-04-19T03:01:41.978 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:41.978 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:41.978 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:41.978 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997397+0000", 2024-04-19T03:01:41.978 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0001482 2024-04-19T03:01:41.978 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:41.979 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:41.979 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:01:41.979 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997407+0000", 2024-04-19T03:01:41.980 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0944000000000001e-05 2024-04-19T03:01:41.980 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:41.980 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:41.980 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:41.980 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.008173+0000", 2024-04-19T03:01:41.980 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.010765378000000001 2024-04-19T03:01:41.980 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:41.981 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:41.981 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:01:41.981 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.008278+0000", 2024-04-19T03:01:41.981 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00010538 2024-04-19T03:01:41.981 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:41.981 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:41.981 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 1", 2024-04-19T03:01:41.981 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.008423+0000", 2024-04-19T03:01:41.981 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014525599999999999 2024-04-19T03:01:41.981 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:41.982 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:41.982 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:01:41.982 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.012734+0000", 2024-04-19T03:01:41.982 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0043108590000000002 2024-04-19T03:01:41.982 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:41.982 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:41.982 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:41.982 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.019318+0000", 2024-04-19T03:01:41.982 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0065836130000000003 2024-04-19T03:01:41.982 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:41.982 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:41.982 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:01:41.982 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.019382+0000", 2024-04-19T03:01:41.982 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.3925999999999997e-05 2024-04-19T03:01:41.983 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:41.983 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:41.983 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:01:41.983 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.019417+0000", 2024-04-19T03:01:41.983 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.5454999999999999e-05 2024-04-19T03:01:41.983 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:41.983 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:41.983 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:41.983 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:41.983 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:41.983 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(mds.0.3:15 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:01:41.983 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:14.997260+0000", 2024-04-19T03:01:41.983 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 26.952231063999999, 2024-04-19T03:01:41.983 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.021842842000000001, 2024-04-19T03:01:41.984 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:01:41.984 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:41.984 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:01:41.984 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:41.984 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:01:41.984 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997260+0000", 2024-04-19T03:01:41.984 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:41.984 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:41.984 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:41.984 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:01:41.984 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997260+0000", 2024-04-19T03:01:41.984 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:41.984 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:41.985 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:41.985 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:01:41.985 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997259+0000", 2024-04-19T03:01:41.985 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999995 2024-04-19T03:01:41.985 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:41.985 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:41.985 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:01:41.985 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997270+0000", 2024-04-19T03:01:41.985 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0312999999999999e-05 2024-04-19T03:01:41.985 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:41.985 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:41.986 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:01:41.986 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997279+0000", 2024-04-19T03:01:41.986 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.7770000000000008e-06 2024-04-19T03:01:41.986 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:41.986 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:41.986 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:01:41.986 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997286+0000", 2024-04-19T03:01:41.986 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.0129999999999996e-06 2024-04-19T03:01:41.986 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:41.986 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:41.986 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:41.986 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997433+0000", 2024-04-19T03:01:41.986 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014774699999999999 2024-04-19T03:01:41.987 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:41.987 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:41.987 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:01:41.987 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997443+0000", 2024-04-19T03:01:41.987 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.414e-06 2024-04-19T03:01:41.987 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:41.987 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:41.987 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:41.987 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.008673+0000", 2024-04-19T03:01:41.987 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.011230789999999999 2024-04-19T03:01:41.987 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:41.987 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:41.987 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:01:41.987 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.008808+0000", 2024-04-19T03:01:41.988 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000134346 2024-04-19T03:01:41.988 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:41.988 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:41.988 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-04-19T03:01:41.988 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.008922+0000", 2024-04-19T03:01:41.988 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000114444 2024-04-19T03:01:41.988 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:41.988 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:41.988 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:01:41.988 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.013442+0000", 2024-04-19T03:01:41.988 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0045193439999999998 2024-04-19T03:01:41.988 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:41.988 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:41.988 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:41.989 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.019005+0000", 2024-04-19T03:01:41.989 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00556333 2024-04-19T03:01:41.989 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:41.989 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:41.989 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:01:41.989 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.019049+0000", 2024-04-19T03:01:41.989 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.4240000000000003e-05 2024-04-19T03:01:41.989 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:41.989 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:41.989 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:01:41.989 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.019103+0000", 2024-04-19T03:01:41.989 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.3706999999999999e-05 2024-04-19T03:01:41.989 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:41.989 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:41.990 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:41.990 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:41.990 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:41.990 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(mds.0.3:17 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:01:41.990 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:14.997292+0000", 2024-04-19T03:01:41.990 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 26.952199337, 2024-04-19T03:01:41.990 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.019573165999999999, 2024-04-19T03:01:41.990 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:01:41.990 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:41.990 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:01:41.990 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:41.990 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:01:41.990 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997292+0000", 2024-04-19T03:01:41.991 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:41.991 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:41.991 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:41.991 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:01:41.991 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997292+0000", 2024-04-19T03:01:41.991 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:41.991 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:41.991 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:41.991 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:01:41.991 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997291+0000", 2024-04-19T03:01:41.991 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999995 2024-04-19T03:01:41.991 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:41.991 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:41.991 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:01:41.992 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997297+0000", 2024-04-19T03:01:41.992 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.3900000000000001e-06 2024-04-19T03:01:41.992 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:41.992 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:41.992 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:01:41.992 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997316+0000", 2024-04-19T03:01:41.992 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.9406e-05 2024-04-19T03:01:41.992 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:41.992 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:41.992 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:01:41.992 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997353+0000", 2024-04-19T03:01:41.992 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.6563999999999998e-05 2024-04-19T03:01:41.992 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:41.992 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:41.993 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:41.993 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997447+0000", 2024-04-19T03:01:41.993 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.4463999999999995e-05 2024-04-19T03:01:41.993 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:41.993 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:41.993 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op must wait for map", 2024-04-19T03:01:41.993 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997458+0000", 2024-04-19T03:01:41.993 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0817e-05 2024-04-19T03:01:41.993 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:41.993 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:41.993 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:41.993 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.002013+0000", 2024-04-19T03:01:41.993 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.004555229 2024-04-19T03:01:41.993 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:41.994 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:41.994 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:01:41.994 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.002943+0000", 2024-04-19T03:01:41.994 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00092983200000000001 2024-04-19T03:01:41.994 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:41.994 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:41.994 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-04-19T03:01:41.994 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.003257+0000", 2024-04-19T03:01:41.994 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00031455399999999998 2024-04-19T03:01:41.994 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:41.994 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:41.994 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:01:41.994 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.014107+0000", 2024-04-19T03:01:41.994 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.010849648 2024-04-19T03:01:41.995 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:41.995 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:41.995 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:41.995 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.016767+0000", 2024-04-19T03:01:41.995 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0026594990000000001 2024-04-19T03:01:41.995 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:41.995 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:41.995 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:01:41.995 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.016825+0000", 2024-04-19T03:01:41.995 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.8264000000000003e-05 2024-04-19T03:01:41.995 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:41.995 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:41.995 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:01:41.995 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.016865+0000", 2024-04-19T03:01:41.996 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.0108999999999998e-05 2024-04-19T03:01:41.996 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:41.996 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:41.996 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:41.996 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:41.996 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:41.996 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(mds.0.3:22 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:01:41.996 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:14.997383+0000", 2024-04-19T03:01:41.996 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 26.952108556999999, 2024-04-19T03:01:41.996 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.019634641000000001, 2024-04-19T03:01:41.996 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:01:41.996 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "started", 2024-04-19T03:01:41.996 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:01:41.996 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:41.996 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:01:41.997 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997383+0000", 2024-04-19T03:01:41.997 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:41.997 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:41.997 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:41.997 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:01:41.997 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997383+0000", 2024-04-19T03:01:41.997 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:41.997 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:41.997 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:41.997 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:01:41.997 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997381+0000", 2024-04-19T03:01:41.997 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999986 2024-04-19T03:01:41.997 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:41.997 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:41.997 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:01:41.998 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997399+0000", 2024-04-19T03:01:41.998 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.802e-05 2024-04-19T03:01:41.998 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:41.998 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:41.998 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:01:41.998 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997417+0000", 2024-04-19T03:01:41.998 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.7581e-05 2024-04-19T03:01:41.998 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:41.998 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:41.998 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:01:41.998 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997429+0000", 2024-04-19T03:01:41.998 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1803e-05 2024-04-19T03:01:41.998 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:41.998 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:41.999 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:41.999 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997540+0000", 2024-04-19T03:01:41.999 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000111397 2024-04-19T03:01:41.999 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:41.999 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:41.999 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:01:41.999 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997552+0000", 2024-04-19T03:01:41.999 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1643e-05 2024-04-19T03:01:41.999 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:41.999 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:41.999 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:41.999 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.006836+0000", 2024-04-19T03:01:41.999 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0092841940000000008 2024-04-19T03:01:41.999 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:42.000 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:42.000 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:01:42.000 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.006982+0000", 2024-04-19T03:01:42.000 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014572899999999999 2024-04-19T03:01:42.000 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:42.000 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:42.000 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:01:42.000 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.017017+0000", 2024-04-19T03:01:42.000 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.010035571 2024-04-19T03:01:42.000 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:42.000 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:42.000 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:42.000 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:42.000 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:42.001 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(mds.0.3:23 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:01:42.001 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:14.997449+0000", 2024-04-19T03:01:42.001 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 26.952042016, 2024-04-19T03:01:42.001 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.022679250000000001, 2024-04-19T03:01:42.001 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:01:42.001 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "started", 2024-04-19T03:01:42.001 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:01:42.001 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:42.001 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:01:42.001 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997449+0000", 2024-04-19T03:01:42.001 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:42.001 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:42.001 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:42.001 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:01:42.002 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997449+0000", 2024-04-19T03:01:42.002 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:42.002 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:42.002 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:42.002 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:01:42.002 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997448+0000", 2024-04-19T03:01:42.002 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999995 2024-04-19T03:01:42.002 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:42.002 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:42.002 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:01:42.002 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997452+0000", 2024-04-19T03:01:42.002 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.0369999999999996e-06 2024-04-19T03:01:42.002 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:42.002 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:42.003 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:01:42.003 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997461+0000", 2024-04-19T03:01:42.003 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.6100000000000006e-06 2024-04-19T03:01:42.003 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:42.003 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:42.003 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:01:42.003 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997468+0000", 2024-04-19T03:01:42.003 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.8360000000000003e-06 2024-04-19T03:01:42.003 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:42.003 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:42.003 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:42.003 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997546+0000", 2024-04-19T03:01:42.003 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.7956999999999999e-05 2024-04-19T03:01:42.003 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:42.004 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:42.004 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:01:42.004 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997555+0000", 2024-04-19T03:01:42.004 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.2269999999999999e-06 2024-04-19T03:01:42.004 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:42.004 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:42.004 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:42.004 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.010065+0000", 2024-04-19T03:01:42.004 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.012509457999999999 2024-04-19T03:01:42.004 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:42.004 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:42.004 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:01:42.004 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.010187+0000", 2024-04-19T03:01:42.005 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000122059 2024-04-19T03:01:42.005 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:42.005 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:42.005 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:01:42.005 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.020128+0000", 2024-04-19T03:01:42.005 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0099417529999999994 2024-04-19T03:01:42.005 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:42.005 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:42.005 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:42.005 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:42.005 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:42.005 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(mds.0.3:25 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:01:42.006 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:14.997485+0000", 2024-04-19T03:01:42.006 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 26.95200655, 2024-04-19T03:01:42.006 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.021633427, 2024-04-19T03:01:42.006 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:01:42.006 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "started", 2024-04-19T03:01:42.006 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:01:42.006 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:42.006 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:01:42.006 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997485+0000", 2024-04-19T03:01:42.006 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:42.006 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:42.006 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:42.006 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:01:42.007 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997485+0000", 2024-04-19T03:01:42.007 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:42.007 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:42.007 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:42.007 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:01:42.007 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997484+0000", 2024-04-19T03:01:42.007 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2024-04-19T03:01:42.007 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:42.007 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:42.007 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:01:42.007 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997490+0000", 2024-04-19T03:01:42.007 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.857e-06 2024-04-19T03:01:42.007 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:42.007 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:42.008 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:01:42.008 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997505+0000", 2024-04-19T03:01:42.008 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.518e-05 2024-04-19T03:01:42.008 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:42.008 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:42.008 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:01:42.008 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997520+0000", 2024-04-19T03:01:42.008 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5026e-05 2024-04-19T03:01:42.008 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:42.008 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:42.008 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:42.008 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997607+0000", 2024-04-19T03:01:42.008 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.7107000000000005e-05 2024-04-19T03:01:42.008 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:42.009 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:42.009 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op must wait for map", 2024-04-19T03:01:42.009 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997614+0000", 2024-04-19T03:01:42.009 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.0539999999999997e-06 2024-04-19T03:01:42.009 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:42.009 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:42.009 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:42.009 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.009808+0000", 2024-04-19T03:01:42.009 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.012194371000000001 2024-04-19T03:01:42.009 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:42.009 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:42.009 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:01:42.009 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.010107+0000", 2024-04-19T03:01:42.009 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000298731 2024-04-19T03:01:42.009 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:42.010 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:42.010 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:01:42.010 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.019118+0000", 2024-04-19T03:01:42.010 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0090109839999999997 2024-04-19T03:01:42.010 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:42.010 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:42.010 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:42.010 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:42.010 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:42.010 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4755.0:1118 5.a 5:574e94d1:::benchmark_data_smithi096_19531_object1117:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-19T03:01:42.010 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:38.233189+0000", 2024-04-19T03:01:42.010 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 3.716301831, 2024-04-19T03:01:42.010 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.011322258, 2024-04-19T03:01:42.010 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:01:42.011 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:42.011 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-04-19T03:01:42.011 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4755", 2024-04-19T03:01:42.011 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:42.011 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 1118 2024-04-19T03:01:42.011 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:42.011 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:01:42.011 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:42.011 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:01:42.011 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.233189+0000", 2024-04-19T03:01:42.011 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:42.011 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:42.011 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:42.011 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:01:42.011 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.233189+0000", 2024-04-19T03:01:42.012 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:42.012 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:42.012 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:42.012 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:01:42.012 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.233188+0000", 2024-04-19T03:01:42.012 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2024-04-19T03:01:42.012 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:42.013 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:42.013 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:01:42.013 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.233316+0000", 2024-04-19T03:01:42.013 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012753299999999999 2024-04-19T03:01:42.013 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:42.013 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:42.013 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:01:42.013 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.233330+0000", 2024-04-19T03:01:42.013 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4317e-05 2024-04-19T03:01:42.014 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:42.014 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:42.014 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:01:42.014 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.233348+0000", 2024-04-19T03:01:42.014 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.7989e-05 2024-04-19T03:01:42.014 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:42.014 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:42.014 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:42.014 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.233448+0000", 2024-04-19T03:01:42.014 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.9508999999999999e-05 2024-04-19T03:01:42.014 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:42.014 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:42.015 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:01:42.015 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.233570+0000", 2024-04-19T03:01:42.015 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012247199999999999 2024-04-19T03:01:42.015 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:42.015 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:42.015 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 1", 2024-04-19T03:01:42.015 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.233695+0000", 2024-04-19T03:01:42.015 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012449499999999999 2024-04-19T03:01:42.015 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:42.015 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:42.015 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:42.015 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.236730+0000", 2024-04-19T03:01:42.015 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0030358680000000002 2024-04-19T03:01:42.015 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:42.016 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:42.016 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:01:42.016 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.244431+0000", 2024-04-19T03:01:42.016 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0077005470000000003 2024-04-19T03:01:42.016 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:42.016 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:42.016 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:01:42.016 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.244472+0000", 2024-04-19T03:01:42.016 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.1443999999999998e-05 2024-04-19T03:01:42.016 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:42.016 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:42.016 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:01:42.016 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.244512+0000", 2024-04-19T03:01:42.016 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.9156999999999998e-05 2024-04-19T03:01:42.017 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:42.017 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:42.017 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:42.017 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:42.017 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:42.017 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4755.0:1286 5.3 5:cc96b4b1:::benchmark_data_smithi096_19531_object1285:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-19T03:01:42.017 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:38.298083+0000", 2024-04-19T03:01:42.017 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 3.6514077650000001, 2024-04-19T03:01:42.017 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.01153859, 2024-04-19T03:01:42.017 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:01:42.017 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:42.017 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-04-19T03:01:42.018 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4755", 2024-04-19T03:01:42.018 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:42.018 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 1286 2024-04-19T03:01:42.018 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:42.018 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:01:42.018 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:42.018 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:01:42.018 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.298083+0000", 2024-04-19T03:01:42.019 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:42.019 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:42.019 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:42.019 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:01:42.019 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.298083+0000", 2024-04-19T03:01:42.019 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:42.019 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:42.019 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:42.019 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:01:42.019 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.298083+0000", 2024-04-19T03:01:42.019 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999995 2024-04-19T03:01:42.019 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:42.019 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:42.020 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:01:42.020 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.298174+0000", 2024-04-19T03:01:42.020 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.1042e-05 2024-04-19T03:01:42.020 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:42.020 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:42.020 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:01:42.020 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.298182+0000", 2024-04-19T03:01:42.020 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.8639999999999996e-06 2024-04-19T03:01:42.020 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:42.020 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:42.020 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:01:42.020 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.298189+0000", 2024-04-19T03:01:42.020 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.8109999999999997e-06 2024-04-19T03:01:42.020 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:42.021 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:42.021 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:42.021 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.302217+0000", 2024-04-19T03:01:42.021 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0040280519999999998 2024-04-19T03:01:42.021 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:42.021 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:42.021 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:01:42.021 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.302301+0000", 2024-04-19T03:01:42.021 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.4470999999999998e-05 2024-04-19T03:01:42.021 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:42.021 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:42.022 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-04-19T03:01:42.022 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.302408+0000", 2024-04-19T03:01:42.022 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000106859 2024-04-19T03:01:42.022 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:42.022 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:42.022 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:42.022 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.304746+0000", 2024-04-19T03:01:42.022 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0023379120000000001 2024-04-19T03:01:42.022 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:42.022 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:42.022 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:01:42.022 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.309539+0000", 2024-04-19T03:01:42.023 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0047926740000000002 2024-04-19T03:01:42.023 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:42.023 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:42.023 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:01:42.023 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.309587+0000", 2024-04-19T03:01:42.023 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.8605e-05 2024-04-19T03:01:42.023 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:42.023 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:42.023 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:01:42.023 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.309622+0000", 2024-04-19T03:01:42.023 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.4835000000000001e-05 2024-04-19T03:01:42.023 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:42.023 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:42.023 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:42.024 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:42.024 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:42.024 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4755.0:1287 5.3 5:cd0a836c:::benchmark_data_smithi096_19531_object1286:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-19T03:01:42.024 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:38.298199+0000", 2024-04-19T03:01:42.024 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 3.6512925740000002, 2024-04-19T03:01:42.024 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.011479652, 2024-04-19T03:01:42.024 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:01:42.024 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:42.024 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-04-19T03:01:42.024 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4755", 2024-04-19T03:01:42.024 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:42.024 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 1287 2024-04-19T03:01:42.024 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:42.024 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:01:42.024 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:42.025 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:01:42.025 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.298199+0000", 2024-04-19T03:01:42.025 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:42.025 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:42.025 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:42.025 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:01:42.025 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.298199+0000", 2024-04-19T03:01:42.025 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:42.025 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:42.025 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:42.025 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:01:42.025 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.298198+0000", 2024-04-19T03:01:42.025 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999995 2024-04-19T03:01:42.025 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:42.026 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:42.026 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:01:42.026 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.298257+0000", 2024-04-19T03:01:42.026 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.9268000000000002e-05 2024-04-19T03:01:42.026 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:42.026 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:42.026 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:01:42.026 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.298268+0000", 2024-04-19T03:01:42.026 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0829000000000001e-05 2024-04-19T03:01:42.026 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:42.026 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:42.026 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:01:42.026 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.298274+0000", 2024-04-19T03:01:42.027 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.7810000000000002e-06 2024-04-19T03:01:42.027 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:42.027 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:42.027 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:42.027 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.303347+0000", 2024-04-19T03:01:42.027 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0050733549999999999 2024-04-19T03:01:42.027 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:42.027 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:42.027 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:01:42.027 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.303449+0000", 2024-04-19T03:01:42.027 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000101716 2024-04-19T03:01:42.027 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:42.027 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:42.027 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-04-19T03:01:42.027 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.303574+0000", 2024-04-19T03:01:42.028 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012509899999999999 2024-04-19T03:01:42.028 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:42.028 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:42.028 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:42.028 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.305521+0000", 2024-04-19T03:01:42.028 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001947107 2024-04-19T03:01:42.028 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:42.028 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:42.028 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:01:42.028 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.309631+0000", 2024-04-19T03:01:42.028 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0041096789999999998 2024-04-19T03:01:42.028 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:42.028 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:42.028 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:01:42.028 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.309658+0000", 2024-04-19T03:01:42.029 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.7466000000000001e-05 2024-04-19T03:01:42.029 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:42.029 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:42.029 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:01:42.029 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.309678+0000", 2024-04-19T03:01:42.029 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.0027999999999999e-05 2024-04-19T03:01:42.029 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:42.029 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:42.029 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:42.029 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:42.029 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:42.029 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4755.0:2541 5.a 5:559851b8:::benchmark_data_smithi096_19531_object2540:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-19T03:01:42.029 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:38.734628+0000", 2024-04-19T03:01:42.029 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 3.2148633740000001, 2024-04-19T03:01:42.030 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.011852089999999999, 2024-04-19T03:01:42.030 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:01:42.030 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:42.030 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-04-19T03:01:42.030 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4755", 2024-04-19T03:01:42.030 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:42.030 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 2541 2024-04-19T03:01:42.030 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:42.030 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:01:42.030 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:42.031 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:01:42.031 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.734628+0000", 2024-04-19T03:01:42.031 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:42.031 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:42.031 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:42.031 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:01:42.031 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.734628+0000", 2024-04-19T03:01:42.031 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:42.032 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:42.032 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:42.032 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:01:42.032 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.734627+0000", 2024-04-19T03:01:42.032 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2024-04-19T03:01:42.032 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:42.032 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:42.032 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:01:42.033 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.734717+0000", 2024-04-19T03:01:42.033 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.0206999999999999e-05 2024-04-19T03:01:42.033 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:42.033 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:42.033 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:01:42.033 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.734737+0000", 2024-04-19T03:01:42.033 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.0265999999999999e-05 2024-04-19T03:01:42.033 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:42.033 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:42.033 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:01:42.033 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.734744+0000", 2024-04-19T03:01:42.033 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.4409999999999998e-06 2024-04-19T03:01:42.033 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:42.033 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:42.034 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:42.034 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.735425+0000", 2024-04-19T03:01:42.034 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00068099899999999995 2024-04-19T03:01:42.034 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:42.034 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:42.034 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:01:42.034 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.735565+0000", 2024-04-19T03:01:42.034 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014048500000000001 2024-04-19T03:01:42.034 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:42.034 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:42.034 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 1", 2024-04-19T03:01:42.034 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.735733+0000", 2024-04-19T03:01:42.035 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00016728700000000001 2024-04-19T03:01:42.035 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:42.035 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:42.035 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:42.035 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.741844+0000", 2024-04-19T03:01:42.035 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0061117690000000004 2024-04-19T03:01:42.035 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:42.035 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:42.035 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:01:42.035 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.746401+0000", 2024-04-19T03:01:42.035 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0045563899999999996 2024-04-19T03:01:42.035 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:42.035 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:42.035 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:01:42.036 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.746446+0000", 2024-04-19T03:01:42.036 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.5417999999999998e-05 2024-04-19T03:01:42.036 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:42.036 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:42.036 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:01:42.036 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.746480+0000", 2024-04-19T03:01:42.036 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.3563999999999999e-05 2024-04-19T03:01:42.036 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:42.036 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:42.037 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:42.037 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:42.037 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:42.037 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4755.0:2554 5.a 5:578b51bf:::benchmark_data_smithi096_19531_object2553:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-19T03:01:42.037 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:38.737533+0000", 2024-04-19T03:01:42.037 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 3.211958493, 2024-04-19T03:01:42.037 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.011966071999999999, 2024-04-19T03:01:42.037 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:01:42.037 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:42.038 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-04-19T03:01:42.038 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4755", 2024-04-19T03:01:42.038 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:42.038 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 2554 2024-04-19T03:01:42.038 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:42.038 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:01:42.038 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:42.038 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:01:42.039 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.737533+0000", 2024-04-19T03:01:42.039 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:42.039 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:42.039 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:42.039 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:01:42.039 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.737533+0000", 2024-04-19T03:01:42.039 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:42.039 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:42.039 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:42.039 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:01:42.039 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.737532+0000", 2024-04-19T03:01:42.039 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999995 2024-04-19T03:01:42.040 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:42.040 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:42.040 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:01:42.040 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.737629+0000", 2024-04-19T03:01:42.040 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.7090999999999996e-05 2024-04-19T03:01:42.040 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:42.040 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:42.040 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:01:42.040 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.737646+0000", 2024-04-19T03:01:42.040 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.7263999999999999e-05 2024-04-19T03:01:42.040 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:42.040 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:42.040 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:01:42.041 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.737656+0000", 2024-04-19T03:01:42.041 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.4380000000000001e-06 2024-04-19T03:01:42.041 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:42.041 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:42.041 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:42.041 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.745271+0000", 2024-04-19T03:01:42.041 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0076152549999999996 2024-04-19T03:01:42.041 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:42.041 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:42.041 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:01:42.041 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.745380+0000", 2024-04-19T03:01:42.041 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00010886 2024-04-19T03:01:42.042 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:42.042 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:42.042 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 1", 2024-04-19T03:01:42.042 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.745534+0000", 2024-04-19T03:01:42.042 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00015456000000000001 2024-04-19T03:01:42.042 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:42.042 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:42.042 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:01:42.042 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.748168+0000", 2024-04-19T03:01:42.042 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0026332959999999998 2024-04-19T03:01:42.042 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:42.042 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:42.042 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:42.043 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.748839+0000", 2024-04-19T03:01:42.043 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00067164000000000004 2024-04-19T03:01:42.043 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:42.043 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:42.043 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:01:42.043 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.749453+0000", 2024-04-19T03:01:42.043 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00061381700000000001 2024-04-19T03:01:42.043 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:42.043 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:42.043 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:01:42.043 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.749499+0000", 2024-04-19T03:01:42.044 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.5507000000000003e-05 2024-04-19T03:01:42.044 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:42.044 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:42.044 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:42.044 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:42.044 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:42.044 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4755.0:3004 5.6 5:658337c5:::benchmark_data_smithi096_19531_object3003:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-19T03:01:42.044 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:38.908609+0000", 2024-04-19T03:01:42.044 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 3.040882565, 2024-04-19T03:01:42.044 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.011722379, 2024-04-19T03:01:42.044 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:01:42.044 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:42.044 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-04-19T03:01:42.044 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4755", 2024-04-19T03:01:42.045 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:42.045 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 3004 2024-04-19T03:01:42.045 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:42.045 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:01:42.045 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:42.045 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:01:42.045 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.908609+0000", 2024-04-19T03:01:42.045 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:42.045 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:42.045 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:42.045 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:01:42.045 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.908609+0000", 2024-04-19T03:01:42.046 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:42.046 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:42.046 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:42.046 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:01:42.046 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.908608+0000", 2024-04-19T03:01:42.046 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999995 2024-04-19T03:01:42.046 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:42.046 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:42.046 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:01:42.046 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.908675+0000", 2024-04-19T03:01:42.047 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.7108999999999997e-05 2024-04-19T03:01:42.047 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:42.047 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:42.047 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:01:42.047 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.908686+0000", 2024-04-19T03:01:42.047 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0732e-05 2024-04-19T03:01:42.047 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:42.047 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:42.047 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:01:42.047 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.908694+0000", 2024-04-19T03:01:42.047 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.2930000000000001e-06 2024-04-19T03:01:42.047 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:42.047 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:42.048 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:42.048 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.912596+0000", 2024-04-19T03:01:42.048 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.003902422 2024-04-19T03:01:42.048 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:42.048 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:42.048 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:01:42.048 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.912740+0000", 2024-04-19T03:01:42.048 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014406099999999999 2024-04-19T03:01:42.048 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:42.048 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:42.048 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-04-19T03:01:42.048 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.912936+0000", 2024-04-19T03:01:42.048 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00019509599999999999 2024-04-19T03:01:42.049 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:42.049 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:42.049 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:42.049 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.917445+0000", 2024-04-19T03:01:42.049 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0045092750000000001 2024-04-19T03:01:42.049 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:42.049 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:42.049 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:01:42.049 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.920257+0000", 2024-04-19T03:01:42.049 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0028124640000000002 2024-04-19T03:01:42.049 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:42.049 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:42.049 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:01:42.050 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.920296+0000", 2024-04-19T03:01:42.050 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.8478e-05 2024-04-19T03:01:42.050 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:42.050 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:42.050 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:01:42.050 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:38.920331+0000", 2024-04-19T03:01:42.050 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.5162e-05 2024-04-19T03:01:42.050 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:42.051 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:42.051 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:42.051 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:42.051 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:42.051 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4755.0:3801 5.3 5:c840485b:::benchmark_data_smithi096_19531_object3800:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-19T03:01:42.051 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:39.210152+0000", 2024-04-19T03:01:42.051 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 2.7393394390000001, 2024-04-19T03:01:42.051 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.011245458, 2024-04-19T03:01:42.051 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:01:42.051 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:42.052 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-04-19T03:01:42.052 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4755", 2024-04-19T03:01:42.052 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:42.052 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 3801 2024-04-19T03:01:42.052 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:42.052 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:01:42.052 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:42.052 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:01:42.052 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:39.210152+0000", 2024-04-19T03:01:42.052 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:42.052 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:42.052 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:42.052 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:01:42.053 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:39.210152+0000", 2024-04-19T03:01:42.053 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:42.053 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:42.053 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:42.053 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:01:42.053 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:39.210151+0000", 2024-04-19T03:01:42.053 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2024-04-19T03:01:42.053 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:42.053 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:42.054 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:01:42.054 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:39.210260+0000", 2024-04-19T03:01:42.054 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000108962 2024-04-19T03:01:42.054 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:42.054 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:42.054 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:01:42.054 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:39.210281+0000", 2024-04-19T03:01:42.054 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.1013e-05 2024-04-19T03:01:42.054 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:42.054 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:42.054 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:01:42.054 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:39.210306+0000", 2024-04-19T03:01:42.055 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.5503e-05 2024-04-19T03:01:42.055 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:42.055 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:42.055 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:42.055 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:39.210375+0000", 2024-04-19T03:01:42.055 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.8360000000000003e-05 2024-04-19T03:01:42.055 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:42.055 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:42.055 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:01:42.055 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:39.210494+0000", 2024-04-19T03:01:42.055 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000119154 2024-04-19T03:01:42.055 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:42.055 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:42.056 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-04-19T03:01:42.056 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:39.210624+0000", 2024-04-19T03:01:42.056 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00013040600000000001 2024-04-19T03:01:42.056 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:42.056 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:42.056 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:01:42.056 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:39.212957+0000", 2024-04-19T03:01:42.056 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0023325630000000002 2024-04-19T03:01:42.056 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:42.056 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:42.056 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:42.056 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:39.221325+0000", 2024-04-19T03:01:42.056 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0083684439999999992 2024-04-19T03:01:42.056 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:42.057 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:42.057 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:01:42.057 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:39.221358+0000", 2024-04-19T03:01:42.057 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.3114999999999997e-05 2024-04-19T03:01:42.057 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:42.057 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:42.057 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:01:42.057 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:39.221397+0000", 2024-04-19T03:01:42.057 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.8846e-05 2024-04-19T03:01:42.057 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:42.057 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:42.057 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:42.057 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:42.057 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:42.058 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4755.0:3803 5.6 5:678d4a6b:::benchmark_data_smithi096_19531_object3802:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-19T03:01:42.058 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:39.210318+0000", 2024-04-19T03:01:42.058 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 2.7391728180000001, 2024-04-19T03:01:42.058 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.013528874, 2024-04-19T03:01:42.058 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:01:42.058 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:42.058 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-04-19T03:01:42.058 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4755", 2024-04-19T03:01:42.058 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:42.058 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 3803 2024-04-19T03:01:42.058 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:42.058 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:01:42.058 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:42.059 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:01:42.059 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:39.210318+0000", 2024-04-19T03:01:42.059 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:42.059 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:42.059 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:42.059 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:01:42.059 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:39.210318+0000", 2024-04-19T03:01:42.059 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:42.059 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:42.059 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:42.059 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:01:42.059 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:39.210318+0000", 2024-04-19T03:01:42.059 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2024-04-19T03:01:42.059 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:42.060 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:42.060 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:01:42.060 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:39.210411+0000", 2024-04-19T03:01:42.060 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.2949999999999996e-05 2024-04-19T03:01:42.060 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:42.060 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:42.060 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:01:42.060 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:39.210423+0000", 2024-04-19T03:01:42.060 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2119e-05 2024-04-19T03:01:42.060 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:42.060 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:42.060 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:01:42.060 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:39.210429+0000", 2024-04-19T03:01:42.060 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.5409999999999997e-06 2024-04-19T03:01:42.061 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:42.061 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:42.061 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:42.061 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:39.210477+0000", 2024-04-19T03:01:42.061 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.7673999999999998e-05 2024-04-19T03:01:42.061 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:42.061 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:42.061 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:01:42.061 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:39.210609+0000", 2024-04-19T03:01:42.061 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00013191400000000001 2024-04-19T03:01:42.061 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:42.061 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:42.061 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-04-19T03:01:42.061 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:39.210755+0000", 2024-04-19T03:01:42.062 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014639699999999999 2024-04-19T03:01:42.062 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:42.062 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:42.062 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:01:42.062 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:39.215050+0000", 2024-04-19T03:01:42.062 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0042952060000000002 2024-04-19T03:01:42.062 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:42.062 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:42.062 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:42.063 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:39.223788+0000", 2024-04-19T03:01:42.063 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0087373529999999998 2024-04-19T03:01:42.063 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:42.063 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:42.063 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:01:42.063 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:39.223822+0000", 2024-04-19T03:01:42.064 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.4545000000000002e-05 2024-04-19T03:01:42.064 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:42.064 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:42.064 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:01:42.064 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:39.223847+0000", 2024-04-19T03:01:42.064 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.4899e-05 2024-04-19T03:01:42.064 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:42.065 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:42.065 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:42.065 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:42.065 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:42.065 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4755.0:3804 5.6 5:631563b7:::benchmark_data_smithi096_19531_object3803:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-19T03:01:42.065 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:39.211389+0000", 2024-04-19T03:01:42.065 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 2.7381021269999999, 2024-04-19T03:01:42.066 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.012667085999999999, 2024-04-19T03:01:42.066 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:01:42.066 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:42.066 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-04-19T03:01:42.066 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4755", 2024-04-19T03:01:42.066 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:42.067 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 3804 2024-04-19T03:01:42.067 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:42.067 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:01:42.067 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:42.067 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:01:42.067 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:39.211389+0000", 2024-04-19T03:01:42.067 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:42.068 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:42.068 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:42.068 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:01:42.068 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:39.211389+0000", 2024-04-19T03:01:42.068 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:42.068 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:42.068 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:42.069 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:01:42.069 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:39.211388+0000", 2024-04-19T03:01:42.069 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999986 2024-04-19T03:01:42.069 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:42.069 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:42.069 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:01:42.070 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:39.211460+0000", 2024-04-19T03:01:42.070 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.2653999999999999e-05 2024-04-19T03:01:42.070 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:42.070 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:42.070 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:01:42.070 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:39.211472+0000", 2024-04-19T03:01:42.070 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1549000000000001e-05 2024-04-19T03:01:42.071 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:42.071 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:42.071 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:01:42.071 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:39.211481+0000", 2024-04-19T03:01:42.071 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.6680000000000007e-06 2024-04-19T03:01:42.071 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:42.071 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:42.072 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:42.072 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:39.211711+0000", 2024-04-19T03:01:42.072 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00023037700000000001 2024-04-19T03:01:42.072 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:42.072 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:42.072 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:01:42.072 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:39.211817+0000", 2024-04-19T03:01:42.073 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000105524 2024-04-19T03:01:42.073 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:42.073 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:42.073 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-04-19T03:01:42.073 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:39.211899+0000", 2024-04-19T03:01:42.073 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.1926000000000001e-05 2024-04-19T03:01:42.073 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:42.073 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:42.073 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:01:42.074 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:39.215057+0000", 2024-04-19T03:01:42.074 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0031585279999999999 2024-04-19T03:01:42.074 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:42.074 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:42.074 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:42.074 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:39.223976+0000", 2024-04-19T03:01:42.074 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.008918469 2024-04-19T03:01:42.074 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:42.075 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:42.075 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:01:42.075 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:39.224017+0000", 2024-04-19T03:01:42.075 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.1652e-05 2024-04-19T03:01:42.075 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:42.075 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:42.075 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:01:42.075 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:39.224056+0000", 2024-04-19T03:01:42.075 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.8936000000000001e-05 2024-04-19T03:01:42.075 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:42.075 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:42.075 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:42.075 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:42.076 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:42.076 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4755.0:3805 5.6 5:67ca77e0:::benchmark_data_smithi096_19531_object3804:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-19T03:01:42.076 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:39.211489+0000", 2024-04-19T03:01:42.076 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 2.738002421, 2024-04-19T03:01:42.076 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.012727723999999999, 2024-04-19T03:01:42.076 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:01:42.076 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:42.076 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-04-19T03:01:42.076 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4755", 2024-04-19T03:01:42.076 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:42.076 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 3805 2024-04-19T03:01:42.076 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:42.076 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:01:42.076 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:42.077 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:01:42.077 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:39.211489+0000", 2024-04-19T03:01:42.077 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:42.077 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:42.077 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:42.077 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:01:42.077 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:39.211489+0000", 2024-04-19T03:01:42.077 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:42.077 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:42.077 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:42.077 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:01:42.078 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:39.211488+0000", 2024-04-19T03:01:42.078 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999995 2024-04-19T03:01:42.078 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:42.078 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:42.078 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:01:42.078 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:39.211528+0000", 2024-04-19T03:01:42.078 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.9740000000000002e-05 2024-04-19T03:01:42.078 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:42.078 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:42.078 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:01:42.078 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:39.211536+0000", 2024-04-19T03:01:42.078 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.9130000000000003e-06 2024-04-19T03:01:42.078 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:42.079 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:42.079 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:01:42.079 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:39.211542+0000", 2024-04-19T03:01:42.079 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.8599999999999998e-06 2024-04-19T03:01:42.079 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:42.079 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:42.079 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:42.079 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:39.213004+0000", 2024-04-19T03:01:42.079 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0014621160000000001 2024-04-19T03:01:42.079 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:42.079 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:42.079 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:01:42.079 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:39.213139+0000", 2024-04-19T03:01:42.079 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00013563299999999999 2024-04-19T03:01:42.079 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:42.080 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:42.080 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-04-19T03:01:42.080 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:39.213227+0000", 2024-04-19T03:01:42.080 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.7322000000000002e-05 2024-04-19T03:01:42.080 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:42.080 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:42.080 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:01:42.080 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:39.215063+0000", 2024-04-19T03:01:42.080 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0018363629999999999 2024-04-19T03:01:42.080 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:42.080 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:42.080 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:42.080 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:39.224122+0000", 2024-04-19T03:01:42.080 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0090587979999999999 2024-04-19T03:01:42.080 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:42.081 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:42.081 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:01:42.081 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:39.224176+0000", 2024-04-19T03:01:42.081 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.4645999999999998e-05 2024-04-19T03:01:42.081 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:42.081 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:42.081 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:01:42.081 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:39.224216+0000", 2024-04-19T03:01:42.081 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.9956000000000002e-05 2024-04-19T03:01:42.081 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:42.081 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:42.081 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:42.081 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:42.081 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:42.082 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4755.0:3807 5.6 5:668f066b:::benchmark_data_smithi096_19531_object3806:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-19T03:01:42.082 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:39.212665+0000", 2024-04-19T03:01:42.082 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 2.7368261770000002, 2024-04-19T03:01:42.082 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.011688258999999999, 2024-04-19T03:01:42.082 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:01:42.082 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:42.082 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-04-19T03:01:42.082 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4755", 2024-04-19T03:01:42.082 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:42.082 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 3807 2024-04-19T03:01:42.082 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:42.083 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:01:42.083 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:42.083 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:01:42.083 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:39.212665+0000", 2024-04-19T03:01:42.083 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:42.083 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:42.083 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:42.083 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:01:42.083 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:39.212665+0000", 2024-04-19T03:01:42.083 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:42.083 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:42.083 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:42.083 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:01:42.083 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:39.212664+0000", 2024-04-19T03:01:42.084 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2024-04-19T03:01:42.084 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:42.084 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:42.084 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:01:42.084 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:39.212736+0000", 2024-04-19T03:01:42.084 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.2078999999999999e-05 2024-04-19T03:01:42.084 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:42.084 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:42.084 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:01:42.084 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:39.212747+0000", 2024-04-19T03:01:42.084 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1089e-05 2024-04-19T03:01:42.084 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:42.085 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:42.085 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:01:42.085 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:39.212754+0000", 2024-04-19T03:01:42.085 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.058e-06 2024-04-19T03:01:42.085 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:42.085 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:42.085 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:42.085 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:39.214124+0000", 2024-04-19T03:01:42.085 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0013694619999999999 2024-04-19T03:01:42.085 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:42.085 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:42.085 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:01:42.086 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:39.214218+0000", 2024-04-19T03:01:42.086 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.4668999999999998e-05 2024-04-19T03:01:42.086 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:42.086 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:42.086 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-04-19T03:01:42.086 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:39.214308+0000", 2024-04-19T03:01:42.087 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.9635000000000005e-05 2024-04-19T03:01:42.087 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:42.087 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:42.087 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:01:42.087 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:39.215513+0000", 2024-04-19T03:01:42.087 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0012048600000000001 2024-04-19T03:01:42.087 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:42.088 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:42.088 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:42.088 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:39.224264+0000", 2024-04-19T03:01:42.088 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0087506470000000003 2024-04-19T03:01:42.088 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:42.088 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:42.089 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:01:42.089 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:39.224312+0000", 2024-04-19T03:01:42.089 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.8854999999999999e-05 2024-04-19T03:01:42.089 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:42.089 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:42.089 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:01:42.089 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:39.224353+0000", 2024-04-19T03:01:42.090 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.0815000000000001e-05 2024-04-19T03:01:42.090 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:42.090 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:42.090 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:42.090 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:42.090 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:42.091 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-04-19T03:01:42.092 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2: {} 2024-04-19T03:01:42.094 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T03:01:42.095 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-04-19T03:01:42.085+0000 7f35986ab700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18243) UID: 0 2024-04-19T03:01:42.095 INFO:teuthology.orchestra.run.smithi096.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T03:01:42.096 INFO:teuthology.orchestra.run.smithi096.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-19T03:01:42.096 INFO:teuthology.orchestra.run.smithi096.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-19T03:01:42.193 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:01:42.192+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:01:42.235 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-19T03:01:42.235 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-04-19T03:01:42.235 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.235 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:11644 5.d 5:b18f5742:::benchmark_data_smithi096_19531_object11643:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T03:01:42.235 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:42.229253+0000", 2024-04-19T03:01:42.235 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0051525709999999999, 2024-04-19T03:01:42.235 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.005178027, 2024-04-19T03:01:42.235 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:01:42.236 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:01:42.236 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:01:42.236 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:01:42.236 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:42.236 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 11644 2024-04-19T03:01:42.236 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.236 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:01:42.236 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.236 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:01:42.236 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.229253+0000", 2024-04-19T03:01:42.236 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:42.236 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.236 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.237 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:01:42.237 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.229253+0000", 2024-04-19T03:01:42.237 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:42.237 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.237 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.237 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:01:42.237 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.229252+0000", 2024-04-19T03:01:42.237 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:01:42.237 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.237 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.237 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:01:42.237 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.229392+0000", 2024-04-19T03:01:42.237 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000140235 2024-04-19T03:01:42.237 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.238 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.238 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:01:42.238 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.229403+0000", 2024-04-19T03:01:42.238 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1174e-05 2024-04-19T03:01:42.238 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.238 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.238 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:01:42.238 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.229409+0000", 2024-04-19T03:01:42.238 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8939999999999998e-06 2024-04-19T03:01:42.238 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.238 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.238 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:42.238 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.229475+0000", 2024-04-19T03:01:42.238 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5728000000000005e-05 2024-04-19T03:01:42.239 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.239 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.239 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:01:42.239 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.229668+0000", 2024-04-19T03:01:42.239 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00019320900000000001 2024-04-19T03:01:42.239 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.239 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.239 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-04-19T03:01:42.239 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.229971+0000", 2024-04-19T03:01:42.239 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00030283600000000001 2024-04-19T03:01:42.239 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:42.239 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:01:42.239 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:42.239 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.240 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.240 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:11647 5.d 5:b0ca5c4c:::benchmark_data_smithi096_19531_object11646:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T03:01:42.240 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:42.230836+0000", 2024-04-19T03:01:42.240 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0035695940000000002, 2024-04-19T03:01:42.240 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0036651180000000002, 2024-04-19T03:01:42.240 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:01:42.240 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:01:42.240 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:01:42.240 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:01:42.240 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:42.240 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 11647 2024-04-19T03:01:42.240 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.240 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:01:42.240 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.241 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:01:42.241 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.230836+0000", 2024-04-19T03:01:42.241 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:42.241 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.241 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.241 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:01:42.241 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.230836+0000", 2024-04-19T03:01:42.241 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:42.241 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.241 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.241 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:01:42.241 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.230835+0000", 2024-04-19T03:01:42.241 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:01:42.241 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.242 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.242 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:01:42.242 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.230972+0000", 2024-04-19T03:01:42.242 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000137386 2024-04-19T03:01:42.242 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.242 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.242 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:01:42.242 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.230991+0000", 2024-04-19T03:01:42.242 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8703999999999999e-05 2024-04-19T03:01:42.242 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.242 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.242 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:01:42.242 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.231006+0000", 2024-04-19T03:01:42.243 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5339e-05 2024-04-19T03:01:42.243 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.243 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.243 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:42.243 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.231250+0000", 2024-04-19T03:01:42.243 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00024398599999999999 2024-04-19T03:01:42.243 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.243 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.243 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:01:42.243 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.231366+0000", 2024-04-19T03:01:42.243 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011637999999999999 2024-04-19T03:01:42.243 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.243 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.243 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-04-19T03:01:42.244 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.231489+0000", 2024-04-19T03:01:42.244 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000122669 2024-04-19T03:01:42.244 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:42.244 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:01:42.244 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:42.244 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.244 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.244 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:11649 5.0 5:01b809f9:::benchmark_data_smithi096_19531_object11648:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T03:01:42.244 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:42.231017+0000", 2024-04-19T03:01:42.244 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0033878889999999998, 2024-04-19T03:01:42.244 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0035444719999999999, 2024-04-19T03:01:42.244 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:01:42.244 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:01:42.244 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:01:42.244 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:01:42.245 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:42.245 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 11649 2024-04-19T03:01:42.245 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.245 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:01:42.245 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.245 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:01:42.245 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.231017+0000", 2024-04-19T03:01:42.245 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:42.245 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.245 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.245 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:01:42.245 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.231017+0000", 2024-04-19T03:01:42.245 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:42.245 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.246 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.246 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:01:42.246 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.231017+0000", 2024-04-19T03:01:42.246 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:01:42.246 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.246 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.246 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:01:42.246 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.231069+0000", 2024-04-19T03:01:42.246 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2065999999999999e-05 2024-04-19T03:01:42.246 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.246 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.246 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:01:42.246 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.231082+0000", 2024-04-19T03:01:42.246 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3543000000000001e-05 2024-04-19T03:01:42.247 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.247 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.247 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:01:42.247 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.231091+0000", 2024-04-19T03:01:42.247 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.473e-06 2024-04-19T03:01:42.247 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.247 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.247 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:42.247 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.231139+0000", 2024-04-19T03:01:42.247 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7889000000000002e-05 2024-04-19T03:01:42.247 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.247 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.247 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:01:42.247 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.231256+0000", 2024-04-19T03:01:42.248 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000116999 2024-04-19T03:01:42.248 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.248 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.248 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:01:42.248 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.231378+0000", 2024-04-19T03:01:42.248 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000122383 2024-04-19T03:01:42.248 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:42.248 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:01:42.248 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:42.248 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.248 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.248 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:11651 5.d 5:b94e9545:::benchmark_data_smithi096_19531_object11650:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T03:01:42.248 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:42.231751+0000", 2024-04-19T03:01:42.248 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0026539659999999998, 2024-04-19T03:01:42.249 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0028701780000000001, 2024-04-19T03:01:42.249 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:01:42.249 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:01:42.249 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:01:42.249 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:01:42.249 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:42.249 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 11651 2024-04-19T03:01:42.249 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.249 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:01:42.249 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.249 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:01:42.249 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.231751+0000", 2024-04-19T03:01:42.249 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:42.249 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.249 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.250 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:01:42.250 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.231751+0000", 2024-04-19T03:01:42.250 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:42.250 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.250 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.250 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:01:42.250 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.231750+0000", 2024-04-19T03:01:42.250 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:01:42.250 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.250 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.250 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:01:42.250 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.231864+0000", 2024-04-19T03:01:42.250 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011336999999999999 2024-04-19T03:01:42.251 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.251 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.251 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:01:42.251 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.231897+0000", 2024-04-19T03:01:42.251 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3915000000000003e-05 2024-04-19T03:01:42.251 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.251 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.251 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:01:42.251 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.231927+0000", 2024-04-19T03:01:42.251 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9785999999999999e-05 2024-04-19T03:01:42.251 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.251 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.251 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:42.251 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.232661+0000", 2024-04-19T03:01:42.251 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000733686 2024-04-19T03:01:42.252 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.252 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.252 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:01:42.252 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.232792+0000", 2024-04-19T03:01:42.252 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013085399999999999 2024-04-19T03:01:42.252 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.252 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.252 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-04-19T03:01:42.252 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.232883+0000", 2024-04-19T03:01:42.252 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1036e-05 2024-04-19T03:01:42.252 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:42.252 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:01:42.252 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:42.252 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.253 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.253 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:11654 5.d 5:b34fd53f:::benchmark_data_smithi096_19531_object11653:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T03:01:42.253 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:42.231943+0000", 2024-04-19T03:01:42.253 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0024626269999999998, 2024-04-19T03:01:42.253 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0027365610000000002, 2024-04-19T03:01:42.253 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:01:42.253 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:01:42.253 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:01:42.253 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:01:42.253 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:42.253 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 11654 2024-04-19T03:01:42.253 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.253 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:01:42.253 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.254 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:01:42.254 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.231943+0000", 2024-04-19T03:01:42.254 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:42.254 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.254 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.254 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:01:42.254 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.231943+0000", 2024-04-19T03:01:42.254 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:42.254 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.254 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.254 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:01:42.254 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.231942+0000", 2024-04-19T03:01:42.254 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:01:42.254 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.255 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.255 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:01:42.255 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.231984+0000", 2024-04-19T03:01:42.255 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1625000000000002e-05 2024-04-19T03:01:42.255 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.255 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.255 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:01:42.255 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.231997+0000", 2024-04-19T03:01:42.255 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3787e-05 2024-04-19T03:01:42.255 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.255 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.255 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:01:42.255 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.232005+0000", 2024-04-19T03:01:42.255 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0350000000000001e-06 2024-04-19T03:01:42.256 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.256 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.256 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:42.256 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.233941+0000", 2024-04-19T03:01:42.256 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001935476 2024-04-19T03:01:42.256 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.256 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.256 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:01:42.256 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.234072+0000", 2024-04-19T03:01:42.256 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013110899999999999 2024-04-19T03:01:42.256 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.256 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.256 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-04-19T03:01:42.256 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.234156+0000", 2024-04-19T03:01:42.257 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.4451999999999997e-05 2024-04-19T03:01:42.257 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:42.257 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:01:42.257 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:42.257 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.257 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.257 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:11655 5.e 5:7ff999de:::benchmark_data_smithi096_19531_object11654:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T03:01:42.257 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:42.232135+0000", 2024-04-19T03:01:42.257 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0022700649999999999, 2024-04-19T03:01:42.257 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0026084770000000001, 2024-04-19T03:01:42.257 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:01:42.257 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:01:42.257 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:01:42.257 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:01:42.258 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:42.258 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 11655 2024-04-19T03:01:42.258 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.258 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:01:42.258 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.258 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:01:42.258 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.232135+0000", 2024-04-19T03:01:42.258 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:42.258 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.258 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.258 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:01:42.258 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.232135+0000", 2024-04-19T03:01:42.258 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:42.258 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.259 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.259 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:01:42.259 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.232135+0000", 2024-04-19T03:01:42.259 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:01:42.259 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.259 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.259 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:01:42.259 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.232218+0000", 2024-04-19T03:01:42.259 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3301999999999996e-05 2024-04-19T03:01:42.259 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.259 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.259 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:01:42.259 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.232228+0000", 2024-04-19T03:01:42.259 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0305999999999999e-05 2024-04-19T03:01:42.259 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.260 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.260 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:01:42.260 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.232237+0000", 2024-04-19T03:01:42.260 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3639999999999999e-06 2024-04-19T03:01:42.260 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.260 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.260 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:42.260 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.232312+0000", 2024-04-19T03:01:42.260 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5576999999999998e-05 2024-04-19T03:01:42.260 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.260 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.260 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:01:42.260 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.232551+0000", 2024-04-19T03:01:42.260 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000238667 2024-04-19T03:01:42.261 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.261 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.261 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:01:42.261 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.232706+0000", 2024-04-19T03:01:42.261 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000155515 2024-04-19T03:01:42.261 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:42.261 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:01:42.261 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:42.261 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.261 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.261 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop_reply(client.4755.0:11644 5.d e26/22)", 2024-04-19T03:01:42.261 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:42.232929+0000", 2024-04-19T03:01:42.261 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0014766720000000001, 2024-04-19T03:01:42.261 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00186331, 2024-04-19T03:01:42.261 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:01:42.262 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-04-19T03:01:42.262 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:01:42.262 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.262 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:01:42.262 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.232929+0000", 2024-04-19T03:01:42.262 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:42.262 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.262 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.262 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:01:42.262 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.232929+0000", 2024-04-19T03:01:42.262 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:42.262 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.262 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.263 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:01:42.263 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.232928+0000", 2024-04-19T03:01:42.263 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:01:42.263 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.263 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.263 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:01:42.263 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.232934+0000", 2024-04-19T03:01:42.263 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4899999999999997e-06 2024-04-19T03:01:42.263 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.263 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.263 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:01:42.263 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.232948+0000", 2024-04-19T03:01:42.263 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3679000000000001e-05 2024-04-19T03:01:42.263 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.263 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.264 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:01:42.264 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.232955+0000", 2024-04-19T03:01:42.264 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5120000000000002e-06 2024-04-19T03:01:42.264 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:42.264 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:01:42.264 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:42.264 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.264 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.264 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:11659 5.0 5:0119fba2:::benchmark_data_smithi096_19531_object11658:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T03:01:42.264 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:42.233108+0000", 2024-04-19T03:01:42.264 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.001297084, 2024-04-19T03:01:42.264 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001723254, 2024-04-19T03:01:42.264 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:01:42.264 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:01:42.265 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:01:42.265 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:01:42.265 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:42.265 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 11659 2024-04-19T03:01:42.265 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.265 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:01:42.265 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.265 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:01:42.265 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.233108+0000", 2024-04-19T03:01:42.265 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:42.265 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.265 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.265 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:01:42.265 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.233108+0000", 2024-04-19T03:01:42.266 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:42.266 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.266 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.266 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:01:42.266 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.233107+0000", 2024-04-19T03:01:42.266 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:01:42.266 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.266 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.266 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:01:42.266 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.233203+0000", 2024-04-19T03:01:42.266 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.5817999999999996e-05 2024-04-19T03:01:42.266 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.266 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.267 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:01:42.267 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.233217+0000", 2024-04-19T03:01:42.267 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4039000000000001e-05 2024-04-19T03:01:42.267 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.267 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.267 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:01:42.267 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.233225+0000", 2024-04-19T03:01:42.267 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.2970000000000004e-06 2024-04-19T03:01:42.267 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.267 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.267 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:42.267 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.233268+0000", 2024-04-19T03:01:42.267 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2296000000000003e-05 2024-04-19T03:01:42.267 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.267 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.268 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:01:42.268 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.233454+0000", 2024-04-19T03:01:42.268 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000186126 2024-04-19T03:01:42.268 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.268 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.268 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:01:42.268 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.233656+0000", 2024-04-19T03:01:42.268 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00020195599999999999 2024-04-19T03:01:42.268 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:42.268 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:01:42.268 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:42.268 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.268 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.268 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop_reply(client.4755.0:11649 5.0 e26/22)", 2024-04-19T03:01:42.269 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:42.233619+0000", 2024-04-19T03:01:42.269 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.00078642299999999996, 2024-04-19T03:01:42.269 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0012604510000000001, 2024-04-19T03:01:42.269 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:01:42.269 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-04-19T03:01:42.269 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:01:42.269 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.269 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:01:42.269 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.233619+0000", 2024-04-19T03:01:42.269 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:42.269 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.269 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.269 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:01:42.269 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.233619+0000", 2024-04-19T03:01:42.270 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:42.270 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.270 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.270 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:01:42.270 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.233618+0000", 2024-04-19T03:01:42.270 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:01:42.270 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.270 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.270 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:01:42.270 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.233634+0000", 2024-04-19T03:01:42.270 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6277e-05 2024-04-19T03:01:42.270 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.270 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.271 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:01:42.271 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.233652+0000", 2024-04-19T03:01:42.271 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.789e-05 2024-04-19T03:01:42.271 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.271 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.271 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:01:42.271 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.233661+0000", 2024-04-19T03:01:42.271 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1050000000000001e-06 2024-04-19T03:01:42.271 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:42.271 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:01:42.271 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:42.271 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.271 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.271 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:11637 5.d 5:bd04e91d:::benchmark_data_smithi096_19531_object11636:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T03:01:42.272 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:42.226957+0000", 2024-04-19T03:01:42.272 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0074485519999999998, 2024-04-19T03:01:42.272 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0079919369999999993, 2024-04-19T03:01:42.272 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:01:42.272 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:01:42.272 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:01:42.272 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:01:42.272 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:42.272 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 11637 2024-04-19T03:01:42.272 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.272 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:01:42.272 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.272 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:01:42.272 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.226957+0000", 2024-04-19T03:01:42.273 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:42.273 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.273 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.273 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:01:42.273 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.226957+0000", 2024-04-19T03:01:42.273 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:42.273 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.273 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.273 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:01:42.273 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.226956+0000", 2024-04-19T03:01:42.273 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:01:42.273 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.273 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.273 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:01:42.273 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.227003+0000", 2024-04-19T03:01:42.274 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7425000000000001e-05 2024-04-19T03:01:42.274 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.274 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.274 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:01:42.274 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.227026+0000", 2024-04-19T03:01:42.274 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3051e-05 2024-04-19T03:01:42.274 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.274 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.274 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:01:42.274 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.227035+0000", 2024-04-19T03:01:42.274 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.7409999999999998e-06 2024-04-19T03:01:42.274 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.274 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.274 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:42.275 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.227088+0000", 2024-04-19T03:01:42.275 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3528e-05 2024-04-19T03:01:42.275 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.275 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.275 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:01:42.275 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.227276+0000", 2024-04-19T03:01:42.275 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00018787200000000001 2024-04-19T03:01:42.275 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.275 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.275 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-04-19T03:01:42.275 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.227436+0000", 2024-04-19T03:01:42.276 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015965200000000001 2024-04-19T03:01:42.276 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.276 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.276 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:42.276 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.231224+0000", 2024-04-19T03:01:42.276 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.003788249 2024-04-19T03:01:42.276 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:42.276 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:01:42.276 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:42.276 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:42.276 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-04-19T03:01:42.277 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 10 2024-04-19T03:01:42.277 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-19T03:01:42.278 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T03:01:42.293 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:01:42.292+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:01:42.394 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:01:42.392+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:01:42.399 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-19T03:01:42.399 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-04-19T03:01:42.399 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-04-19T03:01:42.400 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-04-19T03:01:42.400 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-19T03:01:42.412 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T03:01:42.495 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:01:42.492+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:01:42.584 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-19T03:01:42.584 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-04-19T03:01:42.584 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-04-19T03:01:42.584 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-04-19T03:01:42.584 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.585 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:9 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:01:42.585 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:14.999380+0000", 2024-04-19T03:01:42.585 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 27.582580960000001, 2024-04-19T03:01:42.585 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.019009906, 2024-04-19T03:01:42.585 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:01:42.585 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:42.585 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:01:42.585 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.585 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:01:42.585 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999380+0000", 2024-04-19T03:01:42.585 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:42.585 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.585 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.586 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:01:42.586 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999380+0000", 2024-04-19T03:01:42.586 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:42.586 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.586 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.586 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:01:42.586 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999377+0000", 2024-04-19T03:01:42.586 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999971 2024-04-19T03:01:42.586 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.586 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.586 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:01:42.586 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999393+0000", 2024-04-19T03:01:42.586 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5665999999999999e-05 2024-04-19T03:01:42.587 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.587 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.587 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:01:42.587 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999416+0000", 2024-04-19T03:01:42.587 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3030000000000001e-05 2024-04-19T03:01:42.587 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.587 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.587 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:01:42.587 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999439+0000", 2024-04-19T03:01:42.587 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3203000000000001e-05 2024-04-19T03:01:42.587 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.587 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.587 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:42.587 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999564+0000", 2024-04-19T03:01:42.588 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012492800000000001 2024-04-19T03:01:42.588 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.588 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.588 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op must wait for map", 2024-04-19T03:01:42.588 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999573+0000", 2024-04-19T03:01:42.588 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.7129999999999994e-06 2024-04-19T03:01:42.588 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.588 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.588 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:42.588 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.005623+0000", 2024-04-19T03:01:42.588 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0060502120000000001 2024-04-19T03:01:42.588 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.588 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.588 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:01:42.589 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.006510+0000", 2024-04-19T03:01:42.589 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00088656 2024-04-19T03:01:42.589 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.589 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.589 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-04-19T03:01:42.589 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.008004+0000", 2024-04-19T03:01:42.589 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0014948240000000001 2024-04-19T03:01:42.589 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.589 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.589 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:01:42.589 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.011874+0000", 2024-04-19T03:01:42.589 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0038699630000000001 2024-04-19T03:01:42.589 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.589 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.590 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:42.590 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.018000+0000", 2024-04-19T03:01:42.590 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0061254389999999999 2024-04-19T03:01:42.590 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.590 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.590 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:01:42.590 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.018281+0000", 2024-04-19T03:01:42.590 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00028121400000000001 2024-04-19T03:01:42.590 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.590 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.590 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:01:42.590 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.018390+0000", 2024-04-19T03:01:42.590 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010899 2024-04-19T03:01:42.591 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:42.591 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:01:42.591 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:42.591 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.591 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.591 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:10 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:01:42.591 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:14.999496+0000", 2024-04-19T03:01:42.591 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 27.582465424999999, 2024-04-19T03:01:42.591 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.022720497999999999, 2024-04-19T03:01:42.591 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:01:42.591 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:42.591 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:01:42.591 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.591 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:01:42.592 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999496+0000", 2024-04-19T03:01:42.592 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:42.592 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.592 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.592 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:01:42.592 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999496+0000", 2024-04-19T03:01:42.592 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:42.592 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.592 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.592 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:01:42.592 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999494+0000", 2024-04-19T03:01:42.592 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:01:42.592 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.592 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.593 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:01:42.593 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999503+0000", 2024-04-19T03:01:42.593 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.5930000000000006e-06 2024-04-19T03:01:42.593 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.593 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.593 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:01:42.593 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999523+0000", 2024-04-19T03:01:42.593 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9553000000000001e-05 2024-04-19T03:01:42.593 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.593 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.593 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:01:42.593 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999538+0000", 2024-04-19T03:01:42.593 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5702999999999999e-05 2024-04-19T03:01:42.593 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.594 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.594 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:42.594 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999608+0000", 2024-04-19T03:01:42.594 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.9912000000000004e-05 2024-04-19T03:01:42.594 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.594 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.594 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op must wait for map", 2024-04-19T03:01:42.594 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999626+0000", 2024-04-19T03:01:42.594 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8207e-05 2024-04-19T03:01:42.594 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.594 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.594 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:42.594 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.010765+0000", 2024-04-19T03:01:42.594 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011138719 2024-04-19T03:01:42.595 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.595 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.595 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:01:42.595 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.010906+0000", 2024-04-19T03:01:42.595 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014095899999999999 2024-04-19T03:01:42.595 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.595 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.595 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-04-19T03:01:42.595 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.011472+0000", 2024-04-19T03:01:42.595 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00056629300000000005 2024-04-19T03:01:42.595 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.595 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.595 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:01:42.595 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.013217+0000", 2024-04-19T03:01:42.595 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001744317 2024-04-19T03:01:42.596 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.596 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.596 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:42.596 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.022083+0000", 2024-04-19T03:01:42.596 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0088663849999999992 2024-04-19T03:01:42.596 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.596 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.596 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:01:42.596 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.022124+0000", 2024-04-19T03:01:42.596 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.057e-05 2024-04-19T03:01:42.596 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.596 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.596 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:01:42.596 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.022216+0000", 2024-04-19T03:01:42.597 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.2417000000000006e-05 2024-04-19T03:01:42.597 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:42.597 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:01:42.597 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:42.597 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.597 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.597 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:13 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:01:42.597 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:14.999564+0000", 2024-04-19T03:01:42.597 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 27.582396543000002, 2024-04-19T03:01:42.597 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.019594777000000001, 2024-04-19T03:01:42.597 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:01:42.597 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:42.597 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:01:42.597 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.597 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:01:42.598 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999564+0000", 2024-04-19T03:01:42.598 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:42.598 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.598 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.598 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:01:42.598 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999564+0000", 2024-04-19T03:01:42.598 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:42.598 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.598 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.598 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:01:42.598 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999563+0000", 2024-04-19T03:01:42.598 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:01:42.598 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.599 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.599 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:01:42.599 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999582+0000", 2024-04-19T03:01:42.599 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8151999999999998e-05 2024-04-19T03:01:42.599 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.599 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.599 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:01:42.599 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999599+0000", 2024-04-19T03:01:42.599 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7583000000000001e-05 2024-04-19T03:01:42.599 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.599 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.599 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:01:42.599 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999618+0000", 2024-04-19T03:01:42.599 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8989999999999999e-05 2024-04-19T03:01:42.600 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.600 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.600 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:42.600 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999692+0000", 2024-04-19T03:01:42.600 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3561999999999998e-05 2024-04-19T03:01:42.600 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.600 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.600 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op must wait for map", 2024-04-19T03:01:42.600 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999698+0000", 2024-04-19T03:01:42.600 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7159999999999997e-06 2024-04-19T03:01:42.600 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.600 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.600 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:42.600 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.007836+0000", 2024-04-19T03:01:42.600 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0081376520000000004 2024-04-19T03:01:42.601 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.601 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.601 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:01:42.601 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.008208+0000", 2024-04-19T03:01:42.601 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00037223699999999998 2024-04-19T03:01:42.601 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.601 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.601 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-04-19T03:01:42.601 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.008516+0000", 2024-04-19T03:01:42.601 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000308227 2024-04-19T03:01:42.601 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.601 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.601 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:01:42.601 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.011585+0000", 2024-04-19T03:01:42.602 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0030680659999999999 2024-04-19T03:01:42.602 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.602 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.602 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:42.602 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.018871+0000", 2024-04-19T03:01:42.602 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0072861369999999998 2024-04-19T03:01:42.602 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.602 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.602 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:01:42.602 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.019067+0000", 2024-04-19T03:01:42.602 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00019672099999999999 2024-04-19T03:01:42.602 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.602 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.602 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:01:42.603 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.019159+0000", 2024-04-19T03:01:42.603 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1829999999999993e-05 2024-04-19T03:01:42.603 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:42.603 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:01:42.603 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:42.603 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.603 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.603 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:31 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:01:42.603 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:14.999649+0000", 2024-04-19T03:01:42.603 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 27.582312425000001, 2024-04-19T03:01:42.603 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.018882121000000002, 2024-04-19T03:01:42.603 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:01:42.603 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:42.603 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:01:42.604 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.604 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:01:42.604 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999649+0000", 2024-04-19T03:01:42.604 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:42.604 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.604 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.604 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:01:42.604 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999649+0000", 2024-04-19T03:01:42.604 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:42.604 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.604 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.604 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:01:42.604 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999647+0000", 2024-04-19T03:01:42.604 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:01:42.604 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.605 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.605 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:01:42.605 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999657+0000", 2024-04-19T03:01:42.605 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.3729999999999999e-06 2024-04-19T03:01:42.605 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.605 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.605 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:01:42.605 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999675+0000", 2024-04-19T03:01:42.605 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8522999999999999e-05 2024-04-19T03:01:42.605 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.606 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.606 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:01:42.606 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999689+0000", 2024-04-19T03:01:42.606 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.347e-05 2024-04-19T03:01:42.606 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.606 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.606 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:42.606 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999761+0000", 2024-04-19T03:01:42.606 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.1904999999999997e-05 2024-04-19T03:01:42.606 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.606 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.606 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:01:42.606 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999766+0000", 2024-04-19T03:01:42.606 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6069999999999998e-06 2024-04-19T03:01:42.607 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.607 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.607 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:42.607 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.010040+0000", 2024-04-19T03:01:42.607 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.010273381 2024-04-19T03:01:42.607 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.607 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.607 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:01:42.607 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.010260+0000", 2024-04-19T03:01:42.607 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00022003300000000001 2024-04-19T03:01:42.607 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.607 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.607 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-04-19T03:01:42.607 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.010415+0000", 2024-04-19T03:01:42.608 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015515599999999999 2024-04-19T03:01:42.608 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.608 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.608 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:01:42.608 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.013206+0000", 2024-04-19T03:01:42.608 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0027915010000000001 2024-04-19T03:01:42.608 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.608 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.608 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:42.608 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.018438+0000", 2024-04-19T03:01:42.608 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0052313469999999999 2024-04-19T03:01:42.608 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.608 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.608 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:01:42.609 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.018491+0000", 2024-04-19T03:01:42.609 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3554000000000003e-05 2024-04-19T03:01:42.609 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.609 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.609 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:01:42.609 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.018531+0000", 2024-04-19T03:01:42.609 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9384000000000001e-05 2024-04-19T03:01:42.609 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:42.609 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:01:42.609 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:42.609 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.609 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.609 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:32 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:01:42.609 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:14.999712+0000", 2024-04-19T03:01:42.609 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 27.582249181999998, 2024-04-19T03:01:42.610 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.022635437000000001, 2024-04-19T03:01:42.610 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:01:42.610 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:42.610 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:01:42.610 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.610 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:01:42.610 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999712+0000", 2024-04-19T03:01:42.610 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:42.610 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.610 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.610 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:01:42.610 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999712+0000", 2024-04-19T03:01:42.610 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:42.610 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.611 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.611 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:01:42.611 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999711+0000", 2024-04-19T03:01:42.611 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:01:42.611 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.611 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.611 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:01:42.611 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999719+0000", 2024-04-19T03:01:42.611 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.354e-06 2024-04-19T03:01:42.611 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.611 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.611 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:01:42.611 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999735+0000", 2024-04-19T03:01:42.611 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6288999999999999e-05 2024-04-19T03:01:42.612 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.612 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.612 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:01:42.612 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999749+0000", 2024-04-19T03:01:42.612 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3492999999999999e-05 2024-04-19T03:01:42.612 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.612 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.612 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:42.612 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999811+0000", 2024-04-19T03:01:42.612 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2298999999999994e-05 2024-04-19T03:01:42.612 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.612 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.612 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:01:42.612 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999817+0000", 2024-04-19T03:01:42.613 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2169999999999999e-06 2024-04-19T03:01:42.613 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.613 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.613 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:42.613 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.011836+0000", 2024-04-19T03:01:42.613 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.012018008 2024-04-19T03:01:42.613 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.613 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.613 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:01:42.613 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.011897+0000", 2024-04-19T03:01:42.613 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1111000000000005e-05 2024-04-19T03:01:42.613 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.613 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.613 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-04-19T03:01:42.614 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.011980+0000", 2024-04-19T03:01:42.614 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3003999999999993e-05 2024-04-19T03:01:42.614 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.614 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.614 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:01:42.614 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.013863+0000", 2024-04-19T03:01:42.614 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001883804 2024-04-19T03:01:42.614 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.614 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.614 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:42.614 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.022257+0000", 2024-04-19T03:01:42.614 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0083938290000000002 2024-04-19T03:01:42.614 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.614 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.615 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:01:42.615 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.022310+0000", 2024-04-19T03:01:42.615 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.236e-05 2024-04-19T03:01:42.615 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.615 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.615 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:01:42.615 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.022347+0000", 2024-04-19T03:01:42.615 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7653e-05 2024-04-19T03:01:42.615 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:42.615 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:01:42.615 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:42.615 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.615 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.615 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:35 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:01:42.616 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:14.999772+0000", 2024-04-19T03:01:42.616 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 27.582188902999999, 2024-04-19T03:01:42.616 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020205530999999999, 2024-04-19T03:01:42.616 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:01:42.616 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:42.616 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:01:42.616 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.616 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:01:42.616 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999772+0000", 2024-04-19T03:01:42.616 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:42.616 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.616 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.616 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:01:42.616 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999772+0000", 2024-04-19T03:01:42.617 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:42.617 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.617 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.617 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:01:42.617 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999771+0000", 2024-04-19T03:01:42.617 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:01:42.617 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.617 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.617 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:01:42.617 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999778+0000", 2024-04-19T03:01:42.617 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2200000000000003e-06 2024-04-19T03:01:42.617 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.617 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.617 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:01:42.617 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999794+0000", 2024-04-19T03:01:42.618 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5798999999999999e-05 2024-04-19T03:01:42.618 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.618 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.618 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:01:42.618 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999809+0000", 2024-04-19T03:01:42.618 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.469e-05 2024-04-19T03:01:42.618 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.618 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.618 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:42.618 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999915+0000", 2024-04-19T03:01:42.618 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000105658 2024-04-19T03:01:42.618 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.618 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.619 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:01:42.619 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999927+0000", 2024-04-19T03:01:42.619 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.201e-05 2024-04-19T03:01:42.619 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.619 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.619 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:42.619 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.009841+0000", 2024-04-19T03:01:42.619 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0099147039999999999 2024-04-19T03:01:42.619 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.619 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.619 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:01:42.619 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.009941+0000", 2024-04-19T03:01:42.619 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.9461000000000002e-05 2024-04-19T03:01:42.619 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.620 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.620 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-04-19T03:01:42.620 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.010101+0000", 2024-04-19T03:01:42.620 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016028599999999999 2024-04-19T03:01:42.620 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.620 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.620 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:01:42.620 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.011787+0000", 2024-04-19T03:01:42.620 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001685513 2024-04-19T03:01:42.620 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.620 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.620 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:42.620 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.019889+0000", 2024-04-19T03:01:42.620 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0081026559999999997 2024-04-19T03:01:42.621 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.621 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.621 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:01:42.621 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.019932+0000", 2024-04-19T03:01:42.621 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2385000000000002e-05 2024-04-19T03:01:42.621 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.621 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.621 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:01:42.621 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.019978+0000", 2024-04-19T03:01:42.621 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6093000000000001e-05 2024-04-19T03:01:42.621 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:42.621 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:01:42.621 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:42.621 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.622 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.622 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:18 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:01:42.622 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:14.999834+0000", 2024-04-19T03:01:42.622 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 27.582126817999999, 2024-04-19T03:01:42.622 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.019567312999999999, 2024-04-19T03:01:42.622 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:01:42.622 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:42.622 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:01:42.622 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.622 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:01:42.622 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999834+0000", 2024-04-19T03:01:42.622 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:42.622 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.623 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.623 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:01:42.623 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999834+0000", 2024-04-19T03:01:42.623 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:42.623 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.623 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.623 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:01:42.623 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999833+0000", 2024-04-19T03:01:42.623 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:01:42.623 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.623 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.623 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:01:42.623 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999842+0000", 2024-04-19T03:01:42.623 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.2269999999999999e-06 2024-04-19T03:01:42.624 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.624 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.624 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:01:42.624 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999860+0000", 2024-04-19T03:01:42.624 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8456000000000001e-05 2024-04-19T03:01:42.624 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.624 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.624 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:01:42.624 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999874+0000", 2024-04-19T03:01:42.624 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3263e-05 2024-04-19T03:01:42.624 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.624 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.624 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:42.624 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999934+0000", 2024-04-19T03:01:42.624 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0888999999999999e-05 2024-04-19T03:01:42.625 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.625 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.625 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:01:42.625 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999940+0000", 2024-04-19T03:01:42.625 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4330000000000003e-06 2024-04-19T03:01:42.625 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.625 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.626 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:42.626 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.010943+0000", 2024-04-19T03:01:42.626 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011002786000000001 2024-04-19T03:01:42.626 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.626 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.627 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:01:42.627 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.011078+0000", 2024-04-19T03:01:42.627 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013541000000000001 2024-04-19T03:01:42.627 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.627 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.627 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-04-19T03:01:42.627 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.011172+0000", 2024-04-19T03:01:42.627 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.3459000000000001e-05 2024-04-19T03:01:42.627 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.627 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.627 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:01:42.627 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.013211+0000", 2024-04-19T03:01:42.627 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0020397710000000001 2024-04-19T03:01:42.628 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.628 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.628 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:42.628 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.019320+0000", 2024-04-19T03:01:42.628 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0061089969999999997 2024-04-19T03:01:42.628 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.628 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.628 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:01:42.628 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.019364+0000", 2024-04-19T03:01:42.628 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4158e-05 2024-04-19T03:01:42.628 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.628 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.628 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:01:42.628 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.019402+0000", 2024-04-19T03:01:42.628 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7011000000000002e-05 2024-04-19T03:01:42.629 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:42.629 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:01:42.629 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:42.629 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.629 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.629 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:21 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:01:42.629 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:14.999896+0000", 2024-04-19T03:01:42.629 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 27.582064999, 2024-04-19T03:01:42.629 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.018618866000000001, 2024-04-19T03:01:42.629 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:01:42.629 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-19T03:01:42.629 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:01:42.630 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.630 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:01:42.630 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999896+0000", 2024-04-19T03:01:42.630 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:42.630 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.630 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.630 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:01:42.630 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999896+0000", 2024-04-19T03:01:42.630 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:42.631 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.631 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.631 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:01:42.631 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999895+0000", 2024-04-19T03:01:42.631 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:01:42.631 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.631 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.631 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:01:42.631 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999901+0000", 2024-04-19T03:01:42.631 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4529999999999999e-06 2024-04-19T03:01:42.631 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.631 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.631 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:01:42.632 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999918+0000", 2024-04-19T03:01:42.632 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6897000000000001e-05 2024-04-19T03:01:42.632 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.632 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.632 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:01:42.632 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999931+0000", 2024-04-19T03:01:42.632 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.309e-05 2024-04-19T03:01:42.632 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.632 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.632 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:42.632 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.000027+0000", 2024-04-19T03:01:42.632 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.5880999999999999e-05 2024-04-19T03:01:42.632 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.632 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.633 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op must wait for map", 2024-04-19T03:01:42.633 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.000040+0000", 2024-04-19T03:01:42.633 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3083e-05 2024-04-19T03:01:42.633 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.633 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.633 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:42.633 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.004961+0000", 2024-04-19T03:01:42.633 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0049206079999999999 2024-04-19T03:01:42.633 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.633 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.633 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:01:42.633 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.005261+0000", 2024-04-19T03:01:42.633 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00030041699999999998 2024-04-19T03:01:42.634 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.634 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.634 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:01:42.634 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.018515+0000", 2024-04-19T03:01:42.634 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013253534000000001 2024-04-19T03:01:42.634 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:42.634 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:01:42.634 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:42.634 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.634 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.634 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:24 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:01:42.634 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:14.999964+0000", 2024-04-19T03:01:42.635 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 27.581997504, 2024-04-19T03:01:42.635 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020451446000000002, 2024-04-19T03:01:42.635 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:01:42.635 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-19T03:01:42.635 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:01:42.635 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.635 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:01:42.635 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999964+0000", 2024-04-19T03:01:42.635 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:42.635 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.635 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.635 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:01:42.635 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999964+0000", 2024-04-19T03:01:42.635 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:42.636 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.636 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.636 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:01:42.636 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999963+0000", 2024-04-19T03:01:42.636 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:01:42.636 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.636 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.636 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:01:42.636 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999969+0000", 2024-04-19T03:01:42.636 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0270000000000001e-06 2024-04-19T03:01:42.636 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.636 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.636 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:01:42.637 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999984+0000", 2024-04-19T03:01:42.637 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5903e-05 2024-04-19T03:01:42.637 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.637 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.637 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:01:42.637 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999998+0000", 2024-04-19T03:01:42.637 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3076e-05 2024-04-19T03:01:42.637 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.637 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.637 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:42.637 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.000078+0000", 2024-04-19T03:01:42.637 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0525000000000006e-05 2024-04-19T03:01:42.637 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.637 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.638 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op must wait for map", 2024-04-19T03:01:42.638 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.000084+0000", 2024-04-19T03:01:42.638 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8370000000000002e-06 2024-04-19T03:01:42.638 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.638 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.638 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:42.638 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.008819+0000", 2024-04-19T03:01:42.638 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0087349019999999993 2024-04-19T03:01:42.638 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.638 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.638 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:01:42.638 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.009018+0000", 2024-04-19T03:01:42.639 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000198989 2024-04-19T03:01:42.639 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.639 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.639 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:01:42.639 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.020415+0000", 2024-04-19T03:01:42.639 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011397157 2024-04-19T03:01:42.639 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:42.639 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:01:42.639 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:42.639 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.639 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.639 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:10 5.d 5:bcad0b2c:::benchmark_data_smithi096_19531_object9:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-19T03:01:42.639 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:37.821923+0000", 2024-04-19T03:01:42.639 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 4.760038432, 2024-04-19T03:01:42.640 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.014433605, 2024-04-19T03:01:42.640 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:01:42.640 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:42.640 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:01:42.640 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:01:42.640 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:42.640 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 10 2024-04-19T03:01:42.640 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.640 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:01:42.640 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.640 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:01:42.640 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:37.821923+0000", 2024-04-19T03:01:42.640 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:42.640 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.641 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.641 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:01:42.641 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:37.821923+0000", 2024-04-19T03:01:42.641 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:42.641 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.641 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.641 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:01:42.641 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:37.821922+0000", 2024-04-19T03:01:42.641 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:01:42.641 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.641 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.641 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:01:42.642 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:37.822058+0000", 2024-04-19T03:01:42.642 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013657799999999999 2024-04-19T03:01:42.642 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.642 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.642 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:01:42.642 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:37.822102+0000", 2024-04-19T03:01:42.642 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4255999999999998e-05 2024-04-19T03:01:42.642 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.642 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.642 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:01:42.642 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:37.822118+0000", 2024-04-19T03:01:42.642 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5685999999999999e-05 2024-04-19T03:01:42.642 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.643 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.643 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:42.643 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:37.822198+0000", 2024-04-19T03:01:42.643 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0165000000000002e-05 2024-04-19T03:01:42.643 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.643 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.643 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:01:42.643 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:37.822204+0000", 2024-04-19T03:01:42.643 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4399999999999996e-06 2024-04-19T03:01:42.643 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.643 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.643 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:42.644 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:37.827330+0000", 2024-04-19T03:01:42.644 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0051261120000000004 2024-04-19T03:01:42.644 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.644 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.644 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:01:42.644 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:37.827630+0000", 2024-04-19T03:01:42.644 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00029984400000000001 2024-04-19T03:01:42.644 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.644 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.644 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-04-19T03:01:42.644 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:37.827982+0000", 2024-04-19T03:01:42.644 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00035224300000000002 2024-04-19T03:01:42.644 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.645 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.645 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:01:42.645 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:37.832967+0000", 2024-04-19T03:01:42.645 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0049855810000000002 2024-04-19T03:01:42.645 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.645 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.645 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:42.645 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:37.836261+0000", 2024-04-19T03:01:42.645 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.003293018 2024-04-19T03:01:42.645 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.645 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.645 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:01:42.646 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:37.836296+0000", 2024-04-19T03:01:42.646 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5769999999999998e-05 2024-04-19T03:01:42.646 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.646 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.646 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:01:42.646 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:37.836356+0000", 2024-04-19T03:01:42.646 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9914999999999998e-05 2024-04-19T03:01:42.646 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:42.646 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:01:42.646 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:42.646 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.646 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.647 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:3790 5.d 5:b1320d9c:::benchmark_data_smithi096_19531_object3789:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-19T03:01:42.647 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:39.208695+0000", 2024-04-19T03:01:42.647 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 3.3732657740000001, 2024-04-19T03:01:42.647 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015283936999999999, 2024-04-19T03:01:42.647 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:01:42.647 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:42.647 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:01:42.647 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:01:42.647 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:42.647 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3790 2024-04-19T03:01:42.647 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.647 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:01:42.647 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.648 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:01:42.648 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:39.208695+0000", 2024-04-19T03:01:42.648 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:42.648 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.648 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.648 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:01:42.648 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:39.208695+0000", 2024-04-19T03:01:42.648 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:42.648 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.648 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.648 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:01:42.648 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:39.208694+0000", 2024-04-19T03:01:42.648 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:01:42.648 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.649 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.649 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:01:42.649 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:39.208738+0000", 2024-04-19T03:01:42.649 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3562000000000001e-05 2024-04-19T03:01:42.649 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.649 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.649 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:01:42.649 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:39.208749+0000", 2024-04-19T03:01:42.649 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1505000000000001e-05 2024-04-19T03:01:42.649 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.649 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.649 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:01:42.649 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:39.208759+0000", 2024-04-19T03:01:42.650 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0288999999999999e-05 2024-04-19T03:01:42.650 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.650 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.650 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:42.650 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:39.212745+0000", 2024-04-19T03:01:42.650 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0039855669999999998 2024-04-19T03:01:42.650 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.650 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.650 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:01:42.650 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:39.212900+0000", 2024-04-19T03:01:42.650 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000154568 2024-04-19T03:01:42.651 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.651 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.651 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-04-19T03:01:42.651 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:39.213027+0000", 2024-04-19T03:01:42.651 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000127565 2024-04-19T03:01:42.651 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.651 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.651 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:01:42.651 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:39.215729+0000", 2024-04-19T03:01:42.651 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0027014280000000001 2024-04-19T03:01:42.651 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.651 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.651 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:42.652 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:39.223889+0000", 2024-04-19T03:01:42.652 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0081604650000000004 2024-04-19T03:01:42.652 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.652 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.652 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:01:42.652 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:39.223940+0000", 2024-04-19T03:01:42.652 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1446999999999997e-05 2024-04-19T03:01:42.652 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.652 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.652 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:01:42.652 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:39.223979+0000", 2024-04-19T03:01:42.652 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8748000000000002e-05 2024-04-19T03:01:42.652 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:42.653 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:01:42.653 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:42.653 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.653 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.653 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:3794 5.d 5:be7b5d22:::benchmark_data_smithi096_19531_object3793:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-19T03:01:42.653 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:39.209221+0000", 2024-04-19T03:01:42.653 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 3.3727403699999998, 2024-04-19T03:01:42.653 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015746540999999999, 2024-04-19T03:01:42.653 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:01:42.653 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:42.653 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:01:42.653 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:01:42.653 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:42.653 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3794 2024-04-19T03:01:42.654 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.654 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:01:42.654 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.654 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:01:42.654 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:39.209221+0000", 2024-04-19T03:01:42.654 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:42.654 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.654 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.654 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:01:42.654 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:39.209221+0000", 2024-04-19T03:01:42.654 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:42.654 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.654 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.655 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:01:42.655 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:39.209220+0000", 2024-04-19T03:01:42.655 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:01:42.655 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.655 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.655 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:01:42.655 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:39.209352+0000", 2024-04-19T03:01:42.655 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013184399999999999 2024-04-19T03:01:42.655 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.655 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.655 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:01:42.655 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:39.209369+0000", 2024-04-19T03:01:42.655 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7651000000000001e-05 2024-04-19T03:01:42.656 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.656 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.656 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:01:42.656 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:39.209378+0000", 2024-04-19T03:01:42.656 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9870000000000005e-06 2024-04-19T03:01:42.656 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.656 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.656 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:42.656 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:39.214226+0000", 2024-04-19T03:01:42.656 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0048477579999999998 2024-04-19T03:01:42.656 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.656 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.657 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:01:42.657 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:39.214431+0000", 2024-04-19T03:01:42.657 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00020539899999999999 2024-04-19T03:01:42.657 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.657 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.657 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-04-19T03:01:42.657 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:39.214639+0000", 2024-04-19T03:01:42.657 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00020784500000000001 2024-04-19T03:01:42.657 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.657 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.657 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:01:42.657 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:39.216765+0000", 2024-04-19T03:01:42.657 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.002125198 2024-04-19T03:01:42.658 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.658 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.658 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:42.658 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:39.224861+0000", 2024-04-19T03:01:42.658 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0080968480000000002 2024-04-19T03:01:42.658 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.658 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.658 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:01:42.658 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:39.224914+0000", 2024-04-19T03:01:42.658 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2463000000000002e-05 2024-04-19T03:01:42.658 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.658 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.659 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:01:42.659 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:39.224967+0000", 2024-04-19T03:01:42.659 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3368000000000001e-05 2024-04-19T03:01:42.659 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:42.659 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:01:42.659 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:42.659 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.659 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.659 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:11274 5.e 5:7c846032:::benchmark_data_smithi096_19531_object11273:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T03:01:42.659 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:42.061776+0000", 2024-04-19T03:01:42.659 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.52018525900000001, 2024-04-19T03:01:42.659 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.035381001000000002, 2024-04-19T03:01:42.660 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:01:42.660 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:42.660 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:01:42.660 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:01:42.660 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:42.660 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 11274 2024-04-19T03:01:42.660 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.660 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:01:42.660 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.660 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:01:42.660 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.061776+0000", 2024-04-19T03:01:42.660 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:42.660 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.661 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.661 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:01:42.661 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.061776+0000", 2024-04-19T03:01:42.661 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:42.661 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.661 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.661 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:01:42.661 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.061775+0000", 2024-04-19T03:01:42.661 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:01:42.661 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.661 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.661 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:01:42.661 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.061807+0000", 2024-04-19T03:01:42.662 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1733000000000003e-05 2024-04-19T03:01:42.662 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.662 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.662 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:01:42.662 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.061822+0000", 2024-04-19T03:01:42.662 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5452999999999999e-05 2024-04-19T03:01:42.662 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.662 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.662 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:01:42.662 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.061827+0000", 2024-04-19T03:01:42.662 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9810000000000003e-06 2024-04-19T03:01:42.662 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.662 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.662 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:42.663 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.063388+0000", 2024-04-19T03:01:42.663 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0015605720000000001 2024-04-19T03:01:42.663 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.663 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.663 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:01:42.663 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.063612+0000", 2024-04-19T03:01:42.663 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00022431 2024-04-19T03:01:42.663 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.663 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.663 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:01:42.663 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.063747+0000", 2024-04-19T03:01:42.663 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013459600000000001 2024-04-19T03:01:42.663 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.664 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.664 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:01:42.664 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.066186+0000", 2024-04-19T03:01:42.664 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0024388909999999999 2024-04-19T03:01:42.664 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.664 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.664 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:42.664 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.097016+0000", 2024-04-19T03:01:42.664 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.030830705 2024-04-19T03:01:42.664 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.664 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.664 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:01:42.665 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.097096+0000", 2024-04-19T03:01:42.665 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.9469999999999996e-05 2024-04-19T03:01:42.665 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.665 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.665 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:01:42.665 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.097157+0000", 2024-04-19T03:01:42.665 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0884999999999997e-05 2024-04-19T03:01:42.665 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:42.665 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:01:42.665 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:42.665 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.665 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.665 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:11279 5.8 5:10b60c58:::benchmark_data_smithi096_19531_object11278:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T03:01:42.665 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:42.062594+0000", 2024-04-19T03:01:42.666 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.51936682099999998, 2024-04-19T03:01:42.666 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.028696788000000001, 2024-04-19T03:01:42.666 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:01:42.666 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:42.666 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:01:42.666 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:01:42.666 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:42.666 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 11279 2024-04-19T03:01:42.666 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.666 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:01:42.666 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.667 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:01:42.667 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.062594+0000", 2024-04-19T03:01:42.667 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:42.667 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.667 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.667 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:01:42.667 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.062594+0000", 2024-04-19T03:01:42.667 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:42.667 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.667 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.667 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:01:42.667 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.062593+0000", 2024-04-19T03:01:42.667 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:01:42.668 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.668 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.668 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:01:42.668 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.062646+0000", 2024-04-19T03:01:42.668 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2293999999999998e-05 2024-04-19T03:01:42.668 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.668 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.668 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:01:42.668 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.062657+0000", 2024-04-19T03:01:42.668 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1440000000000001e-05 2024-04-19T03:01:42.668 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.668 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.668 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:01:42.668 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.062665+0000", 2024-04-19T03:01:42.669 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5159999999999997e-06 2024-04-19T03:01:42.669 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.669 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.669 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:42.669 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.063799+0000", 2024-04-19T03:01:42.669 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0011344860000000001 2024-04-19T03:01:42.669 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.669 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.669 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:01:42.669 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.063962+0000", 2024-04-19T03:01:42.669 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000162614 2024-04-19T03:01:42.669 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.670 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.670 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:01:42.670 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.064167+0000", 2024-04-19T03:01:42.670 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00020491699999999999 2024-04-19T03:01:42.670 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.670 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.670 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:01:42.670 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.066768+0000", 2024-04-19T03:01:42.670 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0026012090000000002 2024-04-19T03:01:42.670 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.670 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.671 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:42.671 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.091184+0000", 2024-04-19T03:01:42.671 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.024416582999999999 2024-04-19T03:01:42.671 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.671 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.671 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:01:42.671 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.091251+0000", 2024-04-19T03:01:42.671 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6753000000000003e-05 2024-04-19T03:01:42.671 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.671 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.671 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:01:42.671 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.091291+0000", 2024-04-19T03:01:42.671 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9841e-05 2024-04-19T03:01:42.672 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:42.672 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:01:42.672 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:42.672 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.672 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.672 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:11282 5.e 5:75b7c510:::benchmark_data_smithi096_19531_object11281:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T03:01:42.672 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:42.062674+0000", 2024-04-19T03:01:42.672 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.51928736499999995, 2024-04-19T03:01:42.672 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.034812849, 2024-04-19T03:01:42.672 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:01:42.672 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:42.672 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:01:42.673 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:01:42.673 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:42.673 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 11282 2024-04-19T03:01:42.673 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.673 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:01:42.673 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.673 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:01:42.673 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.062674+0000", 2024-04-19T03:01:42.673 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:42.673 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.673 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.673 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:01:42.673 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.062674+0000", 2024-04-19T03:01:42.673 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:42.674 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.674 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.674 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:01:42.674 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.062673+0000", 2024-04-19T03:01:42.674 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:01:42.674 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.674 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.674 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:01:42.674 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.062712+0000", 2024-04-19T03:01:42.674 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9341999999999997e-05 2024-04-19T03:01:42.674 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.674 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.674 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:01:42.675 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.062721+0000", 2024-04-19T03:01:42.675 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1700000000000003e-06 2024-04-19T03:01:42.675 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.675 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.675 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:01:42.675 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.062729+0000", 2024-04-19T03:01:42.675 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4240000000000004e-06 2024-04-19T03:01:42.675 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.675 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.675 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:42.675 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.065017+0000", 2024-04-19T03:01:42.675 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0022878590000000002 2024-04-19T03:01:42.675 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.675 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.676 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:01:42.676 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.065207+0000", 2024-04-19T03:01:42.676 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000190411 2024-04-19T03:01:42.676 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.676 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.676 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:01:42.676 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.065323+0000", 2024-04-19T03:01:42.676 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000115593 2024-04-19T03:01:42.676 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.676 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.676 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:01:42.676 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.069683+0000", 2024-04-19T03:01:42.676 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0043604409999999996 2024-04-19T03:01:42.676 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.677 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.677 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:42.677 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.097273+0000", 2024-04-19T03:01:42.677 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.027589516000000001 2024-04-19T03:01:42.677 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.677 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.677 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:01:42.677 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.097406+0000", 2024-04-19T03:01:42.677 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000133514 2024-04-19T03:01:42.677 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.677 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.677 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:01:42.677 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.097486+0000", 2024-04-19T03:01:42.678 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0479e-05 2024-04-19T03:01:42.678 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:42.678 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:01:42.678 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:42.678 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.678 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.678 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:11288 5.0 5:042458d0:::benchmark_data_smithi096_19531_object11287:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T03:01:42.678 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:42.070352+0000", 2024-04-19T03:01:42.678 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.51160943699999994, 2024-04-19T03:01:42.678 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.021532447, 2024-04-19T03:01:42.678 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:01:42.679 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:42.679 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:01:42.679 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:01:42.679 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:42.679 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 11288 2024-04-19T03:01:42.679 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.679 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:01:42.679 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.679 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:01:42.679 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.070352+0000", 2024-04-19T03:01:42.679 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:42.679 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.679 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.679 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:01:42.680 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.070352+0000", 2024-04-19T03:01:42.680 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:42.680 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.680 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.680 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:01:42.680 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.070351+0000", 2024-04-19T03:01:42.680 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:01:42.680 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.680 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.680 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:01:42.680 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.070392+0000", 2024-04-19T03:01:42.680 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1077e-05 2024-04-19T03:01:42.680 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.681 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.681 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:01:42.681 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.070398+0000", 2024-04-19T03:01:42.681 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1109999999999996e-06 2024-04-19T03:01:42.681 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.681 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.681 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:01:42.681 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.070402+0000", 2024-04-19T03:01:42.681 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2010000000000001e-06 2024-04-19T03:01:42.681 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.681 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.681 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:42.681 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.070445+0000", 2024-04-19T03:01:42.682 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2585e-05 2024-04-19T03:01:42.682 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.682 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.682 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:01:42.682 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.070572+0000", 2024-04-19T03:01:42.682 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012708500000000001 2024-04-19T03:01:42.682 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.682 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.682 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:01:42.682 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.070711+0000", 2024-04-19T03:01:42.682 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013848699999999999 2024-04-19T03:01:42.682 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.683 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.683 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:01:42.683 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.073505+0000", 2024-04-19T03:01:42.683 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0027944620000000002 2024-04-19T03:01:42.683 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.683 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.683 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:42.683 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.091806+0000", 2024-04-19T03:01:42.683 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.018301251000000001 2024-04-19T03:01:42.683 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.683 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.683 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:01:42.683 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.091854+0000", 2024-04-19T03:01:42.684 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7419000000000001e-05 2024-04-19T03:01:42.684 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.684 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.684 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:01:42.684 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.091884+0000", 2024-04-19T03:01:42.684 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0241999999999999e-05 2024-04-19T03:01:42.684 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:42.684 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:01:42.684 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:42.684 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.684 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.684 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:11292 5.0 5:009b2ea9:::benchmark_data_smithi096_19531_object11291:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T03:01:42.684 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:42.070676+0000", 2024-04-19T03:01:42.684 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.51128506200000001, 2024-04-19T03:01:42.685 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.02219631, 2024-04-19T03:01:42.685 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:01:42.685 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:42.685 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:01:42.685 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:01:42.685 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:42.685 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 11292 2024-04-19T03:01:42.685 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.685 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:01:42.685 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.685 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:01:42.685 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.070676+0000", 2024-04-19T03:01:42.686 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:42.686 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.686 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.686 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:01:42.686 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.070676+0000", 2024-04-19T03:01:42.686 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:42.686 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.686 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.686 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:01:42.686 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.070675+0000", 2024-04-19T03:01:42.686 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:01:42.686 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.687 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.687 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:01:42.687 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.070800+0000", 2024-04-19T03:01:42.687 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000125263 2024-04-19T03:01:42.687 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.687 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.687 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:01:42.687 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.070808+0000", 2024-04-19T03:01:42.687 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0209999999999999e-06 2024-04-19T03:01:42.687 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.687 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.687 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:01:42.687 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.070814+0000", 2024-04-19T03:01:42.688 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0969999999999996e-06 2024-04-19T03:01:42.688 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.688 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.688 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:42.688 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.071956+0000", 2024-04-19T03:01:42.688 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0011427480000000001 2024-04-19T03:01:42.688 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.688 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.688 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:01:42.688 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.072153+0000", 2024-04-19T03:01:42.688 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000196524 2024-04-19T03:01:42.688 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.689 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.689 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:01:42.689 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.072312+0000", 2024-04-19T03:01:42.689 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015879300000000001 2024-04-19T03:01:42.689 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.689 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.689 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:01:42.689 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.078407+0000", 2024-04-19T03:01:42.689 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0060954929999999996 2024-04-19T03:01:42.689 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.689 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.689 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:42.690 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.092742+0000", 2024-04-19T03:01:42.690 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.014335349000000001 2024-04-19T03:01:42.690 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.690 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.690 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:01:42.690 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.092815+0000", 2024-04-19T03:01:42.690 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2881999999999998e-05 2024-04-19T03:01:42.690 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.690 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.690 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:01:42.690 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.092872+0000", 2024-04-19T03:01:42.690 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6965000000000001e-05 2024-04-19T03:01:42.691 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:42.691 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:01:42.691 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:42.691 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.691 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.691 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:11297 5.e 5:7975ecb6:::benchmark_data_smithi096_19531_object11296:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T03:01:42.691 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:42.076848+0000", 2024-04-19T03:01:42.691 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.50511318199999999, 2024-04-19T03:01:42.691 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020867969, 2024-04-19T03:01:42.691 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:01:42.691 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:42.692 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:01:42.692 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:01:42.692 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:42.692 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 11297 2024-04-19T03:01:42.692 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.692 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:01:42.692 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.692 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:01:42.692 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.076848+0000", 2024-04-19T03:01:42.692 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:42.692 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.692 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.692 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:01:42.693 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.076848+0000", 2024-04-19T03:01:42.693 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:42.693 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.693 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.693 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:01:42.693 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.076846+0000", 2024-04-19T03:01:42.693 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:01:42.693 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.693 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.693 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:01:42.693 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.076894+0000", 2024-04-19T03:01:42.693 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7645000000000002e-05 2024-04-19T03:01:42.693 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.693 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.694 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:01:42.694 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.076913+0000", 2024-04-19T03:01:42.694 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8885e-05 2024-04-19T03:01:42.694 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.694 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.694 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:01:42.694 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.076924+0000", 2024-04-19T03:01:42.694 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.118e-05 2024-04-19T03:01:42.694 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.694 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.694 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:42.694 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.076983+0000", 2024-04-19T03:01:42.695 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8952000000000001e-05 2024-04-19T03:01:42.695 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.695 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.695 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:01:42.695 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.077156+0000", 2024-04-19T03:01:42.695 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00017307600000000001 2024-04-19T03:01:42.695 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.695 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.695 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:01:42.695 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.077358+0000", 2024-04-19T03:01:42.695 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000201991 2024-04-19T03:01:42.695 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.695 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.695 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:01:42.696 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.080885+0000", 2024-04-19T03:01:42.696 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0035268309999999998 2024-04-19T03:01:42.696 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.696 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.696 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:42.696 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.097569+0000", 2024-04-19T03:01:42.696 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.016683854000000001 2024-04-19T03:01:42.696 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.696 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.696 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:01:42.696 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.097647+0000", 2024-04-19T03:01:42.696 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.7823000000000004e-05 2024-04-19T03:01:42.696 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.696 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.697 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:01:42.697 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.097716+0000", 2024-04-19T03:01:42.697 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.9079999999999996e-05 2024-04-19T03:01:42.697 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:42.697 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:01:42.697 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:42.697 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.697 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.697 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:11298 5.e 5:72565f0a:::benchmark_data_smithi096_19531_object11297:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T03:01:42.697 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:42.076954+0000", 2024-04-19T03:01:42.697 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.50500730800000004, 2024-04-19T03:01:42.697 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020950191999999999, 2024-04-19T03:01:42.697 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:01:42.698 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:42.698 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:01:42.698 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:01:42.698 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:42.698 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 11298 2024-04-19T03:01:42.698 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.698 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:01:42.698 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.698 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:01:42.698 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.076954+0000", 2024-04-19T03:01:42.698 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:42.698 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.698 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.699 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:01:42.699 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.076954+0000", 2024-04-19T03:01:42.699 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:42.699 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.699 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.699 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:01:42.699 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.076953+0000", 2024-04-19T03:01:42.699 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:01:42.699 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.699 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.699 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:01:42.699 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.076997+0000", 2024-04-19T03:01:42.699 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4023000000000002e-05 2024-04-19T03:01:42.699 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.700 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.700 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:01:42.700 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.077009+0000", 2024-04-19T03:01:42.700 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2456000000000001e-05 2024-04-19T03:01:42.700 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.700 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.700 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:01:42.700 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.077015+0000", 2024-04-19T03:01:42.700 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7950000000000004e-06 2024-04-19T03:01:42.700 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.700 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.700 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:42.700 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.078552+0000", 2024-04-19T03:01:42.701 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0015371320000000001 2024-04-19T03:01:42.701 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.701 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.701 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:01:42.701 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.078760+0000", 2024-04-19T03:01:42.701 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00020808799999999999 2024-04-19T03:01:42.701 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.701 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.701 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:01:42.701 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.078875+0000", 2024-04-19T03:01:42.701 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011457500000000001 2024-04-19T03:01:42.701 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.701 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.701 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:01:42.702 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.083603+0000", 2024-04-19T03:01:42.702 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0047276239999999997 2024-04-19T03:01:42.702 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.702 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.702 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:42.702 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.097783+0000", 2024-04-19T03:01:42.702 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.014180036 2024-04-19T03:01:42.702 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.702 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.702 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:01:42.702 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.097863+0000", 2024-04-19T03:01:42.702 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0317999999999999e-05 2024-04-19T03:01:42.703 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.703 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.703 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:01:42.703 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.097904+0000", 2024-04-19T03:01:42.703 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1035000000000003e-05 2024-04-19T03:01:42.703 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:42.703 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:01:42.703 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:42.703 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.703 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.703 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:11299 5.4 5:2fce09a4:::benchmark_data_smithi096_19531_object11298:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T03:01:42.703 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:42.078808+0000", 2024-04-19T03:01:42.703 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.50315291100000004, 2024-04-19T03:01:42.703 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.014060319, 2024-04-19T03:01:42.704 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:01:42.704 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:42.704 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:01:42.704 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:01:42.704 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:42.704 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 11299 2024-04-19T03:01:42.704 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.704 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:01:42.704 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.704 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:01:42.704 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.078808+0000", 2024-04-19T03:01:42.704 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:42.704 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.705 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.705 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:01:42.705 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.078808+0000", 2024-04-19T03:01:42.705 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:42.705 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.705 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.705 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:01:42.705 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.078807+0000", 2024-04-19T03:01:42.705 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:01:42.705 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.705 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.705 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:01:42.705 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.078867+0000", 2024-04-19T03:01:42.705 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9802000000000001e-05 2024-04-19T03:01:42.706 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.706 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.706 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:01:42.706 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.078888+0000", 2024-04-19T03:01:42.706 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0818999999999998e-05 2024-04-19T03:01:42.706 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.706 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.706 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:01:42.706 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.078896+0000", 2024-04-19T03:01:42.706 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.7010000000000002e-06 2024-04-19T03:01:42.706 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.706 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.707 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:42.707 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.078946+0000", 2024-04-19T03:01:42.707 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9866e-05 2024-04-19T03:01:42.707 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.707 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.707 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:01:42.707 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.079028+0000", 2024-04-19T03:01:42.707 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1705000000000005e-05 2024-04-19T03:01:42.707 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.707 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.707 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:01:42.707 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.079106+0000", 2024-04-19T03:01:42.707 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.8338999999999997e-05 2024-04-19T03:01:42.707 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.708 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.708 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:01:42.708 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.083673+0000", 2024-04-19T03:01:42.708 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0045672059999999999 2024-04-19T03:01:42.708 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.708 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.708 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:42.708 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.092721+0000", 2024-04-19T03:01:42.708 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0090472260000000002 2024-04-19T03:01:42.708 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.708 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.708 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:01:42.708 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.092806+0000", 2024-04-19T03:01:42.709 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.5575000000000007e-05 2024-04-19T03:01:42.709 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:42.709 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:42.709 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:01:42.709 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.092868+0000", 2024-04-19T03:01:42.709 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2236000000000005e-05 2024-04-19T03:01:42.709 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:42.709 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:01:42.709 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:42.709 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:42.709 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:01:42.709 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-19T03:01:42.711 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-04-19T03:01:42.705+0000 7f35986ab700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18243) UID: 0 2024-04-19T03:01:42.711 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T03:01:42.812 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-04-19T03:01:42.809+0000 7f35986ab700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18243) UID: 0 2024-04-19T03:01:42.819 INFO:tasks.radosbench.radosbench.0.smithi096.stdout: 5 16 13164 13148 164.333 154.438 0.00722535 0.00607671 2024-04-19T03:01:42.844 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-04-19T03:01:42.844 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [ 2024-04-19T03:01:42.844 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:42.844 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:13205 5.f 5:f1fadc71:::benchmark_data_smithi096_19531_object13204:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T03:01:42.844 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:01:42.835646+0000", 2024-04-19T03:01:42.844 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0060206720000000003, 2024-04-19T03:01:42.844 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0060508369999999999, 2024-04-19T03:01:42.844 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:01:42.844 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:01:42.844 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:01:42.845 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:01:42.845 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:42.845 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 13205 2024-04-19T03:01:42.845 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:42.845 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:01:42.845 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:42.845 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:01:42.845 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:42.835646+0000", 2024-04-19T03:01:42.845 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:42.845 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:42.845 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:42.845 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:01:42.846 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:42.835646+0000", 2024-04-19T03:01:42.846 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:42.846 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:42.846 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:42.846 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:01:42.846 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:42.835645+0000", 2024-04-19T03:01:42.846 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:01:42.846 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:42.846 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:42.846 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:01:42.846 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:42.835748+0000", 2024-04-19T03:01:42.846 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000103335 2024-04-19T03:01:42.846 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:42.847 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:42.847 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:01:42.847 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:42.835772+0000", 2024-04-19T03:01:42.847 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.446e-05 2024-04-19T03:01:42.847 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:42.847 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:42.847 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:01:42.847 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:42.835778+0000", 2024-04-19T03:01:42.847 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9519999999999999e-06 2024-04-19T03:01:42.847 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:42.847 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:42.847 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:01:42.847 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:42.835837+0000", 2024-04-19T03:01:42.847 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9061999999999998e-05 2024-04-19T03:01:42.847 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:42.848 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:42.848 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:01:42.848 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:42.835985+0000", 2024-04-19T03:01:42.848 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00014732100000000001 2024-04-19T03:01:42.848 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:42.848 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:42.848 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:01:42.848 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:42.836133+0000", 2024-04-19T03:01:42.848 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00014817500000000001 2024-04-19T03:01:42.848 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:42.848 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:42.848 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:01:42.848 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:42.838443+0000", 2024-04-19T03:01:42.849 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0023104029999999999 2024-04-19T03:01:42.849 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:42.849 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:01:42.849 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:42.849 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:42.849 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:42.849 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:13206 5.f 5:f2ac923e:::benchmark_data_smithi096_19531_object13205:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T03:01:42.849 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:01:42.835802+0000", 2024-04-19T03:01:42.849 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0058647919999999997, 2024-04-19T03:01:42.849 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0060017250000000003, 2024-04-19T03:01:42.849 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:01:42.849 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:01:42.849 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:01:42.850 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:01:42.850 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:42.850 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 13206 2024-04-19T03:01:42.850 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:42.850 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:01:42.850 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:42.850 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:01:42.850 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:42.835802+0000", 2024-04-19T03:01:42.850 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:42.850 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:42.850 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:42.850 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:01:42.851 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:42.835802+0000", 2024-04-19T03:01:42.851 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:42.851 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:42.851 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:42.851 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:01:42.851 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:42.835801+0000", 2024-04-19T03:01:42.851 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:01:42.851 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:42.851 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:42.851 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:01:42.851 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:42.835858+0000", 2024-04-19T03:01:42.851 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6875e-05 2024-04-19T03:01:42.851 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:42.852 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:42.852 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:01:42.852 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:42.835868+0000", 2024-04-19T03:01:42.852 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.944e-06 2024-04-19T03:01:42.852 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:42.852 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:42.852 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:01:42.852 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:42.835887+0000", 2024-04-19T03:01:42.852 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8573999999999999e-05 2024-04-19T03:01:42.852 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:42.852 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:42.852 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:01:42.852 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:42.837209+0000", 2024-04-19T03:01:42.852 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0013225839999999999 2024-04-19T03:01:42.853 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:42.853 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:42.853 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:01:42.853 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:42.837338+0000", 2024-04-19T03:01:42.853 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000128832 2024-04-19T03:01:42.853 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:42.853 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:42.853 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:01:42.853 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:42.837500+0000", 2024-04-19T03:01:42.853 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00016186400000000001 2024-04-19T03:01:42.853 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:42.853 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:42.853 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:01:42.854 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:42.839188+0000", 2024-04-19T03:01:42.854 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001688576 2024-04-19T03:01:42.854 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:42.854 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:01:42.854 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:42.854 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:42.854 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:42.854 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:13219 5.1 5:873e9aea:::benchmark_data_smithi096_19531_object13218:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T03:01:42.854 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:01:42.839218+0000", 2024-04-19T03:01:42.854 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.002448544, 2024-04-19T03:01:42.854 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0026785580000000002, 2024-04-19T03:01:42.854 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:01:42.854 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:01:42.855 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:01:42.855 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:01:42.855 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:42.855 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 13219 2024-04-19T03:01:42.855 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:42.855 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:01:42.855 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:42.855 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:01:42.855 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:42.839218+0000", 2024-04-19T03:01:42.855 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:42.855 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:42.855 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:42.855 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:01:42.856 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:42.839218+0000", 2024-04-19T03:01:42.856 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:42.856 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:42.856 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:42.856 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:01:42.856 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:42.839217+0000", 2024-04-19T03:01:42.856 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:01:42.856 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:42.856 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:42.856 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:01:42.856 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:42.839264+0000", 2024-04-19T03:01:42.856 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7617000000000002e-05 2024-04-19T03:01:42.856 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:42.857 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:42.857 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:01:42.857 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:42.839277+0000", 2024-04-19T03:01:42.857 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2853e-05 2024-04-19T03:01:42.857 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:42.857 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:42.857 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:01:42.857 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:42.839283+0000", 2024-04-19T03:01:42.857 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6790000000000002e-06 2024-04-19T03:01:42.857 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:42.857 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:42.857 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:01:42.857 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:42.839338+0000", 2024-04-19T03:01:42.857 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5554999999999999e-05 2024-04-19T03:01:42.857 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:42.858 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:42.858 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:01:42.858 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:42.839445+0000", 2024-04-19T03:01:42.858 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000106241 2024-04-19T03:01:42.858 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:42.858 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:42.858 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-04-19T03:01:42.858 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:42.839538+0000", 2024-04-19T03:01:42.858 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.3068999999999999e-05 2024-04-19T03:01:42.858 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:42.858 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:42.858 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:01:42.859 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:42.841393+0000", 2024-04-19T03:01:42.859 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0018553669999999999 2024-04-19T03:01:42.859 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:42.859 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:01:42.859 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:42.859 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:42.859 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:42.859 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4755.0:13210 5.d e26/22 5:b1b13ae4:::benchmark_data_smithi096_19531_object13209:head v 26'818, mlcod=26'815)", 2024-04-19T03:01:42.859 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:01:42.839621+0000", 2024-04-19T03:01:42.859 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0020450149999999999, 2024-04-19T03:01:42.859 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0023604450000000001, 2024-04-19T03:01:42.859 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:01:42.859 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-04-19T03:01:42.860 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:01:42.860 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:42.860 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:01:42.860 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:42.839621+0000", 2024-04-19T03:01:42.860 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:42.860 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:42.860 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:42.860 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:01:42.860 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:42.839621+0000", 2024-04-19T03:01:42.860 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:42.860 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:42.860 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:42.860 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:01:42.861 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:42.839621+0000", 2024-04-19T03:01:42.861 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:01:42.861 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:42.861 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:42.861 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:01:42.861 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:42.839667+0000", 2024-04-19T03:01:42.861 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6146999999999997e-05 2024-04-19T03:01:42.861 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:42.861 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:42.861 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:01:42.861 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:42.839676+0000", 2024-04-19T03:01:42.861 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.4919999999999999e-06 2024-04-19T03:01:42.861 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:42.861 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:42.862 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:01:42.862 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:42.839682+0000", 2024-04-19T03:01:42.862 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2569999999999998e-06 2024-04-19T03:01:42.862 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:42.862 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:42.862 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:01:42.862 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:42.839720+0000", 2024-04-19T03:01:42.862 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.879e-05 2024-04-19T03:01:42.862 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:42.862 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:42.862 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:01:42.862 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:42.839758+0000", 2024-04-19T03:01:42.862 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7778999999999999e-05 2024-04-19T03:01:42.863 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:42.863 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:01:42.863 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:42.863 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:42.863 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:42.863 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4755.0:13218 5.3 e26/22 5:cf58aa12:::benchmark_data_smithi096_19531_object13217:head v 26'745, mlcod=26'743)", 2024-04-19T03:01:42.863 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:01:42.840143+0000", 2024-04-19T03:01:42.863 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0015238669999999999, 2024-04-19T03:01:42.863 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0019153779999999999, 2024-04-19T03:01:42.863 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:01:42.863 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-04-19T03:01:42.863 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:01:42.864 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:42.864 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:01:42.864 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:42.840143+0000", 2024-04-19T03:01:42.864 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:42.864 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:42.864 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:42.864 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:01:42.864 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:42.840143+0000", 2024-04-19T03:01:42.864 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:42.864 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:42.864 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:42.864 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:01:42.864 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:42.840142+0000", 2024-04-19T03:01:42.865 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:01:42.865 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:42.865 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:42.865 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:01:42.865 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:42.840210+0000", 2024-04-19T03:01:42.865 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7974999999999999e-05 2024-04-19T03:01:42.865 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:42.865 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:42.865 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:01:42.865 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:42.840245+0000", 2024-04-19T03:01:42.865 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4780999999999998e-05 2024-04-19T03:01:42.865 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:42.865 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:42.866 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:01:42.866 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:42.840251+0000", 2024-04-19T03:01:42.866 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3430000000000001e-06 2024-04-19T03:01:42.866 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:42.866 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:42.866 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:01:42.866 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:42.840305+0000", 2024-04-19T03:01:42.866 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4008000000000002e-05 2024-04-19T03:01:42.866 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:42.866 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:42.866 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:01:42.866 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:42.840334+0000", 2024-04-19T03:01:42.866 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.8714e-05 2024-04-19T03:01:42.867 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:42.867 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:01:42.867 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:42.867 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:42.867 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:42.867 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4755.0:13216 5.d e26/22 5:bc1068e2:::benchmark_data_smithi096_19531_object13215:head v 26'819, mlcod=26'815)", 2024-04-19T03:01:42.867 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:01:42.841046+0000", 2024-04-19T03:01:42.867 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.00062047199999999995, 2024-04-19T03:01:42.867 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0010778649999999999, 2024-04-19T03:01:42.867 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:01:42.867 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-04-19T03:01:42.867 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:01:42.867 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:42.868 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:01:42.868 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:42.841046+0000", 2024-04-19T03:01:42.868 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:42.868 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:42.868 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:42.868 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:01:42.868 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:42.841046+0000", 2024-04-19T03:01:42.868 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:42.868 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:42.868 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:42.868 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:01:42.868 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:42.841045+0000", 2024-04-19T03:01:42.869 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:01:42.869 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:42.869 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:42.869 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:01:42.869 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:42.841109+0000", 2024-04-19T03:01:42.869 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3388999999999999e-05 2024-04-19T03:01:42.869 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:42.869 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:42.869 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:01:42.869 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:42.841122+0000", 2024-04-19T03:01:42.869 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2938999999999999e-05 2024-04-19T03:01:42.869 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:42.869 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:42.869 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:01:42.870 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:42.841129+0000", 2024-04-19T03:01:42.870 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.1729999999999998e-06 2024-04-19T03:01:42.870 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:42.870 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:42.870 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:01:42.870 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:42.841174+0000", 2024-04-19T03:01:42.870 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4996000000000001e-05 2024-04-19T03:01:42.870 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:42.870 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:42.870 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:01:42.870 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:42.841187+0000", 2024-04-19T03:01:42.870 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2762000000000001e-05 2024-04-19T03:01:42.870 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:42.870 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:01:42.870 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:42.871 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:42.871 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:42.871 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:13220 5.f 5:f11de2eb:::benchmark_data_smithi096_19531_object13219:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T03:01:42.871 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:01:42.841275+0000", 2024-04-19T03:01:42.871 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.00039103400000000001, 2024-04-19T03:01:42.871 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00092056199999999999, 2024-04-19T03:01:42.871 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:01:42.871 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:01:42.871 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:01:42.871 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:01:42.871 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:42.871 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 13220 2024-04-19T03:01:42.871 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:42.871 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:01:42.871 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:42.872 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:01:42.872 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:42.841275+0000", 2024-04-19T03:01:42.872 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:42.872 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:42.872 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:42.872 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:01:42.872 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:42.841275+0000", 2024-04-19T03:01:42.872 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:42.872 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:42.872 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:42.872 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:01:42.872 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:42.841274+0000", 2024-04-19T03:01:42.872 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:01:42.872 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:42.872 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:42.873 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:01:42.873 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:42.841337+0000", 2024-04-19T03:01:42.873 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2226999999999999e-05 2024-04-19T03:01:42.873 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:42.873 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:42.873 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:01:42.873 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:42.841348+0000", 2024-04-19T03:01:42.873 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1240000000000001e-05 2024-04-19T03:01:42.873 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:42.873 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:42.873 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:01:42.873 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:42.841356+0000", 2024-04-19T03:01:42.873 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8180000000000004e-06 2024-04-19T03:01:42.873 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:42.873 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:42.874 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:01:42.874 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:42.841400+0000", 2024-04-19T03:01:42.874 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4650000000000001e-05 2024-04-19T03:01:42.874 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:42.874 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:42.874 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:01:42.874 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:42.841508+0000", 2024-04-19T03:01:42.874 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000107577 2024-04-19T03:01:42.874 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:42.874 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:42.874 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:01:42.874 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:42.841629+0000", 2024-04-19T03:01:42.874 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000120717 2024-04-19T03:01:42.874 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:42.875 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:01:42.875 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:42.875 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:42.875 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:42.875 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:13221 5.9 5:92c3b5ac:::benchmark_data_smithi096_19531_object13220:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T03:01:42.875 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:01:42.841372+0000", 2024-04-19T03:01:42.875 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.00029468000000000002, 2024-04-19T03:01:42.875 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00088013900000000005, 2024-04-19T03:01:42.875 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:01:42.875 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:01:42.875 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:01:42.875 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:01:42.875 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:42.875 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 13221 2024-04-19T03:01:42.876 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:42.876 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:01:42.876 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:42.876 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:01:42.876 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:42.841372+0000", 2024-04-19T03:01:42.876 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:42.876 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:42.876 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:42.876 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:01:42.876 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:42.841372+0000", 2024-04-19T03:01:42.876 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:42.876 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:42.876 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:42.876 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:01:42.877 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:42.841371+0000", 2024-04-19T03:01:42.877 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:01:42.877 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:42.877 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:42.877 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:01:42.877 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:42.841411+0000", 2024-04-19T03:01:42.877 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0170999999999999e-05 2024-04-19T03:01:42.877 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:42.877 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:42.877 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:01:42.877 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:42.841420+0000", 2024-04-19T03:01:42.877 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6370000000000005e-06 2024-04-19T03:01:42.877 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:42.877 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:42.877 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:01:42.877 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:42.841428+0000", 2024-04-19T03:01:42.878 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4109999999999996e-06 2024-04-19T03:01:42.878 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:42.878 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:42.878 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:01:42.878 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:42.841475+0000", 2024-04-19T03:01:42.878 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6220999999999997e-05 2024-04-19T03:01:42.878 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:42.878 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:42.878 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:01:42.878 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:42.841606+0000", 2024-04-19T03:01:42.878 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000131292 2024-04-19T03:01:42.878 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:42.878 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:42.879 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:01:42.879 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:42.841700+0000", 2024-04-19T03:01:42.879 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.3842e-05 2024-04-19T03:01:42.879 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:42.879 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:01:42.879 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:42.879 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:42.879 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-04-19T03:01:42.879 INFO:teuthology.orchestra.run.smithi144.stdout: "num_ops": 8 2024-04-19T03:01:42.879 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-04-19T03:01:42.880 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T03:01:42.913 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-04-19T03:01:42.909+0000 7f35986ab700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18243) UID: 0 2024-04-19T03:01:43.004 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-04-19T03:01:43.004 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2024-04-19T03:01:43.004 INFO:teuthology.orchestra.run.smithi144.stdout: "complaint_time": 30, 2024-04-19T03:01:43.005 INFO:teuthology.orchestra.run.smithi144.stdout: "num_blocked_ops": 0 2024-04-19T03:01:43.005 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-04-19T03:01:43.015 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:01:43.013+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:01:43.018 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T03:01:43.116 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-04-19T03:01:43.109+0000 7f35986ab700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18243) UID: 0 2024-04-19T03:01:43.141 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-04-19T03:01:43.142 INFO:teuthology.orchestra.run.smithi144.stdout: "size": 20, 2024-04-19T03:01:43.142 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 600, 2024-04-19T03:01:43.142 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [ 2024-04-19T03:01:43.142 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.142 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4159.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-19T03:01:43.142 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:01:07.935397+0000", 2024-04-19T03:01:43.142 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 35.202912300999998, 2024-04-19T03:01:43.143 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.020241816999999999, 2024-04-19T03:01:43.143 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:01:43.143 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:43.143 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:01:43.143 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4159", 2024-04-19T03:01:43.143 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3589238956", 2024-04-19T03:01:43.143 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 116 2024-04-19T03:01:43.143 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.143 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:01:43.143 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.143 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:01:43.144 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:07.935397+0000", 2024-04-19T03:01:43.144 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:43.144 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.144 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.144 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:01:43.144 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:07.935397+0000", 2024-04-19T03:01:43.144 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:43.144 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.144 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.145 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:01:43.145 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:07.935396+0000", 2024-04-19T03:01:43.145 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999986 2024-04-19T03:01:43.145 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.145 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.145 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:01:43.145 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:07.935407+0000", 2024-04-19T03:01:43.145 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0842999999999999e-05 2024-04-19T03:01:43.145 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.145 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.146 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:01:43.146 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:07.935424+0000", 2024-04-19T03:01:43.146 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7193e-05 2024-04-19T03:01:43.146 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.146 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.146 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:01:43.146 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:07.935440+0000", 2024-04-19T03:01:43.146 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.626e-05 2024-04-19T03:01:43.146 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.147 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.147 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:01:43.147 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:07.950487+0000", 2024-04-19T03:01:43.147 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.015046992 2024-04-19T03:01:43.147 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.147 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.147 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:01:43.147 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:07.950602+0000", 2024-04-19T03:01:43.147 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000115048 2024-04-19T03:01:43.147 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.148 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.148 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:01:43.148 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:07.950693+0000", 2024-04-19T03:01:43.148 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.1364000000000001e-05 2024-04-19T03:01:43.148 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.148 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.148 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:01:43.148 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:07.951956+0000", 2024-04-19T03:01:43.148 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001262832 2024-04-19T03:01:43.148 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.149 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.149 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:43.149 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:07.955473+0000", 2024-04-19T03:01:43.149 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0035168209999999998 2024-04-19T03:01:43.149 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.149 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.149 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:01:43.149 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:07.955570+0000", 2024-04-19T03:01:43.149 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.7175000000000004e-05 2024-04-19T03:01:43.149 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.150 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.150 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:01:43.150 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:07.955639+0000", 2024-04-19T03:01:43.150 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8699000000000001e-05 2024-04-19T03:01:43.150 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:43.150 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:01:43.150 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:43.150 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.150 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.150 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4159.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-19T03:01:43.151 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:01:07.935454+0000", 2024-04-19T03:01:43.151 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 35.202855618999997, 2024-04-19T03:01:43.151 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.020337788999999998, 2024-04-19T03:01:43.151 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:01:43.151 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:43.151 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:01:43.151 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4159", 2024-04-19T03:01:43.151 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3589238956", 2024-04-19T03:01:43.151 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 117 2024-04-19T03:01:43.151 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.151 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:01:43.151 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.152 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:01:43.152 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:07.935454+0000", 2024-04-19T03:01:43.152 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:43.152 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.152 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.152 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:01:43.152 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:07.935454+0000", 2024-04-19T03:01:43.152 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:43.152 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.152 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.152 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:01:43.153 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:07.935453+0000", 2024-04-19T03:01:43.153 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:01:43.153 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.153 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.153 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:01:43.153 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:07.935464+0000", 2024-04-19T03:01:43.153 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1409999999999999e-05 2024-04-19T03:01:43.153 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.153 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.153 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:01:43.153 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:07.935485+0000", 2024-04-19T03:01:43.154 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0380000000000001e-05 2024-04-19T03:01:43.154 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.154 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.154 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:01:43.154 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:07.935501+0000", 2024-04-19T03:01:43.154 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6419999999999999e-05 2024-04-19T03:01:43.154 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.154 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.154 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:01:43.154 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:07.951288+0000", 2024-04-19T03:01:43.154 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.015786969000000001 2024-04-19T03:01:43.155 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.155 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.155 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:01:43.155 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:07.951404+0000", 2024-04-19T03:01:43.155 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000115977 2024-04-19T03:01:43.155 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.155 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.155 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:01:43.155 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:07.951629+0000", 2024-04-19T03:01:43.155 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000224634 2024-04-19T03:01:43.155 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.155 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.156 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:01:43.156 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:07.952689+0000", 2024-04-19T03:01:43.156 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001060374 2024-04-19T03:01:43.156 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.156 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.156 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:43.158 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:07.955706+0000", 2024-04-19T03:01:43.159 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0030169149999999998 2024-04-19T03:01:43.159 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.159 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.159 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:01:43.159 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:07.955741+0000", 2024-04-19T03:01:43.159 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5160999999999998e-05 2024-04-19T03:01:43.159 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.159 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.159 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:01:43.159 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:07.955792+0000", 2024-04-19T03:01:43.159 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0609000000000003e-05 2024-04-19T03:01:43.160 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:43.160 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:01:43.160 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:43.160 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.160 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.160 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4159.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-19T03:01:43.160 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:01:08.150835+0000", 2024-04-19T03:01:43.160 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 34.987474052000003, 2024-04-19T03:01:43.160 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.020342419, 2024-04-19T03:01:43.160 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:01:43.160 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:43.160 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:01:43.161 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4159", 2024-04-19T03:01:43.161 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3589238956", 2024-04-19T03:01:43.161 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 139 2024-04-19T03:01:43.161 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.161 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:01:43.161 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.161 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:01:43.161 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.150835+0000", 2024-04-19T03:01:43.161 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:43.162 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.162 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.162 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:01:43.162 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.150835+0000", 2024-04-19T03:01:43.162 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:43.162 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.162 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.162 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:01:43.162 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.150834+0000", 2024-04-19T03:01:43.162 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:01:43.162 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.163 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.163 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:01:43.163 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.150844+0000", 2024-04-19T03:01:43.163 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.927e-06 2024-04-19T03:01:43.163 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.163 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.163 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:01:43.163 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.150866+0000", 2024-04-19T03:01:43.163 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.211e-05 2024-04-19T03:01:43.163 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.163 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.164 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:01:43.164 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.150899+0000", 2024-04-19T03:01:43.164 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2452e-05 2024-04-19T03:01:43.164 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.164 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.164 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:01:43.164 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.167067+0000", 2024-04-19T03:01:43.164 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.016167737000000001 2024-04-19T03:01:43.164 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.164 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.164 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:01:43.164 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.167210+0000", 2024-04-19T03:01:43.165 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00014319300000000001 2024-04-19T03:01:43.165 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.165 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.165 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:01:43.165 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.167389+0000", 2024-04-19T03:01:43.165 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000179075 2024-04-19T03:01:43.165 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.165 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.165 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:01:43.165 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.170083+0000", 2024-04-19T03:01:43.166 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.002694307 2024-04-19T03:01:43.166 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.167 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.167 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:43.167 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.171088+0000", 2024-04-19T03:01:43.167 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001004429 2024-04-19T03:01:43.167 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.167 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.167 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:01:43.168 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.171147+0000", 2024-04-19T03:01:43.168 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9197999999999998e-05 2024-04-19T03:01:43.168 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.168 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.168 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:01:43.168 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.171178+0000", 2024-04-19T03:01:43.168 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.1137999999999999e-05 2024-04-19T03:01:43.169 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:43.169 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:01:43.169 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:43.169 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.169 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.169 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4159.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-19T03:01:43.169 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:01:08.150915+0000", 2024-04-19T03:01:43.170 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 34.987394375999997, 2024-04-19T03:01:43.170 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.020502679999999999, 2024-04-19T03:01:43.170 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:01:43.170 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:43.170 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:01:43.170 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4159", 2024-04-19T03:01:43.170 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3589238956", 2024-04-19T03:01:43.170 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 140 2024-04-19T03:01:43.170 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.170 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:01:43.170 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.170 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:01:43.171 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.150915+0000", 2024-04-19T03:01:43.171 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:43.171 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.171 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.171 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:01:43.171 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.150915+0000", 2024-04-19T03:01:43.171 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:43.171 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.171 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.171 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:01:43.171 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.150914+0000", 2024-04-19T03:01:43.171 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999986 2024-04-19T03:01:43.171 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.171 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.172 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:01:43.172 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.151066+0000", 2024-04-19T03:01:43.172 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00015186400000000001 2024-04-19T03:01:43.172 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.172 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.172 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:01:43.172 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.151120+0000", 2024-04-19T03:01:43.172 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4042999999999997e-05 2024-04-19T03:01:43.172 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.172 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.172 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:01:43.172 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.151155+0000", 2024-04-19T03:01:43.172 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4941999999999999e-05 2024-04-19T03:01:43.172 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.173 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.173 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:01:43.173 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.168222+0000", 2024-04-19T03:01:43.173 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.017066939999999999 2024-04-19T03:01:43.173 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.173 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.173 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:01:43.173 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.168305+0000", 2024-04-19T03:01:43.173 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.3642999999999999e-05 2024-04-19T03:01:43.173 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.173 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.173 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:01:43.173 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.168385+0000", 2024-04-19T03:01:43.173 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9647999999999994e-05 2024-04-19T03:01:43.174 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.174 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.174 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:01:43.174 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.170514+0000", 2024-04-19T03:01:43.174 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0021286370000000001 2024-04-19T03:01:43.174 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.174 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.174 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:43.174 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.171252+0000", 2024-04-19T03:01:43.174 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00073828499999999998 2024-04-19T03:01:43.174 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.174 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.174 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:01:43.175 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.171353+0000", 2024-04-19T03:01:43.175 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000100839 2024-04-19T03:01:43.175 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.175 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.175 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:01:43.175 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.171418+0000", 2024-04-19T03:01:43.175 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5048999999999993e-05 2024-04-19T03:01:43.175 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:43.175 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:01:43.176 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:43.176 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.176 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.176 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4159.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-19T03:01:43.176 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:01:08.151173+0000", 2024-04-19T03:01:43.176 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 34.987136853999999, 2024-04-19T03:01:43.176 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.023083023000000001, 2024-04-19T03:01:43.176 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:01:43.176 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:43.177 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:01:43.177 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4159", 2024-04-19T03:01:43.177 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3589238956", 2024-04-19T03:01:43.177 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 141 2024-04-19T03:01:43.177 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.177 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:01:43.177 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.177 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:01:43.178 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.151173+0000", 2024-04-19T03:01:43.178 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:43.178 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.178 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.178 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:01:43.178 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.151173+0000", 2024-04-19T03:01:43.178 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:43.178 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.179 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.179 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:01:43.179 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.151171+0000", 2024-04-19T03:01:43.179 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:01:43.179 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.179 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.179 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:01:43.179 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.151182+0000", 2024-04-19T03:01:43.179 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0730000000000001e-05 2024-04-19T03:01:43.180 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.180 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.180 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:01:43.180 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.151203+0000", 2024-04-19T03:01:43.180 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0387e-05 2024-04-19T03:01:43.180 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.180 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.180 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:01:43.181 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.151225+0000", 2024-04-19T03:01:43.181 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2643e-05 2024-04-19T03:01:43.181 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.181 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.181 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:01:43.181 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.169207+0000", 2024-04-19T03:01:43.181 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.017981561 2024-04-19T03:01:43.181 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.182 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.182 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:01:43.182 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.169386+0000", 2024-04-19T03:01:43.182 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000178758 2024-04-19T03:01:43.182 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.182 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.182 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:01:43.183 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.169546+0000", 2024-04-19T03:01:43.183 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000160781 2024-04-19T03:01:43.183 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.183 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.183 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:01:43.183 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.171444+0000", 2024-04-19T03:01:43.183 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0018980309999999999 2024-04-19T03:01:43.183 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.184 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.184 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:43.184 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.174165+0000", 2024-04-19T03:01:43.184 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0027204920000000001 2024-04-19T03:01:43.184 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.184 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.184 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:01:43.184 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.174228+0000", 2024-04-19T03:01:43.185 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2774000000000006e-05 2024-04-19T03:01:43.185 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.185 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.185 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:01:43.185 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.174256+0000", 2024-04-19T03:01:43.185 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.8045999999999999e-05 2024-04-19T03:01:43.185 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:43.185 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:01:43.185 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:43.186 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.186 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.186 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4159.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-19T03:01:43.186 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:01:08.347807+0000", 2024-04-19T03:01:43.186 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 34.790502846000003, 2024-04-19T03:01:43.186 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.021589991999999999, 2024-04-19T03:01:43.186 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:01:43.187 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:43.187 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:01:43.187 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4159", 2024-04-19T03:01:43.187 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3589238956", 2024-04-19T03:01:43.187 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 165 2024-04-19T03:01:43.187 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.187 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:01:43.187 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.188 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:01:43.188 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.347807+0000", 2024-04-19T03:01:43.188 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:43.188 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.188 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.188 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:01:43.188 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.347807+0000", 2024-04-19T03:01:43.188 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:43.189 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.189 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.189 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:01:43.189 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.347806+0000", 2024-04-19T03:01:43.189 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:01:43.189 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.189 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.189 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:01:43.189 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.347812+0000", 2024-04-19T03:01:43.190 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.066e-06 2024-04-19T03:01:43.190 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.190 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.190 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:01:43.190 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.347818+0000", 2024-04-19T03:01:43.190 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5550000000000002e-06 2024-04-19T03:01:43.190 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.191 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.191 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:01:43.191 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.347822+0000", 2024-04-19T03:01:43.191 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.561e-06 2024-04-19T03:01:43.191 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.191 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.192 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:01:43.192 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.365703+0000", 2024-04-19T03:01:43.192 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.017880566000000001 2024-04-19T03:01:43.192 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.192 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.192 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:01:43.193 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.365805+0000", 2024-04-19T03:01:43.193 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00010213900000000001 2024-04-19T03:01:43.193 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.193 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.193 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:01:43.193 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.365928+0000", 2024-04-19T03:01:43.194 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00012337900000000001 2024-04-19T03:01:43.194 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.194 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.194 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:43.194 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.367353+0000", 2024-04-19T03:01:43.194 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001424397 2024-04-19T03:01:43.195 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.195 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.195 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:01:43.195 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.369260+0000", 2024-04-19T03:01:43.195 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0019069130000000001 2024-04-19T03:01:43.195 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.196 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.196 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:01:43.196 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.369342+0000", 2024-04-19T03:01:43.196 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2423999999999996e-05 2024-04-19T03:01:43.196 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.196 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.197 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:01:43.197 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.369397+0000", 2024-04-19T03:01:43.197 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4481999999999998e-05 2024-04-19T03:01:43.197 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:43.197 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:01:43.197 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:43.198 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.198 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.198 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4159.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-19T03:01:43.198 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:01:08.539135+0000", 2024-04-19T03:01:43.198 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 34.599174587999997, 2024-04-19T03:01:43.198 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.021590602, 2024-04-19T03:01:43.199 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:01:43.199 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:43.199 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:01:43.199 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4159", 2024-04-19T03:01:43.199 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3589238956", 2024-04-19T03:01:43.199 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 188 2024-04-19T03:01:43.200 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.200 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:01:43.200 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.200 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:01:43.200 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.539135+0000", 2024-04-19T03:01:43.200 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:43.201 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.201 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.201 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:01:43.201 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.539135+0000", 2024-04-19T03:01:43.201 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:43.201 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.201 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.201 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:01:43.202 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.539134+0000", 2024-04-19T03:01:43.202 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:01:43.202 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.202 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.202 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:01:43.202 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.539228+0000", 2024-04-19T03:01:43.203 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.3771999999999996e-05 2024-04-19T03:01:43.203 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.203 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.203 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:01:43.203 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.539243+0000", 2024-04-19T03:01:43.203 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4707e-05 2024-04-19T03:01:43.204 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.204 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.204 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:01:43.204 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.539250+0000", 2024-04-19T03:01:43.204 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7190000000000001e-06 2024-04-19T03:01:43.204 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.205 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.205 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:01:43.205 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.553787+0000", 2024-04-19T03:01:43.205 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.014536248999999999 2024-04-19T03:01:43.205 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.205 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.206 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:01:43.206 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.553857+0000", 2024-04-19T03:01:43.206 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0675999999999999e-05 2024-04-19T03:01:43.206 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.206 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.206 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:01:43.207 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.553953+0000", 2024-04-19T03:01:43.207 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.5420999999999993e-05 2024-04-19T03:01:43.207 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.207 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.207 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:01:43.207 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.555569+0000", 2024-04-19T03:01:43.208 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001616625 2024-04-19T03:01:43.208 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.208 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.208 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:43.208 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.560644+0000", 2024-04-19T03:01:43.208 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0050749660000000002 2024-04-19T03:01:43.209 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.209 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.209 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:01:43.209 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.560690+0000", 2024-04-19T03:01:43.209 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6041000000000002e-05 2024-04-19T03:01:43.209 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.210 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.210 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:01:43.210 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.560726+0000", 2024-04-19T03:01:43.210 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5188999999999998e-05 2024-04-19T03:01:43.210 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:43.211 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:01:43.211 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:43.211 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.211 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.211 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4159.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-19T03:01:43.211 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:01:08.539259+0000", 2024-04-19T03:01:43.212 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 34.599050120000001, 2024-04-19T03:01:43.212 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.021552071999999999, 2024-04-19T03:01:43.212 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:01:43.212 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:43.212 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:01:43.212 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4159", 2024-04-19T03:01:43.213 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3589238956", 2024-04-19T03:01:43.213 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 189 2024-04-19T03:01:43.213 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.213 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:01:43.213 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.213 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:01:43.214 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.539259+0000", 2024-04-19T03:01:43.214 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:43.214 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.214 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.214 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:01:43.214 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.539259+0000", 2024-04-19T03:01:43.215 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:43.215 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.215 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.215 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:01:43.215 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.539259+0000", 2024-04-19T03:01:43.215 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:01:43.215 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.216 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.216 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:01:43.216 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.539268+0000", 2024-04-19T03:01:43.216 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.5359999999999998e-06 2024-04-19T03:01:43.216 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.216 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.216 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:01:43.216 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.539291+0000", 2024-04-19T03:01:43.217 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2687000000000001e-05 2024-04-19T03:01:43.217 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.217 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.217 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:01:43.217 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.539298+0000", 2024-04-19T03:01:43.217 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.883e-06 2024-04-19T03:01:43.217 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.217 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.218 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:01:43.218 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.554957+0000", 2024-04-19T03:01:43.218 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.015659019999999999 2024-04-19T03:01:43.218 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.218 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.218 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:01:43.218 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.555010+0000", 2024-04-19T03:01:43.218 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2985999999999997e-05 2024-04-19T03:01:43.219 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.219 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.219 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:01:43.219 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.555094+0000", 2024-04-19T03:01:43.219 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4530000000000006e-05 2024-04-19T03:01:43.219 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.220 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.220 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:01:43.220 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.556093+0000", 2024-04-19T03:01:43.220 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00099903300000000008 2024-04-19T03:01:43.220 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.220 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.220 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:43.220 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.560759+0000", 2024-04-19T03:01:43.220 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0046654369999999997 2024-04-19T03:01:43.220 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.220 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.221 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:01:43.221 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.560789+0000", 2024-04-19T03:01:43.221 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0638e-05 2024-04-19T03:01:43.221 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.221 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.221 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:01:43.221 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.560811+0000", 2024-04-19T03:01:43.221 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2167999999999998e-05 2024-04-19T03:01:43.221 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:43.221 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:01:43.221 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:43.221 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.222 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.222 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:8 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:01:43.222 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:01:14.998165+0000", 2024-04-19T03:01:43.222 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 28.140144439, 2024-04-19T03:01:43.222 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.024541001, 2024-04-19T03:01:43.222 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:01:43.222 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:43.222 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:01:43.223 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.223 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:01:43.223 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998165+0000", 2024-04-19T03:01:43.223 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:43.223 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.223 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.223 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:01:43.223 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998165+0000", 2024-04-19T03:01:43.223 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:43.223 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.223 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.223 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:01:43.223 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998164+0000", 2024-04-19T03:01:43.224 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:01:43.224 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.224 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.224 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:01:43.224 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998170+0000", 2024-04-19T03:01:43.224 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2939999999999996e-06 2024-04-19T03:01:43.224 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.224 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.224 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:01:43.224 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998179+0000", 2024-04-19T03:01:43.224 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.5540000000000003e-06 2024-04-19T03:01:43.224 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.224 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.224 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:01:43.225 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998188+0000", 2024-04-19T03:01:43.225 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2959999999999999e-06 2024-04-19T03:01:43.225 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.225 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.225 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:01:43.225 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998332+0000", 2024-04-19T03:01:43.225 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00014474 2024-04-19T03:01:43.225 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.226 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.226 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:01:43.226 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998337+0000", 2024-04-19T03:01:43.226 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6909999999999996e-06 2024-04-19T03:01:43.226 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.226 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.226 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:01:43.226 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.010222+0000", 2024-04-19T03:01:43.226 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011885178 2024-04-19T03:01:43.226 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.226 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.226 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:01:43.227 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.010342+0000", 2024-04-19T03:01:43.227 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00011991500000000001 2024-04-19T03:01:43.227 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.227 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.227 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:01:43.227 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.010506+0000", 2024-04-19T03:01:43.227 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00016429699999999999 2024-04-19T03:01:43.227 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.228 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.228 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:01:43.228 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.014525+0000", 2024-04-19T03:01:43.228 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0040189839999999998 2024-04-19T03:01:43.228 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.228 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.228 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:43.228 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.022600+0000", 2024-04-19T03:01:43.228 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0080741990000000007 2024-04-19T03:01:43.228 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.228 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.228 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:01:43.228 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.022670+0000", 2024-04-19T03:01:43.229 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0743999999999999e-05 2024-04-19T03:01:43.229 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.229 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.229 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:01:43.229 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.022706+0000", 2024-04-19T03:01:43.229 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5782999999999999e-05 2024-04-19T03:01:43.229 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:43.229 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:01:43.229 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:43.229 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.229 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.229 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:27 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:01:43.230 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:01:14.998436+0000", 2024-04-19T03:01:43.230 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 28.139873784999999, 2024-04-19T03:01:43.230 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.024406325999999999, 2024-04-19T03:01:43.230 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:01:43.230 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:43.230 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:01:43.230 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.230 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:01:43.230 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998436+0000", 2024-04-19T03:01:43.230 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:43.230 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.230 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.230 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:01:43.231 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998436+0000", 2024-04-19T03:01:43.231 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:43.231 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.231 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.231 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:01:43.231 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998435+0000", 2024-04-19T03:01:43.231 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:01:43.231 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.231 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.231 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:01:43.232 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998445+0000", 2024-04-19T03:01:43.232 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0349e-05 2024-04-19T03:01:43.232 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.232 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.232 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:01:43.232 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998453+0000", 2024-04-19T03:01:43.232 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0399999999999993e-06 2024-04-19T03:01:43.232 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.232 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.233 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:01:43.233 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998461+0000", 2024-04-19T03:01:43.233 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9780000000000005e-06 2024-04-19T03:01:43.233 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.233 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.233 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:01:43.233 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998515+0000", 2024-04-19T03:01:43.234 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3097999999999999e-05 2024-04-19T03:01:43.234 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.234 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.234 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:01:43.234 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998520+0000", 2024-04-19T03:01:43.234 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9220000000000002e-06 2024-04-19T03:01:43.234 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.235 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.235 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:01:43.235 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.011258+0000", 2024-04-19T03:01:43.235 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.012737735 2024-04-19T03:01:43.235 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.235 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.235 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:01:43.236 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.011566+0000", 2024-04-19T03:01:43.236 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00030826200000000001 2024-04-19T03:01:43.236 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.236 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.236 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:01:43.236 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.011996+0000", 2024-04-19T03:01:43.236 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00042912000000000001 2024-04-19T03:01:43.236 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.236 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.236 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:01:43.237 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.014533+0000", 2024-04-19T03:01:43.237 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.002537423 2024-04-19T03:01:43.237 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.237 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.237 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:43.237 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.022756+0000", 2024-04-19T03:01:43.237 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0082231530000000004 2024-04-19T03:01:43.237 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.237 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.237 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:01:43.237 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.022807+0000", 2024-04-19T03:01:43.238 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0852e-05 2024-04-19T03:01:43.238 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.238 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.238 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:01:43.238 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.022842+0000", 2024-04-19T03:01:43.238 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5058000000000002e-05 2024-04-19T03:01:43.238 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:43.238 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:01:43.238 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:43.238 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.238 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.238 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:28 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:01:43.239 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:01:14.998476+0000", 2024-04-19T03:01:43.239 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 28.139833863, 2024-04-19T03:01:43.239 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.024656784000000001, 2024-04-19T03:01:43.239 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:01:43.239 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:43.239 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:01:43.239 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.239 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:01:43.239 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998476+0000", 2024-04-19T03:01:43.239 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:43.239 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.239 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.240 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:01:43.240 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998476+0000", 2024-04-19T03:01:43.240 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:43.240 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.240 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.240 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:01:43.240 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998475+0000", 2024-04-19T03:01:43.240 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:01:43.240 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.240 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.240 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:01:43.240 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998484+0000", 2024-04-19T03:01:43.240 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.7770000000000008e-06 2024-04-19T03:01:43.240 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.241 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.241 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:01:43.241 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998495+0000", 2024-04-19T03:01:43.241 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0726e-05 2024-04-19T03:01:43.241 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.241 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.241 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:01:43.241 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998503+0000", 2024-04-19T03:01:43.241 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.8780000000000004e-06 2024-04-19T03:01:43.241 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.241 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.241 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:01:43.241 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998579+0000", 2024-04-19T03:01:43.242 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5160999999999994e-05 2024-04-19T03:01:43.242 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.242 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.242 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:01:43.242 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998586+0000", 2024-04-19T03:01:43.242 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8520000000000004e-06 2024-04-19T03:01:43.242 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.242 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.242 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:01:43.242 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.012423+0000", 2024-04-19T03:01:43.242 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.013836667 2024-04-19T03:01:43.242 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.242 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.243 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:01:43.243 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.012532+0000", 2024-04-19T03:01:43.243 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000108565 2024-04-19T03:01:43.243 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.243 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.243 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:01:43.243 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.012655+0000", 2024-04-19T03:01:43.243 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00012344600000000001 2024-04-19T03:01:43.243 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.243 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.243 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:01:43.243 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.015680+0000", 2024-04-19T03:01:43.243 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0030246470000000001 2024-04-19T03:01:43.244 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.244 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.244 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:43.244 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.023091+0000", 2024-04-19T03:01:43.244 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0074116030000000001 2024-04-19T03:01:43.244 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.244 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.244 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:01:43.244 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.023115+0000", 2024-04-19T03:01:43.244 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.3091999999999998e-05 2024-04-19T03:01:43.244 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.244 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.245 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:01:43.245 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.023132+0000", 2024-04-19T03:01:43.245 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7901999999999999e-05 2024-04-19T03:01:43.245 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:43.245 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:01:43.245 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:43.245 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.245 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.245 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:29 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:01:43.245 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:01:14.998527+0000", 2024-04-19T03:01:43.246 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 28.139782322999999, 2024-04-19T03:01:43.246 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.024738599999999999, 2024-04-19T03:01:43.246 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:01:43.246 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:43.246 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:01:43.246 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.246 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:01:43.246 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998527+0000", 2024-04-19T03:01:43.247 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:43.247 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.247 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.247 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:01:43.247 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998527+0000", 2024-04-19T03:01:43.247 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:43.247 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.247 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.247 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:01:43.247 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998527+0000", 2024-04-19T03:01:43.247 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:01:43.248 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.248 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.248 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:01:43.248 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998531+0000", 2024-04-19T03:01:43.248 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9450000000000001e-06 2024-04-19T03:01:43.248 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.248 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.248 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:01:43.248 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998541+0000", 2024-04-19T03:01:43.248 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.4320000000000005e-06 2024-04-19T03:01:43.248 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.248 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.248 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:01:43.248 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998548+0000", 2024-04-19T03:01:43.249 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.221e-06 2024-04-19T03:01:43.249 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.249 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.249 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:01:43.249 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998620+0000", 2024-04-19T03:01:43.249 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.1676999999999998e-05 2024-04-19T03:01:43.249 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.249 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.249 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:01:43.249 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998624+0000", 2024-04-19T03:01:43.249 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4850000000000003e-06 2024-04-19T03:01:43.249 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.249 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.250 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:01:43.250 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.013261+0000", 2024-04-19T03:01:43.250 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.014636451999999999 2024-04-19T03:01:43.250 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.250 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.250 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:01:43.250 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.013364+0000", 2024-04-19T03:01:43.250 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000102885 2024-04-19T03:01:43.250 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.250 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.250 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:01:43.250 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.013481+0000", 2024-04-19T03:01:43.250 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00011783299999999999 2024-04-19T03:01:43.251 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.251 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.251 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:01:43.251 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.016265+0000", 2024-04-19T03:01:43.251 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0027834539999999999 2024-04-19T03:01:43.251 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.251 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.251 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:43.251 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.023180+0000", 2024-04-19T03:01:43.251 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0069149399999999996 2024-04-19T03:01:43.251 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.252 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.252 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:01:43.252 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.023230+0000", 2024-04-19T03:01:43.252 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0220999999999999e-05 2024-04-19T03:01:43.252 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.252 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.252 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:01:43.252 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.023266+0000", 2024-04-19T03:01:43.252 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5703e-05 2024-04-19T03:01:43.252 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:43.252 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:01:43.253 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:43.253 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.253 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.253 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:30 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:01:43.253 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:01:14.998577+0000", 2024-04-19T03:01:43.253 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 28.139732215999999, 2024-04-19T03:01:43.253 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.024774022999999999, 2024-04-19T03:01:43.253 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:01:43.253 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:43.253 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:01:43.253 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.253 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:01:43.253 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998577+0000", 2024-04-19T03:01:43.254 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:43.254 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.254 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.254 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:01:43.254 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998577+0000", 2024-04-19T03:01:43.254 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:43.254 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.254 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.254 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:01:43.254 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998576+0000", 2024-04-19T03:01:43.254 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:01:43.254 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.255 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.255 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:01:43.255 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998583+0000", 2024-04-19T03:01:43.255 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8850000000000001e-06 2024-04-19T03:01:43.255 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.255 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.255 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:01:43.255 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998597+0000", 2024-04-19T03:01:43.255 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.362e-05 2024-04-19T03:01:43.255 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.255 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.255 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:01:43.255 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998607+0000", 2024-04-19T03:01:43.255 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0389e-05 2024-04-19T03:01:43.256 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.256 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.256 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:01:43.256 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998713+0000", 2024-04-19T03:01:43.256 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000105338 2024-04-19T03:01:43.256 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.256 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.256 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:01:43.256 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998720+0000", 2024-04-19T03:01:43.256 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2370000000000003e-06 2024-04-19T03:01:43.256 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.256 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.256 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:01:43.256 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.014014+0000", 2024-04-19T03:01:43.257 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.015294116999999999 2024-04-19T03:01:43.257 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.257 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.257 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:01:43.257 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.014091+0000", 2024-04-19T03:01:43.257 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7148000000000001e-05 2024-04-19T03:01:43.257 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.257 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.258 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:01:43.258 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.014271+0000", 2024-04-19T03:01:43.258 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00017962699999999999 2024-04-19T03:01:43.258 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.258 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.258 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:01:43.258 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.018024+0000", 2024-04-19T03:01:43.258 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0037529809999999999 2024-04-19T03:01:43.258 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.258 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.258 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:43.258 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.023303+0000", 2024-04-19T03:01:43.258 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0052793099999999997 2024-04-19T03:01:43.259 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.259 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.259 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:01:43.259 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.023331+0000", 2024-04-19T03:01:43.259 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.8013000000000001e-05 2024-04-19T03:01:43.259 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.259 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.259 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:01:43.259 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.023351+0000", 2024-04-19T03:01:43.259 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0225999999999999e-05 2024-04-19T03:01:43.259 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:43.259 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:01:43.260 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:43.260 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.260 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.260 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:33 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:01:43.260 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:01:14.998625+0000", 2024-04-19T03:01:43.260 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 28.139684818999999, 2024-04-19T03:01:43.260 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.024007338999999999, 2024-04-19T03:01:43.260 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:01:43.260 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:43.260 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:01:43.260 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.260 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:01:43.260 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998625+0000", 2024-04-19T03:01:43.261 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:43.261 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.261 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.261 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:01:43.261 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998625+0000", 2024-04-19T03:01:43.261 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:43.261 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.261 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.261 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:01:43.261 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998623+0000", 2024-04-19T03:01:43.261 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999986 2024-04-19T03:01:43.261 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.261 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.262 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:01:43.262 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998632+0000", 2024-04-19T03:01:43.262 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9279999999999999e-06 2024-04-19T03:01:43.262 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.262 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.262 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:01:43.262 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998642+0000", 2024-04-19T03:01:43.262 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0063e-05 2024-04-19T03:01:43.262 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.262 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.263 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:01:43.263 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998649+0000", 2024-04-19T03:01:43.263 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4799999999999998e-06 2024-04-19T03:01:43.263 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.263 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.263 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:01:43.263 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998730+0000", 2024-04-19T03:01:43.263 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.1514999999999995e-05 2024-04-19T03:01:43.263 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.263 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.263 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:01:43.263 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998741+0000", 2024-04-19T03:01:43.263 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1029999999999999e-05 2024-04-19T03:01:43.264 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.264 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.264 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:01:43.264 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.010202+0000", 2024-04-19T03:01:43.264 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011460529000000001 2024-04-19T03:01:43.264 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.264 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.264 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:01:43.264 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.010292+0000", 2024-04-19T03:01:43.264 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.0382000000000003e-05 2024-04-19T03:01:43.264 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.264 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.264 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:01:43.264 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.010391+0000", 2024-04-19T03:01:43.265 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.8491000000000003e-05 2024-04-19T03:01:43.265 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.265 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.265 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:01:43.265 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.013800+0000", 2024-04-19T03:01:43.265 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0034090219999999998 2024-04-19T03:01:43.265 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.265 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.265 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:43.265 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.022564+0000", 2024-04-19T03:01:43.265 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0087639950000000001 2024-04-19T03:01:43.265 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.265 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.266 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:01:43.266 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.022601+0000", 2024-04-19T03:01:43.266 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7363999999999997e-05 2024-04-19T03:01:43.266 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.266 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.266 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:01:43.266 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.022632+0000", 2024-04-19T03:01:43.266 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0917000000000002e-05 2024-04-19T03:01:43.266 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:43.266 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:01:43.266 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:43.266 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.266 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.267 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:37 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:01:43.267 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:01:14.998739+0000", 2024-04-19T03:01:43.267 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 28.139570878000001, 2024-04-19T03:01:43.267 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.020573188999999999, 2024-04-19T03:01:43.267 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:01:43.267 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:43.267 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:01:43.267 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.267 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:01:43.267 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998739+0000", 2024-04-19T03:01:43.267 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:43.267 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.268 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.268 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:01:43.268 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998739+0000", 2024-04-19T03:01:43.268 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:43.268 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.268 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.268 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:01:43.268 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998738+0000", 2024-04-19T03:01:43.268 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:01:43.268 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.269 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.269 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:01:43.269 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998755+0000", 2024-04-19T03:01:43.269 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7105999999999999e-05 2024-04-19T03:01:43.269 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.269 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.269 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:01:43.269 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998764+0000", 2024-04-19T03:01:43.269 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.1279999999999997e-06 2024-04-19T03:01:43.269 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.269 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.269 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:01:43.269 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998771+0000", 2024-04-19T03:01:43.270 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6939999999999998e-06 2024-04-19T03:01:43.270 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.270 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.270 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:01:43.270 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998843+0000", 2024-04-19T03:01:43.270 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.1695999999999999e-05 2024-04-19T03:01:43.270 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.270 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.270 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op must wait for map", 2024-04-19T03:01:43.270 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998852+0000", 2024-04-19T03:01:43.270 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.0799999999999995e-06 2024-04-19T03:01:43.270 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.270 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.271 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:01:43.271 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.006513+0000", 2024-04-19T03:01:43.271 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0076610020000000001 2024-04-19T03:01:43.271 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.271 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.271 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:01:43.271 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.006670+0000", 2024-04-19T03:01:43.271 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000157529 2024-04-19T03:01:43.271 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.271 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.271 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-04-19T03:01:43.272 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.006863+0000", 2024-04-19T03:01:43.272 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000192597 2024-04-19T03:01:43.272 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.272 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.272 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:01:43.272 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.012404+0000", 2024-04-19T03:01:43.272 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0055415220000000001 2024-04-19T03:01:43.273 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.273 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.273 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:43.273 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.019171+0000", 2024-04-19T03:01:43.273 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0067666829999999999 2024-04-19T03:01:43.273 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.273 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.273 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:01:43.273 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.019228+0000", 2024-04-19T03:01:43.273 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7145999999999998e-05 2024-04-19T03:01:43.273 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.273 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.273 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:01:43.274 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.019312+0000", 2024-04-19T03:01:43.274 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.3591999999999995e-05 2024-04-19T03:01:43.274 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:43.274 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:01:43.274 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:43.274 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.274 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.274 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:01:43.274 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:01:14.998792+0000", 2024-04-19T03:01:43.274 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 28.139517949999998, 2024-04-19T03:01:43.274 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.023951813999999998, 2024-04-19T03:01:43.274 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:01:43.274 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:43.275 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:01:43.275 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.275 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:01:43.275 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998792+0000", 2024-04-19T03:01:43.275 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:43.275 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.275 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.275 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:01:43.275 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998792+0000", 2024-04-19T03:01:43.275 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:43.275 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.275 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.275 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:01:43.275 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998791+0000", 2024-04-19T03:01:43.276 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:01:43.276 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.276 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.276 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:01:43.276 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998796+0000", 2024-04-19T03:01:43.276 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9649999999999999e-06 2024-04-19T03:01:43.276 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.276 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.276 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:01:43.276 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998809+0000", 2024-04-19T03:01:43.276 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3254e-05 2024-04-19T03:01:43.276 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.276 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.277 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:01:43.277 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998816+0000", 2024-04-19T03:01:43.277 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.472e-06 2024-04-19T03:01:43.277 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.277 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.277 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:01:43.277 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998899+0000", 2024-04-19T03:01:43.277 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.3676000000000003e-05 2024-04-19T03:01:43.277 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.277 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.277 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:01:43.277 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998908+0000", 2024-04-19T03:01:43.277 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6940000000000001e-06 2024-04-19T03:01:43.278 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.278 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.278 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:01:43.278 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.010818+0000", 2024-04-19T03:01:43.278 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011910482999999999 2024-04-19T03:01:43.278 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.278 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.278 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:01:43.279 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.010959+0000", 2024-04-19T03:01:43.279 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00014018900000000001 2024-04-19T03:01:43.279 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.279 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.279 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:01:43.279 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.011185+0000", 2024-04-19T03:01:43.279 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000226085 2024-04-19T03:01:43.280 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.280 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.280 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:01:43.280 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.014479+0000", 2024-04-19T03:01:43.280 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0032938260000000001 2024-04-19T03:01:43.280 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.280 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.280 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:43.280 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.022697+0000", 2024-04-19T03:01:43.280 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0082186029999999997 2024-04-19T03:01:43.280 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.280 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.280 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:01:43.281 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.022724+0000", 2024-04-19T03:01:43.281 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.6503999999999999e-05 2024-04-19T03:01:43.281 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.281 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.281 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:01:43.281 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.022743+0000", 2024-04-19T03:01:43.282 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9663000000000001e-05 2024-04-19T03:01:43.282 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:43.282 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:01:43.282 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:43.282 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.282 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.283 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:01:43.283 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:01:14.998870+0000", 2024-04-19T03:01:43.283 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 28.139439749000001, 2024-04-19T03:01:43.283 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.024280578000000001, 2024-04-19T03:01:43.283 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:01:43.283 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:43.284 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:01:43.284 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.284 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:01:43.284 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998870+0000", 2024-04-19T03:01:43.284 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:43.284 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.285 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.285 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:01:43.285 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998870+0000", 2024-04-19T03:01:43.285 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:43.285 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.285 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.285 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:01:43.286 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998869+0000", 2024-04-19T03:01:43.286 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:01:43.286 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.286 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.286 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:01:43.286 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998879+0000", 2024-04-19T03:01:43.287 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.8689999999999999e-06 2024-04-19T03:01:43.287 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.287 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.287 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:01:43.287 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998893+0000", 2024-04-19T03:01:43.287 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4436999999999999e-05 2024-04-19T03:01:43.288 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.288 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.288 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:01:43.288 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998904+0000", 2024-04-19T03:01:43.288 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0657e-05 2024-04-19T03:01:43.288 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.289 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.289 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:01:43.289 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998972+0000", 2024-04-19T03:01:43.289 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8121999999999996e-05 2024-04-19T03:01:43.289 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.289 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.290 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:01:43.290 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998980+0000", 2024-04-19T03:01:43.290 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7170000000000008e-06 2024-04-19T03:01:43.290 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.290 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.290 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:01:43.291 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.011666+0000", 2024-04-19T03:01:43.291 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.012686507 2024-04-19T03:01:43.291 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.291 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.291 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:01:43.291 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.012403+0000", 2024-04-19T03:01:43.292 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00073661899999999999 2024-04-19T03:01:43.292 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.292 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.292 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:01:43.292 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.012788+0000", 2024-04-19T03:01:43.292 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00038495800000000002 2024-04-19T03:01:43.293 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.293 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.293 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:01:43.293 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.015713+0000", 2024-04-19T03:01:43.293 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0029255879999999998 2024-04-19T03:01:43.293 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.294 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.294 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:43.294 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.023066+0000", 2024-04-19T03:01:43.294 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.007352903 2024-04-19T03:01:43.294 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.294 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.295 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:01:43.295 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.023113+0000", 2024-04-19T03:01:43.295 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7163000000000002e-05 2024-04-19T03:01:43.295 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.295 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.295 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:01:43.296 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.023150+0000", 2024-04-19T03:01:43.296 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6881000000000001e-05 2024-04-19T03:01:43.296 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:43.296 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:01:43.296 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:43.296 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.297 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.297 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:16 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:01:43.297 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:01:14.998920+0000", 2024-04-19T03:01:43.297 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 28.139389703999999, 2024-04-19T03:01:43.297 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.020562114999999999, 2024-04-19T03:01:43.297 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:01:43.298 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:43.298 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:01:43.298 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.298 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:01:43.298 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998920+0000", 2024-04-19T03:01:43.298 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:43.299 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.299 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.299 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:01:43.299 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998920+0000", 2024-04-19T03:01:43.299 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:43.299 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.300 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.300 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:01:43.300 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998919+0000", 2024-04-19T03:01:43.300 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:01:43.300 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.300 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.301 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:01:43.301 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998925+0000", 2024-04-19T03:01:43.301 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5370000000000003e-06 2024-04-19T03:01:43.301 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.301 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.301 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:01:43.302 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998943+0000", 2024-04-19T03:01:43.302 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7549000000000001e-05 2024-04-19T03:01:43.302 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.302 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.302 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:01:43.302 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998955+0000", 2024-04-19T03:01:43.303 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1977000000000001e-05 2024-04-19T03:01:43.303 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.303 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.303 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:01:43.303 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.999009+0000", 2024-04-19T03:01:43.303 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3667e-05 2024-04-19T03:01:43.304 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.304 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.304 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:01:43.304 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.999013+0000", 2024-04-19T03:01:43.304 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8829999999999997e-06 2024-04-19T03:01:43.304 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.305 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.305 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:01:43.305 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.007476+0000", 2024-04-19T03:01:43.305 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0084621569999999997 2024-04-19T03:01:43.305 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.305 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.305 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:01:43.305 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.007626+0000", 2024-04-19T03:01:43.305 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00015079199999999999 2024-04-19T03:01:43.305 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.306 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.306 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-04-19T03:01:43.306 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.007765+0000", 2024-04-19T03:01:43.306 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000138376 2024-04-19T03:01:43.306 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.306 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.306 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:01:43.306 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.012418+0000", 2024-04-19T03:01:43.306 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0046528200000000002 2024-04-19T03:01:43.306 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.307 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.307 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:43.307 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.019380+0000", 2024-04-19T03:01:43.307 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0069621960000000004 2024-04-19T03:01:43.307 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.307 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.307 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:01:43.307 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.019437+0000", 2024-04-19T03:01:43.307 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7226999999999999e-05 2024-04-19T03:01:43.308 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.308 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.308 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:01:43.308 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.019482+0000", 2024-04-19T03:01:43.308 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4857000000000001e-05 2024-04-19T03:01:43.308 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:43.308 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:01:43.308 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:43.308 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.309 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.309 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:20 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:01:43.309 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:01:14.999024+0000", 2024-04-19T03:01:43.309 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 28.139285477000001, 2024-04-19T03:01:43.309 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.024212818000000001, 2024-04-19T03:01:43.309 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:01:43.309 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-04-19T03:01:43.309 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:01:43.310 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.310 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:01:43.310 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.999024+0000", 2024-04-19T03:01:43.310 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:43.310 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.310 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.311 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:01:43.311 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.999024+0000", 2024-04-19T03:01:43.311 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:43.311 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.311 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.311 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:01:43.311 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.999023+0000", 2024-04-19T03:01:43.311 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:01:43.312 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.312 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.312 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:01:43.312 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.999029+0000", 2024-04-19T03:01:43.312 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2709999999999998e-06 2024-04-19T03:01:43.312 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.312 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.312 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:01:43.313 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.999045+0000", 2024-04-19T03:01:43.313 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.5840000000000001e-05 2024-04-19T03:01:43.313 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.313 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.313 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:01:43.313 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.999057+0000", 2024-04-19T03:01:43.313 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1897e-05 2024-04-19T03:01:43.313 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.313 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.313 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:01:43.313 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.999136+0000", 2024-04-19T03:01:43.313 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8842000000000002e-05 2024-04-19T03:01:43.314 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.314 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.314 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:01:43.314 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.999144+0000", 2024-04-19T03:01:43.314 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.3110000000000006e-06 2024-04-19T03:01:43.314 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.315 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.315 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:01:43.315 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.013338+0000", 2024-04-19T03:01:43.315 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.014194217 2024-04-19T03:01:43.315 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.315 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.315 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:01:43.315 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.013485+0000", 2024-04-19T03:01:43.316 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000146787 2024-04-19T03:01:43.316 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.316 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.316 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:01:43.316 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.023237+0000", 2024-04-19T03:01:43.316 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0097517899999999998 2024-04-19T03:01:43.316 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:43.317 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:01:43.317 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:43.317 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.317 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.317 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:11289 5.7 5:e1ea82b1:::benchmark_data_smithi096_19531_object11288:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T03:01:43.317 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:01:42.068678+0000", 2024-04-19T03:01:43.318 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 1.0696312569999999, 2024-04-19T03:01:43.318 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.022027980999999999, 2024-04-19T03:01:43.318 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:01:43.318 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:43.318 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:01:43.318 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:01:43.318 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:43.318 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 11289 2024-04-19T03:01:43.318 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.318 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:01:43.319 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.319 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:01:43.319 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:42.068678+0000", 2024-04-19T03:01:43.319 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:43.319 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.319 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.319 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:01:43.319 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:42.068678+0000", 2024-04-19T03:01:43.319 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:43.319 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.319 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.320 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:01:43.320 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:42.068677+0000", 2024-04-19T03:01:43.320 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:01:43.320 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.320 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.320 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:01:43.320 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:42.068721+0000", 2024-04-19T03:01:43.320 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3714000000000002e-05 2024-04-19T03:01:43.320 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.320 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.320 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:01:43.320 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:42.068728+0000", 2024-04-19T03:01:43.321 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0029999999999997e-06 2024-04-19T03:01:43.321 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.321 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.321 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:01:43.321 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:42.068733+0000", 2024-04-19T03:01:43.321 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0100000000000003e-06 2024-04-19T03:01:43.321 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.321 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.321 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:01:43.321 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:42.068820+0000", 2024-04-19T03:01:43.321 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.653e-05 2024-04-19T03:01:43.321 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.321 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.321 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:01:43.322 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:42.068990+0000", 2024-04-19T03:01:43.322 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00017046800000000001 2024-04-19T03:01:43.322 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.322 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.322 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-04-19T03:01:43.322 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:42.069140+0000", 2024-04-19T03:01:43.322 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00015001000000000001 2024-04-19T03:01:43.322 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.322 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.322 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:01:43.322 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:42.074573+0000", 2024-04-19T03:01:43.322 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0054326979999999997 2024-04-19T03:01:43.322 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.323 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.323 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:43.323 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:42.090534+0000", 2024-04-19T03:01:43.323 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.015961300000000001 2024-04-19T03:01:43.323 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.323 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.323 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:01:43.323 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:42.090619+0000", 2024-04-19T03:01:43.323 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4536999999999994e-05 2024-04-19T03:01:43.323 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:43.323 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:43.323 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:01:43.323 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:42.090706+0000", 2024-04-19T03:01:43.324 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.7643000000000001e-05 2024-04-19T03:01:43.324 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:43.324 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:01:43.324 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:43.324 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:43.324 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:01:43.324 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-04-19T03:01:43.326 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T03:01:43.326 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:01:43.324+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:01:43.426 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:01:43.421+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:01:43.461 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-04-19T03:01:43.461 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [ 2024-04-19T03:01:43.462 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.462 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4755.0:14765 5.c 5:364ef54c:::benchmark_data_smithi096_19531_object14764:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T03:01:43.462 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:43.454598+0000", 2024-04-19T03:01:43.462 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 0.003316439, 2024-04-19T03:01:43.462 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.003337455, 2024-04-19T03:01:43.462 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:01:43.462 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:01:43.462 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-04-19T03:01:43.462 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4755", 2024-04-19T03:01:43.462 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:43.462 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 14765 2024-04-19T03:01:43.463 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.463 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:01:43.463 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.463 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:01:43.463 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:43.454598+0000", 2024-04-19T03:01:43.463 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:43.463 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.463 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.463 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:01:43.463 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:43.454598+0000", 2024-04-19T03:01:43.463 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:43.463 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.463 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.463 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:01:43.464 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:43.454597+0000", 2024-04-19T03:01:43.464 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999986 2024-04-19T03:01:43.464 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.464 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.464 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:01:43.464 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:43.454644+0000", 2024-04-19T03:01:43.464 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.7577000000000002e-05 2024-04-19T03:01:43.464 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.464 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.464 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:01:43.464 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:43.454656+0000", 2024-04-19T03:01:43.464 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2118e-05 2024-04-19T03:01:43.464 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.464 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.465 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:01:43.465 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:43.454679+0000", 2024-04-19T03:01:43.465 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.2552999999999999e-05 2024-04-19T03:01:43.465 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.465 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.465 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:43.465 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:43.454734+0000", 2024-04-19T03:01:43.465 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.4506000000000003e-05 2024-04-19T03:01:43.465 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.465 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.465 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:01:43.465 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:43.454906+0000", 2024-04-19T03:01:43.465 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000172435 2024-04-19T03:01:43.465 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.466 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.466 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-04-19T03:01:43.466 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:43.455066+0000", 2024-04-19T03:01:43.466 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000160106 2024-04-19T03:01:43.466 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:43.466 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:43.466 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:43.466 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.466 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.466 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4755.0:14762 5.b e26/22 5:d884bcc7:::benchmark_data_smithi096_19531_object14761:head v 26'946, mlcod=26'944)", 2024-04-19T03:01:43.466 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:43.454684+0000", 2024-04-19T03:01:43.466 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 0.0032308300000000001, 2024-04-19T03:01:43.466 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0033305460000000002, 2024-04-19T03:01:43.466 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:01:43.467 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "started", 2024-04-19T03:01:43.467 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:01:43.467 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.467 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:01:43.467 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:43.454684+0000", 2024-04-19T03:01:43.467 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:43.467 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.467 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.467 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:01:43.467 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:43.454684+0000", 2024-04-19T03:01:43.467 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:43.467 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.467 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.468 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:01:43.468 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:43.454683+0000", 2024-04-19T03:01:43.468 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2024-04-19T03:01:43.468 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.468 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.468 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:01:43.468 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:43.454774+0000", 2024-04-19T03:01:43.468 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.0891999999999996e-05 2024-04-19T03:01:43.468 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.468 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.468 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:01:43.468 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:43.454782+0000", 2024-04-19T03:01:43.468 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.5560000000000008e-06 2024-04-19T03:01:43.468 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.469 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.469 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:01:43.469 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:43.454795+0000", 2024-04-19T03:01:43.469 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2275e-05 2024-04-19T03:01:43.469 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.469 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.469 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:43.469 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:43.454830+0000", 2024-04-19T03:01:43.469 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.5515000000000001e-05 2024-04-19T03:01:43.469 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.469 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.469 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:01:43.469 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:43.454854+0000", 2024-04-19T03:01:43.470 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.4003e-05 2024-04-19T03:01:43.470 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:43.470 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:43.470 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:43.470 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.470 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.470 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4755.0:14766 5.c 5:3bc62af3:::benchmark_data_smithi096_19531_object14765:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T03:01:43.470 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:43.454692+0000", 2024-04-19T03:01:43.470 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 0.00322216, 2024-04-19T03:01:43.470 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0033850080000000001, 2024-04-19T03:01:43.470 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:01:43.470 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:01:43.470 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-04-19T03:01:43.470 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4755", 2024-04-19T03:01:43.471 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:43.471 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 14766 2024-04-19T03:01:43.471 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.471 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:01:43.471 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.471 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:01:43.471 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:43.454692+0000", 2024-04-19T03:01:43.471 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:43.471 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.471 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.471 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:01:43.471 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:43.454692+0000", 2024-04-19T03:01:43.471 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:43.471 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.472 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.472 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:01:43.472 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:43.454691+0000", 2024-04-19T03:01:43.472 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2024-04-19T03:01:43.472 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.472 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.472 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:01:43.472 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:43.454785+0000", 2024-04-19T03:01:43.472 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.3097000000000007e-05 2024-04-19T03:01:43.472 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.472 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.472 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:01:43.472 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:43.454793+0000", 2024-04-19T03:01:43.473 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.4160000000000004e-06 2024-04-19T03:01:43.473 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.473 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.473 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:01:43.473 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:43.454800+0000", 2024-04-19T03:01:43.473 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.0430000000000002e-06 2024-04-19T03:01:43.473 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.473 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.473 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:43.473 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:43.457559+0000", 2024-04-19T03:01:43.473 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0027593829999999998 2024-04-19T03:01:43.473 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.473 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.473 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:01:43.474 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:43.457699+0000", 2024-04-19T03:01:43.474 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000139927 2024-04-19T03:01:43.474 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.474 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.474 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-04-19T03:01:43.474 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:43.457864+0000", 2024-04-19T03:01:43.474 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00016469600000000001 2024-04-19T03:01:43.474 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:43.474 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:43.474 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:43.474 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.474 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.474 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4755.0:14768 5.5 5:af5d241f:::benchmark_data_smithi096_19531_object14767:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T03:01:43.475 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:43.454887+0000", 2024-04-19T03:01:43.475 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 0.0030277949999999998, 2024-04-19T03:01:43.475 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0032669460000000002, 2024-04-19T03:01:43.475 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:01:43.475 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:01:43.475 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-04-19T03:01:43.475 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4755", 2024-04-19T03:01:43.475 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:43.475 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 14768 2024-04-19T03:01:43.475 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.475 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:01:43.475 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.475 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:01:43.476 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:43.454887+0000", 2024-04-19T03:01:43.476 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:43.476 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.476 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.476 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:01:43.476 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:43.454887+0000", 2024-04-19T03:01:43.476 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:43.476 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.476 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.476 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:01:43.476 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:43.454886+0000", 2024-04-19T03:01:43.476 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2024-04-19T03:01:43.476 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.476 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.477 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:01:43.477 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:43.454918+0000", 2024-04-19T03:01:43.477 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.2459999999999998e-05 2024-04-19T03:01:43.477 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.477 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.477 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:01:43.477 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:43.454929+0000", 2024-04-19T03:01:43.477 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0738e-05 2024-04-19T03:01:43.477 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.477 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.477 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:01:43.477 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:43.454938+0000", 2024-04-19T03:01:43.477 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.5019999999999998e-06 2024-04-19T03:01:43.477 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.478 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.478 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:43.478 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:43.454999+0000", 2024-04-19T03:01:43.478 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.0124999999999998e-05 2024-04-19T03:01:43.478 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.478 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.478 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:01:43.478 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:43.455163+0000", 2024-04-19T03:01:43.478 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00016432999999999999 2024-04-19T03:01:43.478 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.478 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.478 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-04-19T03:01:43.478 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:43.455289+0000", 2024-04-19T03:01:43.479 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000126422 2024-04-19T03:01:43.479 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.479 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.479 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:01:43.479 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:43.457557+0000", 2024-04-19T03:01:43.479 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0022676369999999999 2024-04-19T03:01:43.479 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:43.479 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:43.479 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:43.479 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.479 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.479 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4755.0:14761 5.2 e26/22 5:4e1fe129:::benchmark_data_smithi096_19531_object14760:head v 26'899, mlcod=26'896)", 2024-04-19T03:01:43.479 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:43.455170+0000", 2024-04-19T03:01:43.479 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 0.0027442299999999998, 2024-04-19T03:01:43.480 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0030541510000000002, 2024-04-19T03:01:43.480 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:01:43.480 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "started", 2024-04-19T03:01:43.480 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:01:43.480 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.480 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:01:43.480 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:43.455170+0000", 2024-04-19T03:01:43.480 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:43.480 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.480 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.480 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:01:43.480 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:43.455170+0000", 2024-04-19T03:01:43.480 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:43.481 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.481 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.481 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:01:43.481 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:43.455170+0000", 2024-04-19T03:01:43.481 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999995 2024-04-19T03:01:43.481 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.481 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.481 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:01:43.481 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:43.455272+0000", 2024-04-19T03:01:43.481 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00010218200000000001 2024-04-19T03:01:43.481 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.481 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.481 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:01:43.481 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:43.455280+0000", 2024-04-19T03:01:43.482 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.3329999999999997e-06 2024-04-19T03:01:43.482 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.482 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.482 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:01:43.482 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:43.455287+0000", 2024-04-19T03:01:43.482 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.1639999999999998e-06 2024-04-19T03:01:43.482 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.482 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.482 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:43.482 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:43.455330+0000", 2024-04-19T03:01:43.482 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.3056999999999998e-05 2024-04-19T03:01:43.482 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.482 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.483 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:01:43.483 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:43.455351+0000", 2024-04-19T03:01:43.483 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.128e-05 2024-04-19T03:01:43.483 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:43.483 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:43.483 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:43.483 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.483 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.483 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4755.0:14769 5.e e26/22 5:74e42a14:::benchmark_data_smithi096_19531_object14768:head v 26'945, mlcod=26'943)", 2024-04-19T03:01:43.483 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:43.455957+0000", 2024-04-19T03:01:43.483 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 0.0019578159999999998, 2024-04-19T03:01:43.483 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.002320969, 2024-04-19T03:01:43.483 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:01:43.484 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "started", 2024-04-19T03:01:43.484 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:01:43.484 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.484 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:01:43.484 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:43.455957+0000", 2024-04-19T03:01:43.484 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:43.484 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.484 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.484 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:01:43.484 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:43.455957+0000", 2024-04-19T03:01:43.484 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:43.484 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.484 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.484 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:01:43.485 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:43.455956+0000", 2024-04-19T03:01:43.485 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999995 2024-04-19T03:01:43.485 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.485 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.485 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:01:43.485 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:43.456048+0000", 2024-04-19T03:01:43.485 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.2084999999999997e-05 2024-04-19T03:01:43.485 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.485 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.485 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:01:43.485 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:43.456067+0000", 2024-04-19T03:01:43.485 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.8766e-05 2024-04-19T03:01:43.485 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.485 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.486 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:01:43.486 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:43.456074+0000", 2024-04-19T03:01:43.486 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.9149999999999999e-06 2024-04-19T03:01:43.486 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.486 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.486 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:43.486 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:43.456114+0000", 2024-04-19T03:01:43.486 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.0333000000000002e-05 2024-04-19T03:01:43.486 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.486 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.486 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:01:43.486 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:43.456132+0000", 2024-04-19T03:01:43.486 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.8158000000000001e-05 2024-04-19T03:01:43.487 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:43.487 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:43.487 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:43.487 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.487 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.487 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4755.0:14763 5.b e26/22 5:df7f9968:::benchmark_data_smithi096_19531_object14762:head v 26'947, mlcod=26'944)", 2024-04-19T03:01:43.487 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:43.456096+0000", 2024-04-19T03:01:43.487 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 0.0018183769999999999, 2024-04-19T03:01:43.487 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0022344840000000001, 2024-04-19T03:01:43.487 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:01:43.487 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "started", 2024-04-19T03:01:43.487 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:01:43.487 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.487 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:01:43.487 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:43.456096+0000", 2024-04-19T03:01:43.488 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:43.488 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.488 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.488 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:01:43.488 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:43.456096+0000", 2024-04-19T03:01:43.488 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:43.488 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.488 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.488 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:01:43.488 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:43.456096+0000", 2024-04-19T03:01:43.488 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999995 2024-04-19T03:01:43.488 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.488 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.488 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:01:43.489 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:43.456273+0000", 2024-04-19T03:01:43.489 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00017740900000000001 2024-04-19T03:01:43.489 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.489 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.489 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:01:43.489 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:43.456283+0000", 2024-04-19T03:01:43.489 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0159e-05 2024-04-19T03:01:43.489 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.489 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.489 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:01:43.489 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:43.456289+0000", 2024-04-19T03:01:43.489 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.9569999999999999e-06 2024-04-19T03:01:43.489 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.489 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.489 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:43.490 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:43.456351+0000", 2024-04-19T03:01:43.490 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.1363000000000002e-05 2024-04-19T03:01:43.490 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.490 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.490 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:01:43.490 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:43.456373+0000", 2024-04-19T03:01:43.490 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.2546999999999999e-05 2024-04-19T03:01:43.490 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:43.490 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:43.490 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:43.490 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.490 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.490 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4755.0:14764 5.2 e26/22 5:4a409f7d:::benchmark_data_smithi096_19531_object14763:head v 26'900, mlcod=26'896)", 2024-04-19T03:01:43.491 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:43.456210+0000", 2024-04-19T03:01:43.491 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 0.0017048950000000001, 2024-04-19T03:01:43.491 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0021754819999999998, 2024-04-19T03:01:43.491 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:01:43.491 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "started", 2024-04-19T03:01:43.491 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:01:43.491 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.491 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:01:43.491 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:43.456210+0000", 2024-04-19T03:01:43.491 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:43.491 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.491 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.491 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:01:43.492 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:43.456210+0000", 2024-04-19T03:01:43.492 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:43.492 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.492 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.492 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:01:43.492 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:43.456209+0000", 2024-04-19T03:01:43.492 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999995 2024-04-19T03:01:43.492 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.492 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.492 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:01:43.492 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:43.456343+0000", 2024-04-19T03:01:43.492 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00013360499999999999 2024-04-19T03:01:43.492 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.492 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.493 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:01:43.493 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:43.456351+0000", 2024-04-19T03:01:43.493 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.3049999999999993e-06 2024-04-19T03:01:43.493 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.493 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.493 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:01:43.493 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:43.456356+0000", 2024-04-19T03:01:43.493 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.2349999999999999e-06 2024-04-19T03:01:43.493 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.493 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.493 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:43.493 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:43.456493+0000", 2024-04-19T03:01:43.493 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00013665300000000001 2024-04-19T03:01:43.493 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.494 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.494 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:01:43.494 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:43.456513+0000", 2024-04-19T03:01:43.494 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.0169e-05 2024-04-19T03:01:43.494 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:43.494 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:43.494 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:43.494 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.494 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.494 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4755.0:14774 5.a 5:53627c4f:::benchmark_data_smithi096_19531_object14773:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T03:01:43.494 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:43.456920+0000", 2024-04-19T03:01:43.494 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 0.00099501100000000007, 2024-04-19T03:01:43.494 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001524915, 2024-04-19T03:01:43.495 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:01:43.495 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:01:43.495 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-04-19T03:01:43.495 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4755", 2024-04-19T03:01:43.495 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:43.495 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 14774 2024-04-19T03:01:43.495 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.495 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:01:43.495 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.495 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:01:43.495 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:43.456920+0000", 2024-04-19T03:01:43.495 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:43.495 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.495 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.496 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:01:43.496 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:43.456920+0000", 2024-04-19T03:01:43.496 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:43.496 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.496 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.496 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:01:43.496 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:43.456918+0000", 2024-04-19T03:01:43.496 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999986 2024-04-19T03:01:43.496 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.496 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.496 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:01:43.496 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:43.456963+0000", 2024-04-19T03:01:43.496 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.4406999999999997e-05 2024-04-19T03:01:43.497 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.497 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.497 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:01:43.497 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:43.456993+0000", 2024-04-19T03:01:43.497 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0091e-05 2024-04-19T03:01:43.497 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.497 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.497 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:01:43.497 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:43.457004+0000", 2024-04-19T03:01:43.497 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1303e-05 2024-04-19T03:01:43.497 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.497 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.497 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:43.497 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:43.457058+0000", 2024-04-19T03:01:43.498 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.3429e-05 2024-04-19T03:01:43.498 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.498 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.498 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:01:43.498 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:43.457263+0000", 2024-04-19T03:01:43.498 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00020503700000000001 2024-04-19T03:01:43.498 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.498 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.498 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 1", 2024-04-19T03:01:43.498 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:43.457412+0000", 2024-04-19T03:01:43.498 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000149541 2024-04-19T03:01:43.498 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:43.498 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:43.499 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:43.499 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.499 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.499 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4755.0:14770 5.b e26/22 5:d682cabd:::benchmark_data_smithi096_19531_object14769:head v 26'948, mlcod=26'944)", 2024-04-19T03:01:43.499 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:43.457292+0000", 2024-04-19T03:01:43.499 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 0.00062216300000000001, 2024-04-19T03:01:43.499 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001218319, 2024-04-19T03:01:43.499 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:01:43.499 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "started", 2024-04-19T03:01:43.499 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:01:43.499 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.499 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:01:43.499 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:43.457292+0000", 2024-04-19T03:01:43.499 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:43.500 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.500 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.500 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:01:43.500 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:43.457292+0000", 2024-04-19T03:01:43.500 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:43.500 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.500 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.500 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:01:43.500 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:43.457292+0000", 2024-04-19T03:01:43.500 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2024-04-19T03:01:43.500 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.500 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.501 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:01:43.501 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:43.457353+0000", 2024-04-19T03:01:43.501 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.1544999999999994e-05 2024-04-19T03:01:43.501 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.501 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.501 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:01:43.501 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:43.457361+0000", 2024-04-19T03:01:43.501 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.4490000000000002e-06 2024-04-19T03:01:43.501 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.501 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.501 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:01:43.501 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:43.457365+0000", 2024-04-19T03:01:43.501 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.7450000000000003e-06 2024-04-19T03:01:43.502 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.502 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.502 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:43.502 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:43.457627+0000", 2024-04-19T03:01:43.502 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00026141100000000002 2024-04-19T03:01:43.502 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.502 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.502 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:01:43.502 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:43.457650+0000", 2024-04-19T03:01:43.502 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.2802e-05 2024-04-19T03:01:43.502 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:43.502 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:43.502 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:43.503 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.503 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.503 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop_reply(client.4755.0:14765 5.c e26/22)", 2024-04-19T03:01:43.503 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:43.457467+0000", 2024-04-19T03:01:43.504 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 0.00044736299999999999, 2024-04-19T03:01:43.504 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0010910469999999999, 2024-04-19T03:01:43.504 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:01:43.504 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "queued for pg", 2024-04-19T03:01:43.504 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:01:43.504 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.504 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:01:43.504 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:43.457467+0000", 2024-04-19T03:01:43.504 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:43.504 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.504 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.504 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:01:43.504 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:43.457467+0000", 2024-04-19T03:01:43.505 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:43.505 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.505 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.505 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:01:43.505 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:43.457467+0000", 2024-04-19T03:01:43.505 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999995 2024-04-19T03:01:43.505 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.505 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.505 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:01:43.505 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:43.457471+0000", 2024-04-19T03:01:43.505 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.5120000000000002e-06 2024-04-19T03:01:43.505 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.506 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.506 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:01:43.506 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:43.457487+0000", 2024-04-19T03:01:43.506 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.6096e-05 2024-04-19T03:01:43.506 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.506 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.506 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:01:43.506 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:43.457493+0000", 2024-04-19T03:01:43.506 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.9329999999999998e-06 2024-04-19T03:01:43.506 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:43.506 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:43.506 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:43.506 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.507 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.507 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4755.0:14767 5.2 e26/22 5:4c416fbb:::benchmark_data_smithi096_19531_object14766:head v 26'901, mlcod=26'896)", 2024-04-19T03:01:43.507 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:43.457748+0000", 2024-04-19T03:01:43.507 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 0.00016661399999999999, 2024-04-19T03:01:43.507 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00085803099999999998, 2024-04-19T03:01:43.507 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:01:43.507 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "started", 2024-04-19T03:01:43.507 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:01:43.507 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.507 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:01:43.507 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:43.457748+0000", 2024-04-19T03:01:43.507 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:43.507 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.508 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.508 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:01:43.508 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:43.457748+0000", 2024-04-19T03:01:43.508 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:43.508 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.508 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.508 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:01:43.508 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:43.457747+0000", 2024-04-19T03:01:43.508 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999995 2024-04-19T03:01:43.508 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.508 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.508 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:01:43.508 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:43.457791+0000", 2024-04-19T03:01:43.509 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.4263e-05 2024-04-19T03:01:43.509 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.509 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.509 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:01:43.509 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:43.457801+0000", 2024-04-19T03:01:43.509 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.5719999999999992e-06 2024-04-19T03:01:43.509 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.509 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.509 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:01:43.509 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:43.457808+0000", 2024-04-19T03:01:43.509 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.7789999999999998e-06 2024-04-19T03:01:43.509 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.509 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.509 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:43.509 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:43.457899+0000", 2024-04-19T03:01:43.510 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.1570999999999995e-05 2024-04-19T03:01:43.510 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.510 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.510 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:01:43.510 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:43.457959+0000", 2024-04-19T03:01:43.510 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.9608999999999998e-05 2024-04-19T03:01:43.510 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:43.510 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:43.510 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:43.510 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.510 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.510 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4755.0:14772 5.e e26/22 5:7ad967c6:::benchmark_data_smithi096_19531_object14771:head v 26'946, mlcod=26'943)", 2024-04-19T03:01:43.510 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:43.457961+0000", 2024-04-19T03:01:43.511 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 4294967295.9999533, 2024-04-19T03:01:43.511 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00070396100000000002, 2024-04-19T03:01:43.511 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:01:43.511 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "started", 2024-04-19T03:01:43.511 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:01:43.511 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.511 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:01:43.511 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:43.457961+0000", 2024-04-19T03:01:43.511 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:43.511 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.511 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.511 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:01:43.511 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:43.457961+0000", 2024-04-19T03:01:43.511 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:43.512 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.512 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.512 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:01:43.512 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:43.457961+0000", 2024-04-19T03:01:43.512 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2024-04-19T03:01:43.512 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.512 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.512 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:01:43.512 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:43.457999+0000", 2024-04-19T03:01:43.512 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.8902000000000001e-05 2024-04-19T03:01:43.512 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.512 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.512 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:01:43.512 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:43.458010+0000", 2024-04-19T03:01:43.513 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0219e-05 2024-04-19T03:01:43.513 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.513 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.513 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:01:43.513 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:43.458016+0000", 2024-04-19T03:01:43.513 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.7429999999999996e-06 2024-04-19T03:01:43.513 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.513 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.513 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:43.513 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:43.458060+0000", 2024-04-19T03:01:43.513 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.3578999999999997e-05 2024-04-19T03:01:43.513 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.513 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.514 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:01:43.514 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:43.458079+0000", 2024-04-19T03:01:43.514 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.8842e-05 2024-04-19T03:01:43.514 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:43.514 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:43.514 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:43.514 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.514 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.514 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4755.0:14752 5.c 5:3c7e542e:::benchmark_data_smithi096_19531_object14751:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T03:01:43.514 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:43.450696+0000", 2024-04-19T03:01:43.514 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 0.0072189730000000001, 2024-04-19T03:01:43.514 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0080406980000000006, 2024-04-19T03:01:43.514 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:01:43.515 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:01:43.515 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-04-19T03:01:43.515 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4755", 2024-04-19T03:01:43.515 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:43.515 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 14752 2024-04-19T03:01:43.515 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.515 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:01:43.515 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.515 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:01:43.515 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:43.450696+0000", 2024-04-19T03:01:43.515 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:43.515 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.515 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.515 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:01:43.516 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:43.450696+0000", 2024-04-19T03:01:43.516 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:43.516 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.516 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.516 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:01:43.516 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:43.450695+0000", 2024-04-19T03:01:43.516 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2024-04-19T03:01:43.516 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.516 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.516 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:01:43.516 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:43.450751+0000", 2024-04-19T03:01:43.516 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.6268999999999999e-05 2024-04-19T03:01:43.516 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.516 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.517 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:01:43.517 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:43.450759+0000", 2024-04-19T03:01:43.517 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.9249999999999995e-06 2024-04-19T03:01:43.517 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.517 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.517 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:01:43.517 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:43.450764+0000", 2024-04-19T03:01:43.517 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.5119999999999999e-06 2024-04-19T03:01:43.517 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.517 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.517 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:43.517 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:43.450814+0000", 2024-04-19T03:01:43.517 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.9339999999999999e-05 2024-04-19T03:01:43.517 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.518 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.518 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:01:43.518 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:43.450995+0000", 2024-04-19T03:01:43.518 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00018168000000000001 2024-04-19T03:01:43.518 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.518 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.518 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-04-19T03:01:43.518 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:43.451120+0000", 2024-04-19T03:01:43.518 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000124449 2024-04-19T03:01:43.518 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.518 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.518 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:43.518 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:43.453936+0000", 2024-04-19T03:01:43.518 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.002815892 2024-04-19T03:01:43.519 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:43.519 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:43.519 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:43.519 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:43.519 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2024-04-19T03:01:43.519 INFO:teuthology.orchestra.run.smithi097.stdout: "num_ops": 14 2024-04-19T03:01:43.519 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-04-19T03:01:43.520 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T03:01:43.527 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-04-19T03:01:43.521+0000 7f35986ab700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18243) UID: 0 2024-04-19T03:01:43.628 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:01:43.625+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:01:43.656 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-04-19T03:01:43.657 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [], 2024-04-19T03:01:43.657 INFO:teuthology.orchestra.run.smithi097.stdout: "complaint_time": 30, 2024-04-19T03:01:43.657 INFO:teuthology.orchestra.run.smithi097.stdout: "num_blocked_ops": 0 2024-04-19T03:01:43.657 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-04-19T03:01:43.670 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T03:01:43.730 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:01:43.728+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:01:43.797 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-19T03:01:43.809 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-04-19T03:01:43.809 INFO:teuthology.orchestra.run.smithi097.stdout: "size": 20, 2024-04-19T03:01:43.809 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 600, 2024-04-19T03:01:43.809 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [ 2024-04-19T03:01:43.809 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.809 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:01:43.809 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:14.996966+0000", 2024-04-19T03:01:43.810 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 28.807516645, 2024-04-19T03:01:43.810 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.018946704000000002, 2024-04-19T03:01:43.810 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:01:43.810 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:43.810 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:01:43.810 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.810 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:01:43.810 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.996966+0000", 2024-04-19T03:01:43.810 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:43.810 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.810 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.810 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:01:43.811 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.996966+0000", 2024-04-19T03:01:43.811 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:43.811 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.811 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.811 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:01:43.811 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.996964+0000", 2024-04-19T03:01:43.811 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999971 2024-04-19T03:01:43.811 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.811 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.811 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:01:43.811 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.996982+0000", 2024-04-19T03:01:43.811 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.8306999999999999e-05 2024-04-19T03:01:43.811 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.811 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.812 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:01:43.812 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997027+0000", 2024-04-19T03:01:43.812 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.5274000000000001e-05 2024-04-19T03:01:43.812 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.812 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.812 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:01:43.812 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997047+0000", 2024-04-19T03:01:43.812 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.9726999999999999e-05 2024-04-19T03:01:43.812 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.812 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.812 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:43.812 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997203+0000", 2024-04-19T03:01:43.812 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000155847 2024-04-19T03:01:43.812 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.813 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.813 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op must wait for map", 2024-04-19T03:01:43.813 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997249+0000", 2024-04-19T03:01:43.813 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.5824e-05 2024-04-19T03:01:43.813 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.813 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.813 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:43.813 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.007264+0000", 2024-04-19T03:01:43.813 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.010015909 2024-04-19T03:01:43.813 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.813 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.813 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:01:43.813 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.007394+0000", 2024-04-19T03:01:43.813 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012931999999999999 2024-04-19T03:01:43.814 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.814 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.814 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-04-19T03:01:43.814 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.007537+0000", 2024-04-19T03:01:43.814 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014365 2024-04-19T03:01:43.814 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.814 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.814 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:01:43.814 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.012444+0000", 2024-04-19T03:01:43.814 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0049067260000000001 2024-04-19T03:01:43.814 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.814 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.814 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:43.814 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.015791+0000", 2024-04-19T03:01:43.815 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0033471109999999998 2024-04-19T03:01:43.815 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.815 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.815 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:01:43.815 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.015845+0000", 2024-04-19T03:01:43.815 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.4236e-05 2024-04-19T03:01:43.815 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.815 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.815 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:01:43.815 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.015913+0000", 2024-04-19T03:01:43.815 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.7397000000000005e-05 2024-04-19T03:01:43.815 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:43.815 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:43.815 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:43.816 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.816 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.816 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(mds.0.3:14 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:01:43.816 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:14.997079+0000", 2024-04-19T03:01:43.816 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 28.807404061, 2024-04-19T03:01:43.816 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.021951970000000001, 2024-04-19T03:01:43.816 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:01:43.816 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:43.816 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:01:43.816 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.816 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:01:43.816 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997079+0000", 2024-04-19T03:01:43.816 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:43.816 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.817 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.817 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:01:43.817 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997079+0000", 2024-04-19T03:01:43.817 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:43.817 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.817 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.817 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:01:43.817 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997077+0000", 2024-04-19T03:01:43.817 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999986 2024-04-19T03:01:43.817 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.817 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.817 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:01:43.817 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997087+0000", 2024-04-19T03:01:43.817 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.006e-05 2024-04-19T03:01:43.818 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.818 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.818 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:01:43.818 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997105+0000", 2024-04-19T03:01:43.818 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.8026999999999999e-05 2024-04-19T03:01:43.818 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.818 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.818 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:01:43.818 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997135+0000", 2024-04-19T03:01:43.818 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.9643000000000001e-05 2024-04-19T03:01:43.818 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.818 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.818 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:43.818 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997208+0000", 2024-04-19T03:01:43.819 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.3419999999999998e-05 2024-04-19T03:01:43.819 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.819 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.819 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op must wait for map", 2024-04-19T03:01:43.819 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997244+0000", 2024-04-19T03:01:43.819 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.5367000000000002e-05 2024-04-19T03:01:43.819 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.819 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.819 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:43.819 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.007357+0000", 2024-04-19T03:01:43.819 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.010112703000000001 2024-04-19T03:01:43.819 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.819 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.819 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:01:43.820 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.007479+0000", 2024-04-19T03:01:43.820 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012279599999999999 2024-04-19T03:01:43.820 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.820 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.820 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 1", 2024-04-19T03:01:43.820 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.007610+0000", 2024-04-19T03:01:43.820 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00013093499999999999 2024-04-19T03:01:43.820 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.820 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.820 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:01:43.820 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.012526+0000", 2024-04-19T03:01:43.820 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0049157519999999998 2024-04-19T03:01:43.820 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.820 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.821 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:43.821 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.018959+0000", 2024-04-19T03:01:43.821 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0064326009999999996 2024-04-19T03:01:43.821 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.821 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.821 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:01:43.821 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.019005+0000", 2024-04-19T03:01:43.821 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.6066999999999998e-05 2024-04-19T03:01:43.821 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.821 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.821 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:01:43.821 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.019031+0000", 2024-04-19T03:01:43.821 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.6009000000000001e-05 2024-04-19T03:01:43.821 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:43.821 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:43.822 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:43.822 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.822 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.822 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:01:43.822 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:14.997149+0000", 2024-04-19T03:01:43.822 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 28.807333441000001, 2024-04-19T03:01:43.822 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.021805590999999999, 2024-04-19T03:01:43.822 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:01:43.822 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:43.822 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:01:43.822 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.822 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:01:43.822 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997149+0000", 2024-04-19T03:01:43.822 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:43.823 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.823 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.823 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:01:43.823 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997149+0000", 2024-04-19T03:01:43.823 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:43.823 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.823 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.823 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:01:43.823 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997148+0000", 2024-04-19T03:01:43.823 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2024-04-19T03:01:43.823 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.823 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.823 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:01:43.823 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997166+0000", 2024-04-19T03:01:43.824 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.8233e-05 2024-04-19T03:01:43.824 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.824 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.824 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:01:43.824 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997182+0000", 2024-04-19T03:01:43.824 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5999999999999999e-05 2024-04-19T03:01:43.824 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.824 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.824 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:01:43.824 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997195+0000", 2024-04-19T03:01:43.824 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.252e-05 2024-04-19T03:01:43.824 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.824 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.824 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:43.825 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997348+0000", 2024-04-19T03:01:43.825 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000153115 2024-04-19T03:01:43.825 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.825 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.825 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:01:43.825 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997354+0000", 2024-04-19T03:01:43.825 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.9359999999999996e-06 2024-04-19T03:01:43.825 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.825 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.825 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:43.825 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.008147+0000", 2024-04-19T03:01:43.825 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.010793127 2024-04-19T03:01:43.825 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.826 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.826 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:01:43.826 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.008225+0000", 2024-04-19T03:01:43.826 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.7935999999999994e-05 2024-04-19T03:01:43.826 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.826 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.826 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-04-19T03:01:43.826 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.008377+0000", 2024-04-19T03:01:43.826 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00015159099999999999 2024-04-19T03:01:43.826 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.826 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.826 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:01:43.827 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.012629+0000", 2024-04-19T03:01:43.827 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0042520420000000001 2024-04-19T03:01:43.827 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.827 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.827 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:43.827 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.018871+0000", 2024-04-19T03:01:43.827 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0062425060000000001 2024-04-19T03:01:43.827 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.827 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.827 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:01:43.827 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.018910+0000", 2024-04-19T03:01:43.827 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.8482999999999997e-05 2024-04-19T03:01:43.828 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.828 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.828 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:01:43.828 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.018955+0000", 2024-04-19T03:01:43.828 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.5252e-05 2024-04-19T03:01:43.828 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:43.828 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:43.828 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:43.828 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.828 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.828 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(mds.0.3:36 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:01:43.828 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:14.997207+0000", 2024-04-19T03:01:43.828 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 28.807275891, 2024-04-19T03:01:43.828 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.022210431999999999, 2024-04-19T03:01:43.829 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:01:43.829 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:43.829 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:01:43.829 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.829 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:01:43.829 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997207+0000", 2024-04-19T03:01:43.829 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:43.829 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.829 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.829 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:01:43.829 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997207+0000", 2024-04-19T03:01:43.829 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:43.829 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.829 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.830 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:01:43.830 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997206+0000", 2024-04-19T03:01:43.830 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2024-04-19T03:01:43.830 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.830 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.830 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:01:43.830 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997218+0000", 2024-04-19T03:01:43.830 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2607e-05 2024-04-19T03:01:43.830 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.830 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.830 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:01:43.830 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997234+0000", 2024-04-19T03:01:43.830 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5583999999999999e-05 2024-04-19T03:01:43.830 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.831 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.831 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:01:43.831 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997248+0000", 2024-04-19T03:01:43.831 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4270000000000001e-05 2024-04-19T03:01:43.831 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.831 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.831 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:43.831 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997397+0000", 2024-04-19T03:01:43.831 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0001482 2024-04-19T03:01:43.831 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.831 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.831 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:01:43.831 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997407+0000", 2024-04-19T03:01:43.832 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0944000000000001e-05 2024-04-19T03:01:43.832 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.832 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.832 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:43.832 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.008173+0000", 2024-04-19T03:01:43.832 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.010765378000000001 2024-04-19T03:01:43.832 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.832 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.832 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:01:43.832 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.008278+0000", 2024-04-19T03:01:43.832 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00010538 2024-04-19T03:01:43.832 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.832 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.832 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 1", 2024-04-19T03:01:43.832 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.008423+0000", 2024-04-19T03:01:43.833 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014525599999999999 2024-04-19T03:01:43.833 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.833 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.833 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:01:43.833 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.012734+0000", 2024-04-19T03:01:43.833 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0043108590000000002 2024-04-19T03:01:43.833 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.833 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.833 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:43.833 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.019318+0000", 2024-04-19T03:01:43.833 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0065836130000000003 2024-04-19T03:01:43.833 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.833 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.833 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:01:43.834 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.019382+0000", 2024-04-19T03:01:43.834 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.3925999999999997e-05 2024-04-19T03:01:43.834 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.834 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.834 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:01:43.834 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.019417+0000", 2024-04-19T03:01:43.834 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.5454999999999999e-05 2024-04-19T03:01:43.834 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:43.834 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:43.834 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:43.834 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.834 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.834 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(mds.0.3:15 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:01:43.834 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:14.997260+0000", 2024-04-19T03:01:43.835 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 28.80722274, 2024-04-19T03:01:43.835 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.021842842000000001, 2024-04-19T03:01:43.835 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:01:43.835 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:43.835 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:01:43.835 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.835 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:01:43.835 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997260+0000", 2024-04-19T03:01:43.835 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:43.835 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.835 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.835 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:01:43.835 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997260+0000", 2024-04-19T03:01:43.835 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:43.836 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.836 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.836 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:01:43.836 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997259+0000", 2024-04-19T03:01:43.836 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999995 2024-04-19T03:01:43.836 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.836 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.836 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:01:43.836 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997270+0000", 2024-04-19T03:01:43.836 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0312999999999999e-05 2024-04-19T03:01:43.837 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.837 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.837 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:01:43.837 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997279+0000", 2024-04-19T03:01:43.837 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.7770000000000008e-06 2024-04-19T03:01:43.837 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.837 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.837 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:01:43.837 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997286+0000", 2024-04-19T03:01:43.837 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.0129999999999996e-06 2024-04-19T03:01:43.838 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.838 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.838 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:43.838 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997433+0000", 2024-04-19T03:01:43.838 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014774699999999999 2024-04-19T03:01:43.838 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.838 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.838 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:01:43.838 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997443+0000", 2024-04-19T03:01:43.838 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.414e-06 2024-04-19T03:01:43.838 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.838 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.838 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:43.839 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.008673+0000", 2024-04-19T03:01:43.839 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.011230789999999999 2024-04-19T03:01:43.839 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.839 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.839 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:01:43.839 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.008808+0000", 2024-04-19T03:01:43.839 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000134346 2024-04-19T03:01:43.839 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.839 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.839 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-04-19T03:01:43.839 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.008922+0000", 2024-04-19T03:01:43.839 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000114444 2024-04-19T03:01:43.839 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.839 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.840 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:01:43.840 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.013442+0000", 2024-04-19T03:01:43.840 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0045193439999999998 2024-04-19T03:01:43.840 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.840 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.840 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:43.840 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.019005+0000", 2024-04-19T03:01:43.840 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00556333 2024-04-19T03:01:43.840 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.840 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.840 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:01:43.840 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.019049+0000", 2024-04-19T03:01:43.840 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.4240000000000003e-05 2024-04-19T03:01:43.840 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.841 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.841 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:01:43.841 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.019103+0000", 2024-04-19T03:01:43.841 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.3706999999999999e-05 2024-04-19T03:01:43.841 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:43.841 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:43.841 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:43.841 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.841 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.841 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(mds.0.3:17 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:01:43.841 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:14.997292+0000", 2024-04-19T03:01:43.841 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 28.807191013000001, 2024-04-19T03:01:43.841 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.019573165999999999, 2024-04-19T03:01:43.841 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:01:43.842 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:43.842 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:01:43.842 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.842 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:01:43.842 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997292+0000", 2024-04-19T03:01:43.842 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:43.842 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.842 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.842 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:01:43.842 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997292+0000", 2024-04-19T03:01:43.842 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:43.842 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.842 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.843 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:01:43.843 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997291+0000", 2024-04-19T03:01:43.843 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999995 2024-04-19T03:01:43.843 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.843 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.843 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:01:43.843 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997297+0000", 2024-04-19T03:01:43.843 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.3900000000000001e-06 2024-04-19T03:01:43.843 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.843 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.843 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:01:43.843 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997316+0000", 2024-04-19T03:01:43.843 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.9406e-05 2024-04-19T03:01:43.843 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.844 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.844 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:01:43.844 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997353+0000", 2024-04-19T03:01:43.844 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.6563999999999998e-05 2024-04-19T03:01:43.844 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.844 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.844 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:43.844 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997447+0000", 2024-04-19T03:01:43.844 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.4463999999999995e-05 2024-04-19T03:01:43.844 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.844 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.844 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op must wait for map", 2024-04-19T03:01:43.844 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997458+0000", 2024-04-19T03:01:43.844 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0817e-05 2024-04-19T03:01:43.845 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.845 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.845 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:43.845 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.002013+0000", 2024-04-19T03:01:43.845 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.004555229 2024-04-19T03:01:43.845 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.845 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.845 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:01:43.845 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.002943+0000", 2024-04-19T03:01:43.845 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00092983200000000001 2024-04-19T03:01:43.845 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.845 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.845 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-04-19T03:01:43.845 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.003257+0000", 2024-04-19T03:01:43.846 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00031455399999999998 2024-04-19T03:01:43.846 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.846 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.846 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:01:43.846 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.014107+0000", 2024-04-19T03:01:43.846 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.010849648 2024-04-19T03:01:43.846 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.846 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.846 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:43.846 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.016767+0000", 2024-04-19T03:01:43.846 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0026594990000000001 2024-04-19T03:01:43.846 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.846 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.846 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:01:43.847 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.016825+0000", 2024-04-19T03:01:43.847 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.8264000000000003e-05 2024-04-19T03:01:43.847 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.847 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.847 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:01:43.847 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.016865+0000", 2024-04-19T03:01:43.847 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.0108999999999998e-05 2024-04-19T03:01:43.847 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:43.847 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:43.847 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:43.847 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.847 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.847 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(mds.0.3:22 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:01:43.848 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:14.997383+0000", 2024-04-19T03:01:43.848 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 28.807100233, 2024-04-19T03:01:43.848 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.019634641000000001, 2024-04-19T03:01:43.848 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:01:43.848 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "started", 2024-04-19T03:01:43.848 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:01:43.848 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.848 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:01:43.848 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997383+0000", 2024-04-19T03:01:43.848 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:43.848 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.848 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.848 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:01:43.848 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997383+0000", 2024-04-19T03:01:43.848 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:43.849 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.849 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.849 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:01:43.849 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997381+0000", 2024-04-19T03:01:43.849 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999986 2024-04-19T03:01:43.849 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.849 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.849 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:01:43.849 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997399+0000", 2024-04-19T03:01:43.849 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.802e-05 2024-04-19T03:01:43.849 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.849 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.849 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:01:43.849 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997417+0000", 2024-04-19T03:01:43.850 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.7581e-05 2024-04-19T03:01:43.850 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.850 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.850 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:01:43.850 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997429+0000", 2024-04-19T03:01:43.850 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1803e-05 2024-04-19T03:01:43.850 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.850 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.850 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:43.850 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997540+0000", 2024-04-19T03:01:43.850 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000111397 2024-04-19T03:01:43.850 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.850 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.850 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:01:43.851 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997552+0000", 2024-04-19T03:01:43.851 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1643e-05 2024-04-19T03:01:43.851 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.851 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.851 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:43.851 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.006836+0000", 2024-04-19T03:01:43.851 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0092841940000000008 2024-04-19T03:01:43.851 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.851 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.851 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:01:43.851 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.006982+0000", 2024-04-19T03:01:43.851 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014572899999999999 2024-04-19T03:01:43.851 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.851 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.852 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:01:43.852 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.017017+0000", 2024-04-19T03:01:43.852 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.010035571 2024-04-19T03:01:43.852 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:43.852 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:43.852 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:43.852 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.852 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.852 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(mds.0.3:23 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:01:43.852 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:14.997449+0000", 2024-04-19T03:01:43.852 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 28.807033692000001, 2024-04-19T03:01:43.852 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.022679250000000001, 2024-04-19T03:01:43.852 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:01:43.853 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "started", 2024-04-19T03:01:43.853 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:01:43.853 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.853 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:01:43.853 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997449+0000", 2024-04-19T03:01:43.853 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:43.853 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.853 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.853 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:01:43.853 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997449+0000", 2024-04-19T03:01:43.853 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:43.853 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.853 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.853 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:01:43.853 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997448+0000", 2024-04-19T03:01:43.854 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999995 2024-04-19T03:01:43.854 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.854 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.854 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:01:43.854 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997452+0000", 2024-04-19T03:01:43.854 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.0369999999999996e-06 2024-04-19T03:01:43.854 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.854 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.854 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:01:43.854 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997461+0000", 2024-04-19T03:01:43.854 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.6100000000000006e-06 2024-04-19T03:01:43.854 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.854 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.854 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:01:43.855 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997468+0000", 2024-04-19T03:01:43.855 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.8360000000000003e-06 2024-04-19T03:01:43.855 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.855 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.855 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:43.855 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997546+0000", 2024-04-19T03:01:43.855 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.7956999999999999e-05 2024-04-19T03:01:43.855 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.855 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.855 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:01:43.855 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997555+0000", 2024-04-19T03:01:43.855 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.2269999999999999e-06 2024-04-19T03:01:43.855 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.855 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.856 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:43.856 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.010065+0000", 2024-04-19T03:01:43.856 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.012509457999999999 2024-04-19T03:01:43.856 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.856 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.856 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:01:43.856 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.010187+0000", 2024-04-19T03:01:43.856 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000122059 2024-04-19T03:01:43.856 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.856 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.856 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:01:43.856 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.020128+0000", 2024-04-19T03:01:43.856 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0099417529999999994 2024-04-19T03:01:43.856 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:43.857 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:43.857 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:43.857 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.857 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.857 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(mds.0.3:25 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:01:43.857 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:14.997485+0000", 2024-04-19T03:01:43.857 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 28.806998226000001, 2024-04-19T03:01:43.857 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.021633427, 2024-04-19T03:01:43.857 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:01:43.857 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "started", 2024-04-19T03:01:43.857 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:01:43.857 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.857 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:01:43.857 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997485+0000", 2024-04-19T03:01:43.857 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:43.858 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.858 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.858 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:01:43.858 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997485+0000", 2024-04-19T03:01:43.858 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:43.858 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.858 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.858 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:01:43.858 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997484+0000", 2024-04-19T03:01:43.858 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2024-04-19T03:01:43.858 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.858 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.858 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:01:43.859 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997490+0000", 2024-04-19T03:01:43.859 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.857e-06 2024-04-19T03:01:43.859 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.859 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.859 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:01:43.859 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997505+0000", 2024-04-19T03:01:43.859 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.518e-05 2024-04-19T03:01:43.859 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.859 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.859 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:01:43.859 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997520+0000", 2024-04-19T03:01:43.859 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5026e-05 2024-04-19T03:01:43.859 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.859 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.860 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:43.860 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997607+0000", 2024-04-19T03:01:43.860 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.7107000000000005e-05 2024-04-19T03:01:43.860 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.860 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.860 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op must wait for map", 2024-04-19T03:01:43.860 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997614+0000", 2024-04-19T03:01:43.860 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.0539999999999997e-06 2024-04-19T03:01:43.860 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.860 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.860 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:43.861 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.009808+0000", 2024-04-19T03:01:43.861 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.012194371000000001 2024-04-19T03:01:43.861 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.861 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.861 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:01:43.861 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.010107+0000", 2024-04-19T03:01:43.861 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000298731 2024-04-19T03:01:43.861 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.861 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.861 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:01:43.861 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.019118+0000", 2024-04-19T03:01:43.861 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0090109839999999997 2024-04-19T03:01:43.861 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:43.861 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:43.862 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:43.862 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.862 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.862 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4755.0:3803 5.6 5:678d4a6b:::benchmark_data_smithi096_19531_object3802:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-19T03:01:43.862 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:39.210318+0000", 2024-04-19T03:01:43.862 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 4.5941644940000002, 2024-04-19T03:01:43.862 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.013528874, 2024-04-19T03:01:43.862 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:01:43.862 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:43.862 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-04-19T03:01:43.862 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4755", 2024-04-19T03:01:43.862 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:43.862 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 3803 2024-04-19T03:01:43.862 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.863 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:01:43.863 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.863 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:01:43.863 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:39.210318+0000", 2024-04-19T03:01:43.863 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:43.863 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.863 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.863 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:01:43.863 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:39.210318+0000", 2024-04-19T03:01:43.863 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:43.863 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.863 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.863 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:01:43.863 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:39.210318+0000", 2024-04-19T03:01:43.864 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2024-04-19T03:01:43.864 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.864 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.864 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:01:43.864 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:39.210411+0000", 2024-04-19T03:01:43.864 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.2949999999999996e-05 2024-04-19T03:01:43.864 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.864 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.864 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:01:43.864 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:39.210423+0000", 2024-04-19T03:01:43.864 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2119e-05 2024-04-19T03:01:43.864 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.864 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.864 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:01:43.864 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:39.210429+0000", 2024-04-19T03:01:43.865 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.5409999999999997e-06 2024-04-19T03:01:43.865 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.865 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.865 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:43.865 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:39.210477+0000", 2024-04-19T03:01:43.865 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.7673999999999998e-05 2024-04-19T03:01:43.865 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.865 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.865 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:01:43.865 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:39.210609+0000", 2024-04-19T03:01:43.865 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00013191400000000001 2024-04-19T03:01:43.865 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.865 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.866 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-04-19T03:01:43.866 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:39.210755+0000", 2024-04-19T03:01:43.866 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014639699999999999 2024-04-19T03:01:43.866 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.866 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.866 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:01:43.866 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:39.215050+0000", 2024-04-19T03:01:43.866 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0042952060000000002 2024-04-19T03:01:43.866 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.866 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.866 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:43.867 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:39.223788+0000", 2024-04-19T03:01:43.867 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0087373529999999998 2024-04-19T03:01:43.867 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.867 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.867 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:01:43.867 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:39.223822+0000", 2024-04-19T03:01:43.867 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.4545000000000002e-05 2024-04-19T03:01:43.867 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.867 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.867 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:01:43.867 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:39.223847+0000", 2024-04-19T03:01:43.867 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.4899e-05 2024-04-19T03:01:43.867 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:43.867 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:43.868 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:43.868 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.868 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.868 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4755.0:3804 5.6 5:631563b7:::benchmark_data_smithi096_19531_object3803:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-19T03:01:43.868 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:39.211389+0000", 2024-04-19T03:01:43.868 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 4.5930938030000004, 2024-04-19T03:01:43.868 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.012667085999999999, 2024-04-19T03:01:43.868 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:01:43.868 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:43.868 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-04-19T03:01:43.868 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4755", 2024-04-19T03:01:43.868 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:43.868 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 3804 2024-04-19T03:01:43.869 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.869 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:01:43.869 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.869 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:01:43.869 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:39.211389+0000", 2024-04-19T03:01:43.869 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:43.869 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.869 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.869 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:01:43.869 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:39.211389+0000", 2024-04-19T03:01:43.869 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:43.869 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.869 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.870 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:01:43.870 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:39.211388+0000", 2024-04-19T03:01:43.870 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999986 2024-04-19T03:01:43.870 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.870 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.870 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:01:43.870 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:39.211460+0000", 2024-04-19T03:01:43.870 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.2653999999999999e-05 2024-04-19T03:01:43.870 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.870 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.870 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:01:43.870 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:39.211472+0000", 2024-04-19T03:01:43.870 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1549000000000001e-05 2024-04-19T03:01:43.870 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.871 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.871 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:01:43.871 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:39.211481+0000", 2024-04-19T03:01:43.871 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.6680000000000007e-06 2024-04-19T03:01:43.871 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.871 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.871 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:43.871 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:39.211711+0000", 2024-04-19T03:01:43.871 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00023037700000000001 2024-04-19T03:01:43.871 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.871 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.871 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:01:43.871 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:39.211817+0000", 2024-04-19T03:01:43.871 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000105524 2024-04-19T03:01:43.872 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.872 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.872 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-04-19T03:01:43.872 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:39.211899+0000", 2024-04-19T03:01:43.872 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.1926000000000001e-05 2024-04-19T03:01:43.872 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.872 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.872 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:01:43.872 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:39.215057+0000", 2024-04-19T03:01:43.872 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0031585279999999999 2024-04-19T03:01:43.872 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.872 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.872 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:43.872 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:39.223976+0000", 2024-04-19T03:01:43.873 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.008918469 2024-04-19T03:01:43.873 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.873 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.873 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:01:43.873 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:39.224017+0000", 2024-04-19T03:01:43.873 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.1652e-05 2024-04-19T03:01:43.873 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.873 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.873 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:01:43.873 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:39.224056+0000", 2024-04-19T03:01:43.873 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.8936000000000001e-05 2024-04-19T03:01:43.874 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:43.874 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:43.874 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:43.874 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.874 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.874 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4755.0:3805 5.6 5:67ca77e0:::benchmark_data_smithi096_19531_object3804:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-19T03:01:43.874 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:39.211489+0000", 2024-04-19T03:01:43.874 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 4.5929940970000001, 2024-04-19T03:01:43.874 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.012727723999999999, 2024-04-19T03:01:43.874 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:01:43.874 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:43.874 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-04-19T03:01:43.874 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4755", 2024-04-19T03:01:43.875 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:43.875 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 3805 2024-04-19T03:01:43.875 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.875 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:01:43.875 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.875 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:01:43.875 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:39.211489+0000", 2024-04-19T03:01:43.875 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:43.875 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.875 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.875 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:01:43.875 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:39.211489+0000", 2024-04-19T03:01:43.875 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:43.875 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.876 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.876 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:01:43.876 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:39.211488+0000", 2024-04-19T03:01:43.876 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999995 2024-04-19T03:01:43.876 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.876 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.876 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:01:43.876 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:39.211528+0000", 2024-04-19T03:01:43.876 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.9740000000000002e-05 2024-04-19T03:01:43.876 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.876 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.876 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:01:43.876 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:39.211536+0000", 2024-04-19T03:01:43.876 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.9130000000000003e-06 2024-04-19T03:01:43.877 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.877 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.877 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:01:43.877 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:39.211542+0000", 2024-04-19T03:01:43.877 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.8599999999999998e-06 2024-04-19T03:01:43.877 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.877 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.877 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:43.877 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:39.213004+0000", 2024-04-19T03:01:43.877 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0014621160000000001 2024-04-19T03:01:43.877 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.877 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.877 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:01:43.877 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:39.213139+0000", 2024-04-19T03:01:43.878 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00013563299999999999 2024-04-19T03:01:43.878 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.878 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.878 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-04-19T03:01:43.878 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:39.213227+0000", 2024-04-19T03:01:43.878 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.7322000000000002e-05 2024-04-19T03:01:43.878 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.878 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.878 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:01:43.878 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:39.215063+0000", 2024-04-19T03:01:43.878 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0018363629999999999 2024-04-19T03:01:43.878 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.878 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.878 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:43.879 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:39.224122+0000", 2024-04-19T03:01:43.879 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0090587979999999999 2024-04-19T03:01:43.879 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.879 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.879 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:01:43.879 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:39.224176+0000", 2024-04-19T03:01:43.879 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.4645999999999998e-05 2024-04-19T03:01:43.879 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.879 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.879 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:01:43.879 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:39.224216+0000", 2024-04-19T03:01:43.879 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.9956000000000002e-05 2024-04-19T03:01:43.879 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:43.880 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:43.880 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:43.880 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.880 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.880 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4755.0:11277 5.c 5:38c3ceb2:::benchmark_data_smithi096_19531_object11276:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T03:01:43.880 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:42.059676+0000", 2024-04-19T03:01:43.880 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 1.7448066039999999, 2024-04-19T03:01:43.880 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.029909680000000001, 2024-04-19T03:01:43.880 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:01:43.880 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:43.880 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-04-19T03:01:43.880 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4755", 2024-04-19T03:01:43.880 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:43.880 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 11277 2024-04-19T03:01:43.881 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.881 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:01:43.881 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.881 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:01:43.881 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.059676+0000", 2024-04-19T03:01:43.881 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:43.881 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.881 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.881 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:01:43.881 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.059676+0000", 2024-04-19T03:01:43.881 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:43.881 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.881 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.881 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:01:43.882 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.059665+0000", 2024-04-19T03:01:43.882 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999886 2024-04-19T03:01:43.882 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.882 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.882 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:01:43.882 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.059777+0000", 2024-04-19T03:01:43.882 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000111953 2024-04-19T03:01:43.882 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.882 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.882 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:01:43.882 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.059789+0000", 2024-04-19T03:01:43.882 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1809e-05 2024-04-19T03:01:43.882 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.883 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.883 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:01:43.883 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.059797+0000", 2024-04-19T03:01:43.883 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.2090000000000005e-06 2024-04-19T03:01:43.883 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.883 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.883 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:43.883 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.060528+0000", 2024-04-19T03:01:43.883 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00073144499999999995 2024-04-19T03:01:43.883 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.883 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.883 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:01:43.883 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.060662+0000", 2024-04-19T03:01:43.883 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000133435 2024-04-19T03:01:43.884 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.884 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.884 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-04-19T03:01:43.884 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.060766+0000", 2024-04-19T03:01:43.884 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00010473500000000001 2024-04-19T03:01:43.884 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.884 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.884 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:01:43.884 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.067649+0000", 2024-04-19T03:01:43.884 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.006882684 2024-04-19T03:01:43.884 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.884 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.884 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:43.884 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.089475+0000", 2024-04-19T03:01:43.885 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.021826196999999999 2024-04-19T03:01:43.885 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.885 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.885 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:01:43.885 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.089535+0000", 2024-04-19T03:01:43.885 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.9239e-05 2024-04-19T03:01:43.885 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.885 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.885 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:01:43.885 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.089586+0000", 2024-04-19T03:01:43.885 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.1288000000000001e-05 2024-04-19T03:01:43.885 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:43.885 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:43.885 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:43.885 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.886 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.886 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4755.0:11280 5.6 5:6e34f5e7:::benchmark_data_smithi096_19531_object11279:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T03:01:43.886 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:42.060002+0000", 2024-04-19T03:01:43.886 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 1.7444812280000002, 2024-04-19T03:01:43.886 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.028171841999999999, 2024-04-19T03:01:43.886 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:01:43.886 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:43.886 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-04-19T03:01:43.886 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4755", 2024-04-19T03:01:43.886 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:43.886 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 11280 2024-04-19T03:01:43.886 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.887 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:01:43.887 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.887 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:01:43.887 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.060002+0000", 2024-04-19T03:01:43.887 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:43.887 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.887 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.887 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:01:43.887 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.060002+0000", 2024-04-19T03:01:43.887 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:43.887 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.887 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.887 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:01:43.887 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.060000+0000", 2024-04-19T03:01:43.887 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2024-04-19T03:01:43.888 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.888 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.888 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:01:43.888 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.060120+0000", 2024-04-19T03:01:43.888 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00011941400000000001 2024-04-19T03:01:43.888 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.888 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.888 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:01:43.888 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.060132+0000", 2024-04-19T03:01:43.888 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2197e-05 2024-04-19T03:01:43.888 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.888 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.888 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:01:43.888 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.060141+0000", 2024-04-19T03:01:43.889 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.6829999999999997e-06 2024-04-19T03:01:43.889 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.889 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.889 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:43.889 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.060194+0000", 2024-04-19T03:01:43.889 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.3395e-05 2024-04-19T03:01:43.889 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.889 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.889 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:01:43.889 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.060333+0000", 2024-04-19T03:01:43.889 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00013935799999999999 2024-04-19T03:01:43.889 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.889 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.889 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-04-19T03:01:43.889 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.060477+0000", 2024-04-19T03:01:43.890 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000143938 2024-04-19T03:01:43.890 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.890 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.890 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:01:43.890 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.067752+0000", 2024-04-19T03:01:43.890 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0072741580000000002 2024-04-19T03:01:43.890 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.890 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.890 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:43.890 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.088041+0000", 2024-04-19T03:01:43.890 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.020288955000000001 2024-04-19T03:01:43.890 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.890 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.891 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:01:43.891 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.088113+0000", 2024-04-19T03:01:43.891 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.2492999999999999e-05 2024-04-19T03:01:43.891 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.891 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.891 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:01:43.891 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.088173+0000", 2024-04-19T03:01:43.891 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.0418999999999999e-05 2024-04-19T03:01:43.891 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:43.891 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:43.891 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:43.891 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.891 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.891 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4755.0:11274 5.e e26/22 5:7c846032:::benchmark_data_smithi096_19531_object11273:head v 26'697, mlcod=26'692)", 2024-04-19T03:01:43.892 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:42.065726+0000", 2024-04-19T03:01:43.892 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 1.738756701, 2024-04-19T03:01:43.892 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.028607227999999998, 2024-04-19T03:01:43.892 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:01:43.892 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:43.892 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:01:43.892 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.892 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:01:43.892 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.065726+0000", 2024-04-19T03:01:43.892 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:43.892 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.892 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.892 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:01:43.892 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.065726+0000", 2024-04-19T03:01:43.892 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:43.893 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.893 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.893 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:01:43.893 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.065725+0000", 2024-04-19T03:01:43.893 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2024-04-19T03:01:43.893 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.893 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.893 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:01:43.893 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.066818+0000", 2024-04-19T03:01:43.893 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0010930110000000001 2024-04-19T03:01:43.893 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.893 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.893 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:01:43.893 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.066826+0000", 2024-04-19T03:01:43.894 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.0609999999999996e-06 2024-04-19T03:01:43.894 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.894 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.894 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:01:43.894 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.066831+0000", 2024-04-19T03:01:43.894 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.7500000000000003e-06 2024-04-19T03:01:43.894 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.894 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.894 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:43.894 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.066857+0000", 2024-04-19T03:01:43.894 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.6126999999999999e-05 2024-04-19T03:01:43.894 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.894 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.895 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:01:43.895 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.066868+0000", 2024-04-19T03:01:43.895 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1113e-05 2024-04-19T03:01:43.895 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.895 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.895 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:01:43.895 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.094266+0000", 2024-04-19T03:01:43.895 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.027397731000000002 2024-04-19T03:01:43.895 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.895 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.895 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:01:43.895 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.094333+0000", 2024-04-19T03:01:43.895 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.7230000000000005e-05 2024-04-19T03:01:43.895 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:43.896 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:43.896 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:43.896 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.896 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.896 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4755.0:11279 5.8 e26/22 5:10b60c58:::benchmark_data_smithi096_19531_object11278:head v 26'723, mlcod=26'719)", 2024-04-19T03:01:43.896 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:42.066841+0000", 2024-04-19T03:01:43.896 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 1.737641386, 2024-04-19T03:01:43.896 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.021736267, 2024-04-19T03:01:43.896 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:01:43.896 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:43.896 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:01:43.896 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.896 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:01:43.896 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.066841+0000", 2024-04-19T03:01:43.896 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:43.897 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.897 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.897 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:01:43.897 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.066841+0000", 2024-04-19T03:01:43.897 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:43.897 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.897 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.897 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:01:43.897 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.066841+0000", 2024-04-19T03:01:43.897 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999995 2024-04-19T03:01:43.897 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.897 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.897 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:01:43.897 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.066876+0000", 2024-04-19T03:01:43.898 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.4790999999999999e-05 2024-04-19T03:01:43.898 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.898 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.898 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:01:43.898 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.066880+0000", 2024-04-19T03:01:43.898 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.3610000000000003e-06 2024-04-19T03:01:43.898 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.898 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.898 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:01:43.898 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.066883+0000", 2024-04-19T03:01:43.898 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.4079999999999998e-06 2024-04-19T03:01:43.898 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.898 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.898 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:43.899 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.066929+0000", 2024-04-19T03:01:43.899 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.5444000000000001e-05 2024-04-19T03:01:43.899 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.899 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.899 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:01:43.899 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.066951+0000", 2024-04-19T03:01:43.899 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.2578999999999998e-05 2024-04-19T03:01:43.899 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.899 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.899 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:01:43.899 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.088518+0000", 2024-04-19T03:01:43.899 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.021566617 2024-04-19T03:01:43.899 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.899 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.900 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:01:43.900 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.088578+0000", 2024-04-19T03:01:43.900 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.9655999999999999e-05 2024-04-19T03:01:43.900 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:43.900 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:43.900 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:43.900 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.900 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.900 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4755.0:11282 5.e e26/22 5:75b7c510:::benchmark_data_smithi096_19531_object11281:head v 26'698, mlcod=26'693)", 2024-04-19T03:01:43.900 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:42.066923+0000", 2024-04-19T03:01:43.900 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 1.7375595189999999, 2024-04-19T03:01:43.900 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.027436461999999998, 2024-04-19T03:01:43.900 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:01:43.900 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:43.901 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:01:43.901 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.901 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:01:43.901 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.066923+0000", 2024-04-19T03:01:43.901 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:43.901 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.901 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.901 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:01:43.901 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.066923+0000", 2024-04-19T03:01:43.901 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:43.901 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.901 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.901 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:01:43.901 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.066923+0000", 2024-04-19T03:01:43.901 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999995 2024-04-19T03:01:43.902 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.902 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.902 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:01:43.902 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.066955+0000", 2024-04-19T03:01:43.902 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.2060999999999997e-05 2024-04-19T03:01:43.902 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.902 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.902 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:01:43.902 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.066962+0000", 2024-04-19T03:01:43.902 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.1969999999999999e-06 2024-04-19T03:01:43.902 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.902 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.902 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:01:43.902 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.066967+0000", 2024-04-19T03:01:43.903 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.6589999999999998e-06 2024-04-19T03:01:43.903 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.903 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.903 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:43.903 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.067762+0000", 2024-04-19T03:01:43.903 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00079538199999999997 2024-04-19T03:01:43.903 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.903 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.903 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:01:43.903 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.067782+0000", 2024-04-19T03:01:43.903 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.9432999999999998e-05 2024-04-19T03:01:43.903 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.903 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.903 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:01:43.904 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.094339+0000", 2024-04-19T03:01:43.904 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.026556778999999999 2024-04-19T03:01:43.904 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.904 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.904 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:01:43.904 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.094360+0000", 2024-04-19T03:01:43.904 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.1246e-05 2024-04-19T03:01:43.904 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:43.904 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:43.904 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:43.904 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.904 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.904 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4755.0:11291 5.a 5:5ee9d828:::benchmark_data_smithi096_19531_object11290:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T03:01:43.904 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:42.067725+0000", 2024-04-19T03:01:43.905 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 1.736757409, 2024-04-19T03:01:43.905 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.021089111000000001, 2024-04-19T03:01:43.905 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:01:43.905 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:43.905 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-04-19T03:01:43.905 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4755", 2024-04-19T03:01:43.905 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:43.905 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 11291 2024-04-19T03:01:43.905 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.905 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:01:43.905 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.905 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:01:43.905 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.067725+0000", 2024-04-19T03:01:43.905 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:43.906 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.906 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.906 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:01:43.906 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.067725+0000", 2024-04-19T03:01:43.906 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:43.906 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.906 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.906 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:01:43.906 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.067724+0000", 2024-04-19T03:01:43.906 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2024-04-19T03:01:43.906 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.906 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.906 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:01:43.907 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.067842+0000", 2024-04-19T03:01:43.907 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000117691 2024-04-19T03:01:43.907 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.907 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.907 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:01:43.907 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.067853+0000", 2024-04-19T03:01:43.907 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0679000000000001e-05 2024-04-19T03:01:43.907 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.907 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.907 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:01:43.907 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.067859+0000", 2024-04-19T03:01:43.907 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.9510000000000003e-06 2024-04-19T03:01:43.907 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.907 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.908 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:43.908 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.067905+0000", 2024-04-19T03:01:43.908 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.6242999999999998e-05 2024-04-19T03:01:43.908 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.908 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.908 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:01:43.908 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.085335+0000", 2024-04-19T03:01:43.908 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.017430451 2024-04-19T03:01:43.908 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.908 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.908 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 1", 2024-04-19T03:01:43.908 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.085538+0000", 2024-04-19T03:01:43.908 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000202511 2024-04-19T03:01:43.908 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.909 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.909 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:43.909 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.087988+0000", 2024-04-19T03:01:43.909 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0024505780000000001 2024-04-19T03:01:43.909 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.909 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.909 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:01:43.909 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.088672+0000", 2024-04-19T03:01:43.909 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00068377900000000003 2024-04-19T03:01:43.909 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.909 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.909 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:01:43.910 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.088757+0000", 2024-04-19T03:01:43.910 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.4384999999999999e-05 2024-04-19T03:01:43.910 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.910 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.910 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:01:43.910 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.088815+0000", 2024-04-19T03:01:43.910 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.7995999999999998e-05 2024-04-19T03:01:43.910 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:43.910 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:43.910 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:43.910 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.911 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.911 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4755.0:11293 5.c 5:31728bfd:::benchmark_data_smithi096_19531_object11292:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T03:01:43.911 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:42.068359+0000", 2024-04-19T03:01:43.911 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 1.7361236949999999, 2024-04-19T03:01:43.911 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.022306475999999999, 2024-04-19T03:01:43.911 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:01:43.911 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:43.911 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-04-19T03:01:43.911 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4755", 2024-04-19T03:01:43.911 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:43.911 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 11293 2024-04-19T03:01:43.911 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.911 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:01:43.911 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.912 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:01:43.912 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.068359+0000", 2024-04-19T03:01:43.912 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:43.912 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.912 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.912 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:01:43.912 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.068359+0000", 2024-04-19T03:01:43.912 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:43.912 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.912 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.912 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:01:43.912 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.068358+0000", 2024-04-19T03:01:43.912 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2024-04-19T03:01:43.912 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.913 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.913 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:01:43.913 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.068427+0000", 2024-04-19T03:01:43.913 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.9139000000000003e-05 2024-04-19T03:01:43.913 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.913 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.913 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:01:43.913 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.085292+0000", 2024-04-19T03:01:43.913 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.016864371 2024-04-19T03:01:43.913 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.913 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.913 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:01:43.913 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.085306+0000", 2024-04-19T03:01:43.913 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.434e-05 2024-04-19T03:01:43.913 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.914 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.914 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:43.914 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.085404+0000", 2024-04-19T03:01:43.914 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.8145000000000003e-05 2024-04-19T03:01:43.914 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.914 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.914 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:01:43.914 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.085569+0000", 2024-04-19T03:01:43.914 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00016504099999999999 2024-04-19T03:01:43.914 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.914 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.914 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-04-19T03:01:43.914 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.085739+0000", 2024-04-19T03:01:43.915 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000170099 2024-04-19T03:01:43.915 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.915 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.915 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:01:43.915 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.089603+0000", 2024-04-19T03:01:43.915 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0038636080000000001 2024-04-19T03:01:43.915 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.915 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.915 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:43.915 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.090578+0000", 2024-04-19T03:01:43.915 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00097513199999999997 2024-04-19T03:01:43.915 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.915 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.915 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:01:43.916 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.090618+0000", 2024-04-19T03:01:43.916 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.9987999999999997e-05 2024-04-19T03:01:43.916 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.916 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.916 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:01:43.916 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.090666+0000", 2024-04-19T03:01:43.916 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.7420999999999999e-05 2024-04-19T03:01:43.916 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:43.916 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:43.916 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:43.916 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.916 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.916 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4755.0:11288 5.0 e26/22 5:042458d0:::benchmark_data_smithi096_19531_object11287:head v 26'772, mlcod=26'770)", 2024-04-19T03:01:43.916 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:42.068428+0000", 2024-04-19T03:01:43.917 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 1.736055294, 2024-04-19T03:01:43.917 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.020774925, 2024-04-19T03:01:43.917 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:01:43.917 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:43.917 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:01:43.917 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.917 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:01:43.917 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.068428+0000", 2024-04-19T03:01:43.917 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:43.917 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.917 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.917 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:01:43.917 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.068428+0000", 2024-04-19T03:01:43.917 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:43.918 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.918 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.918 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:01:43.918 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.068427+0000", 2024-04-19T03:01:43.918 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999995 2024-04-19T03:01:43.918 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.918 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.918 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:01:43.918 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.068481+0000", 2024-04-19T03:01:43.918 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.3866999999999998e-05 2024-04-19T03:01:43.918 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.918 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.918 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:01:43.918 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.085273+0000", 2024-04-19T03:01:43.919 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.016792372999999999 2024-04-19T03:01:43.919 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.919 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.919 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:01:43.919 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.085288+0000", 2024-04-19T03:01:43.919 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4941e-05 2024-04-19T03:01:43.919 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.919 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.919 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:43.919 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.085350+0000", 2024-04-19T03:01:43.919 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.1550999999999994e-05 2024-04-19T03:01:43.919 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.919 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.919 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:01:43.920 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.085384+0000", 2024-04-19T03:01:43.920 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.4915e-05 2024-04-19T03:01:43.920 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.920 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.920 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:01:43.920 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.089164+0000", 2024-04-19T03:01:43.920 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0037794410000000001 2024-04-19T03:01:43.920 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:43.920 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:43.920 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:01:43.920 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.089202+0000", 2024-04-19T03:01:43.920 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.8519000000000002e-05 2024-04-19T03:01:43.920 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:43.920 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:43.921 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:43.921 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:43.921 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:43.921 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-04-19T03:01:43.922 INFO:tasks.radosbench.radosbench.0.smithi096.stdout: 6 16 15678 15662 163.129 157.125 0.00668176 0.00612099 2024-04-19T03:01:43.922 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:01:43.917+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:01:43.923 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T03:01:44.023 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:01:44.021+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:01:44.046 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-19T03:01:44.047 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-04-19T03:01:44.047 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:44.047 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:16226 5.d 5:bca764f3:::benchmark_data_smithi096_19531_object16225:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T03:01:44.047 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:44.041489+0000", 2024-04-19T03:01:44.047 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0053734179999999996, 2024-04-19T03:01:44.047 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0053929959999999997, 2024-04-19T03:01:44.047 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:01:44.047 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:01:44.047 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:01:44.047 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:01:44.047 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:44.047 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 16226 2024-04-19T03:01:44.047 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:44.048 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:01:44.048 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:44.048 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:01:44.048 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:44.041489+0000", 2024-04-19T03:01:44.048 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:44.048 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:44.048 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:44.048 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:01:44.048 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:44.041489+0000", 2024-04-19T03:01:44.048 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:44.048 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:44.048 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:44.048 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:01:44.049 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:44.041488+0000", 2024-04-19T03:01:44.049 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:01:44.049 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:44.049 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:44.049 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:01:44.049 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:44.041581+0000", 2024-04-19T03:01:44.049 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.2307999999999998e-05 2024-04-19T03:01:44.049 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:44.049 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:44.049 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:01:44.049 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:44.041605+0000", 2024-04-19T03:01:44.049 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4658e-05 2024-04-19T03:01:44.049 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:44.049 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:44.050 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:01:44.050 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:44.041631+0000", 2024-04-19T03:01:44.050 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5738e-05 2024-04-19T03:01:44.050 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:44.050 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:44.050 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:44.050 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:44.041698+0000", 2024-04-19T03:01:44.050 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7051999999999994e-05 2024-04-19T03:01:44.050 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:44.051 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:44.051 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:01:44.051 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:44.041858+0000", 2024-04-19T03:01:44.051 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000160142 2024-04-19T03:01:44.051 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:44.051 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:44.051 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-04-19T03:01:44.051 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:44.041978+0000", 2024-04-19T03:01:44.051 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000120185 2024-04-19T03:01:44.051 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:44.051 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:44.051 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:01:44.051 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:44.043906+0000", 2024-04-19T03:01:44.051 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0019276849999999999 2024-04-19T03:01:44.052 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:44.052 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:01:44.052 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:44.052 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:44.052 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:44.052 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:16228 5.0 5:01be8336:::benchmark_data_smithi096_19531_object16227:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T03:01:44.052 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:44.041654+0000", 2024-04-19T03:01:44.052 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0052090590000000003, 2024-04-19T03:01:44.052 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0052769089999999998, 2024-04-19T03:01:44.052 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:01:44.052 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:01:44.052 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:01:44.052 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:01:44.053 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:44.053 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 16228 2024-04-19T03:01:44.053 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:44.053 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:01:44.053 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:44.053 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:01:44.053 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:44.041654+0000", 2024-04-19T03:01:44.053 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:44.053 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:44.053 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:44.053 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:01:44.053 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:44.041654+0000", 2024-04-19T03:01:44.053 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:44.054 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:44.054 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:44.054 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:01:44.054 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:44.041653+0000", 2024-04-19T03:01:44.054 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:01:44.054 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:44.054 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:44.054 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:01:44.054 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:44.041692+0000", 2024-04-19T03:01:44.054 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8992000000000002e-05 2024-04-19T03:01:44.054 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:44.054 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:44.054 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:01:44.055 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:44.041700+0000", 2024-04-19T03:01:44.055 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.055e-06 2024-04-19T03:01:44.055 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:44.055 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:44.055 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:01:44.055 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:44.041708+0000", 2024-04-19T03:01:44.055 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0390000000000005e-06 2024-04-19T03:01:44.055 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:44.055 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:44.055 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:44.055 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:44.042491+0000", 2024-04-19T03:01:44.055 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00078301900000000003 2024-04-19T03:01:44.055 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:44.056 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:44.056 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:01:44.056 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:44.042633+0000", 2024-04-19T03:01:44.056 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014178699999999999 2024-04-19T03:01:44.056 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:44.056 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:44.056 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:01:44.056 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:44.042820+0000", 2024-04-19T03:01:44.056 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00018699799999999999 2024-04-19T03:01:44.056 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:44.056 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:44.056 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:01:44.056 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:44.044873+0000", 2024-04-19T03:01:44.056 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0020533230000000001 2024-04-19T03:01:44.057 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:44.057 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:01:44.057 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:44.057 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:44.057 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:44.057 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:16237 5.8 5:1f31398f:::benchmark_data_smithi096_19531_object16236:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T03:01:44.057 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:44.044192+0000", 2024-04-19T03:01:44.057 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.002670221, 2024-04-19T03:01:44.057 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.002781277, 2024-04-19T03:01:44.057 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:01:44.057 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:01:44.057 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:01:44.057 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:01:44.057 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:44.058 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 16237 2024-04-19T03:01:44.058 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:44.058 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:01:44.058 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:44.058 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:01:44.058 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:44.044192+0000", 2024-04-19T03:01:44.058 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:44.058 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:44.058 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:44.058 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:01:44.058 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:44.044192+0000", 2024-04-19T03:01:44.058 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:44.058 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:44.059 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:44.059 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:01:44.059 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:44.044191+0000", 2024-04-19T03:01:44.059 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:01:44.059 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:44.059 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:44.059 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:01:44.059 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:44.044257+0000", 2024-04-19T03:01:44.059 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5346999999999996e-05 2024-04-19T03:01:44.059 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:44.059 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:44.059 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:01:44.059 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:44.044268+0000", 2024-04-19T03:01:44.060 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.095e-05 2024-04-19T03:01:44.060 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:44.060 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:44.060 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:01:44.060 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:44.044273+0000", 2024-04-19T03:01:44.060 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2839999999999997e-06 2024-04-19T03:01:44.060 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:44.060 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:44.060 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:44.060 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:44.044316+0000", 2024-04-19T03:01:44.060 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2635000000000001e-05 2024-04-19T03:01:44.060 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:44.060 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:44.060 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:01:44.061 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:44.044466+0000", 2024-04-19T03:01:44.061 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000150068 2024-04-19T03:01:44.061 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:44.061 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:44.061 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:01:44.061 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:44.044582+0000", 2024-04-19T03:01:44.061 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011668899999999999 2024-04-19T03:01:44.061 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:44.061 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:44.061 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:01:44.061 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:44.046019+0000", 2024-04-19T03:01:44.061 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001437006 2024-04-19T03:01:44.061 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:44.062 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:01:44.062 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:44.062 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:44.062 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:44.062 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:16239 5.4 5:218c4af7:::benchmark_data_smithi096_19531_object16238:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T03:01:44.062 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:44.044332+0000", 2024-04-19T03:01:44.062 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.002530806, 2024-04-19T03:01:44.062 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.002683534, 2024-04-19T03:01:44.062 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:01:44.062 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:01:44.062 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:01:44.062 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:01:44.063 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:44.063 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 16239 2024-04-19T03:01:44.063 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:44.063 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:01:44.063 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:44.063 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:01:44.063 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:44.044332+0000", 2024-04-19T03:01:44.063 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:44.063 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:44.063 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:44.063 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:01:44.063 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:44.044332+0000", 2024-04-19T03:01:44.063 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:44.063 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:44.064 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:44.064 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:01:44.064 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:44.044331+0000", 2024-04-19T03:01:44.064 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:01:44.064 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:44.064 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:44.064 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:01:44.064 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:44.044393+0000", 2024-04-19T03:01:44.064 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2571999999999997e-05 2024-04-19T03:01:44.064 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:44.064 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:44.064 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:01:44.064 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:44.044401+0000", 2024-04-19T03:01:44.064 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5009999999999998e-06 2024-04-19T03:01:44.065 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:44.065 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:44.065 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:01:44.065 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:44.044406+0000", 2024-04-19T03:01:44.065 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5790000000000003e-06 2024-04-19T03:01:44.065 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:44.065 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:44.065 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:44.065 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:44.044451+0000", 2024-04-19T03:01:44.065 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4765999999999998e-05 2024-04-19T03:01:44.065 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:44.065 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:44.065 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:01:44.066 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:44.044543+0000", 2024-04-19T03:01:44.066 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1799000000000007e-05 2024-04-19T03:01:44.066 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:44.066 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:44.066 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:01:44.066 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:44.044664+0000", 2024-04-19T03:01:44.066 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000120637 2024-04-19T03:01:44.066 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:44.066 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:44.066 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:01:44.066 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:44.046810+0000", 2024-04-19T03:01:44.066 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0021466189999999998 2024-04-19T03:01:44.066 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:44.066 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:01:44.067 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:44.067 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:44.067 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-04-19T03:01:44.067 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 4 2024-04-19T03:01:44.067 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-19T03:01:44.068 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T03:01:44.097 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-19T03:01:44.123 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:01:44.120+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:01:44.193 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-19T03:01:44.193 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-04-19T03:01:44.193 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-04-19T03:01:44.193 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-04-19T03:01:44.193 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-19T03:01:44.205 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T03:01:44.224 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:01:44.221+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:01:44.236 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0: {} 2024-04-19T03:01:44.256 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1: {} 2024-04-19T03:01:44.277 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2: {} 2024-04-19T03:01:44.279 INFO:teuthology.orchestra.run.smithi096.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T03:01:44.279 INFO:teuthology.orchestra.run.smithi096.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-19T03:01:44.279 INFO:teuthology.orchestra.run.smithi096.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-19T03:01:44.327 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:01:44.321+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:01:44.335 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-19T03:01:44.335 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:01:44.347 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T03:01:44.426 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:01:44.421+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:01:44.470 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-04-19T03:01:44.470 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:01:44.482 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T03:01:44.528 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:01:44.528+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:01:44.608 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-04-19T03:01:44.609 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:01:44.621 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T03:01:44.629 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:01:44.625+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:01:44.729 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-04-19T03:01:44.725+0000 7f35986ab700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18243) UID: 0 2024-04-19T03:01:44.752 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-04-19T03:01:44.752 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:01:44.764 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T03:01:44.820 INFO:tasks.radosbench.radosbench.0.smithi096.stdout: 7 16 18139 18123 161.796 153.812 0.00290018 0.00617318 2024-04-19T03:01:44.830 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:01:44.825+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:01:44.895 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-04-19T03:01:44.895 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:01:44.908 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T03:01:44.931 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-04-19T03:01:44.925+0000 7f35986ab700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18243) UID: 0 2024-04-19T03:01:45.033 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:01:45.032+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:01:45.033 INFO:teuthology.orchestra.run.smithi096.stderr:nodeep-scrub is unset 2024-04-19T03:01:45.039 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-04-19T03:01:45.039 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:01:45.051 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T03:01:45.133 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-04-19T03:01:45.129+0000 7f35986ab700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18243) UID: 0 2024-04-19T03:01:45.186 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-04-19T03:01:45.186 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:01:45.199 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T03:01:45.234 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-04-19T03:01:45.229+0000 7f35986ab700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18243) UID: 0 2024-04-19T03:01:45.330 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-19T03:01:45.330 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:01:45.335 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:01:45.332+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:01:45.343 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T03:01:45.436 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-04-19T03:01:45.433+0000 7f35986ab700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18243) UID: 0 2024-04-19T03:01:45.464 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-19T03:01:45.464 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:01:45.476 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T03:01:45.537 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:01:45.536+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:01:45.557 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-04-19T03:01:45.558 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-19T03:01:45.558 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap 2024-04-19T03:01:45.558 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-04-19T03:01:45.596 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-19T03:01:45.596 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:01:45.612 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T03:01:45.638 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-04-19T03:01:45.633+0000 7f35986ab700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18243) UID: 0 2024-04-19T03:01:45.739 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:01:45.736+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:01:45.740 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-04-19T03:01:45.740 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:01:45.753 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T03:01:45.820 INFO:tasks.radosbench.radosbench.0.smithi096.stdout: 8 16 20534 20518 160.28 149.688 0.00376992 0.00623077 2024-04-19T03:01:45.839 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-04-19T03:01:45.833+0000 7f35986ab700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18243) UID: 0 2024-04-19T03:01:45.867 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-19T03:01:45.867 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-04-19T03:01:45.868 INFO:teuthology.orchestra.run.smithi096.stdout: "epoch": 27, 2024-04-19T03:01:45.868 INFO:teuthology.orchestra.run.smithi096.stdout: "fsid": "c6cc8e09-11d4-48de-9a6c-4d70ed3c3789", 2024-04-19T03:01:45.868 INFO:teuthology.orchestra.run.smithi096.stdout: "created": "2024-04-19T03:00:53.746146+0000", 2024-04-19T03:01:45.868 INFO:teuthology.orchestra.run.smithi096.stdout: "modified": "2024-04-19T03:01:45.006275+0000", 2024-04-19T03:01:45.868 INFO:teuthology.orchestra.run.smithi096.stdout: "last_up_change": "2024-04-19T03:01:04.501086+0000", 2024-04-19T03:01:45.868 INFO:teuthology.orchestra.run.smithi096.stdout: "last_in_change": "2024-04-19T03:00:54.640172+0000", 2024-04-19T03:01:45.868 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-04-19T03:01:45.868 INFO:teuthology.orchestra.run.smithi096.stdout: "flags_num": 5799936, 2024-04-19T03:01:45.868 INFO:teuthology.orchestra.run.smithi096.stdout: "flags_set": [ 2024-04-19T03:01:45.868 INFO:teuthology.orchestra.run.smithi096.stdout: "pglog_hardlimit", 2024-04-19T03:01:45.868 INFO:teuthology.orchestra.run.smithi096.stdout: "purged_snapdirs", 2024-04-19T03:01:45.868 INFO:teuthology.orchestra.run.smithi096.stdout: "recovery_deletes", 2024-04-19T03:01:45.868 INFO:teuthology.orchestra.run.smithi096.stdout: "sortbitwise" 2024-04-19T03:01:45.869 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-19T03:01:45.869 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_version": 5, 2024-04-19T03:01:45.869 INFO:teuthology.orchestra.run.smithi096.stdout: "full_ratio": 0.94999998807907104, 2024-04-19T03:01:45.869 INFO:teuthology.orchestra.run.smithi096.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-04-19T03:01:45.869 INFO:teuthology.orchestra.run.smithi096.stdout: "nearfull_ratio": 0.85000002384185791, 2024-04-19T03:01:45.869 INFO:teuthology.orchestra.run.smithi096.stdout: "cluster_snapshot": "", 2024-04-19T03:01:45.869 INFO:teuthology.orchestra.run.smithi096.stdout: "pool_max": 5, 2024-04-19T03:01:45.869 INFO:teuthology.orchestra.run.smithi096.stdout: "max_osd": 3, 2024-04-19T03:01:45.869 INFO:teuthology.orchestra.run.smithi096.stdout: "require_min_compat_client": "luminous", 2024-04-19T03:01:45.869 INFO:teuthology.orchestra.run.smithi096.stdout: "min_compat_client": "jewel", 2024-04-19T03:01:45.869 INFO:teuthology.orchestra.run.smithi096.stdout: "require_osd_release": "reef", 2024-04-19T03:01:45.869 INFO:teuthology.orchestra.run.smithi096.stdout: "allow_crimson": false, 2024-04-19T03:01:45.869 INFO:teuthology.orchestra.run.smithi096.stdout: "pools": [ 2024-04-19T03:01:45.869 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-19T03:01:45.870 INFO:teuthology.orchestra.run.smithi096.stdout: "pool": 1, 2024-04-19T03:01:45.870 INFO:teuthology.orchestra.run.smithi096.stdout: "pool_name": ".mgr", 2024-04-19T03:01:45.870 INFO:teuthology.orchestra.run.smithi096.stdout: "create_time": "2024-04-19T03:01:05.999591+0000", 2024-04-19T03:01:45.870 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-19T03:01:45.870 INFO:teuthology.orchestra.run.smithi096.stdout: "flags_names": "hashpspool", 2024-04-19T03:01:45.870 INFO:teuthology.orchestra.run.smithi096.stdout: "type": 1, 2024-04-19T03:01:45.870 INFO:teuthology.orchestra.run.smithi096.stdout: "size": 2, 2024-04-19T03:01:45.870 INFO:teuthology.orchestra.run.smithi096.stdout: "min_size": 1, 2024-04-19T03:01:45.870 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_rule": 0, 2024-04-19T03:01:45.870 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_count": 0, 2024-04-19T03:01:45.870 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_target": 0, 2024-04-19T03:01:45.870 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_barrier": 0, 2024-04-19T03:01:45.871 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-19T03:01:45.871 INFO:teuthology.orchestra.run.smithi096.stdout: "object_hash": 2, 2024-04-19T03:01:45.871 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_autoscale_mode": "off", 2024-04-19T03:01:45.871 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num": 1, 2024-04-19T03:01:45.871 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_placement_num": 1, 2024-04-19T03:01:45.871 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_placement_num_target": 1, 2024-04-19T03:01:45.871 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num_target": 1, 2024-04-19T03:01:45.871 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num_pending": 1, 2024-04-19T03:01:45.871 INFO:teuthology.orchestra.run.smithi096.stdout: "last_pg_merge_meta": { 2024-04-19T03:01:45.871 INFO:teuthology.orchestra.run.smithi096.stdout: "source_pgid": "0.0", 2024-04-19T03:01:45.871 INFO:teuthology.orchestra.run.smithi096.stdout: "ready_epoch": 0, 2024-04-19T03:01:45.871 INFO:teuthology.orchestra.run.smithi096.stdout: "last_epoch_started": 0, 2024-04-19T03:01:45.871 INFO:teuthology.orchestra.run.smithi096.stdout: "last_epoch_clean": 0, 2024-04-19T03:01:45.871 INFO:teuthology.orchestra.run.smithi096.stdout: "source_version": "0'0", 2024-04-19T03:01:45.872 INFO:teuthology.orchestra.run.smithi096.stdout: "target_version": "0'0" 2024-04-19T03:01:45.872 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-19T03:01:45.872 INFO:teuthology.orchestra.run.smithi096.stdout: "last_change": "14", 2024-04-19T03:01:45.872 INFO:teuthology.orchestra.run.smithi096.stdout: "last_force_op_resend": "0", 2024-04-19T03:01:45.872 INFO:teuthology.orchestra.run.smithi096.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-19T03:01:45.872 INFO:teuthology.orchestra.run.smithi096.stdout: "last_force_op_resend_preluminous": "0", 2024-04-19T03:01:45.872 INFO:teuthology.orchestra.run.smithi096.stdout: "auid": 0, 2024-04-19T03:01:45.872 INFO:teuthology.orchestra.run.smithi096.stdout: "snap_mode": "selfmanaged", 2024-04-19T03:01:45.872 INFO:teuthology.orchestra.run.smithi096.stdout: "snap_seq": 0, 2024-04-19T03:01:45.872 INFO:teuthology.orchestra.run.smithi096.stdout: "snap_epoch": 0, 2024-04-19T03:01:45.872 INFO:teuthology.orchestra.run.smithi096.stdout: "pool_snaps": [], 2024-04-19T03:01:45.872 INFO:teuthology.orchestra.run.smithi096.stdout: "removed_snaps": "[]", 2024-04-19T03:01:45.872 INFO:teuthology.orchestra.run.smithi096.stdout: "quota_max_bytes": 0, 2024-04-19T03:01:45.873 INFO:teuthology.orchestra.run.smithi096.stdout: "quota_max_objects": 0, 2024-04-19T03:01:45.873 INFO:teuthology.orchestra.run.smithi096.stdout: "tiers": [], 2024-04-19T03:01:45.873 INFO:teuthology.orchestra.run.smithi096.stdout: "tier_of": -1, 2024-04-19T03:01:45.873 INFO:teuthology.orchestra.run.smithi096.stdout: "read_tier": -1, 2024-04-19T03:01:45.873 INFO:teuthology.orchestra.run.smithi096.stdout: "write_tier": -1, 2024-04-19T03:01:45.873 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_mode": "none", 2024-04-19T03:01:45.873 INFO:teuthology.orchestra.run.smithi096.stdout: "target_max_bytes": 0, 2024-04-19T03:01:45.873 INFO:teuthology.orchestra.run.smithi096.stdout: "target_max_objects": 0, 2024-04-19T03:01:45.873 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-19T03:01:45.873 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-19T03:01:45.873 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-19T03:01:45.873 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_min_flush_age": 0, 2024-04-19T03:01:45.874 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_min_evict_age": 0, 2024-04-19T03:01:45.874 INFO:teuthology.orchestra.run.smithi096.stdout: "erasure_code_profile": "", 2024-04-19T03:01:45.874 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_params": { 2024-04-19T03:01:45.874 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "none" 2024-04-19T03:01:45.874 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-19T03:01:45.874 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_period": 0, 2024-04-19T03:01:45.874 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_count": 0, 2024-04-19T03:01:45.874 INFO:teuthology.orchestra.run.smithi096.stdout: "use_gmt_hitset": true, 2024-04-19T03:01:45.874 INFO:teuthology.orchestra.run.smithi096.stdout: "min_read_recency_for_promote": 0, 2024-04-19T03:01:45.874 INFO:teuthology.orchestra.run.smithi096.stdout: "min_write_recency_for_promote": 0, 2024-04-19T03:01:45.874 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_grade_decay_rate": 0, 2024-04-19T03:01:45.874 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_search_last_n": 0, 2024-04-19T03:01:45.875 INFO:teuthology.orchestra.run.smithi096.stdout: "grade_table": [], 2024-04-19T03:01:45.875 INFO:teuthology.orchestra.run.smithi096.stdout: "stripe_width": 0, 2024-04-19T03:01:45.875 INFO:teuthology.orchestra.run.smithi096.stdout: "expected_num_objects": 0, 2024-04-19T03:01:45.875 INFO:teuthology.orchestra.run.smithi096.stdout: "fast_read": false, 2024-04-19T03:01:45.875 INFO:teuthology.orchestra.run.smithi096.stdout: "options": { 2024-04-19T03:01:45.875 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num_max": 32, 2024-04-19T03:01:45.875 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num_min": 1 2024-04-19T03:01:45.875 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-19T03:01:45.875 INFO:teuthology.orchestra.run.smithi096.stdout: "application_metadata": { 2024-04-19T03:01:45.875 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": {} 2024-04-19T03:01:45.875 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-19T03:01:45.875 INFO:teuthology.orchestra.run.smithi096.stdout: "read_balance": { 2024-04-19T03:01:45.875 INFO:teuthology.orchestra.run.smithi096.stdout: "score_acting": 2.9900000095367432, 2024-04-19T03:01:45.876 INFO:teuthology.orchestra.run.smithi096.stdout: "score_stable": 2.9900000095367432, 2024-04-19T03:01:45.876 INFO:teuthology.orchestra.run.smithi096.stdout: "optimal_score": 0.67000001668930054, 2024-04-19T03:01:45.876 INFO:teuthology.orchestra.run.smithi096.stdout: "raw_score_acting": 2, 2024-04-19T03:01:45.876 INFO:teuthology.orchestra.run.smithi096.stdout: "raw_score_stable": 2, 2024-04-19T03:01:45.876 INFO:teuthology.orchestra.run.smithi096.stdout: "primary_affinity_weighted": 1, 2024-04-19T03:01:45.876 INFO:teuthology.orchestra.run.smithi096.stdout: "average_primary_affinity": 1, 2024-04-19T03:01:45.876 INFO:teuthology.orchestra.run.smithi096.stdout: "average_primary_affinity_weighted": 1 2024-04-19T03:01:45.876 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-19T03:01:45.876 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-19T03:01:45.876 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-19T03:01:45.876 INFO:teuthology.orchestra.run.smithi096.stdout: "pool": 2, 2024-04-19T03:01:45.876 INFO:teuthology.orchestra.run.smithi096.stdout: "pool_name": "rbd", 2024-04-19T03:01:45.876 INFO:teuthology.orchestra.run.smithi096.stdout: "create_time": "2024-04-19T03:01:09.051757+0000", 2024-04-19T03:01:45.877 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-19T03:01:45.877 INFO:teuthology.orchestra.run.smithi096.stdout: "flags_names": "hashpspool", 2024-04-19T03:01:45.877 INFO:teuthology.orchestra.run.smithi096.stdout: "type": 1, 2024-04-19T03:01:45.877 INFO:teuthology.orchestra.run.smithi096.stdout: "size": 2, 2024-04-19T03:01:45.877 INFO:teuthology.orchestra.run.smithi096.stdout: "min_size": 1, 2024-04-19T03:01:45.877 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_rule": 0, 2024-04-19T03:01:45.877 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_count": 0, 2024-04-19T03:01:45.877 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_target": 0, 2024-04-19T03:01:45.877 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_barrier": 0, 2024-04-19T03:01:45.877 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-19T03:01:45.877 INFO:teuthology.orchestra.run.smithi096.stdout: "object_hash": 2, 2024-04-19T03:01:45.877 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_autoscale_mode": "off", 2024-04-19T03:01:45.877 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num": 8, 2024-04-19T03:01:45.878 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_placement_num": 8, 2024-04-19T03:01:45.878 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_placement_num_target": 8, 2024-04-19T03:01:45.878 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num_target": 8, 2024-04-19T03:01:45.878 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num_pending": 8, 2024-04-19T03:01:45.878 INFO:teuthology.orchestra.run.smithi096.stdout: "last_pg_merge_meta": { 2024-04-19T03:01:45.878 INFO:teuthology.orchestra.run.smithi096.stdout: "source_pgid": "0.0", 2024-04-19T03:01:45.878 INFO:teuthology.orchestra.run.smithi096.stdout: "ready_epoch": 0, 2024-04-19T03:01:45.878 INFO:teuthology.orchestra.run.smithi096.stdout: "last_epoch_started": 0, 2024-04-19T03:01:45.878 INFO:teuthology.orchestra.run.smithi096.stdout: "last_epoch_clean": 0, 2024-04-19T03:01:45.878 INFO:teuthology.orchestra.run.smithi096.stdout: "source_version": "0'0", 2024-04-19T03:01:45.878 INFO:teuthology.orchestra.run.smithi096.stdout: "target_version": "0'0" 2024-04-19T03:01:45.878 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-19T03:01:45.878 INFO:teuthology.orchestra.run.smithi096.stdout: "last_change": "17", 2024-04-19T03:01:45.878 INFO:teuthology.orchestra.run.smithi096.stdout: "last_force_op_resend": "0", 2024-04-19T03:01:45.879 INFO:teuthology.orchestra.run.smithi096.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-19T03:01:45.879 INFO:teuthology.orchestra.run.smithi096.stdout: "last_force_op_resend_preluminous": "0", 2024-04-19T03:01:45.879 INFO:teuthology.orchestra.run.smithi096.stdout: "auid": 0, 2024-04-19T03:01:45.879 INFO:teuthology.orchestra.run.smithi096.stdout: "snap_mode": "selfmanaged", 2024-04-19T03:01:45.879 INFO:teuthology.orchestra.run.smithi096.stdout: "snap_seq": 0, 2024-04-19T03:01:45.879 INFO:teuthology.orchestra.run.smithi096.stdout: "snap_epoch": 0, 2024-04-19T03:01:45.879 INFO:teuthology.orchestra.run.smithi096.stdout: "pool_snaps": [], 2024-04-19T03:01:45.879 INFO:teuthology.orchestra.run.smithi096.stdout: "removed_snaps": "[]", 2024-04-19T03:01:45.879 INFO:teuthology.orchestra.run.smithi096.stdout: "quota_max_bytes": 0, 2024-04-19T03:01:45.879 INFO:teuthology.orchestra.run.smithi096.stdout: "quota_max_objects": 0, 2024-04-19T03:01:45.879 INFO:teuthology.orchestra.run.smithi096.stdout: "tiers": [], 2024-04-19T03:01:45.879 INFO:teuthology.orchestra.run.smithi096.stdout: "tier_of": -1, 2024-04-19T03:01:45.879 INFO:teuthology.orchestra.run.smithi096.stdout: "read_tier": -1, 2024-04-19T03:01:45.880 INFO:teuthology.orchestra.run.smithi096.stdout: "write_tier": -1, 2024-04-19T03:01:45.880 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_mode": "none", 2024-04-19T03:01:45.880 INFO:teuthology.orchestra.run.smithi096.stdout: "target_max_bytes": 0, 2024-04-19T03:01:45.880 INFO:teuthology.orchestra.run.smithi096.stdout: "target_max_objects": 0, 2024-04-19T03:01:45.880 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-19T03:01:45.880 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-19T03:01:45.880 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-19T03:01:45.880 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_min_flush_age": 0, 2024-04-19T03:01:45.880 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_min_evict_age": 0, 2024-04-19T03:01:45.880 INFO:teuthology.orchestra.run.smithi096.stdout: "erasure_code_profile": "", 2024-04-19T03:01:45.880 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_params": { 2024-04-19T03:01:45.880 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "none" 2024-04-19T03:01:45.880 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-19T03:01:45.881 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_period": 0, 2024-04-19T03:01:45.881 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_count": 0, 2024-04-19T03:01:45.881 INFO:teuthology.orchestra.run.smithi096.stdout: "use_gmt_hitset": true, 2024-04-19T03:01:45.881 INFO:teuthology.orchestra.run.smithi096.stdout: "min_read_recency_for_promote": 0, 2024-04-19T03:01:45.881 INFO:teuthology.orchestra.run.smithi096.stdout: "min_write_recency_for_promote": 0, 2024-04-19T03:01:45.881 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_grade_decay_rate": 0, 2024-04-19T03:01:45.881 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_search_last_n": 0, 2024-04-19T03:01:45.881 INFO:teuthology.orchestra.run.smithi096.stdout: "grade_table": [], 2024-04-19T03:01:45.881 INFO:teuthology.orchestra.run.smithi096.stdout: "stripe_width": 0, 2024-04-19T03:01:45.881 INFO:teuthology.orchestra.run.smithi096.stdout: "expected_num_objects": 0, 2024-04-19T03:01:45.881 INFO:teuthology.orchestra.run.smithi096.stdout: "fast_read": false, 2024-04-19T03:01:45.881 INFO:teuthology.orchestra.run.smithi096.stdout: "options": {}, 2024-04-19T03:01:45.881 INFO:teuthology.orchestra.run.smithi096.stdout: "application_metadata": { 2024-04-19T03:01:45.882 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd": {} 2024-04-19T03:01:45.882 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-19T03:01:45.882 INFO:teuthology.orchestra.run.smithi096.stdout: "read_balance": { 2024-04-19T03:01:45.882 INFO:teuthology.orchestra.run.smithi096.stdout: "score_acting": 1.5, 2024-04-19T03:01:45.882 INFO:teuthology.orchestra.run.smithi096.stdout: "score_stable": 1.5, 2024-04-19T03:01:45.882 INFO:teuthology.orchestra.run.smithi096.stdout: "optimal_score": 1, 2024-04-19T03:01:45.882 INFO:teuthology.orchestra.run.smithi096.stdout: "raw_score_acting": 1.5, 2024-04-19T03:01:45.882 INFO:teuthology.orchestra.run.smithi096.stdout: "raw_score_stable": 1.5, 2024-04-19T03:01:45.882 INFO:teuthology.orchestra.run.smithi096.stdout: "primary_affinity_weighted": 1, 2024-04-19T03:01:45.882 INFO:teuthology.orchestra.run.smithi096.stdout: "average_primary_affinity": 1, 2024-04-19T03:01:45.882 INFO:teuthology.orchestra.run.smithi096.stdout: "average_primary_affinity_weighted": 1 2024-04-19T03:01:45.883 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-19T03:01:45.883 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-19T03:01:45.883 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-19T03:01:45.883 INFO:teuthology.orchestra.run.smithi096.stdout: "pool": 3, 2024-04-19T03:01:45.883 INFO:teuthology.orchestra.run.smithi096.stdout: "pool_name": "cephfs_metadata", 2024-04-19T03:01:45.883 INFO:teuthology.orchestra.run.smithi096.stdout: "create_time": "2024-04-19T03:01:13.479163+0000", 2024-04-19T03:01:45.883 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-19T03:01:45.883 INFO:teuthology.orchestra.run.smithi096.stdout: "flags_names": "hashpspool", 2024-04-19T03:01:45.883 INFO:teuthology.orchestra.run.smithi096.stdout: "type": 1, 2024-04-19T03:01:45.883 INFO:teuthology.orchestra.run.smithi096.stdout: "size": 2, 2024-04-19T03:01:45.883 INFO:teuthology.orchestra.run.smithi096.stdout: "min_size": 1, 2024-04-19T03:01:45.883 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_rule": 0, 2024-04-19T03:01:45.883 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_count": 0, 2024-04-19T03:01:45.883 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_target": 0, 2024-04-19T03:01:45.884 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_barrier": 0, 2024-04-19T03:01:45.884 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-19T03:01:45.884 INFO:teuthology.orchestra.run.smithi096.stdout: "object_hash": 2, 2024-04-19T03:01:45.884 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_autoscale_mode": "off", 2024-04-19T03:01:45.884 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num": 32, 2024-04-19T03:01:45.884 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_placement_num": 32, 2024-04-19T03:01:45.884 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_placement_num_target": 32, 2024-04-19T03:01:45.884 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num_target": 32, 2024-04-19T03:01:45.884 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num_pending": 32, 2024-04-19T03:01:45.884 INFO:teuthology.orchestra.run.smithi096.stdout: "last_pg_merge_meta": { 2024-04-19T03:01:45.884 INFO:teuthology.orchestra.run.smithi096.stdout: "source_pgid": "0.0", 2024-04-19T03:01:45.884 INFO:teuthology.orchestra.run.smithi096.stdout: "ready_epoch": 0, 2024-04-19T03:01:45.884 INFO:teuthology.orchestra.run.smithi096.stdout: "last_epoch_started": 0, 2024-04-19T03:01:45.885 INFO:teuthology.orchestra.run.smithi096.stdout: "last_epoch_clean": 0, 2024-04-19T03:01:45.885 INFO:teuthology.orchestra.run.smithi096.stdout: "source_version": "0'0", 2024-04-19T03:01:45.885 INFO:teuthology.orchestra.run.smithi096.stdout: "target_version": "0'0" 2024-04-19T03:01:45.885 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-19T03:01:45.885 INFO:teuthology.orchestra.run.smithi096.stdout: "last_change": "20", 2024-04-19T03:01:45.885 INFO:teuthology.orchestra.run.smithi096.stdout: "last_force_op_resend": "0", 2024-04-19T03:01:45.885 INFO:teuthology.orchestra.run.smithi096.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-19T03:01:45.885 INFO:teuthology.orchestra.run.smithi096.stdout: "last_force_op_resend_preluminous": "0", 2024-04-19T03:01:45.885 INFO:teuthology.orchestra.run.smithi096.stdout: "auid": 0, 2024-04-19T03:01:45.885 INFO:teuthology.orchestra.run.smithi096.stdout: "snap_mode": "selfmanaged", 2024-04-19T03:01:45.885 INFO:teuthology.orchestra.run.smithi096.stdout: "snap_seq": 0, 2024-04-19T03:01:45.885 INFO:teuthology.orchestra.run.smithi096.stdout: "snap_epoch": 0, 2024-04-19T03:01:45.885 INFO:teuthology.orchestra.run.smithi096.stdout: "pool_snaps": [], 2024-04-19T03:01:45.886 INFO:teuthology.orchestra.run.smithi096.stdout: "removed_snaps": "[]", 2024-04-19T03:01:45.886 INFO:teuthology.orchestra.run.smithi096.stdout: "quota_max_bytes": 0, 2024-04-19T03:01:45.886 INFO:teuthology.orchestra.run.smithi096.stdout: "quota_max_objects": 0, 2024-04-19T03:01:45.886 INFO:teuthology.orchestra.run.smithi096.stdout: "tiers": [], 2024-04-19T03:01:45.886 INFO:teuthology.orchestra.run.smithi096.stdout: "tier_of": -1, 2024-04-19T03:01:45.886 INFO:teuthology.orchestra.run.smithi096.stdout: "read_tier": -1, 2024-04-19T03:01:45.886 INFO:teuthology.orchestra.run.smithi096.stdout: "write_tier": -1, 2024-04-19T03:01:45.886 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_mode": "none", 2024-04-19T03:01:45.886 INFO:teuthology.orchestra.run.smithi096.stdout: "target_max_bytes": 0, 2024-04-19T03:01:45.886 INFO:teuthology.orchestra.run.smithi096.stdout: "target_max_objects": 0, 2024-04-19T03:01:45.886 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-19T03:01:45.886 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-19T03:01:45.886 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-19T03:01:45.886 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_min_flush_age": 0, 2024-04-19T03:01:45.887 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_min_evict_age": 0, 2024-04-19T03:01:45.887 INFO:teuthology.orchestra.run.smithi096.stdout: "erasure_code_profile": "", 2024-04-19T03:01:45.887 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_params": { 2024-04-19T03:01:45.887 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "none" 2024-04-19T03:01:45.887 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-19T03:01:45.887 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_period": 0, 2024-04-19T03:01:45.887 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_count": 0, 2024-04-19T03:01:45.887 INFO:teuthology.orchestra.run.smithi096.stdout: "use_gmt_hitset": true, 2024-04-19T03:01:45.887 INFO:teuthology.orchestra.run.smithi096.stdout: "min_read_recency_for_promote": 0, 2024-04-19T03:01:45.887 INFO:teuthology.orchestra.run.smithi096.stdout: "min_write_recency_for_promote": 0, 2024-04-19T03:01:45.887 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_grade_decay_rate": 0, 2024-04-19T03:01:45.887 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_search_last_n": 0, 2024-04-19T03:01:45.887 INFO:teuthology.orchestra.run.smithi096.stdout: "grade_table": [], 2024-04-19T03:01:45.888 INFO:teuthology.orchestra.run.smithi096.stdout: "stripe_width": 0, 2024-04-19T03:01:45.888 INFO:teuthology.orchestra.run.smithi096.stdout: "expected_num_objects": 0, 2024-04-19T03:01:45.888 INFO:teuthology.orchestra.run.smithi096.stdout: "fast_read": false, 2024-04-19T03:01:45.888 INFO:teuthology.orchestra.run.smithi096.stdout: "options": { 2024-04-19T03:01:45.888 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_autoscale_bias": 4, 2024-04-19T03:01:45.888 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num_min": 16, 2024-04-19T03:01:45.888 INFO:teuthology.orchestra.run.smithi096.stdout: "recovery_priority": 5 2024-04-19T03:01:45.888 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-19T03:01:45.888 INFO:teuthology.orchestra.run.smithi096.stdout: "application_metadata": { 2024-04-19T03:01:45.888 INFO:teuthology.orchestra.run.smithi096.stdout: "cephfs": { 2024-04-19T03:01:45.888 INFO:teuthology.orchestra.run.smithi096.stdout: "metadata": "cephfs" 2024-04-19T03:01:45.888 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-19T03:01:45.888 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-19T03:01:45.888 INFO:teuthology.orchestra.run.smithi096.stdout: "read_balance": { 2024-04-19T03:01:45.889 INFO:teuthology.orchestra.run.smithi096.stdout: "score_acting": 1.1299999952316284, 2024-04-19T03:01:45.889 INFO:teuthology.orchestra.run.smithi096.stdout: "score_stable": 1.1299999952316284, 2024-04-19T03:01:45.889 INFO:teuthology.orchestra.run.smithi096.stdout: "optimal_score": 1, 2024-04-19T03:01:45.889 INFO:teuthology.orchestra.run.smithi096.stdout: "raw_score_acting": 1.1299999952316284, 2024-04-19T03:01:45.889 INFO:teuthology.orchestra.run.smithi096.stdout: "raw_score_stable": 1.1299999952316284, 2024-04-19T03:01:45.889 INFO:teuthology.orchestra.run.smithi096.stdout: "primary_affinity_weighted": 1, 2024-04-19T03:01:45.889 INFO:teuthology.orchestra.run.smithi096.stdout: "average_primary_affinity": 1, 2024-04-19T03:01:45.889 INFO:teuthology.orchestra.run.smithi096.stdout: "average_primary_affinity_weighted": 1 2024-04-19T03:01:45.889 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-19T03:01:45.889 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-19T03:01:45.889 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-19T03:01:45.889 INFO:teuthology.orchestra.run.smithi096.stdout: "pool": 4, 2024-04-19T03:01:45.889 INFO:teuthology.orchestra.run.smithi096.stdout: "pool_name": "cephfs_data", 2024-04-19T03:01:45.889 INFO:teuthology.orchestra.run.smithi096.stdout: "create_time": "2024-04-19T03:01:13.992441+0000", 2024-04-19T03:01:45.890 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-19T03:01:45.890 INFO:teuthology.orchestra.run.smithi096.stdout: "flags_names": "hashpspool", 2024-04-19T03:01:45.890 INFO:teuthology.orchestra.run.smithi096.stdout: "type": 1, 2024-04-19T03:01:45.890 INFO:teuthology.orchestra.run.smithi096.stdout: "size": 2, 2024-04-19T03:01:45.890 INFO:teuthology.orchestra.run.smithi096.stdout: "min_size": 1, 2024-04-19T03:01:45.890 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_rule": 0, 2024-04-19T03:01:45.890 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_count": 0, 2024-04-19T03:01:45.890 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_target": 0, 2024-04-19T03:01:45.890 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_barrier": 0, 2024-04-19T03:01:45.890 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-19T03:01:45.890 INFO:teuthology.orchestra.run.smithi096.stdout: "object_hash": 2, 2024-04-19T03:01:45.890 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_autoscale_mode": "off", 2024-04-19T03:01:45.890 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num": 64, 2024-04-19T03:01:45.891 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_placement_num": 64, 2024-04-19T03:01:45.891 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_placement_num_target": 64, 2024-04-19T03:01:45.891 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num_target": 64, 2024-04-19T03:01:45.891 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num_pending": 64, 2024-04-19T03:01:45.891 INFO:teuthology.orchestra.run.smithi096.stdout: "last_pg_merge_meta": { 2024-04-19T03:01:45.891 INFO:teuthology.orchestra.run.smithi096.stdout: "source_pgid": "0.0", 2024-04-19T03:01:45.891 INFO:teuthology.orchestra.run.smithi096.stdout: "ready_epoch": 0, 2024-04-19T03:01:45.891 INFO:teuthology.orchestra.run.smithi096.stdout: "last_epoch_started": 0, 2024-04-19T03:01:45.891 INFO:teuthology.orchestra.run.smithi096.stdout: "last_epoch_clean": 0, 2024-04-19T03:01:45.891 INFO:teuthology.orchestra.run.smithi096.stdout: "source_version": "0'0", 2024-04-19T03:01:45.891 INFO:teuthology.orchestra.run.smithi096.stdout: "target_version": "0'0" 2024-04-19T03:01:45.891 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-19T03:01:45.891 INFO:teuthology.orchestra.run.smithi096.stdout: "last_change": "21", 2024-04-19T03:01:45.891 INFO:teuthology.orchestra.run.smithi096.stdout: "last_force_op_resend": "0", 2024-04-19T03:01:45.892 INFO:teuthology.orchestra.run.smithi096.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-19T03:01:45.892 INFO:teuthology.orchestra.run.smithi096.stdout: "last_force_op_resend_preluminous": "0", 2024-04-19T03:01:45.892 INFO:teuthology.orchestra.run.smithi096.stdout: "auid": 0, 2024-04-19T03:01:45.892 INFO:teuthology.orchestra.run.smithi096.stdout: "snap_mode": "selfmanaged", 2024-04-19T03:01:45.892 INFO:teuthology.orchestra.run.smithi096.stdout: "snap_seq": 0, 2024-04-19T03:01:45.892 INFO:teuthology.orchestra.run.smithi096.stdout: "snap_epoch": 0, 2024-04-19T03:01:45.892 INFO:teuthology.orchestra.run.smithi096.stdout: "pool_snaps": [], 2024-04-19T03:01:45.892 INFO:teuthology.orchestra.run.smithi096.stdout: "removed_snaps": "[]", 2024-04-19T03:01:45.892 INFO:teuthology.orchestra.run.smithi096.stdout: "quota_max_bytes": 0, 2024-04-19T03:01:45.892 INFO:teuthology.orchestra.run.smithi096.stdout: "quota_max_objects": 0, 2024-04-19T03:01:45.892 INFO:teuthology.orchestra.run.smithi096.stdout: "tiers": [], 2024-04-19T03:01:45.892 INFO:teuthology.orchestra.run.smithi096.stdout: "tier_of": -1, 2024-04-19T03:01:45.892 INFO:teuthology.orchestra.run.smithi096.stdout: "read_tier": -1, 2024-04-19T03:01:45.893 INFO:teuthology.orchestra.run.smithi096.stdout: "write_tier": -1, 2024-04-19T03:01:45.893 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_mode": "none", 2024-04-19T03:01:45.893 INFO:teuthology.orchestra.run.smithi096.stdout: "target_max_bytes": 0, 2024-04-19T03:01:45.893 INFO:teuthology.orchestra.run.smithi096.stdout: "target_max_objects": 0, 2024-04-19T03:01:45.893 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-19T03:01:45.893 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-19T03:01:45.893 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-19T03:01:45.893 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_min_flush_age": 0, 2024-04-19T03:01:45.893 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_min_evict_age": 0, 2024-04-19T03:01:45.893 INFO:teuthology.orchestra.run.smithi096.stdout: "erasure_code_profile": "", 2024-04-19T03:01:45.893 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_params": { 2024-04-19T03:01:45.893 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "none" 2024-04-19T03:01:45.893 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-19T03:01:45.893 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_period": 0, 2024-04-19T03:01:45.894 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_count": 0, 2024-04-19T03:01:45.894 INFO:teuthology.orchestra.run.smithi096.stdout: "use_gmt_hitset": true, 2024-04-19T03:01:45.894 INFO:teuthology.orchestra.run.smithi096.stdout: "min_read_recency_for_promote": 0, 2024-04-19T03:01:45.894 INFO:teuthology.orchestra.run.smithi096.stdout: "min_write_recency_for_promote": 0, 2024-04-19T03:01:45.894 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_grade_decay_rate": 0, 2024-04-19T03:01:45.894 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_search_last_n": 0, 2024-04-19T03:01:45.894 INFO:teuthology.orchestra.run.smithi096.stdout: "grade_table": [], 2024-04-19T03:01:45.894 INFO:teuthology.orchestra.run.smithi096.stdout: "stripe_width": 0, 2024-04-19T03:01:45.894 INFO:teuthology.orchestra.run.smithi096.stdout: "expected_num_objects": 0, 2024-04-19T03:01:45.894 INFO:teuthology.orchestra.run.smithi096.stdout: "fast_read": false, 2024-04-19T03:01:45.894 INFO:teuthology.orchestra.run.smithi096.stdout: "options": { 2024-04-19T03:01:45.894 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num_min": 64, 2024-04-19T03:01:45.894 INFO:teuthology.orchestra.run.smithi096.stdout: "target_size_ratio": 0.89999997615814209 2024-04-19T03:01:45.894 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-19T03:01:45.895 INFO:teuthology.orchestra.run.smithi096.stdout: "application_metadata": { 2024-04-19T03:01:45.895 INFO:teuthology.orchestra.run.smithi096.stdout: "cephfs": { 2024-04-19T03:01:45.895 INFO:teuthology.orchestra.run.smithi096.stdout: "data": "cephfs" 2024-04-19T03:01:45.895 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-19T03:01:45.895 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-19T03:01:45.895 INFO:teuthology.orchestra.run.smithi096.stdout: "read_balance": { 2024-04-19T03:01:45.895 INFO:teuthology.orchestra.run.smithi096.stdout: "score_acting": 1.1299999952316284, 2024-04-19T03:01:45.895 INFO:teuthology.orchestra.run.smithi096.stdout: "score_stable": 1.1299999952316284, 2024-04-19T03:01:45.895 INFO:teuthology.orchestra.run.smithi096.stdout: "optimal_score": 1, 2024-04-19T03:01:45.895 INFO:teuthology.orchestra.run.smithi096.stdout: "raw_score_acting": 1.1299999952316284, 2024-04-19T03:01:45.895 INFO:teuthology.orchestra.run.smithi096.stdout: "raw_score_stable": 1.1299999952316284, 2024-04-19T03:01:45.895 INFO:teuthology.orchestra.run.smithi096.stdout: "primary_affinity_weighted": 1, 2024-04-19T03:01:45.895 INFO:teuthology.orchestra.run.smithi096.stdout: "average_primary_affinity": 1, 2024-04-19T03:01:45.896 INFO:teuthology.orchestra.run.smithi096.stdout: "average_primary_affinity_weighted": 1 2024-04-19T03:01:45.896 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-19T03:01:45.896 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-19T03:01:45.896 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-19T03:01:45.896 INFO:teuthology.orchestra.run.smithi096.stdout: "pool": 5, 2024-04-19T03:01:45.896 INFO:teuthology.orchestra.run.smithi096.stdout: "pool_name": "unique_pool_0", 2024-04-19T03:01:45.896 INFO:teuthology.orchestra.run.smithi096.stdout: "create_time": "2024-04-19T03:01:35.396306+0000", 2024-04-19T03:01:45.896 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-19T03:01:45.896 INFO:teuthology.orchestra.run.smithi096.stdout: "flags_names": "hashpspool", 2024-04-19T03:01:45.896 INFO:teuthology.orchestra.run.smithi096.stdout: "type": 1, 2024-04-19T03:01:45.896 INFO:teuthology.orchestra.run.smithi096.stdout: "size": 2, 2024-04-19T03:01:45.896 INFO:teuthology.orchestra.run.smithi096.stdout: "min_size": 1, 2024-04-19T03:01:45.896 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_rule": 0, 2024-04-19T03:01:45.896 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_count": 0, 2024-04-19T03:01:45.897 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_target": 0, 2024-04-19T03:01:45.897 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_barrier": 0, 2024-04-19T03:01:45.897 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-19T03:01:45.897 INFO:teuthology.orchestra.run.smithi096.stdout: "object_hash": 2, 2024-04-19T03:01:45.897 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_autoscale_mode": "off", 2024-04-19T03:01:45.897 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num": 16, 2024-04-19T03:01:45.897 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_placement_num": 16, 2024-04-19T03:01:45.897 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_placement_num_target": 16, 2024-04-19T03:01:45.897 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num_target": 16, 2024-04-19T03:01:45.897 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num_pending": 16, 2024-04-19T03:01:45.897 INFO:teuthology.orchestra.run.smithi096.stdout: "last_pg_merge_meta": { 2024-04-19T03:01:45.897 INFO:teuthology.orchestra.run.smithi096.stdout: "source_pgid": "0.0", 2024-04-19T03:01:45.897 INFO:teuthology.orchestra.run.smithi096.stdout: "ready_epoch": 0, 2024-04-19T03:01:45.897 INFO:teuthology.orchestra.run.smithi096.stdout: "last_epoch_started": 0, 2024-04-19T03:01:45.898 INFO:teuthology.orchestra.run.smithi096.stdout: "last_epoch_clean": 0, 2024-04-19T03:01:45.898 INFO:teuthology.orchestra.run.smithi096.stdout: "source_version": "0'0", 2024-04-19T03:01:45.898 INFO:teuthology.orchestra.run.smithi096.stdout: "target_version": "0'0" 2024-04-19T03:01:45.898 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-19T03:01:45.898 INFO:teuthology.orchestra.run.smithi096.stdout: "last_change": "24", 2024-04-19T03:01:45.898 INFO:teuthology.orchestra.run.smithi096.stdout: "last_force_op_resend": "0", 2024-04-19T03:01:45.898 INFO:teuthology.orchestra.run.smithi096.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-19T03:01:45.898 INFO:teuthology.orchestra.run.smithi096.stdout: "last_force_op_resend_preluminous": "0", 2024-04-19T03:01:45.898 INFO:teuthology.orchestra.run.smithi096.stdout: "auid": 0, 2024-04-19T03:01:45.898 INFO:teuthology.orchestra.run.smithi096.stdout: "snap_mode": "selfmanaged", 2024-04-19T03:01:45.898 INFO:teuthology.orchestra.run.smithi096.stdout: "snap_seq": 0, 2024-04-19T03:01:45.898 INFO:teuthology.orchestra.run.smithi096.stdout: "snap_epoch": 0, 2024-04-19T03:01:45.898 INFO:teuthology.orchestra.run.smithi096.stdout: "pool_snaps": [], 2024-04-19T03:01:45.898 INFO:teuthology.orchestra.run.smithi096.stdout: "removed_snaps": "[]", 2024-04-19T03:01:45.899 INFO:teuthology.orchestra.run.smithi096.stdout: "quota_max_bytes": 0, 2024-04-19T03:01:45.899 INFO:teuthology.orchestra.run.smithi096.stdout: "quota_max_objects": 0, 2024-04-19T03:01:45.899 INFO:teuthology.orchestra.run.smithi096.stdout: "tiers": [], 2024-04-19T03:01:45.899 INFO:teuthology.orchestra.run.smithi096.stdout: "tier_of": -1, 2024-04-19T03:01:45.899 INFO:teuthology.orchestra.run.smithi096.stdout: "read_tier": -1, 2024-04-19T03:01:45.899 INFO:teuthology.orchestra.run.smithi096.stdout: "write_tier": -1, 2024-04-19T03:01:45.899 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_mode": "none", 2024-04-19T03:01:45.899 INFO:teuthology.orchestra.run.smithi096.stdout: "target_max_bytes": 0, 2024-04-19T03:01:45.899 INFO:teuthology.orchestra.run.smithi096.stdout: "target_max_objects": 0, 2024-04-19T03:01:45.899 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-19T03:01:45.899 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-19T03:01:45.899 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-19T03:01:45.899 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_min_flush_age": 0, 2024-04-19T03:01:45.899 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_min_evict_age": 0, 2024-04-19T03:01:45.900 INFO:teuthology.orchestra.run.smithi096.stdout: "erasure_code_profile": "", 2024-04-19T03:01:45.900 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_params": { 2024-04-19T03:01:45.900 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "none" 2024-04-19T03:01:45.900 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-19T03:01:45.900 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_period": 0, 2024-04-19T03:01:45.900 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_count": 0, 2024-04-19T03:01:45.900 INFO:teuthology.orchestra.run.smithi096.stdout: "use_gmt_hitset": true, 2024-04-19T03:01:45.900 INFO:teuthology.orchestra.run.smithi096.stdout: "min_read_recency_for_promote": 0, 2024-04-19T03:01:45.900 INFO:teuthology.orchestra.run.smithi096.stdout: "min_write_recency_for_promote": 0, 2024-04-19T03:01:45.900 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_grade_decay_rate": 0, 2024-04-19T03:01:45.900 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_search_last_n": 0, 2024-04-19T03:01:45.900 INFO:teuthology.orchestra.run.smithi096.stdout: "grade_table": [], 2024-04-19T03:01:45.900 INFO:teuthology.orchestra.run.smithi096.stdout: "stripe_width": 0, 2024-04-19T03:01:45.900 INFO:teuthology.orchestra.run.smithi096.stdout: "expected_num_objects": 0, 2024-04-19T03:01:45.901 INFO:teuthology.orchestra.run.smithi096.stdout: "fast_read": false, 2024-04-19T03:01:45.901 INFO:teuthology.orchestra.run.smithi096.stdout: "options": {}, 2024-04-19T03:01:45.901 INFO:teuthology.orchestra.run.smithi096.stdout: "application_metadata": { 2024-04-19T03:01:45.901 INFO:teuthology.orchestra.run.smithi096.stdout: "rados": {} 2024-04-19T03:01:45.901 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-19T03:01:45.901 INFO:teuthology.orchestra.run.smithi096.stdout: "read_balance": { 2024-04-19T03:01:45.901 INFO:teuthology.orchestra.run.smithi096.stdout: "score_acting": 1.1299999952316284, 2024-04-19T03:01:45.901 INFO:teuthology.orchestra.run.smithi096.stdout: "score_stable": 1.1299999952316284, 2024-04-19T03:01:45.901 INFO:teuthology.orchestra.run.smithi096.stdout: "optimal_score": 1, 2024-04-19T03:01:45.901 INFO:teuthology.orchestra.run.smithi096.stdout: "raw_score_acting": 1.1299999952316284, 2024-04-19T03:01:45.901 INFO:teuthology.orchestra.run.smithi096.stdout: "raw_score_stable": 1.1299999952316284, 2024-04-19T03:01:45.901 INFO:teuthology.orchestra.run.smithi096.stdout: "primary_affinity_weighted": 1, 2024-04-19T03:01:45.901 INFO:teuthology.orchestra.run.smithi096.stdout: "average_primary_affinity": 1, 2024-04-19T03:01:45.901 INFO:teuthology.orchestra.run.smithi096.stdout: "average_primary_affinity_weighted": 1 2024-04-19T03:01:45.901 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-19T03:01:45.902 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-19T03:01:45.902 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-19T03:01:45.902 INFO:teuthology.orchestra.run.smithi096.stdout: "osds": [ 2024-04-19T03:01:45.902 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-19T03:01:45.902 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": 0, 2024-04-19T03:01:45.902 INFO:teuthology.orchestra.run.smithi096.stdout: "uuid": "05ecb884-2c30-44f7-aa14-90154f9bbe9a", 2024-04-19T03:01:45.902 INFO:teuthology.orchestra.run.smithi096.stdout: "up": 1, 2024-04-19T03:01:45.902 INFO:teuthology.orchestra.run.smithi096.stdout: "in": 1, 2024-04-19T03:01:45.902 INFO:teuthology.orchestra.run.smithi096.stdout: "weight": 1, 2024-04-19T03:01:45.902 INFO:teuthology.orchestra.run.smithi096.stdout: "primary_affinity": 1, 2024-04-19T03:01:45.902 INFO:teuthology.orchestra.run.smithi096.stdout: "last_clean_begin": 0, 2024-04-19T03:01:45.902 INFO:teuthology.orchestra.run.smithi096.stdout: "last_clean_end": 0, 2024-04-19T03:01:45.902 INFO:teuthology.orchestra.run.smithi096.stdout: "up_from": 9, 2024-04-19T03:01:45.903 INFO:teuthology.orchestra.run.smithi096.stdout: "up_thru": 22, 2024-04-19T03:01:45.903 INFO:teuthology.orchestra.run.smithi096.stdout: "down_at": 0, 2024-04-19T03:01:45.903 INFO:teuthology.orchestra.run.smithi096.stdout: "lost_at": 0, 2024-04-19T03:01:45.903 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addrs": { 2024-04-19T03:01:45.903 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-19T03:01:45.903 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-19T03:01:45.903 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-19T03:01:45.903 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.97:6800", 2024-04-19T03:01:45.903 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 18245 2024-04-19T03:01:45.903 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-19T03:01:45.903 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-19T03:01:45.903 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-19T03:01:45.903 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.97:6801", 2024-04-19T03:01:45.903 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 18245 2024-04-19T03:01:45.904 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-19T03:01:45.904 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-19T03:01:45.904 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-19T03:01:45.904 INFO:teuthology.orchestra.run.smithi096.stdout: "cluster_addrs": { 2024-04-19T03:01:45.904 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-19T03:01:45.904 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-19T03:01:45.904 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-19T03:01:45.904 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.97:6802", 2024-04-19T03:01:45.904 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 18245 2024-04-19T03:01:45.904 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-19T03:01:45.904 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-19T03:01:45.904 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-19T03:01:45.904 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.97:6803", 2024-04-19T03:01:45.904 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 18245 2024-04-19T03:01:45.905 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-19T03:01:45.905 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-19T03:01:45.905 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-19T03:01:45.905 INFO:teuthology.orchestra.run.smithi096.stdout: "heartbeat_back_addrs": { 2024-04-19T03:01:45.905 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-19T03:01:45.905 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-19T03:01:45.905 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-19T03:01:45.905 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.97:6806", 2024-04-19T03:01:45.905 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 18245 2024-04-19T03:01:45.905 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-19T03:01:45.905 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-19T03:01:45.905 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-19T03:01:45.905 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.97:6807", 2024-04-19T03:01:45.905 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 18245 2024-04-19T03:01:45.906 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-19T03:01:45.906 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-19T03:01:45.906 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-19T03:01:45.906 INFO:teuthology.orchestra.run.smithi096.stdout: "heartbeat_front_addrs": { 2024-04-19T03:01:45.906 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-19T03:01:45.906 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-19T03:01:45.906 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-19T03:01:45.906 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.97:6804", 2024-04-19T03:01:45.906 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 18245 2024-04-19T03:01:45.906 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-19T03:01:45.906 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-19T03:01:45.906 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-19T03:01:45.906 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.97:6805", 2024-04-19T03:01:45.906 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 18245 2024-04-19T03:01:45.907 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-19T03:01:45.907 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-19T03:01:45.907 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-19T03:01:45.907 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addr": "172.21.15.97:6801/18245", 2024-04-19T03:01:45.907 INFO:teuthology.orchestra.run.smithi096.stdout: "cluster_addr": "172.21.15.97:6803/18245", 2024-04-19T03:01:45.907 INFO:teuthology.orchestra.run.smithi096.stdout: "heartbeat_back_addr": "172.21.15.97:6807/18245", 2024-04-19T03:01:45.907 INFO:teuthology.orchestra.run.smithi096.stdout: "heartbeat_front_addr": "172.21.15.97:6805/18245", 2024-04-19T03:01:45.907 INFO:teuthology.orchestra.run.smithi096.stdout: "state": [ 2024-04-19T03:01:45.907 INFO:teuthology.orchestra.run.smithi096.stdout: "exists", 2024-04-19T03:01:45.907 INFO:teuthology.orchestra.run.smithi096.stdout: "up" 2024-04-19T03:01:45.907 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-19T03:01:45.907 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-19T03:01:45.907 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-19T03:01:45.907 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": 1, 2024-04-19T03:01:45.908 INFO:teuthology.orchestra.run.smithi096.stdout: "uuid": "efc873e0-69c3-4a57-8ee5-41f836b65f47", 2024-04-19T03:01:45.908 INFO:teuthology.orchestra.run.smithi096.stdout: "up": 1, 2024-04-19T03:01:45.908 INFO:teuthology.orchestra.run.smithi096.stdout: "in": 1, 2024-04-19T03:01:45.908 INFO:teuthology.orchestra.run.smithi096.stdout: "weight": 1, 2024-04-19T03:01:45.908 INFO:teuthology.orchestra.run.smithi096.stdout: "primary_affinity": 1, 2024-04-19T03:01:45.908 INFO:teuthology.orchestra.run.smithi096.stdout: "last_clean_begin": 0, 2024-04-19T03:01:45.908 INFO:teuthology.orchestra.run.smithi096.stdout: "last_clean_end": 0, 2024-04-19T03:01:45.908 INFO:teuthology.orchestra.run.smithi096.stdout: "up_from": 10, 2024-04-19T03:01:45.908 INFO:teuthology.orchestra.run.smithi096.stdout: "up_thru": 22, 2024-04-19T03:01:45.908 INFO:teuthology.orchestra.run.smithi096.stdout: "down_at": 0, 2024-04-19T03:01:45.908 INFO:teuthology.orchestra.run.smithi096.stdout: "lost_at": 0, 2024-04-19T03:01:45.908 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addrs": { 2024-04-19T03:01:45.908 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-19T03:01:45.908 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-19T03:01:45.909 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-19T03:01:45.909 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.134:6800", 2024-04-19T03:01:45.909 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 18145 2024-04-19T03:01:45.909 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-19T03:01:45.909 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-19T03:01:45.909 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-19T03:01:45.909 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.134:6801", 2024-04-19T03:01:45.909 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 18145 2024-04-19T03:01:45.909 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-19T03:01:45.909 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-19T03:01:45.909 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-19T03:01:45.909 INFO:teuthology.orchestra.run.smithi096.stdout: "cluster_addrs": { 2024-04-19T03:01:45.909 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-19T03:01:45.909 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-19T03:01:45.910 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-19T03:01:45.910 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.134:6802", 2024-04-19T03:01:45.910 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 18145 2024-04-19T03:01:45.910 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-19T03:01:45.910 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-19T03:01:45.910 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-19T03:01:45.910 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.134:6803", 2024-04-19T03:01:45.910 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 18145 2024-04-19T03:01:45.910 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-19T03:01:45.911 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-19T03:01:45.911 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-19T03:01:45.911 INFO:teuthology.orchestra.run.smithi096.stdout: "heartbeat_back_addrs": { 2024-04-19T03:01:45.911 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-19T03:01:45.911 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-19T03:01:45.911 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-19T03:01:45.911 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.134:6806", 2024-04-19T03:01:45.911 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 18145 2024-04-19T03:01:45.911 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-19T03:01:45.911 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-19T03:01:45.911 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-19T03:01:45.911 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.134:6807", 2024-04-19T03:01:45.911 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 18145 2024-04-19T03:01:45.911 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-19T03:01:45.912 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-19T03:01:45.912 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-19T03:01:45.912 INFO:teuthology.orchestra.run.smithi096.stdout: "heartbeat_front_addrs": { 2024-04-19T03:01:45.912 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-19T03:01:45.912 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-19T03:01:45.912 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-19T03:01:45.912 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.134:6804", 2024-04-19T03:01:45.912 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 18145 2024-04-19T03:01:45.912 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-19T03:01:45.912 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-19T03:01:45.912 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-19T03:01:45.912 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.134:6805", 2024-04-19T03:01:45.913 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 18145 2024-04-19T03:01:45.913 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-19T03:01:45.913 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-19T03:01:45.913 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-19T03:01:45.913 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addr": "172.21.15.134:6801/18145", 2024-04-19T03:01:45.913 INFO:teuthology.orchestra.run.smithi096.stdout: "cluster_addr": "172.21.15.134:6803/18145", 2024-04-19T03:01:45.913 INFO:teuthology.orchestra.run.smithi096.stdout: "heartbeat_back_addr": "172.21.15.134:6807/18145", 2024-04-19T03:01:45.913 INFO:teuthology.orchestra.run.smithi096.stdout: "heartbeat_front_addr": "172.21.15.134:6805/18145", 2024-04-19T03:01:45.913 INFO:teuthology.orchestra.run.smithi096.stdout: "state": [ 2024-04-19T03:01:45.913 INFO:teuthology.orchestra.run.smithi096.stdout: "exists", 2024-04-19T03:01:45.913 INFO:teuthology.orchestra.run.smithi096.stdout: "up" 2024-04-19T03:01:45.913 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-19T03:01:45.913 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-19T03:01:45.913 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-19T03:01:45.914 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": 2, 2024-04-19T03:01:45.914 INFO:teuthology.orchestra.run.smithi096.stdout: "uuid": "229278a0-dd93-4234-9065-e4f2f6188ef2", 2024-04-19T03:01:45.914 INFO:teuthology.orchestra.run.smithi096.stdout: "up": 1, 2024-04-19T03:01:45.914 INFO:teuthology.orchestra.run.smithi096.stdout: "in": 1, 2024-04-19T03:01:45.914 INFO:teuthology.orchestra.run.smithi096.stdout: "weight": 1, 2024-04-19T03:01:45.914 INFO:teuthology.orchestra.run.smithi096.stdout: "primary_affinity": 1, 2024-04-19T03:01:45.914 INFO:teuthology.orchestra.run.smithi096.stdout: "last_clean_begin": 0, 2024-04-19T03:01:45.914 INFO:teuthology.orchestra.run.smithi096.stdout: "last_clean_end": 0, 2024-04-19T03:01:45.914 INFO:teuthology.orchestra.run.smithi096.stdout: "up_from": 10, 2024-04-19T03:01:45.914 INFO:teuthology.orchestra.run.smithi096.stdout: "up_thru": 22, 2024-04-19T03:01:45.914 INFO:teuthology.orchestra.run.smithi096.stdout: "down_at": 0, 2024-04-19T03:01:45.914 INFO:teuthology.orchestra.run.smithi096.stdout: "lost_at": 0, 2024-04-19T03:01:45.914 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addrs": { 2024-04-19T03:01:45.915 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-19T03:01:45.915 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-19T03:01:45.915 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-19T03:01:45.915 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.144:6800", 2024-04-19T03:01:45.915 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 18223 2024-04-19T03:01:45.915 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-19T03:01:45.915 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-19T03:01:45.915 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-19T03:01:45.915 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.144:6801", 2024-04-19T03:01:45.915 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 18223 2024-04-19T03:01:45.915 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-19T03:01:45.915 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-19T03:01:45.915 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-19T03:01:45.915 INFO:teuthology.orchestra.run.smithi096.stdout: "cluster_addrs": { 2024-04-19T03:01:45.915 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-19T03:01:45.916 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-19T03:01:45.916 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-19T03:01:45.916 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.144:6802", 2024-04-19T03:01:45.916 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 18223 2024-04-19T03:01:45.916 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-19T03:01:45.916 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-19T03:01:45.916 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-19T03:01:45.916 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.144:6803", 2024-04-19T03:01:45.916 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 18223 2024-04-19T03:01:45.916 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-19T03:01:45.916 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-19T03:01:45.916 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-19T03:01:45.916 INFO:teuthology.orchestra.run.smithi096.stdout: "heartbeat_back_addrs": { 2024-04-19T03:01:45.916 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-19T03:01:45.916 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-19T03:01:45.917 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-19T03:01:45.917 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.144:6806", 2024-04-19T03:01:45.917 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 18223 2024-04-19T03:01:45.917 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-19T03:01:45.917 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-19T03:01:45.917 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-19T03:01:45.917 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.144:6807", 2024-04-19T03:01:45.917 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 18223 2024-04-19T03:01:45.917 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-19T03:01:45.917 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-19T03:01:45.917 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-19T03:01:45.917 INFO:teuthology.orchestra.run.smithi096.stdout: "heartbeat_front_addrs": { 2024-04-19T03:01:45.917 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-19T03:01:45.917 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-19T03:01:45.918 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-19T03:01:45.918 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.144:6804", 2024-04-19T03:01:45.918 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 18223 2024-04-19T03:01:45.918 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-19T03:01:45.918 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-19T03:01:45.918 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-19T03:01:45.918 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.144:6805", 2024-04-19T03:01:45.918 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 18223 2024-04-19T03:01:45.918 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-19T03:01:45.918 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-19T03:01:45.918 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-19T03:01:45.918 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addr": "172.21.15.144:6801/18223", 2024-04-19T03:01:45.918 INFO:teuthology.orchestra.run.smithi096.stdout: "cluster_addr": "172.21.15.144:6803/18223", 2024-04-19T03:01:45.918 INFO:teuthology.orchestra.run.smithi096.stdout: "heartbeat_back_addr": "172.21.15.144:6807/18223", 2024-04-19T03:01:45.919 INFO:teuthology.orchestra.run.smithi096.stdout: "heartbeat_front_addr": "172.21.15.144:6805/18223", 2024-04-19T03:01:45.919 INFO:teuthology.orchestra.run.smithi096.stdout: "state": [ 2024-04-19T03:01:45.919 INFO:teuthology.orchestra.run.smithi096.stdout: "exists", 2024-04-19T03:01:45.919 INFO:teuthology.orchestra.run.smithi096.stdout: "up" 2024-04-19T03:01:45.919 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-19T03:01:45.919 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-19T03:01:45.919 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-19T03:01:45.919 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_xinfo": [ 2024-04-19T03:01:45.919 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-19T03:01:45.919 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": 0, 2024-04-19T03:01:45.919 INFO:teuthology.orchestra.run.smithi096.stdout: "down_stamp": "0.000000", 2024-04-19T03:01:45.919 INFO:teuthology.orchestra.run.smithi096.stdout: "laggy_probability": 0, 2024-04-19T03:01:45.919 INFO:teuthology.orchestra.run.smithi096.stdout: "laggy_interval": 0, 2024-04-19T03:01:45.919 INFO:teuthology.orchestra.run.smithi096.stdout: "features": 4540138322906710015, 2024-04-19T03:01:45.919 INFO:teuthology.orchestra.run.smithi096.stdout: "old_weight": 0, 2024-04-19T03:01:45.920 INFO:teuthology.orchestra.run.smithi096.stdout: "last_purged_snaps_scrub": "2024-04-19T03:00:59.302574+0000", 2024-04-19T03:01:45.920 INFO:teuthology.orchestra.run.smithi096.stdout: "dead_epoch": 0 2024-04-19T03:01:45.920 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-19T03:01:45.920 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-19T03:01:45.920 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": 1, 2024-04-19T03:01:45.920 INFO:teuthology.orchestra.run.smithi096.stdout: "down_stamp": "0.000000", 2024-04-19T03:01:45.920 INFO:teuthology.orchestra.run.smithi096.stdout: "laggy_probability": 0, 2024-04-19T03:01:45.920 INFO:teuthology.orchestra.run.smithi096.stdout: "laggy_interval": 0, 2024-04-19T03:01:45.920 INFO:teuthology.orchestra.run.smithi096.stdout: "features": 4540138322906710015, 2024-04-19T03:01:45.920 INFO:teuthology.orchestra.run.smithi096.stdout: "old_weight": 0, 2024-04-19T03:01:45.920 INFO:teuthology.orchestra.run.smithi096.stdout: "last_purged_snaps_scrub": "2024-04-19T03:01:00.064174+0000", 2024-04-19T03:01:45.920 INFO:teuthology.orchestra.run.smithi096.stdout: "dead_epoch": 0 2024-04-19T03:01:45.920 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-19T03:01:45.920 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-19T03:01:45.920 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": 2, 2024-04-19T03:01:45.921 INFO:teuthology.orchestra.run.smithi096.stdout: "down_stamp": "0.000000", 2024-04-19T03:01:45.921 INFO:teuthology.orchestra.run.smithi096.stdout: "laggy_probability": 0, 2024-04-19T03:01:45.921 INFO:teuthology.orchestra.run.smithi096.stdout: "laggy_interval": 0, 2024-04-19T03:01:45.921 INFO:teuthology.orchestra.run.smithi096.stdout: "features": 4540138322906710015, 2024-04-19T03:01:45.921 INFO:teuthology.orchestra.run.smithi096.stdout: "old_weight": 0, 2024-04-19T03:01:45.921 INFO:teuthology.orchestra.run.smithi096.stdout: "last_purged_snaps_scrub": "2024-04-19T03:00:59.735582+0000", 2024-04-19T03:01:45.921 INFO:teuthology.orchestra.run.smithi096.stdout: "dead_epoch": 0 2024-04-19T03:01:45.921 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-19T03:01:45.921 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-19T03:01:45.921 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_upmap": [], 2024-04-19T03:01:45.921 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_upmap_items": [], 2024-04-19T03:01:45.921 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_upmap_primaries": [], 2024-04-19T03:01:45.921 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_temp": [], 2024-04-19T03:01:45.922 INFO:teuthology.orchestra.run.smithi096.stdout: "primary_temp": [], 2024-04-19T03:01:45.922 INFO:teuthology.orchestra.run.smithi096.stdout: "blocklist": {}, 2024-04-19T03:01:45.922 INFO:teuthology.orchestra.run.smithi096.stdout: "range_blocklist": {}, 2024-04-19T03:01:45.922 INFO:teuthology.orchestra.run.smithi096.stdout: "erasure_code_profiles": { 2024-04-19T03:01:45.922 INFO:teuthology.orchestra.run.smithi096.stdout: "default": { 2024-04-19T03:01:45.922 INFO:teuthology.orchestra.run.smithi096.stdout: "crush-failure-domain": "osd", 2024-04-19T03:01:45.922 INFO:teuthology.orchestra.run.smithi096.stdout: "k": "2", 2024-04-19T03:01:45.922 INFO:teuthology.orchestra.run.smithi096.stdout: "m": "1", 2024-04-19T03:01:45.922 INFO:teuthology.orchestra.run.smithi096.stdout: "plugin": "jerasure", 2024-04-19T03:01:45.922 INFO:teuthology.orchestra.run.smithi096.stdout: "technique": "reed_sol_van" 2024-04-19T03:01:45.922 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-19T03:01:45.922 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-19T03:01:45.922 INFO:teuthology.orchestra.run.smithi096.stdout: "removed_snaps_queue": [], 2024-04-19T03:01:45.922 INFO:teuthology.orchestra.run.smithi096.stdout: "new_removed_snaps": [], 2024-04-19T03:01:45.923 INFO:teuthology.orchestra.run.smithi096.stdout: "new_purged_snaps": [], 2024-04-19T03:01:45.923 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_node_flags": {}, 2024-04-19T03:01:45.923 INFO:teuthology.orchestra.run.smithi096.stdout: "device_class_flags": {}, 2024-04-19T03:01:45.923 INFO:teuthology.orchestra.run.smithi096.stdout: "stretch_mode": { 2024-04-19T03:01:45.923 INFO:teuthology.orchestra.run.smithi096.stdout: "stretch_mode_enabled": false, 2024-04-19T03:01:45.923 INFO:teuthology.orchestra.run.smithi096.stdout: "stretch_bucket_count": 0, 2024-04-19T03:01:45.923 INFO:teuthology.orchestra.run.smithi096.stdout: "degraded_stretch_mode": 0, 2024-04-19T03:01:45.923 INFO:teuthology.orchestra.run.smithi096.stdout: "recovering_stretch_mode": 0, 2024-04-19T03:01:45.923 INFO:teuthology.orchestra.run.smithi096.stdout: "stretch_mode_bucket": 0 2024-04-19T03:01:45.923 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-19T03:01:45.923 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-04-19T03:01:45.925 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-04-19T03:01:45.925 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:01:45.926 INFO:tasks.thrashosds.thrasher:j is {'epoch': 27, 'fsid': 'c6cc8e09-11d4-48de-9a6c-4d70ed3c3789', 'created': '2024-04-19T03:00:53.746146+0000', 'modified': '2024-04-19T03:01:45.006275+0000', 'last_up_change': '2024-04-19T03:01:04.501086+0000', 'last_in_change': '2024-04-19T03:00:54.640172+0000', 'flags': 'sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5799936, 'flags_set': ['pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 5, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 5, 'max_osd': 3, 'require_min_compat_client': 'luminous', 'min_compat_client': 'jewel', 'require_osd_release': 'reef', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-19T03:01:05.999591+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '14', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-19T03:01:09.051757+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-19T03:01:13.479163+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-04-19T03:01:13.992441+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'unique_pool_0', 'create_time': '2024-04-19T03:01:35.396306+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 16, 'pg_placement_num': 16, 'pg_placement_num_target': 16, 'pg_num_target': 16, 'pg_num_pending': 16, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rados': {}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}], 'osds': [{'osd': 0, 'uuid': '05ecb884-2c30-44f7-aa14-90154f9bbe9a', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 9, 'up_thru': 22, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.97:6800', 'nonce': 18245}, {'type': 'v1', 'addr': '172.21.15.97:6801', 'nonce': 18245}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.97:6802', 'nonce': 18245}, {'type': 'v1', 'addr': '172.21.15.97:6803', 'nonce': 18245}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.97:6806', 'nonce': 18245}, {'type': 'v1', 'addr': '172.21.15.97:6807', 'nonce': 18245}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.97:6804', 'nonce': 18245}, {'type': 'v1', 'addr': '172.21.15.97:6805', 'nonce': 18245}]}, 'public_addr': '172.21.15.97:6801/18245', 'cluster_addr': '172.21.15.97:6803/18245', 'heartbeat_back_addr': '172.21.15.97:6807/18245', 'heartbeat_front_addr': '172.21.15.97:6805/18245', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': 'efc873e0-69c3-4a57-8ee5-41f836b65f47', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 10, 'up_thru': 22, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6800', 'nonce': 18145}, {'type': 'v1', 'addr': '172.21.15.134:6801', 'nonce': 18145}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6802', 'nonce': 18145}, {'type': 'v1', 'addr': '172.21.15.134:6803', 'nonce': 18145}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6806', 'nonce': 18145}, {'type': 'v1', 'addr': '172.21.15.134:6807', 'nonce': 18145}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6804', 'nonce': 18145}, {'type': 'v1', 'addr': '172.21.15.134:6805', 'nonce': 18145}]}, 'public_addr': '172.21.15.134:6801/18145', 'cluster_addr': '172.21.15.134:6803/18145', 'heartbeat_back_addr': '172.21.15.134:6807/18145', 'heartbeat_front_addr': '172.21.15.134:6805/18145', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '229278a0-dd93-4234-9065-e4f2f6188ef2', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 10, 'up_thru': 22, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.144:6800', 'nonce': 18223}, {'type': 'v1', 'addr': '172.21.15.144:6801', 'nonce': 18223}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.144:6802', 'nonce': 18223}, {'type': 'v1', 'addr': '172.21.15.144:6803', 'nonce': 18223}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.144:6806', 'nonce': 18223}, {'type': 'v1', 'addr': '172.21.15.144:6807', 'nonce': 18223}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.144:6804', 'nonce': 18223}, {'type': 'v1', 'addr': '172.21.15.144:6805', 'nonce': 18223}]}, 'public_addr': '172.21.15.144:6801/18223', 'cluster_addr': '172.21.15.144:6803/18223', 'heartbeat_back_addr': '172.21.15.144:6807/18223', 'heartbeat_front_addr': '172.21.15.144:6805/18223', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-19T03:00:59.302574+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-19T03:01:00.064174+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-19T03:00:59.735582+0000', 'dead_epoch': 0}], 'pg_upmap': [], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-04-19T03:01:45.926 INFO:tasks.thrashosds.thrasher:No pg_upmap entries; doing nothing 2024-04-19T03:01:45.926 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T03:01:45.940 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-04-19T03:01:45.937+0000 7f35986ab700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18243) UID: 0 2024-04-19T03:01:46.041 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:01:46.037+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:01:46.057 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-04-19T03:01:46.057 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:01:46.071 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T03:01:46.142 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:01:46.140+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:01:46.203 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-04-19T03:01:46.203 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:01:46.217 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T03:01:46.242 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:01:46.237+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:01:46.293 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-19T03:01:46.343 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-04-19T03:01:46.337+0000 7f35986ab700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18243) UID: 0 2024-04-19T03:01:46.347 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-04-19T03:01:46.347 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:01:46.359 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T03:01:46.448 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-04-19T03:01:46.441+0000 7f35986ab700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18243) UID: 0 2024-04-19T03:01:46.449 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0: {} 2024-04-19T03:01:46.473 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1: {} 2024-04-19T03:01:46.495 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2: {} 2024-04-19T03:01:46.497 INFO:teuthology.orchestra.run.smithi096.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T03:01:46.497 INFO:teuthology.orchestra.run.smithi096.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-19T03:01:46.497 INFO:teuthology.orchestra.run.smithi096.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-19T03:01:46.499 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-04-19T03:01:46.499 INFO:teuthology.orchestra.run.smithi097.stdout: "size": 20, 2024-04-19T03:01:46.499 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 600, 2024-04-19T03:01:46.499 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [ 2024-04-19T03:01:46.499 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.499 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:01:46.499 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:14.996966+0000", 2024-04-19T03:01:46.499 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 31.498166959999999, 2024-04-19T03:01:46.500 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.018946704000000002, 2024-04-19T03:01:46.500 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:01:46.500 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:46.500 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:01:46.500 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.500 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:01:46.500 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.996966+0000", 2024-04-19T03:01:46.500 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:46.500 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.500 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.500 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:01:46.500 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.996966+0000", 2024-04-19T03:01:46.500 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:46.500 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.501 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.501 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:01:46.501 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.996964+0000", 2024-04-19T03:01:46.501 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999971 2024-04-19T03:01:46.501 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.501 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.501 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:01:46.501 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.996982+0000", 2024-04-19T03:01:46.501 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.8306999999999999e-05 2024-04-19T03:01:46.501 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.501 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.501 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:01:46.501 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997027+0000", 2024-04-19T03:01:46.502 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.5274000000000001e-05 2024-04-19T03:01:46.502 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.502 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.502 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:01:46.502 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997047+0000", 2024-04-19T03:01:46.502 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.9726999999999999e-05 2024-04-19T03:01:46.502 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.502 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.502 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:46.502 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997203+0000", 2024-04-19T03:01:46.502 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000155847 2024-04-19T03:01:46.502 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.502 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.503 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op must wait for map", 2024-04-19T03:01:46.503 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997249+0000", 2024-04-19T03:01:46.503 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.5824e-05 2024-04-19T03:01:46.503 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.503 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.503 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:46.503 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.007264+0000", 2024-04-19T03:01:46.503 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.010015909 2024-04-19T03:01:46.503 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.503 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.503 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:01:46.503 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.007394+0000", 2024-04-19T03:01:46.503 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012931999999999999 2024-04-19T03:01:46.504 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.504 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.504 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-04-19T03:01:46.504 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.007537+0000", 2024-04-19T03:01:46.504 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014365 2024-04-19T03:01:46.504 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.504 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.504 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:01:46.504 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.012444+0000", 2024-04-19T03:01:46.504 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0049067260000000001 2024-04-19T03:01:46.504 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.504 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.504 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:46.504 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.015791+0000", 2024-04-19T03:01:46.505 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0033471109999999998 2024-04-19T03:01:46.505 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.505 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.505 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:01:46.505 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.015845+0000", 2024-04-19T03:01:46.505 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.4236e-05 2024-04-19T03:01:46.505 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.505 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.505 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:01:46.505 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.015913+0000", 2024-04-19T03:01:46.505 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.7397000000000005e-05 2024-04-19T03:01:46.505 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:46.505 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:46.505 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:46.505 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.506 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.506 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(mds.0.3:14 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:01:46.506 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:14.997079+0000", 2024-04-19T03:01:46.506 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 31.498054375999999, 2024-04-19T03:01:46.506 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.021951970000000001, 2024-04-19T03:01:46.506 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:01:46.506 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:46.506 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:01:46.506 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.506 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:01:46.506 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997079+0000", 2024-04-19T03:01:46.506 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:46.507 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.507 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.507 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:01:46.507 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997079+0000", 2024-04-19T03:01:46.507 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:46.507 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.507 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.507 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:01:46.507 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997077+0000", 2024-04-19T03:01:46.507 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999986 2024-04-19T03:01:46.508 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.508 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.508 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:01:46.508 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997087+0000", 2024-04-19T03:01:46.508 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.006e-05 2024-04-19T03:01:46.508 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.508 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.508 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:01:46.508 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997105+0000", 2024-04-19T03:01:46.508 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.8026999999999999e-05 2024-04-19T03:01:46.508 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.508 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.508 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:01:46.509 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997135+0000", 2024-04-19T03:01:46.509 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.9643000000000001e-05 2024-04-19T03:01:46.509 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.509 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.509 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:46.509 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997208+0000", 2024-04-19T03:01:46.509 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.3419999999999998e-05 2024-04-19T03:01:46.509 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.509 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.509 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op must wait for map", 2024-04-19T03:01:46.509 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997244+0000", 2024-04-19T03:01:46.509 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.5367000000000002e-05 2024-04-19T03:01:46.509 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.509 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.510 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:46.510 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.007357+0000", 2024-04-19T03:01:46.510 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.010112703000000001 2024-04-19T03:01:46.510 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.510 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.510 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:01:46.510 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.007479+0000", 2024-04-19T03:01:46.510 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012279599999999999 2024-04-19T03:01:46.510 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.510 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.510 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 1", 2024-04-19T03:01:46.510 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.007610+0000", 2024-04-19T03:01:46.510 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00013093499999999999 2024-04-19T03:01:46.511 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.511 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.511 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:01:46.511 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.012526+0000", 2024-04-19T03:01:46.511 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0049157519999999998 2024-04-19T03:01:46.511 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.511 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.511 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:46.511 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.018959+0000", 2024-04-19T03:01:46.511 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0064326009999999996 2024-04-19T03:01:46.511 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.511 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.511 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:01:46.512 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.019005+0000", 2024-04-19T03:01:46.512 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.6066999999999998e-05 2024-04-19T03:01:46.512 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.512 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.512 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:01:46.512 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.019031+0000", 2024-04-19T03:01:46.512 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.6009000000000001e-05 2024-04-19T03:01:46.512 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:46.512 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:46.512 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:46.512 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.512 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.513 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:01:46.513 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:14.997149+0000", 2024-04-19T03:01:46.513 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 31.497983756, 2024-04-19T03:01:46.513 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.021805590999999999, 2024-04-19T03:01:46.513 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:01:46.513 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:46.513 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:01:46.513 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.513 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:01:46.513 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997149+0000", 2024-04-19T03:01:46.513 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:46.513 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.513 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.513 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:01:46.514 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997149+0000", 2024-04-19T03:01:46.514 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:46.514 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.514 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.514 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:01:46.514 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997148+0000", 2024-04-19T03:01:46.514 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2024-04-19T03:01:46.514 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.514 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.514 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:01:46.514 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997166+0000", 2024-04-19T03:01:46.514 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.8233e-05 2024-04-19T03:01:46.515 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.515 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.515 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:01:46.515 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997182+0000", 2024-04-19T03:01:46.515 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5999999999999999e-05 2024-04-19T03:01:46.515 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.515 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.515 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:01:46.515 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997195+0000", 2024-04-19T03:01:46.515 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.252e-05 2024-04-19T03:01:46.515 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.515 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.515 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:46.515 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997348+0000", 2024-04-19T03:01:46.516 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000153115 2024-04-19T03:01:46.516 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.516 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.516 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:01:46.516 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997354+0000", 2024-04-19T03:01:46.516 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.9359999999999996e-06 2024-04-19T03:01:46.516 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.516 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.516 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:46.516 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.008147+0000", 2024-04-19T03:01:46.516 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.010793127 2024-04-19T03:01:46.516 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.516 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.516 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:01:46.517 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.008225+0000", 2024-04-19T03:01:46.517 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.7935999999999994e-05 2024-04-19T03:01:46.517 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.517 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.517 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-04-19T03:01:46.517 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.008377+0000", 2024-04-19T03:01:46.517 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00015159099999999999 2024-04-19T03:01:46.517 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.517 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.517 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:01:46.517 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.012629+0000", 2024-04-19T03:01:46.517 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0042520420000000001 2024-04-19T03:01:46.517 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.517 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.518 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:46.518 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.018871+0000", 2024-04-19T03:01:46.518 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0062425060000000001 2024-04-19T03:01:46.518 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.518 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.518 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:01:46.518 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.018910+0000", 2024-04-19T03:01:46.518 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.8482999999999997e-05 2024-04-19T03:01:46.518 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.518 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.518 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:01:46.518 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.018955+0000", 2024-04-19T03:01:46.518 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.5252e-05 2024-04-19T03:01:46.519 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:46.519 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:46.519 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:46.519 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.519 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.519 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(mds.0.3:36 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:01:46.519 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:14.997207+0000", 2024-04-19T03:01:46.519 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 31.497926205999999, 2024-04-19T03:01:46.519 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.022210431999999999, 2024-04-19T03:01:46.519 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:01:46.519 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:46.519 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:01:46.519 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.520 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:01:46.520 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997207+0000", 2024-04-19T03:01:46.520 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:46.520 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.520 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.520 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:01:46.520 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997207+0000", 2024-04-19T03:01:46.520 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:46.520 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.520 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.520 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:01:46.520 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997206+0000", 2024-04-19T03:01:46.520 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2024-04-19T03:01:46.521 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.521 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.521 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:01:46.521 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997218+0000", 2024-04-19T03:01:46.521 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2607e-05 2024-04-19T03:01:46.521 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.521 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.521 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:01:46.521 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997234+0000", 2024-04-19T03:01:46.521 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5583999999999999e-05 2024-04-19T03:01:46.521 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.521 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.521 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:01:46.522 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997248+0000", 2024-04-19T03:01:46.522 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4270000000000001e-05 2024-04-19T03:01:46.522 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.522 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.522 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:46.522 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997397+0000", 2024-04-19T03:01:46.522 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0001482 2024-04-19T03:01:46.522 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.522 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.522 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:01:46.522 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997407+0000", 2024-04-19T03:01:46.522 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0944000000000001e-05 2024-04-19T03:01:46.522 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.523 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.523 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:46.523 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.008173+0000", 2024-04-19T03:01:46.523 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.010765378000000001 2024-04-19T03:01:46.523 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.523 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.523 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:01:46.523 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.008278+0000", 2024-04-19T03:01:46.523 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00010538 2024-04-19T03:01:46.523 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.523 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.523 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 1", 2024-04-19T03:01:46.523 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.008423+0000", 2024-04-19T03:01:46.523 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014525599999999999 2024-04-19T03:01:46.524 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.524 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.524 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:01:46.524 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.012734+0000", 2024-04-19T03:01:46.524 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0043108590000000002 2024-04-19T03:01:46.524 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.524 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.524 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:46.524 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.019318+0000", 2024-04-19T03:01:46.524 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0065836130000000003 2024-04-19T03:01:46.524 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.524 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.524 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:01:46.524 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.019382+0000", 2024-04-19T03:01:46.525 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.3925999999999997e-05 2024-04-19T03:01:46.525 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.525 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.525 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:01:46.525 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.019417+0000", 2024-04-19T03:01:46.525 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.5454999999999999e-05 2024-04-19T03:01:46.525 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:46.525 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:46.525 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:46.525 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.525 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.525 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(mds.0.3:15 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:01:46.525 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:14.997260+0000", 2024-04-19T03:01:46.525 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 31.497873054999999, 2024-04-19T03:01:46.526 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.021842842000000001, 2024-04-19T03:01:46.526 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:01:46.526 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:46.526 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:01:46.526 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.526 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:01:46.526 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997260+0000", 2024-04-19T03:01:46.526 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:46.526 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.526 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.526 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:01:46.526 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997260+0000", 2024-04-19T03:01:46.527 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:46.527 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.527 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.527 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:01:46.527 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997259+0000", 2024-04-19T03:01:46.527 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999995 2024-04-19T03:01:46.527 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.527 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.527 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:01:46.527 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997270+0000", 2024-04-19T03:01:46.527 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0312999999999999e-05 2024-04-19T03:01:46.527 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.527 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.527 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:01:46.527 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997279+0000", 2024-04-19T03:01:46.528 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.7770000000000008e-06 2024-04-19T03:01:46.528 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.528 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.528 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:01:46.528 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997286+0000", 2024-04-19T03:01:46.528 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.0129999999999996e-06 2024-04-19T03:01:46.528 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.528 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.528 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:46.528 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997433+0000", 2024-04-19T03:01:46.528 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014774699999999999 2024-04-19T03:01:46.528 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.528 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.529 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:01:46.529 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997443+0000", 2024-04-19T03:01:46.529 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.414e-06 2024-04-19T03:01:46.529 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.529 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.529 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:46.529 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.008673+0000", 2024-04-19T03:01:46.529 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.011230789999999999 2024-04-19T03:01:46.529 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.529 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.529 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:01:46.529 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.008808+0000", 2024-04-19T03:01:46.529 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000134346 2024-04-19T03:01:46.529 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.529 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.530 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-04-19T03:01:46.530 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.008922+0000", 2024-04-19T03:01:46.530 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000114444 2024-04-19T03:01:46.530 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.530 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.530 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:01:46.530 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.013442+0000", 2024-04-19T03:01:46.530 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0045193439999999998 2024-04-19T03:01:46.530 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.530 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.530 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:46.530 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.019005+0000", 2024-04-19T03:01:46.531 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00556333 2024-04-19T03:01:46.531 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.531 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.531 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:01:46.531 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.019049+0000", 2024-04-19T03:01:46.531 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.4240000000000003e-05 2024-04-19T03:01:46.531 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.531 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.531 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:01:46.531 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.019103+0000", 2024-04-19T03:01:46.531 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.3706999999999999e-05 2024-04-19T03:01:46.531 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:46.531 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:46.532 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:46.532 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.532 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.532 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(mds.0.3:17 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:01:46.532 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:14.997292+0000", 2024-04-19T03:01:46.532 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 31.497841328, 2024-04-19T03:01:46.532 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.019573165999999999, 2024-04-19T03:01:46.532 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:01:46.532 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:46.532 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:01:46.532 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.532 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:01:46.532 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997292+0000", 2024-04-19T03:01:46.532 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:46.532 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.533 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.533 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:01:46.533 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997292+0000", 2024-04-19T03:01:46.533 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:46.533 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.533 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.533 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:01:46.533 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997291+0000", 2024-04-19T03:01:46.533 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999995 2024-04-19T03:01:46.533 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.533 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.533 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:01:46.533 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997297+0000", 2024-04-19T03:01:46.534 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.3900000000000001e-06 2024-04-19T03:01:46.534 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.534 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.534 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:01:46.534 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997316+0000", 2024-04-19T03:01:46.534 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.9406e-05 2024-04-19T03:01:46.534 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.534 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.534 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:01:46.534 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997353+0000", 2024-04-19T03:01:46.534 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.6563999999999998e-05 2024-04-19T03:01:46.534 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.534 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.534 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:46.535 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997447+0000", 2024-04-19T03:01:46.535 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.4463999999999995e-05 2024-04-19T03:01:46.535 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.535 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.535 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op must wait for map", 2024-04-19T03:01:46.535 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997458+0000", 2024-04-19T03:01:46.535 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0817e-05 2024-04-19T03:01:46.535 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.535 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.535 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:46.535 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.002013+0000", 2024-04-19T03:01:46.535 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.004555229 2024-04-19T03:01:46.536 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.536 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.536 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:01:46.536 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.002943+0000", 2024-04-19T03:01:46.536 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00092983200000000001 2024-04-19T03:01:46.536 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.536 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.536 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-04-19T03:01:46.536 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.003257+0000", 2024-04-19T03:01:46.536 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00031455399999999998 2024-04-19T03:01:46.536 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.536 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.536 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:01:46.536 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.014107+0000", 2024-04-19T03:01:46.537 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.010849648 2024-04-19T03:01:46.537 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.537 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.537 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:46.537 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.016767+0000", 2024-04-19T03:01:46.537 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0026594990000000001 2024-04-19T03:01:46.537 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.537 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.537 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:01:46.537 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.016825+0000", 2024-04-19T03:01:46.537 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.8264000000000003e-05 2024-04-19T03:01:46.537 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.537 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.537 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:01:46.538 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.016865+0000", 2024-04-19T03:01:46.538 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.0108999999999998e-05 2024-04-19T03:01:46.538 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:46.538 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:46.538 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:46.538 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.538 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.538 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(mds.0.3:22 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:01:46.538 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:14.997383+0000", 2024-04-19T03:01:46.538 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 31.497750547999999, 2024-04-19T03:01:46.538 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.019634641000000001, 2024-04-19T03:01:46.538 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:01:46.538 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "started", 2024-04-19T03:01:46.539 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:01:46.539 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.539 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:01:46.539 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997383+0000", 2024-04-19T03:01:46.539 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:46.539 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.539 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.539 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:01:46.539 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997383+0000", 2024-04-19T03:01:46.539 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:46.539 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.539 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.539 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:01:46.539 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997381+0000", 2024-04-19T03:01:46.540 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999986 2024-04-19T03:01:46.540 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.540 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.540 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:01:46.540 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997399+0000", 2024-04-19T03:01:46.540 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.802e-05 2024-04-19T03:01:46.540 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.540 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.540 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:01:46.540 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997417+0000", 2024-04-19T03:01:46.540 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.7581e-05 2024-04-19T03:01:46.540 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.540 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.540 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:01:46.540 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997429+0000", 2024-04-19T03:01:46.541 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1803e-05 2024-04-19T03:01:46.541 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.541 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.541 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:46.541 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997540+0000", 2024-04-19T03:01:46.541 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000111397 2024-04-19T03:01:46.541 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.541 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.541 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:01:46.541 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997552+0000", 2024-04-19T03:01:46.541 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1643e-05 2024-04-19T03:01:46.541 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.542 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.542 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:46.542 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.006836+0000", 2024-04-19T03:01:46.542 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0092841940000000008 2024-04-19T03:01:46.542 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.542 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.542 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:01:46.542 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.006982+0000", 2024-04-19T03:01:46.542 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014572899999999999 2024-04-19T03:01:46.542 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.542 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.542 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:01:46.542 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.017017+0000", 2024-04-19T03:01:46.543 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.010035571 2024-04-19T03:01:46.543 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:46.543 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:46.543 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:46.543 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.543 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.543 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(mds.0.3:23 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:01:46.543 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:14.997449+0000", 2024-04-19T03:01:46.543 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 31.497684007, 2024-04-19T03:01:46.543 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.022679250000000001, 2024-04-19T03:01:46.543 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:01:46.543 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "started", 2024-04-19T03:01:46.543 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:01:46.543 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.544 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:01:46.544 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997449+0000", 2024-04-19T03:01:46.544 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:46.544 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.544 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.544 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:01:46.544 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997449+0000", 2024-04-19T03:01:46.544 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:46.544 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.544 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.544 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:01:46.544 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997448+0000", 2024-04-19T03:01:46.544 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999995 2024-04-19T03:01:46.544 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.545 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.545 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:01:46.545 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997452+0000", 2024-04-19T03:01:46.545 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.0369999999999996e-06 2024-04-19T03:01:46.545 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.545 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.545 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:01:46.545 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997461+0000", 2024-04-19T03:01:46.545 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.6100000000000006e-06 2024-04-19T03:01:46.545 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.545 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.545 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:01:46.545 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997468+0000", 2024-04-19T03:01:46.545 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.8360000000000003e-06 2024-04-19T03:01:46.545 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.546 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.546 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:46.546 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997546+0000", 2024-04-19T03:01:46.546 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.7956999999999999e-05 2024-04-19T03:01:46.546 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.546 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.546 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:01:46.546 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997555+0000", 2024-04-19T03:01:46.546 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.2269999999999999e-06 2024-04-19T03:01:46.546 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.546 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.546 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:46.547 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.010065+0000", 2024-04-19T03:01:46.547 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.012509457999999999 2024-04-19T03:01:46.547 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.547 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.547 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:01:46.547 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.010187+0000", 2024-04-19T03:01:46.547 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000122059 2024-04-19T03:01:46.547 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.547 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.547 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:01:46.547 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.020128+0000", 2024-04-19T03:01:46.547 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0099417529999999994 2024-04-19T03:01:46.547 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:46.547 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:46.547 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:46.548 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.548 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.548 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(mds.0.3:25 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:01:46.548 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:14.997485+0000", 2024-04-19T03:01:46.548 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 31.497648541, 2024-04-19T03:01:46.548 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.021633427, 2024-04-19T03:01:46.548 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:01:46.548 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "started", 2024-04-19T03:01:46.548 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:01:46.548 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.548 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:01:46.548 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997485+0000", 2024-04-19T03:01:46.548 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:46.548 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.549 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.549 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:01:46.549 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997485+0000", 2024-04-19T03:01:46.549 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:46.549 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.549 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.549 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:01:46.549 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997484+0000", 2024-04-19T03:01:46.549 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2024-04-19T03:01:46.549 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.549 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.549 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:01:46.549 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997490+0000", 2024-04-19T03:01:46.549 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.857e-06 2024-04-19T03:01:46.550 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.550 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.550 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:01:46.550 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997505+0000", 2024-04-19T03:01:46.550 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.518e-05 2024-04-19T03:01:46.550 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.550 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.550 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:01:46.550 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997520+0000", 2024-04-19T03:01:46.550 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5026e-05 2024-04-19T03:01:46.550 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.550 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.550 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:46.550 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997607+0000", 2024-04-19T03:01:46.551 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.7107000000000005e-05 2024-04-19T03:01:46.551 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.551 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.551 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op must wait for map", 2024-04-19T03:01:46.551 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997614+0000", 2024-04-19T03:01:46.551 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.0539999999999997e-06 2024-04-19T03:01:46.551 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.551 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.551 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:46.551 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.009808+0000", 2024-04-19T03:01:46.551 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.012194371000000001 2024-04-19T03:01:46.551 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.551 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.552 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:01:46.552 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.010107+0000", 2024-04-19T03:01:46.552 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000298731 2024-04-19T03:01:46.552 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.552 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.552 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:01:46.552 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.019118+0000", 2024-04-19T03:01:46.552 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0090109839999999997 2024-04-19T03:01:46.552 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:46.552 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:46.552 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:46.552 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.552 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.552 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4755.0:3803 5.6 5:678d4a6b:::benchmark_data_smithi096_19531_object3802:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-19T03:01:46.552 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:39.210318+0000", 2024-04-19T03:01:46.553 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 7.2848148090000002, 2024-04-19T03:01:46.553 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.013528874, 2024-04-19T03:01:46.553 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:01:46.553 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:46.553 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-04-19T03:01:46.553 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4755", 2024-04-19T03:01:46.553 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:46.553 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 3803 2024-04-19T03:01:46.553 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.553 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:01:46.553 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.553 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:01:46.553 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:39.210318+0000", 2024-04-19T03:01:46.553 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:46.554 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.554 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.554 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:01:46.554 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:39.210318+0000", 2024-04-19T03:01:46.554 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:46.554 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.554 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.554 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:01:46.554 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:39.210318+0000", 2024-04-19T03:01:46.554 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2024-04-19T03:01:46.554 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.554 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.554 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:01:46.555 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:39.210411+0000", 2024-04-19T03:01:46.555 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.2949999999999996e-05 2024-04-19T03:01:46.555 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.555 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.555 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:01:46.555 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:39.210423+0000", 2024-04-19T03:01:46.555 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2119e-05 2024-04-19T03:01:46.555 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.555 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.555 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:01:46.555 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:39.210429+0000", 2024-04-19T03:01:46.555 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.5409999999999997e-06 2024-04-19T03:01:46.555 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.555 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.555 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:46.556 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:39.210477+0000", 2024-04-19T03:01:46.556 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.7673999999999998e-05 2024-04-19T03:01:46.556 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.556 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.556 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:01:46.556 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:39.210609+0000", 2024-04-19T03:01:46.556 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00013191400000000001 2024-04-19T03:01:46.556 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.556 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.556 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-04-19T03:01:46.556 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:39.210755+0000", 2024-04-19T03:01:46.556 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014639699999999999 2024-04-19T03:01:46.556 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.557 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.557 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:01:46.557 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:39.215050+0000", 2024-04-19T03:01:46.557 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0042952060000000002 2024-04-19T03:01:46.557 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.557 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.557 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:46.557 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:39.223788+0000", 2024-04-19T03:01:46.557 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0087373529999999998 2024-04-19T03:01:46.557 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.557 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.557 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:01:46.557 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:39.223822+0000", 2024-04-19T03:01:46.558 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.4545000000000002e-05 2024-04-19T03:01:46.558 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.558 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.558 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:01:46.558 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:39.223847+0000", 2024-04-19T03:01:46.558 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.4899e-05 2024-04-19T03:01:46.558 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:46.558 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:46.558 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:46.558 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.558 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.558 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4755.0:3804 5.6 5:631563b7:::benchmark_data_smithi096_19531_object3803:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-19T03:01:46.558 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:39.211389+0000", 2024-04-19T03:01:46.559 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 7.2837441179999995, 2024-04-19T03:01:46.559 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.012667085999999999, 2024-04-19T03:01:46.559 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:01:46.559 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:46.559 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-04-19T03:01:46.559 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4755", 2024-04-19T03:01:46.559 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:46.559 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 3804 2024-04-19T03:01:46.559 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.559 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:01:46.559 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.559 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:01:46.559 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:39.211389+0000", 2024-04-19T03:01:46.560 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:46.560 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.560 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.560 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:01:46.560 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:39.211389+0000", 2024-04-19T03:01:46.560 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:46.560 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.560 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.560 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:01:46.560 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:39.211388+0000", 2024-04-19T03:01:46.560 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999986 2024-04-19T03:01:46.560 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.560 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.560 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:01:46.561 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:39.211460+0000", 2024-04-19T03:01:46.561 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.2653999999999999e-05 2024-04-19T03:01:46.561 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.561 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.561 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:01:46.561 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:39.211472+0000", 2024-04-19T03:01:46.561 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1549000000000001e-05 2024-04-19T03:01:46.561 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.561 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.561 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:01:46.561 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:39.211481+0000", 2024-04-19T03:01:46.561 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.6680000000000007e-06 2024-04-19T03:01:46.562 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.562 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.562 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:46.562 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:39.211711+0000", 2024-04-19T03:01:46.562 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00023037700000000001 2024-04-19T03:01:46.562 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.562 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.562 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:01:46.562 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:39.211817+0000", 2024-04-19T03:01:46.562 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000105524 2024-04-19T03:01:46.562 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.562 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.563 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-04-19T03:01:46.563 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:39.211899+0000", 2024-04-19T03:01:46.563 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.1926000000000001e-05 2024-04-19T03:01:46.563 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.563 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.563 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:01:46.563 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:39.215057+0000", 2024-04-19T03:01:46.563 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0031585279999999999 2024-04-19T03:01:46.563 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.563 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.563 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:46.563 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:39.223976+0000", 2024-04-19T03:01:46.563 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.008918469 2024-04-19T03:01:46.563 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.564 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.564 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:01:46.564 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:39.224017+0000", 2024-04-19T03:01:46.565 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.1652e-05 2024-04-19T03:01:46.565 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.565 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.566 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:01:46.566 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:39.224056+0000", 2024-04-19T03:01:46.566 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.8936000000000001e-05 2024-04-19T03:01:46.566 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:46.566 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:46.566 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:46.566 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.566 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.566 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4755.0:3805 5.6 5:67ca77e0:::benchmark_data_smithi096_19531_object3804:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-19T03:01:46.566 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:39.211489+0000", 2024-04-19T03:01:46.566 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 7.2836444120000001, 2024-04-19T03:01:46.566 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.012727723999999999, 2024-04-19T03:01:46.566 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:01:46.567 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:46.567 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-04-19T03:01:46.567 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4755", 2024-04-19T03:01:46.567 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:46.567 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 3805 2024-04-19T03:01:46.567 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.567 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:01:46.567 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.567 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:01:46.567 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:39.211489+0000", 2024-04-19T03:01:46.567 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:46.567 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.568 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.568 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:01:46.568 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:39.211489+0000", 2024-04-19T03:01:46.568 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:46.568 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.568 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.568 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:01:46.568 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:39.211488+0000", 2024-04-19T03:01:46.568 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999995 2024-04-19T03:01:46.568 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.568 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.568 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:01:46.568 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:39.211528+0000", 2024-04-19T03:01:46.568 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.9740000000000002e-05 2024-04-19T03:01:46.569 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.569 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.569 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:01:46.569 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:39.211536+0000", 2024-04-19T03:01:46.569 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.9130000000000003e-06 2024-04-19T03:01:46.569 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.569 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.569 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:01:46.569 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:39.211542+0000", 2024-04-19T03:01:46.569 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.8599999999999998e-06 2024-04-19T03:01:46.569 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.569 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.569 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:46.570 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:39.213004+0000", 2024-04-19T03:01:46.570 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0014621160000000001 2024-04-19T03:01:46.570 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.570 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.570 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:01:46.570 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:39.213139+0000", 2024-04-19T03:01:46.570 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00013563299999999999 2024-04-19T03:01:46.570 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.570 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.570 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-04-19T03:01:46.570 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:39.213227+0000", 2024-04-19T03:01:46.570 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.7322000000000002e-05 2024-04-19T03:01:46.570 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.570 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.571 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:01:46.571 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:39.215063+0000", 2024-04-19T03:01:46.571 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0018363629999999999 2024-04-19T03:01:46.571 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.571 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.571 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:46.571 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:39.224122+0000", 2024-04-19T03:01:46.571 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0090587979999999999 2024-04-19T03:01:46.571 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.571 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.571 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:01:46.571 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:39.224176+0000", 2024-04-19T03:01:46.572 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.4645999999999998e-05 2024-04-19T03:01:46.572 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.572 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.572 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:01:46.572 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:39.224216+0000", 2024-04-19T03:01:46.572 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.9956000000000002e-05 2024-04-19T03:01:46.572 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:46.572 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:46.572 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:46.572 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.572 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.572 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4755.0:11277 5.c 5:38c3ceb2:::benchmark_data_smithi096_19531_object11276:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T03:01:46.572 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:42.059676+0000", 2024-04-19T03:01:46.573 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 4.4354569189999999, 2024-04-19T03:01:46.573 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.029909680000000001, 2024-04-19T03:01:46.573 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:01:46.573 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:46.573 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-04-19T03:01:46.573 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4755", 2024-04-19T03:01:46.573 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:46.573 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 11277 2024-04-19T03:01:46.573 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.573 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:01:46.573 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.573 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:01:46.574 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.059676+0000", 2024-04-19T03:01:46.574 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:46.574 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.574 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.574 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:01:46.574 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.059676+0000", 2024-04-19T03:01:46.574 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:46.574 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.574 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.574 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:01:46.574 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.059665+0000", 2024-04-19T03:01:46.574 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999886 2024-04-19T03:01:46.574 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.575 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.575 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:01:46.575 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.059777+0000", 2024-04-19T03:01:46.575 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000111953 2024-04-19T03:01:46.575 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.575 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.575 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:01:46.575 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.059789+0000", 2024-04-19T03:01:46.575 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1809e-05 2024-04-19T03:01:46.575 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.575 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.575 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:01:46.575 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.059797+0000", 2024-04-19T03:01:46.576 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.2090000000000005e-06 2024-04-19T03:01:46.576 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.576 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.576 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:46.576 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.060528+0000", 2024-04-19T03:01:46.576 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00073144499999999995 2024-04-19T03:01:46.576 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.576 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.576 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:01:46.576 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.060662+0000", 2024-04-19T03:01:46.576 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000133435 2024-04-19T03:01:46.576 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.576 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.577 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-04-19T03:01:46.577 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.060766+0000", 2024-04-19T03:01:46.577 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00010473500000000001 2024-04-19T03:01:46.577 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.577 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.577 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:01:46.577 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.067649+0000", 2024-04-19T03:01:46.577 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.006882684 2024-04-19T03:01:46.577 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.577 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.577 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:46.577 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.089475+0000", 2024-04-19T03:01:46.577 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.021826196999999999 2024-04-19T03:01:46.577 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.578 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.578 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:01:46.578 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.089535+0000", 2024-04-19T03:01:46.578 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.9239e-05 2024-04-19T03:01:46.578 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.578 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.578 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:01:46.578 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.089586+0000", 2024-04-19T03:01:46.578 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.1288000000000001e-05 2024-04-19T03:01:46.578 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:46.578 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:46.578 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:46.578 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.579 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.579 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4755.0:11280 5.6 5:6e34f5e7:::benchmark_data_smithi096_19531_object11279:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T03:01:46.579 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:42.060002+0000", 2024-04-19T03:01:46.579 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 4.4351315429999998, 2024-04-19T03:01:46.579 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.028171841999999999, 2024-04-19T03:01:46.579 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:01:46.579 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:46.579 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-04-19T03:01:46.579 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4755", 2024-04-19T03:01:46.579 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:46.579 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 11280 2024-04-19T03:01:46.579 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.579 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:01:46.579 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.579 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:01:46.580 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.060002+0000", 2024-04-19T03:01:46.580 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:46.580 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.580 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.580 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:01:46.580 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.060002+0000", 2024-04-19T03:01:46.580 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:46.580 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.580 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.580 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:01:46.580 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.060000+0000", 2024-04-19T03:01:46.580 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2024-04-19T03:01:46.580 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.580 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.581 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:01:46.581 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.060120+0000", 2024-04-19T03:01:46.581 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00011941400000000001 2024-04-19T03:01:46.581 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.581 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.581 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:01:46.581 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.060132+0000", 2024-04-19T03:01:46.581 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2197e-05 2024-04-19T03:01:46.581 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.581 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.581 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:01:46.581 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.060141+0000", 2024-04-19T03:01:46.581 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.6829999999999997e-06 2024-04-19T03:01:46.582 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.582 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.582 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:46.582 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.060194+0000", 2024-04-19T03:01:46.582 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.3395e-05 2024-04-19T03:01:46.582 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.582 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.582 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:01:46.582 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.060333+0000", 2024-04-19T03:01:46.582 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00013935799999999999 2024-04-19T03:01:46.582 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.582 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.582 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-04-19T03:01:46.583 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.060477+0000", 2024-04-19T03:01:46.583 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000143938 2024-04-19T03:01:46.583 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.583 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.583 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:01:46.583 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.067752+0000", 2024-04-19T03:01:46.583 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0072741580000000002 2024-04-19T03:01:46.583 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.583 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.583 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:46.583 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.088041+0000", 2024-04-19T03:01:46.583 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.020288955000000001 2024-04-19T03:01:46.583 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.583 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.584 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:01:46.584 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.088113+0000", 2024-04-19T03:01:46.584 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.2492999999999999e-05 2024-04-19T03:01:46.584 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.584 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.584 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:01:46.584 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.088173+0000", 2024-04-19T03:01:46.584 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.0418999999999999e-05 2024-04-19T03:01:46.584 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:46.584 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:46.584 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:46.584 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.584 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.585 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4755.0:11274 5.e e26/22 5:7c846032:::benchmark_data_smithi096_19531_object11273:head v 26'697, mlcod=26'692)", 2024-04-19T03:01:46.585 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:42.065726+0000", 2024-04-19T03:01:46.585 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 4.4294070159999999, 2024-04-19T03:01:46.585 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.028607227999999998, 2024-04-19T03:01:46.585 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:01:46.585 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:46.585 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:01:46.585 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.585 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:01:46.585 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.065726+0000", 2024-04-19T03:01:46.585 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:46.585 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.585 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.585 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:01:46.586 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.065726+0000", 2024-04-19T03:01:46.586 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:46.586 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.586 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.586 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:01:46.586 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.065725+0000", 2024-04-19T03:01:46.586 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2024-04-19T03:01:46.586 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.586 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.586 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:01:46.586 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.066818+0000", 2024-04-19T03:01:46.586 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0010930110000000001 2024-04-19T03:01:46.586 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.587 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.587 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:01:46.587 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.066826+0000", 2024-04-19T03:01:46.587 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.0609999999999996e-06 2024-04-19T03:01:46.587 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.587 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.587 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:01:46.587 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.066831+0000", 2024-04-19T03:01:46.587 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.7500000000000003e-06 2024-04-19T03:01:46.587 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.587 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.587 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:46.587 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.066857+0000", 2024-04-19T03:01:46.588 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.6126999999999999e-05 2024-04-19T03:01:46.588 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.588 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.588 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:01:46.588 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.066868+0000", 2024-04-19T03:01:46.588 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1113e-05 2024-04-19T03:01:46.588 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.588 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.588 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:01:46.588 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.094266+0000", 2024-04-19T03:01:46.588 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.027397731000000002 2024-04-19T03:01:46.588 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.588 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.589 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:01:46.589 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.094333+0000", 2024-04-19T03:01:46.589 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.7230000000000005e-05 2024-04-19T03:01:46.589 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:46.589 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:46.589 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:46.589 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.589 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.589 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4755.0:11279 5.8 e26/22 5:10b60c58:::benchmark_data_smithi096_19531_object11278:head v 26'723, mlcod=26'719)", 2024-04-19T03:01:46.589 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:42.066841+0000", 2024-04-19T03:01:46.589 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 4.428291701, 2024-04-19T03:01:46.589 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.021736267, 2024-04-19T03:01:46.589 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:01:46.589 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:46.590 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:01:46.590 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.590 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:01:46.590 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.066841+0000", 2024-04-19T03:01:46.590 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:46.590 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.590 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.590 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:01:46.590 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.066841+0000", 2024-04-19T03:01:46.590 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:46.590 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.590 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.590 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:01:46.591 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.066841+0000", 2024-04-19T03:01:46.591 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999995 2024-04-19T03:01:46.591 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.591 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.591 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:01:46.591 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.066876+0000", 2024-04-19T03:01:46.591 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.4790999999999999e-05 2024-04-19T03:01:46.591 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.591 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.591 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:01:46.591 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.066880+0000", 2024-04-19T03:01:46.591 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.3610000000000003e-06 2024-04-19T03:01:46.591 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.591 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.592 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:01:46.592 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.066883+0000", 2024-04-19T03:01:46.592 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.4079999999999998e-06 2024-04-19T03:01:46.592 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.592 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.592 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:46.592 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.066929+0000", 2024-04-19T03:01:46.592 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.5444000000000001e-05 2024-04-19T03:01:46.592 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.592 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.592 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:01:46.592 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.066951+0000", 2024-04-19T03:01:46.592 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.2578999999999998e-05 2024-04-19T03:01:46.593 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.593 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.593 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:01:46.593 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.088518+0000", 2024-04-19T03:01:46.593 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.021566617 2024-04-19T03:01:46.593 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.593 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.593 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:01:46.593 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.088578+0000", 2024-04-19T03:01:46.593 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.9655999999999999e-05 2024-04-19T03:01:46.594 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:46.594 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:46.594 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:46.594 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.594 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.594 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4755.0:11282 5.e e26/22 5:75b7c510:::benchmark_data_smithi096_19531_object11281:head v 26'698, mlcod=26'693)", 2024-04-19T03:01:46.594 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:42.066923+0000", 2024-04-19T03:01:46.594 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 4.4282098340000005, 2024-04-19T03:01:46.594 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.027436461999999998, 2024-04-19T03:01:46.594 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:01:46.594 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:46.594 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:01:46.594 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.595 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:01:46.595 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.066923+0000", 2024-04-19T03:01:46.595 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:46.595 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.595 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.595 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:01:46.595 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.066923+0000", 2024-04-19T03:01:46.595 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:46.595 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.595 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.595 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:01:46.595 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.066923+0000", 2024-04-19T03:01:46.595 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999995 2024-04-19T03:01:46.595 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.596 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.596 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:01:46.596 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.066955+0000", 2024-04-19T03:01:46.596 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.2060999999999997e-05 2024-04-19T03:01:46.596 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.596 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.596 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:01:46.596 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.066962+0000", 2024-04-19T03:01:46.596 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.1969999999999999e-06 2024-04-19T03:01:46.596 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.596 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.596 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:01:46.596 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.066967+0000", 2024-04-19T03:01:46.596 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.6589999999999998e-06 2024-04-19T03:01:46.597 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.597 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.597 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:46.597 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.067762+0000", 2024-04-19T03:01:46.597 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00079538199999999997 2024-04-19T03:01:46.597 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.597 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.597 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:01:46.597 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.067782+0000", 2024-04-19T03:01:46.597 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.9432999999999998e-05 2024-04-19T03:01:46.597 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.597 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.597 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:01:46.597 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.094339+0000", 2024-04-19T03:01:46.598 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.026556778999999999 2024-04-19T03:01:46.598 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.598 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.598 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:01:46.598 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.094360+0000", 2024-04-19T03:01:46.598 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.1246e-05 2024-04-19T03:01:46.598 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:46.598 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:46.598 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:46.598 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.598 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.598 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4755.0:11291 5.a 5:5ee9d828:::benchmark_data_smithi096_19531_object11290:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T03:01:46.598 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:42.067725+0000", 2024-04-19T03:01:46.598 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 4.427407724, 2024-04-19T03:01:46.598 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.021089111000000001, 2024-04-19T03:01:46.599 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:01:46.599 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:46.599 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-04-19T03:01:46.599 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4755", 2024-04-19T03:01:46.599 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:46.599 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 11291 2024-04-19T03:01:46.599 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.599 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:01:46.599 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.599 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:01:46.599 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.067725+0000", 2024-04-19T03:01:46.599 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:46.599 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.599 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.600 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:01:46.600 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.067725+0000", 2024-04-19T03:01:46.600 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:46.600 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.600 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.600 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:01:46.600 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.067724+0000", 2024-04-19T03:01:46.600 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2024-04-19T03:01:46.600 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.600 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.600 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:01:46.600 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.067842+0000", 2024-04-19T03:01:46.600 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000117691 2024-04-19T03:01:46.600 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.600 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.601 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:01:46.601 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.067853+0000", 2024-04-19T03:01:46.601 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0679000000000001e-05 2024-04-19T03:01:46.601 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.601 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.601 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:01:46.601 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.067859+0000", 2024-04-19T03:01:46.601 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.9510000000000003e-06 2024-04-19T03:01:46.601 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.601 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.601 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:46.601 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.067905+0000", 2024-04-19T03:01:46.601 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.6242999999999998e-05 2024-04-19T03:01:46.601 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.602 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.602 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:01:46.602 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.085335+0000", 2024-04-19T03:01:46.602 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.017430451 2024-04-19T03:01:46.602 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.602 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.602 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 1", 2024-04-19T03:01:46.602 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.085538+0000", 2024-04-19T03:01:46.602 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000202511 2024-04-19T03:01:46.602 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.602 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.602 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:46.602 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.087988+0000", 2024-04-19T03:01:46.602 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0024505780000000001 2024-04-19T03:01:46.603 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.603 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.603 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:01:46.603 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.088672+0000", 2024-04-19T03:01:46.603 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00068377900000000003 2024-04-19T03:01:46.603 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.603 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.603 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:01:46.603 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.088757+0000", 2024-04-19T03:01:46.603 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.4384999999999999e-05 2024-04-19T03:01:46.603 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.603 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.603 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:01:46.603 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.088815+0000", 2024-04-19T03:01:46.604 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.7995999999999998e-05 2024-04-19T03:01:46.604 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:46.604 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:46.604 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:46.604 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.604 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.604 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4755.0:11293 5.c 5:31728bfd:::benchmark_data_smithi096_19531_object11292:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T03:01:46.604 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:42.068359+0000", 2024-04-19T03:01:46.604 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 4.4267740099999999, 2024-04-19T03:01:46.604 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.022306475999999999, 2024-04-19T03:01:46.604 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:01:46.604 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:46.604 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-04-19T03:01:46.605 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4755", 2024-04-19T03:01:46.605 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:46.605 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 11293 2024-04-19T03:01:46.605 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.605 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:01:46.605 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.605 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:01:46.605 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.068359+0000", 2024-04-19T03:01:46.605 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:46.605 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.605 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.605 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:01:46.605 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.068359+0000", 2024-04-19T03:01:46.605 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:46.606 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.606 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.606 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:01:46.606 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.068358+0000", 2024-04-19T03:01:46.606 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2024-04-19T03:01:46.606 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.606 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.606 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:01:46.606 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.068427+0000", 2024-04-19T03:01:46.606 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.9139000000000003e-05 2024-04-19T03:01:46.606 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.606 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.606 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:01:46.607 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.085292+0000", 2024-04-19T03:01:46.607 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.016864371 2024-04-19T03:01:46.607 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.607 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.607 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:01:46.607 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.085306+0000", 2024-04-19T03:01:46.607 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.434e-05 2024-04-19T03:01:46.607 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.607 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.607 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:46.607 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.085404+0000", 2024-04-19T03:01:46.607 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.8145000000000003e-05 2024-04-19T03:01:46.607 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.607 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.607 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:01:46.608 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.085569+0000", 2024-04-19T03:01:46.608 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00016504099999999999 2024-04-19T03:01:46.608 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.608 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.608 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-04-19T03:01:46.608 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.085739+0000", 2024-04-19T03:01:46.608 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000170099 2024-04-19T03:01:46.608 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.608 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.608 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:01:46.608 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.089603+0000", 2024-04-19T03:01:46.608 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0038636080000000001 2024-04-19T03:01:46.608 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.608 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.609 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:46.609 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.090578+0000", 2024-04-19T03:01:46.609 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00097513199999999997 2024-04-19T03:01:46.609 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.609 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.609 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:01:46.609 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.090618+0000", 2024-04-19T03:01:46.609 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.9987999999999997e-05 2024-04-19T03:01:46.609 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.609 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.609 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:01:46.609 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.090666+0000", 2024-04-19T03:01:46.609 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.7420999999999999e-05 2024-04-19T03:01:46.609 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:46.610 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:46.610 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:46.610 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.610 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.610 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4755.0:11288 5.0 e26/22 5:042458d0:::benchmark_data_smithi096_19531_object11287:head v 26'772, mlcod=26'770)", 2024-04-19T03:01:46.610 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:42.068428+0000", 2024-04-19T03:01:46.610 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 4.4267056089999999, 2024-04-19T03:01:46.610 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.020774925, 2024-04-19T03:01:46.610 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:01:46.610 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:46.610 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:01:46.610 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.610 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:01:46.610 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.068428+0000", 2024-04-19T03:01:46.611 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:46.611 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.611 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.611 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:01:46.611 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.068428+0000", 2024-04-19T03:01:46.611 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:46.611 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.611 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.611 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:01:46.611 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.068427+0000", 2024-04-19T03:01:46.611 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999995 2024-04-19T03:01:46.611 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.611 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.612 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:01:46.612 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.068481+0000", 2024-04-19T03:01:46.612 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.3866999999999998e-05 2024-04-19T03:01:46.612 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.612 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.612 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:01:46.612 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.085273+0000", 2024-04-19T03:01:46.612 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.016792372999999999 2024-04-19T03:01:46.612 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.612 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.612 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:01:46.612 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.085288+0000", 2024-04-19T03:01:46.612 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4941e-05 2024-04-19T03:01:46.612 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.612 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.613 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:46.613 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.085350+0000", 2024-04-19T03:01:46.613 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.1550999999999994e-05 2024-04-19T03:01:46.613 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.613 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.613 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:01:46.613 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.085384+0000", 2024-04-19T03:01:46.613 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.4915e-05 2024-04-19T03:01:46.613 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.613 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.613 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:01:46.613 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.089164+0000", 2024-04-19T03:01:46.613 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0037794410000000001 2024-04-19T03:01:46.613 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:46.614 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:46.614 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:01:46.614 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.089202+0000", 2024-04-19T03:01:46.614 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.8519000000000002e-05 2024-04-19T03:01:46.614 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:46.614 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:46.614 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:46.614 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:46.614 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:46.614 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-04-19T03:01:46.616 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:01:46.612+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:01:46.617 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T03:01:46.716 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-04-19T03:01:46.713+0000 7f35986ab700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18243) UID: 0 2024-04-19T03:01:46.748 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-19T03:01:46.748 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-04-19T03:01:46.749 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:46.749 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:22673 5.d 5:bb9852af:::benchmark_data_smithi096_19531_object22672:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T03:01:46.749 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:46.742293+0000", 2024-04-19T03:01:46.749 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0064047360000000003, 2024-04-19T03:01:46.749 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0064317549999999999, 2024-04-19T03:01:46.749 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:01:46.749 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:01:46.749 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:01:46.749 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:01:46.749 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:46.749 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 22673 2024-04-19T03:01:46.749 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:46.749 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:01:46.749 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:46.750 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:01:46.750 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:46.742293+0000", 2024-04-19T03:01:46.750 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:46.750 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:46.750 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:46.750 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:01:46.750 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:46.742293+0000", 2024-04-19T03:01:46.750 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:46.750 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:46.750 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:46.750 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:01:46.750 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:46.742291+0000", 2024-04-19T03:01:46.750 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:01:46.751 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:46.751 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:46.751 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:01:46.751 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:46.742364+0000", 2024-04-19T03:01:46.751 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2886999999999995e-05 2024-04-19T03:01:46.751 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:46.751 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:46.751 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:01:46.751 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:46.742377+0000", 2024-04-19T03:01:46.751 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2296000000000001e-05 2024-04-19T03:01:46.751 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:46.751 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:46.751 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:01:46.751 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:46.742386+0000", 2024-04-19T03:01:46.751 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.7270000000000002e-06 2024-04-19T03:01:46.751 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:46.752 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:46.752 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:46.752 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:46.744536+0000", 2024-04-19T03:01:46.752 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0021492220000000001 2024-04-19T03:01:46.752 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:46.752 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:46.752 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:01:46.752 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:46.744719+0000", 2024-04-19T03:01:46.752 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000182888 2024-04-19T03:01:46.752 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:46.752 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:46.752 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-04-19T03:01:46.752 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:46.744875+0000", 2024-04-19T03:01:46.753 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015665500000000001 2024-04-19T03:01:46.753 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:46.753 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:46.753 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:01:46.753 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:46.748038+0000", 2024-04-19T03:01:46.753 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0031629869999999999 2024-04-19T03:01:46.753 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:46.753 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:01:46.753 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:46.753 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:46.753 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:46.753 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:22677 5.d 5:b6f2ab05:::benchmark_data_smithi096_19531_object22676:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T03:01:46.753 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:46.743448+0000", 2024-04-19T03:01:46.753 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0052499909999999999, 2024-04-19T03:01:46.754 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0053722070000000004, 2024-04-19T03:01:46.754 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:01:46.754 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:01:46.754 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:01:46.754 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:01:46.754 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:46.754 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 22677 2024-04-19T03:01:46.754 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:46.754 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:01:46.754 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:46.754 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:01:46.754 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:46.743448+0000", 2024-04-19T03:01:46.755 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:46.755 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:46.755 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:46.755 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:01:46.755 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:46.743448+0000", 2024-04-19T03:01:46.755 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:46.755 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:46.755 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:46.755 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:01:46.755 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:46.743446+0000", 2024-04-19T03:01:46.755 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:01:46.755 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:46.755 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:46.755 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:01:46.755 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:46.743504+0000", 2024-04-19T03:01:46.756 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.804e-05 2024-04-19T03:01:46.756 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:46.756 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:46.756 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:01:46.756 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:46.743519+0000", 2024-04-19T03:01:46.756 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4812e-05 2024-04-19T03:01:46.756 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:46.756 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:46.756 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:01:46.756 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:46.743534+0000", 2024-04-19T03:01:46.756 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4868000000000001e-05 2024-04-19T03:01:46.756 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:46.757 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:46.757 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:46.757 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:46.746339+0000", 2024-04-19T03:01:46.757 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0028049030000000001 2024-04-19T03:01:46.757 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:46.757 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:46.757 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:01:46.757 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:46.746483+0000", 2024-04-19T03:01:46.757 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014405900000000001 2024-04-19T03:01:46.757 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:46.757 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:46.757 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-04-19T03:01:46.757 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:46.746598+0000", 2024-04-19T03:01:46.757 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011466100000000001 2024-04-19T03:01:46.758 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:46.758 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:01:46.758 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:46.758 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:46.758 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:46.758 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:22683 5.d 5:b4d78824:::benchmark_data_smithi096_19531_object22682:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T03:01:46.758 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:46.745858+0000", 2024-04-19T03:01:46.758 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0028398020000000002, 2024-04-19T03:01:46.758 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0030294919999999999, 2024-04-19T03:01:46.758 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:01:46.758 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:01:46.758 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:01:46.758 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:01:46.759 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:46.759 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 22683 2024-04-19T03:01:46.759 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:46.759 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:01:46.759 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:46.759 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:01:46.759 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:46.745858+0000", 2024-04-19T03:01:46.759 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:46.759 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:46.759 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:46.759 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:01:46.759 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:46.745858+0000", 2024-04-19T03:01:46.759 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:46.760 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:46.760 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:46.760 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:01:46.760 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:46.745857+0000", 2024-04-19T03:01:46.760 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:01:46.760 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:46.760 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:46.760 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:01:46.760 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:46.745907+0000", 2024-04-19T03:01:46.760 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0285999999999999e-05 2024-04-19T03:01:46.760 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:46.760 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:46.760 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:01:46.760 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:46.745917+0000", 2024-04-19T03:01:46.760 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.7550000000000006e-06 2024-04-19T03:01:46.760 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:46.761 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:46.761 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:01:46.761 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:46.745923+0000", 2024-04-19T03:01:46.761 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8730000000000004e-06 2024-04-19T03:01:46.761 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:46.761 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:46.761 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:46.761 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:46.748070+0000", 2024-04-19T03:01:46.761 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0021473629999999998 2024-04-19T03:01:46.761 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:46.761 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:46.761 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:01:46.761 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:46.748174+0000", 2024-04-19T03:01:46.762 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010399399999999999 2024-04-19T03:01:46.762 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:46.762 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:46.762 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-04-19T03:01:46.762 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:46.748278+0000", 2024-04-19T03:01:46.762 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010382699999999999 2024-04-19T03:01:46.762 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:46.762 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:01:46.762 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:46.762 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:46.762 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-04-19T03:01:46.762 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 3 2024-04-19T03:01:46.762 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-19T03:01:46.763 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T03:01:46.817 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:01:46.813+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:01:46.820 INFO:tasks.radosbench.radosbench.0.smithi096.stdout: 9 16 22846 22830 158.525 144.5 0.00797271 0.00630091 2024-04-19T03:01:46.887 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-19T03:01:46.888 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-04-19T03:01:46.888 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-04-19T03:01:46.888 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-04-19T03:01:46.888 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-19T03:01:46.899 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T03:01:46.918 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-04-19T03:01:46.913+0000 7f35986ab700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18243) UID: 0 2024-04-19T03:01:47.019 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-04-19T03:01:47.013+0000 7f35986ab700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18243) UID: 0 2024-04-19T03:01:47.031 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-19T03:01:47.031 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-04-19T03:01:47.031 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-04-19T03:01:47.031 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-04-19T03:01:47.031 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.031 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:9 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:01:47.031 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:14.999380+0000", 2024-04-19T03:01:47.031 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 32.029649087000003, 2024-04-19T03:01:47.031 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.019009906, 2024-04-19T03:01:47.031 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:01:47.031 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:47.032 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:01:47.032 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.032 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:01:47.032 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999380+0000", 2024-04-19T03:01:47.032 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:47.032 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.032 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.032 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:01:47.032 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999380+0000", 2024-04-19T03:01:47.032 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:47.032 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.032 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.032 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:01:47.032 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999377+0000", 2024-04-19T03:01:47.033 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999971 2024-04-19T03:01:47.033 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.033 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.033 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:01:47.033 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999393+0000", 2024-04-19T03:01:47.033 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5665999999999999e-05 2024-04-19T03:01:47.033 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.033 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.033 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:01:47.033 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999416+0000", 2024-04-19T03:01:47.033 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3030000000000001e-05 2024-04-19T03:01:47.033 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.033 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.034 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:01:47.034 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999439+0000", 2024-04-19T03:01:47.034 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3203000000000001e-05 2024-04-19T03:01:47.034 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.034 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.034 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:47.034 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999564+0000", 2024-04-19T03:01:47.034 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012492800000000001 2024-04-19T03:01:47.034 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.034 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.034 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op must wait for map", 2024-04-19T03:01:47.034 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999573+0000", 2024-04-19T03:01:47.034 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.7129999999999994e-06 2024-04-19T03:01:47.035 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.035 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.035 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:47.035 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.005623+0000", 2024-04-19T03:01:47.035 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0060502120000000001 2024-04-19T03:01:47.035 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.035 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.035 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:01:47.035 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.006510+0000", 2024-04-19T03:01:47.035 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00088656 2024-04-19T03:01:47.035 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.035 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.035 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-04-19T03:01:47.035 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.008004+0000", 2024-04-19T03:01:47.036 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0014948240000000001 2024-04-19T03:01:47.036 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.036 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.036 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:01:47.036 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.011874+0000", 2024-04-19T03:01:47.036 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0038699630000000001 2024-04-19T03:01:47.036 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.036 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.036 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:47.036 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.018000+0000", 2024-04-19T03:01:47.036 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0061254389999999999 2024-04-19T03:01:47.036 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.036 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.036 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:01:47.037 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.018281+0000", 2024-04-19T03:01:47.037 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00028121400000000001 2024-04-19T03:01:47.037 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.037 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.037 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:01:47.037 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.018390+0000", 2024-04-19T03:01:47.037 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010899 2024-04-19T03:01:47.037 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:47.037 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:01:47.037 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:47.037 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.037 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.037 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:10 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:01:47.037 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:14.999496+0000", 2024-04-19T03:01:47.038 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 32.029533551999997, 2024-04-19T03:01:47.038 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.022720497999999999, 2024-04-19T03:01:47.038 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:01:47.038 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:47.038 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:01:47.038 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.038 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:01:47.038 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999496+0000", 2024-04-19T03:01:47.038 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:47.038 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.038 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.038 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:01:47.038 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999496+0000", 2024-04-19T03:01:47.039 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:47.039 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.039 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.039 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:01:47.039 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999494+0000", 2024-04-19T03:01:47.039 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:01:47.039 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.039 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.039 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:01:47.039 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999503+0000", 2024-04-19T03:01:47.039 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.5930000000000006e-06 2024-04-19T03:01:47.039 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.039 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.040 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:01:47.040 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999523+0000", 2024-04-19T03:01:47.040 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9553000000000001e-05 2024-04-19T03:01:47.040 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.040 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.040 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:01:47.040 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999538+0000", 2024-04-19T03:01:47.040 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5702999999999999e-05 2024-04-19T03:01:47.040 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.040 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.040 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:47.040 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999608+0000", 2024-04-19T03:01:47.040 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.9912000000000004e-05 2024-04-19T03:01:47.040 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.041 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.041 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op must wait for map", 2024-04-19T03:01:47.041 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999626+0000", 2024-04-19T03:01:47.041 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8207e-05 2024-04-19T03:01:47.041 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.041 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.041 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:47.041 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.010765+0000", 2024-04-19T03:01:47.041 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011138719 2024-04-19T03:01:47.041 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.041 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.041 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:01:47.041 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.010906+0000", 2024-04-19T03:01:47.041 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014095899999999999 2024-04-19T03:01:47.042 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.042 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.042 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-04-19T03:01:47.042 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.011472+0000", 2024-04-19T03:01:47.042 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00056629300000000005 2024-04-19T03:01:47.042 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.042 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.042 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:01:47.042 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.013217+0000", 2024-04-19T03:01:47.042 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001744317 2024-04-19T03:01:47.042 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.042 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.042 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:47.042 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.022083+0000", 2024-04-19T03:01:47.043 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0088663849999999992 2024-04-19T03:01:47.043 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.043 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.043 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:01:47.043 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.022124+0000", 2024-04-19T03:01:47.043 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.057e-05 2024-04-19T03:01:47.043 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.043 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.043 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:01:47.043 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.022216+0000", 2024-04-19T03:01:47.043 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.2417000000000006e-05 2024-04-19T03:01:47.043 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:47.043 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:01:47.043 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:47.044 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.044 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.044 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:13 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:01:47.044 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:14.999564+0000", 2024-04-19T03:01:47.044 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 32.029464670000003, 2024-04-19T03:01:47.044 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.019594777000000001, 2024-04-19T03:01:47.044 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:01:47.044 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:47.044 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:01:47.044 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.044 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:01:47.044 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999564+0000", 2024-04-19T03:01:47.044 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:47.044 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.045 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.045 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:01:47.045 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999564+0000", 2024-04-19T03:01:47.045 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:47.045 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.045 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.045 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:01:47.045 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999563+0000", 2024-04-19T03:01:47.045 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:01:47.045 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.045 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.045 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:01:47.045 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999582+0000", 2024-04-19T03:01:47.045 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8151999999999998e-05 2024-04-19T03:01:47.046 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.046 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.046 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:01:47.046 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999599+0000", 2024-04-19T03:01:47.046 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7583000000000001e-05 2024-04-19T03:01:47.046 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.046 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.046 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:01:47.046 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999618+0000", 2024-04-19T03:01:47.046 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8989999999999999e-05 2024-04-19T03:01:47.046 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.046 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.046 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:47.047 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999692+0000", 2024-04-19T03:01:47.047 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3561999999999998e-05 2024-04-19T03:01:47.047 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.047 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.047 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op must wait for map", 2024-04-19T03:01:47.047 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999698+0000", 2024-04-19T03:01:47.047 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7159999999999997e-06 2024-04-19T03:01:47.047 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.047 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.047 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:47.047 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.007836+0000", 2024-04-19T03:01:47.047 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0081376520000000004 2024-04-19T03:01:47.047 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.047 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.048 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:01:47.048 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.008208+0000", 2024-04-19T03:01:47.048 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00037223699999999998 2024-04-19T03:01:47.048 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.048 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.048 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-04-19T03:01:47.048 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.008516+0000", 2024-04-19T03:01:47.048 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000308227 2024-04-19T03:01:47.048 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.048 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.048 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:01:47.048 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.011585+0000", 2024-04-19T03:01:47.048 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0030680659999999999 2024-04-19T03:01:47.048 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.048 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.049 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:47.049 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.018871+0000", 2024-04-19T03:01:47.049 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0072861369999999998 2024-04-19T03:01:47.049 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.049 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.049 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:01:47.049 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.019067+0000", 2024-04-19T03:01:47.049 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00019672099999999999 2024-04-19T03:01:47.049 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.049 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.049 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:01:47.049 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.019159+0000", 2024-04-19T03:01:47.049 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1829999999999993e-05 2024-04-19T03:01:47.049 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:47.050 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:01:47.050 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:47.050 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.050 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.050 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:31 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:01:47.050 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:14.999649+0000", 2024-04-19T03:01:47.050 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 32.029380551999999, 2024-04-19T03:01:47.050 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.018882121000000002, 2024-04-19T03:01:47.050 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:01:47.050 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:47.050 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:01:47.050 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.050 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:01:47.051 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999649+0000", 2024-04-19T03:01:47.051 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:47.051 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.051 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.051 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:01:47.051 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999649+0000", 2024-04-19T03:01:47.051 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:47.051 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.051 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.051 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:01:47.051 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999647+0000", 2024-04-19T03:01:47.051 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:01:47.051 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.051 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.052 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:01:47.052 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999657+0000", 2024-04-19T03:01:47.052 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.3729999999999999e-06 2024-04-19T03:01:47.052 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.052 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.052 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:01:47.052 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999675+0000", 2024-04-19T03:01:47.052 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8522999999999999e-05 2024-04-19T03:01:47.052 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.052 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.052 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:01:47.052 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999689+0000", 2024-04-19T03:01:47.052 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.347e-05 2024-04-19T03:01:47.053 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.053 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.053 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:47.053 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999761+0000", 2024-04-19T03:01:47.053 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.1904999999999997e-05 2024-04-19T03:01:47.053 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.053 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.053 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:01:47.053 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999766+0000", 2024-04-19T03:01:47.053 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6069999999999998e-06 2024-04-19T03:01:47.053 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.053 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.053 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:47.054 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.010040+0000", 2024-04-19T03:01:47.054 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.010273381 2024-04-19T03:01:47.054 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.054 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.054 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:01:47.054 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.010260+0000", 2024-04-19T03:01:47.054 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00022003300000000001 2024-04-19T03:01:47.054 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.054 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.054 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-04-19T03:01:47.055 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.010415+0000", 2024-04-19T03:01:47.055 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015515599999999999 2024-04-19T03:01:47.055 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.055 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.055 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:01:47.055 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.013206+0000", 2024-04-19T03:01:47.055 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0027915010000000001 2024-04-19T03:01:47.055 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.055 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.055 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:47.055 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.018438+0000", 2024-04-19T03:01:47.055 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0052313469999999999 2024-04-19T03:01:47.055 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.056 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.056 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:01:47.056 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.018491+0000", 2024-04-19T03:01:47.056 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3554000000000003e-05 2024-04-19T03:01:47.056 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.056 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.056 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:01:47.056 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.018531+0000", 2024-04-19T03:01:47.056 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9384000000000001e-05 2024-04-19T03:01:47.056 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:47.056 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:01:47.056 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:47.056 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.056 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.057 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:32 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:01:47.057 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:14.999712+0000", 2024-04-19T03:01:47.057 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 32.029317309, 2024-04-19T03:01:47.057 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.022635437000000001, 2024-04-19T03:01:47.057 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:01:47.057 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:47.057 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:01:47.057 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.057 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:01:47.057 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999712+0000", 2024-04-19T03:01:47.057 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:47.057 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.057 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.058 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:01:47.058 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999712+0000", 2024-04-19T03:01:47.058 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:47.058 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.058 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.058 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:01:47.058 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999711+0000", 2024-04-19T03:01:47.058 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:01:47.058 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.058 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.058 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:01:47.058 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999719+0000", 2024-04-19T03:01:47.058 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.354e-06 2024-04-19T03:01:47.059 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.059 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.059 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:01:47.059 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999735+0000", 2024-04-19T03:01:47.059 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6288999999999999e-05 2024-04-19T03:01:47.059 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.059 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.059 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:01:47.059 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999749+0000", 2024-04-19T03:01:47.059 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3492999999999999e-05 2024-04-19T03:01:47.059 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.059 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.059 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:47.060 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999811+0000", 2024-04-19T03:01:47.060 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2298999999999994e-05 2024-04-19T03:01:47.060 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.060 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.060 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:01:47.060 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999817+0000", 2024-04-19T03:01:47.060 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2169999999999999e-06 2024-04-19T03:01:47.060 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.060 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.060 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:47.060 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.011836+0000", 2024-04-19T03:01:47.060 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.012018008 2024-04-19T03:01:47.060 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.061 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.061 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:01:47.061 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.011897+0000", 2024-04-19T03:01:47.061 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1111000000000005e-05 2024-04-19T03:01:47.061 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.061 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.061 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-04-19T03:01:47.061 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.011980+0000", 2024-04-19T03:01:47.061 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3003999999999993e-05 2024-04-19T03:01:47.061 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.061 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.061 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:01:47.061 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.013863+0000", 2024-04-19T03:01:47.062 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001883804 2024-04-19T03:01:47.062 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.062 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.062 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:47.062 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.022257+0000", 2024-04-19T03:01:47.062 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0083938290000000002 2024-04-19T03:01:47.062 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.062 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.062 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:01:47.062 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.022310+0000", 2024-04-19T03:01:47.062 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.236e-05 2024-04-19T03:01:47.062 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.063 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.063 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:01:47.063 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.022347+0000", 2024-04-19T03:01:47.063 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7653e-05 2024-04-19T03:01:47.063 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:47.063 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:01:47.063 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:47.063 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.063 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.063 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:35 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:01:47.063 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:14.999772+0000", 2024-04-19T03:01:47.063 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 32.029257029999997, 2024-04-19T03:01:47.064 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020205530999999999, 2024-04-19T03:01:47.064 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:01:47.064 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:47.064 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:01:47.064 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.064 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:01:47.064 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999772+0000", 2024-04-19T03:01:47.064 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:47.064 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.064 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.064 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:01:47.064 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999772+0000", 2024-04-19T03:01:47.064 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:47.065 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.065 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.065 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:01:47.065 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999771+0000", 2024-04-19T03:01:47.065 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:01:47.065 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.065 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.065 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:01:47.065 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999778+0000", 2024-04-19T03:01:47.065 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2200000000000003e-06 2024-04-19T03:01:47.065 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.065 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.065 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:01:47.066 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999794+0000", 2024-04-19T03:01:47.066 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5798999999999999e-05 2024-04-19T03:01:47.066 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.066 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.066 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:01:47.066 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999809+0000", 2024-04-19T03:01:47.066 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.469e-05 2024-04-19T03:01:47.066 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.066 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.066 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:47.066 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999915+0000", 2024-04-19T03:01:47.066 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000105658 2024-04-19T03:01:47.066 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.067 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.067 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:01:47.067 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999927+0000", 2024-04-19T03:01:47.067 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.201e-05 2024-04-19T03:01:47.067 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.067 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.067 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:47.067 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.009841+0000", 2024-04-19T03:01:47.067 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0099147039999999999 2024-04-19T03:01:47.067 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.067 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.067 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:01:47.067 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.009941+0000", 2024-04-19T03:01:47.068 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.9461000000000002e-05 2024-04-19T03:01:47.068 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.068 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.068 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-04-19T03:01:47.068 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.010101+0000", 2024-04-19T03:01:47.068 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016028599999999999 2024-04-19T03:01:47.068 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.068 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.068 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:01:47.068 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.011787+0000", 2024-04-19T03:01:47.068 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001685513 2024-04-19T03:01:47.068 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.068 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.068 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:47.069 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.019889+0000", 2024-04-19T03:01:47.069 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0081026559999999997 2024-04-19T03:01:47.069 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.069 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.069 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:01:47.069 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.019932+0000", 2024-04-19T03:01:47.069 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2385000000000002e-05 2024-04-19T03:01:47.069 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.069 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.069 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:01:47.069 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.019978+0000", 2024-04-19T03:01:47.069 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6093000000000001e-05 2024-04-19T03:01:47.070 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:47.070 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:01:47.070 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:47.070 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.070 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.070 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:18 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:01:47.070 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:14.999834+0000", 2024-04-19T03:01:47.070 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 32.029194945, 2024-04-19T03:01:47.070 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.019567312999999999, 2024-04-19T03:01:47.070 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:01:47.070 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:47.070 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:01:47.070 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.070 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:01:47.071 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999834+0000", 2024-04-19T03:01:47.071 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:47.071 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.071 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.071 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:01:47.071 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999834+0000", 2024-04-19T03:01:47.071 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:47.071 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.071 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.071 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:01:47.071 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999833+0000", 2024-04-19T03:01:47.071 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:01:47.071 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.071 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.072 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:01:47.072 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999842+0000", 2024-04-19T03:01:47.072 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.2269999999999999e-06 2024-04-19T03:01:47.072 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.072 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.072 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:01:47.072 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999860+0000", 2024-04-19T03:01:47.072 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8456000000000001e-05 2024-04-19T03:01:47.072 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.072 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.072 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:01:47.072 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999874+0000", 2024-04-19T03:01:47.072 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3263e-05 2024-04-19T03:01:47.072 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.073 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.073 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:47.073 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999934+0000", 2024-04-19T03:01:47.073 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0888999999999999e-05 2024-04-19T03:01:47.073 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.073 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.073 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:01:47.073 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999940+0000", 2024-04-19T03:01:47.073 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4330000000000003e-06 2024-04-19T03:01:47.073 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.073 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.073 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:47.073 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.010943+0000", 2024-04-19T03:01:47.073 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011002786000000001 2024-04-19T03:01:47.074 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.074 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.074 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:01:47.074 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.011078+0000", 2024-04-19T03:01:47.074 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013541000000000001 2024-04-19T03:01:47.074 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.074 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.074 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-04-19T03:01:47.074 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.011172+0000", 2024-04-19T03:01:47.074 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.3459000000000001e-05 2024-04-19T03:01:47.074 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.074 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.074 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:01:47.075 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.013211+0000", 2024-04-19T03:01:47.075 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0020397710000000001 2024-04-19T03:01:47.075 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.075 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.075 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:47.075 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.019320+0000", 2024-04-19T03:01:47.075 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0061089969999999997 2024-04-19T03:01:47.075 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.075 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.075 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:01:47.075 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.019364+0000", 2024-04-19T03:01:47.075 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4158e-05 2024-04-19T03:01:47.075 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.075 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.076 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:01:47.076 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.019402+0000", 2024-04-19T03:01:47.076 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7011000000000002e-05 2024-04-19T03:01:47.076 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:47.076 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:01:47.076 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:47.076 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.076 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.076 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:21 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:01:47.076 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:14.999896+0000", 2024-04-19T03:01:47.076 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 32.029133125999998, 2024-04-19T03:01:47.076 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.018618866000000001, 2024-04-19T03:01:47.076 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:01:47.076 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-19T03:01:47.077 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:01:47.077 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.077 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:01:47.077 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999896+0000", 2024-04-19T03:01:47.077 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:47.077 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.077 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.077 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:01:47.077 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999896+0000", 2024-04-19T03:01:47.077 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:47.077 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.077 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.077 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:01:47.078 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999895+0000", 2024-04-19T03:01:47.078 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:01:47.078 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.078 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.078 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:01:47.078 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999901+0000", 2024-04-19T03:01:47.078 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4529999999999999e-06 2024-04-19T03:01:47.078 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.078 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.078 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:01:47.078 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999918+0000", 2024-04-19T03:01:47.078 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6897000000000001e-05 2024-04-19T03:01:47.078 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.078 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.079 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:01:47.079 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999931+0000", 2024-04-19T03:01:47.079 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.309e-05 2024-04-19T03:01:47.079 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.079 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.079 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:47.079 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.000027+0000", 2024-04-19T03:01:47.079 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.5880999999999999e-05 2024-04-19T03:01:47.079 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.079 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.079 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op must wait for map", 2024-04-19T03:01:47.079 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.000040+0000", 2024-04-19T03:01:47.079 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3083e-05 2024-04-19T03:01:47.080 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.080 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.080 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:47.080 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.004961+0000", 2024-04-19T03:01:47.080 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0049206079999999999 2024-04-19T03:01:47.080 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.080 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.080 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:01:47.080 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.005261+0000", 2024-04-19T03:01:47.080 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00030041699999999998 2024-04-19T03:01:47.080 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.080 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.080 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:01:47.080 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.018515+0000", 2024-04-19T03:01:47.081 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013253534000000001 2024-04-19T03:01:47.081 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:47.081 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:01:47.081 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:47.081 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.081 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.081 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:24 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:01:47.081 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:14.999964+0000", 2024-04-19T03:01:47.081 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 32.029065631000002, 2024-04-19T03:01:47.081 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020451446000000002, 2024-04-19T03:01:47.081 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:01:47.081 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-19T03:01:47.081 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:01:47.081 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.082 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:01:47.082 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999964+0000", 2024-04-19T03:01:47.082 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:47.082 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.082 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.082 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:01:47.082 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999964+0000", 2024-04-19T03:01:47.082 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:47.082 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.082 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.082 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:01:47.082 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999963+0000", 2024-04-19T03:01:47.082 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:01:47.082 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.083 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.083 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:01:47.083 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999969+0000", 2024-04-19T03:01:47.083 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0270000000000001e-06 2024-04-19T03:01:47.083 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.083 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.083 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:01:47.083 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999984+0000", 2024-04-19T03:01:47.083 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5903e-05 2024-04-19T03:01:47.083 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.083 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.083 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:01:47.083 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999998+0000", 2024-04-19T03:01:47.083 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3076e-05 2024-04-19T03:01:47.084 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.084 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.084 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:47.084 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.000078+0000", 2024-04-19T03:01:47.084 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0525000000000006e-05 2024-04-19T03:01:47.084 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.084 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.084 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op must wait for map", 2024-04-19T03:01:47.084 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.000084+0000", 2024-04-19T03:01:47.084 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8370000000000002e-06 2024-04-19T03:01:47.084 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.084 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.084 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:47.084 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.008819+0000", 2024-04-19T03:01:47.085 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0087349019999999993 2024-04-19T03:01:47.085 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.085 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.085 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:01:47.085 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.009018+0000", 2024-04-19T03:01:47.085 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000198989 2024-04-19T03:01:47.085 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.085 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.085 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:01:47.085 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.020415+0000", 2024-04-19T03:01:47.085 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011397157 2024-04-19T03:01:47.085 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:47.085 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:01:47.085 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:47.086 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.086 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.086 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:10 5.d 5:bcad0b2c:::benchmark_data_smithi096_19531_object9:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e24)", 2024-04-19T03:01:47.086 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:37.821923+0000", 2024-04-19T03:01:47.086 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 9.2071065589999996, 2024-04-19T03:01:47.086 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.014433605, 2024-04-19T03:01:47.086 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:01:47.086 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:47.086 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:01:47.086 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:01:47.086 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:47.086 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 10 2024-04-19T03:01:47.086 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.086 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:01:47.087 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.087 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:01:47.087 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:37.821923+0000", 2024-04-19T03:01:47.087 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:47.087 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.087 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.087 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:01:47.087 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:37.821923+0000", 2024-04-19T03:01:47.087 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:47.087 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.087 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.087 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:01:47.087 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:37.821922+0000", 2024-04-19T03:01:47.088 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:01:47.088 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.088 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.088 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:01:47.088 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:37.822058+0000", 2024-04-19T03:01:47.088 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013657799999999999 2024-04-19T03:01:47.088 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.088 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.088 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:01:47.088 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:37.822102+0000", 2024-04-19T03:01:47.088 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4255999999999998e-05 2024-04-19T03:01:47.088 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.088 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.088 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:01:47.089 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:37.822118+0000", 2024-04-19T03:01:47.089 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5685999999999999e-05 2024-04-19T03:01:47.089 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.089 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.089 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:47.089 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:37.822198+0000", 2024-04-19T03:01:47.089 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0165000000000002e-05 2024-04-19T03:01:47.089 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.089 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.089 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:01:47.089 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:37.822204+0000", 2024-04-19T03:01:47.089 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4399999999999996e-06 2024-04-19T03:01:47.089 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.089 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.090 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:47.090 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:37.827330+0000", 2024-04-19T03:01:47.090 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0051261120000000004 2024-04-19T03:01:47.090 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.090 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.090 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:01:47.090 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:37.827630+0000", 2024-04-19T03:01:47.090 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00029984400000000001 2024-04-19T03:01:47.090 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.090 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.090 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-04-19T03:01:47.090 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:37.827982+0000", 2024-04-19T03:01:47.090 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00035224300000000002 2024-04-19T03:01:47.091 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.091 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.091 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:01:47.091 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:37.832967+0000", 2024-04-19T03:01:47.091 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0049855810000000002 2024-04-19T03:01:47.091 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.091 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.091 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:47.091 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:37.836261+0000", 2024-04-19T03:01:47.091 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.003293018 2024-04-19T03:01:47.091 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.091 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.091 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:01:47.091 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:37.836296+0000", 2024-04-19T03:01:47.092 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5769999999999998e-05 2024-04-19T03:01:47.092 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.092 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.092 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:01:47.092 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:37.836356+0000", 2024-04-19T03:01:47.092 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9914999999999998e-05 2024-04-19T03:01:47.092 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:47.092 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:01:47.092 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:47.092 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.092 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.092 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:3790 5.d 5:b1320d9c:::benchmark_data_smithi096_19531_object3789:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-19T03:01:47.092 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:39.208695+0000", 2024-04-19T03:01:47.093 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 7.8203339009999997, 2024-04-19T03:01:47.093 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015283936999999999, 2024-04-19T03:01:47.093 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:01:47.093 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:47.093 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:01:47.093 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:01:47.093 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:47.093 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3790 2024-04-19T03:01:47.093 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.093 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:01:47.093 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.093 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:01:47.093 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:39.208695+0000", 2024-04-19T03:01:47.093 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:47.094 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.094 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.094 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:01:47.094 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:39.208695+0000", 2024-04-19T03:01:47.094 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:47.094 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.094 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.094 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:01:47.094 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:39.208694+0000", 2024-04-19T03:01:47.094 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:01:47.094 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.094 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.094 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:01:47.095 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:39.208738+0000", 2024-04-19T03:01:47.095 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3562000000000001e-05 2024-04-19T03:01:47.095 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.095 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.095 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:01:47.095 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:39.208749+0000", 2024-04-19T03:01:47.095 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1505000000000001e-05 2024-04-19T03:01:47.095 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.095 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.095 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:01:47.095 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:39.208759+0000", 2024-04-19T03:01:47.095 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0288999999999999e-05 2024-04-19T03:01:47.095 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.096 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.096 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:47.096 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:39.212745+0000", 2024-04-19T03:01:47.096 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0039855669999999998 2024-04-19T03:01:47.096 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.096 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.096 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:01:47.096 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:39.212900+0000", 2024-04-19T03:01:47.096 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000154568 2024-04-19T03:01:47.096 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.096 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.096 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-04-19T03:01:47.096 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:39.213027+0000", 2024-04-19T03:01:47.096 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000127565 2024-04-19T03:01:47.097 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.097 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.097 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:01:47.097 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:39.215729+0000", 2024-04-19T03:01:47.097 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0027014280000000001 2024-04-19T03:01:47.097 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.097 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.097 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:47.097 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:39.223889+0000", 2024-04-19T03:01:47.097 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0081604650000000004 2024-04-19T03:01:47.097 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.097 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.097 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:01:47.097 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:39.223940+0000", 2024-04-19T03:01:47.098 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1446999999999997e-05 2024-04-19T03:01:47.098 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.098 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.098 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:01:47.098 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:39.223979+0000", 2024-04-19T03:01:47.098 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8748000000000002e-05 2024-04-19T03:01:47.098 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:47.098 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:01:47.098 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:47.098 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.098 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.098 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:3794 5.d 5:be7b5d22:::benchmark_data_smithi096_19531_object3793:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-19T03:01:47.099 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:39.209221+0000", 2024-04-19T03:01:47.099 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 7.8198084970000004, 2024-04-19T03:01:47.099 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015746540999999999, 2024-04-19T03:01:47.099 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:01:47.099 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:47.099 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:01:47.099 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:01:47.099 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:47.099 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3794 2024-04-19T03:01:47.099 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.099 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:01:47.099 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.099 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:01:47.099 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:39.209221+0000", 2024-04-19T03:01:47.100 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:47.100 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.100 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.100 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:01:47.100 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:39.209221+0000", 2024-04-19T03:01:47.100 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:47.100 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.100 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.100 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:01:47.100 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:39.209220+0000", 2024-04-19T03:01:47.101 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:01:47.101 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.101 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.101 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:01:47.101 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:39.209352+0000", 2024-04-19T03:01:47.101 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013184399999999999 2024-04-19T03:01:47.101 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.101 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.101 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:01:47.101 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:39.209369+0000", 2024-04-19T03:01:47.101 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7651000000000001e-05 2024-04-19T03:01:47.101 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.102 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.102 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:01:47.102 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:39.209378+0000", 2024-04-19T03:01:47.102 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9870000000000005e-06 2024-04-19T03:01:47.102 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.102 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.102 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:47.102 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:39.214226+0000", 2024-04-19T03:01:47.102 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0048477579999999998 2024-04-19T03:01:47.102 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.102 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.102 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:01:47.102 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:39.214431+0000", 2024-04-19T03:01:47.102 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00020539899999999999 2024-04-19T03:01:47.103 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.103 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.103 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-04-19T03:01:47.103 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:39.214639+0000", 2024-04-19T03:01:47.103 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00020784500000000001 2024-04-19T03:01:47.103 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.103 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.103 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:01:47.103 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:39.216765+0000", 2024-04-19T03:01:47.103 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.002125198 2024-04-19T03:01:47.103 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.103 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.104 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:47.104 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:39.224861+0000", 2024-04-19T03:01:47.104 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0080968480000000002 2024-04-19T03:01:47.104 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.104 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.104 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:01:47.104 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:39.224914+0000", 2024-04-19T03:01:47.104 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2463000000000002e-05 2024-04-19T03:01:47.104 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.104 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.104 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:01:47.104 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:39.224967+0000", 2024-04-19T03:01:47.105 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3368000000000001e-05 2024-04-19T03:01:47.105 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:47.105 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:01:47.105 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:47.105 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.105 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.105 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:11274 5.e 5:7c846032:::benchmark_data_smithi096_19531_object11273:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T03:01:47.105 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:42.061776+0000", 2024-04-19T03:01:47.105 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 4.9672533860000003, 2024-04-19T03:01:47.105 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.035381001000000002, 2024-04-19T03:01:47.105 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:01:47.105 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:47.105 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:01:47.106 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:01:47.106 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:47.106 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 11274 2024-04-19T03:01:47.106 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.106 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:01:47.106 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.106 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:01:47.106 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.061776+0000", 2024-04-19T03:01:47.106 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:47.106 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.106 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.106 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:01:47.106 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.061776+0000", 2024-04-19T03:01:47.107 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:47.107 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.107 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.107 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:01:47.107 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.061775+0000", 2024-04-19T03:01:47.107 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:01:47.107 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.107 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.107 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:01:47.107 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.061807+0000", 2024-04-19T03:01:47.107 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1733000000000003e-05 2024-04-19T03:01:47.107 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.108 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.108 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:01:47.108 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.061822+0000", 2024-04-19T03:01:47.108 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5452999999999999e-05 2024-04-19T03:01:47.108 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.108 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.108 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:01:47.108 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.061827+0000", 2024-04-19T03:01:47.108 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9810000000000003e-06 2024-04-19T03:01:47.108 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.108 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.108 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:47.109 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.063388+0000", 2024-04-19T03:01:47.109 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0015605720000000001 2024-04-19T03:01:47.109 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.109 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.109 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:01:47.109 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.063612+0000", 2024-04-19T03:01:47.109 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00022431 2024-04-19T03:01:47.109 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.109 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.110 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:01:47.110 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.063747+0000", 2024-04-19T03:01:47.110 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013459600000000001 2024-04-19T03:01:47.110 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.110 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.110 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:01:47.110 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.066186+0000", 2024-04-19T03:01:47.110 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0024388909999999999 2024-04-19T03:01:47.110 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.110 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.110 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:47.111 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.097016+0000", 2024-04-19T03:01:47.111 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.030830705 2024-04-19T03:01:47.111 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.111 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.111 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:01:47.111 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.097096+0000", 2024-04-19T03:01:47.111 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.9469999999999996e-05 2024-04-19T03:01:47.111 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.111 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.111 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:01:47.111 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.097157+0000", 2024-04-19T03:01:47.111 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0884999999999997e-05 2024-04-19T03:01:47.112 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:47.112 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:01:47.112 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:47.112 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.112 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.112 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:11279 5.8 5:10b60c58:::benchmark_data_smithi096_19531_object11278:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T03:01:47.112 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:42.062594+0000", 2024-04-19T03:01:47.112 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 4.9664349479999998, 2024-04-19T03:01:47.112 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.028696788000000001, 2024-04-19T03:01:47.112 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:01:47.112 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:47.112 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:01:47.112 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:01:47.113 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:47.113 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 11279 2024-04-19T03:01:47.113 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.113 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:01:47.113 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.113 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:01:47.113 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.062594+0000", 2024-04-19T03:01:47.113 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:47.113 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.113 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.113 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:01:47.113 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.062594+0000", 2024-04-19T03:01:47.113 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:47.114 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.114 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.114 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:01:47.114 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.062593+0000", 2024-04-19T03:01:47.114 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:01:47.114 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.114 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.114 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:01:47.114 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.062646+0000", 2024-04-19T03:01:47.114 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2293999999999998e-05 2024-04-19T03:01:47.114 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.114 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.114 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:01:47.115 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.062657+0000", 2024-04-19T03:01:47.115 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1440000000000001e-05 2024-04-19T03:01:47.115 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.115 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.115 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:01:47.115 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.062665+0000", 2024-04-19T03:01:47.115 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5159999999999997e-06 2024-04-19T03:01:47.115 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.115 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.115 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:47.115 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.063799+0000", 2024-04-19T03:01:47.115 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0011344860000000001 2024-04-19T03:01:47.115 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.116 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.116 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:01:47.116 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.063962+0000", 2024-04-19T03:01:47.116 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000162614 2024-04-19T03:01:47.116 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.116 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.116 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:01:47.116 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.064167+0000", 2024-04-19T03:01:47.116 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00020491699999999999 2024-04-19T03:01:47.116 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.116 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.116 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:01:47.116 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.066768+0000", 2024-04-19T03:01:47.117 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0026012090000000002 2024-04-19T03:01:47.117 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.117 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.117 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:47.117 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.091184+0000", 2024-04-19T03:01:47.117 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.024416582999999999 2024-04-19T03:01:47.117 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.117 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.117 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:01:47.117 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.091251+0000", 2024-04-19T03:01:47.117 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6753000000000003e-05 2024-04-19T03:01:47.117 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.117 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.118 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:01:47.118 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.091291+0000", 2024-04-19T03:01:47.118 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9841e-05 2024-04-19T03:01:47.118 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:47.118 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:01:47.118 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:47.118 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.118 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.118 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:11282 5.e 5:75b7c510:::benchmark_data_smithi096_19531_object11281:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T03:01:47.118 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:42.062674+0000", 2024-04-19T03:01:47.118 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 4.9663554919999999, 2024-04-19T03:01:47.118 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.034812849, 2024-04-19T03:01:47.119 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:01:47.119 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:47.119 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:01:47.119 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:01:47.119 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:47.119 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 11282 2024-04-19T03:01:47.119 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.119 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:01:47.119 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.119 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:01:47.119 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.062674+0000", 2024-04-19T03:01:47.119 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:47.119 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.120 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.120 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:01:47.120 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.062674+0000", 2024-04-19T03:01:47.120 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:47.120 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.120 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.120 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:01:47.120 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.062673+0000", 2024-04-19T03:01:47.120 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:01:47.120 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.120 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.120 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:01:47.120 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.062712+0000", 2024-04-19T03:01:47.121 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9341999999999997e-05 2024-04-19T03:01:47.121 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.121 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.121 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:01:47.121 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.062721+0000", 2024-04-19T03:01:47.121 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1700000000000003e-06 2024-04-19T03:01:47.121 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.121 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.121 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:01:47.121 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.062729+0000", 2024-04-19T03:01:47.121 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4240000000000004e-06 2024-04-19T03:01:47.121 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.121 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.122 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:47.122 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.065017+0000", 2024-04-19T03:01:47.122 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0022878590000000002 2024-04-19T03:01:47.122 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.122 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.122 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:01:47.122 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.065207+0000", 2024-04-19T03:01:47.122 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000190411 2024-04-19T03:01:47.122 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.122 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.122 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:01:47.122 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.065323+0000", 2024-04-19T03:01:47.123 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000115593 2024-04-19T03:01:47.123 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.123 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.123 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:01:47.123 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.069683+0000", 2024-04-19T03:01:47.123 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0043604409999999996 2024-04-19T03:01:47.123 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.123 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.123 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:47.123 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.097273+0000", 2024-04-19T03:01:47.123 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.027589516000000001 2024-04-19T03:01:47.123 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.123 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.124 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:01:47.124 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.097406+0000", 2024-04-19T03:01:47.124 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000133514 2024-04-19T03:01:47.124 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.124 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.124 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:01:47.124 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.097486+0000", 2024-04-19T03:01:47.124 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0479e-05 2024-04-19T03:01:47.124 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:47.124 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:01:47.124 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:47.124 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.124 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.125 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:11288 5.0 5:042458d0:::benchmark_data_smithi096_19531_object11287:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T03:01:47.125 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:42.070352+0000", 2024-04-19T03:01:47.125 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 4.9586775640000003, 2024-04-19T03:01:47.125 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.021532447, 2024-04-19T03:01:47.125 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:01:47.125 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:47.125 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:01:47.125 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:01:47.125 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:47.125 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 11288 2024-04-19T03:01:47.125 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.125 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:01:47.125 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.126 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:01:47.126 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.070352+0000", 2024-04-19T03:01:47.126 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:47.126 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.126 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.126 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:01:47.126 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.070352+0000", 2024-04-19T03:01:47.126 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:47.126 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.126 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.126 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:01:47.126 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.070351+0000", 2024-04-19T03:01:47.126 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:01:47.127 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.127 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.127 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:01:47.127 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.070392+0000", 2024-04-19T03:01:47.127 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1077e-05 2024-04-19T03:01:47.127 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.127 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.127 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:01:47.127 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.070398+0000", 2024-04-19T03:01:47.127 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1109999999999996e-06 2024-04-19T03:01:47.127 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.127 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.127 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:01:47.127 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.070402+0000", 2024-04-19T03:01:47.128 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2010000000000001e-06 2024-04-19T03:01:47.128 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.128 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.128 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:47.128 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.070445+0000", 2024-04-19T03:01:47.128 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2585e-05 2024-04-19T03:01:47.128 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.128 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.128 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:01:47.128 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.070572+0000", 2024-04-19T03:01:47.128 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012708500000000001 2024-04-19T03:01:47.128 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.128 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.129 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:01:47.129 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.070711+0000", 2024-04-19T03:01:47.129 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013848699999999999 2024-04-19T03:01:47.129 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.129 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.129 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:01:47.129 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.073505+0000", 2024-04-19T03:01:47.129 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0027944620000000002 2024-04-19T03:01:47.129 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.129 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.129 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:47.129 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.091806+0000", 2024-04-19T03:01:47.129 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.018301251000000001 2024-04-19T03:01:47.129 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.130 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.130 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:01:47.130 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.091854+0000", 2024-04-19T03:01:47.130 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7419000000000001e-05 2024-04-19T03:01:47.130 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.130 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.130 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:01:47.130 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.091884+0000", 2024-04-19T03:01:47.130 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0241999999999999e-05 2024-04-19T03:01:47.130 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:47.130 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:01:47.130 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:47.131 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.131 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.131 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:11292 5.0 5:009b2ea9:::benchmark_data_smithi096_19531_object11291:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T03:01:47.131 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:42.070676+0000", 2024-04-19T03:01:47.131 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 4.9583531890000003, 2024-04-19T03:01:47.131 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.02219631, 2024-04-19T03:01:47.131 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:01:47.131 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:47.131 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:01:47.131 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:01:47.131 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:47.131 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 11292 2024-04-19T03:01:47.132 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.132 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:01:47.132 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.132 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:01:47.132 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.070676+0000", 2024-04-19T03:01:47.132 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:47.132 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.132 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.132 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:01:47.132 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.070676+0000", 2024-04-19T03:01:47.132 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:47.132 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.132 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.133 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:01:47.133 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.070675+0000", 2024-04-19T03:01:47.133 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:01:47.133 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.133 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.133 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:01:47.133 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.070800+0000", 2024-04-19T03:01:47.133 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000125263 2024-04-19T03:01:47.133 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.133 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.133 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:01:47.134 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.070808+0000", 2024-04-19T03:01:47.134 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0209999999999999e-06 2024-04-19T03:01:47.134 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.134 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.134 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:01:47.134 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.070814+0000", 2024-04-19T03:01:47.134 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0969999999999996e-06 2024-04-19T03:01:47.134 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.134 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.134 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:47.134 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.071956+0000", 2024-04-19T03:01:47.134 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0011427480000000001 2024-04-19T03:01:47.135 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.135 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.135 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:01:47.135 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.072153+0000", 2024-04-19T03:01:47.135 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000196524 2024-04-19T03:01:47.135 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.135 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.135 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:01:47.135 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.072312+0000", 2024-04-19T03:01:47.135 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015879300000000001 2024-04-19T03:01:47.135 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.135 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.135 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:01:47.136 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.078407+0000", 2024-04-19T03:01:47.136 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0060954929999999996 2024-04-19T03:01:47.136 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.136 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.136 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:47.136 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.092742+0000", 2024-04-19T03:01:47.136 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.014335349000000001 2024-04-19T03:01:47.136 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.136 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.136 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:01:47.136 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.092815+0000", 2024-04-19T03:01:47.136 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2881999999999998e-05 2024-04-19T03:01:47.136 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.137 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.137 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:01:47.137 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.092872+0000", 2024-04-19T03:01:47.137 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6965000000000001e-05 2024-04-19T03:01:47.137 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:47.137 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:01:47.137 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:47.137 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.137 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.138 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:11297 5.e 5:7975ecb6:::benchmark_data_smithi096_19531_object11296:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T03:01:47.138 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:42.076848+0000", 2024-04-19T03:01:47.138 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 4.9521813090000002, 2024-04-19T03:01:47.138 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020867969, 2024-04-19T03:01:47.138 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:01:47.138 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:47.138 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:01:47.138 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:01:47.138 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:47.138 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 11297 2024-04-19T03:01:47.138 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.138 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:01:47.139 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.139 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:01:47.139 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.076848+0000", 2024-04-19T03:01:47.139 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:47.139 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.139 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.139 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:01:47.139 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.076848+0000", 2024-04-19T03:01:47.139 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:47.139 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.139 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.139 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:01:47.140 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.076846+0000", 2024-04-19T03:01:47.140 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:01:47.140 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.140 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.140 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:01:47.140 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.076894+0000", 2024-04-19T03:01:47.140 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7645000000000002e-05 2024-04-19T03:01:47.140 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.140 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.140 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:01:47.140 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.076913+0000", 2024-04-19T03:01:47.140 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8885e-05 2024-04-19T03:01:47.141 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.141 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.141 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:01:47.141 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.076924+0000", 2024-04-19T03:01:47.141 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.118e-05 2024-04-19T03:01:47.141 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.141 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.141 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:47.141 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.076983+0000", 2024-04-19T03:01:47.141 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8952000000000001e-05 2024-04-19T03:01:47.141 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.142 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.142 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:01:47.142 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.077156+0000", 2024-04-19T03:01:47.142 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00017307600000000001 2024-04-19T03:01:47.142 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.142 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.142 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:01:47.142 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.077358+0000", 2024-04-19T03:01:47.142 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000201991 2024-04-19T03:01:47.142 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.142 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.143 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:01:47.143 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.080885+0000", 2024-04-19T03:01:47.143 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0035268309999999998 2024-04-19T03:01:47.143 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.143 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.143 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:47.143 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.097569+0000", 2024-04-19T03:01:47.143 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.016683854000000001 2024-04-19T03:01:47.143 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.143 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.143 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:01:47.143 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.097647+0000", 2024-04-19T03:01:47.143 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.7823000000000004e-05 2024-04-19T03:01:47.143 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.144 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.144 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:01:47.144 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.097716+0000", 2024-04-19T03:01:47.144 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.9079999999999996e-05 2024-04-19T03:01:47.144 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:47.144 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:01:47.144 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:47.144 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.144 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.144 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:11298 5.e 5:72565f0a:::benchmark_data_smithi096_19531_object11297:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T03:01:47.144 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:42.076954+0000", 2024-04-19T03:01:47.144 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 4.9520754350000002, 2024-04-19T03:01:47.144 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020950191999999999, 2024-04-19T03:01:47.144 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:01:47.145 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:47.145 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:01:47.145 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:01:47.145 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:47.145 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 11298 2024-04-19T03:01:47.145 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.145 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:01:47.145 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.145 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:01:47.145 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.076954+0000", 2024-04-19T03:01:47.145 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:47.145 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.145 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.145 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:01:47.146 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.076954+0000", 2024-04-19T03:01:47.146 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:47.146 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.146 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.146 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:01:47.146 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.076953+0000", 2024-04-19T03:01:47.146 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:01:47.146 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.146 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.146 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:01:47.146 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.076997+0000", 2024-04-19T03:01:47.146 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4023000000000002e-05 2024-04-19T03:01:47.147 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.147 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.147 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:01:47.147 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.077009+0000", 2024-04-19T03:01:47.147 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2456000000000001e-05 2024-04-19T03:01:47.147 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.147 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.147 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:01:47.147 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.077015+0000", 2024-04-19T03:01:47.147 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7950000000000004e-06 2024-04-19T03:01:47.147 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.147 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.147 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:47.148 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.078552+0000", 2024-04-19T03:01:47.148 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0015371320000000001 2024-04-19T03:01:47.148 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.148 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.148 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:01:47.148 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.078760+0000", 2024-04-19T03:01:47.148 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00020808799999999999 2024-04-19T03:01:47.148 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.148 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.148 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:01:47.148 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.078875+0000", 2024-04-19T03:01:47.148 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011457500000000001 2024-04-19T03:01:47.148 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.149 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.149 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:01:47.149 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.083603+0000", 2024-04-19T03:01:47.149 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0047276239999999997 2024-04-19T03:01:47.149 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.149 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.149 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:47.149 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.097783+0000", 2024-04-19T03:01:47.149 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.014180036 2024-04-19T03:01:47.149 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.149 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.149 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:01:47.149 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.097863+0000", 2024-04-19T03:01:47.150 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0317999999999999e-05 2024-04-19T03:01:47.150 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.150 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.150 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:01:47.150 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.097904+0000", 2024-04-19T03:01:47.150 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1035000000000003e-05 2024-04-19T03:01:47.150 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:47.150 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:01:47.150 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:47.150 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.150 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.150 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:11299 5.4 5:2fce09a4:::benchmark_data_smithi096_19531_object11298:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T03:01:47.150 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:42.078808+0000", 2024-04-19T03:01:47.151 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 4.9502210380000005, 2024-04-19T03:01:47.151 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.014060319, 2024-04-19T03:01:47.151 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:01:47.151 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:47.151 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:01:47.151 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:01:47.151 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:47.151 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 11299 2024-04-19T03:01:47.151 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.151 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:01:47.151 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.151 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:01:47.151 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.078808+0000", 2024-04-19T03:01:47.151 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:47.152 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.152 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.152 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:01:47.152 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.078808+0000", 2024-04-19T03:01:47.152 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:47.152 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.152 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.152 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:01:47.152 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.078807+0000", 2024-04-19T03:01:47.152 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:01:47.152 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.152 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.152 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:01:47.153 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.078867+0000", 2024-04-19T03:01:47.153 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9802000000000001e-05 2024-04-19T03:01:47.153 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.153 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.153 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:01:47.153 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.078888+0000", 2024-04-19T03:01:47.153 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0818999999999998e-05 2024-04-19T03:01:47.153 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.153 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.153 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:01:47.153 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.078896+0000", 2024-04-19T03:01:47.153 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.7010000000000002e-06 2024-04-19T03:01:47.153 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.153 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.153 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:47.153 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.078946+0000", 2024-04-19T03:01:47.154 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9866e-05 2024-04-19T03:01:47.154 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.154 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.154 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:01:47.154 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.079028+0000", 2024-04-19T03:01:47.154 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1705000000000005e-05 2024-04-19T03:01:47.154 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.154 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.154 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:01:47.154 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.079106+0000", 2024-04-19T03:01:47.154 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.8338999999999997e-05 2024-04-19T03:01:47.154 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.154 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.154 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:01:47.155 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.083673+0000", 2024-04-19T03:01:47.155 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0045672059999999999 2024-04-19T03:01:47.155 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.155 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.155 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:47.155 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.092721+0000", 2024-04-19T03:01:47.155 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0090472260000000002 2024-04-19T03:01:47.155 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.155 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.155 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:01:47.155 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.092806+0000", 2024-04-19T03:01:47.155 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.5575000000000007e-05 2024-04-19T03:01:47.155 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:47.155 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:47.155 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:01:47.155 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.092868+0000", 2024-04-19T03:01:47.156 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2236000000000005e-05 2024-04-19T03:01:47.156 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:47.156 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:01:47.156 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:47.156 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:47.156 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:01:47.156 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-19T03:01:47.156 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-19T03:01:47.158 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T03:01:47.159 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:01:47.153+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:01:47.259 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:01:47.256+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:01:47.292 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-04-19T03:01:47.292 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [ 2024-04-19T03:01:47.293 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.293 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:23917 5.7 5:e507b8e2:::benchmark_data_smithi096_19531_object23916:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T03:01:47.293 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:01:47.283812+0000", 2024-04-19T03:01:47.293 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0064847749999999999, 2024-04-19T03:01:47.293 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0065285330000000004, 2024-04-19T03:01:47.293 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:01:47.293 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:01:47.293 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:01:47.293 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:01:47.293 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:47.293 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 23917 2024-04-19T03:01:47.293 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.293 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:01:47.294 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.294 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:01:47.294 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:47.283812+0000", 2024-04-19T03:01:47.294 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:47.294 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.294 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.294 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:01:47.294 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:47.283812+0000", 2024-04-19T03:01:47.294 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:47.294 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.294 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.294 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:01:47.294 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:47.283811+0000", 2024-04-19T03:01:47.295 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:01:47.295 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.295 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.295 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:01:47.295 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:47.283874+0000", 2024-04-19T03:01:47.295 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3235e-05 2024-04-19T03:01:47.295 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.295 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.295 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:01:47.295 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:47.283885+0000", 2024-04-19T03:01:47.295 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0896e-05 2024-04-19T03:01:47.295 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.295 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.295 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:01:47.296 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:47.283890+0000", 2024-04-19T03:01:47.296 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0320000000000003e-06 2024-04-19T03:01:47.296 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.296 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.296 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:01:47.296 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:47.285594+0000", 2024-04-19T03:01:47.296 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0017039889999999999 2024-04-19T03:01:47.296 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.296 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.296 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:01:47.296 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:47.285758+0000", 2024-04-19T03:01:47.296 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000163411 2024-04-19T03:01:47.296 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.296 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.297 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-04-19T03:01:47.297 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:47.285952+0000", 2024-04-19T03:01:47.297 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00019395799999999999 2024-04-19T03:01:47.297 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:47.297 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:01:47.297 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:47.297 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.297 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.297 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:23918 5.9 5:9640d2ea:::benchmark_data_smithi096_19531_object23917:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T03:01:47.297 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:01:47.283896+0000", 2024-04-19T03:01:47.297 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.006401225, 2024-04-19T03:01:47.297 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0065487760000000001, 2024-04-19T03:01:47.297 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:01:47.298 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:01:47.298 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:01:47.298 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:01:47.298 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:47.298 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 23918 2024-04-19T03:01:47.298 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.298 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:01:47.298 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.298 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:01:47.298 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:47.283896+0000", 2024-04-19T03:01:47.298 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:47.298 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.298 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.299 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:01:47.299 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:47.283896+0000", 2024-04-19T03:01:47.299 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:47.299 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.299 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.299 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:01:47.299 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:47.283895+0000", 2024-04-19T03:01:47.299 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:01:47.299 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.299 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.299 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:01:47.299 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:47.283930+0000", 2024-04-19T03:01:47.300 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4523999999999997e-05 2024-04-19T03:01:47.300 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.300 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.300 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:01:47.300 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:47.283937+0000", 2024-04-19T03:01:47.300 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7859999999999997e-06 2024-04-19T03:01:47.300 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.300 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.300 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:01:47.300 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:47.283942+0000", 2024-04-19T03:01:47.300 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0269999999999997e-06 2024-04-19T03:01:47.300 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.301 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.301 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:01:47.301 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:47.285600+0000", 2024-04-19T03:01:47.301 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0016587730000000001 2024-04-19T03:01:47.301 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.301 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.301 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:01:47.301 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:47.285758+0000", 2024-04-19T03:01:47.301 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000158083 2024-04-19T03:01:47.301 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.301 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.301 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:01:47.301 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:47.285952+0000", 2024-04-19T03:01:47.302 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00019328800000000001 2024-04-19T03:01:47.302 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.302 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.302 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:01:47.302 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:47.289392+0000", 2024-04-19T03:01:47.302 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0034407090000000001 2024-04-19T03:01:47.302 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:47.302 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:01:47.302 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:47.302 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.302 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.302 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:23926 5.7 5:e6cf5a98:::benchmark_data_smithi096_19531_object23925:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T03:01:47.302 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:01:47.289201+0000", 2024-04-19T03:01:47.303 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.001095656, 2024-04-19T03:01:47.303 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0013459050000000001, 2024-04-19T03:01:47.303 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:01:47.303 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:01:47.303 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:01:47.303 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:01:47.303 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:47.303 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 23926 2024-04-19T03:01:47.303 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.303 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:01:47.303 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.303 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:01:47.303 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:47.289201+0000", 2024-04-19T03:01:47.303 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:47.304 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.304 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.304 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:01:47.304 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:47.289201+0000", 2024-04-19T03:01:47.304 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:47.304 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.304 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.304 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:01:47.304 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:47.289200+0000", 2024-04-19T03:01:47.304 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:01:47.305 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.305 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.305 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:01:47.305 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:47.289262+0000", 2024-04-19T03:01:47.305 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1957000000000003e-05 2024-04-19T03:01:47.305 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.305 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.305 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:01:47.305 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:47.289276+0000", 2024-04-19T03:01:47.305 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3641e-05 2024-04-19T03:01:47.305 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.305 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.305 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:01:47.305 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:47.289282+0000", 2024-04-19T03:01:47.306 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0870000000000003e-06 2024-04-19T03:01:47.306 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.306 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.306 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:01:47.306 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:47.289345+0000", 2024-04-19T03:01:47.306 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3242000000000002e-05 2024-04-19T03:01:47.306 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.306 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.306 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:01:47.306 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:47.289477+0000", 2024-04-19T03:01:47.306 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00013253200000000001 2024-04-19T03:01:47.306 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.306 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.307 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-04-19T03:01:47.307 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:47.289586+0000", 2024-04-19T03:01:47.307 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00010889499999999999 2024-04-19T03:01:47.307 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:47.307 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:01:47.307 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:47.307 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.307 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.307 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop_reply(client.4755.0:23917 5.7 e27/22)", 2024-04-19T03:01:47.307 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:01:47.289328+0000", 2024-04-19T03:01:47.307 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.00096865500000000002, 2024-04-19T03:01:47.307 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001299096, 2024-04-19T03:01:47.307 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:01:47.308 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-04-19T03:01:47.308 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:01:47.308 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.308 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:01:47.308 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:47.289328+0000", 2024-04-19T03:01:47.308 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:47.308 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.308 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.308 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:01:47.308 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:47.289328+0000", 2024-04-19T03:01:47.308 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:47.308 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.308 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.309 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:01:47.309 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:47.289328+0000", 2024-04-19T03:01:47.309 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:01:47.309 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.309 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.309 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:01:47.309 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:47.289332+0000", 2024-04-19T03:01:47.309 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0589999999999996e-06 2024-04-19T03:01:47.309 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.309 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.309 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:01:47.309 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:47.289337+0000", 2024-04-19T03:01:47.309 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3340000000000001e-06 2024-04-19T03:01:47.309 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.310 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.310 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:01:47.310 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:47.289343+0000", 2024-04-19T03:01:47.310 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1210000000000003e-06 2024-04-19T03:01:47.310 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:47.310 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:01:47.310 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:47.310 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.310 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.310 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:23927 5.2 5:45da85d2:::benchmark_data_smithi096_19531_object23926:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T03:01:47.310 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:01:47.289419+0000", 2024-04-19T03:01:47.310 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.00087789599999999997, 2024-04-19T03:01:47.310 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001274044, 2024-04-19T03:01:47.311 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:01:47.311 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:01:47.311 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:01:47.311 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:01:47.311 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:47.311 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 23927 2024-04-19T03:01:47.311 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.311 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:01:47.311 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.311 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:01:47.311 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:47.289419+0000", 2024-04-19T03:01:47.311 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:47.311 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.312 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.312 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:01:47.312 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:47.289419+0000", 2024-04-19T03:01:47.312 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:47.312 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.312 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.312 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:01:47.312 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:47.289418+0000", 2024-04-19T03:01:47.312 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:01:47.312 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.312 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.312 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:01:47.312 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:47.289467+0000", 2024-04-19T03:01:47.313 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9283999999999998e-05 2024-04-19T03:01:47.313 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.313 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.313 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:01:47.313 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:47.289481+0000", 2024-04-19T03:01:47.313 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3424999999999999e-05 2024-04-19T03:01:47.313 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.313 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.313 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:01:47.313 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:47.289490+0000", 2024-04-19T03:01:47.313 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.1109999999999997e-06 2024-04-19T03:01:47.313 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.313 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.313 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:01:47.314 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:47.289524+0000", 2024-04-19T03:01:47.314 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4371e-05 2024-04-19T03:01:47.314 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.314 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.314 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:01:47.314 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:47.289616+0000", 2024-04-19T03:01:47.314 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.1844999999999999e-05 2024-04-19T03:01:47.314 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.314 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.314 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-04-19T03:01:47.314 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:47.289694+0000", 2024-04-19T03:01:47.314 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8298000000000001e-05 2024-04-19T03:01:47.314 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:47.315 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:01:47.315 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:47.315 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.315 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.315 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:23929 5.f 5.d465273f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T03:01:47.315 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:01:47.290078+0000", 2024-04-19T03:01:47.315 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.00021890000000000001, 2024-04-19T03:01:47.315 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00070302799999999996, 2024-04-19T03:01:47.315 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:01:47.315 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-04-19T03:01:47.315 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:01:47.315 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:01:47.315 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:47.316 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 23929 2024-04-19T03:01:47.316 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.316 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:01:47.316 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.316 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:01:47.316 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:47.290078+0000", 2024-04-19T03:01:47.316 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:47.316 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.316 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.316 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:01:47.316 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:47.290078+0000", 2024-04-19T03:01:47.316 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:47.316 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.317 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.317 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:01:47.317 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:47.290077+0000", 2024-04-19T03:01:47.317 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:01:47.317 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.317 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.317 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:01:47.317 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:47.290135+0000", 2024-04-19T03:01:47.317 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7917999999999997e-05 2024-04-19T03:01:47.317 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.317 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.317 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:01:47.317 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:47.290155+0000", 2024-04-19T03:01:47.318 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0190000000000002e-05 2024-04-19T03:01:47.318 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.318 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.318 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:01:47.318 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:47.290162+0000", 2024-04-19T03:01:47.318 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2559999999999996e-06 2024-04-19T03:01:47.318 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:47.318 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:01:47.318 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:47.318 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.318 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.318 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:23930 5.1 5:858eb027:::benchmark_data_smithi096_19531_object23929:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T03:01:47.318 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:01:47.290168+0000", 2024-04-19T03:01:47.319 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.00012853499999999999, 2024-04-19T03:01:47.319 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00068569599999999996, 2024-04-19T03:01:47.319 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:01:47.319 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:01:47.319 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:01:47.319 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:01:47.319 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:47.319 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 23930 2024-04-19T03:01:47.319 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.319 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:01:47.319 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.319 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:01:47.320 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:47.290168+0000", 2024-04-19T03:01:47.320 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:47.320 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.320 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.320 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:01:47.320 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:47.290168+0000", 2024-04-19T03:01:47.320 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:47.320 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.320 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.320 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:01:47.320 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:47.290168+0000", 2024-04-19T03:01:47.320 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:01:47.320 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.321 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.321 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:01:47.321 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:47.290306+0000", 2024-04-19T03:01:47.321 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00013826499999999999 2024-04-19T03:01:47.321 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.321 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.321 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:01:47.321 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:47.290315+0000", 2024-04-19T03:01:47.321 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.2159999999999995e-06 2024-04-19T03:01:47.321 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.321 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.321 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:01:47.321 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:47.290320+0000", 2024-04-19T03:01:47.322 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6380000000000003e-06 2024-04-19T03:01:47.322 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.322 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.322 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:01:47.322 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:47.290372+0000", 2024-04-19T03:01:47.322 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2528999999999998e-05 2024-04-19T03:01:47.322 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.322 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.322 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:01:47.322 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:47.290564+0000", 2024-04-19T03:01:47.322 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00019133099999999999 2024-04-19T03:01:47.322 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.323 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.323 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-04-19T03:01:47.323 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:47.290763+0000", 2024-04-19T03:01:47.323 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000199672 2024-04-19T03:01:47.323 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:47.323 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:01:47.323 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:47.323 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:47.323 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-04-19T03:01:47.323 INFO:teuthology.orchestra.run.smithi144.stdout: "num_ops": 7 2024-04-19T03:01:47.323 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-04-19T03:01:47.325 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T03:01:47.360 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-04-19T03:01:47.353+0000 7f35986ab700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18243) UID: 0 2024-04-19T03:01:47.458 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-04-19T03:01:47.458 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2024-04-19T03:01:47.458 INFO:teuthology.orchestra.run.smithi144.stdout: "complaint_time": 30, 2024-04-19T03:01:47.458 INFO:teuthology.orchestra.run.smithi144.stdout: "num_blocked_ops": 0 2024-04-19T03:01:47.459 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-04-19T03:01:47.462 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-04-19T03:01:47.457+0000 7f35986ab700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18243) UID: 0 2024-04-19T03:01:47.471 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T03:01:47.562 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:01:47.560+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:01:47.597 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-04-19T03:01:47.597 INFO:teuthology.orchestra.run.smithi144.stdout: "size": 20, 2024-04-19T03:01:47.598 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 600, 2024-04-19T03:01:47.598 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [ 2024-04-19T03:01:47.598 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.598 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4159.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-19T03:01:47.598 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:01:07.935397+0000", 2024-04-19T03:01:47.598 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 39.657921623, 2024-04-19T03:01:47.598 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.020241816999999999, 2024-04-19T03:01:47.598 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:01:47.598 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:47.598 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:01:47.598 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4159", 2024-04-19T03:01:47.598 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3589238956", 2024-04-19T03:01:47.599 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 116 2024-04-19T03:01:47.599 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.599 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:01:47.599 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.599 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:01:47.599 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:07.935397+0000", 2024-04-19T03:01:47.599 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:47.599 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.599 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.599 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:01:47.599 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:07.935397+0000", 2024-04-19T03:01:47.599 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:47.599 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.600 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.600 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:01:47.600 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:07.935396+0000", 2024-04-19T03:01:47.600 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999986 2024-04-19T03:01:47.600 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.600 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.600 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:01:47.600 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:07.935407+0000", 2024-04-19T03:01:47.600 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0842999999999999e-05 2024-04-19T03:01:47.600 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.600 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.600 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:01:47.600 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:07.935424+0000", 2024-04-19T03:01:47.600 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7193e-05 2024-04-19T03:01:47.601 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.601 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.601 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:01:47.601 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:07.935440+0000", 2024-04-19T03:01:47.601 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.626e-05 2024-04-19T03:01:47.601 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.601 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.601 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:01:47.601 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:07.950487+0000", 2024-04-19T03:01:47.601 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.015046992 2024-04-19T03:01:47.601 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.601 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.601 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:01:47.602 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:07.950602+0000", 2024-04-19T03:01:47.602 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000115048 2024-04-19T03:01:47.602 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.602 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.602 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:01:47.602 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:07.950693+0000", 2024-04-19T03:01:47.602 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.1364000000000001e-05 2024-04-19T03:01:47.602 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.602 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.602 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:01:47.602 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:07.951956+0000", 2024-04-19T03:01:47.602 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001262832 2024-04-19T03:01:47.603 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.603 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.603 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:47.603 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:07.955473+0000", 2024-04-19T03:01:47.603 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0035168209999999998 2024-04-19T03:01:47.603 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.603 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.603 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:01:47.603 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:07.955570+0000", 2024-04-19T03:01:47.603 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.7175000000000004e-05 2024-04-19T03:01:47.603 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.603 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.604 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:01:47.604 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:07.955639+0000", 2024-04-19T03:01:47.604 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8699000000000001e-05 2024-04-19T03:01:47.604 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:47.604 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:01:47.604 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:47.604 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.604 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.604 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4159.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-19T03:01:47.604 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:01:07.935454+0000", 2024-04-19T03:01:47.604 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 39.657864941, 2024-04-19T03:01:47.604 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.020337788999999998, 2024-04-19T03:01:47.604 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:01:47.605 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:47.605 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:01:47.605 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4159", 2024-04-19T03:01:47.605 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3589238956", 2024-04-19T03:01:47.605 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 117 2024-04-19T03:01:47.605 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.605 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:01:47.605 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.605 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:01:47.605 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:07.935454+0000", 2024-04-19T03:01:47.605 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:47.605 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.605 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.606 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:01:47.606 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:07.935454+0000", 2024-04-19T03:01:47.606 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:47.606 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.606 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.606 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:01:47.606 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:07.935453+0000", 2024-04-19T03:01:47.606 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:01:47.606 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.606 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.606 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:01:47.606 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:07.935464+0000", 2024-04-19T03:01:47.607 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1409999999999999e-05 2024-04-19T03:01:47.607 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.607 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.607 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:01:47.607 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:07.935485+0000", 2024-04-19T03:01:47.607 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0380000000000001e-05 2024-04-19T03:01:47.607 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.607 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.607 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:01:47.607 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:07.935501+0000", 2024-04-19T03:01:47.607 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6419999999999999e-05 2024-04-19T03:01:47.607 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.608 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.608 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:01:47.608 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:07.951288+0000", 2024-04-19T03:01:47.608 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.015786969000000001 2024-04-19T03:01:47.608 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.608 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.608 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:01:47.608 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:07.951404+0000", 2024-04-19T03:01:47.608 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000115977 2024-04-19T03:01:47.608 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.608 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.608 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:01:47.608 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:07.951629+0000", 2024-04-19T03:01:47.609 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000224634 2024-04-19T03:01:47.609 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.609 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.609 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:01:47.609 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:07.952689+0000", 2024-04-19T03:01:47.609 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001060374 2024-04-19T03:01:47.609 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.609 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.609 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:47.609 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:07.955706+0000", 2024-04-19T03:01:47.609 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0030169149999999998 2024-04-19T03:01:47.609 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.609 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.609 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:01:47.610 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:07.955741+0000", 2024-04-19T03:01:47.610 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5160999999999998e-05 2024-04-19T03:01:47.610 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.610 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.610 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:01:47.610 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:07.955792+0000", 2024-04-19T03:01:47.610 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0609000000000003e-05 2024-04-19T03:01:47.610 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:47.610 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:01:47.611 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:47.611 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.611 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.611 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4159.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-19T03:01:47.611 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:01:08.150835+0000", 2024-04-19T03:01:47.611 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 39.442483373999998, 2024-04-19T03:01:47.611 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.020342419, 2024-04-19T03:01:47.611 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:01:47.611 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:47.612 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:01:47.612 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4159", 2024-04-19T03:01:47.612 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3589238956", 2024-04-19T03:01:47.612 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 139 2024-04-19T03:01:47.612 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.612 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:01:47.612 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.612 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:01:47.612 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.150835+0000", 2024-04-19T03:01:47.612 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:47.612 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.612 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.613 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:01:47.613 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.150835+0000", 2024-04-19T03:01:47.613 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:47.613 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.613 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.613 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:01:47.613 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.150834+0000", 2024-04-19T03:01:47.613 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:01:47.613 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.613 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.613 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:01:47.613 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.150844+0000", 2024-04-19T03:01:47.613 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.927e-06 2024-04-19T03:01:47.614 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.614 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.614 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:01:47.614 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.150866+0000", 2024-04-19T03:01:47.614 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.211e-05 2024-04-19T03:01:47.614 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.614 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.614 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:01:47.614 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.150899+0000", 2024-04-19T03:01:47.614 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2452e-05 2024-04-19T03:01:47.614 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.614 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.615 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:01:47.615 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.167067+0000", 2024-04-19T03:01:47.615 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.016167737000000001 2024-04-19T03:01:47.615 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.615 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.615 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:01:47.615 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.167210+0000", 2024-04-19T03:01:47.615 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00014319300000000001 2024-04-19T03:01:47.615 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.615 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.615 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:01:47.615 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.167389+0000", 2024-04-19T03:01:47.616 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000179075 2024-04-19T03:01:47.616 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.616 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.616 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:01:47.616 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.170083+0000", 2024-04-19T03:01:47.616 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.002694307 2024-04-19T03:01:47.616 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.616 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.616 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:47.616 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.171088+0000", 2024-04-19T03:01:47.616 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001004429 2024-04-19T03:01:47.616 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.616 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.616 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:01:47.617 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.171147+0000", 2024-04-19T03:01:47.617 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9197999999999998e-05 2024-04-19T03:01:47.617 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.617 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.617 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:01:47.617 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.171178+0000", 2024-04-19T03:01:47.617 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.1137999999999999e-05 2024-04-19T03:01:47.617 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:47.617 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:01:47.617 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:47.617 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.617 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.617 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4159.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-19T03:01:47.617 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:01:08.150915+0000", 2024-04-19T03:01:47.618 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 39.442403698, 2024-04-19T03:01:47.618 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.020502679999999999, 2024-04-19T03:01:47.618 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:01:47.618 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:47.618 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:01:47.618 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4159", 2024-04-19T03:01:47.618 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3589238956", 2024-04-19T03:01:47.618 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 140 2024-04-19T03:01:47.618 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.618 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:01:47.618 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.619 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:01:47.619 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.150915+0000", 2024-04-19T03:01:47.619 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:47.619 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.619 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.619 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:01:47.619 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.150915+0000", 2024-04-19T03:01:47.619 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:47.619 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.619 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.619 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:01:47.619 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.150914+0000", 2024-04-19T03:01:47.619 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999986 2024-04-19T03:01:47.620 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.620 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.620 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:01:47.620 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.151066+0000", 2024-04-19T03:01:47.620 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00015186400000000001 2024-04-19T03:01:47.620 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.620 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.620 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:01:47.620 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.151120+0000", 2024-04-19T03:01:47.620 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4042999999999997e-05 2024-04-19T03:01:47.620 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.620 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.620 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:01:47.620 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.151155+0000", 2024-04-19T03:01:47.621 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4941999999999999e-05 2024-04-19T03:01:47.621 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.621 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.621 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:01:47.621 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.168222+0000", 2024-04-19T03:01:47.621 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.017066939999999999 2024-04-19T03:01:47.621 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.621 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.621 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:01:47.621 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.168305+0000", 2024-04-19T03:01:47.621 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.3642999999999999e-05 2024-04-19T03:01:47.622 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.622 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.622 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:01:47.622 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.168385+0000", 2024-04-19T03:01:47.622 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9647999999999994e-05 2024-04-19T03:01:47.622 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.622 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.622 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:01:47.622 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.170514+0000", 2024-04-19T03:01:47.622 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0021286370000000001 2024-04-19T03:01:47.622 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.623 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.623 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:47.623 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.171252+0000", 2024-04-19T03:01:47.623 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00073828499999999998 2024-04-19T03:01:47.623 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.623 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.623 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:01:47.623 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.171353+0000", 2024-04-19T03:01:47.623 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000100839 2024-04-19T03:01:47.623 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.623 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.623 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:01:47.623 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.171418+0000", 2024-04-19T03:01:47.623 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5048999999999993e-05 2024-04-19T03:01:47.624 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:47.624 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:01:47.624 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:47.624 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.624 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.624 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4159.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-19T03:01:47.624 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:01:08.151173+0000", 2024-04-19T03:01:47.624 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 39.442146176000001, 2024-04-19T03:01:47.624 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.023083023000000001, 2024-04-19T03:01:47.624 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:01:47.624 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:47.624 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:01:47.624 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4159", 2024-04-19T03:01:47.625 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3589238956", 2024-04-19T03:01:47.625 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 141 2024-04-19T03:01:47.625 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.625 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:01:47.625 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.625 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:01:47.625 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.151173+0000", 2024-04-19T03:01:47.625 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:47.625 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.625 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.625 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:01:47.625 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.151173+0000", 2024-04-19T03:01:47.625 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:47.625 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.626 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.626 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:01:47.626 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.151171+0000", 2024-04-19T03:01:47.626 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:01:47.626 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.626 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.626 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:01:47.626 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.151182+0000", 2024-04-19T03:01:47.626 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0730000000000001e-05 2024-04-19T03:01:47.626 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.627 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.627 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:01:47.627 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.151203+0000", 2024-04-19T03:01:47.627 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0387e-05 2024-04-19T03:01:47.627 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.627 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.627 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:01:47.627 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.151225+0000", 2024-04-19T03:01:47.627 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2643e-05 2024-04-19T03:01:47.627 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.627 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.627 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:01:47.627 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.169207+0000", 2024-04-19T03:01:47.627 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.017981561 2024-04-19T03:01:47.628 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.628 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.628 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:01:47.628 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.169386+0000", 2024-04-19T03:01:47.628 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000178758 2024-04-19T03:01:47.628 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.628 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.628 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:01:47.629 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.169546+0000", 2024-04-19T03:01:47.629 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000160781 2024-04-19T03:01:47.629 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.629 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.629 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:01:47.629 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.171444+0000", 2024-04-19T03:01:47.629 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0018980309999999999 2024-04-19T03:01:47.630 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.630 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.630 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:47.630 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.174165+0000", 2024-04-19T03:01:47.630 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0027204920000000001 2024-04-19T03:01:47.631 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.631 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.631 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:01:47.631 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.174228+0000", 2024-04-19T03:01:47.631 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2774000000000006e-05 2024-04-19T03:01:47.631 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.632 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.632 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:01:47.632 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.174256+0000", 2024-04-19T03:01:47.632 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.8045999999999999e-05 2024-04-19T03:01:47.632 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:47.632 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:01:47.633 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:47.633 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.633 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.633 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4159.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-19T03:01:47.633 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:01:08.347807+0000", 2024-04-19T03:01:47.633 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 39.245512167999998, 2024-04-19T03:01:47.634 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.021589991999999999, 2024-04-19T03:01:47.634 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:01:47.634 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:47.634 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:01:47.634 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4159", 2024-04-19T03:01:47.634 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3589238956", 2024-04-19T03:01:47.634 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 165 2024-04-19T03:01:47.635 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.635 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:01:47.635 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.635 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:01:47.635 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.347807+0000", 2024-04-19T03:01:47.635 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:47.636 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.636 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.636 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:01:47.636 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.347807+0000", 2024-04-19T03:01:47.636 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:47.636 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.637 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.637 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:01:47.637 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.347806+0000", 2024-04-19T03:01:47.637 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:01:47.637 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.637 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.638 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:01:47.638 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.347812+0000", 2024-04-19T03:01:47.638 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.066e-06 2024-04-19T03:01:47.638 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.638 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.638 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:01:47.639 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.347818+0000", 2024-04-19T03:01:47.639 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5550000000000002e-06 2024-04-19T03:01:47.639 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.639 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.639 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:01:47.639 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.347822+0000", 2024-04-19T03:01:47.639 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.561e-06 2024-04-19T03:01:47.640 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.640 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.640 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:01:47.640 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.365703+0000", 2024-04-19T03:01:47.640 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.017880566000000001 2024-04-19T03:01:47.640 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.641 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.641 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:01:47.641 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.365805+0000", 2024-04-19T03:01:47.641 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00010213900000000001 2024-04-19T03:01:47.641 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.641 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.641 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:01:47.642 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.365928+0000", 2024-04-19T03:01:47.642 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00012337900000000001 2024-04-19T03:01:47.642 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.642 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.642 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:47.642 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.367353+0000", 2024-04-19T03:01:47.643 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001424397 2024-04-19T03:01:47.643 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.643 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.643 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:01:47.643 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.369260+0000", 2024-04-19T03:01:47.643 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0019069130000000001 2024-04-19T03:01:47.644 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.644 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.644 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:01:47.644 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.369342+0000", 2024-04-19T03:01:47.644 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2423999999999996e-05 2024-04-19T03:01:47.644 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.645 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.645 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:01:47.645 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.369397+0000", 2024-04-19T03:01:47.645 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4481999999999998e-05 2024-04-19T03:01:47.645 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:47.645 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:01:47.646 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:47.646 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.646 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.646 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4159.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-19T03:01:47.647 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:01:08.539135+0000", 2024-04-19T03:01:47.647 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 39.054183909999999, 2024-04-19T03:01:47.647 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.021590602, 2024-04-19T03:01:47.647 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:01:47.647 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:47.648 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:01:47.648 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4159", 2024-04-19T03:01:47.648 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3589238956", 2024-04-19T03:01:47.648 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 188 2024-04-19T03:01:47.648 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.648 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:01:47.648 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.649 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:01:47.649 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.539135+0000", 2024-04-19T03:01:47.649 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:47.649 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.649 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.649 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:01:47.650 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.539135+0000", 2024-04-19T03:01:47.650 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:47.650 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.650 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.650 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:01:47.650 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.539134+0000", 2024-04-19T03:01:47.650 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:01:47.651 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.651 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.651 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:01:47.651 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.539228+0000", 2024-04-19T03:01:47.651 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.3771999999999996e-05 2024-04-19T03:01:47.651 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.651 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.651 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:01:47.651 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.539243+0000", 2024-04-19T03:01:47.651 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4707e-05 2024-04-19T03:01:47.652 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.652 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.652 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:01:47.652 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.539250+0000", 2024-04-19T03:01:47.652 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7190000000000001e-06 2024-04-19T03:01:47.652 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.652 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.652 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:01:47.652 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.553787+0000", 2024-04-19T03:01:47.652 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.014536248999999999 2024-04-19T03:01:47.652 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.652 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.653 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:01:47.653 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.553857+0000", 2024-04-19T03:01:47.653 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0675999999999999e-05 2024-04-19T03:01:47.653 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.653 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.653 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:01:47.653 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.553953+0000", 2024-04-19T03:01:47.653 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.5420999999999993e-05 2024-04-19T03:01:47.653 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.653 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.653 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:01:47.653 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.555569+0000", 2024-04-19T03:01:47.653 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001616625 2024-04-19T03:01:47.653 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.653 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.654 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:47.654 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.560644+0000", 2024-04-19T03:01:47.654 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0050749660000000002 2024-04-19T03:01:47.654 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.654 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.654 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:01:47.654 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.560690+0000", 2024-04-19T03:01:47.655 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6041000000000002e-05 2024-04-19T03:01:47.655 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.655 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.655 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:01:47.655 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.560726+0000", 2024-04-19T03:01:47.655 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5188999999999998e-05 2024-04-19T03:01:47.655 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:47.655 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:01:47.656 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:47.656 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.656 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.656 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4159.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-19T03:01:47.656 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:01:08.539259+0000", 2024-04-19T03:01:47.656 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 39.054059442000003, 2024-04-19T03:01:47.656 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.021552071999999999, 2024-04-19T03:01:47.657 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:01:47.657 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:47.657 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:01:47.657 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4159", 2024-04-19T03:01:47.657 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3589238956", 2024-04-19T03:01:47.657 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 189 2024-04-19T03:01:47.657 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.657 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:01:47.658 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.658 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:01:47.658 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.539259+0000", 2024-04-19T03:01:47.658 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:47.658 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.658 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.658 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:01:47.659 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.539259+0000", 2024-04-19T03:01:47.659 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:47.659 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.659 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.659 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:01:47.659 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.539259+0000", 2024-04-19T03:01:47.660 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:01:47.660 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.660 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.660 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:01:47.660 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.539268+0000", 2024-04-19T03:01:47.660 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.5359999999999998e-06 2024-04-19T03:01:47.661 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.661 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.661 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:01:47.661 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.539291+0000", 2024-04-19T03:01:47.661 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2687000000000001e-05 2024-04-19T03:01:47.661 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.661 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.662 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:01:47.662 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.539298+0000", 2024-04-19T03:01:47.662 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.883e-06 2024-04-19T03:01:47.662 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.662 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.662 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:01:47.662 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.554957+0000", 2024-04-19T03:01:47.662 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.015659019999999999 2024-04-19T03:01:47.663 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.663 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.663 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:01:47.663 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.555010+0000", 2024-04-19T03:01:47.663 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2985999999999997e-05 2024-04-19T03:01:47.663 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.664 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.664 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:01:47.664 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.555094+0000", 2024-04-19T03:01:47.664 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4530000000000006e-05 2024-04-19T03:01:47.664 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.664 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.664 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:01:47.665 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.556093+0000", 2024-04-19T03:01:47.665 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00099903300000000008 2024-04-19T03:01:47.665 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.665 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.665 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:47.665 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.560759+0000", 2024-04-19T03:01:47.666 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0046654369999999997 2024-04-19T03:01:47.666 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.666 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.666 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:01:47.666 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.560789+0000", 2024-04-19T03:01:47.666 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0638e-05 2024-04-19T03:01:47.666 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.667 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.667 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:01:47.667 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.560811+0000", 2024-04-19T03:01:47.667 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2167999999999998e-05 2024-04-19T03:01:47.667 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:47.667 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:01:47.667 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:47.667 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.667 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.667 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:8 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:01:47.668 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:01:14.998165+0000", 2024-04-19T03:01:47.668 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 32.595153760999999, 2024-04-19T03:01:47.668 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.024541001, 2024-04-19T03:01:47.668 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:01:47.668 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:47.668 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:01:47.668 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.668 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:01:47.668 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998165+0000", 2024-04-19T03:01:47.668 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:47.668 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.668 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.668 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:01:47.669 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998165+0000", 2024-04-19T03:01:47.669 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:47.669 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.669 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.669 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:01:47.669 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998164+0000", 2024-04-19T03:01:47.669 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:01:47.669 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.669 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.669 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:01:47.669 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998170+0000", 2024-04-19T03:01:47.669 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2939999999999996e-06 2024-04-19T03:01:47.669 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.670 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.670 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:01:47.670 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998179+0000", 2024-04-19T03:01:47.670 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.5540000000000003e-06 2024-04-19T03:01:47.670 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.670 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.670 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:01:47.670 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998188+0000", 2024-04-19T03:01:47.670 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2959999999999999e-06 2024-04-19T03:01:47.670 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.670 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.670 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:01:47.670 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998332+0000", 2024-04-19T03:01:47.671 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00014474 2024-04-19T03:01:47.671 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.673 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.674 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:01:47.674 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998337+0000", 2024-04-19T03:01:47.674 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6909999999999996e-06 2024-04-19T03:01:47.674 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.674 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.674 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:01:47.674 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.010222+0000", 2024-04-19T03:01:47.674 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011885178 2024-04-19T03:01:47.674 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.675 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.675 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:01:47.675 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.010342+0000", 2024-04-19T03:01:47.675 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00011991500000000001 2024-04-19T03:01:47.675 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.675 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.675 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:01:47.675 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.010506+0000", 2024-04-19T03:01:47.675 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00016429699999999999 2024-04-19T03:01:47.675 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.675 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.675 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:01:47.675 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.014525+0000", 2024-04-19T03:01:47.675 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0040189839999999998 2024-04-19T03:01:47.675 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.676 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.676 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:47.676 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.022600+0000", 2024-04-19T03:01:47.676 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0080741990000000007 2024-04-19T03:01:47.676 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.676 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.676 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:01:47.676 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.022670+0000", 2024-04-19T03:01:47.676 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0743999999999999e-05 2024-04-19T03:01:47.676 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.677 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.677 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:01:47.677 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.022706+0000", 2024-04-19T03:01:47.677 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5782999999999999e-05 2024-04-19T03:01:47.677 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:47.677 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:01:47.677 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:47.677 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.677 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.677 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:27 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:01:47.677 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:01:14.998436+0000", 2024-04-19T03:01:47.677 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 32.594883107000001, 2024-04-19T03:01:47.677 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.024406325999999999, 2024-04-19T03:01:47.677 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:01:47.678 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:47.678 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:01:47.678 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.678 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:01:47.678 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998436+0000", 2024-04-19T03:01:47.678 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:47.678 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.678 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.679 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:01:47.679 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998436+0000", 2024-04-19T03:01:47.679 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:47.679 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.679 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.680 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:01:47.680 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998435+0000", 2024-04-19T03:01:47.680 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:01:47.680 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.680 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.680 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:01:47.680 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998445+0000", 2024-04-19T03:01:47.680 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0349e-05 2024-04-19T03:01:47.681 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.681 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.681 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:01:47.681 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998453+0000", 2024-04-19T03:01:47.681 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0399999999999993e-06 2024-04-19T03:01:47.681 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.681 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.681 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:01:47.681 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998461+0000", 2024-04-19T03:01:47.681 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9780000000000005e-06 2024-04-19T03:01:47.681 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.681 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.681 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:01:47.681 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998515+0000", 2024-04-19T03:01:47.682 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3097999999999999e-05 2024-04-19T03:01:47.682 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.682 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.682 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:01:47.682 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998520+0000", 2024-04-19T03:01:47.682 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9220000000000002e-06 2024-04-19T03:01:47.682 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.682 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.682 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:01:47.682 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.011258+0000", 2024-04-19T03:01:47.682 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.012737735 2024-04-19T03:01:47.682 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.683 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.683 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:01:47.683 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.011566+0000", 2024-04-19T03:01:47.683 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00030826200000000001 2024-04-19T03:01:47.683 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.683 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.683 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:01:47.683 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.011996+0000", 2024-04-19T03:01:47.683 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00042912000000000001 2024-04-19T03:01:47.683 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.683 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.683 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:01:47.683 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.014533+0000", 2024-04-19T03:01:47.684 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.002537423 2024-04-19T03:01:47.684 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.684 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.684 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:47.684 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.022756+0000", 2024-04-19T03:01:47.684 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0082231530000000004 2024-04-19T03:01:47.684 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.684 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.684 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:01:47.684 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.022807+0000", 2024-04-19T03:01:47.684 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0852e-05 2024-04-19T03:01:47.685 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.685 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.685 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:01:47.685 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.022842+0000", 2024-04-19T03:01:47.685 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5058000000000002e-05 2024-04-19T03:01:47.685 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:47.685 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:01:47.685 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:47.685 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.685 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.686 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:28 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:01:47.686 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:01:14.998476+0000", 2024-04-19T03:01:47.686 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 32.594843185000002, 2024-04-19T03:01:47.686 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.024656784000000001, 2024-04-19T03:01:47.686 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:01:47.686 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:47.687 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:01:47.687 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.687 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:01:47.687 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998476+0000", 2024-04-19T03:01:47.687 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:47.687 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.688 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.688 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:01:47.688 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998476+0000", 2024-04-19T03:01:47.688 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:47.688 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.689 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.689 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:01:47.689 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998475+0000", 2024-04-19T03:01:47.689 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:01:47.689 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.689 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.689 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:01:47.690 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998484+0000", 2024-04-19T03:01:47.690 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.7770000000000008e-06 2024-04-19T03:01:47.690 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.690 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.690 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:01:47.690 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998495+0000", 2024-04-19T03:01:47.691 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0726e-05 2024-04-19T03:01:47.691 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.691 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.691 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:01:47.691 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998503+0000", 2024-04-19T03:01:47.692 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.8780000000000004e-06 2024-04-19T03:01:47.692 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.692 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.692 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:01:47.692 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998579+0000", 2024-04-19T03:01:47.692 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5160999999999994e-05 2024-04-19T03:01:47.692 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.692 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.692 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:01:47.692 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998586+0000", 2024-04-19T03:01:47.693 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8520000000000004e-06 2024-04-19T03:01:47.693 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.693 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.693 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:01:47.693 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.012423+0000", 2024-04-19T03:01:47.693 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.013836667 2024-04-19T03:01:47.693 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.694 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.694 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:01:47.694 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.012532+0000", 2024-04-19T03:01:47.694 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000108565 2024-04-19T03:01:47.694 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.694 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.694 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:01:47.694 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.012655+0000", 2024-04-19T03:01:47.695 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00012344600000000001 2024-04-19T03:01:47.695 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.695 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.695 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:01:47.695 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.015680+0000", 2024-04-19T03:01:47.695 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0030246470000000001 2024-04-19T03:01:47.695 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.695 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.695 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:47.696 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.023091+0000", 2024-04-19T03:01:47.696 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0074116030000000001 2024-04-19T03:01:47.696 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.696 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.696 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:01:47.696 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.023115+0000", 2024-04-19T03:01:47.696 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.3091999999999998e-05 2024-04-19T03:01:47.696 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.697 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.697 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:01:47.697 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.023132+0000", 2024-04-19T03:01:47.697 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7901999999999999e-05 2024-04-19T03:01:47.697 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:47.697 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:01:47.697 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:47.697 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.697 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.698 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:29 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:01:47.698 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:01:14.998527+0000", 2024-04-19T03:01:47.698 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 32.594791645000001, 2024-04-19T03:01:47.698 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.024738599999999999, 2024-04-19T03:01:47.698 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:01:47.698 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:47.698 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:01:47.699 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.699 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:01:47.699 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998527+0000", 2024-04-19T03:01:47.699 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:47.699 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.699 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.699 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:01:47.700 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998527+0000", 2024-04-19T03:01:47.700 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:47.700 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.700 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.700 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:01:47.700 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998527+0000", 2024-04-19T03:01:47.700 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:01:47.700 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.700 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.701 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:01:47.701 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998531+0000", 2024-04-19T03:01:47.701 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9450000000000001e-06 2024-04-19T03:01:47.701 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.701 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.701 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:01:47.701 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998541+0000", 2024-04-19T03:01:47.701 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.4320000000000005e-06 2024-04-19T03:01:47.701 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.701 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.701 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:01:47.702 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998548+0000", 2024-04-19T03:01:47.702 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.221e-06 2024-04-19T03:01:47.702 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.702 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.702 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:01:47.702 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998620+0000", 2024-04-19T03:01:47.702 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.1676999999999998e-05 2024-04-19T03:01:47.702 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.702 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.702 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:01:47.702 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998624+0000", 2024-04-19T03:01:47.703 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4850000000000003e-06 2024-04-19T03:01:47.703 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.703 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.703 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:01:47.703 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.013261+0000", 2024-04-19T03:01:47.703 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.014636451999999999 2024-04-19T03:01:47.703 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.703 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.703 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:01:47.703 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.013364+0000", 2024-04-19T03:01:47.704 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000102885 2024-04-19T03:01:47.704 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.704 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.704 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:01:47.704 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.013481+0000", 2024-04-19T03:01:47.704 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00011783299999999999 2024-04-19T03:01:47.704 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.704 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.704 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:01:47.704 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.016265+0000", 2024-04-19T03:01:47.704 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0027834539999999999 2024-04-19T03:01:47.704 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.705 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.705 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:47.705 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.023180+0000", 2024-04-19T03:01:47.705 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0069149399999999996 2024-04-19T03:01:47.705 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.705 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.705 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:01:47.705 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.023230+0000", 2024-04-19T03:01:47.705 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0220999999999999e-05 2024-04-19T03:01:47.705 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.705 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.706 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:01:47.706 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.023266+0000", 2024-04-19T03:01:47.706 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5703e-05 2024-04-19T03:01:47.706 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:47.706 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:01:47.706 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:47.706 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.706 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.706 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:30 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:01:47.706 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:01:14.998577+0000", 2024-04-19T03:01:47.706 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 32.594741538000001, 2024-04-19T03:01:47.706 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.024774022999999999, 2024-04-19T03:01:47.706 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:01:47.707 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:47.707 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:01:47.707 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.707 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:01:47.707 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998577+0000", 2024-04-19T03:01:47.707 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:47.707 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.707 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.707 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:01:47.707 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998577+0000", 2024-04-19T03:01:47.707 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:47.707 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.707 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.707 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:01:47.707 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998576+0000", 2024-04-19T03:01:47.708 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:01:47.708 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.708 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.708 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:01:47.708 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998583+0000", 2024-04-19T03:01:47.708 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8850000000000001e-06 2024-04-19T03:01:47.708 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.708 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.708 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:01:47.708 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998597+0000", 2024-04-19T03:01:47.708 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.362e-05 2024-04-19T03:01:47.708 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.708 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.708 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:01:47.708 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998607+0000", 2024-04-19T03:01:47.709 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0389e-05 2024-04-19T03:01:47.709 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.709 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.709 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:01:47.709 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998713+0000", 2024-04-19T03:01:47.709 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000105338 2024-04-19T03:01:47.709 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.709 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.709 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:01:47.709 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998720+0000", 2024-04-19T03:01:47.709 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2370000000000003e-06 2024-04-19T03:01:47.709 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.709 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.709 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:01:47.710 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.014014+0000", 2024-04-19T03:01:47.710 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.015294116999999999 2024-04-19T03:01:47.710 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.710 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.710 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:01:47.710 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.014091+0000", 2024-04-19T03:01:47.710 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7148000000000001e-05 2024-04-19T03:01:47.710 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.710 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.710 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:01:47.710 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.014271+0000", 2024-04-19T03:01:47.710 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00017962699999999999 2024-04-19T03:01:47.711 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.711 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.711 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:01:47.711 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.018024+0000", 2024-04-19T03:01:47.711 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0037529809999999999 2024-04-19T03:01:47.711 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.712 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.712 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:47.712 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.023303+0000", 2024-04-19T03:01:47.712 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0052793099999999997 2024-04-19T03:01:47.712 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.712 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.712 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:01:47.712 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.023331+0000", 2024-04-19T03:01:47.712 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.8013000000000001e-05 2024-04-19T03:01:47.712 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.712 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.712 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:01:47.713 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.023351+0000", 2024-04-19T03:01:47.713 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0225999999999999e-05 2024-04-19T03:01:47.713 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:47.713 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:01:47.713 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:47.713 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.713 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.713 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:33 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:01:47.713 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:01:14.998625+0000", 2024-04-19T03:01:47.713 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 32.594694140999998, 2024-04-19T03:01:47.713 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.024007338999999999, 2024-04-19T03:01:47.713 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:01:47.713 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:47.713 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:01:47.714 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.714 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:01:47.714 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998625+0000", 2024-04-19T03:01:47.714 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:47.714 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.714 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.714 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:01:47.714 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998625+0000", 2024-04-19T03:01:47.714 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:47.714 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.714 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.714 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:01:47.714 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998623+0000", 2024-04-19T03:01:47.715 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999986 2024-04-19T03:01:47.715 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.715 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.715 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:01:47.715 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998632+0000", 2024-04-19T03:01:47.715 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9279999999999999e-06 2024-04-19T03:01:47.715 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.715 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.715 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:01:47.715 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998642+0000", 2024-04-19T03:01:47.715 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0063e-05 2024-04-19T03:01:47.716 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.716 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.716 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:01:47.716 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998649+0000", 2024-04-19T03:01:47.716 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4799999999999998e-06 2024-04-19T03:01:47.716 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.716 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.716 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:01:47.716 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998730+0000", 2024-04-19T03:01:47.716 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.1514999999999995e-05 2024-04-19T03:01:47.716 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.716 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.716 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:01:47.716 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998741+0000", 2024-04-19T03:01:47.717 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1029999999999999e-05 2024-04-19T03:01:47.717 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.717 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.717 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:01:47.717 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.010202+0000", 2024-04-19T03:01:47.717 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011460529000000001 2024-04-19T03:01:47.717 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.717 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.717 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:01:47.717 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.010292+0000", 2024-04-19T03:01:47.717 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.0382000000000003e-05 2024-04-19T03:01:47.718 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.718 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.718 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:01:47.718 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.010391+0000", 2024-04-19T03:01:47.718 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.8491000000000003e-05 2024-04-19T03:01:47.718 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.719 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.719 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:01:47.719 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.013800+0000", 2024-04-19T03:01:47.719 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0034090219999999998 2024-04-19T03:01:47.719 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.719 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.719 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:47.719 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.022564+0000", 2024-04-19T03:01:47.719 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0087639950000000001 2024-04-19T03:01:47.719 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.719 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.719 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:01:47.719 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.022601+0000", 2024-04-19T03:01:47.719 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7363999999999997e-05 2024-04-19T03:01:47.719 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.720 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.720 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:01:47.720 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.022632+0000", 2024-04-19T03:01:47.720 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0917000000000002e-05 2024-04-19T03:01:47.720 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:47.720 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:01:47.720 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:47.720 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.720 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.720 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:37 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:01:47.720 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:01:14.998739+0000", 2024-04-19T03:01:47.720 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 32.594580200000003, 2024-04-19T03:01:47.720 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.020573188999999999, 2024-04-19T03:01:47.721 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:01:47.721 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:47.721 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:01:47.721 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.721 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:01:47.721 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998739+0000", 2024-04-19T03:01:47.721 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:47.721 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.721 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.721 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:01:47.721 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998739+0000", 2024-04-19T03:01:47.721 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:47.721 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.721 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.721 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:01:47.722 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998738+0000", 2024-04-19T03:01:47.722 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:01:47.722 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.722 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.722 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:01:47.722 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998755+0000", 2024-04-19T03:01:47.722 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7105999999999999e-05 2024-04-19T03:01:47.722 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.722 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.722 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:01:47.722 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998764+0000", 2024-04-19T03:01:47.722 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.1279999999999997e-06 2024-04-19T03:01:47.723 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.723 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.723 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:01:47.723 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998771+0000", 2024-04-19T03:01:47.723 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6939999999999998e-06 2024-04-19T03:01:47.723 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.723 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.723 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:01:47.723 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998843+0000", 2024-04-19T03:01:47.723 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.1695999999999999e-05 2024-04-19T03:01:47.723 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.723 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.724 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op must wait for map", 2024-04-19T03:01:47.724 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998852+0000", 2024-04-19T03:01:47.724 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.0799999999999995e-06 2024-04-19T03:01:47.724 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.724 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.724 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:01:47.724 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.006513+0000", 2024-04-19T03:01:47.724 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0076610020000000001 2024-04-19T03:01:47.724 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.724 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.724 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:01:47.724 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.006670+0000", 2024-04-19T03:01:47.724 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000157529 2024-04-19T03:01:47.724 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.725 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.725 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-04-19T03:01:47.725 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.006863+0000", 2024-04-19T03:01:47.725 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000192597 2024-04-19T03:01:47.725 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.725 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.725 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:01:47.725 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.012404+0000", 2024-04-19T03:01:47.725 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0055415220000000001 2024-04-19T03:01:47.725 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.725 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.725 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:47.725 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.019171+0000", 2024-04-19T03:01:47.725 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0067666829999999999 2024-04-19T03:01:47.726 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.726 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.726 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:01:47.726 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.019228+0000", 2024-04-19T03:01:47.726 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7145999999999998e-05 2024-04-19T03:01:47.726 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.726 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.726 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:01:47.726 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.019312+0000", 2024-04-19T03:01:47.726 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.3591999999999995e-05 2024-04-19T03:01:47.727 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:47.727 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:01:47.727 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:47.727 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.727 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.727 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:01:47.727 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:01:14.998792+0000", 2024-04-19T03:01:47.727 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 32.594527272000001, 2024-04-19T03:01:47.727 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.023951813999999998, 2024-04-19T03:01:47.727 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:01:47.727 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:47.728 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:01:47.728 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.728 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:01:47.728 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998792+0000", 2024-04-19T03:01:47.728 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:47.728 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.728 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.728 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:01:47.728 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998792+0000", 2024-04-19T03:01:47.728 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:47.728 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.728 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.728 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:01:47.729 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998791+0000", 2024-04-19T03:01:47.729 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:01:47.729 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.729 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.729 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:01:47.729 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998796+0000", 2024-04-19T03:01:47.729 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9649999999999999e-06 2024-04-19T03:01:47.729 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.729 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.729 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:01:47.729 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998809+0000", 2024-04-19T03:01:47.729 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3254e-05 2024-04-19T03:01:47.729 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.730 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.730 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:01:47.730 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998816+0000", 2024-04-19T03:01:47.730 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.472e-06 2024-04-19T03:01:47.730 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.730 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.730 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:01:47.730 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998899+0000", 2024-04-19T03:01:47.730 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.3676000000000003e-05 2024-04-19T03:01:47.730 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.730 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.730 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:01:47.730 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998908+0000", 2024-04-19T03:01:47.731 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6940000000000001e-06 2024-04-19T03:01:47.731 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.731 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.731 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:01:47.731 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.010818+0000", 2024-04-19T03:01:47.731 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011910482999999999 2024-04-19T03:01:47.731 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.731 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.731 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:01:47.731 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.010959+0000", 2024-04-19T03:01:47.731 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00014018900000000001 2024-04-19T03:01:47.731 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.731 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.732 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:01:47.732 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.011185+0000", 2024-04-19T03:01:47.732 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000226085 2024-04-19T03:01:47.732 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.732 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.732 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:01:47.732 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.014479+0000", 2024-04-19T03:01:47.732 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0032938260000000001 2024-04-19T03:01:47.732 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.732 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.732 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:47.732 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.022697+0000", 2024-04-19T03:01:47.732 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0082186029999999997 2024-04-19T03:01:47.732 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.732 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.733 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:01:47.733 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.022724+0000", 2024-04-19T03:01:47.733 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.6503999999999999e-05 2024-04-19T03:01:47.733 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.733 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.733 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:01:47.733 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.022743+0000", 2024-04-19T03:01:47.733 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9663000000000001e-05 2024-04-19T03:01:47.733 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:47.733 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:01:47.733 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:47.733 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.733 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.733 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:01:47.734 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:01:14.998870+0000", 2024-04-19T03:01:47.734 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 32.594449071, 2024-04-19T03:01:47.734 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.024280578000000001, 2024-04-19T03:01:47.734 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:01:47.734 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:47.734 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:01:47.734 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.734 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:01:47.734 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998870+0000", 2024-04-19T03:01:47.734 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:47.734 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.734 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.734 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:01:47.735 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998870+0000", 2024-04-19T03:01:47.735 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:47.735 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.735 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.735 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:01:47.735 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998869+0000", 2024-04-19T03:01:47.735 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:01:47.735 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.735 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.735 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:01:47.735 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998879+0000", 2024-04-19T03:01:47.735 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.8689999999999999e-06 2024-04-19T03:01:47.736 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.736 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.736 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:01:47.736 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998893+0000", 2024-04-19T03:01:47.736 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4436999999999999e-05 2024-04-19T03:01:47.736 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.736 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.736 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:01:47.736 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998904+0000", 2024-04-19T03:01:47.736 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0657e-05 2024-04-19T03:01:47.736 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.736 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.736 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:01:47.736 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998972+0000", 2024-04-19T03:01:47.737 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8121999999999996e-05 2024-04-19T03:01:47.737 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.737 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.737 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:01:47.737 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998980+0000", 2024-04-19T03:01:47.737 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7170000000000008e-06 2024-04-19T03:01:47.737 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.737 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.737 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:01:47.737 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.011666+0000", 2024-04-19T03:01:47.738 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.012686507 2024-04-19T03:01:47.738 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.738 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.738 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:01:47.738 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.012403+0000", 2024-04-19T03:01:47.738 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00073661899999999999 2024-04-19T03:01:47.738 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.738 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.738 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:01:47.738 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.012788+0000", 2024-04-19T03:01:47.738 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00038495800000000002 2024-04-19T03:01:47.738 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.739 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.739 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:01:47.739 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.015713+0000", 2024-04-19T03:01:47.739 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0029255879999999998 2024-04-19T03:01:47.739 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.739 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.739 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:47.739 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.023066+0000", 2024-04-19T03:01:47.739 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.007352903 2024-04-19T03:01:47.739 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.739 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.739 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:01:47.740 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.023113+0000", 2024-04-19T03:01:47.740 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7163000000000002e-05 2024-04-19T03:01:47.740 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.740 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.740 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:01:47.740 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.023150+0000", 2024-04-19T03:01:47.740 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6881000000000001e-05 2024-04-19T03:01:47.740 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:47.740 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:01:47.740 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:47.740 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.740 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.740 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:16 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:01:47.741 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:01:14.998920+0000", 2024-04-19T03:01:47.741 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 32.594399025999998, 2024-04-19T03:01:47.741 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.020562114999999999, 2024-04-19T03:01:47.741 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:01:47.741 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:47.741 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:01:47.741 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.741 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:01:47.741 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998920+0000", 2024-04-19T03:01:47.741 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:47.741 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.741 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.741 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:01:47.741 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998920+0000", 2024-04-19T03:01:47.742 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:47.742 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.742 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.742 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:01:47.742 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998919+0000", 2024-04-19T03:01:47.742 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:01:47.742 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.742 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.742 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:01:47.742 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998925+0000", 2024-04-19T03:01:47.742 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5370000000000003e-06 2024-04-19T03:01:47.743 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.743 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.743 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:01:47.743 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998943+0000", 2024-04-19T03:01:47.743 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7549000000000001e-05 2024-04-19T03:01:47.743 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.743 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.743 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:01:47.743 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998955+0000", 2024-04-19T03:01:47.743 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1977000000000001e-05 2024-04-19T03:01:47.744 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.744 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.744 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:01:47.744 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.999009+0000", 2024-04-19T03:01:47.744 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3667e-05 2024-04-19T03:01:47.744 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.744 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.744 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:01:47.744 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.999013+0000", 2024-04-19T03:01:47.744 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8829999999999997e-06 2024-04-19T03:01:47.744 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.744 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.744 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:01:47.745 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.007476+0000", 2024-04-19T03:01:47.745 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0084621569999999997 2024-04-19T03:01:47.745 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.745 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.745 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:01:47.745 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.007626+0000", 2024-04-19T03:01:47.745 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00015079199999999999 2024-04-19T03:01:47.745 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.745 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.745 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-04-19T03:01:47.745 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.007765+0000", 2024-04-19T03:01:47.745 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000138376 2024-04-19T03:01:47.746 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.746 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.746 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:01:47.746 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.012418+0000", 2024-04-19T03:01:47.746 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0046528200000000002 2024-04-19T03:01:47.746 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.746 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.746 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:47.746 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.019380+0000", 2024-04-19T03:01:47.746 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0069621960000000004 2024-04-19T03:01:47.746 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.746 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.746 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:01:47.747 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.019437+0000", 2024-04-19T03:01:47.747 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7226999999999999e-05 2024-04-19T03:01:47.747 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.747 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.747 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:01:47.747 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.019482+0000", 2024-04-19T03:01:47.747 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4857000000000001e-05 2024-04-19T03:01:47.747 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:47.747 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:01:47.747 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:47.747 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.747 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.747 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:20 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:01:47.748 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:01:14.999024+0000", 2024-04-19T03:01:47.748 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 32.594294798999996, 2024-04-19T03:01:47.748 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.024212818000000001, 2024-04-19T03:01:47.748 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:01:47.748 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-04-19T03:01:47.748 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:01:47.748 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.748 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:01:47.749 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.999024+0000", 2024-04-19T03:01:47.749 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:47.749 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.749 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.749 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:01:47.749 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.999024+0000", 2024-04-19T03:01:47.749 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:47.749 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.749 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.749 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:01:47.749 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.999023+0000", 2024-04-19T03:01:47.749 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:01:47.750 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.750 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.750 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:01:47.750 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.999029+0000", 2024-04-19T03:01:47.750 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2709999999999998e-06 2024-04-19T03:01:47.750 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.750 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.750 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:01:47.750 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.999045+0000", 2024-04-19T03:01:47.750 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.5840000000000001e-05 2024-04-19T03:01:47.750 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.750 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.750 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:01:47.750 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.999057+0000", 2024-04-19T03:01:47.751 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1897e-05 2024-04-19T03:01:47.751 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.751 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.751 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:01:47.751 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.999136+0000", 2024-04-19T03:01:47.751 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8842000000000002e-05 2024-04-19T03:01:47.751 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.751 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.751 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:01:47.751 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.999144+0000", 2024-04-19T03:01:47.751 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.3110000000000006e-06 2024-04-19T03:01:47.751 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.752 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.752 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:01:47.752 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.013338+0000", 2024-04-19T03:01:47.752 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.014194217 2024-04-19T03:01:47.752 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.752 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.752 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:01:47.752 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.013485+0000", 2024-04-19T03:01:47.752 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000146787 2024-04-19T03:01:47.752 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.752 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.752 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:01:47.753 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.023237+0000", 2024-04-19T03:01:47.753 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0097517899999999998 2024-04-19T03:01:47.753 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:47.753 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:01:47.753 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:47.753 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.753 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.753 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:11289 5.7 5:e1ea82b1:::benchmark_data_smithi096_19531_object11288:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T03:01:47.753 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:01:42.068678+0000", 2024-04-19T03:01:47.753 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 5.5246405789999997, 2024-04-19T03:01:47.753 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.022027980999999999, 2024-04-19T03:01:47.753 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:01:47.753 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:47.753 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:01:47.754 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:01:47.754 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:47.754 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 11289 2024-04-19T03:01:47.754 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.754 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:01:47.754 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.754 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:01:47.754 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:42.068678+0000", 2024-04-19T03:01:47.754 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:47.754 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.754 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.754 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:01:47.755 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:42.068678+0000", 2024-04-19T03:01:47.755 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:47.755 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.755 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.755 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:01:47.755 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:42.068677+0000", 2024-04-19T03:01:47.755 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:01:47.755 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.755 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.755 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:01:47.755 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:42.068721+0000", 2024-04-19T03:01:47.756 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3714000000000002e-05 2024-04-19T03:01:47.756 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.756 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.756 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:01:47.756 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:42.068728+0000", 2024-04-19T03:01:47.756 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0029999999999997e-06 2024-04-19T03:01:47.757 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.757 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.757 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:01:47.757 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:42.068733+0000", 2024-04-19T03:01:47.757 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0100000000000003e-06 2024-04-19T03:01:47.757 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.757 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.758 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:01:47.758 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:42.068820+0000", 2024-04-19T03:01:47.758 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.653e-05 2024-04-19T03:01:47.758 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.758 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.758 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:01:47.759 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:42.068990+0000", 2024-04-19T03:01:47.759 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00017046800000000001 2024-04-19T03:01:47.759 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.759 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.759 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-04-19T03:01:47.759 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:42.069140+0000", 2024-04-19T03:01:47.759 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00015001000000000001 2024-04-19T03:01:47.760 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.760 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.760 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:01:47.760 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:42.074573+0000", 2024-04-19T03:01:47.760 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0054326979999999997 2024-04-19T03:01:47.760 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.760 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.761 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:47.761 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:42.090534+0000", 2024-04-19T03:01:47.761 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.015961300000000001 2024-04-19T03:01:47.761 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.761 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.761 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:01:47.761 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:42.090619+0000", 2024-04-19T03:01:47.762 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4536999999999994e-05 2024-04-19T03:01:47.762 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:47.762 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:47.762 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:01:47.762 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:42.090706+0000", 2024-04-19T03:01:47.762 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.7643000000000001e-05 2024-04-19T03:01:47.763 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:47.763 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:01:47.763 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:47.763 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:47.763 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:01:47.763 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-04-19T03:01:47.766 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:01:47.761+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:01:47.766 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T03:01:47.820 INFO:tasks.radosbench.radosbench.0.smithi096.stdout: 10 16 25137 25121 156.99 143.188 0.00403313 0.00636233 2024-04-19T03:01:47.866 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:01:47.861+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:01:47.903 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-04-19T03:01:47.904 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [ 2024-04-19T03:01:47.904 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:47.904 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4755.0:25302 5.3 5:c8dde3fa:::benchmark_data_smithi096_19531_object25301:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T03:01:47.904 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:47.895142+0000", 2024-04-19T03:01:47.904 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 0.0044272749999999996, 2024-04-19T03:01:47.904 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0044476849999999998, 2024-04-19T03:01:47.905 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:01:47.905 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:01:47.905 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-04-19T03:01:47.905 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4755", 2024-04-19T03:01:47.905 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:47.905 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 25302 2024-04-19T03:01:47.905 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:47.905 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:01:47.905 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:47.905 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:01:47.905 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:47.895142+0000", 2024-04-19T03:01:47.906 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:47.906 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:47.906 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:47.906 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:01:47.906 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:47.895142+0000", 2024-04-19T03:01:47.906 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:47.906 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:47.906 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:47.906 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:01:47.906 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:47.895141+0000", 2024-04-19T03:01:47.907 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999986 2024-04-19T03:01:47.907 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:47.907 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:47.907 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:01:47.907 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:47.895232+0000", 2024-04-19T03:01:47.907 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.1164999999999999e-05 2024-04-19T03:01:47.907 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:47.907 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:47.907 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:01:47.907 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:47.895252+0000", 2024-04-19T03:01:47.907 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.9449999999999998e-05 2024-04-19T03:01:47.907 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:47.907 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:47.908 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:01:47.908 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:47.895282+0000", 2024-04-19T03:01:47.908 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0343999999999999e-05 2024-04-19T03:01:47.908 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:47.908 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:47.908 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:47.908 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:47.895348+0000", 2024-04-19T03:01:47.908 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.5612999999999997e-05 2024-04-19T03:01:47.908 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:47.908 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:47.908 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:01:47.908 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:47.895542+0000", 2024-04-19T03:01:47.908 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000194262 2024-04-19T03:01:47.909 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:47.909 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:47.909 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-04-19T03:01:47.909 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:47.895698+0000", 2024-04-19T03:01:47.909 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00015618000000000001 2024-04-19T03:01:47.909 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:47.909 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:47.909 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:01:47.909 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:47.898429+0000", 2024-04-19T03:01:47.909 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.002730793 2024-04-19T03:01:47.909 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:47.909 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:47.910 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:47.910 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:47.910 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:47.910 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4755.0:25303 5.5 5:a375537f:::benchmark_data_smithi096_19531_object25302:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T03:01:47.910 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:47.895301+0000", 2024-04-19T03:01:47.910 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 0.0042689169999999997, 2024-04-19T03:01:47.910 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0043427609999999997, 2024-04-19T03:01:47.910 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:01:47.910 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:01:47.910 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-04-19T03:01:47.911 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4755", 2024-04-19T03:01:47.911 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:47.911 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 25303 2024-04-19T03:01:47.911 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:47.911 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:01:47.911 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:47.911 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:01:47.911 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:47.895301+0000", 2024-04-19T03:01:47.911 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:47.911 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:47.911 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:47.911 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:01:47.911 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:47.895301+0000", 2024-04-19T03:01:47.911 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:47.912 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:47.912 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:47.912 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:01:47.912 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:47.895300+0000", 2024-04-19T03:01:47.912 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999995 2024-04-19T03:01:47.912 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:47.912 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:47.912 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:01:47.912 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:47.895347+0000", 2024-04-19T03:01:47.912 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.7046999999999999e-05 2024-04-19T03:01:47.912 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:47.912 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:47.912 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:01:47.912 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:47.895353+0000", 2024-04-19T03:01:47.913 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.9100000000000002e-06 2024-04-19T03:01:47.913 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:47.913 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:47.913 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:01:47.913 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:47.895358+0000", 2024-04-19T03:01:47.913 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.2930000000000002e-06 2024-04-19T03:01:47.913 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:47.913 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:47.913 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:47.913 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:47.895430+0000", 2024-04-19T03:01:47.913 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.2886000000000007e-05 2024-04-19T03:01:47.913 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:47.913 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:47.913 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:01:47.914 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:47.895546+0000", 2024-04-19T03:01:47.914 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00011504499999999999 2024-04-19T03:01:47.914 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:47.914 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:47.914 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-04-19T03:01:47.914 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:47.895653+0000", 2024-04-19T03:01:47.914 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000107266 2024-04-19T03:01:47.914 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:47.914 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:47.914 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:01:47.915 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:47.897958+0000", 2024-04-19T03:01:47.915 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0023052519999999998 2024-04-19T03:01:47.915 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:47.915 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:47.915 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:47.915 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:47.915 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:47.915 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4755.0:25308 5.c 5:32b77fd9:::benchmark_data_smithi096_19531_object25307:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T03:01:47.915 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:47.895545+0000", 2024-04-19T03:01:47.915 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 0.0040251649999999998, 2024-04-19T03:01:47.915 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00415877, 2024-04-19T03:01:47.916 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:01:47.916 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:01:47.916 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-04-19T03:01:47.916 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4755", 2024-04-19T03:01:47.916 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:47.916 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 25308 2024-04-19T03:01:47.916 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:47.916 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:01:47.916 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:47.916 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:01:47.917 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:47.895545+0000", 2024-04-19T03:01:47.917 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:47.917 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:47.917 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:47.917 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:01:47.917 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:47.895545+0000", 2024-04-19T03:01:47.917 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:47.917 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:47.917 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:47.917 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:01:47.917 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:47.895544+0000", 2024-04-19T03:01:47.917 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2024-04-19T03:01:47.917 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:47.917 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:47.917 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:01:47.918 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:47.895588+0000", 2024-04-19T03:01:47.918 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.4267999999999997e-05 2024-04-19T03:01:47.918 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:47.918 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:47.918 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:01:47.918 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:47.895600+0000", 2024-04-19T03:01:47.918 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1362000000000001e-05 2024-04-19T03:01:47.918 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:47.918 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:47.918 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:01:47.918 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:47.895610+0000", 2024-04-19T03:01:47.918 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0662000000000001e-05 2024-04-19T03:01:47.919 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:47.919 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:47.919 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:47.919 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:47.895653+0000", 2024-04-19T03:01:47.919 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.2936999999999999e-05 2024-04-19T03:01:47.919 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:47.919 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:47.919 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:01:47.919 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:47.895798+0000", 2024-04-19T03:01:47.919 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000144773 2024-04-19T03:01:47.919 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:47.919 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:47.919 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-04-19T03:01:47.920 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:47.895983+0000", 2024-04-19T03:01:47.920 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00018516 2024-04-19T03:01:47.920 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:47.920 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:47.920 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:47.920 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:47.920 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:47.920 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4755.0:25305 5.0 e27/22 5:0d95b5c8:::benchmark_data_smithi096_19531_object25304:head v 27'1668, mlcod=27'1665)", 2024-04-19T03:01:47.920 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:47.896249+0000", 2024-04-19T03:01:47.920 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 0.0033209289999999998, 2024-04-19T03:01:47.921 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0035311449999999999, 2024-04-19T03:01:47.921 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:01:47.921 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "started", 2024-04-19T03:01:47.921 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:01:47.921 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:47.921 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:01:47.921 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:47.896249+0000", 2024-04-19T03:01:47.921 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:47.921 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:47.921 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:47.921 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:01:47.921 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:47.896249+0000", 2024-04-19T03:01:47.921 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:47.921 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:47.922 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:47.922 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:01:47.922 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:47.896248+0000", 2024-04-19T03:01:47.922 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999995 2024-04-19T03:01:47.922 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:47.922 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:47.922 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:01:47.922 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:47.896329+0000", 2024-04-19T03:01:47.923 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.0980000000000001e-05 2024-04-19T03:01:47.923 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:47.923 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:47.923 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:01:47.923 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:47.896337+0000", 2024-04-19T03:01:47.923 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.6320000000000008e-06 2024-04-19T03:01:47.923 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:47.923 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:47.923 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:01:47.923 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:47.896343+0000", 2024-04-19T03:01:47.923 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.7219999999999996e-06 2024-04-19T03:01:47.924 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:47.924 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:47.924 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:47.924 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:47.896385+0000", 2024-04-19T03:01:47.924 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.2253999999999999e-05 2024-04-19T03:01:47.924 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:47.924 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:47.924 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:01:47.924 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:47.896409+0000", 2024-04-19T03:01:47.924 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.4128999999999999e-05 2024-04-19T03:01:47.924 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:47.924 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:47.924 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:47.924 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:47.925 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:47.925 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4755.0:25307 5.7 e27/22 5:ed9b4fe3:::benchmark_data_smithi096_19531_object25306:head v 27'1463, mlcod=27'1459)", 2024-04-19T03:01:47.925 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:47.897243+0000", 2024-04-19T03:01:47.925 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 0.002326706, 2024-04-19T03:01:47.925 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.002601108, 2024-04-19T03:01:47.925 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:01:47.925 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "started", 2024-04-19T03:01:47.925 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:01:47.925 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:47.926 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:01:47.926 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:47.897243+0000", 2024-04-19T03:01:47.926 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:47.926 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:47.926 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:47.926 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:01:47.926 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:47.897243+0000", 2024-04-19T03:01:47.926 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:47.926 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:47.926 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:47.926 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:01:47.926 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:47.897242+0000", 2024-04-19T03:01:47.927 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2024-04-19T03:01:47.927 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:47.927 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:47.927 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:01:47.927 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:47.897282+0000", 2024-04-19T03:01:47.927 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.0080999999999998e-05 2024-04-19T03:01:47.927 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:47.927 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:47.927 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:01:47.928 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:47.897701+0000", 2024-04-19T03:01:47.928 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000418243 2024-04-19T03:01:47.928 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:47.928 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:47.928 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:01:47.928 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:47.897709+0000", 2024-04-19T03:01:47.928 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.2889999999999998e-06 2024-04-19T03:01:47.928 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:47.928 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:47.928 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:47.928 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:47.897749+0000", 2024-04-19T03:01:47.928 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.9847e-05 2024-04-19T03:01:47.928 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:47.929 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:47.929 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:01:47.929 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:47.897770+0000", 2024-04-19T03:01:47.929 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.1237e-05 2024-04-19T03:01:47.929 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:47.929 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:47.929 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:47.929 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:47.929 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:47.929 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4755.0:25309 5.0 e27/22 5:0991c20b:::benchmark_data_smithi096_19531_object25308:head v 27'1669, mlcod=27'1665)", 2024-04-19T03:01:47.929 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:47.897651+0000", 2024-04-19T03:01:47.929 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 0.0019186100000000001, 2024-04-19T03:01:47.929 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0022568900000000001, 2024-04-19T03:01:47.929 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:01:47.930 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "started", 2024-04-19T03:01:47.930 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:01:47.930 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:47.930 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:01:47.930 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:47.897651+0000", 2024-04-19T03:01:47.930 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:47.930 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:47.930 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:47.930 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:01:47.930 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:47.897651+0000", 2024-04-19T03:01:47.930 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:47.930 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:47.930 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:47.931 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:01:47.931 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:47.897650+0000", 2024-04-19T03:01:47.931 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2024-04-19T03:01:47.931 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:47.931 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:47.931 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:01:47.931 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:47.897729+0000", 2024-04-19T03:01:47.931 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.8740999999999997e-05 2024-04-19T03:01:47.931 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:47.931 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:47.931 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:01:47.931 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:47.897741+0000", 2024-04-19T03:01:47.932 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2140999999999999e-05 2024-04-19T03:01:47.932 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:47.932 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:47.932 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:01:47.932 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:47.897749+0000", 2024-04-19T03:01:47.932 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.8329999999999994e-06 2024-04-19T03:01:47.932 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:47.932 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:47.932 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:47.932 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:47.898119+0000", 2024-04-19T03:01:47.932 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00037021599999999998 2024-04-19T03:01:47.932 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:47.933 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:47.933 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:01:47.933 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:47.898139+0000", 2024-04-19T03:01:47.933 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.9769e-05 2024-04-19T03:01:47.933 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:47.933 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:47.933 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:47.933 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:47.933 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:47.933 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4755.0:25310 5.c 5:36225490:::benchmark_data_smithi096_19531_object25309:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T03:01:47.933 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:47.897977+0000", 2024-04-19T03:01:47.933 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 0.0015931020000000001, 2024-04-19T03:01:47.934 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0019995, 2024-04-19T03:01:47.934 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:01:47.934 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:01:47.934 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-04-19T03:01:47.934 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4755", 2024-04-19T03:01:47.934 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:47.934 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 25310 2024-04-19T03:01:47.934 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:47.934 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:01:47.934 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:47.934 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:01:47.934 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:47.897977+0000", 2024-04-19T03:01:47.935 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:47.935 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:47.935 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:47.935 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:01:47.935 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:47.897977+0000", 2024-04-19T03:01:47.935 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:47.935 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:47.935 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:47.935 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:01:47.935 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:47.897975+0000", 2024-04-19T03:01:47.935 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2024-04-19T03:01:47.935 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:47.935 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:47.936 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:01:47.936 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:47.898029+0000", 2024-04-19T03:01:47.936 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.3924000000000001e-05 2024-04-19T03:01:47.936 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:47.936 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:47.936 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:01:47.936 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:47.898042+0000", 2024-04-19T03:01:47.936 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2825e-05 2024-04-19T03:01:47.936 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:47.937 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:47.937 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:01:47.937 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:47.898051+0000", 2024-04-19T03:01:47.937 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.3639999999999999e-06 2024-04-19T03:01:47.937 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:47.937 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:47.937 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:47.937 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:47.898088+0000", 2024-04-19T03:01:47.937 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.7625e-05 2024-04-19T03:01:47.937 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:47.937 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:47.937 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:01:47.937 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:47.898235+0000", 2024-04-19T03:01:47.938 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014681899999999999 2024-04-19T03:01:47.938 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:47.938 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:47.938 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-04-19T03:01:47.938 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:47.898381+0000", 2024-04-19T03:01:47.938 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014545699999999999 2024-04-19T03:01:47.938 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:47.938 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:47.938 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:47.938 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:47.938 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:47.938 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4755.0:25311 5.c 5.6d7bbd8c (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T03:01:47.939 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:47.898141+0000", 2024-04-19T03:01:47.939 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 0.001428339, 2024-04-19T03:01:47.939 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0019162440000000001, 2024-04-19T03:01:47.939 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:01:47.939 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "queued for pg", 2024-04-19T03:01:47.939 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-04-19T03:01:47.939 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4755", 2024-04-19T03:01:47.939 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:47.939 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 25311 2024-04-19T03:01:47.939 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:47.939 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:01:47.939 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:47.939 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:01:47.940 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:47.898141+0000", 2024-04-19T03:01:47.940 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:47.940 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:47.940 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:47.940 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:01:47.940 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:47.898141+0000", 2024-04-19T03:01:47.940 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:47.940 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:47.940 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:47.940 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:01:47.940 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:47.898141+0000", 2024-04-19T03:01:47.940 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2024-04-19T03:01:47.940 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:47.940 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:47.940 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:01:47.941 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:47.898195+0000", 2024-04-19T03:01:47.941 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.4866e-05 2024-04-19T03:01:47.941 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:47.941 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:47.941 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:01:47.941 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:47.898203+0000", 2024-04-19T03:01:47.941 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.8939999999999993e-06 2024-04-19T03:01:47.941 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:47.941 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:47.941 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:01:47.941 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:47.898208+0000", 2024-04-19T03:01:47.941 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.9559999999999996e-06 2024-04-19T03:01:47.941 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:47.941 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:47.941 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:47.942 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:47.942 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:47.942 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4755.0:25312 5.3 5:c4f185ef:::benchmark_data_smithi096_19531_object25311:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T03:01:47.942 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:47.898489+0000", 2024-04-19T03:01:47.942 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 0.0010807499999999999, 2024-04-19T03:01:47.942 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001634394, 2024-04-19T03:01:47.942 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:01:47.942 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:01:47.942 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-04-19T03:01:47.942 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4755", 2024-04-19T03:01:47.942 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:47.942 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 25312 2024-04-19T03:01:47.942 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:47.943 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:01:47.943 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:47.943 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:01:47.943 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:47.898489+0000", 2024-04-19T03:01:47.943 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:47.943 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:47.943 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:47.943 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:01:47.943 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:47.898489+0000", 2024-04-19T03:01:47.943 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:47.943 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:47.943 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:47.944 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:01:47.944 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:47.898488+0000", 2024-04-19T03:01:47.944 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2024-04-19T03:01:47.944 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:47.944 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:47.944 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:01:47.944 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:47.898514+0000", 2024-04-19T03:01:47.944 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.5333999999999998e-05 2024-04-19T03:01:47.944 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:47.944 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:47.945 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:01:47.945 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:47.898521+0000", 2024-04-19T03:01:47.945 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.0450000000000003e-06 2024-04-19T03:01:47.945 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:47.945 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:47.945 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:01:47.945 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:47.898526+0000", 2024-04-19T03:01:47.945 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.9139999999999999e-06 2024-04-19T03:01:47.945 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:47.945 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:47.945 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:47.945 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:47.898581+0000", 2024-04-19T03:01:47.945 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.5028999999999998e-05 2024-04-19T03:01:47.945 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:47.946 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:47.946 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:01:47.946 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:47.898764+0000", 2024-04-19T03:01:47.946 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00018326599999999999 2024-04-19T03:01:47.946 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:47.946 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:47.946 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-04-19T03:01:47.946 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:47.898891+0000", 2024-04-19T03:01:47.946 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000126876 2024-04-19T03:01:47.947 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:47.947 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:47.947 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:47.947 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:47.947 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:47.947 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4755.0:25313 5.7 e27/22 5:e0207c13:::benchmark_data_smithi096_19531_object25312:head v 27'1464, mlcod=27'1461)", 2024-04-19T03:01:47.947 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:47.898994+0000", 2024-04-19T03:01:47.947 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 0.00057530500000000002, 2024-04-19T03:01:47.947 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001209021, 2024-04-19T03:01:47.947 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:01:47.947 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "started", 2024-04-19T03:01:47.947 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:01:47.947 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:47.948 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:01:47.948 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:47.898994+0000", 2024-04-19T03:01:47.948 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:47.948 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:47.948 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:47.948 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:01:47.948 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:47.898994+0000", 2024-04-19T03:01:47.948 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:47.948 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:47.948 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:47.948 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:01:47.948 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:47.898994+0000", 2024-04-19T03:01:47.949 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999995 2024-04-19T03:01:47.949 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:47.949 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:47.949 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:01:47.949 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:47.899035+0000", 2024-04-19T03:01:47.949 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.138e-05 2024-04-19T03:01:47.949 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:47.949 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:47.949 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:01:47.949 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:47.899045+0000", 2024-04-19T03:01:47.949 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.8740000000000007e-06 2024-04-19T03:01:47.949 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:47.949 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:47.950 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:01:47.950 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:47.899052+0000", 2024-04-19T03:01:47.950 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.9519999999999997e-06 2024-04-19T03:01:47.950 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:47.950 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:47.950 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:47.950 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:47.899110+0000", 2024-04-19T03:01:47.950 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.8183999999999997e-05 2024-04-19T03:01:47.950 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:47.950 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:47.950 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:01:47.950 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:47.899133+0000", 2024-04-19T03:01:47.950 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.2934000000000001e-05 2024-04-19T03:01:47.950 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:47.951 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:47.951 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:47.951 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:47.951 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:47.951 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4755.0:25314 5.e e27/22 5:7343b8ca:::benchmark_data_smithi096_19531_object25313:head v 27'1614, mlcod=27'1612)", 2024-04-19T03:01:47.951 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:47.899245+0000", 2024-04-19T03:01:47.951 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 0.00032513699999999997, 2024-04-19T03:01:47.951 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0010240340000000001, 2024-04-19T03:01:47.951 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:01:47.951 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "started", 2024-04-19T03:01:47.951 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:01:47.951 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:47.951 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:01:47.951 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:47.899245+0000", 2024-04-19T03:01:47.952 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:47.952 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:47.952 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:47.952 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:01:47.952 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:47.899245+0000", 2024-04-19T03:01:47.952 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:47.952 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:47.952 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:47.952 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:01:47.952 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:47.899244+0000", 2024-04-19T03:01:47.952 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999995 2024-04-19T03:01:47.952 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:47.953 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:47.953 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:01:47.953 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:47.899306+0000", 2024-04-19T03:01:47.953 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.1995000000000005e-05 2024-04-19T03:01:47.953 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:47.953 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:47.953 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:01:47.953 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:47.899316+0000", 2024-04-19T03:01:47.953 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0107e-05 2024-04-19T03:01:47.953 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:47.953 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:47.953 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:01:47.954 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:47.899323+0000", 2024-04-19T03:01:47.954 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.759e-06 2024-04-19T03:01:47.954 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:47.954 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:47.954 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:47.954 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:47.899398+0000", 2024-04-19T03:01:47.954 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.4826999999999994e-05 2024-04-19T03:01:47.954 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:47.954 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:47.954 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:01:47.954 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:47.899425+0000", 2024-04-19T03:01:47.954 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.6936000000000001e-05 2024-04-19T03:01:47.955 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:47.955 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:47.955 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:47.955 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:47.955 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:47.955 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4755.0:25316 5.6 5:66abf3a9:::benchmark_data_smithi096_19531_object25315:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T03:01:47.955 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:47.900075+0000", 2024-04-19T03:01:47.955 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 4294967295.999495, 2024-04-19T03:01:47.955 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00026581700000000001, 2024-04-19T03:01:47.955 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:01:47.955 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "started", 2024-04-19T03:01:47.955 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-04-19T03:01:47.955 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4755", 2024-04-19T03:01:47.956 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:47.956 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 25316 2024-04-19T03:01:47.956 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:47.956 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:01:47.956 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:47.956 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:01:47.956 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:47.900075+0000", 2024-04-19T03:01:47.956 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:47.956 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:47.956 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:47.956 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:01:47.956 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:47.900075+0000", 2024-04-19T03:01:47.956 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:47.957 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:47.957 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:47.957 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:01:47.957 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:47.900074+0000", 2024-04-19T03:01:47.957 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2024-04-19T03:01:47.957 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:47.957 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:47.957 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:01:47.957 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:47.900109+0000", 2024-04-19T03:01:47.957 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.5558000000000001e-05 2024-04-19T03:01:47.957 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:47.957 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:47.957 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:01:47.958 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:47.900131+0000", 2024-04-19T03:01:47.958 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.2212999999999999e-05 2024-04-19T03:01:47.958 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:47.958 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:47.958 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:01:47.958 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:47.900140+0000", 2024-04-19T03:01:47.958 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.4829999999999999e-06 2024-04-19T03:01:47.958 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:47.958 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:47.958 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:47.958 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:47.900170+0000", 2024-04-19T03:01:47.958 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0267999999999999e-05 2024-04-19T03:01:47.958 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:47.958 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:47.958 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:01:47.959 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:47.900273+0000", 2024-04-19T03:01:47.959 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00010242 2024-04-19T03:01:47.959 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:47.959 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:47.959 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:47.959 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:47.959 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2024-04-19T03:01:47.959 INFO:teuthology.orchestra.run.smithi097.stdout: "num_ops": 12 2024-04-19T03:01:47.959 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-04-19T03:01:47.960 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T03:01:47.966 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:01:47.961+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:01:48.045 INFO:teuthology.orchestra.run.smithi096.stderr:noscrub is set 2024-04-19T03:01:48.067 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:01:48.064+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:01:48.092 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-04-19T03:01:48.092 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [], 2024-04-19T03:01:48.092 INFO:teuthology.orchestra.run.smithi097.stdout: "complaint_time": 30, 2024-04-19T03:01:48.093 INFO:teuthology.orchestra.run.smithi097.stdout: "num_blocked_ops": 0 2024-04-19T03:01:48.093 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-04-19T03:01:48.105 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T03:01:48.168 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-04-19T03:01:48.165+0000 7f35986ab700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18243) UID: 0 2024-04-19T03:01:48.239 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-04-19T03:01:48.240 INFO:teuthology.orchestra.run.smithi097.stdout: "size": 20, 2024-04-19T03:01:48.240 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 600, 2024-04-19T03:01:48.240 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [ 2024-04-19T03:01:48.240 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.240 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:01:48.240 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:14.996966+0000", 2024-04-19T03:01:48.240 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 33.237403270000001, 2024-04-19T03:01:48.240 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.018946704000000002, 2024-04-19T03:01:48.240 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:01:48.240 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:48.240 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:01:48.240 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.241 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:01:48.241 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.996966+0000", 2024-04-19T03:01:48.241 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:48.241 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.241 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.241 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:01:48.241 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.996966+0000", 2024-04-19T03:01:48.241 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:48.241 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.241 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.241 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:01:48.241 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.996964+0000", 2024-04-19T03:01:48.241 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999971 2024-04-19T03:01:48.242 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.242 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.242 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:01:48.242 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.996982+0000", 2024-04-19T03:01:48.242 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.8306999999999999e-05 2024-04-19T03:01:48.242 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.242 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.242 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:01:48.242 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997027+0000", 2024-04-19T03:01:48.242 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.5274000000000001e-05 2024-04-19T03:01:48.242 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.242 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.243 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:01:48.243 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997047+0000", 2024-04-19T03:01:48.243 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.9726999999999999e-05 2024-04-19T03:01:48.243 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.243 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.243 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:48.243 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997203+0000", 2024-04-19T03:01:48.243 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000155847 2024-04-19T03:01:48.243 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.243 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.243 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op must wait for map", 2024-04-19T03:01:48.243 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997249+0000", 2024-04-19T03:01:48.243 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.5824e-05 2024-04-19T03:01:48.243 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.244 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.244 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:48.244 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.007264+0000", 2024-04-19T03:01:48.244 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.010015909 2024-04-19T03:01:48.244 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.244 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.244 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:01:48.244 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.007394+0000", 2024-04-19T03:01:48.244 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012931999999999999 2024-04-19T03:01:48.244 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.244 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.244 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-04-19T03:01:48.244 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.007537+0000", 2024-04-19T03:01:48.245 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014365 2024-04-19T03:01:48.245 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.245 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.245 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:01:48.245 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.012444+0000", 2024-04-19T03:01:48.245 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0049067260000000001 2024-04-19T03:01:48.245 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.245 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.245 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:48.245 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.015791+0000", 2024-04-19T03:01:48.245 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0033471109999999998 2024-04-19T03:01:48.246 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.246 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.246 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:01:48.246 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.015845+0000", 2024-04-19T03:01:48.246 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.4236e-05 2024-04-19T03:01:48.246 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.246 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.247 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:01:48.247 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.015913+0000", 2024-04-19T03:01:48.247 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.7397000000000005e-05 2024-04-19T03:01:48.247 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:48.247 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:48.247 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:48.247 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.247 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.247 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(mds.0.3:14 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:01:48.248 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:14.997079+0000", 2024-04-19T03:01:48.248 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 33.237290686000001, 2024-04-19T03:01:48.248 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.021951970000000001, 2024-04-19T03:01:48.248 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:01:48.248 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:48.248 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:01:48.249 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.249 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:01:48.249 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997079+0000", 2024-04-19T03:01:48.249 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:48.249 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.249 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.250 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:01:48.250 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997079+0000", 2024-04-19T03:01:48.250 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:48.250 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.250 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.250 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:01:48.250 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997077+0000", 2024-04-19T03:01:48.251 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999986 2024-04-19T03:01:48.251 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.251 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.251 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:01:48.251 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997087+0000", 2024-04-19T03:01:48.251 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.006e-05 2024-04-19T03:01:48.251 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.251 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.252 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:01:48.252 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997105+0000", 2024-04-19T03:01:48.252 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.8026999999999999e-05 2024-04-19T03:01:48.252 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.252 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.252 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:01:48.252 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997135+0000", 2024-04-19T03:01:48.252 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.9643000000000001e-05 2024-04-19T03:01:48.252 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.253 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.253 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:48.253 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997208+0000", 2024-04-19T03:01:48.253 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.3419999999999998e-05 2024-04-19T03:01:48.253 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.253 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.253 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op must wait for map", 2024-04-19T03:01:48.253 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997244+0000", 2024-04-19T03:01:48.253 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.5367000000000002e-05 2024-04-19T03:01:48.254 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.254 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.254 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:48.254 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.007357+0000", 2024-04-19T03:01:48.254 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.010112703000000001 2024-04-19T03:01:48.254 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.254 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.254 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:01:48.255 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.007479+0000", 2024-04-19T03:01:48.255 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012279599999999999 2024-04-19T03:01:48.255 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.255 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.255 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 1", 2024-04-19T03:01:48.255 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.007610+0000", 2024-04-19T03:01:48.256 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00013093499999999999 2024-04-19T03:01:48.256 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.256 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.256 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:01:48.256 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.012526+0000", 2024-04-19T03:01:48.256 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0049157519999999998 2024-04-19T03:01:48.256 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.256 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.256 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:48.256 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.018959+0000", 2024-04-19T03:01:48.256 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0064326009999999996 2024-04-19T03:01:48.257 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.257 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.257 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:01:48.257 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.019005+0000", 2024-04-19T03:01:48.257 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.6066999999999998e-05 2024-04-19T03:01:48.257 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.257 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.257 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:01:48.257 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.019031+0000", 2024-04-19T03:01:48.257 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.6009000000000001e-05 2024-04-19T03:01:48.257 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:48.257 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:48.257 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:48.258 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.258 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.258 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:01:48.258 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:14.997149+0000", 2024-04-19T03:01:48.258 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 33.237220065999999, 2024-04-19T03:01:48.258 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.021805590999999999, 2024-04-19T03:01:48.258 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:01:48.258 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:48.258 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:01:48.258 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.258 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:01:48.258 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997149+0000", 2024-04-19T03:01:48.258 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:48.259 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.259 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.259 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:01:48.259 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997149+0000", 2024-04-19T03:01:48.259 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:48.259 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.259 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.259 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:01:48.259 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997148+0000", 2024-04-19T03:01:48.259 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2024-04-19T03:01:48.259 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.259 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.259 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:01:48.260 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997166+0000", 2024-04-19T03:01:48.260 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.8233e-05 2024-04-19T03:01:48.260 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.260 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.260 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:01:48.260 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997182+0000", 2024-04-19T03:01:48.260 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5999999999999999e-05 2024-04-19T03:01:48.260 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.260 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.260 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:01:48.260 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997195+0000", 2024-04-19T03:01:48.260 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.252e-05 2024-04-19T03:01:48.260 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.261 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.261 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:48.261 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997348+0000", 2024-04-19T03:01:48.261 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000153115 2024-04-19T03:01:48.261 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.261 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.261 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:01:48.261 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997354+0000", 2024-04-19T03:01:48.261 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.9359999999999996e-06 2024-04-19T03:01:48.261 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.261 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.261 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:48.261 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.008147+0000", 2024-04-19T03:01:48.262 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.010793127 2024-04-19T03:01:48.262 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.262 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.262 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:01:48.262 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.008225+0000", 2024-04-19T03:01:48.262 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.7935999999999994e-05 2024-04-19T03:01:48.262 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.262 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.263 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-04-19T03:01:48.263 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.008377+0000", 2024-04-19T03:01:48.263 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00015159099999999999 2024-04-19T03:01:48.263 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.263 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.263 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:01:48.263 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.012629+0000", 2024-04-19T03:01:48.263 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0042520420000000001 2024-04-19T03:01:48.263 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.263 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.264 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:48.264 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.018871+0000", 2024-04-19T03:01:48.264 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0062425060000000001 2024-04-19T03:01:48.264 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.264 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.264 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:01:48.264 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.018910+0000", 2024-04-19T03:01:48.264 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.8482999999999997e-05 2024-04-19T03:01:48.264 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.264 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.264 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:01:48.265 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.018955+0000", 2024-04-19T03:01:48.265 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.5252e-05 2024-04-19T03:01:48.265 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:48.265 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:48.265 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:48.265 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.265 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.265 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(mds.0.3:36 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:01:48.265 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:14.997207+0000", 2024-04-19T03:01:48.265 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 33.237162515999998, 2024-04-19T03:01:48.265 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.022210431999999999, 2024-04-19T03:01:48.265 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:01:48.265 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:48.265 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:01:48.266 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.266 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:01:48.266 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997207+0000", 2024-04-19T03:01:48.266 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:48.266 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.266 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.266 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:01:48.266 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997207+0000", 2024-04-19T03:01:48.266 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:48.266 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.266 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.266 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:01:48.267 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997206+0000", 2024-04-19T03:01:48.267 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2024-04-19T03:01:48.267 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.267 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.267 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:01:48.267 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997218+0000", 2024-04-19T03:01:48.267 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2607e-05 2024-04-19T03:01:48.267 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.267 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.267 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:01:48.267 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997234+0000", 2024-04-19T03:01:48.267 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5583999999999999e-05 2024-04-19T03:01:48.267 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.267 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.268 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:01:48.268 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997248+0000", 2024-04-19T03:01:48.268 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4270000000000001e-05 2024-04-19T03:01:48.268 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.268 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.268 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:48.268 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997397+0000", 2024-04-19T03:01:48.268 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0001482 2024-04-19T03:01:48.268 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.268 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.268 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:01:48.268 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997407+0000", 2024-04-19T03:01:48.269 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0944000000000001e-05 2024-04-19T03:01:48.269 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.269 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.269 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:48.269 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.008173+0000", 2024-04-19T03:01:48.269 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.010765378000000001 2024-04-19T03:01:48.269 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.269 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.269 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:01:48.269 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.008278+0000", 2024-04-19T03:01:48.269 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00010538 2024-04-19T03:01:48.269 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.269 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.270 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 1", 2024-04-19T03:01:48.270 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.008423+0000", 2024-04-19T03:01:48.270 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014525599999999999 2024-04-19T03:01:48.270 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.270 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.270 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:01:48.270 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.012734+0000", 2024-04-19T03:01:48.270 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0043108590000000002 2024-04-19T03:01:48.270 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.270 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.270 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:48.270 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.019318+0000", 2024-04-19T03:01:48.271 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0065836130000000003 2024-04-19T03:01:48.271 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.271 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.271 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:01:48.271 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.019382+0000", 2024-04-19T03:01:48.271 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.3925999999999997e-05 2024-04-19T03:01:48.271 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.271 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.271 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:01:48.271 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.019417+0000", 2024-04-19T03:01:48.271 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.5454999999999999e-05 2024-04-19T03:01:48.271 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:48.271 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:48.271 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:48.271 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.272 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.272 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(mds.0.3:15 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:01:48.272 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:14.997260+0000", 2024-04-19T03:01:48.272 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 33.237109365000002, 2024-04-19T03:01:48.272 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.021842842000000001, 2024-04-19T03:01:48.272 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:01:48.272 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:48.272 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:01:48.272 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.272 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:01:48.272 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997260+0000", 2024-04-19T03:01:48.272 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:48.272 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.273 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.273 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:01:48.273 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997260+0000", 2024-04-19T03:01:48.273 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:48.273 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.273 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.273 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:01:48.273 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997259+0000", 2024-04-19T03:01:48.273 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999995 2024-04-19T03:01:48.273 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.273 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.273 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:01:48.273 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997270+0000", 2024-04-19T03:01:48.273 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0312999999999999e-05 2024-04-19T03:01:48.273 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.274 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.274 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:01:48.274 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997279+0000", 2024-04-19T03:01:48.274 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.7770000000000008e-06 2024-04-19T03:01:48.274 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.274 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.274 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:01:48.274 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997286+0000", 2024-04-19T03:01:48.274 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.0129999999999996e-06 2024-04-19T03:01:48.274 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.274 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.274 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:48.275 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997433+0000", 2024-04-19T03:01:48.275 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014774699999999999 2024-04-19T03:01:48.275 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.275 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.275 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:01:48.275 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997443+0000", 2024-04-19T03:01:48.275 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.414e-06 2024-04-19T03:01:48.275 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.275 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.275 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:48.275 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.008673+0000", 2024-04-19T03:01:48.275 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.011230789999999999 2024-04-19T03:01:48.275 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.275 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.276 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:01:48.276 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.008808+0000", 2024-04-19T03:01:48.276 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000134346 2024-04-19T03:01:48.276 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.276 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.276 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-04-19T03:01:48.276 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.008922+0000", 2024-04-19T03:01:48.276 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000114444 2024-04-19T03:01:48.276 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.276 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.276 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:01:48.276 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.013442+0000", 2024-04-19T03:01:48.276 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0045193439999999998 2024-04-19T03:01:48.276 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.277 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.277 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:48.277 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.019005+0000", 2024-04-19T03:01:48.277 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00556333 2024-04-19T03:01:48.277 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.277 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.277 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:01:48.277 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.019049+0000", 2024-04-19T03:01:48.277 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.4240000000000003e-05 2024-04-19T03:01:48.277 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.277 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.277 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:01:48.277 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.019103+0000", 2024-04-19T03:01:48.277 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.3706999999999999e-05 2024-04-19T03:01:48.278 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:48.278 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:48.278 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:48.278 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.278 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.278 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(mds.0.3:17 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:01:48.278 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:14.997292+0000", 2024-04-19T03:01:48.278 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 33.237077638000002, 2024-04-19T03:01:48.278 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.019573165999999999, 2024-04-19T03:01:48.278 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:01:48.278 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:48.278 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:01:48.279 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.279 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:01:48.279 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997292+0000", 2024-04-19T03:01:48.279 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:48.279 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.279 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.279 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:01:48.279 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997292+0000", 2024-04-19T03:01:48.279 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:48.279 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.279 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.279 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:01:48.279 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997291+0000", 2024-04-19T03:01:48.279 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999995 2024-04-19T03:01:48.279 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.279 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.280 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:01:48.280 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997297+0000", 2024-04-19T03:01:48.280 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.3900000000000001e-06 2024-04-19T03:01:48.280 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.280 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.280 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:01:48.280 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997316+0000", 2024-04-19T03:01:48.280 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.9406e-05 2024-04-19T03:01:48.280 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.280 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.280 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:01:48.280 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997353+0000", 2024-04-19T03:01:48.280 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.6563999999999998e-05 2024-04-19T03:01:48.280 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.280 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.281 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:48.281 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997447+0000", 2024-04-19T03:01:48.281 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.4463999999999995e-05 2024-04-19T03:01:48.281 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.281 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.281 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op must wait for map", 2024-04-19T03:01:48.281 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997458+0000", 2024-04-19T03:01:48.281 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0817e-05 2024-04-19T03:01:48.281 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.281 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.281 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:48.281 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.002013+0000", 2024-04-19T03:01:48.281 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.004555229 2024-04-19T03:01:48.281 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.282 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.282 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:01:48.282 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.002943+0000", 2024-04-19T03:01:48.282 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00092983200000000001 2024-04-19T03:01:48.282 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.282 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.282 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-04-19T03:01:48.282 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.003257+0000", 2024-04-19T03:01:48.282 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00031455399999999998 2024-04-19T03:01:48.282 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.282 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.285 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:01:48.286 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.014107+0000", 2024-04-19T03:01:48.286 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.010849648 2024-04-19T03:01:48.286 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.286 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.286 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:48.286 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.016767+0000", 2024-04-19T03:01:48.286 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0026594990000000001 2024-04-19T03:01:48.286 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.286 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.286 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:01:48.287 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.016825+0000", 2024-04-19T03:01:48.287 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.8264000000000003e-05 2024-04-19T03:01:48.287 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.287 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.287 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:01:48.287 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.016865+0000", 2024-04-19T03:01:48.287 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.0108999999999998e-05 2024-04-19T03:01:48.287 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:48.287 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:48.287 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:48.287 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.287 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.287 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(mds.0.3:22 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:01:48.288 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:14.997383+0000", 2024-04-19T03:01:48.288 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 33.236986858000002, 2024-04-19T03:01:48.288 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.019634641000000001, 2024-04-19T03:01:48.288 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:01:48.288 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "started", 2024-04-19T03:01:48.288 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:01:48.288 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.288 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:01:48.288 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997383+0000", 2024-04-19T03:01:48.288 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:48.288 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.288 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.289 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:01:48.289 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997383+0000", 2024-04-19T03:01:48.289 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:48.289 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.289 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.289 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:01:48.289 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997381+0000", 2024-04-19T03:01:48.289 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999986 2024-04-19T03:01:48.289 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.289 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.289 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:01:48.289 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997399+0000", 2024-04-19T03:01:48.290 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.802e-05 2024-04-19T03:01:48.290 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.290 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.290 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:01:48.290 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997417+0000", 2024-04-19T03:01:48.290 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.7581e-05 2024-04-19T03:01:48.290 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.290 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.290 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:01:48.290 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997429+0000", 2024-04-19T03:01:48.290 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1803e-05 2024-04-19T03:01:48.291 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.291 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.291 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:48.291 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997540+0000", 2024-04-19T03:01:48.291 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000111397 2024-04-19T03:01:48.291 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.291 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.291 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:01:48.291 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997552+0000", 2024-04-19T03:01:48.291 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1643e-05 2024-04-19T03:01:48.291 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.291 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.291 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:48.292 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.006836+0000", 2024-04-19T03:01:48.292 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0092841940000000008 2024-04-19T03:01:48.292 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.292 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.292 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:01:48.292 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.006982+0000", 2024-04-19T03:01:48.292 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014572899999999999 2024-04-19T03:01:48.292 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.292 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.292 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:01:48.292 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.017017+0000", 2024-04-19T03:01:48.293 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.010035571 2024-04-19T03:01:48.293 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:48.293 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:48.293 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:48.293 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.293 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.293 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(mds.0.3:23 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:01:48.293 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:14.997449+0000", 2024-04-19T03:01:48.293 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 33.236920316999999, 2024-04-19T03:01:48.293 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.022679250000000001, 2024-04-19T03:01:48.294 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:01:48.294 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "started", 2024-04-19T03:01:48.294 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:01:48.294 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.294 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:01:48.294 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997449+0000", 2024-04-19T03:01:48.294 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:48.294 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.294 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.294 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:01:48.294 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997449+0000", 2024-04-19T03:01:48.294 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:48.295 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.295 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.295 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:01:48.295 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997448+0000", 2024-04-19T03:01:48.295 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999995 2024-04-19T03:01:48.295 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.295 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.295 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:01:48.295 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997452+0000", 2024-04-19T03:01:48.295 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.0369999999999996e-06 2024-04-19T03:01:48.295 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.295 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.296 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:01:48.296 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997461+0000", 2024-04-19T03:01:48.296 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.6100000000000006e-06 2024-04-19T03:01:48.296 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.296 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.296 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:01:48.296 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997468+0000", 2024-04-19T03:01:48.296 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.8360000000000003e-06 2024-04-19T03:01:48.296 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.296 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.296 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:48.296 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997546+0000", 2024-04-19T03:01:48.297 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.7956999999999999e-05 2024-04-19T03:01:48.297 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.297 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.297 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:01:48.297 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997555+0000", 2024-04-19T03:01:48.297 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.2269999999999999e-06 2024-04-19T03:01:48.297 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.297 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.297 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:48.297 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.010065+0000", 2024-04-19T03:01:48.297 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.012509457999999999 2024-04-19T03:01:48.297 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.297 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.298 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:01:48.298 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.010187+0000", 2024-04-19T03:01:48.298 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000122059 2024-04-19T03:01:48.298 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.298 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.298 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:01:48.299 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.020128+0000", 2024-04-19T03:01:48.299 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0099417529999999994 2024-04-19T03:01:48.299 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:48.299 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:48.299 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:48.299 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.299 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.299 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(mds.0.3:25 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:01:48.299 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:14.997485+0000", 2024-04-19T03:01:48.299 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 33.236884850999999, 2024-04-19T03:01:48.300 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.021633427, 2024-04-19T03:01:48.300 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:01:48.300 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "started", 2024-04-19T03:01:48.300 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:01:48.300 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.300 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:01:48.300 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997485+0000", 2024-04-19T03:01:48.300 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:48.300 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.301 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.301 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:01:48.301 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997485+0000", 2024-04-19T03:01:48.302 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:48.302 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.302 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.302 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:01:48.302 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997484+0000", 2024-04-19T03:01:48.302 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2024-04-19T03:01:48.302 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.302 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.302 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:01:48.302 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997490+0000", 2024-04-19T03:01:48.302 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.857e-06 2024-04-19T03:01:48.303 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.303 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.303 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:01:48.303 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997505+0000", 2024-04-19T03:01:48.303 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.518e-05 2024-04-19T03:01:48.303 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.303 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.303 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:01:48.303 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997520+0000", 2024-04-19T03:01:48.303 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5026e-05 2024-04-19T03:01:48.303 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.303 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.303 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:48.303 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997607+0000", 2024-04-19T03:01:48.304 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.7107000000000005e-05 2024-04-19T03:01:48.304 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.304 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.304 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op must wait for map", 2024-04-19T03:01:48.304 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997614+0000", 2024-04-19T03:01:48.304 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.0539999999999997e-06 2024-04-19T03:01:48.304 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.304 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.304 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:48.304 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.009808+0000", 2024-04-19T03:01:48.304 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.012194371000000001 2024-04-19T03:01:48.304 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.304 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.304 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:01:48.305 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.010107+0000", 2024-04-19T03:01:48.305 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000298731 2024-04-19T03:01:48.305 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.305 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.305 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:01:48.305 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.019118+0000", 2024-04-19T03:01:48.305 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0090109839999999997 2024-04-19T03:01:48.305 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:48.305 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:48.305 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:48.305 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.305 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.305 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4755.0:11277 5.c 5:38c3ceb2:::benchmark_data_smithi096_19531_object11276:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T03:01:48.305 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:42.059676+0000", 2024-04-19T03:01:48.306 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 6.1746932289999998, 2024-04-19T03:01:48.306 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.029909680000000001, 2024-04-19T03:01:48.306 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:01:48.306 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:48.306 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-04-19T03:01:48.306 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4755", 2024-04-19T03:01:48.306 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:48.306 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 11277 2024-04-19T03:01:48.306 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.306 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:01:48.306 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.306 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:01:48.306 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.059676+0000", 2024-04-19T03:01:48.307 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:48.307 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.307 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.307 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:01:48.307 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.059676+0000", 2024-04-19T03:01:48.307 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:48.307 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.307 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.307 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:01:48.307 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.059665+0000", 2024-04-19T03:01:48.307 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999886 2024-04-19T03:01:48.307 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.307 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.307 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:01:48.308 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.059777+0000", 2024-04-19T03:01:48.308 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000111953 2024-04-19T03:01:48.308 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.308 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.308 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:01:48.308 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.059789+0000", 2024-04-19T03:01:48.308 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1809e-05 2024-04-19T03:01:48.308 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.308 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.308 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:01:48.308 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.059797+0000", 2024-04-19T03:01:48.308 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.2090000000000005e-06 2024-04-19T03:01:48.308 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.308 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.309 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:48.309 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.060528+0000", 2024-04-19T03:01:48.309 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00073144499999999995 2024-04-19T03:01:48.309 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.309 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.309 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:01:48.309 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.060662+0000", 2024-04-19T03:01:48.309 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000133435 2024-04-19T03:01:48.309 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.309 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.309 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-04-19T03:01:48.309 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.060766+0000", 2024-04-19T03:01:48.309 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00010473500000000001 2024-04-19T03:01:48.310 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.310 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.310 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:01:48.310 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.067649+0000", 2024-04-19T03:01:48.310 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.006882684 2024-04-19T03:01:48.310 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.310 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.310 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:48.310 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.089475+0000", 2024-04-19T03:01:48.310 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.021826196999999999 2024-04-19T03:01:48.310 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.310 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.310 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:01:48.310 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.089535+0000", 2024-04-19T03:01:48.311 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.9239e-05 2024-04-19T03:01:48.311 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.311 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.311 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:01:48.311 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.089586+0000", 2024-04-19T03:01:48.311 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.1288000000000001e-05 2024-04-19T03:01:48.311 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:48.311 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:48.311 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:48.311 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.311 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.311 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4755.0:11280 5.6 5:6e34f5e7:::benchmark_data_smithi096_19531_object11279:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T03:01:48.311 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:42.060002+0000", 2024-04-19T03:01:48.312 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 6.1743678529999997, 2024-04-19T03:01:48.312 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.028171841999999999, 2024-04-19T03:01:48.312 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:01:48.312 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:48.312 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-04-19T03:01:48.312 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4755", 2024-04-19T03:01:48.312 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:48.312 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 11280 2024-04-19T03:01:48.312 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.312 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:01:48.312 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.312 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:01:48.312 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.060002+0000", 2024-04-19T03:01:48.312 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:48.313 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.313 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.313 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:01:48.313 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.060002+0000", 2024-04-19T03:01:48.313 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:48.313 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.313 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.313 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:01:48.313 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.060000+0000", 2024-04-19T03:01:48.313 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2024-04-19T03:01:48.313 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.313 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.313 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:01:48.313 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.060120+0000", 2024-04-19T03:01:48.314 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00011941400000000001 2024-04-19T03:01:48.314 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.314 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.314 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:01:48.314 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.060132+0000", 2024-04-19T03:01:48.314 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2197e-05 2024-04-19T03:01:48.314 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.314 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.314 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:01:48.314 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.060141+0000", 2024-04-19T03:01:48.314 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.6829999999999997e-06 2024-04-19T03:01:48.314 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.314 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.315 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:48.315 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.060194+0000", 2024-04-19T03:01:48.315 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.3395e-05 2024-04-19T03:01:48.315 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.315 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.315 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:01:48.315 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.060333+0000", 2024-04-19T03:01:48.315 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00013935799999999999 2024-04-19T03:01:48.315 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.315 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.315 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-04-19T03:01:48.315 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.060477+0000", 2024-04-19T03:01:48.315 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000143938 2024-04-19T03:01:48.316 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.316 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.316 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:01:48.316 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.067752+0000", 2024-04-19T03:01:48.316 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0072741580000000002 2024-04-19T03:01:48.316 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.316 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.316 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:48.316 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.088041+0000", 2024-04-19T03:01:48.316 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.020288955000000001 2024-04-19T03:01:48.316 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.316 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.316 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:01:48.316 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.088113+0000", 2024-04-19T03:01:48.317 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.2492999999999999e-05 2024-04-19T03:01:48.317 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.317 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.317 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:01:48.317 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.088173+0000", 2024-04-19T03:01:48.317 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.0418999999999999e-05 2024-04-19T03:01:48.317 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:48.317 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:48.317 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:48.317 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.317 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.317 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4755.0:11274 5.e e26/22 5:7c846032:::benchmark_data_smithi096_19531_object11273:head v 26'697, mlcod=26'692)", 2024-04-19T03:01:48.317 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:42.065726+0000", 2024-04-19T03:01:48.317 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 6.1686433259999998, 2024-04-19T03:01:48.318 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.028607227999999998, 2024-04-19T03:01:48.318 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:01:48.318 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:48.318 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:01:48.319 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.319 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:01:48.319 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.065726+0000", 2024-04-19T03:01:48.319 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:48.319 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.319 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.320 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:01:48.320 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.065726+0000", 2024-04-19T03:01:48.320 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:48.320 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.320 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.320 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:01:48.320 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.065725+0000", 2024-04-19T03:01:48.320 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2024-04-19T03:01:48.320 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.320 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.320 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:01:48.320 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.066818+0000", 2024-04-19T03:01:48.320 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0010930110000000001 2024-04-19T03:01:48.320 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.321 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.321 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:01:48.321 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.066826+0000", 2024-04-19T03:01:48.321 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.0609999999999996e-06 2024-04-19T03:01:48.321 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.321 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.321 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:01:48.321 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.066831+0000", 2024-04-19T03:01:48.321 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.7500000000000003e-06 2024-04-19T03:01:48.321 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.321 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.321 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:48.321 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.066857+0000", 2024-04-19T03:01:48.321 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.6126999999999999e-05 2024-04-19T03:01:48.321 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.322 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.322 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:01:48.322 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.066868+0000", 2024-04-19T03:01:48.322 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1113e-05 2024-04-19T03:01:48.322 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.322 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.322 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:01:48.322 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.094266+0000", 2024-04-19T03:01:48.322 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.027397731000000002 2024-04-19T03:01:48.322 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.322 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.322 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:01:48.323 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.094333+0000", 2024-04-19T03:01:48.323 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.7230000000000005e-05 2024-04-19T03:01:48.323 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:48.323 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:48.323 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:48.323 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.323 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.323 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4755.0:11279 5.8 e26/22 5:10b60c58:::benchmark_data_smithi096_19531_object11278:head v 26'723, mlcod=26'719)", 2024-04-19T03:01:48.323 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:42.066841+0000", 2024-04-19T03:01:48.323 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 6.1675280109999999, 2024-04-19T03:01:48.323 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.021736267, 2024-04-19T03:01:48.323 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:01:48.323 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:48.323 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:01:48.323 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.324 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:01:48.324 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.066841+0000", 2024-04-19T03:01:48.324 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:48.324 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.324 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.324 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:01:48.324 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.066841+0000", 2024-04-19T03:01:48.324 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:48.324 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.324 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.324 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:01:48.324 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.066841+0000", 2024-04-19T03:01:48.325 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999995 2024-04-19T03:01:48.325 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.325 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.325 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:01:48.325 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.066876+0000", 2024-04-19T03:01:48.325 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.4790999999999999e-05 2024-04-19T03:01:48.325 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.325 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.325 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:01:48.325 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.066880+0000", 2024-04-19T03:01:48.325 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.3610000000000003e-06 2024-04-19T03:01:48.325 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.325 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.326 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:01:48.326 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.066883+0000", 2024-04-19T03:01:48.326 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.4079999999999998e-06 2024-04-19T03:01:48.326 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.326 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.326 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:48.326 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.066929+0000", 2024-04-19T03:01:48.326 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.5444000000000001e-05 2024-04-19T03:01:48.326 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.327 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.327 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:01:48.327 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.066951+0000", 2024-04-19T03:01:48.327 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.2578999999999998e-05 2024-04-19T03:01:48.327 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.327 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.327 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:01:48.327 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.088518+0000", 2024-04-19T03:01:48.327 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.021566617 2024-04-19T03:01:48.327 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.327 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.327 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:01:48.328 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.088578+0000", 2024-04-19T03:01:48.328 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.9655999999999999e-05 2024-04-19T03:01:48.328 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:48.328 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:48.328 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:48.328 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.328 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.328 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4755.0:11282 5.e e26/22 5:75b7c510:::benchmark_data_smithi096_19531_object11281:head v 26'698, mlcod=26'693)", 2024-04-19T03:01:48.328 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:42.066923+0000", 2024-04-19T03:01:48.328 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 6.1674461440000004, 2024-04-19T03:01:48.328 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.027436461999999998, 2024-04-19T03:01:48.328 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:01:48.329 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:48.329 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:01:48.329 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.329 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:01:48.329 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.066923+0000", 2024-04-19T03:01:48.329 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:48.329 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.329 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.329 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:01:48.329 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.066923+0000", 2024-04-19T03:01:48.330 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:48.330 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.330 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.330 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:01:48.330 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.066923+0000", 2024-04-19T03:01:48.330 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999995 2024-04-19T03:01:48.330 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.330 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.330 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:01:48.331 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.066955+0000", 2024-04-19T03:01:48.331 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.2060999999999997e-05 2024-04-19T03:01:48.331 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.331 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.331 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:01:48.331 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.066962+0000", 2024-04-19T03:01:48.331 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.1969999999999999e-06 2024-04-19T03:01:48.331 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.331 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.331 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:01:48.331 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.066967+0000", 2024-04-19T03:01:48.331 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.6589999999999998e-06 2024-04-19T03:01:48.331 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.332 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.332 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:48.332 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.067762+0000", 2024-04-19T03:01:48.332 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00079538199999999997 2024-04-19T03:01:48.332 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.332 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.332 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:01:48.332 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.067782+0000", 2024-04-19T03:01:48.332 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.9432999999999998e-05 2024-04-19T03:01:48.332 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.333 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.333 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:01:48.333 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.094339+0000", 2024-04-19T03:01:48.333 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.026556778999999999 2024-04-19T03:01:48.333 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.333 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.333 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:01:48.333 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.094360+0000", 2024-04-19T03:01:48.333 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.1246e-05 2024-04-19T03:01:48.333 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:48.333 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:48.334 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:48.334 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.334 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.334 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4755.0:11291 5.a 5:5ee9d828:::benchmark_data_smithi096_19531_object11290:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T03:01:48.334 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:42.067725+0000", 2024-04-19T03:01:48.334 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 6.1666440339999999, 2024-04-19T03:01:48.334 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.021089111000000001, 2024-04-19T03:01:48.334 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:01:48.334 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:48.334 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-04-19T03:01:48.334 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4755", 2024-04-19T03:01:48.334 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:48.335 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 11291 2024-04-19T03:01:48.335 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.335 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:01:48.335 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.335 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:01:48.335 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.067725+0000", 2024-04-19T03:01:48.335 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:48.335 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.335 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.335 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:01:48.335 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.067725+0000", 2024-04-19T03:01:48.335 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:48.336 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.336 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.336 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:01:48.336 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.067724+0000", 2024-04-19T03:01:48.336 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2024-04-19T03:01:48.336 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.336 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.336 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:01:48.336 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.067842+0000", 2024-04-19T03:01:48.336 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000117691 2024-04-19T03:01:48.336 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.336 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.336 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:01:48.336 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.067853+0000", 2024-04-19T03:01:48.337 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0679000000000001e-05 2024-04-19T03:01:48.337 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.337 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.337 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:01:48.337 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.067859+0000", 2024-04-19T03:01:48.337 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.9510000000000003e-06 2024-04-19T03:01:48.337 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.337 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.337 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:48.337 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.067905+0000", 2024-04-19T03:01:48.337 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.6242999999999998e-05 2024-04-19T03:01:48.337 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.337 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.337 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:01:48.338 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.085335+0000", 2024-04-19T03:01:48.338 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.017430451 2024-04-19T03:01:48.338 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.338 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.338 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 1", 2024-04-19T03:01:48.338 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.085538+0000", 2024-04-19T03:01:48.338 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000202511 2024-04-19T03:01:48.338 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.338 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.338 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:48.338 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.087988+0000", 2024-04-19T03:01:48.338 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0024505780000000001 2024-04-19T03:01:48.339 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.339 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.339 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:01:48.339 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.088672+0000", 2024-04-19T03:01:48.339 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00068377900000000003 2024-04-19T03:01:48.339 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.339 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.339 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:01:48.339 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.088757+0000", 2024-04-19T03:01:48.339 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.4384999999999999e-05 2024-04-19T03:01:48.339 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.339 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.339 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:01:48.339 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.088815+0000", 2024-04-19T03:01:48.340 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.7995999999999998e-05 2024-04-19T03:01:48.340 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:48.340 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:48.340 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:48.340 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.340 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.340 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4755.0:11293 5.c 5:31728bfd:::benchmark_data_smithi096_19531_object11292:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T03:01:48.340 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:42.068359+0000", 2024-04-19T03:01:48.340 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 6.1660103199999998, 2024-04-19T03:01:48.341 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.022306475999999999, 2024-04-19T03:01:48.341 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:01:48.341 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:48.341 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-04-19T03:01:48.341 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4755", 2024-04-19T03:01:48.341 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:48.341 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 11293 2024-04-19T03:01:48.341 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.341 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:01:48.341 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.341 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:01:48.341 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.068359+0000", 2024-04-19T03:01:48.341 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:48.342 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.342 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.342 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:01:48.342 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.068359+0000", 2024-04-19T03:01:48.342 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:48.342 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.342 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.343 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:01:48.343 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.068358+0000", 2024-04-19T03:01:48.343 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2024-04-19T03:01:48.343 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.343 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.343 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:01:48.343 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.068427+0000", 2024-04-19T03:01:48.344 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.9139000000000003e-05 2024-04-19T03:01:48.344 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.344 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.344 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:01:48.344 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.085292+0000", 2024-04-19T03:01:48.344 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.016864371 2024-04-19T03:01:48.344 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.344 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.344 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:01:48.344 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.085306+0000", 2024-04-19T03:01:48.344 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.434e-05 2024-04-19T03:01:48.344 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.344 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.344 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:48.345 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.085404+0000", 2024-04-19T03:01:48.345 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.8145000000000003e-05 2024-04-19T03:01:48.345 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.345 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.345 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:01:48.345 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.085569+0000", 2024-04-19T03:01:48.345 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00016504099999999999 2024-04-19T03:01:48.345 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.345 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.345 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-04-19T03:01:48.345 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.085739+0000", 2024-04-19T03:01:48.345 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000170099 2024-04-19T03:01:48.345 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.345 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.346 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:01:48.346 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.089603+0000", 2024-04-19T03:01:48.346 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0038636080000000001 2024-04-19T03:01:48.346 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.346 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.346 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:48.346 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.090578+0000", 2024-04-19T03:01:48.346 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00097513199999999997 2024-04-19T03:01:48.346 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.347 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.347 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:01:48.347 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.090618+0000", 2024-04-19T03:01:48.347 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.9987999999999997e-05 2024-04-19T03:01:48.347 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.347 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.347 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:01:48.347 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.090666+0000", 2024-04-19T03:01:48.347 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.7420999999999999e-05 2024-04-19T03:01:48.347 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:48.347 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:48.347 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:48.347 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.348 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.348 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4755.0:11288 5.0 e26/22 5:042458d0:::benchmark_data_smithi096_19531_object11287:head v 26'772, mlcod=26'770)", 2024-04-19T03:01:48.348 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:42.068428+0000", 2024-04-19T03:01:48.348 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 6.1659419189999998, 2024-04-19T03:01:48.348 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.020774925, 2024-04-19T03:01:48.348 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:01:48.348 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:48.348 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:01:48.348 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.349 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:01:48.349 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.068428+0000", 2024-04-19T03:01:48.349 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:48.349 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.349 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.349 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:01:48.349 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.068428+0000", 2024-04-19T03:01:48.349 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:48.349 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.349 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.350 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:01:48.350 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.068427+0000", 2024-04-19T03:01:48.350 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999995 2024-04-19T03:01:48.350 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.350 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.350 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:01:48.350 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.068481+0000", 2024-04-19T03:01:48.350 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.3866999999999998e-05 2024-04-19T03:01:48.350 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.350 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.350 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:01:48.350 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.085273+0000", 2024-04-19T03:01:48.351 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.016792372999999999 2024-04-19T03:01:48.351 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.351 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.351 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:01:48.351 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.085288+0000", 2024-04-19T03:01:48.351 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4941e-05 2024-04-19T03:01:48.351 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.351 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.351 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:48.351 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.085350+0000", 2024-04-19T03:01:48.351 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.1550999999999994e-05 2024-04-19T03:01:48.352 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.352 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.352 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:01:48.352 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.085384+0000", 2024-04-19T03:01:48.352 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.4915e-05 2024-04-19T03:01:48.352 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.352 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.352 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:01:48.352 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.089164+0000", 2024-04-19T03:01:48.352 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0037794410000000001 2024-04-19T03:01:48.352 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.352 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.352 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:01:48.352 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.089202+0000", 2024-04-19T03:01:48.353 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.8519000000000002e-05 2024-04-19T03:01:48.353 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:48.353 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:48.353 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:48.353 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.353 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.353 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4755.0:24217 5.3 5:c03b7422:::benchmark_data_smithi096_19531_object24216:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T03:01:48.353 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:47.410095+0000", 2024-04-19T03:01:48.353 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 0.82427437299999995, 2024-04-19T03:01:48.353 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0150338, 2024-04-19T03:01:48.353 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:01:48.353 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:48.353 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-04-19T03:01:48.353 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4755", 2024-04-19T03:01:48.354 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:48.354 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 24217 2024-04-19T03:01:48.354 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.354 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:01:48.354 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.354 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:01:48.354 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:47.410095+0000", 2024-04-19T03:01:48.354 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:48.354 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.354 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.354 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:01:48.354 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:47.410095+0000", 2024-04-19T03:01:48.355 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:48.355 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.355 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.355 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:01:48.355 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:47.410094+0000", 2024-04-19T03:01:48.355 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2024-04-19T03:01:48.355 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.355 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.355 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:01:48.355 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:47.410151+0000", 2024-04-19T03:01:48.355 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.6611999999999999e-05 2024-04-19T03:01:48.356 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.356 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.356 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:01:48.356 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:47.410159+0000", 2024-04-19T03:01:48.356 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.0949999999999996e-06 2024-04-19T03:01:48.356 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.356 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.357 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:01:48.357 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:47.410163+0000", 2024-04-19T03:01:48.357 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.4039999999999997e-06 2024-04-19T03:01:48.357 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.357 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.357 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:48.358 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:47.413678+0000", 2024-04-19T03:01:48.358 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.003514966 2024-04-19T03:01:48.358 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.358 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.358 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:01:48.358 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:47.413844+0000", 2024-04-19T03:01:48.359 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00016588400000000001 2024-04-19T03:01:48.359 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.359 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.359 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-04-19T03:01:48.359 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:47.413982+0000", 2024-04-19T03:01:48.359 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00013829000000000001 2024-04-19T03:01:48.360 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.360 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.360 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:48.360 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:47.421668+0000", 2024-04-19T03:01:48.360 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0076854560000000002 2024-04-19T03:01:48.360 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.360 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.361 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:01:48.361 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:47.425040+0000", 2024-04-19T03:01:48.361 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.003371892 2024-04-19T03:01:48.361 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.361 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.361 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:01:48.361 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:47.425096+0000", 2024-04-19T03:01:48.362 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.5858e-05 2024-04-19T03:01:48.362 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.362 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.362 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:01:48.362 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:47.425129+0000", 2024-04-19T03:01:48.363 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.3160000000000001e-05 2024-04-19T03:01:48.363 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:48.363 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:48.363 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:48.363 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.363 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.364 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4755.0:24220 5.3 5:c7fc2237:::benchmark_data_smithi096_19531_object24219:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T03:01:48.364 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:47.413011+0000", 2024-04-19T03:01:48.364 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 0.82135889100000004, 2024-04-19T03:01:48.364 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.01399542, 2024-04-19T03:01:48.364 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:01:48.364 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:48.365 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-04-19T03:01:48.365 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4755", 2024-04-19T03:01:48.365 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:48.365 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 24220 2024-04-19T03:01:48.365 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.365 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:01:48.366 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.366 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:01:48.366 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:47.413011+0000", 2024-04-19T03:01:48.366 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:48.366 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.367 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.367 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:01:48.367 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:47.413011+0000", 2024-04-19T03:01:48.367 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:48.367 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.367 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.368 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:01:48.368 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:47.413010+0000", 2024-04-19T03:01:48.368 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999995 2024-04-19T03:01:48.368 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.368 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.368 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:01:48.369 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:47.413038+0000", 2024-04-19T03:01:48.369 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.7457000000000002e-05 2024-04-19T03:01:48.369 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.369 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.369 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:01:48.369 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:47.413043+0000", 2024-04-19T03:01:48.370 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.366e-06 2024-04-19T03:01:48.370 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.370 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.370 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:01:48.370 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:47.413046+0000", 2024-04-19T03:01:48.371 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.3850000000000002e-06 2024-04-19T03:01:48.371 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.371 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.371 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:48.371 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:47.417136+0000", 2024-04-19T03:01:48.371 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.004089629 2024-04-19T03:01:48.372 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.372 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.372 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:01:48.372 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:47.417228+0000", 2024-04-19T03:01:48.372 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.2173e-05 2024-04-19T03:01:48.372 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.372 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.373 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-04-19T03:01:48.373 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:47.417306+0000", 2024-04-19T03:01:48.373 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.8379000000000003e-05 2024-04-19T03:01:48.373 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.373 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.373 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:48.373 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:47.425231+0000", 2024-04-19T03:01:48.373 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0079245359999999994 2024-04-19T03:01:48.373 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.373 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.374 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:01:48.374 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:47.426930+0000", 2024-04-19T03:01:48.374 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0016989380000000001 2024-04-19T03:01:48.374 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.374 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.374 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:01:48.374 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:47.426970+0000", 2024-04-19T03:01:48.374 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.0244000000000003e-05 2024-04-19T03:01:48.374 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.374 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.375 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:01:48.375 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:47.427006+0000", 2024-04-19T03:01:48.375 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.5750000000000002e-05 2024-04-19T03:01:48.375 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:48.375 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:48.375 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:48.375 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.376 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.376 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4755.0:25697 5.6 5:66ec51da:::benchmark_data_smithi096_19531_object25696:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-04-19T03:01:48.376 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:48.065130+0000", 2024-04-19T03:01:48.376 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 0.169239104, 2024-04-19T03:01:48.376 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.013787089000000001, 2024-04-19T03:01:48.376 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:01:48.376 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:48.376 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-04-19T03:01:48.376 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4755", 2024-04-19T03:01:48.376 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:48.376 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 25697 2024-04-19T03:01:48.376 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.376 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:01:48.376 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.377 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:01:48.377 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:48.065130+0000", 2024-04-19T03:01:48.377 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:48.377 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.377 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.377 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:01:48.377 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:48.065130+0000", 2024-04-19T03:01:48.377 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:48.377 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.377 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.377 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:01:48.377 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:48.065130+0000", 2024-04-19T03:01:48.377 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2024-04-19T03:01:48.377 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.377 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.378 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:01:48.378 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:48.065178+0000", 2024-04-19T03:01:48.378 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.8476999999999997e-05 2024-04-19T03:01:48.378 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.378 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.378 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:01:48.378 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:48.065190+0000", 2024-04-19T03:01:48.378 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2153999999999999e-05 2024-04-19T03:01:48.378 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.378 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.378 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:01:48.378 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:48.065196+0000", 2024-04-19T03:01:48.379 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.7540000000000003e-06 2024-04-19T03:01:48.379 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.379 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.379 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:48.379 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:48.068259+0000", 2024-04-19T03:01:48.379 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0030630800000000001 2024-04-19T03:01:48.379 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.379 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.380 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:01:48.380 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:48.068407+0000", 2024-04-19T03:01:48.380 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014749899999999999 2024-04-19T03:01:48.380 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.380 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.380 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-04-19T03:01:48.380 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:48.068538+0000", 2024-04-19T03:01:48.380 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000131118 2024-04-19T03:01:48.380 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.380 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.380 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:01:48.380 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:48.075325+0000", 2024-04-19T03:01:48.380 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0067873040000000001 2024-04-19T03:01:48.380 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.380 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.381 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:48.381 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:48.078818+0000", 2024-04-19T03:01:48.381 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.003492733 2024-04-19T03:01:48.381 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.381 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.381 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:01:48.381 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:48.078874+0000", 2024-04-19T03:01:48.381 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.5983999999999998e-05 2024-04-19T03:01:48.381 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:48.381 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:48.381 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:01:48.381 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:48.078917+0000", 2024-04-19T03:01:48.381 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.375e-05 2024-04-19T03:01:48.381 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:48.381 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:48.381 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:48.382 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:48.382 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:48.382 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-04-19T03:01:48.383 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T03:01:48.384 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-04-19T03:01:48.377+0000 7f35986ab700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18243) UID: 0 2024-04-19T03:01:48.484 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-04-19T03:01:48.481+0000 7f35986ab700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18243) UID: 0 2024-04-19T03:01:48.513 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-19T03:01:48.514 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-04-19T03:01:48.514 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:48.514 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop_reply(client.4755.0:26669 5.d e28/22)", 2024-04-19T03:01:48.515 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:48.511482+0000", 2024-04-19T03:01:48.515 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0010167640000000001, 2024-04-19T03:01:48.515 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0010348309999999999, 2024-04-19T03:01:48.515 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:01:48.515 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-04-19T03:01:48.515 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:01:48.515 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:48.515 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:01:48.515 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:48.511482+0000", 2024-04-19T03:01:48.515 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:48.515 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:48.516 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:48.516 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:01:48.516 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:48.511482+0000", 2024-04-19T03:01:48.516 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:48.516 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:48.516 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:48.517 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:01:48.517 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:48.511481+0000", 2024-04-19T03:01:48.517 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:01:48.517 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:48.517 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:48.517 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:01:48.517 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:48.511490+0000", 2024-04-19T03:01:48.517 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.6980000000000004e-06 2024-04-19T03:01:48.517 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:48.517 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:48.517 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:01:48.517 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:48.511505+0000", 2024-04-19T03:01:48.517 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4816e-05 2024-04-19T03:01:48.518 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:48.518 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:48.518 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:01:48.518 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:48.511516+0000", 2024-04-19T03:01:48.518 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1309e-05 2024-04-19T03:01:48.518 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:48.518 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:01:48.518 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:48.518 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:48.518 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:48.518 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4755.0:26683 5.a e28/22 5:51818b82:::benchmark_data_smithi096_19531_object26682:head v 28'1625, mlcod=28'1623)", 2024-04-19T03:01:48.519 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:48.511615+0000", 2024-04-19T03:01:48.519 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.00088370699999999996, 2024-04-19T03:01:48.519 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00095433300000000003, 2024-04-19T03:01:48.519 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:01:48.519 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-19T03:01:48.519 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:01:48.519 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:48.519 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:01:48.519 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:48.511615+0000", 2024-04-19T03:01:48.519 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:48.519 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:48.519 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:48.519 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:01:48.519 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:48.511615+0000", 2024-04-19T03:01:48.520 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:48.520 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:48.520 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:48.520 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:01:48.520 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:48.511614+0000", 2024-04-19T03:01:48.520 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:01:48.520 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:48.520 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:48.520 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:01:48.520 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:48.511681+0000", 2024-04-19T03:01:48.520 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6177e-05 2024-04-19T03:01:48.520 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:48.520 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:48.520 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:01:48.521 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:48.511689+0000", 2024-04-19T03:01:48.521 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.2959999999999999e-06 2024-04-19T03:01:48.521 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:48.521 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:48.521 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:01:48.521 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:48.511695+0000", 2024-04-19T03:01:48.521 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7490000000000004e-06 2024-04-19T03:01:48.521 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:48.521 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:48.521 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:48.521 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:48.511754+0000", 2024-04-19T03:01:48.521 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9719999999999997e-05 2024-04-19T03:01:48.521 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:48.521 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:48.522 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:01:48.522 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:48.511789+0000", 2024-04-19T03:01:48.522 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4164e-05 2024-04-19T03:01:48.522 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:48.522 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:01:48.522 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:48.522 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:48.522 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:48.522 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:26669 5.d 5:b6163aa1:::benchmark_data_smithi096_19531_object26668:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-04-19T03:01:48.522 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:48.506063+0000", 2024-04-19T03:01:48.522 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0064363989999999998, 2024-04-19T03:01:48.522 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00656816, 2024-04-19T03:01:48.523 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:01:48.523 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:01:48.523 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:01:48.523 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:01:48.523 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:48.523 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 26669 2024-04-19T03:01:48.523 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:48.523 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:01:48.523 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:48.523 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:01:48.523 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:48.506063+0000", 2024-04-19T03:01:48.523 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:48.523 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:48.523 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:48.523 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:01:48.524 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:48.506063+0000", 2024-04-19T03:01:48.524 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:48.524 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:48.524 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:48.524 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:01:48.524 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:48.506061+0000", 2024-04-19T03:01:48.524 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:01:48.524 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:48.524 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:48.524 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:01:48.524 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:48.506136+0000", 2024-04-19T03:01:48.524 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4819000000000003e-05 2024-04-19T03:01:48.524 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:48.525 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:48.525 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:01:48.525 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:48.506149+0000", 2024-04-19T03:01:48.525 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2986000000000001e-05 2024-04-19T03:01:48.525 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:48.525 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:48.525 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:01:48.525 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:48.506156+0000", 2024-04-19T03:01:48.525 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7900000000000002e-06 2024-04-19T03:01:48.525 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:48.526 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:48.526 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:48.526 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:48.506210+0000", 2024-04-19T03:01:48.526 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3597999999999997e-05 2024-04-19T03:01:48.526 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:48.526 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:48.526 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:01:48.526 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:48.506379+0000", 2024-04-19T03:01:48.526 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016938399999999999 2024-04-19T03:01:48.526 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:48.526 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:48.526 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-04-19T03:01:48.527 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:48.506529+0000", 2024-04-19T03:01:48.527 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014995199999999999 2024-04-19T03:01:48.527 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:48.527 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:48.527 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:01:48.527 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:48.509247+0000", 2024-04-19T03:01:48.527 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0027181280000000002 2024-04-19T03:01:48.527 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:48.527 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:01:48.528 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:48.528 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:48.528 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:48.528 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:26671 5.d 5:bd8fb078:::benchmark_data_smithi096_19531_object26670:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-04-19T03:01:48.528 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:48.506900+0000", 2024-04-19T03:01:48.528 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.005598792, 2024-04-19T03:01:48.528 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0058100479999999999, 2024-04-19T03:01:48.528 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:01:48.528 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:01:48.528 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:01:48.528 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:01:48.528 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:48.528 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 26671 2024-04-19T03:01:48.528 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:48.528 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:01:48.529 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:48.529 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:01:48.529 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:48.506900+0000", 2024-04-19T03:01:48.529 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:48.529 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:48.529 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:48.529 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:01:48.529 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:48.506900+0000", 2024-04-19T03:01:48.529 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:48.529 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:48.529 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:48.529 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:01:48.529 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:48.506899+0000", 2024-04-19T03:01:48.529 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:01:48.530 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:48.530 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:48.530 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:01:48.530 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:48.506957+0000", 2024-04-19T03:01:48.530 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7432999999999997e-05 2024-04-19T03:01:48.530 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:48.530 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:48.530 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:01:48.530 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:48.506967+0000", 2024-04-19T03:01:48.530 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0427e-05 2024-04-19T03:01:48.530 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:48.530 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:48.530 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:01:48.531 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:48.506972+0000", 2024-04-19T03:01:48.531 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9570000000000001e-06 2024-04-19T03:01:48.531 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:48.531 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:48.531 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:48.531 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:48.507862+0000", 2024-04-19T03:01:48.531 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00088953999999999997 2024-04-19T03:01:48.531 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:48.531 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:48.531 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:01:48.531 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:48.507984+0000", 2024-04-19T03:01:48.531 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000122774 2024-04-19T03:01:48.531 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:48.531 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:48.532 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-04-19T03:01:48.532 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:48.508062+0000", 2024-04-19T03:01:48.532 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.7448999999999997e-05 2024-04-19T03:01:48.532 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:48.532 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:48.532 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:01:48.532 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:48.509540+0000", 2024-04-19T03:01:48.532 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0014778879999999999 2024-04-19T03:01:48.532 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:48.532 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:01:48.532 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:48.532 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:48.532 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:48.533 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:26672 5.0 5:021d763c:::benchmark_data_smithi096_19531_object26671:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-04-19T03:01:48.533 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:48.507669+0000", 2024-04-19T03:01:48.533 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0048303749999999996, 2024-04-19T03:01:48.533 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0051294009999999996, 2024-04-19T03:01:48.533 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:01:48.533 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:01:48.533 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:01:48.533 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:01:48.533 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:48.533 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 26672 2024-04-19T03:01:48.533 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:48.533 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:01:48.533 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:48.534 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:01:48.534 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:48.507669+0000", 2024-04-19T03:01:48.534 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:48.534 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:48.534 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:48.534 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:01:48.534 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:48.507669+0000", 2024-04-19T03:01:48.534 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:48.534 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:48.534 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:48.534 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:01:48.534 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:48.507668+0000", 2024-04-19T03:01:48.534 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:01:48.535 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:48.535 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:48.535 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:01:48.535 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:48.507788+0000", 2024-04-19T03:01:48.535 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000120337 2024-04-19T03:01:48.535 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:48.535 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:48.535 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:01:48.535 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:48.507803+0000", 2024-04-19T03:01:48.535 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4357e-05 2024-04-19T03:01:48.535 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:48.535 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:48.535 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:01:48.535 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:48.507811+0000", 2024-04-19T03:01:48.536 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.2830000000000001e-06 2024-04-19T03:01:48.536 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:48.536 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:48.536 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:48.536 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:48.507859+0000", 2024-04-19T03:01:48.536 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8165999999999999e-05 2024-04-19T03:01:48.536 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:48.536 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:48.536 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:01:48.536 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:48.507999+0000", 2024-04-19T03:01:48.536 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013950799999999999 2024-04-19T03:01:48.536 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:48.536 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:48.536 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:01:48.536 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:48.508156+0000", 2024-04-19T03:01:48.537 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000157405 2024-04-19T03:01:48.537 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:48.537 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:48.537 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:01:48.537 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:48.510291+0000", 2024-04-19T03:01:48.537 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0021348589999999998 2024-04-19T03:01:48.537 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:48.537 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:01:48.537 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:48.537 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:48.537 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:48.538 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:26675 5.4 5:2b7faf70:::benchmark_data_smithi096_19531_object26674:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-04-19T03:01:48.538 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:48.508956+0000", 2024-04-19T03:01:48.538 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0035431210000000002, 2024-04-19T03:01:48.538 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0039202689999999997, 2024-04-19T03:01:48.538 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:01:48.538 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:01:48.538 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:01:48.539 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:01:48.539 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:48.539 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 26675 2024-04-19T03:01:48.539 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:48.539 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:01:48.539 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:48.539 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:01:48.539 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:48.508956+0000", 2024-04-19T03:01:48.540 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:48.540 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:48.540 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:48.540 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:01:48.540 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:48.508956+0000", 2024-04-19T03:01:48.540 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:48.540 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:48.540 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:48.541 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:01:48.541 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:48.508955+0000", 2024-04-19T03:01:48.541 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:01:48.541 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:48.541 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:48.541 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:01:48.541 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:48.509038+0000", 2024-04-19T03:01:48.541 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3316e-05 2024-04-19T03:01:48.541 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:48.541 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:48.541 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:01:48.541 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:48.509049+0000", 2024-04-19T03:01:48.541 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1058e-05 2024-04-19T03:01:48.541 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:48.542 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:48.542 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:01:48.542 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:48.509055+0000", 2024-04-19T03:01:48.542 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0870000000000003e-06 2024-04-19T03:01:48.542 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:48.542 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:48.542 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:48.542 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:48.509104+0000", 2024-04-19T03:01:48.542 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8250000000000001e-05 2024-04-19T03:01:48.542 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:48.542 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:48.542 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:01:48.542 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:48.509213+0000", 2024-04-19T03:01:48.543 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010895699999999999 2024-04-19T03:01:48.543 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:48.543 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:48.543 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:01:48.543 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:48.509308+0000", 2024-04-19T03:01:48.543 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.5624999999999993e-05 2024-04-19T03:01:48.543 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:48.543 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:48.543 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:01:48.543 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:48.512044+0000", 2024-04-19T03:01:48.543 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0027354039999999999 2024-04-19T03:01:48.543 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:48.543 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:01:48.543 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:48.544 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:48.544 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:48.544 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:26678 5.4 5:270eba95:::benchmark_data_smithi096_19531_object26677:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-04-19T03:01:48.544 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:48.510236+0000", 2024-04-19T03:01:48.544 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0022634510000000001, 2024-04-19T03:01:48.544 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0027166579999999998, 2024-04-19T03:01:48.544 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:01:48.544 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:01:48.544 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:01:48.545 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:01:48.545 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:48.545 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 26678 2024-04-19T03:01:48.545 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:48.545 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:01:48.545 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:48.545 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:01:48.545 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:48.510236+0000", 2024-04-19T03:01:48.545 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:48.545 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:48.545 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:48.545 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:01:48.545 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:48.510236+0000", 2024-04-19T03:01:48.546 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:48.546 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:48.546 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:48.546 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:01:48.546 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:48.510234+0000", 2024-04-19T03:01:48.546 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:01:48.546 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:48.546 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:48.546 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:01:48.546 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:48.510289+0000", 2024-04-19T03:01:48.546 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4239e-05 2024-04-19T03:01:48.546 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:48.546 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:48.547 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:01:48.547 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:48.510302+0000", 2024-04-19T03:01:48.547 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3565e-05 2024-04-19T03:01:48.547 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:48.547 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:48.547 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:01:48.547 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:48.510309+0000", 2024-04-19T03:01:48.547 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2289999999999997e-06 2024-04-19T03:01:48.547 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:48.547 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:48.547 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:48.547 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:48.510491+0000", 2024-04-19T03:01:48.547 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00018183199999999999 2024-04-19T03:01:48.548 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:48.548 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:48.548 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:01:48.548 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:48.510617+0000", 2024-04-19T03:01:48.548 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012622299999999999 2024-04-19T03:01:48.548 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:48.548 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:48.548 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:01:48.548 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:48.510754+0000", 2024-04-19T03:01:48.549 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000136537 2024-04-19T03:01:48.549 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:48.549 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:48.549 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:01:48.549 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:48.512559+0000", 2024-04-19T03:01:48.549 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001804911 2024-04-19T03:01:48.549 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:48.549 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:01:48.550 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:48.550 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:48.550 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:48.550 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:26682 5.d 5:bd3bf13f:::benchmark_data_smithi096_19531_object26681:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-04-19T03:01:48.550 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:48.511157+0000", 2024-04-19T03:01:48.550 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.001342425, 2024-04-19T03:01:48.550 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00187356, 2024-04-19T03:01:48.550 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:01:48.550 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:01:48.550 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:01:48.550 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:01:48.550 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:48.550 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 26682 2024-04-19T03:01:48.551 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:48.551 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:01:48.551 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:48.551 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:01:48.551 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:48.511157+0000", 2024-04-19T03:01:48.551 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:48.551 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:48.551 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:48.551 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:01:48.551 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:48.511157+0000", 2024-04-19T03:01:48.551 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:48.552 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:48.552 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:48.552 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:01:48.552 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:48.511156+0000", 2024-04-19T03:01:48.552 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:01:48.552 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:48.552 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:48.552 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:01:48.552 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:48.511254+0000", 2024-04-19T03:01:48.552 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.8318000000000003e-05 2024-04-19T03:01:48.552 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:48.552 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:48.552 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:01:48.553 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:48.511265+0000", 2024-04-19T03:01:48.553 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1070000000000001e-05 2024-04-19T03:01:48.553 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:48.553 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:48.553 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:01:48.553 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:48.511274+0000", 2024-04-19T03:01:48.553 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3580000000000003e-06 2024-04-19T03:01:48.553 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:48.553 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:48.553 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:48.553 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:48.511309+0000", 2024-04-19T03:01:48.553 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5167999999999999e-05 2024-04-19T03:01:48.553 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:48.554 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:48.554 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:01:48.554 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:48.511430+0000", 2024-04-19T03:01:48.554 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012173299999999999 2024-04-19T03:01:48.554 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:48.554 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:48.555 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-04-19T03:01:48.555 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:48.511561+0000", 2024-04-19T03:01:48.555 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013065200000000001 2024-04-19T03:01:48.555 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:48.555 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:01:48.555 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:48.555 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:48.555 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-04-19T03:01:48.555 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 8 2024-04-19T03:01:48.555 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-19T03:01:48.556 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T03:01:48.584 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:01:48.584+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:01:48.618 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-19T03:01:48.684 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-19T03:01:48.685 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-04-19T03:01:48.685 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-04-19T03:01:48.685 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-04-19T03:01:48.685 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-19T03:01:48.685 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:01:48.681+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:01:48.697 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T03:01:48.779 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0: {} 2024-04-19T03:01:48.786 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:01:48.784+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:01:48.800 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1: {} 2024-04-19T03:01:48.818 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-19T03:01:48.818 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:01:48.820 INFO:tasks.radosbench.radosbench.0.smithi096.stdout: 11 16 27335 27319 155.205 137.375 0.00286999 0.00643472 2024-04-19T03:01:48.822 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2: {} 2024-04-19T03:01:48.825 INFO:teuthology.orchestra.run.smithi096.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T03:01:48.825 INFO:teuthology.orchestra.run.smithi096.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-19T03:01:48.825 INFO:teuthology.orchestra.run.smithi096.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-19T03:01:48.832 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T03:01:48.887 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:01:48.885+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:01:48.965 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-04-19T03:01:48.965 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:01:48.977 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T03:01:48.988 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-04-19T03:01:48.985+0000 7f35986ab700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18243) UID: 0 2024-04-19T03:01:49.089 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-04-19T03:01:49.085+0000 7f35986ab700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18243) UID: 0 2024-04-19T03:01:49.104 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-04-19T03:01:49.105 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:01:49.117 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T03:01:49.189 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:01:49.188+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:01:49.244 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-04-19T03:01:49.245 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:01:49.257 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T03:01:49.290 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:01:49.288+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:01:49.391 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-04-19T03:01:49.391 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:01:49.391 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-04-19T03:01:49.385+0000 7f35986ab700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18243) UID: 0 2024-04-19T03:01:49.405 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T03:01:49.493 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:01:49.492+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:01:49.532 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-04-19T03:01:49.533 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:01:49.545 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T03:01:49.593 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-04-19T03:01:49.589+0000 7f35986ab700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18243) UID: 0 2024-04-19T03:01:49.676 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-04-19T03:01:49.676 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:01:49.689 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T03:01:49.694 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:01:49.689+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:01:49.795 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-04-19T03:01:49.789+0000 7f35986ab700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18243) UID: 0 2024-04-19T03:01:49.811 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-19T03:01:49.811 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:01:49.820 INFO:tasks.radosbench.radosbench.0.smithi096.stdout: 12 16 29556 29540 153.838 138.812 0.00623724 0.00649231 2024-04-19T03:01:49.825 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T03:01:49.897 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:01:49.896+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:01:49.950 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-19T03:01:49.950 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:01:49.963 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T03:01:49.997 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:01:49.993+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:01:50.057 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-19T03:01:50.087 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-19T03:01:50.087 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:01:50.098 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:01:50.096+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:01:50.101 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T03:01:50.199 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:01:50.196+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:01:50.222 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-04-19T03:01:50.222 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:01:50.236 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T03:01:50.301 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:01:50.297+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:01:50.360 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-04-19T03:01:50.360 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:01:50.372 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T03:01:50.402 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:01:50.397+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:01:50.495 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-04-19T03:01:50.496 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:01:50.503 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:01:50.500+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:01:50.508 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T03:01:50.604 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:01:50.601+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:01:50.634 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-04-19T03:01:50.634 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:01:50.647 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T03:01:50.704 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:01:50.704+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:01:50.775 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-04-19T03:01:50.775 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:01:50.787 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T03:01:50.806 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:01:50.805+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:01:50.820 INFO:tasks.radosbench.radosbench.0.smithi096.stdout: 13 16 31706 31690 152.34 134.375 0.00648473 0.0065573 2024-04-19T03:01:50.838 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-19T03:01:50.907 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:01:50.904+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:01:50.917 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-04-19T03:01:50.918 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:01:50.927 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-04-19T03:01:50.927 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-19T03:01:50.927 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap_items 2024-04-19T03:01:50.927 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-04-19T03:01:50.930 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T03:01:50.986 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0: {} 2024-04-19T03:01:51.007 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1: {} 2024-04-19T03:01:51.008 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-04-19T03:01:51.005+0000 7f35986ab700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18243) UID: 0 2024-04-19T03:01:51.029 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2: {} 2024-04-19T03:01:51.031 INFO:teuthology.orchestra.run.smithi096.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T03:01:51.031 INFO:teuthology.orchestra.run.smithi096.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-19T03:01:51.031 INFO:teuthology.orchestra.run.smithi096.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-19T03:01:51.051 INFO:teuthology.orchestra.run.smithi096.stderr:nodeep-scrub is set 2024-04-19T03:01:51.063 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-19T03:01:51.063 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-04-19T03:01:51.064 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.064 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:32231 5.4 5:2e5aa4cf:::benchmark_data_smithi096_19531_object32230:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-04-19T03:01:51.064 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:51.056924+0000", 2024-04-19T03:01:51.064 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0053122669999999999, 2024-04-19T03:01:51.064 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0053455589999999997, 2024-04-19T03:01:51.064 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:01:51.064 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:01:51.064 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:01:51.064 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:01:51.064 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:51.064 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 32231 2024-04-19T03:01:51.064 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.065 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:01:51.065 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.065 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:01:51.065 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:51.056924+0000", 2024-04-19T03:01:51.065 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:51.065 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.065 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.065 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:01:51.065 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:51.056924+0000", 2024-04-19T03:01:51.065 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:51.065 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.065 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.065 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:01:51.065 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:51.056923+0000", 2024-04-19T03:01:51.066 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:01:51.066 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.066 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.066 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:01:51.066 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:51.056983+0000", 2024-04-19T03:01:51.066 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0365000000000002e-05 2024-04-19T03:01:51.066 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.066 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.066 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:01:51.066 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:51.056997+0000", 2024-04-19T03:01:51.066 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4314000000000001e-05 2024-04-19T03:01:51.066 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.066 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.066 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:01:51.067 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:51.057008+0000", 2024-04-19T03:01:51.067 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0482000000000001e-05 2024-04-19T03:01:51.067 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.067 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.067 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:51.067 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:51.057062+0000", 2024-04-19T03:01:51.067 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4224999999999997e-05 2024-04-19T03:01:51.067 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.067 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.067 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:01:51.067 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:51.057238+0000", 2024-04-19T03:01:51.067 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00017613000000000001 2024-04-19T03:01:51.067 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.067 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.068 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:01:51.068 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:51.057409+0000", 2024-04-19T03:01:51.068 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00017048500000000001 2024-04-19T03:01:51.068 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:51.068 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:01:51.068 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:51.068 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.068 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.068 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:32233 5.b 5:d804a67d:::benchmark_data_smithi096_19531_object32232:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-19T03:01:51.068 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:51.058271+0000", 2024-04-19T03:01:51.068 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0039649170000000001, 2024-04-19T03:01:51.068 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0041708919999999998, 2024-04-19T03:01:51.068 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:01:51.068 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:01:51.068 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:01:51.069 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:01:51.069 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:51.069 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 32233 2024-04-19T03:01:51.069 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.069 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:01:51.069 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.069 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:01:51.069 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:51.058271+0000", 2024-04-19T03:01:51.069 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:51.069 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.069 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.069 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:01:51.069 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:51.058271+0000", 2024-04-19T03:01:51.069 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:51.070 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.070 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.070 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:01:51.070 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:51.058270+0000", 2024-04-19T03:01:51.070 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:01:51.070 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.070 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.070 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:01:51.070 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:51.058332+0000", 2024-04-19T03:01:51.070 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1803000000000004e-05 2024-04-19T03:01:51.070 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.070 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.070 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:01:51.070 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:51.058345+0000", 2024-04-19T03:01:51.071 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3555e-05 2024-04-19T03:01:51.071 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.071 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.071 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:01:51.071 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:51.058353+0000", 2024-04-19T03:01:51.071 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.8439999999999998e-06 2024-04-19T03:01:51.071 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.071 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.071 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:51.071 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:51.058422+0000", 2024-04-19T03:01:51.071 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.8702999999999996e-05 2024-04-19T03:01:51.071 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.071 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.071 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op must wait for map", 2024-04-19T03:01:51.071 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:51.058435+0000", 2024-04-19T03:01:51.072 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3617e-05 2024-04-19T03:01:51.072 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.072 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.072 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:51.072 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:51.060724+0000", 2024-04-19T03:01:51.072 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0022881830000000001 2024-04-19T03:01:51.072 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.072 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.072 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:01:51.072 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:51.060899+0000", 2024-04-19T03:01:51.072 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000175618 2024-04-19T03:01:51.072 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.072 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.072 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:01:51.073 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:51.061049+0000", 2024-04-19T03:01:51.073 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015008299999999999 2024-04-19T03:01:51.073 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:51.073 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:01:51.073 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:51.073 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.073 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.073 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:32234 5.8 5:1481ce6b:::benchmark_data_smithi096_19531_object32233:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-19T03:01:51.073 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:51.058378+0000", 2024-04-19T03:01:51.073 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0038578089999999998, 2024-04-19T03:01:51.073 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0042013220000000004, 2024-04-19T03:01:51.073 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:01:51.073 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:01:51.073 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:01:51.073 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:01:51.074 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:51.074 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 32234 2024-04-19T03:01:51.074 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.074 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:01:51.074 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.074 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:01:51.074 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:51.058378+0000", 2024-04-19T03:01:51.074 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:51.074 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.074 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.074 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:01:51.074 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:51.058378+0000", 2024-04-19T03:01:51.074 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:51.074 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.075 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.075 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:01:51.075 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:51.058378+0000", 2024-04-19T03:01:51.075 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:01:51.075 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.075 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.075 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:01:51.075 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:51.058422+0000", 2024-04-19T03:01:51.075 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4245000000000001e-05 2024-04-19T03:01:51.075 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.075 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.075 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:01:51.075 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:51.058445+0000", 2024-04-19T03:01:51.075 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3538000000000001e-05 2024-04-19T03:01:51.076 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.076 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.076 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:01:51.076 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:51.058453+0000", 2024-04-19T03:01:51.076 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5240000000000003e-06 2024-04-19T03:01:51.076 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.076 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.076 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:51.076 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:51.058506+0000", 2024-04-19T03:01:51.076 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3257999999999997e-05 2024-04-19T03:01:51.076 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.076 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.076 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op must wait for map", 2024-04-19T03:01:51.076 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:51.058511+0000", 2024-04-19T03:01:51.076 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7910000000000004e-06 2024-04-19T03:01:51.077 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.077 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.077 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:51.077 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:51.060441+0000", 2024-04-19T03:01:51.077 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001929643 2024-04-19T03:01:51.077 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.077 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.077 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:01:51.077 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:51.060552+0000", 2024-04-19T03:01:51.077 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000111097 2024-04-19T03:01:51.077 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.077 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.077 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:01:51.077 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:51.060696+0000", 2024-04-19T03:01:51.078 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000144344 2024-04-19T03:01:51.078 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:51.078 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:01:51.078 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:51.078 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.078 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.078 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:32235 5.4 5:29c14405:::benchmark_data_smithi096_19531_object32234:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-19T03:01:51.078 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:51.058465+0000", 2024-04-19T03:01:51.078 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.003771, 2024-04-19T03:01:51.078 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00422435, 2024-04-19T03:01:51.078 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:01:51.078 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:01:51.078 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:01:51.078 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:01:51.079 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:51.079 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 32235 2024-04-19T03:01:51.079 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.079 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:01:51.079 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.079 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:01:51.079 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:51.058465+0000", 2024-04-19T03:01:51.079 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:51.079 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.079 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.079 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:01:51.079 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:51.058465+0000", 2024-04-19T03:01:51.079 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:51.079 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.080 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.080 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:01:51.080 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:51.058465+0000", 2024-04-19T03:01:51.080 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:01:51.080 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.080 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.080 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:01:51.080 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:51.058496+0000", 2024-04-19T03:01:51.080 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1118000000000003e-05 2024-04-19T03:01:51.080 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.080 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.080 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:01:51.080 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:51.058503+0000", 2024-04-19T03:01:51.080 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.6320000000000008e-06 2024-04-19T03:01:51.081 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.081 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.081 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:01:51.081 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:51.058509+0000", 2024-04-19T03:01:51.081 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.665e-06 2024-04-19T03:01:51.081 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.081 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.081 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:51.081 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:51.059135+0000", 2024-04-19T03:01:51.081 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00062573800000000003 2024-04-19T03:01:51.081 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.081 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.081 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op must wait for map", 2024-04-19T03:01:51.081 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:51.059140+0000", 2024-04-19T03:01:51.081 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1089999999999997e-06 2024-04-19T03:01:51.082 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.082 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.082 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:51.082 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:51.060417+0000", 2024-04-19T03:01:51.082 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0012773299999999999 2024-04-19T03:01:51.082 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.082 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.082 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:01:51.082 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:51.060552+0000", 2024-04-19T03:01:51.082 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000134979 2024-04-19T03:01:51.082 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.082 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.082 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:01:51.082 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:51.060715+0000", 2024-04-19T03:01:51.083 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016336599999999999 2024-04-19T03:01:51.083 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:51.083 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:01:51.083 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:51.083 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.083 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.083 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4755.0:32230 5.9 e29/22 5:920026d7:::benchmark_data_smithi096_19531_object32229:head v 29'1981, mlcod=28'1977)", 2024-04-19T03:01:51.083 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:51.059752+0000", 2024-04-19T03:01:51.083 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0024839049999999998, 2024-04-19T03:01:51.083 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0030413469999999998, 2024-04-19T03:01:51.083 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:01:51.083 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-19T03:01:51.083 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:01:51.083 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.084 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:01:51.084 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:51.059752+0000", 2024-04-19T03:01:51.084 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:51.084 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.084 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.084 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:01:51.084 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:51.059752+0000", 2024-04-19T03:01:51.084 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:51.084 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.084 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.084 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:01:51.084 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:51.059751+0000", 2024-04-19T03:01:51.084 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:01:51.084 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.084 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.085 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:01:51.085 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:51.059889+0000", 2024-04-19T03:01:51.085 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013715999999999999 2024-04-19T03:01:51.085 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.085 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.085 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:01:51.085 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:51.059899+0000", 2024-04-19T03:01:51.085 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0156999999999999e-05 2024-04-19T03:01:51.085 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.085 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.085 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:01:51.085 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:51.059907+0000", 2024-04-19T03:01:51.085 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.2009999999999999e-06 2024-04-19T03:01:51.085 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.085 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.086 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:51.086 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:51.060159+0000", 2024-04-19T03:01:51.086 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00025175300000000001 2024-04-19T03:01:51.086 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.086 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.086 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:01:51.086 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:51.060182+0000", 2024-04-19T03:01:51.086 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3268000000000002e-05 2024-04-19T03:01:51.086 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:51.086 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:01:51.086 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:51.086 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.086 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.086 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:32243 5.0 5:0f31bf3b:::benchmark_data_smithi096_19531_object32242:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-19T03:01:51.087 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:51.062446+0000", 2024-04-19T03:01:51.087 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 4294967295.9997897, 2024-04-19T03:01:51.087 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00042915800000000001, 2024-04-19T03:01:51.087 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:01:51.087 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:01:51.087 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:01:51.087 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:01:51.087 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:51.087 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 32243 2024-04-19T03:01:51.087 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.087 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:01:51.087 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.087 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:01:51.087 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:51.062446+0000", 2024-04-19T03:01:51.088 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:51.088 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.088 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.088 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:01:51.088 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:51.062446+0000", 2024-04-19T03:01:51.088 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:51.088 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.088 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.088 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:01:51.088 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:51.062445+0000", 2024-04-19T03:01:51.088 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:01:51.088 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.088 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.088 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:01:51.088 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:51.062478+0000", 2024-04-19T03:01:51.089 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3299000000000001e-05 2024-04-19T03:01:51.089 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.089 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.089 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:01:51.089 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:51.062487+0000", 2024-04-19T03:01:51.089 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.5010000000000004e-06 2024-04-19T03:01:51.089 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.089 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.089 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:01:51.089 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:51.062493+0000", 2024-04-19T03:01:51.089 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2110000000000003e-06 2024-04-19T03:01:51.089 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.089 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.089 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:51.089 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:51.062686+0000", 2024-04-19T03:01:51.090 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00019284799999999999 2024-04-19T03:01:51.090 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.090 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.090 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:01:51.090 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:51.062766+0000", 2024-04-19T03:01:51.090 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.9833999999999995e-05 2024-04-19T03:01:51.090 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.090 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.090 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:01:51.090 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:51.062838+0000", 2024-04-19T03:01:51.090 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2318999999999997e-05 2024-04-19T03:01:51.090 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:51.090 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:01:51.090 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:51.091 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.091 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.091 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4755.0:32237 5.9 e29/22 5:9e950403:::benchmark_data_smithi096_19531_object32236:head v 29'1982, mlcod=28'1978)", 2024-04-19T03:01:51.091 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:51.062407+0000", 2024-04-19T03:01:51.091 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 4294967295.9998293, 2024-04-19T03:01:51.091 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00057805699999999998, 2024-04-19T03:01:51.091 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:01:51.091 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-19T03:01:51.091 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:01:51.091 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.091 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:01:51.092 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:51.062407+0000", 2024-04-19T03:01:51.092 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:51.092 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.092 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.092 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:01:51.092 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:51.062407+0000", 2024-04-19T03:01:51.093 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:51.093 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.093 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.093 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:01:51.093 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:51.062406+0000", 2024-04-19T03:01:51.093 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:01:51.093 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.093 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.093 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:01:51.093 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:51.062610+0000", 2024-04-19T03:01:51.093 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000203222 2024-04-19T03:01:51.093 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.093 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.094 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:01:51.094 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:51.062618+0000", 2024-04-19T03:01:51.094 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.2220000000000002e-06 2024-04-19T03:01:51.094 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.094 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.094 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:01:51.094 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:51.062624+0000", 2024-04-19T03:01:51.094 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9750000000000004e-06 2024-04-19T03:01:51.094 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.094 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.094 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:51.094 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:51.062664+0000", 2024-04-19T03:01:51.094 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.0467999999999999e-05 2024-04-19T03:01:51.095 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.095 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.095 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:01:51.095 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:51.062684+0000", 2024-04-19T03:01:51.095 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9989000000000001e-05 2024-04-19T03:01:51.095 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:51.095 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:01:51.095 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:51.095 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:51.095 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-04-19T03:01:51.095 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 7 2024-04-19T03:01:51.095 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-19T03:01:51.097 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T03:01:51.108 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:01:51.105+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:01:51.209 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:01:51.205+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:01:51.229 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-19T03:01:51.229 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-04-19T03:01:51.229 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-04-19T03:01:51.229 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-04-19T03:01:51.229 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-19T03:01:51.232 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-19T03:01:51.232 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-04-19T03:01:51.232 INFO:teuthology.orchestra.run.smithi096.stdout: "epoch": 29, 2024-04-19T03:01:51.232 INFO:teuthology.orchestra.run.smithi096.stdout: "fsid": "c6cc8e09-11d4-48de-9a6c-4d70ed3c3789", 2024-04-19T03:01:51.232 INFO:teuthology.orchestra.run.smithi096.stdout: "created": "2024-04-19T03:00:53.746146+0000", 2024-04-19T03:01:51.232 INFO:teuthology.orchestra.run.smithi096.stdout: "modified": "2024-04-19T03:01:51.030789+0000", 2024-04-19T03:01:51.232 INFO:teuthology.orchestra.run.smithi096.stdout: "last_up_change": "2024-04-19T03:01:04.501086+0000", 2024-04-19T03:01:51.232 INFO:teuthology.orchestra.run.smithi096.stdout: "last_in_change": "2024-04-19T03:00:54.640172+0000", 2024-04-19T03:01:51.232 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": "noscrub,nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-04-19T03:01:51.232 INFO:teuthology.orchestra.run.smithi096.stdout: "flags_num": 5806080, 2024-04-19T03:01:51.232 INFO:teuthology.orchestra.run.smithi096.stdout: "flags_set": [ 2024-04-19T03:01:51.232 INFO:teuthology.orchestra.run.smithi096.stdout: "nodeep-scrub", 2024-04-19T03:01:51.232 INFO:teuthology.orchestra.run.smithi096.stdout: "noscrub", 2024-04-19T03:01:51.232 INFO:teuthology.orchestra.run.smithi096.stdout: "pglog_hardlimit", 2024-04-19T03:01:51.233 INFO:teuthology.orchestra.run.smithi096.stdout: "purged_snapdirs", 2024-04-19T03:01:51.233 INFO:teuthology.orchestra.run.smithi096.stdout: "recovery_deletes", 2024-04-19T03:01:51.233 INFO:teuthology.orchestra.run.smithi096.stdout: "sortbitwise" 2024-04-19T03:01:51.233 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-19T03:01:51.233 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_version": 5, 2024-04-19T03:01:51.233 INFO:teuthology.orchestra.run.smithi096.stdout: "full_ratio": 0.94999998807907104, 2024-04-19T03:01:51.233 INFO:teuthology.orchestra.run.smithi096.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-04-19T03:01:51.233 INFO:teuthology.orchestra.run.smithi096.stdout: "nearfull_ratio": 0.85000002384185791, 2024-04-19T03:01:51.233 INFO:teuthology.orchestra.run.smithi096.stdout: "cluster_snapshot": "", 2024-04-19T03:01:51.233 INFO:teuthology.orchestra.run.smithi096.stdout: "pool_max": 5, 2024-04-19T03:01:51.233 INFO:teuthology.orchestra.run.smithi096.stdout: "max_osd": 3, 2024-04-19T03:01:51.233 INFO:teuthology.orchestra.run.smithi096.stdout: "require_min_compat_client": "luminous", 2024-04-19T03:01:51.233 INFO:teuthology.orchestra.run.smithi096.stdout: "min_compat_client": "jewel", 2024-04-19T03:01:51.233 INFO:teuthology.orchestra.run.smithi096.stdout: "require_osd_release": "reef", 2024-04-19T03:01:51.233 INFO:teuthology.orchestra.run.smithi096.stdout: "allow_crimson": false, 2024-04-19T03:01:51.234 INFO:teuthology.orchestra.run.smithi096.stdout: "pools": [ 2024-04-19T03:01:51.234 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-19T03:01:51.234 INFO:teuthology.orchestra.run.smithi096.stdout: "pool": 1, 2024-04-19T03:01:51.234 INFO:teuthology.orchestra.run.smithi096.stdout: "pool_name": ".mgr", 2024-04-19T03:01:51.234 INFO:teuthology.orchestra.run.smithi096.stdout: "create_time": "2024-04-19T03:01:05.999591+0000", 2024-04-19T03:01:51.234 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-19T03:01:51.234 INFO:teuthology.orchestra.run.smithi096.stdout: "flags_names": "hashpspool", 2024-04-19T03:01:51.234 INFO:teuthology.orchestra.run.smithi096.stdout: "type": 1, 2024-04-19T03:01:51.234 INFO:teuthology.orchestra.run.smithi096.stdout: "size": 2, 2024-04-19T03:01:51.234 INFO:teuthology.orchestra.run.smithi096.stdout: "min_size": 1, 2024-04-19T03:01:51.234 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_rule": 0, 2024-04-19T03:01:51.234 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_count": 0, 2024-04-19T03:01:51.234 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_target": 0, 2024-04-19T03:01:51.235 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_barrier": 0, 2024-04-19T03:01:51.235 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-19T03:01:51.235 INFO:teuthology.orchestra.run.smithi096.stdout: "object_hash": 2, 2024-04-19T03:01:51.235 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_autoscale_mode": "off", 2024-04-19T03:01:51.235 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num": 1, 2024-04-19T03:01:51.235 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_placement_num": 1, 2024-04-19T03:01:51.235 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_placement_num_target": 1, 2024-04-19T03:01:51.235 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num_target": 1, 2024-04-19T03:01:51.235 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num_pending": 1, 2024-04-19T03:01:51.235 INFO:teuthology.orchestra.run.smithi096.stdout: "last_pg_merge_meta": { 2024-04-19T03:01:51.235 INFO:teuthology.orchestra.run.smithi096.stdout: "source_pgid": "0.0", 2024-04-19T03:01:51.235 INFO:teuthology.orchestra.run.smithi096.stdout: "ready_epoch": 0, 2024-04-19T03:01:51.235 INFO:teuthology.orchestra.run.smithi096.stdout: "last_epoch_started": 0, 2024-04-19T03:01:51.236 INFO:teuthology.orchestra.run.smithi096.stdout: "last_epoch_clean": 0, 2024-04-19T03:01:51.236 INFO:teuthology.orchestra.run.smithi096.stdout: "source_version": "0'0", 2024-04-19T03:01:51.236 INFO:teuthology.orchestra.run.smithi096.stdout: "target_version": "0'0" 2024-04-19T03:01:51.236 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-19T03:01:51.236 INFO:teuthology.orchestra.run.smithi096.stdout: "last_change": "14", 2024-04-19T03:01:51.236 INFO:teuthology.orchestra.run.smithi096.stdout: "last_force_op_resend": "0", 2024-04-19T03:01:51.236 INFO:teuthology.orchestra.run.smithi096.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-19T03:01:51.236 INFO:teuthology.orchestra.run.smithi096.stdout: "last_force_op_resend_preluminous": "0", 2024-04-19T03:01:51.236 INFO:teuthology.orchestra.run.smithi096.stdout: "auid": 0, 2024-04-19T03:01:51.236 INFO:teuthology.orchestra.run.smithi096.stdout: "snap_mode": "selfmanaged", 2024-04-19T03:01:51.236 INFO:teuthology.orchestra.run.smithi096.stdout: "snap_seq": 0, 2024-04-19T03:01:51.236 INFO:teuthology.orchestra.run.smithi096.stdout: "snap_epoch": 0, 2024-04-19T03:01:51.236 INFO:teuthology.orchestra.run.smithi096.stdout: "pool_snaps": [], 2024-04-19T03:01:51.236 INFO:teuthology.orchestra.run.smithi096.stdout: "removed_snaps": "[]", 2024-04-19T03:01:51.237 INFO:teuthology.orchestra.run.smithi096.stdout: "quota_max_bytes": 0, 2024-04-19T03:01:51.237 INFO:teuthology.orchestra.run.smithi096.stdout: "quota_max_objects": 0, 2024-04-19T03:01:51.237 INFO:teuthology.orchestra.run.smithi096.stdout: "tiers": [], 2024-04-19T03:01:51.237 INFO:teuthology.orchestra.run.smithi096.stdout: "tier_of": -1, 2024-04-19T03:01:51.237 INFO:teuthology.orchestra.run.smithi096.stdout: "read_tier": -1, 2024-04-19T03:01:51.237 INFO:teuthology.orchestra.run.smithi096.stdout: "write_tier": -1, 2024-04-19T03:01:51.237 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_mode": "none", 2024-04-19T03:01:51.237 INFO:teuthology.orchestra.run.smithi096.stdout: "target_max_bytes": 0, 2024-04-19T03:01:51.237 INFO:teuthology.orchestra.run.smithi096.stdout: "target_max_objects": 0, 2024-04-19T03:01:51.237 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-19T03:01:51.237 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-19T03:01:51.237 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-19T03:01:51.237 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_min_flush_age": 0, 2024-04-19T03:01:51.237 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_min_evict_age": 0, 2024-04-19T03:01:51.238 INFO:teuthology.orchestra.run.smithi096.stdout: "erasure_code_profile": "", 2024-04-19T03:01:51.238 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_params": { 2024-04-19T03:01:51.238 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "none" 2024-04-19T03:01:51.238 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-19T03:01:51.238 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_period": 0, 2024-04-19T03:01:51.238 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_count": 0, 2024-04-19T03:01:51.238 INFO:teuthology.orchestra.run.smithi096.stdout: "use_gmt_hitset": true, 2024-04-19T03:01:51.238 INFO:teuthology.orchestra.run.smithi096.stdout: "min_read_recency_for_promote": 0, 2024-04-19T03:01:51.238 INFO:teuthology.orchestra.run.smithi096.stdout: "min_write_recency_for_promote": 0, 2024-04-19T03:01:51.238 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_grade_decay_rate": 0, 2024-04-19T03:01:51.238 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_search_last_n": 0, 2024-04-19T03:01:51.238 INFO:teuthology.orchestra.run.smithi096.stdout: "grade_table": [], 2024-04-19T03:01:51.238 INFO:teuthology.orchestra.run.smithi096.stdout: "stripe_width": 0, 2024-04-19T03:01:51.238 INFO:teuthology.orchestra.run.smithi096.stdout: "expected_num_objects": 0, 2024-04-19T03:01:51.239 INFO:teuthology.orchestra.run.smithi096.stdout: "fast_read": false, 2024-04-19T03:01:51.239 INFO:teuthology.orchestra.run.smithi096.stdout: "options": { 2024-04-19T03:01:51.239 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num_max": 32, 2024-04-19T03:01:51.239 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num_min": 1 2024-04-19T03:01:51.239 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-19T03:01:51.239 INFO:teuthology.orchestra.run.smithi096.stdout: "application_metadata": { 2024-04-19T03:01:51.239 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": {} 2024-04-19T03:01:51.239 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-19T03:01:51.239 INFO:teuthology.orchestra.run.smithi096.stdout: "read_balance": { 2024-04-19T03:01:51.239 INFO:teuthology.orchestra.run.smithi096.stdout: "score_acting": 2.9900000095367432, 2024-04-19T03:01:51.239 INFO:teuthology.orchestra.run.smithi096.stdout: "score_stable": 2.9900000095367432, 2024-04-19T03:01:51.239 INFO:teuthology.orchestra.run.smithi096.stdout: "optimal_score": 0.67000001668930054, 2024-04-19T03:01:51.239 INFO:teuthology.orchestra.run.smithi096.stdout: "raw_score_acting": 2, 2024-04-19T03:01:51.240 INFO:teuthology.orchestra.run.smithi096.stdout: "raw_score_stable": 2, 2024-04-19T03:01:51.240 INFO:teuthology.orchestra.run.smithi096.stdout: "primary_affinity_weighted": 1, 2024-04-19T03:01:51.240 INFO:teuthology.orchestra.run.smithi096.stdout: "average_primary_affinity": 1, 2024-04-19T03:01:51.240 INFO:teuthology.orchestra.run.smithi096.stdout: "average_primary_affinity_weighted": 1 2024-04-19T03:01:51.240 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-19T03:01:51.240 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-19T03:01:51.240 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-19T03:01:51.240 INFO:teuthology.orchestra.run.smithi096.stdout: "pool": 2, 2024-04-19T03:01:51.240 INFO:teuthology.orchestra.run.smithi096.stdout: "pool_name": "rbd", 2024-04-19T03:01:51.240 INFO:teuthology.orchestra.run.smithi096.stdout: "create_time": "2024-04-19T03:01:09.051757+0000", 2024-04-19T03:01:51.240 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-19T03:01:51.240 INFO:teuthology.orchestra.run.smithi096.stdout: "flags_names": "hashpspool", 2024-04-19T03:01:51.240 INFO:teuthology.orchestra.run.smithi096.stdout: "type": 1, 2024-04-19T03:01:51.240 INFO:teuthology.orchestra.run.smithi096.stdout: "size": 2, 2024-04-19T03:01:51.241 INFO:teuthology.orchestra.run.smithi096.stdout: "min_size": 1, 2024-04-19T03:01:51.241 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_rule": 0, 2024-04-19T03:01:51.241 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_count": 0, 2024-04-19T03:01:51.241 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_target": 0, 2024-04-19T03:01:51.241 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_barrier": 0, 2024-04-19T03:01:51.241 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-19T03:01:51.241 INFO:teuthology.orchestra.run.smithi096.stdout: "object_hash": 2, 2024-04-19T03:01:51.241 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_autoscale_mode": "off", 2024-04-19T03:01:51.241 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num": 8, 2024-04-19T03:01:51.241 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_placement_num": 8, 2024-04-19T03:01:51.241 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_placement_num_target": 8, 2024-04-19T03:01:51.241 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num_target": 8, 2024-04-19T03:01:51.241 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num_pending": 8, 2024-04-19T03:01:51.242 INFO:teuthology.orchestra.run.smithi096.stdout: "last_pg_merge_meta": { 2024-04-19T03:01:51.242 INFO:teuthology.orchestra.run.smithi096.stdout: "source_pgid": "0.0", 2024-04-19T03:01:51.242 INFO:teuthology.orchestra.run.smithi096.stdout: "ready_epoch": 0, 2024-04-19T03:01:51.242 INFO:teuthology.orchestra.run.smithi096.stdout: "last_epoch_started": 0, 2024-04-19T03:01:51.242 INFO:teuthology.orchestra.run.smithi096.stdout: "last_epoch_clean": 0, 2024-04-19T03:01:51.242 INFO:teuthology.orchestra.run.smithi096.stdout: "source_version": "0'0", 2024-04-19T03:01:51.242 INFO:teuthology.orchestra.run.smithi096.stdout: "target_version": "0'0" 2024-04-19T03:01:51.242 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-19T03:01:51.242 INFO:teuthology.orchestra.run.smithi096.stdout: "last_change": "17", 2024-04-19T03:01:51.242 INFO:teuthology.orchestra.run.smithi096.stdout: "last_force_op_resend": "0", 2024-04-19T03:01:51.242 INFO:teuthology.orchestra.run.smithi096.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-19T03:01:51.243 INFO:teuthology.orchestra.run.smithi096.stdout: "last_force_op_resend_preluminous": "0", 2024-04-19T03:01:51.243 INFO:teuthology.orchestra.run.smithi096.stdout: "auid": 0, 2024-04-19T03:01:51.243 INFO:teuthology.orchestra.run.smithi096.stdout: "snap_mode": "selfmanaged", 2024-04-19T03:01:51.243 INFO:teuthology.orchestra.run.smithi096.stdout: "snap_seq": 0, 2024-04-19T03:01:51.243 INFO:teuthology.orchestra.run.smithi096.stdout: "snap_epoch": 0, 2024-04-19T03:01:51.243 INFO:teuthology.orchestra.run.smithi096.stdout: "pool_snaps": [], 2024-04-19T03:01:51.243 INFO:teuthology.orchestra.run.smithi096.stdout: "removed_snaps": "[]", 2024-04-19T03:01:51.243 INFO:teuthology.orchestra.run.smithi096.stdout: "quota_max_bytes": 0, 2024-04-19T03:01:51.243 INFO:teuthology.orchestra.run.smithi096.stdout: "quota_max_objects": 0, 2024-04-19T03:01:51.243 INFO:teuthology.orchestra.run.smithi096.stdout: "tiers": [], 2024-04-19T03:01:51.243 INFO:teuthology.orchestra.run.smithi096.stdout: "tier_of": -1, 2024-04-19T03:01:51.243 INFO:teuthology.orchestra.run.smithi096.stdout: "read_tier": -1, 2024-04-19T03:01:51.243 INFO:teuthology.orchestra.run.smithi096.stdout: "write_tier": -1, 2024-04-19T03:01:51.243 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_mode": "none", 2024-04-19T03:01:51.244 INFO:teuthology.orchestra.run.smithi096.stdout: "target_max_bytes": 0, 2024-04-19T03:01:51.244 INFO:teuthology.orchestra.run.smithi096.stdout: "target_max_objects": 0, 2024-04-19T03:01:51.244 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-19T03:01:51.244 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-19T03:01:51.244 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-19T03:01:51.244 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_min_flush_age": 0, 2024-04-19T03:01:51.244 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_min_evict_age": 0, 2024-04-19T03:01:51.244 INFO:teuthology.orchestra.run.smithi096.stdout: "erasure_code_profile": "", 2024-04-19T03:01:51.244 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_params": { 2024-04-19T03:01:51.244 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "none" 2024-04-19T03:01:51.244 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-19T03:01:51.244 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_period": 0, 2024-04-19T03:01:51.244 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_count": 0, 2024-04-19T03:01:51.245 INFO:teuthology.orchestra.run.smithi096.stdout: "use_gmt_hitset": true, 2024-04-19T03:01:51.245 INFO:teuthology.orchestra.run.smithi096.stdout: "min_read_recency_for_promote": 0, 2024-04-19T03:01:51.245 INFO:teuthology.orchestra.run.smithi096.stdout: "min_write_recency_for_promote": 0, 2024-04-19T03:01:51.245 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_grade_decay_rate": 0, 2024-04-19T03:01:51.245 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_search_last_n": 0, 2024-04-19T03:01:51.245 INFO:teuthology.orchestra.run.smithi096.stdout: "grade_table": [], 2024-04-19T03:01:51.245 INFO:teuthology.orchestra.run.smithi096.stdout: "stripe_width": 0, 2024-04-19T03:01:51.245 INFO:teuthology.orchestra.run.smithi096.stdout: "expected_num_objects": 0, 2024-04-19T03:01:51.245 INFO:teuthology.orchestra.run.smithi096.stdout: "fast_read": false, 2024-04-19T03:01:51.245 INFO:teuthology.orchestra.run.smithi096.stdout: "options": {}, 2024-04-19T03:01:51.245 INFO:teuthology.orchestra.run.smithi096.stdout: "application_metadata": { 2024-04-19T03:01:51.245 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd": {} 2024-04-19T03:01:51.245 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-19T03:01:51.245 INFO:teuthology.orchestra.run.smithi096.stdout: "read_balance": { 2024-04-19T03:01:51.245 INFO:teuthology.orchestra.run.smithi096.stdout: "score_acting": 1.5, 2024-04-19T03:01:51.246 INFO:teuthology.orchestra.run.smithi096.stdout: "score_stable": 1.5, 2024-04-19T03:01:51.246 INFO:teuthology.orchestra.run.smithi096.stdout: "optimal_score": 1, 2024-04-19T03:01:51.246 INFO:teuthology.orchestra.run.smithi096.stdout: "raw_score_acting": 1.5, 2024-04-19T03:01:51.246 INFO:teuthology.orchestra.run.smithi096.stdout: "raw_score_stable": 1.5, 2024-04-19T03:01:51.246 INFO:teuthology.orchestra.run.smithi096.stdout: "primary_affinity_weighted": 1, 2024-04-19T03:01:51.246 INFO:teuthology.orchestra.run.smithi096.stdout: "average_primary_affinity": 1, 2024-04-19T03:01:51.246 INFO:teuthology.orchestra.run.smithi096.stdout: "average_primary_affinity_weighted": 1 2024-04-19T03:01:51.246 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-19T03:01:51.246 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-19T03:01:51.246 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-19T03:01:51.246 INFO:teuthology.orchestra.run.smithi096.stdout: "pool": 3, 2024-04-19T03:01:51.246 INFO:teuthology.orchestra.run.smithi096.stdout: "pool_name": "cephfs_metadata", 2024-04-19T03:01:51.247 INFO:teuthology.orchestra.run.smithi096.stdout: "create_time": "2024-04-19T03:01:13.479163+0000", 2024-04-19T03:01:51.247 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-19T03:01:51.247 INFO:teuthology.orchestra.run.smithi096.stdout: "flags_names": "hashpspool", 2024-04-19T03:01:51.247 INFO:teuthology.orchestra.run.smithi096.stdout: "type": 1, 2024-04-19T03:01:51.247 INFO:teuthology.orchestra.run.smithi096.stdout: "size": 2, 2024-04-19T03:01:51.247 INFO:teuthology.orchestra.run.smithi096.stdout: "min_size": 1, 2024-04-19T03:01:51.247 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_rule": 0, 2024-04-19T03:01:51.247 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_count": 0, 2024-04-19T03:01:51.247 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_target": 0, 2024-04-19T03:01:51.247 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_barrier": 0, 2024-04-19T03:01:51.247 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-19T03:01:51.247 INFO:teuthology.orchestra.run.smithi096.stdout: "object_hash": 2, 2024-04-19T03:01:51.247 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_autoscale_mode": "off", 2024-04-19T03:01:51.248 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num": 32, 2024-04-19T03:01:51.248 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_placement_num": 32, 2024-04-19T03:01:51.248 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_placement_num_target": 32, 2024-04-19T03:01:51.248 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num_target": 32, 2024-04-19T03:01:51.248 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num_pending": 32, 2024-04-19T03:01:51.248 INFO:teuthology.orchestra.run.smithi096.stdout: "last_pg_merge_meta": { 2024-04-19T03:01:51.248 INFO:teuthology.orchestra.run.smithi096.stdout: "source_pgid": "0.0", 2024-04-19T03:01:51.248 INFO:teuthology.orchestra.run.smithi096.stdout: "ready_epoch": 0, 2024-04-19T03:01:51.248 INFO:teuthology.orchestra.run.smithi096.stdout: "last_epoch_started": 0, 2024-04-19T03:01:51.248 INFO:teuthology.orchestra.run.smithi096.stdout: "last_epoch_clean": 0, 2024-04-19T03:01:51.248 INFO:teuthology.orchestra.run.smithi096.stdout: "source_version": "0'0", 2024-04-19T03:01:51.248 INFO:teuthology.orchestra.run.smithi096.stdout: "target_version": "0'0" 2024-04-19T03:01:51.248 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-19T03:01:51.249 INFO:teuthology.orchestra.run.smithi096.stdout: "last_change": "20", 2024-04-19T03:01:51.249 INFO:teuthology.orchestra.run.smithi096.stdout: "last_force_op_resend": "0", 2024-04-19T03:01:51.249 INFO:teuthology.orchestra.run.smithi096.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-19T03:01:51.249 INFO:teuthology.orchestra.run.smithi096.stdout: "last_force_op_resend_preluminous": "0", 2024-04-19T03:01:51.249 INFO:teuthology.orchestra.run.smithi096.stdout: "auid": 0, 2024-04-19T03:01:51.249 INFO:teuthology.orchestra.run.smithi096.stdout: "snap_mode": "selfmanaged", 2024-04-19T03:01:51.249 INFO:teuthology.orchestra.run.smithi096.stdout: "snap_seq": 0, 2024-04-19T03:01:51.249 INFO:teuthology.orchestra.run.smithi096.stdout: "snap_epoch": 0, 2024-04-19T03:01:51.249 INFO:teuthology.orchestra.run.smithi096.stdout: "pool_snaps": [], 2024-04-19T03:01:51.249 INFO:teuthology.orchestra.run.smithi096.stdout: "removed_snaps": "[]", 2024-04-19T03:01:51.249 INFO:teuthology.orchestra.run.smithi096.stdout: "quota_max_bytes": 0, 2024-04-19T03:01:51.249 INFO:teuthology.orchestra.run.smithi096.stdout: "quota_max_objects": 0, 2024-04-19T03:01:51.249 INFO:teuthology.orchestra.run.smithi096.stdout: "tiers": [], 2024-04-19T03:01:51.249 INFO:teuthology.orchestra.run.smithi096.stdout: "tier_of": -1, 2024-04-19T03:01:51.249 INFO:teuthology.orchestra.run.smithi096.stdout: "read_tier": -1, 2024-04-19T03:01:51.250 INFO:teuthology.orchestra.run.smithi096.stdout: "write_tier": -1, 2024-04-19T03:01:51.250 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_mode": "none", 2024-04-19T03:01:51.250 INFO:teuthology.orchestra.run.smithi096.stdout: "target_max_bytes": 0, 2024-04-19T03:01:51.250 INFO:teuthology.orchestra.run.smithi096.stdout: "target_max_objects": 0, 2024-04-19T03:01:51.250 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-19T03:01:51.250 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-19T03:01:51.250 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-19T03:01:51.250 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_min_flush_age": 0, 2024-04-19T03:01:51.250 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_min_evict_age": 0, 2024-04-19T03:01:51.250 INFO:teuthology.orchestra.run.smithi096.stdout: "erasure_code_profile": "", 2024-04-19T03:01:51.250 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_params": { 2024-04-19T03:01:51.250 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "none" 2024-04-19T03:01:51.251 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-19T03:01:51.251 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_period": 0, 2024-04-19T03:01:51.251 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_count": 0, 2024-04-19T03:01:51.251 INFO:teuthology.orchestra.run.smithi096.stdout: "use_gmt_hitset": true, 2024-04-19T03:01:51.251 INFO:teuthology.orchestra.run.smithi096.stdout: "min_read_recency_for_promote": 0, 2024-04-19T03:01:51.251 INFO:teuthology.orchestra.run.smithi096.stdout: "min_write_recency_for_promote": 0, 2024-04-19T03:01:51.251 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_grade_decay_rate": 0, 2024-04-19T03:01:51.251 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_search_last_n": 0, 2024-04-19T03:01:51.251 INFO:teuthology.orchestra.run.smithi096.stdout: "grade_table": [], 2024-04-19T03:01:51.251 INFO:teuthology.orchestra.run.smithi096.stdout: "stripe_width": 0, 2024-04-19T03:01:51.251 INFO:teuthology.orchestra.run.smithi096.stdout: "expected_num_objects": 0, 2024-04-19T03:01:51.251 INFO:teuthology.orchestra.run.smithi096.stdout: "fast_read": false, 2024-04-19T03:01:51.251 INFO:teuthology.orchestra.run.smithi096.stdout: "options": { 2024-04-19T03:01:51.251 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_autoscale_bias": 4, 2024-04-19T03:01:51.252 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num_min": 16, 2024-04-19T03:01:51.252 INFO:teuthology.orchestra.run.smithi096.stdout: "recovery_priority": 5 2024-04-19T03:01:51.252 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-19T03:01:51.252 INFO:teuthology.orchestra.run.smithi096.stdout: "application_metadata": { 2024-04-19T03:01:51.252 INFO:teuthology.orchestra.run.smithi096.stdout: "cephfs": { 2024-04-19T03:01:51.252 INFO:teuthology.orchestra.run.smithi096.stdout: "metadata": "cephfs" 2024-04-19T03:01:51.252 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-19T03:01:51.252 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-19T03:01:51.252 INFO:teuthology.orchestra.run.smithi096.stdout: "read_balance": { 2024-04-19T03:01:51.252 INFO:teuthology.orchestra.run.smithi096.stdout: "score_acting": 1.1299999952316284, 2024-04-19T03:01:51.252 INFO:teuthology.orchestra.run.smithi096.stdout: "score_stable": 1.1299999952316284, 2024-04-19T03:01:51.253 INFO:teuthology.orchestra.run.smithi096.stdout: "optimal_score": 1, 2024-04-19T03:01:51.253 INFO:teuthology.orchestra.run.smithi096.stdout: "raw_score_acting": 1.1299999952316284, 2024-04-19T03:01:51.253 INFO:teuthology.orchestra.run.smithi096.stdout: "raw_score_stable": 1.1299999952316284, 2024-04-19T03:01:51.253 INFO:teuthology.orchestra.run.smithi096.stdout: "primary_affinity_weighted": 1, 2024-04-19T03:01:51.253 INFO:teuthology.orchestra.run.smithi096.stdout: "average_primary_affinity": 1, 2024-04-19T03:01:51.253 INFO:teuthology.orchestra.run.smithi096.stdout: "average_primary_affinity_weighted": 1 2024-04-19T03:01:51.253 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-19T03:01:51.253 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-19T03:01:51.253 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-19T03:01:51.253 INFO:teuthology.orchestra.run.smithi096.stdout: "pool": 4, 2024-04-19T03:01:51.253 INFO:teuthology.orchestra.run.smithi096.stdout: "pool_name": "cephfs_data", 2024-04-19T03:01:51.253 INFO:teuthology.orchestra.run.smithi096.stdout: "create_time": "2024-04-19T03:01:13.992441+0000", 2024-04-19T03:01:51.253 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-19T03:01:51.253 INFO:teuthology.orchestra.run.smithi096.stdout: "flags_names": "hashpspool", 2024-04-19T03:01:51.254 INFO:teuthology.orchestra.run.smithi096.stdout: "type": 1, 2024-04-19T03:01:51.254 INFO:teuthology.orchestra.run.smithi096.stdout: "size": 2, 2024-04-19T03:01:51.254 INFO:teuthology.orchestra.run.smithi096.stdout: "min_size": 1, 2024-04-19T03:01:51.254 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_rule": 0, 2024-04-19T03:01:51.254 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_count": 0, 2024-04-19T03:01:51.254 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_target": 0, 2024-04-19T03:01:51.254 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_barrier": 0, 2024-04-19T03:01:51.254 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-19T03:01:51.254 INFO:teuthology.orchestra.run.smithi096.stdout: "object_hash": 2, 2024-04-19T03:01:51.254 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_autoscale_mode": "off", 2024-04-19T03:01:51.254 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num": 64, 2024-04-19T03:01:51.254 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_placement_num": 64, 2024-04-19T03:01:51.255 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_placement_num_target": 64, 2024-04-19T03:01:51.255 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num_target": 64, 2024-04-19T03:01:51.255 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num_pending": 64, 2024-04-19T03:01:51.255 INFO:teuthology.orchestra.run.smithi096.stdout: "last_pg_merge_meta": { 2024-04-19T03:01:51.255 INFO:teuthology.orchestra.run.smithi096.stdout: "source_pgid": "0.0", 2024-04-19T03:01:51.255 INFO:teuthology.orchestra.run.smithi096.stdout: "ready_epoch": 0, 2024-04-19T03:01:51.255 INFO:teuthology.orchestra.run.smithi096.stdout: "last_epoch_started": 0, 2024-04-19T03:01:51.255 INFO:teuthology.orchestra.run.smithi096.stdout: "last_epoch_clean": 0, 2024-04-19T03:01:51.255 INFO:teuthology.orchestra.run.smithi096.stdout: "source_version": "0'0", 2024-04-19T03:01:51.255 INFO:teuthology.orchestra.run.smithi096.stdout: "target_version": "0'0" 2024-04-19T03:01:51.255 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-19T03:01:51.255 INFO:teuthology.orchestra.run.smithi096.stdout: "last_change": "21", 2024-04-19T03:01:51.255 INFO:teuthology.orchestra.run.smithi096.stdout: "last_force_op_resend": "0", 2024-04-19T03:01:51.256 INFO:teuthology.orchestra.run.smithi096.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-19T03:01:51.256 INFO:teuthology.orchestra.run.smithi096.stdout: "last_force_op_resend_preluminous": "0", 2024-04-19T03:01:51.256 INFO:teuthology.orchestra.run.smithi096.stdout: "auid": 0, 2024-04-19T03:01:51.256 INFO:teuthology.orchestra.run.smithi096.stdout: "snap_mode": "selfmanaged", 2024-04-19T03:01:51.256 INFO:teuthology.orchestra.run.smithi096.stdout: "snap_seq": 0, 2024-04-19T03:01:51.256 INFO:teuthology.orchestra.run.smithi096.stdout: "snap_epoch": 0, 2024-04-19T03:01:51.256 INFO:teuthology.orchestra.run.smithi096.stdout: "pool_snaps": [], 2024-04-19T03:01:51.256 INFO:teuthology.orchestra.run.smithi096.stdout: "removed_snaps": "[]", 2024-04-19T03:01:51.256 INFO:teuthology.orchestra.run.smithi096.stdout: "quota_max_bytes": 0, 2024-04-19T03:01:51.256 INFO:teuthology.orchestra.run.smithi096.stdout: "quota_max_objects": 0, 2024-04-19T03:01:51.256 INFO:teuthology.orchestra.run.smithi096.stdout: "tiers": [], 2024-04-19T03:01:51.256 INFO:teuthology.orchestra.run.smithi096.stdout: "tier_of": -1, 2024-04-19T03:01:51.256 INFO:teuthology.orchestra.run.smithi096.stdout: "read_tier": -1, 2024-04-19T03:01:51.256 INFO:teuthology.orchestra.run.smithi096.stdout: "write_tier": -1, 2024-04-19T03:01:51.257 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_mode": "none", 2024-04-19T03:01:51.257 INFO:teuthology.orchestra.run.smithi096.stdout: "target_max_bytes": 0, 2024-04-19T03:01:51.257 INFO:teuthology.orchestra.run.smithi096.stdout: "target_max_objects": 0, 2024-04-19T03:01:51.257 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-19T03:01:51.257 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-19T03:01:51.257 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-19T03:01:51.257 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_min_flush_age": 0, 2024-04-19T03:01:51.257 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_min_evict_age": 0, 2024-04-19T03:01:51.257 INFO:teuthology.orchestra.run.smithi096.stdout: "erasure_code_profile": "", 2024-04-19T03:01:51.257 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_params": { 2024-04-19T03:01:51.257 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "none" 2024-04-19T03:01:51.257 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-19T03:01:51.257 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_period": 0, 2024-04-19T03:01:51.258 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_count": 0, 2024-04-19T03:01:51.258 INFO:teuthology.orchestra.run.smithi096.stdout: "use_gmt_hitset": true, 2024-04-19T03:01:51.258 INFO:teuthology.orchestra.run.smithi096.stdout: "min_read_recency_for_promote": 0, 2024-04-19T03:01:51.258 INFO:teuthology.orchestra.run.smithi096.stdout: "min_write_recency_for_promote": 0, 2024-04-19T03:01:51.258 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_grade_decay_rate": 0, 2024-04-19T03:01:51.258 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_search_last_n": 0, 2024-04-19T03:01:51.258 INFO:teuthology.orchestra.run.smithi096.stdout: "grade_table": [], 2024-04-19T03:01:51.258 INFO:teuthology.orchestra.run.smithi096.stdout: "stripe_width": 0, 2024-04-19T03:01:51.258 INFO:teuthology.orchestra.run.smithi096.stdout: "expected_num_objects": 0, 2024-04-19T03:01:51.258 INFO:teuthology.orchestra.run.smithi096.stdout: "fast_read": false, 2024-04-19T03:01:51.258 INFO:teuthology.orchestra.run.smithi096.stdout: "options": { 2024-04-19T03:01:51.258 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num_min": 64, 2024-04-19T03:01:51.258 INFO:teuthology.orchestra.run.smithi096.stdout: "target_size_ratio": 0.89999997615814209 2024-04-19T03:01:51.259 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-19T03:01:51.259 INFO:teuthology.orchestra.run.smithi096.stdout: "application_metadata": { 2024-04-19T03:01:51.259 INFO:teuthology.orchestra.run.smithi096.stdout: "cephfs": { 2024-04-19T03:01:51.259 INFO:teuthology.orchestra.run.smithi096.stdout: "data": "cephfs" 2024-04-19T03:01:51.259 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-19T03:01:51.259 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-19T03:01:51.259 INFO:teuthology.orchestra.run.smithi096.stdout: "read_balance": { 2024-04-19T03:01:51.259 INFO:teuthology.orchestra.run.smithi096.stdout: "score_acting": 1.1299999952316284, 2024-04-19T03:01:51.259 INFO:teuthology.orchestra.run.smithi096.stdout: "score_stable": 1.1299999952316284, 2024-04-19T03:01:51.259 INFO:teuthology.orchestra.run.smithi096.stdout: "optimal_score": 1, 2024-04-19T03:01:51.259 INFO:teuthology.orchestra.run.smithi096.stdout: "raw_score_acting": 1.1299999952316284, 2024-04-19T03:01:51.259 INFO:teuthology.orchestra.run.smithi096.stdout: "raw_score_stable": 1.1299999952316284, 2024-04-19T03:01:51.259 INFO:teuthology.orchestra.run.smithi096.stdout: "primary_affinity_weighted": 1, 2024-04-19T03:01:51.259 INFO:teuthology.orchestra.run.smithi096.stdout: "average_primary_affinity": 1, 2024-04-19T03:01:51.260 INFO:teuthology.orchestra.run.smithi096.stdout: "average_primary_affinity_weighted": 1 2024-04-19T03:01:51.260 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-19T03:01:51.260 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-19T03:01:51.260 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-19T03:01:51.260 INFO:teuthology.orchestra.run.smithi096.stdout: "pool": 5, 2024-04-19T03:01:51.260 INFO:teuthology.orchestra.run.smithi096.stdout: "pool_name": "unique_pool_0", 2024-04-19T03:01:51.260 INFO:teuthology.orchestra.run.smithi096.stdout: "create_time": "2024-04-19T03:01:35.396306+0000", 2024-04-19T03:01:51.260 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-19T03:01:51.260 INFO:teuthology.orchestra.run.smithi096.stdout: "flags_names": "hashpspool", 2024-04-19T03:01:51.260 INFO:teuthology.orchestra.run.smithi096.stdout: "type": 1, 2024-04-19T03:01:51.260 INFO:teuthology.orchestra.run.smithi096.stdout: "size": 2, 2024-04-19T03:01:51.260 INFO:teuthology.orchestra.run.smithi096.stdout: "min_size": 1, 2024-04-19T03:01:51.260 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_rule": 0, 2024-04-19T03:01:51.261 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_count": 0, 2024-04-19T03:01:51.261 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_target": 0, 2024-04-19T03:01:51.261 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_barrier": 0, 2024-04-19T03:01:51.261 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-19T03:01:51.261 INFO:teuthology.orchestra.run.smithi096.stdout: "object_hash": 2, 2024-04-19T03:01:51.261 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_autoscale_mode": "off", 2024-04-19T03:01:51.261 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num": 16, 2024-04-19T03:01:51.261 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_placement_num": 16, 2024-04-19T03:01:51.261 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_placement_num_target": 16, 2024-04-19T03:01:51.261 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num_target": 16, 2024-04-19T03:01:51.261 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num_pending": 16, 2024-04-19T03:01:51.261 INFO:teuthology.orchestra.run.smithi096.stdout: "last_pg_merge_meta": { 2024-04-19T03:01:51.261 INFO:teuthology.orchestra.run.smithi096.stdout: "source_pgid": "0.0", 2024-04-19T03:01:51.261 INFO:teuthology.orchestra.run.smithi096.stdout: "ready_epoch": 0, 2024-04-19T03:01:51.262 INFO:teuthology.orchestra.run.smithi096.stdout: "last_epoch_started": 0, 2024-04-19T03:01:51.262 INFO:teuthology.orchestra.run.smithi096.stdout: "last_epoch_clean": 0, 2024-04-19T03:01:51.262 INFO:teuthology.orchestra.run.smithi096.stdout: "source_version": "0'0", 2024-04-19T03:01:51.262 INFO:teuthology.orchestra.run.smithi096.stdout: "target_version": "0'0" 2024-04-19T03:01:51.262 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-19T03:01:51.262 INFO:teuthology.orchestra.run.smithi096.stdout: "last_change": "24", 2024-04-19T03:01:51.262 INFO:teuthology.orchestra.run.smithi096.stdout: "last_force_op_resend": "0", 2024-04-19T03:01:51.262 INFO:teuthology.orchestra.run.smithi096.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-19T03:01:51.262 INFO:teuthology.orchestra.run.smithi096.stdout: "last_force_op_resend_preluminous": "0", 2024-04-19T03:01:51.262 INFO:teuthology.orchestra.run.smithi096.stdout: "auid": 0, 2024-04-19T03:01:51.262 INFO:teuthology.orchestra.run.smithi096.stdout: "snap_mode": "selfmanaged", 2024-04-19T03:01:51.262 INFO:teuthology.orchestra.run.smithi096.stdout: "snap_seq": 0, 2024-04-19T03:01:51.262 INFO:teuthology.orchestra.run.smithi096.stdout: "snap_epoch": 0, 2024-04-19T03:01:51.263 INFO:teuthology.orchestra.run.smithi096.stdout: "pool_snaps": [], 2024-04-19T03:01:51.263 INFO:teuthology.orchestra.run.smithi096.stdout: "removed_snaps": "[]", 2024-04-19T03:01:51.263 INFO:teuthology.orchestra.run.smithi096.stdout: "quota_max_bytes": 0, 2024-04-19T03:01:51.263 INFO:teuthology.orchestra.run.smithi096.stdout: "quota_max_objects": 0, 2024-04-19T03:01:51.263 INFO:teuthology.orchestra.run.smithi096.stdout: "tiers": [], 2024-04-19T03:01:51.263 INFO:teuthology.orchestra.run.smithi096.stdout: "tier_of": -1, 2024-04-19T03:01:51.263 INFO:teuthology.orchestra.run.smithi096.stdout: "read_tier": -1, 2024-04-19T03:01:51.263 INFO:teuthology.orchestra.run.smithi096.stdout: "write_tier": -1, 2024-04-19T03:01:51.263 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_mode": "none", 2024-04-19T03:01:51.263 INFO:teuthology.orchestra.run.smithi096.stdout: "target_max_bytes": 0, 2024-04-19T03:01:51.263 INFO:teuthology.orchestra.run.smithi096.stdout: "target_max_objects": 0, 2024-04-19T03:01:51.263 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-19T03:01:51.263 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-19T03:01:51.264 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-19T03:01:51.264 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_min_flush_age": 0, 2024-04-19T03:01:51.264 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_min_evict_age": 0, 2024-04-19T03:01:51.264 INFO:teuthology.orchestra.run.smithi096.stdout: "erasure_code_profile": "", 2024-04-19T03:01:51.264 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_params": { 2024-04-19T03:01:51.264 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "none" 2024-04-19T03:01:51.264 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-19T03:01:51.264 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_period": 0, 2024-04-19T03:01:51.264 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_count": 0, 2024-04-19T03:01:51.264 INFO:teuthology.orchestra.run.smithi096.stdout: "use_gmt_hitset": true, 2024-04-19T03:01:51.264 INFO:teuthology.orchestra.run.smithi096.stdout: "min_read_recency_for_promote": 0, 2024-04-19T03:01:51.264 INFO:teuthology.orchestra.run.smithi096.stdout: "min_write_recency_for_promote": 0, 2024-04-19T03:01:51.264 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_grade_decay_rate": 0, 2024-04-19T03:01:51.264 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_search_last_n": 0, 2024-04-19T03:01:51.265 INFO:teuthology.orchestra.run.smithi096.stdout: "grade_table": [], 2024-04-19T03:01:51.265 INFO:teuthology.orchestra.run.smithi096.stdout: "stripe_width": 0, 2024-04-19T03:01:51.265 INFO:teuthology.orchestra.run.smithi096.stdout: "expected_num_objects": 0, 2024-04-19T03:01:51.265 INFO:teuthology.orchestra.run.smithi096.stdout: "fast_read": false, 2024-04-19T03:01:51.265 INFO:teuthology.orchestra.run.smithi096.stdout: "options": {}, 2024-04-19T03:01:51.265 INFO:teuthology.orchestra.run.smithi096.stdout: "application_metadata": { 2024-04-19T03:01:51.265 INFO:teuthology.orchestra.run.smithi096.stdout: "rados": {} 2024-04-19T03:01:51.265 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-19T03:01:51.265 INFO:teuthology.orchestra.run.smithi096.stdout: "read_balance": { 2024-04-19T03:01:51.265 INFO:teuthology.orchestra.run.smithi096.stdout: "score_acting": 1.1299999952316284, 2024-04-19T03:01:51.265 INFO:teuthology.orchestra.run.smithi096.stdout: "score_stable": 1.1299999952316284, 2024-04-19T03:01:51.265 INFO:teuthology.orchestra.run.smithi096.stdout: "optimal_score": 1, 2024-04-19T03:01:51.265 INFO:teuthology.orchestra.run.smithi096.stdout: "raw_score_acting": 1.1299999952316284, 2024-04-19T03:01:51.266 INFO:teuthology.orchestra.run.smithi096.stdout: "raw_score_stable": 1.1299999952316284, 2024-04-19T03:01:51.266 INFO:teuthology.orchestra.run.smithi096.stdout: "primary_affinity_weighted": 1, 2024-04-19T03:01:51.266 INFO:teuthology.orchestra.run.smithi096.stdout: "average_primary_affinity": 1, 2024-04-19T03:01:51.266 INFO:teuthology.orchestra.run.smithi096.stdout: "average_primary_affinity_weighted": 1 2024-04-19T03:01:51.266 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-19T03:01:51.266 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-19T03:01:51.266 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-19T03:01:51.266 INFO:teuthology.orchestra.run.smithi096.stdout: "osds": [ 2024-04-19T03:01:51.266 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-19T03:01:51.266 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": 0, 2024-04-19T03:01:51.266 INFO:teuthology.orchestra.run.smithi096.stdout: "uuid": "05ecb884-2c30-44f7-aa14-90154f9bbe9a", 2024-04-19T03:01:51.266 INFO:teuthology.orchestra.run.smithi096.stdout: "up": 1, 2024-04-19T03:01:51.266 INFO:teuthology.orchestra.run.smithi096.stdout: "in": 1, 2024-04-19T03:01:51.267 INFO:teuthology.orchestra.run.smithi096.stdout: "weight": 1, 2024-04-19T03:01:51.267 INFO:teuthology.orchestra.run.smithi096.stdout: "primary_affinity": 1, 2024-04-19T03:01:51.267 INFO:teuthology.orchestra.run.smithi096.stdout: "last_clean_begin": 0, 2024-04-19T03:01:51.267 INFO:teuthology.orchestra.run.smithi096.stdout: "last_clean_end": 0, 2024-04-19T03:01:51.267 INFO:teuthology.orchestra.run.smithi096.stdout: "up_from": 9, 2024-04-19T03:01:51.267 INFO:teuthology.orchestra.run.smithi096.stdout: "up_thru": 22, 2024-04-19T03:01:51.267 INFO:teuthology.orchestra.run.smithi096.stdout: "down_at": 0, 2024-04-19T03:01:51.267 INFO:teuthology.orchestra.run.smithi096.stdout: "lost_at": 0, 2024-04-19T03:01:51.267 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addrs": { 2024-04-19T03:01:51.267 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-19T03:01:51.267 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-19T03:01:51.267 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-19T03:01:51.267 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.97:6800", 2024-04-19T03:01:51.268 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 18245 2024-04-19T03:01:51.268 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-19T03:01:51.268 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-19T03:01:51.268 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-19T03:01:51.268 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.97:6801", 2024-04-19T03:01:51.268 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 18245 2024-04-19T03:01:51.268 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-19T03:01:51.268 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-19T03:01:51.268 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-19T03:01:51.268 INFO:teuthology.orchestra.run.smithi096.stdout: "cluster_addrs": { 2024-04-19T03:01:51.268 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-19T03:01:51.268 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-19T03:01:51.268 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-19T03:01:51.269 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.97:6802", 2024-04-19T03:01:51.269 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 18245 2024-04-19T03:01:51.269 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-19T03:01:51.269 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-19T03:01:51.269 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-19T03:01:51.269 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.97:6803", 2024-04-19T03:01:51.269 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 18245 2024-04-19T03:01:51.269 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-19T03:01:51.269 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-19T03:01:51.269 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-19T03:01:51.270 INFO:teuthology.orchestra.run.smithi096.stdout: "heartbeat_back_addrs": { 2024-04-19T03:01:51.270 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-19T03:01:51.270 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-19T03:01:51.270 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-19T03:01:51.270 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.97:6806", 2024-04-19T03:01:51.270 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 18245 2024-04-19T03:01:51.270 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-19T03:01:51.270 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-19T03:01:51.270 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-19T03:01:51.270 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.97:6807", 2024-04-19T03:01:51.270 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 18245 2024-04-19T03:01:51.270 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-19T03:01:51.270 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-19T03:01:51.271 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-19T03:01:51.271 INFO:teuthology.orchestra.run.smithi096.stdout: "heartbeat_front_addrs": { 2024-04-19T03:01:51.271 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-19T03:01:51.271 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-19T03:01:51.271 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-19T03:01:51.271 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.97:6804", 2024-04-19T03:01:51.271 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 18245 2024-04-19T03:01:51.271 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-19T03:01:51.271 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-19T03:01:51.271 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-19T03:01:51.271 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.97:6805", 2024-04-19T03:01:51.271 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 18245 2024-04-19T03:01:51.271 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-19T03:01:51.272 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-19T03:01:51.272 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-19T03:01:51.272 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addr": "172.21.15.97:6801/18245", 2024-04-19T03:01:51.272 INFO:teuthology.orchestra.run.smithi096.stdout: "cluster_addr": "172.21.15.97:6803/18245", 2024-04-19T03:01:51.272 INFO:teuthology.orchestra.run.smithi096.stdout: "heartbeat_back_addr": "172.21.15.97:6807/18245", 2024-04-19T03:01:51.272 INFO:teuthology.orchestra.run.smithi096.stdout: "heartbeat_front_addr": "172.21.15.97:6805/18245", 2024-04-19T03:01:51.272 INFO:teuthology.orchestra.run.smithi096.stdout: "state": [ 2024-04-19T03:01:51.272 INFO:teuthology.orchestra.run.smithi096.stdout: "exists", 2024-04-19T03:01:51.272 INFO:teuthology.orchestra.run.smithi096.stdout: "up" 2024-04-19T03:01:51.272 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-19T03:01:51.272 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-19T03:01:51.272 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-19T03:01:51.272 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": 1, 2024-04-19T03:01:51.272 INFO:teuthology.orchestra.run.smithi096.stdout: "uuid": "efc873e0-69c3-4a57-8ee5-41f836b65f47", 2024-04-19T03:01:51.273 INFO:teuthology.orchestra.run.smithi096.stdout: "up": 1, 2024-04-19T03:01:51.273 INFO:teuthology.orchestra.run.smithi096.stdout: "in": 1, 2024-04-19T03:01:51.273 INFO:teuthology.orchestra.run.smithi096.stdout: "weight": 1, 2024-04-19T03:01:51.273 INFO:teuthology.orchestra.run.smithi096.stdout: "primary_affinity": 1, 2024-04-19T03:01:51.273 INFO:teuthology.orchestra.run.smithi096.stdout: "last_clean_begin": 0, 2024-04-19T03:01:51.273 INFO:teuthology.orchestra.run.smithi096.stdout: "last_clean_end": 0, 2024-04-19T03:01:51.273 INFO:teuthology.orchestra.run.smithi096.stdout: "up_from": 10, 2024-04-19T03:01:51.273 INFO:teuthology.orchestra.run.smithi096.stdout: "up_thru": 22, 2024-04-19T03:01:51.273 INFO:teuthology.orchestra.run.smithi096.stdout: "down_at": 0, 2024-04-19T03:01:51.273 INFO:teuthology.orchestra.run.smithi096.stdout: "lost_at": 0, 2024-04-19T03:01:51.273 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addrs": { 2024-04-19T03:01:51.273 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-19T03:01:51.273 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-19T03:01:51.274 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-19T03:01:51.274 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.134:6800", 2024-04-19T03:01:51.274 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 18145 2024-04-19T03:01:51.274 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-19T03:01:51.274 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-19T03:01:51.274 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-19T03:01:51.274 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.134:6801", 2024-04-19T03:01:51.274 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 18145 2024-04-19T03:01:51.274 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-19T03:01:51.274 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-19T03:01:51.274 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-19T03:01:51.274 INFO:teuthology.orchestra.run.smithi096.stdout: "cluster_addrs": { 2024-04-19T03:01:51.274 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-19T03:01:51.275 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-19T03:01:51.275 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-19T03:01:51.275 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.134:6802", 2024-04-19T03:01:51.275 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 18145 2024-04-19T03:01:51.275 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-19T03:01:51.275 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-19T03:01:51.275 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-19T03:01:51.275 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.134:6803", 2024-04-19T03:01:51.275 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 18145 2024-04-19T03:01:51.275 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-19T03:01:51.275 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-19T03:01:51.275 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-19T03:01:51.275 INFO:teuthology.orchestra.run.smithi096.stdout: "heartbeat_back_addrs": { 2024-04-19T03:01:51.275 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-19T03:01:51.276 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-19T03:01:51.276 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-19T03:01:51.276 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.134:6806", 2024-04-19T03:01:51.276 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 18145 2024-04-19T03:01:51.276 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-19T03:01:51.276 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-19T03:01:51.276 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-19T03:01:51.276 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.134:6807", 2024-04-19T03:01:51.276 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 18145 2024-04-19T03:01:51.276 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-19T03:01:51.276 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-19T03:01:51.276 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-19T03:01:51.276 INFO:teuthology.orchestra.run.smithi096.stdout: "heartbeat_front_addrs": { 2024-04-19T03:01:51.276 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-19T03:01:51.277 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-19T03:01:51.277 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-19T03:01:51.277 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.134:6804", 2024-04-19T03:01:51.277 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 18145 2024-04-19T03:01:51.277 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-19T03:01:51.277 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-19T03:01:51.277 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-19T03:01:51.277 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.134:6805", 2024-04-19T03:01:51.277 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 18145 2024-04-19T03:01:51.277 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-19T03:01:51.277 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-19T03:01:51.277 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-19T03:01:51.277 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addr": "172.21.15.134:6801/18145", 2024-04-19T03:01:51.277 INFO:teuthology.orchestra.run.smithi096.stdout: "cluster_addr": "172.21.15.134:6803/18145", 2024-04-19T03:01:51.278 INFO:teuthology.orchestra.run.smithi096.stdout: "heartbeat_back_addr": "172.21.15.134:6807/18145", 2024-04-19T03:01:51.278 INFO:teuthology.orchestra.run.smithi096.stdout: "heartbeat_front_addr": "172.21.15.134:6805/18145", 2024-04-19T03:01:51.278 INFO:teuthology.orchestra.run.smithi096.stdout: "state": [ 2024-04-19T03:01:51.278 INFO:teuthology.orchestra.run.smithi096.stdout: "exists", 2024-04-19T03:01:51.278 INFO:teuthology.orchestra.run.smithi096.stdout: "up" 2024-04-19T03:01:51.278 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-19T03:01:51.278 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-19T03:01:51.278 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-19T03:01:51.278 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": 2, 2024-04-19T03:01:51.278 INFO:teuthology.orchestra.run.smithi096.stdout: "uuid": "229278a0-dd93-4234-9065-e4f2f6188ef2", 2024-04-19T03:01:51.278 INFO:teuthology.orchestra.run.smithi096.stdout: "up": 1, 2024-04-19T03:01:51.278 INFO:teuthology.orchestra.run.smithi096.stdout: "in": 1, 2024-04-19T03:01:51.278 INFO:teuthology.orchestra.run.smithi096.stdout: "weight": 1, 2024-04-19T03:01:51.278 INFO:teuthology.orchestra.run.smithi096.stdout: "primary_affinity": 1, 2024-04-19T03:01:51.279 INFO:teuthology.orchestra.run.smithi096.stdout: "last_clean_begin": 0, 2024-04-19T03:01:51.279 INFO:teuthology.orchestra.run.smithi096.stdout: "last_clean_end": 0, 2024-04-19T03:01:51.279 INFO:teuthology.orchestra.run.smithi096.stdout: "up_from": 10, 2024-04-19T03:01:51.279 INFO:teuthology.orchestra.run.smithi096.stdout: "up_thru": 22, 2024-04-19T03:01:51.279 INFO:teuthology.orchestra.run.smithi096.stdout: "down_at": 0, 2024-04-19T03:01:51.279 INFO:teuthology.orchestra.run.smithi096.stdout: "lost_at": 0, 2024-04-19T03:01:51.279 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addrs": { 2024-04-19T03:01:51.279 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-19T03:01:51.279 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-19T03:01:51.279 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-19T03:01:51.279 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.144:6800", 2024-04-19T03:01:51.279 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 18223 2024-04-19T03:01:51.279 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-19T03:01:51.279 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-19T03:01:51.280 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-19T03:01:51.280 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.144:6801", 2024-04-19T03:01:51.280 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 18223 2024-04-19T03:01:51.280 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-19T03:01:51.280 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-19T03:01:51.280 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-19T03:01:51.280 INFO:teuthology.orchestra.run.smithi096.stdout: "cluster_addrs": { 2024-04-19T03:01:51.280 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-19T03:01:51.280 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-19T03:01:51.280 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-19T03:01:51.280 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.144:6802", 2024-04-19T03:01:51.280 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 18223 2024-04-19T03:01:51.280 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-19T03:01:51.280 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-19T03:01:51.281 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-19T03:01:51.281 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.144:6803", 2024-04-19T03:01:51.281 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 18223 2024-04-19T03:01:51.281 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-19T03:01:51.281 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-19T03:01:51.281 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-19T03:01:51.281 INFO:teuthology.orchestra.run.smithi096.stdout: "heartbeat_back_addrs": { 2024-04-19T03:01:51.281 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-19T03:01:51.281 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-19T03:01:51.281 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-19T03:01:51.281 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.144:6806", 2024-04-19T03:01:51.281 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 18223 2024-04-19T03:01:51.281 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-19T03:01:51.281 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-19T03:01:51.281 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-19T03:01:51.282 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.144:6807", 2024-04-19T03:01:51.282 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 18223 2024-04-19T03:01:51.282 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-19T03:01:51.282 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-19T03:01:51.282 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-19T03:01:51.282 INFO:teuthology.orchestra.run.smithi096.stdout: "heartbeat_front_addrs": { 2024-04-19T03:01:51.282 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-19T03:01:51.282 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-19T03:01:51.282 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-19T03:01:51.282 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.144:6804", 2024-04-19T03:01:51.282 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 18223 2024-04-19T03:01:51.282 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-19T03:01:51.282 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-19T03:01:51.283 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-19T03:01:51.283 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.144:6805", 2024-04-19T03:01:51.283 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 18223 2024-04-19T03:01:51.283 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-19T03:01:51.283 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-19T03:01:51.283 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-19T03:01:51.283 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addr": "172.21.15.144:6801/18223", 2024-04-19T03:01:51.283 INFO:teuthology.orchestra.run.smithi096.stdout: "cluster_addr": "172.21.15.144:6803/18223", 2024-04-19T03:01:51.283 INFO:teuthology.orchestra.run.smithi096.stdout: "heartbeat_back_addr": "172.21.15.144:6807/18223", 2024-04-19T03:01:51.283 INFO:teuthology.orchestra.run.smithi096.stdout: "heartbeat_front_addr": "172.21.15.144:6805/18223", 2024-04-19T03:01:51.283 INFO:teuthology.orchestra.run.smithi096.stdout: "state": [ 2024-04-19T03:01:51.283 INFO:teuthology.orchestra.run.smithi096.stdout: "exists", 2024-04-19T03:01:51.283 INFO:teuthology.orchestra.run.smithi096.stdout: "up" 2024-04-19T03:01:51.283 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-19T03:01:51.284 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-19T03:01:51.284 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-19T03:01:51.284 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_xinfo": [ 2024-04-19T03:01:51.284 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-19T03:01:51.284 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": 0, 2024-04-19T03:01:51.284 INFO:teuthology.orchestra.run.smithi096.stdout: "down_stamp": "0.000000", 2024-04-19T03:01:51.284 INFO:teuthology.orchestra.run.smithi096.stdout: "laggy_probability": 0, 2024-04-19T03:01:51.284 INFO:teuthology.orchestra.run.smithi096.stdout: "laggy_interval": 0, 2024-04-19T03:01:51.284 INFO:teuthology.orchestra.run.smithi096.stdout: "features": 4540138322906710015, 2024-04-19T03:01:51.284 INFO:teuthology.orchestra.run.smithi096.stdout: "old_weight": 0, 2024-04-19T03:01:51.284 INFO:teuthology.orchestra.run.smithi096.stdout: "last_purged_snaps_scrub": "2024-04-19T03:00:59.302574+0000", 2024-04-19T03:01:51.284 INFO:teuthology.orchestra.run.smithi096.stdout: "dead_epoch": 0 2024-04-19T03:01:51.284 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-19T03:01:51.284 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-19T03:01:51.285 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": 1, 2024-04-19T03:01:51.285 INFO:teuthology.orchestra.run.smithi096.stdout: "down_stamp": "0.000000", 2024-04-19T03:01:51.285 INFO:teuthology.orchestra.run.smithi096.stdout: "laggy_probability": 0, 2024-04-19T03:01:51.285 INFO:teuthology.orchestra.run.smithi096.stdout: "laggy_interval": 0, 2024-04-19T03:01:51.285 INFO:teuthology.orchestra.run.smithi096.stdout: "features": 4540138322906710015, 2024-04-19T03:01:51.285 INFO:teuthology.orchestra.run.smithi096.stdout: "old_weight": 0, 2024-04-19T03:01:51.285 INFO:teuthology.orchestra.run.smithi096.stdout: "last_purged_snaps_scrub": "2024-04-19T03:01:00.064174+0000", 2024-04-19T03:01:51.285 INFO:teuthology.orchestra.run.smithi096.stdout: "dead_epoch": 0 2024-04-19T03:01:51.285 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-19T03:01:51.285 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-19T03:01:51.285 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": 2, 2024-04-19T03:01:51.285 INFO:teuthology.orchestra.run.smithi096.stdout: "down_stamp": "0.000000", 2024-04-19T03:01:51.285 INFO:teuthology.orchestra.run.smithi096.stdout: "laggy_probability": 0, 2024-04-19T03:01:51.285 INFO:teuthology.orchestra.run.smithi096.stdout: "laggy_interval": 0, 2024-04-19T03:01:51.286 INFO:teuthology.orchestra.run.smithi096.stdout: "features": 4540138322906710015, 2024-04-19T03:01:51.286 INFO:teuthology.orchestra.run.smithi096.stdout: "old_weight": 0, 2024-04-19T03:01:51.286 INFO:teuthology.orchestra.run.smithi096.stdout: "last_purged_snaps_scrub": "2024-04-19T03:00:59.735582+0000", 2024-04-19T03:01:51.286 INFO:teuthology.orchestra.run.smithi096.stdout: "dead_epoch": 0 2024-04-19T03:01:51.286 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-19T03:01:51.286 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-19T03:01:51.286 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_upmap": [], 2024-04-19T03:01:51.286 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_upmap_items": [], 2024-04-19T03:01:51.286 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_upmap_primaries": [], 2024-04-19T03:01:51.286 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_temp": [], 2024-04-19T03:01:51.286 INFO:teuthology.orchestra.run.smithi096.stdout: "primary_temp": [], 2024-04-19T03:01:51.286 INFO:teuthology.orchestra.run.smithi096.stdout: "blocklist": {}, 2024-04-19T03:01:51.286 INFO:teuthology.orchestra.run.smithi096.stdout: "range_blocklist": {}, 2024-04-19T03:01:51.286 INFO:teuthology.orchestra.run.smithi096.stdout: "erasure_code_profiles": { 2024-04-19T03:01:51.287 INFO:teuthology.orchestra.run.smithi096.stdout: "default": { 2024-04-19T03:01:51.287 INFO:teuthology.orchestra.run.smithi096.stdout: "crush-failure-domain": "osd", 2024-04-19T03:01:51.287 INFO:teuthology.orchestra.run.smithi096.stdout: "k": "2", 2024-04-19T03:01:51.287 INFO:teuthology.orchestra.run.smithi096.stdout: "m": "1", 2024-04-19T03:01:51.287 INFO:teuthology.orchestra.run.smithi096.stdout: "plugin": "jerasure", 2024-04-19T03:01:51.287 INFO:teuthology.orchestra.run.smithi096.stdout: "technique": "reed_sol_van" 2024-04-19T03:01:51.287 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-19T03:01:51.287 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-19T03:01:51.287 INFO:teuthology.orchestra.run.smithi096.stdout: "removed_snaps_queue": [], 2024-04-19T03:01:51.287 INFO:teuthology.orchestra.run.smithi096.stdout: "new_removed_snaps": [], 2024-04-19T03:01:51.287 INFO:teuthology.orchestra.run.smithi096.stdout: "new_purged_snaps": [], 2024-04-19T03:01:51.287 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_node_flags": {}, 2024-04-19T03:01:51.287 INFO:teuthology.orchestra.run.smithi096.stdout: "device_class_flags": {}, 2024-04-19T03:01:51.287 INFO:teuthology.orchestra.run.smithi096.stdout: "stretch_mode": { 2024-04-19T03:01:51.288 INFO:teuthology.orchestra.run.smithi096.stdout: "stretch_mode_enabled": false, 2024-04-19T03:01:51.288 INFO:teuthology.orchestra.run.smithi096.stdout: "stretch_bucket_count": 0, 2024-04-19T03:01:51.288 INFO:teuthology.orchestra.run.smithi096.stdout: "degraded_stretch_mode": 0, 2024-04-19T03:01:51.288 INFO:teuthology.orchestra.run.smithi096.stdout: "recovering_stretch_mode": 0, 2024-04-19T03:01:51.288 INFO:teuthology.orchestra.run.smithi096.stdout: "stretch_mode_bucket": 0 2024-04-19T03:01:51.288 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-19T03:01:51.288 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-04-19T03:01:51.290 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T03:01:51.291 INFO:tasks.thrashosds.thrasher:j is {'epoch': 29, 'fsid': 'c6cc8e09-11d4-48de-9a6c-4d70ed3c3789', 'created': '2024-04-19T03:00:53.746146+0000', 'modified': '2024-04-19T03:01:51.030789+0000', 'last_up_change': '2024-04-19T03:01:04.501086+0000', 'last_in_change': '2024-04-19T03:00:54.640172+0000', 'flags': 'noscrub,nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5806080, 'flags_set': ['nodeep-scrub', 'noscrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 5, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 5, 'max_osd': 3, 'require_min_compat_client': 'luminous', 'min_compat_client': 'jewel', 'require_osd_release': 'reef', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-19T03:01:05.999591+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '14', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-19T03:01:09.051757+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-19T03:01:13.479163+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-04-19T03:01:13.992441+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'unique_pool_0', 'create_time': '2024-04-19T03:01:35.396306+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 16, 'pg_placement_num': 16, 'pg_placement_num_target': 16, 'pg_num_target': 16, 'pg_num_pending': 16, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rados': {}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}], 'osds': [{'osd': 0, 'uuid': '05ecb884-2c30-44f7-aa14-90154f9bbe9a', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 9, 'up_thru': 22, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.97:6800', 'nonce': 18245}, {'type': 'v1', 'addr': '172.21.15.97:6801', 'nonce': 18245}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.97:6802', 'nonce': 18245}, {'type': 'v1', 'addr': '172.21.15.97:6803', 'nonce': 18245}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.97:6806', 'nonce': 18245}, {'type': 'v1', 'addr': '172.21.15.97:6807', 'nonce': 18245}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.97:6804', 'nonce': 18245}, {'type': 'v1', 'addr': '172.21.15.97:6805', 'nonce': 18245}]}, 'public_addr': '172.21.15.97:6801/18245', 'cluster_addr': '172.21.15.97:6803/18245', 'heartbeat_back_addr': '172.21.15.97:6807/18245', 'heartbeat_front_addr': '172.21.15.97:6805/18245', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': 'efc873e0-69c3-4a57-8ee5-41f836b65f47', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 10, 'up_thru': 22, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6800', 'nonce': 18145}, {'type': 'v1', 'addr': '172.21.15.134:6801', 'nonce': 18145}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6802', 'nonce': 18145}, {'type': 'v1', 'addr': '172.21.15.134:6803', 'nonce': 18145}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6806', 'nonce': 18145}, {'type': 'v1', 'addr': '172.21.15.134:6807', 'nonce': 18145}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6804', 'nonce': 18145}, {'type': 'v1', 'addr': '172.21.15.134:6805', 'nonce': 18145}]}, 'public_addr': '172.21.15.134:6801/18145', 'cluster_addr': '172.21.15.134:6803/18145', 'heartbeat_back_addr': '172.21.15.134:6807/18145', 'heartbeat_front_addr': '172.21.15.134:6805/18145', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '229278a0-dd93-4234-9065-e4f2f6188ef2', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 10, 'up_thru': 22, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.144:6800', 'nonce': 18223}, {'type': 'v1', 'addr': '172.21.15.144:6801', 'nonce': 18223}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.144:6802', 'nonce': 18223}, {'type': 'v1', 'addr': '172.21.15.144:6803', 'nonce': 18223}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.144:6806', 'nonce': 18223}, {'type': 'v1', 'addr': '172.21.15.144:6807', 'nonce': 18223}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.144:6804', 'nonce': 18223}, {'type': 'v1', 'addr': '172.21.15.144:6805', 'nonce': 18223}]}, 'public_addr': '172.21.15.144:6801/18223', 'cluster_addr': '172.21.15.144:6803/18223', 'heartbeat_back_addr': '172.21.15.144:6807/18223', 'heartbeat_front_addr': '172.21.15.144:6805/18223', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-19T03:00:59.302574+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-19T03:01:00.064174+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-19T03:00:59.735582+0000', 'dead_epoch': 0}], 'pg_upmap': [], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-04-19T03:01:51.291 INFO:tasks.thrashosds.thrasher:No pg_upmap entries; doing nothing 2024-04-19T03:01:51.310 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:01:51.309+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:01:51.411 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-04-19T03:01:51.405+0000 7f35986ab700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18243) UID: 0 2024-04-19T03:01:51.423 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-19T03:01:51.423 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-04-19T03:01:51.423 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-04-19T03:01:51.423 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-04-19T03:01:51.423 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.424 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:9 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:01:51.424 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:14.999380+0000", 2024-04-19T03:01:51.424 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 36.420864700999999, 2024-04-19T03:01:51.424 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.019009906, 2024-04-19T03:01:51.424 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:01:51.424 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:51.424 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:01:51.424 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.424 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:01:51.424 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999380+0000", 2024-04-19T03:01:51.424 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:51.424 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.424 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.425 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:01:51.425 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999380+0000", 2024-04-19T03:01:51.425 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:51.425 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.425 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.425 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:01:51.425 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999377+0000", 2024-04-19T03:01:51.425 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999971 2024-04-19T03:01:51.425 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.425 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.425 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:01:51.425 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999393+0000", 2024-04-19T03:01:51.425 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5665999999999999e-05 2024-04-19T03:01:51.425 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.426 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.426 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:01:51.426 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999416+0000", 2024-04-19T03:01:51.426 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3030000000000001e-05 2024-04-19T03:01:51.426 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.426 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.426 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:01:51.426 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999439+0000", 2024-04-19T03:01:51.426 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3203000000000001e-05 2024-04-19T03:01:51.426 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.426 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.426 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:51.426 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999564+0000", 2024-04-19T03:01:51.427 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012492800000000001 2024-04-19T03:01:51.427 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.427 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.427 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op must wait for map", 2024-04-19T03:01:51.427 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999573+0000", 2024-04-19T03:01:51.427 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.7129999999999994e-06 2024-04-19T03:01:51.427 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.427 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.427 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:51.427 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.005623+0000", 2024-04-19T03:01:51.427 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0060502120000000001 2024-04-19T03:01:51.427 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.427 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.428 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:01:51.428 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.006510+0000", 2024-04-19T03:01:51.428 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00088656 2024-04-19T03:01:51.428 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.428 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.428 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-04-19T03:01:51.428 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.008004+0000", 2024-04-19T03:01:51.428 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0014948240000000001 2024-04-19T03:01:51.428 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.428 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.428 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:01:51.428 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.011874+0000", 2024-04-19T03:01:51.428 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0038699630000000001 2024-04-19T03:01:51.429 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.429 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.429 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:51.429 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.018000+0000", 2024-04-19T03:01:51.429 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0061254389999999999 2024-04-19T03:01:51.429 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.429 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.429 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:01:51.429 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.018281+0000", 2024-04-19T03:01:51.429 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00028121400000000001 2024-04-19T03:01:51.429 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.429 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.429 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:01:51.430 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.018390+0000", 2024-04-19T03:01:51.430 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010899 2024-04-19T03:01:51.430 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:51.430 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:01:51.430 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:51.430 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.430 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.430 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:10 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:01:51.430 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:14.999496+0000", 2024-04-19T03:01:51.430 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 36.420749166, 2024-04-19T03:01:51.430 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.022720497999999999, 2024-04-19T03:01:51.430 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:01:51.430 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:51.430 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:01:51.431 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.431 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:01:51.431 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999496+0000", 2024-04-19T03:01:51.431 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:51.431 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.431 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.431 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:01:51.431 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999496+0000", 2024-04-19T03:01:51.431 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:51.431 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.431 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.431 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:01:51.431 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999494+0000", 2024-04-19T03:01:51.432 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:01:51.432 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.432 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.432 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:01:51.432 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999503+0000", 2024-04-19T03:01:51.432 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.5930000000000006e-06 2024-04-19T03:01:51.432 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.432 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.432 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:01:51.432 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999523+0000", 2024-04-19T03:01:51.432 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9553000000000001e-05 2024-04-19T03:01:51.432 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.432 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.432 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:01:51.432 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999538+0000", 2024-04-19T03:01:51.433 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5702999999999999e-05 2024-04-19T03:01:51.433 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.433 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.433 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:51.433 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999608+0000", 2024-04-19T03:01:51.433 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.9912000000000004e-05 2024-04-19T03:01:51.433 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.433 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.433 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op must wait for map", 2024-04-19T03:01:51.433 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999626+0000", 2024-04-19T03:01:51.433 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8207e-05 2024-04-19T03:01:51.433 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.433 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.433 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:51.434 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.010765+0000", 2024-04-19T03:01:51.434 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011138719 2024-04-19T03:01:51.434 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.434 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.434 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:01:51.434 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.010906+0000", 2024-04-19T03:01:51.434 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014095899999999999 2024-04-19T03:01:51.434 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.434 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.434 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-04-19T03:01:51.434 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.011472+0000", 2024-04-19T03:01:51.434 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00056629300000000005 2024-04-19T03:01:51.435 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.435 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.435 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:01:51.435 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.013217+0000", 2024-04-19T03:01:51.435 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001744317 2024-04-19T03:01:51.435 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.435 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.435 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:51.435 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.022083+0000", 2024-04-19T03:01:51.435 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0088663849999999992 2024-04-19T03:01:51.435 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.435 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.435 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:01:51.435 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.022124+0000", 2024-04-19T03:01:51.436 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.057e-05 2024-04-19T03:01:51.436 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.436 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.436 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:01:51.436 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.022216+0000", 2024-04-19T03:01:51.436 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.2417000000000006e-05 2024-04-19T03:01:51.436 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:51.436 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:01:51.436 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:51.436 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.436 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.436 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:13 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:01:51.436 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:14.999564+0000", 2024-04-19T03:01:51.437 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 36.420680283999999, 2024-04-19T03:01:51.437 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.019594777000000001, 2024-04-19T03:01:51.437 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:01:51.437 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:51.437 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:01:51.437 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.437 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:01:51.437 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999564+0000", 2024-04-19T03:01:51.437 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:51.437 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.437 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.437 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:01:51.438 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999564+0000", 2024-04-19T03:01:51.438 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:51.438 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.438 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.438 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:01:51.438 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999563+0000", 2024-04-19T03:01:51.438 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:01:51.438 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.438 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.438 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:01:51.438 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999582+0000", 2024-04-19T03:01:51.438 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8151999999999998e-05 2024-04-19T03:01:51.438 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.439 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.439 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:01:51.439 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999599+0000", 2024-04-19T03:01:51.439 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7583000000000001e-05 2024-04-19T03:01:51.439 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.439 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.439 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:01:51.439 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999618+0000", 2024-04-19T03:01:51.439 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8989999999999999e-05 2024-04-19T03:01:51.439 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.439 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.439 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:51.440 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999692+0000", 2024-04-19T03:01:51.440 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3561999999999998e-05 2024-04-19T03:01:51.440 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.440 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.440 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op must wait for map", 2024-04-19T03:01:51.440 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999698+0000", 2024-04-19T03:01:51.440 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7159999999999997e-06 2024-04-19T03:01:51.440 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.440 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.440 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:51.440 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.007836+0000", 2024-04-19T03:01:51.440 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0081376520000000004 2024-04-19T03:01:51.440 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.440 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.441 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:01:51.441 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.008208+0000", 2024-04-19T03:01:51.441 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00037223699999999998 2024-04-19T03:01:51.441 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.441 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.441 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-04-19T03:01:51.441 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.008516+0000", 2024-04-19T03:01:51.441 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000308227 2024-04-19T03:01:51.441 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.441 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.441 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:01:51.441 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.011585+0000", 2024-04-19T03:01:51.441 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0030680659999999999 2024-04-19T03:01:51.441 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.442 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.442 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:51.442 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.018871+0000", 2024-04-19T03:01:51.442 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0072861369999999998 2024-04-19T03:01:51.442 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.442 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.442 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:01:51.442 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.019067+0000", 2024-04-19T03:01:51.442 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00019672099999999999 2024-04-19T03:01:51.442 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.442 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.442 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:01:51.443 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.019159+0000", 2024-04-19T03:01:51.443 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1829999999999993e-05 2024-04-19T03:01:51.443 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:51.443 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:01:51.443 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:51.443 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.443 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.443 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:31 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:01:51.443 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:14.999649+0000", 2024-04-19T03:01:51.443 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 36.420596166000003, 2024-04-19T03:01:51.443 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.018882121000000002, 2024-04-19T03:01:51.443 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:01:51.443 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:51.443 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:01:51.444 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.444 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:01:51.444 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999649+0000", 2024-04-19T03:01:51.444 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:51.444 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.444 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.444 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:01:51.444 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999649+0000", 2024-04-19T03:01:51.444 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:51.444 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.444 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.444 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:01:51.444 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999647+0000", 2024-04-19T03:01:51.444 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:01:51.445 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.445 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.445 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:01:51.445 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999657+0000", 2024-04-19T03:01:51.445 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.3729999999999999e-06 2024-04-19T03:01:51.445 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.445 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.445 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:01:51.445 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999675+0000", 2024-04-19T03:01:51.445 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8522999999999999e-05 2024-04-19T03:01:51.445 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.445 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.446 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:01:51.446 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999689+0000", 2024-04-19T03:01:51.446 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.347e-05 2024-04-19T03:01:51.446 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.446 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.446 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:51.446 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999761+0000", 2024-04-19T03:01:51.446 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.1904999999999997e-05 2024-04-19T03:01:51.446 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.446 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.446 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:01:51.446 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999766+0000", 2024-04-19T03:01:51.446 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6069999999999998e-06 2024-04-19T03:01:51.447 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.447 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.447 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:51.447 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.010040+0000", 2024-04-19T03:01:51.447 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.010273381 2024-04-19T03:01:51.447 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.447 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.447 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:01:51.447 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.010260+0000", 2024-04-19T03:01:51.447 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00022003300000000001 2024-04-19T03:01:51.447 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.447 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.447 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-04-19T03:01:51.447 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.010415+0000", 2024-04-19T03:01:51.448 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015515599999999999 2024-04-19T03:01:51.448 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.448 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.448 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:01:51.448 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.013206+0000", 2024-04-19T03:01:51.448 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0027915010000000001 2024-04-19T03:01:51.448 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.448 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.448 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:51.448 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.018438+0000", 2024-04-19T03:01:51.448 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0052313469999999999 2024-04-19T03:01:51.448 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.448 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.448 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:01:51.448 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.018491+0000", 2024-04-19T03:01:51.449 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3554000000000003e-05 2024-04-19T03:01:51.449 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.449 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.449 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:01:51.449 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.018531+0000", 2024-04-19T03:01:51.449 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9384000000000001e-05 2024-04-19T03:01:51.449 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:51.449 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:01:51.449 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:51.449 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.449 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.449 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:32 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:01:51.449 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:14.999712+0000", 2024-04-19T03:01:51.449 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 36.420532923000003, 2024-04-19T03:01:51.449 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.022635437000000001, 2024-04-19T03:01:51.450 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:01:51.450 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:51.450 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:01:51.450 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.450 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:01:51.450 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999712+0000", 2024-04-19T03:01:51.450 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:51.450 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.450 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.450 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:01:51.450 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999712+0000", 2024-04-19T03:01:51.450 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:51.450 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.451 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.451 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:01:51.451 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999711+0000", 2024-04-19T03:01:51.451 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:01:51.451 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.451 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.451 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:01:51.451 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999719+0000", 2024-04-19T03:01:51.451 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.354e-06 2024-04-19T03:01:51.451 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.451 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.451 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:01:51.451 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999735+0000", 2024-04-19T03:01:51.451 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6288999999999999e-05 2024-04-19T03:01:51.452 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.452 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.452 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:01:51.452 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999749+0000", 2024-04-19T03:01:51.452 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3492999999999999e-05 2024-04-19T03:01:51.452 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.452 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.452 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:51.452 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999811+0000", 2024-04-19T03:01:51.452 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2298999999999994e-05 2024-04-19T03:01:51.452 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.452 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.452 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:01:51.452 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999817+0000", 2024-04-19T03:01:51.452 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2169999999999999e-06 2024-04-19T03:01:51.453 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.453 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.453 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:51.453 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.011836+0000", 2024-04-19T03:01:51.453 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.012018008 2024-04-19T03:01:51.453 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.453 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.453 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:01:51.453 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.011897+0000", 2024-04-19T03:01:51.453 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1111000000000005e-05 2024-04-19T03:01:51.453 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.453 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.453 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-04-19T03:01:51.453 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.011980+0000", 2024-04-19T03:01:51.454 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3003999999999993e-05 2024-04-19T03:01:51.454 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.454 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.454 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:01:51.454 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.013863+0000", 2024-04-19T03:01:51.454 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001883804 2024-04-19T03:01:51.454 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.454 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.454 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:51.454 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.022257+0000", 2024-04-19T03:01:51.454 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0083938290000000002 2024-04-19T03:01:51.454 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.454 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.455 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:01:51.455 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.022310+0000", 2024-04-19T03:01:51.455 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.236e-05 2024-04-19T03:01:51.455 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.455 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.455 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:01:51.455 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.022347+0000", 2024-04-19T03:01:51.455 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7653e-05 2024-04-19T03:01:51.455 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:51.455 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:01:51.455 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:51.455 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.455 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.456 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:35 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:01:51.456 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:14.999772+0000", 2024-04-19T03:01:51.456 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 36.420472644, 2024-04-19T03:01:51.456 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020205530999999999, 2024-04-19T03:01:51.456 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:01:51.456 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:51.456 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:01:51.456 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.456 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:01:51.456 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999772+0000", 2024-04-19T03:01:51.456 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:51.456 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.456 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.457 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:01:51.457 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999772+0000", 2024-04-19T03:01:51.457 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:51.457 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.457 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.457 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:01:51.457 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999771+0000", 2024-04-19T03:01:51.457 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:01:51.457 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.457 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.457 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:01:51.457 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999778+0000", 2024-04-19T03:01:51.457 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2200000000000003e-06 2024-04-19T03:01:51.457 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.457 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.458 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:01:51.458 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999794+0000", 2024-04-19T03:01:51.458 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5798999999999999e-05 2024-04-19T03:01:51.458 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.458 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.458 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:01:51.458 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999809+0000", 2024-04-19T03:01:51.458 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.469e-05 2024-04-19T03:01:51.458 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.458 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.458 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:51.458 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999915+0000", 2024-04-19T03:01:51.458 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000105658 2024-04-19T03:01:51.459 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.459 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.459 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:01:51.459 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999927+0000", 2024-04-19T03:01:51.459 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.201e-05 2024-04-19T03:01:51.459 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.459 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.459 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:51.459 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.009841+0000", 2024-04-19T03:01:51.459 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0099147039999999999 2024-04-19T03:01:51.459 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.459 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.459 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:01:51.459 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.009941+0000", 2024-04-19T03:01:51.459 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.9461000000000002e-05 2024-04-19T03:01:51.460 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.460 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.460 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-04-19T03:01:51.460 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.010101+0000", 2024-04-19T03:01:51.460 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016028599999999999 2024-04-19T03:01:51.460 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.460 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.460 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:01:51.460 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.011787+0000", 2024-04-19T03:01:51.460 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001685513 2024-04-19T03:01:51.460 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.460 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.460 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:51.460 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.019889+0000", 2024-04-19T03:01:51.461 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0081026559999999997 2024-04-19T03:01:51.461 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.461 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.461 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:01:51.461 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.019932+0000", 2024-04-19T03:01:51.461 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2385000000000002e-05 2024-04-19T03:01:51.461 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.461 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.461 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:01:51.461 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.019978+0000", 2024-04-19T03:01:51.461 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6093000000000001e-05 2024-04-19T03:01:51.461 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:51.461 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:01:51.461 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:51.462 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.462 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.462 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:18 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:01:51.462 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:14.999834+0000", 2024-04-19T03:01:51.462 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 36.420410558999997, 2024-04-19T03:01:51.462 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.019567312999999999, 2024-04-19T03:01:51.462 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:01:51.462 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:51.462 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:01:51.462 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.462 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:01:51.462 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999834+0000", 2024-04-19T03:01:51.462 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:51.463 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.463 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.463 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:01:51.463 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999834+0000", 2024-04-19T03:01:51.463 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:51.463 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.463 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.463 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:01:51.463 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999833+0000", 2024-04-19T03:01:51.463 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:01:51.463 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.463 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.463 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:01:51.464 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999842+0000", 2024-04-19T03:01:51.464 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.2269999999999999e-06 2024-04-19T03:01:51.464 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.464 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.464 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:01:51.464 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999860+0000", 2024-04-19T03:01:51.464 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8456000000000001e-05 2024-04-19T03:01:51.464 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.464 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.464 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:01:51.464 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999874+0000", 2024-04-19T03:01:51.464 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3263e-05 2024-04-19T03:01:51.465 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.465 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.465 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:51.465 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999934+0000", 2024-04-19T03:01:51.465 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0888999999999999e-05 2024-04-19T03:01:51.465 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.465 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.465 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:01:51.465 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999940+0000", 2024-04-19T03:01:51.465 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4330000000000003e-06 2024-04-19T03:01:51.465 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.465 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.466 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:51.466 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.010943+0000", 2024-04-19T03:01:51.466 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011002786000000001 2024-04-19T03:01:51.466 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.466 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.466 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:01:51.466 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.011078+0000", 2024-04-19T03:01:51.466 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013541000000000001 2024-04-19T03:01:51.466 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.466 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.466 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-04-19T03:01:51.466 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.011172+0000", 2024-04-19T03:01:51.466 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.3459000000000001e-05 2024-04-19T03:01:51.467 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.467 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.467 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:01:51.467 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.013211+0000", 2024-04-19T03:01:51.467 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0020397710000000001 2024-04-19T03:01:51.467 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.467 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.467 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:51.467 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.019320+0000", 2024-04-19T03:01:51.467 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0061089969999999997 2024-04-19T03:01:51.467 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.467 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.468 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:01:51.468 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.019364+0000", 2024-04-19T03:01:51.468 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4158e-05 2024-04-19T03:01:51.468 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.468 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.468 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:01:51.468 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.019402+0000", 2024-04-19T03:01:51.468 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7011000000000002e-05 2024-04-19T03:01:51.468 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:51.468 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:01:51.468 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:51.468 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.468 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.469 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:21 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:01:51.469 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:14.999896+0000", 2024-04-19T03:01:51.469 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 36.420348740000001, 2024-04-19T03:01:51.469 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.018618866000000001, 2024-04-19T03:01:51.469 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:01:51.469 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-19T03:01:51.469 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:01:51.469 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.469 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:01:51.469 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999896+0000", 2024-04-19T03:01:51.469 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:51.469 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.470 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.470 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:01:51.470 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999896+0000", 2024-04-19T03:01:51.470 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:51.470 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.470 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.470 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:01:51.470 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999895+0000", 2024-04-19T03:01:51.470 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:01:51.470 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.470 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.470 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:01:51.471 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999901+0000", 2024-04-19T03:01:51.471 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4529999999999999e-06 2024-04-19T03:01:51.471 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.471 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.471 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:01:51.471 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999918+0000", 2024-04-19T03:01:51.471 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6897000000000001e-05 2024-04-19T03:01:51.471 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.471 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.471 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:01:51.471 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999931+0000", 2024-04-19T03:01:51.471 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.309e-05 2024-04-19T03:01:51.471 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.471 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.471 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:51.472 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.000027+0000", 2024-04-19T03:01:51.472 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.5880999999999999e-05 2024-04-19T03:01:51.472 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.472 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.472 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op must wait for map", 2024-04-19T03:01:51.472 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.000040+0000", 2024-04-19T03:01:51.472 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3083e-05 2024-04-19T03:01:51.472 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.472 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.472 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:51.472 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.004961+0000", 2024-04-19T03:01:51.472 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0049206079999999999 2024-04-19T03:01:51.472 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.472 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.473 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:01:51.473 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.005261+0000", 2024-04-19T03:01:51.473 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00030041699999999998 2024-04-19T03:01:51.473 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.473 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.473 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:01:51.473 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.018515+0000", 2024-04-19T03:01:51.473 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013253534000000001 2024-04-19T03:01:51.473 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:51.473 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:01:51.473 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:51.473 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.473 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.473 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:24 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:01:51.474 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:14.999964+0000", 2024-04-19T03:01:51.474 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 36.420281244999998, 2024-04-19T03:01:51.474 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020451446000000002, 2024-04-19T03:01:51.474 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:01:51.474 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-19T03:01:51.474 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:01:51.474 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.474 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:01:51.474 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999964+0000", 2024-04-19T03:01:51.474 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:51.474 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.475 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.475 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:01:51.475 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999964+0000", 2024-04-19T03:01:51.475 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:51.475 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.475 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.475 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:01:51.475 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999963+0000", 2024-04-19T03:01:51.475 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:01:51.475 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.475 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.475 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:01:51.475 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999969+0000", 2024-04-19T03:01:51.476 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0270000000000001e-06 2024-04-19T03:01:51.476 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.476 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.476 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:01:51.476 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999984+0000", 2024-04-19T03:01:51.476 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5903e-05 2024-04-19T03:01:51.476 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.476 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.476 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:01:51.476 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999998+0000", 2024-04-19T03:01:51.476 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3076e-05 2024-04-19T03:01:51.476 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.476 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.477 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:51.477 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.000078+0000", 2024-04-19T03:01:51.477 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0525000000000006e-05 2024-04-19T03:01:51.477 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.477 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.477 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op must wait for map", 2024-04-19T03:01:51.477 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.000084+0000", 2024-04-19T03:01:51.477 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8370000000000002e-06 2024-04-19T03:01:51.477 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.477 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.477 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:51.477 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.008819+0000", 2024-04-19T03:01:51.477 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0087349019999999993 2024-04-19T03:01:51.477 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.478 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.478 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:01:51.478 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.009018+0000", 2024-04-19T03:01:51.478 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000198989 2024-04-19T03:01:51.478 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.478 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.478 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:01:51.478 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.020415+0000", 2024-04-19T03:01:51.478 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011397157 2024-04-19T03:01:51.478 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:51.478 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:01:51.478 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:51.478 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.478 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.479 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:3790 5.d 5:b1320d9c:::benchmark_data_smithi096_19531_object3789:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-19T03:01:51.479 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:39.208695+0000", 2024-04-19T03:01:51.479 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 12.211549515, 2024-04-19T03:01:51.479 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015283936999999999, 2024-04-19T03:01:51.479 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:01:51.479 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:51.479 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:01:51.479 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:01:51.479 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:51.479 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3790 2024-04-19T03:01:51.479 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.479 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:01:51.479 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.480 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:01:51.480 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:39.208695+0000", 2024-04-19T03:01:51.480 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:51.480 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.480 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.480 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:01:51.480 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:39.208695+0000", 2024-04-19T03:01:51.480 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:51.480 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.480 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.480 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:01:51.480 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:39.208694+0000", 2024-04-19T03:01:51.480 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:01:51.480 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.481 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.481 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:01:51.481 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:39.208738+0000", 2024-04-19T03:01:51.481 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3562000000000001e-05 2024-04-19T03:01:51.481 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.481 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.481 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:01:51.481 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:39.208749+0000", 2024-04-19T03:01:51.481 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1505000000000001e-05 2024-04-19T03:01:51.481 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.481 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.481 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:01:51.481 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:39.208759+0000", 2024-04-19T03:01:51.482 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0288999999999999e-05 2024-04-19T03:01:51.482 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.482 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.482 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:51.482 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:39.212745+0000", 2024-04-19T03:01:51.482 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0039855669999999998 2024-04-19T03:01:51.482 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.482 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.482 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:01:51.482 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:39.212900+0000", 2024-04-19T03:01:51.482 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000154568 2024-04-19T03:01:51.482 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.482 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.483 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-04-19T03:01:51.483 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:39.213027+0000", 2024-04-19T03:01:51.483 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000127565 2024-04-19T03:01:51.483 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.483 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.483 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:01:51.483 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:39.215729+0000", 2024-04-19T03:01:51.483 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0027014280000000001 2024-04-19T03:01:51.483 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.483 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.483 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:51.483 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:39.223889+0000", 2024-04-19T03:01:51.483 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0081604650000000004 2024-04-19T03:01:51.484 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.484 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.484 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:01:51.484 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:39.223940+0000", 2024-04-19T03:01:51.484 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1446999999999997e-05 2024-04-19T03:01:51.484 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.484 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.484 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:01:51.484 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:39.223979+0000", 2024-04-19T03:01:51.484 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8748000000000002e-05 2024-04-19T03:01:51.484 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:51.484 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:01:51.484 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:51.485 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.485 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.485 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:3794 5.d 5:be7b5d22:::benchmark_data_smithi096_19531_object3793:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-19T03:01:51.485 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:39.209221+0000", 2024-04-19T03:01:51.485 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 12.211024111, 2024-04-19T03:01:51.485 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015746540999999999, 2024-04-19T03:01:51.485 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:01:51.485 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:51.485 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:01:51.485 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:01:51.485 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:51.485 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 3794 2024-04-19T03:01:51.485 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.486 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:01:51.486 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.486 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:01:51.486 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:39.209221+0000", 2024-04-19T03:01:51.486 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:51.486 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.486 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.486 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:01:51.486 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:39.209221+0000", 2024-04-19T03:01:51.486 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:51.486 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.486 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.486 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:01:51.487 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:39.209220+0000", 2024-04-19T03:01:51.487 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:01:51.487 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.487 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.487 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:01:51.487 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:39.209352+0000", 2024-04-19T03:01:51.487 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013184399999999999 2024-04-19T03:01:51.487 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.487 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.487 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:01:51.487 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:39.209369+0000", 2024-04-19T03:01:51.487 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7651000000000001e-05 2024-04-19T03:01:51.487 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.487 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.488 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:01:51.488 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:39.209378+0000", 2024-04-19T03:01:51.488 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9870000000000005e-06 2024-04-19T03:01:51.488 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.488 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.488 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:51.488 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:39.214226+0000", 2024-04-19T03:01:51.488 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0048477579999999998 2024-04-19T03:01:51.488 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.488 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.488 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:01:51.488 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:39.214431+0000", 2024-04-19T03:01:51.488 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00020539899999999999 2024-04-19T03:01:51.488 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.489 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.489 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-04-19T03:01:51.489 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:39.214639+0000", 2024-04-19T03:01:51.489 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00020784500000000001 2024-04-19T03:01:51.489 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.489 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.489 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:01:51.489 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:39.216765+0000", 2024-04-19T03:01:51.489 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.002125198 2024-04-19T03:01:51.489 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.489 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.489 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:51.489 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:39.224861+0000", 2024-04-19T03:01:51.489 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0080968480000000002 2024-04-19T03:01:51.490 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.490 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.490 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:01:51.490 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:39.224914+0000", 2024-04-19T03:01:51.490 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2463000000000002e-05 2024-04-19T03:01:51.490 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.490 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.490 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:01:51.490 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:39.224967+0000", 2024-04-19T03:01:51.490 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3368000000000001e-05 2024-04-19T03:01:51.490 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:51.490 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:01:51.490 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:51.490 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.491 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.491 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:11274 5.e 5:7c846032:::benchmark_data_smithi096_19531_object11273:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T03:01:51.491 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:42.061776+0000", 2024-04-19T03:01:51.491 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 9.3584689999999995, 2024-04-19T03:01:51.491 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.035381001000000002, 2024-04-19T03:01:51.491 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:01:51.491 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:51.491 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:01:51.491 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:01:51.491 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:51.491 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 11274 2024-04-19T03:01:51.491 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.491 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:01:51.491 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.491 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:01:51.492 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.061776+0000", 2024-04-19T03:01:51.492 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:51.492 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.492 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.492 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:01:51.492 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.061776+0000", 2024-04-19T03:01:51.492 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:51.492 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.492 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.492 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:01:51.492 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.061775+0000", 2024-04-19T03:01:51.492 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:01:51.492 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.493 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.493 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:01:51.493 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.061807+0000", 2024-04-19T03:01:51.493 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1733000000000003e-05 2024-04-19T03:01:51.493 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.493 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.493 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:01:51.493 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.061822+0000", 2024-04-19T03:01:51.493 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5452999999999999e-05 2024-04-19T03:01:51.493 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.493 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.493 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:01:51.493 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.061827+0000", 2024-04-19T03:01:51.493 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9810000000000003e-06 2024-04-19T03:01:51.494 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.494 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.494 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:51.494 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.063388+0000", 2024-04-19T03:01:51.494 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0015605720000000001 2024-04-19T03:01:51.494 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.494 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.494 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:01:51.494 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.063612+0000", 2024-04-19T03:01:51.494 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00022431 2024-04-19T03:01:51.494 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.494 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.494 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:01:51.495 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.063747+0000", 2024-04-19T03:01:51.495 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013459600000000001 2024-04-19T03:01:51.495 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.495 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.495 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:01:51.495 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.066186+0000", 2024-04-19T03:01:51.495 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0024388909999999999 2024-04-19T03:01:51.495 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.495 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.495 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:51.495 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.097016+0000", 2024-04-19T03:01:51.495 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.030830705 2024-04-19T03:01:51.495 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.495 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.496 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:01:51.496 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.097096+0000", 2024-04-19T03:01:51.496 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.9469999999999996e-05 2024-04-19T03:01:51.496 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.496 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.496 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:01:51.496 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.097157+0000", 2024-04-19T03:01:51.496 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0884999999999997e-05 2024-04-19T03:01:51.496 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:51.496 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:01:51.496 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:51.496 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.496 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.496 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:11279 5.8 5:10b60c58:::benchmark_data_smithi096_19531_object11278:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T03:01:51.497 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:42.062594+0000", 2024-04-19T03:01:51.497 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 9.3576505619999999, 2024-04-19T03:01:51.497 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.028696788000000001, 2024-04-19T03:01:51.497 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:01:51.497 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:51.497 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:01:51.497 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:01:51.497 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:51.497 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 11279 2024-04-19T03:01:51.497 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.497 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:01:51.497 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.497 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:01:51.498 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.062594+0000", 2024-04-19T03:01:51.498 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:51.498 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.498 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.498 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:01:51.498 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.062594+0000", 2024-04-19T03:01:51.498 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:51.498 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.498 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.498 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:01:51.498 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.062593+0000", 2024-04-19T03:01:51.499 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:01:51.499 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.499 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.499 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:01:51.499 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.062646+0000", 2024-04-19T03:01:51.499 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2293999999999998e-05 2024-04-19T03:01:51.499 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.499 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.499 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:01:51.499 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.062657+0000", 2024-04-19T03:01:51.499 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1440000000000001e-05 2024-04-19T03:01:51.499 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.499 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.500 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:01:51.500 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.062665+0000", 2024-04-19T03:01:51.500 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5159999999999997e-06 2024-04-19T03:01:51.500 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.500 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.500 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:51.500 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.063799+0000", 2024-04-19T03:01:51.500 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0011344860000000001 2024-04-19T03:01:51.500 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.500 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.500 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:01:51.500 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.063962+0000", 2024-04-19T03:01:51.500 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000162614 2024-04-19T03:01:51.500 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.501 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.501 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:01:51.501 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.064167+0000", 2024-04-19T03:01:51.501 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00020491699999999999 2024-04-19T03:01:51.501 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.501 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.501 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:01:51.501 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.066768+0000", 2024-04-19T03:01:51.501 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0026012090000000002 2024-04-19T03:01:51.501 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.501 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.501 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:51.501 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.091184+0000", 2024-04-19T03:01:51.502 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.024416582999999999 2024-04-19T03:01:51.502 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.502 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.502 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:01:51.502 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.091251+0000", 2024-04-19T03:01:51.502 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6753000000000003e-05 2024-04-19T03:01:51.502 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.502 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.502 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:01:51.502 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.091291+0000", 2024-04-19T03:01:51.502 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9841e-05 2024-04-19T03:01:51.502 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:51.502 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:01:51.503 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:51.503 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.503 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.503 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:11282 5.e 5:75b7c510:::benchmark_data_smithi096_19531_object11281:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T03:01:51.503 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:42.062674+0000", 2024-04-19T03:01:51.503 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 9.357571106, 2024-04-19T03:01:51.503 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.034812849, 2024-04-19T03:01:51.503 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:01:51.503 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:51.503 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:01:51.503 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:01:51.503 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:51.503 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 11282 2024-04-19T03:01:51.503 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.504 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:01:51.504 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.504 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:01:51.504 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.062674+0000", 2024-04-19T03:01:51.504 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:51.504 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.504 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.504 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:01:51.504 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.062674+0000", 2024-04-19T03:01:51.504 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:51.504 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.504 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.504 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:01:51.505 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.062673+0000", 2024-04-19T03:01:51.505 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:01:51.505 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.505 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.505 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:01:51.505 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.062712+0000", 2024-04-19T03:01:51.505 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9341999999999997e-05 2024-04-19T03:01:51.505 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.505 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.505 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:01:51.505 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.062721+0000", 2024-04-19T03:01:51.505 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1700000000000003e-06 2024-04-19T03:01:51.505 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.506 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.506 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:01:51.506 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.062729+0000", 2024-04-19T03:01:51.506 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4240000000000004e-06 2024-04-19T03:01:51.506 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.506 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.506 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:51.506 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.065017+0000", 2024-04-19T03:01:51.506 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0022878590000000002 2024-04-19T03:01:51.506 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.506 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.506 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:01:51.507 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.065207+0000", 2024-04-19T03:01:51.507 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000190411 2024-04-19T03:01:51.507 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.507 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.507 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:01:51.507 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.065323+0000", 2024-04-19T03:01:51.507 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000115593 2024-04-19T03:01:51.507 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.507 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.507 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:01:51.507 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.069683+0000", 2024-04-19T03:01:51.507 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0043604409999999996 2024-04-19T03:01:51.507 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.507 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.507 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:51.508 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.097273+0000", 2024-04-19T03:01:51.508 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.027589516000000001 2024-04-19T03:01:51.508 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.508 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.508 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:01:51.508 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.097406+0000", 2024-04-19T03:01:51.508 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000133514 2024-04-19T03:01:51.508 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.508 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.508 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:01:51.508 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.097486+0000", 2024-04-19T03:01:51.508 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0479e-05 2024-04-19T03:01:51.508 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:51.508 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:01:51.509 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:51.509 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.509 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.509 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:11288 5.0 5:042458d0:::benchmark_data_smithi096_19531_object11287:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T03:01:51.509 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:42.070352+0000", 2024-04-19T03:01:51.509 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 9.3498931780000003, 2024-04-19T03:01:51.509 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.021532447, 2024-04-19T03:01:51.509 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:01:51.509 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:51.509 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:01:51.509 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:01:51.509 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:51.509 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 11288 2024-04-19T03:01:51.510 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.510 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:01:51.510 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.510 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:01:51.510 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.070352+0000", 2024-04-19T03:01:51.510 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:51.510 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.510 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.510 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:01:51.510 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.070352+0000", 2024-04-19T03:01:51.510 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:51.510 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.510 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.511 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:01:51.511 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.070351+0000", 2024-04-19T03:01:51.511 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:01:51.511 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.511 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.511 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:01:51.511 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.070392+0000", 2024-04-19T03:01:51.511 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1077e-05 2024-04-19T03:01:51.511 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.511 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.511 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:01:51.511 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.070398+0000", 2024-04-19T03:01:51.511 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1109999999999996e-06 2024-04-19T03:01:51.512 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.512 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.512 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:01:51.512 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.070402+0000", 2024-04-19T03:01:51.512 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2010000000000001e-06 2024-04-19T03:01:51.512 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.512 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.512 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:51.512 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.070445+0000", 2024-04-19T03:01:51.512 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2585e-05 2024-04-19T03:01:51.512 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.512 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.512 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:01:51.513 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.070572+0000", 2024-04-19T03:01:51.513 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012708500000000001 2024-04-19T03:01:51.513 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.513 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.513 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:01:51.513 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.070711+0000", 2024-04-19T03:01:51.513 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013848699999999999 2024-04-19T03:01:51.513 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.513 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.513 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:01:51.513 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.073505+0000", 2024-04-19T03:01:51.513 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0027944620000000002 2024-04-19T03:01:51.513 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.514 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.514 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:51.514 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.091806+0000", 2024-04-19T03:01:51.514 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.018301251000000001 2024-04-19T03:01:51.514 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.514 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.514 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:01:51.514 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.091854+0000", 2024-04-19T03:01:51.514 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7419000000000001e-05 2024-04-19T03:01:51.514 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.514 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.514 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:01:51.514 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.091884+0000", 2024-04-19T03:01:51.515 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0241999999999999e-05 2024-04-19T03:01:51.515 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:51.515 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:01:51.515 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:51.515 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.515 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.515 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:11292 5.0 5:009b2ea9:::benchmark_data_smithi096_19531_object11291:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T03:01:51.515 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:42.070676+0000", 2024-04-19T03:01:51.515 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 9.3495688030000004, 2024-04-19T03:01:51.515 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.02219631, 2024-04-19T03:01:51.515 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:01:51.515 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:51.516 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:01:51.516 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:01:51.516 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:51.516 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 11292 2024-04-19T03:01:51.516 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.516 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:01:51.516 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.516 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:01:51.516 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.070676+0000", 2024-04-19T03:01:51.516 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:51.516 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.516 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.516 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:01:51.516 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.070676+0000", 2024-04-19T03:01:51.517 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:51.517 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.517 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.517 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:01:51.517 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.070675+0000", 2024-04-19T03:01:51.517 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:01:51.517 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.517 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.517 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:01:51.517 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.070800+0000", 2024-04-19T03:01:51.517 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000125263 2024-04-19T03:01:51.517 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.517 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.517 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:01:51.518 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.070808+0000", 2024-04-19T03:01:51.518 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0209999999999999e-06 2024-04-19T03:01:51.518 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.518 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.518 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:01:51.518 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.070814+0000", 2024-04-19T03:01:51.518 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0969999999999996e-06 2024-04-19T03:01:51.518 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.518 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.518 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:51.518 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.071956+0000", 2024-04-19T03:01:51.518 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0011427480000000001 2024-04-19T03:01:51.518 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.519 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.519 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:01:51.519 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.072153+0000", 2024-04-19T03:01:51.519 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000196524 2024-04-19T03:01:51.519 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.519 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.519 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:01:51.519 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.072312+0000", 2024-04-19T03:01:51.519 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015879300000000001 2024-04-19T03:01:51.519 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.519 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.520 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:01:51.520 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.078407+0000", 2024-04-19T03:01:51.520 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0060954929999999996 2024-04-19T03:01:51.520 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.520 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.520 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:51.520 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.092742+0000", 2024-04-19T03:01:51.520 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.014335349000000001 2024-04-19T03:01:51.520 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.520 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.520 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:01:51.520 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.092815+0000", 2024-04-19T03:01:51.521 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2881999999999998e-05 2024-04-19T03:01:51.521 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.521 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.521 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:01:51.521 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.092872+0000", 2024-04-19T03:01:51.521 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6965000000000001e-05 2024-04-19T03:01:51.521 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:51.521 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:01:51.521 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:51.521 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.521 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.521 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:11297 5.e 5:7975ecb6:::benchmark_data_smithi096_19531_object11296:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T03:01:51.521 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:42.076848+0000", 2024-04-19T03:01:51.522 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 9.3433969230000002, 2024-04-19T03:01:51.522 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020867969, 2024-04-19T03:01:51.522 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:01:51.522 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:51.522 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:01:51.522 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:01:51.522 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:51.522 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 11297 2024-04-19T03:01:51.522 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.522 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:01:51.522 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.522 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:01:51.523 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.076848+0000", 2024-04-19T03:01:51.523 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:51.523 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.523 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.523 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:01:51.523 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.076848+0000", 2024-04-19T03:01:51.523 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:51.523 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.523 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.523 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:01:51.523 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.076846+0000", 2024-04-19T03:01:51.523 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:01:51.523 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.523 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.524 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:01:51.524 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.076894+0000", 2024-04-19T03:01:51.524 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7645000000000002e-05 2024-04-19T03:01:51.524 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.524 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.524 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:01:51.524 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.076913+0000", 2024-04-19T03:01:51.524 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8885e-05 2024-04-19T03:01:51.524 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.524 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.524 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:01:51.524 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.076924+0000", 2024-04-19T03:01:51.524 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.118e-05 2024-04-19T03:01:51.524 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.524 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.525 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:51.525 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.076983+0000", 2024-04-19T03:01:51.525 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8952000000000001e-05 2024-04-19T03:01:51.525 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.525 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.525 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:01:51.525 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.077156+0000", 2024-04-19T03:01:51.525 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00017307600000000001 2024-04-19T03:01:51.525 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.525 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.525 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:01:51.525 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.077358+0000", 2024-04-19T03:01:51.525 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000201991 2024-04-19T03:01:51.526 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.526 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.526 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:01:51.526 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.080885+0000", 2024-04-19T03:01:51.526 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0035268309999999998 2024-04-19T03:01:51.526 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.526 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.526 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:51.526 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.097569+0000", 2024-04-19T03:01:51.526 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.016683854000000001 2024-04-19T03:01:51.526 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.526 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.526 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:01:51.527 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.097647+0000", 2024-04-19T03:01:51.527 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.7823000000000004e-05 2024-04-19T03:01:51.527 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.527 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.527 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:01:51.527 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.097716+0000", 2024-04-19T03:01:51.527 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.9079999999999996e-05 2024-04-19T03:01:51.527 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:51.527 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:01:51.527 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:51.527 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.527 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.527 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:11298 5.e 5:72565f0a:::benchmark_data_smithi096_19531_object11297:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T03:01:51.528 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:42.076954+0000", 2024-04-19T03:01:51.528 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 9.3432910489999994, 2024-04-19T03:01:51.528 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020950191999999999, 2024-04-19T03:01:51.528 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:01:51.528 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:51.528 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:01:51.528 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:01:51.528 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:51.528 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 11298 2024-04-19T03:01:51.528 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.528 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:01:51.528 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.529 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:01:51.529 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.076954+0000", 2024-04-19T03:01:51.529 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:51.529 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.529 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.529 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:01:51.529 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.076954+0000", 2024-04-19T03:01:51.529 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:51.529 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.529 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.529 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:01:51.529 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.076953+0000", 2024-04-19T03:01:51.529 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:01:51.530 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.530 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.530 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:01:51.530 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.076997+0000", 2024-04-19T03:01:51.530 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4023000000000002e-05 2024-04-19T03:01:51.530 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.530 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.530 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:01:51.530 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.077009+0000", 2024-04-19T03:01:51.530 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2456000000000001e-05 2024-04-19T03:01:51.530 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.530 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.530 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:01:51.531 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.077015+0000", 2024-04-19T03:01:51.531 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7950000000000004e-06 2024-04-19T03:01:51.531 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.531 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.531 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:51.531 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.078552+0000", 2024-04-19T03:01:51.531 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0015371320000000001 2024-04-19T03:01:51.531 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.531 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.531 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:01:51.531 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.078760+0000", 2024-04-19T03:01:51.531 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00020808799999999999 2024-04-19T03:01:51.532 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.532 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.532 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:01:51.532 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.078875+0000", 2024-04-19T03:01:51.532 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011457500000000001 2024-04-19T03:01:51.532 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.532 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.532 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:01:51.532 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.083603+0000", 2024-04-19T03:01:51.532 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0047276239999999997 2024-04-19T03:01:51.532 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.532 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.532 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:51.532 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.097783+0000", 2024-04-19T03:01:51.533 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.014180036 2024-04-19T03:01:51.533 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.533 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.533 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:01:51.533 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.097863+0000", 2024-04-19T03:01:51.533 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0317999999999999e-05 2024-04-19T03:01:51.533 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.533 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.533 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:01:51.533 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.097904+0000", 2024-04-19T03:01:51.533 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1035000000000003e-05 2024-04-19T03:01:51.533 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:51.533 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:01:51.534 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:51.534 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.534 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.534 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4755.0:24536 5.9 e27/22 5:9b1ba70d:::benchmark_data_smithi096_19531_object24535:head v 27'1502, mlcod=27'1498)", 2024-04-19T03:01:51.534 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:47.560148+0000", 2024-04-19T03:01:51.534 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 3.8600971930000001, 2024-04-19T03:01:51.534 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015234558, 2024-04-19T03:01:51.534 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:01:51.534 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:51.534 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:01:51.534 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.535 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:01:51.535 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:47.560148+0000", 2024-04-19T03:01:51.535 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:51.535 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.535 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.535 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:01:51.535 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:47.560148+0000", 2024-04-19T03:01:51.535 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:51.535 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.535 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.535 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:01:51.535 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:47.560147+0000", 2024-04-19T03:01:51.536 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:01:51.536 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.536 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.536 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:01:51.536 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:47.560273+0000", 2024-04-19T03:01:51.536 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000126074 2024-04-19T03:01:51.536 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.536 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.536 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:01:51.536 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:47.560282+0000", 2024-04-19T03:01:51.536 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.5699999999999999e-06 2024-04-19T03:01:51.536 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.536 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.537 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:01:51.537 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:47.560289+0000", 2024-04-19T03:01:51.537 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5309999999999998e-06 2024-04-19T03:01:51.537 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.537 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.537 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:51.537 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:47.560901+0000", 2024-04-19T03:01:51.537 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00061193 2024-04-19T03:01:51.537 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.537 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.537 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:01:51.537 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:47.560927+0000", 2024-04-19T03:01:51.537 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5596999999999999e-05 2024-04-19T03:01:51.538 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.538 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.538 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:01:51.538 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:47.575325+0000", 2024-04-19T03:01:51.538 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.014398097 2024-04-19T03:01:51.538 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.538 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.538 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:01:51.538 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:47.575382+0000", 2024-04-19T03:01:51.538 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7479000000000003e-05 2024-04-19T03:01:51.538 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:51.538 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:01:51.539 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:51.539 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.539 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.539 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:26355 5.d 5:ba5fabd5:::benchmark_data_smithi096_19531_object26354:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e28)", 2024-04-19T03:01:51.539 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:48.365219+0000", 2024-04-19T03:01:51.539 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 3.055026094, 2024-04-19T03:01:51.539 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015632889000000001, 2024-04-19T03:01:51.539 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:01:51.539 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:51.539 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:01:51.539 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:01:51.539 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:51.539 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 26355 2024-04-19T03:01:51.540 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.540 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:01:51.540 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.540 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:01:51.540 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:48.365219+0000", 2024-04-19T03:01:51.540 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:51.540 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.540 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.540 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:01:51.540 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:48.365219+0000", 2024-04-19T03:01:51.540 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:51.540 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.540 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.541 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:01:51.541 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:48.365218+0000", 2024-04-19T03:01:51.541 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:01:51.541 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.541 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.541 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:01:51.541 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:48.365364+0000", 2024-04-19T03:01:51.541 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014625799999999999 2024-04-19T03:01:51.541 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.541 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.541 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:01:51.541 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:48.365377+0000", 2024-04-19T03:01:51.541 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3149000000000001e-05 2024-04-19T03:01:51.541 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.542 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.542 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:01:51.542 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:48.365385+0000", 2024-04-19T03:01:51.542 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.7600000000000002e-06 2024-04-19T03:01:51.542 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.542 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.542 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:51.542 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:48.372580+0000", 2024-04-19T03:01:51.542 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0071954339999999997 2024-04-19T03:01:51.542 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.542 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.542 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:01:51.543 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:48.372862+0000", 2024-04-19T03:01:51.543 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00028161899999999999 2024-04-19T03:01:51.543 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.543 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.543 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-04-19T03:01:51.543 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:48.373055+0000", 2024-04-19T03:01:51.543 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00019343299999999999 2024-04-19T03:01:51.543 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.543 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.543 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:51.543 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:48.377481+0000", 2024-04-19T03:01:51.543 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0044251580000000002 2024-04-19T03:01:51.543 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.543 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.544 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:01:51.544 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:48.380795+0000", 2024-04-19T03:01:51.544 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0033143890000000001 2024-04-19T03:01:51.544 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.544 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.544 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:01:51.544 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:48.380828+0000", 2024-04-19T03:01:51.544 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3081999999999999e-05 2024-04-19T03:01:51.544 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:51.544 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:51.544 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:01:51.544 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:48.380852+0000", 2024-04-19T03:01:51.544 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3527999999999999e-05 2024-04-19T03:01:51.545 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:51.545 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:01:51.545 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:51.545 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:51.545 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:01:51.545 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-19T03:01:51.547 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T03:01:51.547 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:01:51.544+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:01:51.647 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:01:51.644+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:01:51.678 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-04-19T03:01:51.678 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [ 2024-04-19T03:01:51.679 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:51.679 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:33595 5.1 5:84bd5a87:::benchmark_data_smithi096_19531_object33594:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-19T03:01:51.679 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:01:51.670608+0000", 2024-04-19T03:01:51.679 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0054720120000000001, 2024-04-19T03:01:51.679 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.005501428, 2024-04-19T03:01:51.679 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:01:51.679 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:01:51.679 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:01:51.679 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:01:51.679 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:51.679 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 33595 2024-04-19T03:01:51.679 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:51.679 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:01:51.680 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:51.680 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:01:51.680 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:51.670608+0000", 2024-04-19T03:01:51.680 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:51.680 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:51.680 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:51.680 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:01:51.680 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:51.670608+0000", 2024-04-19T03:01:51.680 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:51.680 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:51.680 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:51.680 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:01:51.680 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:51.670607+0000", 2024-04-19T03:01:51.680 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:01:51.681 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:51.681 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:51.681 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:01:51.681 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:51.670681+0000", 2024-04-19T03:01:51.681 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4723999999999998e-05 2024-04-19T03:01:51.681 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:51.681 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:51.681 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:01:51.681 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:51.670692+0000", 2024-04-19T03:01:51.681 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.077e-05 2024-04-19T03:01:51.681 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:51.681 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:51.681 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:01:51.681 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:51.670699+0000", 2024-04-19T03:01:51.682 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.533e-06 2024-04-19T03:01:51.682 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:51.682 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:51.682 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:01:51.682 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:51.674276+0000", 2024-04-19T03:01:51.682 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0035772099999999999 2024-04-19T03:01:51.682 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:51.682 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:51.682 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:01:51.682 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:51.674407+0000", 2024-04-19T03:01:51.682 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00013109999999999999 2024-04-19T03:01:51.682 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:51.682 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:51.683 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-04-19T03:01:51.683 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:51.674602+0000", 2024-04-19T03:01:51.683 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00019473200000000001 2024-04-19T03:01:51.683 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:51.683 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:01:51.683 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:51.683 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:51.683 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:51.683 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:33596 5.9 5:94b079ff:::benchmark_data_smithi096_19531_object33595:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-19T03:01:51.683 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:01:51.671161+0000", 2024-04-19T03:01:51.683 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0049184839999999999, 2024-04-19T03:01:51.683 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0050319739999999998, 2024-04-19T03:01:51.683 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:01:51.684 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:01:51.684 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:01:51.684 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:01:51.684 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:51.684 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 33596 2024-04-19T03:01:51.684 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:51.684 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:01:51.684 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:51.684 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:01:51.684 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:51.671161+0000", 2024-04-19T03:01:51.684 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:51.684 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:51.684 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:51.684 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:01:51.685 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:51.671161+0000", 2024-04-19T03:01:51.685 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:51.685 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:51.685 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:51.685 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:01:51.685 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:51.671160+0000", 2024-04-19T03:01:51.685 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:01:51.685 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:51.685 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:51.685 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:01:51.685 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:51.671249+0000", 2024-04-19T03:01:51.685 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.8269000000000005e-05 2024-04-19T03:01:51.685 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:51.685 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:51.686 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:01:51.686 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:51.671258+0000", 2024-04-19T03:01:51.686 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.7669999999999998e-06 2024-04-19T03:01:51.686 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:51.686 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:51.686 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:01:51.686 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:51.671266+0000", 2024-04-19T03:01:51.686 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.3030000000000002e-06 2024-04-19T03:01:51.686 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:51.686 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:51.686 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:01:51.686 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:51.674268+0000", 2024-04-19T03:01:51.686 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0030028099999999999 2024-04-19T03:01:51.686 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:51.687 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:51.687 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:01:51.687 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:51.674402+0000", 2024-04-19T03:01:51.687 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00013362399999999999 2024-04-19T03:01:51.687 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:51.687 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:51.687 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:01:51.687 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:51.674543+0000", 2024-04-19T03:01:51.687 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00014068699999999999 2024-04-19T03:01:51.687 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:51.687 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:01:51.687 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:51.687 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:51.687 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:51.687 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:33597 5.7 5:e267fe3f:::benchmark_data_smithi096_19531_object33596:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-19T03:01:51.688 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:01:51.671328+0000", 2024-04-19T03:01:51.688 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0047519040000000004, 2024-04-19T03:01:51.688 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0049408830000000001, 2024-04-19T03:01:51.688 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:01:51.688 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:01:51.688 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:01:51.688 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:01:51.688 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:51.688 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 33597 2024-04-19T03:01:51.688 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:51.688 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:01:51.688 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:51.688 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:01:51.688 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:51.671328+0000", 2024-04-19T03:01:51.689 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:51.689 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:51.689 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:51.689 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:01:51.689 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:51.671328+0000", 2024-04-19T03:01:51.689 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:51.689 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:51.689 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:51.689 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:01:51.689 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:51.671327+0000", 2024-04-19T03:01:51.689 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:01:51.689 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:51.690 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:51.690 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:01:51.690 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:51.671372+0000", 2024-04-19T03:01:51.690 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4620000000000003e-05 2024-04-19T03:01:51.690 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:51.690 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:51.690 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:01:51.690 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:51.671382+0000", 2024-04-19T03:01:51.690 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0215e-05 2024-04-19T03:01:51.690 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:51.690 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:51.690 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:01:51.690 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:51.671388+0000", 2024-04-19T03:01:51.690 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5910000000000001e-06 2024-04-19T03:01:51.691 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:51.691 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:51.691 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:01:51.691 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:51.672623+0000", 2024-04-19T03:01:51.691 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0012349769999999999 2024-04-19T03:01:51.691 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:51.691 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:51.691 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:01:51.691 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:51.672770+0000", 2024-04-19T03:01:51.691 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00014609399999999999 2024-04-19T03:01:51.691 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:51.691 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:51.691 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-04-19T03:01:51.692 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:51.672937+0000", 2024-04-19T03:01:51.692 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000167553 2024-04-19T03:01:51.692 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:51.692 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:01:51.692 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:51.692 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:51.692 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:51.692 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:33598 5.f 5:f9b889e8:::benchmark_data_smithi096_19531_object33597:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-19T03:01:51.692 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:01:51.671399+0000", 2024-04-19T03:01:51.692 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0046806809999999999, 2024-04-19T03:01:51.692 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.004942803, 2024-04-19T03:01:51.692 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:01:51.692 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:01:51.692 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:01:51.692 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:01:51.693 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:51.693 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 33598 2024-04-19T03:01:51.693 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:51.693 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:01:51.693 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:51.693 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:01:51.693 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:51.671399+0000", 2024-04-19T03:01:51.693 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:51.693 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:51.693 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:51.693 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:01:51.693 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:51.671399+0000", 2024-04-19T03:01:51.693 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:51.694 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:51.694 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:51.694 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:01:51.694 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:51.671398+0000", 2024-04-19T03:01:51.694 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:01:51.694 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:51.694 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:51.694 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:01:51.694 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:51.671465+0000", 2024-04-19T03:01:51.694 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6081999999999995e-05 2024-04-19T03:01:51.694 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:51.694 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:51.695 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:01:51.695 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:51.671474+0000", 2024-04-19T03:01:51.695 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.268e-06 2024-04-19T03:01:51.695 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:51.695 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:51.695 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:01:51.695 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:51.671482+0000", 2024-04-19T03:01:51.695 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6979999999999998e-06 2024-04-19T03:01:51.695 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:51.695 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:51.695 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:01:51.696 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:51.672611+0000", 2024-04-19T03:01:51.696 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001129739 2024-04-19T03:01:51.696 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:51.696 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:51.696 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:01:51.696 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:51.672754+0000", 2024-04-19T03:01:51.696 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00014248400000000001 2024-04-19T03:01:51.696 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:51.696 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:51.696 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:01:51.696 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:51.672870+0000", 2024-04-19T03:01:51.696 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000116419 2024-04-19T03:01:51.696 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:51.697 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:01:51.697 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:51.697 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:51.697 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:51.697 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:33602 5.7 5:e06b1e77:::benchmark_data_smithi096_19531_object33601:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-19T03:01:51.697 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:01:51.673113+0000", 2024-04-19T03:01:51.697 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.002966251, 2024-04-19T03:01:51.697 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0032858620000000001, 2024-04-19T03:01:51.697 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:01:51.697 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:01:51.697 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:01:51.697 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:01:51.697 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:51.698 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 33602 2024-04-19T03:01:51.698 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:51.698 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:01:51.698 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:51.698 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:01:51.698 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:51.673113+0000", 2024-04-19T03:01:51.698 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:51.698 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:51.698 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:51.698 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:01:51.698 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:51.673113+0000", 2024-04-19T03:01:51.698 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:51.698 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:51.699 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:51.699 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:01:51.699 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:51.673112+0000", 2024-04-19T03:01:51.699 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999986 2024-04-19T03:01:51.699 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:51.699 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:51.699 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:01:51.699 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:51.673159+0000", 2024-04-19T03:01:51.699 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7219999999999999e-05 2024-04-19T03:01:51.699 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:51.699 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:51.699 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:01:51.699 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:51.673173+0000", 2024-04-19T03:01:51.699 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3532e-05 2024-04-19T03:01:51.700 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:51.700 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:51.700 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:01:51.700 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:51.673186+0000", 2024-04-19T03:01:51.700 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2821e-05 2024-04-19T03:01:51.700 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:51.700 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:51.700 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:01:51.700 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:51.674534+0000", 2024-04-19T03:01:51.700 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0013484269999999999 2024-04-19T03:01:51.700 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:51.700 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:51.700 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:01:51.700 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:51.674669+0000", 2024-04-19T03:01:51.701 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00013446500000000001 2024-04-19T03:01:51.701 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:51.701 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:51.701 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-04-19T03:01:51.701 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:51.674859+0000", 2024-04-19T03:01:51.701 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000190001 2024-04-19T03:01:51.701 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:51.701 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:01:51.701 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:51.701 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:51.701 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:51.701 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:33606 5.7 5.3651b187 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-19T03:01:51.701 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:01:51.674539+0000", 2024-04-19T03:01:51.702 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0015409460000000001, 2024-04-19T03:01:51.702 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0019122779999999999, 2024-04-19T03:01:51.702 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:01:51.702 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-04-19T03:01:51.702 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:01:51.702 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:01:51.702 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:51.702 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 33606 2024-04-19T03:01:51.702 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:51.702 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:01:51.702 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:51.702 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:01:51.702 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:51.674539+0000", 2024-04-19T03:01:51.702 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:51.703 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:51.703 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:51.703 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:01:51.703 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:51.674539+0000", 2024-04-19T03:01:51.703 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:51.703 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:51.703 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:51.703 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:01:51.703 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:51.674538+0000", 2024-04-19T03:01:51.703 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:01:51.703 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:51.703 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:51.703 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:01:51.703 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:51.674620+0000", 2024-04-19T03:01:51.704 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2416000000000005e-05 2024-04-19T03:01:51.704 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:51.704 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:51.704 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:01:51.704 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:51.674629+0000", 2024-04-19T03:01:51.704 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.0860000000000008e-06 2024-04-19T03:01:51.704 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:51.704 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:51.704 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:01:51.704 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:51.674636+0000", 2024-04-19T03:01:51.704 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8249999999999999e-06 2024-04-19T03:01:51.704 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:51.704 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:01:51.705 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:51.705 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:51.705 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:51.705 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4755.0:33601 5.5 e29/22 5:a6566d85:::benchmark_data_smithi096_19531_object33600:head v 29'2130, mlcod=29'2128)", 2024-04-19T03:01:51.705 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:01:51.674700+0000", 2024-04-19T03:01:51.705 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.001379712, 2024-04-19T03:01:51.705 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00178191, 2024-04-19T03:01:51.705 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:01:51.705 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-04-19T03:01:51.705 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:01:51.705 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:51.705 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:01:51.705 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:51.674700+0000", 2024-04-19T03:01:51.705 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:51.706 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:51.706 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:51.706 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:01:51.706 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:51.674700+0000", 2024-04-19T03:01:51.706 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:51.706 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:51.706 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:51.706 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:01:51.706 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:51.674700+0000", 2024-04-19T03:01:51.706 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:01:51.706 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:51.706 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:51.706 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:01:51.706 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:51.674741+0000", 2024-04-19T03:01:51.707 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1783000000000003e-05 2024-04-19T03:01:51.707 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:51.707 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:51.707 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:01:51.707 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:51.674748+0000", 2024-04-19T03:01:51.707 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.1019999999999999e-06 2024-04-19T03:01:51.707 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:51.707 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:51.707 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:01:51.707 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:51.674754+0000", 2024-04-19T03:01:51.707 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3890000000000004e-06 2024-04-19T03:01:51.707 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:51.707 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:51.708 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:01:51.708 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:51.674796+0000", 2024-04-19T03:01:51.708 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2174e-05 2024-04-19T03:01:51.708 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:51.708 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:51.708 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:01:51.708 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:51.674829+0000", 2024-04-19T03:01:51.708 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2950999999999997e-05 2024-04-19T03:01:51.708 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:51.708 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:01:51.708 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:51.708 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:51.708 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:51.709 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4755.0:33603 5.6 e29/22 5:64060f85:::benchmark_data_smithi096_19531_object33602:head v 29'2147, mlcod=29'2145)", 2024-04-19T03:01:51.709 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:01:51.674773+0000", 2024-04-19T03:01:51.709 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0013066460000000001, 2024-04-19T03:01:51.709 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0017489109999999999, 2024-04-19T03:01:51.709 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:01:51.709 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-04-19T03:01:51.709 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:01:51.709 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:51.709 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:01:51.709 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:51.674773+0000", 2024-04-19T03:01:51.709 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:51.709 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:51.709 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:51.709 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:01:51.710 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:51.674773+0000", 2024-04-19T03:01:51.710 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:51.710 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:51.710 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:51.710 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:01:51.710 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:51.674773+0000", 2024-04-19T03:01:51.710 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:01:51.710 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:51.710 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:51.710 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:01:51.710 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:51.674801+0000", 2024-04-19T03:01:51.710 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7813999999999998e-05 2024-04-19T03:01:51.710 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:51.711 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:51.711 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:01:51.711 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:51.674807+0000", 2024-04-19T03:01:51.711 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.9330000000000004e-06 2024-04-19T03:01:51.711 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:51.711 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:51.711 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:01:51.711 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:51.674820+0000", 2024-04-19T03:01:51.711 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3001e-05 2024-04-19T03:01:51.711 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:51.711 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:51.711 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:01:51.711 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:51.674879+0000", 2024-04-19T03:01:51.712 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8286999999999999e-05 2024-04-19T03:01:51.712 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:51.712 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:51.712 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:01:51.712 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:51.674896+0000", 2024-04-19T03:01:51.712 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7011e-05 2024-04-19T03:01:51.712 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:51.712 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:01:51.712 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:51.712 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:51.712 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:51.712 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4755.0:33605 5.c e29/22 5:394e6ce9:::benchmark_data_smithi096_19531_object33604:head v 29'2191, mlcod=29'2189)", 2024-04-19T03:01:51.712 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:01:51.675004+0000", 2024-04-19T03:01:51.712 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.001075264, 2024-04-19T03:01:51.712 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0015645360000000001, 2024-04-19T03:01:51.713 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:01:51.713 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-04-19T03:01:51.713 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:01:51.713 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:51.713 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:01:51.713 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:51.675004+0000", 2024-04-19T03:01:51.713 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:51.713 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:51.713 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:51.713 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:01:51.713 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:51.675004+0000", 2024-04-19T03:01:51.713 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:51.713 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:51.713 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:51.714 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:01:51.714 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:51.675004+0000", 2024-04-19T03:01:51.714 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:01:51.714 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:51.714 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:51.714 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:01:51.714 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:51.675028+0000", 2024-04-19T03:01:51.714 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.4409e-05 2024-04-19T03:01:51.714 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:51.714 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:51.714 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:01:51.714 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:51.675037+0000", 2024-04-19T03:01:51.714 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.3299999999999999e-06 2024-04-19T03:01:51.715 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:51.715 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:51.715 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:01:51.715 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:51.675042+0000", 2024-04-19T03:01:51.715 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0760000000000002e-06 2024-04-19T03:01:51.715 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:51.715 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:51.715 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:01:51.715 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:51.675094+0000", 2024-04-19T03:01:51.715 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1867999999999999e-05 2024-04-19T03:01:51.715 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:51.715 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:51.715 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:01:51.715 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:51.675108+0000", 2024-04-19T03:01:51.716 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4432e-05 2024-04-19T03:01:51.716 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:51.716 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:01:51.716 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:51.716 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:51.716 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:51.716 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:33590 5.7 5:e094e0ae:::benchmark_data_smithi096_19531_object33589:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-19T03:01:51.716 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:01:51.669176+0000", 2024-04-19T03:01:51.716 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0069036169999999999, 2024-04-19T03:01:51.716 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0074550190000000002, 2024-04-19T03:01:51.716 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:01:51.716 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:01:51.716 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:01:51.716 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:01:51.717 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:51.717 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 33590 2024-04-19T03:01:51.717 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:51.717 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:01:51.717 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:51.717 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:01:51.717 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:51.669176+0000", 2024-04-19T03:01:51.717 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:51.717 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:51.717 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:51.717 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:01:51.717 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:51.669176+0000", 2024-04-19T03:01:51.717 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:51.717 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:51.718 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:51.718 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:01:51.718 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:51.669175+0000", 2024-04-19T03:01:51.718 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:01:51.718 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:51.718 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:51.718 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:01:51.718 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:51.669206+0000", 2024-04-19T03:01:51.718 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.1043000000000001e-05 2024-04-19T03:01:51.718 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:51.718 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:51.718 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:01:51.718 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:51.669218+0000", 2024-04-19T03:01:51.718 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1168e-05 2024-04-19T03:01:51.719 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:51.719 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:51.719 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:01:51.719 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:51.669223+0000", 2024-04-19T03:01:51.719 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9039999999999997e-06 2024-04-19T03:01:51.719 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:51.719 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:51.719 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:01:51.719 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:51.669264+0000", 2024-04-19T03:01:51.719 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0926000000000001e-05 2024-04-19T03:01:51.719 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:51.719 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:51.719 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:01:51.720 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:51.669458+0000", 2024-04-19T03:01:51.720 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000193337 2024-04-19T03:01:51.720 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:51.720 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:51.720 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-04-19T03:01:51.720 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:51.669549+0000", 2024-04-19T03:01:51.720 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.1716000000000001e-05 2024-04-19T03:01:51.720 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:51.720 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:51.720 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:51.720 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:51.674482+0000", 2024-04-19T03:01:51.720 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.004932769 2024-04-19T03:01:51.720 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:51.720 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:51.721 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:01:51.721 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:51.676625+0000", 2024-04-19T03:01:51.721 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0021428129999999999 2024-04-19T03:01:51.721 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:51.721 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:01:51.721 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:51.721 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:51.721 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:51.721 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:33591 5.7 5:ea44ef1f:::benchmark_data_smithi096_19531_object33590:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-19T03:01:51.721 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:01:51.669353+0000", 2024-04-19T03:01:51.721 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0067261500000000002, 2024-04-19T03:01:51.721 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0073560350000000004, 2024-04-19T03:01:51.721 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:01:51.721 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:01:51.722 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:01:51.722 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:01:51.722 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:51.722 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 33591 2024-04-19T03:01:51.722 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:51.722 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:01:51.722 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:51.722 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:01:51.722 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:51.669353+0000", 2024-04-19T03:01:51.722 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:51.722 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:51.722 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:51.722 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:01:51.722 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:51.669353+0000", 2024-04-19T03:01:51.723 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:51.723 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:51.723 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:51.723 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:01:51.723 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:51.669353+0000", 2024-04-19T03:01:51.723 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:01:51.723 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:51.723 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:51.723 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:01:51.723 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:51.669421+0000", 2024-04-19T03:01:51.723 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8650000000000002e-05 2024-04-19T03:01:51.723 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:51.723 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:51.723 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:01:51.723 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:51.669434+0000", 2024-04-19T03:01:51.723 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2917e-05 2024-04-19T03:01:51.724 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:51.724 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:51.724 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:01:51.724 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:51.669441+0000", 2024-04-19T03:01:51.724 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.9840000000000004e-06 2024-04-19T03:01:51.724 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:51.724 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:51.724 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:01:51.724 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:51.670992+0000", 2024-04-19T03:01:51.724 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0015513009999999999 2024-04-19T03:01:51.724 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:51.724 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:51.724 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:01:51.725 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:51.671084+0000", 2024-04-19T03:01:51.725 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.1719999999999996e-05 2024-04-19T03:01:51.725 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:51.725 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:51.725 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-04-19T03:01:51.725 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:51.671174+0000", 2024-04-19T03:01:51.725 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.0270000000000001e-05 2024-04-19T03:01:51.725 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:51.725 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:51.725 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:51.725 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:51.674512+0000", 2024-04-19T03:01:51.725 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0033375879999999998 2024-04-19T03:01:51.725 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:51.725 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:01:51.725 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:51.726 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:51.726 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-04-19T03:01:51.726 INFO:teuthology.orchestra.run.smithi144.stdout: "num_ops": 11 2024-04-19T03:01:51.726 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-04-19T03:01:51.727 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T03:01:51.748 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:01:51.745+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:01:51.821 INFO:tasks.radosbench.radosbench.0.smithi096.stdout: 14 16 33910 33894 151.297 137.75 0.00814747 0.00660258 2024-04-19T03:01:51.849 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:01:51.848+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:01:51.858 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-04-19T03:01:51.859 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2024-04-19T03:01:51.859 INFO:teuthology.orchestra.run.smithi144.stdout: "complaint_time": 30, 2024-04-19T03:01:51.859 INFO:teuthology.orchestra.run.smithi144.stdout: "num_blocked_ops": 0 2024-04-19T03:01:51.859 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-04-19T03:01:51.872 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T03:01:51.950 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:01:51.948+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:01:52.003 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-04-19T03:01:52.004 INFO:teuthology.orchestra.run.smithi144.stdout: "size": 20, 2024-04-19T03:01:52.004 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 600, 2024-04-19T03:01:52.004 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [ 2024-04-19T03:01:52.004 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.004 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4159.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-19T03:01:52.004 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:01:07.935397+0000", 2024-04-19T03:01:52.004 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 44.063733175000003, 2024-04-19T03:01:52.004 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.020241816999999999, 2024-04-19T03:01:52.004 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:01:52.004 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:52.005 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:01:52.005 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4159", 2024-04-19T03:01:52.005 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3589238956", 2024-04-19T03:01:52.005 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 116 2024-04-19T03:01:52.005 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.005 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:01:52.005 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.005 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:01:52.005 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:07.935397+0000", 2024-04-19T03:01:52.005 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:52.005 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.005 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.006 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:01:52.006 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:07.935397+0000", 2024-04-19T03:01:52.006 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:52.006 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.006 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.006 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:01:52.006 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:07.935396+0000", 2024-04-19T03:01:52.006 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999986 2024-04-19T03:01:52.006 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.006 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.006 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:01:52.007 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:07.935407+0000", 2024-04-19T03:01:52.007 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0842999999999999e-05 2024-04-19T03:01:52.007 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.007 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.007 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:01:52.007 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:07.935424+0000", 2024-04-19T03:01:52.007 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7193e-05 2024-04-19T03:01:52.007 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.007 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.007 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:01:52.007 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:07.935440+0000", 2024-04-19T03:01:52.007 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.626e-05 2024-04-19T03:01:52.008 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.008 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.008 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:01:52.008 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:07.950487+0000", 2024-04-19T03:01:52.008 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.015046992 2024-04-19T03:01:52.008 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.008 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.008 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:01:52.008 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:07.950602+0000", 2024-04-19T03:01:52.008 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000115048 2024-04-19T03:01:52.008 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.008 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.009 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:01:52.009 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:07.950693+0000", 2024-04-19T03:01:52.009 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.1364000000000001e-05 2024-04-19T03:01:52.009 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.009 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.009 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:01:52.009 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:07.951956+0000", 2024-04-19T03:01:52.009 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001262832 2024-04-19T03:01:52.009 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.009 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.009 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:52.009 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:07.955473+0000", 2024-04-19T03:01:52.010 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0035168209999999998 2024-04-19T03:01:52.010 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.010 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.010 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:01:52.010 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:07.955570+0000", 2024-04-19T03:01:52.010 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.7175000000000004e-05 2024-04-19T03:01:52.010 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.010 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.010 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:01:52.010 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:07.955639+0000", 2024-04-19T03:01:52.010 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8699000000000001e-05 2024-04-19T03:01:52.011 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:52.011 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:01:52.011 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:52.011 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.011 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.011 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4159.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-19T03:01:52.011 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:01:07.935454+0000", 2024-04-19T03:01:52.011 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 44.063676493000003, 2024-04-19T03:01:52.011 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.020337788999999998, 2024-04-19T03:01:52.011 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:01:52.011 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:52.011 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:01:52.012 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4159", 2024-04-19T03:01:52.012 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3589238956", 2024-04-19T03:01:52.012 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 117 2024-04-19T03:01:52.012 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.012 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:01:52.012 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.012 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:01:52.012 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:07.935454+0000", 2024-04-19T03:01:52.012 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:52.012 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.012 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.012 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:01:52.013 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:07.935454+0000", 2024-04-19T03:01:52.013 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:52.013 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.013 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.013 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:01:52.013 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:07.935453+0000", 2024-04-19T03:01:52.013 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:01:52.013 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.013 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.013 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:01:52.013 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:07.935464+0000", 2024-04-19T03:01:52.014 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1409999999999999e-05 2024-04-19T03:01:52.014 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.014 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.014 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:01:52.014 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:07.935485+0000", 2024-04-19T03:01:52.014 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0380000000000001e-05 2024-04-19T03:01:52.014 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.014 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.014 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:01:52.014 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:07.935501+0000", 2024-04-19T03:01:52.015 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6419999999999999e-05 2024-04-19T03:01:52.015 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.015 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.015 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:01:52.015 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:07.951288+0000", 2024-04-19T03:01:52.015 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.015786969000000001 2024-04-19T03:01:52.015 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.015 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.015 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:01:52.015 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:07.951404+0000", 2024-04-19T03:01:52.015 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000115977 2024-04-19T03:01:52.015 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.016 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.016 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:01:52.016 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:07.951629+0000", 2024-04-19T03:01:52.016 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000224634 2024-04-19T03:01:52.016 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.016 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.016 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:01:52.016 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:07.952689+0000", 2024-04-19T03:01:52.016 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001060374 2024-04-19T03:01:52.016 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.016 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.017 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:52.017 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:07.955706+0000", 2024-04-19T03:01:52.017 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0030169149999999998 2024-04-19T03:01:52.017 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.017 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.017 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:01:52.017 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:07.955741+0000", 2024-04-19T03:01:52.017 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5160999999999998e-05 2024-04-19T03:01:52.017 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.017 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.017 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:01:52.017 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:07.955792+0000", 2024-04-19T03:01:52.017 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0609000000000003e-05 2024-04-19T03:01:52.018 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:52.018 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:01:52.018 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:52.018 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.018 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.018 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4159.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-19T03:01:52.018 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:01:08.150835+0000", 2024-04-19T03:01:52.018 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 43.848294926000001, 2024-04-19T03:01:52.018 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.020342419, 2024-04-19T03:01:52.018 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:01:52.018 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:52.018 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:01:52.019 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4159", 2024-04-19T03:01:52.019 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3589238956", 2024-04-19T03:01:52.019 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 139 2024-04-19T03:01:52.019 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.019 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:01:52.019 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.019 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:01:52.019 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.150835+0000", 2024-04-19T03:01:52.019 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:52.019 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.019 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.020 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:01:52.020 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.150835+0000", 2024-04-19T03:01:52.020 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:52.020 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.020 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.020 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:01:52.020 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.150834+0000", 2024-04-19T03:01:52.020 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:01:52.020 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.020 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.021 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:01:52.021 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.150844+0000", 2024-04-19T03:01:52.021 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.927e-06 2024-04-19T03:01:52.021 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.021 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.021 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:01:52.021 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.150866+0000", 2024-04-19T03:01:52.021 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.211e-05 2024-04-19T03:01:52.021 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.021 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.021 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:01:52.021 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.150899+0000", 2024-04-19T03:01:52.022 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2452e-05 2024-04-19T03:01:52.022 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.022 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.022 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:01:52.022 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.167067+0000", 2024-04-19T03:01:52.022 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.016167737000000001 2024-04-19T03:01:52.022 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.022 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.022 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:01:52.022 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.167210+0000", 2024-04-19T03:01:52.022 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00014319300000000001 2024-04-19T03:01:52.023 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.023 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.023 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:01:52.023 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.167389+0000", 2024-04-19T03:01:52.023 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000179075 2024-04-19T03:01:52.023 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.023 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.023 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:01:52.023 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.170083+0000", 2024-04-19T03:01:52.023 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.002694307 2024-04-19T03:01:52.023 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.023 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.024 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:52.024 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.171088+0000", 2024-04-19T03:01:52.024 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001004429 2024-04-19T03:01:52.024 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.024 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.024 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:01:52.024 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.171147+0000", 2024-04-19T03:01:52.024 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9197999999999998e-05 2024-04-19T03:01:52.024 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.024 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.024 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:01:52.024 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.171178+0000", 2024-04-19T03:01:52.024 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.1137999999999999e-05 2024-04-19T03:01:52.025 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:52.025 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:01:52.025 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:52.025 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.025 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.025 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4159.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-19T03:01:52.025 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:01:08.150915+0000", 2024-04-19T03:01:52.025 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 43.848215250000003, 2024-04-19T03:01:52.025 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.020502679999999999, 2024-04-19T03:01:52.025 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:01:52.025 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:52.026 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:01:52.026 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4159", 2024-04-19T03:01:52.026 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3589238956", 2024-04-19T03:01:52.026 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 140 2024-04-19T03:01:52.026 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.026 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:01:52.026 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.026 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:01:52.026 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.150915+0000", 2024-04-19T03:01:52.026 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:52.026 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.027 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.027 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:01:52.027 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.150915+0000", 2024-04-19T03:01:52.027 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:52.027 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.027 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.027 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:01:52.027 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.150914+0000", 2024-04-19T03:01:52.027 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999986 2024-04-19T03:01:52.027 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.027 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.027 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:01:52.028 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.151066+0000", 2024-04-19T03:01:52.028 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00015186400000000001 2024-04-19T03:01:52.028 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.028 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.028 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:01:52.028 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.151120+0000", 2024-04-19T03:01:52.028 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4042999999999997e-05 2024-04-19T03:01:52.028 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.028 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.028 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:01:52.028 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.151155+0000", 2024-04-19T03:01:52.029 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4941999999999999e-05 2024-04-19T03:01:52.029 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.029 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.029 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:01:52.029 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.168222+0000", 2024-04-19T03:01:52.029 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.017066939999999999 2024-04-19T03:01:52.029 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.029 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.029 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:01:52.029 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.168305+0000", 2024-04-19T03:01:52.029 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.3642999999999999e-05 2024-04-19T03:01:52.029 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.030 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.030 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:01:52.030 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.168385+0000", 2024-04-19T03:01:52.030 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9647999999999994e-05 2024-04-19T03:01:52.030 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.030 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.030 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:01:52.030 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.170514+0000", 2024-04-19T03:01:52.030 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0021286370000000001 2024-04-19T03:01:52.030 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.030 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.031 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:52.031 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.171252+0000", 2024-04-19T03:01:52.031 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00073828499999999998 2024-04-19T03:01:52.031 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.031 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.031 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:01:52.031 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.171353+0000", 2024-04-19T03:01:52.031 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000100839 2024-04-19T03:01:52.031 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.031 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.031 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:01:52.031 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.171418+0000", 2024-04-19T03:01:52.032 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5048999999999993e-05 2024-04-19T03:01:52.032 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:52.032 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:01:52.032 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:52.032 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.032 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.032 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4159.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-19T03:01:52.032 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:01:08.151173+0000", 2024-04-19T03:01:52.033 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 43.847957727999997, 2024-04-19T03:01:52.033 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.023083023000000001, 2024-04-19T03:01:52.033 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:01:52.033 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:52.033 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:01:52.033 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4159", 2024-04-19T03:01:52.033 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3589238956", 2024-04-19T03:01:52.033 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 141 2024-04-19T03:01:52.033 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.034 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:01:52.034 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.034 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:01:52.034 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.151173+0000", 2024-04-19T03:01:52.034 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:52.034 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.034 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.034 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:01:52.034 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.151173+0000", 2024-04-19T03:01:52.034 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:52.034 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.034 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.035 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:01:52.035 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.151171+0000", 2024-04-19T03:01:52.035 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:01:52.035 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.035 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.035 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:01:52.035 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.151182+0000", 2024-04-19T03:01:52.035 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0730000000000001e-05 2024-04-19T03:01:52.035 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.035 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.035 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:01:52.035 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.151203+0000", 2024-04-19T03:01:52.035 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0387e-05 2024-04-19T03:01:52.035 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.036 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.036 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:01:52.036 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.151225+0000", 2024-04-19T03:01:52.036 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2643e-05 2024-04-19T03:01:52.036 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.036 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.036 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:01:52.036 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.169207+0000", 2024-04-19T03:01:52.036 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.017981561 2024-04-19T03:01:52.036 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.036 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.036 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:01:52.036 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.169386+0000", 2024-04-19T03:01:52.036 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000178758 2024-04-19T03:01:52.037 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.037 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.037 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:01:52.037 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.169546+0000", 2024-04-19T03:01:52.037 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000160781 2024-04-19T03:01:52.037 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.037 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.037 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:01:52.037 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.171444+0000", 2024-04-19T03:01:52.037 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0018980309999999999 2024-04-19T03:01:52.037 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.037 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.038 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:52.038 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.174165+0000", 2024-04-19T03:01:52.038 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0027204920000000001 2024-04-19T03:01:52.038 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.038 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.038 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:01:52.038 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.174228+0000", 2024-04-19T03:01:52.038 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2774000000000006e-05 2024-04-19T03:01:52.038 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.038 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.038 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:01:52.039 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.174256+0000", 2024-04-19T03:01:52.039 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.8045999999999999e-05 2024-04-19T03:01:52.039 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:52.039 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:01:52.039 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:52.039 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.039 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.039 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4159.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-19T03:01:52.039 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:01:08.347807+0000", 2024-04-19T03:01:52.039 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 43.651323720000001, 2024-04-19T03:01:52.039 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.021589991999999999, 2024-04-19T03:01:52.039 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:01:52.040 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:52.040 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:01:52.040 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4159", 2024-04-19T03:01:52.040 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3589238956", 2024-04-19T03:01:52.040 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 165 2024-04-19T03:01:52.040 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.040 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:01:52.040 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.040 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:01:52.040 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.347807+0000", 2024-04-19T03:01:52.040 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:52.040 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.040 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.040 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:01:52.040 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.347807+0000", 2024-04-19T03:01:52.041 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:52.041 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.041 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.041 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:01:52.041 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.347806+0000", 2024-04-19T03:01:52.041 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:01:52.041 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.041 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.041 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:01:52.041 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.347812+0000", 2024-04-19T03:01:52.041 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.066e-06 2024-04-19T03:01:52.041 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.041 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.041 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:01:52.042 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.347818+0000", 2024-04-19T03:01:52.042 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5550000000000002e-06 2024-04-19T03:01:52.042 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.042 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.042 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:01:52.042 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.347822+0000", 2024-04-19T03:01:52.042 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.561e-06 2024-04-19T03:01:52.042 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.042 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.042 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:01:52.042 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.365703+0000", 2024-04-19T03:01:52.042 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.017880566000000001 2024-04-19T03:01:52.042 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.043 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.043 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:01:52.043 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.365805+0000", 2024-04-19T03:01:52.043 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00010213900000000001 2024-04-19T03:01:52.043 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.043 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.043 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:01:52.043 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.365928+0000", 2024-04-19T03:01:52.043 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00012337900000000001 2024-04-19T03:01:52.043 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.043 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.043 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:52.043 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.367353+0000", 2024-04-19T03:01:52.044 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001424397 2024-04-19T03:01:52.044 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.044 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.044 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:01:52.044 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.369260+0000", 2024-04-19T03:01:52.044 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0019069130000000001 2024-04-19T03:01:52.044 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.044 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.044 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:01:52.044 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.369342+0000", 2024-04-19T03:01:52.044 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2423999999999996e-05 2024-04-19T03:01:52.044 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.044 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.044 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:01:52.044 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.369397+0000", 2024-04-19T03:01:52.045 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4481999999999998e-05 2024-04-19T03:01:52.045 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:52.045 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:01:52.045 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:52.045 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.045 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.045 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4159.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-19T03:01:52.045 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:01:08.539135+0000", 2024-04-19T03:01:52.045 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 43.459995462000002, 2024-04-19T03:01:52.045 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.021590602, 2024-04-19T03:01:52.045 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:01:52.045 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:52.046 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:01:52.046 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4159", 2024-04-19T03:01:52.046 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3589238956", 2024-04-19T03:01:52.046 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 188 2024-04-19T03:01:52.046 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.046 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:01:52.046 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.046 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:01:52.046 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.539135+0000", 2024-04-19T03:01:52.046 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:52.046 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.046 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.046 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:01:52.046 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.539135+0000", 2024-04-19T03:01:52.047 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:52.047 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.047 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.047 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:01:52.047 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.539134+0000", 2024-04-19T03:01:52.047 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:01:52.047 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.047 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.047 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:01:52.047 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.539228+0000", 2024-04-19T03:01:52.047 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.3771999999999996e-05 2024-04-19T03:01:52.047 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.047 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.048 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:01:52.048 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.539243+0000", 2024-04-19T03:01:52.048 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4707e-05 2024-04-19T03:01:52.048 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.048 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.048 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:01:52.048 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.539250+0000", 2024-04-19T03:01:52.048 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7190000000000001e-06 2024-04-19T03:01:52.048 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.048 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.048 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:01:52.048 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.553787+0000", 2024-04-19T03:01:52.048 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.014536248999999999 2024-04-19T03:01:52.049 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.049 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.049 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:01:52.049 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.553857+0000", 2024-04-19T03:01:52.049 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0675999999999999e-05 2024-04-19T03:01:52.049 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.049 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.049 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:01:52.049 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.553953+0000", 2024-04-19T03:01:52.049 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.5420999999999993e-05 2024-04-19T03:01:52.049 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.049 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.049 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:01:52.049 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.555569+0000", 2024-04-19T03:01:52.050 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001616625 2024-04-19T03:01:52.050 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.050 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.050 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:52.050 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.560644+0000", 2024-04-19T03:01:52.050 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0050749660000000002 2024-04-19T03:01:52.050 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.050 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.050 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:01:52.050 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.560690+0000", 2024-04-19T03:01:52.050 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6041000000000002e-05 2024-04-19T03:01:52.050 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.050 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.051 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:01:52.051 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.560726+0000", 2024-04-19T03:01:52.051 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5188999999999998e-05 2024-04-19T03:01:52.051 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:52.051 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:01:52.051 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:52.051 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.051 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.051 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4159.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-19T03:01:52.051 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:01:08.539259+0000", 2024-04-19T03:01:52.051 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 43.459870993999999, 2024-04-19T03:01:52.051 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.021552071999999999, 2024-04-19T03:01:52.051 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:01:52.051 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:52.052 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:01:52.052 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4159", 2024-04-19T03:01:52.052 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3589238956", 2024-04-19T03:01:52.052 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 189 2024-04-19T03:01:52.052 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.052 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:01:52.052 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.052 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:01:52.052 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.539259+0000", 2024-04-19T03:01:52.052 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:52.052 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.052 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.052 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:01:52.052 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.539259+0000", 2024-04-19T03:01:52.053 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:52.053 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.053 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.053 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:01:52.053 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.539259+0000", 2024-04-19T03:01:52.053 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:01:52.053 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.053 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.053 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:01:52.053 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.539268+0000", 2024-04-19T03:01:52.053 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.5359999999999998e-06 2024-04-19T03:01:52.053 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.053 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.053 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:01:52.054 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.539291+0000", 2024-04-19T03:01:52.054 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2687000000000001e-05 2024-04-19T03:01:52.054 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.054 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.054 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:01:52.054 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.539298+0000", 2024-04-19T03:01:52.054 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.883e-06 2024-04-19T03:01:52.054 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.054 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.054 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:01:52.054 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.554957+0000", 2024-04-19T03:01:52.054 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.015659019999999999 2024-04-19T03:01:52.054 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.055 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.055 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:01:52.055 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.555010+0000", 2024-04-19T03:01:52.055 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2985999999999997e-05 2024-04-19T03:01:52.055 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.055 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.055 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:01:52.055 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.555094+0000", 2024-04-19T03:01:52.055 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4530000000000006e-05 2024-04-19T03:01:52.055 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.055 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.055 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:01:52.055 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.556093+0000", 2024-04-19T03:01:52.056 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00099903300000000008 2024-04-19T03:01:52.056 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.056 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.056 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:52.056 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.560759+0000", 2024-04-19T03:01:52.056 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0046654369999999997 2024-04-19T03:01:52.056 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.056 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.056 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:01:52.056 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.560789+0000", 2024-04-19T03:01:52.056 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0638e-05 2024-04-19T03:01:52.056 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.056 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.056 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:01:52.056 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.560811+0000", 2024-04-19T03:01:52.057 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2167999999999998e-05 2024-04-19T03:01:52.057 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:52.057 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:01:52.057 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:52.057 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.057 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.057 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:8 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:01:52.057 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:01:14.998165+0000", 2024-04-19T03:01:52.057 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 37.000965313000002, 2024-04-19T03:01:52.057 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.024541001, 2024-04-19T03:01:52.057 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:01:52.057 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:52.057 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:01:52.058 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.058 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:01:52.058 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998165+0000", 2024-04-19T03:01:52.058 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:52.058 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.058 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.058 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:01:52.058 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998165+0000", 2024-04-19T03:01:52.058 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:52.058 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.058 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.058 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:01:52.058 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998164+0000", 2024-04-19T03:01:52.059 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:01:52.059 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.059 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.059 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:01:52.059 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998170+0000", 2024-04-19T03:01:52.059 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2939999999999996e-06 2024-04-19T03:01:52.059 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.059 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.059 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:01:52.059 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998179+0000", 2024-04-19T03:01:52.059 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.5540000000000003e-06 2024-04-19T03:01:52.059 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.059 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.059 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:01:52.060 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998188+0000", 2024-04-19T03:01:52.060 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2959999999999999e-06 2024-04-19T03:01:52.060 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.060 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.060 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:01:52.060 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998332+0000", 2024-04-19T03:01:52.060 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00014474 2024-04-19T03:01:52.060 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.060 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.060 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:01:52.060 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998337+0000", 2024-04-19T03:01:52.060 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6909999999999996e-06 2024-04-19T03:01:52.060 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.060 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.061 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:01:52.061 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.010222+0000", 2024-04-19T03:01:52.061 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011885178 2024-04-19T03:01:52.061 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.061 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.061 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:01:52.061 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.010342+0000", 2024-04-19T03:01:52.061 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00011991500000000001 2024-04-19T03:01:52.061 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.061 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.061 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:01:52.061 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.010506+0000", 2024-04-19T03:01:52.061 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00016429699999999999 2024-04-19T03:01:52.061 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.062 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.062 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:01:52.062 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.014525+0000", 2024-04-19T03:01:52.062 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0040189839999999998 2024-04-19T03:01:52.062 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.062 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.062 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:52.062 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.022600+0000", 2024-04-19T03:01:52.062 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0080741990000000007 2024-04-19T03:01:52.062 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.062 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.062 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:01:52.062 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.022670+0000", 2024-04-19T03:01:52.063 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0743999999999999e-05 2024-04-19T03:01:52.063 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.063 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.063 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:01:52.063 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.022706+0000", 2024-04-19T03:01:52.063 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5782999999999999e-05 2024-04-19T03:01:52.063 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:52.063 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:01:52.063 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:52.063 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.063 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.063 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:27 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:01:52.063 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:01:14.998436+0000", 2024-04-19T03:01:52.064 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 37.000694658999997, 2024-04-19T03:01:52.064 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.024406325999999999, 2024-04-19T03:01:52.064 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:01:52.064 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:52.064 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:01:52.064 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.064 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:01:52.064 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998436+0000", 2024-04-19T03:01:52.064 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:52.064 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.064 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.064 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:01:52.064 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998436+0000", 2024-04-19T03:01:52.064 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:52.064 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.065 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.065 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:01:52.065 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998435+0000", 2024-04-19T03:01:52.065 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:01:52.065 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.065 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.065 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:01:52.065 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998445+0000", 2024-04-19T03:01:52.065 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0349e-05 2024-04-19T03:01:52.065 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.065 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.065 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:01:52.065 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998453+0000", 2024-04-19T03:01:52.066 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0399999999999993e-06 2024-04-19T03:01:52.066 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.066 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.066 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:01:52.066 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998461+0000", 2024-04-19T03:01:52.066 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9780000000000005e-06 2024-04-19T03:01:52.066 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.066 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.066 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:01:52.066 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998515+0000", 2024-04-19T03:01:52.066 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3097999999999999e-05 2024-04-19T03:01:52.066 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.066 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.067 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:01:52.067 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998520+0000", 2024-04-19T03:01:52.067 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9220000000000002e-06 2024-04-19T03:01:52.067 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.067 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.067 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:01:52.067 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.011258+0000", 2024-04-19T03:01:52.067 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.012737735 2024-04-19T03:01:52.067 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.067 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.067 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:01:52.067 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.011566+0000", 2024-04-19T03:01:52.067 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00030826200000000001 2024-04-19T03:01:52.068 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.068 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.068 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:01:52.068 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.011996+0000", 2024-04-19T03:01:52.068 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00042912000000000001 2024-04-19T03:01:52.068 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.068 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.068 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:01:52.068 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.014533+0000", 2024-04-19T03:01:52.068 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.002537423 2024-04-19T03:01:52.068 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.068 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.068 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:52.068 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.022756+0000", 2024-04-19T03:01:52.069 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0082231530000000004 2024-04-19T03:01:52.069 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.069 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.069 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:01:52.069 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.022807+0000", 2024-04-19T03:01:52.069 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0852e-05 2024-04-19T03:01:52.069 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.069 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.069 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:01:52.069 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.022842+0000", 2024-04-19T03:01:52.069 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5058000000000002e-05 2024-04-19T03:01:52.069 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:52.069 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:01:52.069 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:52.070 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.070 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.070 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:28 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:01:52.070 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:01:14.998476+0000", 2024-04-19T03:01:52.070 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 37.000654736999998, 2024-04-19T03:01:52.070 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.024656784000000001, 2024-04-19T03:01:52.070 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:01:52.070 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:52.070 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:01:52.070 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.070 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:01:52.070 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998476+0000", 2024-04-19T03:01:52.071 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:52.071 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.071 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.071 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:01:52.071 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998476+0000", 2024-04-19T03:01:52.071 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:52.071 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.071 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.071 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:01:52.071 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998475+0000", 2024-04-19T03:01:52.071 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:01:52.071 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.071 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.071 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:01:52.072 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998484+0000", 2024-04-19T03:01:52.072 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.7770000000000008e-06 2024-04-19T03:01:52.072 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.072 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.072 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:01:52.072 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998495+0000", 2024-04-19T03:01:52.072 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0726e-05 2024-04-19T03:01:52.072 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.072 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.072 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:01:52.072 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998503+0000", 2024-04-19T03:01:52.072 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.8780000000000004e-06 2024-04-19T03:01:52.072 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.072 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.073 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:01:52.073 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998579+0000", 2024-04-19T03:01:52.073 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5160999999999994e-05 2024-04-19T03:01:52.073 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.073 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.073 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:01:52.073 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998586+0000", 2024-04-19T03:01:52.073 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8520000000000004e-06 2024-04-19T03:01:52.073 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.073 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.073 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:01:52.073 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.012423+0000", 2024-04-19T03:01:52.073 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.013836667 2024-04-19T03:01:52.073 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.074 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.074 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:01:52.074 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.012532+0000", 2024-04-19T03:01:52.074 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000108565 2024-04-19T03:01:52.074 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.074 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.074 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:01:52.074 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.012655+0000", 2024-04-19T03:01:52.074 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00012344600000000001 2024-04-19T03:01:52.074 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.074 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.074 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:01:52.074 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.015680+0000", 2024-04-19T03:01:52.075 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0030246470000000001 2024-04-19T03:01:52.075 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.075 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.075 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:52.075 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.023091+0000", 2024-04-19T03:01:52.075 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0074116030000000001 2024-04-19T03:01:52.075 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.075 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.075 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:01:52.075 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.023115+0000", 2024-04-19T03:01:52.075 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.3091999999999998e-05 2024-04-19T03:01:52.075 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.075 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.075 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:01:52.076 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.023132+0000", 2024-04-19T03:01:52.076 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7901999999999999e-05 2024-04-19T03:01:52.076 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:52.076 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:01:52.076 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:52.076 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.076 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.076 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:29 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:01:52.076 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:01:14.998527+0000", 2024-04-19T03:01:52.076 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 37.000603196999997, 2024-04-19T03:01:52.076 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.024738599999999999, 2024-04-19T03:01:52.076 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:01:52.076 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:52.076 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:01:52.076 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.077 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:01:52.077 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998527+0000", 2024-04-19T03:01:52.077 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:52.077 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.077 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.077 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:01:52.077 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998527+0000", 2024-04-19T03:01:52.077 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:52.077 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.077 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.077 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:01:52.077 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998527+0000", 2024-04-19T03:01:52.077 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:01:52.077 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.077 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.078 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:01:52.078 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998531+0000", 2024-04-19T03:01:52.078 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9450000000000001e-06 2024-04-19T03:01:52.078 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.078 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.078 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:01:52.078 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998541+0000", 2024-04-19T03:01:52.078 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.4320000000000005e-06 2024-04-19T03:01:52.078 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.078 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.078 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:01:52.078 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998548+0000", 2024-04-19T03:01:52.078 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.221e-06 2024-04-19T03:01:52.079 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.079 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.079 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:01:52.079 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998620+0000", 2024-04-19T03:01:52.079 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.1676999999999998e-05 2024-04-19T03:01:52.079 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.079 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.079 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:01:52.079 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998624+0000", 2024-04-19T03:01:52.079 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4850000000000003e-06 2024-04-19T03:01:52.079 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.079 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.079 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:01:52.079 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.013261+0000", 2024-04-19T03:01:52.080 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.014636451999999999 2024-04-19T03:01:52.080 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.080 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.080 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:01:52.080 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.013364+0000", 2024-04-19T03:01:52.080 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000102885 2024-04-19T03:01:52.080 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.080 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.080 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:01:52.080 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.013481+0000", 2024-04-19T03:01:52.080 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00011783299999999999 2024-04-19T03:01:52.080 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.080 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.080 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:01:52.081 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.016265+0000", 2024-04-19T03:01:52.081 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0027834539999999999 2024-04-19T03:01:52.081 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.081 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.081 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:52.081 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.023180+0000", 2024-04-19T03:01:52.081 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0069149399999999996 2024-04-19T03:01:52.081 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.081 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.081 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:01:52.081 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.023230+0000", 2024-04-19T03:01:52.081 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0220999999999999e-05 2024-04-19T03:01:52.081 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.081 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.082 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:01:52.082 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.023266+0000", 2024-04-19T03:01:52.082 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5703e-05 2024-04-19T03:01:52.082 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:52.082 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:01:52.082 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:52.082 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.082 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.082 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:30 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:01:52.082 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:01:14.998577+0000", 2024-04-19T03:01:52.082 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 37.000553089999997, 2024-04-19T03:01:52.082 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.024774022999999999, 2024-04-19T03:01:52.082 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:01:52.083 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:52.083 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:01:52.083 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.083 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:01:52.083 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998577+0000", 2024-04-19T03:01:52.083 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:52.083 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.083 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.083 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:01:52.083 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998577+0000", 2024-04-19T03:01:52.083 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:52.083 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.083 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.083 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:01:52.083 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998576+0000", 2024-04-19T03:01:52.084 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:01:52.084 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.084 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.084 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:01:52.084 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998583+0000", 2024-04-19T03:01:52.084 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8850000000000001e-06 2024-04-19T03:01:52.084 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.084 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.084 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:01:52.084 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998597+0000", 2024-04-19T03:01:52.084 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.362e-05 2024-04-19T03:01:52.084 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.084 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.085 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:01:52.085 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998607+0000", 2024-04-19T03:01:52.085 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0389e-05 2024-04-19T03:01:52.085 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.085 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.085 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:01:52.085 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998713+0000", 2024-04-19T03:01:52.085 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000105338 2024-04-19T03:01:52.085 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.085 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.085 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:01:52.085 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998720+0000", 2024-04-19T03:01:52.085 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2370000000000003e-06 2024-04-19T03:01:52.085 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.086 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.086 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:01:52.086 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.014014+0000", 2024-04-19T03:01:52.086 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.015294116999999999 2024-04-19T03:01:52.086 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.086 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.086 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:01:52.086 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.014091+0000", 2024-04-19T03:01:52.086 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7148000000000001e-05 2024-04-19T03:01:52.086 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.086 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.086 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:01:52.086 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.014271+0000", 2024-04-19T03:01:52.087 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00017962699999999999 2024-04-19T03:01:52.087 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.087 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.087 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:01:52.087 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.018024+0000", 2024-04-19T03:01:52.087 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0037529809999999999 2024-04-19T03:01:52.087 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.087 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.087 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:52.087 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.023303+0000", 2024-04-19T03:01:52.087 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0052793099999999997 2024-04-19T03:01:52.087 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.087 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.087 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:01:52.087 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.023331+0000", 2024-04-19T03:01:52.088 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.8013000000000001e-05 2024-04-19T03:01:52.088 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.088 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.088 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:01:52.088 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.023351+0000", 2024-04-19T03:01:52.088 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0225999999999999e-05 2024-04-19T03:01:52.088 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:52.088 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:01:52.088 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:52.088 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.088 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.088 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:33 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:01:52.088 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:01:14.998625+0000", 2024-04-19T03:01:52.088 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 37.000505693000001, 2024-04-19T03:01:52.089 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.024007338999999999, 2024-04-19T03:01:52.089 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:01:52.089 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:52.089 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:01:52.089 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.089 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:01:52.089 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998625+0000", 2024-04-19T03:01:52.089 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:52.089 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.089 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.089 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:01:52.089 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998625+0000", 2024-04-19T03:01:52.089 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:52.089 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.090 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.090 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:01:52.090 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998623+0000", 2024-04-19T03:01:52.090 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999986 2024-04-19T03:01:52.090 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.090 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.090 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:01:52.090 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998632+0000", 2024-04-19T03:01:52.090 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9279999999999999e-06 2024-04-19T03:01:52.090 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.090 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.090 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:01:52.090 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998642+0000", 2024-04-19T03:01:52.091 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0063e-05 2024-04-19T03:01:52.091 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.091 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.091 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:01:52.091 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998649+0000", 2024-04-19T03:01:52.091 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4799999999999998e-06 2024-04-19T03:01:52.091 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.091 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.091 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:01:52.091 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998730+0000", 2024-04-19T03:01:52.091 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.1514999999999995e-05 2024-04-19T03:01:52.091 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.091 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.091 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:01:52.092 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998741+0000", 2024-04-19T03:01:52.092 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1029999999999999e-05 2024-04-19T03:01:52.092 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.092 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.092 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:01:52.092 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.010202+0000", 2024-04-19T03:01:52.092 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011460529000000001 2024-04-19T03:01:52.092 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.092 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.092 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:01:52.092 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.010292+0000", 2024-04-19T03:01:52.092 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.0382000000000003e-05 2024-04-19T03:01:52.092 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.092 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.092 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:01:52.093 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.010391+0000", 2024-04-19T03:01:52.093 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.8491000000000003e-05 2024-04-19T03:01:52.093 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.093 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.093 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:01:52.093 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.013800+0000", 2024-04-19T03:01:52.093 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0034090219999999998 2024-04-19T03:01:52.093 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.093 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.093 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:52.093 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.022564+0000", 2024-04-19T03:01:52.093 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0087639950000000001 2024-04-19T03:01:52.093 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.093 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.094 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:01:52.094 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.022601+0000", 2024-04-19T03:01:52.094 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7363999999999997e-05 2024-04-19T03:01:52.094 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.094 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.094 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:01:52.094 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.022632+0000", 2024-04-19T03:01:52.094 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0917000000000002e-05 2024-04-19T03:01:52.094 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:52.094 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:01:52.094 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:52.094 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.095 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.095 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:37 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:01:52.095 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:01:14.998739+0000", 2024-04-19T03:01:52.095 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 37.000391751999999, 2024-04-19T03:01:52.095 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.020573188999999999, 2024-04-19T03:01:52.095 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:01:52.095 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:52.095 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:01:52.095 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.095 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:01:52.095 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998739+0000", 2024-04-19T03:01:52.095 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:52.095 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.096 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.096 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:01:52.096 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998739+0000", 2024-04-19T03:01:52.096 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:52.096 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.096 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.096 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:01:52.096 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998738+0000", 2024-04-19T03:01:52.096 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:01:52.096 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.096 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.096 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:01:52.096 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998755+0000", 2024-04-19T03:01:52.096 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7105999999999999e-05 2024-04-19T03:01:52.097 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.097 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.097 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:01:52.097 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998764+0000", 2024-04-19T03:01:52.097 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.1279999999999997e-06 2024-04-19T03:01:52.097 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.097 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.097 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:01:52.097 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998771+0000", 2024-04-19T03:01:52.097 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6939999999999998e-06 2024-04-19T03:01:52.097 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.097 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.097 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:01:52.098 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998843+0000", 2024-04-19T03:01:52.098 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.1695999999999999e-05 2024-04-19T03:01:52.098 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.098 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.098 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op must wait for map", 2024-04-19T03:01:52.098 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998852+0000", 2024-04-19T03:01:52.098 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.0799999999999995e-06 2024-04-19T03:01:52.098 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.098 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.098 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:01:52.098 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.006513+0000", 2024-04-19T03:01:52.098 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0076610020000000001 2024-04-19T03:01:52.098 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.099 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.099 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:01:52.099 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.006670+0000", 2024-04-19T03:01:52.099 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000157529 2024-04-19T03:01:52.099 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.099 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.099 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-04-19T03:01:52.099 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.006863+0000", 2024-04-19T03:01:52.099 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000192597 2024-04-19T03:01:52.099 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.099 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.099 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:01:52.099 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.012404+0000", 2024-04-19T03:01:52.099 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0055415220000000001 2024-04-19T03:01:52.100 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.100 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.100 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:52.100 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.019171+0000", 2024-04-19T03:01:52.100 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0067666829999999999 2024-04-19T03:01:52.100 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.100 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.100 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:01:52.100 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.019228+0000", 2024-04-19T03:01:52.100 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7145999999999998e-05 2024-04-19T03:01:52.100 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.100 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.100 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:01:52.101 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.019312+0000", 2024-04-19T03:01:52.101 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.3591999999999995e-05 2024-04-19T03:01:52.101 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:52.101 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:01:52.101 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:52.101 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.101 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.101 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:01:52.101 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:01:14.998792+0000", 2024-04-19T03:01:52.101 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 37.000338824000004, 2024-04-19T03:01:52.101 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.023951813999999998, 2024-04-19T03:01:52.101 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:01:52.101 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:52.102 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:01:52.102 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.102 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:01:52.102 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998792+0000", 2024-04-19T03:01:52.102 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:52.102 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.102 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.102 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:01:52.102 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998792+0000", 2024-04-19T03:01:52.102 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:52.102 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.102 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.102 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:01:52.102 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998791+0000", 2024-04-19T03:01:52.103 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:01:52.103 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.103 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.103 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:01:52.103 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998796+0000", 2024-04-19T03:01:52.103 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9649999999999999e-06 2024-04-19T03:01:52.103 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.103 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.103 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:01:52.103 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998809+0000", 2024-04-19T03:01:52.103 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3254e-05 2024-04-19T03:01:52.103 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.103 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.103 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:01:52.104 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998816+0000", 2024-04-19T03:01:52.104 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.472e-06 2024-04-19T03:01:52.104 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.104 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.104 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:01:52.104 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998899+0000", 2024-04-19T03:01:52.104 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.3676000000000003e-05 2024-04-19T03:01:52.104 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.104 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.104 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:01:52.104 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998908+0000", 2024-04-19T03:01:52.104 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6940000000000001e-06 2024-04-19T03:01:52.104 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.104 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.105 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:01:52.105 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.010818+0000", 2024-04-19T03:01:52.105 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011910482999999999 2024-04-19T03:01:52.105 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.105 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.105 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:01:52.105 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.010959+0000", 2024-04-19T03:01:52.105 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00014018900000000001 2024-04-19T03:01:52.105 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.105 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.105 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:01:52.105 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.011185+0000", 2024-04-19T03:01:52.105 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000226085 2024-04-19T03:01:52.106 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.106 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.106 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:01:52.106 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.014479+0000", 2024-04-19T03:01:52.106 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0032938260000000001 2024-04-19T03:01:52.106 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.106 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.106 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:52.106 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.022697+0000", 2024-04-19T03:01:52.106 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0082186029999999997 2024-04-19T03:01:52.106 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.106 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.106 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:01:52.106 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.022724+0000", 2024-04-19T03:01:52.107 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.6503999999999999e-05 2024-04-19T03:01:52.107 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.107 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.107 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:01:52.107 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.022743+0000", 2024-04-19T03:01:52.107 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9663000000000001e-05 2024-04-19T03:01:52.107 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:52.107 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:01:52.107 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:52.107 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.107 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.107 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:01:52.107 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:01:14.998870+0000", 2024-04-19T03:01:52.108 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 37.000260623000003, 2024-04-19T03:01:52.108 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.024280578000000001, 2024-04-19T03:01:52.108 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:01:52.108 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:52.108 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:01:52.108 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.108 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:01:52.108 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998870+0000", 2024-04-19T03:01:52.108 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:52.108 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.108 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.108 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:01:52.108 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998870+0000", 2024-04-19T03:01:52.109 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:52.109 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.109 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.109 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:01:52.109 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998869+0000", 2024-04-19T03:01:52.109 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:01:52.109 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.109 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.109 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:01:52.109 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998879+0000", 2024-04-19T03:01:52.109 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.8689999999999999e-06 2024-04-19T03:01:52.109 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.109 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.109 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:01:52.110 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998893+0000", 2024-04-19T03:01:52.110 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4436999999999999e-05 2024-04-19T03:01:52.110 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.110 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.110 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:01:52.110 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998904+0000", 2024-04-19T03:01:52.110 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0657e-05 2024-04-19T03:01:52.110 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.110 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.110 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:01:52.110 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998972+0000", 2024-04-19T03:01:52.110 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8121999999999996e-05 2024-04-19T03:01:52.110 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.111 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.111 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:01:52.111 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998980+0000", 2024-04-19T03:01:52.111 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7170000000000008e-06 2024-04-19T03:01:52.111 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.111 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.111 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:01:52.111 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.011666+0000", 2024-04-19T03:01:52.111 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.012686507 2024-04-19T03:01:52.111 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.111 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.111 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:01:52.111 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.012403+0000", 2024-04-19T03:01:52.111 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00073661899999999999 2024-04-19T03:01:52.112 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.112 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.112 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:01:52.112 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.012788+0000", 2024-04-19T03:01:52.112 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00038495800000000002 2024-04-19T03:01:52.112 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.112 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.112 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:01:52.112 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.015713+0000", 2024-04-19T03:01:52.112 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0029255879999999998 2024-04-19T03:01:52.112 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.112 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.112 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:52.112 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.023066+0000", 2024-04-19T03:01:52.113 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.007352903 2024-04-19T03:01:52.113 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.113 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.113 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:01:52.113 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.023113+0000", 2024-04-19T03:01:52.113 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7163000000000002e-05 2024-04-19T03:01:52.113 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.113 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.113 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:01:52.113 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.023150+0000", 2024-04-19T03:01:52.113 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6881000000000001e-05 2024-04-19T03:01:52.113 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:52.113 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:01:52.113 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:52.114 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.114 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.114 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:16 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:01:52.114 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:01:14.998920+0000", 2024-04-19T03:01:52.114 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 37.000210578000001, 2024-04-19T03:01:52.114 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.020562114999999999, 2024-04-19T03:01:52.114 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:01:52.114 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:52.114 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:01:52.114 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.114 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:01:52.114 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998920+0000", 2024-04-19T03:01:52.114 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:52.115 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.115 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.115 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:01:52.115 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998920+0000", 2024-04-19T03:01:52.115 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:52.115 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.115 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.115 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:01:52.115 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998919+0000", 2024-04-19T03:01:52.115 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:01:52.115 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.115 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.115 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:01:52.115 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998925+0000", 2024-04-19T03:01:52.116 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5370000000000003e-06 2024-04-19T03:01:52.116 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.116 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.116 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:01:52.116 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998943+0000", 2024-04-19T03:01:52.116 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7549000000000001e-05 2024-04-19T03:01:52.116 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.116 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.116 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:01:52.116 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998955+0000", 2024-04-19T03:01:52.116 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1977000000000001e-05 2024-04-19T03:01:52.116 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.116 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.116 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:01:52.117 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.999009+0000", 2024-04-19T03:01:52.117 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3667e-05 2024-04-19T03:01:52.117 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.117 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.117 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:01:52.117 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.999013+0000", 2024-04-19T03:01:52.117 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8829999999999997e-06 2024-04-19T03:01:52.117 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.117 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.117 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:01:52.117 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.007476+0000", 2024-04-19T03:01:52.117 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0084621569999999997 2024-04-19T03:01:52.117 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.117 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.118 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:01:52.118 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.007626+0000", 2024-04-19T03:01:52.118 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00015079199999999999 2024-04-19T03:01:52.118 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.118 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.118 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-04-19T03:01:52.118 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.007765+0000", 2024-04-19T03:01:52.118 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000138376 2024-04-19T03:01:52.118 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.118 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.118 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:01:52.118 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.012418+0000", 2024-04-19T03:01:52.118 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0046528200000000002 2024-04-19T03:01:52.118 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.119 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.119 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:52.119 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.019380+0000", 2024-04-19T03:01:52.119 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0069621960000000004 2024-04-19T03:01:52.119 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.119 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.119 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:01:52.119 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.019437+0000", 2024-04-19T03:01:52.119 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7226999999999999e-05 2024-04-19T03:01:52.119 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.119 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.119 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:01:52.119 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.019482+0000", 2024-04-19T03:01:52.119 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4857000000000001e-05 2024-04-19T03:01:52.120 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:52.120 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:01:52.120 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:52.120 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.120 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.120 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:20 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:01:52.120 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:01:14.999024+0000", 2024-04-19T03:01:52.120 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 37.000106350999999, 2024-04-19T03:01:52.120 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.024212818000000001, 2024-04-19T03:01:52.120 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:01:52.120 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-04-19T03:01:52.120 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:01:52.120 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.120 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:01:52.121 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.999024+0000", 2024-04-19T03:01:52.121 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:52.121 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.121 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.121 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:01:52.121 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.999024+0000", 2024-04-19T03:01:52.121 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:52.121 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.121 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.121 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:01:52.121 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.999023+0000", 2024-04-19T03:01:52.121 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:01:52.121 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.121 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.122 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:01:52.122 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.999029+0000", 2024-04-19T03:01:52.122 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2709999999999998e-06 2024-04-19T03:01:52.122 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.122 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.122 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:01:52.122 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.999045+0000", 2024-04-19T03:01:52.122 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.5840000000000001e-05 2024-04-19T03:01:52.122 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.122 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.122 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:01:52.122 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.999057+0000", 2024-04-19T03:01:52.122 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1897e-05 2024-04-19T03:01:52.123 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.123 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.123 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:01:52.123 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.999136+0000", 2024-04-19T03:01:52.123 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8842000000000002e-05 2024-04-19T03:01:52.123 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.123 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.123 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:01:52.123 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.999144+0000", 2024-04-19T03:01:52.123 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.3110000000000006e-06 2024-04-19T03:01:52.123 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.123 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.123 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:01:52.123 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.013338+0000", 2024-04-19T03:01:52.124 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.014194217 2024-04-19T03:01:52.124 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.124 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.124 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:01:52.124 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.013485+0000", 2024-04-19T03:01:52.124 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000146787 2024-04-19T03:01:52.124 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.124 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.124 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:01:52.124 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.023237+0000", 2024-04-19T03:01:52.124 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0097517899999999998 2024-04-19T03:01:52.124 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:52.124 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:01:52.124 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:52.125 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.125 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.125 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:11289 5.7 5:e1ea82b1:::benchmark_data_smithi096_19531_object11288:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T03:01:52.125 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:01:42.068678+0000", 2024-04-19T03:01:52.125 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 9.9304521309999991, 2024-04-19T03:01:52.125 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.022027980999999999, 2024-04-19T03:01:52.125 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:01:52.125 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:52.125 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:01:52.125 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:01:52.125 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:52.125 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 11289 2024-04-19T03:01:52.125 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.125 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:01:52.126 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.126 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:01:52.126 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:42.068678+0000", 2024-04-19T03:01:52.126 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:52.126 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.126 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.126 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:01:52.126 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:42.068678+0000", 2024-04-19T03:01:52.126 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:52.126 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.126 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.126 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:01:52.126 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:42.068677+0000", 2024-04-19T03:01:52.126 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:01:52.127 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.127 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.127 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:01:52.127 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:42.068721+0000", 2024-04-19T03:01:52.127 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3714000000000002e-05 2024-04-19T03:01:52.127 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.127 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.127 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:01:52.127 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:42.068728+0000", 2024-04-19T03:01:52.127 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0029999999999997e-06 2024-04-19T03:01:52.127 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.127 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.127 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:01:52.127 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:42.068733+0000", 2024-04-19T03:01:52.128 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0100000000000003e-06 2024-04-19T03:01:52.128 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.128 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.128 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:01:52.128 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:42.068820+0000", 2024-04-19T03:01:52.128 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.653e-05 2024-04-19T03:01:52.128 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.128 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.128 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:01:52.128 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:42.068990+0000", 2024-04-19T03:01:52.128 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00017046800000000001 2024-04-19T03:01:52.128 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.128 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.128 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-04-19T03:01:52.129 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:42.069140+0000", 2024-04-19T03:01:52.129 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00015001000000000001 2024-04-19T03:01:52.129 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.129 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.129 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:01:52.129 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:42.074573+0000", 2024-04-19T03:01:52.129 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0054326979999999997 2024-04-19T03:01:52.129 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.129 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.129 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:52.129 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:42.090534+0000", 2024-04-19T03:01:52.129 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.015961300000000001 2024-04-19T03:01:52.129 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.129 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.130 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:01:52.130 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:42.090619+0000", 2024-04-19T03:01:52.130 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4536999999999994e-05 2024-04-19T03:01:52.130 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:52.130 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:52.130 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:01:52.130 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:42.090706+0000", 2024-04-19T03:01:52.130 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.7643000000000001e-05 2024-04-19T03:01:52.130 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:52.130 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:01:52.130 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:52.130 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:52.130 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:01:52.131 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-04-19T03:01:52.132 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:01:52.129+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:01:52.132 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T03:01:52.233 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:01:52.229+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:01:52.264 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-04-19T03:01:52.264 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [ 2024-04-19T03:01:52.264 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.264 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4755.0:34812 5.5 5:a177a35f:::benchmark_data_smithi096_19531_object34811:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-19T03:01:52.264 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:52.256397+0000", 2024-04-19T03:01:52.264 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 0.0049079800000000002, 2024-04-19T03:01:52.264 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0049376239999999998, 2024-04-19T03:01:52.264 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:01:52.264 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:01:52.265 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-04-19T03:01:52.265 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4755", 2024-04-19T03:01:52.265 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:52.265 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 34812 2024-04-19T03:01:52.265 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.265 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:01:52.265 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.265 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:01:52.265 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:52.256397+0000", 2024-04-19T03:01:52.265 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:52.265 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.265 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.265 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:01:52.266 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:52.256397+0000", 2024-04-19T03:01:52.266 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:52.266 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.266 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.266 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:01:52.266 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:52.256396+0000", 2024-04-19T03:01:52.266 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2024-04-19T03:01:52.266 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.266 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.266 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:01:52.266 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:52.256458+0000", 2024-04-19T03:01:52.266 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.1916999999999997e-05 2024-04-19T03:01:52.266 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.267 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.267 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:01:52.267 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:52.256468+0000", 2024-04-19T03:01:52.267 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.6530000000000006e-06 2024-04-19T03:01:52.267 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.267 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.267 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:01:52.267 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:52.256474+0000", 2024-04-19T03:01:52.267 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.6110000000000001e-06 2024-04-19T03:01:52.267 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.267 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.267 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:52.267 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:52.256505+0000", 2024-04-19T03:01:52.268 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1801000000000003e-05 2024-04-19T03:01:52.268 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.268 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.268 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:01:52.268 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:52.256609+0000", 2024-04-19T03:01:52.268 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00010384599999999999 2024-04-19T03:01:52.268 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.268 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.268 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-04-19T03:01:52.268 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:52.256735+0000", 2024-04-19T03:01:52.268 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000126095 2024-04-19T03:01:52.268 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.268 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.268 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:01:52.269 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:52.260874+0000", 2024-04-19T03:01:52.269 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0041390000000000003 2024-04-19T03:01:52.269 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:52.269 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:52.269 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:52.269 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.269 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.269 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4755.0:34813 5.5 5:a2e91a2d:::benchmark_data_smithi096_19531_object34812:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-19T03:01:52.269 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:52.256482+0000", 2024-04-19T03:01:52.269 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 0.0048228020000000002, 2024-04-19T03:01:52.269 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0049392710000000003, 2024-04-19T03:01:52.269 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:01:52.269 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:01:52.269 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-04-19T03:01:52.269 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4755", 2024-04-19T03:01:52.270 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:52.270 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 34813 2024-04-19T03:01:52.270 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.270 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:01:52.270 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.270 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:01:52.270 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:52.256482+0000", 2024-04-19T03:01:52.270 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:52.270 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.270 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.270 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:01:52.270 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:52.256482+0000", 2024-04-19T03:01:52.270 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:52.271 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.271 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.271 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:01:52.271 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:52.256482+0000", 2024-04-19T03:01:52.271 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999995 2024-04-19T03:01:52.271 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.271 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.271 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:01:52.271 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:52.256512+0000", 2024-04-19T03:01:52.271 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0378999999999998e-05 2024-04-19T03:01:52.271 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.271 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.271 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:01:52.271 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:52.256517+0000", 2024-04-19T03:01:52.271 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.2919999999999997e-06 2024-04-19T03:01:52.272 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.272 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.272 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:01:52.272 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:52.256520+0000", 2024-04-19T03:01:52.272 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.066e-06 2024-04-19T03:01:52.272 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.272 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.272 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:52.272 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:52.258792+0000", 2024-04-19T03:01:52.272 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0022727099999999998 2024-04-19T03:01:52.272 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.272 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.272 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:01:52.272 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:52.258936+0000", 2024-04-19T03:01:52.272 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000143969 2024-04-19T03:01:52.273 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.273 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.273 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-04-19T03:01:52.273 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:52.259056+0000", 2024-04-19T03:01:52.273 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000119647 2024-04-19T03:01:52.273 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:52.273 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:52.273 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:52.273 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.273 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.273 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4755.0:34815 5.c 5:3bd88ae3:::benchmark_data_smithi096_19531_object34814:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-19T03:01:52.273 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:52.256526+0000", 2024-04-19T03:01:52.273 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 0.0047793569999999997, 2024-04-19T03:01:52.273 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0049698210000000001, 2024-04-19T03:01:52.273 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:01:52.274 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:01:52.274 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-04-19T03:01:52.274 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4755", 2024-04-19T03:01:52.274 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:52.274 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 34815 2024-04-19T03:01:52.274 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.274 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:01:52.274 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.274 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:01:52.274 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:52.256526+0000", 2024-04-19T03:01:52.274 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:52.274 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.274 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.275 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:01:52.275 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:52.256526+0000", 2024-04-19T03:01:52.275 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:52.275 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.275 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.275 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:01:52.275 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:52.256525+0000", 2024-04-19T03:01:52.275 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999995 2024-04-19T03:01:52.275 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.275 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.275 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:01:52.275 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:52.256587+0000", 2024-04-19T03:01:52.275 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.1724999999999996e-05 2024-04-19T03:01:52.275 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.276 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.276 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:01:52.276 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:52.256591+0000", 2024-04-19T03:01:52.276 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.2350000000000001e-06 2024-04-19T03:01:52.276 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.276 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.276 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:01:52.276 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:52.256595+0000", 2024-04-19T03:01:52.276 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.0509999999999998e-06 2024-04-19T03:01:52.276 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.276 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.276 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:52.276 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:52.256636+0000", 2024-04-19T03:01:52.276 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.087e-05 2024-04-19T03:01:52.276 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.277 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.277 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:01:52.277 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:52.256728+0000", 2024-04-19T03:01:52.277 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.2113000000000004e-05 2024-04-19T03:01:52.277 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.277 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.277 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-04-19T03:01:52.277 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:52.256830+0000", 2024-04-19T03:01:52.277 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000101636 2024-04-19T03:01:52.277 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.277 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.277 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:01:52.277 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:52.259515+0000", 2024-04-19T03:01:52.277 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0026849729999999998 2024-04-19T03:01:52.277 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:52.278 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:52.278 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:52.278 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.278 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.278 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4755.0:34818 5.6 5:69a43a78:::benchmark_data_smithi096_19531_object34817:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-19T03:01:52.278 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:52.256830+0000", 2024-04-19T03:01:52.278 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 0.004475672, 2024-04-19T03:01:52.278 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0047464580000000003, 2024-04-19T03:01:52.278 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:01:52.278 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:01:52.278 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-04-19T03:01:52.278 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4755", 2024-04-19T03:01:52.278 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:52.278 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 34818 2024-04-19T03:01:52.279 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.279 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:01:52.279 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.279 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:01:52.279 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:52.256830+0000", 2024-04-19T03:01:52.279 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:52.279 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.279 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.279 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:01:52.279 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:52.256830+0000", 2024-04-19T03:01:52.279 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:52.279 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.279 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.279 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:01:52.279 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:52.256829+0000", 2024-04-19T03:01:52.280 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999995 2024-04-19T03:01:52.280 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.280 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.280 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:01:52.280 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:52.256982+0000", 2024-04-19T03:01:52.280 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00015276800000000001 2024-04-19T03:01:52.280 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.280 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.280 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:01:52.280 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:52.256991+0000", 2024-04-19T03:01:52.280 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.064e-06 2024-04-19T03:01:52.280 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.280 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.280 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:01:52.280 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:52.256995+0000", 2024-04-19T03:01:52.281 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.481e-06 2024-04-19T03:01:52.281 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.281 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.281 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:52.281 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:52.257024+0000", 2024-04-19T03:01:52.281 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.8555999999999999e-05 2024-04-19T03:01:52.281 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.281 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.281 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:01:52.281 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:52.257115+0000", 2024-04-19T03:01:52.281 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.1249000000000007e-05 2024-04-19T03:01:52.281 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.281 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.281 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-04-19T03:01:52.281 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:52.257198+0000", 2024-04-19T03:01:52.281 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.2756999999999994e-05 2024-04-19T03:01:52.282 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.282 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.282 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:01:52.282 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:52.260300+0000", 2024-04-19T03:01:52.282 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.003102418 2024-04-19T03:01:52.282 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:52.282 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:52.282 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:52.282 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.282 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.282 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4755.0:34819 5.4 e29/22 5:2d5ae5cb:::benchmark_data_smithi096_19531_object34818:head v 29'2123, mlcod=29'2121)", 2024-04-19T03:01:52.282 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:52.257698+0000", 2024-04-19T03:01:52.282 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 0.003607107, 2024-04-19T03:01:52.282 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0039527870000000001, 2024-04-19T03:01:52.283 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:01:52.283 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "started", 2024-04-19T03:01:52.283 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:01:52.283 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.283 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:01:52.283 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:52.257698+0000", 2024-04-19T03:01:52.283 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:52.283 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.283 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.283 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:01:52.283 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:52.257698+0000", 2024-04-19T03:01:52.283 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:52.283 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.283 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.283 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:01:52.283 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:52.257697+0000", 2024-04-19T03:01:52.284 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2024-04-19T03:01:52.284 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.284 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.284 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:01:52.284 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:52.257742+0000", 2024-04-19T03:01:52.284 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.5188999999999997e-05 2024-04-19T03:01:52.284 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.284 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.284 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:01:52.284 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:52.257757+0000", 2024-04-19T03:01:52.284 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4099e-05 2024-04-19T03:01:52.284 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.284 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.284 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:01:52.284 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:52.257764+0000", 2024-04-19T03:01:52.285 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.1930000000000004e-06 2024-04-19T03:01:52.285 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.285 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.285 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:52.285 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:52.257809+0000", 2024-04-19T03:01:52.285 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.5118999999999999e-05 2024-04-19T03:01:52.285 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.285 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.285 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:01:52.285 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:52.257840+0000", 2024-04-19T03:01:52.285 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1096000000000002e-05 2024-04-19T03:01:52.285 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:52.285 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:52.285 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:52.285 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.286 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.286 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4755.0:34817 5.b e29/22 5:d0342b0f:::benchmark_data_smithi096_19531_object34816:head v 29'2217, mlcod=29'2214)", 2024-04-19T03:01:52.286 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:52.259339+0000", 2024-04-19T03:01:52.286 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 0.0019661510000000002, 2024-04-19T03:01:52.286 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0023686340000000001, 2024-04-19T03:01:52.286 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:01:52.286 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "started", 2024-04-19T03:01:52.286 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:01:52.286 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.286 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:01:52.286 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:52.259339+0000", 2024-04-19T03:01:52.286 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:52.286 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.286 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.287 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:01:52.287 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:52.259339+0000", 2024-04-19T03:01:52.287 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:52.287 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.287 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.287 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:01:52.287 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:52.259338+0000", 2024-04-19T03:01:52.287 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2024-04-19T03:01:52.287 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.287 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.287 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:01:52.287 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:52.259466+0000", 2024-04-19T03:01:52.287 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012827199999999999 2024-04-19T03:01:52.287 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.288 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.288 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:01:52.288 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:52.259484+0000", 2024-04-19T03:01:52.288 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.7510999999999999e-05 2024-04-19T03:01:52.288 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.288 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.288 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:01:52.288 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:52.259493+0000", 2024-04-19T03:01:52.288 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.115e-06 2024-04-19T03:01:52.288 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.288 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.288 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:52.288 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:52.259547+0000", 2024-04-19T03:01:52.288 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.3677999999999997e-05 2024-04-19T03:01:52.288 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.289 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.289 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:01:52.289 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:52.259566+0000", 2024-04-19T03:01:52.289 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.9701999999999999e-05 2024-04-19T03:01:52.289 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:52.289 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:52.289 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:52.289 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.289 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.289 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4755.0:34821 5.a 5:5ab49eb1:::benchmark_data_smithi096_19531_object34820:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-19T03:01:52.289 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:52.259669+0000", 2024-04-19T03:01:52.289 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 0.001636537, 2024-04-19T03:01:52.289 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0020999410000000001, 2024-04-19T03:01:52.289 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:01:52.289 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:01:52.290 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-04-19T03:01:52.290 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4755", 2024-04-19T03:01:52.290 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:52.290 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 34821 2024-04-19T03:01:52.290 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.290 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:01:52.290 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.290 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:01:52.290 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:52.259669+0000", 2024-04-19T03:01:52.290 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:52.290 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.290 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.290 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:01:52.291 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:52.259669+0000", 2024-04-19T03:01:52.291 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:52.291 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.291 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.291 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:01:52.291 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:52.259667+0000", 2024-04-19T03:01:52.291 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999986 2024-04-19T03:01:52.291 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.291 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.291 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:01:52.291 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:52.259698+0000", 2024-04-19T03:01:52.291 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1217000000000003e-05 2024-04-19T03:01:52.291 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.291 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.291 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:01:52.292 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:52.259715+0000", 2024-04-19T03:01:52.292 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.6371e-05 2024-04-19T03:01:52.292 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.292 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.292 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:01:52.292 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:52.259723+0000", 2024-04-19T03:01:52.292 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.2519999999999999e-06 2024-04-19T03:01:52.292 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.292 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.292 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:52.292 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:52.259779+0000", 2024-04-19T03:01:52.292 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.5862999999999997e-05 2024-04-19T03:01:52.292 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.292 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.292 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:01:52.293 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:52.259934+0000", 2024-04-19T03:01:52.293 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00015473099999999999 2024-04-19T03:01:52.293 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.293 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.293 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 1", 2024-04-19T03:01:52.293 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:52.260091+0000", 2024-04-19T03:01:52.293 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000157765 2024-04-19T03:01:52.293 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:52.293 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:52.293 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:52.293 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.293 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.293 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4755.0:34820 5.8 e29/22 5:1651c683:::benchmark_data_smithi096_19531_object34819:head v 29'2177, mlcod=29'2175)", 2024-04-19T03:01:52.293 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:52.259868+0000", 2024-04-19T03:01:52.293 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 0.0014371480000000001, 2024-04-19T03:01:52.294 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001972578, 2024-04-19T03:01:52.294 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:01:52.294 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "started", 2024-04-19T03:01:52.294 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:01:52.294 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.294 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:01:52.294 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:52.259868+0000", 2024-04-19T03:01:52.294 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:52.294 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.294 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.294 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:01:52.294 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:52.259868+0000", 2024-04-19T03:01:52.294 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:52.295 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.295 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.295 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:01:52.295 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:52.259867+0000", 2024-04-19T03:01:52.295 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999995 2024-04-19T03:01:52.295 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.295 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.295 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:01:52.295 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:52.259997+0000", 2024-04-19T03:01:52.295 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00013001700000000001 2024-04-19T03:01:52.295 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.295 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.295 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:01:52.295 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:52.260006+0000", 2024-04-19T03:01:52.296 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.9199999999999993e-06 2024-04-19T03:01:52.296 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.296 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.296 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:01:52.296 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:52.260013+0000", 2024-04-19T03:01:52.296 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.6270000000000002e-06 2024-04-19T03:01:52.296 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.296 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.296 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:52.296 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:52.260070+0000", 2024-04-19T03:01:52.296 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.6796999999999998e-05 2024-04-19T03:01:52.296 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.296 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.296 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:01:52.297 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:52.260093+0000", 2024-04-19T03:01:52.297 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.3691000000000001e-05 2024-04-19T03:01:52.297 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:52.297 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:52.297 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:52.297 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.297 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.297 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4755.0:34823 5.2 e29/22 5:432b2d77:::benchmark_data_smithi096_19531_object34822:head v 29'2122, mlcod=29'2120)", 2024-04-19T03:01:52.297 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:52.260620+0000", 2024-04-19T03:01:52.297 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 0.00068500099999999997, 2024-04-19T03:01:52.297 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0012771379999999999, 2024-04-19T03:01:52.297 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:01:52.297 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "started", 2024-04-19T03:01:52.297 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:01:52.298 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.298 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:01:52.298 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:52.260620+0000", 2024-04-19T03:01:52.298 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:52.298 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.298 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.298 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:01:52.298 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:52.260620+0000", 2024-04-19T03:01:52.298 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:52.298 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.298 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.298 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:01:52.298 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:52.260619+0000", 2024-04-19T03:01:52.299 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2024-04-19T03:01:52.299 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.299 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.299 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:01:52.299 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:52.260899+0000", 2024-04-19T03:01:52.299 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00027967900000000002 2024-04-19T03:01:52.299 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.299 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.299 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:01:52.299 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:52.260907+0000", 2024-04-19T03:01:52.299 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.3890000000000005e-06 2024-04-19T03:01:52.299 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.299 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.300 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:01:52.300 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:52.260914+0000", 2024-04-19T03:01:52.300 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.1229999999999997e-06 2024-04-19T03:01:52.300 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.300 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.300 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:52.300 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:52.260968+0000", 2024-04-19T03:01:52.300 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.3984999999999999e-05 2024-04-19T03:01:52.300 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.300 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.300 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:01:52.300 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:52.260985+0000", 2024-04-19T03:01:52.300 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.7847e-05 2024-04-19T03:01:52.300 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:52.300 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:52.301 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:52.301 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.301 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.301 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4755.0:34822 5.4 e29/22 5:2d935b17:::benchmark_data_smithi096_19531_object34821:head v 29'2124, mlcod=29'2121)", 2024-04-19T03:01:52.301 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:52.260832+0000", 2024-04-19T03:01:52.301 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 0.00047342, 2024-04-19T03:01:52.301 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001122774, 2024-04-19T03:01:52.301 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:01:52.301 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "started", 2024-04-19T03:01:52.301 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:01:52.301 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.301 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:01:52.301 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:52.260832+0000", 2024-04-19T03:01:52.301 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:52.301 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.302 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.302 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:01:52.302 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:52.260832+0000", 2024-04-19T03:01:52.302 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:52.302 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.302 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.302 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:01:52.302 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:52.260831+0000", 2024-04-19T03:01:52.302 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2024-04-19T03:01:52.302 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.302 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.302 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:01:52.302 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:52.260976+0000", 2024-04-19T03:01:52.303 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014517299999999999 2024-04-19T03:01:52.303 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.303 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.303 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:01:52.303 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:52.260987+0000", 2024-04-19T03:01:52.303 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1302e-05 2024-04-19T03:01:52.303 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.303 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.303 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:01:52.303 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:52.260995+0000", 2024-04-19T03:01:52.303 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.5639999999999999e-06 2024-04-19T03:01:52.303 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.303 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.303 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:52.303 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:52.261033+0000", 2024-04-19T03:01:52.304 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.8770999999999999e-05 2024-04-19T03:01:52.304 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.304 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.304 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:01:52.304 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:52.261052+0000", 2024-04-19T03:01:52.304 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.8326e-05 2024-04-19T03:01:52.304 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:52.304 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:52.304 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:52.304 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.304 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.304 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4755.0:34825 5.3 5:ca07253e:::benchmark_data_smithi096_19531_object34824:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-19T03:01:52.304 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:52.261298+0000", 2024-04-19T03:01:52.304 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 7.5650000000000004e-06, 2024-04-19T03:01:52.304 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00071804699999999998, 2024-04-19T03:01:52.305 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:01:52.305 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:01:52.305 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-04-19T03:01:52.305 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4755", 2024-04-19T03:01:52.305 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:52.305 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 34825 2024-04-19T03:01:52.305 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.305 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:01:52.305 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.305 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:01:52.305 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:52.261298+0000", 2024-04-19T03:01:52.305 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:52.305 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.305 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.305 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:01:52.306 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:52.261298+0000", 2024-04-19T03:01:52.306 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:52.306 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.306 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.306 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:01:52.306 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:52.261297+0000", 2024-04-19T03:01:52.306 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2024-04-19T03:01:52.306 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.306 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.306 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:01:52.306 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:52.261388+0000", 2024-04-19T03:01:52.306 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.1070999999999996e-05 2024-04-19T03:01:52.306 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.306 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.307 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:01:52.307 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:52.261400+0000", 2024-04-19T03:01:52.307 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.234e-05 2024-04-19T03:01:52.307 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.307 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.307 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:01:52.307 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:52.261409+0000", 2024-04-19T03:01:52.307 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.9979999999999992e-06 2024-04-19T03:01:52.307 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.307 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.307 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:52.307 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:52.261457+0000", 2024-04-19T03:01:52.307 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.7722000000000002e-05 2024-04-19T03:01:52.307 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.308 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.308 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:01:52.308 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:52.261596+0000", 2024-04-19T03:01:52.308 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00013940600000000001 2024-04-19T03:01:52.308 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.308 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.308 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-04-19T03:01:52.308 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:52.261744+0000", 2024-04-19T03:01:52.308 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014819200000000001 2024-04-19T03:01:52.308 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:52.308 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:52.308 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:52.308 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:52.308 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2024-04-19T03:01:52.308 INFO:teuthology.orchestra.run.smithi097.stdout: "num_ops": 11 2024-04-19T03:01:52.309 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-04-19T03:01:52.309 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T03:01:52.334 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:01:52.332+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:01:52.434 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:01:52.432+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:01:52.437 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-04-19T03:01:52.438 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [], 2024-04-19T03:01:52.438 INFO:teuthology.orchestra.run.smithi097.stdout: "complaint_time": 30, 2024-04-19T03:01:52.438 INFO:teuthology.orchestra.run.smithi097.stdout: "num_blocked_ops": 0 2024-04-19T03:01:52.438 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-04-19T03:01:52.451 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T03:01:52.535 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:01:52.533+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:01:52.582 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-04-19T03:01:52.582 INFO:teuthology.orchestra.run.smithi097.stdout: "size": 20, 2024-04-19T03:01:52.583 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 600, 2024-04-19T03:01:52.583 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [ 2024-04-19T03:01:52.583 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.583 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:01:52.583 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:14.996966+0000", 2024-04-19T03:01:52.583 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 37.577355449000002, 2024-04-19T03:01:52.583 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.018946704000000002, 2024-04-19T03:01:52.583 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:01:52.583 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:52.583 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:01:52.583 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.583 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:01:52.583 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.996966+0000", 2024-04-19T03:01:52.583 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:52.584 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.584 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.584 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:01:52.584 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.996966+0000", 2024-04-19T03:01:52.584 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:52.584 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.584 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.584 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:01:52.584 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.996964+0000", 2024-04-19T03:01:52.584 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999971 2024-04-19T03:01:52.584 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.584 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.584 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:01:52.584 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.996982+0000", 2024-04-19T03:01:52.585 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.8306999999999999e-05 2024-04-19T03:01:52.585 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.585 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.585 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:01:52.585 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997027+0000", 2024-04-19T03:01:52.585 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.5274000000000001e-05 2024-04-19T03:01:52.585 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.585 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.585 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:01:52.585 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997047+0000", 2024-04-19T03:01:52.585 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.9726999999999999e-05 2024-04-19T03:01:52.585 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.585 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.585 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:52.586 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997203+0000", 2024-04-19T03:01:52.586 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000155847 2024-04-19T03:01:52.586 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.586 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.586 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op must wait for map", 2024-04-19T03:01:52.586 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997249+0000", 2024-04-19T03:01:52.586 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.5824e-05 2024-04-19T03:01:52.586 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.586 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.586 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:52.586 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.007264+0000", 2024-04-19T03:01:52.586 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.010015909 2024-04-19T03:01:52.586 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.587 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.587 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:01:52.587 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.007394+0000", 2024-04-19T03:01:52.587 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012931999999999999 2024-04-19T03:01:52.587 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.587 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.587 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-04-19T03:01:52.587 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.007537+0000", 2024-04-19T03:01:52.587 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014365 2024-04-19T03:01:52.587 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.587 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.587 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:01:52.587 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.012444+0000", 2024-04-19T03:01:52.587 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0049067260000000001 2024-04-19T03:01:52.588 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.588 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.588 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:52.588 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.015791+0000", 2024-04-19T03:01:52.588 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0033471109999999998 2024-04-19T03:01:52.588 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.588 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.588 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:01:52.588 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.015845+0000", 2024-04-19T03:01:52.588 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.4236e-05 2024-04-19T03:01:52.588 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.588 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.588 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:01:52.589 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.015913+0000", 2024-04-19T03:01:52.589 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.7397000000000005e-05 2024-04-19T03:01:52.589 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:52.589 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:52.589 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:52.589 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.589 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.589 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(mds.0.3:14 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:01:52.589 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:14.997079+0000", 2024-04-19T03:01:52.589 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 37.577242865000002, 2024-04-19T03:01:52.589 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.021951970000000001, 2024-04-19T03:01:52.589 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:01:52.589 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:52.589 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:01:52.590 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.590 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:01:52.590 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997079+0000", 2024-04-19T03:01:52.590 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:52.590 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.590 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.590 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:01:52.590 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997079+0000", 2024-04-19T03:01:52.590 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:52.590 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.590 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.590 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:01:52.590 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997077+0000", 2024-04-19T03:01:52.591 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999986 2024-04-19T03:01:52.591 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.591 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.591 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:01:52.591 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997087+0000", 2024-04-19T03:01:52.591 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.006e-05 2024-04-19T03:01:52.591 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.591 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.591 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:01:52.591 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997105+0000", 2024-04-19T03:01:52.591 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.8026999999999999e-05 2024-04-19T03:01:52.591 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.591 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.591 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:01:52.591 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997135+0000", 2024-04-19T03:01:52.592 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.9643000000000001e-05 2024-04-19T03:01:52.592 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.592 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.592 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:52.592 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997208+0000", 2024-04-19T03:01:52.592 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.3419999999999998e-05 2024-04-19T03:01:52.592 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.592 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.592 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op must wait for map", 2024-04-19T03:01:52.592 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997244+0000", 2024-04-19T03:01:52.592 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.5367000000000002e-05 2024-04-19T03:01:52.592 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.592 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.592 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:52.593 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.007357+0000", 2024-04-19T03:01:52.593 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.010112703000000001 2024-04-19T03:01:52.593 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.593 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.593 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:01:52.593 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.007479+0000", 2024-04-19T03:01:52.593 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012279599999999999 2024-04-19T03:01:52.593 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.593 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.593 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 1", 2024-04-19T03:01:52.593 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.007610+0000", 2024-04-19T03:01:52.593 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00013093499999999999 2024-04-19T03:01:52.593 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.594 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.594 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:01:52.594 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.012526+0000", 2024-04-19T03:01:52.594 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0049157519999999998 2024-04-19T03:01:52.594 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.594 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.594 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:52.594 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.018959+0000", 2024-04-19T03:01:52.594 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0064326009999999996 2024-04-19T03:01:52.594 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.594 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.594 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:01:52.594 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.019005+0000", 2024-04-19T03:01:52.595 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.6066999999999998e-05 2024-04-19T03:01:52.595 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.595 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.595 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:01:52.595 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.019031+0000", 2024-04-19T03:01:52.595 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.6009000000000001e-05 2024-04-19T03:01:52.595 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:52.595 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:52.595 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:52.595 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.595 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.595 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:01:52.595 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:14.997149+0000", 2024-04-19T03:01:52.595 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 37.577172245, 2024-04-19T03:01:52.596 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.021805590999999999, 2024-04-19T03:01:52.596 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:01:52.596 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:52.596 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:01:52.596 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.596 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:01:52.596 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997149+0000", 2024-04-19T03:01:52.596 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:52.596 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.596 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.596 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:01:52.596 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997149+0000", 2024-04-19T03:01:52.596 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:52.596 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.597 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.597 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:01:52.597 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997148+0000", 2024-04-19T03:01:52.597 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2024-04-19T03:01:52.597 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.597 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.597 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:01:52.597 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997166+0000", 2024-04-19T03:01:52.597 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.8233e-05 2024-04-19T03:01:52.597 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.598 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.598 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:01:52.598 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997182+0000", 2024-04-19T03:01:52.598 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5999999999999999e-05 2024-04-19T03:01:52.598 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.598 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.598 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:01:52.598 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997195+0000", 2024-04-19T03:01:52.598 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.252e-05 2024-04-19T03:01:52.598 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.598 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.598 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:52.599 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997348+0000", 2024-04-19T03:01:52.599 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000153115 2024-04-19T03:01:52.599 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.599 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.599 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:01:52.599 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997354+0000", 2024-04-19T03:01:52.599 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.9359999999999996e-06 2024-04-19T03:01:52.599 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.599 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.599 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:52.599 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.008147+0000", 2024-04-19T03:01:52.599 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.010793127 2024-04-19T03:01:52.599 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.599 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.600 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:01:52.600 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.008225+0000", 2024-04-19T03:01:52.600 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.7935999999999994e-05 2024-04-19T03:01:52.600 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.600 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.600 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-04-19T03:01:52.600 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.008377+0000", 2024-04-19T03:01:52.600 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00015159099999999999 2024-04-19T03:01:52.600 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.600 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.600 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:01:52.600 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.012629+0000", 2024-04-19T03:01:52.600 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0042520420000000001 2024-04-19T03:01:52.600 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.601 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.601 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:52.601 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.018871+0000", 2024-04-19T03:01:52.601 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0062425060000000001 2024-04-19T03:01:52.601 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.601 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.601 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:01:52.601 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.018910+0000", 2024-04-19T03:01:52.601 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.8482999999999997e-05 2024-04-19T03:01:52.601 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.601 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.601 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:01:52.601 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.018955+0000", 2024-04-19T03:01:52.601 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.5252e-05 2024-04-19T03:01:52.602 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:52.602 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:52.602 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:52.602 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.602 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.602 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(mds.0.3:36 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:01:52.602 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:14.997207+0000", 2024-04-19T03:01:52.602 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 37.577114694999999, 2024-04-19T03:01:52.602 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.022210431999999999, 2024-04-19T03:01:52.602 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:01:52.602 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:52.602 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:01:52.602 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.602 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:01:52.603 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997207+0000", 2024-04-19T03:01:52.603 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:52.603 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.603 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.603 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:01:52.603 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997207+0000", 2024-04-19T03:01:52.603 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:52.603 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.603 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.603 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:01:52.603 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997206+0000", 2024-04-19T03:01:52.603 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2024-04-19T03:01:52.603 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.603 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.604 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:01:52.604 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997218+0000", 2024-04-19T03:01:52.604 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2607e-05 2024-04-19T03:01:52.604 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.604 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.604 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:01:52.604 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997234+0000", 2024-04-19T03:01:52.604 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5583999999999999e-05 2024-04-19T03:01:52.604 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.604 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.604 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:01:52.604 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997248+0000", 2024-04-19T03:01:52.604 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4270000000000001e-05 2024-04-19T03:01:52.604 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.605 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.605 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:52.605 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997397+0000", 2024-04-19T03:01:52.605 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0001482 2024-04-19T03:01:52.605 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.605 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.605 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:01:52.605 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997407+0000", 2024-04-19T03:01:52.605 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0944000000000001e-05 2024-04-19T03:01:52.605 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.605 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.605 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:52.605 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.008173+0000", 2024-04-19T03:01:52.605 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.010765378000000001 2024-04-19T03:01:52.606 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.606 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.606 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:01:52.606 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.008278+0000", 2024-04-19T03:01:52.606 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00010538 2024-04-19T03:01:52.606 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.606 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.606 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 1", 2024-04-19T03:01:52.606 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.008423+0000", 2024-04-19T03:01:52.606 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014525599999999999 2024-04-19T03:01:52.606 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.606 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.606 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:01:52.606 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.012734+0000", 2024-04-19T03:01:52.607 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0043108590000000002 2024-04-19T03:01:52.607 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.607 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.607 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:52.607 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.019318+0000", 2024-04-19T03:01:52.607 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0065836130000000003 2024-04-19T03:01:52.607 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.607 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.607 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:01:52.607 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.019382+0000", 2024-04-19T03:01:52.607 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.3925999999999997e-05 2024-04-19T03:01:52.607 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.607 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.607 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:01:52.608 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.019417+0000", 2024-04-19T03:01:52.608 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.5454999999999999e-05 2024-04-19T03:01:52.608 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:52.608 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:52.608 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:52.608 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.608 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.608 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(mds.0.3:15 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:01:52.608 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:14.997260+0000", 2024-04-19T03:01:52.608 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 37.577061544000003, 2024-04-19T03:01:52.608 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.021842842000000001, 2024-04-19T03:01:52.608 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:01:52.608 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:52.609 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:01:52.609 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.609 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:01:52.609 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997260+0000", 2024-04-19T03:01:52.609 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:52.609 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.609 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.609 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:01:52.609 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997260+0000", 2024-04-19T03:01:52.609 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:52.609 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.609 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.609 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:01:52.609 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997259+0000", 2024-04-19T03:01:52.609 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999995 2024-04-19T03:01:52.610 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.610 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.610 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:01:52.610 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997270+0000", 2024-04-19T03:01:52.610 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0312999999999999e-05 2024-04-19T03:01:52.610 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.610 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.610 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:01:52.610 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997279+0000", 2024-04-19T03:01:52.610 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.7770000000000008e-06 2024-04-19T03:01:52.610 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.610 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.610 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:01:52.611 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997286+0000", 2024-04-19T03:01:52.611 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.0129999999999996e-06 2024-04-19T03:01:52.611 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.611 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.611 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:52.611 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997433+0000", 2024-04-19T03:01:52.611 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014774699999999999 2024-04-19T03:01:52.611 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.611 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.611 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:01:52.611 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997443+0000", 2024-04-19T03:01:52.611 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.414e-06 2024-04-19T03:01:52.611 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.612 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.612 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:52.612 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.008673+0000", 2024-04-19T03:01:52.612 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.011230789999999999 2024-04-19T03:01:52.612 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.612 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.612 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:01:52.612 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.008808+0000", 2024-04-19T03:01:52.612 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000134346 2024-04-19T03:01:52.612 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.612 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.612 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-04-19T03:01:52.612 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.008922+0000", 2024-04-19T03:01:52.612 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000114444 2024-04-19T03:01:52.613 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.613 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.613 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:01:52.613 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.013442+0000", 2024-04-19T03:01:52.613 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0045193439999999998 2024-04-19T03:01:52.613 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.613 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.613 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:52.613 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.019005+0000", 2024-04-19T03:01:52.613 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00556333 2024-04-19T03:01:52.613 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.613 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.613 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:01:52.613 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.019049+0000", 2024-04-19T03:01:52.614 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.4240000000000003e-05 2024-04-19T03:01:52.614 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.614 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.614 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:01:52.614 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.019103+0000", 2024-04-19T03:01:52.614 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.3706999999999999e-05 2024-04-19T03:01:52.614 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:52.614 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:52.614 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:52.614 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.614 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.614 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(mds.0.3:17 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:01:52.614 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:14.997292+0000", 2024-04-19T03:01:52.615 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 37.577029817000003, 2024-04-19T03:01:52.615 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.019573165999999999, 2024-04-19T03:01:52.615 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:01:52.615 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:52.615 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:01:52.615 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.615 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:01:52.615 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997292+0000", 2024-04-19T03:01:52.615 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:52.615 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.615 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.615 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:01:52.615 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997292+0000", 2024-04-19T03:01:52.615 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:52.615 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.616 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.616 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:01:52.616 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997291+0000", 2024-04-19T03:01:52.616 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999995 2024-04-19T03:01:52.616 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.616 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.616 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:01:52.616 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997297+0000", 2024-04-19T03:01:52.616 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.3900000000000001e-06 2024-04-19T03:01:52.616 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.616 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.616 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:01:52.616 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997316+0000", 2024-04-19T03:01:52.617 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.9406e-05 2024-04-19T03:01:52.617 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.617 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.617 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:01:52.617 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997353+0000", 2024-04-19T03:01:52.617 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.6563999999999998e-05 2024-04-19T03:01:52.617 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.617 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.617 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:52.617 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997447+0000", 2024-04-19T03:01:52.617 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.4463999999999995e-05 2024-04-19T03:01:52.617 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.617 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.617 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op must wait for map", 2024-04-19T03:01:52.618 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997458+0000", 2024-04-19T03:01:52.618 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0817e-05 2024-04-19T03:01:52.618 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.618 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.618 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:52.618 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.002013+0000", 2024-04-19T03:01:52.618 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.004555229 2024-04-19T03:01:52.618 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.618 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.618 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:01:52.618 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.002943+0000", 2024-04-19T03:01:52.618 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00092983200000000001 2024-04-19T03:01:52.618 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.619 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.619 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-04-19T03:01:52.619 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.003257+0000", 2024-04-19T03:01:52.619 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00031455399999999998 2024-04-19T03:01:52.619 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.619 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.619 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:01:52.619 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.014107+0000", 2024-04-19T03:01:52.619 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.010849648 2024-04-19T03:01:52.619 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.619 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.619 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:52.619 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.016767+0000", 2024-04-19T03:01:52.619 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0026594990000000001 2024-04-19T03:01:52.620 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.620 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.620 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:01:52.620 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.016825+0000", 2024-04-19T03:01:52.620 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.8264000000000003e-05 2024-04-19T03:01:52.620 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.620 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.620 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:01:52.620 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.016865+0000", 2024-04-19T03:01:52.620 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.0108999999999998e-05 2024-04-19T03:01:52.620 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:52.620 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:52.620 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:52.620 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.621 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.621 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(mds.0.3:22 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:01:52.621 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:14.997383+0000", 2024-04-19T03:01:52.621 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 37.576939037000002, 2024-04-19T03:01:52.621 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.019634641000000001, 2024-04-19T03:01:52.621 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:01:52.621 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "started", 2024-04-19T03:01:52.621 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:01:52.621 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.621 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:01:52.621 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997383+0000", 2024-04-19T03:01:52.621 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:52.621 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.621 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.621 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:01:52.622 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997383+0000", 2024-04-19T03:01:52.622 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:52.622 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.622 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.622 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:01:52.622 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997381+0000", 2024-04-19T03:01:52.622 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999986 2024-04-19T03:01:52.622 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.622 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.622 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:01:52.622 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997399+0000", 2024-04-19T03:01:52.622 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.802e-05 2024-04-19T03:01:52.623 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.623 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.623 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:01:52.623 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997417+0000", 2024-04-19T03:01:52.623 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.7581e-05 2024-04-19T03:01:52.623 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.623 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.623 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:01:52.623 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997429+0000", 2024-04-19T03:01:52.623 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1803e-05 2024-04-19T03:01:52.623 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.623 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.623 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:52.623 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997540+0000", 2024-04-19T03:01:52.623 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000111397 2024-04-19T03:01:52.624 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.624 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.624 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:01:52.624 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997552+0000", 2024-04-19T03:01:52.624 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1643e-05 2024-04-19T03:01:52.624 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.624 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.624 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:52.624 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.006836+0000", 2024-04-19T03:01:52.624 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0092841940000000008 2024-04-19T03:01:52.624 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.624 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.624 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:01:52.625 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.006982+0000", 2024-04-19T03:01:52.625 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014572899999999999 2024-04-19T03:01:52.625 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.625 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.625 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:01:52.625 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.017017+0000", 2024-04-19T03:01:52.625 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.010035571 2024-04-19T03:01:52.625 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:52.625 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:52.625 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:52.625 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.625 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.625 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(mds.0.3:23 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:01:52.626 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:14.997449+0000", 2024-04-19T03:01:52.626 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 37.576872496, 2024-04-19T03:01:52.626 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.022679250000000001, 2024-04-19T03:01:52.626 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:01:52.626 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "started", 2024-04-19T03:01:52.626 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:01:52.626 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.626 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:01:52.626 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997449+0000", 2024-04-19T03:01:52.626 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:52.626 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.626 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.626 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:01:52.626 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997449+0000", 2024-04-19T03:01:52.627 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:52.627 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.627 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.627 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:01:52.627 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997448+0000", 2024-04-19T03:01:52.627 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999995 2024-04-19T03:01:52.627 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.627 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.627 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:01:52.627 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997452+0000", 2024-04-19T03:01:52.627 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.0369999999999996e-06 2024-04-19T03:01:52.627 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.627 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.627 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:01:52.628 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997461+0000", 2024-04-19T03:01:52.628 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.6100000000000006e-06 2024-04-19T03:01:52.628 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.628 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.628 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:01:52.628 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997468+0000", 2024-04-19T03:01:52.628 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.8360000000000003e-06 2024-04-19T03:01:52.628 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.628 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.628 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:52.628 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997546+0000", 2024-04-19T03:01:52.628 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.7956999999999999e-05 2024-04-19T03:01:52.628 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.628 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.629 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:01:52.629 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997555+0000", 2024-04-19T03:01:52.629 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.2269999999999999e-06 2024-04-19T03:01:52.629 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.629 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.629 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:52.629 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.010065+0000", 2024-04-19T03:01:52.629 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.012509457999999999 2024-04-19T03:01:52.629 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.629 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.629 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:01:52.629 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.010187+0000", 2024-04-19T03:01:52.629 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000122059 2024-04-19T03:01:52.630 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.630 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.630 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:01:52.630 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.020128+0000", 2024-04-19T03:01:52.630 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0099417529999999994 2024-04-19T03:01:52.630 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:52.630 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:52.630 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:52.630 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.630 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.630 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(mds.0.3:25 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:01:52.630 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:14.997485+0000", 2024-04-19T03:01:52.630 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 37.57683703, 2024-04-19T03:01:52.630 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.021633427, 2024-04-19T03:01:52.631 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:01:52.631 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "started", 2024-04-19T03:01:52.631 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:01:52.631 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.631 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:01:52.631 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997485+0000", 2024-04-19T03:01:52.631 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:52.631 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.631 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.631 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:01:52.631 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997485+0000", 2024-04-19T03:01:52.631 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:52.631 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.631 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.632 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:01:52.632 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997484+0000", 2024-04-19T03:01:52.632 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2024-04-19T03:01:52.632 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.632 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.632 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:01:52.632 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997490+0000", 2024-04-19T03:01:52.632 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.857e-06 2024-04-19T03:01:52.632 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.632 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.632 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:01:52.632 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997505+0000", 2024-04-19T03:01:52.632 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.518e-05 2024-04-19T03:01:52.633 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.633 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.633 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:01:52.633 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997520+0000", 2024-04-19T03:01:52.633 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5026e-05 2024-04-19T03:01:52.633 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.633 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.633 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:52.633 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997607+0000", 2024-04-19T03:01:52.633 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.7107000000000005e-05 2024-04-19T03:01:52.633 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.633 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.633 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op must wait for map", 2024-04-19T03:01:52.633 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997614+0000", 2024-04-19T03:01:52.634 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.0539999999999997e-06 2024-04-19T03:01:52.634 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.634 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.634 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:52.634 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.009808+0000", 2024-04-19T03:01:52.634 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.012194371000000001 2024-04-19T03:01:52.634 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.634 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.634 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:01:52.634 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.010107+0000", 2024-04-19T03:01:52.634 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000298731 2024-04-19T03:01:52.634 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.634 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.634 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:01:52.635 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.019118+0000", 2024-04-19T03:01:52.635 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0090109839999999997 2024-04-19T03:01:52.635 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:52.635 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:52.635 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:52.635 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.635 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.635 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4755.0:11277 5.c 5:38c3ceb2:::benchmark_data_smithi096_19531_object11276:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T03:01:52.635 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:42.059676+0000", 2024-04-19T03:01:52.635 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 10.514645408, 2024-04-19T03:01:52.635 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.029909680000000001, 2024-04-19T03:01:52.635 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:01:52.635 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:52.635 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-04-19T03:01:52.635 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4755", 2024-04-19T03:01:52.636 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:52.636 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 11277 2024-04-19T03:01:52.636 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.636 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:01:52.636 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.636 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:01:52.636 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.059676+0000", 2024-04-19T03:01:52.636 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:52.636 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.636 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.636 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:01:52.636 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.059676+0000", 2024-04-19T03:01:52.636 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:52.636 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.637 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.637 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:01:52.637 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.059665+0000", 2024-04-19T03:01:52.637 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999886 2024-04-19T03:01:52.637 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.637 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.637 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:01:52.637 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.059777+0000", 2024-04-19T03:01:52.637 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000111953 2024-04-19T03:01:52.637 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.637 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.637 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:01:52.637 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.059789+0000", 2024-04-19T03:01:52.637 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1809e-05 2024-04-19T03:01:52.637 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.638 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.638 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:01:52.638 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.059797+0000", 2024-04-19T03:01:52.638 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.2090000000000005e-06 2024-04-19T03:01:52.638 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.638 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.638 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:52.638 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.060528+0000", 2024-04-19T03:01:52.638 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00073144499999999995 2024-04-19T03:01:52.638 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.638 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.638 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:01:52.638 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.060662+0000", 2024-04-19T03:01:52.639 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000133435 2024-04-19T03:01:52.639 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.639 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.639 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-04-19T03:01:52.639 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.060766+0000", 2024-04-19T03:01:52.639 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00010473500000000001 2024-04-19T03:01:52.639 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.639 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.639 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:01:52.639 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.067649+0000", 2024-04-19T03:01:52.639 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.006882684 2024-04-19T03:01:52.639 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.639 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.639 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:52.640 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.089475+0000", 2024-04-19T03:01:52.640 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.021826196999999999 2024-04-19T03:01:52.640 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.640 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.640 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:01:52.640 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.089535+0000", 2024-04-19T03:01:52.640 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.9239e-05 2024-04-19T03:01:52.640 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.640 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.640 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:01:52.640 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.089586+0000", 2024-04-19T03:01:52.640 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.1288000000000001e-05 2024-04-19T03:01:52.640 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:52.640 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:52.641 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:52.641 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.641 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.641 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4755.0:11280 5.6 5:6e34f5e7:::benchmark_data_smithi096_19531_object11279:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T03:01:52.641 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:42.060002+0000", 2024-04-19T03:01:52.641 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 10.514320032000001, 2024-04-19T03:01:52.641 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.028171841999999999, 2024-04-19T03:01:52.641 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:01:52.641 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:52.641 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-04-19T03:01:52.641 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4755", 2024-04-19T03:01:52.641 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:52.641 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 11280 2024-04-19T03:01:52.642 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.642 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:01:52.642 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.642 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:01:52.642 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.060002+0000", 2024-04-19T03:01:52.642 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:52.642 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.642 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.642 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:01:52.642 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.060002+0000", 2024-04-19T03:01:52.642 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:52.642 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.642 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.643 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:01:52.643 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.060000+0000", 2024-04-19T03:01:52.643 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2024-04-19T03:01:52.643 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.643 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.643 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:01:52.643 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.060120+0000", 2024-04-19T03:01:52.643 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00011941400000000001 2024-04-19T03:01:52.643 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.643 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.643 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:01:52.643 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.060132+0000", 2024-04-19T03:01:52.643 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2197e-05 2024-04-19T03:01:52.643 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.644 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.644 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:01:52.644 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.060141+0000", 2024-04-19T03:01:52.644 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.6829999999999997e-06 2024-04-19T03:01:52.644 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.644 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.644 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:52.644 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.060194+0000", 2024-04-19T03:01:52.644 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.3395e-05 2024-04-19T03:01:52.644 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.644 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.644 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:01:52.644 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.060333+0000", 2024-04-19T03:01:52.644 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00013935799999999999 2024-04-19T03:01:52.645 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.645 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.645 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-04-19T03:01:52.645 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.060477+0000", 2024-04-19T03:01:52.645 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000143938 2024-04-19T03:01:52.645 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.645 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.645 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:01:52.645 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.067752+0000", 2024-04-19T03:01:52.645 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0072741580000000002 2024-04-19T03:01:52.645 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.645 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.645 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:52.645 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.088041+0000", 2024-04-19T03:01:52.646 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.020288955000000001 2024-04-19T03:01:52.646 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.646 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.646 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:01:52.646 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.088113+0000", 2024-04-19T03:01:52.646 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.2492999999999999e-05 2024-04-19T03:01:52.646 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.646 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.646 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:01:52.646 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.088173+0000", 2024-04-19T03:01:52.646 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.0418999999999999e-05 2024-04-19T03:01:52.646 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:52.646 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:52.647 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:52.647 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.647 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.647 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4755.0:11274 5.e e26/22 5:7c846032:::benchmark_data_smithi096_19531_object11273:head v 26'697, mlcod=26'692)", 2024-04-19T03:01:52.647 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:42.065726+0000", 2024-04-19T03:01:52.647 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 10.508595505000001, 2024-04-19T03:01:52.647 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.028607227999999998, 2024-04-19T03:01:52.647 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:01:52.647 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:52.647 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:01:52.647 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.647 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:01:52.647 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.065726+0000", 2024-04-19T03:01:52.647 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:52.647 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.648 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.648 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:01:52.648 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.065726+0000", 2024-04-19T03:01:52.648 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:52.648 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.648 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.648 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:01:52.648 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.065725+0000", 2024-04-19T03:01:52.648 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2024-04-19T03:01:52.648 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.648 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.648 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:01:52.648 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.066818+0000", 2024-04-19T03:01:52.649 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0010930110000000001 2024-04-19T03:01:52.649 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.649 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.649 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:01:52.649 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.066826+0000", 2024-04-19T03:01:52.649 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.0609999999999996e-06 2024-04-19T03:01:52.649 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.649 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.649 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:01:52.649 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.066831+0000", 2024-04-19T03:01:52.649 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.7500000000000003e-06 2024-04-19T03:01:52.649 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.649 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.649 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:52.650 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.066857+0000", 2024-04-19T03:01:52.650 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.6126999999999999e-05 2024-04-19T03:01:52.650 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.650 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.650 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:01:52.650 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.066868+0000", 2024-04-19T03:01:52.650 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1113e-05 2024-04-19T03:01:52.650 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.650 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.650 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:01:52.650 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.094266+0000", 2024-04-19T03:01:52.650 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.027397731000000002 2024-04-19T03:01:52.650 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.651 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.651 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:01:52.651 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.094333+0000", 2024-04-19T03:01:52.651 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.7230000000000005e-05 2024-04-19T03:01:52.651 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:52.651 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:52.651 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:52.651 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.651 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.651 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4755.0:11279 5.8 e26/22 5:10b60c58:::benchmark_data_smithi096_19531_object11278:head v 26'723, mlcod=26'719)", 2024-04-19T03:01:52.651 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:42.066841+0000", 2024-04-19T03:01:52.651 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 10.507480190000001, 2024-04-19T03:01:52.651 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.021736267, 2024-04-19T03:01:52.651 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:01:52.651 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:52.652 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:01:52.652 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.652 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:01:52.652 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.066841+0000", 2024-04-19T03:01:52.652 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:52.652 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.652 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.652 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:01:52.652 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.066841+0000", 2024-04-19T03:01:52.652 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:52.652 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.652 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.652 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:01:52.652 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.066841+0000", 2024-04-19T03:01:52.653 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999995 2024-04-19T03:01:52.653 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.653 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.653 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:01:52.653 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.066876+0000", 2024-04-19T03:01:52.653 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.4790999999999999e-05 2024-04-19T03:01:52.653 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.653 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.653 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:01:52.653 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.066880+0000", 2024-04-19T03:01:52.653 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.3610000000000003e-06 2024-04-19T03:01:52.653 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.653 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.654 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:01:52.654 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.066883+0000", 2024-04-19T03:01:52.654 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.4079999999999998e-06 2024-04-19T03:01:52.654 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.654 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.654 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:52.654 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.066929+0000", 2024-04-19T03:01:52.654 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.5444000000000001e-05 2024-04-19T03:01:52.654 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.654 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.654 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:01:52.654 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.066951+0000", 2024-04-19T03:01:52.654 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.2578999999999998e-05 2024-04-19T03:01:52.654 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.655 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.655 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:01:52.655 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.088518+0000", 2024-04-19T03:01:52.655 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.021566617 2024-04-19T03:01:52.655 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.655 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.655 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:01:52.655 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.088578+0000", 2024-04-19T03:01:52.655 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.9655999999999999e-05 2024-04-19T03:01:52.655 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:52.655 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:52.655 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:52.655 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.655 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.656 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4755.0:11282 5.e e26/22 5:75b7c510:::benchmark_data_smithi096_19531_object11281:head v 26'698, mlcod=26'693)", 2024-04-19T03:01:52.656 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:42.066923+0000", 2024-04-19T03:01:52.656 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 10.507398323, 2024-04-19T03:01:52.656 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.027436461999999998, 2024-04-19T03:01:52.656 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:01:52.656 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:52.656 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:01:52.656 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.656 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:01:52.656 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.066923+0000", 2024-04-19T03:01:52.656 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:52.656 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.656 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.656 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:01:52.657 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.066923+0000", 2024-04-19T03:01:52.657 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:52.657 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.657 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.657 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:01:52.657 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.066923+0000", 2024-04-19T03:01:52.657 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999995 2024-04-19T03:01:52.657 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.658 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.658 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:01:52.658 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.066955+0000", 2024-04-19T03:01:52.658 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.2060999999999997e-05 2024-04-19T03:01:52.658 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.658 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.658 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:01:52.658 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.066962+0000", 2024-04-19T03:01:52.658 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.1969999999999999e-06 2024-04-19T03:01:52.658 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.658 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.658 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:01:52.658 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.066967+0000", 2024-04-19T03:01:52.659 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.6589999999999998e-06 2024-04-19T03:01:52.659 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.659 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.659 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:52.659 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.067762+0000", 2024-04-19T03:01:52.659 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00079538199999999997 2024-04-19T03:01:52.659 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.659 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.659 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:01:52.659 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.067782+0000", 2024-04-19T03:01:52.659 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.9432999999999998e-05 2024-04-19T03:01:52.659 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.659 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.659 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:01:52.660 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.094339+0000", 2024-04-19T03:01:52.660 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.026556778999999999 2024-04-19T03:01:52.660 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.660 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.660 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:01:52.660 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.094360+0000", 2024-04-19T03:01:52.660 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.1246e-05 2024-04-19T03:01:52.660 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:52.660 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:52.660 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:52.660 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.660 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.660 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4755.0:11291 5.a 5:5ee9d828:::benchmark_data_smithi096_19531_object11290:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T03:01:52.660 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:42.067725+0000", 2024-04-19T03:01:52.661 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 10.506596213, 2024-04-19T03:01:52.661 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.021089111000000001, 2024-04-19T03:01:52.661 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:01:52.661 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:52.661 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-04-19T03:01:52.661 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4755", 2024-04-19T03:01:52.661 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:52.661 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 11291 2024-04-19T03:01:52.661 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.661 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:01:52.661 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.661 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:01:52.661 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.067725+0000", 2024-04-19T03:01:52.661 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:52.662 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.662 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.662 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:01:52.662 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.067725+0000", 2024-04-19T03:01:52.662 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:52.662 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.662 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.662 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:01:52.662 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.067724+0000", 2024-04-19T03:01:52.662 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2024-04-19T03:01:52.662 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.662 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.662 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:01:52.662 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.067842+0000", 2024-04-19T03:01:52.663 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000117691 2024-04-19T03:01:52.663 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.663 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.663 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:01:52.663 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.067853+0000", 2024-04-19T03:01:52.663 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0679000000000001e-05 2024-04-19T03:01:52.663 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.663 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.663 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:01:52.663 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.067859+0000", 2024-04-19T03:01:52.663 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.9510000000000003e-06 2024-04-19T03:01:52.663 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.663 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.663 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:52.664 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.067905+0000", 2024-04-19T03:01:52.664 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.6242999999999998e-05 2024-04-19T03:01:52.664 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.664 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.664 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:01:52.664 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.085335+0000", 2024-04-19T03:01:52.664 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.017430451 2024-04-19T03:01:52.664 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.664 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.664 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 1", 2024-04-19T03:01:52.664 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.085538+0000", 2024-04-19T03:01:52.664 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000202511 2024-04-19T03:01:52.664 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.664 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.665 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:52.665 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.087988+0000", 2024-04-19T03:01:52.665 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0024505780000000001 2024-04-19T03:01:52.665 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.665 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.665 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:01:52.665 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.088672+0000", 2024-04-19T03:01:52.665 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00068377900000000003 2024-04-19T03:01:52.665 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.665 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.665 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:01:52.665 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.088757+0000", 2024-04-19T03:01:52.665 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.4384999999999999e-05 2024-04-19T03:01:52.665 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.665 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.666 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:01:52.666 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.088815+0000", 2024-04-19T03:01:52.666 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.7995999999999998e-05 2024-04-19T03:01:52.666 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:52.666 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:52.666 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:52.666 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.666 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.666 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4755.0:11293 5.c 5:31728bfd:::benchmark_data_smithi096_19531_object11292:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T03:01:52.666 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:42.068359+0000", 2024-04-19T03:01:52.666 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 10.505962499000001, 2024-04-19T03:01:52.666 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.022306475999999999, 2024-04-19T03:01:52.667 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:01:52.667 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:52.667 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-04-19T03:01:52.667 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4755", 2024-04-19T03:01:52.667 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:52.667 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 11293 2024-04-19T03:01:52.667 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.667 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:01:52.667 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.667 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:01:52.667 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.068359+0000", 2024-04-19T03:01:52.667 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:52.667 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.667 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.668 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:01:52.668 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.068359+0000", 2024-04-19T03:01:52.668 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:52.668 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.668 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.668 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:01:52.668 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.068358+0000", 2024-04-19T03:01:52.668 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2024-04-19T03:01:52.668 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.668 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.668 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:01:52.668 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.068427+0000", 2024-04-19T03:01:52.668 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.9139000000000003e-05 2024-04-19T03:01:52.668 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.669 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.669 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:01:52.669 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.085292+0000", 2024-04-19T03:01:52.669 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.016864371 2024-04-19T03:01:52.669 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.669 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.669 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:01:52.669 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.085306+0000", 2024-04-19T03:01:52.669 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.434e-05 2024-04-19T03:01:52.669 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.669 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.669 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:52.669 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.085404+0000", 2024-04-19T03:01:52.669 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.8145000000000003e-05 2024-04-19T03:01:52.670 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.670 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.670 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:01:52.670 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.085569+0000", 2024-04-19T03:01:52.670 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00016504099999999999 2024-04-19T03:01:52.670 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.670 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.670 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-04-19T03:01:52.670 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.085739+0000", 2024-04-19T03:01:52.670 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000170099 2024-04-19T03:01:52.670 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.670 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.670 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:01:52.671 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.089603+0000", 2024-04-19T03:01:52.671 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0038636080000000001 2024-04-19T03:01:52.671 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.671 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.671 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:52.671 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.090578+0000", 2024-04-19T03:01:52.671 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00097513199999999997 2024-04-19T03:01:52.671 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.671 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.671 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:01:52.671 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.090618+0000", 2024-04-19T03:01:52.671 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.9987999999999997e-05 2024-04-19T03:01:52.671 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.671 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.672 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:01:52.672 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.090666+0000", 2024-04-19T03:01:52.672 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.7420999999999999e-05 2024-04-19T03:01:52.672 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:52.672 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:52.672 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:52.672 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.672 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.672 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4755.0:11288 5.0 e26/22 5:042458d0:::benchmark_data_smithi096_19531_object11287:head v 26'772, mlcod=26'770)", 2024-04-19T03:01:52.672 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:42.068428+0000", 2024-04-19T03:01:52.672 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 10.505894098000001, 2024-04-19T03:01:52.672 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.020774925, 2024-04-19T03:01:52.672 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:01:52.673 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:52.673 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:01:52.673 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.673 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:01:52.673 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.068428+0000", 2024-04-19T03:01:52.673 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:52.673 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.673 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.673 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:01:52.673 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.068428+0000", 2024-04-19T03:01:52.673 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:52.673 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.673 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.673 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:01:52.673 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.068427+0000", 2024-04-19T03:01:52.674 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999995 2024-04-19T03:01:52.674 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.674 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.674 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:01:52.674 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.068481+0000", 2024-04-19T03:01:52.674 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.3866999999999998e-05 2024-04-19T03:01:52.674 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.674 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.674 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:01:52.674 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.085273+0000", 2024-04-19T03:01:52.674 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.016792372999999999 2024-04-19T03:01:52.674 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.674 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.675 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:01:52.675 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.085288+0000", 2024-04-19T03:01:52.675 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4941e-05 2024-04-19T03:01:52.675 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.675 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.675 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:52.675 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.085350+0000", 2024-04-19T03:01:52.675 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.1550999999999994e-05 2024-04-19T03:01:52.675 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.675 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.675 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:01:52.675 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.085384+0000", 2024-04-19T03:01:52.675 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.4915e-05 2024-04-19T03:01:52.675 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.676 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.676 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:01:52.676 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.089164+0000", 2024-04-19T03:01:52.676 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0037794410000000001 2024-04-19T03:01:52.676 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.676 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.676 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:01:52.676 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.089202+0000", 2024-04-19T03:01:52.676 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.8519000000000002e-05 2024-04-19T03:01:52.676 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:52.676 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:52.676 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:52.676 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.676 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.677 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4755.0:24217 5.3 5:c03b7422:::benchmark_data_smithi096_19531_object24216:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e27)", 2024-04-19T03:01:52.677 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:47.410095+0000", 2024-04-19T03:01:52.677 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 5.1642265519999997, 2024-04-19T03:01:52.677 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0150338, 2024-04-19T03:01:52.677 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:01:52.677 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:52.677 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-04-19T03:01:52.677 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4755", 2024-04-19T03:01:52.677 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:52.677 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 24217 2024-04-19T03:01:52.677 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.677 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:01:52.677 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.677 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:01:52.678 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:47.410095+0000", 2024-04-19T03:01:52.678 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:52.678 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.678 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.678 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:01:52.678 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:47.410095+0000", 2024-04-19T03:01:52.678 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:52.678 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.678 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.678 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:01:52.678 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:47.410094+0000", 2024-04-19T03:01:52.678 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2024-04-19T03:01:52.678 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.678 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.679 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:01:52.679 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:47.410151+0000", 2024-04-19T03:01:52.679 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.6611999999999999e-05 2024-04-19T03:01:52.679 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.679 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.679 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:01:52.679 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:47.410159+0000", 2024-04-19T03:01:52.679 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.0949999999999996e-06 2024-04-19T03:01:52.679 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.679 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.679 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:01:52.679 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:47.410163+0000", 2024-04-19T03:01:52.679 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.4039999999999997e-06 2024-04-19T03:01:52.679 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.680 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.680 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:52.680 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:47.413678+0000", 2024-04-19T03:01:52.680 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.003514966 2024-04-19T03:01:52.680 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.680 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.680 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:01:52.680 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:47.413844+0000", 2024-04-19T03:01:52.680 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00016588400000000001 2024-04-19T03:01:52.680 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.680 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.680 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-04-19T03:01:52.680 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:47.413982+0000", 2024-04-19T03:01:52.680 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00013829000000000001 2024-04-19T03:01:52.681 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.681 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.681 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:52.681 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:47.421668+0000", 2024-04-19T03:01:52.681 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0076854560000000002 2024-04-19T03:01:52.681 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.681 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.681 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:01:52.681 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:47.425040+0000", 2024-04-19T03:01:52.681 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.003371892 2024-04-19T03:01:52.681 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.681 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.681 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:01:52.682 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:47.425096+0000", 2024-04-19T03:01:52.682 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.5858e-05 2024-04-19T03:01:52.682 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.682 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.682 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:01:52.682 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:47.425129+0000", 2024-04-19T03:01:52.682 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.3160000000000001e-05 2024-04-19T03:01:52.682 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:52.682 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:52.682 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:52.682 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.682 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.682 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4755.0:34933 5.3 5:c11a2f0a:::benchmark_data_smithi096_19531_object34932:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-19T03:01:52.683 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:52.311988+0000", 2024-04-19T03:01:52.683 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 0.26233357699999998, 2024-04-19T03:01:52.683 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.014846692, 2024-04-19T03:01:52.683 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:01:52.683 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:52.683 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-04-19T03:01:52.683 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4755", 2024-04-19T03:01:52.683 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:52.683 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 34933 2024-04-19T03:01:52.683 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.683 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:01:52.683 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.683 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:01:52.683 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:52.311988+0000", 2024-04-19T03:01:52.684 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:52.684 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.684 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.684 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:01:52.684 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:52.311988+0000", 2024-04-19T03:01:52.684 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:52.684 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.684 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.684 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:01:52.684 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:52.311986+0000", 2024-04-19T03:01:52.684 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999986 2024-04-19T03:01:52.684 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.684 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.684 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:01:52.685 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:52.312049+0000", 2024-04-19T03:01:52.685 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.2984999999999994e-05 2024-04-19T03:01:52.685 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.685 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.685 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:01:52.685 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:52.312062+0000", 2024-04-19T03:01:52.685 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2150999999999999e-05 2024-04-19T03:01:52.685 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.685 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.685 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:01:52.685 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:52.312070+0000", 2024-04-19T03:01:52.685 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.0790000000000001e-06 2024-04-19T03:01:52.685 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.685 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.686 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:52.686 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:52.318135+0000", 2024-04-19T03:01:52.686 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0060651139999999999 2024-04-19T03:01:52.686 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.686 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.686 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:01:52.686 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:52.318281+0000", 2024-04-19T03:01:52.686 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014642999999999999 2024-04-19T03:01:52.686 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.686 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.686 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-04-19T03:01:52.686 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:52.318453+0000", 2024-04-19T03:01:52.686 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00017230899999999999 2024-04-19T03:01:52.686 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.687 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.687 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:01:52.687 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:52.326243+0000", 2024-04-19T03:01:52.687 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0077890470000000003 2024-04-19T03:01:52.687 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.687 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.687 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:52.687 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:52.326779+0000", 2024-04-19T03:01:52.687 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00053634899999999998 2024-04-19T03:01:52.687 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.687 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.687 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:01:52.687 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:52.326811+0000", 2024-04-19T03:01:52.688 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.2313e-05 2024-04-19T03:01:52.688 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.688 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.688 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:01:52.688 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:52.326835+0000", 2024-04-19T03:01:52.688 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.3561e-05 2024-04-19T03:01:52.688 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:52.688 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:52.688 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:52.688 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.688 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.688 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4755.0:35317 5.c 5:3b13a094:::benchmark_data_smithi096_19531_object35316:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-19T03:01:52.688 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:52.508483+0000", 2024-04-19T03:01:52.688 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 0.065838380000000002, 2024-04-19T03:01:52.689 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.014514361, 2024-04-19T03:01:52.689 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:01:52.689 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:52.689 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-04-19T03:01:52.689 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4755", 2024-04-19T03:01:52.689 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:52.689 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 35317 2024-04-19T03:01:52.689 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.689 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:01:52.689 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.689 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:01:52.689 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:52.508483+0000", 2024-04-19T03:01:52.689 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:52.689 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.689 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.690 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:01:52.690 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:52.508483+0000", 2024-04-19T03:01:52.690 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:52.690 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.690 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.690 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:01:52.690 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:52.508482+0000", 2024-04-19T03:01:52.690 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2024-04-19T03:01:52.690 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.690 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.690 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:01:52.690 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:52.508579+0000", 2024-04-19T03:01:52.690 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.6508999999999994e-05 2024-04-19T03:01:52.690 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.691 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.691 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:01:52.691 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:52.508589+0000", 2024-04-19T03:01:52.691 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0675e-05 2024-04-19T03:01:52.691 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.691 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.691 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:01:52.691 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:52.508597+0000", 2024-04-19T03:01:52.691 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.0399999999999993e-06 2024-04-19T03:01:52.691 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.691 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.691 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:52.691 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:52.508677+0000", 2024-04-19T03:01:52.691 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.9673999999999996e-05 2024-04-19T03:01:52.692 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.692 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.692 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:01:52.692 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:52.508841+0000", 2024-04-19T03:01:52.692 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000164019 2024-04-19T03:01:52.692 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.692 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.692 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-04-19T03:01:52.692 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:52.509000+0000", 2024-04-19T03:01:52.692 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000158825 2024-04-19T03:01:52.692 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.692 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.692 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:01:52.692 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:52.511739+0000", 2024-04-19T03:01:52.693 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0027386429999999998 2024-04-19T03:01:52.693 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.693 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.693 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:52.693 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:52.522914+0000", 2024-04-19T03:01:52.693 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.011175879999999999 2024-04-19T03:01:52.693 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.693 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.693 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:01:52.693 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:52.522962+0000", 2024-04-19T03:01:52.693 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.7199e-05 2024-04-19T03:01:52.693 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:52.693 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:52.693 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:01:52.694 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:52.522998+0000", 2024-04-19T03:01:52.694 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.5905999999999998e-05 2024-04-19T03:01:52.694 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:52.694 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:52.694 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:52.694 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:52.694 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:52.694 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-04-19T03:01:52.696 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T03:01:52.696 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:01:52.692+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:01:52.796 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:01:52.796+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:01:52.821 INFO:tasks.radosbench.radosbench.0.smithi096.stdout: 15 16 35973 35957 149.805 128.938 0.00897944 0.0066689 2024-04-19T03:01:52.826 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-19T03:01:52.826 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-04-19T03:01:52.826 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:52.826 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:35974 5.d 5:b2a36c2c:::benchmark_data_smithi096_19531_object35973:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-19T03:01:52.826 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:52.822278+0000", 2024-04-19T03:01:52.826 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.00298198, 2024-04-19T03:01:52.826 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0030136630000000002, 2024-04-19T03:01:52.826 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:01:52.826 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:01:52.827 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:01:52.827 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:01:52.827 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:52.827 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 35974 2024-04-19T03:01:52.827 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:52.827 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:01:52.827 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:52.827 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:01:52.827 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:52.822278+0000", 2024-04-19T03:01:52.827 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:52.827 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:52.827 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:52.827 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:01:52.827 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:52.822278+0000", 2024-04-19T03:01:52.828 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:52.828 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:52.828 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:52.828 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:01:52.828 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:52.822277+0000", 2024-04-19T03:01:52.828 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:01:52.828 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:52.828 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:52.828 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:01:52.828 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:52.822402+0000", 2024-04-19T03:01:52.828 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000125091 2024-04-19T03:01:52.828 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:52.828 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:52.828 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:01:52.829 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:52.822417+0000", 2024-04-19T03:01:52.829 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.488e-05 2024-04-19T03:01:52.829 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:52.829 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:52.829 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:01:52.829 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:52.822425+0000", 2024-04-19T03:01:52.829 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0709999999999995e-06 2024-04-19T03:01:52.829 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:52.829 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:52.829 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:52.829 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:52.822521+0000", 2024-04-19T03:01:52.829 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.6712999999999994e-05 2024-04-19T03:01:52.829 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:52.829 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:52.829 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:01:52.830 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:52.822680+0000", 2024-04-19T03:01:52.830 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015822399999999999 2024-04-19T03:01:52.830 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:52.830 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:52.830 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-04-19T03:01:52.830 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:52.822832+0000", 2024-04-19T03:01:52.830 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015201099999999999 2024-04-19T03:01:52.830 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:52.830 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:01:52.831 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:52.831 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:52.831 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:52.831 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:35976 5.8 5:1000e648:::benchmark_data_smithi096_19531_object35975:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-19T03:01:52.831 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:52.822509+0000", 2024-04-19T03:01:52.831 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0027507999999999999, 2024-04-19T03:01:52.831 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0028850249999999998, 2024-04-19T03:01:52.831 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:01:52.831 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:01:52.831 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:01:52.831 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:01:52.831 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:52.831 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 35976 2024-04-19T03:01:52.831 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:52.832 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:01:52.832 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:52.832 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:01:52.832 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:52.822509+0000", 2024-04-19T03:01:52.832 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:52.832 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:52.832 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:52.832 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:01:52.832 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:52.822509+0000", 2024-04-19T03:01:52.832 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:52.832 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:52.832 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:52.832 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:01:52.832 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:52.822508+0000", 2024-04-19T03:01:52.833 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:01:52.833 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:52.833 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:52.833 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:01:52.833 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:52.822581+0000", 2024-04-19T03:01:52.833 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3057000000000002e-05 2024-04-19T03:01:52.833 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:52.833 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:52.833 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:01:52.833 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:52.822589+0000", 2024-04-19T03:01:52.833 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.1269999999999997e-06 2024-04-19T03:01:52.833 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:52.833 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:52.833 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:01:52.834 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:52.822593+0000", 2024-04-19T03:01:52.834 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7729999999999999e-06 2024-04-19T03:01:52.834 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:52.834 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:52.834 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:52.834 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:52.822626+0000", 2024-04-19T03:01:52.834 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2291e-05 2024-04-19T03:01:52.834 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:52.834 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:52.834 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:01:52.834 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:52.822714+0000", 2024-04-19T03:01:52.834 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.8848e-05 2024-04-19T03:01:52.834 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:52.834 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:52.835 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:01:52.835 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:52.822803+0000", 2024-04-19T03:01:52.835 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.8442999999999993e-05 2024-04-19T03:01:52.835 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:52.835 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:01:52.835 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:52.835 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:52.835 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:52.835 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:35977 5.e 5:708eaab5:::benchmark_data_smithi096_19531_object35976:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-19T03:01:52.835 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:52.823606+0000", 2024-04-19T03:01:52.835 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0016540820000000001, 2024-04-19T03:01:52.835 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001879417, 2024-04-19T03:01:52.835 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:01:52.836 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:01:52.836 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:01:52.836 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:01:52.836 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:52.836 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 35977 2024-04-19T03:01:52.836 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:52.836 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:01:52.836 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:52.836 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:01:52.836 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:52.823606+0000", 2024-04-19T03:01:52.836 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:52.837 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:52.837 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:52.837 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:01:52.837 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:52.823606+0000", 2024-04-19T03:01:52.837 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:52.837 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:52.837 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:52.837 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:01:52.837 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:52.823605+0000", 2024-04-19T03:01:52.837 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:01:52.837 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:52.837 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:52.837 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:01:52.837 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:52.823641+0000", 2024-04-19T03:01:52.838 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6103999999999999e-05 2024-04-19T03:01:52.838 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:52.838 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:52.838 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:01:52.838 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:52.823647+0000", 2024-04-19T03:01:52.838 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8130000000000001e-06 2024-04-19T03:01:52.838 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:52.838 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:52.838 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:01:52.838 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:52.823652+0000", 2024-04-19T03:01:52.838 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7570000000000004e-06 2024-04-19T03:01:52.838 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:52.838 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:52.838 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:52.839 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:52.823696+0000", 2024-04-19T03:01:52.839 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3865000000000001e-05 2024-04-19T03:01:52.839 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:52.839 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:52.839 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:01:52.839 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:52.823853+0000", 2024-04-19T03:01:52.839 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000157317 2024-04-19T03:01:52.839 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:52.839 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:52.839 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:01:52.839 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:52.824018+0000", 2024-04-19T03:01:52.839 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000165358 2024-04-19T03:01:52.839 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:52.839 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:01:52.840 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:52.840 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:52.840 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:52.840 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:35978 5.4 5:2d976069:::benchmark_data_smithi096_19531_object35977:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-19T03:01:52.840 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:52.823661+0000", 2024-04-19T03:01:52.840 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.001598861, 2024-04-19T03:01:52.840 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001912497, 2024-04-19T03:01:52.840 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:01:52.840 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:01:52.840 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:01:52.840 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:01:52.840 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:52.840 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 35978 2024-04-19T03:01:52.840 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:52.841 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:01:52.841 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:52.841 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:01:52.841 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:52.823661+0000", 2024-04-19T03:01:52.841 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:52.841 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:52.841 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:52.841 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:01:52.841 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:52.823661+0000", 2024-04-19T03:01:52.841 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:52.841 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:52.841 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:52.841 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:01:52.841 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:52.823661+0000", 2024-04-19T03:01:52.842 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:01:52.842 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:52.842 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:52.842 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:01:52.842 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:52.823692+0000", 2024-04-19T03:01:52.842 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1745000000000002e-05 2024-04-19T03:01:52.842 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:52.842 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:52.842 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:01:52.842 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:52.823697+0000", 2024-04-19T03:01:52.842 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7690000000000004e-06 2024-04-19T03:01:52.842 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:52.842 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:52.843 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:01:52.843 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:52.823700+0000", 2024-04-19T03:01:52.843 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.004e-06 2024-04-19T03:01:52.843 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:52.843 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:52.843 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:52.843 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:52.823731+0000", 2024-04-19T03:01:52.843 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1007999999999999e-05 2024-04-19T03:01:52.843 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:52.843 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:52.843 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:01:52.843 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:52.823805+0000", 2024-04-19T03:01:52.843 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4214000000000005e-05 2024-04-19T03:01:52.843 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:52.843 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:52.844 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:01:52.844 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:52.823885+0000", 2024-04-19T03:01:52.844 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.9809999999999997e-05 2024-04-19T03:01:52.844 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:52.844 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:01:52.844 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:52.844 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:52.844 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:52.844 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop_reply(client.4755.0:35972 5.e e29/22)", 2024-04-19T03:01:52.844 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:52.824457+0000", 2024-04-19T03:01:52.844 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.00080309499999999998, 2024-04-19T03:01:52.844 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001196066, 2024-04-19T03:01:52.844 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:01:52.844 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-04-19T03:01:52.845 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:01:52.845 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:52.845 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:01:52.845 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:52.824457+0000", 2024-04-19T03:01:52.845 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:52.845 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:52.845 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:52.845 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:01:52.845 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:52.824457+0000", 2024-04-19T03:01:52.845 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:52.845 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:52.845 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:52.845 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:01:52.845 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:52.824456+0000", 2024-04-19T03:01:52.846 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:01:52.846 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:52.846 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:52.846 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:01:52.846 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:52.824461+0000", 2024-04-19T03:01:52.846 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4789999999999998e-06 2024-04-19T03:01:52.846 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:52.846 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:52.846 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:01:52.846 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:52.824469+0000", 2024-04-19T03:01:52.846 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.8970000000000008e-06 2024-04-19T03:01:52.846 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:52.846 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:52.846 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:01:52.847 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:52.824474+0000", 2024-04-19T03:01:52.847 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7729999999999996e-06 2024-04-19T03:01:52.847 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:52.847 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:01:52.847 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:52.847 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:52.847 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:52.847 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:35980 5.d 5:b598b778:::benchmark_data_smithi096_19531_object35979:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-19T03:01:52.847 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:52.824690+0000", 2024-04-19T03:01:52.847 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.00056983399999999997, 2024-04-19T03:01:52.847 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001022556, 2024-04-19T03:01:52.847 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:01:52.847 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:01:52.847 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:01:52.848 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:01:52.848 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:52.848 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 35980 2024-04-19T03:01:52.848 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:52.848 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:01:52.848 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:52.848 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:01:52.848 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:52.824690+0000", 2024-04-19T03:01:52.848 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:52.848 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:52.848 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:52.848 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:01:52.848 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:52.824690+0000", 2024-04-19T03:01:52.848 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:52.848 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:52.849 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:52.849 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:01:52.849 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:52.824689+0000", 2024-04-19T03:01:52.849 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:01:52.849 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:52.849 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:52.849 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:01:52.849 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:52.824759+0000", 2024-04-19T03:01:52.849 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.0047000000000002e-05 2024-04-19T03:01:52.849 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:52.849 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:52.849 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:01:52.849 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:52.824796+0000", 2024-04-19T03:01:52.849 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6414000000000001e-05 2024-04-19T03:01:52.850 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:52.850 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:52.850 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:01:52.850 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:52.824803+0000", 2024-04-19T03:01:52.850 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3429999999999998e-06 2024-04-19T03:01:52.850 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:52.850 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:52.850 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:52.850 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:52.824880+0000", 2024-04-19T03:01:52.850 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.6518000000000002e-05 2024-04-19T03:01:52.850 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:52.850 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:52.850 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:01:52.851 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:52.825025+0000", 2024-04-19T03:01:52.851 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014525900000000001 2024-04-19T03:01:52.851 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:52.851 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:52.851 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-04-19T03:01:52.851 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:52.825188+0000", 2024-04-19T03:01:52.851 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016300400000000001 2024-04-19T03:01:52.851 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:52.851 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:01:52.851 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:52.851 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:52.851 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:52.851 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:35964 5.8 5:16f4b565:::benchmark_data_smithi096_19531_object35963:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-19T03:01:52.851 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:52.817523+0000", 2024-04-19T03:01:52.851 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0077372020000000003, 2024-04-19T03:01:52.852 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0082746490000000002, 2024-04-19T03:01:52.852 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:01:52.852 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:01:52.852 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:01:52.852 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:01:52.852 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:52.852 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 35964 2024-04-19T03:01:52.852 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:52.852 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:01:52.852 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:52.852 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:01:52.852 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:52.817523+0000", 2024-04-19T03:01:52.852 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:52.852 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:52.852 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:52.853 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:01:52.853 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:52.817523+0000", 2024-04-19T03:01:52.853 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:52.853 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:52.853 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:52.853 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:01:52.853 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:52.817522+0000", 2024-04-19T03:01:52.853 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:01:52.853 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:52.853 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:52.853 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:01:52.853 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:52.817628+0000", 2024-04-19T03:01:52.853 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010594099999999999 2024-04-19T03:01:52.853 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:52.854 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:52.854 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:01:52.854 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:52.817654+0000", 2024-04-19T03:01:52.854 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6698000000000001e-05 2024-04-19T03:01:52.854 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:52.854 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:52.854 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:01:52.854 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:52.817667+0000", 2024-04-19T03:01:52.854 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.225e-05 2024-04-19T03:01:52.854 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:52.854 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:52.854 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:52.854 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:52.817724+0000", 2024-04-19T03:01:52.855 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7629e-05 2024-04-19T03:01:52.855 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:52.855 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:52.855 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:01:52.855 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:52.817894+0000", 2024-04-19T03:01:52.855 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000169474 2024-04-19T03:01:52.855 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:52.855 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:52.855 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:01:52.855 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:52.818018+0000", 2024-04-19T03:01:52.855 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012459 2024-04-19T03:01:52.855 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:52.855 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:52.855 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:52.855 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:52.825747+0000", 2024-04-19T03:01:52.856 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0077290589999999999 2024-04-19T03:01:52.856 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:52.856 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:01:52.856 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:52.856 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:52.856 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:52.856 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:35969 5.0 5:0104bca7:::benchmark_data_smithi096_19531_object35968:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-19T03:01:52.856 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:52.820415+0000", 2024-04-19T03:01:52.856 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0048448850000000002, 2024-04-19T03:01:52.856 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0054786959999999999, 2024-04-19T03:01:52.856 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:01:52.856 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:01:52.856 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:01:52.856 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:01:52.857 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:52.857 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 35969 2024-04-19T03:01:52.857 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:52.857 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:01:52.857 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:52.857 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:01:52.857 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:52.820415+0000", 2024-04-19T03:01:52.857 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:52.857 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:52.857 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:52.857 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:01:52.857 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:52.820415+0000", 2024-04-19T03:01:52.857 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:52.857 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:52.858 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:52.858 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:01:52.858 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:52.820414+0000", 2024-04-19T03:01:52.858 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:01:52.858 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:52.858 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:52.858 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:01:52.858 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:52.820463+0000", 2024-04-19T03:01:52.858 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9320000000000002e-05 2024-04-19T03:01:52.858 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:52.858 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:52.858 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:01:52.858 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:52.820473+0000", 2024-04-19T03:01:52.858 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.7249999999999992e-06 2024-04-19T03:01:52.859 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:52.859 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:52.859 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:01:52.859 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:52.820485+0000", 2024-04-19T03:01:52.859 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2351000000000001e-05 2024-04-19T03:01:52.859 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:52.859 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:52.859 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:52.859 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:52.820535+0000", 2024-04-19T03:01:52.859 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9610000000000001e-05 2024-04-19T03:01:52.859 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:52.859 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:52.859 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:01:52.859 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:52.820828+0000", 2024-04-19T03:01:52.860 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00029350399999999999 2024-04-19T03:01:52.860 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:52.860 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:52.860 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:01:52.860 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:52.820956+0000", 2024-04-19T03:01:52.860 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012742299999999999 2024-04-19T03:01:52.860 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:52.860 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:52.860 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:52.860 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:52.825816+0000", 2024-04-19T03:01:52.860 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0048606880000000002 2024-04-19T03:01:52.860 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:52.860 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:01:52.860 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:52.861 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:52.861 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:52.861 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:35972 5.e 5:71c13d8f:::benchmark_data_smithi096_19531_object35971:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-19T03:01:52.861 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:52.820747+0000", 2024-04-19T03:01:52.861 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0045134659999999998, 2024-04-19T03:01:52.861 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0052415090000000001, 2024-04-19T03:01:52.861 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:01:52.861 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:01:52.861 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:01:52.861 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:01:52.861 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:52.861 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 35972 2024-04-19T03:01:52.861 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:52.861 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:01:52.862 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:52.862 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:01:52.862 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:52.820747+0000", 2024-04-19T03:01:52.862 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:52.862 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:52.862 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:52.862 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:01:52.862 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:52.820747+0000", 2024-04-19T03:01:52.862 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:52.862 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:52.862 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:52.862 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:01:52.862 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:52.820746+0000", 2024-04-19T03:01:52.862 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:01:52.863 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:52.863 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:52.863 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:01:52.863 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:52.820821+0000", 2024-04-19T03:01:52.863 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5259000000000006e-05 2024-04-19T03:01:52.863 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:52.863 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:52.863 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:01:52.863 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:52.820830+0000", 2024-04-19T03:01:52.863 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.8990000000000007e-06 2024-04-19T03:01:52.863 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:52.863 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:52.863 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:01:52.863 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:52.820837+0000", 2024-04-19T03:01:52.863 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.844e-06 2024-04-19T03:01:52.864 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:52.864 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:52.864 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:52.864 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:52.820872+0000", 2024-04-19T03:01:52.864 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5267e-05 2024-04-19T03:01:52.864 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:52.864 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:52.864 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:01:52.864 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:52.820954+0000", 2024-04-19T03:01:52.864 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1841999999999993e-05 2024-04-19T03:01:52.864 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:52.864 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:52.864 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:01:52.864 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:52.821048+0000", 2024-04-19T03:01:52.865 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.4266999999999997e-05 2024-04-19T03:01:52.865 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:52.865 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:01:52.865 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:52.865 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:52.865 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-04-19T03:01:52.865 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 9 2024-04-19T03:01:52.865 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-19T03:01:52.866 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T03:01:52.912 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:01:52.912+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:01:52.990 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-19T03:01:52.990 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-04-19T03:01:52.990 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-04-19T03:01:52.990 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-04-19T03:01:52.990 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-19T03:01:52.998 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T03:01:52.999 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:01:52.993+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:01:53.050 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-19T03:01:53.098 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-19T03:01:53.099 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-04-19T03:01:53.093+0000 7f35986ab700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18243) UID: 0 2024-04-19T03:01:53.124 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-19T03:01:53.125 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-04-19T03:01:53.125 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-04-19T03:01:53.125 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-04-19T03:01:53.125 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.125 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:9 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:01:53.125 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:14.999380+0000", 2024-04-19T03:01:53.125 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 38.122934823999998, 2024-04-19T03:01:53.125 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.019009906, 2024-04-19T03:01:53.125 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:01:53.125 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:53.126 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:01:53.126 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.126 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:01:53.126 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999380+0000", 2024-04-19T03:01:53.126 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:53.126 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.126 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.126 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:01:53.126 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999380+0000", 2024-04-19T03:01:53.126 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:53.126 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.126 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.126 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:01:53.127 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999377+0000", 2024-04-19T03:01:53.127 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999971 2024-04-19T03:01:53.127 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.127 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.127 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:01:53.127 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999393+0000", 2024-04-19T03:01:53.127 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5665999999999999e-05 2024-04-19T03:01:53.127 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.127 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.127 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:01:53.127 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999416+0000", 2024-04-19T03:01:53.127 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3030000000000001e-05 2024-04-19T03:01:53.127 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.127 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.128 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:01:53.128 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999439+0000", 2024-04-19T03:01:53.128 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3203000000000001e-05 2024-04-19T03:01:53.128 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.128 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.128 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:53.128 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999564+0000", 2024-04-19T03:01:53.128 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012492800000000001 2024-04-19T03:01:53.128 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.128 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.128 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op must wait for map", 2024-04-19T03:01:53.129 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999573+0000", 2024-04-19T03:01:53.129 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.7129999999999994e-06 2024-04-19T03:01:53.129 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.129 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.129 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:53.129 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.005623+0000", 2024-04-19T03:01:53.129 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0060502120000000001 2024-04-19T03:01:53.129 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.129 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.129 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:01:53.129 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.006510+0000", 2024-04-19T03:01:53.129 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00088656 2024-04-19T03:01:53.130 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.130 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.130 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-04-19T03:01:53.130 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.008004+0000", 2024-04-19T03:01:53.130 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0014948240000000001 2024-04-19T03:01:53.130 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.130 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.130 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:01:53.130 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.011874+0000", 2024-04-19T03:01:53.130 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0038699630000000001 2024-04-19T03:01:53.130 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.130 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.130 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:53.130 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.018000+0000", 2024-04-19T03:01:53.131 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0061254389999999999 2024-04-19T03:01:53.131 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.131 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.131 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:01:53.131 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.018281+0000", 2024-04-19T03:01:53.131 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00028121400000000001 2024-04-19T03:01:53.131 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.131 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.131 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:01:53.131 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.018390+0000", 2024-04-19T03:01:53.131 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010899 2024-04-19T03:01:53.131 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:53.132 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:01:53.132 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:53.132 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.132 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.132 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:10 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:01:53.132 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:14.999496+0000", 2024-04-19T03:01:53.132 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 38.122819288999999, 2024-04-19T03:01:53.132 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.022720497999999999, 2024-04-19T03:01:53.132 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:01:53.132 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:53.132 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:01:53.132 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.132 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:01:53.132 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999496+0000", 2024-04-19T03:01:53.133 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:53.133 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.133 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.133 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:01:53.133 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999496+0000", 2024-04-19T03:01:53.133 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:53.133 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.133 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.133 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:01:53.133 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999494+0000", 2024-04-19T03:01:53.133 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:01:53.133 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.133 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.133 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:01:53.134 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999503+0000", 2024-04-19T03:01:53.134 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.5930000000000006e-06 2024-04-19T03:01:53.134 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.134 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.134 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:01:53.134 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999523+0000", 2024-04-19T03:01:53.134 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9553000000000001e-05 2024-04-19T03:01:53.134 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.134 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.134 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:01:53.134 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999538+0000", 2024-04-19T03:01:53.134 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5702999999999999e-05 2024-04-19T03:01:53.134 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.135 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.135 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:53.135 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999608+0000", 2024-04-19T03:01:53.135 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.9912000000000004e-05 2024-04-19T03:01:53.135 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.135 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.135 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op must wait for map", 2024-04-19T03:01:53.135 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999626+0000", 2024-04-19T03:01:53.135 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8207e-05 2024-04-19T03:01:53.135 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.135 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.135 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:53.135 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.010765+0000", 2024-04-19T03:01:53.135 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011138719 2024-04-19T03:01:53.136 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.136 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.136 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:01:53.136 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.010906+0000", 2024-04-19T03:01:53.136 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014095899999999999 2024-04-19T03:01:53.136 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.136 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.136 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-04-19T03:01:53.136 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.011472+0000", 2024-04-19T03:01:53.136 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00056629300000000005 2024-04-19T03:01:53.136 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.136 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.137 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:01:53.137 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.013217+0000", 2024-04-19T03:01:53.137 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001744317 2024-04-19T03:01:53.137 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.137 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.137 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:53.137 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.022083+0000", 2024-04-19T03:01:53.137 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0088663849999999992 2024-04-19T03:01:53.137 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.137 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.137 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:01:53.137 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.022124+0000", 2024-04-19T03:01:53.137 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.057e-05 2024-04-19T03:01:53.137 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.138 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.138 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:01:53.138 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.022216+0000", 2024-04-19T03:01:53.138 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.2417000000000006e-05 2024-04-19T03:01:53.138 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:53.138 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:01:53.138 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:53.138 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.138 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.138 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:13 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:01:53.138 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:14.999564+0000", 2024-04-19T03:01:53.138 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 38.122750406999998, 2024-04-19T03:01:53.138 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.019594777000000001, 2024-04-19T03:01:53.139 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:01:53.139 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:53.139 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:01:53.139 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.139 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:01:53.139 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999564+0000", 2024-04-19T03:01:53.139 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:53.139 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.139 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.139 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:01:53.139 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999564+0000", 2024-04-19T03:01:53.139 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:53.139 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.139 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.140 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:01:53.140 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999563+0000", 2024-04-19T03:01:53.140 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:01:53.140 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.140 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.140 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:01:53.140 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999582+0000", 2024-04-19T03:01:53.140 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8151999999999998e-05 2024-04-19T03:01:53.140 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.140 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.140 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:01:53.140 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999599+0000", 2024-04-19T03:01:53.140 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7583000000000001e-05 2024-04-19T03:01:53.140 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.141 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.141 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:01:53.141 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999618+0000", 2024-04-19T03:01:53.141 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8989999999999999e-05 2024-04-19T03:01:53.141 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.141 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.141 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:53.141 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999692+0000", 2024-04-19T03:01:53.141 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3561999999999998e-05 2024-04-19T03:01:53.141 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.141 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.141 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op must wait for map", 2024-04-19T03:01:53.141 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999698+0000", 2024-04-19T03:01:53.142 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7159999999999997e-06 2024-04-19T03:01:53.142 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.142 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.142 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:53.142 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.007836+0000", 2024-04-19T03:01:53.142 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0081376520000000004 2024-04-19T03:01:53.142 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.142 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.142 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:01:53.142 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.008208+0000", 2024-04-19T03:01:53.142 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00037223699999999998 2024-04-19T03:01:53.142 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.143 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.143 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-04-19T03:01:53.143 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.008516+0000", 2024-04-19T03:01:53.143 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000308227 2024-04-19T03:01:53.143 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.143 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.143 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:01:53.143 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.011585+0000", 2024-04-19T03:01:53.143 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0030680659999999999 2024-04-19T03:01:53.143 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.144 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.144 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:53.144 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.018871+0000", 2024-04-19T03:01:53.144 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0072861369999999998 2024-04-19T03:01:53.144 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.144 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.144 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:01:53.144 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.019067+0000", 2024-04-19T03:01:53.144 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00019672099999999999 2024-04-19T03:01:53.144 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.144 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.144 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:01:53.144 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.019159+0000", 2024-04-19T03:01:53.144 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1829999999999993e-05 2024-04-19T03:01:53.145 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:53.145 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:01:53.145 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:53.145 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.145 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.145 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:31 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:01:53.145 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:14.999649+0000", 2024-04-19T03:01:53.145 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 38.122666289000001, 2024-04-19T03:01:53.145 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.018882121000000002, 2024-04-19T03:01:53.145 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:01:53.145 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:53.145 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:01:53.145 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.146 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:01:53.146 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999649+0000", 2024-04-19T03:01:53.146 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:53.146 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.146 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.146 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:01:53.146 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999649+0000", 2024-04-19T03:01:53.146 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:53.146 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.146 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.146 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:01:53.146 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999647+0000", 2024-04-19T03:01:53.147 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:01:53.147 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.147 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.147 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:01:53.147 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999657+0000", 2024-04-19T03:01:53.147 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.3729999999999999e-06 2024-04-19T03:01:53.147 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.147 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.147 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:01:53.147 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999675+0000", 2024-04-19T03:01:53.147 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8522999999999999e-05 2024-04-19T03:01:53.147 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.147 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.148 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:01:53.148 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999689+0000", 2024-04-19T03:01:53.148 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.347e-05 2024-04-19T03:01:53.148 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.148 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.148 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:53.148 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999761+0000", 2024-04-19T03:01:53.148 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.1904999999999997e-05 2024-04-19T03:01:53.148 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.148 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.148 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:01:53.148 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999766+0000", 2024-04-19T03:01:53.148 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6069999999999998e-06 2024-04-19T03:01:53.149 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.149 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.149 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:53.149 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.010040+0000", 2024-04-19T03:01:53.149 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.010273381 2024-04-19T03:01:53.149 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.149 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.149 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:01:53.149 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.010260+0000", 2024-04-19T03:01:53.149 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00022003300000000001 2024-04-19T03:01:53.149 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.149 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.149 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-04-19T03:01:53.150 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.010415+0000", 2024-04-19T03:01:53.150 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015515599999999999 2024-04-19T03:01:53.150 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.150 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.150 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:01:53.150 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.013206+0000", 2024-04-19T03:01:53.150 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0027915010000000001 2024-04-19T03:01:53.150 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.150 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.150 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:53.150 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.018438+0000", 2024-04-19T03:01:53.150 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0052313469999999999 2024-04-19T03:01:53.150 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.151 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.151 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:01:53.151 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.018491+0000", 2024-04-19T03:01:53.151 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3554000000000003e-05 2024-04-19T03:01:53.151 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.151 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.151 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:01:53.151 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.018531+0000", 2024-04-19T03:01:53.151 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9384000000000001e-05 2024-04-19T03:01:53.151 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:53.151 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:01:53.152 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:53.152 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.152 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.152 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:32 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:01:53.152 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:14.999712+0000", 2024-04-19T03:01:53.152 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 38.122603046000002, 2024-04-19T03:01:53.152 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.022635437000000001, 2024-04-19T03:01:53.152 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:01:53.152 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:53.152 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:01:53.152 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.152 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:01:53.152 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999712+0000", 2024-04-19T03:01:53.153 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:53.153 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.153 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.153 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:01:53.153 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999712+0000", 2024-04-19T03:01:53.153 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:53.153 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.153 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.153 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:01:53.153 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999711+0000", 2024-04-19T03:01:53.153 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:01:53.153 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.153 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.153 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:01:53.153 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999719+0000", 2024-04-19T03:01:53.154 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.354e-06 2024-04-19T03:01:53.154 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.154 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.154 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:01:53.154 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999735+0000", 2024-04-19T03:01:53.154 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6288999999999999e-05 2024-04-19T03:01:53.154 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.154 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.154 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:01:53.154 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999749+0000", 2024-04-19T03:01:53.154 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3492999999999999e-05 2024-04-19T03:01:53.154 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.154 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.155 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:53.155 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999811+0000", 2024-04-19T03:01:53.155 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2298999999999994e-05 2024-04-19T03:01:53.155 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.155 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.155 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:01:53.155 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999817+0000", 2024-04-19T03:01:53.155 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2169999999999999e-06 2024-04-19T03:01:53.155 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.155 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.155 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:53.155 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.011836+0000", 2024-04-19T03:01:53.155 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.012018008 2024-04-19T03:01:53.156 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.156 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.156 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:01:53.156 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.011897+0000", 2024-04-19T03:01:53.156 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1111000000000005e-05 2024-04-19T03:01:53.156 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.156 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.156 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-04-19T03:01:53.156 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.011980+0000", 2024-04-19T03:01:53.156 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3003999999999993e-05 2024-04-19T03:01:53.156 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.156 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.156 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:01:53.156 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.013863+0000", 2024-04-19T03:01:53.157 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001883804 2024-04-19T03:01:53.157 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.157 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.157 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:53.157 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.022257+0000", 2024-04-19T03:01:53.157 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0083938290000000002 2024-04-19T03:01:53.157 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.157 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.157 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:01:53.157 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.022310+0000", 2024-04-19T03:01:53.157 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.236e-05 2024-04-19T03:01:53.157 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.157 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.157 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:01:53.158 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.022347+0000", 2024-04-19T03:01:53.158 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7653e-05 2024-04-19T03:01:53.158 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:53.158 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:01:53.158 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:53.158 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.158 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.158 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:35 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:01:53.158 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:14.999772+0000", 2024-04-19T03:01:53.159 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 38.122542766999999, 2024-04-19T03:01:53.159 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020205530999999999, 2024-04-19T03:01:53.159 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:01:53.159 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:53.159 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:01:53.159 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.159 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:01:53.159 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999772+0000", 2024-04-19T03:01:53.159 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:53.159 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.159 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.159 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:01:53.159 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999772+0000", 2024-04-19T03:01:53.159 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:53.160 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.160 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.160 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:01:53.160 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999771+0000", 2024-04-19T03:01:53.160 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:01:53.160 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.160 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.160 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:01:53.160 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999778+0000", 2024-04-19T03:01:53.160 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2200000000000003e-06 2024-04-19T03:01:53.160 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.160 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.161 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:01:53.161 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999794+0000", 2024-04-19T03:01:53.161 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5798999999999999e-05 2024-04-19T03:01:53.161 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.161 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.161 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:01:53.161 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999809+0000", 2024-04-19T03:01:53.161 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.469e-05 2024-04-19T03:01:53.161 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.161 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.161 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:53.161 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999915+0000", 2024-04-19T03:01:53.161 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000105658 2024-04-19T03:01:53.161 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.162 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.162 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:01:53.162 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999927+0000", 2024-04-19T03:01:53.162 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.201e-05 2024-04-19T03:01:53.162 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.162 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.162 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:53.162 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.009841+0000", 2024-04-19T03:01:53.162 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0099147039999999999 2024-04-19T03:01:53.162 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.162 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.162 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:01:53.162 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.009941+0000", 2024-04-19T03:01:53.163 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.9461000000000002e-05 2024-04-19T03:01:53.163 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.163 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.163 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-04-19T03:01:53.163 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.010101+0000", 2024-04-19T03:01:53.163 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016028599999999999 2024-04-19T03:01:53.163 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.163 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.163 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:01:53.163 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.011787+0000", 2024-04-19T03:01:53.163 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001685513 2024-04-19T03:01:53.163 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.163 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.163 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:53.164 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.019889+0000", 2024-04-19T03:01:53.164 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0081026559999999997 2024-04-19T03:01:53.164 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.164 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.164 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:01:53.164 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.019932+0000", 2024-04-19T03:01:53.164 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2385000000000002e-05 2024-04-19T03:01:53.164 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.164 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.164 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:01:53.164 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.019978+0000", 2024-04-19T03:01:53.164 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6093000000000001e-05 2024-04-19T03:01:53.164 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:53.164 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:01:53.165 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:53.165 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.165 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.165 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:18 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:01:53.165 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:14.999834+0000", 2024-04-19T03:01:53.165 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 38.122480682000003, 2024-04-19T03:01:53.165 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.019567312999999999, 2024-04-19T03:01:53.165 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:01:53.165 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:53.165 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:01:53.165 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.165 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:01:53.165 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999834+0000", 2024-04-19T03:01:53.166 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:53.166 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.167 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.167 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:01:53.167 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999834+0000", 2024-04-19T03:01:53.167 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:53.167 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.167 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.167 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:01:53.167 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999833+0000", 2024-04-19T03:01:53.167 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:01:53.167 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.167 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.167 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:01:53.167 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999842+0000", 2024-04-19T03:01:53.167 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.2269999999999999e-06 2024-04-19T03:01:53.167 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.168 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.168 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:01:53.168 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999860+0000", 2024-04-19T03:01:53.168 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8456000000000001e-05 2024-04-19T03:01:53.168 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.168 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.168 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:01:53.168 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999874+0000", 2024-04-19T03:01:53.168 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3263e-05 2024-04-19T03:01:53.168 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.168 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.168 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:53.168 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999934+0000", 2024-04-19T03:01:53.169 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0888999999999999e-05 2024-04-19T03:01:53.169 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.169 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.169 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:01:53.169 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999940+0000", 2024-04-19T03:01:53.169 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4330000000000003e-06 2024-04-19T03:01:53.169 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.169 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.169 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:53.169 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.010943+0000", 2024-04-19T03:01:53.169 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011002786000000001 2024-04-19T03:01:53.169 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.169 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.170 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:01:53.170 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.011078+0000", 2024-04-19T03:01:53.170 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013541000000000001 2024-04-19T03:01:53.170 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.170 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.170 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-04-19T03:01:53.170 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.011172+0000", 2024-04-19T03:01:53.170 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.3459000000000001e-05 2024-04-19T03:01:53.170 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.170 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.170 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:01:53.170 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.013211+0000", 2024-04-19T03:01:53.170 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0020397710000000001 2024-04-19T03:01:53.171 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.171 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.171 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:53.171 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.019320+0000", 2024-04-19T03:01:53.171 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0061089969999999997 2024-04-19T03:01:53.171 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.171 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.171 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:01:53.171 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.019364+0000", 2024-04-19T03:01:53.171 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4158e-05 2024-04-19T03:01:53.171 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.171 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.171 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:01:53.171 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.019402+0000", 2024-04-19T03:01:53.172 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7011000000000002e-05 2024-04-19T03:01:53.172 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:53.172 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:01:53.172 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:53.172 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.172 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.172 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:21 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:01:53.172 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:14.999896+0000", 2024-04-19T03:01:53.172 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 38.122418863, 2024-04-19T03:01:53.172 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.018618866000000001, 2024-04-19T03:01:53.172 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:01:53.172 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-19T03:01:53.172 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:01:53.173 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.173 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:01:53.173 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999896+0000", 2024-04-19T03:01:53.173 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:53.173 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.173 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.173 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:01:53.173 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999896+0000", 2024-04-19T03:01:53.173 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:53.173 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.173 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.173 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:01:53.173 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999895+0000", 2024-04-19T03:01:53.173 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:01:53.174 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.174 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.174 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:01:53.174 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999901+0000", 2024-04-19T03:01:53.174 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4529999999999999e-06 2024-04-19T03:01:53.174 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.174 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.174 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:01:53.174 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999918+0000", 2024-04-19T03:01:53.174 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6897000000000001e-05 2024-04-19T03:01:53.174 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.174 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.174 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:01:53.175 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999931+0000", 2024-04-19T03:01:53.175 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.309e-05 2024-04-19T03:01:53.175 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.175 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.175 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:53.175 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.000027+0000", 2024-04-19T03:01:53.175 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.5880999999999999e-05 2024-04-19T03:01:53.175 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.175 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.175 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op must wait for map", 2024-04-19T03:01:53.175 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.000040+0000", 2024-04-19T03:01:53.175 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3083e-05 2024-04-19T03:01:53.175 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.175 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.175 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:53.176 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.004961+0000", 2024-04-19T03:01:53.176 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0049206079999999999 2024-04-19T03:01:53.176 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.176 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.176 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:01:53.176 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.005261+0000", 2024-04-19T03:01:53.176 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00030041699999999998 2024-04-19T03:01:53.176 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.176 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.176 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:01:53.176 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.018515+0000", 2024-04-19T03:01:53.177 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013253534000000001 2024-04-19T03:01:53.177 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:53.177 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:01:53.177 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:53.177 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.177 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.177 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:24 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:01:53.177 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:14.999964+0000", 2024-04-19T03:01:53.177 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 38.122351367999997, 2024-04-19T03:01:53.177 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020451446000000002, 2024-04-19T03:01:53.177 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:01:53.177 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-19T03:01:53.177 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:01:53.178 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.178 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:01:53.178 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999964+0000", 2024-04-19T03:01:53.178 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:53.178 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.178 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.178 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:01:53.178 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999964+0000", 2024-04-19T03:01:53.178 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:53.178 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.178 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.178 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:01:53.178 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999963+0000", 2024-04-19T03:01:53.178 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:01:53.179 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.179 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.179 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:01:53.179 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999969+0000", 2024-04-19T03:01:53.179 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0270000000000001e-06 2024-04-19T03:01:53.179 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.179 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.179 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:01:53.179 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999984+0000", 2024-04-19T03:01:53.179 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5903e-05 2024-04-19T03:01:53.179 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.180 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.181 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:01:53.181 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999998+0000", 2024-04-19T03:01:53.181 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3076e-05 2024-04-19T03:01:53.181 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.181 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.181 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:53.181 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.000078+0000", 2024-04-19T03:01:53.181 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0525000000000006e-05 2024-04-19T03:01:53.181 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.181 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.181 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op must wait for map", 2024-04-19T03:01:53.182 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.000084+0000", 2024-04-19T03:01:53.182 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8370000000000002e-06 2024-04-19T03:01:53.182 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.182 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.182 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:53.182 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.008819+0000", 2024-04-19T03:01:53.182 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0087349019999999993 2024-04-19T03:01:53.182 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.182 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.182 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:01:53.182 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.009018+0000", 2024-04-19T03:01:53.182 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000198989 2024-04-19T03:01:53.182 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.182 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.183 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:01:53.183 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.020415+0000", 2024-04-19T03:01:53.183 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011397157 2024-04-19T03:01:53.183 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:53.183 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:01:53.183 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:53.183 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.183 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.183 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:11274 5.e 5:7c846032:::benchmark_data_smithi096_19531_object11273:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T03:01:53.183 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:42.061776+0000", 2024-04-19T03:01:53.183 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 11.060539123, 2024-04-19T03:01:53.183 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.035381001000000002, 2024-04-19T03:01:53.183 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:01:53.184 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:53.184 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:01:53.184 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:01:53.184 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:53.184 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 11274 2024-04-19T03:01:53.184 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.184 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:01:53.184 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.184 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:01:53.184 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.061776+0000", 2024-04-19T03:01:53.184 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:53.184 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.184 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.184 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:01:53.185 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.061776+0000", 2024-04-19T03:01:53.185 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:53.185 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.185 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.185 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:01:53.185 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.061775+0000", 2024-04-19T03:01:53.185 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:01:53.185 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.185 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.185 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:01:53.185 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.061807+0000", 2024-04-19T03:01:53.185 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1733000000000003e-05 2024-04-19T03:01:53.185 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.186 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.186 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:01:53.186 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.061822+0000", 2024-04-19T03:01:53.186 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5452999999999999e-05 2024-04-19T03:01:53.186 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.186 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.186 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:01:53.186 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.061827+0000", 2024-04-19T03:01:53.186 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9810000000000003e-06 2024-04-19T03:01:53.186 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.186 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.186 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:53.186 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.063388+0000", 2024-04-19T03:01:53.187 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0015605720000000001 2024-04-19T03:01:53.187 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.187 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.187 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:01:53.187 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.063612+0000", 2024-04-19T03:01:53.187 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00022431 2024-04-19T03:01:53.187 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.187 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.187 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:01:53.187 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.063747+0000", 2024-04-19T03:01:53.187 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013459600000000001 2024-04-19T03:01:53.187 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.187 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.187 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:01:53.188 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.066186+0000", 2024-04-19T03:01:53.188 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0024388909999999999 2024-04-19T03:01:53.188 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.188 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.188 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:53.188 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.097016+0000", 2024-04-19T03:01:53.188 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.030830705 2024-04-19T03:01:53.188 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.188 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.188 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:01:53.188 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.097096+0000", 2024-04-19T03:01:53.188 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.9469999999999996e-05 2024-04-19T03:01:53.188 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.189 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.189 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:01:53.189 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.097157+0000", 2024-04-19T03:01:53.189 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0884999999999997e-05 2024-04-19T03:01:53.189 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:53.189 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:01:53.189 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:53.189 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.189 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.189 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:11279 5.8 5:10b60c58:::benchmark_data_smithi096_19531_object11278:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T03:01:53.189 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:42.062594+0000", 2024-04-19T03:01:53.189 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 11.059720685, 2024-04-19T03:01:53.189 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.028696788000000001, 2024-04-19T03:01:53.190 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:01:53.190 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:53.190 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:01:53.190 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:01:53.190 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:53.190 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 11279 2024-04-19T03:01:53.190 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.190 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:01:53.190 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.190 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:01:53.190 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.062594+0000", 2024-04-19T03:01:53.190 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:53.191 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.194 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.194 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:01:53.194 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.062594+0000", 2024-04-19T03:01:53.194 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:53.194 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.194 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.194 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:01:53.194 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.062593+0000", 2024-04-19T03:01:53.194 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:01:53.194 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.194 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.195 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:01:53.195 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.062646+0000", 2024-04-19T03:01:53.195 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2293999999999998e-05 2024-04-19T03:01:53.195 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.195 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.195 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:01:53.195 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.062657+0000", 2024-04-19T03:01:53.195 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1440000000000001e-05 2024-04-19T03:01:53.195 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.195 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.195 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:01:53.195 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.062665+0000", 2024-04-19T03:01:53.195 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5159999999999997e-06 2024-04-19T03:01:53.195 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.196 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.196 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:53.196 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.063799+0000", 2024-04-19T03:01:53.196 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0011344860000000001 2024-04-19T03:01:53.196 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.196 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.196 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:01:53.196 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.063962+0000", 2024-04-19T03:01:53.196 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000162614 2024-04-19T03:01:53.196 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.196 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.196 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:01:53.196 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.064167+0000", 2024-04-19T03:01:53.196 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00020491699999999999 2024-04-19T03:01:53.197 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.197 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.197 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:01:53.197 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.066768+0000", 2024-04-19T03:01:53.197 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0026012090000000002 2024-04-19T03:01:53.197 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.197 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.197 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:53.197 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.091184+0000", 2024-04-19T03:01:53.197 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.024416582999999999 2024-04-19T03:01:53.197 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.197 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.197 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:01:53.197 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.091251+0000", 2024-04-19T03:01:53.198 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6753000000000003e-05 2024-04-19T03:01:53.198 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.198 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.198 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:01:53.198 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.091291+0000", 2024-04-19T03:01:53.198 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9841e-05 2024-04-19T03:01:53.198 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:53.198 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:01:53.198 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:53.198 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.198 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.198 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:11282 5.e 5:75b7c510:::benchmark_data_smithi096_19531_object11281:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T03:01:53.198 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:42.062674+0000", 2024-04-19T03:01:53.198 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 11.059641229, 2024-04-19T03:01:53.199 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.034812849, 2024-04-19T03:01:53.199 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:01:53.199 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:53.199 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:01:53.199 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:01:53.199 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:53.199 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 11282 2024-04-19T03:01:53.199 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.199 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:01:53.199 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.199 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:01:53.199 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.062674+0000", 2024-04-19T03:01:53.199 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:53.199 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.200 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.200 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:01:53.200 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.062674+0000", 2024-04-19T03:01:53.200 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:53.200 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.200 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.200 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:01:53.200 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.062673+0000", 2024-04-19T03:01:53.200 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:01:53.200 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.200 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.200 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:01:53.200 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.062712+0000", 2024-04-19T03:01:53.200 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9341999999999997e-05 2024-04-19T03:01:53.200 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.201 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.201 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:01:53.201 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.062721+0000", 2024-04-19T03:01:53.201 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1700000000000003e-06 2024-04-19T03:01:53.201 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.201 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.201 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:01:53.201 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.062729+0000", 2024-04-19T03:01:53.201 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4240000000000004e-06 2024-04-19T03:01:53.201 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.201 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.201 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:53.201 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.065017+0000", 2024-04-19T03:01:53.201 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0022878590000000002 2024-04-19T03:01:53.202 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.202 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.202 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:01:53.202 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.065207+0000", 2024-04-19T03:01:53.202 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000190411 2024-04-19T03:01:53.202 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.202 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.202 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:01:53.202 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.065323+0000", 2024-04-19T03:01:53.202 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000115593 2024-04-19T03:01:53.202 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.202 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.203 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:01:53.203 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.069683+0000", 2024-04-19T03:01:53.203 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0043604409999999996 2024-04-19T03:01:53.203 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.203 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.203 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:53.203 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.097273+0000", 2024-04-19T03:01:53.203 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.027589516000000001 2024-04-19T03:01:53.203 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.203 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.203 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:01:53.203 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.097406+0000", 2024-04-19T03:01:53.203 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000133514 2024-04-19T03:01:53.203 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.204 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.204 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:01:53.204 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.097486+0000", 2024-04-19T03:01:53.204 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0479e-05 2024-04-19T03:01:53.204 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:53.204 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:01:53.204 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:53.204 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.204 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.204 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:11288 5.0 5:042458d0:::benchmark_data_smithi096_19531_object11287:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T03:01:53.204 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:42.070352+0000", 2024-04-19T03:01:53.204 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 11.051963301000001, 2024-04-19T03:01:53.204 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.021532447, 2024-04-19T03:01:53.205 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:01:53.205 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:53.205 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:01:53.205 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:01:53.205 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:53.205 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 11288 2024-04-19T03:01:53.205 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.205 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:01:53.205 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.205 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:01:53.205 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.070352+0000", 2024-04-19T03:01:53.205 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:53.205 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.206 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.206 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:01:53.206 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.070352+0000", 2024-04-19T03:01:53.206 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:53.206 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.206 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.206 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:01:53.206 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.070351+0000", 2024-04-19T03:01:53.206 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:01:53.206 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.207 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.207 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:01:53.207 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.070392+0000", 2024-04-19T03:01:53.207 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1077e-05 2024-04-19T03:01:53.207 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.207 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.207 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:01:53.207 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.070398+0000", 2024-04-19T03:01:53.207 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1109999999999996e-06 2024-04-19T03:01:53.207 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.207 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.207 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:01:53.207 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.070402+0000", 2024-04-19T03:01:53.208 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2010000000000001e-06 2024-04-19T03:01:53.208 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.208 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.208 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:53.208 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.070445+0000", 2024-04-19T03:01:53.208 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2585e-05 2024-04-19T03:01:53.208 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.208 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.208 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:01:53.208 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.070572+0000", 2024-04-19T03:01:53.208 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012708500000000001 2024-04-19T03:01:53.208 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.208 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.208 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:01:53.209 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.070711+0000", 2024-04-19T03:01:53.209 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013848699999999999 2024-04-19T03:01:53.209 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.209 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.209 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:01:53.209 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.073505+0000", 2024-04-19T03:01:53.209 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0027944620000000002 2024-04-19T03:01:53.209 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.209 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.209 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:53.209 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.091806+0000", 2024-04-19T03:01:53.209 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.018301251000000001 2024-04-19T03:01:53.209 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.209 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.210 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:01:53.210 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.091854+0000", 2024-04-19T03:01:53.210 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7419000000000001e-05 2024-04-19T03:01:53.210 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.210 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.210 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:01:53.210 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.091884+0000", 2024-04-19T03:01:53.210 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0241999999999999e-05 2024-04-19T03:01:53.210 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:53.210 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:01:53.210 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:53.210 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.210 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.211 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:11292 5.0 5:009b2ea9:::benchmark_data_smithi096_19531_object11291:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T03:01:53.211 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:42.070676+0000", 2024-04-19T03:01:53.211 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 11.051638926000001, 2024-04-19T03:01:53.211 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.02219631, 2024-04-19T03:01:53.211 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:01:53.211 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:53.211 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:01:53.211 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:01:53.211 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:53.211 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 11292 2024-04-19T03:01:53.211 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.211 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:01:53.211 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.211 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:01:53.211 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.070676+0000", 2024-04-19T03:01:53.212 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:53.212 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.212 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.212 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:01:53.212 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.070676+0000", 2024-04-19T03:01:53.212 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:53.212 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.212 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.212 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:01:53.212 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.070675+0000", 2024-04-19T03:01:53.212 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:01:53.212 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.212 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.212 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:01:53.213 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.070800+0000", 2024-04-19T03:01:53.213 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000125263 2024-04-19T03:01:53.213 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.213 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.213 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:01:53.213 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.070808+0000", 2024-04-19T03:01:53.213 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0209999999999999e-06 2024-04-19T03:01:53.213 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.213 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.213 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:01:53.213 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.070814+0000", 2024-04-19T03:01:53.213 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0969999999999996e-06 2024-04-19T03:01:53.213 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.213 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.214 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:53.214 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.071956+0000", 2024-04-19T03:01:53.214 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0011427480000000001 2024-04-19T03:01:53.214 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.214 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.214 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:01:53.214 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.072153+0000", 2024-04-19T03:01:53.214 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000196524 2024-04-19T03:01:53.214 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.214 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.214 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:01:53.214 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.072312+0000", 2024-04-19T03:01:53.214 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015879300000000001 2024-04-19T03:01:53.214 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.215 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.215 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:01:53.215 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.078407+0000", 2024-04-19T03:01:53.215 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0060954929999999996 2024-04-19T03:01:53.215 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.215 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.215 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:53.215 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.092742+0000", 2024-04-19T03:01:53.215 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.014335349000000001 2024-04-19T03:01:53.215 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.215 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.215 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:01:53.215 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.092815+0000", 2024-04-19T03:01:53.215 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2881999999999998e-05 2024-04-19T03:01:53.216 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.216 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.216 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:01:53.216 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.092872+0000", 2024-04-19T03:01:53.216 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6965000000000001e-05 2024-04-19T03:01:53.216 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:53.216 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:01:53.216 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:53.216 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.216 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.216 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:11297 5.e 5:7975ecb6:::benchmark_data_smithi096_19531_object11296:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T03:01:53.216 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:42.076848+0000", 2024-04-19T03:01:53.216 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 11.045467046000001, 2024-04-19T03:01:53.217 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020867969, 2024-04-19T03:01:53.217 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:01:53.217 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:53.217 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:01:53.217 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:01:53.217 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:53.217 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 11297 2024-04-19T03:01:53.217 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.217 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:01:53.217 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.217 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:01:53.217 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.076848+0000", 2024-04-19T03:01:53.217 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:53.217 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.218 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.218 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:01:53.218 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.076848+0000", 2024-04-19T03:01:53.218 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:53.218 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.218 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.218 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:01:53.218 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.076846+0000", 2024-04-19T03:01:53.218 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:01:53.218 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.218 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.218 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:01:53.218 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.076894+0000", 2024-04-19T03:01:53.219 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7645000000000002e-05 2024-04-19T03:01:53.219 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.219 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.219 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:01:53.219 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.076913+0000", 2024-04-19T03:01:53.219 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8885e-05 2024-04-19T03:01:53.219 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.219 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.219 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:01:53.219 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.076924+0000", 2024-04-19T03:01:53.219 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.118e-05 2024-04-19T03:01:53.219 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.219 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.219 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:53.220 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.076983+0000", 2024-04-19T03:01:53.220 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8952000000000001e-05 2024-04-19T03:01:53.220 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.220 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.220 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:01:53.220 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.077156+0000", 2024-04-19T03:01:53.220 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00017307600000000001 2024-04-19T03:01:53.220 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.220 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.220 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:01:53.220 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.077358+0000", 2024-04-19T03:01:53.220 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000201991 2024-04-19T03:01:53.220 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.221 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.221 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:01:53.221 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.080885+0000", 2024-04-19T03:01:53.221 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0035268309999999998 2024-04-19T03:01:53.221 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.221 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.221 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:53.221 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.097569+0000", 2024-04-19T03:01:53.221 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.016683854000000001 2024-04-19T03:01:53.221 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.221 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.221 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:01:53.221 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.097647+0000", 2024-04-19T03:01:53.221 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.7823000000000004e-05 2024-04-19T03:01:53.222 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.222 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.222 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:01:53.222 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.097716+0000", 2024-04-19T03:01:53.222 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.9079999999999996e-05 2024-04-19T03:01:53.222 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:53.222 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:01:53.222 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:53.222 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.222 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.222 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:11298 5.e 5:72565f0a:::benchmark_data_smithi096_19531_object11297:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T03:01:53.222 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:42.076954+0000", 2024-04-19T03:01:53.222 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 11.045361172, 2024-04-19T03:01:53.223 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020950191999999999, 2024-04-19T03:01:53.223 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:01:53.223 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:53.223 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:01:53.223 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:01:53.223 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:53.223 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 11298 2024-04-19T03:01:53.223 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.223 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:01:53.223 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.223 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:01:53.223 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.076954+0000", 2024-04-19T03:01:53.223 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:53.224 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.224 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.224 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:01:53.224 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.076954+0000", 2024-04-19T03:01:53.224 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:53.224 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.224 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.224 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:01:53.224 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.076953+0000", 2024-04-19T03:01:53.224 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:01:53.224 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.224 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.224 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:01:53.225 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.076997+0000", 2024-04-19T03:01:53.225 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4023000000000002e-05 2024-04-19T03:01:53.225 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.225 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.225 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:01:53.225 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.077009+0000", 2024-04-19T03:01:53.225 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2456000000000001e-05 2024-04-19T03:01:53.225 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.225 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.225 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:01:53.225 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.077015+0000", 2024-04-19T03:01:53.225 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7950000000000004e-06 2024-04-19T03:01:53.225 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.225 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.225 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:53.226 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.078552+0000", 2024-04-19T03:01:53.226 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0015371320000000001 2024-04-19T03:01:53.226 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.226 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.226 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:01:53.226 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.078760+0000", 2024-04-19T03:01:53.226 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00020808799999999999 2024-04-19T03:01:53.226 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.226 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.226 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:01:53.226 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.078875+0000", 2024-04-19T03:01:53.226 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011457500000000001 2024-04-19T03:01:53.226 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.226 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.227 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:01:53.227 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.083603+0000", 2024-04-19T03:01:53.227 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0047276239999999997 2024-04-19T03:01:53.227 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.227 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.227 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:53.227 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.097783+0000", 2024-04-19T03:01:53.227 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.014180036 2024-04-19T03:01:53.227 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.227 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.227 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:01:53.227 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.097863+0000", 2024-04-19T03:01:53.227 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0317999999999999e-05 2024-04-19T03:01:53.228 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.228 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.228 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:01:53.228 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.097904+0000", 2024-04-19T03:01:53.228 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1035000000000003e-05 2024-04-19T03:01:53.228 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:53.228 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:01:53.228 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:53.228 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.228 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.228 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:33735 5.0 5:0d3df4c1:::benchmark_data_smithi096_19531_object33734:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-19T03:01:53.228 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:51.736996+0000", 2024-04-19T03:01:53.228 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 1.3853193720000001, 2024-04-19T03:01:53.228 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.016460420999999999, 2024-04-19T03:01:53.229 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:01:53.229 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:53.229 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:01:53.229 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:01:53.229 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:53.229 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 33735 2024-04-19T03:01:53.229 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.229 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:01:53.229 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.229 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:01:53.229 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:51.736996+0000", 2024-04-19T03:01:53.229 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:53.229 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.229 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.230 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:01:53.230 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:51.736996+0000", 2024-04-19T03:01:53.230 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:53.230 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.230 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.230 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:01:53.230 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:51.736994+0000", 2024-04-19T03:01:53.230 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:01:53.230 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.230 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.230 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:01:53.230 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:51.737064+0000", 2024-04-19T03:01:53.230 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.9554999999999994e-05 2024-04-19T03:01:53.231 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.231 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.231 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:01:53.231 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:51.737073+0000", 2024-04-19T03:01:53.231 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.0790000000000007e-06 2024-04-19T03:01:53.231 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.231 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.231 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:01:53.231 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:51.737080+0000", 2024-04-19T03:01:53.231 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.9859999999999997e-06 2024-04-19T03:01:53.231 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.231 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.231 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:53.231 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:51.739616+0000", 2024-04-19T03:01:53.232 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0025362129999999998 2024-04-19T03:01:53.232 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.232 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.232 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:01:53.232 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:51.739765+0000", 2024-04-19T03:01:53.232 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014857499999999999 2024-04-19T03:01:53.232 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.232 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.232 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:01:53.232 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:51.739975+0000", 2024-04-19T03:01:53.232 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00020989500000000001 2024-04-19T03:01:53.232 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.232 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.233 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:01:53.233 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:51.743100+0000", 2024-04-19T03:01:53.233 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0031247110000000001 2024-04-19T03:01:53.233 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.233 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.233 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:53.233 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:51.753398+0000", 2024-04-19T03:01:53.233 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.010298880999999999 2024-04-19T03:01:53.233 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.233 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.233 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:01:53.233 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:51.753433+0000", 2024-04-19T03:01:53.233 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4204e-05 2024-04-19T03:01:53.233 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.234 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.234 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:01:53.234 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:51.753456+0000", 2024-04-19T03:01:53.234 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3329999999999999e-05 2024-04-19T03:01:53.234 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:53.234 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:01:53.234 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:53.234 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.234 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.234 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:34393 5.0 5:0af9b819:::benchmark_data_smithi096_19531_object34392:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-19T03:01:53.234 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:52.039968+0000", 2024-04-19T03:01:53.234 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 1.082347264, 2024-04-19T03:01:53.234 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.017022232000000002, 2024-04-19T03:01:53.235 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:01:53.235 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:53.235 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:01:53.235 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:01:53.235 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:53.235 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 34393 2024-04-19T03:01:53.235 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.235 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:01:53.235 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.235 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:01:53.235 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:52.039968+0000", 2024-04-19T03:01:53.235 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:53.235 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.235 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.236 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:01:53.236 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:52.039968+0000", 2024-04-19T03:01:53.236 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:53.236 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.236 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.236 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:01:53.236 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:52.039967+0000", 2024-04-19T03:01:53.236 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:01:53.236 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.236 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.236 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:01:53.236 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:52.040007+0000", 2024-04-19T03:01:53.236 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9509999999999999e-05 2024-04-19T03:01:53.237 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.237 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.237 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:01:53.237 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:52.040014+0000", 2024-04-19T03:01:53.237 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.7999999999999999e-06 2024-04-19T03:01:53.237 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.237 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.237 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:01:53.237 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:52.040020+0000", 2024-04-19T03:01:53.237 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5840000000000002e-06 2024-04-19T03:01:53.237 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.237 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.237 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:53.237 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:52.051245+0000", 2024-04-19T03:01:53.238 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011225153 2024-04-19T03:01:53.238 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.238 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.238 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:01:53.238 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:52.051374+0000", 2024-04-19T03:01:53.238 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000128987 2024-04-19T03:01:53.238 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.238 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.238 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:01:53.238 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:52.051470+0000", 2024-04-19T03:01:53.238 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.6086000000000001e-05 2024-04-19T03:01:53.238 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.238 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.238 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:53.239 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:52.056773+0000", 2024-04-19T03:01:53.239 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0053027940000000004 2024-04-19T03:01:53.239 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.239 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.239 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:01:53.239 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:52.056903+0000", 2024-04-19T03:01:53.239 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012994100000000001 2024-04-19T03:01:53.239 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.239 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.239 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:01:53.239 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:52.056957+0000", 2024-04-19T03:01:53.239 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4462999999999997e-05 2024-04-19T03:01:53.239 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.239 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.240 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:01:53.240 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:52.056990+0000", 2024-04-19T03:01:53.240 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2487000000000003e-05 2024-04-19T03:01:53.240 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:53.240 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:01:53.240 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:53.240 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.240 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.240 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:34755 5.8 5:1953eeae:::benchmark_data_smithi096_19531_object34754:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-19T03:01:53.240 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:52.223155+0000", 2024-04-19T03:01:53.240 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.899160293, 2024-04-19T03:01:53.240 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.017663038999999998, 2024-04-19T03:01:53.240 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:01:53.240 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:53.240 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:01:53.241 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:01:53.241 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:53.241 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 34755 2024-04-19T03:01:53.241 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.241 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:01:53.241 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.241 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:01:53.241 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:52.223155+0000", 2024-04-19T03:01:53.241 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:53.241 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.241 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.241 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:01:53.241 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:52.223155+0000", 2024-04-19T03:01:53.241 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:53.242 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.242 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.242 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:01:53.242 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:52.223154+0000", 2024-04-19T03:01:53.242 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:01:53.242 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.242 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.242 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:01:53.242 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:52.223275+0000", 2024-04-19T03:01:53.242 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000121241 2024-04-19T03:01:53.242 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.242 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.242 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:01:53.242 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:52.223285+0000", 2024-04-19T03:01:53.243 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0407999999999999e-05 2024-04-19T03:01:53.243 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.243 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.243 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:01:53.243 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:52.223293+0000", 2024-04-19T03:01:53.243 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0940000000000008e-06 2024-04-19T03:01:53.243 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.243 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.243 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:53.243 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:52.233001+0000", 2024-04-19T03:01:53.243 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0097077980000000001 2024-04-19T03:01:53.243 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.243 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.243 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:01:53.244 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:52.233197+0000", 2024-04-19T03:01:53.244 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000196329 2024-04-19T03:01:53.244 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.244 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.244 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:01:53.244 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:52.233375+0000", 2024-04-19T03:01:53.244 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00017711800000000001 2024-04-19T03:01:53.244 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.244 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.244 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:53.244 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:52.239338+0000", 2024-04-19T03:01:53.244 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0059637149999999996 2024-04-19T03:01:53.244 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.245 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.245 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:01:53.245 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:52.240752+0000", 2024-04-19T03:01:53.245 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0014136179999999999 2024-04-19T03:01:53.245 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.245 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.245 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:01:53.245 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:52.240794+0000", 2024-04-19T03:01:53.245 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1906000000000002e-05 2024-04-19T03:01:53.245 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.245 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.245 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:01:53.245 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:52.240818+0000", 2024-04-19T03:01:53.245 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3821000000000001e-05 2024-04-19T03:01:53.246 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:53.246 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:01:53.246 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:53.246 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.246 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.246 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:35039 5.e 5:727d1bf0:::benchmark_data_smithi096_19531_object35038:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-19T03:01:53.246 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:52.372805+0000", 2024-04-19T03:01:53.246 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.74950997900000005, 2024-04-19T03:01:53.246 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.016657958, 2024-04-19T03:01:53.246 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:01:53.246 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:53.246 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:01:53.247 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:01:53.247 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:53.247 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 35039 2024-04-19T03:01:53.247 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.247 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:01:53.247 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.247 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:01:53.247 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:52.372805+0000", 2024-04-19T03:01:53.247 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:53.247 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.247 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.247 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:01:53.247 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:52.372805+0000", 2024-04-19T03:01:53.247 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:53.247 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.248 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.248 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:01:53.248 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:52.372804+0000", 2024-04-19T03:01:53.248 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:01:53.248 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.248 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.248 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:01:53.248 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:52.372857+0000", 2024-04-19T03:01:53.248 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3421000000000002e-05 2024-04-19T03:01:53.248 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.248 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.248 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:01:53.248 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:52.372869+0000", 2024-04-19T03:01:53.248 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1454000000000001e-05 2024-04-19T03:01:53.249 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.249 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.249 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:01:53.249 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:52.372876+0000", 2024-04-19T03:01:53.249 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.8680000000000001e-06 2024-04-19T03:01:53.249 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.249 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.249 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:53.249 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:52.376761+0000", 2024-04-19T03:01:53.249 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00388492 2024-04-19T03:01:53.249 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.249 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.249 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:01:53.249 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:52.376919+0000", 2024-04-19T03:01:53.250 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015809400000000001 2024-04-19T03:01:53.250 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.250 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.250 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:01:53.250 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:52.377030+0000", 2024-04-19T03:01:53.250 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000111202 2024-04-19T03:01:53.250 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.250 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.250 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:01:53.250 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:52.386050+0000", 2024-04-19T03:01:53.251 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0090200290000000006 2024-04-19T03:01:53.251 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.251 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.251 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:53.251 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:52.389352+0000", 2024-04-19T03:01:53.251 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0033019049999999999 2024-04-19T03:01:53.251 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.251 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.251 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:01:53.251 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:52.389414+0000", 2024-04-19T03:01:53.251 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2271000000000001e-05 2024-04-19T03:01:53.251 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:53.251 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:53.251 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:01:53.252 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:52.389463+0000", 2024-04-19T03:01:53.252 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8649000000000001e-05 2024-04-19T03:01:53.252 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:53.252 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:01:53.252 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:53.252 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:53.252 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:01:53.252 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-19T03:01:53.254 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-04-19T03:01:53.249+0000 7f35986ab700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18243) UID: 0 2024-04-19T03:01:53.254 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0: {} 2024-04-19T03:01:53.254 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1: {} 2024-04-19T03:01:53.254 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2: {} 2024-04-19T03:01:53.254 INFO:teuthology.orchestra.run.smithi096.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T03:01:53.255 INFO:teuthology.orchestra.run.smithi096.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-19T03:01:53.255 INFO:teuthology.orchestra.run.smithi096.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-19T03:01:53.255 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T03:01:53.355 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:01:53.353+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:01:53.382 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-04-19T03:01:53.382 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:01:53.398 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T03:01:53.455 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:01:53.452+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:01:53.523 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-04-19T03:01:53.523 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:01:53.534 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T03:01:53.578 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:01:53.577+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:01:53.656 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-04-19T03:01:53.656 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:01:53.657 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-04-19T03:01:53.653+0000 7f35986ab700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18243) UID: 0 2024-04-19T03:01:53.668 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T03:01:53.758 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:01:53.756+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:01:53.802 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-04-19T03:01:53.803 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:01:53.815 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T03:01:53.821 INFO:tasks.radosbench.radosbench.0.smithi096.stdout: 16 16 38007 37991 148.387 127.125 0.00683033 0.00673274 2024-04-19T03:01:53.859 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:01:53.857+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:01:53.949 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-04-19T03:01:53.949 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:01:53.959 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:01:53.956+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:01:53.961 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T03:01:54.060 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:01:54.057+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:01:54.071 INFO:teuthology.orchestra.run.smithi096.stderr:noscrub is unset 2024-04-19T03:01:54.095 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-04-19T03:01:54.095 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:01:54.109 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T03:01:54.161 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-04-19T03:01:54.157+0000 7f35986ab700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18243) UID: 0 2024-04-19T03:01:54.240 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-19T03:01:54.240 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:01:54.252 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T03:01:54.262 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:01:54.261+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:01:54.364 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:01:54.361+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:01:54.377 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-19T03:01:54.377 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:01:54.389 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T03:01:54.464 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-04-19T03:01:54.461+0000 7f35986ab700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18243) UID: 0 2024-04-19T03:01:54.513 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-19T03:01:54.513 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:01:54.526 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T03:01:54.570 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:01:54.569+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:01:54.654 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-04-19T03:01:54.654 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:01:54.667 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T03:01:54.667 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:01:54.661+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:01:54.766 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:01:54.761+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:01:54.789 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-04-19T03:01:54.789 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:01:54.802 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T03:01:54.821 INFO:tasks.radosbench.radosbench.0.smithi096.stdout: 17 16 40020 40004 147.058 125.812 0.00668486 0.00679326 2024-04-19T03:01:54.867 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-04-19T03:01:54.865+0000 7f35986ab700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18243) UID: 0 2024-04-19T03:01:54.927 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-04-19T03:01:54.927 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:01:54.939 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T03:01:54.969 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:01:54.965+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:01:55.068 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-04-19T03:01:55.068 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:01:55.069 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-04-19T03:01:55.065+0000 7f35986ab700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18243) UID: 0 2024-04-19T03:01:55.081 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T03:01:55.170 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:01:55.165+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:01:55.209 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-04-19T03:01:55.209 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:01:55.222 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T03:01:55.268 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-19T03:01:55.270 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:01:55.268+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:01:55.353 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-04-19T03:01:55.354 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:01:55.367 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T03:01:55.371 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:01:55.369+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:01:55.427 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0: {} 2024-04-19T03:01:55.449 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1: {} 2024-04-19T03:01:55.470 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2: {} 2024-04-19T03:01:55.472 INFO:teuthology.orchestra.run.smithi096.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T03:01:55.472 INFO:teuthology.orchestra.run.smithi096.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-19T03:01:55.472 INFO:teuthology.orchestra.run.smithi096.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-19T03:01:55.472 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:01:55.469+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:01:55.483 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-19T03:01:55.484 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-04-19T03:01:55.484 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.484 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4755.0:41307 5.a e30/22 5:50ff1087:::benchmark_data_smithi096_19531_object41306:head v 30'2500, mlcod=30'2497)", 2024-04-19T03:01:55.484 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:55.477756+0000", 2024-04-19T03:01:55.484 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0054745000000000002, 2024-04-19T03:01:55.484 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.005491147, 2024-04-19T03:01:55.484 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:01:55.484 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-19T03:01:55.484 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:01:55.484 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.484 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:01:55.484 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:55.477756+0000", 2024-04-19T03:01:55.485 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:55.485 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.485 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.485 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:01:55.485 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:55.477756+0000", 2024-04-19T03:01:55.485 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:55.485 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.485 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.485 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:01:55.485 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:55.477755+0000", 2024-04-19T03:01:55.485 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:01:55.485 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.485 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.486 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:01:55.486 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:55.477827+0000", 2024-04-19T03:01:55.486 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.1903000000000006e-05 2024-04-19T03:01:55.486 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.486 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.486 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:01:55.486 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:55.477833+0000", 2024-04-19T03:01:55.486 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1099999999999999e-06 2024-04-19T03:01:55.486 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.486 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.486 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:01:55.486 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:55.477837+0000", 2024-04-19T03:01:55.487 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9110000000000003e-06 2024-04-19T03:01:55.487 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.487 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.487 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:55.487 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:55.477874+0000", 2024-04-19T03:01:55.487 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7058000000000003e-05 2024-04-19T03:01:55.487 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.487 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.487 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:01:55.488 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:55.477893+0000", 2024-04-19T03:01:55.488 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9174e-05 2024-04-19T03:01:55.488 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:55.488 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:01:55.488 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:55.488 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.488 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.488 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:41310 5.4 5:281817e5:::benchmark_data_smithi096_19531_object41309:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-19T03:01:55.488 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:55.477867+0000", 2024-04-19T03:01:55.488 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0053637930000000004, 2024-04-19T03:01:55.488 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0055115169999999996, 2024-04-19T03:01:55.488 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:01:55.488 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:01:55.489 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:01:55.489 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:01:55.489 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:55.489 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 41310 2024-04-19T03:01:55.489 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.489 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:01:55.489 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.489 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:01:55.489 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:55.477867+0000", 2024-04-19T03:01:55.489 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:55.489 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.489 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.489 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:01:55.490 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:55.477867+0000", 2024-04-19T03:01:55.490 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:55.490 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.490 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.490 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:01:55.490 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:55.477866+0000", 2024-04-19T03:01:55.490 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:01:55.490 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.490 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.490 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:01:55.490 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:55.477898+0000", 2024-04-19T03:01:55.490 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2449000000000001e-05 2024-04-19T03:01:55.490 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.491 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.491 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:01:55.491 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:55.477904+0000", 2024-04-19T03:01:55.491 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1829999999999999e-06 2024-04-19T03:01:55.491 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.491 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.491 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:01:55.491 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:55.477913+0000", 2024-04-19T03:01:55.491 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9430000000000006e-06 2024-04-19T03:01:55.491 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.491 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.491 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:55.491 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:55.477964+0000", 2024-04-19T03:01:55.491 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0748000000000003e-05 2024-04-19T03:01:55.491 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.492 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.492 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:01:55.492 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:55.478102+0000", 2024-04-19T03:01:55.492 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013763999999999999 2024-04-19T03:01:55.492 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.492 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.492 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:01:55.492 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:55.478264+0000", 2024-04-19T03:01:55.492 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016260800000000001 2024-04-19T03:01:55.492 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:55.492 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:01:55.492 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:55.492 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.493 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.493 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:41311 5.4 5:2c113812:::benchmark_data_smithi096_19531_object41310:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-19T03:01:55.493 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:55.477926+0000", 2024-04-19T03:01:55.493 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0053043279999999996, 2024-04-19T03:01:55.493 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0055209980000000001, 2024-04-19T03:01:55.493 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:01:55.493 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:01:55.493 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:01:55.493 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:01:55.493 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:55.493 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 41311 2024-04-19T03:01:55.493 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.493 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:01:55.494 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.494 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:01:55.494 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:55.477926+0000", 2024-04-19T03:01:55.494 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:55.494 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.494 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.494 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:01:55.494 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:55.477926+0000", 2024-04-19T03:01:55.494 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:55.494 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.494 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.494 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:01:55.494 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:55.477926+0000", 2024-04-19T03:01:55.495 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:01:55.495 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.495 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.495 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:01:55.495 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:55.477969+0000", 2024-04-19T03:01:55.495 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2917999999999998e-05 2024-04-19T03:01:55.495 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.495 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.495 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:01:55.495 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:55.477976+0000", 2024-04-19T03:01:55.495 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.7009999999999996e-06 2024-04-19T03:01:55.495 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.495 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.496 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:01:55.496 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:55.477982+0000", 2024-04-19T03:01:55.496 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9660000000000001e-06 2024-04-19T03:01:55.496 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.496 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.496 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:55.496 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:55.479981+0000", 2024-04-19T03:01:55.496 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001998887 2024-04-19T03:01:55.496 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.496 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.496 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:01:55.496 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:55.480076+0000", 2024-04-19T03:01:55.496 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.5153000000000002e-05 2024-04-19T03:01:55.496 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.497 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.497 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:01:55.497 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:55.480164+0000", 2024-04-19T03:01:55.497 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.7443999999999998e-05 2024-04-19T03:01:55.497 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:55.497 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:01:55.497 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:55.497 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.497 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.497 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:41313 5.8 5:1a03c0ab:::benchmark_data_smithi096_19531_object41312:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-19T03:01:55.497 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:55.480207+0000", 2024-04-19T03:01:55.497 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0030232200000000001, 2024-04-19T03:01:55.497 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0032829500000000002, 2024-04-19T03:01:55.497 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:01:55.498 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:01:55.498 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:01:55.498 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:01:55.498 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:55.498 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 41313 2024-04-19T03:01:55.498 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.498 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:01:55.498 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.498 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:01:55.498 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:55.480207+0000", 2024-04-19T03:01:55.498 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:55.498 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.499 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.499 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:01:55.499 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:55.480207+0000", 2024-04-19T03:01:55.499 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:55.499 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.499 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.499 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:01:55.499 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:55.480206+0000", 2024-04-19T03:01:55.499 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:01:55.499 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.499 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.499 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:01:55.499 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:55.480295+0000", 2024-04-19T03:01:55.499 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9111999999999997e-05 2024-04-19T03:01:55.500 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.500 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.500 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:01:55.500 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:55.480309+0000", 2024-04-19T03:01:55.500 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4049999999999999e-05 2024-04-19T03:01:55.500 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.500 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.500 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:01:55.500 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:55.480320+0000", 2024-04-19T03:01:55.500 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0074e-05 2024-04-19T03:01:55.500 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.500 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.500 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:55.501 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:55.480375+0000", 2024-04-19T03:01:55.501 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5346000000000002e-05 2024-04-19T03:01:55.501 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.501 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.501 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:01:55.501 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:55.480534+0000", 2024-04-19T03:01:55.501 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000158987 2024-04-19T03:01:55.501 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.501 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.501 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:01:55.501 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:55.480708+0000", 2024-04-19T03:01:55.501 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00017427600000000001 2024-04-19T03:01:55.501 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:55.501 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:01:55.502 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:55.502 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.502 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.502 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:41315 5.4 5:20559512:::benchmark_data_smithi096_19531_object41314:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-19T03:01:55.502 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:55.480417+0000", 2024-04-19T03:01:55.502 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0028136379999999998, 2024-04-19T03:01:55.502 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0031270579999999998, 2024-04-19T03:01:55.502 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:01:55.502 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:01:55.502 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:01:55.502 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:01:55.502 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:55.502 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 41315 2024-04-19T03:01:55.503 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.503 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:01:55.503 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.503 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:01:55.503 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:55.480417+0000", 2024-04-19T03:01:55.503 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:55.503 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.503 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.503 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:01:55.503 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:55.480417+0000", 2024-04-19T03:01:55.503 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:55.503 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.503 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.503 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:01:55.504 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:55.480416+0000", 2024-04-19T03:01:55.504 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:01:55.504 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.504 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.504 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:01:55.504 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:55.480489+0000", 2024-04-19T03:01:55.504 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3405000000000006e-05 2024-04-19T03:01:55.504 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.504 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.504 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:01:55.504 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:55.480497+0000", 2024-04-19T03:01:55.504 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3699999999999997e-06 2024-04-19T03:01:55.504 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.505 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.505 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:01:55.505 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:55.480502+0000", 2024-04-19T03:01:55.505 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9339999999999997e-06 2024-04-19T03:01:55.505 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.505 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.505 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:55.505 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:55.481674+0000", 2024-04-19T03:01:55.505 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0011721380000000001 2024-04-19T03:01:55.505 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.505 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.505 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:01:55.505 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:55.481793+0000", 2024-04-19T03:01:55.505 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011935899999999999 2024-04-19T03:01:55.506 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.506 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.506 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:01:55.506 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:55.481877+0000", 2024-04-19T03:01:55.506 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3380000000000005e-05 2024-04-19T03:01:55.506 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:55.506 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:01:55.506 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:55.506 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.506 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.506 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4755.0:41309 5.a e30/22 5:59b94fb0:::benchmark_data_smithi096_19531_object41308:head v 30'2501, mlcod=30'2497)", 2024-04-19T03:01:55.506 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:55.480699+0000", 2024-04-19T03:01:55.506 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0025318390000000001, 2024-04-19T03:01:55.506 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.002884906, 2024-04-19T03:01:55.507 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:01:55.507 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-19T03:01:55.507 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:01:55.507 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.507 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:01:55.507 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:55.480699+0000", 2024-04-19T03:01:55.507 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:55.507 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.507 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.507 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:01:55.507 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:55.480699+0000", 2024-04-19T03:01:55.507 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:55.507 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.507 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.508 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:01:55.508 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:55.480698+0000", 2024-04-19T03:01:55.508 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:01:55.508 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.508 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.508 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:01:55.508 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:55.480813+0000", 2024-04-19T03:01:55.508 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000115376 2024-04-19T03:01:55.508 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.508 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.508 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:01:55.508 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:55.480820+0000", 2024-04-19T03:01:55.508 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2210000000000002e-06 2024-04-19T03:01:55.508 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.509 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.509 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:01:55.509 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:55.480826+0000", 2024-04-19T03:01:55.509 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0800000000000002e-06 2024-04-19T03:01:55.509 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.509 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.509 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:55.509 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:55.480880+0000", 2024-04-19T03:01:55.509 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3882999999999999e-05 2024-04-19T03:01:55.509 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.509 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.509 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:01:55.509 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:55.480899+0000", 2024-04-19T03:01:55.509 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9293999999999999e-05 2024-04-19T03:01:55.510 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:55.510 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:01:55.510 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:55.510 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.510 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.510 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:41317 5.e 5:7391fc5a:::benchmark_data_smithi096_19531_object41316:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-19T03:01:55.510 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:55.482385+0000", 2024-04-19T03:01:55.510 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.00084495999999999996, 2024-04-19T03:01:55.510 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0012326220000000001, 2024-04-19T03:01:55.510 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:01:55.510 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:01:55.510 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:01:55.510 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:01:55.511 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:55.511 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 41317 2024-04-19T03:01:55.511 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.511 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:01:55.511 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.511 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:01:55.511 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:55.482385+0000", 2024-04-19T03:01:55.511 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:55.511 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.511 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.511 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:01:55.511 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:55.482385+0000", 2024-04-19T03:01:55.511 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:55.511 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.511 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.512 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:01:55.512 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:55.482384+0000", 2024-04-19T03:01:55.512 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:01:55.512 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.512 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.512 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:01:55.512 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:55.482442+0000", 2024-04-19T03:01:55.512 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7670000000000002e-05 2024-04-19T03:01:55.512 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.512 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.512 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:01:55.512 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:55.482458+0000", 2024-04-19T03:01:55.512 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5885000000000001e-05 2024-04-19T03:01:55.512 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.513 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.513 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:01:55.513 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:55.482467+0000", 2024-04-19T03:01:55.513 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.4720000000000001e-06 2024-04-19T03:01:55.513 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.513 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.513 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:55.513 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:55.482514+0000", 2024-04-19T03:01:55.513 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6258000000000003e-05 2024-04-19T03:01:55.513 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.513 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.513 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:01:55.513 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:55.482657+0000", 2024-04-19T03:01:55.514 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000143311 2024-04-19T03:01:55.514 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.514 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.514 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:01:55.514 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:55.482848+0000", 2024-04-19T03:01:55.514 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000190535 2024-04-19T03:01:55.514 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:55.514 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:01:55.514 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:55.514 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.514 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.514 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4755.0:41320 5.f e30/22 5:f02de4a4:::benchmark_data_smithi096_19531_object41319:head v 30'2623, mlcod=30'2621)", 2024-04-19T03:01:55.514 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:55.483290+0000", 2024-04-19T03:01:55.515 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 4294967295.9999409, 2024-04-19T03:01:55.515 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00037063800000000001, 2024-04-19T03:01:55.515 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:01:55.515 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-19T03:01:55.515 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:01:55.515 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.515 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:01:55.515 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:55.483290+0000", 2024-04-19T03:01:55.515 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:55.515 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.515 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.515 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:01:55.515 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:55.483290+0000", 2024-04-19T03:01:55.515 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:55.516 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.516 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.516 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:01:55.516 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:55.483289+0000", 2024-04-19T03:01:55.516 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:01:55.516 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.516 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.516 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:01:55.516 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:55.483349+0000", 2024-04-19T03:01:55.516 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0081999999999998e-05 2024-04-19T03:01:55.516 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.516 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.516 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:01:55.516 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:55.483363+0000", 2024-04-19T03:01:55.517 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4287000000000001e-05 2024-04-19T03:01:55.517 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.517 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.517 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:01:55.517 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:55.483378+0000", 2024-04-19T03:01:55.517 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4567e-05 2024-04-19T03:01:55.517 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.517 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.517 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:55.517 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:55.483420+0000", 2024-04-19T03:01:55.517 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2330999999999998e-05 2024-04-19T03:01:55.517 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.517 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.518 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:01:55.518 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:55.483434+0000", 2024-04-19T03:01:55.518 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.412e-05 2024-04-19T03:01:55.518 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:55.518 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:01:55.518 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:55.518 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.518 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.518 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:41304 5.4 5:26ad50ab:::benchmark_data_smithi096_19531_object41303:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-19T03:01:55.518 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:55.475313+0000", 2024-04-19T03:01:55.518 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.00791736, 2024-04-19T03:01:55.518 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0083820630000000004, 2024-04-19T03:01:55.518 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:01:55.519 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:01:55.519 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:01:55.519 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:01:55.519 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:55.519 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 41304 2024-04-19T03:01:55.519 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.519 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:01:55.519 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.519 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:01:55.519 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:55.475313+0000", 2024-04-19T03:01:55.519 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:55.519 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.519 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.520 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:01:55.520 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:55.475313+0000", 2024-04-19T03:01:55.520 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:55.520 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.520 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.520 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:01:55.520 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:55.475312+0000", 2024-04-19T03:01:55.520 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:01:55.520 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.520 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.520 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:01:55.520 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:55.475354+0000", 2024-04-19T03:01:55.520 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1501000000000001e-05 2024-04-19T03:01:55.520 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.521 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.521 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:01:55.521 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:55.475362+0000", 2024-04-19T03:01:55.521 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.2840000000000006e-06 2024-04-19T03:01:55.521 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.521 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.521 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:01:55.521 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:55.475369+0000", 2024-04-19T03:01:55.521 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.1810000000000004e-06 2024-04-19T03:01:55.521 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.521 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.521 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:55.521 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:55.475434+0000", 2024-04-19T03:01:55.522 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4754999999999999e-05 2024-04-19T03:01:55.522 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.522 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.522 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:01:55.522 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:55.475560+0000", 2024-04-19T03:01:55.522 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000125723 2024-04-19T03:01:55.522 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.522 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.522 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:01:55.522 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:55.475690+0000", 2024-04-19T03:01:55.522 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013032000000000001 2024-04-19T03:01:55.522 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.522 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.522 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:01:55.523 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:55.483516+0000", 2024-04-19T03:01:55.523 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0078257139999999992 2024-04-19T03:01:55.523 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:55.523 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:01:55.523 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:55.523 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.523 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.523 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:41305 5.e 5:7b35df67:::benchmark_data_smithi096_19531_object41304:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-19T03:01:55.523 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:55.475393+0000", 2024-04-19T03:01:55.523 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.007837218, 2024-04-19T03:01:55.523 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0083463340000000004, 2024-04-19T03:01:55.523 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:01:55.523 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:01:55.524 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:01:55.524 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:01:55.524 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:55.524 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 41305 2024-04-19T03:01:55.524 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.524 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:01:55.524 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.524 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:01:55.524 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:55.475393+0000", 2024-04-19T03:01:55.524 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:55.524 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.524 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.524 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:01:55.524 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:55.475393+0000", 2024-04-19T03:01:55.524 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:55.525 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.525 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.525 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:01:55.525 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:55.475393+0000", 2024-04-19T03:01:55.525 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:01:55.525 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.525 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.525 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:01:55.525 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:55.475429+0000", 2024-04-19T03:01:55.525 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5904e-05 2024-04-19T03:01:55.525 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.525 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.525 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:01:55.526 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:55.475436+0000", 2024-04-19T03:01:55.526 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.8299999999999996e-06 2024-04-19T03:01:55.526 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.526 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.526 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:01:55.526 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:55.475442+0000", 2024-04-19T03:01:55.526 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.383e-06 2024-04-19T03:01:55.526 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.526 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.526 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:55.526 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:55.477697+0000", 2024-04-19T03:01:55.526 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0022555600000000002 2024-04-19T03:01:55.526 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.527 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.527 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:01:55.527 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:55.477853+0000", 2024-04-19T03:01:55.527 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015563999999999999 2024-04-19T03:01:55.527 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.527 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.527 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:01:55.527 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:55.477994+0000", 2024-04-19T03:01:55.527 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000141058 2024-04-19T03:01:55.527 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:55.527 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:01:55.527 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:55.527 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:55.527 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-04-19T03:01:55.527 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 10 2024-04-19T03:01:55.528 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-19T03:01:55.529 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T03:01:55.573 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-04-19T03:01:55.569+0000 7f35986ab700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18243) UID: 0 2024-04-19T03:01:55.660 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-19T03:01:55.660 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-04-19T03:01:55.661 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-04-19T03:01:55.661 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-04-19T03:01:55.661 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-19T03:01:55.674 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T03:01:55.675 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:01:55.672+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:01:55.775 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:01:55.772+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:01:55.809 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-19T03:01:55.809 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-04-19T03:01:55.809 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-04-19T03:01:55.809 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-04-19T03:01:55.809 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.809 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:9 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:01:55.809 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:14.999380+0000", 2024-04-19T03:01:55.809 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 40.806034816999997, 2024-04-19T03:01:55.810 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.019009906, 2024-04-19T03:01:55.810 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:01:55.810 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:55.810 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:01:55.810 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.810 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:01:55.810 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999380+0000", 2024-04-19T03:01:55.810 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:55.810 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.810 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.810 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:01:55.810 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999380+0000", 2024-04-19T03:01:55.810 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:55.811 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.811 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.811 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:01:55.811 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999377+0000", 2024-04-19T03:01:55.811 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999971 2024-04-19T03:01:55.811 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.811 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.811 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:01:55.811 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999393+0000", 2024-04-19T03:01:55.811 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5665999999999999e-05 2024-04-19T03:01:55.811 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.811 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.811 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:01:55.811 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999416+0000", 2024-04-19T03:01:55.812 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3030000000000001e-05 2024-04-19T03:01:55.812 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.812 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.812 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:01:55.812 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999439+0000", 2024-04-19T03:01:55.812 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3203000000000001e-05 2024-04-19T03:01:55.812 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.812 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.812 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:55.812 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999564+0000", 2024-04-19T03:01:55.812 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012492800000000001 2024-04-19T03:01:55.812 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.813 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.813 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op must wait for map", 2024-04-19T03:01:55.813 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999573+0000", 2024-04-19T03:01:55.813 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.7129999999999994e-06 2024-04-19T03:01:55.813 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.813 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.813 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:55.813 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.005623+0000", 2024-04-19T03:01:55.813 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0060502120000000001 2024-04-19T03:01:55.813 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.813 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.813 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:01:55.814 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.006510+0000", 2024-04-19T03:01:55.814 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00088656 2024-04-19T03:01:55.814 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.814 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.814 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-04-19T03:01:55.814 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.008004+0000", 2024-04-19T03:01:55.814 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0014948240000000001 2024-04-19T03:01:55.814 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.814 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.814 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:01:55.814 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.011874+0000", 2024-04-19T03:01:55.814 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0038699630000000001 2024-04-19T03:01:55.814 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.815 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.815 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:55.815 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.018000+0000", 2024-04-19T03:01:55.815 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0061254389999999999 2024-04-19T03:01:55.815 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.815 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.815 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:01:55.815 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.018281+0000", 2024-04-19T03:01:55.815 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00028121400000000001 2024-04-19T03:01:55.815 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.816 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.816 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:01:55.816 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.018390+0000", 2024-04-19T03:01:55.816 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010899 2024-04-19T03:01:55.816 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:55.816 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:01:55.816 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:55.816 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.816 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.816 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:10 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:01:55.816 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:14.999496+0000", 2024-04-19T03:01:55.816 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 40.805919281999998, 2024-04-19T03:01:55.816 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.022720497999999999, 2024-04-19T03:01:55.816 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:01:55.817 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:55.817 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:01:55.817 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.817 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:01:55.817 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999496+0000", 2024-04-19T03:01:55.817 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:55.817 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.817 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.817 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:01:55.817 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999496+0000", 2024-04-19T03:01:55.817 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:55.817 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.817 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.818 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:01:55.818 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999494+0000", 2024-04-19T03:01:55.818 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:01:55.818 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.818 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.818 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:01:55.818 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999503+0000", 2024-04-19T03:01:55.818 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.5930000000000006e-06 2024-04-19T03:01:55.818 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.818 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.818 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:01:55.818 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999523+0000", 2024-04-19T03:01:55.818 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9553000000000001e-05 2024-04-19T03:01:55.818 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.819 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.819 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:01:55.819 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999538+0000", 2024-04-19T03:01:55.819 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5702999999999999e-05 2024-04-19T03:01:55.819 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.819 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.819 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:55.819 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999608+0000", 2024-04-19T03:01:55.819 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.9912000000000004e-05 2024-04-19T03:01:55.819 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.819 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.819 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op must wait for map", 2024-04-19T03:01:55.819 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999626+0000", 2024-04-19T03:01:55.819 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8207e-05 2024-04-19T03:01:55.820 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.820 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.820 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:55.820 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.010765+0000", 2024-04-19T03:01:55.820 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011138719 2024-04-19T03:01:55.820 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.820 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.820 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:01:55.820 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.010906+0000", 2024-04-19T03:01:55.820 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014095899999999999 2024-04-19T03:01:55.820 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.820 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.820 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-04-19T03:01:55.820 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.011472+0000", 2024-04-19T03:01:55.820 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00056629300000000005 2024-04-19T03:01:55.821 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.821 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.821 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:01:55.821 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.013217+0000", 2024-04-19T03:01:55.821 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001744317 2024-04-19T03:01:55.821 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.821 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.821 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:55.821 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.022083+0000", 2024-04-19T03:01:55.821 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0088663849999999992 2024-04-19T03:01:55.821 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.821 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.821 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:01:55.821 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.022124+0000", 2024-04-19T03:01:55.822 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.057e-05 2024-04-19T03:01:55.822 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.822 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.822 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:01:55.822 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.022216+0000", 2024-04-19T03:01:55.822 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.2417000000000006e-05 2024-04-19T03:01:55.822 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:55.822 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:01:55.822 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:55.822 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.822 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.822 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:13 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:01:55.822 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:14.999564+0000", 2024-04-19T03:01:55.822 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 40.805850399999997, 2024-04-19T03:01:55.823 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.019594777000000001, 2024-04-19T03:01:55.823 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:01:55.823 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:55.823 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:01:55.823 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.823 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:01:55.823 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999564+0000", 2024-04-19T03:01:55.823 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:55.823 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.823 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.823 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:01:55.823 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999564+0000", 2024-04-19T03:01:55.823 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:55.823 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.824 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.824 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:01:55.824 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999563+0000", 2024-04-19T03:01:55.824 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:01:55.824 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.824 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.824 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:01:55.824 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999582+0000", 2024-04-19T03:01:55.824 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8151999999999998e-05 2024-04-19T03:01:55.824 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.824 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.824 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:01:55.824 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999599+0000", 2024-04-19T03:01:55.824 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7583000000000001e-05 2024-04-19T03:01:55.825 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.825 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.825 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:01:55.825 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999618+0000", 2024-04-19T03:01:55.825 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8989999999999999e-05 2024-04-19T03:01:55.825 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.825 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.825 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:55.825 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999692+0000", 2024-04-19T03:01:55.825 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3561999999999998e-05 2024-04-19T03:01:55.825 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.825 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.825 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op must wait for map", 2024-04-19T03:01:55.825 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999698+0000", 2024-04-19T03:01:55.826 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7159999999999997e-06 2024-04-19T03:01:55.826 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.826 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.826 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:55.826 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.007836+0000", 2024-04-19T03:01:55.826 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0081376520000000004 2024-04-19T03:01:55.826 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.826 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.826 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:01:55.827 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.008208+0000", 2024-04-19T03:01:55.827 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00037223699999999998 2024-04-19T03:01:55.827 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.827 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.827 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-04-19T03:01:55.827 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.008516+0000", 2024-04-19T03:01:55.827 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000308227 2024-04-19T03:01:55.827 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.827 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.827 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:01:55.827 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.011585+0000", 2024-04-19T03:01:55.828 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0030680659999999999 2024-04-19T03:01:55.828 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.828 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.828 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:55.828 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.018871+0000", 2024-04-19T03:01:55.828 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0072861369999999998 2024-04-19T03:01:55.828 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.828 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.828 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:01:55.828 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.019067+0000", 2024-04-19T03:01:55.828 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00019672099999999999 2024-04-19T03:01:55.828 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.828 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.829 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:01:55.829 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.019159+0000", 2024-04-19T03:01:55.829 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1829999999999993e-05 2024-04-19T03:01:55.829 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:55.829 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:01:55.829 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:55.829 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.829 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.829 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:31 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:01:55.829 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:14.999649+0000", 2024-04-19T03:01:55.830 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 40.805766282, 2024-04-19T03:01:55.830 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.018882121000000002, 2024-04-19T03:01:55.830 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:01:55.830 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:55.830 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:01:55.830 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.830 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:01:55.830 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999649+0000", 2024-04-19T03:01:55.830 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:55.830 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.830 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.830 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:01:55.830 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999649+0000", 2024-04-19T03:01:55.831 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:55.831 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.831 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.831 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:01:55.831 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999647+0000", 2024-04-19T03:01:55.831 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:01:55.831 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.831 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.831 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:01:55.831 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999657+0000", 2024-04-19T03:01:55.831 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.3729999999999999e-06 2024-04-19T03:01:55.831 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.831 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.831 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:01:55.832 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999675+0000", 2024-04-19T03:01:55.832 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8522999999999999e-05 2024-04-19T03:01:55.832 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.832 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.832 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:01:55.832 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999689+0000", 2024-04-19T03:01:55.832 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.347e-05 2024-04-19T03:01:55.833 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.833 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.833 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:55.833 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999761+0000", 2024-04-19T03:01:55.833 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.1904999999999997e-05 2024-04-19T03:01:55.833 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.833 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.833 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:01:55.833 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999766+0000", 2024-04-19T03:01:55.833 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6069999999999998e-06 2024-04-19T03:01:55.833 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.834 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.834 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:55.834 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.010040+0000", 2024-04-19T03:01:55.834 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.010273381 2024-04-19T03:01:55.834 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.834 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.835 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:01:55.835 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.010260+0000", 2024-04-19T03:01:55.835 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00022003300000000001 2024-04-19T03:01:55.835 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.835 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.835 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-04-19T03:01:55.835 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.010415+0000", 2024-04-19T03:01:55.835 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015515599999999999 2024-04-19T03:01:55.835 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.835 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.835 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:01:55.835 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.013206+0000", 2024-04-19T03:01:55.835 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0027915010000000001 2024-04-19T03:01:55.836 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.836 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.836 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:55.836 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.018438+0000", 2024-04-19T03:01:55.836 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0052313469999999999 2024-04-19T03:01:55.836 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.836 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.836 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:01:55.836 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.018491+0000", 2024-04-19T03:01:55.836 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3554000000000003e-05 2024-04-19T03:01:55.836 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.836 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.836 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:01:55.836 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.018531+0000", 2024-04-19T03:01:55.837 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9384000000000001e-05 2024-04-19T03:01:55.837 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:55.837 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:01:55.837 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:55.837 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.837 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.837 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:32 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:01:55.838 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:14.999712+0000", 2024-04-19T03:01:55.838 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 40.805703039000001, 2024-04-19T03:01:55.838 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.022635437000000001, 2024-04-19T03:01:55.838 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:01:55.838 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:55.838 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:01:55.839 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.839 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:01:55.839 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999712+0000", 2024-04-19T03:01:55.839 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:55.839 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.839 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.839 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:01:55.839 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999712+0000", 2024-04-19T03:01:55.839 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:55.839 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.839 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.839 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:01:55.839 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999711+0000", 2024-04-19T03:01:55.840 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:01:55.840 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.840 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.840 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:01:55.840 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999719+0000", 2024-04-19T03:01:55.840 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.354e-06 2024-04-19T03:01:55.840 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.840 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.840 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:01:55.840 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999735+0000", 2024-04-19T03:01:55.840 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6288999999999999e-05 2024-04-19T03:01:55.840 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.841 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.841 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:01:55.841 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999749+0000", 2024-04-19T03:01:55.841 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3492999999999999e-05 2024-04-19T03:01:55.841 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.841 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.841 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:55.841 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999811+0000", 2024-04-19T03:01:55.841 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2298999999999994e-05 2024-04-19T03:01:55.841 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.841 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.841 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:01:55.841 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999817+0000", 2024-04-19T03:01:55.841 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2169999999999999e-06 2024-04-19T03:01:55.842 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.842 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.842 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:55.842 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.011836+0000", 2024-04-19T03:01:55.842 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.012018008 2024-04-19T03:01:55.842 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.842 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.842 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:01:55.842 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.011897+0000", 2024-04-19T03:01:55.842 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1111000000000005e-05 2024-04-19T03:01:55.842 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.842 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.843 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-04-19T03:01:55.843 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.011980+0000", 2024-04-19T03:01:55.843 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3003999999999993e-05 2024-04-19T03:01:55.843 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.843 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.843 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:01:55.843 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.013863+0000", 2024-04-19T03:01:55.843 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001883804 2024-04-19T03:01:55.843 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.843 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.843 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:55.843 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.022257+0000", 2024-04-19T03:01:55.843 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0083938290000000002 2024-04-19T03:01:55.843 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.844 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.844 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:01:55.844 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.022310+0000", 2024-04-19T03:01:55.844 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.236e-05 2024-04-19T03:01:55.844 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.844 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.844 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:01:55.844 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.022347+0000", 2024-04-19T03:01:55.844 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7653e-05 2024-04-19T03:01:55.844 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:55.844 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:01:55.844 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:55.844 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.844 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.845 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:35 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:01:55.845 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:14.999772+0000", 2024-04-19T03:01:55.845 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 40.805642759999998, 2024-04-19T03:01:55.845 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020205530999999999, 2024-04-19T03:01:55.845 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:01:55.845 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:55.845 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:01:55.845 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.845 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:01:55.845 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999772+0000", 2024-04-19T03:01:55.845 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:55.845 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.845 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.846 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:01:55.846 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999772+0000", 2024-04-19T03:01:55.846 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:55.846 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.846 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.846 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:01:55.846 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999771+0000", 2024-04-19T03:01:55.846 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:01:55.846 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.846 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.846 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:01:55.846 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999778+0000", 2024-04-19T03:01:55.847 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2200000000000003e-06 2024-04-19T03:01:55.847 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.847 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.847 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:01:55.847 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999794+0000", 2024-04-19T03:01:55.847 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5798999999999999e-05 2024-04-19T03:01:55.847 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.847 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.847 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:01:55.847 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999809+0000", 2024-04-19T03:01:55.847 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.469e-05 2024-04-19T03:01:55.847 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.847 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.847 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:55.848 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999915+0000", 2024-04-19T03:01:55.848 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000105658 2024-04-19T03:01:55.848 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.848 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.848 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:01:55.848 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999927+0000", 2024-04-19T03:01:55.848 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.201e-05 2024-04-19T03:01:55.848 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.848 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.848 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:55.848 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.009841+0000", 2024-04-19T03:01:55.848 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0099147039999999999 2024-04-19T03:01:55.848 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.849 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.849 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:01:55.849 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.009941+0000", 2024-04-19T03:01:55.849 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.9461000000000002e-05 2024-04-19T03:01:55.849 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.849 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.849 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-04-19T03:01:55.849 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.010101+0000", 2024-04-19T03:01:55.849 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016028599999999999 2024-04-19T03:01:55.849 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.849 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.849 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:01:55.849 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.011787+0000", 2024-04-19T03:01:55.849 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001685513 2024-04-19T03:01:55.850 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.850 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.850 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:55.850 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.019889+0000", 2024-04-19T03:01:55.850 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0081026559999999997 2024-04-19T03:01:55.850 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.850 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.850 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:01:55.850 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.019932+0000", 2024-04-19T03:01:55.850 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2385000000000002e-05 2024-04-19T03:01:55.850 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.850 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.850 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:01:55.850 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.019978+0000", 2024-04-19T03:01:55.851 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6093000000000001e-05 2024-04-19T03:01:55.851 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:55.851 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:01:55.851 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:55.851 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.851 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.851 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:18 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:01:55.851 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:14.999834+0000", 2024-04-19T03:01:55.851 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 40.805580675000002, 2024-04-19T03:01:55.851 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.019567312999999999, 2024-04-19T03:01:55.851 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:01:55.851 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:55.851 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:01:55.851 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.851 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:01:55.852 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999834+0000", 2024-04-19T03:01:55.852 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:55.852 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.852 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.852 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:01:55.852 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999834+0000", 2024-04-19T03:01:55.852 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:55.852 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.852 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.852 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:01:55.852 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999833+0000", 2024-04-19T03:01:55.852 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:01:55.852 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.852 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.853 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:01:55.853 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999842+0000", 2024-04-19T03:01:55.853 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.2269999999999999e-06 2024-04-19T03:01:55.853 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.853 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.853 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:01:55.853 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999860+0000", 2024-04-19T03:01:55.853 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8456000000000001e-05 2024-04-19T03:01:55.853 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.853 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.853 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:01:55.853 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999874+0000", 2024-04-19T03:01:55.853 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3263e-05 2024-04-19T03:01:55.853 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.853 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.854 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:55.854 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999934+0000", 2024-04-19T03:01:55.854 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0888999999999999e-05 2024-04-19T03:01:55.854 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.854 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.854 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:01:55.854 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999940+0000", 2024-04-19T03:01:55.854 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4330000000000003e-06 2024-04-19T03:01:55.854 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.854 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.854 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:55.854 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.010943+0000", 2024-04-19T03:01:55.854 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011002786000000001 2024-04-19T03:01:55.855 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.855 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.855 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:01:55.855 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.011078+0000", 2024-04-19T03:01:55.855 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013541000000000001 2024-04-19T03:01:55.855 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.855 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.855 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-04-19T03:01:55.855 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.011172+0000", 2024-04-19T03:01:55.855 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.3459000000000001e-05 2024-04-19T03:01:55.855 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.855 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.855 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:01:55.855 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.013211+0000", 2024-04-19T03:01:55.856 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0020397710000000001 2024-04-19T03:01:55.856 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.856 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.856 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:55.856 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.019320+0000", 2024-04-19T03:01:55.856 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0061089969999999997 2024-04-19T03:01:55.856 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.856 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.856 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:01:55.856 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.019364+0000", 2024-04-19T03:01:55.856 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4158e-05 2024-04-19T03:01:55.856 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.856 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.856 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:01:55.857 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.019402+0000", 2024-04-19T03:01:55.857 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7011000000000002e-05 2024-04-19T03:01:55.857 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:55.857 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:01:55.857 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:55.857 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.857 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.857 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:21 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:01:55.857 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:14.999896+0000", 2024-04-19T03:01:55.857 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 40.805518855999999, 2024-04-19T03:01:55.857 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.018618866000000001, 2024-04-19T03:01:55.857 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:01:55.857 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-19T03:01:55.857 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:01:55.858 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.858 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:01:55.858 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999896+0000", 2024-04-19T03:01:55.858 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:55.858 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.858 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.858 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:01:55.858 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999896+0000", 2024-04-19T03:01:55.858 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:55.858 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.858 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.858 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:01:55.858 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999895+0000", 2024-04-19T03:01:55.859 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:01:55.859 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.859 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.859 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:01:55.859 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999901+0000", 2024-04-19T03:01:55.859 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4529999999999999e-06 2024-04-19T03:01:55.859 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.859 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.859 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:01:55.859 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999918+0000", 2024-04-19T03:01:55.859 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6897000000000001e-05 2024-04-19T03:01:55.859 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.859 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.859 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:01:55.860 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999931+0000", 2024-04-19T03:01:55.860 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.309e-05 2024-04-19T03:01:55.860 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.860 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.860 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:55.860 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.000027+0000", 2024-04-19T03:01:55.860 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.5880999999999999e-05 2024-04-19T03:01:55.860 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.860 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.860 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op must wait for map", 2024-04-19T03:01:55.860 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.000040+0000", 2024-04-19T03:01:55.860 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3083e-05 2024-04-19T03:01:55.860 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.861 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.861 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:55.861 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.004961+0000", 2024-04-19T03:01:55.861 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0049206079999999999 2024-04-19T03:01:55.861 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.861 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.861 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:01:55.861 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.005261+0000", 2024-04-19T03:01:55.861 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00030041699999999998 2024-04-19T03:01:55.861 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.861 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.861 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:01:55.861 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.018515+0000", 2024-04-19T03:01:55.862 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013253534000000001 2024-04-19T03:01:55.862 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:55.862 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:01:55.862 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:55.862 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.862 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.862 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:24 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:01:55.862 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:14.999964+0000", 2024-04-19T03:01:55.862 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 40.805451361000003, 2024-04-19T03:01:55.862 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020451446000000002, 2024-04-19T03:01:55.862 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:01:55.862 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-19T03:01:55.862 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:01:55.863 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.863 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:01:55.863 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999964+0000", 2024-04-19T03:01:55.863 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:55.863 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.863 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.863 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:01:55.863 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999964+0000", 2024-04-19T03:01:55.863 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:55.863 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.863 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.863 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:01:55.863 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999963+0000", 2024-04-19T03:01:55.864 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:01:55.864 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.864 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.864 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:01:55.864 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999969+0000", 2024-04-19T03:01:55.864 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0270000000000001e-06 2024-04-19T03:01:55.864 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.864 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.864 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:01:55.864 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999984+0000", 2024-04-19T03:01:55.864 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5903e-05 2024-04-19T03:01:55.864 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.864 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.864 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:01:55.865 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999998+0000", 2024-04-19T03:01:55.865 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3076e-05 2024-04-19T03:01:55.865 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.865 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.865 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:55.865 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.000078+0000", 2024-04-19T03:01:55.865 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0525000000000006e-05 2024-04-19T03:01:55.865 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.865 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.865 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op must wait for map", 2024-04-19T03:01:55.865 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.000084+0000", 2024-04-19T03:01:55.865 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8370000000000002e-06 2024-04-19T03:01:55.866 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.866 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.866 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:55.866 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.008819+0000", 2024-04-19T03:01:55.866 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0087349019999999993 2024-04-19T03:01:55.866 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.866 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.866 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:01:55.866 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.009018+0000", 2024-04-19T03:01:55.866 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000198989 2024-04-19T03:01:55.866 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.866 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.867 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:01:55.867 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.020415+0000", 2024-04-19T03:01:55.867 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011397157 2024-04-19T03:01:55.867 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:55.867 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:01:55.867 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:55.867 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.867 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.867 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:11274 5.e 5:7c846032:::benchmark_data_smithi096_19531_object11273:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T03:01:55.867 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:42.061776+0000", 2024-04-19T03:01:55.867 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 13.743639116000001, 2024-04-19T03:01:55.867 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.035381001000000002, 2024-04-19T03:01:55.867 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:01:55.867 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:55.868 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:01:55.868 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:01:55.868 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:55.868 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 11274 2024-04-19T03:01:55.868 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.868 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:01:55.868 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.868 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:01:55.868 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.061776+0000", 2024-04-19T03:01:55.868 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:55.868 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.868 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.868 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:01:55.868 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.061776+0000", 2024-04-19T03:01:55.869 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:55.869 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.869 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.869 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:01:55.869 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.061775+0000", 2024-04-19T03:01:55.869 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:01:55.869 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.869 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.869 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:01:55.869 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.061807+0000", 2024-04-19T03:01:55.869 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1733000000000003e-05 2024-04-19T03:01:55.869 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.870 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.870 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:01:55.870 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.061822+0000", 2024-04-19T03:01:55.870 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5452999999999999e-05 2024-04-19T03:01:55.870 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.870 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.870 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:01:55.870 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.061827+0000", 2024-04-19T03:01:55.870 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9810000000000003e-06 2024-04-19T03:01:55.870 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.870 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.870 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:55.870 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.063388+0000", 2024-04-19T03:01:55.871 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0015605720000000001 2024-04-19T03:01:55.871 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.871 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.871 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:01:55.871 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.063612+0000", 2024-04-19T03:01:55.871 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00022431 2024-04-19T03:01:55.871 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.871 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.871 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:01:55.871 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.063747+0000", 2024-04-19T03:01:55.871 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013459600000000001 2024-04-19T03:01:55.871 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.871 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.872 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:01:55.872 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.066186+0000", 2024-04-19T03:01:55.872 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0024388909999999999 2024-04-19T03:01:55.872 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.872 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.872 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:55.872 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.097016+0000", 2024-04-19T03:01:55.872 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.030830705 2024-04-19T03:01:55.872 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.872 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.872 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:01:55.872 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.097096+0000", 2024-04-19T03:01:55.873 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.9469999999999996e-05 2024-04-19T03:01:55.873 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.873 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.873 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:01:55.873 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.097157+0000", 2024-04-19T03:01:55.873 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0884999999999997e-05 2024-04-19T03:01:55.873 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:55.873 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:01:55.873 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:55.873 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.873 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.873 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:11279 5.8 5:10b60c58:::benchmark_data_smithi096_19531_object11278:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T03:01:55.873 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:42.062594+0000", 2024-04-19T03:01:55.873 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 13.742820677999999, 2024-04-19T03:01:55.874 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.028696788000000001, 2024-04-19T03:01:55.874 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:01:55.874 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:55.874 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:01:55.874 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:01:55.874 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:55.874 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 11279 2024-04-19T03:01:55.874 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.874 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:01:55.874 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.874 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:01:55.874 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.062594+0000", 2024-04-19T03:01:55.874 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:55.875 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.875 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.875 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:01:55.875 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.062594+0000", 2024-04-19T03:01:55.875 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:55.875 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.875 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.875 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:01:55.875 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.062593+0000", 2024-04-19T03:01:55.875 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:01:55.876 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.876 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.876 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:01:55.876 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.062646+0000", 2024-04-19T03:01:55.876 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2293999999999998e-05 2024-04-19T03:01:55.876 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.877 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.877 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:01:55.877 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.062657+0000", 2024-04-19T03:01:55.877 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1440000000000001e-05 2024-04-19T03:01:55.877 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.877 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.877 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:01:55.877 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.062665+0000", 2024-04-19T03:01:55.878 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5159999999999997e-06 2024-04-19T03:01:55.878 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.878 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.878 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:55.878 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.063799+0000", 2024-04-19T03:01:55.878 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0011344860000000001 2024-04-19T03:01:55.878 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.878 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.878 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:01:55.878 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.063962+0000", 2024-04-19T03:01:55.878 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000162614 2024-04-19T03:01:55.878 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.878 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.879 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:01:55.879 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.064167+0000", 2024-04-19T03:01:55.879 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00020491699999999999 2024-04-19T03:01:55.879 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.879 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.879 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:01:55.879 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.066768+0000", 2024-04-19T03:01:55.879 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0026012090000000002 2024-04-19T03:01:55.879 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.879 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.879 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:55.879 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.091184+0000", 2024-04-19T03:01:55.879 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.024416582999999999 2024-04-19T03:01:55.879 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.880 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.880 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:01:55.880 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.091251+0000", 2024-04-19T03:01:55.880 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6753000000000003e-05 2024-04-19T03:01:55.880 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.880 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.880 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:01:55.880 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.091291+0000", 2024-04-19T03:01:55.880 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9841e-05 2024-04-19T03:01:55.880 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:55.880 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:01:55.880 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:55.880 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.880 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.880 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:11282 5.e 5:75b7c510:::benchmark_data_smithi096_19531_object11281:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T03:01:55.881 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:42.062674+0000", 2024-04-19T03:01:55.881 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 13.742741221999999, 2024-04-19T03:01:55.881 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.034812849, 2024-04-19T03:01:55.881 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:01:55.881 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:55.881 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:01:55.881 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:01:55.881 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:55.881 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 11282 2024-04-19T03:01:55.881 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.881 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:01:55.881 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.881 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:01:55.881 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.062674+0000", 2024-04-19T03:01:55.882 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:55.882 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.882 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.882 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:01:55.882 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.062674+0000", 2024-04-19T03:01:55.882 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:55.882 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.882 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.882 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:01:55.882 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.062673+0000", 2024-04-19T03:01:55.882 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:01:55.882 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.882 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.882 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:01:55.883 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.062712+0000", 2024-04-19T03:01:55.883 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9341999999999997e-05 2024-04-19T03:01:55.883 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.883 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.883 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:01:55.883 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.062721+0000", 2024-04-19T03:01:55.883 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1700000000000003e-06 2024-04-19T03:01:55.883 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.883 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.883 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:01:55.883 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.062729+0000", 2024-04-19T03:01:55.883 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4240000000000004e-06 2024-04-19T03:01:55.883 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.883 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.883 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:55.884 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.065017+0000", 2024-04-19T03:01:55.884 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0022878590000000002 2024-04-19T03:01:55.884 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.884 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.884 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:01:55.884 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.065207+0000", 2024-04-19T03:01:55.884 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000190411 2024-04-19T03:01:55.884 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.884 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.884 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:01:55.884 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.065323+0000", 2024-04-19T03:01:55.884 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000115593 2024-04-19T03:01:55.884 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.884 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.885 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:01:55.885 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.069683+0000", 2024-04-19T03:01:55.885 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0043604409999999996 2024-04-19T03:01:55.885 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.885 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.885 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:55.885 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.097273+0000", 2024-04-19T03:01:55.885 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.027589516000000001 2024-04-19T03:01:55.885 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.885 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.885 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:01:55.885 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.097406+0000", 2024-04-19T03:01:55.885 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000133514 2024-04-19T03:01:55.886 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.886 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.886 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:01:55.886 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.097486+0000", 2024-04-19T03:01:55.886 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0479e-05 2024-04-19T03:01:55.886 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:55.886 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:01:55.886 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:55.886 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.886 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.886 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:11288 5.0 5:042458d0:::benchmark_data_smithi096_19531_object11287:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T03:01:55.886 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:42.070352+0000", 2024-04-19T03:01:55.887 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 13.735063294, 2024-04-19T03:01:55.887 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.021532447, 2024-04-19T03:01:55.887 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:01:55.887 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:55.887 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:01:55.887 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:01:55.887 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:55.887 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 11288 2024-04-19T03:01:55.887 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.887 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:01:55.887 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.887 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:01:55.887 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.070352+0000", 2024-04-19T03:01:55.887 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:55.888 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.888 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.888 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:01:55.888 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.070352+0000", 2024-04-19T03:01:55.888 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:55.888 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.888 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.888 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:01:55.888 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.070351+0000", 2024-04-19T03:01:55.888 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:01:55.888 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.888 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.888 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:01:55.889 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.070392+0000", 2024-04-19T03:01:55.889 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1077e-05 2024-04-19T03:01:55.889 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.889 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.889 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:01:55.889 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.070398+0000", 2024-04-19T03:01:55.889 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1109999999999996e-06 2024-04-19T03:01:55.889 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.889 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.889 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:01:55.889 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.070402+0000", 2024-04-19T03:01:55.889 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2010000000000001e-06 2024-04-19T03:01:55.889 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.889 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.889 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:55.890 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.070445+0000", 2024-04-19T03:01:55.890 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2585e-05 2024-04-19T03:01:55.890 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.890 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.890 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:01:55.890 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.070572+0000", 2024-04-19T03:01:55.890 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012708500000000001 2024-04-19T03:01:55.890 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.890 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.890 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:01:55.890 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.070711+0000", 2024-04-19T03:01:55.890 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013848699999999999 2024-04-19T03:01:55.890 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.891 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.891 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:01:55.891 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.073505+0000", 2024-04-19T03:01:55.891 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0027944620000000002 2024-04-19T03:01:55.891 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.891 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.891 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:55.891 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.091806+0000", 2024-04-19T03:01:55.891 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.018301251000000001 2024-04-19T03:01:55.891 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.891 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.891 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:01:55.892 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.091854+0000", 2024-04-19T03:01:55.892 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7419000000000001e-05 2024-04-19T03:01:55.892 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.892 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.892 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:01:55.892 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.091884+0000", 2024-04-19T03:01:55.892 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0241999999999999e-05 2024-04-19T03:01:55.892 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:55.892 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:01:55.892 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:55.892 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.892 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.892 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:11292 5.0 5:009b2ea9:::benchmark_data_smithi096_19531_object11291:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T03:01:55.892 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:42.070676+0000", 2024-04-19T03:01:55.892 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 13.734738919, 2024-04-19T03:01:55.893 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.02219631, 2024-04-19T03:01:55.893 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:01:55.893 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:55.893 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:01:55.893 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:01:55.893 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:55.893 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 11292 2024-04-19T03:01:55.893 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.893 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:01:55.893 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.893 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:01:55.893 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.070676+0000", 2024-04-19T03:01:55.894 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:55.894 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.894 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.894 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:01:55.894 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.070676+0000", 2024-04-19T03:01:55.894 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:55.894 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.894 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.894 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:01:55.894 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.070675+0000", 2024-04-19T03:01:55.894 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:01:55.894 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.894 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.894 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:01:55.895 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.070800+0000", 2024-04-19T03:01:55.895 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000125263 2024-04-19T03:01:55.895 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.895 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.895 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:01:55.895 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.070808+0000", 2024-04-19T03:01:55.895 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0209999999999999e-06 2024-04-19T03:01:55.895 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.895 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.895 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:01:55.895 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.070814+0000", 2024-04-19T03:01:55.895 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0969999999999996e-06 2024-04-19T03:01:55.895 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.896 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.896 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:55.896 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.071956+0000", 2024-04-19T03:01:55.896 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0011427480000000001 2024-04-19T03:01:55.896 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.896 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.896 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:01:55.896 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.072153+0000", 2024-04-19T03:01:55.896 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000196524 2024-04-19T03:01:55.896 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.896 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.896 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:01:55.896 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.072312+0000", 2024-04-19T03:01:55.897 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015879300000000001 2024-04-19T03:01:55.897 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.897 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.897 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:01:55.897 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.078407+0000", 2024-04-19T03:01:55.897 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0060954929999999996 2024-04-19T03:01:55.897 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.897 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.897 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:55.897 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.092742+0000", 2024-04-19T03:01:55.897 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.014335349000000001 2024-04-19T03:01:55.897 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.897 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.897 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:01:55.897 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.092815+0000", 2024-04-19T03:01:55.898 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2881999999999998e-05 2024-04-19T03:01:55.898 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.898 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.898 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:01:55.898 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.092872+0000", 2024-04-19T03:01:55.898 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6965000000000001e-05 2024-04-19T03:01:55.898 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:55.898 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:01:55.898 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:55.898 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.898 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.898 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:11297 5.e 5:7975ecb6:::benchmark_data_smithi096_19531_object11296:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T03:01:55.899 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:42.076848+0000", 2024-04-19T03:01:55.899 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 13.728567039, 2024-04-19T03:01:55.899 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020867969, 2024-04-19T03:01:55.899 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:01:55.899 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:55.899 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:01:55.899 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:01:55.899 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:55.899 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 11297 2024-04-19T03:01:55.899 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.899 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:01:55.899 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.899 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:01:55.899 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.076848+0000", 2024-04-19T03:01:55.900 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:55.900 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.900 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.900 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:01:55.900 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.076848+0000", 2024-04-19T03:01:55.900 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:55.900 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.900 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.900 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:01:55.900 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.076846+0000", 2024-04-19T03:01:55.900 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:01:55.900 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.900 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.900 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:01:55.901 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.076894+0000", 2024-04-19T03:01:55.901 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7645000000000002e-05 2024-04-19T03:01:55.901 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.901 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.901 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:01:55.901 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.076913+0000", 2024-04-19T03:01:55.901 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8885e-05 2024-04-19T03:01:55.901 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.901 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.901 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:01:55.901 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.076924+0000", 2024-04-19T03:01:55.901 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.118e-05 2024-04-19T03:01:55.902 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.902 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.902 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:55.902 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.076983+0000", 2024-04-19T03:01:55.902 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8952000000000001e-05 2024-04-19T03:01:55.902 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.902 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.902 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:01:55.902 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.077156+0000", 2024-04-19T03:01:55.902 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00017307600000000001 2024-04-19T03:01:55.902 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.902 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.902 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:01:55.902 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.077358+0000", 2024-04-19T03:01:55.903 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000201991 2024-04-19T03:01:55.903 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.903 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.903 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:01:55.903 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.080885+0000", 2024-04-19T03:01:55.903 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0035268309999999998 2024-04-19T03:01:55.903 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.903 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.903 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:55.903 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.097569+0000", 2024-04-19T03:01:55.903 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.016683854000000001 2024-04-19T03:01:55.903 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.903 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.904 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:01:55.904 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.097647+0000", 2024-04-19T03:01:55.904 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.7823000000000004e-05 2024-04-19T03:01:55.904 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.904 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.904 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:01:55.904 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.097716+0000", 2024-04-19T03:01:55.904 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.9079999999999996e-05 2024-04-19T03:01:55.904 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:55.904 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:01:55.904 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:55.904 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.905 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.905 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:11298 5.e 5:72565f0a:::benchmark_data_smithi096_19531_object11297:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T03:01:55.905 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:42.076954+0000", 2024-04-19T03:01:55.905 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 13.728461165000001, 2024-04-19T03:01:55.905 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020950191999999999, 2024-04-19T03:01:55.905 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:01:55.905 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:55.905 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:01:55.905 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:01:55.905 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:55.905 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 11298 2024-04-19T03:01:55.905 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.905 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:01:55.906 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.906 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:01:55.906 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.076954+0000", 2024-04-19T03:01:55.906 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:55.906 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.906 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.906 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:01:55.906 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.076954+0000", 2024-04-19T03:01:55.906 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:55.906 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.906 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.907 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:01:55.907 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.076953+0000", 2024-04-19T03:01:55.907 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:01:55.907 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.907 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.907 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:01:55.907 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.076997+0000", 2024-04-19T03:01:55.907 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4023000000000002e-05 2024-04-19T03:01:55.908 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.908 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.908 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:01:55.908 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.077009+0000", 2024-04-19T03:01:55.908 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2456000000000001e-05 2024-04-19T03:01:55.908 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.908 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.908 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:01:55.908 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.077015+0000", 2024-04-19T03:01:55.908 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7950000000000004e-06 2024-04-19T03:01:55.908 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.909 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.909 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:55.909 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.078552+0000", 2024-04-19T03:01:55.909 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0015371320000000001 2024-04-19T03:01:55.909 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.909 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.909 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:01:55.909 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.078760+0000", 2024-04-19T03:01:55.909 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00020808799999999999 2024-04-19T03:01:55.909 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.909 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.909 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:01:55.909 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.078875+0000", 2024-04-19T03:01:55.910 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011457500000000001 2024-04-19T03:01:55.910 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.910 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.910 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:01:55.910 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.083603+0000", 2024-04-19T03:01:55.910 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0047276239999999997 2024-04-19T03:01:55.910 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.910 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.910 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:55.910 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.097783+0000", 2024-04-19T03:01:55.910 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.014180036 2024-04-19T03:01:55.911 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.911 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.911 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:01:55.911 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.097863+0000", 2024-04-19T03:01:55.911 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0317999999999999e-05 2024-04-19T03:01:55.911 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.911 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.911 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:01:55.911 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.097904+0000", 2024-04-19T03:01:55.911 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1035000000000003e-05 2024-04-19T03:01:55.911 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:55.912 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:01:55.912 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:55.912 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.912 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.912 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:34755 5.8 5:1953eeae:::benchmark_data_smithi096_19531_object34754:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-19T03:01:55.912 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:52.223155+0000", 2024-04-19T03:01:55.912 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 3.5822602859999999, 2024-04-19T03:01:55.912 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.017663038999999998, 2024-04-19T03:01:55.912 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:01:55.912 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:55.912 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:01:55.912 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:01:55.912 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:55.912 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 34755 2024-04-19T03:01:55.913 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.913 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:01:55.913 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.913 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:01:55.913 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:52.223155+0000", 2024-04-19T03:01:55.913 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:55.913 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.913 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.913 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:01:55.913 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:52.223155+0000", 2024-04-19T03:01:55.913 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:55.913 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.914 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.914 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:01:55.914 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:52.223154+0000", 2024-04-19T03:01:55.914 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:01:55.914 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.914 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.914 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:01:55.914 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:52.223275+0000", 2024-04-19T03:01:55.914 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000121241 2024-04-19T03:01:55.915 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.915 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.915 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:01:55.915 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:52.223285+0000", 2024-04-19T03:01:55.915 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0407999999999999e-05 2024-04-19T03:01:55.915 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.915 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.915 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:01:55.915 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:52.223293+0000", 2024-04-19T03:01:55.915 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0940000000000008e-06 2024-04-19T03:01:55.915 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.916 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.916 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:55.916 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:52.233001+0000", 2024-04-19T03:01:55.916 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0097077980000000001 2024-04-19T03:01:55.916 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.916 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.916 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:01:55.916 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:52.233197+0000", 2024-04-19T03:01:55.916 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000196329 2024-04-19T03:01:55.916 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.916 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.916 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:01:55.916 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:52.233375+0000", 2024-04-19T03:01:55.916 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00017711800000000001 2024-04-19T03:01:55.917 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.917 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.917 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:55.917 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:52.239338+0000", 2024-04-19T03:01:55.917 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0059637149999999996 2024-04-19T03:01:55.917 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.917 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.917 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:01:55.917 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:52.240752+0000", 2024-04-19T03:01:55.917 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0014136179999999999 2024-04-19T03:01:55.917 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.917 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.917 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:01:55.917 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:52.240794+0000", 2024-04-19T03:01:55.918 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1906000000000002e-05 2024-04-19T03:01:55.918 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.918 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.918 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:01:55.918 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:52.240818+0000", 2024-04-19T03:01:55.918 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3821000000000001e-05 2024-04-19T03:01:55.918 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:55.918 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:01:55.918 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:55.918 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.918 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.918 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:41635 5.0 5:099f52c6:::benchmark_data_smithi096_19531_object41634:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-19T03:01:55.918 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:55.638486+0000", 2024-04-19T03:01:55.919 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.16692890299999999, 2024-04-19T03:01:55.919 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.018229273000000001, 2024-04-19T03:01:55.919 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:01:55.919 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:55.919 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:01:55.919 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:01:55.919 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:55.919 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 41635 2024-04-19T03:01:55.919 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.919 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:01:55.919 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.919 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:01:55.919 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:55.638486+0000", 2024-04-19T03:01:55.920 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:55.920 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.920 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.920 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:01:55.920 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:55.638486+0000", 2024-04-19T03:01:55.920 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:55.920 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.920 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.920 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:01:55.920 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:55.638484+0000", 2024-04-19T03:01:55.921 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999981 2024-04-19T03:01:55.921 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.921 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.921 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:01:55.921 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:55.638563+0000", 2024-04-19T03:01:55.921 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.9453e-05 2024-04-19T03:01:55.921 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.921 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.921 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:01:55.921 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:55.638578+0000", 2024-04-19T03:01:55.921 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4917e-05 2024-04-19T03:01:55.921 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.921 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.921 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:01:55.921 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:55.638587+0000", 2024-04-19T03:01:55.922 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.7479999999999999e-06 2024-04-19T03:01:55.922 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.922 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.922 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:55.922 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:55.647558+0000", 2024-04-19T03:01:55.922 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0089711489999999994 2024-04-19T03:01:55.922 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.922 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.922 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:01:55.922 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:55.647666+0000", 2024-04-19T03:01:55.922 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000107606 2024-04-19T03:01:55.922 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.922 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.923 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:01:55.923 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:55.647745+0000", 2024-04-19T03:01:55.923 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.9229999999999999e-05 2024-04-19T03:01:55.923 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.923 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.923 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:55.923 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:55.652616+0000", 2024-04-19T03:01:55.923 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0048707739999999996 2024-04-19T03:01:55.923 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.923 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.923 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:01:55.923 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:55.656654+0000", 2024-04-19T03:01:55.924 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0040386140000000003 2024-04-19T03:01:55.924 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.924 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.924 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:01:55.924 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:55.656692+0000", 2024-04-19T03:01:55.924 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7317000000000002e-05 2024-04-19T03:01:55.924 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.924 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.924 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:01:55.924 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:55.656715+0000", 2024-04-19T03:01:55.924 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3533e-05 2024-04-19T03:01:55.924 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:55.924 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:01:55.924 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:55.924 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.925 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.925 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:41640 5.0 5:0989f358:::benchmark_data_smithi096_19531_object41639:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-19T03:01:55.925 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:55.640790+0000", 2024-04-19T03:01:55.925 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.164624721, 2024-04-19T03:01:55.925 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020000754999999999, 2024-04-19T03:01:55.925 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:01:55.925 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:55.925 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:01:55.925 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:01:55.925 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:55.925 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 41640 2024-04-19T03:01:55.925 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.925 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:01:55.925 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.926 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:01:55.926 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:55.640790+0000", 2024-04-19T03:01:55.926 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:55.926 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.926 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.926 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:01:55.926 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:55.640790+0000", 2024-04-19T03:01:55.926 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:55.926 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.926 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.926 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:01:55.926 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:55.640789+0000", 2024-04-19T03:01:55.926 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:01:55.926 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.927 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.927 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:01:55.927 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:55.640829+0000", 2024-04-19T03:01:55.927 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9870999999999998e-05 2024-04-19T03:01:55.927 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.927 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.927 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:01:55.927 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:55.640838+0000", 2024-04-19T03:01:55.927 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.8899999999999996e-06 2024-04-19T03:01:55.927 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.927 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.927 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:01:55.927 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:55.640843+0000", 2024-04-19T03:01:55.927 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1630000000000004e-06 2024-04-19T03:01:55.927 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.927 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.928 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:55.928 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:55.649279+0000", 2024-04-19T03:01:55.928 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0084358179999999994 2024-04-19T03:01:55.928 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.928 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.928 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:01:55.928 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:55.649388+0000", 2024-04-19T03:01:55.928 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010836399999999999 2024-04-19T03:01:55.928 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.928 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.928 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:01:55.928 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:55.649479+0000", 2024-04-19T03:01:55.928 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1284000000000002e-05 2024-04-19T03:01:55.928 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.928 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.929 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:01:55.929 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:55.656726+0000", 2024-04-19T03:01:55.929 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.007246962 2024-04-19T03:01:55.929 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.929 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.929 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:55.929 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:55.660689+0000", 2024-04-19T03:01:55.929 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0039628900000000002 2024-04-19T03:01:55.929 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.929 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.929 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:01:55.929 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:55.660755+0000", 2024-04-19T03:01:55.929 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6267999999999996e-05 2024-04-19T03:01:55.929 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.929 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.930 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:01:55.930 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:55.660791+0000", 2024-04-19T03:01:55.930 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5975e-05 2024-04-19T03:01:55.930 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:55.930 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:01:55.930 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:55.930 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.930 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.930 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:41743 5.d 5:b5695557:::benchmark_data_smithi096_19531_object41742:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-19T03:01:55.930 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:55.693206+0000", 2024-04-19T03:01:55.930 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.112208984, 2024-04-19T03:01:55.930 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.017738706, 2024-04-19T03:01:55.930 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:01:55.931 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:55.931 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:01:55.931 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:01:55.931 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:55.931 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 41743 2024-04-19T03:01:55.931 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.931 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:01:55.931 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.931 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:01:55.931 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:55.693206+0000", 2024-04-19T03:01:55.931 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:55.931 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.932 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.932 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:01:55.932 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:55.693206+0000", 2024-04-19T03:01:55.932 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:55.932 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.932 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.932 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:01:55.932 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:55.693205+0000", 2024-04-19T03:01:55.932 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:01:55.932 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.932 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.932 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:01:55.932 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:55.693278+0000", 2024-04-19T03:01:55.932 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2693000000000003e-05 2024-04-19T03:01:55.933 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.933 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.933 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:01:55.933 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:55.693286+0000", 2024-04-19T03:01:55.933 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.9310000000000008e-06 2024-04-19T03:01:55.933 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.933 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.933 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:01:55.933 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:55.693292+0000", 2024-04-19T03:01:55.933 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9510000000000003e-06 2024-04-19T03:01:55.933 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.933 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.933 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:55.933 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:55.699127+0000", 2024-04-19T03:01:55.933 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0058351519999999997 2024-04-19T03:01:55.934 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.934 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.934 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:01:55.934 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:55.699226+0000", 2024-04-19T03:01:55.934 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.8636999999999998e-05 2024-04-19T03:01:55.934 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.934 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.934 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-04-19T03:01:55.934 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:55.699300+0000", 2024-04-19T03:01:55.934 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4172999999999996e-05 2024-04-19T03:01:55.934 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.934 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.934 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:01:55.934 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:55.700946+0000", 2024-04-19T03:01:55.935 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001646441 2024-04-19T03:01:55.935 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.935 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.935 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:55.935 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:55.710881+0000", 2024-04-19T03:01:55.935 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0099342839999999998 2024-04-19T03:01:55.935 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.935 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.935 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:01:55.935 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:55.710912+0000", 2024-04-19T03:01:55.935 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0925e-05 2024-04-19T03:01:55.935 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:55.935 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:55.935 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:01:55.936 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:55.710945+0000", 2024-04-19T03:01:55.936 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3058000000000001e-05 2024-04-19T03:01:55.936 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:55.936 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:01:55.936 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:55.936 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:55.936 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:01:55.936 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-19T03:01:55.937 INFO:tasks.radosbench.radosbench.0.smithi096.stdout: 18 16 42007 41991 145.787 124.188 0.0127758 0.00685304 2024-04-19T03:01:55.938 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:01:55.933+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:01:55.938 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T03:01:56.038 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:01:56.036+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:01:56.067 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-04-19T03:01:56.067 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [ 2024-04-19T03:01:56.067 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.067 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:42474 5.2 5:460ee0ef:::benchmark_data_smithi096_19531_object42473:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-19T03:01:56.067 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:01:56.060422+0000", 2024-04-19T03:01:56.067 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.005478536, 2024-04-19T03:01:56.067 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0054981250000000004, 2024-04-19T03:01:56.068 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:01:56.068 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:01:56.068 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:01:56.068 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:01:56.068 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:56.068 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 42474 2024-04-19T03:01:56.068 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.068 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:01:56.068 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.068 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:01:56.068 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:56.060422+0000", 2024-04-19T03:01:56.068 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:56.068 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.069 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.069 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:01:56.069 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:56.060422+0000", 2024-04-19T03:01:56.069 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:56.069 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.069 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.069 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:01:56.069 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:56.060421+0000", 2024-04-19T03:01:56.069 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999986 2024-04-19T03:01:56.069 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.069 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.069 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:01:56.069 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:56.060474+0000", 2024-04-19T03:01:56.070 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2771e-05 2024-04-19T03:01:56.070 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.070 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.070 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:01:56.070 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:56.060490+0000", 2024-04-19T03:01:56.070 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6232e-05 2024-04-19T03:01:56.070 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.070 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.070 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:01:56.070 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:56.060501+0000", 2024-04-19T03:01:56.070 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1272e-05 2024-04-19T03:01:56.070 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.070 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.071 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:01:56.071 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:56.061908+0000", 2024-04-19T03:01:56.071 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001407127 2024-04-19T03:01:56.071 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.071 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.071 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:01:56.071 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:56.062014+0000", 2024-04-19T03:01:56.071 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000105843 2024-04-19T03:01:56.071 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.071 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.071 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-04-19T03:01:56.071 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:56.062139+0000", 2024-04-19T03:01:56.071 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00012489099999999999 2024-04-19T03:01:56.071 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.072 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.072 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:56.072 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:56.064461+0000", 2024-04-19T03:01:56.072 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0023222799999999999 2024-04-19T03:01:56.072 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:56.072 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:01:56.072 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:56.072 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.072 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.072 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:42476 5.9 5:99328f4d:::benchmark_data_smithi096_19531_object42475:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-19T03:01:56.072 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:01:56.060698+0000", 2024-04-19T03:01:56.072 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0052028990000000004, 2024-04-19T03:01:56.072 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0052785000000000002, 2024-04-19T03:01:56.072 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:01:56.073 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:01:56.073 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:01:56.073 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:01:56.073 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:56.073 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 42476 2024-04-19T03:01:56.073 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.073 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:01:56.073 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.073 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:01:56.073 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:56.060698+0000", 2024-04-19T03:01:56.073 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:56.073 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.074 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.074 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:01:56.074 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:56.060698+0000", 2024-04-19T03:01:56.074 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:56.074 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.074 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.074 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:01:56.074 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:56.060697+0000", 2024-04-19T03:01:56.074 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:01:56.074 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.075 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.075 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:01:56.075 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:56.060760+0000", 2024-04-19T03:01:56.075 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2952000000000003e-05 2024-04-19T03:01:56.075 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.075 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.075 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:01:56.075 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:56.060773+0000", 2024-04-19T03:01:56.075 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3444e-05 2024-04-19T03:01:56.075 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.075 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.075 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:01:56.077 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:56.060784+0000", 2024-04-19T03:01:56.077 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0271e-05 2024-04-19T03:01:56.077 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.077 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.077 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:01:56.077 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:56.061211+0000", 2024-04-19T03:01:56.077 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00042739600000000003 2024-04-19T03:01:56.078 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.078 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.078 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:01:56.078 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:56.061355+0000", 2024-04-19T03:01:56.078 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000143764 2024-04-19T03:01:56.078 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.078 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.078 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:01:56.078 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:56.061444+0000", 2024-04-19T03:01:56.078 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.878e-05 2024-04-19T03:01:56.078 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.078 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.078 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:01:56.078 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:56.065787+0000", 2024-04-19T03:01:56.079 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0043436289999999999 2024-04-19T03:01:56.079 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:56.079 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:01:56.079 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:56.079 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.079 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.079 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4755.0:42473 5.c e30/22 5:337b60d4:::benchmark_data_smithi096_19531_object42472:head v 30'2729, mlcod=30'2725)", 2024-04-19T03:01:56.079 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:01:56.060856+0000", 2024-04-19T03:01:56.079 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0050447809999999999, 2024-04-19T03:01:56.079 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0051670010000000001, 2024-04-19T03:01:56.079 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:01:56.079 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-04-19T03:01:56.079 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:01:56.079 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.080 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:01:56.080 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:56.060856+0000", 2024-04-19T03:01:56.080 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:56.080 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.080 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.080 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:01:56.080 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:56.060856+0000", 2024-04-19T03:01:56.080 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:56.080 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.080 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.080 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:01:56.080 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:56.060855+0000", 2024-04-19T03:01:56.080 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:01:56.081 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.081 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.081 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:01:56.081 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:56.060908+0000", 2024-04-19T03:01:56.081 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2309999999999999e-05 2024-04-19T03:01:56.081 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.081 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.081 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:01:56.081 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:56.060918+0000", 2024-04-19T03:01:56.081 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0278999999999999e-05 2024-04-19T03:01:56.081 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.081 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.081 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:01:56.081 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:56.060927+0000", 2024-04-19T03:01:56.082 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.2920000000000001e-06 2024-04-19T03:01:56.082 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.082 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.082 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:01:56.082 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:56.061370+0000", 2024-04-19T03:01:56.082 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000443366 2024-04-19T03:01:56.082 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.082 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.082 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:01:56.082 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:56.061399+0000", 2024-04-19T03:01:56.082 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.8966999999999999e-05 2024-04-19T03:01:56.082 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:56.082 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:01:56.082 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:56.083 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.083 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.083 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:42479 5.9 5:95b4821b:::benchmark_data_smithi096_19531_object42478:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-19T03:01:56.083 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:01:56.062897+0000", 2024-04-19T03:01:56.083 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0030037979999999998, 2024-04-19T03:01:56.083 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0031768199999999999, 2024-04-19T03:01:56.083 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:01:56.083 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:01:56.083 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:01:56.083 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:01:56.083 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:56.083 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 42479 2024-04-19T03:01:56.083 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.083 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:01:56.084 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.084 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:01:56.084 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:56.062897+0000", 2024-04-19T03:01:56.084 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:56.084 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.084 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.084 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:01:56.084 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:56.062897+0000", 2024-04-19T03:01:56.084 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:56.084 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.084 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.084 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:01:56.084 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:56.062896+0000", 2024-04-19T03:01:56.084 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:01:56.085 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.085 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.085 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:01:56.085 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:56.062953+0000", 2024-04-19T03:01:56.085 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7051e-05 2024-04-19T03:01:56.085 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.085 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.085 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:01:56.085 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:56.062972+0000", 2024-04-19T03:01:56.085 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9403999999999999e-05 2024-04-19T03:01:56.085 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.085 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.085 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:01:56.086 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:56.062981+0000", 2024-04-19T03:01:56.086 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.5890000000000003e-06 2024-04-19T03:01:56.086 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.086 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.086 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:01:56.086 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:56.063151+0000", 2024-04-19T03:01:56.086 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00017065299999999999 2024-04-19T03:01:56.086 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.086 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.086 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:01:56.086 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:56.063235+0000", 2024-04-19T03:01:56.086 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.3379000000000002e-05 2024-04-19T03:01:56.086 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.087 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.087 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:01:56.087 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:56.063310+0000", 2024-04-19T03:01:56.087 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5454e-05 2024-04-19T03:01:56.087 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:56.087 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:01:56.087 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:56.087 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.087 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.087 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:42483 5.9 5:95e517d8:::benchmark_data_smithi096_19531_object42482:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-19T03:01:56.087 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:01:56.064460+0000", 2024-04-19T03:01:56.087 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.001441215, 2024-04-19T03:01:56.087 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0016584289999999999, 2024-04-19T03:01:56.087 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:01:56.088 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:01:56.088 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:01:56.088 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:01:56.088 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:56.088 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 42483 2024-04-19T03:01:56.088 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.088 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:01:56.088 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.088 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:01:56.088 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:56.064460+0000", 2024-04-19T03:01:56.088 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:56.088 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.088 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.088 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:01:56.088 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:56.064460+0000", 2024-04-19T03:01:56.089 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:56.089 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.089 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.089 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:01:56.089 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:56.064458+0000", 2024-04-19T03:01:56.089 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:01:56.089 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.089 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.089 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:01:56.089 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:56.064502+0000", 2024-04-19T03:01:56.089 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3602e-05 2024-04-19T03:01:56.089 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.089 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.089 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:01:56.090 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:56.064519+0000", 2024-04-19T03:01:56.090 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7379000000000001e-05 2024-04-19T03:01:56.090 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.090 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.090 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:01:56.090 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:56.064525+0000", 2024-04-19T03:01:56.090 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7610000000000004e-06 2024-04-19T03:01:56.090 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.090 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.090 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:01:56.090 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:56.064623+0000", 2024-04-19T03:01:56.090 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.7738000000000005e-05 2024-04-19T03:01:56.090 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.091 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.091 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:01:56.091 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:56.064703+0000", 2024-04-19T03:01:56.091 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9672999999999994e-05 2024-04-19T03:01:56.091 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.091 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.091 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:01:56.091 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:56.064779+0000", 2024-04-19T03:01:56.091 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6482000000000004e-05 2024-04-19T03:01:56.091 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:56.091 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:01:56.091 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:56.091 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:56.091 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-04-19T03:01:56.092 INFO:teuthology.orchestra.run.smithi144.stdout: "num_ops": 5 2024-04-19T03:01:56.092 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-04-19T03:01:56.092 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-19T03:01:56.093 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T03:01:56.139 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:01:56.136+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:01:56.221 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-04-19T03:01:56.221 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2024-04-19T03:01:56.222 INFO:teuthology.orchestra.run.smithi144.stdout: "complaint_time": 30, 2024-04-19T03:01:56.222 INFO:teuthology.orchestra.run.smithi144.stdout: "num_blocked_ops": 0 2024-04-19T03:01:56.222 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-04-19T03:01:56.234 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T03:01:56.240 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-04-19T03:01:56.237+0000 7f35986ab700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18243) UID: 0 2024-04-19T03:01:56.291 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-04-19T03:01:56.292 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-19T03:01:56.292 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap 2024-04-19T03:01:56.292 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-04-19T03:01:56.342 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:01:56.340+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:01:56.355 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-04-19T03:01:56.356 INFO:teuthology.orchestra.run.smithi144.stdout: "size": 20, 2024-04-19T03:01:56.356 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 600, 2024-04-19T03:01:56.356 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [ 2024-04-19T03:01:56.356 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.356 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4159.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-19T03:01:56.356 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:01:07.935397+0000", 2024-04-19T03:01:56.356 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 48.416762912999999, 2024-04-19T03:01:56.356 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.020241816999999999, 2024-04-19T03:01:56.356 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:01:56.356 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:56.356 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:01:56.356 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4159", 2024-04-19T03:01:56.357 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3589238956", 2024-04-19T03:01:56.357 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 116 2024-04-19T03:01:56.357 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.357 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:01:56.357 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.357 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:01:56.357 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:07.935397+0000", 2024-04-19T03:01:56.357 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:56.357 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.357 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.357 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:01:56.357 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:07.935397+0000", 2024-04-19T03:01:56.357 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:56.358 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.358 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.358 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:01:56.358 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:07.935396+0000", 2024-04-19T03:01:56.358 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999986 2024-04-19T03:01:56.358 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.358 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.358 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:01:56.358 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:07.935407+0000", 2024-04-19T03:01:56.358 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0842999999999999e-05 2024-04-19T03:01:56.358 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.358 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.358 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:01:56.358 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:07.935424+0000", 2024-04-19T03:01:56.359 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7193e-05 2024-04-19T03:01:56.359 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.359 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.359 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:01:56.359 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:07.935440+0000", 2024-04-19T03:01:56.359 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.626e-05 2024-04-19T03:01:56.359 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.359 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.359 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:01:56.359 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:07.950487+0000", 2024-04-19T03:01:56.359 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.015046992 2024-04-19T03:01:56.359 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.359 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.360 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:01:56.360 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:07.950602+0000", 2024-04-19T03:01:56.360 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000115048 2024-04-19T03:01:56.360 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.360 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.360 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:01:56.360 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:07.950693+0000", 2024-04-19T03:01:56.360 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.1364000000000001e-05 2024-04-19T03:01:56.360 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.360 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.360 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:01:56.360 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:07.951956+0000", 2024-04-19T03:01:56.360 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001262832 2024-04-19T03:01:56.360 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.361 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.361 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:56.361 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:07.955473+0000", 2024-04-19T03:01:56.361 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0035168209999999998 2024-04-19T03:01:56.361 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.361 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.361 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:01:56.361 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:07.955570+0000", 2024-04-19T03:01:56.361 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.7175000000000004e-05 2024-04-19T03:01:56.361 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.361 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.361 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:01:56.361 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:07.955639+0000", 2024-04-19T03:01:56.362 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8699000000000001e-05 2024-04-19T03:01:56.362 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:56.362 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:01:56.362 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:56.362 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.362 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.362 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4159.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-19T03:01:56.362 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:01:07.935454+0000", 2024-04-19T03:01:56.362 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 48.416706230999999, 2024-04-19T03:01:56.362 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.020337788999999998, 2024-04-19T03:01:56.362 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:01:56.362 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:56.362 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:01:56.363 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4159", 2024-04-19T03:01:56.363 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3589238956", 2024-04-19T03:01:56.363 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 117 2024-04-19T03:01:56.363 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.363 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:01:56.363 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.363 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:01:56.363 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:07.935454+0000", 2024-04-19T03:01:56.363 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:56.363 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.363 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.363 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:01:56.363 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:07.935454+0000", 2024-04-19T03:01:56.364 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:56.364 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.364 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.364 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:01:56.364 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:07.935453+0000", 2024-04-19T03:01:56.364 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:01:56.364 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.364 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.364 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:01:56.365 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:07.935464+0000", 2024-04-19T03:01:56.365 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1409999999999999e-05 2024-04-19T03:01:56.365 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.365 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.365 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:01:56.365 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:07.935485+0000", 2024-04-19T03:01:56.365 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0380000000000001e-05 2024-04-19T03:01:56.365 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.365 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.365 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:01:56.366 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:07.935501+0000", 2024-04-19T03:01:56.366 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6419999999999999e-05 2024-04-19T03:01:56.366 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.366 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.366 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:01:56.366 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:07.951288+0000", 2024-04-19T03:01:56.366 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.015786969000000001 2024-04-19T03:01:56.366 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.366 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.366 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:01:56.366 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:07.951404+0000", 2024-04-19T03:01:56.366 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000115977 2024-04-19T03:01:56.366 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.367 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.367 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:01:56.367 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:07.951629+0000", 2024-04-19T03:01:56.367 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000224634 2024-04-19T03:01:56.367 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.367 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.367 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:01:56.367 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:07.952689+0000", 2024-04-19T03:01:56.367 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001060374 2024-04-19T03:01:56.367 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.367 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.367 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:56.367 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:07.955706+0000", 2024-04-19T03:01:56.368 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0030169149999999998 2024-04-19T03:01:56.368 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.368 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.368 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:01:56.368 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:07.955741+0000", 2024-04-19T03:01:56.368 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5160999999999998e-05 2024-04-19T03:01:56.368 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.368 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.368 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:01:56.368 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:07.955792+0000", 2024-04-19T03:01:56.368 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0609000000000003e-05 2024-04-19T03:01:56.368 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:56.369 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:01:56.369 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:56.369 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.369 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.369 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4159.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-19T03:01:56.369 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:01:08.150835+0000", 2024-04-19T03:01:56.369 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 48.201324663999998, 2024-04-19T03:01:56.369 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.020342419, 2024-04-19T03:01:56.369 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:01:56.369 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:56.369 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:01:56.369 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4159", 2024-04-19T03:01:56.369 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3589238956", 2024-04-19T03:01:56.370 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 139 2024-04-19T03:01:56.370 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.370 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:01:56.370 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.370 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:01:56.370 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.150835+0000", 2024-04-19T03:01:56.370 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:56.370 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.370 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.370 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:01:56.370 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.150835+0000", 2024-04-19T03:01:56.370 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:56.370 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.371 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.371 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:01:56.371 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.150834+0000", 2024-04-19T03:01:56.371 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:01:56.371 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.371 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.371 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:01:56.371 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.150844+0000", 2024-04-19T03:01:56.371 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.927e-06 2024-04-19T03:01:56.371 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.371 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.371 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:01:56.372 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.150866+0000", 2024-04-19T03:01:56.372 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.211e-05 2024-04-19T03:01:56.372 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.372 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.372 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:01:56.372 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.150899+0000", 2024-04-19T03:01:56.372 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2452e-05 2024-04-19T03:01:56.372 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.372 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.372 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:01:56.372 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.167067+0000", 2024-04-19T03:01:56.372 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.016167737000000001 2024-04-19T03:01:56.372 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.372 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.373 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:01:56.373 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.167210+0000", 2024-04-19T03:01:56.373 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00014319300000000001 2024-04-19T03:01:56.373 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.373 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.373 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:01:56.373 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.167389+0000", 2024-04-19T03:01:56.373 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000179075 2024-04-19T03:01:56.373 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.373 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.373 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:01:56.373 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.170083+0000", 2024-04-19T03:01:56.373 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.002694307 2024-04-19T03:01:56.374 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.374 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.374 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:56.374 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.171088+0000", 2024-04-19T03:01:56.374 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001004429 2024-04-19T03:01:56.374 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.374 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.374 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:01:56.374 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.171147+0000", 2024-04-19T03:01:56.374 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9197999999999998e-05 2024-04-19T03:01:56.374 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.374 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.374 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:01:56.374 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.171178+0000", 2024-04-19T03:01:56.375 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.1137999999999999e-05 2024-04-19T03:01:56.375 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:56.375 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:01:56.375 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:56.375 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.375 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.375 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4159.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-19T03:01:56.375 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:01:08.150915+0000", 2024-04-19T03:01:56.375 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 48.201244987999999, 2024-04-19T03:01:56.375 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.020502679999999999, 2024-04-19T03:01:56.375 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:01:56.375 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:56.375 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:01:56.375 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4159", 2024-04-19T03:01:56.376 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3589238956", 2024-04-19T03:01:56.376 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 140 2024-04-19T03:01:56.376 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.376 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:01:56.376 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.376 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:01:56.376 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.150915+0000", 2024-04-19T03:01:56.376 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:56.376 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.376 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.376 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:01:56.376 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.150915+0000", 2024-04-19T03:01:56.376 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:56.376 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.377 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.377 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:01:56.377 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.150914+0000", 2024-04-19T03:01:56.377 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999986 2024-04-19T03:01:56.377 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.377 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.377 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:01:56.377 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.151066+0000", 2024-04-19T03:01:56.377 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00015186400000000001 2024-04-19T03:01:56.377 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.377 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.377 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:01:56.377 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.151120+0000", 2024-04-19T03:01:56.378 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4042999999999997e-05 2024-04-19T03:01:56.378 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.378 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.378 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:01:56.378 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.151155+0000", 2024-04-19T03:01:56.378 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4941999999999999e-05 2024-04-19T03:01:56.378 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.378 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.378 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:01:56.378 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.168222+0000", 2024-04-19T03:01:56.378 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.017066939999999999 2024-04-19T03:01:56.378 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.378 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.379 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:01:56.379 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.168305+0000", 2024-04-19T03:01:56.379 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.3642999999999999e-05 2024-04-19T03:01:56.379 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.379 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.379 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:01:56.379 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.168385+0000", 2024-04-19T03:01:56.379 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9647999999999994e-05 2024-04-19T03:01:56.379 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.379 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.379 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:01:56.379 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.170514+0000", 2024-04-19T03:01:56.379 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0021286370000000001 2024-04-19T03:01:56.380 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.380 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.380 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:56.380 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.171252+0000", 2024-04-19T03:01:56.380 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00073828499999999998 2024-04-19T03:01:56.380 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.380 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.380 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:01:56.380 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.171353+0000", 2024-04-19T03:01:56.380 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000100839 2024-04-19T03:01:56.380 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.380 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.380 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:01:56.381 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.171418+0000", 2024-04-19T03:01:56.381 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5048999999999993e-05 2024-04-19T03:01:56.381 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:56.381 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:01:56.381 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:56.381 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.381 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.381 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4159.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-19T03:01:56.381 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:01:08.151173+0000", 2024-04-19T03:01:56.381 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 48.200987466000001, 2024-04-19T03:01:56.381 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.023083023000000001, 2024-04-19T03:01:56.381 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:01:56.381 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:56.382 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:01:56.382 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4159", 2024-04-19T03:01:56.382 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3589238956", 2024-04-19T03:01:56.382 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 141 2024-04-19T03:01:56.382 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.382 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:01:56.382 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.382 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:01:56.382 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.151173+0000", 2024-04-19T03:01:56.382 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:56.382 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.382 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.382 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:01:56.382 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.151173+0000", 2024-04-19T03:01:56.383 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:56.383 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.383 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.383 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:01:56.383 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.151171+0000", 2024-04-19T03:01:56.383 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:01:56.383 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.383 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.383 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:01:56.383 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.151182+0000", 2024-04-19T03:01:56.383 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0730000000000001e-05 2024-04-19T03:01:56.383 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.383 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.383 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:01:56.384 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.151203+0000", 2024-04-19T03:01:56.384 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0387e-05 2024-04-19T03:01:56.384 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.384 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.384 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:01:56.384 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.151225+0000", 2024-04-19T03:01:56.384 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2643e-05 2024-04-19T03:01:56.384 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.384 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.384 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:01:56.384 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.169207+0000", 2024-04-19T03:01:56.384 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.017981561 2024-04-19T03:01:56.384 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.384 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.385 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:01:56.385 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.169386+0000", 2024-04-19T03:01:56.385 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000178758 2024-04-19T03:01:56.385 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.385 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.385 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:01:56.385 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.169546+0000", 2024-04-19T03:01:56.385 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000160781 2024-04-19T03:01:56.385 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.385 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.385 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:01:56.385 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.171444+0000", 2024-04-19T03:01:56.385 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0018980309999999999 2024-04-19T03:01:56.386 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.386 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.386 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:56.386 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.174165+0000", 2024-04-19T03:01:56.386 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0027204920000000001 2024-04-19T03:01:56.386 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.386 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.386 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:01:56.386 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.174228+0000", 2024-04-19T03:01:56.386 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2774000000000006e-05 2024-04-19T03:01:56.386 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.386 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.386 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:01:56.386 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.174256+0000", 2024-04-19T03:01:56.387 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.8045999999999999e-05 2024-04-19T03:01:56.387 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:56.387 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:01:56.387 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:56.387 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.387 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.387 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4159.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-19T03:01:56.387 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:01:08.347807+0000", 2024-04-19T03:01:56.387 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 48.004353457999997, 2024-04-19T03:01:56.387 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.021589991999999999, 2024-04-19T03:01:56.387 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:01:56.387 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:56.387 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:01:56.387 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4159", 2024-04-19T03:01:56.388 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3589238956", 2024-04-19T03:01:56.388 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 165 2024-04-19T03:01:56.388 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.388 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:01:56.388 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.388 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:01:56.388 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.347807+0000", 2024-04-19T03:01:56.388 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:56.388 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.388 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.388 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:01:56.388 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.347807+0000", 2024-04-19T03:01:56.388 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:56.389 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.389 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.389 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:01:56.389 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.347806+0000", 2024-04-19T03:01:56.389 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:01:56.389 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.389 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.389 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:01:56.389 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.347812+0000", 2024-04-19T03:01:56.389 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.066e-06 2024-04-19T03:01:56.389 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.389 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.389 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:01:56.389 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.347818+0000", 2024-04-19T03:01:56.390 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5550000000000002e-06 2024-04-19T03:01:56.390 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.390 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.390 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:01:56.390 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.347822+0000", 2024-04-19T03:01:56.390 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.561e-06 2024-04-19T03:01:56.390 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.390 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.390 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:01:56.390 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.365703+0000", 2024-04-19T03:01:56.390 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.017880566000000001 2024-04-19T03:01:56.390 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.390 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.391 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:01:56.391 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.365805+0000", 2024-04-19T03:01:56.391 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00010213900000000001 2024-04-19T03:01:56.391 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.391 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.391 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:01:56.391 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.365928+0000", 2024-04-19T03:01:56.391 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00012337900000000001 2024-04-19T03:01:56.391 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.391 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.391 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:56.391 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.367353+0000", 2024-04-19T03:01:56.391 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001424397 2024-04-19T03:01:56.391 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.392 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.392 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:01:56.392 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.369260+0000", 2024-04-19T03:01:56.392 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0019069130000000001 2024-04-19T03:01:56.392 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.392 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.392 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:01:56.392 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.369342+0000", 2024-04-19T03:01:56.392 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2423999999999996e-05 2024-04-19T03:01:56.392 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.392 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.392 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:01:56.392 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.369397+0000", 2024-04-19T03:01:56.392 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4481999999999998e-05 2024-04-19T03:01:56.393 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:56.393 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:01:56.393 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:56.393 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.393 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.393 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4159.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-19T03:01:56.393 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:01:08.539135+0000", 2024-04-19T03:01:56.393 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 47.813025199999998, 2024-04-19T03:01:56.393 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.021590602, 2024-04-19T03:01:56.393 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:01:56.393 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:56.393 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:01:56.393 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4159", 2024-04-19T03:01:56.393 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3589238956", 2024-04-19T03:01:56.394 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 188 2024-04-19T03:01:56.394 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.394 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:01:56.394 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.394 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:01:56.394 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.539135+0000", 2024-04-19T03:01:56.394 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:56.394 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.394 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.394 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:01:56.394 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.539135+0000", 2024-04-19T03:01:56.394 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:56.395 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.395 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.395 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:01:56.395 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.539134+0000", 2024-04-19T03:01:56.395 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:01:56.395 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.395 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.395 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:01:56.395 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.539228+0000", 2024-04-19T03:01:56.395 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.3771999999999996e-05 2024-04-19T03:01:56.395 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.395 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.395 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:01:56.395 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.539243+0000", 2024-04-19T03:01:56.396 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4707e-05 2024-04-19T03:01:56.396 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.396 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.396 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:01:56.396 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.539250+0000", 2024-04-19T03:01:56.396 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7190000000000001e-06 2024-04-19T03:01:56.396 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.396 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.396 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:01:56.396 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.553787+0000", 2024-04-19T03:01:56.396 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.014536248999999999 2024-04-19T03:01:56.396 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.396 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.396 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:01:56.397 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.553857+0000", 2024-04-19T03:01:56.397 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0675999999999999e-05 2024-04-19T03:01:56.397 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.397 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.397 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:01:56.397 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.553953+0000", 2024-04-19T03:01:56.397 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.5420999999999993e-05 2024-04-19T03:01:56.397 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.397 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.397 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:01:56.397 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.555569+0000", 2024-04-19T03:01:56.397 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001616625 2024-04-19T03:01:56.397 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.397 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.398 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:56.398 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.560644+0000", 2024-04-19T03:01:56.398 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0050749660000000002 2024-04-19T03:01:56.398 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.398 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.398 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:01:56.398 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.560690+0000", 2024-04-19T03:01:56.398 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6041000000000002e-05 2024-04-19T03:01:56.398 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.398 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.398 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:01:56.398 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.560726+0000", 2024-04-19T03:01:56.398 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5188999999999998e-05 2024-04-19T03:01:56.399 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:56.399 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:01:56.399 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:56.399 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.399 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.399 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4159.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-19T03:01:56.399 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:01:08.539259+0000", 2024-04-19T03:01:56.399 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 47.812900732000003, 2024-04-19T03:01:56.399 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.021552071999999999, 2024-04-19T03:01:56.399 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:01:56.399 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:56.399 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:01:56.399 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4159", 2024-04-19T03:01:56.400 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3589238956", 2024-04-19T03:01:56.400 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 189 2024-04-19T03:01:56.400 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.400 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:01:56.400 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.400 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:01:56.400 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.539259+0000", 2024-04-19T03:01:56.400 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:56.400 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.400 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.400 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:01:56.400 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.539259+0000", 2024-04-19T03:01:56.400 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:56.401 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.401 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.401 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:01:56.401 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.539259+0000", 2024-04-19T03:01:56.401 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:01:56.401 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.401 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.401 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:01:56.401 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.539268+0000", 2024-04-19T03:01:56.401 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.5359999999999998e-06 2024-04-19T03:01:56.401 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.401 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.401 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:01:56.402 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.539291+0000", 2024-04-19T03:01:56.402 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2687000000000001e-05 2024-04-19T03:01:56.402 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.402 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.402 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:01:56.402 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.539298+0000", 2024-04-19T03:01:56.402 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.883e-06 2024-04-19T03:01:56.402 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.402 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.402 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:01:56.402 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.554957+0000", 2024-04-19T03:01:56.402 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.015659019999999999 2024-04-19T03:01:56.402 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.402 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.403 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:01:56.403 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.555010+0000", 2024-04-19T03:01:56.403 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2985999999999997e-05 2024-04-19T03:01:56.403 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.403 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.403 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:01:56.403 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.555094+0000", 2024-04-19T03:01:56.403 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4530000000000006e-05 2024-04-19T03:01:56.403 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.403 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.403 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:01:56.403 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.556093+0000", 2024-04-19T03:01:56.404 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00099903300000000008 2024-04-19T03:01:56.404 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.404 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.404 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:56.404 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.560759+0000", 2024-04-19T03:01:56.404 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0046654369999999997 2024-04-19T03:01:56.404 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.404 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.404 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:01:56.404 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.560789+0000", 2024-04-19T03:01:56.404 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0638e-05 2024-04-19T03:01:56.404 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.404 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.404 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:01:56.405 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.560811+0000", 2024-04-19T03:01:56.405 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2167999999999998e-05 2024-04-19T03:01:56.405 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:56.405 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:01:56.405 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:56.405 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.405 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.405 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:8 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:01:56.405 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:01:14.998165+0000", 2024-04-19T03:01:56.405 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 41.353995050999998, 2024-04-19T03:01:56.405 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.024541001, 2024-04-19T03:01:56.405 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:01:56.405 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:56.406 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:01:56.406 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.406 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:01:56.406 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998165+0000", 2024-04-19T03:01:56.406 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:56.406 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.406 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.406 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:01:56.406 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998165+0000", 2024-04-19T03:01:56.407 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:56.407 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.407 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.407 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:01:56.407 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998164+0000", 2024-04-19T03:01:56.407 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:01:56.407 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.407 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.407 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:01:56.407 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998170+0000", 2024-04-19T03:01:56.407 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2939999999999996e-06 2024-04-19T03:01:56.407 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.407 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.407 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:01:56.408 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998179+0000", 2024-04-19T03:01:56.408 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.5540000000000003e-06 2024-04-19T03:01:56.408 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.408 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.408 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:01:56.408 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998188+0000", 2024-04-19T03:01:56.408 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2959999999999999e-06 2024-04-19T03:01:56.408 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.408 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.408 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:01:56.408 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998332+0000", 2024-04-19T03:01:56.408 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00014474 2024-04-19T03:01:56.408 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.409 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.409 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:01:56.409 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998337+0000", 2024-04-19T03:01:56.409 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6909999999999996e-06 2024-04-19T03:01:56.409 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.409 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.409 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:01:56.409 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.010222+0000", 2024-04-19T03:01:56.409 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011885178 2024-04-19T03:01:56.409 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.409 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.409 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:01:56.409 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.010342+0000", 2024-04-19T03:01:56.409 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00011991500000000001 2024-04-19T03:01:56.410 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.410 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.410 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:01:56.410 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.010506+0000", 2024-04-19T03:01:56.410 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00016429699999999999 2024-04-19T03:01:56.410 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.410 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.410 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:01:56.410 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.014525+0000", 2024-04-19T03:01:56.410 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0040189839999999998 2024-04-19T03:01:56.410 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.410 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.410 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:56.411 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.022600+0000", 2024-04-19T03:01:56.411 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0080741990000000007 2024-04-19T03:01:56.411 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.411 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.411 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:01:56.411 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.022670+0000", 2024-04-19T03:01:56.411 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0743999999999999e-05 2024-04-19T03:01:56.411 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.411 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.411 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:01:56.411 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.022706+0000", 2024-04-19T03:01:56.411 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5782999999999999e-05 2024-04-19T03:01:56.411 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:56.412 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:01:56.412 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:56.412 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.412 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.412 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:27 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:01:56.412 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:01:14.998436+0000", 2024-04-19T03:01:56.412 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 41.353724397000001, 2024-04-19T03:01:56.412 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.024406325999999999, 2024-04-19T03:01:56.412 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:01:56.412 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:56.412 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:01:56.412 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.412 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:01:56.412 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998436+0000", 2024-04-19T03:01:56.413 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:56.413 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.413 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.413 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:01:56.413 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998436+0000", 2024-04-19T03:01:56.413 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:56.413 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.413 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.413 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:01:56.413 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998435+0000", 2024-04-19T03:01:56.413 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:01:56.413 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.413 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.414 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:01:56.414 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998445+0000", 2024-04-19T03:01:56.414 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0349e-05 2024-04-19T03:01:56.414 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.414 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.414 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:01:56.414 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998453+0000", 2024-04-19T03:01:56.414 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0399999999999993e-06 2024-04-19T03:01:56.414 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.414 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.414 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:01:56.415 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998461+0000", 2024-04-19T03:01:56.415 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9780000000000005e-06 2024-04-19T03:01:56.415 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.415 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.415 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:01:56.415 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998515+0000", 2024-04-19T03:01:56.415 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3097999999999999e-05 2024-04-19T03:01:56.415 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.415 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.415 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:01:56.415 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998520+0000", 2024-04-19T03:01:56.415 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9220000000000002e-06 2024-04-19T03:01:56.415 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.415 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.416 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:01:56.416 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.011258+0000", 2024-04-19T03:01:56.416 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.012737735 2024-04-19T03:01:56.416 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.416 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.416 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:01:56.416 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.011566+0000", 2024-04-19T03:01:56.416 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00030826200000000001 2024-04-19T03:01:56.416 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.416 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.416 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:01:56.416 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.011996+0000", 2024-04-19T03:01:56.416 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00042912000000000001 2024-04-19T03:01:56.416 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.417 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.417 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:01:56.417 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.014533+0000", 2024-04-19T03:01:56.417 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.002537423 2024-04-19T03:01:56.417 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.417 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.417 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:56.417 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.022756+0000", 2024-04-19T03:01:56.417 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0082231530000000004 2024-04-19T03:01:56.417 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.417 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.417 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:01:56.417 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.022807+0000", 2024-04-19T03:01:56.418 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0852e-05 2024-04-19T03:01:56.418 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.418 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.418 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:01:56.418 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.022842+0000", 2024-04-19T03:01:56.418 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5058000000000002e-05 2024-04-19T03:01:56.418 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:56.418 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:01:56.418 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:56.418 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.418 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.418 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:28 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:01:56.418 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:01:14.998476+0000", 2024-04-19T03:01:56.419 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 41.353684475000001, 2024-04-19T03:01:56.419 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.024656784000000001, 2024-04-19T03:01:56.419 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:01:56.419 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:56.419 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:01:56.419 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.419 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:01:56.419 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998476+0000", 2024-04-19T03:01:56.419 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:56.419 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.419 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.419 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:01:56.419 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998476+0000", 2024-04-19T03:01:56.419 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:56.420 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.420 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.420 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:01:56.420 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998475+0000", 2024-04-19T03:01:56.420 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:01:56.420 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.420 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.420 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:01:56.420 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998484+0000", 2024-04-19T03:01:56.420 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.7770000000000008e-06 2024-04-19T03:01:56.420 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.420 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.420 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:01:56.421 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998495+0000", 2024-04-19T03:01:56.421 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0726e-05 2024-04-19T03:01:56.421 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.421 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.421 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:01:56.421 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998503+0000", 2024-04-19T03:01:56.421 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.8780000000000004e-06 2024-04-19T03:01:56.421 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.421 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.421 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:01:56.421 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998579+0000", 2024-04-19T03:01:56.421 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5160999999999994e-05 2024-04-19T03:01:56.421 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.421 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.422 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:01:56.422 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998586+0000", 2024-04-19T03:01:56.422 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8520000000000004e-06 2024-04-19T03:01:56.422 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.422 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.422 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:01:56.422 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.012423+0000", 2024-04-19T03:01:56.422 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.013836667 2024-04-19T03:01:56.422 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.422 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.422 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:01:56.422 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.012532+0000", 2024-04-19T03:01:56.422 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000108565 2024-04-19T03:01:56.423 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.423 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.423 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:01:56.423 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.012655+0000", 2024-04-19T03:01:56.423 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00012344600000000001 2024-04-19T03:01:56.423 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.423 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.423 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:01:56.423 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.015680+0000", 2024-04-19T03:01:56.423 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0030246470000000001 2024-04-19T03:01:56.423 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.423 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.423 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:56.423 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.023091+0000", 2024-04-19T03:01:56.423 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0074116030000000001 2024-04-19T03:01:56.424 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.424 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.424 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:01:56.424 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.023115+0000", 2024-04-19T03:01:56.424 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.3091999999999998e-05 2024-04-19T03:01:56.424 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.424 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.424 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:01:56.424 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.023132+0000", 2024-04-19T03:01:56.424 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7901999999999999e-05 2024-04-19T03:01:56.424 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:56.424 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:01:56.424 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:56.424 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.425 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.425 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:29 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:01:56.425 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:01:14.998527+0000", 2024-04-19T03:01:56.425 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 41.353632935, 2024-04-19T03:01:56.425 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.024738599999999999, 2024-04-19T03:01:56.425 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:01:56.425 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:56.425 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:01:56.425 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.425 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:01:56.425 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998527+0000", 2024-04-19T03:01:56.425 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:56.425 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.425 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.426 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:01:56.426 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998527+0000", 2024-04-19T03:01:56.426 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:56.426 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.426 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.426 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:01:56.426 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998527+0000", 2024-04-19T03:01:56.426 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:01:56.426 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.426 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.426 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:01:56.426 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998531+0000", 2024-04-19T03:01:56.426 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9450000000000001e-06 2024-04-19T03:01:56.426 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.427 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.427 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:01:56.427 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998541+0000", 2024-04-19T03:01:56.427 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.4320000000000005e-06 2024-04-19T03:01:56.427 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.427 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.427 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:01:56.427 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998548+0000", 2024-04-19T03:01:56.427 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.221e-06 2024-04-19T03:01:56.427 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.427 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.427 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:01:56.427 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998620+0000", 2024-04-19T03:01:56.427 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.1676999999999998e-05 2024-04-19T03:01:56.428 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.428 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.428 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:01:56.428 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998624+0000", 2024-04-19T03:01:56.428 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4850000000000003e-06 2024-04-19T03:01:56.428 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.428 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.428 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:01:56.428 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.013261+0000", 2024-04-19T03:01:56.428 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.014636451999999999 2024-04-19T03:01:56.428 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.428 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.428 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:01:56.429 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.013364+0000", 2024-04-19T03:01:56.429 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000102885 2024-04-19T03:01:56.429 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.429 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.429 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:01:56.429 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.013481+0000", 2024-04-19T03:01:56.429 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00011783299999999999 2024-04-19T03:01:56.429 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.429 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.429 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:01:56.429 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.016265+0000", 2024-04-19T03:01:56.429 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0027834539999999999 2024-04-19T03:01:56.429 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.429 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.430 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:56.430 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.023180+0000", 2024-04-19T03:01:56.430 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0069149399999999996 2024-04-19T03:01:56.430 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.430 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.430 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:01:56.430 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.023230+0000", 2024-04-19T03:01:56.430 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0220999999999999e-05 2024-04-19T03:01:56.430 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.430 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.430 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:01:56.430 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.023266+0000", 2024-04-19T03:01:56.430 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5703e-05 2024-04-19T03:01:56.430 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:56.431 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:01:56.431 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:56.431 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.431 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.431 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:30 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:01:56.431 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:01:14.998577+0000", 2024-04-19T03:01:56.431 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 41.353582828, 2024-04-19T03:01:56.431 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.024774022999999999, 2024-04-19T03:01:56.431 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:01:56.431 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:56.431 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:01:56.431 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.432 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:01:56.432 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998577+0000", 2024-04-19T03:01:56.432 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:56.432 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.432 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.432 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:01:56.432 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998577+0000", 2024-04-19T03:01:56.432 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:56.432 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.432 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.432 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:01:56.432 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998576+0000", 2024-04-19T03:01:56.432 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:01:56.432 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.432 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.433 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:01:56.433 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998583+0000", 2024-04-19T03:01:56.433 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8850000000000001e-06 2024-04-19T03:01:56.433 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.433 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.433 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:01:56.433 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998597+0000", 2024-04-19T03:01:56.433 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.362e-05 2024-04-19T03:01:56.433 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.433 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.433 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:01:56.433 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998607+0000", 2024-04-19T03:01:56.433 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0389e-05 2024-04-19T03:01:56.433 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.434 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.434 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:01:56.434 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998713+0000", 2024-04-19T03:01:56.434 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000105338 2024-04-19T03:01:56.434 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.434 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.434 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:01:56.434 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998720+0000", 2024-04-19T03:01:56.434 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2370000000000003e-06 2024-04-19T03:01:56.434 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.434 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.434 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:01:56.434 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.014014+0000", 2024-04-19T03:01:56.434 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.015294116999999999 2024-04-19T03:01:56.435 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.435 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.435 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:01:56.435 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.014091+0000", 2024-04-19T03:01:56.435 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7148000000000001e-05 2024-04-19T03:01:56.435 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.435 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.435 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:01:56.435 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.014271+0000", 2024-04-19T03:01:56.435 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00017962699999999999 2024-04-19T03:01:56.435 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.435 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.435 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:01:56.435 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.018024+0000", 2024-04-19T03:01:56.436 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0037529809999999999 2024-04-19T03:01:56.436 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.436 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.436 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:56.436 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.023303+0000", 2024-04-19T03:01:56.436 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0052793099999999997 2024-04-19T03:01:56.436 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.436 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.436 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:01:56.436 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.023331+0000", 2024-04-19T03:01:56.436 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.8013000000000001e-05 2024-04-19T03:01:56.436 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.436 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.436 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:01:56.437 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.023351+0000", 2024-04-19T03:01:56.437 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0225999999999999e-05 2024-04-19T03:01:56.437 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:56.437 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:01:56.437 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:56.437 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.437 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.437 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:33 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:01:56.437 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:01:14.998625+0000", 2024-04-19T03:01:56.437 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 41.353535430999997, 2024-04-19T03:01:56.437 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.024007338999999999, 2024-04-19T03:01:56.437 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:01:56.437 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:56.437 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:01:56.437 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.438 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:01:56.438 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998625+0000", 2024-04-19T03:01:56.438 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:56.438 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.438 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.438 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:01:56.438 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998625+0000", 2024-04-19T03:01:56.438 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:56.438 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.438 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.438 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:01:56.438 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998623+0000", 2024-04-19T03:01:56.438 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999986 2024-04-19T03:01:56.438 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.439 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.439 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:01:56.439 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998632+0000", 2024-04-19T03:01:56.439 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9279999999999999e-06 2024-04-19T03:01:56.439 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.439 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.439 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:01:56.439 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998642+0000", 2024-04-19T03:01:56.439 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0063e-05 2024-04-19T03:01:56.439 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.439 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.439 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:01:56.439 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998649+0000", 2024-04-19T03:01:56.439 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4799999999999998e-06 2024-04-19T03:01:56.440 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.440 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.440 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:01:56.440 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998730+0000", 2024-04-19T03:01:56.440 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.1514999999999995e-05 2024-04-19T03:01:56.440 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.440 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.440 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:01:56.440 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998741+0000", 2024-04-19T03:01:56.440 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1029999999999999e-05 2024-04-19T03:01:56.440 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.440 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.440 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:01:56.440 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.010202+0000", 2024-04-19T03:01:56.441 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011460529000000001 2024-04-19T03:01:56.441 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.441 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.441 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:01:56.441 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.010292+0000", 2024-04-19T03:01:56.441 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.0382000000000003e-05 2024-04-19T03:01:56.441 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.441 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.441 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:01:56.441 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.010391+0000", 2024-04-19T03:01:56.441 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.8491000000000003e-05 2024-04-19T03:01:56.441 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.441 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.441 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:01:56.442 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.013800+0000", 2024-04-19T03:01:56.442 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0034090219999999998 2024-04-19T03:01:56.442 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.442 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.442 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:56.442 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.022564+0000", 2024-04-19T03:01:56.442 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0087639950000000001 2024-04-19T03:01:56.442 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.442 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.442 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:01:56.442 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.022601+0000", 2024-04-19T03:01:56.442 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7363999999999997e-05 2024-04-19T03:01:56.442 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.442 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.443 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:01:56.443 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.022632+0000", 2024-04-19T03:01:56.443 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0917000000000002e-05 2024-04-19T03:01:56.443 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:56.443 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:01:56.443 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:56.443 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.443 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.443 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:37 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:01:56.443 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:01:14.998739+0000", 2024-04-19T03:01:56.443 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 41.353421490000002, 2024-04-19T03:01:56.443 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.020573188999999999, 2024-04-19T03:01:56.443 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:01:56.443 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:56.444 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:01:56.444 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.444 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:01:56.444 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998739+0000", 2024-04-19T03:01:56.444 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:56.444 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.444 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.444 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:01:56.444 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998739+0000", 2024-04-19T03:01:56.444 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:56.444 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.444 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.444 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:01:56.444 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998738+0000", 2024-04-19T03:01:56.445 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:01:56.445 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.445 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.445 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:01:56.445 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998755+0000", 2024-04-19T03:01:56.445 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7105999999999999e-05 2024-04-19T03:01:56.445 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.445 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.445 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:01:56.445 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998764+0000", 2024-04-19T03:01:56.445 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.1279999999999997e-06 2024-04-19T03:01:56.445 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.445 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.445 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:01:56.446 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998771+0000", 2024-04-19T03:01:56.446 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6939999999999998e-06 2024-04-19T03:01:56.446 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.446 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.446 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:01:56.446 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998843+0000", 2024-04-19T03:01:56.446 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.1695999999999999e-05 2024-04-19T03:01:56.446 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.446 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.446 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op must wait for map", 2024-04-19T03:01:56.446 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998852+0000", 2024-04-19T03:01:56.446 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.0799999999999995e-06 2024-04-19T03:01:56.446 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.446 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.447 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:01:56.447 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.006513+0000", 2024-04-19T03:01:56.447 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0076610020000000001 2024-04-19T03:01:56.447 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.447 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.447 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:01:56.447 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.006670+0000", 2024-04-19T03:01:56.447 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000157529 2024-04-19T03:01:56.447 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.447 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.447 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-04-19T03:01:56.447 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.006863+0000", 2024-04-19T03:01:56.447 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000192597 2024-04-19T03:01:56.447 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.447 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.448 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:01:56.448 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.012404+0000", 2024-04-19T03:01:56.448 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0055415220000000001 2024-04-19T03:01:56.448 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.448 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.448 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:56.448 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.019171+0000", 2024-04-19T03:01:56.448 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0067666829999999999 2024-04-19T03:01:56.448 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.448 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.448 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:01:56.448 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.019228+0000", 2024-04-19T03:01:56.448 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7145999999999998e-05 2024-04-19T03:01:56.448 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.449 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.449 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:01:56.449 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.019312+0000", 2024-04-19T03:01:56.449 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.3591999999999995e-05 2024-04-19T03:01:56.449 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:56.449 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:01:56.449 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:56.449 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.449 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.449 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:01:56.449 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:01:14.998792+0000", 2024-04-19T03:01:56.449 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 41.353368562, 2024-04-19T03:01:56.449 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.023951813999999998, 2024-04-19T03:01:56.449 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:01:56.450 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:56.450 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:01:56.450 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.450 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:01:56.450 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998792+0000", 2024-04-19T03:01:56.450 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:56.450 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.450 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.450 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:01:56.450 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998792+0000", 2024-04-19T03:01:56.450 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:56.450 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.450 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.451 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:01:56.451 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998791+0000", 2024-04-19T03:01:56.451 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:01:56.451 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.451 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.451 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:01:56.451 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998796+0000", 2024-04-19T03:01:56.451 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9649999999999999e-06 2024-04-19T03:01:56.451 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.451 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.451 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:01:56.451 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998809+0000", 2024-04-19T03:01:56.451 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3254e-05 2024-04-19T03:01:56.451 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.452 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.452 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:01:56.452 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998816+0000", 2024-04-19T03:01:56.452 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.472e-06 2024-04-19T03:01:56.452 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.452 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.452 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:01:56.452 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998899+0000", 2024-04-19T03:01:56.452 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.3676000000000003e-05 2024-04-19T03:01:56.452 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.452 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.452 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:01:56.452 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998908+0000", 2024-04-19T03:01:56.452 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6940000000000001e-06 2024-04-19T03:01:56.452 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.453 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.453 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:01:56.453 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.010818+0000", 2024-04-19T03:01:56.453 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011910482999999999 2024-04-19T03:01:56.453 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.453 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.453 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:01:56.453 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.010959+0000", 2024-04-19T03:01:56.453 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00014018900000000001 2024-04-19T03:01:56.453 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.453 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.453 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:01:56.453 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.011185+0000", 2024-04-19T03:01:56.453 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000226085 2024-04-19T03:01:56.454 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.454 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.454 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:01:56.454 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.014479+0000", 2024-04-19T03:01:56.454 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0032938260000000001 2024-04-19T03:01:56.454 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.454 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.454 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:56.455 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.022697+0000", 2024-04-19T03:01:56.455 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0082186029999999997 2024-04-19T03:01:56.455 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.455 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.455 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:01:56.455 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.022724+0000", 2024-04-19T03:01:56.455 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.6503999999999999e-05 2024-04-19T03:01:56.455 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.455 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.455 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:01:56.455 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.022743+0000", 2024-04-19T03:01:56.455 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9663000000000001e-05 2024-04-19T03:01:56.455 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:56.455 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:01:56.456 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:56.456 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.456 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.456 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:01:56.456 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:01:14.998870+0000", 2024-04-19T03:01:56.456 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 41.353290360999999, 2024-04-19T03:01:56.456 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.024280578000000001, 2024-04-19T03:01:56.456 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:01:56.456 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:56.456 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:01:56.456 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.456 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:01:56.456 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998870+0000", 2024-04-19T03:01:56.456 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:56.457 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.457 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.457 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:01:56.457 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998870+0000", 2024-04-19T03:01:56.457 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:56.457 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.457 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.457 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:01:56.457 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998869+0000", 2024-04-19T03:01:56.457 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:01:56.457 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.457 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.457 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:01:56.457 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998879+0000", 2024-04-19T03:01:56.458 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.8689999999999999e-06 2024-04-19T03:01:56.458 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.458 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.458 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:01:56.458 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998893+0000", 2024-04-19T03:01:56.458 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4436999999999999e-05 2024-04-19T03:01:56.458 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.458 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.458 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:01:56.458 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998904+0000", 2024-04-19T03:01:56.458 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0657e-05 2024-04-19T03:01:56.458 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.458 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.459 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:01:56.459 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998972+0000", 2024-04-19T03:01:56.459 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8121999999999996e-05 2024-04-19T03:01:56.459 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.459 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.459 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:01:56.459 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998980+0000", 2024-04-19T03:01:56.459 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7170000000000008e-06 2024-04-19T03:01:56.459 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.459 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.459 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:01:56.459 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.011666+0000", 2024-04-19T03:01:56.459 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.012686507 2024-04-19T03:01:56.459 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.459 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.460 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:01:56.460 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.012403+0000", 2024-04-19T03:01:56.460 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00073661899999999999 2024-04-19T03:01:56.460 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.460 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.460 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:01:56.460 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.012788+0000", 2024-04-19T03:01:56.460 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00038495800000000002 2024-04-19T03:01:56.460 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.460 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.460 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:01:56.460 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.015713+0000", 2024-04-19T03:01:56.460 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0029255879999999998 2024-04-19T03:01:56.460 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.461 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.461 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:56.461 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.023066+0000", 2024-04-19T03:01:56.461 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.007352903 2024-04-19T03:01:56.461 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.461 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.461 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:01:56.461 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.023113+0000", 2024-04-19T03:01:56.461 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7163000000000002e-05 2024-04-19T03:01:56.461 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.461 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.461 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:01:56.461 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.023150+0000", 2024-04-19T03:01:56.462 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6881000000000001e-05 2024-04-19T03:01:56.462 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:56.462 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:01:56.462 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:56.462 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.462 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.462 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:16 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:01:56.462 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:01:14.998920+0000", 2024-04-19T03:01:56.462 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 41.353240315999997, 2024-04-19T03:01:56.462 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.020562114999999999, 2024-04-19T03:01:56.462 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:01:56.462 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:56.463 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:01:56.463 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.463 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:01:56.463 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998920+0000", 2024-04-19T03:01:56.463 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:56.463 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.463 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.463 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:01:56.463 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998920+0000", 2024-04-19T03:01:56.463 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:56.463 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.463 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.463 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:01:56.463 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998919+0000", 2024-04-19T03:01:56.464 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:01:56.464 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.464 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.464 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:01:56.464 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998925+0000", 2024-04-19T03:01:56.464 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5370000000000003e-06 2024-04-19T03:01:56.464 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.464 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.464 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:01:56.464 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998943+0000", 2024-04-19T03:01:56.464 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7549000000000001e-05 2024-04-19T03:01:56.464 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.464 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.465 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:01:56.465 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998955+0000", 2024-04-19T03:01:56.465 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1977000000000001e-05 2024-04-19T03:01:56.465 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.465 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.465 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:01:56.465 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.999009+0000", 2024-04-19T03:01:56.465 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3667e-05 2024-04-19T03:01:56.465 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.465 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.465 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:01:56.465 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.999013+0000", 2024-04-19T03:01:56.465 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8829999999999997e-06 2024-04-19T03:01:56.465 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.466 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.466 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:01:56.466 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.007476+0000", 2024-04-19T03:01:56.466 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0084621569999999997 2024-04-19T03:01:56.466 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.466 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.466 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:01:56.466 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.007626+0000", 2024-04-19T03:01:56.466 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00015079199999999999 2024-04-19T03:01:56.466 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.466 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.466 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-04-19T03:01:56.466 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.007765+0000", 2024-04-19T03:01:56.467 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000138376 2024-04-19T03:01:56.467 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.467 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.467 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:01:56.467 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.012418+0000", 2024-04-19T03:01:56.467 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0046528200000000002 2024-04-19T03:01:56.467 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.467 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.467 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:56.467 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.019380+0000", 2024-04-19T03:01:56.467 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0069621960000000004 2024-04-19T03:01:56.467 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.467 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.467 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:01:56.468 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.019437+0000", 2024-04-19T03:01:56.468 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7226999999999999e-05 2024-04-19T03:01:56.468 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.468 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.468 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:01:56.468 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.019482+0000", 2024-04-19T03:01:56.468 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4857000000000001e-05 2024-04-19T03:01:56.468 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:56.468 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:01:56.468 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:56.468 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.468 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.468 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:20 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:01:56.468 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:01:14.999024+0000", 2024-04-19T03:01:56.469 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 41.353136089000003, 2024-04-19T03:01:56.469 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.024212818000000001, 2024-04-19T03:01:56.469 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:01:56.469 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-04-19T03:01:56.469 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:01:56.469 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.469 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:01:56.469 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.999024+0000", 2024-04-19T03:01:56.469 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:56.469 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.469 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.469 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:01:56.469 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.999024+0000", 2024-04-19T03:01:56.470 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:56.470 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.470 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.470 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:01:56.470 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.999023+0000", 2024-04-19T03:01:56.470 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:01:56.470 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.470 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.470 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:01:56.470 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.999029+0000", 2024-04-19T03:01:56.470 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2709999999999998e-06 2024-04-19T03:01:56.470 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.470 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.470 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:01:56.471 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.999045+0000", 2024-04-19T03:01:56.471 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.5840000000000001e-05 2024-04-19T03:01:56.471 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.471 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.471 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:01:56.471 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.999057+0000", 2024-04-19T03:01:56.471 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1897e-05 2024-04-19T03:01:56.471 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.471 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.471 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:01:56.471 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.999136+0000", 2024-04-19T03:01:56.471 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8842000000000002e-05 2024-04-19T03:01:56.471 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.471 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.472 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:01:56.472 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.999144+0000", 2024-04-19T03:01:56.472 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.3110000000000006e-06 2024-04-19T03:01:56.472 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.472 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.472 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:01:56.472 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.013338+0000", 2024-04-19T03:01:56.472 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.014194217 2024-04-19T03:01:56.472 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.472 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.472 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:01:56.472 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.013485+0000", 2024-04-19T03:01:56.472 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000146787 2024-04-19T03:01:56.472 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.472 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.473 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:01:56.473 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.023237+0000", 2024-04-19T03:01:56.473 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0097517899999999998 2024-04-19T03:01:56.473 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:56.473 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:01:56.473 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:56.473 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.473 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.473 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:11289 5.7 5:e1ea82b1:::benchmark_data_smithi096_19531_object11288:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T03:01:56.473 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:01:42.068678+0000", 2024-04-19T03:01:56.473 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 14.283481868999999, 2024-04-19T03:01:56.473 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.022027980999999999, 2024-04-19T03:01:56.473 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:01:56.473 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:56.474 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:01:56.474 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:01:56.474 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:56.474 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 11289 2024-04-19T03:01:56.474 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.474 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:01:56.474 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.474 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:01:56.474 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:42.068678+0000", 2024-04-19T03:01:56.474 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:56.474 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.474 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.474 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:01:56.474 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:42.068678+0000", 2024-04-19T03:01:56.475 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:01:56.475 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.475 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.475 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:01:56.475 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:42.068677+0000", 2024-04-19T03:01:56.475 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:01:56.475 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.475 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.475 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:01:56.475 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:42.068721+0000", 2024-04-19T03:01:56.475 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3714000000000002e-05 2024-04-19T03:01:56.475 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.475 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.475 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:01:56.476 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:42.068728+0000", 2024-04-19T03:01:56.476 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0029999999999997e-06 2024-04-19T03:01:56.476 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.476 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.476 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:01:56.476 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:42.068733+0000", 2024-04-19T03:01:56.476 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0100000000000003e-06 2024-04-19T03:01:56.476 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.476 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.476 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:01:56.476 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:42.068820+0000", 2024-04-19T03:01:56.476 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.653e-05 2024-04-19T03:01:56.476 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.476 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.476 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:01:56.477 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:42.068990+0000", 2024-04-19T03:01:56.477 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00017046800000000001 2024-04-19T03:01:56.477 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.477 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.477 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-04-19T03:01:56.477 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:42.069140+0000", 2024-04-19T03:01:56.477 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00015001000000000001 2024-04-19T03:01:56.477 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.477 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.477 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:01:56.477 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:42.074573+0000", 2024-04-19T03:01:56.477 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0054326979999999997 2024-04-19T03:01:56.477 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.477 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.477 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:56.478 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:42.090534+0000", 2024-04-19T03:01:56.478 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.015961300000000001 2024-04-19T03:01:56.478 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.478 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.478 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:01:56.478 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:42.090619+0000", 2024-04-19T03:01:56.478 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4536999999999994e-05 2024-04-19T03:01:56.478 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:01:56.478 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:01:56.478 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:01:56.478 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:42.090706+0000", 2024-04-19T03:01:56.478 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.7643000000000001e-05 2024-04-19T03:01:56.478 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:56.478 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:01:56.479 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:56.479 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:01:56.479 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:01:56.479 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-04-19T03:01:56.480 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:01:56.477+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:01:56.481 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T03:01:56.581 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:01:56.577+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:01:56.598 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-19T03:01:56.598 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-04-19T03:01:56.598 INFO:teuthology.orchestra.run.smithi096.stdout: "epoch": 30, 2024-04-19T03:01:56.598 INFO:teuthology.orchestra.run.smithi096.stdout: "fsid": "c6cc8e09-11d4-48de-9a6c-4d70ed3c3789", 2024-04-19T03:01:56.598 INFO:teuthology.orchestra.run.smithi096.stdout: "created": "2024-04-19T03:00:53.746146+0000", 2024-04-19T03:01:56.598 INFO:teuthology.orchestra.run.smithi096.stdout: "modified": "2024-04-19T03:01:54.055013+0000", 2024-04-19T03:01:56.598 INFO:teuthology.orchestra.run.smithi096.stdout: "last_up_change": "2024-04-19T03:01:04.501086+0000", 2024-04-19T03:01:56.598 INFO:teuthology.orchestra.run.smithi096.stdout: "last_in_change": "2024-04-19T03:00:54.640172+0000", 2024-04-19T03:01:56.599 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": "nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-04-19T03:01:56.599 INFO:teuthology.orchestra.run.smithi096.stdout: "flags_num": 5804032, 2024-04-19T03:01:56.599 INFO:teuthology.orchestra.run.smithi096.stdout: "flags_set": [ 2024-04-19T03:01:56.599 INFO:teuthology.orchestra.run.smithi096.stdout: "nodeep-scrub", 2024-04-19T03:01:56.599 INFO:teuthology.orchestra.run.smithi096.stdout: "pglog_hardlimit", 2024-04-19T03:01:56.599 INFO:teuthology.orchestra.run.smithi096.stdout: "purged_snapdirs", 2024-04-19T03:01:56.599 INFO:teuthology.orchestra.run.smithi096.stdout: "recovery_deletes", 2024-04-19T03:01:56.599 INFO:teuthology.orchestra.run.smithi096.stdout: "sortbitwise" 2024-04-19T03:01:56.599 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-19T03:01:56.599 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_version": 5, 2024-04-19T03:01:56.599 INFO:teuthology.orchestra.run.smithi096.stdout: "full_ratio": 0.94999998807907104, 2024-04-19T03:01:56.599 INFO:teuthology.orchestra.run.smithi096.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-04-19T03:01:56.599 INFO:teuthology.orchestra.run.smithi096.stdout: "nearfull_ratio": 0.85000002384185791, 2024-04-19T03:01:56.600 INFO:teuthology.orchestra.run.smithi096.stdout: "cluster_snapshot": "", 2024-04-19T03:01:56.600 INFO:teuthology.orchestra.run.smithi096.stdout: "pool_max": 5, 2024-04-19T03:01:56.600 INFO:teuthology.orchestra.run.smithi096.stdout: "max_osd": 3, 2024-04-19T03:01:56.600 INFO:teuthology.orchestra.run.smithi096.stdout: "require_min_compat_client": "luminous", 2024-04-19T03:01:56.600 INFO:teuthology.orchestra.run.smithi096.stdout: "min_compat_client": "jewel", 2024-04-19T03:01:56.600 INFO:teuthology.orchestra.run.smithi096.stdout: "require_osd_release": "reef", 2024-04-19T03:01:56.600 INFO:teuthology.orchestra.run.smithi096.stdout: "allow_crimson": false, 2024-04-19T03:01:56.600 INFO:teuthology.orchestra.run.smithi096.stdout: "pools": [ 2024-04-19T03:01:56.600 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-19T03:01:56.600 INFO:teuthology.orchestra.run.smithi096.stdout: "pool": 1, 2024-04-19T03:01:56.600 INFO:teuthology.orchestra.run.smithi096.stdout: "pool_name": ".mgr", 2024-04-19T03:01:56.600 INFO:teuthology.orchestra.run.smithi096.stdout: "create_time": "2024-04-19T03:01:05.999591+0000", 2024-04-19T03:01:56.600 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-19T03:01:56.600 INFO:teuthology.orchestra.run.smithi096.stdout: "flags_names": "hashpspool", 2024-04-19T03:01:56.601 INFO:teuthology.orchestra.run.smithi096.stdout: "type": 1, 2024-04-19T03:01:56.601 INFO:teuthology.orchestra.run.smithi096.stdout: "size": 2, 2024-04-19T03:01:56.601 INFO:teuthology.orchestra.run.smithi096.stdout: "min_size": 1, 2024-04-19T03:01:56.601 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_rule": 0, 2024-04-19T03:01:56.601 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_count": 0, 2024-04-19T03:01:56.601 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_target": 0, 2024-04-19T03:01:56.601 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_barrier": 0, 2024-04-19T03:01:56.601 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-19T03:01:56.601 INFO:teuthology.orchestra.run.smithi096.stdout: "object_hash": 2, 2024-04-19T03:01:56.601 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_autoscale_mode": "off", 2024-04-19T03:01:56.601 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num": 1, 2024-04-19T03:01:56.601 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_placement_num": 1, 2024-04-19T03:01:56.601 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_placement_num_target": 1, 2024-04-19T03:01:56.602 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num_target": 1, 2024-04-19T03:01:56.602 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num_pending": 1, 2024-04-19T03:01:56.602 INFO:teuthology.orchestra.run.smithi096.stdout: "last_pg_merge_meta": { 2024-04-19T03:01:56.602 INFO:teuthology.orchestra.run.smithi096.stdout: "source_pgid": "0.0", 2024-04-19T03:01:56.602 INFO:teuthology.orchestra.run.smithi096.stdout: "ready_epoch": 0, 2024-04-19T03:01:56.602 INFO:teuthology.orchestra.run.smithi096.stdout: "last_epoch_started": 0, 2024-04-19T03:01:56.602 INFO:teuthology.orchestra.run.smithi096.stdout: "last_epoch_clean": 0, 2024-04-19T03:01:56.602 INFO:teuthology.orchestra.run.smithi096.stdout: "source_version": "0'0", 2024-04-19T03:01:56.602 INFO:teuthology.orchestra.run.smithi096.stdout: "target_version": "0'0" 2024-04-19T03:01:56.602 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-19T03:01:56.602 INFO:teuthology.orchestra.run.smithi096.stdout: "last_change": "14", 2024-04-19T03:01:56.602 INFO:teuthology.orchestra.run.smithi096.stdout: "last_force_op_resend": "0", 2024-04-19T03:01:56.602 INFO:teuthology.orchestra.run.smithi096.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-19T03:01:56.603 INFO:teuthology.orchestra.run.smithi096.stdout: "last_force_op_resend_preluminous": "0", 2024-04-19T03:01:56.603 INFO:teuthology.orchestra.run.smithi096.stdout: "auid": 0, 2024-04-19T03:01:56.603 INFO:teuthology.orchestra.run.smithi096.stdout: "snap_mode": "selfmanaged", 2024-04-19T03:01:56.603 INFO:teuthology.orchestra.run.smithi096.stdout: "snap_seq": 0, 2024-04-19T03:01:56.603 INFO:teuthology.orchestra.run.smithi096.stdout: "snap_epoch": 0, 2024-04-19T03:01:56.603 INFO:teuthology.orchestra.run.smithi096.stdout: "pool_snaps": [], 2024-04-19T03:01:56.603 INFO:teuthology.orchestra.run.smithi096.stdout: "removed_snaps": "[]", 2024-04-19T03:01:56.603 INFO:teuthology.orchestra.run.smithi096.stdout: "quota_max_bytes": 0, 2024-04-19T03:01:56.603 INFO:teuthology.orchestra.run.smithi096.stdout: "quota_max_objects": 0, 2024-04-19T03:01:56.603 INFO:teuthology.orchestra.run.smithi096.stdout: "tiers": [], 2024-04-19T03:01:56.603 INFO:teuthology.orchestra.run.smithi096.stdout: "tier_of": -1, 2024-04-19T03:01:56.603 INFO:teuthology.orchestra.run.smithi096.stdout: "read_tier": -1, 2024-04-19T03:01:56.603 INFO:teuthology.orchestra.run.smithi096.stdout: "write_tier": -1, 2024-04-19T03:01:56.603 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_mode": "none", 2024-04-19T03:01:56.604 INFO:teuthology.orchestra.run.smithi096.stdout: "target_max_bytes": 0, 2024-04-19T03:01:56.604 INFO:teuthology.orchestra.run.smithi096.stdout: "target_max_objects": 0, 2024-04-19T03:01:56.604 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-19T03:01:56.604 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-19T03:01:56.604 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-19T03:01:56.604 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_min_flush_age": 0, 2024-04-19T03:01:56.604 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_min_evict_age": 0, 2024-04-19T03:01:56.604 INFO:teuthology.orchestra.run.smithi096.stdout: "erasure_code_profile": "", 2024-04-19T03:01:56.604 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_params": { 2024-04-19T03:01:56.604 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "none" 2024-04-19T03:01:56.604 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-19T03:01:56.604 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_period": 0, 2024-04-19T03:01:56.604 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_count": 0, 2024-04-19T03:01:56.604 INFO:teuthology.orchestra.run.smithi096.stdout: "use_gmt_hitset": true, 2024-04-19T03:01:56.604 INFO:teuthology.orchestra.run.smithi096.stdout: "min_read_recency_for_promote": 0, 2024-04-19T03:01:56.605 INFO:teuthology.orchestra.run.smithi096.stdout: "min_write_recency_for_promote": 0, 2024-04-19T03:01:56.605 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_grade_decay_rate": 0, 2024-04-19T03:01:56.605 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_search_last_n": 0, 2024-04-19T03:01:56.605 INFO:teuthology.orchestra.run.smithi096.stdout: "grade_table": [], 2024-04-19T03:01:56.605 INFO:teuthology.orchestra.run.smithi096.stdout: "stripe_width": 0, 2024-04-19T03:01:56.605 INFO:teuthology.orchestra.run.smithi096.stdout: "expected_num_objects": 0, 2024-04-19T03:01:56.605 INFO:teuthology.orchestra.run.smithi096.stdout: "fast_read": false, 2024-04-19T03:01:56.605 INFO:teuthology.orchestra.run.smithi096.stdout: "options": { 2024-04-19T03:01:56.605 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num_max": 32, 2024-04-19T03:01:56.605 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num_min": 1 2024-04-19T03:01:56.605 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-19T03:01:56.605 INFO:teuthology.orchestra.run.smithi096.stdout: "application_metadata": { 2024-04-19T03:01:56.605 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": {} 2024-04-19T03:01:56.605 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-19T03:01:56.606 INFO:teuthology.orchestra.run.smithi096.stdout: "read_balance": { 2024-04-19T03:01:56.606 INFO:teuthology.orchestra.run.smithi096.stdout: "score_acting": 2.9900000095367432, 2024-04-19T03:01:56.606 INFO:teuthology.orchestra.run.smithi096.stdout: "score_stable": 2.9900000095367432, 2024-04-19T03:01:56.606 INFO:teuthology.orchestra.run.smithi096.stdout: "optimal_score": 0.67000001668930054, 2024-04-19T03:01:56.606 INFO:teuthology.orchestra.run.smithi096.stdout: "raw_score_acting": 2, 2024-04-19T03:01:56.606 INFO:teuthology.orchestra.run.smithi096.stdout: "raw_score_stable": 2, 2024-04-19T03:01:56.606 INFO:teuthology.orchestra.run.smithi096.stdout: "primary_affinity_weighted": 1, 2024-04-19T03:01:56.606 INFO:teuthology.orchestra.run.smithi096.stdout: "average_primary_affinity": 1, 2024-04-19T03:01:56.606 INFO:teuthology.orchestra.run.smithi096.stdout: "average_primary_affinity_weighted": 1 2024-04-19T03:01:56.606 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-19T03:01:56.606 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-19T03:01:56.606 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-19T03:01:56.607 INFO:teuthology.orchestra.run.smithi096.stdout: "pool": 2, 2024-04-19T03:01:56.607 INFO:teuthology.orchestra.run.smithi096.stdout: "pool_name": "rbd", 2024-04-19T03:01:56.607 INFO:teuthology.orchestra.run.smithi096.stdout: "create_time": "2024-04-19T03:01:09.051757+0000", 2024-04-19T03:01:56.607 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-19T03:01:56.607 INFO:teuthology.orchestra.run.smithi096.stdout: "flags_names": "hashpspool", 2024-04-19T03:01:56.607 INFO:teuthology.orchestra.run.smithi096.stdout: "type": 1, 2024-04-19T03:01:56.607 INFO:teuthology.orchestra.run.smithi096.stdout: "size": 2, 2024-04-19T03:01:56.607 INFO:teuthology.orchestra.run.smithi096.stdout: "min_size": 1, 2024-04-19T03:01:56.607 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_rule": 0, 2024-04-19T03:01:56.607 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_count": 0, 2024-04-19T03:01:56.607 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_target": 0, 2024-04-19T03:01:56.607 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_barrier": 0, 2024-04-19T03:01:56.607 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-19T03:01:56.607 INFO:teuthology.orchestra.run.smithi096.stdout: "object_hash": 2, 2024-04-19T03:01:56.608 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_autoscale_mode": "off", 2024-04-19T03:01:56.608 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num": 8, 2024-04-19T03:01:56.608 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_placement_num": 8, 2024-04-19T03:01:56.608 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_placement_num_target": 8, 2024-04-19T03:01:56.608 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num_target": 8, 2024-04-19T03:01:56.608 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num_pending": 8, 2024-04-19T03:01:56.608 INFO:teuthology.orchestra.run.smithi096.stdout: "last_pg_merge_meta": { 2024-04-19T03:01:56.608 INFO:teuthology.orchestra.run.smithi096.stdout: "source_pgid": "0.0", 2024-04-19T03:01:56.608 INFO:teuthology.orchestra.run.smithi096.stdout: "ready_epoch": 0, 2024-04-19T03:01:56.608 INFO:teuthology.orchestra.run.smithi096.stdout: "last_epoch_started": 0, 2024-04-19T03:01:56.608 INFO:teuthology.orchestra.run.smithi096.stdout: "last_epoch_clean": 0, 2024-04-19T03:01:56.608 INFO:teuthology.orchestra.run.smithi096.stdout: "source_version": "0'0", 2024-04-19T03:01:56.608 INFO:teuthology.orchestra.run.smithi096.stdout: "target_version": "0'0" 2024-04-19T03:01:56.609 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-19T03:01:56.609 INFO:teuthology.orchestra.run.smithi096.stdout: "last_change": "17", 2024-04-19T03:01:56.609 INFO:teuthology.orchestra.run.smithi096.stdout: "last_force_op_resend": "0", 2024-04-19T03:01:56.609 INFO:teuthology.orchestra.run.smithi096.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-19T03:01:56.609 INFO:teuthology.orchestra.run.smithi096.stdout: "last_force_op_resend_preluminous": "0", 2024-04-19T03:01:56.609 INFO:teuthology.orchestra.run.smithi096.stdout: "auid": 0, 2024-04-19T03:01:56.609 INFO:teuthology.orchestra.run.smithi096.stdout: "snap_mode": "selfmanaged", 2024-04-19T03:01:56.609 INFO:teuthology.orchestra.run.smithi096.stdout: "snap_seq": 0, 2024-04-19T03:01:56.609 INFO:teuthology.orchestra.run.smithi096.stdout: "snap_epoch": 0, 2024-04-19T03:01:56.609 INFO:teuthology.orchestra.run.smithi096.stdout: "pool_snaps": [], 2024-04-19T03:01:56.609 INFO:teuthology.orchestra.run.smithi096.stdout: "removed_snaps": "[]", 2024-04-19T03:01:56.610 INFO:teuthology.orchestra.run.smithi096.stdout: "quota_max_bytes": 0, 2024-04-19T03:01:56.610 INFO:teuthology.orchestra.run.smithi096.stdout: "quota_max_objects": 0, 2024-04-19T03:01:56.610 INFO:teuthology.orchestra.run.smithi096.stdout: "tiers": [], 2024-04-19T03:01:56.610 INFO:teuthology.orchestra.run.smithi096.stdout: "tier_of": -1, 2024-04-19T03:01:56.610 INFO:teuthology.orchestra.run.smithi096.stdout: "read_tier": -1, 2024-04-19T03:01:56.610 INFO:teuthology.orchestra.run.smithi096.stdout: "write_tier": -1, 2024-04-19T03:01:56.610 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_mode": "none", 2024-04-19T03:01:56.610 INFO:teuthology.orchestra.run.smithi096.stdout: "target_max_bytes": 0, 2024-04-19T03:01:56.610 INFO:teuthology.orchestra.run.smithi096.stdout: "target_max_objects": 0, 2024-04-19T03:01:56.610 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-19T03:01:56.610 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-19T03:01:56.610 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-19T03:01:56.610 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_min_flush_age": 0, 2024-04-19T03:01:56.611 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_min_evict_age": 0, 2024-04-19T03:01:56.611 INFO:teuthology.orchestra.run.smithi096.stdout: "erasure_code_profile": "", 2024-04-19T03:01:56.611 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_params": { 2024-04-19T03:01:56.611 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "none" 2024-04-19T03:01:56.611 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-19T03:01:56.611 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_period": 0, 2024-04-19T03:01:56.611 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_count": 0, 2024-04-19T03:01:56.611 INFO:teuthology.orchestra.run.smithi096.stdout: "use_gmt_hitset": true, 2024-04-19T03:01:56.611 INFO:teuthology.orchestra.run.smithi096.stdout: "min_read_recency_for_promote": 0, 2024-04-19T03:01:56.611 INFO:teuthology.orchestra.run.smithi096.stdout: "min_write_recency_for_promote": 0, 2024-04-19T03:01:56.611 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_grade_decay_rate": 0, 2024-04-19T03:01:56.611 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_search_last_n": 0, 2024-04-19T03:01:56.611 INFO:teuthology.orchestra.run.smithi096.stdout: "grade_table": [], 2024-04-19T03:01:56.611 INFO:teuthology.orchestra.run.smithi096.stdout: "stripe_width": 0, 2024-04-19T03:01:56.611 INFO:teuthology.orchestra.run.smithi096.stdout: "expected_num_objects": 0, 2024-04-19T03:01:56.612 INFO:teuthology.orchestra.run.smithi096.stdout: "fast_read": false, 2024-04-19T03:01:56.612 INFO:teuthology.orchestra.run.smithi096.stdout: "options": {}, 2024-04-19T03:01:56.612 INFO:teuthology.orchestra.run.smithi096.stdout: "application_metadata": { 2024-04-19T03:01:56.612 INFO:teuthology.orchestra.run.smithi096.stdout: "rbd": {} 2024-04-19T03:01:56.612 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-19T03:01:56.612 INFO:teuthology.orchestra.run.smithi096.stdout: "read_balance": { 2024-04-19T03:01:56.612 INFO:teuthology.orchestra.run.smithi096.stdout: "score_acting": 1.5, 2024-04-19T03:01:56.612 INFO:teuthology.orchestra.run.smithi096.stdout: "score_stable": 1.5, 2024-04-19T03:01:56.612 INFO:teuthology.orchestra.run.smithi096.stdout: "optimal_score": 1, 2024-04-19T03:01:56.612 INFO:teuthology.orchestra.run.smithi096.stdout: "raw_score_acting": 1.5, 2024-04-19T03:01:56.612 INFO:teuthology.orchestra.run.smithi096.stdout: "raw_score_stable": 1.5, 2024-04-19T03:01:56.612 INFO:teuthology.orchestra.run.smithi096.stdout: "primary_affinity_weighted": 1, 2024-04-19T03:01:56.612 INFO:teuthology.orchestra.run.smithi096.stdout: "average_primary_affinity": 1, 2024-04-19T03:01:56.612 INFO:teuthology.orchestra.run.smithi096.stdout: "average_primary_affinity_weighted": 1 2024-04-19T03:01:56.613 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-19T03:01:56.613 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-19T03:01:56.613 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-19T03:01:56.613 INFO:teuthology.orchestra.run.smithi096.stdout: "pool": 3, 2024-04-19T03:01:56.613 INFO:teuthology.orchestra.run.smithi096.stdout: "pool_name": "cephfs_metadata", 2024-04-19T03:01:56.613 INFO:teuthology.orchestra.run.smithi096.stdout: "create_time": "2024-04-19T03:01:13.479163+0000", 2024-04-19T03:01:56.613 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-19T03:01:56.613 INFO:teuthology.orchestra.run.smithi096.stdout: "flags_names": "hashpspool", 2024-04-19T03:01:56.613 INFO:teuthology.orchestra.run.smithi096.stdout: "type": 1, 2024-04-19T03:01:56.613 INFO:teuthology.orchestra.run.smithi096.stdout: "size": 2, 2024-04-19T03:01:56.613 INFO:teuthology.orchestra.run.smithi096.stdout: "min_size": 1, 2024-04-19T03:01:56.613 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_rule": 0, 2024-04-19T03:01:56.613 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_count": 0, 2024-04-19T03:01:56.613 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_target": 0, 2024-04-19T03:01:56.614 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_barrier": 0, 2024-04-19T03:01:56.614 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-19T03:01:56.614 INFO:teuthology.orchestra.run.smithi096.stdout: "object_hash": 2, 2024-04-19T03:01:56.614 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_autoscale_mode": "off", 2024-04-19T03:01:56.614 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num": 32, 2024-04-19T03:01:56.614 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_placement_num": 32, 2024-04-19T03:01:56.614 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_placement_num_target": 32, 2024-04-19T03:01:56.614 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num_target": 32, 2024-04-19T03:01:56.614 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num_pending": 32, 2024-04-19T03:01:56.614 INFO:teuthology.orchestra.run.smithi096.stdout: "last_pg_merge_meta": { 2024-04-19T03:01:56.614 INFO:teuthology.orchestra.run.smithi096.stdout: "source_pgid": "0.0", 2024-04-19T03:01:56.614 INFO:teuthology.orchestra.run.smithi096.stdout: "ready_epoch": 0, 2024-04-19T03:01:56.614 INFO:teuthology.orchestra.run.smithi096.stdout: "last_epoch_started": 0, 2024-04-19T03:01:56.614 INFO:teuthology.orchestra.run.smithi096.stdout: "last_epoch_clean": 0, 2024-04-19T03:01:56.615 INFO:teuthology.orchestra.run.smithi096.stdout: "source_version": "0'0", 2024-04-19T03:01:56.615 INFO:teuthology.orchestra.run.smithi096.stdout: "target_version": "0'0" 2024-04-19T03:01:56.615 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-19T03:01:56.615 INFO:teuthology.orchestra.run.smithi096.stdout: "last_change": "20", 2024-04-19T03:01:56.615 INFO:teuthology.orchestra.run.smithi096.stdout: "last_force_op_resend": "0", 2024-04-19T03:01:56.615 INFO:teuthology.orchestra.run.smithi096.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-19T03:01:56.615 INFO:teuthology.orchestra.run.smithi096.stdout: "last_force_op_resend_preluminous": "0", 2024-04-19T03:01:56.615 INFO:teuthology.orchestra.run.smithi096.stdout: "auid": 0, 2024-04-19T03:01:56.615 INFO:teuthology.orchestra.run.smithi096.stdout: "snap_mode": "selfmanaged", 2024-04-19T03:01:56.615 INFO:teuthology.orchestra.run.smithi096.stdout: "snap_seq": 0, 2024-04-19T03:01:56.615 INFO:teuthology.orchestra.run.smithi096.stdout: "snap_epoch": 0, 2024-04-19T03:01:56.615 INFO:teuthology.orchestra.run.smithi096.stdout: "pool_snaps": [], 2024-04-19T03:01:56.615 INFO:teuthology.orchestra.run.smithi096.stdout: "removed_snaps": "[]", 2024-04-19T03:01:56.616 INFO:teuthology.orchestra.run.smithi096.stdout: "quota_max_bytes": 0, 2024-04-19T03:01:56.616 INFO:teuthology.orchestra.run.smithi096.stdout: "quota_max_objects": 0, 2024-04-19T03:01:56.616 INFO:teuthology.orchestra.run.smithi096.stdout: "tiers": [], 2024-04-19T03:01:56.616 INFO:teuthology.orchestra.run.smithi096.stdout: "tier_of": -1, 2024-04-19T03:01:56.616 INFO:teuthology.orchestra.run.smithi096.stdout: "read_tier": -1, 2024-04-19T03:01:56.616 INFO:teuthology.orchestra.run.smithi096.stdout: "write_tier": -1, 2024-04-19T03:01:56.616 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_mode": "none", 2024-04-19T03:01:56.616 INFO:teuthology.orchestra.run.smithi096.stdout: "target_max_bytes": 0, 2024-04-19T03:01:56.616 INFO:teuthology.orchestra.run.smithi096.stdout: "target_max_objects": 0, 2024-04-19T03:01:56.616 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-19T03:01:56.616 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-19T03:01:56.616 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-19T03:01:56.616 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_min_flush_age": 0, 2024-04-19T03:01:56.616 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_min_evict_age": 0, 2024-04-19T03:01:56.617 INFO:teuthology.orchestra.run.smithi096.stdout: "erasure_code_profile": "", 2024-04-19T03:01:56.617 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_params": { 2024-04-19T03:01:56.617 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "none" 2024-04-19T03:01:56.617 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-19T03:01:56.617 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_period": 0, 2024-04-19T03:01:56.617 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_count": 0, 2024-04-19T03:01:56.617 INFO:teuthology.orchestra.run.smithi096.stdout: "use_gmt_hitset": true, 2024-04-19T03:01:56.617 INFO:teuthology.orchestra.run.smithi096.stdout: "min_read_recency_for_promote": 0, 2024-04-19T03:01:56.617 INFO:teuthology.orchestra.run.smithi096.stdout: "min_write_recency_for_promote": 0, 2024-04-19T03:01:56.617 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_grade_decay_rate": 0, 2024-04-19T03:01:56.617 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_search_last_n": 0, 2024-04-19T03:01:56.617 INFO:teuthology.orchestra.run.smithi096.stdout: "grade_table": [], 2024-04-19T03:01:56.617 INFO:teuthology.orchestra.run.smithi096.stdout: "stripe_width": 0, 2024-04-19T03:01:56.618 INFO:teuthology.orchestra.run.smithi096.stdout: "expected_num_objects": 0, 2024-04-19T03:01:56.618 INFO:teuthology.orchestra.run.smithi096.stdout: "fast_read": false, 2024-04-19T03:01:56.618 INFO:teuthology.orchestra.run.smithi096.stdout: "options": { 2024-04-19T03:01:56.618 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_autoscale_bias": 4, 2024-04-19T03:01:56.618 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num_min": 16, 2024-04-19T03:01:56.618 INFO:teuthology.orchestra.run.smithi096.stdout: "recovery_priority": 5 2024-04-19T03:01:56.618 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-19T03:01:56.618 INFO:teuthology.orchestra.run.smithi096.stdout: "application_metadata": { 2024-04-19T03:01:56.618 INFO:teuthology.orchestra.run.smithi096.stdout: "cephfs": { 2024-04-19T03:01:56.618 INFO:teuthology.orchestra.run.smithi096.stdout: "metadata": "cephfs" 2024-04-19T03:01:56.618 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-19T03:01:56.618 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-19T03:01:56.618 INFO:teuthology.orchestra.run.smithi096.stdout: "read_balance": { 2024-04-19T03:01:56.618 INFO:teuthology.orchestra.run.smithi096.stdout: "score_acting": 1.1299999952316284, 2024-04-19T03:01:56.619 INFO:teuthology.orchestra.run.smithi096.stdout: "score_stable": 1.1299999952316284, 2024-04-19T03:01:56.619 INFO:teuthology.orchestra.run.smithi096.stdout: "optimal_score": 1, 2024-04-19T03:01:56.619 INFO:teuthology.orchestra.run.smithi096.stdout: "raw_score_acting": 1.1299999952316284, 2024-04-19T03:01:56.619 INFO:teuthology.orchestra.run.smithi096.stdout: "raw_score_stable": 1.1299999952316284, 2024-04-19T03:01:56.619 INFO:teuthology.orchestra.run.smithi096.stdout: "primary_affinity_weighted": 1, 2024-04-19T03:01:56.619 INFO:teuthology.orchestra.run.smithi096.stdout: "average_primary_affinity": 1, 2024-04-19T03:01:56.619 INFO:teuthology.orchestra.run.smithi096.stdout: "average_primary_affinity_weighted": 1 2024-04-19T03:01:56.619 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-19T03:01:56.619 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-19T03:01:56.619 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-19T03:01:56.619 INFO:teuthology.orchestra.run.smithi096.stdout: "pool": 4, 2024-04-19T03:01:56.619 INFO:teuthology.orchestra.run.smithi096.stdout: "pool_name": "cephfs_data", 2024-04-19T03:01:56.619 INFO:teuthology.orchestra.run.smithi096.stdout: "create_time": "2024-04-19T03:01:13.992441+0000", 2024-04-19T03:01:56.619 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-19T03:01:56.620 INFO:teuthology.orchestra.run.smithi096.stdout: "flags_names": "hashpspool", 2024-04-19T03:01:56.620 INFO:teuthology.orchestra.run.smithi096.stdout: "type": 1, 2024-04-19T03:01:56.620 INFO:teuthology.orchestra.run.smithi096.stdout: "size": 2, 2024-04-19T03:01:56.620 INFO:teuthology.orchestra.run.smithi096.stdout: "min_size": 1, 2024-04-19T03:01:56.620 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_rule": 0, 2024-04-19T03:01:56.620 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_count": 0, 2024-04-19T03:01:56.620 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_target": 0, 2024-04-19T03:01:56.620 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_barrier": 0, 2024-04-19T03:01:56.620 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-19T03:01:56.620 INFO:teuthology.orchestra.run.smithi096.stdout: "object_hash": 2, 2024-04-19T03:01:56.620 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_autoscale_mode": "off", 2024-04-19T03:01:56.620 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num": 64, 2024-04-19T03:01:56.620 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_placement_num": 64, 2024-04-19T03:01:56.620 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_placement_num_target": 64, 2024-04-19T03:01:56.621 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num_target": 64, 2024-04-19T03:01:56.621 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num_pending": 64, 2024-04-19T03:01:56.621 INFO:teuthology.orchestra.run.smithi096.stdout: "last_pg_merge_meta": { 2024-04-19T03:01:56.621 INFO:teuthology.orchestra.run.smithi096.stdout: "source_pgid": "0.0", 2024-04-19T03:01:56.621 INFO:teuthology.orchestra.run.smithi096.stdout: "ready_epoch": 0, 2024-04-19T03:01:56.621 INFO:teuthology.orchestra.run.smithi096.stdout: "last_epoch_started": 0, 2024-04-19T03:01:56.621 INFO:teuthology.orchestra.run.smithi096.stdout: "last_epoch_clean": 0, 2024-04-19T03:01:56.621 INFO:teuthology.orchestra.run.smithi096.stdout: "source_version": "0'0", 2024-04-19T03:01:56.621 INFO:teuthology.orchestra.run.smithi096.stdout: "target_version": "0'0" 2024-04-19T03:01:56.621 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-19T03:01:56.621 INFO:teuthology.orchestra.run.smithi096.stdout: "last_change": "21", 2024-04-19T03:01:56.621 INFO:teuthology.orchestra.run.smithi096.stdout: "last_force_op_resend": "0", 2024-04-19T03:01:56.621 INFO:teuthology.orchestra.run.smithi096.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-19T03:01:56.621 INFO:teuthology.orchestra.run.smithi096.stdout: "last_force_op_resend_preluminous": "0", 2024-04-19T03:01:56.622 INFO:teuthology.orchestra.run.smithi096.stdout: "auid": 0, 2024-04-19T03:01:56.622 INFO:teuthology.orchestra.run.smithi096.stdout: "snap_mode": "selfmanaged", 2024-04-19T03:01:56.622 INFO:teuthology.orchestra.run.smithi096.stdout: "snap_seq": 0, 2024-04-19T03:01:56.622 INFO:teuthology.orchestra.run.smithi096.stdout: "snap_epoch": 0, 2024-04-19T03:01:56.622 INFO:teuthology.orchestra.run.smithi096.stdout: "pool_snaps": [], 2024-04-19T03:01:56.622 INFO:teuthology.orchestra.run.smithi096.stdout: "removed_snaps": "[]", 2024-04-19T03:01:56.622 INFO:teuthology.orchestra.run.smithi096.stdout: "quota_max_bytes": 0, 2024-04-19T03:01:56.622 INFO:teuthology.orchestra.run.smithi096.stdout: "quota_max_objects": 0, 2024-04-19T03:01:56.622 INFO:teuthology.orchestra.run.smithi096.stdout: "tiers": [], 2024-04-19T03:01:56.622 INFO:teuthology.orchestra.run.smithi096.stdout: "tier_of": -1, 2024-04-19T03:01:56.622 INFO:teuthology.orchestra.run.smithi096.stdout: "read_tier": -1, 2024-04-19T03:01:56.622 INFO:teuthology.orchestra.run.smithi096.stdout: "write_tier": -1, 2024-04-19T03:01:56.622 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_mode": "none", 2024-04-19T03:01:56.623 INFO:teuthology.orchestra.run.smithi096.stdout: "target_max_bytes": 0, 2024-04-19T03:01:56.623 INFO:teuthology.orchestra.run.smithi096.stdout: "target_max_objects": 0, 2024-04-19T03:01:56.623 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-19T03:01:56.623 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-19T03:01:56.623 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-19T03:01:56.623 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_min_flush_age": 0, 2024-04-19T03:01:56.623 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_min_evict_age": 0, 2024-04-19T03:01:56.623 INFO:teuthology.orchestra.run.smithi096.stdout: "erasure_code_profile": "", 2024-04-19T03:01:56.623 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_params": { 2024-04-19T03:01:56.623 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "none" 2024-04-19T03:01:56.623 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-19T03:01:56.623 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_period": 0, 2024-04-19T03:01:56.623 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_count": 0, 2024-04-19T03:01:56.623 INFO:teuthology.orchestra.run.smithi096.stdout: "use_gmt_hitset": true, 2024-04-19T03:01:56.624 INFO:teuthology.orchestra.run.smithi096.stdout: "min_read_recency_for_promote": 0, 2024-04-19T03:01:56.624 INFO:teuthology.orchestra.run.smithi096.stdout: "min_write_recency_for_promote": 0, 2024-04-19T03:01:56.624 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_grade_decay_rate": 0, 2024-04-19T03:01:56.624 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_search_last_n": 0, 2024-04-19T03:01:56.624 INFO:teuthology.orchestra.run.smithi096.stdout: "grade_table": [], 2024-04-19T03:01:56.624 INFO:teuthology.orchestra.run.smithi096.stdout: "stripe_width": 0, 2024-04-19T03:01:56.624 INFO:teuthology.orchestra.run.smithi096.stdout: "expected_num_objects": 0, 2024-04-19T03:01:56.624 INFO:teuthology.orchestra.run.smithi096.stdout: "fast_read": false, 2024-04-19T03:01:56.624 INFO:teuthology.orchestra.run.smithi096.stdout: "options": { 2024-04-19T03:01:56.624 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num_min": 64, 2024-04-19T03:01:56.624 INFO:teuthology.orchestra.run.smithi096.stdout: "target_size_ratio": 0.89999997615814209 2024-04-19T03:01:56.624 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-19T03:01:56.624 INFO:teuthology.orchestra.run.smithi096.stdout: "application_metadata": { 2024-04-19T03:01:56.624 INFO:teuthology.orchestra.run.smithi096.stdout: "cephfs": { 2024-04-19T03:01:56.625 INFO:teuthology.orchestra.run.smithi096.stdout: "data": "cephfs" 2024-04-19T03:01:56.625 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-19T03:01:56.625 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-19T03:01:56.625 INFO:teuthology.orchestra.run.smithi096.stdout: "read_balance": { 2024-04-19T03:01:56.625 INFO:teuthology.orchestra.run.smithi096.stdout: "score_acting": 1.1299999952316284, 2024-04-19T03:01:56.625 INFO:teuthology.orchestra.run.smithi096.stdout: "score_stable": 1.1299999952316284, 2024-04-19T03:01:56.625 INFO:teuthology.orchestra.run.smithi096.stdout: "optimal_score": 1, 2024-04-19T03:01:56.625 INFO:teuthology.orchestra.run.smithi096.stdout: "raw_score_acting": 1.1299999952316284, 2024-04-19T03:01:56.625 INFO:teuthology.orchestra.run.smithi096.stdout: "raw_score_stable": 1.1299999952316284, 2024-04-19T03:01:56.625 INFO:teuthology.orchestra.run.smithi096.stdout: "primary_affinity_weighted": 1, 2024-04-19T03:01:56.625 INFO:teuthology.orchestra.run.smithi096.stdout: "average_primary_affinity": 1, 2024-04-19T03:01:56.625 INFO:teuthology.orchestra.run.smithi096.stdout: "average_primary_affinity_weighted": 1 2024-04-19T03:01:56.625 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-19T03:01:56.626 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-19T03:01:56.626 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-19T03:01:56.626 INFO:teuthology.orchestra.run.smithi096.stdout: "pool": 5, 2024-04-19T03:01:56.626 INFO:teuthology.orchestra.run.smithi096.stdout: "pool_name": "unique_pool_0", 2024-04-19T03:01:56.626 INFO:teuthology.orchestra.run.smithi096.stdout: "create_time": "2024-04-19T03:01:35.396306+0000", 2024-04-19T03:01:56.626 INFO:teuthology.orchestra.run.smithi096.stdout: "flags": 1, 2024-04-19T03:01:56.626 INFO:teuthology.orchestra.run.smithi096.stdout: "flags_names": "hashpspool", 2024-04-19T03:01:56.626 INFO:teuthology.orchestra.run.smithi096.stdout: "type": 1, 2024-04-19T03:01:56.626 INFO:teuthology.orchestra.run.smithi096.stdout: "size": 2, 2024-04-19T03:01:56.626 INFO:teuthology.orchestra.run.smithi096.stdout: "min_size": 1, 2024-04-19T03:01:56.626 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_rule": 0, 2024-04-19T03:01:56.626 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_count": 0, 2024-04-19T03:01:56.626 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_target": 0, 2024-04-19T03:01:56.626 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_barrier": 0, 2024-04-19T03:01:56.627 INFO:teuthology.orchestra.run.smithi096.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-19T03:01:56.627 INFO:teuthology.orchestra.run.smithi096.stdout: "object_hash": 2, 2024-04-19T03:01:56.627 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_autoscale_mode": "off", 2024-04-19T03:01:56.627 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num": 16, 2024-04-19T03:01:56.627 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_placement_num": 16, 2024-04-19T03:01:56.627 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_placement_num_target": 16, 2024-04-19T03:01:56.627 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num_target": 16, 2024-04-19T03:01:56.627 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_num_pending": 16, 2024-04-19T03:01:56.627 INFO:teuthology.orchestra.run.smithi096.stdout: "last_pg_merge_meta": { 2024-04-19T03:01:56.627 INFO:teuthology.orchestra.run.smithi096.stdout: "source_pgid": "0.0", 2024-04-19T03:01:56.627 INFO:teuthology.orchestra.run.smithi096.stdout: "ready_epoch": 0, 2024-04-19T03:01:56.627 INFO:teuthology.orchestra.run.smithi096.stdout: "last_epoch_started": 0, 2024-04-19T03:01:56.627 INFO:teuthology.orchestra.run.smithi096.stdout: "last_epoch_clean": 0, 2024-04-19T03:01:56.627 INFO:teuthology.orchestra.run.smithi096.stdout: "source_version": "0'0", 2024-04-19T03:01:56.628 INFO:teuthology.orchestra.run.smithi096.stdout: "target_version": "0'0" 2024-04-19T03:01:56.628 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-19T03:01:56.628 INFO:teuthology.orchestra.run.smithi096.stdout: "last_change": "24", 2024-04-19T03:01:56.628 INFO:teuthology.orchestra.run.smithi096.stdout: "last_force_op_resend": "0", 2024-04-19T03:01:56.628 INFO:teuthology.orchestra.run.smithi096.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-19T03:01:56.628 INFO:teuthology.orchestra.run.smithi096.stdout: "last_force_op_resend_preluminous": "0", 2024-04-19T03:01:56.628 INFO:teuthology.orchestra.run.smithi096.stdout: "auid": 0, 2024-04-19T03:01:56.628 INFO:teuthology.orchestra.run.smithi096.stdout: "snap_mode": "selfmanaged", 2024-04-19T03:01:56.628 INFO:teuthology.orchestra.run.smithi096.stdout: "snap_seq": 0, 2024-04-19T03:01:56.628 INFO:teuthology.orchestra.run.smithi096.stdout: "snap_epoch": 0, 2024-04-19T03:01:56.628 INFO:teuthology.orchestra.run.smithi096.stdout: "pool_snaps": [], 2024-04-19T03:01:56.628 INFO:teuthology.orchestra.run.smithi096.stdout: "removed_snaps": "[]", 2024-04-19T03:01:56.628 INFO:teuthology.orchestra.run.smithi096.stdout: "quota_max_bytes": 0, 2024-04-19T03:01:56.628 INFO:teuthology.orchestra.run.smithi096.stdout: "quota_max_objects": 0, 2024-04-19T03:01:56.629 INFO:teuthology.orchestra.run.smithi096.stdout: "tiers": [], 2024-04-19T03:01:56.629 INFO:teuthology.orchestra.run.smithi096.stdout: "tier_of": -1, 2024-04-19T03:01:56.629 INFO:teuthology.orchestra.run.smithi096.stdout: "read_tier": -1, 2024-04-19T03:01:56.629 INFO:teuthology.orchestra.run.smithi096.stdout: "write_tier": -1, 2024-04-19T03:01:56.629 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_mode": "none", 2024-04-19T03:01:56.629 INFO:teuthology.orchestra.run.smithi096.stdout: "target_max_bytes": 0, 2024-04-19T03:01:56.629 INFO:teuthology.orchestra.run.smithi096.stdout: "target_max_objects": 0, 2024-04-19T03:01:56.629 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-19T03:01:56.629 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-19T03:01:56.629 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-19T03:01:56.629 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_min_flush_age": 0, 2024-04-19T03:01:56.629 INFO:teuthology.orchestra.run.smithi096.stdout: "cache_min_evict_age": 0, 2024-04-19T03:01:56.629 INFO:teuthology.orchestra.run.smithi096.stdout: "erasure_code_profile": "", 2024-04-19T03:01:56.629 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_params": { 2024-04-19T03:01:56.630 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "none" 2024-04-19T03:01:56.630 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-19T03:01:56.630 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_period": 0, 2024-04-19T03:01:56.630 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_count": 0, 2024-04-19T03:01:56.630 INFO:teuthology.orchestra.run.smithi096.stdout: "use_gmt_hitset": true, 2024-04-19T03:01:56.630 INFO:teuthology.orchestra.run.smithi096.stdout: "min_read_recency_for_promote": 0, 2024-04-19T03:01:56.630 INFO:teuthology.orchestra.run.smithi096.stdout: "min_write_recency_for_promote": 0, 2024-04-19T03:01:56.630 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_grade_decay_rate": 0, 2024-04-19T03:01:56.630 INFO:teuthology.orchestra.run.smithi096.stdout: "hit_set_search_last_n": 0, 2024-04-19T03:01:56.630 INFO:teuthology.orchestra.run.smithi096.stdout: "grade_table": [], 2024-04-19T03:01:56.630 INFO:teuthology.orchestra.run.smithi096.stdout: "stripe_width": 0, 2024-04-19T03:01:56.630 INFO:teuthology.orchestra.run.smithi096.stdout: "expected_num_objects": 0, 2024-04-19T03:01:56.630 INFO:teuthology.orchestra.run.smithi096.stdout: "fast_read": false, 2024-04-19T03:01:56.630 INFO:teuthology.orchestra.run.smithi096.stdout: "options": {}, 2024-04-19T03:01:56.631 INFO:teuthology.orchestra.run.smithi096.stdout: "application_metadata": { 2024-04-19T03:01:56.631 INFO:teuthology.orchestra.run.smithi096.stdout: "rados": {} 2024-04-19T03:01:56.631 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-19T03:01:56.631 INFO:teuthology.orchestra.run.smithi096.stdout: "read_balance": { 2024-04-19T03:01:56.631 INFO:teuthology.orchestra.run.smithi096.stdout: "score_acting": 1.1299999952316284, 2024-04-19T03:01:56.631 INFO:teuthology.orchestra.run.smithi096.stdout: "score_stable": 1.1299999952316284, 2024-04-19T03:01:56.631 INFO:teuthology.orchestra.run.smithi096.stdout: "optimal_score": 1, 2024-04-19T03:01:56.631 INFO:teuthology.orchestra.run.smithi096.stdout: "raw_score_acting": 1.1299999952316284, 2024-04-19T03:01:56.631 INFO:teuthology.orchestra.run.smithi096.stdout: "raw_score_stable": 1.1299999952316284, 2024-04-19T03:01:56.631 INFO:teuthology.orchestra.run.smithi096.stdout: "primary_affinity_weighted": 1, 2024-04-19T03:01:56.631 INFO:teuthology.orchestra.run.smithi096.stdout: "average_primary_affinity": 1, 2024-04-19T03:01:56.631 INFO:teuthology.orchestra.run.smithi096.stdout: "average_primary_affinity_weighted": 1 2024-04-19T03:01:56.631 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-19T03:01:56.631 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-19T03:01:56.632 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-19T03:01:56.632 INFO:teuthology.orchestra.run.smithi096.stdout: "osds": [ 2024-04-19T03:01:56.632 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-19T03:01:56.632 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": 0, 2024-04-19T03:01:56.632 INFO:teuthology.orchestra.run.smithi096.stdout: "uuid": "05ecb884-2c30-44f7-aa14-90154f9bbe9a", 2024-04-19T03:01:56.632 INFO:teuthology.orchestra.run.smithi096.stdout: "up": 1, 2024-04-19T03:01:56.632 INFO:teuthology.orchestra.run.smithi096.stdout: "in": 1, 2024-04-19T03:01:56.632 INFO:teuthology.orchestra.run.smithi096.stdout: "weight": 1, 2024-04-19T03:01:56.632 INFO:teuthology.orchestra.run.smithi096.stdout: "primary_affinity": 1, 2024-04-19T03:01:56.632 INFO:teuthology.orchestra.run.smithi096.stdout: "last_clean_begin": 0, 2024-04-19T03:01:56.632 INFO:teuthology.orchestra.run.smithi096.stdout: "last_clean_end": 0, 2024-04-19T03:01:56.632 INFO:teuthology.orchestra.run.smithi096.stdout: "up_from": 9, 2024-04-19T03:01:56.632 INFO:teuthology.orchestra.run.smithi096.stdout: "up_thru": 22, 2024-04-19T03:01:56.632 INFO:teuthology.orchestra.run.smithi096.stdout: "down_at": 0, 2024-04-19T03:01:56.633 INFO:teuthology.orchestra.run.smithi096.stdout: "lost_at": 0, 2024-04-19T03:01:56.633 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addrs": { 2024-04-19T03:01:56.633 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-19T03:01:56.633 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-19T03:01:56.633 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-19T03:01:56.633 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.97:6800", 2024-04-19T03:01:56.633 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 18245 2024-04-19T03:01:56.633 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-19T03:01:56.633 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-19T03:01:56.633 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-19T03:01:56.633 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.97:6801", 2024-04-19T03:01:56.633 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 18245 2024-04-19T03:01:56.633 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-19T03:01:56.633 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-19T03:01:56.634 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-19T03:01:56.634 INFO:teuthology.orchestra.run.smithi096.stdout: "cluster_addrs": { 2024-04-19T03:01:56.634 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-19T03:01:56.634 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-19T03:01:56.634 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-19T03:01:56.634 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.97:6802", 2024-04-19T03:01:56.634 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 18245 2024-04-19T03:01:56.634 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-19T03:01:56.634 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-19T03:01:56.634 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-19T03:01:56.634 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.97:6803", 2024-04-19T03:01:56.634 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 18245 2024-04-19T03:01:56.634 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-19T03:01:56.635 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-19T03:01:56.635 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-19T03:01:56.635 INFO:teuthology.orchestra.run.smithi096.stdout: "heartbeat_back_addrs": { 2024-04-19T03:01:56.635 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-19T03:01:56.635 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-19T03:01:56.635 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-19T03:01:56.635 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.97:6806", 2024-04-19T03:01:56.635 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 18245 2024-04-19T03:01:56.635 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-19T03:01:56.635 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-19T03:01:56.635 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-19T03:01:56.635 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.97:6807", 2024-04-19T03:01:56.635 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 18245 2024-04-19T03:01:56.635 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-19T03:01:56.636 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-19T03:01:56.636 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-19T03:01:56.636 INFO:teuthology.orchestra.run.smithi096.stdout: "heartbeat_front_addrs": { 2024-04-19T03:01:56.636 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-19T03:01:56.636 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-19T03:01:56.636 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-19T03:01:56.636 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.97:6804", 2024-04-19T03:01:56.636 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 18245 2024-04-19T03:01:56.636 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-19T03:01:56.636 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-19T03:01:56.636 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-19T03:01:56.636 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.97:6805", 2024-04-19T03:01:56.636 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 18245 2024-04-19T03:01:56.636 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-19T03:01:56.637 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-19T03:01:56.637 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-19T03:01:56.637 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addr": "172.21.15.97:6801/18245", 2024-04-19T03:01:56.637 INFO:teuthology.orchestra.run.smithi096.stdout: "cluster_addr": "172.21.15.97:6803/18245", 2024-04-19T03:01:56.637 INFO:teuthology.orchestra.run.smithi096.stdout: "heartbeat_back_addr": "172.21.15.97:6807/18245", 2024-04-19T03:01:56.637 INFO:teuthology.orchestra.run.smithi096.stdout: "heartbeat_front_addr": "172.21.15.97:6805/18245", 2024-04-19T03:01:56.637 INFO:teuthology.orchestra.run.smithi096.stdout: "state": [ 2024-04-19T03:01:56.637 INFO:teuthology.orchestra.run.smithi096.stdout: "exists", 2024-04-19T03:01:56.637 INFO:teuthology.orchestra.run.smithi096.stdout: "up" 2024-04-19T03:01:56.637 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-19T03:01:56.637 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-19T03:01:56.637 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-19T03:01:56.637 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": 1, 2024-04-19T03:01:56.637 INFO:teuthology.orchestra.run.smithi096.stdout: "uuid": "efc873e0-69c3-4a57-8ee5-41f836b65f47", 2024-04-19T03:01:56.638 INFO:teuthology.orchestra.run.smithi096.stdout: "up": 1, 2024-04-19T03:01:56.638 INFO:teuthology.orchestra.run.smithi096.stdout: "in": 1, 2024-04-19T03:01:56.638 INFO:teuthology.orchestra.run.smithi096.stdout: "weight": 1, 2024-04-19T03:01:56.638 INFO:teuthology.orchestra.run.smithi096.stdout: "primary_affinity": 1, 2024-04-19T03:01:56.638 INFO:teuthology.orchestra.run.smithi096.stdout: "last_clean_begin": 0, 2024-04-19T03:01:56.638 INFO:teuthology.orchestra.run.smithi096.stdout: "last_clean_end": 0, 2024-04-19T03:01:56.638 INFO:teuthology.orchestra.run.smithi096.stdout: "up_from": 10, 2024-04-19T03:01:56.638 INFO:teuthology.orchestra.run.smithi096.stdout: "up_thru": 22, 2024-04-19T03:01:56.638 INFO:teuthology.orchestra.run.smithi096.stdout: "down_at": 0, 2024-04-19T03:01:56.638 INFO:teuthology.orchestra.run.smithi096.stdout: "lost_at": 0, 2024-04-19T03:01:56.638 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addrs": { 2024-04-19T03:01:56.638 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-19T03:01:56.638 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-19T03:01:56.639 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-19T03:01:56.639 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.134:6800", 2024-04-19T03:01:56.639 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 18145 2024-04-19T03:01:56.639 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-19T03:01:56.639 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-19T03:01:56.639 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-19T03:01:56.639 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.134:6801", 2024-04-19T03:01:56.639 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 18145 2024-04-19T03:01:56.639 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-19T03:01:56.639 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-19T03:01:56.639 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-19T03:01:56.639 INFO:teuthology.orchestra.run.smithi096.stdout: "cluster_addrs": { 2024-04-19T03:01:56.639 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-19T03:01:56.639 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-19T03:01:56.640 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-19T03:01:56.640 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.134:6802", 2024-04-19T03:01:56.640 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 18145 2024-04-19T03:01:56.640 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-19T03:01:56.640 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-19T03:01:56.640 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-19T03:01:56.640 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.134:6803", 2024-04-19T03:01:56.640 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 18145 2024-04-19T03:01:56.640 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-19T03:01:56.640 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-19T03:01:56.640 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-19T03:01:56.640 INFO:teuthology.orchestra.run.smithi096.stdout: "heartbeat_back_addrs": { 2024-04-19T03:01:56.640 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-19T03:01:56.641 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-19T03:01:56.641 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-19T03:01:56.641 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.134:6806", 2024-04-19T03:01:56.641 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 18145 2024-04-19T03:01:56.641 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-19T03:01:56.641 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-19T03:01:56.641 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-19T03:01:56.641 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.134:6807", 2024-04-19T03:01:56.641 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 18145 2024-04-19T03:01:56.641 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-19T03:01:56.641 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-19T03:01:56.641 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-19T03:01:56.641 INFO:teuthology.orchestra.run.smithi096.stdout: "heartbeat_front_addrs": { 2024-04-19T03:01:56.641 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-19T03:01:56.642 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-19T03:01:56.642 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-19T03:01:56.642 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.134:6804", 2024-04-19T03:01:56.642 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 18145 2024-04-19T03:01:56.642 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-19T03:01:56.642 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-19T03:01:56.642 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-19T03:01:56.642 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.134:6805", 2024-04-19T03:01:56.642 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 18145 2024-04-19T03:01:56.642 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-19T03:01:56.642 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-19T03:01:56.642 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-19T03:01:56.642 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addr": "172.21.15.134:6801/18145", 2024-04-19T03:01:56.643 INFO:teuthology.orchestra.run.smithi096.stdout: "cluster_addr": "172.21.15.134:6803/18145", 2024-04-19T03:01:56.643 INFO:teuthology.orchestra.run.smithi096.stdout: "heartbeat_back_addr": "172.21.15.134:6807/18145", 2024-04-19T03:01:56.643 INFO:teuthology.orchestra.run.smithi096.stdout: "heartbeat_front_addr": "172.21.15.134:6805/18145", 2024-04-19T03:01:56.643 INFO:teuthology.orchestra.run.smithi096.stdout: "state": [ 2024-04-19T03:01:56.643 INFO:teuthology.orchestra.run.smithi096.stdout: "exists", 2024-04-19T03:01:56.643 INFO:teuthology.orchestra.run.smithi096.stdout: "up" 2024-04-19T03:01:56.643 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-19T03:01:56.643 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-19T03:01:56.643 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-19T03:01:56.643 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": 2, 2024-04-19T03:01:56.643 INFO:teuthology.orchestra.run.smithi096.stdout: "uuid": "229278a0-dd93-4234-9065-e4f2f6188ef2", 2024-04-19T03:01:56.643 INFO:teuthology.orchestra.run.smithi096.stdout: "up": 1, 2024-04-19T03:01:56.643 INFO:teuthology.orchestra.run.smithi096.stdout: "in": 1, 2024-04-19T03:01:56.643 INFO:teuthology.orchestra.run.smithi096.stdout: "weight": 1, 2024-04-19T03:01:56.645 INFO:teuthology.orchestra.run.smithi096.stdout: "primary_affinity": 1, 2024-04-19T03:01:56.645 INFO:teuthology.orchestra.run.smithi096.stdout: "last_clean_begin": 0, 2024-04-19T03:01:56.645 INFO:teuthology.orchestra.run.smithi096.stdout: "last_clean_end": 0, 2024-04-19T03:01:56.645 INFO:teuthology.orchestra.run.smithi096.stdout: "up_from": 10, 2024-04-19T03:01:56.645 INFO:teuthology.orchestra.run.smithi096.stdout: "up_thru": 22, 2024-04-19T03:01:56.645 INFO:teuthology.orchestra.run.smithi096.stdout: "down_at": 0, 2024-04-19T03:01:56.645 INFO:teuthology.orchestra.run.smithi096.stdout: "lost_at": 0, 2024-04-19T03:01:56.646 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addrs": { 2024-04-19T03:01:56.646 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-19T03:01:56.646 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-19T03:01:56.646 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-19T03:01:56.646 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.144:6800", 2024-04-19T03:01:56.646 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 18223 2024-04-19T03:01:56.646 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-19T03:01:56.646 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-19T03:01:56.646 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-19T03:01:56.646 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.144:6801", 2024-04-19T03:01:56.646 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 18223 2024-04-19T03:01:56.646 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-19T03:01:56.646 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-19T03:01:56.646 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-19T03:01:56.647 INFO:teuthology.orchestra.run.smithi096.stdout: "cluster_addrs": { 2024-04-19T03:01:56.647 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-19T03:01:56.647 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-19T03:01:56.647 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-19T03:01:56.647 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.144:6802", 2024-04-19T03:01:56.647 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 18223 2024-04-19T03:01:56.647 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-19T03:01:56.647 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-19T03:01:56.647 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-19T03:01:56.647 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.144:6803", 2024-04-19T03:01:56.647 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 18223 2024-04-19T03:01:56.647 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-19T03:01:56.647 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-19T03:01:56.648 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-19T03:01:56.648 INFO:teuthology.orchestra.run.smithi096.stdout: "heartbeat_back_addrs": { 2024-04-19T03:01:56.648 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-19T03:01:56.648 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-19T03:01:56.648 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-19T03:01:56.648 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.144:6806", 2024-04-19T03:01:56.648 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 18223 2024-04-19T03:01:56.648 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-19T03:01:56.648 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-19T03:01:56.648 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-19T03:01:56.648 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.144:6807", 2024-04-19T03:01:56.648 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 18223 2024-04-19T03:01:56.648 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-19T03:01:56.648 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-19T03:01:56.649 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-19T03:01:56.649 INFO:teuthology.orchestra.run.smithi096.stdout: "heartbeat_front_addrs": { 2024-04-19T03:01:56.649 INFO:teuthology.orchestra.run.smithi096.stdout: "addrvec": [ 2024-04-19T03:01:56.649 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-19T03:01:56.649 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v2", 2024-04-19T03:01:56.649 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.144:6804", 2024-04-19T03:01:56.649 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 18223 2024-04-19T03:01:56.649 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-19T03:01:56.649 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-19T03:01:56.649 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2024-04-19T03:01:56.649 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "172.21.15.144:6805", 2024-04-19T03:01:56.649 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 18223 2024-04-19T03:01:56.649 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-19T03:01:56.649 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-19T03:01:56.650 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-19T03:01:56.650 INFO:teuthology.orchestra.run.smithi096.stdout: "public_addr": "172.21.15.144:6801/18223", 2024-04-19T03:01:56.650 INFO:teuthology.orchestra.run.smithi096.stdout: "cluster_addr": "172.21.15.144:6803/18223", 2024-04-19T03:01:56.650 INFO:teuthology.orchestra.run.smithi096.stdout: "heartbeat_back_addr": "172.21.15.144:6807/18223", 2024-04-19T03:01:56.650 INFO:teuthology.orchestra.run.smithi096.stdout: "heartbeat_front_addr": "172.21.15.144:6805/18223", 2024-04-19T03:01:56.650 INFO:teuthology.orchestra.run.smithi096.stdout: "state": [ 2024-04-19T03:01:56.650 INFO:teuthology.orchestra.run.smithi096.stdout: "exists", 2024-04-19T03:01:56.650 INFO:teuthology.orchestra.run.smithi096.stdout: "up" 2024-04-19T03:01:56.650 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2024-04-19T03:01:56.650 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-19T03:01:56.650 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-19T03:01:56.650 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_xinfo": [ 2024-04-19T03:01:56.650 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-19T03:01:56.650 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": 0, 2024-04-19T03:01:56.651 INFO:teuthology.orchestra.run.smithi096.stdout: "down_stamp": "0.000000", 2024-04-19T03:01:56.651 INFO:teuthology.orchestra.run.smithi096.stdout: "laggy_probability": 0, 2024-04-19T03:01:56.651 INFO:teuthology.orchestra.run.smithi096.stdout: "laggy_interval": 0, 2024-04-19T03:01:56.651 INFO:teuthology.orchestra.run.smithi096.stdout: "features": 4540138322906710015, 2024-04-19T03:01:56.651 INFO:teuthology.orchestra.run.smithi096.stdout: "old_weight": 0, 2024-04-19T03:01:56.651 INFO:teuthology.orchestra.run.smithi096.stdout: "last_purged_snaps_scrub": "2024-04-19T03:00:59.302574+0000", 2024-04-19T03:01:56.651 INFO:teuthology.orchestra.run.smithi096.stdout: "dead_epoch": 0 2024-04-19T03:01:56.651 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-19T03:01:56.651 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-19T03:01:56.651 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": 1, 2024-04-19T03:01:56.651 INFO:teuthology.orchestra.run.smithi096.stdout: "down_stamp": "0.000000", 2024-04-19T03:01:56.651 INFO:teuthology.orchestra.run.smithi096.stdout: "laggy_probability": 0, 2024-04-19T03:01:56.651 INFO:teuthology.orchestra.run.smithi096.stdout: "laggy_interval": 0, 2024-04-19T03:01:56.651 INFO:teuthology.orchestra.run.smithi096.stdout: "features": 4540138322906710015, 2024-04-19T03:01:56.652 INFO:teuthology.orchestra.run.smithi096.stdout: "old_weight": 0, 2024-04-19T03:01:56.652 INFO:teuthology.orchestra.run.smithi096.stdout: "last_purged_snaps_scrub": "2024-04-19T03:01:00.064174+0000", 2024-04-19T03:01:56.652 INFO:teuthology.orchestra.run.smithi096.stdout: "dead_epoch": 0 2024-04-19T03:01:56.652 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-19T03:01:56.652 INFO:teuthology.orchestra.run.smithi096.stdout: { 2024-04-19T03:01:56.652 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": 2, 2024-04-19T03:01:56.652 INFO:teuthology.orchestra.run.smithi096.stdout: "down_stamp": "0.000000", 2024-04-19T03:01:56.652 INFO:teuthology.orchestra.run.smithi096.stdout: "laggy_probability": 0, 2024-04-19T03:01:56.652 INFO:teuthology.orchestra.run.smithi096.stdout: "laggy_interval": 0, 2024-04-19T03:01:56.652 INFO:teuthology.orchestra.run.smithi096.stdout: "features": 4540138322906710015, 2024-04-19T03:01:56.652 INFO:teuthology.orchestra.run.smithi096.stdout: "old_weight": 0, 2024-04-19T03:01:56.652 INFO:teuthology.orchestra.run.smithi096.stdout: "last_purged_snaps_scrub": "2024-04-19T03:00:59.735582+0000", 2024-04-19T03:01:56.652 INFO:teuthology.orchestra.run.smithi096.stdout: "dead_epoch": 0 2024-04-19T03:01:56.653 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-19T03:01:56.653 INFO:teuthology.orchestra.run.smithi096.stdout: ], 2024-04-19T03:01:56.653 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_upmap": [], 2024-04-19T03:01:56.653 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_upmap_items": [], 2024-04-19T03:01:56.653 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_upmap_primaries": [], 2024-04-19T03:01:56.653 INFO:teuthology.orchestra.run.smithi096.stdout: "pg_temp": [], 2024-04-19T03:01:56.653 INFO:teuthology.orchestra.run.smithi096.stdout: "primary_temp": [], 2024-04-19T03:01:56.653 INFO:teuthology.orchestra.run.smithi096.stdout: "blocklist": {}, 2024-04-19T03:01:56.653 INFO:teuthology.orchestra.run.smithi096.stdout: "range_blocklist": {}, 2024-04-19T03:01:56.653 INFO:teuthology.orchestra.run.smithi096.stdout: "erasure_code_profiles": { 2024-04-19T03:01:56.653 INFO:teuthology.orchestra.run.smithi096.stdout: "default": { 2024-04-19T03:01:56.653 INFO:teuthology.orchestra.run.smithi096.stdout: "crush-failure-domain": "osd", 2024-04-19T03:01:56.653 INFO:teuthology.orchestra.run.smithi096.stdout: "k": "2", 2024-04-19T03:01:56.653 INFO:teuthology.orchestra.run.smithi096.stdout: "m": "1", 2024-04-19T03:01:56.653 INFO:teuthology.orchestra.run.smithi096.stdout: "plugin": "jerasure", 2024-04-19T03:01:56.654 INFO:teuthology.orchestra.run.smithi096.stdout: "technique": "reed_sol_van" 2024-04-19T03:01:56.654 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-19T03:01:56.654 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2024-04-19T03:01:56.654 INFO:teuthology.orchestra.run.smithi096.stdout: "removed_snaps_queue": [], 2024-04-19T03:01:56.654 INFO:teuthology.orchestra.run.smithi096.stdout: "new_removed_snaps": [], 2024-04-19T03:01:56.654 INFO:teuthology.orchestra.run.smithi096.stdout: "new_purged_snaps": [], 2024-04-19T03:01:56.654 INFO:teuthology.orchestra.run.smithi096.stdout: "crush_node_flags": {}, 2024-04-19T03:01:56.654 INFO:teuthology.orchestra.run.smithi096.stdout: "device_class_flags": {}, 2024-04-19T03:01:56.654 INFO:teuthology.orchestra.run.smithi096.stdout: "stretch_mode": { 2024-04-19T03:01:56.654 INFO:teuthology.orchestra.run.smithi096.stdout: "stretch_mode_enabled": false, 2024-04-19T03:01:56.654 INFO:teuthology.orchestra.run.smithi096.stdout: "stretch_bucket_count": 0, 2024-04-19T03:01:56.654 INFO:teuthology.orchestra.run.smithi096.stdout: "degraded_stretch_mode": 0, 2024-04-19T03:01:56.654 INFO:teuthology.orchestra.run.smithi096.stdout: "recovering_stretch_mode": 0, 2024-04-19T03:01:56.654 INFO:teuthology.orchestra.run.smithi096.stdout: "stretch_mode_bucket": 0 2024-04-19T03:01:56.655 INFO:teuthology.orchestra.run.smithi096.stdout: } 2024-04-19T03:01:56.655 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-04-19T03:01:56.657 INFO:tasks.thrashosds.thrasher:j is {'epoch': 30, 'fsid': 'c6cc8e09-11d4-48de-9a6c-4d70ed3c3789', 'created': '2024-04-19T03:00:53.746146+0000', 'modified': '2024-04-19T03:01:54.055013+0000', 'last_up_change': '2024-04-19T03:01:04.501086+0000', 'last_in_change': '2024-04-19T03:00:54.640172+0000', 'flags': 'nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5804032, 'flags_set': ['nodeep-scrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 5, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 5, 'max_osd': 3, 'require_min_compat_client': 'luminous', 'min_compat_client': 'jewel', 'require_osd_release': 'reef', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-19T03:01:05.999591+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '14', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-19T03:01:09.051757+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-19T03:01:13.479163+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-04-19T03:01:13.992441+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'unique_pool_0', 'create_time': '2024-04-19T03:01:35.396306+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 16, 'pg_placement_num': 16, 'pg_placement_num_target': 16, 'pg_num_target': 16, 'pg_num_pending': 16, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rados': {}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}], 'osds': [{'osd': 0, 'uuid': '05ecb884-2c30-44f7-aa14-90154f9bbe9a', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 9, 'up_thru': 22, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.97:6800', 'nonce': 18245}, {'type': 'v1', 'addr': '172.21.15.97:6801', 'nonce': 18245}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.97:6802', 'nonce': 18245}, {'type': 'v1', 'addr': '172.21.15.97:6803', 'nonce': 18245}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.97:6806', 'nonce': 18245}, {'type': 'v1', 'addr': '172.21.15.97:6807', 'nonce': 18245}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.97:6804', 'nonce': 18245}, {'type': 'v1', 'addr': '172.21.15.97:6805', 'nonce': 18245}]}, 'public_addr': '172.21.15.97:6801/18245', 'cluster_addr': '172.21.15.97:6803/18245', 'heartbeat_back_addr': '172.21.15.97:6807/18245', 'heartbeat_front_addr': '172.21.15.97:6805/18245', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': 'efc873e0-69c3-4a57-8ee5-41f836b65f47', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 10, 'up_thru': 22, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6800', 'nonce': 18145}, {'type': 'v1', 'addr': '172.21.15.134:6801', 'nonce': 18145}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6802', 'nonce': 18145}, {'type': 'v1', 'addr': '172.21.15.134:6803', 'nonce': 18145}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6806', 'nonce': 18145}, {'type': 'v1', 'addr': '172.21.15.134:6807', 'nonce': 18145}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6804', 'nonce': 18145}, {'type': 'v1', 'addr': '172.21.15.134:6805', 'nonce': 18145}]}, 'public_addr': '172.21.15.134:6801/18145', 'cluster_addr': '172.21.15.134:6803/18145', 'heartbeat_back_addr': '172.21.15.134:6807/18145', 'heartbeat_front_addr': '172.21.15.134:6805/18145', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '229278a0-dd93-4234-9065-e4f2f6188ef2', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 10, 'up_thru': 22, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.144:6800', 'nonce': 18223}, {'type': 'v1', 'addr': '172.21.15.144:6801', 'nonce': 18223}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.144:6802', 'nonce': 18223}, {'type': 'v1', 'addr': '172.21.15.144:6803', 'nonce': 18223}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.144:6806', 'nonce': 18223}, {'type': 'v1', 'addr': '172.21.15.144:6807', 'nonce': 18223}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.144:6804', 'nonce': 18223}, {'type': 'v1', 'addr': '172.21.15.144:6805', 'nonce': 18223}]}, 'public_addr': '172.21.15.144:6801/18223', 'cluster_addr': '172.21.15.144:6803/18223', 'heartbeat_back_addr': '172.21.15.144:6807/18223', 'heartbeat_front_addr': '172.21.15.144:6805/18223', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-19T03:00:59.302574+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-19T03:01:00.064174+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-19T03:00:59.735582+0000', 'dead_epoch': 0}], 'pg_upmap': [], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-04-19T03:01:56.657 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-19T03:01:56.658 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-04-19T03:01:56.658 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [ 2024-04-19T03:01:56.658 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:56.658 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4755.0:43553 5.8 e30/22 5:10efc2f3:::benchmark_data_smithi096_19531_object43552:head v 30'2752, mlcod=30'2748)", 2024-04-19T03:01:56.658 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:56.607360+0000", 2024-04-19T03:01:56.658 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 0.0045980099999999996, 2024-04-19T03:01:56.658 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0046193099999999997, 2024-04-19T03:01:56.658 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:01:56.659 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "started", 2024-04-19T03:01:56.659 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:01:56.659 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:56.659 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:01:56.659 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:56.607360+0000", 2024-04-19T03:01:56.659 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:56.659 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:56.659 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:56.659 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:01:56.659 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:56.607360+0000", 2024-04-19T03:01:56.659 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:56.659 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:56.659 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:56.659 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:01:56.660 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:56.607359+0000", 2024-04-19T03:01:56.660 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999995 2024-04-19T03:01:56.660 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:56.660 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:56.660 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:01:56.660 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:56.607485+0000", 2024-04-19T03:01:56.660 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012564 2024-04-19T03:01:56.660 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:56.660 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:56.660 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:01:56.660 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:56.607494+0000", 2024-04-19T03:01:56.660 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.1260000000000004e-06 2024-04-19T03:01:56.660 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:56.660 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:56.661 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:01:56.661 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:56.607498+0000", 2024-04-19T03:01:56.661 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.464e-06 2024-04-19T03:01:56.661 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:56.661 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:56.661 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:56.661 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:56.607538+0000", 2024-04-19T03:01:56.661 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.9882000000000002e-05 2024-04-19T03:01:56.661 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:56.661 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:56.661 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:01:56.661 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:56.607559+0000", 2024-04-19T03:01:56.661 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.1131000000000001e-05 2024-04-19T03:01:56.661 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:56.661 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:56.662 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:56.662 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:56.662 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:56.662 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4755.0:43557 5.4 e30/22 5:2d21de06:::benchmark_data_smithi096_19531_object43556:head v 30'2657, mlcod=30'2655)", 2024-04-19T03:01:56.662 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:56.608004+0000", 2024-04-19T03:01:56.662 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 0.0039536900000000002, 2024-04-19T03:01:56.662 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0040344300000000003, 2024-04-19T03:01:56.662 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:01:56.662 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "started", 2024-04-19T03:01:56.662 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:01:56.662 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:56.662 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:01:56.663 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:56.608004+0000", 2024-04-19T03:01:56.663 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:56.663 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:56.663 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:56.663 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:01:56.663 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:56.608004+0000", 2024-04-19T03:01:56.663 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:56.663 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:56.663 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:56.663 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:01:56.663 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:56.608004+0000", 2024-04-19T03:01:56.663 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999995 2024-04-19T03:01:56.663 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:56.663 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:56.664 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:01:56.664 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:56.608080+0000", 2024-04-19T03:01:56.664 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.6292999999999996e-05 2024-04-19T03:01:56.664 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:56.664 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:56.664 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:01:56.664 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:56.608087+0000", 2024-04-19T03:01:56.664 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.0570000000000004e-06 2024-04-19T03:01:56.664 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:56.664 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:56.664 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:01:56.664 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:56.608091+0000", 2024-04-19T03:01:56.664 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.7809999999999999e-06 2024-04-19T03:01:56.664 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:56.665 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:56.665 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:56.665 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:56.608128+0000", 2024-04-19T03:01:56.665 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.6841000000000002e-05 2024-04-19T03:01:56.665 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:56.665 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:56.665 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:01:56.665 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:56.608139+0000", 2024-04-19T03:01:56.665 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1364e-05 2024-04-19T03:01:56.665 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:56.665 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:56.666 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:56.666 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:56.666 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:56.666 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4755.0:43556 5.8 e30/22 5:1a9908ce:::benchmark_data_smithi096_19531_object43555:head v 30'2753, mlcod=30'2748)", 2024-04-19T03:01:56.666 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:56.609281+0000", 2024-04-19T03:01:56.666 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 0.0026767470000000002, 2024-04-19T03:01:56.666 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0028118610000000001, 2024-04-19T03:01:56.666 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:01:56.666 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "started", 2024-04-19T03:01:56.666 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:01:56.666 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:56.667 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:01:56.667 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:56.609281+0000", 2024-04-19T03:01:56.667 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:56.667 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:56.667 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:56.667 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:01:56.667 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:56.609281+0000", 2024-04-19T03:01:56.667 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:56.667 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:56.667 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:56.667 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:01:56.667 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:56.609280+0000", 2024-04-19T03:01:56.667 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999995 2024-04-19T03:01:56.667 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:56.668 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:56.668 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:01:56.668 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:56.609375+0000", 2024-04-19T03:01:56.668 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.5056999999999995e-05 2024-04-19T03:01:56.668 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:56.668 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:56.668 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:01:56.668 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:56.609385+0000", 2024-04-19T03:01:56.668 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.3659999999999998e-06 2024-04-19T03:01:56.668 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:56.668 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:56.668 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:01:56.668 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:56.609394+0000", 2024-04-19T03:01:56.668 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.6150000000000003e-06 2024-04-19T03:01:56.669 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:56.669 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:56.669 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:56.669 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:56.609436+0000", 2024-04-19T03:01:56.669 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.1403999999999999e-05 2024-04-19T03:01:56.669 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:56.669 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:56.669 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:01:56.669 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:56.609456+0000", 2024-04-19T03:01:56.669 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.98e-05 2024-04-19T03:01:56.669 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:56.669 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:56.669 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:56.669 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:56.670 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:56.670 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4755.0:43558 5.3 5.a91d2db3 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-19T03:01:56.670 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:56.610023+0000", 2024-04-19T03:01:56.670 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 0.0019349149999999999, 2024-04-19T03:01:56.670 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0021232529999999999, 2024-04-19T03:01:56.670 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:01:56.670 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "queued for pg", 2024-04-19T03:01:56.670 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-04-19T03:01:56.670 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4755", 2024-04-19T03:01:56.670 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:56.670 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 43558 2024-04-19T03:01:56.670 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:56.670 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:01:56.670 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:56.671 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:01:56.671 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:56.610023+0000", 2024-04-19T03:01:56.671 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:56.671 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:56.671 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:56.671 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:01:56.671 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:56.610023+0000", 2024-04-19T03:01:56.671 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:56.671 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:56.671 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:56.671 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:01:56.671 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:56.610021+0000", 2024-04-19T03:01:56.671 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999986 2024-04-19T03:01:56.671 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:56.672 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:56.672 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:01:56.672 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:56.610081+0000", 2024-04-19T03:01:56.672 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.9531000000000003e-05 2024-04-19T03:01:56.672 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:56.672 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:56.672 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:01:56.672 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:56.610091+0000", 2024-04-19T03:01:56.672 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.6390000000000004e-06 2024-04-19T03:01:56.672 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:56.672 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:56.672 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:01:56.672 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:56.610096+0000", 2024-04-19T03:01:56.672 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.0699999999999997e-06 2024-04-19T03:01:56.672 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:56.673 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:56.673 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:56.673 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:56.673 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:56.673 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4755.0:43559 5.0 e30/22 5:0e646521:::benchmark_data_smithi096_19531_object43558:head v 30'2767, mlcod=30'2765)", 2024-04-19T03:01:56.673 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:56.610982+0000", 2024-04-19T03:01:56.673 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 0.00097532300000000005, 2024-04-19T03:01:56.673 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001216258, 2024-04-19T03:01:56.673 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:01:56.673 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "started", 2024-04-19T03:01:56.673 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:01:56.673 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:56.673 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:01:56.673 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:56.610982+0000", 2024-04-19T03:01:56.674 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:56.674 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:56.674 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:56.674 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:01:56.674 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:56.610982+0000", 2024-04-19T03:01:56.674 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:56.674 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:56.674 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:56.674 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:01:56.674 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:56.610982+0000", 2024-04-19T03:01:56.674 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999995 2024-04-19T03:01:56.674 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:56.674 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:56.674 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:01:56.675 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:56.611013+0000", 2024-04-19T03:01:56.675 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1454000000000001e-05 2024-04-19T03:01:56.675 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:56.675 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:56.675 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:01:56.675 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:56.611022+0000", 2024-04-19T03:01:56.675 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.4619999999999996e-06 2024-04-19T03:01:56.675 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:56.675 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:56.675 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:01:56.675 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:56.611025+0000", 2024-04-19T03:01:56.675 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.478e-06 2024-04-19T03:01:56.675 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:56.675 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:56.676 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:56.676 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:56.611064+0000", 2024-04-19T03:01:56.676 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.8492999999999999e-05 2024-04-19T03:01:56.676 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:56.676 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:56.676 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:01:56.676 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:56.611086+0000", 2024-04-19T03:01:56.676 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.2293000000000002e-05 2024-04-19T03:01:56.676 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:56.676 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:56.676 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:56.676 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:56.676 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:56.676 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop_reply(client.4755.0:43547 5.3 e30/22)", 2024-04-19T03:01:56.677 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:56.611337+0000", 2024-04-19T03:01:56.677 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 0.00062050300000000001, 2024-04-19T03:01:56.677 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00099356599999999998, 2024-04-19T03:01:56.677 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:01:56.677 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "queued for pg", 2024-04-19T03:01:56.677 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:01:56.677 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:56.677 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:01:56.677 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:56.611337+0000", 2024-04-19T03:01:56.677 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:56.677 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:56.677 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:56.677 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:01:56.677 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:56.611337+0000", 2024-04-19T03:01:56.678 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:56.678 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:56.678 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:56.678 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:01:56.678 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:56.611337+0000", 2024-04-19T03:01:56.678 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999995 2024-04-19T03:01:56.678 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:56.678 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:56.678 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:01:56.678 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:56.611345+0000", 2024-04-19T03:01:56.678 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.7129999999999994e-06 2024-04-19T03:01:56.678 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:56.678 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:56.678 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:01:56.679 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:56.611357+0000", 2024-04-19T03:01:56.679 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1333e-05 2024-04-19T03:01:56.679 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:56.679 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:56.679 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:01:56.679 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:56.611362+0000", 2024-04-19T03:01:56.679 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.1989999999999997e-06 2024-04-19T03:01:56.679 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:56.679 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:56.679 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:56.679 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:56.679 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:56.679 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop_reply(client.4755.0:43548 5.3 e30/22)", 2024-04-19T03:01:56.679 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:56.611376+0000", 2024-04-19T03:01:56.680 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 0.00058215899999999995, 2024-04-19T03:01:56.680 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0010081580000000001, 2024-04-19T03:01:56.680 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:01:56.680 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "queued for pg", 2024-04-19T03:01:56.680 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:01:56.680 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:56.680 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:01:56.680 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:56.611376+0000", 2024-04-19T03:01:56.680 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:56.680 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:56.680 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:56.680 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:01:56.680 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:56.611376+0000", 2024-04-19T03:01:56.680 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:56.681 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:56.681 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:56.681 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:01:56.681 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:56.611375+0000", 2024-04-19T03:01:56.681 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967296 2024-04-19T03:01:56.681 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:56.681 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:56.681 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:01:56.681 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:56.611378+0000", 2024-04-19T03:01:56.681 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.8200000000000001e-06 2024-04-19T03:01:56.681 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:56.681 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:56.681 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:01:56.682 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:56.611388+0000", 2024-04-19T03:01:56.682 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0108e-05 2024-04-19T03:01:56.682 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:56.682 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:56.682 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:01:56.682 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:56.611393+0000", 2024-04-19T03:01:56.682 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.9899999999999997e-06 2024-04-19T03:01:56.682 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:56.682 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:56.682 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:56.682 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:56.682 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:56.682 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4755.0:43560 5.2 e30/22 5:4027df6e:::benchmark_data_smithi096_19531_object43559:head v 30'2707, mlcod=30'2703)", 2024-04-19T03:01:56.683 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:56.611564+0000", 2024-04-19T03:01:56.683 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 0.00039339399999999998, 2024-04-19T03:01:56.683 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00086485100000000003, 2024-04-19T03:01:56.683 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:01:56.683 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "started", 2024-04-19T03:01:56.683 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:01:56.683 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:56.683 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:01:56.683 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:56.611564+0000", 2024-04-19T03:01:56.683 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:56.683 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:56.683 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:56.683 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:01:56.683 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:56.611564+0000", 2024-04-19T03:01:56.684 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:56.684 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:56.684 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:56.684 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:01:56.684 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:56.611564+0000", 2024-04-19T03:01:56.684 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2024-04-19T03:01:56.684 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:56.684 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:56.684 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:01:56.684 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:56.611607+0000", 2024-04-19T03:01:56.684 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.375e-05 2024-04-19T03:01:56.684 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:56.684 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:56.685 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:01:56.685 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:56.611617+0000", 2024-04-19T03:01:56.685 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.3109999999999995e-06 2024-04-19T03:01:56.685 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:56.685 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:56.685 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:01:56.685 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:56.611624+0000", 2024-04-19T03:01:56.685 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.9059999999999996e-06 2024-04-19T03:01:56.685 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:56.685 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:56.685 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:56.685 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:56.611667+0000", 2024-04-19T03:01:56.685 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.3525000000000001e-05 2024-04-19T03:01:56.685 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:56.685 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:56.686 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:01:56.686 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:56.611681+0000", 2024-04-19T03:01:56.686 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4345000000000001e-05 2024-04-19T03:01:56.686 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:56.686 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:56.686 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:56.686 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:56.686 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:56.686 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4755.0:43561 5.a 5:5c0a0920:::benchmark_data_smithi096_19531_object43560:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-19T03:01:56.686 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:56.612240+0000", 2024-04-19T03:01:56.686 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 4294967295.9997182, 2024-04-19T03:01:56.686 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00025106100000000001, 2024-04-19T03:01:56.686 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:01:56.686 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "reached pg", 2024-04-19T03:01:56.687 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-04-19T03:01:56.687 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4755", 2024-04-19T03:01:56.687 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:56.687 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 43561 2024-04-19T03:01:56.687 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:56.687 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:01:56.687 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:56.687 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:01:56.687 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:56.612240+0000", 2024-04-19T03:01:56.687 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:56.687 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:56.687 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:56.687 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:01:56.688 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:56.612240+0000", 2024-04-19T03:01:56.688 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:56.688 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:56.688 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:56.688 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:01:56.688 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:56.612239+0000", 2024-04-19T03:01:56.688 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2024-04-19T03:01:56.688 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:56.688 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:56.688 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:01:56.688 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:56.612296+0000", 2024-04-19T03:01:56.688 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.7744999999999997e-05 2024-04-19T03:01:56.688 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:56.688 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:56.688 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:01:56.689 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:56.612308+0000", 2024-04-19T03:01:56.689 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1443999999999999e-05 2024-04-19T03:01:56.689 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:56.689 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:56.689 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:01:56.689 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:56.612314+0000", 2024-04-19T03:01:56.689 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.0990000000000004e-06 2024-04-19T03:01:56.689 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:56.689 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:56.689 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:56.689 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:56.612360+0000", 2024-04-19T03:01:56.689 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.6508000000000003e-05 2024-04-19T03:01:56.689 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:56.690 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:56.690 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:56.690 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:56.690 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:56.690 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4755.0:43562 5.c 5:33344dab:::benchmark_data_smithi096_19531_object43561:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-19T03:01:56.690 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:56.612323+0000", 2024-04-19T03:01:56.690 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 4294967295.9996347, 2024-04-19T03:01:56.690 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00023409200000000001, 2024-04-19T03:01:56.690 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:01:56.690 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "started", 2024-04-19T03:01:56.690 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-04-19T03:01:56.690 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4755", 2024-04-19T03:01:56.690 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:56.690 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 43562 2024-04-19T03:01:56.691 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:56.691 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:01:56.691 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:56.691 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:01:56.691 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:56.612323+0000", 2024-04-19T03:01:56.691 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:56.691 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:56.691 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:56.691 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:01:56.691 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:56.612323+0000", 2024-04-19T03:01:56.691 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:56.691 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:56.691 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:56.691 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:01:56.692 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:56.612322+0000", 2024-04-19T03:01:56.692 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999995 2024-04-19T03:01:56.692 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:56.692 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:56.692 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:01:56.692 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:56.612355+0000", 2024-04-19T03:01:56.692 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.2261000000000002e-05 2024-04-19T03:01:56.692 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:56.692 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:56.692 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:01:56.692 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:56.612361+0000", 2024-04-19T03:01:56.692 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.1539999999999999e-06 2024-04-19T03:01:56.692 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:56.692 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:56.693 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:01:56.693 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:56.612364+0000", 2024-04-19T03:01:56.693 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.5889999999999999e-06 2024-04-19T03:01:56.693 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:56.693 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:56.693 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:56.693 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:56.612398+0000", 2024-04-19T03:01:56.693 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.3549e-05 2024-04-19T03:01:56.693 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:56.693 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:56.693 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:01:56.693 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:56.612499+0000", 2024-04-19T03:01:56.693 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00010081000000000001 2024-04-19T03:01:56.693 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:56.694 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:56.694 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:56.694 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:56.694 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:56.694 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4755.0:43542 5.5 5:a06ae091:::benchmark_data_smithi096_19531_object43541:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-19T03:01:56.694 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:56.600309+0000", 2024-04-19T03:01:56.694 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 0.011648501, 2024-04-19T03:01:56.694 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.01233014, 2024-04-19T03:01:56.694 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:01:56.694 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:01:56.694 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-04-19T03:01:56.694 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4755", 2024-04-19T03:01:56.694 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:56.695 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 43542 2024-04-19T03:01:56.695 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:56.695 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:01:56.695 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:56.695 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:01:56.695 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:56.600309+0000", 2024-04-19T03:01:56.695 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:56.695 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:56.695 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:56.695 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:01:56.695 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:56.600309+0000", 2024-04-19T03:01:56.695 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:56.695 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:56.695 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:56.696 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:01:56.696 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:56.600308+0000", 2024-04-19T03:01:56.696 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2024-04-19T03:01:56.696 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:56.696 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:56.696 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:01:56.696 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:56.600365+0000", 2024-04-19T03:01:56.696 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.6501e-05 2024-04-19T03:01:56.696 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:56.696 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:56.696 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:01:56.696 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:56.600379+0000", 2024-04-19T03:01:56.696 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.3869999999999999e-05 2024-04-19T03:01:56.697 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:56.697 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:56.697 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:01:56.697 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:56.600386+0000", 2024-04-19T03:01:56.697 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.3819999999999998e-06 2024-04-19T03:01:56.697 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:56.697 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:56.697 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:56.697 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:56.602929+0000", 2024-04-19T03:01:56.697 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0025429530000000001 2024-04-19T03:01:56.697 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:56.697 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:56.697 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:01:56.697 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:56.603088+0000", 2024-04-19T03:01:56.698 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000158627 2024-04-19T03:01:56.698 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:56.698 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:56.698 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-04-19T03:01:56.698 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:56.603214+0000", 2024-04-19T03:01:56.698 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012680600000000001 2024-04-19T03:01:56.698 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:56.698 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:56.698 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:01:56.698 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:56.609218+0000", 2024-04-19T03:01:56.698 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0060037049999999998 2024-04-19T03:01:56.698 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:56.698 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:56.699 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:56.699 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:56.699 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:56.699 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4755.0:43547 5.3 5:c0266fa0:::benchmark_data_smithi096_19531_object43546:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-19T03:01:56.699 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:56.601921+0000", 2024-04-19T03:01:56.699 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 0.010036872000000001, 2024-04-19T03:01:56.699 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.010796913, 2024-04-19T03:01:56.699 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:01:56.699 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:01:56.699 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-04-19T03:01:56.699 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4755", 2024-04-19T03:01:56.699 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:56.699 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 43547 2024-04-19T03:01:56.699 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:56.699 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:01:56.700 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:56.700 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:01:56.700 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:56.601921+0000", 2024-04-19T03:01:56.700 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:56.700 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:56.700 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:56.700 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:01:56.700 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:56.601921+0000", 2024-04-19T03:01:56.700 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:56.700 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:56.700 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:56.700 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:01:56.700 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:56.601920+0000", 2024-04-19T03:01:56.700 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999995 2024-04-19T03:01:56.701 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:56.701 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:56.701 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:01:56.701 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:56.601994+0000", 2024-04-19T03:01:56.701 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.3281000000000005e-05 2024-04-19T03:01:56.701 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:56.701 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:56.701 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:01:56.701 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:56.602001+0000", 2024-04-19T03:01:56.701 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.7130000000000005e-06 2024-04-19T03:01:56.701 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:56.701 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:56.701 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:01:56.701 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:56.602007+0000", 2024-04-19T03:01:56.702 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.4689999999999996e-06 2024-04-19T03:01:56.702 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:56.702 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:56.702 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:56.702 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:56.602064+0000", 2024-04-19T03:01:56.702 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.7139000000000003e-05 2024-04-19T03:01:56.702 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:56.702 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:56.702 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:01:56.702 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:56.602192+0000", 2024-04-19T03:01:56.702 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000127675 2024-04-19T03:01:56.702 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:56.703 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:56.703 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-04-19T03:01:56.703 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:56.602318+0000", 2024-04-19T03:01:56.703 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012652599999999999 2024-04-19T03:01:56.703 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:56.703 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:56.703 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:56.703 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:56.703 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:56.703 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4755.0:43548 5.3 5:c5330a04:::benchmark_data_smithi096_19531_object43547:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-19T03:01:56.703 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:56.602025+0000", 2024-04-19T03:01:56.703 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 0.009932883, 2024-04-19T03:01:56.703 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.010762378, 2024-04-19T03:01:56.703 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:01:56.704 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:01:56.704 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-04-19T03:01:56.704 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4755", 2024-04-19T03:01:56.704 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:56.704 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 43548 2024-04-19T03:01:56.704 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:56.704 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:01:56.704 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:56.704 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:01:56.704 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:56.602025+0000", 2024-04-19T03:01:56.704 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:56.704 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:56.704 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:56.704 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:01:56.704 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:56.602025+0000", 2024-04-19T03:01:56.705 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:56.705 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:56.705 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:56.705 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:01:56.705 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:56.602024+0000", 2024-04-19T03:01:56.705 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999995 2024-04-19T03:01:56.705 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:56.705 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:56.705 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:01:56.705 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:56.602076+0000", 2024-04-19T03:01:56.705 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.1465999999999998e-05 2024-04-19T03:01:56.705 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:56.705 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:56.705 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:01:56.706 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:56.602088+0000", 2024-04-19T03:01:56.706 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2641e-05 2024-04-19T03:01:56.706 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:56.706 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:56.706 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:01:56.706 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:56.602094+0000", 2024-04-19T03:01:56.706 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.2530000000000004e-06 2024-04-19T03:01:56.706 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:56.706 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:56.706 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:56.706 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:56.604480+0000", 2024-04-19T03:01:56.706 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0023867229999999999 2024-04-19T03:01:56.706 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:56.706 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:56.707 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:01:56.707 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:56.604694+0000", 2024-04-19T03:01:56.707 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00021357400000000001 2024-04-19T03:01:56.707 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:56.707 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:56.707 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-04-19T03:01:56.707 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:56.604834+0000", 2024-04-19T03:01:56.707 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000139753 2024-04-19T03:01:56.707 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:56.707 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:56.707 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:56.707 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:56.707 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:56.707 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4755.0:43549 5.2 e30/22 5:4182491a:::benchmark_data_smithi096_19531_object43548:head v 30'2705, mlcod=30'2703)", 2024-04-19T03:01:56.708 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:56.604572+0000", 2024-04-19T03:01:56.708 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 0.0073860979999999998, 2024-04-19T03:01:56.708 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0082852020000000002, 2024-04-19T03:01:56.708 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:01:56.708 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "started", 2024-04-19T03:01:56.708 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:01:56.708 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:56.708 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:01:56.708 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:56.604572+0000", 2024-04-19T03:01:56.708 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:56.708 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:56.708 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:56.708 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:01:56.708 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:56.604572+0000", 2024-04-19T03:01:56.709 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:56.709 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:56.709 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:56.709 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:01:56.709 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:56.604571+0000", 2024-04-19T03:01:56.709 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2024-04-19T03:01:56.709 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:56.709 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:56.709 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:01:56.709 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:56.604612+0000", 2024-04-19T03:01:56.709 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.1202999999999998e-05 2024-04-19T03:01:56.709 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:56.709 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:56.709 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:01:56.710 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:56.604637+0000", 2024-04-19T03:01:56.710 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.4627999999999999e-05 2024-04-19T03:01:56.710 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:56.710 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:56.710 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:01:56.710 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:56.604645+0000", 2024-04-19T03:01:56.710 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.0779999999999996e-06 2024-04-19T03:01:56.710 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:56.710 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:56.710 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:56.710 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:56.604765+0000", 2024-04-19T03:01:56.710 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012037800000000001 2024-04-19T03:01:56.711 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:56.711 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:56.711 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:01:56.711 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:56.604784+0000", 2024-04-19T03:01:56.711 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.9082000000000001e-05 2024-04-19T03:01:56.711 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:56.711 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:56.711 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:56.711 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:56.711 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:56.711 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4755.0:43552 5.b e30/22 5:dc328909:::benchmark_data_smithi096_19531_object43551:head v 30'2766, mlcod=30'2764)", 2024-04-19T03:01:56.711 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:56.605255+0000", 2024-04-19T03:01:56.711 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 0.0067027880000000003, 2024-04-19T03:01:56.711 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0076808659999999997, 2024-04-19T03:01:56.711 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:01:56.712 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "started", 2024-04-19T03:01:56.712 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:01:56.712 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:56.712 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:01:56.712 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:56.605255+0000", 2024-04-19T03:01:56.712 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:56.712 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:56.712 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:56.712 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:01:56.712 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:56.605255+0000", 2024-04-19T03:01:56.712 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:56.712 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:56.712 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:56.713 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:01:56.713 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:56.605254+0000", 2024-04-19T03:01:56.713 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999995 2024-04-19T03:01:56.713 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:56.713 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:56.713 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:01:56.713 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:56.605328+0000", 2024-04-19T03:01:56.713 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.3915e-05 2024-04-19T03:01:56.713 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:56.713 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:56.713 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:01:56.713 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:56.605336+0000", 2024-04-19T03:01:56.713 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.1070000000000005e-06 2024-04-19T03:01:56.713 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:56.714 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:56.714 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:01:56.714 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:56.605342+0000", 2024-04-19T03:01:56.714 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.6459999999999998e-06 2024-04-19T03:01:56.714 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:56.714 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:56.714 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:56.714 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:56.605374+0000", 2024-04-19T03:01:56.714 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.2492e-05 2024-04-19T03:01:56.714 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:56.714 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:56.714 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:01:56.714 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:56.605390+0000", 2024-04-19T03:01:56.714 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5962000000000001e-05 2024-04-19T03:01:56.715 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:56.715 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:56.715 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:56.715 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:56.715 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:56.715 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4755.0:43550 5.2 e30/22 5:43a456a9:::benchmark_data_smithi096_19531_object43549:head v 30'2706, mlcod=30'2703)", 2024-04-19T03:01:56.715 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:56.606000+0000", 2024-04-19T03:01:56.715 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 0.0059581829999999997, 2024-04-19T03:01:56.715 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.007037293, 2024-04-19T03:01:56.715 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:01:56.715 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "started", 2024-04-19T03:01:56.715 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:01:56.715 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:56.716 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:01:56.716 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:56.606000+0000", 2024-04-19T03:01:56.716 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:56.716 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:56.716 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:56.716 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:01:56.716 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:56.606000+0000", 2024-04-19T03:01:56.716 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:56.716 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:56.716 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:56.716 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:01:56.716 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:56.605999+0000", 2024-04-19T03:01:56.716 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2024-04-19T03:01:56.716 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:56.717 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:56.717 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:01:56.717 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:56.606058+0000", 2024-04-19T03:01:56.717 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.9009999999999999e-05 2024-04-19T03:01:56.717 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:56.717 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:56.717 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:01:56.717 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:56.606070+0000", 2024-04-19T03:01:56.717 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2700999999999999e-05 2024-04-19T03:01:56.717 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:56.717 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:56.717 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:01:56.717 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:56.606078+0000", 2024-04-19T03:01:56.717 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.6729999999999992e-06 2024-04-19T03:01:56.717 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:56.718 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:56.718 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:56.718 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:56.606916+0000", 2024-04-19T03:01:56.718 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00083760699999999998 2024-04-19T03:01:56.718 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:56.718 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:56.718 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:01:56.718 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:56.606940+0000", 2024-04-19T03:01:56.718 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.4505e-05 2024-04-19T03:01:56.718 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:56.718 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:56.718 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:56.718 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:56.719 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:56.719 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4755.0:43554 5.3 5:cd28916a:::benchmark_data_smithi096_19531_object43553:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-19T03:01:56.719 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:56.606978+0000", 2024-04-19T03:01:56.719 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 0.004980183, 2024-04-19T03:01:56.719 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0061262799999999996, 2024-04-19T03:01:56.719 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:01:56.719 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:01:56.719 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-04-19T03:01:56.719 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4755", 2024-04-19T03:01:56.719 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:56.719 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 43554 2024-04-19T03:01:56.719 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:56.719 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:01:56.719 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:56.720 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:01:56.720 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:56.606978+0000", 2024-04-19T03:01:56.720 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:56.720 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:56.720 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:56.720 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:01:56.720 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:56.606978+0000", 2024-04-19T03:01:56.720 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:56.720 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:56.720 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:56.720 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:01:56.720 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:56.606976+0000", 2024-04-19T03:01:56.720 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2024-04-19T03:01:56.720 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:56.720 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:56.721 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:01:56.721 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:56.607030+0000", 2024-04-19T03:01:56.721 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.4033000000000003e-05 2024-04-19T03:01:56.721 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:56.721 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:56.721 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:01:56.721 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:56.607041+0000", 2024-04-19T03:01:56.721 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1041e-05 2024-04-19T03:01:56.721 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:56.721 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:56.721 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:01:56.721 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:56.607047+0000", 2024-04-19T03:01:56.721 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.5969999999999999e-06 2024-04-19T03:01:56.721 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:56.722 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:56.722 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:56.722 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:56.608914+0000", 2024-04-19T03:01:56.722 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0018666749999999999 2024-04-19T03:01:56.722 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:56.722 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:56.722 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:01:56.722 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:56.609120+0000", 2024-04-19T03:01:56.722 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00020620400000000001 2024-04-19T03:01:56.722 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:56.722 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:56.722 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-04-19T03:01:56.722 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:56.609281+0000", 2024-04-19T03:01:56.722 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000160602 2024-04-19T03:01:56.723 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:56.723 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:56.723 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:56.723 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:56.723 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:56.723 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4755.0:43555 5.3 5:cfd6e632:::benchmark_data_smithi096_19531_object43554:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-19T03:01:56.723 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:56.607053+0000", 2024-04-19T03:01:56.723 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 0.0049047329999999997, 2024-04-19T03:01:56.723 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.006165172, 2024-04-19T03:01:56.723 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:01:56.723 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:01:56.723 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-04-19T03:01:56.723 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4755", 2024-04-19T03:01:56.723 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:56.724 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 43555 2024-04-19T03:01:56.724 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:56.724 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:01:56.724 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:56.724 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:01:56.724 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:56.607053+0000", 2024-04-19T03:01:56.724 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:56.724 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:56.724 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:56.724 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:01:56.724 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:56.607053+0000", 2024-04-19T03:01:56.724 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:56.724 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:56.724 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:56.724 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:01:56.725 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:56.607053+0000", 2024-04-19T03:01:56.725 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999995 2024-04-19T03:01:56.725 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:56.725 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:56.725 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:01:56.725 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:56.607096+0000", 2024-04-19T03:01:56.725 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.3095e-05 2024-04-19T03:01:56.725 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:56.725 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:56.725 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:01:56.725 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:56.607103+0000", 2024-04-19T03:01:56.725 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.1149999999999996e-06 2024-04-19T03:01:56.725 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:56.725 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:56.726 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:01:56.726 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:56.607106+0000", 2024-04-19T03:01:56.726 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.551e-06 2024-04-19T03:01:56.726 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:56.726 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:56.726 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:56.726 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:56.611344+0000", 2024-04-19T03:01:56.726 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0042372240000000004 2024-04-19T03:01:56.726 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:56.726 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:56.726 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:01:56.726 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:56.611493+0000", 2024-04-19T03:01:56.726 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000149829 2024-04-19T03:01:56.727 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:56.727 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:56.727 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-04-19T03:01:56.727 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:56.611652+0000", 2024-04-19T03:01:56.727 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00015832300000000001 2024-04-19T03:01:56.727 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:56.727 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:56.727 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:56.727 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:56.727 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2024-04-19T03:01:56.727 INFO:teuthology.orchestra.run.smithi097.stdout: "num_ops": 18 2024-04-19T03:01:56.727 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-04-19T03:01:56.728 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T03:01:56.729 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-04-19T03:01:56.725+0000 7f35986ab700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18243) UID: 0 2024-04-19T03:01:56.821 INFO:tasks.radosbench.radosbench.0.smithi096.stdout: 19 16 43960 43944 144.537 122.062 0.0142148 0.00691239 2024-04-19T03:01:56.829 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:01:56.828+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:01:56.862 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-04-19T03:01:56.862 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [], 2024-04-19T03:01:56.862 INFO:teuthology.orchestra.run.smithi097.stdout: "complaint_time": 30, 2024-04-19T03:01:56.862 INFO:teuthology.orchestra.run.smithi097.stdout: "num_blocked_ops": 0 2024-04-19T03:01:56.862 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-04-19T03:01:56.875 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T03:01:56.930 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-04-19T03:01:56.925+0000 7f35986ab700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18243) UID: 0 2024-04-19T03:01:57.011 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-04-19T03:01:57.011 INFO:teuthology.orchestra.run.smithi097.stdout: "size": 20, 2024-04-19T03:01:57.011 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 600, 2024-04-19T03:01:57.011 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [ 2024-04-19T03:01:57.012 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.012 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:01:57.012 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:14.996966+0000", 2024-04-19T03:01:57.012 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 42.010152456, 2024-04-19T03:01:57.012 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.018946704000000002, 2024-04-19T03:01:57.012 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:01:57.012 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:57.012 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:01:57.012 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.012 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:01:57.012 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.996966+0000", 2024-04-19T03:01:57.012 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:57.013 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.013 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.013 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:01:57.013 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.996966+0000", 2024-04-19T03:01:57.013 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:57.013 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.013 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.013 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:01:57.013 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.996964+0000", 2024-04-19T03:01:57.013 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999971 2024-04-19T03:01:57.013 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.013 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.014 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:01:57.014 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.996982+0000", 2024-04-19T03:01:57.014 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.8306999999999999e-05 2024-04-19T03:01:57.014 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.014 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.014 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:01:57.014 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997027+0000", 2024-04-19T03:01:57.014 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.5274000000000001e-05 2024-04-19T03:01:57.014 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.014 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.015 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:01:57.015 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997047+0000", 2024-04-19T03:01:57.015 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.9726999999999999e-05 2024-04-19T03:01:57.015 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.015 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.015 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:57.015 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997203+0000", 2024-04-19T03:01:57.015 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000155847 2024-04-19T03:01:57.015 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.015 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.015 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op must wait for map", 2024-04-19T03:01:57.015 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997249+0000", 2024-04-19T03:01:57.015 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.5824e-05 2024-04-19T03:01:57.016 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.016 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.016 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:57.016 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.007264+0000", 2024-04-19T03:01:57.016 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.010015909 2024-04-19T03:01:57.016 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.016 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.016 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:01:57.016 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.007394+0000", 2024-04-19T03:01:57.016 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012931999999999999 2024-04-19T03:01:57.016 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.016 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.016 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-04-19T03:01:57.017 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.007537+0000", 2024-04-19T03:01:57.017 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014365 2024-04-19T03:01:57.017 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.017 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.017 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:01:57.017 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.012444+0000", 2024-04-19T03:01:57.017 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0049067260000000001 2024-04-19T03:01:57.017 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.017 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.017 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:57.017 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.015791+0000", 2024-04-19T03:01:57.017 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0033471109999999998 2024-04-19T03:01:57.017 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.018 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.018 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:01:57.018 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.015845+0000", 2024-04-19T03:01:57.018 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.4236e-05 2024-04-19T03:01:57.018 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.018 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.018 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:01:57.018 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.015913+0000", 2024-04-19T03:01:57.018 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.7397000000000005e-05 2024-04-19T03:01:57.018 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:57.019 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:57.019 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:57.019 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.019 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.019 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(mds.0.3:14 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:01:57.019 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:14.997079+0000", 2024-04-19T03:01:57.019 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 42.010039872, 2024-04-19T03:01:57.019 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.021951970000000001, 2024-04-19T03:01:57.019 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:01:57.019 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:57.019 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:01:57.019 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.020 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:01:57.020 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997079+0000", 2024-04-19T03:01:57.020 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:57.020 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.020 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.020 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:01:57.020 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997079+0000", 2024-04-19T03:01:57.020 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:57.020 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.020 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.020 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:01:57.020 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997077+0000", 2024-04-19T03:01:57.020 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999986 2024-04-19T03:01:57.021 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.021 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.021 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:01:57.021 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997087+0000", 2024-04-19T03:01:57.021 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.006e-05 2024-04-19T03:01:57.021 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.021 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.021 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:01:57.021 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997105+0000", 2024-04-19T03:01:57.021 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.8026999999999999e-05 2024-04-19T03:01:57.021 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.021 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.021 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:01:57.021 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997135+0000", 2024-04-19T03:01:57.022 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.9643000000000001e-05 2024-04-19T03:01:57.022 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.022 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.022 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:57.022 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997208+0000", 2024-04-19T03:01:57.022 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.3419999999999998e-05 2024-04-19T03:01:57.022 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.022 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.022 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op must wait for map", 2024-04-19T03:01:57.022 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997244+0000", 2024-04-19T03:01:57.022 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.5367000000000002e-05 2024-04-19T03:01:57.022 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.022 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.023 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:57.023 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.007357+0000", 2024-04-19T03:01:57.023 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.010112703000000001 2024-04-19T03:01:57.023 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.023 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.023 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:01:57.023 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.007479+0000", 2024-04-19T03:01:57.023 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012279599999999999 2024-04-19T03:01:57.023 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.023 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.023 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 1", 2024-04-19T03:01:57.023 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.007610+0000", 2024-04-19T03:01:57.023 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00013093499999999999 2024-04-19T03:01:57.024 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.024 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.024 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:01:57.024 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.012526+0000", 2024-04-19T03:01:57.024 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0049157519999999998 2024-04-19T03:01:57.024 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.024 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.024 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:57.024 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.018959+0000", 2024-04-19T03:01:57.024 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0064326009999999996 2024-04-19T03:01:57.024 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.024 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.025 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:01:57.025 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.019005+0000", 2024-04-19T03:01:57.025 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.6066999999999998e-05 2024-04-19T03:01:57.025 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.025 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.025 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:01:57.025 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.019031+0000", 2024-04-19T03:01:57.025 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.6009000000000001e-05 2024-04-19T03:01:57.025 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:57.025 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:57.025 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:57.025 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.025 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.026 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:01:57.026 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:14.997149+0000", 2024-04-19T03:01:57.026 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 42.009969251999998, 2024-04-19T03:01:57.026 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.021805590999999999, 2024-04-19T03:01:57.026 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:01:57.026 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:57.026 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:01:57.026 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.026 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:01:57.026 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997149+0000", 2024-04-19T03:01:57.026 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:57.026 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.027 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.027 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:01:57.027 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997149+0000", 2024-04-19T03:01:57.027 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:57.027 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.027 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.027 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:01:57.027 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997148+0000", 2024-04-19T03:01:57.027 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2024-04-19T03:01:57.027 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.027 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.027 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:01:57.027 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997166+0000", 2024-04-19T03:01:57.028 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.8233e-05 2024-04-19T03:01:57.028 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.028 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.028 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:01:57.028 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997182+0000", 2024-04-19T03:01:57.028 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5999999999999999e-05 2024-04-19T03:01:57.028 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.028 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.028 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:01:57.028 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997195+0000", 2024-04-19T03:01:57.028 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.252e-05 2024-04-19T03:01:57.028 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.029 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.029 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:57.029 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997348+0000", 2024-04-19T03:01:57.029 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000153115 2024-04-19T03:01:57.029 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.029 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.029 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:01:57.029 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997354+0000", 2024-04-19T03:01:57.029 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.9359999999999996e-06 2024-04-19T03:01:57.029 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.029 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.029 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:57.029 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.008147+0000", 2024-04-19T03:01:57.030 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.010793127 2024-04-19T03:01:57.030 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.030 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.030 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:01:57.030 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.008225+0000", 2024-04-19T03:01:57.030 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.7935999999999994e-05 2024-04-19T03:01:57.030 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.030 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.030 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-04-19T03:01:57.030 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.008377+0000", 2024-04-19T03:01:57.030 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00015159099999999999 2024-04-19T03:01:57.030 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.031 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.031 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:01:57.031 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.012629+0000", 2024-04-19T03:01:57.031 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0042520420000000001 2024-04-19T03:01:57.031 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.031 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.031 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:57.031 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.018871+0000", 2024-04-19T03:01:57.031 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0062425060000000001 2024-04-19T03:01:57.031 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.031 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.031 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:01:57.031 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.018910+0000", 2024-04-19T03:01:57.032 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.8482999999999997e-05 2024-04-19T03:01:57.032 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.032 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.032 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:01:57.032 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.018955+0000", 2024-04-19T03:01:57.032 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.5252e-05 2024-04-19T03:01:57.032 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:57.032 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:57.032 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:57.032 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.032 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.033 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(mds.0.3:36 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:01:57.033 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:14.997207+0000", 2024-04-19T03:01:57.033 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 42.009911701999997, 2024-04-19T03:01:57.033 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.022210431999999999, 2024-04-19T03:01:57.033 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:01:57.033 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:57.033 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:01:57.033 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.033 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:01:57.033 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997207+0000", 2024-04-19T03:01:57.033 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:57.033 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.033 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.034 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:01:57.034 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997207+0000", 2024-04-19T03:01:57.034 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:57.034 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.034 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.034 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:01:57.034 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997206+0000", 2024-04-19T03:01:57.034 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2024-04-19T03:01:57.034 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.034 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.034 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:01:57.034 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997218+0000", 2024-04-19T03:01:57.035 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2607e-05 2024-04-19T03:01:57.035 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.035 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.035 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:01:57.035 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997234+0000", 2024-04-19T03:01:57.035 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5583999999999999e-05 2024-04-19T03:01:57.035 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.035 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.035 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:01:57.035 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997248+0000", 2024-04-19T03:01:57.035 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4270000000000001e-05 2024-04-19T03:01:57.035 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.035 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.036 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:57.036 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997397+0000", 2024-04-19T03:01:57.036 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0001482 2024-04-19T03:01:57.036 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.036 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.036 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:01:57.036 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997407+0000", 2024-04-19T03:01:57.036 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0944000000000001e-05 2024-04-19T03:01:57.036 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.036 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.036 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:57.036 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.008173+0000", 2024-04-19T03:01:57.036 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.010765378000000001 2024-04-19T03:01:57.036 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.037 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.037 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:01:57.037 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.008278+0000", 2024-04-19T03:01:57.037 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00010538 2024-04-19T03:01:57.037 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.037 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.037 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 1", 2024-04-19T03:01:57.037 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.008423+0000", 2024-04-19T03:01:57.037 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014525599999999999 2024-04-19T03:01:57.037 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.037 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.037 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:01:57.037 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.012734+0000", 2024-04-19T03:01:57.038 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0043108590000000002 2024-04-19T03:01:57.038 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.038 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.038 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:57.038 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.019318+0000", 2024-04-19T03:01:57.038 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0065836130000000003 2024-04-19T03:01:57.038 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.038 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.038 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:01:57.038 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.019382+0000", 2024-04-19T03:01:57.038 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.3925999999999997e-05 2024-04-19T03:01:57.038 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.038 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.038 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:01:57.039 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.019417+0000", 2024-04-19T03:01:57.039 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.5454999999999999e-05 2024-04-19T03:01:57.039 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:57.039 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:57.039 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:57.039 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.039 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.039 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(mds.0.3:15 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:01:57.039 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:14.997260+0000", 2024-04-19T03:01:57.039 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 42.009858551000001, 2024-04-19T03:01:57.039 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.021842842000000001, 2024-04-19T03:01:57.039 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:01:57.039 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:57.039 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:01:57.040 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.040 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:01:57.040 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997260+0000", 2024-04-19T03:01:57.040 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:57.040 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.040 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.040 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:01:57.040 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997260+0000", 2024-04-19T03:01:57.040 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:57.040 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.040 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.040 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:01:57.040 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997259+0000", 2024-04-19T03:01:57.040 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999995 2024-04-19T03:01:57.041 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.041 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.041 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:01:57.041 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997270+0000", 2024-04-19T03:01:57.041 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0312999999999999e-05 2024-04-19T03:01:57.041 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.041 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.041 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:01:57.041 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997279+0000", 2024-04-19T03:01:57.041 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.7770000000000008e-06 2024-04-19T03:01:57.041 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.041 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.041 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:01:57.042 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997286+0000", 2024-04-19T03:01:57.042 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.0129999999999996e-06 2024-04-19T03:01:57.042 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.042 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.042 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:57.042 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997433+0000", 2024-04-19T03:01:57.042 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014774699999999999 2024-04-19T03:01:57.042 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.042 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.042 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:01:57.042 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997443+0000", 2024-04-19T03:01:57.042 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.414e-06 2024-04-19T03:01:57.042 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.043 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.043 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:57.043 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.008673+0000", 2024-04-19T03:01:57.043 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.011230789999999999 2024-04-19T03:01:57.043 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.043 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.043 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:01:57.043 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.008808+0000", 2024-04-19T03:01:57.043 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000134346 2024-04-19T03:01:57.043 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.043 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.043 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-04-19T03:01:57.043 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.008922+0000", 2024-04-19T03:01:57.044 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000114444 2024-04-19T03:01:57.044 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.044 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.044 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:01:57.044 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.013442+0000", 2024-04-19T03:01:57.044 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0045193439999999998 2024-04-19T03:01:57.044 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.044 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.044 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:57.044 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.019005+0000", 2024-04-19T03:01:57.044 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00556333 2024-04-19T03:01:57.044 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.044 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.045 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:01:57.045 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.019049+0000", 2024-04-19T03:01:57.045 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.4240000000000003e-05 2024-04-19T03:01:57.045 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.045 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.045 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:01:57.045 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.019103+0000", 2024-04-19T03:01:57.045 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.3706999999999999e-05 2024-04-19T03:01:57.045 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:57.045 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:57.045 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:57.045 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.045 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.045 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(mds.0.3:17 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:01:57.046 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:14.997292+0000", 2024-04-19T03:01:57.046 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 42.009826824000001, 2024-04-19T03:01:57.046 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.019573165999999999, 2024-04-19T03:01:57.046 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:01:57.046 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:57.046 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:01:57.046 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.046 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:01:57.046 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997292+0000", 2024-04-19T03:01:57.046 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:57.046 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.046 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.046 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:01:57.047 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997292+0000", 2024-04-19T03:01:57.047 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:57.047 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.047 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.047 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:01:57.047 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997291+0000", 2024-04-19T03:01:57.047 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999995 2024-04-19T03:01:57.047 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.047 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.047 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:01:57.047 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997297+0000", 2024-04-19T03:01:57.047 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.3900000000000001e-06 2024-04-19T03:01:57.048 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.048 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.048 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:01:57.048 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997316+0000", 2024-04-19T03:01:57.048 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.9406e-05 2024-04-19T03:01:57.048 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.048 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.048 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:01:57.048 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997353+0000", 2024-04-19T03:01:57.048 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.6563999999999998e-05 2024-04-19T03:01:57.048 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.048 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.048 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:57.049 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997447+0000", 2024-04-19T03:01:57.049 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.4463999999999995e-05 2024-04-19T03:01:57.049 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.049 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.049 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op must wait for map", 2024-04-19T03:01:57.049 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997458+0000", 2024-04-19T03:01:57.049 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0817e-05 2024-04-19T03:01:57.049 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.049 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.049 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:57.049 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.002013+0000", 2024-04-19T03:01:57.049 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.004555229 2024-04-19T03:01:57.049 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.049 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.050 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:01:57.050 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.002943+0000", 2024-04-19T03:01:57.050 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00092983200000000001 2024-04-19T03:01:57.050 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.050 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.050 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-04-19T03:01:57.050 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.003257+0000", 2024-04-19T03:01:57.050 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00031455399999999998 2024-04-19T03:01:57.050 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.050 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.050 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:01:57.050 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.014107+0000", 2024-04-19T03:01:57.050 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.010849648 2024-04-19T03:01:57.051 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.051 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.051 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:57.051 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.016767+0000", 2024-04-19T03:01:57.051 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0026594990000000001 2024-04-19T03:01:57.051 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.051 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.051 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:01:57.051 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.016825+0000", 2024-04-19T03:01:57.051 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.8264000000000003e-05 2024-04-19T03:01:57.051 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.051 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.051 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:01:57.052 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.016865+0000", 2024-04-19T03:01:57.052 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.0108999999999998e-05 2024-04-19T03:01:57.052 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:57.052 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:57.052 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:57.052 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.052 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.052 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(mds.0.3:22 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:01:57.052 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:14.997383+0000", 2024-04-19T03:01:57.052 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 42.009736044, 2024-04-19T03:01:57.052 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.019634641000000001, 2024-04-19T03:01:57.052 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:01:57.052 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "started", 2024-04-19T03:01:57.053 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:01:57.053 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.053 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:01:57.053 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997383+0000", 2024-04-19T03:01:57.053 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:57.053 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.053 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.053 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:01:57.053 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997383+0000", 2024-04-19T03:01:57.053 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:57.053 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.053 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.053 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:01:57.054 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997381+0000", 2024-04-19T03:01:57.054 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999986 2024-04-19T03:01:57.054 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.054 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.054 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:01:57.054 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997399+0000", 2024-04-19T03:01:57.054 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.802e-05 2024-04-19T03:01:57.054 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.054 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.054 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:01:57.054 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997417+0000", 2024-04-19T03:01:57.055 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.7581e-05 2024-04-19T03:01:57.055 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.055 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.055 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:01:57.055 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997429+0000", 2024-04-19T03:01:57.055 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1803e-05 2024-04-19T03:01:57.055 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.055 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.055 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:57.055 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997540+0000", 2024-04-19T03:01:57.055 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000111397 2024-04-19T03:01:57.055 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.055 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.056 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:01:57.056 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997552+0000", 2024-04-19T03:01:57.056 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1643e-05 2024-04-19T03:01:57.056 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.056 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.056 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:57.056 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.006836+0000", 2024-04-19T03:01:57.056 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0092841940000000008 2024-04-19T03:01:57.056 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.056 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.056 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:01:57.056 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.006982+0000", 2024-04-19T03:01:57.057 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014572899999999999 2024-04-19T03:01:57.057 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.057 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.057 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:01:57.057 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.017017+0000", 2024-04-19T03:01:57.057 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.010035571 2024-04-19T03:01:57.057 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:57.057 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:57.057 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:57.057 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.057 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.057 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(mds.0.3:23 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:01:57.058 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:14.997449+0000", 2024-04-19T03:01:57.058 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 42.009669502999998, 2024-04-19T03:01:57.058 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.022679250000000001, 2024-04-19T03:01:57.058 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:01:57.058 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "started", 2024-04-19T03:01:57.058 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:01:57.058 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.058 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:01:57.058 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997449+0000", 2024-04-19T03:01:57.058 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:57.058 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.058 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.059 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:01:57.059 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997449+0000", 2024-04-19T03:01:57.059 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:57.059 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.059 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.059 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:01:57.059 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997448+0000", 2024-04-19T03:01:57.059 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999995 2024-04-19T03:01:57.059 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.059 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.060 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:01:57.060 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997452+0000", 2024-04-19T03:01:57.060 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.0369999999999996e-06 2024-04-19T03:01:57.060 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.060 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.060 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:01:57.060 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997461+0000", 2024-04-19T03:01:57.061 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.6100000000000006e-06 2024-04-19T03:01:57.061 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.061 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.061 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:01:57.061 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997468+0000", 2024-04-19T03:01:57.061 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.8360000000000003e-06 2024-04-19T03:01:57.061 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.061 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.061 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:57.061 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997546+0000", 2024-04-19T03:01:57.061 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.7956999999999999e-05 2024-04-19T03:01:57.061 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.061 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.061 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:01:57.062 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997555+0000", 2024-04-19T03:01:57.062 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.2269999999999999e-06 2024-04-19T03:01:57.062 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.062 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.062 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:57.062 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.010065+0000", 2024-04-19T03:01:57.062 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.012509457999999999 2024-04-19T03:01:57.062 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.062 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.062 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:01:57.062 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.010187+0000", 2024-04-19T03:01:57.062 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000122059 2024-04-19T03:01:57.063 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.063 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.063 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:01:57.063 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.020128+0000", 2024-04-19T03:01:57.063 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0099417529999999994 2024-04-19T03:01:57.063 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:57.063 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:57.063 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:57.063 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.063 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.063 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(mds.0.3:25 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:01:57.063 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:14.997485+0000", 2024-04-19T03:01:57.064 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 42.009634036999998, 2024-04-19T03:01:57.064 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.021633427, 2024-04-19T03:01:57.064 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:01:57.064 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "started", 2024-04-19T03:01:57.064 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:01:57.064 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.064 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:01:57.064 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997485+0000", 2024-04-19T03:01:57.064 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:57.064 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.064 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.064 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:01:57.064 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997485+0000", 2024-04-19T03:01:57.065 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:57.065 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.065 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.065 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:01:57.065 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997484+0000", 2024-04-19T03:01:57.065 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2024-04-19T03:01:57.065 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.065 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.065 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:01:57.065 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997490+0000", 2024-04-19T03:01:57.065 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.857e-06 2024-04-19T03:01:57.065 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.065 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.066 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:01:57.066 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997505+0000", 2024-04-19T03:01:57.066 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.518e-05 2024-04-19T03:01:57.066 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.066 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.066 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:01:57.066 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997520+0000", 2024-04-19T03:01:57.066 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5026e-05 2024-04-19T03:01:57.066 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.066 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.066 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:57.066 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997607+0000", 2024-04-19T03:01:57.067 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.7107000000000005e-05 2024-04-19T03:01:57.067 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.067 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.067 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op must wait for map", 2024-04-19T03:01:57.067 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997614+0000", 2024-04-19T03:01:57.067 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.0539999999999997e-06 2024-04-19T03:01:57.067 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.067 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.067 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:57.067 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.009808+0000", 2024-04-19T03:01:57.067 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.012194371000000001 2024-04-19T03:01:57.067 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.067 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.068 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:01:57.068 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.010107+0000", 2024-04-19T03:01:57.068 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000298731 2024-04-19T03:01:57.068 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.068 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.068 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:01:57.068 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.019118+0000", 2024-04-19T03:01:57.068 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0090109839999999997 2024-04-19T03:01:57.068 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:57.068 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:57.068 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:57.068 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.068 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.068 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4755.0:11277 5.c 5:38c3ceb2:::benchmark_data_smithi096_19531_object11276:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T03:01:57.069 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:42.059676+0000", 2024-04-19T03:01:57.069 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 14.947442414999999, 2024-04-19T03:01:57.069 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.029909680000000001, 2024-04-19T03:01:57.069 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:01:57.069 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:57.069 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-04-19T03:01:57.069 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4755", 2024-04-19T03:01:57.069 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:57.069 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 11277 2024-04-19T03:01:57.069 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.069 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:01:57.069 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.070 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:01:57.070 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.059676+0000", 2024-04-19T03:01:57.070 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:57.070 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.070 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.070 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:01:57.070 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.059676+0000", 2024-04-19T03:01:57.070 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:57.070 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.070 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.070 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:01:57.070 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.059665+0000", 2024-04-19T03:01:57.071 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999886 2024-04-19T03:01:57.071 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.071 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.071 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:01:57.071 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.059777+0000", 2024-04-19T03:01:57.071 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000111953 2024-04-19T03:01:57.071 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.071 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.071 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:01:57.071 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.059789+0000", 2024-04-19T03:01:57.071 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1809e-05 2024-04-19T03:01:57.071 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.071 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.072 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:01:57.072 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.059797+0000", 2024-04-19T03:01:57.072 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.2090000000000005e-06 2024-04-19T03:01:57.072 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.072 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.072 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:57.072 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.060528+0000", 2024-04-19T03:01:57.072 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00073144499999999995 2024-04-19T03:01:57.072 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.072 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.072 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:01:57.072 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.060662+0000", 2024-04-19T03:01:57.073 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000133435 2024-04-19T03:01:57.073 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.073 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.073 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-04-19T03:01:57.073 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.060766+0000", 2024-04-19T03:01:57.073 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00010473500000000001 2024-04-19T03:01:57.073 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.073 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.073 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:01:57.073 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.067649+0000", 2024-04-19T03:01:57.073 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.006882684 2024-04-19T03:01:57.073 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.073 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.074 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:57.074 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.089475+0000", 2024-04-19T03:01:57.074 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.021826196999999999 2024-04-19T03:01:57.074 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.074 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.074 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:01:57.074 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.089535+0000", 2024-04-19T03:01:57.074 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.9239e-05 2024-04-19T03:01:57.074 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.074 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.074 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:01:57.074 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.089586+0000", 2024-04-19T03:01:57.075 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.1288000000000001e-05 2024-04-19T03:01:57.075 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:57.075 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:57.075 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:57.075 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.075 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.075 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4755.0:11280 5.6 5:6e34f5e7:::benchmark_data_smithi096_19531_object11279:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T03:01:57.075 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:42.060002+0000", 2024-04-19T03:01:57.075 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 14.947117039, 2024-04-19T03:01:57.075 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.028171841999999999, 2024-04-19T03:01:57.075 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:01:57.075 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:57.076 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-04-19T03:01:57.076 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4755", 2024-04-19T03:01:57.076 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:57.076 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 11280 2024-04-19T03:01:57.076 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.076 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:01:57.076 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.076 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:01:57.076 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.060002+0000", 2024-04-19T03:01:57.076 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:57.076 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.076 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.076 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:01:57.076 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.060002+0000", 2024-04-19T03:01:57.077 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:57.077 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.077 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.077 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:01:57.077 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.060000+0000", 2024-04-19T03:01:57.077 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2024-04-19T03:01:57.077 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.077 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.077 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:01:57.077 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.060120+0000", 2024-04-19T03:01:57.077 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00011941400000000001 2024-04-19T03:01:57.077 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.077 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.077 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:01:57.078 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.060132+0000", 2024-04-19T03:01:57.078 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2197e-05 2024-04-19T03:01:57.078 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.078 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.078 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:01:57.078 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.060141+0000", 2024-04-19T03:01:57.078 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.6829999999999997e-06 2024-04-19T03:01:57.078 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.078 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.078 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:57.078 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.060194+0000", 2024-04-19T03:01:57.079 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.3395e-05 2024-04-19T03:01:57.079 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.079 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.079 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:01:57.079 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.060333+0000", 2024-04-19T03:01:57.079 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00013935799999999999 2024-04-19T03:01:57.079 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.079 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.079 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-04-19T03:01:57.079 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.060477+0000", 2024-04-19T03:01:57.079 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000143938 2024-04-19T03:01:57.080 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.080 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.080 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:01:57.080 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.067752+0000", 2024-04-19T03:01:57.080 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0072741580000000002 2024-04-19T03:01:57.080 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.080 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.080 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:57.080 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.088041+0000", 2024-04-19T03:01:57.080 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.020288955000000001 2024-04-19T03:01:57.081 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.081 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.081 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:01:57.081 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.088113+0000", 2024-04-19T03:01:57.081 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.2492999999999999e-05 2024-04-19T03:01:57.081 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.081 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.081 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:01:57.081 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.088173+0000", 2024-04-19T03:01:57.081 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.0418999999999999e-05 2024-04-19T03:01:57.081 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:57.081 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:57.082 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:57.082 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.082 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.082 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4755.0:11274 5.e e26/22 5:7c846032:::benchmark_data_smithi096_19531_object11273:head v 26'697, mlcod=26'692)", 2024-04-19T03:01:57.082 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:42.065726+0000", 2024-04-19T03:01:57.082 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 14.941392512, 2024-04-19T03:01:57.082 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.028607227999999998, 2024-04-19T03:01:57.082 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:01:57.082 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:57.082 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:01:57.082 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.082 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:01:57.083 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.065726+0000", 2024-04-19T03:01:57.083 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:57.083 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.083 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.083 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:01:57.084 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.065726+0000", 2024-04-19T03:01:57.084 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:57.084 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.084 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.084 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:01:57.084 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.065725+0000", 2024-04-19T03:01:57.084 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2024-04-19T03:01:57.084 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.084 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.085 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:01:57.085 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.066818+0000", 2024-04-19T03:01:57.085 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0010930110000000001 2024-04-19T03:01:57.085 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.085 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.085 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:01:57.085 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.066826+0000", 2024-04-19T03:01:57.085 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.0609999999999996e-06 2024-04-19T03:01:57.085 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.085 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.085 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:01:57.085 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.066831+0000", 2024-04-19T03:01:57.085 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.7500000000000003e-06 2024-04-19T03:01:57.085 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.085 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.086 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:57.086 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.066857+0000", 2024-04-19T03:01:57.086 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.6126999999999999e-05 2024-04-19T03:01:57.086 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.086 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.086 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:01:57.086 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.066868+0000", 2024-04-19T03:01:57.086 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1113e-05 2024-04-19T03:01:57.086 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.086 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.086 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:01:57.086 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.094266+0000", 2024-04-19T03:01:57.086 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.027397731000000002 2024-04-19T03:01:57.087 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.087 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.087 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:01:57.087 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.094333+0000", 2024-04-19T03:01:57.087 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.7230000000000005e-05 2024-04-19T03:01:57.087 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:57.087 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:57.087 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:57.087 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.087 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.087 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4755.0:11279 5.8 e26/22 5:10b60c58:::benchmark_data_smithi096_19531_object11278:head v 26'723, mlcod=26'719)", 2024-04-19T03:01:57.087 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:42.066841+0000", 2024-04-19T03:01:57.087 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 14.940277197, 2024-04-19T03:01:57.087 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.021736267, 2024-04-19T03:01:57.088 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:01:57.088 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:57.088 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:01:57.088 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.088 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:01:57.088 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.066841+0000", 2024-04-19T03:01:57.088 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:57.088 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.088 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.088 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:01:57.088 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.066841+0000", 2024-04-19T03:01:57.088 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:57.088 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.088 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.089 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:01:57.089 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.066841+0000", 2024-04-19T03:01:57.089 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999995 2024-04-19T03:01:57.089 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.089 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.089 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:01:57.089 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.066876+0000", 2024-04-19T03:01:57.089 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.4790999999999999e-05 2024-04-19T03:01:57.089 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.089 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.089 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:01:57.089 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.066880+0000", 2024-04-19T03:01:57.089 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.3610000000000003e-06 2024-04-19T03:01:57.090 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.090 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.090 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:01:57.090 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.066883+0000", 2024-04-19T03:01:57.090 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.4079999999999998e-06 2024-04-19T03:01:57.090 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.090 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.090 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:57.090 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.066929+0000", 2024-04-19T03:01:57.090 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.5444000000000001e-05 2024-04-19T03:01:57.090 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.090 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.090 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:01:57.091 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.066951+0000", 2024-04-19T03:01:57.091 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.2578999999999998e-05 2024-04-19T03:01:57.091 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.091 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.091 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:01:57.091 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.088518+0000", 2024-04-19T03:01:57.091 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.021566617 2024-04-19T03:01:57.091 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.091 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.091 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:01:57.091 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.088578+0000", 2024-04-19T03:01:57.091 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.9655999999999999e-05 2024-04-19T03:01:57.091 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:57.091 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:57.092 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:57.092 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.092 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.092 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4755.0:11282 5.e e26/22 5:75b7c510:::benchmark_data_smithi096_19531_object11281:head v 26'698, mlcod=26'693)", 2024-04-19T03:01:57.092 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:42.066923+0000", 2024-04-19T03:01:57.092 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 14.94019533, 2024-04-19T03:01:57.092 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.027436461999999998, 2024-04-19T03:01:57.092 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:01:57.093 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:57.093 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:01:57.093 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.093 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:01:57.093 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.066923+0000", 2024-04-19T03:01:57.093 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:57.093 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.093 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.093 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:01:57.093 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.066923+0000", 2024-04-19T03:01:57.093 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:57.093 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.093 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.094 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:01:57.094 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.066923+0000", 2024-04-19T03:01:57.094 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999995 2024-04-19T03:01:57.094 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.094 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.094 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:01:57.094 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.066955+0000", 2024-04-19T03:01:57.094 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.2060999999999997e-05 2024-04-19T03:01:57.094 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.094 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.094 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:01:57.094 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.066962+0000", 2024-04-19T03:01:57.094 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.1969999999999999e-06 2024-04-19T03:01:57.095 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.095 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.095 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:01:57.095 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.066967+0000", 2024-04-19T03:01:57.095 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.6589999999999998e-06 2024-04-19T03:01:57.095 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.095 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.095 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:57.095 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.067762+0000", 2024-04-19T03:01:57.095 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00079538199999999997 2024-04-19T03:01:57.095 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.095 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.095 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:01:57.095 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.067782+0000", 2024-04-19T03:01:57.096 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.9432999999999998e-05 2024-04-19T03:01:57.096 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.096 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.096 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:01:57.096 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.094339+0000", 2024-04-19T03:01:57.096 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.026556778999999999 2024-04-19T03:01:57.096 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.096 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.096 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:01:57.096 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.094360+0000", 2024-04-19T03:01:57.096 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.1246e-05 2024-04-19T03:01:57.096 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:57.096 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:57.096 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:57.097 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.097 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.097 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4755.0:11291 5.a 5:5ee9d828:::benchmark_data_smithi096_19531_object11290:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T03:01:57.097 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:42.067725+0000", 2024-04-19T03:01:57.097 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 14.939393219999999, 2024-04-19T03:01:57.097 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.021089111000000001, 2024-04-19T03:01:57.097 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:01:57.097 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:57.097 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-04-19T03:01:57.097 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4755", 2024-04-19T03:01:57.097 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:57.097 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 11291 2024-04-19T03:01:57.097 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.098 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:01:57.098 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.098 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:01:57.098 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.067725+0000", 2024-04-19T03:01:57.098 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:57.098 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.098 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.098 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:01:57.098 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.067725+0000", 2024-04-19T03:01:57.098 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:57.098 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.098 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.098 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:01:57.099 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.067724+0000", 2024-04-19T03:01:57.099 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2024-04-19T03:01:57.099 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.099 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.099 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:01:57.099 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.067842+0000", 2024-04-19T03:01:57.099 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000117691 2024-04-19T03:01:57.099 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.099 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.099 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:01:57.099 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.067853+0000", 2024-04-19T03:01:57.099 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0679000000000001e-05 2024-04-19T03:01:57.099 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.099 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.099 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:01:57.100 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.067859+0000", 2024-04-19T03:01:57.100 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.9510000000000003e-06 2024-04-19T03:01:57.100 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.100 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.100 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:57.100 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.067905+0000", 2024-04-19T03:01:57.100 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.6242999999999998e-05 2024-04-19T03:01:57.100 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.100 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.100 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:01:57.100 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.085335+0000", 2024-04-19T03:01:57.100 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.017430451 2024-04-19T03:01:57.100 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.101 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.101 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 1", 2024-04-19T03:01:57.101 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.085538+0000", 2024-04-19T03:01:57.101 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000202511 2024-04-19T03:01:57.101 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.101 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.101 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:57.101 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.087988+0000", 2024-04-19T03:01:57.101 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0024505780000000001 2024-04-19T03:01:57.101 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.101 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.101 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:01:57.101 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.088672+0000", 2024-04-19T03:01:57.101 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00068377900000000003 2024-04-19T03:01:57.101 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.102 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.102 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:01:57.102 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.088757+0000", 2024-04-19T03:01:57.102 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.4384999999999999e-05 2024-04-19T03:01:57.102 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.102 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.102 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:01:57.102 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.088815+0000", 2024-04-19T03:01:57.102 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.7995999999999998e-05 2024-04-19T03:01:57.102 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:57.102 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:57.102 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:57.102 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.102 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.103 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4755.0:11293 5.c 5:31728bfd:::benchmark_data_smithi096_19531_object11292:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T03:01:57.103 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:42.068359+0000", 2024-04-19T03:01:57.103 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 14.938759506, 2024-04-19T03:01:57.103 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.022306475999999999, 2024-04-19T03:01:57.103 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:01:57.103 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:57.103 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-04-19T03:01:57.103 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4755", 2024-04-19T03:01:57.103 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:57.103 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 11293 2024-04-19T03:01:57.103 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.103 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:01:57.103 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.104 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:01:57.104 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.068359+0000", 2024-04-19T03:01:57.104 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:57.104 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.104 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.104 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:01:57.104 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.068359+0000", 2024-04-19T03:01:57.104 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:57.104 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.104 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.104 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:01:57.104 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.068358+0000", 2024-04-19T03:01:57.104 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2024-04-19T03:01:57.104 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.105 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.105 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:01:57.105 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.068427+0000", 2024-04-19T03:01:57.105 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.9139000000000003e-05 2024-04-19T03:01:57.105 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.105 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.105 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:01:57.105 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.085292+0000", 2024-04-19T03:01:57.105 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.016864371 2024-04-19T03:01:57.105 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.105 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.105 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:01:57.105 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.085306+0000", 2024-04-19T03:01:57.105 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.434e-05 2024-04-19T03:01:57.106 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.106 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.106 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:57.106 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.085404+0000", 2024-04-19T03:01:57.106 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.8145000000000003e-05 2024-04-19T03:01:57.106 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.106 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.106 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:01:57.106 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.085569+0000", 2024-04-19T03:01:57.106 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00016504099999999999 2024-04-19T03:01:57.106 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.106 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.106 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-04-19T03:01:57.107 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.085739+0000", 2024-04-19T03:01:57.107 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000170099 2024-04-19T03:01:57.107 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.107 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.107 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:01:57.107 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.089603+0000", 2024-04-19T03:01:57.107 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0038636080000000001 2024-04-19T03:01:57.107 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.107 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.107 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:57.107 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.090578+0000", 2024-04-19T03:01:57.107 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00097513199999999997 2024-04-19T03:01:57.107 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.107 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.108 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:01:57.108 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.090618+0000", 2024-04-19T03:01:57.108 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.9987999999999997e-05 2024-04-19T03:01:57.108 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.108 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.108 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:01:57.108 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.090666+0000", 2024-04-19T03:01:57.108 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.7420999999999999e-05 2024-04-19T03:01:57.108 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:57.108 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:57.108 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:57.108 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.108 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.108 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4755.0:11288 5.0 e26/22 5:042458d0:::benchmark_data_smithi096_19531_object11287:head v 26'772, mlcod=26'770)", 2024-04-19T03:01:57.109 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:42.068428+0000", 2024-04-19T03:01:57.109 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 14.938691105, 2024-04-19T03:01:57.109 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.020774925, 2024-04-19T03:01:57.109 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:01:57.109 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:57.109 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:01:57.109 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.109 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:01:57.109 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.068428+0000", 2024-04-19T03:01:57.109 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:57.109 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.109 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.109 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:01:57.109 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.068428+0000", 2024-04-19T03:01:57.110 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:57.110 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.110 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.110 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:01:57.110 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.068427+0000", 2024-04-19T03:01:57.110 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999995 2024-04-19T03:01:57.110 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.110 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.110 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:01:57.110 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.068481+0000", 2024-04-19T03:01:57.110 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.3866999999999998e-05 2024-04-19T03:01:57.110 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.111 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.111 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:01:57.111 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.085273+0000", 2024-04-19T03:01:57.111 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.016792372999999999 2024-04-19T03:01:57.111 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.111 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.111 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:01:57.111 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.085288+0000", 2024-04-19T03:01:57.111 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4941e-05 2024-04-19T03:01:57.111 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.111 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.111 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:57.111 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.085350+0000", 2024-04-19T03:01:57.111 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.1550999999999994e-05 2024-04-19T03:01:57.112 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.112 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.112 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:01:57.112 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.085384+0000", 2024-04-19T03:01:57.112 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.4915e-05 2024-04-19T03:01:57.112 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.112 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.112 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:01:57.112 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.089164+0000", 2024-04-19T03:01:57.112 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0037794410000000001 2024-04-19T03:01:57.112 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.112 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.112 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:01:57.112 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.089202+0000", 2024-04-19T03:01:57.112 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.8519000000000002e-05 2024-04-19T03:01:57.113 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:57.113 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:57.113 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:57.113 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.113 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.113 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4755.0:43309 5.5 5:a621e8bb:::benchmark_data_smithi096_19531_object43308:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-19T03:01:57.113 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:56.475880+0000", 2024-04-19T03:01:57.113 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 0.53123876699999995, 2024-04-19T03:01:57.113 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.017826946, 2024-04-19T03:01:57.113 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:01:57.113 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:57.113 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-04-19T03:01:57.113 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4755", 2024-04-19T03:01:57.113 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:57.114 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 43309 2024-04-19T03:01:57.114 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.114 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:01:57.114 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.114 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:01:57.114 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:56.475880+0000", 2024-04-19T03:01:57.114 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:57.114 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.114 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.114 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:01:57.114 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:56.475880+0000", 2024-04-19T03:01:57.115 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:57.115 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.115 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.115 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:01:57.115 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:56.475879+0000", 2024-04-19T03:01:57.115 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2024-04-19T03:01:57.115 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.115 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.115 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:01:57.115 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:56.475928+0000", 2024-04-19T03:01:57.115 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.9211e-05 2024-04-19T03:01:57.115 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.115 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.115 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:01:57.116 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:56.475938+0000", 2024-04-19T03:01:57.116 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0584000000000001e-05 2024-04-19T03:01:57.116 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.116 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.116 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:01:57.116 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:56.475945+0000", 2024-04-19T03:01:57.116 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.9249999999999998e-06 2024-04-19T03:01:57.116 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.116 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.116 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:57.116 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:56.479557+0000", 2024-04-19T03:01:57.116 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0036113260000000002 2024-04-19T03:01:57.116 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.117 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.117 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:01:57.117 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:56.479658+0000", 2024-04-19T03:01:57.117 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00010131700000000001 2024-04-19T03:01:57.117 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.117 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.117 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-04-19T03:01:57.117 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:56.479740+0000", 2024-04-19T03:01:57.117 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.1746e-05 2024-04-19T03:01:57.117 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.117 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.117 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:01:57.117 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:56.486608+0000", 2024-04-19T03:01:57.118 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0068677649999999996 2024-04-19T03:01:57.118 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.118 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.118 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:57.118 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:56.493624+0000", 2024-04-19T03:01:57.118 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0070163109999999999 2024-04-19T03:01:57.118 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.118 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.118 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:01:57.118 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:56.493678+0000", 2024-04-19T03:01:57.118 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.4107999999999998e-05 2024-04-19T03:01:57.118 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.119 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.119 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:01:57.119 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:56.493707+0000", 2024-04-19T03:01:57.119 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.881e-05 2024-04-19T03:01:57.119 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:57.119 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:57.119 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:57.119 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.119 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.119 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4755.0:43321 5.5 5:a20a2166:::benchmark_data_smithi096_19531_object43320:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-19T03:01:57.119 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:56.482048+0000", 2024-04-19T03:01:57.119 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 0.52507090700000003, 2024-04-19T03:01:57.119 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.016772601000000002, 2024-04-19T03:01:57.119 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:01:57.120 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:57.120 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-04-19T03:01:57.120 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4755", 2024-04-19T03:01:57.120 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:57.120 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 43321 2024-04-19T03:01:57.120 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.120 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:01:57.120 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.120 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:01:57.120 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:56.482048+0000", 2024-04-19T03:01:57.120 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:57.120 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.120 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.120 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:01:57.121 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:56.482048+0000", 2024-04-19T03:01:57.121 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:57.121 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.121 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.121 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:01:57.121 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:56.482047+0000", 2024-04-19T03:01:57.121 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2024-04-19T03:01:57.121 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.121 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.121 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:01:57.121 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:56.482139+0000", 2024-04-19T03:01:57.121 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.2551000000000002e-05 2024-04-19T03:01:57.121 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.121 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.122 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:01:57.122 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:56.482158+0000", 2024-04-19T03:01:57.122 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.8638e-05 2024-04-19T03:01:57.122 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.122 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.122 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:01:57.122 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:56.482165+0000", 2024-04-19T03:01:57.122 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.1960000000000002e-06 2024-04-19T03:01:57.122 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.122 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.122 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:57.122 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:56.484298+0000", 2024-04-19T03:01:57.122 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0021330670000000002 2024-04-19T03:01:57.123 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.123 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.123 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:01:57.123 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:56.484470+0000", 2024-04-19T03:01:57.123 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000171655 2024-04-19T03:01:57.123 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.123 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.123 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-04-19T03:01:57.123 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:56.484620+0000", 2024-04-19T03:01:57.123 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000150538 2024-04-19T03:01:57.123 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.123 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.123 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:01:57.123 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:56.487331+0000", 2024-04-19T03:01:57.124 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.002710315 2024-04-19T03:01:57.124 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.124 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.124 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:57.124 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:56.498750+0000", 2024-04-19T03:01:57.124 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.011419034 2024-04-19T03:01:57.124 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.124 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.124 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:01:57.124 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:56.498783+0000", 2024-04-19T03:01:57.124 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.3501000000000003e-05 2024-04-19T03:01:57.124 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.124 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.124 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:01:57.125 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:56.498820+0000", 2024-04-19T03:01:57.125 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.6964e-05 2024-04-19T03:01:57.125 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:57.125 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:57.125 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:57.125 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.125 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.125 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4755.0:43739 5.c 5:3f98ce5a:::benchmark_data_smithi096_19531_object43738:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-19T03:01:57.125 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:56.699042+0000", 2024-04-19T03:01:57.125 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 0.30807617799999998, 2024-04-19T03:01:57.125 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.018275395, 2024-04-19T03:01:57.125 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:01:57.125 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:57.125 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-04-19T03:01:57.126 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4755", 2024-04-19T03:01:57.126 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:57.126 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 43739 2024-04-19T03:01:57.126 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.126 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:01:57.126 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.126 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:01:57.126 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:56.699042+0000", 2024-04-19T03:01:57.126 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:57.126 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.126 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.126 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:01:57.126 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:56.699042+0000", 2024-04-19T03:01:57.126 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:01:57.127 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.127 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.127 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:01:57.127 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:56.699041+0000", 2024-04-19T03:01:57.127 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2024-04-19T03:01:57.127 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.127 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.127 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:01:57.127 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:56.699129+0000", 2024-04-19T03:01:57.127 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.7989000000000001e-05 2024-04-19T03:01:57.127 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.127 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.127 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:01:57.127 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:56.699140+0000", 2024-04-19T03:01:57.128 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1034e-05 2024-04-19T03:01:57.128 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.128 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.128 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:01:57.128 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:56.699146+0000", 2024-04-19T03:01:57.128 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.9000000000000003e-06 2024-04-19T03:01:57.128 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.128 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.128 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:01:57.128 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:56.706318+0000", 2024-04-19T03:01:57.128 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0071715449999999997 2024-04-19T03:01:57.128 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.128 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.128 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:01:57.128 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:56.706444+0000", 2024-04-19T03:01:57.129 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012612499999999999 2024-04-19T03:01:57.129 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.129 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.129 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-04-19T03:01:57.129 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:56.706559+0000", 2024-04-19T03:01:57.129 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000114852 2024-04-19T03:01:57.129 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.129 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.129 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:01:57.129 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:56.711087+0000", 2024-04-19T03:01:57.129 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0045284790000000002 2024-04-19T03:01:57.129 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.129 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.129 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:57.130 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:56.717260+0000", 2024-04-19T03:01:57.130 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0061730229999999997 2024-04-19T03:01:57.130 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.130 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.130 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:01:57.130 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:56.717298+0000", 2024-04-19T03:01:57.130 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.7339999999999998e-05 2024-04-19T03:01:57.130 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:01:57.130 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:01:57.130 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:01:57.130 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:56.717318+0000", 2024-04-19T03:01:57.130 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.0119000000000002e-05 2024-04-19T03:01:57.130 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:57.130 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:57.131 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:57.131 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:01:57.131 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:01:57.131 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-04-19T03:01:57.134 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T03:01:57.136 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-19T03:01:57.139 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-04-19T03:01:57.129+0000 7f35986ab700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18243) UID: 0 2024-04-19T03:01:57.140 INFO:teuthology.orchestra.run.smithi096.stderr:dumped all 2024-04-19T03:01:57.140 INFO:teuthology.orchestra.run.smithi096.stdout:{"pg_ready":true,"pg_map":{"version":52,"stamp":"2024-04-19T03:01:55.956004+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2604731226,"num_objects":39760,"num_object_clones":0,"num_object_copies":79520,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39760,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":39984,"num_write_kb":2546578,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39932,"ondisk_log_size":39932,"up":242,"acting":242,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":242,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":467584,"kb_used_data":311908,"kb_used_omap":4,"kb_used_meta":155643,"kb_avail":282647936,"statfs":{"total":289910292480,"available":289431486464,"internally_reserved":0,"allocated":319393792,"data_stored":5095147621,"data_compressed":9759474,"data_compressed_allocated":318427136,"data_compressed_original":5094801408,"omap_allocated":4782,"internal_metadata":159378770},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[4,1,6,7],"upper_bound":16},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1440153600,"num_objects":21975,"num_object_clones":0,"num_object_copies":43950,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21975,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21975,"num_write_kb":1406400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.918367"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-19T03:01:51.062355+0000","last_change":"2024-04-19T03:01:15.019292+0000","last_active":"2024-04-19T03:01:51.062355+0000","last_peered":"2024-04-19T03:01:51.062355+0000","last_clean":"2024-04-19T03:01:51.062355+0000","last_became_active":"2024-04-19T03:01:15.017907+0000","last_became_peered":"2024-04-19T03:01:15.017907+0000","last_unstale":"2024-04-19T03:01:51.062355+0000","last_undegraded":"2024-04-19T03:01:51.062355+0000","last_fullsized":"2024-04-19T03:01:51.062355+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:13:26.030579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-19T03:01:51.060101+0000","last_change":"2024-04-19T03:01:15.018719+0000","last_active":"2024-04-19T03:01:51.060101+0000","last_peered":"2024-04-19T03:01:51.060101+0000","last_clean":"2024-04-19T03:01:51.060101+0000","last_became_active":"2024-04-19T03:01:15.018070+0000","last_became_peered":"2024-04-19T03:01:15.018070+0000","last_unstale":"2024-04-19T03:01:51.060101+0000","last_undegraded":"2024-04-19T03:01:51.060101+0000","last_fullsized":"2024-04-19T03:01:51.060101+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:48:13.389356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-19T03:01:51.053611+0000","last_change":"2024-04-19T03:01:15.015884+0000","last_active":"2024-04-19T03:01:51.053611+0000","last_peered":"2024-04-19T03:01:51.053611+0000","last_clean":"2024-04-19T03:01:51.053611+0000","last_became_active":"2024-04-19T03:01:15.014599+0000","last_became_peered":"2024-04-19T03:01:15.014599+0000","last_unstale":"2024-04-19T03:01:51.053611+0000","last_undegraded":"2024-04-19T03:01:51.053611+0000","last_fullsized":"2024-04-19T03:01:51.053611+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:35:19.436344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-19T03:01:51.053203+0000","last_change":"2024-04-19T03:01:15.015186+0000","last_active":"2024-04-19T03:01:51.053203+0000","last_peered":"2024-04-19T03:01:51.053203+0000","last_clean":"2024-04-19T03:01:51.053203+0000","last_became_active":"2024-04-19T03:01:15.014218+0000","last_became_peered":"2024-04-19T03:01:15.014218+0000","last_unstale":"2024-04-19T03:01:51.053203+0000","last_undegraded":"2024-04-19T03:01:51.053203+0000","last_fullsized":"2024-04-19T03:01:51.053203+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:30:22.360053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-19T03:01:51.060582+0000","last_change":"2024-04-19T03:01:15.019382+0000","last_active":"2024-04-19T03:01:51.060582+0000","last_peered":"2024-04-19T03:01:51.060582+0000","last_clean":"2024-04-19T03:01:51.060582+0000","last_became_active":"2024-04-19T03:01:15.017859+0000","last_became_peered":"2024-04-19T03:01:15.017859+0000","last_unstale":"2024-04-19T03:01:51.060582+0000","last_undegraded":"2024-04-19T03:01:51.060582+0000","last_fullsized":"2024-04-19T03:01:51.060582+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:31:51.982582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-19T03:01:51.055327+0000","last_change":"2024-04-19T03:01:15.016989+0000","last_active":"2024-04-19T03:01:51.055327+0000","last_peered":"2024-04-19T03:01:51.055327+0000","last_clean":"2024-04-19T03:01:51.055327+0000","last_became_active":"2024-04-19T03:01:15.016569+0000","last_became_peered":"2024-04-19T03:01:15.016569+0000","last_unstale":"2024-04-19T03:01:51.055327+0000","last_undegraded":"2024-04-19T03:01:51.055327+0000","last_fullsized":"2024-04-19T03:01:51.055327+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:22:58.349159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-19T03:01:51.055652+0000","last_change":"2024-04-19T03:01:15.016925+0000","last_active":"2024-04-19T03:01:51.055652+0000","last_peered":"2024-04-19T03:01:51.055652+0000","last_clean":"2024-04-19T03:01:51.055652+0000","last_became_active":"2024-04-19T03:01:15.016589+0000","last_became_peered":"2024-04-19T03:01:15.016589+0000","last_unstale":"2024-04-19T03:01:51.055652+0000","last_undegraded":"2024-04-19T03:01:51.055652+0000","last_fullsized":"2024-04-19T03:01:51.055652+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:48:13.389356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-19T03:01:51.052708+0000","last_change":"2024-04-19T03:01:15.018969+0000","last_active":"2024-04-19T03:01:51.052708+0000","last_peered":"2024-04-19T03:01:51.052708+0000","last_clean":"2024-04-19T03:01:51.052708+0000","last_became_active":"2024-04-19T03:01:15.016895+0000","last_became_peered":"2024-04-19T03:01:15.016895+0000","last_unstale":"2024-04-19T03:01:51.052708+0000","last_undegraded":"2024-04-19T03:01:51.052708+0000","last_fullsized":"2024-04-19T03:01:51.052708+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:09:23.427311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-19T03:01:48.044741+0000","last_change":"2024-04-19T03:01:15.018526+0000","last_active":"2024-04-19T03:01:48.044741+0000","last_peered":"2024-04-19T03:01:48.044741+0000","last_clean":"2024-04-19T03:01:48.044741+0000","last_became_active":"2024-04-19T03:01:15.018268+0000","last_became_peered":"2024-04-19T03:01:15.018268+0000","last_unstale":"2024-04-19T03:01:48.044741+0000","last_undegraded":"2024-04-19T03:01:48.044741+0000","last_fullsized":"2024-04-19T03:01:48.044741+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:17:52.453165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-19T03:01:51.062080+0000","last_change":"2024-04-19T03:01:15.018499+0000","last_active":"2024-04-19T03:01:51.062080+0000","last_peered":"2024-04-19T03:01:51.062080+0000","last_clean":"2024-04-19T03:01:51.062080+0000","last_became_active":"2024-04-19T03:01:15.017894+0000","last_became_peered":"2024-04-19T03:01:15.017894+0000","last_unstale":"2024-04-19T03:01:51.062080+0000","last_undegraded":"2024-04-19T03:01:51.062080+0000","last_fullsized":"2024-04-19T03:01:51.062080+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:10:21.967941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-19T03:01:51.053646+0000","last_change":"2024-04-19T03:01:15.017525+0000","last_active":"2024-04-19T03:01:51.053646+0000","last_peered":"2024-04-19T03:01:51.053646+0000","last_clean":"2024-04-19T03:01:51.053646+0000","last_became_active":"2024-04-19T03:01:15.016887+0000","last_became_peered":"2024-04-19T03:01:15.016887+0000","last_unstale":"2024-04-19T03:01:51.053646+0000","last_undegraded":"2024-04-19T03:01:51.053646+0000","last_fullsized":"2024-04-19T03:01:51.053646+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:10:56.732208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-19T03:01:51.060243+0000","last_change":"2024-04-19T03:01:15.020240+0000","last_active":"2024-04-19T03:01:51.060243+0000","last_peered":"2024-04-19T03:01:51.060243+0000","last_clean":"2024-04-19T03:01:51.060243+0000","last_became_active":"2024-04-19T03:01:15.019820+0000","last_became_peered":"2024-04-19T03:01:15.019820+0000","last_unstale":"2024-04-19T03:01:51.060243+0000","last_undegraded":"2024-04-19T03:01:51.060243+0000","last_fullsized":"2024-04-19T03:01:51.060243+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:09:23.427311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-19T03:01:51.060423+0000","last_change":"2024-04-19T03:01:15.018712+0000","last_active":"2024-04-19T03:01:51.060423+0000","last_peered":"2024-04-19T03:01:51.060423+0000","last_clean":"2024-04-19T03:01:51.060423+0000","last_became_active":"2024-04-19T03:01:15.017970+0000","last_became_peered":"2024-04-19T03:01:15.017970+0000","last_unstale":"2024-04-19T03:01:51.060423+0000","last_undegraded":"2024-04-19T03:01:51.060423+0000","last_fullsized":"2024-04-19T03:01:51.060423+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:07:57.843767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-19T03:01:51.055384+0000","last_change":"2024-04-19T03:01:15.010960+0000","last_active":"2024-04-19T03:01:51.055384+0000","last_peered":"2024-04-19T03:01:51.055384+0000","last_clean":"2024-04-19T03:01:51.055384+0000","last_became_active":"2024-04-19T03:01:15.010472+0000","last_became_peered":"2024-04-19T03:01:15.010472+0000","last_unstale":"2024-04-19T03:01:51.055384+0000","last_undegraded":"2024-04-19T03:01:51.055384+0000","last_fullsized":"2024-04-19T03:01:51.055384+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:21:36.129346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-19T03:01:51.055694+0000","last_change":"2024-04-19T03:01:15.014574+0000","last_active":"2024-04-19T03:01:51.055694+0000","last_peered":"2024-04-19T03:01:51.055694+0000","last_clean":"2024-04-19T03:01:51.055694+0000","last_became_active":"2024-04-19T03:01:15.014096+0000","last_became_peered":"2024-04-19T03:01:15.014096+0000","last_unstale":"2024-04-19T03:01:51.055694+0000","last_undegraded":"2024-04-19T03:01:51.055694+0000","last_fullsized":"2024-04-19T03:01:51.055694+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:01:54.253963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-19T03:01:51.052692+0000","last_change":"2024-04-19T03:01:15.018778+0000","last_active":"2024-04-19T03:01:51.052692+0000","last_peered":"2024-04-19T03:01:51.052692+0000","last_clean":"2024-04-19T03:01:51.052692+0000","last_became_active":"2024-04-19T03:01:15.016809+0000","last_became_peered":"2024-04-19T03:01:15.016809+0000","last_unstale":"2024-04-19T03:01:51.052692+0000","last_undegraded":"2024-04-19T03:01:51.052692+0000","last_fullsized":"2024-04-19T03:01:51.052692+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:40:59.453079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-19T03:01:48.045309+0000","last_change":"2024-04-19T03:01:15.011516+0000","last_active":"2024-04-19T03:01:48.045309+0000","last_peered":"2024-04-19T03:01:48.045309+0000","last_clean":"2024-04-19T03:01:48.045309+0000","last_became_active":"2024-04-19T03:01:15.011056+0000","last_became_peered":"2024-04-19T03:01:15.011056+0000","last_unstale":"2024-04-19T03:01:48.045309+0000","last_undegraded":"2024-04-19T03:01:48.045309+0000","last_fullsized":"2024-04-19T03:01:48.045309+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:35:50.354787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-19T03:01:51.062294+0000","last_change":"2024-04-19T03:01:15.017257+0000","last_active":"2024-04-19T03:01:51.062294+0000","last_peered":"2024-04-19T03:01:51.062294+0000","last_clean":"2024-04-19T03:01:51.062294+0000","last_became_active":"2024-04-19T03:01:15.016062+0000","last_became_peered":"2024-04-19T03:01:15.016062+0000","last_unstale":"2024-04-19T03:01:51.062294+0000","last_undegraded":"2024-04-19T03:01:51.062294+0000","last_fullsized":"2024-04-19T03:01:51.062294+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:40:20.790332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-19T03:01:48.044811+0000","last_change":"2024-04-19T03:01:15.011065+0000","last_active":"2024-04-19T03:01:48.044811+0000","last_peered":"2024-04-19T03:01:48.044811+0000","last_clean":"2024-04-19T03:01:48.044811+0000","last_became_active":"2024-04-19T03:01:15.010330+0000","last_became_peered":"2024-04-19T03:01:15.010330+0000","last_unstale":"2024-04-19T03:01:48.044811+0000","last_undegraded":"2024-04-19T03:01:48.044811+0000","last_fullsized":"2024-04-19T03:01:48.044811+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:56:10.495533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-19T03:01:51.053537+0000","last_change":"2024-04-19T03:01:15.017812+0000","last_active":"2024-04-19T03:01:51.053537+0000","last_peered":"2024-04-19T03:01:51.053537+0000","last_clean":"2024-04-19T03:01:51.053537+0000","last_became_active":"2024-04-19T03:01:15.016891+0000","last_became_peered":"2024-04-19T03:01:15.016891+0000","last_unstale":"2024-04-19T03:01:51.053537+0000","last_undegraded":"2024-04-19T03:01:51.053537+0000","last_fullsized":"2024-04-19T03:01:51.053537+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:39:54.289444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-19T03:01:51.053311+0000","last_change":"2024-04-19T03:01:15.019143+0000","last_active":"2024-04-19T03:01:51.053311+0000","last_peered":"2024-04-19T03:01:51.053311+0000","last_clean":"2024-04-19T03:01:51.053311+0000","last_became_active":"2024-04-19T03:01:15.017757+0000","last_became_peered":"2024-04-19T03:01:15.017757+0000","last_unstale":"2024-04-19T03:01:51.053311+0000","last_undegraded":"2024-04-19T03:01:51.053311+0000","last_fullsized":"2024-04-19T03:01:51.053311+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:10:21.967941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-19T03:01:51.059995+0000","last_change":"2024-04-19T03:01:15.020108+0000","last_active":"2024-04-19T03:01:51.059995+0000","last_peered":"2024-04-19T03:01:51.059995+0000","last_clean":"2024-04-19T03:01:51.059995+0000","last_became_active":"2024-04-19T03:01:15.018978+0000","last_became_peered":"2024-04-19T03:01:15.018978+0000","last_unstale":"2024-04-19T03:01:51.059995+0000","last_undegraded":"2024-04-19T03:01:51.059995+0000","last_fullsized":"2024-04-19T03:01:51.059995+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:30:22.360053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-19T03:01:48.044501+0000","last_change":"2024-04-19T03:01:15.016877+0000","last_active":"2024-04-19T03:01:48.044501+0000","last_peered":"2024-04-19T03:01:48.044501+0000","last_clean":"2024-04-19T03:01:48.044501+0000","last_became_active":"2024-04-19T03:01:15.016245+0000","last_became_peered":"2024-04-19T03:01:15.016245+0000","last_unstale":"2024-04-19T03:01:48.044501+0000","last_undegraded":"2024-04-19T03:01:48.044501+0000","last_fullsized":"2024-04-19T03:01:48.044501+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:38:07.846380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-19T03:01:51.059819+0000","last_change":"2024-04-19T03:01:15.018809+0000","last_active":"2024-04-19T03:01:51.059819+0000","last_peered":"2024-04-19T03:01:51.059819+0000","last_clean":"2024-04-19T03:01:51.059819+0000","last_became_active":"2024-04-19T03:01:15.017549+0000","last_became_peered":"2024-04-19T03:01:15.017549+0000","last_unstale":"2024-04-19T03:01:51.059819+0000","last_undegraded":"2024-04-19T03:01:51.059819+0000","last_fullsized":"2024-04-19T03:01:51.059819+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:37:35.950318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-19T03:01:51.062403+0000","last_change":"2024-04-19T03:01:15.020443+0000","last_active":"2024-04-19T03:01:51.062403+0000","last_peered":"2024-04-19T03:01:51.062403+0000","last_clean":"2024-04-19T03:01:51.062403+0000","last_became_active":"2024-04-19T03:01:15.018780+0000","last_became_peered":"2024-04-19T03:01:15.018780+0000","last_unstale":"2024-04-19T03:01:51.062403+0000","last_undegraded":"2024-04-19T03:01:51.062403+0000","last_fullsized":"2024-04-19T03:01:51.062403+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:56:44.307812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-19T03:01:48.045769+0000","last_change":"2024-04-19T03:01:15.017487+0000","last_active":"2024-04-19T03:01:48.045769+0000","last_peered":"2024-04-19T03:01:48.045769+0000","last_clean":"2024-04-19T03:01:48.045769+0000","last_became_active":"2024-04-19T03:01:15.016183+0000","last_became_peered":"2024-04-19T03:01:15.016183+0000","last_unstale":"2024-04-19T03:01:48.045769+0000","last_undegraded":"2024-04-19T03:01:48.045769+0000","last_fullsized":"2024-04-19T03:01:48.045769+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:44:37.487013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-19T03:01:51.053735+0000","last_change":"2024-04-19T03:01:15.016117+0000","last_active":"2024-04-19T03:01:51.053735+0000","last_peered":"2024-04-19T03:01:51.053735+0000","last_clean":"2024-04-19T03:01:51.053735+0000","last_became_active":"2024-04-19T03:01:15.015415+0000","last_became_peered":"2024-04-19T03:01:15.015415+0000","last_unstale":"2024-04-19T03:01:51.053735+0000","last_undegraded":"2024-04-19T03:01:51.053735+0000","last_fullsized":"2024-04-19T03:01:51.053735+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:06:35.813797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-19T03:01:51.060373+0000","last_change":"2024-04-19T03:01:15.020098+0000","last_active":"2024-04-19T03:01:51.060373+0000","last_peered":"2024-04-19T03:01:51.060373+0000","last_clean":"2024-04-19T03:01:51.060373+0000","last_became_active":"2024-04-19T03:01:15.019064+0000","last_became_peered":"2024-04-19T03:01:15.019064+0000","last_unstale":"2024-04-19T03:01:51.060373+0000","last_undegraded":"2024-04-19T03:01:51.060373+0000","last_fullsized":"2024-04-19T03:01:51.060373+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:50:06.490191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-19T03:01:48.045678+0000","last_change":"2024-04-19T03:01:15.013746+0000","last_active":"2024-04-19T03:01:48.045678+0000","last_peered":"2024-04-19T03:01:48.045678+0000","last_clean":"2024-04-19T03:01:48.045678+0000","last_became_active":"2024-04-19T03:01:15.011865+0000","last_became_peered":"2024-04-19T03:01:15.011865+0000","last_unstale":"2024-04-19T03:01:48.045678+0000","last_undegraded":"2024-04-19T03:01:48.045678+0000","last_fullsized":"2024-04-19T03:01:48.045678+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:32:23.606804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-19T03:01:51.060117+0000","last_change":"2024-04-19T03:01:15.019787+0000","last_active":"2024-04-19T03:01:51.060117+0000","last_peered":"2024-04-19T03:01:51.060117+0000","last_clean":"2024-04-19T03:01:51.060117+0000","last_became_active":"2024-04-19T03:01:15.018350+0000","last_became_peered":"2024-04-19T03:01:15.018350+0000","last_unstale":"2024-04-19T03:01:51.060117+0000","last_undegraded":"2024-04-19T03:01:51.060117+0000","last_fullsized":"2024-04-19T03:01:51.060117+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:10:42.079294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-19T03:01:48.044597+0000","last_change":"2024-04-19T03:01:15.012900+0000","last_active":"2024-04-19T03:01:48.044597+0000","last_peered":"2024-04-19T03:01:48.044597+0000","last_clean":"2024-04-19T03:01:48.044597+0000","last_became_active":"2024-04-19T03:01:15.012416+0000","last_became_peered":"2024-04-19T03:01:15.012416+0000","last_unstale":"2024-04-19T03:01:48.044597+0000","last_undegraded":"2024-04-19T03:01:48.044597+0000","last_fullsized":"2024-04-19T03:01:48.044597+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:57:14.847455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-19T03:01:51.052759+0000","last_change":"2024-04-19T03:01:15.019278+0000","last_active":"2024-04-19T03:01:51.052759+0000","last_peered":"2024-04-19T03:01:51.052759+0000","last_clean":"2024-04-19T03:01:51.052759+0000","last_became_active":"2024-04-19T03:01:15.017779+0000","last_became_peered":"2024-04-19T03:01:15.017779+0000","last_unstale":"2024-04-19T03:01:51.052759+0000","last_undegraded":"2024-04-19T03:01:51.052759+0000","last_fullsized":"2024-04-19T03:01:51.052759+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:54:54.463918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-19T03:01:51.060342+0000","last_change":"2024-04-19T03:01:15.016669+0000","last_active":"2024-04-19T03:01:51.060342+0000","last_peered":"2024-04-19T03:01:51.060342+0000","last_clean":"2024-04-19T03:01:51.060342+0000","last_became_active":"2024-04-19T03:01:15.016286+0000","last_became_peered":"2024-04-19T03:01:15.016286+0000","last_unstale":"2024-04-19T03:01:51.060342+0000","last_undegraded":"2024-04-19T03:01:51.060342+0000","last_fullsized":"2024-04-19T03:01:51.060342+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:55:34.102680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"20'2","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-19T03:01:51.053335+0000","last_change":"2024-04-19T03:01:14.651050+0000","last_active":"2024-04-19T03:01:51.053335+0000","last_peered":"2024-04-19T03:01:51.053335+0000","last_clean":"2024-04-19T03:01:51.053335+0000","last_became_active":"2024-04-19T03:01:14.650679+0000","last_became_peered":"2024-04-19T03:01:14.650679+0000","last_unstale":"2024-04-19T03:01:51.053335+0000","last_undegraded":"2024-04-19T03:01:51.053335+0000","last_fullsized":"2024-04-19T03:01:51.053335+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:37:03.684394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-19T03:01:51.060541+0000","last_change":"2024-04-19T03:01:15.017124+0000","last_active":"2024-04-19T03:01:51.060541+0000","last_peered":"2024-04-19T03:01:51.060541+0000","last_clean":"2024-04-19T03:01:51.060541+0000","last_became_active":"2024-04-19T03:01:15.016535+0000","last_became_peered":"2024-04-19T03:01:15.016535+0000","last_unstale":"2024-04-19T03:01:51.060541+0000","last_undegraded":"2024-04-19T03:01:51.060541+0000","last_fullsized":"2024-04-19T03:01:51.060541+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:40:12.179703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-19T03:01:48.046253+0000","last_change":"2024-04-19T03:01:14.646594+0000","last_active":"2024-04-19T03:01:48.046253+0000","last_peered":"2024-04-19T03:01:48.046253+0000","last_clean":"2024-04-19T03:01:48.046253+0000","last_became_active":"2024-04-19T03:01:14.646122+0000","last_became_peered":"2024-04-19T03:01:14.646122+0000","last_unstale":"2024-04-19T03:01:48.046253+0000","last_undegraded":"2024-04-19T03:01:48.046253+0000","last_fullsized":"2024-04-19T03:01:48.046253+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:40:53.463388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-19T03:01:48.047286+0000","last_change":"2024-04-19T03:01:15.017420+0000","last_active":"2024-04-19T03:01:48.047286+0000","last_peered":"2024-04-19T03:01:48.047286+0000","last_clean":"2024-04-19T03:01:48.047286+0000","last_became_active":"2024-04-19T03:01:15.015840+0000","last_became_peered":"2024-04-19T03:01:15.015840+0000","last_unstale":"2024-04-19T03:01:48.047286+0000","last_undegraded":"2024-04-19T03:01:48.047286+0000","last_fullsized":"2024-04-19T03:01:48.047286+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:05:05.266293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-19T03:01:51.059816+0000","last_change":"2024-04-19T03:01:14.649074+0000","last_active":"2024-04-19T03:01:51.059816+0000","last_peered":"2024-04-19T03:01:51.059816+0000","last_clean":"2024-04-19T03:01:51.059816+0000","last_became_active":"2024-04-19T03:01:14.648217+0000","last_became_peered":"2024-04-19T03:01:14.648217+0000","last_unstale":"2024-04-19T03:01:51.059816+0000","last_undegraded":"2024-04-19T03:01:51.059816+0000","last_fullsized":"2024-04-19T03:01:51.059816+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:57:05.238043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-19T03:01:48.044735+0000","last_change":"2024-04-19T03:01:15.017136+0000","last_active":"2024-04-19T03:01:48.044735+0000","last_peered":"2024-04-19T03:01:48.044735+0000","last_clean":"2024-04-19T03:01:48.044735+0000","last_became_active":"2024-04-19T03:01:15.016550+0000","last_became_peered":"2024-04-19T03:01:15.016550+0000","last_unstale":"2024-04-19T03:01:48.044735+0000","last_undegraded":"2024-04-19T03:01:48.044735+0000","last_fullsized":"2024-04-19T03:01:48.044735+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:55:37.697481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"20'8","reported_seq":28,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-19T03:01:51.052849+0000","last_change":"2024-04-19T03:01:14.649044+0000","last_active":"2024-04-19T03:01:51.052849+0000","last_peered":"2024-04-19T03:01:51.052849+0000","last_clean":"2024-04-19T03:01:51.052849+0000","last_became_active":"2024-04-19T03:01:14.648859+0000","last_became_peered":"2024-04-19T03:01:14.648859+0000","last_unstale":"2024-04-19T03:01:51.052849+0000","last_undegraded":"2024-04-19T03:01:51.052849+0000","last_fullsized":"2024-04-19T03:01:51.052849+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:30:45.925657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"30'2455","reported_seq":2471,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-19T03:01:54.973922+0000","last_change":"2024-04-19T03:01:36.752938+0000","last_active":"2024-04-19T03:01:54.973922+0000","last_peered":"2024-04-19T03:01:54.973922+0000","last_clean":"2024-04-19T03:01:54.973922+0000","last_became_active":"2024-04-19T03:01:36.751024+0000","last_became_peered":"2024-04-19T03:01:36.751024+0000","last_unstale":"2024-04-19T03:01:54.973922+0000","last_undegraded":"2024-04-19T03:01:54.973922+0000","last_fullsized":"2024-04-19T03:01:54.973922+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:35.722578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:35.722578+0000","last_clean_scrub_stamp":"2024-04-19T03:01:35.722578+0000","objects_scrubbed":0,"log_size":2455,"log_dups_size":0,"ondisk_log_size":2455,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:52:27.986544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":160890880,"num_objects":2455,"num_object_clones":0,"num_object_copies":4910,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2455,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2455,"num_write_kb":157120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"20'1","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-19T03:01:51.054187+0000","last_change":"2024-04-19T03:01:14.649839+0000","last_active":"2024-04-19T03:01:51.054187+0000","last_peered":"2024-04-19T03:01:51.054187+0000","last_clean":"2024-04-19T03:01:51.054187+0000","last_became_active":"2024-04-19T03:01:14.649571+0000","last_became_peered":"2024-04-19T03:01:14.649571+0000","last_unstale":"2024-04-19T03:01:51.054187+0000","last_undegraded":"2024-04-19T03:01:51.054187+0000","last_fullsized":"2024-04-19T03:01:51.054187+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:03:57.839660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-19T03:01:51.059899+0000","last_change":"2024-04-19T03:01:15.021047+0000","last_active":"2024-04-19T03:01:51.059899+0000","last_peered":"2024-04-19T03:01:51.059899+0000","last_clean":"2024-04-19T03:01:51.059899+0000","last_became_active":"2024-04-19T03:01:15.019792+0000","last_became_peered":"2024-04-19T03:01:15.019792+0000","last_unstale":"2024-04-19T03:01:51.059899+0000","last_undegraded":"2024-04-19T03:01:51.059899+0000","last_fullsized":"2024-04-19T03:01:51.059899+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:54:54.463918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.8","version":"30'2540","reported_seq":2556,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-19T03:01:54.943695+0000","last_change":"2024-04-19T03:01:36.755782+0000","last_active":"2024-04-19T03:01:54.943695+0000","last_peered":"2024-04-19T03:01:54.943695+0000","last_clean":"2024-04-19T03:01:54.943695+0000","last_became_active":"2024-04-19T03:01:36.755496+0000","last_became_peered":"2024-04-19T03:01:36.755496+0000","last_unstale":"2024-04-19T03:01:54.943695+0000","last_undegraded":"2024-04-19T03:01:54.943695+0000","last_fullsized":"2024-04-19T03:01:54.943695+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:35.722578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:35.722578+0000","last_clean_scrub_stamp":"2024-04-19T03:01:35.722578+0000","objects_scrubbed":0,"log_size":2540,"log_dups_size":0,"ondisk_log_size":2540,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:32:32.504213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":166461440,"num_objects":2540,"num_object_clones":0,"num_object_copies":5080,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2540,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2540,"num_write_kb":162560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"20'2","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-19T03:01:51.062384+0000","last_change":"2024-04-19T03:01:14.645075+0000","last_active":"2024-04-19T03:01:51.062384+0000","last_peered":"2024-04-19T03:01:51.062384+0000","last_clean":"2024-04-19T03:01:51.062384+0000","last_became_active":"2024-04-19T03:01:14.644790+0000","last_became_peered":"2024-04-19T03:01:14.644790+0000","last_unstale":"2024-04-19T03:01:51.062384+0000","last_undegraded":"2024-04-19T03:01:51.062384+0000","last_fullsized":"2024-04-19T03:01:51.062384+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:55:15.035769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-19T03:01:51.059703+0000","last_change":"2024-04-19T03:01:15.016330+0000","last_active":"2024-04-19T03:01:51.059703+0000","last_peered":"2024-04-19T03:01:51.059703+0000","last_clean":"2024-04-19T03:01:51.059703+0000","last_became_active":"2024-04-19T03:01:15.015644+0000","last_became_peered":"2024-04-19T03:01:15.015644+0000","last_unstale":"2024-04-19T03:01:51.059703+0000","last_undegraded":"2024-04-19T03:01:51.059703+0000","last_fullsized":"2024-04-19T03:01:51.059703+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:13:06.902769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.b","version":"30'2557","reported_seq":2573,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-19T03:01:54.963798+0000","last_change":"2024-04-19T03:01:36.754931+0000","last_active":"2024-04-19T03:01:54.963798+0000","last_peered":"2024-04-19T03:01:54.963798+0000","last_clean":"2024-04-19T03:01:54.963798+0000","last_became_active":"2024-04-19T03:01:36.754549+0000","last_became_peered":"2024-04-19T03:01:36.754549+0000","last_unstale":"2024-04-19T03:01:54.963798+0000","last_undegraded":"2024-04-19T03:01:54.963798+0000","last_fullsized":"2024-04-19T03:01:54.963798+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:35.722578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:35.722578+0000","last_clean_scrub_stamp":"2024-04-19T03:01:35.722578+0000","objects_scrubbed":0,"log_size":2557,"log_dups_size":0,"ondisk_log_size":2557,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:03:26.146922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":167575552,"num_objects":2557,"num_object_clones":0,"num_object_copies":5114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2557,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2557,"num_write_kb":163648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"20'1","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-19T03:01:51.053922+0000","last_change":"2024-04-19T03:01:14.649826+0000","last_active":"2024-04-19T03:01:51.053922+0000","last_peered":"2024-04-19T03:01:51.053922+0000","last_clean":"2024-04-19T03:01:51.053922+0000","last_became_active":"2024-04-19T03:01:14.649565+0000","last_became_peered":"2024-04-19T03:01:14.649565+0000","last_unstale":"2024-04-19T03:01:51.053922+0000","last_undegraded":"2024-04-19T03:01:51.053922+0000","last_fullsized":"2024-04-19T03:01:51.053922+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:36:00.962931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-19T03:01:51.055446+0000","last_change":"2024-04-19T03:01:15.018099+0000","last_active":"2024-04-19T03:01:51.055446+0000","last_peered":"2024-04-19T03:01:51.055446+0000","last_clean":"2024-04-19T03:01:51.055446+0000","last_became_active":"2024-04-19T03:01:15.017536+0000","last_became_peered":"2024-04-19T03:01:15.017536+0000","last_unstale":"2024-04-19T03:01:51.055446+0000","last_undegraded":"2024-04-19T03:01:51.055446+0000","last_fullsized":"2024-04-19T03:01:51.055446+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:50:06.490191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.a","version":"29'2307","reported_seq":2322,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-19T03:01:53.954547+0000","last_change":"2024-04-19T03:01:36.751169+0000","last_active":"2024-04-19T03:01:53.954547+0000","last_peered":"2024-04-19T03:01:53.954547+0000","last_clean":"2024-04-19T03:01:53.954547+0000","last_became_active":"2024-04-19T03:01:36.748389+0000","last_became_peered":"2024-04-19T03:01:36.748389+0000","last_unstale":"2024-04-19T03:01:53.954547+0000","last_undegraded":"2024-04-19T03:01:53.954547+0000","last_fullsized":"2024-04-19T03:01:53.954547+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:35.722578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:35.722578+0000","last_clean_scrub_stamp":"2024-04-19T03:01:35.722578+0000","objects_scrubbed":0,"log_size":2307,"log_dups_size":0,"ondisk_log_size":2307,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:09:24.940742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":151191552,"num_objects":2307,"num_object_clones":0,"num_object_copies":4614,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2307,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2307,"num_write_kb":147648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-19T03:01:51.053594+0000","last_change":"2024-04-19T03:01:14.651201+0000","last_active":"2024-04-19T03:01:51.053594+0000","last_peered":"2024-04-19T03:01:51.053594+0000","last_clean":"2024-04-19T03:01:51.053594+0000","last_became_active":"2024-04-19T03:01:14.650942+0000","last_became_peered":"2024-04-19T03:01:14.650942+0000","last_unstale":"2024-04-19T03:01:51.053594+0000","last_undegraded":"2024-04-19T03:01:51.053594+0000","last_fullsized":"2024-04-19T03:01:51.053594+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:02:13.190917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-19T03:01:48.045507+0000","last_change":"2024-04-19T03:01:15.017458+0000","last_active":"2024-04-19T03:01:48.045507+0000","last_peered":"2024-04-19T03:01:48.045507+0000","last_clean":"2024-04-19T03:01:48.045507+0000","last_became_active":"2024-04-19T03:01:15.016653+0000","last_became_peered":"2024-04-19T03:01:15.016653+0000","last_unstale":"2024-04-19T03:01:48.045507+0000","last_undegraded":"2024-04-19T03:01:48.045507+0000","last_fullsized":"2024-04-19T03:01:48.045507+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:52:28.671365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"30'2562","reported_seq":2578,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-19T03:01:54.967429+0000","last_change":"2024-04-19T03:01:36.753335+0000","last_active":"2024-04-19T03:01:54.967429+0000","last_peered":"2024-04-19T03:01:54.967429+0000","last_clean":"2024-04-19T03:01:54.967429+0000","last_became_active":"2024-04-19T03:01:36.752922+0000","last_became_peered":"2024-04-19T03:01:36.752922+0000","last_unstale":"2024-04-19T03:01:54.967429+0000","last_undegraded":"2024-04-19T03:01:54.967429+0000","last_fullsized":"2024-04-19T03:01:54.967429+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:35.722578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:35.722578+0000","last_clean_scrub_stamp":"2024-04-19T03:01:35.722578+0000","objects_scrubbed":0,"log_size":2562,"log_dups_size":0,"ondisk_log_size":2562,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:04:51.492597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":167903232,"num_objects":2562,"num_object_clones":0,"num_object_copies":5124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2562,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2562,"num_write_kb":163968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"20'2","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-19T03:01:48.045844+0000","last_change":"2024-04-19T03:01:14.647553+0000","last_active":"2024-04-19T03:01:48.045844+0000","last_peered":"2024-04-19T03:01:48.045844+0000","last_clean":"2024-04-19T03:01:48.045844+0000","last_became_active":"2024-04-19T03:01:14.647147+0000","last_became_peered":"2024-04-19T03:01:14.647147+0000","last_unstale":"2024-04-19T03:01:48.045844+0000","last_undegraded":"2024-04-19T03:01:48.045844+0000","last_fullsized":"2024-04-19T03:01:48.045844+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:33:45.550646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-19T03:01:51.053296+0000","last_change":"2024-04-19T03:01:15.018012+0000","last_active":"2024-04-19T03:01:51.053296+0000","last_peered":"2024-04-19T03:01:51.053296+0000","last_clean":"2024-04-19T03:01:51.053296+0000","last_became_active":"2024-04-19T03:01:15.017086+0000","last_became_peered":"2024-04-19T03:01:15.017086+0000","last_unstale":"2024-04-19T03:01:51.053296+0000","last_undegraded":"2024-04-19T03:01:51.053296+0000","last_fullsized":"2024-04-19T03:01:51.053296+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:54:04.518505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"29'2463","reported_seq":2478,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-19T03:01:53.949169+0000","last_change":"2024-04-19T03:01:36.754414+0000","last_active":"2024-04-19T03:01:53.949169+0000","last_peered":"2024-04-19T03:01:53.949169+0000","last_clean":"2024-04-19T03:01:53.949169+0000","last_became_active":"2024-04-19T03:01:36.754173+0000","last_became_peered":"2024-04-19T03:01:36.754173+0000","last_unstale":"2024-04-19T03:01:53.949169+0000","last_undegraded":"2024-04-19T03:01:53.949169+0000","last_fullsized":"2024-04-19T03:01:53.949169+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:35.722578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:35.722578+0000","last_clean_scrub_stamp":"2024-04-19T03:01:35.722578+0000","objects_scrubbed":0,"log_size":2463,"log_dups_size":0,"ondisk_log_size":2463,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:29:08.411256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":161415168,"num_objects":2463,"num_object_clones":0,"num_object_copies":4926,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2463,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2463,"num_write_kb":157632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-19T03:01:51.055563+0000","last_change":"2024-04-19T03:01:14.651004+0000","last_active":"2024-04-19T03:01:51.055563+0000","last_peered":"2024-04-19T03:01:51.055563+0000","last_clean":"2024-04-19T03:01:51.055563+0000","last_became_active":"2024-04-19T03:01:14.650635+0000","last_became_peered":"2024-04-19T03:01:14.650635+0000","last_unstale":"2024-04-19T03:01:51.055563+0000","last_undegraded":"2024-04-19T03:01:51.055563+0000","last_fullsized":"2024-04-19T03:01:51.055563+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:57:15.575819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-19T03:01:51.053816+0000","last_change":"2024-04-19T03:01:15.015685+0000","last_active":"2024-04-19T03:01:51.053816+0000","last_peered":"2024-04-19T03:01:51.053816+0000","last_clean":"2024-04-19T03:01:51.053816+0000","last_became_active":"2024-04-19T03:01:15.014847+0000","last_became_peered":"2024-04-19T03:01:15.014847+0000","last_unstale":"2024-04-19T03:01:51.053816+0000","last_undegraded":"2024-04-19T03:01:51.053816+0000","last_fullsized":"2024-04-19T03:01:51.053816+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:51:06.208551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.f","version":"30'2554","reported_seq":2570,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-19T03:01:54.973408+0000","last_change":"2024-04-19T03:01:36.755035+0000","last_active":"2024-04-19T03:01:54.973408+0000","last_peered":"2024-04-19T03:01:54.973408+0000","last_clean":"2024-04-19T03:01:54.973408+0000","last_became_active":"2024-04-19T03:01:36.753645+0000","last_became_peered":"2024-04-19T03:01:36.753645+0000","last_unstale":"2024-04-19T03:01:54.973408+0000","last_undegraded":"2024-04-19T03:01:54.973408+0000","last_fullsized":"2024-04-19T03:01:54.973408+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:35.722578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:35.722578+0000","last_clean_scrub_stamp":"2024-04-19T03:01:35.722578+0000","objects_scrubbed":0,"log_size":2554,"log_dups_size":0,"ondisk_log_size":2554,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:45:30.691887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":167378944,"num_objects":2554,"num_object_clones":0,"num_object_copies":5108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2554,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2554,"num_write_kb":163456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-19T03:01:51.059819+0000","last_change":"2024-04-19T03:01:14.644582+0000","last_active":"2024-04-19T03:01:51.059819+0000","last_peered":"2024-04-19T03:01:51.059819+0000","last_clean":"2024-04-19T03:01:51.059819+0000","last_became_active":"2024-04-19T03:01:14.644101+0000","last_became_peered":"2024-04-19T03:01:14.644101+0000","last_unstale":"2024-04-19T03:01:51.059819+0000","last_undegraded":"2024-04-19T03:01:51.059819+0000","last_fullsized":"2024-04-19T03:01:51.059819+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:28:24.652864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-19T03:01:51.053439+0000","last_change":"2024-04-19T03:01:15.014818+0000","last_active":"2024-04-19T03:01:51.053439+0000","last_peered":"2024-04-19T03:01:51.053439+0000","last_clean":"2024-04-19T03:01:51.053439+0000","last_became_active":"2024-04-19T03:01:15.014421+0000","last_became_peered":"2024-04-19T03:01:15.014421+0000","last_unstale":"2024-04-19T03:01:51.053439+0000","last_undegraded":"2024-04-19T03:01:51.053439+0000","last_fullsized":"2024-04-19T03:01:51.053439+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:16:20.475837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"30'2555","reported_seq":2570,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-19T03:01:54.979166+0000","last_change":"2024-04-19T03:01:36.755894+0000","last_active":"2024-04-19T03:01:54.979166+0000","last_peered":"2024-04-19T03:01:54.979166+0000","last_clean":"2024-04-19T03:01:54.979166+0000","last_became_active":"2024-04-19T03:01:36.755533+0000","last_became_peered":"2024-04-19T03:01:36.755533+0000","last_unstale":"2024-04-19T03:01:54.979166+0000","last_undegraded":"2024-04-19T03:01:54.979166+0000","last_fullsized":"2024-04-19T03:01:54.979166+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:35.722578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:35.722578+0000","last_clean_scrub_stamp":"2024-04-19T03:01:35.722578+0000","objects_scrubbed":0,"log_size":2555,"log_dups_size":0,"ondisk_log_size":2555,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:30:41.428486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":167444480,"num_objects":2555,"num_object_clones":0,"num_object_copies":5110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2555,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2555,"num_write_kb":163520,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-19T03:01:51.060059+0000","last_change":"2024-04-19T03:01:14.643840+0000","last_active":"2024-04-19T03:01:51.060059+0000","last_peered":"2024-04-19T03:01:51.060059+0000","last_clean":"2024-04-19T03:01:51.060059+0000","last_became_active":"2024-04-19T03:01:14.643503+0000","last_became_peered":"2024-04-19T03:01:14.643503+0000","last_unstale":"2024-04-19T03:01:51.060059+0000","last_undegraded":"2024-04-19T03:01:51.060059+0000","last_fullsized":"2024-04-19T03:01:51.060059+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:09:33.801275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-19T03:01:48.044937+0000","last_change":"2024-04-19T03:01:15.012607+0000","last_active":"2024-04-19T03:01:48.044937+0000","last_peered":"2024-04-19T03:01:48.044937+0000","last_clean":"2024-04-19T03:01:48.044937+0000","last_became_active":"2024-04-19T03:01:15.012152+0000","last_became_peered":"2024-04-19T03:01:15.012152+0000","last_unstale":"2024-04-19T03:01:48.044937+0000","last_undegraded":"2024-04-19T03:01:48.044937+0000","last_fullsized":"2024-04-19T03:01:48.044937+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:57:36.794409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.4","version":"30'2474","reported_seq":2490,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-19T03:01:54.967924+0000","last_change":"2024-04-19T03:01:36.754786+0000","last_active":"2024-04-19T03:01:54.967924+0000","last_peered":"2024-04-19T03:01:54.967924+0000","last_clean":"2024-04-19T03:01:54.967924+0000","last_became_active":"2024-04-19T03:01:36.754448+0000","last_became_peered":"2024-04-19T03:01:36.754448+0000","last_unstale":"2024-04-19T03:01:54.967924+0000","last_undegraded":"2024-04-19T03:01:54.967924+0000","last_fullsized":"2024-04-19T03:01:54.967924+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:35.722578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:35.722578+0000","last_clean_scrub_stamp":"2024-04-19T03:01:35.722578+0000","objects_scrubbed":0,"log_size":2474,"log_dups_size":0,"ondisk_log_size":2474,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:10:19.915080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":162136064,"num_objects":2474,"num_object_clones":0,"num_object_copies":4948,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2474,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2474,"num_write_kb":158336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"14'157","reported_seq":221,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-19T03:01:51.053020+0000","last_change":"2024-04-19T03:01:07.538434+0000","last_active":"2024-04-19T03:01:51.053020+0000","last_peered":"2024-04-19T03:01:51.053020+0000","last_clean":"2024-04-19T03:01:51.053020+0000","last_became_active":"2024-04-19T03:01:07.537856+0000","last_became_peered":"2024-04-19T03:01:07.537856+0000","last_unstale":"2024-04-19T03:01:51.053020+0000","last_undegraded":"2024-04-19T03:01:51.053020+0000","last_fullsized":"2024-04-19T03:01:51.053020+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:06.516863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:06.516863+0000","last_clean_scrub_stamp":"2024-04-19T03:01:06.516863+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:36:46.386286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-19T03:01:51.053439+0000","last_change":"2024-04-19T03:01:10.602869+0000","last_active":"2024-04-19T03:01:51.053439+0000","last_peered":"2024-04-19T03:01:51.053439+0000","last_clean":"2024-04-19T03:01:51.053439+0000","last_became_active":"2024-04-19T03:01:10.601965+0000","last_became_peered":"2024-04-19T03:01:10.601965+0000","last_unstale":"2024-04-19T03:01:51.053439+0000","last_undegraded":"2024-04-19T03:01:51.053439+0000","last_fullsized":"2024-04-19T03:01:51.053439+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_clean_scrub_stamp":"2024-04-19T03:01:09.578660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:14:41.316871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-19T03:01:48.046324+0000","last_change":"2024-04-19T03:01:14.643201+0000","last_active":"2024-04-19T03:01:48.046324+0000","last_peered":"2024-04-19T03:01:48.046324+0000","last_clean":"2024-04-19T03:01:48.046324+0000","last_became_active":"2024-04-19T03:01:14.642885+0000","last_became_peered":"2024-04-19T03:01:14.642885+0000","last_unstale":"2024-04-19T03:01:48.046324+0000","last_undegraded":"2024-04-19T03:01:48.046324+0000","last_fullsized":"2024-04-19T03:01:48.046324+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:24:40.181164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-19T03:01:51.054022+0000","last_change":"2024-04-19T03:01:15.016104+0000","last_active":"2024-04-19T03:01:51.054022+0000","last_peered":"2024-04-19T03:01:51.054022+0000","last_clean":"2024-04-19T03:01:51.054022+0000","last_became_active":"2024-04-19T03:01:15.015386+0000","last_became_peered":"2024-04-19T03:01:15.015386+0000","last_unstale":"2024-04-19T03:01:51.054022+0000","last_undegraded":"2024-04-19T03:01:51.054022+0000","last_fullsized":"2024-04-19T03:01:51.054022+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:00:35.372657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.7","version":"30'2450","reported_seq":2466,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-19T03:01:54.964906+0000","last_change":"2024-04-19T03:01:36.759341+0000","last_active":"2024-04-19T03:01:54.964906+0000","last_peered":"2024-04-19T03:01:54.964906+0000","last_clean":"2024-04-19T03:01:54.964906+0000","last_became_active":"2024-04-19T03:01:36.759050+0000","last_became_peered":"2024-04-19T03:01:36.759050+0000","last_unstale":"2024-04-19T03:01:54.964906+0000","last_undegraded":"2024-04-19T03:01:54.964906+0000","last_fullsized":"2024-04-19T03:01:54.964906+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:35.722578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:35.722578+0000","last_clean_scrub_stamp":"2024-04-19T03:01:35.722578+0000","objects_scrubbed":0,"log_size":2450,"log_dups_size":0,"ondisk_log_size":2450,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:33:10.556075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":160563200,"num_objects":2450,"num_object_clones":0,"num_object_copies":4900,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2450,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2450,"num_write_kb":156800,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-19T03:01:51.052940+0000","last_change":"2024-04-19T03:01:10.602194+0000","last_active":"2024-04-19T03:01:51.052940+0000","last_peered":"2024-04-19T03:01:51.052940+0000","last_clean":"2024-04-19T03:01:51.052940+0000","last_became_active":"2024-04-19T03:01:10.601381+0000","last_became_peered":"2024-04-19T03:01:10.601381+0000","last_unstale":"2024-04-19T03:01:51.052940+0000","last_undegraded":"2024-04-19T03:01:51.052940+0000","last_fullsized":"2024-04-19T03:01:51.052940+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_clean_scrub_stamp":"2024-04-19T03:01:09.578660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:42:26.594095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-19T03:01:48.045399+0000","last_change":"2024-04-19T03:01:14.647365+0000","last_active":"2024-04-19T03:01:48.045399+0000","last_peered":"2024-04-19T03:01:48.045399+0000","last_clean":"2024-04-19T03:01:48.045399+0000","last_became_active":"2024-04-19T03:01:14.646950+0000","last_became_peered":"2024-04-19T03:01:14.646950+0000","last_unstale":"2024-04-19T03:01:48.045399+0000","last_undegraded":"2024-04-19T03:01:48.045399+0000","last_fullsized":"2024-04-19T03:01:48.045399+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:41:26.108674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-19T03:01:51.062155+0000","last_change":"2024-04-19T03:01:15.018728+0000","last_active":"2024-04-19T03:01:51.062155+0000","last_peered":"2024-04-19T03:01:51.062155+0000","last_clean":"2024-04-19T03:01:51.062155+0000","last_became_active":"2024-04-19T03:01:15.017287+0000","last_became_peered":"2024-04-19T03:01:15.017287+0000","last_unstale":"2024-04-19T03:01:51.062155+0000","last_undegraded":"2024-04-19T03:01:51.062155+0000","last_fullsized":"2024-04-19T03:01:51.062155+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:54:04.518505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"29'2440","reported_seq":2455,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-19T03:01:53.943568+0000","last_change":"2024-04-19T03:01:36.753604+0000","last_active":"2024-04-19T03:01:53.943568+0000","last_peered":"2024-04-19T03:01:53.943568+0000","last_clean":"2024-04-19T03:01:53.943568+0000","last_became_active":"2024-04-19T03:01:36.752839+0000","last_became_peered":"2024-04-19T03:01:36.752839+0000","last_unstale":"2024-04-19T03:01:53.943568+0000","last_undegraded":"2024-04-19T03:01:53.943568+0000","last_fullsized":"2024-04-19T03:01:53.943568+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:35.722578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:35.722578+0000","last_clean_scrub_stamp":"2024-04-19T03:01:35.722578+0000","objects_scrubbed":0,"log_size":2440,"log_dups_size":0,"ondisk_log_size":2440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:27:42.608543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":159907840,"num_objects":2440,"num_object_clones":0,"num_object_copies":4880,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2440,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2440,"num_write_kb":156160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-19T03:01:48.045476+0000","last_change":"2024-04-19T03:01:10.600207+0000","last_active":"2024-04-19T03:01:48.045476+0000","last_peered":"2024-04-19T03:01:48.045476+0000","last_clean":"2024-04-19T03:01:48.045476+0000","last_became_active":"2024-04-19T03:01:10.599209+0000","last_became_peered":"2024-04-19T03:01:10.599209+0000","last_unstale":"2024-04-19T03:01:48.045476+0000","last_undegraded":"2024-04-19T03:01:48.045476+0000","last_fullsized":"2024-04-19T03:01:48.045476+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_clean_scrub_stamp":"2024-04-19T03:01:09.578660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:30:25.748140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-19T03:01:51.060207+0000","last_change":"2024-04-19T03:01:14.649068+0000","last_active":"2024-04-19T03:01:51.060207+0000","last_peered":"2024-04-19T03:01:51.060207+0000","last_clean":"2024-04-19T03:01:51.060207+0000","last_became_active":"2024-04-19T03:01:14.648082+0000","last_became_peered":"2024-04-19T03:01:14.648082+0000","last_unstale":"2024-04-19T03:01:51.060207+0000","last_undegraded":"2024-04-19T03:01:51.060207+0000","last_fullsized":"2024-04-19T03:01:51.060207+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:30:14.489117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-19T03:01:48.044950+0000","last_change":"2024-04-19T03:01:15.012147+0000","last_active":"2024-04-19T03:01:48.044950+0000","last_peered":"2024-04-19T03:01:48.044950+0000","last_clean":"2024-04-19T03:01:48.044950+0000","last_became_active":"2024-04-19T03:01:15.011421+0000","last_became_peered":"2024-04-19T03:01:15.011421+0000","last_unstale":"2024-04-19T03:01:48.044950+0000","last_undegraded":"2024-04-19T03:01:48.044950+0000","last_fullsized":"2024-04-19T03:01:48.044950+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:50:51.928641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"29'2412","reported_seq":2427,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-19T03:01:53.959983+0000","last_change":"2024-04-19T03:01:36.753776+0000","last_active":"2024-04-19T03:01:53.959983+0000","last_peered":"2024-04-19T03:01:53.959983+0000","last_clean":"2024-04-19T03:01:53.959983+0000","last_became_active":"2024-04-19T03:01:36.752878+0000","last_became_peered":"2024-04-19T03:01:36.752878+0000","last_unstale":"2024-04-19T03:01:53.959983+0000","last_undegraded":"2024-04-19T03:01:53.959983+0000","last_fullsized":"2024-04-19T03:01:53.959983+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:35.722578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:35.722578+0000","last_clean_scrub_stamp":"2024-04-19T03:01:35.722578+0000","objects_scrubbed":0,"log_size":2412,"log_dups_size":0,"ondisk_log_size":2412,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:59:26.700990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":158072832,"num_objects":2412,"num_object_clones":0,"num_object_copies":4824,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2412,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2412,"num_write_kb":154368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-19T03:01:51.055579+0000","last_change":"2024-04-19T03:01:10.601386+0000","last_active":"2024-04-19T03:01:51.055579+0000","last_peered":"2024-04-19T03:01:51.055579+0000","last_clean":"2024-04-19T03:01:51.055579+0000","last_became_active":"2024-04-19T03:01:10.600732+0000","last_became_peered":"2024-04-19T03:01:10.600732+0000","last_unstale":"2024-04-19T03:01:51.055579+0000","last_undegraded":"2024-04-19T03:01:51.055579+0000","last_fullsized":"2024-04-19T03:01:51.055579+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_clean_scrub_stamp":"2024-04-19T03:01:09.578660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:34:53.138338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-19T03:01:51.053460+0000","last_change":"2024-04-19T03:01:14.651363+0000","last_active":"2024-04-19T03:01:51.053460+0000","last_peered":"2024-04-19T03:01:51.053460+0000","last_clean":"2024-04-19T03:01:51.053460+0000","last_became_active":"2024-04-19T03:01:14.651020+0000","last_became_peered":"2024-04-19T03:01:14.651020+0000","last_unstale":"2024-04-19T03:01:51.053460+0000","last_undegraded":"2024-04-19T03:01:51.053460+0000","last_fullsized":"2024-04-19T03:01:51.053460+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:44:36.043345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-19T03:01:48.046549+0000","last_change":"2024-04-19T03:01:15.017182+0000","last_active":"2024-04-19T03:01:48.046549+0000","last_peered":"2024-04-19T03:01:48.046549+0000","last_clean":"2024-04-19T03:01:48.046549+0000","last_became_active":"2024-04-19T03:01:15.016258+0000","last_became_peered":"2024-04-19T03:01:15.016258+0000","last_unstale":"2024-04-19T03:01:48.046549+0000","last_undegraded":"2024-04-19T03:01:48.046549+0000","last_fullsized":"2024-04-19T03:01:48.046549+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:27:25.351590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"29'2346","reported_seq":2361,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-19T03:01:53.941117+0000","last_change":"2024-04-19T03:01:36.755675+0000","last_active":"2024-04-19T03:01:53.941117+0000","last_peered":"2024-04-19T03:01:53.941117+0000","last_clean":"2024-04-19T03:01:53.941117+0000","last_became_active":"2024-04-19T03:01:36.755380+0000","last_became_peered":"2024-04-19T03:01:36.755380+0000","last_unstale":"2024-04-19T03:01:53.941117+0000","last_undegraded":"2024-04-19T03:01:53.941117+0000","last_fullsized":"2024-04-19T03:01:53.941117+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:35.722578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:35.722578+0000","last_clean_scrub_stamp":"2024-04-19T03:01:35.722578+0000","objects_scrubbed":0,"log_size":2346,"log_dups_size":0,"ondisk_log_size":2346,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:28:39.488024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":153747456,"num_objects":2346,"num_object_clones":0,"num_object_copies":4692,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2346,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2346,"num_write_kb":150144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-19T03:01:51.054008+0000","last_change":"2024-04-19T03:01:14.651740+0000","last_active":"2024-04-19T03:01:51.054008+0000","last_peered":"2024-04-19T03:01:51.054008+0000","last_clean":"2024-04-19T03:01:51.054008+0000","last_became_active":"2024-04-19T03:01:14.651491+0000","last_became_peered":"2024-04-19T03:01:14.651491+0000","last_unstale":"2024-04-19T03:01:51.054008+0000","last_undegraded":"2024-04-19T03:01:51.054008+0000","last_fullsized":"2024-04-19T03:01:51.054008+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:42:15.864988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-19T03:01:48.046861+0000","last_change":"2024-04-19T03:01:10.601062+0000","last_active":"2024-04-19T03:01:48.046861+0000","last_peered":"2024-04-19T03:01:48.046861+0000","last_clean":"2024-04-19T03:01:48.046861+0000","last_became_active":"2024-04-19T03:01:10.600334+0000","last_became_peered":"2024-04-19T03:01:10.600334+0000","last_unstale":"2024-04-19T03:01:48.046861+0000","last_undegraded":"2024-04-19T03:01:48.046861+0000","last_fullsized":"2024-04-19T03:01:48.046861+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_clean_scrub_stamp":"2024-04-19T03:01:09.578660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:51:38.307752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-19T03:01:51.060015+0000","last_change":"2024-04-19T03:01:15.020501+0000","last_active":"2024-04-19T03:01:51.060015+0000","last_peered":"2024-04-19T03:01:51.060015+0000","last_clean":"2024-04-19T03:01:51.060015+0000","last_became_active":"2024-04-19T03:01:15.019019+0000","last_became_peered":"2024-04-19T03:01:15.019019+0000","last_unstale":"2024-04-19T03:01:51.060015+0000","last_undegraded":"2024-04-19T03:01:51.060015+0000","last_fullsized":"2024-04-19T03:01:51.060015+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:22:58.349159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"30'2496","reported_seq":2512,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-19T03:01:54.956832+0000","last_change":"2024-04-19T03:01:36.756326+0000","last_active":"2024-04-19T03:01:54.956832+0000","last_peered":"2024-04-19T03:01:54.956832+0000","last_clean":"2024-04-19T03:01:54.956832+0000","last_became_active":"2024-04-19T03:01:36.756143+0000","last_became_peered":"2024-04-19T03:01:36.756143+0000","last_unstale":"2024-04-19T03:01:54.956832+0000","last_undegraded":"2024-04-19T03:01:54.956832+0000","last_fullsized":"2024-04-19T03:01:54.956832+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:35.722578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:35.722578+0000","last_clean_scrub_stamp":"2024-04-19T03:01:35.722578+0000","objects_scrubbed":0,"log_size":2496,"log_dups_size":0,"ondisk_log_size":2496,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:36:56.610876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":163577856,"num_objects":2496,"num_object_clones":0,"num_object_copies":4992,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2496,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2496,"num_write_kb":159744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-19T03:01:48.047011+0000","last_change":"2024-04-19T03:01:14.643098+0000","last_active":"2024-04-19T03:01:48.047011+0000","last_peered":"2024-04-19T03:01:48.047011+0000","last_clean":"2024-04-19T03:01:48.047011+0000","last_became_active":"2024-04-19T03:01:14.642789+0000","last_became_peered":"2024-04-19T03:01:14.642789+0000","last_unstale":"2024-04-19T03:01:48.047011+0000","last_undegraded":"2024-04-19T03:01:48.047011+0000","last_fullsized":"2024-04-19T03:01:48.047011+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:40:40.193720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-19T03:01:51.060965+0000","last_change":"2024-04-19T03:01:10.603139+0000","last_active":"2024-04-19T03:01:51.060965+0000","last_peered":"2024-04-19T03:01:51.060965+0000","last_clean":"2024-04-19T03:01:51.060965+0000","last_became_active":"2024-04-19T03:01:10.602397+0000","last_became_peered":"2024-04-19T03:01:10.602397+0000","last_unstale":"2024-04-19T03:01:51.060965+0000","last_undegraded":"2024-04-19T03:01:51.060965+0000","last_fullsized":"2024-04-19T03:01:51.060965+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_clean_scrub_stamp":"2024-04-19T03:01:09.578660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:36:00.072157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-19T03:01:51.060504+0000","last_change":"2024-04-19T03:01:15.020052+0000","last_active":"2024-04-19T03:01:51.060504+0000","last_peered":"2024-04-19T03:01:51.060504+0000","last_clean":"2024-04-19T03:01:51.060504+0000","last_became_active":"2024-04-19T03:01:15.019144+0000","last_became_peered":"2024-04-19T03:01:15.019144+0000","last_unstale":"2024-04-19T03:01:51.060504+0000","last_undegraded":"2024-04-19T03:01:51.060504+0000","last_fullsized":"2024-04-19T03:01:51.060504+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:39:54.289444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"30'2559","reported_seq":2575,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-19T03:01:54.975492+0000","last_change":"2024-04-19T03:01:36.755713+0000","last_active":"2024-04-19T03:01:54.975492+0000","last_peered":"2024-04-19T03:01:54.975492+0000","last_clean":"2024-04-19T03:01:54.975492+0000","last_became_active":"2024-04-19T03:01:36.755379+0000","last_became_peered":"2024-04-19T03:01:36.755379+0000","last_unstale":"2024-04-19T03:01:54.975492+0000","last_undegraded":"2024-04-19T03:01:54.975492+0000","last_fullsized":"2024-04-19T03:01:54.975492+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:35.722578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:35.722578+0000","last_clean_scrub_stamp":"2024-04-19T03:01:35.722578+0000","objects_scrubbed":0,"log_size":2559,"log_dups_size":0,"ondisk_log_size":2559,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:53:47.404400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":167706624,"num_objects":2559,"num_object_clones":0,"num_object_copies":5118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2559,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2559,"num_write_kb":163776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"20'2","reported_seq":21,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-19T03:01:48.045353+0000","last_change":"2024-04-19T03:01:14.643328+0000","last_active":"2024-04-19T03:01:48.045353+0000","last_peered":"2024-04-19T03:01:48.045353+0000","last_clean":"2024-04-19T03:01:48.045353+0000","last_became_active":"2024-04-19T03:01:14.643001+0000","last_became_peered":"2024-04-19T03:01:14.643001+0000","last_unstale":"2024-04-19T03:01:48.045353+0000","last_undegraded":"2024-04-19T03:01:48.045353+0000","last_fullsized":"2024-04-19T03:01:48.045353+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:28:14.128657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":22,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-19T03:01:48.047450+0000","last_change":"2024-04-19T03:01:10.599894+0000","last_active":"2024-04-19T03:01:48.047450+0000","last_peered":"2024-04-19T03:01:48.047450+0000","last_clean":"2024-04-19T03:01:48.047450+0000","last_became_active":"2024-04-19T03:01:10.599202+0000","last_became_peered":"2024-04-19T03:01:10.599202+0000","last_unstale":"2024-04-19T03:01:48.047450+0000","last_undegraded":"2024-04-19T03:01:48.047450+0000","last_fullsized":"2024-04-19T03:01:48.047450+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_clean_scrub_stamp":"2024-04-19T03:01:09.578660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:59:34.386302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-19T03:01:48.045468+0000","last_change":"2024-04-19T03:01:15.016429+0000","last_active":"2024-04-19T03:01:48.045468+0000","last_peered":"2024-04-19T03:01:48.045468+0000","last_clean":"2024-04-19T03:01:48.045468+0000","last_became_active":"2024-04-19T03:01:15.015945+0000","last_became_peered":"2024-04-19T03:01:15.015945+0000","last_unstale":"2024-04-19T03:01:48.045468+0000","last_undegraded":"2024-04-19T03:01:48.045468+0000","last_fullsized":"2024-04-19T03:01:48.045468+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:43:17.785352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.0","version":"30'2566","reported_seq":2582,"reported_epoch":30,"state":"active+clean","last_fresh":"2024-04-19T03:01:54.969741+0000","last_change":"2024-04-19T03:01:36.756012+0000","last_active":"2024-04-19T03:01:54.969741+0000","last_peered":"2024-04-19T03:01:54.969741+0000","last_clean":"2024-04-19T03:01:54.969741+0000","last_became_active":"2024-04-19T03:01:36.755562+0000","last_became_peered":"2024-04-19T03:01:36.755562+0000","last_unstale":"2024-04-19T03:01:54.969741+0000","last_undegraded":"2024-04-19T03:01:54.969741+0000","last_fullsized":"2024-04-19T03:01:54.969741+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:35.722578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:35.722578+0000","last_clean_scrub_stamp":"2024-04-19T03:01:35.722578+0000","objects_scrubbed":0,"log_size":2566,"log_dups_size":0,"ondisk_log_size":2566,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:42:40.911562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":168165376,"num_objects":2566,"num_object_clones":0,"num_object_copies":5132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2566,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2566,"num_write_kb":164224,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"21'1","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-19T03:01:48.047372+0000","last_change":"2024-04-19T03:01:14.647170+0000","last_active":"2024-04-19T03:01:48.047372+0000","last_peered":"2024-04-19T03:01:48.047372+0000","last_clean":"2024-04-19T03:01:48.047372+0000","last_became_active":"2024-04-19T03:01:14.646622+0000","last_became_peered":"2024-04-19T03:01:14.646622+0000","last_unstale":"2024-04-19T03:01:48.047372+0000","last_undegraded":"2024-04-19T03:01:48.047372+0000","last_fullsized":"2024-04-19T03:01:48.047372+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:32:41.909038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-19T03:01:51.054250+0000","last_change":"2024-04-19T03:01:10.602274+0000","last_active":"2024-04-19T03:01:51.054250+0000","last_peered":"2024-04-19T03:01:51.054250+0000","last_clean":"2024-04-19T03:01:51.054250+0000","last_became_active":"2024-04-19T03:01:10.601487+0000","last_became_peered":"2024-04-19T03:01:10.601487+0000","last_unstale":"2024-04-19T03:01:51.054250+0000","last_undegraded":"2024-04-19T03:01:51.054250+0000","last_fullsized":"2024-04-19T03:01:51.054250+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_clean_scrub_stamp":"2024-04-19T03:01:09.578660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:26:16.712446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-19T03:01:51.059737+0000","last_change":"2024-04-19T03:01:15.018914+0000","last_active":"2024-04-19T03:01:51.059737+0000","last_peered":"2024-04-19T03:01:51.059737+0000","last_clean":"2024-04-19T03:01:51.059737+0000","last_became_active":"2024-04-19T03:01:15.018276+0000","last_became_peered":"2024-04-19T03:01:15.018276+0000","last_unstale":"2024-04-19T03:01:51.059737+0000","last_undegraded":"2024-04-19T03:01:51.059737+0000","last_fullsized":"2024-04-19T03:01:51.059737+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:40:59.453079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-19T03:01:51.053179+0000","last_change":"2024-04-19T03:01:15.015855+0000","last_active":"2024-04-19T03:01:51.053179+0000","last_peered":"2024-04-19T03:01:51.053179+0000","last_clean":"2024-04-19T03:01:51.053179+0000","last_became_active":"2024-04-19T03:01:15.015358+0000","last_became_peered":"2024-04-19T03:01:15.015358+0000","last_unstale":"2024-04-19T03:01:51.053179+0000","last_undegraded":"2024-04-19T03:01:51.053179+0000","last_fullsized":"2024-04-19T03:01:51.053179+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:59:49.270245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"20'6","reported_seq":26,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-19T03:01:51.053509+0000","last_change":"2024-04-19T03:01:14.649577+0000","last_active":"2024-04-19T03:01:51.053509+0000","last_peered":"2024-04-19T03:01:51.053509+0000","last_clean":"2024-04-19T03:01:51.053509+0000","last_became_active":"2024-04-19T03:01:14.649284+0000","last_became_peered":"2024-04-19T03:01:14.649284+0000","last_unstale":"2024-04-19T03:01:51.053509+0000","last_undegraded":"2024-04-19T03:01:51.053509+0000","last_fullsized":"2024-04-19T03:01:51.053509+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:01:22.214742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-19T03:01:48.046206+0000","last_change":"2024-04-19T03:01:15.013509+0000","last_active":"2024-04-19T03:01:48.046206+0000","last_peered":"2024-04-19T03:01:48.046206+0000","last_clean":"2024-04-19T03:01:48.046206+0000","last_became_active":"2024-04-19T03:01:15.012694+0000","last_became_peered":"2024-04-19T03:01:15.012694+0000","last_unstale":"2024-04-19T03:01:48.046206+0000","last_undegraded":"2024-04-19T03:01:48.046206+0000","last_fullsized":"2024-04-19T03:01:48.046206+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:13:47.056938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"20'3","reported_seq":23,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-19T03:01:51.060829+0000","last_change":"2024-04-19T03:01:14.648703+0000","last_active":"2024-04-19T03:01:51.060829+0000","last_peered":"2024-04-19T03:01:51.060829+0000","last_clean":"2024-04-19T03:01:51.060829+0000","last_became_active":"2024-04-19T03:01:14.648258+0000","last_became_peered":"2024-04-19T03:01:14.648258+0000","last_unstale":"2024-04-19T03:01:51.060829+0000","last_undegraded":"2024-04-19T03:01:51.060829+0000","last_fullsized":"2024-04-19T03:01:51.060829+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:30:35.593258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-19T03:01:51.053818+0000","last_change":"2024-04-19T03:01:14.651753+0000","last_active":"2024-04-19T03:01:51.053818+0000","last_peered":"2024-04-19T03:01:51.053818+0000","last_clean":"2024-04-19T03:01:51.053818+0000","last_became_active":"2024-04-19T03:01:14.651458+0000","last_became_peered":"2024-04-19T03:01:14.651458+0000","last_unstale":"2024-04-19T03:01:51.053818+0000","last_undegraded":"2024-04-19T03:01:51.053818+0000","last_fullsized":"2024-04-19T03:01:51.053818+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:58:28.669306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-19T03:01:48.044679+0000","last_change":"2024-04-19T03:01:15.016094+0000","last_active":"2024-04-19T03:01:48.044679+0000","last_peered":"2024-04-19T03:01:48.044679+0000","last_clean":"2024-04-19T03:01:48.044679+0000","last_became_active":"2024-04-19T03:01:15.015379+0000","last_became_peered":"2024-04-19T03:01:15.015379+0000","last_unstale":"2024-04-19T03:01:48.044679+0000","last_undegraded":"2024-04-19T03:01:48.044679+0000","last_fullsized":"2024-04-19T03:01:48.044679+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:42:11.854631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-19T03:01:48.045267+0000","last_change":"2024-04-19T03:01:14.647282+0000","last_active":"2024-04-19T03:01:48.045267+0000","last_peered":"2024-04-19T03:01:48.045267+0000","last_clean":"2024-04-19T03:01:48.045267+0000","last_became_active":"2024-04-19T03:01:14.646878+0000","last_became_peered":"2024-04-19T03:01:14.646878+0000","last_unstale":"2024-04-19T03:01:48.045267+0000","last_undegraded":"2024-04-19T03:01:48.045267+0000","last_fullsized":"2024-04-19T03:01:48.045267+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:22:38.096801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-19T03:01:48.044438+0000","last_change":"2024-04-19T03:01:15.013187+0000","last_active":"2024-04-19T03:01:48.044438+0000","last_peered":"2024-04-19T03:01:48.044438+0000","last_clean":"2024-04-19T03:01:48.044438+0000","last_became_active":"2024-04-19T03:01:15.011542+0000","last_became_peered":"2024-04-19T03:01:15.011542+0000","last_unstale":"2024-04-19T03:01:48.044438+0000","last_undegraded":"2024-04-19T03:01:48.044438+0000","last_fullsized":"2024-04-19T03:01:48.044438+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:53:13.646525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-19T03:01:51.062461+0000","last_change":"2024-04-19T03:01:15.020635+0000","last_active":"2024-04-19T03:01:51.062461+0000","last_peered":"2024-04-19T03:01:51.062461+0000","last_clean":"2024-04-19T03:01:51.062461+0000","last_became_active":"2024-04-19T03:01:15.019917+0000","last_became_peered":"2024-04-19T03:01:15.019917+0000","last_unstale":"2024-04-19T03:01:51.062461+0000","last_undegraded":"2024-04-19T03:01:51.062461+0000","last_fullsized":"2024-04-19T03:01:51.062461+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:40:53.477682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-19T03:01:48.045586+0000","last_change":"2024-04-19T03:01:14.643239+0000","last_active":"2024-04-19T03:01:48.045586+0000","last_peered":"2024-04-19T03:01:48.045586+0000","last_clean":"2024-04-19T03:01:48.045586+0000","last_became_active":"2024-04-19T03:01:14.642959+0000","last_became_peered":"2024-04-19T03:01:14.642959+0000","last_unstale":"2024-04-19T03:01:48.045586+0000","last_undegraded":"2024-04-19T03:01:48.045586+0000","last_fullsized":"2024-04-19T03:01:48.045586+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:05:36.752017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":18,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-19T03:01:48.045643+0000","last_change":"2024-04-19T03:01:15.017708+0000","last_active":"2024-04-19T03:01:48.045643+0000","last_peered":"2024-04-19T03:01:48.045643+0000","last_clean":"2024-04-19T03:01:48.045643+0000","last_became_active":"2024-04-19T03:01:15.016726+0000","last_became_peered":"2024-04-19T03:01:15.016726+0000","last_unstale":"2024-04-19T03:01:48.045643+0000","last_undegraded":"2024-04-19T03:01:48.045643+0000","last_fullsized":"2024-04-19T03:01:48.045643+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:07:47.395052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":19,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-19T03:01:48.044831+0000","last_change":"2024-04-19T03:01:14.647744+0000","last_active":"2024-04-19T03:01:48.044831+0000","last_peered":"2024-04-19T03:01:48.044831+0000","last_clean":"2024-04-19T03:01:48.044831+0000","last_became_active":"2024-04-19T03:01:14.647463+0000","last_became_peered":"2024-04-19T03:01:14.647463+0000","last_unstale":"2024-04-19T03:01:48.044831+0000","last_undegraded":"2024-04-19T03:01:48.044831+0000","last_fullsized":"2024-04-19T03:01:48.044831+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:56:15.348940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-19T03:01:51.060457+0000","last_change":"2024-04-19T03:01:15.019045+0000","last_active":"2024-04-19T03:01:51.060457+0000","last_peered":"2024-04-19T03:01:51.060457+0000","last_clean":"2024-04-19T03:01:51.060457+0000","last_became_active":"2024-04-19T03:01:15.017982+0000","last_became_peered":"2024-04-19T03:01:15.017982+0000","last_unstale":"2024-04-19T03:01:51.060457+0000","last_undegraded":"2024-04-19T03:01:51.060457+0000","last_fullsized":"2024-04-19T03:01:51.060457+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:10:56.732208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"20'1","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-19T03:01:51.060142+0000","last_change":"2024-04-19T03:01:14.651050+0000","last_active":"2024-04-19T03:01:51.060142+0000","last_peered":"2024-04-19T03:01:51.060142+0000","last_clean":"2024-04-19T03:01:51.060142+0000","last_became_active":"2024-04-19T03:01:14.650639+0000","last_became_peered":"2024-04-19T03:01:14.650639+0000","last_unstale":"2024-04-19T03:01:51.060142+0000","last_undegraded":"2024-04-19T03:01:51.060142+0000","last_fullsized":"2024-04-19T03:01:51.060142+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:41:49.783896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-19T03:01:51.060297+0000","last_change":"2024-04-19T03:01:15.017319+0000","last_active":"2024-04-19T03:01:51.060297+0000","last_peered":"2024-04-19T03:01:51.060297+0000","last_clean":"2024-04-19T03:01:51.060297+0000","last_became_active":"2024-04-19T03:01:15.016815+0000","last_became_peered":"2024-04-19T03:01:15.016815+0000","last_unstale":"2024-04-19T03:01:51.060297+0000","last_undegraded":"2024-04-19T03:01:51.060297+0000","last_fullsized":"2024-04-19T03:01:51.060297+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:36:36.363535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"20'1","reported_seq":21,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-19T03:01:51.060677+0000","last_change":"2024-04-19T03:01:14.648823+0000","last_active":"2024-04-19T03:01:51.060677+0000","last_peered":"2024-04-19T03:01:51.060677+0000","last_clean":"2024-04-19T03:01:51.060677+0000","last_became_active":"2024-04-19T03:01:14.648337+0000","last_became_peered":"2024-04-19T03:01:14.648337+0000","last_unstale":"2024-04-19T03:01:51.060677+0000","last_undegraded":"2024-04-19T03:01:51.060677+0000","last_fullsized":"2024-04-19T03:01:51.060677+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:08:46.250118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-19T03:01:51.053146+0000","last_change":"2024-04-19T03:01:15.014773+0000","last_active":"2024-04-19T03:01:51.053146+0000","last_peered":"2024-04-19T03:01:51.053146+0000","last_clean":"2024-04-19T03:01:51.053146+0000","last_became_active":"2024-04-19T03:01:15.013919+0000","last_became_peered":"2024-04-19T03:01:15.013919+0000","last_unstale":"2024-04-19T03:01:51.053146+0000","last_undegraded":"2024-04-19T03:01:51.053146+0000","last_fullsized":"2024-04-19T03:01:51.053146+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:56:44.307812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"20'2","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-19T03:01:51.053395+0000","last_change":"2024-04-19T03:01:14.651049+0000","last_active":"2024-04-19T03:01:51.053395+0000","last_peered":"2024-04-19T03:01:51.053395+0000","last_clean":"2024-04-19T03:01:51.053395+0000","last_became_active":"2024-04-19T03:01:14.650646+0000","last_became_peered":"2024-04-19T03:01:14.650646+0000","last_unstale":"2024-04-19T03:01:51.053395+0000","last_undegraded":"2024-04-19T03:01:51.053395+0000","last_fullsized":"2024-04-19T03:01:51.053395+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:33:59.716591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-19T03:01:51.055526+0000","last_change":"2024-04-19T03:01:15.017860+0000","last_active":"2024-04-19T03:01:51.055526+0000","last_peered":"2024-04-19T03:01:51.055526+0000","last_clean":"2024-04-19T03:01:51.055526+0000","last_became_active":"2024-04-19T03:01:15.017355+0000","last_became_peered":"2024-04-19T03:01:15.017355+0000","last_unstale":"2024-04-19T03:01:51.055526+0000","last_undegraded":"2024-04-19T03:01:51.055526+0000","last_fullsized":"2024-04-19T03:01:51.055526+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:13:06.902769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"20'2","reported_seq":22,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-19T03:01:51.060636+0000","last_change":"2024-04-19T03:01:14.649277+0000","last_active":"2024-04-19T03:01:51.060636+0000","last_peered":"2024-04-19T03:01:51.060636+0000","last_clean":"2024-04-19T03:01:51.060636+0000","last_became_active":"2024-04-19T03:01:14.648614+0000","last_became_peered":"2024-04-19T03:01:14.648614+0000","last_unstale":"2024-04-19T03:01:51.060636+0000","last_undegraded":"2024-04-19T03:01:51.060636+0000","last_fullsized":"2024-04-19T03:01:51.060636+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:34:05.922324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-19T03:01:51.059901+0000","last_change":"2024-04-19T03:01:15.017986+0000","last_active":"2024-04-19T03:01:51.059901+0000","last_peered":"2024-04-19T03:01:51.059901+0000","last_clean":"2024-04-19T03:01:51.059901+0000","last_became_active":"2024-04-19T03:01:15.017080+0000","last_became_peered":"2024-04-19T03:01:15.017080+0000","last_unstale":"2024-04-19T03:01:51.059901+0000","last_undegraded":"2024-04-19T03:01:51.059901+0000","last_fullsized":"2024-04-19T03:01:51.059901+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:14:57.922917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"20'1","reported_seq":20,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-19T03:01:48.047199+0000","last_change":"2024-04-19T03:01:14.644015+0000","last_active":"2024-04-19T03:01:48.047199+0000","last_peered":"2024-04-19T03:01:48.047199+0000","last_clean":"2024-04-19T03:01:48.047199+0000","last_became_active":"2024-04-19T03:01:14.643769+0000","last_became_peered":"2024-04-19T03:01:14.643769+0000","last_unstale":"2024-04-19T03:01:48.047199+0000","last_undegraded":"2024-04-19T03:01:48.047199+0000","last_fullsized":"2024-04-19T03:01:48.047199+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:56:05.481089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":19,"reported_epoch":29,"state":"active+clean","last_fresh":"2024-04-19T03:01:51.052883+0000","last_change":"2024-04-19T03:01:15.019466+0000","last_active":"2024-04-19T03:01:51.052883+0000","last_peered":"2024-04-19T03:01:51.052883+0000","last_clean":"2024-04-19T03:01:51.052883+0000","last_became_active":"2024-04-19T03:01:15.018819+0000","last_became_peered":"2024-04-19T03:01:15.018819+0000","last_unstale":"2024-04-19T03:01:51.052883+0000","last_undegraded":"2024-04-19T03:01:51.052883+0000","last_fullsized":"2024-04-19T03:01:51.052883+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:13:26.030579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"20'4","reported_seq":23,"reported_epoch":28,"state":"active+clean","last_fresh":"2024-04-19T03:01:48.045198+0000","last_change":"2024-04-19T03:01:14.647358+0000","last_active":"2024-04-19T03:01:48.045198+0000","last_peered":"2024-04-19T03:01:48.045198+0000","last_clean":"2024-04-19T03:01:48.045198+0000","last_became_active":"2024-04-19T03:01:14.646998+0000","last_became_peered":"2024-04-19T03:01:14.646998+0000","last_unstale":"2024-04-19T03:01:48.045198+0000","last_undegraded":"2024-04-19T03:01:48.045198+0000","last_fullsized":"2024-04-19T03:01:48.045198+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:09:04.022991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":2604138496,"num_objects":39736,"num_object_clones":0,"num_object_copies":79472,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39736,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":39736,"num_write_kb":2543104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":323665920,"data_stored":5178654720,"data_compressed":9908197,"data_compressed_allocated":323665920,"data_compressed_original":5178654720,"omap_allocated":0,"internal_metadata":0},"log_size":39736,"ondisk_log_size":39736,"up":32,"acting":32,"num_store_stats":3},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":14482,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":10,"seq":42949672976,"num_pgs":81,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":153988,"kb_used_data":100728,"kb_used_omap":1,"kb_used_meta":53246,"kb_avail":94217852,"statfs":{"total":96636764160,"available":96479080448,"internally_reserved":0,"allocated":103145472,"data_stored":1644929504,"data_compressed":3153370,"data_compressed_allocated":102801408,"data_compressed_original":1644806144,"omap_allocated":1594,"internal_metadata":54524358},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,1,4,2],"upper_bound":16},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90400000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26400000000000001}]}]},{"osd":1,"up_from":10,"seq":42949672975,"num_pgs":76,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":138492,"kb_used_data":89332,"kb_used_omap":1,"kb_used_meta":49150,"kb_avail":94233348,"statfs":{"total":96636764160,"available":96494948352,"internally_reserved":0,"allocated":91475968,"data_stored":1458347896,"data_compressed":2796039,"data_compressed_allocated":91140096,"data_compressed_original":1458225152,"omap_allocated":1594,"internal_metadata":50330054},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2,0,2,5],"upper_bound":16},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38900000000000001}]}]},{"osd":0,"up_from":9,"seq":38654705678,"num_pgs":85,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":175104,"kb_used_data":121848,"kb_used_omap":1,"kb_used_meta":53246,"kb_avail":94196736,"statfs":{"total":96636764160,"available":96457457664,"internally_reserved":0,"allocated":124772352,"data_stored":1991870221,"data_compressed":3810065,"data_compressed_allocated":124485632,"data_compressed_original":1991770112,"omap_allocated":1594,"internal_metadata":54524358},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.219}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4330000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":7241,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":7241,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":127455232,"data_stored":2039283712,"data_compressed":3901297,"data_compressed_allocated":127455232,"data_compressed_original":2039283712,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":92991488,"data_stored":1487863808,"data_compressed":2846805,"data_compressed_allocated":92991488,"data_compressed_original":1487863808,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":103219200,"data_stored":1651507200,"data_compressed":3160095,"data_compressed_allocated":103219200,"data_compressed_original":1651507200,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-19T03:01:57.145 INFO:tasks.thrashosds.thrasher:Setting 3.1b to [1, 0] 2024-04-19T03:01:57.145 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap', '3.1b', '1', '0'] 2024-04-19T03:01:57.145 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pg-upmap 3.1b 1 0 2024-04-19T03:01:57.146 INFO:teuthology.orchestra.run.smithi096.stderr:nodeep-scrub is unset 2024-04-19T03:01:57.233 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:01:57.232+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:01:57.271 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-19T03:01:57.271 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-04-19T03:01:57.271 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.271 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:44795 5.b 5:d19a1397:::benchmark_data_smithi096_19531_object44794:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-19T03:01:57.271 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:57.261051+0000", 2024-04-19T03:01:57.271 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0092430150000000003, 2024-04-19T03:01:57.271 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0092753039999999998, 2024-04-19T03:01:57.271 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:01:57.271 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:01:57.271 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:01:57.272 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:01:57.272 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:57.272 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44795 2024-04-19T03:01:57.272 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.272 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:01:57.272 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.272 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:01:57.272 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:57.261051+0000", 2024-04-19T03:01:57.272 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:57.272 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.272 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.272 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:01:57.272 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:57.261051+0000", 2024-04-19T03:01:57.273 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:57.273 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.273 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.273 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:01:57.273 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:57.261050+0000", 2024-04-19T03:01:57.273 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:01:57.273 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.273 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.273 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:01:57.273 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:57.261109+0000", 2024-04-19T03:01:57.273 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9015999999999999e-05 2024-04-19T03:01:57.273 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.273 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.273 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:01:57.273 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:57.261121+0000", 2024-04-19T03:01:57.274 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1584e-05 2024-04-19T03:01:57.274 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.274 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.274 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:01:57.274 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:57.261129+0000", 2024-04-19T03:01:57.274 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1410000000000005e-06 2024-04-19T03:01:57.274 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.274 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.274 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:57.274 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:57.261178+0000", 2024-04-19T03:01:57.274 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9332000000000001e-05 2024-04-19T03:01:57.274 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.274 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.274 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:01:57.275 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:57.261376+0000", 2024-04-19T03:01:57.275 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00019735299999999999 2024-04-19T03:01:57.275 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.275 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.275 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:01:57.275 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:57.261534+0000", 2024-04-19T03:01:57.275 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015846999999999999 2024-04-19T03:01:57.275 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.275 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.275 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:01:57.275 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:57.265951+0000", 2024-04-19T03:01:57.275 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0044170299999999997 2024-04-19T03:01:57.275 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:57.275 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:01:57.276 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:57.276 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.276 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.276 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:44800 5.b 5:dcdeb52d:::benchmark_data_smithi096_19531_object44799:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-19T03:01:57.276 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:57.263798+0000", 2024-04-19T03:01:57.276 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0064965149999999996, 2024-04-19T03:01:57.276 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0066336110000000002, 2024-04-19T03:01:57.276 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:01:57.276 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:01:57.276 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:01:57.276 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:01:57.276 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:57.276 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44800 2024-04-19T03:01:57.276 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.276 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:01:57.277 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.277 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:01:57.277 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:57.263798+0000", 2024-04-19T03:01:57.277 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:57.277 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.277 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.277 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:01:57.277 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:57.263798+0000", 2024-04-19T03:01:57.277 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:57.277 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.277 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.277 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:01:57.277 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:57.263797+0000", 2024-04-19T03:01:57.277 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:01:57.278 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.278 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.278 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:01:57.278 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:57.263858+0000", 2024-04-19T03:01:57.278 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1515999999999999e-05 2024-04-19T03:01:57.278 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.278 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.278 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:01:57.278 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:57.263868+0000", 2024-04-19T03:01:57.278 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.3999999999999998e-06 2024-04-19T03:01:57.278 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.278 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.278 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:01:57.279 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:57.263874+0000", 2024-04-19T03:01:57.279 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6139999999999997e-06 2024-04-19T03:01:57.279 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.279 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.279 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:57.279 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:57.263926+0000", 2024-04-19T03:01:57.279 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1705e-05 2024-04-19T03:01:57.279 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.279 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.279 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:01:57.279 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:57.264100+0000", 2024-04-19T03:01:57.279 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00017456199999999999 2024-04-19T03:01:57.279 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.279 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.279 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:01:57.280 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:57.264201+0000", 2024-04-19T03:01:57.280 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000100379 2024-04-19T03:01:57.280 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.280 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.280 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:01:57.280 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:57.266472+0000", 2024-04-19T03:01:57.280 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.002270996 2024-04-19T03:01:57.280 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:57.280 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:01:57.280 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:57.280 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.280 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.280 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:44803 5.8 5:1823e4e7:::benchmark_data_smithi096_19531_object44802:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-19T03:01:57.280 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:57.265026+0000", 2024-04-19T03:01:57.281 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0052681350000000002, 2024-04-19T03:01:57.281 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0055010129999999999, 2024-04-19T03:01:57.281 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:01:57.281 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:01:57.281 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:01:57.281 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:01:57.281 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:57.281 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44803 2024-04-19T03:01:57.281 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.281 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:01:57.281 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.281 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:01:57.281 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:57.265026+0000", 2024-04-19T03:01:57.281 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:57.282 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.282 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.282 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:01:57.282 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:57.265026+0000", 2024-04-19T03:01:57.282 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:57.282 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.282 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.282 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:01:57.282 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:57.265025+0000", 2024-04-19T03:01:57.282 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:01:57.282 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.282 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.282 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:01:57.282 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:57.265106+0000", 2024-04-19T03:01:57.283 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0857000000000002e-05 2024-04-19T03:01:57.283 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.283 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.283 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:01:57.283 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:57.265117+0000", 2024-04-19T03:01:57.283 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0729e-05 2024-04-19T03:01:57.283 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.283 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.283 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:01:57.283 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:57.265122+0000", 2024-04-19T03:01:57.283 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2549999999999997e-06 2024-04-19T03:01:57.283 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.283 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.283 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:57.283 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:57.265169+0000", 2024-04-19T03:01:57.284 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6964e-05 2024-04-19T03:01:57.284 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.284 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.284 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:01:57.284 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:57.265360+0000", 2024-04-19T03:01:57.284 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000191134 2024-04-19T03:01:57.284 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.284 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.284 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:01:57.284 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:57.265530+0000", 2024-04-19T03:01:57.284 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000170044 2024-04-19T03:01:57.284 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.284 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.284 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:01:57.284 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:57.268352+0000", 2024-04-19T03:01:57.284 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0028213829999999998 2024-04-19T03:01:57.285 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:57.285 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:01:57.285 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:57.285 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.285 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.285 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:44807 5.b 5:d2c258df:::benchmark_data_smithi096_19531_object44806:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-19T03:01:57.285 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:57.267069+0000", 2024-04-19T03:01:57.285 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0032250299999999998, 2024-04-19T03:01:57.285 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0035582880000000002, 2024-04-19T03:01:57.285 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:01:57.285 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:01:57.285 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:01:57.285 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:01:57.285 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:57.286 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44807 2024-04-19T03:01:57.286 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.286 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:01:57.286 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.286 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:01:57.286 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:57.267069+0000", 2024-04-19T03:01:57.286 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:57.286 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.286 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.286 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:01:57.286 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:57.267069+0000", 2024-04-19T03:01:57.286 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:57.286 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.286 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.287 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:01:57.287 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:57.267068+0000", 2024-04-19T03:01:57.287 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:01:57.287 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.287 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.287 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:01:57.287 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:57.267120+0000", 2024-04-19T03:01:57.287 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2096999999999999e-05 2024-04-19T03:01:57.287 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.287 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.287 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:01:57.287 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:57.267137+0000", 2024-04-19T03:01:57.287 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7118000000000001e-05 2024-04-19T03:01:57.287 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.288 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.288 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:01:57.288 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:57.267148+0000", 2024-04-19T03:01:57.288 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0890000000000001e-05 2024-04-19T03:01:57.288 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.288 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.288 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:57.288 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:57.267216+0000", 2024-04-19T03:01:57.288 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.8481999999999999e-05 2024-04-19T03:01:57.288 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.288 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.288 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:01:57.288 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:57.267349+0000", 2024-04-19T03:01:57.288 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013265799999999999 2024-04-19T03:01:57.288 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.289 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.289 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:01:57.289 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:57.267501+0000", 2024-04-19T03:01:57.289 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015228900000000001 2024-04-19T03:01:57.289 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:57.289 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:01:57.289 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:57.289 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.289 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.289 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4755.0:44806 5.9 e31/22 5:994458b0:::benchmark_data_smithi096_19531_object44805:head v 31'2724, mlcod=31'2721)", 2024-04-19T03:01:57.289 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:57.267374+0000", 2024-04-19T03:01:57.289 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0029204560000000001, 2024-04-19T03:01:57.289 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0033012279999999998, 2024-04-19T03:01:57.289 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:01:57.289 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-19T03:01:57.290 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:01:57.290 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.290 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:01:57.290 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:57.267374+0000", 2024-04-19T03:01:57.290 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:57.290 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.290 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.290 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:01:57.290 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:57.267374+0000", 2024-04-19T03:01:57.290 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:57.290 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.290 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.290 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:01:57.290 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:57.267373+0000", 2024-04-19T03:01:57.291 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:01:57.291 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.291 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.291 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:01:57.291 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:57.267426+0000", 2024-04-19T03:01:57.291 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2871000000000003e-05 2024-04-19T03:01:57.291 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.291 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.291 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:01:57.291 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:57.267444+0000", 2024-04-19T03:01:57.291 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7846000000000002e-05 2024-04-19T03:01:57.291 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.291 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.291 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:01:57.292 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:57.267452+0000", 2024-04-19T03:01:57.292 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.4829999999999999e-06 2024-04-19T03:01:57.292 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.292 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.292 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:57.292 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:57.267476+0000", 2024-04-19T03:01:57.292 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4125999999999999e-05 2024-04-19T03:01:57.292 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.292 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.292 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:01:57.292 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:57.267497+0000", 2024-04-19T03:01:57.292 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0373e-05 2024-04-19T03:01:57.292 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:57.292 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:01:57.292 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:57.293 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.293 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.293 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:44808 5.4 5:283c080f:::benchmark_data_smithi096_19531_object44807:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-19T03:01:57.293 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:57.268327+0000", 2024-04-19T03:01:57.293 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0019676329999999999, 2024-04-19T03:01:57.293 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0023909690000000002, 2024-04-19T03:01:57.293 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:01:57.293 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:01:57.293 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:01:57.293 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:01:57.293 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:57.293 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44808 2024-04-19T03:01:57.293 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.293 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:01:57.293 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.294 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:01:57.294 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:57.268327+0000", 2024-04-19T03:01:57.294 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:57.294 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.294 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.294 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:01:57.294 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:57.268327+0000", 2024-04-19T03:01:57.294 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:57.294 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.294 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.294 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:01:57.294 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:57.268325+0000", 2024-04-19T03:01:57.294 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:01:57.294 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.295 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.295 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:01:57.295 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:57.268385+0000", 2024-04-19T03:01:57.295 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9589000000000002e-05 2024-04-19T03:01:57.295 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.295 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.295 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:01:57.295 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:57.268394+0000", 2024-04-19T03:01:57.295 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9900000000000003e-06 2024-04-19T03:01:57.295 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.295 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.295 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:01:57.295 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:57.268400+0000", 2024-04-19T03:01:57.296 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8259999999999998e-06 2024-04-19T03:01:57.296 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.296 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.296 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:57.296 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:57.268451+0000", 2024-04-19T03:01:57.296 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0939000000000001e-05 2024-04-19T03:01:57.296 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.296 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.296 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:01:57.296 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:57.268638+0000", 2024-04-19T03:01:57.296 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00018759700000000001 2024-04-19T03:01:57.296 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.296 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.297 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:01:57.297 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:57.268843+0000", 2024-04-19T03:01:57.297 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00020471500000000001 2024-04-19T03:01:57.297 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:57.297 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:01:57.297 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:57.297 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.297 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.297 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:44809 5.e 5:768b31ab:::benchmark_data_smithi096_19531_object44808:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-19T03:01:57.297 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:57.269195+0000", 2024-04-19T03:01:57.297 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.00109913, 2024-04-19T03:01:57.297 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001572436, 2024-04-19T03:01:57.297 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:01:57.298 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:01:57.298 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:01:57.298 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:01:57.298 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:57.298 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44809 2024-04-19T03:01:57.298 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.298 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:01:57.298 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.298 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:01:57.298 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:57.269195+0000", 2024-04-19T03:01:57.298 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:57.298 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.298 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.298 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:01:57.299 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:57.269195+0000", 2024-04-19T03:01:57.299 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:57.299 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.299 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.299 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:01:57.299 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:57.269194+0000", 2024-04-19T03:01:57.299 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:01:57.299 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.299 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.299 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:01:57.299 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:57.269275+0000", 2024-04-19T03:01:57.299 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1113999999999996e-05 2024-04-19T03:01:57.299 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.299 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.299 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:01:57.300 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:57.269287+0000", 2024-04-19T03:01:57.300 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1505000000000001e-05 2024-04-19T03:01:57.300 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.300 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.300 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:01:57.300 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:57.269295+0000", 2024-04-19T03:01:57.300 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.8520000000000004e-06 2024-04-19T03:01:57.300 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.300 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.300 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:57.300 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:57.269349+0000", 2024-04-19T03:01:57.300 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4018999999999999e-05 2024-04-19T03:01:57.300 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.300 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.301 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:01:57.301 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:57.269489+0000", 2024-04-19T03:01:57.301 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014080599999999999 2024-04-19T03:01:57.301 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.301 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.301 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:01:57.301 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:57.269696+0000", 2024-04-19T03:01:57.301 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000206252 2024-04-19T03:01:57.301 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:57.301 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:01:57.301 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:57.301 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.301 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.302 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:44810 5.b 5:d84d2bfb:::benchmark_data_smithi096_19531_object44809:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-19T03:01:57.302 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:57.269312+0000", 2024-04-19T03:01:57.302 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.00098258500000000001, 2024-04-19T03:01:57.302 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001503253, 2024-04-19T03:01:57.302 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:01:57.302 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:01:57.302 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:01:57.302 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:01:57.302 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:57.302 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44810 2024-04-19T03:01:57.302 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.302 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:01:57.302 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.303 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:01:57.303 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:57.269312+0000", 2024-04-19T03:01:57.303 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:57.303 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.303 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.303 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:01:57.303 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:57.269312+0000", 2024-04-19T03:01:57.303 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:57.303 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.303 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.303 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:01:57.303 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:57.269311+0000", 2024-04-19T03:01:57.303 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:01:57.304 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.304 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.304 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:01:57.304 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:57.269350+0000", 2024-04-19T03:01:57.304 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8757000000000002e-05 2024-04-19T03:01:57.304 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.304 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.304 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:01:57.304 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:57.269358+0000", 2024-04-19T03:01:57.304 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.7369999999999995e-06 2024-04-19T03:01:57.304 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.304 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.304 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:01:57.304 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:57.269365+0000", 2024-04-19T03:01:57.305 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.9249999999999998e-06 2024-04-19T03:01:57.305 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.305 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.305 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:57.305 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:57.269849+0000", 2024-04-19T03:01:57.305 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00048412500000000002 2024-04-19T03:01:57.305 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.305 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.305 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:01:57.305 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:57.270084+0000", 2024-04-19T03:01:57.305 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00023504799999999999 2024-04-19T03:01:57.305 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.305 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.305 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:01:57.305 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:57.270275+0000", 2024-04-19T03:01:57.306 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00019086400000000001 2024-04-19T03:01:57.306 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:57.306 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:01:57.306 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:57.306 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.306 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.306 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop_reply(client.4755.0:44795 5.b e31/22)", 2024-04-19T03:01:57.306 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:57.269389+0000", 2024-04-19T03:01:57.306 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.00090500599999999997, 2024-04-19T03:01:57.306 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001468392, 2024-04-19T03:01:57.306 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:01:57.306 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-04-19T03:01:57.306 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:01:57.307 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.307 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:01:57.307 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:57.269389+0000", 2024-04-19T03:01:57.307 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:57.307 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.307 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.307 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:01:57.307 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:57.269389+0000", 2024-04-19T03:01:57.307 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:57.307 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.307 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.307 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:01:57.307 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:57.269389+0000", 2024-04-19T03:01:57.307 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:01:57.307 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.308 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.308 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:01:57.308 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:57.269393+0000", 2024-04-19T03:01:57.308 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9929999999999997e-06 2024-04-19T03:01:57.308 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.308 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.308 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:01:57.308 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:57.269400+0000", 2024-04-19T03:01:57.308 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3209999999999999e-06 2024-04-19T03:01:57.308 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.308 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.308 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:01:57.308 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:57.269406+0000", 2024-04-19T03:01:57.308 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0050000000000001e-06 2024-04-19T03:01:57.309 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:57.309 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:01:57.309 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:57.309 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.309 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.309 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:44813 5.8 5:17f530ba:::benchmark_data_smithi096_19531_object44812:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-19T03:01:57.309 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:57.269631+0000", 2024-04-19T03:01:57.309 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.00066362699999999997, 2024-04-19T03:01:57.309 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001259764, 2024-04-19T03:01:57.309 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:01:57.309 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:01:57.309 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:01:57.309 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:01:57.309 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:57.309 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44813 2024-04-19T03:01:57.310 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.310 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:01:57.310 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.310 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:01:57.310 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:57.269631+0000", 2024-04-19T03:01:57.310 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:57.310 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.310 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.310 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:01:57.310 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:57.269631+0000", 2024-04-19T03:01:57.310 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:57.310 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.311 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.311 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:01:57.311 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:57.269630+0000", 2024-04-19T03:01:57.311 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:01:57.311 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.311 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.311 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:01:57.311 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:57.269705+0000", 2024-04-19T03:01:57.311 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5496999999999999e-05 2024-04-19T03:01:57.311 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.311 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.311 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:01:57.313 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:57.269714+0000", 2024-04-19T03:01:57.313 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.4980000000000006e-06 2024-04-19T03:01:57.313 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.313 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.313 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:01:57.313 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:57.269720+0000", 2024-04-19T03:01:57.313 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7129999999999999e-06 2024-04-19T03:01:57.313 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.313 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.313 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:57.314 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:57.269803+0000", 2024-04-19T03:01:57.314 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.2719000000000005e-05 2024-04-19T03:01:57.314 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.314 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.314 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:01:57.314 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:57.270050+0000", 2024-04-19T03:01:57.314 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000246791 2024-04-19T03:01:57.314 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.314 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.314 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:01:57.314 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:57.270247+0000", 2024-04-19T03:01:57.314 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00019730799999999999 2024-04-19T03:01:57.314 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:57.314 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:01:57.315 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:57.315 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.315 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.315 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:44814 5.0 5:08935f0a:::benchmark_data_smithi096_19531_object44813:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-19T03:01:57.315 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:57.270066+0000", 2024-04-19T03:01:57.315 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.00022834999999999999, 2024-04-19T03:01:57.315 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00087171299999999998, 2024-04-19T03:01:57.315 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:01:57.315 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:01:57.315 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:01:57.315 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:01:57.315 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:57.315 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 44814 2024-04-19T03:01:57.315 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.316 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:01:57.316 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.316 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:01:57.316 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:57.270066+0000", 2024-04-19T03:01:57.316 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:57.316 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.316 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.316 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:01:57.316 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:57.270066+0000", 2024-04-19T03:01:57.316 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:57.316 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.316 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.316 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:01:57.316 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:57.270065+0000", 2024-04-19T03:01:57.316 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:01:57.317 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.317 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.317 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:01:57.317 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:57.270147+0000", 2024-04-19T03:01:57.317 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1963000000000001e-05 2024-04-19T03:01:57.317 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.317 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.317 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:01:57.317 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:57.270159+0000", 2024-04-19T03:01:57.317 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1574e-05 2024-04-19T03:01:57.317 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.317 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.317 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:01:57.317 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:57.270167+0000", 2024-04-19T03:01:57.318 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.943e-06 2024-04-19T03:01:57.318 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.318 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.318 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:57.318 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:57.270225+0000", 2024-04-19T03:01:57.318 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8074e-05 2024-04-19T03:01:57.318 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.318 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.318 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:01:57.318 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:57.270372+0000", 2024-04-19T03:01:57.318 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014695999999999999 2024-04-19T03:01:57.318 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.318 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.318 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:01:57.319 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:57.270536+0000", 2024-04-19T03:01:57.319 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016404700000000001 2024-04-19T03:01:57.319 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:57.319 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:01:57.319 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:57.319 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:57.319 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-04-19T03:01:57.319 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 11 2024-04-19T03:01:57.319 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-19T03:01:57.320 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T03:01:57.334 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:01:57.332+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:01:57.435 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-04-19T03:01:57.433+0000 7f35986ab700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18243) UID: 0 2024-04-19T03:01:57.450 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-19T03:01:57.450 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-04-19T03:01:57.450 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-04-19T03:01:57.451 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-04-19T03:01:57.451 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-19T03:01:57.461 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T03:01:57.484 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-19T03:01:57.536 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:01:57.536+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:01:57.627 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-19T03:01:57.627 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-04-19T03:01:57.628 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-04-19T03:01:57.628 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-04-19T03:01:57.628 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.628 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:9 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:01:57.628 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:14.999380+0000", 2024-04-19T03:01:57.628 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 42.626593176999997, 2024-04-19T03:01:57.628 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.019009906, 2024-04-19T03:01:57.628 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:01:57.628 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:57.628 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:01:57.628 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.628 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:01:57.628 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999380+0000", 2024-04-19T03:01:57.629 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:57.629 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.629 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.629 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:01:57.629 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999380+0000", 2024-04-19T03:01:57.629 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:57.629 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.629 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.629 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:01:57.629 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999377+0000", 2024-04-19T03:01:57.629 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999971 2024-04-19T03:01:57.629 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.629 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.629 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:01:57.629 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999393+0000", 2024-04-19T03:01:57.630 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5665999999999999e-05 2024-04-19T03:01:57.630 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.630 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.630 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:01:57.630 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999416+0000", 2024-04-19T03:01:57.630 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3030000000000001e-05 2024-04-19T03:01:57.630 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.630 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.630 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:01:57.630 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999439+0000", 2024-04-19T03:01:57.630 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3203000000000001e-05 2024-04-19T03:01:57.630 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.630 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.631 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:57.631 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999564+0000", 2024-04-19T03:01:57.631 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012492800000000001 2024-04-19T03:01:57.631 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.631 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.631 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op must wait for map", 2024-04-19T03:01:57.631 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999573+0000", 2024-04-19T03:01:57.631 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.7129999999999994e-06 2024-04-19T03:01:57.631 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.631 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.631 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:57.631 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.005623+0000", 2024-04-19T03:01:57.631 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0060502120000000001 2024-04-19T03:01:57.631 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.632 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.632 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:01:57.632 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.006510+0000", 2024-04-19T03:01:57.632 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00088656 2024-04-19T03:01:57.632 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.632 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.632 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-04-19T03:01:57.632 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.008004+0000", 2024-04-19T03:01:57.632 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0014948240000000001 2024-04-19T03:01:57.632 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.632 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.632 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:01:57.632 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.011874+0000", 2024-04-19T03:01:57.632 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0038699630000000001 2024-04-19T03:01:57.633 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.633 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.633 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:57.633 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.018000+0000", 2024-04-19T03:01:57.633 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0061254389999999999 2024-04-19T03:01:57.633 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.633 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.633 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:01:57.633 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.018281+0000", 2024-04-19T03:01:57.633 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00028121400000000001 2024-04-19T03:01:57.633 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.633 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.633 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:01:57.633 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.018390+0000", 2024-04-19T03:01:57.634 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010899 2024-04-19T03:01:57.634 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:57.634 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:01:57.634 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:57.634 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.634 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.634 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:10 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:01:57.634 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:14.999496+0000", 2024-04-19T03:01:57.634 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 42.626477641999998, 2024-04-19T03:01:57.634 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.022720497999999999, 2024-04-19T03:01:57.634 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:01:57.634 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:57.634 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:01:57.634 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.635 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:01:57.635 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999496+0000", 2024-04-19T03:01:57.635 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:57.635 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.635 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.635 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:01:57.635 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999496+0000", 2024-04-19T03:01:57.635 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:57.635 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.635 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.635 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:01:57.635 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999494+0000", 2024-04-19T03:01:57.635 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:01:57.636 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.636 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.636 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:01:57.636 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999503+0000", 2024-04-19T03:01:57.636 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.5930000000000006e-06 2024-04-19T03:01:57.636 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.636 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.636 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:01:57.636 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999523+0000", 2024-04-19T03:01:57.636 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9553000000000001e-05 2024-04-19T03:01:57.636 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.636 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.636 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:01:57.636 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999538+0000", 2024-04-19T03:01:57.637 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5702999999999999e-05 2024-04-19T03:01:57.637 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.637 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.637 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:57.637 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999608+0000", 2024-04-19T03:01:57.637 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.9912000000000004e-05 2024-04-19T03:01:57.637 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.637 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.637 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op must wait for map", 2024-04-19T03:01:57.637 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999626+0000", 2024-04-19T03:01:57.637 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8207e-05 2024-04-19T03:01:57.637 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.637 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.637 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:57.637 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.010765+0000", 2024-04-19T03:01:57.638 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011138719 2024-04-19T03:01:57.638 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.638 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.638 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:01:57.638 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.010906+0000", 2024-04-19T03:01:57.638 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014095899999999999 2024-04-19T03:01:57.638 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.638 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.638 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-04-19T03:01:57.638 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.011472+0000", 2024-04-19T03:01:57.638 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00056629300000000005 2024-04-19T03:01:57.638 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.638 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.638 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:01:57.639 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.013217+0000", 2024-04-19T03:01:57.639 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001744317 2024-04-19T03:01:57.639 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.639 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.639 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:57.639 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.022083+0000", 2024-04-19T03:01:57.639 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0088663849999999992 2024-04-19T03:01:57.639 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.639 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.639 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:01:57.639 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.022124+0000", 2024-04-19T03:01:57.639 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.057e-05 2024-04-19T03:01:57.639 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.639 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.639 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:01:57.640 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.022216+0000", 2024-04-19T03:01:57.640 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.2417000000000006e-05 2024-04-19T03:01:57.640 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:57.640 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:01:57.640 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:57.640 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.640 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.640 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:13 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:01:57.640 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:14.999564+0000", 2024-04-19T03:01:57.640 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 42.626408759999997, 2024-04-19T03:01:57.640 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.019594777000000001, 2024-04-19T03:01:57.640 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:01:57.640 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:57.640 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:01:57.640 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.641 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:01:57.641 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999564+0000", 2024-04-19T03:01:57.641 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:57.641 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.641 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.641 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:01:57.641 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999564+0000", 2024-04-19T03:01:57.641 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:57.641 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.641 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.641 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:01:57.641 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999563+0000", 2024-04-19T03:01:57.641 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:01:57.642 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.642 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.642 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:01:57.642 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999582+0000", 2024-04-19T03:01:57.642 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8151999999999998e-05 2024-04-19T03:01:57.642 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.642 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.642 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:01:57.642 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999599+0000", 2024-04-19T03:01:57.642 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7583000000000001e-05 2024-04-19T03:01:57.642 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.642 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.642 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:01:57.642 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999618+0000", 2024-04-19T03:01:57.642 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8989999999999999e-05 2024-04-19T03:01:57.643 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.643 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.643 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:57.643 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999692+0000", 2024-04-19T03:01:57.643 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3561999999999998e-05 2024-04-19T03:01:57.643 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.643 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.643 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op must wait for map", 2024-04-19T03:01:57.643 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999698+0000", 2024-04-19T03:01:57.643 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7159999999999997e-06 2024-04-19T03:01:57.643 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.643 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.643 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:57.643 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.007836+0000", 2024-04-19T03:01:57.643 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0081376520000000004 2024-04-19T03:01:57.644 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.644 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.644 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:01:57.644 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.008208+0000", 2024-04-19T03:01:57.644 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00037223699999999998 2024-04-19T03:01:57.644 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.644 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.644 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-04-19T03:01:57.644 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.008516+0000", 2024-04-19T03:01:57.644 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000308227 2024-04-19T03:01:57.644 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.644 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.644 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:01:57.644 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.011585+0000", 2024-04-19T03:01:57.645 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0030680659999999999 2024-04-19T03:01:57.645 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.645 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.645 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:57.645 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.018871+0000", 2024-04-19T03:01:57.645 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0072861369999999998 2024-04-19T03:01:57.645 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.645 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.645 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:01:57.645 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.019067+0000", 2024-04-19T03:01:57.645 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00019672099999999999 2024-04-19T03:01:57.645 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.645 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.646 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:01:57.646 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.019159+0000", 2024-04-19T03:01:57.646 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1829999999999993e-05 2024-04-19T03:01:57.646 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:57.646 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:01:57.646 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:57.646 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.646 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.646 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:31 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:01:57.646 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:14.999649+0000", 2024-04-19T03:01:57.646 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 42.626324642, 2024-04-19T03:01:57.646 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.018882121000000002, 2024-04-19T03:01:57.646 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:01:57.646 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:57.647 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:01:57.647 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.647 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:01:57.647 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999649+0000", 2024-04-19T03:01:57.647 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:57.647 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.647 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.647 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:01:57.647 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999649+0000", 2024-04-19T03:01:57.647 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:57.647 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.648 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.648 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:01:57.648 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999647+0000", 2024-04-19T03:01:57.648 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:01:57.648 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.648 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.648 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:01:57.648 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999657+0000", 2024-04-19T03:01:57.648 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.3729999999999999e-06 2024-04-19T03:01:57.648 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.648 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.648 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:01:57.648 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999675+0000", 2024-04-19T03:01:57.648 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8522999999999999e-05 2024-04-19T03:01:57.649 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.649 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.649 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:01:57.649 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999689+0000", 2024-04-19T03:01:57.649 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.347e-05 2024-04-19T03:01:57.649 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.649 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.649 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:57.649 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999761+0000", 2024-04-19T03:01:57.649 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.1904999999999997e-05 2024-04-19T03:01:57.649 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.649 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.649 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:01:57.649 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999766+0000", 2024-04-19T03:01:57.649 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6069999999999998e-06 2024-04-19T03:01:57.650 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.650 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.650 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:57.650 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.010040+0000", 2024-04-19T03:01:57.650 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.010273381 2024-04-19T03:01:57.650 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.650 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.650 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:01:57.650 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.010260+0000", 2024-04-19T03:01:57.650 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00022003300000000001 2024-04-19T03:01:57.650 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.650 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.650 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-04-19T03:01:57.651 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.010415+0000", 2024-04-19T03:01:57.651 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015515599999999999 2024-04-19T03:01:57.651 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.651 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.651 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:01:57.651 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.013206+0000", 2024-04-19T03:01:57.651 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0027915010000000001 2024-04-19T03:01:57.651 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.651 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.651 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:57.651 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.018438+0000", 2024-04-19T03:01:57.651 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0052313469999999999 2024-04-19T03:01:57.651 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.651 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.651 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:01:57.652 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.018491+0000", 2024-04-19T03:01:57.652 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3554000000000003e-05 2024-04-19T03:01:57.652 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.652 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.652 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:01:57.652 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.018531+0000", 2024-04-19T03:01:57.652 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9384000000000001e-05 2024-04-19T03:01:57.652 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:57.652 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:01:57.652 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:57.652 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.652 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.652 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:32 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:01:57.652 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:14.999712+0000", 2024-04-19T03:01:57.652 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 42.626261399000001, 2024-04-19T03:01:57.652 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.022635437000000001, 2024-04-19T03:01:57.653 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:01:57.653 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:57.653 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:01:57.653 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.653 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:01:57.653 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999712+0000", 2024-04-19T03:01:57.653 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:57.653 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.653 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.654 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:01:57.654 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999712+0000", 2024-04-19T03:01:57.654 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:57.654 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.654 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.654 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:01:57.654 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999711+0000", 2024-04-19T03:01:57.654 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:01:57.654 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.654 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.654 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:01:57.654 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999719+0000", 2024-04-19T03:01:57.654 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.354e-06 2024-04-19T03:01:57.655 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.655 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.655 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:01:57.655 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999735+0000", 2024-04-19T03:01:57.655 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6288999999999999e-05 2024-04-19T03:01:57.655 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.655 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.655 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:01:57.655 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999749+0000", 2024-04-19T03:01:57.655 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3492999999999999e-05 2024-04-19T03:01:57.655 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.655 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.655 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:57.655 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999811+0000", 2024-04-19T03:01:57.656 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2298999999999994e-05 2024-04-19T03:01:57.656 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.656 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.656 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:01:57.656 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999817+0000", 2024-04-19T03:01:57.656 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2169999999999999e-06 2024-04-19T03:01:57.656 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.656 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.656 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:57.656 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.011836+0000", 2024-04-19T03:01:57.656 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.012018008 2024-04-19T03:01:57.656 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.656 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.656 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:01:57.657 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.011897+0000", 2024-04-19T03:01:57.657 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1111000000000005e-05 2024-04-19T03:01:57.657 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.657 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.657 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-04-19T03:01:57.657 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.011980+0000", 2024-04-19T03:01:57.657 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3003999999999993e-05 2024-04-19T03:01:57.657 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.657 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.657 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:01:57.658 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.013863+0000", 2024-04-19T03:01:57.658 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001883804 2024-04-19T03:01:57.658 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.658 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.658 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:57.658 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.022257+0000", 2024-04-19T03:01:57.658 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0083938290000000002 2024-04-19T03:01:57.658 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.658 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.658 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:01:57.658 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.022310+0000", 2024-04-19T03:01:57.658 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.236e-05 2024-04-19T03:01:57.658 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.659 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.659 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:01:57.659 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.022347+0000", 2024-04-19T03:01:57.659 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7653e-05 2024-04-19T03:01:57.659 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:57.659 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:01:57.659 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:57.659 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.659 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.659 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:35 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:01:57.659 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:14.999772+0000", 2024-04-19T03:01:57.659 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 42.626201119999998, 2024-04-19T03:01:57.659 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020205530999999999, 2024-04-19T03:01:57.659 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:01:57.660 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:57.660 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:01:57.660 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.660 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:01:57.660 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999772+0000", 2024-04-19T03:01:57.660 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:57.660 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.660 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.660 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:01:57.660 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999772+0000", 2024-04-19T03:01:57.660 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:57.660 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.660 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.660 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:01:57.660 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999771+0000", 2024-04-19T03:01:57.661 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:01:57.661 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.661 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.661 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:01:57.661 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999778+0000", 2024-04-19T03:01:57.661 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2200000000000003e-06 2024-04-19T03:01:57.661 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.661 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.661 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:01:57.661 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999794+0000", 2024-04-19T03:01:57.661 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5798999999999999e-05 2024-04-19T03:01:57.662 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.662 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.662 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:01:57.662 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999809+0000", 2024-04-19T03:01:57.662 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.469e-05 2024-04-19T03:01:57.662 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.662 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.662 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:57.662 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999915+0000", 2024-04-19T03:01:57.662 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000105658 2024-04-19T03:01:57.662 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.662 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.662 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:01:57.662 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999927+0000", 2024-04-19T03:01:57.663 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.201e-05 2024-04-19T03:01:57.663 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.663 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.663 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:57.663 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.009841+0000", 2024-04-19T03:01:57.663 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0099147039999999999 2024-04-19T03:01:57.663 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.663 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.663 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:01:57.663 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.009941+0000", 2024-04-19T03:01:57.663 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.9461000000000002e-05 2024-04-19T03:01:57.663 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.663 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.663 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-04-19T03:01:57.664 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.010101+0000", 2024-04-19T03:01:57.664 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016028599999999999 2024-04-19T03:01:57.664 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.664 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.664 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:01:57.664 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.011787+0000", 2024-04-19T03:01:57.664 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001685513 2024-04-19T03:01:57.664 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.664 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.664 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:57.664 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.019889+0000", 2024-04-19T03:01:57.664 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0081026559999999997 2024-04-19T03:01:57.664 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.664 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.665 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:01:57.665 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.019932+0000", 2024-04-19T03:01:57.665 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2385000000000002e-05 2024-04-19T03:01:57.665 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.665 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.665 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:01:57.665 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.019978+0000", 2024-04-19T03:01:57.665 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6093000000000001e-05 2024-04-19T03:01:57.665 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:57.665 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:01:57.665 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:57.665 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.665 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.665 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:18 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:01:57.665 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:14.999834+0000", 2024-04-19T03:01:57.666 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 42.626139035000001, 2024-04-19T03:01:57.666 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.019567312999999999, 2024-04-19T03:01:57.666 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:01:57.666 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:57.666 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:01:57.666 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.666 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:01:57.666 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999834+0000", 2024-04-19T03:01:57.666 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:57.666 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.666 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.666 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:01:57.666 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999834+0000", 2024-04-19T03:01:57.667 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:57.667 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.667 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.667 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:01:57.667 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999833+0000", 2024-04-19T03:01:57.667 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:01:57.667 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.667 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.667 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:01:57.667 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999842+0000", 2024-04-19T03:01:57.667 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.2269999999999999e-06 2024-04-19T03:01:57.667 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.667 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.667 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:01:57.667 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999860+0000", 2024-04-19T03:01:57.667 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8456000000000001e-05 2024-04-19T03:01:57.668 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.668 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.668 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:01:57.668 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999874+0000", 2024-04-19T03:01:57.668 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3263e-05 2024-04-19T03:01:57.668 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.668 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.668 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:57.668 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999934+0000", 2024-04-19T03:01:57.668 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0888999999999999e-05 2024-04-19T03:01:57.668 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.668 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.668 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:01:57.669 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999940+0000", 2024-04-19T03:01:57.669 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4330000000000003e-06 2024-04-19T03:01:57.669 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.669 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.669 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:57.669 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.010943+0000", 2024-04-19T03:01:57.669 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011002786000000001 2024-04-19T03:01:57.669 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.669 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.669 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:01:57.669 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.011078+0000", 2024-04-19T03:01:57.669 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013541000000000001 2024-04-19T03:01:57.669 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.670 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.670 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-04-19T03:01:57.670 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.011172+0000", 2024-04-19T03:01:57.670 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.3459000000000001e-05 2024-04-19T03:01:57.670 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.670 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.670 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:01:57.670 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.013211+0000", 2024-04-19T03:01:57.670 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0020397710000000001 2024-04-19T03:01:57.670 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.670 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.670 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:57.670 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.019320+0000", 2024-04-19T03:01:57.671 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0061089969999999997 2024-04-19T03:01:57.671 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.671 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.671 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:01:57.671 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.019364+0000", 2024-04-19T03:01:57.671 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4158e-05 2024-04-19T03:01:57.671 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.671 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.671 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:01:57.671 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.019402+0000", 2024-04-19T03:01:57.671 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7011000000000002e-05 2024-04-19T03:01:57.671 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:57.671 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:01:57.672 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:57.672 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.672 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.672 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:21 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:01:57.672 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:14.999896+0000", 2024-04-19T03:01:57.672 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 42.626077215999999, 2024-04-19T03:01:57.672 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.018618866000000001, 2024-04-19T03:01:57.672 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:01:57.672 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-19T03:01:57.672 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:01:57.672 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.672 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:01:57.672 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999896+0000", 2024-04-19T03:01:57.672 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:57.673 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.673 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.673 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:01:57.673 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999896+0000", 2024-04-19T03:01:57.673 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:57.673 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.673 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.673 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:01:57.673 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999895+0000", 2024-04-19T03:01:57.673 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:01:57.673 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.673 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.673 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:01:57.674 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999901+0000", 2024-04-19T03:01:57.674 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4529999999999999e-06 2024-04-19T03:01:57.674 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.674 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.674 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:01:57.674 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999918+0000", 2024-04-19T03:01:57.674 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6897000000000001e-05 2024-04-19T03:01:57.674 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.674 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.674 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:01:57.674 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999931+0000", 2024-04-19T03:01:57.674 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.309e-05 2024-04-19T03:01:57.674 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.674 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.675 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:57.675 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.000027+0000", 2024-04-19T03:01:57.675 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.5880999999999999e-05 2024-04-19T03:01:57.675 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.675 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.675 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op must wait for map", 2024-04-19T03:01:57.675 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.000040+0000", 2024-04-19T03:01:57.675 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3083e-05 2024-04-19T03:01:57.675 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.675 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.675 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:57.675 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.004961+0000", 2024-04-19T03:01:57.675 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0049206079999999999 2024-04-19T03:01:57.676 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.676 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.676 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:01:57.676 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.005261+0000", 2024-04-19T03:01:57.676 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00030041699999999998 2024-04-19T03:01:57.676 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.676 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.676 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:01:57.676 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.018515+0000", 2024-04-19T03:01:57.676 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013253534000000001 2024-04-19T03:01:57.676 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:57.676 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:01:57.676 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:57.676 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.676 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.677 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:24 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:01:57.677 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:14.999964+0000", 2024-04-19T03:01:57.677 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 42.626009721000003, 2024-04-19T03:01:57.677 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020451446000000002, 2024-04-19T03:01:57.677 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:01:57.677 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-19T03:01:57.677 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:01:57.677 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.677 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:01:57.677 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999964+0000", 2024-04-19T03:01:57.677 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:57.677 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.677 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.677 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:01:57.678 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999964+0000", 2024-04-19T03:01:57.678 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:57.678 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.678 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.678 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:01:57.678 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999963+0000", 2024-04-19T03:01:57.678 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:01:57.678 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.678 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.678 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:01:57.678 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999969+0000", 2024-04-19T03:01:57.678 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0270000000000001e-06 2024-04-19T03:01:57.678 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.679 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.679 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:01:57.679 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999984+0000", 2024-04-19T03:01:57.679 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5903e-05 2024-04-19T03:01:57.679 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.679 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.679 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:01:57.679 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999998+0000", 2024-04-19T03:01:57.679 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3076e-05 2024-04-19T03:01:57.679 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.679 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.679 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:57.679 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.000078+0000", 2024-04-19T03:01:57.679 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0525000000000006e-05 2024-04-19T03:01:57.680 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.680 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.680 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op must wait for map", 2024-04-19T03:01:57.680 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.000084+0000", 2024-04-19T03:01:57.680 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8370000000000002e-06 2024-04-19T03:01:57.680 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.680 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.680 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:57.680 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.008819+0000", 2024-04-19T03:01:57.680 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0087349019999999993 2024-04-19T03:01:57.680 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.680 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.680 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:01:57.680 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.009018+0000", 2024-04-19T03:01:57.680 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000198989 2024-04-19T03:01:57.681 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.681 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.681 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:01:57.681 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.020415+0000", 2024-04-19T03:01:57.681 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011397157 2024-04-19T03:01:57.681 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:57.681 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:01:57.681 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:57.681 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.681 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.681 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:11274 5.e 5:7c846032:::benchmark_data_smithi096_19531_object11273:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T03:01:57.681 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:42.061776+0000", 2024-04-19T03:01:57.681 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 15.564197476, 2024-04-19T03:01:57.681 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.035381001000000002, 2024-04-19T03:01:57.681 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:01:57.682 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:57.682 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:01:57.682 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:01:57.682 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:57.682 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 11274 2024-04-19T03:01:57.682 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.682 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:01:57.682 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.682 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:01:57.682 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.061776+0000", 2024-04-19T03:01:57.682 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:57.682 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.682 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.683 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:01:57.683 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.061776+0000", 2024-04-19T03:01:57.683 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:57.683 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.683 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.683 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:01:57.683 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.061775+0000", 2024-04-19T03:01:57.683 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:01:57.683 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.683 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.683 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:01:57.683 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.061807+0000", 2024-04-19T03:01:57.683 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1733000000000003e-05 2024-04-19T03:01:57.683 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.683 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.684 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:01:57.684 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.061822+0000", 2024-04-19T03:01:57.684 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5452999999999999e-05 2024-04-19T03:01:57.684 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.684 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.684 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:01:57.684 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.061827+0000", 2024-04-19T03:01:57.684 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9810000000000003e-06 2024-04-19T03:01:57.684 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.684 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.684 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:57.684 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.063388+0000", 2024-04-19T03:01:57.684 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0015605720000000001 2024-04-19T03:01:57.684 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.685 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.685 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:01:57.685 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.063612+0000", 2024-04-19T03:01:57.685 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00022431 2024-04-19T03:01:57.685 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.685 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.685 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:01:57.685 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.063747+0000", 2024-04-19T03:01:57.685 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013459600000000001 2024-04-19T03:01:57.685 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.685 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.685 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:01:57.685 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.066186+0000", 2024-04-19T03:01:57.685 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0024388909999999999 2024-04-19T03:01:57.685 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.685 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.686 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:57.686 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.097016+0000", 2024-04-19T03:01:57.686 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.030830705 2024-04-19T03:01:57.686 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.686 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.686 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:01:57.686 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.097096+0000", 2024-04-19T03:01:57.686 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.9469999999999996e-05 2024-04-19T03:01:57.686 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.686 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.686 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:01:57.686 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.097157+0000", 2024-04-19T03:01:57.686 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0884999999999997e-05 2024-04-19T03:01:57.686 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:57.687 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:01:57.687 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:57.687 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.687 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.687 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:11279 5.8 5:10b60c58:::benchmark_data_smithi096_19531_object11278:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T03:01:57.687 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:42.062594+0000", 2024-04-19T03:01:57.687 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 15.563379038000001, 2024-04-19T03:01:57.687 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.028696788000000001, 2024-04-19T03:01:57.687 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:01:57.687 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:57.687 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:01:57.687 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:01:57.687 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:57.687 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 11279 2024-04-19T03:01:57.687 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.688 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:01:57.688 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.688 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:01:57.688 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.062594+0000", 2024-04-19T03:01:57.688 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:57.688 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.688 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.688 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:01:57.688 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.062594+0000", 2024-04-19T03:01:57.688 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:57.688 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.688 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.688 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:01:57.688 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.062593+0000", 2024-04-19T03:01:57.688 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:01:57.688 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.689 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.689 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:01:57.689 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.062646+0000", 2024-04-19T03:01:57.689 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2293999999999998e-05 2024-04-19T03:01:57.689 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.689 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.689 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:01:57.689 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.062657+0000", 2024-04-19T03:01:57.689 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1440000000000001e-05 2024-04-19T03:01:57.689 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.689 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.689 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:01:57.689 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.062665+0000", 2024-04-19T03:01:57.689 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5159999999999997e-06 2024-04-19T03:01:57.689 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.690 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.690 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:57.690 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.063799+0000", 2024-04-19T03:01:57.690 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0011344860000000001 2024-04-19T03:01:57.690 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.690 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.690 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:01:57.690 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.063962+0000", 2024-04-19T03:01:57.690 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000162614 2024-04-19T03:01:57.690 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.690 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.690 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:01:57.690 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.064167+0000", 2024-04-19T03:01:57.690 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00020491699999999999 2024-04-19T03:01:57.690 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.691 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.691 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:01:57.691 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.066768+0000", 2024-04-19T03:01:57.691 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0026012090000000002 2024-04-19T03:01:57.691 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.691 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.691 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:57.691 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.091184+0000", 2024-04-19T03:01:57.691 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.024416582999999999 2024-04-19T03:01:57.691 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.691 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.691 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:01:57.691 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.091251+0000", 2024-04-19T03:01:57.691 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6753000000000003e-05 2024-04-19T03:01:57.691 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.691 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.692 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:01:57.692 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.091291+0000", 2024-04-19T03:01:57.692 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9841e-05 2024-04-19T03:01:57.692 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:57.692 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:01:57.692 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:57.692 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.692 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.692 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:11282 5.e 5:75b7c510:::benchmark_data_smithi096_19531_object11281:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T03:01:57.692 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:42.062674+0000", 2024-04-19T03:01:57.692 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 15.563299581999999, 2024-04-19T03:01:57.692 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.034812849, 2024-04-19T03:01:57.692 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:01:57.692 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:57.692 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:01:57.693 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:01:57.693 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:57.693 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 11282 2024-04-19T03:01:57.693 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.693 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:01:57.693 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.693 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:01:57.693 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.062674+0000", 2024-04-19T03:01:57.693 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:57.693 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.693 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.693 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:01:57.693 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.062674+0000", 2024-04-19T03:01:57.693 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:57.693 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.693 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.694 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:01:57.694 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.062673+0000", 2024-04-19T03:01:57.694 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:01:57.694 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.694 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.694 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:01:57.694 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.062712+0000", 2024-04-19T03:01:57.694 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9341999999999997e-05 2024-04-19T03:01:57.694 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.694 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.694 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:01:57.694 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.062721+0000", 2024-04-19T03:01:57.694 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1700000000000003e-06 2024-04-19T03:01:57.695 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.695 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.695 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:01:57.695 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.062729+0000", 2024-04-19T03:01:57.695 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4240000000000004e-06 2024-04-19T03:01:57.695 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.695 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.695 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:57.695 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.065017+0000", 2024-04-19T03:01:57.695 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0022878590000000002 2024-04-19T03:01:57.695 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.695 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.695 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:01:57.695 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.065207+0000", 2024-04-19T03:01:57.696 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000190411 2024-04-19T03:01:57.696 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.696 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.696 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:01:57.696 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.065323+0000", 2024-04-19T03:01:57.696 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000115593 2024-04-19T03:01:57.696 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.696 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.696 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:01:57.696 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.069683+0000", 2024-04-19T03:01:57.696 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0043604409999999996 2024-04-19T03:01:57.696 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.696 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.696 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:57.697 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.097273+0000", 2024-04-19T03:01:57.697 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.027589516000000001 2024-04-19T03:01:57.697 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.697 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.697 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:01:57.697 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.097406+0000", 2024-04-19T03:01:57.697 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000133514 2024-04-19T03:01:57.697 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.697 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.697 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:01:57.697 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.097486+0000", 2024-04-19T03:01:57.697 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0479e-05 2024-04-19T03:01:57.697 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:57.697 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:01:57.698 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:57.698 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.698 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.698 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:11288 5.0 5:042458d0:::benchmark_data_smithi096_19531_object11287:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T03:01:57.698 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:42.070352+0000", 2024-04-19T03:01:57.698 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 15.555621653999999, 2024-04-19T03:01:57.698 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.021532447, 2024-04-19T03:01:57.698 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:01:57.698 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:57.698 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:01:57.698 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:01:57.698 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:57.698 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 11288 2024-04-19T03:01:57.698 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.699 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:01:57.699 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.699 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:01:57.699 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.070352+0000", 2024-04-19T03:01:57.699 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:57.699 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.699 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.699 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:01:57.699 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.070352+0000", 2024-04-19T03:01:57.699 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:57.699 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.699 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.699 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:01:57.699 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.070351+0000", 2024-04-19T03:01:57.699 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:01:57.700 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.700 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.700 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:01:57.700 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.070392+0000", 2024-04-19T03:01:57.700 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1077e-05 2024-04-19T03:01:57.700 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.700 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.700 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:01:57.700 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.070398+0000", 2024-04-19T03:01:57.700 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1109999999999996e-06 2024-04-19T03:01:57.700 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.700 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.701 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:01:57.701 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.070402+0000", 2024-04-19T03:01:57.701 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2010000000000001e-06 2024-04-19T03:01:57.701 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.701 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.701 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:57.701 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.070445+0000", 2024-04-19T03:01:57.701 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2585e-05 2024-04-19T03:01:57.701 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.701 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.701 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:01:57.701 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.070572+0000", 2024-04-19T03:01:57.701 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012708500000000001 2024-04-19T03:01:57.701 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.702 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.702 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:01:57.702 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.070711+0000", 2024-04-19T03:01:57.702 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013848699999999999 2024-04-19T03:01:57.702 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.702 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.702 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:01:57.702 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.073505+0000", 2024-04-19T03:01:57.702 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0027944620000000002 2024-04-19T03:01:57.702 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.702 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.702 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:57.702 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.091806+0000", 2024-04-19T03:01:57.703 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.018301251000000001 2024-04-19T03:01:57.703 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.703 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.703 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:01:57.703 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.091854+0000", 2024-04-19T03:01:57.703 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7419000000000001e-05 2024-04-19T03:01:57.703 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.703 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.703 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:01:57.703 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.091884+0000", 2024-04-19T03:01:57.703 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0241999999999999e-05 2024-04-19T03:01:57.703 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:57.703 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:01:57.703 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:57.704 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.704 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.704 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:11292 5.0 5:009b2ea9:::benchmark_data_smithi096_19531_object11291:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T03:01:57.704 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:42.070676+0000", 2024-04-19T03:01:57.704 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 15.555297278999999, 2024-04-19T03:01:57.704 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.02219631, 2024-04-19T03:01:57.704 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:01:57.704 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:57.704 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:01:57.704 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:01:57.704 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:57.704 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 11292 2024-04-19T03:01:57.704 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.704 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:01:57.704 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.705 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:01:57.705 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.070676+0000", 2024-04-19T03:01:57.705 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:57.705 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.705 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.705 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:01:57.705 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.070676+0000", 2024-04-19T03:01:57.705 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:57.705 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.705 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.705 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:01:57.705 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.070675+0000", 2024-04-19T03:01:57.705 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:01:57.705 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.706 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.706 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:01:57.706 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.070800+0000", 2024-04-19T03:01:57.706 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000125263 2024-04-19T03:01:57.706 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.706 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.706 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:01:57.706 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.070808+0000", 2024-04-19T03:01:57.706 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0209999999999999e-06 2024-04-19T03:01:57.706 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.706 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.706 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:01:57.706 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.070814+0000", 2024-04-19T03:01:57.706 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0969999999999996e-06 2024-04-19T03:01:57.706 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.707 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.707 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:57.707 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.071956+0000", 2024-04-19T03:01:57.707 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0011427480000000001 2024-04-19T03:01:57.707 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.707 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.707 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:01:57.707 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.072153+0000", 2024-04-19T03:01:57.707 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000196524 2024-04-19T03:01:57.707 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.707 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.707 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:01:57.707 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.072312+0000", 2024-04-19T03:01:57.707 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015879300000000001 2024-04-19T03:01:57.708 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.708 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.708 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:01:57.708 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.078407+0000", 2024-04-19T03:01:57.708 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0060954929999999996 2024-04-19T03:01:57.708 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.708 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.708 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:57.708 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.092742+0000", 2024-04-19T03:01:57.708 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.014335349000000001 2024-04-19T03:01:57.708 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.708 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.708 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:01:57.708 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.092815+0000", 2024-04-19T03:01:57.708 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2881999999999998e-05 2024-04-19T03:01:57.709 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.709 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.709 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:01:57.709 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.092872+0000", 2024-04-19T03:01:57.709 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6965000000000001e-05 2024-04-19T03:01:57.709 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:57.709 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:01:57.709 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:57.709 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.709 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.709 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:11297 5.e 5:7975ecb6:::benchmark_data_smithi096_19531_object11296:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T03:01:57.709 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:42.076848+0000", 2024-04-19T03:01:57.709 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 15.549125398999999, 2024-04-19T03:01:57.709 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020867969, 2024-04-19T03:01:57.710 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:01:57.710 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:57.710 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:01:57.710 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:01:57.710 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:57.710 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 11297 2024-04-19T03:01:57.710 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.710 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:01:57.710 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.710 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:01:57.710 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.076848+0000", 2024-04-19T03:01:57.710 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:57.710 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.710 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.711 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:01:57.711 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.076848+0000", 2024-04-19T03:01:57.711 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:57.711 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.711 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.711 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:01:57.711 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.076846+0000", 2024-04-19T03:01:57.711 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:01:57.711 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.711 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.711 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:01:57.711 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.076894+0000", 2024-04-19T03:01:57.711 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7645000000000002e-05 2024-04-19T03:01:57.711 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.712 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.712 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:01:57.712 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.076913+0000", 2024-04-19T03:01:57.712 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8885e-05 2024-04-19T03:01:57.712 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.712 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.712 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:01:57.712 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.076924+0000", 2024-04-19T03:01:57.712 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.118e-05 2024-04-19T03:01:57.712 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.712 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.713 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:57.713 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.076983+0000", 2024-04-19T03:01:57.713 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8952000000000001e-05 2024-04-19T03:01:57.713 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.713 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.713 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:01:57.713 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.077156+0000", 2024-04-19T03:01:57.713 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00017307600000000001 2024-04-19T03:01:57.713 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.713 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.713 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:01:57.713 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.077358+0000", 2024-04-19T03:01:57.713 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000201991 2024-04-19T03:01:57.713 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.713 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.714 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:01:57.714 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.080885+0000", 2024-04-19T03:01:57.714 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0035268309999999998 2024-04-19T03:01:57.714 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.714 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.714 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:57.714 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.097569+0000", 2024-04-19T03:01:57.714 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.016683854000000001 2024-04-19T03:01:57.714 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.714 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.714 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:01:57.714 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.097647+0000", 2024-04-19T03:01:57.715 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.7823000000000004e-05 2024-04-19T03:01:57.715 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.715 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.715 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:01:57.715 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.097716+0000", 2024-04-19T03:01:57.715 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.9079999999999996e-05 2024-04-19T03:01:57.715 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:57.715 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:01:57.715 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:57.715 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.715 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.715 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:11298 5.e 5:72565f0a:::benchmark_data_smithi096_19531_object11297:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T03:01:57.716 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:42.076954+0000", 2024-04-19T03:01:57.716 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 15.549019525, 2024-04-19T03:01:57.716 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020950191999999999, 2024-04-19T03:01:57.716 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:01:57.716 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:57.716 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:01:57.716 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:01:57.716 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:57.716 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 11298 2024-04-19T03:01:57.716 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.716 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:01:57.716 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.716 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:01:57.716 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.076954+0000", 2024-04-19T03:01:57.717 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:57.717 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.717 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.717 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:01:57.717 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.076954+0000", 2024-04-19T03:01:57.717 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:57.717 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.717 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.717 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:01:57.717 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.076953+0000", 2024-04-19T03:01:57.717 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:01:57.717 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.717 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.717 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:01:57.718 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.076997+0000", 2024-04-19T03:01:57.718 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4023000000000002e-05 2024-04-19T03:01:57.718 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.718 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.718 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:01:57.718 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.077009+0000", 2024-04-19T03:01:57.718 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2456000000000001e-05 2024-04-19T03:01:57.718 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.718 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.718 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:01:57.718 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.077015+0000", 2024-04-19T03:01:57.718 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7950000000000004e-06 2024-04-19T03:01:57.718 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.719 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.719 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:57.719 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.078552+0000", 2024-04-19T03:01:57.719 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0015371320000000001 2024-04-19T03:01:57.719 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.719 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.719 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:01:57.719 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.078760+0000", 2024-04-19T03:01:57.719 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00020808799999999999 2024-04-19T03:01:57.719 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.719 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.719 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:01:57.719 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.078875+0000", 2024-04-19T03:01:57.719 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011457500000000001 2024-04-19T03:01:57.719 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.719 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.719 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:01:57.720 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.083603+0000", 2024-04-19T03:01:57.720 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0047276239999999997 2024-04-19T03:01:57.720 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.720 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.720 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:57.720 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.097783+0000", 2024-04-19T03:01:57.720 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.014180036 2024-04-19T03:01:57.720 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.720 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.720 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:01:57.720 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.097863+0000", 2024-04-19T03:01:57.720 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0317999999999999e-05 2024-04-19T03:01:57.720 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.720 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.720 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:01:57.720 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.097904+0000", 2024-04-19T03:01:57.721 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1035000000000003e-05 2024-04-19T03:01:57.721 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:57.721 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:01:57.721 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:57.721 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.721 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.721 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:41635 5.0 5:099f52c6:::benchmark_data_smithi096_19531_object41634:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-19T03:01:57.721 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:55.638486+0000", 2024-04-19T03:01:57.721 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 1.987487263, 2024-04-19T03:01:57.721 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.018229273000000001, 2024-04-19T03:01:57.721 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:01:57.721 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:57.721 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:01:57.721 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:01:57.721 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:57.721 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 41635 2024-04-19T03:01:57.722 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.722 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:01:57.722 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.722 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:01:57.722 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:55.638486+0000", 2024-04-19T03:01:57.722 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:57.722 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.722 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.722 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:01:57.722 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:55.638486+0000", 2024-04-19T03:01:57.722 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:57.722 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.722 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.723 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:01:57.723 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:55.638484+0000", 2024-04-19T03:01:57.723 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999981 2024-04-19T03:01:57.725 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.725 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.725 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:01:57.725 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:55.638563+0000", 2024-04-19T03:01:57.725 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.9453e-05 2024-04-19T03:01:57.725 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.725 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.725 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:01:57.725 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:55.638578+0000", 2024-04-19T03:01:57.726 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4917e-05 2024-04-19T03:01:57.726 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.726 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.726 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:01:57.726 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:55.638587+0000", 2024-04-19T03:01:57.726 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.7479999999999999e-06 2024-04-19T03:01:57.726 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.726 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.726 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:57.726 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:55.647558+0000", 2024-04-19T03:01:57.726 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0089711489999999994 2024-04-19T03:01:57.726 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.726 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.726 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:01:57.727 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:55.647666+0000", 2024-04-19T03:01:57.727 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000107606 2024-04-19T03:01:57.727 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.727 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.727 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:01:57.727 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:55.647745+0000", 2024-04-19T03:01:57.727 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.9229999999999999e-05 2024-04-19T03:01:57.727 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.727 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.727 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:57.727 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:55.652616+0000", 2024-04-19T03:01:57.727 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0048707739999999996 2024-04-19T03:01:57.727 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.727 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.727 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:01:57.728 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:55.656654+0000", 2024-04-19T03:01:57.728 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0040386140000000003 2024-04-19T03:01:57.728 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.728 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.728 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:01:57.728 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:55.656692+0000", 2024-04-19T03:01:57.728 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7317000000000002e-05 2024-04-19T03:01:57.728 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.728 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.728 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:01:57.728 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:55.656715+0000", 2024-04-19T03:01:57.728 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3533e-05 2024-04-19T03:01:57.728 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:57.728 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:01:57.729 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:57.729 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.729 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.729 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:41640 5.0 5:0989f358:::benchmark_data_smithi096_19531_object41639:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-19T03:01:57.729 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:55.640790+0000", 2024-04-19T03:01:57.729 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 1.985183081, 2024-04-19T03:01:57.729 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020000754999999999, 2024-04-19T03:01:57.729 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:01:57.729 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:57.729 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:01:57.729 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:01:57.729 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:57.729 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 41640 2024-04-19T03:01:57.729 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.730 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:01:57.730 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.730 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:01:57.730 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:55.640790+0000", 2024-04-19T03:01:57.730 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:57.730 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.730 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.730 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:01:57.730 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:55.640790+0000", 2024-04-19T03:01:57.730 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:57.730 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.730 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.730 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:01:57.731 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:55.640789+0000", 2024-04-19T03:01:57.731 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:01:57.731 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.731 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.731 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:01:57.731 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:55.640829+0000", 2024-04-19T03:01:57.731 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9870999999999998e-05 2024-04-19T03:01:57.731 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.731 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.731 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:01:57.731 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:55.640838+0000", 2024-04-19T03:01:57.731 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.8899999999999996e-06 2024-04-19T03:01:57.731 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.731 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.731 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:01:57.732 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:55.640843+0000", 2024-04-19T03:01:57.732 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1630000000000004e-06 2024-04-19T03:01:57.732 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.732 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.732 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:57.732 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:55.649279+0000", 2024-04-19T03:01:57.732 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0084358179999999994 2024-04-19T03:01:57.732 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.732 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.732 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:01:57.732 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:55.649388+0000", 2024-04-19T03:01:57.732 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010836399999999999 2024-04-19T03:01:57.732 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.732 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.733 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:01:57.733 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:55.649479+0000", 2024-04-19T03:01:57.733 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1284000000000002e-05 2024-04-19T03:01:57.733 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.733 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.733 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:01:57.733 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:55.656726+0000", 2024-04-19T03:01:57.733 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.007246962 2024-04-19T03:01:57.733 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.733 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.733 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:57.733 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:55.660689+0000", 2024-04-19T03:01:57.733 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0039628900000000002 2024-04-19T03:01:57.733 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.734 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.734 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:01:57.734 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:55.660755+0000", 2024-04-19T03:01:57.734 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6267999999999996e-05 2024-04-19T03:01:57.734 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.734 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.734 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:01:57.734 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:55.660791+0000", 2024-04-19T03:01:57.734 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5975e-05 2024-04-19T03:01:57.734 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:57.734 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:01:57.734 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:57.734 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.734 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.735 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:41743 5.d 5:b5695557:::benchmark_data_smithi096_19531_object41742:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-19T03:01:57.735 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:55.693206+0000", 2024-04-19T03:01:57.735 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 1.9327673440000002, 2024-04-19T03:01:57.735 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.017738706, 2024-04-19T03:01:57.735 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:01:57.735 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:57.735 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:01:57.735 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:01:57.735 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:57.735 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 41743 2024-04-19T03:01:57.735 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.735 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:01:57.735 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.735 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:01:57.736 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:55.693206+0000", 2024-04-19T03:01:57.736 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:57.736 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.736 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.736 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:01:57.736 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:55.693206+0000", 2024-04-19T03:01:57.736 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:57.736 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.736 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.736 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:01:57.736 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:55.693205+0000", 2024-04-19T03:01:57.736 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:01:57.736 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.737 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.737 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:01:57.737 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:55.693278+0000", 2024-04-19T03:01:57.737 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2693000000000003e-05 2024-04-19T03:01:57.737 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.737 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.737 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:01:57.737 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:55.693286+0000", 2024-04-19T03:01:57.737 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.9310000000000008e-06 2024-04-19T03:01:57.737 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.737 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.737 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:01:57.737 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:55.693292+0000", 2024-04-19T03:01:57.737 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9510000000000003e-06 2024-04-19T03:01:57.738 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.738 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.738 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:57.738 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:55.699127+0000", 2024-04-19T03:01:57.738 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0058351519999999997 2024-04-19T03:01:57.738 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.738 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.738 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:01:57.738 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:55.699226+0000", 2024-04-19T03:01:57.738 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.8636999999999998e-05 2024-04-19T03:01:57.738 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.738 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.738 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-04-19T03:01:57.739 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:55.699300+0000", 2024-04-19T03:01:57.739 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4172999999999996e-05 2024-04-19T03:01:57.739 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.739 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.739 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:01:57.739 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:55.700946+0000", 2024-04-19T03:01:57.739 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001646441 2024-04-19T03:01:57.739 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.739 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.739 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:57.739 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:55.710881+0000", 2024-04-19T03:01:57.739 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0099342839999999998 2024-04-19T03:01:57.739 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.739 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.739 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:01:57.740 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:55.710912+0000", 2024-04-19T03:01:57.740 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0925e-05 2024-04-19T03:01:57.740 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.740 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.740 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:01:57.740 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:55.710945+0000", 2024-04-19T03:01:57.740 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3058000000000001e-05 2024-04-19T03:01:57.740 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:57.740 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:01:57.740 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:57.740 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.740 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.740 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:43996 5.e 5:7a22e4b2:::benchmark_data_smithi096_19531_object43995:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-19T03:01:57.740 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:56.841389+0000", 2024-04-19T03:01:57.741 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.78458456799999998, 2024-04-19T03:01:57.741 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.018031398000000001, 2024-04-19T03:01:57.741 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:01:57.741 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:01:57.741 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:01:57.741 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:01:57.741 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:01:57.741 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 43996 2024-04-19T03:01:57.741 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.741 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:01:57.741 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.741 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:01:57.741 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:56.841389+0000", 2024-04-19T03:01:57.741 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:57.741 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.742 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.742 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:01:57.742 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:56.841389+0000", 2024-04-19T03:01:57.742 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:01:57.742 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.742 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.742 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:01:57.742 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:56.841387+0000", 2024-04-19T03:01:57.742 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:01:57.742 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.742 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.742 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:01:57.742 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:56.841472+0000", 2024-04-19T03:01:57.743 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.4284999999999997e-05 2024-04-19T03:01:57.743 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.743 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.743 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:01:57.743 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:56.841488+0000", 2024-04-19T03:01:57.743 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5829999999999999e-05 2024-04-19T03:01:57.743 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.743 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.743 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:01:57.743 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:56.841499+0000", 2024-04-19T03:01:57.743 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0985000000000001e-05 2024-04-19T03:01:57.743 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.743 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.743 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:01:57.744 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:56.846414+0000", 2024-04-19T03:01:57.744 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0049156219999999997 2024-04-19T03:01:57.744 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.744 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.744 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:01:57.744 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:56.846517+0000", 2024-04-19T03:01:57.744 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000103068 2024-04-19T03:01:57.744 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.744 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.744 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:01:57.744 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:56.846686+0000", 2024-04-19T03:01:57.744 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016901500000000001 2024-04-19T03:01:57.744 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.744 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.744 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:01:57.744 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:56.848994+0000", 2024-04-19T03:01:57.744 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0023076049999999999 2024-04-19T03:01:57.745 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.745 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.745 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:01:57.745 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:56.859298+0000", 2024-04-19T03:01:57.745 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.010303853999999999 2024-04-19T03:01:57.745 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.745 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.745 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:01:57.745 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:56.859366+0000", 2024-04-19T03:01:57.745 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.8724000000000001e-05 2024-04-19T03:01:57.745 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:01:57.745 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:01:57.745 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:01:57.745 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:56.859420+0000", 2024-04-19T03:01:57.745 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3644999999999999e-05 2024-04-19T03:01:57.745 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:57.746 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:01:57.746 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:57.746 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:01:57.746 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:01:57.746 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-19T03:01:57.748 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:01:57.745+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:01:57.748 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0: {} 2024-04-19T03:01:57.748 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1: {} 2024-04-19T03:01:57.748 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2: {} 2024-04-19T03:01:57.749 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T03:01:57.750 INFO:teuthology.orchestra.run.smithi096.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T03:01:57.750 INFO:teuthology.orchestra.run.smithi096.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-19T03:01:57.750 INFO:teuthology.orchestra.run.smithi096.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-19T03:01:57.821 INFO:tasks.radosbench.radosbench.0.smithi096.stdout:2024-04-19T03:01:57.822140+0000 min lat: 0.00184673 max lat: 0.0359477 avg lat: 0.00696838 2024-04-19T03:01:57.821 INFO:tasks.radosbench.radosbench.0.smithi096.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-04-19T03:01:57.821 INFO:tasks.radosbench.radosbench.0.smithi096.stdout: 20 16 45903 45887 143.381 121.438 0.00911927 0.00696838 2024-04-19T03:01:57.848 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:01:57.848+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:01:57.879 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-04-19T03:01:57.879 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:01:57.892 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T03:01:57.949 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:01:57.948+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:01:58.022 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-04-19T03:01:58.022 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:01:58.034 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T03:01:58.049 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:01:58.048+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:01:58.108 INFO:teuthology.orchestra.run.smithi096.stderr:set 3.1b pg_upmap mapping to [1,0] 2024-04-19T03:01:58.150 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-04-19T03:01:58.146+0000 7f35986ab700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18243) UID: 0 2024-04-19T03:01:58.157 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-04-19T03:01:58.157 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:01:58.168 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T03:01:58.252 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:01:58.249+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:01:58.296 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-04-19T03:01:58.296 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:01:58.311 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T03:01:58.352 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-04-19T03:01:58.350+0000 7f35986ab700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18243) UID: 0 2024-04-19T03:01:58.440 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-04-19T03:01:58.441 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:01:58.453 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-04-19T03:01:58.450+0000 7f35986ab700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18243) UID: 0 2024-04-19T03:01:58.454 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T03:01:58.556 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-04-19T03:01:58.550+0000 7f35986ab700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18243) UID: 0 2024-04-19T03:01:58.625 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-04-19T03:01:58.625 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:01:58.639 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T03:01:58.655 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-04-19T03:01:58.650+0000 7f35986ab700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18243) UID: 0 2024-04-19T03:01:58.756 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:01:58.756+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:01:58.764 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-19T03:01:58.765 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:01:58.778 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T03:01:58.821 INFO:tasks.radosbench.radosbench.0.smithi096.stdout: 21 16 47789 47773 142.166 117.875 0.00846074 0.0070277 2024-04-19T03:01:58.857 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-04-19T03:01:58.854+0000 7f35986ab700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18243) UID: 0 2024-04-19T03:01:58.898 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-19T03:01:58.898 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:01:58.910 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T03:01:58.958 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-04-19T03:01:58.954+0000 7f35986ab700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18243) UID: 0 2024-04-19T03:01:59.029 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-19T03:01:59.029 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:01:59.041 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T03:01:59.058 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-04-19T03:01:59.054+0000 7f35986ab700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18243) UID: 0 2024-04-19T03:01:59.147 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-19T03:01:59.160 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-04-19T03:01:59.158+0000 7f35986ab700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18243) UID: 0 2024-04-19T03:01:59.175 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-04-19T03:01:59.175 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:01:59.188 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T03:01:59.260 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-04-19T03:01:59.258+0000 7f35986ab700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18243) UID: 0 2024-04-19T03:01:59.312 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-04-19T03:01:59.313 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:01:59.325 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T03:01:59.361 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:01:59.360+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:01:59.449 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-04-19T03:01:59.449 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:01:59.462 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:01:59.457+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:01:59.464 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T03:01:59.563 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-04-19T03:01:59.558+0000 7f35986ab700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18243) UID: 0 2024-04-19T03:01:59.600 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-04-19T03:01:59.600 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:01:59.612 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T03:01:59.664 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-04-19T03:01:59.662+0000 7f35986ab700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18243) UID: 0 2024-04-19T03:01:59.749 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-04-19T03:01:59.749 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:01:59.751 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-19T03:01:59.762 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T03:01:59.769 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-04-19T03:01:59.762+0000 7f35986ab700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18243) UID: 0 2024-04-19T03:01:59.821 INFO:tasks.radosbench.radosbench.0.smithi096.stdout: 22 16 49643 49627 140.97 115.875 0.00643014 0.00708801 2024-04-19T03:01:59.867 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-04-19T03:01:59.862+0000 7f35986ab700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18243) UID: 0 2024-04-19T03:01:59.893 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-04-19T03:01:59.893 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:01:59.906 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T03:01:59.907 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0: {} 2024-04-19T03:01:59.927 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1: {} 2024-04-19T03:01:59.945 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2: {} 2024-04-19T03:01:59.948 INFO:teuthology.orchestra.run.smithi096.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T03:01:59.948 INFO:teuthology.orchestra.run.smithi096.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-19T03:01:59.948 INFO:teuthology.orchestra.run.smithi096.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-19T03:01:59.968 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:01:59.968+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:00.044 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-19T03:02:00.044 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-04-19T03:02:00.045 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.045 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:50028 5.e 5:7c89f5ea:::benchmark_data_smithi096_19531_object50027:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-19T03:02:00.045 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:00.036488+0000", 2024-04-19T03:02:00.045 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0059311099999999999, 2024-04-19T03:02:00.045 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0059554619999999999, 2024-04-19T03:02:00.045 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:00.045 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:02:00.045 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:00.045 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:00.045 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:00.045 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 50028 2024-04-19T03:02:00.045 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.045 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:00.046 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.046 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:00.046 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:00.036488+0000", 2024-04-19T03:02:00.046 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:00.046 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.046 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.046 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:00.046 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:00.036488+0000", 2024-04-19T03:02:00.046 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:00.046 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.046 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.046 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:00.046 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:00.036487+0000", 2024-04-19T03:02:00.047 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:00.047 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.047 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.047 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:00.047 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:00.036543+0000", 2024-04-19T03:02:00.047 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6110000000000003e-05 2024-04-19T03:02:00.047 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.047 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.047 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:00.047 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:00.036556+0000", 2024-04-19T03:02:00.047 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3067e-05 2024-04-19T03:02:00.047 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.047 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.047 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:00.048 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:00.036566+0000", 2024-04-19T03:02:00.048 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.4720000000000001e-06 2024-04-19T03:02:00.048 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.048 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.048 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:00.048 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:00.037254+0000", 2024-04-19T03:02:00.048 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00068858199999999997 2024-04-19T03:02:00.048 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.048 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.048 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:00.048 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:00.037374+0000", 2024-04-19T03:02:00.048 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012038499999999999 2024-04-19T03:02:00.048 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.048 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.049 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:00.049 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:00.037519+0000", 2024-04-19T03:02:00.049 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000144976 2024-04-19T03:02:00.049 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.049 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.049 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:00.049 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:00.041795+0000", 2024-04-19T03:02:00.049 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0042758300000000004 2024-04-19T03:02:00.049 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:00.049 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:00.049 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:00.049 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.050 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.050 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:50029 5.8 5:162ffc3c:::benchmark_data_smithi096_19531_object50028:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-19T03:02:00.050 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:00.036573+0000", 2024-04-19T03:02:00.050 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0058463229999999996, 2024-04-19T03:02:00.050 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.005935971, 2024-04-19T03:02:00.050 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:00.050 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:02:00.050 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:00.050 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:00.050 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:00.050 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 50029 2024-04-19T03:02:00.050 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.051 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:00.051 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.051 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:00.051 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:00.036573+0000", 2024-04-19T03:02:00.051 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:00.051 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.051 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.051 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:00.051 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:00.036573+0000", 2024-04-19T03:02:00.051 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:00.051 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.051 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.051 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:00.051 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:00.036572+0000", 2024-04-19T03:02:00.052 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:00.052 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.052 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.052 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:00.052 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:00.036605+0000", 2024-04-19T03:02:00.052 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2842000000000002e-05 2024-04-19T03:02:00.052 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.052 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.052 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:00.052 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:00.036615+0000", 2024-04-19T03:02:00.052 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0059e-05 2024-04-19T03:02:00.052 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.052 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.052 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:00.053 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:00.036623+0000", 2024-04-19T03:02:00.053 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.9109999999999993e-06 2024-04-19T03:02:00.053 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.053 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.053 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:00.053 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:00.036682+0000", 2024-04-19T03:02:00.053 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9355999999999999e-05 2024-04-19T03:02:00.053 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.053 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.053 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:00.053 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:00.036890+0000", 2024-04-19T03:02:00.053 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00020777400000000001 2024-04-19T03:02:00.053 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.053 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.054 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:00.054 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:00.037044+0000", 2024-04-19T03:02:00.054 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000154258 2024-04-19T03:02:00.054 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:00.054 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:00.054 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:00.054 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.054 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.054 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:50032 5.8 5:1d4f0330:::benchmark_data_smithi096_19531_object50031:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-19T03:02:00.054 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:00.036792+0000", 2024-04-19T03:02:00.054 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0056264610000000001, 2024-04-19T03:02:00.054 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0057703320000000004, 2024-04-19T03:02:00.054 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:00.055 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:02:00.055 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:00.055 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:00.055 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:00.055 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 50032 2024-04-19T03:02:00.055 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.055 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:00.055 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.055 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:00.055 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:00.036792+0000", 2024-04-19T03:02:00.055 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:00.055 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.055 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.055 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:00.056 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:00.036792+0000", 2024-04-19T03:02:00.056 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:00.056 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.056 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.056 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:00.056 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:00.036791+0000", 2024-04-19T03:02:00.056 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:00.056 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.056 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.056 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:00.056 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:00.036899+0000", 2024-04-19T03:02:00.056 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000107747 2024-04-19T03:02:00.056 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.056 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.057 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:00.057 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:00.036907+0000", 2024-04-19T03:02:00.057 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.763e-06 2024-04-19T03:02:00.057 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.057 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.057 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:00.057 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:00.036913+0000", 2024-04-19T03:02:00.057 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.392e-06 2024-04-19T03:02:00.057 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.057 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.057 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:00.057 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:00.039295+0000", 2024-04-19T03:02:00.057 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0023815049999999999 2024-04-19T03:02:00.057 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.058 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.058 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:00.058 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:00.039389+0000", 2024-04-19T03:02:00.058 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.4262e-05 2024-04-19T03:02:00.058 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.058 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.058 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:00.058 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:00.039490+0000", 2024-04-19T03:02:00.058 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000100961 2024-04-19T03:02:00.058 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:00.058 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:00.058 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:00.058 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.059 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.059 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:50035 5.e 5:77820f1c:::benchmark_data_smithi096_19531_object50034:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-19T03:02:00.059 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:00.037625+0000", 2024-04-19T03:02:00.059 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0047940270000000002, 2024-04-19T03:02:00.059 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0049760569999999999, 2024-04-19T03:02:00.059 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:00.059 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:02:00.059 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:00.059 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:00.059 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:00.059 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 50035 2024-04-19T03:02:00.059 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.059 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:00.059 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.060 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:00.060 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:00.037625+0000", 2024-04-19T03:02:00.060 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:00.060 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.060 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.060 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:00.060 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:00.037625+0000", 2024-04-19T03:02:00.060 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:00.060 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.060 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.060 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:00.060 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:00.037624+0000", 2024-04-19T03:02:00.060 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:00.061 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.061 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.061 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:00.061 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:00.037692+0000", 2024-04-19T03:02:00.061 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.8376999999999999e-05 2024-04-19T03:02:00.061 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.061 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.061 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:00.061 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:00.037703+0000", 2024-04-19T03:02:00.061 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0973e-05 2024-04-19T03:02:00.061 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.061 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.061 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:00.061 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:00.037711+0000", 2024-04-19T03:02:00.061 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0919999999999998e-06 2024-04-19T03:02:00.062 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.062 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.062 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:00.062 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:00.039449+0000", 2024-04-19T03:02:00.062 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001737398 2024-04-19T03:02:00.062 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.062 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.062 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:00.062 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:00.039568+0000", 2024-04-19T03:02:00.062 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000119913 2024-04-19T03:02:00.062 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.062 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.062 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:00.063 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:00.039705+0000", 2024-04-19T03:02:00.063 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013705799999999999 2024-04-19T03:02:00.063 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.063 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.063 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:00.063 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:00.042183+0000", 2024-04-19T03:02:00.063 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0024778040000000001 2024-04-19T03:02:00.063 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:00.063 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:00.063 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:00.063 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.063 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.063 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:50036 5.8 5:1442151f:::benchmark_data_smithi096_19531_object50035:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-19T03:02:00.063 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:00.039756+0000", 2024-04-19T03:02:00.064 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0026630709999999999, 2024-04-19T03:02:00.064 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0028847780000000002, 2024-04-19T03:02:00.064 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:00.064 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:02:00.064 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:00.064 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:00.064 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:00.064 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 50036 2024-04-19T03:02:00.064 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.064 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:00.064 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.064 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:00.064 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:00.039756+0000", 2024-04-19T03:02:00.064 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:00.065 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.065 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.065 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:00.065 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:00.039756+0000", 2024-04-19T03:02:00.065 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:00.065 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.065 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.065 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:00.065 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:00.039755+0000", 2024-04-19T03:02:00.065 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:00.065 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.065 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.065 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:00.065 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:00.039863+0000", 2024-04-19T03:02:00.066 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000108528 2024-04-19T03:02:00.066 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.066 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.066 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:00.066 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:00.039876+0000", 2024-04-19T03:02:00.066 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2889e-05 2024-04-19T03:02:00.066 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.066 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.066 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:00.066 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:00.039885+0000", 2024-04-19T03:02:00.066 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.276e-06 2024-04-19T03:02:00.066 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.066 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.067 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:00.067 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:00.041818+0000", 2024-04-19T03:02:00.067 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0019331859999999999 2024-04-19T03:02:00.067 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.067 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.067 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:00.067 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:00.042011+0000", 2024-04-19T03:02:00.067 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00019364100000000001 2024-04-19T03:02:00.067 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.067 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.067 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:00.067 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:00.042209+0000", 2024-04-19T03:02:00.067 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000197166 2024-04-19T03:02:00.067 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:00.068 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:00.068 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:00.068 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.068 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.068 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4755.0:50034 5.9 e33/22 5:9e6b8add:::benchmark_data_smithi096_19531_object50033:head v 33'3038, mlcod=33'3035)", 2024-04-19T03:02:00.068 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:00.039967+0000", 2024-04-19T03:02:00.068 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0024523169999999999, 2024-04-19T03:02:00.068 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00272317, 2024-04-19T03:02:00.068 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:00.068 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-19T03:02:00.068 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:00.068 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.068 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:00.068 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:00.039967+0000", 2024-04-19T03:02:00.069 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:00.069 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.069 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.069 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:00.069 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:00.039967+0000", 2024-04-19T03:02:00.069 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:00.069 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.069 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.069 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:00.069 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:00.039966+0000", 2024-04-19T03:02:00.069 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:00.069 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.069 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.069 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:00.070 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:00.040038+0000", 2024-04-19T03:02:00.070 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2491999999999996e-05 2024-04-19T03:02:00.070 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.070 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.070 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:00.070 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:00.040051+0000", 2024-04-19T03:02:00.070 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.331e-05 2024-04-19T03:02:00.070 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.070 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.070 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:00.070 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:00.040060+0000", 2024-04-19T03:02:00.070 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.2689999999999999e-06 2024-04-19T03:02:00.070 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.071 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.071 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:00.071 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:00.040838+0000", 2024-04-19T03:02:00.071 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00077802500000000001 2024-04-19T03:02:00.071 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.071 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.071 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:00.071 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:00.040855+0000", 2024-04-19T03:02:00.071 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7635999999999999e-05 2024-04-19T03:02:00.071 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:00.071 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:00.071 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:00.071 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.072 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.072 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:50038 5.8 5.59d7ba98 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-19T03:02:00.072 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:00.041561+0000", 2024-04-19T03:02:00.072 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.00085795900000000004, 2024-04-19T03:02:00.072 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0011856449999999999, 2024-04-19T03:02:00.072 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:00.072 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-04-19T03:02:00.072 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:00.072 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:00.072 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:00.072 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 50038 2024-04-19T03:02:00.072 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.072 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:00.072 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.073 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:00.073 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:00.041561+0000", 2024-04-19T03:02:00.073 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:00.073 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.073 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.073 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:00.073 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:00.041561+0000", 2024-04-19T03:02:00.073 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:00.073 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.073 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.073 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:00.073 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:00.041560+0000", 2024-04-19T03:02:00.073 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:00.073 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.074 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.074 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:00.074 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:00.041675+0000", 2024-04-19T03:02:00.074 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000114632 2024-04-19T03:02:00.074 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.074 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.074 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:00.074 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:00.041687+0000", 2024-04-19T03:02:00.074 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2605999999999999e-05 2024-04-19T03:02:00.074 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.074 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.074 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:00.075 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:00.041695+0000", 2024-04-19T03:02:00.075 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.464e-06 2024-04-19T03:02:00.075 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:00.075 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:00.075 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:00.075 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.075 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.075 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop_reply(client.4755.0:50029 5.8 e33/22)", 2024-04-19T03:02:00.075 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:00.042274+0000", 2024-04-19T03:02:00.075 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.00014520399999999999, 2024-04-19T03:02:00.075 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00051552100000000001, 2024-04-19T03:02:00.075 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:00.075 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-04-19T03:02:00.075 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:00.076 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.076 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:00.076 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:00.042274+0000", 2024-04-19T03:02:00.076 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:00.076 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.076 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.076 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:00.076 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:00.042274+0000", 2024-04-19T03:02:00.076 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:00.076 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.076 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.076 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:00.076 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:00.042273+0000", 2024-04-19T03:02:00.076 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:00.076 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.077 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.077 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:00.077 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:00.042277+0000", 2024-04-19T03:02:00.077 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2289999999999997e-06 2024-04-19T03:02:00.077 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.077 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.077 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:00.077 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:00.042285+0000", 2024-04-19T03:02:00.077 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.9799999999999998e-06 2024-04-19T03:02:00.077 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.077 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.077 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:00.077 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:00.042291+0000", 2024-04-19T03:02:00.077 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6540000000000004e-06 2024-04-19T03:02:00.078 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:00.078 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:00.078 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:00.078 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.078 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.078 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:50026 5.b 5:d75220a4:::benchmark_data_smithi096_19531_object50025:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-19T03:02:00.078 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:00.034676+0000", 2024-04-19T03:02:00.078 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0077433019999999997, 2024-04-19T03:02:00.078 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0081413019999999996, 2024-04-19T03:02:00.078 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:00.078 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:02:00.078 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:00.078 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:00.079 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:00.079 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 50026 2024-04-19T03:02:00.079 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.079 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:00.079 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.079 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:00.079 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:00.034676+0000", 2024-04-19T03:02:00.079 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:00.079 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.079 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.079 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:00.079 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:00.034676+0000", 2024-04-19T03:02:00.079 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:00.079 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.080 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.080 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:00.080 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:00.034674+0000", 2024-04-19T03:02:00.080 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:00.080 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.080 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.080 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:00.080 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:00.034734+0000", 2024-04-19T03:02:00.080 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9332e-05 2024-04-19T03:02:00.080 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.080 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.080 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:00.080 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:00.034744+0000", 2024-04-19T03:02:00.081 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0482000000000001e-05 2024-04-19T03:02:00.081 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.081 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.081 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:00.081 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:00.034749+0000", 2024-04-19T03:02:00.081 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2560000000000002e-06 2024-04-19T03:02:00.081 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.081 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.081 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:00.081 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:00.034783+0000", 2024-04-19T03:02:00.081 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3973999999999997e-05 2024-04-19T03:02:00.081 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.081 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.081 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:00.082 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:00.034912+0000", 2024-04-19T03:02:00.082 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012906500000000001 2024-04-19T03:02:00.082 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.082 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.082 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:00.082 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:00.034994+0000", 2024-04-19T03:02:00.082 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1787999999999997e-05 2024-04-19T03:02:00.082 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.082 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.082 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:00.082 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:00.038623+0000", 2024-04-19T03:02:00.082 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0036286700000000001 2024-04-19T03:02:00.082 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:00.082 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:00.083 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:00.083 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.083 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.083 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:50027 5.e 5:7b180a0a:::benchmark_data_smithi096_19531_object50026:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-19T03:02:00.083 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:00.034814+0000", 2024-04-19T03:02:00.083 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0076046610000000004, 2024-04-19T03:02:00.083 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0080623180000000006, 2024-04-19T03:02:00.083 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:00.083 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:02:00.083 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:00.083 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:00.083 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:00.083 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 50027 2024-04-19T03:02:00.083 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.084 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:00.084 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.084 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:00.084 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:00.034814+0000", 2024-04-19T03:02:00.084 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:00.084 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.084 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.084 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:00.084 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:00.034814+0000", 2024-04-19T03:02:00.084 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:00.084 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.084 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.084 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:00.084 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:00.034814+0000", 2024-04-19T03:02:00.085 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:00.085 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.085 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.085 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:00.085 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:00.034867+0000", 2024-04-19T03:02:00.085 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3510000000000001e-05 2024-04-19T03:02:00.085 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.085 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.085 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:00.085 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:00.034874+0000", 2024-04-19T03:02:00.085 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.357e-06 2024-04-19T03:02:00.085 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.085 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.085 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:00.086 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:00.034880+0000", 2024-04-19T03:02:00.086 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.485e-06 2024-04-19T03:02:00.086 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.086 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.086 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:00.086 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:00.034926+0000", 2024-04-19T03:02:00.086 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5874000000000002e-05 2024-04-19T03:02:00.086 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.086 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.086 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:00.086 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:00.035072+0000", 2024-04-19T03:02:00.086 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014606499999999999 2024-04-19T03:02:00.086 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.087 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.087 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:00.087 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:00.035223+0000", 2024-04-19T03:02:00.087 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000150791 2024-04-19T03:02:00.087 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.087 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.087 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:00.087 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:00.041789+0000", 2024-04-19T03:02:00.087 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0065663780000000003 2024-04-19T03:02:00.087 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:00.087 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:00.087 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:00.087 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:00.087 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-04-19T03:02:00.088 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 10 2024-04-19T03:02:00.088 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-19T03:02:00.089 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T03:02:00.090 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-04-19T03:02:00.086+0000 7f35986ab700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18243) UID: 0 2024-04-19T03:02:00.124 INFO:teuthology.orchestra.run.smithi096.stderr:noscrub is set 2024-04-19T03:02:00.189 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:00.188+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:00.214 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-19T03:02:00.214 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-04-19T03:02:00.214 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-04-19T03:02:00.214 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-04-19T03:02:00.214 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-19T03:02:00.227 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T03:02:00.289 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-04-19T03:02:00.286+0000 7f35986ab700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18243) UID: 0 2024-04-19T03:02:00.390 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:00.388+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:00.392 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-19T03:02:00.392 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-04-19T03:02:00.392 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-04-19T03:02:00.392 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-04-19T03:02:00.393 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.393 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:9 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:02:00.393 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:14.999380+0000", 2024-04-19T03:02:00.393 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 45.391152728999998, 2024-04-19T03:02:00.393 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.019009906, 2024-04-19T03:02:00.393 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:00.393 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:00.393 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:00.393 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.393 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:00.393 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999380+0000", 2024-04-19T03:02:00.393 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:00.393 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.394 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.394 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:00.394 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999380+0000", 2024-04-19T03:02:00.394 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:00.394 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.394 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.394 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:00.394 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999377+0000", 2024-04-19T03:02:00.394 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999971 2024-04-19T03:02:00.394 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.395 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.395 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:00.395 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999393+0000", 2024-04-19T03:02:00.395 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5665999999999999e-05 2024-04-19T03:02:00.395 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.395 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.396 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:00.396 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999416+0000", 2024-04-19T03:02:00.396 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3030000000000001e-05 2024-04-19T03:02:00.396 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.396 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.396 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:00.396 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999439+0000", 2024-04-19T03:02:00.396 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3203000000000001e-05 2024-04-19T03:02:00.396 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.396 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.396 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:00.397 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999564+0000", 2024-04-19T03:02:00.397 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012492800000000001 2024-04-19T03:02:00.397 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.398 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.398 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op must wait for map", 2024-04-19T03:02:00.398 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999573+0000", 2024-04-19T03:02:00.398 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.7129999999999994e-06 2024-04-19T03:02:00.398 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.398 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.398 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:00.398 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.005623+0000", 2024-04-19T03:02:00.398 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0060502120000000001 2024-04-19T03:02:00.399 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.399 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.399 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:00.399 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.006510+0000", 2024-04-19T03:02:00.399 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00088656 2024-04-19T03:02:00.399 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.399 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.399 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-04-19T03:02:00.399 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.008004+0000", 2024-04-19T03:02:00.399 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0014948240000000001 2024-04-19T03:02:00.399 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.399 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.399 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:00.400 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.011874+0000", 2024-04-19T03:02:00.400 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0038699630000000001 2024-04-19T03:02:00.400 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.400 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.400 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:00.400 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.018000+0000", 2024-04-19T03:02:00.400 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0061254389999999999 2024-04-19T03:02:00.400 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.400 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.400 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:00.400 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.018281+0000", 2024-04-19T03:02:00.400 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00028121400000000001 2024-04-19T03:02:00.400 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.401 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.401 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:00.401 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.018390+0000", 2024-04-19T03:02:00.401 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010899 2024-04-19T03:02:00.401 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:00.401 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:00.401 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:00.401 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.401 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.401 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:10 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:02:00.401 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:14.999496+0000", 2024-04-19T03:02:00.401 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 45.391037193999999, 2024-04-19T03:02:00.401 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.022720497999999999, 2024-04-19T03:02:00.402 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:00.402 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:00.402 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:00.402 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.402 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:00.402 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999496+0000", 2024-04-19T03:02:00.402 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:00.402 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.402 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.402 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:00.402 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999496+0000", 2024-04-19T03:02:00.402 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:00.402 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.403 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.403 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:00.403 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999494+0000", 2024-04-19T03:02:00.403 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:00.403 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.403 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.403 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:00.403 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999503+0000", 2024-04-19T03:02:00.403 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.5930000000000006e-06 2024-04-19T03:02:00.403 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.403 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.403 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:00.403 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999523+0000", 2024-04-19T03:02:00.403 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9553000000000001e-05 2024-04-19T03:02:00.404 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.404 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.404 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:00.404 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999538+0000", 2024-04-19T03:02:00.404 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5702999999999999e-05 2024-04-19T03:02:00.404 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.404 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.404 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:00.404 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999608+0000", 2024-04-19T03:02:00.404 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.9912000000000004e-05 2024-04-19T03:02:00.404 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.404 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.404 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op must wait for map", 2024-04-19T03:02:00.405 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999626+0000", 2024-04-19T03:02:00.405 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8207e-05 2024-04-19T03:02:00.405 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.405 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.405 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:00.405 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.010765+0000", 2024-04-19T03:02:00.405 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011138719 2024-04-19T03:02:00.405 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.405 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.405 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:00.405 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.010906+0000", 2024-04-19T03:02:00.405 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014095899999999999 2024-04-19T03:02:00.405 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.405 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.406 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-04-19T03:02:00.406 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.011472+0000", 2024-04-19T03:02:00.406 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00056629300000000005 2024-04-19T03:02:00.406 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.406 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.406 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:00.406 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.013217+0000", 2024-04-19T03:02:00.406 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001744317 2024-04-19T03:02:00.406 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.406 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.406 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:00.406 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.022083+0000", 2024-04-19T03:02:00.406 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0088663849999999992 2024-04-19T03:02:00.407 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.407 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.407 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:00.407 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.022124+0000", 2024-04-19T03:02:00.407 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.057e-05 2024-04-19T03:02:00.407 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.407 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.407 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:00.407 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.022216+0000", 2024-04-19T03:02:00.407 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.2417000000000006e-05 2024-04-19T03:02:00.407 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:00.407 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:00.407 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:00.408 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.408 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.408 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:13 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:02:00.408 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:14.999564+0000", 2024-04-19T03:02:00.408 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 45.390968311999998, 2024-04-19T03:02:00.408 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.019594777000000001, 2024-04-19T03:02:00.408 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:00.408 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:00.408 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:00.408 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.408 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:00.408 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999564+0000", 2024-04-19T03:02:00.408 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:00.409 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.409 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.409 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:00.409 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999564+0000", 2024-04-19T03:02:00.409 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:00.409 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.409 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.409 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:00.409 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999563+0000", 2024-04-19T03:02:00.410 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:00.410 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.410 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.410 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:00.410 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999582+0000", 2024-04-19T03:02:00.410 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8151999999999998e-05 2024-04-19T03:02:00.410 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.410 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.410 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:00.410 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999599+0000", 2024-04-19T03:02:00.410 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7583000000000001e-05 2024-04-19T03:02:00.410 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.410 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.411 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:00.411 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999618+0000", 2024-04-19T03:02:00.411 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8989999999999999e-05 2024-04-19T03:02:00.411 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.412 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.412 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:00.412 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999692+0000", 2024-04-19T03:02:00.412 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3561999999999998e-05 2024-04-19T03:02:00.412 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.412 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.412 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op must wait for map", 2024-04-19T03:02:00.412 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999698+0000", 2024-04-19T03:02:00.412 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7159999999999997e-06 2024-04-19T03:02:00.412 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.412 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.412 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:00.413 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.007836+0000", 2024-04-19T03:02:00.413 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0081376520000000004 2024-04-19T03:02:00.413 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.413 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.413 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:00.413 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.008208+0000", 2024-04-19T03:02:00.413 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00037223699999999998 2024-04-19T03:02:00.413 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.413 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.413 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-04-19T03:02:00.413 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.008516+0000", 2024-04-19T03:02:00.413 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000308227 2024-04-19T03:02:00.414 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.414 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.414 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:00.414 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.011585+0000", 2024-04-19T03:02:00.414 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0030680659999999999 2024-04-19T03:02:00.414 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.414 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.414 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:00.414 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.018871+0000", 2024-04-19T03:02:00.414 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0072861369999999998 2024-04-19T03:02:00.414 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.414 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.414 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:00.415 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.019067+0000", 2024-04-19T03:02:00.415 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00019672099999999999 2024-04-19T03:02:00.415 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.415 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.415 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:00.415 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.019159+0000", 2024-04-19T03:02:00.415 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1829999999999993e-05 2024-04-19T03:02:00.415 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:00.415 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:00.415 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:00.415 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.415 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.415 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:31 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:02:00.415 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:14.999649+0000", 2024-04-19T03:02:00.416 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 45.390884194000002, 2024-04-19T03:02:00.416 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.018882121000000002, 2024-04-19T03:02:00.416 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:00.416 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:00.416 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:00.416 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.416 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:00.416 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999649+0000", 2024-04-19T03:02:00.416 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:00.416 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.416 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.416 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:00.416 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999649+0000", 2024-04-19T03:02:00.417 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:00.417 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.417 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.417 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:00.417 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999647+0000", 2024-04-19T03:02:00.417 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:00.417 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.417 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.417 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:00.417 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999657+0000", 2024-04-19T03:02:00.417 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.3729999999999999e-06 2024-04-19T03:02:00.417 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.417 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.418 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:00.418 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999675+0000", 2024-04-19T03:02:00.418 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8522999999999999e-05 2024-04-19T03:02:00.418 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.418 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.419 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:00.419 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999689+0000", 2024-04-19T03:02:00.419 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.347e-05 2024-04-19T03:02:00.420 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.420 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.420 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:00.420 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999761+0000", 2024-04-19T03:02:00.420 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.1904999999999997e-05 2024-04-19T03:02:00.420 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.420 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.420 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:02:00.420 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999766+0000", 2024-04-19T03:02:00.420 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6069999999999998e-06 2024-04-19T03:02:00.420 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.420 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.420 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:00.421 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.010040+0000", 2024-04-19T03:02:00.421 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.010273381 2024-04-19T03:02:00.421 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.421 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.421 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:00.421 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.010260+0000", 2024-04-19T03:02:00.421 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00022003300000000001 2024-04-19T03:02:00.421 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.421 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.421 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-04-19T03:02:00.421 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.010415+0000", 2024-04-19T03:02:00.421 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015515599999999999 2024-04-19T03:02:00.421 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.421 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.422 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:00.422 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.013206+0000", 2024-04-19T03:02:00.422 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0027915010000000001 2024-04-19T03:02:00.422 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.422 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.422 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:00.422 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.018438+0000", 2024-04-19T03:02:00.422 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0052313469999999999 2024-04-19T03:02:00.422 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.422 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.423 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:00.423 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.018491+0000", 2024-04-19T03:02:00.423 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3554000000000003e-05 2024-04-19T03:02:00.423 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.423 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.423 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:00.423 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.018531+0000", 2024-04-19T03:02:00.423 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9384000000000001e-05 2024-04-19T03:02:00.423 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:00.423 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:00.423 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:00.423 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.423 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.423 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:32 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:02:00.424 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:14.999712+0000", 2024-04-19T03:02:00.424 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 45.390820951000002, 2024-04-19T03:02:00.424 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.022635437000000001, 2024-04-19T03:02:00.424 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:00.424 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:00.424 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:00.424 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.424 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:00.424 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999712+0000", 2024-04-19T03:02:00.424 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:00.424 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.424 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.425 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:00.425 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999712+0000", 2024-04-19T03:02:00.425 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:00.425 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.425 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.425 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:00.426 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999711+0000", 2024-04-19T03:02:00.426 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:00.426 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.426 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.426 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:00.426 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999719+0000", 2024-04-19T03:02:00.426 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.354e-06 2024-04-19T03:02:00.426 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.426 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.426 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:00.426 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999735+0000", 2024-04-19T03:02:00.427 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6288999999999999e-05 2024-04-19T03:02:00.427 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.427 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.427 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:00.427 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999749+0000", 2024-04-19T03:02:00.427 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3492999999999999e-05 2024-04-19T03:02:00.427 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.427 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.427 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:00.427 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999811+0000", 2024-04-19T03:02:00.427 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2298999999999994e-05 2024-04-19T03:02:00.427 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.427 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.427 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:02:00.428 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999817+0000", 2024-04-19T03:02:00.428 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2169999999999999e-06 2024-04-19T03:02:00.428 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.428 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.428 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:00.428 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.011836+0000", 2024-04-19T03:02:00.428 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.012018008 2024-04-19T03:02:00.428 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.428 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.428 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:00.429 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.011897+0000", 2024-04-19T03:02:00.429 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1111000000000005e-05 2024-04-19T03:02:00.429 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.429 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.429 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-04-19T03:02:00.429 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.011980+0000", 2024-04-19T03:02:00.429 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3003999999999993e-05 2024-04-19T03:02:00.429 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.429 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.429 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:00.430 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.013863+0000", 2024-04-19T03:02:00.430 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001883804 2024-04-19T03:02:00.430 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.430 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.430 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:00.430 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.022257+0000", 2024-04-19T03:02:00.430 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0083938290000000002 2024-04-19T03:02:00.430 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.430 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.430 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:00.430 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.022310+0000", 2024-04-19T03:02:00.431 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.236e-05 2024-04-19T03:02:00.431 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.431 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.431 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:00.431 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.022347+0000", 2024-04-19T03:02:00.431 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7653e-05 2024-04-19T03:02:00.431 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:00.431 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:00.431 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:00.431 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.431 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.431 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:35 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:02:00.431 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:14.999772+0000", 2024-04-19T03:02:00.431 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 45.390760671999999, 2024-04-19T03:02:00.432 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020205530999999999, 2024-04-19T03:02:00.432 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:00.432 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:00.432 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:00.432 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.432 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:00.432 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999772+0000", 2024-04-19T03:02:00.432 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:00.432 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.432 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.432 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:00.432 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999772+0000", 2024-04-19T03:02:00.432 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:00.432 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.433 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.433 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:00.433 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999771+0000", 2024-04-19T03:02:00.433 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:00.433 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.433 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.433 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:00.433 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999778+0000", 2024-04-19T03:02:00.433 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2200000000000003e-06 2024-04-19T03:02:00.433 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.433 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.433 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:00.433 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999794+0000", 2024-04-19T03:02:00.433 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5798999999999999e-05 2024-04-19T03:02:00.434 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.434 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.434 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:00.434 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999809+0000", 2024-04-19T03:02:00.434 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.469e-05 2024-04-19T03:02:00.434 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.434 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.434 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:00.434 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999915+0000", 2024-04-19T03:02:00.434 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000105658 2024-04-19T03:02:00.434 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.434 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.434 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:02:00.435 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999927+0000", 2024-04-19T03:02:00.435 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.201e-05 2024-04-19T03:02:00.435 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.435 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.435 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:00.435 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.009841+0000", 2024-04-19T03:02:00.435 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0099147039999999999 2024-04-19T03:02:00.435 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.435 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.435 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:00.435 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.009941+0000", 2024-04-19T03:02:00.435 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.9461000000000002e-05 2024-04-19T03:02:00.435 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.436 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.436 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-04-19T03:02:00.436 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.010101+0000", 2024-04-19T03:02:00.436 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016028599999999999 2024-04-19T03:02:00.436 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.436 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.436 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:00.436 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.011787+0000", 2024-04-19T03:02:00.436 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001685513 2024-04-19T03:02:00.436 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.436 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.436 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:00.436 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.019889+0000", 2024-04-19T03:02:00.436 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0081026559999999997 2024-04-19T03:02:00.437 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.437 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.437 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:00.437 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.019932+0000", 2024-04-19T03:02:00.437 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2385000000000002e-05 2024-04-19T03:02:00.437 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.437 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.437 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:00.437 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.019978+0000", 2024-04-19T03:02:00.437 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6093000000000001e-05 2024-04-19T03:02:00.437 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:00.437 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:00.437 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:00.437 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.438 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.438 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:18 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:02:00.438 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:14.999834+0000", 2024-04-19T03:02:00.438 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 45.390698587000003, 2024-04-19T03:02:00.438 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.019567312999999999, 2024-04-19T03:02:00.438 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:00.438 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:00.438 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:00.438 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.438 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:00.438 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999834+0000", 2024-04-19T03:02:00.438 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:00.438 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.439 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.439 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:00.439 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999834+0000", 2024-04-19T03:02:00.439 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:00.439 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.439 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.439 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:00.439 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999833+0000", 2024-04-19T03:02:00.439 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:00.439 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.440 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.440 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:00.440 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999842+0000", 2024-04-19T03:02:00.440 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.2269999999999999e-06 2024-04-19T03:02:00.440 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.440 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.440 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:00.440 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999860+0000", 2024-04-19T03:02:00.440 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8456000000000001e-05 2024-04-19T03:02:00.441 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.441 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.441 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:00.441 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999874+0000", 2024-04-19T03:02:00.441 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3263e-05 2024-04-19T03:02:00.441 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.441 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.441 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:00.442 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999934+0000", 2024-04-19T03:02:00.442 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0888999999999999e-05 2024-04-19T03:02:00.442 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.442 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.442 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:02:00.442 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999940+0000", 2024-04-19T03:02:00.442 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4330000000000003e-06 2024-04-19T03:02:00.442 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.443 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.443 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:00.443 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.010943+0000", 2024-04-19T03:02:00.443 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011002786000000001 2024-04-19T03:02:00.443 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.443 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.443 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:00.443 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.011078+0000", 2024-04-19T03:02:00.444 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013541000000000001 2024-04-19T03:02:00.444 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.444 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.444 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-04-19T03:02:00.444 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.011172+0000", 2024-04-19T03:02:00.444 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.3459000000000001e-05 2024-04-19T03:02:00.444 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.444 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.445 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:00.445 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.013211+0000", 2024-04-19T03:02:00.445 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0020397710000000001 2024-04-19T03:02:00.445 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.445 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.445 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:00.445 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.019320+0000", 2024-04-19T03:02:00.445 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0061089969999999997 2024-04-19T03:02:00.445 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.446 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.446 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:00.446 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.019364+0000", 2024-04-19T03:02:00.446 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4158e-05 2024-04-19T03:02:00.446 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.446 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.446 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:00.446 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.019402+0000", 2024-04-19T03:02:00.447 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7011000000000002e-05 2024-04-19T03:02:00.447 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:00.447 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:00.447 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:00.447 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.447 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.447 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:21 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:02:00.447 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:14.999896+0000", 2024-04-19T03:02:00.448 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 45.390636768, 2024-04-19T03:02:00.448 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.018618866000000001, 2024-04-19T03:02:00.448 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:00.448 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-19T03:02:00.448 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:00.448 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.448 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:00.448 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999896+0000", 2024-04-19T03:02:00.449 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:00.449 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.449 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.449 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:00.449 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999896+0000", 2024-04-19T03:02:00.449 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:00.449 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.449 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.449 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:00.449 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999895+0000", 2024-04-19T03:02:00.449 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:00.450 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.450 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.450 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:00.450 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999901+0000", 2024-04-19T03:02:00.450 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4529999999999999e-06 2024-04-19T03:02:00.450 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.450 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.450 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:00.450 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999918+0000", 2024-04-19T03:02:00.450 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6897000000000001e-05 2024-04-19T03:02:00.451 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.451 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.451 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:00.451 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999931+0000", 2024-04-19T03:02:00.451 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.309e-05 2024-04-19T03:02:00.451 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.451 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.451 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:00.451 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.000027+0000", 2024-04-19T03:02:00.451 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.5880999999999999e-05 2024-04-19T03:02:00.451 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.451 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.451 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op must wait for map", 2024-04-19T03:02:00.451 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.000040+0000", 2024-04-19T03:02:00.452 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3083e-05 2024-04-19T03:02:00.452 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.452 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.452 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:00.452 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.004961+0000", 2024-04-19T03:02:00.452 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0049206079999999999 2024-04-19T03:02:00.452 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.452 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.452 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:00.452 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.005261+0000", 2024-04-19T03:02:00.452 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00030041699999999998 2024-04-19T03:02:00.452 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.452 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.452 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:00.453 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.018515+0000", 2024-04-19T03:02:00.453 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013253534000000001 2024-04-19T03:02:00.453 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:00.453 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:00.453 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:00.453 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.453 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.453 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:24 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:02:00.453 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:14.999964+0000", 2024-04-19T03:02:00.453 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 45.390569272999997, 2024-04-19T03:02:00.453 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020451446000000002, 2024-04-19T03:02:00.453 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:00.453 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-19T03:02:00.454 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:00.454 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.454 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:00.454 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999964+0000", 2024-04-19T03:02:00.454 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:00.454 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.454 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.454 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:00.455 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999964+0000", 2024-04-19T03:02:00.455 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:00.455 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.455 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.455 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:00.455 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999963+0000", 2024-04-19T03:02:00.455 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:00.456 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.456 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.456 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:00.456 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999969+0000", 2024-04-19T03:02:00.456 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0270000000000001e-06 2024-04-19T03:02:00.456 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.457 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.457 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:00.457 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999984+0000", 2024-04-19T03:02:00.457 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5903e-05 2024-04-19T03:02:00.457 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.457 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.457 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:00.457 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999998+0000", 2024-04-19T03:02:00.457 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3076e-05 2024-04-19T03:02:00.457 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.457 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.457 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:00.457 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.000078+0000", 2024-04-19T03:02:00.458 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0525000000000006e-05 2024-04-19T03:02:00.458 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.458 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.458 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op must wait for map", 2024-04-19T03:02:00.458 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.000084+0000", 2024-04-19T03:02:00.458 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8370000000000002e-06 2024-04-19T03:02:00.458 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.458 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.458 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:00.458 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.008819+0000", 2024-04-19T03:02:00.458 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0087349019999999993 2024-04-19T03:02:00.459 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.459 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.459 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:00.459 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.009018+0000", 2024-04-19T03:02:00.459 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000198989 2024-04-19T03:02:00.459 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.459 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.459 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:00.459 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.020415+0000", 2024-04-19T03:02:00.459 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011397157 2024-04-19T03:02:00.459 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:00.459 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:00.459 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:00.460 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.460 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.460 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:11274 5.e 5:7c846032:::benchmark_data_smithi096_19531_object11273:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T03:02:00.460 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:42.061776+0000", 2024-04-19T03:02:00.460 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 18.328757027999998, 2024-04-19T03:02:00.460 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.035381001000000002, 2024-04-19T03:02:00.460 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:00.460 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:00.460 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:00.460 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:00.460 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:00.460 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 11274 2024-04-19T03:02:00.460 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.460 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:00.460 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.461 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:00.461 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.061776+0000", 2024-04-19T03:02:00.461 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:00.461 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.461 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.461 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:00.461 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.061776+0000", 2024-04-19T03:02:00.461 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:00.461 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.461 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.461 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:00.461 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.061775+0000", 2024-04-19T03:02:00.461 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:00.462 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.462 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.462 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:00.462 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.061807+0000", 2024-04-19T03:02:00.462 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1733000000000003e-05 2024-04-19T03:02:00.462 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.462 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.462 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:00.462 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.061822+0000", 2024-04-19T03:02:00.462 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5452999999999999e-05 2024-04-19T03:02:00.462 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.462 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.463 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:00.463 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.061827+0000", 2024-04-19T03:02:00.463 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9810000000000003e-06 2024-04-19T03:02:00.463 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.463 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.463 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:00.463 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.063388+0000", 2024-04-19T03:02:00.463 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0015605720000000001 2024-04-19T03:02:00.463 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.463 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.463 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:00.463 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.063612+0000", 2024-04-19T03:02:00.463 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00022431 2024-04-19T03:02:00.463 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.464 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.464 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:00.464 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.063747+0000", 2024-04-19T03:02:00.464 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013459600000000001 2024-04-19T03:02:00.464 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.464 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.464 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:00.464 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.066186+0000", 2024-04-19T03:02:00.464 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0024388909999999999 2024-04-19T03:02:00.464 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.464 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.464 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:00.464 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.097016+0000", 2024-04-19T03:02:00.465 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.030830705 2024-04-19T03:02:00.465 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.465 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.465 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:00.465 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.097096+0000", 2024-04-19T03:02:00.465 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.9469999999999996e-05 2024-04-19T03:02:00.465 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.465 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.465 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:00.465 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.097157+0000", 2024-04-19T03:02:00.465 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0884999999999997e-05 2024-04-19T03:02:00.465 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:00.465 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:00.465 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:00.466 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.466 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.466 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:11279 5.8 5:10b60c58:::benchmark_data_smithi096_19531_object11278:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T03:02:00.466 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:42.062594+0000", 2024-04-19T03:02:00.466 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 18.327938589999999, 2024-04-19T03:02:00.466 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.028696788000000001, 2024-04-19T03:02:00.466 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:00.466 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:00.466 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:00.466 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:00.466 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:00.466 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 11279 2024-04-19T03:02:00.466 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.467 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:00.467 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.467 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:00.467 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.062594+0000", 2024-04-19T03:02:00.467 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:00.467 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.467 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.467 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:00.467 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.062594+0000", 2024-04-19T03:02:00.467 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:00.467 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.467 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.467 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:00.467 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.062593+0000", 2024-04-19T03:02:00.468 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:00.468 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.468 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.468 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:00.468 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.062646+0000", 2024-04-19T03:02:00.468 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2293999999999998e-05 2024-04-19T03:02:00.468 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.468 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.468 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:00.468 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.062657+0000", 2024-04-19T03:02:00.469 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1440000000000001e-05 2024-04-19T03:02:00.469 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.469 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.469 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:00.469 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.062665+0000", 2024-04-19T03:02:00.469 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5159999999999997e-06 2024-04-19T03:02:00.469 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.469 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.469 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:00.469 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.063799+0000", 2024-04-19T03:02:00.469 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0011344860000000001 2024-04-19T03:02:00.469 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.469 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.470 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:00.470 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.063962+0000", 2024-04-19T03:02:00.470 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000162614 2024-04-19T03:02:00.470 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.470 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.470 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:00.470 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.064167+0000", 2024-04-19T03:02:00.470 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00020491699999999999 2024-04-19T03:02:00.470 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.470 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.470 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:00.470 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.066768+0000", 2024-04-19T03:02:00.470 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0026012090000000002 2024-04-19T03:02:00.471 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.471 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.471 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:00.471 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.091184+0000", 2024-04-19T03:02:00.471 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.024416582999999999 2024-04-19T03:02:00.471 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.471 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.471 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:00.471 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.091251+0000", 2024-04-19T03:02:00.472 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6753000000000003e-05 2024-04-19T03:02:00.472 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.472 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.472 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:00.472 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.091291+0000", 2024-04-19T03:02:00.472 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9841e-05 2024-04-19T03:02:00.472 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:00.472 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:00.472 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:00.472 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.472 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.472 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:11282 5.e 5:75b7c510:::benchmark_data_smithi096_19531_object11281:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T03:02:00.472 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:42.062674+0000", 2024-04-19T03:02:00.472 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 18.327859134000001, 2024-04-19T03:02:00.473 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.034812849, 2024-04-19T03:02:00.473 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:00.473 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:00.473 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:00.473 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:00.473 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:00.473 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 11282 2024-04-19T03:02:00.473 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.473 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:00.473 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.473 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:00.474 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.062674+0000", 2024-04-19T03:02:00.474 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:00.474 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.474 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.474 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:00.474 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.062674+0000", 2024-04-19T03:02:00.474 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:00.474 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.474 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.474 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:00.474 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.062673+0000", 2024-04-19T03:02:00.475 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:00.475 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.475 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.475 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:00.475 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.062712+0000", 2024-04-19T03:02:00.475 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9341999999999997e-05 2024-04-19T03:02:00.475 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.475 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.475 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:00.475 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.062721+0000", 2024-04-19T03:02:00.475 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1700000000000003e-06 2024-04-19T03:02:00.475 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.475 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.476 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:00.476 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.062729+0000", 2024-04-19T03:02:00.476 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4240000000000004e-06 2024-04-19T03:02:00.476 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.476 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.476 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:00.476 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.065017+0000", 2024-04-19T03:02:00.476 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0022878590000000002 2024-04-19T03:02:00.476 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.476 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.476 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:00.476 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.065207+0000", 2024-04-19T03:02:00.477 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000190411 2024-04-19T03:02:00.477 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.477 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.477 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:00.477 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.065323+0000", 2024-04-19T03:02:00.477 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000115593 2024-04-19T03:02:00.477 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.477 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.477 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:00.477 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.069683+0000", 2024-04-19T03:02:00.477 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0043604409999999996 2024-04-19T03:02:00.477 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.477 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.477 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:00.478 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.097273+0000", 2024-04-19T03:02:00.478 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.027589516000000001 2024-04-19T03:02:00.478 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.478 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.478 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:00.478 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.097406+0000", 2024-04-19T03:02:00.478 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000133514 2024-04-19T03:02:00.479 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.479 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.479 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:00.479 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.097486+0000", 2024-04-19T03:02:00.479 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0479e-05 2024-04-19T03:02:00.479 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:00.479 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:00.479 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:00.479 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.479 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.479 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:11288 5.0 5:042458d0:::benchmark_data_smithi096_19531_object11287:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T03:02:00.480 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:42.070352+0000", 2024-04-19T03:02:00.480 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 18.320181206000001, 2024-04-19T03:02:00.480 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.021532447, 2024-04-19T03:02:00.480 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:00.480 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:00.480 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:00.480 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:00.480 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:00.480 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 11288 2024-04-19T03:02:00.480 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.481 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:00.481 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.481 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:00.481 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.070352+0000", 2024-04-19T03:02:00.481 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:00.481 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.481 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.481 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:00.481 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.070352+0000", 2024-04-19T03:02:00.481 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:00.481 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.481 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.481 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:00.481 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.070351+0000", 2024-04-19T03:02:00.482 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:00.482 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.482 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.482 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:00.482 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.070392+0000", 2024-04-19T03:02:00.482 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1077e-05 2024-04-19T03:02:00.482 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.482 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.482 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:00.482 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.070398+0000", 2024-04-19T03:02:00.482 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1109999999999996e-06 2024-04-19T03:02:00.482 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.483 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.483 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:00.483 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.070402+0000", 2024-04-19T03:02:00.483 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2010000000000001e-06 2024-04-19T03:02:00.483 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.483 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.483 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:00.483 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.070445+0000", 2024-04-19T03:02:00.483 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2585e-05 2024-04-19T03:02:00.483 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.483 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.483 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:00.483 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.070572+0000", 2024-04-19T03:02:00.484 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012708500000000001 2024-04-19T03:02:00.484 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.484 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.484 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:00.484 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.070711+0000", 2024-04-19T03:02:00.484 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013848699999999999 2024-04-19T03:02:00.484 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.484 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.484 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:00.484 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.073505+0000", 2024-04-19T03:02:00.484 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0027944620000000002 2024-04-19T03:02:00.484 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.484 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.484 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:00.485 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.091806+0000", 2024-04-19T03:02:00.485 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.018301251000000001 2024-04-19T03:02:00.485 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.485 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.485 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:00.485 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.091854+0000", 2024-04-19T03:02:00.485 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7419000000000001e-05 2024-04-19T03:02:00.485 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.485 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.485 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:00.485 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.091884+0000", 2024-04-19T03:02:00.485 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0241999999999999e-05 2024-04-19T03:02:00.485 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:00.486 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:00.486 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:00.486 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.486 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.486 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:11292 5.0 5:009b2ea9:::benchmark_data_smithi096_19531_object11291:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T03:02:00.486 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:42.070676+0000", 2024-04-19T03:02:00.486 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 18.319856830999999, 2024-04-19T03:02:00.486 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.02219631, 2024-04-19T03:02:00.486 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:00.486 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:00.486 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:00.486 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:00.486 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:00.487 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 11292 2024-04-19T03:02:00.487 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.487 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:00.487 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.487 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:00.487 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.070676+0000", 2024-04-19T03:02:00.487 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:00.487 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.487 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.487 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:00.487 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.070676+0000", 2024-04-19T03:02:00.487 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:00.487 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.487 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.488 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:00.488 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.070675+0000", 2024-04-19T03:02:00.488 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:00.488 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.488 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.488 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:00.488 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.070800+0000", 2024-04-19T03:02:00.488 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000125263 2024-04-19T03:02:00.488 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.488 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.488 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:00.488 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.070808+0000", 2024-04-19T03:02:00.488 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0209999999999999e-06 2024-04-19T03:02:00.488 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.489 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.489 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:00.489 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.070814+0000", 2024-04-19T03:02:00.489 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0969999999999996e-06 2024-04-19T03:02:00.489 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.489 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.489 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:00.489 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.071956+0000", 2024-04-19T03:02:00.489 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0011427480000000001 2024-04-19T03:02:00.489 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.489 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.489 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:00.489 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.072153+0000", 2024-04-19T03:02:00.490 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000196524 2024-04-19T03:02:00.490 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.490 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.490 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:00.490 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.072312+0000", 2024-04-19T03:02:00.490 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015879300000000001 2024-04-19T03:02:00.490 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.490 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.490 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:00.490 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.078407+0000", 2024-04-19T03:02:00.490 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0060954929999999996 2024-04-19T03:02:00.490 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.490 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.491 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:00.491 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.092742+0000", 2024-04-19T03:02:00.491 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.014335349000000001 2024-04-19T03:02:00.491 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.491 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.491 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:00.491 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.092815+0000", 2024-04-19T03:02:00.491 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2881999999999998e-05 2024-04-19T03:02:00.491 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.491 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.491 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:00.491 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.092872+0000", 2024-04-19T03:02:00.491 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6965000000000001e-05 2024-04-19T03:02:00.492 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:00.492 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:00.492 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:00.492 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.492 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.492 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:11297 5.e 5:7975ecb6:::benchmark_data_smithi096_19531_object11296:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T03:02:00.492 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:42.076848+0000", 2024-04-19T03:02:00.492 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 18.313684950999999, 2024-04-19T03:02:00.492 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020867969, 2024-04-19T03:02:00.492 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:00.492 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:00.492 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:00.492 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:00.492 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:00.493 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 11297 2024-04-19T03:02:00.493 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.493 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:00.493 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.493 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:00.493 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.076848+0000", 2024-04-19T03:02:00.493 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:00.493 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.493 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.493 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:00.493 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.076848+0000", 2024-04-19T03:02:00.493 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:00.493 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.493 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.494 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:00.494 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.076846+0000", 2024-04-19T03:02:00.494 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:00.494 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.494 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.494 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:00.494 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.076894+0000", 2024-04-19T03:02:00.494 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7645000000000002e-05 2024-04-19T03:02:00.494 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.494 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.494 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:00.495 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.076913+0000", 2024-04-19T03:02:00.495 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8885e-05 2024-04-19T03:02:00.495 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.495 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.495 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:00.495 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.076924+0000", 2024-04-19T03:02:00.495 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.118e-05 2024-04-19T03:02:00.495 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.495 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.495 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:00.495 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.076983+0000", 2024-04-19T03:02:00.495 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8952000000000001e-05 2024-04-19T03:02:00.495 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.495 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.496 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:00.496 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.077156+0000", 2024-04-19T03:02:00.496 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00017307600000000001 2024-04-19T03:02:00.496 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.496 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.496 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:00.496 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.077358+0000", 2024-04-19T03:02:00.496 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000201991 2024-04-19T03:02:00.496 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.496 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.496 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:00.496 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.080885+0000", 2024-04-19T03:02:00.496 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0035268309999999998 2024-04-19T03:02:00.496 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.496 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.497 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:00.497 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.097569+0000", 2024-04-19T03:02:00.497 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.016683854000000001 2024-04-19T03:02:00.497 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.497 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.497 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:00.497 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.097647+0000", 2024-04-19T03:02:00.497 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.7823000000000004e-05 2024-04-19T03:02:00.497 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.497 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.497 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:00.497 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.097716+0000", 2024-04-19T03:02:00.497 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.9079999999999996e-05 2024-04-19T03:02:00.497 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:00.498 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:00.498 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:00.498 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.498 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.498 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:11298 5.e 5:72565f0a:::benchmark_data_smithi096_19531_object11297:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T03:02:00.498 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:42.076954+0000", 2024-04-19T03:02:00.498 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 18.313579077, 2024-04-19T03:02:00.498 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020950191999999999, 2024-04-19T03:02:00.498 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:00.499 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:00.499 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:00.499 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:00.499 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:00.499 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 11298 2024-04-19T03:02:00.499 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.499 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:00.499 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.499 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:00.499 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.076954+0000", 2024-04-19T03:02:00.499 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:00.499 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.499 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.499 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:00.500 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.076954+0000", 2024-04-19T03:02:00.500 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:00.500 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.500 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.500 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:00.500 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.076953+0000", 2024-04-19T03:02:00.500 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:00.500 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.500 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.500 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:00.500 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.076997+0000", 2024-04-19T03:02:00.500 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4023000000000002e-05 2024-04-19T03:02:00.500 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.500 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.501 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:00.501 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.077009+0000", 2024-04-19T03:02:00.501 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2456000000000001e-05 2024-04-19T03:02:00.501 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.501 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.501 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:00.501 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.077015+0000", 2024-04-19T03:02:00.501 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7950000000000004e-06 2024-04-19T03:02:00.501 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.501 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.501 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:00.501 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.078552+0000", 2024-04-19T03:02:00.501 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0015371320000000001 2024-04-19T03:02:00.502 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.502 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.502 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:00.502 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.078760+0000", 2024-04-19T03:02:00.502 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00020808799999999999 2024-04-19T03:02:00.502 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.502 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.502 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:00.502 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.078875+0000", 2024-04-19T03:02:00.502 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011457500000000001 2024-04-19T03:02:00.503 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.503 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.503 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:00.503 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.083603+0000", 2024-04-19T03:02:00.503 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0047276239999999997 2024-04-19T03:02:00.503 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.503 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.503 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:00.503 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.097783+0000", 2024-04-19T03:02:00.503 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.014180036 2024-04-19T03:02:00.504 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.504 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.504 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:00.504 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.097863+0000", 2024-04-19T03:02:00.504 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0317999999999999e-05 2024-04-19T03:02:00.504 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.504 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.504 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:00.504 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.097904+0000", 2024-04-19T03:02:00.504 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1035000000000003e-05 2024-04-19T03:02:00.505 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:00.505 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:00.505 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:00.505 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.505 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.505 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:41635 5.0 5:099f52c6:::benchmark_data_smithi096_19531_object41634:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-19T03:02:00.505 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:55.638486+0000", 2024-04-19T03:02:00.505 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 4.7520468149999999, 2024-04-19T03:02:00.505 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.018229273000000001, 2024-04-19T03:02:00.505 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:00.505 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:00.505 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:00.505 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:00.506 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:00.506 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 41635 2024-04-19T03:02:00.506 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.506 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:00.506 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.506 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:00.506 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:55.638486+0000", 2024-04-19T03:02:00.506 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:00.506 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.506 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.506 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:00.506 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:55.638486+0000", 2024-04-19T03:02:00.507 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:00.507 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.507 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.507 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:00.507 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:55.638484+0000", 2024-04-19T03:02:00.507 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999981 2024-04-19T03:02:00.507 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.507 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.507 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:00.507 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:55.638563+0000", 2024-04-19T03:02:00.507 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.9453e-05 2024-04-19T03:02:00.507 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.507 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.508 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:00.508 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:55.638578+0000", 2024-04-19T03:02:00.508 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4917e-05 2024-04-19T03:02:00.508 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.508 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.508 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:00.508 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:55.638587+0000", 2024-04-19T03:02:00.508 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.7479999999999999e-06 2024-04-19T03:02:00.508 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.508 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.508 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:00.508 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:55.647558+0000", 2024-04-19T03:02:00.508 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0089711489999999994 2024-04-19T03:02:00.508 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.509 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.509 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:00.509 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:55.647666+0000", 2024-04-19T03:02:00.509 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000107606 2024-04-19T03:02:00.509 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.509 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.509 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:00.509 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:55.647745+0000", 2024-04-19T03:02:00.509 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.9229999999999999e-05 2024-04-19T03:02:00.509 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.509 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.509 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:00.509 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:55.652616+0000", 2024-04-19T03:02:00.509 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0048707739999999996 2024-04-19T03:02:00.510 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.510 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.510 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:00.510 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:55.656654+0000", 2024-04-19T03:02:00.510 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0040386140000000003 2024-04-19T03:02:00.510 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.510 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.510 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:00.510 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:55.656692+0000", 2024-04-19T03:02:00.510 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7317000000000002e-05 2024-04-19T03:02:00.510 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.510 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.511 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:00.511 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:55.656715+0000", 2024-04-19T03:02:00.511 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3533e-05 2024-04-19T03:02:00.511 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:00.511 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:00.511 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:00.511 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.511 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.511 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:41640 5.0 5:0989f358:::benchmark_data_smithi096_19531_object41639:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-19T03:02:00.511 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:55.640790+0000", 2024-04-19T03:02:00.511 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 4.7497426330000003, 2024-04-19T03:02:00.511 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020000754999999999, 2024-04-19T03:02:00.511 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:00.511 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:00.511 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:00.512 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:00.512 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:00.512 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 41640 2024-04-19T03:02:00.512 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.512 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:00.512 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.512 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:00.512 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:55.640790+0000", 2024-04-19T03:02:00.512 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:00.512 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.512 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.512 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:00.512 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:55.640790+0000", 2024-04-19T03:02:00.512 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:00.513 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.513 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.513 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:00.513 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:55.640789+0000", 2024-04-19T03:02:00.513 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:00.513 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.513 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.513 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:00.513 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:55.640829+0000", 2024-04-19T03:02:00.513 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9870999999999998e-05 2024-04-19T03:02:00.513 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.513 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.513 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:00.513 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:55.640838+0000", 2024-04-19T03:02:00.513 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.8899999999999996e-06 2024-04-19T03:02:00.514 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.514 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.514 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:00.514 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:55.640843+0000", 2024-04-19T03:02:00.514 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1630000000000004e-06 2024-04-19T03:02:00.514 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.514 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.514 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:00.514 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:55.649279+0000", 2024-04-19T03:02:00.514 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0084358179999999994 2024-04-19T03:02:00.514 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.514 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.514 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:00.515 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:55.649388+0000", 2024-04-19T03:02:00.515 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010836399999999999 2024-04-19T03:02:00.515 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.515 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.515 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:00.515 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:55.649479+0000", 2024-04-19T03:02:00.515 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1284000000000002e-05 2024-04-19T03:02:00.515 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.515 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.515 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:00.515 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:55.656726+0000", 2024-04-19T03:02:00.515 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.007246962 2024-04-19T03:02:00.515 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.515 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.516 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:00.516 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:55.660689+0000", 2024-04-19T03:02:00.516 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0039628900000000002 2024-04-19T03:02:00.516 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.516 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.516 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:00.516 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:55.660755+0000", 2024-04-19T03:02:00.516 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6267999999999996e-05 2024-04-19T03:02:00.516 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.516 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.516 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:00.516 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:55.660791+0000", 2024-04-19T03:02:00.516 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5975e-05 2024-04-19T03:02:00.517 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:00.517 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:00.517 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:00.517 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.517 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.517 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:50553 5.0 5:041697c2:::benchmark_data_smithi096_19531_object50552:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-19T03:02:00.517 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:00.314446+0000", 2024-04-19T03:02:00.517 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.076086821999999998, 2024-04-19T03:02:00.517 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.019029635, 2024-04-19T03:02:00.517 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:00.517 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:00.517 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:00.518 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:00.518 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:00.518 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 50553 2024-04-19T03:02:00.518 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.518 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:00.518 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.518 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:00.518 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:00.314446+0000", 2024-04-19T03:02:00.518 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:00.518 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.518 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.518 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:00.518 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:00.314446+0000", 2024-04-19T03:02:00.518 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:00.519 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.519 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.519 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:00.519 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:00.314445+0000", 2024-04-19T03:02:00.519 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:00.519 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.519 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.519 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:00.519 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:00.314535+0000", 2024-04-19T03:02:00.519 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.0303999999999995e-05 2024-04-19T03:02:00.519 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.519 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.519 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:00.520 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:00.314549+0000", 2024-04-19T03:02:00.520 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4039999999999999e-05 2024-04-19T03:02:00.520 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.520 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.520 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:00.520 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:00.314557+0000", 2024-04-19T03:02:00.520 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.7039999999999994e-06 2024-04-19T03:02:00.520 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.520 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.520 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:00.520 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:00.324568+0000", 2024-04-19T03:02:00.520 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.010011406 2024-04-19T03:02:00.520 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.521 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.521 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:00.521 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:00.324700+0000", 2024-04-19T03:02:00.521 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000131879 2024-04-19T03:02:00.521 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.521 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.521 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:00.521 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:00.324889+0000", 2024-04-19T03:02:00.521 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0001885 2024-04-19T03:02:00.521 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.521 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.521 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:00.521 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:00.329400+0000", 2024-04-19T03:02:00.521 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0045109 2024-04-19T03:02:00.522 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.522 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.522 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:00.522 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:00.333400+0000", 2024-04-19T03:02:00.522 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0040001699999999999 2024-04-19T03:02:00.522 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.522 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.522 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:00.522 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:00.333432+0000", 2024-04-19T03:02:00.522 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1930000000000001e-05 2024-04-19T03:02:00.522 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.522 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.523 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:00.523 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:00.333476+0000", 2024-04-19T03:02:00.523 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3831000000000001e-05 2024-04-19T03:02:00.523 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:00.523 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:00.523 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:00.523 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.523 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.523 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:50576 5.b 5:d250063d:::benchmark_data_smithi096_19531_object50575:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-19T03:02:00.523 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:00.329584+0000", 2024-04-19T03:02:00.523 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.060948463000000001, 2024-04-19T03:02:00.523 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.021217389, 2024-04-19T03:02:00.523 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:00.523 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:00.524 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:00.524 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:00.524 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:00.524 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 50576 2024-04-19T03:02:00.524 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.524 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:00.524 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.524 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:00.524 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:00.329584+0000", 2024-04-19T03:02:00.524 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:00.524 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.524 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.524 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:00.525 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:00.329584+0000", 2024-04-19T03:02:00.525 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:00.525 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.525 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.525 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:00.525 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:00.329583+0000", 2024-04-19T03:02:00.525 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:00.525 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.525 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.525 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:00.525 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:00.329626+0000", 2024-04-19T03:02:00.526 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2530000000000001e-05 2024-04-19T03:02:00.526 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.526 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.526 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:00.526 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:00.329642+0000", 2024-04-19T03:02:00.526 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5891000000000001e-05 2024-04-19T03:02:00.526 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.526 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.526 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:00.526 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:00.329652+0000", 2024-04-19T03:02:00.526 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0093e-05 2024-04-19T03:02:00.526 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.527 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.527 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:00.527 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:00.330793+0000", 2024-04-19T03:02:00.527 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001141097 2024-04-19T03:02:00.527 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.527 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.527 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:00.527 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:00.330924+0000", 2024-04-19T03:02:00.527 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013114499999999999 2024-04-19T03:02:00.527 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.527 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.527 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:00.527 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:00.331055+0000", 2024-04-19T03:02:00.527 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013124600000000001 2024-04-19T03:02:00.528 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.528 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.528 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:00.528 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:00.335705+0000", 2024-04-19T03:02:00.528 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0046501549999999996 2024-04-19T03:02:00.528 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.528 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.528 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:00.528 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:00.350741+0000", 2024-04-19T03:02:00.528 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015035411 2024-04-19T03:02:00.528 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.528 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.528 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:00.528 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:00.350777+0000", 2024-04-19T03:02:00.529 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5874999999999998e-05 2024-04-19T03:02:00.529 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:00.529 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:00.529 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:00.529 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:00.350802+0000", 2024-04-19T03:02:00.529 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5040000000000001e-05 2024-04-19T03:02:00.529 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:00.529 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:00.529 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:00.529 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:00.529 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:00.529 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-19T03:02:00.531 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:00.529+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:00.531 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T03:02:00.632 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:00.629+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:00.655 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-04-19T03:02:00.655 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [ 2024-04-19T03:02:00.655 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:00.655 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:51175 5.1 5:89d0bf92:::benchmark_data_smithi096_19531_object51174:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-19T03:02:00.655 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:00.647159+0000", 2024-04-19T03:02:00.656 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0067301039999999998, 2024-04-19T03:02:00.656 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0067627090000000004, 2024-04-19T03:02:00.656 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:00.656 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:02:00.656 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:00.656 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:00.657 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:00.657 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 51175 2024-04-19T03:02:00.657 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:00.657 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:00.657 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:00.657 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:00.657 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:00.647159+0000", 2024-04-19T03:02:00.657 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:00.657 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:00.657 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:00.657 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:00.658 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:00.647159+0000", 2024-04-19T03:02:00.658 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:00.658 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:00.658 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:00.658 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:00.658 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:00.647157+0000", 2024-04-19T03:02:00.658 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:00.658 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:00.658 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:00.658 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:00.659 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:00.647192+0000", 2024-04-19T03:02:00.659 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4335999999999998e-05 2024-04-19T03:02:00.659 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:00.659 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:00.659 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:00.659 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:00.647209+0000", 2024-04-19T03:02:00.659 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6838999999999999e-05 2024-04-19T03:02:00.659 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:00.659 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:00.659 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:00.659 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:00.647219+0000", 2024-04-19T03:02:00.659 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0210000000000001e-05 2024-04-19T03:02:00.659 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:00.659 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:00.660 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:00.660 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:00.647285+0000", 2024-04-19T03:02:00.660 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5843e-05 2024-04-19T03:02:00.660 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:00.660 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:00.660 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:00.660 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:00.647479+0000", 2024-04-19T03:02:00.660 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000194403 2024-04-19T03:02:00.660 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:00.660 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:00.660 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:00.660 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:00.647668+0000", 2024-04-19T03:02:00.660 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0001894 2024-04-19T03:02:00.660 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:00.661 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:00.661 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:00.661 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:00.651941+0000", 2024-04-19T03:02:00.661 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0042730499999999996 2024-04-19T03:02:00.661 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:00.661 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:00.661 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:00.661 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:00.661 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:00.661 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4755.0:51178 5.3 e34/22 5:cba35167:::benchmark_data_smithi096_19531_object51177:head v 34'3174, mlcod=34'3171)", 2024-04-19T03:02:00.661 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:00.650288+0000", 2024-04-19T03:02:00.661 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0036009950000000001, 2024-04-19T03:02:00.661 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0037252969999999998, 2024-04-19T03:02:00.662 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:00.662 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-04-19T03:02:00.662 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:00.662 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:00.662 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:00.662 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:00.650288+0000", 2024-04-19T03:02:00.662 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:00.662 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:00.662 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:00.662 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:00.662 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:00.650288+0000", 2024-04-19T03:02:00.662 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:00.662 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:00.663 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:00.663 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:00.663 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:00.650287+0000", 2024-04-19T03:02:00.663 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:00.663 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:00.663 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:00.663 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:00.663 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:00.650355+0000", 2024-04-19T03:02:00.663 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7311999999999995e-05 2024-04-19T03:02:00.663 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:00.663 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:00.663 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:00.663 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:00.650368+0000", 2024-04-19T03:02:00.664 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2964e-05 2024-04-19T03:02:00.664 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:00.664 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:00.664 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:00.664 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:00.650373+0000", 2024-04-19T03:02:00.664 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7080000000000002e-06 2024-04-19T03:02:00.664 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:00.664 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:00.664 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:00.665 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:00.650421+0000", 2024-04-19T03:02:00.665 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8043000000000001e-05 2024-04-19T03:02:00.665 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:00.665 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:00.665 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:00.665 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:00.650447+0000", 2024-04-19T03:02:00.665 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5899000000000001e-05 2024-04-19T03:02:00.665 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:00.665 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:00.665 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:00.665 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:00.666 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:00.666 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4755.0:51179 5.5 e34/22 5:a5eb7910:::benchmark_data_smithi096_19531_object51178:head v 34'3205, mlcod=34'3201)", 2024-04-19T03:02:00.666 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:00.651316+0000", 2024-04-19T03:02:00.666 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0025726, 2024-04-19T03:02:00.666 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0028221880000000002, 2024-04-19T03:02:00.666 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:00.666 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-04-19T03:02:00.666 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:00.667 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:00.667 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:00.667 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:00.651316+0000", 2024-04-19T03:02:00.667 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:00.667 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:00.667 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:00.667 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:00.667 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:00.651316+0000", 2024-04-19T03:02:00.668 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:00.668 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:00.668 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:00.668 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:00.668 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:00.651315+0000", 2024-04-19T03:02:00.668 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:00.668 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:00.668 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:00.668 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:00.668 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:00.651363+0000", 2024-04-19T03:02:00.668 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7642000000000002e-05 2024-04-19T03:02:00.668 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:00.668 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:00.669 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:00.669 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:00.651386+0000", 2024-04-19T03:02:00.669 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2969999999999999e-05 2024-04-19T03:02:00.669 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:00.669 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:00.669 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:00.669 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:00.651396+0000", 2024-04-19T03:02:00.669 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.9259999999999995e-06 2024-04-19T03:02:00.669 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:00.669 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:00.669 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:00.669 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:00.651459+0000", 2024-04-19T03:02:00.670 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3034999999999995e-05 2024-04-19T03:02:00.670 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:00.670 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:00.670 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:00.670 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:00.651471+0000", 2024-04-19T03:02:00.670 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1885999999999999e-05 2024-04-19T03:02:00.670 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:00.670 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:00.670 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:00.670 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:00.670 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:00.671 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:51183 5.7 5:ed71514c:::benchmark_data_smithi096_19531_object51182:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-19T03:02:00.671 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:00.652073+0000", 2024-04-19T03:02:00.671 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0018162919999999999, 2024-04-19T03:02:00.671 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0021934139999999999, 2024-04-19T03:02:00.671 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:00.671 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:02:00.671 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:00.671 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:00.671 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:00.671 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 51183 2024-04-19T03:02:00.671 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:00.671 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:00.671 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:00.672 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:00.672 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:00.652073+0000", 2024-04-19T03:02:00.672 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:00.672 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:00.672 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:00.672 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:00.672 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:00.652073+0000", 2024-04-19T03:02:00.672 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:00.672 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:00.672 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:00.672 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:00.672 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:00.652071+0000", 2024-04-19T03:02:00.672 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999981 2024-04-19T03:02:00.672 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:00.673 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:00.673 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:00.673 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:00.652115+0000", 2024-04-19T03:02:00.673 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3763000000000001e-05 2024-04-19T03:02:00.673 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:00.673 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:00.673 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:00.673 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:00.652130+0000", 2024-04-19T03:02:00.673 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.482e-05 2024-04-19T03:02:00.673 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:00.673 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:00.673 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:00.673 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:00.652139+0000", 2024-04-19T03:02:00.674 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.5929999999999995e-06 2024-04-19T03:02:00.674 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:00.674 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:00.674 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:00.674 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:00.652192+0000", 2024-04-19T03:02:00.674 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2751999999999999e-05 2024-04-19T03:02:00.674 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:00.674 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:00.674 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:00.674 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:00.652379+0000", 2024-04-19T03:02:00.674 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00018691399999999999 2024-04-19T03:02:00.674 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:00.674 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:00.675 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:00.675 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:00.652520+0000", 2024-04-19T03:02:00.675 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00014096900000000001 2024-04-19T03:02:00.675 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:00.675 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:00.675 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:00.675 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:00.675 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:00.675 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:51187 5.1 5:86ee4a9d:::benchmark_data_smithi096_19531_object51186:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-19T03:02:00.675 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:00.654136+0000", 2024-04-19T03:02:00.675 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4294967295.9997535, 2024-04-19T03:02:00.675 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00021369600000000001, 2024-04-19T03:02:00.675 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:00.675 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-04-19T03:02:00.675 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:00.676 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:00.676 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:00.676 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 51187 2024-04-19T03:02:00.676 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:00.676 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:00.676 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:00.676 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:00.676 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:00.654136+0000", 2024-04-19T03:02:00.676 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:00.676 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:00.676 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:00.676 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:00.676 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:00.654136+0000", 2024-04-19T03:02:00.676 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:00.677 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:00.677 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:00.677 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:00.677 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:00.654134+0000", 2024-04-19T03:02:00.677 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999981 2024-04-19T03:02:00.677 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:00.677 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:00.677 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:00.677 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:00.654186+0000", 2024-04-19T03:02:00.677 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2082e-05 2024-04-19T03:02:00.678 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:00.678 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:00.678 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:00.678 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:00.654206+0000", 2024-04-19T03:02:00.678 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0179000000000001e-05 2024-04-19T03:02:00.678 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:00.678 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:00.678 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:00.678 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:00.654225+0000", 2024-04-19T03:02:00.678 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9273e-05 2024-04-19T03:02:00.678 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:00.679 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:00.679 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:00.679 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:00.654289+0000", 2024-04-19T03:02:00.679 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3239999999999998e-05 2024-04-19T03:02:00.679 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:00.679 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:00.679 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:00.679 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:00.679 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-04-19T03:02:00.679 INFO:teuthology.orchestra.run.smithi144.stdout: "num_ops": 5 2024-04-19T03:02:00.679 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-04-19T03:02:00.680 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T03:02:00.733 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-04-19T03:02:00.730+0000 7f35986ab700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18243) UID: 0 2024-04-19T03:02:00.811 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-04-19T03:02:00.811 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2024-04-19T03:02:00.811 INFO:teuthology.orchestra.run.smithi144.stdout: "complaint_time": 30, 2024-04-19T03:02:00.811 INFO:teuthology.orchestra.run.smithi144.stdout: "num_blocked_ops": 0 2024-04-19T03:02:00.811 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-04-19T03:02:00.822 INFO:tasks.radosbench.radosbench.0.smithi096.stdout: 23 16 51503 51487 139.895 116.25 0.00669838 0.00714217 2024-04-19T03:02:00.823 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T03:02:00.867 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:00.865+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:00.936 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:00.933+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:00.946 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-04-19T03:02:00.946 INFO:teuthology.orchestra.run.smithi144.stdout: "size": 20, 2024-04-19T03:02:00.946 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 600, 2024-04-19T03:02:00.947 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [ 2024-04-19T03:02:00.947 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:00.947 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4159.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-19T03:02:00.947 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:01:08.150915+0000", 2024-04-19T03:02:00.947 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 52.792527325000002, 2024-04-19T03:02:00.947 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.020502679999999999, 2024-04-19T03:02:00.947 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:00.947 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:00.947 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:00.947 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4159", 2024-04-19T03:02:00.948 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3589238956", 2024-04-19T03:02:00.948 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 140 2024-04-19T03:02:00.948 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:00.948 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:00.948 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:00.948 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:00.948 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.150915+0000", 2024-04-19T03:02:00.948 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:00.948 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:00.948 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:00.948 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:00.948 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.150915+0000", 2024-04-19T03:02:00.949 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:00.949 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:00.949 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:00.949 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:00.949 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.150914+0000", 2024-04-19T03:02:00.949 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:00.949 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:00.949 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:00.949 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:00.949 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.151066+0000", 2024-04-19T03:02:00.949 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00015186400000000001 2024-04-19T03:02:00.949 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:00.949 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:00.949 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:00.949 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.151120+0000", 2024-04-19T03:02:00.950 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4042999999999997e-05 2024-04-19T03:02:00.950 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:00.950 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:00.950 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:00.950 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.151155+0000", 2024-04-19T03:02:00.950 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4941999999999999e-05 2024-04-19T03:02:00.950 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:00.950 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:00.950 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:00.950 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.168222+0000", 2024-04-19T03:02:00.950 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.017066939999999999 2024-04-19T03:02:00.950 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:00.950 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:00.951 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:00.951 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.168305+0000", 2024-04-19T03:02:00.951 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.3642999999999999e-05 2024-04-19T03:02:00.951 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:00.951 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:00.951 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:02:00.951 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.168385+0000", 2024-04-19T03:02:00.951 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9647999999999994e-05 2024-04-19T03:02:00.951 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:00.951 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:00.951 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:00.951 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.170514+0000", 2024-04-19T03:02:00.951 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0021286370000000001 2024-04-19T03:02:00.951 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:00.952 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:00.952 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:00.952 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.171252+0000", 2024-04-19T03:02:00.952 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00073828499999999998 2024-04-19T03:02:00.952 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:00.952 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:00.952 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:00.952 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.171353+0000", 2024-04-19T03:02:00.952 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000100839 2024-04-19T03:02:00.952 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:00.952 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:00.952 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:00.952 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.171418+0000", 2024-04-19T03:02:00.952 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5048999999999993e-05 2024-04-19T03:02:00.953 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:00.953 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:00.953 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:00.953 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:00.953 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:00.953 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4159.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-19T03:02:00.953 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:01:08.151173+0000", 2024-04-19T03:02:00.953 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 52.792269803000003, 2024-04-19T03:02:00.953 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.023083023000000001, 2024-04-19T03:02:00.953 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:00.953 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:00.953 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:00.953 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4159", 2024-04-19T03:02:00.953 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3589238956", 2024-04-19T03:02:00.954 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 141 2024-04-19T03:02:00.954 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:00.954 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:00.954 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:00.954 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:00.954 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.151173+0000", 2024-04-19T03:02:00.954 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:00.954 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:00.954 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:00.954 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:00.954 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.151173+0000", 2024-04-19T03:02:00.954 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:00.954 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:00.955 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:00.955 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:00.955 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.151171+0000", 2024-04-19T03:02:00.955 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:00.955 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:00.955 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:00.955 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:00.955 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.151182+0000", 2024-04-19T03:02:00.955 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0730000000000001e-05 2024-04-19T03:02:00.955 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:00.955 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:00.955 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:00.955 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.151203+0000", 2024-04-19T03:02:00.955 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0387e-05 2024-04-19T03:02:00.956 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:00.956 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:00.956 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:00.956 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.151225+0000", 2024-04-19T03:02:00.956 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2643e-05 2024-04-19T03:02:00.956 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:00.956 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:00.956 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:00.956 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.169207+0000", 2024-04-19T03:02:00.956 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.017981561 2024-04-19T03:02:00.956 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:00.956 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:00.956 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:00.956 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.169386+0000", 2024-04-19T03:02:00.956 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000178758 2024-04-19T03:02:00.957 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:00.957 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:00.957 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:02:00.957 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.169546+0000", 2024-04-19T03:02:00.957 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000160781 2024-04-19T03:02:00.957 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:00.957 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:00.957 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:00.957 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.171444+0000", 2024-04-19T03:02:00.957 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0018980309999999999 2024-04-19T03:02:00.957 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:00.957 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:00.957 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:00.957 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.174165+0000", 2024-04-19T03:02:00.958 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0027204920000000001 2024-04-19T03:02:00.958 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:00.958 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:00.958 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:00.958 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.174228+0000", 2024-04-19T03:02:00.958 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2774000000000006e-05 2024-04-19T03:02:00.958 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:00.958 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:00.958 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:00.958 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.174256+0000", 2024-04-19T03:02:00.958 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.8045999999999999e-05 2024-04-19T03:02:00.958 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:00.958 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:00.958 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:00.958 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:00.959 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:00.959 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4159.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-19T03:02:00.959 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:01:08.347807+0000", 2024-04-19T03:02:00.959 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 52.595635795, 2024-04-19T03:02:00.959 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.021589991999999999, 2024-04-19T03:02:00.959 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:00.959 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:00.959 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:00.959 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4159", 2024-04-19T03:02:00.959 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3589238956", 2024-04-19T03:02:00.959 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 165 2024-04-19T03:02:00.959 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:00.959 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:00.959 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:00.960 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:00.960 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.347807+0000", 2024-04-19T03:02:00.960 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:00.960 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:00.960 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:00.960 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:00.960 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.347807+0000", 2024-04-19T03:02:00.960 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:00.960 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:00.960 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:00.960 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:00.960 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.347806+0000", 2024-04-19T03:02:00.960 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:00.960 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:00.961 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:00.961 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:00.961 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.347812+0000", 2024-04-19T03:02:00.961 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.066e-06 2024-04-19T03:02:00.961 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:00.961 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:00.961 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:00.961 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.347818+0000", 2024-04-19T03:02:00.961 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5550000000000002e-06 2024-04-19T03:02:00.961 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:00.961 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:00.961 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:00.961 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.347822+0000", 2024-04-19T03:02:00.962 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.561e-06 2024-04-19T03:02:00.962 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:00.962 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:00.962 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:00.962 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.365703+0000", 2024-04-19T03:02:00.962 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.017880566000000001 2024-04-19T03:02:00.962 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:00.962 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:00.962 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:00.962 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.365805+0000", 2024-04-19T03:02:00.962 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00010213900000000001 2024-04-19T03:02:00.962 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:00.962 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:00.962 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:02:00.963 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.365928+0000", 2024-04-19T03:02:00.963 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00012337900000000001 2024-04-19T03:02:00.963 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:00.963 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:00.963 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:00.963 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.367353+0000", 2024-04-19T03:02:00.963 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001424397 2024-04-19T03:02:00.963 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:00.963 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:00.963 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:00.963 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.369260+0000", 2024-04-19T03:02:00.963 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0019069130000000001 2024-04-19T03:02:00.963 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:00.964 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:00.964 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:00.964 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.369342+0000", 2024-04-19T03:02:00.964 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2423999999999996e-05 2024-04-19T03:02:00.964 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:00.964 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:00.964 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:00.964 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.369397+0000", 2024-04-19T03:02:00.964 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4481999999999998e-05 2024-04-19T03:02:00.964 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:00.964 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:00.964 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:00.964 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:00.964 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:00.965 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4159.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-19T03:02:00.965 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:01:08.539135+0000", 2024-04-19T03:02:00.965 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 52.404307537000001, 2024-04-19T03:02:00.965 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.021590602, 2024-04-19T03:02:00.965 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:00.965 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:00.965 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:00.965 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4159", 2024-04-19T03:02:00.965 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3589238956", 2024-04-19T03:02:00.965 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 188 2024-04-19T03:02:00.965 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:00.965 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:00.965 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:00.965 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:00.966 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.539135+0000", 2024-04-19T03:02:00.966 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:00.966 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:00.966 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:00.966 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:00.966 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.539135+0000", 2024-04-19T03:02:00.966 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:00.966 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:00.966 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:00.966 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:00.966 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.539134+0000", 2024-04-19T03:02:00.966 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:00.966 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:00.966 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:00.967 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:00.967 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.539228+0000", 2024-04-19T03:02:00.967 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.3771999999999996e-05 2024-04-19T03:02:00.967 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:00.967 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:00.967 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:00.967 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.539243+0000", 2024-04-19T03:02:00.967 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4707e-05 2024-04-19T03:02:00.967 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:00.967 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:00.967 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:00.967 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.539250+0000", 2024-04-19T03:02:00.967 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7190000000000001e-06 2024-04-19T03:02:00.967 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:00.968 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:00.968 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:00.968 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.553787+0000", 2024-04-19T03:02:00.968 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.014536248999999999 2024-04-19T03:02:00.968 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:00.968 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:00.968 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:00.968 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.553857+0000", 2024-04-19T03:02:00.968 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0675999999999999e-05 2024-04-19T03:02:00.968 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:00.968 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:00.968 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:02:00.968 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.553953+0000", 2024-04-19T03:02:00.968 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.5420999999999993e-05 2024-04-19T03:02:00.968 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:00.969 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:00.969 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:00.969 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.555569+0000", 2024-04-19T03:02:00.969 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001616625 2024-04-19T03:02:00.969 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:00.969 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:00.969 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:00.969 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.560644+0000", 2024-04-19T03:02:00.969 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0050749660000000002 2024-04-19T03:02:00.969 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:00.969 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:00.969 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:00.969 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.560690+0000", 2024-04-19T03:02:00.969 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6041000000000002e-05 2024-04-19T03:02:00.970 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:00.970 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:00.970 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:00.970 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.560726+0000", 2024-04-19T03:02:00.970 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5188999999999998e-05 2024-04-19T03:02:00.970 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:00.970 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:00.970 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:00.970 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:00.970 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:00.970 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4159.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-19T03:02:00.970 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:01:08.539259+0000", 2024-04-19T03:02:00.970 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 52.404183068999998, 2024-04-19T03:02:00.971 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.021552071999999999, 2024-04-19T03:02:00.971 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:00.971 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:00.971 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:00.971 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4159", 2024-04-19T03:02:00.971 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3589238956", 2024-04-19T03:02:00.971 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 189 2024-04-19T03:02:00.971 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:00.971 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:00.971 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:00.971 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:00.971 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.539259+0000", 2024-04-19T03:02:00.971 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:00.971 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:00.972 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:00.972 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:00.972 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.539259+0000", 2024-04-19T03:02:00.972 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:00.972 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:00.972 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:00.972 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:00.972 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.539259+0000", 2024-04-19T03:02:00.972 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:00.972 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:00.972 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:00.972 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:00.972 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.539268+0000", 2024-04-19T03:02:00.972 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.5359999999999998e-06 2024-04-19T03:02:00.973 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:00.973 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:00.973 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:00.973 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.539291+0000", 2024-04-19T03:02:00.973 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2687000000000001e-05 2024-04-19T03:02:00.973 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:00.973 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:00.973 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:00.973 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.539298+0000", 2024-04-19T03:02:00.973 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.883e-06 2024-04-19T03:02:00.973 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:00.973 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:00.973 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:00.974 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.554957+0000", 2024-04-19T03:02:00.974 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.015659019999999999 2024-04-19T03:02:00.974 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:00.974 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:00.974 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:00.974 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.555010+0000", 2024-04-19T03:02:00.974 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2985999999999997e-05 2024-04-19T03:02:00.974 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:00.974 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:00.974 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:02:00.974 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.555094+0000", 2024-04-19T03:02:00.974 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4530000000000006e-05 2024-04-19T03:02:00.975 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:00.975 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:00.975 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:00.975 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.556093+0000", 2024-04-19T03:02:00.975 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00099903300000000008 2024-04-19T03:02:00.975 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:00.975 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:00.975 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:00.975 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.560759+0000", 2024-04-19T03:02:00.975 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0046654369999999997 2024-04-19T03:02:00.975 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:00.975 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:00.975 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:00.976 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.560789+0000", 2024-04-19T03:02:00.976 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0638e-05 2024-04-19T03:02:00.976 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:00.976 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:00.976 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:00.976 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.560811+0000", 2024-04-19T03:02:00.976 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2167999999999998e-05 2024-04-19T03:02:00.976 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:00.976 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:00.976 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:00.976 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:00.976 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:00.976 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:8 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:02:00.976 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:01:14.998165+0000", 2024-04-19T03:02:00.977 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 45.945277388000001, 2024-04-19T03:02:00.977 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.024541001, 2024-04-19T03:02:00.977 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:00.977 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:00.977 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:00.977 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:00.977 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:00.977 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998165+0000", 2024-04-19T03:02:00.977 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:00.977 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:00.977 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:00.977 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:00.977 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998165+0000", 2024-04-19T03:02:00.978 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:00.978 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:00.978 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:00.978 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:00.978 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998164+0000", 2024-04-19T03:02:00.978 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:00.978 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:00.978 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:00.978 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:00.978 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998170+0000", 2024-04-19T03:02:00.978 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2939999999999996e-06 2024-04-19T03:02:00.978 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:00.978 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:00.979 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:00.979 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998179+0000", 2024-04-19T03:02:00.979 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.5540000000000003e-06 2024-04-19T03:02:00.979 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:00.979 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:00.979 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:00.979 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998188+0000", 2024-04-19T03:02:00.979 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2959999999999999e-06 2024-04-19T03:02:00.979 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:00.979 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:00.979 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:00.979 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998332+0000", 2024-04-19T03:02:00.979 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00014474 2024-04-19T03:02:00.979 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:00.980 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:00.980 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:02:00.980 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998337+0000", 2024-04-19T03:02:00.980 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6909999999999996e-06 2024-04-19T03:02:00.980 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:00.980 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:00.980 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:00.980 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.010222+0000", 2024-04-19T03:02:00.980 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011885178 2024-04-19T03:02:00.980 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:00.980 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:00.980 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:00.980 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.010342+0000", 2024-04-19T03:02:00.980 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00011991500000000001 2024-04-19T03:02:00.980 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:00.981 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:00.981 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:02:00.981 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.010506+0000", 2024-04-19T03:02:00.981 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00016429699999999999 2024-04-19T03:02:00.981 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:00.981 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:00.981 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:00.981 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.014525+0000", 2024-04-19T03:02:00.981 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0040189839999999998 2024-04-19T03:02:00.981 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:00.981 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:00.981 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:00.981 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.022600+0000", 2024-04-19T03:02:00.981 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0080741990000000007 2024-04-19T03:02:00.982 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:00.982 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:00.982 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:00.982 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.022670+0000", 2024-04-19T03:02:00.982 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0743999999999999e-05 2024-04-19T03:02:00.982 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:00.982 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:00.982 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:00.982 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.022706+0000", 2024-04-19T03:02:00.982 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5782999999999999e-05 2024-04-19T03:02:00.982 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:00.982 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:00.982 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:00.983 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:00.983 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:00.983 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:27 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:02:00.983 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:01:14.998436+0000", 2024-04-19T03:02:00.983 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 45.945006734000003, 2024-04-19T03:02:00.983 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.024406325999999999, 2024-04-19T03:02:00.983 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:00.983 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:00.983 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:00.983 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:00.983 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:00.983 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998436+0000", 2024-04-19T03:02:00.983 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:00.984 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:00.984 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:00.984 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:00.984 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998436+0000", 2024-04-19T03:02:00.984 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:00.984 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:00.984 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:00.984 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:00.984 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998435+0000", 2024-04-19T03:02:00.984 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:00.984 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:00.984 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:00.984 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:00.984 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998445+0000", 2024-04-19T03:02:00.985 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0349e-05 2024-04-19T03:02:00.985 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:00.985 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:00.985 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:00.985 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998453+0000", 2024-04-19T03:02:00.985 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0399999999999993e-06 2024-04-19T03:02:00.985 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:00.985 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:00.985 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:00.985 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998461+0000", 2024-04-19T03:02:00.985 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9780000000000005e-06 2024-04-19T03:02:00.985 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:00.985 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:00.986 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:00.986 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998515+0000", 2024-04-19T03:02:00.986 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3097999999999999e-05 2024-04-19T03:02:00.986 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:00.986 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:00.986 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:02:00.986 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998520+0000", 2024-04-19T03:02:00.986 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9220000000000002e-06 2024-04-19T03:02:00.986 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:00.986 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:00.986 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:00.986 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.011258+0000", 2024-04-19T03:02:00.986 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.012737735 2024-04-19T03:02:00.986 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:00.987 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:00.987 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:00.987 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.011566+0000", 2024-04-19T03:02:00.987 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00030826200000000001 2024-04-19T03:02:00.987 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:00.987 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:00.987 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:02:00.987 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.011996+0000", 2024-04-19T03:02:00.987 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00042912000000000001 2024-04-19T03:02:00.987 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:00.987 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:00.987 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:00.987 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.014533+0000", 2024-04-19T03:02:00.987 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.002537423 2024-04-19T03:02:00.988 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:00.988 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:00.988 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:00.988 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.022756+0000", 2024-04-19T03:02:00.988 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0082231530000000004 2024-04-19T03:02:00.988 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:00.988 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:00.988 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:00.988 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.022807+0000", 2024-04-19T03:02:00.988 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0852e-05 2024-04-19T03:02:00.988 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:00.988 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:00.988 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:00.989 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.022842+0000", 2024-04-19T03:02:00.989 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5058000000000002e-05 2024-04-19T03:02:00.989 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:00.989 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:00.989 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:00.989 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:00.989 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:00.989 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:28 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:02:00.989 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:01:14.998476+0000", 2024-04-19T03:02:00.989 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 45.944966811999997, 2024-04-19T03:02:00.989 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.024656784000000001, 2024-04-19T03:02:00.989 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:00.989 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:00.989 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:00.990 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:00.990 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:00.990 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998476+0000", 2024-04-19T03:02:00.990 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:00.990 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:00.990 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:00.990 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:00.990 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998476+0000", 2024-04-19T03:02:00.990 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:00.990 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:00.990 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:00.990 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:00.990 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998475+0000", 2024-04-19T03:02:00.991 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:00.991 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:00.991 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:00.991 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:00.991 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998484+0000", 2024-04-19T03:02:00.991 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.7770000000000008e-06 2024-04-19T03:02:00.991 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:00.991 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:00.991 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:00.991 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998495+0000", 2024-04-19T03:02:00.991 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0726e-05 2024-04-19T03:02:00.991 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:00.991 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:00.993 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:00.993 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998503+0000", 2024-04-19T03:02:00.994 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.8780000000000004e-06 2024-04-19T03:02:00.994 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:00.994 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:00.994 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:00.994 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998579+0000", 2024-04-19T03:02:00.994 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5160999999999994e-05 2024-04-19T03:02:00.994 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:00.994 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:00.994 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:02:00.994 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998586+0000", 2024-04-19T03:02:00.994 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8520000000000004e-06 2024-04-19T03:02:00.994 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:00.994 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:00.994 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:00.995 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.012423+0000", 2024-04-19T03:02:00.995 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.013836667 2024-04-19T03:02:00.995 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:00.995 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:00.995 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:00.995 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.012532+0000", 2024-04-19T03:02:00.995 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000108565 2024-04-19T03:02:00.995 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:00.995 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:00.995 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:02:00.995 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.012655+0000", 2024-04-19T03:02:00.995 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00012344600000000001 2024-04-19T03:02:00.995 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:00.995 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:00.996 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:00.996 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.015680+0000", 2024-04-19T03:02:00.996 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0030246470000000001 2024-04-19T03:02:00.996 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:00.996 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:00.996 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:00.996 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.023091+0000", 2024-04-19T03:02:00.996 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0074116030000000001 2024-04-19T03:02:00.996 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:00.996 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:00.996 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:00.996 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.023115+0000", 2024-04-19T03:02:00.996 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.3091999999999998e-05 2024-04-19T03:02:00.996 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:00.996 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:00.997 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:00.997 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.023132+0000", 2024-04-19T03:02:00.997 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7901999999999999e-05 2024-04-19T03:02:00.997 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:00.997 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:00.997 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:00.997 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:00.997 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:00.997 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:29 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:02:00.997 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:01:14.998527+0000", 2024-04-19T03:02:00.997 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 45.944915272000003, 2024-04-19T03:02:00.997 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.024738599999999999, 2024-04-19T03:02:00.997 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:00.997 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:00.998 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:00.998 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:00.998 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:00.998 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998527+0000", 2024-04-19T03:02:00.998 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:00.998 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:00.998 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:00.998 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:00.998 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998527+0000", 2024-04-19T03:02:00.998 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:00.998 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:00.998 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:00.998 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:00.999 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998527+0000", 2024-04-19T03:02:00.999 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:00.999 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:00.999 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:00.999 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:00.999 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998531+0000", 2024-04-19T03:02:00.999 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9450000000000001e-06 2024-04-19T03:02:00.999 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:00.999 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:00.999 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:00.999 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998541+0000", 2024-04-19T03:02:00.999 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.4320000000000005e-06 2024-04-19T03:02:00.999 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:00.999 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:00.999 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:01.000 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998548+0000", 2024-04-19T03:02:01.000 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.221e-06 2024-04-19T03:02:01.000 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:01.000 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:01.000 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:01.000 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998620+0000", 2024-04-19T03:02:01.000 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.1676999999999998e-05 2024-04-19T03:02:01.000 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:01.000 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:01.000 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:02:01.000 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998624+0000", 2024-04-19T03:02:01.000 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4850000000000003e-06 2024-04-19T03:02:01.000 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:01.000 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:01.001 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:01.001 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.013261+0000", 2024-04-19T03:02:01.001 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.014636451999999999 2024-04-19T03:02:01.001 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:01.001 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:01.001 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:01.001 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.013364+0000", 2024-04-19T03:02:01.001 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000102885 2024-04-19T03:02:01.001 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:01.001 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:01.001 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:02:01.001 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.013481+0000", 2024-04-19T03:02:01.001 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00011783299999999999 2024-04-19T03:02:01.001 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:01.001 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:01.002 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:01.002 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.016265+0000", 2024-04-19T03:02:01.002 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0027834539999999999 2024-04-19T03:02:01.002 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:01.002 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:01.002 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:01.002 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.023180+0000", 2024-04-19T03:02:01.002 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0069149399999999996 2024-04-19T03:02:01.002 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:01.002 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:01.002 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:01.002 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.023230+0000", 2024-04-19T03:02:01.002 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0220999999999999e-05 2024-04-19T03:02:01.002 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:01.003 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:01.003 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:01.003 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.023266+0000", 2024-04-19T03:02:01.003 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5703e-05 2024-04-19T03:02:01.003 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:01.003 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:01.003 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:01.003 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:01.003 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:01.003 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:30 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:02:01.003 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:01:14.998577+0000", 2024-04-19T03:02:01.003 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 45.944865165000003, 2024-04-19T03:02:01.003 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.024774022999999999, 2024-04-19T03:02:01.003 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:01.004 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:01.004 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:01.004 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:01.004 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:01.004 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998577+0000", 2024-04-19T03:02:01.004 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:01.004 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:01.004 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:01.004 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:01.004 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998577+0000", 2024-04-19T03:02:01.004 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:01.004 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:01.004 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:01.004 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:01.005 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998576+0000", 2024-04-19T03:02:01.005 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:01.005 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:01.005 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:01.005 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:01.005 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998583+0000", 2024-04-19T03:02:01.005 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8850000000000001e-06 2024-04-19T03:02:01.005 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:01.005 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:01.005 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:01.005 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998597+0000", 2024-04-19T03:02:01.005 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.362e-05 2024-04-19T03:02:01.005 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:01.005 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:01.006 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:01.006 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998607+0000", 2024-04-19T03:02:01.006 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0389e-05 2024-04-19T03:02:01.006 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:01.006 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:01.006 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:01.006 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998713+0000", 2024-04-19T03:02:01.006 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000105338 2024-04-19T03:02:01.006 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:01.006 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:01.006 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:02:01.006 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998720+0000", 2024-04-19T03:02:01.006 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2370000000000003e-06 2024-04-19T03:02:01.006 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:01.007 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:01.007 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:01.007 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.014014+0000", 2024-04-19T03:02:01.007 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.015294116999999999 2024-04-19T03:02:01.007 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:01.007 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:01.007 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:01.007 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.014091+0000", 2024-04-19T03:02:01.007 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7148000000000001e-05 2024-04-19T03:02:01.007 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:01.007 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:01.007 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:02:01.007 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.014271+0000", 2024-04-19T03:02:01.007 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00017962699999999999 2024-04-19T03:02:01.008 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:01.008 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:01.008 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:01.008 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.018024+0000", 2024-04-19T03:02:01.008 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0037529809999999999 2024-04-19T03:02:01.008 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:01.008 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:01.008 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:01.008 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.023303+0000", 2024-04-19T03:02:01.008 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0052793099999999997 2024-04-19T03:02:01.008 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:01.008 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:01.008 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:01.008 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.023331+0000", 2024-04-19T03:02:01.009 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.8013000000000001e-05 2024-04-19T03:02:01.009 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:01.009 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:01.009 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:01.009 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.023351+0000", 2024-04-19T03:02:01.009 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0225999999999999e-05 2024-04-19T03:02:01.009 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:01.009 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:01.009 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:01.009 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:01.009 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:01.009 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:33 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:02:01.009 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:01:14.998625+0000", 2024-04-19T03:02:01.009 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 45.944817768, 2024-04-19T03:02:01.010 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.024007338999999999, 2024-04-19T03:02:01.010 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:01.010 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:01.010 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:01.010 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:01.010 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:01.010 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998625+0000", 2024-04-19T03:02:01.010 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:01.010 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:01.010 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:01.010 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:01.010 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998625+0000", 2024-04-19T03:02:01.010 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:01.010 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:01.011 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:01.011 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:01.011 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998623+0000", 2024-04-19T03:02:01.011 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:01.011 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:01.011 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:01.011 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:01.011 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998632+0000", 2024-04-19T03:02:01.011 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9279999999999999e-06 2024-04-19T03:02:01.011 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:01.011 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:01.011 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:01.011 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998642+0000", 2024-04-19T03:02:01.012 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0063e-05 2024-04-19T03:02:01.012 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:01.012 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:01.012 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:01.012 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998649+0000", 2024-04-19T03:02:01.012 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4799999999999998e-06 2024-04-19T03:02:01.012 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:01.012 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:01.012 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:01.012 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998730+0000", 2024-04-19T03:02:01.012 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.1514999999999995e-05 2024-04-19T03:02:01.012 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:01.012 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:01.012 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:02:01.013 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998741+0000", 2024-04-19T03:02:01.013 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1029999999999999e-05 2024-04-19T03:02:01.013 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:01.013 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:01.013 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:01.013 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.010202+0000", 2024-04-19T03:02:01.013 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011460529000000001 2024-04-19T03:02:01.013 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:01.013 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:01.013 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:01.013 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.010292+0000", 2024-04-19T03:02:01.013 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.0382000000000003e-05 2024-04-19T03:02:01.013 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:01.013 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:01.013 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:02:01.014 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.010391+0000", 2024-04-19T03:02:01.014 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.8491000000000003e-05 2024-04-19T03:02:01.014 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:01.014 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:01.014 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:01.014 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.013800+0000", 2024-04-19T03:02:01.014 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0034090219999999998 2024-04-19T03:02:01.014 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:01.014 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:01.014 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:01.014 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.022564+0000", 2024-04-19T03:02:01.014 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0087639950000000001 2024-04-19T03:02:01.014 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:01.014 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:01.015 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:01.015 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.022601+0000", 2024-04-19T03:02:01.015 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7363999999999997e-05 2024-04-19T03:02:01.015 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:01.015 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:01.015 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:01.015 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.022632+0000", 2024-04-19T03:02:01.015 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0917000000000002e-05 2024-04-19T03:02:01.015 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:01.015 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:01.015 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:01.015 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:01.015 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:01.016 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:37 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:02:01.016 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:01:14.998739+0000", 2024-04-19T03:02:01.016 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 45.944703826999998, 2024-04-19T03:02:01.016 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.020573188999999999, 2024-04-19T03:02:01.016 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:01.016 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:01.016 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:01.016 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:01.016 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:01.016 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998739+0000", 2024-04-19T03:02:01.016 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:01.016 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:01.016 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:01.016 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:01.017 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998739+0000", 2024-04-19T03:02:01.017 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:01.017 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:01.017 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:01.017 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:01.017 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998738+0000", 2024-04-19T03:02:01.017 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:01.017 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:01.017 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:01.017 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:01.017 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998755+0000", 2024-04-19T03:02:01.017 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7105999999999999e-05 2024-04-19T03:02:01.017 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:01.018 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:01.018 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:01.018 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998764+0000", 2024-04-19T03:02:01.018 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.1279999999999997e-06 2024-04-19T03:02:01.018 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:01.018 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:01.018 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:01.018 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998771+0000", 2024-04-19T03:02:01.018 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6939999999999998e-06 2024-04-19T03:02:01.018 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:01.018 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:01.018 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:01.018 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998843+0000", 2024-04-19T03:02:01.018 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.1695999999999999e-05 2024-04-19T03:02:01.019 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:01.019 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:01.019 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op must wait for map", 2024-04-19T03:02:01.019 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998852+0000", 2024-04-19T03:02:01.019 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.0799999999999995e-06 2024-04-19T03:02:01.019 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:01.019 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:01.019 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:01.019 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.006513+0000", 2024-04-19T03:02:01.019 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0076610020000000001 2024-04-19T03:02:01.019 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:01.019 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:01.019 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:01.019 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.006670+0000", 2024-04-19T03:02:01.020 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000157529 2024-04-19T03:02:01.020 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:01.020 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:01.020 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:01.020 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.006863+0000", 2024-04-19T03:02:01.020 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000192597 2024-04-19T03:02:01.020 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:01.020 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:01.020 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:01.020 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.012404+0000", 2024-04-19T03:02:01.020 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0055415220000000001 2024-04-19T03:02:01.020 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:01.020 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:01.020 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:01.021 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.019171+0000", 2024-04-19T03:02:01.021 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0067666829999999999 2024-04-19T03:02:01.021 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:01.021 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:01.021 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:01.021 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.019228+0000", 2024-04-19T03:02:01.021 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7145999999999998e-05 2024-04-19T03:02:01.021 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:01.021 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:01.021 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:01.021 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.019312+0000", 2024-04-19T03:02:01.021 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.3591999999999995e-05 2024-04-19T03:02:01.021 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:01.021 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:01.022 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:01.022 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:01.022 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:01.022 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:02:01.022 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:01:14.998792+0000", 2024-04-19T03:02:01.022 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 45.944650899000003, 2024-04-19T03:02:01.022 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.023951813999999998, 2024-04-19T03:02:01.022 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:01.022 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:01.022 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:01.022 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:01.022 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:01.022 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998792+0000", 2024-04-19T03:02:01.022 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:01.023 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:01.023 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:01.023 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:01.023 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998792+0000", 2024-04-19T03:02:01.023 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:01.023 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:01.023 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:01.023 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:01.023 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998791+0000", 2024-04-19T03:02:01.023 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:01.023 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:01.023 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:01.023 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:01.023 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998796+0000", 2024-04-19T03:02:01.023 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9649999999999999e-06 2024-04-19T03:02:01.024 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:01.024 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:01.024 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:01.024 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998809+0000", 2024-04-19T03:02:01.024 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3254e-05 2024-04-19T03:02:01.024 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:01.024 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:01.024 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:01.024 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998816+0000", 2024-04-19T03:02:01.024 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.472e-06 2024-04-19T03:02:01.024 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:01.024 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:01.024 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:01.024 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998899+0000", 2024-04-19T03:02:01.025 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.3676000000000003e-05 2024-04-19T03:02:01.025 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:01.025 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:01.025 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:02:01.025 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998908+0000", 2024-04-19T03:02:01.025 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6940000000000001e-06 2024-04-19T03:02:01.025 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:01.025 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:01.025 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:01.025 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.010818+0000", 2024-04-19T03:02:01.025 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011910482999999999 2024-04-19T03:02:01.025 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:01.025 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:01.025 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:01.026 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.010959+0000", 2024-04-19T03:02:01.026 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00014018900000000001 2024-04-19T03:02:01.026 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:01.026 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:01.026 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:02:01.026 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.011185+0000", 2024-04-19T03:02:01.026 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000226085 2024-04-19T03:02:01.026 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:01.026 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:01.026 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:01.026 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.014479+0000", 2024-04-19T03:02:01.026 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0032938260000000001 2024-04-19T03:02:01.026 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:01.027 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:01.027 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:01.027 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.022697+0000", 2024-04-19T03:02:01.027 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0082186029999999997 2024-04-19T03:02:01.027 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:01.027 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:01.027 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:01.027 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.022724+0000", 2024-04-19T03:02:01.027 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.6503999999999999e-05 2024-04-19T03:02:01.027 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:01.027 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:01.027 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:01.027 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.022743+0000", 2024-04-19T03:02:01.027 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9663000000000001e-05 2024-04-19T03:02:01.028 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:01.028 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:01.028 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:01.028 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:01.028 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:01.028 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:02:01.028 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:01:14.998870+0000", 2024-04-19T03:02:01.028 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 45.944572698000002, 2024-04-19T03:02:01.028 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.024280578000000001, 2024-04-19T03:02:01.028 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:01.028 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:01.028 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:01.028 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:01.028 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:01.029 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998870+0000", 2024-04-19T03:02:01.029 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:01.029 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:01.029 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:01.029 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:01.029 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998870+0000", 2024-04-19T03:02:01.029 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:01.029 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:01.029 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:01.029 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:01.029 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998869+0000", 2024-04-19T03:02:01.029 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:01.029 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:01.029 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:01.029 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:01.030 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998879+0000", 2024-04-19T03:02:01.030 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.8689999999999999e-06 2024-04-19T03:02:01.030 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:01.030 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:01.030 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:01.030 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998893+0000", 2024-04-19T03:02:01.030 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4436999999999999e-05 2024-04-19T03:02:01.030 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:01.030 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:01.030 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:01.030 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998904+0000", 2024-04-19T03:02:01.030 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0657e-05 2024-04-19T03:02:01.030 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:01.031 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:01.031 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:01.031 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998972+0000", 2024-04-19T03:02:01.031 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8121999999999996e-05 2024-04-19T03:02:01.031 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:01.031 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:01.031 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:02:01.031 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998980+0000", 2024-04-19T03:02:01.031 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7170000000000008e-06 2024-04-19T03:02:01.031 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:01.031 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:01.031 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:01.031 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.011666+0000", 2024-04-19T03:02:01.031 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.012686507 2024-04-19T03:02:01.032 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:01.032 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:01.032 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:01.032 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.012403+0000", 2024-04-19T03:02:01.032 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00073661899999999999 2024-04-19T03:02:01.032 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:01.032 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:01.032 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:02:01.032 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.012788+0000", 2024-04-19T03:02:01.032 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00038495800000000002 2024-04-19T03:02:01.032 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:01.032 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:01.032 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:01.032 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.015713+0000", 2024-04-19T03:02:01.032 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0029255879999999998 2024-04-19T03:02:01.033 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:01.033 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:01.033 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:01.033 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.023066+0000", 2024-04-19T03:02:01.033 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.007352903 2024-04-19T03:02:01.033 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:01.033 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:01.033 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:01.033 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.023113+0000", 2024-04-19T03:02:01.033 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7163000000000002e-05 2024-04-19T03:02:01.033 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:01.033 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:01.033 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:01.034 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.023150+0000", 2024-04-19T03:02:01.034 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6881000000000001e-05 2024-04-19T03:02:01.034 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:01.034 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:01.034 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:01.034 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:01.034 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:01.034 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:16 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:02:01.034 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:01:14.998920+0000", 2024-04-19T03:02:01.034 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 45.944522653, 2024-04-19T03:02:01.034 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.020562114999999999, 2024-04-19T03:02:01.034 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:01.034 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:01.034 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:01.035 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:01.035 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:01.035 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998920+0000", 2024-04-19T03:02:01.035 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:01.035 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:01.035 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:01.035 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:01.035 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998920+0000", 2024-04-19T03:02:01.035 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:01.035 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:01.035 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:01.035 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:01.035 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998919+0000", 2024-04-19T03:02:01.035 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:01.036 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:01.036 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:01.036 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:01.036 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998925+0000", 2024-04-19T03:02:01.036 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5370000000000003e-06 2024-04-19T03:02:01.036 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:01.036 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:01.036 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:01.036 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998943+0000", 2024-04-19T03:02:01.036 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7549000000000001e-05 2024-04-19T03:02:01.036 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:01.036 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:01.036 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:01.037 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998955+0000", 2024-04-19T03:02:01.037 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1977000000000001e-05 2024-04-19T03:02:01.037 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:01.037 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:01.037 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:01.037 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.999009+0000", 2024-04-19T03:02:01.037 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3667e-05 2024-04-19T03:02:01.037 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:01.037 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:01.037 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:02:01.037 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.999013+0000", 2024-04-19T03:02:01.037 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8829999999999997e-06 2024-04-19T03:02:01.037 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:01.037 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:01.038 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:01.038 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.007476+0000", 2024-04-19T03:02:01.038 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0084621569999999997 2024-04-19T03:02:01.038 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:01.038 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:01.038 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:01.038 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.007626+0000", 2024-04-19T03:02:01.038 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00015079199999999999 2024-04-19T03:02:01.038 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:01.038 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:01.038 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:01.038 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.007765+0000", 2024-04-19T03:02:01.038 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000138376 2024-04-19T03:02:01.038 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:01.039 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:01.039 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:01.039 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.012418+0000", 2024-04-19T03:02:01.039 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0046528200000000002 2024-04-19T03:02:01.039 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:01.039 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:01.039 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:01.039 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.019380+0000", 2024-04-19T03:02:01.039 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0069621960000000004 2024-04-19T03:02:01.039 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:01.039 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:01.039 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:01.039 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.019437+0000", 2024-04-19T03:02:01.039 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7226999999999999e-05 2024-04-19T03:02:01.040 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:01.040 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:01.040 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:01.040 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.019482+0000", 2024-04-19T03:02:01.040 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4857000000000001e-05 2024-04-19T03:02:01.040 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:01.040 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:01.040 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:01.040 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:01.040 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:01.040 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:20 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:02:01.040 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:01:14.999024+0000", 2024-04-19T03:02:01.040 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 45.944418425999999, 2024-04-19T03:02:01.040 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.024212818000000001, 2024-04-19T03:02:01.041 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:01.041 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-04-19T03:02:01.041 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:01.041 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:01.041 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:01.041 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.999024+0000", 2024-04-19T03:02:01.041 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:01.041 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:01.041 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:01.041 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:01.041 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.999024+0000", 2024-04-19T03:02:01.041 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:01.041 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:01.041 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:01.042 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:01.042 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.999023+0000", 2024-04-19T03:02:01.042 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:01.042 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:01.042 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:01.042 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:01.042 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.999029+0000", 2024-04-19T03:02:01.042 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2709999999999998e-06 2024-04-19T03:02:01.042 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:01.042 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:01.042 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:01.042 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.999045+0000", 2024-04-19T03:02:01.042 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.5840000000000001e-05 2024-04-19T03:02:01.043 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:01.043 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:01.043 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:01.043 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.999057+0000", 2024-04-19T03:02:01.043 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1897e-05 2024-04-19T03:02:01.043 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:01.043 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:01.043 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:01.043 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.999136+0000", 2024-04-19T03:02:01.043 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8842000000000002e-05 2024-04-19T03:02:01.043 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:01.043 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:01.043 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:02:01.043 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.999144+0000", 2024-04-19T03:02:01.043 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.3110000000000006e-06 2024-04-19T03:02:01.044 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:01.044 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:01.044 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:01.044 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.013338+0000", 2024-04-19T03:02:01.044 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.014194217 2024-04-19T03:02:01.044 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:01.044 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:01.044 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:01.044 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.013485+0000", 2024-04-19T03:02:01.044 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000146787 2024-04-19T03:02:01.044 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:01.044 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:01.044 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:01.044 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.023237+0000", 2024-04-19T03:02:01.045 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0097517899999999998 2024-04-19T03:02:01.045 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:01.045 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:01.045 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:01.045 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:01.045 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:01.045 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:11289 5.7 5:e1ea82b1:::benchmark_data_smithi096_19531_object11288:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T03:02:01.045 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:01:42.068678+0000", 2024-04-19T03:02:01.045 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 18.874764206000002, 2024-04-19T03:02:01.045 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.022027980999999999, 2024-04-19T03:02:01.045 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:01.045 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:01.045 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:01.046 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:01.046 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:01.046 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 11289 2024-04-19T03:02:01.046 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:01.046 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:01.046 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:01.046 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:01.046 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:42.068678+0000", 2024-04-19T03:02:01.046 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:01.046 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:01.046 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:01.046 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:01.046 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:42.068678+0000", 2024-04-19T03:02:01.047 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:01.047 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:01.047 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:01.047 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:01.047 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:42.068677+0000", 2024-04-19T03:02:01.047 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:01.047 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:01.047 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:01.047 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:01.047 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:42.068721+0000", 2024-04-19T03:02:01.047 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3714000000000002e-05 2024-04-19T03:02:01.047 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:01.047 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:01.047 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:01.048 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:42.068728+0000", 2024-04-19T03:02:01.048 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0029999999999997e-06 2024-04-19T03:02:01.048 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:01.048 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:01.048 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:01.048 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:42.068733+0000", 2024-04-19T03:02:01.048 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0100000000000003e-06 2024-04-19T03:02:01.048 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:01.048 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:01.048 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:01.048 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:42.068820+0000", 2024-04-19T03:02:01.048 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.653e-05 2024-04-19T03:02:01.048 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:01.048 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:01.049 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:01.049 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:42.068990+0000", 2024-04-19T03:02:01.049 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00017046800000000001 2024-04-19T03:02:01.049 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:01.049 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:01.049 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:01.049 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:42.069140+0000", 2024-04-19T03:02:01.049 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00015001000000000001 2024-04-19T03:02:01.049 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:01.049 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:01.049 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:01.049 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:42.074573+0000", 2024-04-19T03:02:01.049 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0054326979999999997 2024-04-19T03:02:01.049 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:01.050 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:01.050 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:01.050 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:42.090534+0000", 2024-04-19T03:02:01.050 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.015961300000000001 2024-04-19T03:02:01.050 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:01.050 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:01.050 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:01.050 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:42.090619+0000", 2024-04-19T03:02:01.050 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4536999999999994e-05 2024-04-19T03:02:01.050 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:01.050 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:01.050 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:01.050 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:42.090706+0000", 2024-04-19T03:02:01.050 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.7643000000000001e-05 2024-04-19T03:02:01.051 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:01.051 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:01.051 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:01.051 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:01.051 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:01.051 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:50122 5.9 5:9d1c74f3:::benchmark_data_smithi096_19531_object50121:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-19T03:02:01.051 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:00.084949+0000", 2024-04-19T03:02:01.051 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.85849378799999998, 2024-04-19T03:02:01.051 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.023564486999999999, 2024-04-19T03:02:01.051 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:01.051 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:01.051 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:01.051 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:01.051 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:01.052 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 50122 2024-04-19T03:02:01.052 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:01.052 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:01.052 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:01.052 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:01.052 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:00.084949+0000", 2024-04-19T03:02:01.052 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:01.052 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:01.052 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:01.052 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:01.052 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:00.084949+0000", 2024-04-19T03:02:01.052 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:01.052 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:01.052 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:01.053 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:01.053 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:00.084948+0000", 2024-04-19T03:02:01.053 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:01.053 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:01.053 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:01.053 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:01.053 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:00.084983+0000", 2024-04-19T03:02:01.053 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4322000000000001e-05 2024-04-19T03:02:01.053 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:01.053 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:01.053 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:01.053 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:00.084992+0000", 2024-04-19T03:02:01.053 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.0180000000000007e-06 2024-04-19T03:02:01.053 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:01.053 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:01.054 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:01.054 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:00.085000+0000", 2024-04-19T03:02:01.054 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.7609999999999996e-06 2024-04-19T03:02:01.054 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:01.054 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:01.054 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:01.054 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:00.093379+0000", 2024-04-19T03:02:01.054 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0083790819999999995 2024-04-19T03:02:01.054 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:01.054 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:01.054 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:01.054 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:00.093555+0000", 2024-04-19T03:02:01.054 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00017582900000000001 2024-04-19T03:02:01.055 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:01.055 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:01.055 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:02:01.055 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:00.093735+0000", 2024-04-19T03:02:01.055 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00018006399999999999 2024-04-19T03:02:01.055 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:01.055 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:01.055 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:01.055 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:00.104665+0000", 2024-04-19T03:02:01.055 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.010929259 2024-04-19T03:02:01.055 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:01.055 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:01.055 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:01.055 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:00.108415+0000", 2024-04-19T03:02:01.055 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0037506610000000002 2024-04-19T03:02:01.056 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:01.056 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:01.056 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:01.056 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:00.108474+0000", 2024-04-19T03:02:01.056 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8551000000000002e-05 2024-04-19T03:02:01.056 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:01.056 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:01.056 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:01.056 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:00.108513+0000", 2024-04-19T03:02:01.056 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9307000000000002e-05 2024-04-19T03:02:01.056 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:01.056 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:01.056 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:01.056 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:01.057 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:01.057 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:50123 5.9 5:98d55939:::benchmark_data_smithi096_19531_object50122:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-19T03:02:01.057 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:00.087166+0000", 2024-04-19T03:02:01.057 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.85627634200000002, 2024-04-19T03:02:01.057 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.021482022999999999, 2024-04-19T03:02:01.057 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:01.057 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:01.057 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:01.057 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:01.057 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:01.057 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 50123 2024-04-19T03:02:01.057 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:01.057 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:01.057 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:01.057 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:01.058 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:00.087166+0000", 2024-04-19T03:02:01.058 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:01.058 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:01.058 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:01.058 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:01.058 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:00.087166+0000", 2024-04-19T03:02:01.058 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:01.058 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:01.058 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:01.058 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:01.058 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:00.087165+0000", 2024-04-19T03:02:01.058 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:01.058 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:01.059 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:01.059 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:01.059 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:00.087253+0000", 2024-04-19T03:02:01.059 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.8466000000000003e-05 2024-04-19T03:02:01.059 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:01.059 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:01.059 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:01.059 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:00.087271+0000", 2024-04-19T03:02:01.059 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8063999999999998e-05 2024-04-19T03:02:01.059 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:01.059 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:01.059 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:01.059 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:00.087280+0000", 2024-04-19T03:02:01.059 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.3930000000000008e-06 2024-04-19T03:02:01.060 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:01.060 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:01.060 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:01.060 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:00.096771+0000", 2024-04-19T03:02:01.060 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0094913329999999994 2024-04-19T03:02:01.060 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:01.060 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:01.060 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:01.060 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:00.096934+0000", 2024-04-19T03:02:01.060 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00016332900000000001 2024-04-19T03:02:01.060 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:01.060 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:01.060 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:02:01.060 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:00.097058+0000", 2024-04-19T03:02:01.061 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000123798 2024-04-19T03:02:01.061 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:01.061 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:01.061 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:01.061 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:00.104674+0000", 2024-04-19T03:02:01.061 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0076159900000000004 2024-04-19T03:02:01.061 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:01.061 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:01.061 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:01.061 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:00.108563+0000", 2024-04-19T03:02:01.061 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0038890029999999998 2024-04-19T03:02:01.061 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:01.061 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:01.061 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:01.062 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:00.108603+0000", 2024-04-19T03:02:01.062 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9610000000000002e-05 2024-04-19T03:02:01.062 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:01.062 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:01.062 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:01.062 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:00.108648+0000", 2024-04-19T03:02:01.062 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5361999999999997e-05 2024-04-19T03:02:01.062 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:01.062 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:01.062 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:01.062 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:01.062 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:01.062 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:50128 5.9 5:9467072a:::benchmark_data_smithi096_19531_object50127:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-19T03:02:01.063 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:00.087808+0000", 2024-04-19T03:02:01.063 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.85563460999999996, 2024-04-19T03:02:01.063 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.020989109999999998, 2024-04-19T03:02:01.063 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:01.063 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:01.063 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:01.063 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:01.063 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:01.063 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 50128 2024-04-19T03:02:01.063 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:01.063 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:01.063 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:01.063 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:01.063 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:00.087808+0000", 2024-04-19T03:02:01.063 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:01.064 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:01.064 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:01.064 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:01.064 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:00.087808+0000", 2024-04-19T03:02:01.064 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:01.064 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:01.064 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:01.064 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:01.064 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:00.087807+0000", 2024-04-19T03:02:01.064 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:01.064 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:01.064 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:01.064 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:01.064 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:00.087898+0000", 2024-04-19T03:02:01.065 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.0927000000000005e-05 2024-04-19T03:02:01.065 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:01.065 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:01.065 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:01.065 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:00.087911+0000", 2024-04-19T03:02:01.065 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3380000000000001e-05 2024-04-19T03:02:01.065 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:01.065 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:01.065 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:01.065 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:00.087917+0000", 2024-04-19T03:02:01.065 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2190000000000001e-06 2024-04-19T03:02:01.065 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:01.065 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:01.065 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:01.065 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:00.098878+0000", 2024-04-19T03:02:01.066 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.010960642 2024-04-19T03:02:01.066 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:01.066 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:01.066 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:01.066 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:00.099020+0000", 2024-04-19T03:02:01.066 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000142037 2024-04-19T03:02:01.066 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:01.066 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:01.066 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:02:01.066 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:00.099118+0000", 2024-04-19T03:02:01.066 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.8066999999999995e-05 2024-04-19T03:02:01.066 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:01.066 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:01.066 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:01.067 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:00.104682+0000", 2024-04-19T03:02:01.067 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0055638889999999998 2024-04-19T03:02:01.067 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:01.067 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:01.067 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:01.067 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:00.108707+0000", 2024-04-19T03:02:01.067 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0040252359999999997 2024-04-19T03:02:01.067 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:01.067 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:01.067 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:01.067 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:00.108763+0000", 2024-04-19T03:02:01.067 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5822999999999997e-05 2024-04-19T03:02:01.067 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:01.067 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:01.068 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:01.068 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:00.108797+0000", 2024-04-19T03:02:01.068 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3754999999999998e-05 2024-04-19T03:02:01.068 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:01.068 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:01.068 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:01.068 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:01.068 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:01.068 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-04-19T03:02:01.070 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:01.065+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:01.070 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T03:02:01.170 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:01.168+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:01.210 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-04-19T03:02:01.210 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [ 2024-04-19T03:02:01.210 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.210 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4755.0:52180 5.c 5:3b83ad62:::benchmark_data_smithi096_19531_object52179:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-19T03:02:01.210 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:02:01.195292+0000", 2024-04-19T03:02:01.210 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 0.011907658999999999, 2024-04-19T03:02:01.210 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.01193547, 2024-04-19T03:02:01.210 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:02:01.210 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:02:01.210 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-04-19T03:02:01.211 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4755", 2024-04-19T03:02:01.211 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:01.211 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 52180 2024-04-19T03:02:01.211 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.211 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:02:01.211 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.211 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:02:01.211 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:01.195292+0000", 2024-04-19T03:02:01.211 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:01.211 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.211 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.211 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:02:01.211 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:01.195292+0000", 2024-04-19T03:02:01.211 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:01.212 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.212 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.212 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:02:01.212 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:01.195291+0000", 2024-04-19T03:02:01.212 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2024-04-19T03:02:01.212 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.212 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.212 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:02:01.212 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:01.195348+0000", 2024-04-19T03:02:01.212 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.6903000000000001e-05 2024-04-19T03:02:01.212 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.212 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.212 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:02:01.213 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:01.195356+0000", 2024-04-19T03:02:01.213 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.1720000000000001e-06 2024-04-19T03:02:01.213 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.213 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.213 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:02:01.213 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:01.195361+0000", 2024-04-19T03:02:01.213 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.0479999999999998e-06 2024-04-19T03:02:01.213 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.213 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.213 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:01.213 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:01.199533+0000", 2024-04-19T03:02:01.213 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0041728449999999997 2024-04-19T03:02:01.213 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.213 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.214 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:02:01.214 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:01.199692+0000", 2024-04-19T03:02:01.214 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000158913 2024-04-19T03:02:01.214 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.214 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.214 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-04-19T03:02:01.214 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:01.199878+0000", 2024-04-19T03:02:01.214 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00018587700000000001 2024-04-19T03:02:01.214 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.214 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.214 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:01.214 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:01.205893+0000", 2024-04-19T03:02:01.214 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.006014485 2024-04-19T03:02:01.215 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.215 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.215 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:02:01.215 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:01.207200+0000", 2024-04-19T03:02:01.215 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0013077970000000001 2024-04-19T03:02:01.215 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:01.215 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:02:01.215 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:01.215 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.215 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.215 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4755.0:52182 5.a 5:5a01847c:::benchmark_data_smithi096_19531_object52181:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-19T03:02:01.215 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:02:01.197220+0000", 2024-04-19T03:02:01.215 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 0.0099799999999999993, 2024-04-19T03:02:01.215 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.01010638, 2024-04-19T03:02:01.216 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:02:01.216 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:02:01.216 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-04-19T03:02:01.216 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4755", 2024-04-19T03:02:01.216 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:01.216 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 52182 2024-04-19T03:02:01.216 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.216 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:02:01.216 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.216 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:02:01.216 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:01.197220+0000", 2024-04-19T03:02:01.216 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:01.216 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.216 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.217 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:02:01.217 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:01.197220+0000", 2024-04-19T03:02:01.217 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:01.217 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.217 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.217 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:02:01.217 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:01.197219+0000", 2024-04-19T03:02:01.217 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2024-04-19T03:02:01.217 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.217 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.217 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:02:01.217 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:01.197334+0000", 2024-04-19T03:02:01.217 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00011493900000000001 2024-04-19T03:02:01.217 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.217 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.218 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:02:01.218 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:01.197348+0000", 2024-04-19T03:02:01.218 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.3645000000000001e-05 2024-04-19T03:02:01.218 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.218 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.218 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:02:01.218 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:01.197355+0000", 2024-04-19T03:02:01.218 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.7780000000000007e-06 2024-04-19T03:02:01.218 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.218 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.218 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:01.218 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:01.199440+0000", 2024-04-19T03:02:01.218 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0020841039999999998 2024-04-19T03:02:01.219 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.219 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.219 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:02:01.219 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:01.199566+0000", 2024-04-19T03:02:01.219 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000126131 2024-04-19T03:02:01.219 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.219 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.219 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 1", 2024-04-19T03:02:01.219 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:01.199695+0000", 2024-04-19T03:02:01.219 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000128959 2024-04-19T03:02:01.219 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.219 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.219 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:01.219 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:01.205689+0000", 2024-04-19T03:02:01.219 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.005994035 2024-04-19T03:02:01.220 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:01.220 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:02:01.220 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:01.220 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.220 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.220 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4755.0:52184 5.a 5:5bb7db0a:::benchmark_data_smithi096_19531_object52183:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-19T03:02:01.220 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:02:01.197363+0000", 2024-04-19T03:02:01.220 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 0.0098366789999999992, 2024-04-19T03:02:01.220 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.010044615, 2024-04-19T03:02:01.220 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:02:01.220 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:02:01.220 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-04-19T03:02:01.220 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4755", 2024-04-19T03:02:01.220 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:01.221 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 52184 2024-04-19T03:02:01.221 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.221 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:02:01.221 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.221 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:02:01.221 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:01.197363+0000", 2024-04-19T03:02:01.221 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:01.221 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.221 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.221 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:02:01.221 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:01.197363+0000", 2024-04-19T03:02:01.221 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:01.221 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.221 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.221 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:02:01.222 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:01.197363+0000", 2024-04-19T03:02:01.222 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:01.222 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.222 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.222 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:02:01.222 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:01.197415+0000", 2024-04-19T03:02:01.222 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.1947999999999998e-05 2024-04-19T03:02:01.222 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.222 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.222 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:02:01.222 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:01.197423+0000", 2024-04-19T03:02:01.222 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.5339999999999999e-06 2024-04-19T03:02:01.222 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.222 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.223 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:02:01.223 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:01.197429+0000", 2024-04-19T03:02:01.223 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.0360000000000003e-06 2024-04-19T03:02:01.223 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.223 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.223 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:01.223 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:01.201656+0000", 2024-04-19T03:02:01.223 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0042272430000000003 2024-04-19T03:02:01.223 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.223 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.223 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:02:01.223 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:01.201789+0000", 2024-04-19T03:02:01.224 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00013296099999999999 2024-04-19T03:02:01.224 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.224 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.224 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 1", 2024-04-19T03:02:01.224 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:01.201877+0000", 2024-04-19T03:02:01.224 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.7227999999999999e-05 2024-04-19T03:02:01.224 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:01.224 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:02:01.224 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:01.224 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.224 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.224 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4755.0:52183 5.4 e34/22 5:2e311f72:::benchmark_data_smithi096_19531_object52182:head v 34'3170, mlcod=34'3167)", 2024-04-19T03:02:01.224 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:02:01.197804+0000", 2024-04-19T03:02:01.225 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 0.0093958619999999996, 2024-04-19T03:02:01.225 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0096699469999999999, 2024-04-19T03:02:01.225 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:02:01.225 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "started", 2024-04-19T03:02:01.225 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:02:01.225 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.225 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:02:01.225 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:01.197804+0000", 2024-04-19T03:02:01.225 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:01.225 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.225 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.225 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:02:01.225 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:01.197804+0000", 2024-04-19T03:02:01.225 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:01.226 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.226 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.226 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:02:01.226 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:01.197803+0000", 2024-04-19T03:02:01.226 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2024-04-19T03:02:01.226 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.226 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.226 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:02:01.226 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:01.197920+0000", 2024-04-19T03:02:01.226 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000116586 2024-04-19T03:02:01.226 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.226 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.226 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:02:01.227 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:01.197933+0000", 2024-04-19T03:02:01.227 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.3682e-05 2024-04-19T03:02:01.227 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.227 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.227 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:02:01.227 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:01.197940+0000", 2024-04-19T03:02:01.227 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.5490000000000003e-06 2024-04-19T03:02:01.227 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.227 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.227 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:01.227 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:01.202372+0000", 2024-04-19T03:02:01.227 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.004432404 2024-04-19T03:02:01.227 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.228 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.228 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:02:01.228 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:01.202389+0000", 2024-04-19T03:02:01.228 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.6511000000000002e-05 2024-04-19T03:02:01.228 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:01.228 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:02:01.228 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:01.228 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.228 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.228 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4755.0:52187 5.2 e34/22 5:483a8fe6:::benchmark_data_smithi096_19531_object52186:head v 34'3251, mlcod=34'3246)", 2024-04-19T03:02:01.228 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:02:01.201858+0000", 2024-04-19T03:02:01.228 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 0.0053420849999999999, 2024-04-19T03:02:01.228 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0056709910000000002, 2024-04-19T03:02:01.229 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:02:01.229 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "started", 2024-04-19T03:02:01.229 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:02:01.229 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.229 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:02:01.229 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:01.201858+0000", 2024-04-19T03:02:01.229 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:01.229 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.229 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.229 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:02:01.229 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:01.201858+0000", 2024-04-19T03:02:01.229 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:01.229 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.229 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.229 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:02:01.230 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:01.201857+0000", 2024-04-19T03:02:01.230 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2024-04-19T03:02:01.230 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.230 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.230 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:02:01.230 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:01.201959+0000", 2024-04-19T03:02:01.230 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00010160799999999999 2024-04-19T03:02:01.230 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.230 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.230 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:02:01.230 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:01.201970+0000", 2024-04-19T03:02:01.230 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0885e-05 2024-04-19T03:02:01.230 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.230 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.231 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:02:01.231 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:01.201976+0000", 2024-04-19T03:02:01.231 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.4629999999999998e-06 2024-04-19T03:02:01.231 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.231 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.231 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:01.231 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:01.203482+0000", 2024-04-19T03:02:01.231 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001505747 2024-04-19T03:02:01.231 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.231 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.231 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:02:01.231 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:01.203493+0000", 2024-04-19T03:02:01.231 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0866999999999999e-05 2024-04-19T03:02:01.232 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:01.232 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:02:01.232 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:01.232 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.232 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.232 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop_reply(client.4755.0:52181 5.a e34/22 ondisk, result = 0)", 2024-04-19T03:02:01.232 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:02:01.202174+0000", 2024-04-19T03:02:01.232 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 0.0050255450000000002, 2024-04-19T03:02:01.232 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0054054660000000003, 2024-04-19T03:02:01.232 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:02:01.232 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "started", 2024-04-19T03:02:01.232 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:02:01.232 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.232 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:02:01.233 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:01.202174+0000", 2024-04-19T03:02:01.233 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:01.233 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.233 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.233 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:02:01.233 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:01.202174+0000", 2024-04-19T03:02:01.233 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:01.233 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.233 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.233 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:02:01.233 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:01.202174+0000", 2024-04-19T03:02:01.233 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:01.233 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.234 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.234 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:02:01.234 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:01.202178+0000", 2024-04-19T03:02:01.234 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.5739999999999997e-06 2024-04-19T03:02:01.234 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.234 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.234 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:02:01.234 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:01.202193+0000", 2024-04-19T03:02:01.234 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4097000000000001e-05 2024-04-19T03:02:01.234 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.234 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.234 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:02:01.234 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:01.202202+0000", 2024-04-19T03:02:01.235 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.1929999999999999e-06 2024-04-19T03:02:01.235 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.235 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.235 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:01.235 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:01.203498+0000", 2024-04-19T03:02:01.235 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0012960459999999999 2024-04-19T03:02:01.235 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.235 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.235 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:02:01.235 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:01.203504+0000", 2024-04-19T03:02:01.235 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.6329999999999999e-06 2024-04-19T03:02:01.235 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:01.235 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:02:01.235 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:01.236 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.236 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.236 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4755.0:52192 5.7 e34/22 5:e0455152:::benchmark_data_smithi096_19531_object52191:head v 34'3211, mlcod=34'3209)", 2024-04-19T03:02:01.236 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:02:01.203782+0000", 2024-04-19T03:02:01.236 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 0.0034175550000000001, 2024-04-19T03:02:01.236 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0038522460000000001, 2024-04-19T03:02:01.236 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:02:01.236 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "started", 2024-04-19T03:02:01.236 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:02:01.236 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.236 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:02:01.236 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:01.203782+0000", 2024-04-19T03:02:01.236 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:01.236 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.237 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.237 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:02:01.237 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:01.203782+0000", 2024-04-19T03:02:01.237 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:01.237 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.237 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.237 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:02:01.237 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:01.203782+0000", 2024-04-19T03:02:01.237 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:01.237 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.237 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.237 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:02:01.237 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:01.203810+0000", 2024-04-19T03:02:01.237 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.7793e-05 2024-04-19T03:02:01.238 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.238 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.238 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:02:01.238 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:01.203820+0000", 2024-04-19T03:02:01.238 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0679999999999999e-05 2024-04-19T03:02:01.238 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.238 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.238 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:02:01.238 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:01.203826+0000", 2024-04-19T03:02:01.238 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.2249999999999997e-06 2024-04-19T03:02:01.238 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.238 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.238 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:01.239 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:01.203886+0000", 2024-04-19T03:02:01.239 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.9033000000000002e-05 2024-04-19T03:02:01.239 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.239 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.239 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:02:01.239 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:01.203903+0000", 2024-04-19T03:02:01.239 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.7836e-05 2024-04-19T03:02:01.239 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:01.239 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:02:01.239 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:01.239 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.239 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.239 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4755.0:52193 5.0 e34/22 5:070e0dd9:::benchmark_data_smithi096_19531_object52192:head v 34'3296, mlcod=34'3294)", 2024-04-19T03:02:01.239 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:02:01.204064+0000", 2024-04-19T03:02:01.240 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 0.0031359019999999999, 2024-04-19T03:02:01.240 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.003629368, 2024-04-19T03:02:01.240 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:02:01.240 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "started", 2024-04-19T03:02:01.240 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:02:01.240 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.240 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:02:01.240 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:01.204064+0000", 2024-04-19T03:02:01.240 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:01.240 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.240 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.240 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:02:01.240 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:01.204064+0000", 2024-04-19T03:02:01.240 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:01.240 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.241 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.241 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:02:01.241 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:01.204047+0000", 2024-04-19T03:02:01.241 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999828 2024-04-19T03:02:01.241 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.241 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.241 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:02:01.241 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:01.204099+0000", 2024-04-19T03:02:01.241 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.2246000000000001e-05 2024-04-19T03:02:01.241 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.241 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.241 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:02:01.241 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:01.204108+0000", 2024-04-19T03:02:01.241 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.0359999999999995e-06 2024-04-19T03:02:01.242 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.242 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.242 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:02:01.242 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:01.204115+0000", 2024-04-19T03:02:01.242 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.674e-06 2024-04-19T03:02:01.242 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.242 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.242 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:01.242 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:01.204153+0000", 2024-04-19T03:02:01.242 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.862e-05 2024-04-19T03:02:01.242 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.242 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.242 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:02:01.242 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:01.204175+0000", 2024-04-19T03:02:01.243 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.1532999999999999e-05 2024-04-19T03:02:01.243 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:01.243 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:02:01.243 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:01.243 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.243 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.243 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4755.0:52195 5.4 e34/22 5:250eeed3:::benchmark_data_smithi096_19531_object52194:head v 34'3171, mlcod=34'3168)", 2024-04-19T03:02:01.243 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:02:01.204297+0000", 2024-04-19T03:02:01.243 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 0.0029032519999999998, 2024-04-19T03:02:01.243 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0034506860000000001, 2024-04-19T03:02:01.243 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:02:01.243 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "started", 2024-04-19T03:02:01.243 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:02:01.243 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.244 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:02:01.244 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:01.204297+0000", 2024-04-19T03:02:01.244 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:01.244 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.244 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.244 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:02:01.244 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:01.204297+0000", 2024-04-19T03:02:01.244 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:01.244 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.244 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.244 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:02:01.244 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:01.204296+0000", 2024-04-19T03:02:01.244 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:01.244 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.244 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.245 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:02:01.245 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:01.204360+0000", 2024-04-19T03:02:01.245 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.4228999999999998e-05 2024-04-19T03:02:01.245 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.245 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.245 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:02:01.245 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:01.204368+0000", 2024-04-19T03:02:01.245 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.3150000000000003e-06 2024-04-19T03:02:01.245 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.245 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.245 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:02:01.245 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:01.204373+0000", 2024-04-19T03:02:01.245 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.5940000000000001e-06 2024-04-19T03:02:01.246 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.246 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.246 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:01.246 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:01.205096+0000", 2024-04-19T03:02:01.246 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00072305899999999996 2024-04-19T03:02:01.246 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.246 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.246 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:02:01.246 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:01.205119+0000", 2024-04-19T03:02:01.246 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.2180000000000001e-05 2024-04-19T03:02:01.246 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:01.246 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:02:01.246 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:01.246 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.247 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.247 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4755.0:52194 5.2 e34/22 5:474ea233:::benchmark_data_smithi096_19531_object52193:head v 34'3252, mlcod=34'3248)", 2024-04-19T03:02:01.247 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:02:01.204441+0000", 2024-04-19T03:02:01.247 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 0.0027585790000000002, 2024-04-19T03:02:01.247 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0033616319999999998, 2024-04-19T03:02:01.247 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:02:01.247 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "started", 2024-04-19T03:02:01.247 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:02:01.247 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.247 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:02:01.247 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:01.204441+0000", 2024-04-19T03:02:01.247 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:01.247 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.247 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.248 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:02:01.248 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:01.204441+0000", 2024-04-19T03:02:01.248 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:01.248 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.248 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.248 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:02:01.248 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:01.204441+0000", 2024-04-19T03:02:01.248 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:01.248 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.248 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.248 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:02:01.248 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:01.204466+0000", 2024-04-19T03:02:01.248 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.4848e-05 2024-04-19T03:02:01.248 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.249 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.249 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:02:01.249 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:01.204474+0000", 2024-04-19T03:02:01.249 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.1240000000000005e-06 2024-04-19T03:02:01.249 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.249 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.249 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:02:01.249 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:01.204479+0000", 2024-04-19T03:02:01.249 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.4870000000000002e-06 2024-04-19T03:02:01.249 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.249 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.249 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:01.249 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:01.205710+0000", 2024-04-19T03:02:01.249 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0012306319999999999 2024-04-19T03:02:01.249 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.250 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.250 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:02:01.250 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:01.205729+0000", 2024-04-19T03:02:01.250 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.8487000000000001e-05 2024-04-19T03:02:01.250 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:01.250 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:02:01.250 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:01.250 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.250 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.250 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4755.0:52196 5.7 e34/22 5:e86ddbed:::benchmark_data_smithi096_19531_object52195:head v 34'3212, mlcod=34'3209)", 2024-04-19T03:02:01.250 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:02:01.205867+0000", 2024-04-19T03:02:01.250 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 0.0013334040000000001, 2024-04-19T03:02:01.250 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001994315, 2024-04-19T03:02:01.251 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:02:01.251 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "started", 2024-04-19T03:02:01.251 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:02:01.251 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.251 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:02:01.251 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:01.205867+0000", 2024-04-19T03:02:01.251 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:01.251 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.251 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.251 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:02:01.251 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:01.205867+0000", 2024-04-19T03:02:01.251 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:01.251 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.251 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.251 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:02:01.252 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:01.205866+0000", 2024-04-19T03:02:01.252 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2024-04-19T03:02:01.252 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.252 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.252 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:02:01.252 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:01.205912+0000", 2024-04-19T03:02:01.252 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.6195000000000001e-05 2024-04-19T03:02:01.252 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.252 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.252 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:02:01.252 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:01.205920+0000", 2024-04-19T03:02:01.252 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.0609999999999996e-06 2024-04-19T03:02:01.252 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.253 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.253 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:02:01.253 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:01.205926+0000", 2024-04-19T03:02:01.253 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.0549999999999996e-06 2024-04-19T03:02:01.253 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.253 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.253 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:01.253 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:01.206120+0000", 2024-04-19T03:02:01.253 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000194019 2024-04-19T03:02:01.253 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.253 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.253 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:02:01.253 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:01.206187+0000", 2024-04-19T03:02:01.253 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.6942999999999999e-05 2024-04-19T03:02:01.253 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:01.254 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:02:01.254 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:01.254 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.254 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.254 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4755.0:52197 5.0 e34/22 5:0f800e96:::benchmark_data_smithi096_19531_object52196:head v 34'3297, mlcod=34'3294)", 2024-04-19T03:02:01.254 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:02:01.206256+0000", 2024-04-19T03:02:01.254 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 0.00094373799999999996, 2024-04-19T03:02:01.254 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0016604219999999999, 2024-04-19T03:02:01.254 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:02:01.254 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "started", 2024-04-19T03:02:01.254 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:02:01.254 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.254 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:02:01.254 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:01.206256+0000", 2024-04-19T03:02:01.255 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:01.255 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.255 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.255 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:02:01.255 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:01.206256+0000", 2024-04-19T03:02:01.255 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:01.255 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.255 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.255 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:02:01.255 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:01.206255+0000", 2024-04-19T03:02:01.255 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2024-04-19T03:02:01.255 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.255 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.255 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:02:01.256 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:01.206366+0000", 2024-04-19T03:02:01.256 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000110414 2024-04-19T03:02:01.256 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.256 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.256 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:02:01.256 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:01.206374+0000", 2024-04-19T03:02:01.256 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.8800000000000008e-06 2024-04-19T03:02:01.256 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.256 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.256 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:02:01.256 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:01.206393+0000", 2024-04-19T03:02:01.256 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.8899e-05 2024-04-19T03:02:01.256 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.256 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.257 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:01.257 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:01.206424+0000", 2024-04-19T03:02:01.257 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1717000000000001e-05 2024-04-19T03:02:01.257 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.257 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.257 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:02:01.257 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:01.206441+0000", 2024-04-19T03:02:01.257 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.7020999999999998e-05 2024-04-19T03:02:01.257 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:01.257 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:02:01.257 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:01.257 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.257 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.257 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop_reply(client.4755.0:52184 5.a e34/22 ondisk, result = 0)", 2024-04-19T03:02:01.257 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:02:01.206404+0000", 2024-04-19T03:02:01.258 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 0.00079581300000000003, 2024-04-19T03:02:01.258 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0015614800000000001, 2024-04-19T03:02:01.258 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:02:01.258 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "started", 2024-04-19T03:02:01.258 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:02:01.258 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.258 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:02:01.258 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:01.206404+0000", 2024-04-19T03:02:01.258 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:01.258 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.258 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.258 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:02:01.258 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:01.206404+0000", 2024-04-19T03:02:01.258 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:01.259 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.259 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.259 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:02:01.259 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:01.206404+0000", 2024-04-19T03:02:01.259 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:01.259 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.259 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.259 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:02:01.259 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:01.206407+0000", 2024-04-19T03:02:01.259 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1640000000000001e-06 2024-04-19T03:02:01.259 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.259 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.259 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:02:01.259 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:01.206412+0000", 2024-04-19T03:02:01.260 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.0089999999999998e-06 2024-04-19T03:02:01.260 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.260 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.260 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:02:01.260 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:01.206416+0000", 2024-04-19T03:02:01.260 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.912e-06 2024-04-19T03:02:01.260 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.260 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.260 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:01.260 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:01.207729+0000", 2024-04-19T03:02:01.260 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0013130189999999999 2024-04-19T03:02:01.260 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.260 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.260 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:02:01.261 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:01.207735+0000", 2024-04-19T03:02:01.261 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.3500000000000002e-06 2024-04-19T03:02:01.261 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:01.261 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:02:01.261 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:01.261 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.261 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.261 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4755.0:52199 5.a 5.904e256a (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-19T03:02:01.261 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:02:01.206441+0000", 2024-04-19T03:02:01.261 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 0.00075900399999999997, 2024-04-19T03:02:01.261 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001574095, 2024-04-19T03:02:01.261 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:02:01.261 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "queued for pg", 2024-04-19T03:02:01.261 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-04-19T03:02:01.261 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4755", 2024-04-19T03:02:01.262 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:01.262 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 52199 2024-04-19T03:02:01.262 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.262 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:02:01.262 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.262 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:02:01.262 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:01.206441+0000", 2024-04-19T03:02:01.262 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:01.262 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.262 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.262 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:02:01.262 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:01.206441+0000", 2024-04-19T03:02:01.262 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:01.263 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.263 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.263 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:02:01.263 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:01.206440+0000", 2024-04-19T03:02:01.263 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:01.263 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.263 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.263 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:02:01.263 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:01.206470+0000", 2024-04-19T03:02:01.263 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0423e-05 2024-04-19T03:02:01.263 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.263 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.263 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:02:01.263 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:01.206491+0000", 2024-04-19T03:02:01.264 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.1389000000000001e-05 2024-04-19T03:02:01.264 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.264 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.264 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:02:01.264 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:01.206499+0000", 2024-04-19T03:02:01.264 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.6590000000000007e-06 2024-04-19T03:02:01.264 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:01.264 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:02:01.264 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:01.264 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.264 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.264 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4755.0:52198 5.4 e34/22 5:287d089f:::benchmark_data_smithi096_19531_object52197:head v 34'3172, mlcod=34'3168)", 2024-04-19T03:02:01.264 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:02:01.206740+0000", 2024-04-19T03:02:01.264 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 0.00046049900000000001, 2024-04-19T03:02:01.265 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001323168, 2024-04-19T03:02:01.265 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:02:01.265 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "started", 2024-04-19T03:02:01.265 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:02:01.265 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.265 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:02:01.265 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:01.206740+0000", 2024-04-19T03:02:01.265 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:01.265 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.265 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.265 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:02:01.265 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:01.206740+0000", 2024-04-19T03:02:01.265 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:01.265 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.266 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.266 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:02:01.266 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:01.206739+0000", 2024-04-19T03:02:01.266 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:01.266 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.266 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.266 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:02:01.266 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:01.206829+0000", 2024-04-19T03:02:01.266 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.0404999999999999e-05 2024-04-19T03:02:01.266 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.266 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.266 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:02:01.266 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:01.206837+0000", 2024-04-19T03:02:01.266 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.0450000000000003e-06 2024-04-19T03:02:01.267 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.267 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.267 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:02:01.267 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:01.206841+0000", 2024-04-19T03:02:01.267 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.9060000000000001e-06 2024-04-19T03:02:01.267 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.267 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.267 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:01.267 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:01.207352+0000", 2024-04-19T03:02:01.267 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00051080500000000003 2024-04-19T03:02:01.267 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.267 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.267 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:02:01.267 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:01.207363+0000", 2024-04-19T03:02:01.268 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0702e-05 2024-04-19T03:02:01.268 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:01.268 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:02:01.268 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:01.268 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.268 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.268 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4755.0:52200 5.2 e34/22 5:4a137a97:::benchmark_data_smithi096_19531_object52199:head v 34'3253, mlcod=34'3249)", 2024-04-19T03:02:01.268 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:02:01.206834+0000", 2024-04-19T03:02:01.268 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 0.00036624500000000001, 2024-04-19T03:02:01.268 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0012814910000000001, 2024-04-19T03:02:01.268 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:02:01.268 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "started", 2024-04-19T03:02:01.268 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:02:01.268 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.269 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:02:01.269 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:01.206834+0000", 2024-04-19T03:02:01.269 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:01.269 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.269 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.269 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:02:01.269 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:01.206834+0000", 2024-04-19T03:02:01.269 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:01.269 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.269 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.269 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:02:01.269 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:01.206833+0000", 2024-04-19T03:02:01.269 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:01.269 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.270 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.270 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:02:01.270 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:01.206885+0000", 2024-04-19T03:02:01.270 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.2185000000000003e-05 2024-04-19T03:02:01.270 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.270 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.270 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:02:01.270 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:01.206894+0000", 2024-04-19T03:02:01.270 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.7630000000000006e-06 2024-04-19T03:02:01.270 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.270 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.270 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:02:01.270 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:01.206900+0000", 2024-04-19T03:02:01.270 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.8270000000000003e-06 2024-04-19T03:02:01.271 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.271 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.271 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:01.271 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:01.207854+0000", 2024-04-19T03:02:01.271 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000953856 2024-04-19T03:02:01.271 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.271 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.271 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:02:01.271 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:01.207871+0000", 2024-04-19T03:02:01.271 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.6767000000000001e-05 2024-04-19T03:02:01.271 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:01.271 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:02:01.271 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:01.271 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.272 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.272 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4755.0:52203 5.a 5.b8a6be7a (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-19T03:02:01.272 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:02:01.207661+0000", 2024-04-19T03:02:01.272 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 4294967295.9995389, 2024-04-19T03:02:01.272 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00050338399999999995, 2024-04-19T03:02:01.272 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:02:01.272 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "queued for pg", 2024-04-19T03:02:01.272 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-04-19T03:02:01.272 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4755", 2024-04-19T03:02:01.272 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:01.272 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 52203 2024-04-19T03:02:01.272 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.272 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:02:01.272 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.273 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:02:01.273 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:01.207661+0000", 2024-04-19T03:02:01.273 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:01.273 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.273 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.273 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:02:01.273 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:01.207661+0000", 2024-04-19T03:02:01.273 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:01.273 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.273 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.273 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:02:01.273 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:01.207660+0000", 2024-04-19T03:02:01.273 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:01.273 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.274 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.274 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:02:01.274 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:01.207705+0000", 2024-04-19T03:02:01.274 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.5151999999999997e-05 2024-04-19T03:02:01.274 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.274 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.274 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:02:01.274 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:01.207716+0000", 2024-04-19T03:02:01.274 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0825999999999999e-05 2024-04-19T03:02:01.274 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.274 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.274 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:02:01.274 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:01.207724+0000", 2024-04-19T03:02:01.275 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.0390000000000005e-06 2024-04-19T03:02:01.275 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:01.275 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:02:01.275 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:01.275 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.275 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.275 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4755.0:52205 5.5 5.2805f2b5 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-19T03:02:01.275 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:02:01.208068+0000", 2024-04-19T03:02:01.275 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 4294967295.9991322, 2024-04-19T03:02:01.275 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014283699999999999, 2024-04-19T03:02:01.275 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:02:01.275 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "queued for pg", 2024-04-19T03:02:01.275 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-04-19T03:02:01.275 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4755", 2024-04-19T03:02:01.276 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:01.276 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 52205 2024-04-19T03:02:01.276 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.276 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:02:01.276 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.276 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:02:01.276 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:01.208068+0000", 2024-04-19T03:02:01.276 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:01.276 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.276 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.276 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:02:01.276 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:01.208068+0000", 2024-04-19T03:02:01.276 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:01.276 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.277 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.277 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:02:01.277 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:01.208067+0000", 2024-04-19T03:02:01.277 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2024-04-19T03:02:01.277 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.277 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.277 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:02:01.277 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:01.208155+0000", 2024-04-19T03:02:01.277 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.7453000000000004e-05 2024-04-19T03:02:01.277 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.277 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.277 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:02:01.277 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:01.208164+0000", 2024-04-19T03:02:01.278 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.6690000000000001e-06 2024-04-19T03:02:01.278 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.278 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.278 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:02:01.278 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:01.208172+0000", 2024-04-19T03:02:01.278 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.5120000000000002e-06 2024-04-19T03:02:01.278 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:01.278 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:02:01.278 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:01.278 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:01.278 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2024-04-19T03:02:01.278 INFO:teuthology.orchestra.run.smithi097.stdout: "num_ops": 18 2024-04-19T03:02:01.278 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-04-19T03:02:01.280 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T03:02:01.281 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:01.277+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:01.380 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:01.380+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:01.408 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-04-19T03:02:01.409 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [], 2024-04-19T03:02:01.409 INFO:teuthology.orchestra.run.smithi097.stdout: "complaint_time": 30, 2024-04-19T03:02:01.409 INFO:teuthology.orchestra.run.smithi097.stdout: "num_blocked_ops": 0 2024-04-19T03:02:01.409 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-04-19T03:02:01.421 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T03:02:01.481 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-04-19T03:02:01.478+0000 7f35986ab700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18243) UID: 0 2024-04-19T03:02:01.556 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-04-19T03:02:01.556 INFO:teuthology.orchestra.run.smithi097.stdout: "size": 20, 2024-04-19T03:02:01.556 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 600, 2024-04-19T03:02:01.556 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [ 2024-04-19T03:02:01.556 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.556 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:02:01.557 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:14.996966+0000", 2024-04-19T03:02:01.557 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 46.555705033000002, 2024-04-19T03:02:01.557 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.018946704000000002, 2024-04-19T03:02:01.557 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:02:01.557 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:01.557 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:02:01.557 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.557 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:02:01.557 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.996966+0000", 2024-04-19T03:02:01.557 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:01.557 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.557 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.557 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:02:01.557 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.996966+0000", 2024-04-19T03:02:01.557 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:01.558 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.558 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.558 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:02:01.558 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.996964+0000", 2024-04-19T03:02:01.558 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999971 2024-04-19T03:02:01.558 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.558 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.558 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:02:01.558 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.996982+0000", 2024-04-19T03:02:01.558 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.8306999999999999e-05 2024-04-19T03:02:01.558 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.558 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.559 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:02:01.559 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997027+0000", 2024-04-19T03:02:01.559 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.5274000000000001e-05 2024-04-19T03:02:01.559 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.559 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.559 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:02:01.559 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997047+0000", 2024-04-19T03:02:01.559 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.9726999999999999e-05 2024-04-19T03:02:01.559 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.559 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.559 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:01.559 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997203+0000", 2024-04-19T03:02:01.559 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000155847 2024-04-19T03:02:01.559 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.560 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.560 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op must wait for map", 2024-04-19T03:02:01.560 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997249+0000", 2024-04-19T03:02:01.560 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.5824e-05 2024-04-19T03:02:01.560 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.560 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.560 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:01.560 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.007264+0000", 2024-04-19T03:02:01.560 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.010015909 2024-04-19T03:02:01.560 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.560 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.560 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:02:01.560 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.007394+0000", 2024-04-19T03:02:01.561 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012931999999999999 2024-04-19T03:02:01.561 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.561 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.561 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-04-19T03:02:01.561 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.007537+0000", 2024-04-19T03:02:01.561 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014365 2024-04-19T03:02:01.561 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.561 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.561 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:02:01.561 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.012444+0000", 2024-04-19T03:02:01.561 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0049067260000000001 2024-04-19T03:02:01.561 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.561 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.561 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:01.562 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.015791+0000", 2024-04-19T03:02:01.562 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0033471109999999998 2024-04-19T03:02:01.562 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.562 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.562 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:02:01.562 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.015845+0000", 2024-04-19T03:02:01.562 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.4236e-05 2024-04-19T03:02:01.562 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.562 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.562 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:02:01.562 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.015913+0000", 2024-04-19T03:02:01.562 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.7397000000000005e-05 2024-04-19T03:02:01.562 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:01.562 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:02:01.563 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:01.563 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.563 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.563 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(mds.0.3:14 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:02:01.563 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:14.997079+0000", 2024-04-19T03:02:01.563 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 46.555592449000002, 2024-04-19T03:02:01.563 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.021951970000000001, 2024-04-19T03:02:01.563 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:02:01.563 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:01.563 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:02:01.563 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.563 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:02:01.563 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997079+0000", 2024-04-19T03:02:01.563 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:01.564 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.564 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.564 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:02:01.564 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997079+0000", 2024-04-19T03:02:01.564 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:01.564 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.564 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.564 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:02:01.564 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997077+0000", 2024-04-19T03:02:01.564 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:01.564 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.564 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.564 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:02:01.564 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997087+0000", 2024-04-19T03:02:01.565 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.006e-05 2024-04-19T03:02:01.565 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.565 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.565 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:02:01.565 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997105+0000", 2024-04-19T03:02:01.565 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.8026999999999999e-05 2024-04-19T03:02:01.565 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.565 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.565 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:02:01.565 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997135+0000", 2024-04-19T03:02:01.565 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.9643000000000001e-05 2024-04-19T03:02:01.565 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.566 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.566 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:01.566 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997208+0000", 2024-04-19T03:02:01.567 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.3419999999999998e-05 2024-04-19T03:02:01.567 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.567 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.567 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op must wait for map", 2024-04-19T03:02:01.568 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997244+0000", 2024-04-19T03:02:01.568 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.5367000000000002e-05 2024-04-19T03:02:01.568 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.568 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.568 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:01.568 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.007357+0000", 2024-04-19T03:02:01.569 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.010112703000000001 2024-04-19T03:02:01.569 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.569 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.569 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:02:01.569 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.007479+0000", 2024-04-19T03:02:01.569 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012279599999999999 2024-04-19T03:02:01.569 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.569 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.570 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 1", 2024-04-19T03:02:01.570 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.007610+0000", 2024-04-19T03:02:01.570 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00013093499999999999 2024-04-19T03:02:01.570 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.570 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.570 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:02:01.570 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.012526+0000", 2024-04-19T03:02:01.570 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0049157519999999998 2024-04-19T03:02:01.571 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.571 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.571 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:01.571 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.018959+0000", 2024-04-19T03:02:01.571 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0064326009999999996 2024-04-19T03:02:01.571 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.571 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.571 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:02:01.572 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.019005+0000", 2024-04-19T03:02:01.572 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.6066999999999998e-05 2024-04-19T03:02:01.572 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.572 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.572 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:02:01.572 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.019031+0000", 2024-04-19T03:02:01.572 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.6009000000000001e-05 2024-04-19T03:02:01.572 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:01.572 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:02:01.572 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:01.572 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.572 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.573 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:02:01.573 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:14.997149+0000", 2024-04-19T03:02:01.573 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 46.555521829, 2024-04-19T03:02:01.573 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.021805590999999999, 2024-04-19T03:02:01.573 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:02:01.573 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:01.573 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:02:01.573 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.573 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:02:01.573 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997149+0000", 2024-04-19T03:02:01.573 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:01.573 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.573 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.574 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:02:01.574 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997149+0000", 2024-04-19T03:02:01.574 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:01.574 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.574 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.574 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:02:01.574 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997148+0000", 2024-04-19T03:02:01.574 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2024-04-19T03:02:01.574 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.574 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.574 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:02:01.574 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997166+0000", 2024-04-19T03:02:01.574 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.8233e-05 2024-04-19T03:02:01.575 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.575 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.575 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:02:01.575 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997182+0000", 2024-04-19T03:02:01.575 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5999999999999999e-05 2024-04-19T03:02:01.575 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.575 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.575 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:02:01.575 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997195+0000", 2024-04-19T03:02:01.575 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.252e-05 2024-04-19T03:02:01.575 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.575 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.576 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:01.576 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997348+0000", 2024-04-19T03:02:01.576 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000153115 2024-04-19T03:02:01.576 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.576 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.576 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:02:01.576 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997354+0000", 2024-04-19T03:02:01.576 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.9359999999999996e-06 2024-04-19T03:02:01.576 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.577 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.577 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:01.577 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.008147+0000", 2024-04-19T03:02:01.577 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.010793127 2024-04-19T03:02:01.577 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.577 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.577 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:02:01.577 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.008225+0000", 2024-04-19T03:02:01.577 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.7935999999999994e-05 2024-04-19T03:02:01.577 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.577 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.577 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-04-19T03:02:01.577 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.008377+0000", 2024-04-19T03:02:01.577 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00015159099999999999 2024-04-19T03:02:01.578 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.578 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.578 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:02:01.578 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.012629+0000", 2024-04-19T03:02:01.578 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0042520420000000001 2024-04-19T03:02:01.578 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.578 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.578 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:01.578 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.018871+0000", 2024-04-19T03:02:01.578 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0062425060000000001 2024-04-19T03:02:01.578 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.578 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.579 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:02:01.579 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.018910+0000", 2024-04-19T03:02:01.579 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.8482999999999997e-05 2024-04-19T03:02:01.579 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.579 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.579 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:02:01.579 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.018955+0000", 2024-04-19T03:02:01.579 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.5252e-05 2024-04-19T03:02:01.579 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:01.579 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:02:01.579 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:01.579 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.580 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.580 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(mds.0.3:36 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:02:01.580 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:14.997207+0000", 2024-04-19T03:02:01.580 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 46.555464278999999, 2024-04-19T03:02:01.580 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.022210431999999999, 2024-04-19T03:02:01.580 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:02:01.580 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:01.580 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:02:01.580 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.580 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:02:01.580 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997207+0000", 2024-04-19T03:02:01.581 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:01.581 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.581 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.581 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:02:01.581 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997207+0000", 2024-04-19T03:02:01.581 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:01.581 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.581 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.581 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:02:01.581 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997206+0000", 2024-04-19T03:02:01.581 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2024-04-19T03:02:01.581 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.582 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.582 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:02:01.582 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997218+0000", 2024-04-19T03:02:01.582 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2607e-05 2024-04-19T03:02:01.582 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.582 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.582 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:02:01.582 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997234+0000", 2024-04-19T03:02:01.582 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5583999999999999e-05 2024-04-19T03:02:01.582 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.583 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.583 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:02:01.583 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997248+0000", 2024-04-19T03:02:01.583 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4270000000000001e-05 2024-04-19T03:02:01.583 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.583 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.583 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:01.583 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997397+0000", 2024-04-19T03:02:01.583 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0001482 2024-04-19T03:02:01.583 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.584 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.584 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:02:01.584 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997407+0000", 2024-04-19T03:02:01.584 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0944000000000001e-05 2024-04-19T03:02:01.584 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.584 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.584 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:01.584 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.008173+0000", 2024-04-19T03:02:01.585 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.010765378000000001 2024-04-19T03:02:01.585 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.585 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.585 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:02:01.585 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.008278+0000", 2024-04-19T03:02:01.585 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00010538 2024-04-19T03:02:01.585 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.585 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.585 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 1", 2024-04-19T03:02:01.585 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.008423+0000", 2024-04-19T03:02:01.585 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014525599999999999 2024-04-19T03:02:01.586 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.586 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.586 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:02:01.587 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.012734+0000", 2024-04-19T03:02:01.587 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0043108590000000002 2024-04-19T03:02:01.587 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.587 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.587 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:01.587 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.019318+0000", 2024-04-19T03:02:01.587 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0065836130000000003 2024-04-19T03:02:01.587 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.587 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.587 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:02:01.587 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.019382+0000", 2024-04-19T03:02:01.588 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.3925999999999997e-05 2024-04-19T03:02:01.588 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.588 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.588 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:02:01.588 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.019417+0000", 2024-04-19T03:02:01.588 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.5454999999999999e-05 2024-04-19T03:02:01.588 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:01.588 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:02:01.588 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:01.588 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.588 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.588 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(mds.0.3:15 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:02:01.588 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:14.997260+0000", 2024-04-19T03:02:01.588 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 46.555411128000003, 2024-04-19T03:02:01.589 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.021842842000000001, 2024-04-19T03:02:01.589 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:02:01.589 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:01.589 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:02:01.589 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.589 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:02:01.589 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997260+0000", 2024-04-19T03:02:01.589 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:01.589 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.589 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.589 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:02:01.589 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997260+0000", 2024-04-19T03:02:01.589 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:01.590 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.590 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.590 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:02:01.590 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997259+0000", 2024-04-19T03:02:01.590 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:01.590 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.591 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.591 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:02:01.591 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997270+0000", 2024-04-19T03:02:01.591 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0312999999999999e-05 2024-04-19T03:02:01.591 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.591 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.591 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:02:01.592 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997279+0000", 2024-04-19T03:02:01.592 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.7770000000000008e-06 2024-04-19T03:02:01.592 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.592 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.592 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:02:01.592 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997286+0000", 2024-04-19T03:02:01.592 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.0129999999999996e-06 2024-04-19T03:02:01.592 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.592 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.592 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:01.592 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997433+0000", 2024-04-19T03:02:01.592 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014774699999999999 2024-04-19T03:02:01.592 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.593 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.593 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:02:01.593 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997443+0000", 2024-04-19T03:02:01.593 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.414e-06 2024-04-19T03:02:01.593 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.593 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.593 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:01.593 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.008673+0000", 2024-04-19T03:02:01.593 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.011230789999999999 2024-04-19T03:02:01.593 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.593 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.593 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:02:01.593 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.008808+0000", 2024-04-19T03:02:01.594 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000134346 2024-04-19T03:02:01.594 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.594 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.594 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-04-19T03:02:01.594 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.008922+0000", 2024-04-19T03:02:01.594 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000114444 2024-04-19T03:02:01.594 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.594 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.594 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:02:01.594 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.013442+0000", 2024-04-19T03:02:01.594 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0045193439999999998 2024-04-19T03:02:01.594 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.594 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.595 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:01.595 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.019005+0000", 2024-04-19T03:02:01.595 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00556333 2024-04-19T03:02:01.595 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.595 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.595 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:02:01.595 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.019049+0000", 2024-04-19T03:02:01.595 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.4240000000000003e-05 2024-04-19T03:02:01.595 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.595 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.595 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:02:01.595 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.019103+0000", 2024-04-19T03:02:01.595 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.3706999999999999e-05 2024-04-19T03:02:01.595 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:01.595 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:02:01.596 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:01.596 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.596 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.596 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(mds.0.3:17 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:02:01.596 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:14.997292+0000", 2024-04-19T03:02:01.596 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 46.555379401000003, 2024-04-19T03:02:01.596 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.019573165999999999, 2024-04-19T03:02:01.596 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:02:01.596 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:01.596 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:02:01.596 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.596 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:02:01.596 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997292+0000", 2024-04-19T03:02:01.596 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:01.596 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.596 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.597 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:02:01.597 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997292+0000", 2024-04-19T03:02:01.597 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:01.597 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.597 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.597 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:02:01.597 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997291+0000", 2024-04-19T03:02:01.597 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:01.597 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.598 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.598 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:02:01.598 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997297+0000", 2024-04-19T03:02:01.598 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.3900000000000001e-06 2024-04-19T03:02:01.598 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.598 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.598 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:02:01.598 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997316+0000", 2024-04-19T03:02:01.598 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.9406e-05 2024-04-19T03:02:01.598 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.598 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.598 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:02:01.599 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997353+0000", 2024-04-19T03:02:01.599 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.6563999999999998e-05 2024-04-19T03:02:01.599 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.599 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.599 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:01.599 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997447+0000", 2024-04-19T03:02:01.599 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.4463999999999995e-05 2024-04-19T03:02:01.599 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.599 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.599 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op must wait for map", 2024-04-19T03:02:01.599 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997458+0000", 2024-04-19T03:02:01.599 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0817e-05 2024-04-19T03:02:01.599 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.599 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.600 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:01.600 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.002013+0000", 2024-04-19T03:02:01.600 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.004555229 2024-04-19T03:02:01.600 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.600 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.600 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:02:01.600 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.002943+0000", 2024-04-19T03:02:01.600 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00092983200000000001 2024-04-19T03:02:01.600 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.600 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.600 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-04-19T03:02:01.600 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.003257+0000", 2024-04-19T03:02:01.601 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00031455399999999998 2024-04-19T03:02:01.601 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.601 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.601 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:02:01.601 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.014107+0000", 2024-04-19T03:02:01.601 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.010849648 2024-04-19T03:02:01.601 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.601 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.601 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:01.601 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.016767+0000", 2024-04-19T03:02:01.601 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0026594990000000001 2024-04-19T03:02:01.601 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.601 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.601 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:02:01.601 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.016825+0000", 2024-04-19T03:02:01.602 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.8264000000000003e-05 2024-04-19T03:02:01.602 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.602 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.602 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:02:01.602 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.016865+0000", 2024-04-19T03:02:01.602 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.0108999999999998e-05 2024-04-19T03:02:01.602 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:01.602 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:02:01.602 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:01.602 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.603 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.603 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(mds.0.3:22 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:02:01.603 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:14.997383+0000", 2024-04-19T03:02:01.603 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 46.555288621000003, 2024-04-19T03:02:01.603 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.019634641000000001, 2024-04-19T03:02:01.603 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:02:01.603 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "started", 2024-04-19T03:02:01.603 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:02:01.603 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.603 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:02:01.603 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997383+0000", 2024-04-19T03:02:01.603 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:01.603 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.603 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.605 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:02:01.605 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997383+0000", 2024-04-19T03:02:01.605 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:01.606 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.606 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.606 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:02:01.606 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997381+0000", 2024-04-19T03:02:01.606 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:01.606 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.606 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.606 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:02:01.606 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997399+0000", 2024-04-19T03:02:01.606 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.802e-05 2024-04-19T03:02:01.606 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.606 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.607 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:02:01.607 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997417+0000", 2024-04-19T03:02:01.607 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.7581e-05 2024-04-19T03:02:01.607 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.607 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.607 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:02:01.607 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997429+0000", 2024-04-19T03:02:01.607 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1803e-05 2024-04-19T03:02:01.607 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.607 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.607 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:01.607 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997540+0000", 2024-04-19T03:02:01.607 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000111397 2024-04-19T03:02:01.607 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.607 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.608 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:02:01.608 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997552+0000", 2024-04-19T03:02:01.608 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1643e-05 2024-04-19T03:02:01.608 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.608 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.608 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:01.608 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.006836+0000", 2024-04-19T03:02:01.608 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0092841940000000008 2024-04-19T03:02:01.609 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.609 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.609 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:02:01.609 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.006982+0000", 2024-04-19T03:02:01.609 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014572899999999999 2024-04-19T03:02:01.609 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.609 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.609 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:02:01.609 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.017017+0000", 2024-04-19T03:02:01.609 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.010035571 2024-04-19T03:02:01.609 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:01.609 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:02:01.609 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:01.609 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.610 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.610 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(mds.0.3:23 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:02:01.610 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:14.997449+0000", 2024-04-19T03:02:01.610 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 46.55522208, 2024-04-19T03:02:01.610 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.022679250000000001, 2024-04-19T03:02:01.610 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:02:01.610 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "started", 2024-04-19T03:02:01.610 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:02:01.610 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.610 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:02:01.610 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997449+0000", 2024-04-19T03:02:01.610 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:01.610 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.611 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.611 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:02:01.611 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997449+0000", 2024-04-19T03:02:01.611 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:01.611 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.611 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.611 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:02:01.611 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997448+0000", 2024-04-19T03:02:01.611 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:01.611 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.612 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.612 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:02:01.612 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997452+0000", 2024-04-19T03:02:01.612 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.0369999999999996e-06 2024-04-19T03:02:01.612 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.612 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.612 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:02:01.613 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997461+0000", 2024-04-19T03:02:01.613 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.6100000000000006e-06 2024-04-19T03:02:01.613 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.613 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.613 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:02:01.613 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997468+0000", 2024-04-19T03:02:01.613 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.8360000000000003e-06 2024-04-19T03:02:01.613 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.613 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.613 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:01.613 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997546+0000", 2024-04-19T03:02:01.613 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.7956999999999999e-05 2024-04-19T03:02:01.613 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.613 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.614 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:02:01.614 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997555+0000", 2024-04-19T03:02:01.614 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.2269999999999999e-06 2024-04-19T03:02:01.614 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.614 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.614 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:01.614 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.010065+0000", 2024-04-19T03:02:01.615 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.012509457999999999 2024-04-19T03:02:01.615 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.615 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.615 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:02:01.615 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.010187+0000", 2024-04-19T03:02:01.616 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000122059 2024-04-19T03:02:01.616 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.616 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.616 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:02:01.616 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.020128+0000", 2024-04-19T03:02:01.616 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0099417529999999994 2024-04-19T03:02:01.616 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:01.617 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:02:01.617 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:01.617 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.617 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.617 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(mds.0.3:25 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:02:01.617 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:14.997485+0000", 2024-04-19T03:02:01.617 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 46.555186614, 2024-04-19T03:02:01.617 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.021633427, 2024-04-19T03:02:01.617 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:02:01.618 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "started", 2024-04-19T03:02:01.618 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:02:01.618 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.618 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:02:01.618 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997485+0000", 2024-04-19T03:02:01.618 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:01.619 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.619 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.619 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:02:01.619 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997485+0000", 2024-04-19T03:02:01.619 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:01.619 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.619 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.620 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:02:01.620 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997484+0000", 2024-04-19T03:02:01.620 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2024-04-19T03:02:01.620 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.620 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.620 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:02:01.620 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997490+0000", 2024-04-19T03:02:01.620 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.857e-06 2024-04-19T03:02:01.620 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.620 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.620 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:02:01.620 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997505+0000", 2024-04-19T03:02:01.621 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.518e-05 2024-04-19T03:02:01.621 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.621 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.621 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:02:01.621 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997520+0000", 2024-04-19T03:02:01.621 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5026e-05 2024-04-19T03:02:01.621 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.621 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.621 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:01.621 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997607+0000", 2024-04-19T03:02:01.621 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.7107000000000005e-05 2024-04-19T03:02:01.621 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.622 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.622 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op must wait for map", 2024-04-19T03:02:01.622 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997614+0000", 2024-04-19T03:02:01.622 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.0539999999999997e-06 2024-04-19T03:02:01.622 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.622 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.622 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:01.622 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.009808+0000", 2024-04-19T03:02:01.622 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.012194371000000001 2024-04-19T03:02:01.622 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.622 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.622 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:02:01.623 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.010107+0000", 2024-04-19T03:02:01.623 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000298731 2024-04-19T03:02:01.623 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.623 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.623 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:02:01.623 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.019118+0000", 2024-04-19T03:02:01.623 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0090109839999999997 2024-04-19T03:02:01.623 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:01.623 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:02:01.623 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:01.623 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.623 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.624 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4755.0:11277 5.c 5:38c3ceb2:::benchmark_data_smithi096_19531_object11276:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T03:02:01.624 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:42.059676+0000", 2024-04-19T03:02:01.624 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 19.492994992, 2024-04-19T03:02:01.624 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.029909680000000001, 2024-04-19T03:02:01.624 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:02:01.624 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:01.624 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-04-19T03:02:01.624 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4755", 2024-04-19T03:02:01.624 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:01.624 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 11277 2024-04-19T03:02:01.624 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.624 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:02:01.624 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.624 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:02:01.625 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.059676+0000", 2024-04-19T03:02:01.625 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:01.625 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.625 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.625 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:02:01.625 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.059676+0000", 2024-04-19T03:02:01.625 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:01.625 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.625 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.625 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:02:01.625 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.059665+0000", 2024-04-19T03:02:01.625 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999886 2024-04-19T03:02:01.626 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.626 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.626 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:02:01.626 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.059777+0000", 2024-04-19T03:02:01.626 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000111953 2024-04-19T03:02:01.626 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.626 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.626 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:02:01.626 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.059789+0000", 2024-04-19T03:02:01.627 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1809e-05 2024-04-19T03:02:01.627 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.627 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.627 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:02:01.627 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.059797+0000", 2024-04-19T03:02:01.627 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.2090000000000005e-06 2024-04-19T03:02:01.628 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.628 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.628 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:01.628 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.060528+0000", 2024-04-19T03:02:01.628 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00073144499999999995 2024-04-19T03:02:01.629 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.629 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.629 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:02:01.629 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.060662+0000", 2024-04-19T03:02:01.629 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000133435 2024-04-19T03:02:01.629 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.630 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.630 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-04-19T03:02:01.630 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.060766+0000", 2024-04-19T03:02:01.630 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00010473500000000001 2024-04-19T03:02:01.630 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.631 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.631 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:02:01.631 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.067649+0000", 2024-04-19T03:02:01.631 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.006882684 2024-04-19T03:02:01.631 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.632 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.632 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:01.632 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.089475+0000", 2024-04-19T03:02:01.632 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.021826196999999999 2024-04-19T03:02:01.632 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.632 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.633 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:02:01.633 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.089535+0000", 2024-04-19T03:02:01.633 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.9239e-05 2024-04-19T03:02:01.633 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.633 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.633 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:02:01.634 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.089586+0000", 2024-04-19T03:02:01.634 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.1288000000000001e-05 2024-04-19T03:02:01.634 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:01.634 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:02:01.634 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:01.634 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.635 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.635 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4755.0:11280 5.6 5:6e34f5e7:::benchmark_data_smithi096_19531_object11279:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T03:02:01.635 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:42.060002+0000", 2024-04-19T03:02:01.635 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 19.492669616000001, 2024-04-19T03:02:01.635 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.028171841999999999, 2024-04-19T03:02:01.636 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:02:01.636 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:01.636 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-04-19T03:02:01.636 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4755", 2024-04-19T03:02:01.636 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:01.636 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 11280 2024-04-19T03:02:01.636 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.636 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:02:01.636 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.636 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:02:01.636 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.060002+0000", 2024-04-19T03:02:01.637 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:01.637 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.637 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.637 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:02:01.637 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.060002+0000", 2024-04-19T03:02:01.637 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:01.637 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.637 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.637 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:02:01.637 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.060000+0000", 2024-04-19T03:02:01.637 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2024-04-19T03:02:01.637 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.637 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.637 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:02:01.638 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.060120+0000", 2024-04-19T03:02:01.638 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00011941400000000001 2024-04-19T03:02:01.638 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.638 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.638 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:02:01.638 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.060132+0000", 2024-04-19T03:02:01.638 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2197e-05 2024-04-19T03:02:01.638 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.638 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.638 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:02:01.638 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.060141+0000", 2024-04-19T03:02:01.638 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.6829999999999997e-06 2024-04-19T03:02:01.639 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.639 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.639 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:01.639 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.060194+0000", 2024-04-19T03:02:01.639 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.3395e-05 2024-04-19T03:02:01.639 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.639 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.639 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:02:01.639 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.060333+0000", 2024-04-19T03:02:01.639 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00013935799999999999 2024-04-19T03:02:01.639 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.639 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.639 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-04-19T03:02:01.639 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.060477+0000", 2024-04-19T03:02:01.640 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000143938 2024-04-19T03:02:01.640 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.640 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.640 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:02:01.640 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.067752+0000", 2024-04-19T03:02:01.640 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0072741580000000002 2024-04-19T03:02:01.640 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.640 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.640 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:01.640 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.088041+0000", 2024-04-19T03:02:01.640 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.020288955000000001 2024-04-19T03:02:01.640 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.640 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.640 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:02:01.641 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.088113+0000", 2024-04-19T03:02:01.641 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.2492999999999999e-05 2024-04-19T03:02:01.641 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.641 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.641 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:02:01.641 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.088173+0000", 2024-04-19T03:02:01.641 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.0418999999999999e-05 2024-04-19T03:02:01.641 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:01.641 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:02:01.642 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:01.642 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.642 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.642 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4755.0:11274 5.e e26/22 5:7c846032:::benchmark_data_smithi096_19531_object11273:head v 26'697, mlcod=26'692)", 2024-04-19T03:02:01.642 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:42.065726+0000", 2024-04-19T03:02:01.642 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 19.486945088999999, 2024-04-19T03:02:01.642 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.028607227999999998, 2024-04-19T03:02:01.642 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:02:01.642 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:01.642 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:02:01.643 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.643 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:02:01.643 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.065726+0000", 2024-04-19T03:02:01.643 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:01.643 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.643 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.643 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:02:01.643 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.065726+0000", 2024-04-19T03:02:01.643 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:01.643 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.643 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.643 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:02:01.643 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.065725+0000", 2024-04-19T03:02:01.643 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2024-04-19T03:02:01.644 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.644 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.644 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:02:01.644 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.066818+0000", 2024-04-19T03:02:01.644 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0010930110000000001 2024-04-19T03:02:01.644 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.644 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.644 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:02:01.644 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.066826+0000", 2024-04-19T03:02:01.644 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.0609999999999996e-06 2024-04-19T03:02:01.644 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.644 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.644 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:02:01.644 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.066831+0000", 2024-04-19T03:02:01.645 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.7500000000000003e-06 2024-04-19T03:02:01.645 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.645 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.645 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:01.645 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.066857+0000", 2024-04-19T03:02:01.645 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.6126999999999999e-05 2024-04-19T03:02:01.645 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.645 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.645 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:02:01.645 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.066868+0000", 2024-04-19T03:02:01.645 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1113e-05 2024-04-19T03:02:01.645 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.645 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.645 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:02:01.646 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.094266+0000", 2024-04-19T03:02:01.646 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.027397731000000002 2024-04-19T03:02:01.646 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.646 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.646 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:02:01.646 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.094333+0000", 2024-04-19T03:02:01.646 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.7230000000000005e-05 2024-04-19T03:02:01.646 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:01.646 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:02:01.646 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:01.646 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.646 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.646 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4755.0:11279 5.8 e26/22 5:10b60c58:::benchmark_data_smithi096_19531_object11278:head v 26'723, mlcod=26'719)", 2024-04-19T03:02:01.647 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:42.066841+0000", 2024-04-19T03:02:01.647 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 19.485829773999999, 2024-04-19T03:02:01.647 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.021736267, 2024-04-19T03:02:01.647 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:02:01.647 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:01.647 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:02:01.647 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.647 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:02:01.648 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.066841+0000", 2024-04-19T03:02:01.648 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:01.648 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.648 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.648 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:02:01.648 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.066841+0000", 2024-04-19T03:02:01.648 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:01.648 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.648 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.648 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:02:01.648 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.066841+0000", 2024-04-19T03:02:01.648 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:01.649 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.649 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.649 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:02:01.649 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.066876+0000", 2024-04-19T03:02:01.649 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.4790999999999999e-05 2024-04-19T03:02:01.649 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.649 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.649 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:02:01.649 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.066880+0000", 2024-04-19T03:02:01.649 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.3610000000000003e-06 2024-04-19T03:02:01.649 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.649 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.649 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:02:01.649 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.066883+0000", 2024-04-19T03:02:01.650 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.4079999999999998e-06 2024-04-19T03:02:01.650 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.650 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.650 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:01.650 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.066929+0000", 2024-04-19T03:02:01.650 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.5444000000000001e-05 2024-04-19T03:02:01.650 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.650 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.650 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:02:01.650 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.066951+0000", 2024-04-19T03:02:01.650 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.2578999999999998e-05 2024-04-19T03:02:01.651 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.651 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.651 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:02:01.651 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.088518+0000", 2024-04-19T03:02:01.651 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.021566617 2024-04-19T03:02:01.651 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.651 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.651 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:02:01.651 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.088578+0000", 2024-04-19T03:02:01.651 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.9655999999999999e-05 2024-04-19T03:02:01.651 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:01.651 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:02:01.651 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:01.652 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.652 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.652 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4755.0:11282 5.e e26/22 5:75b7c510:::benchmark_data_smithi096_19531_object11281:head v 26'698, mlcod=26'693)", 2024-04-19T03:02:01.652 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:42.066923+0000", 2024-04-19T03:02:01.652 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 19.485747907, 2024-04-19T03:02:01.652 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.027436461999999998, 2024-04-19T03:02:01.652 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:02:01.652 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:01.652 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:02:01.652 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.652 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:02:01.652 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.066923+0000", 2024-04-19T03:02:01.652 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:01.652 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.653 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.653 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:02:01.653 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.066923+0000", 2024-04-19T03:02:01.653 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:01.653 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.653 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.653 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:02:01.653 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.066923+0000", 2024-04-19T03:02:01.653 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:01.653 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.653 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.654 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:02:01.654 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.066955+0000", 2024-04-19T03:02:01.654 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.2060999999999997e-05 2024-04-19T03:02:01.654 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.654 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.654 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:02:01.654 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.066962+0000", 2024-04-19T03:02:01.654 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.1969999999999999e-06 2024-04-19T03:02:01.654 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.655 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.655 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:02:01.655 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.066967+0000", 2024-04-19T03:02:01.655 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.6589999999999998e-06 2024-04-19T03:02:01.655 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.655 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.655 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:01.655 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.067762+0000", 2024-04-19T03:02:01.655 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00079538199999999997 2024-04-19T03:02:01.655 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.655 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.655 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:02:01.656 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.067782+0000", 2024-04-19T03:02:01.656 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.9432999999999998e-05 2024-04-19T03:02:01.656 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.656 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.656 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:02:01.656 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.094339+0000", 2024-04-19T03:02:01.656 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.026556778999999999 2024-04-19T03:02:01.656 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.656 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.656 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:02:01.656 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.094360+0000", 2024-04-19T03:02:01.656 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.1246e-05 2024-04-19T03:02:01.656 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:01.656 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:02:01.657 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:01.657 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.657 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.657 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4755.0:11291 5.a 5:5ee9d828:::benchmark_data_smithi096_19531_object11290:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T03:02:01.657 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:42.067725+0000", 2024-04-19T03:02:01.657 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 19.484945797000002, 2024-04-19T03:02:01.657 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.021089111000000001, 2024-04-19T03:02:01.657 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:02:01.657 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:01.657 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-04-19T03:02:01.657 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4755", 2024-04-19T03:02:01.657 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:01.657 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 11291 2024-04-19T03:02:01.657 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.658 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:02:01.658 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.658 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:02:01.658 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.067725+0000", 2024-04-19T03:02:01.658 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:01.658 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.658 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.658 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:02:01.658 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.067725+0000", 2024-04-19T03:02:01.658 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:01.658 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.658 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.659 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:02:01.659 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.067724+0000", 2024-04-19T03:02:01.659 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2024-04-19T03:02:01.659 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.659 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.659 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:02:01.659 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.067842+0000", 2024-04-19T03:02:01.659 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000117691 2024-04-19T03:02:01.659 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.659 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.659 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:02:01.659 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.067853+0000", 2024-04-19T03:02:01.659 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0679000000000001e-05 2024-04-19T03:02:01.659 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.660 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.660 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:02:01.660 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.067859+0000", 2024-04-19T03:02:01.660 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.9510000000000003e-06 2024-04-19T03:02:01.660 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.660 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.660 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:01.660 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.067905+0000", 2024-04-19T03:02:01.660 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.6242999999999998e-05 2024-04-19T03:02:01.660 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.660 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.660 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:02:01.660 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.085335+0000", 2024-04-19T03:02:01.660 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.017430451 2024-04-19T03:02:01.661 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.661 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.661 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 1", 2024-04-19T03:02:01.661 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.085538+0000", 2024-04-19T03:02:01.661 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000202511 2024-04-19T03:02:01.661 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.661 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.661 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:01.661 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.087988+0000", 2024-04-19T03:02:01.661 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0024505780000000001 2024-04-19T03:02:01.661 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.661 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.661 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:02:01.661 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.088672+0000", 2024-04-19T03:02:01.661 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00068377900000000003 2024-04-19T03:02:01.662 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.662 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.662 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:02:01.662 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.088757+0000", 2024-04-19T03:02:01.662 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.4384999999999999e-05 2024-04-19T03:02:01.662 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.662 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.662 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:02:01.662 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.088815+0000", 2024-04-19T03:02:01.662 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.7995999999999998e-05 2024-04-19T03:02:01.662 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:01.662 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:02:01.663 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:01.663 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.663 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.663 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4755.0:11293 5.c 5:31728bfd:::benchmark_data_smithi096_19531_object11292:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T03:02:01.663 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:42.068359+0000", 2024-04-19T03:02:01.663 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 19.484312082999999, 2024-04-19T03:02:01.663 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.022306475999999999, 2024-04-19T03:02:01.663 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:02:01.663 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:01.663 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-04-19T03:02:01.663 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4755", 2024-04-19T03:02:01.663 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:01.664 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 11293 2024-04-19T03:02:01.664 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.664 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:02:01.664 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.664 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:02:01.664 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.068359+0000", 2024-04-19T03:02:01.664 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:01.664 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.664 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.664 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:02:01.664 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.068359+0000", 2024-04-19T03:02:01.665 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:01.665 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.665 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.665 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:02:01.665 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.068358+0000", 2024-04-19T03:02:01.665 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2024-04-19T03:02:01.665 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.665 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.666 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:02:01.666 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.068427+0000", 2024-04-19T03:02:01.666 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.9139000000000003e-05 2024-04-19T03:02:01.666 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.666 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.666 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:02:01.666 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.085292+0000", 2024-04-19T03:02:01.666 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.016864371 2024-04-19T03:02:01.666 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.666 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.666 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:02:01.666 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.085306+0000", 2024-04-19T03:02:01.667 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.434e-05 2024-04-19T03:02:01.667 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.667 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.667 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:01.667 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.085404+0000", 2024-04-19T03:02:01.667 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.8145000000000003e-05 2024-04-19T03:02:01.667 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.667 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.667 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:02:01.667 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.085569+0000", 2024-04-19T03:02:01.667 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00016504099999999999 2024-04-19T03:02:01.667 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.667 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.667 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-04-19T03:02:01.668 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.085739+0000", 2024-04-19T03:02:01.668 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000170099 2024-04-19T03:02:01.668 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.668 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.668 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:02:01.668 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.089603+0000", 2024-04-19T03:02:01.668 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0038636080000000001 2024-04-19T03:02:01.668 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.668 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.668 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:01.668 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.090578+0000", 2024-04-19T03:02:01.669 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00097513199999999997 2024-04-19T03:02:01.669 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.669 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.669 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:02:01.669 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.090618+0000", 2024-04-19T03:02:01.669 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.9987999999999997e-05 2024-04-19T03:02:01.669 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.669 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.670 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:02:01.670 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.090666+0000", 2024-04-19T03:02:01.670 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.7420999999999999e-05 2024-04-19T03:02:01.670 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:01.670 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:02:01.670 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:01.670 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.670 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.671 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4755.0:11288 5.0 e26/22 5:042458d0:::benchmark_data_smithi096_19531_object11287:head v 26'772, mlcod=26'770)", 2024-04-19T03:02:01.671 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:42.068428+0000", 2024-04-19T03:02:01.671 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 19.484243681999999, 2024-04-19T03:02:01.671 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.020774925, 2024-04-19T03:02:01.671 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:02:01.671 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:01.671 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:02:01.671 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.671 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:02:01.671 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.068428+0000", 2024-04-19T03:02:01.671 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:01.672 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.672 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.672 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:02:01.672 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.068428+0000", 2024-04-19T03:02:01.672 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:01.672 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.672 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.672 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:02:01.672 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.068427+0000", 2024-04-19T03:02:01.672 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:01.672 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.673 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.673 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:02:01.673 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.068481+0000", 2024-04-19T03:02:01.673 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.3866999999999998e-05 2024-04-19T03:02:01.673 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.673 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.673 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:02:01.673 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.085273+0000", 2024-04-19T03:02:01.673 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.016792372999999999 2024-04-19T03:02:01.673 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.673 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.673 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:02:01.673 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.085288+0000", 2024-04-19T03:02:01.674 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4941e-05 2024-04-19T03:02:01.674 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.674 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.674 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:01.674 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.085350+0000", 2024-04-19T03:02:01.674 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.1550999999999994e-05 2024-04-19T03:02:01.674 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.674 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.674 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:02:01.674 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.085384+0000", 2024-04-19T03:02:01.674 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.4915e-05 2024-04-19T03:02:01.675 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.675 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.675 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:02:01.675 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.089164+0000", 2024-04-19T03:02:01.675 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0037794410000000001 2024-04-19T03:02:01.675 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.675 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.675 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:02:01.675 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.089202+0000", 2024-04-19T03:02:01.675 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.8519000000000002e-05 2024-04-19T03:02:01.675 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:01.675 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:02:01.675 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:01.676 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.676 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.676 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4755.0:43309 5.5 5:a621e8bb:::benchmark_data_smithi096_19531_object43308:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-19T03:02:01.676 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:56.475880+0000", 2024-04-19T03:02:01.676 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 5.0767913440000001, 2024-04-19T03:02:01.676 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.017826946, 2024-04-19T03:02:01.676 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:02:01.676 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:01.676 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-04-19T03:02:01.676 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4755", 2024-04-19T03:02:01.676 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:01.676 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 43309 2024-04-19T03:02:01.676 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.677 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:02:01.677 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.677 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:02:01.677 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:56.475880+0000", 2024-04-19T03:02:01.677 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:01.677 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.677 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.677 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:02:01.677 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:56.475880+0000", 2024-04-19T03:02:01.677 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:01.677 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.677 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.677 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:02:01.677 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:56.475879+0000", 2024-04-19T03:02:01.677 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2024-04-19T03:02:01.678 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.678 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.678 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:02:01.678 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:56.475928+0000", 2024-04-19T03:02:01.678 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.9211e-05 2024-04-19T03:02:01.678 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.678 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.678 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:02:01.678 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:56.475938+0000", 2024-04-19T03:02:01.678 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0584000000000001e-05 2024-04-19T03:02:01.678 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.678 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.678 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:02:01.678 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:56.475945+0000", 2024-04-19T03:02:01.679 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.9249999999999998e-06 2024-04-19T03:02:01.679 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.679 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.679 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:01.679 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:56.479557+0000", 2024-04-19T03:02:01.679 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0036113260000000002 2024-04-19T03:02:01.679 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.679 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.679 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:02:01.679 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:56.479658+0000", 2024-04-19T03:02:01.679 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00010131700000000001 2024-04-19T03:02:01.679 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.679 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.680 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-04-19T03:02:01.680 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:56.479740+0000", 2024-04-19T03:02:01.680 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.1746e-05 2024-04-19T03:02:01.680 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.680 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.680 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:02:01.680 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:56.486608+0000", 2024-04-19T03:02:01.680 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0068677649999999996 2024-04-19T03:02:01.680 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.680 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.680 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:01.680 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:56.493624+0000", 2024-04-19T03:02:01.680 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0070163109999999999 2024-04-19T03:02:01.680 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.681 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.681 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:02:01.681 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:56.493678+0000", 2024-04-19T03:02:01.681 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.4107999999999998e-05 2024-04-19T03:02:01.681 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.681 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.681 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:02:01.681 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:56.493707+0000", 2024-04-19T03:02:01.681 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.881e-05 2024-04-19T03:02:01.681 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:01.681 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:02:01.681 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:01.681 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.681 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.682 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4755.0:43739 5.c 5:3f98ce5a:::benchmark_data_smithi096_19531_object43738:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-19T03:02:01.682 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:56.699042+0000", 2024-04-19T03:02:01.682 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 4.8536287549999999, 2024-04-19T03:02:01.682 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.018275395, 2024-04-19T03:02:01.682 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:02:01.682 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:01.682 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-04-19T03:02:01.682 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4755", 2024-04-19T03:02:01.682 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:01.682 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 43739 2024-04-19T03:02:01.682 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.683 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:02:01.683 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.683 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:02:01.683 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:56.699042+0000", 2024-04-19T03:02:01.683 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:01.683 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.683 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.683 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:02:01.683 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:56.699042+0000", 2024-04-19T03:02:01.683 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:01.683 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.683 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.683 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:02:01.684 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:56.699041+0000", 2024-04-19T03:02:01.684 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2024-04-19T03:02:01.684 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.684 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.684 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:02:01.684 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:56.699129+0000", 2024-04-19T03:02:01.684 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.7989000000000001e-05 2024-04-19T03:02:01.684 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.684 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.684 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:02:01.684 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:56.699140+0000", 2024-04-19T03:02:01.684 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1034e-05 2024-04-19T03:02:01.684 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.684 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.685 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:02:01.685 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:56.699146+0000", 2024-04-19T03:02:01.685 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.9000000000000003e-06 2024-04-19T03:02:01.685 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.685 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.685 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:01.685 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:56.706318+0000", 2024-04-19T03:02:01.685 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0071715449999999997 2024-04-19T03:02:01.685 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.685 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.685 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:02:01.685 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:56.706444+0000", 2024-04-19T03:02:01.685 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012612499999999999 2024-04-19T03:02:01.685 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.686 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.686 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-04-19T03:02:01.686 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:56.706559+0000", 2024-04-19T03:02:01.686 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000114852 2024-04-19T03:02:01.686 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.686 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.686 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:02:01.686 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:56.711087+0000", 2024-04-19T03:02:01.686 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0045284790000000002 2024-04-19T03:02:01.686 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.686 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.686 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:01.686 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:56.717260+0000", 2024-04-19T03:02:01.686 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0061730229999999997 2024-04-19T03:02:01.687 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.687 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.687 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:02:01.687 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:56.717298+0000", 2024-04-19T03:02:01.687 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.7339999999999998e-05 2024-04-19T03:02:01.687 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.687 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.687 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:02:01.687 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:56.717318+0000", 2024-04-19T03:02:01.687 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.0119000000000002e-05 2024-04-19T03:02:01.687 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:01.687 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:02:01.687 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:01.688 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.688 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.688 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4755.0:50024 5.3 5:c305b2fc:::benchmark_data_smithi096_19531_object50023:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-19T03:02:01.688 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:02:00.031092+0000", 2024-04-19T03:02:01.688 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 1.521579027, 2024-04-19T03:02:01.688 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.018198532, 2024-04-19T03:02:01.688 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:02:01.688 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:01.688 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-04-19T03:02:01.688 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4755", 2024-04-19T03:02:01.688 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:01.688 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 50024 2024-04-19T03:02:01.688 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.688 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:02:01.688 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.689 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:02:01.689 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:00.031092+0000", 2024-04-19T03:02:01.689 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:01.689 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.689 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.689 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:02:01.689 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:00.031092+0000", 2024-04-19T03:02:01.689 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:01.689 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.689 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.689 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:02:01.689 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:00.031092+0000", 2024-04-19T03:02:01.689 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:01.689 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.690 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.690 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:02:01.690 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:00.031171+0000", 2024-04-19T03:02:01.690 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.9357999999999995e-05 2024-04-19T03:02:01.690 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.690 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.690 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:02:01.690 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:00.031179+0000", 2024-04-19T03:02:01.690 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.1620000000000008e-06 2024-04-19T03:02:01.690 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.690 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.690 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:02:01.690 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:00.031184+0000", 2024-04-19T03:02:01.690 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.5759999999999999e-06 2024-04-19T03:02:01.691 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.691 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.691 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:01.691 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:00.037963+0000", 2024-04-19T03:02:01.691 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0067791090000000002 2024-04-19T03:02:01.691 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.691 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.691 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:02:01.691 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:00.038275+0000", 2024-04-19T03:02:01.691 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00031208800000000002 2024-04-19T03:02:01.691 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.691 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.691 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-04-19T03:02:01.691 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:00.038567+0000", 2024-04-19T03:02:01.692 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00029232299999999999 2024-04-19T03:02:01.692 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.692 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.692 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:01.692 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:00.041440+0000", 2024-04-19T03:02:01.692 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0028727269999999998 2024-04-19T03:02:01.692 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.692 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.692 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:02:01.692 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:00.049171+0000", 2024-04-19T03:02:01.692 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.007731071 2024-04-19T03:02:01.692 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.692 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.692 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:02:01.693 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:00.049254+0000", 2024-04-19T03:02:01.693 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.2596999999999995e-05 2024-04-19T03:02:01.693 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:01.693 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:01.693 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:02:01.693 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:00.049291+0000", 2024-04-19T03:02:01.693 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.7168000000000001e-05 2024-04-19T03:02:01.693 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:01.693 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:02:01.693 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:01.693 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:01.693 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:02:01.693 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-04-19T03:02:01.695 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T03:02:01.695 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-04-19T03:02:01.690+0000 7f35986ab700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18243) UID: 0 2024-04-19T03:02:01.795 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:01.792+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:01.817 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-19T03:02:01.817 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-04-19T03:02:01.817 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:01.817 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:53270 5.e 5:78bf5071:::benchmark_data_smithi096_19531_object53269:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-19T03:02:01.818 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:01.808069+0000", 2024-04-19T03:02:01.818 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0084691179999999994, 2024-04-19T03:02:01.818 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0084996519999999999, 2024-04-19T03:02:01.818 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:01.818 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:02:01.818 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:01.818 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:01.818 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:01.818 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 53270 2024-04-19T03:02:01.818 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:01.818 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:01.818 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:01.819 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:01.819 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:01.808069+0000", 2024-04-19T03:02:01.819 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:01.819 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:01.819 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:01.819 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:01.819 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:01.808069+0000", 2024-04-19T03:02:01.819 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:01.819 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:01.819 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:01.819 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:01.819 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:01.808068+0000", 2024-04-19T03:02:01.819 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:01.819 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:01.820 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:01.820 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:01.820 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:01.808182+0000", 2024-04-19T03:02:01.820 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011405599999999999 2024-04-19T03:02:01.820 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:01.820 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:01.820 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:01.820 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:01.808194+0000", 2024-04-19T03:02:01.820 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1846e-05 2024-04-19T03:02:01.820 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:01.820 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:01.820 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:01.820 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:01.808201+0000", 2024-04-19T03:02:01.820 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.6260000000000003e-06 2024-04-19T03:02:01.821 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:01.821 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:01.821 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:01.821 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:01.808234+0000", 2024-04-19T03:02:01.821 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2916999999999997e-05 2024-04-19T03:02:01.821 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:01.821 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:01.821 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:01.821 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:01.808345+0000", 2024-04-19T03:02:01.821 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000110532 2024-04-19T03:02:01.821 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:01.822 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:01.822 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:01.822 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:01.808475+0000", 2024-04-19T03:02:01.822 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012990300000000001 2024-04-19T03:02:01.822 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:01.822 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:01.822 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:01.822 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:01.811422+0000", 2024-04-19T03:02:01.822 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0029475069999999998 2024-04-19T03:02:01.822 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:01.822 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:01.822 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:01.823 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:01.823 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:01.823 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:53278 5.4 5:2cfe042f:::benchmark_data_smithi096_19531_object53277:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-19T03:02:01.823 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:01.812902+0000", 2024-04-19T03:02:01.823 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0036356510000000002, 2024-04-19T03:02:01.823 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.003768778, 2024-04-19T03:02:01.823 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:01.823 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:02:01.823 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:01.823 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:01.823 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:01.823 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 53278 2024-04-19T03:02:01.823 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:01.823 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:01.824 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:01.824 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:01.824 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:01.812902+0000", 2024-04-19T03:02:01.824 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:01.824 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:01.824 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:01.824 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:01.824 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:01.812902+0000", 2024-04-19T03:02:01.824 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:01.824 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:01.824 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:01.824 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:01.824 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:01.812901+0000", 2024-04-19T03:02:01.825 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:01.825 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:01.825 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:01.825 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:01.825 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:01.812948+0000", 2024-04-19T03:02:01.825 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7231000000000002e-05 2024-04-19T03:02:01.825 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:01.825 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:01.825 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:01.825 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:01.812975+0000", 2024-04-19T03:02:01.826 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6681000000000001e-05 2024-04-19T03:02:01.826 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:01.826 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:01.826 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:01.826 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:01.812981+0000", 2024-04-19T03:02:01.826 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2140000000000001e-06 2024-04-19T03:02:01.826 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:01.826 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:01.826 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:01.826 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:01.813019+0000", 2024-04-19T03:02:01.826 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7392999999999999e-05 2024-04-19T03:02:01.826 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:01.826 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:01.827 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:01.827 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:01.813141+0000", 2024-04-19T03:02:01.827 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012263000000000001 2024-04-19T03:02:01.827 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:01.827 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:01.827 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:01.827 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:01.813236+0000", 2024-04-19T03:02:01.827 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.4135000000000006e-05 2024-04-19T03:02:01.827 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:01.827 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:01.827 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:01.827 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:01.815380+0000", 2024-04-19T03:02:01.828 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0021442140000000002 2024-04-19T03:02:01.828 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:01.828 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:01.828 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:01.828 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:01.828 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:01.828 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:53279 5.e 5:72989f65:::benchmark_data_smithi096_19531_object53278:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-19T03:02:01.828 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:01.812993+0000", 2024-04-19T03:02:01.828 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0035443839999999998, 2024-04-19T03:02:01.828 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0037718249999999999, 2024-04-19T03:02:01.829 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:01.829 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:02:01.829 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:01.829 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:01.829 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:01.829 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 53279 2024-04-19T03:02:01.829 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:01.830 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:01.830 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:01.830 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:01.830 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:01.812993+0000", 2024-04-19T03:02:01.830 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:01.830 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:01.830 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:01.830 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:01.830 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:01.812993+0000", 2024-04-19T03:02:01.830 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:01.831 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:01.831 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:01.831 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:01.831 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:01.812993+0000", 2024-04-19T03:02:01.831 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:01.831 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:01.831 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:01.831 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:01.831 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:01.813029+0000", 2024-04-19T03:02:01.831 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6637999999999997e-05 2024-04-19T03:02:01.831 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:01.831 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:01.831 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:01.832 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:01.813037+0000", 2024-04-19T03:02:01.832 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.1389999999999998e-06 2024-04-19T03:02:01.832 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:01.832 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:01.832 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:01.832 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:01.813042+0000", 2024-04-19T03:02:01.833 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8309999999999997e-06 2024-04-19T03:02:01.833 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:01.833 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:01.833 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:01.833 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:01.813084+0000", 2024-04-19T03:02:01.834 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1961e-05 2024-04-19T03:02:01.834 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:01.834 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:01.834 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:01.834 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:01.813176+0000", 2024-04-19T03:02:01.834 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1304000000000005e-05 2024-04-19T03:02:01.835 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:01.835 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:01.835 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:01.835 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:01.813273+0000", 2024-04-19T03:02:01.835 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.7541999999999995e-05 2024-04-19T03:02:01.835 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:01.835 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:01.835 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:01.835 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:01.835 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:01.835 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:53282 5.d 5:b2a19c9a:::benchmark_data_smithi096_19531_object53281:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-19T03:02:01.836 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:01.814507+0000", 2024-04-19T03:02:01.836 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0020310329999999998, 2024-04-19T03:02:01.836 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0023575430000000001, 2024-04-19T03:02:01.836 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:01.836 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:02:01.836 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:01.837 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:01.837 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:01.837 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 53282 2024-04-19T03:02:01.837 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:01.837 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:01.837 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:01.837 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:01.837 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:01.814507+0000", 2024-04-19T03:02:01.837 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:01.837 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:01.837 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:01.837 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:01.838 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:01.814507+0000", 2024-04-19T03:02:01.838 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:01.838 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:01.838 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:01.838 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:01.838 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:01.814506+0000", 2024-04-19T03:02:01.838 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:01.838 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:01.838 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:01.838 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:01.838 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:01.814558+0000", 2024-04-19T03:02:01.838 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1839000000000003e-05 2024-04-19T03:02:01.838 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:01.839 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:01.839 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:01.839 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:01.814572+0000", 2024-04-19T03:02:01.839 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4887e-05 2024-04-19T03:02:01.839 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:01.839 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:01.839 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:01.839 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:01.814580+0000", 2024-04-19T03:02:01.839 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.7649999999999993e-06 2024-04-19T03:02:01.839 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:01.839 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:01.839 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:01.839 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:01.814629+0000", 2024-04-19T03:02:01.840 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8466e-05 2024-04-19T03:02:01.840 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:01.840 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:01.840 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:01.840 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:01.814745+0000", 2024-04-19T03:02:01.840 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000116284 2024-04-19T03:02:01.840 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:01.840 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:01.840 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-04-19T03:02:01.841 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:01.814829+0000", 2024-04-19T03:02:01.841 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.4587999999999997e-05 2024-04-19T03:02:01.841 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:01.841 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:01.841 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:01.841 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:01.841 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:01.841 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:53285 5.d 5.9b9b9c0d (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-19T03:02:01.842 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:01.815066+0000", 2024-04-19T03:02:01.842 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.001471773, 2024-04-19T03:02:01.842 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0018802140000000001, 2024-04-19T03:02:01.842 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:01.842 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-04-19T03:02:01.842 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:01.842 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:01.842 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:01.843 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 53285 2024-04-19T03:02:01.843 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:01.843 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:01.843 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:01.843 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:01.843 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:01.815066+0000", 2024-04-19T03:02:01.843 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:01.843 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:01.844 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:01.844 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:01.844 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:01.815066+0000", 2024-04-19T03:02:01.844 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:01.844 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:01.844 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:01.844 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:01.844 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:01.815065+0000", 2024-04-19T03:02:01.845 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:01.845 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:01.845 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:01.845 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:01.845 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:01.815125+0000", 2024-04-19T03:02:01.845 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0102000000000002e-05 2024-04-19T03:02:01.846 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:01.846 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:01.846 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:01.846 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:01.815137+0000", 2024-04-19T03:02:01.846 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1644000000000001e-05 2024-04-19T03:02:01.846 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:01.847 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:01.847 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:01.847 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:01.815144+0000", 2024-04-19T03:02:01.847 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3130000000000001e-06 2024-04-19T03:02:01.847 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:01.847 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:01.848 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:01.848 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:01.848 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:01.848 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4755.0:53283 5.f e34/22 5:ff1652b4:::benchmark_data_smithi096_19531_object53282:head v 34'3358, mlcod=34'3356)", 2024-04-19T03:02:01.848 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:01.815343+0000", 2024-04-19T03:02:01.848 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.001194924, 2024-04-19T03:02:01.848 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001667848, 2024-04-19T03:02:01.848 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:01.849 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-19T03:02:01.849 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:01.849 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:01.849 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:01.849 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:01.815343+0000", 2024-04-19T03:02:01.849 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:01.849 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:01.850 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:01.850 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:01.850 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:01.815343+0000", 2024-04-19T03:02:01.850 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:01.850 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:01.850 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:01.851 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:01.851 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:01.815342+0000", 2024-04-19T03:02:01.851 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:01.851 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:01.851 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:01.851 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:01.852 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:01.815411+0000", 2024-04-19T03:02:01.852 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.9091000000000006e-05 2024-04-19T03:02:01.852 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:01.852 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:01.852 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:01.852 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:01.815428+0000", 2024-04-19T03:02:01.852 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6665999999999999e-05 2024-04-19T03:02:01.852 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:01.852 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:01.852 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:01.853 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:01.815439+0000", 2024-04-19T03:02:01.853 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1138000000000001e-05 2024-04-19T03:02:01.853 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:01.853 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:01.853 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:01.853 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:01.815484+0000", 2024-04-19T03:02:01.853 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5540000000000001e-05 2024-04-19T03:02:01.853 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:01.853 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:01.853 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:01.853 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:01.815499+0000", 2024-04-19T03:02:01.853 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4965e-05 2024-04-19T03:02:01.853 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:01.853 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:01.854 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:01.854 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:01.854 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:01.854 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop_reply(client.4755.0:53270 5.e e34/22)", 2024-04-19T03:02:01.854 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:01.817038+0000", 2024-04-19T03:02:01.854 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 4294967295.9995003, 2024-04-19T03:02:01.854 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1715000000000003e-05, 2024-04-19T03:02:01.854 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:01.854 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-04-19T03:02:01.854 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:01.854 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:01.854 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:01.854 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:01.817038+0000", 2024-04-19T03:02:01.855 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:01.855 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:01.855 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:01.855 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:01.855 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:01.817038+0000", 2024-04-19T03:02:01.855 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:01.855 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:01.855 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:01.855 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:01.855 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:01.817037+0000", 2024-04-19T03:02:01.855 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:01.855 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:01.855 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:01.855 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:01.856 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:01.817041+0000", 2024-04-19T03:02:01.856 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1690000000000002e-06 2024-04-19T03:02:01.856 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:01.856 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:01.856 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:01.856 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:01.817053+0000", 2024-04-19T03:02:01.856 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.168e-05 2024-04-19T03:02:01.856 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:01.856 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:01.856 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:01.856 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:01.817067+0000", 2024-04-19T03:02:01.856 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3890000000000001e-05 2024-04-19T03:02:01.856 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:01.856 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:01.857 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:01.857 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:01.857 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-04-19T03:02:01.857 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 7 2024-04-19T03:02:01.857 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-19T03:02:01.857 INFO:tasks.radosbench.radosbench.0.smithi096.stdout: 24 16 53298 53282 138.74 112.188 0.00897108 0.00720139 2024-04-19T03:02:01.858 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T03:02:01.904 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:01.904+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:01.960 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-19T03:02:01.979 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-19T03:02:01.980 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-04-19T03:02:01.980 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-04-19T03:02:01.980 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-04-19T03:02:01.980 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-19T03:02:01.991 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T03:02:01.998 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:01.993+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:02.099 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:02.096+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:02.107 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0: {} 2024-04-19T03:02:02.116 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-19T03:02:02.116 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-04-19T03:02:02.116 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-04-19T03:02:02.116 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-04-19T03:02:02.116 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.116 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:9 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:02:02.117 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:14.999380+0000", 2024-04-19T03:02:02.117 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 47.115454532000001, 2024-04-19T03:02:02.117 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.019009906, 2024-04-19T03:02:02.117 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:02.117 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:02.117 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:02.117 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.117 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:02.117 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999380+0000", 2024-04-19T03:02:02.117 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:02.117 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.117 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.117 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:02.118 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999380+0000", 2024-04-19T03:02:02.118 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:02.118 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.118 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.118 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:02.118 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999377+0000", 2024-04-19T03:02:02.118 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999971 2024-04-19T03:02:02.118 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.118 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.118 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:02.118 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999393+0000", 2024-04-19T03:02:02.118 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5665999999999999e-05 2024-04-19T03:02:02.118 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.119 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.119 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:02.119 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999416+0000", 2024-04-19T03:02:02.119 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3030000000000001e-05 2024-04-19T03:02:02.119 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.119 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.119 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:02.119 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999439+0000", 2024-04-19T03:02:02.119 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3203000000000001e-05 2024-04-19T03:02:02.119 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.119 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.119 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:02.119 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999564+0000", 2024-04-19T03:02:02.119 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012492800000000001 2024-04-19T03:02:02.120 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.120 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.120 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op must wait for map", 2024-04-19T03:02:02.120 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999573+0000", 2024-04-19T03:02:02.120 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.7129999999999994e-06 2024-04-19T03:02:02.120 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.120 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.120 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:02.120 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.005623+0000", 2024-04-19T03:02:02.120 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0060502120000000001 2024-04-19T03:02:02.120 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.120 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.120 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:02.121 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.006510+0000", 2024-04-19T03:02:02.121 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00088656 2024-04-19T03:02:02.121 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.121 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.121 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-04-19T03:02:02.121 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.008004+0000", 2024-04-19T03:02:02.121 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0014948240000000001 2024-04-19T03:02:02.121 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.121 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.121 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:02.121 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.011874+0000", 2024-04-19T03:02:02.121 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0038699630000000001 2024-04-19T03:02:02.122 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.122 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.122 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:02.122 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.018000+0000", 2024-04-19T03:02:02.122 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0061254389999999999 2024-04-19T03:02:02.122 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.122 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.122 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:02.122 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.018281+0000", 2024-04-19T03:02:02.122 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00028121400000000001 2024-04-19T03:02:02.122 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.122 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.122 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:02.123 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.018390+0000", 2024-04-19T03:02:02.123 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010899 2024-04-19T03:02:02.123 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:02.123 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:02.123 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:02.123 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.123 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.123 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:10 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:02:02.123 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:14.999496+0000", 2024-04-19T03:02:02.123 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 47.115338997000002, 2024-04-19T03:02:02.123 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.022720497999999999, 2024-04-19T03:02:02.123 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:02.123 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:02.124 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:02.124 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.124 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:02.124 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999496+0000", 2024-04-19T03:02:02.124 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:02.124 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.124 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.124 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:02.124 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999496+0000", 2024-04-19T03:02:02.124 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:02.124 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.124 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.124 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:02.124 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999494+0000", 2024-04-19T03:02:02.125 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:02.125 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.125 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.125 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:02.125 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999503+0000", 2024-04-19T03:02:02.125 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.5930000000000006e-06 2024-04-19T03:02:02.125 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.125 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.125 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:02.125 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999523+0000", 2024-04-19T03:02:02.125 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9553000000000001e-05 2024-04-19T03:02:02.125 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.125 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.126 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:02.126 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999538+0000", 2024-04-19T03:02:02.126 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5702999999999999e-05 2024-04-19T03:02:02.126 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.126 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.126 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:02.126 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999608+0000", 2024-04-19T03:02:02.126 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.9912000000000004e-05 2024-04-19T03:02:02.126 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.126 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.126 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op must wait for map", 2024-04-19T03:02:02.126 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999626+0000", 2024-04-19T03:02:02.126 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8207e-05 2024-04-19T03:02:02.127 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.127 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.127 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:02.127 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.010765+0000", 2024-04-19T03:02:02.127 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011138719 2024-04-19T03:02:02.127 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.127 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.127 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:02.127 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.010906+0000", 2024-04-19T03:02:02.127 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014095899999999999 2024-04-19T03:02:02.127 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.127 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.127 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-04-19T03:02:02.127 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.011472+0000", 2024-04-19T03:02:02.127 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00056629300000000005 2024-04-19T03:02:02.128 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.128 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.128 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:02.128 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.013217+0000", 2024-04-19T03:02:02.128 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001744317 2024-04-19T03:02:02.128 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.128 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.128 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:02.128 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.022083+0000", 2024-04-19T03:02:02.128 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0088663849999999992 2024-04-19T03:02:02.128 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.128 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.128 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:02.129 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.022124+0000", 2024-04-19T03:02:02.129 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.057e-05 2024-04-19T03:02:02.129 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.129 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.129 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:02.129 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.022216+0000", 2024-04-19T03:02:02.129 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.2417000000000006e-05 2024-04-19T03:02:02.129 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:02.129 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:02.129 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:02.129 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.129 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.129 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:13 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:02:02.129 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:14.999564+0000", 2024-04-19T03:02:02.130 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 47.115270115000001, 2024-04-19T03:02:02.130 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.019594777000000001, 2024-04-19T03:02:02.130 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:02.130 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:02.130 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:02.130 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.130 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:02.130 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999564+0000", 2024-04-19T03:02:02.130 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:02.130 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.130 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.130 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:02.131 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999564+0000", 2024-04-19T03:02:02.131 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:02.131 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.131 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.131 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:02.131 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999563+0000", 2024-04-19T03:02:02.131 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:02.131 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.131 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.131 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:02.131 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999582+0000", 2024-04-19T03:02:02.131 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8151999999999998e-05 2024-04-19T03:02:02.131 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.131 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.131 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:02.132 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999599+0000", 2024-04-19T03:02:02.132 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7583000000000001e-05 2024-04-19T03:02:02.132 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.132 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.132 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:02.132 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999618+0000", 2024-04-19T03:02:02.132 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8989999999999999e-05 2024-04-19T03:02:02.132 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.132 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.132 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:02.132 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999692+0000", 2024-04-19T03:02:02.132 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3561999999999998e-05 2024-04-19T03:02:02.132 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.132 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.133 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op must wait for map", 2024-04-19T03:02:02.133 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999698+0000", 2024-04-19T03:02:02.133 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7159999999999997e-06 2024-04-19T03:02:02.133 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.133 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.133 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:02.133 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.007836+0000", 2024-04-19T03:02:02.133 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0081376520000000004 2024-04-19T03:02:02.133 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.133 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.133 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:02.133 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.008208+0000", 2024-04-19T03:02:02.133 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00037223699999999998 2024-04-19T03:02:02.134 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.134 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.134 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-04-19T03:02:02.134 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.008516+0000", 2024-04-19T03:02:02.134 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000308227 2024-04-19T03:02:02.134 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.134 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.134 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:02.134 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.011585+0000", 2024-04-19T03:02:02.134 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0030680659999999999 2024-04-19T03:02:02.134 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.134 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.134 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:02.135 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.018871+0000", 2024-04-19T03:02:02.135 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0072861369999999998 2024-04-19T03:02:02.135 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.135 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.135 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:02.135 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.019067+0000", 2024-04-19T03:02:02.135 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00019672099999999999 2024-04-19T03:02:02.135 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.135 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.135 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:02.135 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.019159+0000", 2024-04-19T03:02:02.135 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1829999999999993e-05 2024-04-19T03:02:02.135 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:02.135 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:02.136 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:02.136 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.136 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.136 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:32 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:02:02.136 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:14.999712+0000", 2024-04-19T03:02:02.136 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 47.115122753999998, 2024-04-19T03:02:02.136 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.022635437000000001, 2024-04-19T03:02:02.136 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:02.136 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:02.136 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:02.136 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.136 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:02.136 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999712+0000", 2024-04-19T03:02:02.136 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:02.137 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.137 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.137 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:02.137 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999712+0000", 2024-04-19T03:02:02.137 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:02.137 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.137 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.137 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:02.137 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999711+0000", 2024-04-19T03:02:02.137 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:02.137 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.137 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.137 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:02.137 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999719+0000", 2024-04-19T03:02:02.137 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.354e-06 2024-04-19T03:02:02.138 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.138 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.138 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:02.138 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999735+0000", 2024-04-19T03:02:02.138 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6288999999999999e-05 2024-04-19T03:02:02.138 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.138 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.138 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:02.138 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999749+0000", 2024-04-19T03:02:02.138 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3492999999999999e-05 2024-04-19T03:02:02.138 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.138 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.138 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:02.139 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999811+0000", 2024-04-19T03:02:02.139 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2298999999999994e-05 2024-04-19T03:02:02.139 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.139 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.139 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:02:02.139 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999817+0000", 2024-04-19T03:02:02.139 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2169999999999999e-06 2024-04-19T03:02:02.139 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.139 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.139 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:02.139 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.011836+0000", 2024-04-19T03:02:02.139 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.012018008 2024-04-19T03:02:02.139 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.139 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.139 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:02.140 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.011897+0000", 2024-04-19T03:02:02.140 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1111000000000005e-05 2024-04-19T03:02:02.140 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.140 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.140 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-04-19T03:02:02.140 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.011980+0000", 2024-04-19T03:02:02.140 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3003999999999993e-05 2024-04-19T03:02:02.140 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.140 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.140 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:02.140 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.013863+0000", 2024-04-19T03:02:02.140 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001883804 2024-04-19T03:02:02.140 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.140 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.141 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:02.141 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.022257+0000", 2024-04-19T03:02:02.141 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0083938290000000002 2024-04-19T03:02:02.141 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.141 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.141 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:02.141 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.022310+0000", 2024-04-19T03:02:02.141 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.236e-05 2024-04-19T03:02:02.141 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.141 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.141 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:02.141 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.022347+0000", 2024-04-19T03:02:02.141 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7653e-05 2024-04-19T03:02:02.141 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:02.142 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:02.142 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:02.142 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.142 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.142 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:35 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:02:02.142 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:14.999772+0000", 2024-04-19T03:02:02.142 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 47.115062475000002, 2024-04-19T03:02:02.142 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020205530999999999, 2024-04-19T03:02:02.142 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:02.142 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:02.142 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:02.142 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.142 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:02.142 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999772+0000", 2024-04-19T03:02:02.143 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:02.143 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.143 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.143 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:02.143 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999772+0000", 2024-04-19T03:02:02.143 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:02.143 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.143 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.143 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:02.143 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999771+0000", 2024-04-19T03:02:02.143 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:02.143 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.143 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.143 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:02.143 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999778+0000", 2024-04-19T03:02:02.144 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2200000000000003e-06 2024-04-19T03:02:02.144 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.144 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.144 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:02.144 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999794+0000", 2024-04-19T03:02:02.144 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5798999999999999e-05 2024-04-19T03:02:02.144 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.144 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.144 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:02.144 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999809+0000", 2024-04-19T03:02:02.144 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.469e-05 2024-04-19T03:02:02.144 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.144 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.145 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:02.145 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999915+0000", 2024-04-19T03:02:02.145 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000105658 2024-04-19T03:02:02.145 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.145 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.145 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:02:02.145 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999927+0000", 2024-04-19T03:02:02.145 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.201e-05 2024-04-19T03:02:02.145 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.145 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.145 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:02.145 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.009841+0000", 2024-04-19T03:02:02.145 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0099147039999999999 2024-04-19T03:02:02.145 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.146 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.146 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:02.146 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.009941+0000", 2024-04-19T03:02:02.146 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.9461000000000002e-05 2024-04-19T03:02:02.146 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.146 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.146 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-04-19T03:02:02.146 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.010101+0000", 2024-04-19T03:02:02.146 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016028599999999999 2024-04-19T03:02:02.146 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.146 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.146 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:02.146 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.011787+0000", 2024-04-19T03:02:02.146 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001685513 2024-04-19T03:02:02.147 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.147 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.147 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:02.147 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.019889+0000", 2024-04-19T03:02:02.147 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0081026559999999997 2024-04-19T03:02:02.147 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.147 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.147 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:02.147 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.019932+0000", 2024-04-19T03:02:02.147 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2385000000000002e-05 2024-04-19T03:02:02.147 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.147 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.147 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:02.147 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.019978+0000", 2024-04-19T03:02:02.148 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6093000000000001e-05 2024-04-19T03:02:02.148 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:02.149 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:02.149 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:02.149 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.149 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.149 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:18 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:02:02.149 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:14.999834+0000", 2024-04-19T03:02:02.149 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 47.115000389999999, 2024-04-19T03:02:02.149 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.019567312999999999, 2024-04-19T03:02:02.149 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:02.149 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:02.149 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:02.149 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.149 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:02.150 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999834+0000", 2024-04-19T03:02:02.150 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:02.150 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.150 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.150 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:02.150 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999834+0000", 2024-04-19T03:02:02.150 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:02.150 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.150 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.150 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:02.150 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999833+0000", 2024-04-19T03:02:02.150 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:02.150 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.150 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.151 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:02.151 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999842+0000", 2024-04-19T03:02:02.151 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.2269999999999999e-06 2024-04-19T03:02:02.151 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.151 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.151 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:02.151 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999860+0000", 2024-04-19T03:02:02.151 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8456000000000001e-05 2024-04-19T03:02:02.151 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.151 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.151 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:02.151 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999874+0000", 2024-04-19T03:02:02.151 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3263e-05 2024-04-19T03:02:02.151 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.152 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.152 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:02.152 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999934+0000", 2024-04-19T03:02:02.152 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0888999999999999e-05 2024-04-19T03:02:02.152 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.152 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.152 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:02:02.152 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999940+0000", 2024-04-19T03:02:02.152 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4330000000000003e-06 2024-04-19T03:02:02.152 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.152 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.152 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:02.152 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.010943+0000", 2024-04-19T03:02:02.152 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011002786000000001 2024-04-19T03:02:02.153 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.153 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.153 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:02.153 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.011078+0000", 2024-04-19T03:02:02.153 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013541000000000001 2024-04-19T03:02:02.153 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.153 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.153 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-04-19T03:02:02.153 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.011172+0000", 2024-04-19T03:02:02.153 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.3459000000000001e-05 2024-04-19T03:02:02.153 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.153 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.153 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:02.153 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.013211+0000", 2024-04-19T03:02:02.153 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0020397710000000001 2024-04-19T03:02:02.154 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.154 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.154 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:02.154 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.019320+0000", 2024-04-19T03:02:02.154 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0061089969999999997 2024-04-19T03:02:02.154 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.154 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.154 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:02.154 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.019364+0000", 2024-04-19T03:02:02.154 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4158e-05 2024-04-19T03:02:02.154 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.154 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.154 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:02.154 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.019402+0000", 2024-04-19T03:02:02.155 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7011000000000002e-05 2024-04-19T03:02:02.155 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:02.155 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:02.155 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:02.155 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.155 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.155 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:24 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:02:02.155 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:14.999964+0000", 2024-04-19T03:02:02.155 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 47.114871076, 2024-04-19T03:02:02.155 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020451446000000002, 2024-04-19T03:02:02.155 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:02.155 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-19T03:02:02.155 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:02.155 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.156 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:02.156 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999964+0000", 2024-04-19T03:02:02.156 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:02.156 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.156 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.156 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:02.156 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999964+0000", 2024-04-19T03:02:02.156 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:02.156 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.156 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.156 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:02.156 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999963+0000", 2024-04-19T03:02:02.156 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:02.156 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.157 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.157 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:02.157 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999969+0000", 2024-04-19T03:02:02.157 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0270000000000001e-06 2024-04-19T03:02:02.157 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.157 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.157 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:02.157 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999984+0000", 2024-04-19T03:02:02.157 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5903e-05 2024-04-19T03:02:02.157 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.157 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.157 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:02.157 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999998+0000", 2024-04-19T03:02:02.157 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3076e-05 2024-04-19T03:02:02.158 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.158 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.158 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:02.158 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.000078+0000", 2024-04-19T03:02:02.158 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0525000000000006e-05 2024-04-19T03:02:02.158 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.158 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.158 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op must wait for map", 2024-04-19T03:02:02.158 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.000084+0000", 2024-04-19T03:02:02.158 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8370000000000002e-06 2024-04-19T03:02:02.158 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.158 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.158 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:02.158 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.008819+0000", 2024-04-19T03:02:02.159 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0087349019999999993 2024-04-19T03:02:02.159 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.159 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.159 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:02.159 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.009018+0000", 2024-04-19T03:02:02.159 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000198989 2024-04-19T03:02:02.159 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.159 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.159 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:02.159 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.020415+0000", 2024-04-19T03:02:02.159 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011397157 2024-04-19T03:02:02.159 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:02.159 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:02.159 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:02.160 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.160 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.160 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:11274 5.e 5:7c846032:::benchmark_data_smithi096_19531_object11273:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T03:02:02.160 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:42.061776+0000", 2024-04-19T03:02:02.160 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 20.053058831000001, 2024-04-19T03:02:02.160 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.035381001000000002, 2024-04-19T03:02:02.160 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:02.160 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:02.160 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:02.160 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:02.160 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:02.160 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 11274 2024-04-19T03:02:02.160 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.160 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:02.161 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.161 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:02.161 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.061776+0000", 2024-04-19T03:02:02.161 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:02.161 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.161 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.161 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:02.161 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.061776+0000", 2024-04-19T03:02:02.161 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:02.161 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.161 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.161 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:02.161 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.061775+0000", 2024-04-19T03:02:02.161 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:02.162 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.162 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.162 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:02.162 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.061807+0000", 2024-04-19T03:02:02.162 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1733000000000003e-05 2024-04-19T03:02:02.162 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.162 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.162 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:02.162 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.061822+0000", 2024-04-19T03:02:02.162 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5452999999999999e-05 2024-04-19T03:02:02.162 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.162 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.162 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:02.162 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.061827+0000", 2024-04-19T03:02:02.163 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9810000000000003e-06 2024-04-19T03:02:02.163 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.163 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.163 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:02.163 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.063388+0000", 2024-04-19T03:02:02.163 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0015605720000000001 2024-04-19T03:02:02.163 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.163 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.163 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:02.163 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.063612+0000", 2024-04-19T03:02:02.163 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00022431 2024-04-19T03:02:02.163 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.163 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.164 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:02.164 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.063747+0000", 2024-04-19T03:02:02.164 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013459600000000001 2024-04-19T03:02:02.164 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.164 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.164 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:02.164 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.066186+0000", 2024-04-19T03:02:02.164 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0024388909999999999 2024-04-19T03:02:02.164 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.164 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.164 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:02.164 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.097016+0000", 2024-04-19T03:02:02.164 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.030830705 2024-04-19T03:02:02.164 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.164 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.165 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:02.165 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.097096+0000", 2024-04-19T03:02:02.165 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.9469999999999996e-05 2024-04-19T03:02:02.165 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.165 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.165 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:02.165 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.097157+0000", 2024-04-19T03:02:02.165 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0884999999999997e-05 2024-04-19T03:02:02.165 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:02.165 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:02.165 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:02.165 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.165 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.165 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:11279 5.8 5:10b60c58:::benchmark_data_smithi096_19531_object11278:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T03:02:02.166 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:42.062594+0000", 2024-04-19T03:02:02.166 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 20.052240393000002, 2024-04-19T03:02:02.166 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.028696788000000001, 2024-04-19T03:02:02.166 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:02.166 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:02.166 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:02.166 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:02.166 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:02.166 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 11279 2024-04-19T03:02:02.166 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.166 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:02.166 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.166 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:02.167 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.062594+0000", 2024-04-19T03:02:02.167 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:02.167 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.167 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.167 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:02.167 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.062594+0000", 2024-04-19T03:02:02.167 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:02.167 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.167 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.167 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:02.167 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.062593+0000", 2024-04-19T03:02:02.167 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:02.167 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.167 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.168 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:02.168 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.062646+0000", 2024-04-19T03:02:02.168 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2293999999999998e-05 2024-04-19T03:02:02.168 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.168 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.168 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:02.168 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.062657+0000", 2024-04-19T03:02:02.168 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1440000000000001e-05 2024-04-19T03:02:02.168 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.168 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.168 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:02.168 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.062665+0000", 2024-04-19T03:02:02.168 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5159999999999997e-06 2024-04-19T03:02:02.168 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.169 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.169 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:02.169 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.063799+0000", 2024-04-19T03:02:02.169 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0011344860000000001 2024-04-19T03:02:02.169 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.169 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.169 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:02.169 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.063962+0000", 2024-04-19T03:02:02.169 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000162614 2024-04-19T03:02:02.169 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.169 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.169 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:02.169 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.064167+0000", 2024-04-19T03:02:02.169 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00020491699999999999 2024-04-19T03:02:02.170 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.170 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.170 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:02.170 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.066768+0000", 2024-04-19T03:02:02.170 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0026012090000000002 2024-04-19T03:02:02.170 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.170 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.170 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:02.170 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.091184+0000", 2024-04-19T03:02:02.170 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.024416582999999999 2024-04-19T03:02:02.170 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.170 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.170 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:02.170 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.091251+0000", 2024-04-19T03:02:02.171 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6753000000000003e-05 2024-04-19T03:02:02.171 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.171 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.171 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:02.171 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.091291+0000", 2024-04-19T03:02:02.171 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9841e-05 2024-04-19T03:02:02.171 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:02.171 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:02.171 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:02.171 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.171 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.171 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:11282 5.e 5:75b7c510:::benchmark_data_smithi096_19531_object11281:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T03:02:02.171 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:42.062674+0000", 2024-04-19T03:02:02.171 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 20.052160937, 2024-04-19T03:02:02.172 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.034812849, 2024-04-19T03:02:02.172 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:02.172 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:02.172 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:02.172 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:02.172 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:02.172 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 11282 2024-04-19T03:02:02.172 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.172 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:02.172 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.172 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:02.172 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.062674+0000", 2024-04-19T03:02:02.172 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:02.173 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.173 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.173 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:02.173 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.062674+0000", 2024-04-19T03:02:02.173 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:02.173 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.173 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.173 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:02.173 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.062673+0000", 2024-04-19T03:02:02.173 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:02.173 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.173 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.173 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:02.173 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.062712+0000", 2024-04-19T03:02:02.173 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9341999999999997e-05 2024-04-19T03:02:02.174 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.174 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.174 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:02.174 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.062721+0000", 2024-04-19T03:02:02.174 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1700000000000003e-06 2024-04-19T03:02:02.174 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.174 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.174 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:02.174 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.062729+0000", 2024-04-19T03:02:02.174 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4240000000000004e-06 2024-04-19T03:02:02.174 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.174 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.175 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:02.175 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.065017+0000", 2024-04-19T03:02:02.175 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0022878590000000002 2024-04-19T03:02:02.175 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.175 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.175 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:02.175 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.065207+0000", 2024-04-19T03:02:02.175 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000190411 2024-04-19T03:02:02.175 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.175 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.175 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:02.175 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.065323+0000", 2024-04-19T03:02:02.175 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000115593 2024-04-19T03:02:02.175 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.176 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.176 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:02.176 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.069683+0000", 2024-04-19T03:02:02.176 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0043604409999999996 2024-04-19T03:02:02.176 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.176 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.176 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:02.176 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.097273+0000", 2024-04-19T03:02:02.176 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.027589516000000001 2024-04-19T03:02:02.176 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.176 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.176 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:02.176 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.097406+0000", 2024-04-19T03:02:02.176 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000133514 2024-04-19T03:02:02.176 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.177 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.177 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:02.177 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.097486+0000", 2024-04-19T03:02:02.177 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0479e-05 2024-04-19T03:02:02.177 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:02.177 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:02.177 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:02.177 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.177 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.177 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:11288 5.0 5:042458d0:::benchmark_data_smithi096_19531_object11287:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T03:02:02.177 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:42.070352+0000", 2024-04-19T03:02:02.177 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 20.044483009, 2024-04-19T03:02:02.177 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.021532447, 2024-04-19T03:02:02.177 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:02.178 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:02.178 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:02.178 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:02.178 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:02.178 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 11288 2024-04-19T03:02:02.178 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.178 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:02.178 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.178 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:02.178 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.070352+0000", 2024-04-19T03:02:02.178 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:02.178 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.178 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.179 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:02.179 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.070352+0000", 2024-04-19T03:02:02.179 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:02.179 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.179 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.179 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:02.179 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.070351+0000", 2024-04-19T03:02:02.179 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:02.179 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.179 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.179 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:02.179 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.070392+0000", 2024-04-19T03:02:02.179 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1077e-05 2024-04-19T03:02:02.179 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.180 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.180 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:02.180 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.070398+0000", 2024-04-19T03:02:02.180 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1109999999999996e-06 2024-04-19T03:02:02.180 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.180 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.180 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:02.180 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.070402+0000", 2024-04-19T03:02:02.180 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2010000000000001e-06 2024-04-19T03:02:02.180 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.180 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.180 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:02.180 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.070445+0000", 2024-04-19T03:02:02.180 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2585e-05 2024-04-19T03:02:02.181 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.181 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.181 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:02.181 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.070572+0000", 2024-04-19T03:02:02.181 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012708500000000001 2024-04-19T03:02:02.181 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.181 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.181 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:02.181 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.070711+0000", 2024-04-19T03:02:02.181 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013848699999999999 2024-04-19T03:02:02.181 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.181 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.181 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:02.182 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.073505+0000", 2024-04-19T03:02:02.182 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0027944620000000002 2024-04-19T03:02:02.182 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.182 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.182 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:02.182 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.091806+0000", 2024-04-19T03:02:02.182 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.018301251000000001 2024-04-19T03:02:02.182 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.182 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.182 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:02.182 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.091854+0000", 2024-04-19T03:02:02.182 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7419000000000001e-05 2024-04-19T03:02:02.182 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.182 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.183 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:02.183 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.091884+0000", 2024-04-19T03:02:02.183 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0241999999999999e-05 2024-04-19T03:02:02.183 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:02.183 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:02.183 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:02.183 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.183 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.183 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:11292 5.0 5:009b2ea9:::benchmark_data_smithi096_19531_object11291:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T03:02:02.183 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:42.070676+0000", 2024-04-19T03:02:02.183 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 20.044158633999999, 2024-04-19T03:02:02.183 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.02219631, 2024-04-19T03:02:02.183 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:02.183 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:02.184 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:02.184 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:02.184 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:02.184 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 11292 2024-04-19T03:02:02.184 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.184 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:02.184 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.184 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:02.184 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.070676+0000", 2024-04-19T03:02:02.184 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:02.184 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.184 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.184 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:02.185 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.070676+0000", 2024-04-19T03:02:02.185 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:02.185 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.185 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.185 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:02.185 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.070675+0000", 2024-04-19T03:02:02.185 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:02.185 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.185 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.185 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:02.185 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.070800+0000", 2024-04-19T03:02:02.185 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000125263 2024-04-19T03:02:02.185 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.185 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.186 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:02.186 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.070808+0000", 2024-04-19T03:02:02.186 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0209999999999999e-06 2024-04-19T03:02:02.186 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.186 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.186 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:02.186 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.070814+0000", 2024-04-19T03:02:02.186 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0969999999999996e-06 2024-04-19T03:02:02.186 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.186 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.186 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:02.186 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.071956+0000", 2024-04-19T03:02:02.187 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0011427480000000001 2024-04-19T03:02:02.187 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.187 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.187 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:02.187 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.072153+0000", 2024-04-19T03:02:02.187 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000196524 2024-04-19T03:02:02.187 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.187 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.187 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:02.187 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.072312+0000", 2024-04-19T03:02:02.187 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015879300000000001 2024-04-19T03:02:02.187 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.187 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.187 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:02.188 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.078407+0000", 2024-04-19T03:02:02.188 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0060954929999999996 2024-04-19T03:02:02.188 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.188 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.188 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:02.188 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.092742+0000", 2024-04-19T03:02:02.188 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.014335349000000001 2024-04-19T03:02:02.188 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.188 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.188 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:02.188 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.092815+0000", 2024-04-19T03:02:02.188 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2881999999999998e-05 2024-04-19T03:02:02.188 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.189 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.189 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:02.189 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.092872+0000", 2024-04-19T03:02:02.189 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6965000000000001e-05 2024-04-19T03:02:02.189 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:02.189 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:02.189 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:02.189 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.189 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.189 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:11297 5.e 5:7975ecb6:::benchmark_data_smithi096_19531_object11296:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T03:02:02.189 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:42.076848+0000", 2024-04-19T03:02:02.189 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 20.037986753999999, 2024-04-19T03:02:02.189 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020867969, 2024-04-19T03:02:02.189 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:02.190 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:02.190 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:02.190 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:02.190 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:02.190 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 11297 2024-04-19T03:02:02.190 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.190 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:02.190 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.190 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:02.190 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.076848+0000", 2024-04-19T03:02:02.190 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:02.190 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.190 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.191 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:02.191 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.076848+0000", 2024-04-19T03:02:02.191 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:02.191 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.191 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.191 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:02.191 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.076846+0000", 2024-04-19T03:02:02.191 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:02.191 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.191 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.191 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:02.191 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.076894+0000", 2024-04-19T03:02:02.191 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7645000000000002e-05 2024-04-19T03:02:02.191 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.192 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.192 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:02.192 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.076913+0000", 2024-04-19T03:02:02.192 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8885e-05 2024-04-19T03:02:02.192 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.192 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.192 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:02.192 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.076924+0000", 2024-04-19T03:02:02.192 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.118e-05 2024-04-19T03:02:02.192 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.192 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.192 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:02.192 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.076983+0000", 2024-04-19T03:02:02.193 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8952000000000001e-05 2024-04-19T03:02:02.193 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.193 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.193 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:02.193 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.077156+0000", 2024-04-19T03:02:02.193 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00017307600000000001 2024-04-19T03:02:02.193 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.193 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.193 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:02.193 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.077358+0000", 2024-04-19T03:02:02.193 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000201991 2024-04-19T03:02:02.193 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.193 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.193 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:02.194 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.080885+0000", 2024-04-19T03:02:02.194 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0035268309999999998 2024-04-19T03:02:02.194 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.194 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.194 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:02.194 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.097569+0000", 2024-04-19T03:02:02.194 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.016683854000000001 2024-04-19T03:02:02.194 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.194 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.194 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:02.194 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.097647+0000", 2024-04-19T03:02:02.194 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.7823000000000004e-05 2024-04-19T03:02:02.194 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.195 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.195 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:02.195 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.097716+0000", 2024-04-19T03:02:02.195 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.9079999999999996e-05 2024-04-19T03:02:02.195 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:02.195 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:02.195 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:02.195 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.195 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.195 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:11298 5.e 5:72565f0a:::benchmark_data_smithi096_19531_object11297:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T03:02:02.195 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:42.076954+0000", 2024-04-19T03:02:02.195 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 20.037880879999999, 2024-04-19T03:02:02.195 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020950191999999999, 2024-04-19T03:02:02.195 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:02.196 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:02.196 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:02.196 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:02.196 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:02.196 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 11298 2024-04-19T03:02:02.196 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.196 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:02.196 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.196 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:02.196 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.076954+0000", 2024-04-19T03:02:02.196 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:02.196 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.196 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.196 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:02.197 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.076954+0000", 2024-04-19T03:02:02.197 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:02.197 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.197 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.197 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:02.197 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.076953+0000", 2024-04-19T03:02:02.197 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:02.197 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.197 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.197 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:02.197 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.076997+0000", 2024-04-19T03:02:02.197 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4023000000000002e-05 2024-04-19T03:02:02.197 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.197 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.197 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:02.198 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.077009+0000", 2024-04-19T03:02:02.198 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2456000000000001e-05 2024-04-19T03:02:02.198 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.198 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.198 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:02.198 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.077015+0000", 2024-04-19T03:02:02.198 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7950000000000004e-06 2024-04-19T03:02:02.198 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.198 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.198 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:02.198 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.078552+0000", 2024-04-19T03:02:02.198 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0015371320000000001 2024-04-19T03:02:02.198 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.199 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.199 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:02.199 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.078760+0000", 2024-04-19T03:02:02.199 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00020808799999999999 2024-04-19T03:02:02.199 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.199 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.199 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:02.199 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.078875+0000", 2024-04-19T03:02:02.199 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011457500000000001 2024-04-19T03:02:02.199 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.199 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.199 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:02.199 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.083603+0000", 2024-04-19T03:02:02.200 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0047276239999999997 2024-04-19T03:02:02.200 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.200 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.200 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:02.200 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.097783+0000", 2024-04-19T03:02:02.200 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.014180036 2024-04-19T03:02:02.200 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.200 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.200 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:02.200 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.097863+0000", 2024-04-19T03:02:02.200 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0317999999999999e-05 2024-04-19T03:02:02.200 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.200 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.200 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:02.201 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.097904+0000", 2024-04-19T03:02:02.201 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1035000000000003e-05 2024-04-19T03:02:02.201 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:02.201 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:02.201 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:02.201 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.201 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.201 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:41640 5.0 5:0989f358:::benchmark_data_smithi096_19531_object41639:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-19T03:02:02.201 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:55.640790+0000", 2024-04-19T03:02:02.201 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 6.4740444359999998, 2024-04-19T03:02:02.201 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020000754999999999, 2024-04-19T03:02:02.201 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:02.202 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:02.202 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:02.202 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:02.202 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:02.202 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 41640 2024-04-19T03:02:02.202 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.202 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:02.202 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.202 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:02.202 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:55.640790+0000", 2024-04-19T03:02:02.202 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:02.202 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.202 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.203 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:02.203 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:55.640790+0000", 2024-04-19T03:02:02.203 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:02.203 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.203 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.203 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:02.203 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:55.640789+0000", 2024-04-19T03:02:02.203 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:02.203 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.203 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.203 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:02.203 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:55.640829+0000", 2024-04-19T03:02:02.203 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9870999999999998e-05 2024-04-19T03:02:02.203 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.204 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.204 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:02.204 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:55.640838+0000", 2024-04-19T03:02:02.204 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.8899999999999996e-06 2024-04-19T03:02:02.204 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.204 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.204 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:02.204 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:55.640843+0000", 2024-04-19T03:02:02.204 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1630000000000004e-06 2024-04-19T03:02:02.204 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.204 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.204 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:02.204 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:55.649279+0000", 2024-04-19T03:02:02.205 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0084358179999999994 2024-04-19T03:02:02.205 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.205 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.205 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:02.205 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:55.649388+0000", 2024-04-19T03:02:02.205 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010836399999999999 2024-04-19T03:02:02.205 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.205 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.205 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:02.205 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:55.649479+0000", 2024-04-19T03:02:02.205 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1284000000000002e-05 2024-04-19T03:02:02.205 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.205 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.205 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:02.206 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:55.656726+0000", 2024-04-19T03:02:02.206 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.007246962 2024-04-19T03:02:02.206 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.206 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.206 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:02.206 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:55.660689+0000", 2024-04-19T03:02:02.206 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0039628900000000002 2024-04-19T03:02:02.206 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.206 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.206 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:02.206 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:55.660755+0000", 2024-04-19T03:02:02.206 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6267999999999996e-05 2024-04-19T03:02:02.206 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.206 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.207 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:02.207 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:55.660791+0000", 2024-04-19T03:02:02.207 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5975e-05 2024-04-19T03:02:02.207 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:02.207 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:02.207 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:02.207 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.207 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.207 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:50553 5.0 5:041697c2:::benchmark_data_smithi096_19531_object50552:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-19T03:02:02.207 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:00.314446+0000", 2024-04-19T03:02:02.207 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 1.8003886250000001, 2024-04-19T03:02:02.207 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.019029635, 2024-04-19T03:02:02.207 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:02.207 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:02.208 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:02.208 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:02.208 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:02.208 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 50553 2024-04-19T03:02:02.208 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.208 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:02.208 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.208 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:02.208 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:00.314446+0000", 2024-04-19T03:02:02.208 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:02.208 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.208 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.208 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:02.208 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:00.314446+0000", 2024-04-19T03:02:02.209 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:02.209 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.209 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.209 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:02.209 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:00.314445+0000", 2024-04-19T03:02:02.209 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:02.209 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.209 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.209 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:02.209 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:00.314535+0000", 2024-04-19T03:02:02.209 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.0303999999999995e-05 2024-04-19T03:02:02.209 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.209 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.209 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:02.210 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:00.314549+0000", 2024-04-19T03:02:02.210 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4039999999999999e-05 2024-04-19T03:02:02.210 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.210 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.210 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:02.210 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:00.314557+0000", 2024-04-19T03:02:02.210 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.7039999999999994e-06 2024-04-19T03:02:02.210 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.210 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.210 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:02.210 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:00.324568+0000", 2024-04-19T03:02:02.210 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.010011406 2024-04-19T03:02:02.210 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.210 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.211 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:02.211 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:00.324700+0000", 2024-04-19T03:02:02.211 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000131879 2024-04-19T03:02:02.211 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.211 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.211 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:02.211 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:00.324889+0000", 2024-04-19T03:02:02.211 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0001885 2024-04-19T03:02:02.211 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.211 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.211 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:02.211 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:00.329400+0000", 2024-04-19T03:02:02.211 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0045109 2024-04-19T03:02:02.211 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.212 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.212 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:02.212 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:00.333400+0000", 2024-04-19T03:02:02.212 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0040001699999999999 2024-04-19T03:02:02.212 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.212 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.212 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:02.212 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:00.333432+0000", 2024-04-19T03:02:02.212 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1930000000000001e-05 2024-04-19T03:02:02.212 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.212 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.212 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:02.212 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:00.333476+0000", 2024-04-19T03:02:02.212 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3831000000000001e-05 2024-04-19T03:02:02.213 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:02.213 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:02.213 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:02.213 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.213 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.213 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:50576 5.b 5:d250063d:::benchmark_data_smithi096_19531_object50575:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-19T03:02:02.213 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:00.329584+0000", 2024-04-19T03:02:02.213 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 1.785250266, 2024-04-19T03:02:02.213 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.021217389, 2024-04-19T03:02:02.213 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:02.213 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:02.213 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:02.213 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:02.213 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:02.214 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 50576 2024-04-19T03:02:02.214 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.214 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:02.214 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.214 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:02.214 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:00.329584+0000", 2024-04-19T03:02:02.214 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:02.214 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.214 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.214 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:02.214 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:00.329584+0000", 2024-04-19T03:02:02.214 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:02.214 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.215 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.215 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:02.215 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:00.329583+0000", 2024-04-19T03:02:02.215 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:02.215 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.215 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.215 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:02.215 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:00.329626+0000", 2024-04-19T03:02:02.215 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2530000000000001e-05 2024-04-19T03:02:02.215 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.215 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.215 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:02.216 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:00.329642+0000", 2024-04-19T03:02:02.216 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5891000000000001e-05 2024-04-19T03:02:02.216 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.216 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.216 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:02.216 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:00.329652+0000", 2024-04-19T03:02:02.216 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0093e-05 2024-04-19T03:02:02.216 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.216 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.216 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:02.216 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:00.330793+0000", 2024-04-19T03:02:02.216 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001141097 2024-04-19T03:02:02.216 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.216 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.216 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:02.217 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:00.330924+0000", 2024-04-19T03:02:02.217 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013114499999999999 2024-04-19T03:02:02.217 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.217 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.217 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:02.217 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:00.331055+0000", 2024-04-19T03:02:02.217 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013124600000000001 2024-04-19T03:02:02.217 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.217 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.217 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:02.217 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:00.335705+0000", 2024-04-19T03:02:02.217 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0046501549999999996 2024-04-19T03:02:02.217 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.217 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.218 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:02.218 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:00.350741+0000", 2024-04-19T03:02:02.218 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015035411 2024-04-19T03:02:02.218 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.218 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.218 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:02.218 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:00.350777+0000", 2024-04-19T03:02:02.218 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5874999999999998e-05 2024-04-19T03:02:02.218 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.218 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.218 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:02.218 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:00.350802+0000", 2024-04-19T03:02:02.218 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5040000000000001e-05 2024-04-19T03:02:02.219 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:02.219 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:02.219 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:02.219 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.219 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.219 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:52869 5.8 5:17861a78:::benchmark_data_smithi096_19531_object52868:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-19T03:02:02.219 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:01.576054+0000", 2024-04-19T03:02:02.219 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.53878056600000002, 2024-04-19T03:02:02.219 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.018948764999999999, 2024-04-19T03:02:02.219 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:02.219 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:02.219 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:02.219 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:02.219 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:02.220 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 52869 2024-04-19T03:02:02.220 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.220 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:02.220 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.220 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:02.220 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:01.576054+0000", 2024-04-19T03:02:02.220 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:02.220 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.220 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.220 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:02.220 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:01.576054+0000", 2024-04-19T03:02:02.220 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:02.220 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.220 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.220 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:02.221 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:01.576053+0000", 2024-04-19T03:02:02.221 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:02.221 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.221 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.221 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:02.221 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:01.576098+0000", 2024-04-19T03:02:02.221 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4505999999999997e-05 2024-04-19T03:02:02.221 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.221 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.221 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:02.221 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:01.576107+0000", 2024-04-19T03:02:02.222 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.2210000000000003e-06 2024-04-19T03:02:02.222 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.222 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.222 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:02.222 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:01.576115+0000", 2024-04-19T03:02:02.222 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.554e-06 2024-04-19T03:02:02.222 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.222 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.222 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:02.222 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:01.580967+0000", 2024-04-19T03:02:02.222 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0048522840000000001 2024-04-19T03:02:02.222 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.222 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.222 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:02.223 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:01.581063+0000", 2024-04-19T03:02:02.223 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.5828000000000005e-05 2024-04-19T03:02:02.223 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.223 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.223 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:02.223 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:01.581162+0000", 2024-04-19T03:02:02.223 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.9155999999999997e-05 2024-04-19T03:02:02.223 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.223 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.223 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:02.223 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:01.587776+0000", 2024-04-19T03:02:02.223 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0066139880000000003 2024-04-19T03:02:02.225 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.225 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.225 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:02.225 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:01.594886+0000", 2024-04-19T03:02:02.225 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0071101910000000001 2024-04-19T03:02:02.225 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.225 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.225 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:02.225 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:01.594953+0000", 2024-04-19T03:02:02.225 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7012000000000001e-05 2024-04-19T03:02:02.225 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.226 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.226 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:02.226 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:01.595003+0000", 2024-04-19T03:02:02.226 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9762000000000002e-05 2024-04-19T03:02:02.226 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:02.226 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:02.226 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:02.226 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.226 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.226 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:52909 5.b 5:df07ce30:::benchmark_data_smithi096_19531_object52908:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-19T03:02:02.226 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:01.602899+0000", 2024-04-19T03:02:02.226 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.511935896, 2024-04-19T03:02:02.226 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020403345, 2024-04-19T03:02:02.226 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:02.227 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:02.227 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:02.227 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:02.227 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:02.227 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 52909 2024-04-19T03:02:02.227 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.227 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:02.227 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.227 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:02.227 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:01.602899+0000", 2024-04-19T03:02:02.227 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:02.227 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.227 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.227 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:02.228 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:01.602899+0000", 2024-04-19T03:02:02.228 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:02.228 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.228 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.228 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:02.228 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:01.602883+0000", 2024-04-19T03:02:02.228 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999838 2024-04-19T03:02:02.228 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.228 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.228 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:02.228 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:01.602956+0000", 2024-04-19T03:02:02.228 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2941000000000005e-05 2024-04-19T03:02:02.228 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.228 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.229 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:02.229 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:01.602970+0000", 2024-04-19T03:02:02.229 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4562999999999999e-05 2024-04-19T03:02:02.229 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.229 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.229 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:02.229 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:01.602981+0000", 2024-04-19T03:02:02.229 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1134999999999999e-05 2024-04-19T03:02:02.229 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.229 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.229 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:02.229 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:01.603043+0000", 2024-04-19T03:02:02.229 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2034999999999998e-05 2024-04-19T03:02:02.229 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.229 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.230 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:02.230 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:01.603173+0000", 2024-04-19T03:02:02.230 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012962800000000001 2024-04-19T03:02:02.230 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.230 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.230 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:02.230 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:01.603296+0000", 2024-04-19T03:02:02.230 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012313 2024-04-19T03:02:02.230 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.230 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.230 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:02.230 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:01.606862+0000", 2024-04-19T03:02:02.230 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0035656049999999999 2024-04-19T03:02:02.230 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.231 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.231 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:02.231 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:01.623147+0000", 2024-04-19T03:02:02.231 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.016285286 2024-04-19T03:02:02.231 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.231 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.231 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:02.231 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:01.623251+0000", 2024-04-19T03:02:02.231 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000104245 2024-04-19T03:02:02.231 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.231 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.231 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:02.231 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:01.623302+0000", 2024-04-19T03:02:02.231 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0763999999999997e-05 2024-04-19T03:02:02.232 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:02.232 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:02.232 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:02.232 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.232 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.232 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:52912 5.b 5:deddbeae:::benchmark_data_smithi096_19531_object52911:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-19T03:02:02.232 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:01.603006+0000", 2024-04-19T03:02:02.232 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.51182810499999998, 2024-04-19T03:02:02.232 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020493783000000002, 2024-04-19T03:02:02.232 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:02.232 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:02.232 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:02.232 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:02.232 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:02.233 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 52912 2024-04-19T03:02:02.233 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.233 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:02.233 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.233 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:02.233 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:01.603006+0000", 2024-04-19T03:02:02.233 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:02.233 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.233 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.233 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:02.233 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:01.603006+0000", 2024-04-19T03:02:02.233 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:02.233 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.233 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.234 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:02.234 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:01.603006+0000", 2024-04-19T03:02:02.234 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:02.234 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.234 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.234 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:02.234 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:01.603054+0000", 2024-04-19T03:02:02.234 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8529000000000002e-05 2024-04-19T03:02:02.234 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.234 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.234 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:02.234 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:01.603067+0000", 2024-04-19T03:02:02.234 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2412000000000001e-05 2024-04-19T03:02:02.234 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.235 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.235 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:02.235 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:01.603078+0000", 2024-04-19T03:02:02.235 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1059e-05 2024-04-19T03:02:02.235 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.235 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.235 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:02.235 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:01.605226+0000", 2024-04-19T03:02:02.235 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0021488029999999999 2024-04-19T03:02:02.235 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.235 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.235 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:02.235 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:01.605333+0000", 2024-04-19T03:02:02.235 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000106346 2024-04-19T03:02:02.236 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.236 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.236 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:02.236 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:01.605426+0000", 2024-04-19T03:02:02.236 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.2985999999999994e-05 2024-04-19T03:02:02.236 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.236 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.236 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:02.236 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:01.607251+0000", 2024-04-19T03:02:02.236 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0018255789999999999 2024-04-19T03:02:02.236 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.236 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.236 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:02.236 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:01.623413+0000", 2024-04-19T03:02:02.237 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.016161854999999999 2024-04-19T03:02:02.237 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.237 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.237 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:02.237 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:01.623448+0000", 2024-04-19T03:02:02.237 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4498000000000001e-05 2024-04-19T03:02:02.237 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:02.237 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:02.237 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:02.237 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:01.623500+0000", 2024-04-19T03:02:02.237 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2543999999999997e-05 2024-04-19T03:02:02.237 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:02.237 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:02.237 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:02.238 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:02.238 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:02.238 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-19T03:02:02.238 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-19T03:02:02.239 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1: {} 2024-04-19T03:02:02.240 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2: {} 2024-04-19T03:02:02.241 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T03:02:02.241 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:02.236+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:02.241 INFO:teuthology.orchestra.run.smithi096.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T03:02:02.242 INFO:teuthology.orchestra.run.smithi096.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-19T03:02:02.242 INFO:teuthology.orchestra.run.smithi096.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-19T03:02:02.340 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:02.337+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:02.377 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-04-19T03:02:02.377 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:02:02.389 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T03:02:02.441 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:02.437+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:02.513 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-04-19T03:02:02.514 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:02:02.525 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T03:02:02.542 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-04-19T03:02:02.538+0000 7f35986ab700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18243) UID: 0 2024-04-19T03:02:02.643 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:02.641+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:02.692 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-04-19T03:02:02.692 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:02:02.705 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T03:02:02.746 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-04-19T03:02:02.742+0000 7f35986ab700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18243) UID: 0 2024-04-19T03:02:02.822 INFO:tasks.radosbench.radosbench.0.smithi096.stdout: 25 16 55111 55095 137.722 113.312 0.0109468 0.00725488 2024-04-19T03:02:02.842 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-04-19T03:02:02.842 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:02:02.846 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:02.841+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:02.855 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T03:02:02.947 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:02.944+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:03.032 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-04-19T03:02:03.032 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:02:03.044 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T03:02:03.047 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-04-19T03:02:03.046+0000 7f35986ab700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18243) UID: 0 2024-04-19T03:02:03.125 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-04-19T03:02:03.125 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-19T03:02:03.125 INFO:tasks.thrashosds.thrasher:inject_pause on osd.0 2024-04-19T03:02:03.125 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-04-19T03:02:03.125 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-04-19T03:02:03.125 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok config set filestore_inject_stall 3 2024-04-19T03:02:03.134 INFO:teuthology.orchestra.run.smithi096.stderr:nodeep-scrub is set 2024-04-19T03:02:03.171 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-04-19T03:02:03.170+0000 7f35986ab700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18243) UID: 0 2024-04-19T03:02:03.174 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-04-19T03:02:03.174 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:02:03.188 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T03:02:03.249 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:03.248+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:03.274 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-04-19T03:02:03.274 INFO:teuthology.orchestra.run.smithi097.stdout: "success": "filestore_inject_stall = '' (not observed, change may require restart) " 2024-04-19T03:02:03.274 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-04-19T03:02:03.310 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-19T03:02:03.310 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:02:03.323 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T03:02:03.350 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:03.349+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:03.451 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:03.449+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:03.492 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-19T03:02:03.492 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:02:03.505 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T03:02:03.552 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:03.549+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:03.629 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-19T03:02:03.629 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:02:03.642 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T03:02:03.652 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-04-19T03:02:03.650+0000 7f35986ab700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18243) UID: 0 2024-04-19T03:02:03.754 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-04-19T03:02:03.750+0000 7f35986ab700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18243) UID: 0 2024-04-19T03:02:03.766 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-04-19T03:02:03.766 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:02:03.779 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T03:02:03.822 INFO:tasks.radosbench.radosbench.0.smithi096.stdout: 26 16 56845 56829 136.593 108.375 0.0164583 0.00731452 2024-04-19T03:02:03.855 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:03.852+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:03.902 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-04-19T03:02:03.902 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:02:03.913 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T03:02:03.957 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:03.953+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:04.038 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-04-19T03:02:04.038 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:02:04.053 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T03:02:04.056 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:04.056+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:04.157 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-04-19T03:02:04.154+0000 7f35986ab700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18243) UID: 0 2024-04-19T03:02:04.187 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-04-19T03:02:04.187 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:02:04.200 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T03:02:04.243 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-19T03:02:04.258 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:04.253+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:04.334 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-04-19T03:02:04.334 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:02:04.347 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T03:02:04.358 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:04.356+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:04.392 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0: {} 2024-04-19T03:02:04.412 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1: {} 2024-04-19T03:02:04.432 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2: {} 2024-04-19T03:02:04.434 INFO:teuthology.orchestra.run.smithi096.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T03:02:04.434 INFO:teuthology.orchestra.run.smithi096.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-19T03:02:04.434 INFO:teuthology.orchestra.run.smithi096.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-19T03:02:04.459 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:04.457+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:04.477 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-04-19T03:02:04.478 INFO:teuthology.orchestra.run.smithi097.stdout: "size": 20, 2024-04-19T03:02:04.478 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 600, 2024-04-19T03:02:04.478 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [ 2024-04-19T03:02:04.478 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.478 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:02:04.478 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:14.996966+0000", 2024-04-19T03:02:04.478 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 49.476966628, 2024-04-19T03:02:04.478 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.018946704000000002, 2024-04-19T03:02:04.478 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:02:04.478 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:04.478 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:02:04.478 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.479 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:02:04.479 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.996966+0000", 2024-04-19T03:02:04.479 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:04.479 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.479 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.479 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:02:04.479 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.996966+0000", 2024-04-19T03:02:04.479 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:04.479 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.479 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.480 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:02:04.480 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.996964+0000", 2024-04-19T03:02:04.480 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999971 2024-04-19T03:02:04.480 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.480 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.480 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:02:04.480 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.996982+0000", 2024-04-19T03:02:04.480 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.8306999999999999e-05 2024-04-19T03:02:04.480 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.480 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.480 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:02:04.480 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997027+0000", 2024-04-19T03:02:04.480 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.5274000000000001e-05 2024-04-19T03:02:04.481 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.481 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.481 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:02:04.481 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997047+0000", 2024-04-19T03:02:04.481 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.9726999999999999e-05 2024-04-19T03:02:04.481 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.481 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.481 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:04.481 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997203+0000", 2024-04-19T03:02:04.481 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000155847 2024-04-19T03:02:04.481 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.481 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.482 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op must wait for map", 2024-04-19T03:02:04.482 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997249+0000", 2024-04-19T03:02:04.482 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.5824e-05 2024-04-19T03:02:04.482 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.482 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.482 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:04.482 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.007264+0000", 2024-04-19T03:02:04.482 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.010015909 2024-04-19T03:02:04.482 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.482 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.482 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:02:04.483 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.007394+0000", 2024-04-19T03:02:04.483 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012931999999999999 2024-04-19T03:02:04.483 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.483 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.483 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-04-19T03:02:04.483 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.007537+0000", 2024-04-19T03:02:04.483 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014365 2024-04-19T03:02:04.483 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.483 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.483 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:02:04.483 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.012444+0000", 2024-04-19T03:02:04.484 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0049067260000000001 2024-04-19T03:02:04.484 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.484 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.484 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:04.484 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.015791+0000", 2024-04-19T03:02:04.484 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0033471109999999998 2024-04-19T03:02:04.484 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.484 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.484 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:02:04.484 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.015845+0000", 2024-04-19T03:02:04.484 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.4236e-05 2024-04-19T03:02:04.484 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.485 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.485 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:02:04.485 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.015913+0000", 2024-04-19T03:02:04.485 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.7397000000000005e-05 2024-04-19T03:02:04.485 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:04.485 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:02:04.485 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:04.485 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.485 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.485 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(mds.0.3:14 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:02:04.485 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:14.997079+0000", 2024-04-19T03:02:04.486 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 49.476854044, 2024-04-19T03:02:04.486 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.021951970000000001, 2024-04-19T03:02:04.486 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:02:04.486 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:04.486 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:02:04.486 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.486 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:02:04.486 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997079+0000", 2024-04-19T03:02:04.486 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:04.486 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.487 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.487 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:02:04.487 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997079+0000", 2024-04-19T03:02:04.487 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:04.487 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.487 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.487 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:02:04.487 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997077+0000", 2024-04-19T03:02:04.487 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:04.487 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.487 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.488 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:02:04.488 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997087+0000", 2024-04-19T03:02:04.488 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.006e-05 2024-04-19T03:02:04.488 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.488 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.488 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:02:04.488 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997105+0000", 2024-04-19T03:02:04.488 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.8026999999999999e-05 2024-04-19T03:02:04.488 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.488 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.488 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:02:04.488 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997135+0000", 2024-04-19T03:02:04.489 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.9643000000000001e-05 2024-04-19T03:02:04.489 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.489 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.489 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:04.489 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997208+0000", 2024-04-19T03:02:04.489 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.3419999999999998e-05 2024-04-19T03:02:04.489 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.489 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.489 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op must wait for map", 2024-04-19T03:02:04.489 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997244+0000", 2024-04-19T03:02:04.490 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.5367000000000002e-05 2024-04-19T03:02:04.490 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.490 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.490 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:04.490 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.007357+0000", 2024-04-19T03:02:04.490 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.010112703000000001 2024-04-19T03:02:04.490 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.490 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.490 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:02:04.490 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.007479+0000", 2024-04-19T03:02:04.490 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012279599999999999 2024-04-19T03:02:04.491 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.491 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.491 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 1", 2024-04-19T03:02:04.491 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.007610+0000", 2024-04-19T03:02:04.491 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00013093499999999999 2024-04-19T03:02:04.491 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.491 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.491 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:02:04.491 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.012526+0000", 2024-04-19T03:02:04.491 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0049157519999999998 2024-04-19T03:02:04.491 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.491 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.491 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:04.492 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.018959+0000", 2024-04-19T03:02:04.492 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0064326009999999996 2024-04-19T03:02:04.492 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.492 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.492 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:02:04.492 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.019005+0000", 2024-04-19T03:02:04.492 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.6066999999999998e-05 2024-04-19T03:02:04.492 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.492 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.492 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:02:04.492 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.019031+0000", 2024-04-19T03:02:04.492 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.6009000000000001e-05 2024-04-19T03:02:04.492 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:04.493 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:02:04.493 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:04.493 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.493 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.493 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:02:04.493 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:14.997149+0000", 2024-04-19T03:02:04.493 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 49.476783423999997, 2024-04-19T03:02:04.493 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.021805590999999999, 2024-04-19T03:02:04.493 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:02:04.493 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:04.493 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:02:04.493 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.493 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:02:04.493 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997149+0000", 2024-04-19T03:02:04.494 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:04.494 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.494 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.494 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:02:04.494 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997149+0000", 2024-04-19T03:02:04.494 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:04.494 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.494 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.494 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:02:04.494 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997148+0000", 2024-04-19T03:02:04.494 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2024-04-19T03:02:04.495 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.495 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.495 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:02:04.495 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997166+0000", 2024-04-19T03:02:04.495 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.8233e-05 2024-04-19T03:02:04.495 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.495 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.495 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:02:04.495 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997182+0000", 2024-04-19T03:02:04.495 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5999999999999999e-05 2024-04-19T03:02:04.495 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.495 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.496 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:02:04.496 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997195+0000", 2024-04-19T03:02:04.496 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.252e-05 2024-04-19T03:02:04.496 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.496 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.496 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:04.496 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997348+0000", 2024-04-19T03:02:04.496 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000153115 2024-04-19T03:02:04.496 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.496 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.496 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:02:04.496 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997354+0000", 2024-04-19T03:02:04.496 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.9359999999999996e-06 2024-04-19T03:02:04.497 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.497 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.497 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:04.497 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.008147+0000", 2024-04-19T03:02:04.497 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.010793127 2024-04-19T03:02:04.497 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.497 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.497 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:02:04.497 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.008225+0000", 2024-04-19T03:02:04.497 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.7935999999999994e-05 2024-04-19T03:02:04.497 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.497 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.497 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-04-19T03:02:04.498 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.008377+0000", 2024-04-19T03:02:04.498 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00015159099999999999 2024-04-19T03:02:04.498 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.498 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.498 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:02:04.498 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.012629+0000", 2024-04-19T03:02:04.498 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0042520420000000001 2024-04-19T03:02:04.498 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.498 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.498 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:04.498 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.018871+0000", 2024-04-19T03:02:04.498 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0062425060000000001 2024-04-19T03:02:04.499 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.499 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.499 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:02:04.499 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.018910+0000", 2024-04-19T03:02:04.499 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.8482999999999997e-05 2024-04-19T03:02:04.499 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.499 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.499 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:02:04.499 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.018955+0000", 2024-04-19T03:02:04.499 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.5252e-05 2024-04-19T03:02:04.499 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:04.499 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:02:04.500 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:04.500 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.500 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.500 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(mds.0.3:36 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:02:04.500 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:14.997207+0000", 2024-04-19T03:02:04.500 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 49.476725874000003, 2024-04-19T03:02:04.500 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.022210431999999999, 2024-04-19T03:02:04.500 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:02:04.500 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:04.500 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:02:04.500 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.500 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:02:04.500 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997207+0000", 2024-04-19T03:02:04.501 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:04.501 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.501 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.501 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:02:04.501 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997207+0000", 2024-04-19T03:02:04.501 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:04.501 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.501 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.501 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:02:04.501 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997206+0000", 2024-04-19T03:02:04.501 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2024-04-19T03:02:04.502 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.502 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.502 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:02:04.502 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997218+0000", 2024-04-19T03:02:04.503 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2607e-05 2024-04-19T03:02:04.503 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.503 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.503 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:02:04.503 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997234+0000", 2024-04-19T03:02:04.503 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5583999999999999e-05 2024-04-19T03:02:04.503 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.503 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.503 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:02:04.503 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997248+0000", 2024-04-19T03:02:04.504 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4270000000000001e-05 2024-04-19T03:02:04.504 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.504 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.504 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:04.504 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997397+0000", 2024-04-19T03:02:04.504 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0001482 2024-04-19T03:02:04.504 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.504 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.504 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:02:04.504 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997407+0000", 2024-04-19T03:02:04.504 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0944000000000001e-05 2024-04-19T03:02:04.504 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.504 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.505 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:04.505 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.008173+0000", 2024-04-19T03:02:04.505 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.010765378000000001 2024-04-19T03:02:04.505 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.505 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.505 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:02:04.505 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.008278+0000", 2024-04-19T03:02:04.505 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00010538 2024-04-19T03:02:04.505 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.505 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.505 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 1", 2024-04-19T03:02:04.505 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.008423+0000", 2024-04-19T03:02:04.505 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014525599999999999 2024-04-19T03:02:04.505 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.506 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.506 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:02:04.506 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.012734+0000", 2024-04-19T03:02:04.506 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0043108590000000002 2024-04-19T03:02:04.506 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.506 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.506 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:04.506 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.019318+0000", 2024-04-19T03:02:04.506 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0065836130000000003 2024-04-19T03:02:04.506 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.506 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.506 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:02:04.506 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.019382+0000", 2024-04-19T03:02:04.507 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.3925999999999997e-05 2024-04-19T03:02:04.507 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.507 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.507 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:02:04.507 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.019417+0000", 2024-04-19T03:02:04.507 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.5454999999999999e-05 2024-04-19T03:02:04.507 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:04.507 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:02:04.507 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:04.507 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.507 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.507 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(mds.0.3:15 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:02:04.507 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:14.997260+0000", 2024-04-19T03:02:04.507 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 49.476672723, 2024-04-19T03:02:04.507 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.021842842000000001, 2024-04-19T03:02:04.508 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:02:04.508 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:04.508 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:02:04.508 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.508 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:02:04.508 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997260+0000", 2024-04-19T03:02:04.508 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:04.508 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.508 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.508 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:02:04.508 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997260+0000", 2024-04-19T03:02:04.508 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:04.508 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.508 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.509 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:02:04.509 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997259+0000", 2024-04-19T03:02:04.509 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:04.509 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.509 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.509 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:02:04.509 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997270+0000", 2024-04-19T03:02:04.509 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0312999999999999e-05 2024-04-19T03:02:04.509 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.509 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.509 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:02:04.509 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997279+0000", 2024-04-19T03:02:04.509 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.7770000000000008e-06 2024-04-19T03:02:04.510 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.510 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.510 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:02:04.510 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997286+0000", 2024-04-19T03:02:04.510 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.0129999999999996e-06 2024-04-19T03:02:04.510 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.510 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.510 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:04.510 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997433+0000", 2024-04-19T03:02:04.510 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014774699999999999 2024-04-19T03:02:04.510 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.510 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.510 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:02:04.511 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997443+0000", 2024-04-19T03:02:04.511 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.414e-06 2024-04-19T03:02:04.511 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.511 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.511 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:04.511 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.008673+0000", 2024-04-19T03:02:04.511 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.011230789999999999 2024-04-19T03:02:04.511 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.511 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.511 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:02:04.511 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.008808+0000", 2024-04-19T03:02:04.511 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000134346 2024-04-19T03:02:04.511 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.511 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.512 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-04-19T03:02:04.512 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.008922+0000", 2024-04-19T03:02:04.512 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000114444 2024-04-19T03:02:04.512 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.512 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.512 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:02:04.512 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.013442+0000", 2024-04-19T03:02:04.512 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0045193439999999998 2024-04-19T03:02:04.512 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.512 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.512 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:04.512 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.019005+0000", 2024-04-19T03:02:04.512 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00556333 2024-04-19T03:02:04.512 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.513 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.513 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:02:04.513 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.019049+0000", 2024-04-19T03:02:04.513 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.4240000000000003e-05 2024-04-19T03:02:04.513 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.513 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.513 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:02:04.513 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.019103+0000", 2024-04-19T03:02:04.513 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.3706999999999999e-05 2024-04-19T03:02:04.513 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:04.513 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:02:04.513 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:04.513 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.513 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.514 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(mds.0.3:17 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:02:04.514 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:14.997292+0000", 2024-04-19T03:02:04.514 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 49.476640996, 2024-04-19T03:02:04.514 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.019573165999999999, 2024-04-19T03:02:04.514 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:02:04.514 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:04.514 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:02:04.514 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.514 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:02:04.514 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997292+0000", 2024-04-19T03:02:04.514 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:04.514 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.514 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.515 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:02:04.515 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997292+0000", 2024-04-19T03:02:04.515 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:04.515 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.515 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.515 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:02:04.515 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997291+0000", 2024-04-19T03:02:04.515 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:04.515 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.515 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.515 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:02:04.515 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997297+0000", 2024-04-19T03:02:04.515 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.3900000000000001e-06 2024-04-19T03:02:04.515 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.516 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.516 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:02:04.516 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997316+0000", 2024-04-19T03:02:04.516 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.9406e-05 2024-04-19T03:02:04.516 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.516 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.516 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:02:04.516 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997353+0000", 2024-04-19T03:02:04.516 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.6563999999999998e-05 2024-04-19T03:02:04.516 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.516 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.516 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:04.516 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997447+0000", 2024-04-19T03:02:04.516 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.4463999999999995e-05 2024-04-19T03:02:04.516 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.517 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.517 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op must wait for map", 2024-04-19T03:02:04.517 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997458+0000", 2024-04-19T03:02:04.517 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0817e-05 2024-04-19T03:02:04.517 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.517 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.517 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:04.517 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.002013+0000", 2024-04-19T03:02:04.517 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.004555229 2024-04-19T03:02:04.517 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.517 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.517 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:02:04.517 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.002943+0000", 2024-04-19T03:02:04.517 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00092983200000000001 2024-04-19T03:02:04.518 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.518 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.518 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-04-19T03:02:04.518 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.003257+0000", 2024-04-19T03:02:04.518 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00031455399999999998 2024-04-19T03:02:04.518 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.518 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.518 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:02:04.518 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.014107+0000", 2024-04-19T03:02:04.518 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.010849648 2024-04-19T03:02:04.518 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.518 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.518 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:04.519 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.016767+0000", 2024-04-19T03:02:04.519 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0026594990000000001 2024-04-19T03:02:04.519 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.519 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.519 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:02:04.519 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.016825+0000", 2024-04-19T03:02:04.519 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.8264000000000003e-05 2024-04-19T03:02:04.519 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.519 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.519 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:02:04.519 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.016865+0000", 2024-04-19T03:02:04.519 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.0108999999999998e-05 2024-04-19T03:02:04.519 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:04.519 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:02:04.520 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:04.520 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.520 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.520 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(mds.0.3:22 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:02:04.520 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:14.997383+0000", 2024-04-19T03:02:04.520 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 49.476550216, 2024-04-19T03:02:04.520 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.019634641000000001, 2024-04-19T03:02:04.520 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:02:04.520 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "started", 2024-04-19T03:02:04.520 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:02:04.520 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.520 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:02:04.520 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997383+0000", 2024-04-19T03:02:04.520 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:04.520 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.521 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.521 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:02:04.521 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997383+0000", 2024-04-19T03:02:04.521 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:04.521 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.521 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.521 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:02:04.521 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997381+0000", 2024-04-19T03:02:04.521 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:04.521 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.521 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.521 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:02:04.521 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997399+0000", 2024-04-19T03:02:04.521 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.802e-05 2024-04-19T03:02:04.522 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.522 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.522 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:02:04.522 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997417+0000", 2024-04-19T03:02:04.522 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.7581e-05 2024-04-19T03:02:04.522 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.522 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.522 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:02:04.522 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997429+0000", 2024-04-19T03:02:04.522 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1803e-05 2024-04-19T03:02:04.522 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.522 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.522 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:04.523 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997540+0000", 2024-04-19T03:02:04.523 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000111397 2024-04-19T03:02:04.523 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.523 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.523 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:02:04.523 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997552+0000", 2024-04-19T03:02:04.523 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1643e-05 2024-04-19T03:02:04.523 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.523 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.523 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:04.523 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.006836+0000", 2024-04-19T03:02:04.523 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0092841940000000008 2024-04-19T03:02:04.523 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.524 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.524 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:02:04.524 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.006982+0000", 2024-04-19T03:02:04.524 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014572899999999999 2024-04-19T03:02:04.524 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.524 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.524 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:02:04.524 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.017017+0000", 2024-04-19T03:02:04.524 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.010035571 2024-04-19T03:02:04.524 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:04.524 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:02:04.524 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:04.524 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.524 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.525 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(mds.0.3:23 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:02:04.525 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:14.997449+0000", 2024-04-19T03:02:04.525 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 49.476483674999997, 2024-04-19T03:02:04.525 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.022679250000000001, 2024-04-19T03:02:04.525 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:02:04.525 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "started", 2024-04-19T03:02:04.525 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:02:04.525 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.525 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:02:04.525 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997449+0000", 2024-04-19T03:02:04.525 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:04.525 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.525 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.526 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:02:04.526 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997449+0000", 2024-04-19T03:02:04.526 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:04.526 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.526 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.526 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:02:04.526 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997448+0000", 2024-04-19T03:02:04.526 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:04.526 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.526 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.526 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:02:04.526 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997452+0000", 2024-04-19T03:02:04.526 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.0369999999999996e-06 2024-04-19T03:02:04.527 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.527 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.527 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:02:04.527 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997461+0000", 2024-04-19T03:02:04.527 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.6100000000000006e-06 2024-04-19T03:02:04.527 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.527 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.527 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:02:04.527 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997468+0000", 2024-04-19T03:02:04.527 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.8360000000000003e-06 2024-04-19T03:02:04.527 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.527 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.527 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:04.527 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997546+0000", 2024-04-19T03:02:04.527 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.7956999999999999e-05 2024-04-19T03:02:04.528 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.528 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.528 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:02:04.528 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997555+0000", 2024-04-19T03:02:04.528 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.2269999999999999e-06 2024-04-19T03:02:04.528 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.528 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.528 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:04.528 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.010065+0000", 2024-04-19T03:02:04.528 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.012509457999999999 2024-04-19T03:02:04.528 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.528 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.528 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:02:04.528 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.010187+0000", 2024-04-19T03:02:04.529 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000122059 2024-04-19T03:02:04.529 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.529 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.529 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:02:04.529 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.020128+0000", 2024-04-19T03:02:04.529 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0099417529999999994 2024-04-19T03:02:04.529 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:04.529 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:02:04.529 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:04.529 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.529 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.529 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(mds.0.3:25 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:02:04.529 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:14.997485+0000", 2024-04-19T03:02:04.529 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 49.476448208999997, 2024-04-19T03:02:04.530 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.021633427, 2024-04-19T03:02:04.530 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:02:04.530 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "started", 2024-04-19T03:02:04.530 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:02:04.530 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.530 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:02:04.530 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997485+0000", 2024-04-19T03:02:04.530 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:04.530 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.530 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.530 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:02:04.530 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997485+0000", 2024-04-19T03:02:04.531 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:04.531 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.531 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.531 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:02:04.531 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997484+0000", 2024-04-19T03:02:04.531 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2024-04-19T03:02:04.531 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.531 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.531 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:02:04.531 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997490+0000", 2024-04-19T03:02:04.531 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.857e-06 2024-04-19T03:02:04.531 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.531 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.532 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:02:04.532 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997505+0000", 2024-04-19T03:02:04.532 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.518e-05 2024-04-19T03:02:04.532 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.532 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.532 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:02:04.532 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997520+0000", 2024-04-19T03:02:04.532 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5026e-05 2024-04-19T03:02:04.532 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.532 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.532 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:04.532 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997607+0000", 2024-04-19T03:02:04.532 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.7107000000000005e-05 2024-04-19T03:02:04.533 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.533 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.533 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op must wait for map", 2024-04-19T03:02:04.533 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997614+0000", 2024-04-19T03:02:04.533 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.0539999999999997e-06 2024-04-19T03:02:04.533 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.533 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.533 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:04.533 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.009808+0000", 2024-04-19T03:02:04.533 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.012194371000000001 2024-04-19T03:02:04.533 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.533 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.533 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:02:04.534 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.010107+0000", 2024-04-19T03:02:04.534 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000298731 2024-04-19T03:02:04.534 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.534 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.534 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:02:04.534 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.019118+0000", 2024-04-19T03:02:04.534 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0090109839999999997 2024-04-19T03:02:04.534 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:04.534 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:02:04.534 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:04.534 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.534 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.535 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4755.0:11277 5.c 5:38c3ceb2:::benchmark_data_smithi096_19531_object11276:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T03:02:04.535 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:42.059676+0000", 2024-04-19T03:02:04.535 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 22.414256587000001, 2024-04-19T03:02:04.535 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.029909680000000001, 2024-04-19T03:02:04.535 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:02:04.535 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:04.535 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-04-19T03:02:04.535 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4755", 2024-04-19T03:02:04.535 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:04.535 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 11277 2024-04-19T03:02:04.535 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.535 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:02:04.535 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.536 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:02:04.536 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.059676+0000", 2024-04-19T03:02:04.536 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:04.536 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.536 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.536 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:02:04.536 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.059676+0000", 2024-04-19T03:02:04.536 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:04.536 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.537 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.537 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:02:04.537 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.059665+0000", 2024-04-19T03:02:04.537 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999886 2024-04-19T03:02:04.537 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.537 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.537 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:02:04.537 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.059777+0000", 2024-04-19T03:02:04.537 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000111953 2024-04-19T03:02:04.537 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.538 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.538 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:02:04.538 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.059789+0000", 2024-04-19T03:02:04.538 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1809e-05 2024-04-19T03:02:04.538 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.538 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.538 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:02:04.538 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.059797+0000", 2024-04-19T03:02:04.538 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.2090000000000005e-06 2024-04-19T03:02:04.538 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.538 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.539 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:04.539 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.060528+0000", 2024-04-19T03:02:04.539 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00073144499999999995 2024-04-19T03:02:04.539 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.539 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.539 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:02:04.539 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.060662+0000", 2024-04-19T03:02:04.539 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000133435 2024-04-19T03:02:04.539 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.539 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.539 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-04-19T03:02:04.539 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.060766+0000", 2024-04-19T03:02:04.540 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00010473500000000001 2024-04-19T03:02:04.540 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.540 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.540 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:02:04.540 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.067649+0000", 2024-04-19T03:02:04.540 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.006882684 2024-04-19T03:02:04.540 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.540 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.540 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:04.540 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.089475+0000", 2024-04-19T03:02:04.540 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.021826196999999999 2024-04-19T03:02:04.540 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.541 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.541 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:02:04.541 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.089535+0000", 2024-04-19T03:02:04.541 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.9239e-05 2024-04-19T03:02:04.541 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.541 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.541 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:02:04.541 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.089586+0000", 2024-04-19T03:02:04.541 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.1288000000000001e-05 2024-04-19T03:02:04.541 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:04.541 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:02:04.541 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:04.541 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.542 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.542 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4755.0:11280 5.6 5:6e34f5e7:::benchmark_data_smithi096_19531_object11279:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T03:02:04.542 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:42.060002+0000", 2024-04-19T03:02:04.542 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 22.413931211000001, 2024-04-19T03:02:04.542 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.028171841999999999, 2024-04-19T03:02:04.542 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:02:04.542 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:04.542 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-04-19T03:02:04.542 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4755", 2024-04-19T03:02:04.542 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:04.542 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 11280 2024-04-19T03:02:04.542 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.543 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:02:04.543 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.543 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:02:04.543 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.060002+0000", 2024-04-19T03:02:04.543 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:04.543 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.543 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.543 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:02:04.543 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.060002+0000", 2024-04-19T03:02:04.543 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:04.543 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.543 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.543 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:02:04.544 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.060000+0000", 2024-04-19T03:02:04.544 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2024-04-19T03:02:04.544 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.544 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.544 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:02:04.544 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.060120+0000", 2024-04-19T03:02:04.544 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00011941400000000001 2024-04-19T03:02:04.544 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.544 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.544 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:02:04.544 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.060132+0000", 2024-04-19T03:02:04.544 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2197e-05 2024-04-19T03:02:04.544 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.544 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.545 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:02:04.545 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.060141+0000", 2024-04-19T03:02:04.545 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.6829999999999997e-06 2024-04-19T03:02:04.545 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.545 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.545 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:04.545 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.060194+0000", 2024-04-19T03:02:04.545 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.3395e-05 2024-04-19T03:02:04.545 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.545 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.545 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:02:04.545 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.060333+0000", 2024-04-19T03:02:04.545 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00013935799999999999 2024-04-19T03:02:04.546 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.546 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.546 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-04-19T03:02:04.546 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.060477+0000", 2024-04-19T03:02:04.546 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000143938 2024-04-19T03:02:04.546 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.546 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.546 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:02:04.546 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.067752+0000", 2024-04-19T03:02:04.546 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0072741580000000002 2024-04-19T03:02:04.546 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.546 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.546 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:04.547 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.088041+0000", 2024-04-19T03:02:04.547 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.020288955000000001 2024-04-19T03:02:04.547 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.547 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.547 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:02:04.547 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.088113+0000", 2024-04-19T03:02:04.547 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.2492999999999999e-05 2024-04-19T03:02:04.547 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.547 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.547 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:02:04.547 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.088173+0000", 2024-04-19T03:02:04.547 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.0418999999999999e-05 2024-04-19T03:02:04.547 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:04.547 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:02:04.548 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:04.548 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.548 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.548 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4755.0:11274 5.e e26/22 5:7c846032:::benchmark_data_smithi096_19531_object11273:head v 26'697, mlcod=26'692)", 2024-04-19T03:02:04.548 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:42.065726+0000", 2024-04-19T03:02:04.548 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 22.408206684, 2024-04-19T03:02:04.548 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.028607227999999998, 2024-04-19T03:02:04.548 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:02:04.548 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:04.548 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:02:04.548 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.548 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:02:04.548 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.065726+0000", 2024-04-19T03:02:04.548 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:04.549 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.549 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.549 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:02:04.549 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.065726+0000", 2024-04-19T03:02:04.549 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:04.549 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.549 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.549 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:02:04.549 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.065725+0000", 2024-04-19T03:02:04.549 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2024-04-19T03:02:04.549 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.549 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.549 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:02:04.549 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.066818+0000", 2024-04-19T03:02:04.550 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0010930110000000001 2024-04-19T03:02:04.550 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.550 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.550 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:02:04.550 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.066826+0000", 2024-04-19T03:02:04.550 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.0609999999999996e-06 2024-04-19T03:02:04.550 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.550 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.550 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:02:04.550 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.066831+0000", 2024-04-19T03:02:04.550 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.7500000000000003e-06 2024-04-19T03:02:04.550 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.550 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.550 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:04.551 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.066857+0000", 2024-04-19T03:02:04.551 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.6126999999999999e-05 2024-04-19T03:02:04.551 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.551 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.551 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:02:04.551 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.066868+0000", 2024-04-19T03:02:04.551 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1113e-05 2024-04-19T03:02:04.551 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.551 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.551 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:02:04.551 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.094266+0000", 2024-04-19T03:02:04.551 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.027397731000000002 2024-04-19T03:02:04.551 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.551 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.552 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:02:04.552 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.094333+0000", 2024-04-19T03:02:04.552 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.7230000000000005e-05 2024-04-19T03:02:04.552 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:04.552 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:02:04.552 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:04.552 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.552 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.552 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4755.0:11279 5.8 e26/22 5:10b60c58:::benchmark_data_smithi096_19531_object11278:head v 26'723, mlcod=26'719)", 2024-04-19T03:02:04.552 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:42.066841+0000", 2024-04-19T03:02:04.552 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 22.407091369, 2024-04-19T03:02:04.552 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.021736267, 2024-04-19T03:02:04.552 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:02:04.552 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:04.552 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:02:04.553 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.553 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:02:04.553 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.066841+0000", 2024-04-19T03:02:04.553 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:04.553 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.553 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.553 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:02:04.553 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.066841+0000", 2024-04-19T03:02:04.553 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:04.553 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.553 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.553 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:02:04.553 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.066841+0000", 2024-04-19T03:02:04.553 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:04.554 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.554 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.554 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:02:04.554 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.066876+0000", 2024-04-19T03:02:04.554 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.4790999999999999e-05 2024-04-19T03:02:04.554 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.554 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.554 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:02:04.554 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.066880+0000", 2024-04-19T03:02:04.554 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.3610000000000003e-06 2024-04-19T03:02:04.554 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.554 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.554 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:02:04.555 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.066883+0000", 2024-04-19T03:02:04.555 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.4079999999999998e-06 2024-04-19T03:02:04.555 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.555 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.555 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:04.555 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.066929+0000", 2024-04-19T03:02:04.555 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.5444000000000001e-05 2024-04-19T03:02:04.555 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.555 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.555 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:02:04.555 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.066951+0000", 2024-04-19T03:02:04.555 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.2578999999999998e-05 2024-04-19T03:02:04.555 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.555 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.556 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:02:04.556 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.088518+0000", 2024-04-19T03:02:04.556 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.021566617 2024-04-19T03:02:04.556 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.556 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.556 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:02:04.556 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.088578+0000", 2024-04-19T03:02:04.556 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.9655999999999999e-05 2024-04-19T03:02:04.556 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:04.556 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:02:04.556 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:04.556 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.556 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.556 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4755.0:11282 5.e e26/22 5:75b7c510:::benchmark_data_smithi096_19531_object11281:head v 26'698, mlcod=26'693)", 2024-04-19T03:02:04.557 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:42.066923+0000", 2024-04-19T03:02:04.557 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 22.407009502000001, 2024-04-19T03:02:04.557 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.027436461999999998, 2024-04-19T03:02:04.557 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:02:04.557 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:04.557 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:02:04.557 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.557 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:02:04.557 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.066923+0000", 2024-04-19T03:02:04.557 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:04.557 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.557 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.557 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:02:04.557 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.066923+0000", 2024-04-19T03:02:04.557 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:04.558 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.558 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.558 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:02:04.558 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.066923+0000", 2024-04-19T03:02:04.558 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:04.558 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.558 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.558 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:02:04.558 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.066955+0000", 2024-04-19T03:02:04.558 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.2060999999999997e-05 2024-04-19T03:02:04.558 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.558 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.558 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:02:04.559 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.066962+0000", 2024-04-19T03:02:04.559 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.1969999999999999e-06 2024-04-19T03:02:04.559 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.559 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.559 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:02:04.559 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.066967+0000", 2024-04-19T03:02:04.559 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.6589999999999998e-06 2024-04-19T03:02:04.559 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.559 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.559 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:04.559 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.067762+0000", 2024-04-19T03:02:04.559 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00079538199999999997 2024-04-19T03:02:04.559 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.559 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.560 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:02:04.560 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.067782+0000", 2024-04-19T03:02:04.560 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.9432999999999998e-05 2024-04-19T03:02:04.560 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.560 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.560 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:02:04.560 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.094339+0000", 2024-04-19T03:02:04.560 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.026556778999999999 2024-04-19T03:02:04.560 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.560 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.560 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:02:04.560 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.094360+0000", 2024-04-19T03:02:04.560 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.1246e-05 2024-04-19T03:02:04.561 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:04.561 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:02:04.561 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:04.561 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.561 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.561 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4755.0:11291 5.a 5:5ee9d828:::benchmark_data_smithi096_19531_object11290:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T03:02:04.561 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:42.067725+0000", 2024-04-19T03:02:04.561 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 22.406207391999999, 2024-04-19T03:02:04.561 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.021089111000000001, 2024-04-19T03:02:04.561 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:02:04.561 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:04.561 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-04-19T03:02:04.561 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4755", 2024-04-19T03:02:04.561 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:04.562 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 11291 2024-04-19T03:02:04.562 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.562 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:02:04.562 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.562 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:02:04.562 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.067725+0000", 2024-04-19T03:02:04.562 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:04.562 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.562 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.562 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:02:04.562 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.067725+0000", 2024-04-19T03:02:04.562 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:04.562 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.562 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.563 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:02:04.563 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.067724+0000", 2024-04-19T03:02:04.563 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2024-04-19T03:02:04.563 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.563 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.563 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:02:04.563 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.067842+0000", 2024-04-19T03:02:04.563 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000117691 2024-04-19T03:02:04.563 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.563 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.563 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:02:04.563 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.067853+0000", 2024-04-19T03:02:04.563 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0679000000000001e-05 2024-04-19T03:02:04.564 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.564 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.564 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:02:04.564 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.067859+0000", 2024-04-19T03:02:04.564 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.9510000000000003e-06 2024-04-19T03:02:04.564 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.564 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.564 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:04.564 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.067905+0000", 2024-04-19T03:02:04.564 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.6242999999999998e-05 2024-04-19T03:02:04.564 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.564 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.564 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:02:04.564 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.085335+0000", 2024-04-19T03:02:04.565 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.017430451 2024-04-19T03:02:04.565 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.565 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.565 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 1", 2024-04-19T03:02:04.565 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.085538+0000", 2024-04-19T03:02:04.565 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000202511 2024-04-19T03:02:04.565 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.565 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.565 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:04.566 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.087988+0000", 2024-04-19T03:02:04.566 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0024505780000000001 2024-04-19T03:02:04.566 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.566 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.566 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:02:04.566 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.088672+0000", 2024-04-19T03:02:04.566 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00068377900000000003 2024-04-19T03:02:04.566 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.566 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.566 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:02:04.566 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.088757+0000", 2024-04-19T03:02:04.566 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.4384999999999999e-05 2024-04-19T03:02:04.566 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.566 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.567 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:02:04.567 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.088815+0000", 2024-04-19T03:02:04.567 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.7995999999999998e-05 2024-04-19T03:02:04.567 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:04.567 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:02:04.567 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:04.567 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.567 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.567 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4755.0:11293 5.c 5:31728bfd:::benchmark_data_smithi096_19531_object11292:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T03:02:04.567 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:42.068359+0000", 2024-04-19T03:02:04.567 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 22.405573678, 2024-04-19T03:02:04.567 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.022306475999999999, 2024-04-19T03:02:04.567 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:02:04.567 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:04.568 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-04-19T03:02:04.568 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4755", 2024-04-19T03:02:04.568 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:04.568 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 11293 2024-04-19T03:02:04.568 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.568 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:02:04.568 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.568 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:02:04.568 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.068359+0000", 2024-04-19T03:02:04.568 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:04.568 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.569 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.569 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:02:04.569 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.068359+0000", 2024-04-19T03:02:04.569 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:04.569 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.569 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.569 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:02:04.569 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.068358+0000", 2024-04-19T03:02:04.569 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2024-04-19T03:02:04.569 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.569 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.569 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:02:04.569 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.068427+0000", 2024-04-19T03:02:04.569 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.9139000000000003e-05 2024-04-19T03:02:04.570 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.570 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.570 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:02:04.570 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.085292+0000", 2024-04-19T03:02:04.570 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.016864371 2024-04-19T03:02:04.570 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.570 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.570 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:02:04.570 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.085306+0000", 2024-04-19T03:02:04.570 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.434e-05 2024-04-19T03:02:04.570 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.570 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.570 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:04.571 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.085404+0000", 2024-04-19T03:02:04.571 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.8145000000000003e-05 2024-04-19T03:02:04.571 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.571 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.571 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:02:04.571 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.085569+0000", 2024-04-19T03:02:04.571 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00016504099999999999 2024-04-19T03:02:04.571 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.571 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.571 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-04-19T03:02:04.571 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.085739+0000", 2024-04-19T03:02:04.571 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000170099 2024-04-19T03:02:04.571 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.571 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.572 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:02:04.572 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.089603+0000", 2024-04-19T03:02:04.572 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0038636080000000001 2024-04-19T03:02:04.572 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.572 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.572 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:04.572 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.090578+0000", 2024-04-19T03:02:04.572 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00097513199999999997 2024-04-19T03:02:04.572 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.572 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.572 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:02:04.572 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.090618+0000", 2024-04-19T03:02:04.572 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.9987999999999997e-05 2024-04-19T03:02:04.572 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.573 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.573 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:02:04.573 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.090666+0000", 2024-04-19T03:02:04.573 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.7420999999999999e-05 2024-04-19T03:02:04.573 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:04.573 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:02:04.573 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:04.573 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.573 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.573 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4755.0:11288 5.0 e26/22 5:042458d0:::benchmark_data_smithi096_19531_object11287:head v 26'772, mlcod=26'770)", 2024-04-19T03:02:04.573 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:42.068428+0000", 2024-04-19T03:02:04.573 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 22.405505277, 2024-04-19T03:02:04.573 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.020774925, 2024-04-19T03:02:04.573 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:02:04.574 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:04.574 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:02:04.574 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.574 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:02:04.574 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.068428+0000", 2024-04-19T03:02:04.574 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:04.574 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.574 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.574 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:02:04.574 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.068428+0000", 2024-04-19T03:02:04.574 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:04.574 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.574 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.575 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:02:04.575 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.068427+0000", 2024-04-19T03:02:04.575 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:04.575 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.575 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.575 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:02:04.575 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.068481+0000", 2024-04-19T03:02:04.575 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.3866999999999998e-05 2024-04-19T03:02:04.575 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.575 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.575 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:02:04.575 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.085273+0000", 2024-04-19T03:02:04.575 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.016792372999999999 2024-04-19T03:02:04.575 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.576 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.576 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:02:04.576 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.085288+0000", 2024-04-19T03:02:04.576 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4941e-05 2024-04-19T03:02:04.576 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.576 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.576 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:04.576 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.085350+0000", 2024-04-19T03:02:04.576 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.1550999999999994e-05 2024-04-19T03:02:04.576 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.576 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.576 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:02:04.576 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.085384+0000", 2024-04-19T03:02:04.576 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.4915e-05 2024-04-19T03:02:04.577 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.577 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.577 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:02:04.577 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.089164+0000", 2024-04-19T03:02:04.577 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0037794410000000001 2024-04-19T03:02:04.577 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.577 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.577 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:02:04.577 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.089202+0000", 2024-04-19T03:02:04.577 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.8519000000000002e-05 2024-04-19T03:02:04.577 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:04.577 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:02:04.577 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:04.578 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.578 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.578 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4755.0:43739 5.c 5:3f98ce5a:::benchmark_data_smithi096_19531_object43738:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-19T03:02:04.578 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:56.699042+0000", 2024-04-19T03:02:04.578 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 7.7748903499999997, 2024-04-19T03:02:04.578 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.018275395, 2024-04-19T03:02:04.578 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:02:04.578 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:04.578 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-04-19T03:02:04.578 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4755", 2024-04-19T03:02:04.578 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:04.578 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 43739 2024-04-19T03:02:04.578 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.579 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:02:04.579 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.579 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:02:04.579 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:56.699042+0000", 2024-04-19T03:02:04.579 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:04.579 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.579 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.579 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:02:04.579 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:56.699042+0000", 2024-04-19T03:02:04.579 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:04.579 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.579 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.579 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:02:04.579 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:56.699041+0000", 2024-04-19T03:02:04.580 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2024-04-19T03:02:04.580 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.580 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.580 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:02:04.580 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:56.699129+0000", 2024-04-19T03:02:04.580 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.7989000000000001e-05 2024-04-19T03:02:04.580 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.580 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.580 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:02:04.580 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:56.699140+0000", 2024-04-19T03:02:04.580 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1034e-05 2024-04-19T03:02:04.580 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.580 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.580 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:02:04.581 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:56.699146+0000", 2024-04-19T03:02:04.581 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.9000000000000003e-06 2024-04-19T03:02:04.581 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.581 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.581 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:04.581 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:56.706318+0000", 2024-04-19T03:02:04.581 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0071715449999999997 2024-04-19T03:02:04.581 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.581 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.581 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:02:04.581 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:56.706444+0000", 2024-04-19T03:02:04.581 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012612499999999999 2024-04-19T03:02:04.581 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.581 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.582 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-04-19T03:02:04.582 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:56.706559+0000", 2024-04-19T03:02:04.582 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000114852 2024-04-19T03:02:04.582 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.582 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.582 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:02:04.582 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:56.711087+0000", 2024-04-19T03:02:04.582 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0045284790000000002 2024-04-19T03:02:04.582 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.582 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.582 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:04.582 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:56.717260+0000", 2024-04-19T03:02:04.583 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0061730229999999997 2024-04-19T03:02:04.583 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.583 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.583 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:02:04.583 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:56.717298+0000", 2024-04-19T03:02:04.583 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.7339999999999998e-05 2024-04-19T03:02:04.583 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.583 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.583 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:02:04.583 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:56.717318+0000", 2024-04-19T03:02:04.583 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.0119000000000002e-05 2024-04-19T03:02:04.583 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:04.583 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:02:04.583 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:04.583 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.584 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.584 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4755.0:52909 5.b e34/22 5:df07ce30:::benchmark_data_smithi096_19531_object52908:head v 34'3385, mlcod=34'3382)", 2024-04-19T03:02:04.584 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:02:01.602017+0000", 2024-04-19T03:02:04.584 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 2.8719158139999998, 2024-04-19T03:02:04.584 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.019478457000000001, 2024-04-19T03:02:04.584 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:02:04.584 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:04.584 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:02:04.584 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.584 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:02:04.584 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:01.602017+0000", 2024-04-19T03:02:04.584 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:04.584 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.585 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.585 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:02:04.585 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:01.602017+0000", 2024-04-19T03:02:04.585 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:04.585 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.585 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.585 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:02:04.585 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:01.602016+0000", 2024-04-19T03:02:04.585 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:04.585 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.585 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.585 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:02:04.585 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:01.602066+0000", 2024-04-19T03:02:04.585 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.9741999999999999e-05 2024-04-19T03:02:04.586 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.586 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.586 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:02:04.586 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:01.602076+0000", 2024-04-19T03:02:04.586 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.6889999999999999e-06 2024-04-19T03:02:04.586 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.586 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.586 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:02:04.586 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:01.602081+0000", 2024-04-19T03:02:04.586 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.2839999999999997e-06 2024-04-19T03:02:04.586 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.586 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.586 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:04.587 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:01.602127+0000", 2024-04-19T03:02:04.587 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.6257000000000001e-05 2024-04-19T03:02:04.587 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.587 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.587 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:02:04.587 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:01.602152+0000", 2024-04-19T03:02:04.587 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.4740999999999999e-05 2024-04-19T03:02:04.587 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.587 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.587 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:02:04.588 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:01.621468+0000", 2024-04-19T03:02:04.588 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.019315704999999999 2024-04-19T03:02:04.588 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.588 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.588 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:02:04.588 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:01.621495+0000", 2024-04-19T03:02:04.588 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.7664000000000001e-05 2024-04-19T03:02:04.588 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:04.588 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:02:04.588 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:04.588 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.588 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.589 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4755.0:52924 5.3 5:cc08e96a:::benchmark_data_smithi096_19531_object52923:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-19T03:02:04.589 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:02:01.610014+0000", 2024-04-19T03:02:04.589 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 2.8639187989999999, 2024-04-19T03:02:04.589 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.019272049999999999, 2024-04-19T03:02:04.589 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:02:04.589 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:04.589 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-04-19T03:02:04.589 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4755", 2024-04-19T03:02:04.589 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:04.589 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 52924 2024-04-19T03:02:04.589 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.589 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:02:04.589 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.590 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:02:04.590 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:01.610014+0000", 2024-04-19T03:02:04.590 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:04.590 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.590 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.590 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:02:04.590 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:01.610014+0000", 2024-04-19T03:02:04.590 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:04.590 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.590 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.590 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:02:04.590 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:01.610013+0000", 2024-04-19T03:02:04.590 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:04.591 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.591 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.591 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:02:04.591 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:01.610064+0000", 2024-04-19T03:02:04.591 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.1062e-05 2024-04-19T03:02:04.591 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.591 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.591 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:02:04.591 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:01.610073+0000", 2024-04-19T03:02:04.591 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.3480000000000004e-06 2024-04-19T03:02:04.591 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.591 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.591 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:02:04.592 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:01.610077+0000", 2024-04-19T03:02:04.592 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.2220000000000004e-06 2024-04-19T03:02:04.592 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.592 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.592 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:04.592 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:01.618767+0000", 2024-04-19T03:02:04.592 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0086896790000000005 2024-04-19T03:02:04.592 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.592 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.592 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:02:04.592 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:01.618869+0000", 2024-04-19T03:02:04.592 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00010192999999999999 2024-04-19T03:02:04.592 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.593 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.593 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-04-19T03:02:04.593 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:01.618957+0000", 2024-04-19T03:02:04.593 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.8110999999999997e-05 2024-04-19T03:02:04.593 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.593 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.593 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:04.593 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:01.629053+0000", 2024-04-19T03:02:04.593 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.010096199 2024-04-19T03:02:04.593 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.593 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.593 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:02:04.593 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:01.629190+0000", 2024-04-19T03:02:04.594 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000137052 2024-04-19T03:02:04.594 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.594 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.594 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:02:04.594 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:01.629241+0000", 2024-04-19T03:02:04.594 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.0822999999999998e-05 2024-04-19T03:02:04.594 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:04.594 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:04.594 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:02:04.594 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:01.629286+0000", 2024-04-19T03:02:04.594 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.5246e-05 2024-04-19T03:02:04.594 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:04.594 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:02:04.595 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:04.595 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:04.595 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:02:04.595 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-04-19T03:02:04.596 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:04.593+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:04.597 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T03:02:04.697 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-04-19T03:02:04.694+0000 7f35986ab700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18243) UID: 0 2024-04-19T03:02:04.718 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-19T03:02:04.718 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-04-19T03:02:04.718 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:04.718 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:58342 5.0 5:0e84528c:::benchmark_data_smithi096_19531_object58341:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-19T03:02:04.718 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:04.704826+0000", 2024-04-19T03:02:04.718 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.012686769000000001, 2024-04-19T03:02:04.718 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.012714914000000001, 2024-04-19T03:02:04.718 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:04.718 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:02:04.718 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:04.718 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:04.719 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:04.719 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 58342 2024-04-19T03:02:04.719 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:04.719 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:04.719 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:04.719 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:04.719 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:04.704826+0000", 2024-04-19T03:02:04.719 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:04.719 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:04.719 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:04.719 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:04.719 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:04.704826+0000", 2024-04-19T03:02:04.719 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:04.719 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:04.719 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:04.720 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:04.720 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:04.704825+0000", 2024-04-19T03:02:04.720 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:04.720 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:04.720 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:04.720 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:04.720 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:04.704885+0000", 2024-04-19T03:02:04.720 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0769e-05 2024-04-19T03:02:04.720 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:04.720 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:04.720 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:04.720 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:04.704896+0000", 2024-04-19T03:02:04.720 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0370000000000001e-05 2024-04-19T03:02:04.721 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:04.721 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:04.721 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:04.721 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:04.704901+0000", 2024-04-19T03:02:04.721 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.344e-06 2024-04-19T03:02:04.721 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:04.721 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:04.721 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:04.721 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:04.704960+0000", 2024-04-19T03:02:04.721 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9184000000000001e-05 2024-04-19T03:02:04.721 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:04.721 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:04.721 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:04.721 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:04.705116+0000", 2024-04-19T03:02:04.722 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000156071 2024-04-19T03:02:04.722 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:04.722 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:04.722 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:04.722 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:04.705261+0000", 2024-04-19T03:02:04.722 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014414000000000001 2024-04-19T03:02:04.722 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:04.722 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:04.722 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:04.722 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:04.708308+0000", 2024-04-19T03:02:04.722 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0030470889999999998 2024-04-19T03:02:04.722 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:04.722 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:04.722 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:04.723 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:04.723 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:04.723 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:58348 5.0 5:01e3ca65:::benchmark_data_smithi096_19531_object58347:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-19T03:02:04.723 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:04.708318+0000", 2024-04-19T03:02:04.723 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0091944109999999996, 2024-04-19T03:02:04.723 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0092862880000000002, 2024-04-19T03:02:04.723 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:04.723 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:02:04.723 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:04.723 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:04.723 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:04.723 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 58348 2024-04-19T03:02:04.723 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:04.724 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:04.724 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:04.724 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:04.724 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:04.708318+0000", 2024-04-19T03:02:04.724 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:04.724 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:04.724 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:04.724 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:04.724 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:04.708318+0000", 2024-04-19T03:02:04.724 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:04.724 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:04.724 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:04.724 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:04.725 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:04.708317+0000", 2024-04-19T03:02:04.725 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:04.725 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:04.725 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:04.725 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:04.725 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:04.708377+0000", 2024-04-19T03:02:04.725 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0442999999999997e-05 2024-04-19T03:02:04.725 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:04.725 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:04.725 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:04.725 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:04.708385+0000", 2024-04-19T03:02:04.726 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5580000000000003e-06 2024-04-19T03:02:04.726 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:04.726 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:04.726 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:04.726 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:04.708389+0000", 2024-04-19T03:02:04.726 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5900000000000001e-06 2024-04-19T03:02:04.727 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:04.727 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:04.727 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:04.727 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:04.708441+0000", 2024-04-19T03:02:04.727 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1830999999999999e-05 2024-04-19T03:02:04.727 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:04.727 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:04.727 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:04.727 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:04.708581+0000", 2024-04-19T03:02:04.727 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013975500000000001 2024-04-19T03:02:04.727 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:04.728 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:04.728 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:04.728 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:04.708708+0000", 2024-04-19T03:02:04.728 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012678099999999999 2024-04-19T03:02:04.728 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:04.728 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:04.728 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:04.728 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:04.711348+0000", 2024-04-19T03:02:04.728 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0026398979999999999 2024-04-19T03:02:04.728 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:04.728 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:04.728 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:04.728 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:04.729 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:04.729 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:58357 5.0 5:061d74de:::benchmark_data_smithi096_19531_object58356:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-19T03:02:04.729 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:04.713193+0000", 2024-04-19T03:02:04.729 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.004319654, 2024-04-19T03:02:04.729 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0044597710000000004, 2024-04-19T03:02:04.729 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:04.729 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:02:04.729 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:04.729 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:04.729 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:04.729 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 58357 2024-04-19T03:02:04.730 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:04.730 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:04.730 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:04.730 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:04.730 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:04.713193+0000", 2024-04-19T03:02:04.730 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:04.730 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:04.730 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:04.730 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:04.730 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:04.713193+0000", 2024-04-19T03:02:04.730 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:04.730 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:04.731 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:04.731 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:04.731 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:04.713192+0000", 2024-04-19T03:02:04.731 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:04.731 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:04.731 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:04.731 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:04.731 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:04.713251+0000", 2024-04-19T03:02:04.731 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9304e-05 2024-04-19T03:02:04.731 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:04.731 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:04.731 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:04.731 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:04.713261+0000", 2024-04-19T03:02:04.732 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.7350000000000008e-06 2024-04-19T03:02:04.732 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:04.732 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:04.732 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:04.732 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:04.713266+0000", 2024-04-19T03:02:04.732 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7709999999999997e-06 2024-04-19T03:02:04.732 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:04.732 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:04.732 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:04.732 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:04.713300+0000", 2024-04-19T03:02:04.732 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4517000000000002e-05 2024-04-19T03:02:04.732 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:04.732 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:04.732 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:04.733 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:04.713413+0000", 2024-04-19T03:02:04.733 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000112522 2024-04-19T03:02:04.733 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:04.733 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:04.733 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:04.733 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:04.713509+0000", 2024-04-19T03:02:04.733 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.6328000000000003e-05 2024-04-19T03:02:04.733 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:04.733 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:04.733 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:04.733 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:04.715735+0000", 2024-04-19T03:02:04.733 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0022256310000000001 2024-04-19T03:02:04.733 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:04.734 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:04.734 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:04.734 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:04.734 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:04.734 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:58358 5.0 5:017765ef:::benchmark_data_smithi096_19531_object58357:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-19T03:02:04.734 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:04.715649+0000", 2024-04-19T03:02:04.734 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.001863654, 2024-04-19T03:02:04.734 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0020511679999999999, 2024-04-19T03:02:04.734 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:04.734 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:02:04.734 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:04.734 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:04.734 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:04.735 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 58358 2024-04-19T03:02:04.735 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:04.735 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:04.735 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:04.735 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:04.735 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:04.715649+0000", 2024-04-19T03:02:04.735 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:04.735 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:04.735 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:04.735 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:04.735 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:04.715649+0000", 2024-04-19T03:02:04.735 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:04.735 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:04.735 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:04.736 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:04.736 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:04.715648+0000", 2024-04-19T03:02:04.736 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:04.736 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:04.736 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:04.736 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:04.736 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:04.715721+0000", 2024-04-19T03:02:04.736 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3523999999999996e-05 2024-04-19T03:02:04.736 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:04.736 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:04.736 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:04.737 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:04.715734+0000", 2024-04-19T03:02:04.737 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3383999999999999e-05 2024-04-19T03:02:04.737 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:04.737 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:04.737 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:04.737 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:04.715744+0000", 2024-04-19T03:02:04.737 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.8600000000000005e-06 2024-04-19T03:02:04.737 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:04.737 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:04.737 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:04.737 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:04.715781+0000", 2024-04-19T03:02:04.738 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6182e-05 2024-04-19T03:02:04.738 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:04.738 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:04.738 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:04.738 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:04.715875+0000", 2024-04-19T03:02:04.738 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.4932000000000005e-05 2024-04-19T03:02:04.738 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:04.738 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:04.738 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:04.738 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:04.715978+0000", 2024-04-19T03:02:04.738 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010297399999999999 2024-04-19T03:02:04.738 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:04.739 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:04.739 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:04.739 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:04.739 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-04-19T03:02:04.739 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 4 2024-04-19T03:02:04.739 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-19T03:02:04.740 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T03:02:04.798 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:04.796+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:04.822 INFO:tasks.radosbench.radosbench.0.smithi096.stdout: 27 16 58564 58548 135.513 107.438 0.00740887 0.00737324 2024-04-19T03:02:04.865 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-19T03:02:04.866 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-04-19T03:02:04.866 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-04-19T03:02:04.866 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-04-19T03:02:04.866 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-19T03:02:04.877 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T03:02:04.900 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-04-19T03:02:04.898+0000 7f35986ab700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18243) UID: 0 2024-04-19T03:02:05.001 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:05.000+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:05.002 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-19T03:02:05.002 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-04-19T03:02:05.002 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-04-19T03:02:05.002 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-04-19T03:02:05.002 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.003 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:10 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:02:05.003 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:14.999496+0000", 2024-04-19T03:02:05.003 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 50.000540936999997, 2024-04-19T03:02:05.003 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.022720497999999999, 2024-04-19T03:02:05.003 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:05.003 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:05.003 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:05.003 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.003 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:05.003 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999496+0000", 2024-04-19T03:02:05.003 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:05.003 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.003 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.004 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:05.004 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999496+0000", 2024-04-19T03:02:05.004 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:05.004 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.004 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.004 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:05.004 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999494+0000", 2024-04-19T03:02:05.004 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:05.004 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.004 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.004 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:05.004 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999503+0000", 2024-04-19T03:02:05.004 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.5930000000000006e-06 2024-04-19T03:02:05.004 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.005 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.005 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:05.005 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999523+0000", 2024-04-19T03:02:05.005 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9553000000000001e-05 2024-04-19T03:02:05.005 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.005 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.005 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:05.005 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999538+0000", 2024-04-19T03:02:05.005 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5702999999999999e-05 2024-04-19T03:02:05.005 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.005 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.005 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:05.005 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999608+0000", 2024-04-19T03:02:05.006 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.9912000000000004e-05 2024-04-19T03:02:05.006 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.006 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.006 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op must wait for map", 2024-04-19T03:02:05.006 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999626+0000", 2024-04-19T03:02:05.006 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8207e-05 2024-04-19T03:02:05.006 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.006 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.006 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:05.006 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.010765+0000", 2024-04-19T03:02:05.006 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011138719 2024-04-19T03:02:05.006 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.007 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.007 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:05.007 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.010906+0000", 2024-04-19T03:02:05.007 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014095899999999999 2024-04-19T03:02:05.007 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.007 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.008 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-04-19T03:02:05.008 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.011472+0000", 2024-04-19T03:02:05.008 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00056629300000000005 2024-04-19T03:02:05.008 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.008 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.008 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:05.008 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.013217+0000", 2024-04-19T03:02:05.008 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001744317 2024-04-19T03:02:05.008 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.009 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.009 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:05.009 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.022083+0000", 2024-04-19T03:02:05.009 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0088663849999999992 2024-04-19T03:02:05.009 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.009 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.009 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:05.009 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.022124+0000", 2024-04-19T03:02:05.009 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.057e-05 2024-04-19T03:02:05.009 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.009 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.009 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:05.009 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.022216+0000", 2024-04-19T03:02:05.010 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.2417000000000006e-05 2024-04-19T03:02:05.010 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:05.010 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:05.010 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:05.010 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.010 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.010 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:13 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:02:05.010 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:14.999564+0000", 2024-04-19T03:02:05.010 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 50.000472055000003, 2024-04-19T03:02:05.010 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.019594777000000001, 2024-04-19T03:02:05.010 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:05.010 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:05.010 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:05.011 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.011 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:05.011 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999564+0000", 2024-04-19T03:02:05.011 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:05.011 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.011 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.011 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:05.011 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999564+0000", 2024-04-19T03:02:05.011 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:05.011 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.011 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.011 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:05.011 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999563+0000", 2024-04-19T03:02:05.011 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:05.012 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.012 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.012 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:05.012 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999582+0000", 2024-04-19T03:02:05.012 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8151999999999998e-05 2024-04-19T03:02:05.012 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.012 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.012 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:05.012 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999599+0000", 2024-04-19T03:02:05.012 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7583000000000001e-05 2024-04-19T03:02:05.012 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.012 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.012 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:05.013 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999618+0000", 2024-04-19T03:02:05.013 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8989999999999999e-05 2024-04-19T03:02:05.013 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.013 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.013 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:05.013 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999692+0000", 2024-04-19T03:02:05.013 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3561999999999998e-05 2024-04-19T03:02:05.013 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.013 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.013 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op must wait for map", 2024-04-19T03:02:05.013 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999698+0000", 2024-04-19T03:02:05.013 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7159999999999997e-06 2024-04-19T03:02:05.013 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.013 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.013 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:05.014 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.007836+0000", 2024-04-19T03:02:05.014 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0081376520000000004 2024-04-19T03:02:05.014 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.014 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.014 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:05.014 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.008208+0000", 2024-04-19T03:02:05.014 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00037223699999999998 2024-04-19T03:02:05.014 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.014 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.014 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-04-19T03:02:05.014 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.008516+0000", 2024-04-19T03:02:05.014 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000308227 2024-04-19T03:02:05.014 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.015 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.015 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:05.015 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.011585+0000", 2024-04-19T03:02:05.015 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0030680659999999999 2024-04-19T03:02:05.015 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.015 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.015 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:05.015 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.018871+0000", 2024-04-19T03:02:05.015 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0072861369999999998 2024-04-19T03:02:05.015 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.015 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.015 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:05.015 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.019067+0000", 2024-04-19T03:02:05.015 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00019672099999999999 2024-04-19T03:02:05.016 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.016 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.016 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:05.016 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.019159+0000", 2024-04-19T03:02:05.016 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1829999999999993e-05 2024-04-19T03:02:05.016 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:05.016 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:05.016 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:05.016 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.016 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.016 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:32 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:02:05.016 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:14.999712+0000", 2024-04-19T03:02:05.016 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 50.000324694, 2024-04-19T03:02:05.017 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.022635437000000001, 2024-04-19T03:02:05.017 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:05.017 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:05.017 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:05.017 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.017 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:05.017 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999712+0000", 2024-04-19T03:02:05.017 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:05.017 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.017 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.017 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:05.017 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999712+0000", 2024-04-19T03:02:05.017 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:05.018 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.018 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.018 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:05.018 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999711+0000", 2024-04-19T03:02:05.018 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:05.018 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.018 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.019 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:05.019 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999719+0000", 2024-04-19T03:02:05.019 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.354e-06 2024-04-19T03:02:05.019 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.019 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.019 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:05.019 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999735+0000", 2024-04-19T03:02:05.019 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6288999999999999e-05 2024-04-19T03:02:05.019 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.019 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.019 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:05.019 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999749+0000", 2024-04-19T03:02:05.019 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3492999999999999e-05 2024-04-19T03:02:05.020 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.020 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.020 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:05.020 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999811+0000", 2024-04-19T03:02:05.020 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2298999999999994e-05 2024-04-19T03:02:05.020 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.020 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.020 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:02:05.020 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999817+0000", 2024-04-19T03:02:05.020 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2169999999999999e-06 2024-04-19T03:02:05.020 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.020 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.020 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:05.020 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.011836+0000", 2024-04-19T03:02:05.021 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.012018008 2024-04-19T03:02:05.021 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.021 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.021 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:05.021 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.011897+0000", 2024-04-19T03:02:05.021 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1111000000000005e-05 2024-04-19T03:02:05.021 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.021 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.021 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-04-19T03:02:05.021 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.011980+0000", 2024-04-19T03:02:05.021 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3003999999999993e-05 2024-04-19T03:02:05.021 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.022 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.022 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:05.022 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.013863+0000", 2024-04-19T03:02:05.022 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001883804 2024-04-19T03:02:05.022 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.022 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.022 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:05.022 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.022257+0000", 2024-04-19T03:02:05.022 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0083938290000000002 2024-04-19T03:02:05.022 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.022 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.022 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:05.022 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.022310+0000", 2024-04-19T03:02:05.022 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.236e-05 2024-04-19T03:02:05.023 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.023 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.023 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:05.023 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.022347+0000", 2024-04-19T03:02:05.023 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7653e-05 2024-04-19T03:02:05.023 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:05.023 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:05.023 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:05.023 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.023 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.023 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:35 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:02:05.023 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:14.999772+0000", 2024-04-19T03:02:05.023 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 50.000264414999997, 2024-04-19T03:02:05.023 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020205530999999999, 2024-04-19T03:02:05.024 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:05.024 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:05.024 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:05.024 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.024 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:05.024 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999772+0000", 2024-04-19T03:02:05.024 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:05.024 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.024 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.024 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:05.024 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999772+0000", 2024-04-19T03:02:05.024 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:05.024 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.025 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.025 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:05.025 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999771+0000", 2024-04-19T03:02:05.025 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:05.025 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.025 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.025 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:05.025 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999778+0000", 2024-04-19T03:02:05.025 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2200000000000003e-06 2024-04-19T03:02:05.025 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.025 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.025 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:05.025 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999794+0000", 2024-04-19T03:02:05.026 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5798999999999999e-05 2024-04-19T03:02:05.026 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.026 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.026 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:05.026 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999809+0000", 2024-04-19T03:02:05.026 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.469e-05 2024-04-19T03:02:05.026 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.027 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.027 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:05.027 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999915+0000", 2024-04-19T03:02:05.027 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000105658 2024-04-19T03:02:05.027 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.028 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.028 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:02:05.028 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999927+0000", 2024-04-19T03:02:05.028 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.201e-05 2024-04-19T03:02:05.028 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.028 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.028 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:05.028 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.009841+0000", 2024-04-19T03:02:05.028 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0099147039999999999 2024-04-19T03:02:05.028 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.029 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.029 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:05.029 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.009941+0000", 2024-04-19T03:02:05.029 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.9461000000000002e-05 2024-04-19T03:02:05.029 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.029 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.030 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-04-19T03:02:05.030 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.010101+0000", 2024-04-19T03:02:05.030 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016028599999999999 2024-04-19T03:02:05.030 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.030 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.030 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:05.030 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.011787+0000", 2024-04-19T03:02:05.030 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001685513 2024-04-19T03:02:05.030 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.030 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.030 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:05.030 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.019889+0000", 2024-04-19T03:02:05.030 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0081026559999999997 2024-04-19T03:02:05.031 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.031 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.031 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:05.031 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.019932+0000", 2024-04-19T03:02:05.031 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2385000000000002e-05 2024-04-19T03:02:05.031 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.031 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.031 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:05.031 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.019978+0000", 2024-04-19T03:02:05.031 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6093000000000001e-05 2024-04-19T03:02:05.031 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:05.031 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:05.031 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:05.032 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.032 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.032 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:18 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:02:05.032 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:14.999834+0000", 2024-04-19T03:02:05.032 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 50.00020233, 2024-04-19T03:02:05.032 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.019567312999999999, 2024-04-19T03:02:05.032 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:05.032 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:05.032 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:05.032 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.032 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:05.032 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999834+0000", 2024-04-19T03:02:05.032 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:05.033 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.033 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.033 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:05.033 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999834+0000", 2024-04-19T03:02:05.033 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:05.033 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.033 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.033 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:05.033 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999833+0000", 2024-04-19T03:02:05.033 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:05.033 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.033 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.033 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:05.034 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999842+0000", 2024-04-19T03:02:05.034 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.2269999999999999e-06 2024-04-19T03:02:05.034 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.034 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.034 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:05.034 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999860+0000", 2024-04-19T03:02:05.034 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8456000000000001e-05 2024-04-19T03:02:05.034 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.034 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.034 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:05.034 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999874+0000", 2024-04-19T03:02:05.034 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3263e-05 2024-04-19T03:02:05.034 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.035 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.035 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:05.035 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999934+0000", 2024-04-19T03:02:05.035 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0888999999999999e-05 2024-04-19T03:02:05.035 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.035 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.035 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:02:05.035 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999940+0000", 2024-04-19T03:02:05.035 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4330000000000003e-06 2024-04-19T03:02:05.035 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.035 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.035 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:05.035 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.010943+0000", 2024-04-19T03:02:05.036 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011002786000000001 2024-04-19T03:02:05.036 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.036 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.036 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:05.036 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.011078+0000", 2024-04-19T03:02:05.036 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013541000000000001 2024-04-19T03:02:05.036 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.036 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.036 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-04-19T03:02:05.036 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.011172+0000", 2024-04-19T03:02:05.036 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.3459000000000001e-05 2024-04-19T03:02:05.036 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.036 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.036 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:05.037 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.013211+0000", 2024-04-19T03:02:05.037 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0020397710000000001 2024-04-19T03:02:05.037 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.037 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.037 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:05.037 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.019320+0000", 2024-04-19T03:02:05.037 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0061089969999999997 2024-04-19T03:02:05.037 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.037 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.037 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:05.037 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.019364+0000", 2024-04-19T03:02:05.037 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4158e-05 2024-04-19T03:02:05.038 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.038 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.038 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:05.038 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.019402+0000", 2024-04-19T03:02:05.038 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7011000000000002e-05 2024-04-19T03:02:05.038 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:05.038 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:05.038 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:05.038 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.038 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.038 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:24 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:02:05.038 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:14.999964+0000", 2024-04-19T03:02:05.038 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 50.000073016000002, 2024-04-19T03:02:05.039 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020451446000000002, 2024-04-19T03:02:05.039 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:05.039 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-19T03:02:05.039 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:05.039 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.040 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:05.040 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999964+0000", 2024-04-19T03:02:05.040 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:05.040 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.040 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.040 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:05.041 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999964+0000", 2024-04-19T03:02:05.041 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:05.041 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.041 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.041 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:05.041 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999963+0000", 2024-04-19T03:02:05.041 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:05.041 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.041 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.041 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:05.041 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999969+0000", 2024-04-19T03:02:05.041 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0270000000000001e-06 2024-04-19T03:02:05.042 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.042 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.042 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:05.042 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999984+0000", 2024-04-19T03:02:05.042 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5903e-05 2024-04-19T03:02:05.042 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.042 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.042 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:05.042 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999998+0000", 2024-04-19T03:02:05.042 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3076e-05 2024-04-19T03:02:05.042 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.042 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.042 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:05.043 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.000078+0000", 2024-04-19T03:02:05.043 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0525000000000006e-05 2024-04-19T03:02:05.043 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.043 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.043 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op must wait for map", 2024-04-19T03:02:05.043 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.000084+0000", 2024-04-19T03:02:05.043 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8370000000000002e-06 2024-04-19T03:02:05.043 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.043 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.043 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:05.044 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.008819+0000", 2024-04-19T03:02:05.044 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0087349019999999993 2024-04-19T03:02:05.044 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.044 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.044 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:05.044 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.009018+0000", 2024-04-19T03:02:05.044 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000198989 2024-04-19T03:02:05.044 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.044 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.044 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:05.044 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.020415+0000", 2024-04-19T03:02:05.045 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011397157 2024-04-19T03:02:05.045 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:05.045 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:05.045 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:05.045 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.045 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.045 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:11274 5.e 5:7c846032:::benchmark_data_smithi096_19531_object11273:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T03:02:05.045 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:42.061776+0000", 2024-04-19T03:02:05.045 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 22.938260770999999, 2024-04-19T03:02:05.045 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.035381001000000002, 2024-04-19T03:02:05.046 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:05.046 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:05.046 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:05.046 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:05.046 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:05.046 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 11274 2024-04-19T03:02:05.046 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.046 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:05.046 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.046 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:05.046 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.061776+0000", 2024-04-19T03:02:05.046 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:05.046 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.047 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.047 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:05.047 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.061776+0000", 2024-04-19T03:02:05.047 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:05.047 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.047 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.047 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:05.047 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.061775+0000", 2024-04-19T03:02:05.047 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:05.047 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.048 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.048 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:05.048 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.061807+0000", 2024-04-19T03:02:05.048 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1733000000000003e-05 2024-04-19T03:02:05.048 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.048 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.048 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:05.048 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.061822+0000", 2024-04-19T03:02:05.048 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5452999999999999e-05 2024-04-19T03:02:05.048 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.048 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.048 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:05.048 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.061827+0000", 2024-04-19T03:02:05.048 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9810000000000003e-06 2024-04-19T03:02:05.048 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.049 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.049 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:05.049 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.063388+0000", 2024-04-19T03:02:05.049 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0015605720000000001 2024-04-19T03:02:05.049 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.049 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.049 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:05.049 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.063612+0000", 2024-04-19T03:02:05.049 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00022431 2024-04-19T03:02:05.049 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.049 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.049 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:05.049 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.063747+0000", 2024-04-19T03:02:05.049 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013459600000000001 2024-04-19T03:02:05.050 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.050 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.050 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:05.050 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.066186+0000", 2024-04-19T03:02:05.050 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0024388909999999999 2024-04-19T03:02:05.050 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.050 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.050 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:05.050 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.097016+0000", 2024-04-19T03:02:05.050 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.030830705 2024-04-19T03:02:05.050 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.050 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.050 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:05.050 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.097096+0000", 2024-04-19T03:02:05.051 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.9469999999999996e-05 2024-04-19T03:02:05.051 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.051 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.051 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:05.051 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.097157+0000", 2024-04-19T03:02:05.051 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0884999999999997e-05 2024-04-19T03:02:05.051 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:05.051 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:05.051 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:05.051 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.051 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.051 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:11279 5.8 5:10b60c58:::benchmark_data_smithi096_19531_object11278:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T03:02:05.051 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:42.062594+0000", 2024-04-19T03:02:05.052 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 22.937442333, 2024-04-19T03:02:05.052 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.028696788000000001, 2024-04-19T03:02:05.052 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:05.052 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:05.052 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:05.052 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:05.052 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:05.052 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 11279 2024-04-19T03:02:05.052 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.052 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:05.052 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.052 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:05.052 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.062594+0000", 2024-04-19T03:02:05.052 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:05.053 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.053 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.053 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:05.053 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.062594+0000", 2024-04-19T03:02:05.053 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:05.053 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.053 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.053 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:05.053 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.062593+0000", 2024-04-19T03:02:05.053 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:05.053 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.053 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.053 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:05.053 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.062646+0000", 2024-04-19T03:02:05.053 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2293999999999998e-05 2024-04-19T03:02:05.054 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.054 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.054 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:05.054 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.062657+0000", 2024-04-19T03:02:05.054 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1440000000000001e-05 2024-04-19T03:02:05.054 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.054 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.054 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:05.054 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.062665+0000", 2024-04-19T03:02:05.054 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5159999999999997e-06 2024-04-19T03:02:05.054 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.054 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.054 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:05.054 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.063799+0000", 2024-04-19T03:02:05.055 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0011344860000000001 2024-04-19T03:02:05.055 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.055 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.055 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:05.055 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.063962+0000", 2024-04-19T03:02:05.055 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000162614 2024-04-19T03:02:05.055 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.055 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.055 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:05.055 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.064167+0000", 2024-04-19T03:02:05.055 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00020491699999999999 2024-04-19T03:02:05.055 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.055 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.055 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:05.055 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.066768+0000", 2024-04-19T03:02:05.056 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0026012090000000002 2024-04-19T03:02:05.056 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.056 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.056 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:05.056 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.091184+0000", 2024-04-19T03:02:05.056 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.024416582999999999 2024-04-19T03:02:05.056 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.056 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.056 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:05.056 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.091251+0000", 2024-04-19T03:02:05.056 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6753000000000003e-05 2024-04-19T03:02:05.056 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.056 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.056 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:05.057 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.091291+0000", 2024-04-19T03:02:05.057 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9841e-05 2024-04-19T03:02:05.057 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:05.057 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:05.057 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:05.057 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.057 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.057 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:11282 5.e 5:75b7c510:::benchmark_data_smithi096_19531_object11281:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T03:02:05.058 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:42.062674+0000", 2024-04-19T03:02:05.058 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 22.937362876999998, 2024-04-19T03:02:05.058 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.034812849, 2024-04-19T03:02:05.058 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:05.058 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:05.058 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:05.058 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:05.058 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:05.058 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 11282 2024-04-19T03:02:05.058 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.058 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:05.058 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.058 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:05.059 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.062674+0000", 2024-04-19T03:02:05.059 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:05.059 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.059 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.059 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:05.059 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.062674+0000", 2024-04-19T03:02:05.059 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:05.059 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.059 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.059 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:05.059 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.062673+0000", 2024-04-19T03:02:05.059 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:05.059 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.059 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.059 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:05.060 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.062712+0000", 2024-04-19T03:02:05.060 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9341999999999997e-05 2024-04-19T03:02:05.060 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.060 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.060 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:05.060 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.062721+0000", 2024-04-19T03:02:05.060 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1700000000000003e-06 2024-04-19T03:02:05.060 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.060 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.060 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:05.060 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.062729+0000", 2024-04-19T03:02:05.060 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4240000000000004e-06 2024-04-19T03:02:05.060 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.060 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.060 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:05.061 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.065017+0000", 2024-04-19T03:02:05.061 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0022878590000000002 2024-04-19T03:02:05.061 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.061 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.061 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:05.061 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.065207+0000", 2024-04-19T03:02:05.061 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000190411 2024-04-19T03:02:05.061 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.061 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.061 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:05.061 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.065323+0000", 2024-04-19T03:02:05.062 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000115593 2024-04-19T03:02:05.062 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.062 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.062 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:05.062 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.069683+0000", 2024-04-19T03:02:05.062 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0043604409999999996 2024-04-19T03:02:05.062 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.062 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.062 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:05.062 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.097273+0000", 2024-04-19T03:02:05.062 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.027589516000000001 2024-04-19T03:02:05.063 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.063 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.063 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:05.063 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.097406+0000", 2024-04-19T03:02:05.063 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000133514 2024-04-19T03:02:05.063 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.063 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.063 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:05.063 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.097486+0000", 2024-04-19T03:02:05.063 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0479e-05 2024-04-19T03:02:05.063 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:05.063 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:05.063 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:05.064 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.064 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.064 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:11288 5.0 5:042458d0:::benchmark_data_smithi096_19531_object11287:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T03:02:05.064 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:42.070352+0000", 2024-04-19T03:02:05.064 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 22.929684948999999, 2024-04-19T03:02:05.064 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.021532447, 2024-04-19T03:02:05.064 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:05.064 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:05.064 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:05.064 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:05.064 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:05.064 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 11288 2024-04-19T03:02:05.064 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.064 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:05.064 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.065 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:05.065 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.070352+0000", 2024-04-19T03:02:05.065 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:05.065 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.065 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.065 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:05.065 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.070352+0000", 2024-04-19T03:02:05.065 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:05.065 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.065 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.065 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:05.065 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.070351+0000", 2024-04-19T03:02:05.065 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:05.065 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.066 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.066 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:05.066 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.070392+0000", 2024-04-19T03:02:05.066 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1077e-05 2024-04-19T03:02:05.066 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.066 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.066 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:05.066 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.070398+0000", 2024-04-19T03:02:05.066 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1109999999999996e-06 2024-04-19T03:02:05.066 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.066 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.066 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:05.067 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.070402+0000", 2024-04-19T03:02:05.067 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2010000000000001e-06 2024-04-19T03:02:05.067 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.067 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.067 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:05.067 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.070445+0000", 2024-04-19T03:02:05.067 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2585e-05 2024-04-19T03:02:05.067 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.067 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.067 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:05.067 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.070572+0000", 2024-04-19T03:02:05.067 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012708500000000001 2024-04-19T03:02:05.067 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.067 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.067 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:05.068 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.070711+0000", 2024-04-19T03:02:05.068 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013848699999999999 2024-04-19T03:02:05.068 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.068 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.068 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:05.068 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.073505+0000", 2024-04-19T03:02:05.068 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0027944620000000002 2024-04-19T03:02:05.068 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.068 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.068 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:05.068 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.091806+0000", 2024-04-19T03:02:05.068 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.018301251000000001 2024-04-19T03:02:05.068 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.068 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.069 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:05.069 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.091854+0000", 2024-04-19T03:02:05.069 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7419000000000001e-05 2024-04-19T03:02:05.069 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.069 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.069 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:05.069 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.091884+0000", 2024-04-19T03:02:05.069 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0241999999999999e-05 2024-04-19T03:02:05.069 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:05.069 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:05.069 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:05.069 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.069 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.069 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:11292 5.0 5:009b2ea9:::benchmark_data_smithi096_19531_object11291:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T03:02:05.070 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:42.070676+0000", 2024-04-19T03:02:05.070 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 22.929360574, 2024-04-19T03:02:05.070 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.02219631, 2024-04-19T03:02:05.070 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:05.070 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:05.070 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:05.070 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:05.070 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:05.070 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 11292 2024-04-19T03:02:05.070 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.070 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:05.070 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.070 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:05.070 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.070676+0000", 2024-04-19T03:02:05.071 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:05.071 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.071 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.071 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:05.071 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.070676+0000", 2024-04-19T03:02:05.071 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:05.071 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.071 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.071 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:05.071 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.070675+0000", 2024-04-19T03:02:05.071 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:05.071 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.071 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.071 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:05.072 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.070800+0000", 2024-04-19T03:02:05.072 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000125263 2024-04-19T03:02:05.072 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.072 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.072 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:05.072 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.070808+0000", 2024-04-19T03:02:05.072 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0209999999999999e-06 2024-04-19T03:02:05.072 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.072 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.072 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:05.072 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.070814+0000", 2024-04-19T03:02:05.072 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0969999999999996e-06 2024-04-19T03:02:05.072 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.072 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.072 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:05.073 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.071956+0000", 2024-04-19T03:02:05.073 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0011427480000000001 2024-04-19T03:02:05.073 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.073 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.073 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:05.073 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.072153+0000", 2024-04-19T03:02:05.073 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000196524 2024-04-19T03:02:05.073 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.073 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.073 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:05.073 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.072312+0000", 2024-04-19T03:02:05.073 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015879300000000001 2024-04-19T03:02:05.073 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.073 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.074 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:05.074 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.078407+0000", 2024-04-19T03:02:05.074 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0060954929999999996 2024-04-19T03:02:05.074 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.074 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.074 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:05.074 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.092742+0000", 2024-04-19T03:02:05.074 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.014335349000000001 2024-04-19T03:02:05.074 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.074 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.074 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:05.074 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.092815+0000", 2024-04-19T03:02:05.074 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2881999999999998e-05 2024-04-19T03:02:05.074 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.075 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.075 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:05.075 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.092872+0000", 2024-04-19T03:02:05.075 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6965000000000001e-05 2024-04-19T03:02:05.075 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:05.075 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:05.075 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:05.075 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.075 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.075 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:11297 5.e 5:7975ecb6:::benchmark_data_smithi096_19531_object11296:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T03:02:05.075 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:42.076848+0000", 2024-04-19T03:02:05.075 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 22.923188694, 2024-04-19T03:02:05.075 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020867969, 2024-04-19T03:02:05.075 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:05.075 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:05.076 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:05.076 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:05.076 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:05.076 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 11297 2024-04-19T03:02:05.076 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.076 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:05.076 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.076 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:05.076 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.076848+0000", 2024-04-19T03:02:05.076 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:05.076 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.076 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.076 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:05.076 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.076848+0000", 2024-04-19T03:02:05.077 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:05.077 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.077 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.077 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:05.077 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.076846+0000", 2024-04-19T03:02:05.077 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:05.077 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.077 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.077 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:05.077 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.076894+0000", 2024-04-19T03:02:05.077 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7645000000000002e-05 2024-04-19T03:02:05.077 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.077 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.077 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:05.077 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.076913+0000", 2024-04-19T03:02:05.078 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8885e-05 2024-04-19T03:02:05.078 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.078 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.078 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:05.078 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.076924+0000", 2024-04-19T03:02:05.078 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.118e-05 2024-04-19T03:02:05.078 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.078 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.078 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:05.078 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.076983+0000", 2024-04-19T03:02:05.078 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8952000000000001e-05 2024-04-19T03:02:05.078 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.079 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.079 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:05.079 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.077156+0000", 2024-04-19T03:02:05.079 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00017307600000000001 2024-04-19T03:02:05.079 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.079 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.079 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:05.079 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.077358+0000", 2024-04-19T03:02:05.079 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000201991 2024-04-19T03:02:05.079 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.079 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.079 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:05.079 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.080885+0000", 2024-04-19T03:02:05.079 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0035268309999999998 2024-04-19T03:02:05.079 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.080 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.080 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:05.080 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.097569+0000", 2024-04-19T03:02:05.080 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.016683854000000001 2024-04-19T03:02:05.080 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.080 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.080 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:05.080 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.097647+0000", 2024-04-19T03:02:05.080 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.7823000000000004e-05 2024-04-19T03:02:05.080 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.080 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.080 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:05.080 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.097716+0000", 2024-04-19T03:02:05.080 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.9079999999999996e-05 2024-04-19T03:02:05.081 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:05.081 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:05.081 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:05.081 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.081 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.081 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:11298 5.e 5:72565f0a:::benchmark_data_smithi096_19531_object11297:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T03:02:05.081 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:42.076954+0000", 2024-04-19T03:02:05.082 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 22.923082820000001, 2024-04-19T03:02:05.082 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020950191999999999, 2024-04-19T03:02:05.082 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:05.082 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:05.082 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:05.082 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:05.082 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:05.082 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 11298 2024-04-19T03:02:05.082 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.083 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:05.083 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.083 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:05.083 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.076954+0000", 2024-04-19T03:02:05.083 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:05.083 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.083 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.083 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:05.083 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.076954+0000", 2024-04-19T03:02:05.083 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:05.083 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.083 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.083 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:05.083 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.076953+0000", 2024-04-19T03:02:05.084 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:05.084 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.084 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.084 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:05.084 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.076997+0000", 2024-04-19T03:02:05.084 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4023000000000002e-05 2024-04-19T03:02:05.084 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.084 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.084 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:05.084 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.077009+0000", 2024-04-19T03:02:05.084 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2456000000000001e-05 2024-04-19T03:02:05.085 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.085 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.085 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:05.085 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.077015+0000", 2024-04-19T03:02:05.085 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7950000000000004e-06 2024-04-19T03:02:05.085 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.085 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.085 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:05.085 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.078552+0000", 2024-04-19T03:02:05.085 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0015371320000000001 2024-04-19T03:02:05.085 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.085 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.085 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:05.085 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.078760+0000", 2024-04-19T03:02:05.085 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00020808799999999999 2024-04-19T03:02:05.086 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.086 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.086 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:05.086 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.078875+0000", 2024-04-19T03:02:05.086 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011457500000000001 2024-04-19T03:02:05.086 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.086 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.086 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:05.086 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.083603+0000", 2024-04-19T03:02:05.086 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0047276239999999997 2024-04-19T03:02:05.086 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.086 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.086 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:05.087 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.097783+0000", 2024-04-19T03:02:05.087 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.014180036 2024-04-19T03:02:05.087 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.087 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.087 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:05.087 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.097863+0000", 2024-04-19T03:02:05.087 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0317999999999999e-05 2024-04-19T03:02:05.087 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.087 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.087 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:05.087 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.097904+0000", 2024-04-19T03:02:05.087 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1035000000000003e-05 2024-04-19T03:02:05.087 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:05.087 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:05.088 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:05.088 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.088 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.088 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:41640 5.0 5:0989f358:::benchmark_data_smithi096_19531_object41639:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-19T03:02:05.088 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:55.640790+0000", 2024-04-19T03:02:05.088 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 9.3592463759999998, 2024-04-19T03:02:05.088 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020000754999999999, 2024-04-19T03:02:05.088 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:05.088 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:05.088 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:05.088 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:05.088 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:05.088 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 41640 2024-04-19T03:02:05.088 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.089 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:05.089 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.089 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:05.089 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:55.640790+0000", 2024-04-19T03:02:05.089 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:05.089 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.089 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.089 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:05.089 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:55.640790+0000", 2024-04-19T03:02:05.089 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:05.089 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.089 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.089 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:05.089 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:55.640789+0000", 2024-04-19T03:02:05.090 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:05.090 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.090 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.090 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:05.090 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:55.640829+0000", 2024-04-19T03:02:05.090 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9870999999999998e-05 2024-04-19T03:02:05.090 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.090 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.090 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:05.090 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:55.640838+0000", 2024-04-19T03:02:05.091 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.8899999999999996e-06 2024-04-19T03:02:05.091 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.091 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.091 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:05.091 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:55.640843+0000", 2024-04-19T03:02:05.091 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1630000000000004e-06 2024-04-19T03:02:05.091 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.091 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.091 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:05.092 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:55.649279+0000", 2024-04-19T03:02:05.092 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0084358179999999994 2024-04-19T03:02:05.092 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.092 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.092 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:05.092 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:55.649388+0000", 2024-04-19T03:02:05.092 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010836399999999999 2024-04-19T03:02:05.092 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.092 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.093 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:05.093 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:55.649479+0000", 2024-04-19T03:02:05.093 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1284000000000002e-05 2024-04-19T03:02:05.093 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.093 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.093 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:05.093 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:55.656726+0000", 2024-04-19T03:02:05.093 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.007246962 2024-04-19T03:02:05.094 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.094 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.094 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:05.094 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:55.660689+0000", 2024-04-19T03:02:05.094 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0039628900000000002 2024-04-19T03:02:05.094 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.094 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.095 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:05.095 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:55.660755+0000", 2024-04-19T03:02:05.095 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6267999999999996e-05 2024-04-19T03:02:05.095 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.095 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.095 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:05.095 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:55.660791+0000", 2024-04-19T03:02:05.095 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5975e-05 2024-04-19T03:02:05.095 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:05.096 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:05.096 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:05.096 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.096 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.096 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:50553 5.0 5:041697c2:::benchmark_data_smithi096_19531_object50552:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-19T03:02:05.096 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:00.314446+0000", 2024-04-19T03:02:05.096 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 4.685590565, 2024-04-19T03:02:05.097 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.019029635, 2024-04-19T03:02:05.097 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:05.097 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:05.097 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:05.097 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:05.097 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:05.097 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 50553 2024-04-19T03:02:05.097 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.097 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:05.098 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.098 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:05.098 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:00.314446+0000", 2024-04-19T03:02:05.098 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:05.098 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.098 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.098 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:05.098 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:00.314446+0000", 2024-04-19T03:02:05.099 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:05.099 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.099 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.099 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:05.099 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:00.314445+0000", 2024-04-19T03:02:05.099 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:05.099 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.099 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.100 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:05.100 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:00.314535+0000", 2024-04-19T03:02:05.100 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.0303999999999995e-05 2024-04-19T03:02:05.100 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.100 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.100 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:05.100 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:00.314549+0000", 2024-04-19T03:02:05.100 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4039999999999999e-05 2024-04-19T03:02:05.101 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.101 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.101 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:05.101 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:00.314557+0000", 2024-04-19T03:02:05.101 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.7039999999999994e-06 2024-04-19T03:02:05.101 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.101 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.101 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:05.101 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:00.324568+0000", 2024-04-19T03:02:05.102 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.010011406 2024-04-19T03:02:05.102 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.102 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.102 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:05.102 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:00.324700+0000", 2024-04-19T03:02:05.102 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000131879 2024-04-19T03:02:05.102 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.102 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.103 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:05.103 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:00.324889+0000", 2024-04-19T03:02:05.103 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0001885 2024-04-19T03:02:05.103 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.103 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.103 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:05.103 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:00.329400+0000", 2024-04-19T03:02:05.103 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0045109 2024-04-19T03:02:05.104 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.104 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.104 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:05.104 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:00.333400+0000", 2024-04-19T03:02:05.104 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0040001699999999999 2024-04-19T03:02:05.104 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.104 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.104 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:05.104 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:00.333432+0000", 2024-04-19T03:02:05.105 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1930000000000001e-05 2024-04-19T03:02:05.105 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.105 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.105 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:05.105 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:00.333476+0000", 2024-04-19T03:02:05.105 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3831000000000001e-05 2024-04-19T03:02:05.105 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:05.105 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:05.105 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:05.105 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.106 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.106 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:50576 5.b 5:d250063d:::benchmark_data_smithi096_19531_object50575:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-19T03:02:05.106 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:00.329584+0000", 2024-04-19T03:02:05.106 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 4.6704522060000002, 2024-04-19T03:02:05.106 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.021217389, 2024-04-19T03:02:05.106 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:05.106 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:05.106 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:05.106 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:05.106 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:05.106 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 50576 2024-04-19T03:02:05.106 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.106 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:05.107 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.107 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:05.107 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:00.329584+0000", 2024-04-19T03:02:05.107 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:05.107 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.107 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.107 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:05.107 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:00.329584+0000", 2024-04-19T03:02:05.107 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:05.107 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.107 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.107 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:05.108 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:00.329583+0000", 2024-04-19T03:02:05.108 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:05.108 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.108 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.108 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:05.108 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:00.329626+0000", 2024-04-19T03:02:05.108 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2530000000000001e-05 2024-04-19T03:02:05.108 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.108 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.108 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:05.108 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:00.329642+0000", 2024-04-19T03:02:05.108 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5891000000000001e-05 2024-04-19T03:02:05.108 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.108 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.109 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:05.109 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:00.329652+0000", 2024-04-19T03:02:05.109 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0093e-05 2024-04-19T03:02:05.109 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.109 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.109 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:05.109 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:00.330793+0000", 2024-04-19T03:02:05.109 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001141097 2024-04-19T03:02:05.109 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.109 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.109 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:05.109 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:00.330924+0000", 2024-04-19T03:02:05.109 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013114499999999999 2024-04-19T03:02:05.109 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.110 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.110 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:05.110 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:00.331055+0000", 2024-04-19T03:02:05.110 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013124600000000001 2024-04-19T03:02:05.110 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.110 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.110 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:05.110 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:00.335705+0000", 2024-04-19T03:02:05.110 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0046501549999999996 2024-04-19T03:02:05.110 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.110 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.110 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:05.110 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:00.350741+0000", 2024-04-19T03:02:05.111 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015035411 2024-04-19T03:02:05.111 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.111 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.111 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:05.111 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:00.350777+0000", 2024-04-19T03:02:05.111 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5874999999999998e-05 2024-04-19T03:02:05.111 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.111 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.111 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:05.111 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:00.350802+0000", 2024-04-19T03:02:05.111 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5040000000000001e-05 2024-04-19T03:02:05.111 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:05.111 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:05.111 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:05.111 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.112 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.112 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:52909 5.b 5:df07ce30:::benchmark_data_smithi096_19531_object52908:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-19T03:02:05.112 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:01.602899+0000", 2024-04-19T03:02:05.112 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 3.3971378360000002, 2024-04-19T03:02:05.112 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020403345, 2024-04-19T03:02:05.112 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:05.112 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:05.112 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:05.112 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:05.112 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:05.112 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 52909 2024-04-19T03:02:05.112 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.112 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:05.113 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.113 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:05.113 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:01.602899+0000", 2024-04-19T03:02:05.113 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:05.113 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.113 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.113 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:05.113 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:01.602899+0000", 2024-04-19T03:02:05.113 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:05.113 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.113 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.113 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:05.113 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:01.602883+0000", 2024-04-19T03:02:05.113 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999838 2024-04-19T03:02:05.113 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.114 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.114 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:05.114 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:01.602956+0000", 2024-04-19T03:02:05.114 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2941000000000005e-05 2024-04-19T03:02:05.114 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.114 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.114 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:05.114 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:01.602970+0000", 2024-04-19T03:02:05.114 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4562999999999999e-05 2024-04-19T03:02:05.114 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.114 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.114 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:05.114 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:01.602981+0000", 2024-04-19T03:02:05.115 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1134999999999999e-05 2024-04-19T03:02:05.115 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.115 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.115 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:05.115 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:01.603043+0000", 2024-04-19T03:02:05.115 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2034999999999998e-05 2024-04-19T03:02:05.115 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.115 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.115 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:05.115 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:01.603173+0000", 2024-04-19T03:02:05.115 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012962800000000001 2024-04-19T03:02:05.115 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.115 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.115 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:05.116 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:01.603296+0000", 2024-04-19T03:02:05.116 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012313 2024-04-19T03:02:05.116 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.116 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.116 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:05.116 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:01.606862+0000", 2024-04-19T03:02:05.116 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0035656049999999999 2024-04-19T03:02:05.116 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.116 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.116 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:05.116 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:01.623147+0000", 2024-04-19T03:02:05.116 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.016285286 2024-04-19T03:02:05.116 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.116 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.117 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:05.117 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:01.623251+0000", 2024-04-19T03:02:05.117 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000104245 2024-04-19T03:02:05.117 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.117 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.117 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:05.117 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:01.623302+0000", 2024-04-19T03:02:05.117 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0763999999999997e-05 2024-04-19T03:02:05.117 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:05.117 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:05.117 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:05.117 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.117 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.117 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:52912 5.b 5:deddbeae:::benchmark_data_smithi096_19531_object52911:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-19T03:02:05.118 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:01.603006+0000", 2024-04-19T03:02:05.118 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 3.3970300450000002, 2024-04-19T03:02:05.118 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020493783000000002, 2024-04-19T03:02:05.118 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:05.118 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:05.118 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:05.118 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:05.118 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:05.118 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 52912 2024-04-19T03:02:05.118 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.118 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:05.118 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.118 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:05.118 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:01.603006+0000", 2024-04-19T03:02:05.119 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:05.119 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.119 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.119 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:05.119 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:01.603006+0000", 2024-04-19T03:02:05.119 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:05.119 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.119 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.119 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:05.119 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:01.603006+0000", 2024-04-19T03:02:05.119 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:05.120 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.120 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.120 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:05.120 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:01.603054+0000", 2024-04-19T03:02:05.120 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8529000000000002e-05 2024-04-19T03:02:05.120 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.120 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.120 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:05.120 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:01.603067+0000", 2024-04-19T03:02:05.120 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2412000000000001e-05 2024-04-19T03:02:05.120 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.120 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.121 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:05.121 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:01.603078+0000", 2024-04-19T03:02:05.121 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1059e-05 2024-04-19T03:02:05.121 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.121 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.121 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:05.121 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:01.605226+0000", 2024-04-19T03:02:05.121 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0021488029999999999 2024-04-19T03:02:05.121 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.121 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.121 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:05.121 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:01.605333+0000", 2024-04-19T03:02:05.121 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000106346 2024-04-19T03:02:05.121 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.122 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.122 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:05.122 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:01.605426+0000", 2024-04-19T03:02:05.122 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.2985999999999994e-05 2024-04-19T03:02:05.122 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.122 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.122 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:05.122 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:01.607251+0000", 2024-04-19T03:02:05.122 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0018255789999999999 2024-04-19T03:02:05.122 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.122 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.122 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:05.122 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:01.623413+0000", 2024-04-19T03:02:05.123 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.016161854999999999 2024-04-19T03:02:05.123 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.123 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.123 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:05.123 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:01.623448+0000", 2024-04-19T03:02:05.123 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4498000000000001e-05 2024-04-19T03:02:05.123 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.123 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.123 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:05.123 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:01.623500+0000", 2024-04-19T03:02:05.123 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2543999999999997e-05 2024-04-19T03:02:05.123 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:05.123 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:05.124 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:05.124 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.124 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.124 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:57961 5.4 5:25b0464f:::benchmark_data_smithi096_19531_object57960:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-19T03:02:05.124 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:04.472703+0000", 2024-04-19T03:02:05.124 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.52733376200000004, 2024-04-19T03:02:05.124 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.021714888000000002, 2024-04-19T03:02:05.124 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:05.124 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:05.124 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:05.124 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:05.124 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:05.124 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 57961 2024-04-19T03:02:05.124 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.125 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:05.125 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.125 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:05.125 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:04.472703+0000", 2024-04-19T03:02:05.125 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:05.125 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.125 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.125 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:05.125 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:04.472703+0000", 2024-04-19T03:02:05.125 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:05.125 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.125 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.125 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:05.125 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:04.472701+0000", 2024-04-19T03:02:05.126 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:05.126 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.126 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.126 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:05.126 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:04.472805+0000", 2024-04-19T03:02:05.126 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000103268 2024-04-19T03:02:05.126 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.126 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.126 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:05.126 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:04.472818+0000", 2024-04-19T03:02:05.126 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3528e-05 2024-04-19T03:02:05.126 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.126 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.127 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:05.127 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:04.472825+0000", 2024-04-19T03:02:05.127 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.0210000000000002e-06 2024-04-19T03:02:05.127 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.127 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.127 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:05.127 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:04.473983+0000", 2024-04-19T03:02:05.127 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0011581600000000001 2024-04-19T03:02:05.128 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.128 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.128 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:05.128 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:04.474201+0000", 2024-04-19T03:02:05.128 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00021749000000000001 2024-04-19T03:02:05.128 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.128 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.128 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:05.129 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:04.474378+0000", 2024-04-19T03:02:05.129 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00017696300000000001 2024-04-19T03:02:05.129 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.129 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.129 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:05.129 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:04.477308+0000", 2024-04-19T03:02:05.129 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0029298140000000002 2024-04-19T03:02:05.130 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.130 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.130 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:05.130 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:04.494322+0000", 2024-04-19T03:02:05.130 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.017014567000000001 2024-04-19T03:02:05.130 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.130 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.130 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:05.131 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:04.494386+0000", 2024-04-19T03:02:05.131 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4122999999999996e-05 2024-04-19T03:02:05.131 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.131 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.131 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:05.131 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:04.494418+0000", 2024-04-19T03:02:05.131 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1245999999999999e-05 2024-04-19T03:02:05.131 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:05.132 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:05.132 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:05.132 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.132 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.132 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:58042 5.b 5:d6f19b42:::benchmark_data_smithi096_19531_object58041:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-19T03:02:05.132 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:04.520286+0000", 2024-04-19T03:02:05.132 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.47975036700000001, 2024-04-19T03:02:05.132 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020956167000000001, 2024-04-19T03:02:05.133 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:05.133 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:05.133 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:05.133 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:05.133 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:05.133 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 58042 2024-04-19T03:02:05.133 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.134 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:05.134 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.134 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:05.134 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:04.520286+0000", 2024-04-19T03:02:05.134 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:05.134 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.134 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.135 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:05.135 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:04.520286+0000", 2024-04-19T03:02:05.135 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:05.135 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.135 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.135 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:05.136 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:04.520285+0000", 2024-04-19T03:02:05.136 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:05.136 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.136 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.136 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:05.136 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:04.520374+0000", 2024-04-19T03:02:05.137 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9599999999999996e-05 2024-04-19T03:02:05.137 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.137 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.137 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:05.137 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:04.520409+0000", 2024-04-19T03:02:05.137 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4952e-05 2024-04-19T03:02:05.138 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.138 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.138 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:05.138 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:04.520421+0000", 2024-04-19T03:02:05.138 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.187e-05 2024-04-19T03:02:05.138 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.139 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.139 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:05.139 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:04.523527+0000", 2024-04-19T03:02:05.139 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.003105465 2024-04-19T03:02:05.139 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.139 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.140 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:05.140 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:04.523740+0000", 2024-04-19T03:02:05.140 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00021303500000000001 2024-04-19T03:02:05.140 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.140 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.140 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:05.141 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:04.523947+0000", 2024-04-19T03:02:05.141 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00020676599999999999 2024-04-19T03:02:05.141 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.141 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.141 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:05.141 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:04.532791+0000", 2024-04-19T03:02:05.142 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0088447079999999997 2024-04-19T03:02:05.142 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.142 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.142 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:05.142 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:04.541145+0000", 2024-04-19T03:02:05.142 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0083535620000000001 2024-04-19T03:02:05.143 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.143 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.143 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:05.143 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:04.541208+0000", 2024-04-19T03:02:05.143 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3303e-05 2024-04-19T03:02:05.143 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:05.143 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:05.144 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:05.144 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:04.541242+0000", 2024-04-19T03:02:05.144 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4226000000000001e-05 2024-04-19T03:02:05.144 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:05.144 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:05.144 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:05.145 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:05.145 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:05.145 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-19T03:02:05.147 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-04-19T03:02:05.142+0000 7f35986ab700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18243) UID: 0 2024-04-19T03:02:05.148 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T03:02:05.149 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-19T03:02:05.247 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:05.245+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:05.281 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-04-19T03:02:05.281 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [ 2024-04-19T03:02:05.281 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.281 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:59359 5.9 5:93fafcca:::benchmark_data_smithi096_19531_object59358:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-19T03:02:05.281 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:05.274498+0000", 2024-04-19T03:02:05.282 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0051605389999999996, 2024-04-19T03:02:05.282 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0051802530000000001, 2024-04-19T03:02:05.282 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:05.282 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:02:05.282 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:05.282 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:05.282 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:05.282 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 59359 2024-04-19T03:02:05.282 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.282 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:05.282 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.282 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:05.282 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:05.274498+0000", 2024-04-19T03:02:05.283 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:05.283 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.283 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.283 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:05.283 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:05.274498+0000", 2024-04-19T03:02:05.283 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:05.284 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.284 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.284 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:05.284 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:05.274497+0000", 2024-04-19T03:02:05.284 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:05.284 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.284 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.284 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:05.284 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:05.274580+0000", 2024-04-19T03:02:05.284 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2997000000000005e-05 2024-04-19T03:02:05.284 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.284 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.285 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:05.285 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:05.274592+0000", 2024-04-19T03:02:05.285 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1816e-05 2024-04-19T03:02:05.285 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.285 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.285 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:05.285 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:05.274598+0000", 2024-04-19T03:02:05.285 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5409999999999997e-06 2024-04-19T03:02:05.285 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.285 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.285 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:05.285 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:05.278157+0000", 2024-04-19T03:02:05.286 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0035582750000000001 2024-04-19T03:02:05.286 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.286 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.286 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:05.286 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:05.278321+0000", 2024-04-19T03:02:05.286 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000164134 2024-04-19T03:02:05.286 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.286 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.286 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:02:05.286 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:05.278484+0000", 2024-04-19T03:02:05.286 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00016369900000000001 2024-04-19T03:02:05.286 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:05.286 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:05.287 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:05.287 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.287 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.287 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:59361 5.f 5:f882cf7b:::benchmark_data_smithi096_19531_object59360:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-19T03:02:05.287 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:05.275903+0000", 2024-04-19T03:02:05.287 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.003755305, 2024-04-19T03:02:05.287 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0038212699999999999, 2024-04-19T03:02:05.287 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:05.287 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:02:05.287 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:05.287 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:05.287 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:05.287 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 59361 2024-04-19T03:02:05.287 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.288 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:05.288 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.288 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:05.288 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:05.275903+0000", 2024-04-19T03:02:05.288 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:05.288 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.288 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.288 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:05.288 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:05.275903+0000", 2024-04-19T03:02:05.288 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:05.288 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.288 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.288 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:05.288 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:05.275903+0000", 2024-04-19T03:02:05.289 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:05.289 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.289 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.289 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:05.289 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:05.275970+0000", 2024-04-19T03:02:05.289 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7719000000000007e-05 2024-04-19T03:02:05.289 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.289 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.289 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:05.289 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:05.275981+0000", 2024-04-19T03:02:05.289 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1174e-05 2024-04-19T03:02:05.289 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.290 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.290 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:05.290 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:05.275991+0000", 2024-04-19T03:02:05.290 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.3149999999999998e-06 2024-04-19T03:02:05.290 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.290 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.290 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:05.290 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:05.276032+0000", 2024-04-19T03:02:05.290 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1258999999999999e-05 2024-04-19T03:02:05.290 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.290 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.290 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:05.290 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:05.276219+0000", 2024-04-19T03:02:05.291 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000187376 2024-04-19T03:02:05.291 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.291 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.291 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:02:05.291 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:05.276338+0000", 2024-04-19T03:02:05.291 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000118337 2024-04-19T03:02:05.291 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.291 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.291 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:05.291 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:05.279615+0000", 2024-04-19T03:02:05.291 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0032772629999999999 2024-04-19T03:02:05.291 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:05.291 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:05.291 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:05.291 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.292 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.292 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop_reply(client.4755.0:59349 5.9 e35/22)", 2024-04-19T03:02:05.292 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:05.276195+0000", 2024-04-19T03:02:05.292 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0034640970000000002, 2024-04-19T03:02:05.292 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0035687259999999999, 2024-04-19T03:02:05.292 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:05.292 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-04-19T03:02:05.292 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:05.292 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.292 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:05.292 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:05.276195+0000", 2024-04-19T03:02:05.292 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:05.292 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.293 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.293 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:05.293 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:05.276195+0000", 2024-04-19T03:02:05.293 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:05.293 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.293 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.293 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:05.293 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:05.276194+0000", 2024-04-19T03:02:05.293 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:05.293 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.293 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.293 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:05.293 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:05.276199+0000", 2024-04-19T03:02:05.294 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4260000000000002e-06 2024-04-19T03:02:05.294 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.294 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.294 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:05.294 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:05.276210+0000", 2024-04-19T03:02:05.294 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1034e-05 2024-04-19T03:02:05.294 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.294 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.294 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:05.294 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:05.276222+0000", 2024-04-19T03:02:05.294 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2204e-05 2024-04-19T03:02:05.294 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:05.295 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:05.295 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:05.295 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.295 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.295 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:59363 5.2 5:4db0e282:::benchmark_data_smithi096_19531_object59362:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-19T03:02:05.295 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:05.276395+0000", 2024-04-19T03:02:05.295 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.003263223, 2024-04-19T03:02:05.295 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.003394574, 2024-04-19T03:02:05.295 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:05.296 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:02:05.296 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:05.296 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:05.296 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:05.296 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 59363 2024-04-19T03:02:05.296 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.296 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:05.296 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.296 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:05.296 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:05.276395+0000", 2024-04-19T03:02:05.296 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:05.297 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.297 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.297 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:05.297 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:05.276395+0000", 2024-04-19T03:02:05.297 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:05.297 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.297 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.297 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:05.297 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:05.276394+0000", 2024-04-19T03:02:05.297 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:05.297 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.297 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.297 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:05.297 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:05.276449+0000", 2024-04-19T03:02:05.298 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4348000000000002e-05 2024-04-19T03:02:05.298 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.298 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.298 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:05.298 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:05.276457+0000", 2024-04-19T03:02:05.298 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9009999999999994e-06 2024-04-19T03:02:05.298 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.298 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.298 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:05.298 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:05.276462+0000", 2024-04-19T03:02:05.299 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9609999999999996e-06 2024-04-19T03:02:05.299 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.299 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.299 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:05.299 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:05.276497+0000", 2024-04-19T03:02:05.299 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5219000000000003e-05 2024-04-19T03:02:05.299 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.299 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.299 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:05.300 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:05.276593+0000", 2024-04-19T03:02:05.300 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.6260000000000003e-05 2024-04-19T03:02:05.300 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.300 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.300 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:05.300 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:05.276772+0000", 2024-04-19T03:02:05.301 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00017899999999999999 2024-04-19T03:02:05.301 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.301 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.301 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:05.301 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:05.279598+0000", 2024-04-19T03:02:05.301 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0028255519999999998 2024-04-19T03:02:05.302 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:05.302 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:05.302 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:05.302 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.302 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.302 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4755.0:59362 5.6 e35/22 5:6f3103ae:::benchmark_data_smithi096_19531_object59361:head v 35'3753, mlcod=35'3751)", 2024-04-19T03:02:05.303 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:05.276757+0000", 2024-04-19T03:02:05.303 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0029012180000000001, 2024-04-19T03:02:05.303 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0030726299999999998, 2024-04-19T03:02:05.303 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:05.303 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-04-19T03:02:05.303 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:05.304 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.304 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:05.304 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:05.276757+0000", 2024-04-19T03:02:05.304 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:05.304 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.304 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.305 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:05.305 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:05.276757+0000", 2024-04-19T03:02:05.305 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:05.305 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.305 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.305 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:05.306 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:05.276757+0000", 2024-04-19T03:02:05.306 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:05.306 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.306 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.306 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:05.307 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:05.276868+0000", 2024-04-19T03:02:05.307 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00011160800000000001 2024-04-19T03:02:05.307 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.307 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.307 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:05.307 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:05.276878+0000", 2024-04-19T03:02:05.308 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0023999999999999e-05 2024-04-19T03:02:05.308 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.308 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.308 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:05.308 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:05.276884+0000", 2024-04-19T03:02:05.308 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1669999999999998e-06 2024-04-19T03:02:05.309 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.309 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.309 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:05.309 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:05.276920+0000", 2024-04-19T03:02:05.309 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6096999999999997e-05 2024-04-19T03:02:05.309 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.309 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.309 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:05.310 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:05.276933+0000", 2024-04-19T03:02:05.310 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3302000000000001e-05 2024-04-19T03:02:05.310 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:05.310 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:05.310 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:05.310 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.311 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.311 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4755.0:59366 5.d e35/22 5:bfcba36d:::benchmark_data_smithi096_19531_object59365:head v 35'3740, mlcod=35'3738)", 2024-04-19T03:02:05.311 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:05.277256+0000", 2024-04-19T03:02:05.311 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0024022119999999999, 2024-04-19T03:02:05.311 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.002602764, 2024-04-19T03:02:05.311 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:05.312 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-04-19T03:02:05.312 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:05.312 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.312 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:05.312 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:05.277256+0000", 2024-04-19T03:02:05.312 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:05.313 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.313 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.313 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:05.313 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:05.277256+0000", 2024-04-19T03:02:05.313 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:05.313 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.314 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.314 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:05.314 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:05.277256+0000", 2024-04-19T03:02:05.314 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:05.314 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.314 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.315 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:05.315 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:05.277328+0000", 2024-04-19T03:02:05.315 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2274000000000006e-05 2024-04-19T03:02:05.315 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.315 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.315 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:05.316 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:05.277340+0000", 2024-04-19T03:02:05.316 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1956999999999999e-05 2024-04-19T03:02:05.316 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.316 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.316 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:05.316 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:05.277346+0000", 2024-04-19T03:02:05.317 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.976e-06 2024-04-19T03:02:05.317 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.317 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.317 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:05.317 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:05.277389+0000", 2024-04-19T03:02:05.318 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2898999999999997e-05 2024-04-19T03:02:05.318 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.318 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.318 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:05.318 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:05.277428+0000", 2024-04-19T03:02:05.318 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9060999999999998e-05 2024-04-19T03:02:05.319 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:05.319 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:05.319 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:05.319 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.319 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.320 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop_reply(client.4755.0:59350 5.9 e35/22)", 2024-04-19T03:02:05.320 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:05.278461+0000", 2024-04-19T03:02:05.320 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.00119728, 2024-04-19T03:02:05.320 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0014252550000000001, 2024-04-19T03:02:05.320 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:05.321 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-04-19T03:02:05.321 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:05.321 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.321 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:05.321 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:05.278461+0000", 2024-04-19T03:02:05.321 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:05.322 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.322 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.322 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:05.322 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:05.278461+0000", 2024-04-19T03:02:05.322 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:05.323 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.323 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.323 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:05.323 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:05.278461+0000", 2024-04-19T03:02:05.323 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:05.323 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.324 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.324 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:05.324 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:05.278466+0000", 2024-04-19T03:02:05.324 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5439999999999998e-06 2024-04-19T03:02:05.324 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.324 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.325 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:05.325 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:05.278475+0000", 2024-04-19T03:02:05.325 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.5469999999999997e-06 2024-04-19T03:02:05.325 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.325 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.325 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:05.326 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:05.278481+0000", 2024-04-19T03:02:05.326 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2219999999999999e-06 2024-04-19T03:02:05.326 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:05.326 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:05.326 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:05.326 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.327 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.327 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:59367 5.1 5.af258d71 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-19T03:02:05.327 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:05.278525+0000", 2024-04-19T03:02:05.327 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0011337369999999999, 2024-04-19T03:02:05.327 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0013851880000000001, 2024-04-19T03:02:05.327 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:05.328 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-04-19T03:02:05.328 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:05.328 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:05.328 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:05.328 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 59367 2024-04-19T03:02:05.329 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.329 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:05.329 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.329 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:05.329 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:05.278525+0000", 2024-04-19T03:02:05.329 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:05.330 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.330 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.330 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:05.330 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:05.278525+0000", 2024-04-19T03:02:05.330 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:05.330 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.330 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.331 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:05.331 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:05.278524+0000", 2024-04-19T03:02:05.331 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:05.331 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.331 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.331 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:05.331 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:05.278577+0000", 2024-04-19T03:02:05.331 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3749999999999999e-05 2024-04-19T03:02:05.331 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.332 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.332 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:05.332 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:05.278591+0000", 2024-04-19T03:02:05.332 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3497e-05 2024-04-19T03:02:05.332 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.332 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.332 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:05.332 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:05.278603+0000", 2024-04-19T03:02:05.333 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2072000000000001e-05 2024-04-19T03:02:05.333 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:05.333 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:05.333 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:05.333 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.333 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.333 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:59349 5.9 5:9041c784:::benchmark_data_smithi096_19531_object59348:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-19T03:02:05.334 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:05.267676+0000", 2024-04-19T03:02:05.334 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.011983013000000001, 2024-04-19T03:02:05.334 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.012266689000000001, 2024-04-19T03:02:05.334 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:05.334 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:02:05.334 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:05.334 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:05.335 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:05.335 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 59349 2024-04-19T03:02:05.335 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.335 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:05.335 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.335 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:05.335 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:05.267676+0000", 2024-04-19T03:02:05.335 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:05.335 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.335 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.335 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:05.335 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:05.267676+0000", 2024-04-19T03:02:05.336 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:05.336 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.336 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.336 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:05.336 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:05.267674+0000", 2024-04-19T03:02:05.336 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:05.336 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.336 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.336 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:05.336 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:05.267737+0000", 2024-04-19T03:02:05.336 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2382e-05 2024-04-19T03:02:05.337 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.337 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.337 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:05.338 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:05.267754+0000", 2024-04-19T03:02:05.338 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7300999999999999e-05 2024-04-19T03:02:05.338 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.338 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.338 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:05.338 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:05.267761+0000", 2024-04-19T03:02:05.339 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5529999999999998e-06 2024-04-19T03:02:05.339 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.339 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.339 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:05.339 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:05.268313+0000", 2024-04-19T03:02:05.339 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00055186299999999998 2024-04-19T03:02:05.339 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.339 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.339 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:05.339 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:05.268445+0000", 2024-04-19T03:02:05.339 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00013246300000000001 2024-04-19T03:02:05.339 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.339 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.339 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:02:05.339 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:05.268536+0000", 2024-04-19T03:02:05.340 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.0932000000000003e-05 2024-04-19T03:02:05.340 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:05.340 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:05.340 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:05.340 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.340 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.340 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:59350 5.9 5:956248f4:::benchmark_data_smithi096_19531_object59349:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-19T03:02:05.340 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:05.268280+0000", 2024-04-19T03:02:05.340 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.011378309, 2024-04-19T03:02:05.340 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011701537, 2024-04-19T03:02:05.340 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:05.340 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:02:05.340 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:05.341 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:05.341 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:05.341 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 59350 2024-04-19T03:02:05.341 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.341 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:05.341 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.341 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:05.341 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:05.268280+0000", 2024-04-19T03:02:05.341 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:05.341 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.341 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.341 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:05.341 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:05.268280+0000", 2024-04-19T03:02:05.341 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:05.341 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.342 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.342 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:05.342 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:05.268280+0000", 2024-04-19T03:02:05.342 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:05.342 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.342 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.342 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:05.342 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:05.268312+0000", 2024-04-19T03:02:05.342 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2122000000000002e-05 2024-04-19T03:02:05.342 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.342 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.342 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:05.342 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:05.268320+0000", 2024-04-19T03:02:05.343 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0930000000000003e-06 2024-04-19T03:02:05.343 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.343 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.343 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:05.343 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:05.268326+0000", 2024-04-19T03:02:05.343 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1120000000000001e-06 2024-04-19T03:02:05.343 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.343 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.343 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:05.343 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:05.270826+0000", 2024-04-19T03:02:05.343 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.002500005 2024-04-19T03:02:05.343 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.343 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.343 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:05.344 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:05.270946+0000", 2024-04-19T03:02:05.344 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000120214 2024-04-19T03:02:05.344 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.344 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.344 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:02:05.344 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:05.271035+0000", 2024-04-19T03:02:05.344 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.8875999999999994e-05 2024-04-19T03:02:05.344 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:05.344 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:05.344 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:05.344 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.344 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.344 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:59354 5.9 5:9a1ac14b:::benchmark_data_smithi096_19531_object59353:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-19T03:02:05.344 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:05.268773+0000", 2024-04-19T03:02:05.345 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.010886124, 2024-04-19T03:02:05.345 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011246624, 2024-04-19T03:02:05.345 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:05.345 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:02:05.345 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:05.345 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:05.345 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:05.345 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 59354 2024-04-19T03:02:05.345 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.345 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:05.345 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.345 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:05.345 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:05.268773+0000", 2024-04-19T03:02:05.345 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:05.346 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.346 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.346 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:05.346 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:05.268773+0000", 2024-04-19T03:02:05.346 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:05.346 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.346 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.346 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:05.346 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:05.268772+0000", 2024-04-19T03:02:05.346 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:05.346 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.346 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.346 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:05.346 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:05.268821+0000", 2024-04-19T03:02:05.347 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9759000000000003e-05 2024-04-19T03:02:05.347 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.347 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.347 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:05.347 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:05.268835+0000", 2024-04-19T03:02:05.347 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3893000000000001e-05 2024-04-19T03:02:05.347 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.347 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.347 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:05.347 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:05.268845+0000", 2024-04-19T03:02:05.347 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.3929999999999997e-06 2024-04-19T03:02:05.347 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.347 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.347 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:05.348 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:05.273068+0000", 2024-04-19T03:02:05.348 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0042231550000000001 2024-04-19T03:02:05.348 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.348 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.348 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:05.348 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:05.273224+0000", 2024-04-19T03:02:05.348 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00015612800000000001 2024-04-19T03:02:05.348 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.348 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.348 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:02:05.348 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:05.273363+0000", 2024-04-19T03:02:05.348 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000139178 2024-04-19T03:02:05.348 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:05.348 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:05.349 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:05.349 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.349 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.349 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:59356 5.9 5:9fd2c36d:::benchmark_data_smithi096_19531_object59355:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-19T03:02:05.349 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:05.271742+0000", 2024-04-19T03:02:05.349 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0079170330000000004, 2024-04-19T03:02:05.349 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0083470929999999999, 2024-04-19T03:02:05.349 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:05.349 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:02:05.349 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:05.349 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:05.349 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:05.349 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 59356 2024-04-19T03:02:05.349 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.350 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:05.350 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.350 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:05.350 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:05.271742+0000", 2024-04-19T03:02:05.350 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:05.350 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.350 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.350 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:05.350 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:05.271742+0000", 2024-04-19T03:02:05.350 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:05.350 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.350 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.350 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:05.350 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:05.271741+0000", 2024-04-19T03:02:05.350 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:05.351 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.351 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.351 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:05.351 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:05.271802+0000", 2024-04-19T03:02:05.351 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0980999999999998e-05 2024-04-19T03:02:05.351 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.351 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.351 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:05.351 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:05.271817+0000", 2024-04-19T03:02:05.351 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.5322e-05 2024-04-19T03:02:05.351 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.351 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.351 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:05.351 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:05.271825+0000", 2024-04-19T03:02:05.352 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.5469999999999997e-06 2024-04-19T03:02:05.352 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.352 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.352 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:05.352 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:05.275687+0000", 2024-04-19T03:02:05.352 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0038614669999999999 2024-04-19T03:02:05.352 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.352 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.352 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:05.352 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:05.275815+0000", 2024-04-19T03:02:05.352 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00012786000000000001 2024-04-19T03:02:05.352 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.352 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.352 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:02:05.352 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:05.275941+0000", 2024-04-19T03:02:05.353 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000125952 2024-04-19T03:02:05.353 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:05.353 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:05.353 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:05.353 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:05.353 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-04-19T03:02:05.353 INFO:teuthology.orchestra.run.smithi144.stdout: "num_ops": 12 2024-04-19T03:02:05.353 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-04-19T03:02:05.354 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:05.352+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:05.355 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T03:02:05.455 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:05.453+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:05.479 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-04-19T03:02:05.479 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2024-04-19T03:02:05.479 INFO:teuthology.orchestra.run.smithi144.stdout: "complaint_time": 30, 2024-04-19T03:02:05.479 INFO:teuthology.orchestra.run.smithi144.stdout: "num_blocked_ops": 0 2024-04-19T03:02:05.479 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-04-19T03:02:05.490 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T03:02:05.555 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:05.553+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:05.657 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:05.653+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:05.660 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-04-19T03:02:05.660 INFO:teuthology.orchestra.run.smithi144.stdout: "size": 20, 2024-04-19T03:02:05.660 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 600, 2024-04-19T03:02:05.660 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [ 2024-04-19T03:02:05.660 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.660 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4159.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-19T03:02:05.661 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:01:08.151173+0000", 2024-04-19T03:02:05.661 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 57.506638035000002, 2024-04-19T03:02:05.661 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.023083023000000001, 2024-04-19T03:02:05.661 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:05.661 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:05.661 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:05.661 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4159", 2024-04-19T03:02:05.661 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3589238956", 2024-04-19T03:02:05.661 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 141 2024-04-19T03:02:05.661 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.661 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:05.661 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.661 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:05.661 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.151173+0000", 2024-04-19T03:02:05.662 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:05.662 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.662 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.662 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:05.662 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.151173+0000", 2024-04-19T03:02:05.662 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:05.662 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.662 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.662 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:05.662 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.151171+0000", 2024-04-19T03:02:05.662 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:05.662 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.663 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.663 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:05.663 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.151182+0000", 2024-04-19T03:02:05.663 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0730000000000001e-05 2024-04-19T03:02:05.663 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.663 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.663 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:05.663 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.151203+0000", 2024-04-19T03:02:05.663 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0387e-05 2024-04-19T03:02:05.663 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.663 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.663 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:05.664 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.151225+0000", 2024-04-19T03:02:05.664 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2643e-05 2024-04-19T03:02:05.664 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.664 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.664 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:05.664 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.169207+0000", 2024-04-19T03:02:05.664 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.017981561 2024-04-19T03:02:05.664 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.664 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.664 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:05.664 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.169386+0000", 2024-04-19T03:02:05.664 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000178758 2024-04-19T03:02:05.664 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.664 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.665 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:02:05.665 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.169546+0000", 2024-04-19T03:02:05.665 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000160781 2024-04-19T03:02:05.665 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.665 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.665 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:05.665 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.171444+0000", 2024-04-19T03:02:05.665 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0018980309999999999 2024-04-19T03:02:05.665 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.665 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.665 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:05.665 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.174165+0000", 2024-04-19T03:02:05.665 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0027204920000000001 2024-04-19T03:02:05.666 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.666 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.666 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:05.666 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.174228+0000", 2024-04-19T03:02:05.666 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2774000000000006e-05 2024-04-19T03:02:05.666 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.666 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.666 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:05.666 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.174256+0000", 2024-04-19T03:02:05.666 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.8045999999999999e-05 2024-04-19T03:02:05.666 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:05.666 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:05.666 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:05.667 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.667 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.667 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4159.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-19T03:02:05.667 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:01:08.347807+0000", 2024-04-19T03:02:05.667 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 57.310004026999998, 2024-04-19T03:02:05.667 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.021589991999999999, 2024-04-19T03:02:05.667 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:05.667 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:05.667 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:05.667 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4159", 2024-04-19T03:02:05.667 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3589238956", 2024-04-19T03:02:05.667 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 165 2024-04-19T03:02:05.667 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.667 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:05.668 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.668 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:05.668 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.347807+0000", 2024-04-19T03:02:05.668 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:05.668 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.668 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.668 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:05.668 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.347807+0000", 2024-04-19T03:02:05.668 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:05.668 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.668 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.668 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:05.668 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.347806+0000", 2024-04-19T03:02:05.669 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:05.669 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.669 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.669 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:05.669 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.347812+0000", 2024-04-19T03:02:05.669 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.066e-06 2024-04-19T03:02:05.669 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.669 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.669 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:05.669 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.347818+0000", 2024-04-19T03:02:05.669 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5550000000000002e-06 2024-04-19T03:02:05.669 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.669 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.669 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:05.669 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.347822+0000", 2024-04-19T03:02:05.670 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.561e-06 2024-04-19T03:02:05.670 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.670 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.670 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:05.670 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.365703+0000", 2024-04-19T03:02:05.670 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.017880566000000001 2024-04-19T03:02:05.670 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.670 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.670 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:05.670 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.365805+0000", 2024-04-19T03:02:05.670 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00010213900000000001 2024-04-19T03:02:05.670 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.671 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.671 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:02:05.671 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.365928+0000", 2024-04-19T03:02:05.671 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00012337900000000001 2024-04-19T03:02:05.671 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.671 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.671 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:05.671 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.367353+0000", 2024-04-19T03:02:05.671 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001424397 2024-04-19T03:02:05.671 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.671 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.671 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:05.671 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.369260+0000", 2024-04-19T03:02:05.671 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0019069130000000001 2024-04-19T03:02:05.672 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.672 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.672 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:05.672 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.369342+0000", 2024-04-19T03:02:05.672 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2423999999999996e-05 2024-04-19T03:02:05.672 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.672 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.672 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:05.672 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.369397+0000", 2024-04-19T03:02:05.672 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4481999999999998e-05 2024-04-19T03:02:05.672 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:05.672 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:05.672 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:05.672 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.673 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.673 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4159.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-19T03:02:05.673 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:01:08.539135+0000", 2024-04-19T03:02:05.673 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 57.118675768999999, 2024-04-19T03:02:05.673 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.021590602, 2024-04-19T03:02:05.673 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:05.673 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:05.673 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:05.673 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4159", 2024-04-19T03:02:05.673 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3589238956", 2024-04-19T03:02:05.673 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 188 2024-04-19T03:02:05.673 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.673 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:05.673 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.674 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:05.674 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.539135+0000", 2024-04-19T03:02:05.674 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:05.674 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.674 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.674 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:05.674 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.539135+0000", 2024-04-19T03:02:05.674 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:05.674 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.674 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.674 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:05.674 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.539134+0000", 2024-04-19T03:02:05.674 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:05.675 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.675 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.675 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:05.675 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.539228+0000", 2024-04-19T03:02:05.675 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.3771999999999996e-05 2024-04-19T03:02:05.675 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.675 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.675 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:05.675 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.539243+0000", 2024-04-19T03:02:05.675 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4707e-05 2024-04-19T03:02:05.675 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.675 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.675 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:05.675 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.539250+0000", 2024-04-19T03:02:05.676 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7190000000000001e-06 2024-04-19T03:02:05.676 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.676 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.676 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:05.676 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.553787+0000", 2024-04-19T03:02:05.676 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.014536248999999999 2024-04-19T03:02:05.676 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.676 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.676 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:05.676 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.553857+0000", 2024-04-19T03:02:05.676 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0675999999999999e-05 2024-04-19T03:02:05.676 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.676 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.676 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:02:05.677 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.553953+0000", 2024-04-19T03:02:05.677 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.5420999999999993e-05 2024-04-19T03:02:05.677 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.677 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.677 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:05.677 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.555569+0000", 2024-04-19T03:02:05.677 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001616625 2024-04-19T03:02:05.677 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.677 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.677 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:05.677 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.560644+0000", 2024-04-19T03:02:05.677 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0050749660000000002 2024-04-19T03:02:05.677 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.677 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.678 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:05.678 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.560690+0000", 2024-04-19T03:02:05.678 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6041000000000002e-05 2024-04-19T03:02:05.678 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.678 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.678 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:05.678 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.560726+0000", 2024-04-19T03:02:05.678 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5188999999999998e-05 2024-04-19T03:02:05.678 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:05.678 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:05.678 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:05.678 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.678 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.679 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4159.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-19T03:02:05.679 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:01:08.539259+0000", 2024-04-19T03:02:05.679 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 57.118551300999997, 2024-04-19T03:02:05.679 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.021552071999999999, 2024-04-19T03:02:05.679 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:05.679 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:05.679 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:05.679 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4159", 2024-04-19T03:02:05.679 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3589238956", 2024-04-19T03:02:05.679 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 189 2024-04-19T03:02:05.679 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.679 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:05.679 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.680 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:05.680 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.539259+0000", 2024-04-19T03:02:05.680 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:05.680 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.680 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.680 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:05.680 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.539259+0000", 2024-04-19T03:02:05.680 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:05.680 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.680 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.680 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:05.680 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.539259+0000", 2024-04-19T03:02:05.680 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:05.680 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.681 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.681 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:05.681 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.539268+0000", 2024-04-19T03:02:05.681 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.5359999999999998e-06 2024-04-19T03:02:05.681 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.681 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.681 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:05.681 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.539291+0000", 2024-04-19T03:02:05.681 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2687000000000001e-05 2024-04-19T03:02:05.681 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.681 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.681 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:05.681 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.539298+0000", 2024-04-19T03:02:05.681 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.883e-06 2024-04-19T03:02:05.682 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.682 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.682 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:05.682 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.554957+0000", 2024-04-19T03:02:05.682 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.015659019999999999 2024-04-19T03:02:05.682 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.682 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.682 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:05.682 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.555010+0000", 2024-04-19T03:02:05.682 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2985999999999997e-05 2024-04-19T03:02:05.682 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.682 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.682 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:02:05.682 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.555094+0000", 2024-04-19T03:02:05.683 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4530000000000006e-05 2024-04-19T03:02:05.683 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.683 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.683 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:05.683 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.556093+0000", 2024-04-19T03:02:05.683 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00099903300000000008 2024-04-19T03:02:05.683 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.683 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.683 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:05.683 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.560759+0000", 2024-04-19T03:02:05.683 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0046654369999999997 2024-04-19T03:02:05.683 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.683 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.683 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:05.684 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.560789+0000", 2024-04-19T03:02:05.684 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0638e-05 2024-04-19T03:02:05.684 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.684 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.684 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:05.684 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.560811+0000", 2024-04-19T03:02:05.684 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2167999999999998e-05 2024-04-19T03:02:05.684 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:05.684 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:05.684 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:05.684 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.684 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.684 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:8 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:02:05.684 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:01:14.998165+0000", 2024-04-19T03:02:05.685 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 50.659645619999999, 2024-04-19T03:02:05.685 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.024541001, 2024-04-19T03:02:05.685 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:05.685 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:05.685 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:05.685 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.685 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:05.685 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998165+0000", 2024-04-19T03:02:05.685 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:05.685 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.685 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.685 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:05.685 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998165+0000", 2024-04-19T03:02:05.685 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:05.686 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.686 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.686 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:05.686 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998164+0000", 2024-04-19T03:02:05.686 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:05.686 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.686 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.686 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:05.686 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998170+0000", 2024-04-19T03:02:05.686 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2939999999999996e-06 2024-04-19T03:02:05.686 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.686 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.686 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:05.687 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998179+0000", 2024-04-19T03:02:05.687 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.5540000000000003e-06 2024-04-19T03:02:05.687 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.687 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.687 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:05.687 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998188+0000", 2024-04-19T03:02:05.687 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2959999999999999e-06 2024-04-19T03:02:05.687 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.687 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.687 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:05.687 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998332+0000", 2024-04-19T03:02:05.687 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00014474 2024-04-19T03:02:05.687 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.687 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.688 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:02:05.688 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998337+0000", 2024-04-19T03:02:05.688 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6909999999999996e-06 2024-04-19T03:02:05.688 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.688 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.688 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:05.688 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.010222+0000", 2024-04-19T03:02:05.688 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011885178 2024-04-19T03:02:05.688 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.688 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.688 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:05.688 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.010342+0000", 2024-04-19T03:02:05.688 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00011991500000000001 2024-04-19T03:02:05.688 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.689 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.689 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:02:05.689 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.010506+0000", 2024-04-19T03:02:05.689 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00016429699999999999 2024-04-19T03:02:05.689 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.689 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.689 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:05.689 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.014525+0000", 2024-04-19T03:02:05.689 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0040189839999999998 2024-04-19T03:02:05.689 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.689 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.689 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:05.689 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.022600+0000", 2024-04-19T03:02:05.689 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0080741990000000007 2024-04-19T03:02:05.690 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.690 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.690 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:05.690 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.022670+0000", 2024-04-19T03:02:05.690 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0743999999999999e-05 2024-04-19T03:02:05.690 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.690 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.690 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:05.690 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.022706+0000", 2024-04-19T03:02:05.690 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5782999999999999e-05 2024-04-19T03:02:05.690 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:05.690 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:05.690 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:05.691 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.691 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.691 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:27 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:02:05.691 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:01:14.998436+0000", 2024-04-19T03:02:05.691 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 50.659374966000001, 2024-04-19T03:02:05.691 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.024406325999999999, 2024-04-19T03:02:05.691 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:05.691 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:05.691 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:05.691 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.691 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:05.691 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998436+0000", 2024-04-19T03:02:05.691 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:05.691 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.692 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.692 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:05.692 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998436+0000", 2024-04-19T03:02:05.692 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:05.692 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.692 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.692 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:05.692 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998435+0000", 2024-04-19T03:02:05.692 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:05.692 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.692 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.692 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:05.692 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998445+0000", 2024-04-19T03:02:05.692 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0349e-05 2024-04-19T03:02:05.693 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.693 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.693 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:05.693 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998453+0000", 2024-04-19T03:02:05.693 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0399999999999993e-06 2024-04-19T03:02:05.693 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.693 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.693 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:05.693 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998461+0000", 2024-04-19T03:02:05.693 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9780000000000005e-06 2024-04-19T03:02:05.693 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.693 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.693 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:05.693 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998515+0000", 2024-04-19T03:02:05.694 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3097999999999999e-05 2024-04-19T03:02:05.694 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.694 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.694 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:02:05.694 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998520+0000", 2024-04-19T03:02:05.694 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9220000000000002e-06 2024-04-19T03:02:05.694 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.694 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.694 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:05.694 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.011258+0000", 2024-04-19T03:02:05.694 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.012737735 2024-04-19T03:02:05.694 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.694 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.694 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:05.695 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.011566+0000", 2024-04-19T03:02:05.695 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00030826200000000001 2024-04-19T03:02:05.695 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.695 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.695 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:02:05.695 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.011996+0000", 2024-04-19T03:02:05.695 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00042912000000000001 2024-04-19T03:02:05.695 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.695 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.695 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:05.695 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.014533+0000", 2024-04-19T03:02:05.695 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.002537423 2024-04-19T03:02:05.695 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.695 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.696 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:05.696 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.022756+0000", 2024-04-19T03:02:05.696 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0082231530000000004 2024-04-19T03:02:05.696 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.696 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.696 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:05.696 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.022807+0000", 2024-04-19T03:02:05.696 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0852e-05 2024-04-19T03:02:05.696 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.696 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.696 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:05.696 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.022842+0000", 2024-04-19T03:02:05.696 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5058000000000002e-05 2024-04-19T03:02:05.697 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:05.697 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:05.697 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:05.697 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.697 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.697 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:28 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:02:05.697 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:01:14.998476+0000", 2024-04-19T03:02:05.697 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 50.659335044000002, 2024-04-19T03:02:05.697 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.024656784000000001, 2024-04-19T03:02:05.697 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:05.697 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:05.698 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:05.698 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.698 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:05.698 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998476+0000", 2024-04-19T03:02:05.698 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:05.698 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.698 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.698 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:05.698 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998476+0000", 2024-04-19T03:02:05.698 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:05.698 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.699 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.699 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:05.699 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998475+0000", 2024-04-19T03:02:05.699 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:05.699 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.699 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.699 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:05.699 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998484+0000", 2024-04-19T03:02:05.699 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.7770000000000008e-06 2024-04-19T03:02:05.699 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.699 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.700 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:05.700 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998495+0000", 2024-04-19T03:02:05.700 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0726e-05 2024-04-19T03:02:05.700 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.700 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.700 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:05.700 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998503+0000", 2024-04-19T03:02:05.700 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.8780000000000004e-06 2024-04-19T03:02:05.700 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.700 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.700 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:05.700 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998579+0000", 2024-04-19T03:02:05.700 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5160999999999994e-05 2024-04-19T03:02:05.701 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.701 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.701 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:02:05.701 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998586+0000", 2024-04-19T03:02:05.701 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8520000000000004e-06 2024-04-19T03:02:05.701 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.701 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.701 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:05.701 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.012423+0000", 2024-04-19T03:02:05.701 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.013836667 2024-04-19T03:02:05.701 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.701 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.701 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:05.701 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.012532+0000", 2024-04-19T03:02:05.702 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000108565 2024-04-19T03:02:05.702 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.702 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.702 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:02:05.702 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.012655+0000", 2024-04-19T03:02:05.702 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00012344600000000001 2024-04-19T03:02:05.702 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.702 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.702 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:05.702 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.015680+0000", 2024-04-19T03:02:05.702 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0030246470000000001 2024-04-19T03:02:05.702 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.702 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.702 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:05.703 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.023091+0000", 2024-04-19T03:02:05.703 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0074116030000000001 2024-04-19T03:02:05.703 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.703 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.703 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:05.703 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.023115+0000", 2024-04-19T03:02:05.703 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.3091999999999998e-05 2024-04-19T03:02:05.703 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.703 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.703 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:05.703 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.023132+0000", 2024-04-19T03:02:05.703 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7901999999999999e-05 2024-04-19T03:02:05.703 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:05.704 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:05.704 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:05.704 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.704 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.704 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:29 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:02:05.704 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:01:14.998527+0000", 2024-04-19T03:02:05.704 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 50.659283504000001, 2024-04-19T03:02:05.704 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.024738599999999999, 2024-04-19T03:02:05.704 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:05.704 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:05.704 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:05.704 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.704 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:05.704 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998527+0000", 2024-04-19T03:02:05.705 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:05.705 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.705 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.705 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:05.705 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998527+0000", 2024-04-19T03:02:05.705 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:05.705 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.705 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.705 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:05.705 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998527+0000", 2024-04-19T03:02:05.705 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:05.705 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.705 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.705 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:05.706 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998531+0000", 2024-04-19T03:02:05.706 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9450000000000001e-06 2024-04-19T03:02:05.706 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.706 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.706 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:05.706 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998541+0000", 2024-04-19T03:02:05.706 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.4320000000000005e-06 2024-04-19T03:02:05.706 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.706 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.706 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:05.706 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998548+0000", 2024-04-19T03:02:05.706 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.221e-06 2024-04-19T03:02:05.706 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.706 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.707 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:05.707 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998620+0000", 2024-04-19T03:02:05.707 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.1676999999999998e-05 2024-04-19T03:02:05.707 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.707 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.707 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:02:05.707 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998624+0000", 2024-04-19T03:02:05.707 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4850000000000003e-06 2024-04-19T03:02:05.707 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.707 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.707 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:05.707 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.013261+0000", 2024-04-19T03:02:05.707 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.014636451999999999 2024-04-19T03:02:05.707 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.708 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.708 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:05.708 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.013364+0000", 2024-04-19T03:02:05.708 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000102885 2024-04-19T03:02:05.708 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.708 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.708 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:02:05.708 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.013481+0000", 2024-04-19T03:02:05.708 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00011783299999999999 2024-04-19T03:02:05.708 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.708 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.708 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:05.708 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.016265+0000", 2024-04-19T03:02:05.708 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0027834539999999999 2024-04-19T03:02:05.709 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.709 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.709 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:05.709 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.023180+0000", 2024-04-19T03:02:05.709 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0069149399999999996 2024-04-19T03:02:05.709 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.709 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.709 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:05.709 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.023230+0000", 2024-04-19T03:02:05.709 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0220999999999999e-05 2024-04-19T03:02:05.709 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.709 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.709 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:05.709 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.023266+0000", 2024-04-19T03:02:05.710 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5703e-05 2024-04-19T03:02:05.710 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:05.710 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:05.710 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:05.710 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.710 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.710 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:30 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:02:05.710 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:01:14.998577+0000", 2024-04-19T03:02:05.710 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 50.659233397000001, 2024-04-19T03:02:05.710 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.024774022999999999, 2024-04-19T03:02:05.710 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:05.710 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:05.710 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:05.711 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.711 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:05.711 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998577+0000", 2024-04-19T03:02:05.711 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:05.711 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.711 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.711 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:05.711 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998577+0000", 2024-04-19T03:02:05.711 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:05.711 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.711 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.711 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:05.711 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998576+0000", 2024-04-19T03:02:05.711 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:05.712 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.712 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.712 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:05.712 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998583+0000", 2024-04-19T03:02:05.712 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8850000000000001e-06 2024-04-19T03:02:05.712 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.712 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.712 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:05.712 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998597+0000", 2024-04-19T03:02:05.712 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.362e-05 2024-04-19T03:02:05.712 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.712 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.712 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:05.712 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998607+0000", 2024-04-19T03:02:05.712 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0389e-05 2024-04-19T03:02:05.713 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.713 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.713 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:05.713 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998713+0000", 2024-04-19T03:02:05.713 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000105338 2024-04-19T03:02:05.713 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.714 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.714 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:02:05.714 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998720+0000", 2024-04-19T03:02:05.714 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2370000000000003e-06 2024-04-19T03:02:05.714 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.714 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.714 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:05.714 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.014014+0000", 2024-04-19T03:02:05.714 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.015294116999999999 2024-04-19T03:02:05.714 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.714 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.714 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:05.714 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.014091+0000", 2024-04-19T03:02:05.714 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7148000000000001e-05 2024-04-19T03:02:05.715 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.715 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.715 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:02:05.715 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.014271+0000", 2024-04-19T03:02:05.715 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00017962699999999999 2024-04-19T03:02:05.715 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.715 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.715 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:05.715 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.018024+0000", 2024-04-19T03:02:05.715 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0037529809999999999 2024-04-19T03:02:05.715 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.715 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.715 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:05.715 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.023303+0000", 2024-04-19T03:02:05.716 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0052793099999999997 2024-04-19T03:02:05.716 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.716 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.716 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:05.716 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.023331+0000", 2024-04-19T03:02:05.716 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.8013000000000001e-05 2024-04-19T03:02:05.716 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.716 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.716 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:05.716 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.023351+0000", 2024-04-19T03:02:05.716 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0225999999999999e-05 2024-04-19T03:02:05.716 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:05.716 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:05.716 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:05.717 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.717 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.717 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:33 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:02:05.717 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:01:14.998625+0000", 2024-04-19T03:02:05.717 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 50.659185999999998, 2024-04-19T03:02:05.717 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.024007338999999999, 2024-04-19T03:02:05.717 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:05.717 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:05.717 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:05.717 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.717 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:05.717 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998625+0000", 2024-04-19T03:02:05.717 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:05.717 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.718 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.718 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:05.718 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998625+0000", 2024-04-19T03:02:05.718 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:05.718 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.718 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.718 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:05.718 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998623+0000", 2024-04-19T03:02:05.718 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:05.718 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.718 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.718 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:05.718 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998632+0000", 2024-04-19T03:02:05.719 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9279999999999999e-06 2024-04-19T03:02:05.719 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.719 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.719 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:05.719 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998642+0000", 2024-04-19T03:02:05.719 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0063e-05 2024-04-19T03:02:05.719 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.719 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.719 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:05.719 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998649+0000", 2024-04-19T03:02:05.719 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4799999999999998e-06 2024-04-19T03:02:05.719 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.719 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.720 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:05.720 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998730+0000", 2024-04-19T03:02:05.720 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.1514999999999995e-05 2024-04-19T03:02:05.720 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.720 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.720 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:02:05.720 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998741+0000", 2024-04-19T03:02:05.720 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1029999999999999e-05 2024-04-19T03:02:05.720 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.720 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.720 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:05.720 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.010202+0000", 2024-04-19T03:02:05.720 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011460529000000001 2024-04-19T03:02:05.720 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.721 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.721 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:05.721 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.010292+0000", 2024-04-19T03:02:05.721 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.0382000000000003e-05 2024-04-19T03:02:05.721 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.721 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.721 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:02:05.721 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.010391+0000", 2024-04-19T03:02:05.721 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.8491000000000003e-05 2024-04-19T03:02:05.721 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.721 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.721 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:05.721 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.013800+0000", 2024-04-19T03:02:05.721 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0034090219999999998 2024-04-19T03:02:05.722 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.722 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.722 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:05.722 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.022564+0000", 2024-04-19T03:02:05.722 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0087639950000000001 2024-04-19T03:02:05.722 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.722 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.722 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:05.722 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.022601+0000", 2024-04-19T03:02:05.722 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7363999999999997e-05 2024-04-19T03:02:05.722 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.722 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.722 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:05.723 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.022632+0000", 2024-04-19T03:02:05.723 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0917000000000002e-05 2024-04-19T03:02:05.723 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:05.723 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:05.723 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:05.723 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.723 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.723 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:37 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:02:05.723 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:01:14.998739+0000", 2024-04-19T03:02:05.723 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 50.659072059000003, 2024-04-19T03:02:05.723 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.020573188999999999, 2024-04-19T03:02:05.723 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:05.723 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:05.723 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:05.724 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.724 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:05.724 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998739+0000", 2024-04-19T03:02:05.724 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:05.724 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.724 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.724 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:05.724 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998739+0000", 2024-04-19T03:02:05.724 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:05.724 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.724 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.724 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:05.724 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998738+0000", 2024-04-19T03:02:05.724 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:05.725 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.725 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.725 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:05.725 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998755+0000", 2024-04-19T03:02:05.725 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7105999999999999e-05 2024-04-19T03:02:05.725 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.725 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.725 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:05.725 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998764+0000", 2024-04-19T03:02:05.725 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.1279999999999997e-06 2024-04-19T03:02:05.725 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.725 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.725 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:05.725 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998771+0000", 2024-04-19T03:02:05.726 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6939999999999998e-06 2024-04-19T03:02:05.726 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.726 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.726 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:05.726 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998843+0000", 2024-04-19T03:02:05.726 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.1695999999999999e-05 2024-04-19T03:02:05.726 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.726 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.726 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op must wait for map", 2024-04-19T03:02:05.726 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998852+0000", 2024-04-19T03:02:05.726 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.0799999999999995e-06 2024-04-19T03:02:05.726 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.726 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.726 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:05.727 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.006513+0000", 2024-04-19T03:02:05.727 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0076610020000000001 2024-04-19T03:02:05.727 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.727 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.727 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:05.727 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.006670+0000", 2024-04-19T03:02:05.727 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000157529 2024-04-19T03:02:05.727 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.727 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.727 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:05.727 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.006863+0000", 2024-04-19T03:02:05.727 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000192597 2024-04-19T03:02:05.727 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.727 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.727 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:05.728 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.012404+0000", 2024-04-19T03:02:05.728 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0055415220000000001 2024-04-19T03:02:05.728 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.728 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.728 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:05.728 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.019171+0000", 2024-04-19T03:02:05.728 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0067666829999999999 2024-04-19T03:02:05.728 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.728 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.728 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:05.728 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.019228+0000", 2024-04-19T03:02:05.728 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7145999999999998e-05 2024-04-19T03:02:05.728 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.728 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.728 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:05.729 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.019312+0000", 2024-04-19T03:02:05.729 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.3591999999999995e-05 2024-04-19T03:02:05.729 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:05.729 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:05.729 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:05.729 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.729 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.729 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:02:05.729 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:01:14.998792+0000", 2024-04-19T03:02:05.729 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 50.659019131000001, 2024-04-19T03:02:05.729 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.023951813999999998, 2024-04-19T03:02:05.729 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:05.729 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:05.729 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:05.730 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.730 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:05.730 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998792+0000", 2024-04-19T03:02:05.730 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:05.730 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.730 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.730 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:05.730 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998792+0000", 2024-04-19T03:02:05.730 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:05.730 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.730 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.730 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:05.730 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998791+0000", 2024-04-19T03:02:05.731 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:05.731 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.731 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.731 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:05.731 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998796+0000", 2024-04-19T03:02:05.731 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9649999999999999e-06 2024-04-19T03:02:05.731 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.731 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.731 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:05.731 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998809+0000", 2024-04-19T03:02:05.731 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3254e-05 2024-04-19T03:02:05.731 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.731 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.731 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:05.731 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998816+0000", 2024-04-19T03:02:05.732 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.472e-06 2024-04-19T03:02:05.732 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.732 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.732 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:05.732 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998899+0000", 2024-04-19T03:02:05.732 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.3676000000000003e-05 2024-04-19T03:02:05.732 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.732 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.732 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:02:05.732 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998908+0000", 2024-04-19T03:02:05.732 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6940000000000001e-06 2024-04-19T03:02:05.732 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.732 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.732 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:05.733 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.010818+0000", 2024-04-19T03:02:05.733 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011910482999999999 2024-04-19T03:02:05.733 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.733 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.733 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:05.733 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.010959+0000", 2024-04-19T03:02:05.733 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00014018900000000001 2024-04-19T03:02:05.733 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.733 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.733 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:02:05.733 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.011185+0000", 2024-04-19T03:02:05.733 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000226085 2024-04-19T03:02:05.733 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.733 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.734 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:05.734 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.014479+0000", 2024-04-19T03:02:05.734 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0032938260000000001 2024-04-19T03:02:05.734 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.734 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.734 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:05.734 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.022697+0000", 2024-04-19T03:02:05.734 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0082186029999999997 2024-04-19T03:02:05.734 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.734 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.734 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:05.734 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.022724+0000", 2024-04-19T03:02:05.734 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.6503999999999999e-05 2024-04-19T03:02:05.734 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.735 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.735 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:05.735 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.022743+0000", 2024-04-19T03:02:05.735 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9663000000000001e-05 2024-04-19T03:02:05.735 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:05.735 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:05.735 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:05.735 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.735 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.735 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:02:05.735 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:01:14.998870+0000", 2024-04-19T03:02:05.735 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 50.65894093, 2024-04-19T03:02:05.735 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.024280578000000001, 2024-04-19T03:02:05.735 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:05.736 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:05.736 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:05.736 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.736 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:05.736 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998870+0000", 2024-04-19T03:02:05.736 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:05.736 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.736 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.736 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:05.736 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998870+0000", 2024-04-19T03:02:05.736 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:05.736 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.736 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.736 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:05.737 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998869+0000", 2024-04-19T03:02:05.737 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:05.737 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.737 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.737 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:05.737 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998879+0000", 2024-04-19T03:02:05.737 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.8689999999999999e-06 2024-04-19T03:02:05.737 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.737 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.737 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:05.737 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998893+0000", 2024-04-19T03:02:05.737 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4436999999999999e-05 2024-04-19T03:02:05.737 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.737 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.738 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:05.738 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998904+0000", 2024-04-19T03:02:05.738 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0657e-05 2024-04-19T03:02:05.738 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.738 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.738 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:05.738 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998972+0000", 2024-04-19T03:02:05.738 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8121999999999996e-05 2024-04-19T03:02:05.738 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.738 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.738 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:02:05.738 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998980+0000", 2024-04-19T03:02:05.738 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7170000000000008e-06 2024-04-19T03:02:05.739 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.739 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.739 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:05.739 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.011666+0000", 2024-04-19T03:02:05.739 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.012686507 2024-04-19T03:02:05.739 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.739 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.739 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:05.739 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.012403+0000", 2024-04-19T03:02:05.739 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00073661899999999999 2024-04-19T03:02:05.739 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.739 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.739 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:02:05.739 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.012788+0000", 2024-04-19T03:02:05.739 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00038495800000000002 2024-04-19T03:02:05.740 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.740 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.740 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:05.740 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.015713+0000", 2024-04-19T03:02:05.740 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0029255879999999998 2024-04-19T03:02:05.740 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.740 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.740 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:05.740 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.023066+0000", 2024-04-19T03:02:05.740 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.007352903 2024-04-19T03:02:05.740 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.740 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.740 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:05.740 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.023113+0000", 2024-04-19T03:02:05.741 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7163000000000002e-05 2024-04-19T03:02:05.741 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.741 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.741 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:05.741 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.023150+0000", 2024-04-19T03:02:05.741 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6881000000000001e-05 2024-04-19T03:02:05.741 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:05.741 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:05.741 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:05.741 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.741 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.741 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:20 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:02:05.741 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:01:14.999024+0000", 2024-04-19T03:02:05.741 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 50.658786657999997, 2024-04-19T03:02:05.741 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.024212818000000001, 2024-04-19T03:02:05.742 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:05.742 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-04-19T03:02:05.742 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:05.742 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.742 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:05.742 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.999024+0000", 2024-04-19T03:02:05.742 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:05.742 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.742 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.742 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:05.742 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.999024+0000", 2024-04-19T03:02:05.742 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:05.742 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.743 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.743 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:05.743 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.999023+0000", 2024-04-19T03:02:05.743 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:05.743 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.743 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.743 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:05.743 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.999029+0000", 2024-04-19T03:02:05.743 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2709999999999998e-06 2024-04-19T03:02:05.743 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.743 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.743 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:05.743 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.999045+0000", 2024-04-19T03:02:05.743 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.5840000000000001e-05 2024-04-19T03:02:05.744 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.744 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.744 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:05.744 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.999057+0000", 2024-04-19T03:02:05.744 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1897e-05 2024-04-19T03:02:05.744 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.744 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.744 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:05.744 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.999136+0000", 2024-04-19T03:02:05.744 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8842000000000002e-05 2024-04-19T03:02:05.744 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.744 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.744 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:02:05.744 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.999144+0000", 2024-04-19T03:02:05.745 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.3110000000000006e-06 2024-04-19T03:02:05.745 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.745 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.745 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:05.745 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.013338+0000", 2024-04-19T03:02:05.745 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.014194217 2024-04-19T03:02:05.745 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.745 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.745 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:05.745 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.013485+0000", 2024-04-19T03:02:05.745 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000146787 2024-04-19T03:02:05.745 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.745 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.745 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:05.746 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.023237+0000", 2024-04-19T03:02:05.746 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0097517899999999998 2024-04-19T03:02:05.746 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:05.746 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:05.746 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:05.746 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.746 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.746 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:11289 5.7 5:e1ea82b1:::benchmark_data_smithi096_19531_object11288:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T03:02:05.746 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:01:42.068678+0000", 2024-04-19T03:02:05.746 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 23.589132438, 2024-04-19T03:02:05.746 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.022027980999999999, 2024-04-19T03:02:05.746 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:05.746 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:05.747 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:05.747 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:05.747 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:05.747 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 11289 2024-04-19T03:02:05.747 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.747 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:05.747 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.747 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:05.747 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:42.068678+0000", 2024-04-19T03:02:05.747 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:05.747 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.747 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.747 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:05.748 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:42.068678+0000", 2024-04-19T03:02:05.748 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:05.748 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.748 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.748 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:05.748 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:42.068677+0000", 2024-04-19T03:02:05.748 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:05.748 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.748 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.748 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:05.748 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:42.068721+0000", 2024-04-19T03:02:05.748 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3714000000000002e-05 2024-04-19T03:02:05.748 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.748 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.749 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:05.749 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:42.068728+0000", 2024-04-19T03:02:05.749 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0029999999999997e-06 2024-04-19T03:02:05.749 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.749 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.749 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:05.749 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:42.068733+0000", 2024-04-19T03:02:05.749 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0100000000000003e-06 2024-04-19T03:02:05.749 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.749 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.749 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:05.749 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:42.068820+0000", 2024-04-19T03:02:05.749 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.653e-05 2024-04-19T03:02:05.749 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.750 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.750 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:05.750 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:42.068990+0000", 2024-04-19T03:02:05.750 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00017046800000000001 2024-04-19T03:02:05.750 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.750 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.750 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:05.750 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:42.069140+0000", 2024-04-19T03:02:05.750 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00015001000000000001 2024-04-19T03:02:05.750 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.750 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.750 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:05.750 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:42.074573+0000", 2024-04-19T03:02:05.751 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0054326979999999997 2024-04-19T03:02:05.751 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.751 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.751 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:05.751 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:42.090534+0000", 2024-04-19T03:02:05.751 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.015961300000000001 2024-04-19T03:02:05.751 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.751 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.751 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:05.751 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:42.090619+0000", 2024-04-19T03:02:05.751 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4536999999999994e-05 2024-04-19T03:02:05.751 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.751 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.751 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:05.752 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:42.090706+0000", 2024-04-19T03:02:05.752 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.7643000000000001e-05 2024-04-19T03:02:05.752 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:05.752 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:05.752 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:05.752 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.752 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.752 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:50122 5.9 5:9d1c74f3:::benchmark_data_smithi096_19531_object50121:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-19T03:02:05.752 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:00.084949+0000", 2024-04-19T03:02:05.752 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 5.5728620199999996, 2024-04-19T03:02:05.752 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.023564486999999999, 2024-04-19T03:02:05.752 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:05.752 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:05.753 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:05.753 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:05.753 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:05.753 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 50122 2024-04-19T03:02:05.753 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.753 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:05.753 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.753 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:05.753 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:00.084949+0000", 2024-04-19T03:02:05.753 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:05.753 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.753 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.753 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:05.753 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:00.084949+0000", 2024-04-19T03:02:05.753 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:05.754 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.754 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.754 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:05.754 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:00.084948+0000", 2024-04-19T03:02:05.754 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:05.754 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.754 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.754 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:05.754 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:00.084983+0000", 2024-04-19T03:02:05.754 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4322000000000001e-05 2024-04-19T03:02:05.754 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.754 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.754 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:05.755 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:00.084992+0000", 2024-04-19T03:02:05.755 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.0180000000000007e-06 2024-04-19T03:02:05.755 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.755 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.755 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:05.755 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:00.085000+0000", 2024-04-19T03:02:05.755 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.7609999999999996e-06 2024-04-19T03:02:05.755 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.755 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.755 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:05.755 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:00.093379+0000", 2024-04-19T03:02:05.755 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0083790819999999995 2024-04-19T03:02:05.755 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.755 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.756 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:05.756 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:00.093555+0000", 2024-04-19T03:02:05.756 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00017582900000000001 2024-04-19T03:02:05.756 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.756 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.756 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:02:05.756 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:00.093735+0000", 2024-04-19T03:02:05.756 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00018006399999999999 2024-04-19T03:02:05.756 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.756 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.756 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:05.756 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:00.104665+0000", 2024-04-19T03:02:05.756 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.010929259 2024-04-19T03:02:05.756 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.756 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.757 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:05.757 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:00.108415+0000", 2024-04-19T03:02:05.757 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0037506610000000002 2024-04-19T03:02:05.757 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.757 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.757 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:05.757 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:00.108474+0000", 2024-04-19T03:02:05.757 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8551000000000002e-05 2024-04-19T03:02:05.757 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.757 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.757 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:05.757 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:00.108513+0000", 2024-04-19T03:02:05.757 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9307000000000002e-05 2024-04-19T03:02:05.757 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:05.758 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:05.758 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:05.758 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.758 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.758 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:50123 5.9 5:98d55939:::benchmark_data_smithi096_19531_object50122:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-19T03:02:05.758 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:00.087166+0000", 2024-04-19T03:02:05.758 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 5.5706445740000001, 2024-04-19T03:02:05.758 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.021482022999999999, 2024-04-19T03:02:05.758 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:05.758 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:05.758 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:05.758 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:05.758 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:05.758 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 50123 2024-04-19T03:02:05.759 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.759 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:05.759 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.759 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:05.759 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:00.087166+0000", 2024-04-19T03:02:05.759 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:05.759 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.759 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.759 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:05.759 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:00.087166+0000", 2024-04-19T03:02:05.759 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:05.759 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.759 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.759 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:05.760 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:00.087165+0000", 2024-04-19T03:02:05.760 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:05.760 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.760 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.760 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:05.760 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:00.087253+0000", 2024-04-19T03:02:05.760 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.8466000000000003e-05 2024-04-19T03:02:05.760 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.760 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.760 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:05.760 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:00.087271+0000", 2024-04-19T03:02:05.760 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8063999999999998e-05 2024-04-19T03:02:05.760 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.760 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.761 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:05.761 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:00.087280+0000", 2024-04-19T03:02:05.761 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.3930000000000008e-06 2024-04-19T03:02:05.761 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.761 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.761 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:05.761 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:00.096771+0000", 2024-04-19T03:02:05.761 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0094913329999999994 2024-04-19T03:02:05.761 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.761 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.761 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:05.761 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:00.096934+0000", 2024-04-19T03:02:05.761 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00016332900000000001 2024-04-19T03:02:05.761 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.761 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.762 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:02:05.762 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:00.097058+0000", 2024-04-19T03:02:05.762 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000123798 2024-04-19T03:02:05.762 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.762 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.762 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:05.762 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:00.104674+0000", 2024-04-19T03:02:05.762 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0076159900000000004 2024-04-19T03:02:05.762 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.762 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.762 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:05.762 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:00.108563+0000", 2024-04-19T03:02:05.762 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0038890029999999998 2024-04-19T03:02:05.763 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.763 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.763 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:05.763 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:00.108603+0000", 2024-04-19T03:02:05.763 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9610000000000002e-05 2024-04-19T03:02:05.763 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.763 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.763 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:05.763 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:00.108648+0000", 2024-04-19T03:02:05.763 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5361999999999997e-05 2024-04-19T03:02:05.763 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:05.763 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:05.763 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:05.763 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.763 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.764 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:50128 5.9 5:9467072a:::benchmark_data_smithi096_19531_object50127:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-19T03:02:05.764 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:00.087808+0000", 2024-04-19T03:02:05.764 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 5.5700028420000001, 2024-04-19T03:02:05.764 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.020989109999999998, 2024-04-19T03:02:05.764 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:05.764 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:05.764 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:05.764 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:05.764 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:05.764 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 50128 2024-04-19T03:02:05.764 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.764 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:05.764 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.764 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:05.765 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:00.087808+0000", 2024-04-19T03:02:05.765 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:05.765 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.765 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.765 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:05.765 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:00.087808+0000", 2024-04-19T03:02:05.765 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:05.765 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.765 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.765 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:05.765 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:00.087807+0000", 2024-04-19T03:02:05.765 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:05.765 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.765 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.766 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:05.766 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:00.087898+0000", 2024-04-19T03:02:05.766 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.0927000000000005e-05 2024-04-19T03:02:05.766 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.766 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.766 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:05.766 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:00.087911+0000", 2024-04-19T03:02:05.766 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3380000000000001e-05 2024-04-19T03:02:05.766 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.766 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.766 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:05.766 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:00.087917+0000", 2024-04-19T03:02:05.766 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2190000000000001e-06 2024-04-19T03:02:05.766 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.767 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.767 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:05.767 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:00.098878+0000", 2024-04-19T03:02:05.767 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.010960642 2024-04-19T03:02:05.767 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.767 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.767 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:05.767 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:00.099020+0000", 2024-04-19T03:02:05.767 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000142037 2024-04-19T03:02:05.767 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.767 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.767 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:02:05.767 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:00.099118+0000", 2024-04-19T03:02:05.768 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.8066999999999995e-05 2024-04-19T03:02:05.768 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.768 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.768 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:05.768 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:00.104682+0000", 2024-04-19T03:02:05.768 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0055638889999999998 2024-04-19T03:02:05.768 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.768 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.768 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:05.768 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:00.108707+0000", 2024-04-19T03:02:05.768 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0040252359999999997 2024-04-19T03:02:05.768 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.768 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.768 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:05.768 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:00.108763+0000", 2024-04-19T03:02:05.769 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5822999999999997e-05 2024-04-19T03:02:05.769 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.769 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.769 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:05.769 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:00.108797+0000", 2024-04-19T03:02:05.769 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3754999999999998e-05 2024-04-19T03:02:05.769 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:05.769 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:05.769 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:05.769 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.769 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.769 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:58102 5.2 5:40e43b15:::benchmark_data_smithi096_19531_object58101:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-19T03:02:05.769 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:04.555384+0000", 2024-04-19T03:02:05.769 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 1.1024270650000001, 2024-04-19T03:02:05.770 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.020981283, 2024-04-19T03:02:05.770 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:05.770 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:05.770 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:05.770 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:05.770 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:05.770 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 58102 2024-04-19T03:02:05.770 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.770 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:05.770 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.770 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:05.770 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:04.555384+0000", 2024-04-19T03:02:05.770 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:05.771 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.771 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.771 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:05.771 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:04.555384+0000", 2024-04-19T03:02:05.771 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:05.771 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.771 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.771 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:05.771 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:04.555383+0000", 2024-04-19T03:02:05.771 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:05.771 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.771 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.771 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:05.771 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:04.555446+0000", 2024-04-19T03:02:05.772 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2780999999999994e-05 2024-04-19T03:02:05.772 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.772 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.772 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:05.772 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:04.555453+0000", 2024-04-19T03:02:05.772 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2400000000000001e-06 2024-04-19T03:02:05.772 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.772 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.772 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:05.772 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:04.555458+0000", 2024-04-19T03:02:05.772 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6920000000000001e-06 2024-04-19T03:02:05.772 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.772 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.772 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:05.773 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:04.559300+0000", 2024-04-19T03:02:05.773 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0038421029999999999 2024-04-19T03:02:05.773 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.773 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.773 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:05.773 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:04.559384+0000", 2024-04-19T03:02:05.773 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4201000000000002e-05 2024-04-19T03:02:05.773 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.773 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.773 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:05.773 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:04.559469+0000", 2024-04-19T03:02:05.773 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.5377000000000006e-05 2024-04-19T03:02:05.773 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.773 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.774 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:05.774 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:04.561214+0000", 2024-04-19T03:02:05.774 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00174496 2024-04-19T03:02:05.774 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.774 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.774 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:05.774 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:04.576300+0000", 2024-04-19T03:02:05.774 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.015085741 2024-04-19T03:02:05.774 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.774 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.774 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:05.774 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:04.576337+0000", 2024-04-19T03:02:05.774 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7231999999999999e-05 2024-04-19T03:02:05.775 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.775 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.775 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:05.775 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:04.576365+0000", 2024-04-19T03:02:05.775 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7611999999999999e-05 2024-04-19T03:02:05.775 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:05.775 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:05.775 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:05.775 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.775 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.775 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:58199 5.1 5:8d6d5536:::benchmark_data_smithi096_19531_object58198:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-19T03:02:05.775 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:04.610309+0000", 2024-04-19T03:02:05.775 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 1.047501756, 2024-04-19T03:02:05.776 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.021489214999999999, 2024-04-19T03:02:05.776 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:05.776 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:05.776 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:05.776 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:05.776 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:05.776 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 58199 2024-04-19T03:02:05.776 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.776 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:05.776 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.776 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:05.776 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:04.610309+0000", 2024-04-19T03:02:05.776 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:05.776 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.776 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.777 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:05.777 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:04.610309+0000", 2024-04-19T03:02:05.777 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:05.777 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.777 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.777 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:05.777 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:04.610309+0000", 2024-04-19T03:02:05.777 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:05.777 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.777 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.777 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:05.777 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:04.610338+0000", 2024-04-19T03:02:05.777 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9564e-05 2024-04-19T03:02:05.778 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.778 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.778 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:05.778 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:04.610344+0000", 2024-04-19T03:02:05.778 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4920000000000001e-06 2024-04-19T03:02:05.778 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.778 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.778 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:05.778 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:04.610348+0000", 2024-04-19T03:02:05.778 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5360000000000003e-06 2024-04-19T03:02:05.778 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.778 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.778 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:05.779 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:04.621218+0000", 2024-04-19T03:02:05.779 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.010869431000000001 2024-04-19T03:02:05.779 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.779 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.779 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:05.779 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:04.621404+0000", 2024-04-19T03:02:05.779 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00018601800000000001 2024-04-19T03:02:05.779 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.779 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.779 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:05.779 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:04.621566+0000", 2024-04-19T03:02:05.779 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00016204199999999999 2024-04-19T03:02:05.779 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.779 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.780 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:05.780 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:04.625888+0000", 2024-04-19T03:02:05.780 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0043228820000000001 2024-04-19T03:02:05.780 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.780 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.780 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:05.780 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:04.631720+0000", 2024-04-19T03:02:05.780 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0058311049999999996 2024-04-19T03:02:05.780 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.780 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.780 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:05.780 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:04.631772+0000", 2024-04-19T03:02:05.780 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2064999999999997e-05 2024-04-19T03:02:05.780 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:05.781 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:05.781 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:05.781 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:04.631798+0000", 2024-04-19T03:02:05.781 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.6480999999999999e-05 2024-04-19T03:02:05.781 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:05.781 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:05.781 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:05.781 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:05.781 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:05.781 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-04-19T03:02:05.783 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:05.781+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:05.783 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T03:02:05.822 INFO:tasks.radosbench.radosbench.0.smithi096.stdout: 28 16 60314 60298 134.579 109.375 0.00510955 0.00742359 2024-04-19T03:02:05.883 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:05.881+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:05.915 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-04-19T03:02:05.915 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [ 2024-04-19T03:02:05.916 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:05.916 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4755.0:60451 5.e e35/22 5:7b3344b3:::benchmark_data_smithi096_19531_object60450:head v 35'3861, mlcod=35'3859)", 2024-04-19T03:02:05.916 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:02:05.907300+0000", 2024-04-19T03:02:05.916 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 0.0064845800000000002, 2024-04-19T03:02:05.916 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.006509211, 2024-04-19T03:02:05.916 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:02:05.916 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "started", 2024-04-19T03:02:05.916 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:02:05.916 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:05.916 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:02:05.916 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:05.907300+0000", 2024-04-19T03:02:05.916 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:05.916 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:05.917 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:05.917 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:02:05.917 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:05.907300+0000", 2024-04-19T03:02:05.917 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:05.917 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:05.917 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:05.917 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:02:05.917 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:05.907299+0000", 2024-04-19T03:02:05.917 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2024-04-19T03:02:05.917 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:05.917 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:05.917 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:02:05.917 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:05.907339+0000", 2024-04-19T03:02:05.917 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.9508000000000002e-05 2024-04-19T03:02:05.918 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:05.918 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:05.918 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:02:05.918 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:05.907352+0000", 2024-04-19T03:02:05.918 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.3132999999999999e-05 2024-04-19T03:02:05.918 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:05.918 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:05.918 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:02:05.918 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:05.907358+0000", 2024-04-19T03:02:05.918 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.0689999999999998e-06 2024-04-19T03:02:05.918 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:05.918 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:05.918 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:05.919 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:05.907407+0000", 2024-04-19T03:02:05.919 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.8301999999999999e-05 2024-04-19T03:02:05.919 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:05.919 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:05.919 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:02:05.919 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:05.907435+0000", 2024-04-19T03:02:05.919 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.8021000000000002e-05 2024-04-19T03:02:05.919 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:05.919 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:02:05.919 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:05.919 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:05.919 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:05.919 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4755.0:60453 5.2 e35/22 5:457bdf63:::benchmark_data_smithi096_19531_object60452:head v 35'3778, mlcod=35'3776)", 2024-04-19T03:02:05.919 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:02:05.908014+0000", 2024-04-19T03:02:05.920 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 0.0057710859999999999, 2024-04-19T03:02:05.920 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0058754819999999996, 2024-04-19T03:02:05.920 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:02:05.920 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "started", 2024-04-19T03:02:05.920 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:02:05.920 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:05.920 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:02:05.920 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:05.908014+0000", 2024-04-19T03:02:05.920 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:05.920 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:05.920 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:05.920 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:02:05.920 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:05.908014+0000", 2024-04-19T03:02:05.920 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:05.921 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:05.921 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:05.921 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:02:05.921 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:05.908013+0000", 2024-04-19T03:02:05.921 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:05.921 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:05.921 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:05.921 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:02:05.921 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:05.908063+0000", 2024-04-19T03:02:05.921 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.9431000000000002e-05 2024-04-19T03:02:05.921 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:05.921 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:05.921 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:02:05.921 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:05.908089+0000", 2024-04-19T03:02:05.922 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.6290000000000001e-05 2024-04-19T03:02:05.922 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:05.922 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:05.922 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:02:05.922 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:05.908095+0000", 2024-04-19T03:02:05.922 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.3049999999999998e-06 2024-04-19T03:02:05.922 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:05.922 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:05.922 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:05.922 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:05.908138+0000", 2024-04-19T03:02:05.922 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.2490000000000001e-05 2024-04-19T03:02:05.922 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:05.922 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:05.923 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:02:05.923 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:05.908155+0000", 2024-04-19T03:02:05.923 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.7399000000000001e-05 2024-04-19T03:02:05.923 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:05.923 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:02:05.923 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:05.923 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:05.923 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:05.923 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4755.0:60457 5.3 5:c85a35a7:::benchmark_data_smithi096_19531_object60456:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-19T03:02:05.923 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:02:05.909022+0000", 2024-04-19T03:02:05.923 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 0.0047631230000000002, 2024-04-19T03:02:05.923 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0049431930000000002, 2024-04-19T03:02:05.923 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:02:05.924 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:02:05.924 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-04-19T03:02:05.924 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4755", 2024-04-19T03:02:05.924 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:05.924 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 60457 2024-04-19T03:02:05.924 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:05.924 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:02:05.924 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:05.924 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:02:05.924 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:05.909022+0000", 2024-04-19T03:02:05.924 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:05.924 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:05.925 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:05.925 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:02:05.925 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:05.909022+0000", 2024-04-19T03:02:05.925 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:05.925 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:05.925 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:05.925 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:02:05.925 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:05.909020+0000", 2024-04-19T03:02:05.925 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:05.925 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:05.925 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:05.925 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:02:05.925 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:05.909123+0000", 2024-04-19T03:02:05.926 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00010247999999999999 2024-04-19T03:02:05.926 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:05.926 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:05.926 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:02:05.926 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:05.909130+0000", 2024-04-19T03:02:05.926 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.5290000000000003e-06 2024-04-19T03:02:05.926 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:05.926 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:05.926 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:02:05.926 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:05.909135+0000", 2024-04-19T03:02:05.926 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.8629999999999999e-06 2024-04-19T03:02:05.926 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:05.926 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:05.926 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:05.927 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:05.909166+0000", 2024-04-19T03:02:05.927 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0997999999999997e-05 2024-04-19T03:02:05.927 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:05.927 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:05.927 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:02:05.927 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:05.909274+0000", 2024-04-19T03:02:05.927 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000107407 2024-04-19T03:02:05.927 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:05.927 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:05.927 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-04-19T03:02:05.927 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:05.909365+0000", 2024-04-19T03:02:05.927 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.1580000000000001e-05 2024-04-19T03:02:05.927 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:05.928 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:02:05.928 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:05.928 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:05.928 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:05.928 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4755.0:60456 5.7 e35/22 5:eb7698c1:::benchmark_data_smithi096_19531_object60455:head v 35'3701, mlcod=35'3698)", 2024-04-19T03:02:05.928 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:02:05.909614+0000", 2024-04-19T03:02:05.928 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 0.0041713219999999999, 2024-04-19T03:02:05.928 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0044304110000000004, 2024-04-19T03:02:05.928 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:02:05.928 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:05.928 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:02:05.928 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:05.928 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:02:05.928 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:05.909614+0000", 2024-04-19T03:02:05.929 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:05.929 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:05.929 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:05.929 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:02:05.929 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:05.909614+0000", 2024-04-19T03:02:05.929 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:05.929 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:05.929 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:05.929 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:02:05.929 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:05.909613+0000", 2024-04-19T03:02:05.929 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:05.929 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:05.929 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:05.929 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:02:05.929 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:05.909678+0000", 2024-04-19T03:02:05.930 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.5078000000000003e-05 2024-04-19T03:02:05.930 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:05.930 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:05.930 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:02:05.930 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:05.909684+0000", 2024-04-19T03:02:05.930 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.5269999999999998e-06 2024-04-19T03:02:05.930 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:05.930 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:05.930 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:02:05.930 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:05.909687+0000", 2024-04-19T03:02:05.930 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.6619999999999998e-06 2024-04-19T03:02:05.930 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:05.931 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:05.931 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:05.931 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:05.909732+0000", 2024-04-19T03:02:05.931 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.4180000000000001e-05 2024-04-19T03:02:05.931 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:05.931 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:05.931 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:02:05.931 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:05.909751+0000", 2024-04-19T03:02:05.931 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.9826e-05 2024-04-19T03:02:05.931 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:05.931 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:05.931 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:02:05.931 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:05.914044+0000", 2024-04-19T03:02:05.931 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0042922660000000003 2024-04-19T03:02:05.932 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:05.932 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:02:05.932 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:05.932 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:05.932 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:05.932 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4755.0:60458 5.8 e35/22 5:1f14ce6c:::benchmark_data_smithi096_19531_object60457:head v 35'3845, mlcod=35'3843)", 2024-04-19T03:02:05.932 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:02:05.909948+0000", 2024-04-19T03:02:05.932 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 0.0038371149999999999, 2024-04-19T03:02:05.932 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0041652429999999999, 2024-04-19T03:02:05.932 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:02:05.932 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "started", 2024-04-19T03:02:05.932 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:02:05.932 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:05.932 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:02:05.933 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:05.909948+0000", 2024-04-19T03:02:05.933 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:05.933 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:05.933 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:05.933 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:02:05.933 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:05.909948+0000", 2024-04-19T03:02:05.933 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:05.933 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:05.933 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:05.933 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:02:05.933 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:05.909947+0000", 2024-04-19T03:02:05.933 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:05.933 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:05.933 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:05.933 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:02:05.934 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:05.910005+0000", 2024-04-19T03:02:05.934 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.7187e-05 2024-04-19T03:02:05.934 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:05.934 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:05.934 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:02:05.934 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:05.910009+0000", 2024-04-19T03:02:05.934 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.9389999999999996e-06 2024-04-19T03:02:05.934 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:05.934 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:05.934 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:02:05.934 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:05.910013+0000", 2024-04-19T03:02:05.934 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.123e-06 2024-04-19T03:02:05.934 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:05.935 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:05.935 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:05.935 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:05.910049+0000", 2024-04-19T03:02:05.935 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.5988000000000002e-05 2024-04-19T03:02:05.935 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:05.935 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:05.935 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:02:05.935 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:05.910060+0000", 2024-04-19T03:02:05.935 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1351e-05 2024-04-19T03:02:05.935 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:05.935 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:02:05.935 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:05.935 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:05.935 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:05.936 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4755.0:60452 5.e e35/22 5:7d9dbb8e:::benchmark_data_smithi096_19531_object60451:head v 35'3862, mlcod=35'3859)", 2024-04-19T03:02:05.936 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:02:05.910750+0000", 2024-04-19T03:02:05.936 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 0.0030347270000000001, 2024-04-19T03:02:05.936 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0034043010000000002, 2024-04-19T03:02:05.936 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:02:05.936 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "started", 2024-04-19T03:02:05.936 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:02:05.936 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:05.936 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:02:05.936 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:05.910750+0000", 2024-04-19T03:02:05.936 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:05.936 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:05.936 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:05.936 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:02:05.937 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:05.910750+0000", 2024-04-19T03:02:05.937 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:05.937 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:05.937 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:05.937 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:02:05.937 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:05.910750+0000", 2024-04-19T03:02:05.937 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:05.937 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:05.937 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:05.937 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:02:05.937 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:05.910818+0000", 2024-04-19T03:02:05.937 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.8329000000000003e-05 2024-04-19T03:02:05.937 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:05.937 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:05.938 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:02:05.938 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:05.910831+0000", 2024-04-19T03:02:05.938 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2938e-05 2024-04-19T03:02:05.938 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:05.938 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:05.938 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:02:05.938 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:05.910836+0000", 2024-04-19T03:02:05.938 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.4650000000000002e-06 2024-04-19T03:02:05.938 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:05.938 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:05.938 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:05.938 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:05.910900+0000", 2024-04-19T03:02:05.938 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.3454000000000006e-05 2024-04-19T03:02:05.939 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:05.939 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:05.939 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:02:05.939 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:05.910921+0000", 2024-04-19T03:02:05.939 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.1005e-05 2024-04-19T03:02:05.939 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:05.939 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:02:05.939 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:05.939 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:05.939 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:05.939 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4755.0:60461 5.a 5:5fa03a9c:::benchmark_data_smithi096_19531_object60460:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-19T03:02:05.939 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:02:05.913319+0000", 2024-04-19T03:02:05.939 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 0.00046578100000000002, 2024-04-19T03:02:05.939 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00087379500000000002, 2024-04-19T03:02:05.940 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:02:05.940 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:02:05.940 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-04-19T03:02:05.940 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4755", 2024-04-19T03:02:05.940 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:05.940 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 60461 2024-04-19T03:02:05.940 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:05.940 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:02:05.940 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:05.940 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:02:05.940 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:05.913319+0000", 2024-04-19T03:02:05.941 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:05.941 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:05.941 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:05.941 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:02:05.941 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:05.913319+0000", 2024-04-19T03:02:05.941 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:05.941 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:05.941 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:05.941 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:02:05.941 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:05.913318+0000", 2024-04-19T03:02:05.941 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:05.942 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:05.942 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:05.942 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:02:05.942 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:05.913396+0000", 2024-04-19T03:02:05.942 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.7595000000000005e-05 2024-04-19T03:02:05.942 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:05.942 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:05.942 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:02:05.942 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:05.913404+0000", 2024-04-19T03:02:05.942 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.7150000000000004e-06 2024-04-19T03:02:05.942 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:05.942 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:05.942 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:02:05.943 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:05.913409+0000", 2024-04-19T03:02:05.943 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.7990000000000001e-06 2024-04-19T03:02:05.943 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:05.943 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:05.943 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:05.943 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:05.913439+0000", 2024-04-19T03:02:05.943 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.9838000000000001e-05 2024-04-19T03:02:05.943 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:05.943 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:05.943 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:02:05.943 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:05.913544+0000", 2024-04-19T03:02:05.943 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000104968 2024-04-19T03:02:05.943 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:05.944 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:05.944 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 1", 2024-04-19T03:02:05.944 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:05.913651+0000", 2024-04-19T03:02:05.944 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000106745 2024-04-19T03:02:05.944 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:05.944 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:02:05.944 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:05.944 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:05.944 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:05.944 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4755.0:60460 5.8 e35/22 5:1c67019c:::benchmark_data_smithi096_19531_object60459:head v 35'3846, mlcod=35'3843)", 2024-04-19T03:02:05.944 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:02:05.913654+0000", 2024-04-19T03:02:05.944 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 0.00013133900000000001, 2024-04-19T03:02:05.944 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00058424499999999995, 2024-04-19T03:02:05.945 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:02:05.945 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "started", 2024-04-19T03:02:05.945 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:02:05.945 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:05.945 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:02:05.945 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:05.913654+0000", 2024-04-19T03:02:05.945 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:05.945 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:05.945 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:05.945 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:02:05.945 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:05.913654+0000", 2024-04-19T03:02:05.945 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:05.945 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:05.946 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:05.946 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:02:05.946 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:05.913653+0000", 2024-04-19T03:02:05.946 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:05.946 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:05.946 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:05.946 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:02:05.946 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:05.913765+0000", 2024-04-19T03:02:05.946 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000111968 2024-04-19T03:02:05.946 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:05.946 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:05.947 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:02:05.947 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:05.913777+0000", 2024-04-19T03:02:05.947 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.165e-05 2024-04-19T03:02:05.947 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:05.947 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:05.947 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:02:05.947 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:05.913781+0000", 2024-04-19T03:02:05.947 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.7180000000000004e-06 2024-04-19T03:02:05.947 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:05.947 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:05.947 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:05.947 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:05.913832+0000", 2024-04-19T03:02:05.947 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.0757000000000002e-05 2024-04-19T03:02:05.948 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:05.948 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:05.948 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:02:05.948 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:05.913851+0000", 2024-04-19T03:02:05.948 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.9094999999999999e-05 2024-04-19T03:02:05.948 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:05.948 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:02:05.948 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:05.948 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:05.948 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:05.948 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4755.0:60463 5.a 5.f392f9ea (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-19T03:02:05.948 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:02:05.913714+0000", 2024-04-19T03:02:05.948 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 7.0594999999999997e-05, 2024-04-19T03:02:05.949 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00057217100000000001, 2024-04-19T03:02:05.949 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:02:05.949 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "queued for pg", 2024-04-19T03:02:05.949 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-04-19T03:02:05.949 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4755", 2024-04-19T03:02:05.949 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:05.949 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 60463 2024-04-19T03:02:05.949 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:05.949 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:02:05.949 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:05.949 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:02:05.949 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:05.913714+0000", 2024-04-19T03:02:05.949 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:05.949 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:05.950 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:05.950 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:02:05.950 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:05.913714+0000", 2024-04-19T03:02:05.950 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:05.950 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:05.950 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:05.950 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:02:05.950 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:05.913713+0000", 2024-04-19T03:02:05.950 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2024-04-19T03:02:05.950 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:05.950 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:05.950 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:02:05.950 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:05.913817+0000", 2024-04-19T03:02:05.951 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00010336399999999999 2024-04-19T03:02:05.951 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:05.951 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:05.951 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:02:05.951 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:05.913834+0000", 2024-04-19T03:02:05.951 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.7713000000000001e-05 2024-04-19T03:02:05.951 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:05.951 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:05.951 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:02:05.951 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:05.913842+0000", 2024-04-19T03:02:05.951 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.3429999999999998e-06 2024-04-19T03:02:05.951 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:05.951 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:02:05.952 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:05.952 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:05.952 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:05.952 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4755.0:60455 5.e e35/22 5:7d3df658:::benchmark_data_smithi096_19531_object60454:head v 35'3863, mlcod=35'3859)", 2024-04-19T03:02:05.952 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:02:05.913792+0000", 2024-04-19T03:02:05.952 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 4294967295.9999933, 2024-04-19T03:02:05.952 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00053583000000000005, 2024-04-19T03:02:05.952 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:02:05.952 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "started", 2024-04-19T03:02:05.952 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:02:05.952 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:05.952 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:02:05.952 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:05.913792+0000", 2024-04-19T03:02:05.952 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:05.952 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:05.953 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:05.953 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:02:05.953 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:05.913792+0000", 2024-04-19T03:02:05.953 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:05.953 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:05.953 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:05.953 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:02:05.953 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:05.913791+0000", 2024-04-19T03:02:05.953 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:05.953 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:05.953 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:05.953 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:02:05.953 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:05.913850+0000", 2024-04-19T03:02:05.954 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.8721000000000002e-05 2024-04-19T03:02:05.954 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:05.954 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:05.954 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:02:05.954 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:05.913856+0000", 2024-04-19T03:02:05.954 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.4649999999999999e-06 2024-04-19T03:02:05.954 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:05.954 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:05.954 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:02:05.954 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:05.913861+0000", 2024-04-19T03:02:05.954 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.6970000000000001e-06 2024-04-19T03:02:05.954 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:05.954 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:05.955 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:05.955 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:05.913938+0000", 2024-04-19T03:02:05.955 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.6815000000000002e-05 2024-04-19T03:02:05.955 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:05.955 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:05.955 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:02:05.955 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:05.913955+0000", 2024-04-19T03:02:05.955 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.7408e-05 2024-04-19T03:02:05.955 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:05.955 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:02:05.955 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:05.955 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:05.955 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:05.955 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop_reply(client.4755.0:60450 5.3 e35/22 ondisk, result = 0)", 2024-04-19T03:02:05.956 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:02:05.914219+0000", 2024-04-19T03:02:05.956 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 4294967295.9995661, 2024-04-19T03:02:05.956 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00015211700000000001, 2024-04-19T03:02:05.956 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:02:05.956 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "started", 2024-04-19T03:02:05.956 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:02:05.956 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:05.956 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:02:05.956 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:05.914219+0000", 2024-04-19T03:02:05.956 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:05.956 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:05.956 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:05.956 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:02:05.956 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:05.914219+0000", 2024-04-19T03:02:05.957 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:05.957 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:05.957 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:05.957 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:02:05.957 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:05.914218+0000", 2024-04-19T03:02:05.957 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:05.957 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:05.957 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:05.957 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:02:05.957 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:05.914223+0000", 2024-04-19T03:02:05.957 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.7260000000000002e-06 2024-04-19T03:02:05.957 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:05.957 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:05.957 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:02:05.957 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:05.914234+0000", 2024-04-19T03:02:05.958 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1245e-05 2024-04-19T03:02:05.958 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:05.958 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:05.958 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:02:05.958 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:05.914240+0000", 2024-04-19T03:02:05.958 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.0499999999999997e-06 2024-04-19T03:02:05.958 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:05.958 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:05.958 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:05.958 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:05.914278+0000", 2024-04-19T03:02:05.958 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.7497999999999999e-05 2024-04-19T03:02:05.958 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:05.958 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:05.959 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:02:05.959 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:05.914285+0000", 2024-04-19T03:02:05.959 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.2089999999999999e-06 2024-04-19T03:02:05.959 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:05.959 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:02:05.959 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:05.959 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:05.959 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2024-04-19T03:02:05.959 INFO:teuthology.orchestra.run.smithi097.stdout: "num_ops": 11 2024-04-19T03:02:05.959 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-04-19T03:02:05.960 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T03:02:05.984 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-04-19T03:02:05.982+0000 7f35986ab700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18243) UID: 0 2024-04-19T03:02:06.085 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-04-19T03:02:06.085 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [], 2024-04-19T03:02:06.085 INFO:teuthology.orchestra.run.smithi097.stdout: "complaint_time": 30, 2024-04-19T03:02:06.085 INFO:teuthology.orchestra.run.smithi097.stdout: "num_blocked_ops": 0 2024-04-19T03:02:06.085 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-04-19T03:02:06.085 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:06.084+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:06.099 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T03:02:06.160 INFO:teuthology.orchestra.run.smithi096.stderr:noscrub is unset 2024-04-19T03:02:06.185 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:06.184+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:06.231 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-04-19T03:02:06.231 INFO:teuthology.orchestra.run.smithi097.stdout: "size": 20, 2024-04-19T03:02:06.231 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 600, 2024-04-19T03:02:06.231 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [ 2024-04-19T03:02:06.231 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.231 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(mds.0.3:14 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:02:06.231 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:14.997079+0000", 2024-04-19T03:02:06.231 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 51.230606031999997, 2024-04-19T03:02:06.231 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.021951970000000001, 2024-04-19T03:02:06.232 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:02:06.232 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:06.232 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:02:06.232 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.232 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:02:06.232 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997079+0000", 2024-04-19T03:02:06.232 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:06.232 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.232 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.232 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:02:06.232 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997079+0000", 2024-04-19T03:02:06.232 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:06.233 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.233 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.233 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:02:06.233 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997077+0000", 2024-04-19T03:02:06.233 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:06.233 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.233 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.233 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:02:06.233 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997087+0000", 2024-04-19T03:02:06.233 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.006e-05 2024-04-19T03:02:06.233 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.233 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.234 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:02:06.234 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997105+0000", 2024-04-19T03:02:06.234 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.8026999999999999e-05 2024-04-19T03:02:06.234 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.234 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.234 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:02:06.234 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997135+0000", 2024-04-19T03:02:06.234 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.9643000000000001e-05 2024-04-19T03:02:06.234 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.234 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.234 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:06.234 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997208+0000", 2024-04-19T03:02:06.235 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.3419999999999998e-05 2024-04-19T03:02:06.235 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.235 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.235 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op must wait for map", 2024-04-19T03:02:06.235 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997244+0000", 2024-04-19T03:02:06.235 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.5367000000000002e-05 2024-04-19T03:02:06.235 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.235 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.235 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:06.235 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.007357+0000", 2024-04-19T03:02:06.236 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.010112703000000001 2024-04-19T03:02:06.236 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.236 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.236 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:02:06.236 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.007479+0000", 2024-04-19T03:02:06.236 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012279599999999999 2024-04-19T03:02:06.236 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.236 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.236 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 1", 2024-04-19T03:02:06.236 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.007610+0000", 2024-04-19T03:02:06.236 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00013093499999999999 2024-04-19T03:02:06.236 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.236 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.237 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:02:06.237 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.012526+0000", 2024-04-19T03:02:06.237 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0049157519999999998 2024-04-19T03:02:06.237 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.237 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.237 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:06.237 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.018959+0000", 2024-04-19T03:02:06.237 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0064326009999999996 2024-04-19T03:02:06.237 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.237 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.237 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:02:06.237 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.019005+0000", 2024-04-19T03:02:06.237 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.6066999999999998e-05 2024-04-19T03:02:06.237 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.238 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.238 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:02:06.238 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.019031+0000", 2024-04-19T03:02:06.238 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.6009000000000001e-05 2024-04-19T03:02:06.238 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:06.238 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:02:06.238 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:06.238 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.238 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.238 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:02:06.238 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:14.997149+0000", 2024-04-19T03:02:06.238 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 51.230535412000002, 2024-04-19T03:02:06.239 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.021805590999999999, 2024-04-19T03:02:06.239 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:02:06.239 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:06.239 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:02:06.239 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.239 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:02:06.239 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997149+0000", 2024-04-19T03:02:06.239 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:06.239 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.239 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.239 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:02:06.239 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997149+0000", 2024-04-19T03:02:06.239 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:06.240 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.240 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.240 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:02:06.240 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997148+0000", 2024-04-19T03:02:06.240 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2024-04-19T03:02:06.240 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.240 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.240 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:02:06.240 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997166+0000", 2024-04-19T03:02:06.240 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.8233e-05 2024-04-19T03:02:06.240 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.240 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.241 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:02:06.241 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997182+0000", 2024-04-19T03:02:06.241 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5999999999999999e-05 2024-04-19T03:02:06.241 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.241 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.241 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:02:06.241 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997195+0000", 2024-04-19T03:02:06.242 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.252e-05 2024-04-19T03:02:06.242 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.242 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.242 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:06.242 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997348+0000", 2024-04-19T03:02:06.242 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000153115 2024-04-19T03:02:06.242 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.242 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.242 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:02:06.242 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997354+0000", 2024-04-19T03:02:06.242 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.9359999999999996e-06 2024-04-19T03:02:06.242 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.242 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.243 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:06.243 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.008147+0000", 2024-04-19T03:02:06.243 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.010793127 2024-04-19T03:02:06.243 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.243 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.243 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:02:06.243 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.008225+0000", 2024-04-19T03:02:06.243 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.7935999999999994e-05 2024-04-19T03:02:06.243 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.243 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.243 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-04-19T03:02:06.243 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.008377+0000", 2024-04-19T03:02:06.243 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00015159099999999999 2024-04-19T03:02:06.243 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.244 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.244 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:02:06.244 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.012629+0000", 2024-04-19T03:02:06.244 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0042520420000000001 2024-04-19T03:02:06.244 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.244 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.244 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:06.244 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.018871+0000", 2024-04-19T03:02:06.244 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0062425060000000001 2024-04-19T03:02:06.244 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.244 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.244 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:02:06.244 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.018910+0000", 2024-04-19T03:02:06.244 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.8482999999999997e-05 2024-04-19T03:02:06.245 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.245 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.245 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:02:06.245 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.018955+0000", 2024-04-19T03:02:06.245 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.5252e-05 2024-04-19T03:02:06.245 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:06.245 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:02:06.245 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:06.245 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.245 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.245 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(mds.0.3:36 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:02:06.245 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:14.997207+0000", 2024-04-19T03:02:06.245 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 51.230477862000001, 2024-04-19T03:02:06.245 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.022210431999999999, 2024-04-19T03:02:06.246 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:02:06.246 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:06.246 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:02:06.246 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.246 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:02:06.246 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997207+0000", 2024-04-19T03:02:06.246 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:06.246 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.246 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.246 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:02:06.246 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997207+0000", 2024-04-19T03:02:06.246 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:06.246 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.247 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.247 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:02:06.247 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997206+0000", 2024-04-19T03:02:06.247 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2024-04-19T03:02:06.247 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.247 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.247 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:02:06.247 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997218+0000", 2024-04-19T03:02:06.247 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2607e-05 2024-04-19T03:02:06.247 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.247 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.247 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:02:06.247 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997234+0000", 2024-04-19T03:02:06.247 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5583999999999999e-05 2024-04-19T03:02:06.248 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.248 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.248 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:02:06.248 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997248+0000", 2024-04-19T03:02:06.248 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4270000000000001e-05 2024-04-19T03:02:06.248 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.248 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.248 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:06.248 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997397+0000", 2024-04-19T03:02:06.248 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0001482 2024-04-19T03:02:06.248 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.248 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.248 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:02:06.248 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997407+0000", 2024-04-19T03:02:06.249 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0944000000000001e-05 2024-04-19T03:02:06.249 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.249 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.249 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:06.249 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.008173+0000", 2024-04-19T03:02:06.249 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.010765378000000001 2024-04-19T03:02:06.249 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.249 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.249 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:02:06.249 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.008278+0000", 2024-04-19T03:02:06.249 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00010538 2024-04-19T03:02:06.249 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.249 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.249 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 1", 2024-04-19T03:02:06.250 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.008423+0000", 2024-04-19T03:02:06.250 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014525599999999999 2024-04-19T03:02:06.250 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.250 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.250 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:02:06.250 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.012734+0000", 2024-04-19T03:02:06.250 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0043108590000000002 2024-04-19T03:02:06.250 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.250 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.250 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:06.250 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.019318+0000", 2024-04-19T03:02:06.250 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0065836130000000003 2024-04-19T03:02:06.250 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.250 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.251 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:02:06.251 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.019382+0000", 2024-04-19T03:02:06.251 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.3925999999999997e-05 2024-04-19T03:02:06.251 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.251 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.251 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:02:06.251 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.019417+0000", 2024-04-19T03:02:06.251 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.5454999999999999e-05 2024-04-19T03:02:06.251 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:06.251 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:02:06.251 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:06.251 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.251 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.251 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(mds.0.3:15 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:02:06.251 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:14.997260+0000", 2024-04-19T03:02:06.252 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 51.230424710999998, 2024-04-19T03:02:06.252 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.021842842000000001, 2024-04-19T03:02:06.252 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:02:06.252 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:06.252 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:02:06.252 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.252 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:02:06.252 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997260+0000", 2024-04-19T03:02:06.252 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:06.252 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.252 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.252 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:02:06.252 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997260+0000", 2024-04-19T03:02:06.252 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:06.253 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.253 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.253 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:02:06.253 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997259+0000", 2024-04-19T03:02:06.253 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:06.253 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.253 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.253 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:02:06.253 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997270+0000", 2024-04-19T03:02:06.253 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0312999999999999e-05 2024-04-19T03:02:06.253 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.253 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.253 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:02:06.253 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997279+0000", 2024-04-19T03:02:06.254 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.7770000000000008e-06 2024-04-19T03:02:06.254 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.254 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.254 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:02:06.254 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997286+0000", 2024-04-19T03:02:06.254 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.0129999999999996e-06 2024-04-19T03:02:06.254 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.254 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.254 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:06.254 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997433+0000", 2024-04-19T03:02:06.254 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014774699999999999 2024-04-19T03:02:06.254 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.254 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.254 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:02:06.255 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997443+0000", 2024-04-19T03:02:06.255 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.414e-06 2024-04-19T03:02:06.255 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.255 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.255 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:06.255 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.008673+0000", 2024-04-19T03:02:06.255 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.011230789999999999 2024-04-19T03:02:06.255 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.255 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.255 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:02:06.255 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.008808+0000", 2024-04-19T03:02:06.255 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000134346 2024-04-19T03:02:06.255 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.255 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.256 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-04-19T03:02:06.256 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.008922+0000", 2024-04-19T03:02:06.256 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000114444 2024-04-19T03:02:06.256 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.256 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.256 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:02:06.256 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.013442+0000", 2024-04-19T03:02:06.256 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0045193439999999998 2024-04-19T03:02:06.256 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.256 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.256 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:06.256 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.019005+0000", 2024-04-19T03:02:06.256 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00556333 2024-04-19T03:02:06.257 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.257 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.257 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:02:06.257 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.019049+0000", 2024-04-19T03:02:06.257 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.4240000000000003e-05 2024-04-19T03:02:06.257 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.257 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.257 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:02:06.257 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.019103+0000", 2024-04-19T03:02:06.257 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.3706999999999999e-05 2024-04-19T03:02:06.257 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:06.257 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:02:06.257 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:06.258 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.258 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.258 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(mds.0.3:23 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:02:06.258 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:14.997449+0000", 2024-04-19T03:02:06.258 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 51.230235663000002, 2024-04-19T03:02:06.258 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.022679250000000001, 2024-04-19T03:02:06.258 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:02:06.258 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "started", 2024-04-19T03:02:06.258 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:02:06.258 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.258 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:02:06.258 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997449+0000", 2024-04-19T03:02:06.258 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:06.259 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.259 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.259 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:02:06.259 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997449+0000", 2024-04-19T03:02:06.259 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:06.259 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.259 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.259 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:02:06.259 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997448+0000", 2024-04-19T03:02:06.259 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:06.259 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.259 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.259 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:02:06.259 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997452+0000", 2024-04-19T03:02:06.260 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.0369999999999996e-06 2024-04-19T03:02:06.260 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.260 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.260 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:02:06.260 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997461+0000", 2024-04-19T03:02:06.260 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.6100000000000006e-06 2024-04-19T03:02:06.260 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.260 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.260 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:02:06.260 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997468+0000", 2024-04-19T03:02:06.260 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.8360000000000003e-06 2024-04-19T03:02:06.260 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.260 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.260 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:06.261 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997546+0000", 2024-04-19T03:02:06.261 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.7956999999999999e-05 2024-04-19T03:02:06.261 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.261 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.261 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:02:06.261 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997555+0000", 2024-04-19T03:02:06.261 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.2269999999999999e-06 2024-04-19T03:02:06.261 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.261 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.261 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:06.261 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.010065+0000", 2024-04-19T03:02:06.261 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.012509457999999999 2024-04-19T03:02:06.261 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.262 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.262 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:02:06.262 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.010187+0000", 2024-04-19T03:02:06.262 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000122059 2024-04-19T03:02:06.262 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.262 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.262 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:02:06.262 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.020128+0000", 2024-04-19T03:02:06.262 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0099417529999999994 2024-04-19T03:02:06.262 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:06.262 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:02:06.262 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:06.263 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.263 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.263 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(mds.0.3:25 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:02:06.263 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:14.997485+0000", 2024-04-19T03:02:06.263 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 51.230200197000002, 2024-04-19T03:02:06.263 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.021633427, 2024-04-19T03:02:06.263 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:02:06.263 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "started", 2024-04-19T03:02:06.263 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:02:06.263 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.263 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:02:06.263 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997485+0000", 2024-04-19T03:02:06.263 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:06.264 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.264 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.264 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:02:06.264 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997485+0000", 2024-04-19T03:02:06.264 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:06.264 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.264 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.264 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:02:06.264 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997484+0000", 2024-04-19T03:02:06.264 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2024-04-19T03:02:06.264 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.264 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.264 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:02:06.264 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997490+0000", 2024-04-19T03:02:06.265 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.857e-06 2024-04-19T03:02:06.265 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.265 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.265 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:02:06.265 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997505+0000", 2024-04-19T03:02:06.265 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.518e-05 2024-04-19T03:02:06.265 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.265 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.265 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:02:06.265 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997520+0000", 2024-04-19T03:02:06.265 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5026e-05 2024-04-19T03:02:06.265 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.265 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.265 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:06.266 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997607+0000", 2024-04-19T03:02:06.266 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.7107000000000005e-05 2024-04-19T03:02:06.266 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.266 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.266 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op must wait for map", 2024-04-19T03:02:06.266 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997614+0000", 2024-04-19T03:02:06.266 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.0539999999999997e-06 2024-04-19T03:02:06.266 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.266 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.266 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:06.266 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.009808+0000", 2024-04-19T03:02:06.266 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.012194371000000001 2024-04-19T03:02:06.266 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.266 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.267 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:02:06.267 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.010107+0000", 2024-04-19T03:02:06.267 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000298731 2024-04-19T03:02:06.267 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.267 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.267 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:02:06.267 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.019118+0000", 2024-04-19T03:02:06.267 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0090109839999999997 2024-04-19T03:02:06.267 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:06.267 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:02:06.267 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:06.267 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.267 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.267 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4755.0:11277 5.c 5:38c3ceb2:::benchmark_data_smithi096_19531_object11276:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T03:02:06.268 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:42.059676+0000", 2024-04-19T03:02:06.268 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 24.168008575000002, 2024-04-19T03:02:06.268 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.029909680000000001, 2024-04-19T03:02:06.268 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:02:06.268 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:06.268 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-04-19T03:02:06.268 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4755", 2024-04-19T03:02:06.268 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:06.268 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 11277 2024-04-19T03:02:06.268 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.268 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:02:06.268 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.268 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:02:06.269 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.059676+0000", 2024-04-19T03:02:06.269 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:06.269 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.269 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.269 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:02:06.269 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.059676+0000", 2024-04-19T03:02:06.269 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:06.269 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.269 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.269 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:02:06.269 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.059665+0000", 2024-04-19T03:02:06.269 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999886 2024-04-19T03:02:06.269 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.269 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.270 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:02:06.270 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.059777+0000", 2024-04-19T03:02:06.270 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000111953 2024-04-19T03:02:06.270 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.270 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.270 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:02:06.270 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.059789+0000", 2024-04-19T03:02:06.270 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1809e-05 2024-04-19T03:02:06.270 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.270 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.270 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:02:06.270 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.059797+0000", 2024-04-19T03:02:06.270 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.2090000000000005e-06 2024-04-19T03:02:06.270 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.271 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.271 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:06.271 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.060528+0000", 2024-04-19T03:02:06.271 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00073144499999999995 2024-04-19T03:02:06.271 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.271 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.271 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:02:06.271 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.060662+0000", 2024-04-19T03:02:06.271 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000133435 2024-04-19T03:02:06.271 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.271 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.271 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-04-19T03:02:06.271 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.060766+0000", 2024-04-19T03:02:06.271 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00010473500000000001 2024-04-19T03:02:06.272 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.272 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.272 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:02:06.272 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.067649+0000", 2024-04-19T03:02:06.272 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.006882684 2024-04-19T03:02:06.272 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.272 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.272 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:06.272 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.089475+0000", 2024-04-19T03:02:06.272 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.021826196999999999 2024-04-19T03:02:06.272 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.272 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.273 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:02:06.273 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.089535+0000", 2024-04-19T03:02:06.273 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.9239e-05 2024-04-19T03:02:06.273 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.273 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.273 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:02:06.273 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.089586+0000", 2024-04-19T03:02:06.273 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.1288000000000001e-05 2024-04-19T03:02:06.273 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:06.273 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:02:06.273 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:06.273 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.273 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.274 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4755.0:11280 5.6 5:6e34f5e7:::benchmark_data_smithi096_19531_object11279:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T03:02:06.274 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:42.060002+0000", 2024-04-19T03:02:06.274 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 24.167683198999999, 2024-04-19T03:02:06.274 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.028171841999999999, 2024-04-19T03:02:06.274 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:02:06.274 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:06.274 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-04-19T03:02:06.274 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4755", 2024-04-19T03:02:06.274 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:06.274 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 11280 2024-04-19T03:02:06.274 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.274 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:02:06.274 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.275 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:02:06.275 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.060002+0000", 2024-04-19T03:02:06.275 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:06.275 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.275 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.275 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:02:06.275 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.060002+0000", 2024-04-19T03:02:06.275 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:06.275 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.275 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.275 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:02:06.275 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.060000+0000", 2024-04-19T03:02:06.275 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2024-04-19T03:02:06.275 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.276 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.276 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:02:06.276 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.060120+0000", 2024-04-19T03:02:06.276 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00011941400000000001 2024-04-19T03:02:06.276 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.276 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.276 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:02:06.276 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.060132+0000", 2024-04-19T03:02:06.276 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2197e-05 2024-04-19T03:02:06.276 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.276 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.276 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:02:06.276 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.060141+0000", 2024-04-19T03:02:06.277 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.6829999999999997e-06 2024-04-19T03:02:06.277 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.277 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.277 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:06.277 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.060194+0000", 2024-04-19T03:02:06.277 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.3395e-05 2024-04-19T03:02:06.277 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.277 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.277 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:02:06.277 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.060333+0000", 2024-04-19T03:02:06.277 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00013935799999999999 2024-04-19T03:02:06.277 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.277 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.277 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-04-19T03:02:06.278 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.060477+0000", 2024-04-19T03:02:06.278 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000143938 2024-04-19T03:02:06.278 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.278 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.278 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:02:06.278 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.067752+0000", 2024-04-19T03:02:06.278 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0072741580000000002 2024-04-19T03:02:06.278 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.278 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.278 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:06.278 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.088041+0000", 2024-04-19T03:02:06.278 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.020288955000000001 2024-04-19T03:02:06.278 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.279 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.279 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:02:06.279 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.088113+0000", 2024-04-19T03:02:06.279 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.2492999999999999e-05 2024-04-19T03:02:06.279 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.279 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.279 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:02:06.279 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.088173+0000", 2024-04-19T03:02:06.279 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.0418999999999999e-05 2024-04-19T03:02:06.279 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:06.279 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:02:06.279 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:06.279 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.279 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.280 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4755.0:11274 5.e e26/22 5:7c846032:::benchmark_data_smithi096_19531_object11273:head v 26'697, mlcod=26'692)", 2024-04-19T03:02:06.280 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:42.065726+0000", 2024-04-19T03:02:06.280 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 24.161958672000001, 2024-04-19T03:02:06.280 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.028607227999999998, 2024-04-19T03:02:06.280 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:02:06.280 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:06.280 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:02:06.280 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.280 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:02:06.280 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.065726+0000", 2024-04-19T03:02:06.280 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:06.280 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.280 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.280 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:02:06.280 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.065726+0000", 2024-04-19T03:02:06.281 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:06.281 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.281 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.281 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:02:06.281 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.065725+0000", 2024-04-19T03:02:06.281 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2024-04-19T03:02:06.281 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.281 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.281 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:02:06.281 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.066818+0000", 2024-04-19T03:02:06.281 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0010930110000000001 2024-04-19T03:02:06.281 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.281 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.281 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:02:06.282 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.066826+0000", 2024-04-19T03:02:06.282 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.0609999999999996e-06 2024-04-19T03:02:06.282 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.282 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.282 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:02:06.282 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.066831+0000", 2024-04-19T03:02:06.282 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.7500000000000003e-06 2024-04-19T03:02:06.282 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.282 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.282 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:06.282 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.066857+0000", 2024-04-19T03:02:06.282 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.6126999999999999e-05 2024-04-19T03:02:06.283 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.283 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.283 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:02:06.283 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.066868+0000", 2024-04-19T03:02:06.283 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1113e-05 2024-04-19T03:02:06.283 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.283 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.283 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:02:06.283 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.094266+0000", 2024-04-19T03:02:06.283 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.027397731000000002 2024-04-19T03:02:06.283 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.283 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.283 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:02:06.283 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.094333+0000", 2024-04-19T03:02:06.284 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.7230000000000005e-05 2024-04-19T03:02:06.284 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:06.284 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:02:06.284 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:06.284 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.284 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.284 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4755.0:11279 5.8 e26/22 5:10b60c58:::benchmark_data_smithi096_19531_object11278:head v 26'723, mlcod=26'719)", 2024-04-19T03:02:06.284 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:42.066841+0000", 2024-04-19T03:02:06.284 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 24.160843357000001, 2024-04-19T03:02:06.284 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.021736267, 2024-04-19T03:02:06.284 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:02:06.284 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:06.284 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:02:06.284 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.285 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:02:06.285 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.066841+0000", 2024-04-19T03:02:06.285 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:06.285 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.285 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.285 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:02:06.285 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.066841+0000", 2024-04-19T03:02:06.285 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:06.285 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.285 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.285 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:02:06.285 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.066841+0000", 2024-04-19T03:02:06.285 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:06.285 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.285 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.286 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:02:06.286 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.066876+0000", 2024-04-19T03:02:06.286 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.4790999999999999e-05 2024-04-19T03:02:06.286 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.286 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.286 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:02:06.286 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.066880+0000", 2024-04-19T03:02:06.286 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.3610000000000003e-06 2024-04-19T03:02:06.286 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.286 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.286 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:02:06.286 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.066883+0000", 2024-04-19T03:02:06.286 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.4079999999999998e-06 2024-04-19T03:02:06.287 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.287 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.287 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:06.287 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.066929+0000", 2024-04-19T03:02:06.287 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.5444000000000001e-05 2024-04-19T03:02:06.287 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.287 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.287 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:02:06.287 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.066951+0000", 2024-04-19T03:02:06.287 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.2578999999999998e-05 2024-04-19T03:02:06.287 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.287 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.287 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:02:06.287 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.088518+0000", 2024-04-19T03:02:06.287 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.021566617 2024-04-19T03:02:06.288 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.288 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.288 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:02:06.288 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.088578+0000", 2024-04-19T03:02:06.288 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.9655999999999999e-05 2024-04-19T03:02:06.288 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:06.288 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:02:06.288 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:06.288 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.288 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.288 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4755.0:11282 5.e e26/22 5:75b7c510:::benchmark_data_smithi096_19531_object11281:head v 26'698, mlcod=26'693)", 2024-04-19T03:02:06.288 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:42.066923+0000", 2024-04-19T03:02:06.288 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 24.160761489999999, 2024-04-19T03:02:06.289 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.027436461999999998, 2024-04-19T03:02:06.289 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:02:06.289 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:06.289 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:02:06.289 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.289 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:02:06.289 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.066923+0000", 2024-04-19T03:02:06.289 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:06.289 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.289 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.289 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:02:06.289 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.066923+0000", 2024-04-19T03:02:06.289 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:06.290 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.290 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.290 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:02:06.290 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.066923+0000", 2024-04-19T03:02:06.290 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:06.290 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.290 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.290 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:02:06.290 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.066955+0000", 2024-04-19T03:02:06.290 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.2060999999999997e-05 2024-04-19T03:02:06.290 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.290 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.290 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:02:06.291 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.066962+0000", 2024-04-19T03:02:06.291 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.1969999999999999e-06 2024-04-19T03:02:06.291 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.291 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.291 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:02:06.291 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.066967+0000", 2024-04-19T03:02:06.291 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.6589999999999998e-06 2024-04-19T03:02:06.291 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.291 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.291 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:06.291 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.067762+0000", 2024-04-19T03:02:06.291 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00079538199999999997 2024-04-19T03:02:06.291 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.291 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.292 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:02:06.292 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.067782+0000", 2024-04-19T03:02:06.292 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.9432999999999998e-05 2024-04-19T03:02:06.292 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.292 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.292 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:02:06.292 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.094339+0000", 2024-04-19T03:02:06.292 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.026556778999999999 2024-04-19T03:02:06.292 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.292 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.292 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:02:06.292 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.094360+0000", 2024-04-19T03:02:06.292 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.1246e-05 2024-04-19T03:02:06.292 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:06.293 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:02:06.293 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:06.293 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.293 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.293 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4755.0:11291 5.a 5:5ee9d828:::benchmark_data_smithi096_19531_object11290:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T03:02:06.293 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:42.067725+0000", 2024-04-19T03:02:06.293 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 24.15995938, 2024-04-19T03:02:06.293 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.021089111000000001, 2024-04-19T03:02:06.293 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:02:06.293 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:06.293 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-04-19T03:02:06.293 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4755", 2024-04-19T03:02:06.293 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:06.294 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 11291 2024-04-19T03:02:06.294 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.294 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:02:06.294 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.294 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:02:06.294 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.067725+0000", 2024-04-19T03:02:06.294 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:06.294 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.294 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.294 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:02:06.294 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.067725+0000", 2024-04-19T03:02:06.294 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:06.294 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.295 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.295 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:02:06.295 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.067724+0000", 2024-04-19T03:02:06.295 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2024-04-19T03:02:06.295 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.295 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.295 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:02:06.295 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.067842+0000", 2024-04-19T03:02:06.295 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000117691 2024-04-19T03:02:06.295 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.295 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.295 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:02:06.295 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.067853+0000", 2024-04-19T03:02:06.295 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0679000000000001e-05 2024-04-19T03:02:06.296 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.296 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.296 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:02:06.296 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.067859+0000", 2024-04-19T03:02:06.296 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.9510000000000003e-06 2024-04-19T03:02:06.296 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.296 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.296 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:06.296 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.067905+0000", 2024-04-19T03:02:06.296 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.6242999999999998e-05 2024-04-19T03:02:06.296 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.296 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.296 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:02:06.296 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.085335+0000", 2024-04-19T03:02:06.297 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.017430451 2024-04-19T03:02:06.297 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.297 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.297 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 1", 2024-04-19T03:02:06.297 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.085538+0000", 2024-04-19T03:02:06.297 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000202511 2024-04-19T03:02:06.297 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.297 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.297 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:06.297 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.087988+0000", 2024-04-19T03:02:06.297 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0024505780000000001 2024-04-19T03:02:06.297 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.297 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.297 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:02:06.298 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.088672+0000", 2024-04-19T03:02:06.298 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00068377900000000003 2024-04-19T03:02:06.298 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.298 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.298 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:02:06.298 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.088757+0000", 2024-04-19T03:02:06.298 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.4384999999999999e-05 2024-04-19T03:02:06.298 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.298 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.298 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:02:06.298 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.088815+0000", 2024-04-19T03:02:06.298 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.7995999999999998e-05 2024-04-19T03:02:06.298 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:06.299 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:02:06.299 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:06.299 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.299 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.299 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4755.0:11293 5.c 5:31728bfd:::benchmark_data_smithi096_19531_object11292:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T03:02:06.299 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:42.068359+0000", 2024-04-19T03:02:06.299 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 24.159325666000001, 2024-04-19T03:02:06.299 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.022306475999999999, 2024-04-19T03:02:06.299 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:02:06.299 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:06.299 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-04-19T03:02:06.299 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4755", 2024-04-19T03:02:06.299 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:06.300 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 11293 2024-04-19T03:02:06.300 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.300 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:02:06.300 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.300 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:02:06.300 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.068359+0000", 2024-04-19T03:02:06.300 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:06.300 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.300 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.300 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:02:06.300 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.068359+0000", 2024-04-19T03:02:06.300 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:06.300 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.301 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.301 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:02:06.301 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.068358+0000", 2024-04-19T03:02:06.301 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2024-04-19T03:02:06.301 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.301 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.301 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:02:06.301 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.068427+0000", 2024-04-19T03:02:06.301 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.9139000000000003e-05 2024-04-19T03:02:06.301 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.301 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.301 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:02:06.301 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.085292+0000", 2024-04-19T03:02:06.301 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.016864371 2024-04-19T03:02:06.302 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.302 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.302 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:02:06.302 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.085306+0000", 2024-04-19T03:02:06.302 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.434e-05 2024-04-19T03:02:06.302 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.302 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.302 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:06.302 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.085404+0000", 2024-04-19T03:02:06.302 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.8145000000000003e-05 2024-04-19T03:02:06.302 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.302 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.302 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:02:06.303 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.085569+0000", 2024-04-19T03:02:06.303 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00016504099999999999 2024-04-19T03:02:06.303 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.303 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.303 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-04-19T03:02:06.303 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.085739+0000", 2024-04-19T03:02:06.303 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000170099 2024-04-19T03:02:06.303 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.303 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.303 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:02:06.303 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.089603+0000", 2024-04-19T03:02:06.303 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0038636080000000001 2024-04-19T03:02:06.303 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.304 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.304 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:06.304 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.090578+0000", 2024-04-19T03:02:06.304 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00097513199999999997 2024-04-19T03:02:06.304 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.304 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.304 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:02:06.304 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.090618+0000", 2024-04-19T03:02:06.304 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.9987999999999997e-05 2024-04-19T03:02:06.304 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.304 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.304 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:02:06.304 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.090666+0000", 2024-04-19T03:02:06.304 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.7420999999999999e-05 2024-04-19T03:02:06.305 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:06.305 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:02:06.305 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:06.305 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.305 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.305 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4755.0:60384 5.a 5:55675f1d:::benchmark_data_smithi096_19531_object60383:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-19T03:02:06.305 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:02:05.864278+0000", 2024-04-19T03:02:06.305 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 0.36340681699999999, 2024-04-19T03:02:06.305 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.021786224999999999, 2024-04-19T03:02:06.305 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:02:06.305 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:06.305 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-04-19T03:02:06.305 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4755", 2024-04-19T03:02:06.305 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:06.306 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 60384 2024-04-19T03:02:06.306 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.306 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:02:06.306 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.306 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:02:06.306 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:05.864278+0000", 2024-04-19T03:02:06.306 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:06.306 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.306 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.306 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:02:06.306 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:05.864278+0000", 2024-04-19T03:02:06.306 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:06.306 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.306 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.307 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:02:06.307 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:05.864277+0000", 2024-04-19T03:02:06.307 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:06.307 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.307 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.307 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:02:06.307 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:05.864344+0000", 2024-04-19T03:02:06.307 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.7392999999999997e-05 2024-04-19T03:02:06.307 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.307 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.307 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:02:06.307 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:05.864355+0000", 2024-04-19T03:02:06.307 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1083999999999999e-05 2024-04-19T03:02:06.307 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.307 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.308 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:02:06.308 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:05.864363+0000", 2024-04-19T03:02:06.308 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.9529999999999999e-06 2024-04-19T03:02:06.308 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.308 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.308 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:06.308 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:05.865979+0000", 2024-04-19T03:02:06.308 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001616159 2024-04-19T03:02:06.308 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.308 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.308 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:02:06.308 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:05.866059+0000", 2024-04-19T03:02:06.308 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.0343e-05 2024-04-19T03:02:06.309 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.309 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.309 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 1", 2024-04-19T03:02:06.309 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:05.866179+0000", 2024-04-19T03:02:06.309 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000119072 2024-04-19T03:02:06.309 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.309 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.309 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:06.309 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:05.875531+0000", 2024-04-19T03:02:06.309 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0093528770000000008 2024-04-19T03:02:06.309 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.309 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.309 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:02:06.309 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:05.885821+0000", 2024-04-19T03:02:06.309 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0102892 2024-04-19T03:02:06.310 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.310 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.310 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:02:06.310 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:05.886025+0000", 2024-04-19T03:02:06.310 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000204086 2024-04-19T03:02:06.310 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.310 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.310 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:02:06.310 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:05.886064+0000", 2024-04-19T03:02:06.310 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.9458000000000001e-05 2024-04-19T03:02:06.310 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:06.310 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:02:06.310 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:06.310 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.311 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.311 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4755.0:60387 5.a 5:5bcd3858:::benchmark_data_smithi096_19531_object60386:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-19T03:02:06.311 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:02:05.865112+0000", 2024-04-19T03:02:06.311 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 0.362572913, 2024-04-19T03:02:06.311 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.021027062999999999, 2024-04-19T03:02:06.311 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:02:06.311 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:06.311 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-04-19T03:02:06.311 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4755", 2024-04-19T03:02:06.311 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:06.311 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 60387 2024-04-19T03:02:06.311 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.311 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:02:06.311 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.312 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:02:06.312 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:05.865112+0000", 2024-04-19T03:02:06.312 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:06.312 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.312 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.312 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:02:06.312 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:05.865112+0000", 2024-04-19T03:02:06.312 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:06.312 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.312 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.312 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:02:06.312 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:05.865111+0000", 2024-04-19T03:02:06.312 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:06.312 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.313 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.313 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:02:06.313 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:05.865220+0000", 2024-04-19T03:02:06.313 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000108874 2024-04-19T03:02:06.313 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.313 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.313 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:02:06.313 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:05.865229+0000", 2024-04-19T03:02:06.313 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.8319999999999995e-06 2024-04-19T03:02:06.313 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.313 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.313 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:02:06.313 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:05.865235+0000", 2024-04-19T03:02:06.313 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.4869999999999999e-06 2024-04-19T03:02:06.313 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.314 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.314 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:06.314 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:05.872377+0000", 2024-04-19T03:02:06.314 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.007141723 2024-04-19T03:02:06.314 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.314 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.314 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:02:06.314 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:05.872553+0000", 2024-04-19T03:02:06.314 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00017596500000000001 2024-04-19T03:02:06.314 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.314 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.314 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 1", 2024-04-19T03:02:06.314 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:05.872745+0000", 2024-04-19T03:02:06.314 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00019203800000000001 2024-04-19T03:02:06.315 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.315 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.315 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:06.315 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:05.875797+0000", 2024-04-19T03:02:06.315 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0030517840000000001 2024-04-19T03:02:06.315 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.315 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.315 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:02:06.315 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:05.886079+0000", 2024-04-19T03:02:06.315 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.010281665000000001 2024-04-19T03:02:06.315 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.315 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.315 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:02:06.315 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:05.886109+0000", 2024-04-19T03:02:06.316 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0241999999999999e-05 2024-04-19T03:02:06.316 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.316 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.316 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:02:06.316 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:05.886139+0000", 2024-04-19T03:02:06.316 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0108e-05 2024-04-19T03:02:06.316 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:06.316 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:02:06.316 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:06.316 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.316 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.316 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4755.0:60674 5.5 5:aaf3a5ff:::benchmark_data_smithi096_19531_object60673:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-19T03:02:06.316 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:02:06.038509+0000", 2024-04-19T03:02:06.317 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 0.18917582599999999, 2024-04-19T03:02:06.317 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.024267756000000001, 2024-04-19T03:02:06.317 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:02:06.317 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:06.317 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-04-19T03:02:06.317 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4755", 2024-04-19T03:02:06.317 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:06.317 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 60674 2024-04-19T03:02:06.317 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.317 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:02:06.317 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.317 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:02:06.317 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.038509+0000", 2024-04-19T03:02:06.318 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:06.318 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.318 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.318 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:02:06.318 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.038509+0000", 2024-04-19T03:02:06.318 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:06.318 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.318 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.318 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:02:06.318 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.038507+0000", 2024-04-19T03:02:06.318 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999981 2024-04-19T03:02:06.318 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.318 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.319 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:02:06.319 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.038584+0000", 2024-04-19T03:02:06.319 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.6947999999999996e-05 2024-04-19T03:02:06.319 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.319 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.319 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:02:06.319 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.038597+0000", 2024-04-19T03:02:06.319 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2863e-05 2024-04-19T03:02:06.319 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.319 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.319 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:02:06.319 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.038606+0000", 2024-04-19T03:02:06.319 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.9209999999999998e-06 2024-04-19T03:02:06.320 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.320 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.320 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:06.320 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.041247+0000", 2024-04-19T03:02:06.320 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0026412720000000001 2024-04-19T03:02:06.320 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.320 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.320 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:02:06.320 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.041436+0000", 2024-04-19T03:02:06.320 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00018870599999999999 2024-04-19T03:02:06.320 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.320 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.321 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-04-19T03:02:06.321 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.041636+0000", 2024-04-19T03:02:06.321 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00020026399999999999 2024-04-19T03:02:06.321 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.321 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.321 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:06.321 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.048757+0000", 2024-04-19T03:02:06.321 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0071207620000000001 2024-04-19T03:02:06.321 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.321 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.321 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:02:06.321 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.062687+0000", 2024-04-19T03:02:06.321 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.013929811 2024-04-19T03:02:06.321 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.322 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.322 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:02:06.322 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.062740+0000", 2024-04-19T03:02:06.322 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.3735e-05 2024-04-19T03:02:06.322 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.322 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.322 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:02:06.322 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.062777+0000", 2024-04-19T03:02:06.322 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.6366999999999999e-05 2024-04-19T03:02:06.322 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:06.322 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:02:06.323 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:06.323 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.323 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.323 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4755.0:60677 5.5 5:aad57123:::benchmark_data_smithi096_19531_object60676:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-19T03:02:06.323 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:02:06.039077+0000", 2024-04-19T03:02:06.323 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 0.18860739100000001, 2024-04-19T03:02:06.323 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.023852720000000001, 2024-04-19T03:02:06.323 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:02:06.323 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:06.323 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-04-19T03:02:06.323 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4755", 2024-04-19T03:02:06.323 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:06.323 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 60677 2024-04-19T03:02:06.323 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.324 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:02:06.324 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.324 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:02:06.324 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.039077+0000", 2024-04-19T03:02:06.324 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:06.324 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.324 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.324 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:02:06.324 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.039077+0000", 2024-04-19T03:02:06.324 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:06.324 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.324 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.324 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:02:06.325 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.039076+0000", 2024-04-19T03:02:06.325 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2024-04-19T03:02:06.325 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.325 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.325 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:02:06.325 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.039158+0000", 2024-04-19T03:02:06.325 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.1310000000000006e-05 2024-04-19T03:02:06.325 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.325 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.325 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:02:06.325 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.039171+0000", 2024-04-19T03:02:06.325 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.3010000000000001e-05 2024-04-19T03:02:06.325 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.325 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.326 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:02:06.326 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.039178+0000", 2024-04-19T03:02:06.326 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.8519999999999998e-06 2024-04-19T03:02:06.326 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.326 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.326 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:06.326 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.048813+0000", 2024-04-19T03:02:06.326 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0096353600000000008 2024-04-19T03:02:06.326 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.326 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.326 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:02:06.326 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.048986+0000", 2024-04-19T03:02:06.326 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000173234 2024-04-19T03:02:06.327 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.327 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.327 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-04-19T03:02:06.329 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.049147+0000", 2024-04-19T03:02:06.329 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00016059000000000001 2024-04-19T03:02:06.329 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.329 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.329 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:02:06.329 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.062805+0000", 2024-04-19T03:02:06.329 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.013658267999999999 2024-04-19T03:02:06.329 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.330 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.330 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:06.330 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.062858+0000", 2024-04-19T03:02:06.330 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.3177999999999998e-05 2024-04-19T03:02:06.330 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.330 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.330 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:02:06.330 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.062903+0000", 2024-04-19T03:02:06.330 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.4336999999999999e-05 2024-04-19T03:02:06.330 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.330 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.330 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:02:06.331 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.062930+0000", 2024-04-19T03:02:06.331 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.7492e-05 2024-04-19T03:02:06.331 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:06.331 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:02:06.331 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:06.331 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.331 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.331 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4755.0:60686 5.5 5:a9caa390:::benchmark_data_smithi096_19531_object60685:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-19T03:02:06.331 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:02:06.044469+0000", 2024-04-19T03:02:06.331 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 0.18321611600000001, 2024-04-19T03:02:06.331 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.021099772999999999, 2024-04-19T03:02:06.331 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:02:06.332 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:06.332 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-04-19T03:02:06.332 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4755", 2024-04-19T03:02:06.332 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:06.332 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 60686 2024-04-19T03:02:06.332 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.332 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:02:06.332 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.332 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:02:06.332 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.044469+0000", 2024-04-19T03:02:06.332 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:06.332 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.332 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.333 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:02:06.333 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.044469+0000", 2024-04-19T03:02:06.333 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:06.333 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.333 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.333 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:02:06.333 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.044467+0000", 2024-04-19T03:02:06.333 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:06.333 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.333 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.333 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:02:06.333 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.044516+0000", 2024-04-19T03:02:06.333 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.9143e-05 2024-04-19T03:02:06.333 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.333 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.334 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:02:06.334 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.044530+0000", 2024-04-19T03:02:06.334 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.3526000000000001e-05 2024-04-19T03:02:06.334 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.334 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.334 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:02:06.334 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.044537+0000", 2024-04-19T03:02:06.334 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.8990000000000004e-06 2024-04-19T03:02:06.334 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.334 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.334 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:06.334 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.054411+0000", 2024-04-19T03:02:06.334 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0098746949999999993 2024-04-19T03:02:06.335 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.335 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.335 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:02:06.335 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.054606+0000", 2024-04-19T03:02:06.335 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00019422100000000001 2024-04-19T03:02:06.335 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.335 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.335 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-04-19T03:02:06.335 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.054848+0000", 2024-04-19T03:02:06.335 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00024189799999999999 2024-04-19T03:02:06.335 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.335 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.335 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:02:06.335 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.063095+0000", 2024-04-19T03:02:06.336 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0082472020000000004 2024-04-19T03:02:06.336 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.336 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.336 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:06.336 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.065481+0000", 2024-04-19T03:02:06.336 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00238623 2024-04-19T03:02:06.336 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.336 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.336 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:02:06.336 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.065532+0000", 2024-04-19T03:02:06.336 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.0509e-05 2024-04-19T03:02:06.336 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.336 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.336 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:02:06.337 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.065568+0000", 2024-04-19T03:02:06.337 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.6876999999999999e-05 2024-04-19T03:02:06.337 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:06.337 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:02:06.337 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:06.337 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.337 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.337 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4755.0:60689 5.5 5:adf8d35d:::benchmark_data_smithi096_19531_object60688:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-19T03:02:06.337 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:02:06.047459+0000", 2024-04-19T03:02:06.337 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 0.180226055, 2024-04-19T03:02:06.337 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.021837532, 2024-04-19T03:02:06.337 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:02:06.337 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:06.337 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-04-19T03:02:06.337 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4755", 2024-04-19T03:02:06.338 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:06.338 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 60689 2024-04-19T03:02:06.338 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.338 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:02:06.338 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.338 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:02:06.338 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.047459+0000", 2024-04-19T03:02:06.338 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:06.338 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.338 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.338 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:02:06.338 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.047459+0000", 2024-04-19T03:02:06.338 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:06.338 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.339 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.339 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:02:06.339 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.047458+0000", 2024-04-19T03:02:06.339 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2024-04-19T03:02:06.339 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.339 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.339 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:02:06.339 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.047527+0000", 2024-04-19T03:02:06.339 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.9114000000000003e-05 2024-04-19T03:02:06.339 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.339 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.339 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:02:06.339 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.047538+0000", 2024-04-19T03:02:06.339 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.094e-05 2024-04-19T03:02:06.340 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.340 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.340 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:02:06.340 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.047542+0000", 2024-04-19T03:02:06.340 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.4689999999999999e-06 2024-04-19T03:02:06.340 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.340 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.340 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:06.340 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.059742+0000", 2024-04-19T03:02:06.340 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.012200103 2024-04-19T03:02:06.340 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.340 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.340 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:02:06.340 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.059904+0000", 2024-04-19T03:02:06.341 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00016191900000000001 2024-04-19T03:02:06.341 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.341 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.341 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-04-19T03:02:06.341 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.060079+0000", 2024-04-19T03:02:06.341 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00017477500000000001 2024-04-19T03:02:06.341 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.341 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.341 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:06.341 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.067922+0000", 2024-04-19T03:02:06.341 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0078434720000000006 2024-04-19T03:02:06.341 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.341 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.341 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:02:06.342 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.069163+0000", 2024-04-19T03:02:06.342 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0012401389999999999 2024-04-19T03:02:06.342 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.342 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.342 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:02:06.342 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.069238+0000", 2024-04-19T03:02:06.342 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.4955000000000003e-05 2024-04-19T03:02:06.342 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.342 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.342 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:02:06.342 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.069296+0000", 2024-04-19T03:02:06.342 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.8726e-05 2024-04-19T03:02:06.342 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:06.342 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:02:06.343 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:06.343 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.343 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.343 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4755.0:60746 5.6 5:68292fbc:::benchmark_data_smithi096_19531_object60745:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-19T03:02:06.343 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:02:06.088145+0000", 2024-04-19T03:02:06.343 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 0.13953995499999999, 2024-04-19T03:02:06.343 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.021267332, 2024-04-19T03:02:06.343 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:02:06.343 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:06.343 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-04-19T03:02:06.343 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4755", 2024-04-19T03:02:06.343 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:06.343 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 60746 2024-04-19T03:02:06.343 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.344 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:02:06.344 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.344 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:02:06.344 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.088145+0000", 2024-04-19T03:02:06.344 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:06.344 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.344 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.344 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:02:06.344 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.088145+0000", 2024-04-19T03:02:06.344 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:06.344 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.344 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.344 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:02:06.345 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.088144+0000", 2024-04-19T03:02:06.345 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2024-04-19T03:02:06.345 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.345 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.345 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:02:06.345 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.088187+0000", 2024-04-19T03:02:06.345 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.337e-05 2024-04-19T03:02:06.345 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.345 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.345 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:02:06.345 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.088199+0000", 2024-04-19T03:02:06.345 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1654999999999999e-05 2024-04-19T03:02:06.345 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.345 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.345 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:02:06.346 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.088205+0000", 2024-04-19T03:02:06.346 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.3840000000000002e-06 2024-04-19T03:02:06.346 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.346 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.346 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:06.346 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.095361+0000", 2024-04-19T03:02:06.346 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0071557799999999996 2024-04-19T03:02:06.346 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.346 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.346 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:02:06.346 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.095490+0000", 2024-04-19T03:02:06.346 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012866700000000001 2024-04-19T03:02:06.346 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.347 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.347 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-04-19T03:02:06.347 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.095629+0000", 2024-04-19T03:02:06.347 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000139529 2024-04-19T03:02:06.347 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.347 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.347 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:02:06.347 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.101867+0000", 2024-04-19T03:02:06.347 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0062376259999999996 2024-04-19T03:02:06.347 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.347 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.347 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:06.347 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.109360+0000", 2024-04-19T03:02:06.347 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0074929799999999998 2024-04-19T03:02:06.347 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.348 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.348 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:02:06.348 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.109389+0000", 2024-04-19T03:02:06.348 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.8759999999999999e-05 2024-04-19T03:02:06.348 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:06.348 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:06.348 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:02:06.348 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.109412+0000", 2024-04-19T03:02:06.348 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.3354999999999999e-05 2024-04-19T03:02:06.348 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:06.348 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:02:06.348 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:06.348 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:06.348 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:02:06.349 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-04-19T03:02:06.350 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T03:02:06.351 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-04-19T03:02:06.346+0000 7f35986ab700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18243) UID: 0 2024-04-19T03:02:06.446 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-19T03:02:06.450 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-04-19T03:02:06.446+0000 7f35986ab700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18243) UID: 0 2024-04-19T03:02:06.475 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-19T03:02:06.475 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-04-19T03:02:06.475 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:06.475 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:61390 5.4 5:2334b5bc:::benchmark_data_smithi096_19531_object61389:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-19T03:02:06.476 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:06.467863+0000", 2024-04-19T03:02:06.476 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0074323150000000001, 2024-04-19T03:02:06.476 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0074618080000000003, 2024-04-19T03:02:06.476 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:06.476 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:02:06.476 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:06.476 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:06.476 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:06.476 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 61390 2024-04-19T03:02:06.476 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:06.476 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:06.476 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:06.476 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:06.477 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:06.467863+0000", 2024-04-19T03:02:06.477 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:06.477 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:06.477 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:06.477 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:06.477 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:06.467863+0000", 2024-04-19T03:02:06.477 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:06.477 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:06.477 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:06.477 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:06.477 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:06.467862+0000", 2024-04-19T03:02:06.477 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:06.478 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:06.478 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:06.478 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:06.478 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:06.467928+0000", 2024-04-19T03:02:06.478 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5779999999999997e-05 2024-04-19T03:02:06.478 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:06.478 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:06.478 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:06.478 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:06.467942+0000", 2024-04-19T03:02:06.478 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4008999999999999e-05 2024-04-19T03:02:06.478 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:06.478 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:06.478 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:06.479 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:06.467949+0000", 2024-04-19T03:02:06.479 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.0779999999999998e-06 2024-04-19T03:02:06.479 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:06.479 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:06.479 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:06.479 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:06.467995+0000", 2024-04-19T03:02:06.479 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6363999999999999e-05 2024-04-19T03:02:06.479 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:06.479 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:06.479 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:06.479 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:06.468113+0000", 2024-04-19T03:02:06.479 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000117823 2024-04-19T03:02:06.480 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:06.480 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:06.480 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:06.480 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:06.468221+0000", 2024-04-19T03:02:06.480 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000108297 2024-04-19T03:02:06.480 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:06.480 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:06.480 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:06.480 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:06.472734+0000", 2024-04-19T03:02:06.480 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0045126350000000001 2024-04-19T03:02:06.480 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:06.480 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:06.480 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:06.480 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:06.481 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:06.481 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:61392 5.4 5:23c55743:::benchmark_data_smithi096_19531_object61391:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-19T03:02:06.481 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:06.467967+0000", 2024-04-19T03:02:06.481 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0073284159999999999, 2024-04-19T03:02:06.481 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0074280869999999999, 2024-04-19T03:02:06.481 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:06.481 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:02:06.481 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:06.481 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:06.481 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:06.481 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 61392 2024-04-19T03:02:06.481 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:06.481 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:06.482 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:06.482 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:06.482 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:06.467967+0000", 2024-04-19T03:02:06.482 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:06.482 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:06.482 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:06.482 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:06.482 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:06.467967+0000", 2024-04-19T03:02:06.482 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:06.482 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:06.482 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:06.482 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:06.482 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:06.467967+0000", 2024-04-19T03:02:06.483 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:06.483 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:06.483 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:06.483 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:06.483 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:06.468003+0000", 2024-04-19T03:02:06.483 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6047999999999998e-05 2024-04-19T03:02:06.483 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:06.483 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:06.483 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:06.483 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:06.468010+0000", 2024-04-19T03:02:06.483 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5560000000000002e-06 2024-04-19T03:02:06.483 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:06.483 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:06.484 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:06.484 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:06.468016+0000", 2024-04-19T03:02:06.484 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2530000000000004e-06 2024-04-19T03:02:06.484 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:06.484 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:06.484 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:06.484 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:06.470512+0000", 2024-04-19T03:02:06.484 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0024963870000000001 2024-04-19T03:02:06.484 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:06.484 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:06.484 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:06.484 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:06.470654+0000", 2024-04-19T03:02:06.485 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014225199999999999 2024-04-19T03:02:06.485 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:06.485 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:06.485 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:06.485 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:06.470737+0000", 2024-04-19T03:02:06.485 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3016999999999995e-05 2024-04-19T03:02:06.485 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:06.485 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:06.485 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:06.485 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:06.474801+0000", 2024-04-19T03:02:06.485 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0040643119999999996 2024-04-19T03:02:06.485 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:06.485 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:06.486 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:06.486 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:06.486 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:06.486 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:61394 5.0 5:0d0eb9c7:::benchmark_data_smithi096_19531_object61393:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-19T03:02:06.486 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:06.469794+0000", 2024-04-19T03:02:06.486 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0055014690000000002, 2024-04-19T03:02:06.486 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0056524009999999996, 2024-04-19T03:02:06.486 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:06.486 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:02:06.486 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:06.486 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:06.486 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:06.486 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 61394 2024-04-19T03:02:06.486 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:06.487 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:06.487 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:06.487 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:06.487 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:06.469794+0000", 2024-04-19T03:02:06.487 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:06.487 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:06.487 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:06.487 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:06.487 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:06.469794+0000", 2024-04-19T03:02:06.487 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:06.487 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:06.487 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:06.487 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:06.488 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:06.469793+0000", 2024-04-19T03:02:06.488 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:06.488 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:06.488 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:06.488 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:06.488 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:06.469850+0000", 2024-04-19T03:02:06.488 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7385e-05 2024-04-19T03:02:06.488 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:06.488 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:06.488 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:06.488 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:06.469866+0000", 2024-04-19T03:02:06.488 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5182e-05 2024-04-19T03:02:06.488 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:06.488 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:06.489 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:06.489 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:06.469875+0000", 2024-04-19T03:02:06.489 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9679999999999995e-06 2024-04-19T03:02:06.489 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:06.489 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:06.489 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:06.489 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:06.469907+0000", 2024-04-19T03:02:06.489 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2855000000000003e-05 2024-04-19T03:02:06.489 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:06.489 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:06.489 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:06.489 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:06.470015+0000", 2024-04-19T03:02:06.490 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000107983 2024-04-19T03:02:06.490 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:06.490 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:06.490 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:06.490 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:06.470093+0000", 2024-04-19T03:02:06.490 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.7435999999999995e-05 2024-04-19T03:02:06.490 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:06.490 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:06.490 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:06.490 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:06.472929+0000", 2024-04-19T03:02:06.490 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0028364100000000001 2024-04-19T03:02:06.490 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:06.490 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:06.491 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:06.491 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:06.491 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:06.491 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:61395 5.8 5:1b7c4c4a:::benchmark_data_smithi096_19531_object61394:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-19T03:02:06.491 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:06.470114+0000", 2024-04-19T03:02:06.491 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0051819070000000004, 2024-04-19T03:02:06.491 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0053826070000000002, 2024-04-19T03:02:06.491 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:06.491 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:02:06.491 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:06.491 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:06.491 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:06.491 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 61395 2024-04-19T03:02:06.492 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:06.492 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:06.492 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:06.492 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:06.492 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:06.470114+0000", 2024-04-19T03:02:06.492 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:06.492 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:06.492 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:06.492 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:06.492 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:06.470114+0000", 2024-04-19T03:02:06.492 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:06.492 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:06.492 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:06.493 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:06.493 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:06.470113+0000", 2024-04-19T03:02:06.493 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:06.493 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:06.493 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:06.493 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:06.493 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:06.470208+0000", 2024-04-19T03:02:06.493 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.4863000000000003e-05 2024-04-19T03:02:06.493 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:06.493 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:06.493 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:06.493 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:06.470217+0000", 2024-04-19T03:02:06.493 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.7630000000000006e-06 2024-04-19T03:02:06.493 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:06.494 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:06.494 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:06.494 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:06.470221+0000", 2024-04-19T03:02:06.494 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1239999999999998e-06 2024-04-19T03:02:06.494 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:06.494 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:06.494 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:06.494 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:06.470267+0000", 2024-04-19T03:02:06.494 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6214999999999997e-05 2024-04-19T03:02:06.494 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:06.494 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:06.494 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:06.494 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:06.470456+0000", 2024-04-19T03:02:06.495 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000189426 2024-04-19T03:02:06.495 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:06.495 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:06.495 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:06.495 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:06.470576+0000", 2024-04-19T03:02:06.495 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011915 2024-04-19T03:02:06.495 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:06.495 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:06.495 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:06.495 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:06.495 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:06.495 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:61398 5.4 5:268409aa:::benchmark_data_smithi096_19531_object61397:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-19T03:02:06.495 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:06.471513+0000", 2024-04-19T03:02:06.495 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0037824220000000001, 2024-04-19T03:02:06.496 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0040274559999999996, 2024-04-19T03:02:06.496 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:06.496 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:02:06.496 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:06.496 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:06.496 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:06.496 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 61398 2024-04-19T03:02:06.496 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:06.496 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:06.496 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:06.496 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:06.496 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:06.471513+0000", 2024-04-19T03:02:06.496 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:06.497 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:06.497 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:06.497 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:06.497 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:06.471513+0000", 2024-04-19T03:02:06.497 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:06.497 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:06.497 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:06.497 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:06.497 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:06.471512+0000", 2024-04-19T03:02:06.497 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:06.497 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:06.497 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:06.498 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:06.498 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:06.471591+0000", 2024-04-19T03:02:06.498 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.9357999999999995e-05 2024-04-19T03:02:06.498 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:06.498 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:06.498 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:06.498 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:06.471607+0000", 2024-04-19T03:02:06.498 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5818e-05 2024-04-19T03:02:06.498 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:06.498 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:06.498 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:06.498 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:06.471616+0000", 2024-04-19T03:02:06.498 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.8089999999999999e-06 2024-04-19T03:02:06.498 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:06.499 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:06.499 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:06.499 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:06.472763+0000", 2024-04-19T03:02:06.499 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0011468089999999999 2024-04-19T03:02:06.499 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:06.499 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:06.499 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:06.499 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:06.472947+0000", 2024-04-19T03:02:06.499 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00018396499999999999 2024-04-19T03:02:06.499 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:06.499 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:06.499 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:06.499 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:06.473034+0000", 2024-04-19T03:02:06.499 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.6779000000000004e-05 2024-04-19T03:02:06.500 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:06.500 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:06.500 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:06.500 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:06.475225+0000", 2024-04-19T03:02:06.500 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.002191007 2024-04-19T03:02:06.500 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:06.500 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:06.500 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:06.500 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:06.500 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:06.500 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:61399 5.b 5:d2e44df7:::benchmark_data_smithi096_19531_object61398:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-19T03:02:06.500 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:06.471978+0000", 2024-04-19T03:02:06.500 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0033176360000000001, 2024-04-19T03:02:06.501 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0036121450000000002, 2024-04-19T03:02:06.501 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:06.501 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:02:06.501 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:06.501 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:06.501 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:06.501 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 61399 2024-04-19T03:02:06.501 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:06.501 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:06.501 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:06.501 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:06.501 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:06.471978+0000", 2024-04-19T03:02:06.501 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:06.502 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:06.502 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:06.502 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:06.502 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:06.471978+0000", 2024-04-19T03:02:06.502 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:06.502 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:06.502 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:06.502 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:06.502 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:06.471977+0000", 2024-04-19T03:02:06.502 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:06.502 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:06.502 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:06.502 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:06.503 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:06.472066+0000", 2024-04-19T03:02:06.503 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.8551e-05 2024-04-19T03:02:06.503 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:06.503 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:06.503 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:06.503 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:06.472076+0000", 2024-04-19T03:02:06.503 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0679999999999999e-05 2024-04-19T03:02:06.503 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:06.503 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:06.503 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:06.503 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:06.472085+0000", 2024-04-19T03:02:06.503 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1359999999999997e-06 2024-04-19T03:02:06.503 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:06.504 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:06.504 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:06.504 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:06.472157+0000", 2024-04-19T03:02:06.504 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.1975000000000001e-05 2024-04-19T03:02:06.504 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:06.504 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:06.504 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:06.504 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:06.472309+0000", 2024-04-19T03:02:06.504 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015206900000000001 2024-04-19T03:02:06.504 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:06.504 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:06.504 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:06.505 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:06.472444+0000", 2024-04-19T03:02:06.505 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000135702 2024-04-19T03:02:06.505 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:06.505 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:06.505 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:06.505 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:06.505 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:06.505 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:61401 5.8 5:16d51035:::benchmark_data_smithi096_19531_object61400:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-19T03:02:06.505 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:06.473408+0000", 2024-04-19T03:02:06.505 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.001887335, 2024-04-19T03:02:06.505 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0022286229999999999, 2024-04-19T03:02:06.505 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:06.506 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:02:06.506 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:06.506 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:06.506 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:06.506 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 61401 2024-04-19T03:02:06.506 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:06.506 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:06.506 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:06.506 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:06.506 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:06.473408+0000", 2024-04-19T03:02:06.506 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:06.507 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:06.507 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:06.507 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:06.507 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:06.473408+0000", 2024-04-19T03:02:06.507 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:06.507 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:06.507 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:06.507 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:06.507 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:06.473407+0000", 2024-04-19T03:02:06.507 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:06.507 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:06.507 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:06.507 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:06.508 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:06.473508+0000", 2024-04-19T03:02:06.508 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010119999999999999 2024-04-19T03:02:06.508 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:06.508 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:06.508 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:06.508 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:06.473519+0000", 2024-04-19T03:02:06.508 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1025e-05 2024-04-19T03:02:06.508 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:06.508 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:06.508 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:06.508 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:06.473526+0000", 2024-04-19T03:02:06.508 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.618e-06 2024-04-19T03:02:06.509 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:06.509 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:06.509 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:06.509 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:06.473570+0000", 2024-04-19T03:02:06.509 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3747e-05 2024-04-19T03:02:06.509 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:06.509 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:06.509 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:06.509 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:06.473707+0000", 2024-04-19T03:02:06.509 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013715400000000001 2024-04-19T03:02:06.509 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:06.509 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:06.509 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:06.510 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:06.473867+0000", 2024-04-19T03:02:06.510 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015976599999999999 2024-04-19T03:02:06.510 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:06.510 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:06.510 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:06.510 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:06.510 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-04-19T03:02:06.510 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 7 2024-04-19T03:02:06.510 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-19T03:02:06.511 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T03:02:06.553 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:06.552+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:06.609 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0: {} 2024-04-19T03:02:06.632 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1: {} 2024-04-19T03:02:06.643 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-19T03:02:06.643 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:02:06.652 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2: {} 2024-04-19T03:02:06.653 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:06.649+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:06.655 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T03:02:06.656 INFO:teuthology.orchestra.run.smithi096.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T03:02:06.656 INFO:teuthology.orchestra.run.smithi096.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-19T03:02:06.656 INFO:teuthology.orchestra.run.smithi096.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-19T03:02:06.754 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-04-19T03:02:06.750+0000 7f35986ab700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18243) UID: 0 2024-04-19T03:02:06.780 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-19T03:02:06.780 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:02:06.792 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T03:02:06.822 INFO:tasks.radosbench.radosbench.0.smithi096.stdout: 29 16 62003 61987 133.578 105.562 0.00869558 0.00747963 2024-04-19T03:02:06.855 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:06.853+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:06.923 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-04-19T03:02:06.923 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:02:06.933 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T03:02:06.955 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:06.952+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:07.056 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-04-19T03:02:07.054+0000 7f35986ab700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18243) UID: 0 2024-04-19T03:02:07.057 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-04-19T03:02:07.057 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:02:07.069 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T03:02:07.157 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:07.156+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:07.194 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-04-19T03:02:07.194 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:02:07.206 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T03:02:07.258 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-04-19T03:02:07.254+0000 7f35986ab700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18243) UID: 0 2024-04-19T03:02:07.341 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-04-19T03:02:07.341 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:02:07.357 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T03:02:07.360 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:07.357+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:07.460 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:07.457+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:07.485 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-04-19T03:02:07.485 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:02:07.497 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T03:02:07.562 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-04-19T03:02:07.558+0000 7f35986ab700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18243) UID: 0 2024-04-19T03:02:07.634 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-04-19T03:02:07.634 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:02:07.647 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T03:02:07.662 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:07.661+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:07.763 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:07.761+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:07.779 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-19T03:02:07.779 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:02:07.793 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T03:02:07.822 INFO:tasks.radosbench.radosbench.0.smithi096.stdout: 30 16 63666 63650 132.589 103.938 0.00535991 0.00753651 2024-04-19T03:02:07.865 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:07.861+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:07.915 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-19T03:02:07.915 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:02:07.927 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T03:02:07.965 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-04-19T03:02:07.962+0000 7f35986ab700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18243) UID: 0 2024-04-19T03:02:08.053 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-19T03:02:08.053 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:02:08.064 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T03:02:08.066 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:08.061+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:08.166 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:08.165+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:08.174 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-19T03:02:08.193 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-04-19T03:02:08.193 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:02:08.205 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T03:02:08.267 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-04-19T03:02:08.266+0000 7f35986ab700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18243) UID: 0 2024-04-19T03:02:08.288 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-04-19T03:02:08.288 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-19T03:02:08.288 INFO:tasks.thrashosds.thrasher:inject_pause on osd.0 2024-04-19T03:02:08.289 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-04-19T03:02:08.289 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-04-19T03:02:08.289 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok config set filestore_inject_stall 3 2024-04-19T03:02:08.324 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-04-19T03:02:08.324 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:02:08.337 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T03:02:08.369 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-04-19T03:02:08.366+0000 7f35986ab700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18243) UID: 0 2024-04-19T03:02:08.425 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-04-19T03:02:08.425 INFO:teuthology.orchestra.run.smithi097.stdout: "success": "" 2024-04-19T03:02:08.425 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-04-19T03:02:08.465 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-04-19T03:02:08.465 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:02:08.469 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:08.465+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:08.478 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T03:02:08.570 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-04-19T03:02:08.566+0000 7f35986ab700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18243) UID: 0 2024-04-19T03:02:08.620 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-04-19T03:02:08.620 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:02:08.634 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T03:02:08.667 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-19T03:02:08.670 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:08.669+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:08.771 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-04-19T03:02:08.770+0000 7f35986ab700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18243) UID: 0 2024-04-19T03:02:08.806 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-04-19T03:02:08.806 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:02:08.818 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T03:02:08.822 INFO:tasks.radosbench.radosbench.0.smithi096.stdout: 31 16 65345 65329 131.697 104.938 0.00694631 0.00758692 2024-04-19T03:02:08.826 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0: {} 2024-04-19T03:02:08.850 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1: {} 2024-04-19T03:02:08.869 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2: {} 2024-04-19T03:02:08.872 INFO:teuthology.orchestra.run.smithi096.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T03:02:08.872 INFO:teuthology.orchestra.run.smithi096.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-19T03:02:08.872 INFO:teuthology.orchestra.run.smithi096.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-19T03:02:08.872 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:08.869+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:08.952 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-04-19T03:02:08.952 INFO:teuthology.orchestra.run.smithi097.stdout: "size": 20, 2024-04-19T03:02:08.952 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 600, 2024-04-19T03:02:08.952 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [ 2024-04-19T03:02:08.952 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:08.952 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(mds.0.3:14 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:02:08.952 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:14.997079+0000", 2024-04-19T03:02:08.952 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 53.951887335999999, 2024-04-19T03:02:08.953 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.021951970000000001, 2024-04-19T03:02:08.953 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:02:08.953 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:08.953 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:02:08.953 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:08.953 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:02:08.953 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997079+0000", 2024-04-19T03:02:08.953 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:08.953 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:08.953 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:08.953 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:02:08.953 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997079+0000", 2024-04-19T03:02:08.953 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:08.954 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:08.954 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:08.954 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:02:08.954 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997077+0000", 2024-04-19T03:02:08.954 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:08.954 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:08.954 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:08.954 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:02:08.954 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997087+0000", 2024-04-19T03:02:08.954 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.006e-05 2024-04-19T03:02:08.954 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:08.954 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:08.954 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:02:08.955 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997105+0000", 2024-04-19T03:02:08.955 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.8026999999999999e-05 2024-04-19T03:02:08.955 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:08.955 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:08.955 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:02:08.955 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997135+0000", 2024-04-19T03:02:08.955 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.9643000000000001e-05 2024-04-19T03:02:08.955 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:08.955 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:08.955 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:08.955 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997208+0000", 2024-04-19T03:02:08.955 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.3419999999999998e-05 2024-04-19T03:02:08.955 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:08.955 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:08.956 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op must wait for map", 2024-04-19T03:02:08.956 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997244+0000", 2024-04-19T03:02:08.956 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.5367000000000002e-05 2024-04-19T03:02:08.956 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:08.956 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:08.956 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:08.956 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.007357+0000", 2024-04-19T03:02:08.956 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.010112703000000001 2024-04-19T03:02:08.956 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:08.956 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:08.956 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:02:08.956 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.007479+0000", 2024-04-19T03:02:08.956 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012279599999999999 2024-04-19T03:02:08.956 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:08.957 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:08.957 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 1", 2024-04-19T03:02:08.957 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.007610+0000", 2024-04-19T03:02:08.957 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00013093499999999999 2024-04-19T03:02:08.957 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:08.957 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:08.957 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:02:08.957 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.012526+0000", 2024-04-19T03:02:08.957 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0049157519999999998 2024-04-19T03:02:08.957 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:08.957 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:08.957 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:08.957 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.018959+0000", 2024-04-19T03:02:08.958 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0064326009999999996 2024-04-19T03:02:08.958 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:08.958 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:08.958 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:02:08.958 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.019005+0000", 2024-04-19T03:02:08.958 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.6066999999999998e-05 2024-04-19T03:02:08.958 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:08.958 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:08.958 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:02:08.958 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.019031+0000", 2024-04-19T03:02:08.958 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.6009000000000001e-05 2024-04-19T03:02:08.958 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:08.958 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:02:08.959 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:08.959 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:08.959 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:08.959 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:02:08.959 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:14.997149+0000", 2024-04-19T03:02:08.959 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 53.951816716000003, 2024-04-19T03:02:08.959 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.021805590999999999, 2024-04-19T03:02:08.959 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:02:08.959 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:08.959 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:02:08.959 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:08.959 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:02:08.959 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997149+0000", 2024-04-19T03:02:08.959 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:08.960 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:08.960 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:08.960 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:02:08.960 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997149+0000", 2024-04-19T03:02:08.960 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:08.960 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:08.960 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:08.960 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:02:08.960 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997148+0000", 2024-04-19T03:02:08.961 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2024-04-19T03:02:08.961 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:08.961 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:08.961 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:02:08.961 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997166+0000", 2024-04-19T03:02:08.962 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.8233e-05 2024-04-19T03:02:08.962 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:08.962 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:08.962 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:02:08.962 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997182+0000", 2024-04-19T03:02:08.962 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5999999999999999e-05 2024-04-19T03:02:08.962 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:08.962 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:08.962 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:02:08.962 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997195+0000", 2024-04-19T03:02:08.963 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.252e-05 2024-04-19T03:02:08.963 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:08.963 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:08.963 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:08.963 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997348+0000", 2024-04-19T03:02:08.963 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000153115 2024-04-19T03:02:08.963 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:08.963 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:08.963 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:02:08.963 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997354+0000", 2024-04-19T03:02:08.963 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.9359999999999996e-06 2024-04-19T03:02:08.963 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:08.963 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:08.963 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:08.964 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.008147+0000", 2024-04-19T03:02:08.964 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.010793127 2024-04-19T03:02:08.965 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:08.965 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:08.965 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:02:08.965 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.008225+0000", 2024-04-19T03:02:08.965 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.7935999999999994e-05 2024-04-19T03:02:08.965 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:08.965 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:08.965 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-04-19T03:02:08.965 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.008377+0000", 2024-04-19T03:02:08.965 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00015159099999999999 2024-04-19T03:02:08.966 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:08.966 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:08.966 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:02:08.966 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.012629+0000", 2024-04-19T03:02:08.966 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0042520420000000001 2024-04-19T03:02:08.966 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:08.966 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:08.966 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:08.966 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.018871+0000", 2024-04-19T03:02:08.966 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0062425060000000001 2024-04-19T03:02:08.966 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:08.966 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:08.966 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:02:08.967 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.018910+0000", 2024-04-19T03:02:08.967 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.8482999999999997e-05 2024-04-19T03:02:08.967 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:08.967 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:08.967 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:02:08.967 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.018955+0000", 2024-04-19T03:02:08.967 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.5252e-05 2024-04-19T03:02:08.967 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:08.967 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:02:08.967 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:08.967 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:08.967 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:08.967 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(mds.0.3:36 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:02:08.967 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:14.997207+0000", 2024-04-19T03:02:08.968 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 53.951759166000002, 2024-04-19T03:02:08.968 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.022210431999999999, 2024-04-19T03:02:08.968 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:02:08.968 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:08.968 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:02:08.968 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:08.968 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:02:08.968 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997207+0000", 2024-04-19T03:02:08.968 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:08.968 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:08.968 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:08.968 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:02:08.968 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997207+0000", 2024-04-19T03:02:08.969 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:08.969 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:08.969 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:08.969 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:02:08.969 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997206+0000", 2024-04-19T03:02:08.969 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2024-04-19T03:02:08.969 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:08.969 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:08.969 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:02:08.969 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997218+0000", 2024-04-19T03:02:08.969 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2607e-05 2024-04-19T03:02:08.969 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:08.969 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:08.969 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:02:08.970 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997234+0000", 2024-04-19T03:02:08.970 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5583999999999999e-05 2024-04-19T03:02:08.970 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:08.970 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:08.970 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:02:08.970 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997248+0000", 2024-04-19T03:02:08.970 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4270000000000001e-05 2024-04-19T03:02:08.970 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:08.970 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:08.970 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:08.970 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997397+0000", 2024-04-19T03:02:08.970 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0001482 2024-04-19T03:02:08.970 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:08.971 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:08.971 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:02:08.971 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997407+0000", 2024-04-19T03:02:08.971 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0944000000000001e-05 2024-04-19T03:02:08.971 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:08.971 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:08.971 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:08.971 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.008173+0000", 2024-04-19T03:02:08.971 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.010765378000000001 2024-04-19T03:02:08.971 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:08.971 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:08.971 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:02:08.971 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.008278+0000", 2024-04-19T03:02:08.971 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00010538 2024-04-19T03:02:08.972 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:08.972 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:08.972 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 1", 2024-04-19T03:02:08.972 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.008423+0000", 2024-04-19T03:02:08.972 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014525599999999999 2024-04-19T03:02:08.972 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:08.972 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:08.972 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:02:08.972 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.012734+0000", 2024-04-19T03:02:08.972 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0043108590000000002 2024-04-19T03:02:08.972 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:08.972 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:08.972 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:08.972 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.019318+0000", 2024-04-19T03:02:08.973 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0065836130000000003 2024-04-19T03:02:08.973 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:08.973 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:08.973 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:02:08.973 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.019382+0000", 2024-04-19T03:02:08.973 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.3925999999999997e-05 2024-04-19T03:02:08.973 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:08.973 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:08.973 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:02:08.973 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.019417+0000", 2024-04-19T03:02:08.973 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.5454999999999999e-05 2024-04-19T03:02:08.973 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:08.973 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:02:08.973 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:08.974 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:08.974 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:08.974 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(mds.0.3:15 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:02:08.974 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:14.997260+0000", 2024-04-19T03:02:08.974 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 53.951706014999999, 2024-04-19T03:02:08.974 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.021842842000000001, 2024-04-19T03:02:08.974 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:02:08.974 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:08.974 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:02:08.974 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:08.974 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:02:08.974 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997260+0000", 2024-04-19T03:02:08.974 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:08.974 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:08.975 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:08.975 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:02:08.975 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997260+0000", 2024-04-19T03:02:08.975 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:08.975 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:08.975 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:08.975 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:02:08.975 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997259+0000", 2024-04-19T03:02:08.976 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:08.976 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:08.976 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:08.976 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:02:08.976 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997270+0000", 2024-04-19T03:02:08.976 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0312999999999999e-05 2024-04-19T03:02:08.976 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:08.976 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:08.976 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:02:08.976 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997279+0000", 2024-04-19T03:02:08.976 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.7770000000000008e-06 2024-04-19T03:02:08.976 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:08.976 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:08.976 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:02:08.977 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997286+0000", 2024-04-19T03:02:08.977 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.0129999999999996e-06 2024-04-19T03:02:08.977 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:08.977 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:08.977 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:08.977 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997433+0000", 2024-04-19T03:02:08.977 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014774699999999999 2024-04-19T03:02:08.977 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:08.977 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:08.977 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:02:08.977 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997443+0000", 2024-04-19T03:02:08.977 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.414e-06 2024-04-19T03:02:08.977 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:08.978 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:08.978 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:08.978 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.008673+0000", 2024-04-19T03:02:08.978 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.011230789999999999 2024-04-19T03:02:08.978 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:08.978 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:08.978 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:02:08.978 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.008808+0000", 2024-04-19T03:02:08.978 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000134346 2024-04-19T03:02:08.978 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:08.978 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:08.978 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-04-19T03:02:08.978 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.008922+0000", 2024-04-19T03:02:08.979 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000114444 2024-04-19T03:02:08.979 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:08.979 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:08.979 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:02:08.979 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.013442+0000", 2024-04-19T03:02:08.979 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0045193439999999998 2024-04-19T03:02:08.979 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:08.979 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:08.979 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:08.979 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.019005+0000", 2024-04-19T03:02:08.979 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00556333 2024-04-19T03:02:08.979 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:08.979 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:08.979 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:02:08.980 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.019049+0000", 2024-04-19T03:02:08.980 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.4240000000000003e-05 2024-04-19T03:02:08.980 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:08.980 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:08.980 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:02:08.980 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.019103+0000", 2024-04-19T03:02:08.980 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.3706999999999999e-05 2024-04-19T03:02:08.980 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:08.980 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:02:08.980 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:08.981 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:08.981 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:08.981 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(mds.0.3:23 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:02:08.981 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:14.997449+0000", 2024-04-19T03:02:08.981 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 53.951516967000003, 2024-04-19T03:02:08.981 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.022679250000000001, 2024-04-19T03:02:08.981 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:02:08.981 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "started", 2024-04-19T03:02:08.981 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:02:08.981 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:08.981 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:02:08.981 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997449+0000", 2024-04-19T03:02:08.981 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:08.981 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:08.982 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:08.982 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:02:08.982 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997449+0000", 2024-04-19T03:02:08.982 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:08.982 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:08.982 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:08.982 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:02:08.982 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997448+0000", 2024-04-19T03:02:08.982 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:08.982 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:08.982 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:08.982 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:02:08.982 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997452+0000", 2024-04-19T03:02:08.983 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.0369999999999996e-06 2024-04-19T03:02:08.983 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:08.983 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:08.983 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:02:08.983 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997461+0000", 2024-04-19T03:02:08.983 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.6100000000000006e-06 2024-04-19T03:02:08.983 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:08.983 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:08.983 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:02:08.983 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997468+0000", 2024-04-19T03:02:08.983 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.8360000000000003e-06 2024-04-19T03:02:08.983 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:08.983 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:08.984 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:08.984 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997546+0000", 2024-04-19T03:02:08.984 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.7956999999999999e-05 2024-04-19T03:02:08.984 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:08.984 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:08.984 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:02:08.984 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997555+0000", 2024-04-19T03:02:08.984 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.2269999999999999e-06 2024-04-19T03:02:08.984 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:08.984 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:08.984 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:08.984 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.010065+0000", 2024-04-19T03:02:08.984 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.012509457999999999 2024-04-19T03:02:08.985 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:08.985 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:08.985 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:02:08.985 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.010187+0000", 2024-04-19T03:02:08.985 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000122059 2024-04-19T03:02:08.985 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:08.985 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:08.985 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:02:08.986 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.020128+0000", 2024-04-19T03:02:08.986 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0099417529999999994 2024-04-19T03:02:08.986 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:08.986 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:02:08.986 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:08.986 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:08.986 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:08.986 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(mds.0.3:25 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:02:08.986 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:14.997485+0000", 2024-04-19T03:02:08.986 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 53.951481501000004, 2024-04-19T03:02:08.986 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.021633427, 2024-04-19T03:02:08.986 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:02:08.987 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "started", 2024-04-19T03:02:08.987 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:02:08.987 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:08.987 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:02:08.987 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997485+0000", 2024-04-19T03:02:08.987 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:08.987 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:08.987 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:08.987 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:02:08.987 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997485+0000", 2024-04-19T03:02:08.987 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:08.987 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:08.987 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:08.988 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:02:08.988 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997484+0000", 2024-04-19T03:02:08.988 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2024-04-19T03:02:08.988 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:08.988 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:08.988 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:02:08.988 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997490+0000", 2024-04-19T03:02:08.988 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.857e-06 2024-04-19T03:02:08.988 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:08.988 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:08.988 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:02:08.988 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997505+0000", 2024-04-19T03:02:08.988 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.518e-05 2024-04-19T03:02:08.988 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:08.988 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:08.989 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:02:08.989 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997520+0000", 2024-04-19T03:02:08.989 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5026e-05 2024-04-19T03:02:08.989 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:08.989 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:08.989 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:08.989 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997607+0000", 2024-04-19T03:02:08.989 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.7107000000000005e-05 2024-04-19T03:02:08.989 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:08.989 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:08.989 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op must wait for map", 2024-04-19T03:02:08.989 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997614+0000", 2024-04-19T03:02:08.990 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.0539999999999997e-06 2024-04-19T03:02:08.990 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:08.990 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:08.990 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:08.990 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.009808+0000", 2024-04-19T03:02:08.990 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.012194371000000001 2024-04-19T03:02:08.990 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:08.990 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:08.990 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:02:08.990 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.010107+0000", 2024-04-19T03:02:08.990 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000298731 2024-04-19T03:02:08.990 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:08.990 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:08.991 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:02:08.991 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.019118+0000", 2024-04-19T03:02:08.991 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0090109839999999997 2024-04-19T03:02:08.991 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:08.991 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:02:08.991 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:08.991 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:08.991 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:08.991 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4755.0:11277 5.c 5:38c3ceb2:::benchmark_data_smithi096_19531_object11276:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T03:02:08.991 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:42.059676+0000", 2024-04-19T03:02:08.991 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 26.889289879, 2024-04-19T03:02:08.991 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.029909680000000001, 2024-04-19T03:02:08.991 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:02:08.991 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:08.992 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-04-19T03:02:08.992 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4755", 2024-04-19T03:02:08.992 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:08.992 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 11277 2024-04-19T03:02:08.992 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:08.992 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:02:08.992 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:08.992 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:02:08.992 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.059676+0000", 2024-04-19T03:02:08.992 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:08.992 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:08.992 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:08.992 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:02:08.993 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.059676+0000", 2024-04-19T03:02:08.993 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:08.993 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:08.993 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:08.993 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:02:08.993 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.059665+0000", 2024-04-19T03:02:08.993 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999886 2024-04-19T03:02:08.993 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:08.993 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:08.993 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:02:08.993 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.059777+0000", 2024-04-19T03:02:08.993 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000111953 2024-04-19T03:02:08.993 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:08.993 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:08.994 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:02:08.994 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.059789+0000", 2024-04-19T03:02:08.994 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1809e-05 2024-04-19T03:02:08.994 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:08.994 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:08.994 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:02:08.994 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.059797+0000", 2024-04-19T03:02:08.994 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.2090000000000005e-06 2024-04-19T03:02:08.994 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:08.994 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:08.994 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:08.994 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.060528+0000", 2024-04-19T03:02:08.994 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00073144499999999995 2024-04-19T03:02:08.995 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:08.995 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:08.995 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:02:08.995 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.060662+0000", 2024-04-19T03:02:08.995 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000133435 2024-04-19T03:02:08.995 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:08.995 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:08.995 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-04-19T03:02:08.995 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.060766+0000", 2024-04-19T03:02:08.995 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00010473500000000001 2024-04-19T03:02:08.995 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:08.995 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:08.995 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:02:08.996 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.067649+0000", 2024-04-19T03:02:08.996 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.006882684 2024-04-19T03:02:08.996 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:08.996 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:08.996 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:08.996 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.089475+0000", 2024-04-19T03:02:08.996 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.021826196999999999 2024-04-19T03:02:08.996 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:08.996 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:08.996 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:02:08.996 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.089535+0000", 2024-04-19T03:02:08.996 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.9239e-05 2024-04-19T03:02:08.996 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:08.996 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:08.997 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:02:08.997 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.089586+0000", 2024-04-19T03:02:08.997 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.1288000000000001e-05 2024-04-19T03:02:08.997 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:08.997 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:02:08.997 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:08.997 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:08.997 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:08.997 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4755.0:11280 5.6 5:6e34f5e7:::benchmark_data_smithi096_19531_object11279:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T03:02:08.997 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:42.060002+0000", 2024-04-19T03:02:08.997 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 26.888964503, 2024-04-19T03:02:08.997 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.028171841999999999, 2024-04-19T03:02:08.997 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:02:08.997 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:08.997 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-04-19T03:02:08.998 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4755", 2024-04-19T03:02:08.998 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:08.998 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 11280 2024-04-19T03:02:08.998 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:08.998 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:02:08.998 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:08.998 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:02:08.998 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.060002+0000", 2024-04-19T03:02:08.998 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:08.998 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:08.998 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:08.998 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:02:08.999 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.060002+0000", 2024-04-19T03:02:08.999 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:08.999 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:08.999 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:08.999 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:02:08.999 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.060000+0000", 2024-04-19T03:02:08.999 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2024-04-19T03:02:08.999 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:08.999 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:08.999 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:02:08.999 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.060120+0000", 2024-04-19T03:02:08.999 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00011941400000000001 2024-04-19T03:02:08.999 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:09.000 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:09.000 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:02:09.000 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.060132+0000", 2024-04-19T03:02:09.000 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2197e-05 2024-04-19T03:02:09.000 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:09.000 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:09.000 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:02:09.000 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.060141+0000", 2024-04-19T03:02:09.000 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.6829999999999997e-06 2024-04-19T03:02:09.000 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:09.000 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:09.000 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:09.000 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.060194+0000", 2024-04-19T03:02:09.001 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.3395e-05 2024-04-19T03:02:09.001 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:09.001 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:09.001 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:02:09.001 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.060333+0000", 2024-04-19T03:02:09.001 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00013935799999999999 2024-04-19T03:02:09.001 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:09.001 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:09.001 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-04-19T03:02:09.001 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.060477+0000", 2024-04-19T03:02:09.001 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000143938 2024-04-19T03:02:09.001 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:09.001 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:09.001 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:02:09.002 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.067752+0000", 2024-04-19T03:02:09.002 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0072741580000000002 2024-04-19T03:02:09.002 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:09.002 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:09.002 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:09.002 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.088041+0000", 2024-04-19T03:02:09.002 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.020288955000000001 2024-04-19T03:02:09.002 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:09.002 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:09.002 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:02:09.002 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.088113+0000", 2024-04-19T03:02:09.002 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.2492999999999999e-05 2024-04-19T03:02:09.002 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:09.002 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:09.003 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:02:09.003 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.088173+0000", 2024-04-19T03:02:09.003 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.0418999999999999e-05 2024-04-19T03:02:09.003 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:09.003 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:02:09.003 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:09.003 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:09.003 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:09.003 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4755.0:11274 5.e e26/22 5:7c846032:::benchmark_data_smithi096_19531_object11273:head v 26'697, mlcod=26'692)", 2024-04-19T03:02:09.003 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:42.065726+0000", 2024-04-19T03:02:09.003 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 26.883239975999999, 2024-04-19T03:02:09.003 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.028607227999999998, 2024-04-19T03:02:09.003 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:02:09.003 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:09.004 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:02:09.004 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:09.004 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:02:09.004 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.065726+0000", 2024-04-19T03:02:09.004 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:09.004 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:09.004 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:09.004 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:02:09.004 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.065726+0000", 2024-04-19T03:02:09.004 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:09.004 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:09.004 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:09.004 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:02:09.004 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.065725+0000", 2024-04-19T03:02:09.005 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2024-04-19T03:02:09.005 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:09.005 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:09.005 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:02:09.005 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.066818+0000", 2024-04-19T03:02:09.005 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0010930110000000001 2024-04-19T03:02:09.005 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:09.005 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:09.005 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:02:09.005 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.066826+0000", 2024-04-19T03:02:09.005 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.0609999999999996e-06 2024-04-19T03:02:09.005 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:09.005 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:09.005 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:02:09.006 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.066831+0000", 2024-04-19T03:02:09.006 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.7500000000000003e-06 2024-04-19T03:02:09.006 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:09.006 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:09.006 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:09.006 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.066857+0000", 2024-04-19T03:02:09.006 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.6126999999999999e-05 2024-04-19T03:02:09.006 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:09.006 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:09.006 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:02:09.006 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.066868+0000", 2024-04-19T03:02:09.006 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1113e-05 2024-04-19T03:02:09.006 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:09.007 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:09.007 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:02:09.007 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.094266+0000", 2024-04-19T03:02:09.007 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.027397731000000002 2024-04-19T03:02:09.007 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:09.007 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:09.007 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:02:09.007 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.094333+0000", 2024-04-19T03:02:09.007 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.7230000000000005e-05 2024-04-19T03:02:09.007 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:09.007 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:02:09.007 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:09.007 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:09.007 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:09.008 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4755.0:11279 5.8 e26/22 5:10b60c58:::benchmark_data_smithi096_19531_object11278:head v 26'723, mlcod=26'719)", 2024-04-19T03:02:09.008 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:42.066841+0000", 2024-04-19T03:02:09.008 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 26.882124660999999, 2024-04-19T03:02:09.008 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.021736267, 2024-04-19T03:02:09.008 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:02:09.008 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:09.008 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:02:09.008 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:09.008 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:02:09.008 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.066841+0000", 2024-04-19T03:02:09.008 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:09.008 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:09.008 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:09.009 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:02:09.009 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.066841+0000", 2024-04-19T03:02:09.009 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:09.009 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:09.009 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:09.009 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:02:09.009 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.066841+0000", 2024-04-19T03:02:09.009 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:09.009 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:09.009 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:09.009 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:02:09.009 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.066876+0000", 2024-04-19T03:02:09.009 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.4790999999999999e-05 2024-04-19T03:02:09.009 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:09.009 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:09.010 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:02:09.010 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.066880+0000", 2024-04-19T03:02:09.010 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.3610000000000003e-06 2024-04-19T03:02:09.010 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:09.010 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:09.010 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:02:09.010 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.066883+0000", 2024-04-19T03:02:09.010 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.4079999999999998e-06 2024-04-19T03:02:09.010 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:09.010 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:09.010 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:09.010 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.066929+0000", 2024-04-19T03:02:09.010 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.5444000000000001e-05 2024-04-19T03:02:09.011 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:09.011 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:09.011 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:02:09.011 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.066951+0000", 2024-04-19T03:02:09.011 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.2578999999999998e-05 2024-04-19T03:02:09.011 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:09.011 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:09.011 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:02:09.011 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.088518+0000", 2024-04-19T03:02:09.011 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.021566617 2024-04-19T03:02:09.011 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:09.011 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:09.011 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:02:09.011 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.088578+0000", 2024-04-19T03:02:09.012 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.9655999999999999e-05 2024-04-19T03:02:09.012 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:09.012 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:02:09.012 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:09.012 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:09.012 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:09.012 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4755.0:11282 5.e e26/22 5:75b7c510:::benchmark_data_smithi096_19531_object11281:head v 26'698, mlcod=26'693)", 2024-04-19T03:02:09.012 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:42.066923+0000", 2024-04-19T03:02:09.012 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 26.882042794, 2024-04-19T03:02:09.012 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.027436461999999998, 2024-04-19T03:02:09.012 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:02:09.012 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:09.012 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:02:09.013 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:09.013 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:02:09.013 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.066923+0000", 2024-04-19T03:02:09.013 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:09.013 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:09.013 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:09.013 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:02:09.013 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.066923+0000", 2024-04-19T03:02:09.013 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:09.013 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:09.013 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:09.013 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:02:09.013 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.066923+0000", 2024-04-19T03:02:09.013 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:09.014 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:09.014 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:09.014 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:02:09.014 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.066955+0000", 2024-04-19T03:02:09.014 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.2060999999999997e-05 2024-04-19T03:02:09.014 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:09.014 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:09.014 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:02:09.014 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.066962+0000", 2024-04-19T03:02:09.014 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.1969999999999999e-06 2024-04-19T03:02:09.014 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:09.014 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:09.014 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:02:09.015 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.066967+0000", 2024-04-19T03:02:09.015 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.6589999999999998e-06 2024-04-19T03:02:09.015 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:09.015 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:09.015 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:09.015 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.067762+0000", 2024-04-19T03:02:09.015 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00079538199999999997 2024-04-19T03:02:09.015 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:09.015 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:09.015 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:02:09.015 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.067782+0000", 2024-04-19T03:02:09.015 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.9432999999999998e-05 2024-04-19T03:02:09.015 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:09.015 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:09.016 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:02:09.016 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.094339+0000", 2024-04-19T03:02:09.016 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.026556778999999999 2024-04-19T03:02:09.016 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:09.016 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:09.016 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:02:09.016 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.094360+0000", 2024-04-19T03:02:09.016 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.1246e-05 2024-04-19T03:02:09.016 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:09.016 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:02:09.016 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:09.016 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:09.016 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:09.016 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4755.0:11291 5.a 5:5ee9d828:::benchmark_data_smithi096_19531_object11290:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T03:02:09.017 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:42.067725+0000", 2024-04-19T03:02:09.017 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 26.881240684000002, 2024-04-19T03:02:09.017 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.021089111000000001, 2024-04-19T03:02:09.017 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:02:09.017 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:09.017 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-04-19T03:02:09.017 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4755", 2024-04-19T03:02:09.017 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:09.017 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 11291 2024-04-19T03:02:09.017 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:09.017 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:02:09.017 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:09.017 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:02:09.018 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.067725+0000", 2024-04-19T03:02:09.018 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:09.018 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:09.018 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:09.018 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:02:09.018 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.067725+0000", 2024-04-19T03:02:09.018 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:09.018 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:09.018 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:09.018 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:02:09.018 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.067724+0000", 2024-04-19T03:02:09.018 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2024-04-19T03:02:09.018 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:09.018 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:09.019 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:02:09.019 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.067842+0000", 2024-04-19T03:02:09.019 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000117691 2024-04-19T03:02:09.019 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:09.019 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:09.019 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:02:09.019 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.067853+0000", 2024-04-19T03:02:09.019 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0679000000000001e-05 2024-04-19T03:02:09.019 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:09.019 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:09.019 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:02:09.019 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.067859+0000", 2024-04-19T03:02:09.019 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.9510000000000003e-06 2024-04-19T03:02:09.019 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:09.020 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:09.020 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:09.020 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.067905+0000", 2024-04-19T03:02:09.020 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.6242999999999998e-05 2024-04-19T03:02:09.020 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:09.020 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:09.020 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:02:09.020 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.085335+0000", 2024-04-19T03:02:09.020 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.017430451 2024-04-19T03:02:09.020 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:09.020 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:09.020 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 1", 2024-04-19T03:02:09.020 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.085538+0000", 2024-04-19T03:02:09.020 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000202511 2024-04-19T03:02:09.021 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:09.021 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:09.021 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:09.021 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.087988+0000", 2024-04-19T03:02:09.021 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0024505780000000001 2024-04-19T03:02:09.021 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:09.021 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:09.021 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:02:09.021 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.088672+0000", 2024-04-19T03:02:09.021 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00068377900000000003 2024-04-19T03:02:09.021 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:09.021 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:09.021 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:02:09.021 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.088757+0000", 2024-04-19T03:02:09.022 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.4384999999999999e-05 2024-04-19T03:02:09.022 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:09.022 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:09.022 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:02:09.022 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.088815+0000", 2024-04-19T03:02:09.022 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.7995999999999998e-05 2024-04-19T03:02:09.022 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:09.022 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:02:09.022 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:09.022 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:09.022 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:09.022 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4755.0:11293 5.c 5:31728bfd:::benchmark_data_smithi096_19531_object11292:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T03:02:09.022 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:42.068359+0000", 2024-04-19T03:02:09.023 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 26.880606969999999, 2024-04-19T03:02:09.023 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.022306475999999999, 2024-04-19T03:02:09.023 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:02:09.023 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:09.023 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-04-19T03:02:09.023 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4755", 2024-04-19T03:02:09.023 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:09.023 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 11293 2024-04-19T03:02:09.023 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:09.023 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:02:09.023 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:09.023 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:02:09.023 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.068359+0000", 2024-04-19T03:02:09.023 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:09.024 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:09.024 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:09.024 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:02:09.024 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.068359+0000", 2024-04-19T03:02:09.024 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:09.024 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:09.024 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:09.024 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:02:09.024 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.068358+0000", 2024-04-19T03:02:09.024 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2024-04-19T03:02:09.024 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:09.024 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:09.024 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:02:09.025 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.068427+0000", 2024-04-19T03:02:09.025 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.9139000000000003e-05 2024-04-19T03:02:09.025 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:09.025 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:09.025 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:02:09.025 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.085292+0000", 2024-04-19T03:02:09.025 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.016864371 2024-04-19T03:02:09.025 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:09.025 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:09.025 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:02:09.025 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.085306+0000", 2024-04-19T03:02:09.025 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.434e-05 2024-04-19T03:02:09.025 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:09.025 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:09.026 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:09.026 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.085404+0000", 2024-04-19T03:02:09.026 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.8145000000000003e-05 2024-04-19T03:02:09.026 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:09.026 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:09.026 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:02:09.026 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.085569+0000", 2024-04-19T03:02:09.026 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00016504099999999999 2024-04-19T03:02:09.026 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:09.026 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:09.026 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-04-19T03:02:09.026 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.085739+0000", 2024-04-19T03:02:09.027 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000170099 2024-04-19T03:02:09.027 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:09.027 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:09.027 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:02:09.027 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.089603+0000", 2024-04-19T03:02:09.027 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0038636080000000001 2024-04-19T03:02:09.027 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:09.027 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:09.027 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:09.027 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.090578+0000", 2024-04-19T03:02:09.027 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00097513199999999997 2024-04-19T03:02:09.027 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:09.027 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:09.028 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:02:09.028 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.090618+0000", 2024-04-19T03:02:09.028 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.9987999999999997e-05 2024-04-19T03:02:09.028 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:09.028 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:09.028 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:02:09.028 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.090666+0000", 2024-04-19T03:02:09.028 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.7420999999999999e-05 2024-04-19T03:02:09.028 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:09.028 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:02:09.028 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:09.028 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:09.028 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:09.029 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4755.0:60384 5.a 5:55675f1d:::benchmark_data_smithi096_19531_object60383:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-19T03:02:09.029 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:02:05.864278+0000", 2024-04-19T03:02:09.029 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 3.0846881210000001, 2024-04-19T03:02:09.029 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.021786224999999999, 2024-04-19T03:02:09.029 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:02:09.029 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:09.029 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-04-19T03:02:09.029 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4755", 2024-04-19T03:02:09.029 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:09.029 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 60384 2024-04-19T03:02:09.029 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:09.029 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:02:09.029 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:09.029 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:02:09.030 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:05.864278+0000", 2024-04-19T03:02:09.030 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:09.030 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:09.030 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:09.030 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:02:09.030 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:05.864278+0000", 2024-04-19T03:02:09.030 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:09.030 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:09.030 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:09.030 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:02:09.030 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:05.864277+0000", 2024-04-19T03:02:09.030 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:09.030 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:09.030 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:09.031 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:02:09.031 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:05.864344+0000", 2024-04-19T03:02:09.031 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.7392999999999997e-05 2024-04-19T03:02:09.031 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:09.031 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:09.031 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:02:09.031 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:05.864355+0000", 2024-04-19T03:02:09.031 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1083999999999999e-05 2024-04-19T03:02:09.031 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:09.031 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:09.031 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:02:09.031 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:05.864363+0000", 2024-04-19T03:02:09.031 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.9529999999999999e-06 2024-04-19T03:02:09.031 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:09.032 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:09.032 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:09.032 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:05.865979+0000", 2024-04-19T03:02:09.032 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001616159 2024-04-19T03:02:09.032 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:09.032 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:09.032 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:02:09.032 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:05.866059+0000", 2024-04-19T03:02:09.032 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.0343e-05 2024-04-19T03:02:09.032 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:09.032 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:09.032 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 1", 2024-04-19T03:02:09.032 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:05.866179+0000", 2024-04-19T03:02:09.032 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000119072 2024-04-19T03:02:09.033 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:09.033 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:09.033 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:09.033 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:05.875531+0000", 2024-04-19T03:02:09.033 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0093528770000000008 2024-04-19T03:02:09.033 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:09.033 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:09.033 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:02:09.033 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:05.885821+0000", 2024-04-19T03:02:09.033 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0102892 2024-04-19T03:02:09.033 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:09.033 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:09.033 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:02:09.033 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:05.886025+0000", 2024-04-19T03:02:09.034 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000204086 2024-04-19T03:02:09.034 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:09.034 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:09.034 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:02:09.034 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:05.886064+0000", 2024-04-19T03:02:09.034 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.9458000000000001e-05 2024-04-19T03:02:09.034 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:09.034 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:02:09.034 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:09.034 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:09.034 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:09.034 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4755.0:60387 5.a 5:5bcd3858:::benchmark_data_smithi096_19531_object60386:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-19T03:02:09.034 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:02:05.865112+0000", 2024-04-19T03:02:09.034 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 3.0838542169999998, 2024-04-19T03:02:09.035 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.021027062999999999, 2024-04-19T03:02:09.035 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:02:09.035 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:09.035 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-04-19T03:02:09.035 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4755", 2024-04-19T03:02:09.035 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:09.035 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 60387 2024-04-19T03:02:09.035 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:09.035 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:02:09.035 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:09.035 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:02:09.035 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:05.865112+0000", 2024-04-19T03:02:09.035 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:09.036 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:09.036 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:09.036 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:02:09.036 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:05.865112+0000", 2024-04-19T03:02:09.036 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:09.036 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:09.036 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:09.036 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:02:09.036 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:05.865111+0000", 2024-04-19T03:02:09.036 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:09.036 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:09.036 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:09.036 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:02:09.036 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:05.865220+0000", 2024-04-19T03:02:09.037 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000108874 2024-04-19T03:02:09.037 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:09.037 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:09.037 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:02:09.037 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:05.865229+0000", 2024-04-19T03:02:09.037 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.8319999999999995e-06 2024-04-19T03:02:09.037 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:09.037 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:09.037 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:02:09.037 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:05.865235+0000", 2024-04-19T03:02:09.037 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.4869999999999999e-06 2024-04-19T03:02:09.037 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:09.037 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:09.038 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:09.038 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:05.872377+0000", 2024-04-19T03:02:09.038 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.007141723 2024-04-19T03:02:09.038 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:09.038 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:09.038 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:02:09.038 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:05.872553+0000", 2024-04-19T03:02:09.038 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00017596500000000001 2024-04-19T03:02:09.038 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:09.038 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:09.038 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 1", 2024-04-19T03:02:09.038 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:05.872745+0000", 2024-04-19T03:02:09.038 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00019203800000000001 2024-04-19T03:02:09.038 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:09.039 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:09.039 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:09.039 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:05.875797+0000", 2024-04-19T03:02:09.039 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0030517840000000001 2024-04-19T03:02:09.039 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:09.039 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:09.039 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:02:09.039 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:05.886079+0000", 2024-04-19T03:02:09.039 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.010281665000000001 2024-04-19T03:02:09.039 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:09.039 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:09.039 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:02:09.039 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:05.886109+0000", 2024-04-19T03:02:09.040 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0241999999999999e-05 2024-04-19T03:02:09.040 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:09.040 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:09.040 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:02:09.040 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:05.886139+0000", 2024-04-19T03:02:09.040 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0108e-05 2024-04-19T03:02:09.040 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:09.040 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:02:09.040 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:09.040 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:09.040 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:09.040 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4755.0:60674 5.5 5:aaf3a5ff:::benchmark_data_smithi096_19531_object60673:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-19T03:02:09.041 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:02:06.038509+0000", 2024-04-19T03:02:09.041 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 2.9104571300000002, 2024-04-19T03:02:09.041 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.024267756000000001, 2024-04-19T03:02:09.041 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:02:09.041 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:09.041 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-04-19T03:02:09.041 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4755", 2024-04-19T03:02:09.041 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:09.041 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 60674 2024-04-19T03:02:09.041 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:09.041 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:02:09.041 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:09.041 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:02:09.042 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.038509+0000", 2024-04-19T03:02:09.042 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:09.042 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:09.042 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:09.042 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:02:09.042 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.038509+0000", 2024-04-19T03:02:09.042 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:09.042 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:09.042 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:09.042 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:02:09.042 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.038507+0000", 2024-04-19T03:02:09.042 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999981 2024-04-19T03:02:09.042 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:09.043 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:09.043 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:02:09.043 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.038584+0000", 2024-04-19T03:02:09.043 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.6947999999999996e-05 2024-04-19T03:02:09.043 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:09.043 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:09.043 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:02:09.043 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.038597+0000", 2024-04-19T03:02:09.043 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2863e-05 2024-04-19T03:02:09.043 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:09.043 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:09.043 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:02:09.043 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.038606+0000", 2024-04-19T03:02:09.043 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.9209999999999998e-06 2024-04-19T03:02:09.044 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:09.044 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:09.044 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:09.044 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.041247+0000", 2024-04-19T03:02:09.044 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0026412720000000001 2024-04-19T03:02:09.044 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:09.044 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:09.044 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:02:09.044 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.041436+0000", 2024-04-19T03:02:09.044 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00018870599999999999 2024-04-19T03:02:09.044 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:09.044 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:09.044 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-04-19T03:02:09.045 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.041636+0000", 2024-04-19T03:02:09.045 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00020026399999999999 2024-04-19T03:02:09.045 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:09.045 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:09.045 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:09.045 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.048757+0000", 2024-04-19T03:02:09.045 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0071207620000000001 2024-04-19T03:02:09.045 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:09.045 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:09.045 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:02:09.045 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.062687+0000", 2024-04-19T03:02:09.045 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.013929811 2024-04-19T03:02:09.045 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:09.045 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:09.046 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:02:09.046 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.062740+0000", 2024-04-19T03:02:09.046 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.3735e-05 2024-04-19T03:02:09.046 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:09.046 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:09.046 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:02:09.046 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.062777+0000", 2024-04-19T03:02:09.046 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.6366999999999999e-05 2024-04-19T03:02:09.046 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:09.046 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:02:09.046 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:09.046 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:09.047 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:09.047 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4755.0:60677 5.5 5:aad57123:::benchmark_data_smithi096_19531_object60676:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-19T03:02:09.047 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:02:06.039077+0000", 2024-04-19T03:02:09.047 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 2.9098886950000002, 2024-04-19T03:02:09.047 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.023852720000000001, 2024-04-19T03:02:09.047 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:02:09.047 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:09.047 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-04-19T03:02:09.047 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4755", 2024-04-19T03:02:09.047 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:09.047 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 60677 2024-04-19T03:02:09.047 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:09.047 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:02:09.047 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:09.048 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:02:09.048 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.039077+0000", 2024-04-19T03:02:09.048 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:09.048 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:09.048 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:09.048 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:02:09.048 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.039077+0000", 2024-04-19T03:02:09.048 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:09.048 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:09.048 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:09.048 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:02:09.048 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.039076+0000", 2024-04-19T03:02:09.048 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2024-04-19T03:02:09.048 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:09.049 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:09.049 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:02:09.049 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.039158+0000", 2024-04-19T03:02:09.049 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.1310000000000006e-05 2024-04-19T03:02:09.049 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:09.049 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:09.049 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:02:09.049 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.039171+0000", 2024-04-19T03:02:09.049 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.3010000000000001e-05 2024-04-19T03:02:09.049 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:09.049 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:09.049 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:02:09.049 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.039178+0000", 2024-04-19T03:02:09.049 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.8519999999999998e-06 2024-04-19T03:02:09.049 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:09.050 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:09.050 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:09.050 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.048813+0000", 2024-04-19T03:02:09.050 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0096353600000000008 2024-04-19T03:02:09.050 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:09.050 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:09.050 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:02:09.050 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.048986+0000", 2024-04-19T03:02:09.050 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000173234 2024-04-19T03:02:09.050 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:09.050 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:09.050 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-04-19T03:02:09.050 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.049147+0000", 2024-04-19T03:02:09.050 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00016059000000000001 2024-04-19T03:02:09.051 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:09.051 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:09.051 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:02:09.051 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.062805+0000", 2024-04-19T03:02:09.051 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.013658267999999999 2024-04-19T03:02:09.051 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:09.051 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:09.051 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:09.051 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.062858+0000", 2024-04-19T03:02:09.051 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.3177999999999998e-05 2024-04-19T03:02:09.051 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:09.051 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:09.051 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:02:09.052 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.062903+0000", 2024-04-19T03:02:09.052 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.4336999999999999e-05 2024-04-19T03:02:09.052 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:09.052 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:09.052 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:02:09.052 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.062930+0000", 2024-04-19T03:02:09.052 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.7492e-05 2024-04-19T03:02:09.052 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:09.052 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:02:09.052 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:09.052 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:09.052 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:09.052 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4755.0:60686 5.5 5:a9caa390:::benchmark_data_smithi096_19531_object60685:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-19T03:02:09.052 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:02:06.044469+0000", 2024-04-19T03:02:09.052 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 2.9044974200000002, 2024-04-19T03:02:09.053 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.021099772999999999, 2024-04-19T03:02:09.053 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:02:09.053 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:09.053 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-04-19T03:02:09.053 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4755", 2024-04-19T03:02:09.053 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:09.053 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 60686 2024-04-19T03:02:09.053 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:09.053 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:02:09.053 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:09.053 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:02:09.053 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.044469+0000", 2024-04-19T03:02:09.053 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:09.053 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:09.054 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:09.054 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:02:09.054 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.044469+0000", 2024-04-19T03:02:09.054 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:09.054 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:09.054 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:09.054 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:02:09.054 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.044467+0000", 2024-04-19T03:02:09.054 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:09.054 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:09.054 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:09.054 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:02:09.054 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.044516+0000", 2024-04-19T03:02:09.054 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.9143e-05 2024-04-19T03:02:09.055 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:09.055 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:09.055 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:02:09.055 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.044530+0000", 2024-04-19T03:02:09.055 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.3526000000000001e-05 2024-04-19T03:02:09.055 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:09.055 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:09.055 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:02:09.055 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.044537+0000", 2024-04-19T03:02:09.055 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.8990000000000004e-06 2024-04-19T03:02:09.055 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:09.055 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:09.055 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:09.055 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.054411+0000", 2024-04-19T03:02:09.056 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0098746949999999993 2024-04-19T03:02:09.056 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:09.056 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:09.056 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:02:09.056 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.054606+0000", 2024-04-19T03:02:09.056 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00019422100000000001 2024-04-19T03:02:09.056 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:09.056 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:09.056 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-04-19T03:02:09.056 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.054848+0000", 2024-04-19T03:02:09.056 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00024189799999999999 2024-04-19T03:02:09.056 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:09.056 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:09.056 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:02:09.057 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.063095+0000", 2024-04-19T03:02:09.057 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0082472020000000004 2024-04-19T03:02:09.057 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:09.057 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:09.057 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:09.057 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.065481+0000", 2024-04-19T03:02:09.057 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00238623 2024-04-19T03:02:09.057 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:09.057 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:09.057 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:02:09.057 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.065532+0000", 2024-04-19T03:02:09.057 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.0509e-05 2024-04-19T03:02:09.057 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:09.057 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:09.058 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:02:09.058 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.065568+0000", 2024-04-19T03:02:09.058 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.6876999999999999e-05 2024-04-19T03:02:09.058 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:09.058 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:02:09.058 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:09.058 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:09.058 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:09.058 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4755.0:60689 5.5 5:adf8d35d:::benchmark_data_smithi096_19531_object60688:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-19T03:02:09.058 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:02:06.047459+0000", 2024-04-19T03:02:09.058 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 2.901507359, 2024-04-19T03:02:09.058 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.021837532, 2024-04-19T03:02:09.058 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:02:09.058 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:09.059 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-04-19T03:02:09.059 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4755", 2024-04-19T03:02:09.059 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:09.059 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 60689 2024-04-19T03:02:09.059 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:09.059 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:02:09.059 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:09.059 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:02:09.059 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.047459+0000", 2024-04-19T03:02:09.059 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:09.059 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:09.059 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:09.059 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:02:09.059 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.047459+0000", 2024-04-19T03:02:09.060 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:09.060 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:09.060 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:09.060 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:02:09.060 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.047458+0000", 2024-04-19T03:02:09.060 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2024-04-19T03:02:09.060 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:09.060 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:09.060 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:02:09.060 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.047527+0000", 2024-04-19T03:02:09.060 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.9114000000000003e-05 2024-04-19T03:02:09.060 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:09.060 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:09.060 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:02:09.061 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.047538+0000", 2024-04-19T03:02:09.061 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.094e-05 2024-04-19T03:02:09.061 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:09.061 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:09.061 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:02:09.061 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.047542+0000", 2024-04-19T03:02:09.061 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.4689999999999999e-06 2024-04-19T03:02:09.061 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:09.061 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:09.061 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:09.061 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.059742+0000", 2024-04-19T03:02:09.061 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.012200103 2024-04-19T03:02:09.061 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:09.062 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:09.062 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:02:09.062 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.059904+0000", 2024-04-19T03:02:09.062 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00016191900000000001 2024-04-19T03:02:09.062 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:09.062 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:09.062 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-04-19T03:02:09.062 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.060079+0000", 2024-04-19T03:02:09.062 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00017477500000000001 2024-04-19T03:02:09.062 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:09.062 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:09.062 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:09.062 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.067922+0000", 2024-04-19T03:02:09.062 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0078434720000000006 2024-04-19T03:02:09.063 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:09.063 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:09.063 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:02:09.063 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.069163+0000", 2024-04-19T03:02:09.063 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0012401389999999999 2024-04-19T03:02:09.063 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:09.063 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:09.063 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:02:09.063 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.069238+0000", 2024-04-19T03:02:09.063 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.4955000000000003e-05 2024-04-19T03:02:09.063 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:09.063 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:09.063 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:02:09.063 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.069296+0000", 2024-04-19T03:02:09.064 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.8726e-05 2024-04-19T03:02:09.064 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:09.064 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:02:09.064 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:09.064 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:09.064 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:09.064 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4755.0:60746 5.6 5:68292fbc:::benchmark_data_smithi096_19531_object60745:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-19T03:02:09.064 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:02:06.088145+0000", 2024-04-19T03:02:09.064 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 2.8608212589999997, 2024-04-19T03:02:09.064 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.021267332, 2024-04-19T03:02:09.064 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:02:09.064 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:09.064 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-04-19T03:02:09.064 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4755", 2024-04-19T03:02:09.065 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:09.065 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 60746 2024-04-19T03:02:09.065 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:09.065 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:02:09.065 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:09.065 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:02:09.065 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.088145+0000", 2024-04-19T03:02:09.065 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:09.065 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:09.065 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:09.065 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:02:09.065 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.088145+0000", 2024-04-19T03:02:09.065 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:09.065 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:09.066 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:09.066 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:02:09.066 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.088144+0000", 2024-04-19T03:02:09.066 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2024-04-19T03:02:09.066 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:09.066 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:09.066 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:02:09.066 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.088187+0000", 2024-04-19T03:02:09.066 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.337e-05 2024-04-19T03:02:09.066 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:09.066 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:09.066 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:02:09.066 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.088199+0000", 2024-04-19T03:02:09.067 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1654999999999999e-05 2024-04-19T03:02:09.067 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:09.067 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:09.067 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:02:09.067 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.088205+0000", 2024-04-19T03:02:09.067 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.3840000000000002e-06 2024-04-19T03:02:09.067 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:09.067 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:09.067 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:09.067 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.095361+0000", 2024-04-19T03:02:09.067 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0071557799999999996 2024-04-19T03:02:09.067 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:09.067 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:09.067 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:02:09.068 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.095490+0000", 2024-04-19T03:02:09.068 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012866700000000001 2024-04-19T03:02:09.068 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:09.068 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:09.068 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-04-19T03:02:09.068 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.095629+0000", 2024-04-19T03:02:09.068 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000139529 2024-04-19T03:02:09.068 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:09.068 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:09.068 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:02:09.068 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.101867+0000", 2024-04-19T03:02:09.068 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0062376259999999996 2024-04-19T03:02:09.068 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:09.068 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:09.069 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:09.069 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.109360+0000", 2024-04-19T03:02:09.069 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0074929799999999998 2024-04-19T03:02:09.069 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:09.069 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:09.069 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:02:09.069 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.109389+0000", 2024-04-19T03:02:09.069 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.8759999999999999e-05 2024-04-19T03:02:09.069 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:09.069 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:09.069 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:02:09.069 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.109412+0000", 2024-04-19T03:02:09.069 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.3354999999999999e-05 2024-04-19T03:02:09.070 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:09.070 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:02:09.070 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:09.070 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:09.070 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:02:09.070 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-04-19T03:02:09.071 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T03:02:09.072 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:09.067+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:09.168 INFO:teuthology.orchestra.run.smithi096.stderr:nodeep-scrub is unset 2024-04-19T03:02:09.171 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:09.167+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:09.205 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-19T03:02:09.206 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-04-19T03:02:09.206 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.206 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:65980 5.0 5:0d4462ff:::benchmark_data_smithi096_19531_object65979:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T03:02:09.206 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:09.198982+0000", 2024-04-19T03:02:09.206 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0069894060000000001, 2024-04-19T03:02:09.206 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0070160079999999998, 2024-04-19T03:02:09.206 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:09.206 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:02:09.206 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:09.206 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:09.206 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:09.207 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 65980 2024-04-19T03:02:09.207 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.207 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:09.207 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.207 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:09.207 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:09.198982+0000", 2024-04-19T03:02:09.207 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:09.207 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.207 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.207 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:09.207 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:09.198982+0000", 2024-04-19T03:02:09.207 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:09.208 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.208 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.208 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:09.208 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:09.198981+0000", 2024-04-19T03:02:09.208 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:09.208 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.208 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.208 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:09.208 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:09.199013+0000", 2024-04-19T03:02:09.208 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1943999999999998e-05 2024-04-19T03:02:09.208 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.208 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.208 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:09.209 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:09.199037+0000", 2024-04-19T03:02:09.209 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4142999999999999e-05 2024-04-19T03:02:09.209 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.209 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.209 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:09.209 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:09.199043+0000", 2024-04-19T03:02:09.209 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1249999999999998e-06 2024-04-19T03:02:09.209 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.209 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.209 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:09.209 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:09.202201+0000", 2024-04-19T03:02:09.209 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0031576159999999998 2024-04-19T03:02:09.209 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.209 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.210 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:09.210 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:09.202296+0000", 2024-04-19T03:02:09.210 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.5241999999999994e-05 2024-04-19T03:02:09.210 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.210 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.210 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:09.210 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:09.202377+0000", 2024-04-19T03:02:09.210 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1074000000000003e-05 2024-04-19T03:02:09.210 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:09.210 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:09.210 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:09.210 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.210 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.210 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:65981 5.e 5:7ad12741:::benchmark_data_smithi096_19531_object65980:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T03:02:09.211 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:09.199051+0000", 2024-04-19T03:02:09.211 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0069198109999999997, 2024-04-19T03:02:09.211 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0070237149999999998, 2024-04-19T03:02:09.211 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:09.211 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:02:09.211 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:09.211 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:09.211 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:09.211 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 65981 2024-04-19T03:02:09.211 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.211 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:09.211 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.211 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:09.211 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:09.199051+0000", 2024-04-19T03:02:09.212 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:09.212 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.212 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.212 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:09.212 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:09.199051+0000", 2024-04-19T03:02:09.212 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:09.212 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.212 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.212 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:09.212 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:09.199051+0000", 2024-04-19T03:02:09.212 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:09.212 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.212 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.212 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:09.213 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:09.199095+0000", 2024-04-19T03:02:09.213 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4067999999999999e-05 2024-04-19T03:02:09.213 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.213 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.213 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:09.213 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:09.199105+0000", 2024-04-19T03:02:09.213 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.8160000000000005e-06 2024-04-19T03:02:09.213 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.213 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.213 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:09.213 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:09.199110+0000", 2024-04-19T03:02:09.213 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.305e-06 2024-04-19T03:02:09.213 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.213 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.214 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:09.214 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:09.199140+0000", 2024-04-19T03:02:09.214 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0066999999999999e-05 2024-04-19T03:02:09.214 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.214 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.214 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:09.214 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:09.199225+0000", 2024-04-19T03:02:09.214 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.5143999999999997e-05 2024-04-19T03:02:09.214 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.214 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.214 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:09.214 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:09.199310+0000", 2024-04-19T03:02:09.214 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.4746000000000005e-05 2024-04-19T03:02:09.215 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:09.215 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:09.215 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:09.215 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.215 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.215 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4755.0:65982 5.9 e37/22 5:95f09a7a:::benchmark_data_smithi096_19531_object65981:head v 37'4024, mlcod=37'4021)", 2024-04-19T03:02:09.215 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:09.200009+0000", 2024-04-19T03:02:09.215 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0059623819999999996, 2024-04-19T03:02:09.215 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0061239959999999996, 2024-04-19T03:02:09.215 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:09.215 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-19T03:02:09.215 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:09.215 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.215 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:09.216 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:09.200009+0000", 2024-04-19T03:02:09.216 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:09.216 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.216 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.216 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:09.216 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:09.200009+0000", 2024-04-19T03:02:09.216 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:09.216 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.216 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.216 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:09.216 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:09.200008+0000", 2024-04-19T03:02:09.216 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:09.216 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.216 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.217 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:09.217 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:09.200055+0000", 2024-04-19T03:02:09.217 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7144000000000001e-05 2024-04-19T03:02:09.217 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.217 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.217 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:09.217 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:09.200068+0000", 2024-04-19T03:02:09.217 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3346999999999999e-05 2024-04-19T03:02:09.217 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.217 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.217 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:09.217 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:09.200075+0000", 2024-04-19T03:02:09.217 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2559999999999999e-06 2024-04-19T03:02:09.217 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.217 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.218 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:09.218 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:09.200131+0000", 2024-04-19T03:02:09.218 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6007000000000001e-05 2024-04-19T03:02:09.218 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.218 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.218 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:09.218 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:09.200151+0000", 2024-04-19T03:02:09.218 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0279999999999999e-05 2024-04-19T03:02:09.218 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:09.218 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:09.218 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:09.218 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.218 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.219 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:65977 5.0 5:09fcd24e:::benchmark_data_smithi096_19531_object65976:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T03:02:09.219 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:09.198319+0000", 2024-04-19T03:02:09.219 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0076524669999999996, 2024-04-19T03:02:09.219 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0078508339999999992, 2024-04-19T03:02:09.219 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:09.219 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:02:09.219 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:09.219 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:09.219 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:09.219 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 65977 2024-04-19T03:02:09.219 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.219 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:09.219 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.219 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:09.220 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:09.198319+0000", 2024-04-19T03:02:09.220 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:09.220 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.220 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.220 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:09.220 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:09.198319+0000", 2024-04-19T03:02:09.220 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:09.220 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.220 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.220 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:09.220 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:09.198318+0000", 2024-04-19T03:02:09.220 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:09.220 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.221 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.221 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:09.221 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:09.198395+0000", 2024-04-19T03:02:09.221 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.7409000000000004e-05 2024-04-19T03:02:09.221 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.221 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.221 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:09.221 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:09.198404+0000", 2024-04-19T03:02:09.221 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1800000000000002e-06 2024-04-19T03:02:09.221 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.221 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.221 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:09.221 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:09.198422+0000", 2024-04-19T03:02:09.221 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8051999999999999e-05 2024-04-19T03:02:09.222 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.222 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.222 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:09.222 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:09.198477+0000", 2024-04-19T03:02:09.222 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5155999999999998e-05 2024-04-19T03:02:09.222 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.222 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.222 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:09.222 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:09.198578+0000", 2024-04-19T03:02:09.222 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000100877 2024-04-19T03:02:09.222 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.222 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.222 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:09.222 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:09.198707+0000", 2024-04-19T03:02:09.223 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012862999999999999 2024-04-19T03:02:09.223 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.223 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.223 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:09.223 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:09.204339+0000", 2024-04-19T03:02:09.223 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0056322519999999999 2024-04-19T03:02:09.223 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:09.223 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:09.223 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:09.223 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.223 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.223 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:65978 5.4 5:20ee1394:::benchmark_data_smithi096_19531_object65977:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T03:02:09.223 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:09.198433+0000", 2024-04-19T03:02:09.223 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0075383050000000004, 2024-04-19T03:02:09.224 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0077837899999999996, 2024-04-19T03:02:09.224 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:09.224 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:02:09.224 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:09.224 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:09.224 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:09.224 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 65978 2024-04-19T03:02:09.224 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.224 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:09.224 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.224 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:09.224 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:09.198433+0000", 2024-04-19T03:02:09.224 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:09.224 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.225 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.225 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:09.225 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:09.198433+0000", 2024-04-19T03:02:09.225 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:09.225 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.225 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.225 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:09.225 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:09.198432+0000", 2024-04-19T03:02:09.225 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:09.225 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.225 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.225 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:09.225 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:09.198466+0000", 2024-04-19T03:02:09.225 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4269e-05 2024-04-19T03:02:09.226 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.226 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.226 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:09.226 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:09.198479+0000", 2024-04-19T03:02:09.226 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2961e-05 2024-04-19T03:02:09.226 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.226 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.226 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:09.226 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:09.198485+0000", 2024-04-19T03:02:09.226 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9399999999999999e-06 2024-04-19T03:02:09.226 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.226 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.226 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:09.226 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:09.198515+0000", 2024-04-19T03:02:09.227 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9598999999999999e-05 2024-04-19T03:02:09.227 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.227 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.227 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:09.227 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:09.198602+0000", 2024-04-19T03:02:09.227 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.7023999999999999e-05 2024-04-19T03:02:09.227 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.227 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.227 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:09.227 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:09.198738+0000", 2024-04-19T03:02:09.227 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013572700000000001 2024-04-19T03:02:09.227 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.227 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.227 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:09.227 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:09.201345+0000", 2024-04-19T03:02:09.228 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0026069639999999998 2024-04-19T03:02:09.228 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:09.228 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:09.228 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:09.228 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:09.228 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-04-19T03:02:09.228 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 5 2024-04-19T03:02:09.228 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-19T03:02:09.229 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T03:02:09.272 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-04-19T03:02:09.270+0000 7f35986ab700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18243) UID: 0 2024-04-19T03:02:09.356 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-19T03:02:09.356 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-04-19T03:02:09.356 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-04-19T03:02:09.356 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-04-19T03:02:09.356 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-19T03:02:09.370 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T03:02:09.373 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:09.371+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:09.473 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:09.469+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:09.497 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-19T03:02:09.498 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-04-19T03:02:09.498 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-04-19T03:02:09.498 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-04-19T03:02:09.498 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.498 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:10 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:02:09.498 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:14.999496+0000", 2024-04-19T03:02:09.498 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 54.496277386999999, 2024-04-19T03:02:09.498 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.022720497999999999, 2024-04-19T03:02:09.498 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:09.498 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:09.499 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:09.499 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.499 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:09.499 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999496+0000", 2024-04-19T03:02:09.499 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:09.499 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.499 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.499 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:09.499 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999496+0000", 2024-04-19T03:02:09.499 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:09.499 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.499 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.499 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:09.500 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999494+0000", 2024-04-19T03:02:09.500 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:09.500 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.500 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.500 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:09.500 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999503+0000", 2024-04-19T03:02:09.500 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.5930000000000006e-06 2024-04-19T03:02:09.500 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.500 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.500 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:09.500 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999523+0000", 2024-04-19T03:02:09.500 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9553000000000001e-05 2024-04-19T03:02:09.500 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.500 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.500 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:09.501 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999538+0000", 2024-04-19T03:02:09.501 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5702999999999999e-05 2024-04-19T03:02:09.501 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.501 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.501 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:09.501 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999608+0000", 2024-04-19T03:02:09.501 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.9912000000000004e-05 2024-04-19T03:02:09.501 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.501 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.501 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op must wait for map", 2024-04-19T03:02:09.501 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999626+0000", 2024-04-19T03:02:09.501 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8207e-05 2024-04-19T03:02:09.501 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.501 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.502 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:09.502 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.010765+0000", 2024-04-19T03:02:09.502 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011138719 2024-04-19T03:02:09.502 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.502 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.502 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:09.502 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.010906+0000", 2024-04-19T03:02:09.502 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014095899999999999 2024-04-19T03:02:09.502 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.502 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.502 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-04-19T03:02:09.502 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.011472+0000", 2024-04-19T03:02:09.502 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00056629300000000005 2024-04-19T03:02:09.503 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.503 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.503 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:09.503 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.013217+0000", 2024-04-19T03:02:09.503 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001744317 2024-04-19T03:02:09.503 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.503 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.503 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:09.503 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.022083+0000", 2024-04-19T03:02:09.503 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0088663849999999992 2024-04-19T03:02:09.503 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.503 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.503 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:09.503 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.022124+0000", 2024-04-19T03:02:09.504 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.057e-05 2024-04-19T03:02:09.504 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.504 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.504 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:09.504 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.022216+0000", 2024-04-19T03:02:09.504 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.2417000000000006e-05 2024-04-19T03:02:09.504 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:09.504 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:09.504 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:09.504 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.504 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.504 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:13 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:02:09.505 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:14.999564+0000", 2024-04-19T03:02:09.505 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 54.496208504999998, 2024-04-19T03:02:09.505 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.019594777000000001, 2024-04-19T03:02:09.505 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:09.505 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:09.505 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:09.505 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.505 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:09.505 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999564+0000", 2024-04-19T03:02:09.505 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:09.505 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.505 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.505 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:09.505 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999564+0000", 2024-04-19T03:02:09.506 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:09.506 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.506 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.506 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:09.506 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999563+0000", 2024-04-19T03:02:09.506 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:09.506 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.506 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.506 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:09.506 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999582+0000", 2024-04-19T03:02:09.506 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8151999999999998e-05 2024-04-19T03:02:09.506 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.506 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.507 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:09.507 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999599+0000", 2024-04-19T03:02:09.507 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7583000000000001e-05 2024-04-19T03:02:09.507 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.507 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.507 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:09.507 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999618+0000", 2024-04-19T03:02:09.507 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8989999999999999e-05 2024-04-19T03:02:09.507 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.507 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.507 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:09.507 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999692+0000", 2024-04-19T03:02:09.507 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3561999999999998e-05 2024-04-19T03:02:09.507 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.508 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.508 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op must wait for map", 2024-04-19T03:02:09.508 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999698+0000", 2024-04-19T03:02:09.508 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7159999999999997e-06 2024-04-19T03:02:09.508 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.508 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.508 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:09.508 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.007836+0000", 2024-04-19T03:02:09.508 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0081376520000000004 2024-04-19T03:02:09.508 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.508 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.508 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:09.508 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.008208+0000", 2024-04-19T03:02:09.508 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00037223699999999998 2024-04-19T03:02:09.509 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.509 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.509 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-04-19T03:02:09.509 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.008516+0000", 2024-04-19T03:02:09.509 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000308227 2024-04-19T03:02:09.509 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.509 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.509 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:09.509 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.011585+0000", 2024-04-19T03:02:09.509 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0030680659999999999 2024-04-19T03:02:09.509 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.509 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.509 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:09.509 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.018871+0000", 2024-04-19T03:02:09.510 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0072861369999999998 2024-04-19T03:02:09.510 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.510 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.510 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:09.510 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.019067+0000", 2024-04-19T03:02:09.510 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00019672099999999999 2024-04-19T03:02:09.510 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.510 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.510 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:09.510 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.019159+0000", 2024-04-19T03:02:09.510 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1829999999999993e-05 2024-04-19T03:02:09.510 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:09.510 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:09.511 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:09.511 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.511 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.511 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:32 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:02:09.511 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:14.999712+0000", 2024-04-19T03:02:09.511 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 54.496061144000002, 2024-04-19T03:02:09.511 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.022635437000000001, 2024-04-19T03:02:09.511 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:09.511 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:09.511 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:09.511 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.511 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:09.511 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999712+0000", 2024-04-19T03:02:09.512 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:09.512 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.512 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.512 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:09.512 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999712+0000", 2024-04-19T03:02:09.512 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:09.512 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.512 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.512 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:09.512 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999711+0000", 2024-04-19T03:02:09.512 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:09.512 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.512 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.513 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:09.513 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999719+0000", 2024-04-19T03:02:09.513 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.354e-06 2024-04-19T03:02:09.513 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.513 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.513 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:09.513 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999735+0000", 2024-04-19T03:02:09.513 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6288999999999999e-05 2024-04-19T03:02:09.513 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.513 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.513 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:09.513 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999749+0000", 2024-04-19T03:02:09.513 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3492999999999999e-05 2024-04-19T03:02:09.514 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.514 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.514 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:09.514 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999811+0000", 2024-04-19T03:02:09.514 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2298999999999994e-05 2024-04-19T03:02:09.514 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.514 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.514 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:02:09.514 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999817+0000", 2024-04-19T03:02:09.514 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2169999999999999e-06 2024-04-19T03:02:09.514 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.514 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.514 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:09.515 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.011836+0000", 2024-04-19T03:02:09.515 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.012018008 2024-04-19T03:02:09.515 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.515 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.515 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:09.515 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.011897+0000", 2024-04-19T03:02:09.515 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1111000000000005e-05 2024-04-19T03:02:09.515 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.515 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.515 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-04-19T03:02:09.515 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.011980+0000", 2024-04-19T03:02:09.515 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3003999999999993e-05 2024-04-19T03:02:09.516 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.516 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.516 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:09.516 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.013863+0000", 2024-04-19T03:02:09.516 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001883804 2024-04-19T03:02:09.516 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.516 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.516 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:09.516 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.022257+0000", 2024-04-19T03:02:09.516 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0083938290000000002 2024-04-19T03:02:09.516 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.516 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.516 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:09.516 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.022310+0000", 2024-04-19T03:02:09.516 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.236e-05 2024-04-19T03:02:09.517 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.517 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.517 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:09.517 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.022347+0000", 2024-04-19T03:02:09.517 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7653e-05 2024-04-19T03:02:09.517 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:09.517 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:09.517 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:09.517 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.517 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.517 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:35 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:02:09.517 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:14.999772+0000", 2024-04-19T03:02:09.517 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 54.496000864999999, 2024-04-19T03:02:09.518 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020205530999999999, 2024-04-19T03:02:09.518 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:09.518 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:09.518 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:09.518 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.518 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:09.518 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999772+0000", 2024-04-19T03:02:09.518 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:09.518 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.518 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.518 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:09.518 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999772+0000", 2024-04-19T03:02:09.518 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:09.519 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.519 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.519 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:09.519 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999771+0000", 2024-04-19T03:02:09.519 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:09.519 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.519 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.519 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:09.519 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999778+0000", 2024-04-19T03:02:09.519 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2200000000000003e-06 2024-04-19T03:02:09.519 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.519 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.519 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:09.520 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999794+0000", 2024-04-19T03:02:09.520 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5798999999999999e-05 2024-04-19T03:02:09.520 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.520 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.520 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:09.520 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999809+0000", 2024-04-19T03:02:09.520 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.469e-05 2024-04-19T03:02:09.520 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.520 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.520 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:09.520 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999915+0000", 2024-04-19T03:02:09.520 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000105658 2024-04-19T03:02:09.520 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.520 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.521 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:02:09.521 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999927+0000", 2024-04-19T03:02:09.521 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.201e-05 2024-04-19T03:02:09.521 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.521 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.521 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:09.521 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.009841+0000", 2024-04-19T03:02:09.521 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0099147039999999999 2024-04-19T03:02:09.521 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.521 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.521 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:09.521 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.009941+0000", 2024-04-19T03:02:09.521 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.9461000000000002e-05 2024-04-19T03:02:09.521 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.522 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.522 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-04-19T03:02:09.522 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.010101+0000", 2024-04-19T03:02:09.522 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016028599999999999 2024-04-19T03:02:09.522 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.522 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.522 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:09.522 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.011787+0000", 2024-04-19T03:02:09.522 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001685513 2024-04-19T03:02:09.522 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.522 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.522 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:09.522 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.019889+0000", 2024-04-19T03:02:09.523 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0081026559999999997 2024-04-19T03:02:09.523 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.523 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.523 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:09.523 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.019932+0000", 2024-04-19T03:02:09.523 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2385000000000002e-05 2024-04-19T03:02:09.523 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.523 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.523 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:09.523 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.019978+0000", 2024-04-19T03:02:09.523 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6093000000000001e-05 2024-04-19T03:02:09.523 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:09.523 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:09.523 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:09.524 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.524 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.524 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:24 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:02:09.524 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:14.999964+0000", 2024-04-19T03:02:09.524 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 54.495809465999997, 2024-04-19T03:02:09.524 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020451446000000002, 2024-04-19T03:02:09.524 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:09.524 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-19T03:02:09.524 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:09.524 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.524 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:09.524 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999964+0000", 2024-04-19T03:02:09.524 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:09.524 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.525 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.525 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:09.525 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999964+0000", 2024-04-19T03:02:09.525 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:09.525 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.525 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.525 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:09.525 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999963+0000", 2024-04-19T03:02:09.525 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:09.525 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.525 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.525 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:09.525 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999969+0000", 2024-04-19T03:02:09.526 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0270000000000001e-06 2024-04-19T03:02:09.526 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.526 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.526 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:09.526 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999984+0000", 2024-04-19T03:02:09.526 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5903e-05 2024-04-19T03:02:09.526 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.526 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.526 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:09.526 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999998+0000", 2024-04-19T03:02:09.526 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3076e-05 2024-04-19T03:02:09.526 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.526 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.526 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:09.527 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.000078+0000", 2024-04-19T03:02:09.527 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0525000000000006e-05 2024-04-19T03:02:09.527 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.527 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.527 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op must wait for map", 2024-04-19T03:02:09.527 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.000084+0000", 2024-04-19T03:02:09.527 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8370000000000002e-06 2024-04-19T03:02:09.527 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.527 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.527 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:09.527 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.008819+0000", 2024-04-19T03:02:09.527 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0087349019999999993 2024-04-19T03:02:09.527 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.527 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.528 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:09.528 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.009018+0000", 2024-04-19T03:02:09.528 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000198989 2024-04-19T03:02:09.528 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.528 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.528 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:09.528 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.020415+0000", 2024-04-19T03:02:09.528 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011397157 2024-04-19T03:02:09.528 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:09.528 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:09.528 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:09.528 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.528 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.528 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:11274 5.e 5:7c846032:::benchmark_data_smithi096_19531_object11273:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T03:02:09.529 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:42.061776+0000", 2024-04-19T03:02:09.529 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 27.433997220999998, 2024-04-19T03:02:09.529 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.035381001000000002, 2024-04-19T03:02:09.529 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:09.529 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:09.529 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:09.529 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:09.529 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:09.529 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 11274 2024-04-19T03:02:09.529 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.529 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:09.529 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.529 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:09.530 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.061776+0000", 2024-04-19T03:02:09.530 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:09.530 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.530 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.530 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:09.530 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.061776+0000", 2024-04-19T03:02:09.530 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:09.530 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.530 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.530 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:09.530 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.061775+0000", 2024-04-19T03:02:09.530 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:09.530 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.530 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.531 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:09.531 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.061807+0000", 2024-04-19T03:02:09.531 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1733000000000003e-05 2024-04-19T03:02:09.531 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.531 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.531 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:09.531 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.061822+0000", 2024-04-19T03:02:09.531 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5452999999999999e-05 2024-04-19T03:02:09.531 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.531 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.531 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:09.531 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.061827+0000", 2024-04-19T03:02:09.531 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9810000000000003e-06 2024-04-19T03:02:09.532 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.532 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.532 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:09.532 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.063388+0000", 2024-04-19T03:02:09.532 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0015605720000000001 2024-04-19T03:02:09.532 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.532 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.532 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:09.532 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.063612+0000", 2024-04-19T03:02:09.532 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00022431 2024-04-19T03:02:09.532 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.532 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.532 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:09.532 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.063747+0000", 2024-04-19T03:02:09.533 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013459600000000001 2024-04-19T03:02:09.533 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.533 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.533 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:09.533 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.066186+0000", 2024-04-19T03:02:09.533 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0024388909999999999 2024-04-19T03:02:09.533 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.533 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.533 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:09.533 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.097016+0000", 2024-04-19T03:02:09.533 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.030830705 2024-04-19T03:02:09.533 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.533 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.534 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:09.534 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.097096+0000", 2024-04-19T03:02:09.534 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.9469999999999996e-05 2024-04-19T03:02:09.534 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.534 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.534 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:09.534 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.097157+0000", 2024-04-19T03:02:09.534 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0884999999999997e-05 2024-04-19T03:02:09.534 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:09.534 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:09.534 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:09.534 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.534 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.534 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:11279 5.8 5:10b60c58:::benchmark_data_smithi096_19531_object11278:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T03:02:09.535 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:42.062594+0000", 2024-04-19T03:02:09.535 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 27.433178782999999, 2024-04-19T03:02:09.535 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.028696788000000001, 2024-04-19T03:02:09.535 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:09.535 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:09.535 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:09.535 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:09.535 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:09.535 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 11279 2024-04-19T03:02:09.535 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.535 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:09.535 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.535 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:09.536 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.062594+0000", 2024-04-19T03:02:09.536 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:09.536 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.536 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.536 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:09.536 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.062594+0000", 2024-04-19T03:02:09.536 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:09.536 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.536 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.536 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:09.536 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.062593+0000", 2024-04-19T03:02:09.536 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:09.536 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.537 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.537 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:09.537 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.062646+0000", 2024-04-19T03:02:09.537 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2293999999999998e-05 2024-04-19T03:02:09.537 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.537 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.537 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:09.537 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.062657+0000", 2024-04-19T03:02:09.537 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1440000000000001e-05 2024-04-19T03:02:09.537 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.537 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.537 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:09.537 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.062665+0000", 2024-04-19T03:02:09.537 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5159999999999997e-06 2024-04-19T03:02:09.538 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.538 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.538 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:09.538 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.063799+0000", 2024-04-19T03:02:09.538 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0011344860000000001 2024-04-19T03:02:09.538 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.538 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.538 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:09.538 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.063962+0000", 2024-04-19T03:02:09.538 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000162614 2024-04-19T03:02:09.538 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.538 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.538 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:09.538 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.064167+0000", 2024-04-19T03:02:09.539 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00020491699999999999 2024-04-19T03:02:09.539 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.539 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.539 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:09.539 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.066768+0000", 2024-04-19T03:02:09.539 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0026012090000000002 2024-04-19T03:02:09.539 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.539 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.539 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:09.539 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.091184+0000", 2024-04-19T03:02:09.539 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.024416582999999999 2024-04-19T03:02:09.539 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.539 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.539 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:09.540 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.091251+0000", 2024-04-19T03:02:09.540 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6753000000000003e-05 2024-04-19T03:02:09.540 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.540 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.540 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:09.540 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.091291+0000", 2024-04-19T03:02:09.540 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9841e-05 2024-04-19T03:02:09.540 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:09.540 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:09.540 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:09.540 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.540 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.540 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:11282 5.e 5:75b7c510:::benchmark_data_smithi096_19531_object11281:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T03:02:09.541 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:42.062674+0000", 2024-04-19T03:02:09.541 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 27.433099327000001, 2024-04-19T03:02:09.541 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.034812849, 2024-04-19T03:02:09.541 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:09.541 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:09.541 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:09.541 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:09.541 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:09.541 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 11282 2024-04-19T03:02:09.541 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.541 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:09.541 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.541 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:09.541 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.062674+0000", 2024-04-19T03:02:09.542 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:09.542 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.542 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.542 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:09.542 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.062674+0000", 2024-04-19T03:02:09.542 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:09.542 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.542 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.542 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:09.542 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.062673+0000", 2024-04-19T03:02:09.542 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:09.542 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.542 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.543 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:09.543 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.062712+0000", 2024-04-19T03:02:09.543 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9341999999999997e-05 2024-04-19T03:02:09.543 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.543 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.543 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:09.543 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.062721+0000", 2024-04-19T03:02:09.543 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1700000000000003e-06 2024-04-19T03:02:09.543 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.543 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.543 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:09.543 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.062729+0000", 2024-04-19T03:02:09.543 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4240000000000004e-06 2024-04-19T03:02:09.544 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.544 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.544 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:09.544 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.065017+0000", 2024-04-19T03:02:09.544 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0022878590000000002 2024-04-19T03:02:09.544 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.544 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.544 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:09.544 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.065207+0000", 2024-04-19T03:02:09.544 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000190411 2024-04-19T03:02:09.544 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.544 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.544 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:09.545 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.065323+0000", 2024-04-19T03:02:09.545 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000115593 2024-04-19T03:02:09.545 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.545 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.545 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:09.545 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.069683+0000", 2024-04-19T03:02:09.545 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0043604409999999996 2024-04-19T03:02:09.545 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.545 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.545 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:09.545 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.097273+0000", 2024-04-19T03:02:09.545 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.027589516000000001 2024-04-19T03:02:09.545 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.545 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.546 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:09.546 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.097406+0000", 2024-04-19T03:02:09.546 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000133514 2024-04-19T03:02:09.546 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.546 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.546 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:09.546 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.097486+0000", 2024-04-19T03:02:09.546 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0479e-05 2024-04-19T03:02:09.546 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:09.546 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:09.546 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:09.546 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.546 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.547 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:11288 5.0 5:042458d0:::benchmark_data_smithi096_19531_object11287:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T03:02:09.547 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:42.070352+0000", 2024-04-19T03:02:09.547 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 27.425421399000001, 2024-04-19T03:02:09.547 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.021532447, 2024-04-19T03:02:09.547 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:09.547 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:09.547 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:09.547 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:09.547 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:09.547 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 11288 2024-04-19T03:02:09.547 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.547 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:09.547 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.548 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:09.548 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.070352+0000", 2024-04-19T03:02:09.548 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:09.548 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.548 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.548 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:09.548 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.070352+0000", 2024-04-19T03:02:09.548 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:09.548 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.548 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.548 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:09.548 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.070351+0000", 2024-04-19T03:02:09.548 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:09.549 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.549 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.549 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:09.549 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.070392+0000", 2024-04-19T03:02:09.549 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1077e-05 2024-04-19T03:02:09.549 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.549 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.549 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:09.549 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.070398+0000", 2024-04-19T03:02:09.549 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1109999999999996e-06 2024-04-19T03:02:09.549 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.549 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.549 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:09.549 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.070402+0000", 2024-04-19T03:02:09.550 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2010000000000001e-06 2024-04-19T03:02:09.550 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.550 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.550 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:09.550 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.070445+0000", 2024-04-19T03:02:09.550 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2585e-05 2024-04-19T03:02:09.550 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.550 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.550 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:09.550 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.070572+0000", 2024-04-19T03:02:09.550 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012708500000000001 2024-04-19T03:02:09.550 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.550 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.550 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:09.551 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.070711+0000", 2024-04-19T03:02:09.551 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013848699999999999 2024-04-19T03:02:09.551 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.551 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.551 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:09.551 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.073505+0000", 2024-04-19T03:02:09.551 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0027944620000000002 2024-04-19T03:02:09.551 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.551 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.551 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:09.551 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.091806+0000", 2024-04-19T03:02:09.551 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.018301251000000001 2024-04-19T03:02:09.551 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.552 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.552 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:09.552 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.091854+0000", 2024-04-19T03:02:09.552 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7419000000000001e-05 2024-04-19T03:02:09.552 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.552 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.552 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:09.552 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.091884+0000", 2024-04-19T03:02:09.552 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0241999999999999e-05 2024-04-19T03:02:09.552 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:09.552 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:09.552 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:09.552 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.552 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.553 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:11292 5.0 5:009b2ea9:::benchmark_data_smithi096_19531_object11291:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T03:02:09.553 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:42.070676+0000", 2024-04-19T03:02:09.553 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 27.425097023999999, 2024-04-19T03:02:09.553 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.02219631, 2024-04-19T03:02:09.553 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:09.553 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:09.553 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:09.553 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:09.553 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:09.553 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 11292 2024-04-19T03:02:09.553 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.553 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:09.553 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.553 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:09.554 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.070676+0000", 2024-04-19T03:02:09.554 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:09.554 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.554 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.554 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:09.554 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.070676+0000", 2024-04-19T03:02:09.554 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:09.554 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.554 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.554 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:09.554 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.070675+0000", 2024-04-19T03:02:09.554 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:09.554 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.555 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.555 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:09.555 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.070800+0000", 2024-04-19T03:02:09.555 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000125263 2024-04-19T03:02:09.555 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.555 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.555 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:09.555 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.070808+0000", 2024-04-19T03:02:09.555 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0209999999999999e-06 2024-04-19T03:02:09.555 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.555 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.555 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:09.555 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.070814+0000", 2024-04-19T03:02:09.555 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0969999999999996e-06 2024-04-19T03:02:09.555 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.556 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.556 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:09.556 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.071956+0000", 2024-04-19T03:02:09.556 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0011427480000000001 2024-04-19T03:02:09.556 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.556 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.556 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:09.556 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.072153+0000", 2024-04-19T03:02:09.556 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000196524 2024-04-19T03:02:09.556 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.556 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.556 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:09.556 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.072312+0000", 2024-04-19T03:02:09.556 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015879300000000001 2024-04-19T03:02:09.557 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.557 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.557 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:09.557 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.078407+0000", 2024-04-19T03:02:09.557 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0060954929999999996 2024-04-19T03:02:09.557 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.557 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.557 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:09.557 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.092742+0000", 2024-04-19T03:02:09.557 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.014335349000000001 2024-04-19T03:02:09.557 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.557 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.557 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:09.557 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.092815+0000", 2024-04-19T03:02:09.558 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2881999999999998e-05 2024-04-19T03:02:09.558 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.558 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.558 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:09.558 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.092872+0000", 2024-04-19T03:02:09.558 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6965000000000001e-05 2024-04-19T03:02:09.558 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:09.558 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:09.558 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:09.558 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.558 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.558 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:11297 5.e 5:7975ecb6:::benchmark_data_smithi096_19531_object11296:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T03:02:09.558 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:42.076848+0000", 2024-04-19T03:02:09.558 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 27.418925143999999, 2024-04-19T03:02:09.559 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020867969, 2024-04-19T03:02:09.559 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:09.559 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:09.559 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:09.559 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:09.559 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:09.559 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 11297 2024-04-19T03:02:09.559 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.559 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:09.559 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.559 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:09.559 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.076848+0000", 2024-04-19T03:02:09.559 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:09.560 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.560 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.560 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:09.560 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.076848+0000", 2024-04-19T03:02:09.560 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:09.560 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.560 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.560 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:09.560 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.076846+0000", 2024-04-19T03:02:09.560 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:09.560 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.560 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.560 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:09.560 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.076894+0000", 2024-04-19T03:02:09.560 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7645000000000002e-05 2024-04-19T03:02:09.561 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.561 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.561 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:09.561 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.076913+0000", 2024-04-19T03:02:09.561 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8885e-05 2024-04-19T03:02:09.561 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.561 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.561 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:09.561 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.076924+0000", 2024-04-19T03:02:09.561 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.118e-05 2024-04-19T03:02:09.561 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.561 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.561 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:09.561 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.076983+0000", 2024-04-19T03:02:09.562 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8952000000000001e-05 2024-04-19T03:02:09.562 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.562 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.562 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:09.562 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.077156+0000", 2024-04-19T03:02:09.562 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00017307600000000001 2024-04-19T03:02:09.562 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.562 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.562 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:09.562 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.077358+0000", 2024-04-19T03:02:09.562 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000201991 2024-04-19T03:02:09.562 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.562 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.563 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:09.563 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.080885+0000", 2024-04-19T03:02:09.563 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0035268309999999998 2024-04-19T03:02:09.563 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.563 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.563 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:09.563 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.097569+0000", 2024-04-19T03:02:09.563 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.016683854000000001 2024-04-19T03:02:09.563 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.563 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.563 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:09.563 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.097647+0000", 2024-04-19T03:02:09.563 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.7823000000000004e-05 2024-04-19T03:02:09.563 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.564 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.564 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:09.564 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.097716+0000", 2024-04-19T03:02:09.564 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.9079999999999996e-05 2024-04-19T03:02:09.564 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:09.564 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:09.564 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:09.564 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.564 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.564 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:11298 5.e 5:72565f0a:::benchmark_data_smithi096_19531_object11297:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T03:02:09.564 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:42.076954+0000", 2024-04-19T03:02:09.564 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 27.41881927, 2024-04-19T03:02:09.564 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020950191999999999, 2024-04-19T03:02:09.564 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:09.565 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:09.565 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:09.565 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:09.565 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:09.565 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 11298 2024-04-19T03:02:09.565 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.565 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:09.565 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.565 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:09.565 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.076954+0000", 2024-04-19T03:02:09.565 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:09.565 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.565 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.565 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:09.566 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.076954+0000", 2024-04-19T03:02:09.566 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:09.566 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.566 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.566 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:09.566 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.076953+0000", 2024-04-19T03:02:09.566 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:09.566 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.566 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.566 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:09.566 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.076997+0000", 2024-04-19T03:02:09.566 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4023000000000002e-05 2024-04-19T03:02:09.566 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.567 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.567 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:09.567 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.077009+0000", 2024-04-19T03:02:09.567 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2456000000000001e-05 2024-04-19T03:02:09.567 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.567 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.567 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:09.567 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.077015+0000", 2024-04-19T03:02:09.567 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7950000000000004e-06 2024-04-19T03:02:09.567 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.567 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.567 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:09.567 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.078552+0000", 2024-04-19T03:02:09.567 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0015371320000000001 2024-04-19T03:02:09.568 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.568 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.568 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:09.568 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.078760+0000", 2024-04-19T03:02:09.568 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00020808799999999999 2024-04-19T03:02:09.568 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.568 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.568 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:09.568 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.078875+0000", 2024-04-19T03:02:09.568 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011457500000000001 2024-04-19T03:02:09.568 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.568 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.568 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:09.568 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.083603+0000", 2024-04-19T03:02:09.569 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0047276239999999997 2024-04-19T03:02:09.569 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.569 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.569 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:09.569 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.097783+0000", 2024-04-19T03:02:09.569 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.014180036 2024-04-19T03:02:09.569 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.569 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.569 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:09.569 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.097863+0000", 2024-04-19T03:02:09.569 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0317999999999999e-05 2024-04-19T03:02:09.569 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.569 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.569 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:09.569 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.097904+0000", 2024-04-19T03:02:09.570 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1035000000000003e-05 2024-04-19T03:02:09.570 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:09.570 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:09.570 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:09.570 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.570 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.570 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:41640 5.0 5:0989f358:::benchmark_data_smithi096_19531_object41639:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30)", 2024-04-19T03:02:09.570 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:55.640790+0000", 2024-04-19T03:02:09.570 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 13.854982826000001, 2024-04-19T03:02:09.570 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020000754999999999, 2024-04-19T03:02:09.570 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:09.570 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:09.570 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:09.571 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:09.571 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:09.571 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 41640 2024-04-19T03:02:09.571 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.571 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:09.571 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.571 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:09.571 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:55.640790+0000", 2024-04-19T03:02:09.571 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:09.571 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.571 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.571 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:09.571 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:55.640790+0000", 2024-04-19T03:02:09.571 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:09.572 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.572 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.572 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:09.572 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:55.640789+0000", 2024-04-19T03:02:09.572 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:09.572 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.572 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.572 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:09.572 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:55.640829+0000", 2024-04-19T03:02:09.572 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9870999999999998e-05 2024-04-19T03:02:09.572 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.572 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.572 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:09.572 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:55.640838+0000", 2024-04-19T03:02:09.573 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.8899999999999996e-06 2024-04-19T03:02:09.573 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.573 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.573 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:09.573 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:55.640843+0000", 2024-04-19T03:02:09.573 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1630000000000004e-06 2024-04-19T03:02:09.573 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.573 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.573 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:09.573 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:55.649279+0000", 2024-04-19T03:02:09.573 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0084358179999999994 2024-04-19T03:02:09.573 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.573 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.573 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:09.573 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:55.649388+0000", 2024-04-19T03:02:09.574 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010836399999999999 2024-04-19T03:02:09.574 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.574 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.574 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:09.574 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:55.649479+0000", 2024-04-19T03:02:09.574 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1284000000000002e-05 2024-04-19T03:02:09.574 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.574 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.574 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:09.574 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:55.656726+0000", 2024-04-19T03:02:09.574 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.007246962 2024-04-19T03:02:09.574 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.574 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.575 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:09.575 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:55.660689+0000", 2024-04-19T03:02:09.575 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0039628900000000002 2024-04-19T03:02:09.575 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.575 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.575 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:09.575 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:55.660755+0000", 2024-04-19T03:02:09.575 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6267999999999996e-05 2024-04-19T03:02:09.575 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.575 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.575 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:09.575 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:55.660791+0000", 2024-04-19T03:02:09.575 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5975e-05 2024-04-19T03:02:09.575 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:09.575 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:09.576 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:09.576 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.576 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.576 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:50576 5.b 5:d250063d:::benchmark_data_smithi096_19531_object50575:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-19T03:02:09.576 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:00.329584+0000", 2024-04-19T03:02:09.576 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 9.1661886559999992, 2024-04-19T03:02:09.576 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.021217389, 2024-04-19T03:02:09.576 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:09.576 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:09.576 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:09.576 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:09.576 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:09.576 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 50576 2024-04-19T03:02:09.576 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.577 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:09.577 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.577 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:09.577 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:00.329584+0000", 2024-04-19T03:02:09.577 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:09.577 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.577 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.577 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:09.577 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:00.329584+0000", 2024-04-19T03:02:09.577 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:09.577 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.577 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.577 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:09.577 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:00.329583+0000", 2024-04-19T03:02:09.578 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:09.578 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.578 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.578 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:09.578 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:00.329626+0000", 2024-04-19T03:02:09.578 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2530000000000001e-05 2024-04-19T03:02:09.578 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.578 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.578 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:09.578 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:00.329642+0000", 2024-04-19T03:02:09.578 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5891000000000001e-05 2024-04-19T03:02:09.578 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.578 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.578 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:09.578 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:00.329652+0000", 2024-04-19T03:02:09.579 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0093e-05 2024-04-19T03:02:09.579 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.579 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.579 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:09.579 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:00.330793+0000", 2024-04-19T03:02:09.579 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001141097 2024-04-19T03:02:09.579 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.579 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.579 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:09.579 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:00.330924+0000", 2024-04-19T03:02:09.579 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013114499999999999 2024-04-19T03:02:09.579 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.579 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.579 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:09.580 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:00.331055+0000", 2024-04-19T03:02:09.580 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013124600000000001 2024-04-19T03:02:09.580 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.580 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.580 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:09.580 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:00.335705+0000", 2024-04-19T03:02:09.580 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0046501549999999996 2024-04-19T03:02:09.580 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.580 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.580 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:09.580 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:00.350741+0000", 2024-04-19T03:02:09.580 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015035411 2024-04-19T03:02:09.580 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.580 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.581 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:09.581 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:00.350777+0000", 2024-04-19T03:02:09.581 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5874999999999998e-05 2024-04-19T03:02:09.581 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.581 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.581 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:09.581 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:00.350802+0000", 2024-04-19T03:02:09.581 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5040000000000001e-05 2024-04-19T03:02:09.581 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:09.581 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:09.581 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:09.581 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.581 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.581 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:52909 5.b 5:df07ce30:::benchmark_data_smithi096_19531_object52908:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-19T03:02:09.582 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:01.602899+0000", 2024-04-19T03:02:09.582 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 7.8928742859999996, 2024-04-19T03:02:09.582 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020403345, 2024-04-19T03:02:09.582 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:09.582 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:09.582 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:09.582 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:09.582 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:09.582 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 52909 2024-04-19T03:02:09.582 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.582 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:09.582 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.582 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:09.582 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:01.602899+0000", 2024-04-19T03:02:09.583 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:09.583 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.583 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.583 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:09.583 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:01.602899+0000", 2024-04-19T03:02:09.583 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:09.583 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.583 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.583 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:09.583 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:01.602883+0000", 2024-04-19T03:02:09.583 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999838 2024-04-19T03:02:09.583 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.583 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.583 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:09.584 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:01.602956+0000", 2024-04-19T03:02:09.584 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2941000000000005e-05 2024-04-19T03:02:09.584 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.584 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.584 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:09.584 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:01.602970+0000", 2024-04-19T03:02:09.584 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4562999999999999e-05 2024-04-19T03:02:09.584 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.584 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.584 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:09.584 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:01.602981+0000", 2024-04-19T03:02:09.584 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1134999999999999e-05 2024-04-19T03:02:09.584 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.584 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.585 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:09.585 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:01.603043+0000", 2024-04-19T03:02:09.585 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2034999999999998e-05 2024-04-19T03:02:09.585 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.585 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.585 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:09.585 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:01.603173+0000", 2024-04-19T03:02:09.585 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012962800000000001 2024-04-19T03:02:09.585 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.585 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.585 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:09.585 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:01.603296+0000", 2024-04-19T03:02:09.585 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012313 2024-04-19T03:02:09.585 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.586 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.586 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:09.586 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:01.606862+0000", 2024-04-19T03:02:09.586 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0035656049999999999 2024-04-19T03:02:09.586 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.586 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.586 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:09.586 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:01.623147+0000", 2024-04-19T03:02:09.586 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.016285286 2024-04-19T03:02:09.586 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.586 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.586 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:09.586 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:01.623251+0000", 2024-04-19T03:02:09.586 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000104245 2024-04-19T03:02:09.587 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.587 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.587 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:09.587 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:01.623302+0000", 2024-04-19T03:02:09.587 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0763999999999997e-05 2024-04-19T03:02:09.587 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:09.587 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:09.587 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:09.587 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.587 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.587 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:52912 5.b 5:deddbeae:::benchmark_data_smithi096_19531_object52911:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-19T03:02:09.587 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:01.603006+0000", 2024-04-19T03:02:09.587 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 7.892766495, 2024-04-19T03:02:09.587 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020493783000000002, 2024-04-19T03:02:09.588 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:09.588 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:09.588 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:09.588 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:09.588 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:09.588 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 52912 2024-04-19T03:02:09.588 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.588 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:09.588 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.588 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:09.588 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:01.603006+0000", 2024-04-19T03:02:09.588 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:09.588 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.588 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.589 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:09.589 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:01.603006+0000", 2024-04-19T03:02:09.589 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:09.589 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.589 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.589 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:09.589 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:01.603006+0000", 2024-04-19T03:02:09.589 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:09.589 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.589 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.589 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:09.589 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:01.603054+0000", 2024-04-19T03:02:09.589 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8529000000000002e-05 2024-04-19T03:02:09.589 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.590 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.590 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:09.590 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:01.603067+0000", 2024-04-19T03:02:09.590 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2412000000000001e-05 2024-04-19T03:02:09.590 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.590 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.590 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:09.590 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:01.603078+0000", 2024-04-19T03:02:09.590 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1059e-05 2024-04-19T03:02:09.590 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.590 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.590 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:09.590 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:01.605226+0000", 2024-04-19T03:02:09.590 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0021488029999999999 2024-04-19T03:02:09.591 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.591 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.591 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:09.591 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:01.605333+0000", 2024-04-19T03:02:09.591 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000106346 2024-04-19T03:02:09.591 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.591 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.591 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:09.591 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:01.605426+0000", 2024-04-19T03:02:09.591 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.2985999999999994e-05 2024-04-19T03:02:09.591 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.591 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.591 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:09.591 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:01.607251+0000", 2024-04-19T03:02:09.592 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0018255789999999999 2024-04-19T03:02:09.592 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.592 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.592 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:09.592 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:01.623413+0000", 2024-04-19T03:02:09.592 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.016161854999999999 2024-04-19T03:02:09.592 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.592 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.592 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:09.592 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:01.623448+0000", 2024-04-19T03:02:09.592 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4498000000000001e-05 2024-04-19T03:02:09.592 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.592 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.592 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:09.593 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:01.623500+0000", 2024-04-19T03:02:09.593 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2543999999999997e-05 2024-04-19T03:02:09.593 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:09.593 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:09.593 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:09.593 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.593 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.593 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:57961 5.4 5:25b0464f:::benchmark_data_smithi096_19531_object57960:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-19T03:02:09.593 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:04.472703+0000", 2024-04-19T03:02:09.593 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 5.0230702120000004, 2024-04-19T03:02:09.593 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.021714888000000002, 2024-04-19T03:02:09.593 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:09.593 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:09.593 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:09.594 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:09.594 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:09.594 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 57961 2024-04-19T03:02:09.594 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.594 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:09.594 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.594 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:09.594 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:04.472703+0000", 2024-04-19T03:02:09.594 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:09.594 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.594 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.594 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:09.594 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:04.472703+0000", 2024-04-19T03:02:09.595 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:09.595 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.595 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.595 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:09.595 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:04.472701+0000", 2024-04-19T03:02:09.595 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:09.595 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.595 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.595 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:09.595 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:04.472805+0000", 2024-04-19T03:02:09.595 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000103268 2024-04-19T03:02:09.595 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.595 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.595 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:09.596 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:04.472818+0000", 2024-04-19T03:02:09.596 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3528e-05 2024-04-19T03:02:09.596 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.596 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.596 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:09.596 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:04.472825+0000", 2024-04-19T03:02:09.596 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.0210000000000002e-06 2024-04-19T03:02:09.596 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.596 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.596 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:09.596 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:04.473983+0000", 2024-04-19T03:02:09.596 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0011581600000000001 2024-04-19T03:02:09.596 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.597 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.597 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:09.597 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:04.474201+0000", 2024-04-19T03:02:09.597 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00021749000000000001 2024-04-19T03:02:09.597 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.597 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.597 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:09.597 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:04.474378+0000", 2024-04-19T03:02:09.597 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00017696300000000001 2024-04-19T03:02:09.597 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.597 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.597 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:09.597 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:04.477308+0000", 2024-04-19T03:02:09.597 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0029298140000000002 2024-04-19T03:02:09.598 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.598 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.598 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:09.598 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:04.494322+0000", 2024-04-19T03:02:09.598 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.017014567000000001 2024-04-19T03:02:09.598 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.598 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.598 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:09.598 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:04.494386+0000", 2024-04-19T03:02:09.598 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4122999999999996e-05 2024-04-19T03:02:09.598 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.598 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.598 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:09.599 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:04.494418+0000", 2024-04-19T03:02:09.599 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1245999999999999e-05 2024-04-19T03:02:09.599 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:09.599 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:09.599 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:09.599 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.599 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.599 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:58042 5.b 5:d6f19b42:::benchmark_data_smithi096_19531_object58041:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-19T03:02:09.599 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:04.520286+0000", 2024-04-19T03:02:09.599 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 4.9754868170000002, 2024-04-19T03:02:09.599 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020956167000000001, 2024-04-19T03:02:09.599 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:09.599 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:09.600 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:09.600 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:09.600 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:09.600 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 58042 2024-04-19T03:02:09.600 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.600 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:09.600 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.600 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:09.600 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:04.520286+0000", 2024-04-19T03:02:09.600 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:09.600 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.600 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.600 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:09.600 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:04.520286+0000", 2024-04-19T03:02:09.601 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:09.601 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.601 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.601 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:09.601 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:04.520285+0000", 2024-04-19T03:02:09.601 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:09.601 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.601 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.601 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:09.601 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:04.520374+0000", 2024-04-19T03:02:09.601 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9599999999999996e-05 2024-04-19T03:02:09.601 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.601 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.601 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:09.602 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:04.520409+0000", 2024-04-19T03:02:09.602 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4952e-05 2024-04-19T03:02:09.602 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.602 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.602 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:09.602 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:04.520421+0000", 2024-04-19T03:02:09.602 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.187e-05 2024-04-19T03:02:09.602 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.602 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.602 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:09.602 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:04.523527+0000", 2024-04-19T03:02:09.602 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.003105465 2024-04-19T03:02:09.602 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.603 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.603 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:09.603 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:04.523740+0000", 2024-04-19T03:02:09.603 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00021303500000000001 2024-04-19T03:02:09.603 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.603 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.603 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:09.603 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:04.523947+0000", 2024-04-19T03:02:09.603 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00020676599999999999 2024-04-19T03:02:09.603 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.603 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.603 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:09.603 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:04.532791+0000", 2024-04-19T03:02:09.603 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0088447079999999997 2024-04-19T03:02:09.603 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.604 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.604 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:09.604 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:04.541145+0000", 2024-04-19T03:02:09.604 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0083535620000000001 2024-04-19T03:02:09.605 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.605 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.605 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:09.605 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:04.541208+0000", 2024-04-19T03:02:09.605 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3303e-05 2024-04-19T03:02:09.605 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.605 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.605 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:09.605 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:04.541242+0000", 2024-04-19T03:02:09.606 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4226000000000001e-05 2024-04-19T03:02:09.606 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:09.606 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:09.606 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:09.606 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.606 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.606 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:59827 5.d 5:b422f98a:::benchmark_data_smithi096_19531_object59826:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-19T03:02:09.606 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:05.531472+0000", 2024-04-19T03:02:09.606 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 3.964300997, 2024-04-19T03:02:09.606 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.021435431000000001, 2024-04-19T03:02:09.606 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:09.606 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:09.606 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:09.606 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:09.607 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:09.607 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 59827 2024-04-19T03:02:09.607 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.607 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:09.607 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.607 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:09.607 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:05.531472+0000", 2024-04-19T03:02:09.607 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:09.607 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.607 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.607 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:09.607 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:05.531472+0000", 2024-04-19T03:02:09.607 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:09.608 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.608 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.608 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:09.608 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:05.531471+0000", 2024-04-19T03:02:09.608 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:09.608 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.608 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.608 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:09.608 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:05.531501+0000", 2024-04-19T03:02:09.608 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0012999999999999e-05 2024-04-19T03:02:09.608 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.608 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.608 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:09.609 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:05.531509+0000", 2024-04-19T03:02:09.609 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.221e-06 2024-04-19T03:02:09.609 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.609 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.609 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:09.609 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:05.531514+0000", 2024-04-19T03:02:09.609 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2190000000000003e-06 2024-04-19T03:02:09.609 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.609 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.609 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:09.609 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:05.531554+0000", 2024-04-19T03:02:09.609 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9907999999999998e-05 2024-04-19T03:02:09.609 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.610 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.610 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:09.610 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:05.531677+0000", 2024-04-19T03:02:09.610 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012335699999999999 2024-04-19T03:02:09.610 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.610 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.610 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-04-19T03:02:09.610 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:05.531811+0000", 2024-04-19T03:02:09.610 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000133645 2024-04-19T03:02:09.610 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.610 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.610 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:09.611 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:05.535051+0000", 2024-04-19T03:02:09.611 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0032405889999999999 2024-04-19T03:02:09.611 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.611 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.611 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:09.611 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:05.552796+0000", 2024-04-19T03:02:09.611 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.017744138 2024-04-19T03:02:09.611 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.611 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.611 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:09.611 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:05.552859+0000", 2024-04-19T03:02:09.611 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3649e-05 2024-04-19T03:02:09.611 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.611 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.612 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:09.612 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:05.552907+0000", 2024-04-19T03:02:09.612 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8231e-05 2024-04-19T03:02:09.612 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:09.612 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:09.612 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:09.612 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.612 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.612 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:60972 5.b 5:d54d473f:::benchmark_data_smithi096_19531_object60971:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-19T03:02:09.612 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:06.223871+0000", 2024-04-19T03:02:09.612 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 3.2719016440000002, 2024-04-19T03:02:09.612 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.021863176000000002, 2024-04-19T03:02:09.612 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:09.612 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:09.613 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:09.613 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:09.613 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:09.613 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 60972 2024-04-19T03:02:09.613 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.613 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:09.613 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.613 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:09.613 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:06.223871+0000", 2024-04-19T03:02:09.613 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:09.613 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.613 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.613 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:09.614 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:06.223871+0000", 2024-04-19T03:02:09.614 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:09.614 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.614 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.614 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:09.614 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:06.223870+0000", 2024-04-19T03:02:09.614 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:09.614 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.614 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.614 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:09.614 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:06.223943+0000", 2024-04-19T03:02:09.614 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2619000000000004e-05 2024-04-19T03:02:09.614 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.614 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.615 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:09.615 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:06.223954+0000", 2024-04-19T03:02:09.615 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0491e-05 2024-04-19T03:02:09.615 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.615 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.615 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:09.615 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:06.223961+0000", 2024-04-19T03:02:09.615 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2089999999999999e-06 2024-04-19T03:02:09.615 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.615 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.615 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:09.615 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:06.224005+0000", 2024-04-19T03:02:09.615 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3884999999999997e-05 2024-04-19T03:02:09.616 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.616 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.616 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:09.616 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:06.224101+0000", 2024-04-19T03:02:09.616 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.6508000000000005e-05 2024-04-19T03:02:09.616 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.616 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.616 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:09.616 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:06.224200+0000", 2024-04-19T03:02:09.616 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.8870999999999996e-05 2024-04-19T03:02:09.616 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.616 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.616 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:09.616 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:06.230624+0000", 2024-04-19T03:02:09.617 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0064236110000000001 2024-04-19T03:02:09.617 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.617 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.617 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:09.617 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:06.245639+0000", 2024-04-19T03:02:09.617 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015015379000000001 2024-04-19T03:02:09.617 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.617 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.617 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:09.617 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:06.245701+0000", 2024-04-19T03:02:09.617 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1663999999999998e-05 2024-04-19T03:02:09.617 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:09.617 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:09.617 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:09.618 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:06.245735+0000", 2024-04-19T03:02:09.618 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3785000000000003e-05 2024-04-19T03:02:09.618 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:09.618 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:09.618 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:09.618 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:09.618 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:09.618 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-19T03:02:09.620 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T03:02:09.620 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:09.615+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:09.721 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:09.717+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:09.744 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-04-19T03:02:09.745 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [ 2024-04-19T03:02:09.745 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:09.745 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4755.0:66923 5.d e37/22 5:b3e479ee:::benchmark_data_smithi096_19531_object66922:head v 37'4224, mlcod=37'4220)", 2024-04-19T03:02:09.745 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:09.739509+0000", 2024-04-19T03:02:09.745 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0040323570000000003, 2024-04-19T03:02:09.745 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.004063077, 2024-04-19T03:02:09.745 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:09.745 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-04-19T03:02:09.745 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:09.745 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:09.745 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:09.745 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:09.739509+0000", 2024-04-19T03:02:09.746 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:09.746 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:09.746 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:09.746 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:09.746 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:09.739509+0000", 2024-04-19T03:02:09.746 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:09.746 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:09.746 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:09.746 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:09.746 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:09.739508+0000", 2024-04-19T03:02:09.746 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:09.746 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:09.746 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:09.746 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:09.747 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:09.739566+0000", 2024-04-19T03:02:09.747 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7859000000000003e-05 2024-04-19T03:02:09.747 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:09.747 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:09.747 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:09.747 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:09.739574+0000", 2024-04-19T03:02:09.747 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6109999999999996e-06 2024-04-19T03:02:09.747 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:09.747 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:09.747 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:09.747 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:09.739579+0000", 2024-04-19T03:02:09.747 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6809999999999997e-06 2024-04-19T03:02:09.747 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:09.747 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:09.748 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:09.748 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:09.739618+0000", 2024-04-19T03:02:09.748 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9511999999999997e-05 2024-04-19T03:02:09.748 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:09.748 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:09.748 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:09.748 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:09.739642+0000", 2024-04-19T03:02:09.748 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.3651000000000001e-05 2024-04-19T03:02:09.748 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:09.748 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:09.748 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:09.748 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:09.748 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:09.748 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4755.0:66928 5.6 e37/22 5:64e8c906:::benchmark_data_smithi096_19531_object66927:head v 37'4244, mlcod=37'4241)", 2024-04-19T03:02:09.749 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:09.739771+0000", 2024-04-19T03:02:09.749 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0037712969999999998, 2024-04-19T03:02:09.749 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.003880863, 2024-04-19T03:02:09.749 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:09.749 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-04-19T03:02:09.749 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:09.749 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:09.749 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:09.749 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:09.739771+0000", 2024-04-19T03:02:09.749 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:09.749 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:09.749 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:09.749 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:09.749 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:09.739771+0000", 2024-04-19T03:02:09.750 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:09.750 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:09.750 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:09.750 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:09.750 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:09.739770+0000", 2024-04-19T03:02:09.750 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:09.750 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:09.750 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:09.750 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:09.750 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:09.739835+0000", 2024-04-19T03:02:09.750 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5341999999999999e-05 2024-04-19T03:02:09.750 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:09.750 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:09.751 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:09.751 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:09.739841+0000", 2024-04-19T03:02:09.751 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3310000000000003e-06 2024-04-19T03:02:09.751 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:09.751 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:09.751 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:09.751 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:09.739844+0000", 2024-04-19T03:02:09.751 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3409999999999999e-06 2024-04-19T03:02:09.751 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:09.751 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:09.751 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:09.751 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:09.739886+0000", 2024-04-19T03:02:09.751 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1974000000000002e-05 2024-04-19T03:02:09.751 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:09.751 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:09.752 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:09.752 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:09.739912+0000", 2024-04-19T03:02:09.752 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.6106999999999999e-05 2024-04-19T03:02:09.752 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:09.752 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:09.752 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:09.752 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:09.752 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:09.752 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:66930 5.9 5:9ca229e3:::benchmark_data_smithi096_19531_object66929:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T03:02:09.752 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:09.741147+0000", 2024-04-19T03:02:09.752 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.002394462, 2024-04-19T03:02:09.752 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0025842209999999998, 2024-04-19T03:02:09.752 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:09.752 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:02:09.753 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:09.753 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:09.753 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:09.753 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 66930 2024-04-19T03:02:09.753 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:09.753 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:09.753 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:09.753 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:09.753 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:09.741147+0000", 2024-04-19T03:02:09.753 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:09.753 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:09.753 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:09.753 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:09.753 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:09.741147+0000", 2024-04-19T03:02:09.754 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:09.754 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:09.754 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:09.754 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:09.754 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:09.741146+0000", 2024-04-19T03:02:09.754 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:09.754 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:09.754 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:09.754 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:09.754 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:09.741211+0000", 2024-04-19T03:02:09.754 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4820000000000006e-05 2024-04-19T03:02:09.754 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:09.755 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:09.755 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:09.755 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:09.741229+0000", 2024-04-19T03:02:09.755 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8618999999999999e-05 2024-04-19T03:02:09.755 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:09.755 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:09.755 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:09.755 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:09.741244+0000", 2024-04-19T03:02:09.755 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4868000000000001e-05 2024-04-19T03:02:09.755 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:09.755 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:09.756 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:09.756 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:09.741309+0000", 2024-04-19T03:02:09.756 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5018999999999995e-05 2024-04-19T03:02:09.756 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:09.756 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:09.756 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:09.756 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:09.741496+0000", 2024-04-19T03:02:09.756 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00018687900000000001 2024-04-19T03:02:09.756 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:09.756 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:09.756 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:02:09.756 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:09.741741+0000", 2024-04-19T03:02:09.756 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00024475799999999998 2024-04-19T03:02:09.756 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:09.757 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:09.757 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:09.757 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:09.757 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:09.757 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4755.0:66929 5.c e37/22 5:39f4767c:::benchmark_data_smithi096_19531_object66928:head v 37'4264, mlcod=37'4260)", 2024-04-19T03:02:09.757 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:09.741555+0000", 2024-04-19T03:02:09.757 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0019869750000000002, 2024-04-19T03:02:09.757 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0022645299999999998, 2024-04-19T03:02:09.757 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:09.757 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-04-19T03:02:09.757 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:09.757 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:09.757 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:09.757 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:09.741555+0000", 2024-04-19T03:02:09.757 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:09.758 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:09.758 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:09.758 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:09.758 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:09.741555+0000", 2024-04-19T03:02:09.758 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:09.758 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:09.758 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:09.758 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:09.758 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:09.741554+0000", 2024-04-19T03:02:09.758 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:09.758 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:09.758 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:09.758 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:09.758 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:09.741628+0000", 2024-04-19T03:02:09.759 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.3271999999999999e-05 2024-04-19T03:02:09.759 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:09.759 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:09.759 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:09.759 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:09.741641+0000", 2024-04-19T03:02:09.759 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3098999999999999e-05 2024-04-19T03:02:09.759 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:09.759 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:09.759 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:09.759 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:09.741648+0000", 2024-04-19T03:02:09.759 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4089999999999997e-06 2024-04-19T03:02:09.759 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:09.759 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:09.760 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:09.760 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:09.741688+0000", 2024-04-19T03:02:09.760 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0342000000000001e-05 2024-04-19T03:02:09.760 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:09.760 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:09.760 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:09.760 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:09.741706+0000", 2024-04-19T03:02:09.760 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7425e-05 2024-04-19T03:02:09.760 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:09.760 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:09.760 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:09.760 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:09.760 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:09.760 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:66931 5.1 5:8b157283:::benchmark_data_smithi096_19531_object66930:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T03:02:09.761 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:09.741721+0000", 2024-04-19T03:02:09.761 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.001820826, 2024-04-19T03:02:09.761 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0021756980000000002, 2024-04-19T03:02:09.761 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:09.761 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:02:09.761 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:09.761 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:09.761 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:09.761 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 66931 2024-04-19T03:02:09.761 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:09.761 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:09.761 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:09.761 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:09.761 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:09.741721+0000", 2024-04-19T03:02:09.762 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:09.762 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:09.762 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:09.762 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:09.762 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:09.741721+0000", 2024-04-19T03:02:09.762 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:09.762 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:09.762 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:09.762 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:09.762 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:09.741720+0000", 2024-04-19T03:02:09.762 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:09.762 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:09.763 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:09.763 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:09.763 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:09.741765+0000", 2024-04-19T03:02:09.763 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5314e-05 2024-04-19T03:02:09.763 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:09.763 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:09.763 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:09.763 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:09.741776+0000", 2024-04-19T03:02:09.763 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.101e-05 2024-04-19T03:02:09.763 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:09.763 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:09.763 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:09.763 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:09.741787+0000", 2024-04-19T03:02:09.763 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1005999999999999e-05 2024-04-19T03:02:09.764 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:09.764 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:09.764 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:09.764 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:09.741838+0000", 2024-04-19T03:02:09.764 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0317e-05 2024-04-19T03:02:09.764 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:09.764 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:09.764 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:09.764 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:09.741981+0000", 2024-04-19T03:02:09.764 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00014354999999999999 2024-04-19T03:02:09.764 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:09.764 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:09.764 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:09.764 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:09.742151+0000", 2024-04-19T03:02:09.765 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00016982600000000001 2024-04-19T03:02:09.765 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:09.765 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:09.765 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:09.765 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:09.765 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:09.765 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4755.0:66933 5.c e37/22)", 2024-04-19T03:02:09.765 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:09.743573+0000", 2024-04-19T03:02:09.765 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4294967295.999969, 2024-04-19T03:02:09.765 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00040651800000000003, 2024-04-19T03:02:09.765 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:09.765 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-04-19T03:02:09.765 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:09.765 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:09.766 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:09.766 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:09.743573+0000", 2024-04-19T03:02:09.766 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:09.766 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:09.766 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:09.766 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:09.766 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:09.743573+0000", 2024-04-19T03:02:09.766 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:09.766 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:09.766 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:09.766 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:09.766 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:09.743572+0000", 2024-04-19T03:02:09.766 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:09.766 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:09.767 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:09.767 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:09.767 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:09.743614+0000", 2024-04-19T03:02:09.767 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1659999999999998e-05 2024-04-19T03:02:09.767 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:09.767 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:09.767 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:09.767 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:09.743630+0000", 2024-04-19T03:02:09.767 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.5832e-05 2024-04-19T03:02:09.767 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:09.767 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:09.767 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:09.767 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:09.743636+0000", 2024-04-19T03:02:09.768 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6139999999999997e-06 2024-04-19T03:02:09.768 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:09.768 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:09.768 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:09.768 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:09.768 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:09.768 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4755.0:66924 5.d e37/22)", 2024-04-19T03:02:09.768 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:09.743743+0000", 2024-04-19T03:02:09.768 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4294967295.9997988, 2024-04-19T03:02:09.768 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00028987499999999999, 2024-04-19T03:02:09.768 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:09.768 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-04-19T03:02:09.768 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:09.768 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:09.768 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:09.769 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:09.743743+0000", 2024-04-19T03:02:09.769 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:09.769 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:09.769 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:09.769 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:09.769 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:09.743743+0000", 2024-04-19T03:02:09.769 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:09.769 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:09.769 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:09.769 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:09.769 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:09.743743+0000", 2024-04-19T03:02:09.769 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:09.769 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:09.770 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:09.770 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:09.770 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:09.743798+0000", 2024-04-19T03:02:09.770 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5671000000000003e-05 2024-04-19T03:02:09.770 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:09.770 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:09.770 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:09.770 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:09.743819+0000", 2024-04-19T03:02:09.770 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1160999999999999e-05 2024-04-19T03:02:09.770 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:09.770 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:09.770 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:09.770 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:09.743825+0000", 2024-04-19T03:02:09.770 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9349999999999999e-06 2024-04-19T03:02:09.771 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:09.771 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:09.771 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:09.771 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:09.771 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-04-19T03:02:09.771 INFO:teuthology.orchestra.run.smithi144.stdout: "num_ops": 7 2024-04-19T03:02:09.771 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-04-19T03:02:09.772 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T03:02:09.821 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:09.819+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:09.823 INFO:tasks.radosbench.radosbench.0.smithi096.stdout: 32 16 67068 67052 130.946 107.688 0.00890592 0.00763074 2024-04-19T03:02:09.895 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-04-19T03:02:09.895 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2024-04-19T03:02:09.895 INFO:teuthology.orchestra.run.smithi144.stdout: "complaint_time": 30, 2024-04-19T03:02:09.895 INFO:teuthology.orchestra.run.smithi144.stdout: "num_blocked_ops": 0 2024-04-19T03:02:09.896 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-04-19T03:02:09.907 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T03:02:09.922 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-04-19T03:02:09.918+0000 7f35986ab700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18243) UID: 0 2024-04-19T03:02:10.023 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:10.019+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:10.040 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-04-19T03:02:10.041 INFO:teuthology.orchestra.run.smithi144.stdout: "size": 20, 2024-04-19T03:02:10.041 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 600, 2024-04-19T03:02:10.041 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [ 2024-04-19T03:02:10.041 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.041 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4159.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-19T03:02:10.041 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:01:08.151173+0000", 2024-04-19T03:02:10.041 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 61.886475935, 2024-04-19T03:02:10.041 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.023083023000000001, 2024-04-19T03:02:10.041 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:10.041 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:10.041 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:10.042 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4159", 2024-04-19T03:02:10.042 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3589238956", 2024-04-19T03:02:10.042 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 141 2024-04-19T03:02:10.042 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.042 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:10.042 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.042 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:10.042 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.151173+0000", 2024-04-19T03:02:10.042 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:10.042 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.042 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.042 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:10.042 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.151173+0000", 2024-04-19T03:02:10.043 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:10.043 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.043 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.043 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:10.043 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.151171+0000", 2024-04-19T03:02:10.043 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:10.043 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.043 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.043 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:10.043 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.151182+0000", 2024-04-19T03:02:10.043 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0730000000000001e-05 2024-04-19T03:02:10.043 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.043 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.044 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:10.044 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.151203+0000", 2024-04-19T03:02:10.044 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0387e-05 2024-04-19T03:02:10.044 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.044 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.044 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:10.044 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.151225+0000", 2024-04-19T03:02:10.044 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2643e-05 2024-04-19T03:02:10.044 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.044 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.044 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:10.044 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.169207+0000", 2024-04-19T03:02:10.044 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.017981561 2024-04-19T03:02:10.045 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.045 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.045 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:10.045 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.169386+0000", 2024-04-19T03:02:10.045 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000178758 2024-04-19T03:02:10.045 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.045 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.045 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:02:10.045 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.169546+0000", 2024-04-19T03:02:10.045 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000160781 2024-04-19T03:02:10.045 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.045 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.045 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:10.046 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.171444+0000", 2024-04-19T03:02:10.046 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0018980309999999999 2024-04-19T03:02:10.046 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.046 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.046 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:10.046 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.174165+0000", 2024-04-19T03:02:10.046 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0027204920000000001 2024-04-19T03:02:10.046 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.046 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.046 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:10.046 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.174228+0000", 2024-04-19T03:02:10.046 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2774000000000006e-05 2024-04-19T03:02:10.046 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.047 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.047 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:10.047 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.174256+0000", 2024-04-19T03:02:10.047 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.8045999999999999e-05 2024-04-19T03:02:10.047 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:10.047 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:10.047 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:10.047 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.047 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.047 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4159.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-19T03:02:10.047 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:01:08.347807+0000", 2024-04-19T03:02:10.047 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 61.689841927000003, 2024-04-19T03:02:10.047 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.021589991999999999, 2024-04-19T03:02:10.047 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:10.048 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:10.048 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:10.048 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4159", 2024-04-19T03:02:10.048 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3589238956", 2024-04-19T03:02:10.048 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 165 2024-04-19T03:02:10.048 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.048 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:10.048 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.048 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:10.048 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.347807+0000", 2024-04-19T03:02:10.048 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:10.048 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.048 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.048 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:10.049 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.347807+0000", 2024-04-19T03:02:10.049 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:10.049 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.049 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.049 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:10.049 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.347806+0000", 2024-04-19T03:02:10.049 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:10.049 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.049 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.049 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:10.049 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.347812+0000", 2024-04-19T03:02:10.049 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.066e-06 2024-04-19T03:02:10.049 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.050 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.050 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:10.050 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.347818+0000", 2024-04-19T03:02:10.050 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5550000000000002e-06 2024-04-19T03:02:10.050 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.050 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.050 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:10.050 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.347822+0000", 2024-04-19T03:02:10.050 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.561e-06 2024-04-19T03:02:10.050 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.050 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.050 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:10.050 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.365703+0000", 2024-04-19T03:02:10.051 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.017880566000000001 2024-04-19T03:02:10.051 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.051 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.051 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:10.051 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.365805+0000", 2024-04-19T03:02:10.051 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00010213900000000001 2024-04-19T03:02:10.051 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.051 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.051 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:02:10.051 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.365928+0000", 2024-04-19T03:02:10.051 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00012337900000000001 2024-04-19T03:02:10.051 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.051 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.051 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:10.051 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.367353+0000", 2024-04-19T03:02:10.052 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001424397 2024-04-19T03:02:10.052 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.052 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.052 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:10.052 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.369260+0000", 2024-04-19T03:02:10.052 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0019069130000000001 2024-04-19T03:02:10.052 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.052 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.052 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:10.052 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.369342+0000", 2024-04-19T03:02:10.052 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2423999999999996e-05 2024-04-19T03:02:10.052 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.052 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.053 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:10.053 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.369397+0000", 2024-04-19T03:02:10.053 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4481999999999998e-05 2024-04-19T03:02:10.053 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:10.053 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:10.053 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:10.053 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.053 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.053 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4159.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-19T03:02:10.053 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:01:08.539135+0000", 2024-04-19T03:02:10.053 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 61.498513668999998, 2024-04-19T03:02:10.053 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.021590602, 2024-04-19T03:02:10.053 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:10.054 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:10.054 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:10.054 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4159", 2024-04-19T03:02:10.054 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3589238956", 2024-04-19T03:02:10.054 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 188 2024-04-19T03:02:10.054 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.054 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:10.054 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.054 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:10.054 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.539135+0000", 2024-04-19T03:02:10.054 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:10.054 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.054 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.055 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:10.055 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.539135+0000", 2024-04-19T03:02:10.055 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:10.055 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.055 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.055 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:10.055 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.539134+0000", 2024-04-19T03:02:10.055 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:10.055 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.055 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.055 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:10.055 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.539228+0000", 2024-04-19T03:02:10.056 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.3771999999999996e-05 2024-04-19T03:02:10.056 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.056 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.056 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:10.056 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.539243+0000", 2024-04-19T03:02:10.056 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4707e-05 2024-04-19T03:02:10.056 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.056 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.056 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:10.056 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.539250+0000", 2024-04-19T03:02:10.057 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7190000000000001e-06 2024-04-19T03:02:10.057 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.057 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.057 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:10.057 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.553787+0000", 2024-04-19T03:02:10.057 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.014536248999999999 2024-04-19T03:02:10.057 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.057 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.057 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:10.057 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.553857+0000", 2024-04-19T03:02:10.057 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0675999999999999e-05 2024-04-19T03:02:10.057 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.057 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.057 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:02:10.058 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.553953+0000", 2024-04-19T03:02:10.058 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.5420999999999993e-05 2024-04-19T03:02:10.058 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.058 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.058 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:10.058 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.555569+0000", 2024-04-19T03:02:10.058 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001616625 2024-04-19T03:02:10.058 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.058 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.058 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:10.058 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.560644+0000", 2024-04-19T03:02:10.058 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0050749660000000002 2024-04-19T03:02:10.058 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.059 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.059 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:10.059 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.560690+0000", 2024-04-19T03:02:10.059 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6041000000000002e-05 2024-04-19T03:02:10.059 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.059 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.059 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:10.059 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.560726+0000", 2024-04-19T03:02:10.059 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5188999999999998e-05 2024-04-19T03:02:10.059 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:10.059 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:10.059 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:10.059 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.059 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.060 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4159.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-19T03:02:10.060 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:01:08.539259+0000", 2024-04-19T03:02:10.060 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 61.498389201000002, 2024-04-19T03:02:10.060 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.021552071999999999, 2024-04-19T03:02:10.060 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:10.060 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:10.060 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:10.060 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4159", 2024-04-19T03:02:10.060 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3589238956", 2024-04-19T03:02:10.060 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 189 2024-04-19T03:02:10.060 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.060 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:10.060 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.060 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:10.061 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.539259+0000", 2024-04-19T03:02:10.061 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:10.061 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.061 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.061 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:10.061 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.539259+0000", 2024-04-19T03:02:10.061 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:10.061 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.061 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.061 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:10.061 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.539259+0000", 2024-04-19T03:02:10.061 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:10.061 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.062 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.062 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:10.062 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.539268+0000", 2024-04-19T03:02:10.062 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.5359999999999998e-06 2024-04-19T03:02:10.062 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.062 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.062 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:10.062 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.539291+0000", 2024-04-19T03:02:10.062 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2687000000000001e-05 2024-04-19T03:02:10.062 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.062 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.062 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:10.062 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.539298+0000", 2024-04-19T03:02:10.062 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.883e-06 2024-04-19T03:02:10.063 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.063 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.063 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:10.063 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.554957+0000", 2024-04-19T03:02:10.063 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.015659019999999999 2024-04-19T03:02:10.063 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.063 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.063 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:10.063 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.555010+0000", 2024-04-19T03:02:10.063 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2985999999999997e-05 2024-04-19T03:02:10.063 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.063 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.063 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:02:10.064 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.555094+0000", 2024-04-19T03:02:10.064 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4530000000000006e-05 2024-04-19T03:02:10.064 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.064 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.064 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:10.064 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.556093+0000", 2024-04-19T03:02:10.064 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00099903300000000008 2024-04-19T03:02:10.064 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.064 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.064 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:10.064 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.560759+0000", 2024-04-19T03:02:10.064 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0046654369999999997 2024-04-19T03:02:10.064 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.064 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.065 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:10.065 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.560789+0000", 2024-04-19T03:02:10.065 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0638e-05 2024-04-19T03:02:10.065 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.065 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.065 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:10.065 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.560811+0000", 2024-04-19T03:02:10.065 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2167999999999998e-05 2024-04-19T03:02:10.065 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:10.065 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:10.065 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:10.065 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.065 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.065 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:8 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:02:10.065 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:01:14.998165+0000", 2024-04-19T03:02:10.066 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 55.039483519999997, 2024-04-19T03:02:10.066 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.024541001, 2024-04-19T03:02:10.066 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:10.066 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:10.066 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:10.066 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.066 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:10.066 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998165+0000", 2024-04-19T03:02:10.066 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:10.066 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.066 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.066 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:10.066 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998165+0000", 2024-04-19T03:02:10.067 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:10.067 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.067 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.067 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:10.067 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998164+0000", 2024-04-19T03:02:10.067 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:10.067 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.067 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.067 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:10.067 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998170+0000", 2024-04-19T03:02:10.067 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2939999999999996e-06 2024-04-19T03:02:10.067 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.067 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.068 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:10.068 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998179+0000", 2024-04-19T03:02:10.068 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.5540000000000003e-06 2024-04-19T03:02:10.068 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.068 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.068 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:10.068 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998188+0000", 2024-04-19T03:02:10.068 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2959999999999999e-06 2024-04-19T03:02:10.068 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.068 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.068 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:10.068 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998332+0000", 2024-04-19T03:02:10.068 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00014474 2024-04-19T03:02:10.068 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.069 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.069 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:02:10.069 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998337+0000", 2024-04-19T03:02:10.069 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6909999999999996e-06 2024-04-19T03:02:10.069 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.069 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.069 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:10.069 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.010222+0000", 2024-04-19T03:02:10.069 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011885178 2024-04-19T03:02:10.069 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.069 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.069 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:10.070 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.010342+0000", 2024-04-19T03:02:10.070 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00011991500000000001 2024-04-19T03:02:10.070 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.070 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.070 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:02:10.070 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.010506+0000", 2024-04-19T03:02:10.070 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00016429699999999999 2024-04-19T03:02:10.070 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.070 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.070 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:10.070 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.014525+0000", 2024-04-19T03:02:10.070 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0040189839999999998 2024-04-19T03:02:10.070 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.070 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.071 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:10.071 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.022600+0000", 2024-04-19T03:02:10.071 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0080741990000000007 2024-04-19T03:02:10.071 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.071 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.071 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:10.071 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.022670+0000", 2024-04-19T03:02:10.071 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0743999999999999e-05 2024-04-19T03:02:10.071 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.071 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.071 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:10.071 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.022706+0000", 2024-04-19T03:02:10.071 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5782999999999999e-05 2024-04-19T03:02:10.071 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:10.072 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:10.072 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:10.072 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.072 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.072 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:27 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:02:10.072 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:01:14.998436+0000", 2024-04-19T03:02:10.072 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 55.039212866, 2024-04-19T03:02:10.072 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.024406325999999999, 2024-04-19T03:02:10.072 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:10.072 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:10.072 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:10.072 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.072 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:10.073 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998436+0000", 2024-04-19T03:02:10.073 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:10.073 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.073 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.073 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:10.073 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998436+0000", 2024-04-19T03:02:10.073 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:10.073 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.073 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.073 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:10.073 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998435+0000", 2024-04-19T03:02:10.073 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:10.073 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.073 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.073 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:10.074 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998445+0000", 2024-04-19T03:02:10.074 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0349e-05 2024-04-19T03:02:10.074 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.074 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.074 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:10.074 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998453+0000", 2024-04-19T03:02:10.074 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0399999999999993e-06 2024-04-19T03:02:10.074 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.074 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.074 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:10.074 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998461+0000", 2024-04-19T03:02:10.074 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9780000000000005e-06 2024-04-19T03:02:10.074 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.075 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.075 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:10.075 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998515+0000", 2024-04-19T03:02:10.075 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3097999999999999e-05 2024-04-19T03:02:10.075 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.075 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.075 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:02:10.075 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998520+0000", 2024-04-19T03:02:10.075 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9220000000000002e-06 2024-04-19T03:02:10.075 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.075 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.075 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:10.075 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.011258+0000", 2024-04-19T03:02:10.075 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.012737735 2024-04-19T03:02:10.076 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.076 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.076 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:10.076 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.011566+0000", 2024-04-19T03:02:10.076 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00030826200000000001 2024-04-19T03:02:10.076 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.076 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.076 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:02:10.076 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.011996+0000", 2024-04-19T03:02:10.076 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00042912000000000001 2024-04-19T03:02:10.076 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.076 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.076 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:10.077 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.014533+0000", 2024-04-19T03:02:10.077 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.002537423 2024-04-19T03:02:10.077 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.077 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.077 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:10.077 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.022756+0000", 2024-04-19T03:02:10.077 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0082231530000000004 2024-04-19T03:02:10.077 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.077 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.077 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:10.077 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.022807+0000", 2024-04-19T03:02:10.077 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0852e-05 2024-04-19T03:02:10.077 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.077 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.078 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:10.078 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.022842+0000", 2024-04-19T03:02:10.078 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5058000000000002e-05 2024-04-19T03:02:10.078 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:10.078 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:10.078 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:10.078 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.078 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.078 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:28 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:02:10.078 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:01:14.998476+0000", 2024-04-19T03:02:10.078 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 55.039172944000001, 2024-04-19T03:02:10.078 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.024656784000000001, 2024-04-19T03:02:10.078 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:10.078 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:10.079 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:10.079 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.079 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:10.079 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998476+0000", 2024-04-19T03:02:10.079 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:10.079 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.079 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.079 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:10.079 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998476+0000", 2024-04-19T03:02:10.079 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:10.079 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.079 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.079 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:10.079 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998475+0000", 2024-04-19T03:02:10.080 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:10.080 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.080 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.080 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:10.080 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998484+0000", 2024-04-19T03:02:10.080 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.7770000000000008e-06 2024-04-19T03:02:10.080 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.080 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.080 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:10.080 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998495+0000", 2024-04-19T03:02:10.080 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0726e-05 2024-04-19T03:02:10.080 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.080 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.080 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:10.081 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998503+0000", 2024-04-19T03:02:10.081 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.8780000000000004e-06 2024-04-19T03:02:10.081 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.081 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.081 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:10.081 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998579+0000", 2024-04-19T03:02:10.081 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5160999999999994e-05 2024-04-19T03:02:10.081 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.081 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.081 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:02:10.081 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998586+0000", 2024-04-19T03:02:10.081 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8520000000000004e-06 2024-04-19T03:02:10.081 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.081 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.082 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:10.082 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.012423+0000", 2024-04-19T03:02:10.082 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.013836667 2024-04-19T03:02:10.082 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.082 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.082 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:10.082 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.012532+0000", 2024-04-19T03:02:10.082 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000108565 2024-04-19T03:02:10.082 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.082 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.082 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:02:10.082 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.012655+0000", 2024-04-19T03:02:10.082 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00012344600000000001 2024-04-19T03:02:10.083 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.083 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.083 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:10.083 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.015680+0000", 2024-04-19T03:02:10.083 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0030246470000000001 2024-04-19T03:02:10.083 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.083 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.083 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:10.083 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.023091+0000", 2024-04-19T03:02:10.083 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0074116030000000001 2024-04-19T03:02:10.083 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.083 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.083 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:10.083 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.023115+0000", 2024-04-19T03:02:10.084 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.3091999999999998e-05 2024-04-19T03:02:10.084 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.084 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.084 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:10.084 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.023132+0000", 2024-04-19T03:02:10.084 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7901999999999999e-05 2024-04-19T03:02:10.084 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:10.084 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:10.084 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:10.084 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.084 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.084 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:29 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:02:10.084 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:01:14.998527+0000", 2024-04-19T03:02:10.085 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 55.039121403999999, 2024-04-19T03:02:10.085 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.024738599999999999, 2024-04-19T03:02:10.085 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:10.085 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:10.085 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:10.085 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.085 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:10.085 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998527+0000", 2024-04-19T03:02:10.085 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:10.085 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.085 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.085 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:10.085 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998527+0000", 2024-04-19T03:02:10.086 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:10.086 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.086 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.086 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:10.086 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998527+0000", 2024-04-19T03:02:10.086 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:10.086 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.086 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.086 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:10.086 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998531+0000", 2024-04-19T03:02:10.086 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9450000000000001e-06 2024-04-19T03:02:10.086 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.086 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.087 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:10.087 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998541+0000", 2024-04-19T03:02:10.087 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.4320000000000005e-06 2024-04-19T03:02:10.087 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.087 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.087 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:10.087 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998548+0000", 2024-04-19T03:02:10.087 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.221e-06 2024-04-19T03:02:10.087 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.087 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.087 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:10.087 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998620+0000", 2024-04-19T03:02:10.087 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.1676999999999998e-05 2024-04-19T03:02:10.088 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.088 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.088 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:02:10.088 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998624+0000", 2024-04-19T03:02:10.088 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4850000000000003e-06 2024-04-19T03:02:10.088 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.088 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.088 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:10.088 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.013261+0000", 2024-04-19T03:02:10.088 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.014636451999999999 2024-04-19T03:02:10.088 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.088 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.088 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:10.088 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.013364+0000", 2024-04-19T03:02:10.089 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000102885 2024-04-19T03:02:10.089 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.089 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.089 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:02:10.089 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.013481+0000", 2024-04-19T03:02:10.089 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00011783299999999999 2024-04-19T03:02:10.089 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.089 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.089 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:10.089 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.016265+0000", 2024-04-19T03:02:10.089 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0027834539999999999 2024-04-19T03:02:10.089 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.089 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.089 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:10.090 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.023180+0000", 2024-04-19T03:02:10.090 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0069149399999999996 2024-04-19T03:02:10.090 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.090 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.090 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:10.090 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.023230+0000", 2024-04-19T03:02:10.090 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0220999999999999e-05 2024-04-19T03:02:10.090 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.090 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.090 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:10.090 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.023266+0000", 2024-04-19T03:02:10.090 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5703e-05 2024-04-19T03:02:10.090 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:10.091 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:10.091 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:10.091 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.091 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.091 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:30 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:02:10.091 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:01:14.998577+0000", 2024-04-19T03:02:10.091 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 55.039071297, 2024-04-19T03:02:10.091 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.024774022999999999, 2024-04-19T03:02:10.091 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:10.091 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:10.091 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:10.091 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.092 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:10.092 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998577+0000", 2024-04-19T03:02:10.092 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:10.092 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.092 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.092 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:10.092 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998577+0000", 2024-04-19T03:02:10.092 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:10.092 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.092 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.092 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:10.092 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998576+0000", 2024-04-19T03:02:10.092 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:10.092 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.093 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.093 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:10.093 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998583+0000", 2024-04-19T03:02:10.093 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8850000000000001e-06 2024-04-19T03:02:10.093 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.093 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.093 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:10.093 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998597+0000", 2024-04-19T03:02:10.093 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.362e-05 2024-04-19T03:02:10.093 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.093 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.093 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:10.093 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998607+0000", 2024-04-19T03:02:10.094 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0389e-05 2024-04-19T03:02:10.094 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.094 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.094 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:10.094 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998713+0000", 2024-04-19T03:02:10.094 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000105338 2024-04-19T03:02:10.094 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.094 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.094 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:02:10.094 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998720+0000", 2024-04-19T03:02:10.094 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2370000000000003e-06 2024-04-19T03:02:10.094 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.094 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.094 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:10.095 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.014014+0000", 2024-04-19T03:02:10.095 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.015294116999999999 2024-04-19T03:02:10.095 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.095 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.095 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:10.095 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.014091+0000", 2024-04-19T03:02:10.095 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7148000000000001e-05 2024-04-19T03:02:10.095 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.095 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.095 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:02:10.095 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.014271+0000", 2024-04-19T03:02:10.095 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00017962699999999999 2024-04-19T03:02:10.095 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.095 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.096 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:10.096 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.018024+0000", 2024-04-19T03:02:10.096 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0037529809999999999 2024-04-19T03:02:10.096 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.096 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.096 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:10.096 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.023303+0000", 2024-04-19T03:02:10.096 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0052793099999999997 2024-04-19T03:02:10.096 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.096 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.096 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:10.096 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.023331+0000", 2024-04-19T03:02:10.096 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.8013000000000001e-05 2024-04-19T03:02:10.096 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.097 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.097 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:10.097 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.023351+0000", 2024-04-19T03:02:10.097 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0225999999999999e-05 2024-04-19T03:02:10.097 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:10.097 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:10.097 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:10.097 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.097 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.097 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:33 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:02:10.097 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:01:14.998625+0000", 2024-04-19T03:02:10.097 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 55.039023899999997, 2024-04-19T03:02:10.097 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.024007338999999999, 2024-04-19T03:02:10.098 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:10.098 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:10.098 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:10.098 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.098 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:10.098 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998625+0000", 2024-04-19T03:02:10.098 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:10.098 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.098 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.098 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:10.098 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998625+0000", 2024-04-19T03:02:10.098 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:10.098 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.099 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.099 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:10.099 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998623+0000", 2024-04-19T03:02:10.099 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:10.099 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.099 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.099 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:10.099 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998632+0000", 2024-04-19T03:02:10.099 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9279999999999999e-06 2024-04-19T03:02:10.099 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.099 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.099 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:10.099 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998642+0000", 2024-04-19T03:02:10.099 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0063e-05 2024-04-19T03:02:10.100 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.100 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.100 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:10.100 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998649+0000", 2024-04-19T03:02:10.100 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4799999999999998e-06 2024-04-19T03:02:10.100 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.100 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.100 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:10.100 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998730+0000", 2024-04-19T03:02:10.100 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.1514999999999995e-05 2024-04-19T03:02:10.100 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.100 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.101 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:02:10.101 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998741+0000", 2024-04-19T03:02:10.101 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1029999999999999e-05 2024-04-19T03:02:10.101 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.101 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.101 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:10.101 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.010202+0000", 2024-04-19T03:02:10.101 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011460529000000001 2024-04-19T03:02:10.101 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.101 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.101 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:10.101 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.010292+0000", 2024-04-19T03:02:10.101 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.0382000000000003e-05 2024-04-19T03:02:10.101 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.102 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.102 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:02:10.102 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.010391+0000", 2024-04-19T03:02:10.102 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.8491000000000003e-05 2024-04-19T03:02:10.102 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.102 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.102 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:10.102 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.013800+0000", 2024-04-19T03:02:10.102 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0034090219999999998 2024-04-19T03:02:10.102 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.102 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.102 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:10.102 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.022564+0000", 2024-04-19T03:02:10.103 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0087639950000000001 2024-04-19T03:02:10.103 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.103 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.103 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:10.103 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.022601+0000", 2024-04-19T03:02:10.103 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7363999999999997e-05 2024-04-19T03:02:10.103 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.103 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.103 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:10.103 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.022632+0000", 2024-04-19T03:02:10.103 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0917000000000002e-05 2024-04-19T03:02:10.103 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:10.103 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:10.104 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:10.104 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.104 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.104 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:02:10.104 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:01:14.998792+0000", 2024-04-19T03:02:10.104 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 55.038857030999999, 2024-04-19T03:02:10.104 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.023951813999999998, 2024-04-19T03:02:10.104 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:10.104 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:10.104 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:10.104 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.104 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:10.104 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998792+0000", 2024-04-19T03:02:10.104 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:10.105 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.105 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.105 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:10.105 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998792+0000", 2024-04-19T03:02:10.105 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:10.105 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.105 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.105 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:10.105 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998791+0000", 2024-04-19T03:02:10.105 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:10.105 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.105 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.105 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:10.105 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998796+0000", 2024-04-19T03:02:10.106 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9649999999999999e-06 2024-04-19T03:02:10.106 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.106 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.106 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:10.106 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998809+0000", 2024-04-19T03:02:10.106 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3254e-05 2024-04-19T03:02:10.106 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.106 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.106 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:10.106 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998816+0000", 2024-04-19T03:02:10.106 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.472e-06 2024-04-19T03:02:10.106 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.106 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.107 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:10.107 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998899+0000", 2024-04-19T03:02:10.107 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.3676000000000003e-05 2024-04-19T03:02:10.107 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.107 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.107 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:02:10.107 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998908+0000", 2024-04-19T03:02:10.107 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6940000000000001e-06 2024-04-19T03:02:10.107 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.107 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.107 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:10.107 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.010818+0000", 2024-04-19T03:02:10.107 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011910482999999999 2024-04-19T03:02:10.107 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.108 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.108 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:10.108 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.010959+0000", 2024-04-19T03:02:10.108 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00014018900000000001 2024-04-19T03:02:10.108 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.108 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.108 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:02:10.108 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.011185+0000", 2024-04-19T03:02:10.108 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000226085 2024-04-19T03:02:10.108 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.108 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.108 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:10.108 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.014479+0000", 2024-04-19T03:02:10.108 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0032938260000000001 2024-04-19T03:02:10.109 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.109 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.109 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:10.109 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.022697+0000", 2024-04-19T03:02:10.109 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0082186029999999997 2024-04-19T03:02:10.109 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.109 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.109 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:10.109 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.022724+0000", 2024-04-19T03:02:10.109 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.6503999999999999e-05 2024-04-19T03:02:10.109 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.109 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.109 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:10.109 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.022743+0000", 2024-04-19T03:02:10.109 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9663000000000001e-05 2024-04-19T03:02:10.110 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:10.110 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:10.110 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:10.110 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.110 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.110 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:02:10.110 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:01:14.998870+0000", 2024-04-19T03:02:10.110 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 55.038778829999998, 2024-04-19T03:02:10.110 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.024280578000000001, 2024-04-19T03:02:10.110 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:10.110 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:10.110 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:10.110 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.111 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:10.111 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998870+0000", 2024-04-19T03:02:10.111 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:10.111 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.111 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.111 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:10.111 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998870+0000", 2024-04-19T03:02:10.111 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:10.111 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.111 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.111 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:10.111 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998869+0000", 2024-04-19T03:02:10.111 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:10.111 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.112 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.112 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:10.112 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998879+0000", 2024-04-19T03:02:10.112 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.8689999999999999e-06 2024-04-19T03:02:10.112 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.112 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.112 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:10.112 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998893+0000", 2024-04-19T03:02:10.112 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4436999999999999e-05 2024-04-19T03:02:10.112 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.112 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.112 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:10.112 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998904+0000", 2024-04-19T03:02:10.112 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0657e-05 2024-04-19T03:02:10.113 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.113 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.113 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:10.113 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998972+0000", 2024-04-19T03:02:10.113 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8121999999999996e-05 2024-04-19T03:02:10.113 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.113 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.113 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:02:10.113 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998980+0000", 2024-04-19T03:02:10.113 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7170000000000008e-06 2024-04-19T03:02:10.113 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.113 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.113 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:10.114 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.011666+0000", 2024-04-19T03:02:10.114 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.012686507 2024-04-19T03:02:10.114 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.114 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.114 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:10.114 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.012403+0000", 2024-04-19T03:02:10.114 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00073661899999999999 2024-04-19T03:02:10.114 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.114 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.114 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:02:10.114 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.012788+0000", 2024-04-19T03:02:10.114 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00038495800000000002 2024-04-19T03:02:10.114 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.114 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.115 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:10.115 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.015713+0000", 2024-04-19T03:02:10.115 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0029255879999999998 2024-04-19T03:02:10.115 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.115 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.115 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:10.115 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.023066+0000", 2024-04-19T03:02:10.115 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.007352903 2024-04-19T03:02:10.115 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.115 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.115 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:10.115 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.023113+0000", 2024-04-19T03:02:10.115 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7163000000000002e-05 2024-04-19T03:02:10.116 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.116 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.116 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:10.116 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.023150+0000", 2024-04-19T03:02:10.116 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6881000000000001e-05 2024-04-19T03:02:10.116 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:10.116 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:10.116 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:10.116 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.116 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.116 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:20 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:02:10.116 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:01:14.999024+0000", 2024-04-19T03:02:10.116 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 55.038624558000002, 2024-04-19T03:02:10.116 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.024212818000000001, 2024-04-19T03:02:10.117 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:10.117 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-04-19T03:02:10.117 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:10.117 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.117 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:10.117 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.999024+0000", 2024-04-19T03:02:10.117 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:10.117 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.117 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.117 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:10.117 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.999024+0000", 2024-04-19T03:02:10.117 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:10.117 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.117 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.118 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:10.118 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.999023+0000", 2024-04-19T03:02:10.118 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:10.118 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.118 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.118 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:10.118 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.999029+0000", 2024-04-19T03:02:10.118 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2709999999999998e-06 2024-04-19T03:02:10.118 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.118 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.118 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:10.118 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.999045+0000", 2024-04-19T03:02:10.118 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.5840000000000001e-05 2024-04-19T03:02:10.119 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.119 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.119 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:10.119 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.999057+0000", 2024-04-19T03:02:10.119 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1897e-05 2024-04-19T03:02:10.119 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.119 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.119 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:10.119 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.999136+0000", 2024-04-19T03:02:10.119 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8842000000000002e-05 2024-04-19T03:02:10.119 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.119 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.119 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:02:10.119 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.999144+0000", 2024-04-19T03:02:10.120 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.3110000000000006e-06 2024-04-19T03:02:10.120 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.120 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.120 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:10.120 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.013338+0000", 2024-04-19T03:02:10.120 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.014194217 2024-04-19T03:02:10.120 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.120 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.120 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:10.120 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.013485+0000", 2024-04-19T03:02:10.120 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000146787 2024-04-19T03:02:10.120 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.120 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.120 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:10.120 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.023237+0000", 2024-04-19T03:02:10.121 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0097517899999999998 2024-04-19T03:02:10.121 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:10.121 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:10.121 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:10.121 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.121 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.121 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:11289 5.7 5:e1ea82b1:::benchmark_data_smithi096_19531_object11288:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T03:02:10.121 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:01:42.068678+0000", 2024-04-19T03:02:10.121 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 27.968970337999998, 2024-04-19T03:02:10.121 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.022027980999999999, 2024-04-19T03:02:10.121 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:10.121 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:10.121 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:10.122 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:10.122 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:10.122 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 11289 2024-04-19T03:02:10.122 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.122 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:10.122 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.122 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:10.122 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:42.068678+0000", 2024-04-19T03:02:10.122 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:10.122 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.122 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.122 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:10.122 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:42.068678+0000", 2024-04-19T03:02:10.122 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:10.123 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.123 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.123 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:10.123 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:42.068677+0000", 2024-04-19T03:02:10.123 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:10.123 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.123 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.123 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:10.123 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:42.068721+0000", 2024-04-19T03:02:10.123 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3714000000000002e-05 2024-04-19T03:02:10.123 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.123 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.123 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:10.123 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:42.068728+0000", 2024-04-19T03:02:10.123 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0029999999999997e-06 2024-04-19T03:02:10.124 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.124 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.124 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:10.124 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:42.068733+0000", 2024-04-19T03:02:10.124 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0100000000000003e-06 2024-04-19T03:02:10.124 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.124 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.124 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:10.124 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:42.068820+0000", 2024-04-19T03:02:10.124 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.653e-05 2024-04-19T03:02:10.124 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.124 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.124 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:10.124 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:42.068990+0000", 2024-04-19T03:02:10.125 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00017046800000000001 2024-04-19T03:02:10.125 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.125 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.125 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:10.125 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:42.069140+0000", 2024-04-19T03:02:10.125 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00015001000000000001 2024-04-19T03:02:10.125 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.125 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.125 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:10.125 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:42.074573+0000", 2024-04-19T03:02:10.125 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0054326979999999997 2024-04-19T03:02:10.125 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.125 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.125 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:10.126 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:42.090534+0000", 2024-04-19T03:02:10.126 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.015961300000000001 2024-04-19T03:02:10.126 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.126 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.126 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:10.126 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:42.090619+0000", 2024-04-19T03:02:10.126 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4536999999999994e-05 2024-04-19T03:02:10.126 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.126 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.126 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:10.126 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:42.090706+0000", 2024-04-19T03:02:10.126 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.7643000000000001e-05 2024-04-19T03:02:10.126 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:10.127 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:10.127 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:10.127 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.127 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.127 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:50122 5.9 5:9d1c74f3:::benchmark_data_smithi096_19531_object50121:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-19T03:02:10.127 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:00.084949+0000", 2024-04-19T03:02:10.127 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 9.9526999200000006, 2024-04-19T03:02:10.127 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.023564486999999999, 2024-04-19T03:02:10.127 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:10.127 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:10.127 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:10.127 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:10.127 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:10.127 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 50122 2024-04-19T03:02:10.127 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.128 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:10.128 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.128 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:10.128 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:00.084949+0000", 2024-04-19T03:02:10.128 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:10.128 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.128 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.128 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:10.128 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:00.084949+0000", 2024-04-19T03:02:10.128 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:10.128 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.128 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.128 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:10.128 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:00.084948+0000", 2024-04-19T03:02:10.129 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:10.129 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.129 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.129 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:10.129 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:00.084983+0000", 2024-04-19T03:02:10.129 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4322000000000001e-05 2024-04-19T03:02:10.129 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.129 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.129 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:10.129 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:00.084992+0000", 2024-04-19T03:02:10.129 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.0180000000000007e-06 2024-04-19T03:02:10.129 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.129 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.129 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:10.130 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:00.085000+0000", 2024-04-19T03:02:10.130 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.7609999999999996e-06 2024-04-19T03:02:10.130 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.130 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.130 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:10.130 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:00.093379+0000", 2024-04-19T03:02:10.130 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0083790819999999995 2024-04-19T03:02:10.130 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.130 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.130 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:10.130 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:00.093555+0000", 2024-04-19T03:02:10.130 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00017582900000000001 2024-04-19T03:02:10.130 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.131 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.131 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:02:10.131 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:00.093735+0000", 2024-04-19T03:02:10.131 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00018006399999999999 2024-04-19T03:02:10.131 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.131 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.131 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:10.131 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:00.104665+0000", 2024-04-19T03:02:10.131 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.010929259 2024-04-19T03:02:10.131 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.131 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.131 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:10.131 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:00.108415+0000", 2024-04-19T03:02:10.131 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0037506610000000002 2024-04-19T03:02:10.132 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.132 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.132 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:10.132 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:00.108474+0000", 2024-04-19T03:02:10.132 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8551000000000002e-05 2024-04-19T03:02:10.132 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.132 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.132 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:10.132 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:00.108513+0000", 2024-04-19T03:02:10.132 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9307000000000002e-05 2024-04-19T03:02:10.132 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:10.132 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:10.132 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:10.132 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.133 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.133 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:50123 5.9 5:98d55939:::benchmark_data_smithi096_19531_object50122:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-19T03:02:10.133 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:00.087166+0000", 2024-04-19T03:02:10.133 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 9.9504824739999993, 2024-04-19T03:02:10.133 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.021482022999999999, 2024-04-19T03:02:10.133 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:10.133 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:10.133 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:10.133 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:10.133 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:10.133 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 50123 2024-04-19T03:02:10.133 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.133 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:10.133 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.134 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:10.134 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:00.087166+0000", 2024-04-19T03:02:10.134 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:10.134 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.134 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.134 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:10.134 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:00.087166+0000", 2024-04-19T03:02:10.134 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:10.134 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.134 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.134 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:10.134 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:00.087165+0000", 2024-04-19T03:02:10.134 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:10.135 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.135 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.135 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:10.135 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:00.087253+0000", 2024-04-19T03:02:10.135 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.8466000000000003e-05 2024-04-19T03:02:10.135 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.135 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.135 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:10.135 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:00.087271+0000", 2024-04-19T03:02:10.135 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8063999999999998e-05 2024-04-19T03:02:10.135 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.135 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.135 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:10.135 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:00.087280+0000", 2024-04-19T03:02:10.135 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.3930000000000008e-06 2024-04-19T03:02:10.136 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.136 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.136 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:10.136 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:00.096771+0000", 2024-04-19T03:02:10.136 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0094913329999999994 2024-04-19T03:02:10.136 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.136 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.136 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:10.136 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:00.096934+0000", 2024-04-19T03:02:10.136 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00016332900000000001 2024-04-19T03:02:10.136 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.136 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.136 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:02:10.136 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:00.097058+0000", 2024-04-19T03:02:10.137 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000123798 2024-04-19T03:02:10.137 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.137 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.137 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:10.137 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:00.104674+0000", 2024-04-19T03:02:10.137 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0076159900000000004 2024-04-19T03:02:10.137 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.137 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.137 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:10.137 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:00.108563+0000", 2024-04-19T03:02:10.137 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0038890029999999998 2024-04-19T03:02:10.137 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.137 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.137 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:10.138 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:00.108603+0000", 2024-04-19T03:02:10.138 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9610000000000002e-05 2024-04-19T03:02:10.138 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.138 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.138 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:10.138 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:00.108648+0000", 2024-04-19T03:02:10.138 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5361999999999997e-05 2024-04-19T03:02:10.138 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:10.138 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:10.138 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:10.138 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.138 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.138 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:50128 5.9 5:9467072a:::benchmark_data_smithi096_19531_object50127:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-19T03:02:10.139 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:00.087808+0000", 2024-04-19T03:02:10.139 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 9.9498407419999992, 2024-04-19T03:02:10.139 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.020989109999999998, 2024-04-19T03:02:10.139 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:10.139 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:10.139 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:10.139 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:10.139 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:10.139 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 50128 2024-04-19T03:02:10.139 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.139 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:10.139 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.139 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:10.139 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:00.087808+0000", 2024-04-19T03:02:10.140 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:10.140 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.140 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.140 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:10.140 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:00.087808+0000", 2024-04-19T03:02:10.140 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:10.140 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.140 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.140 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:10.140 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:00.087807+0000", 2024-04-19T03:02:10.140 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:10.140 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.140 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.140 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:10.141 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:00.087898+0000", 2024-04-19T03:02:10.141 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.0927000000000005e-05 2024-04-19T03:02:10.141 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.141 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.141 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:10.141 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:00.087911+0000", 2024-04-19T03:02:10.141 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3380000000000001e-05 2024-04-19T03:02:10.141 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.141 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.141 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:10.141 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:00.087917+0000", 2024-04-19T03:02:10.141 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2190000000000001e-06 2024-04-19T03:02:10.141 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.141 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.142 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:10.142 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:00.098878+0000", 2024-04-19T03:02:10.142 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.010960642 2024-04-19T03:02:10.142 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.142 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.142 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:10.142 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:00.099020+0000", 2024-04-19T03:02:10.142 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000142037 2024-04-19T03:02:10.142 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.142 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.142 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:02:10.142 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:00.099118+0000", 2024-04-19T03:02:10.142 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.8066999999999995e-05 2024-04-19T03:02:10.142 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.143 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.143 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:10.143 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:00.104682+0000", 2024-04-19T03:02:10.143 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0055638889999999998 2024-04-19T03:02:10.143 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.143 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.143 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:10.143 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:00.108707+0000", 2024-04-19T03:02:10.143 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0040252359999999997 2024-04-19T03:02:10.143 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.143 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.143 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:10.143 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:00.108763+0000", 2024-04-19T03:02:10.143 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5822999999999997e-05 2024-04-19T03:02:10.144 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.144 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.144 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:10.144 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:00.108797+0000", 2024-04-19T03:02:10.144 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3754999999999998e-05 2024-04-19T03:02:10.144 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:10.144 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:10.144 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:10.144 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.144 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.144 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:58199 5.1 5:8d6d5536:::benchmark_data_smithi096_19531_object58198:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-19T03:02:10.144 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:04.610309+0000", 2024-04-19T03:02:10.144 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 5.427339656, 2024-04-19T03:02:10.144 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.021489214999999999, 2024-04-19T03:02:10.145 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:10.145 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:10.145 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:10.145 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:10.145 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:10.145 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 58199 2024-04-19T03:02:10.145 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.145 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:10.145 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.145 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:10.145 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:04.610309+0000", 2024-04-19T03:02:10.145 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:10.145 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.145 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.146 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:10.146 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:04.610309+0000", 2024-04-19T03:02:10.146 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:10.146 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.146 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.146 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:10.146 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:04.610309+0000", 2024-04-19T03:02:10.146 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:10.146 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.146 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.146 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:10.146 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:04.610338+0000", 2024-04-19T03:02:10.146 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9564e-05 2024-04-19T03:02:10.146 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.147 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.147 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:10.147 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:04.610344+0000", 2024-04-19T03:02:10.147 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4920000000000001e-06 2024-04-19T03:02:10.147 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.147 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.147 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:10.147 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:04.610348+0000", 2024-04-19T03:02:10.147 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5360000000000003e-06 2024-04-19T03:02:10.147 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.147 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.147 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:10.147 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:04.621218+0000", 2024-04-19T03:02:10.147 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.010869431000000001 2024-04-19T03:02:10.148 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.148 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.148 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:10.148 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:04.621404+0000", 2024-04-19T03:02:10.148 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00018601800000000001 2024-04-19T03:02:10.148 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.148 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.148 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:10.148 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:04.621566+0000", 2024-04-19T03:02:10.148 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00016204199999999999 2024-04-19T03:02:10.148 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.148 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.148 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:10.148 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:04.625888+0000", 2024-04-19T03:02:10.149 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0043228820000000001 2024-04-19T03:02:10.149 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.149 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.149 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:10.149 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:04.631720+0000", 2024-04-19T03:02:10.149 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0058311049999999996 2024-04-19T03:02:10.149 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.149 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.149 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:10.149 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:04.631772+0000", 2024-04-19T03:02:10.149 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2064999999999997e-05 2024-04-19T03:02:10.149 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.149 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.149 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:10.150 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:04.631798+0000", 2024-04-19T03:02:10.150 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.6480999999999999e-05 2024-04-19T03:02:10.150 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:10.150 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:10.150 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:10.150 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.150 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.150 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:60712 5.2 5:4a2144fe:::benchmark_data_smithi096_19531_object60711:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-19T03:02:10.150 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:06.065544+0000", 2024-04-19T03:02:10.150 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 3.9721048080000001, 2024-04-19T03:02:10.150 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.022207441000000001, 2024-04-19T03:02:10.150 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:10.150 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:10.150 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:10.151 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:10.151 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:10.151 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 60712 2024-04-19T03:02:10.151 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.151 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:10.151 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.151 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:10.151 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:06.065544+0000", 2024-04-19T03:02:10.151 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:10.151 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.151 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.151 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:10.151 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:06.065544+0000", 2024-04-19T03:02:10.151 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:10.152 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.152 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.152 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:10.152 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:06.065543+0000", 2024-04-19T03:02:10.152 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:10.152 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.152 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.152 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:10.152 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:06.065590+0000", 2024-04-19T03:02:10.152 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.723e-05 2024-04-19T03:02:10.152 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.152 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.152 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:10.153 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:06.065605+0000", 2024-04-19T03:02:10.153 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4158999999999999e-05 2024-04-19T03:02:10.153 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.153 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.153 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:10.153 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:06.065612+0000", 2024-04-19T03:02:10.153 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4660000000000002e-06 2024-04-19T03:02:10.153 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.153 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.153 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:10.153 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:06.076435+0000", 2024-04-19T03:02:10.153 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.010822890999999999 2024-04-19T03:02:10.153 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.153 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.154 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:10.154 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:06.076549+0000", 2024-04-19T03:02:10.154 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000114061 2024-04-19T03:02:10.154 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.154 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.154 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:10.154 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:06.076628+0000", 2024-04-19T03:02:10.154 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8696999999999995e-05 2024-04-19T03:02:10.154 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.154 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.154 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:10.154 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:06.085249+0000", 2024-04-19T03:02:10.154 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00862162 2024-04-19T03:02:10.155 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.155 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.155 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:10.155 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:06.087686+0000", 2024-04-19T03:02:10.155 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0024364759999999999 2024-04-19T03:02:10.155 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.155 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.155 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:10.155 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:06.087725+0000", 2024-04-19T03:02:10.155 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9294e-05 2024-04-19T03:02:10.155 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.155 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.155 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:10.156 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:06.087751+0000", 2024-04-19T03:02:10.156 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.6177e-05 2024-04-19T03:02:10.156 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:10.156 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:10.156 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:10.156 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.156 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.156 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:67083 5.7 5:edb9e4d7:::benchmark_data_smithi096_19531_object67082:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T03:02:10.156 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:09.832836+0000", 2024-04-19T03:02:10.156 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.20481295099999999, 2024-04-19T03:02:10.156 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.022382619999999999, 2024-04-19T03:02:10.156 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:10.156 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:10.156 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:10.157 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:10.157 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:10.157 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 67083 2024-04-19T03:02:10.157 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.157 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:10.157 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.157 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:10.157 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:09.832836+0000", 2024-04-19T03:02:10.157 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:10.157 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.157 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.157 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:10.157 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:09.832836+0000", 2024-04-19T03:02:10.157 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:10.158 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.158 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.158 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:10.158 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:09.832835+0000", 2024-04-19T03:02:10.158 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:10.158 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.158 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.158 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:10.158 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:09.832950+0000", 2024-04-19T03:02:10.158 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000115272 2024-04-19T03:02:10.158 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.158 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.158 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:10.158 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:09.832959+0000", 2024-04-19T03:02:10.159 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4770000000000003e-06 2024-04-19T03:02:10.159 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.159 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.159 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:10.159 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:09.832963+0000", 2024-04-19T03:02:10.159 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6959999999999996e-06 2024-04-19T03:02:10.159 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.159 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.159 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:10.159 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:09.843155+0000", 2024-04-19T03:02:10.159 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.010191518 2024-04-19T03:02:10.159 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.159 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.159 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:10.160 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:09.843271+0000", 2024-04-19T03:02:10.160 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000115958 2024-04-19T03:02:10.160 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.160 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.160 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:10.160 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:09.843400+0000", 2024-04-19T03:02:10.160 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00012901699999999999 2024-04-19T03:02:10.160 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.160 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.160 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:10.160 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:09.854577+0000", 2024-04-19T03:02:10.160 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011177319999999999 2024-04-19T03:02:10.160 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.160 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.161 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:10.161 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:09.855122+0000", 2024-04-19T03:02:10.161 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00054507000000000004 2024-04-19T03:02:10.161 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.161 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.161 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:10.161 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:09.855171+0000", 2024-04-19T03:02:10.161 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9085000000000002e-05 2024-04-19T03:02:10.161 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:10.161 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:10.161 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:10.161 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:09.855218+0000", 2024-04-19T03:02:10.161 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7011000000000001e-05 2024-04-19T03:02:10.161 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:10.161 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:10.162 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:10.162 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:10.162 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:10.162 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-04-19T03:02:10.163 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T03:02:10.164 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:10.159+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:10.264 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-04-19T03:02:10.262+0000 7f35986ab700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18243) UID: 0 2024-04-19T03:02:10.296 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-04-19T03:02:10.297 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [ 2024-04-19T03:02:10.297 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.297 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4755.0:67851 5.a 5:5ce047a9:::benchmark_data_smithi096_19531_object67850:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T03:02:10.297 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:02:10.290568+0000", 2024-04-19T03:02:10.297 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 0.0051011169999999996, 2024-04-19T03:02:10.297 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0051241810000000002, 2024-04-19T03:02:10.297 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:02:10.297 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:02:10.297 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-04-19T03:02:10.297 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4755", 2024-04-19T03:02:10.297 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:10.297 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 67851 2024-04-19T03:02:10.298 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.298 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:02:10.298 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.298 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:02:10.298 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:10.290568+0000", 2024-04-19T03:02:10.298 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:10.298 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.298 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.298 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:02:10.298 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:10.290568+0000", 2024-04-19T03:02:10.298 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:10.298 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.298 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.298 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:02:10.299 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:10.290567+0000", 2024-04-19T03:02:10.299 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2024-04-19T03:02:10.299 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.299 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.299 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:02:10.299 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:10.290636+0000", 2024-04-19T03:02:10.299 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.9480000000000006e-05 2024-04-19T03:02:10.299 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.299 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.299 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:02:10.299 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:10.290648+0000", 2024-04-19T03:02:10.299 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1736000000000001e-05 2024-04-19T03:02:10.299 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.300 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.300 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:02:10.300 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:10.290653+0000", 2024-04-19T03:02:10.300 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.0699999999999997e-06 2024-04-19T03:02:10.300 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.300 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.300 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:10.300 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:10.290695+0000", 2024-04-19T03:02:10.300 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.2274000000000002e-05 2024-04-19T03:02:10.300 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.300 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.300 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:02:10.300 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:10.290849+0000", 2024-04-19T03:02:10.300 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000154041 2024-04-19T03:02:10.301 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.301 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.301 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 1", 2024-04-19T03:02:10.301 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:10.291013+0000", 2024-04-19T03:02:10.301 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00016368200000000001 2024-04-19T03:02:10.301 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:10.301 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:02:10.301 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:10.301 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.301 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.301 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4755.0:67853 5.5 5:a4eb6057:::benchmark_data_smithi096_19531_object67852:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T03:02:10.301 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:02:10.290666+0000", 2024-04-19T03:02:10.301 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 0.00500264, 2024-04-19T03:02:10.301 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0050740589999999997, 2024-04-19T03:02:10.302 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:02:10.302 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:02:10.302 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-04-19T03:02:10.302 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4755", 2024-04-19T03:02:10.302 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:10.302 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 67853 2024-04-19T03:02:10.302 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.302 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:02:10.302 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.302 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:02:10.302 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:10.290666+0000", 2024-04-19T03:02:10.302 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:10.302 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.303 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.303 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:02:10.303 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:10.290666+0000", 2024-04-19T03:02:10.303 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:10.303 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.303 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.303 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:02:10.303 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:10.290665+0000", 2024-04-19T03:02:10.303 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:10.303 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.303 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.303 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:02:10.303 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:10.290720+0000", 2024-04-19T03:02:10.303 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.4549000000000002e-05 2024-04-19T03:02:10.304 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.304 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.304 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:02:10.304 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:10.290732+0000", 2024-04-19T03:02:10.304 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.186e-05 2024-04-19T03:02:10.304 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.304 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.304 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:02:10.304 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:10.290738+0000", 2024-04-19T03:02:10.304 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.4130000000000003e-06 2024-04-19T03:02:10.304 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.304 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.304 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:10.304 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:10.290802+0000", 2024-04-19T03:02:10.305 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.3278e-05 2024-04-19T03:02:10.305 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.305 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.305 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:02:10.305 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:10.290931+0000", 2024-04-19T03:02:10.305 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000129672 2024-04-19T03:02:10.305 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.305 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.305 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-04-19T03:02:10.305 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:10.291065+0000", 2024-04-19T03:02:10.305 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000133631 2024-04-19T03:02:10.305 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:10.305 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:02:10.306 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:10.306 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.306 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.306 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4755.0:67852 5.8 e37/22 5:1ed92e93:::benchmark_data_smithi096_19531_object67851:head v 37'4287, mlcod=37'4285)", 2024-04-19T03:02:10.306 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:02:10.291027+0000", 2024-04-19T03:02:10.306 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 0.004641137, 2024-04-19T03:02:10.306 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0047495929999999999, 2024-04-19T03:02:10.306 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:02:10.306 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "started", 2024-04-19T03:02:10.306 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:02:10.306 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.306 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:02:10.306 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:10.291027+0000", 2024-04-19T03:02:10.307 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:10.307 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.307 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.307 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:02:10.307 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:10.291027+0000", 2024-04-19T03:02:10.307 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:10.307 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.307 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.307 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:02:10.307 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:10.291027+0000", 2024-04-19T03:02:10.307 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2024-04-19T03:02:10.307 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.307 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.307 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:02:10.307 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:10.291074+0000", 2024-04-19T03:02:10.308 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.7583999999999997e-05 2024-04-19T03:02:10.308 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.308 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.308 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:02:10.308 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:10.291083+0000", 2024-04-19T03:02:10.308 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.1419999999999999e-06 2024-04-19T03:02:10.308 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.308 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.308 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:02:10.308 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:10.291089+0000", 2024-04-19T03:02:10.308 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.6810000000000003e-06 2024-04-19T03:02:10.308 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.308 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.309 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:10.309 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:10.291170+0000", 2024-04-19T03:02:10.309 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.0704000000000005e-05 2024-04-19T03:02:10.309 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.309 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.309 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:02:10.309 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:10.291202+0000", 2024-04-19T03:02:10.309 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.2259999999999999e-05 2024-04-19T03:02:10.309 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:10.309 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:02:10.309 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:10.309 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.309 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.309 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4755.0:67847 5.1 e37/22 5:8de5f67d:::benchmark_data_smithi096_19531_object67846:head v 37'4254, mlcod=37'4250)", 2024-04-19T03:02:10.310 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:02:10.293477+0000", 2024-04-19T03:02:10.310 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 0.0021914590000000002, 2024-04-19T03:02:10.310 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0023293260000000001, 2024-04-19T03:02:10.310 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:02:10.310 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "started", 2024-04-19T03:02:10.310 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:02:10.310 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.310 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:02:10.310 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:10.293477+0000", 2024-04-19T03:02:10.310 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:10.310 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.310 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.310 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:02:10.311 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:10.293477+0000", 2024-04-19T03:02:10.311 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:10.311 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.311 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.311 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:02:10.311 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:10.293476+0000", 2024-04-19T03:02:10.311 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2024-04-19T03:02:10.311 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.311 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.311 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:02:10.311 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:10.293520+0000", 2024-04-19T03:02:10.311 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.3841000000000003e-05 2024-04-19T03:02:10.311 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.311 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.312 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:02:10.312 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:10.293531+0000", 2024-04-19T03:02:10.312 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1015999999999999e-05 2024-04-19T03:02:10.312 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.312 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.312 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:02:10.312 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:10.293540+0000", 2024-04-19T03:02:10.312 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.0969999999999995e-06 2024-04-19T03:02:10.312 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.312 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.312 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:10.312 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:10.293618+0000", 2024-04-19T03:02:10.312 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.7600000000000002e-05 2024-04-19T03:02:10.312 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.313 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.313 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:02:10.313 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:10.293637+0000", 2024-04-19T03:02:10.313 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.9881000000000002e-05 2024-04-19T03:02:10.313 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:10.313 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:02:10.313 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:10.313 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.313 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.313 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4755.0:67858 5.7 e37/22 5:e8d1b132:::benchmark_data_smithi096_19531_object67857:head v 37'4202, mlcod=37'4200)", 2024-04-19T03:02:10.313 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:02:10.295507+0000", 2024-04-19T03:02:10.313 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 0.00016179500000000001, 2024-04-19T03:02:10.313 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000329838, 2024-04-19T03:02:10.313 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:02:10.314 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "started", 2024-04-19T03:02:10.314 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:02:10.314 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.314 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:02:10.314 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:10.295507+0000", 2024-04-19T03:02:10.314 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:10.314 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.314 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.314 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:02:10.314 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:10.295507+0000", 2024-04-19T03:02:10.314 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:10.314 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.314 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.314 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:02:10.315 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:10.295506+0000", 2024-04-19T03:02:10.315 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:10.315 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.315 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.315 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:02:10.315 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:10.295565+0000", 2024-04-19T03:02:10.315 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.8742000000000001e-05 2024-04-19T03:02:10.315 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.315 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.315 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:02:10.315 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:10.295573+0000", 2024-04-19T03:02:10.315 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.1939999999999998e-06 2024-04-19T03:02:10.315 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.315 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.316 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:02:10.316 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:10.295578+0000", 2024-04-19T03:02:10.316 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.4970000000000003e-06 2024-04-19T03:02:10.316 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.316 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.316 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:10.316 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:10.295624+0000", 2024-04-19T03:02:10.316 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.6326999999999999e-05 2024-04-19T03:02:10.316 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.316 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.316 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:02:10.316 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:10.295639+0000", 2024-04-19T03:02:10.316 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5401e-05 2024-04-19T03:02:10.316 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:10.317 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:02:10.317 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:10.317 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.317 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.317 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4755.0:67842 5.a 5:50a2369d:::benchmark_data_smithi096_19531_object67841:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T03:02:10.317 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:02:10.284762+0000", 2024-04-19T03:02:10.317 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 0.010906702000000001, 2024-04-19T03:02:10.317 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.011106789000000001, 2024-04-19T03:02:10.317 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:02:10.317 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:02:10.317 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-04-19T03:02:10.317 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4755", 2024-04-19T03:02:10.317 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:10.317 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 67842 2024-04-19T03:02:10.318 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.318 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:02:10.318 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.318 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:02:10.318 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:10.284762+0000", 2024-04-19T03:02:10.318 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:10.318 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.318 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.318 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:02:10.318 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:10.284762+0000", 2024-04-19T03:02:10.318 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:10.318 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.318 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.319 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:02:10.319 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:10.284761+0000", 2024-04-19T03:02:10.319 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:10.319 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.319 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.319 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:02:10.319 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:10.284846+0000", 2024-04-19T03:02:10.319 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.5834999999999994e-05 2024-04-19T03:02:10.319 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.319 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.319 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:02:10.319 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:10.284857+0000", 2024-04-19T03:02:10.319 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.047e-05 2024-04-19T03:02:10.319 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.319 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.320 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:02:10.320 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:10.284864+0000", 2024-04-19T03:02:10.320 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.6490000000000008e-06 2024-04-19T03:02:10.320 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.320 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.320 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:10.320 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:10.286403+0000", 2024-04-19T03:02:10.320 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001538925 2024-04-19T03:02:10.320 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.320 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.320 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:02:10.320 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:10.286554+0000", 2024-04-19T03:02:10.320 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00015075200000000001 2024-04-19T03:02:10.320 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.321 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.321 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 1", 2024-04-19T03:02:10.321 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:10.286734+0000", 2024-04-19T03:02:10.321 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000179495 2024-04-19T03:02:10.321 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.321 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.321 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:02:10.321 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:10.289744+0000", 2024-04-19T03:02:10.321 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0030106659999999999 2024-04-19T03:02:10.321 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:10.321 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:02:10.321 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:10.321 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:10.321 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2024-04-19T03:02:10.322 INFO:teuthology.orchestra.run.smithi097.stdout: "num_ops": 6 2024-04-19T03:02:10.322 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-04-19T03:02:10.323 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T03:02:10.365 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-04-19T03:02:10.362+0000 7f35986ab700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18243) UID: 0 2024-04-19T03:02:10.454 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-04-19T03:02:10.455 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [], 2024-04-19T03:02:10.455 INFO:teuthology.orchestra.run.smithi097.stdout: "complaint_time": 30, 2024-04-19T03:02:10.455 INFO:teuthology.orchestra.run.smithi097.stdout: "num_blocked_ops": 0 2024-04-19T03:02:10.455 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-04-19T03:02:10.467 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T03:02:10.469 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:10.463+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:10.566 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:10.563+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:10.651 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-04-19T03:02:10.652 INFO:teuthology.orchestra.run.smithi097.stdout: "size": 20, 2024-04-19T03:02:10.652 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 600, 2024-04-19T03:02:10.652 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [ 2024-04-19T03:02:10.652 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.652 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(mds.0.3:14 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:02:10.652 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:14.997079+0000", 2024-04-19T03:02:10.652 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 55.650175803000003, 2024-04-19T03:02:10.652 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.021951970000000001, 2024-04-19T03:02:10.652 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:02:10.652 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:10.652 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:02:10.652 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.652 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:02:10.653 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997079+0000", 2024-04-19T03:02:10.653 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:10.653 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.653 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.653 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:02:10.653 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997079+0000", 2024-04-19T03:02:10.653 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:10.653 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.653 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.653 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:02:10.653 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997077+0000", 2024-04-19T03:02:10.653 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:10.653 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.653 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.654 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:02:10.654 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997087+0000", 2024-04-19T03:02:10.654 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.006e-05 2024-04-19T03:02:10.654 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.654 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.654 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:02:10.654 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997105+0000", 2024-04-19T03:02:10.654 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.8026999999999999e-05 2024-04-19T03:02:10.654 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.654 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.654 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:02:10.654 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997135+0000", 2024-04-19T03:02:10.654 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.9643000000000001e-05 2024-04-19T03:02:10.655 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.655 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.655 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:10.655 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997208+0000", 2024-04-19T03:02:10.655 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.3419999999999998e-05 2024-04-19T03:02:10.655 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.655 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.655 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op must wait for map", 2024-04-19T03:02:10.655 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997244+0000", 2024-04-19T03:02:10.655 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.5367000000000002e-05 2024-04-19T03:02:10.655 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.655 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.655 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:10.655 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.007357+0000", 2024-04-19T03:02:10.656 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.010112703000000001 2024-04-19T03:02:10.656 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.656 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.656 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:02:10.656 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.007479+0000", 2024-04-19T03:02:10.656 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012279599999999999 2024-04-19T03:02:10.656 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.656 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.656 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 1", 2024-04-19T03:02:10.656 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.007610+0000", 2024-04-19T03:02:10.656 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00013093499999999999 2024-04-19T03:02:10.656 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.656 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.656 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:02:10.657 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.012526+0000", 2024-04-19T03:02:10.657 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0049157519999999998 2024-04-19T03:02:10.657 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.657 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.657 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:10.657 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.018959+0000", 2024-04-19T03:02:10.657 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0064326009999999996 2024-04-19T03:02:10.657 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.657 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.657 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:02:10.657 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.019005+0000", 2024-04-19T03:02:10.657 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.6066999999999998e-05 2024-04-19T03:02:10.657 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.657 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.658 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:02:10.658 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.019031+0000", 2024-04-19T03:02:10.658 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.6009000000000001e-05 2024-04-19T03:02:10.658 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:10.658 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:02:10.658 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:10.658 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.658 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.658 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:02:10.658 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:14.997149+0000", 2024-04-19T03:02:10.658 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 55.650105183000001, 2024-04-19T03:02:10.658 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.021805590999999999, 2024-04-19T03:02:10.658 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:02:10.659 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:10.659 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:02:10.659 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.659 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:02:10.659 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997149+0000", 2024-04-19T03:02:10.659 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:10.659 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.659 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.659 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:02:10.659 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997149+0000", 2024-04-19T03:02:10.659 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:10.659 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.659 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.659 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:02:10.660 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997148+0000", 2024-04-19T03:02:10.660 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2024-04-19T03:02:10.660 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.660 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.660 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:02:10.660 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997166+0000", 2024-04-19T03:02:10.660 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.8233e-05 2024-04-19T03:02:10.660 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.660 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.660 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:02:10.660 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997182+0000", 2024-04-19T03:02:10.660 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5999999999999999e-05 2024-04-19T03:02:10.660 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.660 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.661 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:02:10.661 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997195+0000", 2024-04-19T03:02:10.661 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.252e-05 2024-04-19T03:02:10.661 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.661 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.661 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:10.661 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997348+0000", 2024-04-19T03:02:10.661 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000153115 2024-04-19T03:02:10.661 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.661 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.661 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:02:10.661 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997354+0000", 2024-04-19T03:02:10.661 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.9359999999999996e-06 2024-04-19T03:02:10.661 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.662 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.662 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:10.662 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.008147+0000", 2024-04-19T03:02:10.662 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.010793127 2024-04-19T03:02:10.662 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.662 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.662 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:02:10.662 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.008225+0000", 2024-04-19T03:02:10.662 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.7935999999999994e-05 2024-04-19T03:02:10.662 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.662 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.662 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-04-19T03:02:10.662 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.008377+0000", 2024-04-19T03:02:10.663 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00015159099999999999 2024-04-19T03:02:10.663 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.663 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.663 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:02:10.663 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.012629+0000", 2024-04-19T03:02:10.663 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0042520420000000001 2024-04-19T03:02:10.663 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.663 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.663 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:10.663 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.018871+0000", 2024-04-19T03:02:10.663 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0062425060000000001 2024-04-19T03:02:10.663 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.663 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.663 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:02:10.663 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.018910+0000", 2024-04-19T03:02:10.664 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.8482999999999997e-05 2024-04-19T03:02:10.664 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.664 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.664 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:02:10.664 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.018955+0000", 2024-04-19T03:02:10.664 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.5252e-05 2024-04-19T03:02:10.664 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:10.664 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:02:10.664 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:10.664 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.664 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.664 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(mds.0.3:36 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:02:10.664 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:14.997207+0000", 2024-04-19T03:02:10.664 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 55.650047633, 2024-04-19T03:02:10.665 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.022210431999999999, 2024-04-19T03:02:10.665 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:02:10.665 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:10.665 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:02:10.665 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.665 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:02:10.665 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997207+0000", 2024-04-19T03:02:10.665 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:10.665 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.665 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.665 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:02:10.665 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997207+0000", 2024-04-19T03:02:10.665 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:10.666 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.666 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.666 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:02:10.666 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997206+0000", 2024-04-19T03:02:10.666 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2024-04-19T03:02:10.666 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.666 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.666 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:02:10.666 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997218+0000", 2024-04-19T03:02:10.666 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2607e-05 2024-04-19T03:02:10.666 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.666 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.666 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:02:10.667 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997234+0000", 2024-04-19T03:02:10.667 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5583999999999999e-05 2024-04-19T03:02:10.667 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.667 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.667 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:02:10.667 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997248+0000", 2024-04-19T03:02:10.667 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4270000000000001e-05 2024-04-19T03:02:10.667 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.667 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.667 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:10.667 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997397+0000", 2024-04-19T03:02:10.667 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0001482 2024-04-19T03:02:10.667 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.668 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.668 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:02:10.668 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997407+0000", 2024-04-19T03:02:10.668 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0944000000000001e-05 2024-04-19T03:02:10.668 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.668 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.668 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:10.668 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.008173+0000", 2024-04-19T03:02:10.668 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.010765378000000001 2024-04-19T03:02:10.668 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.668 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.668 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:02:10.669 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.008278+0000", 2024-04-19T03:02:10.669 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00010538 2024-04-19T03:02:10.669 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.669 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.669 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 1", 2024-04-19T03:02:10.669 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.008423+0000", 2024-04-19T03:02:10.669 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014525599999999999 2024-04-19T03:02:10.669 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.669 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.669 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:02:10.669 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.012734+0000", 2024-04-19T03:02:10.669 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0043108590000000002 2024-04-19T03:02:10.669 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.669 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.670 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:10.670 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.019318+0000", 2024-04-19T03:02:10.670 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0065836130000000003 2024-04-19T03:02:10.670 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.670 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.670 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:02:10.670 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.019382+0000", 2024-04-19T03:02:10.670 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.3925999999999997e-05 2024-04-19T03:02:10.670 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.670 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.670 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:02:10.670 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.019417+0000", 2024-04-19T03:02:10.670 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.5454999999999999e-05 2024-04-19T03:02:10.671 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:10.671 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:02:10.671 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:10.671 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.671 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.671 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(mds.0.3:15 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:02:10.671 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:14.997260+0000", 2024-04-19T03:02:10.671 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 55.649994481999997, 2024-04-19T03:02:10.671 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.021842842000000001, 2024-04-19T03:02:10.671 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:02:10.671 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:10.671 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:02:10.671 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.671 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:02:10.672 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997260+0000", 2024-04-19T03:02:10.672 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:10.672 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.672 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.672 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:02:10.672 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997260+0000", 2024-04-19T03:02:10.672 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:10.672 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.672 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.672 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:02:10.672 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997259+0000", 2024-04-19T03:02:10.672 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:10.672 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.672 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.673 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:02:10.673 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997270+0000", 2024-04-19T03:02:10.673 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0312999999999999e-05 2024-04-19T03:02:10.673 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.673 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.673 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:02:10.673 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997279+0000", 2024-04-19T03:02:10.673 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.7770000000000008e-06 2024-04-19T03:02:10.673 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.673 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.673 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:02:10.673 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997286+0000", 2024-04-19T03:02:10.673 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.0129999999999996e-06 2024-04-19T03:02:10.673 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.674 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.674 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:10.674 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997433+0000", 2024-04-19T03:02:10.674 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014774699999999999 2024-04-19T03:02:10.674 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.674 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.674 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:02:10.674 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997443+0000", 2024-04-19T03:02:10.674 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.414e-06 2024-04-19T03:02:10.674 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.674 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.674 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:10.674 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.008673+0000", 2024-04-19T03:02:10.674 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.011230789999999999 2024-04-19T03:02:10.675 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.675 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.675 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:02:10.675 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.008808+0000", 2024-04-19T03:02:10.675 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000134346 2024-04-19T03:02:10.675 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.675 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.675 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-04-19T03:02:10.675 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.008922+0000", 2024-04-19T03:02:10.675 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000114444 2024-04-19T03:02:10.675 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.675 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.675 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:02:10.676 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.013442+0000", 2024-04-19T03:02:10.676 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0045193439999999998 2024-04-19T03:02:10.676 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.676 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.676 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:10.676 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.019005+0000", 2024-04-19T03:02:10.676 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00556333 2024-04-19T03:02:10.676 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.676 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.676 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:02:10.676 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.019049+0000", 2024-04-19T03:02:10.676 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.4240000000000003e-05 2024-04-19T03:02:10.676 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.676 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.677 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:02:10.677 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.019103+0000", 2024-04-19T03:02:10.677 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.3706999999999999e-05 2024-04-19T03:02:10.677 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:10.677 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:02:10.677 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:10.677 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.677 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.677 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(mds.0.3:23 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:02:10.677 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:14.997449+0000", 2024-04-19T03:02:10.677 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 55.649805434000001, 2024-04-19T03:02:10.677 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.022679250000000001, 2024-04-19T03:02:10.677 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:02:10.677 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "started", 2024-04-19T03:02:10.678 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:02:10.678 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.678 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:02:10.678 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997449+0000", 2024-04-19T03:02:10.678 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:10.678 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.678 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.678 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:02:10.678 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997449+0000", 2024-04-19T03:02:10.678 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:10.678 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.678 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.678 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:02:10.679 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997448+0000", 2024-04-19T03:02:10.679 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:10.679 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.679 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.679 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:02:10.679 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997452+0000", 2024-04-19T03:02:10.679 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.0369999999999996e-06 2024-04-19T03:02:10.679 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.679 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.679 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:02:10.679 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997461+0000", 2024-04-19T03:02:10.679 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.6100000000000006e-06 2024-04-19T03:02:10.679 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.679 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.680 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:02:10.680 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997468+0000", 2024-04-19T03:02:10.680 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.8360000000000003e-06 2024-04-19T03:02:10.680 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.680 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.680 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:10.680 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997546+0000", 2024-04-19T03:02:10.680 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.7956999999999999e-05 2024-04-19T03:02:10.680 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.680 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.680 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:02:10.680 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997555+0000", 2024-04-19T03:02:10.680 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.2269999999999999e-06 2024-04-19T03:02:10.681 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.681 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.681 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:10.681 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.010065+0000", 2024-04-19T03:02:10.681 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.012509457999999999 2024-04-19T03:02:10.681 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.681 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.681 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:02:10.681 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.010187+0000", 2024-04-19T03:02:10.681 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000122059 2024-04-19T03:02:10.681 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.681 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.681 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:02:10.681 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.020128+0000", 2024-04-19T03:02:10.682 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0099417529999999994 2024-04-19T03:02:10.682 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:10.682 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:02:10.682 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:10.682 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.682 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.682 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(mds.0.3:25 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:02:10.682 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:14.997485+0000", 2024-04-19T03:02:10.682 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 55.649769968000001, 2024-04-19T03:02:10.682 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.021633427, 2024-04-19T03:02:10.682 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:02:10.682 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "started", 2024-04-19T03:02:10.682 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:02:10.683 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.683 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:02:10.683 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997485+0000", 2024-04-19T03:02:10.683 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:10.683 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.683 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.683 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:02:10.683 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997485+0000", 2024-04-19T03:02:10.683 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:10.683 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.683 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.683 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:02:10.683 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997484+0000", 2024-04-19T03:02:10.683 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2024-04-19T03:02:10.684 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.684 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.684 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:02:10.684 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997490+0000", 2024-04-19T03:02:10.684 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.857e-06 2024-04-19T03:02:10.684 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.684 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.684 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:02:10.684 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997505+0000", 2024-04-19T03:02:10.684 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.518e-05 2024-04-19T03:02:10.684 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.684 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.684 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:02:10.684 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997520+0000", 2024-04-19T03:02:10.685 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5026e-05 2024-04-19T03:02:10.685 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.685 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.685 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:10.685 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997607+0000", 2024-04-19T03:02:10.685 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.7107000000000005e-05 2024-04-19T03:02:10.685 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.685 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.685 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op must wait for map", 2024-04-19T03:02:10.685 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997614+0000", 2024-04-19T03:02:10.685 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.0539999999999997e-06 2024-04-19T03:02:10.686 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.686 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.686 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:10.686 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.009808+0000", 2024-04-19T03:02:10.686 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.012194371000000001 2024-04-19T03:02:10.686 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.686 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.686 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:02:10.686 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.010107+0000", 2024-04-19T03:02:10.686 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000298731 2024-04-19T03:02:10.686 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.687 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.687 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:02:10.687 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.019118+0000", 2024-04-19T03:02:10.687 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0090109839999999997 2024-04-19T03:02:10.687 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:10.687 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:02:10.687 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:10.687 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.687 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.688 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4755.0:11277 5.c 5:38c3ceb2:::benchmark_data_smithi096_19531_object11276:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T03:02:10.688 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:42.059676+0000", 2024-04-19T03:02:10.688 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 28.587578346000001, 2024-04-19T03:02:10.688 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.029909680000000001, 2024-04-19T03:02:10.688 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:02:10.688 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:10.688 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-04-19T03:02:10.688 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4755", 2024-04-19T03:02:10.688 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:10.688 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 11277 2024-04-19T03:02:10.688 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.688 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:02:10.688 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.689 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:02:10.689 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.059676+0000", 2024-04-19T03:02:10.689 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:10.689 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.689 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.689 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:02:10.689 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.059676+0000", 2024-04-19T03:02:10.689 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:10.689 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.689 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.689 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:02:10.689 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.059665+0000", 2024-04-19T03:02:10.689 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999886 2024-04-19T03:02:10.690 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.690 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.690 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:02:10.690 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.059777+0000", 2024-04-19T03:02:10.690 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000111953 2024-04-19T03:02:10.690 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.690 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.690 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:02:10.690 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.059789+0000", 2024-04-19T03:02:10.690 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1809e-05 2024-04-19T03:02:10.690 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.690 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.690 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:02:10.690 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.059797+0000", 2024-04-19T03:02:10.691 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.2090000000000005e-06 2024-04-19T03:02:10.691 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.691 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.691 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:10.691 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.060528+0000", 2024-04-19T03:02:10.691 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00073144499999999995 2024-04-19T03:02:10.691 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.691 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.691 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:02:10.691 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.060662+0000", 2024-04-19T03:02:10.691 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000133435 2024-04-19T03:02:10.692 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.692 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.692 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-04-19T03:02:10.692 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.060766+0000", 2024-04-19T03:02:10.692 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00010473500000000001 2024-04-19T03:02:10.692 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.692 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.692 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:02:10.692 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.067649+0000", 2024-04-19T03:02:10.693 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.006882684 2024-04-19T03:02:10.693 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.693 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.693 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:10.693 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.089475+0000", 2024-04-19T03:02:10.693 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.021826196999999999 2024-04-19T03:02:10.693 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.693 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.693 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:02:10.693 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.089535+0000", 2024-04-19T03:02:10.693 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.9239e-05 2024-04-19T03:02:10.693 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.693 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.693 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:02:10.694 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.089586+0000", 2024-04-19T03:02:10.694 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.1288000000000001e-05 2024-04-19T03:02:10.694 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:10.694 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:02:10.694 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:10.694 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.694 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.694 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4755.0:11280 5.6 5:6e34f5e7:::benchmark_data_smithi096_19531_object11279:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T03:02:10.694 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:42.060002+0000", 2024-04-19T03:02:10.694 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 28.587252970000002, 2024-04-19T03:02:10.694 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.028171841999999999, 2024-04-19T03:02:10.694 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:02:10.694 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:10.695 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-04-19T03:02:10.695 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4755", 2024-04-19T03:02:10.695 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:10.695 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 11280 2024-04-19T03:02:10.695 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.695 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:02:10.695 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.695 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:02:10.695 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.060002+0000", 2024-04-19T03:02:10.695 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:10.695 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.695 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.695 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:02:10.695 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.060002+0000", 2024-04-19T03:02:10.696 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:10.696 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.696 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.696 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:02:10.696 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.060000+0000", 2024-04-19T03:02:10.696 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2024-04-19T03:02:10.696 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.696 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.696 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:02:10.696 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.060120+0000", 2024-04-19T03:02:10.696 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00011941400000000001 2024-04-19T03:02:10.696 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.696 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.696 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:02:10.697 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.060132+0000", 2024-04-19T03:02:10.697 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2197e-05 2024-04-19T03:02:10.697 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.697 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.697 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:02:10.697 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.060141+0000", 2024-04-19T03:02:10.697 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.6829999999999997e-06 2024-04-19T03:02:10.697 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.697 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.697 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:10.697 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.060194+0000", 2024-04-19T03:02:10.697 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.3395e-05 2024-04-19T03:02:10.697 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.698 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.698 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:02:10.698 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.060333+0000", 2024-04-19T03:02:10.698 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00013935799999999999 2024-04-19T03:02:10.698 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.698 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.698 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-04-19T03:02:10.698 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.060477+0000", 2024-04-19T03:02:10.698 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000143938 2024-04-19T03:02:10.698 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.698 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.698 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:02:10.698 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.067752+0000", 2024-04-19T03:02:10.698 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0072741580000000002 2024-04-19T03:02:10.699 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.699 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.699 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:10.699 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.088041+0000", 2024-04-19T03:02:10.699 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.020288955000000001 2024-04-19T03:02:10.699 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.699 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.699 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:02:10.699 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.088113+0000", 2024-04-19T03:02:10.699 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.2492999999999999e-05 2024-04-19T03:02:10.699 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.699 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.699 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:02:10.699 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.088173+0000", 2024-04-19T03:02:10.700 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.0418999999999999e-05 2024-04-19T03:02:10.700 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:10.700 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:02:10.700 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:10.700 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.700 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.700 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4755.0:11274 5.e e26/22 5:7c846032:::benchmark_data_smithi096_19531_object11273:head v 26'697, mlcod=26'692)", 2024-04-19T03:02:10.700 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:42.065726+0000", 2024-04-19T03:02:10.700 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 28.581528443, 2024-04-19T03:02:10.700 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.028607227999999998, 2024-04-19T03:02:10.700 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:02:10.700 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:10.700 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:02:10.701 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.701 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:02:10.701 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.065726+0000", 2024-04-19T03:02:10.701 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:10.701 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.701 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.701 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:02:10.701 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.065726+0000", 2024-04-19T03:02:10.701 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:10.701 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.701 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.701 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:02:10.701 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.065725+0000", 2024-04-19T03:02:10.701 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2024-04-19T03:02:10.702 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.702 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.702 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:02:10.702 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.066818+0000", 2024-04-19T03:02:10.702 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0010930110000000001 2024-04-19T03:02:10.702 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.702 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.702 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:02:10.702 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.066826+0000", 2024-04-19T03:02:10.702 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.0609999999999996e-06 2024-04-19T03:02:10.702 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.702 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.702 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:02:10.703 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.066831+0000", 2024-04-19T03:02:10.703 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.7500000000000003e-06 2024-04-19T03:02:10.703 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.703 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.703 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:10.703 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.066857+0000", 2024-04-19T03:02:10.703 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.6126999999999999e-05 2024-04-19T03:02:10.703 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.703 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.703 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:02:10.703 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.066868+0000", 2024-04-19T03:02:10.703 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1113e-05 2024-04-19T03:02:10.704 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.704 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.704 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:02:10.704 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.094266+0000", 2024-04-19T03:02:10.704 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.027397731000000002 2024-04-19T03:02:10.704 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.704 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.704 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:02:10.704 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.094333+0000", 2024-04-19T03:02:10.704 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.7230000000000005e-05 2024-04-19T03:02:10.704 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:10.704 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:02:10.704 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:10.704 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.705 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.705 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4755.0:11279 5.8 e26/22 5:10b60c58:::benchmark_data_smithi096_19531_object11278:head v 26'723, mlcod=26'719)", 2024-04-19T03:02:10.705 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:42.066841+0000", 2024-04-19T03:02:10.705 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 28.580413128, 2024-04-19T03:02:10.705 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.021736267, 2024-04-19T03:02:10.705 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:02:10.705 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:10.705 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:02:10.705 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.705 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:02:10.705 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.066841+0000", 2024-04-19T03:02:10.705 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:10.705 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.706 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.706 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:02:10.706 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.066841+0000", 2024-04-19T03:02:10.706 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:10.706 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.706 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.706 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:02:10.706 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.066841+0000", 2024-04-19T03:02:10.706 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:10.706 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.706 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.706 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:02:10.706 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.066876+0000", 2024-04-19T03:02:10.707 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.4790999999999999e-05 2024-04-19T03:02:10.707 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.707 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.707 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:02:10.707 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.066880+0000", 2024-04-19T03:02:10.707 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.3610000000000003e-06 2024-04-19T03:02:10.707 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.707 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.707 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:02:10.707 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.066883+0000", 2024-04-19T03:02:10.707 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.4079999999999998e-06 2024-04-19T03:02:10.707 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.707 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.708 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:10.708 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.066929+0000", 2024-04-19T03:02:10.708 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.5444000000000001e-05 2024-04-19T03:02:10.708 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.708 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.708 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:02:10.708 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.066951+0000", 2024-04-19T03:02:10.708 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.2578999999999998e-05 2024-04-19T03:02:10.708 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.708 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.708 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:02:10.708 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.088518+0000", 2024-04-19T03:02:10.708 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.021566617 2024-04-19T03:02:10.708 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.709 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.709 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:02:10.709 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.088578+0000", 2024-04-19T03:02:10.709 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.9655999999999999e-05 2024-04-19T03:02:10.709 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:10.709 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:02:10.709 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:10.709 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.709 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.709 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4755.0:11282 5.e e26/22 5:75b7c510:::benchmark_data_smithi096_19531_object11281:head v 26'698, mlcod=26'693)", 2024-04-19T03:02:10.709 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:42.066923+0000", 2024-04-19T03:02:10.709 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 28.580331261000001, 2024-04-19T03:02:10.709 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.027436461999999998, 2024-04-19T03:02:10.710 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:02:10.710 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:10.710 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:02:10.710 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.710 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:02:10.710 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.066923+0000", 2024-04-19T03:02:10.710 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:10.710 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.710 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.710 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:02:10.710 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.066923+0000", 2024-04-19T03:02:10.710 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:10.710 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.710 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.711 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:02:10.711 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.066923+0000", 2024-04-19T03:02:10.711 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:10.711 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.711 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.711 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:02:10.711 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.066955+0000", 2024-04-19T03:02:10.711 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.2060999999999997e-05 2024-04-19T03:02:10.711 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.711 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.711 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:02:10.711 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.066962+0000", 2024-04-19T03:02:10.711 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.1969999999999999e-06 2024-04-19T03:02:10.711 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.712 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.712 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:02:10.712 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.066967+0000", 2024-04-19T03:02:10.712 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.6589999999999998e-06 2024-04-19T03:02:10.712 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.712 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.712 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:10.712 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.067762+0000", 2024-04-19T03:02:10.712 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00079538199999999997 2024-04-19T03:02:10.712 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.712 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.712 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:02:10.712 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.067782+0000", 2024-04-19T03:02:10.712 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.9432999999999998e-05 2024-04-19T03:02:10.713 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.713 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.713 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:02:10.713 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.094339+0000", 2024-04-19T03:02:10.713 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.026556778999999999 2024-04-19T03:02:10.713 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.713 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.713 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:02:10.713 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.094360+0000", 2024-04-19T03:02:10.713 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.1246e-05 2024-04-19T03:02:10.713 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:10.713 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:02:10.713 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:10.713 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.714 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.714 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4755.0:11293 5.c 5:31728bfd:::benchmark_data_smithi096_19531_object11292:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T03:02:10.714 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:42.068359+0000", 2024-04-19T03:02:10.714 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 28.578895437, 2024-04-19T03:02:10.714 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.022306475999999999, 2024-04-19T03:02:10.714 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:02:10.714 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:10.714 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-04-19T03:02:10.714 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4755", 2024-04-19T03:02:10.714 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:10.714 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 11293 2024-04-19T03:02:10.714 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.714 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:02:10.715 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.715 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:02:10.715 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.068359+0000", 2024-04-19T03:02:10.715 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:10.715 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.715 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.715 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:02:10.715 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.068359+0000", 2024-04-19T03:02:10.715 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:10.715 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.715 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.715 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:02:10.715 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.068358+0000", 2024-04-19T03:02:10.715 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2024-04-19T03:02:10.716 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.716 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.716 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:02:10.716 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.068427+0000", 2024-04-19T03:02:10.716 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.9139000000000003e-05 2024-04-19T03:02:10.716 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.716 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.716 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:02:10.716 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.085292+0000", 2024-04-19T03:02:10.716 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.016864371 2024-04-19T03:02:10.716 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.716 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.716 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:02:10.716 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.085306+0000", 2024-04-19T03:02:10.717 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.434e-05 2024-04-19T03:02:10.717 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.717 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.717 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:10.717 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.085404+0000", 2024-04-19T03:02:10.717 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.8145000000000003e-05 2024-04-19T03:02:10.717 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.717 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.717 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:02:10.717 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.085569+0000", 2024-04-19T03:02:10.717 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00016504099999999999 2024-04-19T03:02:10.717 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.717 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.718 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-04-19T03:02:10.718 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.085739+0000", 2024-04-19T03:02:10.718 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000170099 2024-04-19T03:02:10.718 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.718 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.718 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:02:10.718 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.089603+0000", 2024-04-19T03:02:10.718 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0038636080000000001 2024-04-19T03:02:10.718 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.718 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.718 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:10.718 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.090578+0000", 2024-04-19T03:02:10.718 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00097513199999999997 2024-04-19T03:02:10.718 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.719 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.719 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:02:10.719 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.090618+0000", 2024-04-19T03:02:10.719 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.9987999999999997e-05 2024-04-19T03:02:10.719 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.719 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.719 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:02:10.719 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.090666+0000", 2024-04-19T03:02:10.719 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.7420999999999999e-05 2024-04-19T03:02:10.719 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:10.719 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:02:10.719 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:10.719 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.720 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.720 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4755.0:60384 5.a 5:55675f1d:::benchmark_data_smithi096_19531_object60383:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-19T03:02:10.720 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:02:05.864278+0000", 2024-04-19T03:02:10.720 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 4.7829765880000004, 2024-04-19T03:02:10.720 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.021786224999999999, 2024-04-19T03:02:10.720 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:02:10.720 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:10.720 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-04-19T03:02:10.720 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4755", 2024-04-19T03:02:10.720 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:10.720 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 60384 2024-04-19T03:02:10.720 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.720 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:02:10.720 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.721 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:02:10.721 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:05.864278+0000", 2024-04-19T03:02:10.721 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:10.721 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.721 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.721 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:02:10.721 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:05.864278+0000", 2024-04-19T03:02:10.721 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:10.721 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.721 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.721 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:02:10.721 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:05.864277+0000", 2024-04-19T03:02:10.721 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:10.721 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.722 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.722 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:02:10.722 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:05.864344+0000", 2024-04-19T03:02:10.722 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.7392999999999997e-05 2024-04-19T03:02:10.722 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.722 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.722 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:02:10.722 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:05.864355+0000", 2024-04-19T03:02:10.722 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1083999999999999e-05 2024-04-19T03:02:10.722 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.722 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.722 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:02:10.722 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:05.864363+0000", 2024-04-19T03:02:10.722 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.9529999999999999e-06 2024-04-19T03:02:10.723 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.723 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.723 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:10.723 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:05.865979+0000", 2024-04-19T03:02:10.723 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001616159 2024-04-19T03:02:10.723 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.723 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.723 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:02:10.723 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:05.866059+0000", 2024-04-19T03:02:10.723 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.0343e-05 2024-04-19T03:02:10.723 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.723 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.723 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 1", 2024-04-19T03:02:10.724 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:05.866179+0000", 2024-04-19T03:02:10.724 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000119072 2024-04-19T03:02:10.724 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.724 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.724 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:10.724 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:05.875531+0000", 2024-04-19T03:02:10.724 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0093528770000000008 2024-04-19T03:02:10.724 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.724 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.724 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:02:10.724 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:05.885821+0000", 2024-04-19T03:02:10.724 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0102892 2024-04-19T03:02:10.724 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.724 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.725 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:02:10.725 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:05.886025+0000", 2024-04-19T03:02:10.725 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000204086 2024-04-19T03:02:10.725 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.725 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.725 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:02:10.725 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:05.886064+0000", 2024-04-19T03:02:10.725 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.9458000000000001e-05 2024-04-19T03:02:10.725 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:10.725 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:02:10.725 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:10.725 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.725 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.725 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4755.0:60674 5.5 5:aaf3a5ff:::benchmark_data_smithi096_19531_object60673:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-19T03:02:10.726 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:02:06.038509+0000", 2024-04-19T03:02:10.726 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 4.6087455970000004, 2024-04-19T03:02:10.726 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.024267756000000001, 2024-04-19T03:02:10.726 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:02:10.726 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:10.726 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-04-19T03:02:10.726 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4755", 2024-04-19T03:02:10.726 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:10.726 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 60674 2024-04-19T03:02:10.726 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.726 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:02:10.726 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.726 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:02:10.727 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.038509+0000", 2024-04-19T03:02:10.727 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:10.727 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.727 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.727 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:02:10.727 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.038509+0000", 2024-04-19T03:02:10.727 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:10.727 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.727 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.727 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:02:10.727 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.038507+0000", 2024-04-19T03:02:10.727 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999981 2024-04-19T03:02:10.727 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.727 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.728 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:02:10.728 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.038584+0000", 2024-04-19T03:02:10.728 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.6947999999999996e-05 2024-04-19T03:02:10.728 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.728 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.728 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:02:10.728 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.038597+0000", 2024-04-19T03:02:10.728 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2863e-05 2024-04-19T03:02:10.728 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.728 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.728 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:02:10.728 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.038606+0000", 2024-04-19T03:02:10.728 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.9209999999999998e-06 2024-04-19T03:02:10.729 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.729 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.729 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:10.729 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.041247+0000", 2024-04-19T03:02:10.729 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0026412720000000001 2024-04-19T03:02:10.729 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.729 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.729 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:02:10.729 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.041436+0000", 2024-04-19T03:02:10.729 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00018870599999999999 2024-04-19T03:02:10.729 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.729 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.729 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-04-19T03:02:10.729 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.041636+0000", 2024-04-19T03:02:10.730 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00020026399999999999 2024-04-19T03:02:10.730 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.730 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.730 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:10.730 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.048757+0000", 2024-04-19T03:02:10.730 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0071207620000000001 2024-04-19T03:02:10.730 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.730 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.730 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:02:10.730 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.062687+0000", 2024-04-19T03:02:10.730 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.013929811 2024-04-19T03:02:10.730 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.730 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.731 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:02:10.731 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.062740+0000", 2024-04-19T03:02:10.731 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.3735e-05 2024-04-19T03:02:10.731 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.731 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.731 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:02:10.731 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.062777+0000", 2024-04-19T03:02:10.731 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.6366999999999999e-05 2024-04-19T03:02:10.731 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:10.731 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:02:10.731 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:10.731 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.731 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.731 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4755.0:60677 5.5 5:aad57123:::benchmark_data_smithi096_19531_object60676:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-19T03:02:10.732 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:02:06.039077+0000", 2024-04-19T03:02:10.732 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 4.6081771620000005, 2024-04-19T03:02:10.732 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.023852720000000001, 2024-04-19T03:02:10.732 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:02:10.732 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:10.732 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-04-19T03:02:10.732 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4755", 2024-04-19T03:02:10.732 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:10.732 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 60677 2024-04-19T03:02:10.732 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.732 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:02:10.732 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.732 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:02:10.732 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.039077+0000", 2024-04-19T03:02:10.733 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:10.733 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.733 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.733 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:02:10.733 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.039077+0000", 2024-04-19T03:02:10.733 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:10.733 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.733 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.733 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:02:10.733 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.039076+0000", 2024-04-19T03:02:10.733 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2024-04-19T03:02:10.733 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.733 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.733 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:02:10.733 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.039158+0000", 2024-04-19T03:02:10.734 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.1310000000000006e-05 2024-04-19T03:02:10.734 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.734 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.734 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:02:10.734 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.039171+0000", 2024-04-19T03:02:10.734 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.3010000000000001e-05 2024-04-19T03:02:10.734 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.734 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.734 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:02:10.734 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.039178+0000", 2024-04-19T03:02:10.734 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.8519999999999998e-06 2024-04-19T03:02:10.734 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.734 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.734 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:10.735 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.048813+0000", 2024-04-19T03:02:10.735 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0096353600000000008 2024-04-19T03:02:10.735 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.735 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.735 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:02:10.735 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.048986+0000", 2024-04-19T03:02:10.735 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000173234 2024-04-19T03:02:10.735 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.735 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.735 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-04-19T03:02:10.735 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.049147+0000", 2024-04-19T03:02:10.735 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00016059000000000001 2024-04-19T03:02:10.735 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.735 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.736 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:02:10.736 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.062805+0000", 2024-04-19T03:02:10.736 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.013658267999999999 2024-04-19T03:02:10.736 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.736 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.736 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:10.736 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.062858+0000", 2024-04-19T03:02:10.736 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.3177999999999998e-05 2024-04-19T03:02:10.736 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.736 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.736 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:02:10.736 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.062903+0000", 2024-04-19T03:02:10.736 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.4336999999999999e-05 2024-04-19T03:02:10.736 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.737 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.737 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:02:10.737 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.062930+0000", 2024-04-19T03:02:10.737 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.7492e-05 2024-04-19T03:02:10.737 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:10.737 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:02:10.737 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:10.737 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.737 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.737 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4755.0:60686 5.5 5:a9caa390:::benchmark_data_smithi096_19531_object60685:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-19T03:02:10.737 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:02:06.044469+0000", 2024-04-19T03:02:10.737 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 4.6027858869999996, 2024-04-19T03:02:10.737 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.021099772999999999, 2024-04-19T03:02:10.738 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:02:10.738 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:10.738 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-04-19T03:02:10.738 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4755", 2024-04-19T03:02:10.738 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:10.738 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 60686 2024-04-19T03:02:10.738 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.738 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:02:10.738 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.738 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:02:10.738 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.044469+0000", 2024-04-19T03:02:10.738 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:10.738 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.738 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.739 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:02:10.739 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.044469+0000", 2024-04-19T03:02:10.739 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:10.739 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.739 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.739 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:02:10.739 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.044467+0000", 2024-04-19T03:02:10.739 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:10.739 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.739 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.739 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:02:10.739 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.044516+0000", 2024-04-19T03:02:10.739 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.9143e-05 2024-04-19T03:02:10.740 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.740 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.740 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:02:10.740 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.044530+0000", 2024-04-19T03:02:10.740 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.3526000000000001e-05 2024-04-19T03:02:10.740 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.740 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.740 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:02:10.740 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.044537+0000", 2024-04-19T03:02:10.740 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.8990000000000004e-06 2024-04-19T03:02:10.740 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.740 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.740 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:10.740 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.054411+0000", 2024-04-19T03:02:10.741 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0098746949999999993 2024-04-19T03:02:10.741 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.741 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.741 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:02:10.741 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.054606+0000", 2024-04-19T03:02:10.741 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00019422100000000001 2024-04-19T03:02:10.741 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.741 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.741 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-04-19T03:02:10.741 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.054848+0000", 2024-04-19T03:02:10.741 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00024189799999999999 2024-04-19T03:02:10.741 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.741 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.741 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:02:10.742 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.063095+0000", 2024-04-19T03:02:10.742 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0082472020000000004 2024-04-19T03:02:10.742 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.742 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.742 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:10.742 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.065481+0000", 2024-04-19T03:02:10.742 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00238623 2024-04-19T03:02:10.742 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.742 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.742 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:02:10.742 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.065532+0000", 2024-04-19T03:02:10.742 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.0509e-05 2024-04-19T03:02:10.742 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.743 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.743 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:02:10.743 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.065568+0000", 2024-04-19T03:02:10.743 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.6876999999999999e-05 2024-04-19T03:02:10.743 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:10.743 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:02:10.743 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:10.743 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.743 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.743 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4755.0:60689 5.5 5:adf8d35d:::benchmark_data_smithi096_19531_object60688:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-19T03:02:10.743 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:02:06.047459+0000", 2024-04-19T03:02:10.743 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 4.5997958260000003, 2024-04-19T03:02:10.743 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.021837532, 2024-04-19T03:02:10.743 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:02:10.744 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:10.744 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-04-19T03:02:10.744 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4755", 2024-04-19T03:02:10.744 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:10.744 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 60689 2024-04-19T03:02:10.744 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.744 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:02:10.744 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.744 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:02:10.744 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.047459+0000", 2024-04-19T03:02:10.744 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:10.744 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.744 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.744 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:02:10.745 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.047459+0000", 2024-04-19T03:02:10.745 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:10.745 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.745 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.745 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:02:10.745 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.047458+0000", 2024-04-19T03:02:10.745 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2024-04-19T03:02:10.745 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.745 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.745 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:02:10.745 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.047527+0000", 2024-04-19T03:02:10.745 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.9114000000000003e-05 2024-04-19T03:02:10.745 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.745 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.746 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:02:10.746 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.047538+0000", 2024-04-19T03:02:10.746 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.094e-05 2024-04-19T03:02:10.746 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.746 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.746 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:02:10.746 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.047542+0000", 2024-04-19T03:02:10.746 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.4689999999999999e-06 2024-04-19T03:02:10.746 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.746 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.746 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:10.746 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.059742+0000", 2024-04-19T03:02:10.746 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.012200103 2024-04-19T03:02:10.747 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.747 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.747 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:02:10.747 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.059904+0000", 2024-04-19T03:02:10.747 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00016191900000000001 2024-04-19T03:02:10.747 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.747 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.747 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-04-19T03:02:10.747 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.060079+0000", 2024-04-19T03:02:10.747 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00017477500000000001 2024-04-19T03:02:10.747 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.747 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.747 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:10.747 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.067922+0000", 2024-04-19T03:02:10.747 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0078434720000000006 2024-04-19T03:02:10.748 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.748 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.748 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:02:10.748 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.069163+0000", 2024-04-19T03:02:10.748 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0012401389999999999 2024-04-19T03:02:10.748 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.748 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.748 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:02:10.748 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.069238+0000", 2024-04-19T03:02:10.748 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.4955000000000003e-05 2024-04-19T03:02:10.748 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.748 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.748 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:02:10.748 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.069296+0000", 2024-04-19T03:02:10.749 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.8726e-05 2024-04-19T03:02:10.749 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:10.749 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:02:10.749 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:10.749 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.749 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.749 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4755.0:60746 5.6 5:68292fbc:::benchmark_data_smithi096_19531_object60745:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-19T03:02:10.749 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:02:06.088145+0000", 2024-04-19T03:02:10.749 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 4.559109726, 2024-04-19T03:02:10.749 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.021267332, 2024-04-19T03:02:10.749 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:02:10.749 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:10.749 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-04-19T03:02:10.750 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4755", 2024-04-19T03:02:10.750 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:10.750 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 60746 2024-04-19T03:02:10.750 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.750 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:02:10.750 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.750 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:02:10.750 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.088145+0000", 2024-04-19T03:02:10.750 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:10.750 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.750 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.750 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:02:10.750 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.088145+0000", 2024-04-19T03:02:10.751 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:10.751 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.751 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.751 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:02:10.751 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.088144+0000", 2024-04-19T03:02:10.751 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2024-04-19T03:02:10.751 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.751 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.751 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:02:10.751 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.088187+0000", 2024-04-19T03:02:10.751 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.337e-05 2024-04-19T03:02:10.751 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.751 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.751 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:02:10.752 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.088199+0000", 2024-04-19T03:02:10.752 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1654999999999999e-05 2024-04-19T03:02:10.752 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.752 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.752 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:02:10.752 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.088205+0000", 2024-04-19T03:02:10.752 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.3840000000000002e-06 2024-04-19T03:02:10.752 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.752 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.752 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:10.752 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.095361+0000", 2024-04-19T03:02:10.752 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0071557799999999996 2024-04-19T03:02:10.753 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.753 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.753 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:02:10.753 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.095490+0000", 2024-04-19T03:02:10.753 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012866700000000001 2024-04-19T03:02:10.753 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.753 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.753 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-04-19T03:02:10.753 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.095629+0000", 2024-04-19T03:02:10.754 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000139529 2024-04-19T03:02:10.754 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.754 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.754 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:02:10.754 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.101867+0000", 2024-04-19T03:02:10.754 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0062376259999999996 2024-04-19T03:02:10.754 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.754 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.754 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:10.754 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.109360+0000", 2024-04-19T03:02:10.754 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0074929799999999998 2024-04-19T03:02:10.754 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.754 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.755 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:02:10.755 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.109389+0000", 2024-04-19T03:02:10.755 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.8759999999999999e-05 2024-04-19T03:02:10.755 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.755 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.755 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:02:10.755 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.109412+0000", 2024-04-19T03:02:10.755 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.3354999999999999e-05 2024-04-19T03:02:10.755 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:10.755 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:02:10.755 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:10.755 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.755 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.755 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4755.0:67705 5.3 5:cee6fde7:::benchmark_data_smithi096_19531_object67704:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T03:02:10.756 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:02:10.204519+0000", 2024-04-19T03:02:10.756 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 0.44273532700000001, 2024-04-19T03:02:10.756 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.023064485999999999, 2024-04-19T03:02:10.756 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:02:10.756 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:10.756 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-04-19T03:02:10.756 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4755", 2024-04-19T03:02:10.756 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:10.756 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 67705 2024-04-19T03:02:10.756 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.756 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:02:10.756 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.756 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:02:10.756 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:10.204519+0000", 2024-04-19T03:02:10.757 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:10.757 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.757 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.757 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:02:10.757 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:10.204519+0000", 2024-04-19T03:02:10.757 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:10.757 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.757 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.757 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:02:10.757 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:10.204519+0000", 2024-04-19T03:02:10.757 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:10.757 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.757 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.757 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:02:10.758 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:10.204549+0000", 2024-04-19T03:02:10.758 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0479000000000001e-05 2024-04-19T03:02:10.758 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.758 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.758 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:02:10.758 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:10.204557+0000", 2024-04-19T03:02:10.758 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.5039999999999996e-06 2024-04-19T03:02:10.758 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.758 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.758 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:02:10.758 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:10.204562+0000", 2024-04-19T03:02:10.758 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.305e-06 2024-04-19T03:02:10.758 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.758 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.759 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:10.759 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:10.215382+0000", 2024-04-19T03:02:10.759 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.010820348 2024-04-19T03:02:10.759 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.759 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.759 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:02:10.759 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:10.215604+0000", 2024-04-19T03:02:10.759 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000221645 2024-04-19T03:02:10.759 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.759 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.759 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-04-19T03:02:10.759 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:10.215775+0000", 2024-04-19T03:02:10.759 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00017157500000000001 2024-04-19T03:02:10.760 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.760 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.760 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:10.760 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:10.227474+0000", 2024-04-19T03:02:10.760 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.011699016 2024-04-19T03:02:10.760 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.760 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.760 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:02:10.760 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:10.227491+0000", 2024-04-19T03:02:10.760 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.6977999999999999e-05 2024-04-19T03:02:10.760 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.760 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.760 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:02:10.760 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:10.227546+0000", 2024-04-19T03:02:10.761 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.4768000000000001e-05 2024-04-19T03:02:10.761 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.761 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.761 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:02:10.761 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:10.227584+0000", 2024-04-19T03:02:10.761 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.7512000000000003e-05 2024-04-19T03:02:10.761 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:10.761 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:02:10.761 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:10.761 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.761 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.761 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4755.0:67724 5.3 5:cd75df27:::benchmark_data_smithi096_19531_object67723:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T03:02:10.761 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:02:10.213723+0000", 2024-04-19T03:02:10.761 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 0.43353130899999998, 2024-04-19T03:02:10.762 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.021797713999999999, 2024-04-19T03:02:10.762 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:02:10.762 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:10.762 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-04-19T03:02:10.762 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4755", 2024-04-19T03:02:10.762 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:10.762 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 67724 2024-04-19T03:02:10.762 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.762 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:02:10.762 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.762 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:02:10.762 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:10.213723+0000", 2024-04-19T03:02:10.762 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:10.763 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.763 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.763 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:02:10.763 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:10.213723+0000", 2024-04-19T03:02:10.763 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:10.763 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.763 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.763 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:02:10.763 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:10.213722+0000", 2024-04-19T03:02:10.763 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:10.763 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.763 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.763 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:02:10.763 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:10.213757+0000", 2024-04-19T03:02:10.764 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.5348000000000001e-05 2024-04-19T03:02:10.764 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.764 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.764 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:02:10.764 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:10.213770+0000", 2024-04-19T03:02:10.764 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2663999999999999e-05 2024-04-19T03:02:10.764 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.764 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.764 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:02:10.764 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:10.213778+0000", 2024-04-19T03:02:10.764 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.1629999999999996e-06 2024-04-19T03:02:10.764 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.764 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.765 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:10.765 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:10.227880+0000", 2024-04-19T03:02:10.765 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.014102412999999999 2024-04-19T03:02:10.765 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.765 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.765 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:02:10.765 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:10.227978+0000", 2024-04-19T03:02:10.765 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.7112000000000001e-05 2024-04-19T03:02:10.765 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.765 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.765 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-04-19T03:02:10.765 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:10.228067+0000", 2024-04-19T03:02:10.765 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.9346999999999997e-05 2024-04-19T03:02:10.766 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.766 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.766 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:02:10.766 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:10.231243+0000", 2024-04-19T03:02:10.766 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0031756699999999998 2024-04-19T03:02:10.766 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.766 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.766 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:10.766 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:10.235440+0000", 2024-04-19T03:02:10.766 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0041977890000000004 2024-04-19T03:02:10.766 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.766 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.766 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:02:10.766 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:10.235474+0000", 2024-04-19T03:02:10.767 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.3324000000000001e-05 2024-04-19T03:02:10.767 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:10.767 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:10.767 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:02:10.767 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:10.235521+0000", 2024-04-19T03:02:10.767 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.7318999999999999e-05 2024-04-19T03:02:10.767 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:10.767 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:02:10.767 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:10.767 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:10.767 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:02:10.767 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-04-19T03:02:10.769 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:10.767+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:10.769 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T03:02:10.823 INFO:tasks.radosbench.radosbench.0.smithi096.stdout: 33 16 68734 68718 130.133 104.125 0.0101655 0.00767761 2024-04-19T03:02:10.869 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:10.867+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:10.888 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-19T03:02:10.898 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-19T03:02:10.898 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-04-19T03:02:10.898 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:10.898 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:68854 5.d 5:bc16d263:::benchmark_data_smithi096_19531_object68853:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T03:02:10.898 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:10.891931+0000", 2024-04-19T03:02:10.898 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0059226089999999997, 2024-04-19T03:02:10.898 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0059444099999999998, 2024-04-19T03:02:10.898 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:10.898 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:02:10.898 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:10.898 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:10.899 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:10.899 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 68854 2024-04-19T03:02:10.899 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:10.899 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:10.899 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:10.899 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:10.899 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:10.891931+0000", 2024-04-19T03:02:10.899 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:10.899 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:10.899 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:10.899 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:10.899 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:10.891931+0000", 2024-04-19T03:02:10.899 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:10.899 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:10.900 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:10.900 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:10.900 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:10.891930+0000", 2024-04-19T03:02:10.900 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:10.900 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:10.900 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:10.900 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:10.900 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:10.891982+0000", 2024-04-19T03:02:10.900 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2046000000000003e-05 2024-04-19T03:02:10.900 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:10.900 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:10.900 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:10.900 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:10.891996+0000", 2024-04-19T03:02:10.901 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3424000000000001e-05 2024-04-19T03:02:10.901 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:10.901 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:10.901 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:10.901 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:10.892003+0000", 2024-04-19T03:02:10.901 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.7719999999999994e-06 2024-04-19T03:02:10.901 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:10.901 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:10.901 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:10.901 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:10.893458+0000", 2024-04-19T03:02:10.901 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0014540180000000001 2024-04-19T03:02:10.901 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:10.901 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:10.901 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:10.902 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:10.893629+0000", 2024-04-19T03:02:10.902 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00017142899999999999 2024-04-19T03:02:10.902 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:10.902 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:10.902 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-04-19T03:02:10.902 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:10.893829+0000", 2024-04-19T03:02:10.902 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00020039299999999999 2024-04-19T03:02:10.902 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:10.902 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:10.902 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:10.902 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:10.897605+0000", 2024-04-19T03:02:10.902 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0037759949999999999 2024-04-19T03:02:10.902 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:10.903 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:10.903 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:10.903 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:10.903 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:10.903 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:68858 5.b 5:d6924719:::benchmark_data_smithi096_19531_object68857:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T03:02:10.903 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:10.894483+0000", 2024-04-19T03:02:10.903 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0033706000000000001, 2024-04-19T03:02:10.903 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0034523280000000002, 2024-04-19T03:02:10.903 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:10.903 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:02:10.903 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:10.903 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:10.903 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:10.903 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 68858 2024-04-19T03:02:10.904 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:10.904 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:10.904 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:10.904 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:10.904 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:10.894483+0000", 2024-04-19T03:02:10.904 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:10.904 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:10.904 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:10.904 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:10.904 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:10.894483+0000", 2024-04-19T03:02:10.904 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:10.904 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:10.904 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:10.904 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:10.905 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:10.894483+0000", 2024-04-19T03:02:10.905 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:10.905 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:10.905 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:10.905 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:10.905 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:10.894555+0000", 2024-04-19T03:02:10.905 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2750999999999995e-05 2024-04-19T03:02:10.905 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:10.905 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:10.905 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:10.905 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:10.894569+0000", 2024-04-19T03:02:10.905 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.346e-05 2024-04-19T03:02:10.905 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:10.905 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:10.906 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:10.906 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:10.894577+0000", 2024-04-19T03:02:10.906 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.9249999999999995e-06 2024-04-19T03:02:10.906 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:10.906 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:10.906 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:10.906 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:10.894621+0000", 2024-04-19T03:02:10.906 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4242000000000001e-05 2024-04-19T03:02:10.906 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:10.906 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:10.906 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:10.906 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:10.896529+0000", 2024-04-19T03:02:10.906 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0019076869999999999 2024-04-19T03:02:10.906 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:10.907 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:10.907 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:10.907 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:10.896632+0000", 2024-04-19T03:02:10.907 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000103192 2024-04-19T03:02:10.907 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:10.907 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:10.907 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:10.907 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:10.907 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:10.907 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4755.0:68849 5.f e37/22 5:f1802bd7:::benchmark_data_smithi096_19531_object68848:head v 37'4309, mlcod=37'4306)", 2024-04-19T03:02:10.907 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:10.894652+0000", 2024-04-19T03:02:10.907 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0032017949999999999, 2024-04-19T03:02:10.907 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0033308500000000002, 2024-04-19T03:02:10.907 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:10.908 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-19T03:02:10.908 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:10.908 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:10.908 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:10.908 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:10.894652+0000", 2024-04-19T03:02:10.908 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:10.908 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:10.908 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:10.908 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:10.908 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:10.894652+0000", 2024-04-19T03:02:10.908 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:10.908 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:10.908 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:10.908 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:10.909 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:10.894652+0000", 2024-04-19T03:02:10.909 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:10.909 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:10.909 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:10.909 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:10.909 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:10.894717+0000", 2024-04-19T03:02:10.909 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5265000000000006e-05 2024-04-19T03:02:10.909 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:10.909 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:10.909 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:10.909 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:10.894727+0000", 2024-04-19T03:02:10.909 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.8879999999999992e-06 2024-04-19T03:02:10.909 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:10.909 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:10.909 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:10.910 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:10.894734+0000", 2024-04-19T03:02:10.910 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.0729999999999999e-06 2024-04-19T03:02:10.910 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:10.910 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:10.910 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:10.910 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:10.894771+0000", 2024-04-19T03:02:10.910 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6900999999999998e-05 2024-04-19T03:02:10.910 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:10.910 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:10.910 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:10.910 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:10.894789+0000", 2024-04-19T03:02:10.910 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8766e-05 2024-04-19T03:02:10.910 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:10.910 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:10.911 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:10.911 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:10.911 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:10.911 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4755.0:68850 5.a e37/22 5:5254e9f5:::benchmark_data_smithi096_19531_object68849:head v 37'4177, mlcod=37'4173)", 2024-04-19T03:02:10.911 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:10.896462+0000", 2024-04-19T03:02:10.911 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.001391448, 2024-04-19T03:02:10.911 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0015569819999999999, 2024-04-19T03:02:10.911 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:10.911 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-19T03:02:10.911 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:10.911 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:10.911 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:10.911 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:10.896462+0000", 2024-04-19T03:02:10.911 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:10.911 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:10.912 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:10.912 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:10.912 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:10.896462+0000", 2024-04-19T03:02:10.912 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:10.912 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:10.912 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:10.912 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:10.912 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:10.896462+0000", 2024-04-19T03:02:10.912 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:10.912 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:10.912 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:10.912 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:10.912 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:10.896491+0000", 2024-04-19T03:02:10.912 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9008000000000001e-05 2024-04-19T03:02:10.913 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:10.913 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:10.913 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:10.913 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:10.896501+0000", 2024-04-19T03:02:10.913 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.8849999999999994e-06 2024-04-19T03:02:10.913 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:10.913 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:10.913 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:10.913 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:10.896507+0000", 2024-04-19T03:02:10.913 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6619999999999999e-06 2024-04-19T03:02:10.913 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:10.913 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:10.913 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:10.913 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:10.896550+0000", 2024-04-19T03:02:10.914 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2160999999999998e-05 2024-04-19T03:02:10.914 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:10.914 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:10.914 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:10.914 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:10.896569+0000", 2024-04-19T03:02:10.914 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.948e-05 2024-04-19T03:02:10.914 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:10.914 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:10.914 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:10.914 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:10.914 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:10.914 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4755.0:68855 5.f e37/22 5:fe101c0a:::benchmark_data_smithi096_19531_object68854:head v 37'4310, mlcod=37'4306)", 2024-04-19T03:02:10.914 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:10.897178+0000", 2024-04-19T03:02:10.914 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.00067644600000000004, 2024-04-19T03:02:10.915 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00087932799999999997, 2024-04-19T03:02:10.915 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:10.915 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-19T03:02:10.915 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:10.915 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:10.915 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:10.915 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:10.897178+0000", 2024-04-19T03:02:10.915 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:10.915 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:10.915 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:10.915 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:10.915 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:10.897178+0000", 2024-04-19T03:02:10.915 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:10.915 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:10.915 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:10.916 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:10.916 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:10.897177+0000", 2024-04-19T03:02:10.916 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:10.916 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:10.916 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:10.916 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:10.916 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:10.897233+0000", 2024-04-19T03:02:10.916 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6532e-05 2024-04-19T03:02:10.916 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:10.916 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:10.916 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:10.916 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:10.897250+0000", 2024-04-19T03:02:10.916 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6456999999999998e-05 2024-04-19T03:02:10.916 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:10.916 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:10.917 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:10.917 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:10.897260+0000", 2024-04-19T03:02:10.917 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0047999999999999e-05 2024-04-19T03:02:10.917 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:10.917 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:10.917 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:10.917 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:10.897292+0000", 2024-04-19T03:02:10.917 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2001000000000001e-05 2024-04-19T03:02:10.917 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:10.917 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:10.917 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:10.917 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:10.897308+0000", 2024-04-19T03:02:10.917 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5778e-05 2024-04-19T03:02:10.917 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:10.918 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:10.918 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:10.918 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:10.918 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:10.918 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:68860 5.8 5:124a9458:::benchmark_data_smithi096_19531_object68859:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T03:02:10.918 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:10.897273+0000", 2024-04-19T03:02:10.918 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.00058087899999999997, 2024-04-19T03:02:10.918 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00082221900000000001, 2024-04-19T03:02:10.918 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:10.918 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:02:10.918 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:10.918 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:10.918 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:10.918 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 68860 2024-04-19T03:02:10.919 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:10.919 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:10.919 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:10.919 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:10.919 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:10.897273+0000", 2024-04-19T03:02:10.919 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:10.919 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:10.919 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:10.919 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:10.919 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:10.897273+0000", 2024-04-19T03:02:10.919 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:10.919 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:10.919 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:10.919 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:10.919 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:10.897272+0000", 2024-04-19T03:02:10.920 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:10.920 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:10.920 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:10.920 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:10.920 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:10.897335+0000", 2024-04-19T03:02:10.920 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3281999999999995e-05 2024-04-19T03:02:10.920 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:10.920 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:10.920 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:10.920 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:10.897354+0000", 2024-04-19T03:02:10.920 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8355e-05 2024-04-19T03:02:10.920 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:10.920 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:10.920 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:10.921 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:10.897368+0000", 2024-04-19T03:02:10.921 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4100999999999999e-05 2024-04-19T03:02:10.921 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:10.921 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:10.921 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:10.921 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:10.897419+0000", 2024-04-19T03:02:10.921 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1106000000000002e-05 2024-04-19T03:02:10.921 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:10.921 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:10.921 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:10.921 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:10.897594+0000", 2024-04-19T03:02:10.921 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00017516100000000001 2024-04-19T03:02:10.921 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:10.921 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:10.921 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:10.922 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:10.897755+0000", 2024-04-19T03:02:10.922 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016072600000000001 2024-04-19T03:02:10.922 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:10.922 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:10.922 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:10.922 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:10.922 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-04-19T03:02:10.922 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 6 2024-04-19T03:02:10.922 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-19T03:02:10.923 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T03:02:10.971 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:10.969+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:11.045 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0: {} 2024-04-19T03:02:11.047 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-19T03:02:11.048 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-04-19T03:02:11.048 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-04-19T03:02:11.048 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-04-19T03:02:11.048 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-19T03:02:11.060 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T03:02:11.067 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1: {} 2024-04-19T03:02:11.071 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:11.069+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:11.087 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2: {} 2024-04-19T03:02:11.090 INFO:teuthology.orchestra.run.smithi096.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T03:02:11.090 INFO:teuthology.orchestra.run.smithi096.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-19T03:02:11.090 INFO:teuthology.orchestra.run.smithi096.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-19T03:02:11.172 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-04-19T03:02:11.170+0000 7f35986ab700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18243) UID: 0 2024-04-19T03:02:11.181 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-19T03:02:11.186 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-19T03:02:11.186 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:02:11.198 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T03:02:11.273 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:11.269+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:11.322 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-04-19T03:02:11.323 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:02:11.335 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T03:02:11.375 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:11.371+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:11.462 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-04-19T03:02:11.462 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:02:11.474 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T03:02:11.475 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:11.473+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:11.577 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:11.573+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:11.600 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-04-19T03:02:11.600 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:02:11.612 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T03:02:11.678 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:11.677+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:11.748 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-04-19T03:02:11.748 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:02:11.760 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T03:02:11.779 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:11.777+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:11.823 INFO:tasks.radosbench.radosbench.0.smithi096.stdout: 34 16 70433 70417 129.428 106.188 0.00760379 0.00771966 2024-04-19T03:02:11.881 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:11.879+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:11.895 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-04-19T03:02:11.895 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:02:11.908 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T03:02:11.981 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:11.977+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:12.041 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-04-19T03:02:12.041 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:02:12.053 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T03:02:12.082 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-04-19T03:02:12.078+0000 7f35986ab700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18243) UID: 0 2024-04-19T03:02:12.174 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-19T03:02:12.174 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:02:12.182 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:12.179+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:12.185 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T03:02:12.186 INFO:teuthology.orchestra.run.smithi096.stderr:noscrub is set 2024-04-19T03:02:12.283 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-04-19T03:02:12.282+0000 7f35986ab700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18243) UID: 0 2024-04-19T03:02:12.315 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-19T03:02:12.315 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:02:12.327 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T03:02:12.384 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-04-19T03:02:12.382+0000 7f35986ab700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18243) UID: 0 2024-04-19T03:02:12.454 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-19T03:02:12.454 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:02:12.467 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T03:02:12.514 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:12.513+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:12.587 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:12.585+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:12.600 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-04-19T03:02:12.601 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:02:12.611 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T03:02:12.688 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:12.687+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:12.734 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-04-19T03:02:12.734 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:02:12.746 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T03:02:12.789 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-04-19T03:02:12.786+0000 7f35986ab700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18243) UID: 0 2024-04-19T03:02:12.823 INFO:tasks.radosbench.radosbench.0.smithi096.stdout: 35 16 72080 72064 128.671 102.938 0.0150606 0.00776529 2024-04-19T03:02:12.872 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-04-19T03:02:12.872 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:02:12.884 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T03:02:12.890 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:12.889+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:12.991 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:12.989+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:13.016 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-04-19T03:02:13.016 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:02:13.028 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T03:02:13.092 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:13.089+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:13.101 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-19T03:02:13.158 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-04-19T03:02:13.158 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:02:13.171 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T03:02:13.193 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:13.189+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:13.254 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0: {} 2024-04-19T03:02:13.275 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1: {} 2024-04-19T03:02:13.294 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-04-19T03:02:13.290+0000 7f35986ab700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18243) UID: 0 2024-04-19T03:02:13.294 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2: {} 2024-04-19T03:02:13.297 INFO:teuthology.orchestra.run.smithi096.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T03:02:13.297 INFO:teuthology.orchestra.run.smithi096.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-19T03:02:13.297 INFO:teuthology.orchestra.run.smithi096.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-19T03:02:13.302 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-04-19T03:02:13.303 INFO:teuthology.orchestra.run.smithi097.stdout: "size": 20, 2024-04-19T03:02:13.303 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 600, 2024-04-19T03:02:13.303 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [ 2024-04-19T03:02:13.303 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.303 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(mds.0.3:14 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:02:13.303 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:14.997079+0000", 2024-04-19T03:02:13.303 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 58.302014864, 2024-04-19T03:02:13.303 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.021951970000000001, 2024-04-19T03:02:13.303 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:02:13.303 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:13.303 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:02:13.303 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.304 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:02:13.304 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997079+0000", 2024-04-19T03:02:13.304 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:13.304 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.304 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.304 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:02:13.304 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997079+0000", 2024-04-19T03:02:13.304 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:13.304 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.304 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.304 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:02:13.304 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997077+0000", 2024-04-19T03:02:13.304 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:13.305 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.305 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.305 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:02:13.305 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997087+0000", 2024-04-19T03:02:13.305 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.006e-05 2024-04-19T03:02:13.305 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.305 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.305 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:02:13.305 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997105+0000", 2024-04-19T03:02:13.305 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.8026999999999999e-05 2024-04-19T03:02:13.305 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.305 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.305 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:02:13.306 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997135+0000", 2024-04-19T03:02:13.306 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.9643000000000001e-05 2024-04-19T03:02:13.306 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.306 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.306 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:13.306 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997208+0000", 2024-04-19T03:02:13.306 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.3419999999999998e-05 2024-04-19T03:02:13.306 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.306 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.306 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op must wait for map", 2024-04-19T03:02:13.306 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997244+0000", 2024-04-19T03:02:13.306 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.5367000000000002e-05 2024-04-19T03:02:13.306 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.307 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.307 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:13.307 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.007357+0000", 2024-04-19T03:02:13.307 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.010112703000000001 2024-04-19T03:02:13.307 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.307 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.307 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:02:13.307 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.007479+0000", 2024-04-19T03:02:13.307 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012279599999999999 2024-04-19T03:02:13.307 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.307 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.307 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 1", 2024-04-19T03:02:13.307 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.007610+0000", 2024-04-19T03:02:13.308 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00013093499999999999 2024-04-19T03:02:13.308 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.308 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.308 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:02:13.308 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.012526+0000", 2024-04-19T03:02:13.308 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0049157519999999998 2024-04-19T03:02:13.308 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.308 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.308 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:13.308 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.018959+0000", 2024-04-19T03:02:13.308 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0064326009999999996 2024-04-19T03:02:13.309 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.309 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.309 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:02:13.309 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.019005+0000", 2024-04-19T03:02:13.309 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.6066999999999998e-05 2024-04-19T03:02:13.309 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.309 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.309 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:02:13.309 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.019031+0000", 2024-04-19T03:02:13.309 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.6009000000000001e-05 2024-04-19T03:02:13.309 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:13.309 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:02:13.309 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:13.309 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.309 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.310 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:02:13.310 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:14.997149+0000", 2024-04-19T03:02:13.310 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 58.301944243999998, 2024-04-19T03:02:13.310 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.021805590999999999, 2024-04-19T03:02:13.310 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:02:13.310 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:13.310 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:02:13.310 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.310 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:02:13.310 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997149+0000", 2024-04-19T03:02:13.310 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:13.310 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.311 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.311 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:02:13.311 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997149+0000", 2024-04-19T03:02:13.311 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:13.311 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.311 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.311 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:02:13.311 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997148+0000", 2024-04-19T03:02:13.311 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2024-04-19T03:02:13.311 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.311 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.311 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:02:13.312 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997166+0000", 2024-04-19T03:02:13.312 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.8233e-05 2024-04-19T03:02:13.312 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.312 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.312 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:02:13.312 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997182+0000", 2024-04-19T03:02:13.312 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5999999999999999e-05 2024-04-19T03:02:13.312 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.312 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.312 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:02:13.312 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997195+0000", 2024-04-19T03:02:13.312 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.252e-05 2024-04-19T03:02:13.312 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.312 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.313 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:13.313 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997348+0000", 2024-04-19T03:02:13.313 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000153115 2024-04-19T03:02:13.313 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.313 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.313 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:02:13.313 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997354+0000", 2024-04-19T03:02:13.313 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.9359999999999996e-06 2024-04-19T03:02:13.313 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.313 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.313 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:13.313 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.008147+0000", 2024-04-19T03:02:13.314 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.010793127 2024-04-19T03:02:13.314 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.314 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.314 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:02:13.314 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.008225+0000", 2024-04-19T03:02:13.314 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.7935999999999994e-05 2024-04-19T03:02:13.314 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.314 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.314 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-04-19T03:02:13.314 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.008377+0000", 2024-04-19T03:02:13.314 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00015159099999999999 2024-04-19T03:02:13.314 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.314 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.315 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:02:13.315 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.012629+0000", 2024-04-19T03:02:13.315 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0042520420000000001 2024-04-19T03:02:13.315 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.315 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.315 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:13.315 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.018871+0000", 2024-04-19T03:02:13.315 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0062425060000000001 2024-04-19T03:02:13.315 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.315 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.315 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:02:13.316 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.018910+0000", 2024-04-19T03:02:13.316 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.8482999999999997e-05 2024-04-19T03:02:13.316 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.316 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.316 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:02:13.316 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.018955+0000", 2024-04-19T03:02:13.316 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.5252e-05 2024-04-19T03:02:13.316 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:13.316 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:02:13.316 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:13.316 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.316 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.316 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(mds.0.3:36 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:02:13.317 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:14.997207+0000", 2024-04-19T03:02:13.317 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 58.301886693999997, 2024-04-19T03:02:13.317 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.022210431999999999, 2024-04-19T03:02:13.317 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:02:13.317 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:13.317 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:02:13.317 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.317 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:02:13.317 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997207+0000", 2024-04-19T03:02:13.317 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:13.317 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.317 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.317 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:02:13.317 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997207+0000", 2024-04-19T03:02:13.318 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:13.318 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.318 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.318 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:02:13.318 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997206+0000", 2024-04-19T03:02:13.318 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2024-04-19T03:02:13.318 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.318 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.318 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:02:13.318 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997218+0000", 2024-04-19T03:02:13.318 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2607e-05 2024-04-19T03:02:13.318 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.319 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.319 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:02:13.319 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997234+0000", 2024-04-19T03:02:13.319 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5583999999999999e-05 2024-04-19T03:02:13.319 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.319 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.319 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:02:13.319 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997248+0000", 2024-04-19T03:02:13.319 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4270000000000001e-05 2024-04-19T03:02:13.319 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.319 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.319 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:13.319 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997397+0000", 2024-04-19T03:02:13.320 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0001482 2024-04-19T03:02:13.320 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.320 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.320 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:02:13.320 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997407+0000", 2024-04-19T03:02:13.320 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0944000000000001e-05 2024-04-19T03:02:13.320 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.320 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.320 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:13.320 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.008173+0000", 2024-04-19T03:02:13.320 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.010765378000000001 2024-04-19T03:02:13.320 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.320 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.321 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:02:13.321 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.008278+0000", 2024-04-19T03:02:13.321 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00010538 2024-04-19T03:02:13.321 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.321 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.321 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 1", 2024-04-19T03:02:13.321 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.008423+0000", 2024-04-19T03:02:13.321 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014525599999999999 2024-04-19T03:02:13.321 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.321 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.321 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:02:13.321 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.012734+0000", 2024-04-19T03:02:13.321 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0043108590000000002 2024-04-19T03:02:13.322 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.322 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.322 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:13.322 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.019318+0000", 2024-04-19T03:02:13.322 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0065836130000000003 2024-04-19T03:02:13.322 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.322 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.322 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:02:13.322 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.019382+0000", 2024-04-19T03:02:13.322 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.3925999999999997e-05 2024-04-19T03:02:13.322 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.322 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.322 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:02:13.323 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.019417+0000", 2024-04-19T03:02:13.323 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.5454999999999999e-05 2024-04-19T03:02:13.323 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:13.323 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:02:13.323 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:13.323 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.323 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.323 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(mds.0.3:15 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:02:13.323 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:14.997260+0000", 2024-04-19T03:02:13.323 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 58.301833543000001, 2024-04-19T03:02:13.323 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.021842842000000001, 2024-04-19T03:02:13.323 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:02:13.323 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:13.324 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:02:13.324 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.324 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:02:13.324 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997260+0000", 2024-04-19T03:02:13.324 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:13.324 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.324 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.324 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:02:13.324 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997260+0000", 2024-04-19T03:02:13.324 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:13.324 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.324 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.324 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:02:13.325 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997259+0000", 2024-04-19T03:02:13.325 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:13.325 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.325 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.325 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:02:13.325 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997270+0000", 2024-04-19T03:02:13.325 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0312999999999999e-05 2024-04-19T03:02:13.325 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.325 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.325 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:02:13.325 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997279+0000", 2024-04-19T03:02:13.325 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.7770000000000008e-06 2024-04-19T03:02:13.325 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.325 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.326 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:02:13.326 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997286+0000", 2024-04-19T03:02:13.326 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.0129999999999996e-06 2024-04-19T03:02:13.326 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.326 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.326 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:13.326 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997433+0000", 2024-04-19T03:02:13.326 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014774699999999999 2024-04-19T03:02:13.326 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.326 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.326 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:02:13.326 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997443+0000", 2024-04-19T03:02:13.326 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.414e-06 2024-04-19T03:02:13.327 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.327 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.327 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:13.327 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.008673+0000", 2024-04-19T03:02:13.327 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.011230789999999999 2024-04-19T03:02:13.327 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.327 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.327 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:02:13.327 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.008808+0000", 2024-04-19T03:02:13.327 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000134346 2024-04-19T03:02:13.327 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.327 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.327 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-04-19T03:02:13.327 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.008922+0000", 2024-04-19T03:02:13.328 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000114444 2024-04-19T03:02:13.328 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.328 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.328 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:02:13.328 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.013442+0000", 2024-04-19T03:02:13.328 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0045193439999999998 2024-04-19T03:02:13.328 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.328 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.328 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:13.328 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.019005+0000", 2024-04-19T03:02:13.328 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00556333 2024-04-19T03:02:13.328 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.328 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.328 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:02:13.329 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.019049+0000", 2024-04-19T03:02:13.329 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.4240000000000003e-05 2024-04-19T03:02:13.329 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.329 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.329 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:02:13.329 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.019103+0000", 2024-04-19T03:02:13.329 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.3706999999999999e-05 2024-04-19T03:02:13.329 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:13.329 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:02:13.329 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:13.329 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.329 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.329 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(mds.0.3:23 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:02:13.330 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:14.997449+0000", 2024-04-19T03:02:13.330 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 58.301644494999998, 2024-04-19T03:02:13.330 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.022679250000000001, 2024-04-19T03:02:13.330 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:02:13.330 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "started", 2024-04-19T03:02:13.330 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:02:13.330 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.330 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:02:13.330 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997449+0000", 2024-04-19T03:02:13.330 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:13.330 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.330 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.330 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:02:13.330 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997449+0000", 2024-04-19T03:02:13.331 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:13.331 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.331 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.331 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:02:13.331 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997448+0000", 2024-04-19T03:02:13.331 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:13.331 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.331 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.331 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:02:13.331 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997452+0000", 2024-04-19T03:02:13.331 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.0369999999999996e-06 2024-04-19T03:02:13.331 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.331 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.332 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:02:13.332 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997461+0000", 2024-04-19T03:02:13.332 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.6100000000000006e-06 2024-04-19T03:02:13.332 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.332 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.332 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:02:13.332 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997468+0000", 2024-04-19T03:02:13.332 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.8360000000000003e-06 2024-04-19T03:02:13.332 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.332 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.332 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:13.332 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997546+0000", 2024-04-19T03:02:13.332 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.7956999999999999e-05 2024-04-19T03:02:13.332 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.333 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.333 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:02:13.333 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997555+0000", 2024-04-19T03:02:13.333 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.2269999999999999e-06 2024-04-19T03:02:13.333 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.333 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.333 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:13.333 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.010065+0000", 2024-04-19T03:02:13.333 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.012509457999999999 2024-04-19T03:02:13.333 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.333 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.333 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:02:13.333 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.010187+0000", 2024-04-19T03:02:13.334 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000122059 2024-04-19T03:02:13.334 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.334 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.334 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:02:13.334 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.020128+0000", 2024-04-19T03:02:13.334 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0099417529999999994 2024-04-19T03:02:13.334 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:13.334 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:02:13.334 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:13.334 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.334 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.334 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(mds.0.3:25 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:02:13.334 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:14.997485+0000", 2024-04-19T03:02:13.335 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 58.301609028999998, 2024-04-19T03:02:13.335 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.021633427, 2024-04-19T03:02:13.335 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:02:13.335 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "started", 2024-04-19T03:02:13.335 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:02:13.335 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.335 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:02:13.335 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997485+0000", 2024-04-19T03:02:13.335 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:13.335 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.335 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.335 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:02:13.335 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997485+0000", 2024-04-19T03:02:13.335 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:13.336 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.336 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.336 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:02:13.336 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997484+0000", 2024-04-19T03:02:13.336 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2024-04-19T03:02:13.336 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.336 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.336 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:02:13.336 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997490+0000", 2024-04-19T03:02:13.336 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.857e-06 2024-04-19T03:02:13.336 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.336 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.336 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:02:13.337 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997505+0000", 2024-04-19T03:02:13.337 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.518e-05 2024-04-19T03:02:13.337 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.337 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.337 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:02:13.337 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997520+0000", 2024-04-19T03:02:13.337 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5026e-05 2024-04-19T03:02:13.337 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.337 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.337 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:13.337 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997607+0000", 2024-04-19T03:02:13.337 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.7107000000000005e-05 2024-04-19T03:02:13.337 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.337 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.338 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op must wait for map", 2024-04-19T03:02:13.338 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997614+0000", 2024-04-19T03:02:13.338 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.0539999999999997e-06 2024-04-19T03:02:13.338 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.338 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.338 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:13.338 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.009808+0000", 2024-04-19T03:02:13.338 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.012194371000000001 2024-04-19T03:02:13.338 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.338 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.338 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:02:13.338 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.010107+0000", 2024-04-19T03:02:13.338 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000298731 2024-04-19T03:02:13.339 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.339 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.339 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:02:13.339 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.019118+0000", 2024-04-19T03:02:13.339 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0090109839999999997 2024-04-19T03:02:13.339 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:13.339 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:02:13.339 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:13.339 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.339 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.339 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4755.0:11277 5.c 5:38c3ceb2:::benchmark_data_smithi096_19531_object11276:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T03:02:13.339 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:42.059676+0000", 2024-04-19T03:02:13.339 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 31.239417407000001, 2024-04-19T03:02:13.339 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.029909680000000001, 2024-04-19T03:02:13.340 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:02:13.340 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:13.340 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-04-19T03:02:13.340 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4755", 2024-04-19T03:02:13.340 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:13.340 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 11277 2024-04-19T03:02:13.340 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.340 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:02:13.340 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.340 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:02:13.340 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.059676+0000", 2024-04-19T03:02:13.341 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:13.341 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.341 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.341 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:02:13.341 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.059676+0000", 2024-04-19T03:02:13.341 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:13.341 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.341 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.341 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:02:13.341 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.059665+0000", 2024-04-19T03:02:13.342 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999886 2024-04-19T03:02:13.342 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.342 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.342 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:02:13.342 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.059777+0000", 2024-04-19T03:02:13.342 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000111953 2024-04-19T03:02:13.342 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.342 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.342 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:02:13.342 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.059789+0000", 2024-04-19T03:02:13.342 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1809e-05 2024-04-19T03:02:13.342 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.342 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.343 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:02:13.343 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.059797+0000", 2024-04-19T03:02:13.343 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.2090000000000005e-06 2024-04-19T03:02:13.343 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.343 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.343 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:13.343 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.060528+0000", 2024-04-19T03:02:13.343 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00073144499999999995 2024-04-19T03:02:13.343 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.343 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.343 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:02:13.343 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.060662+0000", 2024-04-19T03:02:13.343 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000133435 2024-04-19T03:02:13.344 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.344 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.344 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-04-19T03:02:13.344 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.060766+0000", 2024-04-19T03:02:13.344 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00010473500000000001 2024-04-19T03:02:13.344 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.344 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.344 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:02:13.344 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.067649+0000", 2024-04-19T03:02:13.344 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.006882684 2024-04-19T03:02:13.344 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.344 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.344 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:13.344 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.089475+0000", 2024-04-19T03:02:13.345 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.021826196999999999 2024-04-19T03:02:13.345 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.345 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.345 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:02:13.345 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.089535+0000", 2024-04-19T03:02:13.345 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.9239e-05 2024-04-19T03:02:13.345 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.345 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.345 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:02:13.345 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.089586+0000", 2024-04-19T03:02:13.345 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.1288000000000001e-05 2024-04-19T03:02:13.345 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:13.345 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:02:13.345 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:13.345 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.346 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.346 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4755.0:11280 5.6 5:6e34f5e7:::benchmark_data_smithi096_19531_object11279:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T03:02:13.346 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:42.060002+0000", 2024-04-19T03:02:13.346 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 31.239092030999998, 2024-04-19T03:02:13.346 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.028171841999999999, 2024-04-19T03:02:13.346 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:02:13.346 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:13.346 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-04-19T03:02:13.346 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4755", 2024-04-19T03:02:13.346 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:13.346 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 11280 2024-04-19T03:02:13.346 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.346 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:02:13.347 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.347 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:02:13.347 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.060002+0000", 2024-04-19T03:02:13.347 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:13.347 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.347 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.347 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:02:13.347 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.060002+0000", 2024-04-19T03:02:13.347 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:13.347 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.347 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.347 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:02:13.347 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.060000+0000", 2024-04-19T03:02:13.347 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2024-04-19T03:02:13.348 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.348 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.348 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:02:13.348 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.060120+0000", 2024-04-19T03:02:13.348 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00011941400000000001 2024-04-19T03:02:13.348 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.348 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.348 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:02:13.348 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.060132+0000", 2024-04-19T03:02:13.348 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2197e-05 2024-04-19T03:02:13.348 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.348 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.348 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:02:13.348 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.060141+0000", 2024-04-19T03:02:13.349 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.6829999999999997e-06 2024-04-19T03:02:13.349 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.349 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.349 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:13.349 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.060194+0000", 2024-04-19T03:02:13.349 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.3395e-05 2024-04-19T03:02:13.349 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.349 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.349 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:02:13.349 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.060333+0000", 2024-04-19T03:02:13.349 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00013935799999999999 2024-04-19T03:02:13.349 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.349 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.350 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-04-19T03:02:13.350 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.060477+0000", 2024-04-19T03:02:13.350 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000143938 2024-04-19T03:02:13.350 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.350 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.350 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:02:13.350 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.067752+0000", 2024-04-19T03:02:13.350 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0072741580000000002 2024-04-19T03:02:13.350 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.350 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.350 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:13.350 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.088041+0000", 2024-04-19T03:02:13.350 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.020288955000000001 2024-04-19T03:02:13.350 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.351 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.351 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:02:13.351 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.088113+0000", 2024-04-19T03:02:13.351 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.2492999999999999e-05 2024-04-19T03:02:13.351 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.351 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.351 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:02:13.351 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.088173+0000", 2024-04-19T03:02:13.351 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.0418999999999999e-05 2024-04-19T03:02:13.351 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:13.351 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:02:13.351 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:13.351 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.352 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.352 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4755.0:11274 5.e e26/22 5:7c846032:::benchmark_data_smithi096_19531_object11273:head v 26'697, mlcod=26'692)", 2024-04-19T03:02:13.352 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:42.065726+0000", 2024-04-19T03:02:13.352 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 31.233367504, 2024-04-19T03:02:13.352 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.028607227999999998, 2024-04-19T03:02:13.352 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:02:13.352 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:13.352 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:02:13.352 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.352 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:02:13.352 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.065726+0000", 2024-04-19T03:02:13.352 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:13.352 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.353 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.353 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:02:13.353 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.065726+0000", 2024-04-19T03:02:13.353 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:13.353 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.353 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.353 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:02:13.353 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.065725+0000", 2024-04-19T03:02:13.353 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2024-04-19T03:02:13.353 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.353 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.353 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:02:13.353 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.066818+0000", 2024-04-19T03:02:13.353 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0010930110000000001 2024-04-19T03:02:13.353 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.354 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.354 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:02:13.354 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.066826+0000", 2024-04-19T03:02:13.354 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.0609999999999996e-06 2024-04-19T03:02:13.354 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.354 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.354 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:02:13.354 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.066831+0000", 2024-04-19T03:02:13.354 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.7500000000000003e-06 2024-04-19T03:02:13.354 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.354 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.354 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:13.354 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.066857+0000", 2024-04-19T03:02:13.355 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.6126999999999999e-05 2024-04-19T03:02:13.355 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.355 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.355 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:02:13.355 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.066868+0000", 2024-04-19T03:02:13.355 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1113e-05 2024-04-19T03:02:13.355 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.355 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.355 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:02:13.355 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.094266+0000", 2024-04-19T03:02:13.355 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.027397731000000002 2024-04-19T03:02:13.355 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.355 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.355 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:02:13.356 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.094333+0000", 2024-04-19T03:02:13.356 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.7230000000000005e-05 2024-04-19T03:02:13.356 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:13.356 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:02:13.356 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:13.356 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.356 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.356 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4755.0:11279 5.8 e26/22 5:10b60c58:::benchmark_data_smithi096_19531_object11278:head v 26'723, mlcod=26'719)", 2024-04-19T03:02:13.356 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:42.066841+0000", 2024-04-19T03:02:13.356 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 31.232252189, 2024-04-19T03:02:13.356 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.021736267, 2024-04-19T03:02:13.356 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:02:13.356 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:13.356 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:02:13.357 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.357 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:02:13.357 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.066841+0000", 2024-04-19T03:02:13.357 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:13.357 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.357 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.357 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:02:13.357 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.066841+0000", 2024-04-19T03:02:13.357 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:13.357 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.357 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.357 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:02:13.357 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.066841+0000", 2024-04-19T03:02:13.358 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:13.358 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.358 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.358 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:02:13.358 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.066876+0000", 2024-04-19T03:02:13.358 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.4790999999999999e-05 2024-04-19T03:02:13.358 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.358 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.358 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:02:13.358 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.066880+0000", 2024-04-19T03:02:13.358 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.3610000000000003e-06 2024-04-19T03:02:13.358 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.358 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.359 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:02:13.359 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.066883+0000", 2024-04-19T03:02:13.359 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.4079999999999998e-06 2024-04-19T03:02:13.359 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.359 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.359 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:13.359 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.066929+0000", 2024-04-19T03:02:13.359 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.5444000000000001e-05 2024-04-19T03:02:13.359 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.359 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.359 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:02:13.359 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.066951+0000", 2024-04-19T03:02:13.359 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.2578999999999998e-05 2024-04-19T03:02:13.359 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.359 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.359 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:02:13.360 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.088518+0000", 2024-04-19T03:02:13.360 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.021566617 2024-04-19T03:02:13.360 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.360 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.360 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:02:13.360 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.088578+0000", 2024-04-19T03:02:13.360 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.9655999999999999e-05 2024-04-19T03:02:13.360 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:13.360 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:02:13.360 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:13.360 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.360 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.360 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4755.0:11282 5.e e26/22 5:75b7c510:::benchmark_data_smithi096_19531_object11281:head v 26'698, mlcod=26'693)", 2024-04-19T03:02:13.360 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:42.066923+0000", 2024-04-19T03:02:13.360 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 31.232170322000002, 2024-04-19T03:02:13.361 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.027436461999999998, 2024-04-19T03:02:13.361 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:02:13.361 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:13.361 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:02:13.361 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.361 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:02:13.361 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.066923+0000", 2024-04-19T03:02:13.361 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:13.361 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.361 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.361 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:02:13.361 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.066923+0000", 2024-04-19T03:02:13.361 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:13.361 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.361 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.362 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:02:13.362 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.066923+0000", 2024-04-19T03:02:13.362 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:13.362 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.362 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.362 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:02:13.362 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.066955+0000", 2024-04-19T03:02:13.362 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.2060999999999997e-05 2024-04-19T03:02:13.362 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.362 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.362 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:02:13.362 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.066962+0000", 2024-04-19T03:02:13.362 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.1969999999999999e-06 2024-04-19T03:02:13.362 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.362 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.363 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:02:13.363 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.066967+0000", 2024-04-19T03:02:13.363 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.6589999999999998e-06 2024-04-19T03:02:13.363 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.363 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.363 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:13.363 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.067762+0000", 2024-04-19T03:02:13.363 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00079538199999999997 2024-04-19T03:02:13.363 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.363 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.363 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:02:13.363 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.067782+0000", 2024-04-19T03:02:13.363 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.9432999999999998e-05 2024-04-19T03:02:13.363 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.363 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.364 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:02:13.364 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.094339+0000", 2024-04-19T03:02:13.364 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.026556778999999999 2024-04-19T03:02:13.364 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.364 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.364 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:02:13.364 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.094360+0000", 2024-04-19T03:02:13.364 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.1246e-05 2024-04-19T03:02:13.364 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:13.364 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:02:13.364 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:13.364 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.364 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.364 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4755.0:11293 5.c 5:31728bfd:::benchmark_data_smithi096_19531_object11292:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T03:02:13.364 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:42.068359+0000", 2024-04-19T03:02:13.364 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 31.230734498, 2024-04-19T03:02:13.365 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.022306475999999999, 2024-04-19T03:02:13.365 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:02:13.365 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:13.365 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-04-19T03:02:13.365 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4755", 2024-04-19T03:02:13.365 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:13.365 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 11293 2024-04-19T03:02:13.365 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.365 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:02:13.365 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.365 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:02:13.365 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.068359+0000", 2024-04-19T03:02:13.365 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:13.366 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.366 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.366 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:02:13.366 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.068359+0000", 2024-04-19T03:02:13.366 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:13.366 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.366 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.366 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:02:13.366 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.068358+0000", 2024-04-19T03:02:13.366 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2024-04-19T03:02:13.366 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.366 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.366 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:02:13.366 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.068427+0000", 2024-04-19T03:02:13.367 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.9139000000000003e-05 2024-04-19T03:02:13.367 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.367 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.367 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:02:13.367 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.085292+0000", 2024-04-19T03:02:13.367 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.016864371 2024-04-19T03:02:13.367 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.367 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.367 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:02:13.367 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.085306+0000", 2024-04-19T03:02:13.367 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.434e-05 2024-04-19T03:02:13.367 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.367 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.367 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:13.367 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.085404+0000", 2024-04-19T03:02:13.368 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.8145000000000003e-05 2024-04-19T03:02:13.368 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.368 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.368 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:02:13.368 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.085569+0000", 2024-04-19T03:02:13.368 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00016504099999999999 2024-04-19T03:02:13.368 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.368 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.368 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-04-19T03:02:13.368 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.085739+0000", 2024-04-19T03:02:13.368 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000170099 2024-04-19T03:02:13.368 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.368 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.369 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:02:13.369 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.089603+0000", 2024-04-19T03:02:13.369 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0038636080000000001 2024-04-19T03:02:13.369 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.369 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.369 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:13.369 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.090578+0000", 2024-04-19T03:02:13.369 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00097513199999999997 2024-04-19T03:02:13.369 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.369 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.369 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:02:13.369 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.090618+0000", 2024-04-19T03:02:13.369 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.9987999999999997e-05 2024-04-19T03:02:13.369 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.369 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.370 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:02:13.370 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.090666+0000", 2024-04-19T03:02:13.370 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.7420999999999999e-05 2024-04-19T03:02:13.370 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:13.370 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:02:13.370 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:13.370 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.370 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.370 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4755.0:60384 5.a 5:55675f1d:::benchmark_data_smithi096_19531_object60383:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-19T03:02:13.370 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:02:05.864278+0000", 2024-04-19T03:02:13.370 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 7.4348156489999999, 2024-04-19T03:02:13.371 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.021786224999999999, 2024-04-19T03:02:13.371 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:02:13.371 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:13.371 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-04-19T03:02:13.371 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4755", 2024-04-19T03:02:13.371 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:13.371 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 60384 2024-04-19T03:02:13.371 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.371 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:02:13.371 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.371 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:02:13.371 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:05.864278+0000", 2024-04-19T03:02:13.372 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:13.372 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.372 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.372 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:02:13.372 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:05.864278+0000", 2024-04-19T03:02:13.372 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:13.372 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.372 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.372 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:02:13.372 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:05.864277+0000", 2024-04-19T03:02:13.372 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:13.372 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.372 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.372 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:02:13.373 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:05.864344+0000", 2024-04-19T03:02:13.373 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.7392999999999997e-05 2024-04-19T03:02:13.373 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.373 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.373 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:02:13.373 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:05.864355+0000", 2024-04-19T03:02:13.373 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1083999999999999e-05 2024-04-19T03:02:13.373 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.373 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.373 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:02:13.373 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:05.864363+0000", 2024-04-19T03:02:13.373 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.9529999999999999e-06 2024-04-19T03:02:13.373 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.373 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.373 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:13.374 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:05.865979+0000", 2024-04-19T03:02:13.374 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001616159 2024-04-19T03:02:13.374 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.374 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.374 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:02:13.374 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:05.866059+0000", 2024-04-19T03:02:13.374 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.0343e-05 2024-04-19T03:02:13.374 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.374 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.374 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 1", 2024-04-19T03:02:13.374 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:05.866179+0000", 2024-04-19T03:02:13.374 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000119072 2024-04-19T03:02:13.375 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.375 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.375 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:13.375 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:05.875531+0000", 2024-04-19T03:02:13.375 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0093528770000000008 2024-04-19T03:02:13.375 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.375 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.375 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:02:13.375 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:05.885821+0000", 2024-04-19T03:02:13.375 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0102892 2024-04-19T03:02:13.375 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.375 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.375 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:02:13.375 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:05.886025+0000", 2024-04-19T03:02:13.376 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000204086 2024-04-19T03:02:13.376 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.376 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.376 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:02:13.376 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:05.886064+0000", 2024-04-19T03:02:13.376 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.9458000000000001e-05 2024-04-19T03:02:13.376 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:13.376 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:02:13.376 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:13.376 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.376 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.376 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4755.0:60674 5.5 5:aaf3a5ff:::benchmark_data_smithi096_19531_object60673:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-19T03:02:13.376 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:02:06.038509+0000", 2024-04-19T03:02:13.377 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 7.260584658, 2024-04-19T03:02:13.377 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.024267756000000001, 2024-04-19T03:02:13.377 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:02:13.377 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:13.377 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-04-19T03:02:13.377 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4755", 2024-04-19T03:02:13.377 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:13.377 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 60674 2024-04-19T03:02:13.377 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.377 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:02:13.377 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.377 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:02:13.378 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.038509+0000", 2024-04-19T03:02:13.378 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:13.378 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.378 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.378 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:02:13.378 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.038509+0000", 2024-04-19T03:02:13.378 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:13.378 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.378 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.378 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:02:13.378 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.038507+0000", 2024-04-19T03:02:13.378 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999981 2024-04-19T03:02:13.379 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.379 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.379 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:02:13.379 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.038584+0000", 2024-04-19T03:02:13.379 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.6947999999999996e-05 2024-04-19T03:02:13.379 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.379 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.379 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:02:13.379 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.038597+0000", 2024-04-19T03:02:13.379 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2863e-05 2024-04-19T03:02:13.379 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.379 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.379 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:02:13.379 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.038606+0000", 2024-04-19T03:02:13.380 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.9209999999999998e-06 2024-04-19T03:02:13.380 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.380 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.380 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:13.380 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.041247+0000", 2024-04-19T03:02:13.380 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0026412720000000001 2024-04-19T03:02:13.380 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.380 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.380 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:02:13.380 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.041436+0000", 2024-04-19T03:02:13.380 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00018870599999999999 2024-04-19T03:02:13.380 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.380 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.381 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-04-19T03:02:13.381 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.041636+0000", 2024-04-19T03:02:13.381 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00020026399999999999 2024-04-19T03:02:13.381 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.381 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.381 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:13.381 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.048757+0000", 2024-04-19T03:02:13.381 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0071207620000000001 2024-04-19T03:02:13.381 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.381 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.381 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:02:13.381 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.062687+0000", 2024-04-19T03:02:13.381 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.013929811 2024-04-19T03:02:13.382 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.382 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.382 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:02:13.382 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.062740+0000", 2024-04-19T03:02:13.382 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.3735e-05 2024-04-19T03:02:13.382 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.382 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.382 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:02:13.382 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.062777+0000", 2024-04-19T03:02:13.382 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.6366999999999999e-05 2024-04-19T03:02:13.382 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:13.382 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:02:13.383 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:13.383 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.383 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.383 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4755.0:60677 5.5 5:aad57123:::benchmark_data_smithi096_19531_object60676:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-19T03:02:13.383 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:02:06.039077+0000", 2024-04-19T03:02:13.383 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 7.260016223, 2024-04-19T03:02:13.383 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.023852720000000001, 2024-04-19T03:02:13.383 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:02:13.383 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:13.383 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-04-19T03:02:13.383 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4755", 2024-04-19T03:02:13.383 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:13.384 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 60677 2024-04-19T03:02:13.384 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.384 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:02:13.384 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.384 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:02:13.384 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.039077+0000", 2024-04-19T03:02:13.384 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:13.384 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.384 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.384 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:02:13.384 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.039077+0000", 2024-04-19T03:02:13.384 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:13.384 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.384 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.385 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:02:13.385 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.039076+0000", 2024-04-19T03:02:13.385 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2024-04-19T03:02:13.385 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.385 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.385 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:02:13.385 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.039158+0000", 2024-04-19T03:02:13.385 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.1310000000000006e-05 2024-04-19T03:02:13.385 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.385 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.385 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:02:13.385 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.039171+0000", 2024-04-19T03:02:13.385 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.3010000000000001e-05 2024-04-19T03:02:13.386 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.386 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.386 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:02:13.386 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.039178+0000", 2024-04-19T03:02:13.386 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.8519999999999998e-06 2024-04-19T03:02:13.386 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.386 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.386 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:13.386 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.048813+0000", 2024-04-19T03:02:13.386 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0096353600000000008 2024-04-19T03:02:13.386 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.386 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.387 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:02:13.387 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.048986+0000", 2024-04-19T03:02:13.387 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000173234 2024-04-19T03:02:13.387 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.387 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.387 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-04-19T03:02:13.387 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.049147+0000", 2024-04-19T03:02:13.387 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00016059000000000001 2024-04-19T03:02:13.387 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.387 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.387 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:02:13.387 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.062805+0000", 2024-04-19T03:02:13.387 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.013658267999999999 2024-04-19T03:02:13.388 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.388 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.388 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:13.388 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.062858+0000", 2024-04-19T03:02:13.388 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.3177999999999998e-05 2024-04-19T03:02:13.388 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.388 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.388 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:02:13.388 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.062903+0000", 2024-04-19T03:02:13.388 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.4336999999999999e-05 2024-04-19T03:02:13.388 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.388 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.388 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:02:13.389 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.062930+0000", 2024-04-19T03:02:13.389 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.7492e-05 2024-04-19T03:02:13.389 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:13.389 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:02:13.389 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:13.389 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.389 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.389 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4755.0:60686 5.5 5:a9caa390:::benchmark_data_smithi096_19531_object60685:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-19T03:02:13.389 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:02:06.044469+0000", 2024-04-19T03:02:13.389 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 7.254624948, 2024-04-19T03:02:13.389 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.021099772999999999, 2024-04-19T03:02:13.389 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:02:13.389 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:13.390 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-04-19T03:02:13.390 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4755", 2024-04-19T03:02:13.390 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:13.390 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 60686 2024-04-19T03:02:13.390 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.390 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:02:13.390 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.390 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:02:13.390 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.044469+0000", 2024-04-19T03:02:13.390 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:13.390 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.390 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.390 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:02:13.391 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.044469+0000", 2024-04-19T03:02:13.391 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:13.391 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.391 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.391 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:02:13.391 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.044467+0000", 2024-04-19T03:02:13.391 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:13.391 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.391 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.391 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:02:13.391 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.044516+0000", 2024-04-19T03:02:13.391 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.9143e-05 2024-04-19T03:02:13.391 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.392 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.392 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:02:13.392 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.044530+0000", 2024-04-19T03:02:13.392 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.3526000000000001e-05 2024-04-19T03:02:13.392 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.392 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.392 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:02:13.392 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.044537+0000", 2024-04-19T03:02:13.392 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.8990000000000004e-06 2024-04-19T03:02:13.392 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.392 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.392 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:13.392 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.054411+0000", 2024-04-19T03:02:13.392 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0098746949999999993 2024-04-19T03:02:13.393 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.393 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.393 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:02:13.393 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.054606+0000", 2024-04-19T03:02:13.393 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00019422100000000001 2024-04-19T03:02:13.393 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.393 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.393 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-04-19T03:02:13.393 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.054848+0000", 2024-04-19T03:02:13.393 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00024189799999999999 2024-04-19T03:02:13.393 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.393 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.393 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:02:13.394 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.063095+0000", 2024-04-19T03:02:13.394 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0082472020000000004 2024-04-19T03:02:13.394 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.394 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.394 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:13.394 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.065481+0000", 2024-04-19T03:02:13.394 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00238623 2024-04-19T03:02:13.394 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.394 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.394 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:02:13.394 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.065532+0000", 2024-04-19T03:02:13.394 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.0509e-05 2024-04-19T03:02:13.394 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.395 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.395 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:02:13.395 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.065568+0000", 2024-04-19T03:02:13.395 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.6876999999999999e-05 2024-04-19T03:02:13.395 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:13.395 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:02:13.395 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:13.395 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.395 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.395 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4755.0:60689 5.5 5:adf8d35d:::benchmark_data_smithi096_19531_object60688:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-19T03:02:13.395 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:02:06.047459+0000", 2024-04-19T03:02:13.395 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 7.2516348869999998, 2024-04-19T03:02:13.395 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.021837532, 2024-04-19T03:02:13.395 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:02:13.396 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:13.396 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-04-19T03:02:13.396 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4755", 2024-04-19T03:02:13.396 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:13.396 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 60689 2024-04-19T03:02:13.396 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.396 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:02:13.396 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.396 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:02:13.396 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.047459+0000", 2024-04-19T03:02:13.396 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:13.396 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.396 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.397 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:02:13.397 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.047459+0000", 2024-04-19T03:02:13.397 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:13.397 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.397 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.397 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:02:13.397 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.047458+0000", 2024-04-19T03:02:13.397 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2024-04-19T03:02:13.397 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.397 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.397 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:02:13.397 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.047527+0000", 2024-04-19T03:02:13.397 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.9114000000000003e-05 2024-04-19T03:02:13.397 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.398 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.398 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:02:13.398 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.047538+0000", 2024-04-19T03:02:13.398 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.094e-05 2024-04-19T03:02:13.398 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.398 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.398 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:02:13.398 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.047542+0000", 2024-04-19T03:02:13.398 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.4689999999999999e-06 2024-04-19T03:02:13.399 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.399 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.399 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:13.399 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.059742+0000", 2024-04-19T03:02:13.399 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.012200103 2024-04-19T03:02:13.399 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.399 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.399 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:02:13.399 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.059904+0000", 2024-04-19T03:02:13.399 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00016191900000000001 2024-04-19T03:02:13.399 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.399 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.399 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-04-19T03:02:13.399 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.060079+0000", 2024-04-19T03:02:13.400 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00017477500000000001 2024-04-19T03:02:13.400 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.400 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.400 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:13.400 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.067922+0000", 2024-04-19T03:02:13.400 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0078434720000000006 2024-04-19T03:02:13.400 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.400 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.400 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:02:13.400 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.069163+0000", 2024-04-19T03:02:13.400 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0012401389999999999 2024-04-19T03:02:13.400 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.401 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.401 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:02:13.401 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.069238+0000", 2024-04-19T03:02:13.401 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.4955000000000003e-05 2024-04-19T03:02:13.401 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.401 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.401 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:02:13.401 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.069296+0000", 2024-04-19T03:02:13.401 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.8726e-05 2024-04-19T03:02:13.401 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:13.401 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:02:13.401 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:13.401 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.401 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.402 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4755.0:60746 5.6 5:68292fbc:::benchmark_data_smithi096_19531_object60745:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-19T03:02:13.402 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:02:06.088145+0000", 2024-04-19T03:02:13.402 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 7.2109487870000004, 2024-04-19T03:02:13.402 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.021267332, 2024-04-19T03:02:13.402 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:02:13.402 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:13.402 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-04-19T03:02:13.402 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4755", 2024-04-19T03:02:13.402 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:13.402 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 60746 2024-04-19T03:02:13.402 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.402 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:02:13.402 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.403 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:02:13.403 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.088145+0000", 2024-04-19T03:02:13.403 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:13.403 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.403 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.403 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:02:13.403 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.088145+0000", 2024-04-19T03:02:13.403 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:13.403 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.403 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.403 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:02:13.403 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.088144+0000", 2024-04-19T03:02:13.403 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2024-04-19T03:02:13.404 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.404 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.404 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:02:13.404 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.088187+0000", 2024-04-19T03:02:13.404 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.337e-05 2024-04-19T03:02:13.404 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.404 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.404 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:02:13.404 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.088199+0000", 2024-04-19T03:02:13.404 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1654999999999999e-05 2024-04-19T03:02:13.404 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.404 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.405 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:02:13.405 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.088205+0000", 2024-04-19T03:02:13.405 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.3840000000000002e-06 2024-04-19T03:02:13.405 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.405 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.405 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:13.405 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.095361+0000", 2024-04-19T03:02:13.405 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0071557799999999996 2024-04-19T03:02:13.405 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.405 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.405 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:02:13.405 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.095490+0000", 2024-04-19T03:02:13.405 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012866700000000001 2024-04-19T03:02:13.406 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.406 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.406 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-04-19T03:02:13.406 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.095629+0000", 2024-04-19T03:02:13.406 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000139529 2024-04-19T03:02:13.406 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.406 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.406 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:02:13.406 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.101867+0000", 2024-04-19T03:02:13.406 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0062376259999999996 2024-04-19T03:02:13.406 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.406 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.407 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:13.407 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.109360+0000", 2024-04-19T03:02:13.407 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0074929799999999998 2024-04-19T03:02:13.407 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.407 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.407 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:02:13.407 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.109389+0000", 2024-04-19T03:02:13.407 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.8759999999999999e-05 2024-04-19T03:02:13.407 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.407 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.407 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:02:13.407 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.109412+0000", 2024-04-19T03:02:13.407 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.3354999999999999e-05 2024-04-19T03:02:13.408 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:13.408 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:02:13.408 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:13.408 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.408 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.408 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4755.0:67705 5.3 5:cee6fde7:::benchmark_data_smithi096_19531_object67704:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T03:02:13.408 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:02:10.204519+0000", 2024-04-19T03:02:13.408 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 3.0945743879999998, 2024-04-19T03:02:13.408 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.023064485999999999, 2024-04-19T03:02:13.408 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:02:13.408 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:13.408 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-04-19T03:02:13.409 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4755", 2024-04-19T03:02:13.409 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:13.409 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 67705 2024-04-19T03:02:13.409 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.409 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:02:13.409 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.409 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:02:13.409 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:10.204519+0000", 2024-04-19T03:02:13.409 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:13.409 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.409 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.409 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:02:13.409 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:10.204519+0000", 2024-04-19T03:02:13.409 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:13.410 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.410 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.410 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:02:13.410 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:10.204519+0000", 2024-04-19T03:02:13.410 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:13.410 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.410 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.410 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:02:13.410 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:10.204549+0000", 2024-04-19T03:02:13.410 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0479000000000001e-05 2024-04-19T03:02:13.410 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.410 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.411 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:02:13.411 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:10.204557+0000", 2024-04-19T03:02:13.411 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.5039999999999996e-06 2024-04-19T03:02:13.411 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.411 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.411 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:02:13.411 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:10.204562+0000", 2024-04-19T03:02:13.411 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.305e-06 2024-04-19T03:02:13.411 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.411 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.411 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:13.411 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:10.215382+0000", 2024-04-19T03:02:13.411 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.010820348 2024-04-19T03:02:13.412 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.412 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.412 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:02:13.412 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:10.215604+0000", 2024-04-19T03:02:13.412 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000221645 2024-04-19T03:02:13.412 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.412 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.412 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-04-19T03:02:13.412 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:10.215775+0000", 2024-04-19T03:02:13.412 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00017157500000000001 2024-04-19T03:02:13.412 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.412 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.412 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:13.412 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:10.227474+0000", 2024-04-19T03:02:13.413 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.011699016 2024-04-19T03:02:13.413 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.413 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.413 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:02:13.413 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:10.227491+0000", 2024-04-19T03:02:13.413 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.6977999999999999e-05 2024-04-19T03:02:13.413 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.413 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.413 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:02:13.413 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:10.227546+0000", 2024-04-19T03:02:13.413 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.4768000000000001e-05 2024-04-19T03:02:13.413 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.413 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.413 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:02:13.414 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:10.227584+0000", 2024-04-19T03:02:13.414 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.7512000000000003e-05 2024-04-19T03:02:13.414 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:13.414 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:02:13.414 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:13.414 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.414 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.414 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4755.0:67724 5.3 5:cd75df27:::benchmark_data_smithi096_19531_object67723:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T03:02:13.414 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:02:10.213723+0000", 2024-04-19T03:02:13.414 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 3.0853703700000001, 2024-04-19T03:02:13.414 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.021797713999999999, 2024-04-19T03:02:13.414 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:02:13.414 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:13.415 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-04-19T03:02:13.415 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4755", 2024-04-19T03:02:13.415 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:13.415 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 67724 2024-04-19T03:02:13.415 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.415 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:02:13.415 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.415 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:02:13.415 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:10.213723+0000", 2024-04-19T03:02:13.415 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:13.415 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.415 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.415 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:02:13.415 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:10.213723+0000", 2024-04-19T03:02:13.416 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:13.416 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.416 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.416 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:02:13.416 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:10.213722+0000", 2024-04-19T03:02:13.416 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:13.416 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.416 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.416 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:02:13.416 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:10.213757+0000", 2024-04-19T03:02:13.416 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.5348000000000001e-05 2024-04-19T03:02:13.416 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.416 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.417 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:02:13.417 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:10.213770+0000", 2024-04-19T03:02:13.417 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2663999999999999e-05 2024-04-19T03:02:13.417 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.417 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.417 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:02:13.417 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:10.213778+0000", 2024-04-19T03:02:13.417 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.1629999999999996e-06 2024-04-19T03:02:13.417 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.417 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.417 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:13.417 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:10.227880+0000", 2024-04-19T03:02:13.417 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.014102412999999999 2024-04-19T03:02:13.418 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.418 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.418 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:02:13.418 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:10.227978+0000", 2024-04-19T03:02:13.418 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.7112000000000001e-05 2024-04-19T03:02:13.418 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.418 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.418 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-04-19T03:02:13.418 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:10.228067+0000", 2024-04-19T03:02:13.418 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.9346999999999997e-05 2024-04-19T03:02:13.418 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.418 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.419 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:02:13.419 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:10.231243+0000", 2024-04-19T03:02:13.419 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0031756699999999998 2024-04-19T03:02:13.419 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.419 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.419 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:13.419 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:10.235440+0000", 2024-04-19T03:02:13.419 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0041977890000000004 2024-04-19T03:02:13.419 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.419 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.419 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:02:13.419 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:10.235474+0000", 2024-04-19T03:02:13.419 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.3324000000000001e-05 2024-04-19T03:02:13.419 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:13.419 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:13.419 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:02:13.420 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:10.235521+0000", 2024-04-19T03:02:13.420 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.7318999999999999e-05 2024-04-19T03:02:13.420 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:13.420 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:02:13.420 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:13.420 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:13.420 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:02:13.420 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-04-19T03:02:13.422 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:13.419+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:13.423 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T03:02:13.437 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-04-19T03:02:13.437 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-19T03:02:13.437 INFO:tasks.thrashosds.thrasher:primary_affinity 2024-04-19T03:02:13.437 INFO:tasks.thrashosds.thrasher:Setting osd 2 primary_affinity to 0.789096 2024-04-19T03:02:13.437 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 2 0.7890963418789428 2024-04-19T03:02:13.523 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:13.521+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:13.548 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-19T03:02:13.549 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-04-19T03:02:13.549 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.549 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:73258 5.d 5:b649c5a6:::benchmark_data_smithi096_19531_object73257:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T03:02:13.549 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:13.533252+0000", 2024-04-19T03:02:13.549 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.014070314, 2024-04-19T03:02:13.549 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.014089881, 2024-04-19T03:02:13.549 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:13.549 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:02:13.549 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:13.549 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:13.549 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:13.549 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 73258 2024-04-19T03:02:13.550 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.550 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:13.550 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.550 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:13.550 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:13.533252+0000", 2024-04-19T03:02:13.550 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:13.550 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.550 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.550 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:13.550 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:13.533252+0000", 2024-04-19T03:02:13.550 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:13.550 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.550 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.550 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:13.551 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:13.533251+0000", 2024-04-19T03:02:13.551 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:13.551 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.551 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.551 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:13.551 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:13.533303+0000", 2024-04-19T03:02:13.551 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1955e-05 2024-04-19T03:02:13.551 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.551 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.551 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:13.551 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:13.533312+0000", 2024-04-19T03:02:13.551 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.6410000000000008e-06 2024-04-19T03:02:13.551 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.552 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.552 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:13.552 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:13.533318+0000", 2024-04-19T03:02:13.552 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.421e-06 2024-04-19T03:02:13.552 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.552 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.552 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:13.552 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:13.535925+0000", 2024-04-19T03:02:13.552 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0026068369999999999 2024-04-19T03:02:13.552 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.552 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.552 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:13.552 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:13.536016+0000", 2024-04-19T03:02:13.552 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1144999999999996e-05 2024-04-19T03:02:13.553 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.553 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.553 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-04-19T03:02:13.553 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:13.536178+0000", 2024-04-19T03:02:13.553 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000161717 2024-04-19T03:02:13.553 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.553 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.553 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:13.553 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:13.541858+0000", 2024-04-19T03:02:13.553 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0056801170000000002 2024-04-19T03:02:13.553 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:13.553 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:13.553 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:13.553 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.554 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.554 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:73262 5.d 5:ba358cce:::benchmark_data_smithi096_19531_object73261:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T03:02:13.554 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:13.536074+0000", 2024-04-19T03:02:13.554 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.011248602999999999, 2024-04-19T03:02:13.554 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011319993, 2024-04-19T03:02:13.554 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:13.554 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:02:13.554 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:13.554 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:13.554 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:13.554 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 73262 2024-04-19T03:02:13.554 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.554 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:13.554 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.555 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:13.555 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:13.536074+0000", 2024-04-19T03:02:13.555 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:13.555 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.555 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.555 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:13.555 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:13.536074+0000", 2024-04-19T03:02:13.555 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:13.555 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.555 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.555 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:13.555 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:13.536073+0000", 2024-04-19T03:02:13.555 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:13.556 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.556 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.556 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:13.556 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:13.536119+0000", 2024-04-19T03:02:13.556 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5954000000000001e-05 2024-04-19T03:02:13.556 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.556 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.556 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:13.556 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:13.536129+0000", 2024-04-19T03:02:13.556 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0628999999999999e-05 2024-04-19T03:02:13.556 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.556 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.556 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:13.556 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:13.536137+0000", 2024-04-19T03:02:13.557 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.8960000000000003e-06 2024-04-19T03:02:13.557 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.557 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.557 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:13.557 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:13.539121+0000", 2024-04-19T03:02:13.557 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0029842050000000002 2024-04-19T03:02:13.557 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.557 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.557 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:13.557 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:13.539250+0000", 2024-04-19T03:02:13.557 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012857999999999999 2024-04-19T03:02:13.557 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.557 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.557 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-04-19T03:02:13.558 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:13.539407+0000", 2024-04-19T03:02:13.558 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015736400000000001 2024-04-19T03:02:13.558 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.558 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.558 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:13.558 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:13.544478+0000", 2024-04-19T03:02:13.558 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0050708860000000001 2024-04-19T03:02:13.558 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:13.558 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:13.558 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:13.558 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.558 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.558 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:73264 5.b 5:dab99c9a:::benchmark_data_smithi096_19531_object73263:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T03:02:13.559 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:13.536305+0000", 2024-04-19T03:02:13.559 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.011017837000000001, 2024-04-19T03:02:13.559 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011131111000000001, 2024-04-19T03:02:13.559 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:13.559 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:02:13.559 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:13.559 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:13.559 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:13.559 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 73264 2024-04-19T03:02:13.560 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.560 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:13.560 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.560 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:13.560 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:13.536305+0000", 2024-04-19T03:02:13.560 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:13.560 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.560 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.560 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:13.560 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:13.536305+0000", 2024-04-19T03:02:13.560 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:13.560 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.560 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.560 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:13.561 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:13.536304+0000", 2024-04-19T03:02:13.561 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:13.561 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.561 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.561 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:13.561 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:13.536343+0000", 2024-04-19T03:02:13.561 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9412999999999997e-05 2024-04-19T03:02:13.561 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.561 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.561 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:13.561 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:13.536353+0000", 2024-04-19T03:02:13.561 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0316000000000001e-05 2024-04-19T03:02:13.561 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.561 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.562 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:13.562 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:13.536361+0000", 2024-04-19T03:02:13.562 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.7680000000000008e-06 2024-04-19T03:02:13.562 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.562 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.562 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:13.562 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:13.539273+0000", 2024-04-19T03:02:13.562 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0029121020000000002 2024-04-19T03:02:13.562 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.562 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.562 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:13.562 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:13.539403+0000", 2024-04-19T03:02:13.562 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000129913 2024-04-19T03:02:13.562 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.563 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.563 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:13.563 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:13.539486+0000", 2024-04-19T03:02:13.563 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.2624e-05 2024-04-19T03:02:13.563 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.563 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.563 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:13.563 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:13.546821+0000", 2024-04-19T03:02:13.563 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0073350710000000003 2024-04-19T03:02:13.563 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:13.563 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:13.563 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:13.563 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.564 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.564 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:73266 5.e 5:730997f2:::benchmark_data_smithi096_19531_object73265:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T03:02:13.564 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:13.539243+0000", 2024-04-19T03:02:13.564 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0080797170000000001, 2024-04-19T03:02:13.564 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0082344459999999994, 2024-04-19T03:02:13.564 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:13.564 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:02:13.564 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:13.564 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:13.564 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:13.564 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 73266 2024-04-19T03:02:13.564 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.564 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:13.564 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.565 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:13.565 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:13.539243+0000", 2024-04-19T03:02:13.565 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:13.565 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.565 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.565 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:13.565 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:13.539243+0000", 2024-04-19T03:02:13.565 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:13.565 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.565 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.565 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:13.565 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:13.539242+0000", 2024-04-19T03:02:13.565 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:13.566 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.566 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.566 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:13.566 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:13.539286+0000", 2024-04-19T03:02:13.566 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4156999999999998e-05 2024-04-19T03:02:13.566 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.566 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.566 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:13.566 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:13.539296+0000", 2024-04-19T03:02:13.566 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0386e-05 2024-04-19T03:02:13.566 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.566 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.566 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:13.566 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:13.539304+0000", 2024-04-19T03:02:13.567 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.354e-06 2024-04-19T03:02:13.567 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.567 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.567 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:13.567 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:13.539352+0000", 2024-04-19T03:02:13.567 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7268999999999998e-05 2024-04-19T03:02:13.567 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.567 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.567 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:13.567 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:13.539462+0000", 2024-04-19T03:02:13.567 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000109911 2024-04-19T03:02:13.567 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.567 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.568 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:13.568 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:13.539582+0000", 2024-04-19T03:02:13.568 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000120684 2024-04-19T03:02:13.568 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.568 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.568 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:13.568 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:13.544510+0000", 2024-04-19T03:02:13.568 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.004927397 2024-04-19T03:02:13.568 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:13.568 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:13.568 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:13.568 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.568 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.569 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:73274 5.b 5:db75a455:::benchmark_data_smithi096_19531_object73273:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T03:02:13.569 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:13.542184+0000", 2024-04-19T03:02:13.569 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0051381939999999996, 2024-04-19T03:02:13.569 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0053324979999999998, 2024-04-19T03:02:13.569 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:13.569 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:02:13.569 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:13.569 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:13.569 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:13.569 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 73274 2024-04-19T03:02:13.569 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.569 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:13.569 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.569 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:13.570 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:13.542184+0000", 2024-04-19T03:02:13.570 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:13.570 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.570 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.570 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:13.570 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:13.542184+0000", 2024-04-19T03:02:13.570 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:13.570 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.570 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.570 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:13.570 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:13.542183+0000", 2024-04-19T03:02:13.570 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:13.570 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.570 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.571 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:13.571 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:13.542250+0000", 2024-04-19T03:02:13.571 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7366999999999994e-05 2024-04-19T03:02:13.571 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.571 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.571 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:13.571 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:13.542261+0000", 2024-04-19T03:02:13.571 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0414000000000001e-05 2024-04-19T03:02:13.571 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.571 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.571 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:13.571 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:13.542266+0000", 2024-04-19T03:02:13.571 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7400000000000001e-06 2024-04-19T03:02:13.571 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.572 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.572 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:13.572 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:13.542297+0000", 2024-04-19T03:02:13.572 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0737000000000001e-05 2024-04-19T03:02:13.572 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.572 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.572 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:13.572 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:13.542392+0000", 2024-04-19T03:02:13.572 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.4882000000000004e-05 2024-04-19T03:02:13.572 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.572 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.572 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:13.572 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:13.542472+0000", 2024-04-19T03:02:13.572 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.9678999999999994e-05 2024-04-19T03:02:13.573 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.573 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.573 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:13.573 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:13.547103+0000", 2024-04-19T03:02:13.573 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0046314980000000004 2024-04-19T03:02:13.573 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:13.573 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:13.573 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:13.573 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.573 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.573 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:73275 5.b 5:dd155deb:::benchmark_data_smithi096_19531_object73274:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T03:02:13.573 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:13.542581+0000", 2024-04-19T03:02:13.573 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.00474137, 2024-04-19T03:02:13.573 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0049755700000000003, 2024-04-19T03:02:13.574 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:13.574 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:02:13.574 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:13.574 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:13.574 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:13.574 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 73275 2024-04-19T03:02:13.574 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.574 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:13.574 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.574 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:13.574 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:13.542581+0000", 2024-04-19T03:02:13.574 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:13.574 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.574 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.575 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:13.575 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:13.542581+0000", 2024-04-19T03:02:13.575 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:13.575 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.575 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.575 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:13.575 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:13.542580+0000", 2024-04-19T03:02:13.575 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:13.575 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.575 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.575 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:13.575 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:13.542667+0000", 2024-04-19T03:02:13.575 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.6924999999999999e-05 2024-04-19T03:02:13.575 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.576 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.576 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:13.576 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:13.542682+0000", 2024-04-19T03:02:13.576 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4766999999999999e-05 2024-04-19T03:02:13.576 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.576 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.576 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:13.576 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:13.542689+0000", 2024-04-19T03:02:13.576 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.1339999999999998e-06 2024-04-19T03:02:13.576 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.576 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.576 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:13.576 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:13.544560+0000", 2024-04-19T03:02:13.576 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0018713060000000001 2024-04-19T03:02:13.577 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.577 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.577 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:13.577 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:13.544711+0000", 2024-04-19T03:02:13.577 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015096 2024-04-19T03:02:13.577 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.577 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.577 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:13.577 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:13.544809+0000", 2024-04-19T03:02:13.577 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.7639999999999994e-05 2024-04-19T03:02:13.577 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:13.577 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:13.577 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:13.577 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.578 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.578 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4755.0:73271 5.9 e38/22 5:9637814b:::benchmark_data_smithi096_19531_object73270:head v 38'4490, mlcod=38'4488)", 2024-04-19T03:02:13.578 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:13.542632+0000", 2024-04-19T03:02:13.578 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0046902319999999999, 2024-04-19T03:02:13.578 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0049721740000000002, 2024-04-19T03:02:13.578 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:13.578 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-19T03:02:13.578 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:13.578 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.578 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:13.578 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:13.542632+0000", 2024-04-19T03:02:13.578 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:13.578 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.579 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.579 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:13.579 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:13.542632+0000", 2024-04-19T03:02:13.579 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:13.579 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.579 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.579 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:13.579 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:13.542632+0000", 2024-04-19T03:02:13.579 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:13.579 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.579 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.579 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:13.579 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:13.542701+0000", 2024-04-19T03:02:13.579 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.9117999999999998e-05 2024-04-19T03:02:13.580 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.580 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.580 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:13.580 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:13.542707+0000", 2024-04-19T03:02:13.580 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4060000000000002e-06 2024-04-19T03:02:13.580 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.580 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.580 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:13.580 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:13.542712+0000", 2024-04-19T03:02:13.580 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5260000000000004e-06 2024-04-19T03:02:13.580 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.580 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.580 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:13.580 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:13.542748+0000", 2024-04-19T03:02:13.581 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6300999999999997e-05 2024-04-19T03:02:13.581 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.581 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.581 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:13.581 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:13.542761+0000", 2024-04-19T03:02:13.581 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3294e-05 2024-04-19T03:02:13.581 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:13.581 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:13.581 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:13.581 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.581 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.581 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:73276 5.0 5:0468da73:::benchmark_data_smithi096_19531_object73275:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T03:02:13.581 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:13.543569+0000", 2024-04-19T03:02:13.582 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0037537740000000001, 2024-04-19T03:02:13.582 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0040730510000000003, 2024-04-19T03:02:13.582 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:13.582 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:02:13.582 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:13.582 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:13.582 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:13.582 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 73276 2024-04-19T03:02:13.582 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.582 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:13.582 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.582 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:13.582 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:13.543569+0000", 2024-04-19T03:02:13.582 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:13.583 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.583 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.583 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:13.583 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:13.543569+0000", 2024-04-19T03:02:13.583 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:13.583 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.583 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.583 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:13.583 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:13.543558+0000", 2024-04-19T03:02:13.583 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999895 2024-04-19T03:02:13.583 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.583 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.583 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:13.584 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:13.543644+0000", 2024-04-19T03:02:13.584 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.5822999999999995e-05 2024-04-19T03:02:13.584 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.584 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.584 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:13.584 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:13.543655+0000", 2024-04-19T03:02:13.584 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1389000000000001e-05 2024-04-19T03:02:13.584 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.584 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.584 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:13.584 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:13.543662+0000", 2024-04-19T03:02:13.584 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3149999999999997e-06 2024-04-19T03:02:13.584 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.584 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.585 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:13.585 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:13.543693+0000", 2024-04-19T03:02:13.585 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0960000000000002e-05 2024-04-19T03:02:13.585 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.585 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.585 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:13.585 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:13.543781+0000", 2024-04-19T03:02:13.585 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.8837000000000003e-05 2024-04-19T03:02:13.585 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.585 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.585 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:13.585 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:13.543856+0000", 2024-04-19T03:02:13.585 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4717999999999999e-05 2024-04-19T03:02:13.585 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.586 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.586 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:13.586 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:13.547262+0000", 2024-04-19T03:02:13.586 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0034058069999999998 2024-04-19T03:02:13.586 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:13.586 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:13.586 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:13.586 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.586 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.586 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:73278 5.e 5:7f7fde3a:::benchmark_data_smithi096_19531_object73277:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T03:02:13.586 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:13.545777+0000", 2024-04-19T03:02:13.586 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.001545638, 2024-04-19T03:02:13.586 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0019336620000000001, 2024-04-19T03:02:13.587 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:13.587 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:02:13.587 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:13.587 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:13.587 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:13.587 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 73278 2024-04-19T03:02:13.587 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.587 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:13.587 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.587 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:13.587 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:13.545777+0000", 2024-04-19T03:02:13.587 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:13.587 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.587 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.587 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:13.588 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:13.545777+0000", 2024-04-19T03:02:13.588 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:13.588 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.588 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.588 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:13.588 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:13.545776+0000", 2024-04-19T03:02:13.588 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:13.588 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.588 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.588 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:13.588 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:13.545840+0000", 2024-04-19T03:02:13.588 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4420999999999999e-05 2024-04-19T03:02:13.588 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.589 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.589 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:13.589 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:13.545847+0000", 2024-04-19T03:02:13.589 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.939e-06 2024-04-19T03:02:13.589 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.589 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.589 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:13.589 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:13.545858+0000", 2024-04-19T03:02:13.589 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1107999999999999e-05 2024-04-19T03:02:13.589 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.589 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.589 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:13.589 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:13.545927+0000", 2024-04-19T03:02:13.589 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.8369999999999998e-05 2024-04-19T03:02:13.590 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.590 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.590 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:13.590 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:13.546053+0000", 2024-04-19T03:02:13.590 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000126592 2024-04-19T03:02:13.590 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.590 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.590 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:13.590 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:13.546150+0000", 2024-04-19T03:02:13.590 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.6698000000000002e-05 2024-04-19T03:02:13.590 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:13.590 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:13.590 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:13.591 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.591 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.591 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop_reply(client.4755.0:73266 5.e e38/22)", 2024-04-19T03:02:13.591 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:13.545881+0000", 2024-04-19T03:02:13.591 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0014419000000000001, 2024-04-19T03:02:13.591 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0018941940000000001, 2024-04-19T03:02:13.591 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:13.591 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-04-19T03:02:13.591 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:13.591 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.591 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:13.591 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:13.545881+0000", 2024-04-19T03:02:13.591 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:13.591 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.591 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.592 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:13.592 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:13.545881+0000", 2024-04-19T03:02:13.592 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:13.592 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.592 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.592 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:13.592 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:13.545880+0000", 2024-04-19T03:02:13.592 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:13.592 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.592 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.592 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:13.592 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:13.545883+0000", 2024-04-19T03:02:13.592 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.537e-06 2024-04-19T03:02:13.592 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.592 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.593 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:13.593 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:13.545887+0000", 2024-04-19T03:02:13.593 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4259999999999996e-06 2024-04-19T03:02:13.593 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.593 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.593 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:13.593 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:13.545891+0000", 2024-04-19T03:02:13.593 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4570000000000001e-06 2024-04-19T03:02:13.593 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:13.593 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:13.593 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:13.593 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.593 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.593 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4755.0:73277 5.9 e38/22 5:981cd58a:::benchmark_data_smithi096_19531_object73276:head v 38'4491, mlcod=38'4488)", 2024-04-19T03:02:13.594 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:13.546043+0000", 2024-04-19T03:02:13.594 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0012789609999999999, 2024-04-19T03:02:13.594 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001780694, 2024-04-19T03:02:13.594 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:13.594 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-19T03:02:13.594 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:13.594 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.594 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:13.594 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:13.546043+0000", 2024-04-19T03:02:13.594 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:13.594 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.594 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.594 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:13.595 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:13.546043+0000", 2024-04-19T03:02:13.595 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:13.595 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.595 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.595 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:13.595 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:13.546043+0000", 2024-04-19T03:02:13.595 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:13.595 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.595 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.595 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:13.595 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:13.546104+0000", 2024-04-19T03:02:13.595 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0622999999999999e-05 2024-04-19T03:02:13.595 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.595 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.595 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:13.596 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:13.546110+0000", 2024-04-19T03:02:13.596 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6000000000000003e-06 2024-04-19T03:02:13.596 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.596 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.596 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:13.596 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:13.546114+0000", 2024-04-19T03:02:13.596 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4429999999999999e-06 2024-04-19T03:02:13.596 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.596 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.596 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:13.596 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:13.546154+0000", 2024-04-19T03:02:13.596 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.0395000000000002e-05 2024-04-19T03:02:13.596 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.596 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.597 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:13.597 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:13.546177+0000", 2024-04-19T03:02:13.597 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2589999999999999e-05 2024-04-19T03:02:13.597 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:13.597 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:13.597 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:13.597 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.597 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.597 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop_reply(client.4755.0:73258 5.d e38/22 ondisk, result = 0)", 2024-04-19T03:02:13.597 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:13.547623+0000", 2024-04-19T03:02:13.597 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 4294967295.9997001, 2024-04-19T03:02:13.597 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00025508300000000002, 2024-04-19T03:02:13.597 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:13.598 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-19T03:02:13.598 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:13.598 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.598 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:13.598 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:13.547623+0000", 2024-04-19T03:02:13.598 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:13.598 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.598 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.598 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:13.598 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:13.547623+0000", 2024-04-19T03:02:13.598 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:13.598 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.598 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.598 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:13.599 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:13.547622+0000", 2024-04-19T03:02:13.599 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:13.599 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.599 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.599 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:13.599 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:13.547627+0000", 2024-04-19T03:02:13.599 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9960000000000001e-06 2024-04-19T03:02:13.599 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.599 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.599 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:13.599 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:13.547655+0000", 2024-04-19T03:02:13.599 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7911000000000001e-05 2024-04-19T03:02:13.599 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.599 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.600 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:13.600 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:13.547663+0000", 2024-04-19T03:02:13.600 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1939999999999998e-06 2024-04-19T03:02:13.600 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.600 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.600 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:13.600 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:13.547744+0000", 2024-04-19T03:02:13.600 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0841999999999996e-05 2024-04-19T03:02:13.600 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.600 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.600 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:13.600 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:13.547754+0000", 2024-04-19T03:02:13.600 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0542e-05 2024-04-19T03:02:13.600 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:13.600 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:13.601 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:13.601 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.601 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.601 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop_reply(client.4755.0:73274 5.b e38/22 ondisk, result = 0)", 2024-04-19T03:02:13.601 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:13.547707+0000", 2024-04-19T03:02:13.601 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 4294967295.9996152, 2024-04-19T03:02:13.601 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00022486300000000001, 2024-04-19T03:02:13.601 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:13.601 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-19T03:02:13.601 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:13.601 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.601 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:13.601 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:13.547707+0000", 2024-04-19T03:02:13.602 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:13.602 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.602 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.602 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:13.602 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:13.547707+0000", 2024-04-19T03:02:13.602 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:13.602 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.602 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.602 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:13.602 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:13.547707+0000", 2024-04-19T03:02:13.602 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:13.602 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.602 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.602 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:13.603 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:13.547710+0000", 2024-04-19T03:02:13.603 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1750000000000001e-06 2024-04-19T03:02:13.603 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.603 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.603 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:13.603 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:13.547720+0000", 2024-04-19T03:02:13.603 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.5629999999999998e-06 2024-04-19T03:02:13.603 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.603 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.603 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:13.603 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:13.547724+0000", 2024-04-19T03:02:13.603 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6999999999999999e-06 2024-04-19T03:02:13.603 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.603 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.604 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:13.604 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:13.547886+0000", 2024-04-19T03:02:13.604 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016203800000000001 2024-04-19T03:02:13.604 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.604 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.604 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:13.604 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:13.547892+0000", 2024-04-19T03:02:13.604 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7189999999999998e-06 2024-04-19T03:02:13.604 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:13.604 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:13.604 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:13.604 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:13.604 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-04-19T03:02:13.604 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 13 2024-04-19T03:02:13.605 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-19T03:02:13.606 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T03:02:13.623 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:13.621+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:13.724 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-04-19T03:02:13.722+0000 7f35986ab700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18243) UID: 0 2024-04-19T03:02:13.727 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-19T03:02:13.727 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-04-19T03:02:13.727 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-04-19T03:02:13.727 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-04-19T03:02:13.727 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-19T03:02:13.739 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T03:02:13.823 INFO:tasks.radosbench.radosbench.0.smithi096.stdout: 36 16 73744 73728 127.985 104 0.00600846 0.00780739 2024-04-19T03:02:13.824 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:13.821+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:13.871 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-19T03:02:13.871 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-04-19T03:02:13.871 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-04-19T03:02:13.871 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-04-19T03:02:13.871 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.871 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:10 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:02:13.871 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:14.999496+0000", 2024-04-19T03:02:13.871 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 58.869095489000003, 2024-04-19T03:02:13.871 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.022720497999999999, 2024-04-19T03:02:13.871 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:13.871 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:13.872 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:13.872 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.872 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:13.872 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999496+0000", 2024-04-19T03:02:13.872 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:13.872 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.872 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.872 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:13.872 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999496+0000", 2024-04-19T03:02:13.872 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:13.872 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.872 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.872 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:13.872 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999494+0000", 2024-04-19T03:02:13.873 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:13.873 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.873 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.873 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:13.873 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999503+0000", 2024-04-19T03:02:13.873 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.5930000000000006e-06 2024-04-19T03:02:13.873 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.873 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.873 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:13.873 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999523+0000", 2024-04-19T03:02:13.873 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9553000000000001e-05 2024-04-19T03:02:13.873 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.873 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.874 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:13.874 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999538+0000", 2024-04-19T03:02:13.874 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5702999999999999e-05 2024-04-19T03:02:13.874 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.874 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.874 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:13.874 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999608+0000", 2024-04-19T03:02:13.874 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.9912000000000004e-05 2024-04-19T03:02:13.874 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.874 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.874 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op must wait for map", 2024-04-19T03:02:13.874 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999626+0000", 2024-04-19T03:02:13.874 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8207e-05 2024-04-19T03:02:13.875 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.875 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.875 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:13.875 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.010765+0000", 2024-04-19T03:02:13.875 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011138719 2024-04-19T03:02:13.875 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.875 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.875 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:13.875 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.010906+0000", 2024-04-19T03:02:13.875 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014095899999999999 2024-04-19T03:02:13.875 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.875 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.875 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-04-19T03:02:13.876 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.011472+0000", 2024-04-19T03:02:13.876 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00056629300000000005 2024-04-19T03:02:13.876 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.876 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.876 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:13.876 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.013217+0000", 2024-04-19T03:02:13.876 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001744317 2024-04-19T03:02:13.876 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.876 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.876 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:13.876 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.022083+0000", 2024-04-19T03:02:13.876 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0088663849999999992 2024-04-19T03:02:13.876 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.877 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.877 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:13.877 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.022124+0000", 2024-04-19T03:02:13.877 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.057e-05 2024-04-19T03:02:13.877 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.877 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.877 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:13.877 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.022216+0000", 2024-04-19T03:02:13.877 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.2417000000000006e-05 2024-04-19T03:02:13.877 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:13.877 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:13.877 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:13.877 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.877 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.878 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:32 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:02:13.878 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:14.999712+0000", 2024-04-19T03:02:13.878 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 58.868879245999999, 2024-04-19T03:02:13.878 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.022635437000000001, 2024-04-19T03:02:13.878 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:13.878 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:13.878 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:13.878 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.878 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:13.878 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999712+0000", 2024-04-19T03:02:13.878 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:13.878 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.878 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.879 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:13.879 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999712+0000", 2024-04-19T03:02:13.879 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:13.879 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.879 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.879 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:13.879 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999711+0000", 2024-04-19T03:02:13.879 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:13.879 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.879 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.879 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:13.879 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999719+0000", 2024-04-19T03:02:13.879 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.354e-06 2024-04-19T03:02:13.879 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.880 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.880 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:13.880 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999735+0000", 2024-04-19T03:02:13.880 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6288999999999999e-05 2024-04-19T03:02:13.880 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.880 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.880 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:13.880 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999749+0000", 2024-04-19T03:02:13.880 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3492999999999999e-05 2024-04-19T03:02:13.880 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.880 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.880 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:13.880 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999811+0000", 2024-04-19T03:02:13.881 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2298999999999994e-05 2024-04-19T03:02:13.881 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.881 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.881 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:02:13.881 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999817+0000", 2024-04-19T03:02:13.881 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2169999999999999e-06 2024-04-19T03:02:13.881 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.881 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.881 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:13.881 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.011836+0000", 2024-04-19T03:02:13.881 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.012018008 2024-04-19T03:02:13.881 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.881 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.882 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:13.882 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.011897+0000", 2024-04-19T03:02:13.882 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1111000000000005e-05 2024-04-19T03:02:13.882 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.882 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.882 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-04-19T03:02:13.882 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.011980+0000", 2024-04-19T03:02:13.882 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3003999999999993e-05 2024-04-19T03:02:13.882 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.882 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.882 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:13.882 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.013863+0000", 2024-04-19T03:02:13.882 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001883804 2024-04-19T03:02:13.882 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.883 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.883 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:13.883 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.022257+0000", 2024-04-19T03:02:13.883 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0083938290000000002 2024-04-19T03:02:13.883 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.883 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.883 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:13.883 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.022310+0000", 2024-04-19T03:02:13.883 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.236e-05 2024-04-19T03:02:13.883 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.883 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.883 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:13.883 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.022347+0000", 2024-04-19T03:02:13.884 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7653e-05 2024-04-19T03:02:13.884 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:13.884 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:13.884 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:13.884 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.884 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.884 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:24 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:02:13.884 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:14.999964+0000", 2024-04-19T03:02:13.884 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 58.868627568000001, 2024-04-19T03:02:13.884 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020451446000000002, 2024-04-19T03:02:13.884 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:13.884 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-19T03:02:13.884 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:13.885 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.885 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:13.885 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999964+0000", 2024-04-19T03:02:13.885 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:13.885 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.885 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.885 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:13.885 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999964+0000", 2024-04-19T03:02:13.885 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:13.885 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.885 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.885 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:13.885 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999963+0000", 2024-04-19T03:02:13.885 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:13.886 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.886 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.886 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:13.886 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999969+0000", 2024-04-19T03:02:13.886 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0270000000000001e-06 2024-04-19T03:02:13.886 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.886 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.886 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:13.886 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999984+0000", 2024-04-19T03:02:13.886 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5903e-05 2024-04-19T03:02:13.886 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.886 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.886 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:13.887 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999998+0000", 2024-04-19T03:02:13.887 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3076e-05 2024-04-19T03:02:13.887 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.887 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.887 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:13.887 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.000078+0000", 2024-04-19T03:02:13.887 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0525000000000006e-05 2024-04-19T03:02:13.887 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.887 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.887 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op must wait for map", 2024-04-19T03:02:13.887 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.000084+0000", 2024-04-19T03:02:13.887 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8370000000000002e-06 2024-04-19T03:02:13.887 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.887 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.888 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:13.888 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.008819+0000", 2024-04-19T03:02:13.888 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0087349019999999993 2024-04-19T03:02:13.888 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.888 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.888 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:13.888 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.009018+0000", 2024-04-19T03:02:13.888 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000198989 2024-04-19T03:02:13.888 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.888 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.888 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:13.888 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.020415+0000", 2024-04-19T03:02:13.888 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011397157 2024-04-19T03:02:13.888 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:13.889 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:13.889 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:13.889 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.889 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.889 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:11274 5.e 5:7c846032:::benchmark_data_smithi096_19531_object11273:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T03:02:13.889 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:42.061776+0000", 2024-04-19T03:02:13.889 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 31.806815322999999, 2024-04-19T03:02:13.889 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.035381001000000002, 2024-04-19T03:02:13.889 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:13.889 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:13.889 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:13.889 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:13.889 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:13.889 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 11274 2024-04-19T03:02:13.890 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.890 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:13.890 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.890 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:13.890 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.061776+0000", 2024-04-19T03:02:13.890 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:13.890 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.890 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.890 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:13.890 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.061776+0000", 2024-04-19T03:02:13.890 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:13.890 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.890 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.890 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:13.891 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.061775+0000", 2024-04-19T03:02:13.891 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:13.891 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.891 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.891 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:13.891 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.061807+0000", 2024-04-19T03:02:13.891 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1733000000000003e-05 2024-04-19T03:02:13.891 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.891 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.891 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:13.891 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.061822+0000", 2024-04-19T03:02:13.892 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5452999999999999e-05 2024-04-19T03:02:13.892 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.892 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.892 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:13.892 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.061827+0000", 2024-04-19T03:02:13.892 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9810000000000003e-06 2024-04-19T03:02:13.892 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.892 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.892 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:13.892 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.063388+0000", 2024-04-19T03:02:13.892 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0015605720000000001 2024-04-19T03:02:13.892 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.892 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.892 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:13.893 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.063612+0000", 2024-04-19T03:02:13.893 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00022431 2024-04-19T03:02:13.893 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.893 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.893 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:13.893 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.063747+0000", 2024-04-19T03:02:13.893 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013459600000000001 2024-04-19T03:02:13.893 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.893 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.893 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:13.893 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.066186+0000", 2024-04-19T03:02:13.893 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0024388909999999999 2024-04-19T03:02:13.893 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.893 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.894 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:13.894 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.097016+0000", 2024-04-19T03:02:13.894 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.030830705 2024-04-19T03:02:13.894 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.894 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.894 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:13.894 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.097096+0000", 2024-04-19T03:02:13.894 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.9469999999999996e-05 2024-04-19T03:02:13.894 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.894 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.894 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:13.895 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.097157+0000", 2024-04-19T03:02:13.895 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0884999999999997e-05 2024-04-19T03:02:13.895 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:13.895 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:13.895 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:13.895 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.895 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.895 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:11279 5.8 5:10b60c58:::benchmark_data_smithi096_19531_object11278:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T03:02:13.895 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:42.062594+0000", 2024-04-19T03:02:13.895 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 31.805996884999999, 2024-04-19T03:02:13.895 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.028696788000000001, 2024-04-19T03:02:13.895 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:13.895 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:13.896 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:13.896 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:13.896 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:13.896 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 11279 2024-04-19T03:02:13.896 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.896 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:13.896 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.896 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:13.896 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.062594+0000", 2024-04-19T03:02:13.896 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:13.896 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.896 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.896 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:13.896 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.062594+0000", 2024-04-19T03:02:13.896 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:13.897 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.897 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.897 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:13.897 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.062593+0000", 2024-04-19T03:02:13.897 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:13.897 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.897 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.897 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:13.897 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.062646+0000", 2024-04-19T03:02:13.897 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2293999999999998e-05 2024-04-19T03:02:13.897 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.897 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.897 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:13.897 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.062657+0000", 2024-04-19T03:02:13.898 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1440000000000001e-05 2024-04-19T03:02:13.898 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.898 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.898 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:13.898 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.062665+0000", 2024-04-19T03:02:13.898 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5159999999999997e-06 2024-04-19T03:02:13.898 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.898 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.898 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:13.898 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.063799+0000", 2024-04-19T03:02:13.898 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0011344860000000001 2024-04-19T03:02:13.898 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.898 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.899 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:13.899 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.063962+0000", 2024-04-19T03:02:13.899 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000162614 2024-04-19T03:02:13.899 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.899 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.899 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:13.899 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.064167+0000", 2024-04-19T03:02:13.899 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00020491699999999999 2024-04-19T03:02:13.899 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.899 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.899 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:13.899 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.066768+0000", 2024-04-19T03:02:13.899 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0026012090000000002 2024-04-19T03:02:13.900 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.900 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.900 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:13.900 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.091184+0000", 2024-04-19T03:02:13.901 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.024416582999999999 2024-04-19T03:02:13.902 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.902 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.902 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:13.902 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.091251+0000", 2024-04-19T03:02:13.902 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6753000000000003e-05 2024-04-19T03:02:13.902 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.902 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.902 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:13.902 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.091291+0000", 2024-04-19T03:02:13.902 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9841e-05 2024-04-19T03:02:13.902 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:13.902 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:13.902 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:13.903 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.903 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.903 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:11282 5.e 5:75b7c510:::benchmark_data_smithi096_19531_object11281:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T03:02:13.903 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:42.062674+0000", 2024-04-19T03:02:13.903 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 31.805917429000001, 2024-04-19T03:02:13.903 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.034812849, 2024-04-19T03:02:13.903 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:13.903 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:13.903 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:13.903 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:13.903 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:13.903 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 11282 2024-04-19T03:02:13.903 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.904 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:13.904 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.904 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:13.904 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.062674+0000", 2024-04-19T03:02:13.904 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:13.904 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.904 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.904 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:13.904 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.062674+0000", 2024-04-19T03:02:13.904 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:13.904 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.904 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.904 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:13.905 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.062673+0000", 2024-04-19T03:02:13.905 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:13.905 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.905 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.905 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:13.905 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.062712+0000", 2024-04-19T03:02:13.905 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9341999999999997e-05 2024-04-19T03:02:13.905 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.905 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.905 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:13.905 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.062721+0000", 2024-04-19T03:02:13.905 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1700000000000003e-06 2024-04-19T03:02:13.905 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.905 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.906 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:13.906 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.062729+0000", 2024-04-19T03:02:13.906 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4240000000000004e-06 2024-04-19T03:02:13.906 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.906 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.906 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:13.906 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.065017+0000", 2024-04-19T03:02:13.906 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0022878590000000002 2024-04-19T03:02:13.906 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.906 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.906 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:13.906 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.065207+0000", 2024-04-19T03:02:13.906 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000190411 2024-04-19T03:02:13.907 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.907 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.907 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:13.907 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.065323+0000", 2024-04-19T03:02:13.907 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000115593 2024-04-19T03:02:13.907 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.907 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.907 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:13.907 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.069683+0000", 2024-04-19T03:02:13.907 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0043604409999999996 2024-04-19T03:02:13.907 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.907 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.907 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:13.907 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.097273+0000", 2024-04-19T03:02:13.908 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.027589516000000001 2024-04-19T03:02:13.908 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.908 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.908 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:13.908 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.097406+0000", 2024-04-19T03:02:13.908 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000133514 2024-04-19T03:02:13.908 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.908 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.908 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:13.908 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.097486+0000", 2024-04-19T03:02:13.908 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0479e-05 2024-04-19T03:02:13.908 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:13.908 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:13.909 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:13.909 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.909 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.909 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:11288 5.0 5:042458d0:::benchmark_data_smithi096_19531_object11287:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T03:02:13.909 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:42.070352+0000", 2024-04-19T03:02:13.909 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 31.798239501000001, 2024-04-19T03:02:13.909 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.021532447, 2024-04-19T03:02:13.909 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:13.909 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:13.909 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:13.909 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:13.909 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:13.909 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 11288 2024-04-19T03:02:13.910 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.910 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:13.910 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.910 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:13.910 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.070352+0000", 2024-04-19T03:02:13.910 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:13.910 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.910 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.910 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:13.910 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.070352+0000", 2024-04-19T03:02:13.910 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:13.910 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.911 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.911 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:13.911 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.070351+0000", 2024-04-19T03:02:13.911 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:13.911 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.911 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.911 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:13.911 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.070392+0000", 2024-04-19T03:02:13.911 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1077e-05 2024-04-19T03:02:13.911 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.911 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.911 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:13.911 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.070398+0000", 2024-04-19T03:02:13.912 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1109999999999996e-06 2024-04-19T03:02:13.912 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.912 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.912 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:13.912 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.070402+0000", 2024-04-19T03:02:13.912 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2010000000000001e-06 2024-04-19T03:02:13.912 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.912 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.912 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:13.912 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.070445+0000", 2024-04-19T03:02:13.912 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2585e-05 2024-04-19T03:02:13.912 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.912 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.913 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:13.913 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.070572+0000", 2024-04-19T03:02:13.913 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012708500000000001 2024-04-19T03:02:13.913 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.913 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.913 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:13.913 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.070711+0000", 2024-04-19T03:02:13.913 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013848699999999999 2024-04-19T03:02:13.913 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.913 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.913 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:13.913 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.073505+0000", 2024-04-19T03:02:13.913 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0027944620000000002 2024-04-19T03:02:13.913 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.914 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.914 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:13.914 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.091806+0000", 2024-04-19T03:02:13.914 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.018301251000000001 2024-04-19T03:02:13.914 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.914 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.914 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:13.914 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.091854+0000", 2024-04-19T03:02:13.914 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7419000000000001e-05 2024-04-19T03:02:13.914 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.914 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.914 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:13.914 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.091884+0000", 2024-04-19T03:02:13.914 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0241999999999999e-05 2024-04-19T03:02:13.915 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:13.915 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:13.915 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:13.915 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.915 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.915 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:11292 5.0 5:009b2ea9:::benchmark_data_smithi096_19531_object11291:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T03:02:13.915 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:42.070676+0000", 2024-04-19T03:02:13.915 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 31.797915125999999, 2024-04-19T03:02:13.915 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.02219631, 2024-04-19T03:02:13.915 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:13.915 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:13.915 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:13.915 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:13.916 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:13.916 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 11292 2024-04-19T03:02:13.916 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.916 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:13.916 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.916 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:13.916 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.070676+0000", 2024-04-19T03:02:13.916 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:13.916 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.916 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.916 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:13.916 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.070676+0000", 2024-04-19T03:02:13.916 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:13.916 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.917 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.917 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:13.917 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.070675+0000", 2024-04-19T03:02:13.917 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:13.917 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.917 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.917 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:13.917 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.070800+0000", 2024-04-19T03:02:13.917 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000125263 2024-04-19T03:02:13.917 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.917 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.917 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:13.917 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.070808+0000", 2024-04-19T03:02:13.917 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0209999999999999e-06 2024-04-19T03:02:13.918 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.918 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.918 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:13.918 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.070814+0000", 2024-04-19T03:02:13.918 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0969999999999996e-06 2024-04-19T03:02:13.918 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.918 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.918 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:13.918 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.071956+0000", 2024-04-19T03:02:13.918 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0011427480000000001 2024-04-19T03:02:13.918 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.918 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.918 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:13.919 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.072153+0000", 2024-04-19T03:02:13.919 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000196524 2024-04-19T03:02:13.919 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.919 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.919 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:13.919 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.072312+0000", 2024-04-19T03:02:13.919 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015879300000000001 2024-04-19T03:02:13.919 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.919 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.919 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:13.919 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.078407+0000", 2024-04-19T03:02:13.919 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0060954929999999996 2024-04-19T03:02:13.919 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.919 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.920 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:13.920 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.092742+0000", 2024-04-19T03:02:13.920 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.014335349000000001 2024-04-19T03:02:13.920 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.920 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.920 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:13.920 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.092815+0000", 2024-04-19T03:02:13.920 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2881999999999998e-05 2024-04-19T03:02:13.920 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.920 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.920 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:13.920 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.092872+0000", 2024-04-19T03:02:13.920 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6965000000000001e-05 2024-04-19T03:02:13.920 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:13.920 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:13.921 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:13.921 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.921 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.921 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:11297 5.e 5:7975ecb6:::benchmark_data_smithi096_19531_object11296:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T03:02:13.921 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:42.076848+0000", 2024-04-19T03:02:13.921 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 31.791743245999999, 2024-04-19T03:02:13.921 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020867969, 2024-04-19T03:02:13.921 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:13.921 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:13.921 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:13.921 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:13.921 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:13.921 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 11297 2024-04-19T03:02:13.921 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.922 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:13.922 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.922 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:13.922 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.076848+0000", 2024-04-19T03:02:13.922 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:13.922 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.922 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.922 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:13.922 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.076848+0000", 2024-04-19T03:02:13.922 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:13.922 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.922 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.922 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:13.922 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.076846+0000", 2024-04-19T03:02:13.922 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:13.923 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.923 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.923 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:13.923 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.076894+0000", 2024-04-19T03:02:13.923 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7645000000000002e-05 2024-04-19T03:02:13.923 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.923 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.923 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:13.923 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.076913+0000", 2024-04-19T03:02:13.923 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8885e-05 2024-04-19T03:02:13.923 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.923 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.923 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:13.923 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.076924+0000", 2024-04-19T03:02:13.923 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.118e-05 2024-04-19T03:02:13.924 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.924 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.924 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:13.924 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.076983+0000", 2024-04-19T03:02:13.924 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8952000000000001e-05 2024-04-19T03:02:13.924 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.924 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.924 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:13.924 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.077156+0000", 2024-04-19T03:02:13.924 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00017307600000000001 2024-04-19T03:02:13.924 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.924 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.924 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:13.924 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.077358+0000", 2024-04-19T03:02:13.924 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000201991 2024-04-19T03:02:13.925 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.925 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.925 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:13.925 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.080885+0000", 2024-04-19T03:02:13.925 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0035268309999999998 2024-04-19T03:02:13.925 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.925 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.925 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:13.925 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.097569+0000", 2024-04-19T03:02:13.925 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.016683854000000001 2024-04-19T03:02:13.925 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.925 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.925 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:13.926 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.097647+0000", 2024-04-19T03:02:13.926 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.7823000000000004e-05 2024-04-19T03:02:13.926 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.926 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.926 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:13.926 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.097716+0000", 2024-04-19T03:02:13.926 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.9079999999999996e-05 2024-04-19T03:02:13.926 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:13.926 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:13.926 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:13.926 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.926 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.927 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:11298 5.e 5:72565f0a:::benchmark_data_smithi096_19531_object11297:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T03:02:13.927 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:42.076954+0000", 2024-04-19T03:02:13.927 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 31.791637372, 2024-04-19T03:02:13.927 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020950191999999999, 2024-04-19T03:02:13.927 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:13.927 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:13.927 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:13.927 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:13.927 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:13.927 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 11298 2024-04-19T03:02:13.927 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.927 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:13.927 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.927 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:13.928 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.076954+0000", 2024-04-19T03:02:13.928 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:13.928 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.928 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.928 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:13.928 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.076954+0000", 2024-04-19T03:02:13.928 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:13.928 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.928 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.928 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:13.928 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.076953+0000", 2024-04-19T03:02:13.928 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:13.929 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.929 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.929 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:13.929 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.076997+0000", 2024-04-19T03:02:13.929 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4023000000000002e-05 2024-04-19T03:02:13.929 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.929 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.929 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:13.929 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.077009+0000", 2024-04-19T03:02:13.929 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2456000000000001e-05 2024-04-19T03:02:13.929 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.929 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.929 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:13.929 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.077015+0000", 2024-04-19T03:02:13.930 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7950000000000004e-06 2024-04-19T03:02:13.930 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.930 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.930 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:13.930 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.078552+0000", 2024-04-19T03:02:13.930 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0015371320000000001 2024-04-19T03:02:13.930 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.930 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.930 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:13.930 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.078760+0000", 2024-04-19T03:02:13.930 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00020808799999999999 2024-04-19T03:02:13.930 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.930 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.931 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:13.931 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.078875+0000", 2024-04-19T03:02:13.931 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011457500000000001 2024-04-19T03:02:13.931 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.931 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.931 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:13.931 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.083603+0000", 2024-04-19T03:02:13.931 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0047276239999999997 2024-04-19T03:02:13.931 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.931 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.931 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:13.931 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.097783+0000", 2024-04-19T03:02:13.931 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.014180036 2024-04-19T03:02:13.932 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.932 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.932 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:13.932 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.097863+0000", 2024-04-19T03:02:13.932 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0317999999999999e-05 2024-04-19T03:02:13.932 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.932 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.932 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:13.932 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.097904+0000", 2024-04-19T03:02:13.932 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1035000000000003e-05 2024-04-19T03:02:13.932 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:13.932 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:13.932 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:13.933 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.933 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.933 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:50576 5.b 5:d250063d:::benchmark_data_smithi096_19531_object50575:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-19T03:02:13.933 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:00.329584+0000", 2024-04-19T03:02:13.933 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 13.539006757999999, 2024-04-19T03:02:13.933 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.021217389, 2024-04-19T03:02:13.933 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:13.933 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:13.933 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:13.933 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:13.933 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:13.933 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 50576 2024-04-19T03:02:13.933 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.933 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:13.934 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.934 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:13.934 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:00.329584+0000", 2024-04-19T03:02:13.934 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:13.934 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.934 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.934 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:13.934 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:00.329584+0000", 2024-04-19T03:02:13.934 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:13.934 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.934 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.934 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:13.934 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:00.329583+0000", 2024-04-19T03:02:13.935 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:13.935 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.935 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.935 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:13.935 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:00.329626+0000", 2024-04-19T03:02:13.935 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2530000000000001e-05 2024-04-19T03:02:13.935 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.935 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.935 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:13.935 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:00.329642+0000", 2024-04-19T03:02:13.935 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5891000000000001e-05 2024-04-19T03:02:13.935 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.935 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.935 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:13.936 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:00.329652+0000", 2024-04-19T03:02:13.936 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0093e-05 2024-04-19T03:02:13.936 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.936 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.936 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:13.936 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:00.330793+0000", 2024-04-19T03:02:13.936 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001141097 2024-04-19T03:02:13.936 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.936 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.936 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:13.936 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:00.330924+0000", 2024-04-19T03:02:13.936 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013114499999999999 2024-04-19T03:02:13.936 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.937 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.937 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:13.937 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:00.331055+0000", 2024-04-19T03:02:13.937 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013124600000000001 2024-04-19T03:02:13.937 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.937 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.937 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:13.937 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:00.335705+0000", 2024-04-19T03:02:13.937 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0046501549999999996 2024-04-19T03:02:13.937 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.938 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.938 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:13.938 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:00.350741+0000", 2024-04-19T03:02:13.938 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015035411 2024-04-19T03:02:13.938 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.938 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.938 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:13.938 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:00.350777+0000", 2024-04-19T03:02:13.938 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5874999999999998e-05 2024-04-19T03:02:13.938 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.938 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.938 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:13.938 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:00.350802+0000", 2024-04-19T03:02:13.939 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5040000000000001e-05 2024-04-19T03:02:13.939 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:13.939 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:13.939 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:13.939 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.939 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.939 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:52909 5.b 5:df07ce30:::benchmark_data_smithi096_19531_object52908:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-19T03:02:13.939 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:01.602899+0000", 2024-04-19T03:02:13.939 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 12.265692388, 2024-04-19T03:02:13.939 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020403345, 2024-04-19T03:02:13.939 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:13.939 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:13.940 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:13.940 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:13.940 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:13.940 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 52909 2024-04-19T03:02:13.940 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.940 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:13.940 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.940 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:13.940 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:01.602899+0000", 2024-04-19T03:02:13.940 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:13.940 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.940 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.940 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:13.940 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:01.602899+0000", 2024-04-19T03:02:13.941 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:13.941 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.941 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.941 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:13.941 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:01.602883+0000", 2024-04-19T03:02:13.941 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999838 2024-04-19T03:02:13.941 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.941 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.941 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:13.941 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:01.602956+0000", 2024-04-19T03:02:13.941 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2941000000000005e-05 2024-04-19T03:02:13.941 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.941 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.941 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:13.942 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:01.602970+0000", 2024-04-19T03:02:13.942 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4562999999999999e-05 2024-04-19T03:02:13.942 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.942 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.942 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:13.942 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:01.602981+0000", 2024-04-19T03:02:13.942 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1134999999999999e-05 2024-04-19T03:02:13.942 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.942 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.942 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:13.942 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:01.603043+0000", 2024-04-19T03:02:13.942 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2034999999999998e-05 2024-04-19T03:02:13.942 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.943 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.943 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:13.943 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:01.603173+0000", 2024-04-19T03:02:13.943 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012962800000000001 2024-04-19T03:02:13.943 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.943 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.943 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:13.943 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:01.603296+0000", 2024-04-19T03:02:13.943 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012313 2024-04-19T03:02:13.943 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.943 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.943 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:13.944 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:01.606862+0000", 2024-04-19T03:02:13.944 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0035656049999999999 2024-04-19T03:02:13.944 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.944 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.944 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:13.944 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:01.623147+0000", 2024-04-19T03:02:13.944 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.016285286 2024-04-19T03:02:13.944 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.944 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.944 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:13.944 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:01.623251+0000", 2024-04-19T03:02:13.944 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000104245 2024-04-19T03:02:13.944 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.944 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.945 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:13.945 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:01.623302+0000", 2024-04-19T03:02:13.945 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0763999999999997e-05 2024-04-19T03:02:13.945 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:13.945 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:13.945 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:13.945 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.945 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.945 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:52912 5.b 5:deddbeae:::benchmark_data_smithi096_19531_object52911:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-19T03:02:13.945 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:01.603006+0000", 2024-04-19T03:02:13.945 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 12.265584597, 2024-04-19T03:02:13.945 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020493783000000002, 2024-04-19T03:02:13.945 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:13.945 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:13.946 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:13.946 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:13.946 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:13.946 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 52912 2024-04-19T03:02:13.946 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.946 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:13.946 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.946 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:13.946 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:01.603006+0000", 2024-04-19T03:02:13.946 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:13.946 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.946 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.946 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:13.947 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:01.603006+0000", 2024-04-19T03:02:13.947 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:13.947 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.947 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.947 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:13.947 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:01.603006+0000", 2024-04-19T03:02:13.947 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:13.947 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.947 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.947 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:13.947 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:01.603054+0000", 2024-04-19T03:02:13.947 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8529000000000002e-05 2024-04-19T03:02:13.947 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.948 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.948 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:13.948 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:01.603067+0000", 2024-04-19T03:02:13.948 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2412000000000001e-05 2024-04-19T03:02:13.948 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.948 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.948 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:13.948 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:01.603078+0000", 2024-04-19T03:02:13.948 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1059e-05 2024-04-19T03:02:13.948 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.948 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.948 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:13.948 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:01.605226+0000", 2024-04-19T03:02:13.948 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0021488029999999999 2024-04-19T03:02:13.948 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.949 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.949 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:13.949 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:01.605333+0000", 2024-04-19T03:02:13.949 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000106346 2024-04-19T03:02:13.949 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.949 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.949 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:13.949 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:01.605426+0000", 2024-04-19T03:02:13.949 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.2985999999999994e-05 2024-04-19T03:02:13.949 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.949 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.949 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:13.949 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:01.607251+0000", 2024-04-19T03:02:13.950 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0018255789999999999 2024-04-19T03:02:13.950 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.950 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.950 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:13.950 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:01.623413+0000", 2024-04-19T03:02:13.950 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.016161854999999999 2024-04-19T03:02:13.950 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.950 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.950 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:13.950 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:01.623448+0000", 2024-04-19T03:02:13.950 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4498000000000001e-05 2024-04-19T03:02:13.950 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.950 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.950 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:13.951 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:01.623500+0000", 2024-04-19T03:02:13.951 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2543999999999997e-05 2024-04-19T03:02:13.951 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:13.951 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:13.951 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:13.951 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.951 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.951 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:57961 5.4 5:25b0464f:::benchmark_data_smithi096_19531_object57960:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-19T03:02:13.951 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:04.472703+0000", 2024-04-19T03:02:13.951 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 9.3958883140000005, 2024-04-19T03:02:13.951 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.021714888000000002, 2024-04-19T03:02:13.951 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:13.951 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:13.951 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:13.951 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:13.951 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:13.952 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 57961 2024-04-19T03:02:13.952 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.952 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:13.952 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.952 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:13.952 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:04.472703+0000", 2024-04-19T03:02:13.952 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:13.952 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.952 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.952 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:13.952 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:04.472703+0000", 2024-04-19T03:02:13.952 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:13.952 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.952 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.952 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:13.952 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:04.472701+0000", 2024-04-19T03:02:13.953 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:13.953 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.953 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.953 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:13.953 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:04.472805+0000", 2024-04-19T03:02:13.953 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000103268 2024-04-19T03:02:13.953 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.953 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.953 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:13.953 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:04.472818+0000", 2024-04-19T03:02:13.953 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3528e-05 2024-04-19T03:02:13.953 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.954 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.954 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:13.954 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:04.472825+0000", 2024-04-19T03:02:13.954 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.0210000000000002e-06 2024-04-19T03:02:13.954 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.954 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.954 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:13.954 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:04.473983+0000", 2024-04-19T03:02:13.954 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0011581600000000001 2024-04-19T03:02:13.954 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.954 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.954 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:13.954 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:04.474201+0000", 2024-04-19T03:02:13.955 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00021749000000000001 2024-04-19T03:02:13.955 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.955 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.955 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:13.955 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:04.474378+0000", 2024-04-19T03:02:13.955 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00017696300000000001 2024-04-19T03:02:13.955 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.955 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.955 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:13.955 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:04.477308+0000", 2024-04-19T03:02:13.955 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0029298140000000002 2024-04-19T03:02:13.955 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.955 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.955 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:13.956 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:04.494322+0000", 2024-04-19T03:02:13.956 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.017014567000000001 2024-04-19T03:02:13.956 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.956 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.956 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:13.956 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:04.494386+0000", 2024-04-19T03:02:13.956 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4122999999999996e-05 2024-04-19T03:02:13.956 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.956 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.956 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:13.956 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:04.494418+0000", 2024-04-19T03:02:13.956 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1245999999999999e-05 2024-04-19T03:02:13.956 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:13.956 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:13.956 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:13.956 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.957 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.957 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:58042 5.b 5:d6f19b42:::benchmark_data_smithi096_19531_object58041:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-19T03:02:13.957 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:04.520286+0000", 2024-04-19T03:02:13.957 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 9.3483049190000003, 2024-04-19T03:02:13.957 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020956167000000001, 2024-04-19T03:02:13.957 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:13.957 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:13.957 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:13.958 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:13.958 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:13.958 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 58042 2024-04-19T03:02:13.958 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.958 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:13.958 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.958 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:13.958 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:04.520286+0000", 2024-04-19T03:02:13.958 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:13.958 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.958 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.958 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:13.958 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:04.520286+0000", 2024-04-19T03:02:13.959 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:13.959 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.959 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.959 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:13.959 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:04.520285+0000", 2024-04-19T03:02:13.959 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:13.959 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.959 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.959 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:13.959 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:04.520374+0000", 2024-04-19T03:02:13.959 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9599999999999996e-05 2024-04-19T03:02:13.959 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.959 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.959 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:13.959 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:04.520409+0000", 2024-04-19T03:02:13.959 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4952e-05 2024-04-19T03:02:13.960 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.960 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.960 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:13.960 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:04.520421+0000", 2024-04-19T03:02:13.960 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.187e-05 2024-04-19T03:02:13.960 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.960 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.960 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:13.960 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:04.523527+0000", 2024-04-19T03:02:13.960 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.003105465 2024-04-19T03:02:13.960 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.960 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.960 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:13.960 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:04.523740+0000", 2024-04-19T03:02:13.960 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00021303500000000001 2024-04-19T03:02:13.960 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.961 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.961 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:13.961 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:04.523947+0000", 2024-04-19T03:02:13.961 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00020676599999999999 2024-04-19T03:02:13.961 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.961 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.961 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:13.961 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:04.532791+0000", 2024-04-19T03:02:13.961 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0088447079999999997 2024-04-19T03:02:13.961 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.961 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.961 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:13.961 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:04.541145+0000", 2024-04-19T03:02:13.961 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0083535620000000001 2024-04-19T03:02:13.961 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.962 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.962 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:13.962 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:04.541208+0000", 2024-04-19T03:02:13.962 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3303e-05 2024-04-19T03:02:13.962 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.962 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.962 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:13.962 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:04.541242+0000", 2024-04-19T03:02:13.962 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4226000000000001e-05 2024-04-19T03:02:13.962 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:13.962 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:13.962 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:13.962 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.963 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.963 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:59827 5.d 5:b422f98a:::benchmark_data_smithi096_19531_object59826:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-19T03:02:13.963 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:05.531472+0000", 2024-04-19T03:02:13.963 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 8.3371190990000006, 2024-04-19T03:02:13.963 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.021435431000000001, 2024-04-19T03:02:13.963 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:13.963 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:13.963 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:13.963 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:13.963 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:13.963 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 59827 2024-04-19T03:02:13.963 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.963 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:13.963 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.963 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:13.963 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:05.531472+0000", 2024-04-19T03:02:13.964 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:13.964 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.964 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.964 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:13.964 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:05.531472+0000", 2024-04-19T03:02:13.964 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:13.964 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.964 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.964 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:13.964 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:05.531471+0000", 2024-04-19T03:02:13.964 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:13.964 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.964 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.965 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:13.965 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:05.531501+0000", 2024-04-19T03:02:13.965 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0012999999999999e-05 2024-04-19T03:02:13.965 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.965 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.965 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:13.965 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:05.531509+0000", 2024-04-19T03:02:13.965 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.221e-06 2024-04-19T03:02:13.965 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.965 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.965 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:13.965 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:05.531514+0000", 2024-04-19T03:02:13.965 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2190000000000003e-06 2024-04-19T03:02:13.965 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.965 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.966 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:13.966 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:05.531554+0000", 2024-04-19T03:02:13.966 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9907999999999998e-05 2024-04-19T03:02:13.966 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.966 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.966 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:13.966 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:05.531677+0000", 2024-04-19T03:02:13.966 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012335699999999999 2024-04-19T03:02:13.966 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.966 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.966 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-04-19T03:02:13.966 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:05.531811+0000", 2024-04-19T03:02:13.967 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000133645 2024-04-19T03:02:13.967 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.967 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.967 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:13.967 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:05.535051+0000", 2024-04-19T03:02:13.967 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0032405889999999999 2024-04-19T03:02:13.967 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.967 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.967 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:13.967 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:05.552796+0000", 2024-04-19T03:02:13.967 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.017744138 2024-04-19T03:02:13.967 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.967 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.968 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:13.968 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:05.552859+0000", 2024-04-19T03:02:13.968 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3649e-05 2024-04-19T03:02:13.968 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.968 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.968 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:13.968 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:05.552907+0000", 2024-04-19T03:02:13.968 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8231e-05 2024-04-19T03:02:13.968 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:13.968 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:13.968 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:13.968 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.968 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.969 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:60972 5.b 5:d54d473f:::benchmark_data_smithi096_19531_object60971:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-19T03:02:13.969 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:06.223871+0000", 2024-04-19T03:02:13.969 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 7.6447197459999998, 2024-04-19T03:02:13.969 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.021863176000000002, 2024-04-19T03:02:13.969 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:13.969 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:13.969 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:13.969 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:13.969 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:13.969 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 60972 2024-04-19T03:02:13.969 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.969 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:13.969 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.970 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:13.970 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:06.223871+0000", 2024-04-19T03:02:13.970 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:13.970 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.970 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.970 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:13.970 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:06.223871+0000", 2024-04-19T03:02:13.970 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:13.970 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.970 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.970 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:13.970 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:06.223870+0000", 2024-04-19T03:02:13.970 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:13.971 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.971 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.971 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:13.971 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:06.223943+0000", 2024-04-19T03:02:13.971 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2619000000000004e-05 2024-04-19T03:02:13.971 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.971 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.971 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:13.971 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:06.223954+0000", 2024-04-19T03:02:13.971 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0491e-05 2024-04-19T03:02:13.971 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.971 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.971 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:13.971 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:06.223961+0000", 2024-04-19T03:02:13.972 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2089999999999999e-06 2024-04-19T03:02:13.972 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.972 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.972 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:13.972 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:06.224005+0000", 2024-04-19T03:02:13.972 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3884999999999997e-05 2024-04-19T03:02:13.972 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.972 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.972 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:13.972 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:06.224101+0000", 2024-04-19T03:02:13.972 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.6508000000000005e-05 2024-04-19T03:02:13.972 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.972 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.972 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:13.973 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:06.224200+0000", 2024-04-19T03:02:13.973 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.8870999999999996e-05 2024-04-19T03:02:13.973 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.973 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.973 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:13.973 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:06.230624+0000", 2024-04-19T03:02:13.973 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0064236110000000001 2024-04-19T03:02:13.973 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.973 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.973 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:13.973 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:06.245639+0000", 2024-04-19T03:02:13.973 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015015379000000001 2024-04-19T03:02:13.973 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.974 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.974 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:13.974 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:06.245701+0000", 2024-04-19T03:02:13.974 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1663999999999998e-05 2024-04-19T03:02:13.974 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.974 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.974 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:13.974 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:06.245735+0000", 2024-04-19T03:02:13.974 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3785000000000003e-05 2024-04-19T03:02:13.974 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:13.974 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:13.974 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:13.974 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.975 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.975 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:67762 5.4 5:20b04c26:::benchmark_data_smithi096_19531_object67761:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T03:02:13.975 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:10.239937+0000", 2024-04-19T03:02:13.975 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 3.6286542449999999, 2024-04-19T03:02:13.975 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020469803000000002, 2024-04-19T03:02:13.975 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:13.975 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:13.975 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:13.975 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:13.975 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:13.975 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 67762 2024-04-19T03:02:13.975 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.975 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:13.976 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.976 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:13.976 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:10.239937+0000", 2024-04-19T03:02:13.976 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:13.976 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.976 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.976 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:13.976 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:10.239937+0000", 2024-04-19T03:02:13.976 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:13.976 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.976 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.976 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:13.976 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:10.239936+0000", 2024-04-19T03:02:13.976 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:13.977 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.977 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.977 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:13.977 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:10.239983+0000", 2024-04-19T03:02:13.977 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7348999999999997e-05 2024-04-19T03:02:13.977 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.977 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.977 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:13.977 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:10.239994+0000", 2024-04-19T03:02:13.977 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0329000000000001e-05 2024-04-19T03:02:13.977 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.977 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.977 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:13.978 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:10.240002+0000", 2024-04-19T03:02:13.978 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0299999999999994e-06 2024-04-19T03:02:13.978 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.978 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.978 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:13.978 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:10.243811+0000", 2024-04-19T03:02:13.978 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0038095 2024-04-19T03:02:13.978 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.978 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.978 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:13.978 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:10.243937+0000", 2024-04-19T03:02:13.978 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012542099999999999 2024-04-19T03:02:13.978 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.979 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.979 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:13.979 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:10.244039+0000", 2024-04-19T03:02:13.979 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010274 2024-04-19T03:02:13.979 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.979 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.979 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:13.979 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:10.247304+0000", 2024-04-19T03:02:13.979 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0032646279999999999 2024-04-19T03:02:13.979 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.979 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.979 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:13.980 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:10.260327+0000", 2024-04-19T03:02:13.980 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013023211999999999 2024-04-19T03:02:13.980 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.980 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.980 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:13.980 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:10.260373+0000", 2024-04-19T03:02:13.980 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5899000000000002e-05 2024-04-19T03:02:13.980 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.980 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.980 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:13.980 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:10.260407+0000", 2024-04-19T03:02:13.980 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3430999999999999e-05 2024-04-19T03:02:13.980 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:13.980 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:13.981 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:13.981 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.981 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.981 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:73012 5.0 5:0ea78234:::benchmark_data_smithi096_19531_object73011:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T03:02:13.981 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:13.385164+0000", 2024-04-19T03:02:13.981 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.48342659300000002, 2024-04-19T03:02:13.981 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020370072999999999, 2024-04-19T03:02:13.981 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:13.981 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:13.981 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:13.981 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:13.981 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:13.982 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 73012 2024-04-19T03:02:13.982 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.982 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:13.982 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.982 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:13.982 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:13.385164+0000", 2024-04-19T03:02:13.982 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:13.982 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.982 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.982 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:13.982 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:13.385164+0000", 2024-04-19T03:02:13.982 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:13.983 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.983 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.983 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:13.983 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:13.385163+0000", 2024-04-19T03:02:13.983 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:13.983 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.983 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.983 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:13.983 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:13.385262+0000", 2024-04-19T03:02:13.983 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.8648999999999997e-05 2024-04-19T03:02:13.983 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.983 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.983 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:13.983 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:13.385279+0000", 2024-04-19T03:02:13.984 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.647e-05 2024-04-19T03:02:13.984 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.984 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.984 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:13.984 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:13.385287+0000", 2024-04-19T03:02:13.984 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9460000000000004e-06 2024-04-19T03:02:13.984 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.984 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.984 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:13.984 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:13.385353+0000", 2024-04-19T03:02:13.984 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5945000000000006e-05 2024-04-19T03:02:13.984 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.984 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.985 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:13.985 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:13.385484+0000", 2024-04-19T03:02:13.985 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000130572 2024-04-19T03:02:13.985 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.985 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.985 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:13.985 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:13.385656+0000", 2024-04-19T03:02:13.985 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00017162699999999999 2024-04-19T03:02:13.985 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.985 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.985 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:13.985 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:13.393327+0000", 2024-04-19T03:02:13.985 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0076712389999999998 2024-04-19T03:02:13.986 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.986 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.986 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:13.986 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:13.405484+0000", 2024-04-19T03:02:13.986 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.012157382 2024-04-19T03:02:13.986 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.986 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.986 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:13.986 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:13.405512+0000", 2024-04-19T03:02:13.986 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7946999999999999e-05 2024-04-19T03:02:13.986 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.986 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.986 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:13.987 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:13.405535+0000", 2024-04-19T03:02:13.987 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2385e-05 2024-04-19T03:02:13.987 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:13.987 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:13.987 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:13.987 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.987 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.987 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:73742 5.b 5:d86fe728:::benchmark_data_smithi096_19531_object73741:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T03:02:13.987 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:13.822877+0000", 2024-04-19T03:02:13.987 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.045714262999999998, 2024-04-19T03:02:13.987 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020717838999999998, 2024-04-19T03:02:13.987 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:13.987 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:13.988 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:13.988 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:13.988 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:13.988 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 73742 2024-04-19T03:02:13.988 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.988 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:13.988 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.988 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:13.988 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:13.822877+0000", 2024-04-19T03:02:13.988 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:13.988 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.988 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.988 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:13.989 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:13.822877+0000", 2024-04-19T03:02:13.989 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:13.989 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.989 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.989 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:13.989 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:13.822875+0000", 2024-04-19T03:02:13.989 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:13.989 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.989 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.989 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:13.989 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:13.822923+0000", 2024-04-19T03:02:13.989 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8118999999999998e-05 2024-04-19T03:02:13.989 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.989 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.989 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:13.990 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:13.822942+0000", 2024-04-19T03:02:13.990 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8709999999999999e-05 2024-04-19T03:02:13.990 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.990 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.990 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:13.990 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:13.822951+0000", 2024-04-19T03:02:13.990 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.7460000000000006e-06 2024-04-19T03:02:13.990 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.990 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.990 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:13.990 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:13.827792+0000", 2024-04-19T03:02:13.990 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0048410939999999998 2024-04-19T03:02:13.990 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.991 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.991 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:13.991 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:13.827976+0000", 2024-04-19T03:02:13.991 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00018441900000000001 2024-04-19T03:02:13.991 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.991 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.991 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:13.991 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:13.828067+0000", 2024-04-19T03:02:13.991 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1034999999999998e-05 2024-04-19T03:02:13.991 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.991 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.991 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:13.991 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:13.834404+0000", 2024-04-19T03:02:13.991 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0063362080000000003 2024-04-19T03:02:13.991 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.992 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.992 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:13.992 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:13.843527+0000", 2024-04-19T03:02:13.992 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0091229399999999995 2024-04-19T03:02:13.992 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.992 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.992 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:13.992 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:13.843557+0000", 2024-04-19T03:02:13.992 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0886000000000002e-05 2024-04-19T03:02:13.992 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:13.992 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:13.992 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:13.992 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:13.843595+0000", 2024-04-19T03:02:13.992 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7169999999999998e-05 2024-04-19T03:02:13.993 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:13.993 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:13.993 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:13.993 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:13.993 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:13.993 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-19T03:02:13.994 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-04-19T03:02:13.990+0000 7f35986ab700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18243) UID: 0 2024-04-19T03:02:13.995 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T03:02:14.095 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:14.093+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:14.122 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-04-19T03:02:14.122 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [ 2024-04-19T03:02:14.122 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.123 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:74249 5.f 5:f4338fa8:::benchmark_data_smithi096_19531_object74248:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T03:02:14.123 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:14.117339+0000", 2024-04-19T03:02:14.123 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0046278439999999999, 2024-04-19T03:02:14.123 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0046454119999999998, 2024-04-19T03:02:14.123 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:14.123 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:02:14.123 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:14.123 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:14.123 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:14.123 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 74249 2024-04-19T03:02:14.123 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.123 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:14.124 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.124 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:14.124 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:14.117339+0000", 2024-04-19T03:02:14.124 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:14.124 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.124 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.124 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:14.124 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:14.117339+0000", 2024-04-19T03:02:14.124 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:14.124 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.124 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.124 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:14.124 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:14.117338+0000", 2024-04-19T03:02:14.125 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:14.125 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.125 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.125 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:14.125 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:14.117386+0000", 2024-04-19T03:02:14.125 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7479999999999999e-05 2024-04-19T03:02:14.125 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.125 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.125 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:14.125 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:14.117396+0000", 2024-04-19T03:02:14.125 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0739e-05 2024-04-19T03:02:14.126 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.126 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.126 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:14.126 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:14.117403+0000", 2024-04-19T03:02:14.126 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.939e-06 2024-04-19T03:02:14.126 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.126 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.126 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:14.126 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:14.117433+0000", 2024-04-19T03:02:14.126 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9892000000000001e-05 2024-04-19T03:02:14.127 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.127 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.127 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:14.127 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:14.117521+0000", 2024-04-19T03:02:14.127 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.7644000000000003e-05 2024-04-19T03:02:14.127 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.127 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.127 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:02:14.127 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:14.117603+0000", 2024-04-19T03:02:14.127 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2311999999999994e-05 2024-04-19T03:02:14.127 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:14.127 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:14.128 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:14.128 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.128 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.128 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:74253 5.f 5:fded59e0:::benchmark_data_smithi096_19531_object74252:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T03:02:14.128 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:14.119123+0000", 2024-04-19T03:02:14.128 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0028443029999999998, 2024-04-19T03:02:14.128 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0029083659999999999, 2024-04-19T03:02:14.128 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:14.128 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:02:14.128 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:14.128 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:14.129 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:14.129 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 74253 2024-04-19T03:02:14.129 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.129 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:14.129 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.129 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:14.129 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:14.119123+0000", 2024-04-19T03:02:14.129 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:14.129 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.129 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.129 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:14.129 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:14.119123+0000", 2024-04-19T03:02:14.129 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:14.129 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.130 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.130 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:14.130 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:14.119122+0000", 2024-04-19T03:02:14.130 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:14.130 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.130 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.130 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:14.130 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:14.119183+0000", 2024-04-19T03:02:14.130 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1080999999999993e-05 2024-04-19T03:02:14.130 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.130 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.131 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:14.131 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:14.119208+0000", 2024-04-19T03:02:14.131 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5187000000000001e-05 2024-04-19T03:02:14.131 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.131 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.131 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:14.131 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:14.119214+0000", 2024-04-19T03:02:14.131 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6570000000000002e-06 2024-04-19T03:02:14.131 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.131 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.131 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:14.131 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:14.121309+0000", 2024-04-19T03:02:14.132 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0020948 2024-04-19T03:02:14.132 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.132 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.132 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:14.132 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:14.121401+0000", 2024-04-19T03:02:14.132 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.2486999999999997e-05 2024-04-19T03:02:14.132 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.132 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.132 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:02:14.132 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:14.121484+0000", 2024-04-19T03:02:14.132 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2896000000000001e-05 2024-04-19T03:02:14.132 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:14.133 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:14.133 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:14.133 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.133 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.133 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:74254 5.9 5:9ead0500:::benchmark_data_smithi096_19531_object74253:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T03:02:14.133 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:14.119224+0000", 2024-04-19T03:02:14.133 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0027427060000000001, 2024-04-19T03:02:14.133 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0028565320000000002, 2024-04-19T03:02:14.133 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:14.133 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:02:14.133 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:14.133 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:14.133 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:14.133 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 74254 2024-04-19T03:02:14.134 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.134 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:14.134 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.134 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:14.134 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:14.119224+0000", 2024-04-19T03:02:14.134 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:14.134 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.134 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.134 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:14.134 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:14.119224+0000", 2024-04-19T03:02:14.134 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:14.134 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.135 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.135 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:14.135 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:14.119224+0000", 2024-04-19T03:02:14.135 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:14.135 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.135 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.135 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:14.135 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:14.119251+0000", 2024-04-19T03:02:14.135 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.6577999999999999e-05 2024-04-19T03:02:14.135 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.135 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.135 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:14.135 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:14.119258+0000", 2024-04-19T03:02:14.135 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.1810000000000004e-06 2024-04-19T03:02:14.136 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.136 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.136 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:14.136 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:14.119262+0000", 2024-04-19T03:02:14.136 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9169999999999999e-06 2024-04-19T03:02:14.136 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.136 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.136 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:14.136 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:14.119310+0000", 2024-04-19T03:02:14.136 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7892000000000002e-05 2024-04-19T03:02:14.136 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.136 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.136 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:14.137 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:14.119464+0000", 2024-04-19T03:02:14.137 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00015440500000000001 2024-04-19T03:02:14.137 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.137 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.137 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:02:14.137 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:14.119604+0000", 2024-04-19T03:02:14.137 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00014046999999999999 2024-04-19T03:02:14.137 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:14.137 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:14.137 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:14.137 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.137 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.137 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:74256 5.7 5.9acf0d77 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T03:02:14.138 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:14.121817+0000", 2024-04-19T03:02:14.138 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.00014985199999999999, 2024-04-19T03:02:14.138 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00029997999999999998, 2024-04-19T03:02:14.138 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:14.138 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-04-19T03:02:14.138 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:14.138 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:14.138 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:14.138 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 74256 2024-04-19T03:02:14.138 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.138 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:14.138 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.138 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:14.138 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:14.121817+0000", 2024-04-19T03:02:14.139 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:14.139 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.139 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.139 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:14.139 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:14.121817+0000", 2024-04-19T03:02:14.139 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:14.139 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.139 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.139 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:14.139 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:14.121816+0000", 2024-04-19T03:02:14.139 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:14.139 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.139 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.140 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:14.140 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:14.121888+0000", 2024-04-19T03:02:14.140 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.1598000000000001e-05 2024-04-19T03:02:14.140 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.140 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.140 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:14.140 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:14.121898+0000", 2024-04-19T03:02:14.140 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0095000000000001e-05 2024-04-19T03:02:14.140 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.140 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.140 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:14.140 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:14.121903+0000", 2024-04-19T03:02:14.140 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1329999999999998e-06 2024-04-19T03:02:14.140 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:14.140 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:14.141 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:14.141 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:14.141 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-04-19T03:02:14.141 INFO:teuthology.orchestra.run.smithi144.stdout: "num_ops": 4 2024-04-19T03:02:14.141 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-04-19T03:02:14.142 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T03:02:14.192 INFO:teuthology.orchestra.run.smithi096.stderr:set osd.2 primary-affinity to 0.789096 (8517142) 2024-04-19T03:02:14.196 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:14.195+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:14.198 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-19T03:02:14.255 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-04-19T03:02:14.256 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2024-04-19T03:02:14.256 INFO:teuthology.orchestra.run.smithi144.stdout: "complaint_time": 30, 2024-04-19T03:02:14.256 INFO:teuthology.orchestra.run.smithi144.stdout: "num_blocked_ops": 0 2024-04-19T03:02:14.256 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-04-19T03:02:14.266 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T03:02:14.297 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:14.295+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:14.368 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-04-19T03:02:14.368 INFO:teuthology.orchestra.run.smithi144.stdout: "size": 20, 2024-04-19T03:02:14.368 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 600, 2024-04-19T03:02:14.368 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [ 2024-04-19T03:02:14.368 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.369 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4159.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-19T03:02:14.369 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:01:08.151173+0000", 2024-04-19T03:02:14.369 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 66.214108428000003, 2024-04-19T03:02:14.369 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.023083023000000001, 2024-04-19T03:02:14.369 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:14.369 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:14.369 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:14.369 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4159", 2024-04-19T03:02:14.369 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3589238956", 2024-04-19T03:02:14.369 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 141 2024-04-19T03:02:14.369 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.369 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:14.369 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.370 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:14.370 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.151173+0000", 2024-04-19T03:02:14.370 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:14.370 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.370 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.370 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:14.370 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.151173+0000", 2024-04-19T03:02:14.370 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:14.370 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.370 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.370 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:14.370 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.151171+0000", 2024-04-19T03:02:14.370 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:14.371 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.371 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.371 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:14.371 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.151182+0000", 2024-04-19T03:02:14.371 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0730000000000001e-05 2024-04-19T03:02:14.371 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.371 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.371 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:14.371 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.151203+0000", 2024-04-19T03:02:14.371 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0387e-05 2024-04-19T03:02:14.371 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.371 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.371 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:14.371 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.151225+0000", 2024-04-19T03:02:14.372 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2643e-05 2024-04-19T03:02:14.372 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.372 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.372 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:14.372 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.169207+0000", 2024-04-19T03:02:14.372 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.017981561 2024-04-19T03:02:14.372 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.372 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.372 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:14.372 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.169386+0000", 2024-04-19T03:02:14.372 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000178758 2024-04-19T03:02:14.372 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.372 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.372 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:02:14.372 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.169546+0000", 2024-04-19T03:02:14.373 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000160781 2024-04-19T03:02:14.373 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.373 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.373 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:14.373 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.171444+0000", 2024-04-19T03:02:14.373 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0018980309999999999 2024-04-19T03:02:14.373 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.373 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.373 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:14.374 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.174165+0000", 2024-04-19T03:02:14.374 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0027204920000000001 2024-04-19T03:02:14.374 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.374 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.374 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:14.374 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.174228+0000", 2024-04-19T03:02:14.374 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2774000000000006e-05 2024-04-19T03:02:14.374 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.374 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.374 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:14.374 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.174256+0000", 2024-04-19T03:02:14.374 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.8045999999999999e-05 2024-04-19T03:02:14.375 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:14.375 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:14.375 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:14.375 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.375 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.375 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4159.0:165 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-19T03:02:14.375 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:01:08.347807+0000", 2024-04-19T03:02:14.375 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 66.017474419999999, 2024-04-19T03:02:14.375 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.021589991999999999, 2024-04-19T03:02:14.375 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:14.375 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:14.375 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:14.375 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4159", 2024-04-19T03:02:14.376 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3589238956", 2024-04-19T03:02:14.376 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 165 2024-04-19T03:02:14.376 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.376 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:14.376 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.376 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:14.376 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.347807+0000", 2024-04-19T03:02:14.376 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:14.376 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.376 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.376 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:14.376 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.347807+0000", 2024-04-19T03:02:14.376 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:14.376 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.376 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.377 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:14.377 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.347806+0000", 2024-04-19T03:02:14.377 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:14.377 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.377 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.377 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:14.377 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.347812+0000", 2024-04-19T03:02:14.377 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.066e-06 2024-04-19T03:02:14.377 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.377 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.377 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:14.377 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.347818+0000", 2024-04-19T03:02:14.377 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5550000000000002e-06 2024-04-19T03:02:14.377 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.378 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.378 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:14.378 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.347822+0000", 2024-04-19T03:02:14.378 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.561e-06 2024-04-19T03:02:14.378 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.378 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.378 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:14.378 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.365703+0000", 2024-04-19T03:02:14.378 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.017880566000000001 2024-04-19T03:02:14.378 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.378 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.378 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:14.378 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.365805+0000", 2024-04-19T03:02:14.379 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00010213900000000001 2024-04-19T03:02:14.379 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.379 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.379 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:02:14.379 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.365928+0000", 2024-04-19T03:02:14.379 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00012337900000000001 2024-04-19T03:02:14.379 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.379 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.379 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:14.379 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.367353+0000", 2024-04-19T03:02:14.379 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001424397 2024-04-19T03:02:14.379 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.379 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.379 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:14.380 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.369260+0000", 2024-04-19T03:02:14.380 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0019069130000000001 2024-04-19T03:02:14.380 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.380 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.380 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:14.380 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.369342+0000", 2024-04-19T03:02:14.380 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2423999999999996e-05 2024-04-19T03:02:14.380 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.380 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.380 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:14.380 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.369397+0000", 2024-04-19T03:02:14.380 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4481999999999998e-05 2024-04-19T03:02:14.380 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:14.381 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:14.381 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:14.381 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.381 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.381 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4159.0:188 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-19T03:02:14.381 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:01:08.539135+0000", 2024-04-19T03:02:14.381 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 65.826146162000001, 2024-04-19T03:02:14.381 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.021590602, 2024-04-19T03:02:14.381 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:14.381 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:14.381 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:14.381 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4159", 2024-04-19T03:02:14.382 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3589238956", 2024-04-19T03:02:14.382 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 188 2024-04-19T03:02:14.382 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.382 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:14.382 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.382 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:14.382 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.539135+0000", 2024-04-19T03:02:14.382 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:14.382 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.382 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.382 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:14.382 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.539135+0000", 2024-04-19T03:02:14.382 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:14.383 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.383 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.383 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:14.383 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.539134+0000", 2024-04-19T03:02:14.383 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:14.383 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.383 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.383 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:14.383 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.539228+0000", 2024-04-19T03:02:14.383 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.3771999999999996e-05 2024-04-19T03:02:14.383 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.383 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.383 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:14.383 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.539243+0000", 2024-04-19T03:02:14.384 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4707e-05 2024-04-19T03:02:14.384 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.384 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.384 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:14.384 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.539250+0000", 2024-04-19T03:02:14.384 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7190000000000001e-06 2024-04-19T03:02:14.384 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.384 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.384 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:14.384 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.553787+0000", 2024-04-19T03:02:14.384 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.014536248999999999 2024-04-19T03:02:14.384 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.384 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.384 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:14.385 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.553857+0000", 2024-04-19T03:02:14.385 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0675999999999999e-05 2024-04-19T03:02:14.385 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.385 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.385 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:02:14.385 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.553953+0000", 2024-04-19T03:02:14.385 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.5420999999999993e-05 2024-04-19T03:02:14.385 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.385 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.385 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:14.385 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.555569+0000", 2024-04-19T03:02:14.385 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001616625 2024-04-19T03:02:14.385 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.385 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.386 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:14.386 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.560644+0000", 2024-04-19T03:02:14.386 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0050749660000000002 2024-04-19T03:02:14.386 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.386 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.386 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:14.386 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.560690+0000", 2024-04-19T03:02:14.386 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6041000000000002e-05 2024-04-19T03:02:14.386 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.386 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.386 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:14.386 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.560726+0000", 2024-04-19T03:02:14.386 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5188999999999998e-05 2024-04-19T03:02:14.386 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:14.387 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:14.387 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:14.387 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.387 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.387 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4159.0:189 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e13)", 2024-04-19T03:02:14.387 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:01:08.539259+0000", 2024-04-19T03:02:14.387 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 65.826021694000005, 2024-04-19T03:02:14.387 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.021552071999999999, 2024-04-19T03:02:14.387 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:14.387 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:14.387 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:14.387 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4159", 2024-04-19T03:02:14.387 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3589238956", 2024-04-19T03:02:14.387 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 189 2024-04-19T03:02:14.388 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.388 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:14.388 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.388 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:14.388 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.539259+0000", 2024-04-19T03:02:14.388 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:14.388 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.388 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.388 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:14.388 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.539259+0000", 2024-04-19T03:02:14.388 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:14.388 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.388 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.388 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:14.389 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.539259+0000", 2024-04-19T03:02:14.389 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:14.389 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.389 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.389 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:14.389 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.539268+0000", 2024-04-19T03:02:14.389 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.5359999999999998e-06 2024-04-19T03:02:14.389 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.389 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.389 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:14.389 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.539291+0000", 2024-04-19T03:02:14.389 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2687000000000001e-05 2024-04-19T03:02:14.389 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.390 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.390 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:14.390 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.539298+0000", 2024-04-19T03:02:14.390 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.883e-06 2024-04-19T03:02:14.390 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.390 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.390 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:14.390 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.554957+0000", 2024-04-19T03:02:14.390 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.015659019999999999 2024-04-19T03:02:14.390 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.390 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.390 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:14.390 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.555010+0000", 2024-04-19T03:02:14.391 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2985999999999997e-05 2024-04-19T03:02:14.391 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.391 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.391 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:02:14.391 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.555094+0000", 2024-04-19T03:02:14.391 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4530000000000006e-05 2024-04-19T03:02:14.391 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.391 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.391 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:14.391 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.556093+0000", 2024-04-19T03:02:14.391 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00099903300000000008 2024-04-19T03:02:14.391 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.391 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.391 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:14.391 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.560759+0000", 2024-04-19T03:02:14.392 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0046654369999999997 2024-04-19T03:02:14.392 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.392 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.392 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:14.392 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.560789+0000", 2024-04-19T03:02:14.392 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0638e-05 2024-04-19T03:02:14.392 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.392 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.392 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:14.392 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:08.560811+0000", 2024-04-19T03:02:14.392 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2167999999999998e-05 2024-04-19T03:02:14.392 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:14.392 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:14.392 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:14.392 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.393 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.393 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:8 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:02:14.393 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:01:14.998165+0000", 2024-04-19T03:02:14.393 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 59.367116013, 2024-04-19T03:02:14.393 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.024541001, 2024-04-19T03:02:14.393 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:14.393 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:14.393 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:14.393 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.393 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:14.393 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998165+0000", 2024-04-19T03:02:14.393 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:14.393 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.393 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.394 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:14.394 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998165+0000", 2024-04-19T03:02:14.394 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:14.394 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.394 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.394 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:14.394 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998164+0000", 2024-04-19T03:02:14.394 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:14.394 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.394 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.394 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:14.394 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998170+0000", 2024-04-19T03:02:14.394 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2939999999999996e-06 2024-04-19T03:02:14.395 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.395 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.395 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:14.395 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998179+0000", 2024-04-19T03:02:14.395 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.5540000000000003e-06 2024-04-19T03:02:14.395 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.395 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.395 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:14.395 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998188+0000", 2024-04-19T03:02:14.395 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2959999999999999e-06 2024-04-19T03:02:14.396 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.396 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.396 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:14.396 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998332+0000", 2024-04-19T03:02:14.396 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00014474 2024-04-19T03:02:14.396 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.396 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.396 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:02:14.396 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998337+0000", 2024-04-19T03:02:14.396 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6909999999999996e-06 2024-04-19T03:02:14.396 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.396 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.396 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:14.396 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.010222+0000", 2024-04-19T03:02:14.397 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011885178 2024-04-19T03:02:14.397 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.397 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.397 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:14.397 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.010342+0000", 2024-04-19T03:02:14.397 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00011991500000000001 2024-04-19T03:02:14.397 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.397 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.397 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:02:14.397 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.010506+0000", 2024-04-19T03:02:14.397 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00016429699999999999 2024-04-19T03:02:14.397 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.397 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.397 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:14.398 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.014525+0000", 2024-04-19T03:02:14.398 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0040189839999999998 2024-04-19T03:02:14.398 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.398 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.398 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:14.398 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.022600+0000", 2024-04-19T03:02:14.398 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0080741990000000007 2024-04-19T03:02:14.398 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.398 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.398 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:14.398 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.022670+0000", 2024-04-19T03:02:14.398 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0743999999999999e-05 2024-04-19T03:02:14.398 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.398 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.399 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:14.399 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.022706+0000", 2024-04-19T03:02:14.399 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5782999999999999e-05 2024-04-19T03:02:14.399 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:14.399 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:14.399 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:14.399 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.399 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.399 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:27 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:02:14.399 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:01:14.998436+0000", 2024-04-19T03:02:14.399 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 59.366845359000003, 2024-04-19T03:02:14.399 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.024406325999999999, 2024-04-19T03:02:14.399 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:14.399 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:14.400 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:14.400 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.400 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:14.400 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998436+0000", 2024-04-19T03:02:14.400 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:14.400 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.400 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.400 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:14.400 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998436+0000", 2024-04-19T03:02:14.400 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:14.400 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.400 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.401 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:14.401 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998435+0000", 2024-04-19T03:02:14.401 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:14.401 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.401 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.401 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:14.401 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998445+0000", 2024-04-19T03:02:14.401 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0349e-05 2024-04-19T03:02:14.401 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.401 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.401 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:14.401 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998453+0000", 2024-04-19T03:02:14.401 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0399999999999993e-06 2024-04-19T03:02:14.402 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.402 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.402 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:14.402 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998461+0000", 2024-04-19T03:02:14.402 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9780000000000005e-06 2024-04-19T03:02:14.402 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.402 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.402 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:14.402 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998515+0000", 2024-04-19T03:02:14.402 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3097999999999999e-05 2024-04-19T03:02:14.402 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.402 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.402 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:02:14.403 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998520+0000", 2024-04-19T03:02:14.403 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9220000000000002e-06 2024-04-19T03:02:14.403 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.403 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.403 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:14.403 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.011258+0000", 2024-04-19T03:02:14.403 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.012737735 2024-04-19T03:02:14.403 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.403 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.403 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:14.403 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.011566+0000", 2024-04-19T03:02:14.403 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00030826200000000001 2024-04-19T03:02:14.403 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.403 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.404 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:02:14.404 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.011996+0000", 2024-04-19T03:02:14.404 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00042912000000000001 2024-04-19T03:02:14.404 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.404 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.404 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:14.404 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.014533+0000", 2024-04-19T03:02:14.404 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.002537423 2024-04-19T03:02:14.404 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.404 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.404 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:14.404 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.022756+0000", 2024-04-19T03:02:14.404 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0082231530000000004 2024-04-19T03:02:14.404 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.405 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.405 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:14.405 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.022807+0000", 2024-04-19T03:02:14.405 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0852e-05 2024-04-19T03:02:14.405 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.405 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.405 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:14.405 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.022842+0000", 2024-04-19T03:02:14.405 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5058000000000002e-05 2024-04-19T03:02:14.405 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:14.405 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:14.405 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:14.405 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.405 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.406 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:28 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:02:14.406 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:01:14.998476+0000", 2024-04-19T03:02:14.406 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 59.366805436999996, 2024-04-19T03:02:14.406 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.024656784000000001, 2024-04-19T03:02:14.406 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:14.406 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:14.406 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:14.406 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.406 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:14.406 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998476+0000", 2024-04-19T03:02:14.407 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:14.407 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.407 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.407 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:14.407 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998476+0000", 2024-04-19T03:02:14.407 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:14.407 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.407 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.407 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:14.407 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998475+0000", 2024-04-19T03:02:14.407 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:14.407 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.407 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.407 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:14.407 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998484+0000", 2024-04-19T03:02:14.408 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.7770000000000008e-06 2024-04-19T03:02:14.408 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.408 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.408 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:14.408 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998495+0000", 2024-04-19T03:02:14.408 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0726e-05 2024-04-19T03:02:14.408 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.408 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.408 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:14.408 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998503+0000", 2024-04-19T03:02:14.408 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.8780000000000004e-06 2024-04-19T03:02:14.408 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.408 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.408 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:14.409 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998579+0000", 2024-04-19T03:02:14.409 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5160999999999994e-05 2024-04-19T03:02:14.409 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.409 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.409 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:02:14.409 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998586+0000", 2024-04-19T03:02:14.409 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8520000000000004e-06 2024-04-19T03:02:14.409 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.409 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.409 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:14.409 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.012423+0000", 2024-04-19T03:02:14.409 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.013836667 2024-04-19T03:02:14.409 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.409 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.410 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:14.410 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.012532+0000", 2024-04-19T03:02:14.410 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000108565 2024-04-19T03:02:14.410 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.410 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.410 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:02:14.410 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.012655+0000", 2024-04-19T03:02:14.410 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00012344600000000001 2024-04-19T03:02:14.410 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.410 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.410 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:14.410 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.015680+0000", 2024-04-19T03:02:14.410 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0030246470000000001 2024-04-19T03:02:14.411 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.411 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.411 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:14.411 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.023091+0000", 2024-04-19T03:02:14.411 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0074116030000000001 2024-04-19T03:02:14.411 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.411 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.411 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:14.411 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.023115+0000", 2024-04-19T03:02:14.411 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.3091999999999998e-05 2024-04-19T03:02:14.411 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.411 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.411 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:14.412 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.023132+0000", 2024-04-19T03:02:14.412 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7901999999999999e-05 2024-04-19T03:02:14.412 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:14.412 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:14.412 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:14.412 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.412 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.412 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:29 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:02:14.412 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:01:14.998527+0000", 2024-04-19T03:02:14.412 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 59.366753897000002, 2024-04-19T03:02:14.412 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.024738599999999999, 2024-04-19T03:02:14.412 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:14.412 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:14.412 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:14.413 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.413 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:14.413 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998527+0000", 2024-04-19T03:02:14.413 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:14.413 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.413 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.413 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:14.413 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998527+0000", 2024-04-19T03:02:14.413 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:14.413 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.413 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.413 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:14.413 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998527+0000", 2024-04-19T03:02:14.413 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:14.414 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.414 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.414 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:14.414 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998531+0000", 2024-04-19T03:02:14.414 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9450000000000001e-06 2024-04-19T03:02:14.414 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.414 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.414 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:14.414 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998541+0000", 2024-04-19T03:02:14.414 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.4320000000000005e-06 2024-04-19T03:02:14.414 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.414 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.414 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:14.414 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998548+0000", 2024-04-19T03:02:14.415 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.221e-06 2024-04-19T03:02:14.415 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.415 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.415 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:14.415 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998620+0000", 2024-04-19T03:02:14.415 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.1676999999999998e-05 2024-04-19T03:02:14.415 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.415 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.415 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:02:14.415 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998624+0000", 2024-04-19T03:02:14.415 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4850000000000003e-06 2024-04-19T03:02:14.415 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.415 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.415 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:14.416 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.013261+0000", 2024-04-19T03:02:14.416 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.014636451999999999 2024-04-19T03:02:14.416 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.416 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.416 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:14.416 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.013364+0000", 2024-04-19T03:02:14.416 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000102885 2024-04-19T03:02:14.416 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.416 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.416 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:02:14.416 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.013481+0000", 2024-04-19T03:02:14.416 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00011783299999999999 2024-04-19T03:02:14.416 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.416 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.417 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:14.417 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.016265+0000", 2024-04-19T03:02:14.417 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0027834539999999999 2024-04-19T03:02:14.417 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.417 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.417 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:14.417 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.023180+0000", 2024-04-19T03:02:14.417 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0069149399999999996 2024-04-19T03:02:14.417 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.417 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.417 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:14.417 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.023230+0000", 2024-04-19T03:02:14.417 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0220999999999999e-05 2024-04-19T03:02:14.417 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.418 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.418 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:14.418 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.023266+0000", 2024-04-19T03:02:14.418 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5703e-05 2024-04-19T03:02:14.418 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:14.418 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:14.418 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:14.418 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.418 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.418 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:30 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:02:14.418 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:01:14.998577+0000", 2024-04-19T03:02:14.418 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 59.366703790000003, 2024-04-19T03:02:14.418 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.024774022999999999, 2024-04-19T03:02:14.419 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:14.419 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:14.419 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:14.419 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.419 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:14.419 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998577+0000", 2024-04-19T03:02:14.419 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:14.419 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.419 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.419 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:14.419 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998577+0000", 2024-04-19T03:02:14.419 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:14.419 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.420 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.420 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:14.420 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998576+0000", 2024-04-19T03:02:14.420 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:14.420 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.420 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.420 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:14.420 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998583+0000", 2024-04-19T03:02:14.420 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8850000000000001e-06 2024-04-19T03:02:14.420 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.420 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.420 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:14.420 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998597+0000", 2024-04-19T03:02:14.420 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.362e-05 2024-04-19T03:02:14.421 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.421 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.421 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:14.421 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998607+0000", 2024-04-19T03:02:14.421 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0389e-05 2024-04-19T03:02:14.421 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.421 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.421 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:14.421 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998713+0000", 2024-04-19T03:02:14.421 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000105338 2024-04-19T03:02:14.421 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.421 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.421 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:02:14.421 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998720+0000", 2024-04-19T03:02:14.422 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2370000000000003e-06 2024-04-19T03:02:14.422 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.422 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.422 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:14.422 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.014014+0000", 2024-04-19T03:02:14.422 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.015294116999999999 2024-04-19T03:02:14.423 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.423 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.423 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:14.423 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.014091+0000", 2024-04-19T03:02:14.423 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7148000000000001e-05 2024-04-19T03:02:14.423 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.423 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.423 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:02:14.423 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.014271+0000", 2024-04-19T03:02:14.423 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00017962699999999999 2024-04-19T03:02:14.423 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.423 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.423 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:14.423 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.018024+0000", 2024-04-19T03:02:14.424 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0037529809999999999 2024-04-19T03:02:14.424 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.424 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.424 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:14.424 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.023303+0000", 2024-04-19T03:02:14.424 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0052793099999999997 2024-04-19T03:02:14.424 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.424 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.424 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:14.424 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.023331+0000", 2024-04-19T03:02:14.424 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.8013000000000001e-05 2024-04-19T03:02:14.424 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.424 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.424 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:14.425 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.023351+0000", 2024-04-19T03:02:14.425 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0225999999999999e-05 2024-04-19T03:02:14.425 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:14.425 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:14.425 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:14.425 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.425 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.425 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:33 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:02:14.425 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:01:14.998625+0000", 2024-04-19T03:02:14.425 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 59.366656393, 2024-04-19T03:02:14.425 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.024007338999999999, 2024-04-19T03:02:14.425 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:14.425 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:14.426 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:14.426 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.426 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:14.426 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998625+0000", 2024-04-19T03:02:14.426 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:14.426 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.426 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.426 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:14.426 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998625+0000", 2024-04-19T03:02:14.426 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:14.426 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.426 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.426 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:14.426 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998623+0000", 2024-04-19T03:02:14.427 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:14.427 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.427 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.427 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:14.427 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998632+0000", 2024-04-19T03:02:14.427 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9279999999999999e-06 2024-04-19T03:02:14.427 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.427 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.427 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:14.427 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998642+0000", 2024-04-19T03:02:14.427 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0063e-05 2024-04-19T03:02:14.427 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.427 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.428 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:14.428 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998649+0000", 2024-04-19T03:02:14.428 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4799999999999998e-06 2024-04-19T03:02:14.428 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.428 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.428 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:14.428 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998730+0000", 2024-04-19T03:02:14.428 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.1514999999999995e-05 2024-04-19T03:02:14.428 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.428 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.428 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:02:14.428 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998741+0000", 2024-04-19T03:02:14.428 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1029999999999999e-05 2024-04-19T03:02:14.428 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.429 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.429 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:14.429 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.010202+0000", 2024-04-19T03:02:14.429 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011460529000000001 2024-04-19T03:02:14.429 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.429 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.429 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:14.429 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.010292+0000", 2024-04-19T03:02:14.429 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.0382000000000003e-05 2024-04-19T03:02:14.429 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.429 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.429 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:02:14.429 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.010391+0000", 2024-04-19T03:02:14.429 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.8491000000000003e-05 2024-04-19T03:02:14.430 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.430 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.430 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:14.430 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.013800+0000", 2024-04-19T03:02:14.430 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0034090219999999998 2024-04-19T03:02:14.430 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.430 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.430 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:14.430 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.022564+0000", 2024-04-19T03:02:14.430 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0087639950000000001 2024-04-19T03:02:14.430 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.430 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.430 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:14.430 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.022601+0000", 2024-04-19T03:02:14.431 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7363999999999997e-05 2024-04-19T03:02:14.431 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.431 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.431 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:14.431 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.022632+0000", 2024-04-19T03:02:14.431 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0917000000000002e-05 2024-04-19T03:02:14.431 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:14.431 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:14.431 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:14.431 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.431 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.431 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:02:14.431 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:01:14.998792+0000", 2024-04-19T03:02:14.432 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 59.366489524000002, 2024-04-19T03:02:14.432 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.023951813999999998, 2024-04-19T03:02:14.432 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:14.432 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:14.432 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:14.432 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.432 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:14.432 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998792+0000", 2024-04-19T03:02:14.432 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:14.432 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.432 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.432 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:14.432 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998792+0000", 2024-04-19T03:02:14.432 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:14.432 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.433 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.433 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:14.433 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998791+0000", 2024-04-19T03:02:14.433 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:14.433 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.433 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.433 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:14.433 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998796+0000", 2024-04-19T03:02:14.433 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9649999999999999e-06 2024-04-19T03:02:14.433 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.433 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.433 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:14.433 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998809+0000", 2024-04-19T03:02:14.433 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3254e-05 2024-04-19T03:02:14.434 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.434 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.434 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:14.434 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998816+0000", 2024-04-19T03:02:14.434 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.472e-06 2024-04-19T03:02:14.434 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.434 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.434 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:14.434 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998899+0000", 2024-04-19T03:02:14.434 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.3676000000000003e-05 2024-04-19T03:02:14.434 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.434 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.434 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:02:14.434 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998908+0000", 2024-04-19T03:02:14.435 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6940000000000001e-06 2024-04-19T03:02:14.435 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.435 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.435 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:14.435 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.010818+0000", 2024-04-19T03:02:14.435 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011910482999999999 2024-04-19T03:02:14.435 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.435 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.435 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:14.435 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.010959+0000", 2024-04-19T03:02:14.435 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00014018900000000001 2024-04-19T03:02:14.435 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.435 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.435 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:02:14.436 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.011185+0000", 2024-04-19T03:02:14.436 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000226085 2024-04-19T03:02:14.436 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.436 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.436 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:14.436 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.014479+0000", 2024-04-19T03:02:14.436 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0032938260000000001 2024-04-19T03:02:14.436 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.436 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.436 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:14.436 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.022697+0000", 2024-04-19T03:02:14.436 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0082186029999999997 2024-04-19T03:02:14.436 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.436 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.437 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:14.437 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.022724+0000", 2024-04-19T03:02:14.437 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.6503999999999999e-05 2024-04-19T03:02:14.437 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.437 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.437 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:14.437 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.022743+0000", 2024-04-19T03:02:14.437 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9663000000000001e-05 2024-04-19T03:02:14.437 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:14.437 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:14.437 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:14.437 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.437 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.437 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:02:14.438 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:01:14.998870+0000", 2024-04-19T03:02:14.438 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 59.366411323000001, 2024-04-19T03:02:14.438 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.024280578000000001, 2024-04-19T03:02:14.438 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:14.438 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:14.438 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:14.438 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.438 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:14.438 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998870+0000", 2024-04-19T03:02:14.438 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:14.438 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.438 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.438 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:14.439 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998870+0000", 2024-04-19T03:02:14.439 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:14.439 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.439 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.439 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:14.439 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998869+0000", 2024-04-19T03:02:14.439 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:14.439 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.439 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.439 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:14.439 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998879+0000", 2024-04-19T03:02:14.439 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.8689999999999999e-06 2024-04-19T03:02:14.439 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.439 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.440 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:14.440 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998893+0000", 2024-04-19T03:02:14.440 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4436999999999999e-05 2024-04-19T03:02:14.440 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.440 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.440 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:14.440 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998904+0000", 2024-04-19T03:02:14.440 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0657e-05 2024-04-19T03:02:14.440 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.440 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.440 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:14.440 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998972+0000", 2024-04-19T03:02:14.440 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8121999999999996e-05 2024-04-19T03:02:14.441 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.441 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.441 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:02:14.441 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998980+0000", 2024-04-19T03:02:14.441 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7170000000000008e-06 2024-04-19T03:02:14.441 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.441 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.441 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:14.441 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.011666+0000", 2024-04-19T03:02:14.441 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.012686507 2024-04-19T03:02:14.441 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.441 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.441 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:14.441 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.012403+0000", 2024-04-19T03:02:14.442 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00073661899999999999 2024-04-19T03:02:14.442 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.442 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.442 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:02:14.442 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.012788+0000", 2024-04-19T03:02:14.442 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00038495800000000002 2024-04-19T03:02:14.442 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.442 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.442 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:14.442 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.015713+0000", 2024-04-19T03:02:14.442 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0029255879999999998 2024-04-19T03:02:14.442 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.442 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.443 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:14.443 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.023066+0000", 2024-04-19T03:02:14.443 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.007352903 2024-04-19T03:02:14.443 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.443 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.443 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:14.443 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.023113+0000", 2024-04-19T03:02:14.443 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7163000000000002e-05 2024-04-19T03:02:14.443 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.443 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.443 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:14.443 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.023150+0000", 2024-04-19T03:02:14.443 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6881000000000001e-05 2024-04-19T03:02:14.443 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:14.444 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:14.444 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:14.444 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.444 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.444 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:20 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:02:14.444 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:01:14.999024+0000", 2024-04-19T03:02:14.444 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 59.366257050999998, 2024-04-19T03:02:14.444 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.024212818000000001, 2024-04-19T03:02:14.444 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:14.444 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-04-19T03:02:14.444 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:14.444 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.444 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:14.444 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.999024+0000", 2024-04-19T03:02:14.445 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:14.445 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.445 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.445 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:14.445 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.999024+0000", 2024-04-19T03:02:14.445 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:14.445 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.445 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.445 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:14.445 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.999023+0000", 2024-04-19T03:02:14.445 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:14.445 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.445 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.446 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:14.446 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.999029+0000", 2024-04-19T03:02:14.446 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2709999999999998e-06 2024-04-19T03:02:14.446 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.446 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.446 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:14.446 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.999045+0000", 2024-04-19T03:02:14.446 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.5840000000000001e-05 2024-04-19T03:02:14.446 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.446 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.446 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:14.446 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.999057+0000", 2024-04-19T03:02:14.446 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1897e-05 2024-04-19T03:02:14.447 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.447 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.447 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:14.447 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.999136+0000", 2024-04-19T03:02:14.447 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8842000000000002e-05 2024-04-19T03:02:14.447 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.447 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.447 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:02:14.447 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.999144+0000", 2024-04-19T03:02:14.447 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.3110000000000006e-06 2024-04-19T03:02:14.447 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.447 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.447 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:14.447 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.013338+0000", 2024-04-19T03:02:14.448 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.014194217 2024-04-19T03:02:14.448 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.448 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.448 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:14.448 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.013485+0000", 2024-04-19T03:02:14.448 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000146787 2024-04-19T03:02:14.448 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.448 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.448 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:14.448 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.023237+0000", 2024-04-19T03:02:14.448 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0097517899999999998 2024-04-19T03:02:14.448 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:14.448 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:14.448 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:14.449 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.449 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.449 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:11289 5.7 5:e1ea82b1:::benchmark_data_smithi096_19531_object11288:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T03:02:14.449 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:01:42.068678+0000", 2024-04-19T03:02:14.449 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 32.296602831000001, 2024-04-19T03:02:14.449 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.022027980999999999, 2024-04-19T03:02:14.449 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:14.449 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:14.449 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:14.449 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:14.449 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:14.449 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 11289 2024-04-19T03:02:14.449 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.449 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:14.450 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.450 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:14.450 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:42.068678+0000", 2024-04-19T03:02:14.450 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:14.450 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.450 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.450 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:14.450 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:42.068678+0000", 2024-04-19T03:02:14.450 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:14.450 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.450 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.450 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:14.450 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:42.068677+0000", 2024-04-19T03:02:14.451 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:14.451 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.451 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.451 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:14.451 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:42.068721+0000", 2024-04-19T03:02:14.451 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3714000000000002e-05 2024-04-19T03:02:14.451 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.451 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.451 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:14.451 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:42.068728+0000", 2024-04-19T03:02:14.451 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0029999999999997e-06 2024-04-19T03:02:14.451 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.451 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.451 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:14.452 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:42.068733+0000", 2024-04-19T03:02:14.452 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0100000000000003e-06 2024-04-19T03:02:14.452 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.452 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.452 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:14.452 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:42.068820+0000", 2024-04-19T03:02:14.452 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.653e-05 2024-04-19T03:02:14.452 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.452 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.452 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:14.452 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:42.068990+0000", 2024-04-19T03:02:14.452 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00017046800000000001 2024-04-19T03:02:14.452 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.452 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.453 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:14.453 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:42.069140+0000", 2024-04-19T03:02:14.453 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00015001000000000001 2024-04-19T03:02:14.453 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.453 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.453 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:14.453 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:42.074573+0000", 2024-04-19T03:02:14.453 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0054326979999999997 2024-04-19T03:02:14.453 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.453 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.453 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:14.453 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:42.090534+0000", 2024-04-19T03:02:14.453 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.015961300000000001 2024-04-19T03:02:14.454 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.454 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.454 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:14.454 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:42.090619+0000", 2024-04-19T03:02:14.454 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4536999999999994e-05 2024-04-19T03:02:14.454 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.454 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.454 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:14.454 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:42.090706+0000", 2024-04-19T03:02:14.454 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.7643000000000001e-05 2024-04-19T03:02:14.454 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:14.454 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:14.454 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:14.454 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.455 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.455 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:50122 5.9 5:9d1c74f3:::benchmark_data_smithi096_19531_object50121:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-19T03:02:14.455 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:00.084949+0000", 2024-04-19T03:02:14.455 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 14.280332413, 2024-04-19T03:02:14.455 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.023564486999999999, 2024-04-19T03:02:14.455 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:14.455 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:14.455 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:14.455 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:14.455 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:14.455 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 50122 2024-04-19T03:02:14.455 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.455 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:14.456 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.456 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:14.456 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:00.084949+0000", 2024-04-19T03:02:14.456 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:14.456 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.456 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.456 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:14.456 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:00.084949+0000", 2024-04-19T03:02:14.456 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:14.456 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.456 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.456 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:14.456 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:00.084948+0000", 2024-04-19T03:02:14.456 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:14.457 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.457 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.457 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:14.457 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:00.084983+0000", 2024-04-19T03:02:14.457 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4322000000000001e-05 2024-04-19T03:02:14.457 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.457 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.457 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:14.457 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:00.084992+0000", 2024-04-19T03:02:14.457 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.0180000000000007e-06 2024-04-19T03:02:14.457 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.457 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.457 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:14.457 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:00.085000+0000", 2024-04-19T03:02:14.458 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.7609999999999996e-06 2024-04-19T03:02:14.458 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.458 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.458 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:14.458 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:00.093379+0000", 2024-04-19T03:02:14.458 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0083790819999999995 2024-04-19T03:02:14.458 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.458 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.458 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:14.458 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:00.093555+0000", 2024-04-19T03:02:14.458 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00017582900000000001 2024-04-19T03:02:14.458 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.458 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.459 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:02:14.459 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:00.093735+0000", 2024-04-19T03:02:14.459 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00018006399999999999 2024-04-19T03:02:14.459 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.459 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.459 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:14.459 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:00.104665+0000", 2024-04-19T03:02:14.459 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.010929259 2024-04-19T03:02:14.459 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.459 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.459 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:14.459 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:00.108415+0000", 2024-04-19T03:02:14.459 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0037506610000000002 2024-04-19T03:02:14.459 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.459 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.459 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:14.460 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:00.108474+0000", 2024-04-19T03:02:14.460 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8551000000000002e-05 2024-04-19T03:02:14.460 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.460 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.460 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:14.460 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:00.108513+0000", 2024-04-19T03:02:14.460 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9307000000000002e-05 2024-04-19T03:02:14.460 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:14.460 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:14.460 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:14.460 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.460 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.460 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:50123 5.9 5:98d55939:::benchmark_data_smithi096_19531_object50122:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-19T03:02:14.460 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:00.087166+0000", 2024-04-19T03:02:14.460 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 14.278114967, 2024-04-19T03:02:14.461 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.021482022999999999, 2024-04-19T03:02:14.461 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:14.461 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:14.461 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:14.461 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:14.461 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:14.461 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 50123 2024-04-19T03:02:14.461 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.461 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:14.461 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.461 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:14.461 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:00.087166+0000", 2024-04-19T03:02:14.461 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:14.461 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.462 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.462 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:14.462 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:00.087166+0000", 2024-04-19T03:02:14.462 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:14.462 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.462 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.462 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:14.462 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:00.087165+0000", 2024-04-19T03:02:14.462 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:14.462 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.462 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.462 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:14.462 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:00.087253+0000", 2024-04-19T03:02:14.463 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.8466000000000003e-05 2024-04-19T03:02:14.463 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.463 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.463 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:14.463 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:00.087271+0000", 2024-04-19T03:02:14.463 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8063999999999998e-05 2024-04-19T03:02:14.463 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.463 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.463 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:14.463 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:00.087280+0000", 2024-04-19T03:02:14.463 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.3930000000000008e-06 2024-04-19T03:02:14.463 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.463 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.463 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:14.464 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:00.096771+0000", 2024-04-19T03:02:14.464 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0094913329999999994 2024-04-19T03:02:14.464 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.464 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.464 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:14.464 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:00.096934+0000", 2024-04-19T03:02:14.464 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00016332900000000001 2024-04-19T03:02:14.464 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.464 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.464 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:02:14.464 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:00.097058+0000", 2024-04-19T03:02:14.464 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000123798 2024-04-19T03:02:14.464 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.464 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.464 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:14.465 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:00.104674+0000", 2024-04-19T03:02:14.465 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0076159900000000004 2024-04-19T03:02:14.465 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.465 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.465 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:14.465 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:00.108563+0000", 2024-04-19T03:02:14.465 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0038890029999999998 2024-04-19T03:02:14.465 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.465 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.465 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:14.465 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:00.108603+0000", 2024-04-19T03:02:14.465 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9610000000000002e-05 2024-04-19T03:02:14.465 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.465 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.466 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:14.466 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:00.108648+0000", 2024-04-19T03:02:14.466 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5361999999999997e-05 2024-04-19T03:02:14.466 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:14.466 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:14.466 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:14.466 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.466 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.466 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:50128 5.9 5:9467072a:::benchmark_data_smithi096_19531_object50127:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-19T03:02:14.466 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:00.087808+0000", 2024-04-19T03:02:14.466 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 14.277473235, 2024-04-19T03:02:14.466 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.020989109999999998, 2024-04-19T03:02:14.467 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:14.467 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:14.467 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:14.467 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:14.467 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:14.467 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 50128 2024-04-19T03:02:14.467 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.467 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:14.467 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.467 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:14.467 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:00.087808+0000", 2024-04-19T03:02:14.467 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:14.467 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.467 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.468 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:14.468 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:00.087808+0000", 2024-04-19T03:02:14.468 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:14.468 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.468 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.468 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:14.468 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:00.087807+0000", 2024-04-19T03:02:14.468 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:14.468 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.468 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.468 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:14.468 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:00.087898+0000", 2024-04-19T03:02:14.468 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.0927000000000005e-05 2024-04-19T03:02:14.468 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.468 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.469 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:14.469 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:00.087911+0000", 2024-04-19T03:02:14.469 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3380000000000001e-05 2024-04-19T03:02:14.469 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.469 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.469 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:14.469 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:00.087917+0000", 2024-04-19T03:02:14.469 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2190000000000001e-06 2024-04-19T03:02:14.469 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.469 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.469 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:14.469 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:00.098878+0000", 2024-04-19T03:02:14.469 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.010960642 2024-04-19T03:02:14.469 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.470 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.470 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:14.470 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:00.099020+0000", 2024-04-19T03:02:14.470 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000142037 2024-04-19T03:02:14.470 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.470 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.470 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:02:14.470 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:00.099118+0000", 2024-04-19T03:02:14.470 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.8066999999999995e-05 2024-04-19T03:02:14.470 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.470 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.470 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:14.470 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:00.104682+0000", 2024-04-19T03:02:14.470 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0055638889999999998 2024-04-19T03:02:14.471 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.471 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.471 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:14.471 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:00.108707+0000", 2024-04-19T03:02:14.471 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0040252359999999997 2024-04-19T03:02:14.471 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.471 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.471 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:14.471 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:00.108763+0000", 2024-04-19T03:02:14.471 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5822999999999997e-05 2024-04-19T03:02:14.471 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.471 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.471 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:14.471 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:00.108797+0000", 2024-04-19T03:02:14.472 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3754999999999998e-05 2024-04-19T03:02:14.472 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:14.472 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:14.472 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:14.472 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.472 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.472 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:58199 5.1 5:8d6d5536:::benchmark_data_smithi096_19531_object58198:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-19T03:02:14.472 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:04.610309+0000", 2024-04-19T03:02:14.472 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 9.7549721490000003, 2024-04-19T03:02:14.472 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.021489214999999999, 2024-04-19T03:02:14.472 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:14.472 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:14.472 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:14.472 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:14.472 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:14.473 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 58199 2024-04-19T03:02:14.473 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.473 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:14.473 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.473 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:14.473 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:04.610309+0000", 2024-04-19T03:02:14.473 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:14.473 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.473 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.473 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:14.473 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:04.610309+0000", 2024-04-19T03:02:14.473 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:14.473 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.473 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.473 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:14.474 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:04.610309+0000", 2024-04-19T03:02:14.474 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:14.474 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.474 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.474 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:14.474 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:04.610338+0000", 2024-04-19T03:02:14.474 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9564e-05 2024-04-19T03:02:14.474 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.474 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.474 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:14.474 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:04.610344+0000", 2024-04-19T03:02:14.474 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4920000000000001e-06 2024-04-19T03:02:14.474 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.474 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.475 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:14.475 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:04.610348+0000", 2024-04-19T03:02:14.475 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5360000000000003e-06 2024-04-19T03:02:14.475 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.475 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.475 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:14.475 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:04.621218+0000", 2024-04-19T03:02:14.475 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.010869431000000001 2024-04-19T03:02:14.475 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.475 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.475 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:14.475 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:04.621404+0000", 2024-04-19T03:02:14.475 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00018601800000000001 2024-04-19T03:02:14.475 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.476 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.476 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:14.476 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:04.621566+0000", 2024-04-19T03:02:14.476 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00016204199999999999 2024-04-19T03:02:14.476 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.476 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.476 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:14.476 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:04.625888+0000", 2024-04-19T03:02:14.476 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0043228820000000001 2024-04-19T03:02:14.476 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.476 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.476 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:14.476 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:04.631720+0000", 2024-04-19T03:02:14.476 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0058311049999999996 2024-04-19T03:02:14.477 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.477 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.477 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:14.477 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:04.631772+0000", 2024-04-19T03:02:14.477 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2064999999999997e-05 2024-04-19T03:02:14.477 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.477 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.477 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:14.477 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:04.631798+0000", 2024-04-19T03:02:14.477 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.6480999999999999e-05 2024-04-19T03:02:14.477 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:14.477 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:14.477 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:14.477 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.477 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.478 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:60712 5.2 5:4a2144fe:::benchmark_data_smithi096_19531_object60711:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-19T03:02:14.478 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:06.065544+0000", 2024-04-19T03:02:14.478 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 8.2997373010000004, 2024-04-19T03:02:14.478 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.022207441000000001, 2024-04-19T03:02:14.478 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:14.478 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:14.478 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:14.478 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:14.478 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:14.478 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 60712 2024-04-19T03:02:14.478 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.478 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:14.478 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.478 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:14.479 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:06.065544+0000", 2024-04-19T03:02:14.479 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:14.479 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.479 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.479 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:14.479 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:06.065544+0000", 2024-04-19T03:02:14.479 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:14.479 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.479 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.479 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:14.479 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:06.065543+0000", 2024-04-19T03:02:14.479 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:14.479 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.479 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.480 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:14.480 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:06.065590+0000", 2024-04-19T03:02:14.480 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.723e-05 2024-04-19T03:02:14.480 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.480 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.480 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:14.480 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:06.065605+0000", 2024-04-19T03:02:14.480 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4158999999999999e-05 2024-04-19T03:02:14.480 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.480 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.480 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:14.480 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:06.065612+0000", 2024-04-19T03:02:14.480 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4660000000000002e-06 2024-04-19T03:02:14.480 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.481 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.481 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:14.481 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:06.076435+0000", 2024-04-19T03:02:14.481 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.010822890999999999 2024-04-19T03:02:14.481 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.481 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.481 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:14.481 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:06.076549+0000", 2024-04-19T03:02:14.481 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000114061 2024-04-19T03:02:14.481 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.481 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.481 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:14.481 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:06.076628+0000", 2024-04-19T03:02:14.481 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8696999999999995e-05 2024-04-19T03:02:14.481 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.482 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.482 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:14.482 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:06.085249+0000", 2024-04-19T03:02:14.482 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00862162 2024-04-19T03:02:14.482 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.482 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.482 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:14.482 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:06.087686+0000", 2024-04-19T03:02:14.482 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0024364759999999999 2024-04-19T03:02:14.482 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.482 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.482 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:14.482 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:06.087725+0000", 2024-04-19T03:02:14.483 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9294e-05 2024-04-19T03:02:14.483 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.483 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.483 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:14.483 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:06.087751+0000", 2024-04-19T03:02:14.483 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.6177e-05 2024-04-19T03:02:14.483 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:14.483 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:14.483 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:14.483 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.483 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.483 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:67083 5.7 5:edb9e4d7:::benchmark_data_smithi096_19531_object67082:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T03:02:14.483 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:09.832836+0000", 2024-04-19T03:02:14.483 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4.5324454440000004, 2024-04-19T03:02:14.484 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.022382619999999999, 2024-04-19T03:02:14.484 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:14.484 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:14.484 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:14.484 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:14.484 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:14.484 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 67083 2024-04-19T03:02:14.484 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.484 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:14.484 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.484 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:14.484 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:09.832836+0000", 2024-04-19T03:02:14.484 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:14.484 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.484 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.485 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:14.485 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:09.832836+0000", 2024-04-19T03:02:14.485 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:14.485 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.485 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.485 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:14.485 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:09.832835+0000", 2024-04-19T03:02:14.485 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:14.485 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.485 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.485 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:14.485 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:09.832950+0000", 2024-04-19T03:02:14.485 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000115272 2024-04-19T03:02:14.485 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.486 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.486 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:14.486 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:09.832959+0000", 2024-04-19T03:02:14.486 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4770000000000003e-06 2024-04-19T03:02:14.486 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.486 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.486 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:14.486 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:09.832963+0000", 2024-04-19T03:02:14.486 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6959999999999996e-06 2024-04-19T03:02:14.486 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.486 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.486 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:14.486 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:09.843155+0000", 2024-04-19T03:02:14.486 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.010191518 2024-04-19T03:02:14.487 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.487 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.487 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:14.487 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:09.843271+0000", 2024-04-19T03:02:14.487 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000115958 2024-04-19T03:02:14.487 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.487 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.487 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:14.487 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:09.843400+0000", 2024-04-19T03:02:14.487 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00012901699999999999 2024-04-19T03:02:14.487 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.487 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.487 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:14.487 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:09.854577+0000", 2024-04-19T03:02:14.487 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011177319999999999 2024-04-19T03:02:14.488 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.488 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.488 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:14.488 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:09.855122+0000", 2024-04-19T03:02:14.488 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00054507000000000004 2024-04-19T03:02:14.488 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.488 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.488 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:14.488 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:09.855171+0000", 2024-04-19T03:02:14.488 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9085000000000002e-05 2024-04-19T03:02:14.488 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:14.488 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:14.488 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:14.488 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:09.855218+0000", 2024-04-19T03:02:14.488 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7011000000000001e-05 2024-04-19T03:02:14.489 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:14.489 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:14.489 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:14.489 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:14.489 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:14.489 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-04-19T03:02:14.490 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T03:02:14.491 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-04-19T03:02:14.486+0000 7f35986ab700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18243) UID: 0 2024-04-19T03:02:14.591 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-04-19T03:02:14.590+0000 7f35986ab700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18243) UID: 0 2024-04-19T03:02:14.607 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-04-19T03:02:14.608 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [ 2024-04-19T03:02:14.608 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.608 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4755.0:74403 5.1 5.f3e96581 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-04-19T03:02:14.608 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:02:14.214951+0000", 2024-04-19T03:02:14.608 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 0.39005550100000003, 2024-04-19T03:02:14.608 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.39009442100000002, 2024-04-19T03:02:14.608 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:02:14.608 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "waiting for peered", 2024-04-19T03:02:14.608 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-04-19T03:02:14.608 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4755", 2024-04-19T03:02:14.608 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:14.608 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 74403 2024-04-19T03:02:14.609 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.609 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:02:14.609 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.609 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:02:14.609 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.214951+0000", 2024-04-19T03:02:14.609 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:14.609 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.609 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.609 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:02:14.609 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.214951+0000", 2024-04-19T03:02:14.609 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:14.609 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.610 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.610 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:02:14.610 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.214950+0000", 2024-04-19T03:02:14.610 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2024-04-19T03:02:14.610 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.611 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.611 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:02:14.611 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.215056+0000", 2024-04-19T03:02:14.611 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000105783 2024-04-19T03:02:14.611 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.611 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.611 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:02:14.611 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.215062+0000", 2024-04-19T03:02:14.611 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.28e-06 2024-04-19T03:02:14.611 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.611 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.611 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:02:14.612 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.215066+0000", 2024-04-19T03:02:14.612 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.0430000000000001e-06 2024-04-19T03:02:14.612 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.612 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.612 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:14.612 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.215137+0000", 2024-04-19T03:02:14.612 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.0778999999999994e-05 2024-04-19T03:02:14.612 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.612 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.612 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for peered", 2024-04-19T03:02:14.612 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.215150+0000", 2024-04-19T03:02:14.612 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.3628999999999999e-05 2024-04-19T03:02:14.613 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:14.613 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:02:14.613 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:14.613 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.613 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.613 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4755.0:74373 5.2 5.68f82492 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-04-19T03:02:14.613 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:02:14.192381+0000", 2024-04-19T03:02:14.613 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 0.41262544800000001, 2024-04-19T03:02:14.613 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.41277445800000001, 2024-04-19T03:02:14.613 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:02:14.613 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "waiting for peered", 2024-04-19T03:02:14.613 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-04-19T03:02:14.614 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4755", 2024-04-19T03:02:14.614 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:14.614 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 74373 2024-04-19T03:02:14.614 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.614 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:02:14.614 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.614 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:02:14.614 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.192381+0000", 2024-04-19T03:02:14.614 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:14.614 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.614 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.614 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:02:14.614 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.192381+0000", 2024-04-19T03:02:14.614 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:14.615 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.615 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.615 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:02:14.615 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.192380+0000", 2024-04-19T03:02:14.615 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2024-04-19T03:02:14.615 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.615 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.615 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:02:14.615 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.192435+0000", 2024-04-19T03:02:14.615 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.5247000000000001e-05 2024-04-19T03:02:14.615 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.616 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.616 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:02:14.616 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.192449+0000", 2024-04-19T03:02:14.616 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.3847e-05 2024-04-19T03:02:14.616 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.616 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.616 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:02:14.616 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.192453+0000", 2024-04-19T03:02:14.616 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.5179999999999998e-06 2024-04-19T03:02:14.616 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.616 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.617 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:14.617 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.192486+0000", 2024-04-19T03:02:14.617 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.2889999999999999e-05 2024-04-19T03:02:14.617 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.617 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.617 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for peered", 2024-04-19T03:02:14.617 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.192493+0000", 2024-04-19T03:02:14.617 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.8040000000000004e-06 2024-04-19T03:02:14.617 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:14.617 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:02:14.617 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:14.618 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.618 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.618 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4755.0:74375 5.2 5.bf910142 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-04-19T03:02:14.618 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:02:14.193804+0000", 2024-04-19T03:02:14.618 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 0.411202607, 2024-04-19T03:02:14.618 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.41144528400000002, 2024-04-19T03:02:14.618 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:02:14.618 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "waiting for peered", 2024-04-19T03:02:14.618 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-04-19T03:02:14.618 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4755", 2024-04-19T03:02:14.618 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:14.619 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 74375 2024-04-19T03:02:14.619 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.619 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:02:14.619 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.619 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:02:14.619 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.193804+0000", 2024-04-19T03:02:14.619 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:14.619 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.619 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.619 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:02:14.619 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.193804+0000", 2024-04-19T03:02:14.619 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:14.619 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.620 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.620 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:02:14.620 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.193802+0000", 2024-04-19T03:02:14.620 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2024-04-19T03:02:14.620 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.620 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.620 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:02:14.620 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.193830+0000", 2024-04-19T03:02:14.620 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.7841999999999999e-05 2024-04-19T03:02:14.620 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.620 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.620 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:02:14.620 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.193838+0000", 2024-04-19T03:02:14.621 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.0269999999999995e-06 2024-04-19T03:02:14.621 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.621 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.621 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:02:14.621 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.193845+0000", 2024-04-19T03:02:14.621 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.314e-06 2024-04-19T03:02:14.621 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.621 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.621 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:14.621 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.193905+0000", 2024-04-19T03:02:14.621 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.0367e-05 2024-04-19T03:02:14.621 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.622 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.622 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for peered", 2024-04-19T03:02:14.622 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.193911+0000", 2024-04-19T03:02:14.622 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.0120000000000002e-06 2024-04-19T03:02:14.622 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:14.622 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:02:14.622 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:14.622 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.622 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.622 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4755.0:74378 5.1 5.a68eebb1 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-04-19T03:02:14.622 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:02:14.194149+0000", 2024-04-19T03:02:14.622 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 0.41085751700000001, 2024-04-19T03:02:14.622 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.41119233700000002, 2024-04-19T03:02:14.623 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:02:14.623 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "waiting for peered", 2024-04-19T03:02:14.623 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-04-19T03:02:14.623 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4755", 2024-04-19T03:02:14.623 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:14.623 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 74378 2024-04-19T03:02:14.623 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.623 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:02:14.623 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.623 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:02:14.623 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.194149+0000", 2024-04-19T03:02:14.623 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:14.623 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.623 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.624 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:02:14.624 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.194149+0000", 2024-04-19T03:02:14.624 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:14.624 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.624 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.624 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:02:14.624 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.194148+0000", 2024-04-19T03:02:14.624 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2024-04-19T03:02:14.624 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.624 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.624 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:02:14.624 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.194216+0000", 2024-04-19T03:02:14.624 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.8571999999999993e-05 2024-04-19T03:02:14.624 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.625 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.625 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:02:14.625 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.194228+0000", 2024-04-19T03:02:14.625 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2114e-05 2024-04-19T03:02:14.625 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.625 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.625 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:02:14.625 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.194234+0000", 2024-04-19T03:02:14.625 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.173e-06 2024-04-19T03:02:14.625 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.625 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.625 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:14.625 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.194276+0000", 2024-04-19T03:02:14.626 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.1743999999999999e-05 2024-04-19T03:02:14.626 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.626 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.626 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for peered", 2024-04-19T03:02:14.626 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.194284+0000", 2024-04-19T03:02:14.626 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.1589999999999993e-06 2024-04-19T03:02:14.626 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:14.626 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:02:14.626 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:14.626 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.626 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.626 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4755.0:74471 5.2 5.6f47a5c2 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-04-19T03:02:14.626 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:02:14.419635+0000", 2024-04-19T03:02:14.627 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 0.18537073100000001, 2024-04-19T03:02:14.627 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.18579812100000001, 2024-04-19T03:02:14.627 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:02:14.627 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "waiting for peered", 2024-04-19T03:02:14.627 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-04-19T03:02:14.627 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4755", 2024-04-19T03:02:14.627 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:14.627 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 74471 2024-04-19T03:02:14.627 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.627 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:02:14.627 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.627 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:02:14.627 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.419635+0000", 2024-04-19T03:02:14.628 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:14.628 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.628 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.628 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:02:14.628 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.419635+0000", 2024-04-19T03:02:14.628 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:14.628 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.628 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.628 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:02:14.628 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.419634+0000", 2024-04-19T03:02:14.628 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:14.628 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.628 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.628 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:02:14.628 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.419687+0000", 2024-04-19T03:02:14.628 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.3216e-05 2024-04-19T03:02:14.629 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.629 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.629 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:02:14.629 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.419711+0000", 2024-04-19T03:02:14.629 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.3737e-05 2024-04-19T03:02:14.629 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.629 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.629 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:02:14.629 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.419729+0000", 2024-04-19T03:02:14.629 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.8297000000000001e-05 2024-04-19T03:02:14.629 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.629 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.629 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:14.629 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.419821+0000", 2024-04-19T03:02:14.629 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.2175000000000004e-05 2024-04-19T03:02:14.630 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.630 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.630 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for peered", 2024-04-19T03:02:14.630 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.419841+0000", 2024-04-19T03:02:14.630 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.9874e-05 2024-04-19T03:02:14.630 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:14.630 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:02:14.630 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:14.630 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.630 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.630 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4755.0:74381 5.2 5.f3165fb2 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-04-19T03:02:14.630 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:02:14.196029+0000", 2024-04-19T03:02:14.630 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 0.40897739, 2024-04-19T03:02:14.630 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.40949477400000001, 2024-04-19T03:02:14.631 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:02:14.631 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "waiting for peered", 2024-04-19T03:02:14.631 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-04-19T03:02:14.631 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4755", 2024-04-19T03:02:14.631 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:14.631 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 74381 2024-04-19T03:02:14.631 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.631 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:02:14.631 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.631 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:02:14.631 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.196029+0000", 2024-04-19T03:02:14.631 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:14.631 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.631 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.631 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:02:14.631 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.196029+0000", 2024-04-19T03:02:14.632 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:14.632 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.632 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.632 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:02:14.632 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.196028+0000", 2024-04-19T03:02:14.632 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2024-04-19T03:02:14.632 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.632 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.632 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:02:14.632 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.196094+0000", 2024-04-19T03:02:14.632 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.6611000000000003e-05 2024-04-19T03:02:14.632 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.632 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.632 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:02:14.632 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.196105+0000", 2024-04-19T03:02:14.632 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0907000000000001e-05 2024-04-19T03:02:14.633 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.633 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.633 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:02:14.633 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.196111+0000", 2024-04-19T03:02:14.633 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.7130000000000002e-06 2024-04-19T03:02:14.633 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.633 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.633 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:14.633 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.196145+0000", 2024-04-19T03:02:14.633 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.3544999999999998e-05 2024-04-19T03:02:14.633 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.633 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.633 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for peered", 2024-04-19T03:02:14.633 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.196150+0000", 2024-04-19T03:02:14.633 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.2109999999999997e-06 2024-04-19T03:02:14.633 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:14.634 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:02:14.634 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:14.634 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.634 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.634 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4755.0:74445 5.2 5.c339c5d2 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-04-19T03:02:14.634 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:02:14.277771+0000", 2024-04-19T03:02:14.634 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 0.32723514100000001, 2024-04-19T03:02:14.634 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.32784194900000002, 2024-04-19T03:02:14.634 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:02:14.634 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "waiting for peered", 2024-04-19T03:02:14.634 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-04-19T03:02:14.634 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4755", 2024-04-19T03:02:14.634 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:14.635 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 74445 2024-04-19T03:02:14.635 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.635 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:02:14.635 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.635 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:02:14.635 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.277771+0000", 2024-04-19T03:02:14.635 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:14.635 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.635 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.635 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:02:14.635 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.277771+0000", 2024-04-19T03:02:14.635 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:14.636 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.636 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.636 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:02:14.636 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.277770+0000", 2024-04-19T03:02:14.636 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2024-04-19T03:02:14.636 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.636 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.636 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:02:14.636 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.277846+0000", 2024-04-19T03:02:14.636 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.6355999999999999e-05 2024-04-19T03:02:14.636 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.636 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.636 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:02:14.636 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.277862+0000", 2024-04-19T03:02:14.637 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5577999999999999e-05 2024-04-19T03:02:14.637 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.637 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.637 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:02:14.637 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.277869+0000", 2024-04-19T03:02:14.637 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.024e-06 2024-04-19T03:02:14.637 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.637 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.637 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:14.637 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.277924+0000", 2024-04-19T03:02:14.637 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.4758e-05 2024-04-19T03:02:14.637 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.637 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.637 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for peered", 2024-04-19T03:02:14.638 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.277933+0000", 2024-04-19T03:02:14.638 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.1630000000000002e-06 2024-04-19T03:02:14.638 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:14.638 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:02:14.638 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:14.638 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.638 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.638 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4755.0:74415 5.2 5.c69d5162 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-04-19T03:02:14.638 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:02:14.229627+0000", 2024-04-19T03:02:14.638 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 0.37537948599999998, 2024-04-19T03:02:14.638 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.37607769000000002, 2024-04-19T03:02:14.638 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:02:14.638 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "waiting for peered", 2024-04-19T03:02:14.639 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-04-19T03:02:14.639 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4755", 2024-04-19T03:02:14.639 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:14.639 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 74415 2024-04-19T03:02:14.639 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.639 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:02:14.639 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.639 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:02:14.639 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.229627+0000", 2024-04-19T03:02:14.639 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:14.639 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.639 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.640 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:02:14.640 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.229627+0000", 2024-04-19T03:02:14.640 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:14.640 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.640 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.640 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:02:14.640 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.229625+0000", 2024-04-19T03:02:14.640 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:14.640 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.640 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.640 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:02:14.640 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.229673+0000", 2024-04-19T03:02:14.641 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.7441000000000002e-05 2024-04-19T03:02:14.641 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.641 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.641 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:02:14.641 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.229739+0000", 2024-04-19T03:02:14.641 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.5894000000000003e-05 2024-04-19T03:02:14.641 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.641 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.641 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:02:14.641 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.229749+0000", 2024-04-19T03:02:14.641 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0715e-05 2024-04-19T03:02:14.641 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.641 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.641 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:14.642 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.229842+0000", 2024-04-19T03:02:14.642 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.2750999999999993e-05 2024-04-19T03:02:14.642 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.642 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.642 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for peered", 2024-04-19T03:02:14.642 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.229858+0000", 2024-04-19T03:02:14.642 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.6045999999999998e-05 2024-04-19T03:02:14.642 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:14.642 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:02:14.642 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:14.642 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.642 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.642 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4755.0:74449 5.1 5.2a7ef491 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-04-19T03:02:14.643 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:02:14.287450+0000", 2024-04-19T03:02:14.643 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 0.3175557, 2024-04-19T03:02:14.643 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.31834373100000002, 2024-04-19T03:02:14.643 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:02:14.643 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "waiting for peered", 2024-04-19T03:02:14.643 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-04-19T03:02:14.643 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4755", 2024-04-19T03:02:14.643 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:14.643 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 74449 2024-04-19T03:02:14.643 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.643 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:02:14.643 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.643 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:02:14.643 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.287450+0000", 2024-04-19T03:02:14.643 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:14.644 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.644 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.644 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:02:14.644 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.287450+0000", 2024-04-19T03:02:14.644 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:14.644 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.644 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.644 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:02:14.644 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.287449+0000", 2024-04-19T03:02:14.644 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:14.644 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.644 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.644 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:02:14.645 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.287529+0000", 2024-04-19T03:02:14.645 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.9923e-05 2024-04-19T03:02:14.645 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.645 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.645 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:02:14.645 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.287548+0000", 2024-04-19T03:02:14.645 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.8702000000000002e-05 2024-04-19T03:02:14.645 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.645 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.645 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:02:14.645 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.287562+0000", 2024-04-19T03:02:14.645 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.396e-05 2024-04-19T03:02:14.645 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.645 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.646 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:14.646 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.287623+0000", 2024-04-19T03:02:14.646 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.0736999999999998e-05 2024-04-19T03:02:14.646 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.646 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.646 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for peered", 2024-04-19T03:02:14.646 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.287629+0000", 2024-04-19T03:02:14.646 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.6229999999999999e-06 2024-04-19T03:02:14.646 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:14.646 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:02:14.646 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:14.646 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.646 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.647 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4755.0:74420 5.1 5.baa27761 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-04-19T03:02:14.647 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:02:14.234364+0000", 2024-04-19T03:02:14.647 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 0.37064231600000003, 2024-04-19T03:02:14.647 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.37151992700000003, 2024-04-19T03:02:14.647 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:02:14.647 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "waiting for peered", 2024-04-19T03:02:14.647 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-04-19T03:02:14.647 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4755", 2024-04-19T03:02:14.647 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:14.647 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 74420 2024-04-19T03:02:14.647 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.647 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:02:14.647 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.647 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:02:14.648 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.234364+0000", 2024-04-19T03:02:14.648 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:14.648 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.648 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.648 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:02:14.648 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.234364+0000", 2024-04-19T03:02:14.648 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:14.648 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.648 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.648 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:02:14.648 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.234363+0000", 2024-04-19T03:02:14.648 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:14.648 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.648 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.648 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:02:14.649 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.234413+0000", 2024-04-19T03:02:14.649 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.0535000000000003e-05 2024-04-19T03:02:14.649 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.649 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.649 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:02:14.649 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.234438+0000", 2024-04-19T03:02:14.649 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.4664999999999998e-05 2024-04-19T03:02:14.649 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.649 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.649 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:02:14.649 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.234446+0000", 2024-04-19T03:02:14.649 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.6100000000000006e-06 2024-04-19T03:02:14.649 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.649 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.650 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:14.650 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.234504+0000", 2024-04-19T03:02:14.650 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.7890999999999999e-05 2024-04-19T03:02:14.650 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.650 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.650 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for peered", 2024-04-19T03:02:14.650 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.234518+0000", 2024-04-19T03:02:14.650 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.3368e-05 2024-04-19T03:02:14.650 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:14.650 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:02:14.650 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:14.650 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.651 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.651 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4755.0:74392 5.1 5.471f39f1 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-04-19T03:02:14.651 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:02:14.203646+0000", 2024-04-19T03:02:14.651 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 0.40136043300000002, 2024-04-19T03:02:14.651 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.40232690500000001, 2024-04-19T03:02:14.651 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:02:14.651 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "waiting for peered", 2024-04-19T03:02:14.651 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-04-19T03:02:14.651 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4755", 2024-04-19T03:02:14.651 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:14.651 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 74392 2024-04-19T03:02:14.651 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.651 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:02:14.651 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.652 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:02:14.652 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.203646+0000", 2024-04-19T03:02:14.652 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:14.652 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.652 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.652 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:02:14.652 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.203646+0000", 2024-04-19T03:02:14.652 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:14.652 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.652 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.652 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:02:14.652 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.203644+0000", 2024-04-19T03:02:14.653 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:14.653 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.653 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.653 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:02:14.653 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.203695+0000", 2024-04-19T03:02:14.653 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.0813000000000003e-05 2024-04-19T03:02:14.653 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.653 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.653 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:02:14.653 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.203710+0000", 2024-04-19T03:02:14.653 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5299999999999999e-05 2024-04-19T03:02:14.654 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.654 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.654 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:02:14.654 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.203727+0000", 2024-04-19T03:02:14.654 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.6294999999999999e-05 2024-04-19T03:02:14.654 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.654 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.654 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:14.654 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.203802+0000", 2024-04-19T03:02:14.654 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.5197999999999994e-05 2024-04-19T03:02:14.654 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.654 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.655 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for peered", 2024-04-19T03:02:14.655 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.203815+0000", 2024-04-19T03:02:14.655 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.3254e-05 2024-04-19T03:02:14.655 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:14.655 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:02:14.655 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:14.655 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.655 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.655 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4755.0:74351 5.1 5.8554cfb1 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e39)", 2024-04-19T03:02:14.655 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:02:14.185504+0000", 2024-04-19T03:02:14.655 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 0.41950231500000001, 2024-04-19T03:02:14.655 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.42055953000000001, 2024-04-19T03:02:14.655 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:02:14.656 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "waiting for peered", 2024-04-19T03:02:14.656 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-04-19T03:02:14.656 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4755", 2024-04-19T03:02:14.656 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:14.656 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 74351 2024-04-19T03:02:14.656 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.656 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:02:14.656 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.656 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:02:14.656 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.185504+0000", 2024-04-19T03:02:14.656 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:14.656 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.657 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.657 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:02:14.657 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.185504+0000", 2024-04-19T03:02:14.657 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:14.657 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.657 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.657 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:02:14.657 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.185503+0000", 2024-04-19T03:02:14.657 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2024-04-19T03:02:14.657 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.657 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.657 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:02:14.657 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.185536+0000", 2024-04-19T03:02:14.657 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.3433000000000003e-05 2024-04-19T03:02:14.657 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.658 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.658 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:02:14.658 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.185547+0000", 2024-04-19T03:02:14.658 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0375e-05 2024-04-19T03:02:14.658 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.658 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.658 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:02:14.658 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.185554+0000", 2024-04-19T03:02:14.658 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.1670000000000002e-06 2024-04-19T03:02:14.658 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.658 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.658 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:14.658 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.185646+0000", 2024-04-19T03:02:14.659 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.1772000000000002e-05 2024-04-19T03:02:14.659 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.659 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.659 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for peered", 2024-04-19T03:02:14.659 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.185658+0000", 2024-04-19T03:02:14.659 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2337999999999999e-05 2024-04-19T03:02:14.659 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:14.659 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:02:14.659 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:14.659 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.659 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.659 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4755.0:74396 5.1 5.8ce6e6f1 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-04-19T03:02:14.659 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:02:14.206696+0000", 2024-04-19T03:02:14.659 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 0.39831029200000001, 2024-04-19T03:02:14.660 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.399456757, 2024-04-19T03:02:14.660 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:02:14.660 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "waiting for peered", 2024-04-19T03:02:14.660 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-04-19T03:02:14.660 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4755", 2024-04-19T03:02:14.660 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:14.660 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 74396 2024-04-19T03:02:14.660 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.660 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:02:14.660 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.660 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:02:14.660 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.206696+0000", 2024-04-19T03:02:14.660 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:14.660 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.661 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.661 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:02:14.661 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.206696+0000", 2024-04-19T03:02:14.661 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:14.661 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.661 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.661 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:02:14.661 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.206695+0000", 2024-04-19T03:02:14.661 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:14.661 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.661 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.661 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:02:14.661 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.206746+0000", 2024-04-19T03:02:14.662 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.1564000000000003e-05 2024-04-19T03:02:14.662 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.662 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.662 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:02:14.662 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.206759+0000", 2024-04-19T03:02:14.662 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.3315e-05 2024-04-19T03:02:14.662 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.662 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.662 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:02:14.662 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.206767+0000", 2024-04-19T03:02:14.662 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.2400000000000001e-06 2024-04-19T03:02:14.662 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.662 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.663 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:14.663 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.206819+0000", 2024-04-19T03:02:14.663 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.2169999999999997e-05 2024-04-19T03:02:14.663 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.663 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.663 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for peered", 2024-04-19T03:02:14.663 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.206829+0000", 2024-04-19T03:02:14.663 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.8770000000000005e-06 2024-04-19T03:02:14.663 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:14.663 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:02:14.663 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:14.663 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.663 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.663 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4755.0:74360 5.2 5.ca4c1c12 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e39)", 2024-04-19T03:02:14.664 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:02:14.185568+0000", 2024-04-19T03:02:14.664 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 0.41943832599999997, 2024-04-19T03:02:14.664 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.42067550100000001, 2024-04-19T03:02:14.664 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:02:14.664 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "waiting for peered", 2024-04-19T03:02:14.664 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-04-19T03:02:14.664 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4755", 2024-04-19T03:02:14.664 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:14.664 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 74360 2024-04-19T03:02:14.664 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.664 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:02:14.664 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.664 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:02:14.664 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.185568+0000", 2024-04-19T03:02:14.665 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:14.665 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.665 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.665 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:02:14.665 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.185568+0000", 2024-04-19T03:02:14.665 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:14.665 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.665 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.665 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:02:14.665 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.185567+0000", 2024-04-19T03:02:14.665 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:14.665 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.665 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.666 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:02:14.666 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.185613+0000", 2024-04-19T03:02:14.666 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.6119999999999999e-05 2024-04-19T03:02:14.666 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.666 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.666 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:02:14.666 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.185621+0000", 2024-04-19T03:02:14.666 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.7810000000000005e-06 2024-04-19T03:02:14.666 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.666 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.666 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:02:14.666 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.185627+0000", 2024-04-19T03:02:14.666 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.7370000000000003e-06 2024-04-19T03:02:14.667 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.667 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.667 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:14.667 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.185671+0000", 2024-04-19T03:02:14.667 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.4418000000000001e-05 2024-04-19T03:02:14.667 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.667 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.667 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for peered", 2024-04-19T03:02:14.667 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.185681+0000", 2024-04-19T03:02:14.667 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.9529999999999994e-06 2024-04-19T03:02:14.667 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:14.667 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:02:14.667 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:14.667 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.668 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.668 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4755.0:74397 5.2 5.333813d2 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-04-19T03:02:14.668 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:02:14.207542+0000", 2024-04-19T03:02:14.668 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 0.397464229, 2024-04-19T03:02:14.668 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.39879645200000002, 2024-04-19T03:02:14.668 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:02:14.668 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "waiting for peered", 2024-04-19T03:02:14.668 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-04-19T03:02:14.668 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4755", 2024-04-19T03:02:14.668 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:14.668 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 74397 2024-04-19T03:02:14.668 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.668 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:02:14.669 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.669 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:02:14.669 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.207542+0000", 2024-04-19T03:02:14.669 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:14.669 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.669 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.669 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:02:14.669 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.207542+0000", 2024-04-19T03:02:14.669 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:14.669 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.669 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.669 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:02:14.669 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.207541+0000", 2024-04-19T03:02:14.669 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2024-04-19T03:02:14.670 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.670 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.670 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:02:14.670 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.207607+0000", 2024-04-19T03:02:14.670 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.5537999999999995e-05 2024-04-19T03:02:14.670 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.670 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.670 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:02:14.670 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.207616+0000", 2024-04-19T03:02:14.670 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.5319999999999995e-06 2024-04-19T03:02:14.670 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.670 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.671 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:02:14.671 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.207623+0000", 2024-04-19T03:02:14.671 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.25e-06 2024-04-19T03:02:14.671 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.671 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.671 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:14.671 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.207667+0000", 2024-04-19T03:02:14.671 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.3071999999999997e-05 2024-04-19T03:02:14.671 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.671 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.671 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for peered", 2024-04-19T03:02:14.671 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.207676+0000", 2024-04-19T03:02:14.671 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.0040000000000005e-06 2024-04-19T03:02:14.671 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:14.672 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:02:14.672 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:14.672 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.672 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.672 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4755.0:74425 5.2 5.571c8a72 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-04-19T03:02:14.672 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:02:14.241897+0000", 2024-04-19T03:02:14.672 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 0.36310927999999998, 2024-04-19T03:02:14.672 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.36453097000000001, 2024-04-19T03:02:14.672 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:02:14.672 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "waiting for peered", 2024-04-19T03:02:14.672 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-04-19T03:02:14.672 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4755", 2024-04-19T03:02:14.672 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:14.672 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 74425 2024-04-19T03:02:14.673 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.673 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:02:14.673 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.673 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:02:14.673 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.241897+0000", 2024-04-19T03:02:14.673 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:14.673 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.673 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.673 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:02:14.673 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.241897+0000", 2024-04-19T03:02:14.673 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:14.673 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.673 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.673 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:02:14.674 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.241896+0000", 2024-04-19T03:02:14.674 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2024-04-19T03:02:14.674 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.674 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.674 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:02:14.674 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.241976+0000", 2024-04-19T03:02:14.674 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.9976999999999997e-05 2024-04-19T03:02:14.674 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.674 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.674 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:02:14.674 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.241991+0000", 2024-04-19T03:02:14.674 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5764999999999999e-05 2024-04-19T03:02:14.674 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.675 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.675 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:02:14.675 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.241999+0000", 2024-04-19T03:02:14.675 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.5669999999999997e-06 2024-04-19T03:02:14.675 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.675 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.675 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:14.675 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.242086+0000", 2024-04-19T03:02:14.675 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.6650000000000006e-05 2024-04-19T03:02:14.675 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.675 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.675 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for peered", 2024-04-19T03:02:14.675 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.242105+0000", 2024-04-19T03:02:14.675 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.9768000000000001e-05 2024-04-19T03:02:14.676 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:14.676 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:02:14.676 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:14.676 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:14.676 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2024-04-19T03:02:14.676 INFO:teuthology.orchestra.run.smithi097.stdout: "num_ops": 16 2024-04-19T03:02:14.676 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-04-19T03:02:14.677 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T03:02:14.692 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:14.689+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:14.789 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-04-19T03:02:14.789 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [], 2024-04-19T03:02:14.789 INFO:teuthology.orchestra.run.smithi097.stdout: "complaint_time": 30, 2024-04-19T03:02:14.789 INFO:teuthology.orchestra.run.smithi097.stdout: "num_blocked_ops": 0 2024-04-19T03:02:14.789 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-04-19T03:02:14.793 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:14.789+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:14.798 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T03:02:14.823 INFO:tasks.radosbench.radosbench.0.smithi096.stdout: 37 16 74471 74455 125.754 45.4375 0.00611624 0.00781919 2024-04-19T03:02:14.894 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:14.891+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:14.908 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-04-19T03:02:14.908 INFO:teuthology.orchestra.run.smithi097.stdout: "size": 20, 2024-04-19T03:02:14.909 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 600, 2024-04-19T03:02:14.909 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [ 2024-04-19T03:02:14.909 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.909 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(mds.0.3:14 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:02:14.909 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:14.997079+0000", 2024-04-19T03:02:14.909 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 59.907258366999997, 2024-04-19T03:02:14.909 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.021951970000000001, 2024-04-19T03:02:14.909 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:02:14.909 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:14.909 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:02:14.909 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.909 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:02:14.909 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997079+0000", 2024-04-19T03:02:14.910 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:14.910 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.910 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.910 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:02:14.910 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997079+0000", 2024-04-19T03:02:14.910 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:14.910 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.910 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.910 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:02:14.910 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997077+0000", 2024-04-19T03:02:14.911 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:14.911 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.911 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.911 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:02:14.911 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997087+0000", 2024-04-19T03:02:14.911 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.006e-05 2024-04-19T03:02:14.911 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.911 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.911 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:02:14.911 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997105+0000", 2024-04-19T03:02:14.911 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.8026999999999999e-05 2024-04-19T03:02:14.911 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.911 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.912 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:02:14.912 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997135+0000", 2024-04-19T03:02:14.912 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.9643000000000001e-05 2024-04-19T03:02:14.912 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.912 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.912 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:14.912 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997208+0000", 2024-04-19T03:02:14.912 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.3419999999999998e-05 2024-04-19T03:02:14.912 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.912 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.912 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op must wait for map", 2024-04-19T03:02:14.913 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997244+0000", 2024-04-19T03:02:14.913 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.5367000000000002e-05 2024-04-19T03:02:14.913 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.913 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.913 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:14.913 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.007357+0000", 2024-04-19T03:02:14.913 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.010112703000000001 2024-04-19T03:02:14.913 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.913 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.913 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:02:14.913 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.007479+0000", 2024-04-19T03:02:14.913 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012279599999999999 2024-04-19T03:02:14.913 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.913 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.914 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 1", 2024-04-19T03:02:14.914 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.007610+0000", 2024-04-19T03:02:14.914 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00013093499999999999 2024-04-19T03:02:14.914 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.914 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.914 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:02:14.914 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.012526+0000", 2024-04-19T03:02:14.914 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0049157519999999998 2024-04-19T03:02:14.914 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.915 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.915 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:14.915 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.018959+0000", 2024-04-19T03:02:14.915 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0064326009999999996 2024-04-19T03:02:14.915 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.915 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.915 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:02:14.915 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.019005+0000", 2024-04-19T03:02:14.915 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.6066999999999998e-05 2024-04-19T03:02:14.915 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.915 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.915 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:02:14.915 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.019031+0000", 2024-04-19T03:02:14.915 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.6009000000000001e-05 2024-04-19T03:02:14.916 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:14.916 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:02:14.916 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:14.916 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.916 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.916 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(mds.0.3:26 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:02:14.916 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:14.997149+0000", 2024-04-19T03:02:14.916 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 59.907187747000002, 2024-04-19T03:02:14.916 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.021805590999999999, 2024-04-19T03:02:14.916 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:02:14.916 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:14.916 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:02:14.916 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.916 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:02:14.917 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997149+0000", 2024-04-19T03:02:14.917 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:14.917 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.917 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.917 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:02:14.917 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997149+0000", 2024-04-19T03:02:14.917 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:14.917 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.917 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.917 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:02:14.917 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997148+0000", 2024-04-19T03:02:14.917 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2024-04-19T03:02:14.917 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.918 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.918 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:02:14.918 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997166+0000", 2024-04-19T03:02:14.918 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.8233e-05 2024-04-19T03:02:14.918 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.918 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.918 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:02:14.918 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997182+0000", 2024-04-19T03:02:14.918 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5999999999999999e-05 2024-04-19T03:02:14.918 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.918 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.919 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:02:14.919 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997195+0000", 2024-04-19T03:02:14.919 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.252e-05 2024-04-19T03:02:14.919 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.919 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.919 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:14.919 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997348+0000", 2024-04-19T03:02:14.919 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000153115 2024-04-19T03:02:14.919 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.919 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.919 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:02:14.919 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997354+0000", 2024-04-19T03:02:14.919 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.9359999999999996e-06 2024-04-19T03:02:14.920 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.920 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.920 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:14.920 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.008147+0000", 2024-04-19T03:02:14.920 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.010793127 2024-04-19T03:02:14.920 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.920 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.920 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:02:14.920 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.008225+0000", 2024-04-19T03:02:14.920 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.7935999999999994e-05 2024-04-19T03:02:14.920 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.920 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.920 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-04-19T03:02:14.920 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.008377+0000", 2024-04-19T03:02:14.921 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00015159099999999999 2024-04-19T03:02:14.921 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.921 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.921 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:02:14.921 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.012629+0000", 2024-04-19T03:02:14.921 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0042520420000000001 2024-04-19T03:02:14.921 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.921 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.921 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:14.921 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.018871+0000", 2024-04-19T03:02:14.922 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0062425060000000001 2024-04-19T03:02:14.922 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.922 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.922 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:02:14.922 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.018910+0000", 2024-04-19T03:02:14.922 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.8482999999999997e-05 2024-04-19T03:02:14.922 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.922 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.922 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:02:14.922 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.018955+0000", 2024-04-19T03:02:14.922 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.5252e-05 2024-04-19T03:02:14.922 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:14.922 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:02:14.923 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:14.923 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.923 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.923 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(mds.0.3:36 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:02:14.923 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:14.997207+0000", 2024-04-19T03:02:14.923 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 59.907130197000001, 2024-04-19T03:02:14.923 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.022210431999999999, 2024-04-19T03:02:14.923 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:02:14.923 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:14.923 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:02:14.923 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.923 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:02:14.923 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997207+0000", 2024-04-19T03:02:14.923 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:14.923 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.924 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.924 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:02:14.924 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997207+0000", 2024-04-19T03:02:14.924 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:14.924 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.924 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.924 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:02:14.924 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997206+0000", 2024-04-19T03:02:14.924 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2024-04-19T03:02:14.924 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.924 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.924 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:02:14.924 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997218+0000", 2024-04-19T03:02:14.925 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2607e-05 2024-04-19T03:02:14.925 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.925 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.925 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:02:14.925 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997234+0000", 2024-04-19T03:02:14.925 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5583999999999999e-05 2024-04-19T03:02:14.925 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.925 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.925 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:02:14.925 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997248+0000", 2024-04-19T03:02:14.925 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4270000000000001e-05 2024-04-19T03:02:14.925 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.925 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.925 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:14.926 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997397+0000", 2024-04-19T03:02:14.926 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0001482 2024-04-19T03:02:14.926 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.926 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.926 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:02:14.926 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997407+0000", 2024-04-19T03:02:14.926 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0944000000000001e-05 2024-04-19T03:02:14.926 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.926 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.926 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:14.926 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.008173+0000", 2024-04-19T03:02:14.926 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.010765378000000001 2024-04-19T03:02:14.926 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.927 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.927 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:02:14.927 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.008278+0000", 2024-04-19T03:02:14.927 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00010538 2024-04-19T03:02:14.927 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.927 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.927 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 1", 2024-04-19T03:02:14.927 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.008423+0000", 2024-04-19T03:02:14.927 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014525599999999999 2024-04-19T03:02:14.927 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.927 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.927 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:02:14.927 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.012734+0000", 2024-04-19T03:02:14.927 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0043108590000000002 2024-04-19T03:02:14.928 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.928 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.928 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:14.928 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.019318+0000", 2024-04-19T03:02:14.928 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0065836130000000003 2024-04-19T03:02:14.928 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.928 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.928 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:02:14.928 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.019382+0000", 2024-04-19T03:02:14.928 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.3925999999999997e-05 2024-04-19T03:02:14.928 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.928 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.928 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:02:14.928 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.019417+0000", 2024-04-19T03:02:14.929 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.5454999999999999e-05 2024-04-19T03:02:14.929 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:14.929 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:02:14.929 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:14.929 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.929 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.929 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(mds.0.3:15 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:02:14.929 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:14.997260+0000", 2024-04-19T03:02:14.929 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 59.907077045999998, 2024-04-19T03:02:14.929 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.021842842000000001, 2024-04-19T03:02:14.929 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:02:14.929 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:14.929 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:02:14.929 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.930 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:02:14.930 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997260+0000", 2024-04-19T03:02:14.930 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:14.930 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.930 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.930 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:02:14.930 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997260+0000", 2024-04-19T03:02:14.930 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:14.930 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.930 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.930 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:02:14.930 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997259+0000", 2024-04-19T03:02:14.930 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:14.930 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.931 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.931 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:02:14.931 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997270+0000", 2024-04-19T03:02:14.931 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0312999999999999e-05 2024-04-19T03:02:14.931 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.931 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.931 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:02:14.931 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997279+0000", 2024-04-19T03:02:14.931 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.7770000000000008e-06 2024-04-19T03:02:14.931 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.931 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.931 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:02:14.932 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997286+0000", 2024-04-19T03:02:14.932 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.0129999999999996e-06 2024-04-19T03:02:14.932 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.932 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.932 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:14.932 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997433+0000", 2024-04-19T03:02:14.932 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014774699999999999 2024-04-19T03:02:14.932 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.932 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.932 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:02:14.932 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997443+0000", 2024-04-19T03:02:14.932 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.414e-06 2024-04-19T03:02:14.932 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.933 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.933 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:14.933 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.008673+0000", 2024-04-19T03:02:14.933 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.011230789999999999 2024-04-19T03:02:14.933 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.933 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.933 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:02:14.933 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.008808+0000", 2024-04-19T03:02:14.933 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000134346 2024-04-19T03:02:14.933 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.933 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.933 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-04-19T03:02:14.933 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.008922+0000", 2024-04-19T03:02:14.933 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000114444 2024-04-19T03:02:14.934 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.934 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.934 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:02:14.934 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.013442+0000", 2024-04-19T03:02:14.934 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0045193439999999998 2024-04-19T03:02:14.934 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.934 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.934 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:14.934 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.019005+0000", 2024-04-19T03:02:14.934 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00556333 2024-04-19T03:02:14.934 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.934 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.934 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:02:14.935 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.019049+0000", 2024-04-19T03:02:14.935 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.4240000000000003e-05 2024-04-19T03:02:14.935 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.935 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.935 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:02:14.935 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.019103+0000", 2024-04-19T03:02:14.935 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.3706999999999999e-05 2024-04-19T03:02:14.935 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:14.935 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:02:14.935 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:14.935 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.935 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.935 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(mds.0.3:23 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:02:14.935 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:14.997449+0000", 2024-04-19T03:02:14.935 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 59.906887998000002, 2024-04-19T03:02:14.936 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.022679250000000001, 2024-04-19T03:02:14.936 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:02:14.936 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "started", 2024-04-19T03:02:14.936 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:02:14.936 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.936 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:02:14.936 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997449+0000", 2024-04-19T03:02:14.936 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:14.936 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.936 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.936 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:02:14.936 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997449+0000", 2024-04-19T03:02:14.936 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:14.936 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.937 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.937 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:02:14.937 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997448+0000", 2024-04-19T03:02:14.937 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:14.937 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.937 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.937 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:02:14.937 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997452+0000", 2024-04-19T03:02:14.937 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.0369999999999996e-06 2024-04-19T03:02:14.937 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.937 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.938 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:02:14.938 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997461+0000", 2024-04-19T03:02:14.938 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.6100000000000006e-06 2024-04-19T03:02:14.938 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.938 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.938 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:02:14.938 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997468+0000", 2024-04-19T03:02:14.938 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.8360000000000003e-06 2024-04-19T03:02:14.938 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.938 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.938 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:14.938 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997546+0000", 2024-04-19T03:02:14.939 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.7956999999999999e-05 2024-04-19T03:02:14.939 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.939 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.939 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:02:14.939 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997555+0000", 2024-04-19T03:02:14.939 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.2269999999999999e-06 2024-04-19T03:02:14.939 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.939 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.939 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:14.940 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.010065+0000", 2024-04-19T03:02:14.940 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.012509457999999999 2024-04-19T03:02:14.940 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.940 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.940 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:02:14.940 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.010187+0000", 2024-04-19T03:02:14.940 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000122059 2024-04-19T03:02:14.940 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.940 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.940 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:02:14.940 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.020128+0000", 2024-04-19T03:02:14.941 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0099417529999999994 2024-04-19T03:02:14.941 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:14.941 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:02:14.941 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:14.941 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.941 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.942 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(mds.0.3:25 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:02:14.942 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:14.997485+0000", 2024-04-19T03:02:14.942 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 59.906852532000002, 2024-04-19T03:02:14.942 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.021633427, 2024-04-19T03:02:14.942 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:02:14.942 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "started", 2024-04-19T03:02:14.943 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:02:14.943 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.943 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:02:14.943 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997485+0000", 2024-04-19T03:02:14.943 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:14.944 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.944 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.944 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:02:14.944 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997485+0000", 2024-04-19T03:02:14.944 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:14.944 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.945 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.945 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:02:14.945 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997484+0000", 2024-04-19T03:02:14.945 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2024-04-19T03:02:14.945 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.945 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.946 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:02:14.946 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997490+0000", 2024-04-19T03:02:14.946 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.857e-06 2024-04-19T03:02:14.946 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.946 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.946 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:02:14.946 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997505+0000", 2024-04-19T03:02:14.946 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.518e-05 2024-04-19T03:02:14.946 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.946 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.947 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:02:14.947 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997520+0000", 2024-04-19T03:02:14.947 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5026e-05 2024-04-19T03:02:14.947 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.947 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.947 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:14.947 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997607+0000", 2024-04-19T03:02:14.947 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.7107000000000005e-05 2024-04-19T03:02:14.947 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.947 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.947 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op must wait for map", 2024-04-19T03:02:14.947 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:14.997614+0000", 2024-04-19T03:02:14.947 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.0539999999999997e-06 2024-04-19T03:02:14.947 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.948 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.948 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:14.948 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.009808+0000", 2024-04-19T03:02:14.948 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.012194371000000001 2024-04-19T03:02:14.948 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.948 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.948 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:02:14.948 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.010107+0000", 2024-04-19T03:02:14.948 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000298731 2024-04-19T03:02:14.948 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.948 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.948 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:02:14.948 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:15.019118+0000", 2024-04-19T03:02:14.948 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0090109839999999997 2024-04-19T03:02:14.949 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:14.949 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:02:14.949 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:14.949 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.949 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.949 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4755.0:11277 5.c 5:38c3ceb2:::benchmark_data_smithi096_19531_object11276:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T03:02:14.949 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:42.059676+0000", 2024-04-19T03:02:14.949 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 32.844660910000002, 2024-04-19T03:02:14.949 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.029909680000000001, 2024-04-19T03:02:14.949 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:02:14.949 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:14.950 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-04-19T03:02:14.950 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4755", 2024-04-19T03:02:14.950 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:14.950 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 11277 2024-04-19T03:02:14.950 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.950 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:02:14.950 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.950 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:02:14.951 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.059676+0000", 2024-04-19T03:02:14.951 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:14.951 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.951 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.951 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:02:14.951 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.059676+0000", 2024-04-19T03:02:14.951 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:14.951 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.951 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.951 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:02:14.951 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.059665+0000", 2024-04-19T03:02:14.951 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999886 2024-04-19T03:02:14.951 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.951 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.952 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:02:14.952 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.059777+0000", 2024-04-19T03:02:14.952 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000111953 2024-04-19T03:02:14.952 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.952 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.952 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:02:14.952 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.059789+0000", 2024-04-19T03:02:14.952 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1809e-05 2024-04-19T03:02:14.952 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.952 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.952 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:02:14.952 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.059797+0000", 2024-04-19T03:02:14.952 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.2090000000000005e-06 2024-04-19T03:02:14.952 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.953 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.953 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:14.953 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.060528+0000", 2024-04-19T03:02:14.953 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00073144499999999995 2024-04-19T03:02:14.953 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.953 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.953 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:02:14.953 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.060662+0000", 2024-04-19T03:02:14.953 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000133435 2024-04-19T03:02:14.953 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.953 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.953 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-04-19T03:02:14.953 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.060766+0000", 2024-04-19T03:02:14.953 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00010473500000000001 2024-04-19T03:02:14.953 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.954 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.954 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:02:14.954 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.067649+0000", 2024-04-19T03:02:14.954 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.006882684 2024-04-19T03:02:14.954 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.954 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.954 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:14.954 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.089475+0000", 2024-04-19T03:02:14.954 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.021826196999999999 2024-04-19T03:02:14.954 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.954 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.954 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:02:14.954 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.089535+0000", 2024-04-19T03:02:14.955 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.9239e-05 2024-04-19T03:02:14.955 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.955 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.955 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:02:14.955 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.089586+0000", 2024-04-19T03:02:14.955 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.1288000000000001e-05 2024-04-19T03:02:14.955 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:14.955 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:02:14.955 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:14.955 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.955 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.955 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4755.0:11280 5.6 5:6e34f5e7:::benchmark_data_smithi096_19531_object11279:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T03:02:14.955 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:42.060002+0000", 2024-04-19T03:02:14.955 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 32.844335534000002, 2024-04-19T03:02:14.956 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.028171841999999999, 2024-04-19T03:02:14.956 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:02:14.956 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:14.956 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-04-19T03:02:14.956 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4755", 2024-04-19T03:02:14.956 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:14.956 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 11280 2024-04-19T03:02:14.956 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.957 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:02:14.957 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.957 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:02:14.957 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.060002+0000", 2024-04-19T03:02:14.957 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:14.957 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.958 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.958 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:02:14.958 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.060002+0000", 2024-04-19T03:02:14.958 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:14.958 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.959 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.959 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:02:14.959 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.060000+0000", 2024-04-19T03:02:14.959 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2024-04-19T03:02:14.959 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.959 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.960 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:02:14.960 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.060120+0000", 2024-04-19T03:02:14.960 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00011941400000000001 2024-04-19T03:02:14.960 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.960 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.960 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:02:14.960 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.060132+0000", 2024-04-19T03:02:14.960 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2197e-05 2024-04-19T03:02:14.960 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.960 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.960 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:02:14.961 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.060141+0000", 2024-04-19T03:02:14.961 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.6829999999999997e-06 2024-04-19T03:02:14.961 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.961 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.961 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:14.961 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.060194+0000", 2024-04-19T03:02:14.961 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.3395e-05 2024-04-19T03:02:14.961 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.961 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.961 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:02:14.961 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.060333+0000", 2024-04-19T03:02:14.961 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00013935799999999999 2024-04-19T03:02:14.961 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.962 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.962 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-04-19T03:02:14.962 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.060477+0000", 2024-04-19T03:02:14.962 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000143938 2024-04-19T03:02:14.962 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.962 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.962 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:02:14.962 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.067752+0000", 2024-04-19T03:02:14.962 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0072741580000000002 2024-04-19T03:02:14.962 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.962 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.963 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:14.963 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.088041+0000", 2024-04-19T03:02:14.963 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.020288955000000001 2024-04-19T03:02:14.963 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.963 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.963 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:02:14.963 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.088113+0000", 2024-04-19T03:02:14.963 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.2492999999999999e-05 2024-04-19T03:02:14.963 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.963 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.963 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:02:14.963 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.088173+0000", 2024-04-19T03:02:14.963 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.0418999999999999e-05 2024-04-19T03:02:14.963 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:14.964 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:02:14.964 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:14.964 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.964 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.964 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4755.0:11274 5.e e26/22 5:7c846032:::benchmark_data_smithi096_19531_object11273:head v 26'697, mlcod=26'692)", 2024-04-19T03:02:14.964 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:42.065726+0000", 2024-04-19T03:02:14.964 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 32.838611006999997, 2024-04-19T03:02:14.964 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.028607227999999998, 2024-04-19T03:02:14.964 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:02:14.964 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:14.964 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:02:14.964 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.964 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:02:14.965 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.065726+0000", 2024-04-19T03:02:14.965 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:14.965 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.965 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.965 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:02:14.965 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.065726+0000", 2024-04-19T03:02:14.965 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:14.965 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.965 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.965 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:02:14.965 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.065725+0000", 2024-04-19T03:02:14.965 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2024-04-19T03:02:14.965 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.965 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.966 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:02:14.966 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.066818+0000", 2024-04-19T03:02:14.966 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0010930110000000001 2024-04-19T03:02:14.966 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.966 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.966 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:02:14.966 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.066826+0000", 2024-04-19T03:02:14.966 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.0609999999999996e-06 2024-04-19T03:02:14.966 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.966 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.966 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:02:14.966 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.066831+0000", 2024-04-19T03:02:14.967 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.7500000000000003e-06 2024-04-19T03:02:14.967 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.967 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.967 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:14.967 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.066857+0000", 2024-04-19T03:02:14.967 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.6126999999999999e-05 2024-04-19T03:02:14.967 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.967 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.967 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:02:14.967 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.066868+0000", 2024-04-19T03:02:14.967 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1113e-05 2024-04-19T03:02:14.968 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.968 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.968 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:02:14.968 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.094266+0000", 2024-04-19T03:02:14.968 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.027397731000000002 2024-04-19T03:02:14.968 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.968 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.968 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:02:14.968 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.094333+0000", 2024-04-19T03:02:14.968 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.7230000000000005e-05 2024-04-19T03:02:14.968 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:14.968 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:02:14.968 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:14.968 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.969 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.969 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4755.0:11279 5.8 e26/22 5:10b60c58:::benchmark_data_smithi096_19531_object11278:head v 26'723, mlcod=26'719)", 2024-04-19T03:02:14.969 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:42.066841+0000", 2024-04-19T03:02:14.969 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 32.837495691999997, 2024-04-19T03:02:14.969 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.021736267, 2024-04-19T03:02:14.969 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:02:14.969 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:14.969 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:02:14.969 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.969 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:02:14.969 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.066841+0000", 2024-04-19T03:02:14.969 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:14.969 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.969 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.970 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:02:14.970 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.066841+0000", 2024-04-19T03:02:14.970 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:14.970 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.970 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.970 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:02:14.970 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.066841+0000", 2024-04-19T03:02:14.970 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:14.970 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.970 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.970 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:02:14.970 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.066876+0000", 2024-04-19T03:02:14.970 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.4790999999999999e-05 2024-04-19T03:02:14.970 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.971 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.971 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:02:14.971 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.066880+0000", 2024-04-19T03:02:14.971 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.3610000000000003e-06 2024-04-19T03:02:14.971 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.971 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.971 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:02:14.971 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.066883+0000", 2024-04-19T03:02:14.971 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.4079999999999998e-06 2024-04-19T03:02:14.971 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.971 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.972 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:14.972 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.066929+0000", 2024-04-19T03:02:14.972 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.5444000000000001e-05 2024-04-19T03:02:14.972 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.972 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.972 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:02:14.972 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.066951+0000", 2024-04-19T03:02:14.972 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.2578999999999998e-05 2024-04-19T03:02:14.972 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.972 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.972 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:02:14.972 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.088518+0000", 2024-04-19T03:02:14.972 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.021566617 2024-04-19T03:02:14.972 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.973 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.973 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:02:14.973 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.088578+0000", 2024-04-19T03:02:14.973 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.9655999999999999e-05 2024-04-19T03:02:14.973 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:14.973 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:02:14.973 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:14.973 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.973 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.973 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4755.0:11282 5.e e26/22 5:75b7c510:::benchmark_data_smithi096_19531_object11281:head v 26'698, mlcod=26'693)", 2024-04-19T03:02:14.973 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:42.066923+0000", 2024-04-19T03:02:14.973 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 32.837413824999999, 2024-04-19T03:02:14.973 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.027436461999999998, 2024-04-19T03:02:14.974 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:02:14.974 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:14.974 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:02:14.974 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.974 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:02:14.974 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.066923+0000", 2024-04-19T03:02:14.974 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:14.974 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.974 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.974 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:02:14.974 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.066923+0000", 2024-04-19T03:02:14.974 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:14.974 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.975 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.975 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:02:14.975 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.066923+0000", 2024-04-19T03:02:14.975 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:14.975 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.975 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.975 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:02:14.975 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.066955+0000", 2024-04-19T03:02:14.975 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.2060999999999997e-05 2024-04-19T03:02:14.975 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.975 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.975 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:02:14.975 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.066962+0000", 2024-04-19T03:02:14.976 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.1969999999999999e-06 2024-04-19T03:02:14.976 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.976 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.976 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:02:14.976 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.066967+0000", 2024-04-19T03:02:14.976 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.6589999999999998e-06 2024-04-19T03:02:14.976 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.976 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.976 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:14.976 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.067762+0000", 2024-04-19T03:02:14.976 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00079538199999999997 2024-04-19T03:02:14.976 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.977 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.977 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:02:14.977 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.067782+0000", 2024-04-19T03:02:14.977 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.9432999999999998e-05 2024-04-19T03:02:14.977 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.977 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.977 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:02:14.977 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.094339+0000", 2024-04-19T03:02:14.977 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.026556778999999999 2024-04-19T03:02:14.977 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.977 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.977 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:02:14.977 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.094360+0000", 2024-04-19T03:02:14.978 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.1246e-05 2024-04-19T03:02:14.978 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:14.978 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:02:14.978 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:14.978 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.978 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.978 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4755.0:11293 5.c 5:31728bfd:::benchmark_data_smithi096_19531_object11292:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T03:02:14.978 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:01:42.068359+0000", 2024-04-19T03:02:14.978 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 32.835978001000001, 2024-04-19T03:02:14.978 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.022306475999999999, 2024-04-19T03:02:14.978 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:02:14.978 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:14.978 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-04-19T03:02:14.979 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4755", 2024-04-19T03:02:14.979 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:14.979 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 11293 2024-04-19T03:02:14.979 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.979 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:02:14.979 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.979 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:02:14.979 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.068359+0000", 2024-04-19T03:02:14.979 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:14.979 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.979 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.979 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:02:14.979 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.068359+0000", 2024-04-19T03:02:14.980 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:14.980 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.980 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.980 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:02:14.980 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.068358+0000", 2024-04-19T03:02:14.980 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2024-04-19T03:02:14.980 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.980 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.980 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:02:14.980 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.068427+0000", 2024-04-19T03:02:14.980 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.9139000000000003e-05 2024-04-19T03:02:14.980 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.980 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.980 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:02:14.980 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.085292+0000", 2024-04-19T03:02:14.981 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.016864371 2024-04-19T03:02:14.981 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.981 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.981 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:02:14.981 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.085306+0000", 2024-04-19T03:02:14.981 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.434e-05 2024-04-19T03:02:14.981 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.981 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.981 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:14.981 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.085404+0000", 2024-04-19T03:02:14.981 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.8145000000000003e-05 2024-04-19T03:02:14.981 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.981 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.981 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:02:14.982 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.085569+0000", 2024-04-19T03:02:14.982 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00016504099999999999 2024-04-19T03:02:14.982 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.982 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.982 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-04-19T03:02:14.982 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.085739+0000", 2024-04-19T03:02:14.982 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000170099 2024-04-19T03:02:14.982 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.982 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.982 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:02:14.982 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.089603+0000", 2024-04-19T03:02:14.982 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0038636080000000001 2024-04-19T03:02:14.982 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.983 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.983 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:14.983 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.090578+0000", 2024-04-19T03:02:14.983 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00097513199999999997 2024-04-19T03:02:14.983 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.983 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.983 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:02:14.983 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.090618+0000", 2024-04-19T03:02:14.983 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.9987999999999997e-05 2024-04-19T03:02:14.983 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.983 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.983 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:02:14.983 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:01:42.090666+0000", 2024-04-19T03:02:14.984 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.7420999999999999e-05 2024-04-19T03:02:14.984 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:14.984 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:02:14.984 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:14.984 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.984 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.984 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4755.0:60384 5.a 5:55675f1d:::benchmark_data_smithi096_19531_object60383:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-19T03:02:14.984 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:02:05.864278+0000", 2024-04-19T03:02:14.984 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 9.0400591519999995, 2024-04-19T03:02:14.984 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.021786224999999999, 2024-04-19T03:02:14.984 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:02:14.984 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:14.985 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-04-19T03:02:14.985 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4755", 2024-04-19T03:02:14.985 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:14.985 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 60384 2024-04-19T03:02:14.985 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.985 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:02:14.985 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.985 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:02:14.985 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:05.864278+0000", 2024-04-19T03:02:14.985 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:14.985 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.985 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.985 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:02:14.986 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:05.864278+0000", 2024-04-19T03:02:14.986 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:14.986 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.986 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.986 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:02:14.986 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:05.864277+0000", 2024-04-19T03:02:14.986 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:14.986 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.986 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.986 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:02:14.986 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:05.864344+0000", 2024-04-19T03:02:14.986 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.7392999999999997e-05 2024-04-19T03:02:14.986 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.987 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.987 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:02:14.987 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:05.864355+0000", 2024-04-19T03:02:14.987 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1083999999999999e-05 2024-04-19T03:02:14.987 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.987 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.987 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:02:14.987 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:05.864363+0000", 2024-04-19T03:02:14.987 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.9529999999999999e-06 2024-04-19T03:02:14.987 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.987 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.987 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:14.987 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:05.865979+0000", 2024-04-19T03:02:14.987 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001616159 2024-04-19T03:02:14.988 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.988 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.988 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:02:14.988 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:05.866059+0000", 2024-04-19T03:02:14.988 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.0343e-05 2024-04-19T03:02:14.988 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.988 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.988 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 1", 2024-04-19T03:02:14.988 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:05.866179+0000", 2024-04-19T03:02:14.988 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000119072 2024-04-19T03:02:14.988 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.988 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.988 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:14.988 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:05.875531+0000", 2024-04-19T03:02:14.989 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0093528770000000008 2024-04-19T03:02:14.989 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.989 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.989 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:02:14.989 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:05.885821+0000", 2024-04-19T03:02:14.989 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0102892 2024-04-19T03:02:14.989 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.989 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.989 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:02:14.989 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:05.886025+0000", 2024-04-19T03:02:14.989 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000204086 2024-04-19T03:02:14.989 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.989 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.989 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:02:14.990 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:05.886064+0000", 2024-04-19T03:02:14.990 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.9458000000000001e-05 2024-04-19T03:02:14.990 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:14.990 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:02:14.990 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:14.990 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.990 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.990 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4755.0:60674 5.5 5:aaf3a5ff:::benchmark_data_smithi096_19531_object60673:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-19T03:02:14.990 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:02:06.038509+0000", 2024-04-19T03:02:14.990 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 8.8658281609999996, 2024-04-19T03:02:14.990 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.024267756000000001, 2024-04-19T03:02:14.990 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:02:14.990 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:14.991 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-04-19T03:02:14.991 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4755", 2024-04-19T03:02:14.991 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:14.991 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 60674 2024-04-19T03:02:14.991 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.991 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:02:14.991 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.991 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:02:14.991 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.038509+0000", 2024-04-19T03:02:14.991 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:14.991 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.991 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.991 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:02:14.991 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.038509+0000", 2024-04-19T03:02:14.992 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:14.992 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.992 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.992 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:02:14.992 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.038507+0000", 2024-04-19T03:02:14.992 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999981 2024-04-19T03:02:14.992 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.992 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.992 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:02:14.992 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.038584+0000", 2024-04-19T03:02:14.992 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.6947999999999996e-05 2024-04-19T03:02:14.992 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.992 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.993 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:02:14.993 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.038597+0000", 2024-04-19T03:02:14.993 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2863e-05 2024-04-19T03:02:14.993 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.993 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.993 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:02:14.993 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.038606+0000", 2024-04-19T03:02:14.993 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.9209999999999998e-06 2024-04-19T03:02:14.993 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.993 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.993 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:14.993 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.041247+0000", 2024-04-19T03:02:14.993 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0026412720000000001 2024-04-19T03:02:14.994 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.994 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.994 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:02:14.994 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.041436+0000", 2024-04-19T03:02:14.994 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00018870599999999999 2024-04-19T03:02:14.994 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.994 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.994 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-04-19T03:02:14.994 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.041636+0000", 2024-04-19T03:02:14.994 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00020026399999999999 2024-04-19T03:02:14.994 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.995 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.995 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:14.995 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.048757+0000", 2024-04-19T03:02:14.995 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0071207620000000001 2024-04-19T03:02:14.995 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.995 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.995 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:02:14.995 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.062687+0000", 2024-04-19T03:02:14.995 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.013929811 2024-04-19T03:02:14.995 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.995 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.995 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:02:14.995 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.062740+0000", 2024-04-19T03:02:14.996 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.3735e-05 2024-04-19T03:02:14.996 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.996 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.996 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:02:14.996 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.062777+0000", 2024-04-19T03:02:14.996 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.6366999999999999e-05 2024-04-19T03:02:14.996 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:14.996 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:02:14.996 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:14.996 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.996 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.996 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4755.0:60677 5.5 5:aad57123:::benchmark_data_smithi096_19531_object60676:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-19T03:02:14.996 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:02:06.039077+0000", 2024-04-19T03:02:14.997 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 8.8652597259999997, 2024-04-19T03:02:14.997 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.023852720000000001, 2024-04-19T03:02:14.997 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:02:14.997 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:14.997 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-04-19T03:02:14.997 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4755", 2024-04-19T03:02:14.997 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:14.997 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 60677 2024-04-19T03:02:14.997 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.997 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:02:14.997 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.997 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:02:14.998 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.039077+0000", 2024-04-19T03:02:14.998 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:14.998 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.998 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.998 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:02:14.998 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.039077+0000", 2024-04-19T03:02:14.998 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:14.998 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.998 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.998 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:02:14.998 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.039076+0000", 2024-04-19T03:02:14.998 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2024-04-19T03:02:14.999 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.999 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.999 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:02:14.999 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.039158+0000", 2024-04-19T03:02:14.999 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.1310000000000006e-05 2024-04-19T03:02:14.999 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.999 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.999 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:02:14.999 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.039171+0000", 2024-04-19T03:02:14.999 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.3010000000000001e-05 2024-04-19T03:02:14.999 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:14.999 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:14.999 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:02:14.999 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.039178+0000", 2024-04-19T03:02:15.000 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.8519999999999998e-06 2024-04-19T03:02:15.000 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:15.000 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:15.000 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:15.000 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.048813+0000", 2024-04-19T03:02:15.000 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0096353600000000008 2024-04-19T03:02:15.000 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:15.000 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:15.000 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:02:15.000 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.048986+0000", 2024-04-19T03:02:15.000 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000173234 2024-04-19T03:02:15.000 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:15.000 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:15.000 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-04-19T03:02:15.001 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.049147+0000", 2024-04-19T03:02:15.001 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00016059000000000001 2024-04-19T03:02:15.001 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:15.001 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:15.001 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:02:15.001 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.062805+0000", 2024-04-19T03:02:15.001 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.013658267999999999 2024-04-19T03:02:15.001 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:15.001 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:15.001 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:15.001 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.062858+0000", 2024-04-19T03:02:15.001 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.3177999999999998e-05 2024-04-19T03:02:15.001 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:15.001 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:15.002 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:02:15.002 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.062903+0000", 2024-04-19T03:02:15.002 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.4336999999999999e-05 2024-04-19T03:02:15.002 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:15.002 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:15.002 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:02:15.002 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.062930+0000", 2024-04-19T03:02:15.002 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.7492e-05 2024-04-19T03:02:15.002 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:15.002 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:02:15.002 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:15.002 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:15.002 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:15.003 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4755.0:60686 5.5 5:a9caa390:::benchmark_data_smithi096_19531_object60685:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-19T03:02:15.003 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:02:06.044469+0000", 2024-04-19T03:02:15.003 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 8.8598684510000005, 2024-04-19T03:02:15.003 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.021099772999999999, 2024-04-19T03:02:15.003 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:02:15.003 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:15.003 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-04-19T03:02:15.003 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4755", 2024-04-19T03:02:15.003 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:15.003 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 60686 2024-04-19T03:02:15.003 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:15.003 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:02:15.003 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:15.004 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:02:15.004 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.044469+0000", 2024-04-19T03:02:15.004 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:15.004 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:15.004 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:15.004 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:02:15.004 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.044469+0000", 2024-04-19T03:02:15.004 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:15.004 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:15.004 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:15.004 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:02:15.004 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.044467+0000", 2024-04-19T03:02:15.004 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:15.004 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:15.005 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:15.005 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:02:15.005 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.044516+0000", 2024-04-19T03:02:15.005 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.9143e-05 2024-04-19T03:02:15.005 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:15.005 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:15.005 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:02:15.005 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.044530+0000", 2024-04-19T03:02:15.005 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.3526000000000001e-05 2024-04-19T03:02:15.005 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:15.005 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:15.005 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:02:15.005 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.044537+0000", 2024-04-19T03:02:15.005 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.8990000000000004e-06 2024-04-19T03:02:15.006 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:15.006 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:15.006 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:15.006 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.054411+0000", 2024-04-19T03:02:15.006 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0098746949999999993 2024-04-19T03:02:15.006 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:15.006 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:15.006 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:02:15.006 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.054606+0000", 2024-04-19T03:02:15.006 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00019422100000000001 2024-04-19T03:02:15.006 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:15.006 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:15.007 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-04-19T03:02:15.007 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.054848+0000", 2024-04-19T03:02:15.007 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00024189799999999999 2024-04-19T03:02:15.007 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:15.007 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:15.007 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:02:15.007 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.063095+0000", 2024-04-19T03:02:15.007 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0082472020000000004 2024-04-19T03:02:15.007 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:15.007 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:15.007 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:15.007 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.065481+0000", 2024-04-19T03:02:15.007 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00238623 2024-04-19T03:02:15.007 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:15.008 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:15.008 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:02:15.008 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.065532+0000", 2024-04-19T03:02:15.008 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.0509e-05 2024-04-19T03:02:15.008 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:15.008 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:15.008 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:02:15.008 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.065568+0000", 2024-04-19T03:02:15.008 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.6876999999999999e-05 2024-04-19T03:02:15.008 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:15.008 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:02:15.008 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:15.009 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:15.009 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:15.009 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4755.0:60689 5.5 5:adf8d35d:::benchmark_data_smithi096_19531_object60688:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-19T03:02:15.009 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:02:06.047459+0000", 2024-04-19T03:02:15.009 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 8.8568783900000003, 2024-04-19T03:02:15.009 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.021837532, 2024-04-19T03:02:15.009 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:02:15.009 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:15.009 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-04-19T03:02:15.009 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4755", 2024-04-19T03:02:15.009 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:15.010 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 60689 2024-04-19T03:02:15.010 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:15.010 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:02:15.010 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:15.010 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:02:15.010 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.047459+0000", 2024-04-19T03:02:15.010 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:15.010 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:15.010 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:15.010 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:02:15.011 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.047459+0000", 2024-04-19T03:02:15.011 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:15.011 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:15.011 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:15.011 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:02:15.011 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.047458+0000", 2024-04-19T03:02:15.011 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2024-04-19T03:02:15.011 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:15.012 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:15.012 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:02:15.012 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.047527+0000", 2024-04-19T03:02:15.012 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.9114000000000003e-05 2024-04-19T03:02:15.012 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:15.012 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:15.012 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:02:15.012 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.047538+0000", 2024-04-19T03:02:15.012 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.094e-05 2024-04-19T03:02:15.012 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:15.012 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:15.012 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:02:15.013 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.047542+0000", 2024-04-19T03:02:15.013 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.4689999999999999e-06 2024-04-19T03:02:15.013 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:15.013 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:15.013 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:15.013 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.059742+0000", 2024-04-19T03:02:15.013 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.012200103 2024-04-19T03:02:15.013 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:15.013 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:15.013 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:02:15.013 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.059904+0000", 2024-04-19T03:02:15.013 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00016191900000000001 2024-04-19T03:02:15.013 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:15.013 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:15.014 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-04-19T03:02:15.014 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.060079+0000", 2024-04-19T03:02:15.014 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00017477500000000001 2024-04-19T03:02:15.014 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:15.014 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:15.014 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:15.014 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.067922+0000", 2024-04-19T03:02:15.014 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0078434720000000006 2024-04-19T03:02:15.014 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:15.014 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:15.014 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:02:15.014 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.069163+0000", 2024-04-19T03:02:15.014 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0012401389999999999 2024-04-19T03:02:15.015 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:15.015 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:15.015 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:02:15.015 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.069238+0000", 2024-04-19T03:02:15.015 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.4955000000000003e-05 2024-04-19T03:02:15.015 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:15.015 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:15.015 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:02:15.015 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.069296+0000", 2024-04-19T03:02:15.015 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.8726e-05 2024-04-19T03:02:15.015 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:15.015 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:02:15.015 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:15.015 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:15.016 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:15.016 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4755.0:60746 5.6 5:68292fbc:::benchmark_data_smithi096_19531_object60745:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-19T03:02:15.016 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:02:06.088145+0000", 2024-04-19T03:02:15.016 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 8.81619229, 2024-04-19T03:02:15.016 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.021267332, 2024-04-19T03:02:15.016 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:02:15.016 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:15.016 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-04-19T03:02:15.016 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4755", 2024-04-19T03:02:15.016 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:15.016 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 60746 2024-04-19T03:02:15.016 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:15.016 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:02:15.017 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:15.017 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:02:15.017 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.088145+0000", 2024-04-19T03:02:15.017 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:15.017 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:15.017 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:15.017 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:02:15.017 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.088145+0000", 2024-04-19T03:02:15.017 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:15.017 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:15.017 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:15.017 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:02:15.017 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.088144+0000", 2024-04-19T03:02:15.018 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2024-04-19T03:02:15.018 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:15.018 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:15.018 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:02:15.018 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.088187+0000", 2024-04-19T03:02:15.018 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.337e-05 2024-04-19T03:02:15.018 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:15.018 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:15.018 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:02:15.018 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.088199+0000", 2024-04-19T03:02:15.018 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.1654999999999999e-05 2024-04-19T03:02:15.018 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:15.019 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:15.019 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:02:15.019 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.088205+0000", 2024-04-19T03:02:15.019 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.3840000000000002e-06 2024-04-19T03:02:15.019 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:15.019 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:15.019 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:15.019 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.095361+0000", 2024-04-19T03:02:15.019 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0071557799999999996 2024-04-19T03:02:15.019 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:15.019 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:15.019 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:02:15.019 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.095490+0000", 2024-04-19T03:02:15.020 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012866700000000001 2024-04-19T03:02:15.020 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:15.020 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:15.020 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-04-19T03:02:15.020 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.095629+0000", 2024-04-19T03:02:15.020 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000139529 2024-04-19T03:02:15.020 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:15.020 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:15.020 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:02:15.020 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.101867+0000", 2024-04-19T03:02:15.020 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0062376259999999996 2024-04-19T03:02:15.020 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:15.020 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:15.020 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:15.021 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.109360+0000", 2024-04-19T03:02:15.021 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0074929799999999998 2024-04-19T03:02:15.021 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:15.021 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:15.021 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:02:15.021 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.109389+0000", 2024-04-19T03:02:15.021 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.8759999999999999e-05 2024-04-19T03:02:15.021 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:15.021 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:15.021 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:02:15.021 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:06.109412+0000", 2024-04-19T03:02:15.022 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.3354999999999999e-05 2024-04-19T03:02:15.022 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:15.022 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:02:15.022 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:15.022 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:15.022 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:15.022 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4755.0:67705 5.3 5:cee6fde7:::benchmark_data_smithi096_19531_object67704:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T03:02:15.022 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:02:10.204519+0000", 2024-04-19T03:02:15.022 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 4.6998178910000004, 2024-04-19T03:02:15.022 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.023064485999999999, 2024-04-19T03:02:15.022 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:02:15.022 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:15.023 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-04-19T03:02:15.023 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4755", 2024-04-19T03:02:15.023 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:15.023 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 67705 2024-04-19T03:02:15.023 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:15.023 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:02:15.023 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:15.023 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:02:15.023 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:10.204519+0000", 2024-04-19T03:02:15.023 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:15.023 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:15.023 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:15.023 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:02:15.023 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:10.204519+0000", 2024-04-19T03:02:15.024 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:15.024 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:15.024 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:15.024 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:02:15.024 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:10.204519+0000", 2024-04-19T03:02:15.024 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:15.024 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:15.024 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:15.024 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:02:15.024 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:10.204549+0000", 2024-04-19T03:02:15.024 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0479000000000001e-05 2024-04-19T03:02:15.024 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:15.024 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:15.024 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:02:15.025 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:10.204557+0000", 2024-04-19T03:02:15.025 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.5039999999999996e-06 2024-04-19T03:02:15.025 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:15.025 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:15.025 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:02:15.025 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:10.204562+0000", 2024-04-19T03:02:15.025 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.305e-06 2024-04-19T03:02:15.025 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:15.025 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:15.025 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:15.025 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:10.215382+0000", 2024-04-19T03:02:15.026 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.010820348 2024-04-19T03:02:15.026 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:15.026 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:15.026 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:02:15.026 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:10.215604+0000", 2024-04-19T03:02:15.026 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000221645 2024-04-19T03:02:15.026 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:15.026 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:15.026 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-04-19T03:02:15.026 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:10.215775+0000", 2024-04-19T03:02:15.027 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00017157500000000001 2024-04-19T03:02:15.027 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:15.027 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:15.027 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:15.027 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:10.227474+0000", 2024-04-19T03:02:15.027 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.011699016 2024-04-19T03:02:15.027 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:15.027 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:15.027 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:02:15.027 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:10.227491+0000", 2024-04-19T03:02:15.027 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.6977999999999999e-05 2024-04-19T03:02:15.027 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:15.028 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:15.028 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:02:15.028 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:10.227546+0000", 2024-04-19T03:02:15.028 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.4768000000000001e-05 2024-04-19T03:02:15.028 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:15.028 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:15.028 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:02:15.029 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:10.227584+0000", 2024-04-19T03:02:15.029 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.7512000000000003e-05 2024-04-19T03:02:15.029 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:15.029 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:02:15.029 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:15.029 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:15.029 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:15.029 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4755.0:67724 5.3 5:cd75df27:::benchmark_data_smithi096_19531_object67723:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T03:02:15.029 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:02:10.213723+0000", 2024-04-19T03:02:15.029 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 4.6906138730000002, 2024-04-19T03:02:15.029 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.021797713999999999, 2024-04-19T03:02:15.029 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:02:15.030 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:15.030 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-04-19T03:02:15.030 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4755", 2024-04-19T03:02:15.030 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:15.030 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 67724 2024-04-19T03:02:15.030 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:15.030 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:02:15.030 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:15.030 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:02:15.031 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:10.213723+0000", 2024-04-19T03:02:15.031 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:15.031 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:15.031 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:15.031 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:02:15.031 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:10.213723+0000", 2024-04-19T03:02:15.031 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:15.031 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:15.031 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:15.031 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:02:15.031 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:10.213722+0000", 2024-04-19T03:02:15.032 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:15.032 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:15.032 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:15.032 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:02:15.032 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:10.213757+0000", 2024-04-19T03:02:15.032 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.5348000000000001e-05 2024-04-19T03:02:15.032 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:15.032 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:15.032 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:02:15.032 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:10.213770+0000", 2024-04-19T03:02:15.032 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2663999999999999e-05 2024-04-19T03:02:15.032 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:15.033 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:15.033 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:02:15.033 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:10.213778+0000", 2024-04-19T03:02:15.033 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.1629999999999996e-06 2024-04-19T03:02:15.033 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:15.033 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:15.033 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:15.034 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:10.227880+0000", 2024-04-19T03:02:15.034 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.014102412999999999 2024-04-19T03:02:15.034 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:15.034 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:15.034 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:02:15.034 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:10.227978+0000", 2024-04-19T03:02:15.035 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.7112000000000001e-05 2024-04-19T03:02:15.035 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:15.035 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:15.035 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-04-19T03:02:15.035 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:10.228067+0000", 2024-04-19T03:02:15.035 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.9346999999999997e-05 2024-04-19T03:02:15.035 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:15.036 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:15.036 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:02:15.036 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:10.231243+0000", 2024-04-19T03:02:15.036 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0031756699999999998 2024-04-19T03:02:15.036 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:15.036 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:15.037 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:15.037 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:10.235440+0000", 2024-04-19T03:02:15.037 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0041977890000000004 2024-04-19T03:02:15.037 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:15.037 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:15.037 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:02:15.038 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:10.235474+0000", 2024-04-19T03:02:15.038 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.3324000000000001e-05 2024-04-19T03:02:15.038 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:15.038 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:15.038 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:02:15.038 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:10.235521+0000", 2024-04-19T03:02:15.039 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.7318999999999999e-05 2024-04-19T03:02:15.039 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:15.039 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:02:15.039 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:15.039 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:15.039 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:02:15.039 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-04-19T03:02:15.041 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:15.037+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:15.042 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T03:02:15.142 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-04-19T03:02:15.138+0000 7f35986ab700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18243) UID: 0 2024-04-19T03:02:15.157 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-19T03:02:15.158 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-04-19T03:02:15.158 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 0 2024-04-19T03:02:15.158 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-19T03:02:15.167 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T03:02:15.198 INFO:teuthology.orchestra.run.smithi096.stderr:nodeep-scrub is set 2024-04-19T03:02:15.242 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:15.241+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:15.289 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-19T03:02:15.289 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-04-19T03:02:15.289 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-04-19T03:02:15.289 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-04-19T03:02:15.289 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-19T03:02:15.301 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T03:02:15.343 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-04-19T03:02:15.342+0000 7f35986ab700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18243) UID: 0 2024-04-19T03:02:15.423 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-19T03:02:15.427 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-19T03:02:15.427 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-04-19T03:02:15.427 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-04-19T03:02:15.427 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-04-19T03:02:15.427 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.427 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:10 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:02:15.427 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:14.999496+0000", 2024-04-19T03:02:15.428 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 60.424956897000001, 2024-04-19T03:02:15.428 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.022720497999999999, 2024-04-19T03:02:15.428 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:15.428 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:15.428 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:15.428 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.428 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:15.428 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999496+0000", 2024-04-19T03:02:15.428 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:15.428 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.428 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.428 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:15.428 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999496+0000", 2024-04-19T03:02:15.428 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:15.428 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.429 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.429 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:15.429 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999494+0000", 2024-04-19T03:02:15.429 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:15.429 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.429 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.429 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:15.429 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999503+0000", 2024-04-19T03:02:15.429 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.5930000000000006e-06 2024-04-19T03:02:15.429 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.429 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.429 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:15.429 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999523+0000", 2024-04-19T03:02:15.429 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9553000000000001e-05 2024-04-19T03:02:15.430 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.430 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.430 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:15.430 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999538+0000", 2024-04-19T03:02:15.430 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5702999999999999e-05 2024-04-19T03:02:15.430 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.430 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.430 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:15.430 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999608+0000", 2024-04-19T03:02:15.430 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.9912000000000004e-05 2024-04-19T03:02:15.430 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.430 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.430 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op must wait for map", 2024-04-19T03:02:15.430 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999626+0000", 2024-04-19T03:02:15.431 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8207e-05 2024-04-19T03:02:15.431 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.431 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.431 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:15.431 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.010765+0000", 2024-04-19T03:02:15.431 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011138719 2024-04-19T03:02:15.431 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.431 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.431 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:15.431 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.010906+0000", 2024-04-19T03:02:15.431 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014095899999999999 2024-04-19T03:02:15.431 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.431 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.432 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-04-19T03:02:15.432 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.011472+0000", 2024-04-19T03:02:15.432 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00056629300000000005 2024-04-19T03:02:15.432 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.432 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.432 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:15.432 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.013217+0000", 2024-04-19T03:02:15.432 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001744317 2024-04-19T03:02:15.432 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.432 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.432 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:15.432 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.022083+0000", 2024-04-19T03:02:15.432 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0088663849999999992 2024-04-19T03:02:15.433 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.433 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.433 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:15.433 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.022124+0000", 2024-04-19T03:02:15.433 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.057e-05 2024-04-19T03:02:15.433 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.433 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.433 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:15.433 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.022216+0000", 2024-04-19T03:02:15.433 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.2417000000000006e-05 2024-04-19T03:02:15.433 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:15.433 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:15.433 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:15.434 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.434 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.434 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:32 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:02:15.434 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:14.999712+0000", 2024-04-19T03:02:15.434 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 60.424740653999997, 2024-04-19T03:02:15.434 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.022635437000000001, 2024-04-19T03:02:15.434 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:15.434 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:15.434 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:15.434 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.434 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:15.434 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999712+0000", 2024-04-19T03:02:15.434 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:15.435 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.435 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.435 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:15.435 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999712+0000", 2024-04-19T03:02:15.435 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:15.435 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.435 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.435 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:15.435 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999711+0000", 2024-04-19T03:02:15.435 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:15.435 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.435 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.435 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:15.435 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999719+0000", 2024-04-19T03:02:15.436 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.354e-06 2024-04-19T03:02:15.436 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.436 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.436 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:15.436 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999735+0000", 2024-04-19T03:02:15.436 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6288999999999999e-05 2024-04-19T03:02:15.436 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.436 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.436 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:15.436 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999749+0000", 2024-04-19T03:02:15.436 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3492999999999999e-05 2024-04-19T03:02:15.436 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.436 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.437 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:15.437 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999811+0000", 2024-04-19T03:02:15.437 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2298999999999994e-05 2024-04-19T03:02:15.437 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.437 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.437 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:02:15.437 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999817+0000", 2024-04-19T03:02:15.437 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2169999999999999e-06 2024-04-19T03:02:15.437 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.437 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.437 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:15.437 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.011836+0000", 2024-04-19T03:02:15.437 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.012018008 2024-04-19T03:02:15.437 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.438 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.438 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:15.438 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.011897+0000", 2024-04-19T03:02:15.438 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1111000000000005e-05 2024-04-19T03:02:15.438 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.438 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.438 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-04-19T03:02:15.438 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.011980+0000", 2024-04-19T03:02:15.438 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3003999999999993e-05 2024-04-19T03:02:15.438 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.438 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.438 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:15.438 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.013863+0000", 2024-04-19T03:02:15.439 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001883804 2024-04-19T03:02:15.439 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.439 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.439 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:15.439 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.022257+0000", 2024-04-19T03:02:15.439 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0083938290000000002 2024-04-19T03:02:15.439 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.439 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.439 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:15.439 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.022310+0000", 2024-04-19T03:02:15.439 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.236e-05 2024-04-19T03:02:15.439 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.439 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.439 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:15.440 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.022347+0000", 2024-04-19T03:02:15.440 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7653e-05 2024-04-19T03:02:15.440 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:15.440 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:15.440 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:15.440 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.440 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.440 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:24 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:02:15.440 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:14.999964+0000", 2024-04-19T03:02:15.440 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 60.424488975999999, 2024-04-19T03:02:15.440 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020451446000000002, 2024-04-19T03:02:15.440 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:15.440 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-19T03:02:15.440 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:15.441 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.441 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:15.441 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999964+0000", 2024-04-19T03:02:15.441 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:15.441 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.441 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.441 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:15.441 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999964+0000", 2024-04-19T03:02:15.441 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:15.441 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.441 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.441 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:15.441 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999963+0000", 2024-04-19T03:02:15.442 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:15.442 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.442 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.442 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:15.442 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999969+0000", 2024-04-19T03:02:15.442 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0270000000000001e-06 2024-04-19T03:02:15.442 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.442 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.442 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:15.442 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999984+0000", 2024-04-19T03:02:15.442 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5903e-05 2024-04-19T03:02:15.442 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.442 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.443 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:15.443 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999998+0000", 2024-04-19T03:02:15.443 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3076e-05 2024-04-19T03:02:15.443 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.443 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.443 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:15.443 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.000078+0000", 2024-04-19T03:02:15.443 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0525000000000006e-05 2024-04-19T03:02:15.443 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.443 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.443 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op must wait for map", 2024-04-19T03:02:15.443 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.000084+0000", 2024-04-19T03:02:15.443 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8370000000000002e-06 2024-04-19T03:02:15.443 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.443 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.444 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:15.444 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.008819+0000", 2024-04-19T03:02:15.444 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0087349019999999993 2024-04-19T03:02:15.444 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.444 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.444 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:15.444 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.009018+0000", 2024-04-19T03:02:15.444 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000198989 2024-04-19T03:02:15.444 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.444 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.444 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:15.444 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.020415+0000", 2024-04-19T03:02:15.444 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011397157 2024-04-19T03:02:15.444 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:15.445 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:15.445 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:15.445 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.445 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.445 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:11274 5.e 5:7c846032:::benchmark_data_smithi096_19531_object11273:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T03:02:15.445 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:42.061776+0000", 2024-04-19T03:02:15.445 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 33.362676731000001, 2024-04-19T03:02:15.445 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.035381001000000002, 2024-04-19T03:02:15.445 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:15.445 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:15.445 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:15.445 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:15.445 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:15.445 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 11274 2024-04-19T03:02:15.446 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.446 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:15.446 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.446 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:15.446 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.061776+0000", 2024-04-19T03:02:15.446 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:15.446 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.446 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.446 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:15.446 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.061776+0000", 2024-04-19T03:02:15.446 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:15.446 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.446 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.447 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:15.447 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.061775+0000", 2024-04-19T03:02:15.447 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:15.447 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.447 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.447 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:15.447 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.061807+0000", 2024-04-19T03:02:15.447 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1733000000000003e-05 2024-04-19T03:02:15.447 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.447 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.447 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:15.447 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.061822+0000", 2024-04-19T03:02:15.447 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5452999999999999e-05 2024-04-19T03:02:15.447 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.448 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.448 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:15.448 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.061827+0000", 2024-04-19T03:02:15.448 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9810000000000003e-06 2024-04-19T03:02:15.448 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.448 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.448 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:15.448 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.063388+0000", 2024-04-19T03:02:15.448 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0015605720000000001 2024-04-19T03:02:15.448 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.448 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.448 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:15.448 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.063612+0000", 2024-04-19T03:02:15.448 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00022431 2024-04-19T03:02:15.449 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.449 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.449 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:15.449 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.063747+0000", 2024-04-19T03:02:15.449 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013459600000000001 2024-04-19T03:02:15.449 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.449 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.449 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:15.449 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.066186+0000", 2024-04-19T03:02:15.449 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0024388909999999999 2024-04-19T03:02:15.449 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.449 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.449 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:15.449 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.097016+0000", 2024-04-19T03:02:15.450 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.030830705 2024-04-19T03:02:15.450 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.450 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.450 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:15.450 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.097096+0000", 2024-04-19T03:02:15.450 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.9469999999999996e-05 2024-04-19T03:02:15.450 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.450 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.450 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:15.450 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.097157+0000", 2024-04-19T03:02:15.450 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0884999999999997e-05 2024-04-19T03:02:15.450 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:15.450 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:15.450 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:15.451 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.451 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.451 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:11279 5.8 5:10b60c58:::benchmark_data_smithi096_19531_object11278:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T03:02:15.451 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:42.062594+0000", 2024-04-19T03:02:15.451 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 33.361858292999997, 2024-04-19T03:02:15.451 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.028696788000000001, 2024-04-19T03:02:15.451 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:15.451 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:15.451 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:15.451 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:15.451 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:15.451 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 11279 2024-04-19T03:02:15.451 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.452 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:15.452 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.452 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:15.452 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.062594+0000", 2024-04-19T03:02:15.452 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:15.452 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.452 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.452 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:15.452 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.062594+0000", 2024-04-19T03:02:15.452 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:15.452 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.452 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.452 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:15.452 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.062593+0000", 2024-04-19T03:02:15.453 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:15.453 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.453 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.453 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:15.453 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.062646+0000", 2024-04-19T03:02:15.453 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2293999999999998e-05 2024-04-19T03:02:15.453 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.453 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.453 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:15.453 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.062657+0000", 2024-04-19T03:02:15.453 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1440000000000001e-05 2024-04-19T03:02:15.453 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.453 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.453 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:15.454 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.062665+0000", 2024-04-19T03:02:15.454 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5159999999999997e-06 2024-04-19T03:02:15.454 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.454 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.454 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:15.454 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.063799+0000", 2024-04-19T03:02:15.454 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0011344860000000001 2024-04-19T03:02:15.454 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.454 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.454 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:15.454 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.063962+0000", 2024-04-19T03:02:15.454 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000162614 2024-04-19T03:02:15.454 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.455 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.455 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:15.455 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.064167+0000", 2024-04-19T03:02:15.455 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00020491699999999999 2024-04-19T03:02:15.455 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.455 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.455 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:15.455 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.066768+0000", 2024-04-19T03:02:15.455 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0026012090000000002 2024-04-19T03:02:15.455 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.455 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.455 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:15.456 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.091184+0000", 2024-04-19T03:02:15.456 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.024416582999999999 2024-04-19T03:02:15.456 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.456 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.456 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:15.456 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.091251+0000", 2024-04-19T03:02:15.456 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6753000000000003e-05 2024-04-19T03:02:15.456 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.456 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.456 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:15.456 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.091291+0000", 2024-04-19T03:02:15.456 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9841e-05 2024-04-19T03:02:15.456 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:15.456 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:15.457 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:15.457 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.457 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.457 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:11282 5.e 5:75b7c510:::benchmark_data_smithi096_19531_object11281:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T03:02:15.457 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:42.062674+0000", 2024-04-19T03:02:15.457 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 33.361778837000003, 2024-04-19T03:02:15.457 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.034812849, 2024-04-19T03:02:15.457 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:15.457 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:15.457 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:15.457 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:15.457 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:15.457 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 11282 2024-04-19T03:02:15.457 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.458 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:15.458 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.458 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:15.458 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.062674+0000", 2024-04-19T03:02:15.458 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:15.458 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.458 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.458 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:15.458 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.062674+0000", 2024-04-19T03:02:15.458 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:15.458 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.458 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.458 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:15.459 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.062673+0000", 2024-04-19T03:02:15.459 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:15.459 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.459 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.459 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:15.459 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.062712+0000", 2024-04-19T03:02:15.459 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9341999999999997e-05 2024-04-19T03:02:15.459 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.459 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.459 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:15.459 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.062721+0000", 2024-04-19T03:02:15.459 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1700000000000003e-06 2024-04-19T03:02:15.459 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.459 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.459 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:15.460 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.062729+0000", 2024-04-19T03:02:15.460 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4240000000000004e-06 2024-04-19T03:02:15.460 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.460 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.460 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:15.460 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.065017+0000", 2024-04-19T03:02:15.460 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0022878590000000002 2024-04-19T03:02:15.460 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.460 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.460 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:15.460 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.065207+0000", 2024-04-19T03:02:15.460 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000190411 2024-04-19T03:02:15.460 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.460 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.461 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:15.461 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.065323+0000", 2024-04-19T03:02:15.461 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000115593 2024-04-19T03:02:15.461 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.461 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.461 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:15.461 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.069683+0000", 2024-04-19T03:02:15.461 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0043604409999999996 2024-04-19T03:02:15.461 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.461 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.461 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:15.461 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.097273+0000", 2024-04-19T03:02:15.461 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.027589516000000001 2024-04-19T03:02:15.461 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.462 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.462 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:15.462 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.097406+0000", 2024-04-19T03:02:15.462 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000133514 2024-04-19T03:02:15.462 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.462 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.462 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:15.462 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.097486+0000", 2024-04-19T03:02:15.462 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0479e-05 2024-04-19T03:02:15.462 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:15.462 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:15.462 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:15.462 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.462 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.463 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:11288 5.0 5:042458d0:::benchmark_data_smithi096_19531_object11287:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T03:02:15.463 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:42.070352+0000", 2024-04-19T03:02:15.463 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 33.354100909000003, 2024-04-19T03:02:15.463 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.021532447, 2024-04-19T03:02:15.463 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:15.463 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:15.463 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:15.463 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:15.463 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:15.463 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 11288 2024-04-19T03:02:15.463 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.463 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:15.463 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.463 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:15.464 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.070352+0000", 2024-04-19T03:02:15.464 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:15.464 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.464 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.464 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:15.464 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.070352+0000", 2024-04-19T03:02:15.464 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:15.464 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.464 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.464 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:15.464 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.070351+0000", 2024-04-19T03:02:15.464 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:15.464 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.464 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.465 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:15.465 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.070392+0000", 2024-04-19T03:02:15.465 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1077e-05 2024-04-19T03:02:15.465 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.465 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.465 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:15.465 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.070398+0000", 2024-04-19T03:02:15.465 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1109999999999996e-06 2024-04-19T03:02:15.465 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.465 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.465 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:15.465 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.070402+0000", 2024-04-19T03:02:15.465 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2010000000000001e-06 2024-04-19T03:02:15.465 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.466 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.466 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:15.466 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.070445+0000", 2024-04-19T03:02:15.466 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2585e-05 2024-04-19T03:02:15.466 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.466 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.466 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:15.466 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.070572+0000", 2024-04-19T03:02:15.466 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012708500000000001 2024-04-19T03:02:15.466 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.466 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.466 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:15.466 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.070711+0000", 2024-04-19T03:02:15.466 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013848699999999999 2024-04-19T03:02:15.467 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.467 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.467 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:15.467 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.073505+0000", 2024-04-19T03:02:15.467 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0027944620000000002 2024-04-19T03:02:15.467 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.467 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.467 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:15.467 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.091806+0000", 2024-04-19T03:02:15.467 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.018301251000000001 2024-04-19T03:02:15.467 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.467 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.467 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:15.467 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.091854+0000", 2024-04-19T03:02:15.468 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7419000000000001e-05 2024-04-19T03:02:15.468 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.468 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.468 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:15.468 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.091884+0000", 2024-04-19T03:02:15.468 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0241999999999999e-05 2024-04-19T03:02:15.468 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:15.468 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:15.468 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:15.468 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.468 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.468 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:11292 5.0 5:009b2ea9:::benchmark_data_smithi096_19531_object11291:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T03:02:15.468 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:42.070676+0000", 2024-04-19T03:02:15.468 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 33.353776533999998, 2024-04-19T03:02:15.469 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.02219631, 2024-04-19T03:02:15.469 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:15.469 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:15.469 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:15.469 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:15.469 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:15.469 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 11292 2024-04-19T03:02:15.469 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.469 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:15.469 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.469 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:15.469 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.070676+0000", 2024-04-19T03:02:15.469 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:15.469 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.470 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.470 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:15.470 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.070676+0000", 2024-04-19T03:02:15.470 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:15.470 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.470 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.470 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:15.470 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.070675+0000", 2024-04-19T03:02:15.470 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:15.470 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.470 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.470 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:15.470 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.070800+0000", 2024-04-19T03:02:15.471 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000125263 2024-04-19T03:02:15.471 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.471 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.471 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:15.471 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.070808+0000", 2024-04-19T03:02:15.471 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0209999999999999e-06 2024-04-19T03:02:15.471 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.471 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.471 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:15.471 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.070814+0000", 2024-04-19T03:02:15.471 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0969999999999996e-06 2024-04-19T03:02:15.471 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.471 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.471 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:15.472 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.071956+0000", 2024-04-19T03:02:15.472 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0011427480000000001 2024-04-19T03:02:15.472 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.472 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.472 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:15.472 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.072153+0000", 2024-04-19T03:02:15.472 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000196524 2024-04-19T03:02:15.472 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.472 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.472 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:15.472 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.072312+0000", 2024-04-19T03:02:15.472 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015879300000000001 2024-04-19T03:02:15.472 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.472 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.473 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:15.473 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.078407+0000", 2024-04-19T03:02:15.473 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0060954929999999996 2024-04-19T03:02:15.473 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.473 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.473 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:15.473 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.092742+0000", 2024-04-19T03:02:15.473 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.014335349000000001 2024-04-19T03:02:15.473 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.473 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.473 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:15.473 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.092815+0000", 2024-04-19T03:02:15.473 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2881999999999998e-05 2024-04-19T03:02:15.473 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.474 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.474 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:15.474 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.092872+0000", 2024-04-19T03:02:15.474 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6965000000000001e-05 2024-04-19T03:02:15.474 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:15.474 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:15.474 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:15.474 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.474 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.474 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:11297 5.e 5:7975ecb6:::benchmark_data_smithi096_19531_object11296:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T03:02:15.474 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:42.076848+0000", 2024-04-19T03:02:15.474 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 33.347604654000001, 2024-04-19T03:02:15.474 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020867969, 2024-04-19T03:02:15.474 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:15.475 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:15.475 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:15.475 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:15.475 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:15.475 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 11297 2024-04-19T03:02:15.475 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.475 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:15.475 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.475 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:15.475 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.076848+0000", 2024-04-19T03:02:15.475 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:15.475 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.475 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.475 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:15.476 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.076848+0000", 2024-04-19T03:02:15.476 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:15.476 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.476 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.476 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:15.476 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.076846+0000", 2024-04-19T03:02:15.476 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:15.476 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.476 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.476 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:15.476 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.076894+0000", 2024-04-19T03:02:15.476 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7645000000000002e-05 2024-04-19T03:02:15.476 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.476 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.477 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:15.477 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.076913+0000", 2024-04-19T03:02:15.477 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8885e-05 2024-04-19T03:02:15.477 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.477 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.477 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:15.477 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.076924+0000", 2024-04-19T03:02:15.477 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.118e-05 2024-04-19T03:02:15.477 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.477 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.477 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:15.477 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.076983+0000", 2024-04-19T03:02:15.477 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8952000000000001e-05 2024-04-19T03:02:15.477 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.478 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.478 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:15.478 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.077156+0000", 2024-04-19T03:02:15.478 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00017307600000000001 2024-04-19T03:02:15.478 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.478 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.478 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:15.478 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.077358+0000", 2024-04-19T03:02:15.478 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000201991 2024-04-19T03:02:15.478 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.478 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.478 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:15.478 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.080885+0000", 2024-04-19T03:02:15.479 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0035268309999999998 2024-04-19T03:02:15.479 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.479 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.479 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:15.479 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.097569+0000", 2024-04-19T03:02:15.479 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.016683854000000001 2024-04-19T03:02:15.479 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.479 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.479 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:15.479 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.097647+0000", 2024-04-19T03:02:15.479 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.7823000000000004e-05 2024-04-19T03:02:15.479 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.479 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.479 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:15.479 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.097716+0000", 2024-04-19T03:02:15.480 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.9079999999999996e-05 2024-04-19T03:02:15.480 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:15.480 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:15.480 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:15.480 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.480 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.480 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:11298 5.e 5:72565f0a:::benchmark_data_smithi096_19531_object11297:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T03:02:15.480 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:42.076954+0000", 2024-04-19T03:02:15.480 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 33.347498780000002, 2024-04-19T03:02:15.480 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020950191999999999, 2024-04-19T03:02:15.480 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:15.480 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:15.480 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:15.481 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:15.481 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:15.481 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 11298 2024-04-19T03:02:15.481 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.481 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:15.481 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.481 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:15.481 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.076954+0000", 2024-04-19T03:02:15.481 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:15.481 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.481 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.481 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:15.481 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.076954+0000", 2024-04-19T03:02:15.481 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:15.482 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.482 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.482 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:15.482 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.076953+0000", 2024-04-19T03:02:15.482 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:15.482 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.482 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.482 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:15.482 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.076997+0000", 2024-04-19T03:02:15.482 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4023000000000002e-05 2024-04-19T03:02:15.482 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.482 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.482 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:15.483 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.077009+0000", 2024-04-19T03:02:15.483 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2456000000000001e-05 2024-04-19T03:02:15.483 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.483 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.483 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:15.483 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.077015+0000", 2024-04-19T03:02:15.483 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7950000000000004e-06 2024-04-19T03:02:15.483 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.483 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.483 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:15.483 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.078552+0000", 2024-04-19T03:02:15.483 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0015371320000000001 2024-04-19T03:02:15.483 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.483 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.484 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:15.484 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.078760+0000", 2024-04-19T03:02:15.484 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00020808799999999999 2024-04-19T03:02:15.484 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.484 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.484 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:15.484 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.078875+0000", 2024-04-19T03:02:15.484 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011457500000000001 2024-04-19T03:02:15.484 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.484 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.484 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:15.484 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.083603+0000", 2024-04-19T03:02:15.484 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0047276239999999997 2024-04-19T03:02:15.484 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.485 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.485 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:15.485 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.097783+0000", 2024-04-19T03:02:15.485 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.014180036 2024-04-19T03:02:15.485 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.485 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.485 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:15.485 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.097863+0000", 2024-04-19T03:02:15.485 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0317999999999999e-05 2024-04-19T03:02:15.485 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.485 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.485 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:15.486 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.097904+0000", 2024-04-19T03:02:15.486 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1035000000000003e-05 2024-04-19T03:02:15.486 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:15.486 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:15.486 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:15.486 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.486 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.486 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:50576 5.b 5:d250063d:::benchmark_data_smithi096_19531_object50575:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-19T03:02:15.486 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:00.329584+0000", 2024-04-19T03:02:15.486 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 15.094868165999999, 2024-04-19T03:02:15.486 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.021217389, 2024-04-19T03:02:15.486 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:15.487 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:15.487 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:15.487 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:15.487 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:15.487 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 50576 2024-04-19T03:02:15.487 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.487 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:15.487 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.487 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:15.487 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:00.329584+0000", 2024-04-19T03:02:15.487 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:15.487 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.487 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.487 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:15.488 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:00.329584+0000", 2024-04-19T03:02:15.488 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:15.488 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.488 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.488 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:15.488 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:00.329583+0000", 2024-04-19T03:02:15.488 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:15.488 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.488 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.488 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:15.488 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:00.329626+0000", 2024-04-19T03:02:15.488 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2530000000000001e-05 2024-04-19T03:02:15.488 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.488 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.489 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:15.489 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:00.329642+0000", 2024-04-19T03:02:15.489 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5891000000000001e-05 2024-04-19T03:02:15.489 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.489 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.489 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:15.489 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:00.329652+0000", 2024-04-19T03:02:15.489 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0093e-05 2024-04-19T03:02:15.489 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.489 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.489 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:15.489 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:00.330793+0000", 2024-04-19T03:02:15.489 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001141097 2024-04-19T03:02:15.490 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.490 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.490 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:15.490 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:00.330924+0000", 2024-04-19T03:02:15.490 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013114499999999999 2024-04-19T03:02:15.490 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.490 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.490 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:15.490 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:00.331055+0000", 2024-04-19T03:02:15.490 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013124600000000001 2024-04-19T03:02:15.490 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.490 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.490 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:15.491 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:00.335705+0000", 2024-04-19T03:02:15.491 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0046501549999999996 2024-04-19T03:02:15.491 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.491 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.491 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:15.491 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:00.350741+0000", 2024-04-19T03:02:15.491 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015035411 2024-04-19T03:02:15.491 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.491 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.491 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:15.491 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:00.350777+0000", 2024-04-19T03:02:15.491 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5874999999999998e-05 2024-04-19T03:02:15.491 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.491 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.492 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:15.492 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:00.350802+0000", 2024-04-19T03:02:15.492 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5040000000000001e-05 2024-04-19T03:02:15.492 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:15.492 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:15.492 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:15.492 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.492 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.492 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:52909 5.b 5:df07ce30:::benchmark_data_smithi096_19531_object52908:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-19T03:02:15.492 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:01.602899+0000", 2024-04-19T03:02:15.492 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 13.821553796, 2024-04-19T03:02:15.492 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020403345, 2024-04-19T03:02:15.492 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:15.492 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:15.493 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:15.493 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:15.493 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:15.493 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 52909 2024-04-19T03:02:15.493 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.493 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:15.493 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.493 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:15.493 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:01.602899+0000", 2024-04-19T03:02:15.493 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:15.493 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.493 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.493 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:15.493 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:01.602899+0000", 2024-04-19T03:02:15.493 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:15.494 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.494 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.494 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:15.494 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:01.602883+0000", 2024-04-19T03:02:15.494 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999838 2024-04-19T03:02:15.494 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.494 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.494 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:15.494 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:01.602956+0000", 2024-04-19T03:02:15.494 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2941000000000005e-05 2024-04-19T03:02:15.494 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.494 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.494 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:15.495 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:01.602970+0000", 2024-04-19T03:02:15.495 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4562999999999999e-05 2024-04-19T03:02:15.495 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.495 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.495 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:15.495 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:01.602981+0000", 2024-04-19T03:02:15.495 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1134999999999999e-05 2024-04-19T03:02:15.495 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.495 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.495 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:15.495 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:01.603043+0000", 2024-04-19T03:02:15.495 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2034999999999998e-05 2024-04-19T03:02:15.495 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.495 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.495 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:15.496 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:01.603173+0000", 2024-04-19T03:02:15.496 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012962800000000001 2024-04-19T03:02:15.496 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.496 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.496 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:15.496 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:01.603296+0000", 2024-04-19T03:02:15.496 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012313 2024-04-19T03:02:15.496 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.496 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.496 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:15.496 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:01.606862+0000", 2024-04-19T03:02:15.496 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0035656049999999999 2024-04-19T03:02:15.496 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.497 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.497 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:15.497 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:01.623147+0000", 2024-04-19T03:02:15.497 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.016285286 2024-04-19T03:02:15.497 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.497 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.497 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:15.497 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:01.623251+0000", 2024-04-19T03:02:15.497 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000104245 2024-04-19T03:02:15.497 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.497 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.497 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:15.497 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:01.623302+0000", 2024-04-19T03:02:15.497 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0763999999999997e-05 2024-04-19T03:02:15.498 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:15.498 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:15.498 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:15.498 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.498 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.498 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:52912 5.b 5:deddbeae:::benchmark_data_smithi096_19531_object52911:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-19T03:02:15.498 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:01.603006+0000", 2024-04-19T03:02:15.498 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 13.821446005, 2024-04-19T03:02:15.498 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020493783000000002, 2024-04-19T03:02:15.498 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:15.498 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:15.498 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:15.498 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:15.499 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:15.499 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 52912 2024-04-19T03:02:15.499 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.499 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:15.499 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.499 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:15.499 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:01.603006+0000", 2024-04-19T03:02:15.499 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:15.499 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.499 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.499 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:15.499 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:01.603006+0000", 2024-04-19T03:02:15.499 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:15.499 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.500 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.500 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:15.500 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:01.603006+0000", 2024-04-19T03:02:15.500 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:15.500 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.500 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.500 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:15.500 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:01.603054+0000", 2024-04-19T03:02:15.500 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8529000000000002e-05 2024-04-19T03:02:15.500 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.500 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.500 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:15.500 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:01.603067+0000", 2024-04-19T03:02:15.500 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2412000000000001e-05 2024-04-19T03:02:15.501 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.501 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.501 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:15.501 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:01.603078+0000", 2024-04-19T03:02:15.501 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1059e-05 2024-04-19T03:02:15.501 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.501 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.501 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:15.501 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:01.605226+0000", 2024-04-19T03:02:15.501 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0021488029999999999 2024-04-19T03:02:15.501 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.501 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.501 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:15.502 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:01.605333+0000", 2024-04-19T03:02:15.502 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000106346 2024-04-19T03:02:15.502 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.502 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.502 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:15.502 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:01.605426+0000", 2024-04-19T03:02:15.502 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.2985999999999994e-05 2024-04-19T03:02:15.502 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.502 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.502 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:15.502 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:01.607251+0000", 2024-04-19T03:02:15.502 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0018255789999999999 2024-04-19T03:02:15.502 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.502 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.503 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:15.503 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:01.623413+0000", 2024-04-19T03:02:15.503 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.016161854999999999 2024-04-19T03:02:15.503 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.503 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.503 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:15.503 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:01.623448+0000", 2024-04-19T03:02:15.503 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4498000000000001e-05 2024-04-19T03:02:15.503 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.503 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.503 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:15.503 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:01.623500+0000", 2024-04-19T03:02:15.503 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2543999999999997e-05 2024-04-19T03:02:15.504 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:15.504 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:15.504 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:15.504 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.504 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.504 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:57961 5.4 5:25b0464f:::benchmark_data_smithi096_19531_object57960:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-19T03:02:15.504 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:04.472703+0000", 2024-04-19T03:02:15.504 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 10.951749722000001, 2024-04-19T03:02:15.504 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.021714888000000002, 2024-04-19T03:02:15.504 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:15.504 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:15.504 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:15.504 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:15.504 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:15.505 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 57961 2024-04-19T03:02:15.505 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.505 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:15.505 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.505 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:15.505 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:04.472703+0000", 2024-04-19T03:02:15.505 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:15.505 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.505 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.505 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:15.505 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:04.472703+0000", 2024-04-19T03:02:15.505 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:15.505 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.506 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.506 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:15.506 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:04.472701+0000", 2024-04-19T03:02:15.506 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:15.506 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.506 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.506 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:15.506 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:04.472805+0000", 2024-04-19T03:02:15.506 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000103268 2024-04-19T03:02:15.506 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.506 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.506 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:15.506 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:04.472818+0000", 2024-04-19T03:02:15.507 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3528e-05 2024-04-19T03:02:15.507 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.507 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.507 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:15.507 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:04.472825+0000", 2024-04-19T03:02:15.507 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.0210000000000002e-06 2024-04-19T03:02:15.507 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.507 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.507 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:15.507 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:04.473983+0000", 2024-04-19T03:02:15.507 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0011581600000000001 2024-04-19T03:02:15.507 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.507 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.507 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:15.508 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:04.474201+0000", 2024-04-19T03:02:15.508 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00021749000000000001 2024-04-19T03:02:15.508 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.508 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.508 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:15.508 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:04.474378+0000", 2024-04-19T03:02:15.508 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00017696300000000001 2024-04-19T03:02:15.508 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.508 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.508 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:15.508 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:04.477308+0000", 2024-04-19T03:02:15.508 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0029298140000000002 2024-04-19T03:02:15.508 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.509 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.509 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:15.509 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:04.494322+0000", 2024-04-19T03:02:15.509 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.017014567000000001 2024-04-19T03:02:15.509 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.509 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.509 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:15.509 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:04.494386+0000", 2024-04-19T03:02:15.509 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4122999999999996e-05 2024-04-19T03:02:15.509 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.509 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.509 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:15.509 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:04.494418+0000", 2024-04-19T03:02:15.509 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1245999999999999e-05 2024-04-19T03:02:15.510 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:15.510 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:15.510 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:15.510 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.510 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.510 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:58042 5.b 5:d6f19b42:::benchmark_data_smithi096_19531_object58041:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-19T03:02:15.510 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:04.520286+0000", 2024-04-19T03:02:15.510 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 10.904166327, 2024-04-19T03:02:15.510 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020956167000000001, 2024-04-19T03:02:15.510 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:15.510 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:15.510 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:15.511 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:15.511 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:15.511 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 58042 2024-04-19T03:02:15.511 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.511 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:15.511 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.511 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:15.511 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:04.520286+0000", 2024-04-19T03:02:15.511 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:15.511 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.511 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.511 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:15.511 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:04.520286+0000", 2024-04-19T03:02:15.511 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:15.511 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.512 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.512 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:15.512 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:04.520285+0000", 2024-04-19T03:02:15.512 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:15.512 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.512 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.512 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:15.512 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:04.520374+0000", 2024-04-19T03:02:15.512 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9599999999999996e-05 2024-04-19T03:02:15.512 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.512 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.512 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:15.512 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:04.520409+0000", 2024-04-19T03:02:15.513 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4952e-05 2024-04-19T03:02:15.513 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.513 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.513 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:15.513 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:04.520421+0000", 2024-04-19T03:02:15.513 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.187e-05 2024-04-19T03:02:15.513 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.513 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.513 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:15.513 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:04.523527+0000", 2024-04-19T03:02:15.513 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.003105465 2024-04-19T03:02:15.513 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.513 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.513 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:15.514 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:04.523740+0000", 2024-04-19T03:02:15.514 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00021303500000000001 2024-04-19T03:02:15.514 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.514 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.514 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:15.514 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:04.523947+0000", 2024-04-19T03:02:15.514 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00020676599999999999 2024-04-19T03:02:15.514 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.514 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.514 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:15.514 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:04.532791+0000", 2024-04-19T03:02:15.514 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0088447079999999997 2024-04-19T03:02:15.514 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.514 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.515 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:15.515 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:04.541145+0000", 2024-04-19T03:02:15.515 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0083535620000000001 2024-04-19T03:02:15.515 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.515 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.515 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:15.515 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:04.541208+0000", 2024-04-19T03:02:15.515 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3303e-05 2024-04-19T03:02:15.515 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.515 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.515 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:15.515 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:04.541242+0000", 2024-04-19T03:02:15.515 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4226000000000001e-05 2024-04-19T03:02:15.515 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:15.516 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:15.516 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:15.516 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.516 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.516 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:59827 5.d 5:b422f98a:::benchmark_data_smithi096_19531_object59826:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-19T03:02:15.516 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:05.531472+0000", 2024-04-19T03:02:15.516 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 9.8929805070000008, 2024-04-19T03:02:15.516 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.021435431000000001, 2024-04-19T03:02:15.516 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:15.516 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:15.516 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:15.516 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:15.516 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:15.516 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 59827 2024-04-19T03:02:15.517 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.517 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:15.517 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.517 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:15.517 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:05.531472+0000", 2024-04-19T03:02:15.517 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:15.517 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.517 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.517 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:15.517 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:05.531472+0000", 2024-04-19T03:02:15.517 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:15.517 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.517 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.517 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:15.518 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:05.531471+0000", 2024-04-19T03:02:15.518 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:15.518 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.518 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.518 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:15.518 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:05.531501+0000", 2024-04-19T03:02:15.518 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0012999999999999e-05 2024-04-19T03:02:15.518 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.518 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.518 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:15.518 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:05.531509+0000", 2024-04-19T03:02:15.518 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.221e-06 2024-04-19T03:02:15.518 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.518 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.519 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:15.519 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:05.531514+0000", 2024-04-19T03:02:15.519 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2190000000000003e-06 2024-04-19T03:02:15.519 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.519 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.519 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:15.519 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:05.531554+0000", 2024-04-19T03:02:15.519 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9907999999999998e-05 2024-04-19T03:02:15.519 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.519 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.519 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:15.519 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:05.531677+0000", 2024-04-19T03:02:15.519 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012335699999999999 2024-04-19T03:02:15.519 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.520 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.520 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-04-19T03:02:15.520 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:05.531811+0000", 2024-04-19T03:02:15.520 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000133645 2024-04-19T03:02:15.520 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.520 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.520 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:15.520 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:05.535051+0000", 2024-04-19T03:02:15.520 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0032405889999999999 2024-04-19T03:02:15.520 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.520 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.520 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:15.520 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:05.552796+0000", 2024-04-19T03:02:15.520 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.017744138 2024-04-19T03:02:15.521 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.521 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.521 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:15.521 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:05.552859+0000", 2024-04-19T03:02:15.521 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3649e-05 2024-04-19T03:02:15.521 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.521 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.521 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:15.521 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:05.552907+0000", 2024-04-19T03:02:15.521 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8231e-05 2024-04-19T03:02:15.521 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:15.521 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:15.521 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:15.521 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.521 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.522 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:60972 5.b 5:d54d473f:::benchmark_data_smithi096_19531_object60971:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-19T03:02:15.522 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:06.223871+0000", 2024-04-19T03:02:15.522 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 9.200581154, 2024-04-19T03:02:15.522 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.021863176000000002, 2024-04-19T03:02:15.522 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:15.522 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:15.522 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:15.522 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:15.522 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:15.522 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 60972 2024-04-19T03:02:15.522 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.522 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:15.522 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.523 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:15.523 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:06.223871+0000", 2024-04-19T03:02:15.523 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:15.523 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.523 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.523 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:15.523 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:06.223871+0000", 2024-04-19T03:02:15.523 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:15.523 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.523 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.523 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:15.523 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:06.223870+0000", 2024-04-19T03:02:15.523 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:15.523 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.524 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.524 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:15.524 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:06.223943+0000", 2024-04-19T03:02:15.524 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2619000000000004e-05 2024-04-19T03:02:15.524 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.524 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.524 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:15.524 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:06.223954+0000", 2024-04-19T03:02:15.524 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0491e-05 2024-04-19T03:02:15.524 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.524 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.524 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:15.524 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:06.223961+0000", 2024-04-19T03:02:15.524 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2089999999999999e-06 2024-04-19T03:02:15.525 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.525 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.525 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:15.525 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:06.224005+0000", 2024-04-19T03:02:15.525 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3884999999999997e-05 2024-04-19T03:02:15.525 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.525 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.525 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:15.525 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:06.224101+0000", 2024-04-19T03:02:15.525 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.6508000000000005e-05 2024-04-19T03:02:15.525 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.525 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.525 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:15.525 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:06.224200+0000", 2024-04-19T03:02:15.526 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.8870999999999996e-05 2024-04-19T03:02:15.526 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.526 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.526 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:15.526 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:06.230624+0000", 2024-04-19T03:02:15.526 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0064236110000000001 2024-04-19T03:02:15.526 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.526 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.526 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:15.526 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:06.245639+0000", 2024-04-19T03:02:15.526 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015015379000000001 2024-04-19T03:02:15.526 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.526 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.526 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:15.527 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:06.245701+0000", 2024-04-19T03:02:15.527 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1663999999999998e-05 2024-04-19T03:02:15.527 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.527 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.527 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:15.527 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:06.245735+0000", 2024-04-19T03:02:15.527 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3785000000000003e-05 2024-04-19T03:02:15.527 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:15.527 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:15.527 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:15.527 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.527 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.527 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:67762 5.4 5:20b04c26:::benchmark_data_smithi096_19531_object67761:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T03:02:15.528 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:10.239937+0000", 2024-04-19T03:02:15.528 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 5.1845156530000001, 2024-04-19T03:02:15.528 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020469803000000002, 2024-04-19T03:02:15.528 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:15.528 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:15.528 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:15.528 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:15.528 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:15.528 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 67762 2024-04-19T03:02:15.528 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.528 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:15.528 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.528 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:15.528 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:10.239937+0000", 2024-04-19T03:02:15.529 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:15.529 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.529 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.529 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:15.529 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:10.239937+0000", 2024-04-19T03:02:15.529 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:15.529 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.529 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.529 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:15.529 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:10.239936+0000", 2024-04-19T03:02:15.529 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:15.529 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.529 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.529 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:15.530 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:10.239983+0000", 2024-04-19T03:02:15.530 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7348999999999997e-05 2024-04-19T03:02:15.530 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.530 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.530 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:15.530 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:10.239994+0000", 2024-04-19T03:02:15.530 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0329000000000001e-05 2024-04-19T03:02:15.530 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.530 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.530 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:15.530 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:10.240002+0000", 2024-04-19T03:02:15.530 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0299999999999994e-06 2024-04-19T03:02:15.530 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.530 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.531 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:15.531 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:10.243811+0000", 2024-04-19T03:02:15.531 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0038095 2024-04-19T03:02:15.531 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.531 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.531 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:15.531 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:10.243937+0000", 2024-04-19T03:02:15.531 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012542099999999999 2024-04-19T03:02:15.531 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.531 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.531 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:15.531 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:10.244039+0000", 2024-04-19T03:02:15.531 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010274 2024-04-19T03:02:15.531 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.532 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.532 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:15.532 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:10.247304+0000", 2024-04-19T03:02:15.532 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0032646279999999999 2024-04-19T03:02:15.532 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.532 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.532 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:15.532 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:10.260327+0000", 2024-04-19T03:02:15.532 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013023211999999999 2024-04-19T03:02:15.532 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.532 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.532 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:15.532 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:10.260373+0000", 2024-04-19T03:02:15.532 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5899000000000002e-05 2024-04-19T03:02:15.532 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.533 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.533 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:15.533 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:10.260407+0000", 2024-04-19T03:02:15.533 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3430999999999999e-05 2024-04-19T03:02:15.533 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:15.533 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:15.533 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:15.533 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.533 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.533 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:73012 5.0 5:0ea78234:::benchmark_data_smithi096_19531_object73011:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T03:02:15.533 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:13.385164+0000", 2024-04-19T03:02:15.533 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 2.0392880010000001, 2024-04-19T03:02:15.533 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020370072999999999, 2024-04-19T03:02:15.533 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:15.534 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:15.534 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:15.534 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:15.534 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:15.534 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 73012 2024-04-19T03:02:15.534 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.534 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:15.534 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.534 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:15.534 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:13.385164+0000", 2024-04-19T03:02:15.534 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:15.534 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.534 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.534 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:15.535 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:13.385164+0000", 2024-04-19T03:02:15.535 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:15.535 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.535 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.535 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:15.535 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:13.385163+0000", 2024-04-19T03:02:15.535 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:15.535 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.535 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.535 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:15.535 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:13.385262+0000", 2024-04-19T03:02:15.537 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.8648999999999997e-05 2024-04-19T03:02:15.537 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.537 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.537 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:15.537 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:13.385279+0000", 2024-04-19T03:02:15.537 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.647e-05 2024-04-19T03:02:15.537 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.537 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.537 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:15.537 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:13.385287+0000", 2024-04-19T03:02:15.537 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9460000000000004e-06 2024-04-19T03:02:15.537 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.538 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.538 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:15.538 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:13.385353+0000", 2024-04-19T03:02:15.538 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5945000000000006e-05 2024-04-19T03:02:15.538 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.538 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.538 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:15.538 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:13.385484+0000", 2024-04-19T03:02:15.538 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000130572 2024-04-19T03:02:15.538 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.538 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.538 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:15.538 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:13.385656+0000", 2024-04-19T03:02:15.539 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00017162699999999999 2024-04-19T03:02:15.539 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.539 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.539 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:15.539 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:13.393327+0000", 2024-04-19T03:02:15.539 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0076712389999999998 2024-04-19T03:02:15.539 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.539 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.539 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:15.539 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:13.405484+0000", 2024-04-19T03:02:15.539 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.012157382 2024-04-19T03:02:15.539 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.539 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.539 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:15.540 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:13.405512+0000", 2024-04-19T03:02:15.540 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7946999999999999e-05 2024-04-19T03:02:15.540 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.540 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.540 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:15.540 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:13.405535+0000", 2024-04-19T03:02:15.540 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2385e-05 2024-04-19T03:02:15.540 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:15.540 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:15.540 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:15.540 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.540 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.540 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:73742 5.b 5:d86fe728:::benchmark_data_smithi096_19531_object73741:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T03:02:15.541 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:13.822877+0000", 2024-04-19T03:02:15.541 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 1.601575671, 2024-04-19T03:02:15.541 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020717838999999998, 2024-04-19T03:02:15.541 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:15.541 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:15.541 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:15.541 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:15.541 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:15.541 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 73742 2024-04-19T03:02:15.541 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.541 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:15.541 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.541 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:15.541 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:13.822877+0000", 2024-04-19T03:02:15.542 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:15.542 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.542 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.542 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:15.542 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:13.822877+0000", 2024-04-19T03:02:15.542 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:15.542 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.542 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.542 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:15.542 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:13.822875+0000", 2024-04-19T03:02:15.542 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:15.542 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.542 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.543 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:15.543 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:13.822923+0000", 2024-04-19T03:02:15.543 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8118999999999998e-05 2024-04-19T03:02:15.543 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.543 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.543 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:15.543 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:13.822942+0000", 2024-04-19T03:02:15.543 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8709999999999999e-05 2024-04-19T03:02:15.543 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.543 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.543 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:15.543 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:13.822951+0000", 2024-04-19T03:02:15.543 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.7460000000000006e-06 2024-04-19T03:02:15.543 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.544 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.544 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:15.544 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:13.827792+0000", 2024-04-19T03:02:15.544 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0048410939999999998 2024-04-19T03:02:15.544 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.544 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.544 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:15.544 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:13.827976+0000", 2024-04-19T03:02:15.544 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00018441900000000001 2024-04-19T03:02:15.544 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.544 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.544 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:15.544 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:13.828067+0000", 2024-04-19T03:02:15.544 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1034999999999998e-05 2024-04-19T03:02:15.545 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.545 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.545 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:15.545 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:13.834404+0000", 2024-04-19T03:02:15.545 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0063362080000000003 2024-04-19T03:02:15.545 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.545 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.545 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:15.545 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:13.843527+0000", 2024-04-19T03:02:15.545 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0091229399999999995 2024-04-19T03:02:15.545 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.545 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.545 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:15.545 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:13.843557+0000", 2024-04-19T03:02:15.546 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0886000000000002e-05 2024-04-19T03:02:15.546 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:15.546 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:15.546 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:15.546 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:13.843595+0000", 2024-04-19T03:02:15.546 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7169999999999998e-05 2024-04-19T03:02:15.546 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:15.546 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:15.546 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:15.546 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:15.546 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:15.546 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-19T03:02:15.548 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T03:02:15.548 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:15.543+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:15.581 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0: {} 2024-04-19T03:02:15.603 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1: {} 2024-04-19T03:02:15.623 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2: {} 2024-04-19T03:02:15.626 INFO:teuthology.orchestra.run.smithi096.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T03:02:15.626 INFO:teuthology.orchestra.run.smithi096.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-19T03:02:15.626 INFO:teuthology.orchestra.run.smithi096.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-19T03:02:15.648 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:15.647+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:15.669 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-04-19T03:02:15.669 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:02:15.682 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T03:02:15.749 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-04-19T03:02:15.746+0000 7f35986ab700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18243) UID: 0 2024-04-19T03:02:15.802 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-04-19T03:02:15.803 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:02:15.818 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T03:02:15.824 INFO:tasks.radosbench.radosbench.0.smithi096.stdout: 38 16 75466 75450 124.081 62.1875 0.00903306 0.00805345 2024-04-19T03:02:15.850 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-04-19T03:02:15.846+0000 7f35986ab700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18243) UID: 0 2024-04-19T03:02:15.942 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-04-19T03:02:15.942 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:02:15.952 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:15.947+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:15.955 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T03:02:16.052 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:16.049+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:16.083 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-04-19T03:02:16.083 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:02:16.099 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T03:02:16.153 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:16.151+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:16.234 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-04-19T03:02:16.234 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:02:16.247 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T03:02:16.253 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:16.249+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:16.355 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-04-19T03:02:16.354+0000 7f35986ab700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18243) UID: 0 2024-04-19T03:02:16.383 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-04-19T03:02:16.447 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:02:16.448 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T03:02:16.455 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-04-19T03:02:16.454+0000 7f35986ab700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18243) UID: 0 2024-04-19T03:02:16.557 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:16.555+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:16.581 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-19T03:02:16.582 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:02:16.593 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T03:02:16.658 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-04-19T03:02:16.654+0000 7f35986ab700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18243) UID: 0 2024-04-19T03:02:16.718 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-19T03:02:16.718 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:02:16.731 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T03:02:16.758 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:16.755+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:16.824 INFO:tasks.radosbench.radosbench.0.smithi096.stdout: 39 16 77132 77116 123.569 104.125 0.00575765 0.00808688 2024-04-19T03:02:16.852 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-19T03:02:16.852 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:02:16.859 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:16.855+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:16.864 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T03:02:16.960 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:16.957+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:16.985 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-04-19T03:02:16.985 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:02:16.997 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T03:02:17.061 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:17.057+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:17.105 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-04-19T03:02:17.106 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:02:17.115 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T03:02:17.162 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-04-19T03:02:17.158+0000 7f35986ab700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18243) UID: 0 2024-04-19T03:02:17.211 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-19T03:02:17.262 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:17.261+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:17.283 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-04-19T03:02:17.283 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:02:17.296 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T03:02:17.363 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:17.359+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:17.426 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-04-19T03:02:17.427 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:02:17.440 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T03:02:17.464 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:17.463+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:17.565 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:17.563+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:17.572 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-04-19T03:02:17.572 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:02:17.586 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T03:02:17.638 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-19T03:02:17.666 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-04-19T03:02:17.662+0000 7f35986ab700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18243) UID: 0 2024-04-19T03:02:17.728 INFO:teuthology.orchestra.run.smithi097.stdout:ERROR: (22) Invalid argument 2024-04-19T03:02:17.728 INFO:teuthology.orchestra.run.smithi097.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:02:17.741 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T03:02:17.768 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-04-19T03:02:17.766+0000 7f35986ab700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18243) UID: 0 2024-04-19T03:02:17.798 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0: {} 2024-04-19T03:02:17.818 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1: {} 2024-04-19T03:02:17.824 INFO:tasks.radosbench.radosbench.0.smithi096.stdout:2024-04-19T03:02:17.824572+0000 min lat: 0.00184673 max lat: 1.04193 avg lat: 0.00813039 2024-04-19T03:02:17.824 INFO:tasks.radosbench.radosbench.0.smithi096.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-04-19T03:02:17.824 INFO:tasks.radosbench.radosbench.0.smithi096.stdout: 40 16 78682 78666 122.902 96.875 0.0103018 0.00813039 2024-04-19T03:02:17.839 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2: {} 2024-04-19T03:02:17.841 INFO:teuthology.orchestra.run.smithi096.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T03:02:17.842 INFO:teuthology.orchestra.run.smithi096.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-19T03:02:17.842 INFO:teuthology.orchestra.run.smithi096.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-19T03:02:17.868 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:17.865+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:17.870 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-19T03:02:17.870 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-04-19T03:02:17.870 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:17.870 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:78746 5.d 5:b965ea3f:::benchmark_data_smithi096_19531_object78745:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-19T03:02:17.870 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:17.865622+0000", 2024-04-19T03:02:17.870 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0045876160000000001, 2024-04-19T03:02:17.870 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0046090580000000001, 2024-04-19T03:02:17.870 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:17.870 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:02:17.871 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:17.871 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:17.871 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:17.871 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 78746 2024-04-19T03:02:17.871 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:17.871 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:17.871 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:17.871 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:17.871 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:17.865622+0000", 2024-04-19T03:02:17.871 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:17.871 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:17.871 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:17.871 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:17.871 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:17.865622+0000", 2024-04-19T03:02:17.872 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:17.872 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:17.872 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:17.872 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:17.872 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:17.865621+0000", 2024-04-19T03:02:17.872 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:17.872 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:17.872 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:17.872 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:17.872 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:17.865678+0000", 2024-04-19T03:02:17.872 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6771000000000002e-05 2024-04-19T03:02:17.872 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:17.872 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:17.872 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:17.873 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:17.865695+0000", 2024-04-19T03:02:17.873 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6736e-05 2024-04-19T03:02:17.873 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:17.873 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:17.873 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:17.873 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:17.865704+0000", 2024-04-19T03:02:17.873 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.2820000000000002e-06 2024-04-19T03:02:17.873 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:17.873 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:17.873 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:17.873 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:17.865753+0000", 2024-04-19T03:02:17.873 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9286999999999998e-05 2024-04-19T03:02:17.873 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:17.874 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:17.874 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:17.874 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:17.865870+0000", 2024-04-19T03:02:17.874 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000117006 2024-04-19T03:02:17.874 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:17.874 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:17.874 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-04-19T03:02:17.874 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:17.865976+0000", 2024-04-19T03:02:17.874 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000105905 2024-04-19T03:02:17.874 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:17.874 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:17.874 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:17.875 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:17.868998+0000", 2024-04-19T03:02:17.875 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.003021246 2024-04-19T03:02:17.875 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:17.875 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:17.875 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:17.875 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:17.875 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:17.875 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:78751 5.b 5:d0ea0592:::benchmark_data_smithi096_19531_object78750:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-19T03:02:17.875 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:17.866871+0000", 2024-04-19T03:02:17.875 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0033385910000000001, 2024-04-19T03:02:17.875 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0034208630000000001, 2024-04-19T03:02:17.875 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:17.876 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:02:17.876 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:17.876 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:17.876 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:17.876 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 78751 2024-04-19T03:02:17.876 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:17.876 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:17.876 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:17.876 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:17.876 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:17.866871+0000", 2024-04-19T03:02:17.876 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:17.876 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:17.876 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:17.876 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:17.877 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:17.866871+0000", 2024-04-19T03:02:17.877 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:17.877 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:17.877 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:17.877 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:17.877 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:17.866870+0000", 2024-04-19T03:02:17.877 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:17.877 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:17.877 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:17.877 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:17.877 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:17.866982+0000", 2024-04-19T03:02:17.877 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011135 2024-04-19T03:02:17.877 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:17.878 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:17.878 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:17.878 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:17.866992+0000", 2024-04-19T03:02:17.878 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0202e-05 2024-04-19T03:02:17.878 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:17.878 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:17.878 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:17.878 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:17.867000+0000", 2024-04-19T03:02:17.878 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.9330000000000001e-06 2024-04-19T03:02:17.878 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:17.878 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:17.878 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:17.878 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:17.867053+0000", 2024-04-19T03:02:17.879 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3431999999999999e-05 2024-04-19T03:02:17.879 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:17.879 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:17.879 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:17.879 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:17.867200+0000", 2024-04-19T03:02:17.879 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000146253 2024-04-19T03:02:17.879 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:17.879 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:17.879 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:17.879 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:17.867362+0000", 2024-04-19T03:02:17.879 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016250300000000001 2024-04-19T03:02:17.879 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:17.879 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:17.879 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:17.880 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:17.880 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:17.880 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4755.0:78747 5.a e40/22 5:5b09deb8:::benchmark_data_smithi096_19531_object78746:head v 40'4797, mlcod=40'4795)", 2024-04-19T03:02:17.880 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:17.867069+0000", 2024-04-19T03:02:17.880 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0031409150000000002, 2024-04-19T03:02:17.880 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.003271333, 2024-04-19T03:02:17.880 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:17.880 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-19T03:02:17.880 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:17.880 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:17.880 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:17.880 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:17.867069+0000", 2024-04-19T03:02:17.880 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:17.881 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:17.881 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:17.881 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:17.881 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:17.867069+0000", 2024-04-19T03:02:17.881 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:17.881 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:17.881 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:17.881 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:17.881 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:17.867068+0000", 2024-04-19T03:02:17.881 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:17.881 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:17.881 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:17.881 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:17.881 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:17.867169+0000", 2024-04-19T03:02:17.882 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000100938 2024-04-19T03:02:17.882 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:17.882 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:17.882 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:17.882 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:17.867178+0000", 2024-04-19T03:02:17.882 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3040000000000005e-06 2024-04-19T03:02:17.882 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:17.882 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:17.882 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:17.882 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:17.867184+0000", 2024-04-19T03:02:17.882 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2659999999999998e-06 2024-04-19T03:02:17.882 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:17.882 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:17.883 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:17.883 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:17.867223+0000", 2024-04-19T03:02:17.883 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9372000000000002e-05 2024-04-19T03:02:17.883 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:17.883 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:17.883 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:17.883 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:17.867244+0000", 2024-04-19T03:02:17.883 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0381999999999999e-05 2024-04-19T03:02:17.883 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:17.883 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:17.883 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:17.883 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:17.883 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-04-19T03:02:17.883 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 3 2024-04-19T03:02:17.884 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-19T03:02:17.885 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T03:02:17.969 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:17.965+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:18.013 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-19T03:02:18.013 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-04-19T03:02:18.013 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-04-19T03:02:18.013 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-04-19T03:02:18.014 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-19T03:02:18.023 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T03:02:18.070 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:18.067+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:18.133 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-19T03:02:18.133 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-04-19T03:02:18.133 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-04-19T03:02:18.133 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-04-19T03:02:18.133 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.133 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:10 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:02:18.134 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:14.999496+0000", 2024-04-19T03:02:18.134 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 63.131664848, 2024-04-19T03:02:18.134 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.022720497999999999, 2024-04-19T03:02:18.134 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:18.134 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:18.134 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:18.134 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.134 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:18.134 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999496+0000", 2024-04-19T03:02:18.134 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:18.134 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.134 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.134 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:18.135 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999496+0000", 2024-04-19T03:02:18.135 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:18.135 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.135 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.135 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:18.135 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999494+0000", 2024-04-19T03:02:18.135 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:18.135 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.135 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.135 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:18.135 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999503+0000", 2024-04-19T03:02:18.135 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.5930000000000006e-06 2024-04-19T03:02:18.135 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.135 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.136 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:18.136 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999523+0000", 2024-04-19T03:02:18.136 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9553000000000001e-05 2024-04-19T03:02:18.136 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.136 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.136 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:18.136 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999538+0000", 2024-04-19T03:02:18.136 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5702999999999999e-05 2024-04-19T03:02:18.136 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.136 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.136 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:18.136 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999608+0000", 2024-04-19T03:02:18.136 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.9912000000000004e-05 2024-04-19T03:02:18.136 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.137 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.137 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op must wait for map", 2024-04-19T03:02:18.137 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999626+0000", 2024-04-19T03:02:18.137 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8207e-05 2024-04-19T03:02:18.137 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.137 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.137 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:18.137 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.010765+0000", 2024-04-19T03:02:18.137 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011138719 2024-04-19T03:02:18.137 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.137 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.137 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:18.137 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.010906+0000", 2024-04-19T03:02:18.137 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014095899999999999 2024-04-19T03:02:18.138 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.138 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.138 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-04-19T03:02:18.138 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.011472+0000", 2024-04-19T03:02:18.138 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00056629300000000005 2024-04-19T03:02:18.138 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.138 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.138 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:18.138 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.013217+0000", 2024-04-19T03:02:18.138 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001744317 2024-04-19T03:02:18.138 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.138 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.138 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:18.139 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.022083+0000", 2024-04-19T03:02:18.139 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0088663849999999992 2024-04-19T03:02:18.139 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.139 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.139 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:18.139 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.022124+0000", 2024-04-19T03:02:18.139 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.057e-05 2024-04-19T03:02:18.139 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.139 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.139 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:18.139 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.022216+0000", 2024-04-19T03:02:18.140 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.2417000000000006e-05 2024-04-19T03:02:18.140 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:18.140 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:18.140 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:18.140 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.140 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.140 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:32 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:02:18.140 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:14.999712+0000", 2024-04-19T03:02:18.141 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 63.131448605000003, 2024-04-19T03:02:18.141 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.022635437000000001, 2024-04-19T03:02:18.141 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:18.141 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:18.141 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:18.141 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.141 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:18.141 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999712+0000", 2024-04-19T03:02:18.141 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:18.142 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.142 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.142 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:18.142 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999712+0000", 2024-04-19T03:02:18.142 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:18.142 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.142 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.142 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:18.142 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999711+0000", 2024-04-19T03:02:18.142 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:18.142 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.143 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.143 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:18.143 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999719+0000", 2024-04-19T03:02:18.143 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.354e-06 2024-04-19T03:02:18.143 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.143 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.143 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:18.143 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999735+0000", 2024-04-19T03:02:18.143 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6288999999999999e-05 2024-04-19T03:02:18.143 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.143 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.143 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:18.143 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999749+0000", 2024-04-19T03:02:18.143 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3492999999999999e-05 2024-04-19T03:02:18.143 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.144 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.144 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:18.144 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999811+0000", 2024-04-19T03:02:18.144 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2298999999999994e-05 2024-04-19T03:02:18.144 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.144 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.144 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:02:18.144 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999817+0000", 2024-04-19T03:02:18.144 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2169999999999999e-06 2024-04-19T03:02:18.144 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.144 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.144 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:18.144 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.011836+0000", 2024-04-19T03:02:18.144 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.012018008 2024-04-19T03:02:18.145 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.145 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.145 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:18.145 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.011897+0000", 2024-04-19T03:02:18.145 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1111000000000005e-05 2024-04-19T03:02:18.145 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.145 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.145 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-04-19T03:02:18.145 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.011980+0000", 2024-04-19T03:02:18.145 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3003999999999993e-05 2024-04-19T03:02:18.145 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.146 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.146 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:18.146 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.013863+0000", 2024-04-19T03:02:18.146 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001883804 2024-04-19T03:02:18.146 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.146 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.146 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:18.146 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.022257+0000", 2024-04-19T03:02:18.146 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0083938290000000002 2024-04-19T03:02:18.146 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.146 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.146 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:18.146 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.022310+0000", 2024-04-19T03:02:18.147 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.236e-05 2024-04-19T03:02:18.147 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.147 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.147 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:18.147 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.022347+0000", 2024-04-19T03:02:18.147 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7653e-05 2024-04-19T03:02:18.147 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:18.147 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:18.147 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:18.147 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.147 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.147 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:24 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:02:18.147 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:14.999964+0000", 2024-04-19T03:02:18.147 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 63.131196926999998, 2024-04-19T03:02:18.148 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020451446000000002, 2024-04-19T03:02:18.148 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:18.148 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-19T03:02:18.148 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:18.148 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.148 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:18.148 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999964+0000", 2024-04-19T03:02:18.148 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:18.148 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.148 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.148 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:18.148 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999964+0000", 2024-04-19T03:02:18.148 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:18.148 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.149 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.149 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:18.149 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999963+0000", 2024-04-19T03:02:18.149 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:18.149 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.149 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.149 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:18.149 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999969+0000", 2024-04-19T03:02:18.149 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0270000000000001e-06 2024-04-19T03:02:18.149 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.149 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.149 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:18.149 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999984+0000", 2024-04-19T03:02:18.149 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5903e-05 2024-04-19T03:02:18.150 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.150 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.150 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:18.150 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:14.999998+0000", 2024-04-19T03:02:18.150 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3076e-05 2024-04-19T03:02:18.150 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.150 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.150 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:18.151 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.000078+0000", 2024-04-19T03:02:18.151 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0525000000000006e-05 2024-04-19T03:02:18.151 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.151 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.151 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op must wait for map", 2024-04-19T03:02:18.151 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.000084+0000", 2024-04-19T03:02:18.151 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8370000000000002e-06 2024-04-19T03:02:18.151 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.151 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.151 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:18.151 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.008819+0000", 2024-04-19T03:02:18.151 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0087349019999999993 2024-04-19T03:02:18.151 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.152 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.152 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:18.152 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.009018+0000", 2024-04-19T03:02:18.152 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000198989 2024-04-19T03:02:18.152 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.152 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.152 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:18.152 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:15.020415+0000", 2024-04-19T03:02:18.152 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011397157 2024-04-19T03:02:18.152 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:18.153 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:18.153 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:18.153 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.153 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.153 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:11274 5.e 5:7c846032:::benchmark_data_smithi096_19531_object11273:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T03:02:18.153 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:42.061776+0000", 2024-04-19T03:02:18.153 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 36.069384681999999, 2024-04-19T03:02:18.153 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.035381001000000002, 2024-04-19T03:02:18.153 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:18.153 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:18.153 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:18.153 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:18.153 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:18.153 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 11274 2024-04-19T03:02:18.154 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.154 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:18.154 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.154 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:18.154 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.061776+0000", 2024-04-19T03:02:18.154 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:18.154 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.154 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.154 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:18.154 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.061776+0000", 2024-04-19T03:02:18.154 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:18.154 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.154 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.155 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:18.155 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.061775+0000", 2024-04-19T03:02:18.155 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:18.155 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.155 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.155 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:18.155 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.061807+0000", 2024-04-19T03:02:18.155 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1733000000000003e-05 2024-04-19T03:02:18.155 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.155 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.155 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:18.155 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.061822+0000", 2024-04-19T03:02:18.155 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5452999999999999e-05 2024-04-19T03:02:18.155 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.155 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.156 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:18.156 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.061827+0000", 2024-04-19T03:02:18.156 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9810000000000003e-06 2024-04-19T03:02:18.156 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.156 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.156 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:18.156 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.063388+0000", 2024-04-19T03:02:18.156 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0015605720000000001 2024-04-19T03:02:18.156 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.156 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.156 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:18.156 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.063612+0000", 2024-04-19T03:02:18.156 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00022431 2024-04-19T03:02:18.156 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.156 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.157 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:18.157 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.063747+0000", 2024-04-19T03:02:18.157 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013459600000000001 2024-04-19T03:02:18.157 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.157 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.157 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:18.157 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.066186+0000", 2024-04-19T03:02:18.157 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0024388909999999999 2024-04-19T03:02:18.157 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.157 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.157 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:18.157 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.097016+0000", 2024-04-19T03:02:18.157 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.030830705 2024-04-19T03:02:18.157 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.158 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.158 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:18.158 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.097096+0000", 2024-04-19T03:02:18.158 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.9469999999999996e-05 2024-04-19T03:02:18.158 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.158 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.158 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:18.158 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.097157+0000", 2024-04-19T03:02:18.158 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0884999999999997e-05 2024-04-19T03:02:18.158 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:18.158 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:18.159 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:18.159 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.159 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.159 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:11279 5.8 5:10b60c58:::benchmark_data_smithi096_19531_object11278:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T03:02:18.159 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:42.062594+0000", 2024-04-19T03:02:18.159 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 36.068566244000003, 2024-04-19T03:02:18.159 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.028696788000000001, 2024-04-19T03:02:18.159 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:18.159 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:18.159 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:18.159 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:18.159 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:18.159 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 11279 2024-04-19T03:02:18.160 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.160 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:18.160 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.160 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:18.160 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.062594+0000", 2024-04-19T03:02:18.160 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:18.160 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.160 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.160 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:18.160 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.062594+0000", 2024-04-19T03:02:18.160 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:18.160 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.160 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.160 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:18.161 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.062593+0000", 2024-04-19T03:02:18.161 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:18.161 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.161 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.161 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:18.161 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.062646+0000", 2024-04-19T03:02:18.161 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2293999999999998e-05 2024-04-19T03:02:18.161 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.161 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.161 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:18.162 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.062657+0000", 2024-04-19T03:02:18.162 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1440000000000001e-05 2024-04-19T03:02:18.162 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.162 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.162 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:18.162 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.062665+0000", 2024-04-19T03:02:18.162 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5159999999999997e-06 2024-04-19T03:02:18.162 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.162 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.163 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:18.163 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.063799+0000", 2024-04-19T03:02:18.163 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0011344860000000001 2024-04-19T03:02:18.163 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.163 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.163 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:18.163 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.063962+0000", 2024-04-19T03:02:18.163 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000162614 2024-04-19T03:02:18.163 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.163 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.163 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:18.163 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.064167+0000", 2024-04-19T03:02:18.163 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00020491699999999999 2024-04-19T03:02:18.164 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.164 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.164 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:18.164 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.066768+0000", 2024-04-19T03:02:18.164 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0026012090000000002 2024-04-19T03:02:18.164 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.164 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.164 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:18.164 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.091184+0000", 2024-04-19T03:02:18.164 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.024416582999999999 2024-04-19T03:02:18.164 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.164 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.164 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:18.164 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.091251+0000", 2024-04-19T03:02:18.165 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6753000000000003e-05 2024-04-19T03:02:18.165 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.165 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.165 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:18.165 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.091291+0000", 2024-04-19T03:02:18.165 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9841e-05 2024-04-19T03:02:18.165 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:18.165 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:18.165 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:18.166 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.166 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.166 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:11282 5.e 5:75b7c510:::benchmark_data_smithi096_19531_object11281:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T03:02:18.166 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:42.062674+0000", 2024-04-19T03:02:18.166 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 36.068486788000001, 2024-04-19T03:02:18.166 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.034812849, 2024-04-19T03:02:18.166 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:18.166 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:18.166 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:18.166 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:18.166 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:18.166 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 11282 2024-04-19T03:02:18.167 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.167 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:18.167 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.167 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:18.167 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.062674+0000", 2024-04-19T03:02:18.167 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:18.167 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.167 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.167 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:18.167 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.062674+0000", 2024-04-19T03:02:18.167 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:18.167 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.167 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.167 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:18.168 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.062673+0000", 2024-04-19T03:02:18.168 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:18.168 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.168 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.168 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:18.168 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.062712+0000", 2024-04-19T03:02:18.168 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9341999999999997e-05 2024-04-19T03:02:18.168 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.168 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.168 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:18.168 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.062721+0000", 2024-04-19T03:02:18.168 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1700000000000003e-06 2024-04-19T03:02:18.168 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.168 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.169 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:18.169 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.062729+0000", 2024-04-19T03:02:18.169 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4240000000000004e-06 2024-04-19T03:02:18.169 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.169 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.169 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:18.169 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.065017+0000", 2024-04-19T03:02:18.169 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0022878590000000002 2024-04-19T03:02:18.169 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.169 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.169 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:18.169 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.065207+0000", 2024-04-19T03:02:18.169 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000190411 2024-04-19T03:02:18.169 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.169 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.170 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:18.170 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.065323+0000", 2024-04-19T03:02:18.170 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000115593 2024-04-19T03:02:18.170 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.170 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.170 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:18.170 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.069683+0000", 2024-04-19T03:02:18.170 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0043604409999999996 2024-04-19T03:02:18.170 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.170 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.170 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:18.170 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.097273+0000", 2024-04-19T03:02:18.170 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.027589516000000001 2024-04-19T03:02:18.171 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.171 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.171 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:18.171 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.097406+0000", 2024-04-19T03:02:18.171 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000133514 2024-04-19T03:02:18.171 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.171 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.171 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:18.171 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.097486+0000", 2024-04-19T03:02:18.171 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0479e-05 2024-04-19T03:02:18.172 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:18.172 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:18.172 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:18.172 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.172 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.172 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:11288 5.0 5:042458d0:::benchmark_data_smithi096_19531_object11287:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T03:02:18.172 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:42.070352+0000", 2024-04-19T03:02:18.172 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 36.060808860000002, 2024-04-19T03:02:18.172 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.021532447, 2024-04-19T03:02:18.172 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:18.172 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:18.172 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:18.173 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:18.173 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:18.173 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 11288 2024-04-19T03:02:18.173 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.173 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:18.173 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.173 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:18.173 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.070352+0000", 2024-04-19T03:02:18.173 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:18.174 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.174 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.174 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:18.174 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.070352+0000", 2024-04-19T03:02:18.174 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:18.174 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.174 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.174 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:18.174 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.070351+0000", 2024-04-19T03:02:18.174 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:18.174 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.174 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.175 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:18.175 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.070392+0000", 2024-04-19T03:02:18.175 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1077e-05 2024-04-19T03:02:18.175 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.175 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.175 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:18.175 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.070398+0000", 2024-04-19T03:02:18.175 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1109999999999996e-06 2024-04-19T03:02:18.175 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.175 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.175 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:18.175 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.070402+0000", 2024-04-19T03:02:18.175 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2010000000000001e-06 2024-04-19T03:02:18.175 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.176 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.176 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:18.176 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.070445+0000", 2024-04-19T03:02:18.176 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2585e-05 2024-04-19T03:02:18.176 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.176 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.176 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:18.176 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.070572+0000", 2024-04-19T03:02:18.176 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012708500000000001 2024-04-19T03:02:18.176 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.176 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.176 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:18.176 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.070711+0000", 2024-04-19T03:02:18.176 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013848699999999999 2024-04-19T03:02:18.176 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.177 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.177 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:18.177 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.073505+0000", 2024-04-19T03:02:18.177 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0027944620000000002 2024-04-19T03:02:18.177 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.177 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.177 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:18.177 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.091806+0000", 2024-04-19T03:02:18.177 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.018301251000000001 2024-04-19T03:02:18.177 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.177 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.177 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:18.177 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.091854+0000", 2024-04-19T03:02:18.177 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7419000000000001e-05 2024-04-19T03:02:18.177 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.178 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.178 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:18.178 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.091884+0000", 2024-04-19T03:02:18.178 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0241999999999999e-05 2024-04-19T03:02:18.178 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:18.178 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:18.178 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:18.178 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.178 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.178 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:11292 5.0 5:009b2ea9:::benchmark_data_smithi096_19531_object11291:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T03:02:18.178 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:42.070676+0000", 2024-04-19T03:02:18.178 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 36.060484485000003, 2024-04-19T03:02:18.178 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.02219631, 2024-04-19T03:02:18.179 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:18.179 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:18.179 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:18.179 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:18.179 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:18.179 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 11292 2024-04-19T03:02:18.179 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.179 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:18.179 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.179 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:18.179 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.070676+0000", 2024-04-19T03:02:18.179 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:18.179 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.179 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.180 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:18.180 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.070676+0000", 2024-04-19T03:02:18.180 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:18.180 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.180 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.180 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:18.180 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.070675+0000", 2024-04-19T03:02:18.180 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:18.180 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.180 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.180 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:18.180 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.070800+0000", 2024-04-19T03:02:18.180 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000125263 2024-04-19T03:02:18.180 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.181 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.181 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:18.181 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.070808+0000", 2024-04-19T03:02:18.181 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0209999999999999e-06 2024-04-19T03:02:18.181 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.181 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.181 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:18.181 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.070814+0000", 2024-04-19T03:02:18.181 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0969999999999996e-06 2024-04-19T03:02:18.181 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.181 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.181 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:18.181 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.071956+0000", 2024-04-19T03:02:18.181 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0011427480000000001 2024-04-19T03:02:18.181 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.182 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.182 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:18.182 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.072153+0000", 2024-04-19T03:02:18.182 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000196524 2024-04-19T03:02:18.182 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.182 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.182 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:18.182 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.072312+0000", 2024-04-19T03:02:18.183 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015879300000000001 2024-04-19T03:02:18.183 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.183 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.183 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:18.183 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.078407+0000", 2024-04-19T03:02:18.183 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0060954929999999996 2024-04-19T03:02:18.183 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.183 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.183 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:18.183 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.092742+0000", 2024-04-19T03:02:18.183 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.014335349000000001 2024-04-19T03:02:18.183 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.184 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.184 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:18.184 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.092815+0000", 2024-04-19T03:02:18.184 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2881999999999998e-05 2024-04-19T03:02:18.184 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.184 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.184 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:18.185 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.092872+0000", 2024-04-19T03:02:18.185 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6965000000000001e-05 2024-04-19T03:02:18.185 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:18.185 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:18.185 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:18.185 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.185 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.185 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:11297 5.e 5:7975ecb6:::benchmark_data_smithi096_19531_object11296:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T03:02:18.185 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:42.076848+0000", 2024-04-19T03:02:18.185 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 36.054312605, 2024-04-19T03:02:18.185 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020867969, 2024-04-19T03:02:18.185 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:18.185 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:18.185 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:18.186 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:18.186 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:18.186 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 11297 2024-04-19T03:02:18.186 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.186 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:18.186 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.186 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:18.186 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.076848+0000", 2024-04-19T03:02:18.186 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:18.186 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.186 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.186 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:18.186 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.076848+0000", 2024-04-19T03:02:18.187 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:18.187 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.187 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.187 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:18.187 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.076846+0000", 2024-04-19T03:02:18.187 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:18.187 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.187 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.187 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:18.187 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.076894+0000", 2024-04-19T03:02:18.187 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7645000000000002e-05 2024-04-19T03:02:18.187 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.187 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.187 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:18.188 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.076913+0000", 2024-04-19T03:02:18.188 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8885e-05 2024-04-19T03:02:18.188 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.188 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.188 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:18.188 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.076924+0000", 2024-04-19T03:02:18.188 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.118e-05 2024-04-19T03:02:18.188 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.188 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.188 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:18.188 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.076983+0000", 2024-04-19T03:02:18.188 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8952000000000001e-05 2024-04-19T03:02:18.188 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.188 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.189 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:18.189 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.077156+0000", 2024-04-19T03:02:18.189 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00017307600000000001 2024-04-19T03:02:18.189 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.189 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.189 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:18.189 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.077358+0000", 2024-04-19T03:02:18.189 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000201991 2024-04-19T03:02:18.189 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.189 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.189 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:18.189 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.080885+0000", 2024-04-19T03:02:18.189 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0035268309999999998 2024-04-19T03:02:18.189 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.190 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.190 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:18.190 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.097569+0000", 2024-04-19T03:02:18.190 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.016683854000000001 2024-04-19T03:02:18.190 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.190 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.190 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:18.190 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.097647+0000", 2024-04-19T03:02:18.190 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.7823000000000004e-05 2024-04-19T03:02:18.190 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.190 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.190 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:18.190 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.097716+0000", 2024-04-19T03:02:18.191 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.9079999999999996e-05 2024-04-19T03:02:18.191 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:18.191 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:18.191 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:18.191 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.191 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.191 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:11298 5.e 5:72565f0a:::benchmark_data_smithi096_19531_object11297:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T03:02:18.191 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:42.076954+0000", 2024-04-19T03:02:18.191 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 36.054206731000001, 2024-04-19T03:02:18.191 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020950191999999999, 2024-04-19T03:02:18.191 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:18.191 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:18.191 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:18.191 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:18.192 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:18.192 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 11298 2024-04-19T03:02:18.192 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.192 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:18.192 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.192 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:18.192 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.076954+0000", 2024-04-19T03:02:18.192 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:18.192 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.192 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.192 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:18.192 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.076954+0000", 2024-04-19T03:02:18.192 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:18.193 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.193 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.193 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:18.193 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.076953+0000", 2024-04-19T03:02:18.193 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:18.193 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.193 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.193 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:18.193 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.076997+0000", 2024-04-19T03:02:18.193 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4023000000000002e-05 2024-04-19T03:02:18.193 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.194 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.194 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:18.194 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.077009+0000", 2024-04-19T03:02:18.194 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2456000000000001e-05 2024-04-19T03:02:18.194 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.194 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.194 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:18.194 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.077015+0000", 2024-04-19T03:02:18.194 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7950000000000004e-06 2024-04-19T03:02:18.194 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.194 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.194 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:18.194 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.078552+0000", 2024-04-19T03:02:18.195 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0015371320000000001 2024-04-19T03:02:18.195 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.195 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.195 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:18.195 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.078760+0000", 2024-04-19T03:02:18.195 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00020808799999999999 2024-04-19T03:02:18.195 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.195 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.195 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:18.195 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.078875+0000", 2024-04-19T03:02:18.196 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011457500000000001 2024-04-19T03:02:18.196 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.196 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.196 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:18.196 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.083603+0000", 2024-04-19T03:02:18.196 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0047276239999999997 2024-04-19T03:02:18.196 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.196 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.196 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:18.196 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.097783+0000", 2024-04-19T03:02:18.196 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.014180036 2024-04-19T03:02:18.196 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.196 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.196 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:18.196 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.097863+0000", 2024-04-19T03:02:18.196 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0317999999999999e-05 2024-04-19T03:02:18.197 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.197 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.197 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:18.197 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.097904+0000", 2024-04-19T03:02:18.197 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1035000000000003e-05 2024-04-19T03:02:18.197 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:18.197 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:18.197 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:18.197 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.197 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.197 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:50576 5.b 5:d250063d:::benchmark_data_smithi096_19531_object50575:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-19T03:02:18.197 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:00.329584+0000", 2024-04-19T03:02:18.197 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 17.801576117, 2024-04-19T03:02:18.197 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.021217389, 2024-04-19T03:02:18.197 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:18.198 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:18.198 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:18.198 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:18.198 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:18.198 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 50576 2024-04-19T03:02:18.198 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.198 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:18.198 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.198 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:18.198 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:00.329584+0000", 2024-04-19T03:02:18.198 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:18.198 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.198 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.198 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:18.199 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:00.329584+0000", 2024-04-19T03:02:18.199 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:18.199 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.199 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.199 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:18.199 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:00.329583+0000", 2024-04-19T03:02:18.199 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:18.199 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.199 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.199 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:18.199 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:00.329626+0000", 2024-04-19T03:02:18.199 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2530000000000001e-05 2024-04-19T03:02:18.199 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.199 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.199 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:18.201 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:00.329642+0000", 2024-04-19T03:02:18.201 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5891000000000001e-05 2024-04-19T03:02:18.201 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.201 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.201 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:18.201 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:00.329652+0000", 2024-04-19T03:02:18.201 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0093e-05 2024-04-19T03:02:18.201 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.201 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.201 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:18.202 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:00.330793+0000", 2024-04-19T03:02:18.202 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001141097 2024-04-19T03:02:18.202 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.202 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.202 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:18.202 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:00.330924+0000", 2024-04-19T03:02:18.202 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013114499999999999 2024-04-19T03:02:18.202 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.202 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.202 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:18.202 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:00.331055+0000", 2024-04-19T03:02:18.202 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013124600000000001 2024-04-19T03:02:18.202 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.202 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.203 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:18.203 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:00.335705+0000", 2024-04-19T03:02:18.203 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0046501549999999996 2024-04-19T03:02:18.203 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.203 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.203 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:18.203 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:00.350741+0000", 2024-04-19T03:02:18.203 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015035411 2024-04-19T03:02:18.203 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.203 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.204 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:18.204 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:00.350777+0000", 2024-04-19T03:02:18.204 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5874999999999998e-05 2024-04-19T03:02:18.204 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.204 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.204 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:18.204 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:00.350802+0000", 2024-04-19T03:02:18.204 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5040000000000001e-05 2024-04-19T03:02:18.204 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:18.204 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:18.204 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:18.204 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.204 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.204 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:52909 5.b 5:df07ce30:::benchmark_data_smithi096_19531_object52908:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-19T03:02:18.205 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:01.602899+0000", 2024-04-19T03:02:18.205 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 16.528261746999998, 2024-04-19T03:02:18.205 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020403345, 2024-04-19T03:02:18.205 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:18.205 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:18.205 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:18.205 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:18.205 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:18.205 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 52909 2024-04-19T03:02:18.205 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.205 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:18.206 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.206 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:18.206 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:01.602899+0000", 2024-04-19T03:02:18.206 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:18.206 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.206 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.206 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:18.206 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:01.602899+0000", 2024-04-19T03:02:18.206 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:18.206 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.206 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.207 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:18.207 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:01.602883+0000", 2024-04-19T03:02:18.207 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999838 2024-04-19T03:02:18.207 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.207 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.207 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:18.207 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:01.602956+0000", 2024-04-19T03:02:18.207 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2941000000000005e-05 2024-04-19T03:02:18.207 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.207 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.207 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:18.207 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:01.602970+0000", 2024-04-19T03:02:18.207 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4562999999999999e-05 2024-04-19T03:02:18.207 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.207 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.208 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:18.208 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:01.602981+0000", 2024-04-19T03:02:18.208 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1134999999999999e-05 2024-04-19T03:02:18.208 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.208 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.208 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:18.208 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:01.603043+0000", 2024-04-19T03:02:18.208 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2034999999999998e-05 2024-04-19T03:02:18.208 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.208 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.208 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:18.208 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:01.603173+0000", 2024-04-19T03:02:18.208 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012962800000000001 2024-04-19T03:02:18.208 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.208 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.209 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:18.209 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:01.603296+0000", 2024-04-19T03:02:18.209 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012313 2024-04-19T03:02:18.209 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.209 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.209 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:18.209 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:01.606862+0000", 2024-04-19T03:02:18.209 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0035656049999999999 2024-04-19T03:02:18.209 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.209 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.209 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:18.209 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:01.623147+0000", 2024-04-19T03:02:18.209 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.016285286 2024-04-19T03:02:18.210 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.210 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.210 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:18.210 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:01.623251+0000", 2024-04-19T03:02:18.210 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000104245 2024-04-19T03:02:18.210 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.210 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.210 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:18.210 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:01.623302+0000", 2024-04-19T03:02:18.210 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0763999999999997e-05 2024-04-19T03:02:18.210 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:18.210 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:18.211 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:18.211 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.211 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.211 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:52912 5.b 5:deddbeae:::benchmark_data_smithi096_19531_object52911:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e34)", 2024-04-19T03:02:18.211 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:01.603006+0000", 2024-04-19T03:02:18.211 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 16.528153956000001, 2024-04-19T03:02:18.211 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020493783000000002, 2024-04-19T03:02:18.211 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:18.211 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:18.211 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:18.211 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:18.211 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:18.211 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 52912 2024-04-19T03:02:18.211 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.212 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:18.212 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.212 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:18.212 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:01.603006+0000", 2024-04-19T03:02:18.212 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:18.212 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.212 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.212 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:18.212 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:01.603006+0000", 2024-04-19T03:02:18.212 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:18.212 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.212 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.212 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:18.212 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:01.603006+0000", 2024-04-19T03:02:18.213 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:18.213 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.213 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.213 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:18.213 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:01.603054+0000", 2024-04-19T03:02:18.213 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8529000000000002e-05 2024-04-19T03:02:18.213 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.213 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.213 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:18.213 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:01.603067+0000", 2024-04-19T03:02:18.213 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2412000000000001e-05 2024-04-19T03:02:18.213 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.213 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.213 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:18.213 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:01.603078+0000", 2024-04-19T03:02:18.214 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1059e-05 2024-04-19T03:02:18.214 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.214 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.214 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:18.214 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:01.605226+0000", 2024-04-19T03:02:18.214 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0021488029999999999 2024-04-19T03:02:18.214 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.214 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.214 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:18.215 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:01.605333+0000", 2024-04-19T03:02:18.215 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000106346 2024-04-19T03:02:18.215 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.215 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.215 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:18.215 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:01.605426+0000", 2024-04-19T03:02:18.215 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.2985999999999994e-05 2024-04-19T03:02:18.215 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.215 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.215 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:18.215 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:01.607251+0000", 2024-04-19T03:02:18.215 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0018255789999999999 2024-04-19T03:02:18.215 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.215 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.215 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:18.216 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:01.623413+0000", 2024-04-19T03:02:18.216 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.016161854999999999 2024-04-19T03:02:18.216 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.216 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.216 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:18.216 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:01.623448+0000", 2024-04-19T03:02:18.216 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4498000000000001e-05 2024-04-19T03:02:18.216 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.216 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.216 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:18.216 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:01.623500+0000", 2024-04-19T03:02:18.217 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2543999999999997e-05 2024-04-19T03:02:18.217 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:18.217 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:18.217 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:18.217 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.217 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.217 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:57961 5.4 5:25b0464f:::benchmark_data_smithi096_19531_object57960:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-19T03:02:18.217 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:04.472703+0000", 2024-04-19T03:02:18.217 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 13.658457673000001, 2024-04-19T03:02:18.217 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.021714888000000002, 2024-04-19T03:02:18.217 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:18.217 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:18.217 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:18.217 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:18.217 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:18.218 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 57961 2024-04-19T03:02:18.218 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.218 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:18.218 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.218 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:18.218 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:04.472703+0000", 2024-04-19T03:02:18.218 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:18.218 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.218 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.218 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:18.218 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:04.472703+0000", 2024-04-19T03:02:18.218 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:18.218 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.218 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.219 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:18.219 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:04.472701+0000", 2024-04-19T03:02:18.219 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:18.219 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.219 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.219 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:18.219 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:04.472805+0000", 2024-04-19T03:02:18.219 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000103268 2024-04-19T03:02:18.219 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.219 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.219 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:18.219 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:04.472818+0000", 2024-04-19T03:02:18.219 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3528e-05 2024-04-19T03:02:18.219 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.220 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.220 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:18.220 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:04.472825+0000", 2024-04-19T03:02:18.220 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.0210000000000002e-06 2024-04-19T03:02:18.220 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.220 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.220 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:18.220 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:04.473983+0000", 2024-04-19T03:02:18.220 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0011581600000000001 2024-04-19T03:02:18.220 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.220 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.220 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:18.220 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:04.474201+0000", 2024-04-19T03:02:18.220 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00021749000000000001 2024-04-19T03:02:18.221 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.221 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.221 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:18.221 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:04.474378+0000", 2024-04-19T03:02:18.221 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00017696300000000001 2024-04-19T03:02:18.221 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.221 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.221 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:18.221 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:04.477308+0000", 2024-04-19T03:02:18.221 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0029298140000000002 2024-04-19T03:02:18.221 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.221 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.221 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:18.221 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:04.494322+0000", 2024-04-19T03:02:18.222 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.017014567000000001 2024-04-19T03:02:18.222 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.222 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.222 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:18.222 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:04.494386+0000", 2024-04-19T03:02:18.222 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4122999999999996e-05 2024-04-19T03:02:18.222 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.222 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.222 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:18.222 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:04.494418+0000", 2024-04-19T03:02:18.222 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1245999999999999e-05 2024-04-19T03:02:18.223 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:18.223 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:18.223 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:18.223 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.223 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.223 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:58042 5.b 5:d6f19b42:::benchmark_data_smithi096_19531_object58041:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-19T03:02:18.223 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:04.520286+0000", 2024-04-19T03:02:18.223 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 13.610874278000001, 2024-04-19T03:02:18.223 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020956167000000001, 2024-04-19T03:02:18.223 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:18.223 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:18.224 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:18.224 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:18.224 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:18.224 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 58042 2024-04-19T03:02:18.224 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.224 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:18.224 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.224 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:18.224 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:04.520286+0000", 2024-04-19T03:02:18.224 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:18.224 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.224 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.225 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:18.225 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:04.520286+0000", 2024-04-19T03:02:18.225 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:18.225 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.225 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.225 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:18.225 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:04.520285+0000", 2024-04-19T03:02:18.225 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:18.225 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.226 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.226 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:18.226 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:04.520374+0000", 2024-04-19T03:02:18.226 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9599999999999996e-05 2024-04-19T03:02:18.226 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.226 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.226 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:18.226 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:04.520409+0000", 2024-04-19T03:02:18.226 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4952e-05 2024-04-19T03:02:18.226 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.226 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.227 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:18.227 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:04.520421+0000", 2024-04-19T03:02:18.227 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.187e-05 2024-04-19T03:02:18.227 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.227 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.227 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:18.227 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:04.523527+0000", 2024-04-19T03:02:18.227 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.003105465 2024-04-19T03:02:18.227 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.228 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.228 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:18.228 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:04.523740+0000", 2024-04-19T03:02:18.228 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00021303500000000001 2024-04-19T03:02:18.228 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.228 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.228 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:18.228 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:04.523947+0000", 2024-04-19T03:02:18.228 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00020676599999999999 2024-04-19T03:02:18.228 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.228 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.228 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:18.228 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:04.532791+0000", 2024-04-19T03:02:18.228 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0088447079999999997 2024-04-19T03:02:18.228 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.229 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.229 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:18.229 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:04.541145+0000", 2024-04-19T03:02:18.229 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0083535620000000001 2024-04-19T03:02:18.229 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.229 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.229 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:18.229 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:04.541208+0000", 2024-04-19T03:02:18.229 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3303e-05 2024-04-19T03:02:18.229 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.229 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.229 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:18.229 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:04.541242+0000", 2024-04-19T03:02:18.229 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4226000000000001e-05 2024-04-19T03:02:18.230 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:18.230 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:18.230 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:18.230 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.230 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.230 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:59827 5.d 5:b422f98a:::benchmark_data_smithi096_19531_object59826:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35)", 2024-04-19T03:02:18.230 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:05.531472+0000", 2024-04-19T03:02:18.230 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 12.599688457999999, 2024-04-19T03:02:18.230 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.021435431000000001, 2024-04-19T03:02:18.230 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:18.230 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:18.230 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:18.231 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:18.231 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:18.231 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 59827 2024-04-19T03:02:18.231 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.231 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:18.231 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.231 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:18.231 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:05.531472+0000", 2024-04-19T03:02:18.231 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:18.231 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.231 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.231 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:18.231 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:05.531472+0000", 2024-04-19T03:02:18.231 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:18.232 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.232 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.232 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:18.232 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:05.531471+0000", 2024-04-19T03:02:18.232 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:18.232 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.232 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.232 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:18.232 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:05.531501+0000", 2024-04-19T03:02:18.232 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0012999999999999e-05 2024-04-19T03:02:18.232 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.232 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.232 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:18.232 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:05.531509+0000", 2024-04-19T03:02:18.233 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.221e-06 2024-04-19T03:02:18.233 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.233 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.233 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:18.233 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:05.531514+0000", 2024-04-19T03:02:18.233 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2190000000000003e-06 2024-04-19T03:02:18.233 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.233 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.233 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:18.233 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:05.531554+0000", 2024-04-19T03:02:18.233 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9907999999999998e-05 2024-04-19T03:02:18.233 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.233 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.233 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:18.233 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:05.531677+0000", 2024-04-19T03:02:18.234 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012335699999999999 2024-04-19T03:02:18.234 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.234 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.234 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-04-19T03:02:18.234 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:05.531811+0000", 2024-04-19T03:02:18.234 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000133645 2024-04-19T03:02:18.234 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.234 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.234 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:18.234 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:05.535051+0000", 2024-04-19T03:02:18.234 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0032405889999999999 2024-04-19T03:02:18.234 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.234 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.234 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:18.234 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:05.552796+0000", 2024-04-19T03:02:18.235 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.017744138 2024-04-19T03:02:18.235 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.235 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.235 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:18.235 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:05.552859+0000", 2024-04-19T03:02:18.235 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3649e-05 2024-04-19T03:02:18.235 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.235 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.235 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:18.236 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:05.552907+0000", 2024-04-19T03:02:18.236 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8231e-05 2024-04-19T03:02:18.236 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:18.236 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:18.236 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:18.236 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.236 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.236 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:60972 5.b 5:d54d473f:::benchmark_data_smithi096_19531_object60971:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2024-04-19T03:02:18.236 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:06.223871+0000", 2024-04-19T03:02:18.236 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 11.907289105, 2024-04-19T03:02:18.236 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.021863176000000002, 2024-04-19T03:02:18.236 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:18.236 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:18.236 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:18.236 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:18.237 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:18.237 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 60972 2024-04-19T03:02:18.237 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.237 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:18.237 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.237 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:18.237 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:06.223871+0000", 2024-04-19T03:02:18.237 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:18.237 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.238 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.238 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:18.238 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:06.223871+0000", 2024-04-19T03:02:18.238 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:18.238 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.238 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.238 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:18.238 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:06.223870+0000", 2024-04-19T03:02:18.238 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:18.238 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.238 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.238 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:18.238 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:06.223943+0000", 2024-04-19T03:02:18.239 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2619000000000004e-05 2024-04-19T03:02:18.239 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.239 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.239 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:18.239 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:06.223954+0000", 2024-04-19T03:02:18.239 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0491e-05 2024-04-19T03:02:18.239 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.239 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.239 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:18.239 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:06.223961+0000", 2024-04-19T03:02:18.239 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2089999999999999e-06 2024-04-19T03:02:18.239 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.239 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.239 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:18.239 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:06.224005+0000", 2024-04-19T03:02:18.240 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3884999999999997e-05 2024-04-19T03:02:18.240 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.240 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.240 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:18.240 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:06.224101+0000", 2024-04-19T03:02:18.240 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.6508000000000005e-05 2024-04-19T03:02:18.240 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.240 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.240 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:18.240 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:06.224200+0000", 2024-04-19T03:02:18.240 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.8870999999999996e-05 2024-04-19T03:02:18.240 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.240 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.240 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:18.241 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:06.230624+0000", 2024-04-19T03:02:18.241 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0064236110000000001 2024-04-19T03:02:18.241 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.241 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.241 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:18.241 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:06.245639+0000", 2024-04-19T03:02:18.241 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015015379000000001 2024-04-19T03:02:18.241 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.241 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.241 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:18.241 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:06.245701+0000", 2024-04-19T03:02:18.241 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1663999999999998e-05 2024-04-19T03:02:18.241 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.242 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.242 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:18.242 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:06.245735+0000", 2024-04-19T03:02:18.242 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3785000000000003e-05 2024-04-19T03:02:18.242 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:18.242 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:18.242 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:18.242 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.242 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.242 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:67762 5.4 5:20b04c26:::benchmark_data_smithi096_19531_object67761:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2024-04-19T03:02:18.242 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:10.239937+0000", 2024-04-19T03:02:18.242 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 7.8912236040000003, 2024-04-19T03:02:18.242 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020469803000000002, 2024-04-19T03:02:18.243 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:18.243 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:18.243 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:18.243 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:18.243 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:18.243 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 67762 2024-04-19T03:02:18.243 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.243 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:18.243 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.243 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:18.243 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:10.239937+0000", 2024-04-19T03:02:18.243 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:18.243 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.243 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.243 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:18.244 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:10.239937+0000", 2024-04-19T03:02:18.244 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:18.244 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.244 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.244 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:18.244 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:10.239936+0000", 2024-04-19T03:02:18.244 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:18.244 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.244 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.244 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:18.244 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:10.239983+0000", 2024-04-19T03:02:18.244 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7348999999999997e-05 2024-04-19T03:02:18.244 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.244 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.244 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:18.244 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:10.239994+0000", 2024-04-19T03:02:18.245 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0329000000000001e-05 2024-04-19T03:02:18.245 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.245 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.245 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:18.245 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:10.240002+0000", 2024-04-19T03:02:18.245 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0299999999999994e-06 2024-04-19T03:02:18.245 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.245 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.245 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:18.245 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:10.243811+0000", 2024-04-19T03:02:18.245 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0038095 2024-04-19T03:02:18.245 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.245 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.245 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:18.245 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:10.243937+0000", 2024-04-19T03:02:18.246 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012542099999999999 2024-04-19T03:02:18.246 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.246 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.246 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:18.246 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:10.244039+0000", 2024-04-19T03:02:18.246 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010274 2024-04-19T03:02:18.246 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.247 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.247 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:18.247 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:10.247304+0000", 2024-04-19T03:02:18.247 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0032646279999999999 2024-04-19T03:02:18.247 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.247 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.247 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:18.248 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:10.260327+0000", 2024-04-19T03:02:18.248 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013023211999999999 2024-04-19T03:02:18.248 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.248 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.248 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:18.248 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:10.260373+0000", 2024-04-19T03:02:18.248 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5899000000000002e-05 2024-04-19T03:02:18.249 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.249 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.249 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:18.249 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:10.260407+0000", 2024-04-19T03:02:18.249 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3430999999999999e-05 2024-04-19T03:02:18.249 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:18.249 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:18.250 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:18.250 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.250 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.250 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:73742 5.b 5:d86fe728:::benchmark_data_smithi096_19531_object73741:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2024-04-19T03:02:18.250 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:13.822877+0000", 2024-04-19T03:02:18.250 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 4.3082836220000003, 2024-04-19T03:02:18.251 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020717838999999998, 2024-04-19T03:02:18.251 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:18.251 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:18.251 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:18.251 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:18.251 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:18.252 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 73742 2024-04-19T03:02:18.252 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.252 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:18.252 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.252 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:18.252 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:13.822877+0000", 2024-04-19T03:02:18.252 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:18.253 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.253 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.253 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:18.253 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:13.822877+0000", 2024-04-19T03:02:18.253 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:18.253 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.253 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.254 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:18.254 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:13.822875+0000", 2024-04-19T03:02:18.254 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:18.254 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.254 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.254 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:18.255 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:13.822923+0000", 2024-04-19T03:02:18.255 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8118999999999998e-05 2024-04-19T03:02:18.255 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.255 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.255 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:18.255 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:13.822942+0000", 2024-04-19T03:02:18.255 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8709999999999999e-05 2024-04-19T03:02:18.255 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.255 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.256 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:18.256 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:13.822951+0000", 2024-04-19T03:02:18.256 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.7460000000000006e-06 2024-04-19T03:02:18.256 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.256 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.256 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:18.257 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:13.827792+0000", 2024-04-19T03:02:18.257 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0048410939999999998 2024-04-19T03:02:18.257 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.257 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.257 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:18.257 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:13.827976+0000", 2024-04-19T03:02:18.257 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00018441900000000001 2024-04-19T03:02:18.257 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.257 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.257 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:18.258 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:13.828067+0000", 2024-04-19T03:02:18.258 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1034999999999998e-05 2024-04-19T03:02:18.258 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.258 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.258 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:18.258 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:13.834404+0000", 2024-04-19T03:02:18.258 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0063362080000000003 2024-04-19T03:02:18.258 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.258 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.258 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:18.258 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:13.843527+0000", 2024-04-19T03:02:18.259 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0091229399999999995 2024-04-19T03:02:18.259 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.259 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.259 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:18.259 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:13.843557+0000", 2024-04-19T03:02:18.259 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0886000000000002e-05 2024-04-19T03:02:18.259 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.259 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.259 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:18.259 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:13.843595+0000", 2024-04-19T03:02:18.259 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7169999999999998e-05 2024-04-19T03:02:18.259 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:18.260 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:18.260 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:18.260 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.260 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.260 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:79014 5.d 5:b5eee02c:::benchmark_data_smithi096_19531_object79013:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-19T03:02:18.260 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:18.032471+0000", 2024-04-19T03:02:18.260 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.098689257000000002, 2024-04-19T03:02:18.260 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.041427629000000001, 2024-04-19T03:02:18.260 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:18.260 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:18.260 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:18.260 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:18.260 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:18.260 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 79014 2024-04-19T03:02:18.261 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.261 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:18.261 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.261 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:18.261 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:18.032471+0000", 2024-04-19T03:02:18.261 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:18.261 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.261 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.261 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:18.261 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:18.032471+0000", 2024-04-19T03:02:18.261 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:18.261 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.261 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.261 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:18.262 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:18.032470+0000", 2024-04-19T03:02:18.262 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:18.262 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.262 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.262 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:18.262 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:18.032525+0000", 2024-04-19T03:02:18.262 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5535999999999998e-05 2024-04-19T03:02:18.262 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.262 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.262 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:18.262 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:18.032537+0000", 2024-04-19T03:02:18.262 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1987999999999999e-05 2024-04-19T03:02:18.263 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.263 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.263 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:18.263 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:18.032546+0000", 2024-04-19T03:02:18.263 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9670000000000007e-06 2024-04-19T03:02:18.263 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.263 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.263 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:18.263 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:18.032613+0000", 2024-04-19T03:02:18.263 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6508999999999996e-05 2024-04-19T03:02:18.263 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.263 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.263 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:18.263 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:18.032738+0000", 2024-04-19T03:02:18.264 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000124912 2024-04-19T03:02:18.264 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.264 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.264 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-04-19T03:02:18.264 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:18.032867+0000", 2024-04-19T03:02:18.264 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012959399999999999 2024-04-19T03:02:18.264 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.264 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.264 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:18.264 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:18.035867+0000", 2024-04-19T03:02:18.264 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.002999378 2024-04-19T03:02:18.264 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.264 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.265 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:18.265 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:18.073705+0000", 2024-04-19T03:02:18.265 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.037838042000000002 2024-04-19T03:02:18.265 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.265 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.265 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:18.265 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:18.073813+0000", 2024-04-19T03:02:18.265 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010806099999999999 2024-04-19T03:02:18.265 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:18.265 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:18.265 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:18.265 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:18.073899+0000", 2024-04-19T03:02:18.265 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.5971999999999996e-05 2024-04-19T03:02:18.265 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:18.266 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:18.266 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:18.266 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:18.266 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:18.266 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-19T03:02:18.267 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-04-19T03:02:18.266+0000 7f35986ab700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18243) UID: 0 2024-04-19T03:02:18.268 INFO:teuthology.orchestra.run.smithi096.stderr:noscrub is unset 2024-04-19T03:02:18.269 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T03:02:18.370 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-04-19T03:02:18.366+0000 7f35986ab700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18243) UID: 0 2024-04-19T03:02:18.394 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-04-19T03:02:18.394 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [ 2024-04-19T03:02:18.394 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.394 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop_reply(client.4755.0:79543 5.9 e41/22 ondisk, result = 0)", 2024-04-19T03:02:18.394 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:18.392727+0000", 2024-04-19T03:02:18.394 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.00020817200000000001, 2024-04-19T03:02:18.394 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00022156300000000001, 2024-04-19T03:02:18.394 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:18.395 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-04-19T03:02:18.395 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:18.395 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.395 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:18.395 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.392727+0000", 2024-04-19T03:02:18.395 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:18.395 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.395 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.395 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:18.395 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.392727+0000", 2024-04-19T03:02:18.395 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:18.395 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.395 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.395 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:18.396 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.392726+0000", 2024-04-19T03:02:18.396 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:18.396 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.396 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.396 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:18.396 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.392735+0000", 2024-04-19T03:02:18.396 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.2159999999999995e-06 2024-04-19T03:02:18.396 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.396 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.396 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:18.396 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.392744+0000", 2024-04-19T03:02:18.396 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.2310000000000002e-06 2024-04-19T03:02:18.396 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.397 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.397 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:18.397 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.392752+0000", 2024-04-19T03:02:18.397 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0369999999999997e-06 2024-04-19T03:02:18.397 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.397 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.397 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:18.397 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.392818+0000", 2024-04-19T03:02:18.397 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6945000000000004e-05 2024-04-19T03:02:18.397 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.397 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.397 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:18.398 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.392828+0000", 2024-04-19T03:02:18.398 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.1770000000000004e-06 2024-04-19T03:02:18.398 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:18.398 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:18.398 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:18.398 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.398 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.398 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:79540 5.7 5:e225f670:::benchmark_data_smithi096_19531_object79539:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-19T03:02:18.398 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:18.384808+0000", 2024-04-19T03:02:18.398 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0081265850000000004, 2024-04-19T03:02:18.398 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0081836540000000003, 2024-04-19T03:02:18.398 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:18.398 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:02:18.399 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:18.399 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:18.399 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:18.399 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 79540 2024-04-19T03:02:18.399 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.399 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:18.399 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.399 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:18.399 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.384808+0000", 2024-04-19T03:02:18.399 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:18.399 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.399 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.399 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:18.400 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.384808+0000", 2024-04-19T03:02:18.400 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:18.400 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.400 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.400 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:18.400 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.384807+0000", 2024-04-19T03:02:18.400 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:18.400 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.400 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.400 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:18.400 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.384854+0000", 2024-04-19T03:02:18.400 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7134e-05 2024-04-19T03:02:18.401 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.401 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.401 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:18.401 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.384869+0000", 2024-04-19T03:02:18.401 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4163e-05 2024-04-19T03:02:18.401 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.401 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.401 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:18.401 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.384877+0000", 2024-04-19T03:02:18.401 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.3999999999999992e-06 2024-04-19T03:02:18.401 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.401 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.401 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:18.401 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.384927+0000", 2024-04-19T03:02:18.402 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0247000000000002e-05 2024-04-19T03:02:18.402 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.402 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.402 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:18.402 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.385067+0000", 2024-04-19T03:02:18.402 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00013950099999999999 2024-04-19T03:02:18.402 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.402 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.402 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:18.402 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.385218+0000", 2024-04-19T03:02:18.402 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00015120699999999999 2024-04-19T03:02:18.402 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:18.403 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:18.403 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:18.403 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.403 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.403 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:79541 5.7 5:ea347c73:::benchmark_data_smithi096_19531_object79540:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-19T03:02:18.403 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:18.387457+0000", 2024-04-19T03:02:18.403 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0054779939999999999, 2024-04-19T03:02:18.403 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0055915890000000001, 2024-04-19T03:02:18.403 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:18.403 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:02:18.403 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:18.403 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:18.403 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:18.403 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 79541 2024-04-19T03:02:18.404 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.404 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:18.404 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.404 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:18.404 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.387457+0000", 2024-04-19T03:02:18.404 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:18.404 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.404 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.404 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:18.404 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.387457+0000", 2024-04-19T03:02:18.404 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:18.404 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.404 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.404 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:18.404 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.387456+0000", 2024-04-19T03:02:18.405 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:18.405 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.405 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.405 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:18.405 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.387503+0000", 2024-04-19T03:02:18.405 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6900000000000002e-05 2024-04-19T03:02:18.405 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.405 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.405 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:18.405 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.387515+0000", 2024-04-19T03:02:18.405 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1946999999999999e-05 2024-04-19T03:02:18.405 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.405 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.406 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:18.406 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.387526+0000", 2024-04-19T03:02:18.406 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1790000000000001e-05 2024-04-19T03:02:18.406 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.406 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.406 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:18.406 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.387834+0000", 2024-04-19T03:02:18.406 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00030785399999999998 2024-04-19T03:02:18.406 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.406 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.406 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:18.406 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.388039+0000", 2024-04-19T03:02:18.406 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00020509200000000001 2024-04-19T03:02:18.407 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.407 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.407 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:18.407 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.388228+0000", 2024-04-19T03:02:18.407 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000188992 2024-04-19T03:02:18.407 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:18.407 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:18.407 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:18.407 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.407 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.407 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:79547 5.f 5:f6c2a02f:::benchmark_data_smithi096_19531_object79546:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-19T03:02:18.407 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:18.388371+0000", 2024-04-19T03:02:18.407 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0045637109999999998, 2024-04-19T03:02:18.407 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0047166309999999998, 2024-04-19T03:02:18.408 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:18.408 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:02:18.408 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:18.408 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:18.408 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:18.408 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 79547 2024-04-19T03:02:18.408 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.408 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:18.408 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.408 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:18.408 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.388371+0000", 2024-04-19T03:02:18.408 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:18.408 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.408 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.409 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:18.409 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.388371+0000", 2024-04-19T03:02:18.409 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:18.409 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.409 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.409 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:18.409 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.388370+0000", 2024-04-19T03:02:18.409 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:18.409 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.409 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.409 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:18.409 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.388431+0000", 2024-04-19T03:02:18.409 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0773000000000002e-05 2024-04-19T03:02:18.409 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.410 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.410 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:18.410 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.388451+0000", 2024-04-19T03:02:18.410 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9817e-05 2024-04-19T03:02:18.410 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.410 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.410 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:18.410 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.388479+0000", 2024-04-19T03:02:18.410 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.8183000000000001e-05 2024-04-19T03:02:18.410 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.410 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.410 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:18.410 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.388515+0000", 2024-04-19T03:02:18.410 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6013999999999998e-05 2024-04-19T03:02:18.411 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.411 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.411 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:18.411 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.388662+0000", 2024-04-19T03:02:18.411 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000146627 2024-04-19T03:02:18.411 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.411 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.411 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:02:18.411 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.388791+0000", 2024-04-19T03:02:18.411 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00012939599999999999 2024-04-19T03:02:18.411 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:18.411 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:18.411 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:18.411 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.412 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.412 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4755.0:79545 5.6 e41/22 5:6290b29e:::benchmark_data_smithi096_19531_object79544:head v 41'5029, mlcod=41'5026)", 2024-04-19T03:02:18.412 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:18.390250+0000", 2024-04-19T03:02:18.412 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0026847220000000001, 2024-04-19T03:02:18.412 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.002875701, 2024-04-19T03:02:18.412 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:18.412 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-04-19T03:02:18.412 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:18.412 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.412 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:18.412 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.390250+0000", 2024-04-19T03:02:18.412 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:18.412 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.412 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.412 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:18.412 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.390250+0000", 2024-04-19T03:02:18.413 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:18.413 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.413 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.413 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:18.413 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.390250+0000", 2024-04-19T03:02:18.413 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:18.413 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.413 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.413 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:18.413 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.390302+0000", 2024-04-19T03:02:18.413 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1953000000000002e-05 2024-04-19T03:02:18.413 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.413 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.413 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:18.413 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.390312+0000", 2024-04-19T03:02:18.414 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.927e-06 2024-04-19T03:02:18.414 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.414 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.414 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:18.414 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.390318+0000", 2024-04-19T03:02:18.414 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3579999999999999e-06 2024-04-19T03:02:18.414 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.414 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.414 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:18.414 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.390360+0000", 2024-04-19T03:02:18.414 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1866000000000002e-05 2024-04-19T03:02:18.414 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.414 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.414 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:18.415 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.390381+0000", 2024-04-19T03:02:18.415 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1308e-05 2024-04-19T03:02:18.415 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:18.415 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:18.415 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:18.415 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.415 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.415 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:79549 5.7 5:e9ac0d31:::benchmark_data_smithi096_19531_object79548:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-19T03:02:18.415 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:18.390573+0000", 2024-04-19T03:02:18.415 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0023625600000000001, 2024-04-19T03:02:18.415 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0025853719999999998, 2024-04-19T03:02:18.415 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:18.415 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:02:18.415 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:18.415 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:18.416 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:18.416 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 79549 2024-04-19T03:02:18.416 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.416 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:18.416 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.416 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:18.416 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.390573+0000", 2024-04-19T03:02:18.416 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:18.416 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.416 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.416 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:18.416 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.390573+0000", 2024-04-19T03:02:18.416 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:18.416 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.416 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.417 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:18.417 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.390571+0000", 2024-04-19T03:02:18.417 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:18.417 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.417 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.417 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:18.417 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.390657+0000", 2024-04-19T03:02:18.417 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.5723999999999994e-05 2024-04-19T03:02:18.417 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.418 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.418 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:18.418 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.390667+0000", 2024-04-19T03:02:18.418 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0176e-05 2024-04-19T03:02:18.418 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.418 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.418 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:18.418 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.390676+0000", 2024-04-19T03:02:18.418 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2020000000000004e-06 2024-04-19T03:02:18.418 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.418 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.418 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:18.419 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.390720+0000", 2024-04-19T03:02:18.419 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4669999999999998e-05 2024-04-19T03:02:18.420 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.420 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.420 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:18.420 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.390880+0000", 2024-04-19T03:02:18.420 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00016003499999999999 2024-04-19T03:02:18.420 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.420 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.420 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:18.420 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.391049+0000", 2024-04-19T03:02:18.420 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00016870899999999999 2024-04-19T03:02:18.420 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:18.420 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:18.420 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:18.420 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.421 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.421 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:79551 5.f 5:fe6d13bd:::benchmark_data_smithi096_19531_object79550:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-19T03:02:18.421 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:18.391295+0000", 2024-04-19T03:02:18.421 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.001640358, 2024-04-19T03:02:18.421 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0019014399999999999, 2024-04-19T03:02:18.421 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:18.421 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:02:18.421 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:18.421 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:18.421 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:18.421 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 79551 2024-04-19T03:02:18.421 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.421 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:18.422 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.422 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:18.422 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.391295+0000", 2024-04-19T03:02:18.422 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:18.422 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.422 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.422 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:18.422 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.391295+0000", 2024-04-19T03:02:18.422 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:18.422 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.422 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.422 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:18.422 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.391294+0000", 2024-04-19T03:02:18.423 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:18.423 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.423 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.423 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:18.423 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.391388+0000", 2024-04-19T03:02:18.423 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.4077000000000001e-05 2024-04-19T03:02:18.423 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.423 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.423 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:18.423 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.391424+0000", 2024-04-19T03:02:18.423 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6031000000000001e-05 2024-04-19T03:02:18.423 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.423 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.423 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:18.424 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.391431+0000", 2024-04-19T03:02:18.424 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4270000000000002e-06 2024-04-19T03:02:18.424 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.424 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.424 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:18.424 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.391642+0000", 2024-04-19T03:02:18.424 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00021026000000000001 2024-04-19T03:02:18.424 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.424 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.424 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:18.424 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.391808+0000", 2024-04-19T03:02:18.424 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000166904 2024-04-19T03:02:18.424 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.424 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.425 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:02:18.425 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.391927+0000", 2024-04-19T03:02:18.425 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000118717 2024-04-19T03:02:18.425 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:18.425 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:18.425 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:18.425 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:18.425 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-04-19T03:02:18.425 INFO:teuthology.orchestra.run.smithi144.stdout: "num_ops": 7 2024-04-19T03:02:18.425 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-04-19T03:02:18.426 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T03:02:18.469 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:18.465+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:18.551 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-04-19T03:02:18.552 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2024-04-19T03:02:18.552 INFO:teuthology.orchestra.run.smithi144.stdout: "complaint_time": 30, 2024-04-19T03:02:18.552 INFO:teuthology.orchestra.run.smithi144.stdout: "num_blocked_ops": 0 2024-04-19T03:02:18.552 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-04-19T03:02:18.564 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T03:02:18.569 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-04-19T03:02:18.566+0000 7f35986ab700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18243) UID: 0 2024-04-19T03:02:18.670 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-04-19T03:02:18.666+0000 7f35986ab700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 18243) UID: 0 2024-04-19T03:02:18.689 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-04-19T03:02:18.689 INFO:teuthology.orchestra.run.smithi144.stdout: "size": 20, 2024-04-19T03:02:18.689 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 600, 2024-04-19T03:02:18.690 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [ 2024-04-19T03:02:18.690 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.690 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:8 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:02:18.690 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:01:14.998165+0000", 2024-04-19T03:02:18.690 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 63.688568056999998, 2024-04-19T03:02:18.690 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.024541001, 2024-04-19T03:02:18.690 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:18.690 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:18.690 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:18.690 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.690 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:18.691 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998165+0000", 2024-04-19T03:02:18.691 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:18.691 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.691 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.691 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:18.691 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998165+0000", 2024-04-19T03:02:18.691 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:18.691 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.691 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.691 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:18.691 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998164+0000", 2024-04-19T03:02:18.692 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:18.692 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.692 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.692 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:18.692 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998170+0000", 2024-04-19T03:02:18.692 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2939999999999996e-06 2024-04-19T03:02:18.692 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.692 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.692 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:18.692 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998179+0000", 2024-04-19T03:02:18.692 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.5540000000000003e-06 2024-04-19T03:02:18.692 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.692 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.693 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:18.693 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998188+0000", 2024-04-19T03:02:18.693 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2959999999999999e-06 2024-04-19T03:02:18.693 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.693 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.693 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:18.693 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998332+0000", 2024-04-19T03:02:18.693 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00014474 2024-04-19T03:02:18.693 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.693 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.693 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:02:18.693 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998337+0000", 2024-04-19T03:02:18.693 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6909999999999996e-06 2024-04-19T03:02:18.694 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.694 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.694 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:18.694 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.010222+0000", 2024-04-19T03:02:18.694 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011885178 2024-04-19T03:02:18.694 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.694 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.694 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:18.694 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.010342+0000", 2024-04-19T03:02:18.694 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00011991500000000001 2024-04-19T03:02:18.694 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.694 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.695 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:02:18.695 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.010506+0000", 2024-04-19T03:02:18.695 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00016429699999999999 2024-04-19T03:02:18.695 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.695 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.695 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:18.695 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.014525+0000", 2024-04-19T03:02:18.695 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0040189839999999998 2024-04-19T03:02:18.695 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.695 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.695 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:18.695 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.022600+0000", 2024-04-19T03:02:18.696 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0080741990000000007 2024-04-19T03:02:18.696 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.696 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.696 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:18.696 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.022670+0000", 2024-04-19T03:02:18.696 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0743999999999999e-05 2024-04-19T03:02:18.696 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.696 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.696 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:18.696 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.022706+0000", 2024-04-19T03:02:18.696 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5782999999999999e-05 2024-04-19T03:02:18.697 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:18.697 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:18.697 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:18.697 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.697 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.697 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:27 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:02:18.697 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:01:14.998436+0000", 2024-04-19T03:02:18.697 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 63.688297403, 2024-04-19T03:02:18.697 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.024406325999999999, 2024-04-19T03:02:18.697 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:18.697 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:18.697 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:18.698 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.698 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:18.698 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998436+0000", 2024-04-19T03:02:18.698 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:18.698 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.698 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.698 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:18.698 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998436+0000", 2024-04-19T03:02:18.698 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:18.698 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.698 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.699 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:18.699 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998435+0000", 2024-04-19T03:02:18.699 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:18.699 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.699 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.699 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:18.699 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998445+0000", 2024-04-19T03:02:18.699 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0349e-05 2024-04-19T03:02:18.699 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.699 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.699 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:18.700 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998453+0000", 2024-04-19T03:02:18.700 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0399999999999993e-06 2024-04-19T03:02:18.700 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.700 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.700 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:18.700 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998461+0000", 2024-04-19T03:02:18.700 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9780000000000005e-06 2024-04-19T03:02:18.700 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.700 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.700 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:18.700 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998515+0000", 2024-04-19T03:02:18.700 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3097999999999999e-05 2024-04-19T03:02:18.701 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.701 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.701 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:02:18.701 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998520+0000", 2024-04-19T03:02:18.701 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9220000000000002e-06 2024-04-19T03:02:18.701 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.701 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.701 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:18.701 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.011258+0000", 2024-04-19T03:02:18.701 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.012737735 2024-04-19T03:02:18.701 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.701 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.702 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:18.702 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.011566+0000", 2024-04-19T03:02:18.702 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00030826200000000001 2024-04-19T03:02:18.702 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.702 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.702 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:02:18.702 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.011996+0000", 2024-04-19T03:02:18.702 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00042912000000000001 2024-04-19T03:02:18.702 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.702 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.702 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:18.703 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.014533+0000", 2024-04-19T03:02:18.703 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.002537423 2024-04-19T03:02:18.703 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.703 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.703 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:18.703 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.022756+0000", 2024-04-19T03:02:18.703 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0082231530000000004 2024-04-19T03:02:18.703 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.703 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.703 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:18.703 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.022807+0000", 2024-04-19T03:02:18.703 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0852e-05 2024-04-19T03:02:18.704 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.704 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.704 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:18.704 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.022842+0000", 2024-04-19T03:02:18.704 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5058000000000002e-05 2024-04-19T03:02:18.704 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:18.704 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:18.704 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:18.704 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.704 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.704 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:28 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:02:18.705 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:01:14.998476+0000", 2024-04-19T03:02:18.705 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 63.688257481000001, 2024-04-19T03:02:18.705 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.024656784000000001, 2024-04-19T03:02:18.705 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:18.705 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:18.705 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:18.705 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.705 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:18.705 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998476+0000", 2024-04-19T03:02:18.705 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:18.705 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.705 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.706 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:18.706 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998476+0000", 2024-04-19T03:02:18.706 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:18.706 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.706 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.706 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:18.706 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998475+0000", 2024-04-19T03:02:18.706 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:18.706 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.706 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.706 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:18.707 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998484+0000", 2024-04-19T03:02:18.707 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.7770000000000008e-06 2024-04-19T03:02:18.707 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.707 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.707 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:18.707 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998495+0000", 2024-04-19T03:02:18.707 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0726e-05 2024-04-19T03:02:18.707 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.707 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.707 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:18.707 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998503+0000", 2024-04-19T03:02:18.707 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.8780000000000004e-06 2024-04-19T03:02:18.708 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.708 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.708 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:18.708 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998579+0000", 2024-04-19T03:02:18.708 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5160999999999994e-05 2024-04-19T03:02:18.708 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.708 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.708 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:02:18.708 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998586+0000", 2024-04-19T03:02:18.708 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8520000000000004e-06 2024-04-19T03:02:18.708 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.708 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.709 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:18.709 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.012423+0000", 2024-04-19T03:02:18.709 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.013836667 2024-04-19T03:02:18.709 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.709 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.709 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:18.709 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.012532+0000", 2024-04-19T03:02:18.709 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000108565 2024-04-19T03:02:18.709 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.709 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.709 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:02:18.709 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.012655+0000", 2024-04-19T03:02:18.709 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00012344600000000001 2024-04-19T03:02:18.710 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.710 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.710 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:18.710 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.015680+0000", 2024-04-19T03:02:18.710 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0030246470000000001 2024-04-19T03:02:18.710 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.710 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.710 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:18.710 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.023091+0000", 2024-04-19T03:02:18.710 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0074116030000000001 2024-04-19T03:02:18.710 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.710 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.711 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:18.711 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.023115+0000", 2024-04-19T03:02:18.711 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.3091999999999998e-05 2024-04-19T03:02:18.711 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.711 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.711 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:18.711 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.023132+0000", 2024-04-19T03:02:18.711 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7901999999999999e-05 2024-04-19T03:02:18.711 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:18.711 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:18.711 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:18.711 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.711 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.711 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:29 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:02:18.712 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:01:14.998527+0000", 2024-04-19T03:02:18.712 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 63.688205941, 2024-04-19T03:02:18.712 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.024738599999999999, 2024-04-19T03:02:18.712 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:18.712 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:18.712 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:18.712 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.712 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:18.712 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998527+0000", 2024-04-19T03:02:18.712 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:18.712 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.712 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.713 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:18.713 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998527+0000", 2024-04-19T03:02:18.713 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:18.713 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.713 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.713 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:18.713 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998527+0000", 2024-04-19T03:02:18.713 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:18.713 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.713 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.713 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:18.713 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998531+0000", 2024-04-19T03:02:18.714 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9450000000000001e-06 2024-04-19T03:02:18.714 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.714 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.714 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:18.714 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998541+0000", 2024-04-19T03:02:18.714 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.4320000000000005e-06 2024-04-19T03:02:18.714 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.714 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.714 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:18.714 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998548+0000", 2024-04-19T03:02:18.715 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.221e-06 2024-04-19T03:02:18.715 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.715 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.715 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:18.715 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998620+0000", 2024-04-19T03:02:18.715 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.1676999999999998e-05 2024-04-19T03:02:18.715 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.715 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.715 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:02:18.715 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998624+0000", 2024-04-19T03:02:18.715 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4850000000000003e-06 2024-04-19T03:02:18.716 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.716 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.716 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:18.716 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.013261+0000", 2024-04-19T03:02:18.716 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.014636451999999999 2024-04-19T03:02:18.716 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.716 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.716 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:18.716 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.013364+0000", 2024-04-19T03:02:18.716 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000102885 2024-04-19T03:02:18.716 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.716 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.717 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:02:18.717 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.013481+0000", 2024-04-19T03:02:18.717 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00011783299999999999 2024-04-19T03:02:18.717 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.717 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.717 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:18.717 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.016265+0000", 2024-04-19T03:02:18.717 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0027834539999999999 2024-04-19T03:02:18.717 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.717 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.717 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:18.718 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.023180+0000", 2024-04-19T03:02:18.718 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0069149399999999996 2024-04-19T03:02:18.718 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.718 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.718 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:18.718 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.023230+0000", 2024-04-19T03:02:18.718 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0220999999999999e-05 2024-04-19T03:02:18.718 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.718 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.718 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:18.718 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.023266+0000", 2024-04-19T03:02:18.719 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5703e-05 2024-04-19T03:02:18.719 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:18.719 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:18.719 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:18.719 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.719 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.719 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:30 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:02:18.719 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:01:14.998577+0000", 2024-04-19T03:02:18.719 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 63.688155834, 2024-04-19T03:02:18.719 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.024774022999999999, 2024-04-19T03:02:18.719 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:18.719 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:18.720 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:18.720 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.720 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:18.720 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998577+0000", 2024-04-19T03:02:18.720 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:18.720 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.720 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.720 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:18.720 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998577+0000", 2024-04-19T03:02:18.720 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:18.720 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.720 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.721 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:18.721 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998576+0000", 2024-04-19T03:02:18.721 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:18.721 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.721 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.721 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:18.721 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998583+0000", 2024-04-19T03:02:18.721 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8850000000000001e-06 2024-04-19T03:02:18.721 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.721 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.722 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:18.722 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998597+0000", 2024-04-19T03:02:18.722 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.362e-05 2024-04-19T03:02:18.722 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.722 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.722 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:18.722 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998607+0000", 2024-04-19T03:02:18.722 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0389e-05 2024-04-19T03:02:18.722 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.722 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.723 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:18.723 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998713+0000", 2024-04-19T03:02:18.723 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000105338 2024-04-19T03:02:18.723 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.723 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.723 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:02:18.723 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998720+0000", 2024-04-19T03:02:18.723 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2370000000000003e-06 2024-04-19T03:02:18.723 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.723 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.723 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:18.723 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.014014+0000", 2024-04-19T03:02:18.724 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.015294116999999999 2024-04-19T03:02:18.724 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.724 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.724 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:18.724 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.014091+0000", 2024-04-19T03:02:18.724 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7148000000000001e-05 2024-04-19T03:02:18.724 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.724 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.724 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:02:18.724 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.014271+0000", 2024-04-19T03:02:18.724 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00017962699999999999 2024-04-19T03:02:18.725 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.725 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.725 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:18.725 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.018024+0000", 2024-04-19T03:02:18.725 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0037529809999999999 2024-04-19T03:02:18.725 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.725 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.725 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:18.725 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.023303+0000", 2024-04-19T03:02:18.725 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0052793099999999997 2024-04-19T03:02:18.726 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.726 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.726 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:18.726 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.023331+0000", 2024-04-19T03:02:18.726 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.8013000000000001e-05 2024-04-19T03:02:18.726 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.726 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.726 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:18.726 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.023351+0000", 2024-04-19T03:02:18.726 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0225999999999999e-05 2024-04-19T03:02:18.726 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:18.727 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:18.727 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:18.727 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.727 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.727 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:33 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:02:18.727 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:01:14.998625+0000", 2024-04-19T03:02:18.727 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 63.688108436999997, 2024-04-19T03:02:18.727 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.024007338999999999, 2024-04-19T03:02:18.727 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:18.727 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:18.727 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:18.728 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.728 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:18.728 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998625+0000", 2024-04-19T03:02:18.728 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:18.728 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.728 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.728 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:18.728 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998625+0000", 2024-04-19T03:02:18.728 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:18.728 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.728 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.728 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:18.729 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998623+0000", 2024-04-19T03:02:18.729 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:18.729 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.729 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.729 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:18.729 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998632+0000", 2024-04-19T03:02:18.729 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9279999999999999e-06 2024-04-19T03:02:18.729 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.729 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.729 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:18.729 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998642+0000", 2024-04-19T03:02:18.729 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0063e-05 2024-04-19T03:02:18.730 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.730 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.730 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:18.730 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998649+0000", 2024-04-19T03:02:18.730 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4799999999999998e-06 2024-04-19T03:02:18.730 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.730 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.730 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:18.730 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998730+0000", 2024-04-19T03:02:18.730 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.1514999999999995e-05 2024-04-19T03:02:18.730 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.730 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.731 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:02:18.731 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998741+0000", 2024-04-19T03:02:18.731 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1029999999999999e-05 2024-04-19T03:02:18.731 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.731 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.731 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:18.731 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.010202+0000", 2024-04-19T03:02:18.731 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011460529000000001 2024-04-19T03:02:18.731 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.731 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.731 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:18.731 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.010292+0000", 2024-04-19T03:02:18.732 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.0382000000000003e-05 2024-04-19T03:02:18.732 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.732 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.732 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:02:18.732 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.010391+0000", 2024-04-19T03:02:18.732 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.8491000000000003e-05 2024-04-19T03:02:18.732 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.732 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.732 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:18.732 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.013800+0000", 2024-04-19T03:02:18.732 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0034090219999999998 2024-04-19T03:02:18.733 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.733 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.733 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:18.733 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.022564+0000", 2024-04-19T03:02:18.733 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0087639950000000001 2024-04-19T03:02:18.733 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.733 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.733 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:18.733 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.022601+0000", 2024-04-19T03:02:18.733 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7363999999999997e-05 2024-04-19T03:02:18.733 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.733 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.734 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:18.734 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.022632+0000", 2024-04-19T03:02:18.734 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0917000000000002e-05 2024-04-19T03:02:18.734 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:18.734 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:18.734 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:18.734 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.734 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.734 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:02:18.734 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:01:14.998792+0000", 2024-04-19T03:02:18.734 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 63.687941567999999, 2024-04-19T03:02:18.735 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.023951813999999998, 2024-04-19T03:02:18.735 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:18.735 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:18.735 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:18.735 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.735 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:18.735 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998792+0000", 2024-04-19T03:02:18.735 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:18.735 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.735 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.735 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:18.736 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998792+0000", 2024-04-19T03:02:18.736 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:18.736 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.736 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.736 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:18.736 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998791+0000", 2024-04-19T03:02:18.736 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:18.736 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.736 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.736 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:18.736 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998796+0000", 2024-04-19T03:02:18.736 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9649999999999999e-06 2024-04-19T03:02:18.737 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.737 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.737 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:18.737 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998809+0000", 2024-04-19T03:02:18.737 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3254e-05 2024-04-19T03:02:18.737 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.737 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.737 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:18.737 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998816+0000", 2024-04-19T03:02:18.737 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.472e-06 2024-04-19T03:02:18.737 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.737 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.738 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:18.738 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998899+0000", 2024-04-19T03:02:18.738 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.3676000000000003e-05 2024-04-19T03:02:18.738 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.738 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.738 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:02:18.738 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998908+0000", 2024-04-19T03:02:18.738 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6940000000000001e-06 2024-04-19T03:02:18.738 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.738 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.738 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:18.739 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.010818+0000", 2024-04-19T03:02:18.739 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011910482999999999 2024-04-19T03:02:18.739 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.739 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.739 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:18.739 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.010959+0000", 2024-04-19T03:02:18.739 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00014018900000000001 2024-04-19T03:02:18.739 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.739 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.739 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:02:18.739 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.011185+0000", 2024-04-19T03:02:18.739 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000226085 2024-04-19T03:02:18.740 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.740 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.740 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:18.740 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.014479+0000", 2024-04-19T03:02:18.740 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0032938260000000001 2024-04-19T03:02:18.740 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.740 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.740 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:18.740 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.022697+0000", 2024-04-19T03:02:18.740 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0082186029999999997 2024-04-19T03:02:18.740 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.741 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.741 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:18.741 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.022724+0000", 2024-04-19T03:02:18.741 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.6503999999999999e-05 2024-04-19T03:02:18.741 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.741 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.741 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:18.741 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.022743+0000", 2024-04-19T03:02:18.741 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9663000000000001e-05 2024-04-19T03:02:18.741 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:18.741 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:18.741 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:18.742 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.742 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.742 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:02:18.742 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:01:14.998870+0000", 2024-04-19T03:02:18.742 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 63.687863366999999, 2024-04-19T03:02:18.742 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.024280578000000001, 2024-04-19T03:02:18.742 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:18.742 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:18.742 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:18.742 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.742 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:18.743 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998870+0000", 2024-04-19T03:02:18.743 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:18.743 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.743 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.743 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:18.743 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998870+0000", 2024-04-19T03:02:18.743 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:18.743 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.743 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.743 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:18.743 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998869+0000", 2024-04-19T03:02:18.743 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:18.744 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.744 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.744 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:18.744 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998879+0000", 2024-04-19T03:02:18.744 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.8689999999999999e-06 2024-04-19T03:02:18.744 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.744 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.744 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:18.744 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998893+0000", 2024-04-19T03:02:18.744 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4436999999999999e-05 2024-04-19T03:02:18.744 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.745 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.745 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:18.745 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998904+0000", 2024-04-19T03:02:18.745 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0657e-05 2024-04-19T03:02:18.745 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.745 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.745 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:18.745 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998972+0000", 2024-04-19T03:02:18.745 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8121999999999996e-05 2024-04-19T03:02:18.745 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.745 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.745 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:02:18.746 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998980+0000", 2024-04-19T03:02:18.746 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7170000000000008e-06 2024-04-19T03:02:18.746 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.746 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.746 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:18.746 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.011666+0000", 2024-04-19T03:02:18.746 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.012686507 2024-04-19T03:02:18.746 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.746 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.746 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:18.746 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.012403+0000", 2024-04-19T03:02:18.747 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00073661899999999999 2024-04-19T03:02:18.747 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.747 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.747 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:02:18.747 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.012788+0000", 2024-04-19T03:02:18.747 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00038495800000000002 2024-04-19T03:02:18.747 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.747 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.747 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:18.747 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.015713+0000", 2024-04-19T03:02:18.747 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0029255879999999998 2024-04-19T03:02:18.748 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.748 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.748 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:18.748 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.023066+0000", 2024-04-19T03:02:18.748 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.007352903 2024-04-19T03:02:18.748 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.748 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.748 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:18.748 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.023113+0000", 2024-04-19T03:02:18.748 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7163000000000002e-05 2024-04-19T03:02:18.748 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.749 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.749 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:18.749 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.023150+0000", 2024-04-19T03:02:18.749 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6881000000000001e-05 2024-04-19T03:02:18.749 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:18.749 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:18.749 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:18.749 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.749 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.749 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:20 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:02:18.749 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:01:14.999024+0000", 2024-04-19T03:02:18.749 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 63.687709095000002, 2024-04-19T03:02:18.750 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.024212818000000001, 2024-04-19T03:02:18.750 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:18.750 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-04-19T03:02:18.750 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:18.750 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.750 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:18.750 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.999024+0000", 2024-04-19T03:02:18.750 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:18.750 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.750 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.750 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:18.750 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.999024+0000", 2024-04-19T03:02:18.751 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:18.751 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.751 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.751 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:18.751 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.999023+0000", 2024-04-19T03:02:18.751 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:18.751 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.751 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.751 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:18.751 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.999029+0000", 2024-04-19T03:02:18.751 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2709999999999998e-06 2024-04-19T03:02:18.752 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.752 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.752 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:18.752 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.999045+0000", 2024-04-19T03:02:18.752 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.5840000000000001e-05 2024-04-19T03:02:18.752 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.752 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.752 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:18.752 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.999057+0000", 2024-04-19T03:02:18.752 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1897e-05 2024-04-19T03:02:18.752 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.752 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.753 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:18.753 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.999136+0000", 2024-04-19T03:02:18.753 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8842000000000002e-05 2024-04-19T03:02:18.753 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.753 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.753 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:02:18.753 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.999144+0000", 2024-04-19T03:02:18.753 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.3110000000000006e-06 2024-04-19T03:02:18.753 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.753 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.753 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:18.754 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.013338+0000", 2024-04-19T03:02:18.754 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.014194217 2024-04-19T03:02:18.754 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.754 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.754 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:18.754 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.013485+0000", 2024-04-19T03:02:18.754 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000146787 2024-04-19T03:02:18.754 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.754 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.754 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:18.754 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.023237+0000", 2024-04-19T03:02:18.754 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0097517899999999998 2024-04-19T03:02:18.755 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:18.755 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:18.755 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:18.755 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.755 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.755 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:50122 5.9 5:9d1c74f3:::benchmark_data_smithi096_19531_object50121:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-19T03:02:18.755 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:00.084949+0000", 2024-04-19T03:02:18.755 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 18.601784457000001, 2024-04-19T03:02:18.755 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.023564486999999999, 2024-04-19T03:02:18.755 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:18.755 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:18.756 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:18.756 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:18.756 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:18.756 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 50122 2024-04-19T03:02:18.756 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.756 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:18.756 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.756 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:18.756 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:00.084949+0000", 2024-04-19T03:02:18.756 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:18.757 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.757 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.757 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:18.757 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:00.084949+0000", 2024-04-19T03:02:18.757 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:18.757 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.757 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.757 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:18.757 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:00.084948+0000", 2024-04-19T03:02:18.757 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:18.757 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.758 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.758 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:18.758 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:00.084983+0000", 2024-04-19T03:02:18.758 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4322000000000001e-05 2024-04-19T03:02:18.758 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.758 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.758 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:18.758 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:00.084992+0000", 2024-04-19T03:02:18.758 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.0180000000000007e-06 2024-04-19T03:02:18.758 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.758 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.759 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:18.759 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:00.085000+0000", 2024-04-19T03:02:18.759 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.7609999999999996e-06 2024-04-19T03:02:18.759 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.759 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.759 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:18.759 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:00.093379+0000", 2024-04-19T03:02:18.759 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0083790819999999995 2024-04-19T03:02:18.759 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.759 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.759 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:18.759 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:00.093555+0000", 2024-04-19T03:02:18.760 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00017582900000000001 2024-04-19T03:02:18.760 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.760 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.760 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:02:18.760 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:00.093735+0000", 2024-04-19T03:02:18.760 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00018006399999999999 2024-04-19T03:02:18.760 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.760 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.760 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:18.760 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:00.104665+0000", 2024-04-19T03:02:18.760 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.010929259 2024-04-19T03:02:18.760 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.760 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.761 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:18.761 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:00.108415+0000", 2024-04-19T03:02:18.761 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0037506610000000002 2024-04-19T03:02:18.761 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.761 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.761 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:18.761 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:00.108474+0000", 2024-04-19T03:02:18.761 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8551000000000002e-05 2024-04-19T03:02:18.761 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.761 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.761 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:18.762 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:00.108513+0000", 2024-04-19T03:02:18.762 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9307000000000002e-05 2024-04-19T03:02:18.762 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:18.762 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:18.762 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:18.762 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.762 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.762 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:78992 5.7 5:e6baa862:::benchmark_data_smithi096_19531_object78991:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-19T03:02:18.762 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:18.008888+0000", 2024-04-19T03:02:18.762 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.67784476199999999, 2024-04-19T03:02:18.763 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.056375285999999997, 2024-04-19T03:02:18.763 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:18.763 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:18.763 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:18.763 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:18.763 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:18.763 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 78992 2024-04-19T03:02:18.763 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.763 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:18.763 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.763 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:18.763 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.008888+0000", 2024-04-19T03:02:18.763 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:18.764 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.764 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.764 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:18.764 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.008888+0000", 2024-04-19T03:02:18.764 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:18.764 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.764 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.764 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:18.764 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.008888+0000", 2024-04-19T03:02:18.764 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:18.764 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.764 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.765 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:18.765 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.008928+0000", 2024-04-19T03:02:18.765 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0361999999999997e-05 2024-04-19T03:02:18.765 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.765 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.765 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:18.765 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.008942+0000", 2024-04-19T03:02:18.765 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4365000000000001e-05 2024-04-19T03:02:18.765 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.765 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.766 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:18.766 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.008949+0000", 2024-04-19T03:02:18.766 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.212e-06 2024-04-19T03:02:18.766 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.766 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.766 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:18.766 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.012683+0000", 2024-04-19T03:02:18.766 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.003733934 2024-04-19T03:02:18.766 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.766 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.766 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:18.766 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.012798+0000", 2024-04-19T03:02:18.767 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00011574999999999999 2024-04-19T03:02:18.767 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.767 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.767 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:18.767 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.012896+0000", 2024-04-19T03:02:18.767 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.7848000000000002e-05 2024-04-19T03:02:18.767 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.767 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.767 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:18.767 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016423+0000", 2024-04-19T03:02:18.767 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0035270789999999998 2024-04-19T03:02:18.767 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.768 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.768 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:18.768 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.065098+0000", 2024-04-19T03:02:18.768 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.048674651999999999 2024-04-19T03:02:18.768 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.768 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.768 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:18.768 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.065193+0000", 2024-04-19T03:02:18.769 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.5087999999999995e-05 2024-04-19T03:02:18.769 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.769 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.769 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:18.769 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.065264+0000", 2024-04-19T03:02:18.769 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0666000000000004e-05 2024-04-19T03:02:18.769 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:18.769 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:18.769 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:18.769 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.769 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.769 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:78998 5.7 5:ee23c1bc:::benchmark_data_smithi096_19531_object78997:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-19T03:02:18.770 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:18.013165+0000", 2024-04-19T03:02:18.770 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.67356805600000003, 2024-04-19T03:02:18.770 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.052410864000000001, 2024-04-19T03:02:18.770 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:18.770 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:18.770 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:18.770 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:18.770 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:18.770 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 78998 2024-04-19T03:02:18.770 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.771 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:18.771 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.771 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:18.771 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.013165+0000", 2024-04-19T03:02:18.771 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:18.771 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.771 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.771 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:18.771 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.013165+0000", 2024-04-19T03:02:18.771 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:18.771 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.771 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.772 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:18.772 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.013164+0000", 2024-04-19T03:02:18.772 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:18.772 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.772 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.772 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:18.772 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.013214+0000", 2024-04-19T03:02:18.772 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9636999999999999e-05 2024-04-19T03:02:18.772 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.772 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.772 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:18.773 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.013223+0000", 2024-04-19T03:02:18.773 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.3619999999999995e-06 2024-04-19T03:02:18.773 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.773 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.773 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:18.773 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.013229+0000", 2024-04-19T03:02:18.773 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6060000000000002e-06 2024-04-19T03:02:18.773 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.773 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.773 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:18.773 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.014882+0000", 2024-04-19T03:02:18.773 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001653257 2024-04-19T03:02:18.774 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.774 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.774 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:18.774 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.014958+0000", 2024-04-19T03:02:18.774 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6398999999999998e-05 2024-04-19T03:02:18.774 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.774 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.774 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:18.774 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.015036+0000", 2024-04-19T03:02:18.774 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8070000000000003e-05 2024-04-19T03:02:18.774 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.775 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.775 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:18.775 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018099+0000", 2024-04-19T03:02:18.775 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0030631149999999999 2024-04-19T03:02:18.775 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.775 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.775 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:18.775 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.065328+0000", 2024-04-19T03:02:18.775 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.047228349000000003 2024-04-19T03:02:18.775 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.775 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.776 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:18.776 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.065508+0000", 2024-04-19T03:02:18.776 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00018036899999999999 2024-04-19T03:02:18.776 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.776 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.776 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:18.776 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.065576+0000", 2024-04-19T03:02:18.776 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7785000000000002e-05 2024-04-19T03:02:18.776 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:18.776 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:18.776 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:18.777 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.777 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.777 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4755.0:78995 5.2 e40/39 5:42b55e12:::benchmark_data_smithi096_19531_object78994:head v 40'4934, mlcod=40'4932)", 2024-04-19T03:02:18.777 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:18.016247+0000", 2024-04-19T03:02:18.777 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.67048609400000003, 2024-04-19T03:02:18.777 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.056240406, 2024-04-19T03:02:18.777 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:18.777 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:18.777 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:18.777 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.777 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:18.777 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016247+0000", 2024-04-19T03:02:18.778 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:18.778 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.778 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.778 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:18.778 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016247+0000", 2024-04-19T03:02:18.778 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:18.778 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.778 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.778 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:18.778 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016246+0000", 2024-04-19T03:02:18.779 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:18.779 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.779 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.779 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:18.779 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016315+0000", 2024-04-19T03:02:18.779 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8979000000000005e-05 2024-04-19T03:02:18.779 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.779 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.779 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:18.779 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016333+0000", 2024-04-19T03:02:18.779 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7586999999999999e-05 2024-04-19T03:02:18.779 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.780 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.780 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:18.780 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016340+0000", 2024-04-19T03:02:18.780 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4080000000000001e-06 2024-04-19T03:02:18.780 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.780 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.780 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:18.780 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016384+0000", 2024-04-19T03:02:18.780 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3656999999999999e-05 2024-04-19T03:02:18.780 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.780 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.780 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:18.781 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016403+0000", 2024-04-19T03:02:18.781 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9089e-05 2024-04-19T03:02:18.781 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.781 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.781 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:18.781 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.072448+0000", 2024-04-19T03:02:18.781 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.056045084000000002 2024-04-19T03:02:18.781 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.781 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.781 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:18.781 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.072487+0000", 2024-04-19T03:02:18.781 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9362e-05 2024-04-19T03:02:18.782 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:18.782 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:18.782 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:18.782 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.782 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.782 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4755.0:78994 5.c e40/22 5:3c60d55d:::benchmark_data_smithi096_19531_object78993:head v 40'4989, mlcod=40'4987)", 2024-04-19T03:02:18.782 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:18.016392+0000", 2024-04-19T03:02:18.782 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.67034145300000003, 2024-04-19T03:02:18.782 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.052629620000000002, 2024-04-19T03:02:18.782 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:18.782 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:18.782 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:18.783 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.783 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:18.783 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016392+0000", 2024-04-19T03:02:18.783 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:18.783 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.783 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.783 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:18.783 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016392+0000", 2024-04-19T03:02:18.783 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:18.783 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.783 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.783 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:18.784 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016391+0000", 2024-04-19T03:02:18.784 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:18.784 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.784 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.784 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:18.784 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016471+0000", 2024-04-19T03:02:18.784 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9346999999999998e-05 2024-04-19T03:02:18.784 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.784 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.784 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:18.784 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016478+0000", 2024-04-19T03:02:18.784 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.593e-06 2024-04-19T03:02:18.785 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.785 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.785 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:18.785 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016495+0000", 2024-04-19T03:02:18.785 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6492999999999999e-05 2024-04-19T03:02:18.785 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.785 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.785 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:18.785 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016539+0000", 2024-04-19T03:02:18.785 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4715999999999997e-05 2024-04-19T03:02:18.785 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.785 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.786 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:18.786 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016551+0000", 2024-04-19T03:02:18.786 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2096000000000001e-05 2024-04-19T03:02:18.786 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.786 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.786 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:18.786 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.068985+0000", 2024-04-19T03:02:18.786 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.052433754999999999 2024-04-19T03:02:18.786 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.786 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.786 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:18.786 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.069021+0000", 2024-04-19T03:02:18.787 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6047000000000002e-05 2024-04-19T03:02:18.787 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:18.787 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:18.787 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:18.787 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.787 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.787 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4755.0:78997 5.5 e40/22 5:a5289197:::benchmark_data_smithi096_19531_object78996:head v 40'4896, mlcod=40'4894)", 2024-04-19T03:02:18.787 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:18.016507+0000", 2024-04-19T03:02:18.787 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.67022561000000003, 2024-04-19T03:02:18.787 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.049953264999999997, 2024-04-19T03:02:18.787 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:18.787 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:18.788 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:18.788 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.788 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:18.788 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016507+0000", 2024-04-19T03:02:18.788 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:18.788 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.788 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.788 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:18.788 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016507+0000", 2024-04-19T03:02:18.788 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:18.788 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.789 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.789 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:18.789 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016507+0000", 2024-04-19T03:02:18.789 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:18.789 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.789 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.789 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:18.789 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016551+0000", 2024-04-19T03:02:18.789 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3412999999999999e-05 2024-04-19T03:02:18.789 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.789 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.789 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:18.790 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016558+0000", 2024-04-19T03:02:18.790 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.002e-06 2024-04-19T03:02:18.790 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.790 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.790 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:18.790 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016563+0000", 2024-04-19T03:02:18.790 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7509999999999997e-06 2024-04-19T03:02:18.790 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.790 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.790 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:18.790 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016604+0000", 2024-04-19T03:02:18.791 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0426999999999998e-05 2024-04-19T03:02:18.791 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.791 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.791 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:18.791 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016615+0000", 2024-04-19T03:02:18.791 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1466e-05 2024-04-19T03:02:18.791 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.791 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.791 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:18.791 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.066373+0000", 2024-04-19T03:02:18.791 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.049757639999999999 2024-04-19T03:02:18.791 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.792 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.792 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:18.792 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.066461+0000", 2024-04-19T03:02:18.792 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.7884000000000001e-05 2024-04-19T03:02:18.792 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:18.792 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:18.792 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:18.792 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.792 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.792 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4755.0:78996 5.1 e40/39 5:87f59708:::benchmark_data_smithi096_19531_object78995:head v 40'4940, mlcod=40'4938)", 2024-04-19T03:02:18.792 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:18.016581+0000", 2024-04-19T03:02:18.792 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.67015228800000004, 2024-04-19T03:02:18.793 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.052051785000000003, 2024-04-19T03:02:18.793 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:18.793 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:18.793 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:18.793 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.793 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:18.793 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016581+0000", 2024-04-19T03:02:18.793 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:18.793 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.793 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.793 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:18.793 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016581+0000", 2024-04-19T03:02:18.794 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:18.794 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.794 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.794 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:18.794 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016581+0000", 2024-04-19T03:02:18.794 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:18.794 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.794 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.794 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:18.794 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016610+0000", 2024-04-19T03:02:18.794 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9556999999999998e-05 2024-04-19T03:02:18.794 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.795 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.795 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:18.795 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016616+0000", 2024-04-19T03:02:18.795 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1090000000000003e-06 2024-04-19T03:02:18.795 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.795 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.795 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:18.795 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016621+0000", 2024-04-19T03:02:18.795 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.454e-06 2024-04-19T03:02:18.795 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.795 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.795 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:18.796 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016663+0000", 2024-04-19T03:02:18.796 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2582e-05 2024-04-19T03:02:18.796 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.796 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.796 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:18.796 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016681+0000", 2024-04-19T03:02:18.796 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7680999999999999e-05 2024-04-19T03:02:18.796 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.796 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.796 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:18.796 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.068486+0000", 2024-04-19T03:02:18.796 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.051804624000000001 2024-04-19T03:02:18.797 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.797 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.797 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:18.797 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.068633+0000", 2024-04-19T03:02:18.797 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00014709099999999999 2024-04-19T03:02:18.797 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:18.797 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:18.797 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:18.797 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.797 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.797 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4755.0:78999 5.3 e40/22 5:c9ec5f7f:::benchmark_data_smithi096_19531_object78998:head v 40'4893, mlcod=40'4889)", 2024-04-19T03:02:18.797 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:18.016633+0000", 2024-04-19T03:02:18.798 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.670100433, 2024-04-19T03:02:18.798 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.051090469999999999, 2024-04-19T03:02:18.798 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:18.798 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:18.798 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:18.798 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.798 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:18.798 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016633+0000", 2024-04-19T03:02:18.798 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:18.798 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.798 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.799 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:18.799 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016633+0000", 2024-04-19T03:02:18.799 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:18.799 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.799 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.799 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:18.799 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016632+0000", 2024-04-19T03:02:18.799 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967296 2024-04-19T03:02:18.799 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.799 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.799 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:18.799 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016660+0000", 2024-04-19T03:02:18.800 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7869999999999999e-05 2024-04-19T03:02:18.800 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.800 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.800 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:18.800 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016667+0000", 2024-04-19T03:02:18.800 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0280000000000003e-06 2024-04-19T03:02:18.800 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.800 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.800 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:18.800 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016672+0000", 2024-04-19T03:02:18.800 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0069999999999997e-06 2024-04-19T03:02:18.801 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.801 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.801 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:18.801 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016725+0000", 2024-04-19T03:02:18.801 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2812000000000002e-05 2024-04-19T03:02:18.801 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.801 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.801 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:18.801 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016750+0000", 2024-04-19T03:02:18.801 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5038e-05 2024-04-19T03:02:18.801 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.801 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.802 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:18.802 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.067673+0000", 2024-04-19T03:02:18.802 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.050922350999999998 2024-04-19T03:02:18.802 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.802 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.802 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:18.802 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.067723+0000", 2024-04-19T03:02:18.802 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0586e-05 2024-04-19T03:02:18.802 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:18.802 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:18.802 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:18.803 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.803 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.803 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4755.0:79003 5.2 e40/39 5:4436e33f:::benchmark_data_smithi096_19531_object79002:head v 40'4935, mlcod=40'4932)", 2024-04-19T03:02:18.803 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:18.018102+0000", 2024-04-19T03:02:18.803 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.66863070599999996, 2024-04-19T03:02:18.803 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.060023990999999999, 2024-04-19T03:02:18.803 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:18.803 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:18.803 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:18.803 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.803 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:18.803 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018102+0000", 2024-04-19T03:02:18.804 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:18.804 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.804 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.804 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:18.804 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018102+0000", 2024-04-19T03:02:18.804 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:18.804 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.804 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.804 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:18.804 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018102+0000", 2024-04-19T03:02:18.804 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:18.804 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.805 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.805 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:18.805 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018134+0000", 2024-04-19T03:02:18.805 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2722000000000003e-05 2024-04-19T03:02:18.805 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.805 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.805 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:18.805 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018145+0000", 2024-04-19T03:02:18.805 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0395e-05 2024-04-19T03:02:18.805 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.805 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.805 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:18.806 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018151+0000", 2024-04-19T03:02:18.806 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5300000000000002e-06 2024-04-19T03:02:18.806 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.806 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.806 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:18.806 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018489+0000", 2024-04-19T03:02:18.806 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00033731499999999998 2024-04-19T03:02:18.806 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.806 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.806 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:18.806 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018508+0000", 2024-04-19T03:02:18.807 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9775e-05 2024-04-19T03:02:18.807 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.807 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.807 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:18.807 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.078059+0000", 2024-04-19T03:02:18.807 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.059550171999999998 2024-04-19T03:02:18.807 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.807 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.807 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:18.807 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.078126+0000", 2024-04-19T03:02:18.807 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7773000000000003e-05 2024-04-19T03:02:18.808 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:18.808 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:18.808 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:18.808 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.808 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.808 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4755.0:79005 5.1 e40/39 5:85b46038:::benchmark_data_smithi096_19531_object79004:head v 40'4941, mlcod=40'4938)", 2024-04-19T03:02:18.808 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:18.018167+0000", 2024-04-19T03:02:18.808 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.66856598700000003, 2024-04-19T03:02:18.808 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.052768941999999999, 2024-04-19T03:02:18.808 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:18.808 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:18.808 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:18.808 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.809 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:18.809 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018167+0000", 2024-04-19T03:02:18.809 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:18.809 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.809 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.809 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:18.809 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018167+0000", 2024-04-19T03:02:18.809 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:18.809 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.809 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.809 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:18.809 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018167+0000", 2024-04-19T03:02:18.810 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:18.810 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.810 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.810 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:18.810 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018196+0000", 2024-04-19T03:02:18.810 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9538000000000001e-05 2024-04-19T03:02:18.810 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.810 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.810 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:18.810 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018204+0000", 2024-04-19T03:02:18.810 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2599999999999999e-06 2024-04-19T03:02:18.811 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.811 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.811 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:18.811 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018208+0000", 2024-04-19T03:02:18.811 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8080000000000004e-06 2024-04-19T03:02:18.811 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.811 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.811 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:18.811 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.064933+0000", 2024-04-19T03:02:18.811 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.046725048999999998 2024-04-19T03:02:18.811 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.811 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.812 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:18.812 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.064964+0000", 2024-04-19T03:02:18.812 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0577000000000002e-05 2024-04-19T03:02:18.812 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.812 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.812 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:18.812 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.070815+0000", 2024-04-19T03:02:18.812 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0058510649999999999 2024-04-19T03:02:18.812 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.812 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.812 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:18.812 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.070936+0000", 2024-04-19T03:02:18.813 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00012095399999999999 2024-04-19T03:02:18.813 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:18.813 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:18.813 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:18.813 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.813 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.813 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4755.0:79006 5.3 e40/22 5:cf79182f:::benchmark_data_smithi096_19531_object79005:head v 40'4894, mlcod=40'4891)", 2024-04-19T03:02:18.813 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:18.021648+0000", 2024-04-19T03:02:18.813 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.66508548099999998, 2024-04-19T03:02:18.813 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.048705480000000002, 2024-04-19T03:02:18.813 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:18.813 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:18.814 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:18.814 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.814 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:18.814 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.021648+0000", 2024-04-19T03:02:18.814 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:18.814 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.814 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.814 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:18.814 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.021648+0000", 2024-04-19T03:02:18.814 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:18.814 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.814 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.815 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:18.815 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.021647+0000", 2024-04-19T03:02:18.815 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:18.815 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.815 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.815 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:18.815 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.021691+0000", 2024-04-19T03:02:18.815 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3852e-05 2024-04-19T03:02:18.815 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.815 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.815 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:18.815 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.064275+0000", 2024-04-19T03:02:18.816 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.042584135000000002 2024-04-19T03:02:18.816 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.816 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.816 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:18.816 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.064287+0000", 2024-04-19T03:02:18.816 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2437e-05 2024-04-19T03:02:18.817 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.817 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.818 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:18.818 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.064370+0000", 2024-04-19T03:02:18.818 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2924999999999996e-05 2024-04-19T03:02:18.818 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.818 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.818 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:18.818 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.064399+0000", 2024-04-19T03:02:18.818 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.8778000000000001e-05 2024-04-19T03:02:18.818 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.818 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.818 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:18.819 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.070324+0000", 2024-04-19T03:02:18.819 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0059246250000000002 2024-04-19T03:02:18.819 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:18.819 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:18.819 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:18.819 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.070353+0000", 2024-04-19T03:02:18.819 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9436000000000001e-05 2024-04-19T03:02:18.819 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:18.819 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:18.819 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:18.819 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:18.819 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:18.820 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-04-19T03:02:18.821 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:18.817+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:18.822 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T03:02:18.824 INFO:tasks.radosbench.radosbench.0.smithi096.stdout: 41 16 80299 80283 122.369 101.062 0.00697964 0.008166 2024-04-19T03:02:18.922 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:18.917+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:18.954 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-04-19T03:02:18.954 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [ 2024-04-19T03:02:18.954 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:18.954 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4755.0:80492 5.c 5:38034714:::benchmark_data_smithi096_19531_object80491:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-19T03:02:18.954 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:02:18.945057+0000", 2024-04-19T03:02:18.954 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 0.0073828829999999998, 2024-04-19T03:02:18.954 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0074099989999999996, 2024-04-19T03:02:18.955 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:02:18.955 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:02:18.955 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-04-19T03:02:18.955 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4755", 2024-04-19T03:02:18.955 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:18.955 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 80492 2024-04-19T03:02:18.955 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:18.955 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:02:18.955 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:18.955 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:02:18.955 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:18.945057+0000", 2024-04-19T03:02:18.955 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:18.955 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:18.956 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:18.956 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:02:18.956 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:18.945057+0000", 2024-04-19T03:02:18.956 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:18.956 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:18.956 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:18.956 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:02:18.956 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:18.945055+0000", 2024-04-19T03:02:18.956 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2024-04-19T03:02:18.956 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:18.956 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:18.956 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:02:18.956 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:18.945140+0000", 2024-04-19T03:02:18.957 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.4252999999999994e-05 2024-04-19T03:02:18.957 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:18.957 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:18.957 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:02:18.957 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:18.945148+0000", 2024-04-19T03:02:18.957 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.1200000000000002e-06 2024-04-19T03:02:18.957 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:18.957 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:18.957 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:02:18.957 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:18.945165+0000", 2024-04-19T03:02:18.957 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.7421000000000001e-05 2024-04-19T03:02:18.957 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:18.957 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:18.958 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:18.958 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:18.945210+0000", 2024-04-19T03:02:18.958 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.4339999999999999e-05 2024-04-19T03:02:18.958 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:18.958 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:18.958 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:02:18.958 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:18.945333+0000", 2024-04-19T03:02:18.958 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000123695 2024-04-19T03:02:18.958 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:18.958 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:18.958 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-04-19T03:02:18.958 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:18.945466+0000", 2024-04-19T03:02:18.958 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000132435 2024-04-19T03:02:18.958 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:18.959 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:18.959 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:02:18.959 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:18.952036+0000", 2024-04-19T03:02:18.959 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0065702989999999999 2024-04-19T03:02:18.959 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:18.959 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:02:18.959 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:18.959 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:18.959 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:18.959 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4755.0:80495 5.5 5:af52f092:::benchmark_data_smithi096_19531_object80494:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-19T03:02:18.959 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:02:18.948330+0000", 2024-04-19T03:02:18.959 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 0.0041092350000000001, 2024-04-19T03:02:18.959 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0042220399999999998, 2024-04-19T03:02:18.959 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:02:18.960 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:02:18.960 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-04-19T03:02:18.960 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4755", 2024-04-19T03:02:18.960 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:18.960 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 80495 2024-04-19T03:02:18.960 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:18.960 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:02:18.960 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:18.960 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:02:18.960 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:18.948330+0000", 2024-04-19T03:02:18.960 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:18.960 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:18.960 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:18.960 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:02:18.961 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:18.948330+0000", 2024-04-19T03:02:18.961 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:18.961 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:18.961 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:18.961 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:02:18.961 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:18.948329+0000", 2024-04-19T03:02:18.961 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:18.961 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:18.961 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:18.961 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:02:18.961 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:18.948400+0000", 2024-04-19T03:02:18.961 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.1296000000000003e-05 2024-04-19T03:02:18.961 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:18.962 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:18.962 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:02:18.962 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:18.948421+0000", 2024-04-19T03:02:18.962 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.0896000000000001e-05 2024-04-19T03:02:18.962 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:18.962 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:18.962 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:02:18.962 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:18.948456+0000", 2024-04-19T03:02:18.962 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.5339999999999997e-05 2024-04-19T03:02:18.962 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:18.962 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:18.962 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:18.962 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:18.948521+0000", 2024-04-19T03:02:18.963 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.4601e-05 2024-04-19T03:02:18.963 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:18.963 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:18.963 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:02:18.963 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:18.948657+0000", 2024-04-19T03:02:18.963 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00013605799999999999 2024-04-19T03:02:18.963 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:18.963 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:18.963 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-04-19T03:02:18.963 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:18.948800+0000", 2024-04-19T03:02:18.963 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014313100000000001 2024-04-19T03:02:18.963 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:18.964 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:18.964 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:02:18.964 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:18.952334+0000", 2024-04-19T03:02:18.964 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.003534092 2024-04-19T03:02:18.964 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:18.964 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:02:18.964 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:18.964 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:18.964 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:18.964 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4755.0:80496 5.3 5:c15d62df:::benchmark_data_smithi096_19531_object80495:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-19T03:02:18.964 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:02:18.948908+0000", 2024-04-19T03:02:18.964 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 0.0035319040000000002, 2024-04-19T03:02:18.964 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0037190859999999999, 2024-04-19T03:02:18.965 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:02:18.965 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:02:18.965 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-04-19T03:02:18.965 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4755", 2024-04-19T03:02:18.965 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:18.965 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 80496 2024-04-19T03:02:18.965 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:18.965 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:02:18.965 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:18.965 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:02:18.965 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:18.948908+0000", 2024-04-19T03:02:18.965 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:18.965 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:18.966 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:18.966 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:02:18.966 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:18.948908+0000", 2024-04-19T03:02:18.966 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:18.966 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:18.966 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:18.966 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:02:18.966 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:18.948907+0000", 2024-04-19T03:02:18.966 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2024-04-19T03:02:18.966 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:18.966 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:18.966 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:02:18.966 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:18.948977+0000", 2024-04-19T03:02:18.967 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.0393000000000002e-05 2024-04-19T03:02:18.967 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:18.967 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:18.967 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:02:18.967 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:18.948986+0000", 2024-04-19T03:02:18.967 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.3160000000000003e-06 2024-04-19T03:02:18.967 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:18.967 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:18.967 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:02:18.967 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:18.948993+0000", 2024-04-19T03:02:18.967 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.4459999999999998e-06 2024-04-19T03:02:18.967 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:18.967 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:18.967 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:18.968 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:18.949037+0000", 2024-04-19T03:02:18.968 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.4438999999999999e-05 2024-04-19T03:02:18.968 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:18.968 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:18.968 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:02:18.968 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:18.949148+0000", 2024-04-19T03:02:18.968 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000110519 2024-04-19T03:02:18.968 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:18.968 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:18.968 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-04-19T03:02:18.968 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:18.949268+0000", 2024-04-19T03:02:18.968 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000120196 2024-04-19T03:02:18.968 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:18.969 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:02:18.969 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:18.969 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:18.969 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:18.969 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4755.0:80497 5.4 e41/22 5:2ba86b71:::benchmark_data_smithi096_19531_object80496:head v 41'4958, mlcod=41'4956)", 2024-04-19T03:02:18.969 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:02:18.949461+0000", 2024-04-19T03:02:18.969 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 0.0029781270000000001, 2024-04-19T03:02:18.969 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0032304759999999999, 2024-04-19T03:02:18.969 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:02:18.969 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "started", 2024-04-19T03:02:18.969 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:02:18.969 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:18.969 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:02:18.970 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:18.949461+0000", 2024-04-19T03:02:18.970 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:18.970 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:18.970 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:18.970 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:02:18.970 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:18.949461+0000", 2024-04-19T03:02:18.970 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:18.970 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:18.970 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:18.970 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:02:18.970 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:18.949461+0000", 2024-04-19T03:02:18.970 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2024-04-19T03:02:18.970 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:18.971 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:18.971 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:02:18.971 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:18.949519+0000", 2024-04-19T03:02:18.971 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.8672999999999999e-05 2024-04-19T03:02:18.971 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:18.971 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:18.971 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:02:18.971 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:18.949529+0000", 2024-04-19T03:02:18.971 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.9049999999999992e-06 2024-04-19T03:02:18.971 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:18.971 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:18.971 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:02:18.971 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:18.949536+0000", 2024-04-19T03:02:18.972 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.6390000000000003e-06 2024-04-19T03:02:18.972 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:18.972 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:18.972 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:18.972 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:18.949579+0000", 2024-04-19T03:02:18.972 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.3470000000000002e-05 2024-04-19T03:02:18.972 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:18.972 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:18.972 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:02:18.972 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:18.949598+0000", 2024-04-19T03:02:18.972 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.8629000000000001e-05 2024-04-19T03:02:18.972 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:18.972 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:02:18.972 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:18.973 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:18.973 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:18.973 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4755.0:80491 5.7 e41/22 5:e1dda3ca:::benchmark_data_smithi096_19531_object80490:head v 41'5019, mlcod=41'5013)", 2024-04-19T03:02:18.973 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:02:18.950271+0000", 2024-04-19T03:02:18.973 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 0.0021686589999999999, 2024-04-19T03:02:18.973 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0024727379999999999, 2024-04-19T03:02:18.973 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:02:18.973 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "started", 2024-04-19T03:02:18.973 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:02:18.973 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:18.973 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:02:18.973 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:18.950271+0000", 2024-04-19T03:02:18.973 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:18.973 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:18.974 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:18.974 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:02:18.974 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:18.950271+0000", 2024-04-19T03:02:18.974 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:18.974 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:18.974 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:18.974 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:02:18.974 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:18.950270+0000", 2024-04-19T03:02:18.974 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2024-04-19T03:02:18.974 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:18.974 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:18.974 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:02:18.975 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:18.950317+0000", 2024-04-19T03:02:18.975 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.6702000000000001e-05 2024-04-19T03:02:18.975 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:18.975 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:18.975 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:02:18.975 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:18.950325+0000", 2024-04-19T03:02:18.975 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.6859999999999995e-06 2024-04-19T03:02:18.975 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:18.975 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:18.975 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:02:18.975 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:18.950331+0000", 2024-04-19T03:02:18.975 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.7910000000000001e-06 2024-04-19T03:02:18.975 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:18.976 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:18.976 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:18.976 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:18.950375+0000", 2024-04-19T03:02:18.976 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.3621000000000001e-05 2024-04-19T03:02:18.976 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:18.976 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:18.976 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:02:18.976 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:18.950391+0000", 2024-04-19T03:02:18.976 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.6252999999999998e-05 2024-04-19T03:02:18.976 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:18.976 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:02:18.976 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:18.977 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:18.977 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:18.977 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_repop(client.4755.0:80499 5.b e41/22 5:d2be4318:::benchmark_data_smithi096_19531_object80498:head v 41'5103, mlcod=41'5100)", 2024-04-19T03:02:18.977 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:02:18.951589+0000", 2024-04-19T03:02:18.977 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 0.00085069500000000005, 2024-04-19T03:02:18.977 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.001204449, 2024-04-19T03:02:18.977 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:02:18.977 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "started", 2024-04-19T03:02:18.977 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:02:18.977 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:18.977 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:02:18.977 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:18.951589+0000", 2024-04-19T03:02:18.977 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:18.978 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:18.978 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:18.978 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:02:18.978 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:18.951589+0000", 2024-04-19T03:02:18.978 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:18.978 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:18.978 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:18.978 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:02:18.978 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:18.951588+0000", 2024-04-19T03:02:18.978 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2024-04-19T03:02:18.978 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:18.978 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:18.979 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:02:18.979 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:18.951632+0000", 2024-04-19T03:02:18.979 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.3655000000000001e-05 2024-04-19T03:02:18.979 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:18.979 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:18.979 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:02:18.979 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:18.951641+0000", 2024-04-19T03:02:18.979 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.0100000000000001e-06 2024-04-19T03:02:18.979 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:18.979 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:18.979 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:02:18.979 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:18.951647+0000", 2024-04-19T03:02:18.979 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.9070000000000004e-06 2024-04-19T03:02:18.980 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:18.980 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:18.980 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:18.980 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:18.951680+0000", 2024-04-19T03:02:18.980 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.3237e-05 2024-04-19T03:02:18.980 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:18.980 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:18.980 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:02:18.980 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:18.951696+0000", 2024-04-19T03:02:18.980 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.6066000000000002e-05 2024-04-19T03:02:18.980 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:18.980 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:02:18.980 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:18.980 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:18.981 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:18.981 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4755.0:80500 5.a 5:5dafd15d:::benchmark_data_smithi096_19531_object80499:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-19T03:02:18.981 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:02:18.952475+0000", 2024-04-19T03:02:18.981 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 4294967295.9999642, 2024-04-19T03:02:18.981 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00037336500000000001, 2024-04-19T03:02:18.981 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:02:18.981 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:02:18.981 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-04-19T03:02:18.981 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4755", 2024-04-19T03:02:18.981 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:18.981 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 80500 2024-04-19T03:02:18.981 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:18.981 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:02:18.982 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:18.982 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:02:18.982 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:18.952475+0000", 2024-04-19T03:02:18.982 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:18.982 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:18.982 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:18.982 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:02:18.982 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:18.952475+0000", 2024-04-19T03:02:18.982 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:18.982 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:18.982 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:18.982 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:02:18.983 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:18.952474+0000", 2024-04-19T03:02:18.983 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:18.983 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:18.983 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:18.983 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:02:18.983 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:18.952528+0000", 2024-04-19T03:02:18.983 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.4048999999999997e-05 2024-04-19T03:02:18.983 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:18.983 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:18.983 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:02:18.983 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:18.952536+0000", 2024-04-19T03:02:18.983 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.3680000000000002e-06 2024-04-19T03:02:18.983 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:18.984 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:18.984 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:02:18.984 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:18.952549+0000", 2024-04-19T03:02:18.984 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2802e-05 2024-04-19T03:02:18.984 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:18.984 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:18.984 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:18.984 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:18.952588+0000", 2024-04-19T03:02:18.984 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.8596000000000001e-05 2024-04-19T03:02:18.984 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:18.984 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:18.984 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:02:18.984 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:18.952679+0000", 2024-04-19T03:02:18.984 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.1051999999999995e-05 2024-04-19T03:02:18.985 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:18.985 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:18.985 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 1", 2024-04-19T03:02:18.985 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:18.952782+0000", 2024-04-19T03:02:18.985 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00010348000000000001 2024-04-19T03:02:18.985 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:18.985 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:02:18.985 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:18.985 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:18.985 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:18.985 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4755.0:80501 5.a 5.9dfd41a (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-19T03:02:18.985 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:02:18.952562+0000", 2024-04-19T03:02:18.986 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 4294967295.9998775, 2024-04-19T03:02:18.986 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00034956000000000001, 2024-04-19T03:02:18.986 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:02:18.986 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "queued for pg", 2024-04-19T03:02:18.986 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-04-19T03:02:18.986 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4755", 2024-04-19T03:02:18.986 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:18.986 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 80501 2024-04-19T03:02:18.986 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:18.986 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:02:18.986 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:18.986 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:02:18.986 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:18.952562+0000", 2024-04-19T03:02:18.987 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:18.987 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:18.987 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:18.987 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:02:18.987 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:18.952562+0000", 2024-04-19T03:02:18.987 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:18.987 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:18.987 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:18.987 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:02:18.987 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:18.952562+0000", 2024-04-19T03:02:18.987 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:18.987 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:18.987 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:18.988 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:02:18.988 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:18.952596+0000", 2024-04-19T03:02:18.988 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.3824e-05 2024-04-19T03:02:18.988 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:18.988 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:18.988 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:02:18.988 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:18.952600+0000", 2024-04-19T03:02:18.988 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.7040000000000002e-06 2024-04-19T03:02:18.988 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:18.988 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:18.988 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:02:18.988 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:18.952603+0000", 2024-04-19T03:02:18.988 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0819999999999999e-06 2024-04-19T03:02:18.988 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:18.988 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:02:18.989 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:18.989 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:18.989 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:18.989 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4755.0:80502 5.3 5.f41c36d3 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-19T03:02:18.989 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:02:18.952609+0000", 2024-04-19T03:02:18.989 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 4294967295.9998302, 2024-04-19T03:02:18.989 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00034839000000000002, 2024-04-19T03:02:18.989 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:02:18.989 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "queued for pg", 2024-04-19T03:02:18.989 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-04-19T03:02:18.989 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4755", 2024-04-19T03:02:18.989 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:18.989 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 80502 2024-04-19T03:02:18.990 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:18.990 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:02:18.990 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:18.990 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:02:18.990 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:18.952609+0000", 2024-04-19T03:02:18.990 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:18.990 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:18.990 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:18.990 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:02:18.990 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:18.952609+0000", 2024-04-19T03:02:18.990 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:18.990 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:18.990 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:18.991 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:02:18.991 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:18.952609+0000", 2024-04-19T03:02:18.991 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:18.991 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:18.991 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:18.991 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:02:18.991 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:18.952717+0000", 2024-04-19T03:02:18.991 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000108488 2024-04-19T03:02:18.991 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:18.991 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:18.991 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:02:18.991 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:18.952722+0000", 2024-04-19T03:02:18.992 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.9540000000000003e-06 2024-04-19T03:02:18.992 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:18.992 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:18.992 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:02:18.992 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:18.952725+0000", 2024-04-19T03:02:18.992 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.1329999999999999e-06 2024-04-19T03:02:18.992 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:18.992 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:02:18.992 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:18.992 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:18.992 INFO:teuthology.orchestra.run.smithi097.stdout: ], 2024-04-19T03:02:18.992 INFO:teuthology.orchestra.run.smithi097.stdout: "num_ops": 9 2024-04-19T03:02:18.993 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-04-19T03:02:18.994 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-19T03:02:19.022 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:19.019+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:19.123 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:19.121+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:19.134 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-04-19T03:02:19.134 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [], 2024-04-19T03:02:19.134 INFO:teuthology.orchestra.run.smithi097.stdout: "complaint_time": 30, 2024-04-19T03:02:19.134 INFO:teuthology.orchestra.run.smithi097.stdout: "num_blocked_ops": 0 2024-04-19T03:02:19.134 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-04-19T03:02:19.148 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-19T03:02:19.198 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2024-04-19T03:02:19.199 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-19T03:02:19.199 INFO:tasks.thrashosds.thrasher:Killing osd 0, live_osds are [0, 1, 2] 2024-04-19T03:02:19.199 INFO:tasks.ceph.ceph_manager.ceph:kill_osd on osd.0 doing powercycle of ubuntu@smithi097.front.sepia.ceph.com 2024-04-19T03:02:19.199 INFO:teuthology.orchestra.console.smithi097:Power off 2024-04-19T03:02:19.199 DEBUG:teuthology.orchestra.console.smithi097:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-19T03:02:19.223 DEBUG:teuthology.orchestra.console.smithi097:power off output: Chassis Power Control: Down/Off 2024-04-19T03:02:19.223 DEBUG:teuthology.orchestra.console.smithi097:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-19T03:02:19.233 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:19.231+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:19.247 DEBUG:teuthology.orchestra.console.smithi097:check power output: Chassis Power is on 2024-04-19T03:02:19.277 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-04-19T03:02:19.278 INFO:teuthology.orchestra.run.smithi097.stdout: "size": 20, 2024-04-19T03:02:19.278 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 600, 2024-04-19T03:02:19.278 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [ 2024-04-19T03:02:19.278 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.278 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4755.0:74351 5.1 5:8df32aa1:::benchmark_data_smithi096_19531_object74350:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e39)", 2024-04-19T03:02:19.278 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:02:14.185504+0000", 2024-04-19T03:02:19.278 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 5.0873069739999996, 2024-04-19T03:02:19.278 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0247640629999999, 2024-04-19T03:02:19.278 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:02:19.278 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "reached pg", 2024-04-19T03:02:19.278 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-04-19T03:02:19.279 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4755", 2024-04-19T03:02:19.279 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:19.279 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 74351 2024-04-19T03:02:19.279 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.279 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:02:19.279 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.279 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:02:19.279 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.185504+0000", 2024-04-19T03:02:19.279 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:19.279 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.279 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.279 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:02:19.280 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.185504+0000", 2024-04-19T03:02:19.280 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:19.280 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.280 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.280 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:02:19.280 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.185503+0000", 2024-04-19T03:02:19.280 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2024-04-19T03:02:19.280 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.280 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.280 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:02:19.280 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.185536+0000", 2024-04-19T03:02:19.280 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.3433000000000003e-05 2024-04-19T03:02:19.280 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.281 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.281 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:02:19.281 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.185547+0000", 2024-04-19T03:02:19.281 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0375e-05 2024-04-19T03:02:19.281 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.281 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.281 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:02:19.281 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.185554+0000", 2024-04-19T03:02:19.281 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.1670000000000002e-06 2024-04-19T03:02:19.281 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.281 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.281 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:19.282 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.185646+0000", 2024-04-19T03:02:19.282 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.1772000000000002e-05 2024-04-19T03:02:19.282 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.282 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.282 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for peered", 2024-04-19T03:02:19.282 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.185658+0000", 2024-04-19T03:02:19.282 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2337999999999999e-05 2024-04-19T03:02:19.282 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.282 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.282 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:19.282 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:15.208850+0000", 2024-04-19T03:02:19.282 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0231923679999999 2024-04-19T03:02:19.283 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.283 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.283 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:02:19.283 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:15.210268+0000", 2024-04-19T03:02:19.283 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0014175699999999999 2024-04-19T03:02:19.283 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:19.283 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:02:19.283 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:19.283 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.283 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.283 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4755.0:74360 5.2 5:48383253:::benchmark_data_smithi096_19531_object74359:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e39)", 2024-04-19T03:02:19.283 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:02:14.185568+0000", 2024-04-19T03:02:19.284 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 5.0872429849999996, 2024-04-19T03:02:19.284 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.036717468, 2024-04-19T03:02:19.284 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:02:19.284 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "reached pg", 2024-04-19T03:02:19.284 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-04-19T03:02:19.284 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4755", 2024-04-19T03:02:19.284 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:19.284 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 74360 2024-04-19T03:02:19.284 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.284 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:02:19.284 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.284 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:02:19.284 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.185568+0000", 2024-04-19T03:02:19.285 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:19.285 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.285 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.285 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:02:19.285 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.185568+0000", 2024-04-19T03:02:19.285 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:19.285 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.285 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.285 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:02:19.285 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.185567+0000", 2024-04-19T03:02:19.285 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:19.285 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.285 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.285 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:02:19.286 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.185613+0000", 2024-04-19T03:02:19.286 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.6119999999999999e-05 2024-04-19T03:02:19.286 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.286 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.286 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:02:19.286 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.185621+0000", 2024-04-19T03:02:19.286 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.7810000000000005e-06 2024-04-19T03:02:19.286 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.286 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.286 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:02:19.286 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.185627+0000", 2024-04-19T03:02:19.286 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.7370000000000003e-06 2024-04-19T03:02:19.287 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.287 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.287 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:19.287 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.185671+0000", 2024-04-19T03:02:19.287 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.4418000000000001e-05 2024-04-19T03:02:19.287 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.287 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.287 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for peered", 2024-04-19T03:02:19.287 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.185681+0000", 2024-04-19T03:02:19.287 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.9529999999999994e-06 2024-04-19T03:02:19.287 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.287 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.287 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:19.287 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:15.208251+0000", 2024-04-19T03:02:19.288 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0225692989999999 2024-04-19T03:02:19.288 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.288 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.288 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for missing object", 2024-04-19T03:02:19.288 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:15.208407+0000", 2024-04-19T03:02:19.288 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00015626 2024-04-19T03:02:19.288 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.288 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.288 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:19.288 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:15.222132+0000", 2024-04-19T03:02:19.288 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.013725371 2024-04-19T03:02:19.288 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.288 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.288 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:02:19.288 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:15.222285+0000", 2024-04-19T03:02:19.288 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00015311799999999999 2024-04-19T03:02:19.289 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:19.289 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:02:19.289 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:19.289 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.289 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.289 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4755.0:74373 5.2 5:49241f16:::benchmark_data_smithi096_19531_object74372:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-04-19T03:02:19.289 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:02:14.192381+0000", 2024-04-19T03:02:19.289 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 5.0804301069999998, 2024-04-19T03:02:19.289 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0302692689999999, 2024-04-19T03:02:19.289 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:02:19.289 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:19.289 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-04-19T03:02:19.289 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4755", 2024-04-19T03:02:19.289 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:19.290 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 74373 2024-04-19T03:02:19.290 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.290 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:02:19.290 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.290 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:02:19.290 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.192381+0000", 2024-04-19T03:02:19.290 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:19.290 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.290 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.290 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:02:19.290 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.192381+0000", 2024-04-19T03:02:19.290 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:19.290 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.290 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.291 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:02:19.291 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.192380+0000", 2024-04-19T03:02:19.291 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2024-04-19T03:02:19.291 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.291 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.291 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:02:19.291 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.192435+0000", 2024-04-19T03:02:19.291 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.5247000000000001e-05 2024-04-19T03:02:19.291 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.291 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.291 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:02:19.291 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.192449+0000", 2024-04-19T03:02:19.291 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.3847e-05 2024-04-19T03:02:19.291 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.292 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.292 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:02:19.292 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.192453+0000", 2024-04-19T03:02:19.292 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.5179999999999998e-06 2024-04-19T03:02:19.292 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.292 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.292 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:19.292 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.192486+0000", 2024-04-19T03:02:19.292 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.2889999999999999e-05 2024-04-19T03:02:19.292 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.292 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.292 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for peered", 2024-04-19T03:02:19.292 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.192493+0000", 2024-04-19T03:02:19.293 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.8040000000000004e-06 2024-04-19T03:02:19.293 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.293 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.293 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:19.293 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:15.208662+0000", 2024-04-19T03:02:19.293 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0161685119999999 2024-04-19T03:02:19.293 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.293 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.293 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:02:19.293 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:15.208819+0000", 2024-04-19T03:02:19.293 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00015754199999999999 2024-04-19T03:02:19.293 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.293 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.293 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-04-19T03:02:19.293 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:15.209219+0000", 2024-04-19T03:02:19.294 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00039969799999999998 2024-04-19T03:02:19.294 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.294 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.294 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:02:19.294 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:15.222371+0000", 2024-04-19T03:02:19.294 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.013151885 2024-04-19T03:02:19.294 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.294 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.294 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:19.294 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:15.222447+0000", 2024-04-19T03:02:19.294 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.627e-05 2024-04-19T03:02:19.294 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.295 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.295 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:02:19.295 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:15.222518+0000", 2024-04-19T03:02:19.295 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.1099999999999994e-05 2024-04-19T03:02:19.295 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.295 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.295 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:02:19.295 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:15.222650+0000", 2024-04-19T03:02:19.295 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00013200899999999999 2024-04-19T03:02:19.295 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:19.295 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:02:19.295 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:19.295 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.295 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.296 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4755.0:74375 5.2 5:428089fd:::benchmark_data_smithi096_19531_object74374:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-04-19T03:02:19.296 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:02:14.193804+0000", 2024-04-19T03:02:19.296 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 5.0790072659999996, 2024-04-19T03:02:19.296 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.029068756, 2024-04-19T03:02:19.296 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:02:19.296 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:19.296 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-04-19T03:02:19.296 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4755", 2024-04-19T03:02:19.296 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:19.296 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 74375 2024-04-19T03:02:19.296 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.296 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:02:19.296 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.296 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:02:19.297 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.193804+0000", 2024-04-19T03:02:19.297 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:19.297 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.297 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.297 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:02:19.297 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.193804+0000", 2024-04-19T03:02:19.297 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:19.297 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.297 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.297 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:02:19.297 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.193802+0000", 2024-04-19T03:02:19.297 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2024-04-19T03:02:19.297 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.297 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.298 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:02:19.298 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.193830+0000", 2024-04-19T03:02:19.298 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.7841999999999999e-05 2024-04-19T03:02:19.298 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.298 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.298 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:02:19.298 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.193838+0000", 2024-04-19T03:02:19.298 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.0269999999999995e-06 2024-04-19T03:02:19.298 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.298 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.298 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:02:19.298 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.193845+0000", 2024-04-19T03:02:19.298 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.314e-06 2024-04-19T03:02:19.298 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.299 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.299 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:19.299 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.193905+0000", 2024-04-19T03:02:19.299 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.0367e-05 2024-04-19T03:02:19.299 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.299 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.299 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for peered", 2024-04-19T03:02:19.299 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.193911+0000", 2024-04-19T03:02:19.299 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.0120000000000002e-06 2024-04-19T03:02:19.299 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.299 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.299 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:19.299 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:15.215696+0000", 2024-04-19T03:02:19.299 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.02178513 2024-04-19T03:02:19.300 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.300 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.300 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:02:19.300 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:15.215921+0000", 2024-04-19T03:02:19.300 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00022519 2024-04-19T03:02:19.300 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.300 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.300 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-04-19T03:02:19.300 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:15.216099+0000", 2024-04-19T03:02:19.300 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000177615 2024-04-19T03:02:19.300 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.300 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.300 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:02:19.300 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:15.222382+0000", 2024-04-19T03:02:19.300 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.006282948 2024-04-19T03:02:19.301 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.301 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.301 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:19.301 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:15.222736+0000", 2024-04-19T03:02:19.301 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00035392099999999999 2024-04-19T03:02:19.301 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.301 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.301 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:02:19.301 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:15.222786+0000", 2024-04-19T03:02:19.301 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.0095000000000001e-05 2024-04-19T03:02:19.301 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.301 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.301 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:02:19.301 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:15.222872+0000", 2024-04-19T03:02:19.302 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.6401000000000002e-05 2024-04-19T03:02:19.302 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:19.302 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:02:19.302 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:19.302 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.302 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.302 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4755.0:74378 5.1 5:8dd77165:::benchmark_data_smithi096_19531_object74377:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-04-19T03:02:19.302 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:02:14.194149+0000", 2024-04-19T03:02:19.302 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 5.0786621759999999, 2024-04-19T03:02:19.302 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.030086555, 2024-04-19T03:02:19.302 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:02:19.302 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:19.302 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-04-19T03:02:19.303 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4755", 2024-04-19T03:02:19.303 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:19.303 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 74378 2024-04-19T03:02:19.303 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.303 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:02:19.303 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.303 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:02:19.303 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.194149+0000", 2024-04-19T03:02:19.303 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:19.303 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.303 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.303 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:02:19.303 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.194149+0000", 2024-04-19T03:02:19.304 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:19.304 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.304 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.304 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:02:19.304 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.194148+0000", 2024-04-19T03:02:19.304 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2024-04-19T03:02:19.304 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.304 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.304 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:02:19.304 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.194216+0000", 2024-04-19T03:02:19.304 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.8571999999999993e-05 2024-04-19T03:02:19.304 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.304 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.304 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:02:19.304 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.194228+0000", 2024-04-19T03:02:19.305 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2114e-05 2024-04-19T03:02:19.305 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.305 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.305 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:02:19.305 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.194234+0000", 2024-04-19T03:02:19.305 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.173e-06 2024-04-19T03:02:19.305 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.305 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.305 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:19.305 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.194276+0000", 2024-04-19T03:02:19.305 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.1743999999999999e-05 2024-04-19T03:02:19.305 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.305 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.306 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for peered", 2024-04-19T03:02:19.306 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.194284+0000", 2024-04-19T03:02:19.306 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.1589999999999993e-06 2024-04-19T03:02:19.306 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.306 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.306 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:19.306 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:15.210737+0000", 2024-04-19T03:02:19.306 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0164528230000001 2024-04-19T03:02:19.306 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.306 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.306 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:02:19.306 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:15.211115+0000", 2024-04-19T03:02:19.306 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00037735200000000002 2024-04-19T03:02:19.307 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.307 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.307 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-04-19T03:02:19.307 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:15.211370+0000", 2024-04-19T03:02:19.307 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00025494 2024-04-19T03:02:19.307 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.307 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.307 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:19.307 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:15.223984+0000", 2024-04-19T03:02:19.307 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.012614136 2024-04-19T03:02:19.307 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.307 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.307 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:02:19.307 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:15.223999+0000", 2024-04-19T03:02:19.308 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5642999999999999e-05 2024-04-19T03:02:19.308 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.308 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.308 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:02:19.308 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:15.224183+0000", 2024-04-19T03:02:19.308 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00018374400000000001 2024-04-19T03:02:19.308 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.308 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.308 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:02:19.308 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:15.224235+0000", 2024-04-19T03:02:19.308 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.2203999999999997e-05 2024-04-19T03:02:19.308 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:19.308 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:02:19.308 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:19.309 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.309 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.309 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4755.0:74381 5.2 5:4dfa68cf:::benchmark_data_smithi096_19531_object74380:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-04-19T03:02:19.309 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:02:14.196029+0000", 2024-04-19T03:02:19.309 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 5.0767820490000002, 2024-04-19T03:02:19.309 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.038063218, 2024-04-19T03:02:19.309 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:02:19.309 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:19.309 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-04-19T03:02:19.309 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4755", 2024-04-19T03:02:19.309 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:19.309 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 74381 2024-04-19T03:02:19.309 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.309 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:02:19.310 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.310 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:02:19.310 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.196029+0000", 2024-04-19T03:02:19.310 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:19.310 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.310 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.310 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:02:19.310 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.196029+0000", 2024-04-19T03:02:19.310 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:19.310 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.310 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.310 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:02:19.310 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.196028+0000", 2024-04-19T03:02:19.310 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2024-04-19T03:02:19.311 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.311 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.311 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:02:19.311 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.196094+0000", 2024-04-19T03:02:19.311 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.6611000000000003e-05 2024-04-19T03:02:19.311 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.311 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.311 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:02:19.311 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.196105+0000", 2024-04-19T03:02:19.311 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0907000000000001e-05 2024-04-19T03:02:19.311 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.311 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.311 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:02:19.311 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.196111+0000", 2024-04-19T03:02:19.312 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.7130000000000002e-06 2024-04-19T03:02:19.312 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.312 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.312 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:19.312 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.196145+0000", 2024-04-19T03:02:19.312 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.3544999999999998e-05 2024-04-19T03:02:19.312 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.312 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.312 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for peered", 2024-04-19T03:02:19.312 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.196150+0000", 2024-04-19T03:02:19.312 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.2109999999999997e-06 2024-04-19T03:02:19.312 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.312 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.312 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:19.313 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:15.222926+0000", 2024-04-19T03:02:19.313 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.026776447 2024-04-19T03:02:19.313 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.313 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.313 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:02:19.313 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:15.223062+0000", 2024-04-19T03:02:19.313 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00013572599999999999 2024-04-19T03:02:19.313 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.313 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.313 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-04-19T03:02:19.313 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:15.223195+0000", 2024-04-19T03:02:19.313 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000132633 2024-04-19T03:02:19.313 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.313 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.314 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:19.314 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:15.230931+0000", 2024-04-19T03:02:19.314 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0077366259999999999 2024-04-19T03:02:19.314 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.314 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.314 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:02:19.314 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:15.233948+0000", 2024-04-19T03:02:19.314 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0030168259999999998 2024-04-19T03:02:19.314 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.314 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.314 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:02:19.314 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:15.233997+0000", 2024-04-19T03:02:19.314 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.8513999999999997e-05 2024-04-19T03:02:19.315 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.315 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.315 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:02:19.315 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:15.234092+0000", 2024-04-19T03:02:19.315 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.5488000000000005e-05 2024-04-19T03:02:19.315 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:19.315 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:02:19.315 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:19.315 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.315 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.315 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4755.0:74392 5.1 5:8f9cf8e2:::benchmark_data_smithi096_19531_object74391:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-04-19T03:02:19.315 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:02:14.203646+0000", 2024-04-19T03:02:19.315 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 5.0691650920000004, 2024-04-19T03:02:19.315 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.023726396, 2024-04-19T03:02:19.316 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:02:19.316 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:19.316 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-04-19T03:02:19.316 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4755", 2024-04-19T03:02:19.316 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:19.316 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 74392 2024-04-19T03:02:19.316 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.316 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:02:19.316 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.316 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:02:19.316 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.203646+0000", 2024-04-19T03:02:19.316 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:19.316 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.316 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.317 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:02:19.317 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.203646+0000", 2024-04-19T03:02:19.317 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:19.317 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.317 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.317 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:02:19.317 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.203644+0000", 2024-04-19T03:02:19.317 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:19.317 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.317 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.317 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:02:19.317 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.203695+0000", 2024-04-19T03:02:19.317 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.0813000000000003e-05 2024-04-19T03:02:19.318 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.318 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.318 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:02:19.318 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.203710+0000", 2024-04-19T03:02:19.318 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5299999999999999e-05 2024-04-19T03:02:19.318 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.318 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.318 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:02:19.318 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.203727+0000", 2024-04-19T03:02:19.318 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.6294999999999999e-05 2024-04-19T03:02:19.318 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.318 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.318 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:19.319 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.203802+0000", 2024-04-19T03:02:19.319 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.5197999999999994e-05 2024-04-19T03:02:19.319 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.319 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.319 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for peered", 2024-04-19T03:02:19.319 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.203815+0000", 2024-04-19T03:02:19.319 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.3254e-05 2024-04-19T03:02:19.319 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.319 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.319 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:19.319 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:15.217490+0000", 2024-04-19T03:02:19.319 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.013674808 2024-04-19T03:02:19.319 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.320 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.320 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:02:19.320 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:15.217625+0000", 2024-04-19T03:02:19.320 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00013472199999999999 2024-04-19T03:02:19.320 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.320 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.320 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-04-19T03:02:19.320 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:15.217757+0000", 2024-04-19T03:02:19.320 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000132714 2024-04-19T03:02:19.320 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.320 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.320 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:02:19.320 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:15.224253+0000", 2024-04-19T03:02:19.320 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0064955070000000002 2024-04-19T03:02:19.321 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.321 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.321 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:19.321 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:15.227259+0000", 2024-04-19T03:02:19.321 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0030065880000000001 2024-04-19T03:02:19.321 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.321 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.321 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:02:19.321 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:15.227311+0000", 2024-04-19T03:02:19.321 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.1870000000000003e-05 2024-04-19T03:02:19.321 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.321 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.321 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:02:19.322 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:15.227372+0000", 2024-04-19T03:02:19.322 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.0909000000000002e-05 2024-04-19T03:02:19.322 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:19.322 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:02:19.322 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:19.322 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.322 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.322 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4755.0:74396 5.1 5:8f676731:::benchmark_data_smithi096_19531_object74395:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-04-19T03:02:19.322 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:02:14.206696+0000", 2024-04-19T03:02:19.322 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 5.0661149510000003, 2024-04-19T03:02:19.322 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0268165140000001, 2024-04-19T03:02:19.322 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:02:19.322 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:19.322 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-04-19T03:02:19.323 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4755", 2024-04-19T03:02:19.323 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:19.323 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 74396 2024-04-19T03:02:19.323 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.323 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:02:19.323 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.323 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:02:19.323 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.206696+0000", 2024-04-19T03:02:19.323 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:19.323 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.323 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.323 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:02:19.323 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.206696+0000", 2024-04-19T03:02:19.323 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:19.324 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.324 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.324 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:02:19.324 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.206695+0000", 2024-04-19T03:02:19.324 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:19.324 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.324 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.324 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:02:19.324 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.206746+0000", 2024-04-19T03:02:19.324 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.1564000000000003e-05 2024-04-19T03:02:19.324 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.324 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.324 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:02:19.324 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.206759+0000", 2024-04-19T03:02:19.325 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.3315e-05 2024-04-19T03:02:19.325 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.325 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.325 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:02:19.325 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.206767+0000", 2024-04-19T03:02:19.325 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.2400000000000001e-06 2024-04-19T03:02:19.325 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.325 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.325 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:19.325 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.206819+0000", 2024-04-19T03:02:19.325 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.2169999999999997e-05 2024-04-19T03:02:19.325 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.325 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.325 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for peered", 2024-04-19T03:02:19.326 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.206829+0000", 2024-04-19T03:02:19.326 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.8770000000000005e-06 2024-04-19T03:02:19.326 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.326 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.326 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:19.326 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:15.219773+0000", 2024-04-19T03:02:19.326 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0129442209999999 2024-04-19T03:02:19.326 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.326 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.326 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:02:19.326 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:15.219902+0000", 2024-04-19T03:02:19.326 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012875500000000001 2024-04-19T03:02:19.326 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.326 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.327 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-04-19T03:02:19.327 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:15.220005+0000", 2024-04-19T03:02:19.327 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000103009 2024-04-19T03:02:19.327 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.327 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.327 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:02:19.327 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:15.227394+0000", 2024-04-19T03:02:19.327 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.007389606 2024-04-19T03:02:19.327 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.327 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.327 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:19.327 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:15.233421+0000", 2024-04-19T03:02:19.327 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0060262639999999999 2024-04-19T03:02:19.327 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.328 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.328 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:02:19.328 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:15.233453+0000", 2024-04-19T03:02:19.328 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.2128000000000001e-05 2024-04-19T03:02:19.328 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.328 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.328 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:02:19.328 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:15.233512+0000", 2024-04-19T03:02:19.328 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.9731000000000001e-05 2024-04-19T03:02:19.328 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:19.328 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:02:19.328 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:19.328 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.328 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.329 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4755.0:74397 5.2 5:4bc81ccc:::benchmark_data_smithi096_19531_object74396:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-04-19T03:02:19.329 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:02:14.207542+0000", 2024-04-19T03:02:19.329 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 5.0652688880000003, 2024-04-19T03:02:19.329 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0268300530000001, 2024-04-19T03:02:19.329 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:02:19.329 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:19.329 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-04-19T03:02:19.329 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4755", 2024-04-19T03:02:19.329 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:19.329 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 74397 2024-04-19T03:02:19.329 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.329 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:02:19.329 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.329 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:02:19.329 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.207542+0000", 2024-04-19T03:02:19.330 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:19.330 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.330 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.330 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:02:19.330 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.207542+0000", 2024-04-19T03:02:19.330 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:19.330 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.330 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.330 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:02:19.330 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.207541+0000", 2024-04-19T03:02:19.330 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2024-04-19T03:02:19.330 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.330 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.331 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:02:19.331 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.207607+0000", 2024-04-19T03:02:19.331 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.5537999999999995e-05 2024-04-19T03:02:19.331 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.331 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.331 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:02:19.331 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.207616+0000", 2024-04-19T03:02:19.331 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.5319999999999995e-06 2024-04-19T03:02:19.331 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.331 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.331 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:02:19.331 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.207623+0000", 2024-04-19T03:02:19.331 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.25e-06 2024-04-19T03:02:19.332 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.332 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.332 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:19.332 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.207667+0000", 2024-04-19T03:02:19.332 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.3071999999999997e-05 2024-04-19T03:02:19.332 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.332 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.332 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for peered", 2024-04-19T03:02:19.332 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.207676+0000", 2024-04-19T03:02:19.332 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.0040000000000005e-06 2024-04-19T03:02:19.332 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.332 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.332 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:19.332 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:15.225502+0000", 2024-04-19T03:02:19.332 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.017826731 2024-04-19T03:02:19.332 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.333 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.333 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:02:19.333 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:15.225653+0000", 2024-04-19T03:02:19.333 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00015033900000000001 2024-04-19T03:02:19.333 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.333 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.333 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-04-19T03:02:19.333 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:15.225889+0000", 2024-04-19T03:02:19.333 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000236061 2024-04-19T03:02:19.333 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.333 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.333 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:19.333 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:15.234154+0000", 2024-04-19T03:02:19.334 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0082656970000000007 2024-04-19T03:02:19.334 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.334 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.334 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:02:19.334 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:15.234243+0000", 2024-04-19T03:02:19.334 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.8455000000000006e-05 2024-04-19T03:02:19.334 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.334 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.334 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:02:19.334 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:15.234288+0000", 2024-04-19T03:02:19.334 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.5222999999999997e-05 2024-04-19T03:02:19.334 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.334 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.335 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:02:19.335 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:15.234372+0000", 2024-04-19T03:02:19.335 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.3963999999999998e-05 2024-04-19T03:02:19.335 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:19.335 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:02:19.335 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:19.335 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.335 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.335 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4755.0:74403 5.1 5:81a697cf:::benchmark_data_smithi096_19531_object74402:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-04-19T03:02:19.335 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:02:14.214951+0000", 2024-04-19T03:02:19.335 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 5.0578601599999997, 2024-04-19T03:02:19.335 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.018702416, 2024-04-19T03:02:19.335 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:02:19.335 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:19.336 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-04-19T03:02:19.336 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4755", 2024-04-19T03:02:19.336 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:19.336 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 74403 2024-04-19T03:02:19.336 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.336 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:02:19.336 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.336 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:02:19.336 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.214951+0000", 2024-04-19T03:02:19.336 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:19.336 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.336 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.336 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:02:19.336 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.214951+0000", 2024-04-19T03:02:19.337 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:19.337 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.337 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.337 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:02:19.337 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.214950+0000", 2024-04-19T03:02:19.337 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2024-04-19T03:02:19.337 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.337 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.337 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:02:19.337 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.215056+0000", 2024-04-19T03:02:19.337 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000105783 2024-04-19T03:02:19.337 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.337 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.337 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:02:19.338 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.215062+0000", 2024-04-19T03:02:19.338 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.28e-06 2024-04-19T03:02:19.338 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.338 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.338 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:02:19.338 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.215066+0000", 2024-04-19T03:02:19.338 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.0430000000000001e-06 2024-04-19T03:02:19.338 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.338 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.338 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:19.338 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.215137+0000", 2024-04-19T03:02:19.338 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.0778999999999994e-05 2024-04-19T03:02:19.338 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.339 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.339 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for peered", 2024-04-19T03:02:19.339 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.215150+0000", 2024-04-19T03:02:19.339 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.3628999999999999e-05 2024-04-19T03:02:19.339 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.339 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.339 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:19.339 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:15.222118+0000", 2024-04-19T03:02:19.339 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.006967368 2024-04-19T03:02:19.339 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.339 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.339 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:02:19.339 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:15.222198+0000", 2024-04-19T03:02:19.339 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.9980000000000003e-05 2024-04-19T03:02:19.339 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.340 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.340 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-04-19T03:02:19.340 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:15.222289+0000", 2024-04-19T03:02:19.340 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.0791999999999994e-05 2024-04-19T03:02:19.340 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.340 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.340 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:02:19.340 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:15.233362+0000", 2024-04-19T03:02:19.340 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.011073380000000001 2024-04-19T03:02:19.340 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.340 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.340 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:19.340 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:15.233571+0000", 2024-04-19T03:02:19.341 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00020865599999999999 2024-04-19T03:02:19.341 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.341 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.341 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:02:19.341 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:15.233630+0000", 2024-04-19T03:02:19.341 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.9375e-05 2024-04-19T03:02:19.341 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.341 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.341 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:02:19.341 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:15.233653+0000", 2024-04-19T03:02:19.341 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.3176999999999998e-05 2024-04-19T03:02:19.341 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:19.341 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:02:19.341 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:19.341 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.342 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.342 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4755.0:74415 5.2 5:468ab963:::benchmark_data_smithi096_19531_object74414:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-04-19T03:02:19.342 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:02:14.229627+0000", 2024-04-19T03:02:19.342 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 5.0431841449999997, 2024-04-19T03:02:19.342 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.004925394, 2024-04-19T03:02:19.342 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:02:19.342 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:19.342 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-04-19T03:02:19.342 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4755", 2024-04-19T03:02:19.342 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:19.342 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 74415 2024-04-19T03:02:19.342 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.342 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:02:19.343 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.343 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:02:19.343 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.229627+0000", 2024-04-19T03:02:19.343 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:19.343 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.343 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.343 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:02:19.343 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.229627+0000", 2024-04-19T03:02:19.343 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:19.343 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.343 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.343 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:02:19.343 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.229625+0000", 2024-04-19T03:02:19.343 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:19.343 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.344 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.344 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:02:19.344 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.229673+0000", 2024-04-19T03:02:19.344 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.7441000000000002e-05 2024-04-19T03:02:19.344 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.344 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.344 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:02:19.344 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.229739+0000", 2024-04-19T03:02:19.344 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.5894000000000003e-05 2024-04-19T03:02:19.344 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.344 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.344 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:02:19.344 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.229749+0000", 2024-04-19T03:02:19.344 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0715e-05 2024-04-19T03:02:19.345 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.345 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.345 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:19.345 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.229842+0000", 2024-04-19T03:02:19.345 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.2750999999999993e-05 2024-04-19T03:02:19.345 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.345 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.345 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for peered", 2024-04-19T03:02:19.345 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.229858+0000", 2024-04-19T03:02:19.345 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.6045999999999998e-05 2024-04-19T03:02:19.345 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.345 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.345 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:19.345 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:15.228455+0000", 2024-04-19T03:02:19.346 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.99859718500000005 2024-04-19T03:02:19.346 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.346 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.346 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:02:19.346 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:15.228555+0000", 2024-04-19T03:02:19.346 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.9591000000000002e-05 2024-04-19T03:02:19.346 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.346 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.346 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-04-19T03:02:19.346 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:15.228660+0000", 2024-04-19T03:02:19.346 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000105309 2024-04-19T03:02:19.346 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.346 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.346 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:19.347 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:15.234235+0000", 2024-04-19T03:02:19.347 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.005575048 2024-04-19T03:02:19.347 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.347 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.347 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:02:19.347 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:15.234388+0000", 2024-04-19T03:02:19.347 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00015287499999999999 2024-04-19T03:02:19.347 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.347 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.347 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:02:19.347 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:15.234452+0000", 2024-04-19T03:02:19.347 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.3918999999999996e-05 2024-04-19T03:02:19.347 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.347 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.347 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:02:19.348 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:15.234552+0000", 2024-04-19T03:02:19.348 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000100128 2024-04-19T03:02:19.348 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:19.348 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:02:19.348 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:19.348 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.348 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.348 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4755.0:74420 5.1 5:86ee455d:::benchmark_data_smithi096_19531_object74419:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-04-19T03:02:19.348 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:02:14.234364+0000", 2024-04-19T03:02:19.348 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 5.0384469750000003, 2024-04-19T03:02:19.348 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.99942114599999998, 2024-04-19T03:02:19.348 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:02:19.348 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:19.349 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-04-19T03:02:19.349 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4755", 2024-04-19T03:02:19.349 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:19.349 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 74420 2024-04-19T03:02:19.349 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.349 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:02:19.349 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.349 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:02:19.349 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.234364+0000", 2024-04-19T03:02:19.349 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:19.349 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.349 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.349 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:02:19.350 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.234364+0000", 2024-04-19T03:02:19.350 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:19.350 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.350 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.350 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:02:19.350 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.234363+0000", 2024-04-19T03:02:19.350 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:19.350 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.350 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.350 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:02:19.350 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.234413+0000", 2024-04-19T03:02:19.350 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.0535000000000003e-05 2024-04-19T03:02:19.351 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.351 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.351 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:02:19.351 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.234438+0000", 2024-04-19T03:02:19.351 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.4664999999999998e-05 2024-04-19T03:02:19.351 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.351 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.351 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:02:19.351 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.234446+0000", 2024-04-19T03:02:19.351 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.6100000000000006e-06 2024-04-19T03:02:19.351 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.351 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.351 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:19.352 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.234504+0000", 2024-04-19T03:02:19.352 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.7890999999999999e-05 2024-04-19T03:02:19.352 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.352 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.352 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for peered", 2024-04-19T03:02:19.352 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.234518+0000", 2024-04-19T03:02:19.352 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.3368e-05 2024-04-19T03:02:19.352 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.352 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.352 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:19.352 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:15.224330+0000", 2024-04-19T03:02:19.352 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.98981231800000002 2024-04-19T03:02:19.352 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.353 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.353 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:02:19.353 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:15.224478+0000", 2024-04-19T03:02:19.353 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00014808200000000001 2024-04-19T03:02:19.353 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.353 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.353 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-04-19T03:02:19.353 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:15.224642+0000", 2024-04-19T03:02:19.353 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000164334 2024-04-19T03:02:19.353 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.353 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.353 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:02:19.353 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:15.233663+0000", 2024-04-19T03:02:19.354 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0090205649999999995 2024-04-19T03:02:19.354 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.354 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.354 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:19.354 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:15.233715+0000", 2024-04-19T03:02:19.354 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.2117999999999998e-05 2024-04-19T03:02:19.354 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.354 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.354 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:02:19.354 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:15.233759+0000", 2024-04-19T03:02:19.354 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.3745000000000002e-05 2024-04-19T03:02:19.354 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.354 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.355 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:02:19.355 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:15.233785+0000", 2024-04-19T03:02:19.355 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.6278000000000001e-05 2024-04-19T03:02:19.355 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:19.355 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:02:19.355 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:19.355 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.355 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.355 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4755.0:74425 5.2 5:4e5138ea:::benchmark_data_smithi096_19531_object74424:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-04-19T03:02:19.355 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:02:14.241897+0000", 2024-04-19T03:02:19.355 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 5.0309139390000004, 2024-04-19T03:02:19.355 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.99984577299999999, 2024-04-19T03:02:19.355 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:02:19.355 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:19.356 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-04-19T03:02:19.356 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4755", 2024-04-19T03:02:19.356 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:19.356 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 74425 2024-04-19T03:02:19.356 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.356 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:02:19.356 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.356 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:02:19.356 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.241897+0000", 2024-04-19T03:02:19.356 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:19.356 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.356 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.356 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:02:19.357 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.241897+0000", 2024-04-19T03:02:19.357 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:19.357 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.357 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.357 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:02:19.357 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.241896+0000", 2024-04-19T03:02:19.357 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2024-04-19T03:02:19.357 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.357 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.357 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:02:19.357 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.241976+0000", 2024-04-19T03:02:19.357 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.9976999999999997e-05 2024-04-19T03:02:19.357 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.358 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.358 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:02:19.358 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.241991+0000", 2024-04-19T03:02:19.358 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5764999999999999e-05 2024-04-19T03:02:19.358 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.358 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.358 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:02:19.358 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.241999+0000", 2024-04-19T03:02:19.358 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.5669999999999997e-06 2024-04-19T03:02:19.358 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.358 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.358 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:19.358 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.242086+0000", 2024-04-19T03:02:19.359 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.6650000000000006e-05 2024-04-19T03:02:19.359 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.359 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.359 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for peered", 2024-04-19T03:02:19.359 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.242105+0000", 2024-04-19T03:02:19.359 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.9768000000000001e-05 2024-04-19T03:02:19.359 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.359 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.359 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:19.359 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:15.230972+0000", 2024-04-19T03:02:19.359 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.98886612799999996 2024-04-19T03:02:19.359 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.359 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.359 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:02:19.360 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:15.231134+0000", 2024-04-19T03:02:19.360 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000162454 2024-04-19T03:02:19.360 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.360 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.360 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-04-19T03:02:19.360 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:15.231309+0000", 2024-04-19T03:02:19.360 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00017481699999999999 2024-04-19T03:02:19.360 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.360 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.360 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:02:19.360 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:15.241539+0000", 2024-04-19T03:02:19.360 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.010230034000000001 2024-04-19T03:02:19.361 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.361 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.361 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:19.361 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:15.241615+0000", 2024-04-19T03:02:19.361 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.5597000000000001e-05 2024-04-19T03:02:19.361 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.361 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.361 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:02:19.361 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:15.241663+0000", 2024-04-19T03:02:19.361 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.8102999999999997e-05 2024-04-19T03:02:19.361 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.361 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.361 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:02:19.362 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:15.241743+0000", 2024-04-19T03:02:19.362 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.0087999999999996e-05 2024-04-19T03:02:19.362 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:19.362 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:02:19.362 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:19.362 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.362 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.362 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4755.0:74445 5.2 5:4ba39cc3:::benchmark_data_smithi096_19531_object74444:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-04-19T03:02:19.362 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:02:14.277771+0000", 2024-04-19T03:02:19.362 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 4.9950397999999998, 2024-04-19T03:02:19.362 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.96413836100000005, 2024-04-19T03:02:19.362 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:02:19.362 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:19.363 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-04-19T03:02:19.363 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4755", 2024-04-19T03:02:19.363 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:19.363 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 74445 2024-04-19T03:02:19.363 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.363 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:02:19.363 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.363 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:02:19.363 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.277771+0000", 2024-04-19T03:02:19.363 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:19.363 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.363 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.363 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:02:19.363 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.277771+0000", 2024-04-19T03:02:19.364 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:19.364 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.364 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.364 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:02:19.364 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.277770+0000", 2024-04-19T03:02:19.364 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2024-04-19T03:02:19.364 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.364 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.364 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:02:19.364 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.277846+0000", 2024-04-19T03:02:19.364 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.6355999999999999e-05 2024-04-19T03:02:19.364 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.364 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.364 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:02:19.365 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.277862+0000", 2024-04-19T03:02:19.365 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5577999999999999e-05 2024-04-19T03:02:19.365 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.365 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.365 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:02:19.365 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.277869+0000", 2024-04-19T03:02:19.365 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.024e-06 2024-04-19T03:02:19.365 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.365 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.365 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:19.365 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.277924+0000", 2024-04-19T03:02:19.365 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.4758e-05 2024-04-19T03:02:19.365 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.366 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.366 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for peered", 2024-04-19T03:02:19.366 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.277933+0000", 2024-04-19T03:02:19.366 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.1630000000000002e-06 2024-04-19T03:02:19.366 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.366 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.366 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:19.366 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:15.234601+0000", 2024-04-19T03:02:19.366 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.95666806400000004 2024-04-19T03:02:19.366 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.366 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.366 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:02:19.367 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:15.234819+0000", 2024-04-19T03:02:19.367 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00021804800000000001 2024-04-19T03:02:19.367 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.367 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.367 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-04-19T03:02:19.367 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:15.234979+0000", 2024-04-19T03:02:19.367 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00016025999999999999 2024-04-19T03:02:19.367 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.367 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.367 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:19.367 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:15.241792+0000", 2024-04-19T03:02:19.367 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0068126460000000003 2024-04-19T03:02:19.367 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.367 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.368 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:02:19.368 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:15.241804+0000", 2024-04-19T03:02:19.368 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.2479e-05 2024-04-19T03:02:19.368 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.368 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.368 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:02:19.368 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:15.241835+0000", 2024-04-19T03:02:19.368 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.0278999999999999e-05 2024-04-19T03:02:19.368 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.368 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.368 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:02:19.368 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:15.241909+0000", 2024-04-19T03:02:19.368 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.4652000000000003e-05 2024-04-19T03:02:19.368 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:19.369 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:02:19.369 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:19.369 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.369 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.369 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4755.0:74449 5.1 5:892f7e54:::benchmark_data_smithi096_19531_object74448:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-04-19T03:02:19.369 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:02:14.287450+0000", 2024-04-19T03:02:19.369 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 4.9853603589999995, 2024-04-19T03:02:19.369 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.94648623300000001, 2024-04-19T03:02:19.369 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:02:19.369 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:19.369 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-04-19T03:02:19.369 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4755", 2024-04-19T03:02:19.369 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:19.370 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 74449 2024-04-19T03:02:19.370 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.370 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:02:19.370 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.370 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:02:19.370 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.287450+0000", 2024-04-19T03:02:19.370 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:19.370 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.370 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.370 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:02:19.370 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.287450+0000", 2024-04-19T03:02:19.370 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:19.370 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.371 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.371 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:02:19.371 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.287449+0000", 2024-04-19T03:02:19.371 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:19.371 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.371 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.371 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:02:19.371 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.287529+0000", 2024-04-19T03:02:19.371 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.9923e-05 2024-04-19T03:02:19.371 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.371 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.371 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:02:19.371 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.287548+0000", 2024-04-19T03:02:19.372 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.8702000000000002e-05 2024-04-19T03:02:19.372 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.372 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.372 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:02:19.372 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.287562+0000", 2024-04-19T03:02:19.372 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.396e-05 2024-04-19T03:02:19.372 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.372 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.372 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:19.372 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.287623+0000", 2024-04-19T03:02:19.372 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.0736999999999998e-05 2024-04-19T03:02:19.372 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.372 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.372 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for peered", 2024-04-19T03:02:19.373 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.287629+0000", 2024-04-19T03:02:19.373 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.6229999999999999e-06 2024-04-19T03:02:19.373 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.373 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.373 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:19.373 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:15.227436+0000", 2024-04-19T03:02:19.373 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.93980665600000002 2024-04-19T03:02:19.373 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.373 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.373 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:02:19.373 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:15.227609+0000", 2024-04-19T03:02:19.373 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00017355800000000001 2024-04-19T03:02:19.373 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.373 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.373 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-04-19T03:02:19.374 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:15.227781+0000", 2024-04-19T03:02:19.374 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00017192299999999999 2024-04-19T03:02:19.374 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.374 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.374 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:02:19.374 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:15.233684+0000", 2024-04-19T03:02:19.374 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0059024400000000001 2024-04-19T03:02:19.374 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.374 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.374 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:19.374 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:15.233850+0000", 2024-04-19T03:02:19.374 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00016633800000000001 2024-04-19T03:02:19.374 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.375 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.375 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:02:19.375 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:15.233901+0000", 2024-04-19T03:02:19.375 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.0677999999999998e-05 2024-04-19T03:02:19.375 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.375 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.375 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:02:19.375 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:15.233937+0000", 2024-04-19T03:02:19.375 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.5945000000000002e-05 2024-04-19T03:02:19.375 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:19.375 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:02:19.375 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:19.375 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.376 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.376 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4755.0:74471 5.2 5:43a5e2f6:::benchmark_data_smithi096_19531_object74470:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2024-04-19T03:02:19.376 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:02:14.419635+0000", 2024-04-19T03:02:19.376 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 4.8531753899999996, 2024-04-19T03:02:19.376 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.82752761600000002, 2024-04-19T03:02:19.376 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:02:19.376 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:19.376 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-04-19T03:02:19.376 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4755", 2024-04-19T03:02:19.376 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:19.376 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 74471 2024-04-19T03:02:19.376 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.376 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:02:19.376 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.377 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:02:19.377 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.419635+0000", 2024-04-19T03:02:19.377 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:19.377 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.377 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.377 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:02:19.377 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.419635+0000", 2024-04-19T03:02:19.377 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:19.377 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.377 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.377 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:02:19.377 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.419634+0000", 2024-04-19T03:02:19.377 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:19.377 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.377 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.378 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:02:19.378 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.419687+0000", 2024-04-19T03:02:19.378 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.3216e-05 2024-04-19T03:02:19.378 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.378 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.378 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:02:19.378 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.419711+0000", 2024-04-19T03:02:19.378 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 2.3737e-05 2024-04-19T03:02:19.378 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.378 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.378 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:02:19.378 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.419729+0000", 2024-04-19T03:02:19.378 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.8297000000000001e-05 2024-04-19T03:02:19.379 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.379 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.379 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:19.379 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.419821+0000", 2024-04-19T03:02:19.379 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.2175000000000004e-05 2024-04-19T03:02:19.379 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.379 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.379 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for peered", 2024-04-19T03:02:19.379 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:14.419841+0000", 2024-04-19T03:02:19.379 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.9874e-05 2024-04-19T03:02:19.379 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.379 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.379 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:19.379 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:15.238877+0000", 2024-04-19T03:02:19.379 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.81903614800000002 2024-04-19T03:02:19.380 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.380 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.380 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:02:19.380 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:15.238995+0000", 2024-04-19T03:02:19.380 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000117339 2024-04-19T03:02:19.380 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.380 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.380 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-04-19T03:02:19.380 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:15.239119+0000", 2024-04-19T03:02:19.380 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00012409199999999999 2024-04-19T03:02:19.380 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.380 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.380 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:19.380 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:15.246969+0000", 2024-04-19T03:02:19.381 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0078501370000000001 2024-04-19T03:02:19.381 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.381 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.381 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:02:19.381 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:15.247030+0000", 2024-04-19T03:02:19.381 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.0788999999999997e-05 2024-04-19T03:02:19.381 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.381 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.381 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:02:19.381 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:15.247076+0000", 2024-04-19T03:02:19.381 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.5833e-05 2024-04-19T03:02:19.381 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.381 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.381 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:02:19.381 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:15.247163+0000", 2024-04-19T03:02:19.381 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.7498999999999997e-05 2024-04-19T03:02:19.382 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:19.382 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:02:19.382 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:19.382 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.382 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.382 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4755.0:78994 5.c 5:3c60d55d:::benchmark_data_smithi096_19531_object78993:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-19T03:02:19.382 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:02:18.012512+0000", 2024-04-19T03:02:19.382 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 1.2602987670000001, 2024-04-19T03:02:19.382 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.058611089999999998, 2024-04-19T03:02:19.382 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:02:19.382 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:19.382 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-04-19T03:02:19.383 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4755", 2024-04-19T03:02:19.383 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:19.383 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 78994 2024-04-19T03:02:19.383 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.383 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:02:19.383 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.383 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:02:19.383 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:18.012512+0000", 2024-04-19T03:02:19.383 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:19.383 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.383 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.383 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:02:19.383 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:18.012512+0000", 2024-04-19T03:02:19.383 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:19.384 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.384 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.384 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:02:19.384 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:18.012511+0000", 2024-04-19T03:02:19.384 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:19.384 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.384 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.384 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:02:19.384 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:18.012567+0000", 2024-04-19T03:02:19.384 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.6718999999999997e-05 2024-04-19T03:02:19.384 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.384 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.384 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:02:19.384 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:18.012581+0000", 2024-04-19T03:02:19.385 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.4110999999999999e-05 2024-04-19T03:02:19.385 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.385 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.385 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:02:19.385 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:18.012591+0000", 2024-04-19T03:02:19.385 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.3540000000000006e-06 2024-04-19T03:02:19.385 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.385 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.385 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:19.385 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:18.012685+0000", 2024-04-19T03:02:19.385 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.4449000000000003e-05 2024-04-19T03:02:19.385 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.386 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.386 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:02:19.386 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:18.012846+0000", 2024-04-19T03:02:19.386 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00016104100000000001 2024-04-19T03:02:19.386 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.386 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.386 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-04-19T03:02:19.386 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:18.013260+0000", 2024-04-19T03:02:19.386 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000413788 2024-04-19T03:02:19.386 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.386 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.386 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:02:19.386 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:18.017109+0000", 2024-04-19T03:02:19.386 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0038489750000000001 2024-04-19T03:02:19.387 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.387 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.387 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:19.387 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:18.070972+0000", 2024-04-19T03:02:19.387 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.053863384 2024-04-19T03:02:19.387 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.387 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.387 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:02:19.387 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:18.071058+0000", 2024-04-19T03:02:19.387 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.5877999999999993e-05 2024-04-19T03:02:19.387 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.387 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.387 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:02:19.387 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:18.071123+0000", 2024-04-19T03:02:19.387 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.4968999999999994e-05 2024-04-19T03:02:19.387 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:19.388 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:02:19.388 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:19.388 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.388 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.388 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4755.0:78995 5.2 5:42b55e12:::benchmark_data_smithi096_19531_object78994:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-19T03:02:19.388 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:02:18.012663+0000", 2024-04-19T03:02:19.388 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 1.260148058, 2024-04-19T03:02:19.388 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.060288853000000003, 2024-04-19T03:02:19.388 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:02:19.388 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:19.388 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-04-19T03:02:19.388 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4755", 2024-04-19T03:02:19.388 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:19.389 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 78995 2024-04-19T03:02:19.389 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.389 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:02:19.389 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.389 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:02:19.389 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:18.012663+0000", 2024-04-19T03:02:19.389 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:19.389 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.389 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.389 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:02:19.389 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:18.012663+0000", 2024-04-19T03:02:19.389 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:19.389 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.389 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.390 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:02:19.390 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:18.012662+0000", 2024-04-19T03:02:19.390 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2024-04-19T03:02:19.390 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.390 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.390 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:02:19.390 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:18.012731+0000", 2024-04-19T03:02:19.390 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.9323e-05 2024-04-19T03:02:19.390 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.390 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.390 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:02:19.390 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:18.012742+0000", 2024-04-19T03:02:19.390 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0892e-05 2024-04-19T03:02:19.390 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.391 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.391 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:02:19.391 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:18.012750+0000", 2024-04-19T03:02:19.391 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.6329999999999996e-06 2024-04-19T03:02:19.391 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.391 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.391 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:19.391 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:18.012797+0000", 2024-04-19T03:02:19.391 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.6844000000000001e-05 2024-04-19T03:02:19.391 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.391 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.391 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:02:19.391 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:18.012879+0000", 2024-04-19T03:02:19.392 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.2681000000000003e-05 2024-04-19T03:02:19.392 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.392 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.392 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-04-19T03:02:19.392 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:18.012962+0000", 2024-04-19T03:02:19.392 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.2701000000000007e-05 2024-04-19T03:02:19.392 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.392 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.392 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:02:19.392 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:18.015877+0000", 2024-04-19T03:02:19.392 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0029153199999999999 2024-04-19T03:02:19.392 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.392 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.392 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:19.393 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:18.072805+0000", 2024-04-19T03:02:19.393 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.056928140000000002 2024-04-19T03:02:19.393 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.393 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.393 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:02:19.393 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:18.072887+0000", 2024-04-19T03:02:19.393 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.1320000000000001e-05 2024-04-19T03:02:19.393 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.393 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.393 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:02:19.393 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:18.072952+0000", 2024-04-19T03:02:19.393 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.4916e-05 2024-04-19T03:02:19.393 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:19.394 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:02:19.394 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:19.394 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.394 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.394 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4755.0:78996 5.1 5:87f59708:::benchmark_data_smithi096_19531_object78995:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-19T03:02:19.394 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:02:18.012799+0000", 2024-04-19T03:02:19.394 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 1.260011827, 2024-04-19T03:02:19.394 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.058237934999999998, 2024-04-19T03:02:19.394 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:02:19.394 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:19.394 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-04-19T03:02:19.394 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4755", 2024-04-19T03:02:19.394 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:19.395 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 78996 2024-04-19T03:02:19.395 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.395 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:02:19.395 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.395 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:02:19.395 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:18.012799+0000", 2024-04-19T03:02:19.395 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:19.395 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.395 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.395 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:02:19.395 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:18.012799+0000", 2024-04-19T03:02:19.395 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:19.395 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.396 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.396 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:02:19.396 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:18.012798+0000", 2024-04-19T03:02:19.396 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.999999 2024-04-19T03:02:19.396 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.396 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.396 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:02:19.396 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:18.012834+0000", 2024-04-19T03:02:19.396 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 3.5852000000000002e-05 2024-04-19T03:02:19.396 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.396 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.396 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:02:19.396 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:18.012843+0000", 2024-04-19T03:02:19.397 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.132e-06 2024-04-19T03:02:19.397 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.397 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.397 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:02:19.397 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:18.012850+0000", 2024-04-19T03:02:19.397 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.9070000000000001e-06 2024-04-19T03:02:19.397 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.397 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.397 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:19.397 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:18.012943+0000", 2024-04-19T03:02:19.397 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.2967999999999995e-05 2024-04-19T03:02:19.397 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.397 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.397 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:02:19.398 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:18.013115+0000", 2024-04-19T03:02:19.398 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00017193199999999999 2024-04-19T03:02:19.398 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.398 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.398 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-04-19T03:02:19.398 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:18.013292+0000", 2024-04-19T03:02:19.398 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.00017729200000000001 2024-04-19T03:02:19.398 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.398 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.398 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:02:19.398 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:18.016574+0000", 2024-04-19T03:02:19.398 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.003281586 2024-04-19T03:02:19.398 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.398 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.399 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:19.399 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:18.070931+0000", 2024-04-19T03:02:19.399 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.054357324999999998 2024-04-19T03:02:19.399 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.399 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.399 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:02:19.399 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:18.070992+0000", 2024-04-19T03:02:19.399 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 6.1173000000000005e-05 2024-04-19T03:02:19.399 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.399 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.399 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:02:19.399 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:18.071037+0000", 2024-04-19T03:02:19.399 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4.4549000000000003e-05 2024-04-19T03:02:19.399 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:19.399 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:02:19.400 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:19.400 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.400 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.400 INFO:teuthology.orchestra.run.smithi097.stdout: "description": "osd_op(client.4755.0:79003 5.2 5:4436e33f:::benchmark_data_smithi096_19531_object79002:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-19T03:02:19.400 INFO:teuthology.orchestra.run.smithi097.stdout: "initiated_at": "2024-04-19T03:02:18.016740+0000", 2024-04-19T03:02:19.400 INFO:teuthology.orchestra.run.smithi097.stdout: "age": 1.2560704120000001, 2024-04-19T03:02:19.400 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.061589115, 2024-04-19T03:02:19.400 INFO:teuthology.orchestra.run.smithi097.stdout: "type_data": { 2024-04-19T03:02:19.400 INFO:teuthology.orchestra.run.smithi097.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:19.400 INFO:teuthology.orchestra.run.smithi097.stdout: "client_info": { 2024-04-19T03:02:19.400 INFO:teuthology.orchestra.run.smithi097.stdout: "client": "client.4755", 2024-04-19T03:02:19.400 INFO:teuthology.orchestra.run.smithi097.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:19.400 INFO:teuthology.orchestra.run.smithi097.stdout: "tid": 79003 2024-04-19T03:02:19.400 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.400 INFO:teuthology.orchestra.run.smithi097.stdout: "events": [ 2024-04-19T03:02:19.401 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.401 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "initiated", 2024-04-19T03:02:19.401 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:18.016740+0000", 2024-04-19T03:02:19.401 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:19.401 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.401 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.401 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "throttled", 2024-04-19T03:02:19.401 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:18.016740+0000", 2024-04-19T03:02:19.401 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0 2024-04-19T03:02:19.401 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.401 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.401 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "header_read", 2024-04-19T03:02:19.401 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:18.016739+0000", 2024-04-19T03:02:19.401 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:19.401 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.401 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.402 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "all_read", 2024-04-19T03:02:19.402 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:18.016838+0000", 2024-04-19T03:02:19.402 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 9.8863000000000005e-05 2024-04-19T03:02:19.402 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.402 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.402 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "dispatched", 2024-04-19T03:02:19.402 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:18.016853+0000", 2024-04-19T03:02:19.402 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.5452e-05 2024-04-19T03:02:19.402 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.402 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.402 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "queued_for_pg", 2024-04-19T03:02:19.402 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:18.016864+0000", 2024-04-19T03:02:19.402 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 1.0236e-05 2024-04-19T03:02:19.402 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.403 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.403 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "reached_pg", 2024-04-19T03:02:19.403 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:18.016918+0000", 2024-04-19T03:02:19.403 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 5.4384e-05 2024-04-19T03:02:19.403 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.403 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.403 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "started", 2024-04-19T03:02:19.403 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:18.017097+0000", 2024-04-19T03:02:19.403 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000179278 2024-04-19T03:02:19.403 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.403 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.403 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "waiting for subops from 2", 2024-04-19T03:02:19.403 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:18.017245+0000", 2024-04-19T03:02:19.403 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.000147441 2024-04-19T03:02:19.404 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.404 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.404 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "op_commit", 2024-04-19T03:02:19.404 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:18.021293+0000", 2024-04-19T03:02:19.404 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.0040486949999999997 2024-04-19T03:02:19.404 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.404 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.404 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:19.404 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:18.078171+0000", 2024-04-19T03:02:19.404 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 0.056877479000000002 2024-04-19T03:02:19.404 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.404 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.404 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "commit_sent", 2024-04-19T03:02:19.404 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:18.078256+0000", 2024-04-19T03:02:19.404 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 8.5463000000000005e-05 2024-04-19T03:02:19.405 INFO:teuthology.orchestra.run.smithi097.stdout: }, 2024-04-19T03:02:19.405 INFO:teuthology.orchestra.run.smithi097.stdout: { 2024-04-19T03:02:19.405 INFO:teuthology.orchestra.run.smithi097.stdout: "event": "done", 2024-04-19T03:02:19.405 INFO:teuthology.orchestra.run.smithi097.stdout: "time": "2024-04-19T03:02:18.078330+0000", 2024-04-19T03:02:19.405 INFO:teuthology.orchestra.run.smithi097.stdout: "duration": 7.3219999999999994e-05 2024-04-19T03:02:19.405 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:19.405 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:02:19.405 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:19.405 INFO:teuthology.orchestra.run.smithi097.stdout: } 2024-04-19T03:02:19.405 INFO:teuthology.orchestra.run.smithi097.stdout: ] 2024-04-19T03:02:19.405 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-04-19T03:02:19.407 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T03:02:19.408 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:19.405+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:19.508 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:19.507+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:19.536 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-04-19T03:02:19.536 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [ 2024-04-19T03:02:19.536 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.537 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4755.0:81439 5.6 e41/22 5:664740cb:::benchmark_data_smithi096_19531_object81438:head v 41'5146, mlcod=41'5143)", 2024-04-19T03:02:19.537 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:19.528938+0000", 2024-04-19T03:02:19.537 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.005805864, 2024-04-19T03:02:19.537 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0058323250000000002, 2024-04-19T03:02:19.537 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:19.537 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-04-19T03:02:19.537 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:19.537 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.537 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:19.537 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:19.528938+0000", 2024-04-19T03:02:19.537 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:19.537 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.538 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.538 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:19.538 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:19.528938+0000", 2024-04-19T03:02:19.538 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:19.538 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.538 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.538 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:19.538 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:19.528938+0000", 2024-04-19T03:02:19.538 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:19.538 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.538 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.538 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:19.538 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:19.529043+0000", 2024-04-19T03:02:19.539 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00010590999999999999 2024-04-19T03:02:19.539 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.539 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.539 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:19.539 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:19.529049+0000", 2024-04-19T03:02:19.539 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2170000000000002e-06 2024-04-19T03:02:19.539 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.539 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.539 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:19.539 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:19.529052+0000", 2024-04-19T03:02:19.539 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5370000000000002e-06 2024-04-19T03:02:19.539 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.539 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.539 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:19.540 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:19.529097+0000", 2024-04-19T03:02:19.540 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5241000000000003e-05 2024-04-19T03:02:19.540 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.540 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.540 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:19.540 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:19.529138+0000", 2024-04-19T03:02:19.540 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0774e-05 2024-04-19T03:02:19.540 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:19.540 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:19.540 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:19.540 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.540 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.540 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4755.0:81440 5.c e41/22 5:3bba855c:::benchmark_data_smithi096_19531_object81439:head v 41'5144, mlcod=41'5142)", 2024-04-19T03:02:19.540 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:19.529071+0000", 2024-04-19T03:02:19.541 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.005673338, 2024-04-19T03:02:19.541 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0057764380000000001, 2024-04-19T03:02:19.541 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:19.541 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-04-19T03:02:19.541 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:19.541 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.541 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:19.541 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:19.529071+0000", 2024-04-19T03:02:19.541 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:19.541 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.541 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.541 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:19.541 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:19.529071+0000", 2024-04-19T03:02:19.542 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:19.542 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.542 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.542 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:19.542 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:19.529070+0000", 2024-04-19T03:02:19.542 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:19.542 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.542 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.542 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:19.542 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:19.529114+0000", 2024-04-19T03:02:19.542 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4013e-05 2024-04-19T03:02:19.542 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.542 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.543 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:19.543 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:19.529142+0000", 2024-04-19T03:02:19.543 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.8303999999999999e-05 2024-04-19T03:02:19.543 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.543 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.543 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:19.543 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:19.529149+0000", 2024-04-19T03:02:19.543 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1449999999999996e-06 2024-04-19T03:02:19.543 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.543 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.543 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:19.543 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:19.529207+0000", 2024-04-19T03:02:19.543 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8251000000000002e-05 2024-04-19T03:02:19.544 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.544 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.544 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:19.544 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:19.529228+0000", 2024-04-19T03:02:19.544 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.071e-05 2024-04-19T03:02:19.544 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:19.544 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:19.544 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:19.544 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.544 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.544 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4755.0:81444 5.6 e41/22 5:6d073f3c:::benchmark_data_smithi096_19531_object81443:head v 41'5147, mlcod=41'5143)", 2024-04-19T03:02:19.544 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:19.531443+0000", 2024-04-19T03:02:19.544 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.003300992, 2024-04-19T03:02:19.545 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0034724999999999999, 2024-04-19T03:02:19.545 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:19.545 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-04-19T03:02:19.545 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:19.545 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.545 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:19.545 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:19.531443+0000", 2024-04-19T03:02:19.545 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:19.545 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.545 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.545 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:19.545 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:19.531443+0000", 2024-04-19T03:02:19.545 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:19.546 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.546 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.546 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:19.546 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:19.531442+0000", 2024-04-19T03:02:19.546 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:19.546 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.546 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.546 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:19.546 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:19.531507+0000", 2024-04-19T03:02:19.546 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4406000000000006e-05 2024-04-19T03:02:19.546 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.546 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.546 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:19.547 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:19.531514+0000", 2024-04-19T03:02:19.547 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5950000000000001e-06 2024-04-19T03:02:19.547 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.547 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.547 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:19.547 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:19.531519+0000", 2024-04-19T03:02:19.547 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9930000000000003e-06 2024-04-19T03:02:19.547 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.547 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.547 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:19.547 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:19.531561+0000", 2024-04-19T03:02:19.547 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1829000000000002e-05 2024-04-19T03:02:19.547 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.547 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.547 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:19.548 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:19.531584+0000", 2024-04-19T03:02:19.548 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2521e-05 2024-04-19T03:02:19.548 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:19.548 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:19.548 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:19.548 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.548 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.548 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:81446 5.f 5:f821f521:::benchmark_data_smithi096_19531_object81445:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-19T03:02:19.548 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:19.531792+0000", 2024-04-19T03:02:19.548 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0029519780000000001, 2024-04-19T03:02:19.548 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.003198008, 2024-04-19T03:02:19.548 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:19.549 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:02:19.549 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:19.549 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:19.549 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:19.549 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 81446 2024-04-19T03:02:19.549 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.549 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:19.549 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.549 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:19.549 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:19.531792+0000", 2024-04-19T03:02:19.549 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:19.549 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.549 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.549 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:19.550 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:19.531792+0000", 2024-04-19T03:02:19.550 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:19.550 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.550 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.550 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:19.550 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:19.531790+0000", 2024-04-19T03:02:19.550 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:19.550 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.550 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.550 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:19.550 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:19.531923+0000", 2024-04-19T03:02:19.550 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000132676 2024-04-19T03:02:19.550 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.551 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.551 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:19.551 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:19.531938+0000", 2024-04-19T03:02:19.551 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4696e-05 2024-04-19T03:02:19.551 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.551 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.551 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:19.551 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:19.531948+0000", 2024-04-19T03:02:19.551 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0237999999999999e-05 2024-04-19T03:02:19.551 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.551 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.551 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:19.551 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:19.532032+0000", 2024-04-19T03:02:19.551 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4219000000000001e-05 2024-04-19T03:02:19.552 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.552 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.552 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:19.552 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:19.532182+0000", 2024-04-19T03:02:19.552 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000149846 2024-04-19T03:02:19.552 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.552 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.552 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:02:19.552 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:19.532309+0000", 2024-04-19T03:02:19.552 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00012709200000000001 2024-04-19T03:02:19.552 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:19.552 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:19.552 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:19.552 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.553 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.553 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4755.0:81443 5.c e41/22 5:35bb99c9:::benchmark_data_smithi096_19531_object81442:head v 41'5145, mlcod=41'5142)", 2024-04-19T03:02:19.553 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:19.532259+0000", 2024-04-19T03:02:19.553 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0024852490000000001, 2024-04-19T03:02:19.553 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0028163950000000002, 2024-04-19T03:02:19.553 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:19.553 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-04-19T03:02:19.553 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:19.553 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.553 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:19.553 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:19.532259+0000", 2024-04-19T03:02:19.553 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:19.553 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.554 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.554 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:19.554 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:19.532259+0000", 2024-04-19T03:02:19.554 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:19.554 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.554 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.554 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:19.554 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:19.532258+0000", 2024-04-19T03:02:19.554 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:19.554 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.554 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.554 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:19.554 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:19.532305+0000", 2024-04-19T03:02:19.554 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6810000000000001e-05 2024-04-19T03:02:19.555 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.555 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.555 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:19.555 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:19.532314+0000", 2024-04-19T03:02:19.555 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9900000000000003e-06 2024-04-19T03:02:19.555 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.555 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.555 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:19.555 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:19.532321+0000", 2024-04-19T03:02:19.555 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.9410000000000001e-06 2024-04-19T03:02:19.555 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.555 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.555 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:19.556 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:19.532362+0000", 2024-04-19T03:02:19.556 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1278e-05 2024-04-19T03:02:19.556 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.556 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.556 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:19.556 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:19.532382+0000", 2024-04-19T03:02:19.556 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0562000000000001e-05 2024-04-19T03:02:19.556 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:19.556 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:19.556 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:19.556 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.556 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.556 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4755.0:81447 5.3 e41/22 5:ccb7826a:::benchmark_data_smithi096_19531_object81446:head v 41'5051, mlcod=41'5049)", 2024-04-19T03:02:19.557 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:19.532388+0000", 2024-04-19T03:02:19.557 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0023559090000000002, 2024-04-19T03:02:19.557 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0027531460000000002, 2024-04-19T03:02:19.557 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:19.557 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-04-19T03:02:19.557 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:19.557 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.557 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:19.557 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:19.532388+0000", 2024-04-19T03:02:19.557 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:19.557 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.557 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.558 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:19.558 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:19.532388+0000", 2024-04-19T03:02:19.558 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:19.558 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.558 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.558 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:19.558 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:19.532387+0000", 2024-04-19T03:02:19.558 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:19.558 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.558 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.558 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:19.558 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:19.532444+0000", 2024-04-19T03:02:19.558 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6660999999999998e-05 2024-04-19T03:02:19.559 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.559 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.559 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:19.559 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:19.532453+0000", 2024-04-19T03:02:19.559 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4419999999999998e-06 2024-04-19T03:02:19.559 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.559 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.559 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:19.559 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:19.532470+0000", 2024-04-19T03:02:19.559 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7275999999999999e-05 2024-04-19T03:02:19.559 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.559 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.559 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:19.560 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:19.532517+0000", 2024-04-19T03:02:19.560 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.689e-05 2024-04-19T03:02:19.560 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.560 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.560 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:19.560 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:19.532535+0000", 2024-04-19T03:02:19.560 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8252000000000001e-05 2024-04-19T03:02:19.560 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:19.560 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:19.560 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:19.560 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.560 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.560 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:81448 5.9 5:9588f069:::benchmark_data_smithi096_19531_object81447:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-19T03:02:19.560 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:19.532684+0000", 2024-04-19T03:02:19.561 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0020600039999999998, 2024-04-19T03:02:19.561 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0025325059999999999, 2024-04-19T03:02:19.561 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:19.561 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:02:19.561 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:19.561 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:19.561 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:19.561 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 81448 2024-04-19T03:02:19.561 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.561 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:19.561 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.561 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:19.561 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:19.532684+0000", 2024-04-19T03:02:19.562 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:19.562 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.562 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.562 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:19.562 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:19.532684+0000", 2024-04-19T03:02:19.562 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:19.562 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.562 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.562 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:19.562 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:19.532683+0000", 2024-04-19T03:02:19.562 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:19.562 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.562 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.562 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:19.563 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:19.532728+0000", 2024-04-19T03:02:19.563 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5697e-05 2024-04-19T03:02:19.563 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.563 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.563 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:19.563 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:19.532745+0000", 2024-04-19T03:02:19.563 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6303999999999998e-05 2024-04-19T03:02:19.563 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.563 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.563 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:19.563 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:19.532754+0000", 2024-04-19T03:02:19.563 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9630000000000004e-06 2024-04-19T03:02:19.563 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.564 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.564 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:19.564 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:19.532806+0000", 2024-04-19T03:02:19.564 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2607e-05 2024-04-19T03:02:19.564 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.564 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.564 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:19.564 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:19.532925+0000", 2024-04-19T03:02:19.564 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00011915 2024-04-19T03:02:19.564 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.564 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.564 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:02:19.564 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:19.533044+0000", 2024-04-19T03:02:19.564 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000118711 2024-04-19T03:02:19.565 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:19.565 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:19.565 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:19.565 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.565 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.565 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4755.0:81445 5.6 e41/22 5:601e53d7:::benchmark_data_smithi096_19531_object81444:head v 41'5148, mlcod=41'5144)", 2024-04-19T03:02:19.565 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:19.534296+0000", 2024-04-19T03:02:19.565 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.00044795799999999998, 2024-04-19T03:02:19.565 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0010038499999999999, 2024-04-19T03:02:19.565 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:19.565 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-04-19T03:02:19.565 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:19.565 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.565 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:19.566 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:19.534296+0000", 2024-04-19T03:02:19.566 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:19.566 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.566 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.566 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:19.566 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:19.534296+0000", 2024-04-19T03:02:19.566 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:19.566 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.566 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.566 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:19.566 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:19.534295+0000", 2024-04-19T03:02:19.566 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:19.566 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.566 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.567 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:19.567 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:19.534334+0000", 2024-04-19T03:02:19.567 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8859999999999997e-05 2024-04-19T03:02:19.567 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.567 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.567 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:19.567 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:19.534352+0000", 2024-04-19T03:02:19.567 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7561999999999999e-05 2024-04-19T03:02:19.567 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.567 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.567 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:19.567 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:19.534358+0000", 2024-04-19T03:02:19.567 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6680000000000004e-06 2024-04-19T03:02:19.567 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.568 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.568 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:19.568 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:19.534416+0000", 2024-04-19T03:02:19.568 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7228000000000002e-05 2024-04-19T03:02:19.568 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.568 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.568 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:19.568 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:19.534437+0000", 2024-04-19T03:02:19.568 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1810999999999998e-05 2024-04-19T03:02:19.568 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:19.568 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:19.568 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:19.568 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.568 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.569 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4755.0:81450 5.2 e41/39 5:405bee1d:::benchmark_data_smithi096_19531_object81449:head v 41'5080, mlcod=41'5078)", 2024-04-19T03:02:19.569 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:19.534371+0000", 2024-04-19T03:02:19.569 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.00037310700000000002, 2024-04-19T03:02:19.569 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00099806599999999993, 2024-04-19T03:02:19.569 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:19.569 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-04-19T03:02:19.569 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:19.569 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.569 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:19.569 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:19.534371+0000", 2024-04-19T03:02:19.569 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:19.569 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.569 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.569 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:19.570 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:19.534371+0000", 2024-04-19T03:02:19.570 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:19.570 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.570 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.570 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:19.570 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:19.534370+0000", 2024-04-19T03:02:19.570 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:19.570 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.570 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.570 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:19.570 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:19.534405+0000", 2024-04-19T03:02:19.570 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4925000000000002e-05 2024-04-19T03:02:19.570 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.571 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.571 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:19.571 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:19.534413+0000", 2024-04-19T03:02:19.571 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9950000000000005e-06 2024-04-19T03:02:19.571 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.571 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.571 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:19.571 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:19.534418+0000", 2024-04-19T03:02:19.571 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7439999999999998e-06 2024-04-19T03:02:19.571 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.571 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.571 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:19.571 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:19.534461+0000", 2024-04-19T03:02:19.571 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2852999999999998e-05 2024-04-19T03:02:19.571 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.572 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.572 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:19.572 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:19.534498+0000", 2024-04-19T03:02:19.572 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7042999999999998e-05 2024-04-19T03:02:19.572 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:19.572 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:19.572 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:19.572 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.572 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.572 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4755.0:81451 5.3 e41/22 5:ca6dc552:::benchmark_data_smithi096_19531_object81450:head v 41'5052, mlcod=41'5049)", 2024-04-19T03:02:19.572 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:19.535089+0000", 2024-04-19T03:02:19.572 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4294967295.9996552, 2024-04-19T03:02:19.572 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00034682199999999999, 2024-04-19T03:02:19.572 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:19.573 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-04-19T03:02:19.573 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:19.573 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.573 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:19.573 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:19.535089+0000", 2024-04-19T03:02:19.573 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:19.573 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.573 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.573 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:19.573 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:19.535089+0000", 2024-04-19T03:02:19.573 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:19.573 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.573 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.573 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:19.574 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:19.535088+0000", 2024-04-19T03:02:19.574 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:19.574 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.574 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.574 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:19.574 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:19.535116+0000", 2024-04-19T03:02:19.574 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7538e-05 2024-04-19T03:02:19.574 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.574 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.574 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:19.574 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:19.535127+0000", 2024-04-19T03:02:19.574 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1936999999999999e-05 2024-04-19T03:02:19.574 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.574 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.574 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:19.575 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:19.535133+0000", 2024-04-19T03:02:19.575 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.835e-06 2024-04-19T03:02:19.575 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.575 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.575 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:19.575 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:19.535187+0000", 2024-04-19T03:02:19.575 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3962999999999998e-05 2024-04-19T03:02:19.575 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.575 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.575 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:19.575 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:19.535200+0000", 2024-04-19T03:02:19.575 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2343e-05 2024-04-19T03:02:19.575 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:19.575 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:19.576 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:19.576 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.576 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.576 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:81442 5.f 5:faf6c2a2:::benchmark_data_smithi096_19531_object81441:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-19T03:02:19.576 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:19.528582+0000", 2024-04-19T03:02:19.576 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0061615710000000002, 2024-04-19T03:02:19.576 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0069261549999999998, 2024-04-19T03:02:19.576 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:19.576 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:02:19.576 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:19.576 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:19.576 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:19.576 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 81442 2024-04-19T03:02:19.576 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.577 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:19.577 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.577 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:19.577 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:19.528582+0000", 2024-04-19T03:02:19.577 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:19.577 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.577 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.577 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:19.577 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:19.528582+0000", 2024-04-19T03:02:19.577 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:19.577 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.577 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.577 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:19.577 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:19.528581+0000", 2024-04-19T03:02:19.578 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:19.578 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.578 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.578 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:19.578 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:19.528727+0000", 2024-04-19T03:02:19.578 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00014559499999999999 2024-04-19T03:02:19.578 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.578 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.578 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:19.578 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:19.528745+0000", 2024-04-19T03:02:19.578 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7884999999999999e-05 2024-04-19T03:02:19.578 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.578 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.579 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:19.579 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:19.528752+0000", 2024-04-19T03:02:19.579 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6020000000000002e-06 2024-04-19T03:02:19.579 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.579 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.579 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:19.579 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:19.528799+0000", 2024-04-19T03:02:19.579 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6195000000000001e-05 2024-04-19T03:02:19.579 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.579 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.579 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:19.579 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:19.528887+0000", 2024-04-19T03:02:19.579 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.8028999999999994e-05 2024-04-19T03:02:19.580 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.580 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.580 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:02:19.580 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:19.528974+0000", 2024-04-19T03:02:19.580 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.7128999999999999e-05 2024-04-19T03:02:19.580 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.580 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.580 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:19.580 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:19.535451+0000", 2024-04-19T03:02:19.580 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0064770330000000001 2024-04-19T03:02:19.580 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:19.580 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:19.580 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:19.580 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:19.580 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-04-19T03:02:19.581 INFO:teuthology.orchestra.run.smithi144.stdout: "num_ops": 11 2024-04-19T03:02:19.581 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-04-19T03:02:19.582 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T03:02:19.609 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:19.605+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:19.702 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-04-19T03:02:19.702 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2024-04-19T03:02:19.702 INFO:teuthology.orchestra.run.smithi144.stdout: "complaint_time": 30, 2024-04-19T03:02:19.702 INFO:teuthology.orchestra.run.smithi144.stdout: "num_blocked_ops": 0 2024-04-19T03:02:19.702 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-04-19T03:02:19.709 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:19.707+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:19.714 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T03:02:19.810 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:19.807+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:19.824 INFO:tasks.radosbench.radosbench.0.smithi096.stdout: 42 16 81950 81934 121.912 103.188 0.0119681 0.00819637 2024-04-19T03:02:19.837 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-04-19T03:02:19.837 INFO:teuthology.orchestra.run.smithi144.stdout: "size": 20, 2024-04-19T03:02:19.837 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 600, 2024-04-19T03:02:19.837 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [ 2024-04-19T03:02:19.837 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.837 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:8 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:02:19.837 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:01:14.998165+0000", 2024-04-19T03:02:19.837 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 64.835216278000004, 2024-04-19T03:02:19.837 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.024541001, 2024-04-19T03:02:19.837 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:19.838 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:19.838 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:19.838 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.838 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:19.838 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998165+0000", 2024-04-19T03:02:19.838 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:19.838 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.838 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.838 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:19.838 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998165+0000", 2024-04-19T03:02:19.838 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:19.838 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.838 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.838 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:19.839 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998164+0000", 2024-04-19T03:02:19.839 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:19.839 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.839 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.839 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:19.839 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998170+0000", 2024-04-19T03:02:19.839 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2939999999999996e-06 2024-04-19T03:02:19.839 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.839 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.839 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:19.839 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998179+0000", 2024-04-19T03:02:19.839 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.5540000000000003e-06 2024-04-19T03:02:19.839 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.840 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.840 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:19.840 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998188+0000", 2024-04-19T03:02:19.840 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2959999999999999e-06 2024-04-19T03:02:19.840 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.840 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.840 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:19.840 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998332+0000", 2024-04-19T03:02:19.840 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00014474 2024-04-19T03:02:19.840 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.840 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.840 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:02:19.840 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998337+0000", 2024-04-19T03:02:19.840 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6909999999999996e-06 2024-04-19T03:02:19.841 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.841 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.841 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:19.841 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.010222+0000", 2024-04-19T03:02:19.841 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011885178 2024-04-19T03:02:19.841 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.841 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.841 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:19.841 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.010342+0000", 2024-04-19T03:02:19.841 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00011991500000000001 2024-04-19T03:02:19.841 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.841 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.841 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:02:19.842 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.010506+0000", 2024-04-19T03:02:19.842 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00016429699999999999 2024-04-19T03:02:19.842 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.842 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.842 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:19.842 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.014525+0000", 2024-04-19T03:02:19.842 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0040189839999999998 2024-04-19T03:02:19.842 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.842 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.842 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:19.842 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.022600+0000", 2024-04-19T03:02:19.842 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0080741990000000007 2024-04-19T03:02:19.842 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.843 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.843 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:19.843 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.022670+0000", 2024-04-19T03:02:19.843 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0743999999999999e-05 2024-04-19T03:02:19.843 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.843 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.843 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:19.843 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.022706+0000", 2024-04-19T03:02:19.843 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5782999999999999e-05 2024-04-19T03:02:19.843 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:19.843 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:19.843 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:19.843 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.843 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.844 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:27 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:02:19.844 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:01:14.998436+0000", 2024-04-19T03:02:19.844 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 64.834945623999999, 2024-04-19T03:02:19.844 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.024406325999999999, 2024-04-19T03:02:19.844 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:19.844 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:19.844 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:19.844 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.844 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:19.844 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998436+0000", 2024-04-19T03:02:19.844 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:19.844 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.844 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.844 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:19.845 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998436+0000", 2024-04-19T03:02:19.845 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:19.845 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.845 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.845 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:19.845 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998435+0000", 2024-04-19T03:02:19.845 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:19.845 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.845 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.845 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:19.845 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998445+0000", 2024-04-19T03:02:19.845 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0349e-05 2024-04-19T03:02:19.845 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.846 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.846 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:19.846 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998453+0000", 2024-04-19T03:02:19.846 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0399999999999993e-06 2024-04-19T03:02:19.846 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.846 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.846 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:19.846 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998461+0000", 2024-04-19T03:02:19.846 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9780000000000005e-06 2024-04-19T03:02:19.846 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.846 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.846 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:19.847 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998515+0000", 2024-04-19T03:02:19.847 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3097999999999999e-05 2024-04-19T03:02:19.847 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.847 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.847 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:02:19.847 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998520+0000", 2024-04-19T03:02:19.847 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9220000000000002e-06 2024-04-19T03:02:19.847 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.847 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.847 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:19.847 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.011258+0000", 2024-04-19T03:02:19.847 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.012737735 2024-04-19T03:02:19.847 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.848 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.848 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:19.848 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.011566+0000", 2024-04-19T03:02:19.848 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00030826200000000001 2024-04-19T03:02:19.848 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.848 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.848 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:02:19.848 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.011996+0000", 2024-04-19T03:02:19.848 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00042912000000000001 2024-04-19T03:02:19.848 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.848 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.848 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:19.848 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.014533+0000", 2024-04-19T03:02:19.849 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.002537423 2024-04-19T03:02:19.849 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.849 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.849 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:19.849 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.022756+0000", 2024-04-19T03:02:19.849 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0082231530000000004 2024-04-19T03:02:19.849 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.849 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.849 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:19.849 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.022807+0000", 2024-04-19T03:02:19.849 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0852e-05 2024-04-19T03:02:19.849 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.849 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.849 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:19.849 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.022842+0000", 2024-04-19T03:02:19.850 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5058000000000002e-05 2024-04-19T03:02:19.850 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:19.850 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:19.850 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:19.850 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.850 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.850 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:28 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:02:19.850 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:01:14.998476+0000", 2024-04-19T03:02:19.850 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 64.834905702, 2024-04-19T03:02:19.850 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.024656784000000001, 2024-04-19T03:02:19.850 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:19.850 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:19.850 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:19.850 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.851 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:19.851 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998476+0000", 2024-04-19T03:02:19.851 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:19.851 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.851 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.851 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:19.851 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998476+0000", 2024-04-19T03:02:19.851 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:19.851 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.851 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.851 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:19.851 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998475+0000", 2024-04-19T03:02:19.851 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:19.852 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.852 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.852 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:19.852 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998484+0000", 2024-04-19T03:02:19.852 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.7770000000000008e-06 2024-04-19T03:02:19.852 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.852 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.852 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:19.852 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998495+0000", 2024-04-19T03:02:19.852 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0726e-05 2024-04-19T03:02:19.852 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.852 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.852 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:19.852 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998503+0000", 2024-04-19T03:02:19.852 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.8780000000000004e-06 2024-04-19T03:02:19.853 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.853 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.853 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:19.853 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998579+0000", 2024-04-19T03:02:19.853 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5160999999999994e-05 2024-04-19T03:02:19.853 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.853 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.853 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:02:19.853 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998586+0000", 2024-04-19T03:02:19.853 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8520000000000004e-06 2024-04-19T03:02:19.853 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.853 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.853 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:19.853 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.012423+0000", 2024-04-19T03:02:19.853 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.013836667 2024-04-19T03:02:19.854 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.854 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.854 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:19.854 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.012532+0000", 2024-04-19T03:02:19.854 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000108565 2024-04-19T03:02:19.854 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.854 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.854 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:02:19.854 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.012655+0000", 2024-04-19T03:02:19.854 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00012344600000000001 2024-04-19T03:02:19.854 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.854 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.854 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:19.855 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.015680+0000", 2024-04-19T03:02:19.855 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0030246470000000001 2024-04-19T03:02:19.855 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.855 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.855 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:19.855 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.023091+0000", 2024-04-19T03:02:19.855 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0074116030000000001 2024-04-19T03:02:19.855 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.855 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.855 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:19.855 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.023115+0000", 2024-04-19T03:02:19.855 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.3091999999999998e-05 2024-04-19T03:02:19.855 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.856 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.856 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:19.856 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.023132+0000", 2024-04-19T03:02:19.856 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7901999999999999e-05 2024-04-19T03:02:19.856 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:19.856 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:19.856 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:19.856 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.856 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.856 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:29 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:02:19.856 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:01:14.998527+0000", 2024-04-19T03:02:19.856 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 64.834854161999999, 2024-04-19T03:02:19.856 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.024738599999999999, 2024-04-19T03:02:19.857 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:19.857 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:19.857 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:19.857 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.857 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:19.857 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998527+0000", 2024-04-19T03:02:19.857 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:19.857 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.857 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.857 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:19.857 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998527+0000", 2024-04-19T03:02:19.857 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:19.857 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.857 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.858 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:19.858 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998527+0000", 2024-04-19T03:02:19.858 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:19.858 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.858 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.858 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:19.858 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998531+0000", 2024-04-19T03:02:19.858 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9450000000000001e-06 2024-04-19T03:02:19.858 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.858 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.858 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:19.858 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998541+0000", 2024-04-19T03:02:19.859 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.4320000000000005e-06 2024-04-19T03:02:19.859 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.859 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.859 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:19.859 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998548+0000", 2024-04-19T03:02:19.859 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.221e-06 2024-04-19T03:02:19.859 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.859 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.859 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:19.859 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998620+0000", 2024-04-19T03:02:19.859 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.1676999999999998e-05 2024-04-19T03:02:19.859 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.859 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.860 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:02:19.860 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998624+0000", 2024-04-19T03:02:19.860 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4850000000000003e-06 2024-04-19T03:02:19.860 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.860 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.860 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:19.860 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.013261+0000", 2024-04-19T03:02:19.860 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.014636451999999999 2024-04-19T03:02:19.860 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.860 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.860 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:19.860 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.013364+0000", 2024-04-19T03:02:19.860 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000102885 2024-04-19T03:02:19.860 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.860 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.861 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:02:19.861 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.013481+0000", 2024-04-19T03:02:19.861 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00011783299999999999 2024-04-19T03:02:19.861 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.861 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.861 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:19.861 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.016265+0000", 2024-04-19T03:02:19.861 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0027834539999999999 2024-04-19T03:02:19.861 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.861 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.861 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:19.861 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.023180+0000", 2024-04-19T03:02:19.861 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0069149399999999996 2024-04-19T03:02:19.862 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.862 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.862 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:19.862 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.023230+0000", 2024-04-19T03:02:19.862 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0220999999999999e-05 2024-04-19T03:02:19.862 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.862 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.862 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:19.862 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.023266+0000", 2024-04-19T03:02:19.862 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5703e-05 2024-04-19T03:02:19.862 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:19.862 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:19.862 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:19.863 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.863 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.863 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:30 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:02:19.863 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:01:14.998577+0000", 2024-04-19T03:02:19.863 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 64.834804055000006, 2024-04-19T03:02:19.863 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.024774022999999999, 2024-04-19T03:02:19.863 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:19.863 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:19.863 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:19.863 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.863 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:19.863 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998577+0000", 2024-04-19T03:02:19.863 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:19.863 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.864 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.864 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:19.864 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998577+0000", 2024-04-19T03:02:19.864 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:19.864 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.864 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.864 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:19.864 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998576+0000", 2024-04-19T03:02:19.864 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:19.864 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.864 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.864 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:19.864 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998583+0000", 2024-04-19T03:02:19.865 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8850000000000001e-06 2024-04-19T03:02:19.865 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.865 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.865 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:19.865 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998597+0000", 2024-04-19T03:02:19.865 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.362e-05 2024-04-19T03:02:19.865 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.865 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.865 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:19.865 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998607+0000", 2024-04-19T03:02:19.865 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0389e-05 2024-04-19T03:02:19.865 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.866 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.866 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:19.866 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998713+0000", 2024-04-19T03:02:19.866 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000105338 2024-04-19T03:02:19.866 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.866 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.866 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:02:19.866 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998720+0000", 2024-04-19T03:02:19.866 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2370000000000003e-06 2024-04-19T03:02:19.866 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.866 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.866 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:19.867 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.014014+0000", 2024-04-19T03:02:19.867 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.015294116999999999 2024-04-19T03:02:19.867 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.867 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.867 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:19.867 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.014091+0000", 2024-04-19T03:02:19.867 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7148000000000001e-05 2024-04-19T03:02:19.867 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.867 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.867 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:02:19.867 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.014271+0000", 2024-04-19T03:02:19.867 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00017962699999999999 2024-04-19T03:02:19.867 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.867 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.868 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:19.868 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.018024+0000", 2024-04-19T03:02:19.868 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0037529809999999999 2024-04-19T03:02:19.868 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.868 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.868 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:19.868 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.023303+0000", 2024-04-19T03:02:19.868 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0052793099999999997 2024-04-19T03:02:19.868 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.868 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.868 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:19.868 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.023331+0000", 2024-04-19T03:02:19.868 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.8013000000000001e-05 2024-04-19T03:02:19.868 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.868 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.869 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:19.869 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.023351+0000", 2024-04-19T03:02:19.869 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0225999999999999e-05 2024-04-19T03:02:19.869 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:19.869 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:19.869 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:19.869 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.869 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.869 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:33 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:02:19.869 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:01:14.998625+0000", 2024-04-19T03:02:19.869 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 64.834756658000003, 2024-04-19T03:02:19.869 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.024007338999999999, 2024-04-19T03:02:19.869 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:19.870 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:19.870 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:19.870 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.870 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:19.870 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998625+0000", 2024-04-19T03:02:19.870 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:19.870 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.870 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.870 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:19.870 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998625+0000", 2024-04-19T03:02:19.870 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:19.870 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.870 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.870 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:19.871 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998623+0000", 2024-04-19T03:02:19.871 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:19.871 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.871 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.871 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:19.871 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998632+0000", 2024-04-19T03:02:19.871 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9279999999999999e-06 2024-04-19T03:02:19.871 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.871 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.871 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:19.871 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998642+0000", 2024-04-19T03:02:19.871 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0063e-05 2024-04-19T03:02:19.871 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.872 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.872 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:19.872 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998649+0000", 2024-04-19T03:02:19.872 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4799999999999998e-06 2024-04-19T03:02:19.872 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.872 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.872 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:19.872 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998730+0000", 2024-04-19T03:02:19.872 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.1514999999999995e-05 2024-04-19T03:02:19.872 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.872 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.872 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:02:19.872 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998741+0000", 2024-04-19T03:02:19.872 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1029999999999999e-05 2024-04-19T03:02:19.873 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.873 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.873 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:19.873 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.010202+0000", 2024-04-19T03:02:19.873 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011460529000000001 2024-04-19T03:02:19.873 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.873 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.873 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:19.873 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.010292+0000", 2024-04-19T03:02:19.873 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.0382000000000003e-05 2024-04-19T03:02:19.873 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.873 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.873 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:02:19.873 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.010391+0000", 2024-04-19T03:02:19.873 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.8491000000000003e-05 2024-04-19T03:02:19.874 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.874 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.874 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:19.874 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.013800+0000", 2024-04-19T03:02:19.874 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0034090219999999998 2024-04-19T03:02:19.874 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.874 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.874 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:19.874 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.022564+0000", 2024-04-19T03:02:19.874 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0087639950000000001 2024-04-19T03:02:19.874 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.874 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.874 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:19.875 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.022601+0000", 2024-04-19T03:02:19.875 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7363999999999997e-05 2024-04-19T03:02:19.875 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.875 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.875 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:19.875 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.022632+0000", 2024-04-19T03:02:19.875 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0917000000000002e-05 2024-04-19T03:02:19.875 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:19.875 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:19.875 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:19.875 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.875 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.875 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:02:19.876 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:01:14.998792+0000", 2024-04-19T03:02:19.876 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 64.834589789000006, 2024-04-19T03:02:19.876 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.023951813999999998, 2024-04-19T03:02:19.876 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:19.876 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:19.876 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:19.876 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.876 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:19.876 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998792+0000", 2024-04-19T03:02:19.876 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:19.876 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.876 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.876 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:19.877 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998792+0000", 2024-04-19T03:02:19.877 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:19.877 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.877 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.877 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:19.877 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998791+0000", 2024-04-19T03:02:19.877 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:19.877 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.877 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.877 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:19.877 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998796+0000", 2024-04-19T03:02:19.877 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9649999999999999e-06 2024-04-19T03:02:19.877 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.877 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.877 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:19.878 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998809+0000", 2024-04-19T03:02:19.878 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3254e-05 2024-04-19T03:02:19.878 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.878 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.878 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:19.878 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998816+0000", 2024-04-19T03:02:19.878 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.472e-06 2024-04-19T03:02:19.878 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.878 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.878 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:19.878 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998899+0000", 2024-04-19T03:02:19.878 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.3676000000000003e-05 2024-04-19T03:02:19.878 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.879 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.879 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:02:19.879 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998908+0000", 2024-04-19T03:02:19.879 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6940000000000001e-06 2024-04-19T03:02:19.879 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.879 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.879 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:19.879 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.010818+0000", 2024-04-19T03:02:19.879 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011910482999999999 2024-04-19T03:02:19.879 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.879 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.879 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:19.879 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.010959+0000", 2024-04-19T03:02:19.879 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00014018900000000001 2024-04-19T03:02:19.880 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.880 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.880 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:02:19.880 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.011185+0000", 2024-04-19T03:02:19.880 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000226085 2024-04-19T03:02:19.880 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.880 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.880 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:19.880 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.014479+0000", 2024-04-19T03:02:19.880 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0032938260000000001 2024-04-19T03:02:19.880 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.880 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.880 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:19.881 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.022697+0000", 2024-04-19T03:02:19.881 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0082186029999999997 2024-04-19T03:02:19.881 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.881 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.881 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:19.881 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.022724+0000", 2024-04-19T03:02:19.881 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.6503999999999999e-05 2024-04-19T03:02:19.881 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.881 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.881 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:19.881 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.022743+0000", 2024-04-19T03:02:19.881 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9663000000000001e-05 2024-04-19T03:02:19.881 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:19.882 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:19.882 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:19.882 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.882 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.882 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:02:19.882 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:01:14.998870+0000", 2024-04-19T03:02:19.882 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 64.834511587999998, 2024-04-19T03:02:19.882 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.024280578000000001, 2024-04-19T03:02:19.882 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:19.882 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:19.882 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:19.882 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.882 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:19.883 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998870+0000", 2024-04-19T03:02:19.883 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:19.883 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.883 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.883 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:19.883 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998870+0000", 2024-04-19T03:02:19.883 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:19.883 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.883 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.883 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:19.883 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998869+0000", 2024-04-19T03:02:19.883 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:19.883 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.884 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.884 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:19.884 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998879+0000", 2024-04-19T03:02:19.884 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.8689999999999999e-06 2024-04-19T03:02:19.884 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.884 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.884 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:19.884 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998893+0000", 2024-04-19T03:02:19.884 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4436999999999999e-05 2024-04-19T03:02:19.884 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.884 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.884 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:19.884 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998904+0000", 2024-04-19T03:02:19.885 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0657e-05 2024-04-19T03:02:19.885 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.885 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.885 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:19.885 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998972+0000", 2024-04-19T03:02:19.885 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8121999999999996e-05 2024-04-19T03:02:19.885 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.885 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.885 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:02:19.885 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998980+0000", 2024-04-19T03:02:19.885 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7170000000000008e-06 2024-04-19T03:02:19.885 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.885 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.885 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:19.886 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.011666+0000", 2024-04-19T03:02:19.886 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.012686507 2024-04-19T03:02:19.886 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.886 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.886 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:19.886 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.012403+0000", 2024-04-19T03:02:19.886 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00073661899999999999 2024-04-19T03:02:19.886 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.886 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.886 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:02:19.886 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.012788+0000", 2024-04-19T03:02:19.886 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00038495800000000002 2024-04-19T03:02:19.886 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.886 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.887 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:19.887 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.015713+0000", 2024-04-19T03:02:19.887 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0029255879999999998 2024-04-19T03:02:19.887 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.887 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.887 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:19.887 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.023066+0000", 2024-04-19T03:02:19.887 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.007352903 2024-04-19T03:02:19.887 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.887 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.887 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:19.887 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.023113+0000", 2024-04-19T03:02:19.887 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7163000000000002e-05 2024-04-19T03:02:19.887 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.888 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.888 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:19.888 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.023150+0000", 2024-04-19T03:02:19.888 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6881000000000001e-05 2024-04-19T03:02:19.888 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:19.888 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:19.888 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:19.888 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.888 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.888 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:20 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:02:19.888 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:01:14.999024+0000", 2024-04-19T03:02:19.888 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 64.834357315999995, 2024-04-19T03:02:19.888 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.024212818000000001, 2024-04-19T03:02:19.888 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:19.889 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-04-19T03:02:19.889 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:19.889 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.889 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:19.889 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.999024+0000", 2024-04-19T03:02:19.889 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:19.889 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.889 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.889 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:19.889 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.999024+0000", 2024-04-19T03:02:19.889 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:19.889 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.889 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.889 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:19.890 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.999023+0000", 2024-04-19T03:02:19.890 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:19.890 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.890 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.890 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:19.890 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.999029+0000", 2024-04-19T03:02:19.890 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2709999999999998e-06 2024-04-19T03:02:19.890 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.890 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.890 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:19.890 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.999045+0000", 2024-04-19T03:02:19.890 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.5840000000000001e-05 2024-04-19T03:02:19.890 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.891 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.891 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:19.891 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.999057+0000", 2024-04-19T03:02:19.891 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1897e-05 2024-04-19T03:02:19.891 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.891 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.891 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:19.891 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.999136+0000", 2024-04-19T03:02:19.891 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8842000000000002e-05 2024-04-19T03:02:19.891 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.891 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.891 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:02:19.891 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.999144+0000", 2024-04-19T03:02:19.891 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.3110000000000006e-06 2024-04-19T03:02:19.892 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.892 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.892 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:19.892 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.013338+0000", 2024-04-19T03:02:19.892 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.014194217 2024-04-19T03:02:19.892 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.892 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.892 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:19.892 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.013485+0000", 2024-04-19T03:02:19.892 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000146787 2024-04-19T03:02:19.892 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.892 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.892 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:19.893 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.023237+0000", 2024-04-19T03:02:19.893 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0097517899999999998 2024-04-19T03:02:19.893 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:19.893 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:19.893 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:19.893 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.893 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.893 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:50122 5.9 5:9d1c74f3:::benchmark_data_smithi096_19531_object50121:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e33)", 2024-04-19T03:02:19.893 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:00.084949+0000", 2024-04-19T03:02:19.893 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 19.748432678, 2024-04-19T03:02:19.893 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.023564486999999999, 2024-04-19T03:02:19.893 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:19.893 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:19.894 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:19.894 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:19.894 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:19.894 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 50122 2024-04-19T03:02:19.894 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.894 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:19.894 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.894 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:19.894 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:00.084949+0000", 2024-04-19T03:02:19.894 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:19.894 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.894 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.894 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:19.895 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:00.084949+0000", 2024-04-19T03:02:19.895 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:19.895 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.895 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.895 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:19.895 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:00.084948+0000", 2024-04-19T03:02:19.895 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:19.895 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.895 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.895 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:19.895 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:00.084983+0000", 2024-04-19T03:02:19.895 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4322000000000001e-05 2024-04-19T03:02:19.895 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.896 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.896 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:19.896 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:00.084992+0000", 2024-04-19T03:02:19.896 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.0180000000000007e-06 2024-04-19T03:02:19.896 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.896 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.896 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:19.896 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:00.085000+0000", 2024-04-19T03:02:19.896 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.7609999999999996e-06 2024-04-19T03:02:19.896 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.896 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.896 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:19.896 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:00.093379+0000", 2024-04-19T03:02:19.896 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0083790819999999995 2024-04-19T03:02:19.897 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.897 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.897 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:19.897 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:00.093555+0000", 2024-04-19T03:02:19.897 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00017582900000000001 2024-04-19T03:02:19.897 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.897 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.897 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:02:19.897 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:00.093735+0000", 2024-04-19T03:02:19.897 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00018006399999999999 2024-04-19T03:02:19.897 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.897 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.897 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:19.897 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:00.104665+0000", 2024-04-19T03:02:19.898 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.010929259 2024-04-19T03:02:19.898 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.898 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.898 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:19.898 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:00.108415+0000", 2024-04-19T03:02:19.898 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0037506610000000002 2024-04-19T03:02:19.898 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.898 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.898 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:19.898 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:00.108474+0000", 2024-04-19T03:02:19.898 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8551000000000002e-05 2024-04-19T03:02:19.898 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.898 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.898 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:19.899 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:00.108513+0000", 2024-04-19T03:02:19.899 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9307000000000002e-05 2024-04-19T03:02:19.899 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:19.899 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:19.899 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:19.899 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.899 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.899 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:78992 5.7 5:e6baa862:::benchmark_data_smithi096_19531_object78991:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-19T03:02:19.899 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:18.008888+0000", 2024-04-19T03:02:19.899 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 1.8244929829999998, 2024-04-19T03:02:19.899 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.056375285999999997, 2024-04-19T03:02:19.899 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:19.900 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:19.900 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:19.900 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:19.900 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:19.900 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 78992 2024-04-19T03:02:19.900 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.900 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:19.900 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.900 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:19.900 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.008888+0000", 2024-04-19T03:02:19.900 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:19.900 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.900 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.900 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:19.901 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.008888+0000", 2024-04-19T03:02:19.901 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:19.901 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.901 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.901 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:19.901 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.008888+0000", 2024-04-19T03:02:19.901 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:19.901 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.901 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.901 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:19.901 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.008928+0000", 2024-04-19T03:02:19.901 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0361999999999997e-05 2024-04-19T03:02:19.901 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.901 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.902 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:19.902 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.008942+0000", 2024-04-19T03:02:19.902 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4365000000000001e-05 2024-04-19T03:02:19.902 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.902 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.902 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:19.902 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.008949+0000", 2024-04-19T03:02:19.902 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.212e-06 2024-04-19T03:02:19.902 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.902 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.902 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:19.902 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.012683+0000", 2024-04-19T03:02:19.902 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.003733934 2024-04-19T03:02:19.902 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.903 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.903 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:19.903 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.012798+0000", 2024-04-19T03:02:19.903 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00011574999999999999 2024-04-19T03:02:19.903 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.903 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.903 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:19.903 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.012896+0000", 2024-04-19T03:02:19.903 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.7848000000000002e-05 2024-04-19T03:02:19.903 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.903 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.903 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:19.903 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016423+0000", 2024-04-19T03:02:19.903 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0035270789999999998 2024-04-19T03:02:19.904 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.904 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.904 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:19.904 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.065098+0000", 2024-04-19T03:02:19.904 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.048674651999999999 2024-04-19T03:02:19.904 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.904 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.904 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:19.904 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.065193+0000", 2024-04-19T03:02:19.904 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.5087999999999995e-05 2024-04-19T03:02:19.904 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.904 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.904 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:19.904 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.065264+0000", 2024-04-19T03:02:19.904 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0666000000000004e-05 2024-04-19T03:02:19.905 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:19.905 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:19.905 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:19.905 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.905 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.905 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:78998 5.7 5:ee23c1bc:::benchmark_data_smithi096_19531_object78997:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-19T03:02:19.905 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:18.013165+0000", 2024-04-19T03:02:19.905 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 1.8202162770000001, 2024-04-19T03:02:19.905 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.052410864000000001, 2024-04-19T03:02:19.905 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:19.905 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:19.905 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:19.905 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:19.905 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:19.906 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 78998 2024-04-19T03:02:19.906 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.906 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:19.906 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.906 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:19.906 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.013165+0000", 2024-04-19T03:02:19.906 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:19.906 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.906 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.906 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:19.906 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.013165+0000", 2024-04-19T03:02:19.906 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:19.906 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.906 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.906 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:19.907 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.013164+0000", 2024-04-19T03:02:19.907 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:19.907 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.907 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.907 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:19.907 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.013214+0000", 2024-04-19T03:02:19.907 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9636999999999999e-05 2024-04-19T03:02:19.907 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.907 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.907 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:19.907 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.013223+0000", 2024-04-19T03:02:19.907 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.3619999999999995e-06 2024-04-19T03:02:19.907 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.907 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.908 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:19.908 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.013229+0000", 2024-04-19T03:02:19.908 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6060000000000002e-06 2024-04-19T03:02:19.908 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.908 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.908 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:19.908 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.014882+0000", 2024-04-19T03:02:19.908 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001653257 2024-04-19T03:02:19.908 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.908 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.908 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:19.908 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.014958+0000", 2024-04-19T03:02:19.908 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6398999999999998e-05 2024-04-19T03:02:19.908 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.909 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.909 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:19.909 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.015036+0000", 2024-04-19T03:02:19.909 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8070000000000003e-05 2024-04-19T03:02:19.909 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.909 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.909 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:19.909 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018099+0000", 2024-04-19T03:02:19.909 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0030631149999999999 2024-04-19T03:02:19.909 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.909 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.909 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:19.909 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.065328+0000", 2024-04-19T03:02:19.909 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.047228349000000003 2024-04-19T03:02:19.910 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.910 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.910 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:19.910 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.065508+0000", 2024-04-19T03:02:19.910 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00018036899999999999 2024-04-19T03:02:19.910 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.910 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.910 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:19.910 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.065576+0000", 2024-04-19T03:02:19.910 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7785000000000002e-05 2024-04-19T03:02:19.910 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:19.910 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:19.910 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:19.910 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.911 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.911 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4755.0:78995 5.2 e40/39 5:42b55e12:::benchmark_data_smithi096_19531_object78994:head v 40'4934, mlcod=40'4932)", 2024-04-19T03:02:19.911 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:18.016247+0000", 2024-04-19T03:02:19.911 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 1.8171343150000001, 2024-04-19T03:02:19.911 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.056240406, 2024-04-19T03:02:19.911 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:19.911 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:19.911 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:19.911 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.911 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:19.911 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016247+0000", 2024-04-19T03:02:19.911 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:19.911 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.912 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.912 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:19.912 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016247+0000", 2024-04-19T03:02:19.912 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:19.912 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.912 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.912 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:19.912 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016246+0000", 2024-04-19T03:02:19.912 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:19.912 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.912 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.912 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:19.912 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016315+0000", 2024-04-19T03:02:19.912 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8979000000000005e-05 2024-04-19T03:02:19.913 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.913 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.913 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:19.913 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016333+0000", 2024-04-19T03:02:19.913 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7586999999999999e-05 2024-04-19T03:02:19.913 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.913 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.913 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:19.913 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016340+0000", 2024-04-19T03:02:19.913 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4080000000000001e-06 2024-04-19T03:02:19.913 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.913 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.913 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:19.913 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016384+0000", 2024-04-19T03:02:19.914 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3656999999999999e-05 2024-04-19T03:02:19.914 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.914 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.914 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:19.914 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016403+0000", 2024-04-19T03:02:19.914 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9089e-05 2024-04-19T03:02:19.914 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.914 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.914 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:19.914 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.072448+0000", 2024-04-19T03:02:19.914 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.056045084000000002 2024-04-19T03:02:19.914 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.914 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.915 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:19.915 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.072487+0000", 2024-04-19T03:02:19.915 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9362e-05 2024-04-19T03:02:19.915 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:19.915 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:19.915 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:19.915 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.915 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.915 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4755.0:78994 5.c e40/22 5:3c60d55d:::benchmark_data_smithi096_19531_object78993:head v 40'4989, mlcod=40'4987)", 2024-04-19T03:02:19.915 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:18.016392+0000", 2024-04-19T03:02:19.915 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 1.816989674, 2024-04-19T03:02:19.915 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.052629620000000002, 2024-04-19T03:02:19.915 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:19.916 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:19.916 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:19.916 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.916 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:19.916 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016392+0000", 2024-04-19T03:02:19.916 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:19.916 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.916 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.916 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:19.916 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016392+0000", 2024-04-19T03:02:19.916 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:19.916 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.916 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.916 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:19.917 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016391+0000", 2024-04-19T03:02:19.917 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:19.917 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.917 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.917 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:19.917 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016471+0000", 2024-04-19T03:02:19.917 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9346999999999998e-05 2024-04-19T03:02:19.917 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.917 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.917 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:19.917 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016478+0000", 2024-04-19T03:02:19.917 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.593e-06 2024-04-19T03:02:19.917 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.917 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.917 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:19.918 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016495+0000", 2024-04-19T03:02:19.918 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6492999999999999e-05 2024-04-19T03:02:19.918 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.918 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.918 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:19.918 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016539+0000", 2024-04-19T03:02:19.918 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4715999999999997e-05 2024-04-19T03:02:19.918 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.918 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.918 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:19.918 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016551+0000", 2024-04-19T03:02:19.918 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2096000000000001e-05 2024-04-19T03:02:19.918 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.918 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.919 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:19.919 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.068985+0000", 2024-04-19T03:02:19.919 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.052433754999999999 2024-04-19T03:02:19.919 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.919 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.919 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:19.919 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.069021+0000", 2024-04-19T03:02:19.919 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6047000000000002e-05 2024-04-19T03:02:19.919 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:19.919 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:19.919 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:19.919 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.919 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.919 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4755.0:78997 5.5 e40/22 5:a5289197:::benchmark_data_smithi096_19531_object78996:head v 40'4896, mlcod=40'4894)", 2024-04-19T03:02:19.920 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:18.016507+0000", 2024-04-19T03:02:19.920 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 1.8168738310000001, 2024-04-19T03:02:19.920 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.049953264999999997, 2024-04-19T03:02:19.920 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:19.920 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:19.920 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:19.920 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.920 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:19.920 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016507+0000", 2024-04-19T03:02:19.920 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:19.920 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.920 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.920 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:19.920 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016507+0000", 2024-04-19T03:02:19.921 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:19.921 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.921 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.921 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:19.921 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016507+0000", 2024-04-19T03:02:19.921 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:19.921 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.921 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.921 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:19.921 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016551+0000", 2024-04-19T03:02:19.921 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3412999999999999e-05 2024-04-19T03:02:19.921 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.921 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.921 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:19.922 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016558+0000", 2024-04-19T03:02:19.922 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.002e-06 2024-04-19T03:02:19.922 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.922 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.922 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:19.922 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016563+0000", 2024-04-19T03:02:19.922 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7509999999999997e-06 2024-04-19T03:02:19.922 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.922 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.922 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:19.922 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016604+0000", 2024-04-19T03:02:19.922 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0426999999999998e-05 2024-04-19T03:02:19.922 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.923 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.923 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:19.923 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016615+0000", 2024-04-19T03:02:19.923 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1466e-05 2024-04-19T03:02:19.923 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.923 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.923 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:19.923 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.066373+0000", 2024-04-19T03:02:19.923 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.049757639999999999 2024-04-19T03:02:19.923 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.923 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.923 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:19.923 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.066461+0000", 2024-04-19T03:02:19.924 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.7884000000000001e-05 2024-04-19T03:02:19.924 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:19.924 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:19.924 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:19.924 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.924 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.924 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4755.0:78996 5.1 e40/39 5:87f59708:::benchmark_data_smithi096_19531_object78995:head v 40'4940, mlcod=40'4938)", 2024-04-19T03:02:19.924 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:18.016581+0000", 2024-04-19T03:02:19.924 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 1.8168005090000001, 2024-04-19T03:02:19.924 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.052051785000000003, 2024-04-19T03:02:19.924 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:19.924 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:19.924 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:19.925 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.925 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:19.925 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016581+0000", 2024-04-19T03:02:19.925 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:19.925 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.925 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.925 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:19.925 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016581+0000", 2024-04-19T03:02:19.925 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:19.925 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.925 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.925 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:19.925 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016581+0000", 2024-04-19T03:02:19.926 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:19.926 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.926 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.926 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:19.926 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016610+0000", 2024-04-19T03:02:19.926 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9556999999999998e-05 2024-04-19T03:02:19.926 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.926 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.926 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:19.926 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016616+0000", 2024-04-19T03:02:19.926 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1090000000000003e-06 2024-04-19T03:02:19.926 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.927 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.927 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:19.927 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016621+0000", 2024-04-19T03:02:19.927 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.454e-06 2024-04-19T03:02:19.927 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.927 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.927 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:19.927 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016663+0000", 2024-04-19T03:02:19.927 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2582e-05 2024-04-19T03:02:19.927 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.927 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.927 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:19.927 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016681+0000", 2024-04-19T03:02:19.927 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7680999999999999e-05 2024-04-19T03:02:19.928 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.928 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.928 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:19.928 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.068486+0000", 2024-04-19T03:02:19.928 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.051804624000000001 2024-04-19T03:02:19.928 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.928 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.928 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:19.928 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.068633+0000", 2024-04-19T03:02:19.928 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00014709099999999999 2024-04-19T03:02:19.928 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:19.928 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:19.928 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:19.928 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.929 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.929 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4755.0:78999 5.3 e40/22 5:c9ec5f7f:::benchmark_data_smithi096_19531_object78998:head v 40'4893, mlcod=40'4889)", 2024-04-19T03:02:19.929 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:18.016633+0000", 2024-04-19T03:02:19.929 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 1.816748654, 2024-04-19T03:02:19.929 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.051090469999999999, 2024-04-19T03:02:19.929 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:19.929 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:19.929 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:19.929 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.929 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:19.929 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016633+0000", 2024-04-19T03:02:19.929 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:19.929 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.930 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.930 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:19.930 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016633+0000", 2024-04-19T03:02:19.930 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:19.930 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.930 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.930 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:19.930 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016632+0000", 2024-04-19T03:02:19.930 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967296 2024-04-19T03:02:19.930 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.930 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.930 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:19.930 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016660+0000", 2024-04-19T03:02:19.930 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7869999999999999e-05 2024-04-19T03:02:19.931 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.931 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.931 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:19.931 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016667+0000", 2024-04-19T03:02:19.931 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0280000000000003e-06 2024-04-19T03:02:19.931 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.931 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.931 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:19.931 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016672+0000", 2024-04-19T03:02:19.931 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0069999999999997e-06 2024-04-19T03:02:19.931 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.931 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.931 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:19.931 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016725+0000", 2024-04-19T03:02:19.932 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2812000000000002e-05 2024-04-19T03:02:19.932 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.932 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.932 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:19.932 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016750+0000", 2024-04-19T03:02:19.932 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5038e-05 2024-04-19T03:02:19.932 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.932 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.932 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:19.932 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.067673+0000", 2024-04-19T03:02:19.932 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.050922350999999998 2024-04-19T03:02:19.932 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.932 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.932 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:19.933 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.067723+0000", 2024-04-19T03:02:19.933 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0586e-05 2024-04-19T03:02:19.933 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:19.933 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:19.933 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:19.933 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.933 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.933 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4755.0:79003 5.2 e40/39 5:4436e33f:::benchmark_data_smithi096_19531_object79002:head v 40'4935, mlcod=40'4932)", 2024-04-19T03:02:19.933 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:18.018102+0000", 2024-04-19T03:02:19.933 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 1.815278927, 2024-04-19T03:02:19.933 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.060023990999999999, 2024-04-19T03:02:19.933 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:19.934 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:19.934 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:19.934 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.934 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:19.934 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018102+0000", 2024-04-19T03:02:19.934 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:19.934 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.934 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.934 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:19.934 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018102+0000", 2024-04-19T03:02:19.934 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:19.934 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.934 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.934 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:19.935 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018102+0000", 2024-04-19T03:02:19.935 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:19.935 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.935 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.935 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:19.935 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018134+0000", 2024-04-19T03:02:19.935 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2722000000000003e-05 2024-04-19T03:02:19.935 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.935 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.935 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:19.935 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018145+0000", 2024-04-19T03:02:19.935 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0395e-05 2024-04-19T03:02:19.936 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.936 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.936 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:19.936 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018151+0000", 2024-04-19T03:02:19.936 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5300000000000002e-06 2024-04-19T03:02:19.936 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.936 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.936 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:19.936 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018489+0000", 2024-04-19T03:02:19.936 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00033731499999999998 2024-04-19T03:02:19.936 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.936 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.936 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:19.937 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018508+0000", 2024-04-19T03:02:19.937 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9775e-05 2024-04-19T03:02:19.937 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.937 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.937 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:19.937 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.078059+0000", 2024-04-19T03:02:19.937 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.059550171999999998 2024-04-19T03:02:19.937 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.937 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.937 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:19.937 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.078126+0000", 2024-04-19T03:02:19.937 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7773000000000003e-05 2024-04-19T03:02:19.937 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:19.937 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:19.938 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:19.938 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.938 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.938 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4755.0:79005 5.1 e40/39 5:85b46038:::benchmark_data_smithi096_19531_object79004:head v 40'4941, mlcod=40'4938)", 2024-04-19T03:02:19.938 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:18.018167+0000", 2024-04-19T03:02:19.938 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 1.815214208, 2024-04-19T03:02:19.938 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.052768941999999999, 2024-04-19T03:02:19.938 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:19.938 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:19.938 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:19.938 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.938 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:19.938 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018167+0000", 2024-04-19T03:02:19.939 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:19.939 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.939 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.939 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:19.939 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018167+0000", 2024-04-19T03:02:19.939 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:19.939 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.939 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.939 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:19.939 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018167+0000", 2024-04-19T03:02:19.939 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:19.939 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.939 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.939 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:19.939 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018196+0000", 2024-04-19T03:02:19.940 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9538000000000001e-05 2024-04-19T03:02:19.940 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.940 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.940 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:19.940 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018204+0000", 2024-04-19T03:02:19.940 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2599999999999999e-06 2024-04-19T03:02:19.940 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.940 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.940 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:19.940 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018208+0000", 2024-04-19T03:02:19.940 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8080000000000004e-06 2024-04-19T03:02:19.940 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.940 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.941 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:19.941 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.064933+0000", 2024-04-19T03:02:19.941 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.046725048999999998 2024-04-19T03:02:19.941 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.941 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.941 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:19.941 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.064964+0000", 2024-04-19T03:02:19.941 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0577000000000002e-05 2024-04-19T03:02:19.941 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.941 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.941 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:19.941 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.070815+0000", 2024-04-19T03:02:19.941 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0058510649999999999 2024-04-19T03:02:19.941 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.941 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.942 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:19.942 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.070936+0000", 2024-04-19T03:02:19.942 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00012095399999999999 2024-04-19T03:02:19.942 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:19.942 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:19.942 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:19.942 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.942 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.942 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4755.0:79006 5.3 e40/22 5:cf79182f:::benchmark_data_smithi096_19531_object79005:head v 40'4894, mlcod=40'4891)", 2024-04-19T03:02:19.942 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:18.021648+0000", 2024-04-19T03:02:19.942 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 1.8117337019999999, 2024-04-19T03:02:19.942 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.048705480000000002, 2024-04-19T03:02:19.942 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:19.943 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:19.943 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:19.943 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.943 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:19.943 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.021648+0000", 2024-04-19T03:02:19.943 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:19.943 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.943 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.943 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:19.943 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.021648+0000", 2024-04-19T03:02:19.943 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:19.943 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.943 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.944 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:19.944 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.021647+0000", 2024-04-19T03:02:19.944 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:19.944 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.944 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.944 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:19.944 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.021691+0000", 2024-04-19T03:02:19.944 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3852e-05 2024-04-19T03:02:19.944 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.944 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.944 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:19.944 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.064275+0000", 2024-04-19T03:02:19.944 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.042584135000000002 2024-04-19T03:02:19.944 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.944 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.945 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:19.945 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.064287+0000", 2024-04-19T03:02:19.945 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2437e-05 2024-04-19T03:02:19.945 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.945 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.945 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:19.945 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.064370+0000", 2024-04-19T03:02:19.945 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2924999999999996e-05 2024-04-19T03:02:19.945 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.945 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.945 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:19.945 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.064399+0000", 2024-04-19T03:02:19.945 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.8778000000000001e-05 2024-04-19T03:02:19.945 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.946 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.946 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:19.946 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.070324+0000", 2024-04-19T03:02:19.946 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0059246250000000002 2024-04-19T03:02:19.946 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:19.946 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:19.946 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:19.946 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.070353+0000", 2024-04-19T03:02:19.946 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9436000000000001e-05 2024-04-19T03:02:19.946 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:19.946 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:19.946 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:19.946 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:19.947 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:19.947 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-04-19T03:02:19.947 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-19T03:02:19.949 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:19.947+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:19.949 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T03:02:20.050 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:20.049+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:20.073 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-19T03:02:20.074 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-04-19T03:02:20.074 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:20.074 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:82346 5.8 5:1f4555b1:::benchmark_data_smithi096_19531_object82345:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-19T03:02:20.074 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:20.065126+0000", 2024-04-19T03:02:20.074 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0091141820000000002, 2024-04-19T03:02:20.074 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0091341830000000006, 2024-04-19T03:02:20.074 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:20.074 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:02:20.074 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:20.074 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:20.074 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:20.074 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 82346 2024-04-19T03:02:20.075 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:20.075 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:20.075 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:20.075 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:20.075 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:20.065126+0000", 2024-04-19T03:02:20.075 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:20.075 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:20.075 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:20.075 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:20.075 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:20.065126+0000", 2024-04-19T03:02:20.075 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:20.075 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:20.075 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:20.076 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:20.076 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:20.065125+0000", 2024-04-19T03:02:20.076 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:20.076 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:20.076 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:20.076 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:20.076 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:20.065178+0000", 2024-04-19T03:02:20.076 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3396000000000002e-05 2024-04-19T03:02:20.076 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:20.076 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:20.076 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:20.076 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:20.065194+0000", 2024-04-19T03:02:20.076 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6167999999999998e-05 2024-04-19T03:02:20.077 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:20.077 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:20.077 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:20.077 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:20.065202+0000", 2024-04-19T03:02:20.077 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.8509999999999999e-06 2024-04-19T03:02:20.077 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:20.077 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:20.077 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:20.077 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:20.067113+0000", 2024-04-19T03:02:20.077 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0019105350000000001 2024-04-19T03:02:20.077 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:20.077 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:20.077 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:20.077 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:20.067259+0000", 2024-04-19T03:02:20.078 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000145737 2024-04-19T03:02:20.078 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:20.078 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:20.078 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:20.078 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:20.067432+0000", 2024-04-19T03:02:20.078 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000173182 2024-04-19T03:02:20.078 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:20.078 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:20.078 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:20.078 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:20.073271+0000", 2024-04-19T03:02:20.078 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0058395849999999996 2024-04-19T03:02:20.078 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:20.078 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:20.079 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:20.079 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:20.079 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:20.079 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:82351 5.4 5:2020a671:::benchmark_data_smithi096_19531_object82350:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-19T03:02:20.079 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:20.066556+0000", 2024-04-19T03:02:20.079 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0076838899999999996, 2024-04-19T03:02:20.079 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0077524569999999999, 2024-04-19T03:02:20.079 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:20.079 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:02:20.079 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:20.079 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:20.079 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:20.079 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 82351 2024-04-19T03:02:20.079 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:20.080 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:20.080 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:20.080 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:20.080 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:20.066556+0000", 2024-04-19T03:02:20.080 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:20.080 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:20.080 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:20.080 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:20.080 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:20.066556+0000", 2024-04-19T03:02:20.080 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:20.080 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:20.080 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:20.080 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:20.080 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:20.066555+0000", 2024-04-19T03:02:20.081 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:20.081 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:20.081 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:20.081 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:20.081 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:20.066606+0000", 2024-04-19T03:02:20.081 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0515e-05 2024-04-19T03:02:20.081 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:20.081 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:20.081 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:20.081 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:20.066631+0000", 2024-04-19T03:02:20.081 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.495e-05 2024-04-19T03:02:20.081 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:20.082 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:20.082 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:20.082 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:20.066642+0000", 2024-04-19T03:02:20.082 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1212e-05 2024-04-19T03:02:20.082 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:20.082 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:20.082 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:20.082 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:20.066695+0000", 2024-04-19T03:02:20.082 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2703e-05 2024-04-19T03:02:20.082 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:20.082 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:20.082 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:20.082 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:20.066886+0000", 2024-04-19T03:02:20.083 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000190841 2024-04-19T03:02:20.083 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:20.083 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:20.083 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:20.083 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:20.067006+0000", 2024-04-19T03:02:20.083 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000120845 2024-04-19T03:02:20.083 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:20.083 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:20.083 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:20.083 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:20.073418+0000", 2024-04-19T03:02:20.083 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0064115810000000004 2024-04-19T03:02:20.083 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:20.084 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:20.084 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:20.084 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:20.084 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-04-19T03:02:20.084 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 2 2024-04-19T03:02:20.084 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-19T03:02:20.087 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T03:02:20.100 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0: {} 2024-04-19T03:02:20.122 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1: {} 2024-04-19T03:02:20.142 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2: {} 2024-04-19T03:02:20.144 INFO:teuthology.orchestra.run.smithi096.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T03:02:20.144 INFO:teuthology.orchestra.run.smithi096.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-19T03:02:20.144 INFO:teuthology.orchestra.run.smithi096.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-19T03:02:20.151 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:20.147+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:20.210 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-19T03:02:20.210 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:02:20.223 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T03:02:20.268 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:20.267+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:20.270 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-19T03:02:20.348 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-19T03:02:20.348 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:02:20.354 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:20.353+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:20.361 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T03:02:20.455 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:20.453+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:20.485 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-04-19T03:02:20.485 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:02:20.498 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T03:02:20.556 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:20.555+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:20.616 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-04-19T03:02:20.617 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:02:20.629 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T03:02:20.657 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:20.655+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:20.754 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-04-19T03:02:20.754 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:02:20.759 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:20.757+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:20.767 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T03:02:20.824 INFO:tasks.radosbench.radosbench.0.smithi096.stdout: 43 16 83624 83608 121.509 104.625 0.0120549 0.00822383 2024-04-19T03:02:20.860 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:20.855+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:20.890 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-19T03:02:20.890 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:02:20.903 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T03:02:20.960 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:20.957+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:21.026 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-19T03:02:21.026 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:02:21.038 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T03:02:21.062 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:21.057+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:21.162 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:21.161+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:21.166 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-19T03:02:21.166 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:02:21.178 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T03:02:21.241 INFO:teuthology.orchestra.run.smithi096.stderr:nodeep-scrub is unset 2024-04-19T03:02:21.262 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:21.261+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:21.299 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-04-19T03:02:21.300 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:02:21.312 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T03:02:21.363 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:21.361+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:21.433 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-04-19T03:02:21.433 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:02:21.448 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T03:02:21.464 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:21.463+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:21.565 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:21.563+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:21.615 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-04-19T03:02:21.615 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:02:21.627 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T03:02:21.676 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:21.675+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:21.755 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-19T03:02:21.755 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:02:21.766 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:21.761+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:21.768 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T03:02:21.824 INFO:tasks.radosbench.radosbench.0.smithi096.stdout: 44 16 85312 85296 121.145 105.5 0.00501149 0.0082487 2024-04-19T03:02:21.866 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:21.865+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:21.890 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-19T03:02:21.890 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:02:21.903 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T03:02:21.967 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:21.963+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:22.028 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-19T03:02:22.028 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:02:22.040 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T03:02:22.090 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:22.089+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:22.156 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-19T03:02:22.167 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-04-19T03:02:22.167 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:02:22.169 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:22.167+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:22.179 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T03:02:22.270 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:22.269+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:22.302 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-04-19T03:02:22.303 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:02:22.315 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T03:02:22.315 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0: {} 2024-04-19T03:02:22.337 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1: {} 2024-04-19T03:02:22.357 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2: {} 2024-04-19T03:02:22.359 INFO:teuthology.orchestra.run.smithi096.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-19T03:02:22.360 INFO:teuthology.orchestra.run.smithi096.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-19T03:02:22.360 INFO:teuthology.orchestra.run.smithi096.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-19T03:02:22.371 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:22.369+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:22.446 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-04-19T03:02:22.446 INFO:teuthology.orchestra.run.smithi144.stdout: "size": 20, 2024-04-19T03:02:22.447 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 600, 2024-04-19T03:02:22.447 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [ 2024-04-19T03:02:22.447 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.447 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:8 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:02:22.447 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:01:14.998165+0000", 2024-04-19T03:02:22.447 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 67.444647872000004, 2024-04-19T03:02:22.447 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.024541001, 2024-04-19T03:02:22.447 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:22.447 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:22.447 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:22.447 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.447 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:22.447 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998165+0000", 2024-04-19T03:02:22.448 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:22.448 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.448 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.448 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:22.448 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998165+0000", 2024-04-19T03:02:22.448 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:22.448 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.448 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.448 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:22.448 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998164+0000", 2024-04-19T03:02:22.448 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:22.448 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.448 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.448 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:22.448 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998170+0000", 2024-04-19T03:02:22.449 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2939999999999996e-06 2024-04-19T03:02:22.449 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.449 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.449 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:22.449 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998179+0000", 2024-04-19T03:02:22.449 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.5540000000000003e-06 2024-04-19T03:02:22.449 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.449 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.449 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:22.449 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998188+0000", 2024-04-19T03:02:22.449 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2959999999999999e-06 2024-04-19T03:02:22.449 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.449 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.450 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:22.450 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998332+0000", 2024-04-19T03:02:22.450 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00014474 2024-04-19T03:02:22.450 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.450 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.450 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:02:22.450 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998337+0000", 2024-04-19T03:02:22.450 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6909999999999996e-06 2024-04-19T03:02:22.450 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.450 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.450 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:22.450 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.010222+0000", 2024-04-19T03:02:22.450 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011885178 2024-04-19T03:02:22.451 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.451 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.451 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:22.451 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.010342+0000", 2024-04-19T03:02:22.451 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00011991500000000001 2024-04-19T03:02:22.451 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.451 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.451 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:02:22.451 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.010506+0000", 2024-04-19T03:02:22.451 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00016429699999999999 2024-04-19T03:02:22.451 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.451 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.451 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:22.451 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.014525+0000", 2024-04-19T03:02:22.452 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0040189839999999998 2024-04-19T03:02:22.452 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.452 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.452 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:22.452 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.022600+0000", 2024-04-19T03:02:22.452 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0080741990000000007 2024-04-19T03:02:22.452 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.452 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.452 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:22.452 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.022670+0000", 2024-04-19T03:02:22.452 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0743999999999999e-05 2024-04-19T03:02:22.452 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.452 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.453 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:22.453 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.022706+0000", 2024-04-19T03:02:22.453 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5782999999999999e-05 2024-04-19T03:02:22.453 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:22.453 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:22.453 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:22.453 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.453 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.453 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:27 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:02:22.453 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:01:14.998436+0000", 2024-04-19T03:02:22.453 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 67.444377218, 2024-04-19T03:02:22.453 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.024406325999999999, 2024-04-19T03:02:22.453 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:22.453 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:22.454 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:22.454 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.454 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:22.454 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998436+0000", 2024-04-19T03:02:22.454 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:22.454 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.454 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.454 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:22.454 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998436+0000", 2024-04-19T03:02:22.454 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:22.454 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.454 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.455 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:22.455 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998435+0000", 2024-04-19T03:02:22.455 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:22.455 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.455 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.455 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:22.455 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998445+0000", 2024-04-19T03:02:22.455 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0349e-05 2024-04-19T03:02:22.455 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.455 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.455 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:22.455 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998453+0000", 2024-04-19T03:02:22.455 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0399999999999993e-06 2024-04-19T03:02:22.455 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.456 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.456 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:22.456 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998461+0000", 2024-04-19T03:02:22.456 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9780000000000005e-06 2024-04-19T03:02:22.456 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.456 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.456 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:22.456 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998515+0000", 2024-04-19T03:02:22.456 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3097999999999999e-05 2024-04-19T03:02:22.456 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.456 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.456 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:02:22.457 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998520+0000", 2024-04-19T03:02:22.457 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9220000000000002e-06 2024-04-19T03:02:22.457 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.457 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.457 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:22.457 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.011258+0000", 2024-04-19T03:02:22.457 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.012737735 2024-04-19T03:02:22.457 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.457 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.457 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:22.457 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.011566+0000", 2024-04-19T03:02:22.457 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00030826200000000001 2024-04-19T03:02:22.457 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.457 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.458 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:02:22.458 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.011996+0000", 2024-04-19T03:02:22.458 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00042912000000000001 2024-04-19T03:02:22.458 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.458 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.458 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:22.458 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.014533+0000", 2024-04-19T03:02:22.458 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.002537423 2024-04-19T03:02:22.458 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.458 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.458 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:22.458 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.022756+0000", 2024-04-19T03:02:22.458 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0082231530000000004 2024-04-19T03:02:22.458 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.459 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.459 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:22.459 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.022807+0000", 2024-04-19T03:02:22.459 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0852e-05 2024-04-19T03:02:22.459 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.459 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.459 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:22.459 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.022842+0000", 2024-04-19T03:02:22.459 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5058000000000002e-05 2024-04-19T03:02:22.459 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:22.459 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:22.459 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:22.459 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.459 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.460 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:28 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:02:22.460 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:01:14.998476+0000", 2024-04-19T03:02:22.460 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 67.444337296, 2024-04-19T03:02:22.460 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.024656784000000001, 2024-04-19T03:02:22.460 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:22.460 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:22.460 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:22.460 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.460 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:22.461 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998476+0000", 2024-04-19T03:02:22.461 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:22.461 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.461 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.461 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:22.461 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998476+0000", 2024-04-19T03:02:22.461 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:22.461 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.461 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.461 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:22.462 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998475+0000", 2024-04-19T03:02:22.462 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:22.462 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.462 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.462 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:22.462 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998484+0000", 2024-04-19T03:02:22.462 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.7770000000000008e-06 2024-04-19T03:02:22.462 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.462 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.462 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:22.462 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998495+0000", 2024-04-19T03:02:22.462 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0726e-05 2024-04-19T03:02:22.462 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.463 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.463 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:22.463 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998503+0000", 2024-04-19T03:02:22.463 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.8780000000000004e-06 2024-04-19T03:02:22.463 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.463 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.463 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:22.463 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998579+0000", 2024-04-19T03:02:22.463 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5160999999999994e-05 2024-04-19T03:02:22.463 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.463 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.463 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:02:22.463 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998586+0000", 2024-04-19T03:02:22.463 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8520000000000004e-06 2024-04-19T03:02:22.464 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.464 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.464 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:22.464 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.012423+0000", 2024-04-19T03:02:22.464 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.013836667 2024-04-19T03:02:22.464 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.464 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.464 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:22.464 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.012532+0000", 2024-04-19T03:02:22.464 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000108565 2024-04-19T03:02:22.464 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.464 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.465 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:02:22.465 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.012655+0000", 2024-04-19T03:02:22.465 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00012344600000000001 2024-04-19T03:02:22.465 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.465 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.465 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:22.465 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.015680+0000", 2024-04-19T03:02:22.465 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0030246470000000001 2024-04-19T03:02:22.465 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.465 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.465 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:22.465 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.023091+0000", 2024-04-19T03:02:22.465 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0074116030000000001 2024-04-19T03:02:22.466 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.466 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.466 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:22.466 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.023115+0000", 2024-04-19T03:02:22.466 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.3091999999999998e-05 2024-04-19T03:02:22.466 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.466 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.466 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:22.466 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.023132+0000", 2024-04-19T03:02:22.466 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7901999999999999e-05 2024-04-19T03:02:22.466 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:22.466 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:22.466 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:22.467 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.467 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.467 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:29 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:02:22.467 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:01:14.998527+0000", 2024-04-19T03:02:22.467 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 67.444285755999999, 2024-04-19T03:02:22.467 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.024738599999999999, 2024-04-19T03:02:22.467 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:22.467 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:22.467 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:22.467 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.467 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:22.467 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998527+0000", 2024-04-19T03:02:22.467 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:22.467 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.468 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.468 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:22.468 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998527+0000", 2024-04-19T03:02:22.468 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:22.468 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.468 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.468 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:22.468 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998527+0000", 2024-04-19T03:02:22.468 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:22.468 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.468 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.468 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:22.468 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998531+0000", 2024-04-19T03:02:22.468 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9450000000000001e-06 2024-04-19T03:02:22.469 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.469 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.469 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:22.469 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998541+0000", 2024-04-19T03:02:22.469 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.4320000000000005e-06 2024-04-19T03:02:22.469 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.469 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.469 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:22.469 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998548+0000", 2024-04-19T03:02:22.469 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.221e-06 2024-04-19T03:02:22.470 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.470 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.470 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:22.470 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998620+0000", 2024-04-19T03:02:22.470 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.1676999999999998e-05 2024-04-19T03:02:22.470 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.470 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.470 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:02:22.470 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998624+0000", 2024-04-19T03:02:22.470 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4850000000000003e-06 2024-04-19T03:02:22.471 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.471 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.471 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:22.471 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.013261+0000", 2024-04-19T03:02:22.471 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.014636451999999999 2024-04-19T03:02:22.471 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.471 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.471 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:22.471 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.013364+0000", 2024-04-19T03:02:22.471 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000102885 2024-04-19T03:02:22.471 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.471 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.471 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:02:22.472 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.013481+0000", 2024-04-19T03:02:22.472 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00011783299999999999 2024-04-19T03:02:22.472 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.472 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.472 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:22.472 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.016265+0000", 2024-04-19T03:02:22.472 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0027834539999999999 2024-04-19T03:02:22.472 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.472 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.472 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:22.472 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.023180+0000", 2024-04-19T03:02:22.472 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0069149399999999996 2024-04-19T03:02:22.472 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.472 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.473 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:22.473 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.023230+0000", 2024-04-19T03:02:22.473 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0220999999999999e-05 2024-04-19T03:02:22.473 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.473 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.473 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:22.473 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.023266+0000", 2024-04-19T03:02:22.473 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5703e-05 2024-04-19T03:02:22.473 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:22.473 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:22.473 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:22.473 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.473 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.474 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:30 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:02:22.474 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:01:14.998577+0000", 2024-04-19T03:02:22.474 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 67.444235649000007, 2024-04-19T03:02:22.474 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.024774022999999999, 2024-04-19T03:02:22.474 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:22.474 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:22.474 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:22.474 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.474 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:22.474 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998577+0000", 2024-04-19T03:02:22.474 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:22.474 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.475 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.475 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:22.475 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998577+0000", 2024-04-19T03:02:22.475 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:22.475 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.475 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.475 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:22.475 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998576+0000", 2024-04-19T03:02:22.475 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:22.475 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.475 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.475 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:22.475 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998583+0000", 2024-04-19T03:02:22.476 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8850000000000001e-06 2024-04-19T03:02:22.476 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.476 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.476 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:22.476 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998597+0000", 2024-04-19T03:02:22.476 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.362e-05 2024-04-19T03:02:22.476 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.476 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.476 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:22.476 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998607+0000", 2024-04-19T03:02:22.477 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0389e-05 2024-04-19T03:02:22.477 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.477 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.477 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:22.477 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998713+0000", 2024-04-19T03:02:22.477 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000105338 2024-04-19T03:02:22.477 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.477 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.477 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:02:22.477 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998720+0000", 2024-04-19T03:02:22.477 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2370000000000003e-06 2024-04-19T03:02:22.477 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.478 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.478 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:22.478 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.014014+0000", 2024-04-19T03:02:22.478 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.015294116999999999 2024-04-19T03:02:22.478 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.478 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.478 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:22.478 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.014091+0000", 2024-04-19T03:02:22.478 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7148000000000001e-05 2024-04-19T03:02:22.478 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.478 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.478 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:02:22.479 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.014271+0000", 2024-04-19T03:02:22.479 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00017962699999999999 2024-04-19T03:02:22.479 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.479 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.479 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:22.479 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.018024+0000", 2024-04-19T03:02:22.479 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0037529809999999999 2024-04-19T03:02:22.479 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.479 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.479 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:22.479 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.023303+0000", 2024-04-19T03:02:22.479 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0052793099999999997 2024-04-19T03:02:22.479 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.480 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.480 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:22.480 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.023331+0000", 2024-04-19T03:02:22.480 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.8013000000000001e-05 2024-04-19T03:02:22.480 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.480 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.480 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:22.480 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.023351+0000", 2024-04-19T03:02:22.480 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0225999999999999e-05 2024-04-19T03:02:22.480 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:22.480 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:22.480 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:22.480 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.481 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.481 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:33 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:02:22.481 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:01:14.998625+0000", 2024-04-19T03:02:22.481 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 67.444188252000004, 2024-04-19T03:02:22.481 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.024007338999999999, 2024-04-19T03:02:22.481 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:22.481 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:22.481 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:22.481 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.481 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:22.481 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998625+0000", 2024-04-19T03:02:22.481 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:22.481 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.481 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.482 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:22.482 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998625+0000", 2024-04-19T03:02:22.482 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:22.482 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.482 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.482 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:22.482 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998623+0000", 2024-04-19T03:02:22.482 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:22.482 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.482 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.482 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:22.482 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998632+0000", 2024-04-19T03:02:22.483 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9279999999999999e-06 2024-04-19T03:02:22.483 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.483 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.483 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:22.483 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998642+0000", 2024-04-19T03:02:22.483 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0063e-05 2024-04-19T03:02:22.483 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.483 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.483 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:22.483 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998649+0000", 2024-04-19T03:02:22.483 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4799999999999998e-06 2024-04-19T03:02:22.483 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.484 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.484 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:22.484 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998730+0000", 2024-04-19T03:02:22.484 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.1514999999999995e-05 2024-04-19T03:02:22.484 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.484 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.484 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:02:22.484 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998741+0000", 2024-04-19T03:02:22.484 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1029999999999999e-05 2024-04-19T03:02:22.484 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.484 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.484 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:22.485 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.010202+0000", 2024-04-19T03:02:22.485 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011460529000000001 2024-04-19T03:02:22.485 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.485 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.485 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:22.485 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.010292+0000", 2024-04-19T03:02:22.485 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.0382000000000003e-05 2024-04-19T03:02:22.485 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.485 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.485 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:02:22.485 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.010391+0000", 2024-04-19T03:02:22.485 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.8491000000000003e-05 2024-04-19T03:02:22.485 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.485 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.486 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:22.486 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.013800+0000", 2024-04-19T03:02:22.486 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0034090219999999998 2024-04-19T03:02:22.486 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.486 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.486 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:22.486 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.022564+0000", 2024-04-19T03:02:22.486 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0087639950000000001 2024-04-19T03:02:22.486 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.486 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.486 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:22.486 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.022601+0000", 2024-04-19T03:02:22.486 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7363999999999997e-05 2024-04-19T03:02:22.487 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.487 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.487 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:22.487 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.022632+0000", 2024-04-19T03:02:22.487 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0917000000000002e-05 2024-04-19T03:02:22.487 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:22.487 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:22.487 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:22.487 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.487 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.487 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:02:22.487 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:01:14.998870+0000", 2024-04-19T03:02:22.487 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 67.443943181999998, 2024-04-19T03:02:22.488 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.024280578000000001, 2024-04-19T03:02:22.488 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:22.488 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:22.488 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:22.488 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.488 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:22.488 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998870+0000", 2024-04-19T03:02:22.488 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:22.488 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.488 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.488 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:22.488 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998870+0000", 2024-04-19T03:02:22.488 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:22.488 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.489 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.489 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:22.489 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998869+0000", 2024-04-19T03:02:22.489 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:22.489 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.489 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.489 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:22.489 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998879+0000", 2024-04-19T03:02:22.489 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.8689999999999999e-06 2024-04-19T03:02:22.489 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.489 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.489 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:22.489 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998893+0000", 2024-04-19T03:02:22.489 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4436999999999999e-05 2024-04-19T03:02:22.490 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.490 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.490 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:22.490 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998904+0000", 2024-04-19T03:02:22.490 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0657e-05 2024-04-19T03:02:22.490 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.490 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.490 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:22.490 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998972+0000", 2024-04-19T03:02:22.490 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8121999999999996e-05 2024-04-19T03:02:22.490 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.490 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.490 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:02:22.490 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998980+0000", 2024-04-19T03:02:22.491 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7170000000000008e-06 2024-04-19T03:02:22.491 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.491 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.491 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:22.491 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.011666+0000", 2024-04-19T03:02:22.491 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.012686507 2024-04-19T03:02:22.491 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.491 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.491 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:22.491 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.012403+0000", 2024-04-19T03:02:22.491 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00073661899999999999 2024-04-19T03:02:22.491 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.491 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.492 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:02:22.492 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.012788+0000", 2024-04-19T03:02:22.492 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00038495800000000002 2024-04-19T03:02:22.492 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.492 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.492 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:22.492 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.015713+0000", 2024-04-19T03:02:22.492 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0029255879999999998 2024-04-19T03:02:22.492 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.492 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.492 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:22.492 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.023066+0000", 2024-04-19T03:02:22.492 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.007352903 2024-04-19T03:02:22.493 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.493 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.493 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:22.493 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.023113+0000", 2024-04-19T03:02:22.493 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7163000000000002e-05 2024-04-19T03:02:22.493 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.493 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.493 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:22.493 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.023150+0000", 2024-04-19T03:02:22.493 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6881000000000001e-05 2024-04-19T03:02:22.493 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:22.493 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:22.493 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:22.493 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.494 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.494 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:20 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:02:22.494 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:01:14.999024+0000", 2024-04-19T03:02:22.494 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 67.443788909999995, 2024-04-19T03:02:22.494 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.024212818000000001, 2024-04-19T03:02:22.494 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:22.494 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-04-19T03:02:22.494 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:22.494 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.494 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:22.494 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.999024+0000", 2024-04-19T03:02:22.494 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:22.494 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.495 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.495 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:22.495 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.999024+0000", 2024-04-19T03:02:22.495 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:22.495 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.495 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.495 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:22.495 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.999023+0000", 2024-04-19T03:02:22.495 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:22.495 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.495 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.495 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:22.495 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.999029+0000", 2024-04-19T03:02:22.496 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2709999999999998e-06 2024-04-19T03:02:22.496 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.496 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.496 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:22.496 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.999045+0000", 2024-04-19T03:02:22.496 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.5840000000000001e-05 2024-04-19T03:02:22.496 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.496 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.496 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:22.496 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.999057+0000", 2024-04-19T03:02:22.496 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1897e-05 2024-04-19T03:02:22.496 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.496 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.496 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:22.497 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.999136+0000", 2024-04-19T03:02:22.497 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8842000000000002e-05 2024-04-19T03:02:22.497 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.497 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.497 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:02:22.497 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.999144+0000", 2024-04-19T03:02:22.497 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.3110000000000006e-06 2024-04-19T03:02:22.497 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.497 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.497 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:22.497 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.013338+0000", 2024-04-19T03:02:22.497 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.014194217 2024-04-19T03:02:22.497 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.497 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.498 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:22.498 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.013485+0000", 2024-04-19T03:02:22.498 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000146787 2024-04-19T03:02:22.498 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.498 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.498 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:22.498 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.023237+0000", 2024-04-19T03:02:22.498 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0097517899999999998 2024-04-19T03:02:22.498 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:22.498 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:22.498 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:22.498 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.499 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.499 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:78992 5.7 5:e6baa862:::benchmark_data_smithi096_19531_object78991:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-19T03:02:22.499 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:18.008888+0000", 2024-04-19T03:02:22.499 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4.433924577, 2024-04-19T03:02:22.499 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.056375285999999997, 2024-04-19T03:02:22.499 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:22.499 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:22.499 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:22.499 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:22.501 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:22.501 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 78992 2024-04-19T03:02:22.501 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.502 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:22.502 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.502 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:22.502 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.008888+0000", 2024-04-19T03:02:22.502 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:22.502 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.502 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.502 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:22.502 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.008888+0000", 2024-04-19T03:02:22.502 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:22.502 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.502 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.502 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:22.502 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.008888+0000", 2024-04-19T03:02:22.503 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:22.503 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.503 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.503 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:22.503 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.008928+0000", 2024-04-19T03:02:22.503 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0361999999999997e-05 2024-04-19T03:02:22.503 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.503 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.503 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:22.503 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.008942+0000", 2024-04-19T03:02:22.503 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4365000000000001e-05 2024-04-19T03:02:22.503 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.503 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.503 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:22.504 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.008949+0000", 2024-04-19T03:02:22.504 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.212e-06 2024-04-19T03:02:22.504 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.504 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.504 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:22.504 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.012683+0000", 2024-04-19T03:02:22.504 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.003733934 2024-04-19T03:02:22.504 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.504 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.504 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:22.504 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.012798+0000", 2024-04-19T03:02:22.504 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00011574999999999999 2024-04-19T03:02:22.504 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.504 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.505 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:22.505 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.012896+0000", 2024-04-19T03:02:22.505 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.7848000000000002e-05 2024-04-19T03:02:22.505 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.505 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.505 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:22.505 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016423+0000", 2024-04-19T03:02:22.505 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0035270789999999998 2024-04-19T03:02:22.505 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.505 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.505 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:22.505 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.065098+0000", 2024-04-19T03:02:22.505 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.048674651999999999 2024-04-19T03:02:22.505 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.506 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.506 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:22.506 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.065193+0000", 2024-04-19T03:02:22.506 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.5087999999999995e-05 2024-04-19T03:02:22.506 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.506 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.506 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:22.506 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.065264+0000", 2024-04-19T03:02:22.506 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0666000000000004e-05 2024-04-19T03:02:22.506 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:22.506 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:22.506 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:22.506 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.506 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.507 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:78998 5.7 5:ee23c1bc:::benchmark_data_smithi096_19531_object78997:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-19T03:02:22.507 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:18.013165+0000", 2024-04-19T03:02:22.507 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4.4296478710000002, 2024-04-19T03:02:22.507 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.052410864000000001, 2024-04-19T03:02:22.507 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:22.507 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:22.507 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:22.507 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:22.507 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:22.507 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 78998 2024-04-19T03:02:22.507 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.507 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:22.507 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.508 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:22.508 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.013165+0000", 2024-04-19T03:02:22.508 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:22.508 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.508 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.508 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:22.508 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.013165+0000", 2024-04-19T03:02:22.508 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:22.508 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.508 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.508 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:22.508 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.013164+0000", 2024-04-19T03:02:22.508 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:22.508 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.509 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.509 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:22.509 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.013214+0000", 2024-04-19T03:02:22.509 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9636999999999999e-05 2024-04-19T03:02:22.509 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.509 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.509 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:22.509 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.013223+0000", 2024-04-19T03:02:22.509 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.3619999999999995e-06 2024-04-19T03:02:22.509 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.509 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.509 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:22.509 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.013229+0000", 2024-04-19T03:02:22.509 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6060000000000002e-06 2024-04-19T03:02:22.510 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.510 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.510 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:22.510 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.014882+0000", 2024-04-19T03:02:22.510 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001653257 2024-04-19T03:02:22.510 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.510 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.510 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:22.510 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.014958+0000", 2024-04-19T03:02:22.510 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6398999999999998e-05 2024-04-19T03:02:22.510 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.510 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.510 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:22.511 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.015036+0000", 2024-04-19T03:02:22.511 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8070000000000003e-05 2024-04-19T03:02:22.511 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.511 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.511 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:22.511 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018099+0000", 2024-04-19T03:02:22.511 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0030631149999999999 2024-04-19T03:02:22.511 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.511 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.511 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:22.511 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.065328+0000", 2024-04-19T03:02:22.511 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.047228349000000003 2024-04-19T03:02:22.511 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.511 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.512 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:22.512 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.065508+0000", 2024-04-19T03:02:22.512 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00018036899999999999 2024-04-19T03:02:22.512 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.512 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.512 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:22.512 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.065576+0000", 2024-04-19T03:02:22.512 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7785000000000002e-05 2024-04-19T03:02:22.512 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:22.512 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:22.512 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:22.512 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.512 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.512 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4755.0:78995 5.2 e40/39 5:42b55e12:::benchmark_data_smithi096_19531_object78994:head v 40'4934, mlcod=40'4932)", 2024-04-19T03:02:22.513 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:18.016247+0000", 2024-04-19T03:02:22.513 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4.4265659089999998, 2024-04-19T03:02:22.513 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.056240406, 2024-04-19T03:02:22.513 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:22.513 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:22.513 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:22.513 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.513 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:22.513 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016247+0000", 2024-04-19T03:02:22.513 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:22.513 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.513 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.513 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:22.514 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016247+0000", 2024-04-19T03:02:22.514 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:22.514 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.514 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.514 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:22.514 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016246+0000", 2024-04-19T03:02:22.514 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:22.514 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.514 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.514 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:22.514 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016315+0000", 2024-04-19T03:02:22.514 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8979000000000005e-05 2024-04-19T03:02:22.514 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.515 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.515 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:22.515 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016333+0000", 2024-04-19T03:02:22.515 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7586999999999999e-05 2024-04-19T03:02:22.515 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.515 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.515 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:22.515 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016340+0000", 2024-04-19T03:02:22.515 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4080000000000001e-06 2024-04-19T03:02:22.515 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.515 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.515 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:22.515 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016384+0000", 2024-04-19T03:02:22.515 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3656999999999999e-05 2024-04-19T03:02:22.516 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.516 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.516 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:22.516 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016403+0000", 2024-04-19T03:02:22.516 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9089e-05 2024-04-19T03:02:22.516 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.516 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.516 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:22.516 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.072448+0000", 2024-04-19T03:02:22.516 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.056045084000000002 2024-04-19T03:02:22.516 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.516 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.516 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:22.517 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.072487+0000", 2024-04-19T03:02:22.517 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9362e-05 2024-04-19T03:02:22.517 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:22.517 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:22.517 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:22.517 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.517 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.517 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4755.0:78994 5.c e40/22 5:3c60d55d:::benchmark_data_smithi096_19531_object78993:head v 40'4989, mlcod=40'4987)", 2024-04-19T03:02:22.517 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:18.016392+0000", 2024-04-19T03:02:22.517 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4.4264212680000004, 2024-04-19T03:02:22.517 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.052629620000000002, 2024-04-19T03:02:22.517 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:22.517 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:22.517 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:22.518 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.518 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:22.518 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016392+0000", 2024-04-19T03:02:22.518 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:22.518 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.518 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.518 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:22.518 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016392+0000", 2024-04-19T03:02:22.518 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:22.518 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.518 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.518 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:22.518 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016391+0000", 2024-04-19T03:02:22.519 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:22.519 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.519 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.519 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:22.519 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016471+0000", 2024-04-19T03:02:22.519 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9346999999999998e-05 2024-04-19T03:02:22.519 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.519 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.519 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:22.519 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016478+0000", 2024-04-19T03:02:22.519 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.593e-06 2024-04-19T03:02:22.519 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.519 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.519 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:22.520 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016495+0000", 2024-04-19T03:02:22.520 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6492999999999999e-05 2024-04-19T03:02:22.520 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.520 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.520 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:22.520 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016539+0000", 2024-04-19T03:02:22.520 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4715999999999997e-05 2024-04-19T03:02:22.520 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.520 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.520 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:22.520 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016551+0000", 2024-04-19T03:02:22.520 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2096000000000001e-05 2024-04-19T03:02:22.520 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.521 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.521 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:22.521 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.068985+0000", 2024-04-19T03:02:22.521 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.052433754999999999 2024-04-19T03:02:22.521 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.521 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.521 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:22.521 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.069021+0000", 2024-04-19T03:02:22.521 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6047000000000002e-05 2024-04-19T03:02:22.521 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:22.521 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:22.521 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:22.521 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.522 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.522 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4755.0:78997 5.5 e40/22 5:a5289197:::benchmark_data_smithi096_19531_object78996:head v 40'4896, mlcod=40'4894)", 2024-04-19T03:02:22.522 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:18.016507+0000", 2024-04-19T03:02:22.522 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4.4263054249999998, 2024-04-19T03:02:22.522 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.049953264999999997, 2024-04-19T03:02:22.522 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:22.522 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:22.522 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:22.522 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.522 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:22.522 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016507+0000", 2024-04-19T03:02:22.522 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:22.522 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.523 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.523 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:22.523 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016507+0000", 2024-04-19T03:02:22.523 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:22.523 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.523 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.523 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:22.523 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016507+0000", 2024-04-19T03:02:22.523 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:22.523 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.523 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.523 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:22.523 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016551+0000", 2024-04-19T03:02:22.524 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3412999999999999e-05 2024-04-19T03:02:22.524 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.524 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.524 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:22.524 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016558+0000", 2024-04-19T03:02:22.524 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.002e-06 2024-04-19T03:02:22.524 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.524 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.524 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:22.524 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016563+0000", 2024-04-19T03:02:22.524 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7509999999999997e-06 2024-04-19T03:02:22.524 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.524 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.525 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:22.525 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016604+0000", 2024-04-19T03:02:22.525 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0426999999999998e-05 2024-04-19T03:02:22.525 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.525 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.525 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:22.525 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016615+0000", 2024-04-19T03:02:22.525 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1466e-05 2024-04-19T03:02:22.525 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.525 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.525 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:22.525 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.066373+0000", 2024-04-19T03:02:22.525 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.049757639999999999 2024-04-19T03:02:22.526 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.526 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.526 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:22.526 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.066461+0000", 2024-04-19T03:02:22.526 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.7884000000000001e-05 2024-04-19T03:02:22.526 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:22.526 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:22.526 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:22.526 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.526 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.526 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4755.0:78996 5.1 e40/39 5:87f59708:::benchmark_data_smithi096_19531_object78995:head v 40'4940, mlcod=40'4938)", 2024-04-19T03:02:22.526 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:18.016581+0000", 2024-04-19T03:02:22.526 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4.4262321030000003, 2024-04-19T03:02:22.527 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.052051785000000003, 2024-04-19T03:02:22.527 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:22.527 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:22.527 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:22.527 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.527 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:22.527 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016581+0000", 2024-04-19T03:02:22.527 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:22.527 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.527 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.527 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:22.527 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016581+0000", 2024-04-19T03:02:22.527 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:22.527 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.528 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.528 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:22.528 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016581+0000", 2024-04-19T03:02:22.528 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:22.528 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.528 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.528 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:22.528 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016610+0000", 2024-04-19T03:02:22.528 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9556999999999998e-05 2024-04-19T03:02:22.528 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.528 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.528 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:22.528 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016616+0000", 2024-04-19T03:02:22.528 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1090000000000003e-06 2024-04-19T03:02:22.529 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.529 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.529 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:22.529 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016621+0000", 2024-04-19T03:02:22.529 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.454e-06 2024-04-19T03:02:22.529 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.529 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.529 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:22.529 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016663+0000", 2024-04-19T03:02:22.529 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2582e-05 2024-04-19T03:02:22.529 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.529 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.529 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:22.529 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016681+0000", 2024-04-19T03:02:22.530 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7680999999999999e-05 2024-04-19T03:02:22.530 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.530 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.530 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:22.530 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.068486+0000", 2024-04-19T03:02:22.530 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.051804624000000001 2024-04-19T03:02:22.530 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.530 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.530 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:22.530 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.068633+0000", 2024-04-19T03:02:22.530 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00014709099999999999 2024-04-19T03:02:22.530 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:22.530 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:22.531 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:22.531 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.531 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.531 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4755.0:78999 5.3 e40/22 5:c9ec5f7f:::benchmark_data_smithi096_19531_object78998:head v 40'4893, mlcod=40'4889)", 2024-04-19T03:02:22.531 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:18.016633+0000", 2024-04-19T03:02:22.531 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4.4261802479999997, 2024-04-19T03:02:22.531 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.051090469999999999, 2024-04-19T03:02:22.531 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:22.531 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:22.531 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:22.531 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.531 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:22.531 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016633+0000", 2024-04-19T03:02:22.532 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:22.532 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.532 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.532 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:22.532 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016633+0000", 2024-04-19T03:02:22.532 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:22.532 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.532 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.532 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:22.532 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016632+0000", 2024-04-19T03:02:22.532 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967296 2024-04-19T03:02:22.532 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.532 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.532 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:22.533 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016660+0000", 2024-04-19T03:02:22.533 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7869999999999999e-05 2024-04-19T03:02:22.533 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.533 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.533 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:22.533 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016667+0000", 2024-04-19T03:02:22.533 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0280000000000003e-06 2024-04-19T03:02:22.533 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.533 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.533 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:22.533 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016672+0000", 2024-04-19T03:02:22.533 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0069999999999997e-06 2024-04-19T03:02:22.533 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.533 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.534 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:22.534 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016725+0000", 2024-04-19T03:02:22.534 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2812000000000002e-05 2024-04-19T03:02:22.534 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.534 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.534 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:22.534 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016750+0000", 2024-04-19T03:02:22.534 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5038e-05 2024-04-19T03:02:22.534 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.534 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.534 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:22.534 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.067673+0000", 2024-04-19T03:02:22.534 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.050922350999999998 2024-04-19T03:02:22.535 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.535 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.535 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:22.535 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.067723+0000", 2024-04-19T03:02:22.535 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0586e-05 2024-04-19T03:02:22.535 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:22.535 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:22.535 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:22.535 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.535 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.535 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4755.0:79003 5.2 e40/39 5:4436e33f:::benchmark_data_smithi096_19531_object79002:head v 40'4935, mlcod=40'4932)", 2024-04-19T03:02:22.535 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:18.018102+0000", 2024-04-19T03:02:22.536 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4.4247105209999997, 2024-04-19T03:02:22.536 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.060023990999999999, 2024-04-19T03:02:22.536 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:22.536 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:22.536 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:22.536 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.536 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:22.536 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018102+0000", 2024-04-19T03:02:22.536 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:22.536 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.536 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.536 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:22.536 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018102+0000", 2024-04-19T03:02:22.537 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:22.537 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.537 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.537 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:22.537 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018102+0000", 2024-04-19T03:02:22.537 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:22.537 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.537 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.537 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:22.537 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018134+0000", 2024-04-19T03:02:22.537 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2722000000000003e-05 2024-04-19T03:02:22.537 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.537 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.537 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:22.538 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018145+0000", 2024-04-19T03:02:22.538 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0395e-05 2024-04-19T03:02:22.538 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.538 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.538 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:22.538 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018151+0000", 2024-04-19T03:02:22.538 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5300000000000002e-06 2024-04-19T03:02:22.538 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.538 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.538 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:22.538 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018489+0000", 2024-04-19T03:02:22.538 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00033731499999999998 2024-04-19T03:02:22.538 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.539 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.539 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:22.539 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018508+0000", 2024-04-19T03:02:22.539 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9775e-05 2024-04-19T03:02:22.539 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.539 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.539 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:22.539 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.078059+0000", 2024-04-19T03:02:22.539 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.059550171999999998 2024-04-19T03:02:22.539 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.539 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.539 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:22.539 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.078126+0000", 2024-04-19T03:02:22.540 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7773000000000003e-05 2024-04-19T03:02:22.540 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:22.540 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:22.540 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:22.540 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.540 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.540 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4755.0:79005 5.1 e40/39 5:85b46038:::benchmark_data_smithi096_19531_object79004:head v 40'4941, mlcod=40'4938)", 2024-04-19T03:02:22.540 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:18.018167+0000", 2024-04-19T03:02:22.540 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4.4246458019999997, 2024-04-19T03:02:22.540 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.052768941999999999, 2024-04-19T03:02:22.540 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:22.540 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:22.541 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:22.541 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.541 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:22.541 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018167+0000", 2024-04-19T03:02:22.541 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:22.541 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.541 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.541 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:22.541 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018167+0000", 2024-04-19T03:02:22.541 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:22.541 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.541 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.541 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:22.542 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018167+0000", 2024-04-19T03:02:22.542 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:22.542 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.542 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.542 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:22.542 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018196+0000", 2024-04-19T03:02:22.542 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9538000000000001e-05 2024-04-19T03:02:22.542 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.542 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.542 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:22.542 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018204+0000", 2024-04-19T03:02:22.542 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2599999999999999e-06 2024-04-19T03:02:22.542 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.543 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.543 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:22.543 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018208+0000", 2024-04-19T03:02:22.543 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8080000000000004e-06 2024-04-19T03:02:22.543 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.543 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.543 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:22.543 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.064933+0000", 2024-04-19T03:02:22.543 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.046725048999999998 2024-04-19T03:02:22.543 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.543 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.543 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:22.544 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.064964+0000", 2024-04-19T03:02:22.544 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0577000000000002e-05 2024-04-19T03:02:22.544 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.544 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.544 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:22.544 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.070815+0000", 2024-04-19T03:02:22.544 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0058510649999999999 2024-04-19T03:02:22.544 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.544 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.544 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:22.544 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.070936+0000", 2024-04-19T03:02:22.544 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00012095399999999999 2024-04-19T03:02:22.545 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:22.545 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:22.545 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:22.545 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.545 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.545 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4755.0:79006 5.3 e40/22 5:cf79182f:::benchmark_data_smithi096_19531_object79005:head v 40'4894, mlcod=40'4891)", 2024-04-19T03:02:22.545 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:18.021648+0000", 2024-04-19T03:02:22.545 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4.4211652959999999, 2024-04-19T03:02:22.545 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.048705480000000002, 2024-04-19T03:02:22.545 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:22.545 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:22.545 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:22.546 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.546 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:22.546 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.021648+0000", 2024-04-19T03:02:22.546 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:22.546 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.546 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.546 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:22.546 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.021648+0000", 2024-04-19T03:02:22.546 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:22.546 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.546 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.546 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:22.547 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.021647+0000", 2024-04-19T03:02:22.547 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:22.547 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.547 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.547 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:22.547 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.021691+0000", 2024-04-19T03:02:22.547 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3852e-05 2024-04-19T03:02:22.547 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.547 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.547 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:22.547 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.064275+0000", 2024-04-19T03:02:22.547 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.042584135000000002 2024-04-19T03:02:22.547 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.548 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.548 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:22.548 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.064287+0000", 2024-04-19T03:02:22.548 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2437e-05 2024-04-19T03:02:22.548 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.548 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.548 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:22.548 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.064370+0000", 2024-04-19T03:02:22.548 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2924999999999996e-05 2024-04-19T03:02:22.548 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.548 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.548 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:22.549 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.064399+0000", 2024-04-19T03:02:22.549 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.8778000000000001e-05 2024-04-19T03:02:22.549 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.549 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.549 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:22.549 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.070324+0000", 2024-04-19T03:02:22.549 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0059246250000000002 2024-04-19T03:02:22.549 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.549 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.549 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:22.549 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.070353+0000", 2024-04-19T03:02:22.549 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9436000000000001e-05 2024-04-19T03:02:22.549 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:22.549 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:22.550 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:22.550 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.550 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.550 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:82106 5.f 5:fc183e9a:::benchmark_data_smithi096_19531_object82105:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-19T03:02:22.550 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:19.915911+0000", 2024-04-19T03:02:22.550 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 2.5269023910000001, 2024-04-19T03:02:22.550 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.028421080000000001, 2024-04-19T03:02:22.550 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:22.550 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:22.550 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:22.550 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:22.550 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:22.550 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 82106 2024-04-19T03:02:22.551 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.551 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:22.551 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.551 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:22.551 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:19.915911+0000", 2024-04-19T03:02:22.551 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:22.551 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.551 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.551 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:22.551 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:19.915911+0000", 2024-04-19T03:02:22.551 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:22.551 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.551 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.552 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:22.552 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:19.915910+0000", 2024-04-19T03:02:22.552 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:22.552 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.552 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.552 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:22.552 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:19.915947+0000", 2024-04-19T03:02:22.552 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7931e-05 2024-04-19T03:02:22.552 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.552 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.552 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:22.552 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:19.915959+0000", 2024-04-19T03:02:22.553 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2001000000000001e-05 2024-04-19T03:02:22.553 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.553 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.553 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:22.553 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:19.915967+0000", 2024-04-19T03:02:22.553 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0090000000000007e-06 2024-04-19T03:02:22.553 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.553 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.553 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:22.553 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:19.930274+0000", 2024-04-19T03:02:22.553 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.014306591 2024-04-19T03:02:22.553 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.553 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.554 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:22.554 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:19.930440+0000", 2024-04-19T03:02:22.554 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00016622800000000001 2024-04-19T03:02:22.554 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.554 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.554 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:02:22.554 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:19.930619+0000", 2024-04-19T03:02:22.554 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000178421 2024-04-19T03:02:22.554 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.554 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.554 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:22.554 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:19.936406+0000", 2024-04-19T03:02:22.555 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0057876630000000002 2024-04-19T03:02:22.555 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.555 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.555 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:22.555 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:19.944228+0000", 2024-04-19T03:02:22.555 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0078213359999999999 2024-04-19T03:02:22.555 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.555 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.555 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:22.555 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:19.944279+0000", 2024-04-19T03:02:22.555 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1400999999999998e-05 2024-04-19T03:02:22.555 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.556 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.556 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:22.556 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:19.944332+0000", 2024-04-19T03:02:22.556 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2485999999999999e-05 2024-04-19T03:02:22.556 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:22.556 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:22.556 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:22.556 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.556 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.556 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:82110 5.f 5:f3acfb5e:::benchmark_data_smithi096_19531_object82109:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-19T03:02:22.556 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:19.918314+0000", 2024-04-19T03:02:22.556 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 2.524498672, 2024-04-19T03:02:22.556 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.026113954000000002, 2024-04-19T03:02:22.556 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:22.557 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:22.557 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:22.557 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:22.557 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:22.557 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 82110 2024-04-19T03:02:22.557 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.557 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:22.557 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.557 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:22.557 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:19.918314+0000", 2024-04-19T03:02:22.557 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:22.557 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.557 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.557 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:22.558 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:19.918314+0000", 2024-04-19T03:02:22.558 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:22.558 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.558 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.558 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:22.558 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:19.918313+0000", 2024-04-19T03:02:22.558 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:22.558 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.558 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.558 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:22.558 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:19.918365+0000", 2024-04-19T03:02:22.558 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2086999999999998e-05 2024-04-19T03:02:22.558 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.559 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.559 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:22.559 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:19.918375+0000", 2024-04-19T03:02:22.559 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.7450000000000007e-06 2024-04-19T03:02:22.559 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.559 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.559 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:22.559 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:19.918381+0000", 2024-04-19T03:02:22.559 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5099999999999998e-06 2024-04-19T03:02:22.559 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.559 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.559 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:22.559 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:19.932961+0000", 2024-04-19T03:02:22.559 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.014580492 2024-04-19T03:02:22.560 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.560 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.560 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:22.560 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:19.933113+0000", 2024-04-19T03:02:22.560 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000152027 2024-04-19T03:02:22.560 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.560 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.560 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:02:22.560 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:19.933201+0000", 2024-04-19T03:02:22.560 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.8269999999999993e-05 2024-04-19T03:02:22.560 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.560 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.560 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:22.560 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:19.944183+0000", 2024-04-19T03:02:22.561 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.010981853999999999 2024-04-19T03:02:22.561 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.561 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.561 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:22.561 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:19.944354+0000", 2024-04-19T03:02:22.561 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00017105700000000001 2024-04-19T03:02:22.561 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.561 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.561 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:22.561 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:19.944386+0000", 2024-04-19T03:02:22.561 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2036999999999998e-05 2024-04-19T03:02:22.561 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:22.561 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:22.561 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:22.562 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:19.944428+0000", 2024-04-19T03:02:22.562 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1792999999999998e-05 2024-04-19T03:02:22.562 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:22.562 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:22.562 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:22.562 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:22.562 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:22.562 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-04-19T03:02:22.564 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:22.559+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:22.565 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T03:02:22.664 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:22.663+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:22.676 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-19T03:02:22.677 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-04-19T03:02:22.677 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:22.677 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:86620 5.b 5:d80faa68:::benchmark_data_smithi096_19531_object86619:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:22.677 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:22.635110+0000", 2024-04-19T03:02:22.677 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.041630161999999998, 2024-04-19T03:02:22.677 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.041687148, 2024-04-19T03:02:22.677 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:22.677 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:02:22.677 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:22.677 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:22.677 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:22.677 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 86620 2024-04-19T03:02:22.678 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:22.678 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:22.678 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:22.678 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:22.678 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635110+0000", 2024-04-19T03:02:22.678 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:22.678 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:22.678 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:22.678 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:22.678 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635110+0000", 2024-04-19T03:02:22.678 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:22.678 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:22.679 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:22.679 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:22.679 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635110+0000", 2024-04-19T03:02:22.679 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:22.679 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:22.679 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:22.679 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:22.679 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635154+0000", 2024-04-19T03:02:22.679 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4681000000000001e-05 2024-04-19T03:02:22.679 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:22.679 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:22.679 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:22.679 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635166+0000", 2024-04-19T03:02:22.680 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1505000000000001e-05 2024-04-19T03:02:22.680 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:22.680 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:22.680 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:22.680 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635171+0000", 2024-04-19T03:02:22.680 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6040000000000003e-06 2024-04-19T03:02:22.680 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:22.680 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:22.680 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:22.680 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635221+0000", 2024-04-19T03:02:22.680 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9947000000000001e-05 2024-04-19T03:02:22.680 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:22.680 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:22.680 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:22.681 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635356+0000", 2024-04-19T03:02:22.681 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013576199999999999 2024-04-19T03:02:22.681 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:22.681 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:22.681 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:22.681 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635507+0000", 2024-04-19T03:02:22.681 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015072999999999999 2024-04-19T03:02:22.681 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:22.681 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:22.681 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:22.681 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.638488+0000", 2024-04-19T03:02:22.681 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0029813159999999999 2024-04-19T03:02:22.681 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:22.682 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:22.682 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:22.682 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:22.682 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:22.682 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:86621 5.8 5:1597a420:::benchmark_data_smithi096_19531_object86620:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:22.682 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:22.635187+0000", 2024-04-19T03:02:22.682 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.041553302, 2024-04-19T03:02:22.682 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.041705401000000003, 2024-04-19T03:02:22.682 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:22.682 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:02:22.682 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:22.682 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:22.682 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:22.682 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 86621 2024-04-19T03:02:22.683 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:22.683 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:22.683 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:22.683 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:22.683 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635187+0000", 2024-04-19T03:02:22.683 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:22.683 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:22.683 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:22.683 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:22.683 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635187+0000", 2024-04-19T03:02:22.683 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:22.683 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:22.683 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:22.684 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:22.684 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635187+0000", 2024-04-19T03:02:22.684 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:22.684 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:22.684 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:22.684 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:22.684 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635242+0000", 2024-04-19T03:02:22.684 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5158000000000003e-05 2024-04-19T03:02:22.684 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:22.684 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:22.684 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:22.684 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635249+0000", 2024-04-19T03:02:22.684 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.7000000000000008e-06 2024-04-19T03:02:22.685 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:22.685 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:22.685 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:22.685 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635256+0000", 2024-04-19T03:02:22.685 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2060000000000004e-06 2024-04-19T03:02:22.685 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:22.685 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:22.685 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:22.685 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635302+0000", 2024-04-19T03:02:22.685 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5954000000000001e-05 2024-04-19T03:02:22.685 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:22.685 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:22.685 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:22.685 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635427+0000", 2024-04-19T03:02:22.686 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012559299999999999 2024-04-19T03:02:22.686 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:22.686 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:22.686 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:22.686 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635596+0000", 2024-04-19T03:02:22.686 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000168615 2024-04-19T03:02:22.686 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:22.686 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:22.686 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:22.686 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.639320+0000", 2024-04-19T03:02:22.686 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0037244610000000001 2024-04-19T03:02:22.686 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:22.686 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:22.687 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:22.687 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:22.687 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:22.687 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:86615 5.e 5:7fef7288:::benchmark_data_smithi096_19531_object86614:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:22.687 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:22.634544+0000", 2024-04-19T03:02:22.687 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.042196359000000003, 2024-04-19T03:02:22.687 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.042429488000000001, 2024-04-19T03:02:22.687 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:22.687 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:02:22.687 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:22.687 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:22.687 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:22.688 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 86615 2024-04-19T03:02:22.688 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:22.688 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:22.688 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:22.688 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:22.688 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634544+0000", 2024-04-19T03:02:22.688 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:22.688 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:22.688 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:22.688 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:22.688 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634544+0000", 2024-04-19T03:02:22.688 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:22.688 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:22.688 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:22.689 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:22.689 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634542+0000", 2024-04-19T03:02:22.689 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999981 2024-04-19T03:02:22.689 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:22.689 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:22.689 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:22.689 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634585+0000", 2024-04-19T03:02:22.689 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2299000000000003e-05 2024-04-19T03:02:22.689 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:22.689 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:22.689 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:22.689 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634592+0000", 2024-04-19T03:02:22.689 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2350000000000002e-06 2024-04-19T03:02:22.690 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:22.690 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:22.690 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:22.690 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634596+0000", 2024-04-19T03:02:22.690 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5390000000000001e-06 2024-04-19T03:02:22.690 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:22.690 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:22.690 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:22.690 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634639+0000", 2024-04-19T03:02:22.690 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2444999999999998e-05 2024-04-19T03:02:22.690 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:22.690 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:22.691 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:22.691 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634808+0000", 2024-04-19T03:02:22.691 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000169152 2024-04-19T03:02:22.691 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:22.691 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:22.691 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:22.691 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634999+0000", 2024-04-19T03:02:22.691 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00019098300000000001 2024-04-19T03:02:22.691 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:22.691 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:22.691 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:22.691 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.640458+0000", 2024-04-19T03:02:22.691 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0054586870000000003 2024-04-19T03:02:22.692 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:22.692 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:22.692 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:22.692 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:22.692 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:22.692 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:86616 5.e 5:72278f47:::benchmark_data_smithi096_19531_object86615:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:22.692 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:22.634609+0000", 2024-04-19T03:02:22.692 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.042131210000000002, 2024-04-19T03:02:22.692 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.042442810999999997, 2024-04-19T03:02:22.692 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:22.692 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:02:22.692 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:22.693 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:22.693 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:22.693 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 86616 2024-04-19T03:02:22.693 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:22.693 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:22.693 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:22.693 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:22.693 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634609+0000", 2024-04-19T03:02:22.693 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:22.693 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:22.693 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:22.693 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:22.693 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634609+0000", 2024-04-19T03:02:22.694 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:22.694 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:22.694 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:22.694 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:22.694 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634609+0000", 2024-04-19T03:02:22.694 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:22.694 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:22.694 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:22.694 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:22.694 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634651+0000", 2024-04-19T03:02:22.694 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2589000000000002e-05 2024-04-19T03:02:22.694 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:22.694 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:22.695 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:22.695 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634659+0000", 2024-04-19T03:02:22.695 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5850000000000002e-06 2024-04-19T03:02:22.695 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:22.695 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:22.695 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:22.695 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634662+0000", 2024-04-19T03:02:22.695 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3620000000000002e-06 2024-04-19T03:02:22.695 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:22.695 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:22.695 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:22.695 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.637880+0000", 2024-04-19T03:02:22.695 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.003218149 2024-04-19T03:02:22.695 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:22.696 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:22.696 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:22.696 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.637999+0000", 2024-04-19T03:02:22.696 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000118643 2024-04-19T03:02:22.696 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:22.696 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:22.696 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:22.696 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.638102+0000", 2024-04-19T03:02:22.696 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010331 2024-04-19T03:02:22.696 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:22.696 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:22.696 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:22.697 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.640851+0000", 2024-04-19T03:02:22.697 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0027483310000000001 2024-04-19T03:02:22.697 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:22.697 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:22.697 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:22.697 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:22.697 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:22.697 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:86618 5.0 5:09014b90:::benchmark_data_smithi096_19531_object86617:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:22.697 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:22.634894+0000", 2024-04-19T03:02:22.697 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.041846722000000003, 2024-04-19T03:02:22.697 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.04223557, 2024-04-19T03:02:22.697 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:22.697 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:02:22.697 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:22.698 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:22.698 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:22.698 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 86618 2024-04-19T03:02:22.698 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:22.698 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:22.698 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:22.698 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:22.698 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634894+0000", 2024-04-19T03:02:22.698 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:22.698 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:22.698 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:22.698 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:22.698 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634894+0000", 2024-04-19T03:02:22.699 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:22.699 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:22.699 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:22.699 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:22.699 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634893+0000", 2024-04-19T03:02:22.699 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:22.699 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:22.699 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:22.699 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:22.699 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634976+0000", 2024-04-19T03:02:22.699 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3231000000000003e-05 2024-04-19T03:02:22.699 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:22.699 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:22.699 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:22.699 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634983+0000", 2024-04-19T03:02:22.700 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5169999999999996e-06 2024-04-19T03:02:22.700 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:22.700 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:22.700 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:22.700 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634987+0000", 2024-04-19T03:02:22.700 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.425e-06 2024-04-19T03:02:22.700 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:22.700 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:22.700 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:22.700 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635030+0000", 2024-04-19T03:02:22.700 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.32e-05 2024-04-19T03:02:22.700 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:22.700 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:22.700 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:22.701 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635185+0000", 2024-04-19T03:02:22.701 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015471899999999999 2024-04-19T03:02:22.701 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:22.701 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:22.701 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:22.701 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635415+0000", 2024-04-19T03:02:22.701 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00023026500000000001 2024-04-19T03:02:22.701 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:22.701 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:22.701 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:22.701 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.640127+0000", 2024-04-19T03:02:22.701 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0047118890000000004 2024-04-19T03:02:22.701 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:22.701 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:22.701 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:22.702 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:22.702 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-04-19T03:02:22.702 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 5 2024-04-19T03:02:22.702 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-19T03:02:22.706 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T03:02:22.766 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:22.763+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:22.815 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-19T03:02:22.815 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-04-19T03:02:22.815 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-04-19T03:02:22.815 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-04-19T03:02:22.815 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-19T03:02:22.824 INFO:tasks.radosbench.radosbench.0.smithi096.stdout: 45 16 86630 86614 120.283 82.375 0.193866 0.00828433 2024-04-19T03:02:22.826 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T03:02:22.866 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:22.865+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:22.967 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:22.963+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:22.999 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-19T03:02:22.999 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-04-19T03:02:22.999 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-04-19T03:02:22.999 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-04-19T03:02:23.000 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.000 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:11274 5.e 5:7c846032:::benchmark_data_smithi096_19531_object11273:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T03:02:23.000 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:42.061776+0000", 2024-04-19T03:02:23.000 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 40.933844999999998, 2024-04-19T03:02:23.000 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.035381001000000002, 2024-04-19T03:02:23.000 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:23.001 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:23.001 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:23.001 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:23.001 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:23.001 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 11274 2024-04-19T03:02:23.001 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.001 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:23.002 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.002 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:23.002 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.061776+0000", 2024-04-19T03:02:23.002 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:23.002 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.003 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.003 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:23.003 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.061776+0000", 2024-04-19T03:02:23.003 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:23.003 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.003 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.004 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:23.004 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.061775+0000", 2024-04-19T03:02:23.004 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:23.004 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.004 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.004 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:23.005 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.061807+0000", 2024-04-19T03:02:23.005 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1733000000000003e-05 2024-04-19T03:02:23.005 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.005 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.005 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:23.005 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.061822+0000", 2024-04-19T03:02:23.005 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5452999999999999e-05 2024-04-19T03:02:23.006 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.006 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.006 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:23.006 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.061827+0000", 2024-04-19T03:02:23.006 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9810000000000003e-06 2024-04-19T03:02:23.006 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.006 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.007 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:23.007 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.063388+0000", 2024-04-19T03:02:23.007 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0015605720000000001 2024-04-19T03:02:23.007 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.007 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.007 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:23.008 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.063612+0000", 2024-04-19T03:02:23.008 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00022431 2024-04-19T03:02:23.008 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.008 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.008 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:23.008 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.063747+0000", 2024-04-19T03:02:23.009 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013459600000000001 2024-04-19T03:02:23.009 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.009 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.009 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:23.009 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.066186+0000", 2024-04-19T03:02:23.009 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0024388909999999999 2024-04-19T03:02:23.010 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.010 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.010 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:23.010 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.097016+0000", 2024-04-19T03:02:23.010 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.030830705 2024-04-19T03:02:23.010 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.011 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.011 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:23.011 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.097096+0000", 2024-04-19T03:02:23.011 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.9469999999999996e-05 2024-04-19T03:02:23.011 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.011 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.012 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:23.012 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.097157+0000", 2024-04-19T03:02:23.012 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0884999999999997e-05 2024-04-19T03:02:23.012 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:23.012 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:23.012 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:23.013 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.013 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.013 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:11279 5.8 5:10b60c58:::benchmark_data_smithi096_19531_object11278:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T03:02:23.013 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:42.062594+0000", 2024-04-19T03:02:23.013 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 40.933026562000002, 2024-04-19T03:02:23.013 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.028696788000000001, 2024-04-19T03:02:23.013 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:23.014 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:23.014 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:23.014 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:23.014 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:23.014 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 11279 2024-04-19T03:02:23.015 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.015 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:23.015 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.015 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:23.015 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.062594+0000", 2024-04-19T03:02:23.015 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:23.016 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.016 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.016 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:23.016 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.062594+0000", 2024-04-19T03:02:23.016 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:23.016 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.017 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.017 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:23.017 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.062593+0000", 2024-04-19T03:02:23.017 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:23.017 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.017 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.018 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:23.018 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.062646+0000", 2024-04-19T03:02:23.018 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2293999999999998e-05 2024-04-19T03:02:23.018 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.018 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.018 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:23.019 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.062657+0000", 2024-04-19T03:02:23.019 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1440000000000001e-05 2024-04-19T03:02:23.019 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.019 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.019 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:23.019 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.062665+0000", 2024-04-19T03:02:23.020 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5159999999999997e-06 2024-04-19T03:02:23.020 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.020 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.020 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:23.020 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.063799+0000", 2024-04-19T03:02:23.020 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0011344860000000001 2024-04-19T03:02:23.020 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.021 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.021 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:23.021 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.063962+0000", 2024-04-19T03:02:23.021 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000162614 2024-04-19T03:02:23.021 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.021 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.022 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:23.022 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.064167+0000", 2024-04-19T03:02:23.022 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00020491699999999999 2024-04-19T03:02:23.022 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.022 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.023 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:23.023 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.066768+0000", 2024-04-19T03:02:23.023 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0026012090000000002 2024-04-19T03:02:23.023 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.023 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.023 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:23.023 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.091184+0000", 2024-04-19T03:02:23.024 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.024416582999999999 2024-04-19T03:02:23.024 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.024 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.024 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:23.024 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.091251+0000", 2024-04-19T03:02:23.025 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6753000000000003e-05 2024-04-19T03:02:23.025 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.025 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.025 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:23.025 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.091291+0000", 2024-04-19T03:02:23.025 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9841e-05 2024-04-19T03:02:23.026 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:23.026 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:23.026 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:23.026 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.026 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.026 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:11282 5.e 5:75b7c510:::benchmark_data_smithi096_19531_object11281:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T03:02:23.027 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:42.062674+0000", 2024-04-19T03:02:23.027 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 40.932947106, 2024-04-19T03:02:23.027 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.034812849, 2024-04-19T03:02:23.027 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:23.027 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:23.027 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:23.028 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:23.028 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:23.028 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 11282 2024-04-19T03:02:23.028 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.028 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:23.028 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.028 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:23.029 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.062674+0000", 2024-04-19T03:02:23.029 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:23.029 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.029 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.029 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:23.029 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.062674+0000", 2024-04-19T03:02:23.029 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:23.029 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.030 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.030 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:23.030 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.062673+0000", 2024-04-19T03:02:23.030 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:23.030 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.030 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.030 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:23.030 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.062712+0000", 2024-04-19T03:02:23.030 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9341999999999997e-05 2024-04-19T03:02:23.031 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.031 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.031 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:23.031 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.062721+0000", 2024-04-19T03:02:23.031 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1700000000000003e-06 2024-04-19T03:02:23.031 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.031 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.032 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:23.032 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.062729+0000", 2024-04-19T03:02:23.032 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4240000000000004e-06 2024-04-19T03:02:23.032 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.032 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.032 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:23.032 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.065017+0000", 2024-04-19T03:02:23.033 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0022878590000000002 2024-04-19T03:02:23.033 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.033 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.033 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:23.033 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.065207+0000", 2024-04-19T03:02:23.033 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000190411 2024-04-19T03:02:23.033 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.033 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.033 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:23.033 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.065323+0000", 2024-04-19T03:02:23.033 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000115593 2024-04-19T03:02:23.033 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.034 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.034 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:23.034 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.069683+0000", 2024-04-19T03:02:23.034 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0043604409999999996 2024-04-19T03:02:23.034 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.034 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.034 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:23.034 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.097273+0000", 2024-04-19T03:02:23.034 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.027589516000000001 2024-04-19T03:02:23.034 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.034 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.034 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:23.034 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.097406+0000", 2024-04-19T03:02:23.035 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000133514 2024-04-19T03:02:23.035 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.035 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.035 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:23.035 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.097486+0000", 2024-04-19T03:02:23.035 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0479e-05 2024-04-19T03:02:23.035 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:23.035 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:23.035 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:23.035 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.035 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.035 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:79014 5.d 5:b5eee02c:::benchmark_data_smithi096_19531_object79013:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-19T03:02:23.035 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:18.032471+0000", 2024-04-19T03:02:23.035 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 4.9631495750000001, 2024-04-19T03:02:23.036 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.041427629000000001, 2024-04-19T03:02:23.036 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:23.036 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:23.036 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:23.036 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:23.036 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:23.036 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 79014 2024-04-19T03:02:23.036 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.036 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:23.036 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.036 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:23.036 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:18.032471+0000", 2024-04-19T03:02:23.036 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:23.036 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.037 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.037 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:23.037 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:18.032471+0000", 2024-04-19T03:02:23.037 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:23.037 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.037 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.037 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:23.037 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:18.032470+0000", 2024-04-19T03:02:23.037 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:23.037 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.037 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.037 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:23.037 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:18.032525+0000", 2024-04-19T03:02:23.037 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5535999999999998e-05 2024-04-19T03:02:23.038 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.038 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.038 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:23.038 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:18.032537+0000", 2024-04-19T03:02:23.038 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1987999999999999e-05 2024-04-19T03:02:23.038 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.038 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.038 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:23.038 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:18.032546+0000", 2024-04-19T03:02:23.038 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9670000000000007e-06 2024-04-19T03:02:23.038 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.038 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.038 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:23.039 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:18.032613+0000", 2024-04-19T03:02:23.039 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6508999999999996e-05 2024-04-19T03:02:23.039 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.039 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.039 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:23.039 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:18.032738+0000", 2024-04-19T03:02:23.039 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000124912 2024-04-19T03:02:23.039 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.039 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.039 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-04-19T03:02:23.039 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:18.032867+0000", 2024-04-19T03:02:23.040 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012959399999999999 2024-04-19T03:02:23.040 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.040 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.040 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:23.040 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:18.035867+0000", 2024-04-19T03:02:23.040 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.002999378 2024-04-19T03:02:23.040 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.040 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.040 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:23.040 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:18.073705+0000", 2024-04-19T03:02:23.040 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.037838042000000002 2024-04-19T03:02:23.040 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.040 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.041 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:23.041 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:18.073813+0000", 2024-04-19T03:02:23.041 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010806099999999999 2024-04-19T03:02:23.041 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.041 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.041 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:23.041 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:18.073899+0000", 2024-04-19T03:02:23.041 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.5971999999999996e-05 2024-04-19T03:02:23.041 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:23.041 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:23.041 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:23.041 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.041 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.041 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:86413 5.b 5:d2462eef:::benchmark_data_smithi096_19531_object86412:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:23.042 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:22.478664+0000", 2024-04-19T03:02:23.042 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.51695637000000005, 2024-04-19T03:02:23.042 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.031353667000000002, 2024-04-19T03:02:23.042 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:23.042 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:23.042 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:23.042 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:23.042 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:23.042 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 86413 2024-04-19T03:02:23.042 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.042 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:23.042 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.042 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:23.043 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.478664+0000", 2024-04-19T03:02:23.043 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:23.043 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.043 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.043 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:23.043 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.478664+0000", 2024-04-19T03:02:23.043 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:23.043 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.043 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.043 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:23.043 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.478663+0000", 2024-04-19T03:02:23.043 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:23.043 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.043 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.043 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:23.044 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.478700+0000", 2024-04-19T03:02:23.044 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6365000000000002e-05 2024-04-19T03:02:23.044 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.044 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.044 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:23.044 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.478717+0000", 2024-04-19T03:02:23.044 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7652e-05 2024-04-19T03:02:23.044 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.044 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.044 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:23.044 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.478725+0000", 2024-04-19T03:02:23.044 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.7940000000000003e-06 2024-04-19T03:02:23.044 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.044 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.045 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:23.045 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.478762+0000", 2024-04-19T03:02:23.045 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6964e-05 2024-04-19T03:02:23.045 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.045 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.045 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:23.045 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.478857+0000", 2024-04-19T03:02:23.045 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.5265000000000004e-05 2024-04-19T03:02:23.045 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.045 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.045 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:23.045 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.478940+0000", 2024-04-19T03:02:23.045 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.2647999999999999e-05 2024-04-19T03:02:23.045 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.046 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.046 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:23.046 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.484759+0000", 2024-04-19T03:02:23.046 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0058193919999999996 2024-04-19T03:02:23.046 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.046 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.046 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:23.046 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.509954+0000", 2024-04-19T03:02:23.046 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.025194528000000001 2024-04-19T03:02:23.046 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.046 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.046 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:23.046 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.509991+0000", 2024-04-19T03:02:23.047 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7132000000000003e-05 2024-04-19T03:02:23.047 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.047 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.047 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:23.047 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.510018+0000", 2024-04-19T03:02:23.047 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6927000000000002e-05 2024-04-19T03:02:23.047 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:23.047 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:23.047 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:23.047 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.047 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.047 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:86417 5.b 5:d211a87e:::benchmark_data_smithi096_19531_object86416:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:23.047 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:22.481856+0000", 2024-04-19T03:02:23.047 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.51376475099999996, 2024-04-19T03:02:23.048 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.028281390999999999, 2024-04-19T03:02:23.048 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:23.048 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:23.048 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:23.048 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:23.048 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:23.048 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 86417 2024-04-19T03:02:23.048 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.048 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:23.048 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.048 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:23.048 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.481856+0000", 2024-04-19T03:02:23.048 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:23.049 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.049 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.049 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:23.049 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.481856+0000", 2024-04-19T03:02:23.049 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:23.049 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.049 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.049 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:23.049 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.481855+0000", 2024-04-19T03:02:23.049 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:23.049 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.049 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.050 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:23.050 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.481919+0000", 2024-04-19T03:02:23.050 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4309999999999999e-05 2024-04-19T03:02:23.050 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.050 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.050 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:23.050 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.481927+0000", 2024-04-19T03:02:23.050 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.96e-06 2024-04-19T03:02:23.050 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.050 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.050 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:23.051 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.481935+0000", 2024-04-19T03:02:23.051 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.1359999999999999e-06 2024-04-19T03:02:23.051 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.051 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.051 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:23.051 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.481984+0000", 2024-04-19T03:02:23.051 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9684000000000001e-05 2024-04-19T03:02:23.051 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.051 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.052 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:23.052 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.482115+0000", 2024-04-19T03:02:23.052 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013037199999999999 2024-04-19T03:02:23.052 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.052 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.052 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:23.052 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.482242+0000", 2024-04-19T03:02:23.052 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012722300000000001 2024-04-19T03:02:23.052 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.052 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.053 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:23.053 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.485157+0000", 2024-04-19T03:02:23.053 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.002915141 2024-04-19T03:02:23.053 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.053 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.053 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:23.054 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.510073+0000", 2024-04-19T03:02:23.054 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.024916458999999998 2024-04-19T03:02:23.054 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.054 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.054 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:23.054 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.510115+0000", 2024-04-19T03:02:23.054 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1078000000000002e-05 2024-04-19T03:02:23.054 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.054 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.054 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:23.054 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.510137+0000", 2024-04-19T03:02:23.054 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2878e-05 2024-04-19T03:02:23.054 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:23.055 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:23.055 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:23.055 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.055 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.055 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:86438 5.b 5:da9cb795:::benchmark_data_smithi096_19531_object86437:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:23.055 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:22.495642+0000", 2024-04-19T03:02:23.055 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.49997878899999998, 2024-04-19T03:02:23.055 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.033412122000000002, 2024-04-19T03:02:23.055 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:23.055 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:23.055 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:23.055 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:23.055 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:23.055 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 86438 2024-04-19T03:02:23.056 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.056 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:23.056 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.056 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:23.056 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.495642+0000", 2024-04-19T03:02:23.056 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:23.056 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.056 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.056 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:23.056 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.495642+0000", 2024-04-19T03:02:23.056 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:23.056 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.056 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.056 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:23.056 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.495641+0000", 2024-04-19T03:02:23.057 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:23.057 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.057 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.057 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:23.057 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.495722+0000", 2024-04-19T03:02:23.057 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0804999999999996e-05 2024-04-19T03:02:23.057 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.057 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.057 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:23.057 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.495731+0000", 2024-04-19T03:02:23.057 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.6479999999999998e-06 2024-04-19T03:02:23.057 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.057 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.057 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:23.058 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.495738+0000", 2024-04-19T03:02:23.058 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.0729999999999999e-06 2024-04-19T03:02:23.058 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.058 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.058 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:23.058 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.495778+0000", 2024-04-19T03:02:23.058 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9561999999999998e-05 2024-04-19T03:02:23.058 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.058 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.058 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:23.058 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.495921+0000", 2024-04-19T03:02:23.058 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000142831 2024-04-19T03:02:23.058 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.059 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.059 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:23.059 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.496065+0000", 2024-04-19T03:02:23.059 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014444699999999999 2024-04-19T03:02:23.059 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.059 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.059 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:23.059 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.501620+0000", 2024-04-19T03:02:23.059 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.005554682 2024-04-19T03:02:23.059 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.059 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.059 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:23.059 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.528894+0000", 2024-04-19T03:02:23.059 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.027274495999999999 2024-04-19T03:02:23.060 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.060 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.060 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:23.060 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.528993+0000", 2024-04-19T03:02:23.060 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.8350000000000005e-05 2024-04-19T03:02:23.060 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.060 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.060 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:23.060 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.529054+0000", 2024-04-19T03:02:23.060 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1457999999999993e-05 2024-04-19T03:02:23.060 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:23.060 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:23.060 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:23.060 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.061 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.061 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:86439 5.0 5:05d3c0f7:::benchmark_data_smithi096_19531_object86438:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:23.061 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:22.495752+0000", 2024-04-19T03:02:23.061 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.49986894900000001, 2024-04-19T03:02:23.061 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.033234214999999998, 2024-04-19T03:02:23.061 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:23.061 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:23.061 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:23.061 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:23.061 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:23.061 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 86439 2024-04-19T03:02:23.061 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.061 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:23.062 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.062 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:23.062 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.495752+0000", 2024-04-19T03:02:23.062 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:23.062 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.062 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.062 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:23.062 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.495752+0000", 2024-04-19T03:02:23.062 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:23.063 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.063 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.063 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:23.063 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.495751+0000", 2024-04-19T03:02:23.063 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:23.063 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.063 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.063 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:23.063 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.495822+0000", 2024-04-19T03:02:23.063 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.1219999999999999e-05 2024-04-19T03:02:23.063 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.064 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.064 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:23.064 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.495830+0000", 2024-04-19T03:02:23.064 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.323e-06 2024-04-19T03:02:23.064 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.064 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.064 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:23.064 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.495834+0000", 2024-04-19T03:02:23.064 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1659999999999996e-06 2024-04-19T03:02:23.064 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.064 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.064 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:23.064 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.495866+0000", 2024-04-19T03:02:23.064 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2039999999999998e-05 2024-04-19T03:02:23.065 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.065 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.065 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:23.065 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.496001+0000", 2024-04-19T03:02:23.065 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000135346 2024-04-19T03:02:23.065 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.065 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.065 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:23.065 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.496144+0000", 2024-04-19T03:02:23.065 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014325000000000001 2024-04-19T03:02:23.065 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.065 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.065 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:23.065 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.501953+0000", 2024-04-19T03:02:23.066 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0058085150000000002 2024-04-19T03:02:23.066 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.066 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.066 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:23.066 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.528880+0000", 2024-04-19T03:02:23.066 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.026927031000000001 2024-04-19T03:02:23.066 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.066 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.066 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:23.066 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.528956+0000", 2024-04-19T03:02:23.066 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5661999999999995e-05 2024-04-19T03:02:23.066 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.066 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.067 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:23.067 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.528986+0000", 2024-04-19T03:02:23.067 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0318999999999999e-05 2024-04-19T03:02:23.067 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:23.067 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:23.067 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:23.067 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.067 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.067 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:86441 5.e 5:7e6b9d09:::benchmark_data_smithi096_19531_object86440:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:23.067 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:22.496295+0000", 2024-04-19T03:02:23.067 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.49932614199999997, 2024-04-19T03:02:23.067 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.033027515, 2024-04-19T03:02:23.067 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:23.067 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:23.068 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:23.068 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:23.068 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:23.068 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 86441 2024-04-19T03:02:23.068 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.068 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:23.068 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.068 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:23.068 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.496295+0000", 2024-04-19T03:02:23.068 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:23.068 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.068 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.068 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:23.068 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.496295+0000", 2024-04-19T03:02:23.069 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:23.069 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.069 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.069 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:23.069 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.496294+0000", 2024-04-19T03:02:23.069 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:23.069 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.069 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.069 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:23.069 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.496367+0000", 2024-04-19T03:02:23.069 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3007000000000001e-05 2024-04-19T03:02:23.069 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.069 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.069 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:23.070 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.496378+0000", 2024-04-19T03:02:23.070 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1256e-05 2024-04-19T03:02:23.070 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.070 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.070 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:23.070 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.496383+0000", 2024-04-19T03:02:23.070 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.429e-06 2024-04-19T03:02:23.070 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.070 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.070 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:23.070 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.496443+0000", 2024-04-19T03:02:23.070 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9033000000000002e-05 2024-04-19T03:02:23.071 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.071 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.071 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:23.071 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.496619+0000", 2024-04-19T03:02:23.071 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00017653800000000001 2024-04-19T03:02:23.071 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.071 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.071 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:23.071 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.496822+0000", 2024-04-19T03:02:23.071 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00020321900000000001 2024-04-19T03:02:23.071 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.071 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.071 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:23.072 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.500358+0000", 2024-04-19T03:02:23.072 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0035359990000000002 2024-04-19T03:02:23.072 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.072 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.072 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:23.072 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.529268+0000", 2024-04-19T03:02:23.072 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.028910087000000001 2024-04-19T03:02:23.072 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.072 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.072 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:23.072 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.529297+0000", 2024-04-19T03:02:23.072 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8626e-05 2024-04-19T03:02:23.072 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.072 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.073 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:23.073 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.529322+0000", 2024-04-19T03:02:23.073 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.514e-05 2024-04-19T03:02:23.073 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:23.073 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:23.073 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:23.073 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.073 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.073 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:86442 5.0 5:0798d603:::benchmark_data_smithi096_19531_object86441:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:23.073 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:22.499050+0000", 2024-04-19T03:02:23.073 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.496571188, 2024-04-19T03:02:23.073 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.030067559000000001, 2024-04-19T03:02:23.073 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:23.073 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:23.074 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:23.074 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:23.074 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:23.074 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 86442 2024-04-19T03:02:23.074 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.074 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:23.074 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.074 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:23.074 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.499050+0000", 2024-04-19T03:02:23.074 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:23.074 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.074 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.074 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:23.075 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.499050+0000", 2024-04-19T03:02:23.075 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:23.075 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.075 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.075 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:23.075 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.499048+0000", 2024-04-19T03:02:23.075 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:23.075 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.075 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.075 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:23.075 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.499123+0000", 2024-04-19T03:02:23.075 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4487999999999996e-05 2024-04-19T03:02:23.075 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.075 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.076 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:23.076 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.499136+0000", 2024-04-19T03:02:23.076 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3239e-05 2024-04-19T03:02:23.076 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.076 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.076 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:23.076 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.499147+0000", 2024-04-19T03:02:23.076 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1252e-05 2024-04-19T03:02:23.076 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.076 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.076 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:23.077 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.499333+0000", 2024-04-19T03:02:23.077 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00018560500000000001 2024-04-19T03:02:23.077 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.077 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.077 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:23.077 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.499421+0000", 2024-04-19T03:02:23.077 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.8647999999999996e-05 2024-04-19T03:02:23.077 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.077 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.077 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:23.077 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.499618+0000", 2024-04-19T03:02:23.077 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00019694499999999999 2024-04-19T03:02:23.077 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.078 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.078 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:23.078 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.502387+0000", 2024-04-19T03:02:23.078 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0027687459999999999 2024-04-19T03:02:23.078 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.078 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.078 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:23.078 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.529061+0000", 2024-04-19T03:02:23.078 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.026674183000000001 2024-04-19T03:02:23.078 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.078 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.078 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:23.078 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.529093+0000", 2024-04-19T03:02:23.079 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1659999999999998e-05 2024-04-19T03:02:23.079 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.079 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.079 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:23.079 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.529117+0000", 2024-04-19T03:02:23.079 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4267e-05 2024-04-19T03:02:23.079 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:23.079 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:23.079 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:23.079 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.079 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.079 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:86443 5.b 5:db409ed1:::benchmark_data_smithi096_19531_object86442:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:23.079 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:22.499162+0000", 2024-04-19T03:02:23.079 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.49645904200000002, 2024-04-19T03:02:23.080 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.030111367, 2024-04-19T03:02:23.080 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:23.080 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:23.080 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:23.080 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:23.080 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:23.080 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 86443 2024-04-19T03:02:23.080 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.080 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:23.080 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.080 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:23.080 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.499162+0000", 2024-04-19T03:02:23.080 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:23.081 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.081 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.081 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:23.081 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.499162+0000", 2024-04-19T03:02:23.081 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:23.081 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.081 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.081 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:23.081 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.499161+0000", 2024-04-19T03:02:23.081 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:23.081 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.081 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.081 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:23.081 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.499218+0000", 2024-04-19T03:02:23.082 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6712999999999997e-05 2024-04-19T03:02:23.082 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.082 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.082 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:23.082 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.499227+0000", 2024-04-19T03:02:23.082 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.3870000000000001e-06 2024-04-19T03:02:23.082 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.082 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.082 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:23.082 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.499235+0000", 2024-04-19T03:02:23.082 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4059999999999999e-06 2024-04-19T03:02:23.083 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.083 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.083 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:23.083 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.499275+0000", 2024-04-19T03:02:23.083 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.0581000000000003e-05 2024-04-19T03:02:23.083 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.083 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.083 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:23.083 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.499372+0000", 2024-04-19T03:02:23.083 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.6434000000000005e-05 2024-04-19T03:02:23.083 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.083 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.083 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:23.084 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.499483+0000", 2024-04-19T03:02:23.084 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000111739 2024-04-19T03:02:23.084 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.084 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.084 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:23.084 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.503365+0000", 2024-04-19T03:02:23.084 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0038817999999999999 2024-04-19T03:02:23.084 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.084 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.084 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:23.084 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.529137+0000", 2024-04-19T03:02:23.084 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.025772059999999999 2024-04-19T03:02:23.084 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.084 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.085 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:23.085 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.529213+0000", 2024-04-19T03:02:23.085 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.6117000000000003e-05 2024-04-19T03:02:23.085 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.085 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.085 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:23.085 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.529273+0000", 2024-04-19T03:02:23.085 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9775999999999998e-05 2024-04-19T03:02:23.085 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:23.085 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:23.085 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:23.085 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.085 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.085 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:86445 5.b 5:dbef97ec:::benchmark_data_smithi096_19531_object86444:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:23.085 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:22.500216+0000", 2024-04-19T03:02:23.086 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.49540474800000001, 2024-04-19T03:02:23.086 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.029272251999999999, 2024-04-19T03:02:23.086 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:23.086 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:23.086 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:23.086 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:23.086 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:23.086 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 86445 2024-04-19T03:02:23.086 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.086 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:23.086 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.086 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:23.086 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.500216+0000", 2024-04-19T03:02:23.087 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:23.087 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.087 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.087 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:23.087 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.500216+0000", 2024-04-19T03:02:23.087 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:23.087 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.087 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.087 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:23.087 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.500215+0000", 2024-04-19T03:02:23.087 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:23.088 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.088 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.088 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:23.088 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.500341+0000", 2024-04-19T03:02:23.088 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012620599999999999 2024-04-19T03:02:23.088 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.088 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.088 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:23.088 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.500352+0000", 2024-04-19T03:02:23.088 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1302e-05 2024-04-19T03:02:23.088 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.088 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.088 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:23.088 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.500360+0000", 2024-04-19T03:02:23.089 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.9689999999999994e-06 2024-04-19T03:02:23.089 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.089 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.089 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:23.089 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.501658+0000", 2024-04-19T03:02:23.089 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00129788 2024-04-19T03:02:23.089 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.089 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.089 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:23.089 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.501774+0000", 2024-04-19T03:02:23.089 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011529199999999999 2024-04-19T03:02:23.089 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.089 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.090 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:23.090 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.501899+0000", 2024-04-19T03:02:23.090 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012549699999999999 2024-04-19T03:02:23.090 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.090 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.090 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:23.090 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.503979+0000", 2024-04-19T03:02:23.090 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0020800559999999998 2024-04-19T03:02:23.090 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.090 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.090 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:23.090 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.529339+0000", 2024-04-19T03:02:23.090 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.025359593 2024-04-19T03:02:23.090 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.091 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.091 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:23.091 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.529406+0000", 2024-04-19T03:02:23.091 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6935999999999997e-05 2024-04-19T03:02:23.091 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.091 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.091 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:23.091 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.529488+0000", 2024-04-19T03:02:23.091 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.2628999999999998e-05 2024-04-19T03:02:23.091 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:23.091 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:23.091 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:23.091 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.092 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.092 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:86615 5.e 5:7fef7288:::benchmark_data_smithi096_19531_object86614:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:23.092 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:22.634544+0000", 2024-04-19T03:02:23.092 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.36107659600000003, 2024-04-19T03:02:23.092 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.192475071, 2024-04-19T03:02:23.092 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:23.092 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:23.092 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:23.092 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:23.092 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:23.092 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 86615 2024-04-19T03:02:23.092 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.092 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:23.092 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.093 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:23.093 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634544+0000", 2024-04-19T03:02:23.093 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:23.093 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.093 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.093 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:23.093 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634544+0000", 2024-04-19T03:02:23.093 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:23.093 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.093 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.093 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:23.093 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634542+0000", 2024-04-19T03:02:23.093 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999981 2024-04-19T03:02:23.093 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.093 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.094 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:23.094 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634585+0000", 2024-04-19T03:02:23.094 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2299000000000003e-05 2024-04-19T03:02:23.094 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.094 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.094 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:23.094 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634592+0000", 2024-04-19T03:02:23.094 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2350000000000002e-06 2024-04-19T03:02:23.094 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.094 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.094 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:23.095 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634596+0000", 2024-04-19T03:02:23.095 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5390000000000001e-06 2024-04-19T03:02:23.095 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.095 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.095 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:23.095 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634639+0000", 2024-04-19T03:02:23.095 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2444999999999998e-05 2024-04-19T03:02:23.095 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.095 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.095 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:23.095 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634808+0000", 2024-04-19T03:02:23.095 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000169152 2024-04-19T03:02:23.095 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.095 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.096 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:23.096 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634999+0000", 2024-04-19T03:02:23.096 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00019098300000000001 2024-04-19T03:02:23.096 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.096 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.096 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:23.096 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.640458+0000", 2024-04-19T03:02:23.096 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0054586870000000003 2024-04-19T03:02:23.096 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.096 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.096 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:23.096 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.826949+0000", 2024-04-19T03:02:23.096 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.18649178299999999 2024-04-19T03:02:23.096 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.097 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.097 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:23.097 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.826982+0000", 2024-04-19T03:02:23.097 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2477000000000001e-05 2024-04-19T03:02:23.097 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.097 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.097 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:23.097 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.827019+0000", 2024-04-19T03:02:23.097 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7355999999999999e-05 2024-04-19T03:02:23.097 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:23.097 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:23.097 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:23.097 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.097 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.098 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:86616 5.e 5:72278f47:::benchmark_data_smithi096_19531_object86615:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:23.098 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:22.634609+0000", 2024-04-19T03:02:23.098 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.36101144699999999, 2024-04-19T03:02:23.098 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.19472088900000001, 2024-04-19T03:02:23.098 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:23.098 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:23.098 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:23.098 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:23.098 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:23.098 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 86616 2024-04-19T03:02:23.098 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.098 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:23.098 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.098 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:23.099 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634609+0000", 2024-04-19T03:02:23.099 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:23.099 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.099 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.099 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:23.099 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634609+0000", 2024-04-19T03:02:23.099 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:23.099 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.099 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.099 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:23.099 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634609+0000", 2024-04-19T03:02:23.099 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:23.099 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.099 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.100 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:23.100 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634651+0000", 2024-04-19T03:02:23.100 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2589000000000002e-05 2024-04-19T03:02:23.100 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.100 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.100 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:23.100 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634659+0000", 2024-04-19T03:02:23.100 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5850000000000002e-06 2024-04-19T03:02:23.100 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.101 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.101 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:23.101 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634662+0000", 2024-04-19T03:02:23.101 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3620000000000002e-06 2024-04-19T03:02:23.101 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.101 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.101 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:23.101 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.637880+0000", 2024-04-19T03:02:23.101 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.003218149 2024-04-19T03:02:23.101 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.101 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.102 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:23.102 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.637999+0000", 2024-04-19T03:02:23.102 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000118643 2024-04-19T03:02:23.102 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.102 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.102 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:23.102 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.638102+0000", 2024-04-19T03:02:23.102 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010331 2024-04-19T03:02:23.102 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.102 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.102 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:23.102 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.640851+0000", 2024-04-19T03:02:23.102 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0027483310000000001 2024-04-19T03:02:23.103 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.103 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.103 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:23.103 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.829269+0000", 2024-04-19T03:02:23.103 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.188418319 2024-04-19T03:02:23.103 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.103 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.103 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:23.103 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.829299+0000", 2024-04-19T03:02:23.103 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0227e-05 2024-04-19T03:02:23.103 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.103 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.103 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:23.103 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.829330+0000", 2024-04-19T03:02:23.104 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0969000000000001e-05 2024-04-19T03:02:23.104 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:23.104 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:23.104 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:23.104 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.104 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.104 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:86618 5.0 5:09014b90:::benchmark_data_smithi096_19531_object86617:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:23.104 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:22.634894+0000", 2024-04-19T03:02:23.104 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.36072695900000001, 2024-04-19T03:02:23.104 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.19413419800000001, 2024-04-19T03:02:23.104 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:23.104 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:23.104 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:23.104 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:23.104 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:23.105 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 86618 2024-04-19T03:02:23.105 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.105 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:23.105 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.105 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:23.105 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634894+0000", 2024-04-19T03:02:23.105 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:23.105 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.105 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.105 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:23.105 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634894+0000", 2024-04-19T03:02:23.105 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:23.105 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.105 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.106 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:23.106 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634893+0000", 2024-04-19T03:02:23.106 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:23.106 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.106 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.106 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:23.106 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634976+0000", 2024-04-19T03:02:23.106 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3231000000000003e-05 2024-04-19T03:02:23.106 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.106 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.106 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:23.106 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634983+0000", 2024-04-19T03:02:23.106 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5169999999999996e-06 2024-04-19T03:02:23.107 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.107 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.107 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:23.107 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634987+0000", 2024-04-19T03:02:23.107 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.425e-06 2024-04-19T03:02:23.107 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.107 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.107 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:23.107 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635030+0000", 2024-04-19T03:02:23.107 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.32e-05 2024-04-19T03:02:23.107 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.107 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.107 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:23.107 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635185+0000", 2024-04-19T03:02:23.108 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015471899999999999 2024-04-19T03:02:23.108 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.108 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.108 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:23.108 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635415+0000", 2024-04-19T03:02:23.108 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00023026500000000001 2024-04-19T03:02:23.108 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.108 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.108 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:23.108 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.640127+0000", 2024-04-19T03:02:23.108 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0047118890000000004 2024-04-19T03:02:23.109 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.109 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.109 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:23.109 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.828895+0000", 2024-04-19T03:02:23.109 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.18876802600000001 2024-04-19T03:02:23.109 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.109 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.109 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:23.109 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.828972+0000", 2024-04-19T03:02:23.109 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.6345000000000002e-05 2024-04-19T03:02:23.109 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.109 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.109 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:23.109 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.829028+0000", 2024-04-19T03:02:23.109 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6342999999999999e-05 2024-04-19T03:02:23.109 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:23.110 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:23.110 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:23.110 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.110 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.110 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:86620 5.b 5:d80faa68:::benchmark_data_smithi096_19531_object86619:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:23.110 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:22.635110+0000", 2024-04-19T03:02:23.110 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.36051039899999998, 2024-04-19T03:02:23.110 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.193447275, 2024-04-19T03:02:23.110 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:23.110 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:23.110 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:23.110 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:23.110 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:23.111 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 86620 2024-04-19T03:02:23.111 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.111 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:23.111 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.111 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:23.111 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635110+0000", 2024-04-19T03:02:23.111 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:23.111 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.111 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.111 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:23.111 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635110+0000", 2024-04-19T03:02:23.111 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:23.111 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.111 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.112 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:23.112 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635110+0000", 2024-04-19T03:02:23.112 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:23.112 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.112 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.112 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:23.112 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635154+0000", 2024-04-19T03:02:23.112 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4681000000000001e-05 2024-04-19T03:02:23.112 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.112 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.112 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:23.112 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635166+0000", 2024-04-19T03:02:23.112 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1505000000000001e-05 2024-04-19T03:02:23.112 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.113 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.113 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:23.113 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635171+0000", 2024-04-19T03:02:23.113 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6040000000000003e-06 2024-04-19T03:02:23.113 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.113 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.113 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:23.113 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635221+0000", 2024-04-19T03:02:23.113 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9947000000000001e-05 2024-04-19T03:02:23.113 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.113 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.113 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:23.113 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635356+0000", 2024-04-19T03:02:23.113 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013576199999999999 2024-04-19T03:02:23.114 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.114 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.114 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:23.114 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635507+0000", 2024-04-19T03:02:23.114 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015072999999999999 2024-04-19T03:02:23.114 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.114 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.114 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:23.114 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.638488+0000", 2024-04-19T03:02:23.114 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0029813159999999999 2024-04-19T03:02:23.114 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.114 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.114 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:23.115 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.828341+0000", 2024-04-19T03:02:23.115 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.189852254 2024-04-19T03:02:23.115 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.115 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.115 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:23.115 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.828416+0000", 2024-04-19T03:02:23.115 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5344000000000002e-05 2024-04-19T03:02:23.115 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.115 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.115 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:23.115 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.828558+0000", 2024-04-19T03:02:23.115 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000141695 2024-04-19T03:02:23.115 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:23.115 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:23.116 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:23.116 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.116 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.116 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:86621 5.8 5:1597a420:::benchmark_data_smithi096_19531_object86620:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:23.116 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:22.635187+0000", 2024-04-19T03:02:23.116 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.36043353900000002, 2024-04-19T03:02:23.116 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.194204878, 2024-04-19T03:02:23.116 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:23.116 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:23.116 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:23.116 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:23.116 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:23.116 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 86621 2024-04-19T03:02:23.116 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.117 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:23.117 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.117 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:23.117 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635187+0000", 2024-04-19T03:02:23.117 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:23.117 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.117 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.117 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:23.117 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635187+0000", 2024-04-19T03:02:23.117 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:23.117 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.117 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.117 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:23.117 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635187+0000", 2024-04-19T03:02:23.118 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:23.118 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.118 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.118 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:23.118 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635242+0000", 2024-04-19T03:02:23.118 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5158000000000003e-05 2024-04-19T03:02:23.118 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.118 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.118 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:23.118 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635249+0000", 2024-04-19T03:02:23.118 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.7000000000000008e-06 2024-04-19T03:02:23.118 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.118 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.118 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:23.119 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635256+0000", 2024-04-19T03:02:23.119 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2060000000000004e-06 2024-04-19T03:02:23.119 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.119 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.119 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:23.119 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635302+0000", 2024-04-19T03:02:23.119 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5954000000000001e-05 2024-04-19T03:02:23.119 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.119 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.119 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:23.119 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635427+0000", 2024-04-19T03:02:23.120 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012559299999999999 2024-04-19T03:02:23.120 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.120 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.120 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:23.120 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635596+0000", 2024-04-19T03:02:23.120 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000168615 2024-04-19T03:02:23.120 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.120 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.120 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:23.120 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.639320+0000", 2024-04-19T03:02:23.120 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0037244610000000001 2024-04-19T03:02:23.120 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.120 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.121 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:23.121 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.829277+0000", 2024-04-19T03:02:23.121 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.18995651099999999 2024-04-19T03:02:23.121 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.121 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.121 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:23.121 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.829341+0000", 2024-04-19T03:02:23.121 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3756000000000004e-05 2024-04-19T03:02:23.121 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.121 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.121 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:23.121 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.829392+0000", 2024-04-19T03:02:23.121 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1555999999999999e-05 2024-04-19T03:02:23.121 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:23.122 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:23.122 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:23.122 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.122 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.122 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:86648 5.8 5:1b7d75b0:::benchmark_data_smithi096_19531_object86647:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:23.122 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:22.838112+0000", 2024-04-19T03:02:23.122 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.15750886, 2024-04-19T03:02:23.122 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.030488972, 2024-04-19T03:02:23.122 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:23.122 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:23.122 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:23.122 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:23.122 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:23.123 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 86648 2024-04-19T03:02:23.123 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.123 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:23.123 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.123 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:23.123 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.838112+0000", 2024-04-19T03:02:23.123 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:23.123 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.123 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.123 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:23.123 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.838112+0000", 2024-04-19T03:02:23.123 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:23.123 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.123 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.123 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:23.124 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.838111+0000", 2024-04-19T03:02:23.124 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:23.124 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.124 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.124 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:23.124 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.838231+0000", 2024-04-19T03:02:23.124 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000120052 2024-04-19T03:02:23.124 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.124 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.124 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:23.124 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.838237+0000", 2024-04-19T03:02:23.124 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3500000000000002e-06 2024-04-19T03:02:23.124 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.124 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.124 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:23.125 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.838242+0000", 2024-04-19T03:02:23.125 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1239999999999998e-06 2024-04-19T03:02:23.125 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.125 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.125 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:23.125 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.841557+0000", 2024-04-19T03:02:23.125 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0033156930000000002 2024-04-19T03:02:23.125 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.125 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.125 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:23.125 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.841665+0000", 2024-04-19T03:02:23.125 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000107933 2024-04-19T03:02:23.125 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.125 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.125 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:23.126 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.841781+0000", 2024-04-19T03:02:23.126 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000115932 2024-04-19T03:02:23.126 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.126 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.126 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:23.126 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.847372+0000", 2024-04-19T03:02:23.126 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0055906949999999997 2024-04-19T03:02:23.126 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.126 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.126 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:23.126 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.868496+0000", 2024-04-19T03:02:23.126 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.021124014999999999 2024-04-19T03:02:23.126 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.127 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.127 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:23.127 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.868565+0000", 2024-04-19T03:02:23.127 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.9120000000000002e-05 2024-04-19T03:02:23.127 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.127 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.127 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:23.127 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.868601+0000", 2024-04-19T03:02:23.127 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5905000000000003e-05 2024-04-19T03:02:23.127 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:23.127 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:23.127 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:23.127 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.127 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.127 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:86651 5.8 5:16feb5a0:::benchmark_data_smithi096_19531_object86650:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:23.127 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:22.840106+0000", 2024-04-19T03:02:23.128 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.155514822, 2024-04-19T03:02:23.128 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.028659178, 2024-04-19T03:02:23.128 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:23.128 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:23.128 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:23.128 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:23.128 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:23.128 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 86651 2024-04-19T03:02:23.128 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.128 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:23.128 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.128 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:23.128 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.840106+0000", 2024-04-19T03:02:23.128 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:23.129 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.129 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.129 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:23.129 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.840106+0000", 2024-04-19T03:02:23.129 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:23.129 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.129 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.129 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:23.129 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.840104+0000", 2024-04-19T03:02:23.129 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999981 2024-04-19T03:02:23.129 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.129 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.129 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:23.129 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.840236+0000", 2024-04-19T03:02:23.129 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000131994 2024-04-19T03:02:23.130 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.130 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.130 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:23.130 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.840263+0000", 2024-04-19T03:02:23.130 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6953000000000001e-05 2024-04-19T03:02:23.130 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.130 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.130 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:23.130 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.840281+0000", 2024-04-19T03:02:23.130 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7932999999999999e-05 2024-04-19T03:02:23.130 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.130 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.130 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:23.131 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.844103+0000", 2024-04-19T03:02:23.131 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.003822406 2024-04-19T03:02:23.131 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.131 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.131 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:23.131 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.844214+0000", 2024-04-19T03:02:23.131 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011045899999999999 2024-04-19T03:02:23.131 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.131 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.131 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:23.131 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.844317+0000", 2024-04-19T03:02:23.131 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000102854 2024-04-19T03:02:23.131 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.131 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.132 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:23.132 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.847379+0000", 2024-04-19T03:02:23.132 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.003062192 2024-04-19T03:02:23.132 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.132 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.132 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:23.132 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.868654+0000", 2024-04-19T03:02:23.132 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.021274946999999999 2024-04-19T03:02:23.132 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.132 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.132 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:23.132 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.868699+0000", 2024-04-19T03:02:23.132 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4752000000000001e-05 2024-04-19T03:02:23.133 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.133 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.133 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:23.133 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.868765+0000", 2024-04-19T03:02:23.133 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6601999999999997e-05 2024-04-19T03:02:23.133 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:23.133 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:23.133 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:23.133 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.133 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.133 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:86654 5.0 5:00cee17b:::benchmark_data_smithi096_19531_object86653:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:23.133 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:22.844284+0000", 2024-04-19T03:02:23.133 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.15133638099999999, 2024-04-19T03:02:23.133 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.026728325000000001, 2024-04-19T03:02:23.134 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:23.134 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:23.134 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:23.134 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:23.134 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:23.134 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 86654 2024-04-19T03:02:23.134 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.134 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:23.134 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.134 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:23.134 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.844284+0000", 2024-04-19T03:02:23.135 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:23.135 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.135 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.135 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:23.135 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.844284+0000", 2024-04-19T03:02:23.135 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:23.135 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.135 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.135 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:23.135 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.844283+0000", 2024-04-19T03:02:23.135 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:23.135 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.135 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.136 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:23.136 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.844392+0000", 2024-04-19T03:02:23.136 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010949400000000001 2024-04-19T03:02:23.136 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.136 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.136 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:23.136 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.844416+0000", 2024-04-19T03:02:23.136 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3343999999999999e-05 2024-04-19T03:02:23.136 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.136 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.136 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:23.136 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.844425+0000", 2024-04-19T03:02:23.136 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.6949999999999995e-06 2024-04-19T03:02:23.137 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.137 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.137 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:23.137 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.844478+0000", 2024-04-19T03:02:23.137 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2852999999999997e-05 2024-04-19T03:02:23.137 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.137 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.137 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:23.138 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.844618+0000", 2024-04-19T03:02:23.138 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000140357 2024-04-19T03:02:23.138 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.138 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.138 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:23.138 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.844721+0000", 2024-04-19T03:02:23.138 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000102358 2024-04-19T03:02:23.138 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.138 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.138 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:23.138 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.849892+0000", 2024-04-19T03:02:23.138 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0051709340000000003 2024-04-19T03:02:23.138 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.138 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.139 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:23.139 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.870883+0000", 2024-04-19T03:02:23.139 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020991091999999999 2024-04-19T03:02:23.139 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.139 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.139 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:23.139 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.870956+0000", 2024-04-19T03:02:23.139 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2927000000000002e-05 2024-04-19T03:02:23.139 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.139 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.139 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:23.139 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.871013+0000", 2024-04-19T03:02:23.140 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6895000000000003e-05 2024-04-19T03:02:23.140 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:23.140 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:23.140 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:23.140 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:23.140 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:23.140 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-19T03:02:23.141 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:23.137+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:23.142 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T03:02:23.242 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:23.241+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:23.248 DEBUG:teuthology.orchestra.console.smithi097:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-19T03:02:23.256 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-19T03:02:23.257 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-04-19T03:02:23.257 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [ 2024-04-19T03:02:23.257 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.258 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87123 5.6 5.9dc3d8b6 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:02:23.258 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249233+0000", 2024-04-19T03:02:23.258 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.001116854, 2024-04-19T03:02:23.258 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001133291, 2024-04-19T03:02:23.258 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:23.258 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "op must wait for map", 2024-04-19T03:02:23.258 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:23.258 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:23.258 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:23.258 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87123 2024-04-19T03:02:23.258 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.259 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:23.259 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.259 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:23.259 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249233+0000", 2024-04-19T03:02:23.259 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:23.259 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.259 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.259 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:23.259 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249233+0000", 2024-04-19T03:02:23.259 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:23.259 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.259 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.259 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:23.260 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249231+0000", 2024-04-19T03:02:23.260 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:23.260 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.260 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.260 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:23.260 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249285+0000", 2024-04-19T03:02:23.260 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4005000000000002e-05 2024-04-19T03:02:23.260 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.260 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.260 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:23.260 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249300+0000", 2024-04-19T03:02:23.260 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4715999999999999e-05 2024-04-19T03:02:23.260 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.261 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.261 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:23.261 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249307+0000", 2024-04-19T03:02:23.261 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8399999999999997e-06 2024-04-19T03:02:23.261 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.261 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.261 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:23.261 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249366+0000", 2024-04-19T03:02:23.261 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9435999999999998e-05 2024-04-19T03:02:23.261 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.261 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.261 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op must wait for map", 2024-04-19T03:02:23.261 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249376+0000", 2024-04-19T03:02:23.262 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.4919999999999999e-06 2024-04-19T03:02:23.262 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:23.262 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:23.262 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:23.262 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.262 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.262 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87128 5.6 5.423a096 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:02:23.262 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249323+0000", 2024-04-19T03:02:23.262 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0010261070000000001, 2024-04-19T03:02:23.262 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0010911860000000001, 2024-04-19T03:02:23.262 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:23.263 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting_for_map not empty", 2024-04-19T03:02:23.263 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:23.263 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:23.263 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:23.263 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87128 2024-04-19T03:02:23.263 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.263 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:23.263 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.263 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:23.263 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249323+0000", 2024-04-19T03:02:23.263 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:23.263 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.263 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.264 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:23.264 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249323+0000", 2024-04-19T03:02:23.264 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:23.264 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.264 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.264 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:23.264 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249323+0000", 2024-04-19T03:02:23.264 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:23.264 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.264 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.264 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:23.264 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249385+0000", 2024-04-19T03:02:23.264 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1711999999999995e-05 2024-04-19T03:02:23.264 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.265 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.265 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:23.265 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249398+0000", 2024-04-19T03:02:23.265 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3022e-05 2024-04-19T03:02:23.265 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.265 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.265 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:23.265 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249402+0000", 2024-04-19T03:02:23.265 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4819999999999996e-06 2024-04-19T03:02:23.265 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.265 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.265 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:23.265 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249437+0000", 2024-04-19T03:02:23.265 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4702000000000001e-05 2024-04-19T03:02:23.266 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.266 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.266 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:02:23.266 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249442+0000", 2024-04-19T03:02:23.266 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8019999999999999e-06 2024-04-19T03:02:23.266 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:23.266 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:23.266 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:23.266 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.266 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.266 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87130 5.3 5.de6b4313 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:02:23.266 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249418+0000", 2024-04-19T03:02:23.267 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.00093139600000000003, 2024-04-19T03:02:23.267 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0010382670000000001, 2024-04-19T03:02:23.267 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:23.267 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "op must wait for map", 2024-04-19T03:02:23.267 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:23.267 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:23.267 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:23.267 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87130 2024-04-19T03:02:23.267 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.267 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:23.267 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.267 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:23.267 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249418+0000", 2024-04-19T03:02:23.267 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:23.268 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.268 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.268 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:23.268 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249418+0000", 2024-04-19T03:02:23.268 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:23.268 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.268 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.268 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:23.268 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249409+0000", 2024-04-19T03:02:23.268 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999905 2024-04-19T03:02:23.268 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.268 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.268 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:23.268 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249464+0000", 2024-04-19T03:02:23.269 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5381999999999999e-05 2024-04-19T03:02:23.269 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.269 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.269 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:23.269 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249471+0000", 2024-04-19T03:02:23.269 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2609999999999996e-06 2024-04-19T03:02:23.269 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.269 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.269 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:23.269 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249475+0000", 2024-04-19T03:02:23.269 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2839999999999998e-06 2024-04-19T03:02:23.269 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.269 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.269 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:23.270 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249535+0000", 2024-04-19T03:02:23.270 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0545999999999999e-05 2024-04-19T03:02:23.270 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.270 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.270 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op must wait for map", 2024-04-19T03:02:23.270 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249540+0000", 2024-04-19T03:02:23.270 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2859999999999999e-06 2024-04-19T03:02:23.270 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:23.270 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:23.270 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:23.270 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.270 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.270 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87131 5.1 5.aab6aec1 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:02:23.271 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249491+0000", 2024-04-19T03:02:23.271 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.00085874900000000001, 2024-04-19T03:02:23.271 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0010066879999999999, 2024-04-19T03:02:23.271 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:23.271 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "op must wait for map", 2024-04-19T03:02:23.271 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:23.271 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:23.271 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:23.271 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87131 2024-04-19T03:02:23.271 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.271 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:23.271 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.271 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:23.272 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249491+0000", 2024-04-19T03:02:23.272 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:23.272 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.272 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.272 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:23.272 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249491+0000", 2024-04-19T03:02:23.272 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:23.272 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.272 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.272 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:23.272 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249491+0000", 2024-04-19T03:02:23.272 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:23.272 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.273 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.273 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:23.273 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249530+0000", 2024-04-19T03:02:23.273 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9589000000000003e-05 2024-04-19T03:02:23.273 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.273 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.273 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:23.273 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249544+0000", 2024-04-19T03:02:23.273 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4158000000000001e-05 2024-04-19T03:02:23.273 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.273 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.273 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:23.273 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249549+0000", 2024-04-19T03:02:23.274 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6809999999999997e-06 2024-04-19T03:02:23.274 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.274 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.274 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:23.274 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249592+0000", 2024-04-19T03:02:23.274 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3285999999999999e-05 2024-04-19T03:02:23.274 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.274 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.274 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op must wait for map", 2024-04-19T03:02:23.274 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249598+0000", 2024-04-19T03:02:23.274 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8329999999999999e-06 2024-04-19T03:02:23.274 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:23.274 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:23.275 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:23.275 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.275 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.275 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87132 5.c 5.4ced187c (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:02:23.275 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249558+0000", 2024-04-19T03:02:23.275 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.00079184800000000005, 2024-04-19T03:02:23.275 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00098010099999999993, 2024-04-19T03:02:23.275 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:23.275 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "op must wait for map", 2024-04-19T03:02:23.275 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:23.275 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:23.275 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:23.275 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87132 2024-04-19T03:02:23.275 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.275 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:23.276 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.276 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:23.276 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249558+0000", 2024-04-19T03:02:23.276 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:23.276 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.276 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.276 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:23.276 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249558+0000", 2024-04-19T03:02:23.276 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:23.276 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.276 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.276 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:23.276 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249557+0000", 2024-04-19T03:02:23.276 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:23.277 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.277 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.277 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:23.277 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249625+0000", 2024-04-19T03:02:23.277 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7200999999999996e-05 2024-04-19T03:02:23.277 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.277 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.277 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:23.277 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249646+0000", 2024-04-19T03:02:23.277 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1053e-05 2024-04-19T03:02:23.277 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.277 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.277 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:23.277 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249650+0000", 2024-04-19T03:02:23.278 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2719999999999999e-06 2024-04-19T03:02:23.278 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.278 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.278 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:23.278 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249686+0000", 2024-04-19T03:02:23.278 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6430000000000002e-05 2024-04-19T03:02:23.278 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.278 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.278 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op must wait for map", 2024-04-19T03:02:23.278 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249690+0000", 2024-04-19T03:02:23.278 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.765e-06 2024-04-19T03:02:23.278 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:23.278 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:23.279 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:23.279 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.279 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.279 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87133 5.c 5.4654eefc (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:02:23.279 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249657+0000", 2024-04-19T03:02:23.279 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.00069246900000000003, 2024-04-19T03:02:23.279 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00091971900000000005, 2024-04-19T03:02:23.279 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:23.279 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting_for_map not empty", 2024-04-19T03:02:23.279 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:23.279 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:23.279 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:23.279 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87133 2024-04-19T03:02:23.279 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.280 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:23.280 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.280 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:23.280 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249657+0000", 2024-04-19T03:02:23.280 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:23.280 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.280 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.280 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:23.280 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249657+0000", 2024-04-19T03:02:23.280 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:23.280 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.280 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.280 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:23.280 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249657+0000", 2024-04-19T03:02:23.281 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:23.281 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.281 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.281 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:23.281 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249690+0000", 2024-04-19T03:02:23.281 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3343000000000002e-05 2024-04-19T03:02:23.281 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.281 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.281 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:23.281 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249695+0000", 2024-04-19T03:02:23.281 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8600000000000001e-06 2024-04-19T03:02:23.281 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.281 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.281 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:23.282 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249698+0000", 2024-04-19T03:02:23.282 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.1700000000000001e-06 2024-04-19T03:02:23.282 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.282 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.282 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:23.282 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249741+0000", 2024-04-19T03:02:23.282 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2849999999999998e-05 2024-04-19T03:02:23.282 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.282 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.282 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:02:23.282 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249746+0000", 2024-04-19T03:02:23.282 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1019999999999996e-06 2024-04-19T03:02:23.282 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:23.283 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:23.283 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:23.283 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.283 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.283 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87134 5.5 5.f1e236a5 (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:02:23.283 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249708+0000", 2024-04-19T03:02:23.283 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.00064154499999999998, 2024-04-19T03:02:23.283 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00090796200000000001, 2024-04-19T03:02:23.283 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:23.283 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "op must wait for map", 2024-04-19T03:02:23.283 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:23.283 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:23.283 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:23.283 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87134 2024-04-19T03:02:23.284 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.284 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:23.284 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.284 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:23.284 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249708+0000", 2024-04-19T03:02:23.284 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:23.284 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.284 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.284 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:23.284 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249708+0000", 2024-04-19T03:02:23.284 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:23.284 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.284 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.284 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:23.285 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249706+0000", 2024-04-19T03:02:23.285 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999976 2024-04-19T03:02:23.285 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.285 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.285 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:23.285 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249740+0000", 2024-04-19T03:02:23.285 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4458000000000001e-05 2024-04-19T03:02:23.285 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.285 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.285 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:23.285 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249745+0000", 2024-04-19T03:02:23.285 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5020000000000003e-06 2024-04-19T03:02:23.285 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.286 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.286 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:23.286 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249748+0000", 2024-04-19T03:02:23.286 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2499999999999998e-06 2024-04-19T03:02:23.286 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.286 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.286 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:23.286 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249778+0000", 2024-04-19T03:02:23.286 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.006e-05 2024-04-19T03:02:23.286 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.286 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.286 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op must wait for map", 2024-04-19T03:02:23.286 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249782+0000", 2024-04-19T03:02:23.287 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2910000000000001e-06 2024-04-19T03:02:23.287 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:23.287 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:23.287 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:23.287 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.287 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.287 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87137 5.c 5.16310e0c (undecoded) ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:02:23.287 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249756+0000", 2024-04-19T03:02:23.287 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.00059383899999999998, 2024-04-19T03:02:23.287 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00090130500000000003, 2024-04-19T03:02:23.287 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:23.287 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting_for_map not empty", 2024-04-19T03:02:23.287 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:23.287 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:23.287 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:23.288 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87137 2024-04-19T03:02:23.288 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.288 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:23.288 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.288 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:23.288 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249756+0000", 2024-04-19T03:02:23.288 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:23.288 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.288 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.288 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:23.288 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249756+0000", 2024-04-19T03:02:23.288 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:23.288 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.288 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.288 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:23.289 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249755+0000", 2024-04-19T03:02:23.289 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:23.289 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.289 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.289 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:23.289 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249777+0000", 2024-04-19T03:02:23.289 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1420000000000002e-05 2024-04-19T03:02:23.289 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.289 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.289 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:23.289 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249781+0000", 2024-04-19T03:02:23.289 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0609999999999997e-06 2024-04-19T03:02:23.289 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.289 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.289 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:23.290 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249787+0000", 2024-04-19T03:02:23.290 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.02e-06 2024-04-19T03:02:23.290 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.290 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.290 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:23.290 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249818+0000", 2024-04-19T03:02:23.290 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0947e-05 2024-04-19T03:02:23.290 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.290 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.290 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:02:23.290 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249821+0000", 2024-04-19T03:02:23.290 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.117e-06 2024-04-19T03:02:23.290 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:23.290 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:23.291 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:23.291 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:23.291 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-04-19T03:02:23.291 INFO:teuthology.orchestra.run.smithi144.stdout: "num_ops": 8 2024-04-19T03:02:23.291 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-04-19T03:02:23.292 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T03:02:23.343 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:23.339+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:23.357 DEBUG:teuthology.orchestra.console.smithi097:check power output: Chassis Power is on 2024-04-19T03:02:23.400 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-04-19T03:02:23.401 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2024-04-19T03:02:23.401 INFO:teuthology.orchestra.run.smithi144.stdout: "complaint_time": 30, 2024-04-19T03:02:23.401 INFO:teuthology.orchestra.run.smithi144.stdout: "num_blocked_ops": 0 2024-04-19T03:02:23.401 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-04-19T03:02:23.410 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T03:02:23.445 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:23.441+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:23.522 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-04-19T03:02:23.522 INFO:teuthology.orchestra.run.smithi144.stdout: "size": 20, 2024-04-19T03:02:23.522 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 600, 2024-04-19T03:02:23.522 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [ 2024-04-19T03:02:23.522 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.522 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:8 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:02:23.523 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:01:14.998165+0000", 2024-04-19T03:02:23.523 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 68.520154102000006, 2024-04-19T03:02:23.523 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.024541001, 2024-04-19T03:02:23.523 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:23.523 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:23.523 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:23.523 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.523 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:23.524 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998165+0000", 2024-04-19T03:02:23.524 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:23.524 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.524 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.524 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:23.524 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998165+0000", 2024-04-19T03:02:23.524 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:23.524 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.524 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.524 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:23.524 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998164+0000", 2024-04-19T03:02:23.524 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:23.524 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.525 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.525 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:23.525 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998170+0000", 2024-04-19T03:02:23.525 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2939999999999996e-06 2024-04-19T03:02:23.525 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.525 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.525 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:23.525 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998179+0000", 2024-04-19T03:02:23.525 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.5540000000000003e-06 2024-04-19T03:02:23.525 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.525 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.525 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:23.525 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998188+0000", 2024-04-19T03:02:23.525 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2959999999999999e-06 2024-04-19T03:02:23.526 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.526 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.526 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:23.526 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998332+0000", 2024-04-19T03:02:23.526 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00014474 2024-04-19T03:02:23.526 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.526 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.526 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:02:23.526 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998337+0000", 2024-04-19T03:02:23.526 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6909999999999996e-06 2024-04-19T03:02:23.526 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.526 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.526 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:23.527 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.010222+0000", 2024-04-19T03:02:23.527 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011885178 2024-04-19T03:02:23.527 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.527 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.527 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:23.527 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.010342+0000", 2024-04-19T03:02:23.527 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00011991500000000001 2024-04-19T03:02:23.527 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.527 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.527 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:02:23.527 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.010506+0000", 2024-04-19T03:02:23.527 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00016429699999999999 2024-04-19T03:02:23.527 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.528 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.528 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:23.528 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.014525+0000", 2024-04-19T03:02:23.528 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0040189839999999998 2024-04-19T03:02:23.528 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.528 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.528 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:23.528 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.022600+0000", 2024-04-19T03:02:23.528 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0080741990000000007 2024-04-19T03:02:23.528 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.528 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.528 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:23.528 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.022670+0000", 2024-04-19T03:02:23.528 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0743999999999999e-05 2024-04-19T03:02:23.529 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.529 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.529 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:23.529 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.022706+0000", 2024-04-19T03:02:23.529 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5782999999999999e-05 2024-04-19T03:02:23.529 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:23.529 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:23.529 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:23.529 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.529 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.529 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:28 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:02:23.529 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:01:14.998476+0000", 2024-04-19T03:02:23.529 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 68.519843526000002, 2024-04-19T03:02:23.530 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.024656784000000001, 2024-04-19T03:02:23.530 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:23.530 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:23.530 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:23.530 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.530 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:23.530 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998476+0000", 2024-04-19T03:02:23.530 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:23.530 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.530 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.530 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:23.530 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998476+0000", 2024-04-19T03:02:23.530 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:23.531 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.531 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.531 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:23.531 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998475+0000", 2024-04-19T03:02:23.531 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:23.531 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.531 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.531 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:23.531 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998484+0000", 2024-04-19T03:02:23.531 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.7770000000000008e-06 2024-04-19T03:02:23.531 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.531 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.531 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:23.532 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998495+0000", 2024-04-19T03:02:23.532 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0726e-05 2024-04-19T03:02:23.532 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.532 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.532 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:23.532 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998503+0000", 2024-04-19T03:02:23.532 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.8780000000000004e-06 2024-04-19T03:02:23.532 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.532 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.532 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:23.532 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998579+0000", 2024-04-19T03:02:23.532 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5160999999999994e-05 2024-04-19T03:02:23.532 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.532 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.533 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:02:23.533 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998586+0000", 2024-04-19T03:02:23.533 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8520000000000004e-06 2024-04-19T03:02:23.533 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.533 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.533 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:23.533 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.012423+0000", 2024-04-19T03:02:23.533 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.013836667 2024-04-19T03:02:23.533 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.533 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.533 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:23.533 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.012532+0000", 2024-04-19T03:02:23.533 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000108565 2024-04-19T03:02:23.533 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.534 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.534 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:02:23.534 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.012655+0000", 2024-04-19T03:02:23.534 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00012344600000000001 2024-04-19T03:02:23.534 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.534 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.534 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:23.534 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.015680+0000", 2024-04-19T03:02:23.534 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0030246470000000001 2024-04-19T03:02:23.534 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.534 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.534 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:23.534 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.023091+0000", 2024-04-19T03:02:23.534 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0074116030000000001 2024-04-19T03:02:23.535 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.535 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.535 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:23.535 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.023115+0000", 2024-04-19T03:02:23.535 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.3091999999999998e-05 2024-04-19T03:02:23.535 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.535 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.535 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:23.535 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.023132+0000", 2024-04-19T03:02:23.535 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7901999999999999e-05 2024-04-19T03:02:23.535 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:23.535 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:23.535 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:23.535 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.536 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.536 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:29 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:02:23.536 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:01:14.998527+0000", 2024-04-19T03:02:23.536 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 68.519791986000001, 2024-04-19T03:02:23.536 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.024738599999999999, 2024-04-19T03:02:23.536 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:23.536 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:23.536 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:23.536 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.536 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:23.536 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998527+0000", 2024-04-19T03:02:23.536 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:23.536 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.536 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.537 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:23.537 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998527+0000", 2024-04-19T03:02:23.537 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:23.537 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.537 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.537 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:23.537 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998527+0000", 2024-04-19T03:02:23.537 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:23.537 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.537 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.537 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:23.537 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998531+0000", 2024-04-19T03:02:23.537 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9450000000000001e-06 2024-04-19T03:02:23.537 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.538 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.538 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:23.538 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998541+0000", 2024-04-19T03:02:23.538 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.4320000000000005e-06 2024-04-19T03:02:23.538 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.538 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.538 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:23.538 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998548+0000", 2024-04-19T03:02:23.538 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.221e-06 2024-04-19T03:02:23.538 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.538 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.538 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:23.538 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998620+0000", 2024-04-19T03:02:23.539 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.1676999999999998e-05 2024-04-19T03:02:23.539 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.539 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.539 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:02:23.539 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998624+0000", 2024-04-19T03:02:23.539 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4850000000000003e-06 2024-04-19T03:02:23.539 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.539 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.539 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:23.539 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.013261+0000", 2024-04-19T03:02:23.539 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.014636451999999999 2024-04-19T03:02:23.539 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.539 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.539 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:23.540 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.013364+0000", 2024-04-19T03:02:23.540 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000102885 2024-04-19T03:02:23.540 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.540 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.540 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:02:23.540 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.013481+0000", 2024-04-19T03:02:23.540 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00011783299999999999 2024-04-19T03:02:23.540 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.540 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.540 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:23.540 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.016265+0000", 2024-04-19T03:02:23.540 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0027834539999999999 2024-04-19T03:02:23.540 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.540 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.541 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:23.541 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.023180+0000", 2024-04-19T03:02:23.541 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0069149399999999996 2024-04-19T03:02:23.541 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.541 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.541 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:23.541 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.023230+0000", 2024-04-19T03:02:23.541 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0220999999999999e-05 2024-04-19T03:02:23.541 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.541 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.541 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:23.541 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.023266+0000", 2024-04-19T03:02:23.541 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5703e-05 2024-04-19T03:02:23.542 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:23.542 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:23.542 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:23.542 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.542 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.542 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(mds.0.3:30 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e20)", 2024-04-19T03:02:23.542 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:01:14.998577+0000", 2024-04-19T03:02:23.542 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 68.519741878999994, 2024-04-19T03:02:23.542 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.024774022999999999, 2024-04-19T03:02:23.542 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:23.542 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:23.542 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:23.542 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.542 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:23.543 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998577+0000", 2024-04-19T03:02:23.543 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:23.543 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.543 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.543 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:23.543 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998577+0000", 2024-04-19T03:02:23.543 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:23.543 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.543 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.543 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:23.543 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998576+0000", 2024-04-19T03:02:23.543 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:23.543 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.544 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.544 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:23.544 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998583+0000", 2024-04-19T03:02:23.544 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8850000000000001e-06 2024-04-19T03:02:23.544 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.544 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.544 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:23.544 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998597+0000", 2024-04-19T03:02:23.544 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.362e-05 2024-04-19T03:02:23.544 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.544 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.544 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:23.544 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998607+0000", 2024-04-19T03:02:23.544 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0389e-05 2024-04-19T03:02:23.545 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.545 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.545 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:23.545 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998713+0000", 2024-04-19T03:02:23.545 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000105338 2024-04-19T03:02:23.545 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.545 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.545 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:02:23.545 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:14.998720+0000", 2024-04-19T03:02:23.545 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2370000000000003e-06 2024-04-19T03:02:23.545 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.545 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.545 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:23.545 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.014014+0000", 2024-04-19T03:02:23.545 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.015294116999999999 2024-04-19T03:02:23.546 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.546 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.546 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:23.546 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.014091+0000", 2024-04-19T03:02:23.546 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7148000000000001e-05 2024-04-19T03:02:23.546 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.546 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.546 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:02:23.546 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.014271+0000", 2024-04-19T03:02:23.546 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00017962699999999999 2024-04-19T03:02:23.546 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.546 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.546 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:23.546 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.018024+0000", 2024-04-19T03:02:23.547 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0037529809999999999 2024-04-19T03:02:23.547 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.547 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.547 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:23.547 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.023303+0000", 2024-04-19T03:02:23.547 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0052793099999999997 2024-04-19T03:02:23.547 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.547 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.547 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:23.547 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.023331+0000", 2024-04-19T03:02:23.547 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.8013000000000001e-05 2024-04-19T03:02:23.547 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.547 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.547 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:23.548 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:01:15.023351+0000", 2024-04-19T03:02:23.548 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0225999999999999e-05 2024-04-19T03:02:23.548 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:23.548 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:23.548 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:23.548 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.548 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.548 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:78992 5.7 5:e6baa862:::benchmark_data_smithi096_19531_object78991:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-19T03:02:23.548 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:18.008888+0000", 2024-04-19T03:02:23.548 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 5.5094308070000002, 2024-04-19T03:02:23.548 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.056375285999999997, 2024-04-19T03:02:23.548 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:23.548 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:23.548 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:23.549 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:23.549 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:23.549 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 78992 2024-04-19T03:02:23.549 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.549 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:23.549 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.549 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:23.549 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.008888+0000", 2024-04-19T03:02:23.549 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:23.549 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.549 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.549 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:23.549 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.008888+0000", 2024-04-19T03:02:23.549 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:23.549 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.550 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.550 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:23.550 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.008888+0000", 2024-04-19T03:02:23.550 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:23.550 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.550 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.550 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:23.550 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.008928+0000", 2024-04-19T03:02:23.550 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0361999999999997e-05 2024-04-19T03:02:23.550 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.550 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.550 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:23.550 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.008942+0000", 2024-04-19T03:02:23.551 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4365000000000001e-05 2024-04-19T03:02:23.551 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.551 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.551 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:23.551 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.008949+0000", 2024-04-19T03:02:23.551 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.212e-06 2024-04-19T03:02:23.551 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.551 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.551 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:23.551 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.012683+0000", 2024-04-19T03:02:23.551 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.003733934 2024-04-19T03:02:23.551 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.551 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.551 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:23.551 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.012798+0000", 2024-04-19T03:02:23.552 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00011574999999999999 2024-04-19T03:02:23.552 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.552 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.552 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:23.552 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.012896+0000", 2024-04-19T03:02:23.552 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.7848000000000002e-05 2024-04-19T03:02:23.552 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.552 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.552 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:23.552 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016423+0000", 2024-04-19T03:02:23.552 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0035270789999999998 2024-04-19T03:02:23.552 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.552 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.552 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:23.553 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.065098+0000", 2024-04-19T03:02:23.553 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.048674651999999999 2024-04-19T03:02:23.553 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.553 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.553 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:23.553 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.065193+0000", 2024-04-19T03:02:23.553 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.5087999999999995e-05 2024-04-19T03:02:23.553 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.553 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.553 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:23.553 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.065264+0000", 2024-04-19T03:02:23.553 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0666000000000004e-05 2024-04-19T03:02:23.553 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:23.553 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:23.554 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:23.554 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.554 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.554 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:78998 5.7 5:ee23c1bc:::benchmark_data_smithi096_19531_object78997:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-19T03:02:23.554 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:18.013165+0000", 2024-04-19T03:02:23.554 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 5.5051541010000005, 2024-04-19T03:02:23.554 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.052410864000000001, 2024-04-19T03:02:23.554 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:23.554 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:23.554 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:23.554 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:23.554 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:23.554 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 78998 2024-04-19T03:02:23.554 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.555 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:23.555 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.555 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:23.555 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.013165+0000", 2024-04-19T03:02:23.555 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:23.555 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.555 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.555 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:23.555 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.013165+0000", 2024-04-19T03:02:23.555 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:23.555 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.555 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.555 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:23.555 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.013164+0000", 2024-04-19T03:02:23.556 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:23.556 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.556 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.556 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:23.556 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.013214+0000", 2024-04-19T03:02:23.556 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9636999999999999e-05 2024-04-19T03:02:23.556 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.556 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.556 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:23.556 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.013223+0000", 2024-04-19T03:02:23.556 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.3619999999999995e-06 2024-04-19T03:02:23.556 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.556 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.556 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:23.557 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.013229+0000", 2024-04-19T03:02:23.557 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6060000000000002e-06 2024-04-19T03:02:23.557 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.557 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.557 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:23.557 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.014882+0000", 2024-04-19T03:02:23.557 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001653257 2024-04-19T03:02:23.557 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.557 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.557 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:23.557 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.014958+0000", 2024-04-19T03:02:23.557 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6398999999999998e-05 2024-04-19T03:02:23.557 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.557 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.558 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:23.558 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.015036+0000", 2024-04-19T03:02:23.558 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8070000000000003e-05 2024-04-19T03:02:23.558 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.558 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.558 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:23.558 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018099+0000", 2024-04-19T03:02:23.558 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0030631149999999999 2024-04-19T03:02:23.558 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.558 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.558 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:23.558 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.065328+0000", 2024-04-19T03:02:23.558 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.047228349000000003 2024-04-19T03:02:23.559 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.559 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.559 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:23.559 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.065508+0000", 2024-04-19T03:02:23.559 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00018036899999999999 2024-04-19T03:02:23.559 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.559 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.559 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:23.559 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.065576+0000", 2024-04-19T03:02:23.559 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7785000000000002e-05 2024-04-19T03:02:23.559 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:23.559 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:23.559 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:23.559 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.559 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.560 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4755.0:78995 5.2 e40/39 5:42b55e12:::benchmark_data_smithi096_19531_object78994:head v 40'4934, mlcod=40'4932)", 2024-04-19T03:02:23.560 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:18.016247+0000", 2024-04-19T03:02:23.560 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 5.502072139, 2024-04-19T03:02:23.560 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.056240406, 2024-04-19T03:02:23.560 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:23.560 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:23.560 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:23.560 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.560 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:23.560 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016247+0000", 2024-04-19T03:02:23.560 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:23.560 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.560 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.561 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:23.561 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016247+0000", 2024-04-19T03:02:23.561 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:23.561 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.561 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.561 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:23.561 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016246+0000", 2024-04-19T03:02:23.561 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:23.561 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.561 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.561 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:23.561 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016315+0000", 2024-04-19T03:02:23.561 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8979000000000005e-05 2024-04-19T03:02:23.561 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.561 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.562 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:23.562 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016333+0000", 2024-04-19T03:02:23.562 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7586999999999999e-05 2024-04-19T03:02:23.562 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.562 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.562 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:23.562 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016340+0000", 2024-04-19T03:02:23.562 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4080000000000001e-06 2024-04-19T03:02:23.562 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.562 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.562 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:23.562 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016384+0000", 2024-04-19T03:02:23.562 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3656999999999999e-05 2024-04-19T03:02:23.562 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.563 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.563 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:23.563 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016403+0000", 2024-04-19T03:02:23.563 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9089e-05 2024-04-19T03:02:23.563 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.563 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.563 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:23.563 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.072448+0000", 2024-04-19T03:02:23.563 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.056045084000000002 2024-04-19T03:02:23.563 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.563 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.563 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:23.563 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.072487+0000", 2024-04-19T03:02:23.563 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9362e-05 2024-04-19T03:02:23.563 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:23.564 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:23.564 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:23.564 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.564 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.564 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4755.0:78994 5.c e40/22 5:3c60d55d:::benchmark_data_smithi096_19531_object78993:head v 40'4989, mlcod=40'4987)", 2024-04-19T03:02:23.564 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:18.016392+0000", 2024-04-19T03:02:23.564 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 5.5019274979999997, 2024-04-19T03:02:23.564 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.052629620000000002, 2024-04-19T03:02:23.564 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:23.564 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:23.564 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:23.564 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.564 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:23.564 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016392+0000", 2024-04-19T03:02:23.565 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:23.565 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.565 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.565 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:23.565 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016392+0000", 2024-04-19T03:02:23.565 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:23.565 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.565 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.565 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:23.565 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016391+0000", 2024-04-19T03:02:23.565 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:23.565 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.565 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.565 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:23.566 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016471+0000", 2024-04-19T03:02:23.566 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9346999999999998e-05 2024-04-19T03:02:23.566 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.566 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.566 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:23.566 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016478+0000", 2024-04-19T03:02:23.566 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.593e-06 2024-04-19T03:02:23.566 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.566 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.566 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:23.566 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016495+0000", 2024-04-19T03:02:23.566 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6492999999999999e-05 2024-04-19T03:02:23.566 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.566 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.567 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:23.567 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016539+0000", 2024-04-19T03:02:23.567 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4715999999999997e-05 2024-04-19T03:02:23.567 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.567 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.567 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:23.567 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016551+0000", 2024-04-19T03:02:23.567 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2096000000000001e-05 2024-04-19T03:02:23.567 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.567 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.567 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:23.567 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.068985+0000", 2024-04-19T03:02:23.567 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.052433754999999999 2024-04-19T03:02:23.567 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.568 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.568 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:23.568 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.069021+0000", 2024-04-19T03:02:23.568 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6047000000000002e-05 2024-04-19T03:02:23.568 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:23.568 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:23.568 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:23.568 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.568 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.568 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4755.0:78997 5.5 e40/22 5:a5289197:::benchmark_data_smithi096_19531_object78996:head v 40'4896, mlcod=40'4894)", 2024-04-19T03:02:23.568 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:18.016507+0000", 2024-04-19T03:02:23.568 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 5.501811655, 2024-04-19T03:02:23.568 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.049953264999999997, 2024-04-19T03:02:23.569 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:23.569 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:23.569 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:23.569 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.569 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:23.569 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016507+0000", 2024-04-19T03:02:23.569 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:23.569 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.569 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.569 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:23.569 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016507+0000", 2024-04-19T03:02:23.569 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:23.569 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.569 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.570 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:23.570 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016507+0000", 2024-04-19T03:02:23.570 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:23.570 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.570 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.570 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:23.570 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016551+0000", 2024-04-19T03:02:23.570 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3412999999999999e-05 2024-04-19T03:02:23.570 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.570 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.570 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:23.570 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016558+0000", 2024-04-19T03:02:23.570 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.002e-06 2024-04-19T03:02:23.570 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.571 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.571 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:23.571 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016563+0000", 2024-04-19T03:02:23.571 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7509999999999997e-06 2024-04-19T03:02:23.571 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.571 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.571 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:23.571 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016604+0000", 2024-04-19T03:02:23.571 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0426999999999998e-05 2024-04-19T03:02:23.571 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.571 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.571 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:23.571 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016615+0000", 2024-04-19T03:02:23.572 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1466e-05 2024-04-19T03:02:23.572 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.572 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.572 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:23.572 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.066373+0000", 2024-04-19T03:02:23.572 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.049757639999999999 2024-04-19T03:02:23.572 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.572 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.572 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:23.572 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.066461+0000", 2024-04-19T03:02:23.572 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.7884000000000001e-05 2024-04-19T03:02:23.572 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:23.572 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:23.572 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:23.572 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.573 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.573 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4755.0:78996 5.1 e40/39 5:87f59708:::benchmark_data_smithi096_19531_object78995:head v 40'4940, mlcod=40'4938)", 2024-04-19T03:02:23.573 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:18.016581+0000", 2024-04-19T03:02:23.573 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 5.5017383330000005, 2024-04-19T03:02:23.573 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.052051785000000003, 2024-04-19T03:02:23.573 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:23.573 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:23.573 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:23.573 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.573 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:23.573 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016581+0000", 2024-04-19T03:02:23.573 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:23.573 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.573 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.573 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:23.574 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016581+0000", 2024-04-19T03:02:23.574 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:23.574 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.574 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.574 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:23.574 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016581+0000", 2024-04-19T03:02:23.574 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:23.574 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.574 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.574 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:23.574 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016610+0000", 2024-04-19T03:02:23.574 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9556999999999998e-05 2024-04-19T03:02:23.574 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.575 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.575 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:23.575 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016616+0000", 2024-04-19T03:02:23.575 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1090000000000003e-06 2024-04-19T03:02:23.575 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.575 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.575 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:23.575 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016621+0000", 2024-04-19T03:02:23.575 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.454e-06 2024-04-19T03:02:23.575 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.575 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.575 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:23.575 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016663+0000", 2024-04-19T03:02:23.575 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2582e-05 2024-04-19T03:02:23.575 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.576 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.576 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:23.576 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016681+0000", 2024-04-19T03:02:23.576 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7680999999999999e-05 2024-04-19T03:02:23.576 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.576 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.576 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:23.576 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.068486+0000", 2024-04-19T03:02:23.576 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.051804624000000001 2024-04-19T03:02:23.576 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.576 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.576 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:23.576 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.068633+0000", 2024-04-19T03:02:23.576 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00014709099999999999 2024-04-19T03:02:23.577 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:23.577 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:23.577 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:23.577 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.577 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.577 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4755.0:78999 5.3 e40/22 5:c9ec5f7f:::benchmark_data_smithi096_19531_object78998:head v 40'4893, mlcod=40'4889)", 2024-04-19T03:02:23.577 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:18.016633+0000", 2024-04-19T03:02:23.577 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 5.5016864779999999, 2024-04-19T03:02:23.577 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.051090469999999999, 2024-04-19T03:02:23.577 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:23.577 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:23.577 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:23.577 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.577 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:23.578 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016633+0000", 2024-04-19T03:02:23.578 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:23.578 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.578 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.578 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:23.578 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016633+0000", 2024-04-19T03:02:23.578 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:23.578 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.578 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.578 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:23.578 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016632+0000", 2024-04-19T03:02:23.578 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967296 2024-04-19T03:02:23.578 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.578 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.579 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:23.579 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016660+0000", 2024-04-19T03:02:23.579 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7869999999999999e-05 2024-04-19T03:02:23.579 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.579 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.579 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:23.579 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016667+0000", 2024-04-19T03:02:23.579 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0280000000000003e-06 2024-04-19T03:02:23.579 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.579 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.579 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:23.579 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016672+0000", 2024-04-19T03:02:23.579 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0069999999999997e-06 2024-04-19T03:02:23.579 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.580 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.580 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:23.580 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016725+0000", 2024-04-19T03:02:23.580 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2812000000000002e-05 2024-04-19T03:02:23.580 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.580 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.580 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:23.580 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016750+0000", 2024-04-19T03:02:23.580 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5038e-05 2024-04-19T03:02:23.580 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.580 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.580 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:23.580 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.067673+0000", 2024-04-19T03:02:23.581 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.050922350999999998 2024-04-19T03:02:23.581 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.581 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.581 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:23.581 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.067723+0000", 2024-04-19T03:02:23.581 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0586e-05 2024-04-19T03:02:23.581 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:23.581 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:23.581 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:23.581 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.581 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.581 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4755.0:79003 5.2 e40/39 5:4436e33f:::benchmark_data_smithi096_19531_object79002:head v 40'4935, mlcod=40'4932)", 2024-04-19T03:02:23.581 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:18.018102+0000", 2024-04-19T03:02:23.581 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 5.500216751, 2024-04-19T03:02:23.582 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.060023990999999999, 2024-04-19T03:02:23.582 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:23.582 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:23.582 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:23.582 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.582 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:23.582 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018102+0000", 2024-04-19T03:02:23.582 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:23.582 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.582 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.582 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:23.582 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018102+0000", 2024-04-19T03:02:23.582 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:23.583 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.583 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.583 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:23.583 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018102+0000", 2024-04-19T03:02:23.583 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:23.583 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.583 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.583 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:23.583 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018134+0000", 2024-04-19T03:02:23.583 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2722000000000003e-05 2024-04-19T03:02:23.583 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.583 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.583 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:23.583 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018145+0000", 2024-04-19T03:02:23.583 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0395e-05 2024-04-19T03:02:23.584 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.584 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.584 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:23.584 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018151+0000", 2024-04-19T03:02:23.584 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5300000000000002e-06 2024-04-19T03:02:23.584 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.584 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.584 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:23.584 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018489+0000", 2024-04-19T03:02:23.584 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00033731499999999998 2024-04-19T03:02:23.584 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.584 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.584 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:23.584 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018508+0000", 2024-04-19T03:02:23.585 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9775e-05 2024-04-19T03:02:23.585 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.585 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.585 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:23.585 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.078059+0000", 2024-04-19T03:02:23.585 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.059550171999999998 2024-04-19T03:02:23.585 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.585 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.585 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:23.585 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.078126+0000", 2024-04-19T03:02:23.585 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7773000000000003e-05 2024-04-19T03:02:23.585 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:23.585 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:23.585 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:23.585 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.586 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.586 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4755.0:79005 5.1 e40/39 5:85b46038:::benchmark_data_smithi096_19531_object79004:head v 40'4941, mlcod=40'4938)", 2024-04-19T03:02:23.586 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:18.018167+0000", 2024-04-19T03:02:23.586 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 5.5001520319999999, 2024-04-19T03:02:23.586 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.052768941999999999, 2024-04-19T03:02:23.586 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:23.586 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:23.586 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:23.586 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.586 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:23.586 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018167+0000", 2024-04-19T03:02:23.586 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:23.586 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.586 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.587 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:23.587 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018167+0000", 2024-04-19T03:02:23.587 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:23.587 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.587 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.587 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:23.587 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018167+0000", 2024-04-19T03:02:23.587 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:23.587 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.587 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.587 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:23.587 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018196+0000", 2024-04-19T03:02:23.587 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9538000000000001e-05 2024-04-19T03:02:23.587 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.588 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.588 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:23.588 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018204+0000", 2024-04-19T03:02:23.588 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2599999999999999e-06 2024-04-19T03:02:23.588 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.588 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.588 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:23.588 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018208+0000", 2024-04-19T03:02:23.588 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8080000000000004e-06 2024-04-19T03:02:23.588 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.588 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.588 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:23.588 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.064933+0000", 2024-04-19T03:02:23.588 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.046725048999999998 2024-04-19T03:02:23.588 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.589 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.589 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:23.589 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.064964+0000", 2024-04-19T03:02:23.589 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0577000000000002e-05 2024-04-19T03:02:23.589 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.589 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.589 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:23.589 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.070815+0000", 2024-04-19T03:02:23.589 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0058510649999999999 2024-04-19T03:02:23.589 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.589 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.589 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:23.589 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.070936+0000", 2024-04-19T03:02:23.589 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00012095399999999999 2024-04-19T03:02:23.590 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:23.590 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:23.590 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:23.590 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.590 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.590 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4755.0:79006 5.3 e40/22 5:cf79182f:::benchmark_data_smithi096_19531_object79005:head v 40'4894, mlcod=40'4891)", 2024-04-19T03:02:23.590 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:18.021648+0000", 2024-04-19T03:02:23.590 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 5.4966715260000001, 2024-04-19T03:02:23.590 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.048705480000000002, 2024-04-19T03:02:23.590 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:23.590 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:23.590 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:23.590 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.590 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:23.591 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.021648+0000", 2024-04-19T03:02:23.591 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:23.591 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.591 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.591 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:23.591 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.021648+0000", 2024-04-19T03:02:23.591 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:23.591 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.591 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.591 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:23.591 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.021647+0000", 2024-04-19T03:02:23.591 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:23.591 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.591 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.592 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:23.592 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.021691+0000", 2024-04-19T03:02:23.592 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3852e-05 2024-04-19T03:02:23.592 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.592 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.592 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:23.592 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.064275+0000", 2024-04-19T03:02:23.592 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.042584135000000002 2024-04-19T03:02:23.592 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.592 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.592 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:23.592 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.064287+0000", 2024-04-19T03:02:23.592 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2437e-05 2024-04-19T03:02:23.592 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.592 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.593 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:23.593 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.064370+0000", 2024-04-19T03:02:23.593 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2924999999999996e-05 2024-04-19T03:02:23.593 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.593 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.593 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:23.593 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.064399+0000", 2024-04-19T03:02:23.593 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.8778000000000001e-05 2024-04-19T03:02:23.593 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.593 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.593 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:23.593 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.070324+0000", 2024-04-19T03:02:23.593 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0059246250000000002 2024-04-19T03:02:23.593 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.594 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.594 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:23.594 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.070353+0000", 2024-04-19T03:02:23.594 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9436000000000001e-05 2024-04-19T03:02:23.594 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:23.594 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:23.594 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:23.594 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.594 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.594 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:82106 5.f 5:fc183e9a:::benchmark_data_smithi096_19531_object82105:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-19T03:02:23.594 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:19.915911+0000", 2024-04-19T03:02:23.594 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 3.6024086209999999, 2024-04-19T03:02:23.594 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.028421080000000001, 2024-04-19T03:02:23.594 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:23.595 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:23.595 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:23.595 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:23.595 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:23.595 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 82106 2024-04-19T03:02:23.595 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.595 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:23.595 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.595 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:23.595 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:19.915911+0000", 2024-04-19T03:02:23.595 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:23.595 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.595 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.595 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:23.596 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:19.915911+0000", 2024-04-19T03:02:23.596 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:23.596 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.596 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.596 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:23.596 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:19.915910+0000", 2024-04-19T03:02:23.596 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:23.596 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.596 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.596 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:23.596 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:19.915947+0000", 2024-04-19T03:02:23.596 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7931e-05 2024-04-19T03:02:23.596 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.596 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.597 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:23.597 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:19.915959+0000", 2024-04-19T03:02:23.597 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2001000000000001e-05 2024-04-19T03:02:23.597 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.597 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.597 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:23.597 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:19.915967+0000", 2024-04-19T03:02:23.597 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0090000000000007e-06 2024-04-19T03:02:23.597 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.597 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.597 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:23.597 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:19.930274+0000", 2024-04-19T03:02:23.597 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.014306591 2024-04-19T03:02:23.597 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.597 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.598 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:23.598 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:19.930440+0000", 2024-04-19T03:02:23.598 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00016622800000000001 2024-04-19T03:02:23.598 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.598 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.598 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:02:23.598 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:19.930619+0000", 2024-04-19T03:02:23.598 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000178421 2024-04-19T03:02:23.598 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.598 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.598 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:23.598 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:19.936406+0000", 2024-04-19T03:02:23.598 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0057876630000000002 2024-04-19T03:02:23.598 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.599 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.599 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:23.599 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:19.944228+0000", 2024-04-19T03:02:23.599 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0078213359999999999 2024-04-19T03:02:23.599 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.599 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.599 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:23.599 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:19.944279+0000", 2024-04-19T03:02:23.599 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1400999999999998e-05 2024-04-19T03:02:23.599 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.599 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.599 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:23.599 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:19.944332+0000", 2024-04-19T03:02:23.599 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2485999999999999e-05 2024-04-19T03:02:23.599 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:23.600 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:23.600 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:23.600 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.600 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.600 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:82110 5.f 5:f3acfb5e:::benchmark_data_smithi096_19531_object82109:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2024-04-19T03:02:23.600 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:19.918314+0000", 2024-04-19T03:02:23.600 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 3.6000049020000002, 2024-04-19T03:02:23.600 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.026113954000000002, 2024-04-19T03:02:23.600 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:23.600 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:23.600 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:23.600 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:23.600 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:23.600 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 82110 2024-04-19T03:02:23.601 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.601 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:23.601 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.601 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:23.601 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:19.918314+0000", 2024-04-19T03:02:23.601 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:23.601 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.601 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.601 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:23.601 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:19.918314+0000", 2024-04-19T03:02:23.601 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:23.601 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.601 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.601 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:23.601 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:19.918313+0000", 2024-04-19T03:02:23.602 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:23.602 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.602 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.602 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:23.602 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:19.918365+0000", 2024-04-19T03:02:23.602 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2086999999999998e-05 2024-04-19T03:02:23.602 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.602 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.602 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:23.602 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:19.918375+0000", 2024-04-19T03:02:23.602 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.7450000000000007e-06 2024-04-19T03:02:23.602 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.602 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.602 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:23.603 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:19.918381+0000", 2024-04-19T03:02:23.603 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5099999999999998e-06 2024-04-19T03:02:23.603 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.603 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.603 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:23.603 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:19.932961+0000", 2024-04-19T03:02:23.603 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.014580492 2024-04-19T03:02:23.603 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.603 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.603 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:23.603 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:19.933113+0000", 2024-04-19T03:02:23.603 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000152027 2024-04-19T03:02:23.603 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.603 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.604 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:02:23.604 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:19.933201+0000", 2024-04-19T03:02:23.604 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.8269999999999993e-05 2024-04-19T03:02:23.604 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.604 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.604 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:23.604 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:19.944183+0000", 2024-04-19T03:02:23.604 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.010981853999999999 2024-04-19T03:02:23.604 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.604 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.604 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:23.604 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:19.944354+0000", 2024-04-19T03:02:23.604 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00017105700000000001 2024-04-19T03:02:23.604 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.605 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.605 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:23.605 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:19.944386+0000", 2024-04-19T03:02:23.605 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2036999999999998e-05 2024-04-19T03:02:23.605 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.605 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.605 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:23.605 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:19.944428+0000", 2024-04-19T03:02:23.605 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1792999999999998e-05 2024-04-19T03:02:23.605 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:23.605 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:23.605 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:23.605 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.605 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.606 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:86612 5.7 5:e32e3c49:::benchmark_data_smithi096_19531_object86611:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:23.606 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:22.633560+0000", 2024-04-19T03:02:23.606 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.88475909100000005, 2024-04-19T03:02:23.606 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.19135289, 2024-04-19T03:02:23.606 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:23.606 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:23.606 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:23.606 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:23.606 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:23.606 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 86612 2024-04-19T03:02:23.606 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.606 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:23.606 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.606 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:23.607 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633560+0000", 2024-04-19T03:02:23.607 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:23.607 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.607 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.607 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:23.607 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633560+0000", 2024-04-19T03:02:23.607 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:23.607 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.607 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.607 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:23.607 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633558+0000", 2024-04-19T03:02:23.607 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:23.607 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.607 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.607 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:23.608 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633609+0000", 2024-04-19T03:02:23.608 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0850999999999998e-05 2024-04-19T03:02:23.608 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.608 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.608 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:23.608 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633627+0000", 2024-04-19T03:02:23.608 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7951000000000001e-05 2024-04-19T03:02:23.608 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.608 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.608 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:23.608 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633635+0000", 2024-04-19T03:02:23.608 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2530000000000004e-06 2024-04-19T03:02:23.608 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.608 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.608 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:23.609 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633699+0000", 2024-04-19T03:02:23.609 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3901999999999999e-05 2024-04-19T03:02:23.609 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.609 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.609 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:23.609 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633992+0000", 2024-04-19T03:02:23.609 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00029283299999999999 2024-04-19T03:02:23.609 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.609 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.609 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:23.609 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.634223+0000", 2024-04-19T03:02:23.609 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00023084200000000001 2024-04-19T03:02:23.609 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.609 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.610 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:23.610 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.639085+0000", 2024-04-19T03:02:23.610 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0048624269999999999 2024-04-19T03:02:23.610 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.610 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.610 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:23.610 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.824635+0000", 2024-04-19T03:02:23.610 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.18554944700000001 2024-04-19T03:02:23.610 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.610 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.610 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:23.610 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.824793+0000", 2024-04-19T03:02:23.610 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000157959 2024-04-19T03:02:23.610 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.611 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.611 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:23.611 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.824913+0000", 2024-04-19T03:02:23.611 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000120093 2024-04-19T03:02:23.611 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:23.611 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:23.611 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:23.611 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.611 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.611 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:86625 5.7 5:e6d00488:::benchmark_data_smithi096_19531_object86624:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:23.611 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:22.643554+0000", 2024-04-19T03:02:23.611 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.87476532500000004, 2024-04-19T03:02:23.611 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.18732841, 2024-04-19T03:02:23.611 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:23.612 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:23.612 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:23.612 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:23.612 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:23.612 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 86625 2024-04-19T03:02:23.612 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.612 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:23.612 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.612 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:23.612 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643554+0000", 2024-04-19T03:02:23.612 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:23.612 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.612 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.612 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:23.613 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643554+0000", 2024-04-19T03:02:23.613 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:23.613 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.613 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.613 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:23.613 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643552+0000", 2024-04-19T03:02:23.613 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:23.613 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.613 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.613 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:23.613 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643588+0000", 2024-04-19T03:02:23.613 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5855999999999997e-05 2024-04-19T03:02:23.613 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.613 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.613 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:23.614 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643606+0000", 2024-04-19T03:02:23.614 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8226000000000001e-05 2024-04-19T03:02:23.614 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.614 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.614 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:23.614 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643618+0000", 2024-04-19T03:02:23.614 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1868000000000001e-05 2024-04-19T03:02:23.614 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.614 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.614 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:23.614 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643676+0000", 2024-04-19T03:02:23.614 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8153999999999999e-05 2024-04-19T03:02:23.614 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.614 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.615 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:23.615 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643905+0000", 2024-04-19T03:02:23.615 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00022847500000000001 2024-04-19T03:02:23.615 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.615 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.615 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:23.615 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.644150+0000", 2024-04-19T03:02:23.615 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00024531800000000001 2024-04-19T03:02:23.615 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.615 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.615 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:23.615 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.647407+0000", 2024-04-19T03:02:23.615 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0032563190000000001 2024-04-19T03:02:23.615 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.616 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.616 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:23.616 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.830721+0000", 2024-04-19T03:02:23.616 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.18331468300000001 2024-04-19T03:02:23.616 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.616 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.616 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:23.616 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.830813+0000", 2024-04-19T03:02:23.616 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.2205000000000002e-05 2024-04-19T03:02:23.616 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.616 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.616 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:23.616 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.830882+0000", 2024-04-19T03:02:23.616 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8819999999999995e-05 2024-04-19T03:02:23.616 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:23.617 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:23.617 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:23.617 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.617 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.617 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87063 5.7 5:e502e824:::benchmark_data_smithi096_19531_object87062:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:23.617 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.136067+0000", 2024-04-19T03:02:23.617 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.38225245600000002, 2024-04-19T03:02:23.617 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.065521159999999995, 2024-04-19T03:02:23.617 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:23.617 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:23.617 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:23.617 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:23.617 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:23.618 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87063 2024-04-19T03:02:23.618 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.618 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:23.618 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.618 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:23.618 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.136067+0000", 2024-04-19T03:02:23.618 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:23.618 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.618 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.618 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:23.618 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.136067+0000", 2024-04-19T03:02:23.618 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:23.618 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.618 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.619 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:23.619 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.136066+0000", 2024-04-19T03:02:23.619 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:23.619 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.619 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.619 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:23.619 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.136154+0000", 2024-04-19T03:02:23.619 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.8256000000000003e-05 2024-04-19T03:02:23.619 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.619 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.619 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:23.619 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.136162+0000", 2024-04-19T03:02:23.619 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.5099999999999998e-06 2024-04-19T03:02:23.619 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.620 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.620 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:23.620 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.136171+0000", 2024-04-19T03:02:23.620 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2830000000000001e-06 2024-04-19T03:02:23.620 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.620 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.620 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:23.620 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.138421+0000", 2024-04-19T03:02:23.620 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0022506620000000001 2024-04-19T03:02:23.620 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.620 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.620 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:23.620 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.138560+0000", 2024-04-19T03:02:23.620 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000138446 2024-04-19T03:02:23.621 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.621 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.621 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:23.621 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.138689+0000", 2024-04-19T03:02:23.621 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00012950700000000001 2024-04-19T03:02:23.621 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.621 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.621 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:23.621 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.141517+0000", 2024-04-19T03:02:23.621 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0028280860000000001 2024-04-19T03:02:23.621 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.621 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.621 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:23.621 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.201350+0000", 2024-04-19T03:02:23.621 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.059832418999999998 2024-04-19T03:02:23.621 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.622 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.622 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:23.622 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.201485+0000", 2024-04-19T03:02:23.622 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000135597 2024-04-19T03:02:23.622 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.622 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.622 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:23.622 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.201588+0000", 2024-04-19T03:02:23.622 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00010247900000000001 2024-04-19T03:02:23.622 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:23.622 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:23.622 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:23.622 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.622 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.623 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87072 5.7 5:e3c7809a:::benchmark_data_smithi096_19531_object87071:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:23.623 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.144224+0000", 2024-04-19T03:02:23.623 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.37409543200000001, 2024-04-19T03:02:23.623 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.058179555000000001, 2024-04-19T03:02:23.623 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:23.623 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:23.623 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:23.623 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:23.623 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:23.623 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87072 2024-04-19T03:02:23.623 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.623 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:23.623 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.623 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:23.623 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144224+0000", 2024-04-19T03:02:23.624 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:23.624 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.624 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.624 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:23.624 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144224+0000", 2024-04-19T03:02:23.624 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:23.624 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.624 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.624 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:23.624 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144223+0000", 2024-04-19T03:02:23.624 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:23.624 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.624 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.624 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:23.624 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144320+0000", 2024-04-19T03:02:23.625 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.7075000000000001e-05 2024-04-19T03:02:23.625 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.625 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.625 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:23.625 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144331+0000", 2024-04-19T03:02:23.625 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1342000000000001e-05 2024-04-19T03:02:23.625 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.625 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.625 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:23.625 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144337+0000", 2024-04-19T03:02:23.625 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8390000000000003e-06 2024-04-19T03:02:23.625 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.625 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.625 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:23.626 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144369+0000", 2024-04-19T03:02:23.626 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2079000000000002e-05 2024-04-19T03:02:23.626 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.626 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.626 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:23.626 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144464+0000", 2024-04-19T03:02:23.626 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.4623000000000005e-05 2024-04-19T03:02:23.626 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.626 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.626 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:23.626 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144553+0000", 2024-04-19T03:02:23.626 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9171000000000004e-05 2024-04-19T03:02:23.626 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.627 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.627 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:23.627 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.147018+0000", 2024-04-19T03:02:23.627 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0024648370000000001 2024-04-19T03:02:23.627 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.627 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.627 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:23.627 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.202270+0000", 2024-04-19T03:02:23.627 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.055252018 2024-04-19T03:02:23.627 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.627 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.627 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:23.627 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.202356+0000", 2024-04-19T03:02:23.627 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6648000000000001e-05 2024-04-19T03:02:23.628 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:23.628 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:23.628 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:23.628 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.202403+0000", 2024-04-19T03:02:23.628 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6956999999999998e-05 2024-04-19T03:02:23.628 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:23.628 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:23.628 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:23.628 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:23.628 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:23.628 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-04-19T03:02:23.630 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T03:02:23.630 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:23.627+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:23.731 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:23.727+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:23.743 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-19T03:02:23.743 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-04-19T03:02:23.743 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.743 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87135 5.4 5:2a97e7b7:::benchmark_data_smithi096_19531_object87134:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:23.743 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.240884+0000", 2024-04-19T03:02:23.744 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.50156274499999998, 2024-04-19T03:02:23.744 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.50161272099999998, 2024-04-19T03:02:23.744 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:23.744 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "waiting for peered", 2024-04-19T03:02:23.744 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:23.744 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:23.744 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:23.744 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87135 2024-04-19T03:02:23.744 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.744 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:23.744 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.744 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:23.744 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240884+0000", 2024-04-19T03:02:23.745 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:23.745 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.745 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.745 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:23.745 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240884+0000", 2024-04-19T03:02:23.745 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:23.745 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.745 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.745 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:23.745 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240883+0000", 2024-04-19T03:02:23.745 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:23.745 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.745 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.746 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:23.746 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240933+0000", 2024-04-19T03:02:23.746 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9969999999999998e-05 2024-04-19T03:02:23.746 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.746 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.746 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:23.746 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240946+0000", 2024-04-19T03:02:23.746 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2943e-05 2024-04-19T03:02:23.746 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.746 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.746 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:23.746 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240952+0000", 2024-04-19T03:02:23.746 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8930000000000002e-06 2024-04-19T03:02:23.747 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.747 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.747 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:23.747 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240994+0000", 2024-04-19T03:02:23.747 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2753999999999998e-05 2024-04-19T03:02:23.747 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.747 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.747 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:23.747 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.241092+0000", 2024-04-19T03:02:23.747 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.7447000000000004e-05 2024-04-19T03:02:23.747 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.747 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.747 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:23.747 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.241183+0000", 2024-04-19T03:02:23.748 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1163999999999997e-05 2024-04-19T03:02:23.748 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.748 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.748 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:23.748 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.254672+0000", 2024-04-19T03:02:23.748 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.01348864 2024-04-19T03:02:23.748 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.748 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.748 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:02:23.748 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.254681+0000", 2024-04-19T03:02:23.748 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.3789999999999995e-06 2024-04-19T03:02:23.748 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:23.749 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:23.749 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:23.749 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.749 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.749 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87136 5.4 5:212411bc:::benchmark_data_smithi096_19531_object87135:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:23.749 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.240962+0000", 2024-04-19T03:02:23.749 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.501484869, 2024-04-19T03:02:23.749 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.50166621099999997, 2024-04-19T03:02:23.749 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:23.749 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "waiting for peered", 2024-04-19T03:02:23.749 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:23.749 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:23.749 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:23.750 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87136 2024-04-19T03:02:23.750 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.750 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:23.750 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.750 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:23.750 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240962+0000", 2024-04-19T03:02:23.750 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:23.750 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.750 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.750 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:23.750 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240962+0000", 2024-04-19T03:02:23.750 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:23.750 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.751 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.751 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:23.751 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240961+0000", 2024-04-19T03:02:23.751 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:23.751 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.751 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.751 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:23.751 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240995+0000", 2024-04-19T03:02:23.751 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3868000000000002e-05 2024-04-19T03:02:23.751 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.751 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.751 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:23.751 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.241001+0000", 2024-04-19T03:02:23.751 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.322e-06 2024-04-19T03:02:23.752 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.752 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.752 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:23.752 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.241004+0000", 2024-04-19T03:02:23.752 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3510000000000002e-06 2024-04-19T03:02:23.752 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.752 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.752 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:23.752 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247131+0000", 2024-04-19T03:02:23.752 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0061270869999999998 2024-04-19T03:02:23.752 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.752 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.752 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:23.753 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247322+0000", 2024-04-19T03:02:23.753 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000191015 2024-04-19T03:02:23.753 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.753 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.753 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:23.753 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247542+0000", 2024-04-19T03:02:23.753 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00022030199999999999 2024-04-19T03:02:23.753 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.753 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.753 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:23.753 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.254709+0000", 2024-04-19T03:02:23.753 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0071662660000000001 2024-04-19T03:02:23.753 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.754 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.754 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:02:23.754 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.254716+0000", 2024-04-19T03:02:23.754 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3860000000000001e-06 2024-04-19T03:02:23.754 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:23.754 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:23.754 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:23.754 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.754 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.754 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87108 5.e 5:7e197adc:::benchmark_data_smithi096_19531_object87107:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:23.754 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.223103+0000", 2024-04-19T03:02:23.755 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.51934332000000005, 2024-04-19T03:02:23.755 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.51964648599999996, 2024-04-19T03:02:23.755 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:23.755 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "waiting for peered", 2024-04-19T03:02:23.755 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:23.755 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:23.755 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:23.755 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87108 2024-04-19T03:02:23.755 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.755 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:23.755 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.755 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:23.755 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.223103+0000", 2024-04-19T03:02:23.756 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:23.756 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.756 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.756 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:23.756 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.223103+0000", 2024-04-19T03:02:23.756 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:23.756 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.756 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.756 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:23.756 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.223102+0000", 2024-04-19T03:02:23.756 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:23.756 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.756 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.757 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:23.757 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.223156+0000", 2024-04-19T03:02:23.757 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3958000000000001e-05 2024-04-19T03:02:23.757 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.757 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.757 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:23.757 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.223166+0000", 2024-04-19T03:02:23.757 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.4809999999999995e-06 2024-04-19T03:02:23.757 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.757 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.757 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:23.757 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.223172+0000", 2024-04-19T03:02:23.758 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0140000000000004e-06 2024-04-19T03:02:23.758 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.758 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.758 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:23.758 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.227295+0000", 2024-04-19T03:02:23.758 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0041233420000000003 2024-04-19T03:02:23.758 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.758 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.758 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:23.759 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.227495+0000", 2024-04-19T03:02:23.759 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00019955299999999999 2024-04-19T03:02:23.759 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.759 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.759 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:23.759 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.227717+0000", 2024-04-19T03:02:23.759 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000221902 2024-04-19T03:02:23.759 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.759 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.759 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:23.760 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233189+0000", 2024-04-19T03:02:23.760 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0054718889999999997 2024-04-19T03:02:23.760 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.760 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.760 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:23.760 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.250529+0000", 2024-04-19T03:02:23.760 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.017340298000000001 2024-04-19T03:02:23.760 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.760 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.760 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:02:23.760 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.250539+0000", 2024-04-19T03:02:23.760 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0501e-05 2024-04-19T03:02:23.760 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:23.761 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:23.761 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:23.761 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.761 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.761 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87138 5.e 5.438f8de (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:23.761 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.247862+0000", 2024-04-19T03:02:23.761 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.49458479500000002, 2024-04-19T03:02:23.761 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.495005904, 2024-04-19T03:02:23.761 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:23.761 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "waiting for peered", 2024-04-19T03:02:23.761 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:23.761 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:23.761 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:23.762 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87138 2024-04-19T03:02:23.762 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.762 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:23.762 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.762 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:23.762 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247862+0000", 2024-04-19T03:02:23.762 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:23.762 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.762 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.762 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:23.762 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247862+0000", 2024-04-19T03:02:23.763 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:23.763 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.763 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.763 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:23.763 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247860+0000", 2024-04-19T03:02:23.763 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999981 2024-04-19T03:02:23.763 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.763 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.763 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:23.763 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247909+0000", 2024-04-19T03:02:23.763 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9150999999999997e-05 2024-04-19T03:02:23.763 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.763 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.764 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:23.764 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247925+0000", 2024-04-19T03:02:23.764 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5761999999999999e-05 2024-04-19T03:02:23.764 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.764 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.764 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:23.764 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247936+0000", 2024-04-19T03:02:23.764 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1144e-05 2024-04-19T03:02:23.764 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.764 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.764 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:23.764 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.250590+0000", 2024-04-19T03:02:23.764 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.002653678 2024-04-19T03:02:23.764 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.765 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.765 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:02:23.765 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.250599+0000", 2024-04-19T03:02:23.765 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9039999999999998e-06 2024-04-19T03:02:23.765 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:23.765 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:23.765 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:23.765 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.765 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.765 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87118 5.b 5:d1bb4f3c:::benchmark_data_smithi096_19531_object87117:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:23.765 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.231082+0000", 2024-04-19T03:02:23.765 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.51136448599999995, 2024-04-19T03:02:23.765 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.51187925300000003, 2024-04-19T03:02:23.765 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:23.766 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "waiting for peered", 2024-04-19T03:02:23.766 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:23.766 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:23.766 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:23.766 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87118 2024-04-19T03:02:23.766 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.766 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:23.766 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.766 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:23.766 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231082+0000", 2024-04-19T03:02:23.766 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:23.766 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.766 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.766 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:23.767 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231082+0000", 2024-04-19T03:02:23.767 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:23.767 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.767 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.767 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:23.767 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231081+0000", 2024-04-19T03:02:23.767 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:23.767 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.767 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.767 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:23.767 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231159+0000", 2024-04-19T03:02:23.768 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.7819999999999997e-05 2024-04-19T03:02:23.768 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.768 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.768 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:23.768 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231186+0000", 2024-04-19T03:02:23.768 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7126000000000001e-05 2024-04-19T03:02:23.768 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.768 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.769 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:23.769 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231193+0000", 2024-04-19T03:02:23.769 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7259999999999996e-06 2024-04-19T03:02:23.769 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.769 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.769 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:23.769 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231241+0000", 2024-04-19T03:02:23.769 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8123e-05 2024-04-19T03:02:23.770 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.770 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.770 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:23.770 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231354+0000", 2024-04-19T03:02:23.770 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0001133 2024-04-19T03:02:23.770 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.770 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.771 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:23.771 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231443+0000", 2024-04-19T03:02:23.771 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9167999999999997e-05 2024-04-19T03:02:23.771 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.771 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.771 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:23.771 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236498+0000", 2024-04-19T03:02:23.772 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0050545160000000002 2024-04-19T03:02:23.772 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.772 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.772 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:23.772 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.249681+0000", 2024-04-19T03:02:23.772 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013183321 2024-04-19T03:02:23.773 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.773 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.773 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:02:23.773 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.249693+0000", 2024-04-19T03:02:23.773 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1834999999999999e-05 2024-04-19T03:02:23.773 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:23.773 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:23.774 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:23.774 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.774 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.774 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87121 5.b 5:d01822b8:::benchmark_data_smithi096_19531_object87120:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:23.774 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.233319+0000", 2024-04-19T03:02:23.774 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.50912762199999995, 2024-04-19T03:02:23.775 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.50976408399999995, 2024-04-19T03:02:23.775 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:23.775 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "waiting for peered", 2024-04-19T03:02:23.775 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:23.775 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:23.775 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:23.775 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87121 2024-04-19T03:02:23.775 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.776 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:23.776 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.776 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:23.776 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233319+0000", 2024-04-19T03:02:23.776 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:23.776 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.776 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.777 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:23.777 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233319+0000", 2024-04-19T03:02:23.777 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:23.777 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.777 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.777 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:23.778 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233319+0000", 2024-04-19T03:02:23.778 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:23.778 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.778 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.778 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:23.779 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233364+0000", 2024-04-19T03:02:23.779 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5460999999999997e-05 2024-04-19T03:02:23.779 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.779 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.779 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:23.779 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233382+0000", 2024-04-19T03:02:23.779 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8148e-05 2024-04-19T03:02:23.779 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.780 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.780 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:23.780 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233390+0000", 2024-04-19T03:02:23.780 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5340000000000002e-06 2024-04-19T03:02:23.780 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.780 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.780 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:23.780 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233712+0000", 2024-04-19T03:02:23.780 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00032260500000000001 2024-04-19T03:02:23.780 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.780 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.780 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:23.780 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233829+0000", 2024-04-19T03:02:23.780 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011638599999999999 2024-04-19T03:02:23.781 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.781 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.781 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:23.781 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233959+0000", 2024-04-19T03:02:23.781 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013013900000000001 2024-04-19T03:02:23.781 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.781 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.781 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:23.781 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236515+0000", 2024-04-19T03:02:23.781 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0025562750000000002 2024-04-19T03:02:23.781 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.781 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.781 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:23.781 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.249723+0000", 2024-04-19T03:02:23.782 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013208176 2024-04-19T03:02:23.782 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.782 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.782 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:02:23.782 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.249728+0000", 2024-04-19T03:02:23.782 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6519999999999997e-06 2024-04-19T03:02:23.782 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:23.782 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:23.782 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:23.782 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.782 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.782 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87124 5.8 5:14819ad7:::benchmark_data_smithi096_19531_object87123:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:23.783 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.235886+0000", 2024-04-19T03:02:23.783 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.50656019799999996, 2024-04-19T03:02:23.783 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.50732042899999996, 2024-04-19T03:02:23.783 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:23.783 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "waiting for peered", 2024-04-19T03:02:23.783 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:23.783 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:23.783 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:23.783 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87124 2024-04-19T03:02:23.783 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.783 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:23.783 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.783 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:23.783 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.235886+0000", 2024-04-19T03:02:23.783 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:23.784 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.784 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.784 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:23.784 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.235886+0000", 2024-04-19T03:02:23.784 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:23.784 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.784 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.784 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:23.784 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.235886+0000", 2024-04-19T03:02:23.784 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:23.784 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.784 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.784 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:23.785 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.235934+0000", 2024-04-19T03:02:23.785 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8384000000000003e-05 2024-04-19T03:02:23.785 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.785 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.785 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:23.785 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.235945+0000", 2024-04-19T03:02:23.785 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0671e-05 2024-04-19T03:02:23.785 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.785 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.785 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:23.785 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.235952+0000", 2024-04-19T03:02:23.785 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3089999999999998e-06 2024-04-19T03:02:23.786 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.786 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.786 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:23.786 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.237067+0000", 2024-04-19T03:02:23.786 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001115263 2024-04-19T03:02:23.786 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.786 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.786 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:23.786 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.237188+0000", 2024-04-19T03:02:23.786 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000121258 2024-04-19T03:02:23.786 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.786 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.787 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:23.787 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.237316+0000", 2024-04-19T03:02:23.787 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000128071 2024-04-19T03:02:23.787 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.787 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.787 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:23.787 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240744+0000", 2024-04-19T03:02:23.787 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0034275629999999998 2024-04-19T03:02:23.787 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.787 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.787 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:23.787 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.252517+0000", 2024-04-19T03:02:23.788 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011772991999999999 2024-04-19T03:02:23.788 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.788 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.788 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:02:23.788 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.252523+0000", 2024-04-19T03:02:23.788 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3640000000000004e-06 2024-04-19T03:02:23.788 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:23.788 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:23.788 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:23.788 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.788 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.788 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87129 5.0 5:02667e01:::benchmark_data_smithi096_19531_object87128:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:23.788 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.236466+0000", 2024-04-19T03:02:23.789 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.50598020200000005, 2024-04-19T03:02:23.789 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.50686224999999996, 2024-04-19T03:02:23.789 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:23.789 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "waiting for peered", 2024-04-19T03:02:23.789 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:23.789 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:23.789 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:23.789 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87129 2024-04-19T03:02:23.789 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.789 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:23.789 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.789 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:23.789 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236466+0000", 2024-04-19T03:02:23.790 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:23.790 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.790 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.790 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:23.790 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236466+0000", 2024-04-19T03:02:23.790 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:23.790 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.790 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.790 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:23.790 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236465+0000", 2024-04-19T03:02:23.790 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:23.790 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.791 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.791 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:23.791 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236566+0000", 2024-04-19T03:02:23.791 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010047000000000001 2024-04-19T03:02:23.791 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.791 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.791 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:23.791 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236577+0000", 2024-04-19T03:02:23.791 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1772e-05 2024-04-19T03:02:23.791 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.791 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.791 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:23.791 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236584+0000", 2024-04-19T03:02:23.791 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0530000000000003e-06 2024-04-19T03:02:23.791 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.792 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.792 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:23.792 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.237023+0000", 2024-04-19T03:02:23.792 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000439703 2024-04-19T03:02:23.792 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.792 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.792 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:23.792 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.237207+0000", 2024-04-19T03:02:23.792 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000183692 2024-04-19T03:02:23.792 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.792 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.792 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:23.792 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.237373+0000", 2024-04-19T03:02:23.792 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016623500000000001 2024-04-19T03:02:23.793 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.793 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.793 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:23.793 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.241461+0000", 2024-04-19T03:02:23.793 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0040883050000000004 2024-04-19T03:02:23.793 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.793 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.793 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:23.793 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.252500+0000", 2024-04-19T03:02:23.793 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011038450999999999 2024-04-19T03:02:23.793 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:23.793 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:23.793 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:02:23.793 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.252507+0000", 2024-04-19T03:02:23.793 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2439999999999996e-06 2024-04-19T03:02:23.794 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:23.794 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:23.794 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:23.794 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:23.794 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-04-19T03:02:23.794 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 8 2024-04-19T03:02:23.794 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-19T03:02:23.795 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T03:02:23.824 INFO:tasks.radosbench.radosbench.0.smithi096.stdout: 46 16 87138 87122 118.358 31.75 0.00903256 0.00833579 2024-04-19T03:02:23.832 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:23.831+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:23.906 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-19T03:02:23.906 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-04-19T03:02:23.906 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-04-19T03:02:23.906 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-04-19T03:02:23.906 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-19T03:02:23.916 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T03:02:23.933 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:23.929+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:24.034 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:24.031+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:24.075 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-19T03:02:24.075 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-04-19T03:02:24.076 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-04-19T03:02:24.076 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-04-19T03:02:24.076 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.076 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:11274 5.e 5:7c846032:::benchmark_data_smithi096_19531_object11273:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T03:02:24.076 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:42.061776+0000", 2024-04-19T03:02:24.076 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 42.010302981999999, 2024-04-19T03:02:24.076 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.035381001000000002, 2024-04-19T03:02:24.076 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:24.076 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:24.076 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:24.076 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:24.076 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:24.076 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 11274 2024-04-19T03:02:24.077 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.077 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:24.077 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.077 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:24.077 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.061776+0000", 2024-04-19T03:02:24.077 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:24.077 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.077 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.077 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:24.077 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.061776+0000", 2024-04-19T03:02:24.077 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:24.078 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.078 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.078 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:24.078 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.061775+0000", 2024-04-19T03:02:24.078 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:24.078 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.078 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.078 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:24.078 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.061807+0000", 2024-04-19T03:02:24.078 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1733000000000003e-05 2024-04-19T03:02:24.079 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.079 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.079 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:24.079 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.061822+0000", 2024-04-19T03:02:24.079 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5452999999999999e-05 2024-04-19T03:02:24.079 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.079 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.079 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:24.079 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.061827+0000", 2024-04-19T03:02:24.079 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9810000000000003e-06 2024-04-19T03:02:24.079 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.079 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.079 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:24.080 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.063388+0000", 2024-04-19T03:02:24.080 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0015605720000000001 2024-04-19T03:02:24.080 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.080 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.080 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:24.080 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.063612+0000", 2024-04-19T03:02:24.080 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00022431 2024-04-19T03:02:24.080 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.080 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.080 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:24.080 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.063747+0000", 2024-04-19T03:02:24.081 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013459600000000001 2024-04-19T03:02:24.081 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.081 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.081 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:24.081 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.066186+0000", 2024-04-19T03:02:24.081 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0024388909999999999 2024-04-19T03:02:24.081 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.081 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.081 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:24.082 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.097016+0000", 2024-04-19T03:02:24.082 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.030830705 2024-04-19T03:02:24.082 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.082 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.082 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:24.082 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.097096+0000", 2024-04-19T03:02:24.082 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.9469999999999996e-05 2024-04-19T03:02:24.082 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.082 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.082 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:24.082 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.097157+0000", 2024-04-19T03:02:24.082 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0884999999999997e-05 2024-04-19T03:02:24.082 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:24.083 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:24.083 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:24.083 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.083 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.083 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:11282 5.e 5:75b7c510:::benchmark_data_smithi096_19531_object11281:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e26)", 2024-04-19T03:02:24.083 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:01:42.062674+0000", 2024-04-19T03:02:24.083 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 42.009405088000001, 2024-04-19T03:02:24.083 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.034812849, 2024-04-19T03:02:24.083 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:24.083 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:24.083 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:24.083 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:24.083 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:24.084 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 11282 2024-04-19T03:02:24.084 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.084 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:24.084 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.084 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:24.084 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.062674+0000", 2024-04-19T03:02:24.084 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:24.085 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.085 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.085 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:24.085 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.062674+0000", 2024-04-19T03:02:24.085 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:24.085 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.085 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.085 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:24.085 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.062673+0000", 2024-04-19T03:02:24.085 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:24.085 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.086 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.086 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:24.086 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.062712+0000", 2024-04-19T03:02:24.086 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9341999999999997e-05 2024-04-19T03:02:24.086 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.086 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.086 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:24.086 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.062721+0000", 2024-04-19T03:02:24.086 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1700000000000003e-06 2024-04-19T03:02:24.086 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.086 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.086 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:24.086 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.062729+0000", 2024-04-19T03:02:24.087 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4240000000000004e-06 2024-04-19T03:02:24.087 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.087 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.087 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:24.087 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.065017+0000", 2024-04-19T03:02:24.087 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0022878590000000002 2024-04-19T03:02:24.087 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.087 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.087 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:24.087 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.065207+0000", 2024-04-19T03:02:24.087 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000190411 2024-04-19T03:02:24.087 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.087 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.088 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:24.088 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.065323+0000", 2024-04-19T03:02:24.088 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000115593 2024-04-19T03:02:24.088 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.088 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.088 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:24.088 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.069683+0000", 2024-04-19T03:02:24.088 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0043604409999999996 2024-04-19T03:02:24.088 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.088 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.088 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:24.088 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.097273+0000", 2024-04-19T03:02:24.088 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.027589516000000001 2024-04-19T03:02:24.088 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.088 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.089 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:24.089 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.097406+0000", 2024-04-19T03:02:24.089 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000133514 2024-04-19T03:02:24.089 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.089 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.089 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:24.089 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:01:42.097486+0000", 2024-04-19T03:02:24.089 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0479e-05 2024-04-19T03:02:24.089 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:24.089 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:24.089 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:24.089 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.089 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.090 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:79014 5.d 5:b5eee02c:::benchmark_data_smithi096_19531_object79013:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-19T03:02:24.090 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:18.032471+0000", 2024-04-19T03:02:24.090 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 6.0396075570000001, 2024-04-19T03:02:24.090 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.041427629000000001, 2024-04-19T03:02:24.090 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:24.090 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:24.090 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:24.090 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:24.091 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:24.091 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 79014 2024-04-19T03:02:24.091 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.091 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:24.091 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.091 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:24.091 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:18.032471+0000", 2024-04-19T03:02:24.091 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:24.092 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.092 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.092 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:24.092 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:18.032471+0000", 2024-04-19T03:02:24.092 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:24.092 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.092 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.092 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:24.092 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:18.032470+0000", 2024-04-19T03:02:24.092 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:24.092 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.092 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.093 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:24.093 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:18.032525+0000", 2024-04-19T03:02:24.093 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5535999999999998e-05 2024-04-19T03:02:24.093 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.093 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.093 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:24.093 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:18.032537+0000", 2024-04-19T03:02:24.093 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1987999999999999e-05 2024-04-19T03:02:24.093 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.094 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.094 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:24.094 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:18.032546+0000", 2024-04-19T03:02:24.094 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9670000000000007e-06 2024-04-19T03:02:24.094 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.094 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.095 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:24.095 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:18.032613+0000", 2024-04-19T03:02:24.095 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6508999999999996e-05 2024-04-19T03:02:24.095 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.095 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.095 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:24.095 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:18.032738+0000", 2024-04-19T03:02:24.095 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000124912 2024-04-19T03:02:24.095 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.095 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.095 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-04-19T03:02:24.095 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:18.032867+0000", 2024-04-19T03:02:24.095 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012959399999999999 2024-04-19T03:02:24.096 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.096 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.096 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:24.096 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:18.035867+0000", 2024-04-19T03:02:24.096 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.002999378 2024-04-19T03:02:24.096 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.096 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.096 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:24.096 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:18.073705+0000", 2024-04-19T03:02:24.097 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.037838042000000002 2024-04-19T03:02:24.097 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.097 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.097 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:24.097 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:18.073813+0000", 2024-04-19T03:02:24.097 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010806099999999999 2024-04-19T03:02:24.097 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.097 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.097 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:24.097 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:18.073899+0000", 2024-04-19T03:02:24.097 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.5971999999999996e-05 2024-04-19T03:02:24.097 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:24.097 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:24.098 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:24.098 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.098 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.098 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:86413 5.b 5:d2462eef:::benchmark_data_smithi096_19531_object86412:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:24.098 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:22.478664+0000", 2024-04-19T03:02:24.098 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 1.5934143519999999, 2024-04-19T03:02:24.098 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.031353667000000002, 2024-04-19T03:02:24.098 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:24.098 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:24.098 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:24.098 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:24.098 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:24.099 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 86413 2024-04-19T03:02:24.099 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.099 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:24.099 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.099 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:24.099 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.478664+0000", 2024-04-19T03:02:24.099 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:24.099 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.099 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.099 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:24.099 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.478664+0000", 2024-04-19T03:02:24.099 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:24.099 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.099 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.100 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:24.100 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.478663+0000", 2024-04-19T03:02:24.100 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:24.100 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.100 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.100 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:24.100 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.478700+0000", 2024-04-19T03:02:24.100 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6365000000000002e-05 2024-04-19T03:02:24.100 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.100 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.100 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:24.101 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.478717+0000", 2024-04-19T03:02:24.101 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7652e-05 2024-04-19T03:02:24.101 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.101 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.101 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:24.101 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.478725+0000", 2024-04-19T03:02:24.101 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.7940000000000003e-06 2024-04-19T03:02:24.101 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.101 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.101 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:24.101 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.478762+0000", 2024-04-19T03:02:24.101 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6964e-05 2024-04-19T03:02:24.101 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.102 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.102 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:24.102 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.478857+0000", 2024-04-19T03:02:24.102 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.5265000000000004e-05 2024-04-19T03:02:24.102 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.102 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.103 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:24.103 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.478940+0000", 2024-04-19T03:02:24.103 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.2647999999999999e-05 2024-04-19T03:02:24.103 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.103 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.103 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:24.103 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.484759+0000", 2024-04-19T03:02:24.103 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0058193919999999996 2024-04-19T03:02:24.104 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.104 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.104 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:24.104 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.509954+0000", 2024-04-19T03:02:24.104 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.025194528000000001 2024-04-19T03:02:24.104 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.104 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.104 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:24.104 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.509991+0000", 2024-04-19T03:02:24.105 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7132000000000003e-05 2024-04-19T03:02:24.105 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.105 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.105 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:24.105 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.510018+0000", 2024-04-19T03:02:24.105 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6927000000000002e-05 2024-04-19T03:02:24.105 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:24.105 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:24.105 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:24.105 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.105 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.105 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:86438 5.b 5:da9cb795:::benchmark_data_smithi096_19531_object86437:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:24.105 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:22.495642+0000", 2024-04-19T03:02:24.106 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 1.576436771, 2024-04-19T03:02:24.106 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.033412122000000002, 2024-04-19T03:02:24.106 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:24.106 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:24.106 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:24.106 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:24.106 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:24.106 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 86438 2024-04-19T03:02:24.106 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.106 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:24.107 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.107 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:24.107 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.495642+0000", 2024-04-19T03:02:24.107 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:24.107 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.107 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.107 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:24.107 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.495642+0000", 2024-04-19T03:02:24.107 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:24.107 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.107 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.107 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:24.107 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.495641+0000", 2024-04-19T03:02:24.107 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:24.108 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.108 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.108 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:24.108 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.495722+0000", 2024-04-19T03:02:24.108 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0804999999999996e-05 2024-04-19T03:02:24.108 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.108 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.108 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:24.108 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.495731+0000", 2024-04-19T03:02:24.108 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.6479999999999998e-06 2024-04-19T03:02:24.108 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.108 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.108 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:24.108 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.495738+0000", 2024-04-19T03:02:24.109 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.0729999999999999e-06 2024-04-19T03:02:24.109 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.109 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.109 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:24.109 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.495778+0000", 2024-04-19T03:02:24.109 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9561999999999998e-05 2024-04-19T03:02:24.109 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.109 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.109 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:24.109 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.495921+0000", 2024-04-19T03:02:24.110 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000142831 2024-04-19T03:02:24.110 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.110 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.110 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:24.110 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.496065+0000", 2024-04-19T03:02:24.110 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014444699999999999 2024-04-19T03:02:24.110 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.110 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.110 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:24.110 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.501620+0000", 2024-04-19T03:02:24.110 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.005554682 2024-04-19T03:02:24.110 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.111 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.111 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:24.111 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.528894+0000", 2024-04-19T03:02:24.111 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.027274495999999999 2024-04-19T03:02:24.111 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.111 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.111 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:24.111 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.528993+0000", 2024-04-19T03:02:24.111 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.8350000000000005e-05 2024-04-19T03:02:24.111 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.111 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.111 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:24.111 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.529054+0000", 2024-04-19T03:02:24.111 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1457999999999993e-05 2024-04-19T03:02:24.112 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:24.112 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:24.112 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:24.112 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.112 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.112 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:86439 5.0 5:05d3c0f7:::benchmark_data_smithi096_19531_object86438:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:24.112 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:22.495752+0000", 2024-04-19T03:02:24.112 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 1.5763269310000001, 2024-04-19T03:02:24.112 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.033234214999999998, 2024-04-19T03:02:24.112 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:24.112 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:24.112 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:24.113 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:24.113 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:24.113 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 86439 2024-04-19T03:02:24.113 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.113 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:24.113 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.113 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:24.113 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.495752+0000", 2024-04-19T03:02:24.113 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:24.113 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.113 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.114 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:24.114 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.495752+0000", 2024-04-19T03:02:24.114 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:24.114 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.114 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.114 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:24.114 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.495751+0000", 2024-04-19T03:02:24.114 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:24.114 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.114 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.114 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:24.114 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.495822+0000", 2024-04-19T03:02:24.115 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.1219999999999999e-05 2024-04-19T03:02:24.115 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.115 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.115 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:24.115 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.495830+0000", 2024-04-19T03:02:24.115 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.323e-06 2024-04-19T03:02:24.115 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.115 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.115 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:24.115 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.495834+0000", 2024-04-19T03:02:24.115 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1659999999999996e-06 2024-04-19T03:02:24.115 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.116 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.116 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:24.116 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.495866+0000", 2024-04-19T03:02:24.116 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2039999999999998e-05 2024-04-19T03:02:24.116 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.116 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.116 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:24.116 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.496001+0000", 2024-04-19T03:02:24.116 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000135346 2024-04-19T03:02:24.116 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.116 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.116 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:24.116 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.496144+0000", 2024-04-19T03:02:24.117 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014325000000000001 2024-04-19T03:02:24.117 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.117 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.117 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:24.117 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.501953+0000", 2024-04-19T03:02:24.117 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0058085150000000002 2024-04-19T03:02:24.117 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.117 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.117 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:24.117 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.528880+0000", 2024-04-19T03:02:24.117 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.026927031000000001 2024-04-19T03:02:24.117 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.117 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.117 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:24.118 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.528956+0000", 2024-04-19T03:02:24.118 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5661999999999995e-05 2024-04-19T03:02:24.118 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.118 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.118 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:24.118 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.528986+0000", 2024-04-19T03:02:24.118 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0318999999999999e-05 2024-04-19T03:02:24.118 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:24.118 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:24.118 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:24.118 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.118 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.119 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:86441 5.e 5:7e6b9d09:::benchmark_data_smithi096_19531_object86440:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:24.119 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:22.496295+0000", 2024-04-19T03:02:24.119 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 1.5757841240000001, 2024-04-19T03:02:24.119 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.033027515, 2024-04-19T03:02:24.119 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:24.119 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:24.119 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:24.119 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:24.119 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:24.119 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 86441 2024-04-19T03:02:24.119 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.119 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:24.119 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.119 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:24.120 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.496295+0000", 2024-04-19T03:02:24.120 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:24.120 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.120 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.120 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:24.120 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.496295+0000", 2024-04-19T03:02:24.120 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:24.120 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.120 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.120 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:24.120 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.496294+0000", 2024-04-19T03:02:24.120 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:24.120 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.120 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.121 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:24.121 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.496367+0000", 2024-04-19T03:02:24.121 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3007000000000001e-05 2024-04-19T03:02:24.121 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.121 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.121 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:24.121 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.496378+0000", 2024-04-19T03:02:24.121 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1256e-05 2024-04-19T03:02:24.121 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.121 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.121 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:24.121 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.496383+0000", 2024-04-19T03:02:24.121 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.429e-06 2024-04-19T03:02:24.121 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.122 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.122 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:24.122 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.496443+0000", 2024-04-19T03:02:24.122 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9033000000000002e-05 2024-04-19T03:02:24.122 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.122 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.122 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:24.122 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.496619+0000", 2024-04-19T03:02:24.122 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00017653800000000001 2024-04-19T03:02:24.122 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.122 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.122 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:24.122 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.496822+0000", 2024-04-19T03:02:24.122 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00020321900000000001 2024-04-19T03:02:24.123 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.123 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.123 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:24.123 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.500358+0000", 2024-04-19T03:02:24.123 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0035359990000000002 2024-04-19T03:02:24.123 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.123 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.123 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:24.123 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.529268+0000", 2024-04-19T03:02:24.123 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.028910087000000001 2024-04-19T03:02:24.124 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.124 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.124 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:24.124 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.529297+0000", 2024-04-19T03:02:24.124 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8626e-05 2024-04-19T03:02:24.124 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.124 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.124 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:24.124 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.529322+0000", 2024-04-19T03:02:24.124 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.514e-05 2024-04-19T03:02:24.124 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:24.124 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:24.124 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:24.125 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.125 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.125 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:86443 5.b 5:db409ed1:::benchmark_data_smithi096_19531_object86442:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:24.125 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:22.499162+0000", 2024-04-19T03:02:24.125 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 1.5729170240000001, 2024-04-19T03:02:24.125 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.030111367, 2024-04-19T03:02:24.125 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:24.125 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:24.125 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:24.125 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:24.125 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:24.125 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 86443 2024-04-19T03:02:24.126 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.126 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:24.126 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.126 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:24.126 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.499162+0000", 2024-04-19T03:02:24.126 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:24.126 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.126 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.126 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:24.126 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.499162+0000", 2024-04-19T03:02:24.127 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:24.127 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.127 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.127 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:24.127 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.499161+0000", 2024-04-19T03:02:24.127 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:24.127 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.127 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.127 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:24.127 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.499218+0000", 2024-04-19T03:02:24.127 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6712999999999997e-05 2024-04-19T03:02:24.127 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.127 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.128 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:24.128 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.499227+0000", 2024-04-19T03:02:24.128 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.3870000000000001e-06 2024-04-19T03:02:24.128 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.128 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.128 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:24.128 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.499235+0000", 2024-04-19T03:02:24.128 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4059999999999999e-06 2024-04-19T03:02:24.128 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.128 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.128 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:24.128 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.499275+0000", 2024-04-19T03:02:24.128 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.0581000000000003e-05 2024-04-19T03:02:24.128 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.129 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.129 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:24.129 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.499372+0000", 2024-04-19T03:02:24.129 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.6434000000000005e-05 2024-04-19T03:02:24.129 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.129 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.129 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:24.129 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.499483+0000", 2024-04-19T03:02:24.129 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000111739 2024-04-19T03:02:24.129 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.129 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.129 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:24.130 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.503365+0000", 2024-04-19T03:02:24.130 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0038817999999999999 2024-04-19T03:02:24.130 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.130 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.130 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:24.130 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.529137+0000", 2024-04-19T03:02:24.130 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.025772059999999999 2024-04-19T03:02:24.130 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.130 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.130 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:24.130 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.529213+0000", 2024-04-19T03:02:24.131 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.6117000000000003e-05 2024-04-19T03:02:24.131 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.131 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.131 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:24.131 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.529273+0000", 2024-04-19T03:02:24.131 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9775999999999998e-05 2024-04-19T03:02:24.131 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:24.131 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:24.131 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:24.131 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.131 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.131 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:86615 5.e 5:7fef7288:::benchmark_data_smithi096_19531_object86614:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:24.131 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:22.634544+0000", 2024-04-19T03:02:24.132 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 1.437534578, 2024-04-19T03:02:24.132 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.192475071, 2024-04-19T03:02:24.132 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:24.132 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:24.132 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:24.132 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:24.132 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:24.132 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 86615 2024-04-19T03:02:24.132 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.132 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:24.132 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.132 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:24.132 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634544+0000", 2024-04-19T03:02:24.132 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:24.133 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.133 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.133 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:24.133 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634544+0000", 2024-04-19T03:02:24.133 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:24.133 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.134 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.134 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:24.134 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634542+0000", 2024-04-19T03:02:24.137 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999981 2024-04-19T03:02:24.137 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.137 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.138 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:24.138 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634585+0000", 2024-04-19T03:02:24.138 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2299000000000003e-05 2024-04-19T03:02:24.138 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.138 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.139 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:24.139 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634592+0000", 2024-04-19T03:02:24.139 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2350000000000002e-06 2024-04-19T03:02:24.139 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.139 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.139 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:24.139 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634596+0000", 2024-04-19T03:02:24.139 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5390000000000001e-06 2024-04-19T03:02:24.139 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.139 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.139 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:24.139 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634639+0000", 2024-04-19T03:02:24.139 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2444999999999998e-05 2024-04-19T03:02:24.140 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.140 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.140 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:24.140 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634808+0000", 2024-04-19T03:02:24.140 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000169152 2024-04-19T03:02:24.140 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.140 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.140 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:24.140 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634999+0000", 2024-04-19T03:02:24.140 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00019098300000000001 2024-04-19T03:02:24.140 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.140 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.140 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:24.140 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.640458+0000", 2024-04-19T03:02:24.141 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0054586870000000003 2024-04-19T03:02:24.141 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.141 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.141 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:24.141 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.826949+0000", 2024-04-19T03:02:24.141 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.18649178299999999 2024-04-19T03:02:24.141 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.141 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.141 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:24.141 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.826982+0000", 2024-04-19T03:02:24.141 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2477000000000001e-05 2024-04-19T03:02:24.141 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.141 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.141 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:24.142 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.827019+0000", 2024-04-19T03:02:24.142 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7355999999999999e-05 2024-04-19T03:02:24.142 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:24.142 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:24.142 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:24.142 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.142 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.142 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:86616 5.e 5:72278f47:::benchmark_data_smithi096_19531_object86615:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:24.142 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:22.634609+0000", 2024-04-19T03:02:24.143 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 1.4374694290000001, 2024-04-19T03:02:24.143 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.19472088900000001, 2024-04-19T03:02:24.143 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:24.143 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:24.143 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:24.144 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:24.144 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:24.144 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 86616 2024-04-19T03:02:24.144 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.144 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:24.145 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.145 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:24.145 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634609+0000", 2024-04-19T03:02:24.145 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:24.145 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.145 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.146 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:24.146 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634609+0000", 2024-04-19T03:02:24.146 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:24.146 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.146 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.146 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:24.146 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634609+0000", 2024-04-19T03:02:24.146 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:24.146 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.147 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.147 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:24.147 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634651+0000", 2024-04-19T03:02:24.147 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2589000000000002e-05 2024-04-19T03:02:24.147 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.147 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.147 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:24.148 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634659+0000", 2024-04-19T03:02:24.148 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5850000000000002e-06 2024-04-19T03:02:24.148 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.148 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.148 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:24.148 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634662+0000", 2024-04-19T03:02:24.148 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3620000000000002e-06 2024-04-19T03:02:24.148 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.148 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.148 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:24.148 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.637880+0000", 2024-04-19T03:02:24.148 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.003218149 2024-04-19T03:02:24.148 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.148 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.149 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:24.149 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.637999+0000", 2024-04-19T03:02:24.149 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000118643 2024-04-19T03:02:24.149 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.149 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.149 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:24.149 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.638102+0000", 2024-04-19T03:02:24.149 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010331 2024-04-19T03:02:24.149 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.149 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.149 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:24.149 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.640851+0000", 2024-04-19T03:02:24.149 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0027483310000000001 2024-04-19T03:02:24.149 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.150 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.150 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:24.150 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.829269+0000", 2024-04-19T03:02:24.150 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.188418319 2024-04-19T03:02:24.150 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.150 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.150 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:24.150 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.829299+0000", 2024-04-19T03:02:24.150 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0227e-05 2024-04-19T03:02:24.150 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.150 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.150 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:24.151 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.829330+0000", 2024-04-19T03:02:24.151 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0969000000000001e-05 2024-04-19T03:02:24.151 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:24.151 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:24.151 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:24.151 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.151 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.151 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:86618 5.0 5:09014b90:::benchmark_data_smithi096_19531_object86617:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:24.151 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:22.634894+0000", 2024-04-19T03:02:24.151 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 1.4371849409999999, 2024-04-19T03:02:24.151 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.19413419800000001, 2024-04-19T03:02:24.151 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:24.151 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:24.152 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:24.152 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:24.152 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:24.152 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 86618 2024-04-19T03:02:24.152 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.152 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:24.152 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.152 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:24.152 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634894+0000", 2024-04-19T03:02:24.152 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:24.152 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.152 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.152 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:24.152 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634894+0000", 2024-04-19T03:02:24.153 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:24.153 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.153 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.153 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:24.153 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634893+0000", 2024-04-19T03:02:24.153 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:24.153 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.153 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.153 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:24.153 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634976+0000", 2024-04-19T03:02:24.153 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3231000000000003e-05 2024-04-19T03:02:24.153 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.153 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.154 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:24.154 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634983+0000", 2024-04-19T03:02:24.154 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5169999999999996e-06 2024-04-19T03:02:24.154 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.154 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.154 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:24.154 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634987+0000", 2024-04-19T03:02:24.154 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.425e-06 2024-04-19T03:02:24.154 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.154 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.154 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:24.154 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635030+0000", 2024-04-19T03:02:24.154 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.32e-05 2024-04-19T03:02:24.155 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.155 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.155 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:24.155 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635185+0000", 2024-04-19T03:02:24.155 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015471899999999999 2024-04-19T03:02:24.155 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.155 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.155 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:24.155 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635415+0000", 2024-04-19T03:02:24.155 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00023026500000000001 2024-04-19T03:02:24.155 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.155 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.155 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:24.156 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.640127+0000", 2024-04-19T03:02:24.156 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0047118890000000004 2024-04-19T03:02:24.156 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.156 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.156 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:24.156 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.828895+0000", 2024-04-19T03:02:24.156 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.18876802600000001 2024-04-19T03:02:24.156 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.156 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.156 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:24.156 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.828972+0000", 2024-04-19T03:02:24.156 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.6345000000000002e-05 2024-04-19T03:02:24.156 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.156 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.156 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:24.157 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.829028+0000", 2024-04-19T03:02:24.157 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6342999999999999e-05 2024-04-19T03:02:24.157 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:24.157 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:24.157 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:24.157 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.157 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.157 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:86620 5.b 5:d80faa68:::benchmark_data_smithi096_19531_object86619:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:24.157 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:22.635110+0000", 2024-04-19T03:02:24.157 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 1.436968381, 2024-04-19T03:02:24.157 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.193447275, 2024-04-19T03:02:24.157 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:24.157 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:24.157 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:24.158 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:24.158 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:24.158 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 86620 2024-04-19T03:02:24.158 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.158 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:24.158 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.158 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:24.158 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635110+0000", 2024-04-19T03:02:24.158 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:24.158 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.158 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.158 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:24.158 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635110+0000", 2024-04-19T03:02:24.159 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:24.159 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.159 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.159 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:24.159 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635110+0000", 2024-04-19T03:02:24.159 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:24.159 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.159 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.159 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:24.159 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635154+0000", 2024-04-19T03:02:24.159 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4681000000000001e-05 2024-04-19T03:02:24.159 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.159 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.159 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:24.160 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635166+0000", 2024-04-19T03:02:24.160 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1505000000000001e-05 2024-04-19T03:02:24.160 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.160 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.160 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:24.160 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635171+0000", 2024-04-19T03:02:24.160 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6040000000000003e-06 2024-04-19T03:02:24.160 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.160 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.160 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:24.160 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635221+0000", 2024-04-19T03:02:24.160 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9947000000000001e-05 2024-04-19T03:02:24.160 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.160 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.161 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:24.161 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635356+0000", 2024-04-19T03:02:24.161 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013576199999999999 2024-04-19T03:02:24.161 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.161 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.161 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:24.161 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635507+0000", 2024-04-19T03:02:24.162 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015072999999999999 2024-04-19T03:02:24.162 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.162 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.162 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:24.162 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.638488+0000", 2024-04-19T03:02:24.163 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0029813159999999999 2024-04-19T03:02:24.163 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.163 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.163 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:24.163 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.828341+0000", 2024-04-19T03:02:24.163 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.189852254 2024-04-19T03:02:24.164 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.164 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.164 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:24.164 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.828416+0000", 2024-04-19T03:02:24.164 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5344000000000002e-05 2024-04-19T03:02:24.164 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.164 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.164 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:24.164 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.828558+0000", 2024-04-19T03:02:24.165 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000141695 2024-04-19T03:02:24.165 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:24.165 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:24.165 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:24.165 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.165 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.165 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:86621 5.8 5:1597a420:::benchmark_data_smithi096_19531_object86620:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:24.165 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:22.635187+0000", 2024-04-19T03:02:24.165 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 1.4368915209999999, 2024-04-19T03:02:24.165 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.194204878, 2024-04-19T03:02:24.165 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:24.165 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:24.165 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:24.166 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:24.166 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:24.166 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 86621 2024-04-19T03:02:24.166 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.166 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:24.166 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.166 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:24.166 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635187+0000", 2024-04-19T03:02:24.166 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:24.166 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.166 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.166 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:24.167 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635187+0000", 2024-04-19T03:02:24.167 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:24.167 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.167 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.167 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:24.167 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635187+0000", 2024-04-19T03:02:24.167 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:24.167 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.167 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.167 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:24.167 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635242+0000", 2024-04-19T03:02:24.167 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5158000000000003e-05 2024-04-19T03:02:24.167 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.167 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.168 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:24.168 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635249+0000", 2024-04-19T03:02:24.168 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.7000000000000008e-06 2024-04-19T03:02:24.168 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.168 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.168 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:24.168 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635256+0000", 2024-04-19T03:02:24.168 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2060000000000004e-06 2024-04-19T03:02:24.168 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.168 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.168 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:24.168 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635302+0000", 2024-04-19T03:02:24.168 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5954000000000001e-05 2024-04-19T03:02:24.168 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.169 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.169 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:24.169 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635427+0000", 2024-04-19T03:02:24.169 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012559299999999999 2024-04-19T03:02:24.169 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.169 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.169 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:24.169 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635596+0000", 2024-04-19T03:02:24.169 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000168615 2024-04-19T03:02:24.169 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.169 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.169 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:24.169 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.639320+0000", 2024-04-19T03:02:24.169 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0037244610000000001 2024-04-19T03:02:24.170 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.170 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.170 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:24.170 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.829277+0000", 2024-04-19T03:02:24.170 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.18995651099999999 2024-04-19T03:02:24.170 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.170 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.170 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:24.170 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.829341+0000", 2024-04-19T03:02:24.170 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3756000000000004e-05 2024-04-19T03:02:24.170 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.170 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.170 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:24.171 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.829392+0000", 2024-04-19T03:02:24.171 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1555999999999999e-05 2024-04-19T03:02:24.171 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:24.171 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:24.171 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:24.171 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.171 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.171 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:86648 5.8 5:1b7d75b0:::benchmark_data_smithi096_19531_object86647:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:24.171 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:22.838112+0000", 2024-04-19T03:02:24.171 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 1.2339668420000001, 2024-04-19T03:02:24.171 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.030488972, 2024-04-19T03:02:24.171 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:24.171 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:24.171 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:24.172 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:24.172 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:24.172 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 86648 2024-04-19T03:02:24.172 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.172 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:24.172 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.172 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:24.172 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.838112+0000", 2024-04-19T03:02:24.172 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:24.172 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.172 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.172 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:24.172 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.838112+0000", 2024-04-19T03:02:24.172 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:24.173 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.173 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.173 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:24.173 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.838111+0000", 2024-04-19T03:02:24.173 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:24.173 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.173 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.173 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:24.173 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.838231+0000", 2024-04-19T03:02:24.173 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000120052 2024-04-19T03:02:24.173 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.173 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.173 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:24.173 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.838237+0000", 2024-04-19T03:02:24.174 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3500000000000002e-06 2024-04-19T03:02:24.174 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.174 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.174 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:24.174 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.838242+0000", 2024-04-19T03:02:24.174 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1239999999999998e-06 2024-04-19T03:02:24.174 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.174 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.174 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:24.174 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.841557+0000", 2024-04-19T03:02:24.175 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0033156930000000002 2024-04-19T03:02:24.175 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.175 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.175 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:24.175 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.841665+0000", 2024-04-19T03:02:24.175 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000107933 2024-04-19T03:02:24.175 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.175 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.175 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:24.175 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.841781+0000", 2024-04-19T03:02:24.175 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000115932 2024-04-19T03:02:24.175 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.175 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.175 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:24.176 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.847372+0000", 2024-04-19T03:02:24.176 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0055906949999999997 2024-04-19T03:02:24.176 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.176 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.176 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:24.176 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.868496+0000", 2024-04-19T03:02:24.176 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.021124014999999999 2024-04-19T03:02:24.176 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.176 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.176 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:24.176 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.868565+0000", 2024-04-19T03:02:24.176 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.9120000000000002e-05 2024-04-19T03:02:24.176 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.176 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.177 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:24.177 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.868601+0000", 2024-04-19T03:02:24.177 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5905000000000003e-05 2024-04-19T03:02:24.177 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:24.177 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:24.177 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:24.177 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.177 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.177 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87062 5.4 5:2d3b5d9a:::benchmark_data_smithi096_19531_object87061:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:24.177 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.136820+0000", 2024-04-19T03:02:24.177 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.93525836799999995, 2024-04-19T03:02:24.177 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.066483741999999998, 2024-04-19T03:02:24.177 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:24.177 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:24.178 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:24.178 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:24.178 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:24.178 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87062 2024-04-19T03:02:24.178 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.178 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:24.178 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.178 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:24.178 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.136820+0000", 2024-04-19T03:02:24.178 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:24.178 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.178 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.179 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:24.179 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.136820+0000", 2024-04-19T03:02:24.179 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:24.179 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.179 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.179 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:24.179 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.136819+0000", 2024-04-19T03:02:24.179 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:24.179 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.179 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.179 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:24.179 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.136864+0000", 2024-04-19T03:02:24.179 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4855000000000003e-05 2024-04-19T03:02:24.180 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.180 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.180 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:24.180 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.136881+0000", 2024-04-19T03:02:24.180 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7521999999999999e-05 2024-04-19T03:02:24.180 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.180 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.180 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:24.180 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.136890+0000", 2024-04-19T03:02:24.180 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1039999999999996e-06 2024-04-19T03:02:24.180 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.180 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.180 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:24.180 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.136974+0000", 2024-04-19T03:02:24.181 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3735999999999999e-05 2024-04-19T03:02:24.181 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.181 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.181 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:24.181 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.137308+0000", 2024-04-19T03:02:24.181 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00033376100000000002 2024-04-19T03:02:24.181 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.181 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.181 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:24.181 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.137559+0000", 2024-04-19T03:02:24.181 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000250599 2024-04-19T03:02:24.181 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.181 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.181 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:24.182 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.145423+0000", 2024-04-19T03:02:24.182 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0078649589999999995 2024-04-19T03:02:24.182 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.182 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.182 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:24.182 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.203175+0000", 2024-04-19T03:02:24.182 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057751255000000001 2024-04-19T03:02:24.182 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.182 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.182 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:24.182 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.203250+0000", 2024-04-19T03:02:24.182 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5378999999999998e-05 2024-04-19T03:02:24.182 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.182 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.183 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:24.183 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.203304+0000", 2024-04-19T03:02:24.183 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4015999999999999e-05 2024-04-19T03:02:24.183 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:24.183 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:24.183 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:24.183 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.183 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.183 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87065 5.4 5:21d20a47:::benchmark_data_smithi096_19531_object87064:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:24.183 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.137482+0000", 2024-04-19T03:02:24.183 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.93459663400000004, 2024-04-19T03:02:24.183 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.065988749999999999, 2024-04-19T03:02:24.183 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:24.183 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:24.183 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:24.184 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:24.184 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:24.184 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87065 2024-04-19T03:02:24.184 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.184 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:24.184 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.184 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:24.184 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.137482+0000", 2024-04-19T03:02:24.184 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:24.184 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.184 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.184 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:24.184 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.137482+0000", 2024-04-19T03:02:24.184 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:24.185 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.185 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.185 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:24.185 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.137481+0000", 2024-04-19T03:02:24.185 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:24.185 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.185 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.186 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:24.186 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.137530+0000", 2024-04-19T03:02:24.186 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9302000000000003e-05 2024-04-19T03:02:24.186 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.186 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.187 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:24.187 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.137540+0000", 2024-04-19T03:02:24.187 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.2010000000000005e-06 2024-04-19T03:02:24.187 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.187 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.187 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:24.187 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.137545+0000", 2024-04-19T03:02:24.187 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5910000000000003e-06 2024-04-19T03:02:24.187 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.187 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.187 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:24.187 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.140666+0000", 2024-04-19T03:02:24.187 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0031212710000000001 2024-04-19T03:02:24.187 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.187 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.188 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:24.188 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.140847+0000", 2024-04-19T03:02:24.188 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00018065600000000001 2024-04-19T03:02:24.188 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.188 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.188 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:24.188 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.140991+0000", 2024-04-19T03:02:24.188 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014433100000000001 2024-04-19T03:02:24.188 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.188 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.188 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:24.188 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.148053+0000", 2024-04-19T03:02:24.188 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.007061945 2024-04-19T03:02:24.188 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.188 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.189 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:24.189 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.203367+0000", 2024-04-19T03:02:24.189 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.055313703999999998 2024-04-19T03:02:24.189 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.189 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.189 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:24.189 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.203426+0000", 2024-04-19T03:02:24.189 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9024000000000003e-05 2024-04-19T03:02:24.189 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.189 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.189 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:24.189 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.203471+0000", 2024-04-19T03:02:24.189 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4818999999999999e-05 2024-04-19T03:02:24.189 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:24.189 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:24.190 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:24.190 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.190 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.190 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87067 5.b 5:d57af71a:::benchmark_data_smithi096_19531_object87066:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:24.190 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.142233+0000", 2024-04-19T03:02:24.190 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.92984565799999996, 2024-04-19T03:02:24.190 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.071692405000000001, 2024-04-19T03:02:24.190 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:24.190 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:24.190 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:24.190 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:24.190 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:24.190 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87067 2024-04-19T03:02:24.190 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.191 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:24.191 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.191 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:24.191 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142233+0000", 2024-04-19T03:02:24.191 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:24.191 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.191 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.191 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:24.191 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142233+0000", 2024-04-19T03:02:24.191 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:24.191 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.191 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.191 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:24.191 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142232+0000", 2024-04-19T03:02:24.191 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:24.192 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.192 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.192 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:24.192 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142277+0000", 2024-04-19T03:02:24.192 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5837000000000002e-05 2024-04-19T03:02:24.192 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.192 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.192 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:24.192 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142297+0000", 2024-04-19T03:02:24.192 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9561000000000001e-05 2024-04-19T03:02:24.192 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.192 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.192 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:24.192 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142311+0000", 2024-04-19T03:02:24.192 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3654e-05 2024-04-19T03:02:24.193 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.193 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.193 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:24.193 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142391+0000", 2024-04-19T03:02:24.193 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0123999999999994e-05 2024-04-19T03:02:24.193 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.193 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.193 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:24.193 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142669+0000", 2024-04-19T03:02:24.193 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00027829800000000001 2024-04-19T03:02:24.193 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.193 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.193 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:24.193 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142859+0000", 2024-04-19T03:02:24.194 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000190051 2024-04-19T03:02:24.194 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.194 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.194 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:24.194 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.150597+0000", 2024-04-19T03:02:24.194 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0077380299999999999 2024-04-19T03:02:24.194 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.194 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.194 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:24.194 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.213855+0000", 2024-04-19T03:02:24.194 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.063257987000000002 2024-04-19T03:02:24.194 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.194 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.195 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:24.195 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.213898+0000", 2024-04-19T03:02:24.195 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2916e-05 2024-04-19T03:02:24.195 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.195 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.195 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:24.195 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.213925+0000", 2024-04-19T03:02:24.195 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7503000000000001e-05 2024-04-19T03:02:24.195 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:24.195 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:24.195 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:24.195 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.195 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.196 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87069 5.b 5:da0c93b5:::benchmark_data_smithi096_19531_object87068:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:24.196 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.143402+0000", 2024-04-19T03:02:24.196 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.92867669600000002, 2024-04-19T03:02:24.196 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.070678598999999995, 2024-04-19T03:02:24.196 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:24.196 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:24.196 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:24.196 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:24.196 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:24.196 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87069 2024-04-19T03:02:24.196 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.196 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:24.196 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.196 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:24.197 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.143402+0000", 2024-04-19T03:02:24.197 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:24.197 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.197 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.197 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:24.197 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.143402+0000", 2024-04-19T03:02:24.197 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:24.197 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.197 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.197 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:24.197 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.143401+0000", 2024-04-19T03:02:24.197 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:24.197 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.197 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.198 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:24.198 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.143501+0000", 2024-04-19T03:02:24.198 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000100387 2024-04-19T03:02:24.198 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.198 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.198 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:24.198 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.143516+0000", 2024-04-19T03:02:24.199 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5369000000000001e-05 2024-04-19T03:02:24.199 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.199 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.199 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:24.199 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.143524+0000", 2024-04-19T03:02:24.199 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.7079999999999997e-06 2024-04-19T03:02:24.200 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.200 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.200 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:24.200 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.145550+0000", 2024-04-19T03:02:24.200 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0020259290000000001 2024-04-19T03:02:24.200 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.200 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.200 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:24.200 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.145676+0000", 2024-04-19T03:02:24.200 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000126406 2024-04-19T03:02:24.200 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.200 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.201 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:24.201 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.145802+0000", 2024-04-19T03:02:24.201 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000125974 2024-04-19T03:02:24.201 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.201 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.201 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:24.201 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.151030+0000", 2024-04-19T03:02:24.201 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0052276079999999999 2024-04-19T03:02:24.201 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.201 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.201 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:24.201 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.213998+0000", 2024-04-19T03:02:24.202 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.06296786 2024-04-19T03:02:24.202 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.202 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.202 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:24.202 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.214031+0000", 2024-04-19T03:02:24.202 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3387999999999999e-05 2024-04-19T03:02:24.202 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.202 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.202 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:24.202 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.214081+0000", 2024-04-19T03:02:24.202 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9316e-05 2024-04-19T03:02:24.202 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:24.202 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:24.203 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:24.203 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.203 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.203 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87073 5.0 5:0ca21233:::benchmark_data_smithi096_19531_object87072:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:24.203 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.145929+0000", 2024-04-19T03:02:24.203 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.92614943599999999, 2024-04-19T03:02:24.203 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.062283234999999999, 2024-04-19T03:02:24.203 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:24.203 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:24.204 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:24.204 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:24.204 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:24.204 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87073 2024-04-19T03:02:24.204 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.204 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:24.205 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.205 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:24.205 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.145929+0000", 2024-04-19T03:02:24.205 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:24.205 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.205 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.205 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:24.205 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.145929+0000", 2024-04-19T03:02:24.205 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:24.205 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.206 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.206 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:24.206 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.145928+0000", 2024-04-19T03:02:24.206 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:24.206 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.207 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.207 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:24.207 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.146063+0000", 2024-04-19T03:02:24.207 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013541099999999999 2024-04-19T03:02:24.207 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.207 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.207 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:24.207 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.146079+0000", 2024-04-19T03:02:24.207 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5902000000000001e-05 2024-04-19T03:02:24.207 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.207 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.208 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:24.208 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.146100+0000", 2024-04-19T03:02:24.208 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0380000000000001e-05 2024-04-19T03:02:24.208 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.208 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.208 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:24.208 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.146193+0000", 2024-04-19T03:02:24.208 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.3669000000000001e-05 2024-04-19T03:02:24.208 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.208 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.208 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:24.208 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.146388+0000", 2024-04-19T03:02:24.208 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00019457799999999999 2024-04-19T03:02:24.209 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.209 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.209 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:24.209 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.146625+0000", 2024-04-19T03:02:24.209 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00023751999999999999 2024-04-19T03:02:24.209 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.209 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.209 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:24.209 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.151051+0000", 2024-04-19T03:02:24.209 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0044260039999999999 2024-04-19T03:02:24.209 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.209 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.209 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:24.209 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.207872+0000", 2024-04-19T03:02:24.209 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.056821114999999998 2024-04-19T03:02:24.210 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.210 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.210 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:24.210 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.208085+0000", 2024-04-19T03:02:24.210 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000212893 2024-04-19T03:02:24.210 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.210 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.210 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:24.210 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.208213+0000", 2024-04-19T03:02:24.210 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012714700000000001 2024-04-19T03:02:24.210 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:24.210 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:24.210 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:24.211 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.211 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.211 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87074 5.0 5:035614ac:::benchmark_data_smithi096_19531_object87073:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:24.211 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.151387+0000", 2024-04-19T03:02:24.211 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.92069150499999997, 2024-04-19T03:02:24.211 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.063461771, 2024-04-19T03:02:24.211 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:24.211 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:24.211 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:24.211 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:24.211 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:24.211 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87074 2024-04-19T03:02:24.211 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.211 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:24.211 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.212 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:24.212 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.151387+0000", 2024-04-19T03:02:24.212 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:24.212 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.212 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.212 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:24.212 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.151387+0000", 2024-04-19T03:02:24.212 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:24.212 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.212 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.212 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:24.212 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.151386+0000", 2024-04-19T03:02:24.212 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:24.212 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.212 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.212 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:24.213 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.151428+0000", 2024-04-19T03:02:24.213 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.172e-05 2024-04-19T03:02:24.213 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.213 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.213 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:24.213 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.151442+0000", 2024-04-19T03:02:24.213 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4328000000000001e-05 2024-04-19T03:02:24.213 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.213 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.213 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:24.214 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.151451+0000", 2024-04-19T03:02:24.214 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.8400000000000001e-06 2024-04-19T03:02:24.214 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.214 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.214 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:24.214 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.151521+0000", 2024-04-19T03:02:24.214 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.9606999999999999e-05 2024-04-19T03:02:24.214 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.214 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.214 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:24.214 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.151749+0000", 2024-04-19T03:02:24.215 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00022818799999999999 2024-04-19T03:02:24.215 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.215 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.215 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:24.215 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.152006+0000", 2024-04-19T03:02:24.215 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00025687300000000002 2024-04-19T03:02:24.215 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.215 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.215 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:24.215 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.154887+0000", 2024-04-19T03:02:24.215 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0028812989999999999 2024-04-19T03:02:24.215 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.215 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.216 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:24.216 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.214733+0000", 2024-04-19T03:02:24.216 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.059846159000000003 2024-04-19T03:02:24.216 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.216 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.216 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:24.216 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.214788+0000", 2024-04-19T03:02:24.216 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4524000000000002e-05 2024-04-19T03:02:24.216 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:24.216 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:24.216 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:24.216 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.214849+0000", 2024-04-19T03:02:24.216 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1362e-05 2024-04-19T03:02:24.216 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:24.216 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:24.217 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:24.217 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:24.217 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:24.217 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-19T03:02:24.218 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T03:02:24.219 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:24.217+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:24.254 INFO:teuthology.orchestra.run.smithi096.stderr:noscrub is set 2024-04-19T03:02:24.319 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:24.315+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:24.365 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-04-19T03:02:24.365 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [ 2024-04-19T03:02:24.366 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:24.366 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87265 5.9 5:9528d6de:::benchmark_data_smithi096_19531_object87264:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-04-19T03:02:24.366 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:24.349477+0000", 2024-04-19T03:02:24.366 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.014196624, 2024-04-19T03:02:24.366 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.014226577000000001, 2024-04-19T03:02:24.366 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:24.366 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:02:24.366 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:24.366 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:24.366 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:24.366 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87265 2024-04-19T03:02:24.366 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:24.367 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:24.367 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:24.367 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:24.367 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.349477+0000", 2024-04-19T03:02:24.367 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:24.367 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:24.367 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:24.367 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:24.367 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.349477+0000", 2024-04-19T03:02:24.367 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:24.367 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:24.367 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:24.367 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:24.368 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.349476+0000", 2024-04-19T03:02:24.368 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:24.368 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:24.368 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:24.368 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:24.368 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.349639+0000", 2024-04-19T03:02:24.368 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000163036 2024-04-19T03:02:24.368 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:24.368 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:24.368 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:24.368 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.349649+0000", 2024-04-19T03:02:24.368 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.7699999999999996e-06 2024-04-19T03:02:24.369 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:24.369 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:24.369 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:24.369 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.349675+0000", 2024-04-19T03:02:24.369 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.6432e-05 2024-04-19T03:02:24.369 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:24.369 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:24.369 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:24.369 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.355716+0000", 2024-04-19T03:02:24.369 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0060414479999999996 2024-04-19T03:02:24.369 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:24.369 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:24.369 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:24.370 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.355906+0000", 2024-04-19T03:02:24.370 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00018956800000000001 2024-04-19T03:02:24.370 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:24.370 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:24.370 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:02:24.370 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.356076+0000", 2024-04-19T03:02:24.370 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00017030499999999999 2024-04-19T03:02:24.370 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:24.370 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:24.370 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:24.370 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.361560+0000", 2024-04-19T03:02:24.370 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.005483936 2024-04-19T03:02:24.371 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:24.371 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:24.371 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:24.371 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:24.371 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:24.371 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87270 5.f 5:faee2e52:::benchmark_data_smithi096_19531_object87269:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-04-19T03:02:24.371 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:24.350240+0000", 2024-04-19T03:02:24.371 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.013433206, 2024-04-19T03:02:24.371 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.013562622, 2024-04-19T03:02:24.371 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:24.371 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:02:24.371 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:24.371 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:24.372 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:24.372 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87270 2024-04-19T03:02:24.372 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:24.372 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:24.372 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:24.372 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:24.372 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.350240+0000", 2024-04-19T03:02:24.372 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:24.372 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:24.372 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:24.372 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:24.372 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.350240+0000", 2024-04-19T03:02:24.372 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:24.372 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:24.373 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:24.373 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:24.373 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.350240+0000", 2024-04-19T03:02:24.373 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:24.373 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:24.373 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:24.373 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:24.373 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.350277+0000", 2024-04-19T03:02:24.373 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6776000000000002e-05 2024-04-19T03:02:24.373 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:24.373 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:24.373 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:24.373 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.350288+0000", 2024-04-19T03:02:24.374 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.185e-05 2024-04-19T03:02:24.374 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:24.374 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:24.374 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:24.374 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.350294+0000", 2024-04-19T03:02:24.374 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7679999999999997e-06 2024-04-19T03:02:24.374 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:24.374 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:24.374 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:24.374 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.350336+0000", 2024-04-19T03:02:24.374 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2116999999999997e-05 2024-04-19T03:02:24.374 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:24.375 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:24.375 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:24.375 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.350488+0000", 2024-04-19T03:02:24.375 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00015124800000000001 2024-04-19T03:02:24.375 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:24.375 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:24.375 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:02:24.375 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.350614+0000", 2024-04-19T03:02:24.375 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00012659600000000001 2024-04-19T03:02:24.375 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:24.375 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:24.375 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:24.376 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.356220+0000", 2024-04-19T03:02:24.376 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0056061970000000003 2024-04-19T03:02:24.376 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:24.376 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:24.376 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:24.376 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:24.376 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:24.376 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87271 5.f 5:fe6e3420:::benchmark_data_smithi096_19531_object87270:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-04-19T03:02:24.376 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:24.350422+0000", 2024-04-19T03:02:24.376 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.013251234000000001, 2024-04-19T03:02:24.376 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.013470797, 2024-04-19T03:02:24.376 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:24.376 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:02:24.376 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:24.377 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:24.377 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:24.377 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87271 2024-04-19T03:02:24.377 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:24.377 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:24.377 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:24.377 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:24.377 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.350422+0000", 2024-04-19T03:02:24.377 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:24.377 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:24.377 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:24.377 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:24.377 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.350422+0000", 2024-04-19T03:02:24.377 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:24.378 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:24.378 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:24.378 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:24.378 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.350421+0000", 2024-04-19T03:02:24.378 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:24.378 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:24.378 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:24.378 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:24.378 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.350533+0000", 2024-04-19T03:02:24.378 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000112076 2024-04-19T03:02:24.378 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:24.378 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:24.379 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:24.379 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.350544+0000", 2024-04-19T03:02:24.379 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1090000000000001e-05 2024-04-19T03:02:24.379 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:24.379 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:24.379 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:24.379 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.350554+0000", 2024-04-19T03:02:24.379 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.6739999999999992e-06 2024-04-19T03:02:24.379 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:24.379 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:24.379 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:24.379 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.353139+0000", 2024-04-19T03:02:24.379 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0025850349999999999 2024-04-19T03:02:24.379 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:24.380 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:24.380 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:24.380 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.353271+0000", 2024-04-19T03:02:24.380 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000131979 2024-04-19T03:02:24.380 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:24.380 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:24.380 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:02:24.380 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.353405+0000", 2024-04-19T03:02:24.380 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000134592 2024-04-19T03:02:24.380 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:24.380 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:24.380 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:24.380 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.360354+0000", 2024-04-19T03:02:24.381 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0069486000000000001 2024-04-19T03:02:24.381 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:24.381 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:24.381 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:24.381 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:24.381 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:24.381 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87274 5.2 5:40fd89e5:::benchmark_data_smithi096_19531_object87273:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-04-19T03:02:24.381 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:24.354597+0000", 2024-04-19T03:02:24.381 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0090769490000000008, 2024-04-19T03:02:24.381 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0093857779999999991, 2024-04-19T03:02:24.381 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:24.381 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-04-19T03:02:24.382 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:24.382 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:24.382 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:24.382 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87274 2024-04-19T03:02:24.382 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:24.382 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:24.382 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:24.382 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:24.382 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.354597+0000", 2024-04-19T03:02:24.382 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:24.382 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:24.382 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:24.382 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:24.383 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.354597+0000", 2024-04-19T03:02:24.383 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:24.383 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:24.383 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:24.383 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:24.383 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.354596+0000", 2024-04-19T03:02:24.383 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:24.383 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:24.383 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:24.383 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:24.383 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.354637+0000", 2024-04-19T03:02:24.383 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0590999999999998e-05 2024-04-19T03:02:24.383 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:24.383 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:24.384 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:24.384 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.354644+0000", 2024-04-19T03:02:24.384 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.3370000000000002e-06 2024-04-19T03:02:24.384 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:24.384 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:24.384 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:24.384 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.354651+0000", 2024-04-19T03:02:24.384 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6880000000000002e-06 2024-04-19T03:02:24.384 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:24.384 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:24.384 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:24.384 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.357051+0000", 2024-04-19T03:02:24.384 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0024004650000000001 2024-04-19T03:02:24.385 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:24.385 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:24.385 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:24.385 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.357167+0000", 2024-04-19T03:02:24.385 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000116323 2024-04-19T03:02:24.385 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:24.385 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:24.385 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:24.385 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:24.385 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:24.385 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87276 5.9 5:9bf9ffe0:::benchmark_data_smithi096_19531_object87275:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-04-19T03:02:24.385 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:24.354929+0000", 2024-04-19T03:02:24.385 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0087449009999999994, 2024-04-19T03:02:24.386 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0091295549999999993, 2024-04-19T03:02:24.386 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:24.386 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:02:24.386 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:24.386 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:24.386 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:24.386 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87276 2024-04-19T03:02:24.386 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:24.386 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:24.386 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:24.386 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:24.386 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.354929+0000", 2024-04-19T03:02:24.386 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:24.387 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:24.387 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:24.387 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:24.387 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.354929+0000", 2024-04-19T03:02:24.387 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:24.387 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:24.387 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:24.387 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:24.387 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.354928+0000", 2024-04-19T03:02:24.387 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:24.387 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:24.387 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:24.387 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:24.388 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.355037+0000", 2024-04-19T03:02:24.388 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000109051 2024-04-19T03:02:24.388 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:24.388 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:24.388 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:24.388 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.355047+0000", 2024-04-19T03:02:24.388 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0482999999999999e-05 2024-04-19T03:02:24.388 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:24.388 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:24.388 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:24.388 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.355054+0000", 2024-04-19T03:02:24.388 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5420000000000002e-06 2024-04-19T03:02:24.388 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:24.388 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:24.389 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:24.389 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.358562+0000", 2024-04-19T03:02:24.389 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.003507947 2024-04-19T03:02:24.389 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:24.389 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:24.389 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:24.389 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.358749+0000", 2024-04-19T03:02:24.389 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000187543 2024-04-19T03:02:24.389 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:24.389 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:24.389 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:02:24.389 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.358903+0000", 2024-04-19T03:02:24.389 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00015401799999999999 2024-04-19T03:02:24.389 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:24.390 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:24.390 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:24.390 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:24.390 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:24.390 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87279 5.c 5:31637b52:::benchmark_data_smithi096_19531_object87278:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-04-19T03:02:24.390 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:24.357326+0000", 2024-04-19T03:02:24.390 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.006347765, 2024-04-19T03:02:24.390 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0068115379999999998, 2024-04-19T03:02:24.390 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:24.390 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-04-19T03:02:24.390 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:24.390 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:24.391 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:24.391 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87279 2024-04-19T03:02:24.391 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:24.391 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:24.391 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:24.391 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:24.391 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.357326+0000", 2024-04-19T03:02:24.391 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:24.391 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:24.391 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:24.391 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:24.391 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.357326+0000", 2024-04-19T03:02:24.391 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:24.391 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:24.392 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:24.392 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:24.392 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.357325+0000", 2024-04-19T03:02:24.392 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:24.392 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:24.392 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:24.392 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:24.392 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.357368+0000", 2024-04-19T03:02:24.392 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3290000000000001e-05 2024-04-19T03:02:24.392 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:24.392 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:24.392 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:24.392 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.357379+0000", 2024-04-19T03:02:24.393 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1134e-05 2024-04-19T03:02:24.393 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:24.393 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:24.393 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:24.393 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.357385+0000", 2024-04-19T03:02:24.393 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4840000000000003e-06 2024-04-19T03:02:24.393 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:24.393 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:24.393 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:24.393 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.357419+0000", 2024-04-19T03:02:24.393 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4551000000000002e-05 2024-04-19T03:02:24.393 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:24.393 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:24.393 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:24.393 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.357521+0000", 2024-04-19T03:02:24.394 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00010197 2024-04-19T03:02:24.394 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:24.394 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:24.394 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:24.394 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:24.394 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:24.394 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4755.0:87280 5.d e44/22 5:b8971352:::benchmark_data_smithi096_19531_object87279:head v 44'5462, mlcod=44'5460)", 2024-04-19T03:02:24.394 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:24.358202+0000", 2024-04-19T03:02:24.394 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0054713440000000004, 2024-04-19T03:02:24.394 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.006005977, 2024-04-19T03:02:24.394 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:24.394 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-04-19T03:02:24.395 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:24.395 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:24.395 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:24.395 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.358202+0000", 2024-04-19T03:02:24.395 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:24.395 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:24.395 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:24.395 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:24.395 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.358202+0000", 2024-04-19T03:02:24.395 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:24.395 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:24.395 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:24.396 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:24.396 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.358201+0000", 2024-04-19T03:02:24.396 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:24.396 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:24.396 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:24.396 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:24.396 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.358267+0000", 2024-04-19T03:02:24.396 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6000000000000005e-05 2024-04-19T03:02:24.396 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:24.396 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:24.396 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:24.396 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.358291+0000", 2024-04-19T03:02:24.397 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.3421000000000002e-05 2024-04-19T03:02:24.397 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:24.397 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:24.397 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:24.397 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.358303+0000", 2024-04-19T03:02:24.397 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1805e-05 2024-04-19T03:02:24.397 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:24.397 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:24.397 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:24.397 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.358355+0000", 2024-04-19T03:02:24.397 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2227e-05 2024-04-19T03:02:24.397 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:24.397 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:24.398 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:24.398 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.358387+0000", 2024-04-19T03:02:24.398 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.1953999999999999e-05 2024-04-19T03:02:24.398 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:24.398 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:24.398 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:24.398 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:24.398 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:24.398 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87281 5.5 5:abb663bf:::benchmark_data_smithi096_19531_object87280:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-04-19T03:02:24.398 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:24.360707+0000", 2024-04-19T03:02:24.398 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0029661459999999998, 2024-04-19T03:02:24.398 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0035675139999999999, 2024-04-19T03:02:24.399 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:24.399 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-04-19T03:02:24.399 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:24.399 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:24.399 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:24.399 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87281 2024-04-19T03:02:24.399 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:24.399 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:24.399 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:24.399 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:24.399 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.360707+0000", 2024-04-19T03:02:24.399 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:24.399 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:24.399 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:24.400 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:24.400 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.360707+0000", 2024-04-19T03:02:24.400 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:24.400 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:24.400 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:24.400 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:24.400 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.360706+0000", 2024-04-19T03:02:24.400 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:24.400 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:24.400 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:24.400 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:24.400 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.360745+0000", 2024-04-19T03:02:24.400 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8254000000000003e-05 2024-04-19T03:02:24.401 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:24.401 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:24.401 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:24.401 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.360758+0000", 2024-04-19T03:02:24.401 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3278999999999999e-05 2024-04-19T03:02:24.401 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:24.401 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:24.401 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:24.401 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.360765+0000", 2024-04-19T03:02:24.401 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2139999999999999e-06 2024-04-19T03:02:24.401 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:24.401 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:24.401 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:24.401 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.360794+0000", 2024-04-19T03:02:24.402 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.8974000000000001e-05 2024-04-19T03:02:24.402 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:24.402 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:24.402 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:24.402 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.360870+0000", 2024-04-19T03:02:24.402 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6057999999999996e-05 2024-04-19T03:02:24.402 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:24.402 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:24.402 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:24.402 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:24.402 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:24.402 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87282 5.6 5:6362903f:::benchmark_data_smithi096_19531_object87281:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-04-19T03:02:24.402 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:24.361086+0000", 2024-04-19T03:02:24.403 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0025876279999999998, 2024-04-19T03:02:24.403 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0032640289999999999, 2024-04-19T03:02:24.403 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:24.403 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-04-19T03:02:24.403 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:24.403 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:24.403 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:24.403 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87282 2024-04-19T03:02:24.403 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:24.403 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:24.403 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:24.403 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:24.403 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.361086+0000", 2024-04-19T03:02:24.404 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:24.404 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:24.404 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:24.404 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:24.404 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.361086+0000", 2024-04-19T03:02:24.404 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:24.404 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:24.404 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:24.404 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:24.404 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.361085+0000", 2024-04-19T03:02:24.404 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:24.404 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:24.404 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:24.404 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:24.405 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.361156+0000", 2024-04-19T03:02:24.405 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0339999999999994e-05 2024-04-19T03:02:24.405 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:24.405 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:24.405 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:24.405 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.361165+0000", 2024-04-19T03:02:24.405 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.2210000000000003e-06 2024-04-19T03:02:24.405 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:24.405 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:24.405 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:24.405 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.361180+0000", 2024-04-19T03:02:24.405 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.5180999999999999e-05 2024-04-19T03:02:24.406 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:24.406 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:24.406 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:24.406 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.361219+0000", 2024-04-19T03:02:24.406 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8720999999999997e-05 2024-04-19T03:02:24.406 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:24.406 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:24.406 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:24.406 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.361298+0000", 2024-04-19T03:02:24.406 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9789000000000005e-05 2024-04-19T03:02:24.406 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:24.407 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:24.407 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:24.407 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:24.407 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:24.407 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87283 5.f 5:ff48e859:::benchmark_data_smithi096_19531_object87282:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-04-19T03:02:24.407 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:24.361190+0000", 2024-04-19T03:02:24.407 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.002483669, 2024-04-19T03:02:24.407 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.003235435, 2024-04-19T03:02:24.407 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:24.407 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:02:24.407 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:24.407 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:24.407 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:24.407 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87283 2024-04-19T03:02:24.408 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:24.408 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:24.408 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:24.408 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:24.408 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.361190+0000", 2024-04-19T03:02:24.408 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:24.408 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:24.408 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:24.408 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:24.408 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.361190+0000", 2024-04-19T03:02:24.408 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:24.408 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:24.408 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:24.408 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:24.409 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.361189+0000", 2024-04-19T03:02:24.409 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:24.409 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:24.409 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:24.409 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:24.409 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.361227+0000", 2024-04-19T03:02:24.409 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7116999999999997e-05 2024-04-19T03:02:24.409 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:24.409 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:24.409 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:24.409 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.361238+0000", 2024-04-19T03:02:24.409 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1472e-05 2024-04-19T03:02:24.409 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:24.409 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:24.410 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:24.410 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.361242+0000", 2024-04-19T03:02:24.410 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4139999999999996e-06 2024-04-19T03:02:24.410 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:24.410 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:24.410 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:24.410 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.361280+0000", 2024-04-19T03:02:24.410 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7602999999999999e-05 2024-04-19T03:02:24.410 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:24.410 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:24.410 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:24.410 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.361399+0000", 2024-04-19T03:02:24.410 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00011848 2024-04-19T03:02:24.411 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:24.411 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:24.411 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:02:24.411 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.361546+0000", 2024-04-19T03:02:24.411 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000147291 2024-04-19T03:02:24.411 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:24.411 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:24.411 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:24.411 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:24.411 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:24.411 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87284 5.7 5:e64e310b:::benchmark_data_smithi096_19531_object87283:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-04-19T03:02:24.411 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:24.361855+0000", 2024-04-19T03:02:24.411 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.001818189, 2024-04-19T03:02:24.411 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0026244250000000001, 2024-04-19T03:02:24.412 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:24.412 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-04-19T03:02:24.412 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:24.412 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:24.412 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:24.412 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87284 2024-04-19T03:02:24.412 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:24.412 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:24.412 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:24.412 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:24.412 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.361855+0000", 2024-04-19T03:02:24.413 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:24.413 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:24.413 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:24.413 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:24.413 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.361855+0000", 2024-04-19T03:02:24.413 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:24.413 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:24.413 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:24.414 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:24.414 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.361854+0000", 2024-04-19T03:02:24.414 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:24.414 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:24.414 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:24.414 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:24.415 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.361937+0000", 2024-04-19T03:02:24.415 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2398000000000006e-05 2024-04-19T03:02:24.415 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:24.415 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:24.415 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:24.415 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.361946+0000", 2024-04-19T03:02:24.415 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.7030000000000001e-06 2024-04-19T03:02:24.415 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:24.415 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:24.415 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:24.415 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.361952+0000", 2024-04-19T03:02:24.416 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.48e-06 2024-04-19T03:02:24.416 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:24.416 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:24.416 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:24.416 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.361978+0000", 2024-04-19T03:02:24.416 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.6188000000000001e-05 2024-04-19T03:02:24.416 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:24.416 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:24.416 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:24.416 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.362079+0000", 2024-04-19T03:02:24.416 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000101334 2024-04-19T03:02:24.416 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:24.416 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:24.416 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:24.417 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:24.417 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-04-19T03:02:24.417 INFO:teuthology.orchestra.run.smithi144.stdout: "num_ops": 11 2024-04-19T03:02:24.417 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-04-19T03:02:24.417 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-19T03:02:24.419 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T03:02:24.420 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:24.417+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:24.520 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:24.517+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:24.550 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-04-19T03:02:24.550 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2024-04-19T03:02:24.550 INFO:teuthology.orchestra.run.smithi144.stdout: "complaint_time": 30, 2024-04-19T03:02:24.550 INFO:teuthology.orchestra.run.smithi144.stdout: "num_blocked_ops": 0 2024-04-19T03:02:24.550 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-04-19T03:02:24.564 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T03:02:24.580 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1: {} 2024-04-19T03:02:24.600 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2: {} 2024-04-19T03:02:24.600 INFO:teuthology.orchestra.run.smithi096.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-04-19T03:02:24.601 INFO:teuthology.orchestra.run.smithi096.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-19T03:02:24.601 INFO:teuthology.orchestra.run.smithi096.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-19T03:02:24.605 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-19T03:02:24.605 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-19T03:02:24.621 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:24.619+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:24.694 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-04-19T03:02:24.694 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:02:24.705 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T03:02:24.723 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:24.721+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:24.823 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:24.819+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:24.824 INFO:tasks.radosbench.radosbench.0.smithi096.stdout: 47 16 88192 88176 117.242 65.875 0.00681471 0.00852348 2024-04-19T03:02:24.827 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-19T03:02:24.827 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:02:24.839 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T03:02:24.924 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:24.923+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:24.972 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-19T03:02:24.972 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:02:24.986 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T03:02:25.025 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:25.021+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:25.126 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:25.125+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:25.154 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-19T03:02:25.155 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:02:25.169 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T03:02:25.227 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:25.225+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:25.297 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-04-19T03:02:25.298 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:02:25.311 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T03:02:25.328 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:25.327+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:25.429 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:25.425+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:25.441 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-04-19T03:02:25.441 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:02:25.454 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T03:02:25.529 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:25.527+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:25.578 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-04-19T03:02:25.578 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:02:25.590 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T03:02:25.629 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:25.625+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:25.714 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-19T03:02:25.715 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:02:25.729 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T03:02:25.730 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:25.727+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:25.825 INFO:tasks.radosbench.radosbench.0.smithi096.stdout: 48 16 90110 90094 117.296 119.875 0.00979455 0.0085197 2024-04-19T03:02:25.831 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:25.829+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:25.851 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-19T03:02:25.851 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:02:25.864 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T03:02:25.932 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:25.929+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:25.988 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-19T03:02:25.988 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:02:26.002 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T03:02:26.033 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:26.031+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:26.134 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:26.133+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:26.134 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-04-19T03:02:26.135 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:02:26.148 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T03:02:26.235 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:26.233+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:26.266 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-19T03:02:26.278 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-04-19T03:02:26.278 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:02:26.289 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T03:02:26.336 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:26.333+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:26.421 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-04-19T03:02:26.421 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:02:26.434 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T03:02:26.478 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:26.477+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:26.538 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:26.537+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:26.562 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-19T03:02:26.562 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:02:26.576 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T03:02:26.606 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-19T03:02:26.638 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:26.635+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:26.701 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-19T03:02:26.701 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:02:26.713 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T03:02:26.739 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:26.737+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:26.753 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1: {} 2024-04-19T03:02:26.772 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2: {} 2024-04-19T03:02:26.773 INFO:teuthology.orchestra.run.smithi096.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-04-19T03:02:26.773 INFO:teuthology.orchestra.run.smithi096.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-19T03:02:26.773 INFO:teuthology.orchestra.run.smithi096.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-19T03:02:26.777 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-19T03:02:26.777 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-19T03:02:26.825 INFO:tasks.radosbench.radosbench.0.smithi096.stdout: 49 16 92066 92050 117.397 122.25 0.00581044 0.00851209 2024-04-19T03:02:26.838 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-19T03:02:26.838 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-04-19T03:02:26.838 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-04-19T03:02:26.838 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-04-19T03:02:26.838 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.838 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:79014 5.d 5:b5eee02c:::benchmark_data_smithi096_19531_object79013:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-19T03:02:26.838 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:18.032471+0000", 2024-04-19T03:02:26.839 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 8.8032221289999999, 2024-04-19T03:02:26.839 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.041427629000000001, 2024-04-19T03:02:26.839 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:26.839 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:26.839 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:26.839 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:26.839 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:26.839 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 79014 2024-04-19T03:02:26.839 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.839 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:26.839 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.839 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:26.839 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:18.032471+0000", 2024-04-19T03:02:26.840 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:26.840 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.840 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.840 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:26.840 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:18.032471+0000", 2024-04-19T03:02:26.840 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:26.840 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.840 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.840 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:26.840 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:18.032470+0000", 2024-04-19T03:02:26.840 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:26.840 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.840 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.841 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:26.841 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:18.032525+0000", 2024-04-19T03:02:26.841 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5535999999999998e-05 2024-04-19T03:02:26.841 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.841 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.841 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:26.841 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:18.032537+0000", 2024-04-19T03:02:26.841 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1987999999999999e-05 2024-04-19T03:02:26.841 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.841 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.841 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:26.841 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:18.032546+0000", 2024-04-19T03:02:26.842 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9670000000000007e-06 2024-04-19T03:02:26.842 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.842 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.842 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:26.842 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:18.032613+0000", 2024-04-19T03:02:26.842 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6508999999999996e-05 2024-04-19T03:02:26.842 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.842 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.842 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:26.842 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:18.032738+0000", 2024-04-19T03:02:26.842 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000124912 2024-04-19T03:02:26.842 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.842 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.843 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-04-19T03:02:26.843 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:18.032867+0000", 2024-04-19T03:02:26.843 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012959399999999999 2024-04-19T03:02:26.843 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.843 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.843 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:26.843 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:18.035867+0000", 2024-04-19T03:02:26.843 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.002999378 2024-04-19T03:02:26.843 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.843 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.843 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:26.843 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:18.073705+0000", 2024-04-19T03:02:26.843 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.037838042000000002 2024-04-19T03:02:26.844 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.844 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.844 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:26.844 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:18.073813+0000", 2024-04-19T03:02:26.844 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010806099999999999 2024-04-19T03:02:26.844 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.844 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.844 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:26.844 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:18.073899+0000", 2024-04-19T03:02:26.844 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.5971999999999996e-05 2024-04-19T03:02:26.844 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:26.844 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:26.845 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:26.845 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.845 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.845 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:86615 5.e 5:7fef7288:::benchmark_data_smithi096_19531_object86614:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:26.845 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:22.634544+0000", 2024-04-19T03:02:26.845 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 4.20114915, 2024-04-19T03:02:26.845 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.192475071, 2024-04-19T03:02:26.845 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:26.845 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:26.845 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:26.845 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:26.845 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:26.845 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 86615 2024-04-19T03:02:26.845 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.846 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:26.846 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.846 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:26.846 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634544+0000", 2024-04-19T03:02:26.846 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:26.846 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.846 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.846 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:26.846 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634544+0000", 2024-04-19T03:02:26.846 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:26.846 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.846 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.846 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:26.847 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634542+0000", 2024-04-19T03:02:26.847 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999981 2024-04-19T03:02:26.847 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.847 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.847 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:26.847 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634585+0000", 2024-04-19T03:02:26.847 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2299000000000003e-05 2024-04-19T03:02:26.847 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.847 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.847 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:26.847 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634592+0000", 2024-04-19T03:02:26.847 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2350000000000002e-06 2024-04-19T03:02:26.847 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.847 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.847 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:26.848 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634596+0000", 2024-04-19T03:02:26.848 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5390000000000001e-06 2024-04-19T03:02:26.848 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.848 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.848 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:26.848 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634639+0000", 2024-04-19T03:02:26.848 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2444999999999998e-05 2024-04-19T03:02:26.848 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.848 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.848 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:26.848 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634808+0000", 2024-04-19T03:02:26.848 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000169152 2024-04-19T03:02:26.848 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.849 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.849 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:26.849 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634999+0000", 2024-04-19T03:02:26.849 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00019098300000000001 2024-04-19T03:02:26.849 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.849 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.849 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:26.849 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.640458+0000", 2024-04-19T03:02:26.849 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0054586870000000003 2024-04-19T03:02:26.849 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.849 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.849 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:26.849 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.826949+0000", 2024-04-19T03:02:26.850 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.18649178299999999 2024-04-19T03:02:26.850 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.850 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.850 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:26.850 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.826982+0000", 2024-04-19T03:02:26.850 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2477000000000001e-05 2024-04-19T03:02:26.850 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.850 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.850 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:26.850 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.827019+0000", 2024-04-19T03:02:26.850 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7355999999999999e-05 2024-04-19T03:02:26.851 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:26.851 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:26.851 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:26.851 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.851 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.851 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:86616 5.e 5:72278f47:::benchmark_data_smithi096_19531_object86615:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:26.851 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:22.634609+0000", 2024-04-19T03:02:26.851 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 4.2010840009999999, 2024-04-19T03:02:26.851 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.19472088900000001, 2024-04-19T03:02:26.851 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:26.851 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:26.851 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:26.851 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:26.852 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:26.852 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 86616 2024-04-19T03:02:26.852 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.852 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:26.852 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.852 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:26.852 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634609+0000", 2024-04-19T03:02:26.852 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:26.852 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.852 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.852 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:26.852 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634609+0000", 2024-04-19T03:02:26.852 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:26.853 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.853 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.853 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:26.853 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634609+0000", 2024-04-19T03:02:26.853 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:26.853 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.853 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.853 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:26.853 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634651+0000", 2024-04-19T03:02:26.853 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2589000000000002e-05 2024-04-19T03:02:26.853 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.853 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.853 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:26.854 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634659+0000", 2024-04-19T03:02:26.854 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5850000000000002e-06 2024-04-19T03:02:26.854 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.854 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.854 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:26.854 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634662+0000", 2024-04-19T03:02:26.854 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3620000000000002e-06 2024-04-19T03:02:26.854 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.854 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.854 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:26.854 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.637880+0000", 2024-04-19T03:02:26.854 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.003218149 2024-04-19T03:02:26.855 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.855 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.855 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:26.855 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.637999+0000", 2024-04-19T03:02:26.855 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000118643 2024-04-19T03:02:26.855 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.856 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.856 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:26.856 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.638102+0000", 2024-04-19T03:02:26.856 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010331 2024-04-19T03:02:26.856 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.856 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.856 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:26.856 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.640851+0000", 2024-04-19T03:02:26.856 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0027483310000000001 2024-04-19T03:02:26.856 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.856 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.856 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:26.857 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.829269+0000", 2024-04-19T03:02:26.857 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.188418319 2024-04-19T03:02:26.857 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.857 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.857 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:26.857 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.829299+0000", 2024-04-19T03:02:26.857 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0227e-05 2024-04-19T03:02:26.857 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.857 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.857 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:26.857 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.829330+0000", 2024-04-19T03:02:26.857 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0969000000000001e-05 2024-04-19T03:02:26.857 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:26.858 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:26.858 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:26.858 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.858 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.858 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:86618 5.0 5:09014b90:::benchmark_data_smithi096_19531_object86617:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:26.858 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:22.634894+0000", 2024-04-19T03:02:26.858 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 4.2007995129999998, 2024-04-19T03:02:26.858 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.19413419800000001, 2024-04-19T03:02:26.858 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:26.858 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:26.858 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:26.858 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:26.858 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:26.859 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 86618 2024-04-19T03:02:26.859 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.859 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:26.859 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.859 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:26.859 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634894+0000", 2024-04-19T03:02:26.859 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:26.859 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.859 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.859 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:26.859 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634894+0000", 2024-04-19T03:02:26.859 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:26.859 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.860 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.860 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:26.860 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634893+0000", 2024-04-19T03:02:26.860 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:26.860 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.860 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.860 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:26.860 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634976+0000", 2024-04-19T03:02:26.860 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3231000000000003e-05 2024-04-19T03:02:26.860 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.860 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.860 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:26.860 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634983+0000", 2024-04-19T03:02:26.861 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5169999999999996e-06 2024-04-19T03:02:26.861 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.861 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.861 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:26.861 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634987+0000", 2024-04-19T03:02:26.861 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.425e-06 2024-04-19T03:02:26.861 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.861 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.861 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:26.861 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635030+0000", 2024-04-19T03:02:26.861 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.32e-05 2024-04-19T03:02:26.861 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.861 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.862 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:26.862 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635185+0000", 2024-04-19T03:02:26.862 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015471899999999999 2024-04-19T03:02:26.862 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.862 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.862 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:26.862 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635415+0000", 2024-04-19T03:02:26.862 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00023026500000000001 2024-04-19T03:02:26.862 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.862 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.862 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:26.862 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.640127+0000", 2024-04-19T03:02:26.862 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0047118890000000004 2024-04-19T03:02:26.863 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.863 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.863 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:26.863 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.828895+0000", 2024-04-19T03:02:26.863 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.18876802600000001 2024-04-19T03:02:26.863 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.863 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.863 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:26.863 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.828972+0000", 2024-04-19T03:02:26.863 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.6345000000000002e-05 2024-04-19T03:02:26.863 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.863 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.863 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:26.864 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.829028+0000", 2024-04-19T03:02:26.864 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6342999999999999e-05 2024-04-19T03:02:26.864 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:26.864 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:26.864 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:26.864 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.864 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.864 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:86620 5.b 5:d80faa68:::benchmark_data_smithi096_19531_object86619:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:26.864 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:22.635110+0000", 2024-04-19T03:02:26.864 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 4.2005829529999996, 2024-04-19T03:02:26.864 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.193447275, 2024-04-19T03:02:26.864 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:26.865 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:26.865 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:26.865 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:26.865 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:26.865 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 86620 2024-04-19T03:02:26.865 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.865 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:26.865 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.865 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:26.865 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635110+0000", 2024-04-19T03:02:26.865 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:26.865 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.865 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.865 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:26.866 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635110+0000", 2024-04-19T03:02:26.866 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:26.866 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.866 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.866 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:26.866 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635110+0000", 2024-04-19T03:02:26.866 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:26.866 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.866 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.866 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:26.866 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635154+0000", 2024-04-19T03:02:26.867 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4681000000000001e-05 2024-04-19T03:02:26.867 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.867 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.867 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:26.867 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635166+0000", 2024-04-19T03:02:26.867 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1505000000000001e-05 2024-04-19T03:02:26.867 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.867 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.867 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:26.867 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635171+0000", 2024-04-19T03:02:26.867 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6040000000000003e-06 2024-04-19T03:02:26.867 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.868 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.868 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:26.868 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635221+0000", 2024-04-19T03:02:26.868 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9947000000000001e-05 2024-04-19T03:02:26.868 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.868 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.868 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:26.868 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635356+0000", 2024-04-19T03:02:26.868 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013576199999999999 2024-04-19T03:02:26.868 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.868 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.868 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:26.869 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635507+0000", 2024-04-19T03:02:26.869 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015072999999999999 2024-04-19T03:02:26.869 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.869 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.869 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:26.869 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.638488+0000", 2024-04-19T03:02:26.869 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0029813159999999999 2024-04-19T03:02:26.869 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.869 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.869 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:26.869 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.828341+0000", 2024-04-19T03:02:26.869 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.189852254 2024-04-19T03:02:26.869 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.869 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.870 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:26.870 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.828416+0000", 2024-04-19T03:02:26.870 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5344000000000002e-05 2024-04-19T03:02:26.870 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.870 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.870 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:26.870 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.828558+0000", 2024-04-19T03:02:26.870 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000141695 2024-04-19T03:02:26.870 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:26.870 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:26.870 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:26.870 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.871 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.871 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:86621 5.8 5:1597a420:::benchmark_data_smithi096_19531_object86620:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:26.871 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:22.635187+0000", 2024-04-19T03:02:26.871 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 4.2005060929999996, 2024-04-19T03:02:26.871 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.194204878, 2024-04-19T03:02:26.871 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:26.871 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:26.871 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:26.871 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:26.871 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:26.871 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 86621 2024-04-19T03:02:26.871 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.871 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:26.872 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.872 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:26.872 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635187+0000", 2024-04-19T03:02:26.872 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:26.872 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.872 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.872 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:26.872 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635187+0000", 2024-04-19T03:02:26.872 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:26.872 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.872 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.872 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:26.872 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635187+0000", 2024-04-19T03:02:26.873 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:26.873 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.873 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.873 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:26.873 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635242+0000", 2024-04-19T03:02:26.873 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5158000000000003e-05 2024-04-19T03:02:26.873 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.873 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.873 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:26.873 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635249+0000", 2024-04-19T03:02:26.873 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.7000000000000008e-06 2024-04-19T03:02:26.873 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.873 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.873 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:26.873 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635256+0000", 2024-04-19T03:02:26.874 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2060000000000004e-06 2024-04-19T03:02:26.874 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.874 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.874 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:26.874 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635302+0000", 2024-04-19T03:02:26.874 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5954000000000001e-05 2024-04-19T03:02:26.874 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.874 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.874 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:26.874 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635427+0000", 2024-04-19T03:02:26.874 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012559299999999999 2024-04-19T03:02:26.874 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.874 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.875 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:26.875 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635596+0000", 2024-04-19T03:02:26.875 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000168615 2024-04-19T03:02:26.875 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.875 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.875 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:26.875 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.639320+0000", 2024-04-19T03:02:26.875 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0037244610000000001 2024-04-19T03:02:26.875 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.875 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.875 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:26.875 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.829277+0000", 2024-04-19T03:02:26.875 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.18995651099999999 2024-04-19T03:02:26.875 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.875 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.876 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:26.876 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.829341+0000", 2024-04-19T03:02:26.876 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3756000000000004e-05 2024-04-19T03:02:26.876 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.876 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.876 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:26.876 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.829392+0000", 2024-04-19T03:02:26.876 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1555999999999999e-05 2024-04-19T03:02:26.876 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:26.876 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:26.876 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:26.876 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.877 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.877 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87062 5.4 5:2d3b5d9a:::benchmark_data_smithi096_19531_object87061:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:26.877 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.136820+0000", 2024-04-19T03:02:26.877 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 3.6988729400000002, 2024-04-19T03:02:26.877 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.066483741999999998, 2024-04-19T03:02:26.877 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:26.877 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:26.877 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:26.877 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:26.877 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:26.877 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87062 2024-04-19T03:02:26.877 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.877 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:26.877 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.878 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:26.878 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.136820+0000", 2024-04-19T03:02:26.878 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:26.878 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.878 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.878 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:26.878 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.136820+0000", 2024-04-19T03:02:26.878 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:26.878 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.878 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.878 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:26.878 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.136819+0000", 2024-04-19T03:02:26.878 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:26.879 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.879 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.879 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:26.879 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.136864+0000", 2024-04-19T03:02:26.879 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4855000000000003e-05 2024-04-19T03:02:26.879 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.879 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.879 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:26.879 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.136881+0000", 2024-04-19T03:02:26.879 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7521999999999999e-05 2024-04-19T03:02:26.879 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.879 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.879 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:26.880 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.136890+0000", 2024-04-19T03:02:26.880 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1039999999999996e-06 2024-04-19T03:02:26.880 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.880 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.880 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:26.880 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.136974+0000", 2024-04-19T03:02:26.880 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3735999999999999e-05 2024-04-19T03:02:26.880 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.880 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.880 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:26.880 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.137308+0000", 2024-04-19T03:02:26.880 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00033376100000000002 2024-04-19T03:02:26.880 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.880 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.881 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:26.881 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.137559+0000", 2024-04-19T03:02:26.881 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000250599 2024-04-19T03:02:26.881 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.881 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.881 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:26.881 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.145423+0000", 2024-04-19T03:02:26.881 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0078649589999999995 2024-04-19T03:02:26.881 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.881 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.881 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:26.881 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.203175+0000", 2024-04-19T03:02:26.881 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057751255000000001 2024-04-19T03:02:26.881 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.881 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.882 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:26.882 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.203250+0000", 2024-04-19T03:02:26.882 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5378999999999998e-05 2024-04-19T03:02:26.882 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.882 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.882 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:26.882 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.203304+0000", 2024-04-19T03:02:26.882 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4015999999999999e-05 2024-04-19T03:02:26.882 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:26.882 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:26.883 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:26.883 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.883 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.883 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87065 5.4 5:21d20a47:::benchmark_data_smithi096_19531_object87064:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:26.883 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.137482+0000", 2024-04-19T03:02:26.883 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 3.6982112059999999, 2024-04-19T03:02:26.883 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.065988749999999999, 2024-04-19T03:02:26.883 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:26.883 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:26.883 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:26.883 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:26.883 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:26.883 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87065 2024-04-19T03:02:26.883 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.884 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:26.884 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.884 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:26.884 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.137482+0000", 2024-04-19T03:02:26.884 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:26.884 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.884 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.884 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:26.884 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.137482+0000", 2024-04-19T03:02:26.884 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:26.884 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.884 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.884 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:26.884 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.137481+0000", 2024-04-19T03:02:26.885 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:26.885 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.885 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.885 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:26.885 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.137530+0000", 2024-04-19T03:02:26.885 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9302000000000003e-05 2024-04-19T03:02:26.885 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.885 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.885 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:26.885 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.137540+0000", 2024-04-19T03:02:26.885 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.2010000000000005e-06 2024-04-19T03:02:26.885 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.886 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.886 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:26.886 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.137545+0000", 2024-04-19T03:02:26.886 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5910000000000003e-06 2024-04-19T03:02:26.886 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.886 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.886 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:26.886 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.140666+0000", 2024-04-19T03:02:26.886 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0031212710000000001 2024-04-19T03:02:26.886 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.886 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.887 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:26.887 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.140847+0000", 2024-04-19T03:02:26.887 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00018065600000000001 2024-04-19T03:02:26.887 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.887 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.887 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:26.887 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.140991+0000", 2024-04-19T03:02:26.887 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014433100000000001 2024-04-19T03:02:26.887 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.887 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.887 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:26.887 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.148053+0000", 2024-04-19T03:02:26.888 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.007061945 2024-04-19T03:02:26.888 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.888 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.888 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:26.888 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.203367+0000", 2024-04-19T03:02:26.888 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.055313703999999998 2024-04-19T03:02:26.888 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.888 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.888 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:26.888 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.203426+0000", 2024-04-19T03:02:26.888 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9024000000000003e-05 2024-04-19T03:02:26.888 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.889 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.889 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:26.889 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.203471+0000", 2024-04-19T03:02:26.889 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4818999999999999e-05 2024-04-19T03:02:26.889 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:26.889 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:26.889 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:26.889 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.889 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.889 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87067 5.b 5:d57af71a:::benchmark_data_smithi096_19531_object87066:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:26.889 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.142233+0000", 2024-04-19T03:02:26.889 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 3.6934602299999999, 2024-04-19T03:02:26.890 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.071692405000000001, 2024-04-19T03:02:26.890 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:26.890 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:26.890 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:26.890 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:26.890 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:26.890 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87067 2024-04-19T03:02:26.890 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.890 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:26.890 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.890 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:26.890 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142233+0000", 2024-04-19T03:02:26.890 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:26.891 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.891 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.891 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:26.891 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142233+0000", 2024-04-19T03:02:26.891 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:26.891 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.891 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.891 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:26.891 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142232+0000", 2024-04-19T03:02:26.891 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:26.891 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.891 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.891 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:26.892 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142277+0000", 2024-04-19T03:02:26.892 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5837000000000002e-05 2024-04-19T03:02:26.892 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.892 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.892 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:26.892 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142297+0000", 2024-04-19T03:02:26.892 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9561000000000001e-05 2024-04-19T03:02:26.892 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.892 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.892 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:26.892 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142311+0000", 2024-04-19T03:02:26.892 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3654e-05 2024-04-19T03:02:26.892 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.892 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.893 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:26.893 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142391+0000", 2024-04-19T03:02:26.893 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0123999999999994e-05 2024-04-19T03:02:26.893 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.893 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.893 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:26.893 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142669+0000", 2024-04-19T03:02:26.893 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00027829800000000001 2024-04-19T03:02:26.893 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.893 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.893 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:26.893 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142859+0000", 2024-04-19T03:02:26.893 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000190051 2024-04-19T03:02:26.893 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.894 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.894 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:26.894 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.150597+0000", 2024-04-19T03:02:26.894 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0077380299999999999 2024-04-19T03:02:26.894 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.894 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.894 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:26.894 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.213855+0000", 2024-04-19T03:02:26.894 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.063257987000000002 2024-04-19T03:02:26.894 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.894 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.894 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:26.894 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.213898+0000", 2024-04-19T03:02:26.894 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2916e-05 2024-04-19T03:02:26.895 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.895 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.895 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:26.895 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.213925+0000", 2024-04-19T03:02:26.895 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7503000000000001e-05 2024-04-19T03:02:26.895 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:26.895 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:26.895 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:26.895 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.895 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.895 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87069 5.b 5:da0c93b5:::benchmark_data_smithi096_19531_object87068:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:26.895 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.143402+0000", 2024-04-19T03:02:26.895 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 3.692291268, 2024-04-19T03:02:26.896 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.070678598999999995, 2024-04-19T03:02:26.896 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:26.896 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:26.896 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:26.896 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:26.896 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:26.896 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87069 2024-04-19T03:02:26.896 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.896 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:26.896 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.896 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:26.896 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.143402+0000", 2024-04-19T03:02:26.896 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:26.897 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.897 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.897 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:26.897 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.143402+0000", 2024-04-19T03:02:26.897 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:26.897 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.897 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.897 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:26.897 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.143401+0000", 2024-04-19T03:02:26.897 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:26.897 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.897 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.897 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:26.897 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.143501+0000", 2024-04-19T03:02:26.898 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000100387 2024-04-19T03:02:26.898 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.898 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.898 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:26.898 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.143516+0000", 2024-04-19T03:02:26.898 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5369000000000001e-05 2024-04-19T03:02:26.898 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.898 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.898 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:26.898 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.143524+0000", 2024-04-19T03:02:26.898 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.7079999999999997e-06 2024-04-19T03:02:26.898 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.898 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.898 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:26.899 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.145550+0000", 2024-04-19T03:02:26.899 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0020259290000000001 2024-04-19T03:02:26.899 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.899 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.899 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:26.899 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.145676+0000", 2024-04-19T03:02:26.899 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000126406 2024-04-19T03:02:26.899 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.899 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.899 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:26.899 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.145802+0000", 2024-04-19T03:02:26.899 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000125974 2024-04-19T03:02:26.899 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.899 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.900 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:26.900 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.151030+0000", 2024-04-19T03:02:26.900 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0052276079999999999 2024-04-19T03:02:26.900 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.900 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.900 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:26.900 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.213998+0000", 2024-04-19T03:02:26.900 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.06296786 2024-04-19T03:02:26.900 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.900 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.900 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:26.900 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.214031+0000", 2024-04-19T03:02:26.900 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3387999999999999e-05 2024-04-19T03:02:26.901 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.901 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.901 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:26.901 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.214081+0000", 2024-04-19T03:02:26.901 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9316e-05 2024-04-19T03:02:26.901 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:26.901 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:26.901 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:26.901 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.901 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.901 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87073 5.0 5:0ca21233:::benchmark_data_smithi096_19531_object87072:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:26.901 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.145929+0000", 2024-04-19T03:02:26.901 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 3.689764008, 2024-04-19T03:02:26.901 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.062283234999999999, 2024-04-19T03:02:26.902 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:26.902 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:26.902 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:26.902 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:26.902 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:26.902 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87073 2024-04-19T03:02:26.902 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.902 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:26.902 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.902 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:26.902 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.145929+0000", 2024-04-19T03:02:26.902 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:26.902 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.902 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.903 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:26.903 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.145929+0000", 2024-04-19T03:02:26.903 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:26.903 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.903 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.903 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:26.903 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.145928+0000", 2024-04-19T03:02:26.903 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:26.903 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.903 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.903 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:26.903 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.146063+0000", 2024-04-19T03:02:26.903 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013541099999999999 2024-04-19T03:02:26.903 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.903 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.904 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:26.904 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.146079+0000", 2024-04-19T03:02:26.904 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5902000000000001e-05 2024-04-19T03:02:26.904 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.904 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.904 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:26.904 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.146100+0000", 2024-04-19T03:02:26.904 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0380000000000001e-05 2024-04-19T03:02:26.904 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.904 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.904 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:26.904 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.146193+0000", 2024-04-19T03:02:26.904 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.3669000000000001e-05 2024-04-19T03:02:26.904 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.904 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.905 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:26.905 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.146388+0000", 2024-04-19T03:02:26.905 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00019457799999999999 2024-04-19T03:02:26.905 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.905 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.905 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:26.905 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.146625+0000", 2024-04-19T03:02:26.905 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00023751999999999999 2024-04-19T03:02:26.905 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.905 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.905 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:26.905 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.151051+0000", 2024-04-19T03:02:26.905 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0044260039999999999 2024-04-19T03:02:26.905 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.906 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.906 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:26.906 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.207872+0000", 2024-04-19T03:02:26.906 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.056821114999999998 2024-04-19T03:02:26.906 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.906 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.906 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:26.906 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.208085+0000", 2024-04-19T03:02:26.906 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000212893 2024-04-19T03:02:26.906 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.906 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.906 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:26.906 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.208213+0000", 2024-04-19T03:02:26.907 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012714700000000001 2024-04-19T03:02:26.907 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:26.907 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:26.907 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:26.907 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.907 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.907 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87074 5.0 5:035614ac:::benchmark_data_smithi096_19531_object87073:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:26.907 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.151387+0000", 2024-04-19T03:02:26.907 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 3.684306077, 2024-04-19T03:02:26.907 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.063461771, 2024-04-19T03:02:26.907 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:26.907 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:26.907 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:26.908 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:26.908 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:26.908 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87074 2024-04-19T03:02:26.908 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.908 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:26.908 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.908 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:26.908 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.151387+0000", 2024-04-19T03:02:26.908 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:26.908 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.908 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.908 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:26.908 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.151387+0000", 2024-04-19T03:02:26.909 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:26.909 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.909 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.909 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:26.909 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.151386+0000", 2024-04-19T03:02:26.909 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:26.909 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.909 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.909 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:26.909 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.151428+0000", 2024-04-19T03:02:26.909 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.172e-05 2024-04-19T03:02:26.909 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.909 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.909 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:26.910 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.151442+0000", 2024-04-19T03:02:26.910 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4328000000000001e-05 2024-04-19T03:02:26.910 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.910 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.910 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:26.910 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.151451+0000", 2024-04-19T03:02:26.910 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.8400000000000001e-06 2024-04-19T03:02:26.910 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.910 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.910 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:26.910 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.151521+0000", 2024-04-19T03:02:26.910 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.9606999999999999e-05 2024-04-19T03:02:26.911 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.911 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.911 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:26.911 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.151749+0000", 2024-04-19T03:02:26.911 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00022818799999999999 2024-04-19T03:02:26.911 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.911 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.911 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:26.911 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.152006+0000", 2024-04-19T03:02:26.911 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00025687300000000002 2024-04-19T03:02:26.911 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.911 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.911 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:26.912 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.154887+0000", 2024-04-19T03:02:26.912 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0028812989999999999 2024-04-19T03:02:26.912 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.912 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.912 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:26.912 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.214733+0000", 2024-04-19T03:02:26.912 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.059846159000000003 2024-04-19T03:02:26.912 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.912 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.912 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:26.912 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.214788+0000", 2024-04-19T03:02:26.912 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4524000000000002e-05 2024-04-19T03:02:26.912 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.913 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.913 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:26.913 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.214849+0000", 2024-04-19T03:02:26.913 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1362e-05 2024-04-19T03:02:26.913 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:26.913 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:26.913 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:26.913 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.913 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.913 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87108 5.e 5:7e197adc:::benchmark_data_smithi096_19531_object87107:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:26.913 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.223103+0000", 2024-04-19T03:02:26.913 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 3.612589931, 2024-04-19T03:02:26.913 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.044946887, 2024-04-19T03:02:26.914 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:26.914 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-19T03:02:26.914 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:26.914 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:26.914 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:26.914 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87108 2024-04-19T03:02:26.914 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.914 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:26.914 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.914 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:26.914 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.223103+0000", 2024-04-19T03:02:26.914 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:26.915 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.915 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.915 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:26.915 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.223103+0000", 2024-04-19T03:02:26.915 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:26.915 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.915 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.915 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:26.915 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.223102+0000", 2024-04-19T03:02:26.915 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:26.915 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.915 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.915 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:26.915 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.223156+0000", 2024-04-19T03:02:26.916 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3958000000000001e-05 2024-04-19T03:02:26.916 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.916 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.916 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:26.916 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.223166+0000", 2024-04-19T03:02:26.916 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.4809999999999995e-06 2024-04-19T03:02:26.916 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.916 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.916 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:26.916 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.223172+0000", 2024-04-19T03:02:26.916 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0140000000000004e-06 2024-04-19T03:02:26.916 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.916 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.916 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:26.916 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.227295+0000", 2024-04-19T03:02:26.917 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0041233420000000003 2024-04-19T03:02:26.917 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.917 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.917 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:26.917 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.227495+0000", 2024-04-19T03:02:26.917 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00019955299999999999 2024-04-19T03:02:26.917 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.917 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.917 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:26.917 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.227717+0000", 2024-04-19T03:02:26.917 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000221902 2024-04-19T03:02:26.917 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.917 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.917 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:26.918 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233189+0000", 2024-04-19T03:02:26.918 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0054718889999999997 2024-04-19T03:02:26.918 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.918 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.918 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:26.918 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.250529+0000", 2024-04-19T03:02:26.918 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.017340298000000001 2024-04-19T03:02:26.918 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.918 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.918 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:02:26.918 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.250539+0000", 2024-04-19T03:02:26.918 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0501e-05 2024-04-19T03:02:26.918 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.918 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.919 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:26.919 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.268003+0000", 2024-04-19T03:02:26.919 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.017463429 2024-04-19T03:02:26.919 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.919 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.919 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:26.919 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.268050+0000", 2024-04-19T03:02:26.919 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7466000000000003e-05 2024-04-19T03:02:26.919 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:26.919 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:26.919 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:26.919 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.919 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.919 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87118 5.b 5:d1bb4f3c:::benchmark_data_smithi096_19531_object87117:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:26.919 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.231082+0000", 2024-04-19T03:02:26.919 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 3.6046110970000003, 2024-04-19T03:02:26.920 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.035789004, 2024-04-19T03:02:26.920 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:26.920 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-19T03:02:26.920 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:26.920 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:26.920 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:26.920 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87118 2024-04-19T03:02:26.920 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.920 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:26.920 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.920 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:26.920 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231082+0000", 2024-04-19T03:02:26.920 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:26.920 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.920 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.920 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:26.921 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231082+0000", 2024-04-19T03:02:26.921 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:26.921 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.921 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.921 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:26.921 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231081+0000", 2024-04-19T03:02:26.921 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:26.921 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.921 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.921 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:26.921 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231159+0000", 2024-04-19T03:02:26.921 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.7819999999999997e-05 2024-04-19T03:02:26.921 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.921 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.921 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:26.922 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231186+0000", 2024-04-19T03:02:26.922 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7126000000000001e-05 2024-04-19T03:02:26.922 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.922 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.922 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:26.922 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231193+0000", 2024-04-19T03:02:26.922 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7259999999999996e-06 2024-04-19T03:02:26.922 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.922 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.922 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:26.922 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231241+0000", 2024-04-19T03:02:26.922 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8123e-05 2024-04-19T03:02:26.922 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.923 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.923 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:26.923 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231354+0000", 2024-04-19T03:02:26.923 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0001133 2024-04-19T03:02:26.923 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.923 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.923 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:26.923 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231443+0000", 2024-04-19T03:02:26.923 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9167999999999997e-05 2024-04-19T03:02:26.923 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.923 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.923 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:26.924 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236498+0000", 2024-04-19T03:02:26.924 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0050545160000000002 2024-04-19T03:02:26.924 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.924 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.924 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:26.924 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.249681+0000", 2024-04-19T03:02:26.924 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013183321 2024-04-19T03:02:26.924 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.924 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.924 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:02:26.924 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.249693+0000", 2024-04-19T03:02:26.924 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1834999999999999e-05 2024-04-19T03:02:26.924 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.925 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.925 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:26.925 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266733+0000", 2024-04-19T03:02:26.925 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.017040408 2024-04-19T03:02:26.925 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.925 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.925 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:26.925 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266871+0000", 2024-04-19T03:02:26.925 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000137849 2024-04-19T03:02:26.925 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:26.925 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:26.925 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:26.925 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.925 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.926 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87121 5.b 5:d01822b8:::benchmark_data_smithi096_19531_object87120:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:26.926 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.233319+0000", 2024-04-19T03:02:26.926 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 3.6023742329999999, 2024-04-19T03:02:26.926 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.033624198, 2024-04-19T03:02:26.926 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:26.926 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-19T03:02:26.926 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:26.926 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:26.926 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:26.926 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87121 2024-04-19T03:02:26.926 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.926 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:26.926 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.927 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:26.927 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233319+0000", 2024-04-19T03:02:26.927 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:26.927 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.927 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.927 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:26.927 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233319+0000", 2024-04-19T03:02:26.927 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:26.927 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.927 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.927 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:26.927 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233319+0000", 2024-04-19T03:02:26.927 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:26.927 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.927 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.927 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:26.928 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233364+0000", 2024-04-19T03:02:26.928 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5460999999999997e-05 2024-04-19T03:02:26.928 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.928 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.928 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:26.928 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233382+0000", 2024-04-19T03:02:26.928 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8148e-05 2024-04-19T03:02:26.928 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.928 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.928 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:26.928 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233390+0000", 2024-04-19T03:02:26.928 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5340000000000002e-06 2024-04-19T03:02:26.928 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.929 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.929 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:26.929 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233712+0000", 2024-04-19T03:02:26.929 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00032260500000000001 2024-04-19T03:02:26.929 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.929 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.929 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:26.929 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233829+0000", 2024-04-19T03:02:26.929 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011638599999999999 2024-04-19T03:02:26.929 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.929 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.929 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:26.929 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233959+0000", 2024-04-19T03:02:26.930 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013013900000000001 2024-04-19T03:02:26.930 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.930 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.930 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:26.930 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236515+0000", 2024-04-19T03:02:26.930 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0025562750000000002 2024-04-19T03:02:26.930 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.930 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.930 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:26.930 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.249723+0000", 2024-04-19T03:02:26.930 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013208176 2024-04-19T03:02:26.930 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.930 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.930 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:02:26.931 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.249728+0000", 2024-04-19T03:02:26.931 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6519999999999997e-06 2024-04-19T03:02:26.931 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.931 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.931 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:26.931 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266837+0000", 2024-04-19T03:02:26.931 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0171087059999999 2024-04-19T03:02:26.931 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.931 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.931 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:26.931 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266943+0000", 2024-04-19T03:02:26.931 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000106604 2024-04-19T03:02:26.931 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:26.931 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:26.932 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:26.932 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.932 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.932 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87124 5.8 5:14819ad7:::benchmark_data_smithi096_19531_object87123:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:26.932 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.235886+0000", 2024-04-19T03:02:26.932 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 3.5998068089999999, 2024-04-19T03:02:26.932 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0315451179999999, 2024-04-19T03:02:26.932 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:26.932 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-19T03:02:26.932 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:26.932 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:26.932 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:26.932 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87124 2024-04-19T03:02:26.932 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.932 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:26.933 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.933 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:26.933 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.235886+0000", 2024-04-19T03:02:26.933 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:26.933 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.933 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.933 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:26.933 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.235886+0000", 2024-04-19T03:02:26.933 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:26.933 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.933 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.933 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:26.933 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.235886+0000", 2024-04-19T03:02:26.933 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:26.933 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.934 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.934 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:26.934 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.235934+0000", 2024-04-19T03:02:26.934 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8384000000000003e-05 2024-04-19T03:02:26.934 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.934 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.934 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:26.934 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.235945+0000", 2024-04-19T03:02:26.934 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0671e-05 2024-04-19T03:02:26.934 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.934 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.934 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:26.935 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.235952+0000", 2024-04-19T03:02:26.935 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3089999999999998e-06 2024-04-19T03:02:26.935 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.935 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.935 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:26.935 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.237067+0000", 2024-04-19T03:02:26.935 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001115263 2024-04-19T03:02:26.935 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.935 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.935 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:26.935 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.237188+0000", 2024-04-19T03:02:26.935 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000121258 2024-04-19T03:02:26.935 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.935 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.936 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:26.936 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.237316+0000", 2024-04-19T03:02:26.936 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000128071 2024-04-19T03:02:26.936 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.936 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.936 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:26.936 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240744+0000", 2024-04-19T03:02:26.936 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0034275629999999998 2024-04-19T03:02:26.936 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.936 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.936 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:26.936 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.252517+0000", 2024-04-19T03:02:26.936 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011772991999999999 2024-04-19T03:02:26.936 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.936 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.936 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:02:26.937 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.252523+0000", 2024-04-19T03:02:26.937 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3640000000000004e-06 2024-04-19T03:02:26.937 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.937 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.937 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:26.937 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.267290+0000", 2024-04-19T03:02:26.937 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0147665690000001 2024-04-19T03:02:26.937 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.937 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.937 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:26.937 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.267432+0000", 2024-04-19T03:02:26.937 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014165299999999999 2024-04-19T03:02:26.937 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:26.937 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:26.937 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:26.937 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.938 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.938 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87129 5.0 5:02667e01:::benchmark_data_smithi096_19531_object87128:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:26.938 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.236466+0000", 2024-04-19T03:02:26.938 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 3.599226813, 2024-04-19T03:02:26.938 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0301534510000001, 2024-04-19T03:02:26.938 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:26.938 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-19T03:02:26.938 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:26.938 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:26.938 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:26.938 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87129 2024-04-19T03:02:26.938 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.938 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:26.939 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.939 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:26.939 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236466+0000", 2024-04-19T03:02:26.939 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:26.939 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.939 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.939 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:26.939 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236466+0000", 2024-04-19T03:02:26.939 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:26.939 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.939 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.939 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:26.939 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236465+0000", 2024-04-19T03:02:26.939 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:26.939 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.940 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.940 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:26.940 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236566+0000", 2024-04-19T03:02:26.940 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010047000000000001 2024-04-19T03:02:26.940 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.940 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.940 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:26.940 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236577+0000", 2024-04-19T03:02:26.940 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1772e-05 2024-04-19T03:02:26.940 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.940 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.940 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:26.941 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236584+0000", 2024-04-19T03:02:26.941 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0530000000000003e-06 2024-04-19T03:02:26.941 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.941 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.941 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:26.941 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.237023+0000", 2024-04-19T03:02:26.941 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000439703 2024-04-19T03:02:26.941 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.941 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.941 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:26.941 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.237207+0000", 2024-04-19T03:02:26.941 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000183692 2024-04-19T03:02:26.941 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.942 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.942 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:26.942 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.237373+0000", 2024-04-19T03:02:26.942 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016623500000000001 2024-04-19T03:02:26.942 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.942 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.942 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:26.942 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.241461+0000", 2024-04-19T03:02:26.942 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0040883050000000004 2024-04-19T03:02:26.942 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.942 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.942 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:26.943 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.252500+0000", 2024-04-19T03:02:26.943 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011038450999999999 2024-04-19T03:02:26.943 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.943 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.943 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:02:26.943 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.252507+0000", 2024-04-19T03:02:26.943 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2439999999999996e-06 2024-04-19T03:02:26.943 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.943 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.943 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:26.943 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266538+0000", 2024-04-19T03:02:26.943 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.014031184 2024-04-19T03:02:26.944 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.944 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.944 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:26.944 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266620+0000", 2024-04-19T03:02:26.944 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1600000000000005e-05 2024-04-19T03:02:26.944 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:26.944 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:26.944 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:26.944 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.944 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.944 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87135 5.4 5:2a97e7b7:::benchmark_data_smithi096_19531_object87134:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:26.944 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.240884+0000", 2024-04-19T03:02:26.945 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 3.5948093559999998, 2024-04-19T03:02:26.945 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.025708931, 2024-04-19T03:02:26.945 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:26.945 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-19T03:02:26.945 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:26.945 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:26.945 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:26.945 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87135 2024-04-19T03:02:26.945 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.945 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:26.945 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.946 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:26.946 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240884+0000", 2024-04-19T03:02:26.946 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:26.946 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.946 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.946 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:26.946 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240884+0000", 2024-04-19T03:02:26.946 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:26.946 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.946 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.946 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:26.947 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240883+0000", 2024-04-19T03:02:26.947 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:26.947 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.947 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.947 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:26.947 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240933+0000", 2024-04-19T03:02:26.947 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9969999999999998e-05 2024-04-19T03:02:26.947 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.947 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.947 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:26.947 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240946+0000", 2024-04-19T03:02:26.947 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2943e-05 2024-04-19T03:02:26.947 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.948 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.948 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:26.948 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240952+0000", 2024-04-19T03:02:26.948 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8930000000000002e-06 2024-04-19T03:02:26.948 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.948 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.948 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:26.948 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240994+0000", 2024-04-19T03:02:26.948 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2753999999999998e-05 2024-04-19T03:02:26.948 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.948 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.948 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:26.948 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.241092+0000", 2024-04-19T03:02:26.949 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.7447000000000004e-05 2024-04-19T03:02:26.949 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.949 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.949 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:26.949 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.241183+0000", 2024-04-19T03:02:26.949 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1163999999999997e-05 2024-04-19T03:02:26.949 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.949 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.949 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:26.949 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.254672+0000", 2024-04-19T03:02:26.949 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.01348864 2024-04-19T03:02:26.949 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.950 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.950 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:02:26.950 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.254681+0000", 2024-04-19T03:02:26.950 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.3789999999999995e-06 2024-04-19T03:02:26.950 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.950 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.950 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:26.950 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266456+0000", 2024-04-19T03:02:26.950 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.011774621 2024-04-19T03:02:26.950 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.950 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.950 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:26.950 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266593+0000", 2024-04-19T03:02:26.951 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013737600000000001 2024-04-19T03:02:26.951 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:26.951 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:26.951 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:26.951 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.951 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.951 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87136 5.4 5:212411bc:::benchmark_data_smithi096_19531_object87135:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:26.951 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.240962+0000", 2024-04-19T03:02:26.951 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 3.5947314800000001, 2024-04-19T03:02:26.951 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.025738, 2024-04-19T03:02:26.951 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:26.951 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-19T03:02:26.952 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:26.952 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:26.952 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:26.952 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87136 2024-04-19T03:02:26.952 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.952 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:26.952 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.952 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:26.952 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240962+0000", 2024-04-19T03:02:26.952 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:26.952 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.952 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.952 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:26.952 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240962+0000", 2024-04-19T03:02:26.953 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:26.953 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.953 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.953 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:26.953 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240961+0000", 2024-04-19T03:02:26.953 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:26.953 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.953 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.953 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:26.953 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240995+0000", 2024-04-19T03:02:26.953 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3868000000000002e-05 2024-04-19T03:02:26.953 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.953 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.954 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:26.954 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.241001+0000", 2024-04-19T03:02:26.954 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.322e-06 2024-04-19T03:02:26.954 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.954 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.954 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:26.954 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.241004+0000", 2024-04-19T03:02:26.954 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3510000000000002e-06 2024-04-19T03:02:26.954 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.954 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.954 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:26.955 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247131+0000", 2024-04-19T03:02:26.955 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0061270869999999998 2024-04-19T03:02:26.955 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.955 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.955 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:26.955 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247322+0000", 2024-04-19T03:02:26.955 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000191015 2024-04-19T03:02:26.955 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.955 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.955 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:26.955 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247542+0000", 2024-04-19T03:02:26.955 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00022030199999999999 2024-04-19T03:02:26.956 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.956 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.956 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:26.956 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.254709+0000", 2024-04-19T03:02:26.956 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0071662660000000001 2024-04-19T03:02:26.956 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.956 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.956 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:02:26.956 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.254716+0000", 2024-04-19T03:02:26.956 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3860000000000001e-06 2024-04-19T03:02:26.956 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.956 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.956 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:26.956 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266619+0000", 2024-04-19T03:02:26.957 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0119031030000001 2024-04-19T03:02:26.957 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.957 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.957 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:26.957 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266700+0000", 2024-04-19T03:02:26.957 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0764000000000001e-05 2024-04-19T03:02:26.957 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:26.957 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:26.957 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:26.957 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.957 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.957 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87138 5.e 5:7b1f1c20:::benchmark_data_smithi096_19531_object87137:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:26.957 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.247862+0000", 2024-04-19T03:02:26.958 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 3.5878314059999998, 2024-04-19T03:02:26.958 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.024457079, 2024-04-19T03:02:26.958 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:26.958 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:26.958 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:26.958 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:26.958 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:26.958 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87138 2024-04-19T03:02:26.958 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.958 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:26.958 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.958 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:26.959 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247862+0000", 2024-04-19T03:02:26.959 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:26.959 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.959 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.959 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:26.959 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247862+0000", 2024-04-19T03:02:26.959 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:26.959 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.959 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.959 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:26.959 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247860+0000", 2024-04-19T03:02:26.959 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999981 2024-04-19T03:02:26.959 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.959 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.960 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:26.960 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247909+0000", 2024-04-19T03:02:26.960 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9150999999999997e-05 2024-04-19T03:02:26.960 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.960 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.960 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:26.960 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247925+0000", 2024-04-19T03:02:26.960 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5761999999999999e-05 2024-04-19T03:02:26.960 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.960 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.960 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:26.960 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247936+0000", 2024-04-19T03:02:26.960 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1144e-05 2024-04-19T03:02:26.960 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.961 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.961 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:26.961 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.250590+0000", 2024-04-19T03:02:26.961 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.002653678 2024-04-19T03:02:26.961 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.961 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.961 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:02:26.961 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.250599+0000", 2024-04-19T03:02:26.961 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9039999999999998e-06 2024-04-19T03:02:26.961 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.961 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.961 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:26.961 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.268151+0000", 2024-04-19T03:02:26.962 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0175523449999999 2024-04-19T03:02:26.962 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.962 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.962 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:26.962 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.268285+0000", 2024-04-19T03:02:26.962 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013415599999999999 2024-04-19T03:02:26.962 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.962 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.962 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:26.962 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.272238+0000", 2024-04-19T03:02:26.962 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0039533019999999997 2024-04-19T03:02:26.962 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.962 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.962 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:26.963 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.272274+0000", 2024-04-19T03:02:26.963 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5352000000000003e-05 2024-04-19T03:02:26.963 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:26.963 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:26.963 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:26.963 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.272319+0000", 2024-04-19T03:02:26.963 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5281999999999998e-05 2024-04-19T03:02:26.963 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:26.963 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:26.963 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:26.963 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:26.963 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:26.963 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-19T03:02:26.965 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T03:02:26.966 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:26.963+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:27.065 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:27.063+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:27.086 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-04-19T03:02:27.086 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [ 2024-04-19T03:02:27.086 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.086 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:92555 5.9 5:9d311641:::benchmark_data_smithi096_19531_object92554:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-04-19T03:02:27.086 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:27.084487+0000", 2024-04-19T03:02:27.086 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0012857739999999999, 2024-04-19T03:02:27.086 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0013046449999999999, 2024-04-19T03:02:27.087 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:27.087 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:02:27.087 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:27.087 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:27.087 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:27.087 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 92555 2024-04-19T03:02:27.087 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.087 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:27.087 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.087 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:27.087 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:27.084487+0000", 2024-04-19T03:02:27.087 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:27.087 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.088 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.088 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:27.088 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:27.084487+0000", 2024-04-19T03:02:27.088 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:27.088 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.088 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.088 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:27.088 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:27.084486+0000", 2024-04-19T03:02:27.088 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:27.088 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.088 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.089 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:27.089 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:27.084568+0000", 2024-04-19T03:02:27.089 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.1376000000000002e-05 2024-04-19T03:02:27.089 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.089 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.089 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:27.089 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:27.084575+0000", 2024-04-19T03:02:27.089 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5170000000000002e-06 2024-04-19T03:02:27.089 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.089 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.089 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:27.089 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:27.084583+0000", 2024-04-19T03:02:27.089 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9279999999999993e-06 2024-04-19T03:02:27.089 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.090 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.090 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:27.090 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:27.084632+0000", 2024-04-19T03:02:27.090 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8421000000000003e-05 2024-04-19T03:02:27.090 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.090 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.090 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:27.090 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:27.084786+0000", 2024-04-19T03:02:27.090 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00015446700000000001 2024-04-19T03:02:27.090 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.090 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.090 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:02:27.090 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:27.084932+0000", 2024-04-19T03:02:27.091 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00014545500000000001 2024-04-19T03:02:27.091 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:27.091 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:27.091 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:27.091 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.091 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.091 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:92556 5.c 5:3194dc7f:::benchmark_data_smithi096_19531_object92555:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2024-04-19T03:02:27.091 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:27.084684+0000", 2024-04-19T03:02:27.091 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.001089298, 2024-04-19T03:02:27.091 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0011563809999999999, 2024-04-19T03:02:27.091 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:27.091 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-04-19T03:02:27.091 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:27.092 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:27.092 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:27.092 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 92556 2024-04-19T03:02:27.092 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.092 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:27.092 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.092 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:27.092 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:27.084684+0000", 2024-04-19T03:02:27.092 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:27.092 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.092 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.092 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:27.092 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:27.084684+0000", 2024-04-19T03:02:27.092 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:27.092 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.093 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.093 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:27.093 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:27.084683+0000", 2024-04-19T03:02:27.093 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:27.093 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.093 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.093 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:27.093 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:27.084780+0000", 2024-04-19T03:02:27.093 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.6805999999999994e-05 2024-04-19T03:02:27.093 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.093 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.094 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:27.094 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:27.084786+0000", 2024-04-19T03:02:27.094 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.392e-06 2024-04-19T03:02:27.094 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.094 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.094 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:27.094 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:27.084790+0000", 2024-04-19T03:02:27.094 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.963e-06 2024-04-19T03:02:27.094 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.094 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.094 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:27.094 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:27.084833+0000", 2024-04-19T03:02:27.094 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2945999999999998e-05 2024-04-19T03:02:27.095 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.095 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.095 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:27.095 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:27.084930+0000", 2024-04-19T03:02:27.095 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.6824000000000007e-05 2024-04-19T03:02:27.095 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:27.095 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:27.095 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:27.095 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:27.095 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-04-19T03:02:27.095 INFO:teuthology.orchestra.run.smithi144.stdout: "num_ops": 2 2024-04-19T03:02:27.095 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-04-19T03:02:27.098 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T03:02:27.166 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:27.165+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:27.223 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-04-19T03:02:27.223 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2024-04-19T03:02:27.223 INFO:teuthology.orchestra.run.smithi144.stdout: "complaint_time": 30, 2024-04-19T03:02:27.223 INFO:teuthology.orchestra.run.smithi144.stdout: "num_blocked_ops": 0 2024-04-19T03:02:27.223 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-04-19T03:02:27.237 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T03:02:27.267 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:27.263+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:27.304 INFO:teuthology.orchestra.run.smithi096.stderr:nodeep-scrub is set 2024-04-19T03:02:27.358 DEBUG:teuthology.orchestra.console.smithi097:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-19T03:02:27.368 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-04-19T03:02:27.368 INFO:teuthology.orchestra.run.smithi144.stdout: "size": 20, 2024-04-19T03:02:27.368 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 600, 2024-04-19T03:02:27.369 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [ 2024-04-19T03:02:27.369 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.369 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:78992 5.7 5:e6baa862:::benchmark_data_smithi096_19531_object78991:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-19T03:02:27.369 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:18.008888+0000", 2024-04-19T03:02:27.369 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 9.3557183029999997, 2024-04-19T03:02:27.369 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.056375285999999997, 2024-04-19T03:02:27.369 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:27.369 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:27.369 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:27.369 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:27.370 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:27.370 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 78992 2024-04-19T03:02:27.370 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.370 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:27.370 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.370 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:27.370 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.008888+0000", 2024-04-19T03:02:27.370 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:27.370 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.370 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.370 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:27.371 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.008888+0000", 2024-04-19T03:02:27.371 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:27.371 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.371 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.371 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:27.371 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.008888+0000", 2024-04-19T03:02:27.371 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:27.371 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.371 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.371 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:27.371 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.008928+0000", 2024-04-19T03:02:27.372 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0361999999999997e-05 2024-04-19T03:02:27.372 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.372 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.372 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:27.372 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.008942+0000", 2024-04-19T03:02:27.372 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4365000000000001e-05 2024-04-19T03:02:27.372 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.372 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.372 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:27.372 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.008949+0000", 2024-04-19T03:02:27.372 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.212e-06 2024-04-19T03:02:27.372 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.373 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.373 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:27.373 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.012683+0000", 2024-04-19T03:02:27.373 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.003733934 2024-04-19T03:02:27.373 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.373 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.373 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:27.373 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.012798+0000", 2024-04-19T03:02:27.373 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00011574999999999999 2024-04-19T03:02:27.373 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.373 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.373 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:27.374 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.012896+0000", 2024-04-19T03:02:27.374 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.7848000000000002e-05 2024-04-19T03:02:27.374 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.374 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.374 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:27.374 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016423+0000", 2024-04-19T03:02:27.374 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0035270789999999998 2024-04-19T03:02:27.374 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.374 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.374 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:27.375 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.065098+0000", 2024-04-19T03:02:27.375 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.048674651999999999 2024-04-19T03:02:27.375 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.375 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.375 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:27.375 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.065193+0000", 2024-04-19T03:02:27.375 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.5087999999999995e-05 2024-04-19T03:02:27.375 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.375 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.375 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:27.375 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.065264+0000", 2024-04-19T03:02:27.376 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0666000000000004e-05 2024-04-19T03:02:27.376 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:27.376 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:27.376 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:27.376 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.376 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.376 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:78998 5.7 5:ee23c1bc:::benchmark_data_smithi096_19531_object78997:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-19T03:02:27.376 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:18.013165+0000", 2024-04-19T03:02:27.376 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 9.3514415970000009, 2024-04-19T03:02:27.376 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.052410864000000001, 2024-04-19T03:02:27.376 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:27.376 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:27.377 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:27.377 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:27.377 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:27.377 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 78998 2024-04-19T03:02:27.377 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.377 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:27.377 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.377 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:27.377 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.013165+0000", 2024-04-19T03:02:27.377 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:27.377 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.378 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.378 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:27.378 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.013165+0000", 2024-04-19T03:02:27.378 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:27.378 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.378 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.378 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:27.378 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.013164+0000", 2024-04-19T03:02:27.378 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:27.378 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.378 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.379 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:27.379 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.013214+0000", 2024-04-19T03:02:27.379 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9636999999999999e-05 2024-04-19T03:02:27.379 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.379 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.379 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:27.379 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.013223+0000", 2024-04-19T03:02:27.379 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.3619999999999995e-06 2024-04-19T03:02:27.379 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.379 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.379 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:27.379 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.013229+0000", 2024-04-19T03:02:27.380 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6060000000000002e-06 2024-04-19T03:02:27.380 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.380 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.380 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:27.380 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.014882+0000", 2024-04-19T03:02:27.380 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001653257 2024-04-19T03:02:27.380 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.380 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.380 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:27.380 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.014958+0000", 2024-04-19T03:02:27.380 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6398999999999998e-05 2024-04-19T03:02:27.380 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.380 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.381 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:27.381 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.015036+0000", 2024-04-19T03:02:27.381 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8070000000000003e-05 2024-04-19T03:02:27.381 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.381 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.381 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:27.381 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018099+0000", 2024-04-19T03:02:27.381 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0030631149999999999 2024-04-19T03:02:27.381 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.381 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.381 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:27.381 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.065328+0000", 2024-04-19T03:02:27.382 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.047228349000000003 2024-04-19T03:02:27.382 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.382 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.382 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:27.382 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.065508+0000", 2024-04-19T03:02:27.382 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00018036899999999999 2024-04-19T03:02:27.382 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.382 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.382 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:27.382 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.065576+0000", 2024-04-19T03:02:27.382 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7785000000000002e-05 2024-04-19T03:02:27.383 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:27.383 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:27.383 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:27.383 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.383 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.383 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4755.0:78995 5.2 e40/39 5:42b55e12:::benchmark_data_smithi096_19531_object78994:head v 40'4934, mlcod=40'4932)", 2024-04-19T03:02:27.383 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:18.016247+0000", 2024-04-19T03:02:27.383 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 9.3483596349999996, 2024-04-19T03:02:27.383 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.056240406, 2024-04-19T03:02:27.383 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:27.383 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:27.383 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:27.384 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.384 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:27.384 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016247+0000", 2024-04-19T03:02:27.384 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:27.384 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.384 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.384 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:27.384 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016247+0000", 2024-04-19T03:02:27.384 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:27.384 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.384 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.385 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:27.385 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016246+0000", 2024-04-19T03:02:27.385 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:27.385 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.385 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.385 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:27.385 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016315+0000", 2024-04-19T03:02:27.385 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8979000000000005e-05 2024-04-19T03:02:27.385 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.385 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.386 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:27.386 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016333+0000", 2024-04-19T03:02:27.386 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7586999999999999e-05 2024-04-19T03:02:27.386 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.386 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.386 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:27.386 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016340+0000", 2024-04-19T03:02:27.386 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4080000000000001e-06 2024-04-19T03:02:27.386 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.386 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.387 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:27.387 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016384+0000", 2024-04-19T03:02:27.387 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3656999999999999e-05 2024-04-19T03:02:27.387 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.387 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.387 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:27.387 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016403+0000", 2024-04-19T03:02:27.387 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9089e-05 2024-04-19T03:02:27.387 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.387 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.388 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:27.388 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.072448+0000", 2024-04-19T03:02:27.388 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.056045084000000002 2024-04-19T03:02:27.388 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.388 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.388 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:27.388 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.072487+0000", 2024-04-19T03:02:27.388 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9362e-05 2024-04-19T03:02:27.388 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:27.388 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:27.388 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:27.389 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.389 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.389 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4755.0:78994 5.c e40/22 5:3c60d55d:::benchmark_data_smithi096_19531_object78993:head v 40'4989, mlcod=40'4987)", 2024-04-19T03:02:27.389 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:18.016392+0000", 2024-04-19T03:02:27.389 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 9.3482149939999992, 2024-04-19T03:02:27.389 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.052629620000000002, 2024-04-19T03:02:27.389 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:27.389 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:27.389 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:27.389 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.389 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:27.389 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016392+0000", 2024-04-19T03:02:27.390 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:27.390 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.390 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.390 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:27.390 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016392+0000", 2024-04-19T03:02:27.390 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:27.390 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.390 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.390 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:27.390 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016391+0000", 2024-04-19T03:02:27.390 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:27.390 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.391 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.391 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:27.391 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016471+0000", 2024-04-19T03:02:27.391 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9346999999999998e-05 2024-04-19T03:02:27.391 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.391 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.391 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:27.391 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016478+0000", 2024-04-19T03:02:27.391 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.593e-06 2024-04-19T03:02:27.391 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.391 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.392 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:27.392 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016495+0000", 2024-04-19T03:02:27.392 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6492999999999999e-05 2024-04-19T03:02:27.392 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.392 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.392 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:27.392 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016539+0000", 2024-04-19T03:02:27.392 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4715999999999997e-05 2024-04-19T03:02:27.392 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.392 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.392 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:27.392 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016551+0000", 2024-04-19T03:02:27.393 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2096000000000001e-05 2024-04-19T03:02:27.393 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.393 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.393 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:27.393 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.068985+0000", 2024-04-19T03:02:27.393 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.052433754999999999 2024-04-19T03:02:27.393 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.393 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.393 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:27.393 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.069021+0000", 2024-04-19T03:02:27.393 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6047000000000002e-05 2024-04-19T03:02:27.393 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:27.393 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:27.394 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:27.394 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.394 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.394 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4755.0:78996 5.1 e40/39 5:87f59708:::benchmark_data_smithi096_19531_object78995:head v 40'4940, mlcod=40'4938)", 2024-04-19T03:02:27.394 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:18.016581+0000", 2024-04-19T03:02:27.394 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 9.3480258290000009, 2024-04-19T03:02:27.394 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.052051785000000003, 2024-04-19T03:02:27.394 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:27.394 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:27.394 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:27.394 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.395 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:27.395 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016581+0000", 2024-04-19T03:02:27.395 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:27.395 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.395 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.395 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:27.395 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016581+0000", 2024-04-19T03:02:27.395 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:27.395 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.395 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.395 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:27.396 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016581+0000", 2024-04-19T03:02:27.396 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:27.396 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.396 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.396 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:27.396 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016610+0000", 2024-04-19T03:02:27.396 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9556999999999998e-05 2024-04-19T03:02:27.396 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.396 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.396 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:27.396 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016616+0000", 2024-04-19T03:02:27.396 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1090000000000003e-06 2024-04-19T03:02:27.396 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.397 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.397 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:27.397 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016621+0000", 2024-04-19T03:02:27.397 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.454e-06 2024-04-19T03:02:27.397 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.397 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.397 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:27.397 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016663+0000", 2024-04-19T03:02:27.397 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2582e-05 2024-04-19T03:02:27.397 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.398 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.398 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:27.398 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016681+0000", 2024-04-19T03:02:27.398 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7680999999999999e-05 2024-04-19T03:02:27.398 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.398 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.398 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:27.398 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.068486+0000", 2024-04-19T03:02:27.398 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.051804624000000001 2024-04-19T03:02:27.398 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.398 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.399 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:27.399 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.068633+0000", 2024-04-19T03:02:27.399 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00014709099999999999 2024-04-19T03:02:27.399 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:27.399 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:27.399 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:27.399 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.399 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.399 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4755.0:78999 5.3 e40/22 5:c9ec5f7f:::benchmark_data_smithi096_19531_object78998:head v 40'4893, mlcod=40'4889)", 2024-04-19T03:02:27.399 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:18.016633+0000", 2024-04-19T03:02:27.399 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 9.3479739740000003, 2024-04-19T03:02:27.399 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.051090469999999999, 2024-04-19T03:02:27.400 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:27.400 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:27.400 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:27.400 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.400 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:27.400 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016633+0000", 2024-04-19T03:02:27.400 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:27.400 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.400 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.400 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:27.400 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016633+0000", 2024-04-19T03:02:27.401 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:27.401 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.401 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.401 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:27.401 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016632+0000", 2024-04-19T03:02:27.401 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967296 2024-04-19T03:02:27.401 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.401 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.401 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:27.401 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016660+0000", 2024-04-19T03:02:27.401 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7869999999999999e-05 2024-04-19T03:02:27.402 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.402 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.402 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:27.402 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016667+0000", 2024-04-19T03:02:27.402 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0280000000000003e-06 2024-04-19T03:02:27.402 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.402 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.402 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:27.402 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016672+0000", 2024-04-19T03:02:27.402 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0069999999999997e-06 2024-04-19T03:02:27.402 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.403 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.403 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:27.403 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016725+0000", 2024-04-19T03:02:27.403 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2812000000000002e-05 2024-04-19T03:02:27.403 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.403 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.403 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:27.403 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016750+0000", 2024-04-19T03:02:27.403 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5038e-05 2024-04-19T03:02:27.403 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.404 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.404 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:27.404 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.067673+0000", 2024-04-19T03:02:27.404 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.050922350999999998 2024-04-19T03:02:27.404 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.404 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.404 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:27.404 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.067723+0000", 2024-04-19T03:02:27.404 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0586e-05 2024-04-19T03:02:27.404 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:27.404 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:27.405 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:27.405 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.405 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.405 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4755.0:79003 5.2 e40/39 5:4436e33f:::benchmark_data_smithi096_19531_object79002:head v 40'4935, mlcod=40'4932)", 2024-04-19T03:02:27.405 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:18.018102+0000", 2024-04-19T03:02:27.405 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 9.3465042470000004, 2024-04-19T03:02:27.405 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.060023990999999999, 2024-04-19T03:02:27.405 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:27.405 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:27.405 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:27.405 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.405 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:27.406 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018102+0000", 2024-04-19T03:02:27.406 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:27.406 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.406 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.406 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:27.406 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018102+0000", 2024-04-19T03:02:27.406 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:27.406 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.406 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.406 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:27.406 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018102+0000", 2024-04-19T03:02:27.406 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:27.407 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.407 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.407 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:27.407 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018134+0000", 2024-04-19T03:02:27.407 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2722000000000003e-05 2024-04-19T03:02:27.407 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.407 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.407 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:27.407 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018145+0000", 2024-04-19T03:02:27.407 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0395e-05 2024-04-19T03:02:27.407 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.407 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.408 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:27.408 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018151+0000", 2024-04-19T03:02:27.408 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5300000000000002e-06 2024-04-19T03:02:27.408 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.408 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.408 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:27.408 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018489+0000", 2024-04-19T03:02:27.408 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00033731499999999998 2024-04-19T03:02:27.408 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.408 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.408 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:27.408 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018508+0000", 2024-04-19T03:02:27.409 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9775e-05 2024-04-19T03:02:27.409 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.409 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.409 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:27.409 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.078059+0000", 2024-04-19T03:02:27.409 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.059550171999999998 2024-04-19T03:02:27.409 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.409 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.409 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:27.409 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.078126+0000", 2024-04-19T03:02:27.409 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7773000000000003e-05 2024-04-19T03:02:27.410 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:27.410 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:27.410 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:27.410 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.410 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.410 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4755.0:79005 5.1 e40/39 5:85b46038:::benchmark_data_smithi096_19531_object79004:head v 40'4941, mlcod=40'4938)", 2024-04-19T03:02:27.410 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:18.018167+0000", 2024-04-19T03:02:27.410 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 9.3464395279999994, 2024-04-19T03:02:27.410 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.052768941999999999, 2024-04-19T03:02:27.410 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:27.410 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:27.411 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:27.411 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.411 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:27.411 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018167+0000", 2024-04-19T03:02:27.411 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:27.411 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.411 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.411 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:27.411 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018167+0000", 2024-04-19T03:02:27.411 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:27.411 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.411 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.412 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:27.412 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018167+0000", 2024-04-19T03:02:27.412 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:27.412 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.412 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.412 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:27.412 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018196+0000", 2024-04-19T03:02:27.412 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9538000000000001e-05 2024-04-19T03:02:27.412 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.412 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.412 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:27.412 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018204+0000", 2024-04-19T03:02:27.413 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2599999999999999e-06 2024-04-19T03:02:27.413 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.413 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.413 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:27.413 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018208+0000", 2024-04-19T03:02:27.413 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8080000000000004e-06 2024-04-19T03:02:27.413 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.413 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.413 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:27.413 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.064933+0000", 2024-04-19T03:02:27.414 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.046725048999999998 2024-04-19T03:02:27.414 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.414 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.414 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:27.414 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.064964+0000", 2024-04-19T03:02:27.414 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0577000000000002e-05 2024-04-19T03:02:27.414 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.414 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.414 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:27.414 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.070815+0000", 2024-04-19T03:02:27.414 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0058510649999999999 2024-04-19T03:02:27.415 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.415 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.415 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:27.415 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.070936+0000", 2024-04-19T03:02:27.415 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00012095399999999999 2024-04-19T03:02:27.415 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:27.415 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:27.415 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:27.415 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.416 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.416 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:86612 5.7 5:e32e3c49:::benchmark_data_smithi096_19531_object86611:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:27.416 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:22.633560+0000", 2024-04-19T03:02:27.416 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4.7310465869999998, 2024-04-19T03:02:27.416 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.19135289, 2024-04-19T03:02:27.416 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:27.416 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:27.416 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:27.416 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:27.416 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:27.417 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 86612 2024-04-19T03:02:27.417 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.417 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:27.417 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.417 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:27.417 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633560+0000", 2024-04-19T03:02:27.417 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:27.417 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.417 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.417 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:27.418 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633560+0000", 2024-04-19T03:02:27.418 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:27.418 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.418 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.418 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:27.418 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633558+0000", 2024-04-19T03:02:27.418 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:27.418 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.418 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.418 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:27.418 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633609+0000", 2024-04-19T03:02:27.419 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0850999999999998e-05 2024-04-19T03:02:27.419 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.419 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.419 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:27.419 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633627+0000", 2024-04-19T03:02:27.419 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7951000000000001e-05 2024-04-19T03:02:27.419 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.419 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.419 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:27.420 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633635+0000", 2024-04-19T03:02:27.420 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2530000000000004e-06 2024-04-19T03:02:27.420 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.420 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.420 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:27.420 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633699+0000", 2024-04-19T03:02:27.420 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3901999999999999e-05 2024-04-19T03:02:27.420 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.420 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.420 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:27.421 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633992+0000", 2024-04-19T03:02:27.421 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00029283299999999999 2024-04-19T03:02:27.421 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.421 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.421 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:27.421 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.634223+0000", 2024-04-19T03:02:27.421 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00023084200000000001 2024-04-19T03:02:27.421 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.421 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.421 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:27.421 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.639085+0000", 2024-04-19T03:02:27.421 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0048624269999999999 2024-04-19T03:02:27.421 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.422 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.422 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:27.422 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.824635+0000", 2024-04-19T03:02:27.422 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.18554944700000001 2024-04-19T03:02:27.422 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.422 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.422 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:27.422 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.824793+0000", 2024-04-19T03:02:27.422 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000157959 2024-04-19T03:02:27.422 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.422 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.422 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:27.422 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.824913+0000", 2024-04-19T03:02:27.423 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000120093 2024-04-19T03:02:27.423 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:27.423 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:27.423 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:27.423 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.423 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.423 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:86625 5.7 5:e6d00488:::benchmark_data_smithi096_19531_object86624:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:27.423 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:22.643554+0000", 2024-04-19T03:02:27.423 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4.7210528209999998, 2024-04-19T03:02:27.423 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.18732841, 2024-04-19T03:02:27.423 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:27.423 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:27.423 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:27.423 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:27.424 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:27.424 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 86625 2024-04-19T03:02:27.424 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.424 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:27.424 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.424 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:27.424 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643554+0000", 2024-04-19T03:02:27.424 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:27.424 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.424 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.424 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:27.424 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643554+0000", 2024-04-19T03:02:27.424 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:27.424 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.424 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.425 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:27.425 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643552+0000", 2024-04-19T03:02:27.425 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:27.425 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.425 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.425 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:27.425 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643588+0000", 2024-04-19T03:02:27.425 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5855999999999997e-05 2024-04-19T03:02:27.425 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.425 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.425 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:27.425 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643606+0000", 2024-04-19T03:02:27.425 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8226000000000001e-05 2024-04-19T03:02:27.425 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.426 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.426 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:27.426 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643618+0000", 2024-04-19T03:02:27.426 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1868000000000001e-05 2024-04-19T03:02:27.426 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.426 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.426 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:27.426 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643676+0000", 2024-04-19T03:02:27.426 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8153999999999999e-05 2024-04-19T03:02:27.426 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.426 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.426 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:27.426 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643905+0000", 2024-04-19T03:02:27.427 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00022847500000000001 2024-04-19T03:02:27.427 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.427 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.427 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:27.427 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.644150+0000", 2024-04-19T03:02:27.427 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00024531800000000001 2024-04-19T03:02:27.427 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.427 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.427 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:27.427 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.647407+0000", 2024-04-19T03:02:27.427 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0032563190000000001 2024-04-19T03:02:27.427 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.427 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.427 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:27.427 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.830721+0000", 2024-04-19T03:02:27.428 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.18331468300000001 2024-04-19T03:02:27.428 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.428 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.428 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:27.428 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.830813+0000", 2024-04-19T03:02:27.428 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.2205000000000002e-05 2024-04-19T03:02:27.428 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.428 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.428 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:27.428 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.830882+0000", 2024-04-19T03:02:27.428 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8819999999999995e-05 2024-04-19T03:02:27.428 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:27.428 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:27.428 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:27.429 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.429 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.429 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87063 5.7 5:e502e824:::benchmark_data_smithi096_19531_object87062:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:27.429 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.136067+0000", 2024-04-19T03:02:27.429 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4.2285399520000002, 2024-04-19T03:02:27.429 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.065521159999999995, 2024-04-19T03:02:27.429 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:27.429 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:27.429 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:27.429 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:27.429 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:27.429 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87063 2024-04-19T03:02:27.429 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.429 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:27.429 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.430 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:27.430 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.136067+0000", 2024-04-19T03:02:27.430 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:27.430 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.430 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.430 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:27.430 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.136067+0000", 2024-04-19T03:02:27.430 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:27.430 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.430 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.430 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:27.430 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.136066+0000", 2024-04-19T03:02:27.430 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:27.430 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.431 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.431 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:27.431 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.136154+0000", 2024-04-19T03:02:27.431 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.8256000000000003e-05 2024-04-19T03:02:27.431 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.431 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.431 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:27.431 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.136162+0000", 2024-04-19T03:02:27.431 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.5099999999999998e-06 2024-04-19T03:02:27.431 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.431 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.431 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:27.431 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.136171+0000", 2024-04-19T03:02:27.431 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2830000000000001e-06 2024-04-19T03:02:27.431 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.431 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.432 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:27.432 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.138421+0000", 2024-04-19T03:02:27.432 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0022506620000000001 2024-04-19T03:02:27.432 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.432 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.432 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:27.432 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.138560+0000", 2024-04-19T03:02:27.432 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000138446 2024-04-19T03:02:27.432 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.432 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.432 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:27.432 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.138689+0000", 2024-04-19T03:02:27.432 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00012950700000000001 2024-04-19T03:02:27.432 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.433 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.433 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:27.433 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.141517+0000", 2024-04-19T03:02:27.433 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0028280860000000001 2024-04-19T03:02:27.433 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.433 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.433 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:27.433 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.201350+0000", 2024-04-19T03:02:27.433 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.059832418999999998 2024-04-19T03:02:27.433 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.433 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.433 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:27.433 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.201485+0000", 2024-04-19T03:02:27.433 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000135597 2024-04-19T03:02:27.434 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.434 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.434 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:27.434 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.201588+0000", 2024-04-19T03:02:27.434 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00010247900000000001 2024-04-19T03:02:27.434 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:27.434 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:27.434 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:27.434 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.434 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.434 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87072 5.7 5:e3c7809a:::benchmark_data_smithi096_19531_object87071:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:27.434 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.144224+0000", 2024-04-19T03:02:27.434 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4.2203829280000003, 2024-04-19T03:02:27.434 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.058179555000000001, 2024-04-19T03:02:27.435 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:27.435 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:27.435 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:27.435 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:27.435 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:27.435 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87072 2024-04-19T03:02:27.435 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.435 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:27.435 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.435 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:27.435 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144224+0000", 2024-04-19T03:02:27.435 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:27.435 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.436 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.436 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:27.436 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144224+0000", 2024-04-19T03:02:27.436 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:27.436 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.436 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.436 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:27.436 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144223+0000", 2024-04-19T03:02:27.436 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:27.436 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.436 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.436 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:27.436 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144320+0000", 2024-04-19T03:02:27.436 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.7075000000000001e-05 2024-04-19T03:02:27.437 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.437 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.437 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:27.437 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144331+0000", 2024-04-19T03:02:27.437 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1342000000000001e-05 2024-04-19T03:02:27.437 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.437 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.437 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:27.437 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144337+0000", 2024-04-19T03:02:27.437 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8390000000000003e-06 2024-04-19T03:02:27.437 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.437 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.437 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:27.438 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144369+0000", 2024-04-19T03:02:27.438 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2079000000000002e-05 2024-04-19T03:02:27.438 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.438 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.438 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:27.438 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144464+0000", 2024-04-19T03:02:27.438 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.4623000000000005e-05 2024-04-19T03:02:27.438 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.438 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.438 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:27.438 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144553+0000", 2024-04-19T03:02:27.438 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9171000000000004e-05 2024-04-19T03:02:27.438 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.439 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.439 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:27.439 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.147018+0000", 2024-04-19T03:02:27.439 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0024648370000000001 2024-04-19T03:02:27.439 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.439 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.439 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:27.439 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.202270+0000", 2024-04-19T03:02:27.439 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.055252018 2024-04-19T03:02:27.439 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.439 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.439 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:27.439 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.202356+0000", 2024-04-19T03:02:27.439 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6648000000000001e-05 2024-04-19T03:02:27.440 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.440 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.440 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:27.440 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.202403+0000", 2024-04-19T03:02:27.440 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6956999999999998e-05 2024-04-19T03:02:27.440 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:27.440 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:27.440 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:27.440 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.440 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.440 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87123 5.6 5:6d1bc3b9:::benchmark_data_smithi096_19531_object87122:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:02:27.440 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249233+0000", 2024-04-19T03:02:27.440 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4.1153738960000004, 2024-04-19T03:02:27.440 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0291700720000001, 2024-04-19T03:02:27.441 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:27.441 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-04-19T03:02:27.441 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:27.441 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:27.441 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:27.441 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87123 2024-04-19T03:02:27.441 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.441 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:27.441 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.441 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:27.441 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249233+0000", 2024-04-19T03:02:27.441 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:27.441 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.441 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.442 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:27.442 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249233+0000", 2024-04-19T03:02:27.442 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:27.442 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.442 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.442 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:27.442 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249231+0000", 2024-04-19T03:02:27.442 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:27.442 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.442 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.442 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:27.442 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249285+0000", 2024-04-19T03:02:27.442 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4005000000000002e-05 2024-04-19T03:02:27.442 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.443 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.443 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:27.443 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249300+0000", 2024-04-19T03:02:27.443 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4715999999999999e-05 2024-04-19T03:02:27.443 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.443 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.443 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:27.443 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249307+0000", 2024-04-19T03:02:27.443 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8399999999999997e-06 2024-04-19T03:02:27.443 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.443 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.443 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:27.443 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249366+0000", 2024-04-19T03:02:27.443 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9435999999999998e-05 2024-04-19T03:02:27.443 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.444 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.444 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op must wait for map", 2024-04-19T03:02:27.444 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249376+0000", 2024-04-19T03:02:27.444 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.4919999999999999e-06 2024-04-19T03:02:27.444 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.444 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.444 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:27.444 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263757+0000", 2024-04-19T03:02:27.444 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.014381461999999999 2024-04-19T03:02:27.444 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.444 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.444 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:02:27.444 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263875+0000", 2024-04-19T03:02:27.444 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000117166 2024-04-19T03:02:27.444 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.445 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.445 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:27.445 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.277136+0000", 2024-04-19T03:02:27.445 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.013261207 2024-04-19T03:02:27.445 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.445 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.445 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:27.445 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.278403+0000", 2024-04-19T03:02:27.445 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001267106 2024-04-19T03:02:27.445 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:27.445 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:27.445 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:27.445 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.446 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.446 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87128 5.6 5:6905c420:::benchmark_data_smithi096_19531_object87127:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:02:27.446 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249323+0000", 2024-04-19T03:02:27.446 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4.1152831489999997, 2024-04-19T03:02:27.446 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0292813249999999, 2024-04-19T03:02:27.446 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:27.446 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-04-19T03:02:27.446 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:27.446 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:27.446 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:27.446 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87128 2024-04-19T03:02:27.446 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.446 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:27.447 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.447 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:27.447 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249323+0000", 2024-04-19T03:02:27.447 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:27.447 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.447 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.447 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:27.447 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249323+0000", 2024-04-19T03:02:27.447 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:27.447 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.447 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.447 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:27.447 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249323+0000", 2024-04-19T03:02:27.447 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:27.447 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.448 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.448 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:27.448 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249385+0000", 2024-04-19T03:02:27.448 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1711999999999995e-05 2024-04-19T03:02:27.448 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.448 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.448 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:27.448 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249398+0000", 2024-04-19T03:02:27.448 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3022e-05 2024-04-19T03:02:27.448 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.448 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.448 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:27.448 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249402+0000", 2024-04-19T03:02:27.448 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4819999999999996e-06 2024-04-19T03:02:27.449 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.449 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.449 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:27.449 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249437+0000", 2024-04-19T03:02:27.449 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4702000000000001e-05 2024-04-19T03:02:27.449 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.449 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.449 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:02:27.449 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249442+0000", 2024-04-19T03:02:27.449 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8019999999999999e-06 2024-04-19T03:02:27.449 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.449 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.449 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:27.449 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263896+0000", 2024-04-19T03:02:27.450 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.014454679999999999 2024-04-19T03:02:27.450 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.450 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.450 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:02:27.450 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263900+0000", 2024-04-19T03:02:27.450 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9700000000000001e-06 2024-04-19T03:02:27.450 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.450 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.450 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:27.450 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.278557+0000", 2024-04-19T03:02:27.450 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0146566480000001 2024-04-19T03:02:27.450 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.450 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.451 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:27.451 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.278605+0000", 2024-04-19T03:02:27.451 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7735999999999998e-05 2024-04-19T03:02:27.451 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:27.451 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:27.451 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:27.451 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.451 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.451 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87130 5.3 5:c8c2d67b:::benchmark_data_smithi096_19531_object87129:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:02:27.451 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249418+0000", 2024-04-19T03:02:27.451 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4.1151884379999997, 2024-04-19T03:02:27.451 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.025414182, 2024-04-19T03:02:27.451 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:27.451 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-04-19T03:02:27.452 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:27.452 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:27.452 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:27.452 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87130 2024-04-19T03:02:27.452 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.452 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:27.452 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.452 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:27.452 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249418+0000", 2024-04-19T03:02:27.452 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:27.452 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.452 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.452 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:27.452 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249418+0000", 2024-04-19T03:02:27.453 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:27.453 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.453 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.453 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:27.453 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249409+0000", 2024-04-19T03:02:27.453 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999905 2024-04-19T03:02:27.453 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.453 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.453 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:27.453 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249464+0000", 2024-04-19T03:02:27.453 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5381999999999999e-05 2024-04-19T03:02:27.453 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.453 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.453 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:27.453 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249471+0000", 2024-04-19T03:02:27.454 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2609999999999996e-06 2024-04-19T03:02:27.454 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.454 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.454 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:27.454 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249475+0000", 2024-04-19T03:02:27.454 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2839999999999998e-06 2024-04-19T03:02:27.454 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.454 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.454 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:27.454 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249535+0000", 2024-04-19T03:02:27.454 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0545999999999999e-05 2024-04-19T03:02:27.454 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.454 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.454 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op must wait for map", 2024-04-19T03:02:27.455 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249540+0000", 2024-04-19T03:02:27.455 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2859999999999999e-06 2024-04-19T03:02:27.455 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.455 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.455 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:27.455 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263450+0000", 2024-04-19T03:02:27.455 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.013909585 2024-04-19T03:02:27.455 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.455 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.455 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:02:27.455 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263458+0000", 2024-04-19T03:02:27.455 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8089999999999993e-06 2024-04-19T03:02:27.455 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.455 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.456 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:27.456 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.273193+0000", 2024-04-19T03:02:27.456 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0097351379999999 2024-04-19T03:02:27.456 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.456 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.456 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:27.456 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.274832+0000", 2024-04-19T03:02:27.456 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0016394789999999999 2024-04-19T03:02:27.456 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:27.456 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:27.456 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:27.456 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.456 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.456 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87131 5.1 5:83756d55:::benchmark_data_smithi096_19531_object87130:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:02:27.457 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249491+0000", 2024-04-19T03:02:27.457 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4.115115791, 2024-04-19T03:02:27.457 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0191489520000001, 2024-04-19T03:02:27.457 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:27.457 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-04-19T03:02:27.457 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:27.457 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:27.457 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:27.457 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87131 2024-04-19T03:02:27.457 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.457 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:27.457 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.457 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:27.457 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249491+0000", 2024-04-19T03:02:27.458 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:27.458 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.458 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.458 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:27.458 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249491+0000", 2024-04-19T03:02:27.458 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:27.458 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.458 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.458 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:27.458 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249491+0000", 2024-04-19T03:02:27.458 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:27.458 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.459 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.459 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:27.459 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249530+0000", 2024-04-19T03:02:27.459 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9589000000000003e-05 2024-04-19T03:02:27.459 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.459 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.459 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:27.459 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249544+0000", 2024-04-19T03:02:27.459 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4158000000000001e-05 2024-04-19T03:02:27.459 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.459 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.459 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:27.459 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249549+0000", 2024-04-19T03:02:27.459 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6809999999999997e-06 2024-04-19T03:02:27.460 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.460 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.460 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:27.460 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249592+0000", 2024-04-19T03:02:27.460 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3285999999999999e-05 2024-04-19T03:02:27.460 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.460 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.460 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op must wait for map", 2024-04-19T03:02:27.460 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249598+0000", 2024-04-19T03:02:27.460 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8329999999999999e-06 2024-04-19T03:02:27.460 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.460 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.460 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:27.460 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263331+0000", 2024-04-19T03:02:27.461 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.013733093 2024-04-19T03:02:27.461 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.461 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.461 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:02:27.461 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263343+0000", 2024-04-19T03:02:27.461 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.189e-05 2024-04-19T03:02:27.461 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.461 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.461 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:27.461 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.268541+0000", 2024-04-19T03:02:27.461 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0051983440000001 2024-04-19T03:02:27.461 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.461 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.462 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:27.462 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.268640+0000", 2024-04-19T03:02:27.462 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.8387999999999994e-05 2024-04-19T03:02:27.462 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:27.462 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:27.462 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:27.462 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.462 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.462 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87132 5.c 5:3e18b732:::benchmark_data_smithi096_19531_object87131:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:02:27.462 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249558+0000", 2024-04-19T03:02:27.462 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4.1150488899999997, 2024-04-19T03:02:27.462 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0241198380000001, 2024-04-19T03:02:27.462 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:27.462 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-04-19T03:02:27.463 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:27.463 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:27.463 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:27.463 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87132 2024-04-19T03:02:27.463 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.463 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:27.463 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.463 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:27.463 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249558+0000", 2024-04-19T03:02:27.463 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:27.463 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.463 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.463 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:27.463 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249558+0000", 2024-04-19T03:02:27.464 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:27.464 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.464 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.464 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:27.464 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249557+0000", 2024-04-19T03:02:27.464 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:27.464 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.464 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.464 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:27.464 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249625+0000", 2024-04-19T03:02:27.464 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7200999999999996e-05 2024-04-19T03:02:27.464 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.464 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.465 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:27.465 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249646+0000", 2024-04-19T03:02:27.465 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1053e-05 2024-04-19T03:02:27.465 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.465 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.465 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:27.465 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249650+0000", 2024-04-19T03:02:27.465 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2719999999999999e-06 2024-04-19T03:02:27.465 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.465 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.465 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:27.465 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249686+0000", 2024-04-19T03:02:27.465 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6430000000000002e-05 2024-04-19T03:02:27.465 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.466 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.466 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op must wait for map", 2024-04-19T03:02:27.466 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249690+0000", 2024-04-19T03:02:27.466 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.765e-06 2024-04-19T03:02:27.466 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.466 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.466 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:27.466 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261157+0000", 2024-04-19T03:02:27.466 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011467247999999999 2024-04-19T03:02:27.466 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.466 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.466 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:02:27.466 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261170+0000", 2024-04-19T03:02:27.466 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2833000000000001e-05 2024-04-19T03:02:27.467 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.467 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.467 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:27.467 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.272119+0000", 2024-04-19T03:02:27.467 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.010949313 2024-04-19T03:02:27.467 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.467 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.467 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:27.467 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.273678+0000", 2024-04-19T03:02:27.467 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0015581550000000001 2024-04-19T03:02:27.467 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:27.467 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:27.467 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:27.467 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.468 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.468 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87133 5.c 5:3f772a62:::benchmark_data_smithi096_19531_object87132:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:02:27.468 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249657+0000", 2024-04-19T03:02:27.468 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4.1149495109999998, 2024-04-19T03:02:27.468 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0242819409999999, 2024-04-19T03:02:27.468 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:27.468 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-04-19T03:02:27.468 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:27.468 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:27.468 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:27.468 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87133 2024-04-19T03:02:27.468 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.468 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:27.468 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.468 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:27.469 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249657+0000", 2024-04-19T03:02:27.469 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:27.469 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.469 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.469 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:27.469 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249657+0000", 2024-04-19T03:02:27.469 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:27.469 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.469 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.469 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:27.469 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249657+0000", 2024-04-19T03:02:27.469 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:27.469 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.470 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.470 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:27.470 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249690+0000", 2024-04-19T03:02:27.470 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3343000000000002e-05 2024-04-19T03:02:27.470 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.470 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.470 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:27.470 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249695+0000", 2024-04-19T03:02:27.470 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8600000000000001e-06 2024-04-19T03:02:27.470 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.470 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.470 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:27.470 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249698+0000", 2024-04-19T03:02:27.471 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.1700000000000001e-06 2024-04-19T03:02:27.471 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.471 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.471 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:27.471 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249741+0000", 2024-04-19T03:02:27.471 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2849999999999998e-05 2024-04-19T03:02:27.471 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.471 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.471 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:02:27.471 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249746+0000", 2024-04-19T03:02:27.471 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1019999999999996e-06 2024-04-19T03:02:27.471 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.471 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.471 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:27.472 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261209+0000", 2024-04-19T03:02:27.472 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011462447000000001 2024-04-19T03:02:27.472 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.472 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.472 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:02:27.472 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261216+0000", 2024-04-19T03:02:27.472 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8520000000000004e-06 2024-04-19T03:02:27.472 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.472 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.472 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:27.472 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.273872+0000", 2024-04-19T03:02:27.472 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0126558000000001 2024-04-19T03:02:27.472 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.472 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.472 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:27.473 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.273939+0000", 2024-04-19T03:02:27.473 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6822000000000005e-05 2024-04-19T03:02:27.473 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:27.473 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:27.473 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:27.473 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.473 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.473 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87134 5.5 5:a56c478f:::benchmark_data_smithi096_19531_object87133:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:02:27.473 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249708+0000", 2024-04-19T03:02:27.473 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4.1148985869999999, 2024-04-19T03:02:27.473 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0214677299999999, 2024-04-19T03:02:27.473 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:27.473 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-04-19T03:02:27.473 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:27.474 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:27.474 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:27.474 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87134 2024-04-19T03:02:27.474 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.474 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:27.474 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.474 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:27.474 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249708+0000", 2024-04-19T03:02:27.474 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:27.474 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.474 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.474 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:27.475 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249708+0000", 2024-04-19T03:02:27.475 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:27.475 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.475 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.475 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:27.475 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249706+0000", 2024-04-19T03:02:27.475 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999976 2024-04-19T03:02:27.475 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.475 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.475 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:27.475 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249740+0000", 2024-04-19T03:02:27.475 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4458000000000001e-05 2024-04-19T03:02:27.475 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.475 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.476 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:27.476 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249745+0000", 2024-04-19T03:02:27.476 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5020000000000003e-06 2024-04-19T03:02:27.476 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.476 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.476 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:27.476 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249748+0000", 2024-04-19T03:02:27.476 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2499999999999998e-06 2024-04-19T03:02:27.476 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.476 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.476 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:27.476 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249778+0000", 2024-04-19T03:02:27.476 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.006e-05 2024-04-19T03:02:27.476 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.477 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.477 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op must wait for map", 2024-04-19T03:02:27.477 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249782+0000", 2024-04-19T03:02:27.477 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2910000000000001e-06 2024-04-19T03:02:27.477 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.477 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.477 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:27.477 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261666+0000", 2024-04-19T03:02:27.477 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011883471 2024-04-19T03:02:27.477 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.477 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.477 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:02:27.477 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261674+0000", 2024-04-19T03:02:27.478 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6479999999999992e-06 2024-04-19T03:02:27.478 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.478 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.478 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:27.478 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.269323+0000", 2024-04-19T03:02:27.478 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.00764867 2024-04-19T03:02:27.478 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.478 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.478 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:27.478 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.271176+0000", 2024-04-19T03:02:27.478 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001852844 2024-04-19T03:02:27.478 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:27.478 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:27.479 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:27.479 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.479 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.479 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87137 5.c 5:30708c68:::benchmark_data_smithi096_19531_object87136:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:02:27.479 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249756+0000", 2024-04-19T03:02:27.479 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4.1148508809999997, 2024-04-19T03:02:27.479 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.033331752, 2024-04-19T03:02:27.479 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:27.479 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:27.479 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:27.479 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:27.479 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:27.479 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87137 2024-04-19T03:02:27.479 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.479 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:27.480 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.480 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:27.480 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249756+0000", 2024-04-19T03:02:27.480 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:27.480 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.480 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.480 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:27.480 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249756+0000", 2024-04-19T03:02:27.480 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:27.480 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.480 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.480 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:27.480 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249755+0000", 2024-04-19T03:02:27.480 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:27.481 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.481 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.481 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:27.481 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249777+0000", 2024-04-19T03:02:27.481 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1420000000000002e-05 2024-04-19T03:02:27.481 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.481 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.481 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:27.481 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249781+0000", 2024-04-19T03:02:27.481 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0609999999999997e-06 2024-04-19T03:02:27.481 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.481 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.481 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:27.481 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249787+0000", 2024-04-19T03:02:27.481 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.02e-06 2024-04-19T03:02:27.482 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.482 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.482 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:27.482 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249818+0000", 2024-04-19T03:02:27.482 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0947e-05 2024-04-19T03:02:27.482 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.482 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.482 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:02:27.482 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249821+0000", 2024-04-19T03:02:27.482 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.117e-06 2024-04-19T03:02:27.482 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.482 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.482 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:27.483 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261243+0000", 2024-04-19T03:02:27.483 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011421875999999999 2024-04-19T03:02:27.483 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.483 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.483 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:02:27.483 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261251+0000", 2024-04-19T03:02:27.483 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6120000000000001e-06 2024-04-19T03:02:27.483 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.483 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.483 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:27.483 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.274050+0000", 2024-04-19T03:02:27.483 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.012799405 2024-04-19T03:02:27.483 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.483 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.484 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:27.484 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.274529+0000", 2024-04-19T03:02:27.484 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00047867100000000001 2024-04-19T03:02:27.484 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.484 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.484 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:27.484 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.282972+0000", 2024-04-19T03:02:27.484 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0084436900000000002 2024-04-19T03:02:27.484 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.484 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.484 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:27.484 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.283022+0000", 2024-04-19T03:02:27.484 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9339000000000003e-05 2024-04-19T03:02:27.484 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:27.485 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:27.485 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:27.485 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.283088+0000", 2024-04-19T03:02:27.485 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5877999999999995e-05 2024-04-19T03:02:27.485 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:27.485 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:27.485 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:27.485 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:27.485 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:27.485 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-04-19T03:02:27.487 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:27.483+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:27.488 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T03:02:27.488 DEBUG:teuthology.orchestra.console.smithi097:check power output: Chassis Power is off 2024-04-19T03:02:27.588 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:27.585+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:27.589 INFO:teuthology.orchestra.console.smithi097:Power off completed 2024-04-19T03:02:27.618 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-19T03:02:27.619 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-04-19T03:02:27.619 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.619 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:93552 5.8 5:1f14738d:::benchmark_data_smithi096_19531_object93551:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-19T03:02:27.619 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:27.615022+0000", 2024-04-19T03:02:27.619 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0037078089999999998, 2024-04-19T03:02:27.619 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0037271779999999998, 2024-04-19T03:02:27.619 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:27.619 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:27.619 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:27.619 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:27.619 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:27.619 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 93552 2024-04-19T03:02:27.619 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.620 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:27.620 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.620 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:27.620 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:27.615022+0000", 2024-04-19T03:02:27.620 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:27.620 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.620 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.620 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:27.621 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:27.615022+0000", 2024-04-19T03:02:27.621 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:27.621 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.621 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.621 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:27.621 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:27.615021+0000", 2024-04-19T03:02:27.621 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:27.621 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.621 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.621 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:27.621 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:27.615094+0000", 2024-04-19T03:02:27.621 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3078999999999996e-05 2024-04-19T03:02:27.621 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.622 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.622 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:27.622 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:27.615101+0000", 2024-04-19T03:02:27.622 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.8569999999999997e-06 2024-04-19T03:02:27.622 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.622 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.622 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:27.622 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:27.615105+0000", 2024-04-19T03:02:27.622 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7670000000000001e-06 2024-04-19T03:02:27.622 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.622 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.622 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:27.623 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:27.615137+0000", 2024-04-19T03:02:27.623 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2502000000000002e-05 2024-04-19T03:02:27.623 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.623 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.623 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:27.623 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:27.615222+0000", 2024-04-19T03:02:27.623 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.4785999999999998e-05 2024-04-19T03:02:27.623 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.623 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.623 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:27.623 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:27.618690+0000", 2024-04-19T03:02:27.623 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0034676149999999998 2024-04-19T03:02:27.623 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.623 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.624 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:27.624 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:27.618744+0000", 2024-04-19T03:02:27.624 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4055000000000003e-05 2024-04-19T03:02:27.624 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:27.624 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:27.624 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:27.624 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.624 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.624 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:93554 5.e 5:7dff8143:::benchmark_data_smithi096_19531_object93553:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-19T03:02:27.624 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:27.615249+0000", 2024-04-19T03:02:27.624 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0034808700000000001, 2024-04-19T03:02:27.624 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.003593031, 2024-04-19T03:02:27.624 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:27.624 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-19T03:02:27.624 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:27.625 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:27.625 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:27.625 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 93554 2024-04-19T03:02:27.625 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.625 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:27.625 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.625 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:27.625 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:27.615249+0000", 2024-04-19T03:02:27.625 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:27.625 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.625 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.625 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:27.625 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:27.615249+0000", 2024-04-19T03:02:27.626 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:27.626 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.626 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.626 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:27.626 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:27.615248+0000", 2024-04-19T03:02:27.626 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:27.626 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.626 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.626 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:27.626 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:27.615307+0000", 2024-04-19T03:02:27.626 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9367999999999998e-05 2024-04-19T03:02:27.626 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.627 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.627 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:27.627 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:27.615316+0000", 2024-04-19T03:02:27.627 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.4630000000000001e-06 2024-04-19T03:02:27.627 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.627 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.627 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:27.627 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:27.615322+0000", 2024-04-19T03:02:27.627 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3350000000000003e-06 2024-04-19T03:02:27.627 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.627 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.627 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:27.627 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:27.615409+0000", 2024-04-19T03:02:27.627 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.7085999999999999e-05 2024-04-19T03:02:27.627 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.628 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.628 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:27.628 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:27.615499+0000", 2024-04-19T03:02:27.628 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9568999999999996e-05 2024-04-19T03:02:27.628 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:27.628 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:27.628 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:27.628 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.628 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.628 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:93555 5.0 5:0de3d757:::benchmark_data_smithi096_19531_object93554:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-19T03:02:27.628 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:27.616073+0000", 2024-04-19T03:02:27.628 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0026569530000000001, 2024-04-19T03:02:27.628 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0028089429999999999, 2024-04-19T03:02:27.628 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:27.628 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-19T03:02:27.629 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:27.629 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:27.629 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:27.629 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 93555 2024-04-19T03:02:27.629 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.629 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:27.629 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.629 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:27.629 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:27.616073+0000", 2024-04-19T03:02:27.629 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:27.629 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.629 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.629 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:27.629 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:27.616073+0000", 2024-04-19T03:02:27.630 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:27.630 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.630 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.630 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:27.630 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:27.616072+0000", 2024-04-19T03:02:27.630 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:27.630 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.630 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.630 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:27.630 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:27.616137+0000", 2024-04-19T03:02:27.630 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5664e-05 2024-04-19T03:02:27.630 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.630 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.631 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:27.631 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:27.616149+0000", 2024-04-19T03:02:27.631 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.201e-05 2024-04-19T03:02:27.631 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.631 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.631 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:27.631 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:27.616157+0000", 2024-04-19T03:02:27.631 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.1280000000000002e-06 2024-04-19T03:02:27.631 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.631 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.631 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:27.631 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:27.617498+0000", 2024-04-19T03:02:27.631 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0013412459999999999 2024-04-19T03:02:27.631 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.632 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.632 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:27.632 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:27.617623+0000", 2024-04-19T03:02:27.632 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012546899999999999 2024-04-19T03:02:27.632 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:27.632 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:27.632 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:27.632 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.632 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.632 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:93560 5.a 5:5ab92bdf:::benchmark_data_smithi096_19531_object93559:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-19T03:02:27.632 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:27.618107+0000", 2024-04-19T03:02:27.632 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.00062224899999999996, 2024-04-19T03:02:27.632 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00080873999999999996, 2024-04-19T03:02:27.632 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:27.633 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-19T03:02:27.633 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:27.633 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:27.633 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:27.633 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 93560 2024-04-19T03:02:27.633 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.633 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:27.633 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.633 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:27.633 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:27.618107+0000", 2024-04-19T03:02:27.633 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:27.633 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.633 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.634 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:27.634 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:27.618107+0000", 2024-04-19T03:02:27.634 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:27.634 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.634 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.634 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:27.634 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:27.618106+0000", 2024-04-19T03:02:27.634 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:27.634 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.634 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.634 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:27.634 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:27.618191+0000", 2024-04-19T03:02:27.634 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.4313000000000004e-05 2024-04-19T03:02:27.635 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.635 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.635 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:27.635 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:27.618201+0000", 2024-04-19T03:02:27.635 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0158e-05 2024-04-19T03:02:27.635 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.635 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.635 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:27.635 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:27.618206+0000", 2024-04-19T03:02:27.635 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9799999999999998e-06 2024-04-19T03:02:27.635 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.635 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.635 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:27.635 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:27.618242+0000", 2024-04-19T03:02:27.636 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6179e-05 2024-04-19T03:02:27.636 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.636 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.636 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:27.636 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:27.618337+0000", 2024-04-19T03:02:27.636 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.5282e-05 2024-04-19T03:02:27.636 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:27.636 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:27.636 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:27.636 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.636 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.636 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4755.0:93559 5.f e45/22 5:f344a6ae:::benchmark_data_smithi096_19531_object93558:head v 45'5842, mlcod=45'5840)", 2024-04-19T03:02:27.636 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:27.618602+0000", 2024-04-19T03:02:27.637 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.000127355, 2024-04-19T03:02:27.637 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00034748100000000002, 2024-04-19T03:02:27.637 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:27.637 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-19T03:02:27.637 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:27.637 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.637 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:27.637 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:27.618602+0000", 2024-04-19T03:02:27.637 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:27.637 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.637 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.637 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:27.637 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:27.618602+0000", 2024-04-19T03:02:27.637 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:27.638 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.638 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.638 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:27.638 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:27.618602+0000", 2024-04-19T03:02:27.638 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:27.638 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.638 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.638 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:27.638 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:27.618658+0000", 2024-04-19T03:02:27.638 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5924999999999997e-05 2024-04-19T03:02:27.638 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.638 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.638 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:27.639 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:27.618669+0000", 2024-04-19T03:02:27.639 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1083e-05 2024-04-19T03:02:27.639 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.639 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.639 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:27.639 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:27.618676+0000", 2024-04-19T03:02:27.639 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2570000000000001e-06 2024-04-19T03:02:27.639 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.639 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.639 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:27.639 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:27.618722+0000", 2024-04-19T03:02:27.639 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6217000000000002e-05 2024-04-19T03:02:27.639 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.639 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.640 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:27.640 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:27.618747+0000", 2024-04-19T03:02:27.640 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5182999999999999e-05 2024-04-19T03:02:27.640 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:27.640 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:27.640 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:27.640 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:27.640 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-04-19T03:02:27.640 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 5 2024-04-19T03:02:27.640 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-19T03:02:27.641 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T03:02:27.688 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:27.685+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:27.768 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-19T03:02:27.768 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-04-19T03:02:27.768 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-04-19T03:02:27.768 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-04-19T03:02:27.768 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-19T03:02:27.781 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T03:02:27.789 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:27.787+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:27.825 INFO:tasks.radosbench.radosbench.0.smithi096.stdout: 50 16 93950 93934 117.404 117.75 0.00629816 0.00851156 2024-04-19T03:02:27.890 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:27.887+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:27.902 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-19T03:02:27.902 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-04-19T03:02:27.902 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-04-19T03:02:27.902 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-04-19T03:02:27.902 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.902 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:79014 5.d 5:b5eee02c:::benchmark_data_smithi096_19531_object79013:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-19T03:02:27.902 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:18.032471+0000", 2024-04-19T03:02:27.902 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 9.8669542680000006, 2024-04-19T03:02:27.903 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.041427629000000001, 2024-04-19T03:02:27.903 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:27.903 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:27.903 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:27.903 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:27.903 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:27.903 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 79014 2024-04-19T03:02:27.903 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.903 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:27.903 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.903 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:27.903 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:18.032471+0000", 2024-04-19T03:02:27.903 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:27.904 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.904 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.904 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:27.904 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:18.032471+0000", 2024-04-19T03:02:27.904 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:27.904 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.904 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.904 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:27.904 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:18.032470+0000", 2024-04-19T03:02:27.904 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:27.904 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.904 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.904 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:27.905 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:18.032525+0000", 2024-04-19T03:02:27.905 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5535999999999998e-05 2024-04-19T03:02:27.905 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.905 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.905 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:27.905 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:18.032537+0000", 2024-04-19T03:02:27.905 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1987999999999999e-05 2024-04-19T03:02:27.905 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.905 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.905 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:27.905 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:18.032546+0000", 2024-04-19T03:02:27.905 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9670000000000007e-06 2024-04-19T03:02:27.905 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.905 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.906 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:27.906 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:18.032613+0000", 2024-04-19T03:02:27.906 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6508999999999996e-05 2024-04-19T03:02:27.906 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.906 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.906 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:27.906 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:18.032738+0000", 2024-04-19T03:02:27.906 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000124912 2024-04-19T03:02:27.906 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.906 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.906 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-04-19T03:02:27.906 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:18.032867+0000", 2024-04-19T03:02:27.906 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012959399999999999 2024-04-19T03:02:27.907 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.907 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.907 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:27.907 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:18.035867+0000", 2024-04-19T03:02:27.907 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.002999378 2024-04-19T03:02:27.907 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.907 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.907 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:27.907 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:18.073705+0000", 2024-04-19T03:02:27.907 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.037838042000000002 2024-04-19T03:02:27.907 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.907 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.907 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:27.907 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:18.073813+0000", 2024-04-19T03:02:27.908 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010806099999999999 2024-04-19T03:02:27.908 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.908 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.908 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:27.908 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:18.073899+0000", 2024-04-19T03:02:27.908 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.5971999999999996e-05 2024-04-19T03:02:27.908 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:27.908 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:27.908 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:27.908 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.908 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.908 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:86615 5.e 5:7fef7288:::benchmark_data_smithi096_19531_object86614:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:27.908 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:22.634544+0000", 2024-04-19T03:02:27.909 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 5.2648812889999999, 2024-04-19T03:02:27.909 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.192475071, 2024-04-19T03:02:27.909 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:27.909 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:27.909 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:27.909 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:27.909 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:27.909 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 86615 2024-04-19T03:02:27.909 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.909 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:27.909 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.909 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:27.909 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634544+0000", 2024-04-19T03:02:27.909 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:27.910 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.910 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.910 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:27.910 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634544+0000", 2024-04-19T03:02:27.910 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:27.910 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.910 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.910 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:27.910 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634542+0000", 2024-04-19T03:02:27.910 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999981 2024-04-19T03:02:27.910 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.910 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.910 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:27.911 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634585+0000", 2024-04-19T03:02:27.911 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2299000000000003e-05 2024-04-19T03:02:27.911 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.911 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.911 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:27.911 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634592+0000", 2024-04-19T03:02:27.911 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2350000000000002e-06 2024-04-19T03:02:27.911 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.911 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.911 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:27.911 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634596+0000", 2024-04-19T03:02:27.911 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5390000000000001e-06 2024-04-19T03:02:27.911 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.911 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.911 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:27.912 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634639+0000", 2024-04-19T03:02:27.912 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2444999999999998e-05 2024-04-19T03:02:27.912 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.912 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.912 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:27.912 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634808+0000", 2024-04-19T03:02:27.912 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000169152 2024-04-19T03:02:27.912 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.912 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.912 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:27.912 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634999+0000", 2024-04-19T03:02:27.912 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00019098300000000001 2024-04-19T03:02:27.912 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.912 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.913 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:27.913 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.640458+0000", 2024-04-19T03:02:27.913 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0054586870000000003 2024-04-19T03:02:27.913 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.913 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.913 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:27.913 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.826949+0000", 2024-04-19T03:02:27.913 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.18649178299999999 2024-04-19T03:02:27.913 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.913 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.913 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:27.913 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.826982+0000", 2024-04-19T03:02:27.914 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2477000000000001e-05 2024-04-19T03:02:27.914 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.914 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.914 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:27.914 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.827019+0000", 2024-04-19T03:02:27.914 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7355999999999999e-05 2024-04-19T03:02:27.914 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:27.914 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:27.914 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:27.914 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.914 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.914 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:86616 5.e 5:72278f47:::benchmark_data_smithi096_19531_object86615:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:27.915 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:22.634609+0000", 2024-04-19T03:02:27.915 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 5.2648161399999998, 2024-04-19T03:02:27.915 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.19472088900000001, 2024-04-19T03:02:27.915 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:27.915 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:27.915 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:27.915 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:27.915 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:27.915 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 86616 2024-04-19T03:02:27.915 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.915 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:27.915 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.915 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:27.915 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634609+0000", 2024-04-19T03:02:27.916 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:27.916 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.916 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.916 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:27.916 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634609+0000", 2024-04-19T03:02:27.916 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:27.916 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.916 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.916 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:27.916 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634609+0000", 2024-04-19T03:02:27.916 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:27.916 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.916 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.916 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:27.917 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634651+0000", 2024-04-19T03:02:27.917 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2589000000000002e-05 2024-04-19T03:02:27.917 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.917 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.917 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:27.917 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634659+0000", 2024-04-19T03:02:27.917 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5850000000000002e-06 2024-04-19T03:02:27.917 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.917 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.917 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:27.917 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634662+0000", 2024-04-19T03:02:27.917 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3620000000000002e-06 2024-04-19T03:02:27.917 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.917 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.918 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:27.918 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.637880+0000", 2024-04-19T03:02:27.918 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.003218149 2024-04-19T03:02:27.918 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.918 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.918 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:27.918 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.637999+0000", 2024-04-19T03:02:27.918 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000118643 2024-04-19T03:02:27.918 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.918 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.918 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:27.918 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.638102+0000", 2024-04-19T03:02:27.919 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010331 2024-04-19T03:02:27.919 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.919 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.919 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:27.919 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.640851+0000", 2024-04-19T03:02:27.919 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0027483310000000001 2024-04-19T03:02:27.919 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.919 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.919 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:27.919 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.829269+0000", 2024-04-19T03:02:27.919 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.188418319 2024-04-19T03:02:27.919 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.919 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.919 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:27.920 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.829299+0000", 2024-04-19T03:02:27.920 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0227e-05 2024-04-19T03:02:27.920 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.920 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.920 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:27.920 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.829330+0000", 2024-04-19T03:02:27.920 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0969000000000001e-05 2024-04-19T03:02:27.920 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:27.920 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:27.920 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:27.920 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.920 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.920 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:86618 5.0 5:09014b90:::benchmark_data_smithi096_19531_object86617:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:27.920 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:22.634894+0000", 2024-04-19T03:02:27.921 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 5.2645316519999996, 2024-04-19T03:02:27.921 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.19413419800000001, 2024-04-19T03:02:27.921 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:27.921 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:27.921 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:27.921 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:27.921 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:27.921 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 86618 2024-04-19T03:02:27.921 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.921 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:27.921 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.921 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:27.921 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634894+0000", 2024-04-19T03:02:27.921 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:27.921 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.922 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.922 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:27.922 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634894+0000", 2024-04-19T03:02:27.922 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:27.922 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.922 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.922 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:27.922 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634893+0000", 2024-04-19T03:02:27.922 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:27.922 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.922 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.922 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:27.922 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634976+0000", 2024-04-19T03:02:27.922 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3231000000000003e-05 2024-04-19T03:02:27.923 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.923 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.923 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:27.923 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634983+0000", 2024-04-19T03:02:27.923 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5169999999999996e-06 2024-04-19T03:02:27.923 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.923 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.923 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:27.923 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634987+0000", 2024-04-19T03:02:27.923 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.425e-06 2024-04-19T03:02:27.923 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.923 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.923 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:27.923 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635030+0000", 2024-04-19T03:02:27.923 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.32e-05 2024-04-19T03:02:27.924 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.924 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.924 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:27.924 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635185+0000", 2024-04-19T03:02:27.924 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015471899999999999 2024-04-19T03:02:27.924 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.924 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.924 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:27.924 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635415+0000", 2024-04-19T03:02:27.924 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00023026500000000001 2024-04-19T03:02:27.924 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.924 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.924 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:27.924 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.640127+0000", 2024-04-19T03:02:27.925 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0047118890000000004 2024-04-19T03:02:27.925 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.925 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.925 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:27.925 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.828895+0000", 2024-04-19T03:02:27.925 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.18876802600000001 2024-04-19T03:02:27.925 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.925 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.925 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:27.925 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.828972+0000", 2024-04-19T03:02:27.925 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.6345000000000002e-05 2024-04-19T03:02:27.925 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.925 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.926 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:27.926 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.829028+0000", 2024-04-19T03:02:27.926 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6342999999999999e-05 2024-04-19T03:02:27.926 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:27.926 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:27.926 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:27.926 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.926 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.926 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:86620 5.b 5:d80faa68:::benchmark_data_smithi096_19531_object86619:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:27.926 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:22.635110+0000", 2024-04-19T03:02:27.926 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 5.2643150920000004, 2024-04-19T03:02:27.927 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.193447275, 2024-04-19T03:02:27.927 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:27.927 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:27.927 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:27.927 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:27.927 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:27.927 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 86620 2024-04-19T03:02:27.927 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.927 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:27.927 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.927 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:27.927 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635110+0000", 2024-04-19T03:02:27.927 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:27.927 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.928 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.928 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:27.928 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635110+0000", 2024-04-19T03:02:27.928 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:27.928 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.928 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.928 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:27.928 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635110+0000", 2024-04-19T03:02:27.928 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:27.928 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.928 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.928 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:27.928 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635154+0000", 2024-04-19T03:02:27.929 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4681000000000001e-05 2024-04-19T03:02:27.929 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.929 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.929 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:27.929 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635166+0000", 2024-04-19T03:02:27.929 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1505000000000001e-05 2024-04-19T03:02:27.929 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.929 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.929 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:27.929 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635171+0000", 2024-04-19T03:02:27.929 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6040000000000003e-06 2024-04-19T03:02:27.929 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.929 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.929 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:27.930 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635221+0000", 2024-04-19T03:02:27.930 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9947000000000001e-05 2024-04-19T03:02:27.930 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.930 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.930 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:27.930 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635356+0000", 2024-04-19T03:02:27.930 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013576199999999999 2024-04-19T03:02:27.930 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.930 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.930 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:27.930 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635507+0000", 2024-04-19T03:02:27.931 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015072999999999999 2024-04-19T03:02:27.931 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.931 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.931 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:27.931 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.638488+0000", 2024-04-19T03:02:27.931 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0029813159999999999 2024-04-19T03:02:27.931 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.931 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.931 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:27.931 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.828341+0000", 2024-04-19T03:02:27.931 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.189852254 2024-04-19T03:02:27.931 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.931 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.931 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:27.932 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.828416+0000", 2024-04-19T03:02:27.932 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5344000000000002e-05 2024-04-19T03:02:27.932 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.932 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.932 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:27.932 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.828558+0000", 2024-04-19T03:02:27.932 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000141695 2024-04-19T03:02:27.932 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:27.932 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:27.932 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:27.932 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.932 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.932 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:86621 5.8 5:1597a420:::benchmark_data_smithi096_19531_object86620:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:27.932 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:22.635187+0000", 2024-04-19T03:02:27.933 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 5.2642382320000003, 2024-04-19T03:02:27.933 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.194204878, 2024-04-19T03:02:27.933 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:27.933 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:27.933 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:27.933 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:27.933 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:27.933 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 86621 2024-04-19T03:02:27.933 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.933 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:27.933 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.933 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:27.933 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635187+0000", 2024-04-19T03:02:27.934 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:27.934 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.934 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.934 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:27.934 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635187+0000", 2024-04-19T03:02:27.934 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:27.934 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.934 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.934 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:27.934 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635187+0000", 2024-04-19T03:02:27.934 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:27.934 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.934 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.935 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:27.935 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635242+0000", 2024-04-19T03:02:27.935 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5158000000000003e-05 2024-04-19T03:02:27.935 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.935 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.935 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:27.935 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635249+0000", 2024-04-19T03:02:27.935 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.7000000000000008e-06 2024-04-19T03:02:27.935 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.935 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.935 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:27.935 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635256+0000", 2024-04-19T03:02:27.935 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2060000000000004e-06 2024-04-19T03:02:27.935 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.936 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.936 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:27.936 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635302+0000", 2024-04-19T03:02:27.936 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5954000000000001e-05 2024-04-19T03:02:27.936 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.936 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.936 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:27.936 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635427+0000", 2024-04-19T03:02:27.936 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012559299999999999 2024-04-19T03:02:27.936 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.936 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.936 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:27.936 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635596+0000", 2024-04-19T03:02:27.936 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000168615 2024-04-19T03:02:27.936 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.937 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.937 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:27.937 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.639320+0000", 2024-04-19T03:02:27.937 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0037244610000000001 2024-04-19T03:02:27.937 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.937 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.937 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:27.937 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.829277+0000", 2024-04-19T03:02:27.937 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.18995651099999999 2024-04-19T03:02:27.937 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.937 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.937 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:27.937 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.829341+0000", 2024-04-19T03:02:27.938 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3756000000000004e-05 2024-04-19T03:02:27.938 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.938 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.938 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:27.938 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.829392+0000", 2024-04-19T03:02:27.938 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1555999999999999e-05 2024-04-19T03:02:27.938 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:27.938 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:27.938 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:27.938 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.938 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.938 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87062 5.4 5:2d3b5d9a:::benchmark_data_smithi096_19531_object87061:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:27.938 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.136820+0000", 2024-04-19T03:02:27.939 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 4.7626050790000001, 2024-04-19T03:02:27.939 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.066483741999999998, 2024-04-19T03:02:27.939 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:27.939 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:27.939 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:27.939 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:27.939 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:27.939 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87062 2024-04-19T03:02:27.939 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.939 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:27.939 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.939 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:27.939 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.136820+0000", 2024-04-19T03:02:27.940 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:27.940 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.940 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.940 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:27.940 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.136820+0000", 2024-04-19T03:02:27.940 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:27.940 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.940 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.940 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:27.940 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.136819+0000", 2024-04-19T03:02:27.940 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:27.940 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.940 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.940 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:27.941 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.136864+0000", 2024-04-19T03:02:27.941 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4855000000000003e-05 2024-04-19T03:02:27.941 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.941 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.941 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:27.941 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.136881+0000", 2024-04-19T03:02:27.941 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7521999999999999e-05 2024-04-19T03:02:27.941 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.941 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.941 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:27.942 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.136890+0000", 2024-04-19T03:02:27.942 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1039999999999996e-06 2024-04-19T03:02:27.942 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.942 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.942 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:27.942 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.136974+0000", 2024-04-19T03:02:27.942 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3735999999999999e-05 2024-04-19T03:02:27.942 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.942 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.942 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:27.942 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.137308+0000", 2024-04-19T03:02:27.942 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00033376100000000002 2024-04-19T03:02:27.942 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.942 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.943 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:27.943 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.137559+0000", 2024-04-19T03:02:27.943 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000250599 2024-04-19T03:02:27.943 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.943 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.943 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:27.943 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.145423+0000", 2024-04-19T03:02:27.943 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0078649589999999995 2024-04-19T03:02:27.943 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.943 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.943 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:27.943 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.203175+0000", 2024-04-19T03:02:27.943 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057751255000000001 2024-04-19T03:02:27.944 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.944 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.944 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:27.944 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.203250+0000", 2024-04-19T03:02:27.944 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5378999999999998e-05 2024-04-19T03:02:27.944 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.944 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.944 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:27.944 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.203304+0000", 2024-04-19T03:02:27.944 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4015999999999999e-05 2024-04-19T03:02:27.944 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:27.944 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:27.945 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:27.945 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.945 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.945 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87065 5.4 5:21d20a47:::benchmark_data_smithi096_19531_object87064:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:27.945 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.137482+0000", 2024-04-19T03:02:27.945 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 4.7619433449999997, 2024-04-19T03:02:27.945 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.065988749999999999, 2024-04-19T03:02:27.945 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:27.945 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:27.945 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:27.945 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:27.945 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:27.945 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87065 2024-04-19T03:02:27.946 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.946 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:27.946 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.946 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:27.946 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.137482+0000", 2024-04-19T03:02:27.946 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:27.946 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.946 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.946 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:27.946 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.137482+0000", 2024-04-19T03:02:27.946 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:27.946 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.946 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.947 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:27.947 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.137481+0000", 2024-04-19T03:02:27.947 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:27.947 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.947 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.947 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:27.947 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.137530+0000", 2024-04-19T03:02:27.947 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9302000000000003e-05 2024-04-19T03:02:27.947 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.947 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.947 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:27.947 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.137540+0000", 2024-04-19T03:02:27.948 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.2010000000000005e-06 2024-04-19T03:02:27.948 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.948 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.948 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:27.948 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.137545+0000", 2024-04-19T03:02:27.948 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5910000000000003e-06 2024-04-19T03:02:27.948 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.948 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.948 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:27.948 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.140666+0000", 2024-04-19T03:02:27.948 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0031212710000000001 2024-04-19T03:02:27.948 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.949 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.949 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:27.949 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.140847+0000", 2024-04-19T03:02:27.949 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00018065600000000001 2024-04-19T03:02:27.949 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.949 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.949 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:27.949 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.140991+0000", 2024-04-19T03:02:27.949 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014433100000000001 2024-04-19T03:02:27.950 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.950 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.950 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:27.950 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.148053+0000", 2024-04-19T03:02:27.950 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.007061945 2024-04-19T03:02:27.950 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.950 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.950 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:27.950 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.203367+0000", 2024-04-19T03:02:27.950 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.055313703999999998 2024-04-19T03:02:27.950 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.951 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.951 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:27.951 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.203426+0000", 2024-04-19T03:02:27.951 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9024000000000003e-05 2024-04-19T03:02:27.951 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.951 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.951 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:27.951 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.203471+0000", 2024-04-19T03:02:27.951 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4818999999999999e-05 2024-04-19T03:02:27.951 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:27.951 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:27.951 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:27.952 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.952 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.952 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87067 5.b 5:d57af71a:::benchmark_data_smithi096_19531_object87066:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:27.952 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.142233+0000", 2024-04-19T03:02:27.952 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 4.7571923690000002, 2024-04-19T03:02:27.952 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.071692405000000001, 2024-04-19T03:02:27.952 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:27.952 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:27.952 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:27.952 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:27.952 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:27.952 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87067 2024-04-19T03:02:27.952 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.952 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:27.953 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.953 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:27.953 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142233+0000", 2024-04-19T03:02:27.953 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:27.953 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.953 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.953 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:27.953 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142233+0000", 2024-04-19T03:02:27.953 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:27.953 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.953 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.953 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:27.953 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142232+0000", 2024-04-19T03:02:27.953 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:27.954 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.954 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.954 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:27.954 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142277+0000", 2024-04-19T03:02:27.954 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5837000000000002e-05 2024-04-19T03:02:27.954 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.954 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.954 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:27.954 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142297+0000", 2024-04-19T03:02:27.954 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9561000000000001e-05 2024-04-19T03:02:27.954 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.954 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.954 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:27.955 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142311+0000", 2024-04-19T03:02:27.955 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3654e-05 2024-04-19T03:02:27.955 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.955 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.955 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:27.955 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142391+0000", 2024-04-19T03:02:27.955 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0123999999999994e-05 2024-04-19T03:02:27.955 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.955 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.955 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:27.955 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142669+0000", 2024-04-19T03:02:27.955 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00027829800000000001 2024-04-19T03:02:27.955 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.955 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.955 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:27.956 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142859+0000", 2024-04-19T03:02:27.956 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000190051 2024-04-19T03:02:27.956 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.956 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.956 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:27.956 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.150597+0000", 2024-04-19T03:02:27.956 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0077380299999999999 2024-04-19T03:02:27.956 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.956 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.956 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:27.956 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.213855+0000", 2024-04-19T03:02:27.956 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.063257987000000002 2024-04-19T03:02:27.956 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.957 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.957 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:27.957 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.213898+0000", 2024-04-19T03:02:27.957 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2916e-05 2024-04-19T03:02:27.957 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.957 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.957 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:27.957 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.213925+0000", 2024-04-19T03:02:27.957 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7503000000000001e-05 2024-04-19T03:02:27.957 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:27.957 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:27.957 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:27.957 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.957 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.958 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87069 5.b 5:da0c93b5:::benchmark_data_smithi096_19531_object87068:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:27.958 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.143402+0000", 2024-04-19T03:02:27.958 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 4.7560234069999998, 2024-04-19T03:02:27.958 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.070678598999999995, 2024-04-19T03:02:27.958 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:27.958 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:27.958 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:27.958 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:27.958 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:27.958 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87069 2024-04-19T03:02:27.958 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.958 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:27.959 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.959 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:27.959 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.143402+0000", 2024-04-19T03:02:27.959 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:27.959 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.959 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.959 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:27.959 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.143402+0000", 2024-04-19T03:02:27.959 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:27.959 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.959 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.959 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:27.959 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.143401+0000", 2024-04-19T03:02:27.960 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:27.960 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.960 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.960 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:27.960 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.143501+0000", 2024-04-19T03:02:27.960 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000100387 2024-04-19T03:02:27.960 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.960 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.960 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:27.960 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.143516+0000", 2024-04-19T03:02:27.960 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5369000000000001e-05 2024-04-19T03:02:27.960 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.960 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.961 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:27.961 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.143524+0000", 2024-04-19T03:02:27.961 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.7079999999999997e-06 2024-04-19T03:02:27.961 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.961 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.961 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:27.961 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.145550+0000", 2024-04-19T03:02:27.961 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0020259290000000001 2024-04-19T03:02:27.961 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.961 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.961 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:27.961 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.145676+0000", 2024-04-19T03:02:27.961 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000126406 2024-04-19T03:02:27.962 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.962 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.962 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:27.962 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.145802+0000", 2024-04-19T03:02:27.962 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000125974 2024-04-19T03:02:27.962 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.962 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.962 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:27.962 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.151030+0000", 2024-04-19T03:02:27.962 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0052276079999999999 2024-04-19T03:02:27.962 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.963 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.963 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:27.963 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.213998+0000", 2024-04-19T03:02:27.963 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.06296786 2024-04-19T03:02:27.963 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.963 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.963 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:27.963 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.214031+0000", 2024-04-19T03:02:27.963 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3387999999999999e-05 2024-04-19T03:02:27.963 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.964 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.964 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:27.964 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.214081+0000", 2024-04-19T03:02:27.964 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9316e-05 2024-04-19T03:02:27.964 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:27.964 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:27.964 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:27.964 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.964 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.964 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87073 5.0 5:0ca21233:::benchmark_data_smithi096_19531_object87072:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:27.964 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.145929+0000", 2024-04-19T03:02:27.964 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 4.7534961469999999, 2024-04-19T03:02:27.964 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.062283234999999999, 2024-04-19T03:02:27.965 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:27.965 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:27.965 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:27.965 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:27.965 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:27.965 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87073 2024-04-19T03:02:27.965 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.965 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:27.965 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.965 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:27.965 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.145929+0000", 2024-04-19T03:02:27.965 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:27.966 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.966 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.966 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:27.966 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.145929+0000", 2024-04-19T03:02:27.966 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:27.966 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.966 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.966 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:27.966 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.145928+0000", 2024-04-19T03:02:27.966 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:27.966 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.966 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.967 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:27.967 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.146063+0000", 2024-04-19T03:02:27.967 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013541099999999999 2024-04-19T03:02:27.967 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.967 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.967 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:27.967 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.146079+0000", 2024-04-19T03:02:27.967 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5902000000000001e-05 2024-04-19T03:02:27.967 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.967 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.967 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:27.968 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.146100+0000", 2024-04-19T03:02:27.968 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0380000000000001e-05 2024-04-19T03:02:27.968 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.968 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.968 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:27.968 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.146193+0000", 2024-04-19T03:02:27.968 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.3669000000000001e-05 2024-04-19T03:02:27.968 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.968 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.968 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:27.968 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.146388+0000", 2024-04-19T03:02:27.968 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00019457799999999999 2024-04-19T03:02:27.968 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.968 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.969 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:27.969 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.146625+0000", 2024-04-19T03:02:27.969 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00023751999999999999 2024-04-19T03:02:27.969 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.969 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.969 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:27.969 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.151051+0000", 2024-04-19T03:02:27.969 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0044260039999999999 2024-04-19T03:02:27.969 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.969 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.969 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:27.969 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.207872+0000", 2024-04-19T03:02:27.969 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.056821114999999998 2024-04-19T03:02:27.969 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.970 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.970 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:27.970 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.208085+0000", 2024-04-19T03:02:27.970 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000212893 2024-04-19T03:02:27.970 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.970 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.970 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:27.970 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.208213+0000", 2024-04-19T03:02:27.970 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012714700000000001 2024-04-19T03:02:27.970 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:27.970 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:27.970 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:27.970 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.971 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.971 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87074 5.0 5:035614ac:::benchmark_data_smithi096_19531_object87073:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:27.971 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.151387+0000", 2024-04-19T03:02:27.971 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 4.7480382160000003, 2024-04-19T03:02:27.971 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.063461771, 2024-04-19T03:02:27.971 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:27.971 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:27.971 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:27.971 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:27.971 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:27.971 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87074 2024-04-19T03:02:27.971 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.971 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:27.971 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.972 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:27.972 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.151387+0000", 2024-04-19T03:02:27.972 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:27.972 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.972 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.972 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:27.972 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.151387+0000", 2024-04-19T03:02:27.972 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:27.972 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.972 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.972 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:27.972 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.151386+0000", 2024-04-19T03:02:27.972 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:27.972 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.973 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.973 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:27.973 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.151428+0000", 2024-04-19T03:02:27.973 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.172e-05 2024-04-19T03:02:27.973 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.973 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.973 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:27.973 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.151442+0000", 2024-04-19T03:02:27.973 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4328000000000001e-05 2024-04-19T03:02:27.973 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.973 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.973 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:27.973 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.151451+0000", 2024-04-19T03:02:27.973 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.8400000000000001e-06 2024-04-19T03:02:27.974 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.974 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.974 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:27.974 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.151521+0000", 2024-04-19T03:02:27.974 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.9606999999999999e-05 2024-04-19T03:02:27.974 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.974 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.974 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:27.974 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.151749+0000", 2024-04-19T03:02:27.974 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00022818799999999999 2024-04-19T03:02:27.974 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.974 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.974 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:27.974 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.152006+0000", 2024-04-19T03:02:27.975 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00025687300000000002 2024-04-19T03:02:27.975 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.975 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.975 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:27.975 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.154887+0000", 2024-04-19T03:02:27.975 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0028812989999999999 2024-04-19T03:02:27.975 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.975 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.975 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:27.975 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.214733+0000", 2024-04-19T03:02:27.975 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.059846159000000003 2024-04-19T03:02:27.975 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.975 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.975 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:27.976 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.214788+0000", 2024-04-19T03:02:27.976 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4524000000000002e-05 2024-04-19T03:02:27.976 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.976 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.976 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:27.976 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.214849+0000", 2024-04-19T03:02:27.976 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1362e-05 2024-04-19T03:02:27.976 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:27.976 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:27.976 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:27.976 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.976 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.976 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87108 5.e 5:7e197adc:::benchmark_data_smithi096_19531_object87107:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:27.976 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.223103+0000", 2024-04-19T03:02:27.977 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 4.6763220700000003, 2024-04-19T03:02:27.977 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.044946887, 2024-04-19T03:02:27.977 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:27.977 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-19T03:02:27.977 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:27.977 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:27.977 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:27.977 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87108 2024-04-19T03:02:27.977 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.977 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:27.977 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.977 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:27.977 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.223103+0000", 2024-04-19T03:02:27.977 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:27.977 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.978 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.978 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:27.978 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.223103+0000", 2024-04-19T03:02:27.978 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:27.978 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.978 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.978 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:27.978 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.223102+0000", 2024-04-19T03:02:27.978 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:27.978 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.978 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.978 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:27.978 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.223156+0000", 2024-04-19T03:02:27.979 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3958000000000001e-05 2024-04-19T03:02:27.979 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.979 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.979 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:27.979 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.223166+0000", 2024-04-19T03:02:27.979 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.4809999999999995e-06 2024-04-19T03:02:27.979 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.979 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.979 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:27.979 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.223172+0000", 2024-04-19T03:02:27.979 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0140000000000004e-06 2024-04-19T03:02:27.979 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.979 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.979 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:27.980 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.227295+0000", 2024-04-19T03:02:27.980 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0041233420000000003 2024-04-19T03:02:27.980 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.980 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.980 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:27.980 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.227495+0000", 2024-04-19T03:02:27.980 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00019955299999999999 2024-04-19T03:02:27.980 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.980 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.980 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:27.980 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.227717+0000", 2024-04-19T03:02:27.980 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000221902 2024-04-19T03:02:27.980 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.980 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.981 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:27.981 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233189+0000", 2024-04-19T03:02:27.981 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0054718889999999997 2024-04-19T03:02:27.981 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.981 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.981 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:27.981 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.250529+0000", 2024-04-19T03:02:27.981 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.017340298000000001 2024-04-19T03:02:27.981 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.981 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.981 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:02:27.981 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.250539+0000", 2024-04-19T03:02:27.981 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0501e-05 2024-04-19T03:02:27.982 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.982 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.982 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:27.982 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.268003+0000", 2024-04-19T03:02:27.982 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.017463429 2024-04-19T03:02:27.982 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.982 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.982 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:27.982 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.268050+0000", 2024-04-19T03:02:27.982 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7466000000000003e-05 2024-04-19T03:02:27.982 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:27.982 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:27.982 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:27.983 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.983 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.983 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87118 5.b 5:d1bb4f3c:::benchmark_data_smithi096_19531_object87117:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:27.983 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.231082+0000", 2024-04-19T03:02:27.983 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 4.6683432360000001, 2024-04-19T03:02:27.983 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.035789004, 2024-04-19T03:02:27.983 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:27.983 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-19T03:02:27.983 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:27.983 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:27.983 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:27.983 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87118 2024-04-19T03:02:27.983 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.983 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:27.984 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.984 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:27.984 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231082+0000", 2024-04-19T03:02:27.984 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:27.984 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.984 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.984 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:27.984 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231082+0000", 2024-04-19T03:02:27.984 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:27.984 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.984 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.984 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:27.984 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231081+0000", 2024-04-19T03:02:27.984 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:27.985 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.985 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.985 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:27.985 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231159+0000", 2024-04-19T03:02:27.985 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.7819999999999997e-05 2024-04-19T03:02:27.985 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.985 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.985 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:27.985 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231186+0000", 2024-04-19T03:02:27.985 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7126000000000001e-05 2024-04-19T03:02:27.985 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.985 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.985 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:27.985 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231193+0000", 2024-04-19T03:02:27.985 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7259999999999996e-06 2024-04-19T03:02:27.986 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.986 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.986 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:27.986 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231241+0000", 2024-04-19T03:02:27.986 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8123e-05 2024-04-19T03:02:27.986 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.986 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.986 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:27.986 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231354+0000", 2024-04-19T03:02:27.986 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0001133 2024-04-19T03:02:27.986 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.986 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.987 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:27.987 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231443+0000", 2024-04-19T03:02:27.987 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9167999999999997e-05 2024-04-19T03:02:27.987 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.987 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.987 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:27.987 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236498+0000", 2024-04-19T03:02:27.987 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0050545160000000002 2024-04-19T03:02:27.987 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.987 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.987 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:27.987 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.249681+0000", 2024-04-19T03:02:27.987 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013183321 2024-04-19T03:02:27.988 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.988 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.988 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:02:27.988 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.249693+0000", 2024-04-19T03:02:27.988 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1834999999999999e-05 2024-04-19T03:02:27.988 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.988 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.988 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:27.988 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266733+0000", 2024-04-19T03:02:27.988 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.017040408 2024-04-19T03:02:27.988 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.988 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.988 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:27.989 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266871+0000", 2024-04-19T03:02:27.989 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000137849 2024-04-19T03:02:27.989 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:27.989 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:27.989 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:27.989 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.989 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.989 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87121 5.b 5:d01822b8:::benchmark_data_smithi096_19531_object87120:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:27.989 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.233319+0000", 2024-04-19T03:02:27.989 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 4.6661063719999998, 2024-04-19T03:02:27.989 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.033624198, 2024-04-19T03:02:27.989 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:27.989 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-19T03:02:27.990 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:27.990 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:27.990 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:27.990 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87121 2024-04-19T03:02:27.990 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.990 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:27.990 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.990 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:27.990 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233319+0000", 2024-04-19T03:02:27.990 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:27.990 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.990 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.990 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:27.991 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233319+0000", 2024-04-19T03:02:27.991 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:27.991 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.991 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.991 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:27.991 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233319+0000", 2024-04-19T03:02:27.991 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:27.991 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.991 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.991 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:27.991 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233364+0000", 2024-04-19T03:02:27.991 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5460999999999997e-05 2024-04-19T03:02:27.992 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.992 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.992 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:27.992 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233382+0000", 2024-04-19T03:02:27.992 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8148e-05 2024-04-19T03:02:27.992 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.992 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.992 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:27.992 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233390+0000", 2024-04-19T03:02:27.992 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5340000000000002e-06 2024-04-19T03:02:27.992 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.992 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.992 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:27.992 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233712+0000", 2024-04-19T03:02:27.993 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00032260500000000001 2024-04-19T03:02:27.993 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.993 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.993 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:27.993 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233829+0000", 2024-04-19T03:02:27.993 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011638599999999999 2024-04-19T03:02:27.993 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.993 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.993 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:27.993 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233959+0000", 2024-04-19T03:02:27.993 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013013900000000001 2024-04-19T03:02:27.993 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.993 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.993 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:27.994 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236515+0000", 2024-04-19T03:02:27.994 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0025562750000000002 2024-04-19T03:02:27.994 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.994 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.994 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:27.994 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.249723+0000", 2024-04-19T03:02:27.994 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013208176 2024-04-19T03:02:27.994 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.994 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.994 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:02:27.994 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.249728+0000", 2024-04-19T03:02:27.994 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6519999999999997e-06 2024-04-19T03:02:27.994 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.995 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.995 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:27.995 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266837+0000", 2024-04-19T03:02:27.995 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0171087059999999 2024-04-19T03:02:27.995 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.995 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.995 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:27.995 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266943+0000", 2024-04-19T03:02:27.995 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000106604 2024-04-19T03:02:27.995 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:27.995 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:27.995 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:27.995 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.995 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.996 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87124 5.8 5:14819ad7:::benchmark_data_smithi096_19531_object87123:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:27.996 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.235886+0000", 2024-04-19T03:02:27.996 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 4.6635389480000002, 2024-04-19T03:02:27.996 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0315451179999999, 2024-04-19T03:02:27.996 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:27.996 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-19T03:02:27.996 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:27.996 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:27.996 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:27.996 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87124 2024-04-19T03:02:27.996 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.996 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:27.996 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.996 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:27.997 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.235886+0000", 2024-04-19T03:02:27.997 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:27.997 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.997 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.997 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:27.997 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.235886+0000", 2024-04-19T03:02:27.997 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:27.997 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.997 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.997 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:27.997 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.235886+0000", 2024-04-19T03:02:27.997 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:27.997 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.997 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.998 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:27.998 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.235934+0000", 2024-04-19T03:02:27.998 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8384000000000003e-05 2024-04-19T03:02:27.998 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.998 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.998 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:27.998 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.235945+0000", 2024-04-19T03:02:27.998 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0671e-05 2024-04-19T03:02:27.998 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.998 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.998 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:27.999 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.235952+0000", 2024-04-19T03:02:27.999 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3089999999999998e-06 2024-04-19T03:02:27.999 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.999 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.999 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:27.999 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.237067+0000", 2024-04-19T03:02:27.999 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001115263 2024-04-19T03:02:27.999 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:27.999 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:27.999 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:27.999 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.237188+0000", 2024-04-19T03:02:27.999 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000121258 2024-04-19T03:02:27.999 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:28.000 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:28.000 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:28.000 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.237316+0000", 2024-04-19T03:02:28.000 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000128071 2024-04-19T03:02:28.000 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:28.000 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:28.000 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:28.000 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240744+0000", 2024-04-19T03:02:28.000 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0034275629999999998 2024-04-19T03:02:28.000 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:28.000 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:28.000 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:28.000 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.252517+0000", 2024-04-19T03:02:28.001 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011772991999999999 2024-04-19T03:02:28.001 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:28.001 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:28.001 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:02:28.001 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.252523+0000", 2024-04-19T03:02:28.001 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3640000000000004e-06 2024-04-19T03:02:28.001 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:28.001 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:28.001 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:28.001 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.267290+0000", 2024-04-19T03:02:28.001 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0147665690000001 2024-04-19T03:02:28.001 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:28.001 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:28.002 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:28.002 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.267432+0000", 2024-04-19T03:02:28.002 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014165299999999999 2024-04-19T03:02:28.002 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:28.002 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:28.002 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:28.002 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:28.002 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:28.002 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87129 5.0 5:02667e01:::benchmark_data_smithi096_19531_object87128:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:28.002 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.236466+0000", 2024-04-19T03:02:28.002 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 4.6629589520000003, 2024-04-19T03:02:28.002 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0301534510000001, 2024-04-19T03:02:28.003 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:28.003 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-19T03:02:28.003 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:28.003 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:28.003 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:28.003 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87129 2024-04-19T03:02:28.003 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:28.003 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:28.003 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:28.003 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:28.003 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236466+0000", 2024-04-19T03:02:28.003 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:28.003 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:28.003 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:28.003 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:28.004 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236466+0000", 2024-04-19T03:02:28.004 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:28.004 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:28.004 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:28.004 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:28.004 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236465+0000", 2024-04-19T03:02:28.004 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:28.004 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:28.004 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:28.004 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:28.004 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236566+0000", 2024-04-19T03:02:28.004 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010047000000000001 2024-04-19T03:02:28.004 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:28.004 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:28.005 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:28.005 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236577+0000", 2024-04-19T03:02:28.005 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1772e-05 2024-04-19T03:02:28.005 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:28.005 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:28.005 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:28.005 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236584+0000", 2024-04-19T03:02:28.005 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0530000000000003e-06 2024-04-19T03:02:28.005 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:28.005 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:28.005 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:28.005 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.237023+0000", 2024-04-19T03:02:28.005 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000439703 2024-04-19T03:02:28.006 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:28.006 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:28.006 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:28.006 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.237207+0000", 2024-04-19T03:02:28.006 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000183692 2024-04-19T03:02:28.006 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:28.006 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:28.006 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:28.006 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.237373+0000", 2024-04-19T03:02:28.006 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016623500000000001 2024-04-19T03:02:28.006 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:28.006 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:28.007 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:28.007 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.241461+0000", 2024-04-19T03:02:28.007 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0040883050000000004 2024-04-19T03:02:28.007 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:28.007 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:28.007 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:28.007 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.252500+0000", 2024-04-19T03:02:28.007 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011038450999999999 2024-04-19T03:02:28.008 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:28.008 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:28.008 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:02:28.008 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.252507+0000", 2024-04-19T03:02:28.008 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2439999999999996e-06 2024-04-19T03:02:28.008 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:28.008 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:28.008 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:28.008 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266538+0000", 2024-04-19T03:02:28.008 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.014031184 2024-04-19T03:02:28.008 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:28.008 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:28.008 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:28.009 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266620+0000", 2024-04-19T03:02:28.009 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1600000000000005e-05 2024-04-19T03:02:28.009 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:28.009 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:28.009 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:28.009 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:28.009 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:28.009 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87135 5.4 5:2a97e7b7:::benchmark_data_smithi096_19531_object87134:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:28.009 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.240884+0000", 2024-04-19T03:02:28.009 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 4.6585414949999997, 2024-04-19T03:02:28.009 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.025708931, 2024-04-19T03:02:28.009 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:28.009 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-19T03:02:28.010 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:28.010 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:28.010 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:28.010 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87135 2024-04-19T03:02:28.010 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:28.010 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:28.010 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:28.010 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:28.010 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240884+0000", 2024-04-19T03:02:28.010 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:28.010 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:28.010 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:28.010 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:28.011 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240884+0000", 2024-04-19T03:02:28.011 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:28.011 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:28.011 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:28.011 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:28.011 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240883+0000", 2024-04-19T03:02:28.011 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:28.011 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:28.011 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:28.011 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:28.011 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240933+0000", 2024-04-19T03:02:28.011 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9969999999999998e-05 2024-04-19T03:02:28.012 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:28.012 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:28.012 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:28.012 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240946+0000", 2024-04-19T03:02:28.012 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2943e-05 2024-04-19T03:02:28.012 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:28.012 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:28.012 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:28.012 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240952+0000", 2024-04-19T03:02:28.012 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8930000000000002e-06 2024-04-19T03:02:28.012 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:28.012 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:28.012 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:28.012 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240994+0000", 2024-04-19T03:02:28.013 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2753999999999998e-05 2024-04-19T03:02:28.013 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:28.013 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:28.013 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:28.013 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.241092+0000", 2024-04-19T03:02:28.013 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.7447000000000004e-05 2024-04-19T03:02:28.013 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:28.013 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:28.013 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:28.013 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.241183+0000", 2024-04-19T03:02:28.013 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1163999999999997e-05 2024-04-19T03:02:28.013 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:28.014 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:28.014 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:28.014 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.254672+0000", 2024-04-19T03:02:28.014 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.01348864 2024-04-19T03:02:28.014 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:28.014 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:28.014 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:02:28.014 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.254681+0000", 2024-04-19T03:02:28.014 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.3789999999999995e-06 2024-04-19T03:02:28.014 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:28.014 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:28.014 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:28.014 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266456+0000", 2024-04-19T03:02:28.014 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.011774621 2024-04-19T03:02:28.014 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:28.015 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:28.015 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:28.015 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266593+0000", 2024-04-19T03:02:28.015 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013737600000000001 2024-04-19T03:02:28.015 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:28.015 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:28.015 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:28.015 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:28.015 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:28.015 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87136 5.4 5:212411bc:::benchmark_data_smithi096_19531_object87135:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:28.015 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.240962+0000", 2024-04-19T03:02:28.015 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 4.6584636189999999, 2024-04-19T03:02:28.015 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.025738, 2024-04-19T03:02:28.015 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:28.015 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-19T03:02:28.016 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:28.016 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:28.016 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:28.016 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87136 2024-04-19T03:02:28.016 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:28.016 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:28.016 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:28.016 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:28.016 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240962+0000", 2024-04-19T03:02:28.016 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:28.016 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:28.016 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:28.016 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:28.016 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240962+0000", 2024-04-19T03:02:28.016 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:28.016 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:28.017 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:28.017 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:28.017 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240961+0000", 2024-04-19T03:02:28.017 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:28.017 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:28.017 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:28.017 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:28.017 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240995+0000", 2024-04-19T03:02:28.017 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3868000000000002e-05 2024-04-19T03:02:28.017 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:28.017 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:28.017 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:28.017 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.241001+0000", 2024-04-19T03:02:28.017 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.322e-06 2024-04-19T03:02:28.017 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:28.018 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:28.018 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:28.018 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.241004+0000", 2024-04-19T03:02:28.018 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3510000000000002e-06 2024-04-19T03:02:28.018 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:28.018 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:28.018 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:28.018 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247131+0000", 2024-04-19T03:02:28.018 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0061270869999999998 2024-04-19T03:02:28.018 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:28.018 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:28.018 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:28.018 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247322+0000", 2024-04-19T03:02:28.018 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000191015 2024-04-19T03:02:28.019 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:28.019 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:28.019 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:28.019 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247542+0000", 2024-04-19T03:02:28.019 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00022030199999999999 2024-04-19T03:02:28.019 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:28.019 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:28.019 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:28.019 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.254709+0000", 2024-04-19T03:02:28.019 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0071662660000000001 2024-04-19T03:02:28.019 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:28.019 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:28.020 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:02:28.020 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.254716+0000", 2024-04-19T03:02:28.020 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3860000000000001e-06 2024-04-19T03:02:28.020 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:28.020 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:28.020 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:28.020 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266619+0000", 2024-04-19T03:02:28.020 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0119031030000001 2024-04-19T03:02:28.020 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:28.020 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:28.020 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:28.020 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266700+0000", 2024-04-19T03:02:28.020 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0764000000000001e-05 2024-04-19T03:02:28.020 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:28.021 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:28.021 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:28.021 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:28.021 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:28.021 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87138 5.e 5:7b1f1c20:::benchmark_data_smithi096_19531_object87137:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:28.021 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.247862+0000", 2024-04-19T03:02:28.021 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 4.6515635450000001, 2024-04-19T03:02:28.021 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.024457079, 2024-04-19T03:02:28.021 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:28.021 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:28.021 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:28.021 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:28.021 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:28.021 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87138 2024-04-19T03:02:28.022 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:28.022 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:28.022 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:28.022 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:28.022 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247862+0000", 2024-04-19T03:02:28.022 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:28.022 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:28.022 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:28.022 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:28.022 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247862+0000", 2024-04-19T03:02:28.022 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:28.022 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:28.022 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:28.022 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:28.023 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247860+0000", 2024-04-19T03:02:28.023 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999981 2024-04-19T03:02:28.023 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:28.023 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:28.023 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:28.023 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247909+0000", 2024-04-19T03:02:28.023 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9150999999999997e-05 2024-04-19T03:02:28.023 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:28.023 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:28.023 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:28.023 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247925+0000", 2024-04-19T03:02:28.023 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5761999999999999e-05 2024-04-19T03:02:28.023 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:28.023 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:28.023 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:28.024 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247936+0000", 2024-04-19T03:02:28.024 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1144e-05 2024-04-19T03:02:28.024 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:28.024 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:28.024 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:28.024 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.250590+0000", 2024-04-19T03:02:28.024 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.002653678 2024-04-19T03:02:28.024 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:28.024 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:28.024 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:02:28.024 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.250599+0000", 2024-04-19T03:02:28.024 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9039999999999998e-06 2024-04-19T03:02:28.024 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:28.024 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:28.025 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:28.025 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.268151+0000", 2024-04-19T03:02:28.025 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0175523449999999 2024-04-19T03:02:28.025 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:28.025 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:28.025 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:28.025 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.268285+0000", 2024-04-19T03:02:28.025 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013415599999999999 2024-04-19T03:02:28.025 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:28.025 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:28.025 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:28.025 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.272238+0000", 2024-04-19T03:02:28.025 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0039533019999999997 2024-04-19T03:02:28.026 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:28.026 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:28.026 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:28.026 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.272274+0000", 2024-04-19T03:02:28.026 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5352000000000003e-05 2024-04-19T03:02:28.026 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:28.026 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:28.026 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:28.026 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.272319+0000", 2024-04-19T03:02:28.026 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5281999999999998e-05 2024-04-19T03:02:28.026 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:28.026 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:28.026 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:28.027 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:28.027 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:28.027 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-19T03:02:28.028 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T03:02:28.029 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:28.025+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:28.129 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:28.127+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:28.160 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-04-19T03:02:28.160 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [ 2024-04-19T03:02:28.160 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.160 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:94579 5.5 5:afb71a20:::benchmark_data_smithi096_19531_object94578:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-19T03:02:28.160 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:28.154945+0000", 2024-04-19T03:02:28.160 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0027642779999999998, 2024-04-19T03:02:28.160 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0027952839999999999, 2024-04-19T03:02:28.160 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:28.160 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-04-19T03:02:28.160 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:28.161 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:28.161 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:28.161 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 94579 2024-04-19T03:02:28.161 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.161 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:28.161 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.161 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:28.161 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:28.154945+0000", 2024-04-19T03:02:28.161 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:28.161 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.161 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.161 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:28.161 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:28.154945+0000", 2024-04-19T03:02:28.161 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:28.162 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.162 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.162 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:28.162 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:28.154944+0000", 2024-04-19T03:02:28.162 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:28.162 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.162 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.162 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:28.162 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:28.154993+0000", 2024-04-19T03:02:28.162 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9419999999999998e-05 2024-04-19T03:02:28.162 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.162 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.162 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:28.163 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:28.155002+0000", 2024-04-19T03:02:28.163 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9919999999999996e-06 2024-04-19T03:02:28.163 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.163 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.163 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:28.163 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:28.155011+0000", 2024-04-19T03:02:28.163 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4160000000000004e-06 2024-04-19T03:02:28.163 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.163 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.163 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:28.163 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:28.155256+0000", 2024-04-19T03:02:28.163 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00024558499999999999 2024-04-19T03:02:28.163 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:28.163 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:28.163 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:28.163 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.163 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.164 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:94581 5.c 5:307b59ca:::benchmark_data_smithi096_19531_object94580:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-19T03:02:28.164 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:28.155382+0000", 2024-04-19T03:02:28.164 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0023276859999999998, 2024-04-19T03:02:28.164 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0024489669999999998, 2024-04-19T03:02:28.164 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:28.164 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-04-19T03:02:28.164 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:28.164 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:28.164 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:28.164 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 94581 2024-04-19T03:02:28.164 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.164 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:28.164 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.165 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:28.165 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:28.155382+0000", 2024-04-19T03:02:28.165 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:28.165 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.165 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.165 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:28.165 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:28.155382+0000", 2024-04-19T03:02:28.165 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:28.165 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.165 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.165 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:28.165 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:28.155381+0000", 2024-04-19T03:02:28.166 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:28.166 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.166 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.166 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:28.166 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:28.155461+0000", 2024-04-19T03:02:28.166 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9547000000000003e-05 2024-04-19T03:02:28.166 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.166 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.166 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:28.166 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:28.155470+0000", 2024-04-19T03:02:28.166 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.2900000000000008e-06 2024-04-19T03:02:28.166 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.166 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.166 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:28.167 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:28.155477+0000", 2024-04-19T03:02:28.167 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0419999999999997e-06 2024-04-19T03:02:28.167 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.167 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.167 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:28.167 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:28.155517+0000", 2024-04-19T03:02:28.167 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0395999999999997e-05 2024-04-19T03:02:28.167 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.167 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.167 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:28.167 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:28.155641+0000", 2024-04-19T03:02:28.167 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00012416799999999999 2024-04-19T03:02:28.167 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:28.167 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:28.167 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:28.167 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.168 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.168 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:94582 5.6 5:631a8abf:::benchmark_data_smithi096_19531_object94581:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-19T03:02:28.168 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:28.155490+0000", 2024-04-19T03:02:28.168 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.00221944, 2024-04-19T03:02:28.168 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.002429343, 2024-04-19T03:02:28.168 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:28.168 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-04-19T03:02:28.168 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:28.168 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:28.168 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:28.168 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 94582 2024-04-19T03:02:28.168 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.168 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:28.168 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.168 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:28.169 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:28.155490+0000", 2024-04-19T03:02:28.169 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:28.169 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.169 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.169 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:28.169 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:28.155490+0000", 2024-04-19T03:02:28.169 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:28.169 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.169 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.169 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:28.169 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:28.155490+0000", 2024-04-19T03:02:28.169 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:28.169 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.169 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.170 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:28.170 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:28.155524+0000", 2024-04-19T03:02:28.170 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4152000000000001e-05 2024-04-19T03:02:28.170 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.170 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.170 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:28.170 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:28.155531+0000", 2024-04-19T03:02:28.170 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.9029999999999998e-06 2024-04-19T03:02:28.170 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.170 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.170 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:28.170 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:28.155536+0000", 2024-04-19T03:02:28.170 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.874e-06 2024-04-19T03:02:28.170 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.171 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.171 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:28.171 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:28.155582+0000", 2024-04-19T03:02:28.171 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5413e-05 2024-04-19T03:02:28.171 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.171 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.171 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:28.171 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:28.155694+0000", 2024-04-19T03:02:28.171 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000112602 2024-04-19T03:02:28.171 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:28.171 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:28.171 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:28.172 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.172 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.172 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4755.0:94580 5.d e45/22 5:b89dc48c:::benchmark_data_smithi096_19531_object94579:head v 45'5941, mlcod=45'5939)", 2024-04-19T03:02:28.172 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:28.155775+0000", 2024-04-19T03:02:28.172 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.00193501, 2024-04-19T03:02:28.172 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0022258569999999999, 2024-04-19T03:02:28.172 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:28.172 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-04-19T03:02:28.172 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:28.172 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.172 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:28.172 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:28.155775+0000", 2024-04-19T03:02:28.172 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:28.172 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.173 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.173 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:28.173 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:28.155775+0000", 2024-04-19T03:02:28.173 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:28.173 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.173 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.173 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:28.173 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:28.155769+0000", 2024-04-19T03:02:28.173 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999948 2024-04-19T03:02:28.173 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.173 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.173 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:28.173 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:28.155823+0000", 2024-04-19T03:02:28.173 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3671000000000002e-05 2024-04-19T03:02:28.174 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.174 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.174 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:28.174 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:28.155834+0000", 2024-04-19T03:02:28.174 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1277000000000001e-05 2024-04-19T03:02:28.174 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.174 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.174 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:28.174 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:28.155842+0000", 2024-04-19T03:02:28.174 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2439999999999996e-06 2024-04-19T03:02:28.174 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.174 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.174 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:28.175 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:28.156214+0000", 2024-04-19T03:02:28.175 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00037268099999999998 2024-04-19T03:02:28.175 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.175 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.175 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:28.175 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:28.156238+0000", 2024-04-19T03:02:28.175 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.3626999999999999e-05 2024-04-19T03:02:28.175 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:28.175 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:28.175 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:28.175 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.175 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.175 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:94583 5.1 5:845f7359:::benchmark_data_smithi096_19531_object94582:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-19T03:02:28.175 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:28.157733+0000", 2024-04-19T03:02:28.176 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4294967295.9999771, 2024-04-19T03:02:28.176 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000378821, 2024-04-19T03:02:28.176 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:28.176 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-04-19T03:02:28.176 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:28.176 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:28.176 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:28.176 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 94583 2024-04-19T03:02:28.176 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.176 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:28.176 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.176 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:28.176 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:28.157733+0000", 2024-04-19T03:02:28.176 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:28.177 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.177 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.177 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:28.177 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:28.157733+0000", 2024-04-19T03:02:28.177 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:28.177 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.177 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.177 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:28.177 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:28.157731+0000", 2024-04-19T03:02:28.177 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:28.177 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.177 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.177 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:28.177 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:28.157767+0000", 2024-04-19T03:02:28.177 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5731000000000001e-05 2024-04-19T03:02:28.178 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.178 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.178 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:28.178 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:28.157778+0000", 2024-04-19T03:02:28.178 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1022000000000001e-05 2024-04-19T03:02:28.178 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.178 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.178 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:28.178 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:28.157785+0000", 2024-04-19T03:02:28.178 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8530000000000003e-06 2024-04-19T03:02:28.178 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.179 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.179 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:28.179 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:28.157842+0000", 2024-04-19T03:02:28.179 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7129000000000001e-05 2024-04-19T03:02:28.179 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.179 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.179 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:28.179 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:28.157982+0000", 2024-04-19T03:02:28.179 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00013971200000000001 2024-04-19T03:02:28.179 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:28.179 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:28.179 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:28.180 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.180 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.180 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:94584 5.2 5:47a81501:::benchmark_data_smithi096_19531_object94583:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-19T03:02:28.180 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:28.157800+0000", 2024-04-19T03:02:28.180 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4294967295.9999094, 2024-04-19T03:02:28.180 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000402777, 2024-04-19T03:02:28.180 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:28.180 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-04-19T03:02:28.180 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:28.180 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:28.180 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:28.180 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 94584 2024-04-19T03:02:28.180 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.181 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:28.181 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.181 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:28.181 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:28.157800+0000", 2024-04-19T03:02:28.181 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:28.181 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.181 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.181 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:28.181 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:28.157800+0000", 2024-04-19T03:02:28.181 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:28.181 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.181 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.181 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:28.181 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:28.157800+0000", 2024-04-19T03:02:28.182 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:28.182 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.182 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.182 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:28.182 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:28.157832+0000", 2024-04-19T03:02:28.182 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2212000000000003e-05 2024-04-19T03:02:28.182 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.183 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.183 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:28.183 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:28.157841+0000", 2024-04-19T03:02:28.183 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.7050000000000005e-06 2024-04-19T03:02:28.183 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.183 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.183 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:28.183 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:28.157847+0000", 2024-04-19T03:02:28.183 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.674e-06 2024-04-19T03:02:28.183 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.183 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.183 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:28.183 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:28.157893+0000", 2024-04-19T03:02:28.184 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5364000000000001e-05 2024-04-19T03:02:28.184 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.184 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.184 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:28.184 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:28.158026+0000", 2024-04-19T03:02:28.184 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000133141 2024-04-19T03:02:28.184 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:28.184 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:28.184 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:28.184 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.184 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.184 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:94563 5.7 5:e87ca779:::benchmark_data_smithi096_19531_object94562:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-19T03:02:28.185 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:28.146197+0000", 2024-04-19T03:02:28.185 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.011512758999999999, 2024-04-19T03:02:28.185 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.012089776999999999, 2024-04-19T03:02:28.185 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:28.185 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-04-19T03:02:28.185 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:28.185 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:28.185 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:28.185 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 94563 2024-04-19T03:02:28.185 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.185 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:28.185 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.185 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:28.185 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:28.146197+0000", 2024-04-19T03:02:28.186 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:28.186 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.186 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.186 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:28.186 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:28.146197+0000", 2024-04-19T03:02:28.186 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:28.186 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.186 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.186 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:28.186 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:28.146196+0000", 2024-04-19T03:02:28.186 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:28.186 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.187 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.187 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:28.187 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:28.146224+0000", 2024-04-19T03:02:28.187 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.8107e-05 2024-04-19T03:02:28.187 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.187 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.187 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:28.187 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:28.146232+0000", 2024-04-19T03:02:28.187 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.1489999999999997e-06 2024-04-19T03:02:28.187 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.187 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.187 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:28.187 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:28.146237+0000", 2024-04-19T03:02:28.187 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2140000000000004e-06 2024-04-19T03:02:28.187 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.188 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.188 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:28.188 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:28.146284+0000", 2024-04-19T03:02:28.188 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7716999999999997e-05 2024-04-19T03:02:28.188 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.188 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.188 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:28.188 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:28.146454+0000", 2024-04-19T03:02:28.188 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00016940600000000001 2024-04-19T03:02:28.188 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:28.188 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:28.188 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:28.188 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.188 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.189 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:94564 5.7 5:e4c50e01:::benchmark_data_smithi096_19531_object94563:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-19T03:02:28.189 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:28.146503+0000", 2024-04-19T03:02:28.189 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.011206305, 2024-04-19T03:02:28.189 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011873744, 2024-04-19T03:02:28.189 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:28.189 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-04-19T03:02:28.189 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:28.189 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:28.189 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:28.189 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 94564 2024-04-19T03:02:28.189 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.189 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:28.189 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.189 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:28.190 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:28.146503+0000", 2024-04-19T03:02:28.190 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:28.190 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.190 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.190 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:28.190 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:28.146503+0000", 2024-04-19T03:02:28.190 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:28.190 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.190 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.190 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:28.190 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:28.146502+0000", 2024-04-19T03:02:28.190 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:28.190 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.190 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.191 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:28.191 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:28.146578+0000", 2024-04-19T03:02:28.191 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5449000000000002e-05 2024-04-19T03:02:28.191 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.191 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.191 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:28.191 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:28.146594+0000", 2024-04-19T03:02:28.191 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.5736e-05 2024-04-19T03:02:28.191 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.191 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.191 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:28.191 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:28.146601+0000", 2024-04-19T03:02:28.191 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7370000000000006e-06 2024-04-19T03:02:28.191 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.192 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.192 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:28.192 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:28.149222+0000", 2024-04-19T03:02:28.192 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0026203680000000001 2024-04-19T03:02:28.192 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.192 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.192 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:28.192 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:28.149366+0000", 2024-04-19T03:02:28.192 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00014405099999999999 2024-04-19T03:02:28.192 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:28.192 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:28.192 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:28.192 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.192 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.192 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:94567 5.7 5:ed76dcc8:::benchmark_data_smithi096_19531_object94566:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-19T03:02:28.193 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:28.149104+0000", 2024-04-19T03:02:28.193 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0086050789999999999, 2024-04-19T03:02:28.193 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0093593970000000002, 2024-04-19T03:02:28.193 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:28.193 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-04-19T03:02:28.193 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:28.193 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:28.193 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:28.193 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 94567 2024-04-19T03:02:28.193 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.193 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:28.193 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.193 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:28.193 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:28.149104+0000", 2024-04-19T03:02:28.193 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:28.194 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.194 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.194 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:28.194 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:28.149104+0000", 2024-04-19T03:02:28.194 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:28.194 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.194 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.194 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:28.194 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:28.149104+0000", 2024-04-19T03:02:28.194 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:28.194 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.194 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.194 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:28.195 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:28.149193+0000", 2024-04-19T03:02:28.195 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.8917000000000003e-05 2024-04-19T03:02:28.195 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.195 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.195 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:28.195 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:28.149204+0000", 2024-04-19T03:02:28.195 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1586999999999999e-05 2024-04-19T03:02:28.195 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.195 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.195 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:28.195 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:28.149213+0000", 2024-04-19T03:02:28.195 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4400000000000005e-06 2024-04-19T03:02:28.195 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.195 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.196 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:28.196 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:28.152308+0000", 2024-04-19T03:02:28.196 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0030956709999999999 2024-04-19T03:02:28.196 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.196 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.196 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:28.196 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:28.152546+0000", 2024-04-19T03:02:28.196 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00023744400000000001 2024-04-19T03:02:28.196 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:28.196 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:28.196 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:28.196 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.196 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.196 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:94568 5.5 5:a695ae12:::benchmark_data_smithi096_19531_object94567:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-19T03:02:28.196 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:28.149719+0000", 2024-04-19T03:02:28.197 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0079902970000000004, 2024-04-19T03:02:28.197 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0088333999999999999, 2024-04-19T03:02:28.197 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:28.197 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-04-19T03:02:28.197 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:28.197 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:28.197 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:28.197 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 94568 2024-04-19T03:02:28.197 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.197 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:28.197 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.197 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:28.197 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:28.149719+0000", 2024-04-19T03:02:28.198 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:28.198 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.198 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.198 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:28.198 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:28.149719+0000", 2024-04-19T03:02:28.198 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:28.198 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.198 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.198 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:28.198 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:28.149718+0000", 2024-04-19T03:02:28.198 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:28.198 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.198 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.198 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:28.199 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:28.149861+0000", 2024-04-19T03:02:28.199 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000143001 2024-04-19T03:02:28.199 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.199 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.199 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:28.199 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:28.149877+0000", 2024-04-19T03:02:28.199 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.5743000000000002e-05 2024-04-19T03:02:28.199 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.199 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.199 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:28.199 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:28.149888+0000", 2024-04-19T03:02:28.199 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1201e-05 2024-04-19T03:02:28.199 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.199 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.199 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:28.200 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:28.152433+0000", 2024-04-19T03:02:28.200 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.002544789 2024-04-19T03:02:28.200 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.200 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.200 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:28.200 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:28.152588+0000", 2024-04-19T03:02:28.200 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000154647 2024-04-19T03:02:28.200 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:28.200 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:28.200 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:28.200 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.200 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.200 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:94571 5.7 5:eecde152:::benchmark_data_smithi096_19531_object94570:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-19T03:02:28.201 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:28.150196+0000", 2024-04-19T03:02:28.201 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0075134670000000002, 2024-04-19T03:02:28.201 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.008444577, 2024-04-19T03:02:28.201 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:28.201 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-04-19T03:02:28.201 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:28.201 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:28.201 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:28.201 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 94571 2024-04-19T03:02:28.201 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.201 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:28.201 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.201 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:28.201 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:28.150196+0000", 2024-04-19T03:02:28.202 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:28.202 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.202 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.202 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:28.202 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:28.150196+0000", 2024-04-19T03:02:28.202 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:28.202 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.202 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.202 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:28.202 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:28.150195+0000", 2024-04-19T03:02:28.202 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:28.202 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.202 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.203 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:28.203 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:28.150279+0000", 2024-04-19T03:02:28.203 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4338000000000005e-05 2024-04-19T03:02:28.203 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.203 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.203 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:28.203 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:28.150289+0000", 2024-04-19T03:02:28.203 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.3510000000000008e-06 2024-04-19T03:02:28.203 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.203 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.203 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:28.203 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:28.150296+0000", 2024-04-19T03:02:28.203 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7129999999999999e-06 2024-04-19T03:02:28.203 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.204 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.204 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:28.204 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:28.155292+0000", 2024-04-19T03:02:28.204 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.004996655 2024-04-19T03:02:28.204 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.204 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.204 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:28.204 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:28.155450+0000", 2024-04-19T03:02:28.204 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000157746 2024-04-19T03:02:28.204 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:28.204 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:28.204 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:28.204 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.204 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.205 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:94574 5.2 5:4d106f8a:::benchmark_data_smithi096_19531_object94573:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-19T03:02:28.205 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:28.153705+0000", 2024-04-19T03:02:28.205 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0040040579999999996, 2024-04-19T03:02:28.205 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0050250809999999998, 2024-04-19T03:02:28.205 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:28.205 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-04-19T03:02:28.205 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:28.205 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:28.205 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:28.205 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 94574 2024-04-19T03:02:28.205 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.205 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:28.205 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.205 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:28.206 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:28.153705+0000", 2024-04-19T03:02:28.206 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:28.206 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.206 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.206 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:28.206 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:28.153705+0000", 2024-04-19T03:02:28.206 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:28.206 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.206 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.206 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:28.206 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:28.153704+0000", 2024-04-19T03:02:28.206 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:28.207 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.207 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.207 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:28.207 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:28.153774+0000", 2024-04-19T03:02:28.207 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.9468000000000006e-05 2024-04-19T03:02:28.207 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.207 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.207 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:28.207 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:28.153788+0000", 2024-04-19T03:02:28.207 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4725e-05 2024-04-19T03:02:28.207 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.207 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.207 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:28.207 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:28.153797+0000", 2024-04-19T03:02:28.208 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.0589999999999992e-06 2024-04-19T03:02:28.208 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.208 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.208 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:28.208 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:28.153846+0000", 2024-04-19T03:02:28.208 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8857999999999999e-05 2024-04-19T03:02:28.208 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.208 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.208 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:28.208 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:28.153932+0000", 2024-04-19T03:02:28.208 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.5950000000000002e-05 2024-04-19T03:02:28.209 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:28.209 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:28.209 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:28.209 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.209 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.209 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:94575 5.7 5.7253dd57 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-19T03:02:28.209 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:28.153816+0000", 2024-04-19T03:02:28.209 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0038931579999999999, 2024-04-19T03:02:28.209 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0049966250000000002, 2024-04-19T03:02:28.209 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:28.209 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-04-19T03:02:28.209 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:28.209 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:28.210 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:28.210 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 94575 2024-04-19T03:02:28.210 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.210 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:28.210 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.210 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:28.210 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:28.153816+0000", 2024-04-19T03:02:28.210 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:28.210 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.210 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.210 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:28.210 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:28.153816+0000", 2024-04-19T03:02:28.210 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:28.211 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.211 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.211 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:28.211 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:28.153816+0000", 2024-04-19T03:02:28.211 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:28.211 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.211 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.211 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:28.211 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:28.153849+0000", 2024-04-19T03:02:28.211 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3263999999999999e-05 2024-04-19T03:02:28.211 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.211 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.211 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:28.211 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:28.153857+0000", 2024-04-19T03:02:28.212 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.498e-06 2024-04-19T03:02:28.212 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.212 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.212 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:28.212 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:28.153862+0000", 2024-04-19T03:02:28.212 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4999999999999999e-06 2024-04-19T03:02:28.212 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:28.212 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:28.212 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:28.212 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.212 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.212 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:94578 5.3 5:caafd6db:::benchmark_data_smithi096_19531_object94577:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-19T03:02:28.212 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:28.153998+0000", 2024-04-19T03:02:28.213 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.003711383, 2024-04-19T03:02:28.213 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0048869250000000003, 2024-04-19T03:02:28.213 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:28.213 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-04-19T03:02:28.213 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:28.213 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:28.213 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:28.213 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 94578 2024-04-19T03:02:28.213 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.213 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:28.213 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.213 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:28.213 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:28.153998+0000", 2024-04-19T03:02:28.213 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:28.214 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.214 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.214 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:28.214 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:28.153998+0000", 2024-04-19T03:02:28.214 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:28.214 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.214 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.214 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:28.214 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:28.153997+0000", 2024-04-19T03:02:28.214 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:28.214 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.214 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.214 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:28.214 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:28.154069+0000", 2024-04-19T03:02:28.214 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2044000000000003e-05 2024-04-19T03:02:28.215 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.215 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.215 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:28.215 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:28.154081+0000", 2024-04-19T03:02:28.215 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1707e-05 2024-04-19T03:02:28.215 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.215 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.215 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:28.215 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:28.154087+0000", 2024-04-19T03:02:28.215 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6529999999999999e-06 2024-04-19T03:02:28.215 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.215 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.215 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:28.215 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:28.154153+0000", 2024-04-19T03:02:28.216 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6372999999999996e-05 2024-04-19T03:02:28.216 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.216 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.216 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:28.216 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:28.154326+0000", 2024-04-19T03:02:28.216 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000173034 2024-04-19T03:02:28.216 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:28.216 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:28.216 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:28.216 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:28.216 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-04-19T03:02:28.216 INFO:teuthology.orchestra.run.smithi144.stdout: "num_ops": 14 2024-04-19T03:02:28.216 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-04-19T03:02:28.218 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T03:02:28.230 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:28.225+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:28.331 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:28.329+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:28.348 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-04-19T03:02:28.348 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2024-04-19T03:02:28.348 INFO:teuthology.orchestra.run.smithi144.stdout: "complaint_time": 30, 2024-04-19T03:02:28.349 INFO:teuthology.orchestra.run.smithi144.stdout: "num_blocked_ops": 0 2024-04-19T03:02:28.349 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-04-19T03:02:28.362 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T03:02:28.432 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:28.431+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:28.529 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-04-19T03:02:28.529 INFO:teuthology.orchestra.run.smithi144.stdout: "size": 20, 2024-04-19T03:02:28.529 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 600, 2024-04-19T03:02:28.529 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [ 2024-04-19T03:02:28.529 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.529 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:78992 5.7 5:e6baa862:::benchmark_data_smithi096_19531_object78991:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-19T03:02:28.529 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:18.008888+0000", 2024-04-19T03:02:28.530 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 10.517262654, 2024-04-19T03:02:28.530 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.056375285999999997, 2024-04-19T03:02:28.530 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:28.530 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:28.530 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:28.530 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:28.530 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:28.530 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 78992 2024-04-19T03:02:28.530 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.530 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:28.530 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.530 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:28.530 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.008888+0000", 2024-04-19T03:02:28.530 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:28.531 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.531 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.531 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:28.531 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.008888+0000", 2024-04-19T03:02:28.531 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:28.531 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.531 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.531 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:28.531 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.008888+0000", 2024-04-19T03:02:28.531 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:28.531 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.531 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.531 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:28.532 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.008928+0000", 2024-04-19T03:02:28.532 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0361999999999997e-05 2024-04-19T03:02:28.532 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.532 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.532 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:28.532 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.008942+0000", 2024-04-19T03:02:28.532 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4365000000000001e-05 2024-04-19T03:02:28.532 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.532 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.533 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:28.533 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.008949+0000", 2024-04-19T03:02:28.533 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.212e-06 2024-04-19T03:02:28.533 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.533 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.533 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:28.533 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.012683+0000", 2024-04-19T03:02:28.533 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.003733934 2024-04-19T03:02:28.533 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.533 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.533 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:28.533 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.012798+0000", 2024-04-19T03:02:28.533 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00011574999999999999 2024-04-19T03:02:28.533 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.534 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.534 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:28.534 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.012896+0000", 2024-04-19T03:02:28.534 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.7848000000000002e-05 2024-04-19T03:02:28.534 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.534 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.534 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:28.534 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016423+0000", 2024-04-19T03:02:28.534 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0035270789999999998 2024-04-19T03:02:28.534 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.534 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.534 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:28.534 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.065098+0000", 2024-04-19T03:02:28.535 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.048674651999999999 2024-04-19T03:02:28.535 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.535 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.535 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:28.535 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.065193+0000", 2024-04-19T03:02:28.535 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.5087999999999995e-05 2024-04-19T03:02:28.535 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.535 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.535 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:28.535 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.065264+0000", 2024-04-19T03:02:28.535 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0666000000000004e-05 2024-04-19T03:02:28.535 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:28.535 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:28.536 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:28.536 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.536 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.536 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:78998 5.7 5:ee23c1bc:::benchmark_data_smithi096_19531_object78997:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-19T03:02:28.536 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:18.013165+0000", 2024-04-19T03:02:28.536 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 10.512985948000001, 2024-04-19T03:02:28.536 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.052410864000000001, 2024-04-19T03:02:28.536 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:28.536 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:28.536 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:28.536 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:28.536 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:28.536 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 78998 2024-04-19T03:02:28.536 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.537 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:28.537 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.537 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:28.537 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.013165+0000", 2024-04-19T03:02:28.537 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:28.537 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.537 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.537 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:28.537 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.013165+0000", 2024-04-19T03:02:28.537 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:28.537 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.537 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.537 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:28.537 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.013164+0000", 2024-04-19T03:02:28.538 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:28.538 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.538 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.538 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:28.538 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.013214+0000", 2024-04-19T03:02:28.538 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9636999999999999e-05 2024-04-19T03:02:28.538 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.538 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.538 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:28.538 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.013223+0000", 2024-04-19T03:02:28.538 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.3619999999999995e-06 2024-04-19T03:02:28.538 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.538 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.539 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:28.539 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.013229+0000", 2024-04-19T03:02:28.539 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6060000000000002e-06 2024-04-19T03:02:28.539 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.539 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.539 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:28.539 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.014882+0000", 2024-04-19T03:02:28.539 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001653257 2024-04-19T03:02:28.539 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.539 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.539 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:28.539 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.014958+0000", 2024-04-19T03:02:28.539 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6398999999999998e-05 2024-04-19T03:02:28.540 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.540 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.540 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:28.540 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.015036+0000", 2024-04-19T03:02:28.540 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8070000000000003e-05 2024-04-19T03:02:28.540 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.540 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.540 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:28.540 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018099+0000", 2024-04-19T03:02:28.540 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0030631149999999999 2024-04-19T03:02:28.540 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.540 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.540 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:28.541 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.065328+0000", 2024-04-19T03:02:28.541 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.047228349000000003 2024-04-19T03:02:28.541 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.541 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.541 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:28.541 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.065508+0000", 2024-04-19T03:02:28.541 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00018036899999999999 2024-04-19T03:02:28.541 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.541 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.541 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:28.541 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.065576+0000", 2024-04-19T03:02:28.541 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7785000000000002e-05 2024-04-19T03:02:28.541 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:28.542 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:28.542 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:28.542 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.542 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.542 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4755.0:78995 5.2 e40/39 5:42b55e12:::benchmark_data_smithi096_19531_object78994:head v 40'4934, mlcod=40'4932)", 2024-04-19T03:02:28.542 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:18.016247+0000", 2024-04-19T03:02:28.542 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 10.509903985999999, 2024-04-19T03:02:28.542 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.056240406, 2024-04-19T03:02:28.542 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:28.542 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:28.542 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:28.542 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.542 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:28.543 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016247+0000", 2024-04-19T03:02:28.543 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:28.543 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.543 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.543 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:28.543 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016247+0000", 2024-04-19T03:02:28.543 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:28.543 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.543 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.543 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:28.543 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016246+0000", 2024-04-19T03:02:28.543 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:28.544 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.544 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.544 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:28.544 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016315+0000", 2024-04-19T03:02:28.544 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8979000000000005e-05 2024-04-19T03:02:28.544 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.544 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.544 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:28.544 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016333+0000", 2024-04-19T03:02:28.544 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7586999999999999e-05 2024-04-19T03:02:28.544 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.545 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.545 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:28.545 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016340+0000", 2024-04-19T03:02:28.545 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4080000000000001e-06 2024-04-19T03:02:28.545 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.545 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.545 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:28.545 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016384+0000", 2024-04-19T03:02:28.545 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3656999999999999e-05 2024-04-19T03:02:28.545 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.545 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.545 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:28.545 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016403+0000", 2024-04-19T03:02:28.545 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9089e-05 2024-04-19T03:02:28.546 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.546 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.546 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:28.546 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.072448+0000", 2024-04-19T03:02:28.546 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.056045084000000002 2024-04-19T03:02:28.546 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.546 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.546 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:28.546 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.072487+0000", 2024-04-19T03:02:28.546 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9362e-05 2024-04-19T03:02:28.546 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:28.546 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:28.546 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:28.547 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.547 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.547 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4755.0:78994 5.c e40/22 5:3c60d55d:::benchmark_data_smithi096_19531_object78993:head v 40'4989, mlcod=40'4987)", 2024-04-19T03:02:28.547 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:18.016392+0000", 2024-04-19T03:02:28.547 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 10.509759344999999, 2024-04-19T03:02:28.547 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.052629620000000002, 2024-04-19T03:02:28.547 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:28.547 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:28.547 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:28.547 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.547 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:28.547 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016392+0000", 2024-04-19T03:02:28.547 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:28.547 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.548 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.548 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:28.548 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016392+0000", 2024-04-19T03:02:28.548 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:28.548 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.548 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.548 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:28.548 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016391+0000", 2024-04-19T03:02:28.548 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:28.548 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.548 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.548 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:28.548 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016471+0000", 2024-04-19T03:02:28.548 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9346999999999998e-05 2024-04-19T03:02:28.549 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.549 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.549 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:28.549 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016478+0000", 2024-04-19T03:02:28.549 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.593e-06 2024-04-19T03:02:28.549 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.549 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.549 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:28.549 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016495+0000", 2024-04-19T03:02:28.549 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6492999999999999e-05 2024-04-19T03:02:28.549 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.550 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.550 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:28.550 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016539+0000", 2024-04-19T03:02:28.550 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4715999999999997e-05 2024-04-19T03:02:28.550 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.550 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.550 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:28.550 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016551+0000", 2024-04-19T03:02:28.550 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2096000000000001e-05 2024-04-19T03:02:28.550 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.550 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.550 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:28.550 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.068985+0000", 2024-04-19T03:02:28.550 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.052433754999999999 2024-04-19T03:02:28.551 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.551 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.551 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:28.551 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.069021+0000", 2024-04-19T03:02:28.551 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6047000000000002e-05 2024-04-19T03:02:28.551 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:28.551 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:28.551 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:28.551 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.551 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.551 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4755.0:78996 5.1 e40/39 5:87f59708:::benchmark_data_smithi096_19531_object78995:head v 40'4940, mlcod=40'4938)", 2024-04-19T03:02:28.551 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:18.016581+0000", 2024-04-19T03:02:28.551 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 10.509570180000001, 2024-04-19T03:02:28.552 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.052051785000000003, 2024-04-19T03:02:28.552 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:28.552 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:28.552 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:28.552 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.552 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:28.552 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016581+0000", 2024-04-19T03:02:28.552 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:28.552 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.552 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.552 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:28.553 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016581+0000", 2024-04-19T03:02:28.553 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:28.553 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.553 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.553 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:28.553 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016581+0000", 2024-04-19T03:02:28.553 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:28.553 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.553 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.553 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:28.553 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016610+0000", 2024-04-19T03:02:28.553 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9556999999999998e-05 2024-04-19T03:02:28.553 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.553 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.553 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:28.554 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016616+0000", 2024-04-19T03:02:28.554 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1090000000000003e-06 2024-04-19T03:02:28.554 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.554 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.554 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:28.554 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016621+0000", 2024-04-19T03:02:28.554 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.454e-06 2024-04-19T03:02:28.554 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.554 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.554 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:28.554 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016663+0000", 2024-04-19T03:02:28.554 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2582e-05 2024-04-19T03:02:28.554 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.555 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.555 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:28.555 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016681+0000", 2024-04-19T03:02:28.555 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7680999999999999e-05 2024-04-19T03:02:28.555 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.555 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.555 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:28.555 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.068486+0000", 2024-04-19T03:02:28.555 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.051804624000000001 2024-04-19T03:02:28.555 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.555 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.555 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:28.555 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.068633+0000", 2024-04-19T03:02:28.555 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00014709099999999999 2024-04-19T03:02:28.556 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:28.556 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:28.556 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:28.556 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.556 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.556 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4755.0:78999 5.3 e40/22 5:c9ec5f7f:::benchmark_data_smithi096_19531_object78998:head v 40'4893, mlcod=40'4889)", 2024-04-19T03:02:28.556 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:18.016633+0000", 2024-04-19T03:02:28.556 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 10.509518325, 2024-04-19T03:02:28.556 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.051090469999999999, 2024-04-19T03:02:28.556 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:28.556 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:28.556 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:28.556 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.556 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:28.557 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016633+0000", 2024-04-19T03:02:28.557 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:28.557 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.557 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.557 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:28.557 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016633+0000", 2024-04-19T03:02:28.557 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:28.557 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.557 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.557 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:28.557 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016632+0000", 2024-04-19T03:02:28.557 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967296 2024-04-19T03:02:28.557 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.557 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.558 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:28.558 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016660+0000", 2024-04-19T03:02:28.558 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7869999999999999e-05 2024-04-19T03:02:28.558 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.558 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.558 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:28.558 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016667+0000", 2024-04-19T03:02:28.558 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0280000000000003e-06 2024-04-19T03:02:28.558 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.558 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.558 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:28.558 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016672+0000", 2024-04-19T03:02:28.558 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0069999999999997e-06 2024-04-19T03:02:28.559 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.559 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.559 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:28.559 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016725+0000", 2024-04-19T03:02:28.559 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2812000000000002e-05 2024-04-19T03:02:28.559 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.559 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.559 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:28.559 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016750+0000", 2024-04-19T03:02:28.559 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5038e-05 2024-04-19T03:02:28.559 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.559 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.559 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:28.559 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.067673+0000", 2024-04-19T03:02:28.560 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.050922350999999998 2024-04-19T03:02:28.560 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.560 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.560 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:28.560 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.067723+0000", 2024-04-19T03:02:28.560 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0586e-05 2024-04-19T03:02:28.560 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:28.560 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:28.560 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:28.560 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.560 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.560 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4755.0:79003 5.2 e40/39 5:4436e33f:::benchmark_data_smithi096_19531_object79002:head v 40'4935, mlcod=40'4932)", 2024-04-19T03:02:28.560 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:18.018102+0000", 2024-04-19T03:02:28.560 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 10.508048598, 2024-04-19T03:02:28.561 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.060023990999999999, 2024-04-19T03:02:28.561 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:28.561 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:28.561 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:28.561 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.561 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:28.561 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018102+0000", 2024-04-19T03:02:28.561 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:28.561 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.561 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.561 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:28.561 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018102+0000", 2024-04-19T03:02:28.561 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:28.561 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.562 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.562 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:28.562 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018102+0000", 2024-04-19T03:02:28.562 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:28.562 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.562 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.562 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:28.562 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018134+0000", 2024-04-19T03:02:28.562 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2722000000000003e-05 2024-04-19T03:02:28.562 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.562 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.562 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:28.562 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018145+0000", 2024-04-19T03:02:28.563 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0395e-05 2024-04-19T03:02:28.563 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.563 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.563 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:28.563 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018151+0000", 2024-04-19T03:02:28.563 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5300000000000002e-06 2024-04-19T03:02:28.563 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.563 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.563 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:28.563 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018489+0000", 2024-04-19T03:02:28.563 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00033731499999999998 2024-04-19T03:02:28.563 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.563 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.563 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:28.564 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018508+0000", 2024-04-19T03:02:28.564 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9775e-05 2024-04-19T03:02:28.564 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.564 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.564 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:28.564 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.078059+0000", 2024-04-19T03:02:28.564 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.059550171999999998 2024-04-19T03:02:28.564 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.564 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.564 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:28.564 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.078126+0000", 2024-04-19T03:02:28.564 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7773000000000003e-05 2024-04-19T03:02:28.564 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:28.564 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:28.565 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:28.565 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.565 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.565 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4755.0:79005 5.1 e40/39 5:85b46038:::benchmark_data_smithi096_19531_object79004:head v 40'4941, mlcod=40'4938)", 2024-04-19T03:02:28.565 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:18.018167+0000", 2024-04-19T03:02:28.565 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 10.507983878999999, 2024-04-19T03:02:28.565 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.052768941999999999, 2024-04-19T03:02:28.565 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:28.565 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:28.565 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:28.565 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.565 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:28.565 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018167+0000", 2024-04-19T03:02:28.565 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:28.566 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.566 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.566 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:28.566 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018167+0000", 2024-04-19T03:02:28.566 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:28.566 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.566 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.566 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:28.566 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018167+0000", 2024-04-19T03:02:28.566 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:28.566 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.567 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.567 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:28.567 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018196+0000", 2024-04-19T03:02:28.567 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9538000000000001e-05 2024-04-19T03:02:28.567 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.567 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.567 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:28.567 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018204+0000", 2024-04-19T03:02:28.567 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2599999999999999e-06 2024-04-19T03:02:28.567 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.567 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.567 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:28.567 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018208+0000", 2024-04-19T03:02:28.567 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8080000000000004e-06 2024-04-19T03:02:28.568 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.568 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.568 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:28.568 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.064933+0000", 2024-04-19T03:02:28.568 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.046725048999999998 2024-04-19T03:02:28.568 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.568 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.568 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:28.568 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.064964+0000", 2024-04-19T03:02:28.568 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0577000000000002e-05 2024-04-19T03:02:28.568 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.568 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.568 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:28.568 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.070815+0000", 2024-04-19T03:02:28.569 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0058510649999999999 2024-04-19T03:02:28.569 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.569 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.569 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:28.569 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.070936+0000", 2024-04-19T03:02:28.569 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00012095399999999999 2024-04-19T03:02:28.569 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:28.569 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:28.569 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:28.569 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.569 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.569 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:86612 5.7 5:e32e3c49:::benchmark_data_smithi096_19531_object86611:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:28.570 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:22.633560+0000", 2024-04-19T03:02:28.570 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 5.8925909379999997, 2024-04-19T03:02:28.570 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.19135289, 2024-04-19T03:02:28.570 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:28.570 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:28.570 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:28.570 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:28.570 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:28.570 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 86612 2024-04-19T03:02:28.570 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.570 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:28.570 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.570 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:28.571 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633560+0000", 2024-04-19T03:02:28.571 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:28.571 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.571 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.571 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:28.571 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633560+0000", 2024-04-19T03:02:28.571 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:28.571 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.571 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.571 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:28.571 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633558+0000", 2024-04-19T03:02:28.571 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:28.571 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.571 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.572 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:28.572 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633609+0000", 2024-04-19T03:02:28.572 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0850999999999998e-05 2024-04-19T03:02:28.572 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.572 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.572 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:28.572 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633627+0000", 2024-04-19T03:02:28.572 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7951000000000001e-05 2024-04-19T03:02:28.572 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.572 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.572 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:28.572 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633635+0000", 2024-04-19T03:02:28.572 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2530000000000004e-06 2024-04-19T03:02:28.573 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.573 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.573 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:28.573 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633699+0000", 2024-04-19T03:02:28.573 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3901999999999999e-05 2024-04-19T03:02:28.573 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.573 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.573 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:28.573 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633992+0000", 2024-04-19T03:02:28.573 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00029283299999999999 2024-04-19T03:02:28.573 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.573 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.574 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:28.574 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.634223+0000", 2024-04-19T03:02:28.574 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00023084200000000001 2024-04-19T03:02:28.574 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.574 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.574 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:28.574 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.639085+0000", 2024-04-19T03:02:28.574 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0048624269999999999 2024-04-19T03:02:28.574 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.574 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.574 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:28.574 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.824635+0000", 2024-04-19T03:02:28.574 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.18554944700000001 2024-04-19T03:02:28.574 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.575 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.575 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:28.575 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.824793+0000", 2024-04-19T03:02:28.575 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000157959 2024-04-19T03:02:28.575 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.575 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.575 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:28.575 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.824913+0000", 2024-04-19T03:02:28.575 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000120093 2024-04-19T03:02:28.575 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:28.575 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:28.575 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:28.576 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.576 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.576 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:86625 5.7 5:e6d00488:::benchmark_data_smithi096_19531_object86624:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:28.576 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:22.643554+0000", 2024-04-19T03:02:28.576 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 5.8825971719999997, 2024-04-19T03:02:28.576 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.18732841, 2024-04-19T03:02:28.576 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:28.576 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:28.576 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:28.576 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:28.576 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:28.576 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 86625 2024-04-19T03:02:28.576 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.577 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:28.577 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.577 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:28.577 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643554+0000", 2024-04-19T03:02:28.577 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:28.577 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.577 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.577 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:28.577 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643554+0000", 2024-04-19T03:02:28.577 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:28.577 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.577 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.577 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:28.577 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643552+0000", 2024-04-19T03:02:28.578 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:28.578 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.578 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.578 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:28.578 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643588+0000", 2024-04-19T03:02:28.578 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5855999999999997e-05 2024-04-19T03:02:28.578 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.578 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.578 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:28.578 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643606+0000", 2024-04-19T03:02:28.578 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8226000000000001e-05 2024-04-19T03:02:28.578 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.579 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.579 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:28.579 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643618+0000", 2024-04-19T03:02:28.579 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1868000000000001e-05 2024-04-19T03:02:28.579 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.579 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.579 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:28.579 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643676+0000", 2024-04-19T03:02:28.579 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8153999999999999e-05 2024-04-19T03:02:28.579 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.579 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.579 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:28.579 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643905+0000", 2024-04-19T03:02:28.579 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00022847500000000001 2024-04-19T03:02:28.580 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.580 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.580 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:28.580 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.644150+0000", 2024-04-19T03:02:28.580 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00024531800000000001 2024-04-19T03:02:28.580 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.580 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.580 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:28.580 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.647407+0000", 2024-04-19T03:02:28.580 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0032563190000000001 2024-04-19T03:02:28.580 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.580 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.580 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:28.581 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.830721+0000", 2024-04-19T03:02:28.581 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.18331468300000001 2024-04-19T03:02:28.581 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.581 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.581 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:28.581 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.830813+0000", 2024-04-19T03:02:28.581 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.2205000000000002e-05 2024-04-19T03:02:28.581 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.581 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.581 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:28.581 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.830882+0000", 2024-04-19T03:02:28.581 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8819999999999995e-05 2024-04-19T03:02:28.581 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:28.582 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:28.582 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:28.582 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.582 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.582 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87063 5.7 5:e502e824:::benchmark_data_smithi096_19531_object87062:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:28.582 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.136067+0000", 2024-04-19T03:02:28.582 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 5.3900843030000001, 2024-04-19T03:02:28.582 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.065521159999999995, 2024-04-19T03:02:28.582 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:28.582 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:28.582 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:28.582 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:28.582 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:28.583 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87063 2024-04-19T03:02:28.583 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.583 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:28.583 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.583 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:28.583 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.136067+0000", 2024-04-19T03:02:28.583 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:28.583 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.583 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.583 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:28.583 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.136067+0000", 2024-04-19T03:02:28.583 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:28.584 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.584 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.584 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:28.584 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.136066+0000", 2024-04-19T03:02:28.584 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:28.584 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.584 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.584 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:28.584 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.136154+0000", 2024-04-19T03:02:28.584 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.8256000000000003e-05 2024-04-19T03:02:28.584 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.584 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.584 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:28.584 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.136162+0000", 2024-04-19T03:02:28.585 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.5099999999999998e-06 2024-04-19T03:02:28.585 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.585 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.585 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:28.585 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.136171+0000", 2024-04-19T03:02:28.585 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2830000000000001e-06 2024-04-19T03:02:28.585 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.585 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.585 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:28.585 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.138421+0000", 2024-04-19T03:02:28.585 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0022506620000000001 2024-04-19T03:02:28.585 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.585 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.586 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:28.586 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.138560+0000", 2024-04-19T03:02:28.586 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000138446 2024-04-19T03:02:28.586 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.586 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.586 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:28.586 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.138689+0000", 2024-04-19T03:02:28.586 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00012950700000000001 2024-04-19T03:02:28.586 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.586 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.586 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:28.586 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.141517+0000", 2024-04-19T03:02:28.587 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0028280860000000001 2024-04-19T03:02:28.587 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.587 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.587 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:28.587 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.201350+0000", 2024-04-19T03:02:28.587 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.059832418999999998 2024-04-19T03:02:28.587 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.587 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.587 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:28.587 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.201485+0000", 2024-04-19T03:02:28.587 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000135597 2024-04-19T03:02:28.587 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.588 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.588 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:28.588 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.201588+0000", 2024-04-19T03:02:28.588 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00010247900000000001 2024-04-19T03:02:28.588 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:28.588 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:28.588 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:28.588 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.588 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.588 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87072 5.7 5:e3c7809a:::benchmark_data_smithi096_19531_object87071:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:28.588 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.144224+0000", 2024-04-19T03:02:28.588 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 5.3819272790000001, 2024-04-19T03:02:28.588 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.058179555000000001, 2024-04-19T03:02:28.589 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:28.589 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:28.589 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:28.589 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:28.589 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:28.589 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87072 2024-04-19T03:02:28.589 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.589 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:28.589 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.589 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:28.589 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144224+0000", 2024-04-19T03:02:28.590 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:28.590 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.590 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.590 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:28.590 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144224+0000", 2024-04-19T03:02:28.590 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:28.590 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.590 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.590 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:28.590 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144223+0000", 2024-04-19T03:02:28.590 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:28.590 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.590 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.591 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:28.591 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144320+0000", 2024-04-19T03:02:28.591 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.7075000000000001e-05 2024-04-19T03:02:28.591 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.591 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.591 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:28.591 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144331+0000", 2024-04-19T03:02:28.591 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1342000000000001e-05 2024-04-19T03:02:28.591 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.591 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.591 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:28.591 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144337+0000", 2024-04-19T03:02:28.591 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8390000000000003e-06 2024-04-19T03:02:28.591 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.592 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.592 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:28.592 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144369+0000", 2024-04-19T03:02:28.592 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2079000000000002e-05 2024-04-19T03:02:28.592 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.592 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.592 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:28.592 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144464+0000", 2024-04-19T03:02:28.592 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.4623000000000005e-05 2024-04-19T03:02:28.592 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.592 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.592 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:28.593 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144553+0000", 2024-04-19T03:02:28.593 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9171000000000004e-05 2024-04-19T03:02:28.593 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.593 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.593 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:28.593 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.147018+0000", 2024-04-19T03:02:28.593 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0024648370000000001 2024-04-19T03:02:28.593 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.593 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.593 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:28.593 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.202270+0000", 2024-04-19T03:02:28.594 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.055252018 2024-04-19T03:02:28.594 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.594 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.594 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:28.594 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.202356+0000", 2024-04-19T03:02:28.594 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6648000000000001e-05 2024-04-19T03:02:28.594 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.594 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.594 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:28.594 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.202403+0000", 2024-04-19T03:02:28.594 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6956999999999998e-05 2024-04-19T03:02:28.594 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:28.594 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:28.595 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:28.595 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.595 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.595 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87123 5.6 5:6d1bc3b9:::benchmark_data_smithi096_19531_object87122:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:02:28.595 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249233+0000", 2024-04-19T03:02:28.595 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 5.2769182470000002, 2024-04-19T03:02:28.595 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0291700720000001, 2024-04-19T03:02:28.595 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:28.595 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-04-19T03:02:28.595 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:28.595 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:28.595 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:28.595 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87123 2024-04-19T03:02:28.596 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.596 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:28.596 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.596 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:28.596 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249233+0000", 2024-04-19T03:02:28.596 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:28.596 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.596 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.596 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:28.596 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249233+0000", 2024-04-19T03:02:28.596 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:28.596 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.596 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.597 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:28.597 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249231+0000", 2024-04-19T03:02:28.597 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:28.597 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.597 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.597 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:28.597 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249285+0000", 2024-04-19T03:02:28.597 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4005000000000002e-05 2024-04-19T03:02:28.597 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.597 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.597 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:28.597 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249300+0000", 2024-04-19T03:02:28.597 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4715999999999999e-05 2024-04-19T03:02:28.598 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.598 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.598 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:28.598 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249307+0000", 2024-04-19T03:02:28.598 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8399999999999997e-06 2024-04-19T03:02:28.598 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.598 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.598 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:28.598 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249366+0000", 2024-04-19T03:02:28.598 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9435999999999998e-05 2024-04-19T03:02:28.598 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.598 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.598 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op must wait for map", 2024-04-19T03:02:28.599 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249376+0000", 2024-04-19T03:02:28.599 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.4919999999999999e-06 2024-04-19T03:02:28.599 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.599 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.599 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:28.599 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263757+0000", 2024-04-19T03:02:28.599 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.014381461999999999 2024-04-19T03:02:28.599 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.599 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.599 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:02:28.599 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263875+0000", 2024-04-19T03:02:28.599 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000117166 2024-04-19T03:02:28.599 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.599 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.600 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:28.600 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.277136+0000", 2024-04-19T03:02:28.600 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.013261207 2024-04-19T03:02:28.600 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.600 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.600 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:28.600 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.278403+0000", 2024-04-19T03:02:28.600 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001267106 2024-04-19T03:02:28.600 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:28.600 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:28.600 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:28.600 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.600 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.601 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87128 5.6 5:6905c420:::benchmark_data_smithi096_19531_object87127:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:02:28.601 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249323+0000", 2024-04-19T03:02:28.601 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 5.2768274999999996, 2024-04-19T03:02:28.601 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0292813249999999, 2024-04-19T03:02:28.601 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:28.601 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-04-19T03:02:28.601 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:28.601 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:28.601 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:28.601 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87128 2024-04-19T03:02:28.601 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.601 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:28.601 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.601 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:28.601 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249323+0000", 2024-04-19T03:02:28.602 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:28.602 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.602 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.602 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:28.602 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249323+0000", 2024-04-19T03:02:28.602 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:28.602 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.602 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.602 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:28.602 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249323+0000", 2024-04-19T03:02:28.602 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:28.603 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.603 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.603 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:28.603 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249385+0000", 2024-04-19T03:02:28.603 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1711999999999995e-05 2024-04-19T03:02:28.603 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.603 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.603 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:28.603 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249398+0000", 2024-04-19T03:02:28.603 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3022e-05 2024-04-19T03:02:28.603 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.603 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.603 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:28.603 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249402+0000", 2024-04-19T03:02:28.604 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4819999999999996e-06 2024-04-19T03:02:28.604 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.604 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.604 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:28.604 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249437+0000", 2024-04-19T03:02:28.604 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4702000000000001e-05 2024-04-19T03:02:28.604 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.604 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.604 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:02:28.604 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249442+0000", 2024-04-19T03:02:28.604 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8019999999999999e-06 2024-04-19T03:02:28.604 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.604 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.605 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:28.605 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263896+0000", 2024-04-19T03:02:28.605 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.014454679999999999 2024-04-19T03:02:28.605 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.605 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.605 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:02:28.605 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263900+0000", 2024-04-19T03:02:28.605 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9700000000000001e-06 2024-04-19T03:02:28.605 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.605 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.605 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:28.605 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.278557+0000", 2024-04-19T03:02:28.605 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0146566480000001 2024-04-19T03:02:28.605 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.606 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.606 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:28.606 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.278605+0000", 2024-04-19T03:02:28.606 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7735999999999998e-05 2024-04-19T03:02:28.606 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:28.606 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:28.606 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:28.606 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.606 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.606 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87130 5.3 5:c8c2d67b:::benchmark_data_smithi096_19531_object87129:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:02:28.606 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249418+0000", 2024-04-19T03:02:28.607 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 5.2767327890000004, 2024-04-19T03:02:28.607 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.025414182, 2024-04-19T03:02:28.607 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:28.607 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-04-19T03:02:28.607 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:28.607 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:28.607 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:28.607 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87130 2024-04-19T03:02:28.607 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.607 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:28.607 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.607 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:28.607 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249418+0000", 2024-04-19T03:02:28.608 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:28.608 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.608 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.608 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:28.608 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249418+0000", 2024-04-19T03:02:28.608 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:28.608 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.608 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.608 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:28.608 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249409+0000", 2024-04-19T03:02:28.608 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999905 2024-04-19T03:02:28.608 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.608 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.608 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:28.609 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249464+0000", 2024-04-19T03:02:28.609 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5381999999999999e-05 2024-04-19T03:02:28.609 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.609 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.609 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:28.609 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249471+0000", 2024-04-19T03:02:28.609 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2609999999999996e-06 2024-04-19T03:02:28.609 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.609 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.609 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:28.609 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249475+0000", 2024-04-19T03:02:28.609 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2839999999999998e-06 2024-04-19T03:02:28.609 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.609 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.610 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:28.610 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249535+0000", 2024-04-19T03:02:28.610 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0545999999999999e-05 2024-04-19T03:02:28.610 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.610 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.610 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op must wait for map", 2024-04-19T03:02:28.610 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249540+0000", 2024-04-19T03:02:28.610 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2859999999999999e-06 2024-04-19T03:02:28.610 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.610 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.610 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:28.610 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263450+0000", 2024-04-19T03:02:28.610 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.013909585 2024-04-19T03:02:28.611 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.611 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.611 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:02:28.611 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263458+0000", 2024-04-19T03:02:28.611 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8089999999999993e-06 2024-04-19T03:02:28.611 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.611 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.611 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:28.611 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.273193+0000", 2024-04-19T03:02:28.611 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0097351379999999 2024-04-19T03:02:28.611 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.611 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.611 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:28.612 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.274832+0000", 2024-04-19T03:02:28.612 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0016394789999999999 2024-04-19T03:02:28.612 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:28.612 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:28.612 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:28.612 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.612 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.612 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87131 5.1 5:83756d55:::benchmark_data_smithi096_19531_object87130:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:02:28.612 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249491+0000", 2024-04-19T03:02:28.612 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 5.2766601419999999, 2024-04-19T03:02:28.612 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0191489520000001, 2024-04-19T03:02:28.612 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:28.612 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-04-19T03:02:28.612 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:28.613 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:28.613 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:28.613 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87131 2024-04-19T03:02:28.613 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.613 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:28.613 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.613 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:28.613 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249491+0000", 2024-04-19T03:02:28.613 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:28.613 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.613 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.613 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:28.613 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249491+0000", 2024-04-19T03:02:28.614 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:28.614 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.614 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.614 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:28.614 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249491+0000", 2024-04-19T03:02:28.614 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:28.614 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.614 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.614 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:28.614 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249530+0000", 2024-04-19T03:02:28.614 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9589000000000003e-05 2024-04-19T03:02:28.614 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.614 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.615 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:28.615 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249544+0000", 2024-04-19T03:02:28.615 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4158000000000001e-05 2024-04-19T03:02:28.615 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.615 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.615 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:28.615 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249549+0000", 2024-04-19T03:02:28.615 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6809999999999997e-06 2024-04-19T03:02:28.615 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.615 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.615 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:28.615 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249592+0000", 2024-04-19T03:02:28.615 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3285999999999999e-05 2024-04-19T03:02:28.615 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.616 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.616 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op must wait for map", 2024-04-19T03:02:28.616 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249598+0000", 2024-04-19T03:02:28.616 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8329999999999999e-06 2024-04-19T03:02:28.616 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.616 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.616 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:28.616 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263331+0000", 2024-04-19T03:02:28.616 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.013733093 2024-04-19T03:02:28.616 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.616 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.616 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:02:28.616 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263343+0000", 2024-04-19T03:02:28.617 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.189e-05 2024-04-19T03:02:28.617 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.617 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.617 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:28.617 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.268541+0000", 2024-04-19T03:02:28.617 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0051983440000001 2024-04-19T03:02:28.617 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.617 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.617 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:28.617 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.268640+0000", 2024-04-19T03:02:28.617 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.8387999999999994e-05 2024-04-19T03:02:28.617 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:28.617 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:28.617 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:28.617 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.618 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.618 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87132 5.c 5:3e18b732:::benchmark_data_smithi096_19531_object87131:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:02:28.618 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249558+0000", 2024-04-19T03:02:28.618 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 5.2765932409999996, 2024-04-19T03:02:28.618 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0241198380000001, 2024-04-19T03:02:28.618 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:28.618 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-04-19T03:02:28.618 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:28.618 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:28.618 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:28.618 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87132 2024-04-19T03:02:28.618 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.619 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:28.619 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.619 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:28.619 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249558+0000", 2024-04-19T03:02:28.619 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:28.619 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.619 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.619 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:28.619 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249558+0000", 2024-04-19T03:02:28.619 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:28.619 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.619 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.620 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:28.620 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249557+0000", 2024-04-19T03:02:28.620 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:28.620 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.620 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.620 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:28.620 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249625+0000", 2024-04-19T03:02:28.620 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7200999999999996e-05 2024-04-19T03:02:28.620 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.620 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.620 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:28.620 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249646+0000", 2024-04-19T03:02:28.620 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1053e-05 2024-04-19T03:02:28.620 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.621 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.621 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:28.621 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249650+0000", 2024-04-19T03:02:28.621 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2719999999999999e-06 2024-04-19T03:02:28.621 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.621 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.621 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:28.621 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249686+0000", 2024-04-19T03:02:28.621 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6430000000000002e-05 2024-04-19T03:02:28.621 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.621 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.621 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op must wait for map", 2024-04-19T03:02:28.621 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249690+0000", 2024-04-19T03:02:28.621 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.765e-06 2024-04-19T03:02:28.622 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.622 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.622 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:28.622 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261157+0000", 2024-04-19T03:02:28.622 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011467247999999999 2024-04-19T03:02:28.622 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.622 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.622 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:02:28.622 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261170+0000", 2024-04-19T03:02:28.622 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2833000000000001e-05 2024-04-19T03:02:28.622 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.622 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.622 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:28.623 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.272119+0000", 2024-04-19T03:02:28.623 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.010949313 2024-04-19T03:02:28.623 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.623 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.623 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:28.623 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.273678+0000", 2024-04-19T03:02:28.623 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0015581550000000001 2024-04-19T03:02:28.623 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:28.623 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:28.623 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:28.623 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.624 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.624 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87133 5.c 5:3f772a62:::benchmark_data_smithi096_19531_object87132:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:02:28.624 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249657+0000", 2024-04-19T03:02:28.624 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 5.2764938619999997, 2024-04-19T03:02:28.624 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0242819409999999, 2024-04-19T03:02:28.624 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:28.624 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-04-19T03:02:28.624 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:28.624 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:28.624 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:28.624 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87133 2024-04-19T03:02:28.624 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.624 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:28.624 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.625 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:28.625 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249657+0000", 2024-04-19T03:02:28.625 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:28.625 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.625 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.625 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:28.625 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249657+0000", 2024-04-19T03:02:28.625 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:28.625 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.625 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.625 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:28.625 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249657+0000", 2024-04-19T03:02:28.625 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:28.625 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.625 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.626 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:28.626 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249690+0000", 2024-04-19T03:02:28.626 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3343000000000002e-05 2024-04-19T03:02:28.626 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.626 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.626 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:28.626 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249695+0000", 2024-04-19T03:02:28.626 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8600000000000001e-06 2024-04-19T03:02:28.626 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.626 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.626 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:28.626 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249698+0000", 2024-04-19T03:02:28.626 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.1700000000000001e-06 2024-04-19T03:02:28.627 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.627 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.627 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:28.627 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249741+0000", 2024-04-19T03:02:28.627 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2849999999999998e-05 2024-04-19T03:02:28.627 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.627 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.627 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:02:28.627 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249746+0000", 2024-04-19T03:02:28.627 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1019999999999996e-06 2024-04-19T03:02:28.627 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.627 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.627 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:28.628 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261209+0000", 2024-04-19T03:02:28.628 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011462447000000001 2024-04-19T03:02:28.628 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.628 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.628 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:02:28.628 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261216+0000", 2024-04-19T03:02:28.628 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8520000000000004e-06 2024-04-19T03:02:28.628 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.628 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.628 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:28.628 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.273872+0000", 2024-04-19T03:02:28.628 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0126558000000001 2024-04-19T03:02:28.629 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.629 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.629 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:28.629 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.273939+0000", 2024-04-19T03:02:28.629 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6822000000000005e-05 2024-04-19T03:02:28.629 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:28.629 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:28.629 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:28.629 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.629 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.629 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87134 5.5 5:a56c478f:::benchmark_data_smithi096_19531_object87133:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:02:28.629 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249708+0000", 2024-04-19T03:02:28.629 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 5.2764429379999997, 2024-04-19T03:02:28.630 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0214677299999999, 2024-04-19T03:02:28.630 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:28.630 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-04-19T03:02:28.630 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:28.630 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:28.630 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:28.630 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87134 2024-04-19T03:02:28.630 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.630 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:28.630 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.630 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:28.630 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249708+0000", 2024-04-19T03:02:28.631 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:28.631 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.633 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.633 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:28.633 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249708+0000", 2024-04-19T03:02:28.634 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:28.634 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.634 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.634 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:28.634 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249706+0000", 2024-04-19T03:02:28.634 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999976 2024-04-19T03:02:28.634 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.634 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.634 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:28.634 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249740+0000", 2024-04-19T03:02:28.634 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4458000000000001e-05 2024-04-19T03:02:28.634 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.634 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.635 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:28.635 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249745+0000", 2024-04-19T03:02:28.635 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5020000000000003e-06 2024-04-19T03:02:28.635 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.635 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.635 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:28.635 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249748+0000", 2024-04-19T03:02:28.635 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2499999999999998e-06 2024-04-19T03:02:28.635 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.635 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.635 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:28.635 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249778+0000", 2024-04-19T03:02:28.635 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.006e-05 2024-04-19T03:02:28.636 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.636 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.636 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op must wait for map", 2024-04-19T03:02:28.636 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249782+0000", 2024-04-19T03:02:28.636 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2910000000000001e-06 2024-04-19T03:02:28.636 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.636 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.636 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:28.636 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261666+0000", 2024-04-19T03:02:28.636 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011883471 2024-04-19T03:02:28.636 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.636 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.636 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:02:28.637 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261674+0000", 2024-04-19T03:02:28.637 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6479999999999992e-06 2024-04-19T03:02:28.637 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.637 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.637 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:28.637 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.269323+0000", 2024-04-19T03:02:28.637 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.00764867 2024-04-19T03:02:28.637 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.637 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.637 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:28.637 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.271176+0000", 2024-04-19T03:02:28.637 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001852844 2024-04-19T03:02:28.637 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:28.638 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:28.638 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:28.638 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.638 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.638 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87137 5.c 5:30708c68:::benchmark_data_smithi096_19531_object87136:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:02:28.638 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249756+0000", 2024-04-19T03:02:28.638 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 5.2763952319999996, 2024-04-19T03:02:28.638 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.033331752, 2024-04-19T03:02:28.638 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:28.638 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:28.638 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:28.638 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:28.638 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:28.639 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87137 2024-04-19T03:02:28.639 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.639 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:28.639 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.639 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:28.639 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249756+0000", 2024-04-19T03:02:28.639 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:28.639 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.639 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.639 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:28.639 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249756+0000", 2024-04-19T03:02:28.639 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:28.639 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.640 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.640 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:28.640 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249755+0000", 2024-04-19T03:02:28.640 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:28.640 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.640 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.640 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:28.640 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249777+0000", 2024-04-19T03:02:28.640 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1420000000000002e-05 2024-04-19T03:02:28.640 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.640 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.640 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:28.640 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249781+0000", 2024-04-19T03:02:28.640 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0609999999999997e-06 2024-04-19T03:02:28.641 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.641 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.641 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:28.641 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249787+0000", 2024-04-19T03:02:28.641 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.02e-06 2024-04-19T03:02:28.641 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.641 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.641 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:28.641 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249818+0000", 2024-04-19T03:02:28.641 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0947e-05 2024-04-19T03:02:28.641 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.641 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.641 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:02:28.642 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249821+0000", 2024-04-19T03:02:28.642 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.117e-06 2024-04-19T03:02:28.642 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.642 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.642 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:28.642 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261243+0000", 2024-04-19T03:02:28.642 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011421875999999999 2024-04-19T03:02:28.642 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.642 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.642 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:02:28.642 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261251+0000", 2024-04-19T03:02:28.642 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6120000000000001e-06 2024-04-19T03:02:28.642 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.642 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.643 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:28.643 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.274050+0000", 2024-04-19T03:02:28.643 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.012799405 2024-04-19T03:02:28.643 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.643 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.643 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:28.643 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.274529+0000", 2024-04-19T03:02:28.643 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00047867100000000001 2024-04-19T03:02:28.643 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.643 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.643 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:28.643 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.282972+0000", 2024-04-19T03:02:28.643 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0084436900000000002 2024-04-19T03:02:28.644 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.644 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.644 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:28.644 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.283022+0000", 2024-04-19T03:02:28.644 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9339000000000003e-05 2024-04-19T03:02:28.644 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:28.644 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:28.644 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:28.645 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.283088+0000", 2024-04-19T03:02:28.645 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5877999999999995e-05 2024-04-19T03:02:28.645 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:28.645 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:28.645 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:28.645 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:28.645 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:28.645 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-04-19T03:02:28.647 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:28.645+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:28.647 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T03:02:28.748 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:28.745+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:28.778 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-19T03:02:28.778 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-04-19T03:02:28.778 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:28.778 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:95789 5.4 5:2353eae6:::benchmark_data_smithi096_19531_object95788:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-19T03:02:28.778 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:28.769177+0000", 2024-04-19T03:02:28.778 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0085079100000000005, 2024-04-19T03:02:28.778 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0085289939999999998, 2024-04-19T03:02:28.778 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:28.778 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-19T03:02:28.778 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:28.779 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:28.779 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:28.779 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 95789 2024-04-19T03:02:28.779 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:28.779 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:28.779 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:28.779 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:28.779 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:28.769177+0000", 2024-04-19T03:02:28.779 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:28.779 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:28.779 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:28.779 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:28.780 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:28.769177+0000", 2024-04-19T03:02:28.780 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:28.780 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:28.780 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:28.780 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:28.780 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:28.769176+0000", 2024-04-19T03:02:28.780 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:28.780 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:28.780 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:28.780 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:28.780 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:28.769235+0000", 2024-04-19T03:02:28.780 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8721000000000002e-05 2024-04-19T03:02:28.780 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:28.781 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:28.781 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:28.781 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:28.769244+0000", 2024-04-19T03:02:28.781 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9910000000000008e-06 2024-04-19T03:02:28.781 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:28.781 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:28.781 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:28.781 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:28.769250+0000", 2024-04-19T03:02:28.781 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7850000000000003e-06 2024-04-19T03:02:28.781 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:28.781 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:28.781 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:28.781 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:28.772248+0000", 2024-04-19T03:02:28.782 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0029974509999999999 2024-04-19T03:02:28.782 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:28.782 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:28.782 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:28.782 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:28.772416+0000", 2024-04-19T03:02:28.782 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000168655 2024-04-19T03:02:28.782 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:28.782 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:28.782 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:28.782 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:28.782 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:28.782 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:95791 5.0 5:01aa0d55:::benchmark_data_smithi096_19531_object95790:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-19T03:02:28.782 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:28.770799+0000", 2024-04-19T03:02:28.783 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0068853550000000001, 2024-04-19T03:02:28.783 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0069581369999999997, 2024-04-19T03:02:28.783 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:28.783 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-19T03:02:28.783 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:28.783 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:28.783 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:28.783 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 95791 2024-04-19T03:02:28.783 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:28.783 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:28.783 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:28.783 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:28.783 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:28.770799+0000", 2024-04-19T03:02:28.783 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:28.784 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:28.784 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:28.784 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:28.784 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:28.770799+0000", 2024-04-19T03:02:28.784 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:28.784 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:28.784 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:28.784 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:28.784 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:28.770798+0000", 2024-04-19T03:02:28.784 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:28.784 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:28.784 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:28.784 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:28.784 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:28.770859+0000", 2024-04-19T03:02:28.785 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0633e-05 2024-04-19T03:02:28.785 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:28.785 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:28.785 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:28.785 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:28.770869+0000", 2024-04-19T03:02:28.785 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0278000000000001e-05 2024-04-19T03:02:28.785 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:28.785 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:28.785 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:28.785 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:28.770874+0000", 2024-04-19T03:02:28.785 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7770000000000002e-06 2024-04-19T03:02:28.785 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:28.785 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:28.786 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:28.786 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:28.770925+0000", 2024-04-19T03:02:28.786 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0572000000000003e-05 2024-04-19T03:02:28.786 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:28.786 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:28.786 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:28.786 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:28.771066+0000", 2024-04-19T03:02:28.786 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014128200000000001 2024-04-19T03:02:28.786 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:28.786 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:28.786 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:28.786 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:28.786 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:28.787 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:95792 5.a 5:513dd93e:::benchmark_data_smithi096_19531_object95791:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-19T03:02:28.787 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:28.770887+0000", 2024-04-19T03:02:28.787 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0067971940000000003, 2024-04-19T03:02:28.787 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.006910401, 2024-04-19T03:02:28.787 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:28.787 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-19T03:02:28.787 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:28.787 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:28.787 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:28.787 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 95792 2024-04-19T03:02:28.787 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:28.787 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:28.787 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:28.787 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:28.788 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:28.770887+0000", 2024-04-19T03:02:28.788 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:28.788 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:28.788 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:28.788 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:28.788 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:28.770887+0000", 2024-04-19T03:02:28.788 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:28.788 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:28.788 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:28.788 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:28.788 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:28.770886+0000", 2024-04-19T03:02:28.788 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:28.788 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:28.788 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:28.789 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:28.789 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:28.770937+0000", 2024-04-19T03:02:28.789 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0797999999999997e-05 2024-04-19T03:02:28.789 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:28.789 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:28.789 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:28.789 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:28.770946+0000", 2024-04-19T03:02:28.789 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.7050000000000005e-06 2024-04-19T03:02:28.789 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:28.789 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:28.789 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:28.789 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:28.770952+0000", 2024-04-19T03:02:28.790 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1670000000000004e-06 2024-04-19T03:02:28.790 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:28.790 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:28.790 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:28.790 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:28.772341+0000", 2024-04-19T03:02:28.790 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0013888069999999999 2024-04-19T03:02:28.790 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:28.790 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:28.790 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:28.790 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:28.772491+0000", 2024-04-19T03:02:28.790 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015021500000000001 2024-04-19T03:02:28.791 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:28.791 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:28.791 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:28.791 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:28.791 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:28.791 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:95797 5.e 5:762022c4:::benchmark_data_smithi096_19531_object95796:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-19T03:02:28.791 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:28.773016+0000", 2024-04-19T03:02:28.791 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0046687780000000002, 2024-04-19T03:02:28.791 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0048174079999999996, 2024-04-19T03:02:28.791 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:28.791 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-19T03:02:28.791 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:28.791 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:28.791 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:28.792 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 95797 2024-04-19T03:02:28.792 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:28.792 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:28.792 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:28.792 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:28.792 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:28.773016+0000", 2024-04-19T03:02:28.792 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:28.792 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:28.792 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:28.792 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:28.792 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:28.773016+0000", 2024-04-19T03:02:28.792 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:28.792 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:28.792 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:28.793 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:28.793 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:28.773015+0000", 2024-04-19T03:02:28.793 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:28.793 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:28.793 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:28.793 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:28.793 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:28.773064+0000", 2024-04-19T03:02:28.793 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9681000000000001e-05 2024-04-19T03:02:28.793 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:28.793 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:28.793 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:28.793 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:28.773081+0000", 2024-04-19T03:02:28.793 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6469000000000001e-05 2024-04-19T03:02:28.793 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:28.794 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:28.794 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:28.794 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:28.773093+0000", 2024-04-19T03:02:28.794 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2687999999999999e-05 2024-04-19T03:02:28.794 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:28.794 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:28.794 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:28.794 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:28.773153+0000", 2024-04-19T03:02:28.794 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9789e-05 2024-04-19T03:02:28.794 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:28.794 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:28.794 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:28.794 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:28.773292+0000", 2024-04-19T03:02:28.794 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013893299999999999 2024-04-19T03:02:28.795 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:28.795 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:28.795 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:28.795 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:28.795 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:28.795 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4755.0:95786 5.f e45/22 5:f6775c51:::benchmark_data_smithi096_19531_object95785:head v 45'5948, mlcod=45'5944)", 2024-04-19T03:02:28.795 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:28.773219+0000", 2024-04-19T03:02:28.795 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0044650849999999997, 2024-04-19T03:02:28.795 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0046510190000000002, 2024-04-19T03:02:28.795 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:28.795 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-19T03:02:28.795 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:28.795 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:28.796 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:28.796 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:28.773219+0000", 2024-04-19T03:02:28.796 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:28.796 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:28.796 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:28.796 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:28.796 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:28.773219+0000", 2024-04-19T03:02:28.796 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:28.796 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:28.796 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:28.796 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:28.796 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:28.773219+0000", 2024-04-19T03:02:28.796 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:28.796 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:28.797 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:28.797 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:28.797 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:28.773293+0000", 2024-04-19T03:02:28.797 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4636999999999997e-05 2024-04-19T03:02:28.797 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:28.797 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:28.797 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:28.797 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:28.773302+0000", 2024-04-19T03:02:28.797 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.8920000000000006e-06 2024-04-19T03:02:28.797 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:28.797 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:28.797 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:28.797 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:28.773308+0000", 2024-04-19T03:02:28.798 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9139999999999996e-06 2024-04-19T03:02:28.798 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:28.798 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:28.798 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:28.798 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:28.774996+0000", 2024-04-19T03:02:28.798 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001687453 2024-04-19T03:02:28.798 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:28.798 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:28.798 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:28.798 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:28.775016+0000", 2024-04-19T03:02:28.798 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0103e-05 2024-04-19T03:02:28.798 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:28.798 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:28.799 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:28.799 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:28.799 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:28.799 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:95800 5.0 5:0742136f:::benchmark_data_smithi096_19531_object95799:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-19T03:02:28.799 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:28.776105+0000", 2024-04-19T03:02:28.799 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0015797420000000001, 2024-04-19T03:02:28.799 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0018003209999999999, 2024-04-19T03:02:28.799 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:28.799 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-19T03:02:28.799 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:28.799 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:28.799 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:28.799 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 95800 2024-04-19T03:02:28.799 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:28.800 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:28.800 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:28.800 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:28.800 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:28.776105+0000", 2024-04-19T03:02:28.800 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:28.800 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:28.800 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:28.800 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:28.800 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:28.776105+0000", 2024-04-19T03:02:28.800 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:28.800 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:28.800 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:28.800 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:28.801 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:28.776104+0000", 2024-04-19T03:02:28.801 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:28.801 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:28.801 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:28.801 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:28.801 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:28.776153+0000", 2024-04-19T03:02:28.801 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8915000000000002e-05 2024-04-19T03:02:28.801 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:28.801 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:28.801 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:28.801 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:28.776162+0000", 2024-04-19T03:02:28.801 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.4190000000000008e-06 2024-04-19T03:02:28.801 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:28.802 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:28.802 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:28.802 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:28.776168+0000", 2024-04-19T03:02:28.802 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8819999999999998e-06 2024-04-19T03:02:28.802 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:28.802 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:28.802 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:28.802 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:28.776213+0000", 2024-04-19T03:02:28.802 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4842999999999997e-05 2024-04-19T03:02:28.802 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:28.802 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:28.802 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:28.802 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:28.776336+0000", 2024-04-19T03:02:28.803 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012346300000000001 2024-04-19T03:02:28.803 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:28.803 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:28.803 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:28.803 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:28.803 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:28.803 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4755.0:95801 5.9 e45/22 5:9b70fd7f:::benchmark_data_smithi096_19531_object95800:head v 45'5908, mlcod=45'5906)", 2024-04-19T03:02:28.803 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:28.777277+0000", 2024-04-19T03:02:28.803 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.00040770599999999998, 2024-04-19T03:02:28.803 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00066036000000000003, 2024-04-19T03:02:28.803 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:28.803 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-19T03:02:28.803 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:28.804 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:28.804 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:28.804 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:28.777277+0000", 2024-04-19T03:02:28.804 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:28.804 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:28.804 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:28.804 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:28.804 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:28.777277+0000", 2024-04-19T03:02:28.804 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:28.804 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:28.804 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:28.804 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:28.804 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:28.777276+0000", 2024-04-19T03:02:28.805 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:28.805 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:28.805 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:28.805 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:28.805 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:28.777328+0000", 2024-04-19T03:02:28.805 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1854999999999997e-05 2024-04-19T03:02:28.805 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:28.805 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:28.805 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:28.805 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:28.777335+0000", 2024-04-19T03:02:28.805 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.486e-06 2024-04-19T03:02:28.805 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:28.805 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:28.805 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:28.806 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:28.777340+0000", 2024-04-19T03:02:28.806 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0950000000000003e-06 2024-04-19T03:02:28.806 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:28.806 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:28.806 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:28.806 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:28.777379+0000", 2024-04-19T03:02:28.806 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8559999999999997e-05 2024-04-19T03:02:28.806 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:28.806 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:28.806 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:28.806 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:28.777393+0000", 2024-04-19T03:02:28.806 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3998e-05 2024-04-19T03:02:28.807 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:28.807 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:28.807 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:28.807 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:28.807 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:28.807 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:95802 5.4 5:216ca698:::benchmark_data_smithi096_19531_object95801:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2024-04-19T03:02:28.807 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:28.777539+0000", 2024-04-19T03:02:28.807 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.00014553299999999999, 2024-04-19T03:02:28.807 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00043169999999999998, 2024-04-19T03:02:28.807 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:28.807 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-19T03:02:28.807 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:28.807 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:28.808 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:28.808 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 95802 2024-04-19T03:02:28.808 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:28.808 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:28.808 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:28.808 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:28.808 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:28.777539+0000", 2024-04-19T03:02:28.808 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:28.808 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:28.808 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:28.808 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:28.808 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:28.777539+0000", 2024-04-19T03:02:28.809 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:28.809 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:28.809 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:28.809 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:28.809 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:28.777538+0000", 2024-04-19T03:02:28.809 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:28.809 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:28.809 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:28.809 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:28.809 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:28.777577+0000", 2024-04-19T03:02:28.809 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9026999999999998e-05 2024-04-19T03:02:28.809 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:28.809 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:28.810 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:28.810 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:28.777586+0000", 2024-04-19T03:02:28.810 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.0469999999999999e-06 2024-04-19T03:02:28.810 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:28.810 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:28.810 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:28.810 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:28.777592+0000", 2024-04-19T03:02:28.810 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.609e-06 2024-04-19T03:02:28.810 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:28.810 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:28.810 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:28.810 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:28.777633+0000", 2024-04-19T03:02:28.810 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.0760999999999998e-05 2024-04-19T03:02:28.811 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:28.811 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:28.811 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:28.811 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:28.777742+0000", 2024-04-19T03:02:28.811 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010954399999999999 2024-04-19T03:02:28.811 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:28.811 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:28.811 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:28.811 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:28.811 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-04-19T03:02:28.811 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 8 2024-04-19T03:02:28.811 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-19T03:02:28.812 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-19T03:02:28.813 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T03:02:28.825 INFO:tasks.radosbench.radosbench.0.smithi096.stdout: 51 16 95908 95892 117.501 122.375 0.00474556 0.00850483 2024-04-19T03:02:28.848 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:28.847+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:28.938 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-19T03:02:28.938 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-04-19T03:02:28.938 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-04-19T03:02:28.938 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-04-19T03:02:28.939 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-19T03:02:28.949 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:28.945+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:28.951 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T03:02:28.970 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1: {} 2024-04-19T03:02:28.990 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2: {} 2024-04-19T03:02:28.991 INFO:teuthology.orchestra.run.smithi096.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-04-19T03:02:28.991 INFO:teuthology.orchestra.run.smithi096.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-19T03:02:28.991 INFO:teuthology.orchestra.run.smithi096.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-19T03:02:28.994 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-19T03:02:28.995 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-19T03:02:29.049 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:29.047+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:29.074 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-19T03:02:29.074 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:02:29.088 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T03:02:29.150 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:29.147+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:29.218 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-04-19T03:02:29.218 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:02:29.231 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T03:02:29.250 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~0s 2024-04-19T03:02:29.251 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:29.247+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:29.317 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-19T03:02:29.351 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:29.349+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:29.360 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-04-19T03:02:29.360 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:02:29.372 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T03:02:29.452 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:29.451+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:29.497 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-04-19T03:02:29.497 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:02:29.508 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T03:02:29.552 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:29.551+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:29.633 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-19T03:02:29.633 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:02:29.647 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T03:02:29.653 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:29.649+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:29.754 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:29.753+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:29.773 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-19T03:02:29.773 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:02:29.786 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T03:02:29.825 INFO:tasks.radosbench.radosbench.0.smithi096.stdout: 52 16 97834 97818 117.556 120.375 0.00414102 0.00850087 2024-04-19T03:02:29.854 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:29.853+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:29.909 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-19T03:02:29.909 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:02:29.922 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T03:02:29.966 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:29.965+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:30.055 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-04-19T03:02:30.055 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:02:30.056 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:30.053+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:30.068 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T03:02:30.157 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:30.155+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:30.194 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-04-19T03:02:30.194 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:02:30.209 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T03:02:30.257 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:30.255+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:30.328 INFO:teuthology.orchestra.run.smithi096.stderr:noscrub is unset 2024-04-19T03:02:30.346 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-04-19T03:02:30.346 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:02:30.358 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:30.355+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:30.359 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T03:02:30.459 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:30.457+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:30.491 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-19T03:02:30.492 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:02:30.506 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T03:02:30.559 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:30.555+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:30.627 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-19T03:02:30.627 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:02:30.641 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T03:02:30.660 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:30.659+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:30.760 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:30.757+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:30.765 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-19T03:02:30.766 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:02:30.779 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T03:02:30.825 INFO:tasks.radosbench.radosbench.0.smithi096.stdout: 53 16 99713 99697 117.554 117.438 0.0118754 0.00850043 2024-04-19T03:02:30.861 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:30.859+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:30.909 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-04-19T03:02:30.909 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:02:30.921 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T03:02:30.962 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:30.959+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:30.996 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-19T03:02:31.052 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-04-19T03:02:31.052 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:02:31.063 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:31.061+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:31.068 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T03:02:31.152 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1: {} 2024-04-19T03:02:31.164 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:31.163+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:31.172 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2: {} 2024-04-19T03:02:31.172 INFO:teuthology.orchestra.run.smithi096.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-04-19T03:02:31.173 INFO:teuthology.orchestra.run.smithi096.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-19T03:02:31.173 INFO:teuthology.orchestra.run.smithi096.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-19T03:02:31.177 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-19T03:02:31.177 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-19T03:02:31.208 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-04-19T03:02:31.208 INFO:teuthology.orchestra.run.smithi144.stdout: "size": 20, 2024-04-19T03:02:31.208 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 600, 2024-04-19T03:02:31.208 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [ 2024-04-19T03:02:31.209 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.209 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:78992 5.7 5:e6baa862:::benchmark_data_smithi096_19531_object78991:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-19T03:02:31.209 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:18.008888+0000", 2024-04-19T03:02:31.209 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 13.196867572, 2024-04-19T03:02:31.209 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.056375285999999997, 2024-04-19T03:02:31.209 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:31.209 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:31.209 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:31.209 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:31.209 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:31.209 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 78992 2024-04-19T03:02:31.209 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.209 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:31.209 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.210 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:31.210 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.008888+0000", 2024-04-19T03:02:31.210 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:31.210 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.210 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.210 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:31.210 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.008888+0000", 2024-04-19T03:02:31.211 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:31.211 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.211 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.211 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:31.211 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.008888+0000", 2024-04-19T03:02:31.211 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:31.211 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.211 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.211 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:31.211 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.008928+0000", 2024-04-19T03:02:31.211 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0361999999999997e-05 2024-04-19T03:02:31.211 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.211 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.212 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:31.212 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.008942+0000", 2024-04-19T03:02:31.212 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4365000000000001e-05 2024-04-19T03:02:31.212 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.212 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.212 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:31.212 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.008949+0000", 2024-04-19T03:02:31.212 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.212e-06 2024-04-19T03:02:31.212 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.212 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.212 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:31.212 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.012683+0000", 2024-04-19T03:02:31.212 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.003733934 2024-04-19T03:02:31.213 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.213 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.213 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:31.213 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.012798+0000", 2024-04-19T03:02:31.213 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00011574999999999999 2024-04-19T03:02:31.213 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.213 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.213 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:31.213 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.012896+0000", 2024-04-19T03:02:31.213 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.7848000000000002e-05 2024-04-19T03:02:31.213 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.213 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.213 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:31.213 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016423+0000", 2024-04-19T03:02:31.214 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0035270789999999998 2024-04-19T03:02:31.214 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.214 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.214 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:31.214 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.065098+0000", 2024-04-19T03:02:31.214 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.048674651999999999 2024-04-19T03:02:31.214 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.214 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.214 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:31.214 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.065193+0000", 2024-04-19T03:02:31.214 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.5087999999999995e-05 2024-04-19T03:02:31.214 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.214 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.215 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:31.215 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.065264+0000", 2024-04-19T03:02:31.215 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0666000000000004e-05 2024-04-19T03:02:31.215 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:31.215 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:31.215 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:31.215 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.215 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.215 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:78998 5.7 5:ee23c1bc:::benchmark_data_smithi096_19531_object78997:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-19T03:02:31.215 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:18.013165+0000", 2024-04-19T03:02:31.215 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 13.192590866, 2024-04-19T03:02:31.215 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.052410864000000001, 2024-04-19T03:02:31.215 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:31.215 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:31.216 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:31.216 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:31.216 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:31.216 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 78998 2024-04-19T03:02:31.216 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.216 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:31.216 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.216 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:31.216 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.013165+0000", 2024-04-19T03:02:31.216 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:31.216 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.216 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.216 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:31.217 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.013165+0000", 2024-04-19T03:02:31.217 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:31.217 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.217 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.217 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:31.217 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.013164+0000", 2024-04-19T03:02:31.217 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:31.217 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.217 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.217 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:31.217 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.013214+0000", 2024-04-19T03:02:31.217 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9636999999999999e-05 2024-04-19T03:02:31.217 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.217 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.218 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:31.218 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.013223+0000", 2024-04-19T03:02:31.218 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.3619999999999995e-06 2024-04-19T03:02:31.218 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.218 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.218 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:31.218 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.013229+0000", 2024-04-19T03:02:31.218 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6060000000000002e-06 2024-04-19T03:02:31.218 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.218 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.218 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:31.218 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.014882+0000", 2024-04-19T03:02:31.218 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001653257 2024-04-19T03:02:31.219 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.219 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.219 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:31.219 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.014958+0000", 2024-04-19T03:02:31.219 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6398999999999998e-05 2024-04-19T03:02:31.219 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.219 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.219 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:31.219 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.015036+0000", 2024-04-19T03:02:31.219 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8070000000000003e-05 2024-04-19T03:02:31.219 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.219 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.219 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:31.219 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018099+0000", 2024-04-19T03:02:31.220 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0030631149999999999 2024-04-19T03:02:31.220 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.220 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.220 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:31.220 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.065328+0000", 2024-04-19T03:02:31.220 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.047228349000000003 2024-04-19T03:02:31.220 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.220 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.220 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:31.220 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.065508+0000", 2024-04-19T03:02:31.220 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00018036899999999999 2024-04-19T03:02:31.220 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.220 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.220 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:31.220 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.065576+0000", 2024-04-19T03:02:31.221 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7785000000000002e-05 2024-04-19T03:02:31.221 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:31.221 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:31.221 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:31.221 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.221 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.221 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4755.0:78995 5.2 e40/39 5:42b55e12:::benchmark_data_smithi096_19531_object78994:head v 40'4934, mlcod=40'4932)", 2024-04-19T03:02:31.221 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:18.016247+0000", 2024-04-19T03:02:31.221 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 13.189508904, 2024-04-19T03:02:31.221 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.056240406, 2024-04-19T03:02:31.221 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:31.221 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:31.221 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:31.221 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.222 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:31.222 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016247+0000", 2024-04-19T03:02:31.222 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:31.222 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.222 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.222 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:31.222 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016247+0000", 2024-04-19T03:02:31.222 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:31.222 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.222 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.222 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:31.222 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016246+0000", 2024-04-19T03:02:31.222 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:31.223 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.223 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.223 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:31.223 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016315+0000", 2024-04-19T03:02:31.223 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8979000000000005e-05 2024-04-19T03:02:31.223 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.223 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.223 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:31.223 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016333+0000", 2024-04-19T03:02:31.223 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7586999999999999e-05 2024-04-19T03:02:31.223 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.223 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.223 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:31.224 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016340+0000", 2024-04-19T03:02:31.224 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4080000000000001e-06 2024-04-19T03:02:31.224 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.224 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.224 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:31.224 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016384+0000", 2024-04-19T03:02:31.224 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3656999999999999e-05 2024-04-19T03:02:31.224 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.224 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.224 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:31.224 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016403+0000", 2024-04-19T03:02:31.224 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9089e-05 2024-04-19T03:02:31.224 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.224 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.225 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:31.225 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.072448+0000", 2024-04-19T03:02:31.225 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.056045084000000002 2024-04-19T03:02:31.225 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.225 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.225 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:31.225 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.072487+0000", 2024-04-19T03:02:31.225 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9362e-05 2024-04-19T03:02:31.225 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:31.225 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:31.225 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:31.225 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.225 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.225 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4755.0:78994 5.c e40/22 5:3c60d55d:::benchmark_data_smithi096_19531_object78993:head v 40'4989, mlcod=40'4987)", 2024-04-19T03:02:31.226 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:18.016392+0000", 2024-04-19T03:02:31.226 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 13.189364263, 2024-04-19T03:02:31.226 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.052629620000000002, 2024-04-19T03:02:31.226 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:31.226 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:31.226 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:31.226 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.226 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:31.226 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016392+0000", 2024-04-19T03:02:31.226 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:31.226 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.226 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.227 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:31.227 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016392+0000", 2024-04-19T03:02:31.227 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:31.227 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.227 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.227 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:31.227 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016391+0000", 2024-04-19T03:02:31.227 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:31.227 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.227 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.227 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:31.227 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016471+0000", 2024-04-19T03:02:31.227 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9346999999999998e-05 2024-04-19T03:02:31.228 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.228 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.228 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:31.228 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016478+0000", 2024-04-19T03:02:31.228 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.593e-06 2024-04-19T03:02:31.228 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.228 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.228 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:31.228 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016495+0000", 2024-04-19T03:02:31.228 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6492999999999999e-05 2024-04-19T03:02:31.228 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.228 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.228 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:31.228 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016539+0000", 2024-04-19T03:02:31.229 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4715999999999997e-05 2024-04-19T03:02:31.229 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.229 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.229 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:31.229 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016551+0000", 2024-04-19T03:02:31.229 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2096000000000001e-05 2024-04-19T03:02:31.229 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.229 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.229 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:31.229 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.068985+0000", 2024-04-19T03:02:31.229 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.052433754999999999 2024-04-19T03:02:31.229 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.229 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.229 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:31.230 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.069021+0000", 2024-04-19T03:02:31.230 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6047000000000002e-05 2024-04-19T03:02:31.230 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:31.230 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:31.230 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:31.230 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.230 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.230 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4755.0:78996 5.1 e40/39 5:87f59708:::benchmark_data_smithi096_19531_object78995:head v 40'4940, mlcod=40'4938)", 2024-04-19T03:02:31.230 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:18.016581+0000", 2024-04-19T03:02:31.230 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 13.189175098, 2024-04-19T03:02:31.230 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.052051785000000003, 2024-04-19T03:02:31.230 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:31.231 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:31.231 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:31.231 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.231 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:31.231 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016581+0000", 2024-04-19T03:02:31.231 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:31.231 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.231 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.231 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:31.231 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016581+0000", 2024-04-19T03:02:31.231 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:31.231 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.231 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.231 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:31.232 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016581+0000", 2024-04-19T03:02:31.232 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:31.232 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.232 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.232 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:31.232 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016610+0000", 2024-04-19T03:02:31.232 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9556999999999998e-05 2024-04-19T03:02:31.232 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.232 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.232 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:31.232 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016616+0000", 2024-04-19T03:02:31.232 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1090000000000003e-06 2024-04-19T03:02:31.232 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.233 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.233 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:31.233 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016621+0000", 2024-04-19T03:02:31.233 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.454e-06 2024-04-19T03:02:31.233 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.233 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.233 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:31.233 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016663+0000", 2024-04-19T03:02:31.233 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2582e-05 2024-04-19T03:02:31.233 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.233 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.233 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:31.233 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016681+0000", 2024-04-19T03:02:31.233 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7680999999999999e-05 2024-04-19T03:02:31.234 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.234 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.234 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:31.234 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.068486+0000", 2024-04-19T03:02:31.234 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.051804624000000001 2024-04-19T03:02:31.234 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.234 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.234 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:31.234 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.068633+0000", 2024-04-19T03:02:31.234 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00014709099999999999 2024-04-19T03:02:31.234 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:31.234 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:31.234 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:31.235 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.235 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.235 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4755.0:78999 5.3 e40/22 5:c9ec5f7f:::benchmark_data_smithi096_19531_object78998:head v 40'4893, mlcod=40'4889)", 2024-04-19T03:02:31.235 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:18.016633+0000", 2024-04-19T03:02:31.235 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 13.189123242999999, 2024-04-19T03:02:31.235 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.051090469999999999, 2024-04-19T03:02:31.235 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:31.235 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:31.235 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:31.235 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.235 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:31.235 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016633+0000", 2024-04-19T03:02:31.235 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:31.235 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.236 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.236 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:31.236 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016633+0000", 2024-04-19T03:02:31.236 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:31.236 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.236 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.236 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:31.236 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016632+0000", 2024-04-19T03:02:31.236 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967296 2024-04-19T03:02:31.236 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.236 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.236 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:31.236 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016660+0000", 2024-04-19T03:02:31.237 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7869999999999999e-05 2024-04-19T03:02:31.237 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.237 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.237 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:31.237 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016667+0000", 2024-04-19T03:02:31.237 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0280000000000003e-06 2024-04-19T03:02:31.237 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.237 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.237 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:31.237 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016672+0000", 2024-04-19T03:02:31.237 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0069999999999997e-06 2024-04-19T03:02:31.237 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.237 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.237 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:31.238 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016725+0000", 2024-04-19T03:02:31.238 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2812000000000002e-05 2024-04-19T03:02:31.238 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.238 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.238 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:31.238 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016750+0000", 2024-04-19T03:02:31.238 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5038e-05 2024-04-19T03:02:31.238 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.238 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.238 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:31.238 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.067673+0000", 2024-04-19T03:02:31.238 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.050922350999999998 2024-04-19T03:02:31.238 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.239 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.239 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:31.239 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.067723+0000", 2024-04-19T03:02:31.239 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0586e-05 2024-04-19T03:02:31.239 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:31.239 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:31.239 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:31.239 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.239 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.239 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4755.0:79003 5.2 e40/39 5:4436e33f:::benchmark_data_smithi096_19531_object79002:head v 40'4935, mlcod=40'4932)", 2024-04-19T03:02:31.239 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:18.018102+0000", 2024-04-19T03:02:31.239 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 13.187653515999999, 2024-04-19T03:02:31.239 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.060023990999999999, 2024-04-19T03:02:31.239 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:31.240 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:31.240 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:31.240 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.240 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:31.240 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018102+0000", 2024-04-19T03:02:31.240 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:31.240 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.240 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.240 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:31.240 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018102+0000", 2024-04-19T03:02:31.240 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:31.240 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.240 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.240 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:31.240 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018102+0000", 2024-04-19T03:02:31.241 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:31.241 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.241 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.241 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:31.241 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018134+0000", 2024-04-19T03:02:31.241 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2722000000000003e-05 2024-04-19T03:02:31.241 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.241 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.241 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:31.241 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018145+0000", 2024-04-19T03:02:31.241 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0395e-05 2024-04-19T03:02:31.241 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.241 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.241 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:31.242 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018151+0000", 2024-04-19T03:02:31.242 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5300000000000002e-06 2024-04-19T03:02:31.242 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.242 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.242 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:31.242 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018489+0000", 2024-04-19T03:02:31.242 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00033731499999999998 2024-04-19T03:02:31.242 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.242 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.242 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:31.242 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018508+0000", 2024-04-19T03:02:31.242 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9775e-05 2024-04-19T03:02:31.243 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.243 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.243 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:31.243 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.078059+0000", 2024-04-19T03:02:31.243 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.059550171999999998 2024-04-19T03:02:31.243 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.243 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.243 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:31.243 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.078126+0000", 2024-04-19T03:02:31.243 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7773000000000003e-05 2024-04-19T03:02:31.243 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:31.243 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:31.243 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:31.243 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.244 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.244 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4755.0:79005 5.1 e40/39 5:85b46038:::benchmark_data_smithi096_19531_object79004:head v 40'4941, mlcod=40'4938)", 2024-04-19T03:02:31.244 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:18.018167+0000", 2024-04-19T03:02:31.244 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 13.187588797, 2024-04-19T03:02:31.244 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.052768941999999999, 2024-04-19T03:02:31.244 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:31.244 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:31.244 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:31.244 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.244 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:31.244 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018167+0000", 2024-04-19T03:02:31.244 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:31.244 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.245 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.245 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:31.245 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018167+0000", 2024-04-19T03:02:31.245 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:31.245 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.245 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.245 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:31.245 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018167+0000", 2024-04-19T03:02:31.245 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:31.245 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.245 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.245 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:31.245 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018196+0000", 2024-04-19T03:02:31.246 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9538000000000001e-05 2024-04-19T03:02:31.246 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.246 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.246 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:31.246 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018204+0000", 2024-04-19T03:02:31.246 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2599999999999999e-06 2024-04-19T03:02:31.246 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.246 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.246 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:31.246 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018208+0000", 2024-04-19T03:02:31.246 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8080000000000004e-06 2024-04-19T03:02:31.246 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.246 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.247 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:31.247 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.064933+0000", 2024-04-19T03:02:31.247 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.046725048999999998 2024-04-19T03:02:31.247 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.247 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.247 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:31.247 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.064964+0000", 2024-04-19T03:02:31.247 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0577000000000002e-05 2024-04-19T03:02:31.247 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.247 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.247 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:31.247 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.070815+0000", 2024-04-19T03:02:31.247 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0058510649999999999 2024-04-19T03:02:31.247 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.248 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.248 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:31.248 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.070936+0000", 2024-04-19T03:02:31.248 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00012095399999999999 2024-04-19T03:02:31.248 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:31.248 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:31.248 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:31.248 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.248 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.248 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:86612 5.7 5:e32e3c49:::benchmark_data_smithi096_19531_object86611:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:31.248 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:22.633560+0000", 2024-04-19T03:02:31.248 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 8.5721958560000004, 2024-04-19T03:02:31.248 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.19135289, 2024-04-19T03:02:31.248 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:31.249 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:31.249 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:31.249 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:31.249 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:31.249 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 86612 2024-04-19T03:02:31.249 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.249 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:31.249 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.249 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:31.249 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633560+0000", 2024-04-19T03:02:31.249 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:31.249 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.249 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.249 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:31.250 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633560+0000", 2024-04-19T03:02:31.250 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:31.250 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.250 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.250 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:31.250 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633558+0000", 2024-04-19T03:02:31.250 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:31.250 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.250 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.250 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:31.250 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633609+0000", 2024-04-19T03:02:31.250 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0850999999999998e-05 2024-04-19T03:02:31.250 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.251 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.251 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:31.251 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633627+0000", 2024-04-19T03:02:31.251 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7951000000000001e-05 2024-04-19T03:02:31.251 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.251 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.251 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:31.251 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633635+0000", 2024-04-19T03:02:31.251 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2530000000000004e-06 2024-04-19T03:02:31.251 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.251 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.251 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:31.251 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633699+0000", 2024-04-19T03:02:31.252 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3901999999999999e-05 2024-04-19T03:02:31.252 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.252 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.252 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:31.252 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633992+0000", 2024-04-19T03:02:31.252 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00029283299999999999 2024-04-19T03:02:31.252 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.252 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.252 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:31.252 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.634223+0000", 2024-04-19T03:02:31.252 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00023084200000000001 2024-04-19T03:02:31.252 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.252 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.253 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:31.253 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.639085+0000", 2024-04-19T03:02:31.253 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0048624269999999999 2024-04-19T03:02:31.253 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.253 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.253 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:31.253 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.824635+0000", 2024-04-19T03:02:31.253 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.18554944700000001 2024-04-19T03:02:31.253 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.253 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.253 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:31.253 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.824793+0000", 2024-04-19T03:02:31.253 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000157959 2024-04-19T03:02:31.253 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.254 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.254 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:31.254 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.824913+0000", 2024-04-19T03:02:31.254 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000120093 2024-04-19T03:02:31.254 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:31.254 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:31.254 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:31.254 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.254 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.254 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:86625 5.7 5:e6d00488:::benchmark_data_smithi096_19531_object86624:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:31.254 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:22.643554+0000", 2024-04-19T03:02:31.254 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 8.5622020899999995, 2024-04-19T03:02:31.255 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.18732841, 2024-04-19T03:02:31.255 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:31.255 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:31.255 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:31.255 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:31.255 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:31.255 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 86625 2024-04-19T03:02:31.255 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.255 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:31.255 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.255 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:31.255 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643554+0000", 2024-04-19T03:02:31.255 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:31.256 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.256 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.256 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:31.256 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643554+0000", 2024-04-19T03:02:31.256 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:31.256 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.256 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.256 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:31.256 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643552+0000", 2024-04-19T03:02:31.256 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:31.256 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.256 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.256 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:31.257 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643588+0000", 2024-04-19T03:02:31.257 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5855999999999997e-05 2024-04-19T03:02:31.257 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.257 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.257 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:31.257 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643606+0000", 2024-04-19T03:02:31.257 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8226000000000001e-05 2024-04-19T03:02:31.257 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.257 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.257 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:31.257 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643618+0000", 2024-04-19T03:02:31.257 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1868000000000001e-05 2024-04-19T03:02:31.257 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.257 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.258 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:31.258 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643676+0000", 2024-04-19T03:02:31.258 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8153999999999999e-05 2024-04-19T03:02:31.258 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.258 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.258 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:31.258 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643905+0000", 2024-04-19T03:02:31.258 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00022847500000000001 2024-04-19T03:02:31.258 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.258 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.258 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:31.258 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.644150+0000", 2024-04-19T03:02:31.258 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00024531800000000001 2024-04-19T03:02:31.259 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.259 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.259 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:31.259 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.647407+0000", 2024-04-19T03:02:31.259 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0032563190000000001 2024-04-19T03:02:31.259 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.259 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.259 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:31.259 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.830721+0000", 2024-04-19T03:02:31.259 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.18331468300000001 2024-04-19T03:02:31.259 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.259 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.259 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:31.259 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.830813+0000", 2024-04-19T03:02:31.259 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.2205000000000002e-05 2024-04-19T03:02:31.260 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.260 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.260 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:31.260 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.830882+0000", 2024-04-19T03:02:31.260 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8819999999999995e-05 2024-04-19T03:02:31.260 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:31.260 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:31.260 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:31.260 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.260 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.260 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87063 5.7 5:e502e824:::benchmark_data_smithi096_19531_object87062:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:31.260 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.136067+0000", 2024-04-19T03:02:31.260 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 8.0696892210000009, 2024-04-19T03:02:31.261 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.065521159999999995, 2024-04-19T03:02:31.261 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:31.261 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:31.261 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:31.261 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:31.261 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:31.261 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87063 2024-04-19T03:02:31.261 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.261 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:31.261 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.261 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:31.261 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.136067+0000", 2024-04-19T03:02:31.261 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:31.261 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.262 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.262 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:31.262 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.136067+0000", 2024-04-19T03:02:31.262 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:31.262 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.262 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.262 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:31.262 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.136066+0000", 2024-04-19T03:02:31.262 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:31.262 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.262 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.262 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:31.263 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.136154+0000", 2024-04-19T03:02:31.263 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.8256000000000003e-05 2024-04-19T03:02:31.263 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.263 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.263 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:31.263 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.136162+0000", 2024-04-19T03:02:31.263 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.5099999999999998e-06 2024-04-19T03:02:31.263 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.263 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.263 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:31.263 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.136171+0000", 2024-04-19T03:02:31.263 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2830000000000001e-06 2024-04-19T03:02:31.263 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.263 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.264 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:31.264 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.138421+0000", 2024-04-19T03:02:31.264 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0022506620000000001 2024-04-19T03:02:31.264 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.264 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.264 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:31.264 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.138560+0000", 2024-04-19T03:02:31.264 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000138446 2024-04-19T03:02:31.264 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.264 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.264 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:31.264 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.138689+0000", 2024-04-19T03:02:31.264 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00012950700000000001 2024-04-19T03:02:31.264 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.265 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.265 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:31.265 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.141517+0000", 2024-04-19T03:02:31.265 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0028280860000000001 2024-04-19T03:02:31.265 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.265 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.265 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:31.265 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.201350+0000", 2024-04-19T03:02:31.265 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.059832418999999998 2024-04-19T03:02:31.265 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.265 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.265 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:31.265 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.201485+0000", 2024-04-19T03:02:31.266 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000135597 2024-04-19T03:02:31.266 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.266 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.266 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:31.266 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.201588+0000", 2024-04-19T03:02:31.266 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00010247900000000001 2024-04-19T03:02:31.266 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:31.266 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:31.266 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:31.266 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.266 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.266 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87072 5.7 5:e3c7809a:::benchmark_data_smithi096_19531_object87071:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:31.266 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.144224+0000", 2024-04-19T03:02:31.266 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 8.061532197, 2024-04-19T03:02:31.267 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.058179555000000001, 2024-04-19T03:02:31.267 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:31.267 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:31.267 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:31.267 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:31.267 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:31.267 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87072 2024-04-19T03:02:31.267 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.267 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:31.267 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.267 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:31.267 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144224+0000", 2024-04-19T03:02:31.267 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:31.268 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.268 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.268 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:31.268 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144224+0000", 2024-04-19T03:02:31.268 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:31.268 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.268 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.268 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:31.268 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144223+0000", 2024-04-19T03:02:31.268 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:31.268 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.268 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.268 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:31.269 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144320+0000", 2024-04-19T03:02:31.269 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.7075000000000001e-05 2024-04-19T03:02:31.269 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.269 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.269 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:31.269 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144331+0000", 2024-04-19T03:02:31.269 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1342000000000001e-05 2024-04-19T03:02:31.269 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.269 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.269 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:31.269 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144337+0000", 2024-04-19T03:02:31.269 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8390000000000003e-06 2024-04-19T03:02:31.269 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.269 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.270 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:31.270 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144369+0000", 2024-04-19T03:02:31.270 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2079000000000002e-05 2024-04-19T03:02:31.270 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.270 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.270 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:31.270 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144464+0000", 2024-04-19T03:02:31.270 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.4623000000000005e-05 2024-04-19T03:02:31.270 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.270 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.270 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:31.270 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144553+0000", 2024-04-19T03:02:31.270 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9171000000000004e-05 2024-04-19T03:02:31.271 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.271 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.271 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:31.271 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.147018+0000", 2024-04-19T03:02:31.271 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0024648370000000001 2024-04-19T03:02:31.271 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.271 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.271 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:31.271 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.202270+0000", 2024-04-19T03:02:31.271 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.055252018 2024-04-19T03:02:31.271 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.271 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.271 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:31.271 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.202356+0000", 2024-04-19T03:02:31.272 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6648000000000001e-05 2024-04-19T03:02:31.272 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.272 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.272 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:31.272 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.202403+0000", 2024-04-19T03:02:31.272 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6956999999999998e-05 2024-04-19T03:02:31.272 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:31.272 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:31.272 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:31.272 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.272 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.272 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87123 5.6 5:6d1bc3b9:::benchmark_data_smithi096_19531_object87122:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:02:31.272 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249233+0000", 2024-04-19T03:02:31.272 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 7.9565231650000001, 2024-04-19T03:02:31.273 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0291700720000001, 2024-04-19T03:02:31.273 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:31.273 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-04-19T03:02:31.273 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:31.273 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:31.273 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:31.273 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87123 2024-04-19T03:02:31.273 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.273 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:31.273 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.273 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:31.273 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249233+0000", 2024-04-19T03:02:31.273 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:31.274 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.274 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.274 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:31.274 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249233+0000", 2024-04-19T03:02:31.274 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:31.274 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.274 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.274 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:31.274 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249231+0000", 2024-04-19T03:02:31.274 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:31.274 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.274 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.275 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:31.275 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249285+0000", 2024-04-19T03:02:31.275 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4005000000000002e-05 2024-04-19T03:02:31.275 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.275 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.275 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:31.275 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249300+0000", 2024-04-19T03:02:31.275 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4715999999999999e-05 2024-04-19T03:02:31.275 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.275 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.275 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:31.275 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249307+0000", 2024-04-19T03:02:31.275 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8399999999999997e-06 2024-04-19T03:02:31.275 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.276 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.276 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:31.276 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249366+0000", 2024-04-19T03:02:31.276 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9435999999999998e-05 2024-04-19T03:02:31.276 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.276 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.276 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op must wait for map", 2024-04-19T03:02:31.276 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249376+0000", 2024-04-19T03:02:31.276 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.4919999999999999e-06 2024-04-19T03:02:31.276 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.276 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.276 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:31.276 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263757+0000", 2024-04-19T03:02:31.277 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.014381461999999999 2024-04-19T03:02:31.277 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.277 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.277 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:02:31.277 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263875+0000", 2024-04-19T03:02:31.277 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000117166 2024-04-19T03:02:31.277 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.277 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.277 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:31.277 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.277136+0000", 2024-04-19T03:02:31.277 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.013261207 2024-04-19T03:02:31.277 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.277 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.278 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:31.278 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.278403+0000", 2024-04-19T03:02:31.278 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001267106 2024-04-19T03:02:31.278 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:31.278 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:31.278 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:31.278 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.278 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.278 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87128 5.6 5:6905c420:::benchmark_data_smithi096_19531_object87127:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:02:31.278 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249323+0000", 2024-04-19T03:02:31.278 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 7.9564324180000003, 2024-04-19T03:02:31.278 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0292813249999999, 2024-04-19T03:02:31.278 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:31.279 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-04-19T03:02:31.279 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:31.279 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:31.279 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:31.279 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87128 2024-04-19T03:02:31.279 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.279 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:31.279 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.279 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:31.279 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249323+0000", 2024-04-19T03:02:31.279 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:31.279 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.279 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.279 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:31.280 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249323+0000", 2024-04-19T03:02:31.280 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:31.280 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.280 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.280 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:31.280 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249323+0000", 2024-04-19T03:02:31.280 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:31.280 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.280 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.280 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:31.280 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249385+0000", 2024-04-19T03:02:31.280 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1711999999999995e-05 2024-04-19T03:02:31.280 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.280 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.281 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:31.281 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249398+0000", 2024-04-19T03:02:31.281 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3022e-05 2024-04-19T03:02:31.281 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.281 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.281 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:31.281 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249402+0000", 2024-04-19T03:02:31.281 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4819999999999996e-06 2024-04-19T03:02:31.281 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.281 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.281 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:31.281 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249437+0000", 2024-04-19T03:02:31.281 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4702000000000001e-05 2024-04-19T03:02:31.281 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.282 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.282 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:02:31.282 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249442+0000", 2024-04-19T03:02:31.282 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8019999999999999e-06 2024-04-19T03:02:31.282 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.282 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.282 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:31.282 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263896+0000", 2024-04-19T03:02:31.282 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.014454679999999999 2024-04-19T03:02:31.282 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.282 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.282 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:02:31.282 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263900+0000", 2024-04-19T03:02:31.283 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9700000000000001e-06 2024-04-19T03:02:31.283 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.283 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.283 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:31.283 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.278557+0000", 2024-04-19T03:02:31.283 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0146566480000001 2024-04-19T03:02:31.283 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.283 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.283 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:31.283 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.278605+0000", 2024-04-19T03:02:31.283 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7735999999999998e-05 2024-04-19T03:02:31.283 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:31.283 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:31.284 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:31.284 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.284 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.284 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87130 5.3 5:c8c2d67b:::benchmark_data_smithi096_19531_object87129:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:02:31.284 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249418+0000", 2024-04-19T03:02:31.284 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 7.9563377070000003, 2024-04-19T03:02:31.284 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.025414182, 2024-04-19T03:02:31.284 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:31.284 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-04-19T03:02:31.284 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:31.284 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:31.284 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:31.285 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87130 2024-04-19T03:02:31.285 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.285 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:31.285 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.285 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:31.285 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249418+0000", 2024-04-19T03:02:31.285 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:31.285 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.285 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.285 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:31.285 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249418+0000", 2024-04-19T03:02:31.285 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:31.285 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.286 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.286 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:31.286 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249409+0000", 2024-04-19T03:02:31.286 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999905 2024-04-19T03:02:31.286 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.286 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.286 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:31.286 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249464+0000", 2024-04-19T03:02:31.286 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5381999999999999e-05 2024-04-19T03:02:31.286 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.286 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.286 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:31.286 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249471+0000", 2024-04-19T03:02:31.287 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2609999999999996e-06 2024-04-19T03:02:31.287 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.287 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.287 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:31.287 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249475+0000", 2024-04-19T03:02:31.287 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2839999999999998e-06 2024-04-19T03:02:31.287 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.287 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.287 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:31.287 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249535+0000", 2024-04-19T03:02:31.287 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0545999999999999e-05 2024-04-19T03:02:31.287 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.287 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.287 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op must wait for map", 2024-04-19T03:02:31.287 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249540+0000", 2024-04-19T03:02:31.288 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2859999999999999e-06 2024-04-19T03:02:31.288 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.288 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.288 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:31.288 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263450+0000", 2024-04-19T03:02:31.288 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.013909585 2024-04-19T03:02:31.288 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.288 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.288 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:02:31.288 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263458+0000", 2024-04-19T03:02:31.288 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8089999999999993e-06 2024-04-19T03:02:31.288 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.288 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.288 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:31.289 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.273193+0000", 2024-04-19T03:02:31.289 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0097351379999999 2024-04-19T03:02:31.289 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.289 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.289 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:31.289 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.274832+0000", 2024-04-19T03:02:31.289 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0016394789999999999 2024-04-19T03:02:31.289 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:31.289 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:31.289 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:31.289 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.289 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.289 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87131 5.1 5:83756d55:::benchmark_data_smithi096_19531_object87130:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:02:31.289 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249491+0000", 2024-04-19T03:02:31.290 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 7.9562650599999998, 2024-04-19T03:02:31.290 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0191489520000001, 2024-04-19T03:02:31.290 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:31.290 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-04-19T03:02:31.290 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:31.290 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:31.290 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:31.290 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87131 2024-04-19T03:02:31.290 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.290 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:31.290 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.290 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:31.290 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249491+0000", 2024-04-19T03:02:31.291 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:31.291 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.291 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.291 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:31.291 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249491+0000", 2024-04-19T03:02:31.291 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:31.291 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.291 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.291 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:31.291 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249491+0000", 2024-04-19T03:02:31.291 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:31.291 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.291 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.291 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:31.292 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249530+0000", 2024-04-19T03:02:31.292 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9589000000000003e-05 2024-04-19T03:02:31.292 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.292 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.292 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:31.292 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249544+0000", 2024-04-19T03:02:31.292 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4158000000000001e-05 2024-04-19T03:02:31.292 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.292 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.292 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:31.292 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249549+0000", 2024-04-19T03:02:31.292 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6809999999999997e-06 2024-04-19T03:02:31.292 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.292 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.293 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:31.293 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249592+0000", 2024-04-19T03:02:31.293 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3285999999999999e-05 2024-04-19T03:02:31.293 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.293 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.293 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op must wait for map", 2024-04-19T03:02:31.293 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249598+0000", 2024-04-19T03:02:31.293 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8329999999999999e-06 2024-04-19T03:02:31.293 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.293 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.293 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:31.293 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263331+0000", 2024-04-19T03:02:31.293 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.013733093 2024-04-19T03:02:31.293 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.294 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.294 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:02:31.294 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263343+0000", 2024-04-19T03:02:31.294 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.189e-05 2024-04-19T03:02:31.294 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.294 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.294 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:31.294 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.268541+0000", 2024-04-19T03:02:31.294 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0051983440000001 2024-04-19T03:02:31.294 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.294 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.294 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:31.294 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.268640+0000", 2024-04-19T03:02:31.295 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.8387999999999994e-05 2024-04-19T03:02:31.295 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:31.295 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:31.295 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:31.295 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.295 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.295 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87132 5.c 5:3e18b732:::benchmark_data_smithi096_19531_object87131:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:02:31.295 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249558+0000", 2024-04-19T03:02:31.295 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 7.9561981590000004, 2024-04-19T03:02:31.295 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0241198380000001, 2024-04-19T03:02:31.295 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:31.295 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-04-19T03:02:31.295 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:31.296 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:31.296 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:31.296 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87132 2024-04-19T03:02:31.296 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.296 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:31.296 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.296 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:31.296 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249558+0000", 2024-04-19T03:02:31.296 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:31.296 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.296 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.296 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:31.296 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249558+0000", 2024-04-19T03:02:31.297 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:31.297 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.297 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.297 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:31.297 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249557+0000", 2024-04-19T03:02:31.297 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:31.297 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.297 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.297 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:31.297 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249625+0000", 2024-04-19T03:02:31.297 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7200999999999996e-05 2024-04-19T03:02:31.297 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.297 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.297 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:31.298 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249646+0000", 2024-04-19T03:02:31.298 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1053e-05 2024-04-19T03:02:31.298 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.298 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.298 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:31.298 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249650+0000", 2024-04-19T03:02:31.298 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2719999999999999e-06 2024-04-19T03:02:31.298 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.298 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.298 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:31.298 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249686+0000", 2024-04-19T03:02:31.298 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6430000000000002e-05 2024-04-19T03:02:31.298 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.299 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.299 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op must wait for map", 2024-04-19T03:02:31.299 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249690+0000", 2024-04-19T03:02:31.299 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.765e-06 2024-04-19T03:02:31.299 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.299 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.299 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:31.299 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261157+0000", 2024-04-19T03:02:31.299 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011467247999999999 2024-04-19T03:02:31.299 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.299 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.299 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:02:31.299 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261170+0000", 2024-04-19T03:02:31.300 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2833000000000001e-05 2024-04-19T03:02:31.300 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.300 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.300 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:31.300 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.272119+0000", 2024-04-19T03:02:31.300 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.010949313 2024-04-19T03:02:31.300 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.300 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.300 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:31.300 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.273678+0000", 2024-04-19T03:02:31.300 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0015581550000000001 2024-04-19T03:02:31.300 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:31.300 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:31.300 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:31.301 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.301 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.301 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87133 5.c 5:3f772a62:::benchmark_data_smithi096_19531_object87132:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:02:31.301 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249657+0000", 2024-04-19T03:02:31.301 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 7.9560987799999996, 2024-04-19T03:02:31.301 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0242819409999999, 2024-04-19T03:02:31.301 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:31.301 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-04-19T03:02:31.301 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:31.301 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:31.301 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:31.301 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87133 2024-04-19T03:02:31.301 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.301 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:31.302 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.302 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:31.302 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249657+0000", 2024-04-19T03:02:31.302 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:31.302 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.302 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.302 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:31.302 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249657+0000", 2024-04-19T03:02:31.302 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:31.302 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.302 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.302 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:31.302 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249657+0000", 2024-04-19T03:02:31.303 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:31.303 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.303 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.303 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:31.303 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249690+0000", 2024-04-19T03:02:31.303 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3343000000000002e-05 2024-04-19T03:02:31.303 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.303 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.303 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:31.303 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249695+0000", 2024-04-19T03:02:31.303 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8600000000000001e-06 2024-04-19T03:02:31.303 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.303 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.304 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:31.304 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249698+0000", 2024-04-19T03:02:31.304 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.1700000000000001e-06 2024-04-19T03:02:31.304 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.304 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.304 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:31.304 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249741+0000", 2024-04-19T03:02:31.304 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2849999999999998e-05 2024-04-19T03:02:31.304 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.304 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.304 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:02:31.304 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249746+0000", 2024-04-19T03:02:31.304 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1019999999999996e-06 2024-04-19T03:02:31.304 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.305 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.305 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:31.305 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261209+0000", 2024-04-19T03:02:31.305 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011462447000000001 2024-04-19T03:02:31.305 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.305 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.305 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:02:31.305 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261216+0000", 2024-04-19T03:02:31.305 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8520000000000004e-06 2024-04-19T03:02:31.305 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.305 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.305 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:31.305 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.273872+0000", 2024-04-19T03:02:31.305 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0126558000000001 2024-04-19T03:02:31.306 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.306 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.306 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:31.306 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.273939+0000", 2024-04-19T03:02:31.306 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6822000000000005e-05 2024-04-19T03:02:31.306 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:31.306 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:31.306 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:31.306 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.306 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.306 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87134 5.5 5:a56c478f:::benchmark_data_smithi096_19531_object87133:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:02:31.306 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249708+0000", 2024-04-19T03:02:31.307 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 7.9560478559999996, 2024-04-19T03:02:31.307 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0214677299999999, 2024-04-19T03:02:31.307 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:31.307 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-04-19T03:02:31.307 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:31.307 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:31.307 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:31.307 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87134 2024-04-19T03:02:31.307 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.307 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:31.307 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.307 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:31.307 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249708+0000", 2024-04-19T03:02:31.307 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:31.308 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.308 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.308 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:31.308 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249708+0000", 2024-04-19T03:02:31.308 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:31.308 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.308 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.308 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:31.308 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249706+0000", 2024-04-19T03:02:31.308 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999976 2024-04-19T03:02:31.308 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.308 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.308 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:31.308 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249740+0000", 2024-04-19T03:02:31.309 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4458000000000001e-05 2024-04-19T03:02:31.309 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.309 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.309 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:31.309 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249745+0000", 2024-04-19T03:02:31.309 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5020000000000003e-06 2024-04-19T03:02:31.309 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.309 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.309 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:31.309 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249748+0000", 2024-04-19T03:02:31.309 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2499999999999998e-06 2024-04-19T03:02:31.309 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.309 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.310 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:31.310 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249778+0000", 2024-04-19T03:02:31.310 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.006e-05 2024-04-19T03:02:31.310 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.310 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.310 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op must wait for map", 2024-04-19T03:02:31.310 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249782+0000", 2024-04-19T03:02:31.310 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2910000000000001e-06 2024-04-19T03:02:31.310 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.310 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.310 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:31.310 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261666+0000", 2024-04-19T03:02:31.310 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011883471 2024-04-19T03:02:31.310 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.311 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.311 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:02:31.311 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261674+0000", 2024-04-19T03:02:31.311 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6479999999999992e-06 2024-04-19T03:02:31.311 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.311 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.311 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:31.311 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.269323+0000", 2024-04-19T03:02:31.311 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.00764867 2024-04-19T03:02:31.311 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.311 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.311 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:31.311 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.271176+0000", 2024-04-19T03:02:31.312 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001852844 2024-04-19T03:02:31.312 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:31.312 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:31.312 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:31.312 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.312 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.312 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87137 5.c 5:30708c68:::benchmark_data_smithi096_19531_object87136:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:02:31.312 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249756+0000", 2024-04-19T03:02:31.312 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 7.9560001500000004, 2024-04-19T03:02:31.312 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.033331752, 2024-04-19T03:02:31.312 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:31.312 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:31.312 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:31.312 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:31.313 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:31.313 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87137 2024-04-19T03:02:31.313 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.313 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:31.313 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.313 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:31.313 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249756+0000", 2024-04-19T03:02:31.313 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:31.313 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.313 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.313 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:31.313 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249756+0000", 2024-04-19T03:02:31.313 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:31.313 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.314 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.314 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:31.314 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249755+0000", 2024-04-19T03:02:31.314 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:31.314 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.314 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.314 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:31.314 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249777+0000", 2024-04-19T03:02:31.314 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1420000000000002e-05 2024-04-19T03:02:31.314 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.314 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.314 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:31.314 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249781+0000", 2024-04-19T03:02:31.314 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0609999999999997e-06 2024-04-19T03:02:31.315 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.315 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.315 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:31.315 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249787+0000", 2024-04-19T03:02:31.315 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.02e-06 2024-04-19T03:02:31.315 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.315 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.315 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:31.315 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249818+0000", 2024-04-19T03:02:31.315 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0947e-05 2024-04-19T03:02:31.315 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.315 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.315 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:02:31.316 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249821+0000", 2024-04-19T03:02:31.316 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.117e-06 2024-04-19T03:02:31.316 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.316 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.316 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:31.316 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261243+0000", 2024-04-19T03:02:31.316 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011421875999999999 2024-04-19T03:02:31.316 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.316 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.316 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:02:31.316 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261251+0000", 2024-04-19T03:02:31.316 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6120000000000001e-06 2024-04-19T03:02:31.316 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.316 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.317 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:31.317 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.274050+0000", 2024-04-19T03:02:31.317 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.012799405 2024-04-19T03:02:31.317 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.317 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.317 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:31.317 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.274529+0000", 2024-04-19T03:02:31.317 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00047867100000000001 2024-04-19T03:02:31.317 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.317 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.317 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:31.317 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.282972+0000", 2024-04-19T03:02:31.317 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0084436900000000002 2024-04-19T03:02:31.317 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.318 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.318 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:31.318 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.283022+0000", 2024-04-19T03:02:31.318 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9339000000000003e-05 2024-04-19T03:02:31.318 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:31.318 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:31.318 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:31.318 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.283088+0000", 2024-04-19T03:02:31.318 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5877999999999995e-05 2024-04-19T03:02:31.318 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:31.318 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:31.318 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:31.318 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:31.318 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:31.319 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-04-19T03:02:31.320 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:31.317+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:31.320 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T03:02:31.423 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:31.419+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:31.448 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-19T03:02:31.448 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-04-19T03:02:31.449 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.449 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:100907 5.0 5:0d0e6614:::benchmark_data_smithi096_19531_object100906:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-19T03:02:31.449 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:31.430837+0000", 2024-04-19T03:02:31.449 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.016791943, 2024-04-19T03:02:31.449 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.016821438000000001, 2024-04-19T03:02:31.449 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:31.449 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-19T03:02:31.449 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:31.449 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:31.449 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:31.449 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 100907 2024-04-19T03:02:31.449 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.449 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:31.450 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.450 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:31.450 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:31.430837+0000", 2024-04-19T03:02:31.450 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:31.450 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.450 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.450 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:31.450 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:31.430837+0000", 2024-04-19T03:02:31.450 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:31.450 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.450 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.450 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:31.450 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:31.430836+0000", 2024-04-19T03:02:31.451 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:31.451 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.451 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.451 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:31.451 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:31.430911+0000", 2024-04-19T03:02:31.451 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5661000000000006e-05 2024-04-19T03:02:31.451 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.451 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.451 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:31.451 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:31.430921+0000", 2024-04-19T03:02:31.451 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0061000000000001e-05 2024-04-19T03:02:31.451 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.451 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.451 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:31.452 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:31.430929+0000", 2024-04-19T03:02:31.452 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.038e-06 2024-04-19T03:02:31.452 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.452 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.452 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:31.452 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:31.433964+0000", 2024-04-19T03:02:31.452 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0030340440000000001 2024-04-19T03:02:31.452 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.452 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.452 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:31.452 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:31.434094+0000", 2024-04-19T03:02:31.452 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012999600000000001 2024-04-19T03:02:31.452 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:31.452 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:31.453 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:31.453 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.453 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.453 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:100911 5.8 5:12f59153:::benchmark_data_smithi096_19531_object100910:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-19T03:02:31.453 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:31.431211+0000", 2024-04-19T03:02:31.453 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.016418063, 2024-04-19T03:02:31.453 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.016526855, 2024-04-19T03:02:31.453 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:31.453 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-19T03:02:31.453 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:31.453 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:31.453 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:31.453 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 100911 2024-04-19T03:02:31.453 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.453 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:31.454 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.454 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:31.454 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:31.431211+0000", 2024-04-19T03:02:31.454 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:31.454 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.454 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.454 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:31.454 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:31.431211+0000", 2024-04-19T03:02:31.454 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:31.454 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.454 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.454 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:31.454 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:31.431210+0000", 2024-04-19T03:02:31.455 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:31.455 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.455 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.455 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:31.455 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:31.431242+0000", 2024-04-19T03:02:31.455 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2125000000000002e-05 2024-04-19T03:02:31.455 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.455 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.455 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:31.455 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:31.431247+0000", 2024-04-19T03:02:31.455 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9490000000000004e-06 2024-04-19T03:02:31.455 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.455 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.455 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:31.456 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:31.431252+0000", 2024-04-19T03:02:31.456 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9200000000000003e-06 2024-04-19T03:02:31.456 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.456 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.456 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:31.456 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:31.436338+0000", 2024-04-19T03:02:31.456 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0050864250000000003 2024-04-19T03:02:31.456 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.456 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.456 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:31.456 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:31.436429+0000", 2024-04-19T03:02:31.456 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1018000000000002e-05 2024-04-19T03:02:31.456 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:31.456 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:31.456 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:31.457 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.457 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.457 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:100912 5.0 5:0634d80a:::benchmark_data_smithi096_19531_object100911:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-19T03:02:31.457 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:31.431584+0000", 2024-04-19T03:02:31.457 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.016045041999999999, 2024-04-19T03:02:31.457 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.016223576999999999, 2024-04-19T03:02:31.457 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:31.457 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-19T03:02:31.457 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:31.457 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:31.457 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:31.457 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 100912 2024-04-19T03:02:31.457 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.457 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:31.458 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.458 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:31.458 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:31.431584+0000", 2024-04-19T03:02:31.458 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:31.458 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.458 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.458 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:31.458 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:31.431584+0000", 2024-04-19T03:02:31.458 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:31.458 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.458 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.458 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:31.458 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:31.431583+0000", 2024-04-19T03:02:31.459 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:31.459 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.459 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.459 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:31.459 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:31.431649+0000", 2024-04-19T03:02:31.459 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5859999999999996e-05 2024-04-19T03:02:31.459 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.459 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.459 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:31.459 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:31.431658+0000", 2024-04-19T03:02:31.459 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.8119999999999997e-06 2024-04-19T03:02:31.459 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.459 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.459 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:31.459 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:31.431664+0000", 2024-04-19T03:02:31.459 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4219999999999997e-06 2024-04-19T03:02:31.460 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.460 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.460 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:31.460 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:31.438276+0000", 2024-04-19T03:02:31.460 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0066123420000000002 2024-04-19T03:02:31.460 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.460 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.460 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:31.460 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:31.438366+0000", 2024-04-19T03:02:31.460 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.0121e-05 2024-04-19T03:02:31.460 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:31.460 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:31.460 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:31.460 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.460 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.461 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:100916 5.0 5:08c7895f:::benchmark_data_smithi096_19531_object100915:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-19T03:02:31.461 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:31.434349+0000", 2024-04-19T03:02:31.461 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.013280158, 2024-04-19T03:02:31.461 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013526207, 2024-04-19T03:02:31.461 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:31.461 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-19T03:02:31.461 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:31.461 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:31.461 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:31.461 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 100916 2024-04-19T03:02:31.461 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.461 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:31.461 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.461 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:31.462 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:31.434349+0000", 2024-04-19T03:02:31.462 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:31.462 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.462 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.462 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:31.462 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:31.434349+0000", 2024-04-19T03:02:31.462 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:31.462 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.462 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.462 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:31.462 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:31.434348+0000", 2024-04-19T03:02:31.462 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:31.462 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.463 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.463 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:31.463 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:31.434464+0000", 2024-04-19T03:02:31.463 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011687499999999999 2024-04-19T03:02:31.463 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.463 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.463 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:31.463 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:31.434475+0000", 2024-04-19T03:02:31.463 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0937e-05 2024-04-19T03:02:31.463 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.463 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.463 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:31.463 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:31.434481+0000", 2024-04-19T03:02:31.463 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4949999999999999e-06 2024-04-19T03:02:31.464 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.464 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.464 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:31.464 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:31.440985+0000", 2024-04-19T03:02:31.464 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0065038780000000003 2024-04-19T03:02:31.464 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.464 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.464 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:31.464 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:31.441101+0000", 2024-04-19T03:02:31.464 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011642999999999999 2024-04-19T03:02:31.464 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:31.464 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:31.464 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:31.464 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.464 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.465 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:100917 5.8 5:1079af0d:::benchmark_data_smithi096_19531_object100916:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-19T03:02:31.465 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:31.435019+0000", 2024-04-19T03:02:31.465 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.012609891, 2024-04-19T03:02:31.465 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.012924191, 2024-04-19T03:02:31.465 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:31.465 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-19T03:02:31.465 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:31.465 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:31.465 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:31.465 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 100917 2024-04-19T03:02:31.465 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.465 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:31.465 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.466 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:31.466 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:31.435019+0000", 2024-04-19T03:02:31.466 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:31.466 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.466 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.466 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:31.466 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:31.435019+0000", 2024-04-19T03:02:31.466 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:31.466 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.466 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.466 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:31.466 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:31.435018+0000", 2024-04-19T03:02:31.466 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:31.466 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.467 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.467 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:31.467 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:31.435114+0000", 2024-04-19T03:02:31.467 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.5773000000000006e-05 2024-04-19T03:02:31.467 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.467 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.467 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:31.467 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:31.435122+0000", 2024-04-19T03:02:31.467 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5970000000000003e-06 2024-04-19T03:02:31.467 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.467 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.467 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:31.467 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:31.435125+0000", 2024-04-19T03:02:31.467 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5049999999999999e-06 2024-04-19T03:02:31.468 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.468 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.468 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:31.468 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:31.440978+0000", 2024-04-19T03:02:31.468 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0058533409999999998 2024-04-19T03:02:31.468 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.468 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.468 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:31.468 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:31.441117+0000", 2024-04-19T03:02:31.468 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000138942 2024-04-19T03:02:31.468 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:31.468 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:31.468 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:31.468 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.468 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.469 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:100920 5.0 5:0b842b8e:::benchmark_data_smithi096_19531_object100919:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-19T03:02:31.469 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:31.437323+0000", 2024-04-19T03:02:31.469 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.010305422999999999, 2024-04-19T03:02:31.469 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.010686565, 2024-04-19T03:02:31.469 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:31.469 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-19T03:02:31.469 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:31.469 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:31.469 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:31.469 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 100920 2024-04-19T03:02:31.469 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.469 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:31.469 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.469 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:31.469 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:31.437323+0000", 2024-04-19T03:02:31.470 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:31.470 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.470 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.470 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:31.470 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:31.437323+0000", 2024-04-19T03:02:31.470 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:31.470 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.470 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.470 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:31.470 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:31.437323+0000", 2024-04-19T03:02:31.470 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:31.470 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.470 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.470 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:31.471 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:31.437438+0000", 2024-04-19T03:02:31.471 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000115228 2024-04-19T03:02:31.471 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.471 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.471 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:31.471 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:31.437450+0000", 2024-04-19T03:02:31.471 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2122e-05 2024-04-19T03:02:31.471 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.471 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.471 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:31.471 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:31.437455+0000", 2024-04-19T03:02:31.471 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9269999999999996e-06 2024-04-19T03:02:31.471 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.471 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.472 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:31.472 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:31.443524+0000", 2024-04-19T03:02:31.472 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0060690060000000001 2024-04-19T03:02:31.472 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.472 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.472 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:31.472 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:31.443670+0000", 2024-04-19T03:02:31.472 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014597199999999999 2024-04-19T03:02:31.472 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:31.472 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:31.472 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:31.472 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.472 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.472 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:100925 5.d 5:be33c14a:::benchmark_data_smithi096_19531_object100924:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-19T03:02:31.472 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:31.439686+0000", 2024-04-19T03:02:31.473 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0079425840000000008, 2024-04-19T03:02:31.473 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0083902879999999992, 2024-04-19T03:02:31.473 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:31.473 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:02:31.473 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:31.473 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:31.473 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:31.473 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 100925 2024-04-19T03:02:31.473 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.473 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:31.473 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.473 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:31.473 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:31.439686+0000", 2024-04-19T03:02:31.473 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:31.474 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.474 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.474 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:31.474 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:31.439686+0000", 2024-04-19T03:02:31.474 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:31.474 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.474 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.474 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:31.474 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:31.439685+0000", 2024-04-19T03:02:31.474 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:31.474 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.474 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.474 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:31.474 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:31.439825+0000", 2024-04-19T03:02:31.475 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013924799999999999 2024-04-19T03:02:31.475 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.475 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.475 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:31.475 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:31.439835+0000", 2024-04-19T03:02:31.475 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.03e-05 2024-04-19T03:02:31.475 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.475 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.475 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:31.475 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:31.439841+0000", 2024-04-19T03:02:31.475 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7599999999999999e-06 2024-04-19T03:02:31.475 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.475 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.475 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:31.476 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:31.439935+0000", 2024-04-19T03:02:31.476 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.4037999999999996e-05 2024-04-19T03:02:31.476 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.476 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.476 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:31.476 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:31.440104+0000", 2024-04-19T03:02:31.476 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000168787 2024-04-19T03:02:31.476 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.476 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.476 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-04-19T03:02:31.476 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:31.440276+0000", 2024-04-19T03:02:31.476 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00017292100000000001 2024-04-19T03:02:31.476 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.476 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.477 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:31.477 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:31.447495+0000", 2024-04-19T03:02:31.477 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0072184989999999997 2024-04-19T03:02:31.477 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:31.477 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:31.477 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:31.477 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.477 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.477 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:100926 5.e 5:73677704:::benchmark_data_smithi096_19531_object100925:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-19T03:02:31.477 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:31.442334+0000", 2024-04-19T03:02:31.477 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0052948149999999996, 2024-04-19T03:02:31.477 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0058230740000000001, 2024-04-19T03:02:31.477 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:31.477 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-19T03:02:31.478 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:31.478 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:31.478 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:31.478 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 100926 2024-04-19T03:02:31.478 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.478 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:31.478 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.478 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:31.478 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:31.442334+0000", 2024-04-19T03:02:31.478 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:31.478 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.478 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.478 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:31.479 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:31.442334+0000", 2024-04-19T03:02:31.479 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:31.479 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.479 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.479 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:31.479 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:31.442333+0000", 2024-04-19T03:02:31.479 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:31.479 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.479 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.479 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:31.479 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:31.442441+0000", 2024-04-19T03:02:31.479 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010837500000000001 2024-04-19T03:02:31.479 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.479 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.480 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:31.480 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:31.442460+0000", 2024-04-19T03:02:31.480 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8199e-05 2024-04-19T03:02:31.480 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.480 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.480 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:31.480 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:31.442479+0000", 2024-04-19T03:02:31.480 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9505999999999999e-05 2024-04-19T03:02:31.480 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.480 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.480 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:31.480 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:31.442527+0000", 2024-04-19T03:02:31.480 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7525000000000003e-05 2024-04-19T03:02:31.480 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.480 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.481 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:31.481 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:31.442678+0000", 2024-04-19T03:02:31.481 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000151087 2024-04-19T03:02:31.481 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:31.481 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:31.481 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:31.481 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.481 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.481 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:100928 5.a 5:50ec2bca:::benchmark_data_smithi096_19531_object100927:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-19T03:02:31.481 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:31.443988+0000", 2024-04-19T03:02:31.481 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0036408640000000002, 2024-04-19T03:02:31.481 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0042354860000000001, 2024-04-19T03:02:31.481 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:31.481 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-19T03:02:31.481 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:31.482 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:31.482 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:31.482 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 100928 2024-04-19T03:02:31.482 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.482 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:31.482 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.482 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:31.482 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:31.443988+0000", 2024-04-19T03:02:31.482 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:31.482 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.482 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.482 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:31.482 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:31.443988+0000", 2024-04-19T03:02:31.483 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:31.483 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.483 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.483 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:31.483 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:31.443987+0000", 2024-04-19T03:02:31.483 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:31.483 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.483 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.483 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:31.483 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:31.444065+0000", 2024-04-19T03:02:31.483 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.8285e-05 2024-04-19T03:02:31.483 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.483 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.483 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:31.484 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:31.444077+0000", 2024-04-19T03:02:31.484 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1933000000000001e-05 2024-04-19T03:02:31.484 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.484 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.484 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:31.484 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:31.444084+0000", 2024-04-19T03:02:31.484 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.9460000000000001e-06 2024-04-19T03:02:31.484 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.484 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.484 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:31.484 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:31.444132+0000", 2024-04-19T03:02:31.484 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7499e-05 2024-04-19T03:02:31.484 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.484 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.484 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:31.485 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:31.444247+0000", 2024-04-19T03:02:31.485 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011531699999999999 2024-04-19T03:02:31.485 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:31.485 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:31.485 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:31.485 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.485 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.485 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:100930 5.0 5:0b25b18f:::benchmark_data_smithi096_19531_object100929:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-19T03:02:31.485 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:31.444901+0000", 2024-04-19T03:02:31.485 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0027275469999999999, 2024-04-19T03:02:31.485 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0033884269999999998, 2024-04-19T03:02:31.485 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:31.485 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-19T03:02:31.485 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:31.485 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:31.486 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:31.486 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 100930 2024-04-19T03:02:31.486 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.486 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:31.486 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.486 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:31.486 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:31.444901+0000", 2024-04-19T03:02:31.486 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:31.486 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.486 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.486 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:31.486 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:31.444901+0000", 2024-04-19T03:02:31.486 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:31.486 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.487 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.487 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:31.487 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:31.444900+0000", 2024-04-19T03:02:31.487 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:31.487 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.487 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.487 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:31.487 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:31.444974+0000", 2024-04-19T03:02:31.487 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3832999999999996e-05 2024-04-19T03:02:31.487 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.487 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.487 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:31.487 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:31.445070+0000", 2024-04-19T03:02:31.487 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.6167000000000003e-05 2024-04-19T03:02:31.487 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.488 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.488 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:31.488 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:31.445098+0000", 2024-04-19T03:02:31.488 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7554000000000001e-05 2024-04-19T03:02:31.488 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.488 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.488 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:31.488 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:31.446012+0000", 2024-04-19T03:02:31.488 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00091436900000000005 2024-04-19T03:02:31.488 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.488 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.488 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:31.488 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:31.446115+0000", 2024-04-19T03:02:31.488 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000103117 2024-04-19T03:02:31.489 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:31.489 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:31.489 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:31.489 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.489 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.489 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4755.0:100931 5.f e46/22 5:f0cca727:::benchmark_data_smithi096_19531_object100930:head v 46'6246, mlcod=46'6244)", 2024-04-19T03:02:31.489 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:31.446486+0000", 2024-04-19T03:02:31.489 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.001142786, 2024-04-19T03:02:31.489 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0018679809999999999, 2024-04-19T03:02:31.489 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:31.489 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-19T03:02:31.489 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:31.489 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.489 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:31.489 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:31.446486+0000", 2024-04-19T03:02:31.490 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:31.490 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.490 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.490 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:31.490 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:31.446486+0000", 2024-04-19T03:02:31.490 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:31.490 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.490 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.490 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:31.490 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:31.446485+0000", 2024-04-19T03:02:31.490 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:31.490 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.491 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.491 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:31.491 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:31.446542+0000", 2024-04-19T03:02:31.491 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6623999999999999e-05 2024-04-19T03:02:31.491 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.491 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.491 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:31.491 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:31.446562+0000", 2024-04-19T03:02:31.491 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9766e-05 2024-04-19T03:02:31.491 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.491 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.491 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:31.491 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:31.446570+0000", 2024-04-19T03:02:31.491 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.242e-06 2024-04-19T03:02:31.491 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.492 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.492 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:31.492 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:31.446631+0000", 2024-04-19T03:02:31.492 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0891999999999999e-05 2024-04-19T03:02:31.492 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.492 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.492 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:31.492 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:31.446660+0000", 2024-04-19T03:02:31.492 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9196e-05 2024-04-19T03:02:31.492 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:31.492 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:31.492 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:31.492 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.492 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.493 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:100933 5.8 5.3055fd08 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-19T03:02:31.493 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:31.447069+0000", 2024-04-19T03:02:31.493 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.00055940000000000004, 2024-04-19T03:02:31.493 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001340475, 2024-04-19T03:02:31.493 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:31.493 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-04-19T03:02:31.493 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:31.493 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:31.493 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:31.493 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 100933 2024-04-19T03:02:31.493 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.493 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:31.493 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.493 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:31.493 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:31.447069+0000", 2024-04-19T03:02:31.494 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:31.494 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.494 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.494 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:31.494 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:31.447069+0000", 2024-04-19T03:02:31.494 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:31.494 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.494 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.494 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:31.494 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:31.447068+0000", 2024-04-19T03:02:31.494 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:31.494 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.494 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.495 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:31.495 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:31.447108+0000", 2024-04-19T03:02:31.495 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9304000000000002e-05 2024-04-19T03:02:31.495 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.495 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.495 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:31.495 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:31.447119+0000", 2024-04-19T03:02:31.495 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1029999999999999e-05 2024-04-19T03:02:31.495 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.495 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.495 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:31.495 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:31.447124+0000", 2024-04-19T03:02:31.495 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2310000000000004e-06 2024-04-19T03:02:31.495 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:31.496 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:31.496 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:31.496 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:31.496 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-04-19T03:02:31.496 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 12 2024-04-19T03:02:31.496 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-19T03:02:31.497 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T03:02:31.521 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:31.517+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:31.622 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:31.619+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:31.623 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-19T03:02:31.624 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-04-19T03:02:31.624 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-04-19T03:02:31.624 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-04-19T03:02:31.624 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-19T03:02:31.636 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T03:02:31.722 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:31.721+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:31.808 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-19T03:02:31.809 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-04-19T03:02:31.809 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-04-19T03:02:31.809 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-04-19T03:02:31.809 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.809 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:79014 5.d 5:b5eee02c:::benchmark_data_smithi096_19531_object79013:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-19T03:02:31.809 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:18.032471+0000", 2024-04-19T03:02:31.809 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 13.772790729, 2024-04-19T03:02:31.809 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.041427629000000001, 2024-04-19T03:02:31.809 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:31.809 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:31.809 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:31.809 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:31.809 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:31.810 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 79014 2024-04-19T03:02:31.810 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.810 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:31.810 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.810 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:31.810 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:18.032471+0000", 2024-04-19T03:02:31.810 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:31.810 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.810 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.810 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:31.810 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:18.032471+0000", 2024-04-19T03:02:31.810 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:31.810 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.811 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.811 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:31.811 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:18.032470+0000", 2024-04-19T03:02:31.811 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:31.811 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.811 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.811 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:31.811 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:18.032525+0000", 2024-04-19T03:02:31.811 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5535999999999998e-05 2024-04-19T03:02:31.811 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.811 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.811 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:31.811 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:18.032537+0000", 2024-04-19T03:02:31.811 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1987999999999999e-05 2024-04-19T03:02:31.812 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.812 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.812 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:31.812 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:18.032546+0000", 2024-04-19T03:02:31.812 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9670000000000007e-06 2024-04-19T03:02:31.812 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.812 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.812 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:31.812 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:18.032613+0000", 2024-04-19T03:02:31.812 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6508999999999996e-05 2024-04-19T03:02:31.812 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.812 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.812 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:31.812 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:18.032738+0000", 2024-04-19T03:02:31.813 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000124912 2024-04-19T03:02:31.813 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.813 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.813 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-04-19T03:02:31.813 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:18.032867+0000", 2024-04-19T03:02:31.813 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012959399999999999 2024-04-19T03:02:31.813 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.813 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.813 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:31.813 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:18.035867+0000", 2024-04-19T03:02:31.813 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.002999378 2024-04-19T03:02:31.813 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.813 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.813 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:31.814 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:18.073705+0000", 2024-04-19T03:02:31.814 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.037838042000000002 2024-04-19T03:02:31.814 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.814 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.814 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:31.814 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:18.073813+0000", 2024-04-19T03:02:31.814 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010806099999999999 2024-04-19T03:02:31.814 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.814 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.814 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:31.814 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:18.073899+0000", 2024-04-19T03:02:31.814 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.5971999999999996e-05 2024-04-19T03:02:31.814 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:31.815 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:31.815 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:31.815 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.815 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.815 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:86615 5.e 5:7fef7288:::benchmark_data_smithi096_19531_object86614:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:31.815 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:22.634544+0000", 2024-04-19T03:02:31.815 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 9.1707177499999997, 2024-04-19T03:02:31.815 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.192475071, 2024-04-19T03:02:31.815 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:31.815 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:31.815 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:31.815 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:31.815 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:31.815 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 86615 2024-04-19T03:02:31.816 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.816 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:31.816 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.816 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:31.816 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634544+0000", 2024-04-19T03:02:31.816 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:31.816 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.816 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.816 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:31.816 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634544+0000", 2024-04-19T03:02:31.816 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:31.816 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.816 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.816 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:31.817 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634542+0000", 2024-04-19T03:02:31.817 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999981 2024-04-19T03:02:31.817 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.817 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.817 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:31.817 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634585+0000", 2024-04-19T03:02:31.817 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2299000000000003e-05 2024-04-19T03:02:31.817 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.817 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.817 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:31.817 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634592+0000", 2024-04-19T03:02:31.817 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2350000000000002e-06 2024-04-19T03:02:31.817 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.817 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.818 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:31.818 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634596+0000", 2024-04-19T03:02:31.818 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5390000000000001e-06 2024-04-19T03:02:31.818 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.818 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.818 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:31.818 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634639+0000", 2024-04-19T03:02:31.818 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2444999999999998e-05 2024-04-19T03:02:31.818 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.818 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.818 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:31.818 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634808+0000", 2024-04-19T03:02:31.818 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000169152 2024-04-19T03:02:31.818 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.819 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.819 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:31.819 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634999+0000", 2024-04-19T03:02:31.819 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00019098300000000001 2024-04-19T03:02:31.819 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.819 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.819 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:31.819 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.640458+0000", 2024-04-19T03:02:31.819 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0054586870000000003 2024-04-19T03:02:31.819 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.819 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.819 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:31.819 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.826949+0000", 2024-04-19T03:02:31.819 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.18649178299999999 2024-04-19T03:02:31.819 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.819 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.820 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:31.820 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.826982+0000", 2024-04-19T03:02:31.820 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2477000000000001e-05 2024-04-19T03:02:31.820 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.820 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.820 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:31.820 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.827019+0000", 2024-04-19T03:02:31.820 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7355999999999999e-05 2024-04-19T03:02:31.820 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:31.820 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:31.820 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:31.820 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.820 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.820 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:86616 5.e 5:72278f47:::benchmark_data_smithi096_19531_object86615:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:31.821 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:22.634609+0000", 2024-04-19T03:02:31.821 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 9.1706526010000005, 2024-04-19T03:02:31.821 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.19472088900000001, 2024-04-19T03:02:31.821 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:31.821 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:31.821 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:31.821 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:31.821 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:31.821 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 86616 2024-04-19T03:02:31.821 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.821 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:31.821 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.821 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:31.821 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634609+0000", 2024-04-19T03:02:31.821 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:31.822 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.822 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.822 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:31.822 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634609+0000", 2024-04-19T03:02:31.822 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:31.822 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.822 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.822 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:31.822 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634609+0000", 2024-04-19T03:02:31.822 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:31.822 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.822 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.822 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:31.823 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634651+0000", 2024-04-19T03:02:31.823 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2589000000000002e-05 2024-04-19T03:02:31.823 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.823 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.823 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:31.823 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634659+0000", 2024-04-19T03:02:31.823 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5850000000000002e-06 2024-04-19T03:02:31.823 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.823 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.823 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:31.823 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634662+0000", 2024-04-19T03:02:31.823 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3620000000000002e-06 2024-04-19T03:02:31.823 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.823 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.824 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:31.824 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.637880+0000", 2024-04-19T03:02:31.824 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.003218149 2024-04-19T03:02:31.824 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.824 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.824 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:31.824 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.637999+0000", 2024-04-19T03:02:31.824 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000118643 2024-04-19T03:02:31.824 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.824 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.824 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:31.824 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.638102+0000", 2024-04-19T03:02:31.824 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010331 2024-04-19T03:02:31.825 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.825 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.825 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:31.825 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.640851+0000", 2024-04-19T03:02:31.825 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0027483310000000001 2024-04-19T03:02:31.825 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.825 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.825 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:31.825 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.829269+0000", 2024-04-19T03:02:31.825 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.188418319 2024-04-19T03:02:31.825 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.825 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.825 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:31.825 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.829299+0000", 2024-04-19T03:02:31.825 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0227e-05 2024-04-19T03:02:31.826 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.826 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.826 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:31.826 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.829330+0000", 2024-04-19T03:02:31.826 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0969000000000001e-05 2024-04-19T03:02:31.826 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:31.826 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:31.826 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:31.826 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.826 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.826 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:86618 5.0 5:09014b90:::benchmark_data_smithi096_19531_object86617:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:31.826 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:22.634894+0000", 2024-04-19T03:02:31.826 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 9.1703681130000003, 2024-04-19T03:02:31.826 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.19413419800000001, 2024-04-19T03:02:31.827 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:31.827 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:31.827 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:31.827 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:31.827 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:31.827 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 86618 2024-04-19T03:02:31.827 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.827 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:31.827 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.827 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:31.827 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634894+0000", 2024-04-19T03:02:31.827 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:31.827 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.827 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.828 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:31.828 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634894+0000", 2024-04-19T03:02:31.828 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:31.828 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.828 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.828 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:31.828 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634893+0000", 2024-04-19T03:02:31.828 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:31.828 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.828 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.828 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:31.828 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634976+0000", 2024-04-19T03:02:31.828 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3231000000000003e-05 2024-04-19T03:02:31.828 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.828 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.829 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:31.829 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634983+0000", 2024-04-19T03:02:31.829 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5169999999999996e-06 2024-04-19T03:02:31.829 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.829 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.829 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:31.829 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634987+0000", 2024-04-19T03:02:31.829 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.425e-06 2024-04-19T03:02:31.829 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.829 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.829 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:31.829 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635030+0000", 2024-04-19T03:02:31.829 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.32e-05 2024-04-19T03:02:31.829 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.830 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.830 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:31.830 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635185+0000", 2024-04-19T03:02:31.830 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015471899999999999 2024-04-19T03:02:31.830 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.830 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.830 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:31.830 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635415+0000", 2024-04-19T03:02:31.830 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00023026500000000001 2024-04-19T03:02:31.830 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.830 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.830 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:31.830 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.640127+0000", 2024-04-19T03:02:31.830 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0047118890000000004 2024-04-19T03:02:31.831 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.831 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.831 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:31.831 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.828895+0000", 2024-04-19T03:02:31.831 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.18876802600000001 2024-04-19T03:02:31.831 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.831 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.831 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:31.831 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.828972+0000", 2024-04-19T03:02:31.831 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.6345000000000002e-05 2024-04-19T03:02:31.831 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.831 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.831 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:31.831 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.829028+0000", 2024-04-19T03:02:31.832 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6342999999999999e-05 2024-04-19T03:02:31.832 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:31.832 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:31.832 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:31.832 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.832 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.832 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:86620 5.b 5:d80faa68:::benchmark_data_smithi096_19531_object86619:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:31.832 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:22.635110+0000", 2024-04-19T03:02:31.832 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 9.1701515530000002, 2024-04-19T03:02:31.832 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.193447275, 2024-04-19T03:02:31.832 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:31.832 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:31.832 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:31.832 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:31.833 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:31.833 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 86620 2024-04-19T03:02:31.833 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.833 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:31.833 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.833 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:31.833 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635110+0000", 2024-04-19T03:02:31.833 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:31.833 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.833 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.833 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:31.833 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635110+0000", 2024-04-19T03:02:31.833 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:31.833 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.834 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.834 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:31.834 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635110+0000", 2024-04-19T03:02:31.834 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:31.834 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.834 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.834 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:31.834 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635154+0000", 2024-04-19T03:02:31.834 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4681000000000001e-05 2024-04-19T03:02:31.834 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.834 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.834 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:31.834 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635166+0000", 2024-04-19T03:02:31.834 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1505000000000001e-05 2024-04-19T03:02:31.835 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.835 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.835 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:31.835 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635171+0000", 2024-04-19T03:02:31.835 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6040000000000003e-06 2024-04-19T03:02:31.835 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.835 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.835 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:31.835 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635221+0000", 2024-04-19T03:02:31.835 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9947000000000001e-05 2024-04-19T03:02:31.835 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.835 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.835 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:31.835 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635356+0000", 2024-04-19T03:02:31.836 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013576199999999999 2024-04-19T03:02:31.836 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.836 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.836 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:31.836 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635507+0000", 2024-04-19T03:02:31.836 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015072999999999999 2024-04-19T03:02:31.836 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.836 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.836 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:31.836 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.638488+0000", 2024-04-19T03:02:31.836 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0029813159999999999 2024-04-19T03:02:31.836 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.836 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.836 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:31.836 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.828341+0000", 2024-04-19T03:02:31.837 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.189852254 2024-04-19T03:02:31.837 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.837 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.837 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:31.837 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.828416+0000", 2024-04-19T03:02:31.837 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5344000000000002e-05 2024-04-19T03:02:31.837 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.837 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.837 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:31.837 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.828558+0000", 2024-04-19T03:02:31.837 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000141695 2024-04-19T03:02:31.837 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:31.837 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:31.838 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:31.838 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.838 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.838 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:86621 5.8 5:1597a420:::benchmark_data_smithi096_19531_object86620:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:31.838 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:22.635187+0000", 2024-04-19T03:02:31.838 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 9.1700746930000001, 2024-04-19T03:02:31.838 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.194204878, 2024-04-19T03:02:31.838 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:31.838 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:31.838 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:31.838 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:31.838 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:31.838 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 86621 2024-04-19T03:02:31.838 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.839 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:31.839 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.839 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:31.839 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635187+0000", 2024-04-19T03:02:31.839 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:31.839 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.839 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.839 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:31.839 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635187+0000", 2024-04-19T03:02:31.839 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:31.839 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.839 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.839 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:31.839 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635187+0000", 2024-04-19T03:02:31.840 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:31.840 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.840 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.840 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:31.840 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635242+0000", 2024-04-19T03:02:31.840 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5158000000000003e-05 2024-04-19T03:02:31.840 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.840 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.840 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:31.840 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635249+0000", 2024-04-19T03:02:31.840 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.7000000000000008e-06 2024-04-19T03:02:31.840 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.840 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.840 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:31.840 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635256+0000", 2024-04-19T03:02:31.841 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2060000000000004e-06 2024-04-19T03:02:31.841 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.841 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.841 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:31.841 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635302+0000", 2024-04-19T03:02:31.841 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5954000000000001e-05 2024-04-19T03:02:31.841 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.841 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.841 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:31.841 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635427+0000", 2024-04-19T03:02:31.841 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012559299999999999 2024-04-19T03:02:31.841 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.841 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.841 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:31.842 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635596+0000", 2024-04-19T03:02:31.842 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000168615 2024-04-19T03:02:31.842 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.842 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.842 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:31.842 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.639320+0000", 2024-04-19T03:02:31.842 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0037244610000000001 2024-04-19T03:02:31.842 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.842 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.842 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:31.842 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.829277+0000", 2024-04-19T03:02:31.842 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.18995651099999999 2024-04-19T03:02:31.842 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.842 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.843 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:31.843 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.829341+0000", 2024-04-19T03:02:31.843 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3756000000000004e-05 2024-04-19T03:02:31.843 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.843 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.843 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:31.843 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.829392+0000", 2024-04-19T03:02:31.843 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1555999999999999e-05 2024-04-19T03:02:31.843 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:31.843 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:31.843 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:31.843 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.843 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.843 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87062 5.4 5:2d3b5d9a:::benchmark_data_smithi096_19531_object87061:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:31.843 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.136820+0000", 2024-04-19T03:02:31.844 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 8.6684415399999999, 2024-04-19T03:02:31.844 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.066483741999999998, 2024-04-19T03:02:31.844 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:31.844 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:31.844 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:31.844 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:31.844 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:31.844 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87062 2024-04-19T03:02:31.844 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.844 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:31.844 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.844 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:31.844 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.136820+0000", 2024-04-19T03:02:31.844 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:31.845 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.845 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.845 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:31.845 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.136820+0000", 2024-04-19T03:02:31.845 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:31.845 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.845 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.845 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:31.845 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.136819+0000", 2024-04-19T03:02:31.845 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:31.845 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.845 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.845 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:31.845 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.136864+0000", 2024-04-19T03:02:31.846 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4855000000000003e-05 2024-04-19T03:02:31.846 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.846 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.846 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:31.846 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.136881+0000", 2024-04-19T03:02:31.846 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7521999999999999e-05 2024-04-19T03:02:31.846 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.846 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.846 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:31.846 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.136890+0000", 2024-04-19T03:02:31.846 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1039999999999996e-06 2024-04-19T03:02:31.846 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.846 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.846 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:31.847 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.136974+0000", 2024-04-19T03:02:31.847 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3735999999999999e-05 2024-04-19T03:02:31.847 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.847 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.847 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:31.847 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.137308+0000", 2024-04-19T03:02:31.847 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00033376100000000002 2024-04-19T03:02:31.847 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.847 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.847 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:31.847 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.137559+0000", 2024-04-19T03:02:31.847 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000250599 2024-04-19T03:02:31.847 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.847 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.847 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:31.848 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.145423+0000", 2024-04-19T03:02:31.848 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0078649589999999995 2024-04-19T03:02:31.848 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.848 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.848 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:31.848 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.203175+0000", 2024-04-19T03:02:31.848 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057751255000000001 2024-04-19T03:02:31.848 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.848 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.848 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:31.848 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.203250+0000", 2024-04-19T03:02:31.848 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5378999999999998e-05 2024-04-19T03:02:31.848 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.848 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.849 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:31.849 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.203304+0000", 2024-04-19T03:02:31.849 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4015999999999999e-05 2024-04-19T03:02:31.849 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:31.849 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:31.849 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:31.849 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.849 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.849 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87065 5.4 5:21d20a47:::benchmark_data_smithi096_19531_object87064:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:31.849 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.137482+0000", 2024-04-19T03:02:31.849 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 8.6677798060000004, 2024-04-19T03:02:31.849 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.065988749999999999, 2024-04-19T03:02:31.849 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:31.849 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:31.850 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:31.850 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:31.850 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:31.850 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87065 2024-04-19T03:02:31.850 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.850 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:31.850 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.850 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:31.850 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.137482+0000", 2024-04-19T03:02:31.850 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:31.850 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.850 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.850 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:31.850 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.137482+0000", 2024-04-19T03:02:31.851 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:31.851 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.851 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.851 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:31.851 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.137481+0000", 2024-04-19T03:02:31.851 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:31.851 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.851 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.851 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:31.851 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.137530+0000", 2024-04-19T03:02:31.851 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9302000000000003e-05 2024-04-19T03:02:31.851 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.851 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.851 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:31.852 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.137540+0000", 2024-04-19T03:02:31.852 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.2010000000000005e-06 2024-04-19T03:02:31.852 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.852 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.852 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:31.852 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.137545+0000", 2024-04-19T03:02:31.852 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5910000000000003e-06 2024-04-19T03:02:31.852 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.852 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.852 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:31.852 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.140666+0000", 2024-04-19T03:02:31.852 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0031212710000000001 2024-04-19T03:02:31.853 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.853 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.853 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:31.853 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.140847+0000", 2024-04-19T03:02:31.853 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00018065600000000001 2024-04-19T03:02:31.853 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.853 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.853 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:31.853 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.140991+0000", 2024-04-19T03:02:31.853 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014433100000000001 2024-04-19T03:02:31.853 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.853 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.853 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:31.853 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.148053+0000", 2024-04-19T03:02:31.853 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.007061945 2024-04-19T03:02:31.853 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.854 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.854 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:31.854 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.203367+0000", 2024-04-19T03:02:31.854 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.055313703999999998 2024-04-19T03:02:31.854 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.854 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.854 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:31.854 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.203426+0000", 2024-04-19T03:02:31.854 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9024000000000003e-05 2024-04-19T03:02:31.854 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.854 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.854 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:31.854 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.203471+0000", 2024-04-19T03:02:31.855 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4818999999999999e-05 2024-04-19T03:02:31.855 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:31.855 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:31.855 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:31.855 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.855 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.855 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87067 5.b 5:d57af71a:::benchmark_data_smithi096_19531_object87066:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:31.855 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.142233+0000", 2024-04-19T03:02:31.855 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 8.66302883, 2024-04-19T03:02:31.855 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.071692405000000001, 2024-04-19T03:02:31.855 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:31.856 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:31.856 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:31.856 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:31.856 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:31.856 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87067 2024-04-19T03:02:31.856 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.856 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:31.856 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.856 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:31.856 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142233+0000", 2024-04-19T03:02:31.856 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:31.856 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.856 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.857 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:31.857 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142233+0000", 2024-04-19T03:02:31.857 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:31.857 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.857 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.857 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:31.857 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142232+0000", 2024-04-19T03:02:31.857 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:31.857 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.857 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.857 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:31.857 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142277+0000", 2024-04-19T03:02:31.857 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5837000000000002e-05 2024-04-19T03:02:31.858 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.858 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.858 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:31.858 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142297+0000", 2024-04-19T03:02:31.858 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9561000000000001e-05 2024-04-19T03:02:31.858 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.858 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.858 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:31.858 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142311+0000", 2024-04-19T03:02:31.858 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3654e-05 2024-04-19T03:02:31.858 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.858 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.858 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:31.858 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142391+0000", 2024-04-19T03:02:31.859 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0123999999999994e-05 2024-04-19T03:02:31.859 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.859 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.859 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:31.859 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142669+0000", 2024-04-19T03:02:31.859 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00027829800000000001 2024-04-19T03:02:31.859 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.859 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.859 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:31.859 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142859+0000", 2024-04-19T03:02:31.859 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000190051 2024-04-19T03:02:31.859 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.859 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.859 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:31.860 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.150597+0000", 2024-04-19T03:02:31.860 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0077380299999999999 2024-04-19T03:02:31.860 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.860 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.860 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:31.860 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.213855+0000", 2024-04-19T03:02:31.860 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.063257987000000002 2024-04-19T03:02:31.860 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.860 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.860 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:31.860 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.213898+0000", 2024-04-19T03:02:31.860 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2916e-05 2024-04-19T03:02:31.860 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.860 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.861 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:31.861 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.213925+0000", 2024-04-19T03:02:31.861 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7503000000000001e-05 2024-04-19T03:02:31.861 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:31.861 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:31.861 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:31.861 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.861 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.861 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87069 5.b 5:da0c93b5:::benchmark_data_smithi096_19531_object87068:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:31.861 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.143402+0000", 2024-04-19T03:02:31.861 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 8.6618598680000005, 2024-04-19T03:02:31.861 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.070678598999999995, 2024-04-19T03:02:31.861 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:31.861 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:31.862 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:31.862 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:31.862 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:31.862 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87069 2024-04-19T03:02:31.862 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.862 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:31.862 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.862 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:31.862 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.143402+0000", 2024-04-19T03:02:31.862 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:31.862 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.862 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.862 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:31.863 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.143402+0000", 2024-04-19T03:02:31.863 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:31.863 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.863 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.863 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:31.863 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.143401+0000", 2024-04-19T03:02:31.863 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:31.863 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.863 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.863 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:31.863 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.143501+0000", 2024-04-19T03:02:31.863 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000100387 2024-04-19T03:02:31.863 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.863 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.864 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:31.864 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.143516+0000", 2024-04-19T03:02:31.864 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5369000000000001e-05 2024-04-19T03:02:31.864 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.864 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.864 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:31.864 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.143524+0000", 2024-04-19T03:02:31.864 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.7079999999999997e-06 2024-04-19T03:02:31.864 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.864 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.864 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:31.864 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.145550+0000", 2024-04-19T03:02:31.864 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0020259290000000001 2024-04-19T03:02:31.865 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.865 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.865 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:31.865 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.145676+0000", 2024-04-19T03:02:31.865 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000126406 2024-04-19T03:02:31.865 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.865 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.865 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:31.865 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.145802+0000", 2024-04-19T03:02:31.865 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000125974 2024-04-19T03:02:31.865 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.865 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.865 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:31.865 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.151030+0000", 2024-04-19T03:02:31.866 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0052276079999999999 2024-04-19T03:02:31.866 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.866 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.866 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:31.866 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.213998+0000", 2024-04-19T03:02:31.866 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.06296786 2024-04-19T03:02:31.866 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.866 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.866 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:31.866 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.214031+0000", 2024-04-19T03:02:31.866 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3387999999999999e-05 2024-04-19T03:02:31.867 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.867 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.867 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:31.867 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.214081+0000", 2024-04-19T03:02:31.867 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9316e-05 2024-04-19T03:02:31.867 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:31.867 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:31.867 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:31.867 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.867 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.867 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87073 5.0 5:0ca21233:::benchmark_data_smithi096_19531_object87072:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:31.867 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.145929+0000", 2024-04-19T03:02:31.867 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 8.6593326079999997, 2024-04-19T03:02:31.867 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.062283234999999999, 2024-04-19T03:02:31.868 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:31.868 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:31.868 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:31.868 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:31.868 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:31.868 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87073 2024-04-19T03:02:31.868 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.868 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:31.868 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.868 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:31.868 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.145929+0000", 2024-04-19T03:02:31.868 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:31.868 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.868 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.869 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:31.869 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.145929+0000", 2024-04-19T03:02:31.869 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:31.869 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.869 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.869 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:31.869 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.145928+0000", 2024-04-19T03:02:31.869 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:31.869 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.869 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.869 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:31.869 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.146063+0000", 2024-04-19T03:02:31.869 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013541099999999999 2024-04-19T03:02:31.870 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.870 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.870 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:31.870 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.146079+0000", 2024-04-19T03:02:31.870 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5902000000000001e-05 2024-04-19T03:02:31.870 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.870 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.870 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:31.870 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.146100+0000", 2024-04-19T03:02:31.870 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0380000000000001e-05 2024-04-19T03:02:31.870 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.870 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.870 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:31.870 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.146193+0000", 2024-04-19T03:02:31.871 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.3669000000000001e-05 2024-04-19T03:02:31.871 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.871 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.871 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:31.871 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.146388+0000", 2024-04-19T03:02:31.871 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00019457799999999999 2024-04-19T03:02:31.871 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.871 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.871 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:31.871 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.146625+0000", 2024-04-19T03:02:31.871 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00023751999999999999 2024-04-19T03:02:31.871 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.871 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.871 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:31.872 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.151051+0000", 2024-04-19T03:02:31.872 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0044260039999999999 2024-04-19T03:02:31.872 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.872 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.872 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:31.872 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.207872+0000", 2024-04-19T03:02:31.872 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.056821114999999998 2024-04-19T03:02:31.872 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.872 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.872 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:31.872 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.208085+0000", 2024-04-19T03:02:31.872 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000212893 2024-04-19T03:02:31.872 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.872 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.873 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:31.873 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.208213+0000", 2024-04-19T03:02:31.873 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012714700000000001 2024-04-19T03:02:31.873 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:31.873 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:31.873 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:31.873 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.873 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.873 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87074 5.0 5:035614ac:::benchmark_data_smithi096_19531_object87073:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:31.873 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.151387+0000", 2024-04-19T03:02:31.873 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 8.6538746769999992, 2024-04-19T03:02:31.873 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.063461771, 2024-04-19T03:02:31.873 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:31.873 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:31.874 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:31.874 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:31.874 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:31.874 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87074 2024-04-19T03:02:31.874 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.874 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:31.874 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.874 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:31.874 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.151387+0000", 2024-04-19T03:02:31.874 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:31.874 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.874 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.874 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:31.875 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.151387+0000", 2024-04-19T03:02:31.875 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:31.875 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.875 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.875 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:31.875 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.151386+0000", 2024-04-19T03:02:31.875 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:31.875 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.875 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.875 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:31.875 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.151428+0000", 2024-04-19T03:02:31.875 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.172e-05 2024-04-19T03:02:31.875 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.876 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.876 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:31.876 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.151442+0000", 2024-04-19T03:02:31.876 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4328000000000001e-05 2024-04-19T03:02:31.876 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.876 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.876 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:31.876 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.151451+0000", 2024-04-19T03:02:31.876 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.8400000000000001e-06 2024-04-19T03:02:31.876 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.876 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.876 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:31.876 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.151521+0000", 2024-04-19T03:02:31.876 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.9606999999999999e-05 2024-04-19T03:02:31.877 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.877 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.877 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:31.877 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.151749+0000", 2024-04-19T03:02:31.877 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00022818799999999999 2024-04-19T03:02:31.877 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.877 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.877 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:31.877 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.152006+0000", 2024-04-19T03:02:31.877 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00025687300000000002 2024-04-19T03:02:31.877 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.877 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.877 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:31.877 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.154887+0000", 2024-04-19T03:02:31.877 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0028812989999999999 2024-04-19T03:02:31.878 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.878 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.878 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:31.878 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.214733+0000", 2024-04-19T03:02:31.878 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.059846159000000003 2024-04-19T03:02:31.878 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.878 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.878 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:31.878 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.214788+0000", 2024-04-19T03:02:31.878 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4524000000000002e-05 2024-04-19T03:02:31.878 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.878 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.878 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:31.879 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.214849+0000", 2024-04-19T03:02:31.879 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1362e-05 2024-04-19T03:02:31.879 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:31.879 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:31.879 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:31.879 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.879 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.879 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87108 5.e 5:7e197adc:::benchmark_data_smithi096_19531_object87107:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:31.879 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.223103+0000", 2024-04-19T03:02:31.879 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 8.5821585309999993, 2024-04-19T03:02:31.879 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.044946887, 2024-04-19T03:02:31.879 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:31.879 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-19T03:02:31.879 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:31.880 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:31.880 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:31.880 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87108 2024-04-19T03:02:31.880 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.880 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:31.880 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.880 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:31.880 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.223103+0000", 2024-04-19T03:02:31.880 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:31.880 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.880 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.880 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:31.880 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.223103+0000", 2024-04-19T03:02:31.880 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:31.881 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.881 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.881 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:31.881 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.223102+0000", 2024-04-19T03:02:31.881 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:31.881 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.881 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.881 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:31.881 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.223156+0000", 2024-04-19T03:02:31.881 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3958000000000001e-05 2024-04-19T03:02:31.881 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.881 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.881 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:31.881 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.223166+0000", 2024-04-19T03:02:31.881 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.4809999999999995e-06 2024-04-19T03:02:31.881 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.882 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.882 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:31.882 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.223172+0000", 2024-04-19T03:02:31.882 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0140000000000004e-06 2024-04-19T03:02:31.882 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.882 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.882 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:31.882 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.227295+0000", 2024-04-19T03:02:31.882 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0041233420000000003 2024-04-19T03:02:31.882 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.882 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.882 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:31.882 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.227495+0000", 2024-04-19T03:02:31.882 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00019955299999999999 2024-04-19T03:02:31.883 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.883 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.883 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:31.883 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.227717+0000", 2024-04-19T03:02:31.883 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000221902 2024-04-19T03:02:31.883 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.883 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.883 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:31.883 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233189+0000", 2024-04-19T03:02:31.883 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0054718889999999997 2024-04-19T03:02:31.883 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.883 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.883 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:31.883 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.250529+0000", 2024-04-19T03:02:31.884 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.017340298000000001 2024-04-19T03:02:31.884 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.884 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.884 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:02:31.884 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.250539+0000", 2024-04-19T03:02:31.884 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0501e-05 2024-04-19T03:02:31.884 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.884 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.884 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:31.884 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.268003+0000", 2024-04-19T03:02:31.884 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.017463429 2024-04-19T03:02:31.884 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.884 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.884 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:31.885 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.268050+0000", 2024-04-19T03:02:31.885 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7466000000000003e-05 2024-04-19T03:02:31.885 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:31.885 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:31.885 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:31.885 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.885 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.885 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87118 5.b 5:d1bb4f3c:::benchmark_data_smithi096_19531_object87117:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:31.885 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.231082+0000", 2024-04-19T03:02:31.885 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 8.5741796969999999, 2024-04-19T03:02:31.885 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.035789004, 2024-04-19T03:02:31.885 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:31.885 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-19T03:02:31.885 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:31.885 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:31.886 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:31.886 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87118 2024-04-19T03:02:31.886 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.886 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:31.886 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.886 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:31.886 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231082+0000", 2024-04-19T03:02:31.886 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:31.886 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.886 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.886 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:31.886 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231082+0000", 2024-04-19T03:02:31.886 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:31.886 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.887 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.887 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:31.887 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231081+0000", 2024-04-19T03:02:31.887 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:31.887 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.887 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.887 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:31.887 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231159+0000", 2024-04-19T03:02:31.887 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.7819999999999997e-05 2024-04-19T03:02:31.887 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.887 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.887 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:31.887 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231186+0000", 2024-04-19T03:02:31.887 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7126000000000001e-05 2024-04-19T03:02:31.888 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.888 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.888 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:31.888 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231193+0000", 2024-04-19T03:02:31.888 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7259999999999996e-06 2024-04-19T03:02:31.888 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.888 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.888 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:31.888 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231241+0000", 2024-04-19T03:02:31.888 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8123e-05 2024-04-19T03:02:31.888 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.888 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.888 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:31.888 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231354+0000", 2024-04-19T03:02:31.889 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0001133 2024-04-19T03:02:31.889 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.889 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.889 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:31.889 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231443+0000", 2024-04-19T03:02:31.889 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9167999999999997e-05 2024-04-19T03:02:31.889 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.889 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.889 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:31.889 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236498+0000", 2024-04-19T03:02:31.889 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0050545160000000002 2024-04-19T03:02:31.889 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.889 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.889 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:31.890 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.249681+0000", 2024-04-19T03:02:31.890 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013183321 2024-04-19T03:02:31.890 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.890 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.890 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:02:31.890 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.249693+0000", 2024-04-19T03:02:31.890 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1834999999999999e-05 2024-04-19T03:02:31.890 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.890 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.890 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:31.890 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266733+0000", 2024-04-19T03:02:31.890 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.017040408 2024-04-19T03:02:31.890 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.890 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.891 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:31.891 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266871+0000", 2024-04-19T03:02:31.891 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000137849 2024-04-19T03:02:31.891 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:31.891 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:31.891 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:31.891 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.891 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.891 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87121 5.b 5:d01822b8:::benchmark_data_smithi096_19531_object87120:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:31.891 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.233319+0000", 2024-04-19T03:02:31.891 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 8.5719428329999996, 2024-04-19T03:02:31.891 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.033624198, 2024-04-19T03:02:31.891 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:31.892 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-19T03:02:31.892 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:31.892 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:31.892 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:31.892 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87121 2024-04-19T03:02:31.892 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.892 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:31.892 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.892 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:31.892 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233319+0000", 2024-04-19T03:02:31.892 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:31.892 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.892 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.892 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:31.893 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233319+0000", 2024-04-19T03:02:31.893 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:31.893 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.893 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.893 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:31.893 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233319+0000", 2024-04-19T03:02:31.893 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:31.893 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.893 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.893 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:31.893 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233364+0000", 2024-04-19T03:02:31.893 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5460999999999997e-05 2024-04-19T03:02:31.893 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.893 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.893 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:31.893 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233382+0000", 2024-04-19T03:02:31.894 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8148e-05 2024-04-19T03:02:31.894 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.894 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.894 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:31.894 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233390+0000", 2024-04-19T03:02:31.894 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5340000000000002e-06 2024-04-19T03:02:31.894 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.894 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.894 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:31.894 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233712+0000", 2024-04-19T03:02:31.894 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00032260500000000001 2024-04-19T03:02:31.894 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.894 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.895 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:31.895 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233829+0000", 2024-04-19T03:02:31.895 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011638599999999999 2024-04-19T03:02:31.895 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.895 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.895 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:31.895 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233959+0000", 2024-04-19T03:02:31.895 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013013900000000001 2024-04-19T03:02:31.895 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.895 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.895 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:31.895 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236515+0000", 2024-04-19T03:02:31.895 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0025562750000000002 2024-04-19T03:02:31.895 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.896 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.896 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:31.896 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.249723+0000", 2024-04-19T03:02:31.896 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013208176 2024-04-19T03:02:31.896 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.896 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.896 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:02:31.896 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.249728+0000", 2024-04-19T03:02:31.896 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6519999999999997e-06 2024-04-19T03:02:31.896 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.896 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.896 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:31.896 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266837+0000", 2024-04-19T03:02:31.896 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0171087059999999 2024-04-19T03:02:31.896 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.897 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.897 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:31.897 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266943+0000", 2024-04-19T03:02:31.897 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000106604 2024-04-19T03:02:31.897 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:31.897 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:31.897 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:31.897 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.897 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.897 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87124 5.8 5:14819ad7:::benchmark_data_smithi096_19531_object87123:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:31.897 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.235886+0000", 2024-04-19T03:02:31.897 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 8.5693754089999992, 2024-04-19T03:02:31.897 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0315451179999999, 2024-04-19T03:02:31.897 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:31.897 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-19T03:02:31.898 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:31.898 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:31.898 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:31.898 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87124 2024-04-19T03:02:31.898 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.898 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:31.898 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.898 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:31.898 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.235886+0000", 2024-04-19T03:02:31.898 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:31.898 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.898 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.898 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:31.898 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.235886+0000", 2024-04-19T03:02:31.899 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:31.899 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.899 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.901 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:31.901 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.235886+0000", 2024-04-19T03:02:31.901 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:31.901 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.902 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.902 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:31.902 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.235934+0000", 2024-04-19T03:02:31.902 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8384000000000003e-05 2024-04-19T03:02:31.902 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.902 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.902 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:31.902 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.235945+0000", 2024-04-19T03:02:31.902 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0671e-05 2024-04-19T03:02:31.902 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.902 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.902 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:31.902 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.235952+0000", 2024-04-19T03:02:31.902 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3089999999999998e-06 2024-04-19T03:02:31.903 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.903 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.903 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:31.903 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.237067+0000", 2024-04-19T03:02:31.903 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001115263 2024-04-19T03:02:31.903 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.903 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.903 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:31.903 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.237188+0000", 2024-04-19T03:02:31.903 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000121258 2024-04-19T03:02:31.903 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.903 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.903 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:31.903 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.237316+0000", 2024-04-19T03:02:31.903 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000128071 2024-04-19T03:02:31.904 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.904 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.904 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:31.904 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240744+0000", 2024-04-19T03:02:31.904 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0034275629999999998 2024-04-19T03:02:31.904 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.904 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.904 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:31.904 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.252517+0000", 2024-04-19T03:02:31.904 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011772991999999999 2024-04-19T03:02:31.904 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.904 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.904 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:02:31.904 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.252523+0000", 2024-04-19T03:02:31.904 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3640000000000004e-06 2024-04-19T03:02:31.904 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.905 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.905 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:31.905 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.267290+0000", 2024-04-19T03:02:31.905 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0147665690000001 2024-04-19T03:02:31.905 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.905 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.905 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:31.905 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.267432+0000", 2024-04-19T03:02:31.905 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014165299999999999 2024-04-19T03:02:31.905 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:31.905 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:31.905 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:31.905 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.906 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.906 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87129 5.0 5:02667e01:::benchmark_data_smithi096_19531_object87128:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:31.906 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.236466+0000", 2024-04-19T03:02:31.906 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 8.5687954130000001, 2024-04-19T03:02:31.906 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0301534510000001, 2024-04-19T03:02:31.906 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:31.906 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-19T03:02:31.906 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:31.906 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:31.906 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:31.906 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87129 2024-04-19T03:02:31.906 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.906 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:31.907 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.907 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:31.907 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236466+0000", 2024-04-19T03:02:31.907 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:31.907 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.907 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.907 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:31.907 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236466+0000", 2024-04-19T03:02:31.907 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:31.907 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.907 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.907 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:31.907 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236465+0000", 2024-04-19T03:02:31.907 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:31.908 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.908 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.908 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:31.908 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236566+0000", 2024-04-19T03:02:31.908 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010047000000000001 2024-04-19T03:02:31.908 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.908 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.908 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:31.908 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236577+0000", 2024-04-19T03:02:31.908 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1772e-05 2024-04-19T03:02:31.908 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.908 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.908 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:31.908 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236584+0000", 2024-04-19T03:02:31.908 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0530000000000003e-06 2024-04-19T03:02:31.908 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.908 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.909 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:31.909 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.237023+0000", 2024-04-19T03:02:31.909 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000439703 2024-04-19T03:02:31.909 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.909 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.909 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:31.909 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.237207+0000", 2024-04-19T03:02:31.909 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000183692 2024-04-19T03:02:31.909 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.909 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.909 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:31.909 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.237373+0000", 2024-04-19T03:02:31.909 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016623500000000001 2024-04-19T03:02:31.909 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.909 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.910 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:31.910 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.241461+0000", 2024-04-19T03:02:31.910 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0040883050000000004 2024-04-19T03:02:31.910 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.910 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.910 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:31.910 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.252500+0000", 2024-04-19T03:02:31.910 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011038450999999999 2024-04-19T03:02:31.910 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.910 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.910 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:02:31.910 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.252507+0000", 2024-04-19T03:02:31.910 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2439999999999996e-06 2024-04-19T03:02:31.911 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.911 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.911 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:31.911 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266538+0000", 2024-04-19T03:02:31.911 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.014031184 2024-04-19T03:02:31.911 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.911 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.911 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:31.911 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266620+0000", 2024-04-19T03:02:31.911 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1600000000000005e-05 2024-04-19T03:02:31.911 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:31.911 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:31.911 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:31.911 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.911 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.912 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87135 5.4 5:2a97e7b7:::benchmark_data_smithi096_19531_object87134:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:31.912 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.240884+0000", 2024-04-19T03:02:31.912 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 8.5643779559999995, 2024-04-19T03:02:31.912 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.025708931, 2024-04-19T03:02:31.912 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:31.912 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-19T03:02:31.912 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:31.912 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:31.912 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:31.912 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87135 2024-04-19T03:02:31.912 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.912 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:31.912 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.912 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:31.912 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240884+0000", 2024-04-19T03:02:31.913 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:31.913 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.913 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.913 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:31.913 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240884+0000", 2024-04-19T03:02:31.913 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:31.913 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.913 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.913 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:31.913 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240883+0000", 2024-04-19T03:02:31.913 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:31.913 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.913 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.913 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:31.913 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240933+0000", 2024-04-19T03:02:31.913 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9969999999999998e-05 2024-04-19T03:02:31.914 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.914 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.914 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:31.914 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240946+0000", 2024-04-19T03:02:31.914 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2943e-05 2024-04-19T03:02:31.914 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.914 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.914 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:31.914 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240952+0000", 2024-04-19T03:02:31.914 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8930000000000002e-06 2024-04-19T03:02:31.914 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.914 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.914 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:31.914 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240994+0000", 2024-04-19T03:02:31.915 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2753999999999998e-05 2024-04-19T03:02:31.915 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.915 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.915 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:31.915 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.241092+0000", 2024-04-19T03:02:31.915 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.7447000000000004e-05 2024-04-19T03:02:31.915 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.915 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.915 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:31.915 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.241183+0000", 2024-04-19T03:02:31.915 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1163999999999997e-05 2024-04-19T03:02:31.915 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.915 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.915 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:31.916 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.254672+0000", 2024-04-19T03:02:31.916 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.01348864 2024-04-19T03:02:31.916 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.916 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.916 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:02:31.916 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.254681+0000", 2024-04-19T03:02:31.916 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.3789999999999995e-06 2024-04-19T03:02:31.916 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.916 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.916 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:31.916 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266456+0000", 2024-04-19T03:02:31.916 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.011774621 2024-04-19T03:02:31.916 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.916 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.916 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:31.916 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266593+0000", 2024-04-19T03:02:31.916 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013737600000000001 2024-04-19T03:02:31.917 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:31.917 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:31.917 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:31.917 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.917 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.917 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87136 5.4 5:212411bc:::benchmark_data_smithi096_19531_object87135:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:31.917 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.240962+0000", 2024-04-19T03:02:31.917 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 8.5643000800000006, 2024-04-19T03:02:31.917 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.025738, 2024-04-19T03:02:31.917 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:31.917 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-19T03:02:31.917 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:31.917 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:31.917 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:31.917 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87136 2024-04-19T03:02:31.917 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.918 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:31.918 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.918 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:31.918 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240962+0000", 2024-04-19T03:02:31.918 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:31.918 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.918 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.918 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:31.918 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240962+0000", 2024-04-19T03:02:31.918 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:31.918 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.918 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.918 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:31.918 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240961+0000", 2024-04-19T03:02:31.919 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:31.919 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.919 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.919 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:31.919 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240995+0000", 2024-04-19T03:02:31.919 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3868000000000002e-05 2024-04-19T03:02:31.919 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.919 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.919 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:31.919 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.241001+0000", 2024-04-19T03:02:31.919 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.322e-06 2024-04-19T03:02:31.919 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.919 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.920 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:31.920 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.241004+0000", 2024-04-19T03:02:31.920 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3510000000000002e-06 2024-04-19T03:02:31.920 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.920 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.920 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:31.920 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247131+0000", 2024-04-19T03:02:31.920 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0061270869999999998 2024-04-19T03:02:31.920 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.920 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.920 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:31.920 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247322+0000", 2024-04-19T03:02:31.920 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000191015 2024-04-19T03:02:31.920 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.920 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.920 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:31.921 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247542+0000", 2024-04-19T03:02:31.921 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00022030199999999999 2024-04-19T03:02:31.921 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.921 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.921 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:31.921 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.254709+0000", 2024-04-19T03:02:31.921 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0071662660000000001 2024-04-19T03:02:31.921 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.921 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.921 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:02:31.921 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.254716+0000", 2024-04-19T03:02:31.921 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3860000000000001e-06 2024-04-19T03:02:31.921 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.921 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.922 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:31.922 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266619+0000", 2024-04-19T03:02:31.922 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0119031030000001 2024-04-19T03:02:31.922 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.922 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.922 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:31.922 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266700+0000", 2024-04-19T03:02:31.922 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0764000000000001e-05 2024-04-19T03:02:31.922 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:31.922 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:31.922 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:31.922 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.922 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.923 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87138 5.e 5:7b1f1c20:::benchmark_data_smithi096_19531_object87137:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:31.923 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.247862+0000", 2024-04-19T03:02:31.923 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 8.5574000059999999, 2024-04-19T03:02:31.923 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.024457079, 2024-04-19T03:02:31.923 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:31.923 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:31.923 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:31.923 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:31.923 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:31.923 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87138 2024-04-19T03:02:31.923 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.923 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:31.923 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.924 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:31.924 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247862+0000", 2024-04-19T03:02:31.924 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:31.924 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.924 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.924 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:31.924 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247862+0000", 2024-04-19T03:02:31.924 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:31.924 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.924 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.924 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:31.924 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247860+0000", 2024-04-19T03:02:31.924 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999981 2024-04-19T03:02:31.924 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.925 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.925 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:31.925 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247909+0000", 2024-04-19T03:02:31.925 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9150999999999997e-05 2024-04-19T03:02:31.925 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.925 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.925 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:31.925 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247925+0000", 2024-04-19T03:02:31.925 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5761999999999999e-05 2024-04-19T03:02:31.925 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.925 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.925 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:31.925 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247936+0000", 2024-04-19T03:02:31.925 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1144e-05 2024-04-19T03:02:31.926 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.926 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.926 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:31.926 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.250590+0000", 2024-04-19T03:02:31.926 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.002653678 2024-04-19T03:02:31.926 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.926 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.926 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:02:31.926 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.250599+0000", 2024-04-19T03:02:31.926 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9039999999999998e-06 2024-04-19T03:02:31.926 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.926 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.926 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:31.927 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.268151+0000", 2024-04-19T03:02:31.927 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0175523449999999 2024-04-19T03:02:31.927 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.927 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.927 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:31.927 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.268285+0000", 2024-04-19T03:02:31.927 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013415599999999999 2024-04-19T03:02:31.927 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.927 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.927 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:31.927 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.272238+0000", 2024-04-19T03:02:31.927 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0039533019999999997 2024-04-19T03:02:31.927 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.927 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.927 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:31.928 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.272274+0000", 2024-04-19T03:02:31.928 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5352000000000003e-05 2024-04-19T03:02:31.928 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:31.928 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:31.928 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:31.928 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.272319+0000", 2024-04-19T03:02:31.928 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5281999999999998e-05 2024-04-19T03:02:31.928 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:31.928 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:31.928 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:31.928 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:31.928 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:31.928 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-19T03:02:31.929 INFO:tasks.radosbench.radosbench.0.smithi096.stdout: 54 16 101682 101666 117.655 123.062 0.00934775 0.0084939 2024-04-19T03:02:31.930 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T03:02:31.931 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:31.927+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:32.031 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:32.027+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:32.062 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-04-19T03:02:32.062 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [ 2024-04-19T03:02:32.062 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.062 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:102135 5.9 5:91f34250:::benchmark_data_smithi096_19531_object102134:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-19T03:02:32.062 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:32.056278+0000", 2024-04-19T03:02:32.062 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.004278291, 2024-04-19T03:02:32.063 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0043038529999999998, 2024-04-19T03:02:32.063 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:32.063 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:02:32.063 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:32.063 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:32.063 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:32.063 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 102135 2024-04-19T03:02:32.063 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.064 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:32.064 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.064 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:32.064 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:32.056278+0000", 2024-04-19T03:02:32.064 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:32.064 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.064 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.064 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:32.065 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:32.056278+0000", 2024-04-19T03:02:32.065 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:32.065 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.065 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.065 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:32.065 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:32.056277+0000", 2024-04-19T03:02:32.065 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:32.065 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.065 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.065 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:32.065 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:32.056373+0000", 2024-04-19T03:02:32.065 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.5857000000000001e-05 2024-04-19T03:02:32.066 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.066 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.066 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:32.066 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:32.056383+0000", 2024-04-19T03:02:32.066 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0200000000000001e-05 2024-04-19T03:02:32.066 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.066 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.066 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:32.066 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:32.056391+0000", 2024-04-19T03:02:32.066 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.3209999999999999e-06 2024-04-19T03:02:32.066 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.066 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.066 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:32.066 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:32.056466+0000", 2024-04-19T03:02:32.067 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5030000000000005e-05 2024-04-19T03:02:32.067 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.067 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.067 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:32.067 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:32.056646+0000", 2024-04-19T03:02:32.067 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00018001399999999999 2024-04-19T03:02:32.067 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.067 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.067 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:02:32.067 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:32.056725+0000", 2024-04-19T03:02:32.067 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9362000000000004e-05 2024-04-19T03:02:32.067 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.068 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.068 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:32.068 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:32.059519+0000", 2024-04-19T03:02:32.068 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0027938659999999999 2024-04-19T03:02:32.068 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:32.068 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:32.068 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:32.068 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.068 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.068 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4755.0:102136 5.d e46/22 5:b05baa1c:::benchmark_data_smithi096_19531_object102135:head v 46'6441, mlcod=46'6438)", 2024-04-19T03:02:32.068 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:32.057609+0000", 2024-04-19T03:02:32.068 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0029472729999999998, 2024-04-19T03:02:32.068 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0030461939999999999, 2024-04-19T03:02:32.069 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:32.069 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-04-19T03:02:32.069 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:32.069 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.069 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:32.069 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:32.057609+0000", 2024-04-19T03:02:32.069 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:32.069 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.069 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.069 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:32.069 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:32.057609+0000", 2024-04-19T03:02:32.070 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:32.070 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.070 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.070 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:32.070 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:32.057608+0000", 2024-04-19T03:02:32.070 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:32.070 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.070 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.070 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:32.070 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:32.057671+0000", 2024-04-19T03:02:32.070 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2379999999999996e-05 2024-04-19T03:02:32.070 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.070 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.071 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:32.071 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:32.057683+0000", 2024-04-19T03:02:32.071 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1644999999999999e-05 2024-04-19T03:02:32.071 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.071 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.071 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:32.071 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:32.057690+0000", 2024-04-19T03:02:32.071 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4780000000000002e-06 2024-04-19T03:02:32.072 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.072 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.072 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:32.072 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:32.057729+0000", 2024-04-19T03:02:32.072 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8642e-05 2024-04-19T03:02:32.072 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.072 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.072 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:32.072 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:32.057743+0000", 2024-04-19T03:02:32.072 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4037e-05 2024-04-19T03:02:32.072 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:32.073 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:32.073 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:32.073 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.073 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.073 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:102140 5.c 5:3b4a8972:::benchmark_data_smithi096_19531_object102139:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-19T03:02:32.073 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:32.059430+0000", 2024-04-19T03:02:32.073 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0011262430000000001, 2024-04-19T03:02:32.073 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0012590419999999999, 2024-04-19T03:02:32.073 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:32.073 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-04-19T03:02:32.073 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:32.073 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:32.073 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:32.074 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 102140 2024-04-19T03:02:32.074 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.074 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:32.074 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.074 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:32.074 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:32.059430+0000", 2024-04-19T03:02:32.074 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:32.074 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.074 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.074 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:32.074 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:32.059430+0000", 2024-04-19T03:02:32.074 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:32.074 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.075 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.075 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:32.075 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:32.059416+0000", 2024-04-19T03:02:32.075 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999852 2024-04-19T03:02:32.075 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.075 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.075 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:32.075 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:32.059500+0000", 2024-04-19T03:02:32.075 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4269000000000002e-05 2024-04-19T03:02:32.075 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.075 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.075 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:32.075 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:32.059527+0000", 2024-04-19T03:02:32.076 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.6687e-05 2024-04-19T03:02:32.076 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.076 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.076 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:32.076 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:32.059547+0000", 2024-04-19T03:02:32.076 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0304000000000001e-05 2024-04-19T03:02:32.076 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.076 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.076 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:32.077 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:32.059585+0000", 2024-04-19T03:02:32.077 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8260999999999998e-05 2024-04-19T03:02:32.077 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.077 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.077 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:32.077 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:32.059681+0000", 2024-04-19T03:02:32.077 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.5649999999999994e-05 2024-04-19T03:02:32.077 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:32.077 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:32.077 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:32.077 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.077 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.077 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:102141 5.6 5:6da170e4:::benchmark_data_smithi096_19531_object102140:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-19T03:02:32.077 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:32.059565+0000", 2024-04-19T03:02:32.078 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.00099204200000000005, 2024-04-19T03:02:32.078 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001189449, 2024-04-19T03:02:32.078 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:32.078 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-04-19T03:02:32.078 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:32.078 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:32.078 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:32.078 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 102141 2024-04-19T03:02:32.078 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.078 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:32.078 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.078 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:32.078 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:32.059565+0000", 2024-04-19T03:02:32.079 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:32.079 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.079 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.079 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:32.079 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:32.059565+0000", 2024-04-19T03:02:32.079 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:32.079 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.079 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.079 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:32.079 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:32.059564+0000", 2024-04-19T03:02:32.079 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:32.079 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.080 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.080 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:32.080 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:32.059600+0000", 2024-04-19T03:02:32.080 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5811e-05 2024-04-19T03:02:32.080 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.080 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.080 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:32.080 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:32.059608+0000", 2024-04-19T03:02:32.080 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0160000000000008e-06 2024-04-19T03:02:32.080 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.080 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.080 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:32.080 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:32.059614+0000", 2024-04-19T03:02:32.080 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3779999999999998e-06 2024-04-19T03:02:32.081 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.081 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.081 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:32.081 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:32.059668+0000", 2024-04-19T03:02:32.081 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3303000000000001e-05 2024-04-19T03:02:32.081 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.081 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.081 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:32.081 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:32.059793+0000", 2024-04-19T03:02:32.081 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00012568099999999999 2024-04-19T03:02:32.081 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:32.081 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:32.081 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:32.081 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.081 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.082 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:102142 5.2 5:4e48f32d:::benchmark_data_smithi096_19531_object102141:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-19T03:02:32.082 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:32.059634+0000", 2024-04-19T03:02:32.082 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.00092313699999999998, 2024-04-19T03:02:32.082 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0011817240000000001, 2024-04-19T03:02:32.082 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:32.082 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-04-19T03:02:32.082 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:32.082 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:32.082 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:32.082 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 102142 2024-04-19T03:02:32.082 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.082 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:32.082 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.083 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:32.083 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:32.059634+0000", 2024-04-19T03:02:32.083 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:32.083 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.083 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.083 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:32.083 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:32.059634+0000", 2024-04-19T03:02:32.083 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:32.083 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.083 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.083 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:32.083 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:32.059633+0000", 2024-04-19T03:02:32.083 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:32.083 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.084 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.084 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:32.084 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:32.059663+0000", 2024-04-19T03:02:32.084 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0290999999999998e-05 2024-04-19T03:02:32.084 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.084 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.084 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:32.084 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:32.059670+0000", 2024-04-19T03:02:32.084 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.3889999999999999e-06 2024-04-19T03:02:32.084 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.084 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.084 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:32.084 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:32.059678+0000", 2024-04-19T03:02:32.084 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0739999999999993e-06 2024-04-19T03:02:32.084 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.085 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.085 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:32.085 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:32.059720+0000", 2024-04-19T03:02:32.085 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1480999999999998e-05 2024-04-19T03:02:32.085 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.085 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.085 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:32.085 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:32.059841+0000", 2024-04-19T03:02:32.085 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000120973 2024-04-19T03:02:32.085 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:32.085 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:32.085 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:32.085 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.085 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.086 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:102143 5.5 5:a82fe75e:::benchmark_data_smithi096_19531_object102142:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-19T03:02:32.086 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:32.060414+0000", 2024-04-19T03:02:32.086 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.000142946, 2024-04-19T03:02:32.086 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00046523300000000001, 2024-04-19T03:02:32.086 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:32.086 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-04-19T03:02:32.086 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:32.086 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:32.086 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:32.086 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 102143 2024-04-19T03:02:32.087 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.087 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:32.087 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.087 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:32.087 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:32.060414+0000", 2024-04-19T03:02:32.087 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:32.087 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.087 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.087 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:32.087 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:32.060414+0000", 2024-04-19T03:02:32.088 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:32.088 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.088 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.088 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:32.088 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:32.060413+0000", 2024-04-19T03:02:32.088 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:32.088 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.088 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.088 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:32.088 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:32.060468+0000", 2024-04-19T03:02:32.088 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5145999999999997e-05 2024-04-19T03:02:32.088 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.088 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.088 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:32.088 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:32.060478+0000", 2024-04-19T03:02:32.089 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.8230000000000006e-06 2024-04-19T03:02:32.089 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.089 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.089 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:32.089 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:32.060485+0000", 2024-04-19T03:02:32.089 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.3599999999999998e-06 2024-04-19T03:02:32.089 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.089 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.089 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:32.089 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:32.060730+0000", 2024-04-19T03:02:32.089 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00024455700000000001 2024-04-19T03:02:32.089 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.089 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.089 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:32.090 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:32.060855+0000", 2024-04-19T03:02:32.090 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000124781 2024-04-19T03:02:32.090 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:32.090 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:32.090 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:32.090 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.090 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.090 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:102145 5.f 5:fd8cc122:::benchmark_data_smithi096_19531_object102144:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-19T03:02:32.090 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:32.060780+0000", 2024-04-19T03:02:32.090 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4294967295.9997768, 2024-04-19T03:02:32.090 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00017062300000000001, 2024-04-19T03:02:32.090 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:32.090 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-04-19T03:02:32.091 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:32.091 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:32.091 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:32.091 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 102145 2024-04-19T03:02:32.091 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.091 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:32.091 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.091 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:32.091 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:32.060780+0000", 2024-04-19T03:02:32.091 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:32.091 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.091 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.091 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:32.092 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:32.060780+0000", 2024-04-19T03:02:32.092 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:32.092 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.092 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.092 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:32.092 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:32.060779+0000", 2024-04-19T03:02:32.092 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:32.092 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.092 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.092 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:32.092 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:32.060831+0000", 2024-04-19T03:02:32.092 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2176999999999999e-05 2024-04-19T03:02:32.092 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.092 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.093 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:32.093 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:32.060838+0000", 2024-04-19T03:02:32.093 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5420000000000002e-06 2024-04-19T03:02:32.093 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.093 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.093 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:32.093 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:32.060842+0000", 2024-04-19T03:02:32.093 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5009999999999998e-06 2024-04-19T03:02:32.093 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.093 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.093 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:32.093 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:32.060872+0000", 2024-04-19T03:02:32.093 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0287999999999999e-05 2024-04-19T03:02:32.094 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:32.094 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:32.094 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:32.094 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:32.094 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-04-19T03:02:32.094 INFO:teuthology.orchestra.run.smithi144.stdout: "num_ops": 7 2024-04-19T03:02:32.094 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-04-19T03:02:32.095 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T03:02:32.132 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:32.129+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:32.226 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-04-19T03:02:32.226 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2024-04-19T03:02:32.226 INFO:teuthology.orchestra.run.smithi144.stdout: "complaint_time": 30, 2024-04-19T03:02:32.226 INFO:teuthology.orchestra.run.smithi144.stdout: "num_blocked_ops": 0 2024-04-19T03:02:32.226 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-04-19T03:02:32.232 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:32.231+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:32.239 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T03:02:32.333 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:32.331+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:32.342 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-19T03:02:32.363 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-04-19T03:02:32.364 INFO:teuthology.orchestra.run.smithi144.stdout: "size": 20, 2024-04-19T03:02:32.364 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 600, 2024-04-19T03:02:32.364 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [ 2024-04-19T03:02:32.364 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.364 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:78992 5.7 5:e6baa862:::benchmark_data_smithi096_19531_object78991:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-19T03:02:32.364 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:18.008888+0000", 2024-04-19T03:02:32.364 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 14.352424768000001, 2024-04-19T03:02:32.364 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.056375285999999997, 2024-04-19T03:02:32.364 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:32.364 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:32.364 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:32.365 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:32.365 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:32.365 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 78992 2024-04-19T03:02:32.365 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.365 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:32.365 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.365 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:32.365 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.008888+0000", 2024-04-19T03:02:32.365 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:32.365 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.365 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.365 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:32.365 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.008888+0000", 2024-04-19T03:02:32.365 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:32.366 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.366 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.366 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:32.366 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.008888+0000", 2024-04-19T03:02:32.366 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:32.366 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.366 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.366 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:32.366 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.008928+0000", 2024-04-19T03:02:32.366 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0361999999999997e-05 2024-04-19T03:02:32.366 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.366 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.366 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:32.367 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.008942+0000", 2024-04-19T03:02:32.367 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4365000000000001e-05 2024-04-19T03:02:32.367 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.367 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.367 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:32.367 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.008949+0000", 2024-04-19T03:02:32.367 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.212e-06 2024-04-19T03:02:32.367 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.367 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.367 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:32.367 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.012683+0000", 2024-04-19T03:02:32.367 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.003733934 2024-04-19T03:02:32.368 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.368 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.368 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:32.368 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.012798+0000", 2024-04-19T03:02:32.368 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00011574999999999999 2024-04-19T03:02:32.368 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.368 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.368 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:32.368 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.012896+0000", 2024-04-19T03:02:32.368 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.7848000000000002e-05 2024-04-19T03:02:32.368 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.368 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.368 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:32.368 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016423+0000", 2024-04-19T03:02:32.369 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0035270789999999998 2024-04-19T03:02:32.369 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.369 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.369 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:32.369 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.065098+0000", 2024-04-19T03:02:32.369 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.048674651999999999 2024-04-19T03:02:32.369 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.369 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.369 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:32.369 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.065193+0000", 2024-04-19T03:02:32.369 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.5087999999999995e-05 2024-04-19T03:02:32.369 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.370 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.370 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:32.370 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.065264+0000", 2024-04-19T03:02:32.370 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0666000000000004e-05 2024-04-19T03:02:32.370 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:32.370 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:32.370 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:32.370 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.370 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.370 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:78998 5.7 5:ee23c1bc:::benchmark_data_smithi096_19531_object78997:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-19T03:02:32.370 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:18.013165+0000", 2024-04-19T03:02:32.370 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 14.348148062, 2024-04-19T03:02:32.370 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.052410864000000001, 2024-04-19T03:02:32.371 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:32.371 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:32.371 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:32.371 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:32.371 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:32.371 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 78998 2024-04-19T03:02:32.371 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.371 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:32.371 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.371 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:32.371 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.013165+0000", 2024-04-19T03:02:32.371 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:32.371 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.372 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.372 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:32.372 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.013165+0000", 2024-04-19T03:02:32.372 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:32.372 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.372 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.372 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:32.372 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.013164+0000", 2024-04-19T03:02:32.372 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:32.372 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.372 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.372 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:32.373 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.013214+0000", 2024-04-19T03:02:32.373 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9636999999999999e-05 2024-04-19T03:02:32.373 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.373 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.373 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:32.373 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.013223+0000", 2024-04-19T03:02:32.373 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.3619999999999995e-06 2024-04-19T03:02:32.373 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.373 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.373 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:32.373 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.013229+0000", 2024-04-19T03:02:32.373 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6060000000000002e-06 2024-04-19T03:02:32.373 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.373 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.374 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:32.374 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.014882+0000", 2024-04-19T03:02:32.374 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001653257 2024-04-19T03:02:32.374 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.374 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.374 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:32.374 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.014958+0000", 2024-04-19T03:02:32.374 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6398999999999998e-05 2024-04-19T03:02:32.374 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.374 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.374 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:32.374 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.015036+0000", 2024-04-19T03:02:32.374 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8070000000000003e-05 2024-04-19T03:02:32.375 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.375 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.375 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:32.375 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018099+0000", 2024-04-19T03:02:32.375 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0030631149999999999 2024-04-19T03:02:32.375 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.375 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.375 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:32.375 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.065328+0000", 2024-04-19T03:02:32.375 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.047228349000000003 2024-04-19T03:02:32.375 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.375 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.376 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:32.376 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.065508+0000", 2024-04-19T03:02:32.376 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00018036899999999999 2024-04-19T03:02:32.376 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.376 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.376 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:32.376 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.065576+0000", 2024-04-19T03:02:32.376 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7785000000000002e-05 2024-04-19T03:02:32.376 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:32.376 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:32.376 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:32.376 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.376 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.377 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4755.0:78995 5.2 e40/39 5:42b55e12:::benchmark_data_smithi096_19531_object78994:head v 40'4934, mlcod=40'4932)", 2024-04-19T03:02:32.377 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:18.016247+0000", 2024-04-19T03:02:32.377 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 14.3450661, 2024-04-19T03:02:32.377 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.056240406, 2024-04-19T03:02:32.377 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:32.377 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:32.377 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:32.377 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.377 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:32.377 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016247+0000", 2024-04-19T03:02:32.377 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:32.377 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.377 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.378 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:32.378 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016247+0000", 2024-04-19T03:02:32.378 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:32.378 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.378 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.378 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:32.378 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016246+0000", 2024-04-19T03:02:32.378 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:32.378 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.378 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.378 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:32.378 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016315+0000", 2024-04-19T03:02:32.379 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8979000000000005e-05 2024-04-19T03:02:32.379 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.379 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.379 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:32.379 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016333+0000", 2024-04-19T03:02:32.379 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7586999999999999e-05 2024-04-19T03:02:32.379 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.379 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.379 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:32.379 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016340+0000", 2024-04-19T03:02:32.379 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4080000000000001e-06 2024-04-19T03:02:32.379 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.379 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.379 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:32.380 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016384+0000", 2024-04-19T03:02:32.380 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3656999999999999e-05 2024-04-19T03:02:32.380 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.380 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.380 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:32.380 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016403+0000", 2024-04-19T03:02:32.380 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9089e-05 2024-04-19T03:02:32.380 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.380 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.380 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:32.380 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.072448+0000", 2024-04-19T03:02:32.380 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.056045084000000002 2024-04-19T03:02:32.381 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.381 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.381 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:32.381 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.072487+0000", 2024-04-19T03:02:32.381 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9362e-05 2024-04-19T03:02:32.381 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:32.381 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:32.381 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:32.381 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.381 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.381 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4755.0:78994 5.c e40/22 5:3c60d55d:::benchmark_data_smithi096_19531_object78993:head v 40'4989, mlcod=40'4987)", 2024-04-19T03:02:32.381 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:18.016392+0000", 2024-04-19T03:02:32.381 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 14.344921459, 2024-04-19T03:02:32.381 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.052629620000000002, 2024-04-19T03:02:32.382 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:32.382 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:32.382 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:32.382 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.382 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:32.382 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016392+0000", 2024-04-19T03:02:32.382 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:32.382 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.382 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.382 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:32.382 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016392+0000", 2024-04-19T03:02:32.382 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:32.382 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.383 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.383 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:32.383 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016391+0000", 2024-04-19T03:02:32.383 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:32.383 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.383 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.383 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:32.383 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016471+0000", 2024-04-19T03:02:32.383 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9346999999999998e-05 2024-04-19T03:02:32.383 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.383 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.383 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:32.383 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016478+0000", 2024-04-19T03:02:32.383 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.593e-06 2024-04-19T03:02:32.384 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.384 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.384 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:32.384 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016495+0000", 2024-04-19T03:02:32.384 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6492999999999999e-05 2024-04-19T03:02:32.384 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.384 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.384 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:32.384 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016539+0000", 2024-04-19T03:02:32.384 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4715999999999997e-05 2024-04-19T03:02:32.384 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.384 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.384 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:32.384 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016551+0000", 2024-04-19T03:02:32.385 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2096000000000001e-05 2024-04-19T03:02:32.385 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.385 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.385 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:32.385 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.068985+0000", 2024-04-19T03:02:32.385 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.052433754999999999 2024-04-19T03:02:32.385 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.385 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.385 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:32.385 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.069021+0000", 2024-04-19T03:02:32.385 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6047000000000002e-05 2024-04-19T03:02:32.385 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:32.385 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:32.386 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:32.386 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.386 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.386 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4755.0:78996 5.1 e40/39 5:87f59708:::benchmark_data_smithi096_19531_object78995:head v 40'4940, mlcod=40'4938)", 2024-04-19T03:02:32.386 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:18.016581+0000", 2024-04-19T03:02:32.386 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 14.344732294, 2024-04-19T03:02:32.386 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.052051785000000003, 2024-04-19T03:02:32.386 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:32.386 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:32.386 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:32.386 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.386 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:32.386 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016581+0000", 2024-04-19T03:02:32.387 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:32.387 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.387 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.387 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:32.387 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016581+0000", 2024-04-19T03:02:32.387 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:32.387 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.387 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.387 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:32.387 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016581+0000", 2024-04-19T03:02:32.387 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:32.387 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.388 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.388 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:32.388 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016610+0000", 2024-04-19T03:02:32.388 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9556999999999998e-05 2024-04-19T03:02:32.388 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.388 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.388 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:32.388 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016616+0000", 2024-04-19T03:02:32.388 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1090000000000003e-06 2024-04-19T03:02:32.388 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.388 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.388 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:32.388 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016621+0000", 2024-04-19T03:02:32.388 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.454e-06 2024-04-19T03:02:32.389 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.389 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.389 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:32.389 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016663+0000", 2024-04-19T03:02:32.389 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2582e-05 2024-04-19T03:02:32.389 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.389 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.389 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:32.389 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016681+0000", 2024-04-19T03:02:32.389 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7680999999999999e-05 2024-04-19T03:02:32.389 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.389 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.389 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:32.390 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.068486+0000", 2024-04-19T03:02:32.390 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.051804624000000001 2024-04-19T03:02:32.390 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.390 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.390 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:32.390 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.068633+0000", 2024-04-19T03:02:32.390 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00014709099999999999 2024-04-19T03:02:32.390 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:32.390 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:32.390 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:32.390 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.390 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.390 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4755.0:78999 5.3 e40/22 5:c9ec5f7f:::benchmark_data_smithi096_19531_object78998:head v 40'4893, mlcod=40'4889)", 2024-04-19T03:02:32.391 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:18.016633+0000", 2024-04-19T03:02:32.391 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 14.344680438999999, 2024-04-19T03:02:32.391 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.051090469999999999, 2024-04-19T03:02:32.391 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:32.391 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:32.391 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:32.391 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.391 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:32.391 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016633+0000", 2024-04-19T03:02:32.391 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:32.391 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.391 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.391 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:32.391 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016633+0000", 2024-04-19T03:02:32.392 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:32.392 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.392 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.392 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:32.392 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016632+0000", 2024-04-19T03:02:32.392 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967296 2024-04-19T03:02:32.392 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.392 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.392 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:32.392 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016660+0000", 2024-04-19T03:02:32.392 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7869999999999999e-05 2024-04-19T03:02:32.392 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.392 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.393 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:32.393 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016667+0000", 2024-04-19T03:02:32.393 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0280000000000003e-06 2024-04-19T03:02:32.393 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.393 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.393 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:32.393 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016672+0000", 2024-04-19T03:02:32.393 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0069999999999997e-06 2024-04-19T03:02:32.393 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.393 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.393 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:32.393 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016725+0000", 2024-04-19T03:02:32.394 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2812000000000002e-05 2024-04-19T03:02:32.394 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.394 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.394 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:32.394 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016750+0000", 2024-04-19T03:02:32.394 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5038e-05 2024-04-19T03:02:32.394 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.394 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.394 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:32.394 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.067673+0000", 2024-04-19T03:02:32.394 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.050922350999999998 2024-04-19T03:02:32.394 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.394 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.395 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:32.395 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.067723+0000", 2024-04-19T03:02:32.395 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0586e-05 2024-04-19T03:02:32.395 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:32.395 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:32.395 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:32.395 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.395 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.395 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4755.0:79003 5.2 e40/39 5:4436e33f:::benchmark_data_smithi096_19531_object79002:head v 40'4935, mlcod=40'4932)", 2024-04-19T03:02:32.395 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:18.018102+0000", 2024-04-19T03:02:32.395 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 14.343210711999999, 2024-04-19T03:02:32.395 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.060023990999999999, 2024-04-19T03:02:32.395 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:32.395 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:32.396 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:32.396 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.396 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:32.396 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018102+0000", 2024-04-19T03:02:32.396 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:32.396 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.396 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.396 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:32.396 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018102+0000", 2024-04-19T03:02:32.396 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:32.396 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.396 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.396 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:32.397 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018102+0000", 2024-04-19T03:02:32.397 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:32.397 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.397 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.397 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:32.397 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018134+0000", 2024-04-19T03:02:32.397 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2722000000000003e-05 2024-04-19T03:02:32.397 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.397 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.397 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:32.397 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018145+0000", 2024-04-19T03:02:32.397 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0395e-05 2024-04-19T03:02:32.397 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.397 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.398 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:32.398 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018151+0000", 2024-04-19T03:02:32.398 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5300000000000002e-06 2024-04-19T03:02:32.398 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.398 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.398 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:32.398 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018489+0000", 2024-04-19T03:02:32.398 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00033731499999999998 2024-04-19T03:02:32.398 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.398 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.398 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:32.398 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018508+0000", 2024-04-19T03:02:32.398 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9775e-05 2024-04-19T03:02:32.399 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.399 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.399 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:32.399 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.078059+0000", 2024-04-19T03:02:32.399 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.059550171999999998 2024-04-19T03:02:32.399 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.399 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.399 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:32.399 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.078126+0000", 2024-04-19T03:02:32.399 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7773000000000003e-05 2024-04-19T03:02:32.399 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:32.399 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:32.399 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:32.399 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.400 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.400 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4755.0:79005 5.1 e40/39 5:85b46038:::benchmark_data_smithi096_19531_object79004:head v 40'4941, mlcod=40'4938)", 2024-04-19T03:02:32.400 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:18.018167+0000", 2024-04-19T03:02:32.400 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 14.343145993, 2024-04-19T03:02:32.400 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.052768941999999999, 2024-04-19T03:02:32.400 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:32.400 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:32.400 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:32.400 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.400 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:32.400 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018167+0000", 2024-04-19T03:02:32.400 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:32.400 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.400 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.401 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:32.401 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018167+0000", 2024-04-19T03:02:32.401 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:32.401 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.401 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.401 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:32.401 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018167+0000", 2024-04-19T03:02:32.401 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:32.401 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.401 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.401 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:32.401 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018196+0000", 2024-04-19T03:02:32.401 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9538000000000001e-05 2024-04-19T03:02:32.401 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.402 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.402 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:32.402 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018204+0000", 2024-04-19T03:02:32.402 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2599999999999999e-06 2024-04-19T03:02:32.402 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.402 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.402 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:32.402 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018208+0000", 2024-04-19T03:02:32.402 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8080000000000004e-06 2024-04-19T03:02:32.402 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.402 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.402 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:32.402 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.064933+0000", 2024-04-19T03:02:32.403 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.046725048999999998 2024-04-19T03:02:32.403 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.403 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.403 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:32.403 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.064964+0000", 2024-04-19T03:02:32.403 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0577000000000002e-05 2024-04-19T03:02:32.403 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.403 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.403 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:32.403 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.070815+0000", 2024-04-19T03:02:32.403 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0058510649999999999 2024-04-19T03:02:32.403 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.403 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.403 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:32.404 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.070936+0000", 2024-04-19T03:02:32.404 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00012095399999999999 2024-04-19T03:02:32.404 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:32.404 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:32.404 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:32.404 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.404 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.404 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:86612 5.7 5:e32e3c49:::benchmark_data_smithi096_19531_object86611:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:32.404 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:22.633560+0000", 2024-04-19T03:02:32.404 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 9.7277530520000006, 2024-04-19T03:02:32.404 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.19135289, 2024-04-19T03:02:32.404 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:32.404 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:32.404 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:32.404 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:32.405 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:32.405 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 86612 2024-04-19T03:02:32.405 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.405 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:32.405 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.405 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:32.405 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633560+0000", 2024-04-19T03:02:32.405 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:32.405 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.405 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.405 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:32.405 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633560+0000", 2024-04-19T03:02:32.405 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:32.405 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.406 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.406 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:32.406 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633558+0000", 2024-04-19T03:02:32.406 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:32.406 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.406 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.406 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:32.406 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633609+0000", 2024-04-19T03:02:32.406 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0850999999999998e-05 2024-04-19T03:02:32.406 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.406 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.406 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:32.406 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633627+0000", 2024-04-19T03:02:32.406 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7951000000000001e-05 2024-04-19T03:02:32.407 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.407 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.407 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:32.407 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633635+0000", 2024-04-19T03:02:32.407 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2530000000000004e-06 2024-04-19T03:02:32.407 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.407 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.407 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:32.407 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633699+0000", 2024-04-19T03:02:32.407 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3901999999999999e-05 2024-04-19T03:02:32.407 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.407 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.407 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:32.408 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633992+0000", 2024-04-19T03:02:32.408 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00029283299999999999 2024-04-19T03:02:32.408 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.408 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.408 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:32.408 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.634223+0000", 2024-04-19T03:02:32.408 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00023084200000000001 2024-04-19T03:02:32.408 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.408 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.408 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:32.408 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.639085+0000", 2024-04-19T03:02:32.408 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0048624269999999999 2024-04-19T03:02:32.408 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.408 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.408 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:32.409 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.824635+0000", 2024-04-19T03:02:32.409 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.18554944700000001 2024-04-19T03:02:32.409 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.409 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.409 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:32.409 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.824793+0000", 2024-04-19T03:02:32.409 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000157959 2024-04-19T03:02:32.409 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.409 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.409 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:32.409 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.824913+0000", 2024-04-19T03:02:32.409 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000120093 2024-04-19T03:02:32.409 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:32.410 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:32.410 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:32.410 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.410 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.410 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:86625 5.7 5:e6d00488:::benchmark_data_smithi096_19531_object86624:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:32.410 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:22.643554+0000", 2024-04-19T03:02:32.410 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 9.7177592859999997, 2024-04-19T03:02:32.410 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.18732841, 2024-04-19T03:02:32.410 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:32.410 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:32.410 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:32.410 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:32.411 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:32.411 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 86625 2024-04-19T03:02:32.411 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.411 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:32.411 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.411 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:32.411 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643554+0000", 2024-04-19T03:02:32.411 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:32.411 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.411 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.411 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:32.411 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643554+0000", 2024-04-19T03:02:32.412 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:32.412 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.412 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.412 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:32.412 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643552+0000", 2024-04-19T03:02:32.412 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:32.412 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.412 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.412 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:32.412 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643588+0000", 2024-04-19T03:02:32.412 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5855999999999997e-05 2024-04-19T03:02:32.412 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.412 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.412 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:32.413 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643606+0000", 2024-04-19T03:02:32.413 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8226000000000001e-05 2024-04-19T03:02:32.413 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.413 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.413 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:32.413 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643618+0000", 2024-04-19T03:02:32.413 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1868000000000001e-05 2024-04-19T03:02:32.413 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.413 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.413 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:32.413 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643676+0000", 2024-04-19T03:02:32.413 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8153999999999999e-05 2024-04-19T03:02:32.413 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.413 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.414 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:32.414 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643905+0000", 2024-04-19T03:02:32.414 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00022847500000000001 2024-04-19T03:02:32.414 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.414 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.414 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:32.414 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.644150+0000", 2024-04-19T03:02:32.414 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00024531800000000001 2024-04-19T03:02:32.414 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.414 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.414 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:32.414 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.647407+0000", 2024-04-19T03:02:32.414 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0032563190000000001 2024-04-19T03:02:32.415 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.415 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.415 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:32.415 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.830721+0000", 2024-04-19T03:02:32.415 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.18331468300000001 2024-04-19T03:02:32.415 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.415 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.415 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:32.415 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.830813+0000", 2024-04-19T03:02:32.415 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.2205000000000002e-05 2024-04-19T03:02:32.415 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.415 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.415 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:32.415 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.830882+0000", 2024-04-19T03:02:32.416 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8819999999999995e-05 2024-04-19T03:02:32.416 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:32.416 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:32.416 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:32.416 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.416 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.416 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87063 5.7 5:e502e824:::benchmark_data_smithi096_19531_object87062:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:32.416 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.136067+0000", 2024-04-19T03:02:32.416 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 9.2252464169999993, 2024-04-19T03:02:32.416 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.065521159999999995, 2024-04-19T03:02:32.416 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:32.416 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:32.416 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:32.417 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:32.417 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:32.417 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87063 2024-04-19T03:02:32.417 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.417 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:32.417 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.417 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:32.417 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.136067+0000", 2024-04-19T03:02:32.417 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:32.417 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.417 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.417 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:32.417 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.136067+0000", 2024-04-19T03:02:32.417 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:32.417 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.418 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.418 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:32.418 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.136066+0000", 2024-04-19T03:02:32.418 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:32.418 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.418 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.418 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:32.418 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.136154+0000", 2024-04-19T03:02:32.418 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.8256000000000003e-05 2024-04-19T03:02:32.418 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.418 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.418 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:32.418 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.136162+0000", 2024-04-19T03:02:32.419 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.5099999999999998e-06 2024-04-19T03:02:32.419 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.419 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.419 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:32.419 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.136171+0000", 2024-04-19T03:02:32.419 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2830000000000001e-06 2024-04-19T03:02:32.419 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.419 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.419 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:32.419 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.138421+0000", 2024-04-19T03:02:32.419 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0022506620000000001 2024-04-19T03:02:32.419 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.419 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.419 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:32.420 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.138560+0000", 2024-04-19T03:02:32.420 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000138446 2024-04-19T03:02:32.420 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.420 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.420 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:32.420 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.138689+0000", 2024-04-19T03:02:32.420 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00012950700000000001 2024-04-19T03:02:32.420 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.420 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.420 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:32.420 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.141517+0000", 2024-04-19T03:02:32.420 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0028280860000000001 2024-04-19T03:02:32.420 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.420 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.421 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:32.421 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.201350+0000", 2024-04-19T03:02:32.421 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.059832418999999998 2024-04-19T03:02:32.421 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.421 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.421 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:32.421 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.201485+0000", 2024-04-19T03:02:32.421 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000135597 2024-04-19T03:02:32.421 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.421 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.421 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:32.421 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.201588+0000", 2024-04-19T03:02:32.422 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00010247900000000001 2024-04-19T03:02:32.422 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:32.422 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:32.422 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:32.422 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.422 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.422 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87072 5.7 5:e3c7809a:::benchmark_data_smithi096_19531_object87071:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:32.422 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.144224+0000", 2024-04-19T03:02:32.422 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 9.2170893930000002, 2024-04-19T03:02:32.422 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.058179555000000001, 2024-04-19T03:02:32.422 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:32.422 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:32.422 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:32.423 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:32.423 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:32.423 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87072 2024-04-19T03:02:32.423 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.423 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:32.423 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.423 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:32.423 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144224+0000", 2024-04-19T03:02:32.423 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:32.423 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.423 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.423 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:32.423 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144224+0000", 2024-04-19T03:02:32.424 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:32.424 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.424 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.424 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:32.424 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144223+0000", 2024-04-19T03:02:32.424 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:32.424 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.424 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.424 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:32.424 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144320+0000", 2024-04-19T03:02:32.424 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.7075000000000001e-05 2024-04-19T03:02:32.424 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.424 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.425 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:32.425 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144331+0000", 2024-04-19T03:02:32.425 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1342000000000001e-05 2024-04-19T03:02:32.425 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.425 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.425 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:32.425 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144337+0000", 2024-04-19T03:02:32.425 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8390000000000003e-06 2024-04-19T03:02:32.425 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.425 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.425 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:32.425 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144369+0000", 2024-04-19T03:02:32.425 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2079000000000002e-05 2024-04-19T03:02:32.426 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.426 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.426 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:32.426 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144464+0000", 2024-04-19T03:02:32.426 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.4623000000000005e-05 2024-04-19T03:02:32.426 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.426 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.426 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:32.426 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144553+0000", 2024-04-19T03:02:32.426 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9171000000000004e-05 2024-04-19T03:02:32.426 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.426 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.426 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:32.427 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.147018+0000", 2024-04-19T03:02:32.427 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0024648370000000001 2024-04-19T03:02:32.427 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.427 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.427 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:32.427 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.202270+0000", 2024-04-19T03:02:32.427 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.055252018 2024-04-19T03:02:32.427 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.427 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.427 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:32.427 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.202356+0000", 2024-04-19T03:02:32.427 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6648000000000001e-05 2024-04-19T03:02:32.427 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.427 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.427 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:32.428 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.202403+0000", 2024-04-19T03:02:32.428 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6956999999999998e-05 2024-04-19T03:02:32.428 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:32.428 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:32.428 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:32.428 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.428 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.428 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87123 5.6 5:6d1bc3b9:::benchmark_data_smithi096_19531_object87122:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:02:32.428 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249233+0000", 2024-04-19T03:02:32.428 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 9.1120803610000003, 2024-04-19T03:02:32.428 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0291700720000001, 2024-04-19T03:02:32.428 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:32.428 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-04-19T03:02:32.428 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:32.429 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:32.429 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:32.429 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87123 2024-04-19T03:02:32.429 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.429 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:32.429 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.429 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:32.429 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249233+0000", 2024-04-19T03:02:32.429 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:32.429 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.429 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.429 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:32.429 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249233+0000", 2024-04-19T03:02:32.429 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:32.430 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.430 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.430 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:32.430 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249231+0000", 2024-04-19T03:02:32.430 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:32.430 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.430 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.430 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:32.430 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249285+0000", 2024-04-19T03:02:32.430 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4005000000000002e-05 2024-04-19T03:02:32.430 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.430 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.430 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:32.430 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249300+0000", 2024-04-19T03:02:32.431 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4715999999999999e-05 2024-04-19T03:02:32.431 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.431 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.431 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:32.431 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249307+0000", 2024-04-19T03:02:32.431 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8399999999999997e-06 2024-04-19T03:02:32.431 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.431 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.431 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:32.431 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249366+0000", 2024-04-19T03:02:32.431 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9435999999999998e-05 2024-04-19T03:02:32.431 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.431 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.432 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op must wait for map", 2024-04-19T03:02:32.432 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249376+0000", 2024-04-19T03:02:32.432 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.4919999999999999e-06 2024-04-19T03:02:32.432 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.432 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.432 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:32.432 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263757+0000", 2024-04-19T03:02:32.432 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.014381461999999999 2024-04-19T03:02:32.432 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.432 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.432 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:02:32.432 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263875+0000", 2024-04-19T03:02:32.432 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000117166 2024-04-19T03:02:32.432 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.433 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.433 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:32.433 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.277136+0000", 2024-04-19T03:02:32.433 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.013261207 2024-04-19T03:02:32.433 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.433 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.433 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:32.433 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.278403+0000", 2024-04-19T03:02:32.433 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001267106 2024-04-19T03:02:32.433 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:32.433 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:32.433 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:32.433 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.433 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.434 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87128 5.6 5:6905c420:::benchmark_data_smithi096_19531_object87127:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:02:32.434 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249323+0000", 2024-04-19T03:02:32.434 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 9.1119896140000005, 2024-04-19T03:02:32.434 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0292813249999999, 2024-04-19T03:02:32.434 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:32.434 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-04-19T03:02:32.434 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:32.434 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:32.434 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:32.434 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87128 2024-04-19T03:02:32.434 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.434 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:32.434 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.435 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:32.435 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249323+0000", 2024-04-19T03:02:32.435 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:32.435 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.435 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.435 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:32.435 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249323+0000", 2024-04-19T03:02:32.435 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:32.435 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.435 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.435 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:32.435 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249323+0000", 2024-04-19T03:02:32.435 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:32.435 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.436 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.436 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:32.436 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249385+0000", 2024-04-19T03:02:32.436 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1711999999999995e-05 2024-04-19T03:02:32.436 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.436 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.436 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:32.436 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249398+0000", 2024-04-19T03:02:32.436 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3022e-05 2024-04-19T03:02:32.436 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.437 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.437 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:32.437 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249402+0000", 2024-04-19T03:02:32.437 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4819999999999996e-06 2024-04-19T03:02:32.437 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.437 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.437 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:32.437 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249437+0000", 2024-04-19T03:02:32.437 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4702000000000001e-05 2024-04-19T03:02:32.437 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.437 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.437 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:02:32.437 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249442+0000", 2024-04-19T03:02:32.437 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8019999999999999e-06 2024-04-19T03:02:32.438 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.438 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.438 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:32.438 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263896+0000", 2024-04-19T03:02:32.438 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.014454679999999999 2024-04-19T03:02:32.438 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.438 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.438 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:02:32.438 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263900+0000", 2024-04-19T03:02:32.438 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9700000000000001e-06 2024-04-19T03:02:32.438 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.438 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.438 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:32.438 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.278557+0000", 2024-04-19T03:02:32.439 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0146566480000001 2024-04-19T03:02:32.439 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.439 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.439 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:32.439 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.278605+0000", 2024-04-19T03:02:32.439 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7735999999999998e-05 2024-04-19T03:02:32.439 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:32.439 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:32.439 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:32.439 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.439 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.439 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87130 5.3 5:c8c2d67b:::benchmark_data_smithi096_19531_object87129:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:02:32.439 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249418+0000", 2024-04-19T03:02:32.440 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 9.1118949029999996, 2024-04-19T03:02:32.440 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.025414182, 2024-04-19T03:02:32.440 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:32.440 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-04-19T03:02:32.440 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:32.440 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:32.440 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:32.440 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87130 2024-04-19T03:02:32.440 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.440 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:32.440 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.440 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:32.441 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249418+0000", 2024-04-19T03:02:32.441 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:32.441 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.441 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.441 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:32.441 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249418+0000", 2024-04-19T03:02:32.441 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:32.441 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.441 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.441 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:32.441 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249409+0000", 2024-04-19T03:02:32.441 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999905 2024-04-19T03:02:32.441 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.441 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.442 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:32.442 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249464+0000", 2024-04-19T03:02:32.442 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5381999999999999e-05 2024-04-19T03:02:32.442 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.442 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.442 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:32.442 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249471+0000", 2024-04-19T03:02:32.442 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2609999999999996e-06 2024-04-19T03:02:32.442 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.442 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.442 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:32.442 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249475+0000", 2024-04-19T03:02:32.442 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2839999999999998e-06 2024-04-19T03:02:32.442 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.443 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.443 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:32.443 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249535+0000", 2024-04-19T03:02:32.443 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0545999999999999e-05 2024-04-19T03:02:32.443 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.443 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.443 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op must wait for map", 2024-04-19T03:02:32.443 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249540+0000", 2024-04-19T03:02:32.443 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2859999999999999e-06 2024-04-19T03:02:32.443 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.443 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.444 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:32.444 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263450+0000", 2024-04-19T03:02:32.444 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.013909585 2024-04-19T03:02:32.444 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.445 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.445 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:02:32.445 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263458+0000", 2024-04-19T03:02:32.445 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8089999999999993e-06 2024-04-19T03:02:32.445 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.445 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.445 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:32.445 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.273193+0000", 2024-04-19T03:02:32.445 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0097351379999999 2024-04-19T03:02:32.445 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.445 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.445 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:32.445 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.274832+0000", 2024-04-19T03:02:32.445 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0016394789999999999 2024-04-19T03:02:32.446 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:32.446 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:32.446 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:32.446 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.446 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.446 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87131 5.1 5:83756d55:::benchmark_data_smithi096_19531_object87130:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:02:32.446 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249491+0000", 2024-04-19T03:02:32.446 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 9.111822256, 2024-04-19T03:02:32.446 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0191489520000001, 2024-04-19T03:02:32.446 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:32.446 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-04-19T03:02:32.446 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:32.446 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:32.447 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:32.447 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87131 2024-04-19T03:02:32.447 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.447 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:32.447 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.447 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:32.447 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249491+0000", 2024-04-19T03:02:32.447 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:32.447 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.447 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.447 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:32.447 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249491+0000", 2024-04-19T03:02:32.447 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:32.447 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.448 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.448 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:32.448 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249491+0000", 2024-04-19T03:02:32.448 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:32.448 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.448 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.448 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:32.448 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249530+0000", 2024-04-19T03:02:32.448 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9589000000000003e-05 2024-04-19T03:02:32.448 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.448 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.448 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:32.448 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249544+0000", 2024-04-19T03:02:32.448 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4158000000000001e-05 2024-04-19T03:02:32.449 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.449 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.449 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:32.449 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249549+0000", 2024-04-19T03:02:32.449 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6809999999999997e-06 2024-04-19T03:02:32.449 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.449 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.449 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:32.449 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249592+0000", 2024-04-19T03:02:32.449 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3285999999999999e-05 2024-04-19T03:02:32.449 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.449 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.449 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op must wait for map", 2024-04-19T03:02:32.449 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249598+0000", 2024-04-19T03:02:32.450 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8329999999999999e-06 2024-04-19T03:02:32.450 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.450 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.450 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:32.450 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263331+0000", 2024-04-19T03:02:32.450 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.013733093 2024-04-19T03:02:32.450 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.450 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.450 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:02:32.450 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263343+0000", 2024-04-19T03:02:32.450 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.189e-05 2024-04-19T03:02:32.450 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.450 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.451 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:32.451 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.268541+0000", 2024-04-19T03:02:32.451 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0051983440000001 2024-04-19T03:02:32.451 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.451 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.451 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:32.451 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.268640+0000", 2024-04-19T03:02:32.451 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.8387999999999994e-05 2024-04-19T03:02:32.451 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:32.451 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:32.451 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:32.451 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.451 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.452 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87132 5.c 5:3e18b732:::benchmark_data_smithi096_19531_object87131:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:02:32.452 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249558+0000", 2024-04-19T03:02:32.452 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 9.1117553549999997, 2024-04-19T03:02:32.452 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0241198380000001, 2024-04-19T03:02:32.452 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:32.452 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-04-19T03:02:32.452 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:32.452 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:32.452 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:32.452 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87132 2024-04-19T03:02:32.452 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.452 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:32.452 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.452 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:32.453 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249558+0000", 2024-04-19T03:02:32.453 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:32.453 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.453 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.453 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:32.453 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249558+0000", 2024-04-19T03:02:32.453 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:32.453 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.453 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.453 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:32.453 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249557+0000", 2024-04-19T03:02:32.453 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:32.453 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.453 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.454 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:32.454 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249625+0000", 2024-04-19T03:02:32.454 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7200999999999996e-05 2024-04-19T03:02:32.454 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.454 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.454 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:32.454 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249646+0000", 2024-04-19T03:02:32.454 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1053e-05 2024-04-19T03:02:32.454 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.454 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.454 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:32.454 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249650+0000", 2024-04-19T03:02:32.454 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2719999999999999e-06 2024-04-19T03:02:32.455 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.455 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.455 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:32.455 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249686+0000", 2024-04-19T03:02:32.455 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6430000000000002e-05 2024-04-19T03:02:32.455 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.455 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.455 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op must wait for map", 2024-04-19T03:02:32.455 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249690+0000", 2024-04-19T03:02:32.455 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.765e-06 2024-04-19T03:02:32.455 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.455 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.455 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:32.455 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261157+0000", 2024-04-19T03:02:32.456 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011467247999999999 2024-04-19T03:02:32.456 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.456 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.456 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:02:32.456 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261170+0000", 2024-04-19T03:02:32.456 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2833000000000001e-05 2024-04-19T03:02:32.456 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.456 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.456 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:32.456 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.272119+0000", 2024-04-19T03:02:32.456 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.010949313 2024-04-19T03:02:32.456 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.456 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.456 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:32.457 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.273678+0000", 2024-04-19T03:02:32.457 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0015581550000000001 2024-04-19T03:02:32.457 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:32.457 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:32.457 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:32.457 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.457 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.457 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87133 5.c 5:3f772a62:::benchmark_data_smithi096_19531_object87132:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:02:32.457 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249657+0000", 2024-04-19T03:02:32.457 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 9.1116559759999998, 2024-04-19T03:02:32.457 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0242819409999999, 2024-04-19T03:02:32.457 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:32.457 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-04-19T03:02:32.458 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:32.458 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:32.458 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:32.458 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87133 2024-04-19T03:02:32.458 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.458 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:32.458 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.458 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:32.458 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249657+0000", 2024-04-19T03:02:32.458 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:32.458 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.458 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.458 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:32.459 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249657+0000", 2024-04-19T03:02:32.459 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:32.459 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.459 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.459 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:32.459 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249657+0000", 2024-04-19T03:02:32.459 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:32.459 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.459 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.459 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:32.459 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249690+0000", 2024-04-19T03:02:32.459 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3343000000000002e-05 2024-04-19T03:02:32.459 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.460 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.460 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:32.460 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249695+0000", 2024-04-19T03:02:32.460 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8600000000000001e-06 2024-04-19T03:02:32.460 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.460 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.460 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:32.460 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249698+0000", 2024-04-19T03:02:32.460 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.1700000000000001e-06 2024-04-19T03:02:32.460 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.460 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.460 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:32.460 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249741+0000", 2024-04-19T03:02:32.460 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2849999999999998e-05 2024-04-19T03:02:32.461 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.461 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.461 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:02:32.461 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249746+0000", 2024-04-19T03:02:32.461 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1019999999999996e-06 2024-04-19T03:02:32.461 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.461 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.461 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:32.461 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261209+0000", 2024-04-19T03:02:32.461 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011462447000000001 2024-04-19T03:02:32.461 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.461 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.461 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:02:32.461 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261216+0000", 2024-04-19T03:02:32.462 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8520000000000004e-06 2024-04-19T03:02:32.462 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.462 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.462 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:32.462 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.273872+0000", 2024-04-19T03:02:32.462 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0126558000000001 2024-04-19T03:02:32.462 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.462 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.462 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:32.462 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.273939+0000", 2024-04-19T03:02:32.462 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6822000000000005e-05 2024-04-19T03:02:32.462 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:32.462 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:32.463 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:32.463 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.463 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.463 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87134 5.5 5:a56c478f:::benchmark_data_smithi096_19531_object87133:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:02:32.463 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249708+0000", 2024-04-19T03:02:32.463 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 9.1116050519999998, 2024-04-19T03:02:32.463 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0214677299999999, 2024-04-19T03:02:32.463 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:32.463 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-04-19T03:02:32.463 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:32.463 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:32.463 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:32.463 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87134 2024-04-19T03:02:32.463 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.464 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:32.464 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.464 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:32.464 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249708+0000", 2024-04-19T03:02:32.464 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:32.464 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.464 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.464 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:32.464 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249708+0000", 2024-04-19T03:02:32.464 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:32.464 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.464 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.464 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:32.464 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249706+0000", 2024-04-19T03:02:32.465 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999976 2024-04-19T03:02:32.465 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.465 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.465 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:32.465 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249740+0000", 2024-04-19T03:02:32.465 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4458000000000001e-05 2024-04-19T03:02:32.465 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.465 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.465 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:32.465 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249745+0000", 2024-04-19T03:02:32.465 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5020000000000003e-06 2024-04-19T03:02:32.465 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.465 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.466 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:32.466 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249748+0000", 2024-04-19T03:02:32.466 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2499999999999998e-06 2024-04-19T03:02:32.466 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.466 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.466 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:32.466 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249778+0000", 2024-04-19T03:02:32.466 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.006e-05 2024-04-19T03:02:32.466 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.466 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.466 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op must wait for map", 2024-04-19T03:02:32.466 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249782+0000", 2024-04-19T03:02:32.467 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2910000000000001e-06 2024-04-19T03:02:32.467 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.467 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.467 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:32.467 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261666+0000", 2024-04-19T03:02:32.467 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011883471 2024-04-19T03:02:32.467 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.467 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.467 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:02:32.467 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261674+0000", 2024-04-19T03:02:32.467 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6479999999999992e-06 2024-04-19T03:02:32.467 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.467 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.468 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:32.468 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.269323+0000", 2024-04-19T03:02:32.468 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.00764867 2024-04-19T03:02:32.468 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.468 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.468 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:32.468 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.271176+0000", 2024-04-19T03:02:32.468 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001852844 2024-04-19T03:02:32.468 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:32.468 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:32.468 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:32.468 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.468 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.468 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87137 5.c 5:30708c68:::benchmark_data_smithi096_19531_object87136:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:02:32.469 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249756+0000", 2024-04-19T03:02:32.469 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 9.1115573459999997, 2024-04-19T03:02:32.469 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.033331752, 2024-04-19T03:02:32.469 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:32.469 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:32.469 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:32.469 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:32.469 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:32.469 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87137 2024-04-19T03:02:32.469 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.469 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:32.469 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.470 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:32.470 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249756+0000", 2024-04-19T03:02:32.470 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:32.470 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.470 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.470 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:32.470 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249756+0000", 2024-04-19T03:02:32.470 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:32.470 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.470 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.470 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:32.470 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249755+0000", 2024-04-19T03:02:32.471 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:32.471 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.471 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.471 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:32.471 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249777+0000", 2024-04-19T03:02:32.471 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1420000000000002e-05 2024-04-19T03:02:32.471 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.471 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.471 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:32.471 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249781+0000", 2024-04-19T03:02:32.471 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0609999999999997e-06 2024-04-19T03:02:32.471 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.471 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.472 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:32.472 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249787+0000", 2024-04-19T03:02:32.472 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.02e-06 2024-04-19T03:02:32.472 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.472 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.472 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:32.472 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249818+0000", 2024-04-19T03:02:32.472 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0947e-05 2024-04-19T03:02:32.472 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.472 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.472 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:02:32.472 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249821+0000", 2024-04-19T03:02:32.472 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.117e-06 2024-04-19T03:02:32.473 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.473 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.473 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:32.473 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261243+0000", 2024-04-19T03:02:32.473 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011421875999999999 2024-04-19T03:02:32.473 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.473 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.473 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:02:32.473 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261251+0000", 2024-04-19T03:02:32.473 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6120000000000001e-06 2024-04-19T03:02:32.473 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.473 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.473 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:32.474 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.274050+0000", 2024-04-19T03:02:32.474 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.012799405 2024-04-19T03:02:32.474 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.474 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.474 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:32.474 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.274529+0000", 2024-04-19T03:02:32.474 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00047867100000000001 2024-04-19T03:02:32.474 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.474 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.474 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:32.474 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.282972+0000", 2024-04-19T03:02:32.474 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0084436900000000002 2024-04-19T03:02:32.474 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.474 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.475 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:32.475 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.283022+0000", 2024-04-19T03:02:32.475 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9339000000000003e-05 2024-04-19T03:02:32.475 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:32.475 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:32.475 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:32.475 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.283088+0000", 2024-04-19T03:02:32.475 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5877999999999995e-05 2024-04-19T03:02:32.475 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:32.475 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:32.475 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:32.475 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:32.475 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:32.475 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-04-19T03:02:32.477 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T03:02:32.478 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:32.475+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:32.578 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:32.573+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:32.602 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-19T03:02:32.602 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-04-19T03:02:32.602 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.602 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:103179 5.b 5:dd247fd7:::benchmark_data_smithi096_19531_object103178:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-19T03:02:32.602 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:32.596974+0000", 2024-04-19T03:02:32.602 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.005263879, 2024-04-19T03:02:32.602 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0052899729999999999, 2024-04-19T03:02:32.603 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:32.603 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:32.603 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:32.603 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:32.603 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:32.603 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 103179 2024-04-19T03:02:32.603 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.603 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:32.603 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.603 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:32.603 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:32.596974+0000", 2024-04-19T03:02:32.604 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:32.604 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.604 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.604 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:32.604 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:32.596974+0000", 2024-04-19T03:02:32.604 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:32.604 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.604 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.604 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:32.604 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:32.596973+0000", 2024-04-19T03:02:32.604 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:32.604 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.605 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.605 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:32.605 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:32.597012+0000", 2024-04-19T03:02:32.605 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8983999999999998e-05 2024-04-19T03:02:32.605 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.605 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.605 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:32.605 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:32.597024+0000", 2024-04-19T03:02:32.605 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1673e-05 2024-04-19T03:02:32.605 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.605 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.606 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:32.606 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:32.597033+0000", 2024-04-19T03:02:32.606 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9409999999999996e-06 2024-04-19T03:02:32.606 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.606 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.606 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:32.606 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:32.597081+0000", 2024-04-19T03:02:32.606 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8559e-05 2024-04-19T03:02:32.606 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.606 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.606 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:32.607 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:32.597216+0000", 2024-04-19T03:02:32.607 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013464299999999999 2024-04-19T03:02:32.607 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.607 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.607 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:32.607 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:32.602233+0000", 2024-04-19T03:02:32.607 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0050166489999999998 2024-04-19T03:02:32.607 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.607 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.607 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:32.607 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:32.602264+0000", 2024-04-19T03:02:32.607 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1133000000000002e-05 2024-04-19T03:02:32.608 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:32.608 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:32.608 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:32.608 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.608 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.608 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:103184 5.b 5:d9347b66:::benchmark_data_smithi096_19531_object103183:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-19T03:02:32.608 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:32.598200+0000", 2024-04-19T03:02:32.608 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0040376159999999999, 2024-04-19T03:02:32.608 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.004148807, 2024-04-19T03:02:32.608 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:32.609 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-19T03:02:32.609 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:32.609 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:32.609 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:32.609 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 103184 2024-04-19T03:02:32.609 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.609 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:32.609 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.609 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:32.609 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:32.598200+0000", 2024-04-19T03:02:32.609 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:32.609 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.609 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.610 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:32.610 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:32.598200+0000", 2024-04-19T03:02:32.610 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:32.610 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.610 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.610 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:32.610 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:32.598199+0000", 2024-04-19T03:02:32.610 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:32.610 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.610 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.610 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:32.611 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:32.598279+0000", 2024-04-19T03:02:32.611 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0110000000000004e-05 2024-04-19T03:02:32.611 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.611 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.611 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:32.611 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:32.598295+0000", 2024-04-19T03:02:32.611 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5965999999999999e-05 2024-04-19T03:02:32.611 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.611 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.611 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:32.611 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:32.598304+0000", 2024-04-19T03:02:32.611 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.789e-06 2024-04-19T03:02:32.611 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.612 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.612 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:32.612 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:32.600082+0000", 2024-04-19T03:02:32.612 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0017785590000000001 2024-04-19T03:02:32.612 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.612 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.612 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:32.612 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:32.600299+0000", 2024-04-19T03:02:32.612 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00021667299999999999 2024-04-19T03:02:32.612 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:32.612 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:32.612 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:32.613 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.613 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.613 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:103187 5.a 5:56b37ec4:::benchmark_data_smithi096_19531_object103186:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-19T03:02:32.613 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:32.600314+0000", 2024-04-19T03:02:32.613 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.001923538, 2024-04-19T03:02:32.613 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.002095651, 2024-04-19T03:02:32.613 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:32.613 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-19T03:02:32.613 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:32.613 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:32.613 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:32.613 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 103187 2024-04-19T03:02:32.613 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.614 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:32.614 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.614 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:32.614 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:32.600314+0000", 2024-04-19T03:02:32.614 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:32.614 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.614 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.614 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:32.614 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:32.600314+0000", 2024-04-19T03:02:32.614 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:32.614 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.614 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.615 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:32.615 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:32.600313+0000", 2024-04-19T03:02:32.615 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:32.615 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.615 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.615 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:32.615 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:32.600437+0000", 2024-04-19T03:02:32.615 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012419699999999999 2024-04-19T03:02:32.615 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.615 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.615 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:32.615 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:32.600449+0000", 2024-04-19T03:02:32.616 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1433999999999999e-05 2024-04-19T03:02:32.616 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.616 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.616 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:32.616 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:32.600460+0000", 2024-04-19T03:02:32.616 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1283e-05 2024-04-19T03:02:32.616 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.616 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.616 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:32.617 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:32.600567+0000", 2024-04-19T03:02:32.617 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000106759 2024-04-19T03:02:32.617 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.617 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.617 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:32.617 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:32.600684+0000", 2024-04-19T03:02:32.617 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011766500000000001 2024-04-19T03:02:32.617 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:32.617 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:32.617 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:32.617 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.618 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.618 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:103191 5.e 5:768dcf39:::benchmark_data_smithi096_19531_object103190:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-19T03:02:32.618 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:32.601393+0000", 2024-04-19T03:02:32.618 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.00084522199999999997, 2024-04-19T03:02:32.618 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0010757539999999999, 2024-04-19T03:02:32.618 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:32.618 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-19T03:02:32.618 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:32.618 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:32.618 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:32.618 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 103191 2024-04-19T03:02:32.619 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.619 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:32.619 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.619 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:32.619 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:32.601393+0000", 2024-04-19T03:02:32.619 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:32.619 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.619 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.619 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:32.619 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:32.601393+0000", 2024-04-19T03:02:32.619 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:32.620 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.620 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.620 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:32.620 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:32.601392+0000", 2024-04-19T03:02:32.620 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:32.620 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.620 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.620 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:32.620 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:32.601446+0000", 2024-04-19T03:02:32.620 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4287999999999999e-05 2024-04-19T03:02:32.620 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.620 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.621 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:32.621 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:32.601470+0000", 2024-04-19T03:02:32.621 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3516999999999999e-05 2024-04-19T03:02:32.621 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.621 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.621 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:32.621 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:32.601477+0000", 2024-04-19T03:02:32.621 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.6890000000000004e-06 2024-04-19T03:02:32.621 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.621 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.621 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:32.621 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:32.601517+0000", 2024-04-19T03:02:32.622 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9685999999999999e-05 2024-04-19T03:02:32.622 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.622 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.622 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:32.622 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:32.601610+0000", 2024-04-19T03:02:32.622 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.2916000000000003e-05 2024-04-19T03:02:32.622 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:32.622 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:32.622 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:32.622 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:32.622 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-04-19T03:02:32.622 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 4 2024-04-19T03:02:32.622 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-19T03:02:32.624 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T03:02:32.679 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:32.675+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:32.690 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [0] live_osds: [1, 2] 2024-04-19T03:02:32.690 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-19T03:02:32.691 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-19T03:02:32.749 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-19T03:02:32.749 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-04-19T03:02:32.749 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-04-19T03:02:32.750 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-04-19T03:02:32.750 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-19T03:02:32.762 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T03:02:32.779 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:32.777+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:32.825 INFO:tasks.radosbench.radosbench.0.smithi096.stdout: 55 16 103643 103627 117.744 122.562 0.00602939 0.00848748 2024-04-19T03:02:32.880 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:32.879+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:32.902 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-19T03:02:32.902 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-04-19T03:02:32.902 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-04-19T03:02:32.902 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-04-19T03:02:32.902 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.902 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:79014 5.d 5:b5eee02c:::benchmark_data_smithi096_19531_object79013:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-19T03:02:32.902 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:18.032471+0000", 2024-04-19T03:02:32.902 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 14.867351236999999, 2024-04-19T03:02:32.903 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.041427629000000001, 2024-04-19T03:02:32.903 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:32.903 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:32.903 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:32.903 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:32.903 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:32.903 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 79014 2024-04-19T03:02:32.903 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.903 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:32.903 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.903 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:32.903 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:18.032471+0000", 2024-04-19T03:02:32.903 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:32.903 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.904 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.904 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:32.904 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:18.032471+0000", 2024-04-19T03:02:32.904 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:32.904 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.904 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.904 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:32.904 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:18.032470+0000", 2024-04-19T03:02:32.904 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:32.904 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.904 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.904 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:32.904 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:18.032525+0000", 2024-04-19T03:02:32.904 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5535999999999998e-05 2024-04-19T03:02:32.905 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.905 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.905 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:32.905 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:18.032537+0000", 2024-04-19T03:02:32.905 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1987999999999999e-05 2024-04-19T03:02:32.905 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.905 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.905 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:32.905 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:18.032546+0000", 2024-04-19T03:02:32.905 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9670000000000007e-06 2024-04-19T03:02:32.905 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.905 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.905 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:32.905 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:18.032613+0000", 2024-04-19T03:02:32.906 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6508999999999996e-05 2024-04-19T03:02:32.906 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.906 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.906 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:32.906 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:18.032738+0000", 2024-04-19T03:02:32.906 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000124912 2024-04-19T03:02:32.906 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.906 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.906 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-04-19T03:02:32.906 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:18.032867+0000", 2024-04-19T03:02:32.906 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012959399999999999 2024-04-19T03:02:32.906 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.906 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.907 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:32.907 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:18.035867+0000", 2024-04-19T03:02:32.907 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.002999378 2024-04-19T03:02:32.907 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.907 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.907 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:32.907 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:18.073705+0000", 2024-04-19T03:02:32.907 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.037838042000000002 2024-04-19T03:02:32.907 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.907 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.907 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:32.907 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:18.073813+0000", 2024-04-19T03:02:32.907 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010806099999999999 2024-04-19T03:02:32.907 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.907 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.908 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:32.908 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:18.073899+0000", 2024-04-19T03:02:32.908 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.5971999999999996e-05 2024-04-19T03:02:32.908 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:32.908 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:32.908 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:32.908 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.908 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.908 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:86615 5.e 5:7fef7288:::benchmark_data_smithi096_19531_object86614:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:32.908 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:22.634544+0000", 2024-04-19T03:02:32.908 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 10.265278258, 2024-04-19T03:02:32.908 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.192475071, 2024-04-19T03:02:32.908 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:32.908 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:32.909 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:32.909 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:32.909 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:32.909 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 86615 2024-04-19T03:02:32.909 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.909 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:32.909 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.909 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:32.909 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634544+0000", 2024-04-19T03:02:32.909 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:32.909 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.909 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.909 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:32.910 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634544+0000", 2024-04-19T03:02:32.910 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:32.910 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.910 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.910 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:32.910 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634542+0000", 2024-04-19T03:02:32.910 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999981 2024-04-19T03:02:32.910 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.910 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.910 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:32.910 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634585+0000", 2024-04-19T03:02:32.910 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2299000000000003e-05 2024-04-19T03:02:32.910 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.910 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.911 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:32.911 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634592+0000", 2024-04-19T03:02:32.911 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2350000000000002e-06 2024-04-19T03:02:32.911 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.911 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.911 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:32.911 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634596+0000", 2024-04-19T03:02:32.911 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5390000000000001e-06 2024-04-19T03:02:32.911 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.911 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.911 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:32.911 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634639+0000", 2024-04-19T03:02:32.911 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2444999999999998e-05 2024-04-19T03:02:32.911 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.912 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.912 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:32.912 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634808+0000", 2024-04-19T03:02:32.912 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000169152 2024-04-19T03:02:32.912 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.912 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.912 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:32.912 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634999+0000", 2024-04-19T03:02:32.912 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00019098300000000001 2024-04-19T03:02:32.912 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.912 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.912 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:32.912 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.640458+0000", 2024-04-19T03:02:32.913 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0054586870000000003 2024-04-19T03:02:32.913 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.913 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.913 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:32.913 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.826949+0000", 2024-04-19T03:02:32.913 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.18649178299999999 2024-04-19T03:02:32.913 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.913 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.913 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:32.913 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.826982+0000", 2024-04-19T03:02:32.913 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2477000000000001e-05 2024-04-19T03:02:32.913 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.913 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.913 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:32.914 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.827019+0000", 2024-04-19T03:02:32.914 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7355999999999999e-05 2024-04-19T03:02:32.914 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:32.914 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:32.914 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:32.914 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.914 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.914 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:86616 5.e 5:72278f47:::benchmark_data_smithi096_19531_object86615:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:32.914 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:22.634609+0000", 2024-04-19T03:02:32.914 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 10.265213108999999, 2024-04-19T03:02:32.914 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.19472088900000001, 2024-04-19T03:02:32.914 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:32.914 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:32.914 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:32.915 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:32.915 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:32.915 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 86616 2024-04-19T03:02:32.915 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.915 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:32.915 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.915 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:32.915 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634609+0000", 2024-04-19T03:02:32.915 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:32.915 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.915 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.915 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:32.915 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634609+0000", 2024-04-19T03:02:32.915 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:32.916 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.916 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.916 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:32.916 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634609+0000", 2024-04-19T03:02:32.916 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:32.916 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.916 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.916 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:32.916 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634651+0000", 2024-04-19T03:02:32.916 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2589000000000002e-05 2024-04-19T03:02:32.916 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.916 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.916 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:32.916 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634659+0000", 2024-04-19T03:02:32.917 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5850000000000002e-06 2024-04-19T03:02:32.917 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.917 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.917 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:32.917 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634662+0000", 2024-04-19T03:02:32.917 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3620000000000002e-06 2024-04-19T03:02:32.917 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.917 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.917 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:32.917 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.637880+0000", 2024-04-19T03:02:32.917 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.003218149 2024-04-19T03:02:32.917 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.917 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.917 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:32.918 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.637999+0000", 2024-04-19T03:02:32.918 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000118643 2024-04-19T03:02:32.918 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.918 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.918 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:32.918 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.638102+0000", 2024-04-19T03:02:32.918 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010331 2024-04-19T03:02:32.918 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.918 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.918 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:32.918 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.640851+0000", 2024-04-19T03:02:32.918 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0027483310000000001 2024-04-19T03:02:32.918 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.918 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.919 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:32.919 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.829269+0000", 2024-04-19T03:02:32.919 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.188418319 2024-04-19T03:02:32.919 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.919 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.919 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:32.919 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.829299+0000", 2024-04-19T03:02:32.919 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0227e-05 2024-04-19T03:02:32.919 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.919 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.919 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:32.919 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.829330+0000", 2024-04-19T03:02:32.919 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0969000000000001e-05 2024-04-19T03:02:32.919 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:32.920 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:32.920 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:32.920 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.920 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.921 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:86618 5.0 5:09014b90:::benchmark_data_smithi096_19531_object86617:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:32.921 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:22.634894+0000", 2024-04-19T03:02:32.921 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 10.264928620999999, 2024-04-19T03:02:32.921 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.19413419800000001, 2024-04-19T03:02:32.921 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:32.921 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:32.921 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:32.921 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:32.921 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:32.921 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 86618 2024-04-19T03:02:32.921 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.921 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:32.922 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.922 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:32.922 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634894+0000", 2024-04-19T03:02:32.922 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:32.922 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.922 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.922 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:32.922 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634894+0000", 2024-04-19T03:02:32.922 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:32.922 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.922 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.922 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:32.922 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634893+0000", 2024-04-19T03:02:32.922 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:32.923 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.923 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.923 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:32.923 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634976+0000", 2024-04-19T03:02:32.923 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3231000000000003e-05 2024-04-19T03:02:32.923 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.923 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.923 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:32.923 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634983+0000", 2024-04-19T03:02:32.923 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5169999999999996e-06 2024-04-19T03:02:32.923 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.923 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.923 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:32.923 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634987+0000", 2024-04-19T03:02:32.924 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.425e-06 2024-04-19T03:02:32.924 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.924 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.924 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:32.924 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635030+0000", 2024-04-19T03:02:32.924 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.32e-05 2024-04-19T03:02:32.924 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.924 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.924 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:32.924 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635185+0000", 2024-04-19T03:02:32.924 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015471899999999999 2024-04-19T03:02:32.924 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.924 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.924 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:32.924 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635415+0000", 2024-04-19T03:02:32.925 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00023026500000000001 2024-04-19T03:02:32.925 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.925 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.925 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:32.925 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.640127+0000", 2024-04-19T03:02:32.925 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0047118890000000004 2024-04-19T03:02:32.925 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.925 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.925 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:32.925 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.828895+0000", 2024-04-19T03:02:32.925 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.18876802600000001 2024-04-19T03:02:32.925 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.925 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.926 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:32.926 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.828972+0000", 2024-04-19T03:02:32.926 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.6345000000000002e-05 2024-04-19T03:02:32.926 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.926 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.926 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:32.926 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.829028+0000", 2024-04-19T03:02:32.926 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6342999999999999e-05 2024-04-19T03:02:32.926 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:32.926 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:32.926 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:32.926 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.926 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.926 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:86620 5.b 5:d80faa68:::benchmark_data_smithi096_19531_object86619:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:32.927 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:22.635110+0000", 2024-04-19T03:02:32.927 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 10.264712061000001, 2024-04-19T03:02:32.927 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.193447275, 2024-04-19T03:02:32.927 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:32.927 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:32.927 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:32.927 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:32.927 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:32.927 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 86620 2024-04-19T03:02:32.927 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.927 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:32.927 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.927 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:32.927 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635110+0000", 2024-04-19T03:02:32.928 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:32.928 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.928 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.928 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:32.928 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635110+0000", 2024-04-19T03:02:32.928 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:32.928 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.928 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.928 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:32.928 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635110+0000", 2024-04-19T03:02:32.928 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:32.928 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.928 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.928 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:32.929 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635154+0000", 2024-04-19T03:02:32.929 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4681000000000001e-05 2024-04-19T03:02:32.929 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.929 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.929 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:32.929 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635166+0000", 2024-04-19T03:02:32.929 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1505000000000001e-05 2024-04-19T03:02:32.929 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.929 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.929 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:32.929 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635171+0000", 2024-04-19T03:02:32.929 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6040000000000003e-06 2024-04-19T03:02:32.929 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.929 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.930 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:32.930 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635221+0000", 2024-04-19T03:02:32.930 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9947000000000001e-05 2024-04-19T03:02:32.930 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.930 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.930 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:32.930 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635356+0000", 2024-04-19T03:02:32.930 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013576199999999999 2024-04-19T03:02:32.930 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.930 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.930 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:32.930 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635507+0000", 2024-04-19T03:02:32.930 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015072999999999999 2024-04-19T03:02:32.931 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.931 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.931 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:32.931 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.638488+0000", 2024-04-19T03:02:32.931 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0029813159999999999 2024-04-19T03:02:32.931 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.931 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.931 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:32.931 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.828341+0000", 2024-04-19T03:02:32.931 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.189852254 2024-04-19T03:02:32.931 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.931 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.931 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:32.931 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.828416+0000", 2024-04-19T03:02:32.932 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5344000000000002e-05 2024-04-19T03:02:32.932 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.932 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.932 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:32.932 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.828558+0000", 2024-04-19T03:02:32.932 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000141695 2024-04-19T03:02:32.932 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:32.932 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:32.932 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:32.932 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.932 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.932 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:86621 5.8 5:1597a420:::benchmark_data_smithi096_19531_object86620:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:32.932 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:22.635187+0000", 2024-04-19T03:02:32.932 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 10.264635201000001, 2024-04-19T03:02:32.933 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.194204878, 2024-04-19T03:02:32.933 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:32.933 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:32.933 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:32.933 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:32.933 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:32.933 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 86621 2024-04-19T03:02:32.933 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.933 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:32.933 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.933 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:32.933 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635187+0000", 2024-04-19T03:02:32.933 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:32.934 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.934 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.934 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:32.934 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635187+0000", 2024-04-19T03:02:32.934 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:32.934 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.934 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.934 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:32.934 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635187+0000", 2024-04-19T03:02:32.934 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:32.934 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.934 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.934 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:32.935 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635242+0000", 2024-04-19T03:02:32.935 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5158000000000003e-05 2024-04-19T03:02:32.935 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.935 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.935 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:32.935 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635249+0000", 2024-04-19T03:02:32.935 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.7000000000000008e-06 2024-04-19T03:02:32.935 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.935 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.935 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:32.935 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635256+0000", 2024-04-19T03:02:32.935 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2060000000000004e-06 2024-04-19T03:02:32.935 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.936 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.936 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:32.936 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635302+0000", 2024-04-19T03:02:32.936 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5954000000000001e-05 2024-04-19T03:02:32.936 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.936 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.936 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:32.936 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635427+0000", 2024-04-19T03:02:32.936 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012559299999999999 2024-04-19T03:02:32.936 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.936 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.936 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:32.936 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635596+0000", 2024-04-19T03:02:32.937 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000168615 2024-04-19T03:02:32.937 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.937 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.937 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:32.937 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.639320+0000", 2024-04-19T03:02:32.937 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0037244610000000001 2024-04-19T03:02:32.937 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.937 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.937 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:32.937 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.829277+0000", 2024-04-19T03:02:32.937 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.18995651099999999 2024-04-19T03:02:32.937 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.937 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.937 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:32.938 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.829341+0000", 2024-04-19T03:02:32.938 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3756000000000004e-05 2024-04-19T03:02:32.938 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.938 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.938 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:32.938 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.829392+0000", 2024-04-19T03:02:32.938 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1555999999999999e-05 2024-04-19T03:02:32.938 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:32.938 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:32.938 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:32.938 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.938 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.938 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87062 5.4 5:2d3b5d9a:::benchmark_data_smithi096_19531_object87061:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:32.938 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.136820+0000", 2024-04-19T03:02:32.939 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 9.7630020480000006, 2024-04-19T03:02:32.939 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.066483741999999998, 2024-04-19T03:02:32.939 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:32.939 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:32.939 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:32.939 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:32.939 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:32.939 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87062 2024-04-19T03:02:32.939 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.939 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:32.939 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.939 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:32.939 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.136820+0000", 2024-04-19T03:02:32.939 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:32.940 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.940 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.940 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:32.940 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.136820+0000", 2024-04-19T03:02:32.940 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:32.940 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.940 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.940 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:32.940 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.136819+0000", 2024-04-19T03:02:32.940 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:32.940 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.940 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.940 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:32.940 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.136864+0000", 2024-04-19T03:02:32.940 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4855000000000003e-05 2024-04-19T03:02:32.941 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.941 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.941 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:32.941 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.136881+0000", 2024-04-19T03:02:32.941 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7521999999999999e-05 2024-04-19T03:02:32.941 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.941 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.941 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:32.941 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.136890+0000", 2024-04-19T03:02:32.941 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1039999999999996e-06 2024-04-19T03:02:32.941 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.941 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.941 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:32.941 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.136974+0000", 2024-04-19T03:02:32.942 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3735999999999999e-05 2024-04-19T03:02:32.942 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.942 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.942 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:32.942 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.137308+0000", 2024-04-19T03:02:32.942 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00033376100000000002 2024-04-19T03:02:32.942 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.942 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.942 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:32.942 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.137559+0000", 2024-04-19T03:02:32.942 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000250599 2024-04-19T03:02:32.942 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.942 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.942 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:32.943 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.145423+0000", 2024-04-19T03:02:32.943 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0078649589999999995 2024-04-19T03:02:32.943 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.943 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.943 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:32.943 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.203175+0000", 2024-04-19T03:02:32.943 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057751255000000001 2024-04-19T03:02:32.943 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.943 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.943 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:32.943 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.203250+0000", 2024-04-19T03:02:32.943 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5378999999999998e-05 2024-04-19T03:02:32.943 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.943 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.944 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:32.944 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.203304+0000", 2024-04-19T03:02:32.944 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4015999999999999e-05 2024-04-19T03:02:32.944 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:32.944 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:32.944 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:32.944 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.944 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.944 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87065 5.4 5:21d20a47:::benchmark_data_smithi096_19531_object87064:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:32.944 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.137482+0000", 2024-04-19T03:02:32.944 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 9.7623403139999994, 2024-04-19T03:02:32.944 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.065988749999999999, 2024-04-19T03:02:32.944 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:32.944 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:32.945 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:32.945 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:32.945 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:32.945 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87065 2024-04-19T03:02:32.945 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.945 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:32.945 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.945 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:32.945 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.137482+0000", 2024-04-19T03:02:32.945 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:32.945 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.945 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.945 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:32.945 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.137482+0000", 2024-04-19T03:02:32.946 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:32.946 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.946 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.946 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:32.946 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.137481+0000", 2024-04-19T03:02:32.946 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:32.946 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.946 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.946 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:32.946 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.137530+0000", 2024-04-19T03:02:32.946 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9302000000000003e-05 2024-04-19T03:02:32.946 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.946 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.946 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:32.947 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.137540+0000", 2024-04-19T03:02:32.947 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.2010000000000005e-06 2024-04-19T03:02:32.947 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.947 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.947 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:32.947 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.137545+0000", 2024-04-19T03:02:32.947 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5910000000000003e-06 2024-04-19T03:02:32.947 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.947 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.947 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:32.947 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.140666+0000", 2024-04-19T03:02:32.947 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0031212710000000001 2024-04-19T03:02:32.947 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.947 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.948 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:32.948 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.140847+0000", 2024-04-19T03:02:32.948 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00018065600000000001 2024-04-19T03:02:32.948 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.948 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.948 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:32.948 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.140991+0000", 2024-04-19T03:02:32.948 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014433100000000001 2024-04-19T03:02:32.948 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.948 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.948 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:32.948 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.148053+0000", 2024-04-19T03:02:32.948 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.007061945 2024-04-19T03:02:32.948 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.949 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.949 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:32.949 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.203367+0000", 2024-04-19T03:02:32.949 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.055313703999999998 2024-04-19T03:02:32.949 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.949 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.949 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:32.949 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.203426+0000", 2024-04-19T03:02:32.949 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9024000000000003e-05 2024-04-19T03:02:32.949 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.949 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.949 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:32.949 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.203471+0000", 2024-04-19T03:02:32.949 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4818999999999999e-05 2024-04-19T03:02:32.949 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:32.950 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:32.950 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:32.950 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.950 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.950 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87067 5.b 5:d57af71a:::benchmark_data_smithi096_19531_object87066:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:32.950 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.142233+0000", 2024-04-19T03:02:32.950 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 9.7575893380000007, 2024-04-19T03:02:32.950 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.071692405000000001, 2024-04-19T03:02:32.950 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:32.950 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:32.950 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:32.950 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:32.950 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:32.950 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87067 2024-04-19T03:02:32.951 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.951 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:32.951 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.951 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:32.951 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142233+0000", 2024-04-19T03:02:32.951 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:32.951 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.951 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.951 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:32.951 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142233+0000", 2024-04-19T03:02:32.951 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:32.951 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.951 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.952 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:32.952 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142232+0000", 2024-04-19T03:02:32.952 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:32.952 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.952 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.952 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:32.952 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142277+0000", 2024-04-19T03:02:32.952 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5837000000000002e-05 2024-04-19T03:02:32.952 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.952 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.952 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:32.952 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142297+0000", 2024-04-19T03:02:32.952 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9561000000000001e-05 2024-04-19T03:02:32.952 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.952 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.953 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:32.953 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142311+0000", 2024-04-19T03:02:32.953 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3654e-05 2024-04-19T03:02:32.953 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.953 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.953 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:32.953 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142391+0000", 2024-04-19T03:02:32.953 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0123999999999994e-05 2024-04-19T03:02:32.953 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.953 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.953 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:32.953 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142669+0000", 2024-04-19T03:02:32.953 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00027829800000000001 2024-04-19T03:02:32.954 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.954 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.954 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:32.954 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142859+0000", 2024-04-19T03:02:32.954 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000190051 2024-04-19T03:02:32.954 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.954 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.954 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:32.954 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.150597+0000", 2024-04-19T03:02:32.954 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0077380299999999999 2024-04-19T03:02:32.954 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.954 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.954 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:32.954 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.213855+0000", 2024-04-19T03:02:32.955 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.063257987000000002 2024-04-19T03:02:32.955 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.955 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.955 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:32.955 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.213898+0000", 2024-04-19T03:02:32.955 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2916e-05 2024-04-19T03:02:32.955 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.955 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.955 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:32.955 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.213925+0000", 2024-04-19T03:02:32.955 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7503000000000001e-05 2024-04-19T03:02:32.955 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:32.955 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:32.955 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:32.956 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.956 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.956 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87069 5.b 5:da0c93b5:::benchmark_data_smithi096_19531_object87068:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:32.956 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.143402+0000", 2024-04-19T03:02:32.956 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 9.7564203759999995, 2024-04-19T03:02:32.956 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.070678598999999995, 2024-04-19T03:02:32.956 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:32.956 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:32.956 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:32.956 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:32.956 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:32.956 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87069 2024-04-19T03:02:32.956 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.956 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:32.957 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.957 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:32.957 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.143402+0000", 2024-04-19T03:02:32.957 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:32.957 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.957 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.957 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:32.957 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.143402+0000", 2024-04-19T03:02:32.957 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:32.957 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.957 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.957 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:32.957 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.143401+0000", 2024-04-19T03:02:32.958 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:32.958 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.958 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.958 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:32.958 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.143501+0000", 2024-04-19T03:02:32.958 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000100387 2024-04-19T03:02:32.958 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.958 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.958 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:32.958 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.143516+0000", 2024-04-19T03:02:32.958 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5369000000000001e-05 2024-04-19T03:02:32.958 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.959 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.959 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:32.959 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.143524+0000", 2024-04-19T03:02:32.959 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.7079999999999997e-06 2024-04-19T03:02:32.959 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.959 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.959 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:32.959 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.145550+0000", 2024-04-19T03:02:32.959 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0020259290000000001 2024-04-19T03:02:32.959 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.959 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.959 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:32.959 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.145676+0000", 2024-04-19T03:02:32.960 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000126406 2024-04-19T03:02:32.960 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.960 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.960 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:32.960 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.145802+0000", 2024-04-19T03:02:32.960 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000125974 2024-04-19T03:02:32.960 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.960 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.960 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:32.960 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.151030+0000", 2024-04-19T03:02:32.960 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0052276079999999999 2024-04-19T03:02:32.960 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.960 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.961 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:32.961 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.213998+0000", 2024-04-19T03:02:32.961 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.06296786 2024-04-19T03:02:32.961 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.961 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.961 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:32.961 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.214031+0000", 2024-04-19T03:02:32.961 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3387999999999999e-05 2024-04-19T03:02:32.961 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.961 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.961 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:32.961 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.214081+0000", 2024-04-19T03:02:32.961 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9316e-05 2024-04-19T03:02:32.961 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:32.962 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:32.962 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:32.962 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.962 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.962 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87073 5.0 5:0ca21233:::benchmark_data_smithi096_19531_object87072:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:32.962 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.145929+0000", 2024-04-19T03:02:32.962 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 9.7538931160000004, 2024-04-19T03:02:32.962 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.062283234999999999, 2024-04-19T03:02:32.962 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:32.962 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:32.962 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:32.962 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:32.962 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:32.962 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87073 2024-04-19T03:02:32.963 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.963 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:32.963 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.963 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:32.963 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.145929+0000", 2024-04-19T03:02:32.963 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:32.963 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.963 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.963 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:32.963 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.145929+0000", 2024-04-19T03:02:32.963 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:32.963 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.963 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.963 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:32.964 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.145928+0000", 2024-04-19T03:02:32.964 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:32.964 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.964 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.964 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:32.964 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.146063+0000", 2024-04-19T03:02:32.964 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013541099999999999 2024-04-19T03:02:32.964 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.964 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.964 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:32.964 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.146079+0000", 2024-04-19T03:02:32.965 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5902000000000001e-05 2024-04-19T03:02:32.965 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.965 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.965 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:32.965 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.146100+0000", 2024-04-19T03:02:32.965 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0380000000000001e-05 2024-04-19T03:02:32.965 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.965 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.965 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:32.965 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.146193+0000", 2024-04-19T03:02:32.965 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.3669000000000001e-05 2024-04-19T03:02:32.965 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.965 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.966 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:32.966 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.146388+0000", 2024-04-19T03:02:32.966 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00019457799999999999 2024-04-19T03:02:32.966 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.966 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.966 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:32.966 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.146625+0000", 2024-04-19T03:02:32.966 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00023751999999999999 2024-04-19T03:02:32.966 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.966 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.966 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:32.967 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.151051+0000", 2024-04-19T03:02:32.967 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0044260039999999999 2024-04-19T03:02:32.967 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.967 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.967 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:32.967 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.207872+0000", 2024-04-19T03:02:32.967 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.056821114999999998 2024-04-19T03:02:32.967 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.967 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.967 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:32.967 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.208085+0000", 2024-04-19T03:02:32.967 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000212893 2024-04-19T03:02:32.967 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.968 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.968 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:32.968 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.208213+0000", 2024-04-19T03:02:32.968 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012714700000000001 2024-04-19T03:02:32.968 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:32.968 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:32.968 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:32.968 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.968 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.968 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87074 5.0 5:035614ac:::benchmark_data_smithi096_19531_object87073:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:32.968 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.151387+0000", 2024-04-19T03:02:32.968 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 9.7484351849999999, 2024-04-19T03:02:32.968 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.063461771, 2024-04-19T03:02:32.969 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:32.969 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:32.969 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:32.969 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:32.969 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:32.969 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87074 2024-04-19T03:02:32.969 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.969 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:32.969 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.969 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:32.969 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.151387+0000", 2024-04-19T03:02:32.969 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:32.969 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.969 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.970 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:32.970 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.151387+0000", 2024-04-19T03:02:32.970 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:32.970 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.970 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.970 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:32.970 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.151386+0000", 2024-04-19T03:02:32.970 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:32.970 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.970 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.970 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:32.970 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.151428+0000", 2024-04-19T03:02:32.970 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.172e-05 2024-04-19T03:02:32.971 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.971 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.971 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:32.971 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.151442+0000", 2024-04-19T03:02:32.971 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4328000000000001e-05 2024-04-19T03:02:32.971 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.971 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.971 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:32.971 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.151451+0000", 2024-04-19T03:02:32.971 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.8400000000000001e-06 2024-04-19T03:02:32.971 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.971 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.971 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:32.971 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.151521+0000", 2024-04-19T03:02:32.972 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.9606999999999999e-05 2024-04-19T03:02:32.972 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.972 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.972 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:32.972 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.151749+0000", 2024-04-19T03:02:32.972 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00022818799999999999 2024-04-19T03:02:32.972 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.972 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.972 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:32.972 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.152006+0000", 2024-04-19T03:02:32.972 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00025687300000000002 2024-04-19T03:02:32.972 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.972 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.972 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:32.972 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.154887+0000", 2024-04-19T03:02:32.973 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0028812989999999999 2024-04-19T03:02:32.973 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.973 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.973 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:32.973 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.214733+0000", 2024-04-19T03:02:32.973 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.059846159000000003 2024-04-19T03:02:32.973 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.973 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.973 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:32.973 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.214788+0000", 2024-04-19T03:02:32.973 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4524000000000002e-05 2024-04-19T03:02:32.973 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.973 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.973 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:32.974 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.214849+0000", 2024-04-19T03:02:32.974 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1362e-05 2024-04-19T03:02:32.974 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:32.974 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:32.974 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:32.974 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.974 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.974 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87108 5.e 5:7e197adc:::benchmark_data_smithi096_19531_object87107:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:32.974 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.223103+0000", 2024-04-19T03:02:32.974 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 9.676719039, 2024-04-19T03:02:32.974 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.044946887, 2024-04-19T03:02:32.974 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:32.974 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-19T03:02:32.975 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:32.975 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:32.975 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:32.975 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87108 2024-04-19T03:02:32.975 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.975 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:32.975 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.975 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:32.975 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.223103+0000", 2024-04-19T03:02:32.975 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:32.975 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.975 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.975 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:32.975 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.223103+0000", 2024-04-19T03:02:32.975 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:32.976 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.976 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.976 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:32.976 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.223102+0000", 2024-04-19T03:02:32.976 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:32.976 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.976 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.976 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:32.976 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.223156+0000", 2024-04-19T03:02:32.976 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3958000000000001e-05 2024-04-19T03:02:32.976 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.976 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.976 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:32.976 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.223166+0000", 2024-04-19T03:02:32.977 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.4809999999999995e-06 2024-04-19T03:02:32.977 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.977 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.977 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:32.977 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.223172+0000", 2024-04-19T03:02:32.977 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0140000000000004e-06 2024-04-19T03:02:32.977 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.977 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.977 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:32.977 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.227295+0000", 2024-04-19T03:02:32.977 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0041233420000000003 2024-04-19T03:02:32.977 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.977 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.978 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:32.978 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.227495+0000", 2024-04-19T03:02:32.978 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00019955299999999999 2024-04-19T03:02:32.978 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.978 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.978 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:32.978 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.227717+0000", 2024-04-19T03:02:32.978 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000221902 2024-04-19T03:02:32.978 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.978 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.978 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:32.978 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233189+0000", 2024-04-19T03:02:32.978 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0054718889999999997 2024-04-19T03:02:32.979 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.979 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.979 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:32.979 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.250529+0000", 2024-04-19T03:02:32.979 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.017340298000000001 2024-04-19T03:02:32.979 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.979 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.979 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:02:32.979 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.250539+0000", 2024-04-19T03:02:32.979 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0501e-05 2024-04-19T03:02:32.979 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.979 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.979 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:32.979 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.268003+0000", 2024-04-19T03:02:32.979 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.017463429 2024-04-19T03:02:32.980 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.980 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.980 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:32.980 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.268050+0000", 2024-04-19T03:02:32.980 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7466000000000003e-05 2024-04-19T03:02:32.980 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:32.980 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:32.980 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:32.980 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.980 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.980 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87118 5.b 5:d1bb4f3c:::benchmark_data_smithi096_19531_object87117:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:32.980 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.231082+0000", 2024-04-19T03:02:32.980 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 9.6687402050000006, 2024-04-19T03:02:32.981 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.035789004, 2024-04-19T03:02:32.981 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:32.981 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-19T03:02:32.981 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:32.981 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:32.981 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:32.981 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87118 2024-04-19T03:02:32.981 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.981 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:32.981 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.981 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:32.981 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231082+0000", 2024-04-19T03:02:32.981 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:32.981 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.981 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.982 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:32.982 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231082+0000", 2024-04-19T03:02:32.982 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:32.982 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.982 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.982 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:32.982 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231081+0000", 2024-04-19T03:02:32.982 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:32.982 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.982 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.982 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:32.982 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231159+0000", 2024-04-19T03:02:32.982 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.7819999999999997e-05 2024-04-19T03:02:32.982 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.983 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.983 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:32.983 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231186+0000", 2024-04-19T03:02:32.983 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7126000000000001e-05 2024-04-19T03:02:32.983 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.983 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.983 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:32.983 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231193+0000", 2024-04-19T03:02:32.983 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7259999999999996e-06 2024-04-19T03:02:32.983 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.983 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.983 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:32.983 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231241+0000", 2024-04-19T03:02:32.983 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8123e-05 2024-04-19T03:02:32.984 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.984 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.984 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:32.984 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231354+0000", 2024-04-19T03:02:32.984 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0001133 2024-04-19T03:02:32.984 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.984 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.984 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:32.984 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231443+0000", 2024-04-19T03:02:32.984 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9167999999999997e-05 2024-04-19T03:02:32.984 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.984 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.984 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:32.984 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236498+0000", 2024-04-19T03:02:32.985 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0050545160000000002 2024-04-19T03:02:32.985 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.985 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.985 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:32.985 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.249681+0000", 2024-04-19T03:02:32.985 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013183321 2024-04-19T03:02:32.985 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.985 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.985 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:02:32.985 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.249693+0000", 2024-04-19T03:02:32.985 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1834999999999999e-05 2024-04-19T03:02:32.985 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.985 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.986 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:32.986 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266733+0000", 2024-04-19T03:02:32.986 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.017040408 2024-04-19T03:02:32.986 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.986 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.986 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:32.986 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266871+0000", 2024-04-19T03:02:32.986 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000137849 2024-04-19T03:02:32.986 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:32.986 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:32.986 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:32.986 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.986 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.986 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87121 5.b 5:d01822b8:::benchmark_data_smithi096_19531_object87120:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:32.987 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.233319+0000", 2024-04-19T03:02:32.987 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 9.6665033410000003, 2024-04-19T03:02:32.987 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.033624198, 2024-04-19T03:02:32.987 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:32.987 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-19T03:02:32.987 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:32.987 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:32.987 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:32.987 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87121 2024-04-19T03:02:32.987 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.987 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:32.987 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.987 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:32.988 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233319+0000", 2024-04-19T03:02:32.988 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:32.988 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.988 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.988 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:32.988 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233319+0000", 2024-04-19T03:02:32.988 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:32.988 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.988 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.988 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:32.988 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233319+0000", 2024-04-19T03:02:32.988 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:32.988 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.988 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.989 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:32.989 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233364+0000", 2024-04-19T03:02:32.989 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5460999999999997e-05 2024-04-19T03:02:32.989 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.989 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.989 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:32.989 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233382+0000", 2024-04-19T03:02:32.989 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8148e-05 2024-04-19T03:02:32.989 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.989 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.989 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:32.989 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233390+0000", 2024-04-19T03:02:32.989 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5340000000000002e-06 2024-04-19T03:02:32.989 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.990 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.990 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:32.990 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233712+0000", 2024-04-19T03:02:32.990 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00032260500000000001 2024-04-19T03:02:32.990 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.990 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.990 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:32.990 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233829+0000", 2024-04-19T03:02:32.990 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011638599999999999 2024-04-19T03:02:32.990 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.990 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.990 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:32.990 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233959+0000", 2024-04-19T03:02:32.990 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013013900000000001 2024-04-19T03:02:32.991 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.991 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.991 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:32.991 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236515+0000", 2024-04-19T03:02:32.991 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0025562750000000002 2024-04-19T03:02:32.991 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.991 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.991 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:32.991 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.249723+0000", 2024-04-19T03:02:32.991 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013208176 2024-04-19T03:02:32.991 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.991 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.991 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:02:32.992 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.249728+0000", 2024-04-19T03:02:32.992 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6519999999999997e-06 2024-04-19T03:02:32.992 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.992 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.992 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:32.992 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266837+0000", 2024-04-19T03:02:32.992 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0171087059999999 2024-04-19T03:02:32.992 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.992 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.992 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:32.992 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266943+0000", 2024-04-19T03:02:32.992 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000106604 2024-04-19T03:02:32.992 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:32.992 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:32.993 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:32.993 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.993 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.993 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87124 5.8 5:14819ad7:::benchmark_data_smithi096_19531_object87123:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:32.993 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.235886+0000", 2024-04-19T03:02:32.993 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 9.6639359169999999, 2024-04-19T03:02:32.993 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0315451179999999, 2024-04-19T03:02:32.993 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:32.993 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-19T03:02:32.993 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:32.993 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:32.993 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:32.993 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87124 2024-04-19T03:02:32.993 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.993 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:32.994 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.994 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:32.994 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.235886+0000", 2024-04-19T03:02:32.994 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:32.994 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.994 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.994 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:32.994 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.235886+0000", 2024-04-19T03:02:32.994 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:32.994 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.994 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.994 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:32.994 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.235886+0000", 2024-04-19T03:02:32.995 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:32.995 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.995 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.995 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:32.995 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.235934+0000", 2024-04-19T03:02:32.995 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8384000000000003e-05 2024-04-19T03:02:32.995 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.995 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.995 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:32.995 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.235945+0000", 2024-04-19T03:02:32.995 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0671e-05 2024-04-19T03:02:32.995 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.995 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.995 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:32.996 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.235952+0000", 2024-04-19T03:02:32.996 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3089999999999998e-06 2024-04-19T03:02:32.996 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.996 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.996 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:32.996 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.237067+0000", 2024-04-19T03:02:32.996 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001115263 2024-04-19T03:02:32.996 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.996 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.996 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:32.996 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.237188+0000", 2024-04-19T03:02:32.996 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000121258 2024-04-19T03:02:32.996 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.996 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.997 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:32.997 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.237316+0000", 2024-04-19T03:02:32.997 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000128071 2024-04-19T03:02:32.997 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.997 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.997 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:32.997 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240744+0000", 2024-04-19T03:02:32.997 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0034275629999999998 2024-04-19T03:02:32.997 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.997 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.997 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:32.997 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.252517+0000", 2024-04-19T03:02:32.997 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011772991999999999 2024-04-19T03:02:32.998 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.998 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.998 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:02:32.998 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.252523+0000", 2024-04-19T03:02:32.998 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3640000000000004e-06 2024-04-19T03:02:32.998 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.998 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.998 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:32.998 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.267290+0000", 2024-04-19T03:02:32.998 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0147665690000001 2024-04-19T03:02:32.998 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.998 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.998 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:32.998 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.267432+0000", 2024-04-19T03:02:32.999 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014165299999999999 2024-04-19T03:02:32.999 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:32.999 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:32.999 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:32.999 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:32.999 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:32.999 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87129 5.0 5:02667e01:::benchmark_data_smithi096_19531_object87128:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:32.999 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.236466+0000", 2024-04-19T03:02:32.999 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 9.6633559210000008, 2024-04-19T03:02:32.999 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0301534510000001, 2024-04-19T03:02:32.999 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:32.999 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-19T03:02:32.999 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:33.000 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:33.000 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:33.000 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87129 2024-04-19T03:02:33.000 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:33.000 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:33.000 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:33.000 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:33.000 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236466+0000", 2024-04-19T03:02:33.000 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:33.000 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:33.000 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:33.000 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:33.000 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236466+0000", 2024-04-19T03:02:33.000 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:33.000 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:33.001 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:33.001 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:33.001 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236465+0000", 2024-04-19T03:02:33.001 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:33.001 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:33.001 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:33.001 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:33.001 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236566+0000", 2024-04-19T03:02:33.001 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010047000000000001 2024-04-19T03:02:33.001 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:33.001 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:33.001 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:33.001 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236577+0000", 2024-04-19T03:02:33.001 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1772e-05 2024-04-19T03:02:33.002 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:33.002 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:33.002 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:33.002 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236584+0000", 2024-04-19T03:02:33.002 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0530000000000003e-06 2024-04-19T03:02:33.002 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:33.002 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:33.002 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:33.002 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.237023+0000", 2024-04-19T03:02:33.002 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000439703 2024-04-19T03:02:33.002 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:33.002 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:33.002 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:33.002 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.237207+0000", 2024-04-19T03:02:33.003 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000183692 2024-04-19T03:02:33.003 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:33.003 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:33.003 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:33.003 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.237373+0000", 2024-04-19T03:02:33.003 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016623500000000001 2024-04-19T03:02:33.003 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:33.003 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:33.003 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:33.003 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.241461+0000", 2024-04-19T03:02:33.003 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0040883050000000004 2024-04-19T03:02:33.003 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:33.003 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:33.003 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:33.004 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.252500+0000", 2024-04-19T03:02:33.004 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011038450999999999 2024-04-19T03:02:33.004 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:33.004 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:33.004 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:02:33.004 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.252507+0000", 2024-04-19T03:02:33.004 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2439999999999996e-06 2024-04-19T03:02:33.004 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:33.004 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:33.004 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:33.004 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266538+0000", 2024-04-19T03:02:33.004 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.014031184 2024-04-19T03:02:33.004 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:33.004 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:33.004 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:33.005 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266620+0000", 2024-04-19T03:02:33.005 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1600000000000005e-05 2024-04-19T03:02:33.005 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:33.005 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:33.005 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:33.005 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:33.005 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:33.005 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87135 5.4 5:2a97e7b7:::benchmark_data_smithi096_19531_object87134:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:33.005 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.240884+0000", 2024-04-19T03:02:33.005 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 9.6589384640000002, 2024-04-19T03:02:33.005 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.025708931, 2024-04-19T03:02:33.005 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:33.005 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-19T03:02:33.005 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:33.006 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:33.006 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:33.006 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87135 2024-04-19T03:02:33.006 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:33.006 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:33.006 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:33.006 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:33.006 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240884+0000", 2024-04-19T03:02:33.006 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:33.006 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:33.006 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:33.006 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:33.006 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240884+0000", 2024-04-19T03:02:33.006 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:33.007 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:33.007 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:33.007 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:33.007 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240883+0000", 2024-04-19T03:02:33.007 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:33.007 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:33.007 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:33.007 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:33.007 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240933+0000", 2024-04-19T03:02:33.007 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9969999999999998e-05 2024-04-19T03:02:33.007 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:33.007 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:33.007 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:33.007 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240946+0000", 2024-04-19T03:02:33.008 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2943e-05 2024-04-19T03:02:33.008 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:33.008 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:33.008 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:33.008 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240952+0000", 2024-04-19T03:02:33.008 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8930000000000002e-06 2024-04-19T03:02:33.008 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:33.008 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:33.008 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:33.008 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240994+0000", 2024-04-19T03:02:33.008 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2753999999999998e-05 2024-04-19T03:02:33.008 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:33.008 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:33.008 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:33.008 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.241092+0000", 2024-04-19T03:02:33.009 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.7447000000000004e-05 2024-04-19T03:02:33.009 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:33.009 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:33.009 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:33.009 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.241183+0000", 2024-04-19T03:02:33.009 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1163999999999997e-05 2024-04-19T03:02:33.009 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:33.009 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:33.009 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:33.009 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.254672+0000", 2024-04-19T03:02:33.009 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.01348864 2024-04-19T03:02:33.009 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:33.009 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:33.009 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:02:33.010 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.254681+0000", 2024-04-19T03:02:33.010 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.3789999999999995e-06 2024-04-19T03:02:33.010 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:33.010 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:33.010 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:33.010 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266456+0000", 2024-04-19T03:02:33.010 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.011774621 2024-04-19T03:02:33.010 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:33.010 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:33.010 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:33.010 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266593+0000", 2024-04-19T03:02:33.010 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013737600000000001 2024-04-19T03:02:33.010 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:33.011 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:33.011 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:33.011 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:33.011 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:33.011 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87136 5.4 5:212411bc:::benchmark_data_smithi096_19531_object87135:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:33.011 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.240962+0000", 2024-04-19T03:02:33.011 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 9.6588605879999996, 2024-04-19T03:02:33.011 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.025738, 2024-04-19T03:02:33.011 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:33.011 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-19T03:02:33.011 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:33.011 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:33.011 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:33.011 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87136 2024-04-19T03:02:33.011 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:33.012 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:33.012 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:33.012 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:33.012 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240962+0000", 2024-04-19T03:02:33.012 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:33.012 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:33.012 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:33.012 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:33.012 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240962+0000", 2024-04-19T03:02:33.012 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:33.012 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:33.012 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:33.012 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:33.013 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240961+0000", 2024-04-19T03:02:33.013 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:33.013 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:33.013 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:33.013 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:33.013 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240995+0000", 2024-04-19T03:02:33.013 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3868000000000002e-05 2024-04-19T03:02:33.013 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:33.013 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:33.013 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:33.013 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.241001+0000", 2024-04-19T03:02:33.013 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.322e-06 2024-04-19T03:02:33.013 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:33.013 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:33.013 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:33.014 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.241004+0000", 2024-04-19T03:02:33.014 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3510000000000002e-06 2024-04-19T03:02:33.014 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:33.014 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:33.014 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:33.014 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247131+0000", 2024-04-19T03:02:33.014 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0061270869999999998 2024-04-19T03:02:33.014 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:33.014 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:33.014 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:33.014 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247322+0000", 2024-04-19T03:02:33.014 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000191015 2024-04-19T03:02:33.014 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:33.015 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:33.015 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:33.015 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247542+0000", 2024-04-19T03:02:33.015 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00022030199999999999 2024-04-19T03:02:33.015 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:33.015 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:33.015 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:33.015 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.254709+0000", 2024-04-19T03:02:33.015 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0071662660000000001 2024-04-19T03:02:33.015 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:33.015 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:33.015 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:02:33.015 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.254716+0000", 2024-04-19T03:02:33.016 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3860000000000001e-06 2024-04-19T03:02:33.016 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:33.016 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:33.016 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:33.016 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266619+0000", 2024-04-19T03:02:33.016 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0119031030000001 2024-04-19T03:02:33.016 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:33.016 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:33.016 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:33.016 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266700+0000", 2024-04-19T03:02:33.016 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0764000000000001e-05 2024-04-19T03:02:33.016 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:33.016 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:33.016 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:33.017 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:33.017 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:33.017 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87138 5.e 5:7b1f1c20:::benchmark_data_smithi096_19531_object87137:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:33.017 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.247862+0000", 2024-04-19T03:02:33.017 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 9.6519605140000007, 2024-04-19T03:02:33.017 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.024457079, 2024-04-19T03:02:33.017 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:33.017 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:33.017 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:33.017 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:33.017 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:33.017 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87138 2024-04-19T03:02:33.017 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:33.017 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:33.018 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:33.018 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:33.018 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247862+0000", 2024-04-19T03:02:33.018 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:33.018 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:33.018 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:33.018 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:33.018 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247862+0000", 2024-04-19T03:02:33.018 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:33.018 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:33.018 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:33.018 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:33.018 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247860+0000", 2024-04-19T03:02:33.018 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999981 2024-04-19T03:02:33.019 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:33.019 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:33.019 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:33.019 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247909+0000", 2024-04-19T03:02:33.019 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9150999999999997e-05 2024-04-19T03:02:33.019 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:33.019 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:33.019 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:33.019 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247925+0000", 2024-04-19T03:02:33.019 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5761999999999999e-05 2024-04-19T03:02:33.019 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:33.019 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:33.019 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:33.019 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247936+0000", 2024-04-19T03:02:33.020 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1144e-05 2024-04-19T03:02:33.020 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:33.020 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:33.020 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:33.020 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.250590+0000", 2024-04-19T03:02:33.020 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.002653678 2024-04-19T03:02:33.020 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:33.020 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:33.020 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:02:33.020 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.250599+0000", 2024-04-19T03:02:33.020 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9039999999999998e-06 2024-04-19T03:02:33.020 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:33.020 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:33.020 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:33.021 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.268151+0000", 2024-04-19T03:02:33.021 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0175523449999999 2024-04-19T03:02:33.021 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:33.021 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:33.021 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:33.021 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.268285+0000", 2024-04-19T03:02:33.021 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013415599999999999 2024-04-19T03:02:33.021 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:33.021 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:33.021 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:33.021 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.272238+0000", 2024-04-19T03:02:33.021 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0039533019999999997 2024-04-19T03:02:33.021 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:33.021 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:33.022 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:33.022 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.272274+0000", 2024-04-19T03:02:33.022 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5352000000000003e-05 2024-04-19T03:02:33.022 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:33.022 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:33.022 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:33.022 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.272319+0000", 2024-04-19T03:02:33.022 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5281999999999998e-05 2024-04-19T03:02:33.022 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:33.022 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:33.022 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:33.022 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:33.022 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:33.022 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-19T03:02:33.025 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:33.021+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:33.026 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T03:02:33.030 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-19T03:02:33.033 INFO:teuthology.orchestra.run.smithi096.stderr:dumped all 2024-04-19T03:02:33.033 INFO:teuthology.orchestra.run.smithi096.stdout:{"pg_ready":true,"pg_map":{"version":86,"stamp":"2024-04-19T03:02:31.969873+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":6437342042,"num_objects":98241,"num_object_clones":0,"num_object_copies":196482,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":79885,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98241,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":98465,"num_write_kb":6289362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":62401,"ondisk_log_size":62401,"up":156,"acting":156,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":242,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1036632,"kb_used_data":724284,"kb_used_omap":4,"kb_used_meta":312315,"kb_avail":282078888,"statfs":{"total":289910292480,"available":288848781312,"internally_reserved":0,"allocated":741666816,"data_stored":11843455952,"data_compressed":22705888,"data_compressed_allocated":740184064,"data_compressed_original":11842912256,"omap_allocated":4782,"internal_metadata":319810898},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3,0,0,3],"upper_bound":16},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1090387968,"num_objects":16638,"num_object_clones":0,"num_object_copies":33276,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":79885,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16638,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16638,"num_write_kb":1064832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.722397"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":39,"reported_epoch":44,"state":"active+undersized","last_fresh":"2024-04-19T03:02:24.266480+0000","last_change":"2024-04-19T03:02:24.266182+0000","last_active":"2024-04-19T03:02:24.266480+0000","last_peered":"2024-04-19T03:02:24.266480+0000","last_clean":"2024-04-19T03:02:21.249547+0000","last_became_active":"2024-04-19T03:02:24.266182+0000","last_became_peered":"2024-04-19T03:02:24.266182+0000","last_unstale":"2024-04-19T03:02:24.266480+0000","last_undegraded":"2024-04-19T03:02:24.266480+0000","last_fullsized":"2024-04-19T03:02:24.261935+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:20:35.729791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":39,"reported_epoch":44,"state":"active+undersized","last_fresh":"2024-04-19T03:02:24.270136+0000","last_change":"2024-04-19T03:02:24.268239+0000","last_active":"2024-04-19T03:02:24.270136+0000","last_peered":"2024-04-19T03:02:24.270136+0000","last_clean":"2024-04-19T03:02:21.248866+0000","last_became_active":"2024-04-19T03:02:24.268239+0000","last_became_peered":"2024-04-19T03:02:24.268239+0000","last_unstale":"2024-04-19T03:02:24.270136+0000","last_undegraded":"2024-04-19T03:02:24.270136+0000","last_fullsized":"2024-04-19T03:02:24.256328+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:18:42.206345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":34,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-19T03:02:24.260468+0000","last_change":"2024-04-19T03:01:15.015884+0000","last_active":"2024-04-19T03:02:24.260468+0000","last_peered":"2024-04-19T03:02:24.260468+0000","last_clean":"2024-04-19T03:02:24.260468+0000","last_became_active":"2024-04-19T03:01:15.014599+0000","last_became_peered":"2024-04-19T03:01:15.014599+0000","last_unstale":"2024-04-19T03:02:24.260468+0000","last_undegraded":"2024-04-19T03:02:24.260468+0000","last_fullsized":"2024-04-19T03:02:24.260468+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:35:19.436344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":39,"reported_epoch":44,"state":"active+undersized","last_fresh":"2024-04-19T03:02:24.283724+0000","last_change":"2024-04-19T03:02:24.283312+0000","last_active":"2024-04-19T03:02:24.283724+0000","last_peered":"2024-04-19T03:02:24.283724+0000","last_clean":"2024-04-19T03:02:21.239010+0000","last_became_active":"2024-04-19T03:02:24.283312+0000","last_became_peered":"2024-04-19T03:02:24.283312+0000","last_unstale":"2024-04-19T03:02:24.283724+0000","last_undegraded":"2024-04-19T03:02:24.283724+0000","last_fullsized":"2024-04-19T03:02:24.265015+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:19:54.265057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":39,"reported_epoch":44,"state":"active+undersized","last_fresh":"2024-04-19T03:02:24.266392+0000","last_change":"2024-04-19T03:02:24.265793+0000","last_active":"2024-04-19T03:02:24.266392+0000","last_peered":"2024-04-19T03:02:24.266392+0000","last_clean":"2024-04-19T03:02:21.249126+0000","last_became_active":"2024-04-19T03:02:24.265793+0000","last_became_peered":"2024-04-19T03:02:24.265793+0000","last_unstale":"2024-04-19T03:02:24.266392+0000","last_undegraded":"2024-04-19T03:02:24.266392+0000","last_fullsized":"2024-04-19T03:02:24.253775+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:15:46.441415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":34,"reported_epoch":44,"state":"active+undersized","last_fresh":"2024-04-19T03:02:24.270121+0000","last_change":"2024-04-19T03:02:24.269520+0000","last_active":"2024-04-19T03:02:24.270121+0000","last_peered":"2024-04-19T03:02:24.270121+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"2024-04-19T03:02:24.269520+0000","last_became_peered":"2024-04-19T03:02:24.269520+0000","last_unstale":"2024-04-19T03:02:24.270121+0000","last_undegraded":"2024-04-19T03:02:24.270121+0000","last_fullsized":"2024-04-19T03:02:24.255694+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:45:46.332608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":34,"reported_epoch":44,"state":"active+undersized","last_fresh":"2024-04-19T03:02:24.271812+0000","last_change":"2024-04-19T03:02:24.271511+0000","last_active":"2024-04-19T03:02:24.271812+0000","last_peered":"2024-04-19T03:02:24.271812+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"2024-04-19T03:02:24.271511+0000","last_became_peered":"2024-04-19T03:02:24.271511+0000","last_unstale":"2024-04-19T03:02:24.271812+0000","last_undegraded":"2024-04-19T03:02:24.271812+0000","last_fullsized":"2024-04-19T03:02:24.257544+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:45:01.989501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":39,"reported_epoch":44,"state":"active+undersized","last_fresh":"2024-04-19T03:02:24.261773+0000","last_change":"2024-04-19T03:02:24.261119+0000","last_active":"2024-04-19T03:02:24.261773+0000","last_peered":"2024-04-19T03:02:24.261773+0000","last_clean":"2024-04-19T03:02:21.238411+0000","last_became_active":"2024-04-19T03:02:24.261119+0000","last_became_peered":"2024-04-19T03:02:24.261119+0000","last_unstale":"2024-04-19T03:02:24.261773+0000","last_undegraded":"2024-04-19T03:02:24.261773+0000","last_fullsized":"2024-04-19T03:02:24.254717+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:52:09.405073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+undersized","last_fresh":"2024-04-19T03:02:25.045896+0000","last_change":"2024-04-19T03:02:24.263980+0000","last_active":"2024-04-19T03:02:25.045896+0000","last_peered":"2024-04-19T03:02:25.045896+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"2024-04-19T03:02:24.263980+0000","last_became_peered":"2024-04-19T03:02:24.263980+0000","last_unstale":"2024-04-19T03:02:25.045896+0000","last_undegraded":"2024-04-19T03:02:25.045896+0000","last_fullsized":"2024-04-19T03:02:24.256849+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:07:41.954531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":39,"reported_epoch":44,"state":"active+undersized","last_fresh":"2024-04-19T03:02:24.271368+0000","last_change":"2024-04-19T03:02:24.268562+0000","last_active":"2024-04-19T03:02:24.271368+0000","last_peered":"2024-04-19T03:02:24.271368+0000","last_clean":"2024-04-19T03:02:21.249077+0000","last_became_active":"2024-04-19T03:02:24.268562+0000","last_became_peered":"2024-04-19T03:02:24.268562+0000","last_unstale":"2024-04-19T03:02:24.271368+0000","last_undegraded":"2024-04-19T03:02:24.271368+0000","last_fullsized":"2024-04-19T03:02:24.256743+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:38:31.274752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":34,"reported_epoch":44,"state":"active+undersized","last_fresh":"2024-04-19T03:02:24.273935+0000","last_change":"2024-04-19T03:02:24.273737+0000","last_active":"2024-04-19T03:02:24.273935+0000","last_peered":"2024-04-19T03:02:24.273935+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"2024-04-19T03:02:24.273737+0000","last_became_peered":"2024-04-19T03:02:24.273737+0000","last_unstale":"2024-04-19T03:02:24.273935+0000","last_undegraded":"2024-04-19T03:02:24.273935+0000","last_fullsized":"2024-04-19T03:02:24.262626+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:19:16.702009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":34,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-19T03:02:24.254053+0000","last_change":"2024-04-19T03:01:15.020240+0000","last_active":"2024-04-19T03:02:24.254053+0000","last_peered":"2024-04-19T03:02:24.254053+0000","last_clean":"2024-04-19T03:02:24.254053+0000","last_became_active":"2024-04-19T03:01:15.019820+0000","last_became_peered":"2024-04-19T03:01:15.019820+0000","last_unstale":"2024-04-19T03:02:24.254053+0000","last_undegraded":"2024-04-19T03:02:24.254053+0000","last_fullsized":"2024-04-19T03:02:24.254053+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:09:23.427311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":39,"reported_epoch":44,"state":"active+undersized","last_fresh":"2024-04-19T03:02:24.265850+0000","last_change":"2024-04-19T03:02:24.265275+0000","last_active":"2024-04-19T03:02:24.265850+0000","last_peered":"2024-04-19T03:02:24.265850+0000","last_clean":"2024-04-19T03:02:21.248908+0000","last_became_active":"2024-04-19T03:02:24.265275+0000","last_became_peered":"2024-04-19T03:02:24.265275+0000","last_unstale":"2024-04-19T03:02:24.265850+0000","last_undegraded":"2024-04-19T03:02:24.265850+0000","last_fullsized":"2024-04-19T03:02:24.253280+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:10:26.573207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":34,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-19T03:02:24.256870+0000","last_change":"2024-04-19T03:01:15.010960+0000","last_active":"2024-04-19T03:02:24.256870+0000","last_peered":"2024-04-19T03:02:24.256870+0000","last_clean":"2024-04-19T03:02:24.256870+0000","last_became_active":"2024-04-19T03:01:15.010472+0000","last_became_peered":"2024-04-19T03:01:15.010472+0000","last_unstale":"2024-04-19T03:02:24.256870+0000","last_undegraded":"2024-04-19T03:02:24.256870+0000","last_fullsized":"2024-04-19T03:02:24.256870+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:21:36.129346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":34,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-19T03:02:24.257643+0000","last_change":"2024-04-19T03:01:15.014574+0000","last_active":"2024-04-19T03:02:24.257643+0000","last_peered":"2024-04-19T03:02:24.257643+0000","last_clean":"2024-04-19T03:02:24.257643+0000","last_became_active":"2024-04-19T03:01:15.014096+0000","last_became_peered":"2024-04-19T03:01:15.014096+0000","last_unstale":"2024-04-19T03:02:24.257643+0000","last_undegraded":"2024-04-19T03:02:24.257643+0000","last_fullsized":"2024-04-19T03:02:24.257643+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:01:54.253963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":34,"reported_epoch":44,"state":"active+undersized","last_fresh":"2024-04-19T03:02:24.263665+0000","last_change":"2024-04-19T03:02:24.261536+0000","last_active":"2024-04-19T03:02:24.263665+0000","last_peered":"2024-04-19T03:02:24.263665+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"2024-04-19T03:02:24.261536+0000","last_became_peered":"2024-04-19T03:02:24.261536+0000","last_unstale":"2024-04-19T03:02:24.263665+0000","last_undegraded":"2024-04-19T03:02:24.263665+0000","last_fullsized":"2024-04-19T03:02:24.255185+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:22:34.583134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+undersized","last_fresh":"2024-04-19T03:02:25.045918+0000","last_change":"2024-04-19T03:02:24.264729+0000","last_active":"2024-04-19T03:02:25.045918+0000","last_peered":"2024-04-19T03:02:25.045918+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"2024-04-19T03:02:24.264729+0000","last_became_peered":"2024-04-19T03:02:24.264729+0000","last_unstale":"2024-04-19T03:02:25.045918+0000","last_undegraded":"2024-04-19T03:02:25.045918+0000","last_fullsized":"2024-04-19T03:02:24.258548+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:16:20.425626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":39,"reported_epoch":44,"state":"active+undersized","last_fresh":"2024-04-19T03:02:24.271520+0000","last_change":"2024-04-19T03:02:24.269142+0000","last_active":"2024-04-19T03:02:24.271520+0000","last_peered":"2024-04-19T03:02:24.271520+0000","last_clean":"2024-04-19T03:02:21.249343+0000","last_became_active":"2024-04-19T03:02:24.269142+0000","last_became_peered":"2024-04-19T03:02:24.269142+0000","last_unstale":"2024-04-19T03:02:24.271520+0000","last_undegraded":"2024-04-19T03:02:24.271520+0000","last_fullsized":"2024-04-19T03:02:24.257309+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:36:10.316727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+undersized","last_fresh":"2024-04-19T03:02:25.045307+0000","last_change":"2024-04-19T03:02:24.262871+0000","last_active":"2024-04-19T03:02:25.045307+0000","last_peered":"2024-04-19T03:02:25.045307+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"2024-04-19T03:02:24.262871+0000","last_became_peered":"2024-04-19T03:02:24.262871+0000","last_unstale":"2024-04-19T03:02:25.045307+0000","last_undegraded":"2024-04-19T03:02:25.045307+0000","last_fullsized":"2024-04-19T03:02:24.254723+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:19:25.662483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":39,"reported_epoch":44,"state":"active+undersized","last_fresh":"2024-04-19T03:02:24.283526+0000","last_change":"2024-04-19T03:02:24.280097+0000","last_active":"2024-04-19T03:02:24.283526+0000","last_peered":"2024-04-19T03:02:24.283526+0000","last_clean":"2024-04-19T03:02:21.238883+0000","last_became_active":"2024-04-19T03:02:24.280097+0000","last_became_peered":"2024-04-19T03:02:24.280097+0000","last_unstale":"2024-04-19T03:02:24.283526+0000","last_undegraded":"2024-04-19T03:02:24.283526+0000","last_fullsized":"2024-04-19T03:02:24.260958+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:36:30.659316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":39,"reported_epoch":44,"state":"active+undersized","last_fresh":"2024-04-19T03:02:24.272384+0000","last_change":"2024-04-19T03:02:24.265606+0000","last_active":"2024-04-19T03:02:24.272384+0000","last_peered":"2024-04-19T03:02:24.272384+0000","last_clean":"2024-04-19T03:02:21.239350+0000","last_became_active":"2024-04-19T03:02:24.265606+0000","last_became_peered":"2024-04-19T03:02:24.265606+0000","last_unstale":"2024-04-19T03:02:24.272384+0000","last_undegraded":"2024-04-19T03:02:24.272384+0000","last_fullsized":"2024-04-19T03:02:24.257256+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:02:12.255168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":34,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-19T03:02:24.253217+0000","last_change":"2024-04-19T03:01:15.020108+0000","last_active":"2024-04-19T03:02:24.253217+0000","last_peered":"2024-04-19T03:02:24.253217+0000","last_clean":"2024-04-19T03:02:24.253217+0000","last_became_active":"2024-04-19T03:01:15.018978+0000","last_became_peered":"2024-04-19T03:01:15.018978+0000","last_unstale":"2024-04-19T03:02:24.253217+0000","last_undegraded":"2024-04-19T03:02:24.253217+0000","last_fullsized":"2024-04-19T03:02:24.253217+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:30:22.360053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+undersized","last_fresh":"2024-04-19T03:02:25.012276+0000","last_change":"2024-04-19T03:02:24.260984+0000","last_active":"2024-04-19T03:02:25.012276+0000","last_peered":"2024-04-19T03:02:25.012276+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"2024-04-19T03:02:24.260984+0000","last_became_peered":"2024-04-19T03:02:24.260984+0000","last_unstale":"2024-04-19T03:02:25.012276+0000","last_undegraded":"2024-04-19T03:02:25.012276+0000","last_fullsized":"2024-04-19T03:02:24.254937+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:36:55.924337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":39,"reported_epoch":44,"state":"active+undersized","last_fresh":"2024-04-19T03:02:24.267843+0000","last_change":"2024-04-19T03:02:24.267695+0000","last_active":"2024-04-19T03:02:24.267843+0000","last_peered":"2024-04-19T03:02:24.267843+0000","last_clean":"2024-04-19T03:02:21.248328+0000","last_became_active":"2024-04-19T03:02:24.267695+0000","last_became_peered":"2024-04-19T03:02:24.267695+0000","last_unstale":"2024-04-19T03:02:24.267843+0000","last_undegraded":"2024-04-19T03:02:24.267843+0000","last_fullsized":"2024-04-19T03:02:24.251954+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:45:46.987421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":34,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-19T03:02:24.261939+0000","last_change":"2024-04-19T03:01:15.020443+0000","last_active":"2024-04-19T03:02:24.261939+0000","last_peered":"2024-04-19T03:02:24.261939+0000","last_clean":"2024-04-19T03:02:24.261939+0000","last_became_active":"2024-04-19T03:01:15.018780+0000","last_became_peered":"2024-04-19T03:01:15.018780+0000","last_unstale":"2024-04-19T03:02:24.261939+0000","last_undegraded":"2024-04-19T03:02:24.261939+0000","last_fullsized":"2024-04-19T03:02:24.261939+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:56:44.307812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+undersized","last_fresh":"2024-04-19T03:02:25.015327+0000","last_change":"2024-04-19T03:02:24.272073+0000","last_active":"2024-04-19T03:02:25.015327+0000","last_peered":"2024-04-19T03:02:25.015327+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"2024-04-19T03:02:24.272073+0000","last_became_peered":"2024-04-19T03:02:24.272073+0000","last_unstale":"2024-04-19T03:02:25.015327+0000","last_undegraded":"2024-04-19T03:02:25.015327+0000","last_fullsized":"2024-04-19T03:02:24.263402+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:53:27.352419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":17,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-19T03:02:24.256207+0000","last_change":"2024-04-19T03:02:15.206453+0000","last_active":"2024-04-19T03:02:24.256207+0000","last_peered":"2024-04-19T03:02:24.256207+0000","last_clean":"2024-04-19T03:02:24.256207+0000","last_became_active":"2024-04-19T03:02:15.205905+0000","last_became_peered":"2024-04-19T03:02:15.205905+0000","last_unstale":"2024-04-19T03:02:24.256207+0000","last_undegraded":"2024-04-19T03:02:24.256207+0000","last_fullsized":"2024-04-19T03:02:24.256207+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:48:06.646477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":34,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-19T03:02:24.255885+0000","last_change":"2024-04-19T03:01:15.020098+0000","last_active":"2024-04-19T03:02:24.255885+0000","last_peered":"2024-04-19T03:02:24.255885+0000","last_clean":"2024-04-19T03:02:24.255885+0000","last_became_active":"2024-04-19T03:01:15.019064+0000","last_became_peered":"2024-04-19T03:01:15.019064+0000","last_unstale":"2024-04-19T03:02:24.255885+0000","last_undegraded":"2024-04-19T03:02:24.255885+0000","last_fullsized":"2024-04-19T03:02:24.255885+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:50:06.490191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+undersized","last_fresh":"2024-04-19T03:02:25.042616+0000","last_change":"2024-04-19T03:02:24.259183+0000","last_active":"2024-04-19T03:02:25.042616+0000","last_peered":"2024-04-19T03:02:25.042616+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"2024-04-19T03:02:24.259183+0000","last_became_peered":"2024-04-19T03:02:24.259183+0000","last_unstale":"2024-04-19T03:02:25.042616+0000","last_undegraded":"2024-04-19T03:02:25.042616+0000","last_fullsized":"2024-04-19T03:02:24.252854+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:19:16.702009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":34,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-19T03:02:24.253695+0000","last_change":"2024-04-19T03:01:15.019787+0000","last_active":"2024-04-19T03:02:24.253695+0000","last_peered":"2024-04-19T03:02:24.253695+0000","last_clean":"2024-04-19T03:02:24.253695+0000","last_became_active":"2024-04-19T03:01:15.018350+0000","last_became_peered":"2024-04-19T03:01:15.018350+0000","last_unstale":"2024-04-19T03:02:24.253695+0000","last_undegraded":"2024-04-19T03:02:24.253695+0000","last_fullsized":"2024-04-19T03:02:24.253695+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:10:42.079294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+undersized","last_fresh":"2024-04-19T03:02:25.042174+0000","last_change":"2024-04-19T03:02:24.258688+0000","last_active":"2024-04-19T03:02:25.042174+0000","last_peered":"2024-04-19T03:02:25.042174+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"2024-04-19T03:02:24.258688+0000","last_became_peered":"2024-04-19T03:02:24.258688+0000","last_unstale":"2024-04-19T03:02:25.042174+0000","last_undegraded":"2024-04-19T03:02:25.042174+0000","last_fullsized":"2024-04-19T03:02:24.251480+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:16:44.560445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":39,"reported_epoch":44,"state":"active+undersized","last_fresh":"2024-04-19T03:02:24.265394+0000","last_change":"2024-04-19T03:02:24.265187+0000","last_active":"2024-04-19T03:02:24.265394+0000","last_peered":"2024-04-19T03:02:24.265394+0000","last_clean":"2024-04-19T03:02:21.238487+0000","last_became_active":"2024-04-19T03:02:24.265187+0000","last_became_peered":"2024-04-19T03:02:24.265187+0000","last_unstale":"2024-04-19T03:02:24.265394+0000","last_undegraded":"2024-04-19T03:02:24.265394+0000","last_fullsized":"2024-04-19T03:02:24.255513+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:28:32.221121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":39,"reported_epoch":44,"state":"active+undersized","last_fresh":"2024-04-19T03:02:24.266317+0000","last_change":"2024-04-19T03:02:24.266012+0000","last_active":"2024-04-19T03:02:24.266317+0000","last_peered":"2024-04-19T03:02:24.266317+0000","last_clean":"2024-04-19T03:02:21.249385+0000","last_became_active":"2024-04-19T03:02:24.266012+0000","last_became_peered":"2024-04-19T03:02:24.266012+0000","last_unstale":"2024-04-19T03:02:24.266317+0000","last_undegraded":"2024-04-19T03:02:24.266317+0000","last_fullsized":"2024-04-19T03:02:24.254885+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:45:01.989501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"20'2","reported_seq":42,"reported_epoch":44,"state":"active+undersized+degraded","last_fresh":"2024-04-19T03:02:24.272549+0000","last_change":"2024-04-19T03:02:24.265759+0000","last_active":"2024-04-19T03:02:24.272549+0000","last_peered":"2024-04-19T03:02:24.272549+0000","last_clean":"2024-04-19T03:02:21.239584+0000","last_became_active":"2024-04-19T03:02:24.265759+0000","last_became_peered":"2024-04-19T03:02:24.265759+0000","last_unstale":"2024-04-19T03:02:24.272549+0000","last_undegraded":"2024-04-19T03:02:24.257647+0000","last_fullsized":"2024-04-19T03:02:24.257517+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:42:21.986226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":2}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":39,"reported_epoch":44,"state":"active+undersized","last_fresh":"2024-04-19T03:02:24.263746+0000","last_change":"2024-04-19T03:02:24.263260+0000","last_active":"2024-04-19T03:02:24.263746+0000","last_peered":"2024-04-19T03:02:24.263746+0000","last_clean":"2024-04-19T03:02:21.249052+0000","last_became_active":"2024-04-19T03:02:24.263260+0000","last_became_peered":"2024-04-19T03:02:24.263260+0000","last_unstale":"2024-04-19T03:02:24.263746+0000","last_undegraded":"2024-04-19T03:02:24.263746+0000","last_fullsized":"2024-04-19T03:02:24.255863+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:25:50.459325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+undersized","last_fresh":"2024-04-19T03:02:25.012420+0000","last_change":"2024-04-19T03:02:24.269416+0000","last_active":"2024-04-19T03:02:25.012420+0000","last_peered":"2024-04-19T03:02:25.012420+0000","last_clean":"2024-04-19T03:01:13.604133+0000","last_became_active":"2024-04-19T03:02:24.269416+0000","last_became_peered":"2024-04-19T03:02:24.269416+0000","last_unstale":"2024-04-19T03:02:25.012420+0000","last_undegraded":"2024-04-19T03:02:25.012420+0000","last_fullsized":"2024-04-19T03:02:24.260076+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:13:11.249358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+undersized","last_fresh":"2024-04-19T03:02:25.015164+0000","last_change":"2024-04-19T03:02:24.271368+0000","last_active":"2024-04-19T03:02:25.015164+0000","last_peered":"2024-04-19T03:02:25.015164+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"2024-04-19T03:02:24.271368+0000","last_became_peered":"2024-04-19T03:02:24.271368+0000","last_unstale":"2024-04-19T03:02:25.015164+0000","last_undegraded":"2024-04-19T03:02:25.015164+0000","last_fullsized":"2024-04-19T03:02:24.258025+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:46:12.377589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":35,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-19T03:02:24.252345+0000","last_change":"2024-04-19T03:01:14.649074+0000","last_active":"2024-04-19T03:02:24.252345+0000","last_peered":"2024-04-19T03:02:24.252345+0000","last_clean":"2024-04-19T03:02:24.252345+0000","last_became_active":"2024-04-19T03:01:14.648217+0000","last_became_peered":"2024-04-19T03:01:14.648217+0000","last_unstale":"2024-04-19T03:02:24.252345+0000","last_undegraded":"2024-04-19T03:02:24.252345+0000","last_fullsized":"2024-04-19T03:02:24.252345+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:57:05.238043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+undersized","last_fresh":"2024-04-19T03:02:25.015393+0000","last_change":"2024-04-19T03:02:24.272925+0000","last_active":"2024-04-19T03:02:25.015393+0000","last_peered":"2024-04-19T03:02:25.015393+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"2024-04-19T03:02:24.272925+0000","last_became_peered":"2024-04-19T03:02:24.272925+0000","last_unstale":"2024-04-19T03:02:25.015393+0000","last_undegraded":"2024-04-19T03:02:25.015393+0000","last_fullsized":"2024-04-19T03:02:24.260913+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:33:59.041888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"20'8","reported_seq":43,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-19T03:02:24.255820+0000","last_change":"2024-04-19T03:01:14.649044+0000","last_active":"2024-04-19T03:02:24.255820+0000","last_peered":"2024-04-19T03:02:24.255820+0000","last_clean":"2024-04-19T03:02:24.255820+0000","last_became_active":"2024-04-19T03:01:14.648859+0000","last_became_peered":"2024-04-19T03:01:14.648859+0000","last_unstale":"2024-04-19T03:02:24.255820+0000","last_undegraded":"2024-04-19T03:02:24.255820+0000","last_fullsized":"2024-04-19T03:02:24.255820+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:30:45.925657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"45'6049","reported_seq":6080,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-19T03:02:29.997337+0000","last_change":"2024-04-19T03:01:36.752938+0000","last_active":"2024-04-19T03:02:29.997337+0000","last_peered":"2024-04-19T03:02:29.997337+0000","last_clean":"2024-04-19T03:02:29.997337+0000","last_became_active":"2024-04-19T03:01:36.751024+0000","last_became_peered":"2024-04-19T03:01:36.751024+0000","last_unstale":"2024-04-19T03:02:29.997337+0000","last_undegraded":"2024-04-19T03:02:29.997337+0000","last_fullsized":"2024-04-19T03:02:29.997337+0000","mapping_epoch":22,"log_start":"29'2200","ondisk_log_start":"29'2200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:35.722578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:35.722578+0000","last_clean_scrub_stamp":"2024-04-19T03:01:35.722578+0000","objects_scrubbed":0,"log_size":3849,"log_dups_size":0,"ondisk_log_size":3849,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:52:27.986544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":396427264,"num_objects":6049,"num_object_clones":0,"num_object_copies":12098,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6049,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6049,"num_write_kb":387136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"20'1","reported_seq":36,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-19T03:02:24.264009+0000","last_change":"2024-04-19T03:01:14.649839+0000","last_active":"2024-04-19T03:02:24.264009+0000","last_peered":"2024-04-19T03:02:24.264009+0000","last_clean":"2024-04-19T03:02:24.264009+0000","last_became_active":"2024-04-19T03:01:14.649571+0000","last_became_peered":"2024-04-19T03:01:14.649571+0000","last_unstale":"2024-04-19T03:02:24.264009+0000","last_undegraded":"2024-04-19T03:02:24.264009+0000","last_fullsized":"2024-04-19T03:02:24.264009+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:03:57.839660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":34,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-19T03:02:24.252617+0000","last_change":"2024-04-19T03:01:15.021047+0000","last_active":"2024-04-19T03:02:24.252617+0000","last_peered":"2024-04-19T03:02:24.252617+0000","last_clean":"2024-04-19T03:02:24.252617+0000","last_became_active":"2024-04-19T03:01:15.019792+0000","last_became_peered":"2024-04-19T03:01:15.019792+0000","last_unstale":"2024-04-19T03:02:24.252617+0000","last_undegraded":"2024-04-19T03:02:24.252617+0000","last_fullsized":"2024-04-19T03:02:24.252617+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:54:54.463918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.8","version":"45'6263","reported_seq":6298,"reported_epoch":45,"state":"active+undersized+degraded","last_fresh":"2024-04-19T03:02:30.038271+0000","last_change":"2024-04-19T03:02:24.254897+0000","last_active":"2024-04-19T03:02:30.038271+0000","last_peered":"2024-04-19T03:02:30.038271+0000","last_clean":"2024-04-19T03:02:23.241938+0000","last_became_active":"2024-04-19T03:02:24.254897+0000","last_became_peered":"2024-04-19T03:02:24.254897+0000","last_unstale":"2024-04-19T03:02:30.038271+0000","last_undegraded":"2024-04-19T03:02:24.251398+0000","last_fullsized":"2024-04-19T03:02:24.251194+0000","mapping_epoch":43,"log_start":"29'2300","ondisk_log_start":"29'2300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:35.722578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:35.722578+0000","last_clean_scrub_stamp":"2024-04-19T03:01:35.722578+0000","objects_scrubbed":0,"log_size":3963,"log_dups_size":0,"ondisk_log_size":3963,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:12:59.298952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":410451968,"num_objects":6263,"num_object_clones":0,"num_object_copies":12526,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":6263,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6263,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6263,"num_write_kb":400832,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[{"shards":"1","objects":6263}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"20'2","reported_seq":37,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-19T03:02:24.262487+0000","last_change":"2024-04-19T03:01:14.645075+0000","last_active":"2024-04-19T03:02:24.262487+0000","last_peered":"2024-04-19T03:02:24.262487+0000","last_clean":"2024-04-19T03:02:24.262487+0000","last_became_active":"2024-04-19T03:01:14.644790+0000","last_became_peered":"2024-04-19T03:01:14.644790+0000","last_unstale":"2024-04-19T03:02:24.262487+0000","last_undegraded":"2024-04-19T03:02:24.262487+0000","last_fullsized":"2024-04-19T03:02:24.262487+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:55:15.035769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":39,"reported_epoch":44,"state":"active+undersized","last_fresh":"2024-04-19T03:02:24.263280+0000","last_change":"2024-04-19T03:02:24.262120+0000","last_active":"2024-04-19T03:02:24.263280+0000","last_peered":"2024-04-19T03:02:24.263280+0000","last_clean":"2024-04-19T03:02:21.248368+0000","last_became_active":"2024-04-19T03:02:24.262120+0000","last_became_peered":"2024-04-19T03:02:24.262120+0000","last_unstale":"2024-04-19T03:02:24.263280+0000","last_undegraded":"2024-04-19T03:02:24.263280+0000","last_fullsized":"2024-04-19T03:02:24.251780+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:09:48.754662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.b","version":"45'6181","reported_seq":6215,"reported_epoch":45,"state":"active+undersized+degraded","last_fresh":"2024-04-19T03:02:30.041329+0000","last_change":"2024-04-19T03:02:24.258972+0000","last_active":"2024-04-19T03:02:30.041329+0000","last_peered":"2024-04-19T03:02:30.041329+0000","last_clean":"2024-04-19T03:02:23.236019+0000","last_became_active":"2024-04-19T03:02:24.258972+0000","last_became_peered":"2024-04-19T03:02:24.258972+0000","last_unstale":"2024-04-19T03:02:30.041329+0000","last_undegraded":"2024-04-19T03:02:24.252723+0000","last_fullsized":"2024-04-19T03:02:24.252520+0000","mapping_epoch":43,"log_start":"29'2200","ondisk_log_start":"29'2200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:35.722578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:35.722578+0000","last_clean_scrub_stamp":"2024-04-19T03:01:35.722578+0000","objects_scrubbed":0,"log_size":3981,"log_dups_size":0,"ondisk_log_size":3981,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:23:23.264057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":405078016,"num_objects":6181,"num_object_clones":0,"num_object_copies":12362,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":6181,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6181,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6181,"num_write_kb":395584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[{"shards":"1","objects":6181}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"20'1","reported_seq":25,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-19T03:02:24.255702+0000","last_change":"2024-04-19T03:02:15.207891+0000","last_active":"2024-04-19T03:02:24.255702+0000","last_peered":"2024-04-19T03:02:24.255702+0000","last_clean":"2024-04-19T03:02:24.255702+0000","last_became_active":"2024-04-19T03:02:15.207334+0000","last_became_peered":"2024-04-19T03:02:15.207334+0000","last_unstale":"2024-04-19T03:02:24.255702+0000","last_undegraded":"2024-04-19T03:02:24.255702+0000","last_fullsized":"2024-04-19T03:02:24.255702+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:29:49.714544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":39,"reported_epoch":44,"state":"active+undersized","last_fresh":"2024-04-19T03:02:24.269979+0000","last_change":"2024-04-19T03:02:24.269285+0000","last_active":"2024-04-19T03:02:24.269979+0000","last_peered":"2024-04-19T03:02:24.269979+0000","last_clean":"2024-04-19T03:02:21.238896+0000","last_became_active":"2024-04-19T03:02:24.269285+0000","last_became_peered":"2024-04-19T03:02:24.269285+0000","last_unstale":"2024-04-19T03:02:24.269979+0000","last_undegraded":"2024-04-19T03:02:24.269979+0000","last_fullsized":"2024-04-19T03:02:24.257698+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:18:42.206345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.a","version":"45'6028","reported_seq":6063,"reported_epoch":45,"state":"active+undersized+degraded","last_fresh":"2024-04-19T03:02:29.991644+0000","last_change":"2024-04-19T03:02:24.258780+0000","last_active":"2024-04-19T03:02:29.991644+0000","last_peered":"2024-04-19T03:02:29.991644+0000","last_clean":"2024-04-19T03:02:23.222032+0000","last_became_active":"2024-04-19T03:02:24.258780+0000","last_became_peered":"2024-04-19T03:02:24.258780+0000","last_unstale":"2024-04-19T03:02:29.991644+0000","last_undegraded":"2024-04-19T03:02:24.251967+0000","last_fullsized":"2024-04-19T03:02:24.251776+0000","mapping_epoch":43,"log_start":"29'2000","ondisk_log_start":"29'2000","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:35.722578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:35.722578+0000","last_clean_scrub_stamp":"2024-04-19T03:01:35.722578+0000","objects_scrubbed":0,"log_size":4028,"log_dups_size":0,"ondisk_log_size":4028,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:43:48.821760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":395051008,"num_objects":6028,"num_object_clones":0,"num_object_copies":12056,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":6028,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6028,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6028,"num_write_kb":385792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[{"shards":"1","objects":6028}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":35,"reported_epoch":44,"state":"active+undersized","last_fresh":"2024-04-19T03:02:24.283825+0000","last_change":"2024-04-19T03:02:24.283528+0000","last_active":"2024-04-19T03:02:24.283825+0000","last_peered":"2024-04-19T03:02:24.283825+0000","last_clean":"2024-04-19T03:01:13.604133+0000","last_became_active":"2024-04-19T03:02:24.283528+0000","last_became_peered":"2024-04-19T03:02:24.283528+0000","last_unstale":"2024-04-19T03:02:24.283825+0000","last_undegraded":"2024-04-19T03:02:24.283825+0000","last_fullsized":"2024-04-19T03:02:24.265369+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:44:57.689246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+undersized","last_fresh":"2024-04-19T03:02:25.014852+0000","last_change":"2024-04-19T03:02:24.262486+0000","last_active":"2024-04-19T03:02:25.014852+0000","last_peered":"2024-04-19T03:02:25.014852+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"2024-04-19T03:02:24.262486+0000","last_became_peered":"2024-04-19T03:02:24.262486+0000","last_unstale":"2024-04-19T03:02:25.014852+0000","last_undegraded":"2024-04-19T03:02:25.014852+0000","last_fullsized":"2024-04-19T03:02:24.255034+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:10:59.997012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.d","version":"45'6215","reported_seq":6245,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-19T03:02:30.042928+0000","last_change":"2024-04-19T03:01:36.753335+0000","last_active":"2024-04-19T03:02:30.042928+0000","last_peered":"2024-04-19T03:02:30.042928+0000","last_clean":"2024-04-19T03:02:30.042928+0000","last_became_active":"2024-04-19T03:01:36.752922+0000","last_became_peered":"2024-04-19T03:01:36.752922+0000","last_unstale":"2024-04-19T03:02:30.042928+0000","last_undegraded":"2024-04-19T03:02:30.042928+0000","last_fullsized":"2024-04-19T03:02:30.042928+0000","mapping_epoch":22,"log_start":"29'2200","ondisk_log_start":"29'2200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:35.722578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:35.722578+0000","last_clean_scrub_stamp":"2024-04-19T03:01:35.722578+0000","objects_scrubbed":0,"log_size":4015,"log_dups_size":0,"ondisk_log_size":4015,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:04:51.492597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":407306240,"num_objects":6215,"num_object_clones":0,"num_object_copies":12430,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6215,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6215,"num_write_kb":397760,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"20'2","reported_seq":18,"reported_epoch":44,"state":"active+undersized+degraded","last_fresh":"2024-04-19T03:02:25.014917+0000","last_change":"2024-04-19T03:02:24.265344+0000","last_active":"2024-04-19T03:02:25.014917+0000","last_peered":"2024-04-19T03:02:25.014917+0000","last_clean":"2024-04-19T03:01:15.001696+0000","last_became_active":"2024-04-19T03:02:24.265344+0000","last_became_peered":"2024-04-19T03:02:24.265344+0000","last_unstale":"2024-04-19T03:02:25.014917+0000","last_undegraded":"2024-04-19T03:02:24.257245+0000","last_fullsized":"2024-04-19T03:02:24.257097+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:10:25.561421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":1}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":39,"reported_epoch":44,"state":"active+undersized","last_fresh":"2024-04-19T03:02:24.283627+0000","last_change":"2024-04-19T03:02:24.280840+0000","last_active":"2024-04-19T03:02:24.283627+0000","last_peered":"2024-04-19T03:02:24.283627+0000","last_clean":"2024-04-19T03:02:21.239001+0000","last_became_active":"2024-04-19T03:02:24.280840+0000","last_became_peered":"2024-04-19T03:02:24.280840+0000","last_unstale":"2024-04-19T03:02:24.283627+0000","last_undegraded":"2024-04-19T03:02:24.283627+0000","last_fullsized":"2024-04-19T03:02:24.261609+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:42:00.465007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"45'6174","reported_seq":6208,"reported_epoch":45,"state":"active+undersized+degraded","last_fresh":"2024-04-19T03:02:30.004542+0000","last_change":"2024-04-19T03:02:24.268199+0000","last_active":"2024-04-19T03:02:30.004542+0000","last_peered":"2024-04-19T03:02:30.004542+0000","last_clean":"2024-04-19T03:02:23.237233+0000","last_became_active":"2024-04-19T03:02:24.268199+0000","last_became_peered":"2024-04-19T03:02:24.268199+0000","last_unstale":"2024-04-19T03:02:30.004542+0000","last_undegraded":"2024-04-19T03:02:24.255272+0000","last_fullsized":"2024-04-19T03:02:24.255179+0000","mapping_epoch":43,"log_start":"29'2400","ondisk_log_start":"29'2400","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:35.722578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:35.722578+0000","last_clean_scrub_stamp":"2024-04-19T03:01:35.722578+0000","objects_scrubbed":0,"log_size":3774,"log_dups_size":0,"ondisk_log_size":3774,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:23:59.419711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":404619264,"num_objects":6174,"num_object_clones":0,"num_object_copies":12348,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":6174,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6174,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6174,"num_write_kb":395136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":6174}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":40,"reported_epoch":44,"state":"active+undersized","last_fresh":"2024-04-19T03:02:24.270437+0000","last_change":"2024-04-19T03:02:24.269896+0000","last_active":"2024-04-19T03:02:24.270437+0000","last_peered":"2024-04-19T03:02:24.270437+0000","last_clean":"2024-04-19T03:02:21.239091+0000","last_became_active":"2024-04-19T03:02:24.269896+0000","last_became_peered":"2024-04-19T03:02:24.269896+0000","last_unstale":"2024-04-19T03:02:24.270437+0000","last_undegraded":"2024-04-19T03:02:24.270437+0000","last_fullsized":"2024-04-19T03:02:24.262532+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:16:06.565833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":34,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-19T03:02:24.263272+0000","last_change":"2024-04-19T03:01:15.015685+0000","last_active":"2024-04-19T03:02:24.263272+0000","last_peered":"2024-04-19T03:02:24.263272+0000","last_clean":"2024-04-19T03:02:24.263272+0000","last_became_active":"2024-04-19T03:01:15.014847+0000","last_became_peered":"2024-04-19T03:01:15.014847+0000","last_unstale":"2024-04-19T03:02:24.263272+0000","last_undegraded":"2024-04-19T03:02:24.263272+0000","last_fullsized":"2024-04-19T03:02:24.263272+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:51:06.208551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.f","version":"45'6076","reported_seq":6106,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-19T03:02:30.020781+0000","last_change":"2024-04-19T03:01:36.755035+0000","last_active":"2024-04-19T03:02:30.020781+0000","last_peered":"2024-04-19T03:02:30.020781+0000","last_clean":"2024-04-19T03:02:30.020781+0000","last_became_active":"2024-04-19T03:01:36.753645+0000","last_became_peered":"2024-04-19T03:01:36.753645+0000","last_unstale":"2024-04-19T03:02:30.020781+0000","last_undegraded":"2024-04-19T03:02:30.020781+0000","last_fullsized":"2024-04-19T03:02:30.020781+0000","mapping_epoch":22,"log_start":"29'2300","ondisk_log_start":"29'2300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:35.722578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:35.722578+0000","last_clean_scrub_stamp":"2024-04-19T03:01:35.722578+0000","objects_scrubbed":0,"log_size":3776,"log_dups_size":0,"ondisk_log_size":3776,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:45:30.691887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":398196736,"num_objects":6076,"num_object_clones":0,"num_object_copies":12152,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6076,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6076,"num_write_kb":388864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":35,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-19T03:02:24.252773+0000","last_change":"2024-04-19T03:01:14.644582+0000","last_active":"2024-04-19T03:02:24.252773+0000","last_peered":"2024-04-19T03:02:24.252773+0000","last_clean":"2024-04-19T03:02:24.252773+0000","last_became_active":"2024-04-19T03:01:14.644101+0000","last_became_peered":"2024-04-19T03:01:14.644101+0000","last_unstale":"2024-04-19T03:02:24.252773+0000","last_undegraded":"2024-04-19T03:02:24.252773+0000","last_fullsized":"2024-04-19T03:02:24.252773+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:28:24.652864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":34,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-19T03:02:24.260519+0000","last_change":"2024-04-19T03:01:15.014818+0000","last_active":"2024-04-19T03:02:24.260519+0000","last_peered":"2024-04-19T03:02:24.260519+0000","last_clean":"2024-04-19T03:02:24.260519+0000","last_became_active":"2024-04-19T03:01:15.014421+0000","last_became_peered":"2024-04-19T03:01:15.014421+0000","last_unstale":"2024-04-19T03:02:24.260519+0000","last_undegraded":"2024-04-19T03:02:24.260519+0000","last_fullsized":"2024-04-19T03:02:24.260519+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:16:20.475837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.e","version":"45'6190","reported_seq":6225,"reported_epoch":45,"state":"active+undersized+degraded","last_fresh":"2024-04-19T03:02:30.044076+0000","last_change":"2024-04-19T03:02:24.263645+0000","last_active":"2024-04-19T03:02:30.044076+0000","last_peered":"2024-04-19T03:02:30.044076+0000","last_clean":"2024-04-19T03:02:23.236042+0000","last_became_active":"2024-04-19T03:02:24.263645+0000","last_became_peered":"2024-04-19T03:02:24.263645+0000","last_unstale":"2024-04-19T03:02:30.044076+0000","last_undegraded":"2024-04-19T03:02:24.256428+0000","last_fullsized":"2024-04-19T03:02:24.256329+0000","mapping_epoch":43,"log_start":"29'2200","ondisk_log_start":"29'2200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:35.722578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:35.722578+0000","last_clean_scrub_stamp":"2024-04-19T03:01:35.722578+0000","objects_scrubbed":0,"log_size":3990,"log_dups_size":0,"ondisk_log_size":3990,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:40:08.976280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":405667840,"num_objects":6190,"num_object_clones":0,"num_object_copies":12380,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":6190,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6190,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6190,"num_write_kb":396160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[{"shards":"1","objects":6190}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":40,"reported_epoch":44,"state":"active+undersized","last_fresh":"2024-04-19T03:02:24.270633+0000","last_change":"2024-04-19T03:02:24.270374+0000","last_active":"2024-04-19T03:02:24.270633+0000","last_peered":"2024-04-19T03:02:24.270633+0000","last_clean":"2024-04-19T03:02:21.248442+0000","last_became_active":"2024-04-19T03:02:24.270374+0000","last_became_peered":"2024-04-19T03:02:24.270374+0000","last_unstale":"2024-04-19T03:02:24.270633+0000","last_undegraded":"2024-04-19T03:02:24.270633+0000","last_fullsized":"2024-04-19T03:02:24.252696+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:36:04.345818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+undersized","last_fresh":"2024-04-19T03:02:25.045852+0000","last_change":"2024-04-19T03:02:24.263169+0000","last_active":"2024-04-19T03:02:25.045852+0000","last_peered":"2024-04-19T03:02:25.045852+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"2024-04-19T03:02:24.263169+0000","last_became_peered":"2024-04-19T03:02:24.263169+0000","last_unstale":"2024-04-19T03:02:25.045852+0000","last_undegraded":"2024-04-19T03:02:25.045852+0000","last_fullsized":"2024-04-19T03:02:24.256134+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:23:50.481462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.4","version":"45'6050","reported_seq":6084,"reported_epoch":45,"state":"active+undersized+degraded","last_fresh":"2024-04-19T03:02:30.037587+0000","last_change":"2024-04-19T03:02:24.259272+0000","last_active":"2024-04-19T03:02:30.037587+0000","last_peered":"2024-04-19T03:02:30.037587+0000","last_clean":"2024-04-19T03:02:23.238353+0000","last_became_active":"2024-04-19T03:02:24.259272+0000","last_became_peered":"2024-04-19T03:02:24.259272+0000","last_unstale":"2024-04-19T03:02:30.037587+0000","last_undegraded":"2024-04-19T03:02:24.253086+0000","last_fullsized":"2024-04-19T03:02:24.252878+0000","mapping_epoch":43,"log_start":"29'2100","ondisk_log_start":"29'2100","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:35.722578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:35.722578+0000","last_clean_scrub_stamp":"2024-04-19T03:01:35.722578+0000","objects_scrubbed":0,"log_size":3950,"log_dups_size":0,"ondisk_log_size":3950,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:23:40.981702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":396492800,"num_objects":6050,"num_object_clones":0,"num_object_copies":12100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":6050,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6050,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6050,"num_write_kb":387200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[{"shards":"1","objects":6050}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"14'157","reported_seq":236,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-19T03:02:24.257270+0000","last_change":"2024-04-19T03:01:07.538434+0000","last_active":"2024-04-19T03:02:24.257270+0000","last_peered":"2024-04-19T03:02:24.257270+0000","last_clean":"2024-04-19T03:02:24.257270+0000","last_became_active":"2024-04-19T03:01:07.537856+0000","last_became_peered":"2024-04-19T03:01:07.537856+0000","last_unstale":"2024-04-19T03:02:24.257270+0000","last_undegraded":"2024-04-19T03:02:24.257270+0000","last_fullsized":"2024-04-19T03:02:24.257270+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:06.516863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:06.516863+0000","last_clean_scrub_stamp":"2024-04-19T03:01:06.516863+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:36:46.386286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":42,"reported_epoch":44,"state":"active+undersized","last_fresh":"2024-04-19T03:02:24.273341+0000","last_change":"2024-04-19T03:02:24.268308+0000","last_active":"2024-04-19T03:02:24.273341+0000","last_peered":"2024-04-19T03:02:24.273341+0000","last_clean":"2024-04-19T03:02:21.239790+0000","last_became_active":"2024-04-19T03:02:24.268308+0000","last_became_peered":"2024-04-19T03:02:24.268308+0000","last_unstale":"2024-04-19T03:02:24.273341+0000","last_undegraded":"2024-04-19T03:02:24.273341+0000","last_fullsized":"2024-04-19T03:02:24.258234+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_clean_scrub_stamp":"2024-04-19T03:01:09.578660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:19:29.941543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+undersized","last_fresh":"2024-04-19T03:02:25.042567+0000","last_change":"2024-04-19T03:02:24.262992+0000","last_active":"2024-04-19T03:02:25.042567+0000","last_peered":"2024-04-19T03:02:25.042567+0000","last_clean":"2024-04-19T03:01:13.604133+0000","last_became_active":"2024-04-19T03:02:24.262992+0000","last_became_peered":"2024-04-19T03:02:24.262992+0000","last_unstale":"2024-04-19T03:02:25.042567+0000","last_undegraded":"2024-04-19T03:02:25.042567+0000","last_fullsized":"2024-04-19T03:02:24.252649+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:11:27.107247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":17,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-19T03:02:24.254932+0000","last_change":"2024-04-19T03:02:15.205155+0000","last_active":"2024-04-19T03:02:24.254932+0000","last_peered":"2024-04-19T03:02:24.254932+0000","last_clean":"2024-04-19T03:02:24.254932+0000","last_became_active":"2024-04-19T03:02:15.204742+0000","last_became_peered":"2024-04-19T03:02:15.204742+0000","last_unstale":"2024-04-19T03:02:24.254932+0000","last_undegraded":"2024-04-19T03:02:24.254932+0000","last_fullsized":"2024-04-19T03:02:24.254932+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:01:01.281289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"45'6128","reported_seq":6164,"reported_epoch":45,"state":"active+undersized+degraded","last_fresh":"2024-04-19T03:02:30.005960+0000","last_change":"2024-04-19T03:02:24.274102+0000","last_active":"2024-04-19T03:02:30.005960+0000","last_peered":"2024-04-19T03:02:30.005960+0000","last_clean":"2024-04-19T03:02:23.239455+0000","last_became_active":"2024-04-19T03:02:24.274102+0000","last_became_peered":"2024-04-19T03:02:24.274102+0000","last_unstale":"2024-04-19T03:02:30.005960+0000","last_undegraded":"2024-04-19T03:02:24.261745+0000","last_fullsized":"2024-04-19T03:02:24.261603+0000","mapping_epoch":43,"log_start":"29'2300","ondisk_log_start":"29'2300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:35.722578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:35.722578+0000","last_clean_scrub_stamp":"2024-04-19T03:01:35.722578+0000","objects_scrubbed":0,"log_size":3828,"log_dups_size":0,"ondisk_log_size":3828,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:14:59.717945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":401604608,"num_objects":6128,"num_object_clones":0,"num_object_copies":12256,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":6128,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6128,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6128,"num_write_kb":392192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":6128}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":37,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-19T03:02:24.257085+0000","last_change":"2024-04-19T03:01:10.602194+0000","last_active":"2024-04-19T03:02:24.257085+0000","last_peered":"2024-04-19T03:02:24.257085+0000","last_clean":"2024-04-19T03:02:24.257085+0000","last_became_active":"2024-04-19T03:01:10.601381+0000","last_became_peered":"2024-04-19T03:01:10.601381+0000","last_unstale":"2024-04-19T03:02:24.257085+0000","last_undegraded":"2024-04-19T03:02:24.257085+0000","last_fullsized":"2024-04-19T03:02:24.257085+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_clean_scrub_stamp":"2024-04-19T03:01:09.578660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:42:26.594095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+undersized","last_fresh":"2024-04-19T03:02:25.012353+0000","last_change":"2024-04-19T03:02:24.269521+0000","last_active":"2024-04-19T03:02:25.012353+0000","last_peered":"2024-04-19T03:02:25.012353+0000","last_clean":"2024-04-19T03:01:13.604133+0000","last_became_active":"2024-04-19T03:02:24.269521+0000","last_became_peered":"2024-04-19T03:02:24.269521+0000","last_unstale":"2024-04-19T03:02:25.012353+0000","last_undegraded":"2024-04-19T03:02:25.012353+0000","last_fullsized":"2024-04-19T03:02:24.255992+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:14:18.946167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":39,"reported_epoch":44,"state":"active+undersized","last_fresh":"2024-04-19T03:02:24.271369+0000","last_change":"2024-04-19T03:02:24.268858+0000","last_active":"2024-04-19T03:02:24.271369+0000","last_peered":"2024-04-19T03:02:24.271369+0000","last_clean":"2024-04-19T03:02:21.249161+0000","last_became_active":"2024-04-19T03:02:24.268858+0000","last_became_peered":"2024-04-19T03:02:24.268858+0000","last_unstale":"2024-04-19T03:02:24.271369+0000","last_undegraded":"2024-04-19T03:02:24.271369+0000","last_fullsized":"2024-04-19T03:02:24.257061+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:42:00.465007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"45'6222","reported_seq":6256,"reported_epoch":45,"state":"active+undersized+degraded","last_fresh":"2024-04-19T03:02:30.011381+0000","last_change":"2024-04-19T03:02:24.270916+0000","last_active":"2024-04-19T03:02:30.011381+0000","last_peered":"2024-04-19T03:02:30.011381+0000","last_clean":"2024-04-19T03:02:23.234400+0000","last_became_active":"2024-04-19T03:02:24.270916+0000","last_became_peered":"2024-04-19T03:02:24.270916+0000","last_unstale":"2024-04-19T03:02:30.011381+0000","last_undegraded":"2024-04-19T03:02:24.257132+0000","last_fullsized":"2024-04-19T03:02:24.256913+0000","mapping_epoch":43,"log_start":"29'2400","ondisk_log_start":"29'2400","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:35.722578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:35.722578+0000","last_clean_scrub_stamp":"2024-04-19T03:01:35.722578+0000","objects_scrubbed":0,"log_size":3822,"log_dups_size":0,"ondisk_log_size":3822,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:16:26.184892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":407764992,"num_objects":6222,"num_object_clones":0,"num_object_copies":12444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":6222,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6222,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6222,"num_write_kb":398208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":6222}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+undersized","last_fresh":"2024-04-19T03:02:25.042280+0000","last_change":"2024-04-19T03:02:24.262857+0000","last_active":"2024-04-19T03:02:25.042280+0000","last_peered":"2024-04-19T03:02:25.042280+0000","last_clean":"2024-04-19T03:01:09.578660+0000","last_became_active":"2024-04-19T03:02:24.262857+0000","last_became_peered":"2024-04-19T03:02:24.262857+0000","last_unstale":"2024-04-19T03:02:25.042280+0000","last_undegraded":"2024-04-19T03:02:25.042280+0000","last_fullsized":"2024-04-19T03:02:24.253233+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_clean_scrub_stamp":"2024-04-19T03:01:09.578660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:00:41.456639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":35,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-19T03:02:24.252850+0000","last_change":"2024-04-19T03:01:14.649068+0000","last_active":"2024-04-19T03:02:24.252850+0000","last_peered":"2024-04-19T03:02:24.252850+0000","last_clean":"2024-04-19T03:02:24.252850+0000","last_became_active":"2024-04-19T03:01:14.648082+0000","last_became_peered":"2024-04-19T03:01:14.648082+0000","last_unstale":"2024-04-19T03:02:24.252850+0000","last_undegraded":"2024-04-19T03:02:24.252850+0000","last_fullsized":"2024-04-19T03:02:24.252850+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:30:14.489117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+undersized","last_fresh":"2024-04-19T03:02:25.045875+0000","last_change":"2024-04-19T03:02:24.263823+0000","last_active":"2024-04-19T03:02:25.045875+0000","last_peered":"2024-04-19T03:02:25.045875+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"2024-04-19T03:02:24.263823+0000","last_became_peered":"2024-04-19T03:02:24.263823+0000","last_unstale":"2024-04-19T03:02:25.045875+0000","last_undegraded":"2024-04-19T03:02:25.045875+0000","last_fullsized":"2024-04-19T03:02:24.256773+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:13:12.261144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"45'6061","reported_seq":6096,"reported_epoch":45,"state":"active+undersized+degraded","last_fresh":"2024-04-19T03:02:29.999092+0000","last_change":"2024-04-19T03:02:24.265023+0000","last_active":"2024-04-19T03:02:29.999092+0000","last_peered":"2024-04-19T03:02:29.999092+0000","last_clean":"2024-04-19T03:02:23.194092+0000","last_became_active":"2024-04-19T03:02:24.265023+0000","last_became_peered":"2024-04-19T03:02:24.265023+0000","last_unstale":"2024-04-19T03:02:29.999092+0000","last_undegraded":"2024-04-19T03:02:24.256703+0000","last_fullsized":"2024-04-19T03:02:24.256018+0000","mapping_epoch":43,"log_start":"29'2300","ondisk_log_start":"29'2300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:35.722578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:35.722578+0000","last_clean_scrub_stamp":"2024-04-19T03:01:35.722578+0000","objects_scrubbed":0,"log_size":3761,"log_dups_size":0,"ondisk_log_size":3761,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:17:05.667104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":397213696,"num_objects":6061,"num_object_clones":0,"num_object_copies":12122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":6061,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6061,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6061,"num_write_kb":387904,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":6061}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":42,"reported_epoch":44,"state":"active+undersized","last_fresh":"2024-04-19T03:02:24.270233+0000","last_change":"2024-04-19T03:02:24.269783+0000","last_active":"2024-04-19T03:02:24.270233+0000","last_peered":"2024-04-19T03:02:24.270233+0000","last_clean":"2024-04-19T03:02:21.239177+0000","last_became_active":"2024-04-19T03:02:24.269783+0000","last_became_peered":"2024-04-19T03:02:24.269783+0000","last_unstale":"2024-04-19T03:02:24.270233+0000","last_undegraded":"2024-04-19T03:02:24.270233+0000","last_fullsized":"2024-04-19T03:02:24.263098+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_clean_scrub_stamp":"2024-04-19T03:01:09.578660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:20:02.410625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":40,"reported_epoch":44,"state":"active+undersized","last_fresh":"2024-04-19T03:02:24.276660+0000","last_change":"2024-04-19T03:02:24.274962+0000","last_active":"2024-04-19T03:02:24.276660+0000","last_peered":"2024-04-19T03:02:24.276660+0000","last_clean":"2024-04-19T03:02:21.239666+0000","last_became_active":"2024-04-19T03:02:24.274962+0000","last_became_peered":"2024-04-19T03:02:24.274962+0000","last_unstale":"2024-04-19T03:02:24.276660+0000","last_undegraded":"2024-04-19T03:02:24.276660+0000","last_fullsized":"2024-04-19T03:02:24.257928+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:39:20.727205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+undersized","last_fresh":"2024-04-19T03:02:25.045008+0000","last_change":"2024-04-19T03:02:24.260888+0000","last_active":"2024-04-19T03:02:25.045008+0000","last_peered":"2024-04-19T03:02:25.045008+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"2024-04-19T03:02:24.260888+0000","last_became_peered":"2024-04-19T03:02:24.260888+0000","last_unstale":"2024-04-19T03:02:25.045008+0000","last_undegraded":"2024-04-19T03:02:25.045008+0000","last_fullsized":"2024-04-19T03:02:24.253375+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:24:49.913495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"45'6150","reported_seq":6185,"reported_epoch":45,"state":"active+undersized+degraded","last_fresh":"2024-04-19T03:02:29.973305+0000","last_change":"2024-04-19T03:02:24.260890+0000","last_active":"2024-04-19T03:02:29.973305+0000","last_peered":"2024-04-19T03:02:29.973305+0000","last_clean":"2024-04-19T03:02:23.221518+0000","last_became_active":"2024-04-19T03:02:24.260890+0000","last_became_peered":"2024-04-19T03:02:24.260890+0000","last_unstale":"2024-04-19T03:02:29.973305+0000","last_undegraded":"2024-04-19T03:02:24.255236+0000","last_fullsized":"2024-04-19T03:02:24.255007+0000","mapping_epoch":43,"log_start":"29'2300","ondisk_log_start":"29'2300","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:35.722578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:35.722578+0000","last_clean_scrub_stamp":"2024-04-19T03:01:35.722578+0000","objects_scrubbed":0,"log_size":3850,"log_dups_size":0,"ondisk_log_size":3850,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:24:20.825858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":403046400,"num_objects":6150,"num_object_clones":0,"num_object_copies":12300,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":6150,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6150,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6150,"num_write_kb":393600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":6150}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":35,"reported_epoch":44,"state":"active+undersized","last_fresh":"2024-04-19T03:02:24.273997+0000","last_change":"2024-04-19T03:02:24.273760+0000","last_active":"2024-04-19T03:02:24.273997+0000","last_peered":"2024-04-19T03:02:24.273997+0000","last_clean":"2024-04-19T03:01:13.604133+0000","last_became_active":"2024-04-19T03:02:24.273760+0000","last_became_peered":"2024-04-19T03:02:24.273760+0000","last_unstale":"2024-04-19T03:02:24.273997+0000","last_undegraded":"2024-04-19T03:02:24.273997+0000","last_fullsized":"2024-04-19T03:02:24.263483+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:29:38.352671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+undersized","last_fresh":"2024-04-19T03:02:25.045240+0000","last_change":"2024-04-19T03:02:24.266049+0000","last_active":"2024-04-19T03:02:25.045240+0000","last_peered":"2024-04-19T03:02:25.045240+0000","last_clean":"2024-04-19T03:01:09.578660+0000","last_became_active":"2024-04-19T03:02:24.266049+0000","last_became_peered":"2024-04-19T03:02:24.266049+0000","last_unstale":"2024-04-19T03:02:25.045240+0000","last_undegraded":"2024-04-19T03:02:25.045240+0000","last_fullsized":"2024-04-19T03:02:24.256038+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_clean_scrub_stamp":"2024-04-19T03:01:09.578660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:45:26.469448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":34,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-19T03:02:24.253471+0000","last_change":"2024-04-19T03:01:15.020501+0000","last_active":"2024-04-19T03:02:24.253471+0000","last_peered":"2024-04-19T03:02:24.253471+0000","last_clean":"2024-04-19T03:02:24.253471+0000","last_became_active":"2024-04-19T03:01:15.019019+0000","last_became_peered":"2024-04-19T03:01:15.019019+0000","last_unstale":"2024-04-19T03:02:24.253471+0000","last_undegraded":"2024-04-19T03:02:24.253471+0000","last_fullsized":"2024-04-19T03:02:24.253471+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:22:58.349159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"45'6129","reported_seq":6174,"reported_epoch":45,"state":"active+undersized+degraded","last_fresh":"2024-04-19T03:02:30.002273+0000","last_change":"2024-04-19T03:02:24.263766+0000","last_active":"2024-04-19T03:02:30.002273+0000","last_peered":"2024-04-19T03:02:30.002273+0000","last_clean":"2024-04-19T03:02:23.209656+0000","last_became_active":"2024-04-19T03:02:24.263766+0000","last_became_peered":"2024-04-19T03:02:24.263766+0000","last_unstale":"2024-04-19T03:02:30.002273+0000","last_undegraded":"2024-04-19T03:02:24.254945+0000","last_fullsized":"2024-04-19T03:02:24.254797+0000","mapping_epoch":43,"log_start":"29'2351","ondisk_log_start":"29'2351","created":22,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:35.722578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:35.722578+0000","last_clean_scrub_stamp":"2024-04-19T03:01:35.722578+0000","objects_scrubbed":0,"log_size":3778,"log_dups_size":0,"ondisk_log_size":3778,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:06:12.681778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":401670144,"num_objects":6129,"num_object_clones":0,"num_object_copies":12258,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":6129,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6129,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6129,"num_write_kb":392256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":6129}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+undersized","last_fresh":"2024-04-19T03:02:25.045062+0000","last_change":"2024-04-19T03:02:24.264727+0000","last_active":"2024-04-19T03:02:25.045062+0000","last_peered":"2024-04-19T03:02:25.045062+0000","last_clean":"2024-04-19T03:01:13.604133+0000","last_became_active":"2024-04-19T03:02:24.264727+0000","last_became_peered":"2024-04-19T03:02:24.264727+0000","last_unstale":"2024-04-19T03:02:25.045062+0000","last_undegraded":"2024-04-19T03:02:25.045062+0000","last_fullsized":"2024-04-19T03:02:24.253765+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:20:27.536142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":43,"reported_epoch":44,"state":"active+undersized","last_fresh":"2024-04-19T03:02:24.264071+0000","last_change":"2024-04-19T03:02:24.263894+0000","last_active":"2024-04-19T03:02:24.264071+0000","last_peered":"2024-04-19T03:02:24.264071+0000","last_clean":"2024-04-19T03:02:21.249599+0000","last_became_active":"2024-04-19T03:02:24.263894+0000","last_became_peered":"2024-04-19T03:02:24.263894+0000","last_unstale":"2024-04-19T03:02:24.264071+0000","last_undegraded":"2024-04-19T03:02:24.264071+0000","last_fullsized":"2024-04-19T03:02:24.256329+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_clean_scrub_stamp":"2024-04-19T03:01:09.578660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:14:49.692877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":34,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-19T03:02:24.253535+0000","last_change":"2024-04-19T03:01:15.020052+0000","last_active":"2024-04-19T03:02:24.253535+0000","last_peered":"2024-04-19T03:02:24.253535+0000","last_clean":"2024-04-19T03:02:24.253535+0000","last_became_active":"2024-04-19T03:01:15.019144+0000","last_became_peered":"2024-04-19T03:01:15.019144+0000","last_unstale":"2024-04-19T03:02:24.253535+0000","last_undegraded":"2024-04-19T03:02:24.253535+0000","last_fullsized":"2024-04-19T03:02:24.253535+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:39:54.289444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"45'6111","reported_seq":6152,"reported_epoch":45,"state":"active+undersized+degraded","last_fresh":"2024-04-19T03:02:30.005503+0000","last_change":"2024-04-19T03:02:24.260927+0000","last_active":"2024-04-19T03:02:30.005503+0000","last_peered":"2024-04-19T03:02:30.005503+0000","last_clean":"2024-04-19T03:02:23.234974+0000","last_became_active":"2024-04-19T03:02:24.260927+0000","last_became_peered":"2024-04-19T03:02:24.260927+0000","last_unstale":"2024-04-19T03:02:30.005503+0000","last_undegraded":"2024-04-19T03:02:24.254982+0000","last_fullsized":"2024-04-19T03:02:24.254763+0000","mapping_epoch":43,"log_start":"29'2261","ondisk_log_start":"29'2261","created":22,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:35.722578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:35.722578+0000","last_clean_scrub_stamp":"2024-04-19T03:01:35.722578+0000","objects_scrubbed":0,"log_size":3850,"log_dups_size":0,"ondisk_log_size":3850,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:03:00.858643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":400490496,"num_objects":6111,"num_object_clones":0,"num_object_copies":12222,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":6111,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6111,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6111,"num_write_kb":391104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":6111}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"20'2","reported_seq":18,"reported_epoch":44,"state":"active+undersized+degraded","last_fresh":"2024-04-19T03:02:25.045942+0000","last_change":"2024-04-19T03:02:24.265036+0000","last_active":"2024-04-19T03:02:25.045942+0000","last_peered":"2024-04-19T03:02:25.045942+0000","last_clean":"2024-04-19T03:01:15.007165+0000","last_became_active":"2024-04-19T03:02:24.265036+0000","last_became_peered":"2024-04-19T03:02:24.265036+0000","last_unstale":"2024-04-19T03:02:25.045942+0000","last_undegraded":"2024-04-19T03:02:24.258940+0000","last_fullsized":"2024-04-19T03:02:24.258736+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:36:29.647530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[{"shards":"1","objects":1}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+undersized","last_fresh":"2024-04-19T03:02:25.045818+0000","last_change":"2024-04-19T03:02:24.269833+0000","last_active":"2024-04-19T03:02:25.045818+0000","last_peered":"2024-04-19T03:02:25.045818+0000","last_clean":"2024-04-19T03:01:09.578660+0000","last_became_active":"2024-04-19T03:02:24.269833+0000","last_became_peered":"2024-04-19T03:02:24.269833+0000","last_unstale":"2024-04-19T03:02:25.045818+0000","last_undegraded":"2024-04-19T03:02:25.045818+0000","last_fullsized":"2024-04-19T03:02:24.262484+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_clean_scrub_stamp":"2024-04-19T03:01:09.578660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:14:33.574026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+undersized","last_fresh":"2024-04-19T03:02:25.012173+0000","last_change":"2024-04-19T03:02:24.257489+0000","last_active":"2024-04-19T03:02:25.012173+0000","last_peered":"2024-04-19T03:02:25.012173+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"2024-04-19T03:02:24.257489+0000","last_became_peered":"2024-04-19T03:02:24.257489+0000","last_unstale":"2024-04-19T03:02:25.012173+0000","last_undegraded":"2024-04-19T03:02:25.012173+0000","last_fullsized":"2024-04-19T03:02:24.254429+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:52:53.321136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.0","version":"45'6190","reported_seq":6225,"reported_epoch":45,"state":"active+undersized+degraded","last_fresh":"2024-04-19T03:02:30.035023+0000","last_change":"2024-04-19T03:02:24.259199+0000","last_active":"2024-04-19T03:02:30.035023+0000","last_peered":"2024-04-19T03:02:30.035023+0000","last_clean":"2024-04-19T03:02:23.240682+0000","last_became_active":"2024-04-19T03:02:24.259199+0000","last_became_peered":"2024-04-19T03:02:24.259199+0000","last_unstale":"2024-04-19T03:02:30.035023+0000","last_undegraded":"2024-04-19T03:02:24.252094+0000","last_fullsized":"2024-04-19T03:02:24.251896+0000","mapping_epoch":43,"log_start":"29'2200","ondisk_log_start":"29'2200","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:35.722578+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:35.722578+0000","last_clean_scrub_stamp":"2024-04-19T03:01:35.722578+0000","objects_scrubbed":0,"log_size":3990,"log_dups_size":0,"ondisk_log_size":3990,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:53:22.959887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":405667840,"num_objects":6190,"num_object_clones":0,"num_object_copies":12380,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":6190,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6190,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6190,"num_write_kb":396160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[{"shards":"1","objects":6190}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.6","version":"21'1","reported_seq":19,"reported_epoch":44,"state":"active+undersized+degraded","last_fresh":"2024-04-19T03:02:25.015212+0000","last_change":"2024-04-19T03:02:24.270935+0000","last_active":"2024-04-19T03:02:25.015212+0000","last_peered":"2024-04-19T03:02:25.015212+0000","last_clean":"2024-04-19T03:01:18.093734+0000","last_became_active":"2024-04-19T03:02:24.270935+0000","last_became_peered":"2024-04-19T03:02:24.270935+0000","last_unstale":"2024-04-19T03:02:25.015212+0000","last_undegraded":"2024-04-19T03:02:24.258098+0000","last_fullsized":"2024-04-19T03:02:24.257944+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:57:49.614725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":1}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":37,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-19T03:02:24.264090+0000","last_change":"2024-04-19T03:01:10.602274+0000","last_active":"2024-04-19T03:02:24.264090+0000","last_peered":"2024-04-19T03:02:24.264090+0000","last_clean":"2024-04-19T03:02:24.264090+0000","last_became_active":"2024-04-19T03:01:10.601487+0000","last_became_peered":"2024-04-19T03:01:10.601487+0000","last_unstale":"2024-04-19T03:02:24.264090+0000","last_undegraded":"2024-04-19T03:02:24.264090+0000","last_fullsized":"2024-04-19T03:02:24.264090+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_clean_scrub_stamp":"2024-04-19T03:01:09.578660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:26:16.712446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":34,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-19T03:02:24.252110+0000","last_change":"2024-04-19T03:01:15.018914+0000","last_active":"2024-04-19T03:02:24.252110+0000","last_peered":"2024-04-19T03:02:24.252110+0000","last_clean":"2024-04-19T03:02:24.252110+0000","last_became_active":"2024-04-19T03:01:15.018276+0000","last_became_peered":"2024-04-19T03:01:15.018276+0000","last_unstale":"2024-04-19T03:02:24.252110+0000","last_undegraded":"2024-04-19T03:02:24.252110+0000","last_fullsized":"2024-04-19T03:02:24.252110+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:40:59.453079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":34,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-19T03:02:24.256055+0000","last_change":"2024-04-19T03:01:15.015855+0000","last_active":"2024-04-19T03:02:24.256055+0000","last_peered":"2024-04-19T03:02:24.256055+0000","last_clean":"2024-04-19T03:02:24.256055+0000","last_became_active":"2024-04-19T03:01:15.015358+0000","last_became_peered":"2024-04-19T03:01:15.015358+0000","last_unstale":"2024-04-19T03:02:24.256055+0000","last_undegraded":"2024-04-19T03:02:24.256055+0000","last_fullsized":"2024-04-19T03:02:24.256055+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:59:49.270245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"20'6","reported_seq":41,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-19T03:02:24.265323+0000","last_change":"2024-04-19T03:01:14.649577+0000","last_active":"2024-04-19T03:02:24.265323+0000","last_peered":"2024-04-19T03:02:24.265323+0000","last_clean":"2024-04-19T03:02:24.265323+0000","last_became_active":"2024-04-19T03:01:14.649284+0000","last_became_peered":"2024-04-19T03:01:14.649284+0000","last_unstale":"2024-04-19T03:02:24.265323+0000","last_undegraded":"2024-04-19T03:02:24.265323+0000","last_fullsized":"2024-04-19T03:02:24.265323+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:01:22.214742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+undersized","last_fresh":"2024-04-19T03:02:25.042341+0000","last_change":"2024-04-19T03:02:24.262641+0000","last_active":"2024-04-19T03:02:25.042341+0000","last_peered":"2024-04-19T03:02:25.042341+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"2024-04-19T03:02:24.262641+0000","last_became_peered":"2024-04-19T03:02:24.262641+0000","last_unstale":"2024-04-19T03:02:25.042341+0000","last_undegraded":"2024-04-19T03:02:25.042341+0000","last_fullsized":"2024-04-19T03:02:24.251764+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:45:46.332608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"20'3","reported_seq":38,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-19T03:02:24.256209+0000","last_change":"2024-04-19T03:01:14.648703+0000","last_active":"2024-04-19T03:02:24.256209+0000","last_peered":"2024-04-19T03:02:24.256209+0000","last_clean":"2024-04-19T03:02:24.256209+0000","last_became_active":"2024-04-19T03:01:14.648258+0000","last_became_peered":"2024-04-19T03:01:14.648258+0000","last_unstale":"2024-04-19T03:02:24.256209+0000","last_undegraded":"2024-04-19T03:02:24.256209+0000","last_fullsized":"2024-04-19T03:02:24.256209+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:30:35.593258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":35,"reported_epoch":44,"state":"active+undersized","last_fresh":"2024-04-19T03:02:24.272524+0000","last_change":"2024-04-19T03:02:24.271840+0000","last_active":"2024-04-19T03:02:24.272524+0000","last_peered":"2024-04-19T03:02:24.272524+0000","last_clean":"2024-04-19T03:01:13.604133+0000","last_became_active":"2024-04-19T03:02:24.271840+0000","last_became_peered":"2024-04-19T03:02:24.271840+0000","last_unstale":"2024-04-19T03:02:24.272524+0000","last_undegraded":"2024-04-19T03:02:24.272524+0000","last_fullsized":"2024-04-19T03:02:24.263970+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:00:42.349089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+undersized","last_fresh":"2024-04-19T03:02:25.012302+0000","last_change":"2024-04-19T03:02:24.269277+0000","last_active":"2024-04-19T03:02:25.012302+0000","last_peered":"2024-04-19T03:02:25.012302+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"2024-04-19T03:02:24.269277+0000","last_became_peered":"2024-04-19T03:02:24.269277+0000","last_unstale":"2024-04-19T03:02:25.012302+0000","last_undegraded":"2024-04-19T03:02:25.012302+0000","last_fullsized":"2024-04-19T03:02:24.255461+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:25:57.346322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+undersized","last_fresh":"2024-04-19T03:02:25.015498+0000","last_change":"2024-04-19T03:02:24.276976+0000","last_active":"2024-04-19T03:02:25.015498+0000","last_peered":"2024-04-19T03:02:25.015498+0000","last_clean":"2024-04-19T03:01:13.604133+0000","last_became_active":"2024-04-19T03:02:24.276976+0000","last_became_peered":"2024-04-19T03:02:24.276976+0000","last_unstale":"2024-04-19T03:02:25.015498+0000","last_undegraded":"2024-04-19T03:02:25.015498+0000","last_fullsized":"2024-04-19T03:02:24.263866+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:44:03.338466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+undersized","last_fresh":"2024-04-19T03:02:25.042040+0000","last_change":"2024-04-19T03:02:24.254790+0000","last_active":"2024-04-19T03:02:25.042040+0000","last_peered":"2024-04-19T03:02:25.042040+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"2024-04-19T03:02:24.254790+0000","last_became_peered":"2024-04-19T03:02:24.254790+0000","last_unstale":"2024-04-19T03:02:25.042040+0000","last_undegraded":"2024-04-19T03:02:25.042040+0000","last_fullsized":"2024-04-19T03:02:24.251249+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:02:39.751984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":34,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-19T03:02:24.262035+0000","last_change":"2024-04-19T03:01:15.020635+0000","last_active":"2024-04-19T03:02:24.262035+0000","last_peered":"2024-04-19T03:02:24.262035+0000","last_clean":"2024-04-19T03:02:24.262035+0000","last_became_active":"2024-04-19T03:01:15.019917+0000","last_became_peered":"2024-04-19T03:01:15.019917+0000","last_unstale":"2024-04-19T03:02:24.262035+0000","last_undegraded":"2024-04-19T03:02:24.262035+0000","last_fullsized":"2024-04-19T03:02:24.262035+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:40:53.477682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+undersized","last_fresh":"2024-04-19T03:02:25.042136+0000","last_change":"2024-04-19T03:02:24.265626+0000","last_active":"2024-04-19T03:02:25.042136+0000","last_peered":"2024-04-19T03:02:25.042136+0000","last_clean":"2024-04-19T03:01:13.604133+0000","last_became_active":"2024-04-19T03:02:24.265626+0000","last_became_peered":"2024-04-19T03:02:24.265626+0000","last_unstale":"2024-04-19T03:02:25.042136+0000","last_undegraded":"2024-04-19T03:02:25.042136+0000","last_fullsized":"2024-04-19T03:02:24.253251+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:31:25.309764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":44,"state":"active+undersized","last_fresh":"2024-04-19T03:02:25.015279+0000","last_change":"2024-04-19T03:02:24.271602+0000","last_active":"2024-04-19T03:02:25.015279+0000","last_peered":"2024-04-19T03:02:25.015279+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"2024-04-19T03:02:24.271602+0000","last_became_peered":"2024-04-19T03:02:24.271602+0000","last_unstale":"2024-04-19T03:02:25.015279+0000","last_undegraded":"2024-04-19T03:02:25.015279+0000","last_fullsized":"2024-04-19T03:02:24.262475+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:01:44.111884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+undersized","last_fresh":"2024-04-19T03:02:25.012328+0000","last_change":"2024-04-19T03:02:24.271293+0000","last_active":"2024-04-19T03:02:25.012328+0000","last_peered":"2024-04-19T03:02:25.012328+0000","last_clean":"2024-04-19T03:01:13.604133+0000","last_became_active":"2024-04-19T03:02:24.271293+0000","last_became_peered":"2024-04-19T03:02:24.271293+0000","last_unstale":"2024-04-19T03:02:25.012328+0000","last_undegraded":"2024-04-19T03:02:25.012328+0000","last_fullsized":"2024-04-19T03:02:24.255695+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:08:42.859745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":34,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-19T03:02:24.255832+0000","last_change":"2024-04-19T03:01:15.019045+0000","last_active":"2024-04-19T03:02:24.255832+0000","last_peered":"2024-04-19T03:02:24.255832+0000","last_clean":"2024-04-19T03:02:24.255832+0000","last_became_active":"2024-04-19T03:01:15.017982+0000","last_became_peered":"2024-04-19T03:01:15.017982+0000","last_unstale":"2024-04-19T03:02:24.255832+0000","last_undegraded":"2024-04-19T03:02:24.255832+0000","last_fullsized":"2024-04-19T03:02:24.255832+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:10:56.732208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"20'1","reported_seq":41,"reported_epoch":44,"state":"active+undersized","last_fresh":"2024-04-19T03:02:24.264191+0000","last_change":"2024-04-19T03:02:24.263516+0000","last_active":"2024-04-19T03:02:24.264191+0000","last_peered":"2024-04-19T03:02:24.264191+0000","last_clean":"2024-04-19T03:02:21.248830+0000","last_became_active":"2024-04-19T03:02:24.263516+0000","last_became_peered":"2024-04-19T03:02:24.263516+0000","last_unstale":"2024-04-19T03:02:24.264191+0000","last_undegraded":"2024-04-19T03:02:24.264191+0000","last_fullsized":"2024-04-19T03:02:24.253942+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:21:08.378544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":39,"reported_epoch":44,"state":"active+undersized","last_fresh":"2024-04-19T03:02:24.266260+0000","last_change":"2024-04-19T03:02:24.265728+0000","last_active":"2024-04-19T03:02:24.266260+0000","last_peered":"2024-04-19T03:02:24.266260+0000","last_clean":"2024-04-19T03:02:21.249322+0000","last_became_active":"2024-04-19T03:02:24.265728+0000","last_became_peered":"2024-04-19T03:02:24.265728+0000","last_unstale":"2024-04-19T03:02:24.266260+0000","last_undegraded":"2024-04-19T03:02:24.266260+0000","last_fullsized":"2024-04-19T03:02:24.254256+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:18:31.651631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"20'1","reported_seq":49,"reported_epoch":44,"state":"active+undersized","last_fresh":"2024-04-19T03:02:24.266542+0000","last_change":"2024-04-19T03:02:24.266095+0000","last_active":"2024-04-19T03:02:24.266542+0000","last_peered":"2024-04-19T03:02:24.266542+0000","last_clean":"2024-04-19T03:02:21.249288+0000","last_became_active":"2024-04-19T03:02:24.266095+0000","last_became_peered":"2024-04-19T03:02:24.266095+0000","last_unstale":"2024-04-19T03:02:24.266542+0000","last_undegraded":"2024-04-19T03:02:24.266542+0000","last_fullsized":"2024-04-19T03:02:24.254088+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:02:11.243382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":39,"reported_epoch":44,"state":"active+undersized","last_fresh":"2024-04-19T03:02:24.265154+0000","last_change":"2024-04-19T03:02:24.264906+0000","last_active":"2024-04-19T03:02:24.265154+0000","last_peered":"2024-04-19T03:02:24.265154+0000","last_clean":"2024-04-19T03:02:21.239100+0000","last_became_active":"2024-04-19T03:02:24.264906+0000","last_became_peered":"2024-04-19T03:02:24.264906+0000","last_unstale":"2024-04-19T03:02:24.265154+0000","last_undegraded":"2024-04-19T03:02:24.265154+0000","last_fullsized":"2024-04-19T03:02:24.255858+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:00:22.904641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"20'2","reported_seq":42,"reported_epoch":44,"state":"active+undersized+degraded","last_fresh":"2024-04-19T03:02:24.283704+0000","last_change":"2024-04-19T03:02:24.283173+0000","last_active":"2024-04-19T03:02:24.283704+0000","last_peered":"2024-04-19T03:02:24.283704+0000","last_clean":"2024-04-19T03:02:21.239137+0000","last_became_active":"2024-04-19T03:02:24.283173+0000","last_became_peered":"2024-04-19T03:02:24.283173+0000","last_unstale":"2024-04-19T03:02:24.283704+0000","last_undegraded":"2024-04-19T03:02:24.265116+0000","last_fullsized":"2024-04-19T03:02:24.265029+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:14:53.718350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":1}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":39,"reported_epoch":44,"state":"active+undersized","last_fresh":"2024-04-19T03:02:24.270219+0000","last_change":"2024-04-19T03:02:24.269672+0000","last_active":"2024-04-19T03:02:24.270219+0000","last_peered":"2024-04-19T03:02:24.270219+0000","last_clean":"2024-04-19T03:02:21.238991+0000","last_became_active":"2024-04-19T03:02:24.269672+0000","last_became_peered":"2024-04-19T03:02:24.269672+0000","last_unstale":"2024-04-19T03:02:24.270219+0000","last_undegraded":"2024-04-19T03:02:24.270219+0000","last_fullsized":"2024-04-19T03:02:24.260628+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:58:33.524788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"20'2","reported_seq":37,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-04-19T03:02:24.255966+0000","last_change":"2024-04-19T03:01:14.649277+0000","last_active":"2024-04-19T03:02:24.255966+0000","last_peered":"2024-04-19T03:02:24.255966+0000","last_clean":"2024-04-19T03:02:24.255966+0000","last_became_active":"2024-04-19T03:01:14.648614+0000","last_became_peered":"2024-04-19T03:01:14.648614+0000","last_unstale":"2024-04-19T03:02:24.255966+0000","last_undegraded":"2024-04-19T03:02:24.255966+0000","last_fullsized":"2024-04-19T03:02:24.255966+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:34:05.922324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":39,"reported_epoch":44,"state":"active+undersized","last_fresh":"2024-04-19T03:02:24.263621+0000","last_change":"2024-04-19T03:02:24.263202+0000","last_active":"2024-04-19T03:02:24.263621+0000","last_peered":"2024-04-19T03:02:24.263621+0000","last_clean":"2024-04-19T03:02:21.248674+0000","last_became_active":"2024-04-19T03:02:24.263202+0000","last_became_peered":"2024-04-19T03:02:24.263202+0000","last_unstale":"2024-04-19T03:02:24.263621+0000","last_undegraded":"2024-04-19T03:02:24.263621+0000","last_fullsized":"2024-04-19T03:02:24.252560+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:05:00.071308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"20'1","reported_seq":10,"reported_epoch":44,"state":"active+undersized","last_fresh":"2024-04-19T03:02:25.045751+0000","last_change":"2024-04-19T03:02:24.269410+0000","last_active":"2024-04-19T03:02:25.045751+0000","last_peered":"2024-04-19T03:02:25.045751+0000","last_clean":"2024-04-19T03:01:13.604133+0000","last_became_active":"2024-04-19T03:02:24.269410+0000","last_became_peered":"2024-04-19T03:02:24.269410+0000","last_unstale":"2024-04-19T03:02:25.045751+0000","last_undegraded":"2024-04-19T03:02:25.045751+0000","last_fullsized":"2024-04-19T03:02:24.257278+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:01:43.100098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":39,"reported_epoch":44,"state":"active+undersized","last_fresh":"2024-04-19T03:02:24.265009+0000","last_change":"2024-04-19T03:02:24.264787+0000","last_active":"2024-04-19T03:02:24.265009+0000","last_peered":"2024-04-19T03:02:24.265009+0000","last_clean":"2024-04-19T03:02:21.238692+0000","last_became_active":"2024-04-19T03:02:24.264787+0000","last_became_peered":"2024-04-19T03:02:24.264787+0000","last_unstale":"2024-04-19T03:02:24.265009+0000","last_undegraded":"2024-04-19T03:02:24.265009+0000","last_fullsized":"2024-04-19T03:02:24.255976+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:20:59.356983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"20'4","reported_seq":18,"reported_epoch":44,"state":"active+undersized+degraded","last_fresh":"2024-04-19T03:02:25.015450+0000","last_change":"2024-04-19T03:02:24.276744+0000","last_active":"2024-04-19T03:02:25.015450+0000","last_peered":"2024-04-19T03:02:25.015450+0000","last_clean":"2024-04-19T03:01:15.006951+0000","last_became_active":"2024-04-19T03:02:24.276744+0000","last_became_peered":"2024-04-19T03:02:24.276744+0000","last_unstale":"2024-04-19T03:02:25.015450+0000","last_undegraded":"2024-04-19T03:02:24.263785+0000","last_fullsized":"2024-04-19T03:02:24.263676+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:27:16.968519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":2}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":16,"stat_sum":{"num_bytes":6436749312,"num_objects":98217,"num_object_clones":0,"num_object_copies":196434,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":79877,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98217,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":98217,"num_write_kb":6285888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":65536,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":745963520,"data_stored":11935416320,"data_compressed":22871182,"data_compressed_allocated":745963520,"data_compressed_original":11935416320,"omap_allocated":0,"internal_metadata":0},"log_size":62205,"ondisk_log_size":62205,"up":19,"acting":19,"num_store_stats":3},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":83,"acting":83,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":8,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":42,"acting":42,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":10,"acting":10,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":14482,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":10,"seq":42949672983,"num_pgs":80,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":360148,"kb_used_data":244556,"kb_used_omap":1,"kb_used_meta":115582,"kb_avail":94011692,"statfs":{"total":96636764160,"available":96267972608,"internally_reserved":0,"allocated":250425344,"data_stored":3998529422,"data_compressed":7669067,"data_compressed_allocated":249896960,"data_compressed_original":3998334976,"omap_allocated":1594,"internal_metadata":118356422},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 19 03:02:08 2024","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":2.1379999999999999},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"last":0.33100000000000002}]},{"osd":1,"last update":"Fri Apr 19 03:02:08 2024","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.24299999999999999},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":1.413}]}]},{"osd":1,"up_from":10,"seq":42949672982,"num_pgs":76,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":309152,"kb_used_data":219796,"kb_used_omap":1,"kb_used_meta":89342,"kb_avail":94062688,"statfs":{"total":96636764160,"available":96320192512,"internally_reserved":0,"allocated":225071104,"data_stored":3592992038,"data_compressed":6891812,"data_compressed_allocated":224550912,"data_compressed_original":3592798208,"omap_allocated":1594,"internal_metadata":91486662},"hb_peers":[2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3,0,0,3],"upper_bound":16},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 19 03:02:04 2024","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.216},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":2.2349999999999999}]},{"osd":2,"last update":"Fri Apr 19 03:02:04 2024","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.372}]}]},{"osd":0,"up_from":9,"seq":38654705683,"num_pgs":86,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":367332,"kb_used_data":259932,"kb_used_omap":1,"kb_used_meta":107390,"kb_avail":94004508,"statfs":{"total":96636764160,"available":96260616192,"internally_reserved":0,"allocated":266170368,"data_stored":4251934492,"data_compressed":8145009,"data_compressed_allocated":265736192,"data_compressed_original":4251779072,"omap_allocated":1594,"internal_metadata":109967814},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Apr 19 03:02:06 2024","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"min":{"1min":0.216,"5min":0.216,"15min":0.216},"max":{"1min":3.8879999999999999,"5min":3.8879999999999999,"15min":3.8879999999999999},"last":4.2869999999999999},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.32200000000000001}]},{"osd":2,"last update":"Fri Apr 19 03:02:06 2024","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":2.1230000000000002,"5min":2.1230000000000002,"15min":2.1230000000000002},"last":0.29999999999999999},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":3.3330000000000002,"5min":3.3330000000000002,"15min":3.3330000000000002},"last":4.2270000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":7241,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":7241,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":268513280,"data_stored":4296212480,"data_compressed":8230351,"data_compressed_allocated":268513280,"data_compressed_original":4296212480,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":226324480,"data_stored":3621191680,"data_compressed":6940149,"data_compressed_allocated":226324480,"data_compressed_original":3621191680,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":251125760,"data_stored":4018012160,"data_compressed":7700682,"data_compressed_allocated":251125760,"data_compressed_original":4018012160,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-19T03:02:33.039 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg force-backfill 5.8 5.b 5.a 3.b 5.c 5.e 3.1f 2024-04-19T03:02:33.126 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:33.123+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:33.163 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-04-19T03:02:33.163 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [ 2024-04-19T03:02:33.164 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:33.164 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:104307 5.5 5:afa22229:::benchmark_data_smithi096_19531_object104306:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-19T03:02:33.164 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:33.153446+0000", 2024-04-19T03:02:33.164 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0088334869999999992, 2024-04-19T03:02:33.164 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0088596730000000002, 2024-04-19T03:02:33.164 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:33.164 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-04-19T03:02:33.164 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:33.164 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:33.164 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:33.164 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 104307 2024-04-19T03:02:33.164 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:33.164 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:33.165 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:33.165 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:33.165 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:33.153446+0000", 2024-04-19T03:02:33.165 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:33.165 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:33.165 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:33.165 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:33.165 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:33.153446+0000", 2024-04-19T03:02:33.165 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:33.165 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:33.165 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:33.165 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:33.165 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:33.153445+0000", 2024-04-19T03:02:33.166 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:33.166 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:33.166 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:33.166 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:33.166 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:33.153506+0000", 2024-04-19T03:02:33.166 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1210999999999994e-05 2024-04-19T03:02:33.166 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:33.166 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:33.166 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:33.166 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:33.153525+0000", 2024-04-19T03:02:33.167 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9187000000000001e-05 2024-04-19T03:02:33.167 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:33.167 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:33.167 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:33.167 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:33.153531+0000", 2024-04-19T03:02:33.167 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5509999999999999e-06 2024-04-19T03:02:33.167 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:33.167 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:33.167 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:33.167 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:33.153581+0000", 2024-04-19T03:02:33.167 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0393999999999999e-05 2024-04-19T03:02:33.167 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:33.167 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:33.167 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:33.168 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:33.153750+0000", 2024-04-19T03:02:33.168 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000168362 2024-04-19T03:02:33.168 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:33.168 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:33.168 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:33.168 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:33.168 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:33.168 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:104310 5.2 5:404f3d80:::benchmark_data_smithi096_19531_object104309:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-19T03:02:33.168 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:33.155970+0000", 2024-04-19T03:02:33.168 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0063094290000000001, 2024-04-19T03:02:33.168 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0064043349999999997, 2024-04-19T03:02:33.168 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:33.168 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-04-19T03:02:33.168 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:33.169 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:33.169 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:33.169 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 104310 2024-04-19T03:02:33.169 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:33.169 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:33.169 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:33.169 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:33.169 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:33.155970+0000", 2024-04-19T03:02:33.169 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:33.169 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:33.169 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:33.169 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:33.170 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:33.155970+0000", 2024-04-19T03:02:33.170 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:33.170 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:33.170 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:33.170 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:33.170 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:33.155969+0000", 2024-04-19T03:02:33.170 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:33.170 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:33.170 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:33.170 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:33.170 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:33.156015+0000", 2024-04-19T03:02:33.170 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5784000000000001e-05 2024-04-19T03:02:33.171 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:33.171 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:33.171 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:33.171 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:33.156026+0000", 2024-04-19T03:02:33.171 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0872e-05 2024-04-19T03:02:33.171 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:33.171 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:33.171 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:33.171 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:33.156033+0000", 2024-04-19T03:02:33.171 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5549999999999997e-06 2024-04-19T03:02:33.171 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:33.171 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:33.171 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:33.171 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:33.156076+0000", 2024-04-19T03:02:33.171 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3049000000000001e-05 2024-04-19T03:02:33.172 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:33.172 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:33.172 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:33.172 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:33.156195+0000", 2024-04-19T03:02:33.172 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000119058 2024-04-19T03:02:33.172 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:33.172 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:33.172 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:33.172 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:33.172 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:33.172 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:104311 5.2 5:4a7e1645:::benchmark_data_smithi096_19531_object104310:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-19T03:02:33.172 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:33.156047+0000", 2024-04-19T03:02:33.172 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0062319760000000002, 2024-04-19T03:02:33.172 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0063879169999999999, 2024-04-19T03:02:33.173 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:33.173 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-04-19T03:02:33.173 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:33.173 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:33.173 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:33.173 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 104311 2024-04-19T03:02:33.173 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:33.173 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:33.173 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:33.173 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:33.173 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:33.156047+0000", 2024-04-19T03:02:33.173 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:33.173 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:33.174 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:33.174 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:33.174 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:33.156047+0000", 2024-04-19T03:02:33.174 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:33.174 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:33.174 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:33.174 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:33.175 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:33.156047+0000", 2024-04-19T03:02:33.175 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:33.175 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:33.175 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:33.175 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:33.175 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:33.156076+0000", 2024-04-19T03:02:33.175 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9669e-05 2024-04-19T03:02:33.175 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:33.175 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:33.176 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:33.176 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:33.156084+0000", 2024-04-19T03:02:33.176 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.038e-06 2024-04-19T03:02:33.176 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:33.176 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:33.176 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:33.176 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:33.156090+0000", 2024-04-19T03:02:33.176 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8769999999999998e-06 2024-04-19T03:02:33.177 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:33.177 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:33.177 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:33.177 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:33.160613+0000", 2024-04-19T03:02:33.177 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0045230590000000003 2024-04-19T03:02:33.177 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:33.177 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:33.177 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:33.178 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:33.160761+0000", 2024-04-19T03:02:33.178 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00014757999999999999 2024-04-19T03:02:33.178 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:33.178 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:33.178 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:33.178 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:33.179 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:33.179 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:104312 5.5 5:a4b2f18a:::benchmark_data_smithi096_19531_object104311:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-19T03:02:33.179 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:33.156399+0000", 2024-04-19T03:02:33.179 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0058801740000000002, 2024-04-19T03:02:33.179 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0060951269999999997, 2024-04-19T03:02:33.179 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:33.180 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-04-19T03:02:33.180 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:33.180 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:33.180 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:33.180 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 104312 2024-04-19T03:02:33.180 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:33.181 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:33.181 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:33.181 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:33.181 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:33.156399+0000", 2024-04-19T03:02:33.181 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:33.181 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:33.182 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:33.182 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:33.182 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:33.156399+0000", 2024-04-19T03:02:33.182 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:33.182 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:33.182 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:33.182 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:33.183 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:33.156398+0000", 2024-04-19T03:02:33.183 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:33.183 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:33.183 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:33.183 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:33.183 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:33.156466+0000", 2024-04-19T03:02:33.183 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8140999999999997e-05 2024-04-19T03:02:33.184 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:33.184 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:33.184 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:33.184 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:33.156512+0000", 2024-04-19T03:02:33.184 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5404000000000001e-05 2024-04-19T03:02:33.184 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:33.185 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:33.185 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:33.185 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:33.156525+0000", 2024-04-19T03:02:33.185 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3111e-05 2024-04-19T03:02:33.185 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:33.185 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:33.186 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:33.186 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:33.158703+0000", 2024-04-19T03:02:33.186 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0021785250000000002 2024-04-19T03:02:33.186 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:33.186 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:33.186 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:33.186 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:33.158827+0000", 2024-04-19T03:02:33.186 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000123316 2024-04-19T03:02:33.186 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:33.186 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:33.186 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:33.187 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:33.187 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:33.187 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:104316 5.2 5.6a0e9f22 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-19T03:02:33.187 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:33.160604+0000", 2024-04-19T03:02:33.187 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.001675422, 2024-04-19T03:02:33.187 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0019457750000000001, 2024-04-19T03:02:33.187 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:33.187 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-04-19T03:02:33.187 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:33.187 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:33.187 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:33.187 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 104316 2024-04-19T03:02:33.187 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:33.187 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:33.188 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:33.188 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:33.188 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:33.160604+0000", 2024-04-19T03:02:33.188 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:33.188 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:33.188 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:33.188 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:33.188 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:33.160604+0000", 2024-04-19T03:02:33.188 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:33.188 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:33.188 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:33.188 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:33.188 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:33.160603+0000", 2024-04-19T03:02:33.188 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:33.189 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:33.189 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:33.189 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:33.189 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:33.160642+0000", 2024-04-19T03:02:33.189 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9119999999999998e-05 2024-04-19T03:02:33.189 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:33.189 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:33.189 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:33.189 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:33.160652+0000", 2024-04-19T03:02:33.189 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.7690000000000008e-06 2024-04-19T03:02:33.189 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:33.189 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:33.189 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:33.189 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:33.160659+0000", 2024-04-19T03:02:33.189 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0119999999999999e-06 2024-04-19T03:02:33.190 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:33.190 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:33.190 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:33.190 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:33.190 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:33.190 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:104318 5.2 5.3c3cc342 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-19T03:02:33.190 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:33.160666+0000", 2024-04-19T03:02:33.190 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.001613398, 2024-04-19T03:02:33.190 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001929152, 2024-04-19T03:02:33.190 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:33.190 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-04-19T03:02:33.190 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:33.190 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:33.191 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:33.191 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 104318 2024-04-19T03:02:33.191 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:33.191 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:33.191 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:33.191 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:33.191 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:33.160666+0000", 2024-04-19T03:02:33.191 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:33.191 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:33.191 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:33.191 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:33.191 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:33.160666+0000", 2024-04-19T03:02:33.191 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:33.191 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:33.192 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:33.192 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:33.192 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:33.160666+0000", 2024-04-19T03:02:33.192 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:33.192 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:33.192 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:33.192 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:33.192 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:33.160695+0000", 2024-04-19T03:02:33.192 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9626000000000001e-05 2024-04-19T03:02:33.192 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:33.192 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:33.192 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:33.192 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:33.160702+0000", 2024-04-19T03:02:33.192 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7870000000000004e-06 2024-04-19T03:02:33.193 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:33.193 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:33.193 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:33.193 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:33.160707+0000", 2024-04-19T03:02:33.193 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.079e-06 2024-04-19T03:02:33.193 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:33.193 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:33.193 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:33.193 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:33.193 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:33.193 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:104319 5.9 5.bf3282b9 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-19T03:02:33.193 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:33.161004+0000", 2024-04-19T03:02:33.193 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0012755220000000001, 2024-04-19T03:02:33.194 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0016361049999999999, 2024-04-19T03:02:33.194 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:33.194 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-04-19T03:02:33.194 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:33.194 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:33.194 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:33.194 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 104319 2024-04-19T03:02:33.194 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:33.194 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:33.194 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:33.194 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:33.194 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:33.161004+0000", 2024-04-19T03:02:33.194 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:33.194 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:33.195 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:33.195 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:33.195 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:33.161004+0000", 2024-04-19T03:02:33.195 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:33.195 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:33.195 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:33.195 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:33.195 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:33.161003+0000", 2024-04-19T03:02:33.195 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:33.195 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:33.195 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:33.195 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:33.196 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:33.161045+0000", 2024-04-19T03:02:33.196 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2592000000000001e-05 2024-04-19T03:02:33.196 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:33.196 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:33.196 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:33.196 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:33.161062+0000", 2024-04-19T03:02:33.196 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7036000000000001e-05 2024-04-19T03:02:33.196 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:33.196 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:33.196 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:33.196 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:33.161069+0000", 2024-04-19T03:02:33.196 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.9460000000000001e-06 2024-04-19T03:02:33.197 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:33.197 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:33.197 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:33.197 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:33.197 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:33.197 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:104322 5.5 5:a467e0a9:::benchmark_data_smithi096_19531_object104321:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-19T03:02:33.197 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:33.161082+0000", 2024-04-19T03:02:33.197 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0011976980000000001, 2024-04-19T03:02:33.197 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0016080090000000001, 2024-04-19T03:02:33.197 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:33.197 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-04-19T03:02:33.197 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:33.197 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:33.197 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:33.198 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 104322 2024-04-19T03:02:33.198 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:33.198 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:33.198 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:33.198 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:33.198 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:33.161082+0000", 2024-04-19T03:02:33.198 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:33.198 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:33.198 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:33.198 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:33.198 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:33.161082+0000", 2024-04-19T03:02:33.198 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:33.199 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:33.199 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:33.199 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:33.199 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:33.161081+0000", 2024-04-19T03:02:33.199 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:33.199 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:33.199 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:33.199 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:33.199 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:33.161120+0000", 2024-04-19T03:02:33.199 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8423999999999997e-05 2024-04-19T03:02:33.199 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:33.199 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:33.199 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:33.200 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:33.161131+0000", 2024-04-19T03:02:33.200 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1328000000000001e-05 2024-04-19T03:02:33.200 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:33.200 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:33.200 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:33.200 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:33.161138+0000", 2024-04-19T03:02:33.200 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2320000000000004e-06 2024-04-19T03:02:33.200 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:33.200 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:33.200 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:33.200 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:33.161413+0000", 2024-04-19T03:02:33.200 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00027450700000000001 2024-04-19T03:02:33.200 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:33.200 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:33.201 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:33.201 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:33.161569+0000", 2024-04-19T03:02:33.201 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00015677099999999999 2024-04-19T03:02:33.201 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:33.201 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:33.201 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:33.201 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:33.201 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:33.201 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:104323 5.6 5:6e617f29:::benchmark_data_smithi096_19531_object104322:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2024-04-19T03:02:33.201 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:33.161144+0000", 2024-04-19T03:02:33.201 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0011354189999999999, 2024-04-19T03:02:33.201 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0016068289999999999, 2024-04-19T03:02:33.201 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:33.201 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-04-19T03:02:33.202 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:33.202 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:33.202 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:33.202 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 104323 2024-04-19T03:02:33.202 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:33.202 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:33.202 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:33.202 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:33.202 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:33.161144+0000", 2024-04-19T03:02:33.202 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:33.202 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:33.202 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:33.202 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:33.203 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:33.161144+0000", 2024-04-19T03:02:33.203 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:33.203 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:33.203 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:33.203 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:33.203 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:33.161143+0000", 2024-04-19T03:02:33.203 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:33.203 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:33.203 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:33.203 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:33.203 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:33.161180+0000", 2024-04-19T03:02:33.203 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6579000000000003e-05 2024-04-19T03:02:33.203 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:33.203 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:33.203 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:33.204 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:33.161193+0000", 2024-04-19T03:02:33.204 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2853e-05 2024-04-19T03:02:33.204 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:33.204 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:33.204 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:33.204 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:33.161199+0000", 2024-04-19T03:02:33.204 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6200000000000001e-06 2024-04-19T03:02:33.204 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:33.204 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:33.204 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:33.204 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:33.161260+0000", 2024-04-19T03:02:33.204 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0383000000000001e-05 2024-04-19T03:02:33.204 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:33.204 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:33.204 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:33.205 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:33.161422+0000", 2024-04-19T03:02:33.205 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00016217400000000001 2024-04-19T03:02:33.205 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:33.205 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:33.205 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:33.205 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:33.205 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:33.205 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4755.0:104321 5.d e46/22)", 2024-04-19T03:02:33.205 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:33.161763+0000", 2024-04-19T03:02:33.205 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.000516491, 2024-04-19T03:02:33.205 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0010396959999999999, 2024-04-19T03:02:33.205 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:33.205 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-04-19T03:02:33.206 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:33.206 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:33.206 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:33.206 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:33.161763+0000", 2024-04-19T03:02:33.206 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:33.206 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:33.206 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:33.206 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:33.206 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:33.161763+0000", 2024-04-19T03:02:33.206 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:33.206 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:33.206 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:33.207 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:33.207 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:33.161762+0000", 2024-04-19T03:02:33.207 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:33.207 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:33.207 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:33.207 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:33.207 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:33.161840+0000", 2024-04-19T03:02:33.207 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8004999999999996e-05 2024-04-19T03:02:33.207 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:33.207 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:33.207 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:33.207 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:33.161853+0000", 2024-04-19T03:02:33.207 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2588e-05 2024-04-19T03:02:33.207 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:33.207 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:33.208 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:33.208 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:33.161859+0000", 2024-04-19T03:02:33.208 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8220000000000001e-06 2024-04-19T03:02:33.208 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:33.208 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:33.208 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:33.208 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:33.208 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-04-19T03:02:33.208 INFO:teuthology.orchestra.run.smithi144.stdout: "num_ops": 10 2024-04-19T03:02:33.208 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-04-19T03:02:33.209 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-19T03:02:33.210 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T03:02:33.226 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:33.225+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:33.328 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:33.325+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:33.346 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-04-19T03:02:33.346 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2024-04-19T03:02:33.346 INFO:teuthology.orchestra.run.smithi144.stdout: "complaint_time": 30, 2024-04-19T03:02:33.346 INFO:teuthology.orchestra.run.smithi144.stdout: "num_blocked_ops": 0 2024-04-19T03:02:33.346 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-04-19T03:02:33.353 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1: {} 2024-04-19T03:02:33.358 INFO:teuthology.orchestra.run.smithi096.stderr:instructing pg(s) [5.8,5.a,5.b,5.e] on osd.1 to force-backfill; instructing pg(s) [3.b,3.1f,5.c] on osd.2 to force-backfill; 2024-04-19T03:02:33.358 INFO:teuthology.orchestra.run.smithi096.stderr: 2024-04-19T03:02:33.360 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T03:02:33.377 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2: {} 2024-04-19T03:02:33.377 INFO:teuthology.orchestra.run.smithi096.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-04-19T03:02:33.378 INFO:teuthology.orchestra.run.smithi096.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-19T03:02:33.378 INFO:teuthology.orchestra.run.smithi096.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-19T03:02:33.380 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-19T03:02:33.380 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-19T03:02:33.387 INFO:teuthology.orchestra.run.smithi096.stderr:nodeep-scrub is unset 2024-04-19T03:02:33.429 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:33.427+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:33.530 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-04-19T03:02:33.530 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:02:33.530 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:33.527+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:33.543 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T03:02:33.631 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:33.627+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:33.675 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-19T03:02:33.675 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:02:33.689 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T03:02:33.733 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:33.729+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:33.815 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-19T03:02:33.815 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:02:33.826 INFO:tasks.radosbench.radosbench.0.smithi096.stdout: 56 15 105617 105602 117.846 123.438 0.00529187 0.00847988 2024-04-19T03:02:33.829 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T03:02:33.832 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:33.829+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:33.933 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:33.929+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:33.952 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-19T03:02:33.952 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:02:33.965 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T03:02:34.033 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:34.029+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:34.094 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-04-19T03:02:34.094 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:02:34.108 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T03:02:34.134 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:34.133+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:34.237 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:34.233+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:34.240 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-04-19T03:02:34.240 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:02:34.254 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T03:02:34.335 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:34.335+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:34.424 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-04-19T03:02:34.424 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:02:34.438 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:34.433+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:34.438 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T03:02:34.537 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:34.535+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:34.572 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-19T03:02:34.572 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:02:34.583 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T03:02:34.638 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:34.637+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:34.710 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-19T03:02:34.710 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:02:34.721 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T03:02:34.739 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:34.737+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:34.826 INFO:tasks.radosbench.radosbench.0.smithi096.stdout: 57 16 107567 107551 117.915 121.812 0.00701325 0.00847464 2024-04-19T03:02:34.840 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:34.837+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:34.853 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-19T03:02:34.853 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:02:34.866 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T03:02:34.941 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:34.939+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:34.996 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-04-19T03:02:34.996 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:02:35.009 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T03:02:35.042 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:35.041+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:35.060 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~6s 2024-04-19T03:02:35.134 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-04-19T03:02:35.134 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:02:35.143 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:35.139+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:35.145 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T03:02:35.245 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:35.243+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:35.277 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-04-19T03:02:35.277 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:02:35.290 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T03:02:35.346 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:35.341+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:35.381 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-19T03:02:35.398 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-19T03:02:35.420 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-19T03:02:35.420 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:02:35.432 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T03:02:35.446 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:35.443+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:35.525 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1: {} 2024-04-19T03:02:35.545 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2: {} 2024-04-19T03:02:35.545 INFO:teuthology.orchestra.run.smithi096.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-04-19T03:02:35.545 INFO:teuthology.orchestra.run.smithi096.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-19T03:02:35.545 INFO:teuthology.orchestra.run.smithi096.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-19T03:02:35.547 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:35.543+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:35.548 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-19T03:02:35.548 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-19T03:02:35.566 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-19T03:02:35.566 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-04-19T03:02:35.566 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-04-19T03:02:35.566 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-04-19T03:02:35.566 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-19T03:02:35.577 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T03:02:35.648 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:35.647+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:35.712 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-19T03:02:35.712 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-04-19T03:02:35.712 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-04-19T03:02:35.712 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-04-19T03:02:35.712 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.712 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:79014 5.d 5:b5eee02c:::benchmark_data_smithi096_19531_object79013:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-19T03:02:35.713 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:18.032471+0000", 2024-04-19T03:02:35.713 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 17.677296426000002, 2024-04-19T03:02:35.713 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.041427629000000001, 2024-04-19T03:02:35.713 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:35.713 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:35.713 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:35.713 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:35.713 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:35.713 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 79014 2024-04-19T03:02:35.713 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.713 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:35.713 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.713 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:35.713 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:18.032471+0000", 2024-04-19T03:02:35.713 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:35.714 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.714 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.714 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:35.714 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:18.032471+0000", 2024-04-19T03:02:35.714 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:35.714 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.714 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.714 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:35.714 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:18.032470+0000", 2024-04-19T03:02:35.714 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:35.714 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.714 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.714 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:35.715 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:18.032525+0000", 2024-04-19T03:02:35.715 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5535999999999998e-05 2024-04-19T03:02:35.715 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.715 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.715 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:35.715 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:18.032537+0000", 2024-04-19T03:02:35.715 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1987999999999999e-05 2024-04-19T03:02:35.715 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.715 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.715 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:35.715 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:18.032546+0000", 2024-04-19T03:02:35.716 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9670000000000007e-06 2024-04-19T03:02:35.716 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.716 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.716 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:35.716 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:18.032613+0000", 2024-04-19T03:02:35.716 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6508999999999996e-05 2024-04-19T03:02:35.716 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.716 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.716 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:35.716 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:18.032738+0000", 2024-04-19T03:02:35.716 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000124912 2024-04-19T03:02:35.716 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.716 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.717 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-04-19T03:02:35.717 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:18.032867+0000", 2024-04-19T03:02:35.717 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012959399999999999 2024-04-19T03:02:35.717 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.717 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.717 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:35.717 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:18.035867+0000", 2024-04-19T03:02:35.717 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.002999378 2024-04-19T03:02:35.717 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.717 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.717 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:35.717 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:18.073705+0000", 2024-04-19T03:02:35.717 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.037838042000000002 2024-04-19T03:02:35.717 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.718 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.718 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:35.718 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:18.073813+0000", 2024-04-19T03:02:35.718 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010806099999999999 2024-04-19T03:02:35.718 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.718 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.718 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:35.718 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:18.073899+0000", 2024-04-19T03:02:35.718 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.5971999999999996e-05 2024-04-19T03:02:35.718 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:35.718 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:35.718 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:35.718 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.718 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.719 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:86615 5.e 5:7fef7288:::benchmark_data_smithi096_19531_object86614:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:35.719 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:22.634544+0000", 2024-04-19T03:02:35.719 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 13.075223447000001, 2024-04-19T03:02:35.719 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.192475071, 2024-04-19T03:02:35.719 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:35.719 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:35.719 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:35.719 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:35.719 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:35.719 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 86615 2024-04-19T03:02:35.719 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.719 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:35.719 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.719 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:35.719 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634544+0000", 2024-04-19T03:02:35.720 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:35.720 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.720 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.720 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:35.720 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634544+0000", 2024-04-19T03:02:35.720 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:35.720 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.720 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.720 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:35.720 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634542+0000", 2024-04-19T03:02:35.720 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999981 2024-04-19T03:02:35.720 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.720 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.720 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:35.721 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634585+0000", 2024-04-19T03:02:35.721 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2299000000000003e-05 2024-04-19T03:02:35.721 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.721 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.721 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:35.721 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634592+0000", 2024-04-19T03:02:35.721 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2350000000000002e-06 2024-04-19T03:02:35.721 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.721 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.721 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:35.721 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634596+0000", 2024-04-19T03:02:35.721 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5390000000000001e-06 2024-04-19T03:02:35.721 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.721 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.721 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:35.722 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634639+0000", 2024-04-19T03:02:35.722 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2444999999999998e-05 2024-04-19T03:02:35.722 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.722 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.722 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:35.722 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634808+0000", 2024-04-19T03:02:35.722 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000169152 2024-04-19T03:02:35.722 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.722 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.722 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:35.722 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634999+0000", 2024-04-19T03:02:35.722 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00019098300000000001 2024-04-19T03:02:35.723 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.723 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.723 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:35.723 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.640458+0000", 2024-04-19T03:02:35.723 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0054586870000000003 2024-04-19T03:02:35.723 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.723 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.723 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:35.723 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.826949+0000", 2024-04-19T03:02:35.723 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.18649178299999999 2024-04-19T03:02:35.723 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.723 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.723 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:35.724 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.826982+0000", 2024-04-19T03:02:35.724 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2477000000000001e-05 2024-04-19T03:02:35.724 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.724 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.724 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:35.724 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.827019+0000", 2024-04-19T03:02:35.724 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7355999999999999e-05 2024-04-19T03:02:35.724 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:35.724 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:35.724 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:35.724 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.724 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.724 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:86616 5.e 5:72278f47:::benchmark_data_smithi096_19531_object86615:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:35.724 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:22.634609+0000", 2024-04-19T03:02:35.725 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 13.075158298, 2024-04-19T03:02:35.725 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.19472088900000001, 2024-04-19T03:02:35.725 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:35.725 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:35.725 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:35.725 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:35.725 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:35.725 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 86616 2024-04-19T03:02:35.725 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.725 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:35.725 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.725 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:35.725 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634609+0000", 2024-04-19T03:02:35.725 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:35.725 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.726 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.726 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:35.726 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634609+0000", 2024-04-19T03:02:35.726 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:35.726 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.726 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.726 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:35.726 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634609+0000", 2024-04-19T03:02:35.726 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:35.726 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.726 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.727 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:35.727 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634651+0000", 2024-04-19T03:02:35.727 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2589000000000002e-05 2024-04-19T03:02:35.727 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.727 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.727 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:35.727 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634659+0000", 2024-04-19T03:02:35.727 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5850000000000002e-06 2024-04-19T03:02:35.727 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.727 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.727 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:35.728 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634662+0000", 2024-04-19T03:02:35.728 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3620000000000002e-06 2024-04-19T03:02:35.728 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.728 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.728 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:35.728 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.637880+0000", 2024-04-19T03:02:35.728 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.003218149 2024-04-19T03:02:35.728 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.728 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.728 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:35.728 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.637999+0000", 2024-04-19T03:02:35.728 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000118643 2024-04-19T03:02:35.728 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.728 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.729 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:35.729 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.638102+0000", 2024-04-19T03:02:35.729 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010331 2024-04-19T03:02:35.729 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.729 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.729 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:35.729 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.640851+0000", 2024-04-19T03:02:35.729 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0027483310000000001 2024-04-19T03:02:35.729 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.729 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.729 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:35.729 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.829269+0000", 2024-04-19T03:02:35.729 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.188418319 2024-04-19T03:02:35.729 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.730 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.730 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:35.730 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.829299+0000", 2024-04-19T03:02:35.730 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0227e-05 2024-04-19T03:02:35.730 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.730 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.730 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:35.730 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.829330+0000", 2024-04-19T03:02:35.730 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0969000000000001e-05 2024-04-19T03:02:35.730 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:35.730 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:35.730 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:35.731 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.731 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.731 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:86618 5.0 5:09014b90:::benchmark_data_smithi096_19531_object86617:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:35.731 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:22.634894+0000", 2024-04-19T03:02:35.731 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 13.07487381, 2024-04-19T03:02:35.731 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.19413419800000001, 2024-04-19T03:02:35.731 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:35.731 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:35.731 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:35.731 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:35.731 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:35.731 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 86618 2024-04-19T03:02:35.731 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.731 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:35.732 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.732 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:35.732 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634894+0000", 2024-04-19T03:02:35.732 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:35.732 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.732 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.732 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:35.732 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634894+0000", 2024-04-19T03:02:35.732 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:35.732 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.732 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.732 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:35.732 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634893+0000", 2024-04-19T03:02:35.732 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:35.733 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.733 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.733 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:35.733 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634976+0000", 2024-04-19T03:02:35.733 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3231000000000003e-05 2024-04-19T03:02:35.733 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.733 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.733 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:35.733 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634983+0000", 2024-04-19T03:02:35.733 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5169999999999996e-06 2024-04-19T03:02:35.733 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.733 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.733 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:35.734 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634987+0000", 2024-04-19T03:02:35.734 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.425e-06 2024-04-19T03:02:35.734 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.734 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.734 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:35.734 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635030+0000", 2024-04-19T03:02:35.734 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.32e-05 2024-04-19T03:02:35.734 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.734 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.734 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:35.734 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635185+0000", 2024-04-19T03:02:35.735 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015471899999999999 2024-04-19T03:02:35.735 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.735 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.735 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:35.735 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635415+0000", 2024-04-19T03:02:35.735 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00023026500000000001 2024-04-19T03:02:35.735 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.735 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.735 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:35.735 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.640127+0000", 2024-04-19T03:02:35.735 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0047118890000000004 2024-04-19T03:02:35.736 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.736 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.736 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:35.736 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.828895+0000", 2024-04-19T03:02:35.736 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.18876802600000001 2024-04-19T03:02:35.736 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.736 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.736 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:35.736 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.828972+0000", 2024-04-19T03:02:35.736 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.6345000000000002e-05 2024-04-19T03:02:35.736 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.737 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.737 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:35.737 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.829028+0000", 2024-04-19T03:02:35.737 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6342999999999999e-05 2024-04-19T03:02:35.737 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:35.737 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:35.737 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:35.737 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.737 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.738 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:86620 5.b 5:d80faa68:::benchmark_data_smithi096_19531_object86619:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:35.738 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:22.635110+0000", 2024-04-19T03:02:35.738 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 13.07465725, 2024-04-19T03:02:35.738 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.193447275, 2024-04-19T03:02:35.738 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:35.738 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:35.738 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:35.738 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:35.738 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:35.738 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 86620 2024-04-19T03:02:35.738 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.738 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:35.739 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.739 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:35.739 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635110+0000", 2024-04-19T03:02:35.739 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:35.739 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.739 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.739 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:35.739 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635110+0000", 2024-04-19T03:02:35.739 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:35.739 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.739 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.739 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:35.740 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635110+0000", 2024-04-19T03:02:35.740 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:35.740 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.740 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.740 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:35.740 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635154+0000", 2024-04-19T03:02:35.740 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4681000000000001e-05 2024-04-19T03:02:35.740 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.740 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.740 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:35.740 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635166+0000", 2024-04-19T03:02:35.740 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1505000000000001e-05 2024-04-19T03:02:35.740 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.740 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.741 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:35.741 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635171+0000", 2024-04-19T03:02:35.741 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6040000000000003e-06 2024-04-19T03:02:35.741 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.741 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.741 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:35.741 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635221+0000", 2024-04-19T03:02:35.741 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9947000000000001e-05 2024-04-19T03:02:35.741 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.741 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.741 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:35.741 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635356+0000", 2024-04-19T03:02:35.741 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013576199999999999 2024-04-19T03:02:35.742 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.742 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.742 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:35.742 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635507+0000", 2024-04-19T03:02:35.742 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015072999999999999 2024-04-19T03:02:35.742 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.742 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.742 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:35.742 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.638488+0000", 2024-04-19T03:02:35.742 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0029813159999999999 2024-04-19T03:02:35.742 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.742 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.742 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:35.743 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.828341+0000", 2024-04-19T03:02:35.743 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.189852254 2024-04-19T03:02:35.743 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.743 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.743 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:35.743 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.828416+0000", 2024-04-19T03:02:35.743 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5344000000000002e-05 2024-04-19T03:02:35.743 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.743 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.743 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:35.743 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.828558+0000", 2024-04-19T03:02:35.743 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000141695 2024-04-19T03:02:35.743 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:35.743 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:35.744 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:35.744 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.744 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.744 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:86621 5.8 5:1597a420:::benchmark_data_smithi096_19531_object86620:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:35.744 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:22.635187+0000", 2024-04-19T03:02:35.744 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 13.074580389999999, 2024-04-19T03:02:35.744 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.194204878, 2024-04-19T03:02:35.744 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:35.744 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:35.744 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:35.744 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:35.744 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:35.744 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 86621 2024-04-19T03:02:35.744 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.745 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:35.745 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.745 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:35.745 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635187+0000", 2024-04-19T03:02:35.745 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:35.745 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.745 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.745 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:35.745 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635187+0000", 2024-04-19T03:02:35.745 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:35.745 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.745 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.745 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:35.745 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635187+0000", 2024-04-19T03:02:35.746 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:35.746 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.746 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.746 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:35.746 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635242+0000", 2024-04-19T03:02:35.746 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5158000000000003e-05 2024-04-19T03:02:35.746 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.746 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.746 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:35.746 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635249+0000", 2024-04-19T03:02:35.746 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.7000000000000008e-06 2024-04-19T03:02:35.746 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.746 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.747 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:35.747 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635256+0000", 2024-04-19T03:02:35.747 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2060000000000004e-06 2024-04-19T03:02:35.747 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.747 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.747 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:35.747 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635302+0000", 2024-04-19T03:02:35.747 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5954000000000001e-05 2024-04-19T03:02:35.747 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.747 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.747 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:35.747 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635427+0000", 2024-04-19T03:02:35.747 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012559299999999999 2024-04-19T03:02:35.747 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.748 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.748 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:35.748 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635596+0000", 2024-04-19T03:02:35.748 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000168615 2024-04-19T03:02:35.748 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.748 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.748 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:35.748 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.639320+0000", 2024-04-19T03:02:35.748 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0037244610000000001 2024-04-19T03:02:35.748 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.748 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.748 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:35.748 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.829277+0000", 2024-04-19T03:02:35.749 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.18995651099999999 2024-04-19T03:02:35.749 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.749 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.749 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:35.749 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.829341+0000", 2024-04-19T03:02:35.749 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3756000000000004e-05 2024-04-19T03:02:35.749 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.749 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.749 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:35.749 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.829392+0000", 2024-04-19T03:02:35.749 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1555999999999999e-05 2024-04-19T03:02:35.749 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:35.749 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:35.750 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:35.750 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.750 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.750 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87062 5.4 5:2d3b5d9a:::benchmark_data_smithi096_19531_object87061:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:35.750 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.136820+0000", 2024-04-19T03:02:35.750 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 12.572947236999999, 2024-04-19T03:02:35.750 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.066483741999999998, 2024-04-19T03:02:35.750 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:35.750 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:35.750 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:35.750 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:35.750 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:35.750 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87062 2024-04-19T03:02:35.750 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.751 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:35.751 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.751 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:35.751 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.136820+0000", 2024-04-19T03:02:35.751 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:35.751 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.751 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.751 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:35.751 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.136820+0000", 2024-04-19T03:02:35.751 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:35.751 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.751 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.751 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:35.751 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.136819+0000", 2024-04-19T03:02:35.752 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:35.752 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.752 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.752 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:35.752 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.136864+0000", 2024-04-19T03:02:35.752 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4855000000000003e-05 2024-04-19T03:02:35.752 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.752 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.752 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:35.752 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.136881+0000", 2024-04-19T03:02:35.752 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7521999999999999e-05 2024-04-19T03:02:35.752 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.752 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.752 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:35.752 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.136890+0000", 2024-04-19T03:02:35.753 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1039999999999996e-06 2024-04-19T03:02:35.753 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.753 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.753 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:35.753 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.136974+0000", 2024-04-19T03:02:35.753 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3735999999999999e-05 2024-04-19T03:02:35.753 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.753 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.753 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:35.753 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.137308+0000", 2024-04-19T03:02:35.753 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00033376100000000002 2024-04-19T03:02:35.753 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.753 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.753 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:35.754 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.137559+0000", 2024-04-19T03:02:35.754 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000250599 2024-04-19T03:02:35.754 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.754 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.754 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:35.754 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.145423+0000", 2024-04-19T03:02:35.754 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0078649589999999995 2024-04-19T03:02:35.754 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.754 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.754 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:35.754 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.203175+0000", 2024-04-19T03:02:35.754 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057751255000000001 2024-04-19T03:02:35.755 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.755 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.755 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:35.755 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.203250+0000", 2024-04-19T03:02:35.755 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5378999999999998e-05 2024-04-19T03:02:35.755 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.755 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.755 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:35.755 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.203304+0000", 2024-04-19T03:02:35.756 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4015999999999999e-05 2024-04-19T03:02:35.756 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:35.756 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:35.756 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:35.756 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.756 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.757 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87065 5.4 5:21d20a47:::benchmark_data_smithi096_19531_object87064:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:35.757 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.137482+0000", 2024-04-19T03:02:35.757 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 12.572285503, 2024-04-19T03:02:35.757 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.065988749999999999, 2024-04-19T03:02:35.757 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:35.757 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:35.758 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:35.758 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:35.758 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:35.758 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87065 2024-04-19T03:02:35.758 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.759 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:35.759 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.759 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:35.759 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.137482+0000", 2024-04-19T03:02:35.759 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:35.759 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.760 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.760 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:35.760 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.137482+0000", 2024-04-19T03:02:35.760 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:35.760 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.760 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.760 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:35.761 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.137481+0000", 2024-04-19T03:02:35.761 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:35.761 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.761 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.761 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:35.761 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.137530+0000", 2024-04-19T03:02:35.762 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9302000000000003e-05 2024-04-19T03:02:35.762 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.762 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.762 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:35.762 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.137540+0000", 2024-04-19T03:02:35.762 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.2010000000000005e-06 2024-04-19T03:02:35.763 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.763 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.763 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:35.763 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.137545+0000", 2024-04-19T03:02:35.763 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5910000000000003e-06 2024-04-19T03:02:35.763 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.763 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.764 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:35.764 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.140666+0000", 2024-04-19T03:02:35.764 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0031212710000000001 2024-04-19T03:02:35.764 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.764 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.765 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:35.765 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.140847+0000", 2024-04-19T03:02:35.765 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00018065600000000001 2024-04-19T03:02:35.765 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.765 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.765 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:35.765 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.140991+0000", 2024-04-19T03:02:35.765 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014433100000000001 2024-04-19T03:02:35.766 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.766 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.766 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:35.766 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.148053+0000", 2024-04-19T03:02:35.766 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.007061945 2024-04-19T03:02:35.766 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.767 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.767 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:35.767 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.203367+0000", 2024-04-19T03:02:35.767 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.055313703999999998 2024-04-19T03:02:35.767 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.767 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.768 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:35.768 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.203426+0000", 2024-04-19T03:02:35.768 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9024000000000003e-05 2024-04-19T03:02:35.768 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.768 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.768 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:35.769 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.203471+0000", 2024-04-19T03:02:35.769 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4818999999999999e-05 2024-04-19T03:02:35.769 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:35.769 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:35.769 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:35.769 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.770 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.770 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87067 5.b 5:d57af71a:::benchmark_data_smithi096_19531_object87066:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:35.770 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.142233+0000", 2024-04-19T03:02:35.770 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 12.567534526999999, 2024-04-19T03:02:35.770 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.071692405000000001, 2024-04-19T03:02:35.770 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:35.771 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:35.771 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:35.771 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:35.771 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:35.771 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87067 2024-04-19T03:02:35.771 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.772 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:35.772 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.772 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:35.772 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142233+0000", 2024-04-19T03:02:35.772 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:35.772 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.773 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.773 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:35.773 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142233+0000", 2024-04-19T03:02:35.773 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:35.773 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.773 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.774 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:35.774 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142232+0000", 2024-04-19T03:02:35.774 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:35.774 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.774 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.774 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:35.775 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142277+0000", 2024-04-19T03:02:35.775 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5837000000000002e-05 2024-04-19T03:02:35.775 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.775 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.775 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:35.775 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142297+0000", 2024-04-19T03:02:35.775 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9561000000000001e-05 2024-04-19T03:02:35.776 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.776 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.776 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:35.776 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142311+0000", 2024-04-19T03:02:35.776 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3654e-05 2024-04-19T03:02:35.776 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.777 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.777 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:35.777 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142391+0000", 2024-04-19T03:02:35.777 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0123999999999994e-05 2024-04-19T03:02:35.777 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.777 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.777 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:35.778 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142669+0000", 2024-04-19T03:02:35.778 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00027829800000000001 2024-04-19T03:02:35.778 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.778 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.778 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:35.779 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142859+0000", 2024-04-19T03:02:35.779 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000190051 2024-04-19T03:02:35.779 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.779 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.779 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:35.779 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.150597+0000", 2024-04-19T03:02:35.780 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0077380299999999999 2024-04-19T03:02:35.780 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.780 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.780 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:35.780 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.213855+0000", 2024-04-19T03:02:35.780 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.063257987000000002 2024-04-19T03:02:35.781 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.781 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.781 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:35.781 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.213898+0000", 2024-04-19T03:02:35.781 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2916e-05 2024-04-19T03:02:35.781 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.781 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.782 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:35.782 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.213925+0000", 2024-04-19T03:02:35.782 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7503000000000001e-05 2024-04-19T03:02:35.782 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:35.782 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:35.783 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:35.783 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.783 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.783 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87069 5.b 5:da0c93b5:::benchmark_data_smithi096_19531_object87068:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:35.783 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.143402+0000", 2024-04-19T03:02:35.783 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 12.566365565, 2024-04-19T03:02:35.784 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.070678598999999995, 2024-04-19T03:02:35.784 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:35.784 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:35.784 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:35.784 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:35.784 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:35.785 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87069 2024-04-19T03:02:35.785 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.785 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:35.785 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.785 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:35.786 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.143402+0000", 2024-04-19T03:02:35.786 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:35.786 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.786 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.786 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:35.786 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.143402+0000", 2024-04-19T03:02:35.786 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:35.786 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.787 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.787 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:35.787 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.143401+0000", 2024-04-19T03:02:35.787 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:35.787 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.787 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.787 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:35.787 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.143501+0000", 2024-04-19T03:02:35.787 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000100387 2024-04-19T03:02:35.788 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.788 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.788 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:35.788 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.143516+0000", 2024-04-19T03:02:35.788 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5369000000000001e-05 2024-04-19T03:02:35.788 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.788 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.789 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:35.789 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.143524+0000", 2024-04-19T03:02:35.789 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.7079999999999997e-06 2024-04-19T03:02:35.789 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.789 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.789 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:35.789 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.145550+0000", 2024-04-19T03:02:35.789 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0020259290000000001 2024-04-19T03:02:35.790 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.790 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.790 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:35.790 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.145676+0000", 2024-04-19T03:02:35.790 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000126406 2024-04-19T03:02:35.790 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.791 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.791 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:35.791 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.145802+0000", 2024-04-19T03:02:35.791 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000125974 2024-04-19T03:02:35.791 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.791 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.791 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:35.791 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.151030+0000", 2024-04-19T03:02:35.791 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0052276079999999999 2024-04-19T03:02:35.791 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.791 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.791 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:35.791 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.213998+0000", 2024-04-19T03:02:35.792 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.06296786 2024-04-19T03:02:35.792 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.792 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.792 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:35.792 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.214031+0000", 2024-04-19T03:02:35.792 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3387999999999999e-05 2024-04-19T03:02:35.792 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.792 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.792 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:35.792 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.214081+0000", 2024-04-19T03:02:35.792 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9316e-05 2024-04-19T03:02:35.792 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:35.793 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:35.793 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:35.793 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.793 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.793 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87073 5.0 5:0ca21233:::benchmark_data_smithi096_19531_object87072:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:35.793 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.145929+0000", 2024-04-19T03:02:35.793 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 12.563838305000001, 2024-04-19T03:02:35.793 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.062283234999999999, 2024-04-19T03:02:35.793 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:35.793 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:35.793 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:35.793 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:35.793 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:35.793 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87073 2024-04-19T03:02:35.793 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.794 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:35.794 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.794 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:35.794 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.145929+0000", 2024-04-19T03:02:35.794 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:35.794 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.794 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.794 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:35.794 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.145929+0000", 2024-04-19T03:02:35.794 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:35.794 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.794 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.794 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:35.795 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.145928+0000", 2024-04-19T03:02:35.795 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:35.795 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.795 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.795 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:35.795 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.146063+0000", 2024-04-19T03:02:35.795 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013541099999999999 2024-04-19T03:02:35.795 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.795 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.795 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:35.795 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.146079+0000", 2024-04-19T03:02:35.795 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5902000000000001e-05 2024-04-19T03:02:35.795 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.795 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.796 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:35.796 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.146100+0000", 2024-04-19T03:02:35.796 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0380000000000001e-05 2024-04-19T03:02:35.796 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.796 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.796 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:35.796 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.146193+0000", 2024-04-19T03:02:35.796 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.3669000000000001e-05 2024-04-19T03:02:35.796 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.796 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.796 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:35.796 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.146388+0000", 2024-04-19T03:02:35.796 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00019457799999999999 2024-04-19T03:02:35.797 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.797 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.797 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:35.797 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.146625+0000", 2024-04-19T03:02:35.797 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00023751999999999999 2024-04-19T03:02:35.797 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.797 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.797 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:35.797 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.151051+0000", 2024-04-19T03:02:35.797 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0044260039999999999 2024-04-19T03:02:35.797 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.797 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.797 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:35.797 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.207872+0000", 2024-04-19T03:02:35.798 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.056821114999999998 2024-04-19T03:02:35.798 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.798 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.798 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:35.798 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.208085+0000", 2024-04-19T03:02:35.798 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000212893 2024-04-19T03:02:35.798 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.798 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.798 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:35.798 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.208213+0000", 2024-04-19T03:02:35.798 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012714700000000001 2024-04-19T03:02:35.798 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:35.798 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:35.799 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:35.799 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.799 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.799 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87074 5.0 5:035614ac:::benchmark_data_smithi096_19531_object87073:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:35.799 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.151387+0000", 2024-04-19T03:02:35.799 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 12.558380374, 2024-04-19T03:02:35.799 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.063461771, 2024-04-19T03:02:35.799 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:35.799 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:35.799 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:35.799 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:35.799 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:35.799 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87074 2024-04-19T03:02:35.799 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.799 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:35.800 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.800 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:35.800 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.151387+0000", 2024-04-19T03:02:35.800 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:35.800 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.800 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.800 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:35.800 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.151387+0000", 2024-04-19T03:02:35.800 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:35.800 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.800 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.800 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:35.800 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.151386+0000", 2024-04-19T03:02:35.800 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:35.800 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.800 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.801 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:35.801 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.151428+0000", 2024-04-19T03:02:35.801 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.172e-05 2024-04-19T03:02:35.801 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.801 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.801 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:35.801 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.151442+0000", 2024-04-19T03:02:35.801 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4328000000000001e-05 2024-04-19T03:02:35.801 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.801 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.801 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:35.801 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.151451+0000", 2024-04-19T03:02:35.801 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.8400000000000001e-06 2024-04-19T03:02:35.801 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.802 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.802 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:35.802 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.151521+0000", 2024-04-19T03:02:35.802 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.9606999999999999e-05 2024-04-19T03:02:35.802 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.802 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.802 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:35.802 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.151749+0000", 2024-04-19T03:02:35.802 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00022818799999999999 2024-04-19T03:02:35.802 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.802 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.802 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:35.802 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.152006+0000", 2024-04-19T03:02:35.802 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00025687300000000002 2024-04-19T03:02:35.803 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.803 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.803 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:35.803 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.154887+0000", 2024-04-19T03:02:35.803 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0028812989999999999 2024-04-19T03:02:35.803 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.803 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.803 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:35.803 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.214733+0000", 2024-04-19T03:02:35.803 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.059846159000000003 2024-04-19T03:02:35.803 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.803 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.803 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:35.803 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.214788+0000", 2024-04-19T03:02:35.803 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4524000000000002e-05 2024-04-19T03:02:35.804 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.804 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.804 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:35.804 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.214849+0000", 2024-04-19T03:02:35.804 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1362e-05 2024-04-19T03:02:35.804 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:35.804 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:35.804 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:35.804 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.804 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.804 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87108 5.e 5:7e197adc:::benchmark_data_smithi096_19531_object87107:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:35.804 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.223103+0000", 2024-04-19T03:02:35.804 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 12.486664228, 2024-04-19T03:02:35.804 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.044946887, 2024-04-19T03:02:35.804 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:35.805 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-19T03:02:35.805 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:35.805 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:35.805 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:35.805 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87108 2024-04-19T03:02:35.805 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.805 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:35.805 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.805 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:35.805 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.223103+0000", 2024-04-19T03:02:35.805 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:35.805 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.805 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.805 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:35.805 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.223103+0000", 2024-04-19T03:02:35.805 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:35.806 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.806 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.806 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:35.806 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.223102+0000", 2024-04-19T03:02:35.806 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:35.806 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.806 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.806 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:35.806 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.223156+0000", 2024-04-19T03:02:35.806 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3958000000000001e-05 2024-04-19T03:02:35.806 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.806 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.806 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:35.807 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.223166+0000", 2024-04-19T03:02:35.807 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.4809999999999995e-06 2024-04-19T03:02:35.807 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.807 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.807 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:35.807 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.223172+0000", 2024-04-19T03:02:35.807 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0140000000000004e-06 2024-04-19T03:02:35.807 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.807 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.807 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:35.807 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.227295+0000", 2024-04-19T03:02:35.807 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0041233420000000003 2024-04-19T03:02:35.807 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.807 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.807 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:35.807 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.227495+0000", 2024-04-19T03:02:35.808 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00019955299999999999 2024-04-19T03:02:35.808 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.808 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.808 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:35.808 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.227717+0000", 2024-04-19T03:02:35.808 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000221902 2024-04-19T03:02:35.808 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.808 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.808 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:35.808 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233189+0000", 2024-04-19T03:02:35.808 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0054718889999999997 2024-04-19T03:02:35.808 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.808 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.808 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:35.809 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.250529+0000", 2024-04-19T03:02:35.809 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.017340298000000001 2024-04-19T03:02:35.809 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.809 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.809 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:02:35.809 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.250539+0000", 2024-04-19T03:02:35.809 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0501e-05 2024-04-19T03:02:35.809 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.809 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.809 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:35.809 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.268003+0000", 2024-04-19T03:02:35.809 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.017463429 2024-04-19T03:02:35.809 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.809 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.809 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:35.810 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.268050+0000", 2024-04-19T03:02:35.810 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7466000000000003e-05 2024-04-19T03:02:35.810 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:35.810 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:35.810 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:35.810 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.810 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.810 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87118 5.b 5:d1bb4f3c:::benchmark_data_smithi096_19531_object87117:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:35.810 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.231082+0000", 2024-04-19T03:02:35.810 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 12.478685393999999, 2024-04-19T03:02:35.810 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.035789004, 2024-04-19T03:02:35.810 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:35.810 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-19T03:02:35.811 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:35.811 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:35.811 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:35.811 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87118 2024-04-19T03:02:35.811 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.811 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:35.811 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.811 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:35.811 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231082+0000", 2024-04-19T03:02:35.811 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:35.811 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.811 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.811 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:35.811 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231082+0000", 2024-04-19T03:02:35.812 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:35.812 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.812 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.812 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:35.812 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231081+0000", 2024-04-19T03:02:35.812 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:35.812 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.812 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.812 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:35.812 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231159+0000", 2024-04-19T03:02:35.812 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.7819999999999997e-05 2024-04-19T03:02:35.812 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.812 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.812 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:35.812 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231186+0000", 2024-04-19T03:02:35.812 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7126000000000001e-05 2024-04-19T03:02:35.812 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.813 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.813 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:35.813 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231193+0000", 2024-04-19T03:02:35.813 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7259999999999996e-06 2024-04-19T03:02:35.813 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.813 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.813 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:35.813 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231241+0000", 2024-04-19T03:02:35.813 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8123e-05 2024-04-19T03:02:35.813 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.813 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.813 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:35.813 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231354+0000", 2024-04-19T03:02:35.813 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0001133 2024-04-19T03:02:35.814 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.814 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.814 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:35.814 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231443+0000", 2024-04-19T03:02:35.814 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9167999999999997e-05 2024-04-19T03:02:35.814 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.814 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.814 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:35.814 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236498+0000", 2024-04-19T03:02:35.814 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0050545160000000002 2024-04-19T03:02:35.814 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.814 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.815 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:35.815 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.249681+0000", 2024-04-19T03:02:35.815 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013183321 2024-04-19T03:02:35.815 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.815 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.815 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:02:35.815 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.249693+0000", 2024-04-19T03:02:35.815 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1834999999999999e-05 2024-04-19T03:02:35.815 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.815 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.816 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:35.816 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266733+0000", 2024-04-19T03:02:35.816 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.017040408 2024-04-19T03:02:35.816 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.816 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.816 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:35.816 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266871+0000", 2024-04-19T03:02:35.816 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000137849 2024-04-19T03:02:35.816 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:35.816 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:35.816 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:35.816 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.816 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.817 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87121 5.b 5:d01822b8:::benchmark_data_smithi096_19531_object87120:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:35.817 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.233319+0000", 2024-04-19T03:02:35.817 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 12.476448530000001, 2024-04-19T03:02:35.817 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.033624198, 2024-04-19T03:02:35.817 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:35.817 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-19T03:02:35.817 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:35.817 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:35.817 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:35.817 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87121 2024-04-19T03:02:35.817 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.817 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:35.818 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.818 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:35.818 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233319+0000", 2024-04-19T03:02:35.818 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:35.818 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.818 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.818 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:35.818 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233319+0000", 2024-04-19T03:02:35.818 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:35.818 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.818 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.818 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:35.819 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233319+0000", 2024-04-19T03:02:35.819 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:35.819 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.819 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.819 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:35.819 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233364+0000", 2024-04-19T03:02:35.819 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5460999999999997e-05 2024-04-19T03:02:35.819 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.819 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.819 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:35.819 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233382+0000", 2024-04-19T03:02:35.819 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8148e-05 2024-04-19T03:02:35.819 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.819 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.820 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:35.820 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233390+0000", 2024-04-19T03:02:35.820 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5340000000000002e-06 2024-04-19T03:02:35.820 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.820 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.820 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:35.820 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233712+0000", 2024-04-19T03:02:35.820 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00032260500000000001 2024-04-19T03:02:35.820 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.820 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.820 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:35.820 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233829+0000", 2024-04-19T03:02:35.820 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011638599999999999 2024-04-19T03:02:35.820 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.821 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.821 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:35.821 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233959+0000", 2024-04-19T03:02:35.821 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013013900000000001 2024-04-19T03:02:35.821 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.821 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.821 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:35.821 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236515+0000", 2024-04-19T03:02:35.821 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0025562750000000002 2024-04-19T03:02:35.821 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.821 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.821 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:35.821 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.249723+0000", 2024-04-19T03:02:35.821 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013208176 2024-04-19T03:02:35.822 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.822 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.822 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:02:35.822 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.249728+0000", 2024-04-19T03:02:35.822 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6519999999999997e-06 2024-04-19T03:02:35.822 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.822 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.822 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:35.822 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266837+0000", 2024-04-19T03:02:35.823 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0171087059999999 2024-04-19T03:02:35.823 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.823 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.823 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:35.823 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266943+0000", 2024-04-19T03:02:35.823 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000106604 2024-04-19T03:02:35.823 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:35.823 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:35.824 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:35.824 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.824 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.824 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87124 5.8 5:14819ad7:::benchmark_data_smithi096_19531_object87123:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:35.824 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.235886+0000", 2024-04-19T03:02:35.824 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 12.473881106, 2024-04-19T03:02:35.824 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0315451179999999, 2024-04-19T03:02:35.824 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:35.824 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-19T03:02:35.825 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:35.825 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:35.825 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:35.825 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87124 2024-04-19T03:02:35.825 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.825 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:35.825 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.826 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:35.826 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.235886+0000", 2024-04-19T03:02:35.826 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:35.826 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.826 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.826 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:35.826 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.235886+0000", 2024-04-19T03:02:35.827 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:35.827 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.827 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.827 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:35.827 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.235886+0000", 2024-04-19T03:02:35.827 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:35.828 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.828 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.828 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:35.828 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.235934+0000", 2024-04-19T03:02:35.828 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8384000000000003e-05 2024-04-19T03:02:35.828 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.828 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.829 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:35.829 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.235945+0000", 2024-04-19T03:02:35.829 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0671e-05 2024-04-19T03:02:35.829 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.829 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.829 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:35.829 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.235952+0000", 2024-04-19T03:02:35.830 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3089999999999998e-06 2024-04-19T03:02:35.830 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.830 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.830 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:35.830 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.237067+0000", 2024-04-19T03:02:35.830 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001115263 2024-04-19T03:02:35.830 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.830 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.831 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:35.831 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.237188+0000", 2024-04-19T03:02:35.831 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000121258 2024-04-19T03:02:35.831 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.831 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.831 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:35.831 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.237316+0000", 2024-04-19T03:02:35.832 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000128071 2024-04-19T03:02:35.832 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.832 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.832 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:35.832 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240744+0000", 2024-04-19T03:02:35.832 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0034275629999999998 2024-04-19T03:02:35.833 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.833 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.833 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:35.833 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.252517+0000", 2024-04-19T03:02:35.833 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011772991999999999 2024-04-19T03:02:35.833 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.833 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.834 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:02:35.834 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.252523+0000", 2024-04-19T03:02:35.834 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3640000000000004e-06 2024-04-19T03:02:35.834 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.834 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.834 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:35.834 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.267290+0000", 2024-04-19T03:02:35.834 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0147665690000001 2024-04-19T03:02:35.834 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.835 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.835 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:35.835 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.267432+0000", 2024-04-19T03:02:35.835 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014165299999999999 2024-04-19T03:02:35.835 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:35.835 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:35.835 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:35.835 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.835 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.835 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87129 5.0 5:02667e01:::benchmark_data_smithi096_19531_object87128:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:35.835 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.236466+0000", 2024-04-19T03:02:35.835 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 12.47330111, 2024-04-19T03:02:35.835 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0301534510000001, 2024-04-19T03:02:35.835 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:35.836 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-19T03:02:35.836 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:35.836 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:35.836 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:35.836 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87129 2024-04-19T03:02:35.836 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.836 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:35.836 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.836 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:35.836 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236466+0000", 2024-04-19T03:02:35.836 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:35.836 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.836 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.836 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:35.837 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236466+0000", 2024-04-19T03:02:35.837 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:35.837 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.837 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.837 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:35.837 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236465+0000", 2024-04-19T03:02:35.837 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:35.837 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.837 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.837 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:35.837 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236566+0000", 2024-04-19T03:02:35.837 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010047000000000001 2024-04-19T03:02:35.837 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.837 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.837 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:35.838 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236577+0000", 2024-04-19T03:02:35.838 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1772e-05 2024-04-19T03:02:35.838 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.838 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.838 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:35.838 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236584+0000", 2024-04-19T03:02:35.838 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0530000000000003e-06 2024-04-19T03:02:35.838 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.838 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.838 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:35.838 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.237023+0000", 2024-04-19T03:02:35.839 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000439703 2024-04-19T03:02:35.839 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.839 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.839 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:35.839 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.237207+0000", 2024-04-19T03:02:35.839 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000183692 2024-04-19T03:02:35.839 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.839 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.839 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:35.839 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.237373+0000", 2024-04-19T03:02:35.839 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016623500000000001 2024-04-19T03:02:35.839 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.839 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.839 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:35.840 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.241461+0000", 2024-04-19T03:02:35.840 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0040883050000000004 2024-04-19T03:02:35.840 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.840 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.840 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:35.840 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.252500+0000", 2024-04-19T03:02:35.840 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011038450999999999 2024-04-19T03:02:35.840 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.840 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.840 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:02:35.840 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.252507+0000", 2024-04-19T03:02:35.840 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2439999999999996e-06 2024-04-19T03:02:35.840 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.840 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.841 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:35.841 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266538+0000", 2024-04-19T03:02:35.841 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.014031184 2024-04-19T03:02:35.841 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.841 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.841 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:35.841 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266620+0000", 2024-04-19T03:02:35.841 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1600000000000005e-05 2024-04-19T03:02:35.841 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:35.841 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:35.841 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:35.841 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.841 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.841 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87135 5.4 5:2a97e7b7:::benchmark_data_smithi096_19531_object87134:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:35.841 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.240884+0000", 2024-04-19T03:02:35.842 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 12.468883653000001, 2024-04-19T03:02:35.842 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.025708931, 2024-04-19T03:02:35.842 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:35.842 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-19T03:02:35.842 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:35.842 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:35.842 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:35.842 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87135 2024-04-19T03:02:35.842 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.842 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:35.842 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.842 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:35.842 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240884+0000", 2024-04-19T03:02:35.843 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:35.843 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.843 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.843 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:35.843 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240884+0000", 2024-04-19T03:02:35.843 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:35.843 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.843 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.843 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:35.843 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240883+0000", 2024-04-19T03:02:35.843 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:35.843 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.843 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.843 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:35.843 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240933+0000", 2024-04-19T03:02:35.844 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9969999999999998e-05 2024-04-19T03:02:35.844 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.844 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.844 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:35.844 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240946+0000", 2024-04-19T03:02:35.844 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2943e-05 2024-04-19T03:02:35.844 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.844 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.844 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:35.844 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240952+0000", 2024-04-19T03:02:35.844 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8930000000000002e-06 2024-04-19T03:02:35.844 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.844 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.844 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:35.845 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240994+0000", 2024-04-19T03:02:35.845 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2753999999999998e-05 2024-04-19T03:02:35.845 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.845 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.845 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:35.845 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.241092+0000", 2024-04-19T03:02:35.845 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.7447000000000004e-05 2024-04-19T03:02:35.845 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.845 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.845 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:35.845 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.241183+0000", 2024-04-19T03:02:35.845 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1163999999999997e-05 2024-04-19T03:02:35.845 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.845 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.846 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:35.846 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.254672+0000", 2024-04-19T03:02:35.846 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.01348864 2024-04-19T03:02:35.846 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.846 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.846 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:02:35.846 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.254681+0000", 2024-04-19T03:02:35.846 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.3789999999999995e-06 2024-04-19T03:02:35.846 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.846 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.846 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:35.846 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266456+0000", 2024-04-19T03:02:35.846 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.011774621 2024-04-19T03:02:35.847 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.847 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.847 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:35.847 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266593+0000", 2024-04-19T03:02:35.847 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013737600000000001 2024-04-19T03:02:35.847 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:35.847 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:35.847 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:35.847 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.847 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.847 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87136 5.4 5:212411bc:::benchmark_data_smithi096_19531_object87135:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:35.847 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.240962+0000", 2024-04-19T03:02:35.847 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 12.468805777, 2024-04-19T03:02:35.847 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.025738, 2024-04-19T03:02:35.848 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:35.848 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-19T03:02:35.848 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:35.848 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:35.848 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:35.848 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87136 2024-04-19T03:02:35.848 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.848 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:35.848 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.848 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:35.848 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240962+0000", 2024-04-19T03:02:35.848 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:35.848 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.848 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.848 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:35.848 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240962+0000", 2024-04-19T03:02:35.849 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:35.849 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.849 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.849 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:35.849 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240961+0000", 2024-04-19T03:02:35.849 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:35.849 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.849 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.849 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:35.849 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240995+0000", 2024-04-19T03:02:35.849 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3868000000000002e-05 2024-04-19T03:02:35.849 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.849 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.849 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:35.850 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.241001+0000", 2024-04-19T03:02:35.850 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.322e-06 2024-04-19T03:02:35.850 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.850 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.850 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:35.850 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.241004+0000", 2024-04-19T03:02:35.850 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3510000000000002e-06 2024-04-19T03:02:35.850 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.850 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.850 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:35.850 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247131+0000", 2024-04-19T03:02:35.851 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0061270869999999998 2024-04-19T03:02:35.851 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.851 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.851 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:35.851 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247322+0000", 2024-04-19T03:02:35.851 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000191015 2024-04-19T03:02:35.851 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.852 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.852 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:35.852 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247542+0000", 2024-04-19T03:02:35.852 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00022030199999999999 2024-04-19T03:02:35.852 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.852 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.852 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:35.853 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.254709+0000", 2024-04-19T03:02:35.853 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0071662660000000001 2024-04-19T03:02:35.853 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.853 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.853 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:02:35.853 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.254716+0000", 2024-04-19T03:02:35.854 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3860000000000001e-06 2024-04-19T03:02:35.854 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.854 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.854 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:35.854 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266619+0000", 2024-04-19T03:02:35.854 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0119031030000001 2024-04-19T03:02:35.855 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.855 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.855 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:35.855 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266700+0000", 2024-04-19T03:02:35.855 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0764000000000001e-05 2024-04-19T03:02:35.855 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:35.856 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:35.856 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:35.856 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.856 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.856 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87138 5.e 5:7b1f1c20:::benchmark_data_smithi096_19531_object87137:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:35.856 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.247862+0000", 2024-04-19T03:02:35.856 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 12.461905702999999, 2024-04-19T03:02:35.857 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.024457079, 2024-04-19T03:02:35.857 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:35.857 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:35.857 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:35.857 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:35.857 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:35.857 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87138 2024-04-19T03:02:35.857 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.858 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:35.858 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.858 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:35.858 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247862+0000", 2024-04-19T03:02:35.858 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:35.858 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.858 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.859 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:35.859 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247862+0000", 2024-04-19T03:02:35.859 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:35.859 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.859 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.860 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:35.860 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247860+0000", 2024-04-19T03:02:35.860 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999981 2024-04-19T03:02:35.860 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.860 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.860 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:35.861 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247909+0000", 2024-04-19T03:02:35.861 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9150999999999997e-05 2024-04-19T03:02:35.861 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.861 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.861 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:35.861 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247925+0000", 2024-04-19T03:02:35.861 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5761999999999999e-05 2024-04-19T03:02:35.862 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.862 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.862 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:35.862 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247936+0000", 2024-04-19T03:02:35.862 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1144e-05 2024-04-19T03:02:35.862 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.862 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.862 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:35.862 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.250590+0000", 2024-04-19T03:02:35.863 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.002653678 2024-04-19T03:02:35.863 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.863 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.863 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:02:35.863 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.250599+0000", 2024-04-19T03:02:35.863 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9039999999999998e-06 2024-04-19T03:02:35.863 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.863 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.863 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:35.864 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.268151+0000", 2024-04-19T03:02:35.864 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0175523449999999 2024-04-19T03:02:35.864 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.864 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.864 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:35.864 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.268285+0000", 2024-04-19T03:02:35.864 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013415599999999999 2024-04-19T03:02:35.864 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.865 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.865 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:35.865 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.272238+0000", 2024-04-19T03:02:35.865 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0039533019999999997 2024-04-19T03:02:35.865 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.865 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.865 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:35.865 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.272274+0000", 2024-04-19T03:02:35.865 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5352000000000003e-05 2024-04-19T03:02:35.866 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:35.866 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:35.866 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:35.866 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.272319+0000", 2024-04-19T03:02:35.866 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5281999999999998e-05 2024-04-19T03:02:35.866 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:35.866 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:35.866 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:35.867 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:35.867 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:35.867 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-19T03:02:35.868 INFO:tasks.radosbench.radosbench.0.smithi096.stdout: 58 16 109546 109530 118.014 123.688 0.0104345 0.00846784 2024-04-19T03:02:35.869 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T03:02:35.870 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:35.867+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:35.969 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:35.967+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:35.998 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-04-19T03:02:35.998 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [ 2024-04-19T03:02:35.998 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:35.998 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:109869 5.2 5:4e623983:::benchmark_data_smithi096_19531_object109868:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-04-19T03:02:35.998 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:35.985443+0000", 2024-04-19T03:02:35.998 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.010232837999999999, 2024-04-19T03:02:35.998 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.010257110999999999, 2024-04-19T03:02:35.998 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:35.999 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-04-19T03:02:35.999 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:35.999 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:35.999 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:35.999 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 109869 2024-04-19T03:02:35.999 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:35.999 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:35.999 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:35.999 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:35.999 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:35.985443+0000", 2024-04-19T03:02:35.999 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:35.999 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:35.999 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.000 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:36.000 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:35.985443+0000", 2024-04-19T03:02:36.000 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:36.000 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.000 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.000 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:36.000 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:35.985442+0000", 2024-04-19T03:02:36.000 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:36.000 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.000 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.000 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:36.000 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:35.985476+0000", 2024-04-19T03:02:36.000 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3442999999999998e-05 2024-04-19T03:02:36.000 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.001 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.001 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:36.001 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:35.985484+0000", 2024-04-19T03:02:36.001 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6170000000000007e-06 2024-04-19T03:02:36.001 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.001 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.001 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:36.001 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:35.985492+0000", 2024-04-19T03:02:36.001 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.1949999999999997e-06 2024-04-19T03:02:36.001 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.001 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.001 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:36.001 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:35.992653+0000", 2024-04-19T03:02:36.001 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0071609489999999998 2024-04-19T03:02:36.001 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.001 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.002 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:36.002 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:35.992728+0000", 2024-04-19T03:02:36.002 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5486000000000002e-05 2024-04-19T03:02:36.002 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:36.002 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:36.002 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:36.002 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.002 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.002 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:109875 5.f 5:f32b2216:::benchmark_data_smithi096_19531_object109874:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-04-19T03:02:36.002 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:35.988690+0000", 2024-04-19T03:02:36.002 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0069863879999999996, 2024-04-19T03:02:36.002 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0070864880000000002, 2024-04-19T03:02:36.002 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:36.002 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:02:36.003 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:36.003 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:36.003 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:36.003 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 109875 2024-04-19T03:02:36.003 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.003 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:36.003 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.003 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:36.003 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:35.988690+0000", 2024-04-19T03:02:36.003 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:36.003 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.003 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.003 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:36.004 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:35.988690+0000", 2024-04-19T03:02:36.004 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:36.004 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.004 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.004 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:36.004 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:35.988689+0000", 2024-04-19T03:02:36.004 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:36.004 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.004 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.004 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:36.004 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:35.988769+0000", 2024-04-19T03:02:36.004 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0463999999999994e-05 2024-04-19T03:02:36.004 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.004 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.005 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:36.005 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:35.988790+0000", 2024-04-19T03:02:36.005 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.0982999999999999e-05 2024-04-19T03:02:36.005 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.005 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.005 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:36.005 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:35.988797+0000", 2024-04-19T03:02:36.005 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0180000000000004e-06 2024-04-19T03:02:36.005 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.005 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.005 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:36.005 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:35.991098+0000", 2024-04-19T03:02:36.006 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.002301034 2024-04-19T03:02:36.006 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.006 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.006 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:36.006 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:35.991238+0000", 2024-04-19T03:02:36.006 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000139894 2024-04-19T03:02:36.006 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.006 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.007 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:02:36.007 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:35.991383+0000", 2024-04-19T03:02:36.007 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00014499900000000001 2024-04-19T03:02:36.007 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:36.007 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:36.007 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:36.007 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.007 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.007 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:109876 5.7 5:ea9074aa:::benchmark_data_smithi096_19531_object109875:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-04-19T03:02:36.007 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:35.988804+0000", 2024-04-19T03:02:36.007 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0068718929999999996, 2024-04-19T03:02:36.007 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0070414459999999998, 2024-04-19T03:02:36.007 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:36.008 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-04-19T03:02:36.008 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:36.008 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:36.008 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:36.008 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 109876 2024-04-19T03:02:36.008 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.008 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:36.008 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.008 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:36.008 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:35.988804+0000", 2024-04-19T03:02:36.008 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:36.008 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.009 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.009 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:36.009 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:35.988804+0000", 2024-04-19T03:02:36.009 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:36.009 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.009 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.009 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:36.009 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:35.988804+0000", 2024-04-19T03:02:36.009 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:36.009 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.009 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.009 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:36.009 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:35.988841+0000", 2024-04-19T03:02:36.010 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6999000000000003e-05 2024-04-19T03:02:36.010 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.010 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.010 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:36.010 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:35.988857+0000", 2024-04-19T03:02:36.010 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6169000000000001e-05 2024-04-19T03:02:36.010 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.010 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.010 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:36.010 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:35.988875+0000", 2024-04-19T03:02:36.010 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8541000000000001e-05 2024-04-19T03:02:36.010 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.011 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.011 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:36.011 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:35.991093+0000", 2024-04-19T03:02:36.011 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0022174629999999998 2024-04-19T03:02:36.011 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.011 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.011 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:36.011 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:35.991282+0000", 2024-04-19T03:02:36.011 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000189631 2024-04-19T03:02:36.011 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:36.011 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:36.011 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:36.011 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.011 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.012 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:109879 5.1 5:81d40356:::benchmark_data_smithi096_19531_object109878:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-04-19T03:02:36.012 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:35.991189+0000", 2024-04-19T03:02:36.012 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0044866589999999996, 2024-04-19T03:02:36.012 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0047191589999999997, 2024-04-19T03:02:36.012 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:36.012 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-04-19T03:02:36.012 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:36.012 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:36.012 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:36.012 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 109879 2024-04-19T03:02:36.012 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.012 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:36.012 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.012 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:36.012 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:35.991189+0000", 2024-04-19T03:02:36.013 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:36.013 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.013 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.013 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:36.013 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:35.991189+0000", 2024-04-19T03:02:36.013 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:36.013 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.013 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.013 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:36.013 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:35.991188+0000", 2024-04-19T03:02:36.013 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:36.013 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.013 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.013 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:36.013 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:35.991247+0000", 2024-04-19T03:02:36.014 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8836999999999999e-05 2024-04-19T03:02:36.014 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.014 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.014 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:36.014 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:35.991256+0000", 2024-04-19T03:02:36.014 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.5570000000000001e-06 2024-04-19T03:02:36.014 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.014 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.014 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:36.014 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:35.991264+0000", 2024-04-19T03:02:36.014 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.1770000000000001e-06 2024-04-19T03:02:36.014 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.014 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.014 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:36.014 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:35.991310+0000", 2024-04-19T03:02:36.015 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5859000000000003e-05 2024-04-19T03:02:36.015 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.015 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.015 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:36.015 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:35.991522+0000", 2024-04-19T03:02:36.015 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000212797 2024-04-19T03:02:36.015 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:36.015 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:36.015 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:36.015 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.015 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.015 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:109880 5.9 5:9f19ff92:::benchmark_data_smithi096_19531_object109879:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-04-19T03:02:36.015 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:35.991368+0000", 2024-04-19T03:02:36.015 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0043080929999999998, 2024-04-19T03:02:36.016 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0046012600000000002, 2024-04-19T03:02:36.016 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:36.016 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:02:36.016 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:36.016 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:36.016 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:36.016 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 109880 2024-04-19T03:02:36.016 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.016 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:36.016 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.016 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:36.017 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:35.991368+0000", 2024-04-19T03:02:36.017 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:36.017 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.017 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.017 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:36.017 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:35.991368+0000", 2024-04-19T03:02:36.017 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:36.017 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.017 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.018 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:36.018 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:35.991367+0000", 2024-04-19T03:02:36.018 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:36.018 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.018 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.018 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:36.018 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:35.991442+0000", 2024-04-19T03:02:36.018 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5047000000000002e-05 2024-04-19T03:02:36.018 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.018 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.018 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:36.018 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:35.991461+0000", 2024-04-19T03:02:36.019 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8576999999999998e-05 2024-04-19T03:02:36.019 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.019 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.019 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:36.019 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:35.991468+0000", 2024-04-19T03:02:36.019 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2409999999999998e-06 2024-04-19T03:02:36.019 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.019 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.019 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:36.019 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:35.993659+0000", 2024-04-19T03:02:36.019 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0021912559999999999 2024-04-19T03:02:36.019 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.019 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.019 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:36.019 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:35.993743+0000", 2024-04-19T03:02:36.020 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.3473999999999994e-05 2024-04-19T03:02:36.020 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.020 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.020 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:02:36.020 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:35.993816+0000", 2024-04-19T03:02:36.020 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.3079999999999998e-05 2024-04-19T03:02:36.020 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:36.020 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:36.020 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:36.020 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.020 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.020 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:109882 5.9 5.39bc7779 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-04-19T03:02:36.020 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:35.991475+0000", 2024-04-19T03:02:36.020 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0042008180000000003, 2024-04-19T03:02:36.020 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.004554443, 2024-04-19T03:02:36.020 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:36.021 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-04-19T03:02:36.021 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:36.021 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:36.021 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:36.021 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 109882 2024-04-19T03:02:36.021 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.021 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:36.021 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.021 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:36.021 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:35.991475+0000", 2024-04-19T03:02:36.021 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:36.021 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.021 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.021 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:36.021 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:35.991475+0000", 2024-04-19T03:02:36.021 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:36.022 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.022 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.022 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:36.022 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:35.991475+0000", 2024-04-19T03:02:36.022 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:36.022 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.022 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.022 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:36.022 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:35.991517+0000", 2024-04-19T03:02:36.022 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2766999999999999e-05 2024-04-19T03:02:36.022 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.022 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.023 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:36.023 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:35.991537+0000", 2024-04-19T03:02:36.023 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9888999999999999e-05 2024-04-19T03:02:36.023 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.023 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.023 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:36.023 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:35.991544+0000", 2024-04-19T03:02:36.023 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5060000000000001e-06 2024-04-19T03:02:36.023 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:36.023 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:36.023 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:36.023 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.023 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.023 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:109883 5.f 5:fd835275:::benchmark_data_smithi096_19531_object109882:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-04-19T03:02:36.023 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:35.991855+0000", 2024-04-19T03:02:36.023 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0038211809999999999, 2024-04-19T03:02:36.024 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0042246660000000002, 2024-04-19T03:02:36.024 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:36.024 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:02:36.024 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:36.024 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:36.024 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:36.024 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 109883 2024-04-19T03:02:36.024 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.024 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:36.024 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.024 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:36.024 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:35.991855+0000", 2024-04-19T03:02:36.024 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:36.024 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.024 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.024 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:36.024 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:35.991855+0000", 2024-04-19T03:02:36.025 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:36.025 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.025 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.025 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:36.025 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:35.991854+0000", 2024-04-19T03:02:36.025 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:36.025 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.025 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.025 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:36.025 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:35.991935+0000", 2024-04-19T03:02:36.025 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.1508000000000006e-05 2024-04-19T03:02:36.025 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.025 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.025 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:36.025 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:35.991947+0000", 2024-04-19T03:02:36.025 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2009e-05 2024-04-19T03:02:36.026 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.026 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.026 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:36.026 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:35.991954+0000", 2024-04-19T03:02:36.026 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.9870000000000002e-06 2024-04-19T03:02:36.026 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.026 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.026 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:36.026 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:35.993952+0000", 2024-04-19T03:02:36.026 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0019975029999999999 2024-04-19T03:02:36.026 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.026 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.026 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:36.026 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:35.994071+0000", 2024-04-19T03:02:36.026 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000119418 2024-04-19T03:02:36.027 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.027 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.027 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:02:36.027 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:35.994160+0000", 2024-04-19T03:02:36.027 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.8911000000000003e-05 2024-04-19T03:02:36.027 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:36.027 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:36.027 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:36.027 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.027 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.028 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop_reply(client.4755.0:109875 5.f e47/22)", 2024-04-19T03:02:36.028 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:35.994295+0000", 2024-04-19T03:02:36.028 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.001381141, 2024-04-19T03:02:36.028 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001845574, 2024-04-19T03:02:36.028 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:36.028 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-04-19T03:02:36.028 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:36.028 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.028 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:36.028 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:35.994295+0000", 2024-04-19T03:02:36.028 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:36.028 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.029 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.029 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:36.029 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:35.994295+0000", 2024-04-19T03:02:36.029 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:36.029 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.029 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.029 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:36.029 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:35.994294+0000", 2024-04-19T03:02:36.029 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:36.029 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.029 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.029 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:36.029 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:35.994300+0000", 2024-04-19T03:02:36.029 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6319999999999996e-06 2024-04-19T03:02:36.030 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.030 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.030 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:36.030 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:35.994309+0000", 2024-04-19T03:02:36.030 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.6930000000000002e-06 2024-04-19T03:02:36.030 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.030 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.030 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:36.030 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:35.994316+0000", 2024-04-19T03:02:36.030 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5350000000000001e-06 2024-04-19T03:02:36.030 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:36.030 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:36.030 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:36.030 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.031 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.031 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:109885 5.1 5.e4c49d1 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-04-19T03:02:36.031 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:35.994269+0000", 2024-04-19T03:02:36.031 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0014067680000000001, 2024-04-19T03:02:36.031 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0019125730000000001, 2024-04-19T03:02:36.031 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:36.031 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-04-19T03:02:36.031 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:36.031 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:36.031 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:36.031 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 109885 2024-04-19T03:02:36.031 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.031 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:36.031 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.031 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:36.032 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:35.994269+0000", 2024-04-19T03:02:36.032 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:36.032 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.032 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.032 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:36.032 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:35.994269+0000", 2024-04-19T03:02:36.032 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:36.032 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.032 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.032 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:36.032 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:35.994268+0000", 2024-04-19T03:02:36.032 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:36.032 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.032 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.032 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:36.032 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:35.994316+0000", 2024-04-19T03:02:36.033 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8233999999999999e-05 2024-04-19T03:02:36.033 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.033 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.033 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:36.033 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:35.994327+0000", 2024-04-19T03:02:36.033 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0254e-05 2024-04-19T03:02:36.033 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.033 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.033 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:36.033 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:35.994334+0000", 2024-04-19T03:02:36.033 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.1359999999999999e-06 2024-04-19T03:02:36.033 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:36.033 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:36.033 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:36.033 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.034 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.034 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:109886 5.f 5.ef5a829f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-04-19T03:02:36.034 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:35.995054+0000", 2024-04-19T03:02:36.034 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.00062191299999999998, 2024-04-19T03:02:36.034 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001174072, 2024-04-19T03:02:36.034 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:36.034 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-04-19T03:02:36.034 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:36.034 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:36.034 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:36.034 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 109886 2024-04-19T03:02:36.034 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.034 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:36.034 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.035 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:36.035 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:35.995054+0000", 2024-04-19T03:02:36.035 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:36.035 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.035 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.035 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:36.035 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:35.995054+0000", 2024-04-19T03:02:36.035 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:36.035 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.035 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.035 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:36.035 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:35.995053+0000", 2024-04-19T03:02:36.035 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:36.035 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.036 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.036 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:36.036 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:35.995107+0000", 2024-04-19T03:02:36.036 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4376999999999998e-05 2024-04-19T03:02:36.036 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.036 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.036 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:36.036 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:35.995124+0000", 2024-04-19T03:02:36.036 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6433999999999999e-05 2024-04-19T03:02:36.036 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.036 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.036 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:36.036 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:35.995132+0000", 2024-04-19T03:02:36.037 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.1070000000000005e-06 2024-04-19T03:02:36.037 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.037 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.037 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:36.037 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:35.996219+0000", 2024-04-19T03:02:36.037 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001087492 2024-04-19T03:02:36.037 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:36.037 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:36.037 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:36.037 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.037 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.037 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:109888 5.7 5:e782145a:::benchmark_data_smithi096_19531_object109887:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-04-19T03:02:36.038 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:35.995246+0000", 2024-04-19T03:02:36.038 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.00042973300000000001, 2024-04-19T03:02:36.038 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0010394670000000001, 2024-04-19T03:02:36.038 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:36.038 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-04-19T03:02:36.038 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:36.039 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:36.039 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:36.039 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 109888 2024-04-19T03:02:36.039 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.039 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:36.039 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.039 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:36.039 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:35.995246+0000", 2024-04-19T03:02:36.039 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:36.039 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.039 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.039 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:36.040 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:35.995246+0000", 2024-04-19T03:02:36.040 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:36.040 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.040 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.040 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:36.040 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:35.995245+0000", 2024-04-19T03:02:36.040 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:36.040 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.040 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.040 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:36.040 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:35.995323+0000", 2024-04-19T03:02:36.040 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7200000000000006e-05 2024-04-19T03:02:36.040 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.040 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.041 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:36.041 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:35.995336+0000", 2024-04-19T03:02:36.041 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3668e-05 2024-04-19T03:02:36.041 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.041 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.041 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:36.041 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:35.995343+0000", 2024-04-19T03:02:36.041 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.092e-06 2024-04-19T03:02:36.041 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.041 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.041 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:36.041 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:35.996238+0000", 2024-04-19T03:02:36.041 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000894286 2024-04-19T03:02:36.041 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:36.041 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:36.041 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:36.042 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.042 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.042 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:109889 5.3 5:c14ef5ee:::benchmark_data_smithi096_19531_object109888:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2024-04-19T03:02:36.042 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:35.995350+0000", 2024-04-19T03:02:36.042 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.00032597600000000001, 2024-04-19T03:02:36.042 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00098890799999999993, 2024-04-19T03:02:36.042 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:36.042 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-04-19T03:02:36.042 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:36.042 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:36.042 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:36.042 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 109889 2024-04-19T03:02:36.042 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.043 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:36.043 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.043 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:36.043 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:35.995350+0000", 2024-04-19T03:02:36.043 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:36.043 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.043 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.043 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:36.043 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:35.995350+0000", 2024-04-19T03:02:36.043 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:36.043 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.043 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.043 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:36.044 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:35.995349+0000", 2024-04-19T03:02:36.044 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:36.044 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.044 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.044 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:36.044 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:35.995384+0000", 2024-04-19T03:02:36.044 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4563000000000001e-05 2024-04-19T03:02:36.044 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.044 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.044 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:36.044 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:35.995395+0000", 2024-04-19T03:02:36.044 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1175999999999999e-05 2024-04-19T03:02:36.045 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.045 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.045 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:36.045 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:35.995401+0000", 2024-04-19T03:02:36.045 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7169999999999996e-06 2024-04-19T03:02:36.045 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.045 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.045 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:36.045 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:35.995446+0000", 2024-04-19T03:02:36.045 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5016999999999999e-05 2024-04-19T03:02:36.045 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.045 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.045 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:36.046 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:35.995537+0000", 2024-04-19T03:02:36.046 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.1457000000000002e-05 2024-04-19T03:02:36.046 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:36.046 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:36.046 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:36.046 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.046 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.046 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4755.0:109887 5.d e47/22 5:bdc20e35:::benchmark_data_smithi096_19531_object109886:head v 47'6955, mlcod=47'6953)", 2024-04-19T03:02:36.046 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:35.995648+0000", 2024-04-19T03:02:36.046 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 2.8153999999999998e-05, 2024-04-19T03:02:36.046 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00074677900000000004, 2024-04-19T03:02:36.047 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:36.047 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-04-19T03:02:36.047 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:36.047 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.047 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:36.047 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:35.995648+0000", 2024-04-19T03:02:36.047 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:36.047 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.047 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.047 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:36.047 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:35.995648+0000", 2024-04-19T03:02:36.047 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:36.047 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.048 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.048 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:36.048 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:35.995647+0000", 2024-04-19T03:02:36.048 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:36.048 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.048 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.048 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:36.048 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:35.995782+0000", 2024-04-19T03:02:36.048 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000134506 2024-04-19T03:02:36.048 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.048 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.048 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:36.049 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:35.995791+0000", 2024-04-19T03:02:36.049 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.6220000000000004e-06 2024-04-19T03:02:36.049 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.049 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.049 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:36.049 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:35.995798+0000", 2024-04-19T03:02:36.049 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.353e-06 2024-04-19T03:02:36.049 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.049 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.049 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:36.049 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:35.995840+0000", 2024-04-19T03:02:36.049 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2268000000000003e-05 2024-04-19T03:02:36.049 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.050 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.050 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:36.050 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:35.995856+0000", 2024-04-19T03:02:36.050 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6317999999999999e-05 2024-04-19T03:02:36.050 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:36.050 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:36.050 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:36.050 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:36.050 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-04-19T03:02:36.050 INFO:teuthology.orchestra.run.smithi144.stdout: "num_ops": 13 2024-04-19T03:02:36.050 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-04-19T03:02:36.051 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T03:02:36.070 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:36.067+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:36.171 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:36.167+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:36.184 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-04-19T03:02:36.184 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2024-04-19T03:02:36.184 INFO:teuthology.orchestra.run.smithi144.stdout: "complaint_time": 30, 2024-04-19T03:02:36.184 INFO:teuthology.orchestra.run.smithi144.stdout: "num_blocked_ops": 0 2024-04-19T03:02:36.184 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-04-19T03:02:36.196 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T03:02:36.272 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:36.269+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:36.324 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-04-19T03:02:36.325 INFO:teuthology.orchestra.run.smithi144.stdout: "size": 20, 2024-04-19T03:02:36.325 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 600, 2024-04-19T03:02:36.325 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [ 2024-04-19T03:02:36.325 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.325 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:78992 5.7 5:e6baa862:::benchmark_data_smithi096_19531_object78991:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-19T03:02:36.325 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:18.008888+0000", 2024-04-19T03:02:36.325 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 18.313678218, 2024-04-19T03:02:36.325 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.056375285999999997, 2024-04-19T03:02:36.325 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:36.325 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:36.325 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:36.325 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:36.325 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:36.326 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 78992 2024-04-19T03:02:36.326 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.326 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:36.326 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.326 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:36.326 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.008888+0000", 2024-04-19T03:02:36.326 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:36.326 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.326 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.326 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:36.326 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.008888+0000", 2024-04-19T03:02:36.326 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:36.326 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.327 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.327 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:36.327 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.008888+0000", 2024-04-19T03:02:36.327 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:36.327 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.327 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.327 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:36.327 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.008928+0000", 2024-04-19T03:02:36.327 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0361999999999997e-05 2024-04-19T03:02:36.327 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.327 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.327 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:36.327 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.008942+0000", 2024-04-19T03:02:36.327 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4365000000000001e-05 2024-04-19T03:02:36.328 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.328 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.328 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:36.328 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.008949+0000", 2024-04-19T03:02:36.328 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.212e-06 2024-04-19T03:02:36.328 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.328 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.328 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:36.328 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.012683+0000", 2024-04-19T03:02:36.328 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.003733934 2024-04-19T03:02:36.328 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.328 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.328 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:36.328 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.012798+0000", 2024-04-19T03:02:36.329 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00011574999999999999 2024-04-19T03:02:36.329 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.329 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.329 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:36.329 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.012896+0000", 2024-04-19T03:02:36.329 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.7848000000000002e-05 2024-04-19T03:02:36.329 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.329 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.329 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:36.329 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016423+0000", 2024-04-19T03:02:36.329 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0035270789999999998 2024-04-19T03:02:36.329 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.329 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.329 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:36.330 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.065098+0000", 2024-04-19T03:02:36.330 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.048674651999999999 2024-04-19T03:02:36.330 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.330 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.330 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:36.330 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.065193+0000", 2024-04-19T03:02:36.330 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.5087999999999995e-05 2024-04-19T03:02:36.330 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.330 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.330 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:36.330 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.065264+0000", 2024-04-19T03:02:36.330 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0666000000000004e-05 2024-04-19T03:02:36.330 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:36.330 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:36.331 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:36.331 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.331 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.331 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:78998 5.7 5:ee23c1bc:::benchmark_data_smithi096_19531_object78997:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-19T03:02:36.331 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:18.013165+0000", 2024-04-19T03:02:36.331 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 18.309401512000001, 2024-04-19T03:02:36.331 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.052410864000000001, 2024-04-19T03:02:36.331 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:36.331 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:36.331 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:36.331 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:36.331 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:36.331 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 78998 2024-04-19T03:02:36.331 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.332 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:36.332 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.332 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:36.332 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.013165+0000", 2024-04-19T03:02:36.332 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:36.332 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.332 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.332 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:36.332 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.013165+0000", 2024-04-19T03:02:36.332 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:36.332 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.332 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.332 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:36.332 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.013164+0000", 2024-04-19T03:02:36.333 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:36.333 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.333 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.333 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:36.333 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.013214+0000", 2024-04-19T03:02:36.333 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9636999999999999e-05 2024-04-19T03:02:36.333 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.333 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.333 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:36.333 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.013223+0000", 2024-04-19T03:02:36.333 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.3619999999999995e-06 2024-04-19T03:02:36.333 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.333 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.333 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:36.334 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.013229+0000", 2024-04-19T03:02:36.334 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6060000000000002e-06 2024-04-19T03:02:36.334 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.334 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.334 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:36.334 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.014882+0000", 2024-04-19T03:02:36.334 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001653257 2024-04-19T03:02:36.334 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.334 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.334 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:36.334 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.014958+0000", 2024-04-19T03:02:36.334 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6398999999999998e-05 2024-04-19T03:02:36.334 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.335 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.335 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:36.335 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.015036+0000", 2024-04-19T03:02:36.335 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8070000000000003e-05 2024-04-19T03:02:36.335 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.335 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.335 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:36.335 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018099+0000", 2024-04-19T03:02:36.335 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0030631149999999999 2024-04-19T03:02:36.335 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.335 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.335 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:36.335 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.065328+0000", 2024-04-19T03:02:36.335 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.047228349000000003 2024-04-19T03:02:36.335 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.336 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.336 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:36.336 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.065508+0000", 2024-04-19T03:02:36.336 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00018036899999999999 2024-04-19T03:02:36.336 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.336 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.336 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:36.336 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.065576+0000", 2024-04-19T03:02:36.336 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7785000000000002e-05 2024-04-19T03:02:36.336 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:36.336 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:36.336 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:36.336 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.336 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.337 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4755.0:78995 5.2 e40/39 5:42b55e12:::benchmark_data_smithi096_19531_object78994:head v 40'4934, mlcod=40'4932)", 2024-04-19T03:02:36.337 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:18.016247+0000", 2024-04-19T03:02:36.337 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 18.306319550000001, 2024-04-19T03:02:36.337 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.056240406, 2024-04-19T03:02:36.337 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:36.337 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:36.337 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:36.337 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.337 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:36.337 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016247+0000", 2024-04-19T03:02:36.337 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:36.337 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.337 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.337 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:36.337 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016247+0000", 2024-04-19T03:02:36.338 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:36.338 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.338 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.338 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:36.338 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016246+0000", 2024-04-19T03:02:36.338 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:36.338 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.338 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.338 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:36.338 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016315+0000", 2024-04-19T03:02:36.338 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8979000000000005e-05 2024-04-19T03:02:36.338 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.338 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.339 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:36.339 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016333+0000", 2024-04-19T03:02:36.339 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7586999999999999e-05 2024-04-19T03:02:36.339 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.339 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.339 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:36.339 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016340+0000", 2024-04-19T03:02:36.339 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4080000000000001e-06 2024-04-19T03:02:36.339 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.339 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.339 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:36.339 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016384+0000", 2024-04-19T03:02:36.339 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3656999999999999e-05 2024-04-19T03:02:36.339 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.340 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.340 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:36.340 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016403+0000", 2024-04-19T03:02:36.340 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9089e-05 2024-04-19T03:02:36.340 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.340 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.340 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:36.340 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.072448+0000", 2024-04-19T03:02:36.340 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.056045084000000002 2024-04-19T03:02:36.340 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.340 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.340 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:36.341 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.072487+0000", 2024-04-19T03:02:36.341 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9362e-05 2024-04-19T03:02:36.341 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:36.341 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:36.341 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:36.341 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.341 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.341 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4755.0:78994 5.c e40/22 5:3c60d55d:::benchmark_data_smithi096_19531_object78993:head v 40'4989, mlcod=40'4987)", 2024-04-19T03:02:36.341 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:18.016392+0000", 2024-04-19T03:02:36.341 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 18.306174908999999, 2024-04-19T03:02:36.341 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.052629620000000002, 2024-04-19T03:02:36.341 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:36.341 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:36.342 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:36.342 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.342 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:36.342 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016392+0000", 2024-04-19T03:02:36.342 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:36.342 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.342 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.342 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:36.342 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016392+0000", 2024-04-19T03:02:36.342 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:36.342 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.342 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.342 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:36.342 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016391+0000", 2024-04-19T03:02:36.343 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:36.343 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.343 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.343 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:36.343 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016471+0000", 2024-04-19T03:02:36.343 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9346999999999998e-05 2024-04-19T03:02:36.343 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.343 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.343 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:36.343 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016478+0000", 2024-04-19T03:02:36.343 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.593e-06 2024-04-19T03:02:36.343 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.343 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.343 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:36.344 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016495+0000", 2024-04-19T03:02:36.344 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6492999999999999e-05 2024-04-19T03:02:36.344 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.344 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.344 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:36.344 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016539+0000", 2024-04-19T03:02:36.344 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4715999999999997e-05 2024-04-19T03:02:36.344 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.344 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.344 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:36.344 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016551+0000", 2024-04-19T03:02:36.344 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2096000000000001e-05 2024-04-19T03:02:36.344 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.344 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.345 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:36.345 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.068985+0000", 2024-04-19T03:02:36.345 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.052433754999999999 2024-04-19T03:02:36.345 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.345 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.345 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:36.345 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.069021+0000", 2024-04-19T03:02:36.345 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6047000000000002e-05 2024-04-19T03:02:36.345 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:36.345 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:36.345 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:36.345 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.345 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.345 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4755.0:78996 5.1 e40/39 5:87f59708:::benchmark_data_smithi096_19531_object78995:head v 40'4940, mlcod=40'4938)", 2024-04-19T03:02:36.346 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:18.016581+0000", 2024-04-19T03:02:36.346 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 18.305985744000001, 2024-04-19T03:02:36.346 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.052051785000000003, 2024-04-19T03:02:36.346 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:36.346 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:36.346 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:36.346 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.346 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:36.346 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016581+0000", 2024-04-19T03:02:36.346 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:36.346 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.346 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.346 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:36.347 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016581+0000", 2024-04-19T03:02:36.347 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:36.347 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.347 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.347 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:36.347 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016581+0000", 2024-04-19T03:02:36.347 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:36.347 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.347 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.347 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:36.347 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016610+0000", 2024-04-19T03:02:36.347 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9556999999999998e-05 2024-04-19T03:02:36.347 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.347 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.347 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:36.348 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016616+0000", 2024-04-19T03:02:36.348 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1090000000000003e-06 2024-04-19T03:02:36.348 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.348 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.348 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:36.348 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016621+0000", 2024-04-19T03:02:36.348 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.454e-06 2024-04-19T03:02:36.348 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.348 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.348 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:36.348 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016663+0000", 2024-04-19T03:02:36.348 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2582e-05 2024-04-19T03:02:36.348 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.348 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.349 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:36.349 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016681+0000", 2024-04-19T03:02:36.349 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7680999999999999e-05 2024-04-19T03:02:36.349 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.349 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.349 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:36.349 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.068486+0000", 2024-04-19T03:02:36.349 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.051804624000000001 2024-04-19T03:02:36.349 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.349 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.349 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:36.349 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.068633+0000", 2024-04-19T03:02:36.349 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00014709099999999999 2024-04-19T03:02:36.349 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:36.350 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:36.350 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:36.350 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.350 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.350 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4755.0:78999 5.3 e40/22 5:c9ec5f7f:::benchmark_data_smithi096_19531_object78998:head v 40'4893, mlcod=40'4889)", 2024-04-19T03:02:36.350 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:18.016633+0000", 2024-04-19T03:02:36.350 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 18.305933888999999, 2024-04-19T03:02:36.350 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.051090469999999999, 2024-04-19T03:02:36.350 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:36.350 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:36.350 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:36.350 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.350 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:36.351 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016633+0000", 2024-04-19T03:02:36.351 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:36.351 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.351 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.351 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:36.351 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016633+0000", 2024-04-19T03:02:36.351 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:36.351 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.351 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.351 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:36.351 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016632+0000", 2024-04-19T03:02:36.351 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967296 2024-04-19T03:02:36.351 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.351 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.352 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:36.352 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016660+0000", 2024-04-19T03:02:36.352 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7869999999999999e-05 2024-04-19T03:02:36.352 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.352 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.352 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:36.352 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016667+0000", 2024-04-19T03:02:36.352 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0280000000000003e-06 2024-04-19T03:02:36.352 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.352 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.352 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:36.352 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016672+0000", 2024-04-19T03:02:36.352 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0069999999999997e-06 2024-04-19T03:02:36.352 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.353 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.353 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:36.353 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016725+0000", 2024-04-19T03:02:36.353 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2812000000000002e-05 2024-04-19T03:02:36.353 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.353 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.353 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:36.353 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016750+0000", 2024-04-19T03:02:36.353 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5038e-05 2024-04-19T03:02:36.353 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.353 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.353 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:36.353 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.067673+0000", 2024-04-19T03:02:36.353 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.050922350999999998 2024-04-19T03:02:36.354 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.354 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.354 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:36.354 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.067723+0000", 2024-04-19T03:02:36.354 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0586e-05 2024-04-19T03:02:36.354 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:36.354 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:36.354 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:36.354 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.354 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.354 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4755.0:79003 5.2 e40/39 5:4436e33f:::benchmark_data_smithi096_19531_object79002:head v 40'4935, mlcod=40'4932)", 2024-04-19T03:02:36.354 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:18.018102+0000", 2024-04-19T03:02:36.354 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 18.304464161999999, 2024-04-19T03:02:36.354 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.060023990999999999, 2024-04-19T03:02:36.355 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:36.355 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:36.355 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:36.355 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.355 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:36.355 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018102+0000", 2024-04-19T03:02:36.355 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:36.355 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.355 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.355 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:36.355 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018102+0000", 2024-04-19T03:02:36.355 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:36.355 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.355 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.356 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:36.356 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018102+0000", 2024-04-19T03:02:36.356 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:36.356 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.356 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.356 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:36.356 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018134+0000", 2024-04-19T03:02:36.356 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2722000000000003e-05 2024-04-19T03:02:36.356 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.356 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.356 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:36.356 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018145+0000", 2024-04-19T03:02:36.356 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0395e-05 2024-04-19T03:02:36.356 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.357 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.357 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:36.357 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018151+0000", 2024-04-19T03:02:36.357 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5300000000000002e-06 2024-04-19T03:02:36.357 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.357 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.357 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:36.357 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018489+0000", 2024-04-19T03:02:36.357 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00033731499999999998 2024-04-19T03:02:36.357 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.357 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.357 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:36.357 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018508+0000", 2024-04-19T03:02:36.357 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9775e-05 2024-04-19T03:02:36.358 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.358 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.358 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:36.358 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.078059+0000", 2024-04-19T03:02:36.358 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.059550171999999998 2024-04-19T03:02:36.358 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.358 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.359 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:36.359 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.078126+0000", 2024-04-19T03:02:36.359 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7773000000000003e-05 2024-04-19T03:02:36.359 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:36.359 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:36.359 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:36.359 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.359 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.359 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4755.0:79005 5.1 e40/39 5:85b46038:::benchmark_data_smithi096_19531_object79004:head v 40'4941, mlcod=40'4938)", 2024-04-19T03:02:36.359 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:18.018167+0000", 2024-04-19T03:02:36.359 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 18.304399443000001, 2024-04-19T03:02:36.359 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.052768941999999999, 2024-04-19T03:02:36.359 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:36.360 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:36.360 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:36.360 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.360 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:36.360 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018167+0000", 2024-04-19T03:02:36.360 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:36.360 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.360 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.360 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:36.360 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018167+0000", 2024-04-19T03:02:36.360 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:36.360 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.360 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.360 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:36.361 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018167+0000", 2024-04-19T03:02:36.361 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:36.361 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.361 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.361 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:36.361 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018196+0000", 2024-04-19T03:02:36.361 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9538000000000001e-05 2024-04-19T03:02:36.361 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.361 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.361 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:36.361 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018204+0000", 2024-04-19T03:02:36.361 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2599999999999999e-06 2024-04-19T03:02:36.361 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.361 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.362 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:36.362 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018208+0000", 2024-04-19T03:02:36.362 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8080000000000004e-06 2024-04-19T03:02:36.362 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.362 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.362 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:36.362 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.064933+0000", 2024-04-19T03:02:36.362 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.046725048999999998 2024-04-19T03:02:36.362 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.362 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.362 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:36.362 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.064964+0000", 2024-04-19T03:02:36.362 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0577000000000002e-05 2024-04-19T03:02:36.363 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.363 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.363 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:36.363 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.070815+0000", 2024-04-19T03:02:36.363 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0058510649999999999 2024-04-19T03:02:36.363 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.363 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.363 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:36.363 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.070936+0000", 2024-04-19T03:02:36.363 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00012095399999999999 2024-04-19T03:02:36.363 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:36.363 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:36.363 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:36.363 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.364 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.364 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:86612 5.7 5:e32e3c49:::benchmark_data_smithi096_19531_object86611:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:36.364 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:22.633560+0000", 2024-04-19T03:02:36.364 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 13.689006502, 2024-04-19T03:02:36.364 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.19135289, 2024-04-19T03:02:36.364 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:36.364 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:36.364 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:36.364 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:36.364 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:36.364 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 86612 2024-04-19T03:02:36.364 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.364 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:36.364 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.365 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:36.365 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633560+0000", 2024-04-19T03:02:36.365 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:36.365 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.365 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.365 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:36.365 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633560+0000", 2024-04-19T03:02:36.365 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:36.365 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.365 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.365 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:36.365 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633558+0000", 2024-04-19T03:02:36.365 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:36.365 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.365 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.366 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:36.366 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633609+0000", 2024-04-19T03:02:36.366 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0850999999999998e-05 2024-04-19T03:02:36.366 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.366 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.366 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:36.366 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633627+0000", 2024-04-19T03:02:36.366 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7951000000000001e-05 2024-04-19T03:02:36.366 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.366 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.366 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:36.366 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633635+0000", 2024-04-19T03:02:36.366 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2530000000000004e-06 2024-04-19T03:02:36.367 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.367 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.367 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:36.367 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633699+0000", 2024-04-19T03:02:36.367 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3901999999999999e-05 2024-04-19T03:02:36.367 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.367 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.367 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:36.367 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633992+0000", 2024-04-19T03:02:36.367 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00029283299999999999 2024-04-19T03:02:36.367 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.367 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.367 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:36.367 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.634223+0000", 2024-04-19T03:02:36.368 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00023084200000000001 2024-04-19T03:02:36.368 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.368 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.368 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:36.368 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.639085+0000", 2024-04-19T03:02:36.368 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0048624269999999999 2024-04-19T03:02:36.368 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.368 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.368 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:36.368 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.824635+0000", 2024-04-19T03:02:36.368 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.18554944700000001 2024-04-19T03:02:36.368 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.368 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.368 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:36.369 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.824793+0000", 2024-04-19T03:02:36.369 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000157959 2024-04-19T03:02:36.369 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.369 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.369 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:36.369 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.824913+0000", 2024-04-19T03:02:36.369 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000120093 2024-04-19T03:02:36.369 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:36.369 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:36.369 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:36.369 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.369 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.369 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:86625 5.7 5:e6d00488:::benchmark_data_smithi096_19531_object86624:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:36.369 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:22.643554+0000", 2024-04-19T03:02:36.370 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 13.679012736000001, 2024-04-19T03:02:36.370 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.18732841, 2024-04-19T03:02:36.370 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:36.370 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:36.370 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:36.370 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:36.370 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:36.370 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 86625 2024-04-19T03:02:36.370 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.370 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:36.370 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.370 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:36.370 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643554+0000", 2024-04-19T03:02:36.371 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:36.371 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.371 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.371 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:36.371 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643554+0000", 2024-04-19T03:02:36.371 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:36.371 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.371 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.371 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:36.371 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643552+0000", 2024-04-19T03:02:36.371 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:36.371 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.371 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.372 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:36.372 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643588+0000", 2024-04-19T03:02:36.372 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5855999999999997e-05 2024-04-19T03:02:36.372 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.372 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.372 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:36.372 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643606+0000", 2024-04-19T03:02:36.372 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8226000000000001e-05 2024-04-19T03:02:36.372 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.372 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.372 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:36.372 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643618+0000", 2024-04-19T03:02:36.372 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1868000000000001e-05 2024-04-19T03:02:36.372 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.373 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.373 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:36.373 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643676+0000", 2024-04-19T03:02:36.373 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8153999999999999e-05 2024-04-19T03:02:36.373 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.373 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.373 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:36.373 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643905+0000", 2024-04-19T03:02:36.373 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00022847500000000001 2024-04-19T03:02:36.373 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.373 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.373 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:36.373 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.644150+0000", 2024-04-19T03:02:36.373 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00024531800000000001 2024-04-19T03:02:36.374 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.374 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.374 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:36.374 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.647407+0000", 2024-04-19T03:02:36.374 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0032563190000000001 2024-04-19T03:02:36.374 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.374 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.374 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:36.374 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.830721+0000", 2024-04-19T03:02:36.374 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.18331468300000001 2024-04-19T03:02:36.374 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.374 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.374 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:36.375 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.830813+0000", 2024-04-19T03:02:36.375 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.2205000000000002e-05 2024-04-19T03:02:36.375 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.375 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.375 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:36.375 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.830882+0000", 2024-04-19T03:02:36.375 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8819999999999995e-05 2024-04-19T03:02:36.375 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:36.375 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:36.375 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:36.375 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.375 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.375 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87063 5.7 5:e502e824:::benchmark_data_smithi096_19531_object87062:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:36.375 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.136067+0000", 2024-04-19T03:02:36.376 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 13.186499867, 2024-04-19T03:02:36.376 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.065521159999999995, 2024-04-19T03:02:36.376 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:36.376 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:36.376 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:36.376 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:36.376 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:36.376 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87063 2024-04-19T03:02:36.376 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.376 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:36.376 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.376 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:36.376 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.136067+0000", 2024-04-19T03:02:36.377 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:36.377 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.377 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.377 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:36.377 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.136067+0000", 2024-04-19T03:02:36.377 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:36.377 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.377 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.377 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:36.377 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.136066+0000", 2024-04-19T03:02:36.377 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:36.377 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.377 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.377 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:36.377 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.136154+0000", 2024-04-19T03:02:36.378 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.8256000000000003e-05 2024-04-19T03:02:36.378 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.378 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.378 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:36.378 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.136162+0000", 2024-04-19T03:02:36.378 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.5099999999999998e-06 2024-04-19T03:02:36.378 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.378 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.378 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:36.378 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.136171+0000", 2024-04-19T03:02:36.378 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2830000000000001e-06 2024-04-19T03:02:36.378 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.378 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.378 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:36.379 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.138421+0000", 2024-04-19T03:02:36.379 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0022506620000000001 2024-04-19T03:02:36.379 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.379 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.379 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:36.379 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.138560+0000", 2024-04-19T03:02:36.379 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000138446 2024-04-19T03:02:36.379 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.379 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.379 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:36.379 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.138689+0000", 2024-04-19T03:02:36.379 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00012950700000000001 2024-04-19T03:02:36.380 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.380 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.380 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:36.380 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.141517+0000", 2024-04-19T03:02:36.380 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0028280860000000001 2024-04-19T03:02:36.380 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.380 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.380 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:36.380 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.201350+0000", 2024-04-19T03:02:36.380 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.059832418999999998 2024-04-19T03:02:36.380 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.380 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.380 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:36.380 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.201485+0000", 2024-04-19T03:02:36.381 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000135597 2024-04-19T03:02:36.381 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.381 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.381 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:36.381 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.201588+0000", 2024-04-19T03:02:36.381 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00010247900000000001 2024-04-19T03:02:36.381 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:36.381 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:36.381 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:36.381 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.381 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.381 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87072 5.7 5:e3c7809a:::benchmark_data_smithi096_19531_object87071:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:36.381 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.144224+0000", 2024-04-19T03:02:36.381 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 13.178342842999999, 2024-04-19T03:02:36.382 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.058179555000000001, 2024-04-19T03:02:36.382 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:36.382 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:36.382 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:36.382 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:36.382 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:36.382 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87072 2024-04-19T03:02:36.382 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.382 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:36.382 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.382 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:36.382 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144224+0000", 2024-04-19T03:02:36.382 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:36.382 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.383 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.383 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:36.383 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144224+0000", 2024-04-19T03:02:36.383 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:36.383 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.383 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.383 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:36.383 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144223+0000", 2024-04-19T03:02:36.383 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:36.383 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.383 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.383 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:36.383 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144320+0000", 2024-04-19T03:02:36.384 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.7075000000000001e-05 2024-04-19T03:02:36.384 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.384 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.384 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:36.384 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144331+0000", 2024-04-19T03:02:36.384 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1342000000000001e-05 2024-04-19T03:02:36.384 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.384 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.384 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:36.384 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144337+0000", 2024-04-19T03:02:36.384 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8390000000000003e-06 2024-04-19T03:02:36.384 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.384 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.384 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:36.385 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144369+0000", 2024-04-19T03:02:36.385 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2079000000000002e-05 2024-04-19T03:02:36.385 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.385 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.385 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:36.385 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144464+0000", 2024-04-19T03:02:36.385 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.4623000000000005e-05 2024-04-19T03:02:36.385 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.385 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.385 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:36.385 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144553+0000", 2024-04-19T03:02:36.385 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9171000000000004e-05 2024-04-19T03:02:36.385 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.385 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.386 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:36.386 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.147018+0000", 2024-04-19T03:02:36.386 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0024648370000000001 2024-04-19T03:02:36.386 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.386 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.386 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:36.386 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.202270+0000", 2024-04-19T03:02:36.386 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.055252018 2024-04-19T03:02:36.386 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.386 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.386 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:36.386 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.202356+0000", 2024-04-19T03:02:36.387 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6648000000000001e-05 2024-04-19T03:02:36.387 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.387 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.387 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:36.387 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.202403+0000", 2024-04-19T03:02:36.387 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6956999999999998e-05 2024-04-19T03:02:36.387 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:36.387 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:36.387 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:36.387 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.387 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.387 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87123 5.6 5:6d1bc3b9:::benchmark_data_smithi096_19531_object87122:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:02:36.387 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249233+0000", 2024-04-19T03:02:36.388 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 13.073333810999999, 2024-04-19T03:02:36.388 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0291700720000001, 2024-04-19T03:02:36.388 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:36.388 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-04-19T03:02:36.388 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:36.388 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:36.388 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:36.388 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87123 2024-04-19T03:02:36.388 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.388 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:36.388 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.388 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:36.388 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249233+0000", 2024-04-19T03:02:36.388 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:36.389 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.389 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.389 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:36.389 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249233+0000", 2024-04-19T03:02:36.389 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:36.389 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.389 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.389 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:36.389 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249231+0000", 2024-04-19T03:02:36.389 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:36.389 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.389 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.389 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:36.389 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249285+0000", 2024-04-19T03:02:36.389 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4005000000000002e-05 2024-04-19T03:02:36.390 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.390 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.390 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:36.390 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249300+0000", 2024-04-19T03:02:36.390 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4715999999999999e-05 2024-04-19T03:02:36.390 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.390 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.390 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:36.390 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249307+0000", 2024-04-19T03:02:36.390 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8399999999999997e-06 2024-04-19T03:02:36.390 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.390 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.390 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:36.391 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249366+0000", 2024-04-19T03:02:36.391 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9435999999999998e-05 2024-04-19T03:02:36.391 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.391 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.391 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op must wait for map", 2024-04-19T03:02:36.391 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249376+0000", 2024-04-19T03:02:36.391 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.4919999999999999e-06 2024-04-19T03:02:36.391 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.391 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.391 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:36.391 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263757+0000", 2024-04-19T03:02:36.391 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.014381461999999999 2024-04-19T03:02:36.391 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.391 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.391 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:02:36.391 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263875+0000", 2024-04-19T03:02:36.392 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000117166 2024-04-19T03:02:36.392 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.392 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.392 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:36.392 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.277136+0000", 2024-04-19T03:02:36.392 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.013261207 2024-04-19T03:02:36.392 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.392 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.392 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:36.392 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.278403+0000", 2024-04-19T03:02:36.392 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001267106 2024-04-19T03:02:36.392 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:36.392 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:36.392 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:36.392 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.393 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.393 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87128 5.6 5:6905c420:::benchmark_data_smithi096_19531_object87127:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:02:36.393 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249323+0000", 2024-04-19T03:02:36.393 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 13.073243064, 2024-04-19T03:02:36.393 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0292813249999999, 2024-04-19T03:02:36.393 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:36.393 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-04-19T03:02:36.393 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:36.393 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:36.393 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:36.393 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87128 2024-04-19T03:02:36.393 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.393 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:36.393 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.393 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:36.393 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249323+0000", 2024-04-19T03:02:36.394 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:36.394 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.394 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.394 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:36.394 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249323+0000", 2024-04-19T03:02:36.394 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:36.394 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.394 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.394 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:36.394 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249323+0000", 2024-04-19T03:02:36.394 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:36.394 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.394 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.395 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:36.395 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249385+0000", 2024-04-19T03:02:36.395 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1711999999999995e-05 2024-04-19T03:02:36.395 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.395 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.395 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:36.395 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249398+0000", 2024-04-19T03:02:36.395 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3022e-05 2024-04-19T03:02:36.395 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.395 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.395 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:36.395 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249402+0000", 2024-04-19T03:02:36.395 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4819999999999996e-06 2024-04-19T03:02:36.395 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.396 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.396 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:36.396 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249437+0000", 2024-04-19T03:02:36.396 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4702000000000001e-05 2024-04-19T03:02:36.396 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.396 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.396 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:02:36.396 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249442+0000", 2024-04-19T03:02:36.396 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8019999999999999e-06 2024-04-19T03:02:36.396 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.396 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.396 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:36.396 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263896+0000", 2024-04-19T03:02:36.396 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.014454679999999999 2024-04-19T03:02:36.396 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.397 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.397 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:02:36.397 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263900+0000", 2024-04-19T03:02:36.397 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9700000000000001e-06 2024-04-19T03:02:36.397 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.397 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.397 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:36.397 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.278557+0000", 2024-04-19T03:02:36.397 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0146566480000001 2024-04-19T03:02:36.397 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.397 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.397 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:36.397 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.278605+0000", 2024-04-19T03:02:36.397 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7735999999999998e-05 2024-04-19T03:02:36.398 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:36.398 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:36.398 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:36.398 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.398 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.398 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87130 5.3 5:c8c2d67b:::benchmark_data_smithi096_19531_object87129:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:02:36.398 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249418+0000", 2024-04-19T03:02:36.398 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 13.073148353000001, 2024-04-19T03:02:36.398 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.025414182, 2024-04-19T03:02:36.398 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:36.398 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-04-19T03:02:36.398 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:36.398 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:36.399 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:36.399 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87130 2024-04-19T03:02:36.399 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.399 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:36.399 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.399 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:36.399 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249418+0000", 2024-04-19T03:02:36.399 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:36.399 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.399 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.399 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:36.399 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249418+0000", 2024-04-19T03:02:36.399 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:36.399 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.400 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.400 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:36.400 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249409+0000", 2024-04-19T03:02:36.400 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999905 2024-04-19T03:02:36.400 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.400 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.400 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:36.400 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249464+0000", 2024-04-19T03:02:36.400 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5381999999999999e-05 2024-04-19T03:02:36.400 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.400 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.400 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:36.400 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249471+0000", 2024-04-19T03:02:36.400 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2609999999999996e-06 2024-04-19T03:02:36.400 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.401 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.401 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:36.401 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249475+0000", 2024-04-19T03:02:36.401 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2839999999999998e-06 2024-04-19T03:02:36.401 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.401 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.401 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:36.401 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249535+0000", 2024-04-19T03:02:36.401 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0545999999999999e-05 2024-04-19T03:02:36.401 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.401 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.401 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op must wait for map", 2024-04-19T03:02:36.401 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249540+0000", 2024-04-19T03:02:36.402 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2859999999999999e-06 2024-04-19T03:02:36.402 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.402 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.402 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:36.402 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263450+0000", 2024-04-19T03:02:36.402 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.013909585 2024-04-19T03:02:36.402 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.402 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.402 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:02:36.402 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263458+0000", 2024-04-19T03:02:36.402 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8089999999999993e-06 2024-04-19T03:02:36.402 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.402 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.402 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:36.403 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.273193+0000", 2024-04-19T03:02:36.403 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0097351379999999 2024-04-19T03:02:36.403 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.403 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.403 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:36.403 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.274832+0000", 2024-04-19T03:02:36.403 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0016394789999999999 2024-04-19T03:02:36.403 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:36.403 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:36.403 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:36.403 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.403 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.403 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87131 5.1 5:83756d55:::benchmark_data_smithi096_19531_object87130:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:02:36.403 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249491+0000", 2024-04-19T03:02:36.404 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 13.073075705999999, 2024-04-19T03:02:36.404 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0191489520000001, 2024-04-19T03:02:36.404 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:36.404 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-04-19T03:02:36.404 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:36.404 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:36.404 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:36.404 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87131 2024-04-19T03:02:36.404 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.404 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:36.404 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.404 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:36.404 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249491+0000", 2024-04-19T03:02:36.404 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:36.405 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.405 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.405 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:36.405 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249491+0000", 2024-04-19T03:02:36.405 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:36.405 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.405 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.405 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:36.405 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249491+0000", 2024-04-19T03:02:36.405 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:36.405 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.405 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.405 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:36.405 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249530+0000", 2024-04-19T03:02:36.405 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9589000000000003e-05 2024-04-19T03:02:36.406 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.406 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.406 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:36.406 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249544+0000", 2024-04-19T03:02:36.406 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4158000000000001e-05 2024-04-19T03:02:36.406 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.406 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.406 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:36.406 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249549+0000", 2024-04-19T03:02:36.406 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6809999999999997e-06 2024-04-19T03:02:36.406 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.406 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.406 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:36.406 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249592+0000", 2024-04-19T03:02:36.407 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3285999999999999e-05 2024-04-19T03:02:36.407 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.407 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.407 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op must wait for map", 2024-04-19T03:02:36.407 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249598+0000", 2024-04-19T03:02:36.409 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8329999999999999e-06 2024-04-19T03:02:36.410 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.410 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.410 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:36.410 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263331+0000", 2024-04-19T03:02:36.410 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.013733093 2024-04-19T03:02:36.410 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.410 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.410 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:02:36.410 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263343+0000", 2024-04-19T03:02:36.410 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.189e-05 2024-04-19T03:02:36.410 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.410 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.410 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:36.411 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.268541+0000", 2024-04-19T03:02:36.411 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0051983440000001 2024-04-19T03:02:36.411 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.411 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.411 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:36.411 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.268640+0000", 2024-04-19T03:02:36.411 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.8387999999999994e-05 2024-04-19T03:02:36.411 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:36.411 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:36.411 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:36.411 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.411 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.411 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87132 5.c 5:3e18b732:::benchmark_data_smithi096_19531_object87131:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:02:36.412 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249558+0000", 2024-04-19T03:02:36.412 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 13.073008805000001, 2024-04-19T03:02:36.412 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0241198380000001, 2024-04-19T03:02:36.412 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:36.412 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-04-19T03:02:36.412 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:36.412 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:36.412 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:36.412 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87132 2024-04-19T03:02:36.412 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.412 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:36.412 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.412 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:36.412 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249558+0000", 2024-04-19T03:02:36.413 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:36.413 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.413 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.413 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:36.413 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249558+0000", 2024-04-19T03:02:36.413 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:36.413 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.413 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.413 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:36.413 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249557+0000", 2024-04-19T03:02:36.413 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:36.413 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.413 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.414 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:36.414 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249625+0000", 2024-04-19T03:02:36.414 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7200999999999996e-05 2024-04-19T03:02:36.414 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.414 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.414 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:36.414 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249646+0000", 2024-04-19T03:02:36.414 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1053e-05 2024-04-19T03:02:36.414 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.414 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.414 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:36.414 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249650+0000", 2024-04-19T03:02:36.414 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2719999999999999e-06 2024-04-19T03:02:36.414 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.415 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.415 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:36.415 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249686+0000", 2024-04-19T03:02:36.415 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6430000000000002e-05 2024-04-19T03:02:36.415 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.415 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.415 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op must wait for map", 2024-04-19T03:02:36.415 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249690+0000", 2024-04-19T03:02:36.415 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.765e-06 2024-04-19T03:02:36.415 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.415 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.415 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:36.415 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261157+0000", 2024-04-19T03:02:36.415 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011467247999999999 2024-04-19T03:02:36.416 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.416 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.416 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:02:36.416 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261170+0000", 2024-04-19T03:02:36.416 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2833000000000001e-05 2024-04-19T03:02:36.416 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.416 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.416 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:36.416 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.272119+0000", 2024-04-19T03:02:36.416 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.010949313 2024-04-19T03:02:36.416 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.416 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.416 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:36.416 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.273678+0000", 2024-04-19T03:02:36.416 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0015581550000000001 2024-04-19T03:02:36.417 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:36.417 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:36.417 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:36.417 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.417 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.417 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87133 5.c 5:3f772a62:::benchmark_data_smithi096_19531_object87132:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:02:36.417 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249657+0000", 2024-04-19T03:02:36.417 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 13.072909426000001, 2024-04-19T03:02:36.417 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0242819409999999, 2024-04-19T03:02:36.417 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:36.417 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-04-19T03:02:36.417 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:36.417 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:36.417 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:36.418 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87133 2024-04-19T03:02:36.418 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.418 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:36.418 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.418 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:36.418 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249657+0000", 2024-04-19T03:02:36.418 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:36.418 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.418 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.418 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:36.418 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249657+0000", 2024-04-19T03:02:36.418 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:36.418 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.418 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.419 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:36.419 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249657+0000", 2024-04-19T03:02:36.419 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:36.419 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.419 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.419 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:36.419 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249690+0000", 2024-04-19T03:02:36.419 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3343000000000002e-05 2024-04-19T03:02:36.419 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.419 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.419 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:36.419 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249695+0000", 2024-04-19T03:02:36.419 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8600000000000001e-06 2024-04-19T03:02:36.419 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.420 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.420 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:36.420 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249698+0000", 2024-04-19T03:02:36.420 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.1700000000000001e-06 2024-04-19T03:02:36.420 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.420 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.420 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:36.420 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249741+0000", 2024-04-19T03:02:36.420 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2849999999999998e-05 2024-04-19T03:02:36.420 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.420 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.420 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:02:36.420 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249746+0000", 2024-04-19T03:02:36.420 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1019999999999996e-06 2024-04-19T03:02:36.420 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.421 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.421 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:36.421 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261209+0000", 2024-04-19T03:02:36.421 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011462447000000001 2024-04-19T03:02:36.421 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.421 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.421 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:02:36.421 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261216+0000", 2024-04-19T03:02:36.421 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8520000000000004e-06 2024-04-19T03:02:36.421 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.421 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.421 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:36.421 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.273872+0000", 2024-04-19T03:02:36.421 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0126558000000001 2024-04-19T03:02:36.422 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.422 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.422 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:36.422 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.273939+0000", 2024-04-19T03:02:36.422 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6822000000000005e-05 2024-04-19T03:02:36.422 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:36.422 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:36.422 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:36.422 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.422 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.422 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87134 5.5 5:a56c478f:::benchmark_data_smithi096_19531_object87133:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:02:36.422 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249708+0000", 2024-04-19T03:02:36.422 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 13.072858502000001, 2024-04-19T03:02:36.422 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0214677299999999, 2024-04-19T03:02:36.423 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:36.423 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-04-19T03:02:36.423 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:36.423 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:36.423 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:36.423 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87134 2024-04-19T03:02:36.423 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.423 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:36.423 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.423 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:36.423 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249708+0000", 2024-04-19T03:02:36.423 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:36.423 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.423 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.424 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:36.424 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249708+0000", 2024-04-19T03:02:36.424 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:36.424 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.424 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.424 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:36.424 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249706+0000", 2024-04-19T03:02:36.424 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999976 2024-04-19T03:02:36.424 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.424 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.424 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:36.424 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249740+0000", 2024-04-19T03:02:36.424 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4458000000000001e-05 2024-04-19T03:02:36.424 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.425 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.425 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:36.425 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249745+0000", 2024-04-19T03:02:36.425 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5020000000000003e-06 2024-04-19T03:02:36.425 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.425 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.425 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:36.425 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249748+0000", 2024-04-19T03:02:36.425 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2499999999999998e-06 2024-04-19T03:02:36.425 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.425 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.425 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:36.425 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249778+0000", 2024-04-19T03:02:36.425 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.006e-05 2024-04-19T03:02:36.426 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.426 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.426 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op must wait for map", 2024-04-19T03:02:36.426 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249782+0000", 2024-04-19T03:02:36.426 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2910000000000001e-06 2024-04-19T03:02:36.426 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.426 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.426 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:36.426 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261666+0000", 2024-04-19T03:02:36.426 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011883471 2024-04-19T03:02:36.426 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.426 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.426 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:02:36.426 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261674+0000", 2024-04-19T03:02:36.427 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6479999999999992e-06 2024-04-19T03:02:36.427 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.427 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.427 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:36.427 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.269323+0000", 2024-04-19T03:02:36.427 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.00764867 2024-04-19T03:02:36.427 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.427 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.427 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:36.427 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.271176+0000", 2024-04-19T03:02:36.427 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001852844 2024-04-19T03:02:36.427 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:36.427 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:36.428 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:36.428 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.428 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.428 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87137 5.c 5:30708c68:::benchmark_data_smithi096_19531_object87136:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:02:36.428 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249756+0000", 2024-04-19T03:02:36.428 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 13.072810796000001, 2024-04-19T03:02:36.428 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.033331752, 2024-04-19T03:02:36.428 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:36.428 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:36.428 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:36.428 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:36.428 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:36.428 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87137 2024-04-19T03:02:36.428 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.428 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:36.429 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.429 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:36.429 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249756+0000", 2024-04-19T03:02:36.429 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:36.429 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.429 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.429 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:36.429 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249756+0000", 2024-04-19T03:02:36.429 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:36.429 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.429 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.429 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:36.429 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249755+0000", 2024-04-19T03:02:36.429 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:36.430 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.430 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.430 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:36.430 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249777+0000", 2024-04-19T03:02:36.430 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1420000000000002e-05 2024-04-19T03:02:36.430 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.430 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.430 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:36.430 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249781+0000", 2024-04-19T03:02:36.430 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0609999999999997e-06 2024-04-19T03:02:36.430 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.430 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.430 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:36.431 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249787+0000", 2024-04-19T03:02:36.431 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.02e-06 2024-04-19T03:02:36.431 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.431 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.431 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:36.431 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249818+0000", 2024-04-19T03:02:36.431 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0947e-05 2024-04-19T03:02:36.431 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.431 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.431 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:02:36.431 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249821+0000", 2024-04-19T03:02:36.431 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.117e-06 2024-04-19T03:02:36.431 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.431 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.432 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:36.432 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261243+0000", 2024-04-19T03:02:36.432 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011421875999999999 2024-04-19T03:02:36.432 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.432 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.432 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:02:36.432 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261251+0000", 2024-04-19T03:02:36.432 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6120000000000001e-06 2024-04-19T03:02:36.432 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.432 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.432 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:36.432 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.274050+0000", 2024-04-19T03:02:36.432 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.012799405 2024-04-19T03:02:36.432 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.433 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.433 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:36.433 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.274529+0000", 2024-04-19T03:02:36.433 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00047867100000000001 2024-04-19T03:02:36.433 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.433 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.433 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:36.433 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.282972+0000", 2024-04-19T03:02:36.433 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0084436900000000002 2024-04-19T03:02:36.433 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.433 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.433 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:36.433 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.283022+0000", 2024-04-19T03:02:36.433 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9339000000000003e-05 2024-04-19T03:02:36.433 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:36.434 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:36.434 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:36.434 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.283088+0000", 2024-04-19T03:02:36.434 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5877999999999995e-05 2024-04-19T03:02:36.434 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:36.434 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:36.434 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:36.434 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:36.434 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:36.434 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-04-19T03:02:36.436 INFO:teuthology.orchestra.run.smithi096.stderr:noscrub is set 2024-04-19T03:02:36.436 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:36.433+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:36.437 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T03:02:36.536 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:36.533+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:36.566 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-19T03:02:36.566 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-04-19T03:02:36.566 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.566 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:110973 5.d 5:b3b801fa:::benchmark_data_smithi096_19531_object110972:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-19T03:02:36.566 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:36.558539+0000", 2024-04-19T03:02:36.566 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0067024709999999998, 2024-04-19T03:02:36.566 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0067340409999999996, 2024-04-19T03:02:36.567 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:36.567 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:02:36.567 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:36.567 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:36.567 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:36.567 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 110973 2024-04-19T03:02:36.567 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.567 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:36.567 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.567 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:36.567 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:36.558539+0000", 2024-04-19T03:02:36.567 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:36.568 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.568 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.568 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:36.568 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:36.558539+0000", 2024-04-19T03:02:36.568 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:36.568 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.568 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.568 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:36.568 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:36.558537+0000", 2024-04-19T03:02:36.568 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:36.568 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.568 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.568 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:36.568 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:36.558588+0000", 2024-04-19T03:02:36.569 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0735000000000001e-05 2024-04-19T03:02:36.569 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.569 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.569 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:36.569 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:36.558605+0000", 2024-04-19T03:02:36.569 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6653000000000001e-05 2024-04-19T03:02:36.569 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.569 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.569 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:36.569 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:36.558611+0000", 2024-04-19T03:02:36.569 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9479999999999996e-06 2024-04-19T03:02:36.569 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.569 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.570 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:36.570 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:36.558667+0000", 2024-04-19T03:02:36.570 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6295999999999998e-05 2024-04-19T03:02:36.570 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.570 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.570 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:36.570 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:36.558833+0000", 2024-04-19T03:02:36.570 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016555399999999999 2024-04-19T03:02:36.570 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.570 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.570 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-04-19T03:02:36.570 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:36.558989+0000", 2024-04-19T03:02:36.571 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015655899999999999 2024-04-19T03:02:36.571 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.571 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.571 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:36.571 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:36.562027+0000", 2024-04-19T03:02:36.571 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0030375039999999999 2024-04-19T03:02:36.571 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:36.571 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:36.571 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:36.571 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.571 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.571 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:110974 5.b 5:d5e84d98:::benchmark_data_smithi096_19531_object110973:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-19T03:02:36.571 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:36.558626+0000", 2024-04-19T03:02:36.571 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.006614661, 2024-04-19T03:02:36.571 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.006771343, 2024-04-19T03:02:36.572 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:36.572 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-19T03:02:36.572 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:36.572 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:36.572 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:36.572 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 110974 2024-04-19T03:02:36.572 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.572 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:36.572 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.572 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:36.572 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:36.558626+0000", 2024-04-19T03:02:36.572 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:36.572 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.572 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.572 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:36.573 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:36.558626+0000", 2024-04-19T03:02:36.573 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:36.573 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.573 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.573 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:36.573 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:36.558626+0000", 2024-04-19T03:02:36.573 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:36.573 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.573 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.573 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:36.573 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:36.558656+0000", 2024-04-19T03:02:36.573 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0465000000000001e-05 2024-04-19T03:02:36.573 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.573 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.574 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:36.574 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:36.558683+0000", 2024-04-19T03:02:36.574 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6308e-05 2024-04-19T03:02:36.574 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.574 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.574 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:36.574 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:36.558707+0000", 2024-04-19T03:02:36.574 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4561000000000001e-05 2024-04-19T03:02:36.574 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.574 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.574 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:36.574 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:36.558769+0000", 2024-04-19T03:02:36.575 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2053999999999999e-05 2024-04-19T03:02:36.575 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.575 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.575 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:36.575 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:36.558912+0000", 2024-04-19T03:02:36.575 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014237200000000001 2024-04-19T03:02:36.575 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:36.575 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:36.575 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:36.575 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.575 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.575 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:110975 5.e 5:72c93520:::benchmark_data_smithi096_19531_object110974:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-19T03:02:36.575 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:36.558746+0000", 2024-04-19T03:02:36.575 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0064956179999999999, 2024-04-19T03:02:36.576 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0067372910000000003, 2024-04-19T03:02:36.576 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:36.576 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-19T03:02:36.576 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:36.576 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:36.576 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:36.576 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 110975 2024-04-19T03:02:36.576 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.576 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:36.576 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.576 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:36.576 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:36.558746+0000", 2024-04-19T03:02:36.576 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:36.577 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.577 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.577 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:36.577 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:36.558746+0000", 2024-04-19T03:02:36.577 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:36.577 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.577 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.577 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:36.577 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:36.558745+0000", 2024-04-19T03:02:36.577 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:36.577 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.577 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.578 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:36.578 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:36.558773+0000", 2024-04-19T03:02:36.578 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8129000000000001e-05 2024-04-19T03:02:36.578 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.578 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.578 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:36.578 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:36.558783+0000", 2024-04-19T03:02:36.578 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.8290000000000003e-06 2024-04-19T03:02:36.578 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.578 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.578 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:36.578 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:36.558789+0000", 2024-04-19T03:02:36.578 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5209999999999999e-06 2024-04-19T03:02:36.579 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.579 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.579 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:36.579 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:36.558844+0000", 2024-04-19T03:02:36.579 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4979999999999999e-05 2024-04-19T03:02:36.579 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.579 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.579 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:36.579 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:36.559024+0000", 2024-04-19T03:02:36.579 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000179512 2024-04-19T03:02:36.579 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:36.579 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:36.579 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:36.579 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.580 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.580 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:110976 5.b 5:d15abcff:::benchmark_data_smithi096_19531_object110975:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-19T03:02:36.580 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:36.558872+0000", 2024-04-19T03:02:36.580 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0063690090000000001, 2024-04-19T03:02:36.580 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.006682767, 2024-04-19T03:02:36.580 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:36.580 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-19T03:02:36.580 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:36.580 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:36.580 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:36.580 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 110976 2024-04-19T03:02:36.580 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.580 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:36.581 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.581 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:36.581 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:36.558872+0000", 2024-04-19T03:02:36.581 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:36.581 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.581 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.581 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:36.581 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:36.558872+0000", 2024-04-19T03:02:36.581 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:36.581 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.581 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.581 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:36.581 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:36.558871+0000", 2024-04-19T03:02:36.582 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:36.582 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.582 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.582 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:36.582 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:36.558941+0000", 2024-04-19T03:02:36.582 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.9615000000000003e-05 2024-04-19T03:02:36.582 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.582 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.582 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:36.582 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:36.558950+0000", 2024-04-19T03:02:36.582 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1439999999999992e-06 2024-04-19T03:02:36.582 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.582 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.583 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:36.583 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:36.558957+0000", 2024-04-19T03:02:36.583 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.0570000000000004e-06 2024-04-19T03:02:36.583 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.583 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.583 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:36.583 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:36.562201+0000", 2024-04-19T03:02:36.583 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0032435210000000001 2024-04-19T03:02:36.583 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.583 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.583 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:36.583 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:36.562483+0000", 2024-04-19T03:02:36.583 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00028228900000000002 2024-04-19T03:02:36.583 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:36.584 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:36.584 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:36.584 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.584 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.584 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:110982 5.e 5:7af5bf1a:::benchmark_data_smithi096_19531_object110981:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-19T03:02:36.584 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:36.562303+0000", 2024-04-19T03:02:36.584 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.002938057, 2024-04-19T03:02:36.584 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0033259489999999999, 2024-04-19T03:02:36.584 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:36.584 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-19T03:02:36.584 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:36.584 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:36.584 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:36.585 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 110982 2024-04-19T03:02:36.585 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.585 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:36.585 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.585 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:36.585 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:36.562303+0000", 2024-04-19T03:02:36.585 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:36.585 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.585 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.585 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:36.585 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:36.562303+0000", 2024-04-19T03:02:36.585 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:36.585 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.585 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.586 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:36.586 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:36.562302+0000", 2024-04-19T03:02:36.586 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:36.586 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.586 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.586 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:36.586 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:36.562341+0000", 2024-04-19T03:02:36.586 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8964999999999997e-05 2024-04-19T03:02:36.586 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.586 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.586 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:36.586 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:36.562351+0000", 2024-04-19T03:02:36.586 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.8439999999999993e-06 2024-04-19T03:02:36.587 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.587 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.587 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:36.587 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:36.562358+0000", 2024-04-19T03:02:36.587 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3010000000000001e-06 2024-04-19T03:02:36.587 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.587 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.587 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:36.587 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:36.562417+0000", 2024-04-19T03:02:36.587 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9024999999999998e-05 2024-04-19T03:02:36.587 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.587 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.587 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:36.587 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:36.562544+0000", 2024-04-19T03:02:36.587 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012746599999999999 2024-04-19T03:02:36.587 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:36.588 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:36.588 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:36.588 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.588 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.588 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:110983 5.4 5:28b14bc6:::benchmark_data_smithi096_19531_object110982:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-19T03:02:36.588 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:36.562374+0000", 2024-04-19T03:02:36.588 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0028666500000000001, 2024-04-19T03:02:36.588 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0033262579999999999, 2024-04-19T03:02:36.588 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:36.588 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-19T03:02:36.588 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:36.588 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:36.588 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:36.588 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 110983 2024-04-19T03:02:36.589 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.589 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:36.589 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.589 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:36.589 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:36.562374+0000", 2024-04-19T03:02:36.589 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:36.589 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.589 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.589 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:36.589 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:36.562374+0000", 2024-04-19T03:02:36.589 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:36.589 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.589 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.589 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:36.590 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:36.562374+0000", 2024-04-19T03:02:36.590 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:36.590 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.590 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.590 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:36.590 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:36.562415+0000", 2024-04-19T03:02:36.590 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1019999999999997e-05 2024-04-19T03:02:36.590 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.590 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.590 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:36.590 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:36.562424+0000", 2024-04-19T03:02:36.590 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.2869999999999993e-06 2024-04-19T03:02:36.590 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.591 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.591 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:36.591 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:36.562431+0000", 2024-04-19T03:02:36.591 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.0029999999999997e-06 2024-04-19T03:02:36.591 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.591 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.591 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:36.591 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:36.562480+0000", 2024-04-19T03:02:36.591 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8914e-05 2024-04-19T03:02:36.591 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.591 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.591 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:36.591 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:36.562606+0000", 2024-04-19T03:02:36.591 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012550899999999999 2024-04-19T03:02:36.592 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:36.592 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:36.592 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:36.592 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.592 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.592 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4755.0:110977 5.f e48/22 5:f09dcd85:::benchmark_data_smithi096_19531_object110976:head v 48'6851, mlcod=48'6849)", 2024-04-19T03:02:36.592 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:36.562526+0000", 2024-04-19T03:02:36.592 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0027150059999999998, 2024-04-19T03:02:36.592 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0032441409999999999, 2024-04-19T03:02:36.592 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:36.592 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-19T03:02:36.592 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:36.592 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.592 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:36.592 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:36.562526+0000", 2024-04-19T03:02:36.593 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:36.593 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.593 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.593 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:36.593 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:36.562526+0000", 2024-04-19T03:02:36.593 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:36.593 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.593 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.593 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:36.593 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:36.562525+0000", 2024-04-19T03:02:36.593 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:36.593 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.593 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.593 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:36.594 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:36.562578+0000", 2024-04-19T03:02:36.594 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2593999999999998e-05 2024-04-19T03:02:36.594 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.594 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.594 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:36.594 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:36.562592+0000", 2024-04-19T03:02:36.594 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4073999999999999e-05 2024-04-19T03:02:36.594 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.594 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.594 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:36.594 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:36.562601+0000", 2024-04-19T03:02:36.594 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.2280000000000004e-06 2024-04-19T03:02:36.594 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.595 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.595 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:36.595 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:36.562652+0000", 2024-04-19T03:02:36.595 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1292999999999998e-05 2024-04-19T03:02:36.595 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.595 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.595 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:36.595 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:36.562680+0000", 2024-04-19T03:02:36.595 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7464999999999999e-05 2024-04-19T03:02:36.595 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:36.595 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:36.595 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:36.595 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.595 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.596 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:110984 5.d 5:bd879400:::benchmark_data_smithi096_19531_object110983:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-19T03:02:36.596 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:36.563942+0000", 2024-04-19T03:02:36.596 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.001299604, 2024-04-19T03:02:36.596 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0018968469999999999, 2024-04-19T03:02:36.596 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:36.596 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:02:36.596 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:36.596 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:36.596 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:36.596 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 110984 2024-04-19T03:02:36.596 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.596 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:36.596 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.596 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:36.597 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:36.563942+0000", 2024-04-19T03:02:36.597 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:36.597 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.597 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.597 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:36.597 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:36.563942+0000", 2024-04-19T03:02:36.597 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:36.597 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.597 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.597 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:36.597 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:36.563940+0000", 2024-04-19T03:02:36.597 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:36.597 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.597 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.598 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:36.598 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:36.563987+0000", 2024-04-19T03:02:36.598 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6214999999999997e-05 2024-04-19T03:02:36.598 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.598 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.598 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:36.598 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:36.564003+0000", 2024-04-19T03:02:36.598 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6285000000000001e-05 2024-04-19T03:02:36.598 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.598 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.598 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:36.598 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:36.564014+0000", 2024-04-19T03:02:36.598 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1365e-05 2024-04-19T03:02:36.598 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.599 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.599 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:36.599 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:36.564076+0000", 2024-04-19T03:02:36.599 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1873999999999997e-05 2024-04-19T03:02:36.599 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.599 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.599 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:36.599 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:36.564253+0000", 2024-04-19T03:02:36.599 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00017660500000000001 2024-04-19T03:02:36.599 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.599 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.599 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-04-19T03:02:36.599 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:36.564436+0000", 2024-04-19T03:02:36.599 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000183647 2024-04-19T03:02:36.600 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:36.600 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:36.600 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:36.600 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.600 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.600 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:110985 5.a 5:5f894b83:::benchmark_data_smithi096_19531_object110984:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-19T03:02:36.600 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:36.564031+0000", 2024-04-19T03:02:36.600 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0012104150000000001, 2024-04-19T03:02:36.600 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0018870989999999999, 2024-04-19T03:02:36.600 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:36.600 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-19T03:02:36.600 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:36.600 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:36.600 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:36.600 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 110985 2024-04-19T03:02:36.601 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.601 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:36.601 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.601 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:36.601 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:36.564031+0000", 2024-04-19T03:02:36.601 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:36.601 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.601 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.601 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:36.601 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:36.564031+0000", 2024-04-19T03:02:36.601 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:36.601 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.601 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.601 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:36.601 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:36.564030+0000", 2024-04-19T03:02:36.602 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:36.602 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.602 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.602 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:36.602 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:36.564067+0000", 2024-04-19T03:02:36.602 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7078e-05 2024-04-19T03:02:36.602 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.602 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.602 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:36.602 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:36.564077+0000", 2024-04-19T03:02:36.602 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.3980000000000005e-06 2024-04-19T03:02:36.602 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.602 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.602 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:36.603 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:36.564085+0000", 2024-04-19T03:02:36.603 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.4749999999999993e-06 2024-04-19T03:02:36.603 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.603 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.603 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:36.603 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:36.564140+0000", 2024-04-19T03:02:36.603 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4611000000000003e-05 2024-04-19T03:02:36.603 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.603 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.603 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:36.603 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:36.564240+0000", 2024-04-19T03:02:36.603 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000100828 2024-04-19T03:02:36.603 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:36.603 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:36.604 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:36.604 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.604 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.604 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop_reply(client.4755.0:110973 5.d e48/22)", 2024-04-19T03:02:36.604 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:36.564574+0000", 2024-04-19T03:02:36.604 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.00066696099999999999, 2024-04-19T03:02:36.604 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0014206729999999999, 2024-04-19T03:02:36.604 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:36.604 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-04-19T03:02:36.604 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:36.604 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.604 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:36.604 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:36.564574+0000", 2024-04-19T03:02:36.605 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:36.605 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.605 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.605 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:36.605 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:36.564574+0000", 2024-04-19T03:02:36.605 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:36.605 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.605 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.605 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:36.605 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:36.564573+0000", 2024-04-19T03:02:36.605 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:36.605 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.605 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.605 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:36.606 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:36.564580+0000", 2024-04-19T03:02:36.606 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5719999999999999e-06 2024-04-19T03:02:36.606 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.606 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.606 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:36.606 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:36.564594+0000", 2024-04-19T03:02:36.606 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4531e-05 2024-04-19T03:02:36.606 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.606 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.606 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:36.606 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:36.564602+0000", 2024-04-19T03:02:36.606 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.6879999999999999e-06 2024-04-19T03:02:36.606 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:36.606 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:36.607 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:36.607 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.607 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.607 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4755.0:110980 5.f e48/22)", 2024-04-19T03:02:36.607 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:36.565194+0000", 2024-04-19T03:02:36.607 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 4.7178999999999997e-05, 2024-04-19T03:02:36.607 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000847228, 2024-04-19T03:02:36.607 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:36.607 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-04-19T03:02:36.607 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:36.607 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.607 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:36.607 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:36.565194+0000", 2024-04-19T03:02:36.607 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:36.607 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.608 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.608 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:36.608 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:36.565194+0000", 2024-04-19T03:02:36.608 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:36.608 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.608 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.608 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:36.608 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:36.565193+0000", 2024-04-19T03:02:36.608 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:36.608 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.608 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.608 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:36.608 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:36.565244+0000", 2024-04-19T03:02:36.608 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0408999999999998e-05 2024-04-19T03:02:36.608 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.609 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.609 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:36.609 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:36.565255+0000", 2024-04-19T03:02:36.609 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1919999999999999e-05 2024-04-19T03:02:36.609 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.609 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.609 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:36.609 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:36.565262+0000", 2024-04-19T03:02:36.609 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.0079999999999996e-06 2024-04-19T03:02:36.609 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:36.609 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:36.609 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:36.609 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.610 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.610 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:110986 5.d 5.4da4a6fd (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-19T03:02:36.610 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:36.565373+0000", 2024-04-19T03:02:36.610 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 4294967295.9998679, 2024-04-19T03:02:36.610 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00071729900000000002, 2024-04-19T03:02:36.610 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:36.610 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-04-19T03:02:36.610 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:36.610 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:36.610 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:36.610 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 110986 2024-04-19T03:02:36.610 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.610 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:36.610 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.611 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:36.611 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:36.565373+0000", 2024-04-19T03:02:36.611 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:36.611 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.611 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.611 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:36.611 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:36.565373+0000", 2024-04-19T03:02:36.611 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:36.611 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.611 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.611 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:36.611 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:36.565372+0000", 2024-04-19T03:02:36.611 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:36.611 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.611 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.612 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:36.612 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:36.565428+0000", 2024-04-19T03:02:36.612 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5229999999999998e-05 2024-04-19T03:02:36.612 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.612 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.612 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:36.612 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:36.565438+0000", 2024-04-19T03:02:36.612 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0586e-05 2024-04-19T03:02:36.612 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.612 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.612 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:36.612 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:36.565445+0000", 2024-04-19T03:02:36.612 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.0169999999999999e-06 2024-04-19T03:02:36.612 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:36.612 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:36.613 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:36.613 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:36.613 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-04-19T03:02:36.613 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 12 2024-04-19T03:02:36.613 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-19T03:02:36.614 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T03:02:36.637 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:36.633+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:36.737 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:36.735+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:36.743 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-19T03:02:36.744 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-04-19T03:02:36.744 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-04-19T03:02:36.744 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-04-19T03:02:36.744 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-19T03:02:36.757 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T03:02:36.826 INFO:tasks.radosbench.radosbench.0.smithi096.stdout: 59 16 111523 111507 118.108 123.562 0.00446341 0.00846127 2024-04-19T03:02:36.838 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:36.835+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:36.887 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-19T03:02:36.887 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-04-19T03:02:36.887 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-04-19T03:02:36.887 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-04-19T03:02:36.887 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.887 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:79014 5.d 5:b5eee02c:::benchmark_data_smithi096_19531_object79013:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-19T03:02:36.887 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:18.032471+0000", 2024-04-19T03:02:36.887 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 18.852086196999998, 2024-04-19T03:02:36.888 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.041427629000000001, 2024-04-19T03:02:36.888 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:36.888 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:36.888 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:36.888 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:36.888 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:36.888 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 79014 2024-04-19T03:02:36.888 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.888 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:36.888 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.888 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:36.888 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:18.032471+0000", 2024-04-19T03:02:36.888 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:36.888 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.889 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.889 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:36.889 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:18.032471+0000", 2024-04-19T03:02:36.889 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:36.889 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.889 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.889 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:36.889 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:18.032470+0000", 2024-04-19T03:02:36.889 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:36.889 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.889 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.889 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:36.890 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:18.032525+0000", 2024-04-19T03:02:36.890 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5535999999999998e-05 2024-04-19T03:02:36.890 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.890 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.890 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:36.890 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:18.032537+0000", 2024-04-19T03:02:36.890 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1987999999999999e-05 2024-04-19T03:02:36.890 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.890 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.890 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:36.890 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:18.032546+0000", 2024-04-19T03:02:36.890 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9670000000000007e-06 2024-04-19T03:02:36.891 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.891 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.891 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:36.891 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:18.032613+0000", 2024-04-19T03:02:36.891 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6508999999999996e-05 2024-04-19T03:02:36.891 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.891 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.891 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:36.891 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:18.032738+0000", 2024-04-19T03:02:36.891 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000124912 2024-04-19T03:02:36.891 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.891 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.891 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-04-19T03:02:36.891 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:18.032867+0000", 2024-04-19T03:02:36.892 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012959399999999999 2024-04-19T03:02:36.892 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.892 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.892 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:36.892 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:18.035867+0000", 2024-04-19T03:02:36.892 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.002999378 2024-04-19T03:02:36.892 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.892 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.892 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:36.892 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:18.073705+0000", 2024-04-19T03:02:36.892 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.037838042000000002 2024-04-19T03:02:36.892 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.892 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.892 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:36.893 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:18.073813+0000", 2024-04-19T03:02:36.893 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010806099999999999 2024-04-19T03:02:36.893 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.893 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.893 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:36.893 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:18.073899+0000", 2024-04-19T03:02:36.893 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.5971999999999996e-05 2024-04-19T03:02:36.893 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:36.893 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:36.893 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:36.893 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.893 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.893 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:86615 5.e 5:7fef7288:::benchmark_data_smithi096_19531_object86614:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:36.893 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:22.634544+0000", 2024-04-19T03:02:36.894 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 14.250013217999999, 2024-04-19T03:02:36.894 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.192475071, 2024-04-19T03:02:36.894 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:36.894 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:36.894 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:36.894 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:36.894 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:36.894 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 86615 2024-04-19T03:02:36.894 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.894 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:36.894 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.894 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:36.894 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634544+0000", 2024-04-19T03:02:36.895 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:36.895 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.895 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.895 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:36.895 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634544+0000", 2024-04-19T03:02:36.895 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:36.895 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.895 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.895 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:36.895 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634542+0000", 2024-04-19T03:02:36.895 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999981 2024-04-19T03:02:36.895 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.895 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.896 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:36.896 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634585+0000", 2024-04-19T03:02:36.896 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2299000000000003e-05 2024-04-19T03:02:36.896 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.896 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.896 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:36.896 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634592+0000", 2024-04-19T03:02:36.896 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2350000000000002e-06 2024-04-19T03:02:36.896 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.896 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.896 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:36.896 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634596+0000", 2024-04-19T03:02:36.896 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5390000000000001e-06 2024-04-19T03:02:36.896 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.896 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.897 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:36.897 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634639+0000", 2024-04-19T03:02:36.897 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2444999999999998e-05 2024-04-19T03:02:36.897 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.897 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.897 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:36.897 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634808+0000", 2024-04-19T03:02:36.897 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000169152 2024-04-19T03:02:36.897 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.897 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.897 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:36.897 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634999+0000", 2024-04-19T03:02:36.897 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00019098300000000001 2024-04-19T03:02:36.897 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.897 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.898 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:36.898 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.640458+0000", 2024-04-19T03:02:36.898 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0054586870000000003 2024-04-19T03:02:36.898 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.898 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.898 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:36.898 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.826949+0000", 2024-04-19T03:02:36.898 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.18649178299999999 2024-04-19T03:02:36.898 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.898 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.898 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:36.898 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.826982+0000", 2024-04-19T03:02:36.898 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2477000000000001e-05 2024-04-19T03:02:36.899 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.899 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.899 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:36.899 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.827019+0000", 2024-04-19T03:02:36.899 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7355999999999999e-05 2024-04-19T03:02:36.899 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:36.899 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:36.899 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:36.899 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.899 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.899 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:86616 5.e 5:72278f47:::benchmark_data_smithi096_19531_object86615:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:36.899 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:22.634609+0000", 2024-04-19T03:02:36.899 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 14.249948069, 2024-04-19T03:02:36.899 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.19472088900000001, 2024-04-19T03:02:36.899 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:36.900 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:36.900 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:36.900 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:36.900 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:36.900 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 86616 2024-04-19T03:02:36.900 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.900 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:36.900 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.900 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:36.900 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634609+0000", 2024-04-19T03:02:36.900 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:36.900 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.900 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.900 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:36.901 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634609+0000", 2024-04-19T03:02:36.901 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:36.901 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.901 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.901 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:36.901 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634609+0000", 2024-04-19T03:02:36.901 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:36.901 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.901 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.901 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:36.901 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634651+0000", 2024-04-19T03:02:36.901 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2589000000000002e-05 2024-04-19T03:02:36.901 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.901 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.901 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:36.902 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634659+0000", 2024-04-19T03:02:36.902 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5850000000000002e-06 2024-04-19T03:02:36.902 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.902 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.902 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:36.902 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634662+0000", 2024-04-19T03:02:36.902 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3620000000000002e-06 2024-04-19T03:02:36.902 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.902 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.902 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:36.902 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.637880+0000", 2024-04-19T03:02:36.902 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.003218149 2024-04-19T03:02:36.902 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.903 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.903 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:36.903 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.637999+0000", 2024-04-19T03:02:36.903 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000118643 2024-04-19T03:02:36.903 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.903 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.903 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:36.903 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.638102+0000", 2024-04-19T03:02:36.903 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010331 2024-04-19T03:02:36.903 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.903 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.903 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:36.903 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.640851+0000", 2024-04-19T03:02:36.903 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0027483310000000001 2024-04-19T03:02:36.903 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.904 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.904 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:36.904 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.829269+0000", 2024-04-19T03:02:36.904 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.188418319 2024-04-19T03:02:36.904 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.904 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.904 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:36.904 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.829299+0000", 2024-04-19T03:02:36.904 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0227e-05 2024-04-19T03:02:36.904 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.904 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.904 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:36.904 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.829330+0000", 2024-04-19T03:02:36.904 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0969000000000001e-05 2024-04-19T03:02:36.905 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:36.905 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:36.905 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:36.905 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.905 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.905 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:86618 5.0 5:09014b90:::benchmark_data_smithi096_19531_object86617:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:36.905 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:22.634894+0000", 2024-04-19T03:02:36.905 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 14.249663581, 2024-04-19T03:02:36.905 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.19413419800000001, 2024-04-19T03:02:36.905 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:36.905 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:36.905 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:36.905 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:36.906 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:36.906 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 86618 2024-04-19T03:02:36.906 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.906 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:36.906 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.906 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:36.906 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634894+0000", 2024-04-19T03:02:36.906 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:36.906 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.906 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.906 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:36.906 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634894+0000", 2024-04-19T03:02:36.906 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:36.906 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.907 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.907 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:36.907 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634893+0000", 2024-04-19T03:02:36.907 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:36.907 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.907 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.907 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:36.907 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634976+0000", 2024-04-19T03:02:36.907 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3231000000000003e-05 2024-04-19T03:02:36.907 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.907 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.907 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:36.907 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634983+0000", 2024-04-19T03:02:36.908 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5169999999999996e-06 2024-04-19T03:02:36.908 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.908 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.908 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:36.908 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634987+0000", 2024-04-19T03:02:36.908 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.425e-06 2024-04-19T03:02:36.908 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.908 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.908 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:36.908 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635030+0000", 2024-04-19T03:02:36.908 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.32e-05 2024-04-19T03:02:36.908 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.908 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.908 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:36.909 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635185+0000", 2024-04-19T03:02:36.909 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015471899999999999 2024-04-19T03:02:36.909 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.909 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.909 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:36.909 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635415+0000", 2024-04-19T03:02:36.909 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00023026500000000001 2024-04-19T03:02:36.909 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.909 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.909 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:36.909 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.640127+0000", 2024-04-19T03:02:36.909 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0047118890000000004 2024-04-19T03:02:36.909 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.909 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.910 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:36.910 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.828895+0000", 2024-04-19T03:02:36.910 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.18876802600000001 2024-04-19T03:02:36.910 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.910 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.910 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:36.910 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.828972+0000", 2024-04-19T03:02:36.910 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.6345000000000002e-05 2024-04-19T03:02:36.910 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.910 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.910 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:36.910 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.829028+0000", 2024-04-19T03:02:36.911 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6342999999999999e-05 2024-04-19T03:02:36.911 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:36.912 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:36.912 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:36.912 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.912 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.912 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:86620 5.b 5:d80faa68:::benchmark_data_smithi096_19531_object86619:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:36.912 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:22.635110+0000", 2024-04-19T03:02:36.912 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 14.249447021, 2024-04-19T03:02:36.912 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.193447275, 2024-04-19T03:02:36.912 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:36.912 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:36.912 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:36.912 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:36.912 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:36.912 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 86620 2024-04-19T03:02:36.913 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.913 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:36.913 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.913 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:36.913 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635110+0000", 2024-04-19T03:02:36.913 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:36.913 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.913 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.913 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:36.913 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635110+0000", 2024-04-19T03:02:36.913 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:36.913 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.913 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.913 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:36.913 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635110+0000", 2024-04-19T03:02:36.914 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:36.914 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.914 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.914 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:36.914 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635154+0000", 2024-04-19T03:02:36.914 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4681000000000001e-05 2024-04-19T03:02:36.914 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.914 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.914 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:36.914 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635166+0000", 2024-04-19T03:02:36.914 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1505000000000001e-05 2024-04-19T03:02:36.914 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.914 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.914 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:36.915 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635171+0000", 2024-04-19T03:02:36.915 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6040000000000003e-06 2024-04-19T03:02:36.915 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.915 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.915 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:36.915 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635221+0000", 2024-04-19T03:02:36.915 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9947000000000001e-05 2024-04-19T03:02:36.915 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.915 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.915 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:36.915 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635356+0000", 2024-04-19T03:02:36.915 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013576199999999999 2024-04-19T03:02:36.915 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.915 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.916 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:36.916 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635507+0000", 2024-04-19T03:02:36.916 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015072999999999999 2024-04-19T03:02:36.916 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.916 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.916 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:36.916 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.638488+0000", 2024-04-19T03:02:36.916 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0029813159999999999 2024-04-19T03:02:36.916 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.916 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.916 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:36.916 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.828341+0000", 2024-04-19T03:02:36.916 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.189852254 2024-04-19T03:02:36.916 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.916 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.917 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:36.917 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.828416+0000", 2024-04-19T03:02:36.917 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5344000000000002e-05 2024-04-19T03:02:36.917 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.917 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.917 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:36.917 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.828558+0000", 2024-04-19T03:02:36.917 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000141695 2024-04-19T03:02:36.917 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:36.917 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:36.917 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:36.917 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.917 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.917 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:86621 5.8 5:1597a420:::benchmark_data_smithi096_19531_object86620:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:36.917 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:22.635187+0000", 2024-04-19T03:02:36.917 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 14.249370161, 2024-04-19T03:02:36.918 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.194204878, 2024-04-19T03:02:36.918 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:36.918 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:36.918 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:36.918 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:36.918 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:36.918 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 86621 2024-04-19T03:02:36.918 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.918 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:36.918 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.918 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:36.918 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635187+0000", 2024-04-19T03:02:36.918 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:36.919 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.919 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.919 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:36.919 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635187+0000", 2024-04-19T03:02:36.919 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:36.919 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.919 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.919 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:36.919 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635187+0000", 2024-04-19T03:02:36.919 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:36.919 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.919 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.919 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:36.919 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635242+0000", 2024-04-19T03:02:36.919 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5158000000000003e-05 2024-04-19T03:02:36.919 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.920 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.920 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:36.920 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635249+0000", 2024-04-19T03:02:36.920 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.7000000000000008e-06 2024-04-19T03:02:36.920 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.920 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.920 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:36.920 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635256+0000", 2024-04-19T03:02:36.920 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2060000000000004e-06 2024-04-19T03:02:36.920 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.920 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.920 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:36.920 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635302+0000", 2024-04-19T03:02:36.920 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5954000000000001e-05 2024-04-19T03:02:36.920 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.921 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.921 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:36.921 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635427+0000", 2024-04-19T03:02:36.921 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012559299999999999 2024-04-19T03:02:36.921 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.921 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.921 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:36.921 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635596+0000", 2024-04-19T03:02:36.921 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000168615 2024-04-19T03:02:36.921 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.921 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.921 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:36.921 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.639320+0000", 2024-04-19T03:02:36.921 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0037244610000000001 2024-04-19T03:02:36.922 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.922 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.922 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:36.922 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.829277+0000", 2024-04-19T03:02:36.922 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.18995651099999999 2024-04-19T03:02:36.922 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.922 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.922 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:36.922 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.829341+0000", 2024-04-19T03:02:36.922 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3756000000000004e-05 2024-04-19T03:02:36.922 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.922 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.922 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:36.923 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.829392+0000", 2024-04-19T03:02:36.923 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1555999999999999e-05 2024-04-19T03:02:36.923 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:36.923 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:36.923 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:36.923 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.923 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.923 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87062 5.4 5:2d3b5d9a:::benchmark_data_smithi096_19531_object87061:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:36.923 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.136820+0000", 2024-04-19T03:02:36.923 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 13.747737008, 2024-04-19T03:02:36.923 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.066483741999999998, 2024-04-19T03:02:36.923 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:36.923 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:36.923 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:36.924 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:36.924 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:36.924 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87062 2024-04-19T03:02:36.924 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.924 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:36.924 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.924 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:36.924 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.136820+0000", 2024-04-19T03:02:36.924 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:36.924 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.924 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.924 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:36.924 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.136820+0000", 2024-04-19T03:02:36.924 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:36.925 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.925 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.925 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:36.925 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.136819+0000", 2024-04-19T03:02:36.925 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:36.925 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.925 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.925 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:36.925 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.136864+0000", 2024-04-19T03:02:36.925 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4855000000000003e-05 2024-04-19T03:02:36.925 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.925 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.925 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:36.925 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.136881+0000", 2024-04-19T03:02:36.926 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7521999999999999e-05 2024-04-19T03:02:36.926 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.926 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.926 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:36.926 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.136890+0000", 2024-04-19T03:02:36.926 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1039999999999996e-06 2024-04-19T03:02:36.926 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.926 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.926 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:36.926 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.136974+0000", 2024-04-19T03:02:36.926 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3735999999999999e-05 2024-04-19T03:02:36.926 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.926 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.927 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:36.927 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.137308+0000", 2024-04-19T03:02:36.927 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00033376100000000002 2024-04-19T03:02:36.927 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.927 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.927 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:36.927 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.137559+0000", 2024-04-19T03:02:36.927 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000250599 2024-04-19T03:02:36.927 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.927 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.927 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:36.927 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.145423+0000", 2024-04-19T03:02:36.927 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0078649589999999995 2024-04-19T03:02:36.927 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.928 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.928 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:36.928 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.203175+0000", 2024-04-19T03:02:36.928 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057751255000000001 2024-04-19T03:02:36.928 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.928 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.928 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:36.928 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.203250+0000", 2024-04-19T03:02:36.928 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5378999999999998e-05 2024-04-19T03:02:36.928 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.928 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.928 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:36.928 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.203304+0000", 2024-04-19T03:02:36.929 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4015999999999999e-05 2024-04-19T03:02:36.929 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:36.929 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:36.929 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:36.929 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.929 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.929 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87065 5.4 5:21d20a47:::benchmark_data_smithi096_19531_object87064:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:36.929 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.137482+0000", 2024-04-19T03:02:36.929 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 13.747075274, 2024-04-19T03:02:36.929 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.065988749999999999, 2024-04-19T03:02:36.929 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:36.929 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:36.929 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:36.929 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:36.929 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:36.930 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87065 2024-04-19T03:02:36.930 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.930 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:36.930 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.930 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:36.930 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.137482+0000", 2024-04-19T03:02:36.930 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:36.930 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.930 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.930 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:36.930 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.137482+0000", 2024-04-19T03:02:36.930 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:36.930 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.930 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.931 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:36.931 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.137481+0000", 2024-04-19T03:02:36.931 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:36.931 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.931 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.931 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:36.931 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.137530+0000", 2024-04-19T03:02:36.931 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9302000000000003e-05 2024-04-19T03:02:36.931 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.931 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.931 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:36.931 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.137540+0000", 2024-04-19T03:02:36.932 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.2010000000000005e-06 2024-04-19T03:02:36.932 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.932 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.932 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:36.932 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.137545+0000", 2024-04-19T03:02:36.932 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5910000000000003e-06 2024-04-19T03:02:36.932 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.932 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.932 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:36.932 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.140666+0000", 2024-04-19T03:02:36.932 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0031212710000000001 2024-04-19T03:02:36.932 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.932 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.932 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:36.933 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.140847+0000", 2024-04-19T03:02:36.933 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00018065600000000001 2024-04-19T03:02:36.933 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.933 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.933 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:36.933 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.140991+0000", 2024-04-19T03:02:36.933 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014433100000000001 2024-04-19T03:02:36.933 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.933 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.933 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:36.933 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.148053+0000", 2024-04-19T03:02:36.933 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.007061945 2024-04-19T03:02:36.933 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.934 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.934 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:36.934 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.203367+0000", 2024-04-19T03:02:36.934 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.055313703999999998 2024-04-19T03:02:36.934 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.934 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.934 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:36.934 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.203426+0000", 2024-04-19T03:02:36.934 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9024000000000003e-05 2024-04-19T03:02:36.934 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.934 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.934 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:36.935 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.203471+0000", 2024-04-19T03:02:36.935 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4818999999999999e-05 2024-04-19T03:02:36.935 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:36.935 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:36.935 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:36.935 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.935 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.935 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87067 5.b 5:d57af71a:::benchmark_data_smithi096_19531_object87066:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:36.935 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.142233+0000", 2024-04-19T03:02:36.935 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 13.742324298, 2024-04-19T03:02:36.935 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.071692405000000001, 2024-04-19T03:02:36.935 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:36.935 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:36.935 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:36.936 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:36.936 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:36.936 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87067 2024-04-19T03:02:36.936 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.936 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:36.936 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.936 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:36.936 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142233+0000", 2024-04-19T03:02:36.936 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:36.936 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.936 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.936 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:36.936 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142233+0000", 2024-04-19T03:02:36.936 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:36.937 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.937 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.937 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:36.937 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142232+0000", 2024-04-19T03:02:36.937 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:36.937 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.937 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.937 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:36.937 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142277+0000", 2024-04-19T03:02:36.937 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5837000000000002e-05 2024-04-19T03:02:36.937 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.937 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.937 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:36.937 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142297+0000", 2024-04-19T03:02:36.937 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9561000000000001e-05 2024-04-19T03:02:36.938 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.938 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.938 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:36.938 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142311+0000", 2024-04-19T03:02:36.938 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3654e-05 2024-04-19T03:02:36.938 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.938 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.938 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:36.938 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142391+0000", 2024-04-19T03:02:36.938 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0123999999999994e-05 2024-04-19T03:02:36.938 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.938 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.938 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:36.938 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142669+0000", 2024-04-19T03:02:36.939 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00027829800000000001 2024-04-19T03:02:36.939 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.939 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.939 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:36.939 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142859+0000", 2024-04-19T03:02:36.939 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000190051 2024-04-19T03:02:36.939 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.939 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.939 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:36.939 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.150597+0000", 2024-04-19T03:02:36.939 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0077380299999999999 2024-04-19T03:02:36.939 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.939 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.939 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:36.940 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.213855+0000", 2024-04-19T03:02:36.940 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.063257987000000002 2024-04-19T03:02:36.940 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.940 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.940 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:36.940 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.213898+0000", 2024-04-19T03:02:36.940 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2916e-05 2024-04-19T03:02:36.940 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.940 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.940 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:36.940 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.213925+0000", 2024-04-19T03:02:36.940 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7503000000000001e-05 2024-04-19T03:02:36.940 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:36.940 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:36.941 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:36.941 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.941 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.941 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87069 5.b 5:da0c93b5:::benchmark_data_smithi096_19531_object87068:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:36.941 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.143402+0000", 2024-04-19T03:02:36.941 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 13.741155336, 2024-04-19T03:02:36.941 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.070678598999999995, 2024-04-19T03:02:36.941 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:36.941 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:36.941 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:36.941 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:36.941 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:36.941 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87069 2024-04-19T03:02:36.941 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.942 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:36.942 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.942 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:36.942 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.143402+0000", 2024-04-19T03:02:36.942 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:36.942 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.942 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.942 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:36.942 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.143402+0000", 2024-04-19T03:02:36.942 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:36.942 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.942 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.942 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:36.943 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.143401+0000", 2024-04-19T03:02:36.943 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:36.943 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.943 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.943 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:36.943 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.143501+0000", 2024-04-19T03:02:36.943 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000100387 2024-04-19T03:02:36.943 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.943 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.943 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:36.943 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.143516+0000", 2024-04-19T03:02:36.943 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5369000000000001e-05 2024-04-19T03:02:36.943 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.944 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.944 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:36.944 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.143524+0000", 2024-04-19T03:02:36.944 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.7079999999999997e-06 2024-04-19T03:02:36.944 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.944 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.944 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:36.944 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.145550+0000", 2024-04-19T03:02:36.944 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0020259290000000001 2024-04-19T03:02:36.944 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.944 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.944 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:36.944 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.145676+0000", 2024-04-19T03:02:36.944 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000126406 2024-04-19T03:02:36.944 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.945 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.945 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:36.945 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.145802+0000", 2024-04-19T03:02:36.945 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000125974 2024-04-19T03:02:36.945 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.945 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.945 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:36.945 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.151030+0000", 2024-04-19T03:02:36.945 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0052276079999999999 2024-04-19T03:02:36.945 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.945 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.945 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:36.945 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.213998+0000", 2024-04-19T03:02:36.945 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.06296786 2024-04-19T03:02:36.945 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.946 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.946 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:36.946 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.214031+0000", 2024-04-19T03:02:36.946 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3387999999999999e-05 2024-04-19T03:02:36.946 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.946 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.946 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:36.946 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.214081+0000", 2024-04-19T03:02:36.946 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9316e-05 2024-04-19T03:02:36.946 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:36.946 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:36.946 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:36.946 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.946 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.947 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87073 5.0 5:0ca21233:::benchmark_data_smithi096_19531_object87072:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:36.947 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.145929+0000", 2024-04-19T03:02:36.947 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 13.738628075999999, 2024-04-19T03:02:36.947 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.062283234999999999, 2024-04-19T03:02:36.947 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:36.947 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:36.947 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:36.947 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:36.947 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:36.947 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87073 2024-04-19T03:02:36.947 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.947 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:36.948 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.948 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:36.948 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.145929+0000", 2024-04-19T03:02:36.948 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:36.948 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.948 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.948 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:36.948 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.145929+0000", 2024-04-19T03:02:36.948 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:36.948 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.948 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.948 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:36.948 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.145928+0000", 2024-04-19T03:02:36.948 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:36.949 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.949 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.949 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:36.949 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.146063+0000", 2024-04-19T03:02:36.949 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013541099999999999 2024-04-19T03:02:36.949 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.949 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.949 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:36.949 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.146079+0000", 2024-04-19T03:02:36.949 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5902000000000001e-05 2024-04-19T03:02:36.949 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.949 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.949 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:36.949 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.146100+0000", 2024-04-19T03:02:36.950 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0380000000000001e-05 2024-04-19T03:02:36.950 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.950 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.950 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:36.950 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.146193+0000", 2024-04-19T03:02:36.950 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.3669000000000001e-05 2024-04-19T03:02:36.950 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.950 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.950 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:36.950 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.146388+0000", 2024-04-19T03:02:36.950 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00019457799999999999 2024-04-19T03:02:36.950 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.950 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.951 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:36.951 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.146625+0000", 2024-04-19T03:02:36.951 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00023751999999999999 2024-04-19T03:02:36.951 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.951 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.951 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:36.951 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.151051+0000", 2024-04-19T03:02:36.951 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0044260039999999999 2024-04-19T03:02:36.951 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.951 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.951 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:36.951 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.207872+0000", 2024-04-19T03:02:36.951 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.056821114999999998 2024-04-19T03:02:36.951 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.952 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.952 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:36.952 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.208085+0000", 2024-04-19T03:02:36.952 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000212893 2024-04-19T03:02:36.952 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.952 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.952 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:36.952 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.208213+0000", 2024-04-19T03:02:36.952 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012714700000000001 2024-04-19T03:02:36.952 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:36.952 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:36.952 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:36.952 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.952 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.953 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87074 5.0 5:035614ac:::benchmark_data_smithi096_19531_object87073:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:36.953 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.151387+0000", 2024-04-19T03:02:36.953 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 13.733170145000001, 2024-04-19T03:02:36.953 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.063461771, 2024-04-19T03:02:36.953 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:36.953 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:36.953 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:36.953 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:36.953 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:36.953 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87074 2024-04-19T03:02:36.953 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.953 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:36.953 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.953 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:36.954 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.151387+0000", 2024-04-19T03:02:36.954 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:36.954 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.954 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.954 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:36.954 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.151387+0000", 2024-04-19T03:02:36.954 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:36.954 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.954 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.954 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:36.954 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.151386+0000", 2024-04-19T03:02:36.954 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:36.954 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.955 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.955 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:36.955 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.151428+0000", 2024-04-19T03:02:36.955 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.172e-05 2024-04-19T03:02:36.955 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.955 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.955 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:36.955 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.151442+0000", 2024-04-19T03:02:36.955 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4328000000000001e-05 2024-04-19T03:02:36.955 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.955 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.956 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:36.956 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.151451+0000", 2024-04-19T03:02:36.956 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.8400000000000001e-06 2024-04-19T03:02:36.956 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.956 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.956 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:36.956 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.151521+0000", 2024-04-19T03:02:36.956 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.9606999999999999e-05 2024-04-19T03:02:36.956 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.957 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.957 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:36.957 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.151749+0000", 2024-04-19T03:02:36.957 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00022818799999999999 2024-04-19T03:02:36.957 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.957 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.957 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:36.957 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.152006+0000", 2024-04-19T03:02:36.957 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00025687300000000002 2024-04-19T03:02:36.957 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.957 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.957 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:36.957 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.154887+0000", 2024-04-19T03:02:36.958 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0028812989999999999 2024-04-19T03:02:36.958 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.958 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.958 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:36.958 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.214733+0000", 2024-04-19T03:02:36.958 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.059846159000000003 2024-04-19T03:02:36.958 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.958 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.958 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:36.958 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.214788+0000", 2024-04-19T03:02:36.958 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4524000000000002e-05 2024-04-19T03:02:36.958 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.958 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.959 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:36.959 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.214849+0000", 2024-04-19T03:02:36.959 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1362e-05 2024-04-19T03:02:36.959 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:36.959 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:36.959 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:36.959 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.959 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.959 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87108 5.e 5:7e197adc:::benchmark_data_smithi096_19531_object87107:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:36.959 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.223103+0000", 2024-04-19T03:02:36.959 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 13.661453999000001, 2024-04-19T03:02:36.959 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.044946887, 2024-04-19T03:02:36.959 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:36.960 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-19T03:02:36.960 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:36.960 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:36.960 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:36.960 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87108 2024-04-19T03:02:36.960 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.960 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:36.960 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.960 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:36.960 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.223103+0000", 2024-04-19T03:02:36.960 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:36.960 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.960 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.961 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:36.961 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.223103+0000", 2024-04-19T03:02:36.961 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:36.961 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.961 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.961 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:36.961 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.223102+0000", 2024-04-19T03:02:36.961 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:36.961 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.961 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.961 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:36.961 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.223156+0000", 2024-04-19T03:02:36.961 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3958000000000001e-05 2024-04-19T03:02:36.962 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.962 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.962 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:36.962 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.223166+0000", 2024-04-19T03:02:36.962 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.4809999999999995e-06 2024-04-19T03:02:36.962 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.962 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.962 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:36.962 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.223172+0000", 2024-04-19T03:02:36.962 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0140000000000004e-06 2024-04-19T03:02:36.962 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.962 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.962 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:36.965 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.227295+0000", 2024-04-19T03:02:36.966 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0041233420000000003 2024-04-19T03:02:36.966 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.966 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.966 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:36.966 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.227495+0000", 2024-04-19T03:02:36.966 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00019955299999999999 2024-04-19T03:02:36.966 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.966 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.966 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:36.966 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.227717+0000", 2024-04-19T03:02:36.966 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000221902 2024-04-19T03:02:36.967 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.967 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.967 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:36.967 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233189+0000", 2024-04-19T03:02:36.967 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0054718889999999997 2024-04-19T03:02:36.967 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.967 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.967 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:36.967 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.250529+0000", 2024-04-19T03:02:36.967 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.017340298000000001 2024-04-19T03:02:36.967 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.967 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.968 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:02:36.968 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.250539+0000", 2024-04-19T03:02:36.968 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0501e-05 2024-04-19T03:02:36.968 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.968 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.968 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:36.968 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.268003+0000", 2024-04-19T03:02:36.968 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.017463429 2024-04-19T03:02:36.968 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.968 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.968 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:36.968 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.268050+0000", 2024-04-19T03:02:36.968 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7466000000000003e-05 2024-04-19T03:02:36.968 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:36.969 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:36.969 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:36.969 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.969 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.969 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87118 5.b 5:d1bb4f3c:::benchmark_data_smithi096_19531_object87117:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:36.969 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.231082+0000", 2024-04-19T03:02:36.969 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 13.653475165, 2024-04-19T03:02:36.969 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.035789004, 2024-04-19T03:02:36.969 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:36.969 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-19T03:02:36.969 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:36.969 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:36.969 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:36.969 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87118 2024-04-19T03:02:36.970 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.970 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:36.970 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.970 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:36.970 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231082+0000", 2024-04-19T03:02:36.970 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:36.970 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.970 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.970 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:36.970 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231082+0000", 2024-04-19T03:02:36.970 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:36.970 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.970 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.970 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:36.971 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231081+0000", 2024-04-19T03:02:36.971 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:36.971 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.971 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.971 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:36.971 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231159+0000", 2024-04-19T03:02:36.971 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.7819999999999997e-05 2024-04-19T03:02:36.971 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.971 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.971 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:36.971 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231186+0000", 2024-04-19T03:02:36.971 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7126000000000001e-05 2024-04-19T03:02:36.971 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.971 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.971 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:36.972 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231193+0000", 2024-04-19T03:02:36.972 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7259999999999996e-06 2024-04-19T03:02:36.972 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.972 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.972 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:36.972 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231241+0000", 2024-04-19T03:02:36.972 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8123e-05 2024-04-19T03:02:36.972 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.972 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.972 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:36.972 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231354+0000", 2024-04-19T03:02:36.972 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0001133 2024-04-19T03:02:36.972 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.972 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.972 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:36.972 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231443+0000", 2024-04-19T03:02:36.973 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9167999999999997e-05 2024-04-19T03:02:36.973 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.973 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.973 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:36.973 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236498+0000", 2024-04-19T03:02:36.973 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0050545160000000002 2024-04-19T03:02:36.973 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.973 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.973 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:36.973 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.249681+0000", 2024-04-19T03:02:36.973 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013183321 2024-04-19T03:02:36.973 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.973 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.973 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:02:36.973 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.249693+0000", 2024-04-19T03:02:36.974 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1834999999999999e-05 2024-04-19T03:02:36.974 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.974 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.974 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:36.974 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266733+0000", 2024-04-19T03:02:36.974 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.017040408 2024-04-19T03:02:36.974 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.974 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.974 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:36.974 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266871+0000", 2024-04-19T03:02:36.974 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000137849 2024-04-19T03:02:36.974 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:36.974 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:36.975 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:36.975 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.975 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.975 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87121 5.b 5:d01822b8:::benchmark_data_smithi096_19531_object87120:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:36.975 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.233319+0000", 2024-04-19T03:02:36.975 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 13.651238300999999, 2024-04-19T03:02:36.975 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.033624198, 2024-04-19T03:02:36.975 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:36.975 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-19T03:02:36.975 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:36.975 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:36.975 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:36.975 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87121 2024-04-19T03:02:36.975 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.976 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:36.976 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.976 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:36.976 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233319+0000", 2024-04-19T03:02:36.976 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:36.976 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.976 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.976 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:36.976 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233319+0000", 2024-04-19T03:02:36.976 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:36.976 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.976 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.976 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:36.976 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233319+0000", 2024-04-19T03:02:36.977 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:36.977 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.977 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.977 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:36.977 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233364+0000", 2024-04-19T03:02:36.977 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5460999999999997e-05 2024-04-19T03:02:36.977 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.977 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.977 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:36.977 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233382+0000", 2024-04-19T03:02:36.977 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8148e-05 2024-04-19T03:02:36.977 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.977 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.978 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:36.978 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233390+0000", 2024-04-19T03:02:36.978 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5340000000000002e-06 2024-04-19T03:02:36.978 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.978 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.978 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:36.978 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233712+0000", 2024-04-19T03:02:36.978 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00032260500000000001 2024-04-19T03:02:36.978 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.978 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.978 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:36.978 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233829+0000", 2024-04-19T03:02:36.978 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011638599999999999 2024-04-19T03:02:36.978 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.979 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.979 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:36.979 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233959+0000", 2024-04-19T03:02:36.979 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013013900000000001 2024-04-19T03:02:36.979 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.979 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.979 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:36.979 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236515+0000", 2024-04-19T03:02:36.979 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0025562750000000002 2024-04-19T03:02:36.979 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.979 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.979 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:36.979 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.249723+0000", 2024-04-19T03:02:36.980 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013208176 2024-04-19T03:02:36.980 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.980 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.980 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:02:36.980 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.249728+0000", 2024-04-19T03:02:36.980 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6519999999999997e-06 2024-04-19T03:02:36.980 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.980 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.980 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:36.980 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266837+0000", 2024-04-19T03:02:36.980 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0171087059999999 2024-04-19T03:02:36.980 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.980 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.981 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:36.981 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266943+0000", 2024-04-19T03:02:36.981 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000106604 2024-04-19T03:02:36.981 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:36.981 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:36.981 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:36.981 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.981 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.981 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87124 5.8 5:14819ad7:::benchmark_data_smithi096_19531_object87123:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:36.981 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.235886+0000", 2024-04-19T03:02:36.981 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 13.648670877000001, 2024-04-19T03:02:36.981 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0315451179999999, 2024-04-19T03:02:36.981 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:36.982 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-19T03:02:36.982 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:36.982 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:36.982 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:36.982 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87124 2024-04-19T03:02:36.982 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.982 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:36.982 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.982 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:36.982 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.235886+0000", 2024-04-19T03:02:36.982 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:36.982 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.982 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.982 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:36.983 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.235886+0000", 2024-04-19T03:02:36.983 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:36.983 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.983 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.983 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:36.983 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.235886+0000", 2024-04-19T03:02:36.983 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:36.983 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.983 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.983 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:36.983 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.235934+0000", 2024-04-19T03:02:36.983 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8384000000000003e-05 2024-04-19T03:02:36.983 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.984 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.984 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:36.984 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.235945+0000", 2024-04-19T03:02:36.984 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0671e-05 2024-04-19T03:02:36.984 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.984 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.984 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:36.984 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.235952+0000", 2024-04-19T03:02:36.984 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3089999999999998e-06 2024-04-19T03:02:36.984 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.984 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.984 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:36.984 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.237067+0000", 2024-04-19T03:02:36.984 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001115263 2024-04-19T03:02:36.985 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.985 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.985 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:36.985 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.237188+0000", 2024-04-19T03:02:36.985 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000121258 2024-04-19T03:02:36.985 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.985 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.985 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:36.985 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.237316+0000", 2024-04-19T03:02:36.985 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000128071 2024-04-19T03:02:36.985 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.985 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.985 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:36.985 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240744+0000", 2024-04-19T03:02:36.985 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0034275629999999998 2024-04-19T03:02:36.986 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.986 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.986 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:36.986 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.252517+0000", 2024-04-19T03:02:36.986 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011772991999999999 2024-04-19T03:02:36.986 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.986 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.986 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:02:36.986 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.252523+0000", 2024-04-19T03:02:36.986 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3640000000000004e-06 2024-04-19T03:02:36.986 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.986 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.986 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:36.987 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.267290+0000", 2024-04-19T03:02:36.987 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0147665690000001 2024-04-19T03:02:36.987 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.987 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.987 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:36.987 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.267432+0000", 2024-04-19T03:02:36.987 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014165299999999999 2024-04-19T03:02:36.987 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:36.987 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:36.987 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:36.987 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.987 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.987 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87129 5.0 5:02667e01:::benchmark_data_smithi096_19531_object87128:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:36.988 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.236466+0000", 2024-04-19T03:02:36.988 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 13.648090881, 2024-04-19T03:02:36.988 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0301534510000001, 2024-04-19T03:02:36.988 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:36.988 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-19T03:02:36.988 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:36.988 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:36.988 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:36.988 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87129 2024-04-19T03:02:36.988 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.988 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:36.988 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.988 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:36.989 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236466+0000", 2024-04-19T03:02:36.989 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:36.989 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.989 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.989 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:36.989 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236466+0000", 2024-04-19T03:02:36.989 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:36.989 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.989 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.989 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:36.989 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236465+0000", 2024-04-19T03:02:36.989 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:36.989 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.990 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.990 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:36.990 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236566+0000", 2024-04-19T03:02:36.990 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010047000000000001 2024-04-19T03:02:36.990 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.990 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.990 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:36.990 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236577+0000", 2024-04-19T03:02:36.990 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1772e-05 2024-04-19T03:02:36.990 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.990 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.990 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:36.990 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236584+0000", 2024-04-19T03:02:36.991 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0530000000000003e-06 2024-04-19T03:02:36.991 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.991 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.991 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:36.991 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.237023+0000", 2024-04-19T03:02:36.991 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000439703 2024-04-19T03:02:36.991 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.991 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.991 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:36.991 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.237207+0000", 2024-04-19T03:02:36.991 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000183692 2024-04-19T03:02:36.991 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.991 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.991 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:36.992 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.237373+0000", 2024-04-19T03:02:36.992 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016623500000000001 2024-04-19T03:02:36.992 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.992 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.992 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:36.992 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.241461+0000", 2024-04-19T03:02:36.992 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0040883050000000004 2024-04-19T03:02:36.992 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.992 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.992 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:36.992 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.252500+0000", 2024-04-19T03:02:36.992 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011038450999999999 2024-04-19T03:02:36.992 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.992 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.993 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:02:36.993 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.252507+0000", 2024-04-19T03:02:36.993 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2439999999999996e-06 2024-04-19T03:02:36.993 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.993 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.993 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:36.993 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266538+0000", 2024-04-19T03:02:36.993 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.014031184 2024-04-19T03:02:36.993 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.993 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.993 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:36.993 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266620+0000", 2024-04-19T03:02:36.993 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1600000000000005e-05 2024-04-19T03:02:36.994 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:36.994 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:36.994 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:36.994 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.994 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.994 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87135 5.4 5:2a97e7b7:::benchmark_data_smithi096_19531_object87134:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:36.994 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.240884+0000", 2024-04-19T03:02:36.994 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 13.643673423999999, 2024-04-19T03:02:36.994 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.025708931, 2024-04-19T03:02:36.994 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:36.994 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-19T03:02:36.994 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:36.994 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:36.994 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:36.995 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87135 2024-04-19T03:02:36.995 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.995 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:36.995 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.995 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:36.995 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240884+0000", 2024-04-19T03:02:36.995 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:36.995 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.995 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.995 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:36.995 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240884+0000", 2024-04-19T03:02:36.995 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:36.995 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.995 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.995 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:36.996 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240883+0000", 2024-04-19T03:02:36.996 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:36.996 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.996 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.996 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:36.996 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240933+0000", 2024-04-19T03:02:36.996 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9969999999999998e-05 2024-04-19T03:02:36.996 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.996 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.996 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:36.996 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240946+0000", 2024-04-19T03:02:36.996 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2943e-05 2024-04-19T03:02:36.996 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.996 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.996 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:36.996 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240952+0000", 2024-04-19T03:02:36.997 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8930000000000002e-06 2024-04-19T03:02:36.997 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.997 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.997 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:36.997 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240994+0000", 2024-04-19T03:02:36.997 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2753999999999998e-05 2024-04-19T03:02:36.997 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.997 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.997 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:36.997 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.241092+0000", 2024-04-19T03:02:36.997 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.7447000000000004e-05 2024-04-19T03:02:36.997 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.997 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.997 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:36.997 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.241183+0000", 2024-04-19T03:02:36.997 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1163999999999997e-05 2024-04-19T03:02:36.998 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.998 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.998 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:36.998 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.254672+0000", 2024-04-19T03:02:36.998 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.01348864 2024-04-19T03:02:36.998 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.998 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.998 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:02:36.998 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.254681+0000", 2024-04-19T03:02:36.998 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.3789999999999995e-06 2024-04-19T03:02:36.998 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.998 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.998 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:36.998 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266456+0000", 2024-04-19T03:02:36.999 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.011774621 2024-04-19T03:02:36.999 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.999 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.999 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:36.999 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266593+0000", 2024-04-19T03:02:36.999 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013737600000000001 2024-04-19T03:02:36.999 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:36.999 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:36.999 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:36.999 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:36.999 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:36.999 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87136 5.4 5:212411bc:::benchmark_data_smithi096_19531_object87135:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:36.999 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.240962+0000", 2024-04-19T03:02:37.000 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 13.643595548, 2024-04-19T03:02:37.000 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.025738, 2024-04-19T03:02:37.000 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:37.000 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-19T03:02:37.000 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:37.000 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:37.000 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:37.000 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87136 2024-04-19T03:02:37.000 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:37.000 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:37.000 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:37.000 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:37.000 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240962+0000", 2024-04-19T03:02:37.000 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:37.001 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:37.001 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:37.001 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:37.001 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240962+0000", 2024-04-19T03:02:37.001 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:37.001 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:37.001 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:37.001 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:37.001 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240961+0000", 2024-04-19T03:02:37.001 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:37.001 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:37.001 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:37.001 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:37.002 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240995+0000", 2024-04-19T03:02:37.002 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3868000000000002e-05 2024-04-19T03:02:37.002 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:37.002 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:37.002 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:37.002 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.241001+0000", 2024-04-19T03:02:37.002 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.322e-06 2024-04-19T03:02:37.002 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:37.002 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:37.002 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:37.002 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.241004+0000", 2024-04-19T03:02:37.002 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3510000000000002e-06 2024-04-19T03:02:37.002 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:37.003 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:37.003 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:37.003 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247131+0000", 2024-04-19T03:02:37.003 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0061270869999999998 2024-04-19T03:02:37.003 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:37.003 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:37.003 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:37.003 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247322+0000", 2024-04-19T03:02:37.003 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000191015 2024-04-19T03:02:37.003 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:37.003 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:37.003 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:37.003 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247542+0000", 2024-04-19T03:02:37.004 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00022030199999999999 2024-04-19T03:02:37.004 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:37.004 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:37.004 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:37.004 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.254709+0000", 2024-04-19T03:02:37.004 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0071662660000000001 2024-04-19T03:02:37.004 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:37.004 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:37.004 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:02:37.004 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.254716+0000", 2024-04-19T03:02:37.004 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3860000000000001e-06 2024-04-19T03:02:37.004 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:37.004 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:37.005 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:37.005 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266619+0000", 2024-04-19T03:02:37.005 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0119031030000001 2024-04-19T03:02:37.005 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:37.005 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:37.005 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:37.005 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266700+0000", 2024-04-19T03:02:37.005 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0764000000000001e-05 2024-04-19T03:02:37.005 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:37.005 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:37.005 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:37.005 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:37.005 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:37.005 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87138 5.e 5:7b1f1c20:::benchmark_data_smithi096_19531_object87137:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:37.005 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.247862+0000", 2024-04-19T03:02:37.006 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 13.636695474, 2024-04-19T03:02:37.006 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.024457079, 2024-04-19T03:02:37.006 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:37.006 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:37.006 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:37.006 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:37.006 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:37.006 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87138 2024-04-19T03:02:37.006 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:37.006 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:37.006 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:37.006 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:37.006 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247862+0000", 2024-04-19T03:02:37.007 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:37.007 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:37.007 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:37.007 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:37.007 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247862+0000", 2024-04-19T03:02:37.007 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:37.007 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:37.007 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:37.007 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:37.007 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247860+0000", 2024-04-19T03:02:37.007 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999981 2024-04-19T03:02:37.007 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:37.007 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:37.007 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:37.007 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247909+0000", 2024-04-19T03:02:37.007 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9150999999999997e-05 2024-04-19T03:02:37.008 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:37.008 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:37.008 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:37.008 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247925+0000", 2024-04-19T03:02:37.008 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5761999999999999e-05 2024-04-19T03:02:37.008 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:37.008 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:37.008 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:37.008 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247936+0000", 2024-04-19T03:02:37.008 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1144e-05 2024-04-19T03:02:37.008 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:37.008 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:37.008 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:37.008 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.250590+0000", 2024-04-19T03:02:37.008 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.002653678 2024-04-19T03:02:37.009 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:37.009 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:37.009 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:02:37.009 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.250599+0000", 2024-04-19T03:02:37.009 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9039999999999998e-06 2024-04-19T03:02:37.009 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:37.009 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:37.009 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:37.009 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.268151+0000", 2024-04-19T03:02:37.009 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0175523449999999 2024-04-19T03:02:37.009 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:37.009 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:37.009 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:37.009 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.268285+0000", 2024-04-19T03:02:37.009 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013415599999999999 2024-04-19T03:02:37.009 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:37.010 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:37.010 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:37.010 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.272238+0000", 2024-04-19T03:02:37.010 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0039533019999999997 2024-04-19T03:02:37.010 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:37.010 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:37.010 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:37.010 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.272274+0000", 2024-04-19T03:02:37.010 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5352000000000003e-05 2024-04-19T03:02:37.010 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:37.010 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:37.010 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:37.010 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.272319+0000", 2024-04-19T03:02:37.011 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5281999999999998e-05 2024-04-19T03:02:37.011 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:37.011 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:37.011 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:37.011 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:37.011 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:37.011 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-19T03:02:37.012 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:37.009+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:37.013 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T03:02:37.113 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:37.109+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:37.144 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-04-19T03:02:37.144 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [ 2024-04-19T03:02:37.144 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.144 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:112118 5.2 5:40b85624:::benchmark_data_smithi096_19531_object112117:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-19T03:02:37.144 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:37.128690+0000", 2024-04-19T03:02:37.144 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.013459403999999999, 2024-04-19T03:02:37.144 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.013482965, 2024-04-19T03:02:37.144 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:37.144 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:37.144 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:37.144 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:37.144 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:37.145 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 112118 2024-04-19T03:02:37.145 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.145 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:37.145 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.145 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:37.145 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:37.128690+0000", 2024-04-19T03:02:37.145 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:37.145 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.145 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.145 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:37.145 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:37.128690+0000", 2024-04-19T03:02:37.145 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:37.146 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.146 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.146 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:37.146 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:37.128689+0000", 2024-04-19T03:02:37.146 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:37.146 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.146 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.146 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:37.146 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:37.128753+0000", 2024-04-19T03:02:37.146 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4659999999999994e-05 2024-04-19T03:02:37.146 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.146 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.147 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:37.147 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:37.128766+0000", 2024-04-19T03:02:37.147 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2136999999999999e-05 2024-04-19T03:02:37.147 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.147 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.147 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:37.147 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:37.128773+0000", 2024-04-19T03:02:37.147 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0809999999999996e-06 2024-04-19T03:02:37.147 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.147 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.147 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:37.147 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:37.130470+0000", 2024-04-19T03:02:37.147 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001696936 2024-04-19T03:02:37.148 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.148 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.148 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:37.148 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:37.130614+0000", 2024-04-19T03:02:37.148 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00014399200000000001 2024-04-19T03:02:37.148 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.148 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.148 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:37.148 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:37.142115+0000", 2024-04-19T03:02:37.148 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011501432000000001 2024-04-19T03:02:37.148 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.148 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.148 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:37.148 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:37.142163+0000", 2024-04-19T03:02:37.148 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8367e-05 2024-04-19T03:02:37.149 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:37.149 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:37.149 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:37.149 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.149 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.149 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:112119 5.2 5:431d5fec:::benchmark_data_smithi096_19531_object112118:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-19T03:02:37.149 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:37.130139+0000", 2024-04-19T03:02:37.149 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.012009712000000001, 2024-04-19T03:02:37.149 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.01209609, 2024-04-19T03:02:37.149 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:37.149 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-04-19T03:02:37.149 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:37.149 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:37.149 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:37.150 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 112119 2024-04-19T03:02:37.150 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.150 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:37.150 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.150 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:37.150 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:37.130139+0000", 2024-04-19T03:02:37.150 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:37.150 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.150 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.150 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:37.150 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:37.130139+0000", 2024-04-19T03:02:37.150 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:37.151 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.151 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.151 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:37.151 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:37.130138+0000", 2024-04-19T03:02:37.151 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:37.151 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.151 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.151 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:37.151 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:37.130199+0000", 2024-04-19T03:02:37.151 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0393999999999998e-05 2024-04-19T03:02:37.151 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.151 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.151 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:37.152 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:37.130209+0000", 2024-04-19T03:02:37.152 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0638e-05 2024-04-19T03:02:37.152 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.152 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.152 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:37.152 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:37.130217+0000", 2024-04-19T03:02:37.152 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4070000000000004e-06 2024-04-19T03:02:37.152 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.152 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.152 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:37.152 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:37.133320+0000", 2024-04-19T03:02:37.152 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0031037230000000001 2024-04-19T03:02:37.152 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.152 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.153 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:37.153 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:37.133485+0000", 2024-04-19T03:02:37.153 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000164881 2024-04-19T03:02:37.153 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:37.153 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:37.153 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:37.153 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.153 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.153 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:112123 5.7 5:eaa74ef9:::benchmark_data_smithi096_19531_object112122:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-19T03:02:37.153 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:37.132069+0000", 2024-04-19T03:02:37.153 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.010080034, 2024-04-19T03:02:37.153 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.010230137, 2024-04-19T03:02:37.153 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:37.154 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-04-19T03:02:37.154 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:37.154 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:37.154 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:37.154 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 112123 2024-04-19T03:02:37.154 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.154 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:37.154 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.154 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:37.154 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:37.132069+0000", 2024-04-19T03:02:37.154 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:37.154 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.154 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.155 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:37.155 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:37.132069+0000", 2024-04-19T03:02:37.155 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:37.155 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.155 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.155 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:37.155 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:37.132068+0000", 2024-04-19T03:02:37.155 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:37.155 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.155 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.155 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:37.155 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:37.132133+0000", 2024-04-19T03:02:37.155 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5293e-05 2024-04-19T03:02:37.155 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.156 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.156 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:37.156 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:37.132152+0000", 2024-04-19T03:02:37.156 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8261999999999999e-05 2024-04-19T03:02:37.156 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.156 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.156 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:37.156 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:37.132159+0000", 2024-04-19T03:02:37.156 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.1659999999999997e-06 2024-04-19T03:02:37.156 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.156 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.156 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:37.156 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:37.132208+0000", 2024-04-19T03:02:37.157 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9251e-05 2024-04-19T03:02:37.157 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.157 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.157 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:37.157 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:37.132355+0000", 2024-04-19T03:02:37.157 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00014703200000000001 2024-04-19T03:02:37.157 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:37.157 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:37.157 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:37.157 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.157 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.157 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:112124 5.2 5:45bb54d7:::benchmark_data_smithi096_19531_object112123:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-19T03:02:37.157 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:37.132171+0000", 2024-04-19T03:02:37.157 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0099775179999999995, 2024-04-19T03:02:37.158 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.010195342, 2024-04-19T03:02:37.158 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:37.158 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-04-19T03:02:37.158 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:37.158 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:37.158 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:37.158 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 112124 2024-04-19T03:02:37.158 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.158 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:37.158 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.158 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:37.158 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:37.132171+0000", 2024-04-19T03:02:37.158 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:37.159 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.159 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.159 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:37.159 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:37.132171+0000", 2024-04-19T03:02:37.159 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:37.159 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.159 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.159 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:37.159 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:37.132171+0000", 2024-04-19T03:02:37.159 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:37.159 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.159 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.159 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:37.160 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:37.132207+0000", 2024-04-19T03:02:37.160 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6012e-05 2024-04-19T03:02:37.160 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.160 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.160 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:37.160 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:37.132214+0000", 2024-04-19T03:02:37.160 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0280000000000003e-06 2024-04-19T03:02:37.160 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.160 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.160 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:37.160 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:37.132219+0000", 2024-04-19T03:02:37.160 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4890000000000003e-06 2024-04-19T03:02:37.160 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.160 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.160 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:37.161 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:37.136934+0000", 2024-04-19T03:02:37.161 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0047146200000000001 2024-04-19T03:02:37.161 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.161 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.161 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:37.161 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:37.137081+0000", 2024-04-19T03:02:37.161 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00014694600000000001 2024-04-19T03:02:37.161 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:37.161 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:37.161 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:37.161 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.161 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.161 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:112127 5.f 5:f98b29d5:::benchmark_data_smithi096_19531_object112126:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-19T03:02:37.161 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:37.133361+0000", 2024-04-19T03:02:37.162 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0087883920000000008, 2024-04-19T03:02:37.162 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0090844710000000002, 2024-04-19T03:02:37.162 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:37.162 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:02:37.162 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:37.162 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:37.162 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:37.162 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 112127 2024-04-19T03:02:37.162 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.162 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:37.162 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.162 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:37.162 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:37.133361+0000", 2024-04-19T03:02:37.163 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:37.163 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.163 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.163 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:37.163 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:37.133361+0000", 2024-04-19T03:02:37.163 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:37.163 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.163 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.163 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:37.163 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:37.133359+0000", 2024-04-19T03:02:37.163 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:37.163 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.163 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.163 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:37.164 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:37.133428+0000", 2024-04-19T03:02:37.164 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8473000000000007e-05 2024-04-19T03:02:37.164 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.164 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.164 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:37.164 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:37.133465+0000", 2024-04-19T03:02:37.164 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6996999999999998e-05 2024-04-19T03:02:37.164 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.164 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.164 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:37.164 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:37.133482+0000", 2024-04-19T03:02:37.164 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7431e-05 2024-04-19T03:02:37.164 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.165 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.165 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:37.165 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:37.133695+0000", 2024-04-19T03:02:37.165 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00021292199999999999 2024-04-19T03:02:37.165 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.165 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.165 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:37.165 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:37.133874+0000", 2024-04-19T03:02:37.165 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00017845599999999999 2024-04-19T03:02:37.165 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.165 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.165 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:02:37.165 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:37.134046+0000", 2024-04-19T03:02:37.165 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000172249 2024-04-19T03:02:37.166 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.166 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.166 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:37.166 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:37.136922+0000", 2024-04-19T03:02:37.166 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00287616 2024-04-19T03:02:37.166 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:37.166 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:37.166 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:37.166 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.166 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.166 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:112128 5.6 5:6a7b4bef:::benchmark_data_smithi096_19531_object112127:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-19T03:02:37.166 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:37.133489+0000", 2024-04-19T03:02:37.166 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0086597180000000003, 2024-04-19T03:02:37.166 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0090295689999999994, 2024-04-19T03:02:37.167 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:37.167 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-04-19T03:02:37.167 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:37.167 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:37.167 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:37.167 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 112128 2024-04-19T03:02:37.167 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.167 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:37.167 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.167 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:37.167 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:37.133489+0000", 2024-04-19T03:02:37.167 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:37.167 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.167 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.168 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:37.168 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:37.133489+0000", 2024-04-19T03:02:37.168 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:37.168 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.168 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.168 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:37.168 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:37.133489+0000", 2024-04-19T03:02:37.168 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:37.168 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.168 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.168 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:37.168 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:37.133524+0000", 2024-04-19T03:02:37.168 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5014000000000001e-05 2024-04-19T03:02:37.168 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.169 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.169 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:37.169 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:37.133533+0000", 2024-04-19T03:02:37.169 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.0799999999999995e-06 2024-04-19T03:02:37.169 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.169 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.169 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:37.169 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:37.133538+0000", 2024-04-19T03:02:37.169 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2329999999999997e-06 2024-04-19T03:02:37.169 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.169 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.169 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:37.169 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:37.134582+0000", 2024-04-19T03:02:37.169 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00104414 2024-04-19T03:02:37.170 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.170 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.170 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:37.170 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:37.134729+0000", 2024-04-19T03:02:37.170 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00014663400000000001 2024-04-19T03:02:37.170 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:37.170 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:37.170 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:37.170 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.170 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.170 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:112129 5.2 5:43c2fc87:::benchmark_data_smithi096_19531_object112128:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-19T03:02:37.170 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:37.136184+0000", 2024-04-19T03:02:37.170 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0059652079999999996, 2024-04-19T03:02:37.171 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0063991459999999997, 2024-04-19T03:02:37.171 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:37.171 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-04-19T03:02:37.171 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:37.171 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:37.171 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:37.171 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 112129 2024-04-19T03:02:37.171 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.171 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:37.171 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.171 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:37.171 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:37.136184+0000", 2024-04-19T03:02:37.171 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:37.171 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.172 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.172 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:37.172 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:37.136184+0000", 2024-04-19T03:02:37.172 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:37.172 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.172 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.172 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:37.172 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:37.136182+0000", 2024-04-19T03:02:37.172 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:37.172 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.172 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.172 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:37.172 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:37.136314+0000", 2024-04-19T03:02:37.172 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00013131699999999999 2024-04-19T03:02:37.173 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.173 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.173 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:37.173 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:37.136327+0000", 2024-04-19T03:02:37.173 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3203999999999999e-05 2024-04-19T03:02:37.173 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.173 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.173 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:37.173 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:37.136333+0000", 2024-04-19T03:02:37.173 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3010000000000003e-06 2024-04-19T03:02:37.173 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.173 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.173 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:37.173 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:37.139540+0000", 2024-04-19T03:02:37.173 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0032068610000000001 2024-04-19T03:02:37.174 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.174 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.174 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:37.174 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:37.139699+0000", 2024-04-19T03:02:37.174 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00015903600000000001 2024-04-19T03:02:37.174 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:37.174 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:37.174 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:37.174 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.174 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.174 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:112130 5.5 5:ab0d1735:::benchmark_data_smithi096_19531_object112129:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-19T03:02:37.174 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:37.136418+0000", 2024-04-19T03:02:37.174 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0057305860000000002, 2024-04-19T03:02:37.175 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0062383610000000004, 2024-04-19T03:02:37.175 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:37.175 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-04-19T03:02:37.175 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:37.175 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:37.175 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:37.175 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 112130 2024-04-19T03:02:37.175 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.175 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:37.175 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.175 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:37.175 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:37.136418+0000", 2024-04-19T03:02:37.175 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:37.175 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.175 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.175 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:37.176 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:37.136418+0000", 2024-04-19T03:02:37.176 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:37.176 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.176 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.176 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:37.176 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:37.136418+0000", 2024-04-19T03:02:37.176 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:37.176 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.176 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.176 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:37.176 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:37.136519+0000", 2024-04-19T03:02:37.176 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000101019 2024-04-19T03:02:37.176 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.176 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.177 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:37.177 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:37.136525+0000", 2024-04-19T03:02:37.177 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1689999999999997e-06 2024-04-19T03:02:37.177 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.177 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.177 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:37.177 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:37.136529+0000", 2024-04-19T03:02:37.177 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9990000000000002e-06 2024-04-19T03:02:37.177 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.177 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.177 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:37.177 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:37.136561+0000", 2024-04-19T03:02:37.177 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.1738e-05 2024-04-19T03:02:37.177 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.177 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.178 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:37.178 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:37.136703+0000", 2024-04-19T03:02:37.178 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00014252199999999999 2024-04-19T03:02:37.178 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:37.178 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:37.178 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:37.178 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.178 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.178 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:112131 5.6 5:644b464e:::benchmark_data_smithi096_19531_object112130:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-19T03:02:37.178 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:37.136783+0000", 2024-04-19T03:02:37.178 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0053663519999999996, 2024-04-19T03:02:37.178 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0059415730000000003, 2024-04-19T03:02:37.178 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:37.178 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-04-19T03:02:37.179 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:37.179 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:37.179 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:37.179 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 112131 2024-04-19T03:02:37.179 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.179 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:37.179 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.179 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:37.179 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:37.136783+0000", 2024-04-19T03:02:37.179 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:37.179 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.179 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.179 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:37.180 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:37.136783+0000", 2024-04-19T03:02:37.180 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:37.180 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.180 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.180 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:37.180 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:37.136782+0000", 2024-04-19T03:02:37.180 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:37.180 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.180 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.180 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:37.180 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:37.136823+0000", 2024-04-19T03:02:37.180 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1063000000000003e-05 2024-04-19T03:02:37.180 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.180 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.180 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:37.181 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:37.136832+0000", 2024-04-19T03:02:37.181 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.2699999999999993e-06 2024-04-19T03:02:37.181 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.181 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.181 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:37.181 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:37.136840+0000", 2024-04-19T03:02:37.181 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4610000000000002e-06 2024-04-19T03:02:37.181 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.181 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.181 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:37.181 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:37.137444+0000", 2024-04-19T03:02:37.181 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00060457600000000001 2024-04-19T03:02:37.181 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.181 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.182 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:37.182 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:37.137617+0000", 2024-04-19T03:02:37.182 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00017314399999999999 2024-04-19T03:02:37.182 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:37.182 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:37.182 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:37.182 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.182 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.182 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:112132 5.1 5:8e424a9c:::benchmark_data_smithi096_19531_object112131:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-19T03:02:37.182 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:37.136853+0000", 2024-04-19T03:02:37.182 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0052958229999999998, 2024-04-19T03:02:37.182 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0059412070000000004, 2024-04-19T03:02:37.182 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:37.182 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-04-19T03:02:37.183 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:37.183 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:37.183 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:37.183 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 112132 2024-04-19T03:02:37.183 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.183 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:37.183 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.183 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:37.183 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:37.136853+0000", 2024-04-19T03:02:37.183 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:37.183 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.183 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.183 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:37.183 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:37.136853+0000", 2024-04-19T03:02:37.184 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:37.184 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.184 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.184 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:37.184 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:37.136853+0000", 2024-04-19T03:02:37.184 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:37.184 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.184 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.184 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:37.184 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:37.136907+0000", 2024-04-19T03:02:37.184 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4256999999999999e-05 2024-04-19T03:02:37.184 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.184 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.184 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:37.185 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:37.136915+0000", 2024-04-19T03:02:37.185 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9270000000000005e-06 2024-04-19T03:02:37.185 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.185 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.185 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:37.185 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:37.136921+0000", 2024-04-19T03:02:37.185 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0220000000000001e-06 2024-04-19T03:02:37.185 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.185 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.185 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:37.185 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:37.136972+0000", 2024-04-19T03:02:37.185 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0840000000000001e-05 2024-04-19T03:02:37.185 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.185 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.186 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:37.186 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:37.137114+0000", 2024-04-19T03:02:37.186 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00014221899999999999 2024-04-19T03:02:37.186 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:37.186 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:37.186 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:37.186 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.186 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.186 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:112133 5.f 5:f7bb73b8:::benchmark_data_smithi096_19531_object112132:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-19T03:02:37.186 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:37.136936+0000", 2024-04-19T03:02:37.186 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0052129699999999999, 2024-04-19T03:02:37.186 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0059160590000000004, 2024-04-19T03:02:37.186 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:37.187 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:02:37.187 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:37.187 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:37.187 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:37.187 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 112133 2024-04-19T03:02:37.187 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.187 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:37.187 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.187 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:37.187 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:37.136936+0000", 2024-04-19T03:02:37.187 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:37.187 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.187 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.187 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:37.188 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:37.136936+0000", 2024-04-19T03:02:37.188 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:37.188 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.188 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.188 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:37.188 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:37.136935+0000", 2024-04-19T03:02:37.188 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:37.188 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.188 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.188 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:37.188 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:37.136968+0000", 2024-04-19T03:02:37.188 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2571999999999999e-05 2024-04-19T03:02:37.188 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.189 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.189 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:37.189 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:37.136976+0000", 2024-04-19T03:02:37.189 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6969999999999993e-06 2024-04-19T03:02:37.189 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.189 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.189 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:37.189 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:37.136981+0000", 2024-04-19T03:02:37.189 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4979999999999997e-06 2024-04-19T03:02:37.189 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.189 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.189 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:37.189 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:37.137041+0000", 2024-04-19T03:02:37.189 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9689999999999999e-05 2024-04-19T03:02:37.190 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.190 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.190 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:37.190 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:37.137155+0000", 2024-04-19T03:02:37.190 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000114277 2024-04-19T03:02:37.190 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.190 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.190 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:02:37.190 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:37.137355+0000", 2024-04-19T03:02:37.190 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000200249 2024-04-19T03:02:37.190 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.190 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.191 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:37.191 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:37.141990+0000", 2024-04-19T03:02:37.191 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0046342329999999998 2024-04-19T03:02:37.191 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:37.191 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:37.191 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:37.191 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.191 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.191 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:112135 5.5 5:a6bb8211:::benchmark_data_smithi096_19531_object112134:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-19T03:02:37.191 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:37.138067+0000", 2024-04-19T03:02:37.191 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0040820279999999997, 2024-04-19T03:02:37.191 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0048251020000000004, 2024-04-19T03:02:37.191 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:37.191 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-04-19T03:02:37.192 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:37.192 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:37.192 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:37.192 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 112135 2024-04-19T03:02:37.192 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.192 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:37.192 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.192 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:37.192 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:37.138067+0000", 2024-04-19T03:02:37.192 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:37.192 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.192 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.192 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:37.193 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:37.138067+0000", 2024-04-19T03:02:37.193 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:37.193 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.193 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.193 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:37.193 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:37.138066+0000", 2024-04-19T03:02:37.193 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:37.193 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.193 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.193 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:37.193 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:37.138099+0000", 2024-04-19T03:02:37.193 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3583e-05 2024-04-19T03:02:37.193 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.193 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.194 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:37.194 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:37.138115+0000", 2024-04-19T03:02:37.194 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.5234e-05 2024-04-19T03:02:37.194 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.194 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.194 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:37.194 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:37.138122+0000", 2024-04-19T03:02:37.194 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0419999999999997e-06 2024-04-19T03:02:37.194 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.194 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.194 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:37.194 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:37.139749+0000", 2024-04-19T03:02:37.194 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001627341 2024-04-19T03:02:37.195 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.195 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.195 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:37.195 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:37.139875+0000", 2024-04-19T03:02:37.195 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00012609000000000001 2024-04-19T03:02:37.195 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:37.195 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:37.195 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:37.195 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.195 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.195 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:112136 5.6 5:678cc6fe:::benchmark_data_smithi096_19531_object112135:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-19T03:02:37.195 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:37.138133+0000", 2024-04-19T03:02:37.195 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0040162540000000004, 2024-04-19T03:02:37.196 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0047934680000000004, 2024-04-19T03:02:37.196 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:37.196 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-04-19T03:02:37.196 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:37.196 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:37.196 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:37.196 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 112136 2024-04-19T03:02:37.196 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.196 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:37.196 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.196 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:37.196 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:37.138133+0000", 2024-04-19T03:02:37.196 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:37.196 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.197 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.197 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:37.197 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:37.138133+0000", 2024-04-19T03:02:37.197 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:37.197 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.197 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.197 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:37.197 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:37.138132+0000", 2024-04-19T03:02:37.197 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:37.197 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.197 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.197 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:37.197 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:37.138158+0000", 2024-04-19T03:02:37.197 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.6139000000000002e-05 2024-04-19T03:02:37.198 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.198 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.198 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:37.198 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:37.138169+0000", 2024-04-19T03:02:37.198 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0377000000000001e-05 2024-04-19T03:02:37.198 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.198 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.198 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:37.198 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:37.138174+0000", 2024-04-19T03:02:37.198 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2240000000000003e-06 2024-04-19T03:02:37.198 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.198 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.198 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:37.198 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:37.140253+0000", 2024-04-19T03:02:37.199 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0020786049999999999 2024-04-19T03:02:37.199 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.199 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.199 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:37.199 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:37.140379+0000", 2024-04-19T03:02:37.199 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00012606 2024-04-19T03:02:37.199 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:37.199 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:37.199 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:37.199 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.199 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.199 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4755.0:112137 5.d e48/22 5:b3adbddd:::benchmark_data_smithi096_19531_object112136:head v 48'7123, mlcod=48'7121)", 2024-04-19T03:02:37.200 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:37.139051+0000", 2024-04-19T03:02:37.200 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0030977510000000002, 2024-04-19T03:02:37.200 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0039117240000000001, 2024-04-19T03:02:37.200 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:37.200 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-04-19T03:02:37.200 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:37.200 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.200 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:37.200 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:37.139051+0000", 2024-04-19T03:02:37.200 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:37.200 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.200 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.200 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:37.200 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:37.139051+0000", 2024-04-19T03:02:37.201 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:37.201 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.201 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.201 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:37.201 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:37.139050+0000", 2024-04-19T03:02:37.201 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:37.201 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.201 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.201 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:37.201 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:37.139112+0000", 2024-04-19T03:02:37.201 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1823999999999996e-05 2024-04-19T03:02:37.201 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.201 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.201 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:37.202 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:37.139125+0000", 2024-04-19T03:02:37.202 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2514000000000001e-05 2024-04-19T03:02:37.202 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.202 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.202 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:37.202 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:37.139131+0000", 2024-04-19T03:02:37.202 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2339999999999999e-06 2024-04-19T03:02:37.202 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.202 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.202 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:37.202 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:37.139735+0000", 2024-04-19T03:02:37.202 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00060434699999999998 2024-04-19T03:02:37.202 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.202 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.203 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:37.203 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:37.139752+0000", 2024-04-19T03:02:37.203 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6677999999999999e-05 2024-04-19T03:02:37.203 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:37.203 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:37.203 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:37.203 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.203 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.203 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:112139 5.f 5:f680a55b:::benchmark_data_smithi096_19531_object112138:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-19T03:02:37.203 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:37.140866+0000", 2024-04-19T03:02:37.203 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0012830509999999999, 2024-04-19T03:02:37.203 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0021284199999999998, 2024-04-19T03:02:37.203 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:37.204 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:02:37.204 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:37.204 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:37.204 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:37.204 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 112139 2024-04-19T03:02:37.204 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.204 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:37.204 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.204 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:37.204 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:37.140866+0000", 2024-04-19T03:02:37.204 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:37.204 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.204 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.204 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:37.204 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:37.140866+0000", 2024-04-19T03:02:37.205 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:37.205 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.205 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.205 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:37.205 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:37.140865+0000", 2024-04-19T03:02:37.205 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:37.205 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.205 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.205 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:37.205 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:37.140987+0000", 2024-04-19T03:02:37.205 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00012259400000000001 2024-04-19T03:02:37.205 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.205 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.206 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:37.206 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:37.141004+0000", 2024-04-19T03:02:37.206 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6642000000000001e-05 2024-04-19T03:02:37.206 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.206 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.206 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:37.206 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:37.141012+0000", 2024-04-19T03:02:37.206 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.3119999999999994e-06 2024-04-19T03:02:37.206 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.206 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.206 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:37.206 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:37.142019+0000", 2024-04-19T03:02:37.206 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001006776 2024-04-19T03:02:37.206 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.207 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.207 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:37.207 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:37.142127+0000", 2024-04-19T03:02:37.207 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000107917 2024-04-19T03:02:37.207 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.207 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.207 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:02:37.207 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:37.142227+0000", 2024-04-19T03:02:37.207 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.9690000000000003e-05 2024-04-19T03:02:37.207 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:37.207 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:37.207 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:37.207 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.207 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.208 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:112140 5.2 5:4649c246:::benchmark_data_smithi096_19531_object112139:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-19T03:02:37.208 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:37.142228+0000", 2024-04-19T03:02:37.208 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4294967295.9999213, 2024-04-19T03:02:37.208 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00080418600000000003, 2024-04-19T03:02:37.208 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:37.208 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-04-19T03:02:37.208 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:37.208 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:37.208 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:37.208 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 112140 2024-04-19T03:02:37.208 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.208 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:37.208 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.208 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:37.208 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:37.142228+0000", 2024-04-19T03:02:37.209 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:37.209 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.209 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.209 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:37.209 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:37.142228+0000", 2024-04-19T03:02:37.209 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:37.209 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.209 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.209 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:37.209 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:37.142227+0000", 2024-04-19T03:02:37.209 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:37.209 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.209 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.209 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:37.209 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:37.142304+0000", 2024-04-19T03:02:37.210 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7556000000000001e-05 2024-04-19T03:02:37.210 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.210 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.210 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:37.210 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:37.142314+0000", 2024-04-19T03:02:37.210 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0285999999999999e-05 2024-04-19T03:02:37.210 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.210 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.210 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:37.210 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:37.142322+0000", 2024-04-19T03:02:37.210 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2799999999999998e-06 2024-04-19T03:02:37.210 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.210 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.210 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:37.211 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:37.142480+0000", 2024-04-19T03:02:37.211 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000158383 2024-04-19T03:02:37.211 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.211 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.211 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:37.211 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:37.142610+0000", 2024-04-19T03:02:37.211 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00012962100000000001 2024-04-19T03:02:37.211 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:37.211 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:37.211 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:37.211 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:37.211 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-04-19T03:02:37.211 INFO:teuthology.orchestra.run.smithi144.stdout: "num_ops": 16 2024-04-19T03:02:37.211 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-04-19T03:02:37.213 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T03:02:37.214 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:37.213+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:37.315 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:37.311+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:37.342 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-04-19T03:02:37.342 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2024-04-19T03:02:37.342 INFO:teuthology.orchestra.run.smithi144.stdout: "complaint_time": 30, 2024-04-19T03:02:37.342 INFO:teuthology.orchestra.run.smithi144.stdout: "num_blocked_ops": 0 2024-04-19T03:02:37.342 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-04-19T03:02:37.355 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T03:02:37.416 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:37.413+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:37.479 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-04-19T03:02:37.479 INFO:teuthology.orchestra.run.smithi144.stdout: "size": 20, 2024-04-19T03:02:37.479 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 600, 2024-04-19T03:02:37.479 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [ 2024-04-19T03:02:37.479 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.479 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:78992 5.7 5:e6baa862:::benchmark_data_smithi096_19531_object78991:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-19T03:02:37.480 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:18.008888+0000", 2024-04-19T03:02:37.480 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 19.467641830000002, 2024-04-19T03:02:37.480 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.056375285999999997, 2024-04-19T03:02:37.480 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:37.480 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:37.480 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:37.480 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:37.480 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:37.480 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 78992 2024-04-19T03:02:37.480 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.481 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:37.481 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.481 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:37.481 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.008888+0000", 2024-04-19T03:02:37.481 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:37.481 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.481 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.481 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:37.481 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.008888+0000", 2024-04-19T03:02:37.481 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:37.481 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.481 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.481 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:37.482 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.008888+0000", 2024-04-19T03:02:37.482 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:37.482 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.482 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.482 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:37.482 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.008928+0000", 2024-04-19T03:02:37.482 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0361999999999997e-05 2024-04-19T03:02:37.482 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.482 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.482 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:37.482 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.008942+0000", 2024-04-19T03:02:37.483 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4365000000000001e-05 2024-04-19T03:02:37.484 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.484 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.484 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:37.484 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.008949+0000", 2024-04-19T03:02:37.484 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.212e-06 2024-04-19T03:02:37.484 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.484 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.484 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:37.484 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.012683+0000", 2024-04-19T03:02:37.484 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.003733934 2024-04-19T03:02:37.484 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.484 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.485 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:37.485 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.012798+0000", 2024-04-19T03:02:37.485 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00011574999999999999 2024-04-19T03:02:37.485 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.485 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.485 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:37.485 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.012896+0000", 2024-04-19T03:02:37.485 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.7848000000000002e-05 2024-04-19T03:02:37.485 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.485 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.485 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:37.485 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016423+0000", 2024-04-19T03:02:37.485 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0035270789999999998 2024-04-19T03:02:37.485 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.486 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.486 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:37.486 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.065098+0000", 2024-04-19T03:02:37.486 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.048674651999999999 2024-04-19T03:02:37.486 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.486 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.486 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:37.486 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.065193+0000", 2024-04-19T03:02:37.486 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.5087999999999995e-05 2024-04-19T03:02:37.486 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.486 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.486 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:37.486 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.065264+0000", 2024-04-19T03:02:37.486 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0666000000000004e-05 2024-04-19T03:02:37.487 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:37.487 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:37.487 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:37.487 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.487 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.487 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:78998 5.7 5:ee23c1bc:::benchmark_data_smithi096_19531_object78997:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-19T03:02:37.487 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:18.013165+0000", 2024-04-19T03:02:37.487 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 19.463365123999999, 2024-04-19T03:02:37.487 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.052410864000000001, 2024-04-19T03:02:37.487 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:37.487 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:37.487 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:37.487 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:37.487 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:37.488 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 78998 2024-04-19T03:02:37.488 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.488 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:37.488 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.488 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:37.488 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.013165+0000", 2024-04-19T03:02:37.488 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:37.488 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.488 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.488 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:37.488 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.013165+0000", 2024-04-19T03:02:37.488 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:37.488 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.488 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.489 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:37.489 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.013164+0000", 2024-04-19T03:02:37.489 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:37.489 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.489 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.489 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:37.489 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.013214+0000", 2024-04-19T03:02:37.489 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9636999999999999e-05 2024-04-19T03:02:37.489 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.489 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.489 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:37.489 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.013223+0000", 2024-04-19T03:02:37.489 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.3619999999999995e-06 2024-04-19T03:02:37.489 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.490 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.490 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:37.490 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.013229+0000", 2024-04-19T03:02:37.490 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6060000000000002e-06 2024-04-19T03:02:37.490 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.490 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.490 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:37.490 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.014882+0000", 2024-04-19T03:02:37.490 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001653257 2024-04-19T03:02:37.490 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.490 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.490 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:37.490 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.014958+0000", 2024-04-19T03:02:37.490 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6398999999999998e-05 2024-04-19T03:02:37.491 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.491 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.491 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:37.491 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.015036+0000", 2024-04-19T03:02:37.491 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8070000000000003e-05 2024-04-19T03:02:37.491 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.491 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.491 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:37.491 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018099+0000", 2024-04-19T03:02:37.491 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0030631149999999999 2024-04-19T03:02:37.491 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.491 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.491 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:37.491 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.065328+0000", 2024-04-19T03:02:37.492 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.047228349000000003 2024-04-19T03:02:37.492 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.492 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.492 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:37.492 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.065508+0000", 2024-04-19T03:02:37.492 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00018036899999999999 2024-04-19T03:02:37.492 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.492 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.492 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:37.492 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.065576+0000", 2024-04-19T03:02:37.492 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7785000000000002e-05 2024-04-19T03:02:37.492 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:37.492 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:37.492 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:37.492 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.493 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.493 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4755.0:78995 5.2 e40/39 5:42b55e12:::benchmark_data_smithi096_19531_object78994:head v 40'4934, mlcod=40'4932)", 2024-04-19T03:02:37.493 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:18.016247+0000", 2024-04-19T03:02:37.493 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 19.460283162, 2024-04-19T03:02:37.493 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.056240406, 2024-04-19T03:02:37.493 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:37.493 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:37.493 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:37.493 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.493 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:37.493 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016247+0000", 2024-04-19T03:02:37.493 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:37.493 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.493 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.493 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:37.494 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016247+0000", 2024-04-19T03:02:37.494 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:37.494 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.494 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.494 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:37.494 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016246+0000", 2024-04-19T03:02:37.494 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:37.494 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.494 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.494 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:37.494 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016315+0000", 2024-04-19T03:02:37.494 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8979000000000005e-05 2024-04-19T03:02:37.494 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.495 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.495 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:37.495 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016333+0000", 2024-04-19T03:02:37.495 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7586999999999999e-05 2024-04-19T03:02:37.495 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.495 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.495 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:37.495 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016340+0000", 2024-04-19T03:02:37.495 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4080000000000001e-06 2024-04-19T03:02:37.495 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.495 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.495 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:37.495 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016384+0000", 2024-04-19T03:02:37.495 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3656999999999999e-05 2024-04-19T03:02:37.495 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.496 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.496 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:37.496 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016403+0000", 2024-04-19T03:02:37.496 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9089e-05 2024-04-19T03:02:37.496 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.496 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.496 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:37.496 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.072448+0000", 2024-04-19T03:02:37.496 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.056045084000000002 2024-04-19T03:02:37.496 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.496 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.496 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:37.496 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.072487+0000", 2024-04-19T03:02:37.496 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9362e-05 2024-04-19T03:02:37.497 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:37.497 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:37.497 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:37.497 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.497 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.497 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4755.0:78994 5.c e40/22 5:3c60d55d:::benchmark_data_smithi096_19531_object78993:head v 40'4989, mlcod=40'4987)", 2024-04-19T03:02:37.497 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:18.016392+0000", 2024-04-19T03:02:37.497 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 19.460138521000001, 2024-04-19T03:02:37.497 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.052629620000000002, 2024-04-19T03:02:37.497 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:37.497 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:37.497 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:37.497 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.497 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:37.498 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016392+0000", 2024-04-19T03:02:37.498 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:37.498 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.498 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.498 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:37.498 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016392+0000", 2024-04-19T03:02:37.498 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:37.498 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.498 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.498 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:37.498 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016391+0000", 2024-04-19T03:02:37.498 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:37.498 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.498 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.499 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:37.499 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016471+0000", 2024-04-19T03:02:37.499 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9346999999999998e-05 2024-04-19T03:02:37.499 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.499 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.499 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:37.499 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016478+0000", 2024-04-19T03:02:37.499 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.593e-06 2024-04-19T03:02:37.499 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.499 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.499 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:37.499 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016495+0000", 2024-04-19T03:02:37.499 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6492999999999999e-05 2024-04-19T03:02:37.499 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.499 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.500 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:37.500 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016539+0000", 2024-04-19T03:02:37.500 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4715999999999997e-05 2024-04-19T03:02:37.500 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.500 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.500 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:37.500 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016551+0000", 2024-04-19T03:02:37.500 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2096000000000001e-05 2024-04-19T03:02:37.500 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.500 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.500 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:37.500 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.068985+0000", 2024-04-19T03:02:37.500 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.052433754999999999 2024-04-19T03:02:37.500 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.501 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.501 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:37.501 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.069021+0000", 2024-04-19T03:02:37.501 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6047000000000002e-05 2024-04-19T03:02:37.501 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:37.501 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:37.501 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:37.501 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.501 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.501 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4755.0:78996 5.1 e40/39 5:87f59708:::benchmark_data_smithi096_19531_object78995:head v 40'4940, mlcod=40'4938)", 2024-04-19T03:02:37.501 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:18.016581+0000", 2024-04-19T03:02:37.501 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 19.459949355999999, 2024-04-19T03:02:37.501 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.052051785000000003, 2024-04-19T03:02:37.501 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:37.502 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:37.502 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:37.502 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.502 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:37.502 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016581+0000", 2024-04-19T03:02:37.502 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:37.502 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.502 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.502 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:37.502 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016581+0000", 2024-04-19T03:02:37.502 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:37.502 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.502 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.502 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:37.503 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016581+0000", 2024-04-19T03:02:37.503 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:37.503 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.503 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.503 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:37.503 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016610+0000", 2024-04-19T03:02:37.503 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9556999999999998e-05 2024-04-19T03:02:37.503 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.503 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.503 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:37.504 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016616+0000", 2024-04-19T03:02:37.504 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1090000000000003e-06 2024-04-19T03:02:37.504 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.504 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.504 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:37.504 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016621+0000", 2024-04-19T03:02:37.504 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.454e-06 2024-04-19T03:02:37.504 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.504 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.504 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:37.504 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016663+0000", 2024-04-19T03:02:37.505 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2582e-05 2024-04-19T03:02:37.505 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.505 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.505 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:37.505 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016681+0000", 2024-04-19T03:02:37.505 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7680999999999999e-05 2024-04-19T03:02:37.505 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.505 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.505 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:37.505 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.068486+0000", 2024-04-19T03:02:37.505 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.051804624000000001 2024-04-19T03:02:37.505 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.505 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.505 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:37.506 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.068633+0000", 2024-04-19T03:02:37.506 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00014709099999999999 2024-04-19T03:02:37.506 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:37.506 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:37.506 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:37.506 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.506 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.506 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4755.0:78999 5.3 e40/22 5:c9ec5f7f:::benchmark_data_smithi096_19531_object78998:head v 40'4893, mlcod=40'4889)", 2024-04-19T03:02:37.506 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:18.016633+0000", 2024-04-19T03:02:37.506 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 19.459897501, 2024-04-19T03:02:37.506 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.051090469999999999, 2024-04-19T03:02:37.506 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:37.506 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:37.506 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:37.507 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.507 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:37.507 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016633+0000", 2024-04-19T03:02:37.507 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:37.507 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.507 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.507 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:37.507 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016633+0000", 2024-04-19T03:02:37.507 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:37.507 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.507 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.507 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:37.507 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016632+0000", 2024-04-19T03:02:37.507 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967296 2024-04-19T03:02:37.508 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.508 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.508 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:37.508 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016660+0000", 2024-04-19T03:02:37.508 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7869999999999999e-05 2024-04-19T03:02:37.508 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.508 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.508 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:37.508 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016667+0000", 2024-04-19T03:02:37.508 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0280000000000003e-06 2024-04-19T03:02:37.508 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.508 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.508 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:37.508 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016672+0000", 2024-04-19T03:02:37.509 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0069999999999997e-06 2024-04-19T03:02:37.509 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.509 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.509 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:37.509 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016725+0000", 2024-04-19T03:02:37.509 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2812000000000002e-05 2024-04-19T03:02:37.509 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.509 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.509 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:37.509 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016750+0000", 2024-04-19T03:02:37.509 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5038e-05 2024-04-19T03:02:37.509 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.509 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.509 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:37.510 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.067673+0000", 2024-04-19T03:02:37.510 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.050922350999999998 2024-04-19T03:02:37.510 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.510 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.510 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:37.510 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.067723+0000", 2024-04-19T03:02:37.510 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0586e-05 2024-04-19T03:02:37.510 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:37.510 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:37.510 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:37.510 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.510 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.510 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4755.0:79003 5.2 e40/39 5:4436e33f:::benchmark_data_smithi096_19531_object79002:head v 40'4935, mlcod=40'4932)", 2024-04-19T03:02:37.511 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:18.018102+0000", 2024-04-19T03:02:37.511 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 19.458427774, 2024-04-19T03:02:37.511 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.060023990999999999, 2024-04-19T03:02:37.511 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:37.511 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:37.511 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:37.511 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.511 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:37.511 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018102+0000", 2024-04-19T03:02:37.511 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:37.511 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.511 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.511 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:37.511 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018102+0000", 2024-04-19T03:02:37.511 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:37.512 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.512 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.512 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:37.512 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018102+0000", 2024-04-19T03:02:37.512 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:37.512 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.512 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.512 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:37.512 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018134+0000", 2024-04-19T03:02:37.512 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2722000000000003e-05 2024-04-19T03:02:37.512 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.512 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.512 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:37.512 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018145+0000", 2024-04-19T03:02:37.513 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0395e-05 2024-04-19T03:02:37.513 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.513 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.513 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:37.513 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018151+0000", 2024-04-19T03:02:37.513 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5300000000000002e-06 2024-04-19T03:02:37.513 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.513 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.513 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:37.513 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018489+0000", 2024-04-19T03:02:37.513 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00033731499999999998 2024-04-19T03:02:37.513 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.513 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.513 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:37.513 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018508+0000", 2024-04-19T03:02:37.514 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9775e-05 2024-04-19T03:02:37.514 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.514 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.514 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:37.514 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.078059+0000", 2024-04-19T03:02:37.514 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.059550171999999998 2024-04-19T03:02:37.514 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.514 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.514 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:37.514 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.078126+0000", 2024-04-19T03:02:37.514 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7773000000000003e-05 2024-04-19T03:02:37.514 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:37.514 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:37.514 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:37.515 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.515 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.515 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4755.0:79005 5.1 e40/39 5:85b46038:::benchmark_data_smithi096_19531_object79004:head v 40'4941, mlcod=40'4938)", 2024-04-19T03:02:37.515 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:18.018167+0000", 2024-04-19T03:02:37.515 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 19.458363055, 2024-04-19T03:02:37.515 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.052768941999999999, 2024-04-19T03:02:37.515 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:37.515 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:37.515 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:37.515 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.515 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:37.515 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018167+0000", 2024-04-19T03:02:37.515 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:37.515 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.516 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.516 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:37.516 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018167+0000", 2024-04-19T03:02:37.516 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:37.516 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.516 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.516 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:37.516 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018167+0000", 2024-04-19T03:02:37.516 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:37.516 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.516 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.516 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:37.516 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018196+0000", 2024-04-19T03:02:37.516 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9538000000000001e-05 2024-04-19T03:02:37.517 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.517 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.517 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:37.517 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018204+0000", 2024-04-19T03:02:37.517 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2599999999999999e-06 2024-04-19T03:02:37.517 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.517 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.517 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:37.517 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018208+0000", 2024-04-19T03:02:37.517 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8080000000000004e-06 2024-04-19T03:02:37.517 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.517 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.517 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:37.517 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.064933+0000", 2024-04-19T03:02:37.517 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.046725048999999998 2024-04-19T03:02:37.518 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.518 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.518 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:37.518 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.064964+0000", 2024-04-19T03:02:37.518 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0577000000000002e-05 2024-04-19T03:02:37.518 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.518 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.518 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:37.518 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.070815+0000", 2024-04-19T03:02:37.518 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0058510649999999999 2024-04-19T03:02:37.518 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.518 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.518 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:37.518 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.070936+0000", 2024-04-19T03:02:37.519 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00012095399999999999 2024-04-19T03:02:37.519 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:37.519 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:37.519 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:37.519 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.519 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.519 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:86612 5.7 5:e32e3c49:::benchmark_data_smithi096_19531_object86611:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:37.519 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:22.633560+0000", 2024-04-19T03:02:37.519 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 14.842970114, 2024-04-19T03:02:37.519 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.19135289, 2024-04-19T03:02:37.519 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:37.519 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:37.519 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:37.519 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:37.520 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:37.520 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 86612 2024-04-19T03:02:37.520 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.520 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:37.520 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.520 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:37.520 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633560+0000", 2024-04-19T03:02:37.520 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:37.520 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.520 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.520 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:37.520 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633560+0000", 2024-04-19T03:02:37.520 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:37.520 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.520 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.521 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:37.521 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633558+0000", 2024-04-19T03:02:37.521 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:37.521 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.521 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.521 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:37.521 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633609+0000", 2024-04-19T03:02:37.521 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0850999999999998e-05 2024-04-19T03:02:37.521 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.521 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.521 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:37.521 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633627+0000", 2024-04-19T03:02:37.521 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7951000000000001e-05 2024-04-19T03:02:37.521 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.522 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.522 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:37.522 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633635+0000", 2024-04-19T03:02:37.522 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2530000000000004e-06 2024-04-19T03:02:37.522 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.522 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.522 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:37.522 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633699+0000", 2024-04-19T03:02:37.522 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3901999999999999e-05 2024-04-19T03:02:37.522 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.522 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.522 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:37.522 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633992+0000", 2024-04-19T03:02:37.523 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00029283299999999999 2024-04-19T03:02:37.523 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.523 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.523 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:37.523 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.634223+0000", 2024-04-19T03:02:37.523 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00023084200000000001 2024-04-19T03:02:37.523 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.523 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.523 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:37.523 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.639085+0000", 2024-04-19T03:02:37.523 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0048624269999999999 2024-04-19T03:02:37.523 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.523 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.523 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:37.524 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.824635+0000", 2024-04-19T03:02:37.524 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.18554944700000001 2024-04-19T03:02:37.524 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.524 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.524 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:37.524 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.824793+0000", 2024-04-19T03:02:37.524 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000157959 2024-04-19T03:02:37.524 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.524 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.524 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:37.524 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.824913+0000", 2024-04-19T03:02:37.524 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000120093 2024-04-19T03:02:37.524 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:37.524 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:37.524 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:37.525 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.525 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.525 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:86625 5.7 5:e6d00488:::benchmark_data_smithi096_19531_object86624:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:37.525 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:22.643554+0000", 2024-04-19T03:02:37.525 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 14.832976348000001, 2024-04-19T03:02:37.525 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.18732841, 2024-04-19T03:02:37.525 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:37.525 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:37.525 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:37.525 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:37.525 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:37.525 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 86625 2024-04-19T03:02:37.525 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.525 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:37.526 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.526 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:37.526 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643554+0000", 2024-04-19T03:02:37.526 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:37.526 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.526 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.526 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:37.526 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643554+0000", 2024-04-19T03:02:37.526 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:37.526 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.526 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.526 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:37.526 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643552+0000", 2024-04-19T03:02:37.526 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:37.527 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.527 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.527 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:37.527 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643588+0000", 2024-04-19T03:02:37.527 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5855999999999997e-05 2024-04-19T03:02:37.527 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.527 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.527 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:37.527 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643606+0000", 2024-04-19T03:02:37.527 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8226000000000001e-05 2024-04-19T03:02:37.527 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.527 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.527 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:37.527 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643618+0000", 2024-04-19T03:02:37.528 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1868000000000001e-05 2024-04-19T03:02:37.528 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.528 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.528 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:37.528 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643676+0000", 2024-04-19T03:02:37.528 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8153999999999999e-05 2024-04-19T03:02:37.528 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.528 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.528 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:37.528 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643905+0000", 2024-04-19T03:02:37.528 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00022847500000000001 2024-04-19T03:02:37.528 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.528 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.529 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:37.529 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.644150+0000", 2024-04-19T03:02:37.529 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00024531800000000001 2024-04-19T03:02:37.529 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.529 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.529 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:37.529 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.647407+0000", 2024-04-19T03:02:37.529 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0032563190000000001 2024-04-19T03:02:37.529 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.529 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.529 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:37.529 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.830721+0000", 2024-04-19T03:02:37.529 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.18331468300000001 2024-04-19T03:02:37.529 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.529 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.530 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:37.530 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.830813+0000", 2024-04-19T03:02:37.530 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.2205000000000002e-05 2024-04-19T03:02:37.530 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.530 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.530 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:37.530 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.830882+0000", 2024-04-19T03:02:37.530 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8819999999999995e-05 2024-04-19T03:02:37.530 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:37.530 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:37.530 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:37.530 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.530 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.531 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87063 5.7 5:e502e824:::benchmark_data_smithi096_19531_object87062:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:37.531 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.136067+0000", 2024-04-19T03:02:37.531 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 14.340463479, 2024-04-19T03:02:37.531 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.065521159999999995, 2024-04-19T03:02:37.531 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:37.531 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:37.531 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:37.531 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:37.531 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:37.531 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87063 2024-04-19T03:02:37.531 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.531 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:37.531 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.531 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:37.531 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.136067+0000", 2024-04-19T03:02:37.532 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:37.532 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.532 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.532 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:37.532 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.136067+0000", 2024-04-19T03:02:37.532 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:37.532 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.532 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.532 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:37.532 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.136066+0000", 2024-04-19T03:02:37.532 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:37.532 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.532 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.532 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:37.533 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.136154+0000", 2024-04-19T03:02:37.533 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.8256000000000003e-05 2024-04-19T03:02:37.533 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.533 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.533 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:37.533 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.136162+0000", 2024-04-19T03:02:37.533 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.5099999999999998e-06 2024-04-19T03:02:37.533 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.533 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.533 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:37.533 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.136171+0000", 2024-04-19T03:02:37.533 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2830000000000001e-06 2024-04-19T03:02:37.533 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.533 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.533 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:37.534 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.138421+0000", 2024-04-19T03:02:37.534 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0022506620000000001 2024-04-19T03:02:37.534 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.534 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.534 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:37.534 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.138560+0000", 2024-04-19T03:02:37.534 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000138446 2024-04-19T03:02:37.534 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.534 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.534 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:37.534 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.138689+0000", 2024-04-19T03:02:37.534 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00012950700000000001 2024-04-19T03:02:37.534 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.535 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.535 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:37.535 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.141517+0000", 2024-04-19T03:02:37.535 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0028280860000000001 2024-04-19T03:02:37.535 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.535 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.535 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:37.535 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.201350+0000", 2024-04-19T03:02:37.535 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.059832418999999998 2024-04-19T03:02:37.535 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.535 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.535 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:37.535 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.201485+0000", 2024-04-19T03:02:37.536 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000135597 2024-04-19T03:02:37.536 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.536 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.536 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:37.536 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.201588+0000", 2024-04-19T03:02:37.536 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00010247900000000001 2024-04-19T03:02:37.536 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:37.536 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:37.536 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:37.536 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.536 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.536 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87072 5.7 5:e3c7809a:::benchmark_data_smithi096_19531_object87071:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:37.536 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.144224+0000", 2024-04-19T03:02:37.536 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 14.332306454999999, 2024-04-19T03:02:37.537 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.058179555000000001, 2024-04-19T03:02:37.537 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:37.537 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:37.537 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:37.537 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:37.537 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:37.537 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87072 2024-04-19T03:02:37.537 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.537 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:37.537 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.537 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:37.537 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144224+0000", 2024-04-19T03:02:37.537 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:37.537 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.538 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.538 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:37.538 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144224+0000", 2024-04-19T03:02:37.538 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:37.538 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.538 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.538 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:37.538 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144223+0000", 2024-04-19T03:02:37.538 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:37.538 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.538 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.538 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:37.538 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144320+0000", 2024-04-19T03:02:37.539 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.7075000000000001e-05 2024-04-19T03:02:37.539 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.539 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.539 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:37.539 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144331+0000", 2024-04-19T03:02:37.539 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1342000000000001e-05 2024-04-19T03:02:37.539 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.539 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.539 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:37.539 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144337+0000", 2024-04-19T03:02:37.539 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8390000000000003e-06 2024-04-19T03:02:37.539 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.539 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.539 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:37.539 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144369+0000", 2024-04-19T03:02:37.540 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2079000000000002e-05 2024-04-19T03:02:37.540 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.540 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.540 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:37.540 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144464+0000", 2024-04-19T03:02:37.540 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.4623000000000005e-05 2024-04-19T03:02:37.540 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.540 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.540 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:37.540 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144553+0000", 2024-04-19T03:02:37.540 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9171000000000004e-05 2024-04-19T03:02:37.540 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.540 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.540 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:37.540 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.147018+0000", 2024-04-19T03:02:37.541 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0024648370000000001 2024-04-19T03:02:37.541 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.541 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.541 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:37.541 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.202270+0000", 2024-04-19T03:02:37.541 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.055252018 2024-04-19T03:02:37.541 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.541 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.541 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:37.541 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.202356+0000", 2024-04-19T03:02:37.541 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6648000000000001e-05 2024-04-19T03:02:37.541 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.541 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.541 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:37.541 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.202403+0000", 2024-04-19T03:02:37.542 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6956999999999998e-05 2024-04-19T03:02:37.542 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:37.542 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:37.542 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:37.542 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.542 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.542 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87123 5.6 5:6d1bc3b9:::benchmark_data_smithi096_19531_object87122:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:02:37.542 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249233+0000", 2024-04-19T03:02:37.542 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 14.227297423, 2024-04-19T03:02:37.542 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0291700720000001, 2024-04-19T03:02:37.542 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:37.542 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-04-19T03:02:37.542 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:37.542 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:37.543 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:37.543 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87123 2024-04-19T03:02:37.543 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.543 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:37.543 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.543 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:37.543 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249233+0000", 2024-04-19T03:02:37.543 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:37.543 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.543 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.543 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:37.543 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249233+0000", 2024-04-19T03:02:37.543 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:37.543 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.543 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.544 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:37.544 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249231+0000", 2024-04-19T03:02:37.544 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:37.544 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.544 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.544 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:37.544 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249285+0000", 2024-04-19T03:02:37.544 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4005000000000002e-05 2024-04-19T03:02:37.544 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.544 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.544 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:37.544 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249300+0000", 2024-04-19T03:02:37.544 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4715999999999999e-05 2024-04-19T03:02:37.544 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.544 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.545 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:37.545 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249307+0000", 2024-04-19T03:02:37.545 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8399999999999997e-06 2024-04-19T03:02:37.545 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.545 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.545 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:37.545 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249366+0000", 2024-04-19T03:02:37.545 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9435999999999998e-05 2024-04-19T03:02:37.545 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.545 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.545 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op must wait for map", 2024-04-19T03:02:37.545 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249376+0000", 2024-04-19T03:02:37.545 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.4919999999999999e-06 2024-04-19T03:02:37.546 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.546 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.546 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:37.546 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263757+0000", 2024-04-19T03:02:37.546 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.014381461999999999 2024-04-19T03:02:37.546 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.546 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.546 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:02:37.546 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263875+0000", 2024-04-19T03:02:37.546 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000117166 2024-04-19T03:02:37.546 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.546 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.546 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:37.546 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.277136+0000", 2024-04-19T03:02:37.547 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.013261207 2024-04-19T03:02:37.547 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.547 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.547 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:37.547 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.278403+0000", 2024-04-19T03:02:37.547 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001267106 2024-04-19T03:02:37.547 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:37.547 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:37.547 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:37.547 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.547 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.547 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87128 5.6 5:6905c420:::benchmark_data_smithi096_19531_object87127:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:02:37.547 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249323+0000", 2024-04-19T03:02:37.547 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 14.227206676, 2024-04-19T03:02:37.547 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0292813249999999, 2024-04-19T03:02:37.548 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:37.548 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-04-19T03:02:37.548 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:37.548 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:37.548 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:37.548 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87128 2024-04-19T03:02:37.548 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.548 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:37.548 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.548 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:37.548 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249323+0000", 2024-04-19T03:02:37.548 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:37.548 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.548 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.548 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:37.549 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249323+0000", 2024-04-19T03:02:37.549 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:37.549 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.549 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.549 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:37.549 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249323+0000", 2024-04-19T03:02:37.549 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:37.549 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.549 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.549 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:37.549 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249385+0000", 2024-04-19T03:02:37.549 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1711999999999995e-05 2024-04-19T03:02:37.549 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.549 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.550 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:37.550 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249398+0000", 2024-04-19T03:02:37.550 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3022e-05 2024-04-19T03:02:37.550 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.550 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.550 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:37.550 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249402+0000", 2024-04-19T03:02:37.550 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4819999999999996e-06 2024-04-19T03:02:37.550 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.550 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.550 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:37.550 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249437+0000", 2024-04-19T03:02:37.550 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4702000000000001e-05 2024-04-19T03:02:37.550 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.551 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.551 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:02:37.551 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249442+0000", 2024-04-19T03:02:37.551 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8019999999999999e-06 2024-04-19T03:02:37.551 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.551 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.551 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:37.551 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263896+0000", 2024-04-19T03:02:37.551 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.014454679999999999 2024-04-19T03:02:37.551 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.551 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.551 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:02:37.551 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263900+0000", 2024-04-19T03:02:37.551 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9700000000000001e-06 2024-04-19T03:02:37.552 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.552 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.552 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:37.552 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.278557+0000", 2024-04-19T03:02:37.552 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0146566480000001 2024-04-19T03:02:37.552 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.552 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.552 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:37.552 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.278605+0000", 2024-04-19T03:02:37.552 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7735999999999998e-05 2024-04-19T03:02:37.552 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:37.552 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:37.552 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:37.552 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.553 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.553 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87130 5.3 5:c8c2d67b:::benchmark_data_smithi096_19531_object87129:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:02:37.553 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249418+0000", 2024-04-19T03:02:37.553 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 14.227111965000001, 2024-04-19T03:02:37.553 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.025414182, 2024-04-19T03:02:37.553 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:37.553 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-04-19T03:02:37.553 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:37.553 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:37.553 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:37.553 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87130 2024-04-19T03:02:37.553 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.553 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:37.553 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.553 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:37.554 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249418+0000", 2024-04-19T03:02:37.554 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:37.554 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.554 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.554 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:37.554 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249418+0000", 2024-04-19T03:02:37.554 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:37.554 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.554 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.554 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:37.554 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249409+0000", 2024-04-19T03:02:37.554 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999905 2024-04-19T03:02:37.554 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.555 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.555 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:37.555 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249464+0000", 2024-04-19T03:02:37.555 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5381999999999999e-05 2024-04-19T03:02:37.555 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.555 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.555 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:37.555 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249471+0000", 2024-04-19T03:02:37.555 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2609999999999996e-06 2024-04-19T03:02:37.555 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.555 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.556 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:37.556 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249475+0000", 2024-04-19T03:02:37.556 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2839999999999998e-06 2024-04-19T03:02:37.556 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.556 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.556 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:37.556 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249535+0000", 2024-04-19T03:02:37.556 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0545999999999999e-05 2024-04-19T03:02:37.556 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.556 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.556 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op must wait for map", 2024-04-19T03:02:37.556 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249540+0000", 2024-04-19T03:02:37.556 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2859999999999999e-06 2024-04-19T03:02:37.557 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.557 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.557 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:37.557 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263450+0000", 2024-04-19T03:02:37.557 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.013909585 2024-04-19T03:02:37.557 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.557 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.557 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:02:37.557 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263458+0000", 2024-04-19T03:02:37.557 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8089999999999993e-06 2024-04-19T03:02:37.557 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.557 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.557 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:37.557 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.273193+0000", 2024-04-19T03:02:37.558 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0097351379999999 2024-04-19T03:02:37.558 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.558 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.558 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:37.558 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.274832+0000", 2024-04-19T03:02:37.558 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0016394789999999999 2024-04-19T03:02:37.558 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:37.558 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:37.558 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:37.558 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.558 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.558 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87131 5.1 5:83756d55:::benchmark_data_smithi096_19531_object87130:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:02:37.558 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249491+0000", 2024-04-19T03:02:37.559 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 14.227039317999999, 2024-04-19T03:02:37.559 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0191489520000001, 2024-04-19T03:02:37.559 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:37.559 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-04-19T03:02:37.559 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:37.559 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:37.559 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:37.559 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87131 2024-04-19T03:02:37.559 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.559 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:37.559 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.559 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:37.559 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249491+0000", 2024-04-19T03:02:37.559 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:37.560 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.560 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.560 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:37.560 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249491+0000", 2024-04-19T03:02:37.560 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:37.560 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.560 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.560 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:37.560 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249491+0000", 2024-04-19T03:02:37.560 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:37.560 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.560 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.560 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:37.561 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249530+0000", 2024-04-19T03:02:37.561 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9589000000000003e-05 2024-04-19T03:02:37.561 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.561 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.561 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:37.561 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249544+0000", 2024-04-19T03:02:37.561 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4158000000000001e-05 2024-04-19T03:02:37.561 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.561 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.561 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:37.561 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249549+0000", 2024-04-19T03:02:37.561 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6809999999999997e-06 2024-04-19T03:02:37.561 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.561 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.562 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:37.562 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249592+0000", 2024-04-19T03:02:37.562 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3285999999999999e-05 2024-04-19T03:02:37.562 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.562 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.562 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op must wait for map", 2024-04-19T03:02:37.562 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249598+0000", 2024-04-19T03:02:37.562 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8329999999999999e-06 2024-04-19T03:02:37.562 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.562 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.562 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:37.562 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263331+0000", 2024-04-19T03:02:37.562 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.013733093 2024-04-19T03:02:37.563 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.563 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.563 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:02:37.563 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263343+0000", 2024-04-19T03:02:37.563 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.189e-05 2024-04-19T03:02:37.563 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.563 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.563 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:37.563 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.268541+0000", 2024-04-19T03:02:37.563 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0051983440000001 2024-04-19T03:02:37.563 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.563 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.563 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:37.563 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.268640+0000", 2024-04-19T03:02:37.564 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.8387999999999994e-05 2024-04-19T03:02:37.564 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:37.564 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:37.564 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:37.564 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.564 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.564 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87132 5.c 5:3e18b732:::benchmark_data_smithi096_19531_object87131:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:02:37.564 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249558+0000", 2024-04-19T03:02:37.564 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 14.226972417000001, 2024-04-19T03:02:37.564 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0241198380000001, 2024-04-19T03:02:37.564 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:37.564 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-04-19T03:02:37.564 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:37.564 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:37.565 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:37.565 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87132 2024-04-19T03:02:37.565 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.565 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:37.565 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.565 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:37.565 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249558+0000", 2024-04-19T03:02:37.565 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:37.565 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.565 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.565 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:37.565 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249558+0000", 2024-04-19T03:02:37.565 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:37.565 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.565 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.566 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:37.566 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249557+0000", 2024-04-19T03:02:37.566 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:37.566 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.566 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.566 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:37.566 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249625+0000", 2024-04-19T03:02:37.566 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7200999999999996e-05 2024-04-19T03:02:37.566 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.566 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.566 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:37.566 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249646+0000", 2024-04-19T03:02:37.566 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1053e-05 2024-04-19T03:02:37.567 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.567 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.567 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:37.567 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249650+0000", 2024-04-19T03:02:37.567 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2719999999999999e-06 2024-04-19T03:02:37.567 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.567 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.567 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:37.567 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249686+0000", 2024-04-19T03:02:37.567 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6430000000000002e-05 2024-04-19T03:02:37.567 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.567 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.567 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op must wait for map", 2024-04-19T03:02:37.567 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249690+0000", 2024-04-19T03:02:37.568 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.765e-06 2024-04-19T03:02:37.568 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.568 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.568 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:37.568 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261157+0000", 2024-04-19T03:02:37.568 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011467247999999999 2024-04-19T03:02:37.568 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.568 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.568 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:02:37.568 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261170+0000", 2024-04-19T03:02:37.568 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2833000000000001e-05 2024-04-19T03:02:37.568 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.568 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.568 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:37.569 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.272119+0000", 2024-04-19T03:02:37.569 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.010949313 2024-04-19T03:02:37.569 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.569 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.569 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:37.569 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.273678+0000", 2024-04-19T03:02:37.569 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0015581550000000001 2024-04-19T03:02:37.569 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:37.569 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:37.569 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:37.569 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.569 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.569 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87133 5.c 5:3f772a62:::benchmark_data_smithi096_19531_object87132:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:02:37.569 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249657+0000", 2024-04-19T03:02:37.569 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 14.226873038000001, 2024-04-19T03:02:37.570 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0242819409999999, 2024-04-19T03:02:37.570 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:37.570 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-04-19T03:02:37.570 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:37.570 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:37.570 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:37.570 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87133 2024-04-19T03:02:37.570 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.570 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:37.570 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.570 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:37.570 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249657+0000", 2024-04-19T03:02:37.570 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:37.571 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.571 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.571 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:37.571 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249657+0000", 2024-04-19T03:02:37.571 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:37.571 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.571 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.571 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:37.571 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249657+0000", 2024-04-19T03:02:37.571 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:37.571 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.571 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.571 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:37.571 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249690+0000", 2024-04-19T03:02:37.572 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3343000000000002e-05 2024-04-19T03:02:37.572 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.572 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.572 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:37.572 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249695+0000", 2024-04-19T03:02:37.572 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8600000000000001e-06 2024-04-19T03:02:37.572 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.572 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.572 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:37.572 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249698+0000", 2024-04-19T03:02:37.572 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.1700000000000001e-06 2024-04-19T03:02:37.572 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.572 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.573 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:37.573 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249741+0000", 2024-04-19T03:02:37.573 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2849999999999998e-05 2024-04-19T03:02:37.573 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.573 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.573 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:02:37.573 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249746+0000", 2024-04-19T03:02:37.573 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1019999999999996e-06 2024-04-19T03:02:37.573 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.573 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.573 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:37.573 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261209+0000", 2024-04-19T03:02:37.573 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011462447000000001 2024-04-19T03:02:37.573 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.574 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.574 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:02:37.574 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261216+0000", 2024-04-19T03:02:37.574 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8520000000000004e-06 2024-04-19T03:02:37.574 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.574 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.574 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:37.574 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.273872+0000", 2024-04-19T03:02:37.574 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0126558000000001 2024-04-19T03:02:37.574 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.574 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.574 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:37.574 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.273939+0000", 2024-04-19T03:02:37.575 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6822000000000005e-05 2024-04-19T03:02:37.575 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:37.575 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:37.575 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:37.575 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.575 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.575 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87134 5.5 5:a56c478f:::benchmark_data_smithi096_19531_object87133:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:02:37.575 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249708+0000", 2024-04-19T03:02:37.575 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 14.226822114000001, 2024-04-19T03:02:37.575 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0214677299999999, 2024-04-19T03:02:37.575 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:37.575 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-04-19T03:02:37.575 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:37.576 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:37.576 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:37.576 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87134 2024-04-19T03:02:37.576 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.576 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:37.576 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.576 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:37.576 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249708+0000", 2024-04-19T03:02:37.576 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:37.576 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.576 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.576 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:37.576 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249708+0000", 2024-04-19T03:02:37.577 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:37.577 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.577 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.577 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:37.577 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249706+0000", 2024-04-19T03:02:37.577 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999976 2024-04-19T03:02:37.577 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.577 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.577 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:37.577 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249740+0000", 2024-04-19T03:02:37.577 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4458000000000001e-05 2024-04-19T03:02:37.577 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.577 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.577 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:37.578 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249745+0000", 2024-04-19T03:02:37.578 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5020000000000003e-06 2024-04-19T03:02:37.578 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.578 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.578 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:37.578 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249748+0000", 2024-04-19T03:02:37.578 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2499999999999998e-06 2024-04-19T03:02:37.578 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.578 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.578 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:37.578 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249778+0000", 2024-04-19T03:02:37.578 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.006e-05 2024-04-19T03:02:37.578 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.578 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.579 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op must wait for map", 2024-04-19T03:02:37.579 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249782+0000", 2024-04-19T03:02:37.579 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2910000000000001e-06 2024-04-19T03:02:37.579 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.579 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.579 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:37.579 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261666+0000", 2024-04-19T03:02:37.579 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011883471 2024-04-19T03:02:37.579 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.579 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.579 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:02:37.579 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261674+0000", 2024-04-19T03:02:37.579 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6479999999999992e-06 2024-04-19T03:02:37.579 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.580 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.580 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:37.580 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.269323+0000", 2024-04-19T03:02:37.580 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.00764867 2024-04-19T03:02:37.580 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.580 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.580 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:37.580 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.271176+0000", 2024-04-19T03:02:37.580 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001852844 2024-04-19T03:02:37.580 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:37.580 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:37.580 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:37.580 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.580 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.580 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87137 5.c 5:30708c68:::benchmark_data_smithi096_19531_object87136:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:02:37.580 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249756+0000", 2024-04-19T03:02:37.581 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 14.226774408000001, 2024-04-19T03:02:37.581 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.033331752, 2024-04-19T03:02:37.581 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:37.581 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:37.581 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:37.581 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:37.581 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:37.581 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87137 2024-04-19T03:02:37.581 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.581 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:37.581 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.581 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:37.581 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249756+0000", 2024-04-19T03:02:37.581 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:37.581 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.582 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.582 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:37.582 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249756+0000", 2024-04-19T03:02:37.582 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:37.582 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.582 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.582 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:37.582 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249755+0000", 2024-04-19T03:02:37.582 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:37.582 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.582 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.582 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:37.582 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249777+0000", 2024-04-19T03:02:37.582 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1420000000000002e-05 2024-04-19T03:02:37.582 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.583 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.583 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:37.583 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249781+0000", 2024-04-19T03:02:37.583 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0609999999999997e-06 2024-04-19T03:02:37.583 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.583 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.583 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:37.583 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249787+0000", 2024-04-19T03:02:37.583 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.02e-06 2024-04-19T03:02:37.583 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.583 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.583 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:37.583 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249818+0000", 2024-04-19T03:02:37.583 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0947e-05 2024-04-19T03:02:37.584 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.584 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.584 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:02:37.584 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249821+0000", 2024-04-19T03:02:37.584 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.117e-06 2024-04-19T03:02:37.584 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.584 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.584 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:37.584 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261243+0000", 2024-04-19T03:02:37.584 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011421875999999999 2024-04-19T03:02:37.584 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.584 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.584 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:02:37.584 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261251+0000", 2024-04-19T03:02:37.585 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6120000000000001e-06 2024-04-19T03:02:37.585 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.585 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.585 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:37.585 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.274050+0000", 2024-04-19T03:02:37.585 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.012799405 2024-04-19T03:02:37.585 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.585 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.585 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:37.585 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.274529+0000", 2024-04-19T03:02:37.585 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00047867100000000001 2024-04-19T03:02:37.585 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.585 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.586 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:37.586 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.282972+0000", 2024-04-19T03:02:37.586 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0084436900000000002 2024-04-19T03:02:37.586 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.586 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.586 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:37.586 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.283022+0000", 2024-04-19T03:02:37.586 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9339000000000003e-05 2024-04-19T03:02:37.586 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:37.586 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:37.586 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:37.586 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.283088+0000", 2024-04-19T03:02:37.586 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5877999999999995e-05 2024-04-19T03:02:37.586 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:37.587 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:37.587 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:37.587 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:37.587 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:37.587 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-04-19T03:02:37.587 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-19T03:02:37.589 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:37.585+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:37.589 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T03:02:37.689 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:37.687+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:37.714 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-19T03:02:37.715 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-04-19T03:02:37.715 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:37.715 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:113228 5.b 5:dee925b1:::benchmark_data_smithi096_19531_object113227:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-19T03:02:37.715 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:37.709580+0000", 2024-04-19T03:02:37.715 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0045282949999999999, 2024-04-19T03:02:37.715 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0045474260000000002, 2024-04-19T03:02:37.715 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:37.715 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-19T03:02:37.715 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:37.715 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:37.715 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:37.715 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 113228 2024-04-19T03:02:37.716 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:37.716 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:37.716 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:37.716 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:37.716 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:37.709580+0000", 2024-04-19T03:02:37.716 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:37.716 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:37.716 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:37.716 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:37.716 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:37.709580+0000", 2024-04-19T03:02:37.716 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:37.716 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:37.717 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:37.717 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:37.717 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:37.709579+0000", 2024-04-19T03:02:37.717 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:37.717 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:37.717 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:37.717 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:37.717 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:37.709604+0000", 2024-04-19T03:02:37.717 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4949000000000001e-05 2024-04-19T03:02:37.717 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:37.717 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:37.717 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:37.717 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:37.709611+0000", 2024-04-19T03:02:37.717 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4269999999999996e-06 2024-04-19T03:02:37.718 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:37.718 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:37.718 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:37.718 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:37.709616+0000", 2024-04-19T03:02:37.718 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4029999999999998e-06 2024-04-19T03:02:37.718 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:37.718 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:37.718 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:37.718 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:37.709665+0000", 2024-04-19T03:02:37.718 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9245e-05 2024-04-19T03:02:37.718 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:37.718 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:37.718 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:37.719 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:37.709814+0000", 2024-04-19T03:02:37.719 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000148591 2024-04-19T03:02:37.719 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:37.719 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:37.719 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:37.719 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:37.719 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:37.719 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:113230 5.a 5:5b5dbd77:::benchmark_data_smithi096_19531_object113229:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-19T03:02:37.719 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:37.711764+0000", 2024-04-19T03:02:37.719 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0023442910000000001, 2024-04-19T03:02:37.719 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0024526270000000002, 2024-04-19T03:02:37.719 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:37.719 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-19T03:02:37.720 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:37.720 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:37.720 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:37.720 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 113230 2024-04-19T03:02:37.720 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:37.720 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:37.720 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:37.720 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:37.720 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:37.711764+0000", 2024-04-19T03:02:37.720 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:37.720 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:37.720 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:37.720 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:37.720 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:37.711764+0000", 2024-04-19T03:02:37.720 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:37.721 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:37.721 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:37.721 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:37.721 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:37.711763+0000", 2024-04-19T03:02:37.721 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:37.721 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:37.721 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:37.721 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:37.721 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:37.711833+0000", 2024-04-19T03:02:37.721 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.9777999999999995e-05 2024-04-19T03:02:37.721 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:37.721 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:37.721 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:37.722 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:37.711844+0000", 2024-04-19T03:02:37.722 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1066e-05 2024-04-19T03:02:37.722 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:37.722 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:37.722 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:37.722 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:37.711852+0000", 2024-04-19T03:02:37.722 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.6219999999999998e-06 2024-04-19T03:02:37.722 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:37.722 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:37.722 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:37.722 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:37.711953+0000", 2024-04-19T03:02:37.722 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000100834 2024-04-19T03:02:37.722 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:37.722 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:37.723 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:37.723 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:37.712056+0000", 2024-04-19T03:02:37.723 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000102669 2024-04-19T03:02:37.723 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:37.723 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:37.723 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:37.723 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:37.723 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:37.723 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:113233 5.e 5.71392a5e (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-19T03:02:37.723 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:37.714156+0000", 2024-04-19T03:02:37.723 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 4294967295.9999518, 2024-04-19T03:02:37.723 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000111595, 2024-04-19T03:02:37.723 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:37.723 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-04-19T03:02:37.724 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:37.724 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:37.724 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:37.724 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 113233 2024-04-19T03:02:37.724 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:37.724 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:37.724 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:37.724 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:37.724 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:37.714156+0000", 2024-04-19T03:02:37.724 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:37.724 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:37.724 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:37.724 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:37.724 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:37.714156+0000", 2024-04-19T03:02:37.725 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:37.725 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:37.725 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:37.725 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:37.725 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:37.714155+0000", 2024-04-19T03:02:37.725 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:37.725 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:37.725 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:37.725 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:37.725 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:37.714215+0000", 2024-04-19T03:02:37.725 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0130999999999997e-05 2024-04-19T03:02:37.725 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:37.725 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:37.725 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:37.726 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:37.714225+0000", 2024-04-19T03:02:37.726 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.3260000000000002e-06 2024-04-19T03:02:37.726 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:37.726 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:37.726 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:37.726 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:37.714230+0000", 2024-04-19T03:02:37.726 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3349999999999997e-06 2024-04-19T03:02:37.726 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:37.727 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:37.727 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:37.727 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:37.727 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:37.727 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:113212 5.4 5:2592a254:::benchmark_data_smithi096_19531_object113211:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-19T03:02:37.727 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:37.702299+0000", 2024-04-19T03:02:37.727 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.011809547, 2024-04-19T03:02:37.727 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.012021342000000001, 2024-04-19T03:02:37.727 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:37.727 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-19T03:02:37.728 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:37.728 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:37.728 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:37.728 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 113212 2024-04-19T03:02:37.728 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:37.728 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:37.728 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:37.728 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:37.728 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:37.702299+0000", 2024-04-19T03:02:37.728 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:37.728 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:37.729 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:37.729 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:37.729 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:37.702299+0000", 2024-04-19T03:02:37.729 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:37.729 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:37.729 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:37.729 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:37.729 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:37.702298+0000", 2024-04-19T03:02:37.729 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:37.729 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:37.729 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:37.730 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:37.730 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:37.702363+0000", 2024-04-19T03:02:37.730 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4791999999999999e-05 2024-04-19T03:02:37.730 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:37.730 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:37.730 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:37.730 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:37.702374+0000", 2024-04-19T03:02:37.730 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1644000000000001e-05 2024-04-19T03:02:37.730 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:37.730 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:37.731 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:37.731 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:37.702382+0000", 2024-04-19T03:02:37.731 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.2570000000000007e-06 2024-04-19T03:02:37.731 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:37.731 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:37.731 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:37.731 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:37.702446+0000", 2024-04-19T03:02:37.731 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3076000000000004e-05 2024-04-19T03:02:37.731 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:37.731 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:37.731 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:37.731 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:37.702608+0000", 2024-04-19T03:02:37.732 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016199300000000001 2024-04-19T03:02:37.732 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:37.732 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:37.732 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:37.732 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:37.732 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:37.732 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:113213 5.a 5:5b3c0b74:::benchmark_data_smithi096_19531_object113212:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-19T03:02:37.732 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:37.702407+0000", 2024-04-19T03:02:37.732 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.011701677000000001, 2024-04-19T03:02:37.733 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011952597000000001, 2024-04-19T03:02:37.733 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:37.733 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-19T03:02:37.733 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:37.733 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:37.733 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:37.733 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 113213 2024-04-19T03:02:37.733 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:37.733 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:37.733 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:37.733 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:37.734 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:37.702407+0000", 2024-04-19T03:02:37.734 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:37.734 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:37.734 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:37.734 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:37.734 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:37.702407+0000", 2024-04-19T03:02:37.734 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:37.734 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:37.734 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:37.735 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:37.735 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:37.702406+0000", 2024-04-19T03:02:37.735 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:37.735 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:37.735 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:37.735 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:37.735 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:37.702451+0000", 2024-04-19T03:02:37.735 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5605000000000001e-05 2024-04-19T03:02:37.735 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:37.735 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:37.735 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:37.736 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:37.702460+0000", 2024-04-19T03:02:37.736 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.6910000000000003e-06 2024-04-19T03:02:37.736 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:37.736 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:37.736 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:37.736 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:37.702469+0000", 2024-04-19T03:02:37.736 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.7870000000000007e-06 2024-04-19T03:02:37.736 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:37.736 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:37.736 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:37.736 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:37.705435+0000", 2024-04-19T03:02:37.736 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.002965643 2024-04-19T03:02:37.737 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:37.737 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:37.737 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:37.737 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:37.705571+0000", 2024-04-19T03:02:37.737 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013629399999999999 2024-04-19T03:02:37.737 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:37.737 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:37.737 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:37.737 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:37.737 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:37.737 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:113219 5.4 5:217add04:::benchmark_data_smithi096_19531_object113218:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-19T03:02:37.738 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:37.708439+0000", 2024-04-19T03:02:37.738 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0056691409999999999, 2024-04-19T03:02:37.738 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0059753130000000003, 2024-04-19T03:02:37.738 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:37.738 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-19T03:02:37.738 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:37.738 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:37.738 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:37.738 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 113219 2024-04-19T03:02:37.739 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:37.739 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:37.739 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:37.739 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:37.739 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:37.708439+0000", 2024-04-19T03:02:37.739 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:37.739 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:37.739 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:37.739 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:37.739 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:37.708439+0000", 2024-04-19T03:02:37.740 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:37.740 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:37.740 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:37.740 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:37.740 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:37.708438+0000", 2024-04-19T03:02:37.740 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:37.740 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:37.740 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:37.740 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:37.740 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:37.708486+0000", 2024-04-19T03:02:37.740 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7871999999999998e-05 2024-04-19T03:02:37.741 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:37.741 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:37.741 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:37.741 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:37.708496+0000", 2024-04-19T03:02:37.741 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0487e-05 2024-04-19T03:02:37.741 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:37.741 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:37.741 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:37.741 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:37.708505+0000", 2024-04-19T03:02:37.741 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.7069999999999998e-06 2024-04-19T03:02:37.741 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:37.742 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:37.742 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:37.742 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:37.708540+0000", 2024-04-19T03:02:37.742 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5565999999999998e-05 2024-04-19T03:02:37.742 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:37.742 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:37.742 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:37.742 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:37.708637+0000", 2024-04-19T03:02:37.742 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.6953000000000005e-05 2024-04-19T03:02:37.742 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:37.743 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:37.743 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:37.743 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:37.743 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:37.743 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:113221 5.0 5:0d8dc547:::benchmark_data_smithi096_19531_object113220:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-19T03:02:37.743 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:37.708520+0000", 2024-04-19T03:02:37.743 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0055881919999999996, 2024-04-19T03:02:37.743 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0059619390000000003, 2024-04-19T03:02:37.743 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:37.743 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-19T03:02:37.743 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:37.744 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:37.744 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:37.744 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 113221 2024-04-19T03:02:37.744 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:37.744 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:37.744 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:37.744 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:37.744 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:37.708520+0000", 2024-04-19T03:02:37.744 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:37.744 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:37.744 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:37.744 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:37.744 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:37.708520+0000", 2024-04-19T03:02:37.745 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:37.745 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:37.745 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:37.745 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:37.745 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:37.708519+0000", 2024-04-19T03:02:37.745 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:37.745 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:37.745 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:37.745 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:37.745 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:37.708559+0000", 2024-04-19T03:02:37.745 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.0238999999999999e-05 2024-04-19T03:02:37.745 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:37.745 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:37.746 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:37.746 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:37.708567+0000", 2024-04-19T03:02:37.746 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.678e-06 2024-04-19T03:02:37.746 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:37.746 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:37.746 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:37.746 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:37.708573+0000", 2024-04-19T03:02:37.746 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2759999999999997e-06 2024-04-19T03:02:37.746 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:37.746 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:37.747 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:37.747 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:37.708601+0000", 2024-04-19T03:02:37.747 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7484999999999999e-05 2024-04-19T03:02:37.747 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:37.747 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:37.747 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:37.747 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:37.708691+0000", 2024-04-19T03:02:37.747 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.0309000000000006e-05 2024-04-19T03:02:37.747 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:37.748 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:37.748 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:37.748 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:37.748 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:37.748 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:113222 5.4 5:2a61c946:::benchmark_data_smithi096_19531_object113221:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-19T03:02:37.748 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:37.708584+0000", 2024-04-19T03:02:37.748 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0055238120000000003, 2024-04-19T03:02:37.748 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0059612170000000004, 2024-04-19T03:02:37.748 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:37.748 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-19T03:02:37.748 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:37.749 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:37.749 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:37.749 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 113222 2024-04-19T03:02:37.749 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:37.749 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:37.749 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:37.749 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:37.749 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:37.708584+0000", 2024-04-19T03:02:37.749 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:37.749 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:37.749 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:37.750 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:37.750 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:37.708584+0000", 2024-04-19T03:02:37.750 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:37.750 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:37.750 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:37.750 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:37.750 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:37.708584+0000", 2024-04-19T03:02:37.750 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:37.750 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:37.750 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:37.751 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:37.751 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:37.708621+0000", 2024-04-19T03:02:37.751 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7098999999999998e-05 2024-04-19T03:02:37.751 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:37.751 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:37.751 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:37.751 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:37.708628+0000", 2024-04-19T03:02:37.751 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4150000000000002e-06 2024-04-19T03:02:37.751 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:37.751 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:37.751 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:37.751 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:37.708634+0000", 2024-04-19T03:02:37.752 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4240000000000001e-06 2024-04-19T03:02:37.752 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:37.752 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:37.752 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:37.752 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:37.711875+0000", 2024-04-19T03:02:37.752 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.003241374 2024-04-19T03:02:37.752 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:37.752 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:37.752 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:37.752 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:37.711992+0000", 2024-04-19T03:02:37.752 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000116579 2024-04-19T03:02:37.753 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:37.753 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:37.753 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:37.753 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:37.753 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:37.753 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:113223 5.d 5:b54517b4:::benchmark_data_smithi096_19531_object113222:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-19T03:02:37.753 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:37.708643+0000", 2024-04-19T03:02:37.753 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0054648600000000002, 2024-04-19T03:02:37.753 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0059413260000000002, 2024-04-19T03:02:37.753 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:37.753 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:02:37.754 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:37.754 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:37.754 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:37.754 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 113223 2024-04-19T03:02:37.754 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:37.754 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:37.754 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:37.754 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:37.755 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:37.708643+0000", 2024-04-19T03:02:37.755 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:37.755 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:37.755 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:37.755 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:37.755 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:37.708643+0000", 2024-04-19T03:02:37.755 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:37.755 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:37.755 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:37.755 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:37.755 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:37.708643+0000", 2024-04-19T03:02:37.756 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:37.756 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:37.756 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:37.756 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:37.756 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:37.708675+0000", 2024-04-19T03:02:37.756 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2221000000000002e-05 2024-04-19T03:02:37.756 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:37.756 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:37.756 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:37.756 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:37.708682+0000", 2024-04-19T03:02:37.756 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4320000000000002e-06 2024-04-19T03:02:37.757 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:37.757 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:37.757 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:37.757 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:37.708688+0000", 2024-04-19T03:02:37.757 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5219999999999998e-06 2024-04-19T03:02:37.757 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:37.757 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:37.757 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:37.757 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:37.708728+0000", 2024-04-19T03:02:37.757 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.0420999999999998e-05 2024-04-19T03:02:37.757 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:37.758 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:37.758 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:37.758 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:37.708868+0000", 2024-04-19T03:02:37.758 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013935600000000001 2024-04-19T03:02:37.758 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:37.758 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:37.758 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-04-19T03:02:37.758 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:37.709002+0000", 2024-04-19T03:02:37.758 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013459299999999999 2024-04-19T03:02:37.758 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:37.758 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:37.759 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:37.759 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:37.711993+0000", 2024-04-19T03:02:37.759 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0029906500000000001 2024-04-19T03:02:37.759 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:37.759 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:37.759 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:37.759 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:37.759 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:37.760 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:113224 5.a 5:57918aa6:::benchmark_data_smithi096_19531_object113223:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-19T03:02:37.760 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:37.708699+0000", 2024-04-19T03:02:37.760 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0054094809999999998, 2024-04-19T03:02:37.760 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.005926677, 2024-04-19T03:02:37.760 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:37.760 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-19T03:02:37.760 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:37.760 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:37.760 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:37.760 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 113224 2024-04-19T03:02:37.761 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:37.761 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:37.761 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:37.761 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:37.761 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:37.708699+0000", 2024-04-19T03:02:37.761 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:37.761 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:37.761 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:37.761 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:37.761 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:37.708699+0000", 2024-04-19T03:02:37.761 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:37.761 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:37.762 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:37.762 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:37.762 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:37.708698+0000", 2024-04-19T03:02:37.762 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:37.762 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:37.762 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:37.762 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:37.762 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:37.708739+0000", 2024-04-19T03:02:37.762 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1010999999999997e-05 2024-04-19T03:02:37.762 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:37.763 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:37.763 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:37.763 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:37.708747+0000", 2024-04-19T03:02:37.763 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.7000000000000008e-06 2024-04-19T03:02:37.763 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:37.763 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:37.763 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:37.763 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:37.708753+0000", 2024-04-19T03:02:37.763 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8869999999999997e-06 2024-04-19T03:02:37.763 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:37.763 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:37.764 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:37.764 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:37.708821+0000", 2024-04-19T03:02:37.764 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7995000000000002e-05 2024-04-19T03:02:37.764 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:37.764 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:37.764 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:37.764 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:37.708962+0000", 2024-04-19T03:02:37.764 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014125499999999999 2024-04-19T03:02:37.764 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:37.764 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:37.765 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:37.765 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:37.765 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:37.765 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:113226 5.4 5:24827506:::benchmark_data_smithi096_19531_object113225:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-19T03:02:37.765 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:37.709028+0000", 2024-04-19T03:02:37.765 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0050804370000000001, 2024-04-19T03:02:37.765 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0056314879999999996, 2024-04-19T03:02:37.765 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:37.765 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-19T03:02:37.765 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:37.765 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:37.766 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:37.766 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 113226 2024-04-19T03:02:37.766 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:37.766 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:37.766 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:37.766 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:37.766 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:37.709028+0000", 2024-04-19T03:02:37.766 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:37.766 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:37.766 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:37.767 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:37.767 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:37.709028+0000", 2024-04-19T03:02:37.767 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:37.767 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:37.767 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:37.767 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:37.767 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:37.709027+0000", 2024-04-19T03:02:37.767 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:37.767 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:37.767 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:37.767 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:37.767 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:37.709508+0000", 2024-04-19T03:02:37.768 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00048143900000000001 2024-04-19T03:02:37.768 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:37.768 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:37.768 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:37.768 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:37.709519+0000", 2024-04-19T03:02:37.768 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0844e-05 2024-04-19T03:02:37.768 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:37.768 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:37.768 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:37.769 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:37.709527+0000", 2024-04-19T03:02:37.769 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.627e-06 2024-04-19T03:02:37.769 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:37.769 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:37.769 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:37.769 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:37.714373+0000", 2024-04-19T03:02:37.769 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0048458310000000001 2024-04-19T03:02:37.769 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:37.769 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:37.769 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:37.769 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:37.714508+0000", 2024-04-19T03:02:37.770 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000135697 2024-04-19T03:02:37.770 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:37.770 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:37.770 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:37.770 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:37.770 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:37.770 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:113227 5.4 5.b6654b24 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e48)", 2024-04-19T03:02:37.770 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:37.709534+0000", 2024-04-19T03:02:37.770 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0045739409999999998, 2024-04-19T03:02:37.770 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0051569720000000001, 2024-04-19T03:02:37.771 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:37.771 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-04-19T03:02:37.771 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:37.771 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:37.771 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:37.771 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 113227 2024-04-19T03:02:37.771 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:37.771 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:37.771 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:37.771 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:37.771 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:37.709534+0000", 2024-04-19T03:02:37.772 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:37.772 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:37.772 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:37.772 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:37.772 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:37.709534+0000", 2024-04-19T03:02:37.772 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:37.772 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:37.772 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:37.772 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:37.772 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:37.709534+0000", 2024-04-19T03:02:37.772 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:37.773 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:37.773 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:37.773 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:37.773 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:37.709562+0000", 2024-04-19T03:02:37.773 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8161e-05 2024-04-19T03:02:37.773 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:37.773 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:37.773 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:37.773 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:37.709569+0000", 2024-04-19T03:02:37.773 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.8569999999999997e-06 2024-04-19T03:02:37.773 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:37.774 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:37.774 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:37.774 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:37.709574+0000", 2024-04-19T03:02:37.774 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5330000000000002e-06 2024-04-19T03:02:37.774 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:37.774 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:37.774 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:37.774 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:37.774 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-04-19T03:02:37.774 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 12 2024-04-19T03:02:37.774 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-19T03:02:37.776 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1: {} 2024-04-19T03:02:37.776 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2: {} 2024-04-19T03:02:37.777 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T03:02:37.777 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-19T03:02:37.777 INFO:teuthology.orchestra.run.smithi096.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-04-19T03:02:37.778 INFO:teuthology.orchestra.run.smithi096.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-19T03:02:37.778 INFO:teuthology.orchestra.run.smithi096.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-19T03:02:37.778 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-19T03:02:37.789 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:37.785+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:37.826 INFO:tasks.radosbench.radosbench.0.smithi096.stdout:2024-04-19T03:02:37.826986+0000 min lat: 0.00184673 max lat: 1.04523 avg lat: 0.00845767 2024-04-19T03:02:37.826 INFO:tasks.radosbench.radosbench.0.smithi096.stdout: sec Cur ops started finished avg MB/s cur MB/s last lat(s) avg lat(s) 2024-04-19T03:02:37.826 INFO:tasks.radosbench.radosbench.0.smithi096.stdout: 60 4 113447 113443 118.156 121 0.0072473 0.00845767 2024-04-19T03:02:37.891 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:37.887+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:37.923 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-19T03:02:37.923 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:02:37.932 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T03:02:37.992 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:37.991+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:38.040 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-19T03:02:38.040 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:02:38.050 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T03:02:38.093 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:38.091+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:38.167 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-04-19T03:02:38.167 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:02:38.177 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T03:02:38.193 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:38.189+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:38.283 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-04-19T03:02:38.283 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:02:38.292 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T03:02:38.294 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:38.291+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:38.370 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [0] live_osds: [1, 2] 2024-04-19T03:02:38.370 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-19T03:02:38.371 INFO:tasks.thrashosds.thrasher:primary_affinity 2024-04-19T03:02:38.371 INFO:tasks.thrashosds.thrasher:Setting osd 1 primary_affinity to 0.144974 2024-04-19T03:02:38.371 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 1 0.144974176500395 2024-04-19T03:02:38.395 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:38.393+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:38.402 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-04-19T03:02:38.402 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:02:38.412 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T03:02:38.437 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-19T03:02:38.496 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:38.493+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:38.531 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-19T03:02:38.531 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:02:38.541 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T03:02:38.597 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:38.595+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:38.644 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-19T03:02:38.644 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:02:38.654 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T03:02:38.698 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:38.695+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:38.759 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-19T03:02:38.759 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:02:38.769 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T03:02:38.812 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:38.811+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:38.826 INFO:tasks.radosbench.radosbench.0.smithi096.stdout:Total time run: 60.0092 2024-04-19T03:02:38.826 INFO:tasks.radosbench.radosbench.0.smithi096.stdout:Total writes made: 113447 2024-04-19T03:02:38.827 INFO:tasks.radosbench.radosbench.0.smithi096.stdout:Write size: 65536 2024-04-19T03:02:38.827 INFO:tasks.radosbench.radosbench.0.smithi096.stdout:Object size: 65536 2024-04-19T03:02:38.827 INFO:tasks.radosbench.radosbench.0.smithi096.stdout:Bandwidth (MB/sec): 118.156 2024-04-19T03:02:38.827 INFO:tasks.radosbench.radosbench.0.smithi096.stdout:Stddev Bandwidth: 26.3844 2024-04-19T03:02:38.827 INFO:tasks.radosbench.radosbench.0.smithi096.stdout:Max bandwidth (MB/sec): 170.562 2024-04-19T03:02:38.827 INFO:tasks.radosbench.radosbench.0.smithi096.stdout:Min bandwidth (MB/sec): 31.75 2024-04-19T03:02:38.827 INFO:tasks.radosbench.radosbench.0.smithi096.stdout:Average IOPS: 1890 2024-04-19T03:02:38.827 INFO:tasks.radosbench.radosbench.0.smithi096.stdout:Stddev IOPS: 422.15 2024-04-19T03:02:38.827 INFO:tasks.radosbench.radosbench.0.smithi096.stdout:Max IOPS: 2729 2024-04-19T03:02:38.827 INFO:tasks.radosbench.radosbench.0.smithi096.stdout:Min IOPS: 508 2024-04-19T03:02:38.827 INFO:tasks.radosbench.radosbench.0.smithi096.stdout:Average Latency(s): 0.00845778 2024-04-19T03:02:38.827 INFO:tasks.radosbench.radosbench.0.smithi096.stdout:Stddev Latency(s): 0.0174272 2024-04-19T03:02:38.827 INFO:tasks.radosbench.radosbench.0.smithi096.stdout:Max latency(s): 1.04523 2024-04-19T03:02:38.827 INFO:tasks.radosbench.radosbench.0.smithi096.stdout:Min latency(s): 0.00184673 2024-04-19T03:02:38.835 INFO:tasks.radosbench.radosbench.0.smithi096.stdout:Cleaning up (deleting benchmark objects) 2024-04-19T03:02:38.900 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:38.897+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:38.903 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-04-19T03:02:38.903 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:02:38.916 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T03:02:39.001 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:38.997+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:39.044 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-04-19T03:02:39.044 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:02:39.057 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T03:02:39.102 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:39.099+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:39.178 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-04-19T03:02:39.178 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:02:39.189 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T03:02:39.240 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:39.239+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:39.304 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:39.299+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:39.316 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-19T03:02:39.316 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:02:39.330 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T03:02:39.405 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:39.401+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:39.424 INFO:teuthology.orchestra.run.smithi096.stderr:set osd.1 primary-affinity to 0.144974 (895012) 2024-04-19T03:02:39.424 INFO:teuthology.orchestra.run.smithi096.stderr:nodeep-scrub is set 2024-04-19T03:02:39.452 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-19T03:02:39.452 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:02:39.464 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T03:02:39.506 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:39.505+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:39.571 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-19T03:02:39.571 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:02:39.581 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T03:02:39.626 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:39.625+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:39.697 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-04-19T03:02:39.697 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:02:39.707 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T03:02:39.709 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:39.707+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:39.779 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-19T03:02:39.809 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:39.807+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:39.812 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-04-19T03:02:39.812 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:02:39.822 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T03:02:39.910 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:39.909+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:39.929 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-04-19T03:02:39.929 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:02:39.933 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1: {} 2024-04-19T03:02:39.939 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T03:02:39.957 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2: {} 2024-04-19T03:02:39.957 INFO:teuthology.orchestra.run.smithi096.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-04-19T03:02:39.957 INFO:teuthology.orchestra.run.smithi096.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-19T03:02:39.957 INFO:teuthology.orchestra.run.smithi096.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-19T03:02:39.961 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-19T03:02:39.962 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-19T03:02:40.011 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:40.007+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:40.053 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-19T03:02:40.053 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-04-19T03:02:40.053 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 0 2024-04-19T03:02:40.053 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-19T03:02:40.063 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T03:02:40.112 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:40.111+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:40.169 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-19T03:02:40.170 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-04-19T03:02:40.170 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-04-19T03:02:40.170 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-04-19T03:02:40.170 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-19T03:02:40.179 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T03:02:40.220 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:40.219+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:40.314 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:40.313+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:40.333 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-19T03:02:40.333 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-04-19T03:02:40.333 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-04-19T03:02:40.333 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-04-19T03:02:40.333 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.333 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:79014 5.d 5:b5eee02c:::benchmark_data_smithi096_19531_object79013:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-19T03:02:40.333 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:18.032471+0000", 2024-04-19T03:02:40.333 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 22.297456359999998, 2024-04-19T03:02:40.334 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.041427629000000001, 2024-04-19T03:02:40.334 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:40.334 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:40.334 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:40.334 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:40.334 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:40.334 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 79014 2024-04-19T03:02:40.334 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.334 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:40.334 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.334 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:40.334 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:18.032471+0000", 2024-04-19T03:02:40.334 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:40.335 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.335 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.335 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:40.335 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:18.032471+0000", 2024-04-19T03:02:40.335 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:40.335 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.335 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.335 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:40.335 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:18.032470+0000", 2024-04-19T03:02:40.335 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:40.335 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.335 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.335 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:40.335 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:18.032525+0000", 2024-04-19T03:02:40.335 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5535999999999998e-05 2024-04-19T03:02:40.336 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.336 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.336 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:40.336 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:18.032537+0000", 2024-04-19T03:02:40.336 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1987999999999999e-05 2024-04-19T03:02:40.336 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.336 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.336 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:40.336 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:18.032546+0000", 2024-04-19T03:02:40.336 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9670000000000007e-06 2024-04-19T03:02:40.336 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.336 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.336 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:40.336 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:18.032613+0000", 2024-04-19T03:02:40.337 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6508999999999996e-05 2024-04-19T03:02:40.337 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.337 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.337 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:40.337 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:18.032738+0000", 2024-04-19T03:02:40.337 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000124912 2024-04-19T03:02:40.337 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.337 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.337 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-04-19T03:02:40.337 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:18.032867+0000", 2024-04-19T03:02:40.337 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012959399999999999 2024-04-19T03:02:40.337 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.337 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.337 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:40.337 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:18.035867+0000", 2024-04-19T03:02:40.338 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.002999378 2024-04-19T03:02:40.338 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.338 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.338 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:40.338 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:18.073705+0000", 2024-04-19T03:02:40.338 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.037838042000000002 2024-04-19T03:02:40.338 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.338 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.338 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:40.338 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:18.073813+0000", 2024-04-19T03:02:40.338 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010806099999999999 2024-04-19T03:02:40.338 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.338 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.338 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:40.339 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:18.073899+0000", 2024-04-19T03:02:40.339 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.5971999999999996e-05 2024-04-19T03:02:40.339 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:40.339 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:40.339 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:40.339 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.339 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.339 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:86615 5.e 5:7fef7288:::benchmark_data_smithi096_19531_object86614:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:40.339 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:22.634544+0000", 2024-04-19T03:02:40.339 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 17.695383380999999, 2024-04-19T03:02:40.339 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.192475071, 2024-04-19T03:02:40.339 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:40.339 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:40.339 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:40.340 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:40.340 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:40.340 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 86615 2024-04-19T03:02:40.340 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.340 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:40.340 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.340 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:40.340 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634544+0000", 2024-04-19T03:02:40.340 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:40.340 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.340 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.340 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:40.340 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634544+0000", 2024-04-19T03:02:40.340 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:40.341 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.341 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.341 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:40.341 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634542+0000", 2024-04-19T03:02:40.341 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999981 2024-04-19T03:02:40.341 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.341 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.341 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:40.341 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634585+0000", 2024-04-19T03:02:40.341 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2299000000000003e-05 2024-04-19T03:02:40.341 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.341 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.341 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:40.341 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634592+0000", 2024-04-19T03:02:40.341 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2350000000000002e-06 2024-04-19T03:02:40.342 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.342 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.342 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:40.342 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634596+0000", 2024-04-19T03:02:40.342 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5390000000000001e-06 2024-04-19T03:02:40.342 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.342 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.342 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:40.342 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634639+0000", 2024-04-19T03:02:40.342 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2444999999999998e-05 2024-04-19T03:02:40.342 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.342 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.342 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:40.342 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634808+0000", 2024-04-19T03:02:40.343 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000169152 2024-04-19T03:02:40.343 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.343 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.343 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:40.343 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634999+0000", 2024-04-19T03:02:40.343 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00019098300000000001 2024-04-19T03:02:40.343 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.343 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.343 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:40.343 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.640458+0000", 2024-04-19T03:02:40.343 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0054586870000000003 2024-04-19T03:02:40.343 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.343 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.343 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:40.343 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.826949+0000", 2024-04-19T03:02:40.344 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.18649178299999999 2024-04-19T03:02:40.344 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.344 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.344 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:40.344 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.826982+0000", 2024-04-19T03:02:40.344 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2477000000000001e-05 2024-04-19T03:02:40.344 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.344 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.344 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:40.344 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.827019+0000", 2024-04-19T03:02:40.344 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7355999999999999e-05 2024-04-19T03:02:40.344 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:40.344 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:40.344 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:40.345 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.345 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.345 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:86616 5.e 5:72278f47:::benchmark_data_smithi096_19531_object86615:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:40.345 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:22.634609+0000", 2024-04-19T03:02:40.345 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 17.695318231999998, 2024-04-19T03:02:40.345 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.19472088900000001, 2024-04-19T03:02:40.345 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:40.345 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:40.345 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:40.345 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:40.345 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:40.345 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 86616 2024-04-19T03:02:40.345 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.345 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:40.345 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.346 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:40.346 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634609+0000", 2024-04-19T03:02:40.346 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:40.346 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.346 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.346 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:40.346 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634609+0000", 2024-04-19T03:02:40.346 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:40.346 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.346 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.346 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:40.346 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634609+0000", 2024-04-19T03:02:40.346 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:40.346 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.347 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.347 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:40.347 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634651+0000", 2024-04-19T03:02:40.347 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2589000000000002e-05 2024-04-19T03:02:40.347 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.347 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.347 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:40.347 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634659+0000", 2024-04-19T03:02:40.347 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5850000000000002e-06 2024-04-19T03:02:40.347 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.347 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.347 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:40.347 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634662+0000", 2024-04-19T03:02:40.347 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3620000000000002e-06 2024-04-19T03:02:40.348 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.348 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.348 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:40.348 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.637880+0000", 2024-04-19T03:02:40.348 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.003218149 2024-04-19T03:02:40.348 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.348 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.348 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:40.348 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.637999+0000", 2024-04-19T03:02:40.348 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000118643 2024-04-19T03:02:40.348 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.348 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.348 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:40.348 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.638102+0000", 2024-04-19T03:02:40.348 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010331 2024-04-19T03:02:40.349 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.349 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.349 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:40.349 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.640851+0000", 2024-04-19T03:02:40.349 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0027483310000000001 2024-04-19T03:02:40.349 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.349 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.349 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:40.349 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.829269+0000", 2024-04-19T03:02:40.349 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.188418319 2024-04-19T03:02:40.349 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.349 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.349 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:40.349 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.829299+0000", 2024-04-19T03:02:40.349 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0227e-05 2024-04-19T03:02:40.350 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.350 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.350 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:40.350 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.829330+0000", 2024-04-19T03:02:40.350 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0969000000000001e-05 2024-04-19T03:02:40.350 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:40.350 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:40.350 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:40.350 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.350 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.350 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:86618 5.0 5:09014b90:::benchmark_data_smithi096_19531_object86617:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:40.350 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:22.634894+0000", 2024-04-19T03:02:40.350 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 17.695033744, 2024-04-19T03:02:40.350 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.19413419800000001, 2024-04-19T03:02:40.351 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:40.351 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:40.351 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:40.351 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:40.351 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:40.351 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 86618 2024-04-19T03:02:40.351 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.351 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:40.351 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.351 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:40.351 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634894+0000", 2024-04-19T03:02:40.351 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:40.351 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.351 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.352 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:40.352 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634894+0000", 2024-04-19T03:02:40.352 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:40.352 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.352 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.352 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:40.352 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634893+0000", 2024-04-19T03:02:40.352 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:40.352 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.352 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.352 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:40.352 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634976+0000", 2024-04-19T03:02:40.352 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3231000000000003e-05 2024-04-19T03:02:40.352 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.352 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.353 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:40.353 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634983+0000", 2024-04-19T03:02:40.353 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5169999999999996e-06 2024-04-19T03:02:40.353 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.353 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.353 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:40.353 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634987+0000", 2024-04-19T03:02:40.353 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.425e-06 2024-04-19T03:02:40.353 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.353 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.353 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:40.353 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635030+0000", 2024-04-19T03:02:40.353 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.32e-05 2024-04-19T03:02:40.353 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.354 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.354 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:40.354 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635185+0000", 2024-04-19T03:02:40.354 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015471899999999999 2024-04-19T03:02:40.354 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.354 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.354 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:40.354 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635415+0000", 2024-04-19T03:02:40.354 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00023026500000000001 2024-04-19T03:02:40.354 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.354 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.354 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:40.354 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.640127+0000", 2024-04-19T03:02:40.354 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0047118890000000004 2024-04-19T03:02:40.355 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.355 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.355 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:40.355 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.828895+0000", 2024-04-19T03:02:40.355 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.18876802600000001 2024-04-19T03:02:40.355 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.355 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.355 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:40.355 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.828972+0000", 2024-04-19T03:02:40.355 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.6345000000000002e-05 2024-04-19T03:02:40.355 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.355 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.355 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:40.355 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.829028+0000", 2024-04-19T03:02:40.355 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6342999999999999e-05 2024-04-19T03:02:40.356 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:40.356 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:40.356 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:40.356 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.356 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.356 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:86620 5.b 5:d80faa68:::benchmark_data_smithi096_19531_object86619:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:40.356 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:22.635110+0000", 2024-04-19T03:02:40.356 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 17.694817184000001, 2024-04-19T03:02:40.356 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.193447275, 2024-04-19T03:02:40.356 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:40.356 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:40.356 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:40.356 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:40.356 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:40.356 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 86620 2024-04-19T03:02:40.357 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.357 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:40.357 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.357 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:40.357 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635110+0000", 2024-04-19T03:02:40.357 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:40.357 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.357 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.357 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:40.357 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635110+0000", 2024-04-19T03:02:40.357 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:40.357 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.357 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.357 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:40.358 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635110+0000", 2024-04-19T03:02:40.358 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:40.358 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.358 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.358 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:40.358 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635154+0000", 2024-04-19T03:02:40.358 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4681000000000001e-05 2024-04-19T03:02:40.358 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.358 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.358 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:40.358 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635166+0000", 2024-04-19T03:02:40.358 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1505000000000001e-05 2024-04-19T03:02:40.358 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.358 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.359 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:40.359 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635171+0000", 2024-04-19T03:02:40.359 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6040000000000003e-06 2024-04-19T03:02:40.359 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.359 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.359 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:40.359 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635221+0000", 2024-04-19T03:02:40.359 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9947000000000001e-05 2024-04-19T03:02:40.359 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.359 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.359 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:40.359 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635356+0000", 2024-04-19T03:02:40.359 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013576199999999999 2024-04-19T03:02:40.359 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.360 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.360 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:40.360 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635507+0000", 2024-04-19T03:02:40.360 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015072999999999999 2024-04-19T03:02:40.360 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.360 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.360 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:40.360 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.638488+0000", 2024-04-19T03:02:40.360 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0029813159999999999 2024-04-19T03:02:40.360 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.360 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.360 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:40.360 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.828341+0000", 2024-04-19T03:02:40.360 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.189852254 2024-04-19T03:02:40.360 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.361 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.361 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:40.361 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.828416+0000", 2024-04-19T03:02:40.361 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5344000000000002e-05 2024-04-19T03:02:40.361 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.361 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.361 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:40.361 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.828558+0000", 2024-04-19T03:02:40.361 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000141695 2024-04-19T03:02:40.361 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:40.361 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:40.361 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:40.361 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.361 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.362 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:86621 5.8 5:1597a420:::benchmark_data_smithi096_19531_object86620:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:40.362 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:22.635187+0000", 2024-04-19T03:02:40.362 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 17.694740324000001, 2024-04-19T03:02:40.362 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.194204878, 2024-04-19T03:02:40.362 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:40.362 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:40.362 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:40.362 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:40.362 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:40.362 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 86621 2024-04-19T03:02:40.362 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.362 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:40.362 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.363 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:40.363 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635187+0000", 2024-04-19T03:02:40.363 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:40.363 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.363 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.363 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:40.363 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635187+0000", 2024-04-19T03:02:40.363 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:40.363 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.363 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.363 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:40.363 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635187+0000", 2024-04-19T03:02:40.363 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:40.363 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.363 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.364 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:40.364 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635242+0000", 2024-04-19T03:02:40.364 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5158000000000003e-05 2024-04-19T03:02:40.364 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.364 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.364 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:40.364 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635249+0000", 2024-04-19T03:02:40.364 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.7000000000000008e-06 2024-04-19T03:02:40.364 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.364 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.364 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:40.364 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635256+0000", 2024-04-19T03:02:40.364 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2060000000000004e-06 2024-04-19T03:02:40.364 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.365 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.365 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:40.365 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635302+0000", 2024-04-19T03:02:40.365 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5954000000000001e-05 2024-04-19T03:02:40.365 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.365 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.365 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:40.365 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635427+0000", 2024-04-19T03:02:40.365 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012559299999999999 2024-04-19T03:02:40.365 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.365 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.365 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:40.365 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635596+0000", 2024-04-19T03:02:40.365 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000168615 2024-04-19T03:02:40.365 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.366 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.366 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:40.366 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.639320+0000", 2024-04-19T03:02:40.366 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0037244610000000001 2024-04-19T03:02:40.366 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.366 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.366 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:40.366 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.829277+0000", 2024-04-19T03:02:40.366 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.18995651099999999 2024-04-19T03:02:40.366 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.366 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.366 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:40.366 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.829341+0000", 2024-04-19T03:02:40.367 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3756000000000004e-05 2024-04-19T03:02:40.367 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.367 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.367 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:40.367 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.829392+0000", 2024-04-19T03:02:40.367 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1555999999999999e-05 2024-04-19T03:02:40.367 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:40.367 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:40.367 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:40.367 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.367 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.367 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87062 5.4 5:2d3b5d9a:::benchmark_data_smithi096_19531_object87061:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:40.367 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.136820+0000", 2024-04-19T03:02:40.367 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 17.193107171000001, 2024-04-19T03:02:40.368 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.066483741999999998, 2024-04-19T03:02:40.368 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:40.368 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:40.368 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:40.368 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:40.368 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:40.368 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87062 2024-04-19T03:02:40.368 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.368 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:40.368 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.368 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:40.368 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.136820+0000", 2024-04-19T03:02:40.368 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:40.368 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.368 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.369 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:40.369 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.136820+0000", 2024-04-19T03:02:40.369 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:40.369 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.369 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.369 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:40.369 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.136819+0000", 2024-04-19T03:02:40.369 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:40.369 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.369 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.369 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:40.369 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.136864+0000", 2024-04-19T03:02:40.369 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4855000000000003e-05 2024-04-19T03:02:40.369 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.369 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.370 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:40.370 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.136881+0000", 2024-04-19T03:02:40.370 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7521999999999999e-05 2024-04-19T03:02:40.370 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.370 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.370 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:40.370 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.136890+0000", 2024-04-19T03:02:40.370 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1039999999999996e-06 2024-04-19T03:02:40.370 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.370 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.370 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:40.370 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.136974+0000", 2024-04-19T03:02:40.370 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3735999999999999e-05 2024-04-19T03:02:40.370 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.371 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.371 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:40.371 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.137308+0000", 2024-04-19T03:02:40.371 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00033376100000000002 2024-04-19T03:02:40.371 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.371 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.371 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:40.371 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.137559+0000", 2024-04-19T03:02:40.371 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000250599 2024-04-19T03:02:40.371 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.371 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.371 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:40.371 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.145423+0000", 2024-04-19T03:02:40.371 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0078649589999999995 2024-04-19T03:02:40.372 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.372 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.372 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:40.372 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.203175+0000", 2024-04-19T03:02:40.372 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057751255000000001 2024-04-19T03:02:40.372 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.372 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.372 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:40.372 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.203250+0000", 2024-04-19T03:02:40.372 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5378999999999998e-05 2024-04-19T03:02:40.372 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.372 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.372 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:40.372 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.203304+0000", 2024-04-19T03:02:40.373 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4015999999999999e-05 2024-04-19T03:02:40.373 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:40.373 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:40.373 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:40.373 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.373 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.373 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87065 5.4 5:21d20a47:::benchmark_data_smithi096_19531_object87064:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:40.373 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.137482+0000", 2024-04-19T03:02:40.373 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 17.192445437, 2024-04-19T03:02:40.373 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.065988749999999999, 2024-04-19T03:02:40.373 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:40.373 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:40.373 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:40.373 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:40.374 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:40.374 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87065 2024-04-19T03:02:40.374 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.374 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:40.374 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.374 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:40.374 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.137482+0000", 2024-04-19T03:02:40.374 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:40.374 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.374 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.374 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:40.374 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.137482+0000", 2024-04-19T03:02:40.374 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:40.374 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.375 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.375 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:40.375 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.137481+0000", 2024-04-19T03:02:40.375 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:40.375 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.375 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.375 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:40.375 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.137530+0000", 2024-04-19T03:02:40.375 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9302000000000003e-05 2024-04-19T03:02:40.375 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.375 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.375 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:40.376 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.137540+0000", 2024-04-19T03:02:40.376 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.2010000000000005e-06 2024-04-19T03:02:40.376 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.376 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.376 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:40.376 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.137545+0000", 2024-04-19T03:02:40.376 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5910000000000003e-06 2024-04-19T03:02:40.376 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.376 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.376 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:40.376 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.140666+0000", 2024-04-19T03:02:40.376 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0031212710000000001 2024-04-19T03:02:40.376 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.376 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.376 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:40.377 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.140847+0000", 2024-04-19T03:02:40.377 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00018065600000000001 2024-04-19T03:02:40.377 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.377 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.377 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:40.377 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.140991+0000", 2024-04-19T03:02:40.377 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014433100000000001 2024-04-19T03:02:40.377 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.377 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.377 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:40.377 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.148053+0000", 2024-04-19T03:02:40.377 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.007061945 2024-04-19T03:02:40.377 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.377 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.378 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:40.378 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.203367+0000", 2024-04-19T03:02:40.378 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.055313703999999998 2024-04-19T03:02:40.378 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.378 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.378 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:40.378 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.203426+0000", 2024-04-19T03:02:40.378 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9024000000000003e-05 2024-04-19T03:02:40.378 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.378 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.378 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:40.378 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.203471+0000", 2024-04-19T03:02:40.378 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4818999999999999e-05 2024-04-19T03:02:40.378 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:40.379 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:40.379 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:40.379 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.379 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.379 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87067 5.b 5:d57af71a:::benchmark_data_smithi096_19531_object87066:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:40.379 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.142233+0000", 2024-04-19T03:02:40.379 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 17.187694461, 2024-04-19T03:02:40.379 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.071692405000000001, 2024-04-19T03:02:40.379 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:40.379 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:40.379 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:40.379 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:40.379 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:40.379 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87067 2024-04-19T03:02:40.380 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.380 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:40.380 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.380 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:40.380 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142233+0000", 2024-04-19T03:02:40.380 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:40.380 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.380 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.380 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:40.380 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142233+0000", 2024-04-19T03:02:40.380 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:40.380 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.380 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.380 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:40.381 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142232+0000", 2024-04-19T03:02:40.381 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:40.381 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.381 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.381 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:40.381 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142277+0000", 2024-04-19T03:02:40.381 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5837000000000002e-05 2024-04-19T03:02:40.381 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.381 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.381 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:40.381 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142297+0000", 2024-04-19T03:02:40.381 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9561000000000001e-05 2024-04-19T03:02:40.381 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.381 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.381 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:40.382 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142311+0000", 2024-04-19T03:02:40.382 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3654e-05 2024-04-19T03:02:40.382 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.382 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.382 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:40.382 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142391+0000", 2024-04-19T03:02:40.382 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0123999999999994e-05 2024-04-19T03:02:40.382 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.382 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.382 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:40.382 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142669+0000", 2024-04-19T03:02:40.382 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00027829800000000001 2024-04-19T03:02:40.382 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.382 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.383 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:40.383 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142859+0000", 2024-04-19T03:02:40.383 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000190051 2024-04-19T03:02:40.383 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.383 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.383 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:40.383 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.150597+0000", 2024-04-19T03:02:40.383 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0077380299999999999 2024-04-19T03:02:40.383 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.383 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.383 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:40.383 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.213855+0000", 2024-04-19T03:02:40.384 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.063257987000000002 2024-04-19T03:02:40.384 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.384 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.384 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:40.384 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.213898+0000", 2024-04-19T03:02:40.384 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2916e-05 2024-04-19T03:02:40.384 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.384 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.384 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:40.384 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.213925+0000", 2024-04-19T03:02:40.384 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7503000000000001e-05 2024-04-19T03:02:40.384 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:40.384 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:40.384 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:40.385 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.385 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.385 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87069 5.b 5:da0c93b5:::benchmark_data_smithi096_19531_object87068:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:40.385 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.143402+0000", 2024-04-19T03:02:40.385 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 17.186525498999998, 2024-04-19T03:02:40.385 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.070678598999999995, 2024-04-19T03:02:40.385 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:40.385 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:40.385 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:40.385 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:40.385 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:40.385 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87069 2024-04-19T03:02:40.385 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.385 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:40.385 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.386 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:40.386 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.143402+0000", 2024-04-19T03:02:40.386 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:40.386 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.386 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.386 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:40.386 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.143402+0000", 2024-04-19T03:02:40.386 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:40.386 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.386 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.386 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:40.386 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.143401+0000", 2024-04-19T03:02:40.386 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:40.387 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.387 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.387 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:40.387 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.143501+0000", 2024-04-19T03:02:40.387 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000100387 2024-04-19T03:02:40.387 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.387 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.387 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:40.387 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.143516+0000", 2024-04-19T03:02:40.387 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5369000000000001e-05 2024-04-19T03:02:40.387 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.387 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.387 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:40.387 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.143524+0000", 2024-04-19T03:02:40.388 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.7079999999999997e-06 2024-04-19T03:02:40.388 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.388 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.388 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:40.388 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.145550+0000", 2024-04-19T03:02:40.388 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0020259290000000001 2024-04-19T03:02:40.388 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.388 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.388 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:40.388 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.145676+0000", 2024-04-19T03:02:40.388 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000126406 2024-04-19T03:02:40.388 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.388 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.388 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:40.388 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.145802+0000", 2024-04-19T03:02:40.389 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000125974 2024-04-19T03:02:40.389 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.389 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.389 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:40.389 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.151030+0000", 2024-04-19T03:02:40.389 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0052276079999999999 2024-04-19T03:02:40.389 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.389 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.389 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:40.389 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.213998+0000", 2024-04-19T03:02:40.389 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.06296786 2024-04-19T03:02:40.389 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.389 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.389 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:40.390 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.214031+0000", 2024-04-19T03:02:40.390 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3387999999999999e-05 2024-04-19T03:02:40.390 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.390 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.390 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:40.390 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.214081+0000", 2024-04-19T03:02:40.390 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9316e-05 2024-04-19T03:02:40.390 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:40.390 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:40.390 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:40.390 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.390 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.390 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87073 5.0 5:0ca21233:::benchmark_data_smithi096_19531_object87072:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:40.390 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.145929+0000", 2024-04-19T03:02:40.391 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 17.183998239000001, 2024-04-19T03:02:40.391 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.062283234999999999, 2024-04-19T03:02:40.391 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:40.391 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:40.391 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:40.391 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:40.391 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:40.391 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87073 2024-04-19T03:02:40.391 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.391 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:40.391 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.391 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:40.391 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.145929+0000", 2024-04-19T03:02:40.391 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:40.391 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.392 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.392 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:40.392 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.145929+0000", 2024-04-19T03:02:40.392 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:40.392 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.392 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.392 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:40.392 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.145928+0000", 2024-04-19T03:02:40.392 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:40.392 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.392 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.392 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:40.392 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.146063+0000", 2024-04-19T03:02:40.392 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013541099999999999 2024-04-19T03:02:40.393 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.393 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.393 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:40.393 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.146079+0000", 2024-04-19T03:02:40.393 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5902000000000001e-05 2024-04-19T03:02:40.393 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.393 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.393 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:40.393 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.146100+0000", 2024-04-19T03:02:40.393 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0380000000000001e-05 2024-04-19T03:02:40.393 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.393 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.393 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:40.393 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.146193+0000", 2024-04-19T03:02:40.394 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.3669000000000001e-05 2024-04-19T03:02:40.394 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.394 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.394 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:40.394 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.146388+0000", 2024-04-19T03:02:40.394 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00019457799999999999 2024-04-19T03:02:40.394 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.394 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.394 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:40.394 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.146625+0000", 2024-04-19T03:02:40.394 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00023751999999999999 2024-04-19T03:02:40.394 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.394 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.394 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:40.395 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.151051+0000", 2024-04-19T03:02:40.395 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0044260039999999999 2024-04-19T03:02:40.395 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.395 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.395 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:40.395 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.207872+0000", 2024-04-19T03:02:40.395 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.056821114999999998 2024-04-19T03:02:40.395 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.395 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.395 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:40.395 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.208085+0000", 2024-04-19T03:02:40.395 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000212893 2024-04-19T03:02:40.395 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.395 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.395 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:40.396 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.208213+0000", 2024-04-19T03:02:40.396 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012714700000000001 2024-04-19T03:02:40.396 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:40.396 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:40.396 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:40.396 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.396 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.396 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87074 5.0 5:035614ac:::benchmark_data_smithi096_19531_object87073:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:40.396 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.151387+0000", 2024-04-19T03:02:40.396 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 17.178540307999999, 2024-04-19T03:02:40.396 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.063461771, 2024-04-19T03:02:40.396 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:40.396 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:40.396 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:40.397 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:40.397 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:40.397 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87074 2024-04-19T03:02:40.397 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.397 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:40.397 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.397 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:40.397 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.151387+0000", 2024-04-19T03:02:40.397 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:40.397 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.397 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.397 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:40.397 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.151387+0000", 2024-04-19T03:02:40.397 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:40.397 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.398 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.398 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:40.398 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.151386+0000", 2024-04-19T03:02:40.398 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:40.398 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.398 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.398 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:40.398 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.151428+0000", 2024-04-19T03:02:40.398 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.172e-05 2024-04-19T03:02:40.398 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.398 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.398 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:40.398 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.151442+0000", 2024-04-19T03:02:40.398 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4328000000000001e-05 2024-04-19T03:02:40.399 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.399 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.399 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:40.399 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.151451+0000", 2024-04-19T03:02:40.399 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.8400000000000001e-06 2024-04-19T03:02:40.399 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.399 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.399 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:40.399 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.151521+0000", 2024-04-19T03:02:40.399 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.9606999999999999e-05 2024-04-19T03:02:40.399 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.399 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.399 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:40.399 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.151749+0000", 2024-04-19T03:02:40.400 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00022818799999999999 2024-04-19T03:02:40.400 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.400 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.400 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:40.400 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.152006+0000", 2024-04-19T03:02:40.400 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00025687300000000002 2024-04-19T03:02:40.400 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.400 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.400 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:40.400 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.154887+0000", 2024-04-19T03:02:40.400 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0028812989999999999 2024-04-19T03:02:40.400 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.400 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.400 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:40.401 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.214733+0000", 2024-04-19T03:02:40.401 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.059846159000000003 2024-04-19T03:02:40.401 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.401 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.401 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:40.401 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.214788+0000", 2024-04-19T03:02:40.401 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4524000000000002e-05 2024-04-19T03:02:40.401 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.401 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.401 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:40.401 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.214849+0000", 2024-04-19T03:02:40.401 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1362e-05 2024-04-19T03:02:40.401 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:40.401 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:40.402 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:40.402 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.402 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.402 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87108 5.e 5:7e197adc:::benchmark_data_smithi096_19531_object87107:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:40.402 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.223103+0000", 2024-04-19T03:02:40.402 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 17.106824161999999, 2024-04-19T03:02:40.402 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.044946887, 2024-04-19T03:02:40.402 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:40.402 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-19T03:02:40.402 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:40.402 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:40.402 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:40.402 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87108 2024-04-19T03:02:40.402 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.403 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:40.403 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.403 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:40.403 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.223103+0000", 2024-04-19T03:02:40.403 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:40.403 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.403 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.403 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:40.403 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.223103+0000", 2024-04-19T03:02:40.403 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:40.403 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.403 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.403 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:40.403 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.223102+0000", 2024-04-19T03:02:40.403 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:40.404 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.404 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.404 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:40.404 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.223156+0000", 2024-04-19T03:02:40.404 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3958000000000001e-05 2024-04-19T03:02:40.404 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.404 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.404 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:40.404 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.223166+0000", 2024-04-19T03:02:40.404 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.4809999999999995e-06 2024-04-19T03:02:40.404 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.404 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.404 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:40.404 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.223172+0000", 2024-04-19T03:02:40.405 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0140000000000004e-06 2024-04-19T03:02:40.405 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.405 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.405 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:40.405 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.227295+0000", 2024-04-19T03:02:40.405 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0041233420000000003 2024-04-19T03:02:40.405 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.405 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.405 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:40.405 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.227495+0000", 2024-04-19T03:02:40.405 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00019955299999999999 2024-04-19T03:02:40.405 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.405 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.405 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:40.406 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.227717+0000", 2024-04-19T03:02:40.406 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000221902 2024-04-19T03:02:40.406 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.406 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.406 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:40.406 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233189+0000", 2024-04-19T03:02:40.406 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0054718889999999997 2024-04-19T03:02:40.406 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.406 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.406 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:40.406 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.250529+0000", 2024-04-19T03:02:40.406 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.017340298000000001 2024-04-19T03:02:40.406 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.406 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.407 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:02:40.407 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.250539+0000", 2024-04-19T03:02:40.407 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0501e-05 2024-04-19T03:02:40.407 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.407 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.407 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:40.407 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.268003+0000", 2024-04-19T03:02:40.407 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.017463429 2024-04-19T03:02:40.407 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.407 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.407 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:40.407 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.268050+0000", 2024-04-19T03:02:40.407 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7466000000000003e-05 2024-04-19T03:02:40.407 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:40.407 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:40.408 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:40.408 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.408 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.408 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87118 5.b 5:d1bb4f3c:::benchmark_data_smithi096_19531_object87117:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:40.408 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.231082+0000", 2024-04-19T03:02:40.408 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 17.098845327999999, 2024-04-19T03:02:40.408 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.035789004, 2024-04-19T03:02:40.408 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:40.408 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-19T03:02:40.408 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:40.408 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:40.408 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:40.408 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87118 2024-04-19T03:02:40.408 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.409 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:40.409 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.409 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:40.409 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231082+0000", 2024-04-19T03:02:40.409 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:40.409 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.409 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.409 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:40.409 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231082+0000", 2024-04-19T03:02:40.409 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:40.409 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.409 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.409 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:40.409 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231081+0000", 2024-04-19T03:02:40.409 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:40.410 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.410 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.410 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:40.410 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231159+0000", 2024-04-19T03:02:40.410 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.7819999999999997e-05 2024-04-19T03:02:40.410 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.410 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.410 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:40.410 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231186+0000", 2024-04-19T03:02:40.410 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7126000000000001e-05 2024-04-19T03:02:40.410 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.410 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.410 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:40.410 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231193+0000", 2024-04-19T03:02:40.411 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7259999999999996e-06 2024-04-19T03:02:40.411 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.411 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.411 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:40.411 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231241+0000", 2024-04-19T03:02:40.411 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8123e-05 2024-04-19T03:02:40.411 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.411 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.411 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:40.411 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231354+0000", 2024-04-19T03:02:40.411 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0001133 2024-04-19T03:02:40.412 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.412 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.412 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:40.412 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231443+0000", 2024-04-19T03:02:40.412 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9167999999999997e-05 2024-04-19T03:02:40.412 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.412 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.412 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:40.412 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236498+0000", 2024-04-19T03:02:40.412 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0050545160000000002 2024-04-19T03:02:40.412 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.412 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.412 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:40.412 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.249681+0000", 2024-04-19T03:02:40.413 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013183321 2024-04-19T03:02:40.413 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.413 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.413 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:02:40.413 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.249693+0000", 2024-04-19T03:02:40.413 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1834999999999999e-05 2024-04-19T03:02:40.413 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.413 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.413 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:40.413 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266733+0000", 2024-04-19T03:02:40.413 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.017040408 2024-04-19T03:02:40.413 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.413 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.413 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:40.414 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266871+0000", 2024-04-19T03:02:40.414 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000137849 2024-04-19T03:02:40.414 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:40.414 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:40.414 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:40.414 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.414 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.414 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87121 5.b 5:d01822b8:::benchmark_data_smithi096_19531_object87120:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:40.414 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.233319+0000", 2024-04-19T03:02:40.414 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 17.096608463999999, 2024-04-19T03:02:40.414 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.033624198, 2024-04-19T03:02:40.414 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:40.414 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-19T03:02:40.414 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:40.415 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:40.415 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:40.415 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87121 2024-04-19T03:02:40.415 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.415 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:40.415 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.415 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:40.415 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233319+0000", 2024-04-19T03:02:40.415 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:40.415 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.415 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.415 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:40.415 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233319+0000", 2024-04-19T03:02:40.415 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:40.415 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.416 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.416 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:40.416 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233319+0000", 2024-04-19T03:02:40.416 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:40.416 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.416 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.416 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:40.416 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233364+0000", 2024-04-19T03:02:40.416 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5460999999999997e-05 2024-04-19T03:02:40.416 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.416 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.416 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:40.416 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233382+0000", 2024-04-19T03:02:40.416 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8148e-05 2024-04-19T03:02:40.417 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.417 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.417 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:40.417 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233390+0000", 2024-04-19T03:02:40.417 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5340000000000002e-06 2024-04-19T03:02:40.417 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.417 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.417 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:40.417 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233712+0000", 2024-04-19T03:02:40.417 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00032260500000000001 2024-04-19T03:02:40.417 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.417 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.417 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:40.417 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233829+0000", 2024-04-19T03:02:40.418 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011638599999999999 2024-04-19T03:02:40.418 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.418 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.418 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:40.418 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233959+0000", 2024-04-19T03:02:40.418 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013013900000000001 2024-04-19T03:02:40.418 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.418 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.418 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:40.418 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236515+0000", 2024-04-19T03:02:40.418 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0025562750000000002 2024-04-19T03:02:40.418 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.418 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.418 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:40.419 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.249723+0000", 2024-04-19T03:02:40.419 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013208176 2024-04-19T03:02:40.419 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.419 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.419 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:02:40.419 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.249728+0000", 2024-04-19T03:02:40.419 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6519999999999997e-06 2024-04-19T03:02:40.419 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.419 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.419 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:40.419 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266837+0000", 2024-04-19T03:02:40.419 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0171087059999999 2024-04-19T03:02:40.419 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.419 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.419 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:40.420 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266943+0000", 2024-04-19T03:02:40.420 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000106604 2024-04-19T03:02:40.420 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:40.420 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:40.420 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:40.420 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.420 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.420 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87124 5.8 5:14819ad7:::benchmark_data_smithi096_19531_object87123:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:40.420 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.235886+0000", 2024-04-19T03:02:40.420 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 17.09404104, 2024-04-19T03:02:40.420 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0315451179999999, 2024-04-19T03:02:40.420 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:40.420 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-19T03:02:40.420 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:40.421 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:40.421 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:40.421 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87124 2024-04-19T03:02:40.421 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.421 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:40.421 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.421 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:40.421 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.235886+0000", 2024-04-19T03:02:40.421 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:40.421 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.421 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.421 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:40.421 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.235886+0000", 2024-04-19T03:02:40.421 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:40.421 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.422 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.422 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:40.422 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.235886+0000", 2024-04-19T03:02:40.422 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:40.422 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.422 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.422 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:40.422 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.235934+0000", 2024-04-19T03:02:40.422 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8384000000000003e-05 2024-04-19T03:02:40.422 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.422 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.422 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:40.422 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.235945+0000", 2024-04-19T03:02:40.422 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0671e-05 2024-04-19T03:02:40.423 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.423 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.423 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:40.423 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.235952+0000", 2024-04-19T03:02:40.423 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3089999999999998e-06 2024-04-19T03:02:40.423 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.423 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.423 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:40.423 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.237067+0000", 2024-04-19T03:02:40.423 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001115263 2024-04-19T03:02:40.423 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.423 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.423 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:40.423 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.237188+0000", 2024-04-19T03:02:40.423 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000121258 2024-04-19T03:02:40.424 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.424 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.424 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:40.424 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.237316+0000", 2024-04-19T03:02:40.424 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000128071 2024-04-19T03:02:40.424 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.424 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.424 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:40.424 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240744+0000", 2024-04-19T03:02:40.424 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0034275629999999998 2024-04-19T03:02:40.424 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.424 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.424 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:40.424 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.252517+0000", 2024-04-19T03:02:40.425 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011772991999999999 2024-04-19T03:02:40.425 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.425 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.425 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:02:40.425 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.252523+0000", 2024-04-19T03:02:40.425 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3640000000000004e-06 2024-04-19T03:02:40.425 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.425 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.425 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:40.425 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.267290+0000", 2024-04-19T03:02:40.425 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0147665690000001 2024-04-19T03:02:40.425 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.425 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.425 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:40.425 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.267432+0000", 2024-04-19T03:02:40.426 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014165299999999999 2024-04-19T03:02:40.426 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:40.426 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:40.426 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:40.426 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.426 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.426 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87129 5.0 5:02667e01:::benchmark_data_smithi096_19531_object87128:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:40.426 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.236466+0000", 2024-04-19T03:02:40.426 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 17.093461044000001, 2024-04-19T03:02:40.426 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0301534510000001, 2024-04-19T03:02:40.426 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:40.426 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-19T03:02:40.426 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:40.427 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:40.427 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:40.427 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87129 2024-04-19T03:02:40.427 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.427 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:40.427 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.427 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:40.427 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236466+0000", 2024-04-19T03:02:40.427 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:40.427 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.427 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.427 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:40.427 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236466+0000", 2024-04-19T03:02:40.427 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:40.427 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.428 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.428 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:40.428 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236465+0000", 2024-04-19T03:02:40.428 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:40.428 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.428 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.428 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:40.428 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236566+0000", 2024-04-19T03:02:40.428 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010047000000000001 2024-04-19T03:02:40.428 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.428 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.428 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:40.428 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236577+0000", 2024-04-19T03:02:40.428 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1772e-05 2024-04-19T03:02:40.429 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.429 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.429 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:40.429 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236584+0000", 2024-04-19T03:02:40.429 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0530000000000003e-06 2024-04-19T03:02:40.429 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.429 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.429 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:40.429 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.237023+0000", 2024-04-19T03:02:40.429 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000439703 2024-04-19T03:02:40.429 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.429 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.429 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:40.429 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.237207+0000", 2024-04-19T03:02:40.429 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000183692 2024-04-19T03:02:40.430 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.430 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.430 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:40.430 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.237373+0000", 2024-04-19T03:02:40.430 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016623500000000001 2024-04-19T03:02:40.430 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.430 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.430 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:40.430 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.241461+0000", 2024-04-19T03:02:40.430 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0040883050000000004 2024-04-19T03:02:40.430 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.430 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.430 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:40.430 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.252500+0000", 2024-04-19T03:02:40.431 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011038450999999999 2024-04-19T03:02:40.431 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.431 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.431 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:02:40.431 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.252507+0000", 2024-04-19T03:02:40.431 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2439999999999996e-06 2024-04-19T03:02:40.431 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.431 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.431 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:40.431 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266538+0000", 2024-04-19T03:02:40.431 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.014031184 2024-04-19T03:02:40.431 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.431 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.431 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:40.432 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266620+0000", 2024-04-19T03:02:40.432 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1600000000000005e-05 2024-04-19T03:02:40.432 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:40.432 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:40.432 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:40.432 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.432 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.432 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87135 5.4 5:2a97e7b7:::benchmark_data_smithi096_19531_object87134:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:40.432 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.240884+0000", 2024-04-19T03:02:40.432 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 17.089043586999999, 2024-04-19T03:02:40.432 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.025708931, 2024-04-19T03:02:40.432 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:40.432 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-19T03:02:40.432 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:40.433 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:40.433 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:40.433 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87135 2024-04-19T03:02:40.433 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.433 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:40.433 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.433 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:40.433 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240884+0000", 2024-04-19T03:02:40.433 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:40.433 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.433 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.433 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:40.433 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240884+0000", 2024-04-19T03:02:40.433 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:40.433 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.434 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.434 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:40.434 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240883+0000", 2024-04-19T03:02:40.434 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:40.434 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.434 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.434 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:40.434 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240933+0000", 2024-04-19T03:02:40.434 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9969999999999998e-05 2024-04-19T03:02:40.434 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.434 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.434 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:40.434 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240946+0000", 2024-04-19T03:02:40.434 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2943e-05 2024-04-19T03:02:40.435 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.435 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.435 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:40.435 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240952+0000", 2024-04-19T03:02:40.435 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8930000000000002e-06 2024-04-19T03:02:40.435 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.435 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.435 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:40.435 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240994+0000", 2024-04-19T03:02:40.435 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2753999999999998e-05 2024-04-19T03:02:40.435 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.435 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.435 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:40.435 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.241092+0000", 2024-04-19T03:02:40.435 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.7447000000000004e-05 2024-04-19T03:02:40.436 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.436 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.436 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:40.436 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.241183+0000", 2024-04-19T03:02:40.436 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1163999999999997e-05 2024-04-19T03:02:40.436 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.436 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.436 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:40.436 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.254672+0000", 2024-04-19T03:02:40.436 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.01348864 2024-04-19T03:02:40.436 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.436 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.436 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:02:40.436 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.254681+0000", 2024-04-19T03:02:40.437 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.3789999999999995e-06 2024-04-19T03:02:40.437 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.437 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.437 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:40.437 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266456+0000", 2024-04-19T03:02:40.437 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.011774621 2024-04-19T03:02:40.437 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.437 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.437 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:40.437 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266593+0000", 2024-04-19T03:02:40.437 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013737600000000001 2024-04-19T03:02:40.437 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:40.437 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:40.437 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:40.437 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.438 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.438 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87136 5.4 5:212411bc:::benchmark_data_smithi096_19531_object87135:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:40.438 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.240962+0000", 2024-04-19T03:02:40.438 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 17.088965711, 2024-04-19T03:02:40.438 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.025738, 2024-04-19T03:02:40.438 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:40.438 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-19T03:02:40.438 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:40.438 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:40.438 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:40.438 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87136 2024-04-19T03:02:40.438 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.438 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:40.438 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.439 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:40.439 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240962+0000", 2024-04-19T03:02:40.439 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:40.439 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.439 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.439 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:40.439 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240962+0000", 2024-04-19T03:02:40.439 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:40.439 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.439 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.439 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:40.439 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240961+0000", 2024-04-19T03:02:40.439 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:40.439 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.440 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.440 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:40.440 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240995+0000", 2024-04-19T03:02:40.440 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3868000000000002e-05 2024-04-19T03:02:40.440 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.440 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.440 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:40.440 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.241001+0000", 2024-04-19T03:02:40.440 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.322e-06 2024-04-19T03:02:40.440 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.440 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.440 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:40.440 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.241004+0000", 2024-04-19T03:02:40.440 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3510000000000002e-06 2024-04-19T03:02:40.441 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.441 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.441 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:40.441 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247131+0000", 2024-04-19T03:02:40.441 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0061270869999999998 2024-04-19T03:02:40.441 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.441 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.441 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:40.441 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247322+0000", 2024-04-19T03:02:40.441 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000191015 2024-04-19T03:02:40.441 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.441 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.441 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:40.441 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247542+0000", 2024-04-19T03:02:40.442 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00022030199999999999 2024-04-19T03:02:40.442 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.442 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.442 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:40.442 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.254709+0000", 2024-04-19T03:02:40.442 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0071662660000000001 2024-04-19T03:02:40.442 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.442 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.442 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:02:40.442 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.254716+0000", 2024-04-19T03:02:40.442 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3860000000000001e-06 2024-04-19T03:02:40.442 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.442 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.442 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:40.443 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266619+0000", 2024-04-19T03:02:40.443 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0119031030000001 2024-04-19T03:02:40.443 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.443 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.443 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:40.443 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266700+0000", 2024-04-19T03:02:40.443 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0764000000000001e-05 2024-04-19T03:02:40.443 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:40.443 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:40.443 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:40.443 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.443 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.443 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87138 5.e 5:7b1f1c20:::benchmark_data_smithi096_19531_object87137:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:40.443 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.247862+0000", 2024-04-19T03:02:40.443 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 17.082065636999999, 2024-04-19T03:02:40.444 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.024457079, 2024-04-19T03:02:40.444 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:40.444 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:40.444 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:40.444 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:40.444 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:40.444 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87138 2024-04-19T03:02:40.444 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.444 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:40.444 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.444 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:40.444 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247862+0000", 2024-04-19T03:02:40.444 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:40.444 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.445 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.445 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:40.445 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247862+0000", 2024-04-19T03:02:40.445 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:40.445 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.445 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.445 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:40.445 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247860+0000", 2024-04-19T03:02:40.445 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999981 2024-04-19T03:02:40.445 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.445 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.445 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:40.445 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247909+0000", 2024-04-19T03:02:40.445 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9150999999999997e-05 2024-04-19T03:02:40.445 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.446 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.446 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:40.446 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247925+0000", 2024-04-19T03:02:40.446 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5761999999999999e-05 2024-04-19T03:02:40.446 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.446 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.446 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:40.446 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247936+0000", 2024-04-19T03:02:40.446 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1144e-05 2024-04-19T03:02:40.446 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.446 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.446 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:40.446 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.250590+0000", 2024-04-19T03:02:40.446 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.002653678 2024-04-19T03:02:40.447 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.447 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.447 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:02:40.447 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.250599+0000", 2024-04-19T03:02:40.447 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9039999999999998e-06 2024-04-19T03:02:40.447 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.447 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.447 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:40.447 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.268151+0000", 2024-04-19T03:02:40.447 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0175523449999999 2024-04-19T03:02:40.447 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.447 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.447 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:40.447 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.268285+0000", 2024-04-19T03:02:40.447 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013415599999999999 2024-04-19T03:02:40.448 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.448 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.448 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:40.448 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.272238+0000", 2024-04-19T03:02:40.448 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0039533019999999997 2024-04-19T03:02:40.448 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.448 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.448 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:40.448 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.272274+0000", 2024-04-19T03:02:40.448 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5352000000000003e-05 2024-04-19T03:02:40.448 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:40.448 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:40.448 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:40.448 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.272319+0000", 2024-04-19T03:02:40.448 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5281999999999998e-05 2024-04-19T03:02:40.449 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:40.449 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:40.449 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:40.449 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:40.449 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:40.449 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-19T03:02:40.450 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:40.449+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:40.451 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T03:02:40.550 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:40.549+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:40.583 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-04-19T03:02:40.583 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [ 2024-04-19T03:02:40.583 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.583 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:115228 5.d 5:b7c597b9:::benchmark_data_smithi096_19531_object1778:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-19T03:02:40.583 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:40.575357+0000", 2024-04-19T03:02:40.583 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0058473489999999999, 2024-04-19T03:02:40.583 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0058727759999999997, 2024-04-19T03:02:40.583 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:40.583 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:02:40.583 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:40.583 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:40.583 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:40.584 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 115228 2024-04-19T03:02:40.584 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.584 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:40.584 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.584 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:40.584 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:40.575357+0000", 2024-04-19T03:02:40.584 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:40.584 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.584 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.584 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:40.584 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:40.575357+0000", 2024-04-19T03:02:40.584 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:40.584 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.584 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.585 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:40.585 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:40.575357+0000", 2024-04-19T03:02:40.585 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:40.585 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.585 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.585 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:40.585 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:40.575360+0000", 2024-04-19T03:02:40.585 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.937e-06 2024-04-19T03:02:40.585 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.585 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.585 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:40.585 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:40.575367+0000", 2024-04-19T03:02:40.585 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0890000000000002e-06 2024-04-19T03:02:40.585 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.585 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.586 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:40.586 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:40.575372+0000", 2024-04-19T03:02:40.586 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0200000000000002e-06 2024-04-19T03:02:40.586 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.586 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.586 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:40.586 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:40.577160+0000", 2024-04-19T03:02:40.586 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001788825 2024-04-19T03:02:40.586 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.586 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.586 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:40.586 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:40.577308+0000", 2024-04-19T03:02:40.586 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00014708000000000001 2024-04-19T03:02:40.586 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.587 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.587 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:02:40.587 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:40.577447+0000", 2024-04-19T03:02:40.587 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00013962800000000001 2024-04-19T03:02:40.587 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:40.587 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:40.587 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:40.587 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.587 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.587 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:115234 5.7 5:e0f7ffa8:::benchmark_data_smithi096_19531_object1784:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-19T03:02:40.587 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:40.578055+0000", 2024-04-19T03:02:40.587 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.003149748, 2024-04-19T03:02:40.587 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0032644900000000001, 2024-04-19T03:02:40.587 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:40.587 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-04-19T03:02:40.588 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:40.588 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:40.588 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:40.588 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 115234 2024-04-19T03:02:40.588 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.588 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:40.588 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.588 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:40.588 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:40.578055+0000", 2024-04-19T03:02:40.588 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:40.588 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.588 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.588 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:40.588 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:40.578055+0000", 2024-04-19T03:02:40.588 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:40.589 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.589 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.589 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:40.589 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:40.578054+0000", 2024-04-19T03:02:40.589 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:40.589 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.589 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.589 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:40.589 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:40.578060+0000", 2024-04-19T03:02:40.589 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1550000000000004e-06 2024-04-19T03:02:40.589 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.589 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.589 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:40.589 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:40.578072+0000", 2024-04-19T03:02:40.590 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2146e-05 2024-04-19T03:02:40.590 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.590 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.590 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:40.590 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:40.578080+0000", 2024-04-19T03:02:40.590 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8930000000000005e-06 2024-04-19T03:02:40.590 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.590 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.590 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:40.590 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:40.578130+0000", 2024-04-19T03:02:40.590 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0433999999999999e-05 2024-04-19T03:02:40.590 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.590 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.590 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:40.591 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:40.578260+0000", 2024-04-19T03:02:40.591 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000130161 2024-04-19T03:02:40.591 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:40.591 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:40.591 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:40.591 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.591 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.591 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:115235 5.9 5:9825030e:::benchmark_data_smithi096_19531_object1785:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-19T03:02:40.591 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:40.578205+0000", 2024-04-19T03:02:40.591 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.002999682, 2024-04-19T03:02:40.591 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0031876449999999998, 2024-04-19T03:02:40.591 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:40.591 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:02:40.591 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:40.591 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:40.592 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:40.592 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 115235 2024-04-19T03:02:40.592 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.592 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:40.592 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.592 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:40.592 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:40.578205+0000", 2024-04-19T03:02:40.592 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:40.592 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.592 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.592 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:40.592 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:40.578205+0000", 2024-04-19T03:02:40.592 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:40.592 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.593 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.593 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:40.593 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:40.578204+0000", 2024-04-19T03:02:40.593 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:40.593 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.593 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.593 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:40.593 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:40.578209+0000", 2024-04-19T03:02:40.593 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1209999999999998e-06 2024-04-19T03:02:40.593 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.593 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.594 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:40.594 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:40.578218+0000", 2024-04-19T03:02:40.594 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.3840000000000003e-06 2024-04-19T03:02:40.594 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.594 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.594 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:40.594 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:40.578225+0000", 2024-04-19T03:02:40.594 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5100000000000004e-06 2024-04-19T03:02:40.594 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.594 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.594 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:40.594 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:40.578286+0000", 2024-04-19T03:02:40.594 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1428999999999997e-05 2024-04-19T03:02:40.594 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.595 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.595 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:40.595 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:40.578411+0000", 2024-04-19T03:02:40.595 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000124688 2024-04-19T03:02:40.595 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.595 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.595 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:02:40.595 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:40.578517+0000", 2024-04-19T03:02:40.595 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000106326 2024-04-19T03:02:40.595 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:40.595 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:40.595 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:40.595 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.595 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.595 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:115236 5.1 5:85528f92:::benchmark_data_smithi096_19531_object1786:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-19T03:02:40.596 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:40.578263+0000", 2024-04-19T03:02:40.596 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0029418280000000001, 2024-04-19T03:02:40.596 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0032084180000000002, 2024-04-19T03:02:40.596 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:40.596 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-04-19T03:02:40.596 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:40.596 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:40.596 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:40.596 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 115236 2024-04-19T03:02:40.596 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.596 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:40.596 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.596 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:40.596 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:40.578263+0000", 2024-04-19T03:02:40.597 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:40.597 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.597 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.597 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:40.597 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:40.578263+0000", 2024-04-19T03:02:40.597 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:40.597 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.597 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.597 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:40.597 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:40.578262+0000", 2024-04-19T03:02:40.597 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:40.597 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.597 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.597 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:40.597 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:40.578266+0000", 2024-04-19T03:02:40.598 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1459999999999998e-06 2024-04-19T03:02:40.598 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.598 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.598 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:40.598 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:40.578274+0000", 2024-04-19T03:02:40.598 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6399999999999997e-06 2024-04-19T03:02:40.598 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.598 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.598 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:40.598 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:40.578279+0000", 2024-04-19T03:02:40.598 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7429999999999999e-06 2024-04-19T03:02:40.598 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.598 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.599 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:40.599 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:40.578309+0000", 2024-04-19T03:02:40.599 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9547999999999999e-05 2024-04-19T03:02:40.599 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.599 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.599 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:40.599 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:40.578394+0000", 2024-04-19T03:02:40.599 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.5432000000000005e-05 2024-04-19T03:02:40.599 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:40.599 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:40.599 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:40.599 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.599 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.599 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:115239 5.3 5:c7934ae6:::benchmark_data_smithi096_19531_object1789:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-19T03:02:40.600 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:40.580315+0000", 2024-04-19T03:02:40.600 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.00088946999999999995, 2024-04-19T03:02:40.600 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0012258639999999999, 2024-04-19T03:02:40.600 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:40.600 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-04-19T03:02:40.600 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:40.600 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:40.600 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:40.600 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 115239 2024-04-19T03:02:40.600 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.600 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:40.600 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.600 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:40.600 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:40.580315+0000", 2024-04-19T03:02:40.601 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:40.601 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.601 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.601 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:40.601 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:40.580315+0000", 2024-04-19T03:02:40.601 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:40.601 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.601 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.601 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:40.601 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:40.580314+0000", 2024-04-19T03:02:40.601 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:40.601 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.601 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.601 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:40.601 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:40.580320+0000", 2024-04-19T03:02:40.602 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9070000000000004e-06 2024-04-19T03:02:40.602 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.602 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.602 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:40.602 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:40.580334+0000", 2024-04-19T03:02:40.602 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4739999999999999e-05 2024-04-19T03:02:40.602 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.602 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.602 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:40.602 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:40.580342+0000", 2024-04-19T03:02:40.602 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9549999999999992e-06 2024-04-19T03:02:40.602 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.602 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.603 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:40.603 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:40.580398+0000", 2024-04-19T03:02:40.603 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5713e-05 2024-04-19T03:02:40.603 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.603 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.603 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:40.603 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:40.580540+0000", 2024-04-19T03:02:40.603 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00014165099999999999 2024-04-19T03:02:40.603 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:40.603 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:40.604 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:40.604 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.604 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.604 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:115241 5.3 5.c695ce53 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-19T03:02:40.604 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:40.580880+0000", 2024-04-19T03:02:40.604 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.000324677, 2024-04-19T03:02:40.604 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00072544500000000002, 2024-04-19T03:02:40.604 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:40.604 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-04-19T03:02:40.605 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:40.605 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:40.605 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:40.605 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 115241 2024-04-19T03:02:40.605 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.605 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:40.605 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.605 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:40.605 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:40.580880+0000", 2024-04-19T03:02:40.605 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:40.605 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.605 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.605 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:40.605 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:40.580880+0000", 2024-04-19T03:02:40.605 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:40.606 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.606 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.606 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:40.606 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:40.580879+0000", 2024-04-19T03:02:40.606 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:40.606 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.606 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.606 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:40.606 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:40.580884+0000", 2024-04-19T03:02:40.606 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6350000000000003e-06 2024-04-19T03:02:40.606 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.606 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.606 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:40.607 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:40.580899+0000", 2024-04-19T03:02:40.607 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4978e-05 2024-04-19T03:02:40.607 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.607 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.607 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:40.607 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:40.580921+0000", 2024-04-19T03:02:40.607 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1518999999999998e-05 2024-04-19T03:02:40.607 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:40.607 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:40.607 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:40.607 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.607 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.607 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:115242 5.c 5:3b26c634:::benchmark_data_smithi096_19531_object1792:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-19T03:02:40.607 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:40.580931+0000", 2024-04-19T03:02:40.608 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.00027350200000000001, 2024-04-19T03:02:40.608 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00073065700000000001, 2024-04-19T03:02:40.608 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:40.608 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-04-19T03:02:40.608 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:40.608 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:40.608 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:40.608 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 115242 2024-04-19T03:02:40.608 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.608 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:40.608 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.608 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:40.608 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:40.580931+0000", 2024-04-19T03:02:40.608 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:40.608 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.609 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.609 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:40.609 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:40.580931+0000", 2024-04-19T03:02:40.609 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:40.609 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.609 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.609 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:40.609 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:40.580930+0000", 2024-04-19T03:02:40.609 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:40.609 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.609 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.609 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:40.609 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:40.580934+0000", 2024-04-19T03:02:40.609 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4630000000000001e-06 2024-04-19T03:02:40.609 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.610 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.610 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:40.610 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:40.580942+0000", 2024-04-19T03:02:40.610 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0039999999999999e-06 2024-04-19T03:02:40.610 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.610 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.610 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:40.610 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:40.580950+0000", 2024-04-19T03:02:40.610 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.3289999999999994e-06 2024-04-19T03:02:40.610 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.610 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.610 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:40.610 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:40.580999+0000", 2024-04-19T03:02:40.610 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9261000000000002e-05 2024-04-19T03:02:40.611 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.611 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.611 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:40.611 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:40.581147+0000", 2024-04-19T03:02:40.611 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00014798599999999999 2024-04-19T03:02:40.611 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:40.611 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:40.611 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:40.611 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.611 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.612 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop_reply(client.4755.0:115228 5.d e50/49)", 2024-04-19T03:02:40.612 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:40.581704+0000", 2024-04-19T03:02:40.612 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4294967295.9995008, 2024-04-19T03:02:40.612 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.6078999999999999e-05, 2024-04-19T03:02:40.612 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:40.612 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-04-19T03:02:40.612 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:40.612 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.612 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:40.612 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:40.581704+0000", 2024-04-19T03:02:40.612 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:40.612 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.612 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.612 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:40.613 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:40.581704+0000", 2024-04-19T03:02:40.613 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:40.613 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.613 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.613 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:40.613 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:40.581703+0000", 2024-04-19T03:02:40.614 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:40.614 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.615 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.615 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:40.615 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:40.581706+0000", 2024-04-19T03:02:40.615 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7410000000000001e-06 2024-04-19T03:02:40.615 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.615 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.615 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:40.615 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:40.581712+0000", 2024-04-19T03:02:40.615 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2840000000000003e-06 2024-04-19T03:02:40.615 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.615 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.615 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:40.615 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:40.581716+0000", 2024-04-19T03:02:40.616 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.619e-06 2024-04-19T03:02:40.616 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:40.616 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:40.616 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:40.616 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:40.616 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-04-19T03:02:40.616 INFO:teuthology.orchestra.run.smithi144.stdout: "num_ops": 8 2024-04-19T03:02:40.616 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-04-19T03:02:40.617 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T03:02:40.651 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:40.651+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:40.753 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:40.751+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:40.778 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-04-19T03:02:40.778 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2024-04-19T03:02:40.778 INFO:teuthology.orchestra.run.smithi144.stdout: "complaint_time": 30, 2024-04-19T03:02:40.778 INFO:teuthology.orchestra.run.smithi144.stdout: "num_blocked_ops": 0 2024-04-19T03:02:40.778 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-04-19T03:02:40.791 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T03:02:40.854 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:40.853+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:40.916 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-04-19T03:02:40.916 INFO:teuthology.orchestra.run.smithi144.stdout: "size": 20, 2024-04-19T03:02:40.916 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 600, 2024-04-19T03:02:40.916 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [ 2024-04-19T03:02:40.916 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.916 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:78992 5.7 5:e6baa862:::benchmark_data_smithi096_19531_object78991:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-19T03:02:40.916 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:18.008888+0000", 2024-04-19T03:02:40.917 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 22.904493897999998, 2024-04-19T03:02:40.917 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.056375285999999997, 2024-04-19T03:02:40.917 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:40.917 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:40.917 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:40.917 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:40.917 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:40.917 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 78992 2024-04-19T03:02:40.917 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.917 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:40.917 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.917 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:40.917 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.008888+0000", 2024-04-19T03:02:40.917 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:40.918 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.918 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.918 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:40.918 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.008888+0000", 2024-04-19T03:02:40.918 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:40.918 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.918 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.918 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:40.918 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.008888+0000", 2024-04-19T03:02:40.918 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:40.918 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.918 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.918 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:40.918 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.008928+0000", 2024-04-19T03:02:40.919 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0361999999999997e-05 2024-04-19T03:02:40.919 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.919 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.919 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:40.919 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.008942+0000", 2024-04-19T03:02:40.919 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4365000000000001e-05 2024-04-19T03:02:40.919 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.919 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.919 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:40.919 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.008949+0000", 2024-04-19T03:02:40.919 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.212e-06 2024-04-19T03:02:40.919 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.919 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.919 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:40.920 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.012683+0000", 2024-04-19T03:02:40.920 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.003733934 2024-04-19T03:02:40.920 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.920 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.920 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:40.920 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.012798+0000", 2024-04-19T03:02:40.920 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00011574999999999999 2024-04-19T03:02:40.920 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.920 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.920 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:40.920 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.012896+0000", 2024-04-19T03:02:40.920 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.7848000000000002e-05 2024-04-19T03:02:40.920 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.920 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.921 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:40.921 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016423+0000", 2024-04-19T03:02:40.921 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0035270789999999998 2024-04-19T03:02:40.921 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.921 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.921 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:40.921 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.065098+0000", 2024-04-19T03:02:40.921 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.048674651999999999 2024-04-19T03:02:40.921 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.921 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.921 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:40.921 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.065193+0000", 2024-04-19T03:02:40.921 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.5087999999999995e-05 2024-04-19T03:02:40.921 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.922 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.922 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:40.922 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.065264+0000", 2024-04-19T03:02:40.922 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0666000000000004e-05 2024-04-19T03:02:40.922 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:40.923 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:40.923 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:40.923 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.923 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.923 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:78998 5.7 5:ee23c1bc:::benchmark_data_smithi096_19531_object78997:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-19T03:02:40.923 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:18.013165+0000", 2024-04-19T03:02:40.923 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 22.900217191999999, 2024-04-19T03:02:40.923 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.052410864000000001, 2024-04-19T03:02:40.923 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:40.923 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:40.923 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:40.923 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:40.923 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:40.924 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 78998 2024-04-19T03:02:40.924 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.924 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:40.924 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.924 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:40.924 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.013165+0000", 2024-04-19T03:02:40.924 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:40.924 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.924 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.924 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:40.924 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.013165+0000", 2024-04-19T03:02:40.924 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:40.924 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.924 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.925 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:40.925 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.013164+0000", 2024-04-19T03:02:40.925 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:40.925 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.925 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.925 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:40.925 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.013214+0000", 2024-04-19T03:02:40.925 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9636999999999999e-05 2024-04-19T03:02:40.925 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.925 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.925 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:40.925 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.013223+0000", 2024-04-19T03:02:40.925 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.3619999999999995e-06 2024-04-19T03:02:40.925 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.926 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.926 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:40.926 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.013229+0000", 2024-04-19T03:02:40.926 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6060000000000002e-06 2024-04-19T03:02:40.926 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.926 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.926 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:40.926 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.014882+0000", 2024-04-19T03:02:40.926 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001653257 2024-04-19T03:02:40.926 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.926 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.926 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:40.926 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.014958+0000", 2024-04-19T03:02:40.926 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6398999999999998e-05 2024-04-19T03:02:40.927 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.927 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.927 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:40.927 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.015036+0000", 2024-04-19T03:02:40.927 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8070000000000003e-05 2024-04-19T03:02:40.927 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.927 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.927 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:40.927 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018099+0000", 2024-04-19T03:02:40.927 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0030631149999999999 2024-04-19T03:02:40.927 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.927 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.927 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:40.927 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.065328+0000", 2024-04-19T03:02:40.928 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.047228349000000003 2024-04-19T03:02:40.928 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.928 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.928 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:40.928 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.065508+0000", 2024-04-19T03:02:40.928 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00018036899999999999 2024-04-19T03:02:40.928 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.928 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.928 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:40.928 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.065576+0000", 2024-04-19T03:02:40.928 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7785000000000002e-05 2024-04-19T03:02:40.928 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:40.928 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:40.928 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:40.929 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.929 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.929 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4755.0:78995 5.2 e40/39 5:42b55e12:::benchmark_data_smithi096_19531_object78994:head v 40'4934, mlcod=40'4932)", 2024-04-19T03:02:40.929 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:18.016247+0000", 2024-04-19T03:02:40.929 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 22.89713523, 2024-04-19T03:02:40.929 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.056240406, 2024-04-19T03:02:40.929 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:40.929 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:40.929 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:40.929 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.929 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:40.929 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016247+0000", 2024-04-19T03:02:40.929 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:40.929 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.930 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.930 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:40.930 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016247+0000", 2024-04-19T03:02:40.930 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:40.930 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.930 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.930 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:40.930 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016246+0000", 2024-04-19T03:02:40.930 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:40.930 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.930 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.930 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:40.930 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016315+0000", 2024-04-19T03:02:40.930 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8979000000000005e-05 2024-04-19T03:02:40.931 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.931 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.931 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:40.931 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016333+0000", 2024-04-19T03:02:40.931 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7586999999999999e-05 2024-04-19T03:02:40.931 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.931 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.931 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:40.931 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016340+0000", 2024-04-19T03:02:40.931 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4080000000000001e-06 2024-04-19T03:02:40.931 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.931 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.931 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:40.931 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016384+0000", 2024-04-19T03:02:40.932 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3656999999999999e-05 2024-04-19T03:02:40.932 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.932 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.932 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:40.932 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016403+0000", 2024-04-19T03:02:40.932 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9089e-05 2024-04-19T03:02:40.932 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.932 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.932 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:40.932 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.072448+0000", 2024-04-19T03:02:40.932 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.056045084000000002 2024-04-19T03:02:40.932 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.932 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.932 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:40.933 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.072487+0000", 2024-04-19T03:02:40.933 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9362e-05 2024-04-19T03:02:40.933 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:40.933 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:40.933 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:40.933 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.933 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.933 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4755.0:78994 5.c e40/22 5:3c60d55d:::benchmark_data_smithi096_19531_object78993:head v 40'4989, mlcod=40'4987)", 2024-04-19T03:02:40.933 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:18.016392+0000", 2024-04-19T03:02:40.933 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 22.896990589000001, 2024-04-19T03:02:40.933 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.052629620000000002, 2024-04-19T03:02:40.933 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:40.934 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:40.934 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:40.934 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.934 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:40.934 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016392+0000", 2024-04-19T03:02:40.934 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:40.934 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.934 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.934 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:40.934 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016392+0000", 2024-04-19T03:02:40.934 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:40.934 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.934 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.935 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:40.935 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016391+0000", 2024-04-19T03:02:40.935 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:40.935 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.935 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.935 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:40.935 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016471+0000", 2024-04-19T03:02:40.935 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9346999999999998e-05 2024-04-19T03:02:40.935 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.935 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.935 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:40.935 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016478+0000", 2024-04-19T03:02:40.935 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.593e-06 2024-04-19T03:02:40.935 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.935 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.936 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:40.936 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016495+0000", 2024-04-19T03:02:40.936 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6492999999999999e-05 2024-04-19T03:02:40.936 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.936 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.936 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:40.936 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016539+0000", 2024-04-19T03:02:40.936 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4715999999999997e-05 2024-04-19T03:02:40.936 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.936 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.936 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:40.936 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016551+0000", 2024-04-19T03:02:40.936 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2096000000000001e-05 2024-04-19T03:02:40.936 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.937 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.937 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:40.937 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.068985+0000", 2024-04-19T03:02:40.937 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.052433754999999999 2024-04-19T03:02:40.937 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.937 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.937 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:40.937 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.069021+0000", 2024-04-19T03:02:40.937 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6047000000000002e-05 2024-04-19T03:02:40.937 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:40.937 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:40.937 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:40.937 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.937 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.938 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4755.0:78996 5.1 e40/39 5:87f59708:::benchmark_data_smithi096_19531_object78995:head v 40'4940, mlcod=40'4938)", 2024-04-19T03:02:40.938 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:18.016581+0000", 2024-04-19T03:02:40.938 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 22.896801424, 2024-04-19T03:02:40.938 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.052051785000000003, 2024-04-19T03:02:40.938 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:40.938 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:40.938 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:40.938 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.938 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:40.938 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016581+0000", 2024-04-19T03:02:40.938 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:40.938 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.938 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.938 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:40.939 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016581+0000", 2024-04-19T03:02:40.939 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:40.939 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.939 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.939 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:40.939 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016581+0000", 2024-04-19T03:02:40.939 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:40.939 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.939 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.939 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:40.939 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016610+0000", 2024-04-19T03:02:40.939 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9556999999999998e-05 2024-04-19T03:02:40.939 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.939 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.940 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:40.940 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016616+0000", 2024-04-19T03:02:40.940 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1090000000000003e-06 2024-04-19T03:02:40.940 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.940 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.940 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:40.940 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016621+0000", 2024-04-19T03:02:40.940 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.454e-06 2024-04-19T03:02:40.940 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.940 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.940 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:40.940 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016663+0000", 2024-04-19T03:02:40.940 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2582e-05 2024-04-19T03:02:40.940 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.940 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.941 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:40.941 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016681+0000", 2024-04-19T03:02:40.941 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7680999999999999e-05 2024-04-19T03:02:40.941 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.941 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.941 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:40.941 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.068486+0000", 2024-04-19T03:02:40.941 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.051804624000000001 2024-04-19T03:02:40.941 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.941 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.941 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:40.941 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.068633+0000", 2024-04-19T03:02:40.941 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00014709099999999999 2024-04-19T03:02:40.941 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:40.942 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:40.942 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:40.942 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.942 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.942 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4755.0:78999 5.3 e40/22 5:c9ec5f7f:::benchmark_data_smithi096_19531_object78998:head v 40'4893, mlcod=40'4889)", 2024-04-19T03:02:40.942 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:18.016633+0000", 2024-04-19T03:02:40.942 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 22.896749569000001, 2024-04-19T03:02:40.942 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.051090469999999999, 2024-04-19T03:02:40.942 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:40.942 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:40.942 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:40.942 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.942 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:40.942 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016633+0000", 2024-04-19T03:02:40.943 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:40.943 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.943 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.943 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:40.943 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016633+0000", 2024-04-19T03:02:40.943 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:40.943 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.943 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.943 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:40.943 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016632+0000", 2024-04-19T03:02:40.943 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967296 2024-04-19T03:02:40.943 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.943 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.943 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:40.943 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016660+0000", 2024-04-19T03:02:40.944 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7869999999999999e-05 2024-04-19T03:02:40.944 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.944 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.944 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:40.944 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016667+0000", 2024-04-19T03:02:40.944 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0280000000000003e-06 2024-04-19T03:02:40.944 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.944 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.944 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:40.944 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016672+0000", 2024-04-19T03:02:40.944 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0069999999999997e-06 2024-04-19T03:02:40.944 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.944 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.945 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:40.945 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016725+0000", 2024-04-19T03:02:40.945 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2812000000000002e-05 2024-04-19T03:02:40.945 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.945 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.945 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:40.945 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016750+0000", 2024-04-19T03:02:40.945 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5038e-05 2024-04-19T03:02:40.945 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.945 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.945 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:40.945 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.067673+0000", 2024-04-19T03:02:40.945 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.050922350999999998 2024-04-19T03:02:40.945 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.946 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.946 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:40.946 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.067723+0000", 2024-04-19T03:02:40.946 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0586e-05 2024-04-19T03:02:40.946 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:40.946 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:40.946 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:40.946 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.946 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.946 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4755.0:79003 5.2 e40/39 5:4436e33f:::benchmark_data_smithi096_19531_object79002:head v 40'4935, mlcod=40'4932)", 2024-04-19T03:02:40.946 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:18.018102+0000", 2024-04-19T03:02:40.946 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 22.895279842000001, 2024-04-19T03:02:40.946 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.060023990999999999, 2024-04-19T03:02:40.946 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:40.947 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:40.947 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:40.947 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.947 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:40.947 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018102+0000", 2024-04-19T03:02:40.947 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:40.947 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.947 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.947 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:40.947 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018102+0000", 2024-04-19T03:02:40.947 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:40.947 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.947 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.947 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:40.948 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018102+0000", 2024-04-19T03:02:40.948 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:40.948 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.948 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.948 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:40.948 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018134+0000", 2024-04-19T03:02:40.948 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2722000000000003e-05 2024-04-19T03:02:40.948 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.948 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.948 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:40.948 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018145+0000", 2024-04-19T03:02:40.948 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0395e-05 2024-04-19T03:02:40.948 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.948 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.948 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:40.949 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018151+0000", 2024-04-19T03:02:40.949 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5300000000000002e-06 2024-04-19T03:02:40.949 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.949 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.949 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:40.949 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018489+0000", 2024-04-19T03:02:40.949 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00033731499999999998 2024-04-19T03:02:40.949 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.949 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.949 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:40.949 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018508+0000", 2024-04-19T03:02:40.949 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9775e-05 2024-04-19T03:02:40.949 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.949 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.950 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:40.950 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.078059+0000", 2024-04-19T03:02:40.950 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.059550171999999998 2024-04-19T03:02:40.950 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.950 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.950 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:40.950 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.078126+0000", 2024-04-19T03:02:40.950 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7773000000000003e-05 2024-04-19T03:02:40.950 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:40.950 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:40.950 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:40.950 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.950 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.950 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4755.0:79005 5.1 e40/39 5:85b46038:::benchmark_data_smithi096_19531_object79004:head v 40'4941, mlcod=40'4938)", 2024-04-19T03:02:40.951 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:18.018167+0000", 2024-04-19T03:02:40.951 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 22.895215123, 2024-04-19T03:02:40.951 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.052768941999999999, 2024-04-19T03:02:40.951 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:40.951 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:40.951 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:40.951 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.951 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:40.951 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018167+0000", 2024-04-19T03:02:40.951 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:40.951 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.951 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.951 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:40.951 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018167+0000", 2024-04-19T03:02:40.951 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:40.952 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.952 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.952 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:40.952 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018167+0000", 2024-04-19T03:02:40.952 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:40.952 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.952 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.952 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:40.952 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018196+0000", 2024-04-19T03:02:40.952 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9538000000000001e-05 2024-04-19T03:02:40.952 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.952 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.952 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:40.952 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018204+0000", 2024-04-19T03:02:40.953 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2599999999999999e-06 2024-04-19T03:02:40.953 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.953 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.953 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:40.953 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018208+0000", 2024-04-19T03:02:40.953 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8080000000000004e-06 2024-04-19T03:02:40.953 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.953 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.953 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:40.953 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.064933+0000", 2024-04-19T03:02:40.953 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.046725048999999998 2024-04-19T03:02:40.953 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.953 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.953 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:40.954 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.064964+0000", 2024-04-19T03:02:40.954 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0577000000000002e-05 2024-04-19T03:02:40.954 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.954 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.954 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:40.954 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.070815+0000", 2024-04-19T03:02:40.954 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0058510649999999999 2024-04-19T03:02:40.954 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.954 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.954 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:40.954 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.070936+0000", 2024-04-19T03:02:40.954 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00012095399999999999 2024-04-19T03:02:40.954 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:40.954 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:40.955 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:40.955 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.955 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.955 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:86612 5.7 5:e32e3c49:::benchmark_data_smithi096_19531_object86611:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:40.955 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:22.633560+0000", 2024-04-19T03:02:40.955 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 18.279822182, 2024-04-19T03:02:40.955 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.19135289, 2024-04-19T03:02:40.955 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:40.955 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:40.955 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:40.955 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:40.955 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:40.955 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 86612 2024-04-19T03:02:40.955 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.955 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:40.956 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.956 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:40.956 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633560+0000", 2024-04-19T03:02:40.956 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:40.956 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.956 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.956 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:40.956 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633560+0000", 2024-04-19T03:02:40.956 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:40.956 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.956 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.956 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:40.956 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633558+0000", 2024-04-19T03:02:40.956 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:40.957 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.957 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.957 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:40.957 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633609+0000", 2024-04-19T03:02:40.957 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0850999999999998e-05 2024-04-19T03:02:40.957 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.957 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.957 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:40.957 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633627+0000", 2024-04-19T03:02:40.957 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7951000000000001e-05 2024-04-19T03:02:40.957 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.957 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.957 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:40.957 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633635+0000", 2024-04-19T03:02:40.957 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2530000000000004e-06 2024-04-19T03:02:40.958 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.958 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.958 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:40.958 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633699+0000", 2024-04-19T03:02:40.958 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3901999999999999e-05 2024-04-19T03:02:40.958 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.958 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.958 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:40.958 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633992+0000", 2024-04-19T03:02:40.958 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00029283299999999999 2024-04-19T03:02:40.958 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.958 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.958 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:40.959 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.634223+0000", 2024-04-19T03:02:40.959 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00023084200000000001 2024-04-19T03:02:40.959 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.959 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.959 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:40.959 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.639085+0000", 2024-04-19T03:02:40.959 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0048624269999999999 2024-04-19T03:02:40.959 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.959 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.959 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:40.959 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.824635+0000", 2024-04-19T03:02:40.959 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.18554944700000001 2024-04-19T03:02:40.959 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.959 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.959 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:40.960 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.824793+0000", 2024-04-19T03:02:40.960 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000157959 2024-04-19T03:02:40.960 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.960 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.960 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:40.960 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.824913+0000", 2024-04-19T03:02:40.960 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000120093 2024-04-19T03:02:40.960 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:40.960 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:40.960 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:40.960 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.960 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.960 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:86625 5.7 5:e6d00488:::benchmark_data_smithi096_19531_object86624:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:40.960 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:22.643554+0000", 2024-04-19T03:02:40.961 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 18.269828415999999, 2024-04-19T03:02:40.961 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.18732841, 2024-04-19T03:02:40.961 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:40.961 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:40.961 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:40.961 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:40.961 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:40.961 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 86625 2024-04-19T03:02:40.961 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.961 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:40.961 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.961 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:40.961 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643554+0000", 2024-04-19T03:02:40.961 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:40.961 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.962 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.962 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:40.962 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643554+0000", 2024-04-19T03:02:40.962 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:40.962 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.962 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.962 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:40.962 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643552+0000", 2024-04-19T03:02:40.962 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:40.962 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.962 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.962 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:40.962 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643588+0000", 2024-04-19T03:02:40.963 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5855999999999997e-05 2024-04-19T03:02:40.963 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.963 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.963 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:40.963 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643606+0000", 2024-04-19T03:02:40.963 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8226000000000001e-05 2024-04-19T03:02:40.963 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.963 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.963 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:40.963 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643618+0000", 2024-04-19T03:02:40.963 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1868000000000001e-05 2024-04-19T03:02:40.963 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.963 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.963 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:40.963 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643676+0000", 2024-04-19T03:02:40.964 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8153999999999999e-05 2024-04-19T03:02:40.964 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.964 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.964 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:40.964 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643905+0000", 2024-04-19T03:02:40.964 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00022847500000000001 2024-04-19T03:02:40.964 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.964 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.964 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:40.964 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.644150+0000", 2024-04-19T03:02:40.964 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00024531800000000001 2024-04-19T03:02:40.964 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.964 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.964 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:40.964 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.647407+0000", 2024-04-19T03:02:40.965 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0032563190000000001 2024-04-19T03:02:40.965 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.965 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.965 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:40.965 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.830721+0000", 2024-04-19T03:02:40.965 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.18331468300000001 2024-04-19T03:02:40.965 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.965 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.965 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:40.965 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.830813+0000", 2024-04-19T03:02:40.965 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.2205000000000002e-05 2024-04-19T03:02:40.965 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.965 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.965 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:40.966 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.830882+0000", 2024-04-19T03:02:40.966 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8819999999999995e-05 2024-04-19T03:02:40.966 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:40.966 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:40.966 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:40.966 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.966 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.966 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87063 5.7 5:e502e824:::benchmark_data_smithi096_19531_object87062:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:40.966 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.136067+0000", 2024-04-19T03:02:40.966 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 17.777315547000001, 2024-04-19T03:02:40.966 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.065521159999999995, 2024-04-19T03:02:40.966 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:40.966 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:40.966 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:40.967 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:40.967 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:40.967 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87063 2024-04-19T03:02:40.967 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.967 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:40.967 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.967 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:40.967 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.136067+0000", 2024-04-19T03:02:40.967 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:40.967 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.967 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.967 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:40.967 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.136067+0000", 2024-04-19T03:02:40.967 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:40.968 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.968 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.968 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:40.968 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.136066+0000", 2024-04-19T03:02:40.968 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:40.968 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.968 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.968 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:40.968 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.136154+0000", 2024-04-19T03:02:40.968 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.8256000000000003e-05 2024-04-19T03:02:40.968 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.968 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.968 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:40.968 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.136162+0000", 2024-04-19T03:02:40.968 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.5099999999999998e-06 2024-04-19T03:02:40.969 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.969 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.969 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:40.969 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.136171+0000", 2024-04-19T03:02:40.969 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2830000000000001e-06 2024-04-19T03:02:40.969 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.969 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.969 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:40.969 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.138421+0000", 2024-04-19T03:02:40.969 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0022506620000000001 2024-04-19T03:02:40.969 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.969 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.969 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:40.969 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.138560+0000", 2024-04-19T03:02:40.969 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000138446 2024-04-19T03:02:40.970 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.970 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.970 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:40.970 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.138689+0000", 2024-04-19T03:02:40.970 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00012950700000000001 2024-04-19T03:02:40.970 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.970 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.970 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:40.970 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.141517+0000", 2024-04-19T03:02:40.970 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0028280860000000001 2024-04-19T03:02:40.970 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.970 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.970 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:40.970 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.201350+0000", 2024-04-19T03:02:40.971 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.059832418999999998 2024-04-19T03:02:40.971 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.971 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.971 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:40.971 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.201485+0000", 2024-04-19T03:02:40.971 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000135597 2024-04-19T03:02:40.971 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.971 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.971 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:40.971 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.201588+0000", 2024-04-19T03:02:40.971 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00010247900000000001 2024-04-19T03:02:40.971 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:40.971 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:40.971 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:40.972 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.972 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.972 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87072 5.7 5:e3c7809a:::benchmark_data_smithi096_19531_object87071:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:40.972 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.144224+0000", 2024-04-19T03:02:40.972 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 17.769158523000002, 2024-04-19T03:02:40.972 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.058179555000000001, 2024-04-19T03:02:40.972 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:40.972 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:40.972 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:40.972 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:40.972 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:40.972 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87072 2024-04-19T03:02:40.972 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.972 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:40.973 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.973 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:40.973 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144224+0000", 2024-04-19T03:02:40.973 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:40.973 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.973 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.973 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:40.973 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144224+0000", 2024-04-19T03:02:40.973 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:40.973 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.973 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.973 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:40.973 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144223+0000", 2024-04-19T03:02:40.973 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:40.974 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.974 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.974 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:40.974 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144320+0000", 2024-04-19T03:02:40.974 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.7075000000000001e-05 2024-04-19T03:02:40.974 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.974 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.974 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:40.974 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144331+0000", 2024-04-19T03:02:40.974 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1342000000000001e-05 2024-04-19T03:02:40.974 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.974 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.974 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:40.974 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144337+0000", 2024-04-19T03:02:40.975 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8390000000000003e-06 2024-04-19T03:02:40.975 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.975 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.975 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:40.975 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144369+0000", 2024-04-19T03:02:40.975 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2079000000000002e-05 2024-04-19T03:02:40.975 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.975 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.975 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:40.975 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144464+0000", 2024-04-19T03:02:40.975 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.4623000000000005e-05 2024-04-19T03:02:40.975 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.975 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.975 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:40.976 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144553+0000", 2024-04-19T03:02:40.976 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9171000000000004e-05 2024-04-19T03:02:40.976 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.976 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.976 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:40.976 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.147018+0000", 2024-04-19T03:02:40.976 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0024648370000000001 2024-04-19T03:02:40.976 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.976 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.976 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:40.976 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.202270+0000", 2024-04-19T03:02:40.976 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.055252018 2024-04-19T03:02:40.976 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.976 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.976 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:40.977 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.202356+0000", 2024-04-19T03:02:40.977 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6648000000000001e-05 2024-04-19T03:02:40.977 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.977 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.977 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:40.977 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.202403+0000", 2024-04-19T03:02:40.977 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6956999999999998e-05 2024-04-19T03:02:40.977 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:40.977 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:40.977 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:40.977 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.977 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.977 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87123 5.6 5:6d1bc3b9:::benchmark_data_smithi096_19531_object87122:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:02:40.978 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249233+0000", 2024-04-19T03:02:40.978 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 17.664149491, 2024-04-19T03:02:40.978 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0291700720000001, 2024-04-19T03:02:40.978 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:40.978 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-04-19T03:02:40.978 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:40.978 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:40.978 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:40.978 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87123 2024-04-19T03:02:40.978 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.978 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:40.978 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.978 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:40.978 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249233+0000", 2024-04-19T03:02:40.979 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:40.979 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.979 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.979 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:40.979 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249233+0000", 2024-04-19T03:02:40.979 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:40.979 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.979 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.979 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:40.979 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249231+0000", 2024-04-19T03:02:40.979 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:40.979 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.979 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.979 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:40.979 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249285+0000", 2024-04-19T03:02:40.980 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4005000000000002e-05 2024-04-19T03:02:40.980 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.980 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.980 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:40.980 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249300+0000", 2024-04-19T03:02:40.980 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4715999999999999e-05 2024-04-19T03:02:40.980 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.980 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.980 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:40.980 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249307+0000", 2024-04-19T03:02:40.980 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8399999999999997e-06 2024-04-19T03:02:40.980 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.980 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.980 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:40.981 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249366+0000", 2024-04-19T03:02:40.981 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9435999999999998e-05 2024-04-19T03:02:40.981 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.981 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.981 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op must wait for map", 2024-04-19T03:02:40.981 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249376+0000", 2024-04-19T03:02:40.981 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.4919999999999999e-06 2024-04-19T03:02:40.981 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.981 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.981 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:40.981 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263757+0000", 2024-04-19T03:02:40.981 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.014381461999999999 2024-04-19T03:02:40.981 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.981 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.981 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:02:40.982 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263875+0000", 2024-04-19T03:02:40.982 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000117166 2024-04-19T03:02:40.982 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.982 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.982 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:40.982 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.277136+0000", 2024-04-19T03:02:40.982 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.013261207 2024-04-19T03:02:40.982 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.982 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.982 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:40.982 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.278403+0000", 2024-04-19T03:02:40.982 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001267106 2024-04-19T03:02:40.982 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:40.983 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:40.983 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:40.983 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.983 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.983 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87128 5.6 5:6905c420:::benchmark_data_smithi096_19531_object87127:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:02:40.983 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249323+0000", 2024-04-19T03:02:40.983 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 17.664058743999998, 2024-04-19T03:02:40.983 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0292813249999999, 2024-04-19T03:02:40.983 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:40.983 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-04-19T03:02:40.983 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:40.983 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:40.983 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:40.983 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87128 2024-04-19T03:02:40.984 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.984 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:40.984 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.984 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:40.984 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249323+0000", 2024-04-19T03:02:40.984 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:40.984 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.984 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.984 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:40.984 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249323+0000", 2024-04-19T03:02:40.984 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:40.984 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.984 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.984 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:40.985 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249323+0000", 2024-04-19T03:02:40.985 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:40.985 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.985 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.985 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:40.985 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249385+0000", 2024-04-19T03:02:40.985 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1711999999999995e-05 2024-04-19T03:02:40.985 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.985 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.985 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:40.985 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249398+0000", 2024-04-19T03:02:40.985 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3022e-05 2024-04-19T03:02:40.985 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.986 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.986 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:40.986 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249402+0000", 2024-04-19T03:02:40.986 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4819999999999996e-06 2024-04-19T03:02:40.986 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.986 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.986 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:40.986 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249437+0000", 2024-04-19T03:02:40.986 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4702000000000001e-05 2024-04-19T03:02:40.986 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.986 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.986 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:02:40.986 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249442+0000", 2024-04-19T03:02:40.986 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8019999999999999e-06 2024-04-19T03:02:40.987 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.987 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.987 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:40.987 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263896+0000", 2024-04-19T03:02:40.987 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.014454679999999999 2024-04-19T03:02:40.987 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.987 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.987 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:02:40.987 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263900+0000", 2024-04-19T03:02:40.987 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9700000000000001e-06 2024-04-19T03:02:40.987 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.987 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.987 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:40.987 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.278557+0000", 2024-04-19T03:02:40.988 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0146566480000001 2024-04-19T03:02:40.988 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.988 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.988 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:40.988 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.278605+0000", 2024-04-19T03:02:40.988 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7735999999999998e-05 2024-04-19T03:02:40.988 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:40.988 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:40.988 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:40.988 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.988 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.988 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87130 5.3 5:c8c2d67b:::benchmark_data_smithi096_19531_object87129:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:02:40.988 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249418+0000", 2024-04-19T03:02:40.989 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 17.663964032999999, 2024-04-19T03:02:40.989 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.025414182, 2024-04-19T03:02:40.989 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:40.989 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-04-19T03:02:40.989 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:40.989 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:40.989 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:40.989 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87130 2024-04-19T03:02:40.989 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.989 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:40.989 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.989 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:40.989 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249418+0000", 2024-04-19T03:02:40.989 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:40.990 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.990 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.990 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:40.990 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249418+0000", 2024-04-19T03:02:40.990 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:40.990 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.990 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.990 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:40.990 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249409+0000", 2024-04-19T03:02:40.990 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999905 2024-04-19T03:02:40.990 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.990 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.990 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:40.990 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249464+0000", 2024-04-19T03:02:40.991 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5381999999999999e-05 2024-04-19T03:02:40.991 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.991 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.991 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:40.991 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249471+0000", 2024-04-19T03:02:40.991 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2609999999999996e-06 2024-04-19T03:02:40.991 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.991 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.991 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:40.991 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249475+0000", 2024-04-19T03:02:40.991 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2839999999999998e-06 2024-04-19T03:02:40.991 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.991 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.991 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:40.992 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249535+0000", 2024-04-19T03:02:40.992 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0545999999999999e-05 2024-04-19T03:02:40.992 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.992 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.992 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op must wait for map", 2024-04-19T03:02:40.992 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249540+0000", 2024-04-19T03:02:40.992 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2859999999999999e-06 2024-04-19T03:02:40.992 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.992 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.992 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:40.992 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263450+0000", 2024-04-19T03:02:40.992 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.013909585 2024-04-19T03:02:40.992 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.992 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.993 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:02:40.993 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263458+0000", 2024-04-19T03:02:40.993 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8089999999999993e-06 2024-04-19T03:02:40.993 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.993 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.993 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:40.993 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.273193+0000", 2024-04-19T03:02:40.993 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0097351379999999 2024-04-19T03:02:40.993 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.993 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.993 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:40.993 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.274832+0000", 2024-04-19T03:02:40.993 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0016394789999999999 2024-04-19T03:02:40.993 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:40.993 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:40.994 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:40.994 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.994 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.994 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87131 5.1 5:83756d55:::benchmark_data_smithi096_19531_object87130:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:02:40.994 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249491+0000", 2024-04-19T03:02:40.994 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 17.663891386, 2024-04-19T03:02:40.994 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0191489520000001, 2024-04-19T03:02:40.994 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:40.994 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-04-19T03:02:40.994 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:40.994 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:40.994 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:40.994 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87131 2024-04-19T03:02:40.995 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.995 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:40.995 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.995 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:40.995 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249491+0000", 2024-04-19T03:02:40.995 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:40.995 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.995 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.995 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:40.995 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249491+0000", 2024-04-19T03:02:40.995 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:40.995 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.995 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.995 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:40.996 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249491+0000", 2024-04-19T03:02:40.996 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:40.996 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.996 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.996 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:40.996 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249530+0000", 2024-04-19T03:02:40.996 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9589000000000003e-05 2024-04-19T03:02:40.996 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.996 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.996 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:40.996 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249544+0000", 2024-04-19T03:02:40.996 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4158000000000001e-05 2024-04-19T03:02:40.996 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.996 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.996 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:40.997 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249549+0000", 2024-04-19T03:02:40.997 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6809999999999997e-06 2024-04-19T03:02:40.997 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.997 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.997 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:40.997 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249592+0000", 2024-04-19T03:02:40.997 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3285999999999999e-05 2024-04-19T03:02:40.997 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.997 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.997 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op must wait for map", 2024-04-19T03:02:40.997 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249598+0000", 2024-04-19T03:02:40.997 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8329999999999999e-06 2024-04-19T03:02:40.997 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.997 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.998 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:40.998 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263331+0000", 2024-04-19T03:02:40.998 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.013733093 2024-04-19T03:02:40.998 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.998 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.998 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:02:40.998 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263343+0000", 2024-04-19T03:02:40.998 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.189e-05 2024-04-19T03:02:40.998 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.998 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.998 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:40.998 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.268541+0000", 2024-04-19T03:02:40.998 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0051983440000001 2024-04-19T03:02:40.999 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.999 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.999 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:40.999 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.268640+0000", 2024-04-19T03:02:40.999 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.8387999999999994e-05 2024-04-19T03:02:40.999 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:40.999 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:40.999 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:40.999 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:40.999 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:40.999 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87132 5.c 5:3e18b732:::benchmark_data_smithi096_19531_object87131:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:02:40.999 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249558+0000", 2024-04-19T03:02:40.999 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 17.663824484999999, 2024-04-19T03:02:40.999 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0241198380000001, 2024-04-19T03:02:41.000 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:41.000 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-04-19T03:02:41.000 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:41.000 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:41.000 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:41.000 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87132 2024-04-19T03:02:41.000 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:41.000 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:41.000 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:41.000 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:41.000 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249558+0000", 2024-04-19T03:02:41.000 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:41.000 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:41.000 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:41.001 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:41.001 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249558+0000", 2024-04-19T03:02:41.001 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:41.001 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:41.001 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:41.001 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:41.001 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249557+0000", 2024-04-19T03:02:41.001 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:41.001 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:41.001 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:41.001 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:41.001 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249625+0000", 2024-04-19T03:02:41.001 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7200999999999996e-05 2024-04-19T03:02:41.001 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:41.001 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:41.002 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:41.002 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249646+0000", 2024-04-19T03:02:41.002 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1053e-05 2024-04-19T03:02:41.002 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:41.002 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:41.002 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:41.002 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249650+0000", 2024-04-19T03:02:41.002 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2719999999999999e-06 2024-04-19T03:02:41.002 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:41.002 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:41.002 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:41.002 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249686+0000", 2024-04-19T03:02:41.002 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6430000000000002e-05 2024-04-19T03:02:41.003 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:41.003 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:41.003 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op must wait for map", 2024-04-19T03:02:41.003 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249690+0000", 2024-04-19T03:02:41.003 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.765e-06 2024-04-19T03:02:41.003 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:41.003 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:41.003 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:41.003 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261157+0000", 2024-04-19T03:02:41.003 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011467247999999999 2024-04-19T03:02:41.003 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:41.003 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:41.003 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:02:41.003 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261170+0000", 2024-04-19T03:02:41.004 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2833000000000001e-05 2024-04-19T03:02:41.004 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:41.004 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:41.004 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:41.004 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.272119+0000", 2024-04-19T03:02:41.004 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.010949313 2024-04-19T03:02:41.004 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:41.004 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:41.004 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:41.004 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.273678+0000", 2024-04-19T03:02:41.004 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0015581550000000001 2024-04-19T03:02:41.004 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:41.004 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:41.004 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:41.004 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:41.005 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:41.005 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87133 5.c 5:3f772a62:::benchmark_data_smithi096_19531_object87132:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:02:41.005 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249657+0000", 2024-04-19T03:02:41.005 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 17.663725106000001, 2024-04-19T03:02:41.005 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0242819409999999, 2024-04-19T03:02:41.005 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:41.005 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-04-19T03:02:41.005 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:41.005 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:41.005 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:41.005 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87133 2024-04-19T03:02:41.005 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:41.005 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:41.005 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:41.006 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:41.006 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249657+0000", 2024-04-19T03:02:41.006 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:41.006 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:41.006 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:41.006 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:41.006 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249657+0000", 2024-04-19T03:02:41.006 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:41.006 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:41.006 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:41.006 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:41.006 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249657+0000", 2024-04-19T03:02:41.006 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:41.006 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:41.007 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:41.007 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:41.007 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249690+0000", 2024-04-19T03:02:41.007 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3343000000000002e-05 2024-04-19T03:02:41.007 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:41.007 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:41.007 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:41.007 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249695+0000", 2024-04-19T03:02:41.007 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8600000000000001e-06 2024-04-19T03:02:41.007 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:41.007 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:41.007 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:41.007 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249698+0000", 2024-04-19T03:02:41.007 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.1700000000000001e-06 2024-04-19T03:02:41.008 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:41.008 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:41.008 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:41.008 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249741+0000", 2024-04-19T03:02:41.008 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2849999999999998e-05 2024-04-19T03:02:41.008 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:41.008 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:41.008 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:02:41.008 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249746+0000", 2024-04-19T03:02:41.008 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1019999999999996e-06 2024-04-19T03:02:41.008 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:41.008 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:41.008 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:41.008 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261209+0000", 2024-04-19T03:02:41.008 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011462447000000001 2024-04-19T03:02:41.009 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:41.009 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:41.009 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:02:41.009 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261216+0000", 2024-04-19T03:02:41.009 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8520000000000004e-06 2024-04-19T03:02:41.009 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:41.009 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:41.009 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:41.009 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.273872+0000", 2024-04-19T03:02:41.009 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0126558000000001 2024-04-19T03:02:41.009 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:41.009 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:41.009 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:41.009 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.273939+0000", 2024-04-19T03:02:41.010 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6822000000000005e-05 2024-04-19T03:02:41.010 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:41.010 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:41.010 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:41.010 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:41.010 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:41.010 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87134 5.5 5:a56c478f:::benchmark_data_smithi096_19531_object87133:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:02:41.010 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249708+0000", 2024-04-19T03:02:41.010 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 17.663674182000001, 2024-04-19T03:02:41.010 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0214677299999999, 2024-04-19T03:02:41.010 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:41.010 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-04-19T03:02:41.010 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:41.010 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:41.011 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:41.011 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87134 2024-04-19T03:02:41.011 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:41.011 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:41.011 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:41.011 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:41.011 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249708+0000", 2024-04-19T03:02:41.011 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:41.011 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:41.011 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:41.011 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:41.011 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249708+0000", 2024-04-19T03:02:41.011 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:41.011 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:41.012 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:41.012 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:41.012 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249706+0000", 2024-04-19T03:02:41.012 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999976 2024-04-19T03:02:41.012 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:41.012 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:41.012 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:41.012 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249740+0000", 2024-04-19T03:02:41.012 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4458000000000001e-05 2024-04-19T03:02:41.012 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:41.012 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:41.012 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:41.012 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249745+0000", 2024-04-19T03:02:41.012 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5020000000000003e-06 2024-04-19T03:02:41.013 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:41.013 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:41.013 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:41.013 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249748+0000", 2024-04-19T03:02:41.013 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2499999999999998e-06 2024-04-19T03:02:41.013 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:41.013 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:41.013 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:41.013 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249778+0000", 2024-04-19T03:02:41.013 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.006e-05 2024-04-19T03:02:41.013 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:41.013 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:41.013 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op must wait for map", 2024-04-19T03:02:41.013 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249782+0000", 2024-04-19T03:02:41.014 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2910000000000001e-06 2024-04-19T03:02:41.014 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:41.014 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:41.014 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:41.014 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261666+0000", 2024-04-19T03:02:41.014 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011883471 2024-04-19T03:02:41.014 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:41.014 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:41.014 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:02:41.014 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261674+0000", 2024-04-19T03:02:41.014 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6479999999999992e-06 2024-04-19T03:02:41.014 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:41.014 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:41.014 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:41.015 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.269323+0000", 2024-04-19T03:02:41.015 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.00764867 2024-04-19T03:02:41.015 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:41.015 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:41.015 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:41.015 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.271176+0000", 2024-04-19T03:02:41.015 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001852844 2024-04-19T03:02:41.015 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:41.015 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:41.015 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:41.015 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:41.015 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:41.015 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87137 5.c 5:30708c68:::benchmark_data_smithi096_19531_object87136:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:02:41.015 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249756+0000", 2024-04-19T03:02:41.015 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 17.663626476000001, 2024-04-19T03:02:41.016 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.033331752, 2024-04-19T03:02:41.016 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:41.016 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:41.016 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:41.016 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:41.016 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:41.016 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87137 2024-04-19T03:02:41.016 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:41.016 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:41.016 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:41.016 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:41.016 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249756+0000", 2024-04-19T03:02:41.016 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:41.016 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:41.017 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:41.017 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:41.017 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249756+0000", 2024-04-19T03:02:41.017 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:41.017 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:41.017 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:41.017 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:41.017 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249755+0000", 2024-04-19T03:02:41.017 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:41.017 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:41.017 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:41.017 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:41.017 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249777+0000", 2024-04-19T03:02:41.017 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1420000000000002e-05 2024-04-19T03:02:41.018 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:41.018 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:41.018 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:41.018 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249781+0000", 2024-04-19T03:02:41.018 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0609999999999997e-06 2024-04-19T03:02:41.018 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:41.018 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:41.018 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:41.018 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249787+0000", 2024-04-19T03:02:41.018 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.02e-06 2024-04-19T03:02:41.018 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:41.018 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:41.018 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:41.018 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249818+0000", 2024-04-19T03:02:41.018 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0947e-05 2024-04-19T03:02:41.019 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:41.019 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:41.019 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:02:41.019 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249821+0000", 2024-04-19T03:02:41.019 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.117e-06 2024-04-19T03:02:41.019 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:41.019 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:41.019 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:41.019 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261243+0000", 2024-04-19T03:02:41.019 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011421875999999999 2024-04-19T03:02:41.019 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:41.019 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:41.019 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:02:41.019 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261251+0000", 2024-04-19T03:02:41.020 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6120000000000001e-06 2024-04-19T03:02:41.020 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:41.020 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:41.020 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:41.020 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.274050+0000", 2024-04-19T03:02:41.020 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.012799405 2024-04-19T03:02:41.020 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:41.020 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:41.020 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:41.020 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.274529+0000", 2024-04-19T03:02:41.020 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00047867100000000001 2024-04-19T03:02:41.020 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:41.020 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:41.020 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:41.020 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.282972+0000", 2024-04-19T03:02:41.021 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0084436900000000002 2024-04-19T03:02:41.021 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:41.021 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:41.021 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:41.021 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.283022+0000", 2024-04-19T03:02:41.021 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9339000000000003e-05 2024-04-19T03:02:41.021 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:41.021 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:41.021 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:41.021 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.283088+0000", 2024-04-19T03:02:41.021 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5877999999999995e-05 2024-04-19T03:02:41.021 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:41.021 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:41.021 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:41.022 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:41.022 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:41.022 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-04-19T03:02:41.022 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~12s 2024-04-19T03:02:41.023 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:41.019+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:41.024 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T03:02:41.124 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:41.121+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:41.149 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-19T03:02:41.149 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-04-19T03:02:41.149 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.149 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:116609 5.8 5:1d7b7afd:::benchmark_data_smithi096_19531_object3159:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-19T03:02:41.149 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:41.145664+0000", 2024-04-19T03:02:41.149 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0034994520000000001, 2024-04-19T03:02:41.149 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0035183250000000001, 2024-04-19T03:02:41.149 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:41.149 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-19T03:02:41.149 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:41.149 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:41.150 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:41.150 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 116609 2024-04-19T03:02:41.150 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.150 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:41.150 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.150 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:41.150 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:41.145664+0000", 2024-04-19T03:02:41.150 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:41.150 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.150 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.150 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:41.150 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:41.145664+0000", 2024-04-19T03:02:41.150 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:41.151 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.151 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.151 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:41.151 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:41.145664+0000", 2024-04-19T03:02:41.151 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:41.151 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.151 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.151 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:41.151 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:41.145672+0000", 2024-04-19T03:02:41.151 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3149999999999992e-06 2024-04-19T03:02:41.151 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.151 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.151 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:41.151 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:41.145682+0000", 2024-04-19T03:02:41.152 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0203999999999999e-05 2024-04-19T03:02:41.152 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.152 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.152 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:41.152 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:41.145689+0000", 2024-04-19T03:02:41.152 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.1890000000000001e-06 2024-04-19T03:02:41.152 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.152 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.152 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:41.152 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:41.146141+0000", 2024-04-19T03:02:41.152 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00045189200000000002 2024-04-19T03:02:41.152 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.152 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.152 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:41.153 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:41.146278+0000", 2024-04-19T03:02:41.153 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000136926 2024-04-19T03:02:41.153 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:41.153 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:41.153 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:41.153 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.153 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.153 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4755.0:116608 5.9 e50/22 5:9d08f996:::benchmark_data_smithi096_19531_object3158:head v 50'7159, mlcod=50'7157)", 2024-04-19T03:02:41.153 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:41.145982+0000", 2024-04-19T03:02:41.153 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.003182266, 2024-04-19T03:02:41.153 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0032421389999999998, 2024-04-19T03:02:41.153 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:41.153 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-19T03:02:41.153 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:41.153 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.154 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:41.154 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:41.145982+0000", 2024-04-19T03:02:41.154 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:41.154 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.154 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.154 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:41.154 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:41.145982+0000", 2024-04-19T03:02:41.154 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:41.154 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.154 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.154 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:41.154 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:41.145981+0000", 2024-04-19T03:02:41.154 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:41.155 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.155 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.155 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:41.155 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:41.145991+0000", 2024-04-19T03:02:41.155 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.8770000000000005e-06 2024-04-19T03:02:41.155 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.155 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.155 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:41.155 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:41.146000+0000", 2024-04-19T03:02:41.155 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.6999999999999997e-06 2024-04-19T03:02:41.155 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.155 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.155 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:41.155 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:41.146005+0000", 2024-04-19T03:02:41.155 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9649999999999996e-06 2024-04-19T03:02:41.156 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.156 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.156 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:41.156 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:41.146048+0000", 2024-04-19T03:02:41.156 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2354000000000001e-05 2024-04-19T03:02:41.156 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.156 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.156 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:41.156 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:41.146068+0000", 2024-04-19T03:02:41.156 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0000000000000002e-05 2024-04-19T03:02:41.156 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:41.156 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:41.156 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:41.156 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.157 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.157 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4755.0:116613 5.9 e50/22 5:90662314:::benchmark_data_smithi096_19531_object3163:head v 50'7160, mlcod=50'7157)", 2024-04-19T03:02:41.157 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:41.148324+0000", 2024-04-19T03:02:41.157 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.00083993900000000005, 2024-04-19T03:02:41.157 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00093053999999999999, 2024-04-19T03:02:41.157 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:41.157 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-19T03:02:41.157 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:41.157 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.157 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:41.157 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:41.148324+0000", 2024-04-19T03:02:41.157 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:41.157 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.157 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.158 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:41.158 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:41.148324+0000", 2024-04-19T03:02:41.158 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:41.158 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.158 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.158 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:41.158 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:41.148323+0000", 2024-04-19T03:02:41.158 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:41.158 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.158 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.158 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:41.158 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:41.148330+0000", 2024-04-19T03:02:41.158 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.114e-06 2024-04-19T03:02:41.158 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.159 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.159 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:41.159 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:41.148342+0000", 2024-04-19T03:02:41.159 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1575e-05 2024-04-19T03:02:41.159 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.159 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.159 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:41.159 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:41.148351+0000", 2024-04-19T03:02:41.159 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.251e-06 2024-04-19T03:02:41.159 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.159 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.159 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:41.159 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:41.148383+0000", 2024-04-19T03:02:41.159 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1532000000000002e-05 2024-04-19T03:02:41.159 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.160 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.160 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:41.160 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:41.148396+0000", 2024-04-19T03:02:41.160 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3033999999999999e-05 2024-04-19T03:02:41.160 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:41.160 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:41.160 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:41.160 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.160 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.160 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:116618 5.e 5:70dc9afb:::benchmark_data_smithi096_19531_object3168:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-19T03:02:41.160 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:41.148887+0000", 2024-04-19T03:02:41.160 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.00027683900000000002, 2024-04-19T03:02:41.160 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00039798200000000001, 2024-04-19T03:02:41.160 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:41.161 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-19T03:02:41.161 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:41.161 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:41.161 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:41.161 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 116618 2024-04-19T03:02:41.161 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.161 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:41.161 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.161 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:41.161 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:41.148887+0000", 2024-04-19T03:02:41.161 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:41.161 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.161 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.161 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:41.162 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:41.148887+0000", 2024-04-19T03:02:41.162 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:41.162 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.162 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.162 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:41.162 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:41.148886+0000", 2024-04-19T03:02:41.162 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:41.162 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.162 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.162 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:41.162 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:41.148891+0000", 2024-04-19T03:02:41.162 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5990000000000004e-06 2024-04-19T03:02:41.162 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.162 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.163 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:41.163 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:41.148900+0000", 2024-04-19T03:02:41.163 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.3810000000000005e-06 2024-04-19T03:02:41.163 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.163 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.163 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:41.163 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:41.148905+0000", 2024-04-19T03:02:41.163 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9490000000000004e-06 2024-04-19T03:02:41.163 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.163 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.163 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:41.163 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:41.148957+0000", 2024-04-19T03:02:41.163 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2026e-05 2024-04-19T03:02:41.163 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.164 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.164 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:41.164 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:41.149108+0000", 2024-04-19T03:02:41.164 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015040499999999999 2024-04-19T03:02:41.164 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:41.164 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:41.164 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:41.164 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:41.164 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-04-19T03:02:41.164 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 4 2024-04-19T03:02:41.164 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-19T03:02:41.165 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T03:02:41.224 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:41.223+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:41.290 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-19T03:02:41.291 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-04-19T03:02:41.291 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-04-19T03:02:41.291 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-04-19T03:02:41.291 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-19T03:02:41.306 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T03:02:41.352 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:41.351+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:41.426 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:41.425+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:41.429 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-19T03:02:41.429 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-04-19T03:02:41.429 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-04-19T03:02:41.430 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-04-19T03:02:41.430 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.430 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:79014 5.d 5:b5eee02c:::benchmark_data_smithi096_19531_object79013:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-19T03:02:41.430 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:18.032471+0000", 2024-04-19T03:02:41.430 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 23.394180167000002, 2024-04-19T03:02:41.430 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.041427629000000001, 2024-04-19T03:02:41.430 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:41.430 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:41.430 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:41.430 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:41.430 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:41.430 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 79014 2024-04-19T03:02:41.431 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.431 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:41.431 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.431 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:41.431 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:18.032471+0000", 2024-04-19T03:02:41.431 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:41.431 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.432 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.432 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:41.432 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:18.032471+0000", 2024-04-19T03:02:41.432 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:41.432 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.432 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.432 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:41.432 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:18.032470+0000", 2024-04-19T03:02:41.432 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:41.432 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.432 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.433 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:41.433 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:18.032525+0000", 2024-04-19T03:02:41.433 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5535999999999998e-05 2024-04-19T03:02:41.433 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.433 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.433 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:41.433 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:18.032537+0000", 2024-04-19T03:02:41.433 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1987999999999999e-05 2024-04-19T03:02:41.433 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.433 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.433 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:41.433 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:18.032546+0000", 2024-04-19T03:02:41.433 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9670000000000007e-06 2024-04-19T03:02:41.433 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.433 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.434 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:41.434 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:18.032613+0000", 2024-04-19T03:02:41.434 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6508999999999996e-05 2024-04-19T03:02:41.434 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.434 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.434 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:41.434 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:18.032738+0000", 2024-04-19T03:02:41.434 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000124912 2024-04-19T03:02:41.434 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.435 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.435 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-04-19T03:02:41.435 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:18.032867+0000", 2024-04-19T03:02:41.435 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012959399999999999 2024-04-19T03:02:41.435 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.435 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.435 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:41.435 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:18.035867+0000", 2024-04-19T03:02:41.435 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.002999378 2024-04-19T03:02:41.435 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.435 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.435 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:41.435 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:18.073705+0000", 2024-04-19T03:02:41.436 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.037838042000000002 2024-04-19T03:02:41.436 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.436 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.436 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:41.436 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:18.073813+0000", 2024-04-19T03:02:41.436 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010806099999999999 2024-04-19T03:02:41.436 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.436 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.436 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:41.436 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:18.073899+0000", 2024-04-19T03:02:41.436 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.5971999999999996e-05 2024-04-19T03:02:41.436 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:41.437 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:41.437 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:41.437 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.437 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.437 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:86615 5.e 5:7fef7288:::benchmark_data_smithi096_19531_object86614:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:41.437 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:22.634544+0000", 2024-04-19T03:02:41.437 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 18.792107187999999, 2024-04-19T03:02:41.438 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.192475071, 2024-04-19T03:02:41.438 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:41.438 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:41.438 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:41.438 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:41.438 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:41.438 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 86615 2024-04-19T03:02:41.438 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.438 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:41.438 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.438 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:41.438 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634544+0000", 2024-04-19T03:02:41.438 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:41.439 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.439 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.439 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:41.439 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634544+0000", 2024-04-19T03:02:41.439 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:41.439 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.439 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.439 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:41.439 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634542+0000", 2024-04-19T03:02:41.439 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999981 2024-04-19T03:02:41.439 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.439 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.439 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:41.439 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634585+0000", 2024-04-19T03:02:41.440 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2299000000000003e-05 2024-04-19T03:02:41.440 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.440 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.440 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:41.440 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634592+0000", 2024-04-19T03:02:41.440 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2350000000000002e-06 2024-04-19T03:02:41.440 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.440 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.440 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:41.440 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634596+0000", 2024-04-19T03:02:41.440 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5390000000000001e-06 2024-04-19T03:02:41.440 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.440 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.440 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:41.440 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634639+0000", 2024-04-19T03:02:41.441 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2444999999999998e-05 2024-04-19T03:02:41.441 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.441 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.441 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:41.441 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634808+0000", 2024-04-19T03:02:41.441 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000169152 2024-04-19T03:02:41.441 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.441 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.441 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:41.441 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634999+0000", 2024-04-19T03:02:41.441 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00019098300000000001 2024-04-19T03:02:41.441 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.441 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.441 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:41.442 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.640458+0000", 2024-04-19T03:02:41.442 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0054586870000000003 2024-04-19T03:02:41.442 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.442 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.442 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:41.442 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.826949+0000", 2024-04-19T03:02:41.442 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.18649178299999999 2024-04-19T03:02:41.442 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.442 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.442 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:41.443 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.826982+0000", 2024-04-19T03:02:41.443 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2477000000000001e-05 2024-04-19T03:02:41.443 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.443 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.443 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:41.443 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.827019+0000", 2024-04-19T03:02:41.443 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7355999999999999e-05 2024-04-19T03:02:41.443 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:41.443 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:41.443 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:41.443 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.443 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.443 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:86616 5.e 5:72278f47:::benchmark_data_smithi096_19531_object86615:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:41.443 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:22.634609+0000", 2024-04-19T03:02:41.444 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 18.792042039000002, 2024-04-19T03:02:41.444 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.19472088900000001, 2024-04-19T03:02:41.444 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:41.444 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:41.444 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:41.444 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:41.444 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:41.444 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 86616 2024-04-19T03:02:41.444 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.444 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:41.444 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.444 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:41.444 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634609+0000", 2024-04-19T03:02:41.444 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:41.445 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.445 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.445 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:41.445 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634609+0000", 2024-04-19T03:02:41.445 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:41.445 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.445 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.445 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:41.445 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634609+0000", 2024-04-19T03:02:41.445 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:41.445 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.445 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.445 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:41.446 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634651+0000", 2024-04-19T03:02:41.446 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2589000000000002e-05 2024-04-19T03:02:41.446 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.446 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.446 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:41.446 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634659+0000", 2024-04-19T03:02:41.446 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5850000000000002e-06 2024-04-19T03:02:41.446 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.446 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.446 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:41.447 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634662+0000", 2024-04-19T03:02:41.447 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3620000000000002e-06 2024-04-19T03:02:41.447 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.447 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.447 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:41.447 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.637880+0000", 2024-04-19T03:02:41.447 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.003218149 2024-04-19T03:02:41.447 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.447 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.447 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:41.447 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.637999+0000", 2024-04-19T03:02:41.447 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000118643 2024-04-19T03:02:41.447 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.447 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.448 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:41.448 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.638102+0000", 2024-04-19T03:02:41.448 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010331 2024-04-19T03:02:41.448 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.448 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.448 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:41.448 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.640851+0000", 2024-04-19T03:02:41.448 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0027483310000000001 2024-04-19T03:02:41.448 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.448 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.448 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:41.448 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.829269+0000", 2024-04-19T03:02:41.448 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.188418319 2024-04-19T03:02:41.448 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.449 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.449 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:41.449 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.829299+0000", 2024-04-19T03:02:41.449 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0227e-05 2024-04-19T03:02:41.449 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.449 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.449 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:41.449 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.829330+0000", 2024-04-19T03:02:41.449 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0969000000000001e-05 2024-04-19T03:02:41.449 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:41.449 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:41.449 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:41.449 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.449 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.450 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:86618 5.0 5:09014b90:::benchmark_data_smithi096_19531_object86617:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:41.450 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:22.634894+0000", 2024-04-19T03:02:41.450 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 18.791757551, 2024-04-19T03:02:41.450 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.19413419800000001, 2024-04-19T03:02:41.450 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:41.450 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:41.450 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:41.450 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:41.450 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:41.450 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 86618 2024-04-19T03:02:41.450 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.450 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:41.450 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.450 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:41.451 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634894+0000", 2024-04-19T03:02:41.451 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:41.451 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.451 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.451 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:41.451 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634894+0000", 2024-04-19T03:02:41.451 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:41.451 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.451 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.451 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:41.451 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634893+0000", 2024-04-19T03:02:41.451 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:41.451 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.451 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.452 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:41.452 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634976+0000", 2024-04-19T03:02:41.452 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3231000000000003e-05 2024-04-19T03:02:41.452 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.452 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.452 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:41.452 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634983+0000", 2024-04-19T03:02:41.452 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5169999999999996e-06 2024-04-19T03:02:41.452 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.452 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.452 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:41.452 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634987+0000", 2024-04-19T03:02:41.453 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.425e-06 2024-04-19T03:02:41.453 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.453 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.453 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:41.453 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635030+0000", 2024-04-19T03:02:41.453 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.32e-05 2024-04-19T03:02:41.453 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.453 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.453 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:41.453 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635185+0000", 2024-04-19T03:02:41.454 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015471899999999999 2024-04-19T03:02:41.454 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.454 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.454 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:41.454 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635415+0000", 2024-04-19T03:02:41.454 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00023026500000000001 2024-04-19T03:02:41.454 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.454 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.454 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:41.454 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.640127+0000", 2024-04-19T03:02:41.454 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0047118890000000004 2024-04-19T03:02:41.455 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.455 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.455 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:41.455 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.828895+0000", 2024-04-19T03:02:41.455 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.18876802600000001 2024-04-19T03:02:41.455 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.455 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.455 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:41.455 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.828972+0000", 2024-04-19T03:02:41.455 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.6345000000000002e-05 2024-04-19T03:02:41.455 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.455 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.455 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:41.456 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.829028+0000", 2024-04-19T03:02:41.456 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6342999999999999e-05 2024-04-19T03:02:41.456 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:41.456 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:41.456 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:41.456 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.456 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.456 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:86620 5.b 5:d80faa68:::benchmark_data_smithi096_19531_object86619:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:41.456 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:22.635110+0000", 2024-04-19T03:02:41.456 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 18.791540991000002, 2024-04-19T03:02:41.456 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.193447275, 2024-04-19T03:02:41.456 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:41.456 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:41.456 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:41.456 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:41.457 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:41.457 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 86620 2024-04-19T03:02:41.457 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.457 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:41.457 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.457 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:41.457 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635110+0000", 2024-04-19T03:02:41.457 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:41.457 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.457 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.457 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:41.457 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635110+0000", 2024-04-19T03:02:41.458 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:41.458 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.458 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.458 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:41.458 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635110+0000", 2024-04-19T03:02:41.458 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:41.458 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.458 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.458 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:41.458 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635154+0000", 2024-04-19T03:02:41.458 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4681000000000001e-05 2024-04-19T03:02:41.458 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.458 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.459 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:41.459 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635166+0000", 2024-04-19T03:02:41.459 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1505000000000001e-05 2024-04-19T03:02:41.459 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.459 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.459 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:41.459 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635171+0000", 2024-04-19T03:02:41.459 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6040000000000003e-06 2024-04-19T03:02:41.459 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.459 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.459 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:41.459 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635221+0000", 2024-04-19T03:02:41.459 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9947000000000001e-05 2024-04-19T03:02:41.459 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.460 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.460 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:41.460 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635356+0000", 2024-04-19T03:02:41.460 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013576199999999999 2024-04-19T03:02:41.460 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.460 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.460 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:41.460 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635507+0000", 2024-04-19T03:02:41.460 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015072999999999999 2024-04-19T03:02:41.460 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.460 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.460 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:41.460 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.638488+0000", 2024-04-19T03:02:41.460 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0029813159999999999 2024-04-19T03:02:41.461 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.461 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.461 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:41.461 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.828341+0000", 2024-04-19T03:02:41.461 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.189852254 2024-04-19T03:02:41.461 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.461 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.461 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:41.461 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.828416+0000", 2024-04-19T03:02:41.461 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5344000000000002e-05 2024-04-19T03:02:41.462 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.462 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.462 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:41.462 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.828558+0000", 2024-04-19T03:02:41.462 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000141695 2024-04-19T03:02:41.462 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:41.463 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:41.463 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:41.463 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.463 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.463 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:86621 5.8 5:1597a420:::benchmark_data_smithi096_19531_object86620:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:41.463 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:22.635187+0000", 2024-04-19T03:02:41.464 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 18.791464131000001, 2024-04-19T03:02:41.464 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.194204878, 2024-04-19T03:02:41.464 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:41.464 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:41.464 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:41.464 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:41.464 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:41.465 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 86621 2024-04-19T03:02:41.465 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.465 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:41.465 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.465 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:41.465 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635187+0000", 2024-04-19T03:02:41.465 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:41.465 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.465 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.465 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:41.465 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635187+0000", 2024-04-19T03:02:41.466 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:41.466 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.466 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.466 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:41.466 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635187+0000", 2024-04-19T03:02:41.466 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:41.466 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.466 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.466 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:41.466 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635242+0000", 2024-04-19T03:02:41.466 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5158000000000003e-05 2024-04-19T03:02:41.466 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.467 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.467 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:41.467 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635249+0000", 2024-04-19T03:02:41.467 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.7000000000000008e-06 2024-04-19T03:02:41.467 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.467 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.467 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:41.467 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635256+0000", 2024-04-19T03:02:41.467 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2060000000000004e-06 2024-04-19T03:02:41.467 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.467 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.467 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:41.467 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635302+0000", 2024-04-19T03:02:41.468 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5954000000000001e-05 2024-04-19T03:02:41.468 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.468 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.468 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:41.468 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635427+0000", 2024-04-19T03:02:41.468 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012559299999999999 2024-04-19T03:02:41.468 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.468 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.468 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:41.468 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635596+0000", 2024-04-19T03:02:41.468 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000168615 2024-04-19T03:02:41.469 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.469 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.469 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:41.469 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.639320+0000", 2024-04-19T03:02:41.469 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0037244610000000001 2024-04-19T03:02:41.469 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.469 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.469 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:41.469 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.829277+0000", 2024-04-19T03:02:41.469 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.18995651099999999 2024-04-19T03:02:41.469 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.469 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.469 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:41.469 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.829341+0000", 2024-04-19T03:02:41.470 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3756000000000004e-05 2024-04-19T03:02:41.470 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.470 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.470 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:41.470 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.829392+0000", 2024-04-19T03:02:41.470 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1555999999999999e-05 2024-04-19T03:02:41.470 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:41.470 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:41.470 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:41.470 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.470 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.470 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87062 5.4 5:2d3b5d9a:::benchmark_data_smithi096_19531_object87061:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:41.470 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.136820+0000", 2024-04-19T03:02:41.471 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 18.289830978000001, 2024-04-19T03:02:41.471 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.066483741999999998, 2024-04-19T03:02:41.471 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:41.471 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:41.471 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:41.471 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:41.471 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:41.471 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87062 2024-04-19T03:02:41.471 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.471 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:41.471 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.471 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:41.471 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.136820+0000", 2024-04-19T03:02:41.471 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:41.472 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.472 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.472 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:41.472 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.136820+0000", 2024-04-19T03:02:41.472 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:41.472 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.472 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.472 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:41.472 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.136819+0000", 2024-04-19T03:02:41.472 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:41.473 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.473 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.473 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:41.473 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.136864+0000", 2024-04-19T03:02:41.473 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4855000000000003e-05 2024-04-19T03:02:41.473 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.473 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.473 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:41.473 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.136881+0000", 2024-04-19T03:02:41.473 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7521999999999999e-05 2024-04-19T03:02:41.473 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.473 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.473 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:41.474 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.136890+0000", 2024-04-19T03:02:41.474 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1039999999999996e-06 2024-04-19T03:02:41.474 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.474 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.474 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:41.474 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.136974+0000", 2024-04-19T03:02:41.474 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3735999999999999e-05 2024-04-19T03:02:41.474 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.474 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.474 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:41.474 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.137308+0000", 2024-04-19T03:02:41.474 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00033376100000000002 2024-04-19T03:02:41.474 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.475 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.475 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:41.475 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.137559+0000", 2024-04-19T03:02:41.475 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000250599 2024-04-19T03:02:41.475 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.475 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.475 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:41.475 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.145423+0000", 2024-04-19T03:02:41.475 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0078649589999999995 2024-04-19T03:02:41.475 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.475 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.475 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:41.475 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.203175+0000", 2024-04-19T03:02:41.475 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057751255000000001 2024-04-19T03:02:41.475 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.476 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.476 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:41.476 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.203250+0000", 2024-04-19T03:02:41.476 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5378999999999998e-05 2024-04-19T03:02:41.476 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.476 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.476 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:41.476 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.203304+0000", 2024-04-19T03:02:41.476 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4015999999999999e-05 2024-04-19T03:02:41.476 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:41.476 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:41.476 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:41.477 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.477 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.477 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87065 5.4 5:21d20a47:::benchmark_data_smithi096_19531_object87064:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:41.477 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.137482+0000", 2024-04-19T03:02:41.477 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 18.289169244, 2024-04-19T03:02:41.477 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.065988749999999999, 2024-04-19T03:02:41.477 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:41.478 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:41.478 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:41.478 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:41.478 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:41.478 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87065 2024-04-19T03:02:41.478 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.479 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:41.479 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.479 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:41.479 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.137482+0000", 2024-04-19T03:02:41.479 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:41.479 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.479 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.479 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:41.479 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.137482+0000", 2024-04-19T03:02:41.479 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:41.479 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.479 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.480 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:41.480 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.137481+0000", 2024-04-19T03:02:41.480 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:41.480 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.480 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.480 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:41.480 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.137530+0000", 2024-04-19T03:02:41.480 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9302000000000003e-05 2024-04-19T03:02:41.480 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.480 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.480 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:41.480 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.137540+0000", 2024-04-19T03:02:41.480 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.2010000000000005e-06 2024-04-19T03:02:41.480 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.481 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.481 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:41.481 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.137545+0000", 2024-04-19T03:02:41.481 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5910000000000003e-06 2024-04-19T03:02:41.481 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.481 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.481 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:41.481 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.140666+0000", 2024-04-19T03:02:41.481 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0031212710000000001 2024-04-19T03:02:41.481 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.481 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.481 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:41.481 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.140847+0000", 2024-04-19T03:02:41.481 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00018065600000000001 2024-04-19T03:02:41.482 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.482 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.482 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:41.482 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.140991+0000", 2024-04-19T03:02:41.482 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014433100000000001 2024-04-19T03:02:41.482 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.482 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.482 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:41.482 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.148053+0000", 2024-04-19T03:02:41.482 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.007061945 2024-04-19T03:02:41.482 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.482 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.482 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:41.483 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.203367+0000", 2024-04-19T03:02:41.483 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.055313703999999998 2024-04-19T03:02:41.483 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.483 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.483 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:41.483 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.203426+0000", 2024-04-19T03:02:41.483 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9024000000000003e-05 2024-04-19T03:02:41.483 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.483 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.483 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:41.484 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.203471+0000", 2024-04-19T03:02:41.484 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4818999999999999e-05 2024-04-19T03:02:41.484 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:41.484 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:41.484 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:41.484 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.484 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.484 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87067 5.b 5:d57af71a:::benchmark_data_smithi096_19531_object87066:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:41.484 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.142233+0000", 2024-04-19T03:02:41.484 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 18.284418268, 2024-04-19T03:02:41.484 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.071692405000000001, 2024-04-19T03:02:41.484 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:41.484 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:41.485 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:41.485 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:41.485 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:41.485 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87067 2024-04-19T03:02:41.485 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.485 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:41.485 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.485 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:41.485 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142233+0000", 2024-04-19T03:02:41.485 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:41.485 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.485 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.485 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:41.486 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142233+0000", 2024-04-19T03:02:41.486 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:41.486 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.486 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.486 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:41.486 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142232+0000", 2024-04-19T03:02:41.486 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:41.486 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.486 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.486 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:41.486 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142277+0000", 2024-04-19T03:02:41.486 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5837000000000002e-05 2024-04-19T03:02:41.487 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.487 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.487 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:41.487 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142297+0000", 2024-04-19T03:02:41.487 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9561000000000001e-05 2024-04-19T03:02:41.487 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.487 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.487 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:41.487 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142311+0000", 2024-04-19T03:02:41.487 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3654e-05 2024-04-19T03:02:41.487 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.487 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.487 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:41.487 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142391+0000", 2024-04-19T03:02:41.488 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0123999999999994e-05 2024-04-19T03:02:41.488 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.488 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.488 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:41.488 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142669+0000", 2024-04-19T03:02:41.488 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00027829800000000001 2024-04-19T03:02:41.488 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.488 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.488 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:41.488 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142859+0000", 2024-04-19T03:02:41.488 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000190051 2024-04-19T03:02:41.488 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.489 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.489 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:41.489 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.150597+0000", 2024-04-19T03:02:41.489 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0077380299999999999 2024-04-19T03:02:41.489 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.489 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.489 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:41.489 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.213855+0000", 2024-04-19T03:02:41.489 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.063257987000000002 2024-04-19T03:02:41.489 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.489 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.489 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:41.490 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.213898+0000", 2024-04-19T03:02:41.490 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2916e-05 2024-04-19T03:02:41.490 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.490 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.490 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:41.490 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.213925+0000", 2024-04-19T03:02:41.490 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7503000000000001e-05 2024-04-19T03:02:41.490 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:41.490 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:41.490 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:41.490 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.490 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.490 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87069 5.b 5:da0c93b5:::benchmark_data_smithi096_19531_object87068:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:41.491 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.143402+0000", 2024-04-19T03:02:41.491 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 18.283249305999998, 2024-04-19T03:02:41.491 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.070678598999999995, 2024-04-19T03:02:41.491 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:41.491 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:41.491 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:41.491 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:41.491 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:41.491 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87069 2024-04-19T03:02:41.491 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.491 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:41.491 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.491 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:41.491 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.143402+0000", 2024-04-19T03:02:41.492 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:41.492 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.492 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.492 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:41.492 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.143402+0000", 2024-04-19T03:02:41.492 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:41.492 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.492 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.492 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:41.492 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.143401+0000", 2024-04-19T03:02:41.492 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:41.492 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.493 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.493 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:41.493 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.143501+0000", 2024-04-19T03:02:41.493 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000100387 2024-04-19T03:02:41.493 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.493 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.493 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:41.493 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.143516+0000", 2024-04-19T03:02:41.493 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5369000000000001e-05 2024-04-19T03:02:41.493 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.493 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.493 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:41.493 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.143524+0000", 2024-04-19T03:02:41.493 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.7079999999999997e-06 2024-04-19T03:02:41.494 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.494 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.494 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:41.494 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.145550+0000", 2024-04-19T03:02:41.494 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0020259290000000001 2024-04-19T03:02:41.494 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.494 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.494 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:41.494 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.145676+0000", 2024-04-19T03:02:41.494 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000126406 2024-04-19T03:02:41.494 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.494 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.494 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:41.495 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.145802+0000", 2024-04-19T03:02:41.495 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000125974 2024-04-19T03:02:41.495 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.495 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.495 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:41.495 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.151030+0000", 2024-04-19T03:02:41.495 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0052276079999999999 2024-04-19T03:02:41.495 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.495 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.495 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:41.496 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.213998+0000", 2024-04-19T03:02:41.496 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.06296786 2024-04-19T03:02:41.496 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.496 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.496 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:41.496 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.214031+0000", 2024-04-19T03:02:41.496 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3387999999999999e-05 2024-04-19T03:02:41.496 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.496 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.496 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:41.496 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.214081+0000", 2024-04-19T03:02:41.496 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9316e-05 2024-04-19T03:02:41.496 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:41.496 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:41.497 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:41.497 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.497 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.497 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87073 5.0 5:0ca21233:::benchmark_data_smithi096_19531_object87072:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:41.497 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.145929+0000", 2024-04-19T03:02:41.497 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 18.280722046000001, 2024-04-19T03:02:41.497 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.062283234999999999, 2024-04-19T03:02:41.497 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:41.497 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:41.497 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:41.497 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:41.497 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:41.497 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87073 2024-04-19T03:02:41.497 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.498 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:41.498 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.498 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:41.498 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.145929+0000", 2024-04-19T03:02:41.498 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:41.498 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.498 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.498 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:41.498 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.145929+0000", 2024-04-19T03:02:41.498 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:41.498 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.498 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.498 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:41.499 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.145928+0000", 2024-04-19T03:02:41.499 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:41.499 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.499 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.499 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:41.499 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.146063+0000", 2024-04-19T03:02:41.499 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013541099999999999 2024-04-19T03:02:41.499 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.499 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.499 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:41.499 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.146079+0000", 2024-04-19T03:02:41.499 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5902000000000001e-05 2024-04-19T03:02:41.499 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.500 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.500 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:41.500 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.146100+0000", 2024-04-19T03:02:41.500 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0380000000000001e-05 2024-04-19T03:02:41.500 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.500 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.500 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:41.500 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.146193+0000", 2024-04-19T03:02:41.500 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.3669000000000001e-05 2024-04-19T03:02:41.501 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.501 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.501 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:41.501 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.146388+0000", 2024-04-19T03:02:41.501 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00019457799999999999 2024-04-19T03:02:41.501 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.501 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.501 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:41.501 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.146625+0000", 2024-04-19T03:02:41.501 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00023751999999999999 2024-04-19T03:02:41.501 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.501 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.501 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:41.501 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.151051+0000", 2024-04-19T03:02:41.502 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0044260039999999999 2024-04-19T03:02:41.502 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.502 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.502 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:41.502 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.207872+0000", 2024-04-19T03:02:41.502 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.056821114999999998 2024-04-19T03:02:41.502 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.502 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.502 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:41.502 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.208085+0000", 2024-04-19T03:02:41.502 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000212893 2024-04-19T03:02:41.502 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.502 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.503 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:41.503 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.208213+0000", 2024-04-19T03:02:41.503 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012714700000000001 2024-04-19T03:02:41.503 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:41.503 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:41.503 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:41.503 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.503 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.503 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87074 5.0 5:035614ac:::benchmark_data_smithi096_19531_object87073:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:41.503 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.151387+0000", 2024-04-19T03:02:41.503 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 18.275264114999999, 2024-04-19T03:02:41.503 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.063461771, 2024-04-19T03:02:41.503 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:41.503 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:41.504 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:41.504 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:41.504 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:41.504 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87074 2024-04-19T03:02:41.504 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.504 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:41.504 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.504 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:41.504 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.151387+0000", 2024-04-19T03:02:41.504 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:41.504 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.504 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.504 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:41.504 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.151387+0000", 2024-04-19T03:02:41.505 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:41.505 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.505 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.505 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:41.505 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.151386+0000", 2024-04-19T03:02:41.505 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:41.505 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.505 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.505 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:41.505 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.151428+0000", 2024-04-19T03:02:41.505 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.172e-05 2024-04-19T03:02:41.505 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.505 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.506 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:41.506 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.151442+0000", 2024-04-19T03:02:41.506 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4328000000000001e-05 2024-04-19T03:02:41.506 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.506 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.506 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:41.506 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.151451+0000", 2024-04-19T03:02:41.506 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.8400000000000001e-06 2024-04-19T03:02:41.506 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.506 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.506 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:41.506 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.151521+0000", 2024-04-19T03:02:41.507 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.9606999999999999e-05 2024-04-19T03:02:41.507 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.507 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.507 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:41.507 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.151749+0000", 2024-04-19T03:02:41.507 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00022818799999999999 2024-04-19T03:02:41.507 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.507 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.507 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:41.507 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.152006+0000", 2024-04-19T03:02:41.507 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00025687300000000002 2024-04-19T03:02:41.507 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.507 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.507 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:41.508 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.154887+0000", 2024-04-19T03:02:41.508 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0028812989999999999 2024-04-19T03:02:41.508 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.508 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.508 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:41.508 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.214733+0000", 2024-04-19T03:02:41.508 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.059846159000000003 2024-04-19T03:02:41.508 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.508 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.508 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:41.508 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.214788+0000", 2024-04-19T03:02:41.508 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4524000000000002e-05 2024-04-19T03:02:41.508 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.508 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.508 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:41.509 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.214849+0000", 2024-04-19T03:02:41.509 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1362e-05 2024-04-19T03:02:41.509 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:41.509 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:41.509 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:41.509 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.509 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.509 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87108 5.e 5:7e197adc:::benchmark_data_smithi096_19531_object87107:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:41.509 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.223103+0000", 2024-04-19T03:02:41.509 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 18.203547968999999, 2024-04-19T03:02:41.509 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.044946887, 2024-04-19T03:02:41.509 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:41.509 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-19T03:02:41.509 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:41.510 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:41.510 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:41.510 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87108 2024-04-19T03:02:41.510 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.510 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:41.510 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.510 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:41.510 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.223103+0000", 2024-04-19T03:02:41.510 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:41.510 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.510 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.510 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:41.511 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.223103+0000", 2024-04-19T03:02:41.511 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:41.511 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.511 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.511 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:41.511 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.223102+0000", 2024-04-19T03:02:41.511 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:41.511 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.511 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.511 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:41.511 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.223156+0000", 2024-04-19T03:02:41.511 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3958000000000001e-05 2024-04-19T03:02:41.511 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.511 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.511 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:41.512 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.223166+0000", 2024-04-19T03:02:41.512 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.4809999999999995e-06 2024-04-19T03:02:41.512 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.512 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.512 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:41.512 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.223172+0000", 2024-04-19T03:02:41.512 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0140000000000004e-06 2024-04-19T03:02:41.512 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.512 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.512 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:41.512 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.227295+0000", 2024-04-19T03:02:41.512 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0041233420000000003 2024-04-19T03:02:41.512 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.512 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.513 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:41.513 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.227495+0000", 2024-04-19T03:02:41.513 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00019955299999999999 2024-04-19T03:02:41.513 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.513 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.513 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:41.513 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.227717+0000", 2024-04-19T03:02:41.513 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000221902 2024-04-19T03:02:41.513 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.513 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.513 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:41.513 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233189+0000", 2024-04-19T03:02:41.513 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0054718889999999997 2024-04-19T03:02:41.513 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.514 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.514 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:41.514 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.250529+0000", 2024-04-19T03:02:41.514 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.017340298000000001 2024-04-19T03:02:41.514 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.514 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.514 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:02:41.514 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.250539+0000", 2024-04-19T03:02:41.514 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0501e-05 2024-04-19T03:02:41.514 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.514 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.514 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:41.514 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.268003+0000", 2024-04-19T03:02:41.515 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.017463429 2024-04-19T03:02:41.515 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.515 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.515 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:41.515 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.268050+0000", 2024-04-19T03:02:41.515 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7466000000000003e-05 2024-04-19T03:02:41.515 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:41.515 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:41.515 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:41.515 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.515 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.515 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87118 5.b 5:d1bb4f3c:::benchmark_data_smithi096_19531_object87117:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:41.515 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.231082+0000", 2024-04-19T03:02:41.516 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 18.195569135, 2024-04-19T03:02:41.516 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.035789004, 2024-04-19T03:02:41.516 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:41.516 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-19T03:02:41.516 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:41.516 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:41.516 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:41.516 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87118 2024-04-19T03:02:41.516 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.516 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:41.516 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.516 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:41.516 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231082+0000", 2024-04-19T03:02:41.516 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:41.516 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.517 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.517 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:41.517 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231082+0000", 2024-04-19T03:02:41.517 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:41.517 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.517 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.517 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:41.517 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231081+0000", 2024-04-19T03:02:41.517 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:41.517 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.517 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.518 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:41.518 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231159+0000", 2024-04-19T03:02:41.518 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.7819999999999997e-05 2024-04-19T03:02:41.518 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.518 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.518 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:41.518 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231186+0000", 2024-04-19T03:02:41.518 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7126000000000001e-05 2024-04-19T03:02:41.518 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.518 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.519 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:41.519 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231193+0000", 2024-04-19T03:02:41.519 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7259999999999996e-06 2024-04-19T03:02:41.521 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.521 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.521 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:41.522 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231241+0000", 2024-04-19T03:02:41.522 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8123e-05 2024-04-19T03:02:41.522 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.522 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.522 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:41.522 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231354+0000", 2024-04-19T03:02:41.522 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0001133 2024-04-19T03:02:41.522 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.522 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.522 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:41.523 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231443+0000", 2024-04-19T03:02:41.523 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9167999999999997e-05 2024-04-19T03:02:41.523 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.523 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.523 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:41.523 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236498+0000", 2024-04-19T03:02:41.523 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0050545160000000002 2024-04-19T03:02:41.523 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.523 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.523 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:41.523 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.249681+0000", 2024-04-19T03:02:41.523 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013183321 2024-04-19T03:02:41.523 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.523 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.524 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:02:41.524 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.249693+0000", 2024-04-19T03:02:41.524 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1834999999999999e-05 2024-04-19T03:02:41.524 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.524 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.524 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:41.524 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266733+0000", 2024-04-19T03:02:41.524 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.017040408 2024-04-19T03:02:41.524 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.524 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.524 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:41.524 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266871+0000", 2024-04-19T03:02:41.524 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000137849 2024-04-19T03:02:41.524 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:41.525 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:41.525 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:41.525 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.525 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.525 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87121 5.b 5:d01822b8:::benchmark_data_smithi096_19531_object87120:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:41.525 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.233319+0000", 2024-04-19T03:02:41.525 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 18.193332270999999, 2024-04-19T03:02:41.525 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.033624198, 2024-04-19T03:02:41.525 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:41.525 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-19T03:02:41.525 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:41.526 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:41.526 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:41.526 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87121 2024-04-19T03:02:41.526 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.526 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:41.526 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.526 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:41.526 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233319+0000", 2024-04-19T03:02:41.527 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:41.527 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.527 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.527 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:41.527 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233319+0000", 2024-04-19T03:02:41.527 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:41.527 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.527 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.527 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:41.527 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233319+0000", 2024-04-19T03:02:41.527 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:41.527 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.527 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.527 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:41.528 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233364+0000", 2024-04-19T03:02:41.528 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5460999999999997e-05 2024-04-19T03:02:41.528 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.528 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.528 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:41.528 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233382+0000", 2024-04-19T03:02:41.528 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8148e-05 2024-04-19T03:02:41.528 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.528 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.528 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:41.528 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233390+0000", 2024-04-19T03:02:41.528 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5340000000000002e-06 2024-04-19T03:02:41.528 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.528 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.529 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:41.529 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233712+0000", 2024-04-19T03:02:41.529 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00032260500000000001 2024-04-19T03:02:41.529 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.529 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.529 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:41.529 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233829+0000", 2024-04-19T03:02:41.529 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011638599999999999 2024-04-19T03:02:41.529 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.529 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.529 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:41.529 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233959+0000", 2024-04-19T03:02:41.529 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013013900000000001 2024-04-19T03:02:41.529 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.530 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.530 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:41.530 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236515+0000", 2024-04-19T03:02:41.530 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0025562750000000002 2024-04-19T03:02:41.530 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.530 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.530 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:41.530 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.249723+0000", 2024-04-19T03:02:41.530 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013208176 2024-04-19T03:02:41.530 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.530 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.530 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:02:41.530 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.249728+0000", 2024-04-19T03:02:41.531 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6519999999999997e-06 2024-04-19T03:02:41.531 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.531 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.531 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:41.531 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266837+0000", 2024-04-19T03:02:41.531 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0171087059999999 2024-04-19T03:02:41.531 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.531 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.531 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:41.531 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266943+0000", 2024-04-19T03:02:41.531 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000106604 2024-04-19T03:02:41.531 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:41.531 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:41.531 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:41.532 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.532 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.532 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87124 5.8 5:14819ad7:::benchmark_data_smithi096_19531_object87123:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:41.532 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.235886+0000", 2024-04-19T03:02:41.532 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 18.190764847000001, 2024-04-19T03:02:41.532 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0315451179999999, 2024-04-19T03:02:41.532 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:41.532 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-19T03:02:41.532 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:41.532 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:41.532 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:41.532 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87124 2024-04-19T03:02:41.532 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.532 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:41.533 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.533 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:41.533 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.235886+0000", 2024-04-19T03:02:41.533 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:41.533 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.533 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.533 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:41.533 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.235886+0000", 2024-04-19T03:02:41.533 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:41.533 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.533 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.533 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:41.533 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.235886+0000", 2024-04-19T03:02:41.533 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:41.534 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.534 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.534 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:41.534 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.235934+0000", 2024-04-19T03:02:41.534 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8384000000000003e-05 2024-04-19T03:02:41.534 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.534 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.534 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:41.534 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.235945+0000", 2024-04-19T03:02:41.534 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0671e-05 2024-04-19T03:02:41.534 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.534 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.534 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:41.535 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.235952+0000", 2024-04-19T03:02:41.535 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3089999999999998e-06 2024-04-19T03:02:41.535 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.535 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.535 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:41.535 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.237067+0000", 2024-04-19T03:02:41.535 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001115263 2024-04-19T03:02:41.535 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.535 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.535 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:41.535 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.237188+0000", 2024-04-19T03:02:41.535 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000121258 2024-04-19T03:02:41.535 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.535 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.536 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:41.536 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.237316+0000", 2024-04-19T03:02:41.536 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000128071 2024-04-19T03:02:41.536 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.536 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.536 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:41.536 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240744+0000", 2024-04-19T03:02:41.536 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0034275629999999998 2024-04-19T03:02:41.536 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.536 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.536 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:41.536 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.252517+0000", 2024-04-19T03:02:41.536 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011772991999999999 2024-04-19T03:02:41.536 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.537 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.537 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:02:41.537 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.252523+0000", 2024-04-19T03:02:41.537 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3640000000000004e-06 2024-04-19T03:02:41.537 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.537 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.537 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:41.537 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.267290+0000", 2024-04-19T03:02:41.537 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0147665690000001 2024-04-19T03:02:41.537 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.537 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.537 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:41.537 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.267432+0000", 2024-04-19T03:02:41.537 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014165299999999999 2024-04-19T03:02:41.538 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:41.538 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:41.538 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:41.538 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.538 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.538 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87129 5.0 5:02667e01:::benchmark_data_smithi096_19531_object87128:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:41.538 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.236466+0000", 2024-04-19T03:02:41.538 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 18.190184851000001, 2024-04-19T03:02:41.538 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0301534510000001, 2024-04-19T03:02:41.538 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:41.538 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-19T03:02:41.538 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:41.538 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:41.539 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:41.539 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87129 2024-04-19T03:02:41.539 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.539 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:41.539 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.539 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:41.539 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236466+0000", 2024-04-19T03:02:41.539 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:41.539 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.539 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.539 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:41.539 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236466+0000", 2024-04-19T03:02:41.539 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:41.539 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.540 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.540 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:41.540 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236465+0000", 2024-04-19T03:02:41.540 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:41.540 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.540 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.540 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:41.540 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236566+0000", 2024-04-19T03:02:41.540 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010047000000000001 2024-04-19T03:02:41.540 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.540 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.540 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:41.540 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236577+0000", 2024-04-19T03:02:41.540 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1772e-05 2024-04-19T03:02:41.541 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.541 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.541 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:41.541 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236584+0000", 2024-04-19T03:02:41.541 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0530000000000003e-06 2024-04-19T03:02:41.541 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.541 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.541 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:41.541 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.237023+0000", 2024-04-19T03:02:41.541 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000439703 2024-04-19T03:02:41.541 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.541 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.541 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:41.541 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.237207+0000", 2024-04-19T03:02:41.542 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000183692 2024-04-19T03:02:41.542 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.542 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.542 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:41.542 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.237373+0000", 2024-04-19T03:02:41.542 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016623500000000001 2024-04-19T03:02:41.542 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.542 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.542 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:41.542 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.241461+0000", 2024-04-19T03:02:41.542 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0040883050000000004 2024-04-19T03:02:41.542 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.542 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.542 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:41.543 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.252500+0000", 2024-04-19T03:02:41.543 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011038450999999999 2024-04-19T03:02:41.543 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.543 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.543 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:02:41.543 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.252507+0000", 2024-04-19T03:02:41.543 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2439999999999996e-06 2024-04-19T03:02:41.543 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.543 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.543 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:41.543 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266538+0000", 2024-04-19T03:02:41.543 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.014031184 2024-04-19T03:02:41.543 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.543 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.544 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:41.544 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266620+0000", 2024-04-19T03:02:41.544 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1600000000000005e-05 2024-04-19T03:02:41.544 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:41.544 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:41.544 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:41.544 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.544 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.544 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87135 5.4 5:2a97e7b7:::benchmark_data_smithi096_19531_object87134:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:41.544 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.240884+0000", 2024-04-19T03:02:41.544 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 18.185767393999999, 2024-04-19T03:02:41.544 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.025708931, 2024-04-19T03:02:41.544 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:41.544 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-19T03:02:41.545 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:41.545 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:41.545 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:41.545 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87135 2024-04-19T03:02:41.545 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.545 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:41.545 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.545 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:41.545 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240884+0000", 2024-04-19T03:02:41.545 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:41.545 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.545 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.545 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:41.545 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240884+0000", 2024-04-19T03:02:41.545 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:41.546 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.546 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.546 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:41.546 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240883+0000", 2024-04-19T03:02:41.546 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:41.546 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.546 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.546 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:41.546 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240933+0000", 2024-04-19T03:02:41.546 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9969999999999998e-05 2024-04-19T03:02:41.546 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.546 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.546 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:41.547 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240946+0000", 2024-04-19T03:02:41.547 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2943e-05 2024-04-19T03:02:41.547 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.547 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.547 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:41.547 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240952+0000", 2024-04-19T03:02:41.547 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8930000000000002e-06 2024-04-19T03:02:41.547 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.547 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.547 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:41.547 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240994+0000", 2024-04-19T03:02:41.547 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2753999999999998e-05 2024-04-19T03:02:41.547 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.547 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.547 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:41.548 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.241092+0000", 2024-04-19T03:02:41.548 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.7447000000000004e-05 2024-04-19T03:02:41.548 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.548 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.548 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:41.548 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.241183+0000", 2024-04-19T03:02:41.548 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1163999999999997e-05 2024-04-19T03:02:41.548 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.548 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.548 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:41.548 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.254672+0000", 2024-04-19T03:02:41.548 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.01348864 2024-04-19T03:02:41.548 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.548 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.549 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:02:41.549 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.254681+0000", 2024-04-19T03:02:41.549 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.3789999999999995e-06 2024-04-19T03:02:41.549 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.549 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.549 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:41.549 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266456+0000", 2024-04-19T03:02:41.549 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.011774621 2024-04-19T03:02:41.549 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.549 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.549 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:41.549 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266593+0000", 2024-04-19T03:02:41.549 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013737600000000001 2024-04-19T03:02:41.549 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:41.550 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:41.550 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:41.550 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.550 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.550 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87136 5.4 5:212411bc:::benchmark_data_smithi096_19531_object87135:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:41.550 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.240962+0000", 2024-04-19T03:02:41.550 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 18.185689518, 2024-04-19T03:02:41.550 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.025738, 2024-04-19T03:02:41.550 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:41.550 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-19T03:02:41.550 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:41.550 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:41.550 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:41.551 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87136 2024-04-19T03:02:41.551 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.551 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:41.551 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.551 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:41.551 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240962+0000", 2024-04-19T03:02:41.551 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:41.551 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.551 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.551 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:41.551 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240962+0000", 2024-04-19T03:02:41.551 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:41.551 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.551 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.552 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:41.552 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240961+0000", 2024-04-19T03:02:41.552 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:41.552 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.552 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.552 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:41.552 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240995+0000", 2024-04-19T03:02:41.552 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3868000000000002e-05 2024-04-19T03:02:41.552 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.552 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.552 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:41.552 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.241001+0000", 2024-04-19T03:02:41.552 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.322e-06 2024-04-19T03:02:41.552 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.553 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.553 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:41.553 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.241004+0000", 2024-04-19T03:02:41.553 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3510000000000002e-06 2024-04-19T03:02:41.553 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.553 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.553 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:41.553 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247131+0000", 2024-04-19T03:02:41.553 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0061270869999999998 2024-04-19T03:02:41.553 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.553 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.553 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:41.553 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247322+0000", 2024-04-19T03:02:41.553 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000191015 2024-04-19T03:02:41.554 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.554 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.554 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:41.554 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247542+0000", 2024-04-19T03:02:41.554 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00022030199999999999 2024-04-19T03:02:41.554 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.554 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.554 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:41.554 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.254709+0000", 2024-04-19T03:02:41.554 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0071662660000000001 2024-04-19T03:02:41.554 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.554 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.554 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:02:41.554 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.254716+0000", 2024-04-19T03:02:41.555 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3860000000000001e-06 2024-04-19T03:02:41.555 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.555 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.555 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:41.555 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266619+0000", 2024-04-19T03:02:41.555 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0119031030000001 2024-04-19T03:02:41.555 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.555 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.555 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:41.555 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266700+0000", 2024-04-19T03:02:41.555 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0764000000000001e-05 2024-04-19T03:02:41.555 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:41.555 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:41.555 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:41.556 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.556 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.556 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87138 5.e 5:7b1f1c20:::benchmark_data_smithi096_19531_object87137:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:41.556 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.247862+0000", 2024-04-19T03:02:41.556 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 18.178789444, 2024-04-19T03:02:41.556 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.024457079, 2024-04-19T03:02:41.556 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:41.556 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:41.556 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:41.556 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:41.556 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:41.556 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87138 2024-04-19T03:02:41.556 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.556 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:41.557 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.557 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:41.557 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247862+0000", 2024-04-19T03:02:41.557 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:41.557 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.557 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.557 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:41.557 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247862+0000", 2024-04-19T03:02:41.557 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:41.557 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.557 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.557 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:41.557 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247860+0000", 2024-04-19T03:02:41.557 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999981 2024-04-19T03:02:41.557 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.558 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.558 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:41.558 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247909+0000", 2024-04-19T03:02:41.558 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9150999999999997e-05 2024-04-19T03:02:41.558 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.558 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.558 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:41.558 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247925+0000", 2024-04-19T03:02:41.558 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5761999999999999e-05 2024-04-19T03:02:41.558 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.558 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.558 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:41.558 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247936+0000", 2024-04-19T03:02:41.559 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1144e-05 2024-04-19T03:02:41.559 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.559 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.559 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:41.559 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.250590+0000", 2024-04-19T03:02:41.559 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.002653678 2024-04-19T03:02:41.559 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.559 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.559 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:02:41.559 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.250599+0000", 2024-04-19T03:02:41.559 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9039999999999998e-06 2024-04-19T03:02:41.559 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.559 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.559 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:41.560 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.268151+0000", 2024-04-19T03:02:41.560 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0175523449999999 2024-04-19T03:02:41.560 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.560 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.560 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:41.560 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.268285+0000", 2024-04-19T03:02:41.560 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013415599999999999 2024-04-19T03:02:41.560 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.560 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.560 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:41.560 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.272238+0000", 2024-04-19T03:02:41.560 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0039533019999999997 2024-04-19T03:02:41.560 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.560 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.560 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:41.561 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.272274+0000", 2024-04-19T03:02:41.561 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5352000000000003e-05 2024-04-19T03:02:41.561 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:41.561 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:41.561 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:41.561 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.272319+0000", 2024-04-19T03:02:41.561 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5281999999999998e-05 2024-04-19T03:02:41.561 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:41.561 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:41.561 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:41.561 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:41.561 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:41.561 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-19T03:02:41.562 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-19T03:02:41.563 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:41.561+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:41.564 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T03:02:41.664 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:41.663+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:41.693 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-04-19T03:02:41.693 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [ 2024-04-19T03:02:41.693 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:41.693 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:117955 5.2 5:4b51222f:::benchmark_data_smithi096_19531_object4505:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-19T03:02:41.693 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:41.683084+0000", 2024-04-19T03:02:41.693 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0087893169999999996, 2024-04-19T03:02:41.693 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0088080769999999992, 2024-04-19T03:02:41.693 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:41.693 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-04-19T03:02:41.693 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:41.693 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:41.693 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:41.694 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 117955 2024-04-19T03:02:41.694 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:41.694 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:41.694 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:41.694 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:41.694 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:41.683084+0000", 2024-04-19T03:02:41.694 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:41.694 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:41.694 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:41.694 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:41.694 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:41.683084+0000", 2024-04-19T03:02:41.694 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:41.694 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:41.694 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:41.695 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:41.695 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:41.683084+0000", 2024-04-19T03:02:41.695 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:41.695 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:41.695 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:41.695 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:41.695 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:41.683087+0000", 2024-04-19T03:02:41.695 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.65e-06 2024-04-19T03:02:41.695 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:41.695 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:41.695 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:41.695 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:41.683091+0000", 2024-04-19T03:02:41.695 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1339999999999997e-06 2024-04-19T03:02:41.695 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:41.696 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:41.696 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:41.696 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:41.683094+0000", 2024-04-19T03:02:41.696 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6009999999999999e-06 2024-04-19T03:02:41.696 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:41.696 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:41.696 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:41.696 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:41.685223+0000", 2024-04-19T03:02:41.696 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0021287739999999999 2024-04-19T03:02:41.696 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:41.696 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:41.696 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:41.696 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:41.685308+0000", 2024-04-19T03:02:41.696 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.5048000000000003e-05 2024-04-19T03:02:41.697 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:41.697 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:41.697 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:41.697 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:41.697 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:41.697 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:117958 5.2 5:447c0119:::benchmark_data_smithi096_19531_object4508:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-19T03:02:41.697 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:41.683749+0000", 2024-04-19T03:02:41.697 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0081251499999999994, 2024-04-19T03:02:41.697 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0081872200000000003, 2024-04-19T03:02:41.697 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:41.697 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-04-19T03:02:41.697 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:41.697 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:41.697 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:41.698 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 117958 2024-04-19T03:02:41.698 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:41.698 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:41.698 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:41.698 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:41.698 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:41.683749+0000", 2024-04-19T03:02:41.698 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:41.698 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:41.698 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:41.698 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:41.698 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:41.683749+0000", 2024-04-19T03:02:41.698 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:41.698 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:41.698 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:41.699 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:41.699 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:41.683748+0000", 2024-04-19T03:02:41.699 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:41.699 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:41.699 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:41.699 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:41.699 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:41.683753+0000", 2024-04-19T03:02:41.699 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.006e-06 2024-04-19T03:02:41.699 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:41.699 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:41.699 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:41.699 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:41.683770+0000", 2024-04-19T03:02:41.699 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6765e-05 2024-04-19T03:02:41.699 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:41.700 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:41.700 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:41.700 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:41.683781+0000", 2024-04-19T03:02:41.700 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1155000000000001e-05 2024-04-19T03:02:41.700 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:41.700 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:41.700 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:41.700 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:41.686885+0000", 2024-04-19T03:02:41.700 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0031043300000000002 2024-04-19T03:02:41.700 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:41.700 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:41.700 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:41.700 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:41.687025+0000", 2024-04-19T03:02:41.700 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00014039900000000001 2024-04-19T03:02:41.701 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:41.701 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:41.701 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:41.701 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:41.701 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:41.701 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:117961 5.2 5:4147576a:::benchmark_data_smithi096_19531_object4511:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-19T03:02:41.701 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:41.685360+0000", 2024-04-19T03:02:41.701 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0065133420000000001, 2024-04-19T03:02:41.701 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0066105590000000002, 2024-04-19T03:02:41.701 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:41.701 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-04-19T03:02:41.701 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:41.701 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:41.701 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:41.701 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 117961 2024-04-19T03:02:41.702 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:41.702 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:41.702 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:41.702 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:41.702 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:41.685360+0000", 2024-04-19T03:02:41.702 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:41.702 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:41.702 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:41.702 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:41.702 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:41.685360+0000", 2024-04-19T03:02:41.702 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:41.702 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:41.702 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:41.702 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:41.703 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:41.685359+0000", 2024-04-19T03:02:41.703 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:41.703 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:41.703 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:41.704 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:41.704 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:41.685365+0000", 2024-04-19T03:02:41.704 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7389999999999996e-06 2024-04-19T03:02:41.704 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:41.704 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:41.704 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:41.704 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:41.685381+0000", 2024-04-19T03:02:41.704 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6262000000000001e-05 2024-04-19T03:02:41.704 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:41.704 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:41.704 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:41.704 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:41.685389+0000", 2024-04-19T03:02:41.704 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.1250000000000004e-06 2024-04-19T03:02:41.704 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:41.705 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:41.705 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:41.705 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:41.688735+0000", 2024-04-19T03:02:41.705 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0033462119999999999 2024-04-19T03:02:41.705 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:41.705 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:41.705 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:41.705 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:41.688897+0000", 2024-04-19T03:02:41.705 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00016237700000000001 2024-04-19T03:02:41.705 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:41.705 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:41.705 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:41.705 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:41.705 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:41.706 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:117965 5.f 5:f3836d19:::benchmark_data_smithi096_19531_object4515:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-19T03:02:41.706 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:41.686174+0000", 2024-04-19T03:02:41.706 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0056996429999999999, 2024-04-19T03:02:41.706 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.005830076, 2024-04-19T03:02:41.706 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:41.706 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:02:41.706 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:41.706 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:41.706 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:41.706 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 117965 2024-04-19T03:02:41.706 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:41.706 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:41.706 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:41.706 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:41.707 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:41.686174+0000", 2024-04-19T03:02:41.707 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:41.707 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:41.707 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:41.707 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:41.707 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:41.686174+0000", 2024-04-19T03:02:41.707 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:41.707 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:41.707 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:41.707 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:41.707 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:41.686173+0000", 2024-04-19T03:02:41.707 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:41.707 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:41.707 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:41.708 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:41.708 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:41.686177+0000", 2024-04-19T03:02:41.708 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.1669999999999999e-06 2024-04-19T03:02:41.708 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:41.708 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:41.708 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:41.708 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:41.686183+0000", 2024-04-19T03:02:41.708 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0800000000000002e-06 2024-04-19T03:02:41.708 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:41.708 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:41.708 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:41.708 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:41.686188+0000", 2024-04-19T03:02:41.708 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1440000000000002e-06 2024-04-19T03:02:41.708 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:41.709 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:41.709 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:41.709 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:41.688183+0000", 2024-04-19T03:02:41.709 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001995447 2024-04-19T03:02:41.709 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:41.709 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:41.709 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:41.709 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:41.688326+0000", 2024-04-19T03:02:41.709 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000143163 2024-04-19T03:02:41.709 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:41.709 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:41.709 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:02:41.709 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:41.688398+0000", 2024-04-19T03:02:41.709 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.1242000000000007e-05 2024-04-19T03:02:41.710 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:41.710 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:41.710 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:41.710 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:41.690606+0000", 2024-04-19T03:02:41.710 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.002208701 2024-04-19T03:02:41.710 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:41.710 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:41.710 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:41.710 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:41.710 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:41.710 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:117966 5.6 5:64f816cc:::benchmark_data_smithi096_19531_object4516:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-19T03:02:41.710 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:41.688505+0000", 2024-04-19T03:02:41.710 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0033682680000000002, 2024-04-19T03:02:41.711 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0035387819999999999, 2024-04-19T03:02:41.711 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:41.711 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-04-19T03:02:41.711 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:41.711 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:41.711 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:41.711 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 117966 2024-04-19T03:02:41.711 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:41.711 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:41.711 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:41.711 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:41.711 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:41.688505+0000", 2024-04-19T03:02:41.711 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:41.711 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:41.712 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:41.712 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:41.712 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:41.688505+0000", 2024-04-19T03:02:41.712 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:41.712 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:41.712 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:41.712 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:41.712 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:41.688504+0000", 2024-04-19T03:02:41.712 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:41.712 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:41.712 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:41.712 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:41.712 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:41.688511+0000", 2024-04-19T03:02:41.712 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0730000000000001e-06 2024-04-19T03:02:41.713 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:41.713 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:41.713 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:41.713 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:41.688519+0000", 2024-04-19T03:02:41.713 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.011e-06 2024-04-19T03:02:41.713 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:41.713 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:41.713 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:41.713 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:41.688524+0000", 2024-04-19T03:02:41.713 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6420000000000004e-06 2024-04-19T03:02:41.713 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:41.713 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:41.713 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:41.713 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:41.688572+0000", 2024-04-19T03:02:41.714 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7386000000000003e-05 2024-04-19T03:02:41.714 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:41.714 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:41.714 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:41.714 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:41.688712+0000", 2024-04-19T03:02:41.714 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000140607 2024-04-19T03:02:41.714 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:41.714 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:41.714 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:41.714 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:41.714 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:41.714 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:117968 5.1 5:8b535a5f:::benchmark_data_smithi096_19531_object4518:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-19T03:02:41.714 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:41.688833+0000", 2024-04-19T03:02:41.714 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0030403029999999998, 2024-04-19T03:02:41.715 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0032432060000000002, 2024-04-19T03:02:41.715 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:41.715 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-04-19T03:02:41.715 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:41.715 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:41.715 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:41.715 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 117968 2024-04-19T03:02:41.715 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:41.715 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:41.715 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:41.715 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:41.715 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:41.688833+0000", 2024-04-19T03:02:41.715 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:41.715 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:41.716 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:41.716 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:41.716 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:41.688833+0000", 2024-04-19T03:02:41.716 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:41.716 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:41.716 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:41.716 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:41.716 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:41.688833+0000", 2024-04-19T03:02:41.716 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:41.716 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:41.716 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:41.716 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:41.716 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:41.688836+0000", 2024-04-19T03:02:41.716 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4640000000000002e-06 2024-04-19T03:02:41.716 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:41.717 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:41.717 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:41.717 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:41.688848+0000", 2024-04-19T03:02:41.717 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2041999999999999e-05 2024-04-19T03:02:41.717 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:41.717 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:41.717 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:41.717 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:41.688852+0000", 2024-04-19T03:02:41.717 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.89e-06 2024-04-19T03:02:41.717 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:41.717 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:41.717 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:41.717 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:41.688896+0000", 2024-04-19T03:02:41.717 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3643000000000002e-05 2024-04-19T03:02:41.718 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:41.718 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:41.718 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:41.718 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:41.688969+0000", 2024-04-19T03:02:41.718 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2984000000000005e-05 2024-04-19T03:02:41.718 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:41.718 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:41.718 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:41.718 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:41.718 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:41.718 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:117969 5.2 5:47ff485f:::benchmark_data_smithi096_19531_object4519:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-19T03:02:41.718 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:41.688861+0000", 2024-04-19T03:02:41.718 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0030128009999999998, 2024-04-19T03:02:41.718 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0032480579999999998, 2024-04-19T03:02:41.719 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:41.719 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-04-19T03:02:41.719 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:41.719 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:41.719 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:41.719 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 117969 2024-04-19T03:02:41.719 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:41.719 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:41.719 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:41.719 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:41.719 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:41.688861+0000", 2024-04-19T03:02:41.719 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:41.719 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:41.719 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:41.720 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:41.720 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:41.688861+0000", 2024-04-19T03:02:41.720 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:41.720 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:41.720 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:41.720 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:41.720 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:41.688860+0000", 2024-04-19T03:02:41.720 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:41.720 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:41.720 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:41.720 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:41.720 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:41.688863+0000", 2024-04-19T03:02:41.720 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9450000000000002e-06 2024-04-19T03:02:41.720 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:41.720 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:41.721 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:41.721 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:41.688871+0000", 2024-04-19T03:02:41.721 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.328e-06 2024-04-19T03:02:41.721 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:41.721 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:41.721 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:41.721 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:41.688876+0000", 2024-04-19T03:02:41.721 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2449999999999998e-06 2024-04-19T03:02:41.721 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:41.721 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:41.721 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:41.721 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:41.690532+0000", 2024-04-19T03:02:41.721 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0016560360000000001 2024-04-19T03:02:41.721 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:41.722 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:41.722 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:41.722 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:41.690663+0000", 2024-04-19T03:02:41.722 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000131347 2024-04-19T03:02:41.722 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:41.722 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:41.722 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:41.722 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:41.722 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:41.722 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:117971 5.9 5:9aa852b6:::benchmark_data_smithi096_19531_object4521:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-19T03:02:41.725 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:41.690118+0000", 2024-04-19T03:02:41.725 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.001755419, 2024-04-19T03:02:41.725 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0020435050000000001, 2024-04-19T03:02:41.725 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:41.725 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:02:41.726 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:41.726 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:41.726 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:41.726 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 117971 2024-04-19T03:02:41.726 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:41.726 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:41.726 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:41.726 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:41.726 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:41.690118+0000", 2024-04-19T03:02:41.726 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:41.726 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:41.726 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:41.727 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:41.727 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:41.690118+0000", 2024-04-19T03:02:41.727 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:41.727 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:41.727 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:41.727 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:41.727 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:41.690117+0000", 2024-04-19T03:02:41.727 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:41.727 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:41.727 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:41.727 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:41.727 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:41.690123+0000", 2024-04-19T03:02:41.727 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.942e-06 2024-04-19T03:02:41.727 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:41.728 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:41.728 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:41.728 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:41.690133+0000", 2024-04-19T03:02:41.728 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.5389999999999996e-06 2024-04-19T03:02:41.728 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:41.728 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:41.728 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:41.728 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:41.690140+0000", 2024-04-19T03:02:41.728 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0140000000000001e-06 2024-04-19T03:02:41.728 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:41.728 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:41.728 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:41.728 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:41.690206+0000", 2024-04-19T03:02:41.729 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6104000000000003e-05 2024-04-19T03:02:41.729 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:41.729 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:41.729 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:41.729 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:41.690396+0000", 2024-04-19T03:02:41.729 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00019025300000000001 2024-04-19T03:02:41.729 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:41.729 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:41.729 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:02:41.729 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:41.690525+0000", 2024-04-19T03:02:41.729 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00012898299999999999 2024-04-19T03:02:41.729 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:41.729 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:41.729 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:41.730 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:41.730 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:41.730 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:117972 5.c 5:35c03c37:::benchmark_data_smithi096_19531_object4522:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-19T03:02:41.730 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:41.690151+0000", 2024-04-19T03:02:41.730 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0017229669999999999, 2024-04-19T03:02:41.730 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0020626070000000002, 2024-04-19T03:02:41.730 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:41.730 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-04-19T03:02:41.730 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:41.730 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:41.730 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:41.730 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 117972 2024-04-19T03:02:41.730 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:41.731 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:41.731 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:41.731 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:41.731 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:41.690151+0000", 2024-04-19T03:02:41.731 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:41.731 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:41.731 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:41.731 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:41.731 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:41.690151+0000", 2024-04-19T03:02:41.731 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:41.731 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:41.731 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:41.731 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:41.731 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:41.690150+0000", 2024-04-19T03:02:41.732 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:41.732 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:41.732 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:41.732 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:41.732 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:41.690153+0000", 2024-04-19T03:02:41.732 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.757e-06 2024-04-19T03:02:41.732 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:41.732 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:41.732 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:41.732 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:41.690171+0000", 2024-04-19T03:02:41.732 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7771e-05 2024-04-19T03:02:41.732 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:41.732 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:41.732 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:41.733 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:41.690176+0000", 2024-04-19T03:02:41.733 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5720000000000002e-06 2024-04-19T03:02:41.733 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:41.733 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:41.733 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:41.733 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:41.690245+0000", 2024-04-19T03:02:41.733 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8565999999999994e-05 2024-04-19T03:02:41.733 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:41.733 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:41.733 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:41.733 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:41.690400+0000", 2024-04-19T03:02:41.733 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00015496800000000001 2024-04-19T03:02:41.733 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:41.733 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:41.734 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:41.734 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:41.734 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:41.734 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:117975 5.9 5.7454ffe9 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e50)", 2024-04-19T03:02:41.734 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:41.691718+0000", 2024-04-19T03:02:41.734 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.000156045, 2024-04-19T03:02:41.734 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00052809700000000005, 2024-04-19T03:02:41.734 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:41.734 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-04-19T03:02:41.734 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:41.734 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:41.734 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:41.734 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 117975 2024-04-19T03:02:41.734 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:41.735 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:41.735 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:41.735 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:41.735 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:41.691718+0000", 2024-04-19T03:02:41.735 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:41.735 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:41.735 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:41.735 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:41.735 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:41.691718+0000", 2024-04-19T03:02:41.735 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:41.735 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:41.735 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:41.735 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:41.735 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:41.691716+0000", 2024-04-19T03:02:41.736 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:41.736 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:41.736 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:41.736 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:41.736 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:41.691723+0000", 2024-04-19T03:02:41.736 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.032e-06 2024-04-19T03:02:41.736 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:41.736 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:41.736 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:41.736 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:41.691736+0000", 2024-04-19T03:02:41.736 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3823e-05 2024-04-19T03:02:41.736 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:41.736 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:41.736 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:41.736 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:41.691744+0000", 2024-04-19T03:02:41.737 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.588e-06 2024-04-19T03:02:41.737 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:41.737 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:41.737 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:41.737 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:41.737 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-04-19T03:02:41.737 INFO:teuthology.orchestra.run.smithi144.stdout: "num_ops": 10 2024-04-19T03:02:41.737 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-04-19T03:02:41.738 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T03:02:41.765 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:41.763+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:41.866 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:41.865+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:41.867 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-04-19T03:02:41.867 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2024-04-19T03:02:41.867 INFO:teuthology.orchestra.run.smithi144.stdout: "complaint_time": 30, 2024-04-19T03:02:41.867 INFO:teuthology.orchestra.run.smithi144.stdout: "num_blocked_ops": 0 2024-04-19T03:02:41.867 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-04-19T03:02:41.880 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T03:02:41.963 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-19T03:02:41.967 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:41.963+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:42.011 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-04-19T03:02:42.011 INFO:teuthology.orchestra.run.smithi144.stdout: "size": 20, 2024-04-19T03:02:42.011 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 600, 2024-04-19T03:02:42.011 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [ 2024-04-19T03:02:42.012 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.012 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:78992 5.7 5:e6baa862:::benchmark_data_smithi096_19531_object78991:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-19T03:02:42.012 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:18.008888+0000", 2024-04-19T03:02:42.012 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 24.000025078, 2024-04-19T03:02:42.012 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.056375285999999997, 2024-04-19T03:02:42.012 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:42.012 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:42.012 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:42.012 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:42.012 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:42.012 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 78992 2024-04-19T03:02:42.012 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.012 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:42.012 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.013 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:42.013 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.008888+0000", 2024-04-19T03:02:42.013 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:42.013 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.013 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.013 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:42.013 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.008888+0000", 2024-04-19T03:02:42.013 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:42.013 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.013 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.013 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:42.013 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.008888+0000", 2024-04-19T03:02:42.013 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:42.013 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.014 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.014 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:42.014 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.008928+0000", 2024-04-19T03:02:42.014 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0361999999999997e-05 2024-04-19T03:02:42.014 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.014 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.014 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:42.014 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.008942+0000", 2024-04-19T03:02:42.014 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4365000000000001e-05 2024-04-19T03:02:42.014 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.014 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.014 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:42.015 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.008949+0000", 2024-04-19T03:02:42.015 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.212e-06 2024-04-19T03:02:42.015 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.015 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.015 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:42.015 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.012683+0000", 2024-04-19T03:02:42.015 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.003733934 2024-04-19T03:02:42.015 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.015 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.015 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:42.015 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.012798+0000", 2024-04-19T03:02:42.015 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00011574999999999999 2024-04-19T03:02:42.015 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.015 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.016 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:42.016 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.012896+0000", 2024-04-19T03:02:42.016 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.7848000000000002e-05 2024-04-19T03:02:42.016 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.016 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.016 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:42.016 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016423+0000", 2024-04-19T03:02:42.016 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0035270789999999998 2024-04-19T03:02:42.016 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.016 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.016 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:42.016 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.065098+0000", 2024-04-19T03:02:42.016 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.048674651999999999 2024-04-19T03:02:42.016 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.017 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.017 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:42.017 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.065193+0000", 2024-04-19T03:02:42.017 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.5087999999999995e-05 2024-04-19T03:02:42.017 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.017 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.017 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:42.017 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.065264+0000", 2024-04-19T03:02:42.017 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0666000000000004e-05 2024-04-19T03:02:42.017 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:42.017 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:42.017 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:42.017 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.017 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.017 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:78998 5.7 5:ee23c1bc:::benchmark_data_smithi096_19531_object78997:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-19T03:02:42.018 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:18.013165+0000", 2024-04-19T03:02:42.018 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 23.995748372000001, 2024-04-19T03:02:42.018 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.052410864000000001, 2024-04-19T03:02:42.018 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:42.018 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:42.018 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:42.018 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:42.018 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:42.018 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 78998 2024-04-19T03:02:42.018 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.018 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:42.018 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.018 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:42.018 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.013165+0000", 2024-04-19T03:02:42.019 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:42.019 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.019 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.019 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:42.019 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.013165+0000", 2024-04-19T03:02:42.019 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:42.019 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.019 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.019 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:42.019 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.013164+0000", 2024-04-19T03:02:42.019 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:42.019 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.019 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.019 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:42.019 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.013214+0000", 2024-04-19T03:02:42.020 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9636999999999999e-05 2024-04-19T03:02:42.020 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.020 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.020 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:42.020 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.013223+0000", 2024-04-19T03:02:42.020 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.3619999999999995e-06 2024-04-19T03:02:42.020 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.020 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.020 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:42.020 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.013229+0000", 2024-04-19T03:02:42.020 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6060000000000002e-06 2024-04-19T03:02:42.020 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.020 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.020 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:42.021 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.014882+0000", 2024-04-19T03:02:42.021 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001653257 2024-04-19T03:02:42.021 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.021 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.021 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:42.021 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.014958+0000", 2024-04-19T03:02:42.021 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6398999999999998e-05 2024-04-19T03:02:42.021 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.021 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.021 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:42.021 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.015036+0000", 2024-04-19T03:02:42.022 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8070000000000003e-05 2024-04-19T03:02:42.022 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.022 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.022 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:42.022 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018099+0000", 2024-04-19T03:02:42.022 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0030631149999999999 2024-04-19T03:02:42.023 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.023 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.023 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:42.023 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.065328+0000", 2024-04-19T03:02:42.023 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.047228349000000003 2024-04-19T03:02:42.023 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.023 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.023 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:42.023 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.065508+0000", 2024-04-19T03:02:42.023 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00018036899999999999 2024-04-19T03:02:42.024 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.024 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.024 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:42.024 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.065576+0000", 2024-04-19T03:02:42.024 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7785000000000002e-05 2024-04-19T03:02:42.024 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:42.024 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:42.024 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:42.024 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.024 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.024 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4755.0:78995 5.2 e40/39 5:42b55e12:::benchmark_data_smithi096_19531_object78994:head v 40'4934, mlcod=40'4932)", 2024-04-19T03:02:42.024 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:18.016247+0000", 2024-04-19T03:02:42.024 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 23.992666409999998, 2024-04-19T03:02:42.024 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.056240406, 2024-04-19T03:02:42.025 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:42.025 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:42.025 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:42.025 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.025 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:42.025 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016247+0000", 2024-04-19T03:02:42.025 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:42.025 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.025 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.025 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:42.025 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016247+0000", 2024-04-19T03:02:42.025 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:42.025 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.025 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.025 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:42.026 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016246+0000", 2024-04-19T03:02:42.026 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:42.026 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.026 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.026 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:42.026 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016315+0000", 2024-04-19T03:02:42.026 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8979000000000005e-05 2024-04-19T03:02:42.026 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.026 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.026 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:42.026 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016333+0000", 2024-04-19T03:02:42.026 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7586999999999999e-05 2024-04-19T03:02:42.026 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.027 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.027 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:42.027 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016340+0000", 2024-04-19T03:02:42.027 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4080000000000001e-06 2024-04-19T03:02:42.027 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.027 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.027 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:42.027 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016384+0000", 2024-04-19T03:02:42.027 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3656999999999999e-05 2024-04-19T03:02:42.027 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.027 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.027 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:42.027 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016403+0000", 2024-04-19T03:02:42.027 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9089e-05 2024-04-19T03:02:42.028 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.028 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.028 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:42.028 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.072448+0000", 2024-04-19T03:02:42.028 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.056045084000000002 2024-04-19T03:02:42.028 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.028 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.028 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:42.028 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.072487+0000", 2024-04-19T03:02:42.028 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9362e-05 2024-04-19T03:02:42.028 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:42.028 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:42.028 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:42.028 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.028 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.029 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4755.0:78994 5.c e40/22 5:3c60d55d:::benchmark_data_smithi096_19531_object78993:head v 40'4989, mlcod=40'4987)", 2024-04-19T03:02:42.029 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:18.016392+0000", 2024-04-19T03:02:42.029 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 23.992521769, 2024-04-19T03:02:42.029 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.052629620000000002, 2024-04-19T03:02:42.029 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:42.029 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:42.029 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:42.029 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.029 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:42.029 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016392+0000", 2024-04-19T03:02:42.029 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:42.029 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.029 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.030 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:42.030 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016392+0000", 2024-04-19T03:02:42.030 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:42.030 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.030 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.030 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:42.030 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016391+0000", 2024-04-19T03:02:42.030 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:42.030 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.030 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.030 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:42.030 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016471+0000", 2024-04-19T03:02:42.030 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9346999999999998e-05 2024-04-19T03:02:42.031 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.031 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.031 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:42.031 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016478+0000", 2024-04-19T03:02:42.031 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.593e-06 2024-04-19T03:02:42.031 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.031 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.031 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:42.031 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016495+0000", 2024-04-19T03:02:42.031 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6492999999999999e-05 2024-04-19T03:02:42.031 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.031 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.031 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:42.031 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016539+0000", 2024-04-19T03:02:42.032 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4715999999999997e-05 2024-04-19T03:02:42.032 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.032 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.032 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:42.032 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016551+0000", 2024-04-19T03:02:42.032 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2096000000000001e-05 2024-04-19T03:02:42.032 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.032 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.032 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:42.032 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.068985+0000", 2024-04-19T03:02:42.032 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.052433754999999999 2024-04-19T03:02:42.032 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.032 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.032 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:42.033 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.069021+0000", 2024-04-19T03:02:42.033 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6047000000000002e-05 2024-04-19T03:02:42.033 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:42.033 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:42.033 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:42.033 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.033 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.033 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4755.0:78996 5.1 e40/39 5:87f59708:::benchmark_data_smithi096_19531_object78995:head v 40'4940, mlcod=40'4938)", 2024-04-19T03:02:42.033 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:18.016581+0000", 2024-04-19T03:02:42.033 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 23.992332604000001, 2024-04-19T03:02:42.033 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.052051785000000003, 2024-04-19T03:02:42.033 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:42.033 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:42.033 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:42.033 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.034 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:42.034 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016581+0000", 2024-04-19T03:02:42.034 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:42.034 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.034 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.034 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:42.034 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016581+0000", 2024-04-19T03:02:42.034 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:42.034 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.034 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.034 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:42.034 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016581+0000", 2024-04-19T03:02:42.034 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:42.034 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.035 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.035 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:42.035 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016610+0000", 2024-04-19T03:02:42.035 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9556999999999998e-05 2024-04-19T03:02:42.035 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.035 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.035 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:42.035 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016616+0000", 2024-04-19T03:02:42.035 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1090000000000003e-06 2024-04-19T03:02:42.035 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.035 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.035 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:42.035 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016621+0000", 2024-04-19T03:02:42.035 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.454e-06 2024-04-19T03:02:42.036 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.036 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.036 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:42.036 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016663+0000", 2024-04-19T03:02:42.036 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2582e-05 2024-04-19T03:02:42.036 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.036 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.036 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:42.036 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016681+0000", 2024-04-19T03:02:42.036 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7680999999999999e-05 2024-04-19T03:02:42.036 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.036 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.036 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:42.036 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.068486+0000", 2024-04-19T03:02:42.036 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.051804624000000001 2024-04-19T03:02:42.037 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.037 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.037 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:42.037 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.068633+0000", 2024-04-19T03:02:42.037 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00014709099999999999 2024-04-19T03:02:42.037 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:42.037 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:42.037 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:42.037 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.037 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.037 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4755.0:78999 5.3 e40/22 5:c9ec5f7f:::benchmark_data_smithi096_19531_object78998:head v 40'4893, mlcod=40'4889)", 2024-04-19T03:02:42.037 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:18.016633+0000", 2024-04-19T03:02:42.037 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 23.992280748999999, 2024-04-19T03:02:42.037 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.051090469999999999, 2024-04-19T03:02:42.038 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:42.038 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:42.038 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:42.038 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.038 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:42.038 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016633+0000", 2024-04-19T03:02:42.038 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:42.038 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.038 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.038 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:42.038 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016633+0000", 2024-04-19T03:02:42.038 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:42.038 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.038 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.039 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:42.039 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016632+0000", 2024-04-19T03:02:42.039 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967296 2024-04-19T03:02:42.039 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.039 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.039 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:42.039 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016660+0000", 2024-04-19T03:02:42.039 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7869999999999999e-05 2024-04-19T03:02:42.039 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.039 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.039 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:42.039 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016667+0000", 2024-04-19T03:02:42.039 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0280000000000003e-06 2024-04-19T03:02:42.039 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.039 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.040 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:42.040 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016672+0000", 2024-04-19T03:02:42.040 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0069999999999997e-06 2024-04-19T03:02:42.040 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.040 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.040 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:42.040 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016725+0000", 2024-04-19T03:02:42.040 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2812000000000002e-05 2024-04-19T03:02:42.040 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.040 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.040 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:42.040 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016750+0000", 2024-04-19T03:02:42.040 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5038e-05 2024-04-19T03:02:42.040 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.041 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.041 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:42.041 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.067673+0000", 2024-04-19T03:02:42.041 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.050922350999999998 2024-04-19T03:02:42.041 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.041 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.041 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:42.041 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.067723+0000", 2024-04-19T03:02:42.041 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0586e-05 2024-04-19T03:02:42.041 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:42.041 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:42.041 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:42.041 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.041 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.041 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4755.0:79003 5.2 e40/39 5:4436e33f:::benchmark_data_smithi096_19531_object79002:head v 40'4935, mlcod=40'4932)", 2024-04-19T03:02:42.042 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:18.018102+0000", 2024-04-19T03:02:42.042 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 23.990811021999999, 2024-04-19T03:02:42.042 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.060023990999999999, 2024-04-19T03:02:42.042 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:42.042 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:42.042 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:42.042 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.042 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:42.042 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018102+0000", 2024-04-19T03:02:42.042 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:42.042 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.042 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.042 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:42.042 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018102+0000", 2024-04-19T03:02:42.043 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:42.043 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.043 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.043 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:42.043 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018102+0000", 2024-04-19T03:02:42.043 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:42.043 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.043 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.043 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:42.043 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018134+0000", 2024-04-19T03:02:42.043 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2722000000000003e-05 2024-04-19T03:02:42.043 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.043 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.043 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:42.043 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018145+0000", 2024-04-19T03:02:42.044 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0395e-05 2024-04-19T03:02:42.044 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.044 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.044 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:42.044 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018151+0000", 2024-04-19T03:02:42.044 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5300000000000002e-06 2024-04-19T03:02:42.044 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.044 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.044 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:42.044 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018489+0000", 2024-04-19T03:02:42.044 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00033731499999999998 2024-04-19T03:02:42.044 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.044 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.044 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:42.045 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018508+0000", 2024-04-19T03:02:42.045 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9775e-05 2024-04-19T03:02:42.045 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.045 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.045 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:42.045 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.078059+0000", 2024-04-19T03:02:42.045 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.059550171999999998 2024-04-19T03:02:42.045 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.045 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.045 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:42.045 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.078126+0000", 2024-04-19T03:02:42.045 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7773000000000003e-05 2024-04-19T03:02:42.045 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:42.045 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:42.045 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:42.046 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.046 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.046 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4755.0:79005 5.1 e40/39 5:85b46038:::benchmark_data_smithi096_19531_object79004:head v 40'4941, mlcod=40'4938)", 2024-04-19T03:02:42.046 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:18.018167+0000", 2024-04-19T03:02:42.046 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 23.990746303000002, 2024-04-19T03:02:42.046 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.052768941999999999, 2024-04-19T03:02:42.046 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:42.046 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:42.046 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:42.046 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.046 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:42.046 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018167+0000", 2024-04-19T03:02:42.046 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:42.046 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.047 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.047 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:42.047 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018167+0000", 2024-04-19T03:02:42.047 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:42.047 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.047 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.047 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:42.047 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018167+0000", 2024-04-19T03:02:42.047 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:42.047 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.047 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.047 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:42.047 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018196+0000", 2024-04-19T03:02:42.047 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9538000000000001e-05 2024-04-19T03:02:42.048 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.048 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.048 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:42.048 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018204+0000", 2024-04-19T03:02:42.048 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2599999999999999e-06 2024-04-19T03:02:42.048 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.048 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.048 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:42.048 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018208+0000", 2024-04-19T03:02:42.048 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8080000000000004e-06 2024-04-19T03:02:42.048 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.048 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.048 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:42.048 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.064933+0000", 2024-04-19T03:02:42.048 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.046725048999999998 2024-04-19T03:02:42.049 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.049 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.049 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:42.049 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.064964+0000", 2024-04-19T03:02:42.049 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0577000000000002e-05 2024-04-19T03:02:42.049 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.049 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.049 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:42.049 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.070815+0000", 2024-04-19T03:02:42.049 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0058510649999999999 2024-04-19T03:02:42.049 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.049 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.049 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:42.049 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.070936+0000", 2024-04-19T03:02:42.050 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00012095399999999999 2024-04-19T03:02:42.050 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:42.050 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:42.050 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:42.050 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.050 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.050 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:86612 5.7 5:e32e3c49:::benchmark_data_smithi096_19531_object86611:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:42.050 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:22.633560+0000", 2024-04-19T03:02:42.050 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 19.375353361999998, 2024-04-19T03:02:42.050 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.19135289, 2024-04-19T03:02:42.050 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:42.050 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:42.050 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:42.050 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:42.051 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:42.051 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 86612 2024-04-19T03:02:42.051 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.051 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:42.051 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.051 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:42.051 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633560+0000", 2024-04-19T03:02:42.051 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:42.051 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.051 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.051 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:42.051 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633560+0000", 2024-04-19T03:02:42.051 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:42.051 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.051 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.052 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:42.052 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633558+0000", 2024-04-19T03:02:42.052 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:42.052 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.052 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.052 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:42.052 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633609+0000", 2024-04-19T03:02:42.052 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0850999999999998e-05 2024-04-19T03:02:42.052 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.052 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.052 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:42.052 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633627+0000", 2024-04-19T03:02:42.052 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7951000000000001e-05 2024-04-19T03:02:42.052 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.053 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.053 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:42.053 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633635+0000", 2024-04-19T03:02:42.053 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2530000000000004e-06 2024-04-19T03:02:42.053 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.053 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.053 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:42.053 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633699+0000", 2024-04-19T03:02:42.053 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3901999999999999e-05 2024-04-19T03:02:42.053 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.053 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.053 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:42.053 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633992+0000", 2024-04-19T03:02:42.053 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00029283299999999999 2024-04-19T03:02:42.054 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.054 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.054 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:42.054 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.634223+0000", 2024-04-19T03:02:42.054 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00023084200000000001 2024-04-19T03:02:42.054 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.054 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.054 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:42.054 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.639085+0000", 2024-04-19T03:02:42.054 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0048624269999999999 2024-04-19T03:02:42.054 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.054 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.054 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:42.054 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.824635+0000", 2024-04-19T03:02:42.055 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.18554944700000001 2024-04-19T03:02:42.055 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.055 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.055 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:42.055 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.824793+0000", 2024-04-19T03:02:42.055 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000157959 2024-04-19T03:02:42.055 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.055 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.055 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:42.055 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.824913+0000", 2024-04-19T03:02:42.055 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000120093 2024-04-19T03:02:42.055 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:42.055 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:42.055 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:42.056 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.056 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.056 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:86625 5.7 5:e6d00488:::benchmark_data_smithi096_19531_object86624:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:42.056 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:22.643554+0000", 2024-04-19T03:02:42.056 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 19.365359596000001, 2024-04-19T03:02:42.056 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.18732841, 2024-04-19T03:02:42.056 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:42.056 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:42.056 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:42.056 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:42.056 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:42.056 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 86625 2024-04-19T03:02:42.056 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.056 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:42.056 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.057 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:42.057 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643554+0000", 2024-04-19T03:02:42.057 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:42.057 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.057 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.057 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:42.057 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643554+0000", 2024-04-19T03:02:42.057 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:42.057 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.057 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.057 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:42.057 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643552+0000", 2024-04-19T03:02:42.057 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:42.058 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.058 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.058 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:42.058 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643588+0000", 2024-04-19T03:02:42.058 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5855999999999997e-05 2024-04-19T03:02:42.058 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.058 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.058 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:42.058 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643606+0000", 2024-04-19T03:02:42.058 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8226000000000001e-05 2024-04-19T03:02:42.058 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.058 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.058 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:42.058 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643618+0000", 2024-04-19T03:02:42.059 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1868000000000001e-05 2024-04-19T03:02:42.059 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.059 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.059 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:42.059 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643676+0000", 2024-04-19T03:02:42.059 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8153999999999999e-05 2024-04-19T03:02:42.059 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.059 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.059 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:42.059 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643905+0000", 2024-04-19T03:02:42.059 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00022847500000000001 2024-04-19T03:02:42.059 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.059 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.059 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:42.060 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.644150+0000", 2024-04-19T03:02:42.060 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00024531800000000001 2024-04-19T03:02:42.060 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.060 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.060 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:42.060 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.647407+0000", 2024-04-19T03:02:42.060 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0032563190000000001 2024-04-19T03:02:42.060 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.060 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.060 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:42.060 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.830721+0000", 2024-04-19T03:02:42.060 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.18331468300000001 2024-04-19T03:02:42.060 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.060 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.060 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:42.061 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.830813+0000", 2024-04-19T03:02:42.061 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.2205000000000002e-05 2024-04-19T03:02:42.061 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.061 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.061 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:42.061 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.830882+0000", 2024-04-19T03:02:42.061 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8819999999999995e-05 2024-04-19T03:02:42.061 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:42.061 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:42.061 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:42.061 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.061 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.061 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87063 5.7 5:e502e824:::benchmark_data_smithi096_19531_object87062:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:42.061 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.136067+0000", 2024-04-19T03:02:42.062 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 18.872846726999999, 2024-04-19T03:02:42.062 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.065521159999999995, 2024-04-19T03:02:42.062 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:42.062 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:42.062 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:42.062 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:42.062 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:42.062 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87063 2024-04-19T03:02:42.062 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.062 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:42.062 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.062 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:42.062 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.136067+0000", 2024-04-19T03:02:42.062 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:42.063 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.063 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.063 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:42.063 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.136067+0000", 2024-04-19T03:02:42.063 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:42.063 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.063 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.063 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:42.063 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.136066+0000", 2024-04-19T03:02:42.063 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:42.063 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.063 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.063 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:42.063 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.136154+0000", 2024-04-19T03:02:42.063 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.8256000000000003e-05 2024-04-19T03:02:42.064 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.064 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.064 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:42.064 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.136162+0000", 2024-04-19T03:02:42.064 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.5099999999999998e-06 2024-04-19T03:02:42.064 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.064 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.064 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:42.064 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.136171+0000", 2024-04-19T03:02:42.064 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2830000000000001e-06 2024-04-19T03:02:42.064 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.064 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.064 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:42.064 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.138421+0000", 2024-04-19T03:02:42.065 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0022506620000000001 2024-04-19T03:02:42.065 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.065 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.065 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:42.065 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.138560+0000", 2024-04-19T03:02:42.065 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000138446 2024-04-19T03:02:42.065 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.065 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.065 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:42.065 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.138689+0000", 2024-04-19T03:02:42.065 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00012950700000000001 2024-04-19T03:02:42.065 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.065 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.065 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:42.065 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.141517+0000", 2024-04-19T03:02:42.066 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0028280860000000001 2024-04-19T03:02:42.066 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.066 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.066 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:42.066 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.201350+0000", 2024-04-19T03:02:42.066 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.059832418999999998 2024-04-19T03:02:42.066 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.066 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.066 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:42.066 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.201485+0000", 2024-04-19T03:02:42.066 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000135597 2024-04-19T03:02:42.066 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.066 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.067 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:42.067 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.201588+0000", 2024-04-19T03:02:42.067 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00010247900000000001 2024-04-19T03:02:42.067 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:42.067 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:42.067 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:42.067 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.067 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.067 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87072 5.7 5:e3c7809a:::benchmark_data_smithi096_19531_object87071:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:42.067 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.144224+0000", 2024-04-19T03:02:42.067 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 18.864689703, 2024-04-19T03:02:42.067 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.058179555000000001, 2024-04-19T03:02:42.067 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:42.067 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:42.067 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:42.068 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:42.068 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:42.068 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87072 2024-04-19T03:02:42.068 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.068 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:42.068 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.068 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:42.068 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144224+0000", 2024-04-19T03:02:42.068 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:42.068 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.068 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.068 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:42.068 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144224+0000", 2024-04-19T03:02:42.068 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:42.069 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.069 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.069 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:42.069 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144223+0000", 2024-04-19T03:02:42.069 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:42.069 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.069 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.069 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:42.069 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144320+0000", 2024-04-19T03:02:42.069 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.7075000000000001e-05 2024-04-19T03:02:42.069 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.069 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.069 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:42.069 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144331+0000", 2024-04-19T03:02:42.069 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1342000000000001e-05 2024-04-19T03:02:42.070 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.070 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.070 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:42.070 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144337+0000", 2024-04-19T03:02:42.070 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8390000000000003e-06 2024-04-19T03:02:42.070 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.070 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.070 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:42.070 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144369+0000", 2024-04-19T03:02:42.070 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2079000000000002e-05 2024-04-19T03:02:42.070 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.070 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.070 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:42.070 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144464+0000", 2024-04-19T03:02:42.071 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.4623000000000005e-05 2024-04-19T03:02:42.071 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.071 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.071 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:42.071 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144553+0000", 2024-04-19T03:02:42.071 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9171000000000004e-05 2024-04-19T03:02:42.071 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.071 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.071 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:42.071 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.147018+0000", 2024-04-19T03:02:42.071 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0024648370000000001 2024-04-19T03:02:42.071 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.071 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.071 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:42.071 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.202270+0000", 2024-04-19T03:02:42.072 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.055252018 2024-04-19T03:02:42.072 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.072 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.072 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:42.072 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.202356+0000", 2024-04-19T03:02:42.072 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6648000000000001e-05 2024-04-19T03:02:42.072 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.072 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.072 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:42.072 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.202403+0000", 2024-04-19T03:02:42.072 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6956999999999998e-05 2024-04-19T03:02:42.072 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:42.072 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:42.072 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:42.073 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.073 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.073 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87123 5.6 5:6d1bc3b9:::benchmark_data_smithi096_19531_object87122:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:02:42.073 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249233+0000", 2024-04-19T03:02:42.073 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 18.759680671000002, 2024-04-19T03:02:42.073 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0291700720000001, 2024-04-19T03:02:42.073 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:42.073 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-04-19T03:02:42.073 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:42.073 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:42.073 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:42.073 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87123 2024-04-19T03:02:42.073 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.073 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:42.073 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.074 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:42.074 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249233+0000", 2024-04-19T03:02:42.074 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:42.074 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.074 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.074 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:42.074 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249233+0000", 2024-04-19T03:02:42.074 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:42.074 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.074 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.074 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:42.074 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249231+0000", 2024-04-19T03:02:42.074 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:42.074 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.075 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.075 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:42.075 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249285+0000", 2024-04-19T03:02:42.075 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4005000000000002e-05 2024-04-19T03:02:42.075 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.075 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.075 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:42.075 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249300+0000", 2024-04-19T03:02:42.075 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4715999999999999e-05 2024-04-19T03:02:42.075 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.075 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.075 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:42.075 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249307+0000", 2024-04-19T03:02:42.075 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8399999999999997e-06 2024-04-19T03:02:42.075 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.076 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.076 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:42.076 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249366+0000", 2024-04-19T03:02:42.076 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9435999999999998e-05 2024-04-19T03:02:42.076 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.076 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.076 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op must wait for map", 2024-04-19T03:02:42.076 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249376+0000", 2024-04-19T03:02:42.076 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.4919999999999999e-06 2024-04-19T03:02:42.076 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.076 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.076 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:42.076 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263757+0000", 2024-04-19T03:02:42.076 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.014381461999999999 2024-04-19T03:02:42.076 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.077 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.077 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:02:42.077 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263875+0000", 2024-04-19T03:02:42.077 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000117166 2024-04-19T03:02:42.077 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.077 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.077 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:42.077 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.277136+0000", 2024-04-19T03:02:42.077 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.013261207 2024-04-19T03:02:42.077 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.077 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.077 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:42.077 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.278403+0000", 2024-04-19T03:02:42.077 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001267106 2024-04-19T03:02:42.077 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:42.078 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:42.078 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:42.078 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.078 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.078 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87128 5.6 5:6905c420:::benchmark_data_smithi096_19531_object87127:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:02:42.078 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249323+0000", 2024-04-19T03:02:42.078 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 18.759589924, 2024-04-19T03:02:42.078 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0292813249999999, 2024-04-19T03:02:42.078 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:42.078 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-04-19T03:02:42.078 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:42.078 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:42.078 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:42.078 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87128 2024-04-19T03:02:42.079 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.079 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:42.079 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.079 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:42.079 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249323+0000", 2024-04-19T03:02:42.079 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:42.079 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.079 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.079 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:42.079 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249323+0000", 2024-04-19T03:02:42.079 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:42.079 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.079 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.079 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:42.080 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249323+0000", 2024-04-19T03:02:42.080 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:42.080 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.080 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.080 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:42.080 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249385+0000", 2024-04-19T03:02:42.080 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1711999999999995e-05 2024-04-19T03:02:42.080 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.080 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.080 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:42.080 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249398+0000", 2024-04-19T03:02:42.080 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3022e-05 2024-04-19T03:02:42.080 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.080 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.081 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:42.081 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249402+0000", 2024-04-19T03:02:42.081 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4819999999999996e-06 2024-04-19T03:02:42.081 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.081 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.081 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:42.081 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249437+0000", 2024-04-19T03:02:42.081 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4702000000000001e-05 2024-04-19T03:02:42.081 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.081 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.081 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:02:42.081 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249442+0000", 2024-04-19T03:02:42.081 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8019999999999999e-06 2024-04-19T03:02:42.081 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.081 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.082 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:42.082 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263896+0000", 2024-04-19T03:02:42.082 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.014454679999999999 2024-04-19T03:02:42.082 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.082 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.082 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:02:42.082 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263900+0000", 2024-04-19T03:02:42.082 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9700000000000001e-06 2024-04-19T03:02:42.082 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.082 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.082 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:42.082 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.278557+0000", 2024-04-19T03:02:42.082 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0146566480000001 2024-04-19T03:02:42.082 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.083 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.083 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:42.083 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.278605+0000", 2024-04-19T03:02:42.083 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7735999999999998e-05 2024-04-19T03:02:42.083 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:42.083 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:42.083 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:42.083 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.083 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.083 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87130 5.3 5:c8c2d67b:::benchmark_data_smithi096_19531_object87129:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:02:42.083 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249418+0000", 2024-04-19T03:02:42.083 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 18.759495213000001, 2024-04-19T03:02:42.083 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.025414182, 2024-04-19T03:02:42.083 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:42.083 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-04-19T03:02:42.084 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:42.084 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:42.084 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:42.084 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87130 2024-04-19T03:02:42.084 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.084 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:42.084 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.084 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:42.084 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249418+0000", 2024-04-19T03:02:42.084 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:42.084 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.084 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.084 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:42.084 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249418+0000", 2024-04-19T03:02:42.085 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:42.085 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.085 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.085 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:42.085 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249409+0000", 2024-04-19T03:02:42.085 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999905 2024-04-19T03:02:42.085 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.085 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.085 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:42.085 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249464+0000", 2024-04-19T03:02:42.085 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5381999999999999e-05 2024-04-19T03:02:42.085 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.085 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.085 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:42.086 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249471+0000", 2024-04-19T03:02:42.086 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2609999999999996e-06 2024-04-19T03:02:42.086 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.086 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.086 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:42.086 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249475+0000", 2024-04-19T03:02:42.086 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2839999999999998e-06 2024-04-19T03:02:42.086 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.086 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.086 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:42.086 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249535+0000", 2024-04-19T03:02:42.086 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0545999999999999e-05 2024-04-19T03:02:42.086 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.086 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.087 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op must wait for map", 2024-04-19T03:02:42.087 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249540+0000", 2024-04-19T03:02:42.087 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2859999999999999e-06 2024-04-19T03:02:42.087 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.087 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.087 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:42.087 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263450+0000", 2024-04-19T03:02:42.087 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.013909585 2024-04-19T03:02:42.087 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.087 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.087 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:02:42.087 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263458+0000", 2024-04-19T03:02:42.087 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8089999999999993e-06 2024-04-19T03:02:42.087 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.088 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.088 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:42.088 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.273193+0000", 2024-04-19T03:02:42.088 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0097351379999999 2024-04-19T03:02:42.088 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.088 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.088 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:42.088 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.274832+0000", 2024-04-19T03:02:42.088 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0016394789999999999 2024-04-19T03:02:42.088 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:42.088 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:42.088 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:42.088 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.088 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.088 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87131 5.1 5:83756d55:::benchmark_data_smithi096_19531_object87130:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:02:42.089 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249491+0000", 2024-04-19T03:02:42.089 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 18.759422566000001, 2024-04-19T03:02:42.089 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0191489520000001, 2024-04-19T03:02:42.089 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:42.089 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-04-19T03:02:42.089 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:42.089 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:42.089 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:42.089 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87131 2024-04-19T03:02:42.089 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.089 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:42.089 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.089 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:42.089 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249491+0000", 2024-04-19T03:02:42.089 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:42.090 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.090 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.090 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:42.090 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249491+0000", 2024-04-19T03:02:42.090 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:42.090 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.090 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.090 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:42.090 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249491+0000", 2024-04-19T03:02:42.090 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:42.090 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.090 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.090 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:42.090 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249530+0000", 2024-04-19T03:02:42.091 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9589000000000003e-05 2024-04-19T03:02:42.091 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.091 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.091 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:42.091 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249544+0000", 2024-04-19T03:02:42.091 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4158000000000001e-05 2024-04-19T03:02:42.091 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.091 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.091 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:42.091 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249549+0000", 2024-04-19T03:02:42.091 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6809999999999997e-06 2024-04-19T03:02:42.091 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.091 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.091 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:42.091 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249592+0000", 2024-04-19T03:02:42.092 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3285999999999999e-05 2024-04-19T03:02:42.092 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.092 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.092 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op must wait for map", 2024-04-19T03:02:42.092 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249598+0000", 2024-04-19T03:02:42.092 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8329999999999999e-06 2024-04-19T03:02:42.092 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.092 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.092 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:42.092 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263331+0000", 2024-04-19T03:02:42.092 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.013733093 2024-04-19T03:02:42.092 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.092 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.092 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:02:42.093 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263343+0000", 2024-04-19T03:02:42.093 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.189e-05 2024-04-19T03:02:42.093 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.093 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.093 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:42.093 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.268541+0000", 2024-04-19T03:02:42.093 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0051983440000001 2024-04-19T03:02:42.093 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.093 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.093 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:42.093 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.268640+0000", 2024-04-19T03:02:42.093 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.8387999999999994e-05 2024-04-19T03:02:42.093 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:42.093 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:42.094 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:42.094 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.094 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.094 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87132 5.c 5:3e18b732:::benchmark_data_smithi096_19531_object87131:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:02:42.094 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249558+0000", 2024-04-19T03:02:42.094 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 18.759355665000001, 2024-04-19T03:02:42.094 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0241198380000001, 2024-04-19T03:02:42.094 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:42.094 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-04-19T03:02:42.094 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:42.094 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:42.094 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:42.094 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87132 2024-04-19T03:02:42.094 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.095 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:42.095 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.095 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:42.095 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249558+0000", 2024-04-19T03:02:42.095 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:42.095 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.095 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.095 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:42.095 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249558+0000", 2024-04-19T03:02:42.095 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:42.095 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.095 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.095 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:42.095 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249557+0000", 2024-04-19T03:02:42.096 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:42.096 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.096 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.096 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:42.096 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249625+0000", 2024-04-19T03:02:42.096 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7200999999999996e-05 2024-04-19T03:02:42.096 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.096 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.096 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:42.096 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249646+0000", 2024-04-19T03:02:42.096 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1053e-05 2024-04-19T03:02:42.096 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.096 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.096 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:42.097 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249650+0000", 2024-04-19T03:02:42.097 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2719999999999999e-06 2024-04-19T03:02:42.097 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.097 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.097 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:42.097 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249686+0000", 2024-04-19T03:02:42.097 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6430000000000002e-05 2024-04-19T03:02:42.097 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.097 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.097 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op must wait for map", 2024-04-19T03:02:42.097 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249690+0000", 2024-04-19T03:02:42.097 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.765e-06 2024-04-19T03:02:42.097 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.097 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.098 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:42.098 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261157+0000", 2024-04-19T03:02:42.098 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011467247999999999 2024-04-19T03:02:42.098 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.098 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.098 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:02:42.098 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261170+0000", 2024-04-19T03:02:42.098 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2833000000000001e-05 2024-04-19T03:02:42.098 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.098 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.098 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:42.098 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.272119+0000", 2024-04-19T03:02:42.098 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.010949313 2024-04-19T03:02:42.098 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.099 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.099 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:42.099 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.273678+0000", 2024-04-19T03:02:42.099 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0015581550000000001 2024-04-19T03:02:42.099 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:42.099 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:42.099 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:42.099 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.099 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.099 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87133 5.c 5:3f772a62:::benchmark_data_smithi096_19531_object87132:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:02:42.099 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249657+0000", 2024-04-19T03:02:42.099 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 18.759256285999999, 2024-04-19T03:02:42.099 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0242819409999999, 2024-04-19T03:02:42.099 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:42.100 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-04-19T03:02:42.100 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:42.100 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:42.100 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:42.100 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87133 2024-04-19T03:02:42.100 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.100 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:42.100 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.100 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:42.100 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249657+0000", 2024-04-19T03:02:42.100 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:42.100 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.100 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.100 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:42.101 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249657+0000", 2024-04-19T03:02:42.101 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:42.101 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.101 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.101 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:42.101 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249657+0000", 2024-04-19T03:02:42.101 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:42.101 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.101 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.101 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:42.101 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249690+0000", 2024-04-19T03:02:42.101 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3343000000000002e-05 2024-04-19T03:02:42.101 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.101 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.102 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:42.102 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249695+0000", 2024-04-19T03:02:42.102 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8600000000000001e-06 2024-04-19T03:02:42.102 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.102 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.102 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:42.102 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249698+0000", 2024-04-19T03:02:42.102 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.1700000000000001e-06 2024-04-19T03:02:42.102 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.102 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.102 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:42.102 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249741+0000", 2024-04-19T03:02:42.102 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2849999999999998e-05 2024-04-19T03:02:42.102 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.103 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.103 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:02:42.103 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249746+0000", 2024-04-19T03:02:42.103 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1019999999999996e-06 2024-04-19T03:02:42.103 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.103 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.103 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:42.103 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261209+0000", 2024-04-19T03:02:42.103 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011462447000000001 2024-04-19T03:02:42.103 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.103 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.103 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:02:42.103 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261216+0000", 2024-04-19T03:02:42.103 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8520000000000004e-06 2024-04-19T03:02:42.104 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.104 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.104 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:42.104 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.273872+0000", 2024-04-19T03:02:42.104 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0126558000000001 2024-04-19T03:02:42.104 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.104 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.104 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:42.104 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.273939+0000", 2024-04-19T03:02:42.104 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6822000000000005e-05 2024-04-19T03:02:42.104 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:42.104 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:42.104 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:42.104 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.105 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.105 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87134 5.5 5:a56c478f:::benchmark_data_smithi096_19531_object87133:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:02:42.105 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249708+0000", 2024-04-19T03:02:42.105 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 18.759205361999999, 2024-04-19T03:02:42.105 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0214677299999999, 2024-04-19T03:02:42.105 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:42.105 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-04-19T03:02:42.105 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:42.105 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:42.105 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:42.105 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87134 2024-04-19T03:02:42.105 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.105 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:42.105 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.106 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:42.106 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249708+0000", 2024-04-19T03:02:42.106 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:42.106 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.106 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.106 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:42.106 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249708+0000", 2024-04-19T03:02:42.106 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:42.106 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.106 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.106 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:42.106 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249706+0000", 2024-04-19T03:02:42.106 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999976 2024-04-19T03:02:42.106 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.107 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.107 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:42.107 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249740+0000", 2024-04-19T03:02:42.107 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4458000000000001e-05 2024-04-19T03:02:42.107 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.107 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.107 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:42.107 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249745+0000", 2024-04-19T03:02:42.107 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5020000000000003e-06 2024-04-19T03:02:42.107 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.107 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.107 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:42.107 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249748+0000", 2024-04-19T03:02:42.107 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2499999999999998e-06 2024-04-19T03:02:42.107 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.108 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.108 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:42.108 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249778+0000", 2024-04-19T03:02:42.108 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.006e-05 2024-04-19T03:02:42.108 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.108 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.108 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op must wait for map", 2024-04-19T03:02:42.108 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249782+0000", 2024-04-19T03:02:42.108 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2910000000000001e-06 2024-04-19T03:02:42.108 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.108 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.108 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:42.108 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261666+0000", 2024-04-19T03:02:42.108 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011883471 2024-04-19T03:02:42.109 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.109 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.109 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:02:42.109 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261674+0000", 2024-04-19T03:02:42.109 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6479999999999992e-06 2024-04-19T03:02:42.109 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.109 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.109 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:42.109 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.269323+0000", 2024-04-19T03:02:42.109 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.00764867 2024-04-19T03:02:42.109 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.109 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.109 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:42.109 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.271176+0000", 2024-04-19T03:02:42.110 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001852844 2024-04-19T03:02:42.110 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:42.110 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:42.110 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:42.110 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.110 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.110 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87137 5.c 5:30708c68:::benchmark_data_smithi096_19531_object87136:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:02:42.110 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249756+0000", 2024-04-19T03:02:42.110 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 18.759157655999999, 2024-04-19T03:02:42.110 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.033331752, 2024-04-19T03:02:42.110 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:42.110 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:42.110 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:42.111 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:42.111 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:42.111 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87137 2024-04-19T03:02:42.111 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.111 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:42.111 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.111 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:42.111 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249756+0000", 2024-04-19T03:02:42.111 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:42.111 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.111 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.111 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:42.111 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249756+0000", 2024-04-19T03:02:42.111 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:42.111 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.112 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.112 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:42.112 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249755+0000", 2024-04-19T03:02:42.112 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:42.112 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.112 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.112 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:42.112 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249777+0000", 2024-04-19T03:02:42.112 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1420000000000002e-05 2024-04-19T03:02:42.112 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.112 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.112 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:42.112 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249781+0000", 2024-04-19T03:02:42.112 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0609999999999997e-06 2024-04-19T03:02:42.112 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.113 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.113 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:42.113 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249787+0000", 2024-04-19T03:02:42.113 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.02e-06 2024-04-19T03:02:42.113 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.113 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.113 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:42.113 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249818+0000", 2024-04-19T03:02:42.113 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0947e-05 2024-04-19T03:02:42.113 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.113 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.113 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:02:42.113 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249821+0000", 2024-04-19T03:02:42.113 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.117e-06 2024-04-19T03:02:42.114 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.114 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.114 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:42.114 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261243+0000", 2024-04-19T03:02:42.114 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011421875999999999 2024-04-19T03:02:42.114 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.114 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.114 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:02:42.114 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261251+0000", 2024-04-19T03:02:42.114 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6120000000000001e-06 2024-04-19T03:02:42.114 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.114 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.114 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:42.114 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.274050+0000", 2024-04-19T03:02:42.115 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.012799405 2024-04-19T03:02:42.115 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.115 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.115 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:42.115 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.274529+0000", 2024-04-19T03:02:42.115 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00047867100000000001 2024-04-19T03:02:42.115 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.115 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.115 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:42.115 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.282972+0000", 2024-04-19T03:02:42.115 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0084436900000000002 2024-04-19T03:02:42.115 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.115 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.115 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:42.115 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.283022+0000", 2024-04-19T03:02:42.116 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9339000000000003e-05 2024-04-19T03:02:42.116 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:42.116 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:42.116 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:42.116 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.283088+0000", 2024-04-19T03:02:42.116 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5877999999999995e-05 2024-04-19T03:02:42.116 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:42.116 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:42.116 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:42.116 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:42.116 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:42.116 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-04-19T03:02:42.118 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:42.113+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:42.118 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T03:02:42.122 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1: {} 2024-04-19T03:02:42.143 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2: {} 2024-04-19T03:02:42.143 INFO:teuthology.orchestra.run.smithi096.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-04-19T03:02:42.143 INFO:teuthology.orchestra.run.smithi096.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-19T03:02:42.143 INFO:teuthology.orchestra.run.smithi096.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-19T03:02:42.146 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-19T03:02:42.147 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-19T03:02:42.218 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:42.217+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:42.246 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-19T03:02:42.246 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:02:42.258 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T03:02:42.319 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:42.315+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:42.379 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-19T03:02:42.380 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:02:42.393 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T03:02:42.420 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:42.419+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:42.444 INFO:teuthology.orchestra.run.smithi096.stderr:noscrub is unset 2024-04-19T03:02:42.519 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-19T03:02:42.520 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:02:42.521 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:42.519+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:42.532 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T03:02:42.622 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:42.621+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:42.660 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-04-19T03:02:42.660 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:02:42.673 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T03:02:42.722 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:42.719+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:42.824 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:42.821+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:42.842 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-04-19T03:02:42.843 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:02:42.855 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T03:02:42.925 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:42.921+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:42.979 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-04-19T03:02:42.980 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:02:42.991 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T03:02:43.026 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:43.023+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:43.121 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-19T03:02:43.121 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:02:43.127 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:43.123+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:43.133 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T03:02:43.228 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:43.225+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:43.299 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-19T03:02:43.299 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:02:43.311 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T03:02:43.329 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:43.325+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:43.430 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:43.429+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:43.432 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-19T03:02:43.432 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:02:43.445 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T03:02:43.531 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:43.529+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:43.574 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-04-19T03:02:43.574 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:02:43.586 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T03:02:43.632 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:43.629+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:43.709 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-04-19T03:02:43.710 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:02:43.722 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T03:02:43.770 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:43.769+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:43.834 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:43.831+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:43.906 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-04-19T03:02:43.907 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:02:43.920 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T03:02:43.935 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:43.933+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:44.036 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:44.033+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:44.049 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-19T03:02:44.049 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:02:44.061 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T03:02:44.137 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:44.133+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:44.147 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-19T03:02:44.185 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-19T03:02:44.185 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:02:44.197 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T03:02:44.238 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:44.237+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:44.298 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1: {} 2024-04-19T03:02:44.319 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2: {} 2024-04-19T03:02:44.319 INFO:teuthology.orchestra.run.smithi096.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-04-19T03:02:44.319 INFO:teuthology.orchestra.run.smithi096.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-19T03:02:44.319 INFO:teuthology.orchestra.run.smithi096.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-19T03:02:44.321 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-19T03:02:44.321 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-04-19T03:02:44.321 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-04-19T03:02:44.321 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-04-19T03:02:44.321 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.321 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:79014 5.d 5:b5eee02c:::benchmark_data_smithi096_19531_object79013:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-19T03:02:44.322 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:18.032471+0000", 2024-04-19T03:02:44.322 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 26.286187679000001, 2024-04-19T03:02:44.322 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.041427629000000001, 2024-04-19T03:02:44.322 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:44.322 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:44.322 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:44.322 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:44.322 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:44.322 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 79014 2024-04-19T03:02:44.322 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.322 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:44.323 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.323 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:44.323 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:18.032471+0000", 2024-04-19T03:02:44.323 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:44.323 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.323 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.323 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:44.323 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:18.032471+0000", 2024-04-19T03:02:44.323 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:44.323 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.323 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.323 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:44.323 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:18.032470+0000", 2024-04-19T03:02:44.323 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:44.324 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.324 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.324 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:44.324 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:18.032525+0000", 2024-04-19T03:02:44.324 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5535999999999998e-05 2024-04-19T03:02:44.324 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.324 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.324 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:44.324 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:18.032537+0000", 2024-04-19T03:02:44.324 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1987999999999999e-05 2024-04-19T03:02:44.324 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.324 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.324 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:44.324 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:18.032546+0000", 2024-04-19T03:02:44.325 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9670000000000007e-06 2024-04-19T03:02:44.325 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.325 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.325 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:44.325 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:18.032613+0000", 2024-04-19T03:02:44.325 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6508999999999996e-05 2024-04-19T03:02:44.325 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.325 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.325 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:44.325 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:18.032738+0000", 2024-04-19T03:02:44.325 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000124912 2024-04-19T03:02:44.325 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.325 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.325 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-04-19T03:02:44.326 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:18.032867+0000", 2024-04-19T03:02:44.326 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012959399999999999 2024-04-19T03:02:44.326 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.326 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.326 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:44.326 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:18.035867+0000", 2024-04-19T03:02:44.326 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.002999378 2024-04-19T03:02:44.326 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.326 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.326 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:44.326 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:18.073705+0000", 2024-04-19T03:02:44.326 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.037838042000000002 2024-04-19T03:02:44.326 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.326 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.327 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:44.327 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:18.073813+0000", 2024-04-19T03:02:44.327 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010806099999999999 2024-04-19T03:02:44.327 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.327 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.327 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:44.327 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:18.073899+0000", 2024-04-19T03:02:44.327 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.5971999999999996e-05 2024-04-19T03:02:44.327 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:44.327 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:44.327 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:44.327 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.327 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.327 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:86615 5.e 5:7fef7288:::benchmark_data_smithi096_19531_object86614:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:44.328 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:22.634544+0000", 2024-04-19T03:02:44.328 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 21.684114699999999, 2024-04-19T03:02:44.328 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.192475071, 2024-04-19T03:02:44.328 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:44.329 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:44.329 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:44.330 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:44.330 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:44.330 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 86615 2024-04-19T03:02:44.330 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.330 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:44.330 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.330 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:44.330 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634544+0000", 2024-04-19T03:02:44.330 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:44.330 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.330 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.330 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:44.330 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634544+0000", 2024-04-19T03:02:44.330 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:44.331 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.331 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.331 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:44.331 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634542+0000", 2024-04-19T03:02:44.331 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999981 2024-04-19T03:02:44.331 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.331 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.331 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:44.331 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634585+0000", 2024-04-19T03:02:44.331 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2299000000000003e-05 2024-04-19T03:02:44.331 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.331 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.331 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:44.331 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634592+0000", 2024-04-19T03:02:44.332 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2350000000000002e-06 2024-04-19T03:02:44.332 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.332 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.333 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:44.333 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634596+0000", 2024-04-19T03:02:44.333 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5390000000000001e-06 2024-04-19T03:02:44.333 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.333 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.333 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:44.333 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634639+0000", 2024-04-19T03:02:44.333 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2444999999999998e-05 2024-04-19T03:02:44.333 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.333 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.333 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:44.333 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634808+0000", 2024-04-19T03:02:44.333 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000169152 2024-04-19T03:02:44.334 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.334 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.334 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:44.334 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634999+0000", 2024-04-19T03:02:44.334 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00019098300000000001 2024-04-19T03:02:44.334 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.334 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.334 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:44.334 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.640458+0000", 2024-04-19T03:02:44.334 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0054586870000000003 2024-04-19T03:02:44.334 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.334 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.334 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:44.335 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.826949+0000", 2024-04-19T03:02:44.335 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.18649178299999999 2024-04-19T03:02:44.335 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.335 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.335 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:44.335 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.826982+0000", 2024-04-19T03:02:44.335 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2477000000000001e-05 2024-04-19T03:02:44.335 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.335 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.335 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:44.335 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.827019+0000", 2024-04-19T03:02:44.335 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7355999999999999e-05 2024-04-19T03:02:44.335 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:44.335 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:44.336 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:44.336 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.336 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.336 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:86616 5.e 5:72278f47:::benchmark_data_smithi096_19531_object86615:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:44.336 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:22.634609+0000", 2024-04-19T03:02:44.336 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 21.684049551000001, 2024-04-19T03:02:44.336 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.19472088900000001, 2024-04-19T03:02:44.336 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:44.336 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:44.336 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:44.336 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:44.336 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:44.336 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 86616 2024-04-19T03:02:44.336 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.337 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:44.337 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.337 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:44.337 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634609+0000", 2024-04-19T03:02:44.337 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:44.337 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.337 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.337 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:44.337 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634609+0000", 2024-04-19T03:02:44.337 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:44.337 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.337 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.337 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:44.338 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634609+0000", 2024-04-19T03:02:44.338 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:44.338 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.338 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.338 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:44.338 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634651+0000", 2024-04-19T03:02:44.338 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2589000000000002e-05 2024-04-19T03:02:44.338 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.338 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.338 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:44.338 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634659+0000", 2024-04-19T03:02:44.338 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5850000000000002e-06 2024-04-19T03:02:44.338 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.338 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.339 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:44.339 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634662+0000", 2024-04-19T03:02:44.339 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3620000000000002e-06 2024-04-19T03:02:44.339 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.339 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.339 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:44.339 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.637880+0000", 2024-04-19T03:02:44.339 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.003218149 2024-04-19T03:02:44.339 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.339 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.339 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:44.339 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.637999+0000", 2024-04-19T03:02:44.339 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000118643 2024-04-19T03:02:44.339 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.340 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.340 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:44.340 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.638102+0000", 2024-04-19T03:02:44.340 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010331 2024-04-19T03:02:44.340 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.340 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.340 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:44.340 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.640851+0000", 2024-04-19T03:02:44.340 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0027483310000000001 2024-04-19T03:02:44.340 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.340 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.340 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:44.340 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.829269+0000", 2024-04-19T03:02:44.340 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.188418319 2024-04-19T03:02:44.341 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.341 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.341 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:44.341 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.829299+0000", 2024-04-19T03:02:44.341 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0227e-05 2024-04-19T03:02:44.341 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.341 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.341 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:44.341 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.829330+0000", 2024-04-19T03:02:44.341 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0969000000000001e-05 2024-04-19T03:02:44.341 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:44.341 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:44.341 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:44.341 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.342 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.342 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:86618 5.0 5:09014b90:::benchmark_data_smithi096_19531_object86617:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:44.342 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:22.634894+0000", 2024-04-19T03:02:44.342 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 21.683765062999999, 2024-04-19T03:02:44.342 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.19413419800000001, 2024-04-19T03:02:44.342 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:44.342 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:44.342 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:44.342 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:44.342 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:44.342 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 86618 2024-04-19T03:02:44.342 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.342 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:44.342 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.343 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:44.343 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634894+0000", 2024-04-19T03:02:44.343 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:44.343 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.343 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.343 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:44.343 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634894+0000", 2024-04-19T03:02:44.343 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:44.343 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.343 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.343 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:44.343 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634893+0000", 2024-04-19T03:02:44.343 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:44.343 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.344 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.344 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:44.344 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634976+0000", 2024-04-19T03:02:44.344 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3231000000000003e-05 2024-04-19T03:02:44.344 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.344 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.344 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:44.344 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634983+0000", 2024-04-19T03:02:44.344 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5169999999999996e-06 2024-04-19T03:02:44.344 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.344 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.344 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:44.344 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634987+0000", 2024-04-19T03:02:44.345 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.425e-06 2024-04-19T03:02:44.345 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.345 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.345 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:44.345 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635030+0000", 2024-04-19T03:02:44.345 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.32e-05 2024-04-19T03:02:44.345 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.345 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.345 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:44.345 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635185+0000", 2024-04-19T03:02:44.345 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015471899999999999 2024-04-19T03:02:44.345 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.345 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.346 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:44.346 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635415+0000", 2024-04-19T03:02:44.346 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00023026500000000001 2024-04-19T03:02:44.346 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.346 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.346 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:44.346 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.640127+0000", 2024-04-19T03:02:44.346 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0047118890000000004 2024-04-19T03:02:44.346 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.346 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.346 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:44.346 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.828895+0000", 2024-04-19T03:02:44.346 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.18876802600000001 2024-04-19T03:02:44.346 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.347 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.347 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:44.347 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.828972+0000", 2024-04-19T03:02:44.347 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.6345000000000002e-05 2024-04-19T03:02:44.347 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.347 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.347 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:44.347 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.829028+0000", 2024-04-19T03:02:44.347 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6342999999999999e-05 2024-04-19T03:02:44.347 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:44.347 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:44.347 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:44.347 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.348 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.348 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:86620 5.b 5:d80faa68:::benchmark_data_smithi096_19531_object86619:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:44.348 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:22.635110+0000", 2024-04-19T03:02:44.348 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 21.683548503000001, 2024-04-19T03:02:44.348 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.193447275, 2024-04-19T03:02:44.348 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:44.348 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:44.348 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:44.348 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:44.348 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:44.348 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 86620 2024-04-19T03:02:44.348 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.348 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:44.348 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.349 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:44.349 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635110+0000", 2024-04-19T03:02:44.349 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:44.349 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.349 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.349 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:44.349 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635110+0000", 2024-04-19T03:02:44.349 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:44.349 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.349 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.349 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:44.349 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635110+0000", 2024-04-19T03:02:44.349 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:44.349 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.350 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.350 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:44.350 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635154+0000", 2024-04-19T03:02:44.350 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4681000000000001e-05 2024-04-19T03:02:44.350 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.350 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.350 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:44.350 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635166+0000", 2024-04-19T03:02:44.350 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1505000000000001e-05 2024-04-19T03:02:44.350 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.350 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.350 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:44.350 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635171+0000", 2024-04-19T03:02:44.351 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6040000000000003e-06 2024-04-19T03:02:44.351 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.351 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.351 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:44.351 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635221+0000", 2024-04-19T03:02:44.351 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9947000000000001e-05 2024-04-19T03:02:44.351 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.351 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.351 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:44.351 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635356+0000", 2024-04-19T03:02:44.351 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013576199999999999 2024-04-19T03:02:44.351 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.351 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.352 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:44.352 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635507+0000", 2024-04-19T03:02:44.352 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015072999999999999 2024-04-19T03:02:44.352 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.352 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.352 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:44.352 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.638488+0000", 2024-04-19T03:02:44.352 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0029813159999999999 2024-04-19T03:02:44.352 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.352 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.352 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:44.352 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.828341+0000", 2024-04-19T03:02:44.352 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.189852254 2024-04-19T03:02:44.352 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.353 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.353 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:44.353 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.828416+0000", 2024-04-19T03:02:44.353 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5344000000000002e-05 2024-04-19T03:02:44.353 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.353 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.353 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:44.353 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.828558+0000", 2024-04-19T03:02:44.353 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000141695 2024-04-19T03:02:44.353 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:44.353 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:44.353 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:44.353 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.353 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.354 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:86621 5.8 5:1597a420:::benchmark_data_smithi096_19531_object86620:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:44.354 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:22.635187+0000", 2024-04-19T03:02:44.354 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 21.683471643000001, 2024-04-19T03:02:44.354 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.194204878, 2024-04-19T03:02:44.354 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:44.354 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:44.354 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:44.354 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:44.355 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:44.355 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 86621 2024-04-19T03:02:44.355 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.355 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:44.355 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.355 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:44.355 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635187+0000", 2024-04-19T03:02:44.355 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:44.355 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.355 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.355 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:44.355 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635187+0000", 2024-04-19T03:02:44.355 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:44.356 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.356 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.356 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:44.356 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635187+0000", 2024-04-19T03:02:44.356 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:44.356 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.356 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.356 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:44.356 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635242+0000", 2024-04-19T03:02:44.356 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5158000000000003e-05 2024-04-19T03:02:44.356 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.356 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.356 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:44.356 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635249+0000", 2024-04-19T03:02:44.357 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.7000000000000008e-06 2024-04-19T03:02:44.357 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.357 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.357 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:44.357 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635256+0000", 2024-04-19T03:02:44.357 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2060000000000004e-06 2024-04-19T03:02:44.357 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.357 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.357 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:44.357 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635302+0000", 2024-04-19T03:02:44.357 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5954000000000001e-05 2024-04-19T03:02:44.357 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.357 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.357 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:44.358 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635427+0000", 2024-04-19T03:02:44.358 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012559299999999999 2024-04-19T03:02:44.358 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.358 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.358 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:44.358 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635596+0000", 2024-04-19T03:02:44.358 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000168615 2024-04-19T03:02:44.358 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.358 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.358 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:44.358 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.639320+0000", 2024-04-19T03:02:44.358 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0037244610000000001 2024-04-19T03:02:44.358 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.358 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.359 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:44.359 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.829277+0000", 2024-04-19T03:02:44.359 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.18995651099999999 2024-04-19T03:02:44.359 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.359 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.359 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:44.359 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.829341+0000", 2024-04-19T03:02:44.359 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3756000000000004e-05 2024-04-19T03:02:44.359 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.359 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.359 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:44.359 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.829392+0000", 2024-04-19T03:02:44.359 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1555999999999999e-05 2024-04-19T03:02:44.360 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:44.360 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:44.360 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:44.360 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.360 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.360 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87062 5.4 5:2d3b5d9a:::benchmark_data_smithi096_19531_object87061:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:44.360 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.136820+0000", 2024-04-19T03:02:44.360 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 21.181838490000001, 2024-04-19T03:02:44.360 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.066483741999999998, 2024-04-19T03:02:44.360 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:44.360 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:44.360 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:44.360 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:44.360 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:44.360 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87062 2024-04-19T03:02:44.361 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.361 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:44.361 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.361 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:44.361 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.136820+0000", 2024-04-19T03:02:44.361 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:44.361 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.361 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.361 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:44.361 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.136820+0000", 2024-04-19T03:02:44.361 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:44.361 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.361 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.362 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:44.362 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.136819+0000", 2024-04-19T03:02:44.362 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:44.362 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.362 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.362 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:44.362 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.136864+0000", 2024-04-19T03:02:44.362 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4855000000000003e-05 2024-04-19T03:02:44.362 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.362 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.362 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:44.362 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.136881+0000", 2024-04-19T03:02:44.362 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7521999999999999e-05 2024-04-19T03:02:44.362 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.363 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.363 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:44.363 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.136890+0000", 2024-04-19T03:02:44.363 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1039999999999996e-06 2024-04-19T03:02:44.363 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.363 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.363 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:44.363 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.136974+0000", 2024-04-19T03:02:44.363 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3735999999999999e-05 2024-04-19T03:02:44.363 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.363 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.363 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:44.363 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.137308+0000", 2024-04-19T03:02:44.363 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00033376100000000002 2024-04-19T03:02:44.364 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.364 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.364 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:44.364 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.137559+0000", 2024-04-19T03:02:44.364 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000250599 2024-04-19T03:02:44.364 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.364 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.364 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:44.364 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.145423+0000", 2024-04-19T03:02:44.364 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0078649589999999995 2024-04-19T03:02:44.364 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.364 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.364 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:44.364 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.203175+0000", 2024-04-19T03:02:44.365 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057751255000000001 2024-04-19T03:02:44.365 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.365 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.365 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:44.365 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.203250+0000", 2024-04-19T03:02:44.365 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5378999999999998e-05 2024-04-19T03:02:44.365 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.365 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.365 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:44.365 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.203304+0000", 2024-04-19T03:02:44.365 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4015999999999999e-05 2024-04-19T03:02:44.365 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:44.365 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:44.366 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:44.366 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.366 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.366 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87065 5.4 5:21d20a47:::benchmark_data_smithi096_19531_object87064:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:44.366 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.137482+0000", 2024-04-19T03:02:44.366 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 21.181176755999999, 2024-04-19T03:02:44.366 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.065988749999999999, 2024-04-19T03:02:44.366 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:44.366 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:44.366 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:44.366 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:44.366 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:44.367 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87065 2024-04-19T03:02:44.367 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.367 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:44.367 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.367 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:44.367 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.137482+0000", 2024-04-19T03:02:44.367 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:44.367 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.367 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.367 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:44.367 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.137482+0000", 2024-04-19T03:02:44.367 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:44.367 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.367 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.368 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:44.368 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.137481+0000", 2024-04-19T03:02:44.368 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:44.368 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.368 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.368 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:44.368 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.137530+0000", 2024-04-19T03:02:44.368 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9302000000000003e-05 2024-04-19T03:02:44.368 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.368 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.368 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:44.368 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.137540+0000", 2024-04-19T03:02:44.368 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.2010000000000005e-06 2024-04-19T03:02:44.368 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.368 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.369 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:44.369 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.137545+0000", 2024-04-19T03:02:44.369 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5910000000000003e-06 2024-04-19T03:02:44.369 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.369 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.369 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:44.369 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.140666+0000", 2024-04-19T03:02:44.369 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0031212710000000001 2024-04-19T03:02:44.369 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.369 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.369 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:44.369 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.140847+0000", 2024-04-19T03:02:44.369 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00018065600000000001 2024-04-19T03:02:44.369 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.370 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.370 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:44.370 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.140991+0000", 2024-04-19T03:02:44.370 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014433100000000001 2024-04-19T03:02:44.370 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.370 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.370 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:44.370 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.148053+0000", 2024-04-19T03:02:44.370 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.007061945 2024-04-19T03:02:44.370 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.370 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.370 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:44.370 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.203367+0000", 2024-04-19T03:02:44.371 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.055313703999999998 2024-04-19T03:02:44.371 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.371 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.371 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:44.371 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.203426+0000", 2024-04-19T03:02:44.371 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9024000000000003e-05 2024-04-19T03:02:44.371 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.371 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.371 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:44.371 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.203471+0000", 2024-04-19T03:02:44.371 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4818999999999999e-05 2024-04-19T03:02:44.371 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:44.371 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:44.371 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:44.371 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.372 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.372 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87067 5.b 5:d57af71a:::benchmark_data_smithi096_19531_object87066:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:44.372 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.142233+0000", 2024-04-19T03:02:44.372 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 21.176425779999999, 2024-04-19T03:02:44.372 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.071692405000000001, 2024-04-19T03:02:44.372 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:44.372 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:44.372 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:44.372 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:44.372 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:44.372 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87067 2024-04-19T03:02:44.372 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.372 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:44.373 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.373 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:44.373 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142233+0000", 2024-04-19T03:02:44.373 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:44.373 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.373 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.373 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:44.373 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142233+0000", 2024-04-19T03:02:44.373 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:44.373 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.373 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.373 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:44.373 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142232+0000", 2024-04-19T03:02:44.373 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:44.373 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.374 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.374 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:44.374 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142277+0000", 2024-04-19T03:02:44.374 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5837000000000002e-05 2024-04-19T03:02:44.374 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.374 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.374 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:44.374 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142297+0000", 2024-04-19T03:02:44.374 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9561000000000001e-05 2024-04-19T03:02:44.374 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.374 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.374 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:44.374 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142311+0000", 2024-04-19T03:02:44.375 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3654e-05 2024-04-19T03:02:44.375 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.375 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.375 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:44.375 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142391+0000", 2024-04-19T03:02:44.375 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0123999999999994e-05 2024-04-19T03:02:44.375 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.375 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.375 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:44.375 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142669+0000", 2024-04-19T03:02:44.375 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00027829800000000001 2024-04-19T03:02:44.375 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.375 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.375 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:44.376 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142859+0000", 2024-04-19T03:02:44.376 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000190051 2024-04-19T03:02:44.376 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.376 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.376 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:44.376 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.150597+0000", 2024-04-19T03:02:44.376 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0077380299999999999 2024-04-19T03:02:44.376 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.376 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.376 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:44.376 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.213855+0000", 2024-04-19T03:02:44.376 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.063257987000000002 2024-04-19T03:02:44.376 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.376 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.376 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:44.377 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.213898+0000", 2024-04-19T03:02:44.377 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2916e-05 2024-04-19T03:02:44.377 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.377 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.377 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:44.377 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.213925+0000", 2024-04-19T03:02:44.377 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7503000000000001e-05 2024-04-19T03:02:44.377 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:44.377 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:44.377 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:44.377 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.377 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.377 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87069 5.b 5:da0c93b5:::benchmark_data_smithi096_19531_object87068:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:44.377 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.143402+0000", 2024-04-19T03:02:44.377 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 21.175256818000001, 2024-04-19T03:02:44.378 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.070678598999999995, 2024-04-19T03:02:44.378 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:44.378 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:44.378 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:44.378 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:44.378 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:44.378 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87069 2024-04-19T03:02:44.378 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.378 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:44.378 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.378 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:44.378 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.143402+0000", 2024-04-19T03:02:44.378 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:44.379 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.379 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.379 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:44.379 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.143402+0000", 2024-04-19T03:02:44.379 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:44.379 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.379 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.379 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:44.379 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.143401+0000", 2024-04-19T03:02:44.379 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:44.379 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.379 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.379 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:44.379 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.143501+0000", 2024-04-19T03:02:44.379 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000100387 2024-04-19T03:02:44.380 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.380 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.380 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:44.380 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.143516+0000", 2024-04-19T03:02:44.380 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5369000000000001e-05 2024-04-19T03:02:44.380 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.380 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.380 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:44.380 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.143524+0000", 2024-04-19T03:02:44.380 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.7079999999999997e-06 2024-04-19T03:02:44.380 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.380 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.380 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:44.380 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.145550+0000", 2024-04-19T03:02:44.380 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0020259290000000001 2024-04-19T03:02:44.381 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.381 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.381 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:44.381 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.145676+0000", 2024-04-19T03:02:44.381 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000126406 2024-04-19T03:02:44.381 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.381 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.381 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:44.381 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.145802+0000", 2024-04-19T03:02:44.381 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000125974 2024-04-19T03:02:44.381 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.381 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.381 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:44.381 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.151030+0000", 2024-04-19T03:02:44.382 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0052276079999999999 2024-04-19T03:02:44.382 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.382 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.382 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:44.382 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.213998+0000", 2024-04-19T03:02:44.382 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.06296786 2024-04-19T03:02:44.382 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.382 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.382 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:44.382 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.214031+0000", 2024-04-19T03:02:44.382 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3387999999999999e-05 2024-04-19T03:02:44.382 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.382 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.382 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:44.383 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.214081+0000", 2024-04-19T03:02:44.383 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9316e-05 2024-04-19T03:02:44.383 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:44.383 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:44.383 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:44.383 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.383 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.383 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87073 5.0 5:0ca21233:::benchmark_data_smithi096_19531_object87072:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:44.383 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.145929+0000", 2024-04-19T03:02:44.383 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 21.172729558, 2024-04-19T03:02:44.383 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.062283234999999999, 2024-04-19T03:02:44.383 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:44.383 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:44.383 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:44.384 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:44.384 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:44.384 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87073 2024-04-19T03:02:44.384 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.384 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:44.384 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.384 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:44.384 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.145929+0000", 2024-04-19T03:02:44.384 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:44.384 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.384 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.384 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:44.384 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.145929+0000", 2024-04-19T03:02:44.385 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:44.385 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.385 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.385 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:44.385 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.145928+0000", 2024-04-19T03:02:44.385 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:44.385 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.385 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.385 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:44.385 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.146063+0000", 2024-04-19T03:02:44.385 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013541099999999999 2024-04-19T03:02:44.385 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.385 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.385 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:44.386 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.146079+0000", 2024-04-19T03:02:44.386 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5902000000000001e-05 2024-04-19T03:02:44.386 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.386 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.386 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:44.386 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.146100+0000", 2024-04-19T03:02:44.386 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0380000000000001e-05 2024-04-19T03:02:44.386 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.386 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.386 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:44.386 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.146193+0000", 2024-04-19T03:02:44.386 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.3669000000000001e-05 2024-04-19T03:02:44.387 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.387 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.387 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:44.387 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.146388+0000", 2024-04-19T03:02:44.387 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00019457799999999999 2024-04-19T03:02:44.387 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.387 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.387 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:44.387 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.146625+0000", 2024-04-19T03:02:44.387 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00023751999999999999 2024-04-19T03:02:44.387 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.387 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.387 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:44.387 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.151051+0000", 2024-04-19T03:02:44.388 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0044260039999999999 2024-04-19T03:02:44.388 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.388 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.388 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:44.388 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.207872+0000", 2024-04-19T03:02:44.388 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.056821114999999998 2024-04-19T03:02:44.388 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.388 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.388 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:44.388 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.208085+0000", 2024-04-19T03:02:44.388 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000212893 2024-04-19T03:02:44.388 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.388 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.389 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:44.389 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.208213+0000", 2024-04-19T03:02:44.389 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012714700000000001 2024-04-19T03:02:44.389 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:44.389 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:44.389 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:44.389 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.389 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.389 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87074 5.0 5:035614ac:::benchmark_data_smithi096_19531_object87073:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:44.389 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.151387+0000", 2024-04-19T03:02:44.389 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 21.167271627000002, 2024-04-19T03:02:44.389 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.063461771, 2024-04-19T03:02:44.389 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:44.389 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:44.390 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:44.390 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:44.390 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:44.390 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87074 2024-04-19T03:02:44.390 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.390 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:44.390 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.390 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:44.390 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.151387+0000", 2024-04-19T03:02:44.390 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:44.390 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.390 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.390 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:44.391 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.151387+0000", 2024-04-19T03:02:44.391 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:44.391 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.391 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.391 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:44.391 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.151386+0000", 2024-04-19T03:02:44.391 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:44.391 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.391 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.391 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:44.391 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.151428+0000", 2024-04-19T03:02:44.391 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.172e-05 2024-04-19T03:02:44.391 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.391 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.392 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:44.392 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.151442+0000", 2024-04-19T03:02:44.392 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4328000000000001e-05 2024-04-19T03:02:44.392 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.392 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.392 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:44.392 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.151451+0000", 2024-04-19T03:02:44.392 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.8400000000000001e-06 2024-04-19T03:02:44.392 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.392 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.392 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:44.392 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.151521+0000", 2024-04-19T03:02:44.393 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.9606999999999999e-05 2024-04-19T03:02:44.393 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.393 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.393 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:44.394 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.151749+0000", 2024-04-19T03:02:44.394 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00022818799999999999 2024-04-19T03:02:44.394 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.394 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.394 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:44.394 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.152006+0000", 2024-04-19T03:02:44.394 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00025687300000000002 2024-04-19T03:02:44.394 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.394 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.394 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:44.394 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.154887+0000", 2024-04-19T03:02:44.394 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0028812989999999999 2024-04-19T03:02:44.394 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.394 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.395 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:44.395 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.214733+0000", 2024-04-19T03:02:44.395 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.059846159000000003 2024-04-19T03:02:44.395 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.395 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.395 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:44.395 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.214788+0000", 2024-04-19T03:02:44.395 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4524000000000002e-05 2024-04-19T03:02:44.395 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.395 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.395 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:44.395 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.214849+0000", 2024-04-19T03:02:44.395 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1362e-05 2024-04-19T03:02:44.396 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:44.396 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:44.396 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:44.396 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.396 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.396 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87108 5.e 5:7e197adc:::benchmark_data_smithi096_19531_object87107:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:44.396 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.223103+0000", 2024-04-19T03:02:44.396 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 21.095555481000002, 2024-04-19T03:02:44.396 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.044946887, 2024-04-19T03:02:44.396 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:44.396 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-19T03:02:44.396 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:44.396 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:44.397 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:44.397 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87108 2024-04-19T03:02:44.397 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.397 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:44.397 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.397 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:44.397 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.223103+0000", 2024-04-19T03:02:44.397 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:44.397 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.397 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.397 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:44.397 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.223103+0000", 2024-04-19T03:02:44.397 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:44.398 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.398 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.398 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:44.398 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.223102+0000", 2024-04-19T03:02:44.398 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:44.398 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.398 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.398 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:44.398 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.223156+0000", 2024-04-19T03:02:44.398 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3958000000000001e-05 2024-04-19T03:02:44.398 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.398 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.398 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:44.399 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.223166+0000", 2024-04-19T03:02:44.399 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.4809999999999995e-06 2024-04-19T03:02:44.399 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.399 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.399 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:44.399 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.223172+0000", 2024-04-19T03:02:44.399 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0140000000000004e-06 2024-04-19T03:02:44.399 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.399 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.399 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:44.399 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.227295+0000", 2024-04-19T03:02:44.399 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0041233420000000003 2024-04-19T03:02:44.399 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.400 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.400 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:44.400 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.227495+0000", 2024-04-19T03:02:44.400 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00019955299999999999 2024-04-19T03:02:44.400 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.400 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.400 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:44.400 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.227717+0000", 2024-04-19T03:02:44.400 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000221902 2024-04-19T03:02:44.400 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.400 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.400 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:44.401 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233189+0000", 2024-04-19T03:02:44.401 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0054718889999999997 2024-04-19T03:02:44.401 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.401 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.401 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:44.401 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.250529+0000", 2024-04-19T03:02:44.401 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.017340298000000001 2024-04-19T03:02:44.401 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.401 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.401 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:02:44.401 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.250539+0000", 2024-04-19T03:02:44.401 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0501e-05 2024-04-19T03:02:44.401 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.402 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.402 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:44.402 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.268003+0000", 2024-04-19T03:02:44.402 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.017463429 2024-04-19T03:02:44.402 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.402 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.402 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:44.402 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.268050+0000", 2024-04-19T03:02:44.402 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7466000000000003e-05 2024-04-19T03:02:44.402 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:44.402 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:44.402 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:44.402 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.403 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.403 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87118 5.b 5:d1bb4f3c:::benchmark_data_smithi096_19531_object87117:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:44.403 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.231082+0000", 2024-04-19T03:02:44.403 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 21.087576646999999, 2024-04-19T03:02:44.403 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.035789004, 2024-04-19T03:02:44.403 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:44.403 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-19T03:02:44.403 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:44.403 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:44.403 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:44.403 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87118 2024-04-19T03:02:44.403 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.403 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:44.404 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.404 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:44.404 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231082+0000", 2024-04-19T03:02:44.404 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:44.404 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.404 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.404 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:44.404 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231082+0000", 2024-04-19T03:02:44.404 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:44.404 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.404 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.404 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:44.404 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231081+0000", 2024-04-19T03:02:44.404 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:44.405 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.405 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.405 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:44.405 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231159+0000", 2024-04-19T03:02:44.405 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.7819999999999997e-05 2024-04-19T03:02:44.405 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.405 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.405 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:44.405 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231186+0000", 2024-04-19T03:02:44.405 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7126000000000001e-05 2024-04-19T03:02:44.405 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.405 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.405 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:44.406 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231193+0000", 2024-04-19T03:02:44.406 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7259999999999996e-06 2024-04-19T03:02:44.406 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.406 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.406 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:44.406 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231241+0000", 2024-04-19T03:02:44.406 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8123e-05 2024-04-19T03:02:44.406 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.406 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.406 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:44.406 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231354+0000", 2024-04-19T03:02:44.406 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0001133 2024-04-19T03:02:44.406 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.407 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.407 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:44.407 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231443+0000", 2024-04-19T03:02:44.407 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9167999999999997e-05 2024-04-19T03:02:44.407 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.407 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.407 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:44.407 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236498+0000", 2024-04-19T03:02:44.407 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0050545160000000002 2024-04-19T03:02:44.407 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.407 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.407 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:44.407 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.249681+0000", 2024-04-19T03:02:44.408 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013183321 2024-04-19T03:02:44.408 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.408 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.408 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:02:44.408 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.249693+0000", 2024-04-19T03:02:44.408 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1834999999999999e-05 2024-04-19T03:02:44.408 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.408 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.408 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:44.408 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266733+0000", 2024-04-19T03:02:44.408 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.017040408 2024-04-19T03:02:44.408 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.408 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.408 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:44.409 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266871+0000", 2024-04-19T03:02:44.409 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000137849 2024-04-19T03:02:44.409 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:44.409 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:44.409 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:44.409 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.409 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.409 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87121 5.b 5:d01822b8:::benchmark_data_smithi096_19531_object87120:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:44.409 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.233319+0000", 2024-04-19T03:02:44.409 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 21.085339782999998, 2024-04-19T03:02:44.409 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.033624198, 2024-04-19T03:02:44.409 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:44.409 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-19T03:02:44.410 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:44.410 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:44.410 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:44.410 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87121 2024-04-19T03:02:44.410 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.410 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:44.410 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.410 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:44.410 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233319+0000", 2024-04-19T03:02:44.410 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:44.410 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.410 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.410 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:44.410 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233319+0000", 2024-04-19T03:02:44.411 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:44.411 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.411 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.411 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:44.411 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233319+0000", 2024-04-19T03:02:44.411 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:44.411 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.411 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.411 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:44.411 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233364+0000", 2024-04-19T03:02:44.411 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5460999999999997e-05 2024-04-19T03:02:44.411 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.411 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.412 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:44.412 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233382+0000", 2024-04-19T03:02:44.412 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8148e-05 2024-04-19T03:02:44.412 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.412 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.412 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:44.412 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233390+0000", 2024-04-19T03:02:44.412 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5340000000000002e-06 2024-04-19T03:02:44.412 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.412 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.412 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:44.412 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233712+0000", 2024-04-19T03:02:44.412 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00032260500000000001 2024-04-19T03:02:44.412 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.412 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.413 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:44.413 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233829+0000", 2024-04-19T03:02:44.413 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011638599999999999 2024-04-19T03:02:44.413 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.413 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.413 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:44.413 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233959+0000", 2024-04-19T03:02:44.413 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013013900000000001 2024-04-19T03:02:44.413 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.413 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.413 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:44.413 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236515+0000", 2024-04-19T03:02:44.413 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0025562750000000002 2024-04-19T03:02:44.413 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.413 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.414 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:44.414 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.249723+0000", 2024-04-19T03:02:44.414 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013208176 2024-04-19T03:02:44.414 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.414 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.414 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:02:44.414 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.249728+0000", 2024-04-19T03:02:44.414 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6519999999999997e-06 2024-04-19T03:02:44.414 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.414 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.414 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:44.414 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266837+0000", 2024-04-19T03:02:44.414 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0171087059999999 2024-04-19T03:02:44.415 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.415 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.415 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:44.415 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266943+0000", 2024-04-19T03:02:44.415 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000106604 2024-04-19T03:02:44.415 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:44.415 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:44.415 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:44.415 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.415 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.415 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87124 5.8 5:14819ad7:::benchmark_data_smithi096_19531_object87123:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:44.415 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.235886+0000", 2024-04-19T03:02:44.415 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 21.082772359, 2024-04-19T03:02:44.416 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0315451179999999, 2024-04-19T03:02:44.416 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:44.416 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-19T03:02:44.416 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:44.416 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:44.416 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:44.416 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87124 2024-04-19T03:02:44.416 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.416 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:44.416 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.416 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:44.416 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.235886+0000", 2024-04-19T03:02:44.416 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:44.416 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.416 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.417 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:44.417 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.235886+0000", 2024-04-19T03:02:44.417 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:44.417 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.417 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.417 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:44.417 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.235886+0000", 2024-04-19T03:02:44.417 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:44.417 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.417 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.417 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:44.417 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.235934+0000", 2024-04-19T03:02:44.417 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8384000000000003e-05 2024-04-19T03:02:44.418 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.418 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.418 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:44.418 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.235945+0000", 2024-04-19T03:02:44.418 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0671e-05 2024-04-19T03:02:44.418 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.418 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.418 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:44.418 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.235952+0000", 2024-04-19T03:02:44.418 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3089999999999998e-06 2024-04-19T03:02:44.418 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.418 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.418 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:44.418 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.237067+0000", 2024-04-19T03:02:44.419 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001115263 2024-04-19T03:02:44.419 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.419 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.419 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:44.419 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.237188+0000", 2024-04-19T03:02:44.419 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000121258 2024-04-19T03:02:44.419 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.419 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.419 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:44.419 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.237316+0000", 2024-04-19T03:02:44.419 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000128071 2024-04-19T03:02:44.419 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.419 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.420 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:44.420 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240744+0000", 2024-04-19T03:02:44.420 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0034275629999999998 2024-04-19T03:02:44.420 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.420 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.420 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:44.420 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.252517+0000", 2024-04-19T03:02:44.420 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011772991999999999 2024-04-19T03:02:44.420 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.420 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.420 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:02:44.420 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.252523+0000", 2024-04-19T03:02:44.420 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3640000000000004e-06 2024-04-19T03:02:44.420 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.421 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.421 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:44.421 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.267290+0000", 2024-04-19T03:02:44.421 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0147665690000001 2024-04-19T03:02:44.421 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.421 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.421 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:44.421 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.267432+0000", 2024-04-19T03:02:44.421 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014165299999999999 2024-04-19T03:02:44.421 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:44.421 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:44.421 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:44.421 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.422 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.422 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87129 5.0 5:02667e01:::benchmark_data_smithi096_19531_object87128:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:44.422 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.236466+0000", 2024-04-19T03:02:44.422 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 21.082192363000001, 2024-04-19T03:02:44.422 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0301534510000001, 2024-04-19T03:02:44.422 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:44.422 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-19T03:02:44.422 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:44.422 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:44.422 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:44.422 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87129 2024-04-19T03:02:44.422 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.423 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:44.423 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.423 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:44.423 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236466+0000", 2024-04-19T03:02:44.423 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:44.423 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.423 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.423 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:44.423 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236466+0000", 2024-04-19T03:02:44.423 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:44.423 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.423 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.424 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:44.424 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236465+0000", 2024-04-19T03:02:44.424 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:44.424 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.424 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.424 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:44.424 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236566+0000", 2024-04-19T03:02:44.424 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010047000000000001 2024-04-19T03:02:44.424 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.424 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.424 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:44.424 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236577+0000", 2024-04-19T03:02:44.424 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1772e-05 2024-04-19T03:02:44.425 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.425 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.425 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:44.425 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236584+0000", 2024-04-19T03:02:44.425 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0530000000000003e-06 2024-04-19T03:02:44.425 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.425 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.425 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:44.425 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.237023+0000", 2024-04-19T03:02:44.425 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000439703 2024-04-19T03:02:44.425 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.425 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.425 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:44.426 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.237207+0000", 2024-04-19T03:02:44.426 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000183692 2024-04-19T03:02:44.426 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.426 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.426 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:44.426 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.237373+0000", 2024-04-19T03:02:44.426 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016623500000000001 2024-04-19T03:02:44.426 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.426 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.426 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:44.426 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.241461+0000", 2024-04-19T03:02:44.426 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0040883050000000004 2024-04-19T03:02:44.426 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.427 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.427 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:44.427 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.252500+0000", 2024-04-19T03:02:44.427 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011038450999999999 2024-04-19T03:02:44.427 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.427 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.427 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:02:44.427 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.252507+0000", 2024-04-19T03:02:44.427 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2439999999999996e-06 2024-04-19T03:02:44.427 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.427 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.427 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:44.427 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266538+0000", 2024-04-19T03:02:44.427 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.014031184 2024-04-19T03:02:44.428 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.428 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.428 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:44.428 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266620+0000", 2024-04-19T03:02:44.428 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1600000000000005e-05 2024-04-19T03:02:44.428 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:44.428 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:44.428 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:44.428 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.428 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.428 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87135 5.4 5:2a97e7b7:::benchmark_data_smithi096_19531_object87134:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:44.428 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.240884+0000", 2024-04-19T03:02:44.428 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 21.077774905999998, 2024-04-19T03:02:44.428 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.025708931, 2024-04-19T03:02:44.429 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:44.429 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-19T03:02:44.429 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:44.429 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:44.429 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:44.429 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87135 2024-04-19T03:02:44.429 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.429 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:44.429 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.429 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:44.429 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240884+0000", 2024-04-19T03:02:44.429 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:44.429 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.429 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.429 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:44.430 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240884+0000", 2024-04-19T03:02:44.430 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:44.430 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.430 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.430 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:44.430 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240883+0000", 2024-04-19T03:02:44.430 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:44.430 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.430 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.430 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:44.430 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240933+0000", 2024-04-19T03:02:44.430 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9969999999999998e-05 2024-04-19T03:02:44.430 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.431 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.431 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:44.431 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240946+0000", 2024-04-19T03:02:44.431 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2943e-05 2024-04-19T03:02:44.431 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.431 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.431 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:44.431 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240952+0000", 2024-04-19T03:02:44.431 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8930000000000002e-06 2024-04-19T03:02:44.431 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.431 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.431 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:44.431 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240994+0000", 2024-04-19T03:02:44.431 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2753999999999998e-05 2024-04-19T03:02:44.432 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.432 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.432 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:44.432 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.241092+0000", 2024-04-19T03:02:44.432 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.7447000000000004e-05 2024-04-19T03:02:44.432 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.432 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.432 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:44.432 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.241183+0000", 2024-04-19T03:02:44.432 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1163999999999997e-05 2024-04-19T03:02:44.432 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.432 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.432 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:44.432 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.254672+0000", 2024-04-19T03:02:44.432 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.01348864 2024-04-19T03:02:44.433 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.433 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.433 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:02:44.433 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.254681+0000", 2024-04-19T03:02:44.433 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.3789999999999995e-06 2024-04-19T03:02:44.433 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.433 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.433 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:44.433 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266456+0000", 2024-04-19T03:02:44.433 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.011774621 2024-04-19T03:02:44.433 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.433 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.433 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:44.433 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266593+0000", 2024-04-19T03:02:44.434 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013737600000000001 2024-04-19T03:02:44.434 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:44.434 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:44.434 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:44.434 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.434 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.434 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87136 5.4 5:212411bc:::benchmark_data_smithi096_19531_object87135:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:44.434 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.240962+0000", 2024-04-19T03:02:44.434 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 21.07769703, 2024-04-19T03:02:44.434 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.025738, 2024-04-19T03:02:44.434 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:44.434 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-19T03:02:44.434 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:44.434 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:44.434 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:44.435 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87136 2024-04-19T03:02:44.435 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.435 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:44.435 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.435 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:44.435 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240962+0000", 2024-04-19T03:02:44.435 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:44.435 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.435 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.435 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:44.435 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240962+0000", 2024-04-19T03:02:44.435 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:44.435 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.435 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.436 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:44.436 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240961+0000", 2024-04-19T03:02:44.436 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:44.436 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.436 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.436 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:44.436 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240995+0000", 2024-04-19T03:02:44.436 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3868000000000002e-05 2024-04-19T03:02:44.436 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.436 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.436 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:44.436 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.241001+0000", 2024-04-19T03:02:44.436 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.322e-06 2024-04-19T03:02:44.436 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.436 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.437 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:44.437 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.241004+0000", 2024-04-19T03:02:44.437 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3510000000000002e-06 2024-04-19T03:02:44.437 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.437 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.437 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:44.437 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247131+0000", 2024-04-19T03:02:44.437 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0061270869999999998 2024-04-19T03:02:44.437 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.437 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.437 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:44.437 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247322+0000", 2024-04-19T03:02:44.437 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000191015 2024-04-19T03:02:44.437 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.438 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.438 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:44.438 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247542+0000", 2024-04-19T03:02:44.438 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00022030199999999999 2024-04-19T03:02:44.438 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.438 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.438 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:44.438 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.254709+0000", 2024-04-19T03:02:44.438 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0071662660000000001 2024-04-19T03:02:44.438 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.438 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.438 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:02:44.438 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.254716+0000", 2024-04-19T03:02:44.438 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3860000000000001e-06 2024-04-19T03:02:44.439 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.439 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.439 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:44.439 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266619+0000", 2024-04-19T03:02:44.439 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0119031030000001 2024-04-19T03:02:44.439 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.439 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.439 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:44.439 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266700+0000", 2024-04-19T03:02:44.439 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0764000000000001e-05 2024-04-19T03:02:44.439 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:44.439 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:44.439 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:44.439 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.440 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.440 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87138 5.e 5:7b1f1c20:::benchmark_data_smithi096_19531_object87137:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:44.440 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.247862+0000", 2024-04-19T03:02:44.440 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 21.070796955999999, 2024-04-19T03:02:44.440 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.024457079, 2024-04-19T03:02:44.440 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:44.440 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:44.440 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:44.440 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:44.440 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:44.440 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87138 2024-04-19T03:02:44.440 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.440 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:44.440 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.441 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:44.441 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247862+0000", 2024-04-19T03:02:44.441 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:44.441 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.441 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.441 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:44.441 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247862+0000", 2024-04-19T03:02:44.441 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:44.441 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.441 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.441 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:44.441 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247860+0000", 2024-04-19T03:02:44.441 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999981 2024-04-19T03:02:44.441 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.441 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.442 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:44.442 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247909+0000", 2024-04-19T03:02:44.442 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9150999999999997e-05 2024-04-19T03:02:44.442 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.442 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.442 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:44.442 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247925+0000", 2024-04-19T03:02:44.442 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5761999999999999e-05 2024-04-19T03:02:44.442 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.442 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.442 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:44.442 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247936+0000", 2024-04-19T03:02:44.442 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1144e-05 2024-04-19T03:02:44.442 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.443 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.443 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:44.443 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.250590+0000", 2024-04-19T03:02:44.443 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.002653678 2024-04-19T03:02:44.443 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.443 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.443 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:02:44.443 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.250599+0000", 2024-04-19T03:02:44.443 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9039999999999998e-06 2024-04-19T03:02:44.443 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.443 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.443 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:44.443 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.268151+0000", 2024-04-19T03:02:44.443 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0175523449999999 2024-04-19T03:02:44.443 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.444 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.444 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:44.444 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.268285+0000", 2024-04-19T03:02:44.444 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013415599999999999 2024-04-19T03:02:44.444 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.444 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.444 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:44.444 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.272238+0000", 2024-04-19T03:02:44.444 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0039533019999999997 2024-04-19T03:02:44.444 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.444 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.444 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:44.444 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.272274+0000", 2024-04-19T03:02:44.444 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5352000000000003e-05 2024-04-19T03:02:44.444 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:44.445 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:44.445 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:44.445 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.272319+0000", 2024-04-19T03:02:44.445 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5281999999999998e-05 2024-04-19T03:02:44.445 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:44.445 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:44.445 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:44.445 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:44.445 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:44.445 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-19T03:02:44.446 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [0] live_osds: [1, 2] 2024-04-19T03:02:44.446 INFO:tasks.thrashosds.thrasher:Reviving osd 0 2024-04-19T03:02:44.446 INFO:tasks.ceph.ceph_manager.ceph:kill_osd on osd.0 doing powercycle of ubuntu@smithi097.front.sepia.ceph.com 2024-04-19T03:02:44.446 INFO:teuthology.orchestra.console.smithi097:Power on 2024-04-19T03:02:44.446 DEBUG:teuthology.orchestra.console.smithi097:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2024-04-19T03:02:44.456 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-19T03:02:44.457 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:44.445+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:44.458 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-19T03:02:44.459 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T03:02:44.459 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-19T03:02:44.471 DEBUG:teuthology.orchestra.console.smithi097:power on output: Chassis Power Control: Up/On 2024-04-19T03:02:44.471 DEBUG:teuthology.orchestra.console.smithi097:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-19T03:02:44.494 DEBUG:teuthology.orchestra.console.smithi097:check power output: Chassis Power is off 2024-04-19T03:02:44.547 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:44.545+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:44.591 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-04-19T03:02:44.592 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [ 2024-04-19T03:02:44.592 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:44.592 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:125006 5.3 5:c06d8fff:::benchmark_data_smithi096_19531_object11556:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-19T03:02:44.592 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:44.584572+0000", 2024-04-19T03:02:44.592 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0050952760000000001, 2024-04-19T03:02:44.592 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0051201600000000003, 2024-04-19T03:02:44.592 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:44.592 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-04-19T03:02:44.592 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:44.592 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:44.592 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:44.592 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 125006 2024-04-19T03:02:44.592 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:44.592 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:44.593 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:44.593 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:44.593 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:44.584572+0000", 2024-04-19T03:02:44.593 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:44.593 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:44.593 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:44.593 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:44.593 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:44.584572+0000", 2024-04-19T03:02:44.593 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:44.593 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:44.593 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:44.593 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:44.593 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:44.584571+0000", 2024-04-19T03:02:44.594 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:44.594 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:44.594 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:44.594 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:44.594 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:44.584577+0000", 2024-04-19T03:02:44.594 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3860000000000004e-06 2024-04-19T03:02:44.594 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:44.598 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:44.598 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:44.598 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:44.584591+0000", 2024-04-19T03:02:44.598 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4004e-05 2024-04-19T03:02:44.598 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:44.598 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:44.598 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:44.598 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:44.584605+0000", 2024-04-19T03:02:44.598 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4459e-05 2024-04-19T03:02:44.598 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:44.598 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:44.599 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:44.599 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:44.584680+0000", 2024-04-19T03:02:44.599 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4886000000000001e-05 2024-04-19T03:02:44.599 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:44.599 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:44.599 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:44.599 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:44.584837+0000", 2024-04-19T03:02:44.599 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00015646099999999999 2024-04-19T03:02:44.599 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:44.599 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:44.599 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:44.599 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:44.599 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:44.600 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:125009 5.f 5:ff99f76e:::benchmark_data_smithi096_19531_object11559:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-19T03:02:44.600 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:44.585813+0000", 2024-04-19T03:02:44.600 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0038537990000000002, 2024-04-19T03:02:44.600 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0039487360000000004, 2024-04-19T03:02:44.600 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:44.600 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:02:44.600 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:44.600 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:44.600 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:44.600 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 125009 2024-04-19T03:02:44.600 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:44.600 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:44.600 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:44.600 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:44.601 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:44.585813+0000", 2024-04-19T03:02:44.601 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:44.601 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:44.601 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:44.601 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:44.601 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:44.585813+0000", 2024-04-19T03:02:44.601 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:44.601 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:44.601 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:44.601 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:44.601 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:44.585812+0000", 2024-04-19T03:02:44.601 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:44.601 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:44.602 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:44.602 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:44.602 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:44.585816+0000", 2024-04-19T03:02:44.602 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1520000000000002e-06 2024-04-19T03:02:44.602 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:44.602 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:44.602 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:44.602 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:44.585822+0000", 2024-04-19T03:02:44.602 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5210000000000002e-06 2024-04-19T03:02:44.602 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:44.602 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:44.602 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:44.602 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:44.585826+0000", 2024-04-19T03:02:44.603 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.296e-06 2024-04-19T03:02:44.603 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:44.603 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:44.603 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:44.603 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:44.585859+0000", 2024-04-19T03:02:44.603 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2274000000000003e-05 2024-04-19T03:02:44.603 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:44.603 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:44.603 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:44.603 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:44.585949+0000", 2024-04-19T03:02:44.603 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.0416999999999998e-05 2024-04-19T03:02:44.603 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:44.603 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:44.604 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:02:44.604 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:44.586018+0000", 2024-04-19T03:02:44.604 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8758999999999997e-05 2024-04-19T03:02:44.604 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:44.604 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:44.604 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:44.604 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:44.604 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:44.604 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:125011 5.c 5:3e35b50d:::benchmark_data_smithi096_19531_object11561:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-19T03:02:44.604 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:44.586265+0000", 2024-04-19T03:02:44.604 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0034020309999999998, 2024-04-19T03:02:44.604 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0035649010000000001, 2024-04-19T03:02:44.604 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:44.604 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-04-19T03:02:44.605 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:44.605 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:44.605 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:44.605 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 125011 2024-04-19T03:02:44.605 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:44.605 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:44.605 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:44.605 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:44.605 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:44.586265+0000", 2024-04-19T03:02:44.605 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:44.605 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:44.605 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:44.605 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:44.606 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:44.586265+0000", 2024-04-19T03:02:44.606 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:44.606 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:44.606 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:44.606 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:44.606 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:44.586264+0000", 2024-04-19T03:02:44.606 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:44.606 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:44.606 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:44.606 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:44.606 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:44.586270+0000", 2024-04-19T03:02:44.606 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8239999999999996e-06 2024-04-19T03:02:44.606 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:44.607 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:44.607 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:44.607 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:44.586281+0000", 2024-04-19T03:02:44.607 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0947e-05 2024-04-19T03:02:44.607 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:44.607 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:44.607 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:44.607 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:44.586287+0000", 2024-04-19T03:02:44.607 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8360000000000003e-06 2024-04-19T03:02:44.607 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:44.607 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:44.607 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:44.608 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:44.586328+0000", 2024-04-19T03:02:44.608 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0716000000000001e-05 2024-04-19T03:02:44.608 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:44.608 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:44.608 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:44.608 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:44.586425+0000", 2024-04-19T03:02:44.608 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.6922000000000005e-05 2024-04-19T03:02:44.608 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:44.608 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:44.608 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:44.608 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:44.608 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:44.608 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:125012 5.d 5:b46458e0:::benchmark_data_smithi096_19531_object11562:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-19T03:02:44.609 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:44.586312+0000", 2024-04-19T03:02:44.609 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.003354737, 2024-04-19T03:02:44.609 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0035781139999999999, 2024-04-19T03:02:44.609 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:44.609 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:02:44.609 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:44.609 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:44.609 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:44.609 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 125012 2024-04-19T03:02:44.609 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:44.609 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:44.609 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:44.609 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:44.609 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:44.586312+0000", 2024-04-19T03:02:44.610 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:44.610 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:44.610 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:44.610 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:44.610 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:44.586312+0000", 2024-04-19T03:02:44.610 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:44.610 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:44.610 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:44.610 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:44.610 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:44.586311+0000", 2024-04-19T03:02:44.610 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:44.610 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:44.610 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:44.611 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:44.611 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:44.586315+0000", 2024-04-19T03:02:44.611 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7019999999999999e-06 2024-04-19T03:02:44.611 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:44.611 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:44.611 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:44.611 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:44.586327+0000", 2024-04-19T03:02:44.611 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1982e-05 2024-04-19T03:02:44.611 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:44.611 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:44.611 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:44.611 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:44.586335+0000", 2024-04-19T03:02:44.611 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6059999999999997e-06 2024-04-19T03:02:44.612 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:44.612 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:44.612 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:44.612 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:44.586378+0000", 2024-04-19T03:02:44.612 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2998999999999999e-05 2024-04-19T03:02:44.612 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:44.612 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:44.612 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:44.612 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:44.586502+0000", 2024-04-19T03:02:44.612 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00012437700000000001 2024-04-19T03:02:44.612 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:44.612 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:44.612 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:02:44.612 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:44.586619+0000", 2024-04-19T03:02:44.612 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000117002 2024-04-19T03:02:44.613 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:44.613 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:44.613 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:44.613 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:44.613 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:44.613 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:125013 5.3 5:c9711ad3:::benchmark_data_smithi096_19531_object11563:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-19T03:02:44.613 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:44.586355+0000", 2024-04-19T03:02:44.613 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0033120889999999998, 2024-04-19T03:02:44.613 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00360275, 2024-04-19T03:02:44.613 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:44.613 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-04-19T03:02:44.613 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:44.613 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:44.614 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:44.614 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 125013 2024-04-19T03:02:44.614 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:44.614 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:44.614 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:44.614 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:44.614 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:44.586355+0000", 2024-04-19T03:02:44.614 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:44.614 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:44.614 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:44.614 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:44.614 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:44.586355+0000", 2024-04-19T03:02:44.614 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:44.614 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:44.615 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:44.615 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:44.615 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:44.586354+0000", 2024-04-19T03:02:44.615 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:44.615 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:44.615 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:44.615 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:44.615 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:44.586358+0000", 2024-04-19T03:02:44.615 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3629999999999998e-06 2024-04-19T03:02:44.615 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:44.615 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:44.615 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:44.615 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:44.586367+0000", 2024-04-19T03:02:44.616 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.0299999999999999e-06 2024-04-19T03:02:44.616 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:44.616 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:44.616 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:44.616 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:44.586374+0000", 2024-04-19T03:02:44.616 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.956e-06 2024-04-19T03:02:44.616 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:44.616 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:44.616 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:44.616 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:44.587194+0000", 2024-04-19T03:02:44.616 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00082099400000000002 2024-04-19T03:02:44.616 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:44.616 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:44.616 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:44.617 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:44.587334+0000", 2024-04-19T03:02:44.617 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000139942 2024-04-19T03:02:44.617 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:44.617 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:44.617 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:44.617 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:44.617 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:44.617 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:125014 5.5 5:a9a0fdd2:::benchmark_data_smithi096_19531_object11564:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-19T03:02:44.617 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:44.586382+0000", 2024-04-19T03:02:44.617 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0032853050000000001, 2024-04-19T03:02:44.617 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0036360519999999999, 2024-04-19T03:02:44.617 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:44.617 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-04-19T03:02:44.617 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:44.618 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:44.618 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:44.618 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 125014 2024-04-19T03:02:44.618 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:44.618 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:44.618 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:44.618 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:44.618 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:44.586382+0000", 2024-04-19T03:02:44.618 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:44.618 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:44.618 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:44.618 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:44.618 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:44.586382+0000", 2024-04-19T03:02:44.618 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:44.619 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:44.619 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:44.619 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:44.619 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:44.586381+0000", 2024-04-19T03:02:44.619 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:44.619 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:44.619 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:44.619 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:44.619 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:44.586384+0000", 2024-04-19T03:02:44.619 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.4540000000000001e-06 2024-04-19T03:02:44.619 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:44.619 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:44.619 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:44.619 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:44.586391+0000", 2024-04-19T03:02:44.619 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0650000000000001e-06 2024-04-19T03:02:44.619 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:44.620 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:44.620 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:44.620 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:44.586395+0000", 2024-04-19T03:02:44.620 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6160000000000004e-06 2024-04-19T03:02:44.620 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:44.620 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:44.620 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:44.620 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:44.586425+0000", 2024-04-19T03:02:44.620 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9561e-05 2024-04-19T03:02:44.620 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:44.620 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:44.620 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:44.620 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:44.586539+0000", 2024-04-19T03:02:44.620 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000114515 2024-04-19T03:02:44.620 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:44.620 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:44.621 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:44.621 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:44.621 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:44.621 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:125015 5.f 5:f4eb16ac:::benchmark_data_smithi096_19531_object11565:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-19T03:02:44.621 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:44.586491+0000", 2024-04-19T03:02:44.621 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0031762370000000002, 2024-04-19T03:02:44.621 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0035982539999999999, 2024-04-19T03:02:44.621 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:44.621 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:02:44.621 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:44.621 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:44.621 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:44.621 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 125015 2024-04-19T03:02:44.621 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:44.621 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:44.622 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:44.622 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:44.622 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:44.586491+0000", 2024-04-19T03:02:44.622 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:44.622 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:44.622 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:44.622 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:44.622 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:44.586491+0000", 2024-04-19T03:02:44.622 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:44.622 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:44.622 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:44.622 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:44.622 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:44.586490+0000", 2024-04-19T03:02:44.623 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:44.623 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:44.623 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:44.623 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:44.623 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:44.586493+0000", 2024-04-19T03:02:44.623 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4989999999999999e-06 2024-04-19T03:02:44.623 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:44.623 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:44.623 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:44.623 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:44.586500+0000", 2024-04-19T03:02:44.623 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6080000000000001e-06 2024-04-19T03:02:44.623 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:44.623 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:44.623 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:44.624 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:44.586505+0000", 2024-04-19T03:02:44.624 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0209999999999999e-06 2024-04-19T03:02:44.624 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:44.624 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:44.624 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:44.624 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:44.588340+0000", 2024-04-19T03:02:44.624 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001834612 2024-04-19T03:02:44.624 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:44.624 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:44.624 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:44.624 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:44.588452+0000", 2024-04-19T03:02:44.624 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000112475 2024-04-19T03:02:44.624 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:44.625 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:44.625 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:02:44.625 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:44.588569+0000", 2024-04-19T03:02:44.625 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000117243 2024-04-19T03:02:44.625 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:44.625 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:44.625 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:44.625 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:44.625 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:44.625 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:125016 5.d 5:b9929317:::benchmark_data_smithi096_19531_object11566:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-19T03:02:44.625 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:44.586962+0000", 2024-04-19T03:02:44.625 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.002704382, 2024-04-19T03:02:44.625 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0031961989999999998, 2024-04-19T03:02:44.626 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:44.626 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:02:44.626 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:44.626 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:44.626 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:44.626 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 125016 2024-04-19T03:02:44.626 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:44.626 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:44.626 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:44.626 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:44.626 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:44.586962+0000", 2024-04-19T03:02:44.626 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:44.626 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:44.627 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:44.627 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:44.627 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:44.586962+0000", 2024-04-19T03:02:44.627 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:44.627 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:44.627 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:44.627 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:44.627 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:44.586962+0000", 2024-04-19T03:02:44.627 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:44.627 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:44.627 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:44.627 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:44.627 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:44.586969+0000", 2024-04-19T03:02:44.627 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8929999999999999e-06 2024-04-19T03:02:44.627 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:44.628 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:44.628 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:44.628 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:44.586984+0000", 2024-04-19T03:02:44.628 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.5869999999999999e-05 2024-04-19T03:02:44.628 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:44.628 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:44.628 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:44.628 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:44.586992+0000", 2024-04-19T03:02:44.628 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.3220000000000004e-06 2024-04-19T03:02:44.628 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:44.628 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:44.628 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:44.628 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:44.588580+0000", 2024-04-19T03:02:44.628 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001588182 2024-04-19T03:02:44.628 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:44.629 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:44.629 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:44.629 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:44.588705+0000", 2024-04-19T03:02:44.629 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000124824 2024-04-19T03:02:44.629 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:44.629 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:44.629 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:02:44.629 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:44.588820+0000", 2024-04-19T03:02:44.629 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000115658 2024-04-19T03:02:44.629 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:44.629 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:44.629 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:44.629 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:44.629 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:44.629 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:125019 5.2 5:40beb0ee:::benchmark_data_smithi096_19531_object11569:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-19T03:02:44.630 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:44.588331+0000", 2024-04-19T03:02:44.630 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0013360570000000001, 2024-04-19T03:02:44.630 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0018938360000000001, 2024-04-19T03:02:44.630 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:44.630 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-04-19T03:02:44.630 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:44.630 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:44.630 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:44.630 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 125019 2024-04-19T03:02:44.630 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:44.630 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:44.630 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:44.630 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:44.630 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:44.588331+0000", 2024-04-19T03:02:44.631 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:44.631 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:44.631 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:44.631 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:44.631 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:44.588331+0000", 2024-04-19T03:02:44.631 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:44.631 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:44.631 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:44.631 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:44.631 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:44.588330+0000", 2024-04-19T03:02:44.631 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:44.631 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:44.631 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:44.631 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:44.632 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:44.588336+0000", 2024-04-19T03:02:44.632 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8680000000000001e-06 2024-04-19T03:02:44.632 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:44.632 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:44.632 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:44.632 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:44.588347+0000", 2024-04-19T03:02:44.632 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0834e-05 2024-04-19T03:02:44.632 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:44.632 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:44.632 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:44.632 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:44.588355+0000", 2024-04-19T03:02:44.632 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4479999999999997e-06 2024-04-19T03:02:44.632 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:44.632 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:44.632 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:44.633 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:44.588434+0000", 2024-04-19T03:02:44.633 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9831000000000002e-05 2024-04-19T03:02:44.633 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:44.633 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:44.633 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:44.633 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:44.588570+0000", 2024-04-19T03:02:44.633 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00013540000000000001 2024-04-19T03:02:44.633 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:44.633 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:44.633 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:44.633 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:44.633 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:44.633 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:125020 5.d 5.6564189d (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-19T03:02:44.634 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:44.590070+0000", 2024-04-19T03:02:44.634 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4294967295.9995971, 2024-04-19T03:02:44.634 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00021331900000000001, 2024-04-19T03:02:44.634 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:44.634 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-04-19T03:02:44.634 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:44.634 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:44.634 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:44.634 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 125020 2024-04-19T03:02:44.634 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:44.634 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:44.634 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:44.634 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:44.634 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:44.590070+0000", 2024-04-19T03:02:44.635 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:44.635 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:44.635 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:44.635 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:44.635 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:44.590070+0000", 2024-04-19T03:02:44.635 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:44.635 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:44.635 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:44.635 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:44.635 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:44.590069+0000", 2024-04-19T03:02:44.635 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:44.635 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:44.635 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:44.635 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:44.636 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:44.590078+0000", 2024-04-19T03:02:44.636 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.8880000000000003e-06 2024-04-19T03:02:44.636 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:44.636 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:44.636 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:44.636 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:44.590090+0000", 2024-04-19T03:02:44.636 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2337000000000001e-05 2024-04-19T03:02:44.636 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:44.636 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:44.636 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:44.636 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:44.590098+0000", 2024-04-19T03:02:44.636 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8469999999999996e-06 2024-04-19T03:02:44.636 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:44.636 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:44.637 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:44.637 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:44.637 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:44.637 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:125021 5.d 5.c74b2b4d (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-19T03:02:44.637 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:44.590109+0000", 2024-04-19T03:02:44.637 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4294967295.999558, 2024-04-19T03:02:44.637 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000224117, 2024-04-19T03:02:44.637 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:44.637 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-04-19T03:02:44.637 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:44.637 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:44.637 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:44.637 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 125021 2024-04-19T03:02:44.637 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:44.638 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:44.638 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:44.638 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:44.638 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:44.590109+0000", 2024-04-19T03:02:44.638 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:44.638 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:44.638 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:44.638 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:44.638 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:44.590109+0000", 2024-04-19T03:02:44.638 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:44.638 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:44.638 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:44.638 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:44.639 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:44.590108+0000", 2024-04-19T03:02:44.639 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:44.639 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:44.639 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:44.639 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:44.639 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:44.590112+0000", 2024-04-19T03:02:44.639 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2880000000000001e-06 2024-04-19T03:02:44.639 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:44.639 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:44.639 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:44.639 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:44.590119+0000", 2024-04-19T03:02:44.639 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5410000000000003e-06 2024-04-19T03:02:44.639 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:44.639 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:44.639 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:44.640 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:44.590125+0000", 2024-04-19T03:02:44.640 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8710000000000002e-06 2024-04-19T03:02:44.640 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:44.640 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:44.640 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:44.640 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:44.640 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:44.640 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:125022 5.2 5.d8342e62 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-19T03:02:44.640 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:44.590313+0000", 2024-04-19T03:02:44.640 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4294967295.9993539, 2024-04-19T03:02:44.640 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0494000000000006e-05, 2024-04-19T03:02:44.640 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:44.640 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-04-19T03:02:44.640 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:44.641 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:44.641 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:44.641 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 125022 2024-04-19T03:02:44.641 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:44.641 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:44.641 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:44.641 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:44.641 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:44.590313+0000", 2024-04-19T03:02:44.641 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:44.641 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:44.641 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:44.641 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:44.641 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:44.590313+0000", 2024-04-19T03:02:44.641 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:44.642 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:44.642 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:44.642 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:44.642 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:44.590312+0000", 2024-04-19T03:02:44.642 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:44.642 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:44.642 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:44.642 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:44.642 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:44.590316+0000", 2024-04-19T03:02:44.642 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1139999999999999e-06 2024-04-19T03:02:44.642 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:44.642 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:44.642 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:44.643 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:44.590324+0000", 2024-04-19T03:02:44.643 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6550000000000004e-06 2024-04-19T03:02:44.643 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:44.643 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:44.643 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:44.643 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:44.590330+0000", 2024-04-19T03:02:44.643 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9050000000000002e-06 2024-04-19T03:02:44.643 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:44.643 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:44.643 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:44.643 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:44.643 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:44.643 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:125023 5.7 5:e8bcb56b:::benchmark_data_smithi096_19531_object11573:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-19T03:02:44.643 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:44.590348+0000", 2024-04-19T03:02:44.644 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4294967295.9993191, 2024-04-19T03:02:44.644 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.8875999999999994e-05, 2024-04-19T03:02:44.644 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:44.644 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-04-19T03:02:44.644 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:44.644 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:44.644 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:44.644 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 125023 2024-04-19T03:02:44.644 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:44.644 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:44.644 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:44.644 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:44.644 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:44.590348+0000", 2024-04-19T03:02:44.644 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:44.645 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:44.645 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:44.645 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:44.645 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:44.590348+0000", 2024-04-19T03:02:44.645 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:44.645 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:44.645 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:44.645 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:44.645 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:44.590347+0000", 2024-04-19T03:02:44.645 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:44.645 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:44.645 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:44.645 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:44.645 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:44.590350+0000", 2024-04-19T03:02:44.646 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7580000000000001e-06 2024-04-19T03:02:44.646 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:44.646 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:44.646 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:44.646 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:44.590359+0000", 2024-04-19T03:02:44.646 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.7809999999999994e-06 2024-04-19T03:02:44.646 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:44.646 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:44.646 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:44.646 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:44.590364+0000", 2024-04-19T03:02:44.646 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2730000000000002e-06 2024-04-19T03:02:44.646 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:44.646 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:44.646 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:44.647 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:44.590407+0000", 2024-04-19T03:02:44.647 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3368000000000002e-05 2024-04-19T03:02:44.647 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:44.647 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:44.647 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:44.647 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:44.647 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:44.647 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop_reply(client.4755.0:125012 5.d e51/49)", 2024-04-19T03:02:44.647 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:44.590375+0000", 2024-04-19T03:02:44.647 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4294967295.9992924, 2024-04-19T03:02:44.647 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000114886, 2024-04-19T03:02:44.647 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:44.647 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-04-19T03:02:44.647 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:44.648 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:44.648 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:44.648 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:44.590375+0000", 2024-04-19T03:02:44.648 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:44.648 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:44.648 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:44.648 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:44.648 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:44.590375+0000", 2024-04-19T03:02:44.648 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:44.648 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:44.648 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:44.648 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:44.648 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:44.590373+0000", 2024-04-19T03:02:44.648 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:44.648 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:44.649 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:44.649 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:44.649 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:44.590380+0000", 2024-04-19T03:02:44.649 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7120000000000003e-06 2024-04-19T03:02:44.649 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:44.649 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:44.649 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:44.649 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:44.590390+0000", 2024-04-19T03:02:44.649 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0096e-05 2024-04-19T03:02:44.649 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:44.649 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:44.649 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:44.649 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:44.590397+0000", 2024-04-19T03:02:44.649 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8979999999999999e-06 2024-04-19T03:02:44.649 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:44.650 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:44.650 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:44.650 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:44.650 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:44.650 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop_reply(client.4755.0:125009 5.f e51/22)", 2024-04-19T03:02:44.650 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:44.590407+0000", 2024-04-19T03:02:44.650 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4294967295.9992599, 2024-04-19T03:02:44.650 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00012679799999999999, 2024-04-19T03:02:44.650 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:44.650 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-04-19T03:02:44.650 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:44.650 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:44.650 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:44.651 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:44.590407+0000", 2024-04-19T03:02:44.651 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:44.651 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:44.651 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:44.651 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:44.651 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:44.590407+0000", 2024-04-19T03:02:44.651 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:44.651 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:44.651 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:44.651 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:44.651 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:44.590406+0000", 2024-04-19T03:02:44.651 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:44.651 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:44.651 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:44.651 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:44.652 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:44.590409+0000", 2024-04-19T03:02:44.652 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.8600000000000001e-06 2024-04-19T03:02:44.652 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:44.652 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:44.652 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:44.652 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:44.590422+0000", 2024-04-19T03:02:44.652 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2876e-05 2024-04-19T03:02:44.652 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:44.652 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:44.652 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:44.652 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:44.590430+0000", 2024-04-19T03:02:44.652 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8080000000000005e-06 2024-04-19T03:02:44.652 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:44.652 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:44.653 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:44.653 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:44.653 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-04-19T03:02:44.653 INFO:teuthology.orchestra.run.smithi144.stdout: "num_ops": 15 2024-04-19T03:02:44.653 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-04-19T03:02:44.654 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T03:02:44.655 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:44.653+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:44.755 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:44.753+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:44.786 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-04-19T03:02:44.786 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2024-04-19T03:02:44.786 INFO:teuthology.orchestra.run.smithi144.stdout: "complaint_time": 30, 2024-04-19T03:02:44.786 INFO:teuthology.orchestra.run.smithi144.stdout: "num_blocked_ops": 0 2024-04-19T03:02:44.786 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-04-19T03:02:44.802 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T03:02:44.856 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:44.853+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:44.956 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:44.953+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:44.971 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-04-19T03:02:44.971 INFO:teuthology.orchestra.run.smithi144.stdout: "size": 20, 2024-04-19T03:02:44.971 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 600, 2024-04-19T03:02:44.971 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [ 2024-04-19T03:02:44.971 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:44.971 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:78992 5.7 5:e6baa862:::benchmark_data_smithi096_19531_object78991:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-19T03:02:44.971 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:18.008888+0000", 2024-04-19T03:02:44.971 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 26.958948454000002, 2024-04-19T03:02:44.971 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.056375285999999997, 2024-04-19T03:02:44.971 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:44.972 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:44.972 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:44.972 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:44.972 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:44.972 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 78992 2024-04-19T03:02:44.972 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:44.972 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:44.972 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:44.972 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:44.972 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.008888+0000", 2024-04-19T03:02:44.972 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:44.972 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:44.972 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:44.972 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:44.973 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.008888+0000", 2024-04-19T03:02:44.973 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:44.973 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:44.973 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:44.973 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:44.973 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.008888+0000", 2024-04-19T03:02:44.973 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:44.973 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:44.973 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:44.973 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:44.973 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.008928+0000", 2024-04-19T03:02:44.973 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0361999999999997e-05 2024-04-19T03:02:44.973 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:44.973 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:44.974 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:44.974 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.008942+0000", 2024-04-19T03:02:44.974 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4365000000000001e-05 2024-04-19T03:02:44.974 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:44.974 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:44.974 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:44.974 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.008949+0000", 2024-04-19T03:02:44.974 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.212e-06 2024-04-19T03:02:44.974 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:44.974 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:44.974 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:44.974 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.012683+0000", 2024-04-19T03:02:44.974 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.003733934 2024-04-19T03:02:44.975 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:44.975 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:44.975 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:44.975 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.012798+0000", 2024-04-19T03:02:44.975 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00011574999999999999 2024-04-19T03:02:44.975 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:44.975 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:44.975 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:44.975 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.012896+0000", 2024-04-19T03:02:44.975 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.7848000000000002e-05 2024-04-19T03:02:44.975 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:44.975 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:44.976 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:44.976 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016423+0000", 2024-04-19T03:02:44.976 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0035270789999999998 2024-04-19T03:02:44.976 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:44.976 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:44.976 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:44.976 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.065098+0000", 2024-04-19T03:02:44.976 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.048674651999999999 2024-04-19T03:02:44.976 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:44.976 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:44.976 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:44.976 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.065193+0000", 2024-04-19T03:02:44.976 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.5087999999999995e-05 2024-04-19T03:02:44.976 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:44.977 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:44.977 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:44.977 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.065264+0000", 2024-04-19T03:02:44.977 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0666000000000004e-05 2024-04-19T03:02:44.977 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:44.977 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:44.977 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:44.977 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:44.977 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:44.977 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:78998 5.7 5:ee23c1bc:::benchmark_data_smithi096_19531_object78997:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-19T03:02:44.977 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:18.013165+0000", 2024-04-19T03:02:44.977 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 26.954671747999999, 2024-04-19T03:02:44.977 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.052410864000000001, 2024-04-19T03:02:44.977 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:44.978 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:44.978 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:44.978 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:44.978 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:44.978 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 78998 2024-04-19T03:02:44.978 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:44.978 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:44.978 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:44.978 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:44.978 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.013165+0000", 2024-04-19T03:02:44.978 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:44.978 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:44.978 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:44.979 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:44.979 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.013165+0000", 2024-04-19T03:02:44.979 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:44.979 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:44.979 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:44.979 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:44.979 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.013164+0000", 2024-04-19T03:02:44.979 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:44.979 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:44.979 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:44.979 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:44.979 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.013214+0000", 2024-04-19T03:02:44.979 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9636999999999999e-05 2024-04-19T03:02:44.980 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:44.980 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:44.980 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:44.980 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.013223+0000", 2024-04-19T03:02:44.980 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.3619999999999995e-06 2024-04-19T03:02:44.980 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:44.980 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:44.980 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:44.980 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.013229+0000", 2024-04-19T03:02:44.980 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6060000000000002e-06 2024-04-19T03:02:44.980 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:44.980 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:44.980 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:44.980 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.014882+0000", 2024-04-19T03:02:44.980 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001653257 2024-04-19T03:02:44.981 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:44.981 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:44.981 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:44.981 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.014958+0000", 2024-04-19T03:02:44.981 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6398999999999998e-05 2024-04-19T03:02:44.981 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:44.981 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:44.981 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:44.981 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.015036+0000", 2024-04-19T03:02:44.981 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8070000000000003e-05 2024-04-19T03:02:44.981 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:44.982 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:44.982 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:44.982 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018099+0000", 2024-04-19T03:02:44.982 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0030631149999999999 2024-04-19T03:02:44.982 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:44.982 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:44.982 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:44.982 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.065328+0000", 2024-04-19T03:02:44.982 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.047228349000000003 2024-04-19T03:02:44.982 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:44.982 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:44.982 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:44.982 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.065508+0000", 2024-04-19T03:02:44.982 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00018036899999999999 2024-04-19T03:02:44.983 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:44.983 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:44.983 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:44.983 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.065576+0000", 2024-04-19T03:02:44.983 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7785000000000002e-05 2024-04-19T03:02:44.983 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:44.983 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:44.983 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:44.983 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:44.983 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:44.983 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4755.0:78995 5.2 e40/39 5:42b55e12:::benchmark_data_smithi096_19531_object78994:head v 40'4934, mlcod=40'4932)", 2024-04-19T03:02:44.983 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:18.016247+0000", 2024-04-19T03:02:44.983 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 26.951589786, 2024-04-19T03:02:44.983 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.056240406, 2024-04-19T03:02:44.984 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:44.984 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:44.984 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:44.984 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:44.984 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:44.984 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016247+0000", 2024-04-19T03:02:44.984 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:44.984 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:44.984 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:44.984 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:44.984 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016247+0000", 2024-04-19T03:02:44.984 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:44.984 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:44.984 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:44.985 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:44.985 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016246+0000", 2024-04-19T03:02:44.985 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:44.985 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:44.985 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:44.985 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:44.985 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016315+0000", 2024-04-19T03:02:44.985 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8979000000000005e-05 2024-04-19T03:02:44.985 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:44.985 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:44.985 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:44.985 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016333+0000", 2024-04-19T03:02:44.985 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7586999999999999e-05 2024-04-19T03:02:44.986 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:44.986 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:44.986 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:44.986 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016340+0000", 2024-04-19T03:02:44.986 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4080000000000001e-06 2024-04-19T03:02:44.986 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:44.986 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:44.986 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:44.986 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016384+0000", 2024-04-19T03:02:44.986 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3656999999999999e-05 2024-04-19T03:02:44.986 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:44.986 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:44.986 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:44.987 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016403+0000", 2024-04-19T03:02:44.987 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9089e-05 2024-04-19T03:02:44.987 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:44.987 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:44.987 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:44.987 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.072448+0000", 2024-04-19T03:02:44.987 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.056045084000000002 2024-04-19T03:02:44.987 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:44.987 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:44.987 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:44.987 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.072487+0000", 2024-04-19T03:02:44.987 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9362e-05 2024-04-19T03:02:44.987 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:44.987 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:44.988 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:44.988 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:44.988 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:44.988 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4755.0:78994 5.c e40/22 5:3c60d55d:::benchmark_data_smithi096_19531_object78993:head v 40'4989, mlcod=40'4987)", 2024-04-19T03:02:44.988 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:18.016392+0000", 2024-04-19T03:02:44.988 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 26.951445145000001, 2024-04-19T03:02:44.988 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.052629620000000002, 2024-04-19T03:02:44.988 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:44.988 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:44.988 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:44.988 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:44.988 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:44.988 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016392+0000", 2024-04-19T03:02:44.988 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:44.989 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:44.989 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:44.989 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:44.989 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016392+0000", 2024-04-19T03:02:44.989 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:44.989 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:44.989 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:44.989 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:44.989 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016391+0000", 2024-04-19T03:02:44.989 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:44.989 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:44.989 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:44.989 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:44.989 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016471+0000", 2024-04-19T03:02:44.989 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9346999999999998e-05 2024-04-19T03:02:44.990 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:44.990 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:44.990 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:44.990 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016478+0000", 2024-04-19T03:02:44.990 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.593e-06 2024-04-19T03:02:44.990 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:44.990 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:44.990 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:44.990 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016495+0000", 2024-04-19T03:02:44.990 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6492999999999999e-05 2024-04-19T03:02:44.990 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:44.990 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:44.990 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:44.991 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016539+0000", 2024-04-19T03:02:44.991 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4715999999999997e-05 2024-04-19T03:02:44.991 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:44.991 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:44.991 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:44.991 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016551+0000", 2024-04-19T03:02:44.991 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2096000000000001e-05 2024-04-19T03:02:44.991 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:44.991 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:44.991 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:44.991 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.068985+0000", 2024-04-19T03:02:44.991 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.052433754999999999 2024-04-19T03:02:44.991 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:44.991 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:44.992 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:44.992 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.069021+0000", 2024-04-19T03:02:44.992 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6047000000000002e-05 2024-04-19T03:02:44.992 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:44.992 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:44.992 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:44.992 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:44.992 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:44.992 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4755.0:78996 5.1 e40/39 5:87f59708:::benchmark_data_smithi096_19531_object78995:head v 40'4940, mlcod=40'4938)", 2024-04-19T03:02:44.992 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:18.016581+0000", 2024-04-19T03:02:44.992 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 26.951255979999999, 2024-04-19T03:02:44.992 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.052051785000000003, 2024-04-19T03:02:44.992 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:44.992 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:44.992 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:44.993 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:44.993 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:44.993 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016581+0000", 2024-04-19T03:02:44.993 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:44.993 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:44.993 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:44.993 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:44.993 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016581+0000", 2024-04-19T03:02:44.993 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:44.993 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:44.993 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:44.993 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:44.993 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016581+0000", 2024-04-19T03:02:44.993 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:44.994 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:44.994 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:44.994 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:44.994 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016610+0000", 2024-04-19T03:02:44.994 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9556999999999998e-05 2024-04-19T03:02:44.994 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:44.994 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:44.994 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:44.994 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016616+0000", 2024-04-19T03:02:44.994 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1090000000000003e-06 2024-04-19T03:02:44.994 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:44.994 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:44.994 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:44.995 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016621+0000", 2024-04-19T03:02:44.995 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.454e-06 2024-04-19T03:02:44.995 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:44.995 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:44.995 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:44.995 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016663+0000", 2024-04-19T03:02:44.995 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2582e-05 2024-04-19T03:02:44.995 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:44.995 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:44.995 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:44.995 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016681+0000", 2024-04-19T03:02:44.995 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7680999999999999e-05 2024-04-19T03:02:44.995 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:44.996 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:44.996 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:44.996 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.068486+0000", 2024-04-19T03:02:44.996 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.051804624000000001 2024-04-19T03:02:44.996 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:44.996 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:44.996 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:44.996 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.068633+0000", 2024-04-19T03:02:44.996 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00014709099999999999 2024-04-19T03:02:44.996 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:44.996 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:44.996 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:44.996 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:44.996 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:44.996 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4755.0:78999 5.3 e40/22 5:c9ec5f7f:::benchmark_data_smithi096_19531_object78998:head v 40'4893, mlcod=40'4889)", 2024-04-19T03:02:44.997 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:18.016633+0000", 2024-04-19T03:02:44.997 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 26.951204125, 2024-04-19T03:02:44.997 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.051090469999999999, 2024-04-19T03:02:44.997 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:44.997 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:44.997 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:44.997 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:44.997 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:44.997 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016633+0000", 2024-04-19T03:02:44.997 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:44.997 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:44.997 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:44.997 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:44.997 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016633+0000", 2024-04-19T03:02:44.998 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:44.998 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:44.998 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:44.998 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:44.998 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016632+0000", 2024-04-19T03:02:44.998 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967296 2024-04-19T03:02:44.998 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:44.998 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:44.998 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:44.998 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016660+0000", 2024-04-19T03:02:44.998 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7869999999999999e-05 2024-04-19T03:02:44.998 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:44.998 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:44.998 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:44.999 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016667+0000", 2024-04-19T03:02:44.999 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0280000000000003e-06 2024-04-19T03:02:44.999 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:44.999 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:44.999 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:44.999 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016672+0000", 2024-04-19T03:02:44.999 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0069999999999997e-06 2024-04-19T03:02:44.999 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:44.999 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:44.999 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:44.999 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016725+0000", 2024-04-19T03:02:44.999 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2812000000000002e-05 2024-04-19T03:02:44.999 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:44.999 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.000 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:45.000 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016750+0000", 2024-04-19T03:02:45.000 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5038e-05 2024-04-19T03:02:45.000 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.000 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.000 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:45.000 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.067673+0000", 2024-04-19T03:02:45.000 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.050922350999999998 2024-04-19T03:02:45.000 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.000 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.000 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:45.000 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.067723+0000", 2024-04-19T03:02:45.000 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0586e-05 2024-04-19T03:02:45.000 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:45.001 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:45.001 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:45.001 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.001 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.001 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4755.0:79003 5.2 e40/39 5:4436e33f:::benchmark_data_smithi096_19531_object79002:head v 40'4935, mlcod=40'4932)", 2024-04-19T03:02:45.001 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:18.018102+0000", 2024-04-19T03:02:45.001 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 26.949734398, 2024-04-19T03:02:45.001 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.060023990999999999, 2024-04-19T03:02:45.001 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:45.001 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:45.001 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:45.001 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.001 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:45.001 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018102+0000", 2024-04-19T03:02:45.002 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:45.002 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.002 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.002 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:45.002 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018102+0000", 2024-04-19T03:02:45.002 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:45.002 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.002 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.002 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:45.002 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018102+0000", 2024-04-19T03:02:45.002 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:45.002 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.002 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.002 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:45.003 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018134+0000", 2024-04-19T03:02:45.003 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2722000000000003e-05 2024-04-19T03:02:45.003 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.003 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.003 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:45.003 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018145+0000", 2024-04-19T03:02:45.003 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0395e-05 2024-04-19T03:02:45.003 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.003 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.003 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:45.003 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018151+0000", 2024-04-19T03:02:45.003 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5300000000000002e-06 2024-04-19T03:02:45.003 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.003 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.004 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:45.004 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018489+0000", 2024-04-19T03:02:45.004 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00033731499999999998 2024-04-19T03:02:45.004 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.004 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.004 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:45.004 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018508+0000", 2024-04-19T03:02:45.004 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9775e-05 2024-04-19T03:02:45.004 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.004 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.004 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:45.004 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.078059+0000", 2024-04-19T03:02:45.004 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.059550171999999998 2024-04-19T03:02:45.004 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.005 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.005 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:45.005 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.078126+0000", 2024-04-19T03:02:45.005 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7773000000000003e-05 2024-04-19T03:02:45.005 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:45.005 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:45.005 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:45.005 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.005 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.005 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4755.0:79005 5.1 e40/39 5:85b46038:::benchmark_data_smithi096_19531_object79004:head v 40'4941, mlcod=40'4938)", 2024-04-19T03:02:45.005 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:18.018167+0000", 2024-04-19T03:02:45.005 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 26.949669678999999, 2024-04-19T03:02:45.005 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.052768941999999999, 2024-04-19T03:02:45.005 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:45.006 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:45.006 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:45.006 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.006 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:45.006 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018167+0000", 2024-04-19T03:02:45.006 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:45.006 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.006 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.006 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:45.006 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018167+0000", 2024-04-19T03:02:45.006 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:45.006 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.006 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.007 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:45.007 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018167+0000", 2024-04-19T03:02:45.007 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:45.007 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.007 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.007 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:45.007 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018196+0000", 2024-04-19T03:02:45.007 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9538000000000001e-05 2024-04-19T03:02:45.007 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.007 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.007 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:45.007 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018204+0000", 2024-04-19T03:02:45.007 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2599999999999999e-06 2024-04-19T03:02:45.007 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.007 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.008 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:45.008 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018208+0000", 2024-04-19T03:02:45.008 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8080000000000004e-06 2024-04-19T03:02:45.008 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.008 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.008 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:45.008 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.064933+0000", 2024-04-19T03:02:45.008 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.046725048999999998 2024-04-19T03:02:45.008 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.008 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.008 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:45.008 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.064964+0000", 2024-04-19T03:02:45.008 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0577000000000002e-05 2024-04-19T03:02:45.009 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.009 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.009 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:45.009 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.070815+0000", 2024-04-19T03:02:45.009 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0058510649999999999 2024-04-19T03:02:45.009 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.009 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.009 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:45.009 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.070936+0000", 2024-04-19T03:02:45.009 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00012095399999999999 2024-04-19T03:02:45.009 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:45.009 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:45.009 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:45.009 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.009 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.010 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:86612 5.7 5:e32e3c49:::benchmark_data_smithi096_19531_object86611:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:45.010 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:22.633560+0000", 2024-04-19T03:02:45.010 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 22.334276738, 2024-04-19T03:02:45.010 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.19135289, 2024-04-19T03:02:45.010 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:45.010 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:45.010 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:45.010 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:45.010 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:45.010 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 86612 2024-04-19T03:02:45.010 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.010 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:45.010 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.010 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:45.011 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633560+0000", 2024-04-19T03:02:45.011 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:45.011 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.011 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.011 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:45.011 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633560+0000", 2024-04-19T03:02:45.011 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:45.011 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.011 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.011 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:45.011 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633558+0000", 2024-04-19T03:02:45.011 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:45.011 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.011 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.012 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:45.012 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633609+0000", 2024-04-19T03:02:45.012 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0850999999999998e-05 2024-04-19T03:02:45.012 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.012 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.012 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:45.012 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633627+0000", 2024-04-19T03:02:45.012 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7951000000000001e-05 2024-04-19T03:02:45.012 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.012 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.012 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:45.012 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633635+0000", 2024-04-19T03:02:45.012 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2530000000000004e-06 2024-04-19T03:02:45.013 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.013 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.013 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:45.013 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633699+0000", 2024-04-19T03:02:45.013 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3901999999999999e-05 2024-04-19T03:02:45.013 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.013 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.013 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:45.013 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633992+0000", 2024-04-19T03:02:45.013 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00029283299999999999 2024-04-19T03:02:45.013 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.013 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.013 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:45.013 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.634223+0000", 2024-04-19T03:02:45.014 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00023084200000000001 2024-04-19T03:02:45.014 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.014 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.014 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:45.014 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.639085+0000", 2024-04-19T03:02:45.014 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0048624269999999999 2024-04-19T03:02:45.014 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.014 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.014 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:45.014 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.824635+0000", 2024-04-19T03:02:45.014 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.18554944700000001 2024-04-19T03:02:45.014 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.014 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.014 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:45.015 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.824793+0000", 2024-04-19T03:02:45.015 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000157959 2024-04-19T03:02:45.015 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.015 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.015 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:45.015 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.824913+0000", 2024-04-19T03:02:45.015 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000120093 2024-04-19T03:02:45.015 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:45.015 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:45.015 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:45.015 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.015 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.015 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:86625 5.7 5:e6d00488:::benchmark_data_smithi096_19531_object86624:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:45.015 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:22.643554+0000", 2024-04-19T03:02:45.016 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 22.324282971999999, 2024-04-19T03:02:45.016 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.18732841, 2024-04-19T03:02:45.016 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:45.016 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:45.016 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:45.016 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:45.016 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:45.016 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 86625 2024-04-19T03:02:45.016 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.016 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:45.016 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.016 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:45.016 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643554+0000", 2024-04-19T03:02:45.017 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:45.017 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.017 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.017 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:45.017 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643554+0000", 2024-04-19T03:02:45.017 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:45.017 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.017 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.017 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:45.017 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643552+0000", 2024-04-19T03:02:45.017 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:45.017 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.017 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.017 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:45.017 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643588+0000", 2024-04-19T03:02:45.018 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5855999999999997e-05 2024-04-19T03:02:45.018 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.018 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.018 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:45.018 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643606+0000", 2024-04-19T03:02:45.018 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8226000000000001e-05 2024-04-19T03:02:45.018 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.018 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.018 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:45.018 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643618+0000", 2024-04-19T03:02:45.018 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1868000000000001e-05 2024-04-19T03:02:45.018 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.018 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.018 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:45.019 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643676+0000", 2024-04-19T03:02:45.019 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8153999999999999e-05 2024-04-19T03:02:45.019 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.019 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.019 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:45.019 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643905+0000", 2024-04-19T03:02:45.019 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00022847500000000001 2024-04-19T03:02:45.019 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.019 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.019 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:45.019 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.644150+0000", 2024-04-19T03:02:45.019 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00024531800000000001 2024-04-19T03:02:45.019 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.019 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.020 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:45.020 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.647407+0000", 2024-04-19T03:02:45.020 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0032563190000000001 2024-04-19T03:02:45.020 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.020 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.020 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:45.020 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.830721+0000", 2024-04-19T03:02:45.020 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.18331468300000001 2024-04-19T03:02:45.020 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.020 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.020 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:45.020 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.830813+0000", 2024-04-19T03:02:45.020 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.2205000000000002e-05 2024-04-19T03:02:45.020 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.020 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.021 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:45.021 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.830882+0000", 2024-04-19T03:02:45.021 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8819999999999995e-05 2024-04-19T03:02:45.021 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:45.021 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:45.021 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:45.021 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.021 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.021 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87063 5.7 5:e502e824:::benchmark_data_smithi096_19531_object87062:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:45.021 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.136067+0000", 2024-04-19T03:02:45.021 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 21.831770103, 2024-04-19T03:02:45.021 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.065521159999999995, 2024-04-19T03:02:45.021 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:45.021 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:45.021 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:45.022 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:45.022 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:45.022 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87063 2024-04-19T03:02:45.022 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.022 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:45.022 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.022 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:45.022 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.136067+0000", 2024-04-19T03:02:45.022 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:45.022 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.022 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.022 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:45.022 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.136067+0000", 2024-04-19T03:02:45.025 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:45.025 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.026 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.026 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:45.026 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.136066+0000", 2024-04-19T03:02:45.026 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:45.026 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.026 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.026 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:45.026 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.136154+0000", 2024-04-19T03:02:45.026 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.8256000000000003e-05 2024-04-19T03:02:45.026 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.026 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.026 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:45.026 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.136162+0000", 2024-04-19T03:02:45.027 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.5099999999999998e-06 2024-04-19T03:02:45.027 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.027 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.027 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:45.027 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.136171+0000", 2024-04-19T03:02:45.027 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2830000000000001e-06 2024-04-19T03:02:45.027 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.027 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.027 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:45.027 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.138421+0000", 2024-04-19T03:02:45.027 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0022506620000000001 2024-04-19T03:02:45.027 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.027 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.027 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:45.028 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.138560+0000", 2024-04-19T03:02:45.028 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000138446 2024-04-19T03:02:45.028 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.028 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.028 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:45.028 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.138689+0000", 2024-04-19T03:02:45.028 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00012950700000000001 2024-04-19T03:02:45.028 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.028 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.028 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:45.028 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.141517+0000", 2024-04-19T03:02:45.028 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0028280860000000001 2024-04-19T03:02:45.028 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.028 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.029 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:45.029 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.201350+0000", 2024-04-19T03:02:45.029 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.059832418999999998 2024-04-19T03:02:45.029 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.029 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.029 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:45.029 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.201485+0000", 2024-04-19T03:02:45.029 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000135597 2024-04-19T03:02:45.029 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.029 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.029 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:45.029 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.201588+0000", 2024-04-19T03:02:45.029 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00010247900000000001 2024-04-19T03:02:45.030 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:45.030 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:45.030 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:45.030 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.030 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.030 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87072 5.7 5:e3c7809a:::benchmark_data_smithi096_19531_object87071:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:45.030 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.144224+0000", 2024-04-19T03:02:45.030 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 21.823613079000001, 2024-04-19T03:02:45.030 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.058179555000000001, 2024-04-19T03:02:45.030 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:45.030 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:45.030 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:45.030 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:45.030 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:45.031 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87072 2024-04-19T03:02:45.031 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.031 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:45.031 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.031 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:45.031 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144224+0000", 2024-04-19T03:02:45.031 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:45.031 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.031 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.031 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:45.031 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144224+0000", 2024-04-19T03:02:45.031 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:45.031 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.031 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.032 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:45.032 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144223+0000", 2024-04-19T03:02:45.032 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:45.032 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.032 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.032 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:45.032 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144320+0000", 2024-04-19T03:02:45.032 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.7075000000000001e-05 2024-04-19T03:02:45.032 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.032 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.032 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:45.032 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144331+0000", 2024-04-19T03:02:45.032 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1342000000000001e-05 2024-04-19T03:02:45.032 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.033 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.033 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:45.033 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144337+0000", 2024-04-19T03:02:45.033 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8390000000000003e-06 2024-04-19T03:02:45.033 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.033 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.033 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:45.033 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144369+0000", 2024-04-19T03:02:45.033 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2079000000000002e-05 2024-04-19T03:02:45.033 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.033 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.033 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:45.033 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144464+0000", 2024-04-19T03:02:45.033 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.4623000000000005e-05 2024-04-19T03:02:45.034 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.034 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.034 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:45.034 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144553+0000", 2024-04-19T03:02:45.034 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9171000000000004e-05 2024-04-19T03:02:45.034 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.034 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.034 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:45.034 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.147018+0000", 2024-04-19T03:02:45.034 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0024648370000000001 2024-04-19T03:02:45.034 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.034 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.034 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:45.035 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.202270+0000", 2024-04-19T03:02:45.035 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.055252018 2024-04-19T03:02:45.035 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.035 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.035 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:45.035 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.202356+0000", 2024-04-19T03:02:45.035 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6648000000000001e-05 2024-04-19T03:02:45.035 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.035 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.035 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:45.035 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.202403+0000", 2024-04-19T03:02:45.035 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6956999999999998e-05 2024-04-19T03:02:45.035 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:45.035 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:45.036 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:45.036 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.036 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.036 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87123 5.6 5:6d1bc3b9:::benchmark_data_smithi096_19531_object87122:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:02:45.036 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249233+0000", 2024-04-19T03:02:45.036 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 21.718604046999999, 2024-04-19T03:02:45.036 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0291700720000001, 2024-04-19T03:02:45.036 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:45.036 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-04-19T03:02:45.036 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:45.036 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:45.036 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:45.036 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87123 2024-04-19T03:02:45.036 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.037 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:45.037 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.037 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:45.037 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249233+0000", 2024-04-19T03:02:45.037 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:45.037 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.037 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.037 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:45.037 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249233+0000", 2024-04-19T03:02:45.037 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:45.037 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.037 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.037 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:45.038 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249231+0000", 2024-04-19T03:02:45.038 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:45.038 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.038 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.038 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:45.038 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249285+0000", 2024-04-19T03:02:45.038 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4005000000000002e-05 2024-04-19T03:02:45.038 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.038 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.038 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:45.038 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249300+0000", 2024-04-19T03:02:45.038 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4715999999999999e-05 2024-04-19T03:02:45.038 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.039 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.039 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:45.039 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249307+0000", 2024-04-19T03:02:45.039 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8399999999999997e-06 2024-04-19T03:02:45.039 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.039 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.039 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:45.039 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249366+0000", 2024-04-19T03:02:45.039 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9435999999999998e-05 2024-04-19T03:02:45.039 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.039 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.039 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op must wait for map", 2024-04-19T03:02:45.039 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249376+0000", 2024-04-19T03:02:45.040 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.4919999999999999e-06 2024-04-19T03:02:45.040 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.040 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.040 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:45.040 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263757+0000", 2024-04-19T03:02:45.040 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.014381461999999999 2024-04-19T03:02:45.040 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.040 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.040 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:02:45.040 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263875+0000", 2024-04-19T03:02:45.040 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000117166 2024-04-19T03:02:45.040 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.040 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.040 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:45.040 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.277136+0000", 2024-04-19T03:02:45.041 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.013261207 2024-04-19T03:02:45.041 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.041 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.041 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:45.041 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.278403+0000", 2024-04-19T03:02:45.041 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001267106 2024-04-19T03:02:45.041 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:45.041 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:45.041 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:45.041 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.041 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.041 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87128 5.6 5:6905c420:::benchmark_data_smithi096_19531_object87127:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:02:45.041 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249323+0000", 2024-04-19T03:02:45.042 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 21.718513300000001, 2024-04-19T03:02:45.042 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0292813249999999, 2024-04-19T03:02:45.042 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:45.042 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-04-19T03:02:45.042 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:45.042 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:45.042 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:45.042 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87128 2024-04-19T03:02:45.042 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.042 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:45.042 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.042 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:45.042 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249323+0000", 2024-04-19T03:02:45.043 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:45.043 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.043 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.043 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:45.043 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249323+0000", 2024-04-19T03:02:45.043 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:45.043 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.043 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.043 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:45.043 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249323+0000", 2024-04-19T03:02:45.043 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:45.043 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.043 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.043 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:45.044 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249385+0000", 2024-04-19T03:02:45.044 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1711999999999995e-05 2024-04-19T03:02:45.044 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.044 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.044 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:45.044 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249398+0000", 2024-04-19T03:02:45.044 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3022e-05 2024-04-19T03:02:45.044 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.044 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.044 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:45.044 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249402+0000", 2024-04-19T03:02:45.044 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4819999999999996e-06 2024-04-19T03:02:45.044 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.044 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.045 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:45.045 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249437+0000", 2024-04-19T03:02:45.045 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4702000000000001e-05 2024-04-19T03:02:45.045 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.045 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.045 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:02:45.045 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249442+0000", 2024-04-19T03:02:45.045 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8019999999999999e-06 2024-04-19T03:02:45.045 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.045 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.045 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:45.045 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263896+0000", 2024-04-19T03:02:45.045 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.014454679999999999 2024-04-19T03:02:45.045 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.046 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.046 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:02:45.046 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263900+0000", 2024-04-19T03:02:45.046 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9700000000000001e-06 2024-04-19T03:02:45.046 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.046 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.046 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:45.046 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.278557+0000", 2024-04-19T03:02:45.046 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0146566480000001 2024-04-19T03:02:45.046 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.046 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.046 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:45.047 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.278605+0000", 2024-04-19T03:02:45.047 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7735999999999998e-05 2024-04-19T03:02:45.047 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:45.047 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:45.047 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:45.047 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.047 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.047 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87130 5.3 5:c8c2d67b:::benchmark_data_smithi096_19531_object87129:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:02:45.047 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249418+0000", 2024-04-19T03:02:45.047 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 21.718418588999999, 2024-04-19T03:02:45.047 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.025414182, 2024-04-19T03:02:45.047 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:45.047 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-04-19T03:02:45.047 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:45.048 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:45.048 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:45.048 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87130 2024-04-19T03:02:45.048 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.048 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:45.048 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.048 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:45.048 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249418+0000", 2024-04-19T03:02:45.048 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:45.048 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.048 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.048 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:45.048 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249418+0000", 2024-04-19T03:02:45.048 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:45.049 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.049 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.049 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:45.049 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249409+0000", 2024-04-19T03:02:45.049 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999905 2024-04-19T03:02:45.049 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.049 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.049 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:45.049 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249464+0000", 2024-04-19T03:02:45.049 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5381999999999999e-05 2024-04-19T03:02:45.049 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.049 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.049 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:45.050 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249471+0000", 2024-04-19T03:02:45.050 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2609999999999996e-06 2024-04-19T03:02:45.050 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.050 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.050 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:45.050 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249475+0000", 2024-04-19T03:02:45.050 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2839999999999998e-06 2024-04-19T03:02:45.050 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.050 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.050 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:45.050 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249535+0000", 2024-04-19T03:02:45.050 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0545999999999999e-05 2024-04-19T03:02:45.050 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.050 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.051 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op must wait for map", 2024-04-19T03:02:45.051 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249540+0000", 2024-04-19T03:02:45.051 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2859999999999999e-06 2024-04-19T03:02:45.051 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.051 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.051 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:45.051 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263450+0000", 2024-04-19T03:02:45.051 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.013909585 2024-04-19T03:02:45.051 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.051 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.051 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:02:45.051 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263458+0000", 2024-04-19T03:02:45.051 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8089999999999993e-06 2024-04-19T03:02:45.051 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.051 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.052 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:45.052 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.273193+0000", 2024-04-19T03:02:45.052 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0097351379999999 2024-04-19T03:02:45.052 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.052 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.052 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:45.052 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.274832+0000", 2024-04-19T03:02:45.052 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0016394789999999999 2024-04-19T03:02:45.052 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:45.052 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:45.052 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:45.052 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.052 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.052 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87131 5.1 5:83756d55:::benchmark_data_smithi096_19531_object87130:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:02:45.053 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249491+0000", 2024-04-19T03:02:45.053 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 21.718345941999999, 2024-04-19T03:02:45.053 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0191489520000001, 2024-04-19T03:02:45.053 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:45.053 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-04-19T03:02:45.053 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:45.053 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:45.053 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:45.053 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87131 2024-04-19T03:02:45.053 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.053 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:45.053 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.053 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:45.053 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249491+0000", 2024-04-19T03:02:45.053 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:45.053 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.054 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.054 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:45.054 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249491+0000", 2024-04-19T03:02:45.054 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:45.054 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.054 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.054 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:45.054 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249491+0000", 2024-04-19T03:02:45.054 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:45.054 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.054 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.054 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:45.054 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249530+0000", 2024-04-19T03:02:45.055 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9589000000000003e-05 2024-04-19T03:02:45.055 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.055 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.055 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:45.055 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249544+0000", 2024-04-19T03:02:45.055 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4158000000000001e-05 2024-04-19T03:02:45.055 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.055 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.055 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:45.055 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249549+0000", 2024-04-19T03:02:45.055 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6809999999999997e-06 2024-04-19T03:02:45.055 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.055 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.055 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:45.056 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249592+0000", 2024-04-19T03:02:45.056 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3285999999999999e-05 2024-04-19T03:02:45.056 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.056 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.056 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op must wait for map", 2024-04-19T03:02:45.056 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249598+0000", 2024-04-19T03:02:45.056 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8329999999999999e-06 2024-04-19T03:02:45.056 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.056 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.056 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:45.056 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263331+0000", 2024-04-19T03:02:45.056 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.013733093 2024-04-19T03:02:45.056 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.056 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.057 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:02:45.057 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263343+0000", 2024-04-19T03:02:45.057 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.189e-05 2024-04-19T03:02:45.057 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.057 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.057 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:45.057 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.268541+0000", 2024-04-19T03:02:45.057 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0051983440000001 2024-04-19T03:02:45.057 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.057 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.057 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:45.057 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.268640+0000", 2024-04-19T03:02:45.057 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.8387999999999994e-05 2024-04-19T03:02:45.057 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:45.058 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:45.058 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:45.058 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.058 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.058 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87132 5.c 5:3e18b732:::benchmark_data_smithi096_19531_object87131:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:02:45.058 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249558+0000", 2024-04-19T03:02:45.058 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 21.718279040999999, 2024-04-19T03:02:45.058 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0241198380000001, 2024-04-19T03:02:45.058 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:45.058 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-04-19T03:02:45.058 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:45.058 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:45.058 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:45.058 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87132 2024-04-19T03:02:45.059 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.059 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:45.059 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.059 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:45.059 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249558+0000", 2024-04-19T03:02:45.059 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:45.059 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.059 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.059 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:45.059 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249558+0000", 2024-04-19T03:02:45.059 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:45.059 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.059 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.059 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:45.060 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249557+0000", 2024-04-19T03:02:45.060 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:45.060 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.060 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.060 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:45.060 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249625+0000", 2024-04-19T03:02:45.060 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7200999999999996e-05 2024-04-19T03:02:45.060 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.060 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.060 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:45.060 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249646+0000", 2024-04-19T03:02:45.060 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1053e-05 2024-04-19T03:02:45.060 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.060 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.061 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:45.061 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249650+0000", 2024-04-19T03:02:45.061 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2719999999999999e-06 2024-04-19T03:02:45.061 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.061 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.061 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:45.061 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249686+0000", 2024-04-19T03:02:45.061 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6430000000000002e-05 2024-04-19T03:02:45.061 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.061 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.061 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op must wait for map", 2024-04-19T03:02:45.061 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249690+0000", 2024-04-19T03:02:45.061 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.765e-06 2024-04-19T03:02:45.061 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.062 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.062 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:45.062 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261157+0000", 2024-04-19T03:02:45.062 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011467247999999999 2024-04-19T03:02:45.062 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.062 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.062 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:02:45.062 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261170+0000", 2024-04-19T03:02:45.062 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2833000000000001e-05 2024-04-19T03:02:45.062 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.062 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.062 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:45.062 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.272119+0000", 2024-04-19T03:02:45.062 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.010949313 2024-04-19T03:02:45.063 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.063 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.063 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:45.063 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.273678+0000", 2024-04-19T03:02:45.063 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0015581550000000001 2024-04-19T03:02:45.063 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:45.063 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:45.063 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:45.063 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.063 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.063 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87133 5.c 5:3f772a62:::benchmark_data_smithi096_19531_object87132:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:02:45.063 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249657+0000", 2024-04-19T03:02:45.063 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 21.718179662000001, 2024-04-19T03:02:45.063 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0242819409999999, 2024-04-19T03:02:45.064 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:45.064 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-04-19T03:02:45.064 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:45.064 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:45.064 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:45.064 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87133 2024-04-19T03:02:45.064 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.064 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:45.064 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.064 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:45.064 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249657+0000", 2024-04-19T03:02:45.064 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:45.064 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.064 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.064 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:45.065 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249657+0000", 2024-04-19T03:02:45.065 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:45.065 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.065 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.065 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:45.065 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249657+0000", 2024-04-19T03:02:45.065 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:45.065 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.065 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.065 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:45.065 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249690+0000", 2024-04-19T03:02:45.065 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3343000000000002e-05 2024-04-19T03:02:45.065 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.065 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.066 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:45.066 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249695+0000", 2024-04-19T03:02:45.066 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8600000000000001e-06 2024-04-19T03:02:45.066 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.066 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.066 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:45.066 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249698+0000", 2024-04-19T03:02:45.066 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.1700000000000001e-06 2024-04-19T03:02:45.066 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.066 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.066 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:45.066 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249741+0000", 2024-04-19T03:02:45.066 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2849999999999998e-05 2024-04-19T03:02:45.066 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.067 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.067 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:02:45.067 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249746+0000", 2024-04-19T03:02:45.067 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1019999999999996e-06 2024-04-19T03:02:45.067 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.067 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.067 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:45.067 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261209+0000", 2024-04-19T03:02:45.067 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011462447000000001 2024-04-19T03:02:45.067 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.067 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.067 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:02:45.067 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261216+0000", 2024-04-19T03:02:45.067 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8520000000000004e-06 2024-04-19T03:02:45.067 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.068 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.068 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:45.068 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.273872+0000", 2024-04-19T03:02:45.068 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0126558000000001 2024-04-19T03:02:45.068 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.068 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.068 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:45.068 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.273939+0000", 2024-04-19T03:02:45.068 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6822000000000005e-05 2024-04-19T03:02:45.068 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:45.068 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:45.068 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:45.068 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.069 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.069 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87134 5.5 5:a56c478f:::benchmark_data_smithi096_19531_object87133:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:02:45.069 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249708+0000", 2024-04-19T03:02:45.069 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 21.718128738000001, 2024-04-19T03:02:45.069 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0214677299999999, 2024-04-19T03:02:45.069 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:45.069 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-04-19T03:02:45.070 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:45.070 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:45.070 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:45.070 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87134 2024-04-19T03:02:45.070 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.070 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:45.070 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.070 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:45.070 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249708+0000", 2024-04-19T03:02:45.070 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:45.070 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.070 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.070 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:45.071 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249708+0000", 2024-04-19T03:02:45.071 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:45.071 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.071 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.071 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:45.071 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249706+0000", 2024-04-19T03:02:45.071 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999976 2024-04-19T03:02:45.071 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.071 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.071 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:45.071 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249740+0000", 2024-04-19T03:02:45.071 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4458000000000001e-05 2024-04-19T03:02:45.071 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.071 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.072 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:45.072 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249745+0000", 2024-04-19T03:02:45.072 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5020000000000003e-06 2024-04-19T03:02:45.072 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.072 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.072 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:45.072 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249748+0000", 2024-04-19T03:02:45.072 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2499999999999998e-06 2024-04-19T03:02:45.072 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.072 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.072 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:45.072 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249778+0000", 2024-04-19T03:02:45.072 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.006e-05 2024-04-19T03:02:45.072 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.072 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.073 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op must wait for map", 2024-04-19T03:02:45.073 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249782+0000", 2024-04-19T03:02:45.073 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2910000000000001e-06 2024-04-19T03:02:45.073 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.073 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.073 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:45.073 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261666+0000", 2024-04-19T03:02:45.073 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011883471 2024-04-19T03:02:45.073 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.073 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.073 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:02:45.073 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261674+0000", 2024-04-19T03:02:45.073 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6479999999999992e-06 2024-04-19T03:02:45.073 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.074 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.074 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:45.074 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.269323+0000", 2024-04-19T03:02:45.074 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.00764867 2024-04-19T03:02:45.074 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.074 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.074 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:45.074 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.271176+0000", 2024-04-19T03:02:45.074 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001852844 2024-04-19T03:02:45.074 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:45.074 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:45.074 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:45.074 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.074 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.075 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87137 5.c 5:30708c68:::benchmark_data_smithi096_19531_object87136:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:02:45.075 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249756+0000", 2024-04-19T03:02:45.075 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 21.718081032000001, 2024-04-19T03:02:45.075 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.033331752, 2024-04-19T03:02:45.075 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:45.075 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:45.075 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:45.075 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:45.075 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:45.075 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87137 2024-04-19T03:02:45.075 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.075 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:45.075 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.075 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:45.076 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249756+0000", 2024-04-19T03:02:45.076 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:45.076 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.076 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.076 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:45.076 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249756+0000", 2024-04-19T03:02:45.076 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:45.076 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.076 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.076 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:45.076 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249755+0000", 2024-04-19T03:02:45.076 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:45.076 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.076 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.077 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:45.077 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249777+0000", 2024-04-19T03:02:45.077 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1420000000000002e-05 2024-04-19T03:02:45.077 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.077 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.077 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:45.077 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249781+0000", 2024-04-19T03:02:45.077 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0609999999999997e-06 2024-04-19T03:02:45.077 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.077 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.077 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:45.077 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249787+0000", 2024-04-19T03:02:45.077 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.02e-06 2024-04-19T03:02:45.078 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.078 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.078 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:45.078 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249818+0000", 2024-04-19T03:02:45.078 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0947e-05 2024-04-19T03:02:45.078 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.078 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.078 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:02:45.078 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249821+0000", 2024-04-19T03:02:45.078 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.117e-06 2024-04-19T03:02:45.078 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.078 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.078 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:45.079 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261243+0000", 2024-04-19T03:02:45.079 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011421875999999999 2024-04-19T03:02:45.079 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.079 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.079 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:02:45.079 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261251+0000", 2024-04-19T03:02:45.079 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6120000000000001e-06 2024-04-19T03:02:45.079 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.079 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.079 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:45.079 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.274050+0000", 2024-04-19T03:02:45.079 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.012799405 2024-04-19T03:02:45.079 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.079 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.079 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:45.080 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.274529+0000", 2024-04-19T03:02:45.080 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00047867100000000001 2024-04-19T03:02:45.080 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.080 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.080 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:45.080 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.282972+0000", 2024-04-19T03:02:45.080 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0084436900000000002 2024-04-19T03:02:45.080 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.080 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.080 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:45.080 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.283022+0000", 2024-04-19T03:02:45.080 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9339000000000003e-05 2024-04-19T03:02:45.080 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.080 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.080 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:45.081 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.283088+0000", 2024-04-19T03:02:45.081 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5877999999999995e-05 2024-04-19T03:02:45.081 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:45.081 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:45.081 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:45.081 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:45.081 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:45.081 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-04-19T03:02:45.083 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T03:02:45.083 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:45.079+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:45.183 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:45.179+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:45.211 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-19T03:02:45.212 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-04-19T03:02:45.212 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.212 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:126515 5.a 5:585534fb:::benchmark_data_smithi096_19531_object13065:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-19T03:02:45.212 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:45.202458+0000", 2024-04-19T03:02:45.212 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0079998389999999999, 2024-04-19T03:02:45.212 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0080300370000000003, 2024-04-19T03:02:45.212 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:45.212 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-19T03:02:45.212 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:45.212 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:45.212 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:45.213 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 126515 2024-04-19T03:02:45.213 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.213 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:45.213 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.213 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:45.213 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:45.202458+0000", 2024-04-19T03:02:45.213 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:45.213 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.213 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.213 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:45.213 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:45.202458+0000", 2024-04-19T03:02:45.213 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:45.214 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.214 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.214 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:45.214 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:45.202457+0000", 2024-04-19T03:02:45.214 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:45.214 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.214 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.214 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:45.214 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:45.202463+0000", 2024-04-19T03:02:45.214 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4289999999999998e-06 2024-04-19T03:02:45.214 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.214 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.214 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:45.215 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:45.202481+0000", 2024-04-19T03:02:45.215 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7906000000000001e-05 2024-04-19T03:02:45.215 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.215 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.215 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:45.215 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:45.202489+0000", 2024-04-19T03:02:45.215 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0409999999999998e-06 2024-04-19T03:02:45.215 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.215 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.215 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:45.215 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:45.204553+0000", 2024-04-19T03:02:45.215 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0020636140000000001 2024-04-19T03:02:45.215 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.216 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.216 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:45.216 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:45.204722+0000", 2024-04-19T03:02:45.216 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000169636 2024-04-19T03:02:45.216 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:45.216 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:45.216 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:45.216 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.216 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.216 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4755.0:126510 5.9 e51/22 5:98e6e233:::benchmark_data_smithi096_19531_object13060:head v 51'7761, mlcod=51'7758)", 2024-04-19T03:02:45.216 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:45.202764+0000", 2024-04-19T03:02:45.216 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.007693788, 2024-04-19T03:02:45.216 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0078083659999999997, 2024-04-19T03:02:45.217 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:45.217 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-19T03:02:45.217 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:45.217 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.217 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:45.217 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:45.202764+0000", 2024-04-19T03:02:45.217 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:45.217 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.217 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.217 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:45.217 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:45.202764+0000", 2024-04-19T03:02:45.217 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:45.217 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.218 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.218 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:45.218 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:45.202763+0000", 2024-04-19T03:02:45.218 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:45.218 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.218 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.218 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:45.218 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:45.202768+0000", 2024-04-19T03:02:45.218 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4649999999999996e-06 2024-04-19T03:02:45.218 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.218 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.218 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:45.219 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:45.202773+0000", 2024-04-19T03:02:45.219 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7459999999999997e-06 2024-04-19T03:02:45.219 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.219 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.219 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:45.219 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:45.202777+0000", 2024-04-19T03:02:45.219 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9809999999999997e-06 2024-04-19T03:02:45.219 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.219 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.219 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:45.219 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:45.205242+0000", 2024-04-19T03:02:45.219 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0024647649999999998 2024-04-19T03:02:45.219 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.220 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.220 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:45.220 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:45.205263+0000", 2024-04-19T03:02:45.220 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0744999999999999e-05 2024-04-19T03:02:45.220 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:45.220 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:45.220 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:45.220 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.220 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.220 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:126520 5.b 5:d7c8a4fc:::benchmark_data_smithi096_19531_object13070:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-19T03:02:45.220 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:45.203892+0000", 2024-04-19T03:02:45.220 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0065657060000000001, 2024-04-19T03:02:45.221 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0067545469999999996, 2024-04-19T03:02:45.221 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:45.221 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-19T03:02:45.221 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:45.221 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:45.221 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:45.221 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 126520 2024-04-19T03:02:45.221 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.221 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:45.221 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.221 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:45.221 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:45.203892+0000", 2024-04-19T03:02:45.221 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:45.222 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.222 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.222 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:45.222 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:45.203892+0000", 2024-04-19T03:02:45.222 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:45.222 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.222 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.222 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:45.222 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:45.203891+0000", 2024-04-19T03:02:45.222 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:45.222 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.222 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.223 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:45.223 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:45.203896+0000", 2024-04-19T03:02:45.223 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2730000000000002e-06 2024-04-19T03:02:45.223 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.223 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.223 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:45.223 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:45.203906+0000", 2024-04-19T03:02:45.223 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.3919999999999992e-06 2024-04-19T03:02:45.223 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.223 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.223 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:45.223 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:45.203913+0000", 2024-04-19T03:02:45.224 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3919999999999997e-06 2024-04-19T03:02:45.224 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.224 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.224 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:45.224 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:45.203971+0000", 2024-04-19T03:02:45.224 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8032000000000003e-05 2024-04-19T03:02:45.224 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.224 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.224 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:45.224 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:45.204109+0000", 2024-04-19T03:02:45.224 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000138415 2024-04-19T03:02:45.224 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:45.224 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:45.225 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:45.225 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.225 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.225 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:126525 5.b 5:d5d5be4a:::benchmark_data_smithi096_19531_object13075:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-19T03:02:45.225 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:45.206961+0000", 2024-04-19T03:02:45.225 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.003496271, 2024-04-19T03:02:45.225 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0037602500000000001, 2024-04-19T03:02:45.225 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:45.225 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-19T03:02:45.225 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:45.225 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:45.225 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:45.226 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 126525 2024-04-19T03:02:45.226 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.226 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:45.226 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.226 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:45.226 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:45.206961+0000", 2024-04-19T03:02:45.226 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:45.226 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.226 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.226 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:45.226 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:45.206961+0000", 2024-04-19T03:02:45.226 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:45.227 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.227 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.227 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:45.227 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:45.206960+0000", 2024-04-19T03:02:45.227 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:45.227 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.227 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.227 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:45.227 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:45.206966+0000", 2024-04-19T03:02:45.227 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0820000000000004e-06 2024-04-19T03:02:45.227 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.227 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.228 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:45.228 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:45.206985+0000", 2024-04-19T03:02:45.228 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8471999999999999e-05 2024-04-19T03:02:45.228 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.228 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.228 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:45.228 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:45.207005+0000", 2024-04-19T03:02:45.228 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9834e-05 2024-04-19T03:02:45.228 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.228 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.228 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:45.228 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:45.207064+0000", 2024-04-19T03:02:45.228 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9141000000000002e-05 2024-04-19T03:02:45.229 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.229 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.229 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:45.229 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:45.207195+0000", 2024-04-19T03:02:45.229 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013173199999999999 2024-04-19T03:02:45.229 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:45.229 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:45.229 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:45.229 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.229 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.229 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:126526 5.a 5:5dd6eb8d:::benchmark_data_smithi096_19531_object13076:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-19T03:02:45.230 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:45.207025+0000", 2024-04-19T03:02:45.230 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0034329859999999999, 2024-04-19T03:02:45.230 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0037728850000000001, 2024-04-19T03:02:45.230 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:45.230 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-19T03:02:45.230 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:45.230 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:45.230 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:45.230 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 126526 2024-04-19T03:02:45.230 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.230 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:45.231 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.231 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:45.231 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:45.207025+0000", 2024-04-19T03:02:45.231 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:45.231 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.231 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.231 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:45.231 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:45.207025+0000", 2024-04-19T03:02:45.231 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:45.231 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.231 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.231 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:45.231 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:45.207024+0000", 2024-04-19T03:02:45.232 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:45.232 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.232 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.232 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:45.232 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:45.207028+0000", 2024-04-19T03:02:45.232 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.07e-06 2024-04-19T03:02:45.232 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.232 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.232 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:45.232 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:45.207036+0000", 2024-04-19T03:02:45.232 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.7160000000000003e-06 2024-04-19T03:02:45.232 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.233 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.233 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:45.233 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:45.207042+0000", 2024-04-19T03:02:45.233 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2389999999999999e-06 2024-04-19T03:02:45.233 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.233 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.233 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:45.233 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:45.207092+0000", 2024-04-19T03:02:45.233 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0244999999999998e-05 2024-04-19T03:02:45.233 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.233 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.233 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:45.233 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:45.207232+0000", 2024-04-19T03:02:45.234 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000140316 2024-04-19T03:02:45.234 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:45.234 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:45.234 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:45.234 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.234 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.234 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:126527 5.b 5:d90ea3f1:::benchmark_data_smithi096_19531_object13077:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-19T03:02:45.234 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:45.207060+0000", 2024-04-19T03:02:45.234 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0033978630000000001, 2024-04-19T03:02:45.234 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0038116619999999999, 2024-04-19T03:02:45.234 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:45.234 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-19T03:02:45.234 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:45.235 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:45.235 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:45.235 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 126527 2024-04-19T03:02:45.235 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.235 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:45.235 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.235 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:45.235 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:45.207060+0000", 2024-04-19T03:02:45.235 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:45.235 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.235 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.235 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:45.235 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:45.207060+0000", 2024-04-19T03:02:45.235 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:45.235 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.235 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.236 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:45.236 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:45.207059+0000", 2024-04-19T03:02:45.236 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:45.236 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.236 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.236 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:45.236 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:45.207063+0000", 2024-04-19T03:02:45.236 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.693e-06 2024-04-19T03:02:45.236 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.236 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.236 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:45.236 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:45.207070+0000", 2024-04-19T03:02:45.236 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2899999999999997e-06 2024-04-19T03:02:45.236 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.237 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.237 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:45.237 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:45.207076+0000", 2024-04-19T03:02:45.237 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9630000000000003e-06 2024-04-19T03:02:45.237 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.237 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.237 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:45.237 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:45.209206+0000", 2024-04-19T03:02:45.237 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0021299800000000001 2024-04-19T03:02:45.237 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.237 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.237 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:45.237 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:45.209299+0000", 2024-04-19T03:02:45.238 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.3283999999999997e-05 2024-04-19T03:02:45.238 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:45.238 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:45.238 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:45.238 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.238 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.238 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:126528 5.0 5:010a7a9c:::benchmark_data_smithi096_19531_object13078:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-19T03:02:45.238 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:45.207086+0000", 2024-04-19T03:02:45.238 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0033720170000000002, 2024-04-19T03:02:45.238 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0038603930000000002, 2024-04-19T03:02:45.238 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:45.238 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-19T03:02:45.238 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:45.238 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:45.239 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:45.239 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 126528 2024-04-19T03:02:45.239 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.239 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:45.239 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.239 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:45.239 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:45.207086+0000", 2024-04-19T03:02:45.239 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:45.239 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.239 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.239 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:45.239 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:45.207086+0000", 2024-04-19T03:02:45.239 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:45.239 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.239 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.240 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:45.240 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:45.207085+0000", 2024-04-19T03:02:45.240 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:45.240 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.240 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.240 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:45.240 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:45.207089+0000", 2024-04-19T03:02:45.240 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1740000000000002e-06 2024-04-19T03:02:45.240 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.240 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.240 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:45.240 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:45.207097+0000", 2024-04-19T03:02:45.240 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.824e-06 2024-04-19T03:02:45.240 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.241 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.241 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:45.241 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:45.207103+0000", 2024-04-19T03:02:45.241 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0419999999999999e-06 2024-04-19T03:02:45.241 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.241 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.241 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:45.241 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:45.207141+0000", 2024-04-19T03:02:45.241 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7929999999999998e-05 2024-04-19T03:02:45.241 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.241 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.241 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:45.241 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:45.207262+0000", 2024-04-19T03:02:45.241 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012142399999999999 2024-04-19T03:02:45.242 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:45.242 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:45.242 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:45.242 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.242 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.242 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4755.0:126523 5.9 e51/22 5:920929ad:::benchmark_data_smithi096_19531_object13073:head v 51'7762, mlcod=51'7758)", 2024-04-19T03:02:45.242 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:45.207108+0000", 2024-04-19T03:02:45.242 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0033498820000000002, 2024-04-19T03:02:45.242 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0039133079999999999, 2024-04-19T03:02:45.242 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:45.242 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-19T03:02:45.242 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:45.242 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.243 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:45.243 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:45.207108+0000", 2024-04-19T03:02:45.243 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:45.243 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.243 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.243 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:45.243 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:45.207108+0000", 2024-04-19T03:02:45.243 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:45.243 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.243 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.243 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:45.243 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:45.207107+0000", 2024-04-19T03:02:45.244 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:45.244 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.244 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.244 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:45.244 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:45.207115+0000", 2024-04-19T03:02:45.244 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0490000000000004e-06 2024-04-19T03:02:45.244 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.244 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.244 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:45.244 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:45.207125+0000", 2024-04-19T03:02:45.244 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0069e-05 2024-04-19T03:02:45.244 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.245 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.245 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:45.245 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:45.207132+0000", 2024-04-19T03:02:45.245 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.9580000000000001e-06 2024-04-19T03:02:45.245 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.245 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.245 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:45.245 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:45.207171+0000", 2024-04-19T03:02:45.245 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9539999999999998e-05 2024-04-19T03:02:45.245 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.245 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.245 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:45.245 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:45.207193+0000", 2024-04-19T03:02:45.245 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1708999999999998e-05 2024-04-19T03:02:45.246 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:45.246 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:45.246 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:45.246 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.246 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.246 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:126529 5.4 5:21e2eca5:::benchmark_data_smithi096_19531_object13079:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-19T03:02:45.246 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:45.207116+0000", 2024-04-19T03:02:45.246 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0033412619999999998, 2024-04-19T03:02:45.246 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0039724399999999998, 2024-04-19T03:02:45.246 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:45.246 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-19T03:02:45.246 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:45.247 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:45.247 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:45.247 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 126529 2024-04-19T03:02:45.247 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.247 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:45.247 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.247 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:45.247 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:45.207116+0000", 2024-04-19T03:02:45.247 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:45.247 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.247 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.247 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:45.247 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:45.207116+0000", 2024-04-19T03:02:45.247 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:45.248 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.248 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.248 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:45.248 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:45.207116+0000", 2024-04-19T03:02:45.248 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:45.248 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.248 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.248 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:45.248 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:45.207119+0000", 2024-04-19T03:02:45.248 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.676e-06 2024-04-19T03:02:45.248 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.248 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.248 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:45.249 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:45.207127+0000", 2024-04-19T03:02:45.249 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3459999999999996e-06 2024-04-19T03:02:45.249 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.249 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.249 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:45.249 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:45.207133+0000", 2024-04-19T03:02:45.249 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.195e-06 2024-04-19T03:02:45.249 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.249 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.249 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:45.249 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:45.207198+0000", 2024-04-19T03:02:45.249 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5074999999999996e-05 2024-04-19T03:02:45.249 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.250 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.250 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:45.250 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:45.207347+0000", 2024-04-19T03:02:45.250 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014925800000000001 2024-04-19T03:02:45.250 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:45.250 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:45.250 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:45.250 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.250 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.250 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4755.0:126524 5.f e51/22 5:ff320c04:::benchmark_data_smithi096_19531_object13074:head v 51'7823, mlcod=51'7821)", 2024-04-19T03:02:45.250 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:45.207186+0000", 2024-04-19T03:02:45.250 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0032718270000000002, 2024-04-19T03:02:45.251 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0039758149999999997, 2024-04-19T03:02:45.251 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:45.251 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-19T03:02:45.251 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:45.251 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.251 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:45.251 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:45.207186+0000", 2024-04-19T03:02:45.251 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:45.251 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.251 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.251 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:45.251 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:45.207186+0000", 2024-04-19T03:02:45.252 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:45.252 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.252 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.252 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:45.252 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:45.207185+0000", 2024-04-19T03:02:45.252 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:45.252 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.252 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.252 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:45.252 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:45.207191+0000", 2024-04-19T03:02:45.252 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4410000000000001e-06 2024-04-19T03:02:45.252 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.252 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.252 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:45.253 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:45.207199+0000", 2024-04-19T03:02:45.253 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.123e-06 2024-04-19T03:02:45.253 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.253 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.253 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:45.253 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:45.207205+0000", 2024-04-19T03:02:45.253 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0530000000000003e-06 2024-04-19T03:02:45.253 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.253 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.253 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:45.253 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:45.207240+0000", 2024-04-19T03:02:45.253 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5024999999999998e-05 2024-04-19T03:02:45.253 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.254 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.254 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:45.254 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:45.207258+0000", 2024-04-19T03:02:45.254 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8178000000000001e-05 2024-04-19T03:02:45.254 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:45.254 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:45.254 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:45.254 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.254 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.254 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:126530 5.4 5:251ddd33:::benchmark_data_smithi096_19531_object13080:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-19T03:02:45.254 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:45.209530+0000", 2024-04-19T03:02:45.254 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.00092795499999999995, 2024-04-19T03:02:45.254 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0016991560000000001, 2024-04-19T03:02:45.255 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:45.255 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-19T03:02:45.255 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:45.255 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:45.255 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:45.255 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 126530 2024-04-19T03:02:45.255 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.255 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:45.255 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.255 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:45.255 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:45.209530+0000", 2024-04-19T03:02:45.255 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:45.255 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.255 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.255 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:45.256 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:45.209530+0000", 2024-04-19T03:02:45.256 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:45.256 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.256 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.256 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:45.256 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:45.209528+0000", 2024-04-19T03:02:45.256 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:45.256 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.256 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.256 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:45.256 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:45.209536+0000", 2024-04-19T03:02:45.256 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0539999999999995e-06 2024-04-19T03:02:45.256 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.256 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.256 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:45.257 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:45.209559+0000", 2024-04-19T03:02:45.257 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2671e-05 2024-04-19T03:02:45.257 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.257 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.257 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:45.257 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:45.209581+0000", 2024-04-19T03:02:45.257 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1773e-05 2024-04-19T03:02:45.257 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.257 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.257 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:45.257 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:45.209704+0000", 2024-04-19T03:02:45.257 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012318400000000001 2024-04-19T03:02:45.257 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.257 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.257 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:45.258 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:45.209840+0000", 2024-04-19T03:02:45.258 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013622499999999999 2024-04-19T03:02:45.258 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:45.258 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:45.258 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:45.258 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.258 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.258 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:126533 5.8 5:1c50ff8e:::benchmark_data_smithi096_19531_object13083:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-19T03:02:45.258 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:45.209597+0000", 2024-04-19T03:02:45.258 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.000860428, 2024-04-19T03:02:45.258 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00170582, 2024-04-19T03:02:45.258 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:45.259 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-19T03:02:45.259 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:45.259 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:45.259 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:45.259 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 126533 2024-04-19T03:02:45.259 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.259 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:45.259 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.259 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:45.259 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:45.209597+0000", 2024-04-19T03:02:45.259 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:45.259 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.259 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.259 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:45.260 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:45.209597+0000", 2024-04-19T03:02:45.260 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:45.260 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.260 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.260 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:45.260 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:45.209597+0000", 2024-04-19T03:02:45.260 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:45.260 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.260 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.260 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:45.260 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:45.209600+0000", 2024-04-19T03:02:45.260 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7000000000000002e-06 2024-04-19T03:02:45.260 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.261 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.261 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:45.261 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:45.209610+0000", 2024-04-19T03:02:45.261 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.9699999999999994e-06 2024-04-19T03:02:45.261 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.261 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.261 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:45.261 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:45.209619+0000", 2024-04-19T03:02:45.261 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.2140000000000002e-06 2024-04-19T03:02:45.261 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.261 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.261 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:45.261 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:45.209680+0000", 2024-04-19T03:02:45.261 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1014000000000002e-05 2024-04-19T03:02:45.262 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.262 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.262 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:45.262 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:45.209833+0000", 2024-04-19T03:02:45.262 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015285200000000001 2024-04-19T03:02:45.262 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:45.262 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:45.262 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:45.262 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.262 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.262 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:126534 5.e 5:711cb8f6:::benchmark_data_smithi096_19531_object13084:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2024-04-19T03:02:45.262 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:45.209631+0000", 2024-04-19T03:02:45.262 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.00082679900000000002, 2024-04-19T03:02:45.263 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0017458650000000001, 2024-04-19T03:02:45.263 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:45.263 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-19T03:02:45.263 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:45.263 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:45.263 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:45.263 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 126534 2024-04-19T03:02:45.263 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.263 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:45.263 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.263 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:45.263 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:45.209631+0000", 2024-04-19T03:02:45.263 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:45.264 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.264 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.264 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:45.264 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:45.209631+0000", 2024-04-19T03:02:45.264 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:45.264 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.264 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.264 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:45.264 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:45.209630+0000", 2024-04-19T03:02:45.264 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:45.264 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.264 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.264 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:45.265 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:45.209634+0000", 2024-04-19T03:02:45.265 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4149999999999999e-06 2024-04-19T03:02:45.265 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.265 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.265 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:45.265 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:45.209642+0000", 2024-04-19T03:02:45.265 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3550000000000005e-06 2024-04-19T03:02:45.265 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.265 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.265 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:45.265 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:45.209648+0000", 2024-04-19T03:02:45.265 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2090000000000002e-06 2024-04-19T03:02:45.265 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.265 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.266 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:45.266 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:45.209698+0000", 2024-04-19T03:02:45.266 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9843999999999999e-05 2024-04-19T03:02:45.266 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.266 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.266 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:45.266 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:45.209826+0000", 2024-04-19T03:02:45.266 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012804799999999999 2024-04-19T03:02:45.266 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:45.266 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:45.266 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:45.266 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.266 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.267 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4755.0:126531 5.f e51/22 5:f6e734c7:::benchmark_data_smithi096_19531_object13081:head v 51'7824, mlcod=51'7821)", 2024-04-19T03:02:45.267 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:45.209773+0000", 2024-04-19T03:02:45.267 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.00068479399999999996, 2024-04-19T03:02:45.267 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0016771119999999999, 2024-04-19T03:02:45.267 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:45.267 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-19T03:02:45.267 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:45.267 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.267 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:45.267 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:45.209773+0000", 2024-04-19T03:02:45.267 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:45.267 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.267 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.268 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:45.268 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:45.209773+0000", 2024-04-19T03:02:45.268 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:45.268 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.268 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.268 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:45.268 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:45.209772+0000", 2024-04-19T03:02:45.268 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:45.268 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.268 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.268 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:45.268 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:45.209780+0000", 2024-04-19T03:02:45.268 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.9540000000000004e-06 2024-04-19T03:02:45.269 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.269 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.269 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:45.269 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:45.209790+0000", 2024-04-19T03:02:45.269 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0311e-05 2024-04-19T03:02:45.269 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.269 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.269 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:45.269 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:45.209797+0000", 2024-04-19T03:02:45.269 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.0330000000000003e-06 2024-04-19T03:02:45.269 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.269 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.269 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:45.269 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:45.209833+0000", 2024-04-19T03:02:45.270 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6123e-05 2024-04-19T03:02:45.270 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.270 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.270 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:45.270 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:45.209853+0000", 2024-04-19T03:02:45.270 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9423e-05 2024-04-19T03:02:45.270 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:45.270 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:45.270 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:45.270 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.270 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.270 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4755.0:126535 5.9 e51/22 5:9dd25820:::benchmark_data_smithi096_19531_object13085:head v 51'7763, mlcod=51'7759)", 2024-04-19T03:02:45.270 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:45.210417+0000", 2024-04-19T03:02:45.271 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 4.0772000000000002e-05, 2024-04-19T03:02:45.271 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0010981039999999999, 2024-04-19T03:02:45.271 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:45.271 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-19T03:02:45.271 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:45.271 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.271 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:45.271 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:45.210417+0000", 2024-04-19T03:02:45.271 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:45.271 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.271 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.271 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:45.271 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:45.210417+0000", 2024-04-19T03:02:45.271 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:45.272 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.272 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.272 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:45.272 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:45.210416+0000", 2024-04-19T03:02:45.272 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:45.272 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.272 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.272 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:45.272 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:45.210423+0000", 2024-04-19T03:02:45.272 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.9770000000000003e-06 2024-04-19T03:02:45.272 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.272 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.273 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:45.273 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:45.210437+0000", 2024-04-19T03:02:45.273 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3509999999999999e-05 2024-04-19T03:02:45.273 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.273 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.273 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:45.273 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:45.210443+0000", 2024-04-19T03:02:45.273 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3910000000000003e-06 2024-04-19T03:02:45.273 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.273 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.273 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:45.273 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:45.210504+0000", 2024-04-19T03:02:45.274 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1205999999999996e-05 2024-04-19T03:02:45.274 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.274 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.274 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:45.274 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:45.210527+0000", 2024-04-19T03:02:45.274 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2870999999999998e-05 2024-04-19T03:02:45.274 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:45.274 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:45.274 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:45.274 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:45.274 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-04-19T03:02:45.274 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 15 2024-04-19T03:02:45.275 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-19T03:02:45.276 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T03:02:45.284 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:45.281+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:45.385 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:45.381+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:45.445 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-19T03:02:45.445 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-04-19T03:02:45.445 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-04-19T03:02:45.445 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-04-19T03:02:45.445 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-19T03:02:45.451 INFO:teuthology.orchestra.run.smithi096.stderr:nodeep-scrub is unset 2024-04-19T03:02:45.457 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T03:02:45.486 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:45.483+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:45.575 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-19T03:02:45.575 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-04-19T03:02:45.575 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-04-19T03:02:45.575 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-04-19T03:02:45.575 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.575 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:79014 5.d 5:b5eee02c:::benchmark_data_smithi096_19531_object79013:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-19T03:02:45.576 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:18.032471+0000", 2024-04-19T03:02:45.576 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 27.540096732999999, 2024-04-19T03:02:45.576 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.041427629000000001, 2024-04-19T03:02:45.576 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:45.576 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:45.576 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:45.576 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:45.576 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:45.576 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 79014 2024-04-19T03:02:45.576 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.576 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:45.576 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.577 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:45.577 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:18.032471+0000", 2024-04-19T03:02:45.577 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:45.577 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.577 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.577 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:45.577 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:18.032471+0000", 2024-04-19T03:02:45.577 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:45.577 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.577 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.577 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:45.577 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:18.032470+0000", 2024-04-19T03:02:45.577 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:45.577 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.578 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.578 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:45.578 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:18.032525+0000", 2024-04-19T03:02:45.578 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5535999999999998e-05 2024-04-19T03:02:45.578 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.578 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.578 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:45.578 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:18.032537+0000", 2024-04-19T03:02:45.578 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1987999999999999e-05 2024-04-19T03:02:45.578 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.578 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.578 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:45.578 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:18.032546+0000", 2024-04-19T03:02:45.579 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9670000000000007e-06 2024-04-19T03:02:45.579 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.579 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.579 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:45.579 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:18.032613+0000", 2024-04-19T03:02:45.579 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6508999999999996e-05 2024-04-19T03:02:45.579 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.579 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.579 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:45.579 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:18.032738+0000", 2024-04-19T03:02:45.579 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000124912 2024-04-19T03:02:45.579 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.579 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.580 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-04-19T03:02:45.580 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:18.032867+0000", 2024-04-19T03:02:45.580 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012959399999999999 2024-04-19T03:02:45.580 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.580 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.580 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:45.580 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:18.035867+0000", 2024-04-19T03:02:45.580 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.002999378 2024-04-19T03:02:45.580 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.580 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.580 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:45.580 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:18.073705+0000", 2024-04-19T03:02:45.580 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.037838042000000002 2024-04-19T03:02:45.580 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.581 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.581 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:45.581 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:18.073813+0000", 2024-04-19T03:02:45.581 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010806099999999999 2024-04-19T03:02:45.581 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.581 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.581 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:45.581 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:18.073899+0000", 2024-04-19T03:02:45.581 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.5971999999999996e-05 2024-04-19T03:02:45.581 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:45.581 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:45.581 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:45.581 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.581 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.582 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:86615 5.e 5:7fef7288:::benchmark_data_smithi096_19531_object86614:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:45.582 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:22.634544+0000", 2024-04-19T03:02:45.582 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 22.938023754, 2024-04-19T03:02:45.582 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.192475071, 2024-04-19T03:02:45.582 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:45.582 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:45.582 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:45.582 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:45.582 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:45.582 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 86615 2024-04-19T03:02:45.582 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.582 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:45.582 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.583 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:45.583 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634544+0000", 2024-04-19T03:02:45.583 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:45.583 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.583 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.583 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:45.583 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634544+0000", 2024-04-19T03:02:45.583 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:45.583 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.583 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.583 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:45.583 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634542+0000", 2024-04-19T03:02:45.583 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999981 2024-04-19T03:02:45.584 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.584 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.584 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:45.584 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634585+0000", 2024-04-19T03:02:45.584 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2299000000000003e-05 2024-04-19T03:02:45.584 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.584 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.584 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:45.584 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634592+0000", 2024-04-19T03:02:45.584 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2350000000000002e-06 2024-04-19T03:02:45.584 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.584 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.584 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:45.584 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634596+0000", 2024-04-19T03:02:45.585 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5390000000000001e-06 2024-04-19T03:02:45.585 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.585 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.585 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:45.585 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634639+0000", 2024-04-19T03:02:45.585 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2444999999999998e-05 2024-04-19T03:02:45.585 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.585 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.585 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:45.585 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634808+0000", 2024-04-19T03:02:45.585 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000169152 2024-04-19T03:02:45.585 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.585 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.585 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:45.586 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634999+0000", 2024-04-19T03:02:45.586 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00019098300000000001 2024-04-19T03:02:45.586 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.586 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.586 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:45.586 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.640458+0000", 2024-04-19T03:02:45.586 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0054586870000000003 2024-04-19T03:02:45.586 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.586 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.586 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:45.586 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.826949+0000", 2024-04-19T03:02:45.586 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.18649178299999999 2024-04-19T03:02:45.586 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.587 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.587 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:45.587 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.826982+0000", 2024-04-19T03:02:45.587 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2477000000000001e-05 2024-04-19T03:02:45.587 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.587 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.587 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:45.587 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.827019+0000", 2024-04-19T03:02:45.587 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7355999999999999e-05 2024-04-19T03:02:45.587 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:45.587 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:45.587 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:45.587 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.587 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.588 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:86616 5.e 5:72278f47:::benchmark_data_smithi096_19531_object86615:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:45.588 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:22.634609+0000", 2024-04-19T03:02:45.588 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 22.937958604999999, 2024-04-19T03:02:45.588 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.19472088900000001, 2024-04-19T03:02:45.588 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:45.588 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:45.588 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:45.588 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:45.588 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:45.588 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 86616 2024-04-19T03:02:45.588 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.588 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:45.588 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.589 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:45.589 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634609+0000", 2024-04-19T03:02:45.589 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:45.589 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.589 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.589 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:45.589 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634609+0000", 2024-04-19T03:02:45.589 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:45.589 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.589 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.589 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:45.589 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634609+0000", 2024-04-19T03:02:45.589 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:45.589 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.590 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.590 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:45.590 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634651+0000", 2024-04-19T03:02:45.590 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2589000000000002e-05 2024-04-19T03:02:45.590 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.590 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.590 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:45.590 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634659+0000", 2024-04-19T03:02:45.590 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5850000000000002e-06 2024-04-19T03:02:45.590 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.590 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.590 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:45.591 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634662+0000", 2024-04-19T03:02:45.591 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3620000000000002e-06 2024-04-19T03:02:45.591 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.591 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.591 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:45.591 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.637880+0000", 2024-04-19T03:02:45.591 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.003218149 2024-04-19T03:02:45.591 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.591 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.591 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:45.591 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.637999+0000", 2024-04-19T03:02:45.591 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000118643 2024-04-19T03:02:45.591 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.591 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.592 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:45.592 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.638102+0000", 2024-04-19T03:02:45.592 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010331 2024-04-19T03:02:45.592 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.592 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.592 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:45.592 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.640851+0000", 2024-04-19T03:02:45.592 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0027483310000000001 2024-04-19T03:02:45.592 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.592 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.592 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:45.592 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.829269+0000", 2024-04-19T03:02:45.592 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.188418319 2024-04-19T03:02:45.592 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.592 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.593 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:45.593 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.829299+0000", 2024-04-19T03:02:45.593 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0227e-05 2024-04-19T03:02:45.593 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.593 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.593 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:45.593 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.829330+0000", 2024-04-19T03:02:45.593 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0969000000000001e-05 2024-04-19T03:02:45.593 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:45.593 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:45.593 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:45.593 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.593 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.594 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:86618 5.0 5:09014b90:::benchmark_data_smithi096_19531_object86617:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:45.594 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:22.634894+0000", 2024-04-19T03:02:45.594 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 22.937674117, 2024-04-19T03:02:45.594 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.19413419800000001, 2024-04-19T03:02:45.594 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:45.594 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:45.594 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:45.594 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:45.594 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:45.594 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 86618 2024-04-19T03:02:45.594 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.594 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:45.594 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.595 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:45.595 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634894+0000", 2024-04-19T03:02:45.595 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:45.595 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.595 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.595 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:45.595 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634894+0000", 2024-04-19T03:02:45.595 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:45.595 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.595 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.595 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:45.595 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634893+0000", 2024-04-19T03:02:45.596 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:45.596 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.596 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.596 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:45.596 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634976+0000", 2024-04-19T03:02:45.596 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3231000000000003e-05 2024-04-19T03:02:45.596 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.596 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.596 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:45.596 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634983+0000", 2024-04-19T03:02:45.596 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5169999999999996e-06 2024-04-19T03:02:45.596 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.596 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.597 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:45.597 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634987+0000", 2024-04-19T03:02:45.597 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.425e-06 2024-04-19T03:02:45.597 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.597 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.597 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:45.597 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635030+0000", 2024-04-19T03:02:45.597 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.32e-05 2024-04-19T03:02:45.597 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.597 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.597 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:45.597 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635185+0000", 2024-04-19T03:02:45.597 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015471899999999999 2024-04-19T03:02:45.598 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.598 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.598 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:45.598 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635415+0000", 2024-04-19T03:02:45.598 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00023026500000000001 2024-04-19T03:02:45.598 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.598 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.598 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:45.598 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.640127+0000", 2024-04-19T03:02:45.598 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0047118890000000004 2024-04-19T03:02:45.598 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.598 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.598 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:45.599 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.828895+0000", 2024-04-19T03:02:45.599 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.18876802600000001 2024-04-19T03:02:45.599 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.599 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.599 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:45.599 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.828972+0000", 2024-04-19T03:02:45.599 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.6345000000000002e-05 2024-04-19T03:02:45.599 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.599 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.599 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:45.599 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.829028+0000", 2024-04-19T03:02:45.599 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6342999999999999e-05 2024-04-19T03:02:45.599 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:45.600 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:45.600 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:45.600 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.600 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.600 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:86620 5.b 5:d80faa68:::benchmark_data_smithi096_19531_object86619:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:45.600 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:22.635110+0000", 2024-04-19T03:02:45.600 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 22.937457556999998, 2024-04-19T03:02:45.600 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.193447275, 2024-04-19T03:02:45.600 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:45.600 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:45.600 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:45.600 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:45.600 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:45.601 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 86620 2024-04-19T03:02:45.601 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.601 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:45.601 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.601 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:45.601 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635110+0000", 2024-04-19T03:02:45.601 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:45.601 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.601 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.601 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:45.601 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635110+0000", 2024-04-19T03:02:45.601 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:45.601 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.601 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.602 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:45.602 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635110+0000", 2024-04-19T03:02:45.602 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:45.602 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.602 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.602 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:45.602 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635154+0000", 2024-04-19T03:02:45.602 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4681000000000001e-05 2024-04-19T03:02:45.602 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.602 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.602 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:45.602 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635166+0000", 2024-04-19T03:02:45.602 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1505000000000001e-05 2024-04-19T03:02:45.603 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.603 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.603 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:45.603 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635171+0000", 2024-04-19T03:02:45.603 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6040000000000003e-06 2024-04-19T03:02:45.603 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.603 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.603 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:45.603 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635221+0000", 2024-04-19T03:02:45.603 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9947000000000001e-05 2024-04-19T03:02:45.603 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.603 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.603 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:45.604 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635356+0000", 2024-04-19T03:02:45.604 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013576199999999999 2024-04-19T03:02:45.604 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.604 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.604 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:45.604 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635507+0000", 2024-04-19T03:02:45.604 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015072999999999999 2024-04-19T03:02:45.604 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.604 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.604 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:45.604 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.638488+0000", 2024-04-19T03:02:45.604 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0029813159999999999 2024-04-19T03:02:45.605 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.605 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.605 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:45.605 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.828341+0000", 2024-04-19T03:02:45.605 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.189852254 2024-04-19T03:02:45.605 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.605 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.605 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:45.605 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.828416+0000", 2024-04-19T03:02:45.605 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5344000000000002e-05 2024-04-19T03:02:45.605 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.605 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.605 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:45.605 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.828558+0000", 2024-04-19T03:02:45.606 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000141695 2024-04-19T03:02:45.606 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:45.606 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:45.606 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:45.606 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.606 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.606 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:86621 5.8 5:1597a420:::benchmark_data_smithi096_19531_object86620:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:45.606 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:22.635187+0000", 2024-04-19T03:02:45.606 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 22.937380697000002, 2024-04-19T03:02:45.606 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.194204878, 2024-04-19T03:02:45.606 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:45.606 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:45.607 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:45.607 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:45.607 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:45.607 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 86621 2024-04-19T03:02:45.607 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.607 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:45.607 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.607 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:45.607 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635187+0000", 2024-04-19T03:02:45.607 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:45.607 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.607 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.607 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:45.608 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635187+0000", 2024-04-19T03:02:45.608 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:45.608 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.608 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.608 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:45.608 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635187+0000", 2024-04-19T03:02:45.608 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:45.608 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.608 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.608 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:45.608 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635242+0000", 2024-04-19T03:02:45.608 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5158000000000003e-05 2024-04-19T03:02:45.609 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.609 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.609 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:45.609 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635249+0000", 2024-04-19T03:02:45.609 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.7000000000000008e-06 2024-04-19T03:02:45.609 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.609 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.609 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:45.609 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635256+0000", 2024-04-19T03:02:45.609 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2060000000000004e-06 2024-04-19T03:02:45.609 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.609 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.609 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:45.609 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635302+0000", 2024-04-19T03:02:45.610 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5954000000000001e-05 2024-04-19T03:02:45.610 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.610 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.610 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:45.610 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635427+0000", 2024-04-19T03:02:45.610 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012559299999999999 2024-04-19T03:02:45.610 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.610 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.610 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:45.610 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635596+0000", 2024-04-19T03:02:45.610 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000168615 2024-04-19T03:02:45.610 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.610 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.611 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:45.611 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.639320+0000", 2024-04-19T03:02:45.611 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0037244610000000001 2024-04-19T03:02:45.611 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.611 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.611 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:45.611 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.829277+0000", 2024-04-19T03:02:45.611 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.18995651099999999 2024-04-19T03:02:45.611 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.611 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.611 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:45.611 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.829341+0000", 2024-04-19T03:02:45.611 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3756000000000004e-05 2024-04-19T03:02:45.611 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.612 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.612 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:45.612 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.829392+0000", 2024-04-19T03:02:45.612 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1555999999999999e-05 2024-04-19T03:02:45.612 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:45.612 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:45.612 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:45.612 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.612 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.612 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87062 5.4 5:2d3b5d9a:::benchmark_data_smithi096_19531_object87061:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:45.612 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.136820+0000", 2024-04-19T03:02:45.612 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 22.435747544000002, 2024-04-19T03:02:45.612 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.066483741999999998, 2024-04-19T03:02:45.612 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:45.613 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:45.613 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:45.613 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:45.613 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:45.613 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87062 2024-04-19T03:02:45.613 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.613 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:45.613 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.613 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:45.613 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.136820+0000", 2024-04-19T03:02:45.613 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:45.613 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.613 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.614 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:45.614 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.136820+0000", 2024-04-19T03:02:45.614 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:45.614 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.614 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.614 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:45.614 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.136819+0000", 2024-04-19T03:02:45.614 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:45.614 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.614 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.614 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:45.614 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.136864+0000", 2024-04-19T03:02:45.615 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4855000000000003e-05 2024-04-19T03:02:45.615 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.615 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.615 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:45.615 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.136881+0000", 2024-04-19T03:02:45.615 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7521999999999999e-05 2024-04-19T03:02:45.615 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.615 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.615 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:45.615 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.136890+0000", 2024-04-19T03:02:45.615 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1039999999999996e-06 2024-04-19T03:02:45.615 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.615 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.616 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:45.616 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.136974+0000", 2024-04-19T03:02:45.618 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3735999999999999e-05 2024-04-19T03:02:45.618 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.618 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.618 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:45.618 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.137308+0000", 2024-04-19T03:02:45.619 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00033376100000000002 2024-04-19T03:02:45.619 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.619 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.619 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:45.619 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.137559+0000", 2024-04-19T03:02:45.619 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000250599 2024-04-19T03:02:45.619 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.619 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.619 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:45.619 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.145423+0000", 2024-04-19T03:02:45.619 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0078649589999999995 2024-04-19T03:02:45.619 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.619 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.619 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:45.619 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.203175+0000", 2024-04-19T03:02:45.620 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057751255000000001 2024-04-19T03:02:45.620 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.620 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.620 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:45.620 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.203250+0000", 2024-04-19T03:02:45.620 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5378999999999998e-05 2024-04-19T03:02:45.620 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.620 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.620 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:45.620 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.203304+0000", 2024-04-19T03:02:45.620 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4015999999999999e-05 2024-04-19T03:02:45.620 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:45.620 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:45.621 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:45.621 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.621 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.621 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87065 5.4 5:21d20a47:::benchmark_data_smithi096_19531_object87064:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:45.621 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.137482+0000", 2024-04-19T03:02:45.621 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 22.43508581, 2024-04-19T03:02:45.621 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.065988749999999999, 2024-04-19T03:02:45.621 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:45.621 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:45.621 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:45.621 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:45.621 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:45.621 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87065 2024-04-19T03:02:45.622 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.622 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:45.622 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.622 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:45.622 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.137482+0000", 2024-04-19T03:02:45.622 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:45.622 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.622 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.622 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:45.622 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.137482+0000", 2024-04-19T03:02:45.622 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:45.622 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.623 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.623 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:45.623 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.137481+0000", 2024-04-19T03:02:45.623 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:45.623 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.623 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.623 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:45.623 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.137530+0000", 2024-04-19T03:02:45.623 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9302000000000003e-05 2024-04-19T03:02:45.623 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.623 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.623 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:45.624 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.137540+0000", 2024-04-19T03:02:45.624 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.2010000000000005e-06 2024-04-19T03:02:45.624 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.624 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.624 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:45.624 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.137545+0000", 2024-04-19T03:02:45.624 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5910000000000003e-06 2024-04-19T03:02:45.624 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.624 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.624 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:45.624 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.140666+0000", 2024-04-19T03:02:45.624 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0031212710000000001 2024-04-19T03:02:45.624 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.624 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.625 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:45.625 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.140847+0000", 2024-04-19T03:02:45.625 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00018065600000000001 2024-04-19T03:02:45.625 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.625 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.625 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:45.625 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.140991+0000", 2024-04-19T03:02:45.625 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014433100000000001 2024-04-19T03:02:45.625 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.625 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.625 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:45.625 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.148053+0000", 2024-04-19T03:02:45.626 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.007061945 2024-04-19T03:02:45.626 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.626 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.626 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:45.626 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.203367+0000", 2024-04-19T03:02:45.626 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.055313703999999998 2024-04-19T03:02:45.626 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.626 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.626 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:45.626 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.203426+0000", 2024-04-19T03:02:45.626 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9024000000000003e-05 2024-04-19T03:02:45.626 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.626 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.627 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:45.627 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.203471+0000", 2024-04-19T03:02:45.627 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4818999999999999e-05 2024-04-19T03:02:45.627 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:45.627 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:45.627 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:45.627 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.627 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.627 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87067 5.b 5:d57af71a:::benchmark_data_smithi096_19531_object87066:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:45.627 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.142233+0000", 2024-04-19T03:02:45.627 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 22.430334834, 2024-04-19T03:02:45.627 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.071692405000000001, 2024-04-19T03:02:45.627 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:45.628 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:45.628 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:45.628 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:45.628 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:45.628 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87067 2024-04-19T03:02:45.628 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.628 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:45.628 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.628 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:45.628 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142233+0000", 2024-04-19T03:02:45.628 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:45.628 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.628 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.629 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:45.629 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142233+0000", 2024-04-19T03:02:45.629 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:45.629 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.629 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.629 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:45.629 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142232+0000", 2024-04-19T03:02:45.629 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:45.629 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.629 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.629 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:45.629 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142277+0000", 2024-04-19T03:02:45.629 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5837000000000002e-05 2024-04-19T03:02:45.629 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.630 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.630 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:45.630 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142297+0000", 2024-04-19T03:02:45.630 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9561000000000001e-05 2024-04-19T03:02:45.630 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.630 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.630 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:45.630 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142311+0000", 2024-04-19T03:02:45.630 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3654e-05 2024-04-19T03:02:45.630 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.630 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.630 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:45.630 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142391+0000", 2024-04-19T03:02:45.630 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0123999999999994e-05 2024-04-19T03:02:45.631 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.631 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.631 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:45.631 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142669+0000", 2024-04-19T03:02:45.631 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00027829800000000001 2024-04-19T03:02:45.631 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.631 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.631 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:45.631 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142859+0000", 2024-04-19T03:02:45.631 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000190051 2024-04-19T03:02:45.631 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.631 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.631 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:45.632 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.150597+0000", 2024-04-19T03:02:45.632 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0077380299999999999 2024-04-19T03:02:45.632 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.632 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.632 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:45.632 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.213855+0000", 2024-04-19T03:02:45.632 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.063257987000000002 2024-04-19T03:02:45.632 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.632 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.632 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:45.632 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.213898+0000", 2024-04-19T03:02:45.632 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2916e-05 2024-04-19T03:02:45.632 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.632 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.633 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:45.633 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.213925+0000", 2024-04-19T03:02:45.633 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7503000000000001e-05 2024-04-19T03:02:45.633 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:45.633 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:45.633 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:45.633 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.633 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.633 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87069 5.b 5:da0c93b5:::benchmark_data_smithi096_19531_object87068:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:45.633 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.143402+0000", 2024-04-19T03:02:45.633 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 22.429165871999999, 2024-04-19T03:02:45.633 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.070678598999999995, 2024-04-19T03:02:45.633 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:45.633 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:45.633 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:45.634 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:45.634 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:45.634 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87069 2024-04-19T03:02:45.634 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.634 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:45.634 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.634 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:45.634 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.143402+0000", 2024-04-19T03:02:45.634 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:45.634 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.634 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.634 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:45.634 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.143402+0000", 2024-04-19T03:02:45.635 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:45.635 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.635 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.635 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:45.635 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.143401+0000", 2024-04-19T03:02:45.635 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:45.635 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.635 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.635 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:45.635 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.143501+0000", 2024-04-19T03:02:45.635 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000100387 2024-04-19T03:02:45.635 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.636 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.636 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:45.636 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.143516+0000", 2024-04-19T03:02:45.636 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5369000000000001e-05 2024-04-19T03:02:45.636 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.636 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.636 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:45.636 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.143524+0000", 2024-04-19T03:02:45.636 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.7079999999999997e-06 2024-04-19T03:02:45.636 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.636 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.636 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:45.636 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.145550+0000", 2024-04-19T03:02:45.636 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0020259290000000001 2024-04-19T03:02:45.637 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.637 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.637 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:45.637 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.145676+0000", 2024-04-19T03:02:45.637 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000126406 2024-04-19T03:02:45.637 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.637 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.637 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:45.637 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.145802+0000", 2024-04-19T03:02:45.637 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000125974 2024-04-19T03:02:45.637 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.638 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.638 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:45.638 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.151030+0000", 2024-04-19T03:02:45.638 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0052276079999999999 2024-04-19T03:02:45.638 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.638 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.638 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:45.638 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.213998+0000", 2024-04-19T03:02:45.638 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.06296786 2024-04-19T03:02:45.638 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.638 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.638 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:45.638 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.214031+0000", 2024-04-19T03:02:45.639 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3387999999999999e-05 2024-04-19T03:02:45.639 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.639 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.639 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:45.639 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.214081+0000", 2024-04-19T03:02:45.639 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9316e-05 2024-04-19T03:02:45.639 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:45.639 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:45.639 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:45.639 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.639 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.639 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87073 5.0 5:0ca21233:::benchmark_data_smithi096_19531_object87072:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:45.639 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.145929+0000", 2024-04-19T03:02:45.640 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 22.426638612000001, 2024-04-19T03:02:45.640 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.062283234999999999, 2024-04-19T03:02:45.640 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:45.640 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:45.640 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:45.640 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:45.640 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:45.640 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87073 2024-04-19T03:02:45.640 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.640 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:45.640 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.640 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:45.640 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.145929+0000", 2024-04-19T03:02:45.640 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:45.641 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.641 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.641 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:45.641 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.145929+0000", 2024-04-19T03:02:45.641 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:45.641 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.641 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.641 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:45.641 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.145928+0000", 2024-04-19T03:02:45.641 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:45.641 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.641 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.641 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:45.641 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.146063+0000", 2024-04-19T03:02:45.641 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013541099999999999 2024-04-19T03:02:45.642 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.642 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.642 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:45.642 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.146079+0000", 2024-04-19T03:02:45.642 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5902000000000001e-05 2024-04-19T03:02:45.642 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.642 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.642 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:45.642 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.146100+0000", 2024-04-19T03:02:45.642 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0380000000000001e-05 2024-04-19T03:02:45.642 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.642 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.643 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:45.643 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.146193+0000", 2024-04-19T03:02:45.643 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.3669000000000001e-05 2024-04-19T03:02:45.643 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.643 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.643 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:45.643 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.146388+0000", 2024-04-19T03:02:45.643 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00019457799999999999 2024-04-19T03:02:45.643 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.643 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.643 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:45.643 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.146625+0000", 2024-04-19T03:02:45.643 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00023751999999999999 2024-04-19T03:02:45.644 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.644 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.644 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:45.644 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.151051+0000", 2024-04-19T03:02:45.644 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0044260039999999999 2024-04-19T03:02:45.644 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.644 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.644 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:45.644 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.207872+0000", 2024-04-19T03:02:45.644 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.056821114999999998 2024-04-19T03:02:45.644 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.644 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.644 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:45.645 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.208085+0000", 2024-04-19T03:02:45.645 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000212893 2024-04-19T03:02:45.645 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.645 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.645 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:45.645 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.208213+0000", 2024-04-19T03:02:45.645 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012714700000000001 2024-04-19T03:02:45.645 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:45.645 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:45.645 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:45.645 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.645 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.645 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87074 5.0 5:035614ac:::benchmark_data_smithi096_19531_object87073:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:45.646 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.151387+0000", 2024-04-19T03:02:45.646 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 22.421180680999999, 2024-04-19T03:02:45.646 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.063461771, 2024-04-19T03:02:45.646 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:45.646 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:45.646 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:45.646 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:45.646 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:45.646 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87074 2024-04-19T03:02:45.646 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.646 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:45.646 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.647 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:45.647 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.151387+0000", 2024-04-19T03:02:45.647 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:45.647 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.647 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.647 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:45.647 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.151387+0000", 2024-04-19T03:02:45.647 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:45.647 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.647 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.647 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:45.647 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.151386+0000", 2024-04-19T03:02:45.647 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:45.647 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.648 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.648 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:45.648 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.151428+0000", 2024-04-19T03:02:45.648 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.172e-05 2024-04-19T03:02:45.648 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.648 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.648 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:45.648 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.151442+0000", 2024-04-19T03:02:45.648 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4328000000000001e-05 2024-04-19T03:02:45.648 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.648 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.649 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:45.649 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.151451+0000", 2024-04-19T03:02:45.649 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.8400000000000001e-06 2024-04-19T03:02:45.649 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.649 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.649 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:45.649 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.151521+0000", 2024-04-19T03:02:45.649 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.9606999999999999e-05 2024-04-19T03:02:45.649 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.649 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.649 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:45.649 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.151749+0000", 2024-04-19T03:02:45.649 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00022818799999999999 2024-04-19T03:02:45.649 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.650 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.650 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:45.650 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.152006+0000", 2024-04-19T03:02:45.650 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00025687300000000002 2024-04-19T03:02:45.650 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.650 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.650 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:45.650 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.154887+0000", 2024-04-19T03:02:45.650 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0028812989999999999 2024-04-19T03:02:45.650 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.650 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.650 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:45.651 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.214733+0000", 2024-04-19T03:02:45.651 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.059846159000000003 2024-04-19T03:02:45.651 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.651 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.651 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:45.651 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.214788+0000", 2024-04-19T03:02:45.651 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4524000000000002e-05 2024-04-19T03:02:45.651 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.651 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.651 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:45.651 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.214849+0000", 2024-04-19T03:02:45.651 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1362e-05 2024-04-19T03:02:45.651 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:45.651 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:45.652 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:45.652 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.652 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.652 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87108 5.e 5:7e197adc:::benchmark_data_smithi096_19531_object87107:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:45.652 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.223103+0000", 2024-04-19T03:02:45.652 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 22.349464534999999, 2024-04-19T03:02:45.652 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.044946887, 2024-04-19T03:02:45.652 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:45.652 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-19T03:02:45.652 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:45.652 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:45.652 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:45.652 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87108 2024-04-19T03:02:45.653 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.653 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:45.653 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.653 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:45.653 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.223103+0000", 2024-04-19T03:02:45.653 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:45.653 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.653 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.653 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:45.653 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.223103+0000", 2024-04-19T03:02:45.653 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:45.653 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.653 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.653 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:45.653 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.223102+0000", 2024-04-19T03:02:45.653 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:45.654 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.654 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.654 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:45.654 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.223156+0000", 2024-04-19T03:02:45.654 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3958000000000001e-05 2024-04-19T03:02:45.654 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.654 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.654 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:45.654 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.223166+0000", 2024-04-19T03:02:45.654 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.4809999999999995e-06 2024-04-19T03:02:45.654 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.654 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.654 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:45.655 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.223172+0000", 2024-04-19T03:02:45.655 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0140000000000004e-06 2024-04-19T03:02:45.655 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.655 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.655 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:45.655 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.227295+0000", 2024-04-19T03:02:45.655 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0041233420000000003 2024-04-19T03:02:45.655 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.655 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.655 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:45.655 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.227495+0000", 2024-04-19T03:02:45.655 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00019955299999999999 2024-04-19T03:02:45.655 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.655 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.656 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:45.656 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.227717+0000", 2024-04-19T03:02:45.656 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000221902 2024-04-19T03:02:45.656 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.656 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.656 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:45.656 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233189+0000", 2024-04-19T03:02:45.656 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0054718889999999997 2024-04-19T03:02:45.656 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.656 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.656 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:45.656 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.250529+0000", 2024-04-19T03:02:45.656 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.017340298000000001 2024-04-19T03:02:45.656 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.657 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.657 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:02:45.657 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.250539+0000", 2024-04-19T03:02:45.657 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0501e-05 2024-04-19T03:02:45.657 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.657 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.657 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:45.657 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.268003+0000", 2024-04-19T03:02:45.657 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.017463429 2024-04-19T03:02:45.657 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.657 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.657 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:45.657 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.268050+0000", 2024-04-19T03:02:45.657 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7466000000000003e-05 2024-04-19T03:02:45.658 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:45.658 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:45.658 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:45.658 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.658 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.658 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87118 5.b 5:d1bb4f3c:::benchmark_data_smithi096_19531_object87117:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:45.658 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.231082+0000", 2024-04-19T03:02:45.658 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 22.341485701, 2024-04-19T03:02:45.658 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.035789004, 2024-04-19T03:02:45.658 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:45.658 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-19T03:02:45.658 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:45.658 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:45.659 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:45.659 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87118 2024-04-19T03:02:45.659 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.659 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:45.659 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.659 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:45.659 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231082+0000", 2024-04-19T03:02:45.659 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:45.659 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.659 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.659 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:45.659 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231082+0000", 2024-04-19T03:02:45.659 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:45.659 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.659 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.660 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:45.660 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231081+0000", 2024-04-19T03:02:45.660 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:45.660 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.660 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.660 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:45.660 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231159+0000", 2024-04-19T03:02:45.660 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.7819999999999997e-05 2024-04-19T03:02:45.660 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.660 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.660 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:45.660 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231186+0000", 2024-04-19T03:02:45.660 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7126000000000001e-05 2024-04-19T03:02:45.660 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.661 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.661 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:45.661 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231193+0000", 2024-04-19T03:02:45.661 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7259999999999996e-06 2024-04-19T03:02:45.661 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.661 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.661 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:45.661 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231241+0000", 2024-04-19T03:02:45.661 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8123e-05 2024-04-19T03:02:45.661 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.661 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.661 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:45.661 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231354+0000", 2024-04-19T03:02:45.661 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0001133 2024-04-19T03:02:45.662 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.662 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.662 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:45.662 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231443+0000", 2024-04-19T03:02:45.662 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9167999999999997e-05 2024-04-19T03:02:45.662 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.662 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.662 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:45.662 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236498+0000", 2024-04-19T03:02:45.662 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0050545160000000002 2024-04-19T03:02:45.662 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.662 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.662 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:45.663 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.249681+0000", 2024-04-19T03:02:45.663 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013183321 2024-04-19T03:02:45.663 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.663 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.663 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:02:45.663 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.249693+0000", 2024-04-19T03:02:45.663 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1834999999999999e-05 2024-04-19T03:02:45.663 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.663 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.663 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:45.663 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266733+0000", 2024-04-19T03:02:45.663 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.017040408 2024-04-19T03:02:45.663 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.663 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.663 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:45.664 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266871+0000", 2024-04-19T03:02:45.664 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000137849 2024-04-19T03:02:45.664 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:45.664 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:45.664 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:45.664 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.664 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.664 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87121 5.b 5:d01822b8:::benchmark_data_smithi096_19531_object87120:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:45.664 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.233319+0000", 2024-04-19T03:02:45.664 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 22.339248837, 2024-04-19T03:02:45.664 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.033624198, 2024-04-19T03:02:45.664 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:45.664 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-19T03:02:45.664 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:45.664 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:45.665 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:45.665 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87121 2024-04-19T03:02:45.665 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.665 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:45.665 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.665 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:45.665 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233319+0000", 2024-04-19T03:02:45.665 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:45.665 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.665 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.665 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:45.665 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233319+0000", 2024-04-19T03:02:45.665 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:45.665 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.666 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.666 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:45.666 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233319+0000", 2024-04-19T03:02:45.666 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:45.666 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.666 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.666 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:45.666 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233364+0000", 2024-04-19T03:02:45.666 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5460999999999997e-05 2024-04-19T03:02:45.666 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.666 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.666 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:45.666 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233382+0000", 2024-04-19T03:02:45.667 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8148e-05 2024-04-19T03:02:45.667 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.667 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.667 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:45.667 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233390+0000", 2024-04-19T03:02:45.667 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5340000000000002e-06 2024-04-19T03:02:45.667 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.667 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.667 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:45.667 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233712+0000", 2024-04-19T03:02:45.667 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00032260500000000001 2024-04-19T03:02:45.667 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.667 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.667 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:45.667 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233829+0000", 2024-04-19T03:02:45.668 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011638599999999999 2024-04-19T03:02:45.668 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.668 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.668 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:45.668 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233959+0000", 2024-04-19T03:02:45.668 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013013900000000001 2024-04-19T03:02:45.668 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.668 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.668 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:45.668 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236515+0000", 2024-04-19T03:02:45.668 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0025562750000000002 2024-04-19T03:02:45.668 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.668 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.668 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:45.669 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.249723+0000", 2024-04-19T03:02:45.669 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013208176 2024-04-19T03:02:45.669 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.669 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.669 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:02:45.669 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.249728+0000", 2024-04-19T03:02:45.669 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6519999999999997e-06 2024-04-19T03:02:45.669 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.669 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.669 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:45.669 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266837+0000", 2024-04-19T03:02:45.669 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0171087059999999 2024-04-19T03:02:45.669 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.669 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.669 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:45.670 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266943+0000", 2024-04-19T03:02:45.670 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000106604 2024-04-19T03:02:45.670 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:45.670 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:45.670 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:45.670 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.670 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.670 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87124 5.8 5:14819ad7:::benchmark_data_smithi096_19531_object87123:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:45.670 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.235886+0000", 2024-04-19T03:02:45.670 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 22.336681413000001, 2024-04-19T03:02:45.670 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0315451179999999, 2024-04-19T03:02:45.670 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:45.670 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-19T03:02:45.671 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:45.671 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:45.671 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:45.671 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87124 2024-04-19T03:02:45.671 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.671 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:45.671 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.671 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:45.671 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.235886+0000", 2024-04-19T03:02:45.671 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:45.671 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.671 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.671 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:45.671 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.235886+0000", 2024-04-19T03:02:45.672 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:45.672 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.672 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.672 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:45.672 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.235886+0000", 2024-04-19T03:02:45.672 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:45.672 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.672 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.672 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:45.672 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.235934+0000", 2024-04-19T03:02:45.672 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8384000000000003e-05 2024-04-19T03:02:45.672 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.672 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.673 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:45.673 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.235945+0000", 2024-04-19T03:02:45.673 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0671e-05 2024-04-19T03:02:45.673 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.673 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.673 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:45.673 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.235952+0000", 2024-04-19T03:02:45.673 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3089999999999998e-06 2024-04-19T03:02:45.673 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.673 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.673 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:45.673 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.237067+0000", 2024-04-19T03:02:45.673 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001115263 2024-04-19T03:02:45.673 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.674 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.674 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:45.674 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.237188+0000", 2024-04-19T03:02:45.674 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000121258 2024-04-19T03:02:45.674 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.674 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.674 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:45.674 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.237316+0000", 2024-04-19T03:02:45.674 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000128071 2024-04-19T03:02:45.674 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.674 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.674 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:45.674 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240744+0000", 2024-04-19T03:02:45.674 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0034275629999999998 2024-04-19T03:02:45.675 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.675 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.675 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:45.675 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.252517+0000", 2024-04-19T03:02:45.675 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011772991999999999 2024-04-19T03:02:45.675 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.675 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.675 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:02:45.675 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.252523+0000", 2024-04-19T03:02:45.675 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3640000000000004e-06 2024-04-19T03:02:45.675 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.675 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.675 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:45.675 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.267290+0000", 2024-04-19T03:02:45.675 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0147665690000001 2024-04-19T03:02:45.676 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.676 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.676 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:45.676 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.267432+0000", 2024-04-19T03:02:45.676 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014165299999999999 2024-04-19T03:02:45.676 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:45.676 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:45.676 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:45.676 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.676 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.676 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87129 5.0 5:02667e01:::benchmark_data_smithi096_19531_object87128:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:45.676 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.236466+0000", 2024-04-19T03:02:45.676 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 22.336101416999998, 2024-04-19T03:02:45.677 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0301534510000001, 2024-04-19T03:02:45.677 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:45.677 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-19T03:02:45.677 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:45.677 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:45.677 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:45.677 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87129 2024-04-19T03:02:45.677 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.677 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:45.677 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.677 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:45.677 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236466+0000", 2024-04-19T03:02:45.677 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:45.677 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.678 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.678 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:45.678 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236466+0000", 2024-04-19T03:02:45.678 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:45.678 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.678 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.678 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:45.678 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236465+0000", 2024-04-19T03:02:45.678 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:45.678 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.678 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.678 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:45.678 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236566+0000", 2024-04-19T03:02:45.679 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010047000000000001 2024-04-19T03:02:45.679 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.679 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.679 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:45.679 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236577+0000", 2024-04-19T03:02:45.679 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1772e-05 2024-04-19T03:02:45.679 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.679 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.679 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:45.679 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236584+0000", 2024-04-19T03:02:45.679 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0530000000000003e-06 2024-04-19T03:02:45.679 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.679 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.679 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:45.680 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.237023+0000", 2024-04-19T03:02:45.680 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000439703 2024-04-19T03:02:45.680 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.680 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.680 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:45.680 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.237207+0000", 2024-04-19T03:02:45.680 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000183692 2024-04-19T03:02:45.680 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.680 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.680 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:45.680 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.237373+0000", 2024-04-19T03:02:45.680 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016623500000000001 2024-04-19T03:02:45.680 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.680 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.681 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:45.681 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.241461+0000", 2024-04-19T03:02:45.681 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0040883050000000004 2024-04-19T03:02:45.681 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.681 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.681 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:45.681 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.252500+0000", 2024-04-19T03:02:45.681 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011038450999999999 2024-04-19T03:02:45.681 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.681 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.681 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:02:45.681 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.252507+0000", 2024-04-19T03:02:45.681 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2439999999999996e-06 2024-04-19T03:02:45.682 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.682 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.682 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:45.682 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266538+0000", 2024-04-19T03:02:45.682 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.014031184 2024-04-19T03:02:45.682 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.682 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.682 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:45.682 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266620+0000", 2024-04-19T03:02:45.682 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1600000000000005e-05 2024-04-19T03:02:45.682 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:45.682 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:45.682 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:45.683 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.683 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.683 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87135 5.4 5:2a97e7b7:::benchmark_data_smithi096_19531_object87134:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:45.683 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.240884+0000", 2024-04-19T03:02:45.683 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 22.331683959999999, 2024-04-19T03:02:45.683 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.025708931, 2024-04-19T03:02:45.683 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:45.683 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-19T03:02:45.683 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:45.683 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:45.683 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:45.683 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87135 2024-04-19T03:02:45.683 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.683 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:45.684 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.684 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:45.684 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240884+0000", 2024-04-19T03:02:45.684 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:45.684 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.684 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.684 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:45.684 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240884+0000", 2024-04-19T03:02:45.684 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:45.684 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.684 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.684 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:45.684 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240883+0000", 2024-04-19T03:02:45.684 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:45.685 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.685 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.685 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:45.685 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240933+0000", 2024-04-19T03:02:45.685 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9969999999999998e-05 2024-04-19T03:02:45.685 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.685 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.685 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:45.685 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240946+0000", 2024-04-19T03:02:45.685 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2943e-05 2024-04-19T03:02:45.685 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.685 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.685 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:45.685 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240952+0000", 2024-04-19T03:02:45.686 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8930000000000002e-06 2024-04-19T03:02:45.686 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.686 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.686 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:45.686 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240994+0000", 2024-04-19T03:02:45.686 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2753999999999998e-05 2024-04-19T03:02:45.686 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.686 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.686 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:45.686 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.241092+0000", 2024-04-19T03:02:45.686 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.7447000000000004e-05 2024-04-19T03:02:45.686 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.686 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.687 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:45.687 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.241183+0000", 2024-04-19T03:02:45.687 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1163999999999997e-05 2024-04-19T03:02:45.687 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.687 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.687 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:45.687 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.254672+0000", 2024-04-19T03:02:45.687 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.01348864 2024-04-19T03:02:45.687 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.687 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.687 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:02:45.687 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.254681+0000", 2024-04-19T03:02:45.687 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.3789999999999995e-06 2024-04-19T03:02:45.687 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.687 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.688 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:45.688 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266456+0000", 2024-04-19T03:02:45.688 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.011774621 2024-04-19T03:02:45.688 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.688 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.688 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:45.688 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266593+0000", 2024-04-19T03:02:45.688 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013737600000000001 2024-04-19T03:02:45.688 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:45.688 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:45.688 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:45.688 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.688 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.688 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87136 5.4 5:212411bc:::benchmark_data_smithi096_19531_object87135:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:45.688 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.240962+0000", 2024-04-19T03:02:45.689 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 22.331606084000001, 2024-04-19T03:02:45.689 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.025738, 2024-04-19T03:02:45.689 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:45.689 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-19T03:02:45.689 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:45.689 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:45.689 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:45.689 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87136 2024-04-19T03:02:45.689 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.689 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:45.689 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.689 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:45.690 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240962+0000", 2024-04-19T03:02:45.690 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:45.690 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.690 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.690 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:45.690 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240962+0000", 2024-04-19T03:02:45.690 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:45.690 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.690 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.690 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:45.690 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240961+0000", 2024-04-19T03:02:45.691 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:45.691 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.691 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.691 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:45.691 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240995+0000", 2024-04-19T03:02:45.691 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3868000000000002e-05 2024-04-19T03:02:45.691 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.691 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.691 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:45.691 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.241001+0000", 2024-04-19T03:02:45.691 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.322e-06 2024-04-19T03:02:45.691 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.691 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.692 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:45.692 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.241004+0000", 2024-04-19T03:02:45.692 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3510000000000002e-06 2024-04-19T03:02:45.692 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.692 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.692 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:45.692 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247131+0000", 2024-04-19T03:02:45.692 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0061270869999999998 2024-04-19T03:02:45.692 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.692 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.692 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:45.692 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247322+0000", 2024-04-19T03:02:45.692 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000191015 2024-04-19T03:02:45.693 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.693 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.693 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:45.693 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247542+0000", 2024-04-19T03:02:45.693 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00022030199999999999 2024-04-19T03:02:45.693 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.693 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.693 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:45.693 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.254709+0000", 2024-04-19T03:02:45.693 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0071662660000000001 2024-04-19T03:02:45.693 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.693 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.693 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:02:45.693 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.254716+0000", 2024-04-19T03:02:45.694 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3860000000000001e-06 2024-04-19T03:02:45.694 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.694 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.694 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:45.694 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266619+0000", 2024-04-19T03:02:45.694 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0119031030000001 2024-04-19T03:02:45.694 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.694 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.694 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:45.694 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266700+0000", 2024-04-19T03:02:45.694 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0764000000000001e-05 2024-04-19T03:02:45.694 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:45.695 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:45.695 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:45.695 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.695 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.695 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87138 5.e 5:7b1f1c20:::benchmark_data_smithi096_19531_object87137:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:45.695 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.247862+0000", 2024-04-19T03:02:45.695 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 22.32470601, 2024-04-19T03:02:45.695 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.024457079, 2024-04-19T03:02:45.695 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:45.695 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:45.695 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:45.695 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:45.695 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:45.695 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87138 2024-04-19T03:02:45.696 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.696 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:45.696 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.696 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:45.696 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247862+0000", 2024-04-19T03:02:45.696 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:45.696 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.696 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.696 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:45.696 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247862+0000", 2024-04-19T03:02:45.696 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:45.696 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.696 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.696 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:45.697 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247860+0000", 2024-04-19T03:02:45.697 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999981 2024-04-19T03:02:45.697 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.697 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.697 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:45.697 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247909+0000", 2024-04-19T03:02:45.697 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9150999999999997e-05 2024-04-19T03:02:45.697 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.697 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.697 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:45.697 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247925+0000", 2024-04-19T03:02:45.697 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5761999999999999e-05 2024-04-19T03:02:45.697 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.698 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.698 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:45.698 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247936+0000", 2024-04-19T03:02:45.698 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1144e-05 2024-04-19T03:02:45.698 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.698 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.698 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:45.698 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.250590+0000", 2024-04-19T03:02:45.698 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.002653678 2024-04-19T03:02:45.698 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.698 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.698 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:02:45.698 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.250599+0000", 2024-04-19T03:02:45.698 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9039999999999998e-06 2024-04-19T03:02:45.699 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.699 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.699 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:45.699 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.268151+0000", 2024-04-19T03:02:45.699 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0175523449999999 2024-04-19T03:02:45.699 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.699 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.699 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:45.699 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.268285+0000", 2024-04-19T03:02:45.699 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013415599999999999 2024-04-19T03:02:45.699 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.699 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.699 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:45.700 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.272238+0000", 2024-04-19T03:02:45.700 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0039533019999999997 2024-04-19T03:02:45.700 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.700 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.700 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:45.700 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.272274+0000", 2024-04-19T03:02:45.700 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5352000000000003e-05 2024-04-19T03:02:45.700 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:45.700 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:45.700 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:45.700 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.272319+0000", 2024-04-19T03:02:45.700 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5281999999999998e-05 2024-04-19T03:02:45.700 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:45.700 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:45.701 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:45.701 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:45.701 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:45.701 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-19T03:02:45.702 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T03:02:45.703 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:45.699+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:45.803 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:45.801+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:45.834 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-04-19T03:02:45.834 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [ 2024-04-19T03:02:45.834 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.834 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:127983 5.9 5:9f402569:::benchmark_data_smithi096_19531_object14533:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-19T03:02:45.834 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:45.828361+0000", 2024-04-19T03:02:45.834 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0041973449999999999, 2024-04-19T03:02:45.834 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0042219529999999996, 2024-04-19T03:02:45.834 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:45.834 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:02:45.834 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:45.834 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:45.835 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:45.835 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 127983 2024-04-19T03:02:45.835 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.835 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:45.835 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.835 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:45.835 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:45.828361+0000", 2024-04-19T03:02:45.835 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:45.835 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.835 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.835 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:45.835 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:45.828361+0000", 2024-04-19T03:02:45.835 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:45.835 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.836 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.836 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:45.836 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:45.828360+0000", 2024-04-19T03:02:45.836 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:45.836 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.836 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.836 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:45.836 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:45.828365+0000", 2024-04-19T03:02:45.836 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4469999999999999e-06 2024-04-19T03:02:45.836 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.836 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.836 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:45.836 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:45.828371+0000", 2024-04-19T03:02:45.836 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4400000000000002e-06 2024-04-19T03:02:45.837 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.837 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.837 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:45.837 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:45.828375+0000", 2024-04-19T03:02:45.837 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5580000000000001e-06 2024-04-19T03:02:45.837 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.837 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.837 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:45.837 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:45.828421+0000", 2024-04-19T03:02:45.837 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6201e-05 2024-04-19T03:02:45.837 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.837 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.837 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:45.838 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:45.828555+0000", 2024-04-19T03:02:45.838 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000133719 2024-04-19T03:02:45.838 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.838 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.838 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:02:45.838 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:45.828672+0000", 2024-04-19T03:02:45.838 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000117138 2024-04-19T03:02:45.838 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.838 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.838 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:45.839 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:45.831245+0000", 2024-04-19T03:02:45.839 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0025725930000000002 2024-04-19T03:02:45.839 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:45.839 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:45.839 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:45.839 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.839 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.839 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:127985 5.f 5:fa5054ab:::benchmark_data_smithi096_19531_object14535:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-19T03:02:45.839 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:45.829497+0000", 2024-04-19T03:02:45.839 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0030615439999999998, 2024-04-19T03:02:45.839 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0031420660000000002, 2024-04-19T03:02:45.839 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:45.839 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:02:45.839 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:45.840 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:45.840 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:45.840 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 127985 2024-04-19T03:02:45.840 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.840 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:45.840 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.840 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:45.840 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:45.829497+0000", 2024-04-19T03:02:45.840 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:45.840 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.840 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.841 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:45.841 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:45.829497+0000", 2024-04-19T03:02:45.841 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:45.841 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.841 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.841 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:45.841 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:45.829496+0000", 2024-04-19T03:02:45.841 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:45.841 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.841 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.841 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:45.841 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:45.829500+0000", 2024-04-19T03:02:45.841 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.613e-06 2024-04-19T03:02:45.842 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.842 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.842 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:45.842 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:45.829509+0000", 2024-04-19T03:02:45.842 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.3670000000000003e-06 2024-04-19T03:02:45.842 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.842 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.842 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:45.842 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:45.829515+0000", 2024-04-19T03:02:45.842 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1919999999999996e-06 2024-04-19T03:02:45.842 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.842 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.843 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:45.843 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:45.829545+0000", 2024-04-19T03:02:45.843 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0117e-05 2024-04-19T03:02:45.843 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.843 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.843 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:45.843 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:45.829643+0000", 2024-04-19T03:02:45.843 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.7998000000000006e-05 2024-04-19T03:02:45.843 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.843 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.843 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:02:45.843 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:45.829714+0000", 2024-04-19T03:02:45.843 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.1117000000000004e-05 2024-04-19T03:02:45.843 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.844 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.844 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:45.844 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:45.832162+0000", 2024-04-19T03:02:45.844 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00244801 2024-04-19T03:02:45.844 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:45.844 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:45.844 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:45.844 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.844 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.844 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:127986 5.d 5:b6495a7b:::benchmark_data_smithi096_19531_object14536:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-19T03:02:45.844 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:45.831098+0000", 2024-04-19T03:02:45.844 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0014604279999999999, 2024-04-19T03:02:45.844 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001581872, 2024-04-19T03:02:45.844 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:45.845 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:02:45.845 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:45.845 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:45.845 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:45.845 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 127986 2024-04-19T03:02:45.845 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.845 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:45.845 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.845 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:45.845 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:45.831098+0000", 2024-04-19T03:02:45.845 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:45.845 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.845 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.845 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:45.845 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:45.831098+0000", 2024-04-19T03:02:45.846 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:45.846 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.846 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.846 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:45.846 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:45.831097+0000", 2024-04-19T03:02:45.846 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:45.846 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.846 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.846 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:45.846 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:45.831103+0000", 2024-04-19T03:02:45.846 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0980000000000001e-06 2024-04-19T03:02:45.847 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.847 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.847 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:45.847 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:45.831117+0000", 2024-04-19T03:02:45.847 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4201e-05 2024-04-19T03:02:45.847 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.847 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.847 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:45.847 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:45.831123+0000", 2024-04-19T03:02:45.847 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0229999999999998e-06 2024-04-19T03:02:45.847 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.848 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.848 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:45.848 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:45.831167+0000", 2024-04-19T03:02:45.848 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4044e-05 2024-04-19T03:02:45.848 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.848 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.848 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:45.848 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:45.831288+0000", 2024-04-19T03:02:45.848 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000121259 2024-04-19T03:02:45.848 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.848 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.848 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:02:45.848 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:45.831355+0000", 2024-04-19T03:02:45.848 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6501999999999994e-05 2024-04-19T03:02:45.849 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:45.849 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:45.849 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:45.849 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.849 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.849 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:127987 5.1 5:8d139ffb:::benchmark_data_smithi096_19531_object14537:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-19T03:02:45.849 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:45.831138+0000", 2024-04-19T03:02:45.849 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0014206990000000001, 2024-04-19T03:02:45.849 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001589631, 2024-04-19T03:02:45.849 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:45.849 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-04-19T03:02:45.849 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:45.849 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:45.850 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:45.850 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 127987 2024-04-19T03:02:45.850 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.850 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:45.850 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.850 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:45.850 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:45.831138+0000", 2024-04-19T03:02:45.850 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:45.850 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.850 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.850 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:45.850 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:45.831138+0000", 2024-04-19T03:02:45.850 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:45.850 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.851 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.851 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:45.851 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:45.831137+0000", 2024-04-19T03:02:45.851 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:45.851 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.851 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.851 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:45.851 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:45.831140+0000", 2024-04-19T03:02:45.851 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.8899999999999999e-06 2024-04-19T03:02:45.851 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.851 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.851 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:45.851 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:45.831145+0000", 2024-04-19T03:02:45.851 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.527e-06 2024-04-19T03:02:45.852 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.852 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.852 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:45.852 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:45.831148+0000", 2024-04-19T03:02:45.852 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4419999999999998e-06 2024-04-19T03:02:45.852 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.852 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.852 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:45.852 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:45.831185+0000", 2024-04-19T03:02:45.852 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6808999999999999e-05 2024-04-19T03:02:45.852 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.852 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.852 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:45.852 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:45.831324+0000", 2024-04-19T03:02:45.853 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00013932500000000001 2024-04-19T03:02:45.853 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:45.853 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:45.853 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:45.853 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.853 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.853 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:127988 5.2 5:47499ba7:::benchmark_data_smithi096_19531_object14538:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-19T03:02:45.853 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:45.831244+0000", 2024-04-19T03:02:45.853 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.001314239, 2024-04-19T03:02:45.853 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0015163259999999999, 2024-04-19T03:02:45.853 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:45.853 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-04-19T03:02:45.853 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:45.853 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:45.854 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:45.854 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 127988 2024-04-19T03:02:45.854 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.854 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:45.854 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.854 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:45.854 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:45.831244+0000", 2024-04-19T03:02:45.854 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:45.854 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.854 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.854 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:45.854 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:45.831244+0000", 2024-04-19T03:02:45.854 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:45.855 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.855 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.855 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:45.855 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:45.831243+0000", 2024-04-19T03:02:45.855 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:45.855 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.855 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.855 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:45.855 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:45.831250+0000", 2024-04-19T03:02:45.855 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3409999999999999e-06 2024-04-19T03:02:45.855 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.855 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.855 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:45.855 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:45.831260+0000", 2024-04-19T03:02:45.856 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.8570000000000007e-06 2024-04-19T03:02:45.856 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.856 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.856 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:45.856 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:45.831268+0000", 2024-04-19T03:02:45.856 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6240000000000008e-06 2024-04-19T03:02:45.856 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.856 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.856 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:45.856 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:45.831310+0000", 2024-04-19T03:02:45.856 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1993999999999998e-05 2024-04-19T03:02:45.856 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.856 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.857 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:45.857 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:45.831432+0000", 2024-04-19T03:02:45.857 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00012171399999999999 2024-04-19T03:02:45.857 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:45.857 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:45.857 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:45.857 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.857 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.857 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:127989 5.d 5.c463a71d (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-19T03:02:45.857 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:45.831773+0000", 2024-04-19T03:02:45.857 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.00078614799999999997, 2024-04-19T03:02:45.857 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0010367, 2024-04-19T03:02:45.857 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:45.858 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-04-19T03:02:45.858 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:45.858 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:45.858 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:45.858 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 127989 2024-04-19T03:02:45.858 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.858 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:45.858 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.858 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:45.858 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:45.831773+0000", 2024-04-19T03:02:45.858 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:45.858 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.858 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.858 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:45.859 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:45.831773+0000", 2024-04-19T03:02:45.859 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:45.859 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.859 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.859 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:45.859 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:45.831772+0000", 2024-04-19T03:02:45.859 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:45.859 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.859 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.859 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:45.859 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:45.831782+0000", 2024-04-19T03:02:45.859 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.8840000000000006e-06 2024-04-19T03:02:45.859 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.859 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.859 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:45.860 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:45.831791+0000", 2024-04-19T03:02:45.860 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.9240000000000002e-06 2024-04-19T03:02:45.860 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.860 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.860 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:45.860 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:45.831798+0000", 2024-04-19T03:02:45.860 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7610000000000002e-06 2024-04-19T03:02:45.860 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.860 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.860 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:45.860 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:45.832796+0000", 2024-04-19T03:02:45.860 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00099770499999999999 2024-04-19T03:02:45.860 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:45.860 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:45.861 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:45.861 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.861 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.861 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:127990 5.c 5:3592ece3:::benchmark_data_smithi096_19531_object14540:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-19T03:02:45.861 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:45.832075+0000", 2024-04-19T03:02:45.861 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.00048333799999999999, 2024-04-19T03:02:45.861 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00079052400000000002, 2024-04-19T03:02:45.861 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:45.861 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-04-19T03:02:45.861 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:45.861 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:45.861 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:45.861 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 127990 2024-04-19T03:02:45.862 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.862 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:45.862 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.862 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:45.862 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:45.832075+0000", 2024-04-19T03:02:45.862 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:45.862 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.862 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.862 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:45.862 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:45.832075+0000", 2024-04-19T03:02:45.862 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:45.862 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.862 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.862 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:45.862 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:45.832074+0000", 2024-04-19T03:02:45.863 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:45.863 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.863 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.863 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:45.863 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:45.832080+0000", 2024-04-19T03:02:45.863 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4929999999999998e-06 2024-04-19T03:02:45.863 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.863 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.863 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:45.863 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:45.832091+0000", 2024-04-19T03:02:45.863 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1123e-05 2024-04-19T03:02:45.863 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.863 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.863 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:45.864 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:45.832099+0000", 2024-04-19T03:02:45.864 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5270000000000001e-06 2024-04-19T03:02:45.864 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.864 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.864 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:45.864 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:45.832170+0000", 2024-04-19T03:02:45.864 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.1453999999999997e-05 2024-04-19T03:02:45.864 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.864 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.864 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:45.864 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:45.832251+0000", 2024-04-19T03:02:45.864 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.1088999999999996e-05 2024-04-19T03:02:45.864 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:45.864 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:45.865 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:45.865 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.865 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.865 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:127991 5.f 5:f7fd18e4:::benchmark_data_smithi096_19531_object14541:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-19T03:02:45.865 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:45.832258+0000", 2024-04-19T03:02:45.865 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.00030027400000000001, 2024-04-19T03:02:45.865 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00067576400000000003, 2024-04-19T03:02:45.865 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:45.865 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:02:45.865 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:45.865 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:45.865 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:45.865 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 127991 2024-04-19T03:02:45.865 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.865 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:45.866 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.866 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:45.866 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:45.832258+0000", 2024-04-19T03:02:45.866 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:45.866 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.866 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.866 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:45.866 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:45.832258+0000", 2024-04-19T03:02:45.866 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:45.866 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.866 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.866 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:45.866 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:45.832258+0000", 2024-04-19T03:02:45.866 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:45.867 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.867 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.867 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:45.867 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:45.832262+0000", 2024-04-19T03:02:45.867 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8069999999999999e-06 2024-04-19T03:02:45.867 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.867 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.867 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:45.867 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:45.832273+0000", 2024-04-19T03:02:45.867 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0173999999999999e-05 2024-04-19T03:02:45.867 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.867 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.867 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:45.867 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:45.832279+0000", 2024-04-19T03:02:45.867 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8719999999999996e-06 2024-04-19T03:02:45.868 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.868 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.868 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:45.868 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:45.832324+0000", 2024-04-19T03:02:45.868 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4192e-05 2024-04-19T03:02:45.868 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.868 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.868 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:45.868 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:45.832434+0000", 2024-04-19T03:02:45.868 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000109932 2024-04-19T03:02:45.868 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:45.868 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:45.868 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:02:45.868 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:45.832534+0000", 2024-04-19T03:02:45.868 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000100104 2024-04-19T03:02:45.869 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:45.869 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:45.869 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:45.869 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:45.869 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-04-19T03:02:45.869 INFO:teuthology.orchestra.run.smithi144.stdout: "num_ops": 8 2024-04-19T03:02:45.869 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-04-19T03:02:45.870 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T03:02:45.903 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:45.899+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:45.999 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-04-19T03:02:45.999 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2024-04-19T03:02:45.999 INFO:teuthology.orchestra.run.smithi144.stdout: "complaint_time": 30, 2024-04-19T03:02:45.999 INFO:teuthology.orchestra.run.smithi144.stdout: "num_blocked_ops": 0 2024-04-19T03:02:45.999 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-04-19T03:02:46.005 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:46.001+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:46.012 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T03:02:46.104 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:46.103+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:46.184 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-04-19T03:02:46.184 INFO:teuthology.orchestra.run.smithi144.stdout: "size": 20, 2024-04-19T03:02:46.184 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 600, 2024-04-19T03:02:46.184 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [ 2024-04-19T03:02:46.184 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.184 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:78992 5.7 5:e6baa862:::benchmark_data_smithi096_19531_object78991:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-19T03:02:46.184 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:18.008888+0000", 2024-04-19T03:02:46.184 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 28.172292413000001, 2024-04-19T03:02:46.185 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.056375285999999997, 2024-04-19T03:02:46.185 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:46.185 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:46.185 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:46.185 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:46.185 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:46.185 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 78992 2024-04-19T03:02:46.185 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.185 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:46.185 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.185 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:46.185 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.008888+0000", 2024-04-19T03:02:46.185 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:46.186 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.186 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.186 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:46.186 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.008888+0000", 2024-04-19T03:02:46.186 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:46.186 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.186 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.186 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:46.186 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.008888+0000", 2024-04-19T03:02:46.186 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:46.186 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.186 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.186 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:46.187 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.008928+0000", 2024-04-19T03:02:46.187 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0361999999999997e-05 2024-04-19T03:02:46.187 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.187 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.187 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:46.187 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.008942+0000", 2024-04-19T03:02:46.187 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4365000000000001e-05 2024-04-19T03:02:46.187 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.187 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.187 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:46.187 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.008949+0000", 2024-04-19T03:02:46.187 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.212e-06 2024-04-19T03:02:46.187 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.188 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.188 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:46.188 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.012683+0000", 2024-04-19T03:02:46.188 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.003733934 2024-04-19T03:02:46.188 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.188 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.188 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:46.188 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.012798+0000", 2024-04-19T03:02:46.188 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00011574999999999999 2024-04-19T03:02:46.188 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.188 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.188 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:46.188 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.012896+0000", 2024-04-19T03:02:46.189 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.7848000000000002e-05 2024-04-19T03:02:46.189 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.189 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.189 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:46.189 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016423+0000", 2024-04-19T03:02:46.189 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0035270789999999998 2024-04-19T03:02:46.189 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.189 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.189 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:46.189 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.065098+0000", 2024-04-19T03:02:46.189 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.048674651999999999 2024-04-19T03:02:46.189 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.189 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.189 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:46.190 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.065193+0000", 2024-04-19T03:02:46.190 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.5087999999999995e-05 2024-04-19T03:02:46.190 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.190 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.190 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:46.190 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.065264+0000", 2024-04-19T03:02:46.190 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0666000000000004e-05 2024-04-19T03:02:46.190 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:46.190 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:46.190 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:46.190 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.190 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.191 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:78998 5.7 5:ee23c1bc:::benchmark_data_smithi096_19531_object78997:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-19T03:02:46.191 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:18.013165+0000", 2024-04-19T03:02:46.191 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 28.168015706999999, 2024-04-19T03:02:46.191 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.052410864000000001, 2024-04-19T03:02:46.191 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:46.191 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:46.191 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:46.191 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:46.191 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:46.191 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 78998 2024-04-19T03:02:46.191 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.191 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:46.191 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.191 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:46.192 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.013165+0000", 2024-04-19T03:02:46.192 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:46.192 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.192 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.192 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:46.192 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.013165+0000", 2024-04-19T03:02:46.192 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:46.192 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.192 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.192 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:46.192 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.013164+0000", 2024-04-19T03:02:46.192 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:46.192 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.193 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.193 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:46.193 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.013214+0000", 2024-04-19T03:02:46.193 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9636999999999999e-05 2024-04-19T03:02:46.193 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.193 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.193 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:46.193 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.013223+0000", 2024-04-19T03:02:46.193 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.3619999999999995e-06 2024-04-19T03:02:46.193 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.193 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.193 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:46.193 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.013229+0000", 2024-04-19T03:02:46.194 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6060000000000002e-06 2024-04-19T03:02:46.194 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.194 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.194 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:46.194 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.014882+0000", 2024-04-19T03:02:46.194 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001653257 2024-04-19T03:02:46.194 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.194 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.194 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:46.194 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.014958+0000", 2024-04-19T03:02:46.194 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6398999999999998e-05 2024-04-19T03:02:46.194 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.194 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.194 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:46.195 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.015036+0000", 2024-04-19T03:02:46.195 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8070000000000003e-05 2024-04-19T03:02:46.195 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.195 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.195 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:46.195 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018099+0000", 2024-04-19T03:02:46.195 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0030631149999999999 2024-04-19T03:02:46.195 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.195 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.195 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:46.195 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.065328+0000", 2024-04-19T03:02:46.195 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.047228349000000003 2024-04-19T03:02:46.195 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.195 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.196 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:46.196 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.065508+0000", 2024-04-19T03:02:46.196 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00018036899999999999 2024-04-19T03:02:46.196 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.196 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.196 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:46.196 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.065576+0000", 2024-04-19T03:02:46.196 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7785000000000002e-05 2024-04-19T03:02:46.196 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:46.196 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:46.196 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:46.196 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.196 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.196 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4755.0:78995 5.2 e40/39 5:42b55e12:::benchmark_data_smithi096_19531_object78994:head v 40'4934, mlcod=40'4932)", 2024-04-19T03:02:46.197 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:18.016247+0000", 2024-04-19T03:02:46.197 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 28.164933744999999, 2024-04-19T03:02:46.197 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.056240406, 2024-04-19T03:02:46.197 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:46.197 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:46.197 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:46.197 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.197 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:46.197 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016247+0000", 2024-04-19T03:02:46.198 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:46.198 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.198 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.198 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:46.198 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016247+0000", 2024-04-19T03:02:46.198 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:46.198 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.198 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.198 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:46.199 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016246+0000", 2024-04-19T03:02:46.199 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:46.199 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.199 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.199 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:46.199 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016315+0000", 2024-04-19T03:02:46.199 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8979000000000005e-05 2024-04-19T03:02:46.199 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.199 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.199 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:46.199 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016333+0000", 2024-04-19T03:02:46.200 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7586999999999999e-05 2024-04-19T03:02:46.200 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.200 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.200 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:46.200 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016340+0000", 2024-04-19T03:02:46.200 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4080000000000001e-06 2024-04-19T03:02:46.200 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.200 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.200 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:46.200 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016384+0000", 2024-04-19T03:02:46.200 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3656999999999999e-05 2024-04-19T03:02:46.200 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.200 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.201 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:46.201 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016403+0000", 2024-04-19T03:02:46.201 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9089e-05 2024-04-19T03:02:46.201 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.201 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.201 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:46.201 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.072448+0000", 2024-04-19T03:02:46.201 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.056045084000000002 2024-04-19T03:02:46.201 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.201 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.201 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:46.201 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.072487+0000", 2024-04-19T03:02:46.201 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9362e-05 2024-04-19T03:02:46.202 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:46.202 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:46.202 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:46.202 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.202 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.202 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4755.0:78994 5.c e40/22 5:3c60d55d:::benchmark_data_smithi096_19531_object78993:head v 40'4989, mlcod=40'4987)", 2024-04-19T03:02:46.202 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:18.016392+0000", 2024-04-19T03:02:46.202 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 28.164789104, 2024-04-19T03:02:46.202 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.052629620000000002, 2024-04-19T03:02:46.202 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:46.202 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:46.202 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:46.203 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.203 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:46.203 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016392+0000", 2024-04-19T03:02:46.203 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:46.203 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.203 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.203 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:46.203 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016392+0000", 2024-04-19T03:02:46.203 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:46.203 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.203 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.203 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:46.204 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016391+0000", 2024-04-19T03:02:46.204 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:46.204 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.204 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.204 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:46.204 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016471+0000", 2024-04-19T03:02:46.204 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9346999999999998e-05 2024-04-19T03:02:46.204 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.204 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.204 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:46.204 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016478+0000", 2024-04-19T03:02:46.204 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.593e-06 2024-04-19T03:02:46.204 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.205 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.205 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:46.205 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016495+0000", 2024-04-19T03:02:46.205 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6492999999999999e-05 2024-04-19T03:02:46.205 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.205 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.205 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:46.205 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016539+0000", 2024-04-19T03:02:46.205 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4715999999999997e-05 2024-04-19T03:02:46.205 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.205 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.205 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:46.206 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016551+0000", 2024-04-19T03:02:46.206 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2096000000000001e-05 2024-04-19T03:02:46.206 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.206 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.206 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:46.206 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.068985+0000", 2024-04-19T03:02:46.206 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.052433754999999999 2024-04-19T03:02:46.206 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.206 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.206 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:46.206 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.069021+0000", 2024-04-19T03:02:46.206 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6047000000000002e-05 2024-04-19T03:02:46.207 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:46.207 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:46.207 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:46.207 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.207 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.207 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4755.0:78996 5.1 e40/39 5:87f59708:::benchmark_data_smithi096_19531_object78995:head v 40'4940, mlcod=40'4938)", 2024-04-19T03:02:46.207 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:18.016581+0000", 2024-04-19T03:02:46.207 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 28.164599938999999, 2024-04-19T03:02:46.207 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.052051785000000003, 2024-04-19T03:02:46.207 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:46.207 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:46.207 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:46.208 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.208 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:46.208 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016581+0000", 2024-04-19T03:02:46.208 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:46.208 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.208 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.208 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:46.208 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016581+0000", 2024-04-19T03:02:46.208 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:46.208 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.208 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.208 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:46.208 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016581+0000", 2024-04-19T03:02:46.209 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:46.209 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.209 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.209 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:46.209 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016610+0000", 2024-04-19T03:02:46.209 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9556999999999998e-05 2024-04-19T03:02:46.209 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.209 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.210 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:46.210 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016616+0000", 2024-04-19T03:02:46.210 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1090000000000003e-06 2024-04-19T03:02:46.210 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.210 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.210 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:46.210 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016621+0000", 2024-04-19T03:02:46.210 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.454e-06 2024-04-19T03:02:46.210 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.211 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.211 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:46.211 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016663+0000", 2024-04-19T03:02:46.211 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2582e-05 2024-04-19T03:02:46.211 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.211 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.211 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:46.211 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016681+0000", 2024-04-19T03:02:46.211 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7680999999999999e-05 2024-04-19T03:02:46.211 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.211 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.212 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:46.212 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.068486+0000", 2024-04-19T03:02:46.212 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.051804624000000001 2024-04-19T03:02:46.212 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.212 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.212 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:46.212 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.068633+0000", 2024-04-19T03:02:46.212 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00014709099999999999 2024-04-19T03:02:46.212 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:46.212 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:46.212 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:46.212 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.212 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.212 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4755.0:78999 5.3 e40/22 5:c9ec5f7f:::benchmark_data_smithi096_19531_object78998:head v 40'4893, mlcod=40'4889)", 2024-04-19T03:02:46.213 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:18.016633+0000", 2024-04-19T03:02:46.213 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 28.164548084, 2024-04-19T03:02:46.213 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.051090469999999999, 2024-04-19T03:02:46.213 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:46.213 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:46.213 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:46.213 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.213 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:46.213 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016633+0000", 2024-04-19T03:02:46.213 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:46.213 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.213 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.213 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:46.214 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016633+0000", 2024-04-19T03:02:46.214 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:46.214 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.214 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.214 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:46.214 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016632+0000", 2024-04-19T03:02:46.214 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967296 2024-04-19T03:02:46.214 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.214 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.214 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:46.214 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016660+0000", 2024-04-19T03:02:46.214 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7869999999999999e-05 2024-04-19T03:02:46.214 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.215 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.215 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:46.215 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016667+0000", 2024-04-19T03:02:46.215 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0280000000000003e-06 2024-04-19T03:02:46.215 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.215 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.215 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:46.215 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016672+0000", 2024-04-19T03:02:46.215 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0069999999999997e-06 2024-04-19T03:02:46.215 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.215 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.215 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:46.215 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016725+0000", 2024-04-19T03:02:46.216 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2812000000000002e-05 2024-04-19T03:02:46.216 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.216 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.216 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:46.216 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016750+0000", 2024-04-19T03:02:46.216 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5038e-05 2024-04-19T03:02:46.216 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.216 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.216 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:46.216 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.067673+0000", 2024-04-19T03:02:46.216 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.050922350999999998 2024-04-19T03:02:46.216 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.216 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.217 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:46.217 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.067723+0000", 2024-04-19T03:02:46.217 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0586e-05 2024-04-19T03:02:46.217 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:46.217 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:46.217 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:46.217 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.217 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.217 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4755.0:79003 5.2 e40/39 5:4436e33f:::benchmark_data_smithi096_19531_object79002:head v 40'4935, mlcod=40'4932)", 2024-04-19T03:02:46.217 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:18.018102+0000", 2024-04-19T03:02:46.217 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 28.163078357, 2024-04-19T03:02:46.217 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.060023990999999999, 2024-04-19T03:02:46.217 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:46.218 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:46.218 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:46.218 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.218 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:46.218 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018102+0000", 2024-04-19T03:02:46.218 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:46.218 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.218 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.218 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:46.218 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018102+0000", 2024-04-19T03:02:46.218 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:46.218 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.218 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.219 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:46.219 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018102+0000", 2024-04-19T03:02:46.219 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:46.219 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.219 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.219 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:46.219 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018134+0000", 2024-04-19T03:02:46.219 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2722000000000003e-05 2024-04-19T03:02:46.219 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.219 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.219 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:46.219 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018145+0000", 2024-04-19T03:02:46.219 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0395e-05 2024-04-19T03:02:46.220 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.220 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.220 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:46.220 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018151+0000", 2024-04-19T03:02:46.220 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5300000000000002e-06 2024-04-19T03:02:46.220 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.220 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.220 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:46.220 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018489+0000", 2024-04-19T03:02:46.220 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00033731499999999998 2024-04-19T03:02:46.220 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.220 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.221 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:46.221 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018508+0000", 2024-04-19T03:02:46.221 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9775e-05 2024-04-19T03:02:46.221 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.221 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.221 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:46.221 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.078059+0000", 2024-04-19T03:02:46.221 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.059550171999999998 2024-04-19T03:02:46.221 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.221 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.221 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:46.221 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.078126+0000", 2024-04-19T03:02:46.222 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7773000000000003e-05 2024-04-19T03:02:46.222 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:46.222 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:46.222 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:46.222 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.222 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.222 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4755.0:79005 5.1 e40/39 5:85b46038:::benchmark_data_smithi096_19531_object79004:head v 40'4941, mlcod=40'4938)", 2024-04-19T03:02:46.222 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:18.018167+0000", 2024-04-19T03:02:46.222 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 28.163013637999999, 2024-04-19T03:02:46.222 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.052768941999999999, 2024-04-19T03:02:46.222 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:46.223 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:46.223 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:46.223 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.223 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:46.223 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018167+0000", 2024-04-19T03:02:46.223 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:46.223 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.223 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.223 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:46.223 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018167+0000", 2024-04-19T03:02:46.223 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:46.223 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.224 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.224 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:46.224 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018167+0000", 2024-04-19T03:02:46.224 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:46.224 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.224 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.224 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:46.224 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018196+0000", 2024-04-19T03:02:46.224 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9538000000000001e-05 2024-04-19T03:02:46.224 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.224 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.225 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:46.225 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018204+0000", 2024-04-19T03:02:46.225 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2599999999999999e-06 2024-04-19T03:02:46.225 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.225 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.225 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:46.225 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018208+0000", 2024-04-19T03:02:46.225 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8080000000000004e-06 2024-04-19T03:02:46.225 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.225 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.225 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:46.225 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.064933+0000", 2024-04-19T03:02:46.226 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.046725048999999998 2024-04-19T03:02:46.226 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.226 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.226 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:46.226 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.064964+0000", 2024-04-19T03:02:46.226 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0577000000000002e-05 2024-04-19T03:02:46.226 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.226 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.226 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:46.226 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.070815+0000", 2024-04-19T03:02:46.226 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0058510649999999999 2024-04-19T03:02:46.226 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.226 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.227 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:46.227 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.070936+0000", 2024-04-19T03:02:46.227 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00012095399999999999 2024-04-19T03:02:46.227 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:46.227 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:46.227 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:46.227 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.227 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.227 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:86612 5.7 5:e32e3c49:::benchmark_data_smithi096_19531_object86611:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:46.227 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:22.633560+0000", 2024-04-19T03:02:46.227 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 23.547620696999999, 2024-04-19T03:02:46.227 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.19135289, 2024-04-19T03:02:46.228 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:46.228 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:46.228 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:46.228 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:46.228 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:46.228 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 86612 2024-04-19T03:02:46.228 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.228 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:46.228 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.228 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:46.228 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633560+0000", 2024-04-19T03:02:46.228 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:46.228 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.229 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.229 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:46.229 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633560+0000", 2024-04-19T03:02:46.229 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:46.229 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.229 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.229 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:46.229 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633558+0000", 2024-04-19T03:02:46.229 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:46.229 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.229 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.229 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:46.230 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633609+0000", 2024-04-19T03:02:46.230 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0850999999999998e-05 2024-04-19T03:02:46.230 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.230 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.230 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:46.230 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633627+0000", 2024-04-19T03:02:46.230 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7951000000000001e-05 2024-04-19T03:02:46.230 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.230 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.230 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:46.233 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633635+0000", 2024-04-19T03:02:46.233 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2530000000000004e-06 2024-04-19T03:02:46.233 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.234 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.234 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:46.234 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633699+0000", 2024-04-19T03:02:46.234 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3901999999999999e-05 2024-04-19T03:02:46.234 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.234 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.234 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:46.234 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633992+0000", 2024-04-19T03:02:46.234 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00029283299999999999 2024-04-19T03:02:46.234 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.234 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.234 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:46.235 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.634223+0000", 2024-04-19T03:02:46.235 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00023084200000000001 2024-04-19T03:02:46.235 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.235 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.235 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:46.235 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.639085+0000", 2024-04-19T03:02:46.235 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0048624269999999999 2024-04-19T03:02:46.235 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.235 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.235 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:46.235 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.824635+0000", 2024-04-19T03:02:46.235 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.18554944700000001 2024-04-19T03:02:46.236 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.236 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.236 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:46.236 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.824793+0000", 2024-04-19T03:02:46.236 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000157959 2024-04-19T03:02:46.236 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.236 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.236 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:46.236 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.824913+0000", 2024-04-19T03:02:46.236 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000120093 2024-04-19T03:02:46.236 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:46.236 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:46.236 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:46.237 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.237 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.237 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:86625 5.7 5:e6d00488:::benchmark_data_smithi096_19531_object86624:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:46.237 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:22.643554+0000", 2024-04-19T03:02:46.237 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 23.537626930999998, 2024-04-19T03:02:46.237 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.18732841, 2024-04-19T03:02:46.237 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:46.237 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:46.237 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:46.237 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:46.237 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:46.237 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 86625 2024-04-19T03:02:46.238 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.238 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:46.238 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.238 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:46.238 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643554+0000", 2024-04-19T03:02:46.238 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:46.238 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.238 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.238 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:46.238 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643554+0000", 2024-04-19T03:02:46.238 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:46.238 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.238 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.239 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:46.239 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643552+0000", 2024-04-19T03:02:46.239 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:46.239 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.239 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.239 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:46.239 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643588+0000", 2024-04-19T03:02:46.239 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5855999999999997e-05 2024-04-19T03:02:46.239 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.239 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.239 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:46.239 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643606+0000", 2024-04-19T03:02:46.239 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8226000000000001e-05 2024-04-19T03:02:46.240 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.240 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.240 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:46.240 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643618+0000", 2024-04-19T03:02:46.240 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1868000000000001e-05 2024-04-19T03:02:46.240 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.240 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.240 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:46.240 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643676+0000", 2024-04-19T03:02:46.240 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8153999999999999e-05 2024-04-19T03:02:46.240 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.241 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.241 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:46.241 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643905+0000", 2024-04-19T03:02:46.241 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00022847500000000001 2024-04-19T03:02:46.241 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.241 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.241 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:46.241 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.644150+0000", 2024-04-19T03:02:46.241 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00024531800000000001 2024-04-19T03:02:46.241 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.241 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.241 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:46.241 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.647407+0000", 2024-04-19T03:02:46.241 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0032563190000000001 2024-04-19T03:02:46.242 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.242 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.242 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:46.242 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.830721+0000", 2024-04-19T03:02:46.242 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.18331468300000001 2024-04-19T03:02:46.242 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.242 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.242 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:46.242 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.830813+0000", 2024-04-19T03:02:46.242 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.2205000000000002e-05 2024-04-19T03:02:46.242 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.242 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.242 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:46.243 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.830882+0000", 2024-04-19T03:02:46.243 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8819999999999995e-05 2024-04-19T03:02:46.243 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:46.243 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:46.243 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:46.243 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.243 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.243 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87063 5.7 5:e502e824:::benchmark_data_smithi096_19531_object87062:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:46.243 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.136067+0000", 2024-04-19T03:02:46.243 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 23.045114062, 2024-04-19T03:02:46.243 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.065521159999999995, 2024-04-19T03:02:46.243 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:46.244 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:46.244 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:46.244 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:46.244 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:46.244 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87063 2024-04-19T03:02:46.244 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.244 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:46.244 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.244 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:46.244 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.136067+0000", 2024-04-19T03:02:46.244 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:46.244 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.244 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.245 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:46.245 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.136067+0000", 2024-04-19T03:02:46.245 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:46.245 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.245 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.245 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:46.245 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.136066+0000", 2024-04-19T03:02:46.245 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:46.245 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.245 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.245 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:46.246 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.136154+0000", 2024-04-19T03:02:46.246 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.8256000000000003e-05 2024-04-19T03:02:46.246 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.246 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.246 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:46.246 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.136162+0000", 2024-04-19T03:02:46.246 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.5099999999999998e-06 2024-04-19T03:02:46.246 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.246 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.246 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:46.246 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.136171+0000", 2024-04-19T03:02:46.246 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2830000000000001e-06 2024-04-19T03:02:46.247 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.247 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.247 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:46.247 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.138421+0000", 2024-04-19T03:02:46.247 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0022506620000000001 2024-04-19T03:02:46.247 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.247 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.247 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:46.247 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.138560+0000", 2024-04-19T03:02:46.247 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000138446 2024-04-19T03:02:46.247 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.247 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.247 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:46.248 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.138689+0000", 2024-04-19T03:02:46.248 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00012950700000000001 2024-04-19T03:02:46.248 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.248 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.248 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:46.248 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.141517+0000", 2024-04-19T03:02:46.248 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0028280860000000001 2024-04-19T03:02:46.248 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.248 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.248 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:46.248 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.201350+0000", 2024-04-19T03:02:46.248 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.059832418999999998 2024-04-19T03:02:46.248 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.249 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.249 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:46.249 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.201485+0000", 2024-04-19T03:02:46.249 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000135597 2024-04-19T03:02:46.249 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.249 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.249 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:46.249 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.201588+0000", 2024-04-19T03:02:46.249 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00010247900000000001 2024-04-19T03:02:46.249 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:46.249 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:46.249 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:46.249 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.250 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.250 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87072 5.7 5:e3c7809a:::benchmark_data_smithi096_19531_object87071:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:46.250 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.144224+0000", 2024-04-19T03:02:46.250 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 23.036957038000001, 2024-04-19T03:02:46.250 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.058179555000000001, 2024-04-19T03:02:46.250 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:46.250 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:46.250 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:46.250 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:46.250 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:46.250 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87072 2024-04-19T03:02:46.250 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.250 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:46.251 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.251 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:46.251 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144224+0000", 2024-04-19T03:02:46.251 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:46.251 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.251 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.251 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:46.251 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144224+0000", 2024-04-19T03:02:46.251 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:46.251 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.251 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.251 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:46.251 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144223+0000", 2024-04-19T03:02:46.251 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:46.252 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.252 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.252 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:46.252 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144320+0000", 2024-04-19T03:02:46.252 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.7075000000000001e-05 2024-04-19T03:02:46.252 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.252 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.252 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:46.252 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144331+0000", 2024-04-19T03:02:46.252 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1342000000000001e-05 2024-04-19T03:02:46.252 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.252 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.252 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:46.252 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144337+0000", 2024-04-19T03:02:46.253 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8390000000000003e-06 2024-04-19T03:02:46.253 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.253 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.253 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:46.253 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144369+0000", 2024-04-19T03:02:46.253 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2079000000000002e-05 2024-04-19T03:02:46.253 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.253 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.253 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:46.253 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144464+0000", 2024-04-19T03:02:46.253 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.4623000000000005e-05 2024-04-19T03:02:46.253 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.253 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.253 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:46.254 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144553+0000", 2024-04-19T03:02:46.254 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9171000000000004e-05 2024-04-19T03:02:46.254 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.254 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.254 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:46.254 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.147018+0000", 2024-04-19T03:02:46.254 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0024648370000000001 2024-04-19T03:02:46.254 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.254 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.254 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:46.254 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.202270+0000", 2024-04-19T03:02:46.254 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.055252018 2024-04-19T03:02:46.254 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.254 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.255 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:46.255 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.202356+0000", 2024-04-19T03:02:46.255 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6648000000000001e-05 2024-04-19T03:02:46.255 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.255 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.255 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:46.255 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.202403+0000", 2024-04-19T03:02:46.255 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6956999999999998e-05 2024-04-19T03:02:46.255 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:46.255 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:46.255 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:46.255 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.255 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.255 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87123 5.6 5:6d1bc3b9:::benchmark_data_smithi096_19531_object87122:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:02:46.256 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249233+0000", 2024-04-19T03:02:46.256 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 22.931948005999999, 2024-04-19T03:02:46.256 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0291700720000001, 2024-04-19T03:02:46.256 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:46.257 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-04-19T03:02:46.257 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:46.257 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:46.257 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:46.257 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87123 2024-04-19T03:02:46.258 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.258 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:46.258 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.258 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:46.258 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249233+0000", 2024-04-19T03:02:46.258 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:46.258 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.258 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.258 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:46.258 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249233+0000", 2024-04-19T03:02:46.258 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:46.258 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.258 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.259 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:46.259 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249231+0000", 2024-04-19T03:02:46.259 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:46.259 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.259 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.259 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:46.259 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249285+0000", 2024-04-19T03:02:46.259 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4005000000000002e-05 2024-04-19T03:02:46.259 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.259 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.259 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:46.259 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249300+0000", 2024-04-19T03:02:46.259 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4715999999999999e-05 2024-04-19T03:02:46.260 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.260 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.260 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:46.260 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249307+0000", 2024-04-19T03:02:46.260 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8399999999999997e-06 2024-04-19T03:02:46.260 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.260 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.260 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:46.260 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249366+0000", 2024-04-19T03:02:46.260 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9435999999999998e-05 2024-04-19T03:02:46.260 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.260 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.260 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op must wait for map", 2024-04-19T03:02:46.261 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249376+0000", 2024-04-19T03:02:46.261 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.4919999999999999e-06 2024-04-19T03:02:46.261 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.261 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.261 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:46.261 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263757+0000", 2024-04-19T03:02:46.261 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.014381461999999999 2024-04-19T03:02:46.261 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.261 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.261 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:02:46.261 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263875+0000", 2024-04-19T03:02:46.261 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000117166 2024-04-19T03:02:46.261 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.261 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.262 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:46.262 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.277136+0000", 2024-04-19T03:02:46.262 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.013261207 2024-04-19T03:02:46.262 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.262 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.262 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:46.262 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.278403+0000", 2024-04-19T03:02:46.262 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001267106 2024-04-19T03:02:46.262 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:46.262 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:46.262 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:46.263 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.263 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.263 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87128 5.6 5:6905c420:::benchmark_data_smithi096_19531_object87127:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:02:46.263 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249323+0000", 2024-04-19T03:02:46.263 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 22.931857259000001, 2024-04-19T03:02:46.263 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0292813249999999, 2024-04-19T03:02:46.263 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:46.263 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-04-19T03:02:46.263 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:46.263 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:46.263 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:46.263 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87128 2024-04-19T03:02:46.263 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.263 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:46.264 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.264 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:46.264 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249323+0000", 2024-04-19T03:02:46.264 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:46.264 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.264 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.264 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:46.264 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249323+0000", 2024-04-19T03:02:46.264 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:46.264 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.264 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.264 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:46.264 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249323+0000", 2024-04-19T03:02:46.264 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:46.265 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.265 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.265 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:46.265 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249385+0000", 2024-04-19T03:02:46.265 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1711999999999995e-05 2024-04-19T03:02:46.265 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.265 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.265 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:46.265 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249398+0000", 2024-04-19T03:02:46.265 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3022e-05 2024-04-19T03:02:46.265 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.265 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.265 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:46.266 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249402+0000", 2024-04-19T03:02:46.266 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4819999999999996e-06 2024-04-19T03:02:46.266 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.266 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.266 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:46.266 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249437+0000", 2024-04-19T03:02:46.266 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4702000000000001e-05 2024-04-19T03:02:46.266 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.266 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.266 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:02:46.266 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249442+0000", 2024-04-19T03:02:46.266 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8019999999999999e-06 2024-04-19T03:02:46.266 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.267 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.267 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:46.267 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263896+0000", 2024-04-19T03:02:46.267 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.014454679999999999 2024-04-19T03:02:46.267 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.267 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.267 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:02:46.267 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263900+0000", 2024-04-19T03:02:46.267 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9700000000000001e-06 2024-04-19T03:02:46.267 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.267 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.267 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:46.267 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.278557+0000", 2024-04-19T03:02:46.267 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0146566480000001 2024-04-19T03:02:46.268 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.268 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.268 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:46.268 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.278605+0000", 2024-04-19T03:02:46.268 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7735999999999998e-05 2024-04-19T03:02:46.268 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:46.268 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:46.268 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:46.268 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.268 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.268 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87130 5.3 5:c8c2d67b:::benchmark_data_smithi096_19531_object87129:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:02:46.268 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249418+0000", 2024-04-19T03:02:46.268 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 22.931762548000002, 2024-04-19T03:02:46.268 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.025414182, 2024-04-19T03:02:46.269 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:46.269 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-04-19T03:02:46.269 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:46.269 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:46.269 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:46.269 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87130 2024-04-19T03:02:46.269 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.269 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:46.269 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.269 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:46.269 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249418+0000", 2024-04-19T03:02:46.269 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:46.269 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.269 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.270 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:46.270 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249418+0000", 2024-04-19T03:02:46.270 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:46.270 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.270 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.270 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:46.270 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249409+0000", 2024-04-19T03:02:46.270 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999905 2024-04-19T03:02:46.270 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.270 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.270 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:46.270 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249464+0000", 2024-04-19T03:02:46.270 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5381999999999999e-05 2024-04-19T03:02:46.271 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.271 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.271 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:46.271 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249471+0000", 2024-04-19T03:02:46.271 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2609999999999996e-06 2024-04-19T03:02:46.271 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.271 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.271 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:46.271 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249475+0000", 2024-04-19T03:02:46.271 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2839999999999998e-06 2024-04-19T03:02:46.271 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.271 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.271 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:46.271 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249535+0000", 2024-04-19T03:02:46.272 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0545999999999999e-05 2024-04-19T03:02:46.272 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.272 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.272 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op must wait for map", 2024-04-19T03:02:46.272 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249540+0000", 2024-04-19T03:02:46.272 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2859999999999999e-06 2024-04-19T03:02:46.272 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.272 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.272 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:46.272 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263450+0000", 2024-04-19T03:02:46.272 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.013909585 2024-04-19T03:02:46.272 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.272 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.272 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:02:46.272 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263458+0000", 2024-04-19T03:02:46.273 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8089999999999993e-06 2024-04-19T03:02:46.273 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.273 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.273 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:46.273 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.273193+0000", 2024-04-19T03:02:46.273 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0097351379999999 2024-04-19T03:02:46.273 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.273 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.273 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:46.273 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.274832+0000", 2024-04-19T03:02:46.273 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0016394789999999999 2024-04-19T03:02:46.273 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:46.273 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:46.274 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:46.274 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.274 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.274 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87131 5.1 5:83756d55:::benchmark_data_smithi096_19531_object87130:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:02:46.274 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249491+0000", 2024-04-19T03:02:46.274 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 22.931689900999999, 2024-04-19T03:02:46.274 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0191489520000001, 2024-04-19T03:02:46.274 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:46.274 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-04-19T03:02:46.274 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:46.274 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:46.274 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:46.274 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87131 2024-04-19T03:02:46.275 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.275 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:46.275 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.275 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:46.275 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249491+0000", 2024-04-19T03:02:46.275 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:46.275 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.275 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.275 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:46.275 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249491+0000", 2024-04-19T03:02:46.275 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:46.275 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.275 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.275 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:46.276 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249491+0000", 2024-04-19T03:02:46.276 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:46.276 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.276 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.276 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:46.276 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249530+0000", 2024-04-19T03:02:46.276 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9589000000000003e-05 2024-04-19T03:02:46.276 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.276 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.276 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:46.276 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249544+0000", 2024-04-19T03:02:46.276 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4158000000000001e-05 2024-04-19T03:02:46.276 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.276 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.277 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:46.277 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249549+0000", 2024-04-19T03:02:46.277 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6809999999999997e-06 2024-04-19T03:02:46.277 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.277 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.277 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:46.277 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249592+0000", 2024-04-19T03:02:46.277 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3285999999999999e-05 2024-04-19T03:02:46.277 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.277 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.277 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op must wait for map", 2024-04-19T03:02:46.277 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249598+0000", 2024-04-19T03:02:46.277 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8329999999999999e-06 2024-04-19T03:02:46.277 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.277 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.278 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:46.278 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263331+0000", 2024-04-19T03:02:46.278 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.013733093 2024-04-19T03:02:46.278 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.278 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.278 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:02:46.278 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263343+0000", 2024-04-19T03:02:46.278 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.189e-05 2024-04-19T03:02:46.278 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.278 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.278 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:46.278 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.268541+0000", 2024-04-19T03:02:46.278 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0051983440000001 2024-04-19T03:02:46.279 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.279 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.279 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:46.279 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.268640+0000", 2024-04-19T03:02:46.279 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.8387999999999994e-05 2024-04-19T03:02:46.279 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:46.279 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:46.279 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:46.279 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.279 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.279 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87132 5.c 5:3e18b732:::benchmark_data_smithi096_19531_object87131:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:02:46.279 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249558+0000", 2024-04-19T03:02:46.279 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 22.931622999999998, 2024-04-19T03:02:46.279 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0241198380000001, 2024-04-19T03:02:46.280 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:46.280 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-04-19T03:02:46.280 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:46.280 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:46.280 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:46.280 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87132 2024-04-19T03:02:46.280 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.280 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:46.280 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.280 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:46.280 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249558+0000", 2024-04-19T03:02:46.280 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:46.280 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.280 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.281 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:46.281 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249558+0000", 2024-04-19T03:02:46.281 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:46.281 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.281 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.281 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:46.281 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249557+0000", 2024-04-19T03:02:46.281 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:46.281 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.281 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.281 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:46.281 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249625+0000", 2024-04-19T03:02:46.281 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7200999999999996e-05 2024-04-19T03:02:46.281 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.282 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.282 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:46.282 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249646+0000", 2024-04-19T03:02:46.282 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1053e-05 2024-04-19T03:02:46.282 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.282 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.282 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:46.282 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249650+0000", 2024-04-19T03:02:46.282 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2719999999999999e-06 2024-04-19T03:02:46.282 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.282 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.282 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:46.282 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249686+0000", 2024-04-19T03:02:46.283 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6430000000000002e-05 2024-04-19T03:02:46.283 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.283 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.283 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op must wait for map", 2024-04-19T03:02:46.283 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249690+0000", 2024-04-19T03:02:46.283 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.765e-06 2024-04-19T03:02:46.283 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.283 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.283 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:46.283 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261157+0000", 2024-04-19T03:02:46.283 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011467247999999999 2024-04-19T03:02:46.283 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.283 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.283 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:02:46.283 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261170+0000", 2024-04-19T03:02:46.284 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2833000000000001e-05 2024-04-19T03:02:46.284 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.284 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.284 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:46.284 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.272119+0000", 2024-04-19T03:02:46.284 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.010949313 2024-04-19T03:02:46.284 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.284 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.284 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:46.284 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.273678+0000", 2024-04-19T03:02:46.284 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0015581550000000001 2024-04-19T03:02:46.284 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:46.284 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:46.284 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:46.284 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.285 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.285 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87133 5.c 5:3f772a62:::benchmark_data_smithi096_19531_object87132:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:02:46.285 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249657+0000", 2024-04-19T03:02:46.285 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 22.931523621, 2024-04-19T03:02:46.285 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0242819409999999, 2024-04-19T03:02:46.285 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:46.285 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-04-19T03:02:46.285 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:46.285 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:46.285 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:46.285 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87133 2024-04-19T03:02:46.285 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.285 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:46.285 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.286 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:46.286 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249657+0000", 2024-04-19T03:02:46.286 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:46.286 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.286 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.286 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:46.286 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249657+0000", 2024-04-19T03:02:46.286 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:46.286 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.286 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.286 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:46.286 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249657+0000", 2024-04-19T03:02:46.286 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:46.286 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.287 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.287 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:46.287 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249690+0000", 2024-04-19T03:02:46.287 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3343000000000002e-05 2024-04-19T03:02:46.287 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.287 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.287 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:46.287 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249695+0000", 2024-04-19T03:02:46.287 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8600000000000001e-06 2024-04-19T03:02:46.287 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.287 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.287 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:46.287 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249698+0000", 2024-04-19T03:02:46.287 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.1700000000000001e-06 2024-04-19T03:02:46.287 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.288 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.288 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:46.288 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249741+0000", 2024-04-19T03:02:46.288 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2849999999999998e-05 2024-04-19T03:02:46.288 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.288 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.288 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:02:46.288 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249746+0000", 2024-04-19T03:02:46.288 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1019999999999996e-06 2024-04-19T03:02:46.288 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.288 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.288 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:46.288 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261209+0000", 2024-04-19T03:02:46.289 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011462447000000001 2024-04-19T03:02:46.289 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.289 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.289 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:02:46.289 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261216+0000", 2024-04-19T03:02:46.289 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8520000000000004e-06 2024-04-19T03:02:46.289 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.289 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.289 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:46.289 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.273872+0000", 2024-04-19T03:02:46.289 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0126558000000001 2024-04-19T03:02:46.289 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.289 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.289 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:46.290 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.273939+0000", 2024-04-19T03:02:46.290 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6822000000000005e-05 2024-04-19T03:02:46.290 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:46.290 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:46.290 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:46.290 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.290 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.290 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87134 5.5 5:a56c478f:::benchmark_data_smithi096_19531_object87133:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:02:46.290 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249708+0000", 2024-04-19T03:02:46.290 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 22.931472697, 2024-04-19T03:02:46.290 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0214677299999999, 2024-04-19T03:02:46.290 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:46.290 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-04-19T03:02:46.290 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:46.291 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:46.291 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:46.291 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87134 2024-04-19T03:02:46.291 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.291 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:46.291 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.291 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:46.291 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249708+0000", 2024-04-19T03:02:46.291 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:46.291 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.291 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.291 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:46.291 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249708+0000", 2024-04-19T03:02:46.291 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:46.292 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.292 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.292 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:46.292 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249706+0000", 2024-04-19T03:02:46.292 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999976 2024-04-19T03:02:46.292 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.292 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.292 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:46.292 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249740+0000", 2024-04-19T03:02:46.292 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4458000000000001e-05 2024-04-19T03:02:46.292 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.292 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.292 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:46.293 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249745+0000", 2024-04-19T03:02:46.293 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5020000000000003e-06 2024-04-19T03:02:46.293 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.293 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.293 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:46.293 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249748+0000", 2024-04-19T03:02:46.293 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2499999999999998e-06 2024-04-19T03:02:46.293 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.293 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.293 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:46.293 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249778+0000", 2024-04-19T03:02:46.293 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.006e-05 2024-04-19T03:02:46.293 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.293 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.294 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op must wait for map", 2024-04-19T03:02:46.294 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249782+0000", 2024-04-19T03:02:46.294 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2910000000000001e-06 2024-04-19T03:02:46.294 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.294 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.294 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:46.294 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261666+0000", 2024-04-19T03:02:46.294 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011883471 2024-04-19T03:02:46.294 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.294 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.294 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:02:46.294 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261674+0000", 2024-04-19T03:02:46.294 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6479999999999992e-06 2024-04-19T03:02:46.294 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.295 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.295 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:46.295 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.269323+0000", 2024-04-19T03:02:46.295 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.00764867 2024-04-19T03:02:46.295 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.295 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.295 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:46.295 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.271176+0000", 2024-04-19T03:02:46.295 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001852844 2024-04-19T03:02:46.295 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:46.295 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:46.295 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:46.295 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.295 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.296 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87137 5.c 5:30708c68:::benchmark_data_smithi096_19531_object87136:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:02:46.296 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249756+0000", 2024-04-19T03:02:46.296 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 22.931424991, 2024-04-19T03:02:46.296 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.033331752, 2024-04-19T03:02:46.296 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:46.296 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:46.296 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:46.296 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:46.296 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:46.296 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87137 2024-04-19T03:02:46.296 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.296 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:46.296 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.296 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:46.297 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249756+0000", 2024-04-19T03:02:46.297 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:46.297 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.297 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.297 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:46.297 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249756+0000", 2024-04-19T03:02:46.297 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:46.297 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.297 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.297 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:46.297 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249755+0000", 2024-04-19T03:02:46.297 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:46.297 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.297 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.298 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:46.298 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249777+0000", 2024-04-19T03:02:46.298 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1420000000000002e-05 2024-04-19T03:02:46.298 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.298 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.298 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:46.298 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249781+0000", 2024-04-19T03:02:46.298 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0609999999999997e-06 2024-04-19T03:02:46.298 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.298 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.298 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:46.298 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249787+0000", 2024-04-19T03:02:46.298 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.02e-06 2024-04-19T03:02:46.298 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.298 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.299 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:46.299 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249818+0000", 2024-04-19T03:02:46.299 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0947e-05 2024-04-19T03:02:46.299 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.299 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.299 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:02:46.299 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249821+0000", 2024-04-19T03:02:46.299 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.117e-06 2024-04-19T03:02:46.299 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.299 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.299 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:46.299 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261243+0000", 2024-04-19T03:02:46.299 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011421875999999999 2024-04-19T03:02:46.299 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.300 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.300 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:02:46.300 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261251+0000", 2024-04-19T03:02:46.300 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6120000000000001e-06 2024-04-19T03:02:46.300 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.300 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.300 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:46.300 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.274050+0000", 2024-04-19T03:02:46.300 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.012799405 2024-04-19T03:02:46.300 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.300 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.300 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:46.300 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.274529+0000", 2024-04-19T03:02:46.300 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00047867100000000001 2024-04-19T03:02:46.300 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.301 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.301 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:46.301 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.282972+0000", 2024-04-19T03:02:46.301 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0084436900000000002 2024-04-19T03:02:46.301 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.301 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.301 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:46.301 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.283022+0000", 2024-04-19T03:02:46.301 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9339000000000003e-05 2024-04-19T03:02:46.301 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:46.301 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:46.301 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:46.301 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.283088+0000", 2024-04-19T03:02:46.301 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5877999999999995e-05 2024-04-19T03:02:46.301 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:46.302 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:46.302 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:46.302 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:46.302 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:46.302 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-04-19T03:02:46.303 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:46.301+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:46.304 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T03:02:46.404 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:46.403+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:46.425 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-19T03:02:46.425 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-04-19T03:02:46.425 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:46.425 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:129404 5.a 5:5e0e58e9:::benchmark_data_smithi096_19531_object15954:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-19T03:02:46.426 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:46.417312+0000", 2024-04-19T03:02:46.426 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0074292500000000001, 2024-04-19T03:02:46.426 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0074530660000000004, 2024-04-19T03:02:46.426 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:46.426 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-19T03:02:46.426 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:46.426 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:46.426 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:46.426 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 129404 2024-04-19T03:02:46.426 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:46.426 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:46.426 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:46.426 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:46.427 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:46.417312+0000", 2024-04-19T03:02:46.427 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:46.427 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:46.427 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:46.427 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:46.427 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:46.417312+0000", 2024-04-19T03:02:46.427 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:46.427 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:46.427 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:46.427 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:46.427 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:46.417312+0000", 2024-04-19T03:02:46.427 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:46.427 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:46.428 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:46.428 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:46.428 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:46.417317+0000", 2024-04-19T03:02:46.428 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4990000000000002e-06 2024-04-19T03:02:46.428 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:46.428 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:46.428 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:46.428 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:46.417330+0000", 2024-04-19T03:02:46.428 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2649999999999999e-05 2024-04-19T03:02:46.428 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:46.428 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:46.428 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:46.428 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:46.417336+0000", 2024-04-19T03:02:46.429 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6959999999999999e-06 2024-04-19T03:02:46.429 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:46.429 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:46.429 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:46.429 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:46.418352+0000", 2024-04-19T03:02:46.429 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001015773 2024-04-19T03:02:46.429 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:46.429 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:46.429 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:46.429 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:46.418507+0000", 2024-04-19T03:02:46.429 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015502300000000001 2024-04-19T03:02:46.430 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:46.430 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:46.430 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:46.430 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:46.424769+0000", 2024-04-19T03:02:46.430 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0062622140000000003 2024-04-19T03:02:46.430 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:46.430 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:46.430 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:46.430 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:46.430 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:46.430 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:129409 5.8 5:126004b4:::benchmark_data_smithi096_19531_object15959:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-19T03:02:46.430 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:46.418498+0000", 2024-04-19T03:02:46.431 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0062441229999999999, 2024-04-19T03:02:46.431 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0063595209999999999, 2024-04-19T03:02:46.431 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:46.431 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-19T03:02:46.431 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:46.431 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:46.431 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:46.431 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 129409 2024-04-19T03:02:46.431 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:46.431 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:46.431 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:46.432 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:46.432 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:46.418498+0000", 2024-04-19T03:02:46.432 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:46.432 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:46.432 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:46.432 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:46.432 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:46.418498+0000", 2024-04-19T03:02:46.432 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:46.432 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:46.432 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:46.432 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:46.432 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:46.418497+0000", 2024-04-19T03:02:46.432 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:46.433 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:46.433 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:46.433 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:46.433 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:46.418502+0000", 2024-04-19T03:02:46.433 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8600000000000001e-06 2024-04-19T03:02:46.433 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:46.433 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:46.433 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:46.433 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:46.418524+0000", 2024-04-19T03:02:46.433 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2255e-05 2024-04-19T03:02:46.433 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:46.433 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:46.433 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:46.433 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:46.418558+0000", 2024-04-19T03:02:46.434 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4115000000000001e-05 2024-04-19T03:02:46.434 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:46.434 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:46.434 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:46.434 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:46.418594+0000", 2024-04-19T03:02:46.434 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5920000000000002e-05 2024-04-19T03:02:46.434 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:46.434 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:46.434 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:46.434 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:46.418709+0000", 2024-04-19T03:02:46.434 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000115272 2024-04-19T03:02:46.434 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:46.438 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:46.438 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:46.438 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:46.438 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:46.438 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:129412 5.a 5:56772f17:::benchmark_data_smithi096_19531_object15962:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-19T03:02:46.438 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:46.420020+0000", 2024-04-19T03:02:46.438 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0047220650000000001, 2024-04-19T03:02:46.438 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0048839449999999998, 2024-04-19T03:02:46.439 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:46.439 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-19T03:02:46.439 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:46.439 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:46.439 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:46.439 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 129412 2024-04-19T03:02:46.439 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:46.439 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:46.439 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:46.439 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:46.439 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:46.420020+0000", 2024-04-19T03:02:46.439 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:46.439 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:46.440 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:46.440 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:46.440 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:46.420020+0000", 2024-04-19T03:02:46.440 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:46.440 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:46.440 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:46.440 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:46.440 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:46.420019+0000", 2024-04-19T03:02:46.440 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:46.440 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:46.440 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:46.440 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:46.440 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:46.420024+0000", 2024-04-19T03:02:46.441 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4689999999999996e-06 2024-04-19T03:02:46.441 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:46.441 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:46.441 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:46.441 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:46.420035+0000", 2024-04-19T03:02:46.441 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1277000000000001e-05 2024-04-19T03:02:46.441 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:46.441 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:46.441 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:46.441 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:46.420042+0000", 2024-04-19T03:02:46.441 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3280000000000002e-06 2024-04-19T03:02:46.441 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:46.441 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:46.441 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:46.442 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:46.420489+0000", 2024-04-19T03:02:46.442 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000447491 2024-04-19T03:02:46.442 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:46.442 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:46.442 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:46.442 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:46.420599+0000", 2024-04-19T03:02:46.442 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000110035 2024-04-19T03:02:46.442 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:46.442 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:46.442 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:46.442 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:46.443 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:46.443 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4755.0:129411 5.d e52/49 5:be1f50c4:::benchmark_data_smithi096_19531_object15961:head v 52'8185, mlcod=52'8182)", 2024-04-19T03:02:46.443 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:46.420456+0000", 2024-04-19T03:02:46.443 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0042856839999999997, 2024-04-19T03:02:46.443 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.004497933, 2024-04-19T03:02:46.443 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:46.443 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-19T03:02:46.443 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:46.443 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:46.443 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:46.443 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:46.420456+0000", 2024-04-19T03:02:46.443 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:46.443 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:46.443 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:46.443 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:46.444 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:46.420456+0000", 2024-04-19T03:02:46.444 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:46.444 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:46.444 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:46.444 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:46.444 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:46.420455+0000", 2024-04-19T03:02:46.444 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:46.444 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:46.444 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:46.444 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:46.444 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:46.420461+0000", 2024-04-19T03:02:46.444 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.772e-06 2024-04-19T03:02:46.444 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:46.445 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:46.445 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:46.445 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:46.420472+0000", 2024-04-19T03:02:46.445 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0634e-05 2024-04-19T03:02:46.445 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:46.445 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:46.445 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:46.445 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:46.420476+0000", 2024-04-19T03:02:46.445 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3159999999999998e-06 2024-04-19T03:02:46.445 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:46.445 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:46.445 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:46.445 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:46.420517+0000", 2024-04-19T03:02:46.446 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1019000000000001e-05 2024-04-19T03:02:46.446 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:46.446 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:46.446 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:46.446 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:46.420546+0000", 2024-04-19T03:02:46.446 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9317999999999999e-05 2024-04-19T03:02:46.446 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:46.446 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:46.446 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:46.446 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:46.446 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:46.446 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:129413 5.4 5:29fc6888:::benchmark_data_smithi096_19531_object15963:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-19T03:02:46.446 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:46.420807+0000", 2024-04-19T03:02:46.447 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0039342079999999998, 2024-04-19T03:02:46.447 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.004218935, 2024-04-19T03:02:46.447 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:46.447 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-19T03:02:46.447 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:46.447 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:46.447 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:46.447 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 129413 2024-04-19T03:02:46.447 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:46.447 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:46.447 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:46.447 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:46.447 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:46.420807+0000", 2024-04-19T03:02:46.447 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:46.448 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:46.448 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:46.448 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:46.448 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:46.420807+0000", 2024-04-19T03:02:46.448 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:46.448 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:46.448 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:46.448 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:46.448 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:46.420806+0000", 2024-04-19T03:02:46.448 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:46.448 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:46.448 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:46.448 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:46.448 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:46.420812+0000", 2024-04-19T03:02:46.448 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6529999999999999e-06 2024-04-19T03:02:46.449 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:46.449 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:46.449 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:46.449 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:46.420827+0000", 2024-04-19T03:02:46.449 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4768e-05 2024-04-19T03:02:46.449 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:46.449 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:46.449 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:46.449 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:46.420835+0000", 2024-04-19T03:02:46.449 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.8429999999999993e-06 2024-04-19T03:02:46.449 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:46.449 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:46.449 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:46.450 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:46.420885+0000", 2024-04-19T03:02:46.450 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0117999999999997e-05 2024-04-19T03:02:46.450 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:46.450 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:46.450 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:46.450 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:46.421028+0000", 2024-04-19T03:02:46.450 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014367899999999999 2024-04-19T03:02:46.450 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:46.450 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:46.450 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:46.450 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:46.450 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:46.450 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:129414 5.e 5:78607a04:::benchmark_data_smithi096_19531_object15964:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-19T03:02:46.451 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:46.421843+0000", 2024-04-19T03:02:46.451 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0028983590000000001, 2024-04-19T03:02:46.451 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0032529920000000001, 2024-04-19T03:02:46.451 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:46.451 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-19T03:02:46.451 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:46.451 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:46.451 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:46.451 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 129414 2024-04-19T03:02:46.451 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:46.451 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:46.451 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:46.451 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:46.452 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:46.421843+0000", 2024-04-19T03:02:46.452 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:46.452 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:46.452 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:46.452 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:46.452 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:46.421843+0000", 2024-04-19T03:02:46.452 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:46.452 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:46.452 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:46.452 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:46.452 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:46.421842+0000", 2024-04-19T03:02:46.452 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:46.453 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:46.453 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:46.453 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:46.453 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:46.421848+0000", 2024-04-19T03:02:46.453 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5910000000000003e-06 2024-04-19T03:02:46.453 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:46.453 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:46.453 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:46.453 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:46.421861+0000", 2024-04-19T03:02:46.453 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2907e-05 2024-04-19T03:02:46.453 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:46.453 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:46.453 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:46.453 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:46.421869+0000", 2024-04-19T03:02:46.454 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5769999999999996e-06 2024-04-19T03:02:46.454 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:46.454 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:46.454 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:46.454 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:46.421913+0000", 2024-04-19T03:02:46.454 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4319e-05 2024-04-19T03:02:46.454 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:46.454 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:46.454 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:46.454 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:46.422068+0000", 2024-04-19T03:02:46.454 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000155413 2024-04-19T03:02:46.454 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:46.454 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:46.455 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:46.455 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:46.455 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:46.455 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:129416 5.b 5:dff0cd71:::benchmark_data_smithi096_19531_object15966:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-19T03:02:46.455 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:46.422828+0000", 2024-04-19T03:02:46.455 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0019138639999999999, 2024-04-19T03:02:46.455 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.002326336, 2024-04-19T03:02:46.455 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:46.455 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-19T03:02:46.455 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:46.455 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:46.455 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:46.455 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 129416 2024-04-19T03:02:46.455 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:46.456 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:46.456 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:46.456 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:46.456 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:46.422828+0000", 2024-04-19T03:02:46.456 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:46.456 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:46.456 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:46.456 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:46.456 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:46.422828+0000", 2024-04-19T03:02:46.456 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:46.456 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:46.456 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:46.456 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:46.457 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:46.422827+0000", 2024-04-19T03:02:46.457 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:46.457 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:46.457 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:46.457 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:46.457 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:46.422832+0000", 2024-04-19T03:02:46.457 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3260000000000003e-06 2024-04-19T03:02:46.457 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:46.457 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:46.457 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:46.457 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:46.422843+0000", 2024-04-19T03:02:46.457 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0807e-05 2024-04-19T03:02:46.457 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:46.457 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:46.458 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:46.458 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:46.422851+0000", 2024-04-19T03:02:46.458 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.6699999999999994e-06 2024-04-19T03:02:46.458 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:46.458 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:46.458 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:46.458 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:46.422914+0000", 2024-04-19T03:02:46.458 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3026000000000003e-05 2024-04-19T03:02:46.458 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:46.458 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:46.458 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:46.458 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:46.423005+0000", 2024-04-19T03:02:46.458 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1008999999999995e-05 2024-04-19T03:02:46.459 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:46.459 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:46.459 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:46.459 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:46.459 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:46.459 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:129419 5.8 5:1bc8f2b4:::benchmark_data_smithi096_19531_object15969:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-19T03:02:46.459 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:46.422870+0000", 2024-04-19T03:02:46.459 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.001871192, 2024-04-19T03:02:46.459 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0023295799999999999, 2024-04-19T03:02:46.459 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:46.459 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-19T03:02:46.459 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:46.459 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:46.459 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:46.460 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 129419 2024-04-19T03:02:46.460 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:46.460 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:46.460 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:46.460 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:46.460 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:46.422870+0000", 2024-04-19T03:02:46.460 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:46.460 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:46.460 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:46.460 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:46.460 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:46.422870+0000", 2024-04-19T03:02:46.460 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:46.460 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:46.460 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:46.461 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:46.461 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:46.422870+0000", 2024-04-19T03:02:46.461 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:46.461 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:46.461 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:46.461 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:46.461 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:46.422872+0000", 2024-04-19T03:02:46.461 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2340000000000001e-06 2024-04-19T03:02:46.461 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:46.461 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:46.461 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:46.461 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:46.422882+0000", 2024-04-19T03:02:46.461 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.6900000000000004e-06 2024-04-19T03:02:46.462 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:46.462 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:46.462 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:46.462 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:46.422886+0000", 2024-04-19T03:02:46.462 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8229999999999997e-06 2024-04-19T03:02:46.462 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:46.462 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:46.462 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:46.462 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:46.422928+0000", 2024-04-19T03:02:46.462 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2247999999999999e-05 2024-04-19T03:02:46.462 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:46.462 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:46.462 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:46.463 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:46.423068+0000", 2024-04-19T03:02:46.463 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014013400000000001 2024-04-19T03:02:46.463 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:46.463 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:46.463 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:46.463 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:46.463 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:46.463 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4755.0:129418 5.d e52/49 5:b137a574:::benchmark_data_smithi096_19531_object15968:head v 52'8186, mlcod=52'8183)", 2024-04-19T03:02:46.463 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:46.423371+0000", 2024-04-19T03:02:46.463 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.001370584, 2024-04-19T03:02:46.463 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0018759130000000001, 2024-04-19T03:02:46.463 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:46.463 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-19T03:02:46.463 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:46.464 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:46.464 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:46.464 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:46.423371+0000", 2024-04-19T03:02:46.464 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:46.464 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:46.464 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:46.464 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:46.464 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:46.423371+0000", 2024-04-19T03:02:46.464 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:46.464 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:46.464 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:46.464 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:46.464 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:46.423370+0000", 2024-04-19T03:02:46.464 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:46.465 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:46.465 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:46.465 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:46.465 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:46.423378+0000", 2024-04-19T03:02:46.465 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.401e-06 2024-04-19T03:02:46.465 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:46.465 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:46.465 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:46.465 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:46.423407+0000", 2024-04-19T03:02:46.465 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9196999999999998e-05 2024-04-19T03:02:46.466 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:46.466 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:46.466 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:46.466 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:46.423414+0000", 2024-04-19T03:02:46.466 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.1509999999999998e-06 2024-04-19T03:02:46.466 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:46.466 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:46.466 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:46.466 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:46.423471+0000", 2024-04-19T03:02:46.466 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7048e-05 2024-04-19T03:02:46.466 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:46.466 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:46.466 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:46.467 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:46.423494+0000", 2024-04-19T03:02:46.467 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2770000000000001e-05 2024-04-19T03:02:46.467 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:46.467 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:46.467 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:46.467 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:46.467 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:46.467 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:129423 5.4 5:2b30bc83:::benchmark_data_smithi096_19531_object15973:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-19T03:02:46.467 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:46.424967+0000", 2024-04-19T03:02:46.467 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 4294967295.9997745, 2024-04-19T03:02:46.467 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00031776200000000002, 2024-04-19T03:02:46.467 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:46.468 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-19T03:02:46.468 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:46.468 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:46.468 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:46.468 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 129423 2024-04-19T03:02:46.468 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:46.468 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:46.468 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:46.468 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:46.468 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:46.424967+0000", 2024-04-19T03:02:46.468 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:46.468 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:46.468 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:46.468 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:46.469 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:46.424967+0000", 2024-04-19T03:02:46.469 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:46.469 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:46.469 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:46.469 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:46.469 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:46.424966+0000", 2024-04-19T03:02:46.469 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:46.469 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:46.469 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:46.469 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:46.469 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:46.424973+0000", 2024-04-19T03:02:46.470 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.0539999999999997e-06 2024-04-19T03:02:46.470 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:46.470 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:46.470 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:46.470 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:46.425001+0000", 2024-04-19T03:02:46.470 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8160000000000001e-05 2024-04-19T03:02:46.470 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:46.470 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:46.470 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:46.470 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:46.425011+0000", 2024-04-19T03:02:46.470 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.8539999999999992e-06 2024-04-19T03:02:46.470 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:46.470 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:46.470 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:46.471 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:46.425073+0000", 2024-04-19T03:02:46.471 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1532999999999995e-05 2024-04-19T03:02:46.471 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:46.471 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:46.471 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:46.471 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:46.425148+0000", 2024-04-19T03:02:46.471 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5183000000000002e-05 2024-04-19T03:02:46.471 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:46.471 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:46.471 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:46.471 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:46.471 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:46.471 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:129424 5.4 5.7beefc4 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-19T03:02:46.472 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:46.425032+0000", 2024-04-19T03:02:46.472 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 4294967295.9997096, 2024-04-19T03:02:46.472 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00032381199999999998, 2024-04-19T03:02:46.472 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:46.472 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-04-19T03:02:46.472 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:46.472 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:46.472 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:46.472 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 129424 2024-04-19T03:02:46.472 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:46.472 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:46.472 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:46.472 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:46.473 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:46.425032+0000", 2024-04-19T03:02:46.473 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:46.473 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:46.473 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:46.473 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:46.473 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:46.425032+0000", 2024-04-19T03:02:46.473 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:46.473 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:46.473 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:46.473 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:46.473 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:46.425031+0000", 2024-04-19T03:02:46.473 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:46.473 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:46.473 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:46.474 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:46.474 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:46.425035+0000", 2024-04-19T03:02:46.474 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.0230000000000003e-06 2024-04-19T03:02:46.474 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:46.474 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:46.474 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:46.474 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:46.425050+0000", 2024-04-19T03:02:46.474 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4888999999999999e-05 2024-04-19T03:02:46.474 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:46.474 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:46.474 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:46.474 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:46.425058+0000", 2024-04-19T03:02:46.475 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.525e-06 2024-04-19T03:02:46.475 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:46.475 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:46.475 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:46.475 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:46.475 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:46.475 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:129425 5.e 5.8cb13b0e (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2024-04-19T03:02:46.475 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:46.425310+0000", 2024-04-19T03:02:46.475 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 4294967295.9994316, 2024-04-19T03:02:46.475 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9838000000000003e-05, 2024-04-19T03:02:46.475 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:46.475 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-19T03:02:46.475 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:46.475 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:46.476 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:46.476 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 129425 2024-04-19T03:02:46.476 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:46.476 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:46.476 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:46.476 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:46.476 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:46.425310+0000", 2024-04-19T03:02:46.476 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:46.476 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:46.476 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:46.476 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:46.476 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:46.425310+0000", 2024-04-19T03:02:46.476 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:46.476 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:46.477 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:46.477 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:46.477 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:46.425309+0000", 2024-04-19T03:02:46.477 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:46.477 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:46.477 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:46.477 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:46.477 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:46.425314+0000", 2024-04-19T03:02:46.477 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8999999999999997e-06 2024-04-19T03:02:46.477 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:46.477 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:46.477 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:46.477 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:46.425343+0000", 2024-04-19T03:02:46.477 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8317e-05 2024-04-19T03:02:46.478 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:46.478 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:46.478 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:46.478 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:46.425351+0000", 2024-04-19T03:02:46.478 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3680000000000002e-06 2024-04-19T03:02:46.478 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:46.478 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:46.478 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:46.478 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:46.425396+0000", 2024-04-19T03:02:46.478 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4644000000000001e-05 2024-04-19T03:02:46.478 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:46.479 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:46.479 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:46.479 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:46.479 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-04-19T03:02:46.479 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 12 2024-04-19T03:02:46.479 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-19T03:02:46.479 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-19T03:02:46.481 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T03:02:46.505 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:46.503+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:46.606 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:46.603+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:46.606 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-19T03:02:46.606 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-04-19T03:02:46.606 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-04-19T03:02:46.607 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-04-19T03:02:46.607 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-19T03:02:46.620 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T03:02:46.636 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1: {} 2024-04-19T03:02:46.656 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2: {} 2024-04-19T03:02:46.656 INFO:teuthology.orchestra.run.smithi096.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-04-19T03:02:46.656 INFO:teuthology.orchestra.run.smithi096.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-19T03:02:46.656 INFO:teuthology.orchestra.run.smithi096.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-19T03:02:46.660 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-19T03:02:46.661 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-19T03:02:46.707 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:46.705+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:46.785 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-19T03:02:46.786 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:02:46.797 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T03:02:46.807 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:46.803+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:46.908 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~18s 2024-04-19T03:02:46.908 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:46.905+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:46.924 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-04-19T03:02:46.924 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:02:46.937 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T03:02:47.010 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:47.007+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:47.062 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-04-19T03:02:47.062 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:02:47.077 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T03:02:47.154 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:47.153+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:47.256 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:47.253+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:47.282 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-04-19T03:02:47.283 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:02:47.296 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T03:02:47.357 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:47.355+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:47.417 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-19T03:02:47.418 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:02:47.429 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T03:02:47.458 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:47.457+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:47.464 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-19T03:02:47.556 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-19T03:02:47.557 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:02:47.559 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:47.557+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:47.568 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T03:02:47.660 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:47.659+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:47.688 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-19T03:02:47.688 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:02:47.700 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T03:02:47.761 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:47.759+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:47.833 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-04-19T03:02:47.833 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:02:47.845 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T03:02:47.862 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:47.859+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:47.963 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:47.959+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:47.972 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-04-19T03:02:47.972 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:02:47.987 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T03:02:48.064 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:48.061+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:48.116 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-04-19T03:02:48.116 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:02:48.129 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T03:02:48.176 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:48.175+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:48.255 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-19T03:02:48.256 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:02:48.266 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:48.263+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:48.268 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T03:02:48.368 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:48.363+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:48.390 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-19T03:02:48.390 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:02:48.401 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T03:02:48.468 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:48.465+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:48.469 INFO:teuthology.orchestra.run.smithi096.stderr:noscrub is set 2024-04-19T03:02:48.495 DEBUG:teuthology.orchestra.console.smithi097:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-19T03:02:48.520 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-19T03:02:48.521 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:02:48.534 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T03:02:48.569 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:48.567+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:48.605 DEBUG:teuthology.orchestra.console.smithi097:check power output: Chassis Power is off 2024-04-19T03:02:48.662 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-19T03:02:48.664 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-04-19T03:02:48.664 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:02:48.669 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:48.665+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:48.677 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T03:02:48.772 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:48.769+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:48.808 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-04-19T03:02:48.808 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:02:48.811 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1: {} 2024-04-19T03:02:48.821 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T03:02:48.836 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2: {} 2024-04-19T03:02:48.836 INFO:teuthology.orchestra.run.smithi096.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-04-19T03:02:48.836 INFO:teuthology.orchestra.run.smithi096.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-19T03:02:48.836 INFO:teuthology.orchestra.run.smithi096.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-19T03:02:48.840 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-19T03:02:48.841 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-19T03:02:48.871 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:48.869+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:48.971 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:48.967+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:48.990 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-04-19T03:02:48.991 INFO:teuthology.orchestra.run.smithi144.stdout: "size": 20, 2024-04-19T03:02:48.991 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 600, 2024-04-19T03:02:48.991 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [ 2024-04-19T03:02:48.991 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:48.991 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:78992 5.7 5:e6baa862:::benchmark_data_smithi096_19531_object78991:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-19T03:02:48.991 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:18.008888+0000", 2024-04-19T03:02:48.991 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 30.979176309, 2024-04-19T03:02:48.991 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.056375285999999997, 2024-04-19T03:02:48.991 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:48.992 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:48.992 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:48.992 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:48.992 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:48.992 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 78992 2024-04-19T03:02:48.992 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:48.992 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:48.992 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:48.992 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:48.992 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.008888+0000", 2024-04-19T03:02:48.992 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:48.992 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:48.993 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:48.993 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:48.993 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.008888+0000", 2024-04-19T03:02:48.993 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:48.993 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:48.993 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:48.993 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:48.993 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.008888+0000", 2024-04-19T03:02:48.993 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:48.993 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:48.993 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:48.994 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:48.994 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.008928+0000", 2024-04-19T03:02:48.994 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0361999999999997e-05 2024-04-19T03:02:48.994 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:48.994 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:48.994 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:48.994 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.008942+0000", 2024-04-19T03:02:48.994 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4365000000000001e-05 2024-04-19T03:02:48.994 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:48.994 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:48.995 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:48.995 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.008949+0000", 2024-04-19T03:02:48.995 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.212e-06 2024-04-19T03:02:48.995 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:48.995 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:48.995 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:48.995 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.012683+0000", 2024-04-19T03:02:48.995 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.003733934 2024-04-19T03:02:48.995 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:48.995 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:48.995 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:48.996 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.012798+0000", 2024-04-19T03:02:48.996 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00011574999999999999 2024-04-19T03:02:48.996 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:48.996 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:48.996 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:48.996 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.012896+0000", 2024-04-19T03:02:48.996 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.7848000000000002e-05 2024-04-19T03:02:48.996 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:48.996 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:48.996 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:48.996 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016423+0000", 2024-04-19T03:02:48.997 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0035270789999999998 2024-04-19T03:02:48.997 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:48.997 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:48.997 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:48.997 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.065098+0000", 2024-04-19T03:02:48.997 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.048674651999999999 2024-04-19T03:02:48.997 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:48.997 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:48.997 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:48.997 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.065193+0000", 2024-04-19T03:02:48.997 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.5087999999999995e-05 2024-04-19T03:02:48.997 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:48.998 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:48.998 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:48.998 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.065264+0000", 2024-04-19T03:02:48.998 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0666000000000004e-05 2024-04-19T03:02:48.998 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:48.998 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:48.998 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:48.998 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:48.998 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:48.998 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:78998 5.7 5:ee23c1bc:::benchmark_data_smithi096_19531_object78997:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-19T03:02:48.998 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:18.013165+0000", 2024-04-19T03:02:48.999 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 30.974899603000001, 2024-04-19T03:02:48.999 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.052410864000000001, 2024-04-19T03:02:48.999 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:48.999 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:48.999 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:48.999 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:48.999 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:48.999 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 78998 2024-04-19T03:02:48.999 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:48.999 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:48.999 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.000 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:49.000 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.013165+0000", 2024-04-19T03:02:49.000 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:49.000 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.000 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.000 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:49.000 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.013165+0000", 2024-04-19T03:02:49.000 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:49.000 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.000 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.000 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:49.001 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.013164+0000", 2024-04-19T03:02:49.001 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:49.001 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.001 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.001 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:49.001 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.013214+0000", 2024-04-19T03:02:49.001 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9636999999999999e-05 2024-04-19T03:02:49.001 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.001 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.001 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:49.001 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.013223+0000", 2024-04-19T03:02:49.002 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.3619999999999995e-06 2024-04-19T03:02:49.002 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.002 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.002 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:49.002 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.013229+0000", 2024-04-19T03:02:49.002 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6060000000000002e-06 2024-04-19T03:02:49.002 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.002 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.002 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:49.002 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.014882+0000", 2024-04-19T03:02:49.002 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001653257 2024-04-19T03:02:49.003 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.003 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.003 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:49.003 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.014958+0000", 2024-04-19T03:02:49.003 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6398999999999998e-05 2024-04-19T03:02:49.003 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.003 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.003 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:49.003 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.015036+0000", 2024-04-19T03:02:49.003 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8070000000000003e-05 2024-04-19T03:02:49.003 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.003 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.004 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:49.004 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018099+0000", 2024-04-19T03:02:49.004 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0030631149999999999 2024-04-19T03:02:49.004 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.004 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.004 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:49.004 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.065328+0000", 2024-04-19T03:02:49.004 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.047228349000000003 2024-04-19T03:02:49.004 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.004 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.004 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:49.005 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.065508+0000", 2024-04-19T03:02:49.005 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00018036899999999999 2024-04-19T03:02:49.005 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.005 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.005 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:49.005 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.065576+0000", 2024-04-19T03:02:49.005 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7785000000000002e-05 2024-04-19T03:02:49.005 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:49.005 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:49.005 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:49.005 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.005 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.006 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4755.0:78995 5.2 e40/39 5:42b55e12:::benchmark_data_smithi096_19531_object78994:head v 40'4934, mlcod=40'4932)", 2024-04-19T03:02:49.006 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:18.016247+0000", 2024-04-19T03:02:49.006 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 30.971817641000001, 2024-04-19T03:02:49.006 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.056240406, 2024-04-19T03:02:49.006 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:49.006 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:49.006 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:49.006 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.006 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:49.006 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016247+0000", 2024-04-19T03:02:49.006 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:49.007 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.007 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.007 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:49.007 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016247+0000", 2024-04-19T03:02:49.007 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:49.007 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.007 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.007 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:49.007 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016246+0000", 2024-04-19T03:02:49.007 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:49.007 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.007 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.008 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:49.008 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016315+0000", 2024-04-19T03:02:49.008 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8979000000000005e-05 2024-04-19T03:02:49.008 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.008 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.008 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:49.008 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016333+0000", 2024-04-19T03:02:49.008 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7586999999999999e-05 2024-04-19T03:02:49.008 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.008 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.008 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:49.009 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016340+0000", 2024-04-19T03:02:49.009 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4080000000000001e-06 2024-04-19T03:02:49.009 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.009 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.009 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:49.009 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016384+0000", 2024-04-19T03:02:49.009 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3656999999999999e-05 2024-04-19T03:02:49.009 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.009 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.010 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:49.010 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016403+0000", 2024-04-19T03:02:49.010 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9089e-05 2024-04-19T03:02:49.010 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.010 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.010 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:49.010 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.072448+0000", 2024-04-19T03:02:49.010 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.056045084000000002 2024-04-19T03:02:49.010 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.010 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.010 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:49.011 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.072487+0000", 2024-04-19T03:02:49.011 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9362e-05 2024-04-19T03:02:49.011 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:49.011 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:49.011 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:49.011 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.011 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.011 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4755.0:78994 5.c e40/22 5:3c60d55d:::benchmark_data_smithi096_19531_object78993:head v 40'4989, mlcod=40'4987)", 2024-04-19T03:02:49.011 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:18.016392+0000", 2024-04-19T03:02:49.011 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 30.971672999999999, 2024-04-19T03:02:49.011 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.052629620000000002, 2024-04-19T03:02:49.011 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:49.012 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:49.012 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:49.012 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.012 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:49.012 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016392+0000", 2024-04-19T03:02:49.012 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:49.012 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.012 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.012 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:49.012 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016392+0000", 2024-04-19T03:02:49.012 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:49.013 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.013 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.013 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:49.013 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016391+0000", 2024-04-19T03:02:49.013 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:49.013 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.013 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.013 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:49.013 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016471+0000", 2024-04-19T03:02:49.013 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9346999999999998e-05 2024-04-19T03:02:49.013 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.013 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.014 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:49.014 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016478+0000", 2024-04-19T03:02:49.014 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.593e-06 2024-04-19T03:02:49.014 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.014 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.014 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:49.014 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016495+0000", 2024-04-19T03:02:49.014 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6492999999999999e-05 2024-04-19T03:02:49.014 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.014 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.014 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:49.015 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016539+0000", 2024-04-19T03:02:49.015 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4715999999999997e-05 2024-04-19T03:02:49.015 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.015 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.015 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:49.015 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016551+0000", 2024-04-19T03:02:49.015 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2096000000000001e-05 2024-04-19T03:02:49.015 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.015 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.015 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:49.015 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.068985+0000", 2024-04-19T03:02:49.015 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.052433754999999999 2024-04-19T03:02:49.016 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.016 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.016 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:49.016 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.069021+0000", 2024-04-19T03:02:49.016 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6047000000000002e-05 2024-04-19T03:02:49.016 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:49.016 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:49.016 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:49.016 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.016 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.016 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4755.0:78996 5.1 e40/39 5:87f59708:::benchmark_data_smithi096_19531_object78995:head v 40'4940, mlcod=40'4938)", 2024-04-19T03:02:49.016 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:18.016581+0000", 2024-04-19T03:02:49.017 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 30.971483835000001, 2024-04-19T03:02:49.017 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.052051785000000003, 2024-04-19T03:02:49.017 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:49.017 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:49.017 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:49.017 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.017 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:49.017 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016581+0000", 2024-04-19T03:02:49.017 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:49.017 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.017 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.017 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:49.017 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016581+0000", 2024-04-19T03:02:49.018 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:49.018 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.018 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.018 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:49.018 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016581+0000", 2024-04-19T03:02:49.018 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:49.018 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.018 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.018 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:49.018 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016610+0000", 2024-04-19T03:02:49.018 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9556999999999998e-05 2024-04-19T03:02:49.018 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.019 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.019 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:49.019 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016616+0000", 2024-04-19T03:02:49.019 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1090000000000003e-06 2024-04-19T03:02:49.019 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.019 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.019 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:49.019 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016621+0000", 2024-04-19T03:02:49.019 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.454e-06 2024-04-19T03:02:49.019 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.019 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.019 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:49.020 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016663+0000", 2024-04-19T03:02:49.020 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2582e-05 2024-04-19T03:02:49.020 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.020 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.020 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:49.020 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016681+0000", 2024-04-19T03:02:49.020 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7680999999999999e-05 2024-04-19T03:02:49.020 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.020 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.020 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:49.020 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.068486+0000", 2024-04-19T03:02:49.020 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.051804624000000001 2024-04-19T03:02:49.021 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.021 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.021 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:49.021 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.068633+0000", 2024-04-19T03:02:49.021 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00014709099999999999 2024-04-19T03:02:49.021 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:49.021 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:49.021 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:49.021 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.021 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.021 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4755.0:78999 5.3 e40/22 5:c9ec5f7f:::benchmark_data_smithi096_19531_object78998:head v 40'4893, mlcod=40'4889)", 2024-04-19T03:02:49.021 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:18.016633+0000", 2024-04-19T03:02:49.022 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 30.971431979999998, 2024-04-19T03:02:49.022 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.051090469999999999, 2024-04-19T03:02:49.022 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:49.022 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:49.022 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:49.022 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.022 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:49.022 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016633+0000", 2024-04-19T03:02:49.022 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:49.022 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.022 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.023 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:49.023 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016633+0000", 2024-04-19T03:02:49.023 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:49.023 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.023 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.023 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:49.023 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016632+0000", 2024-04-19T03:02:49.023 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967296 2024-04-19T03:02:49.023 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.023 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.023 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:49.023 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016660+0000", 2024-04-19T03:02:49.023 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7869999999999999e-05 2024-04-19T03:02:49.024 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.024 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.024 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:49.024 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016667+0000", 2024-04-19T03:02:49.024 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0280000000000003e-06 2024-04-19T03:02:49.024 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.024 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.024 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:49.024 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016672+0000", 2024-04-19T03:02:49.024 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0069999999999997e-06 2024-04-19T03:02:49.024 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.025 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.025 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:49.025 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016725+0000", 2024-04-19T03:02:49.025 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2812000000000002e-05 2024-04-19T03:02:49.025 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.025 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.025 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:49.025 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016750+0000", 2024-04-19T03:02:49.025 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5038e-05 2024-04-19T03:02:49.025 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.025 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.026 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:49.026 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.067673+0000", 2024-04-19T03:02:49.026 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.050922350999999998 2024-04-19T03:02:49.026 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.026 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.026 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:49.026 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.067723+0000", 2024-04-19T03:02:49.026 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0586e-05 2024-04-19T03:02:49.026 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:49.026 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:49.026 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:49.027 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.027 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.027 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4755.0:79003 5.2 e40/39 5:4436e33f:::benchmark_data_smithi096_19531_object79002:head v 40'4935, mlcod=40'4932)", 2024-04-19T03:02:49.027 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:18.018102+0000", 2024-04-19T03:02:49.027 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 30.969962252999998, 2024-04-19T03:02:49.027 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.060023990999999999, 2024-04-19T03:02:49.027 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:49.027 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:49.027 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:49.027 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.027 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:49.027 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018102+0000", 2024-04-19T03:02:49.027 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:49.027 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.028 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.028 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:49.028 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018102+0000", 2024-04-19T03:02:49.028 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:49.028 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.028 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.028 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:49.028 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018102+0000", 2024-04-19T03:02:49.028 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:49.028 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.028 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.028 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:49.029 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018134+0000", 2024-04-19T03:02:49.029 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2722000000000003e-05 2024-04-19T03:02:49.029 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.029 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.029 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:49.029 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018145+0000", 2024-04-19T03:02:49.029 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0395e-05 2024-04-19T03:02:49.029 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.029 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.029 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:49.029 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018151+0000", 2024-04-19T03:02:49.029 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5300000000000002e-06 2024-04-19T03:02:49.029 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.030 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.030 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:49.030 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018489+0000", 2024-04-19T03:02:49.030 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00033731499999999998 2024-04-19T03:02:49.030 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.030 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.030 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:49.030 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018508+0000", 2024-04-19T03:02:49.030 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9775e-05 2024-04-19T03:02:49.030 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.030 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.030 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:49.031 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.078059+0000", 2024-04-19T03:02:49.031 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.059550171999999998 2024-04-19T03:02:49.031 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.031 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.031 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:49.031 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.078126+0000", 2024-04-19T03:02:49.031 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7773000000000003e-05 2024-04-19T03:02:49.031 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:49.031 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:49.031 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:49.031 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.031 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.032 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4755.0:79005 5.1 e40/39 5:85b46038:::benchmark_data_smithi096_19531_object79004:head v 40'4941, mlcod=40'4938)", 2024-04-19T03:02:49.032 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:18.018167+0000", 2024-04-19T03:02:49.032 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 30.969897534000001, 2024-04-19T03:02:49.032 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.052768941999999999, 2024-04-19T03:02:49.032 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:49.032 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:49.032 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:49.032 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.032 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:49.032 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018167+0000", 2024-04-19T03:02:49.032 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:49.033 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.033 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.033 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:49.033 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018167+0000", 2024-04-19T03:02:49.033 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:49.033 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.033 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.033 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:49.033 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018167+0000", 2024-04-19T03:02:49.033 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:49.033 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.033 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.033 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:49.034 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018196+0000", 2024-04-19T03:02:49.034 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9538000000000001e-05 2024-04-19T03:02:49.034 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.034 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.034 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:49.034 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018204+0000", 2024-04-19T03:02:49.034 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2599999999999999e-06 2024-04-19T03:02:49.034 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.034 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.034 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:49.034 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018208+0000", 2024-04-19T03:02:49.034 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8080000000000004e-06 2024-04-19T03:02:49.035 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.035 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.035 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:49.035 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.064933+0000", 2024-04-19T03:02:49.035 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.046725048999999998 2024-04-19T03:02:49.035 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.035 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.035 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:49.035 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.064964+0000", 2024-04-19T03:02:49.035 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0577000000000002e-05 2024-04-19T03:02:49.036 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.036 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.036 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:49.036 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.070815+0000", 2024-04-19T03:02:49.036 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0058510649999999999 2024-04-19T03:02:49.036 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.036 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.036 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:49.036 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.070936+0000", 2024-04-19T03:02:49.036 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00012095399999999999 2024-04-19T03:02:49.036 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:49.036 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:49.037 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:49.037 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.037 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.037 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:86612 5.7 5:e32e3c49:::benchmark_data_smithi096_19531_object86611:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:49.037 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:22.633560+0000", 2024-04-19T03:02:49.037 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 26.354504593000001, 2024-04-19T03:02:49.037 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.19135289, 2024-04-19T03:02:49.037 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:49.037 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:49.037 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:49.038 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:49.038 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:49.038 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 86612 2024-04-19T03:02:49.038 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.038 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:49.038 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.038 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:49.038 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633560+0000", 2024-04-19T03:02:49.038 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:49.038 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.038 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.039 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:49.039 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633560+0000", 2024-04-19T03:02:49.039 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:49.039 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.039 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.039 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:49.039 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633558+0000", 2024-04-19T03:02:49.039 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:49.039 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.039 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.039 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:49.039 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633609+0000", 2024-04-19T03:02:49.040 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0850999999999998e-05 2024-04-19T03:02:49.040 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.040 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.040 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:49.040 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633627+0000", 2024-04-19T03:02:49.040 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7951000000000001e-05 2024-04-19T03:02:49.040 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.040 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.040 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:49.040 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633635+0000", 2024-04-19T03:02:49.040 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2530000000000004e-06 2024-04-19T03:02:49.041 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.041 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.041 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:49.041 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633699+0000", 2024-04-19T03:02:49.041 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3901999999999999e-05 2024-04-19T03:02:49.041 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.041 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.041 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:49.041 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633992+0000", 2024-04-19T03:02:49.041 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00029283299999999999 2024-04-19T03:02:49.041 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.041 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.042 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:49.042 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.634223+0000", 2024-04-19T03:02:49.042 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00023084200000000001 2024-04-19T03:02:49.042 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.042 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.042 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:49.042 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.639085+0000", 2024-04-19T03:02:49.042 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0048624269999999999 2024-04-19T03:02:49.042 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.043 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.043 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:49.043 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.824635+0000", 2024-04-19T03:02:49.043 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.18554944700000001 2024-04-19T03:02:49.043 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.043 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.043 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:49.043 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.824793+0000", 2024-04-19T03:02:49.043 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000157959 2024-04-19T03:02:49.043 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.043 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.043 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:49.043 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.824913+0000", 2024-04-19T03:02:49.044 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000120093 2024-04-19T03:02:49.044 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:49.044 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:49.044 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:49.044 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.044 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.044 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:86625 5.7 5:e6d00488:::benchmark_data_smithi096_19531_object86624:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:49.044 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:22.643554+0000", 2024-04-19T03:02:49.044 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 26.344510827000001, 2024-04-19T03:02:49.044 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.18732841, 2024-04-19T03:02:49.044 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:49.044 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:49.044 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:49.045 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:49.045 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:49.045 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 86625 2024-04-19T03:02:49.045 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.045 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:49.045 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.045 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:49.045 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643554+0000", 2024-04-19T03:02:49.045 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:49.045 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.045 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.046 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:49.046 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643554+0000", 2024-04-19T03:02:49.046 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:49.046 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.046 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.046 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:49.046 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643552+0000", 2024-04-19T03:02:49.046 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:49.046 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.046 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.046 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:49.047 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643588+0000", 2024-04-19T03:02:49.047 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5855999999999997e-05 2024-04-19T03:02:49.047 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.047 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.047 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:49.047 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643606+0000", 2024-04-19T03:02:49.047 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8226000000000001e-05 2024-04-19T03:02:49.047 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.047 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.047 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:49.047 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643618+0000", 2024-04-19T03:02:49.048 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1868000000000001e-05 2024-04-19T03:02:49.048 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.048 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.048 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:49.048 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643676+0000", 2024-04-19T03:02:49.048 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8153999999999999e-05 2024-04-19T03:02:49.048 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.048 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.048 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:49.048 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643905+0000", 2024-04-19T03:02:49.049 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00022847500000000001 2024-04-19T03:02:49.049 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.049 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.049 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:49.049 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.644150+0000", 2024-04-19T03:02:49.049 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00024531800000000001 2024-04-19T03:02:49.049 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.049 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.049 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:49.049 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.647407+0000", 2024-04-19T03:02:49.049 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0032563190000000001 2024-04-19T03:02:49.050 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.050 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.050 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:49.050 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.830721+0000", 2024-04-19T03:02:49.050 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.18331468300000001 2024-04-19T03:02:49.050 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.050 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.050 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:49.050 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.830813+0000", 2024-04-19T03:02:49.050 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.2205000000000002e-05 2024-04-19T03:02:49.051 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.051 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.051 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:49.051 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.830882+0000", 2024-04-19T03:02:49.051 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8819999999999995e-05 2024-04-19T03:02:49.051 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:49.051 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:49.051 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:49.051 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.051 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.051 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87063 5.7 5:e502e824:::benchmark_data_smithi096_19531_object87062:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:49.051 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.136067+0000", 2024-04-19T03:02:49.051 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 25.851997957999998, 2024-04-19T03:02:49.052 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.065521159999999995, 2024-04-19T03:02:49.052 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:49.052 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:49.052 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:49.052 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:49.052 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:49.052 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87063 2024-04-19T03:02:49.052 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.052 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:49.052 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.052 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:49.052 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.136067+0000", 2024-04-19T03:02:49.052 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:49.053 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.053 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.053 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:49.053 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.136067+0000", 2024-04-19T03:02:49.053 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:49.053 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.053 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.053 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:49.053 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.136066+0000", 2024-04-19T03:02:49.053 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:49.053 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.053 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.054 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:49.054 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.136154+0000", 2024-04-19T03:02:49.054 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.8256000000000003e-05 2024-04-19T03:02:49.054 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.054 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.054 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:49.054 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.136162+0000", 2024-04-19T03:02:49.054 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.5099999999999998e-06 2024-04-19T03:02:49.054 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.054 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.054 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:49.054 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.136171+0000", 2024-04-19T03:02:49.055 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2830000000000001e-06 2024-04-19T03:02:49.057 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.057 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.057 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:49.057 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.138421+0000", 2024-04-19T03:02:49.057 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0022506620000000001 2024-04-19T03:02:49.057 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.057 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.057 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:49.057 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.138560+0000", 2024-04-19T03:02:49.057 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000138446 2024-04-19T03:02:49.058 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.058 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.058 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:49.058 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.138689+0000", 2024-04-19T03:02:49.058 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00012950700000000001 2024-04-19T03:02:49.058 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.058 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.058 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:49.058 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.141517+0000", 2024-04-19T03:02:49.058 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0028280860000000001 2024-04-19T03:02:49.058 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.059 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.059 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:49.059 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.201350+0000", 2024-04-19T03:02:49.059 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.059832418999999998 2024-04-19T03:02:49.059 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.059 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.059 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:49.059 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.201485+0000", 2024-04-19T03:02:49.059 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000135597 2024-04-19T03:02:49.059 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.059 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.059 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:49.060 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.201588+0000", 2024-04-19T03:02:49.060 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00010247900000000001 2024-04-19T03:02:49.060 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:49.060 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:49.060 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:49.060 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.060 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.060 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87072 5.7 5:e3c7809a:::benchmark_data_smithi096_19531_object87071:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:49.060 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.144224+0000", 2024-04-19T03:02:49.060 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 25.843840933999999, 2024-04-19T03:02:49.060 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.058179555000000001, 2024-04-19T03:02:49.060 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:49.061 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:49.061 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:49.061 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:49.061 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:49.061 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87072 2024-04-19T03:02:49.061 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.061 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:49.061 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.061 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:49.061 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144224+0000", 2024-04-19T03:02:49.061 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:49.061 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.061 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.061 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:49.062 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144224+0000", 2024-04-19T03:02:49.062 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:49.062 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.062 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.062 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:49.062 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144223+0000", 2024-04-19T03:02:49.062 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:49.062 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.062 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.062 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:49.062 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144320+0000", 2024-04-19T03:02:49.063 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.7075000000000001e-05 2024-04-19T03:02:49.063 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.063 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.063 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:49.063 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144331+0000", 2024-04-19T03:02:49.063 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1342000000000001e-05 2024-04-19T03:02:49.063 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.063 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.063 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:49.063 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144337+0000", 2024-04-19T03:02:49.063 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8390000000000003e-06 2024-04-19T03:02:49.064 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.064 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.064 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:49.064 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144369+0000", 2024-04-19T03:02:49.064 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2079000000000002e-05 2024-04-19T03:02:49.064 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.064 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.064 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:49.064 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144464+0000", 2024-04-19T03:02:49.064 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.4623000000000005e-05 2024-04-19T03:02:49.064 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.064 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.065 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:49.065 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144553+0000", 2024-04-19T03:02:49.065 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9171000000000004e-05 2024-04-19T03:02:49.065 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.065 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.065 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:49.065 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.147018+0000", 2024-04-19T03:02:49.065 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0024648370000000001 2024-04-19T03:02:49.065 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.065 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.065 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:49.065 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.202270+0000", 2024-04-19T03:02:49.066 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.055252018 2024-04-19T03:02:49.066 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.066 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.066 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:49.066 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.202356+0000", 2024-04-19T03:02:49.066 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6648000000000001e-05 2024-04-19T03:02:49.066 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.066 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.066 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:49.066 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.202403+0000", 2024-04-19T03:02:49.067 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6956999999999998e-05 2024-04-19T03:02:49.067 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:49.067 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:49.067 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:49.067 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.067 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.067 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87123 5.6 5:6d1bc3b9:::benchmark_data_smithi096_19531_object87122:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:02:49.067 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249233+0000", 2024-04-19T03:02:49.067 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 25.738831902000001, 2024-04-19T03:02:49.067 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0291700720000001, 2024-04-19T03:02:49.067 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:49.067 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-04-19T03:02:49.068 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:49.068 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:49.068 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:49.068 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87123 2024-04-19T03:02:49.068 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.068 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:49.068 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.068 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:49.068 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249233+0000", 2024-04-19T03:02:49.068 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:49.068 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.068 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.069 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:49.069 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249233+0000", 2024-04-19T03:02:49.069 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:49.069 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.069 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.069 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:49.069 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249231+0000", 2024-04-19T03:02:49.069 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:49.069 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.069 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.069 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:49.069 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249285+0000", 2024-04-19T03:02:49.070 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4005000000000002e-05 2024-04-19T03:02:49.070 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.070 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.070 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:49.070 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249300+0000", 2024-04-19T03:02:49.070 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4715999999999999e-05 2024-04-19T03:02:49.070 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.070 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.070 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:49.070 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249307+0000", 2024-04-19T03:02:49.070 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8399999999999997e-06 2024-04-19T03:02:49.071 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.071 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.071 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:49.071 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249366+0000", 2024-04-19T03:02:49.071 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9435999999999998e-05 2024-04-19T03:02:49.071 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.071 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.071 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op must wait for map", 2024-04-19T03:02:49.071 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249376+0000", 2024-04-19T03:02:49.071 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.4919999999999999e-06 2024-04-19T03:02:49.071 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.071 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.072 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:49.072 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263757+0000", 2024-04-19T03:02:49.072 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.014381461999999999 2024-04-19T03:02:49.072 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.072 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.072 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:02:49.072 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263875+0000", 2024-04-19T03:02:49.072 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000117166 2024-04-19T03:02:49.072 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.072 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.072 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:49.073 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.277136+0000", 2024-04-19T03:02:49.073 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.013261207 2024-04-19T03:02:49.073 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.073 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.073 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:49.073 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.278403+0000", 2024-04-19T03:02:49.073 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001267106 2024-04-19T03:02:49.073 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:49.073 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:49.073 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:49.073 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.073 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.074 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87128 5.6 5:6905c420:::benchmark_data_smithi096_19531_object87127:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:02:49.074 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249323+0000", 2024-04-19T03:02:49.074 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 25.738741155, 2024-04-19T03:02:49.074 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0292813249999999, 2024-04-19T03:02:49.074 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:49.074 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-04-19T03:02:49.074 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:49.074 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:49.074 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:49.074 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87128 2024-04-19T03:02:49.074 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.074 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:49.075 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.075 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:49.075 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249323+0000", 2024-04-19T03:02:49.075 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:49.075 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.075 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.075 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:49.075 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249323+0000", 2024-04-19T03:02:49.075 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:49.075 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.075 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.075 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:49.076 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249323+0000", 2024-04-19T03:02:49.076 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:49.076 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.076 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.076 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:49.076 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249385+0000", 2024-04-19T03:02:49.076 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1711999999999995e-05 2024-04-19T03:02:49.076 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.076 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.076 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:49.076 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249398+0000", 2024-04-19T03:02:49.076 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3022e-05 2024-04-19T03:02:49.077 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.077 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.077 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:49.077 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249402+0000", 2024-04-19T03:02:49.077 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4819999999999996e-06 2024-04-19T03:02:49.077 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.077 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.077 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:49.077 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249437+0000", 2024-04-19T03:02:49.077 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4702000000000001e-05 2024-04-19T03:02:49.077 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.077 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.077 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:02:49.078 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249442+0000", 2024-04-19T03:02:49.078 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8019999999999999e-06 2024-04-19T03:02:49.078 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.078 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.078 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:49.078 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263896+0000", 2024-04-19T03:02:49.078 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.014454679999999999 2024-04-19T03:02:49.078 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.078 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.078 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:02:49.078 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263900+0000", 2024-04-19T03:02:49.079 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9700000000000001e-06 2024-04-19T03:02:49.079 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.079 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.079 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:49.079 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.278557+0000", 2024-04-19T03:02:49.079 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0146566480000001 2024-04-19T03:02:49.079 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.079 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.079 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:49.079 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.278605+0000", 2024-04-19T03:02:49.080 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7735999999999998e-05 2024-04-19T03:02:49.080 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:49.080 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:49.080 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:49.080 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.080 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.080 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87130 5.3 5:c8c2d67b:::benchmark_data_smithi096_19531_object87129:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:02:49.080 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249418+0000", 2024-04-19T03:02:49.080 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 25.738646444, 2024-04-19T03:02:49.080 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.025414182, 2024-04-19T03:02:49.081 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:49.081 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-04-19T03:02:49.081 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:49.081 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:49.081 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:49.081 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87130 2024-04-19T03:02:49.081 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.081 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:49.081 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.081 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:49.081 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249418+0000", 2024-04-19T03:02:49.081 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:49.082 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.082 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.082 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:49.082 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249418+0000", 2024-04-19T03:02:49.082 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:49.082 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.082 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.082 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:49.082 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249409+0000", 2024-04-19T03:02:49.082 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999905 2024-04-19T03:02:49.082 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.083 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.083 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:49.083 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249464+0000", 2024-04-19T03:02:49.083 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5381999999999999e-05 2024-04-19T03:02:49.083 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.083 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.083 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:49.083 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249471+0000", 2024-04-19T03:02:49.083 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2609999999999996e-06 2024-04-19T03:02:49.083 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.083 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.083 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:49.083 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249475+0000", 2024-04-19T03:02:49.084 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2839999999999998e-06 2024-04-19T03:02:49.084 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.084 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.084 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:49.084 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249535+0000", 2024-04-19T03:02:49.084 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0545999999999999e-05 2024-04-19T03:02:49.084 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.084 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.084 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op must wait for map", 2024-04-19T03:02:49.084 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249540+0000", 2024-04-19T03:02:49.084 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2859999999999999e-06 2024-04-19T03:02:49.084 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.085 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.085 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:49.085 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263450+0000", 2024-04-19T03:02:49.085 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.013909585 2024-04-19T03:02:49.085 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.085 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.085 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:02:49.085 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263458+0000", 2024-04-19T03:02:49.085 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8089999999999993e-06 2024-04-19T03:02:49.085 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.085 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.086 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:49.086 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.273193+0000", 2024-04-19T03:02:49.086 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0097351379999999 2024-04-19T03:02:49.086 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.086 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.086 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:49.086 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.274832+0000", 2024-04-19T03:02:49.086 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0016394789999999999 2024-04-19T03:02:49.087 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:49.087 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:49.087 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:49.087 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.087 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.087 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87131 5.1 5:83756d55:::benchmark_data_smithi096_19531_object87130:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:02:49.087 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249491+0000", 2024-04-19T03:02:49.087 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 25.738573797000001, 2024-04-19T03:02:49.087 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0191489520000001, 2024-04-19T03:02:49.087 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:49.087 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-04-19T03:02:49.087 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:49.088 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:49.088 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:49.088 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87131 2024-04-19T03:02:49.088 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.088 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:49.088 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.088 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:49.088 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249491+0000", 2024-04-19T03:02:49.088 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:49.088 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.088 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.088 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:49.089 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249491+0000", 2024-04-19T03:02:49.089 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:49.089 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.089 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.089 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:49.089 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249491+0000", 2024-04-19T03:02:49.089 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:49.089 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.089 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.089 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:49.089 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249530+0000", 2024-04-19T03:02:49.089 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9589000000000003e-05 2024-04-19T03:02:49.090 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.090 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.090 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:49.090 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249544+0000", 2024-04-19T03:02:49.090 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4158000000000001e-05 2024-04-19T03:02:49.090 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.090 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.090 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:49.090 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249549+0000", 2024-04-19T03:02:49.090 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6809999999999997e-06 2024-04-19T03:02:49.091 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.091 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.091 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:49.091 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249592+0000", 2024-04-19T03:02:49.091 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3285999999999999e-05 2024-04-19T03:02:49.091 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.091 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.091 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op must wait for map", 2024-04-19T03:02:49.091 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249598+0000", 2024-04-19T03:02:49.091 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8329999999999999e-06 2024-04-19T03:02:49.091 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.092 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.092 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:49.092 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263331+0000", 2024-04-19T03:02:49.092 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.013733093 2024-04-19T03:02:49.092 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.092 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.092 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:02:49.092 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263343+0000", 2024-04-19T03:02:49.092 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.189e-05 2024-04-19T03:02:49.092 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.092 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.092 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:49.093 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.268541+0000", 2024-04-19T03:02:49.093 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0051983440000001 2024-04-19T03:02:49.093 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.093 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.093 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:49.093 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.268640+0000", 2024-04-19T03:02:49.093 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.8387999999999994e-05 2024-04-19T03:02:49.093 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:49.093 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:49.093 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:49.093 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.093 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.094 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87132 5.c 5:3e18b732:::benchmark_data_smithi096_19531_object87131:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:02:49.094 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249558+0000", 2024-04-19T03:02:49.094 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 25.738506896000001, 2024-04-19T03:02:49.094 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0241198380000001, 2024-04-19T03:02:49.094 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:49.094 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-04-19T03:02:49.094 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:49.094 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:49.094 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:49.094 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87132 2024-04-19T03:02:49.094 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.095 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:49.095 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.095 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:49.095 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249558+0000", 2024-04-19T03:02:49.095 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:49.095 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.095 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.095 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:49.095 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249558+0000", 2024-04-19T03:02:49.095 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:49.095 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.095 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.096 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:49.096 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249557+0000", 2024-04-19T03:02:49.096 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:49.096 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.096 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.096 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:49.096 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249625+0000", 2024-04-19T03:02:49.096 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7200999999999996e-05 2024-04-19T03:02:49.096 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.096 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.096 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:49.096 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249646+0000", 2024-04-19T03:02:49.097 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1053e-05 2024-04-19T03:02:49.097 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.097 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.097 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:49.097 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249650+0000", 2024-04-19T03:02:49.097 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2719999999999999e-06 2024-04-19T03:02:49.097 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.097 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.097 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:49.097 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249686+0000", 2024-04-19T03:02:49.097 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6430000000000002e-05 2024-04-19T03:02:49.097 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.098 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.098 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op must wait for map", 2024-04-19T03:02:49.098 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249690+0000", 2024-04-19T03:02:49.098 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.765e-06 2024-04-19T03:02:49.098 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.098 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.098 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:49.098 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261157+0000", 2024-04-19T03:02:49.098 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011467247999999999 2024-04-19T03:02:49.098 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.098 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.098 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:02:49.099 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261170+0000", 2024-04-19T03:02:49.099 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2833000000000001e-05 2024-04-19T03:02:49.099 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.099 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.099 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:49.099 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.272119+0000", 2024-04-19T03:02:49.099 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.010949313 2024-04-19T03:02:49.099 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.099 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.099 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:49.099 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.273678+0000", 2024-04-19T03:02:49.100 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0015581550000000001 2024-04-19T03:02:49.100 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:49.100 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:49.100 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:49.100 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.100 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.100 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87133 5.c 5:3f772a62:::benchmark_data_smithi096_19531_object87132:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:02:49.100 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249657+0000", 2024-04-19T03:02:49.100 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 25.738407516999999, 2024-04-19T03:02:49.100 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0242819409999999, 2024-04-19T03:02:49.100 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:49.100 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-04-19T03:02:49.101 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:49.101 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:49.101 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:49.101 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87133 2024-04-19T03:02:49.101 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.101 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:49.101 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.101 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:49.101 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249657+0000", 2024-04-19T03:02:49.101 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:49.101 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.101 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.102 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:49.102 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249657+0000", 2024-04-19T03:02:49.102 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:49.102 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.102 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.102 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:49.102 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249657+0000", 2024-04-19T03:02:49.102 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:49.102 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.102 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.102 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:49.103 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249690+0000", 2024-04-19T03:02:49.103 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3343000000000002e-05 2024-04-19T03:02:49.103 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.103 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.103 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:49.103 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249695+0000", 2024-04-19T03:02:49.103 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8600000000000001e-06 2024-04-19T03:02:49.103 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.103 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.103 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:49.103 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249698+0000", 2024-04-19T03:02:49.103 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.1700000000000001e-06 2024-04-19T03:02:49.104 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.104 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.104 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:49.104 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249741+0000", 2024-04-19T03:02:49.104 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2849999999999998e-05 2024-04-19T03:02:49.104 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.104 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.104 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:02:49.104 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249746+0000", 2024-04-19T03:02:49.104 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1019999999999996e-06 2024-04-19T03:02:49.104 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.104 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.105 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:49.105 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261209+0000", 2024-04-19T03:02:49.105 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011462447000000001 2024-04-19T03:02:49.105 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.105 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.105 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:02:49.105 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261216+0000", 2024-04-19T03:02:49.105 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8520000000000004e-06 2024-04-19T03:02:49.105 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.105 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.105 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:49.105 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.273872+0000", 2024-04-19T03:02:49.106 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0126558000000001 2024-04-19T03:02:49.106 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.106 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.106 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:49.106 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.273939+0000", 2024-04-19T03:02:49.106 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6822000000000005e-05 2024-04-19T03:02:49.106 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:49.106 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:49.106 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:49.106 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.106 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.107 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87134 5.5 5:a56c478f:::benchmark_data_smithi096_19531_object87133:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:02:49.107 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249708+0000", 2024-04-19T03:02:49.107 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 25.738356592999999, 2024-04-19T03:02:49.107 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0214677299999999, 2024-04-19T03:02:49.107 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:49.107 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-04-19T03:02:49.107 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:49.107 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:49.107 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:49.107 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87134 2024-04-19T03:02:49.107 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.107 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:49.108 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.108 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:49.108 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249708+0000", 2024-04-19T03:02:49.108 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:49.108 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.108 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.108 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:49.108 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249708+0000", 2024-04-19T03:02:49.108 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:49.108 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.108 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.108 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:49.109 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249706+0000", 2024-04-19T03:02:49.109 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999976 2024-04-19T03:02:49.109 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.109 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.109 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:49.109 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249740+0000", 2024-04-19T03:02:49.109 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4458000000000001e-05 2024-04-19T03:02:49.109 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.109 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.109 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:49.109 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249745+0000", 2024-04-19T03:02:49.109 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5020000000000003e-06 2024-04-19T03:02:49.110 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.110 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.110 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:49.110 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249748+0000", 2024-04-19T03:02:49.110 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2499999999999998e-06 2024-04-19T03:02:49.110 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.110 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.110 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:49.110 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249778+0000", 2024-04-19T03:02:49.110 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.006e-05 2024-04-19T03:02:49.111 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.111 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.111 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op must wait for map", 2024-04-19T03:02:49.111 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249782+0000", 2024-04-19T03:02:49.111 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2910000000000001e-06 2024-04-19T03:02:49.111 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.111 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.111 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:49.111 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261666+0000", 2024-04-19T03:02:49.111 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011883471 2024-04-19T03:02:49.111 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.111 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.112 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:02:49.112 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261674+0000", 2024-04-19T03:02:49.112 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6479999999999992e-06 2024-04-19T03:02:49.112 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.112 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.112 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:49.112 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.269323+0000", 2024-04-19T03:02:49.112 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.00764867 2024-04-19T03:02:49.112 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.112 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.112 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:49.112 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.271176+0000", 2024-04-19T03:02:49.113 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001852844 2024-04-19T03:02:49.113 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:49.113 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:49.113 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:49.113 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.113 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.113 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87137 5.c 5:30708c68:::benchmark_data_smithi096_19531_object87136:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:02:49.113 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249756+0000", 2024-04-19T03:02:49.113 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 25.738308886999999, 2024-04-19T03:02:49.114 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.033331752, 2024-04-19T03:02:49.114 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:49.114 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:49.114 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:49.114 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:49.114 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:49.114 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87137 2024-04-19T03:02:49.114 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.114 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:49.114 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.114 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:49.114 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249756+0000", 2024-04-19T03:02:49.115 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:49.115 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.115 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.115 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:49.115 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249756+0000", 2024-04-19T03:02:49.115 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:49.115 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.115 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.115 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:49.115 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249755+0000", 2024-04-19T03:02:49.115 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:49.116 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.116 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.116 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:49.116 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249777+0000", 2024-04-19T03:02:49.116 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1420000000000002e-05 2024-04-19T03:02:49.116 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.116 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.116 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:49.116 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249781+0000", 2024-04-19T03:02:49.116 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0609999999999997e-06 2024-04-19T03:02:49.116 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.116 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.117 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:49.117 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249787+0000", 2024-04-19T03:02:49.117 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.02e-06 2024-04-19T03:02:49.117 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.117 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.117 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:49.117 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249818+0000", 2024-04-19T03:02:49.117 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0947e-05 2024-04-19T03:02:49.117 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.117 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.118 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:02:49.118 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249821+0000", 2024-04-19T03:02:49.118 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.117e-06 2024-04-19T03:02:49.118 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.118 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.118 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:49.118 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261243+0000", 2024-04-19T03:02:49.118 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011421875999999999 2024-04-19T03:02:49.118 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.118 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.118 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:02:49.119 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261251+0000", 2024-04-19T03:02:49.119 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6120000000000001e-06 2024-04-19T03:02:49.119 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.119 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.119 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:49.119 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.274050+0000", 2024-04-19T03:02:49.119 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.012799405 2024-04-19T03:02:49.119 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.119 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.119 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:49.120 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.274529+0000", 2024-04-19T03:02:49.120 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00047867100000000001 2024-04-19T03:02:49.120 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.120 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.120 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:49.120 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.282972+0000", 2024-04-19T03:02:49.120 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0084436900000000002 2024-04-19T03:02:49.120 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.120 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.120 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:49.120 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.283022+0000", 2024-04-19T03:02:49.121 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9339000000000003e-05 2024-04-19T03:02:49.121 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.121 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.121 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:49.121 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.283088+0000", 2024-04-19T03:02:49.121 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5877999999999995e-05 2024-04-19T03:02:49.121 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:49.121 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:49.121 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:49.121 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:49.121 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:49.121 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-04-19T03:02:49.123 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:49.119+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:49.124 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T03:02:49.225 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:49.223+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:49.249 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-19T03:02:49.250 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-04-19T03:02:49.250 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.250 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4755.0:136304 5.9 e53/22 5:9cabc5d2:::benchmark_data_smithi096_19531_object22854:head v 53'8331, mlcod=53'8329)", 2024-04-19T03:02:49.250 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:49.245125+0000", 2024-04-19T03:02:49.250 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0045156299999999996, 2024-04-19T03:02:49.250 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0045411119999999999, 2024-04-19T03:02:49.250 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:49.250 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-19T03:02:49.250 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:49.250 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.250 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:49.250 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:49.245125+0000", 2024-04-19T03:02:49.251 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:49.251 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.251 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.251 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:49.251 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:49.245125+0000", 2024-04-19T03:02:49.251 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:49.251 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.251 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.251 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:49.251 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:49.245124+0000", 2024-04-19T03:02:49.251 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:49.251 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.251 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.252 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:49.252 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:49.245131+0000", 2024-04-19T03:02:49.252 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.8839999999999997e-06 2024-04-19T03:02:49.252 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.252 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.252 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:49.252 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:49.245141+0000", 2024-04-19T03:02:49.252 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0305999999999999e-05 2024-04-19T03:02:49.252 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.252 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.252 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:49.252 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:49.245150+0000", 2024-04-19T03:02:49.252 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1659999999999994e-06 2024-04-19T03:02:49.252 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.253 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.253 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:49.253 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:49.245188+0000", 2024-04-19T03:02:49.253 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8918000000000002e-05 2024-04-19T03:02:49.253 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.253 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.253 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:49.253 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:49.245205+0000", 2024-04-19T03:02:49.253 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6801000000000001e-05 2024-04-19T03:02:49.253 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:49.253 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:49.253 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:49.253 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.254 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.254 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:136307 5.b 5:d8d41679:::benchmark_data_smithi096_19531_object22857:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-19T03:02:49.254 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:49.245125+0000", 2024-04-19T03:02:49.254 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0045155330000000004, 2024-04-19T03:02:49.254 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0046119120000000001, 2024-04-19T03:02:49.254 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:49.254 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-19T03:02:49.254 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:49.254 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:49.254 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:49.254 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 136307 2024-04-19T03:02:49.254 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.254 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:49.255 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.255 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:49.255 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:49.245125+0000", 2024-04-19T03:02:49.255 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:49.255 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.255 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.255 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:49.255 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:49.245125+0000", 2024-04-19T03:02:49.255 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:49.255 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.255 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.255 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:49.255 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:49.245124+0000", 2024-04-19T03:02:49.255 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:49.256 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.256 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.256 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:49.256 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:49.245133+0000", 2024-04-19T03:02:49.256 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.2050000000000008e-06 2024-04-19T03:02:49.256 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.256 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.256 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:49.256 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:49.245142+0000", 2024-04-19T03:02:49.256 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.6449999999999994e-06 2024-04-19T03:02:49.256 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.256 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.256 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:49.257 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:49.245150+0000", 2024-04-19T03:02:49.257 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.4589999999999998e-06 2024-04-19T03:02:49.257 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.257 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.257 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:49.257 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:49.246748+0000", 2024-04-19T03:02:49.257 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0015976289999999999 2024-04-19T03:02:49.257 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.257 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.257 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:49.257 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:49.246900+0000", 2024-04-19T03:02:49.257 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000151939 2024-04-19T03:02:49.258 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:49.258 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:49.258 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:49.258 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.258 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.258 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:136308 5.8 5:1c5ab8cc:::benchmark_data_smithi096_19531_object22858:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-19T03:02:49.258 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:49.245444+0000", 2024-04-19T03:02:49.259 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0041962129999999999, 2024-04-19T03:02:49.259 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0043668530000000004, 2024-04-19T03:02:49.259 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:49.259 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-19T03:02:49.259 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:49.259 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:49.259 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:49.259 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 136308 2024-04-19T03:02:49.259 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.259 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:49.259 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.259 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:49.259 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:49.245444+0000", 2024-04-19T03:02:49.259 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:49.260 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.260 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.260 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:49.260 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:49.245444+0000", 2024-04-19T03:02:49.260 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:49.260 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.260 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.260 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:49.260 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:49.245443+0000", 2024-04-19T03:02:49.260 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:49.260 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.260 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.260 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:49.260 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:49.245449+0000", 2024-04-19T03:02:49.261 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1309999999999997e-06 2024-04-19T03:02:49.261 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.261 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.261 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:49.261 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:49.245460+0000", 2024-04-19T03:02:49.261 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1236000000000001e-05 2024-04-19T03:02:49.261 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.261 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.261 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:49.261 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:49.245466+0000", 2024-04-19T03:02:49.261 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9259999999999997e-06 2024-04-19T03:02:49.261 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.261 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.261 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:49.261 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:49.246171+0000", 2024-04-19T03:02:49.262 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00070566300000000004 2024-04-19T03:02:49.262 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.262 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.262 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:49.262 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:49.246275+0000", 2024-04-19T03:02:49.262 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000103853 2024-04-19T03:02:49.262 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:49.262 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:49.262 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:49.262 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.262 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.262 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:136312 5.b 5:d63fd875:::benchmark_data_smithi096_19531_object22862:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-19T03:02:49.262 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:49.246767+0000", 2024-04-19T03:02:49.262 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0028736130000000001, 2024-04-19T03:02:49.263 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.003113701, 2024-04-19T03:02:49.263 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:49.263 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-19T03:02:49.263 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:49.263 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:49.263 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:49.263 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 136312 2024-04-19T03:02:49.263 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.263 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:49.263 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.263 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:49.263 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:49.246767+0000", 2024-04-19T03:02:49.263 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:49.263 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.264 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.264 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:49.264 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:49.246767+0000", 2024-04-19T03:02:49.264 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:49.264 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.264 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.264 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:49.264 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:49.246766+0000", 2024-04-19T03:02:49.264 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:49.264 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.264 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.264 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:49.264 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:49.246772+0000", 2024-04-19T03:02:49.265 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.404e-06 2024-04-19T03:02:49.265 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.265 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.265 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:49.265 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:49.246785+0000", 2024-04-19T03:02:49.265 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2424e-05 2024-04-19T03:02:49.265 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.265 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.265 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:49.265 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:49.246793+0000", 2024-04-19T03:02:49.265 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.9009999999999994e-06 2024-04-19T03:02:49.265 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.265 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.265 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:49.266 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:49.248890+0000", 2024-04-19T03:02:49.266 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0020977579999999999 2024-04-19T03:02:49.266 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.266 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.266 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:49.266 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:49.248996+0000", 2024-04-19T03:02:49.266 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000105145 2024-04-19T03:02:49.266 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:49.266 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:49.266 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:49.266 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.266 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.266 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4755.0:136310 5.f e53/22 5:fb491553:::benchmark_data_smithi096_19531_object22860:head v 53'8453, mlcod=53'8449)", 2024-04-19T03:02:49.267 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:49.247551+0000", 2024-04-19T03:02:49.267 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.002089498, 2024-04-19T03:02:49.267 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0024012149999999999, 2024-04-19T03:02:49.267 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:49.267 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-19T03:02:49.267 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:49.267 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.267 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:49.267 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:49.247551+0000", 2024-04-19T03:02:49.267 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:49.267 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.267 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.267 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:49.267 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:49.247551+0000", 2024-04-19T03:02:49.268 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:49.268 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.268 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.268 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:49.268 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:49.247550+0000", 2024-04-19T03:02:49.268 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:49.268 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.268 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.268 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:49.268 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:49.247559+0000", 2024-04-19T03:02:49.268 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.0019999999999995e-06 2024-04-19T03:02:49.268 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.268 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.269 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:49.269 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:49.247571+0000", 2024-04-19T03:02:49.269 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2053e-05 2024-04-19T03:02:49.269 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.269 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.269 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:49.269 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:49.247577+0000", 2024-04-19T03:02:49.269 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2299999999999996e-06 2024-04-19T03:02:49.269 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.269 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.269 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:49.269 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:49.247624+0000", 2024-04-19T03:02:49.269 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6684000000000002e-05 2024-04-19T03:02:49.269 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.270 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.270 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:49.270 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:49.247646+0000", 2024-04-19T03:02:49.270 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1968e-05 2024-04-19T03:02:49.270 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:49.270 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:49.270 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:49.270 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.270 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.270 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:136313 5.4 5:292f2082:::benchmark_data_smithi096_19531_object22863:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-19T03:02:49.270 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:49.248956+0000", 2024-04-19T03:02:49.270 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.00068468800000000003, 2024-04-19T03:02:49.271 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001059361, 2024-04-19T03:02:49.271 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:49.271 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-19T03:02:49.271 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:49.271 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:49.271 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:49.271 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 136313 2024-04-19T03:02:49.271 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.271 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:49.271 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.271 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:49.271 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:49.248956+0000", 2024-04-19T03:02:49.271 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:49.271 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.271 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.272 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:49.272 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:49.248956+0000", 2024-04-19T03:02:49.272 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:49.272 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.272 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.272 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:49.272 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:49.248954+0000", 2024-04-19T03:02:49.272 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:49.272 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.272 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.272 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:49.272 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:49.248960+0000", 2024-04-19T03:02:49.272 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8329999999999999e-06 2024-04-19T03:02:49.272 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.273 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.273 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:49.273 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:49.248970+0000", 2024-04-19T03:02:49.273 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.2750000000000001e-06 2024-04-19T03:02:49.273 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.273 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.273 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:49.273 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:49.248977+0000", 2024-04-19T03:02:49.273 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.973e-06 2024-04-19T03:02:49.273 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.273 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.273 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:49.273 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:49.249032+0000", 2024-04-19T03:02:49.273 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5955999999999998e-05 2024-04-19T03:02:49.274 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.274 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.274 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:49.274 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:49.249125+0000", 2024-04-19T03:02:49.274 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.2952e-05 2024-04-19T03:02:49.274 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:49.274 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:49.274 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:49.274 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.274 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.274 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:136315 5.a 5:5df8e149:::benchmark_data_smithi096_19531_object22865:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-19T03:02:49.274 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:49.249115+0000", 2024-04-19T03:02:49.274 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.00052553300000000001, 2024-04-19T03:02:49.274 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000969267, 2024-04-19T03:02:49.275 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:49.275 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-19T03:02:49.275 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:49.275 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:49.275 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:49.275 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 136315 2024-04-19T03:02:49.275 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.275 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:49.275 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.275 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:49.275 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:49.249115+0000", 2024-04-19T03:02:49.275 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:49.275 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.275 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.276 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:49.276 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:49.249115+0000", 2024-04-19T03:02:49.276 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:49.276 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.276 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.276 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:49.276 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:49.249114+0000", 2024-04-19T03:02:49.276 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:49.276 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.276 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.276 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:49.276 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:49.249119+0000", 2024-04-19T03:02:49.276 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8199999999999996e-06 2024-04-19T03:02:49.276 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.277 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.277 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:49.277 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:49.249127+0000", 2024-04-19T03:02:49.277 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1880000000000002e-06 2024-04-19T03:02:49.277 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.277 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.277 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:49.277 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:49.249133+0000", 2024-04-19T03:02:49.277 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8860000000000001e-06 2024-04-19T03:02:49.277 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.277 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.277 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:49.277 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:49.249185+0000", 2024-04-19T03:02:49.277 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1471000000000002e-05 2024-04-19T03:02:49.278 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.278 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.278 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:49.278 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:49.249296+0000", 2024-04-19T03:02:49.278 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011117500000000001 2024-04-19T03:02:49.278 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:49.278 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:49.278 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:49.278 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:49.278 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-04-19T03:02:49.278 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 7 2024-04-19T03:02:49.278 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-19T03:02:49.279 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T03:02:49.324 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:49.321+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:49.412 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-19T03:02:49.412 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-04-19T03:02:49.412 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-04-19T03:02:49.412 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-04-19T03:02:49.412 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-19T03:02:49.426 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T03:02:49.426 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:49.421+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:49.526 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:49.523+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:49.551 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-19T03:02:49.551 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-04-19T03:02:49.551 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-04-19T03:02:49.551 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-04-19T03:02:49.551 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.552 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:79014 5.d 5:b5eee02c:::benchmark_data_smithi096_19531_object79013:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-19T03:02:49.552 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:18.032471+0000", 2024-04-19T03:02:49.552 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 31.516896581000001, 2024-04-19T03:02:49.552 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.041427629000000001, 2024-04-19T03:02:49.552 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:49.552 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:49.552 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:49.552 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:49.552 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:49.552 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 79014 2024-04-19T03:02:49.552 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.552 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:49.552 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.552 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:49.553 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:18.032471+0000", 2024-04-19T03:02:49.553 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:49.553 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.553 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.553 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:49.553 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:18.032471+0000", 2024-04-19T03:02:49.553 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:49.553 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.553 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.553 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:49.553 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:18.032470+0000", 2024-04-19T03:02:49.553 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:49.553 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.553 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.554 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:49.554 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:18.032525+0000", 2024-04-19T03:02:49.554 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5535999999999998e-05 2024-04-19T03:02:49.554 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.554 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.555 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:49.555 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:18.032537+0000", 2024-04-19T03:02:49.555 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1987999999999999e-05 2024-04-19T03:02:49.555 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.555 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.555 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:49.555 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:18.032546+0000", 2024-04-19T03:02:49.555 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9670000000000007e-06 2024-04-19T03:02:49.555 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.555 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.556 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:49.556 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:18.032613+0000", 2024-04-19T03:02:49.556 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6508999999999996e-05 2024-04-19T03:02:49.556 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.556 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.556 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:49.556 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:18.032738+0000", 2024-04-19T03:02:49.556 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000124912 2024-04-19T03:02:49.556 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.556 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.556 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-04-19T03:02:49.556 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:18.032867+0000", 2024-04-19T03:02:49.556 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012959399999999999 2024-04-19T03:02:49.556 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.557 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.557 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:49.557 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:18.035867+0000", 2024-04-19T03:02:49.557 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.002999378 2024-04-19T03:02:49.557 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.557 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.557 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:49.557 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:18.073705+0000", 2024-04-19T03:02:49.557 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.037838042000000002 2024-04-19T03:02:49.557 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.557 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.557 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:49.557 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:18.073813+0000", 2024-04-19T03:02:49.557 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010806099999999999 2024-04-19T03:02:49.558 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.558 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.558 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:49.558 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:18.073899+0000", 2024-04-19T03:02:49.558 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.5971999999999996e-05 2024-04-19T03:02:49.558 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:49.558 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:49.558 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:49.558 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.558 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.558 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:86615 5.e 5:7fef7288:::benchmark_data_smithi096_19531_object86614:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:49.558 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:22.634544+0000", 2024-04-19T03:02:49.559 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 26.914823601999998, 2024-04-19T03:02:49.559 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.192475071, 2024-04-19T03:02:49.559 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:49.559 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:49.559 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:49.559 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:49.559 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:49.559 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 86615 2024-04-19T03:02:49.559 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.559 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:49.559 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.559 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:49.559 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634544+0000", 2024-04-19T03:02:49.559 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:49.560 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.560 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.560 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:49.560 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634544+0000", 2024-04-19T03:02:49.560 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:49.560 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.560 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.560 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:49.560 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634542+0000", 2024-04-19T03:02:49.560 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999981 2024-04-19T03:02:49.560 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.560 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.560 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:49.560 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634585+0000", 2024-04-19T03:02:49.561 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2299000000000003e-05 2024-04-19T03:02:49.561 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.561 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.561 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:49.561 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634592+0000", 2024-04-19T03:02:49.561 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2350000000000002e-06 2024-04-19T03:02:49.561 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.561 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.561 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:49.561 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634596+0000", 2024-04-19T03:02:49.561 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5390000000000001e-06 2024-04-19T03:02:49.561 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.561 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.561 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:49.561 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634639+0000", 2024-04-19T03:02:49.562 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2444999999999998e-05 2024-04-19T03:02:49.562 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.562 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.562 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:49.562 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634808+0000", 2024-04-19T03:02:49.562 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000169152 2024-04-19T03:02:49.562 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.562 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.562 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:49.562 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634999+0000", 2024-04-19T03:02:49.562 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00019098300000000001 2024-04-19T03:02:49.562 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.562 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.563 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:49.563 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.640458+0000", 2024-04-19T03:02:49.563 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0054586870000000003 2024-04-19T03:02:49.563 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.563 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.563 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:49.563 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.826949+0000", 2024-04-19T03:02:49.563 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.18649178299999999 2024-04-19T03:02:49.563 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.563 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.563 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:49.563 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.826982+0000", 2024-04-19T03:02:49.563 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2477000000000001e-05 2024-04-19T03:02:49.563 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.564 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.564 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:49.564 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.827019+0000", 2024-04-19T03:02:49.564 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7355999999999999e-05 2024-04-19T03:02:49.564 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:49.564 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:49.564 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:49.564 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.564 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.564 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:86616 5.e 5:72278f47:::benchmark_data_smithi096_19531_object86615:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:49.564 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:22.634609+0000", 2024-04-19T03:02:49.564 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 26.914758453000001, 2024-04-19T03:02:49.564 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.19472088900000001, 2024-04-19T03:02:49.564 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:49.564 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:49.565 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:49.565 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:49.565 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:49.565 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 86616 2024-04-19T03:02:49.565 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.565 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:49.565 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.565 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:49.565 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634609+0000", 2024-04-19T03:02:49.565 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:49.565 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.565 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.565 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:49.566 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634609+0000", 2024-04-19T03:02:49.566 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:49.566 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.566 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.566 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:49.566 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634609+0000", 2024-04-19T03:02:49.566 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:49.566 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.566 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.566 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:49.566 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634651+0000", 2024-04-19T03:02:49.566 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2589000000000002e-05 2024-04-19T03:02:49.566 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.567 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.567 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:49.567 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634659+0000", 2024-04-19T03:02:49.567 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5850000000000002e-06 2024-04-19T03:02:49.567 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.567 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.567 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:49.567 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634662+0000", 2024-04-19T03:02:49.567 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3620000000000002e-06 2024-04-19T03:02:49.567 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.567 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.567 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:49.567 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.637880+0000", 2024-04-19T03:02:49.567 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.003218149 2024-04-19T03:02:49.568 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.568 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.568 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:49.568 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.637999+0000", 2024-04-19T03:02:49.568 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000118643 2024-04-19T03:02:49.568 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.568 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.568 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:49.568 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.638102+0000", 2024-04-19T03:02:49.568 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010331 2024-04-19T03:02:49.568 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.568 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.568 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:49.568 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.640851+0000", 2024-04-19T03:02:49.569 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0027483310000000001 2024-04-19T03:02:49.569 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.569 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.569 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:49.569 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.829269+0000", 2024-04-19T03:02:49.569 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.188418319 2024-04-19T03:02:49.569 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.569 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.569 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:49.569 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.829299+0000", 2024-04-19T03:02:49.569 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0227e-05 2024-04-19T03:02:49.569 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.569 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.569 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:49.570 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.829330+0000", 2024-04-19T03:02:49.570 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0969000000000001e-05 2024-04-19T03:02:49.570 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:49.570 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:49.570 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:49.570 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.570 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.570 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:86618 5.0 5:09014b90:::benchmark_data_smithi096_19531_object86617:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:49.570 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:22.634894+0000", 2024-04-19T03:02:49.570 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 26.914473964999999, 2024-04-19T03:02:49.570 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.19413419800000001, 2024-04-19T03:02:49.570 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:49.570 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:49.571 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:49.571 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:49.571 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:49.571 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 86618 2024-04-19T03:02:49.571 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.571 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:49.571 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.571 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:49.571 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634894+0000", 2024-04-19T03:02:49.571 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:49.571 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.571 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.571 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:49.572 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634894+0000", 2024-04-19T03:02:49.572 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:49.572 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.572 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.572 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:49.572 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634893+0000", 2024-04-19T03:02:49.572 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:49.572 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.572 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.572 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:49.572 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634976+0000", 2024-04-19T03:02:49.572 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3231000000000003e-05 2024-04-19T03:02:49.572 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.572 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.573 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:49.573 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634983+0000", 2024-04-19T03:02:49.573 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5169999999999996e-06 2024-04-19T03:02:49.573 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.573 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.573 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:49.573 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634987+0000", 2024-04-19T03:02:49.573 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.425e-06 2024-04-19T03:02:49.573 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.573 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.573 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:49.573 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635030+0000", 2024-04-19T03:02:49.573 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.32e-05 2024-04-19T03:02:49.573 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.574 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.574 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:49.574 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635185+0000", 2024-04-19T03:02:49.574 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015471899999999999 2024-04-19T03:02:49.574 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.574 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.574 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:49.574 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635415+0000", 2024-04-19T03:02:49.574 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00023026500000000001 2024-04-19T03:02:49.574 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.574 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.574 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:49.574 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.640127+0000", 2024-04-19T03:02:49.575 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0047118890000000004 2024-04-19T03:02:49.575 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.575 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.575 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:49.575 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.828895+0000", 2024-04-19T03:02:49.575 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.18876802600000001 2024-04-19T03:02:49.575 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.575 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.575 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:49.575 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.828972+0000", 2024-04-19T03:02:49.575 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.6345000000000002e-05 2024-04-19T03:02:49.575 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.575 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.575 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:49.576 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.829028+0000", 2024-04-19T03:02:49.576 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6342999999999999e-05 2024-04-19T03:02:49.576 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:49.576 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:49.576 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:49.576 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.576 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.576 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:86620 5.b 5:d80faa68:::benchmark_data_smithi096_19531_object86619:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:49.576 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:22.635110+0000", 2024-04-19T03:02:49.576 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 26.914257405000001, 2024-04-19T03:02:49.576 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.193447275, 2024-04-19T03:02:49.576 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:49.576 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:49.576 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:49.577 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:49.577 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:49.577 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 86620 2024-04-19T03:02:49.577 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.577 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:49.577 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.577 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:49.577 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635110+0000", 2024-04-19T03:02:49.577 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:49.577 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.577 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.577 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:49.577 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635110+0000", 2024-04-19T03:02:49.577 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:49.578 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.578 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.578 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:49.578 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635110+0000", 2024-04-19T03:02:49.578 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:49.578 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.578 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.578 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:49.578 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635154+0000", 2024-04-19T03:02:49.578 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4681000000000001e-05 2024-04-19T03:02:49.578 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.578 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.579 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:49.579 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635166+0000", 2024-04-19T03:02:49.579 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1505000000000001e-05 2024-04-19T03:02:49.579 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.579 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.579 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:49.579 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635171+0000", 2024-04-19T03:02:49.579 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6040000000000003e-06 2024-04-19T03:02:49.579 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.579 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.579 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:49.579 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635221+0000", 2024-04-19T03:02:49.579 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9947000000000001e-05 2024-04-19T03:02:49.579 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.580 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.580 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:49.580 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635356+0000", 2024-04-19T03:02:49.580 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013576199999999999 2024-04-19T03:02:49.580 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.580 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.580 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:49.580 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635507+0000", 2024-04-19T03:02:49.580 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015072999999999999 2024-04-19T03:02:49.580 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.580 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.580 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:49.580 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.638488+0000", 2024-04-19T03:02:49.581 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0029813159999999999 2024-04-19T03:02:49.581 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.581 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.581 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:49.581 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.828341+0000", 2024-04-19T03:02:49.581 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.189852254 2024-04-19T03:02:49.581 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.581 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.581 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:49.581 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.828416+0000", 2024-04-19T03:02:49.581 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5344000000000002e-05 2024-04-19T03:02:49.581 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.581 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.581 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:49.582 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.828558+0000", 2024-04-19T03:02:49.582 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000141695 2024-04-19T03:02:49.582 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:49.582 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:49.582 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:49.582 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.582 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.582 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:86621 5.8 5:1597a420:::benchmark_data_smithi096_19531_object86620:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:49.582 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:22.635187+0000", 2024-04-19T03:02:49.582 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 26.914180545000001, 2024-04-19T03:02:49.582 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.194204878, 2024-04-19T03:02:49.582 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:49.583 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:49.583 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:49.583 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:49.583 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:49.583 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 86621 2024-04-19T03:02:49.583 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.583 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:49.583 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.583 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:49.583 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635187+0000", 2024-04-19T03:02:49.583 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:49.583 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.583 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.583 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:49.584 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635187+0000", 2024-04-19T03:02:49.584 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:49.584 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.584 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.584 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:49.584 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635187+0000", 2024-04-19T03:02:49.584 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:49.584 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.584 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.584 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:49.584 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635242+0000", 2024-04-19T03:02:49.584 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5158000000000003e-05 2024-04-19T03:02:49.584 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.584 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.585 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:49.585 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635249+0000", 2024-04-19T03:02:49.585 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.7000000000000008e-06 2024-04-19T03:02:49.585 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.585 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.585 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:49.585 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635256+0000", 2024-04-19T03:02:49.585 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2060000000000004e-06 2024-04-19T03:02:49.585 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.585 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.585 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:49.585 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635302+0000", 2024-04-19T03:02:49.585 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5954000000000001e-05 2024-04-19T03:02:49.585 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.586 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.586 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:49.586 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635427+0000", 2024-04-19T03:02:49.586 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012559299999999999 2024-04-19T03:02:49.586 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.586 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.586 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:49.586 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635596+0000", 2024-04-19T03:02:49.586 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000168615 2024-04-19T03:02:49.586 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.586 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.586 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:49.586 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.639320+0000", 2024-04-19T03:02:49.587 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0037244610000000001 2024-04-19T03:02:49.587 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.587 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.587 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:49.587 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.829277+0000", 2024-04-19T03:02:49.587 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.18995651099999999 2024-04-19T03:02:49.587 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.587 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.587 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:49.587 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.829341+0000", 2024-04-19T03:02:49.587 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3756000000000004e-05 2024-04-19T03:02:49.587 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.587 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.588 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:49.588 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.829392+0000", 2024-04-19T03:02:49.588 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1555999999999999e-05 2024-04-19T03:02:49.588 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:49.588 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:49.588 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:49.588 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.588 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.588 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87062 5.4 5:2d3b5d9a:::benchmark_data_smithi096_19531_object87061:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:49.588 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.136820+0000", 2024-04-19T03:02:49.588 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 26.412547392, 2024-04-19T03:02:49.588 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.066483741999999998, 2024-04-19T03:02:49.588 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:49.589 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:49.589 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:49.589 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:49.589 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:49.589 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87062 2024-04-19T03:02:49.589 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.589 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:49.589 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.589 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:49.589 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.136820+0000", 2024-04-19T03:02:49.589 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:49.589 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.589 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.589 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:49.590 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.136820+0000", 2024-04-19T03:02:49.590 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:49.590 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.590 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.590 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:49.590 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.136819+0000", 2024-04-19T03:02:49.590 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:49.590 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.590 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.590 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:49.590 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.136864+0000", 2024-04-19T03:02:49.590 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4855000000000003e-05 2024-04-19T03:02:49.590 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.591 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.591 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:49.591 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.136881+0000", 2024-04-19T03:02:49.591 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7521999999999999e-05 2024-04-19T03:02:49.591 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.591 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.591 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:49.591 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.136890+0000", 2024-04-19T03:02:49.591 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1039999999999996e-06 2024-04-19T03:02:49.591 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.591 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.591 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:49.591 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.136974+0000", 2024-04-19T03:02:49.591 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3735999999999999e-05 2024-04-19T03:02:49.592 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.592 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.592 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:49.592 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.137308+0000", 2024-04-19T03:02:49.592 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00033376100000000002 2024-04-19T03:02:49.592 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.592 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.592 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:49.592 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.137559+0000", 2024-04-19T03:02:49.592 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000250599 2024-04-19T03:02:49.592 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.592 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.592 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:49.592 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.145423+0000", 2024-04-19T03:02:49.593 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0078649589999999995 2024-04-19T03:02:49.593 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.593 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.593 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:49.593 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.203175+0000", 2024-04-19T03:02:49.593 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057751255000000001 2024-04-19T03:02:49.593 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.593 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.593 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:49.593 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.203250+0000", 2024-04-19T03:02:49.593 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5378999999999998e-05 2024-04-19T03:02:49.593 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.593 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.594 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:49.594 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.203304+0000", 2024-04-19T03:02:49.594 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4015999999999999e-05 2024-04-19T03:02:49.594 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:49.594 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:49.594 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:49.594 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.594 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.594 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87065 5.4 5:21d20a47:::benchmark_data_smithi096_19531_object87064:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:49.594 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.137482+0000", 2024-04-19T03:02:49.594 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 26.411885657999999, 2024-04-19T03:02:49.594 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.065988749999999999, 2024-04-19T03:02:49.594 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:49.595 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:49.595 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:49.595 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:49.595 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:49.595 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87065 2024-04-19T03:02:49.595 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.595 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:49.595 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.595 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:49.595 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.137482+0000", 2024-04-19T03:02:49.595 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:49.595 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.595 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.596 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:49.596 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.137482+0000", 2024-04-19T03:02:49.596 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:49.596 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.596 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.596 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:49.596 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.137481+0000", 2024-04-19T03:02:49.596 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:49.596 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.596 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.596 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:49.596 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.137530+0000", 2024-04-19T03:02:49.596 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9302000000000003e-05 2024-04-19T03:02:49.597 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.597 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.597 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:49.597 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.137540+0000", 2024-04-19T03:02:49.597 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.2010000000000005e-06 2024-04-19T03:02:49.597 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.597 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.597 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:49.597 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.137545+0000", 2024-04-19T03:02:49.597 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5910000000000003e-06 2024-04-19T03:02:49.597 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.597 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.597 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:49.597 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.140666+0000", 2024-04-19T03:02:49.598 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0031212710000000001 2024-04-19T03:02:49.598 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.598 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.598 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:49.598 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.140847+0000", 2024-04-19T03:02:49.598 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00018065600000000001 2024-04-19T03:02:49.598 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.598 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.598 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:49.598 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.140991+0000", 2024-04-19T03:02:49.598 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014433100000000001 2024-04-19T03:02:49.598 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.598 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.599 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:49.599 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.148053+0000", 2024-04-19T03:02:49.599 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.007061945 2024-04-19T03:02:49.599 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.599 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.599 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:49.599 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.203367+0000", 2024-04-19T03:02:49.599 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.055313703999999998 2024-04-19T03:02:49.599 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.599 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.599 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:49.599 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.203426+0000", 2024-04-19T03:02:49.599 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9024000000000003e-05 2024-04-19T03:02:49.600 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.600 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.600 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:49.600 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.203471+0000", 2024-04-19T03:02:49.600 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4818999999999999e-05 2024-04-19T03:02:49.600 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:49.600 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:49.600 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:49.600 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.600 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.600 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87067 5.b 5:d57af71a:::benchmark_data_smithi096_19531_object87066:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:49.600 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.142233+0000", 2024-04-19T03:02:49.600 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 26.407134681999999, 2024-04-19T03:02:49.600 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.071692405000000001, 2024-04-19T03:02:49.601 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:49.601 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:49.601 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:49.601 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:49.601 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:49.601 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87067 2024-04-19T03:02:49.601 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.601 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:49.601 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.601 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:49.601 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142233+0000", 2024-04-19T03:02:49.601 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:49.601 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.602 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.602 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:49.602 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142233+0000", 2024-04-19T03:02:49.602 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:49.602 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.602 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.602 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:49.602 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142232+0000", 2024-04-19T03:02:49.602 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:49.602 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.602 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.602 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:49.602 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142277+0000", 2024-04-19T03:02:49.603 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5837000000000002e-05 2024-04-19T03:02:49.603 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.603 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.603 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:49.603 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142297+0000", 2024-04-19T03:02:49.603 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9561000000000001e-05 2024-04-19T03:02:49.603 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.603 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.603 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:49.603 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142311+0000", 2024-04-19T03:02:49.603 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3654e-05 2024-04-19T03:02:49.603 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.603 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.603 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:49.604 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142391+0000", 2024-04-19T03:02:49.604 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0123999999999994e-05 2024-04-19T03:02:49.604 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.604 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.604 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:49.604 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142669+0000", 2024-04-19T03:02:49.604 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00027829800000000001 2024-04-19T03:02:49.604 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.604 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.604 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:49.604 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142859+0000", 2024-04-19T03:02:49.604 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000190051 2024-04-19T03:02:49.604 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.604 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.604 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:49.605 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.150597+0000", 2024-04-19T03:02:49.605 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0077380299999999999 2024-04-19T03:02:49.605 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.605 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.605 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:49.605 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.213855+0000", 2024-04-19T03:02:49.605 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.063257987000000002 2024-04-19T03:02:49.605 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.605 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.605 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:49.605 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.213898+0000", 2024-04-19T03:02:49.605 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2916e-05 2024-04-19T03:02:49.605 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.606 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.606 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:49.606 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.213925+0000", 2024-04-19T03:02:49.606 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7503000000000001e-05 2024-04-19T03:02:49.606 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:49.606 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:49.606 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:49.606 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.606 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.606 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87069 5.b 5:da0c93b5:::benchmark_data_smithi096_19531_object87068:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:49.606 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.143402+0000", 2024-04-19T03:02:49.606 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 26.405965720000001, 2024-04-19T03:02:49.606 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.070678598999999995, 2024-04-19T03:02:49.606 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:49.607 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:49.607 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:49.607 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:49.607 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:49.607 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87069 2024-04-19T03:02:49.607 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.607 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:49.607 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.607 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:49.607 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.143402+0000", 2024-04-19T03:02:49.607 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:49.607 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.607 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.607 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:49.608 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.143402+0000", 2024-04-19T03:02:49.608 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:49.608 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.608 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.608 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:49.608 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.143401+0000", 2024-04-19T03:02:49.608 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:49.608 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.608 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.608 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:49.608 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.143501+0000", 2024-04-19T03:02:49.608 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000100387 2024-04-19T03:02:49.608 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.608 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.609 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:49.609 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.143516+0000", 2024-04-19T03:02:49.609 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5369000000000001e-05 2024-04-19T03:02:49.609 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.609 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.609 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:49.609 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.143524+0000", 2024-04-19T03:02:49.609 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.7079999999999997e-06 2024-04-19T03:02:49.609 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.609 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.609 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:49.609 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.145550+0000", 2024-04-19T03:02:49.609 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0020259290000000001 2024-04-19T03:02:49.609 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.610 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.610 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:49.610 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.145676+0000", 2024-04-19T03:02:49.610 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000126406 2024-04-19T03:02:49.610 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.610 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.610 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:49.610 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.145802+0000", 2024-04-19T03:02:49.610 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000125974 2024-04-19T03:02:49.610 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.610 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.610 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:49.610 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.151030+0000", 2024-04-19T03:02:49.610 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0052276079999999999 2024-04-19T03:02:49.611 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.611 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.611 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:49.611 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.213998+0000", 2024-04-19T03:02:49.611 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.06296786 2024-04-19T03:02:49.611 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.611 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.611 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:49.611 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.214031+0000", 2024-04-19T03:02:49.611 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3387999999999999e-05 2024-04-19T03:02:49.611 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.611 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.611 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:49.611 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.214081+0000", 2024-04-19T03:02:49.612 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9316e-05 2024-04-19T03:02:49.612 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:49.612 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:49.612 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:49.612 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.612 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.612 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87073 5.0 5:0ca21233:::benchmark_data_smithi096_19531_object87072:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:49.612 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.145929+0000", 2024-04-19T03:02:49.612 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 26.40343846, 2024-04-19T03:02:49.612 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.062283234999999999, 2024-04-19T03:02:49.612 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:49.612 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:49.612 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:49.612 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:49.613 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:49.613 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87073 2024-04-19T03:02:49.613 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.613 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:49.613 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.613 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:49.613 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.145929+0000", 2024-04-19T03:02:49.613 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:49.613 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.613 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.613 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:49.613 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.145929+0000", 2024-04-19T03:02:49.613 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:49.614 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.614 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.614 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:49.614 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.145928+0000", 2024-04-19T03:02:49.614 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:49.614 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.614 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.614 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:49.614 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.146063+0000", 2024-04-19T03:02:49.614 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013541099999999999 2024-04-19T03:02:49.614 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.614 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.614 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:49.615 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.146079+0000", 2024-04-19T03:02:49.615 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5902000000000001e-05 2024-04-19T03:02:49.615 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.615 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.615 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:49.615 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.146100+0000", 2024-04-19T03:02:49.615 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0380000000000001e-05 2024-04-19T03:02:49.615 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.615 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.615 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:49.615 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.146193+0000", 2024-04-19T03:02:49.615 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.3669000000000001e-05 2024-04-19T03:02:49.615 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.616 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.616 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:49.616 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.146388+0000", 2024-04-19T03:02:49.616 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00019457799999999999 2024-04-19T03:02:49.616 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.616 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.616 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:49.616 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.146625+0000", 2024-04-19T03:02:49.616 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00023751999999999999 2024-04-19T03:02:49.616 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.616 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.616 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:49.616 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.151051+0000", 2024-04-19T03:02:49.616 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0044260039999999999 2024-04-19T03:02:49.617 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.617 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.617 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:49.617 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.207872+0000", 2024-04-19T03:02:49.617 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.056821114999999998 2024-04-19T03:02:49.617 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.617 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.617 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:49.617 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.208085+0000", 2024-04-19T03:02:49.617 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000212893 2024-04-19T03:02:49.617 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.617 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.617 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:49.618 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.208213+0000", 2024-04-19T03:02:49.618 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012714700000000001 2024-04-19T03:02:49.618 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:49.618 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:49.618 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:49.618 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.618 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.618 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87074 5.0 5:035614ac:::benchmark_data_smithi096_19531_object87073:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:49.618 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.151387+0000", 2024-04-19T03:02:49.618 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 26.397980529000002, 2024-04-19T03:02:49.618 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.063461771, 2024-04-19T03:02:49.618 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:49.618 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:49.618 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:49.619 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:49.619 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:49.619 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87074 2024-04-19T03:02:49.619 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.619 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:49.619 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.619 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:49.619 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.151387+0000", 2024-04-19T03:02:49.619 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:49.619 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.619 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.619 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:49.619 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.151387+0000", 2024-04-19T03:02:49.620 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:49.620 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.620 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.620 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:49.620 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.151386+0000", 2024-04-19T03:02:49.620 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:49.620 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.620 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.620 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:49.620 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.151428+0000", 2024-04-19T03:02:49.620 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.172e-05 2024-04-19T03:02:49.620 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.620 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.620 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:49.621 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.151442+0000", 2024-04-19T03:02:49.621 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4328000000000001e-05 2024-04-19T03:02:49.621 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.621 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.621 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:49.621 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.151451+0000", 2024-04-19T03:02:49.621 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.8400000000000001e-06 2024-04-19T03:02:49.621 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.621 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.621 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:49.621 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.151521+0000", 2024-04-19T03:02:49.621 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.9606999999999999e-05 2024-04-19T03:02:49.621 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.621 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.622 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:49.622 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.151749+0000", 2024-04-19T03:02:49.622 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00022818799999999999 2024-04-19T03:02:49.622 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.622 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.622 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:49.622 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.152006+0000", 2024-04-19T03:02:49.622 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00025687300000000002 2024-04-19T03:02:49.622 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.622 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.622 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:49.622 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.154887+0000", 2024-04-19T03:02:49.622 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0028812989999999999 2024-04-19T03:02:49.623 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.623 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.623 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:49.623 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.214733+0000", 2024-04-19T03:02:49.623 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.059846159000000003 2024-04-19T03:02:49.623 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.623 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.623 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:49.623 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.214788+0000", 2024-04-19T03:02:49.623 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4524000000000002e-05 2024-04-19T03:02:49.623 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.623 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.623 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:49.623 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.214849+0000", 2024-04-19T03:02:49.624 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1362e-05 2024-04-19T03:02:49.624 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:49.624 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:49.624 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:49.624 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.624 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.624 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87108 5.e 5:7e197adc:::benchmark_data_smithi096_19531_object87107:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:49.624 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.223103+0000", 2024-04-19T03:02:49.624 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 26.326264383000002, 2024-04-19T03:02:49.624 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.044946887, 2024-04-19T03:02:49.624 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:49.624 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-19T03:02:49.624 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:49.625 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:49.625 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:49.625 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87108 2024-04-19T03:02:49.625 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.625 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:49.625 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.625 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:49.625 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.223103+0000", 2024-04-19T03:02:49.625 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:49.625 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.625 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.625 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:49.625 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.223103+0000", 2024-04-19T03:02:49.625 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:49.626 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.626 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.626 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:49.626 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.223102+0000", 2024-04-19T03:02:49.626 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:49.626 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.626 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.626 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:49.626 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.223156+0000", 2024-04-19T03:02:49.626 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3958000000000001e-05 2024-04-19T03:02:49.626 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.626 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.626 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:49.627 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.223166+0000", 2024-04-19T03:02:49.627 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.4809999999999995e-06 2024-04-19T03:02:49.627 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.627 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.627 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:49.627 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.223172+0000", 2024-04-19T03:02:49.627 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0140000000000004e-06 2024-04-19T03:02:49.627 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.627 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.627 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:49.627 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.227295+0000", 2024-04-19T03:02:49.627 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0041233420000000003 2024-04-19T03:02:49.627 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.627 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.628 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:49.628 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.227495+0000", 2024-04-19T03:02:49.628 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00019955299999999999 2024-04-19T03:02:49.628 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.628 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.628 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:49.628 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.227717+0000", 2024-04-19T03:02:49.628 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000221902 2024-04-19T03:02:49.628 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.628 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.628 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:49.628 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233189+0000", 2024-04-19T03:02:49.628 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0054718889999999997 2024-04-19T03:02:49.628 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.629 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.629 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:49.629 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.250529+0000", 2024-04-19T03:02:49.629 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.017340298000000001 2024-04-19T03:02:49.629 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.629 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.629 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:02:49.629 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.250539+0000", 2024-04-19T03:02:49.629 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0501e-05 2024-04-19T03:02:49.629 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.629 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.629 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:49.629 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.268003+0000", 2024-04-19T03:02:49.630 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.017463429 2024-04-19T03:02:49.630 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.630 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.630 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:49.630 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.268050+0000", 2024-04-19T03:02:49.630 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7466000000000003e-05 2024-04-19T03:02:49.630 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:49.630 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:49.630 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:49.630 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.630 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.630 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87118 5.b 5:d1bb4f3c:::benchmark_data_smithi096_19531_object87117:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:49.630 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.231082+0000", 2024-04-19T03:02:49.630 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 26.318285548999999, 2024-04-19T03:02:49.631 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.035789004, 2024-04-19T03:02:49.631 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:49.631 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-19T03:02:49.631 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:49.631 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:49.631 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:49.631 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87118 2024-04-19T03:02:49.631 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.631 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:49.631 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.631 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:49.631 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231082+0000", 2024-04-19T03:02:49.631 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:49.631 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.632 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.632 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:49.632 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231082+0000", 2024-04-19T03:02:49.632 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:49.632 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.632 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.632 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:49.632 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231081+0000", 2024-04-19T03:02:49.632 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:49.632 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.632 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.632 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:49.632 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231159+0000", 2024-04-19T03:02:49.633 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.7819999999999997e-05 2024-04-19T03:02:49.633 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.633 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.633 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:49.633 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231186+0000", 2024-04-19T03:02:49.633 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7126000000000001e-05 2024-04-19T03:02:49.633 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.633 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.633 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:49.633 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231193+0000", 2024-04-19T03:02:49.633 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7259999999999996e-06 2024-04-19T03:02:49.633 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.633 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.633 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:49.633 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231241+0000", 2024-04-19T03:02:49.634 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8123e-05 2024-04-19T03:02:49.634 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.634 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.634 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:49.634 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231354+0000", 2024-04-19T03:02:49.634 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0001133 2024-04-19T03:02:49.634 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.634 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.634 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:49.634 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231443+0000", 2024-04-19T03:02:49.634 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9167999999999997e-05 2024-04-19T03:02:49.634 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.634 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.635 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:49.635 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236498+0000", 2024-04-19T03:02:49.635 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0050545160000000002 2024-04-19T03:02:49.635 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.635 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.635 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:49.635 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.249681+0000", 2024-04-19T03:02:49.635 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013183321 2024-04-19T03:02:49.635 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.635 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.635 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:02:49.635 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.249693+0000", 2024-04-19T03:02:49.635 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1834999999999999e-05 2024-04-19T03:02:49.635 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.636 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.636 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:49.636 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266733+0000", 2024-04-19T03:02:49.636 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.017040408 2024-04-19T03:02:49.636 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.636 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.636 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:49.636 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266871+0000", 2024-04-19T03:02:49.636 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000137849 2024-04-19T03:02:49.636 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:49.636 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:49.636 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:49.636 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.636 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.637 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87121 5.b 5:d01822b8:::benchmark_data_smithi096_19531_object87120:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:49.637 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.233319+0000", 2024-04-19T03:02:49.637 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 26.316048684999998, 2024-04-19T03:02:49.637 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.033624198, 2024-04-19T03:02:49.637 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:49.637 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-19T03:02:49.637 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:49.637 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:49.637 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:49.637 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87121 2024-04-19T03:02:49.637 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.637 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:49.637 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.638 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:49.638 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233319+0000", 2024-04-19T03:02:49.638 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:49.638 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.638 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.638 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:49.638 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233319+0000", 2024-04-19T03:02:49.638 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:49.638 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.638 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.638 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:49.638 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233319+0000", 2024-04-19T03:02:49.638 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:49.638 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.639 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.639 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:49.639 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233364+0000", 2024-04-19T03:02:49.639 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5460999999999997e-05 2024-04-19T03:02:49.639 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.639 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.639 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:49.639 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233382+0000", 2024-04-19T03:02:49.639 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8148e-05 2024-04-19T03:02:49.639 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.639 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.639 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:49.639 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233390+0000", 2024-04-19T03:02:49.639 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5340000000000002e-06 2024-04-19T03:02:49.640 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.640 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.640 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:49.640 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233712+0000", 2024-04-19T03:02:49.640 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00032260500000000001 2024-04-19T03:02:49.640 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.640 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.640 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:49.640 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233829+0000", 2024-04-19T03:02:49.640 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011638599999999999 2024-04-19T03:02:49.640 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.640 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.640 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:49.641 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233959+0000", 2024-04-19T03:02:49.641 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013013900000000001 2024-04-19T03:02:49.641 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.641 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.641 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:49.641 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236515+0000", 2024-04-19T03:02:49.641 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0025562750000000002 2024-04-19T03:02:49.641 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.641 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.641 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:49.641 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.249723+0000", 2024-04-19T03:02:49.641 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013208176 2024-04-19T03:02:49.641 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.641 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.642 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:02:49.642 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.249728+0000", 2024-04-19T03:02:49.642 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6519999999999997e-06 2024-04-19T03:02:49.642 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.642 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.642 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:49.642 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266837+0000", 2024-04-19T03:02:49.642 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0171087059999999 2024-04-19T03:02:49.642 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.642 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.642 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:49.642 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266943+0000", 2024-04-19T03:02:49.642 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000106604 2024-04-19T03:02:49.643 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:49.643 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:49.643 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:49.643 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.643 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.643 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87124 5.8 5:14819ad7:::benchmark_data_smithi096_19531_object87123:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:49.643 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.235886+0000", 2024-04-19T03:02:49.643 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 26.313481261, 2024-04-19T03:02:49.643 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0315451179999999, 2024-04-19T03:02:49.643 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:49.643 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-19T03:02:49.643 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:49.643 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:49.643 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:49.643 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87124 2024-04-19T03:02:49.644 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.644 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:49.644 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.644 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:49.644 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.235886+0000", 2024-04-19T03:02:49.644 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:49.644 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.644 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.644 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:49.644 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.235886+0000", 2024-04-19T03:02:49.644 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:49.644 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.644 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.644 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:49.645 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.235886+0000", 2024-04-19T03:02:49.645 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:49.645 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.645 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.645 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:49.645 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.235934+0000", 2024-04-19T03:02:49.645 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8384000000000003e-05 2024-04-19T03:02:49.645 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.645 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.645 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:49.645 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.235945+0000", 2024-04-19T03:02:49.645 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0671e-05 2024-04-19T03:02:49.645 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.645 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.646 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:49.646 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.235952+0000", 2024-04-19T03:02:49.646 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3089999999999998e-06 2024-04-19T03:02:49.646 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.646 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.646 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:49.646 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.237067+0000", 2024-04-19T03:02:49.646 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001115263 2024-04-19T03:02:49.646 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.646 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.646 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:49.646 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.237188+0000", 2024-04-19T03:02:49.646 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000121258 2024-04-19T03:02:49.646 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.647 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.647 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:49.647 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.237316+0000", 2024-04-19T03:02:49.647 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000128071 2024-04-19T03:02:49.647 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.647 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.647 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:49.647 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240744+0000", 2024-04-19T03:02:49.647 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0034275629999999998 2024-04-19T03:02:49.647 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.647 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.647 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:49.647 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.252517+0000", 2024-04-19T03:02:49.648 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011772991999999999 2024-04-19T03:02:49.648 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.648 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.648 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:02:49.648 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.252523+0000", 2024-04-19T03:02:49.648 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3640000000000004e-06 2024-04-19T03:02:49.648 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.648 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.648 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:49.648 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.267290+0000", 2024-04-19T03:02:49.648 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0147665690000001 2024-04-19T03:02:49.648 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.648 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.649 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:49.649 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.267432+0000", 2024-04-19T03:02:49.649 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014165299999999999 2024-04-19T03:02:49.649 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:49.649 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:49.649 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:49.649 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.649 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.649 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87129 5.0 5:02667e01:::benchmark_data_smithi096_19531_object87128:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:49.649 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.236466+0000", 2024-04-19T03:02:49.649 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 26.312901265000001, 2024-04-19T03:02:49.649 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0301534510000001, 2024-04-19T03:02:49.649 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:49.649 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-19T03:02:49.650 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:49.650 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:49.650 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:49.650 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87129 2024-04-19T03:02:49.650 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.650 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:49.650 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.650 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:49.650 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236466+0000", 2024-04-19T03:02:49.650 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:49.650 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.650 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.650 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:49.651 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236466+0000", 2024-04-19T03:02:49.651 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:49.651 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.651 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.651 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:49.651 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236465+0000", 2024-04-19T03:02:49.651 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:49.651 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.651 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.651 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:49.651 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236566+0000", 2024-04-19T03:02:49.651 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010047000000000001 2024-04-19T03:02:49.651 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.651 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.652 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:49.652 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236577+0000", 2024-04-19T03:02:49.652 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1772e-05 2024-04-19T03:02:49.652 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.652 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.652 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:49.652 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236584+0000", 2024-04-19T03:02:49.652 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0530000000000003e-06 2024-04-19T03:02:49.652 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.652 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.652 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:49.652 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.237023+0000", 2024-04-19T03:02:49.652 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000439703 2024-04-19T03:02:49.652 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.653 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.653 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:49.653 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.237207+0000", 2024-04-19T03:02:49.653 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000183692 2024-04-19T03:02:49.653 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.653 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.653 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:49.653 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.237373+0000", 2024-04-19T03:02:49.653 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016623500000000001 2024-04-19T03:02:49.653 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.653 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.653 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:49.653 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.241461+0000", 2024-04-19T03:02:49.654 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0040883050000000004 2024-04-19T03:02:49.654 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.654 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.654 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:49.654 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.252500+0000", 2024-04-19T03:02:49.654 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011038450999999999 2024-04-19T03:02:49.654 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.654 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.654 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:02:49.654 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.252507+0000", 2024-04-19T03:02:49.654 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2439999999999996e-06 2024-04-19T03:02:49.654 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.654 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.655 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:49.655 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266538+0000", 2024-04-19T03:02:49.655 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.014031184 2024-04-19T03:02:49.655 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.655 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.655 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:49.655 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266620+0000", 2024-04-19T03:02:49.655 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1600000000000005e-05 2024-04-19T03:02:49.655 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:49.655 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:49.655 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:49.655 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.655 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.655 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87135 5.4 5:2a97e7b7:::benchmark_data_smithi096_19531_object87134:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:49.656 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.240884+0000", 2024-04-19T03:02:49.656 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 26.308483807999998, 2024-04-19T03:02:49.656 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.025708931, 2024-04-19T03:02:49.656 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:49.656 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-19T03:02:49.656 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:49.656 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:49.656 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:49.656 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87135 2024-04-19T03:02:49.656 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.656 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:49.656 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.656 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:49.657 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240884+0000", 2024-04-19T03:02:49.657 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:49.657 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.657 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.657 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:49.657 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240884+0000", 2024-04-19T03:02:49.657 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:49.657 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.657 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.657 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:49.657 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240883+0000", 2024-04-19T03:02:49.657 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:49.657 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.657 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.658 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:49.658 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240933+0000", 2024-04-19T03:02:49.658 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9969999999999998e-05 2024-04-19T03:02:49.658 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.658 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.658 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:49.658 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240946+0000", 2024-04-19T03:02:49.658 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2943e-05 2024-04-19T03:02:49.658 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.658 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.658 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:49.658 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240952+0000", 2024-04-19T03:02:49.658 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8930000000000002e-06 2024-04-19T03:02:49.659 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.659 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.659 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:49.659 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240994+0000", 2024-04-19T03:02:49.659 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2753999999999998e-05 2024-04-19T03:02:49.659 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.659 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.659 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:49.659 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.241092+0000", 2024-04-19T03:02:49.659 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.7447000000000004e-05 2024-04-19T03:02:49.659 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.659 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.659 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:49.660 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.241183+0000", 2024-04-19T03:02:49.660 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1163999999999997e-05 2024-04-19T03:02:49.660 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.660 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.660 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:49.660 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.254672+0000", 2024-04-19T03:02:49.660 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.01348864 2024-04-19T03:02:49.660 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.660 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.660 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:02:49.660 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.254681+0000", 2024-04-19T03:02:49.660 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.3789999999999995e-06 2024-04-19T03:02:49.660 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.660 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.661 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:49.661 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266456+0000", 2024-04-19T03:02:49.661 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.011774621 2024-04-19T03:02:49.661 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.661 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.661 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:49.661 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266593+0000", 2024-04-19T03:02:49.661 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013737600000000001 2024-04-19T03:02:49.661 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:49.661 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:49.661 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:49.661 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.661 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.661 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87136 5.4 5:212411bc:::benchmark_data_smithi096_19531_object87135:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:49.662 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.240962+0000", 2024-04-19T03:02:49.662 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 26.308405931999999, 2024-04-19T03:02:49.662 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.025738, 2024-04-19T03:02:49.662 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:49.662 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-19T03:02:49.662 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:49.662 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:49.662 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:49.662 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87136 2024-04-19T03:02:49.662 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.662 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:49.662 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.662 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:49.663 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240962+0000", 2024-04-19T03:02:49.663 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:49.663 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.663 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.663 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:49.663 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240962+0000", 2024-04-19T03:02:49.663 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:49.663 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.663 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.663 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:49.663 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240961+0000", 2024-04-19T03:02:49.663 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:49.663 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.664 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.664 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:49.664 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240995+0000", 2024-04-19T03:02:49.664 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3868000000000002e-05 2024-04-19T03:02:49.664 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.664 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.664 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:49.664 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.241001+0000", 2024-04-19T03:02:49.664 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.322e-06 2024-04-19T03:02:49.664 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.664 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.664 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:49.664 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.241004+0000", 2024-04-19T03:02:49.664 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3510000000000002e-06 2024-04-19T03:02:49.665 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.665 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.665 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:49.665 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247131+0000", 2024-04-19T03:02:49.665 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0061270869999999998 2024-04-19T03:02:49.665 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.665 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.665 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:49.665 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247322+0000", 2024-04-19T03:02:49.665 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000191015 2024-04-19T03:02:49.665 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.665 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.665 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:49.665 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247542+0000", 2024-04-19T03:02:49.666 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00022030199999999999 2024-04-19T03:02:49.666 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.666 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.666 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:49.666 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.254709+0000", 2024-04-19T03:02:49.666 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0071662660000000001 2024-04-19T03:02:49.666 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.666 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.666 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:02:49.666 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.254716+0000", 2024-04-19T03:02:49.666 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3860000000000001e-06 2024-04-19T03:02:49.666 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.666 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.667 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:49.667 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266619+0000", 2024-04-19T03:02:49.667 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0119031030000001 2024-04-19T03:02:49.667 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.667 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.667 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:49.667 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266700+0000", 2024-04-19T03:02:49.667 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0764000000000001e-05 2024-04-19T03:02:49.667 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:49.667 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:49.667 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:49.667 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.667 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.668 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87138 5.e 5:7b1f1c20:::benchmark_data_smithi096_19531_object87137:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:49.668 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.247862+0000", 2024-04-19T03:02:49.668 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 26.301505857999999, 2024-04-19T03:02:49.668 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.024457079, 2024-04-19T03:02:49.668 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:49.668 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:49.668 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:49.668 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:49.668 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:49.668 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87138 2024-04-19T03:02:49.668 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.668 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:49.668 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.669 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:49.669 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247862+0000", 2024-04-19T03:02:49.669 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:49.669 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.669 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.669 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:49.669 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247862+0000", 2024-04-19T03:02:49.669 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:49.669 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.669 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.669 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:49.669 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247860+0000", 2024-04-19T03:02:49.669 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999981 2024-04-19T03:02:49.669 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.670 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.670 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:49.670 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247909+0000", 2024-04-19T03:02:49.670 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9150999999999997e-05 2024-04-19T03:02:49.670 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.670 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.670 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:49.670 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247925+0000", 2024-04-19T03:02:49.670 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5761999999999999e-05 2024-04-19T03:02:49.670 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.670 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.670 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:49.670 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247936+0000", 2024-04-19T03:02:49.671 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1144e-05 2024-04-19T03:02:49.671 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.671 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.671 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:49.671 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.250590+0000", 2024-04-19T03:02:49.671 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.002653678 2024-04-19T03:02:49.671 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.671 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.671 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:02:49.671 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.250599+0000", 2024-04-19T03:02:49.671 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9039999999999998e-06 2024-04-19T03:02:49.671 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.671 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.672 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:49.672 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.268151+0000", 2024-04-19T03:02:49.672 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0175523449999999 2024-04-19T03:02:49.672 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.672 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.672 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:49.672 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.268285+0000", 2024-04-19T03:02:49.672 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013415599999999999 2024-04-19T03:02:49.672 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.672 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.672 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:49.672 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.272238+0000", 2024-04-19T03:02:49.672 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0039533019999999997 2024-04-19T03:02:49.672 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.673 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.673 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:49.673 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.272274+0000", 2024-04-19T03:02:49.673 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5352000000000003e-05 2024-04-19T03:02:49.673 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:49.673 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:49.673 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:49.673 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.272319+0000", 2024-04-19T03:02:49.673 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5281999999999998e-05 2024-04-19T03:02:49.673 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:49.673 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:49.673 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:49.673 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:49.673 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:49.674 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-19T03:02:49.675 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T03:02:49.675 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:49.671+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:49.775 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:49.773+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:49.806 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-04-19T03:02:49.806 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [ 2024-04-19T03:02:49.806 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.806 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:137710 5.1 5:8da53ff8:::benchmark_data_smithi096_19531_object24260:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-19T03:02:49.806 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:49.799896+0000", 2024-04-19T03:02:49.806 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0050395279999999997, 2024-04-19T03:02:49.807 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0050629639999999997, 2024-04-19T03:02:49.807 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:49.807 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-04-19T03:02:49.807 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:49.807 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:49.807 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:49.807 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 137710 2024-04-19T03:02:49.807 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.807 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:49.807 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.807 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:49.807 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:49.799896+0000", 2024-04-19T03:02:49.807 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:49.808 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.808 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.808 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:49.808 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:49.799896+0000", 2024-04-19T03:02:49.808 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:49.808 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.808 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.808 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:49.808 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:49.799895+0000", 2024-04-19T03:02:49.808 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:49.808 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.808 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.808 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:49.809 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:49.799901+0000", 2024-04-19T03:02:49.809 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8239999999999996e-06 2024-04-19T03:02:49.809 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.809 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.809 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:49.809 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:49.799916+0000", 2024-04-19T03:02:49.809 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.5617999999999999e-05 2024-04-19T03:02:49.809 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.809 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.809 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:49.809 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:49.799927+0000", 2024-04-19T03:02:49.809 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0920999999999999e-05 2024-04-19T03:02:49.809 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.809 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.810 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:49.810 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:49.799975+0000", 2024-04-19T03:02:49.810 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7995999999999999e-05 2024-04-19T03:02:49.810 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.810 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.810 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:49.810 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:49.800105+0000", 2024-04-19T03:02:49.810 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000129395 2024-04-19T03:02:49.810 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:49.810 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:49.810 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:49.811 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.811 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.811 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:137713 5.9 5:98d91b96:::benchmark_data_smithi096_19531_object24263:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-19T03:02:49.811 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:49.800063+0000", 2024-04-19T03:02:49.811 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0048723710000000003, 2024-04-19T03:02:49.811 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0049681359999999997, 2024-04-19T03:02:49.811 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:49.811 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:02:49.811 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:49.811 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:49.811 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:49.811 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 137713 2024-04-19T03:02:49.811 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.812 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:49.812 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.812 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:49.812 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:49.800063+0000", 2024-04-19T03:02:49.812 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:49.812 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.812 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.812 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:49.812 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:49.800063+0000", 2024-04-19T03:02:49.812 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:49.812 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.812 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.812 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:49.812 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:49.800062+0000", 2024-04-19T03:02:49.812 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:49.813 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.813 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.813 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:49.813 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:49.800067+0000", 2024-04-19T03:02:49.813 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5920000000000002e-06 2024-04-19T03:02:49.813 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.813 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.813 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:49.813 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:49.800081+0000", 2024-04-19T03:02:49.813 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4294000000000001e-05 2024-04-19T03:02:49.813 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.813 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.813 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:49.813 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:49.800088+0000", 2024-04-19T03:02:49.813 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.618e-06 2024-04-19T03:02:49.814 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.814 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.814 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:49.814 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:49.800132+0000", 2024-04-19T03:02:49.814 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4047e-05 2024-04-19T03:02:49.814 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.814 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.814 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:49.814 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:49.800284+0000", 2024-04-19T03:02:49.814 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00015214499999999999 2024-04-19T03:02:49.814 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.814 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.815 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:02:49.815 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:49.800432+0000", 2024-04-19T03:02:49.815 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00014820499999999999 2024-04-19T03:02:49.815 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.815 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.815 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:49.815 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:49.803347+0000", 2024-04-19T03:02:49.815 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00291449 2024-04-19T03:02:49.815 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:49.815 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:49.815 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:49.815 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.815 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.815 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:137716 5.f 5:f4b4161e:::benchmark_data_smithi096_19531_object24266:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-19T03:02:49.816 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:49.801065+0000", 2024-04-19T03:02:49.816 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0038704360000000001, 2024-04-19T03:02:49.816 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0040435840000000002, 2024-04-19T03:02:49.816 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:49.816 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:02:49.816 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:49.816 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:49.816 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:49.816 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 137716 2024-04-19T03:02:49.816 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.816 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:49.816 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.816 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:49.816 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:49.801065+0000", 2024-04-19T03:02:49.816 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:49.817 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.817 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.817 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:49.817 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:49.801065+0000", 2024-04-19T03:02:49.817 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:49.817 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.817 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.817 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:49.817 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:49.801064+0000", 2024-04-19T03:02:49.817 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:49.817 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.817 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.817 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:49.817 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:49.801069+0000", 2024-04-19T03:02:49.818 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.673e-06 2024-04-19T03:02:49.818 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.818 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.818 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:49.818 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:49.801085+0000", 2024-04-19T03:02:49.818 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.5840000000000001e-05 2024-04-19T03:02:49.818 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.818 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.818 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:49.818 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:49.801090+0000", 2024-04-19T03:02:49.818 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6169999999999998e-06 2024-04-19T03:02:49.818 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.818 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.818 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:49.819 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:49.801132+0000", 2024-04-19T03:02:49.819 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1173e-05 2024-04-19T03:02:49.819 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.819 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.819 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:49.819 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:49.801222+0000", 2024-04-19T03:02:49.819 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.0791000000000005e-05 2024-04-19T03:02:49.819 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.819 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.819 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:02:49.819 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:49.801295+0000", 2024-04-19T03:02:49.819 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2336000000000007e-05 2024-04-19T03:02:49.819 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:49.819 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:49.820 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:49.820 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.820 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.820 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:137717 5.6 5:629b62cd:::benchmark_data_smithi096_19531_object24267:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-19T03:02:49.820 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:49.802267+0000", 2024-04-19T03:02:49.820 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0026688079999999999, 2024-04-19T03:02:49.820 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.002912581, 2024-04-19T03:02:49.820 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:49.820 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-04-19T03:02:49.820 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:49.820 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:49.820 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:49.820 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 137717 2024-04-19T03:02:49.820 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.821 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:49.821 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.821 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:49.821 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:49.802267+0000", 2024-04-19T03:02:49.821 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:49.821 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.821 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.821 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:49.821 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:49.802267+0000", 2024-04-19T03:02:49.821 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:49.821 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.821 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.821 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:49.821 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:49.802266+0000", 2024-04-19T03:02:49.822 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:49.822 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.822 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.822 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:49.822 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:49.802272+0000", 2024-04-19T03:02:49.822 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.083e-06 2024-04-19T03:02:49.822 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.822 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.822 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:49.822 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:49.802281+0000", 2024-04-19T03:02:49.822 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.149e-06 2024-04-19T03:02:49.822 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.822 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.823 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:49.823 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:49.802289+0000", 2024-04-19T03:02:49.823 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6029999999999999e-06 2024-04-19T03:02:49.823 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.823 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.823 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:49.823 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:49.802334+0000", 2024-04-19T03:02:49.823 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5611000000000001e-05 2024-04-19T03:02:49.823 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.823 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.823 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:49.823 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:49.802494+0000", 2024-04-19T03:02:49.823 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00015969199999999999 2024-04-19T03:02:49.823 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:49.824 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:49.824 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:49.824 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.824 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.824 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:137718 5.5 5:a9b9e055:::benchmark_data_smithi096_19531_object24268:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-19T03:02:49.824 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:49.802304+0000", 2024-04-19T03:02:49.824 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.002631403, 2024-04-19T03:02:49.824 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.002939152, 2024-04-19T03:02:49.824 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:49.824 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-04-19T03:02:49.824 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:49.824 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:49.824 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:49.824 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 137718 2024-04-19T03:02:49.825 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.825 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:49.825 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.825 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:49.825 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:49.802304+0000", 2024-04-19T03:02:49.825 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:49.825 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.825 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.825 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:49.825 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:49.802304+0000", 2024-04-19T03:02:49.825 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:49.825 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.825 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.825 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:49.826 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:49.802304+0000", 2024-04-19T03:02:49.826 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:49.826 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.826 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.826 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:49.826 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:49.802306+0000", 2024-04-19T03:02:49.826 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.419e-06 2024-04-19T03:02:49.826 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.826 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.826 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:49.826 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:49.802312+0000", 2024-04-19T03:02:49.826 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3759999999999999e-06 2024-04-19T03:02:49.826 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.826 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.827 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:49.827 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:49.802319+0000", 2024-04-19T03:02:49.827 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.1890000000000001e-06 2024-04-19T03:02:49.827 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.827 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.827 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:49.827 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:49.803046+0000", 2024-04-19T03:02:49.827 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00072757099999999999 2024-04-19T03:02:49.827 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.827 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.827 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:49.827 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:49.803122+0000", 2024-04-19T03:02:49.827 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5210999999999995e-05 2024-04-19T03:02:49.828 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:49.828 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:49.828 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:49.828 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.828 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.828 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:137719 5.5 5:a3fea352:::benchmark_data_smithi096_19531_object24269:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-19T03:02:49.828 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:49.803030+0000", 2024-04-19T03:02:49.828 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0019057049999999999, 2024-04-19T03:02:49.828 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0022731370000000002, 2024-04-19T03:02:49.828 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:49.828 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-04-19T03:02:49.828 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:49.828 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:49.828 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:49.828 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 137719 2024-04-19T03:02:49.829 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.829 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:49.829 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.829 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:49.829 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:49.803030+0000", 2024-04-19T03:02:49.829 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:49.829 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.829 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.829 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:49.829 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:49.803030+0000", 2024-04-19T03:02:49.829 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:49.829 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.829 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.830 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:49.830 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:49.803029+0000", 2024-04-19T03:02:49.830 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:49.830 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.830 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.830 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:49.830 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:49.803033+0000", 2024-04-19T03:02:49.830 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9210000000000002e-06 2024-04-19T03:02:49.830 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.830 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.830 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:49.830 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:49.803041+0000", 2024-04-19T03:02:49.830 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6290000000000001e-06 2024-04-19T03:02:49.830 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.831 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.831 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:49.831 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:49.803047+0000", 2024-04-19T03:02:49.831 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.426e-06 2024-04-19T03:02:49.831 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.831 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.831 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:49.831 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:49.804825+0000", 2024-04-19T03:02:49.831 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0017775969999999999 2024-04-19T03:02:49.831 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.831 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.831 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:49.831 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:49.804980+0000", 2024-04-19T03:02:49.831 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00015580800000000001 2024-04-19T03:02:49.832 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:49.832 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:49.832 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:49.832 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.832 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.832 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:137720 5.1 5:8c87c4cb:::benchmark_data_smithi096_19531_object24270:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-19T03:02:49.832 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:49.803052+0000", 2024-04-19T03:02:49.832 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.001883212, 2024-04-19T03:02:49.832 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0023098300000000001, 2024-04-19T03:02:49.832 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:49.832 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-04-19T03:02:49.832 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:49.832 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:49.832 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:49.832 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 137720 2024-04-19T03:02:49.833 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.833 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:49.833 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.833 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:49.833 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:49.803052+0000", 2024-04-19T03:02:49.833 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:49.833 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.833 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.833 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:49.833 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:49.803052+0000", 2024-04-19T03:02:49.833 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:49.833 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.833 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.833 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:49.834 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:49.803052+0000", 2024-04-19T03:02:49.834 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:49.834 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.834 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.834 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:49.834 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:49.803055+0000", 2024-04-19T03:02:49.834 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0910000000000001e-06 2024-04-19T03:02:49.834 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.834 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.834 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:49.834 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:49.803061+0000", 2024-04-19T03:02:49.834 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9390000000000002e-06 2024-04-19T03:02:49.834 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.835 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.835 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:49.835 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:49.803066+0000", 2024-04-19T03:02:49.835 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9230000000000001e-06 2024-04-19T03:02:49.835 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.835 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.835 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:49.835 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:49.803108+0000", 2024-04-19T03:02:49.835 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1733000000000002e-05 2024-04-19T03:02:49.835 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.835 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.835 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:49.835 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:49.803236+0000", 2024-04-19T03:02:49.835 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000127997 2024-04-19T03:02:49.836 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:49.836 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:49.836 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:49.836 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.836 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.836 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:137722 5.f 5:fef30adb:::benchmark_data_smithi096_19531_object24272:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-19T03:02:49.836 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:49.803392+0000", 2024-04-19T03:02:49.836 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0015439010000000001, 2024-04-19T03:02:49.836 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0020341550000000002, 2024-04-19T03:02:49.836 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:49.836 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:02:49.836 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:49.836 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:49.836 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:49.836 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 137722 2024-04-19T03:02:49.837 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.837 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:49.837 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.837 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:49.837 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:49.803392+0000", 2024-04-19T03:02:49.837 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:49.837 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.837 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.837 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:49.837 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:49.803392+0000", 2024-04-19T03:02:49.837 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:49.837 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.837 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.837 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:49.837 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:49.803391+0000", 2024-04-19T03:02:49.837 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:49.838 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.838 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.838 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:49.838 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:49.803395+0000", 2024-04-19T03:02:49.838 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1749999999999998e-06 2024-04-19T03:02:49.838 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.838 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.838 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:49.838 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:49.803401+0000", 2024-04-19T03:02:49.838 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5419999999999996e-06 2024-04-19T03:02:49.838 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.838 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.838 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:49.839 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:49.803404+0000", 2024-04-19T03:02:49.839 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8199999999999998e-06 2024-04-19T03:02:49.839 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.839 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.839 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:49.839 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:49.803440+0000", 2024-04-19T03:02:49.839 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5660000000000001e-05 2024-04-19T03:02:49.839 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.839 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.839 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:49.839 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:49.803517+0000", 2024-04-19T03:02:49.839 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6439000000000005e-05 2024-04-19T03:02:49.839 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.840 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.840 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:02:49.840 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:49.803574+0000", 2024-04-19T03:02:49.840 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7812999999999997e-05 2024-04-19T03:02:49.840 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:49.840 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:49.840 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:49.840 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.840 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.840 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:137724 5.2 5:4c131729:::benchmark_data_smithi096_19531_object24274:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-19T03:02:49.840 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:49.805062+0000", 2024-04-19T03:02:49.840 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4294967295.9998736, 2024-04-19T03:02:49.840 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00042979599999999998, 2024-04-19T03:02:49.840 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:49.841 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-04-19T03:02:49.841 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:49.841 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:49.841 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:49.841 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 137724 2024-04-19T03:02:49.841 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.841 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:49.841 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.841 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:49.841 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:49.805062+0000", 2024-04-19T03:02:49.841 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:49.841 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.841 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.842 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:49.842 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:49.805062+0000", 2024-04-19T03:02:49.842 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:49.842 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.842 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.842 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:49.842 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:49.805061+0000", 2024-04-19T03:02:49.842 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:49.842 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.842 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.842 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:49.842 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:49.805066+0000", 2024-04-19T03:02:49.842 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4429999999999996e-06 2024-04-19T03:02:49.843 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.843 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.843 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:49.843 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:49.805072+0000", 2024-04-19T03:02:49.843 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1619999999999996e-06 2024-04-19T03:02:49.843 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.843 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.843 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:49.843 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:49.805076+0000", 2024-04-19T03:02:49.843 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0629999999999999e-06 2024-04-19T03:02:49.843 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.843 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.843 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:49.843 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:49.805113+0000", 2024-04-19T03:02:49.844 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7319e-05 2024-04-19T03:02:49.844 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.844 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.844 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:49.844 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:49.805190+0000", 2024-04-19T03:02:49.844 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6778000000000002e-05 2024-04-19T03:02:49.844 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:49.844 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:49.844 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:49.844 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.844 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.844 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:137725 5.2 5.b9f2c942 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-19T03:02:49.844 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:49.805370+0000", 2024-04-19T03:02:49.844 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4294967295.9995651, 2024-04-19T03:02:49.845 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000179125, 2024-04-19T03:02:49.845 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:49.845 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-04-19T03:02:49.845 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:49.845 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:49.845 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:49.845 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 137725 2024-04-19T03:02:49.845 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.845 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:49.845 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.845 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:49.845 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:49.805370+0000", 2024-04-19T03:02:49.845 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:49.845 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.846 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.846 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:49.846 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:49.805370+0000", 2024-04-19T03:02:49.846 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:49.846 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.846 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.846 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:49.846 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:49.805369+0000", 2024-04-19T03:02:49.846 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:49.846 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.846 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.846 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:49.846 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:49.805374+0000", 2024-04-19T03:02:49.847 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8969999999999999e-06 2024-04-19T03:02:49.847 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.847 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.847 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:49.847 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:49.805383+0000", 2024-04-19T03:02:49.847 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.7739999999999993e-06 2024-04-19T03:02:49.847 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:49.847 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:49.847 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:49.847 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:49.805389+0000", 2024-04-19T03:02:49.847 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.613e-06 2024-04-19T03:02:49.847 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:49.847 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:49.847 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:49.847 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:49.848 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-04-19T03:02:49.848 INFO:teuthology.orchestra.run.smithi144.stdout: "num_ops": 10 2024-04-19T03:02:49.848 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-04-19T03:02:49.849 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T03:02:49.876 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:49.873+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:49.977 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:49.973+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:49.979 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-04-19T03:02:49.980 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2024-04-19T03:02:49.980 INFO:teuthology.orchestra.run.smithi144.stdout: "complaint_time": 30, 2024-04-19T03:02:49.980 INFO:teuthology.orchestra.run.smithi144.stdout: "num_blocked_ops": 0 2024-04-19T03:02:49.980 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-04-19T03:02:49.992 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T03:02:50.080 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:50.077+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:50.169 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-04-19T03:02:50.169 INFO:teuthology.orchestra.run.smithi144.stdout: "size": 20, 2024-04-19T03:02:50.169 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 600, 2024-04-19T03:02:50.169 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [ 2024-04-19T03:02:50.169 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.169 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:78992 5.7 5:e6baa862:::benchmark_data_smithi096_19531_object78991:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-19T03:02:50.169 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:18.008888+0000", 2024-04-19T03:02:50.169 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 32.157777823000004, 2024-04-19T03:02:50.170 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.056375285999999997, 2024-04-19T03:02:50.170 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:50.170 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:50.170 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:50.170 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:50.170 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:50.170 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 78992 2024-04-19T03:02:50.170 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.170 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:50.170 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.170 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:50.170 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.008888+0000", 2024-04-19T03:02:50.170 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:50.170 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.171 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.171 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:50.171 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.008888+0000", 2024-04-19T03:02:50.171 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:50.171 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.171 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.171 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:50.171 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.008888+0000", 2024-04-19T03:02:50.171 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:50.171 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.171 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.171 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:50.171 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.008928+0000", 2024-04-19T03:02:50.172 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0361999999999997e-05 2024-04-19T03:02:50.172 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.172 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.172 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:50.172 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.008942+0000", 2024-04-19T03:02:50.172 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4365000000000001e-05 2024-04-19T03:02:50.172 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.172 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.172 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:50.172 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.008949+0000", 2024-04-19T03:02:50.172 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.212e-06 2024-04-19T03:02:50.172 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.172 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.172 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:50.173 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.012683+0000", 2024-04-19T03:02:50.173 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.003733934 2024-04-19T03:02:50.173 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.173 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.173 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:50.173 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.012798+0000", 2024-04-19T03:02:50.173 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00011574999999999999 2024-04-19T03:02:50.173 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.173 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.173 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:50.173 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.012896+0000", 2024-04-19T03:02:50.173 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.7848000000000002e-05 2024-04-19T03:02:50.173 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.173 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.174 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:50.174 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016423+0000", 2024-04-19T03:02:50.174 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0035270789999999998 2024-04-19T03:02:50.174 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.174 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.174 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:50.174 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.065098+0000", 2024-04-19T03:02:50.174 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.048674651999999999 2024-04-19T03:02:50.174 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.174 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.174 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:50.174 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.065193+0000", 2024-04-19T03:02:50.174 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.5087999999999995e-05 2024-04-19T03:02:50.175 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.175 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.175 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:50.175 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.065264+0000", 2024-04-19T03:02:50.175 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0666000000000004e-05 2024-04-19T03:02:50.175 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:50.175 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:50.175 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:50.175 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.175 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.175 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:78998 5.7 5:ee23c1bc:::benchmark_data_smithi096_19531_object78997:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-19T03:02:50.175 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:18.013165+0000", 2024-04-19T03:02:50.175 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 32.153501116999998, 2024-04-19T03:02:50.175 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.052410864000000001, 2024-04-19T03:02:50.176 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:50.176 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:50.176 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:50.176 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:50.176 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:50.176 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 78998 2024-04-19T03:02:50.176 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.176 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:50.176 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.176 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:50.176 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.013165+0000", 2024-04-19T03:02:50.176 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:50.176 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.176 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.177 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:50.177 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.013165+0000", 2024-04-19T03:02:50.177 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:50.177 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.177 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.177 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:50.177 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.013164+0000", 2024-04-19T03:02:50.177 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:50.177 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.177 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.177 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:50.177 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.013214+0000", 2024-04-19T03:02:50.177 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9636999999999999e-05 2024-04-19T03:02:50.177 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.178 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.178 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:50.178 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.013223+0000", 2024-04-19T03:02:50.178 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.3619999999999995e-06 2024-04-19T03:02:50.178 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.178 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.178 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:50.178 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.013229+0000", 2024-04-19T03:02:50.178 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6060000000000002e-06 2024-04-19T03:02:50.178 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.178 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.178 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:50.178 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.014882+0000", 2024-04-19T03:02:50.178 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001653257 2024-04-19T03:02:50.179 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.179 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.179 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:50.179 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.014958+0000", 2024-04-19T03:02:50.179 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6398999999999998e-05 2024-04-19T03:02:50.179 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.179 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.179 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:50.179 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.015036+0000", 2024-04-19T03:02:50.179 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8070000000000003e-05 2024-04-19T03:02:50.179 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.179 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.179 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:50.179 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018099+0000", 2024-04-19T03:02:50.180 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0030631149999999999 2024-04-19T03:02:50.180 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.180 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.180 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:50.180 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.065328+0000", 2024-04-19T03:02:50.180 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.047228349000000003 2024-04-19T03:02:50.180 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.180 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.180 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:50.180 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.065508+0000", 2024-04-19T03:02:50.180 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00018036899999999999 2024-04-19T03:02:50.180 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.180 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.180 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:50.180 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.065576+0000", 2024-04-19T03:02:50.181 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7785000000000002e-05 2024-04-19T03:02:50.181 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:50.181 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:50.181 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:50.181 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.181 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.181 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4755.0:78995 5.2 e40/39 5:42b55e12:::benchmark_data_smithi096_19531_object78994:head v 40'4934, mlcod=40'4932)", 2024-04-19T03:02:50.181 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:18.016247+0000", 2024-04-19T03:02:50.181 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 32.150419155000002, 2024-04-19T03:02:50.181 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.056240406, 2024-04-19T03:02:50.181 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:50.181 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:50.181 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:50.181 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.182 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:50.182 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016247+0000", 2024-04-19T03:02:50.182 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:50.182 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.182 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.182 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:50.182 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016247+0000", 2024-04-19T03:02:50.182 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:50.182 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.182 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.182 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:50.182 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016246+0000", 2024-04-19T03:02:50.182 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:50.182 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.183 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.183 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:50.183 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016315+0000", 2024-04-19T03:02:50.183 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8979000000000005e-05 2024-04-19T03:02:50.183 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.183 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.183 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:50.183 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016333+0000", 2024-04-19T03:02:50.183 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7586999999999999e-05 2024-04-19T03:02:50.183 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.183 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.184 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:50.184 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016340+0000", 2024-04-19T03:02:50.184 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4080000000000001e-06 2024-04-19T03:02:50.184 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.184 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.184 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:50.184 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016384+0000", 2024-04-19T03:02:50.184 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3656999999999999e-05 2024-04-19T03:02:50.184 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.184 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.184 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:50.184 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016403+0000", 2024-04-19T03:02:50.184 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9089e-05 2024-04-19T03:02:50.184 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.185 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.185 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:50.185 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.072448+0000", 2024-04-19T03:02:50.185 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.056045084000000002 2024-04-19T03:02:50.185 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.185 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.185 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:50.185 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.072487+0000", 2024-04-19T03:02:50.185 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9362e-05 2024-04-19T03:02:50.185 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:50.185 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:50.185 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:50.185 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.185 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.186 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4755.0:78994 5.c e40/22 5:3c60d55d:::benchmark_data_smithi096_19531_object78993:head v 40'4989, mlcod=40'4987)", 2024-04-19T03:02:50.186 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:18.016392+0000", 2024-04-19T03:02:50.186 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 32.150274514000003, 2024-04-19T03:02:50.186 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.052629620000000002, 2024-04-19T03:02:50.186 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:50.186 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:50.186 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:50.186 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.186 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:50.186 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016392+0000", 2024-04-19T03:02:50.186 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:50.186 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.186 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.187 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:50.187 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016392+0000", 2024-04-19T03:02:50.187 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:50.187 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.187 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.187 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:50.187 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016391+0000", 2024-04-19T03:02:50.187 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:50.187 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.187 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.187 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:50.187 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016471+0000", 2024-04-19T03:02:50.187 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9346999999999998e-05 2024-04-19T03:02:50.188 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.188 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.188 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:50.188 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016478+0000", 2024-04-19T03:02:50.188 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.593e-06 2024-04-19T03:02:50.188 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.188 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.188 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:50.188 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016495+0000", 2024-04-19T03:02:50.188 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6492999999999999e-05 2024-04-19T03:02:50.188 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.188 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.188 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:50.188 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016539+0000", 2024-04-19T03:02:50.189 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4715999999999997e-05 2024-04-19T03:02:50.189 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.189 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.189 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:50.189 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016551+0000", 2024-04-19T03:02:50.189 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2096000000000001e-05 2024-04-19T03:02:50.189 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.189 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.189 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:50.189 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.068985+0000", 2024-04-19T03:02:50.189 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.052433754999999999 2024-04-19T03:02:50.189 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.189 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.189 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:50.190 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.069021+0000", 2024-04-19T03:02:50.190 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6047000000000002e-05 2024-04-19T03:02:50.190 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:50.190 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:50.190 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:50.190 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.190 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.190 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4755.0:78996 5.1 e40/39 5:87f59708:::benchmark_data_smithi096_19531_object78995:head v 40'4940, mlcod=40'4938)", 2024-04-19T03:02:50.190 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:18.016581+0000", 2024-04-19T03:02:50.190 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 32.150085349000001, 2024-04-19T03:02:50.190 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.052051785000000003, 2024-04-19T03:02:50.190 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:50.191 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:50.191 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:50.191 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.191 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:50.191 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016581+0000", 2024-04-19T03:02:50.191 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:50.191 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.191 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.191 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:50.191 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016581+0000", 2024-04-19T03:02:50.191 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:50.191 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.191 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.191 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:50.192 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016581+0000", 2024-04-19T03:02:50.192 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:50.192 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.192 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.192 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:50.192 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016610+0000", 2024-04-19T03:02:50.192 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9556999999999998e-05 2024-04-19T03:02:50.192 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.192 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.192 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:50.192 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016616+0000", 2024-04-19T03:02:50.192 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1090000000000003e-06 2024-04-19T03:02:50.192 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.192 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.193 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:50.193 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016621+0000", 2024-04-19T03:02:50.193 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.454e-06 2024-04-19T03:02:50.193 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.193 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.193 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:50.193 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016663+0000", 2024-04-19T03:02:50.193 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2582e-05 2024-04-19T03:02:50.193 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.193 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.193 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:50.193 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016681+0000", 2024-04-19T03:02:50.193 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7680999999999999e-05 2024-04-19T03:02:50.193 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.194 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.194 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:50.194 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.068486+0000", 2024-04-19T03:02:50.194 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.051804624000000001 2024-04-19T03:02:50.194 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.194 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.194 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:50.194 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.068633+0000", 2024-04-19T03:02:50.194 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00014709099999999999 2024-04-19T03:02:50.194 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:50.194 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:50.194 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:50.194 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.195 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.195 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4755.0:78999 5.3 e40/22 5:c9ec5f7f:::benchmark_data_smithi096_19531_object78998:head v 40'4893, mlcod=40'4889)", 2024-04-19T03:02:50.195 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:18.016633+0000", 2024-04-19T03:02:50.195 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 32.150033493999999, 2024-04-19T03:02:50.195 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.051090469999999999, 2024-04-19T03:02:50.195 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:50.195 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:50.195 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:50.195 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.195 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:50.195 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016633+0000", 2024-04-19T03:02:50.195 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:50.195 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.195 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.196 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:50.196 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016633+0000", 2024-04-19T03:02:50.196 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:50.196 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.196 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.196 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:50.196 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016632+0000", 2024-04-19T03:02:50.196 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967296 2024-04-19T03:02:50.196 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.196 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.196 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:50.196 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016660+0000", 2024-04-19T03:02:50.196 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7869999999999999e-05 2024-04-19T03:02:50.196 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.197 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.197 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:50.197 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016667+0000", 2024-04-19T03:02:50.197 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0280000000000003e-06 2024-04-19T03:02:50.197 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.197 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.197 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:50.197 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016672+0000", 2024-04-19T03:02:50.197 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0069999999999997e-06 2024-04-19T03:02:50.197 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.197 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.197 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:50.197 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016725+0000", 2024-04-19T03:02:50.198 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2812000000000002e-05 2024-04-19T03:02:50.198 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.198 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.198 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:50.198 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016750+0000", 2024-04-19T03:02:50.198 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5038e-05 2024-04-19T03:02:50.198 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.198 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.198 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:50.198 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.067673+0000", 2024-04-19T03:02:50.198 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.050922350999999998 2024-04-19T03:02:50.198 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.198 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.198 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:50.199 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.067723+0000", 2024-04-19T03:02:50.199 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0586e-05 2024-04-19T03:02:50.199 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:50.199 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:50.199 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:50.199 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.199 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.199 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4755.0:79003 5.2 e40/39 5:4436e33f:::benchmark_data_smithi096_19531_object79002:head v 40'4935, mlcod=40'4932)", 2024-04-19T03:02:50.199 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:18.018102+0000", 2024-04-19T03:02:50.199 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 32.148563766999999, 2024-04-19T03:02:50.199 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.060023990999999999, 2024-04-19T03:02:50.199 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:50.199 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:50.199 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:50.200 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.200 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:50.200 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018102+0000", 2024-04-19T03:02:50.200 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:50.200 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.200 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.200 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:50.200 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018102+0000", 2024-04-19T03:02:50.200 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:50.200 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.200 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.200 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:50.200 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018102+0000", 2024-04-19T03:02:50.200 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:50.201 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.201 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.201 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:50.201 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018134+0000", 2024-04-19T03:02:50.201 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2722000000000003e-05 2024-04-19T03:02:50.201 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.201 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.201 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:50.201 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018145+0000", 2024-04-19T03:02:50.201 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0395e-05 2024-04-19T03:02:50.201 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.201 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.201 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:50.202 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018151+0000", 2024-04-19T03:02:50.202 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5300000000000002e-06 2024-04-19T03:02:50.202 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.202 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.202 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:50.202 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018489+0000", 2024-04-19T03:02:50.202 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00033731499999999998 2024-04-19T03:02:50.202 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.202 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.202 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:50.202 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018508+0000", 2024-04-19T03:02:50.202 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9775e-05 2024-04-19T03:02:50.202 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.203 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.203 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:50.203 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.078059+0000", 2024-04-19T03:02:50.203 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.059550171999999998 2024-04-19T03:02:50.203 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.203 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.203 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:50.203 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.078126+0000", 2024-04-19T03:02:50.203 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7773000000000003e-05 2024-04-19T03:02:50.203 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:50.203 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:50.203 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:50.203 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.203 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.204 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4755.0:79005 5.1 e40/39 5:85b46038:::benchmark_data_smithi096_19531_object79004:head v 40'4941, mlcod=40'4938)", 2024-04-19T03:02:50.204 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:18.018167+0000", 2024-04-19T03:02:50.204 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 32.148499047999998, 2024-04-19T03:02:50.204 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.052768941999999999, 2024-04-19T03:02:50.204 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:50.204 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:50.204 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:50.204 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.204 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:50.204 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018167+0000", 2024-04-19T03:02:50.204 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:50.204 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.204 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.204 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:50.204 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018167+0000", 2024-04-19T03:02:50.205 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:50.205 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.205 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.205 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:50.205 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018167+0000", 2024-04-19T03:02:50.205 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:50.205 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.205 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.205 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:50.205 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018196+0000", 2024-04-19T03:02:50.205 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9538000000000001e-05 2024-04-19T03:02:50.205 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.205 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.205 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:50.206 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018204+0000", 2024-04-19T03:02:50.206 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2599999999999999e-06 2024-04-19T03:02:50.206 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.206 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.206 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:50.206 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018208+0000", 2024-04-19T03:02:50.206 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8080000000000004e-06 2024-04-19T03:02:50.206 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.206 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.206 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:50.206 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.064933+0000", 2024-04-19T03:02:50.206 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.046725048999999998 2024-04-19T03:02:50.207 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.207 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.207 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:50.207 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.064964+0000", 2024-04-19T03:02:50.207 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0577000000000002e-05 2024-04-19T03:02:50.207 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.207 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.207 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:50.207 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.070815+0000", 2024-04-19T03:02:50.207 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0058510649999999999 2024-04-19T03:02:50.207 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.207 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.207 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:50.208 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.070936+0000", 2024-04-19T03:02:50.208 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00012095399999999999 2024-04-19T03:02:50.208 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:50.208 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:50.208 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:50.208 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.208 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.208 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:86612 5.7 5:e32e3c49:::benchmark_data_smithi096_19531_object86611:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:50.208 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:22.633560+0000", 2024-04-19T03:02:50.208 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 27.533106107000002, 2024-04-19T03:02:50.208 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.19135289, 2024-04-19T03:02:50.208 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:50.208 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:50.209 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:50.209 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:50.209 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:50.209 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 86612 2024-04-19T03:02:50.209 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.209 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:50.209 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.209 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:50.209 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633560+0000", 2024-04-19T03:02:50.209 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:50.209 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.209 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.209 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:50.209 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633560+0000", 2024-04-19T03:02:50.210 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:50.210 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.210 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.210 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:50.210 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633558+0000", 2024-04-19T03:02:50.210 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:50.210 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.210 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.210 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:50.210 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633609+0000", 2024-04-19T03:02:50.210 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0850999999999998e-05 2024-04-19T03:02:50.210 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.210 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.210 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:50.211 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633627+0000", 2024-04-19T03:02:50.211 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7951000000000001e-05 2024-04-19T03:02:50.211 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.211 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.211 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:50.211 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633635+0000", 2024-04-19T03:02:50.211 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2530000000000004e-06 2024-04-19T03:02:50.211 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.211 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.211 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:50.212 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633699+0000", 2024-04-19T03:02:50.212 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3901999999999999e-05 2024-04-19T03:02:50.212 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.212 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.212 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:50.212 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633992+0000", 2024-04-19T03:02:50.212 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00029283299999999999 2024-04-19T03:02:50.212 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.212 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.212 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:50.212 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.634223+0000", 2024-04-19T03:02:50.212 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00023084200000000001 2024-04-19T03:02:50.212 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.213 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.213 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:50.213 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.639085+0000", 2024-04-19T03:02:50.213 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0048624269999999999 2024-04-19T03:02:50.213 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.213 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.213 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:50.213 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.824635+0000", 2024-04-19T03:02:50.213 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.18554944700000001 2024-04-19T03:02:50.213 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.213 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.213 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:50.213 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.824793+0000", 2024-04-19T03:02:50.213 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000157959 2024-04-19T03:02:50.214 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.214 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.214 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:50.214 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.824913+0000", 2024-04-19T03:02:50.214 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000120093 2024-04-19T03:02:50.214 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:50.214 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:50.214 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:50.214 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.214 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.214 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:86625 5.7 5:e6d00488:::benchmark_data_smithi096_19531_object86624:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:50.214 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:22.643554+0000", 2024-04-19T03:02:50.214 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 27.523112341000001, 2024-04-19T03:02:50.215 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.18732841, 2024-04-19T03:02:50.215 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:50.215 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:50.215 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:50.215 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:50.215 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:50.215 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 86625 2024-04-19T03:02:50.215 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.215 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:50.215 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.215 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:50.215 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643554+0000", 2024-04-19T03:02:50.215 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:50.215 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.216 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.216 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:50.216 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643554+0000", 2024-04-19T03:02:50.216 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:50.216 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.216 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.216 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:50.216 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643552+0000", 2024-04-19T03:02:50.216 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:50.216 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.216 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.216 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:50.216 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643588+0000", 2024-04-19T03:02:50.216 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5855999999999997e-05 2024-04-19T03:02:50.217 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.217 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.217 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:50.217 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643606+0000", 2024-04-19T03:02:50.217 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8226000000000001e-05 2024-04-19T03:02:50.217 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.217 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.217 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:50.217 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643618+0000", 2024-04-19T03:02:50.217 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1868000000000001e-05 2024-04-19T03:02:50.217 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.217 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.217 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:50.217 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643676+0000", 2024-04-19T03:02:50.218 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8153999999999999e-05 2024-04-19T03:02:50.218 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.218 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.218 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:50.218 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643905+0000", 2024-04-19T03:02:50.218 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00022847500000000001 2024-04-19T03:02:50.218 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.218 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.218 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:50.218 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.644150+0000", 2024-04-19T03:02:50.218 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00024531800000000001 2024-04-19T03:02:50.218 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.218 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.218 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:50.219 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.647407+0000", 2024-04-19T03:02:50.219 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0032563190000000001 2024-04-19T03:02:50.219 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.219 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.219 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:50.219 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.830721+0000", 2024-04-19T03:02:50.219 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.18331468300000001 2024-04-19T03:02:50.219 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.219 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.219 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:50.219 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.830813+0000", 2024-04-19T03:02:50.219 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.2205000000000002e-05 2024-04-19T03:02:50.219 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.219 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.220 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:50.220 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.830882+0000", 2024-04-19T03:02:50.220 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8819999999999995e-05 2024-04-19T03:02:50.220 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:50.220 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:50.220 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:50.220 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.220 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.220 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87063 5.7 5:e502e824:::benchmark_data_smithi096_19531_object87062:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:50.220 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.136067+0000", 2024-04-19T03:02:50.220 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 27.030599471999999, 2024-04-19T03:02:50.220 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.065521159999999995, 2024-04-19T03:02:50.220 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:50.220 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:50.221 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:50.221 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:50.221 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:50.221 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87063 2024-04-19T03:02:50.221 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.221 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:50.221 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.221 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:50.221 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.136067+0000", 2024-04-19T03:02:50.221 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:50.221 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.221 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.221 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:50.221 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.136067+0000", 2024-04-19T03:02:50.222 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:50.222 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.222 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.222 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:50.222 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.136066+0000", 2024-04-19T03:02:50.222 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:50.222 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.222 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.222 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:50.222 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.136154+0000", 2024-04-19T03:02:50.222 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.8256000000000003e-05 2024-04-19T03:02:50.222 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.222 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.222 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:50.223 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.136162+0000", 2024-04-19T03:02:50.223 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.5099999999999998e-06 2024-04-19T03:02:50.223 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.223 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.223 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:50.223 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.136171+0000", 2024-04-19T03:02:50.223 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2830000000000001e-06 2024-04-19T03:02:50.223 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.223 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.223 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:50.223 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.138421+0000", 2024-04-19T03:02:50.223 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0022506620000000001 2024-04-19T03:02:50.223 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.223 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.224 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:50.224 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.138560+0000", 2024-04-19T03:02:50.224 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000138446 2024-04-19T03:02:50.224 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.224 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.224 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:50.224 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.138689+0000", 2024-04-19T03:02:50.224 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00012950700000000001 2024-04-19T03:02:50.224 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.224 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.224 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:50.224 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.141517+0000", 2024-04-19T03:02:50.224 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0028280860000000001 2024-04-19T03:02:50.224 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.224 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.225 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:50.225 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.201350+0000", 2024-04-19T03:02:50.225 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.059832418999999998 2024-04-19T03:02:50.225 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.225 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.225 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:50.225 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.201485+0000", 2024-04-19T03:02:50.225 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000135597 2024-04-19T03:02:50.225 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.225 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.225 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:50.225 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.201588+0000", 2024-04-19T03:02:50.225 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00010247900000000001 2024-04-19T03:02:50.225 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:50.226 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:50.226 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:50.226 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.226 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.226 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87072 5.7 5:e3c7809a:::benchmark_data_smithi096_19531_object87071:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:50.226 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.144224+0000", 2024-04-19T03:02:50.226 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 27.022442448, 2024-04-19T03:02:50.226 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.058179555000000001, 2024-04-19T03:02:50.226 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:50.226 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:50.226 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:50.226 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:50.226 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:50.227 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87072 2024-04-19T03:02:50.227 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.227 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:50.227 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.227 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:50.227 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144224+0000", 2024-04-19T03:02:50.227 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:50.227 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.227 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.227 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:50.227 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144224+0000", 2024-04-19T03:02:50.227 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:50.227 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.227 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.228 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:50.228 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144223+0000", 2024-04-19T03:02:50.228 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:50.228 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.228 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.228 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:50.228 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144320+0000", 2024-04-19T03:02:50.228 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.7075000000000001e-05 2024-04-19T03:02:50.228 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.228 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.228 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:50.228 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144331+0000", 2024-04-19T03:02:50.228 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1342000000000001e-05 2024-04-19T03:02:50.229 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.229 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.229 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:50.229 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144337+0000", 2024-04-19T03:02:50.229 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8390000000000003e-06 2024-04-19T03:02:50.229 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.229 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.229 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:50.229 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144369+0000", 2024-04-19T03:02:50.229 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2079000000000002e-05 2024-04-19T03:02:50.229 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.229 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.229 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:50.229 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144464+0000", 2024-04-19T03:02:50.230 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.4623000000000005e-05 2024-04-19T03:02:50.230 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.230 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.230 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:50.230 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144553+0000", 2024-04-19T03:02:50.230 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9171000000000004e-05 2024-04-19T03:02:50.230 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.230 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.230 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:50.230 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.147018+0000", 2024-04-19T03:02:50.230 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0024648370000000001 2024-04-19T03:02:50.230 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.230 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.230 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:50.231 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.202270+0000", 2024-04-19T03:02:50.231 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.055252018 2024-04-19T03:02:50.231 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.231 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.231 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:50.231 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.202356+0000", 2024-04-19T03:02:50.231 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6648000000000001e-05 2024-04-19T03:02:50.231 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.231 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.231 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:50.231 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.202403+0000", 2024-04-19T03:02:50.231 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6956999999999998e-05 2024-04-19T03:02:50.231 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:50.231 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:50.232 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:50.232 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.232 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.232 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87123 5.6 5:6d1bc3b9:::benchmark_data_smithi096_19531_object87122:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:02:50.232 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249233+0000", 2024-04-19T03:02:50.232 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 26.917433416000002, 2024-04-19T03:02:50.232 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0291700720000001, 2024-04-19T03:02:50.232 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:50.232 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-04-19T03:02:50.232 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:50.232 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:50.232 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:50.232 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87123 2024-04-19T03:02:50.232 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.233 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:50.233 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.233 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:50.233 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249233+0000", 2024-04-19T03:02:50.233 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:50.233 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.233 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.233 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:50.233 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249233+0000", 2024-04-19T03:02:50.233 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:50.233 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.233 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.233 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:50.233 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249231+0000", 2024-04-19T03:02:50.234 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:50.234 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.234 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.234 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:50.234 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249285+0000", 2024-04-19T03:02:50.234 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4005000000000002e-05 2024-04-19T03:02:50.234 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.234 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.234 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:50.234 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249300+0000", 2024-04-19T03:02:50.234 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4715999999999999e-05 2024-04-19T03:02:50.234 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.234 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.234 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:50.235 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249307+0000", 2024-04-19T03:02:50.235 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8399999999999997e-06 2024-04-19T03:02:50.235 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.235 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.235 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:50.235 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249366+0000", 2024-04-19T03:02:50.235 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9435999999999998e-05 2024-04-19T03:02:50.235 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.235 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.235 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op must wait for map", 2024-04-19T03:02:50.235 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249376+0000", 2024-04-19T03:02:50.235 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.4919999999999999e-06 2024-04-19T03:02:50.235 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.235 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.236 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:50.236 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263757+0000", 2024-04-19T03:02:50.236 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.014381461999999999 2024-04-19T03:02:50.236 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.236 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.236 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:02:50.236 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263875+0000", 2024-04-19T03:02:50.236 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000117166 2024-04-19T03:02:50.236 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.236 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.236 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:50.236 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.277136+0000", 2024-04-19T03:02:50.236 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.013261207 2024-04-19T03:02:50.236 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.236 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.237 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:50.237 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.278403+0000", 2024-04-19T03:02:50.237 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001267106 2024-04-19T03:02:50.237 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:50.237 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:50.237 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:50.237 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.237 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.237 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87128 5.6 5:6905c420:::benchmark_data_smithi096_19531_object87127:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:02:50.237 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249323+0000", 2024-04-19T03:02:50.237 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 26.917342669, 2024-04-19T03:02:50.237 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0292813249999999, 2024-04-19T03:02:50.237 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:50.237 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-04-19T03:02:50.238 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:50.238 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:50.238 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:50.238 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87128 2024-04-19T03:02:50.238 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.238 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:50.238 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.238 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:50.238 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249323+0000", 2024-04-19T03:02:50.238 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:50.238 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.238 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.238 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:50.239 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249323+0000", 2024-04-19T03:02:50.239 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:50.239 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.239 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.239 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:50.239 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249323+0000", 2024-04-19T03:02:50.239 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:50.239 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.239 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.239 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:50.239 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249385+0000", 2024-04-19T03:02:50.239 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1711999999999995e-05 2024-04-19T03:02:50.239 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.239 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.240 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:50.240 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249398+0000", 2024-04-19T03:02:50.240 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3022e-05 2024-04-19T03:02:50.240 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.240 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.240 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:50.240 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249402+0000", 2024-04-19T03:02:50.240 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4819999999999996e-06 2024-04-19T03:02:50.240 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.240 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.240 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:50.240 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249437+0000", 2024-04-19T03:02:50.240 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4702000000000001e-05 2024-04-19T03:02:50.241 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.241 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.241 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:02:50.241 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249442+0000", 2024-04-19T03:02:50.241 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8019999999999999e-06 2024-04-19T03:02:50.241 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.241 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.241 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:50.241 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263896+0000", 2024-04-19T03:02:50.241 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.014454679999999999 2024-04-19T03:02:50.241 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.241 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.241 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:02:50.242 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263900+0000", 2024-04-19T03:02:50.242 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9700000000000001e-06 2024-04-19T03:02:50.242 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.242 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.242 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:50.242 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.278557+0000", 2024-04-19T03:02:50.242 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0146566480000001 2024-04-19T03:02:50.242 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.242 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.242 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:50.242 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.278605+0000", 2024-04-19T03:02:50.242 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7735999999999998e-05 2024-04-19T03:02:50.242 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:50.243 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:50.243 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:50.243 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.243 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.243 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87130 5.3 5:c8c2d67b:::benchmark_data_smithi096_19531_object87129:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:02:50.243 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249418+0000", 2024-04-19T03:02:50.243 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 26.917247958000001, 2024-04-19T03:02:50.243 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.025414182, 2024-04-19T03:02:50.243 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:50.243 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-04-19T03:02:50.243 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:50.243 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:50.243 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:50.243 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87130 2024-04-19T03:02:50.243 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.244 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:50.244 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.244 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:50.244 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249418+0000", 2024-04-19T03:02:50.244 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:50.244 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.244 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.244 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:50.244 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249418+0000", 2024-04-19T03:02:50.244 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:50.244 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.244 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.244 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:50.244 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249409+0000", 2024-04-19T03:02:50.245 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999905 2024-04-19T03:02:50.245 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.245 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.245 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:50.245 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249464+0000", 2024-04-19T03:02:50.245 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5381999999999999e-05 2024-04-19T03:02:50.245 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.245 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.245 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:50.245 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249471+0000", 2024-04-19T03:02:50.245 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2609999999999996e-06 2024-04-19T03:02:50.245 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.245 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.245 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:50.246 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249475+0000", 2024-04-19T03:02:50.246 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2839999999999998e-06 2024-04-19T03:02:50.246 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.246 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.246 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:50.246 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249535+0000", 2024-04-19T03:02:50.246 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0545999999999999e-05 2024-04-19T03:02:50.246 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.246 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.246 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op must wait for map", 2024-04-19T03:02:50.246 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249540+0000", 2024-04-19T03:02:50.246 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2859999999999999e-06 2024-04-19T03:02:50.246 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.247 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.247 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:50.247 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263450+0000", 2024-04-19T03:02:50.247 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.013909585 2024-04-19T03:02:50.247 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.247 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.247 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:02:50.247 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263458+0000", 2024-04-19T03:02:50.247 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8089999999999993e-06 2024-04-19T03:02:50.247 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.247 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.247 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:50.247 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.273193+0000", 2024-04-19T03:02:50.247 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0097351379999999 2024-04-19T03:02:50.248 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.248 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.248 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:50.248 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.274832+0000", 2024-04-19T03:02:50.248 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0016394789999999999 2024-04-19T03:02:50.248 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:50.248 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:50.248 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:50.248 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.248 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.248 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87131 5.1 5:83756d55:::benchmark_data_smithi096_19531_object87130:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:02:50.248 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249491+0000", 2024-04-19T03:02:50.248 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 26.917175311000001, 2024-04-19T03:02:50.248 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0191489520000001, 2024-04-19T03:02:50.249 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:50.249 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-04-19T03:02:50.249 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:50.249 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:50.249 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:50.249 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87131 2024-04-19T03:02:50.249 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.249 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:50.249 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.249 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:50.249 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249491+0000", 2024-04-19T03:02:50.249 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:50.249 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.249 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.250 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:50.250 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249491+0000", 2024-04-19T03:02:50.250 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:50.250 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.250 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.250 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:50.250 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249491+0000", 2024-04-19T03:02:50.250 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:50.250 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.250 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.250 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:50.250 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249530+0000", 2024-04-19T03:02:50.250 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9589000000000003e-05 2024-04-19T03:02:50.250 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.251 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.251 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:50.251 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249544+0000", 2024-04-19T03:02:50.251 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4158000000000001e-05 2024-04-19T03:02:50.251 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.251 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.251 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:50.251 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249549+0000", 2024-04-19T03:02:50.251 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6809999999999997e-06 2024-04-19T03:02:50.251 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.251 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.251 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:50.251 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249592+0000", 2024-04-19T03:02:50.252 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3285999999999999e-05 2024-04-19T03:02:50.252 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.252 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.252 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op must wait for map", 2024-04-19T03:02:50.252 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249598+0000", 2024-04-19T03:02:50.252 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8329999999999999e-06 2024-04-19T03:02:50.252 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.252 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.252 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:50.252 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263331+0000", 2024-04-19T03:02:50.252 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.013733093 2024-04-19T03:02:50.252 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.252 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.252 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:02:50.253 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263343+0000", 2024-04-19T03:02:50.253 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.189e-05 2024-04-19T03:02:50.253 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.253 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.253 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:50.253 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.268541+0000", 2024-04-19T03:02:50.253 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0051983440000001 2024-04-19T03:02:50.253 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.253 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.253 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:50.253 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.268640+0000", 2024-04-19T03:02:50.253 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.8387999999999994e-05 2024-04-19T03:02:50.253 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:50.253 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:50.254 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:50.254 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.254 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.254 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87132 5.c 5:3e18b732:::benchmark_data_smithi096_19531_object87131:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:02:50.254 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249558+0000", 2024-04-19T03:02:50.254 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 26.917108410000001, 2024-04-19T03:02:50.254 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0241198380000001, 2024-04-19T03:02:50.254 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:50.254 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-04-19T03:02:50.254 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:50.254 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:50.254 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:50.254 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87132 2024-04-19T03:02:50.255 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.255 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:50.255 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.255 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:50.255 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249558+0000", 2024-04-19T03:02:50.255 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:50.255 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.255 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.255 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:50.255 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249558+0000", 2024-04-19T03:02:50.255 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:50.255 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.255 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.255 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:50.256 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249557+0000", 2024-04-19T03:02:50.256 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:50.256 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.256 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.256 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:50.256 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249625+0000", 2024-04-19T03:02:50.256 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7200999999999996e-05 2024-04-19T03:02:50.256 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.256 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.256 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:50.256 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249646+0000", 2024-04-19T03:02:50.256 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1053e-05 2024-04-19T03:02:50.256 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.256 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.257 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:50.257 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249650+0000", 2024-04-19T03:02:50.257 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2719999999999999e-06 2024-04-19T03:02:50.257 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.257 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.257 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:50.257 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249686+0000", 2024-04-19T03:02:50.257 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6430000000000002e-05 2024-04-19T03:02:50.257 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.257 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.257 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op must wait for map", 2024-04-19T03:02:50.257 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249690+0000", 2024-04-19T03:02:50.257 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.765e-06 2024-04-19T03:02:50.257 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.258 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.258 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:50.258 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261157+0000", 2024-04-19T03:02:50.258 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011467247999999999 2024-04-19T03:02:50.258 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.258 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.258 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:02:50.258 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261170+0000", 2024-04-19T03:02:50.258 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2833000000000001e-05 2024-04-19T03:02:50.258 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.258 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.258 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:50.258 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.272119+0000", 2024-04-19T03:02:50.258 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.010949313 2024-04-19T03:02:50.259 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.259 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.259 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:50.259 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.273678+0000", 2024-04-19T03:02:50.259 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0015581550000000001 2024-04-19T03:02:50.259 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:50.259 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:50.259 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:50.259 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.259 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.259 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87133 5.c 5:3f772a62:::benchmark_data_smithi096_19531_object87132:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:02:50.259 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249657+0000", 2024-04-19T03:02:50.259 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 26.917009030999999, 2024-04-19T03:02:50.259 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0242819409999999, 2024-04-19T03:02:50.260 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:50.260 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-04-19T03:02:50.260 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:50.260 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:50.260 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:50.260 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87133 2024-04-19T03:02:50.260 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.260 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:50.260 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.260 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:50.260 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249657+0000", 2024-04-19T03:02:50.260 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:50.260 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.260 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.261 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:50.261 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249657+0000", 2024-04-19T03:02:50.261 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:50.261 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.261 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.261 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:50.261 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249657+0000", 2024-04-19T03:02:50.261 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:50.261 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.261 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.261 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:50.261 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249690+0000", 2024-04-19T03:02:50.261 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3343000000000002e-05 2024-04-19T03:02:50.261 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.262 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.262 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:50.262 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249695+0000", 2024-04-19T03:02:50.262 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8600000000000001e-06 2024-04-19T03:02:50.262 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.262 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.262 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:50.262 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249698+0000", 2024-04-19T03:02:50.262 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.1700000000000001e-06 2024-04-19T03:02:50.262 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.262 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.262 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:50.262 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249741+0000", 2024-04-19T03:02:50.263 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2849999999999998e-05 2024-04-19T03:02:50.263 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.263 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.263 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:02:50.263 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249746+0000", 2024-04-19T03:02:50.263 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1019999999999996e-06 2024-04-19T03:02:50.263 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.263 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.263 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:50.263 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261209+0000", 2024-04-19T03:02:50.263 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011462447000000001 2024-04-19T03:02:50.263 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.263 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.263 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:02:50.264 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261216+0000", 2024-04-19T03:02:50.264 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8520000000000004e-06 2024-04-19T03:02:50.264 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.264 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.264 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:50.264 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.273872+0000", 2024-04-19T03:02:50.264 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0126558000000001 2024-04-19T03:02:50.264 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.264 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.264 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:50.264 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.273939+0000", 2024-04-19T03:02:50.264 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6822000000000005e-05 2024-04-19T03:02:50.264 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:50.264 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:50.265 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:50.265 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.265 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.265 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87134 5.5 5:a56c478f:::benchmark_data_smithi096_19531_object87133:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:02:50.265 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249708+0000", 2024-04-19T03:02:50.265 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 26.916958106999999, 2024-04-19T03:02:50.265 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0214677299999999, 2024-04-19T03:02:50.265 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:50.265 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-04-19T03:02:50.265 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:50.265 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:50.265 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:50.265 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87134 2024-04-19T03:02:50.265 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.266 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:50.266 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.266 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:50.266 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249708+0000", 2024-04-19T03:02:50.266 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:50.266 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.266 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.266 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:50.266 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249708+0000", 2024-04-19T03:02:50.266 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:50.266 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.266 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.266 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:50.266 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249706+0000", 2024-04-19T03:02:50.267 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999976 2024-04-19T03:02:50.267 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.267 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.267 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:50.267 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249740+0000", 2024-04-19T03:02:50.267 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4458000000000001e-05 2024-04-19T03:02:50.267 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.267 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.267 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:50.267 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249745+0000", 2024-04-19T03:02:50.267 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5020000000000003e-06 2024-04-19T03:02:50.267 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.267 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.267 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:50.268 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249748+0000", 2024-04-19T03:02:50.268 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2499999999999998e-06 2024-04-19T03:02:50.268 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.268 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.268 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:50.268 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249778+0000", 2024-04-19T03:02:50.268 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.006e-05 2024-04-19T03:02:50.268 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.268 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.268 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op must wait for map", 2024-04-19T03:02:50.268 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249782+0000", 2024-04-19T03:02:50.268 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2910000000000001e-06 2024-04-19T03:02:50.268 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.268 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.269 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:50.269 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261666+0000", 2024-04-19T03:02:50.269 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011883471 2024-04-19T03:02:50.269 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.269 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.269 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:02:50.269 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261674+0000", 2024-04-19T03:02:50.269 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6479999999999992e-06 2024-04-19T03:02:50.269 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.269 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.269 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:50.269 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.269323+0000", 2024-04-19T03:02:50.269 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.00764867 2024-04-19T03:02:50.269 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.270 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.270 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:50.270 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.271176+0000", 2024-04-19T03:02:50.270 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001852844 2024-04-19T03:02:50.270 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:50.270 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:50.270 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:50.270 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.270 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.270 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87137 5.c 5:30708c68:::benchmark_data_smithi096_19531_object87136:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:02:50.270 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249756+0000", 2024-04-19T03:02:50.270 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 26.916910400999999, 2024-04-19T03:02:50.270 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.033331752, 2024-04-19T03:02:50.270 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:50.271 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:50.271 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:50.271 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:50.271 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:50.271 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87137 2024-04-19T03:02:50.271 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.271 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:50.271 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.271 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:50.271 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249756+0000", 2024-04-19T03:02:50.271 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:50.271 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.271 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.271 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:50.272 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249756+0000", 2024-04-19T03:02:50.272 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:50.272 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.272 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.272 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:50.272 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249755+0000", 2024-04-19T03:02:50.272 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:50.272 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.272 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.272 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:50.272 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249777+0000", 2024-04-19T03:02:50.272 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1420000000000002e-05 2024-04-19T03:02:50.272 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.272 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.273 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:50.273 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249781+0000", 2024-04-19T03:02:50.273 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0609999999999997e-06 2024-04-19T03:02:50.273 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.273 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.273 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:50.273 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249787+0000", 2024-04-19T03:02:50.273 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.02e-06 2024-04-19T03:02:50.273 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.273 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.273 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:50.273 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249818+0000", 2024-04-19T03:02:50.273 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0947e-05 2024-04-19T03:02:50.273 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.274 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.274 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:02:50.274 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249821+0000", 2024-04-19T03:02:50.274 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.117e-06 2024-04-19T03:02:50.274 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.274 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.274 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:50.274 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261243+0000", 2024-04-19T03:02:50.274 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011421875999999999 2024-04-19T03:02:50.274 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.274 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.274 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:02:50.274 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261251+0000", 2024-04-19T03:02:50.274 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6120000000000001e-06 2024-04-19T03:02:50.275 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.275 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.275 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:50.275 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.274050+0000", 2024-04-19T03:02:50.275 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.012799405 2024-04-19T03:02:50.275 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.275 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.275 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:50.275 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.274529+0000", 2024-04-19T03:02:50.275 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00047867100000000001 2024-04-19T03:02:50.275 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.275 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.275 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:50.275 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.282972+0000", 2024-04-19T03:02:50.275 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0084436900000000002 2024-04-19T03:02:50.276 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.276 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.276 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:50.276 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.283022+0000", 2024-04-19T03:02:50.276 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9339000000000003e-05 2024-04-19T03:02:50.276 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.276 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.276 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:50.276 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.283088+0000", 2024-04-19T03:02:50.276 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5877999999999995e-05 2024-04-19T03:02:50.276 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:50.276 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:50.276 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:50.276 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:50.277 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:50.277 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-04-19T03:02:50.278 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:50.277+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:50.278 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T03:02:50.379 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:50.377+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:50.407 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-19T03:02:50.408 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-04-19T03:02:50.408 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.408 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:139192 5.e 5:75884528:::benchmark_data_smithi096_19531_object25742:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-19T03:02:50.408 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:50.401564+0000", 2024-04-19T03:02:50.408 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0061149259999999997, 2024-04-19T03:02:50.408 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0061338929999999996, 2024-04-19T03:02:50.408 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:50.408 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-19T03:02:50.408 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:50.408 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:50.408 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:50.408 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 139192 2024-04-19T03:02:50.408 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.409 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:50.409 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.409 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:50.409 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:50.401564+0000", 2024-04-19T03:02:50.409 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:50.409 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.409 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.409 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:50.409 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:50.401564+0000", 2024-04-19T03:02:50.409 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:50.409 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.409 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.409 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:50.409 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:50.401563+0000", 2024-04-19T03:02:50.410 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:50.410 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.410 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.410 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:50.410 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:50.401567+0000", 2024-04-19T03:02:50.410 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8130000000000002e-06 2024-04-19T03:02:50.410 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.410 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.410 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:50.410 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:50.401572+0000", 2024-04-19T03:02:50.410 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5910000000000003e-06 2024-04-19T03:02:50.410 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.410 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.410 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:50.411 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:50.401576+0000", 2024-04-19T03:02:50.411 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6710000000000001e-06 2024-04-19T03:02:50.411 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.411 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.411 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:50.411 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:50.405618+0000", 2024-04-19T03:02:50.411 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0040422000000000001 2024-04-19T03:02:50.411 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.411 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.411 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:50.411 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:50.405696+0000", 2024-04-19T03:02:50.411 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.7878000000000002e-05 2024-04-19T03:02:50.411 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:50.412 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:50.412 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:50.412 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.412 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.412 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4755.0:139195 5.d e53/49 5:bbdcc803:::benchmark_data_smithi096_19531_object25745:head v 53'8803, mlcod=53'8799)", 2024-04-19T03:02:50.412 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:50.403707+0000", 2024-04-19T03:02:50.412 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0039721060000000004, 2024-04-19T03:02:50.412 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0040319689999999998, 2024-04-19T03:02:50.412 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:50.412 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-19T03:02:50.412 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:50.412 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.413 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:50.413 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:50.403707+0000", 2024-04-19T03:02:50.413 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:50.413 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.413 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.413 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:50.413 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:50.403707+0000", 2024-04-19T03:02:50.413 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:50.413 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.413 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.413 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:50.413 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:50.403706+0000", 2024-04-19T03:02:50.413 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:50.413 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.414 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.414 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:50.414 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:50.403715+0000", 2024-04-19T03:02:50.414 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.7020000000000007e-06 2024-04-19T03:02:50.414 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.414 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.414 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:50.414 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:50.403723+0000", 2024-04-19T03:02:50.414 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.2279999999999998e-06 2024-04-19T03:02:50.414 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.414 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.414 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:50.414 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:50.403728+0000", 2024-04-19T03:02:50.415 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6330000000000001e-06 2024-04-19T03:02:50.415 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.415 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.415 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:50.415 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:50.405025+0000", 2024-04-19T03:02:50.415 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0012969959999999999 2024-04-19T03:02:50.415 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.415 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.416 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:50.416 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:50.405048+0000", 2024-04-19T03:02:50.416 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2137000000000002e-05 2024-04-19T03:02:50.416 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:50.416 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:50.416 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:50.416 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.416 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.416 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:139201 5.e 5:790a3501:::benchmark_data_smithi096_19531_object25751:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-19T03:02:50.416 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:50.404438+0000", 2024-04-19T03:02:50.416 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0032408329999999998, 2024-04-19T03:02:50.416 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0033322540000000002, 2024-04-19T03:02:50.416 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:50.417 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-19T03:02:50.417 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:50.417 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:50.417 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:50.417 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 139201 2024-04-19T03:02:50.417 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.417 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:50.417 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.417 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:50.417 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:50.404438+0000", 2024-04-19T03:02:50.417 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:50.417 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.417 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.418 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:50.418 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:50.404438+0000", 2024-04-19T03:02:50.418 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:50.418 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.418 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.418 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:50.418 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:50.404437+0000", 2024-04-19T03:02:50.418 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:50.418 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.418 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.418 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:50.418 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:50.404442+0000", 2024-04-19T03:02:50.418 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4879999999999998e-06 2024-04-19T03:02:50.419 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.419 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.419 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:50.419 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:50.404454+0000", 2024-04-19T03:02:50.419 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1422e-05 2024-04-19T03:02:50.419 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.419 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.419 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:50.419 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:50.404460+0000", 2024-04-19T03:02:50.419 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7799999999999997e-06 2024-04-19T03:02:50.419 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.419 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.419 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:50.419 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:50.407097+0000", 2024-04-19T03:02:50.420 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0026373109999999998 2024-04-19T03:02:50.420 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.420 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.420 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:50.420 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:50.407192+0000", 2024-04-19T03:02:50.420 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.5449e-05 2024-04-19T03:02:50.420 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:50.420 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:50.420 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:50.420 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.420 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.420 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4755.0:139199 5.d e53/49 5:bf3b68c2:::benchmark_data_smithi096_19531_object25749:head v 53'8804, mlcod=53'8800)", 2024-04-19T03:02:50.420 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:50.405997+0000", 2024-04-19T03:02:50.420 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0016814390000000001, 2024-04-19T03:02:50.421 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0018051779999999999, 2024-04-19T03:02:50.421 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:50.421 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-19T03:02:50.421 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:50.421 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.421 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:50.421 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:50.405997+0000", 2024-04-19T03:02:50.421 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:50.421 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.421 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.421 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:50.421 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:50.405997+0000", 2024-04-19T03:02:50.421 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:50.421 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.422 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.422 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:50.422 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:50.405997+0000", 2024-04-19T03:02:50.422 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:50.422 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.422 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.422 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:50.422 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:50.406003+0000", 2024-04-19T03:02:50.422 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3400000000000003e-06 2024-04-19T03:02:50.422 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.422 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.422 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:50.422 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:50.406013+0000", 2024-04-19T03:02:50.423 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0182e-05 2024-04-19T03:02:50.423 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.423 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.423 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:50.423 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:50.406020+0000", 2024-04-19T03:02:50.423 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.0829999999999998e-06 2024-04-19T03:02:50.423 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.423 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.423 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:50.423 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:50.406660+0000", 2024-04-19T03:02:50.423 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00063935499999999998 2024-04-19T03:02:50.423 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.423 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.424 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:50.424 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:50.406684+0000", 2024-04-19T03:02:50.424 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4668000000000002e-05 2024-04-19T03:02:50.424 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:50.424 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:50.424 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:50.424 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.424 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.424 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:139207 5.4 5:2fefe143:::benchmark_data_smithi096_19531_object25757:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-19T03:02:50.424 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:50.406664+0000", 2024-04-19T03:02:50.424 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0010145569999999999, 2024-04-19T03:02:50.424 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001169294, 2024-04-19T03:02:50.424 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:50.424 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-19T03:02:50.425 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:50.425 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:50.425 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:50.425 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 139207 2024-04-19T03:02:50.425 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.425 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:50.425 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.425 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:50.425 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:50.406664+0000", 2024-04-19T03:02:50.425 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:50.425 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.425 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.425 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:50.425 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:50.406664+0000", 2024-04-19T03:02:50.426 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:50.426 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.426 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.426 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:50.426 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:50.406663+0000", 2024-04-19T03:02:50.426 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:50.426 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.426 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.426 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:50.426 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:50.406669+0000", 2024-04-19T03:02:50.426 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5570000000000003e-06 2024-04-19T03:02:50.426 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.426 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.427 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:50.427 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:50.406681+0000", 2024-04-19T03:02:50.427 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2697000000000001e-05 2024-04-19T03:02:50.427 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.427 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.427 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:50.427 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:50.406687+0000", 2024-04-19T03:02:50.427 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7049999999999996e-06 2024-04-19T03:02:50.427 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.427 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.427 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:50.427 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:50.406728+0000", 2024-04-19T03:02:50.427 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1009e-05 2024-04-19T03:02:50.427 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.428 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.428 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:50.428 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:50.406898+0000", 2024-04-19T03:02:50.428 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016961600000000001 2024-04-19T03:02:50.428 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:50.428 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:50.428 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:50.428 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.428 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.428 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:139188 5.e 5:74f84a40:::benchmark_data_smithi096_19531_object25738:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-19T03:02:50.428 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:50.401225+0000", 2024-04-19T03:02:50.428 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.006454156, 2024-04-19T03:02:50.428 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0066429310000000004, 2024-04-19T03:02:50.428 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:50.429 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-19T03:02:50.429 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:50.429 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:50.429 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:50.429 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 139188 2024-04-19T03:02:50.429 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.429 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:50.429 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.429 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:50.429 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:50.401225+0000", 2024-04-19T03:02:50.429 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:50.429 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.429 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.429 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:50.430 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:50.401225+0000", 2024-04-19T03:02:50.430 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:50.430 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.430 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.430 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:50.430 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:50.401223+0000", 2024-04-19T03:02:50.430 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:50.430 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.430 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.430 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:50.430 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:50.401230+0000", 2024-04-19T03:02:50.430 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.9129999999999997e-06 2024-04-19T03:02:50.431 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.431 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.431 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:50.431 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:50.401242+0000", 2024-04-19T03:02:50.431 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1654000000000001e-05 2024-04-19T03:02:50.431 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.431 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.431 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:50.431 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:50.401251+0000", 2024-04-19T03:02:50.431 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1169999999999993e-06 2024-04-19T03:02:50.431 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.431 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.431 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:50.431 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:50.401310+0000", 2024-04-19T03:02:50.432 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9233e-05 2024-04-19T03:02:50.432 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.432 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.432 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:50.432 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:50.401453+0000", 2024-04-19T03:02:50.432 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014273500000000001 2024-04-19T03:02:50.432 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:50.432 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:50.432 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:50.432 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.432 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.432 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:139189 5.e 5:7c0093e9:::benchmark_data_smithi096_19531_object25739:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-19T03:02:50.432 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:50.401268+0000", 2024-04-19T03:02:50.432 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0064102509999999996, 2024-04-19T03:02:50.432 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0066627409999999998, 2024-04-19T03:02:50.433 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:50.433 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-19T03:02:50.433 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:50.433 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:50.433 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:50.433 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 139189 2024-04-19T03:02:50.433 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.433 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:50.433 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.433 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:50.433 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:50.401268+0000", 2024-04-19T03:02:50.433 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:50.433 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.433 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.434 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:50.434 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:50.401268+0000", 2024-04-19T03:02:50.434 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:50.434 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.434 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.434 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:50.434 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:50.401268+0000", 2024-04-19T03:02:50.434 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:50.434 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.434 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.434 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:50.434 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:50.401272+0000", 2024-04-19T03:02:50.434 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7639999999999999e-06 2024-04-19T03:02:50.435 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.435 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.435 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:50.435 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:50.401279+0000", 2024-04-19T03:02:50.435 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.7770000000000002e-06 2024-04-19T03:02:50.435 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.435 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.435 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:50.435 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:50.401288+0000", 2024-04-19T03:02:50.435 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.8380000000000008e-06 2024-04-19T03:02:50.435 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.435 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.435 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:50.435 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:50.403408+0000", 2024-04-19T03:02:50.435 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0021199679999999999 2024-04-19T03:02:50.436 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.436 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.436 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:50.436 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:50.403535+0000", 2024-04-19T03:02:50.436 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012640199999999999 2024-04-19T03:02:50.436 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:50.436 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:50.436 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:50.436 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:50.436 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-04-19T03:02:50.436 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 7 2024-04-19T03:02:50.436 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-19T03:02:50.437 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T03:02:50.479 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:50.477+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:50.482 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-19T03:02:50.563 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-19T03:02:50.563 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-04-19T03:02:50.563 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-04-19T03:02:50.564 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-04-19T03:02:50.564 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-19T03:02:50.576 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T03:02:50.580 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:50.579+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:50.682 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:50.680+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:50.702 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-19T03:02:50.702 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-04-19T03:02:50.702 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-04-19T03:02:50.702 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-04-19T03:02:50.703 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.703 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:79014 5.d 5:b5eee02c:::benchmark_data_smithi096_19531_object79013:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-19T03:02:50.703 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:18.032471+0000", 2024-04-19T03:02:50.703 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 32.667028889999997, 2024-04-19T03:02:50.703 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.041427629000000001, 2024-04-19T03:02:50.703 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:50.703 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:50.703 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:50.703 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:50.703 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:50.703 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 79014 2024-04-19T03:02:50.703 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.703 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:50.703 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.704 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:50.704 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:18.032471+0000", 2024-04-19T03:02:50.704 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:50.704 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.704 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.704 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:50.704 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:18.032471+0000", 2024-04-19T03:02:50.704 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:50.704 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.704 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.704 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:50.704 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:18.032470+0000", 2024-04-19T03:02:50.704 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:50.704 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.705 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.705 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:50.705 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:18.032525+0000", 2024-04-19T03:02:50.705 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5535999999999998e-05 2024-04-19T03:02:50.705 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.705 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.705 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:50.705 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:18.032537+0000", 2024-04-19T03:02:50.705 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1987999999999999e-05 2024-04-19T03:02:50.705 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.705 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.705 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:50.705 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:18.032546+0000", 2024-04-19T03:02:50.705 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9670000000000007e-06 2024-04-19T03:02:50.706 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.706 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.706 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:50.706 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:18.032613+0000", 2024-04-19T03:02:50.706 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6508999999999996e-05 2024-04-19T03:02:50.706 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.706 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.706 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:50.706 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:18.032738+0000", 2024-04-19T03:02:50.706 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000124912 2024-04-19T03:02:50.706 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.706 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.706 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-04-19T03:02:50.707 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:18.032867+0000", 2024-04-19T03:02:50.707 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012959399999999999 2024-04-19T03:02:50.707 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.707 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.707 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:50.707 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:18.035867+0000", 2024-04-19T03:02:50.707 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.002999378 2024-04-19T03:02:50.707 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.707 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.707 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:50.707 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:18.073705+0000", 2024-04-19T03:02:50.707 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.037838042000000002 2024-04-19T03:02:50.707 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.707 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.708 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:50.708 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:18.073813+0000", 2024-04-19T03:02:50.708 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010806099999999999 2024-04-19T03:02:50.708 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.708 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.708 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:50.708 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:18.073899+0000", 2024-04-19T03:02:50.708 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.5971999999999996e-05 2024-04-19T03:02:50.708 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:50.708 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:50.708 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:50.708 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.708 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.708 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:86615 5.e 5:7fef7288:::benchmark_data_smithi096_19531_object86614:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:50.709 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:22.634544+0000", 2024-04-19T03:02:50.709 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 28.064955910999998, 2024-04-19T03:02:50.709 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.192475071, 2024-04-19T03:02:50.709 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:50.709 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:50.709 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:50.709 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:50.709 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:50.709 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 86615 2024-04-19T03:02:50.709 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.709 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:50.709 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.709 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:50.709 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634544+0000", 2024-04-19T03:02:50.710 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:50.710 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.710 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.710 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:50.710 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634544+0000", 2024-04-19T03:02:50.710 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:50.710 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.710 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.710 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:50.710 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634542+0000", 2024-04-19T03:02:50.710 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999981 2024-04-19T03:02:50.710 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.710 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.711 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:50.711 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634585+0000", 2024-04-19T03:02:50.711 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2299000000000003e-05 2024-04-19T03:02:50.711 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.711 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.711 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:50.711 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634592+0000", 2024-04-19T03:02:50.711 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2350000000000002e-06 2024-04-19T03:02:50.711 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.711 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.711 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:50.711 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634596+0000", 2024-04-19T03:02:50.711 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5390000000000001e-06 2024-04-19T03:02:50.711 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.712 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.712 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:50.712 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634639+0000", 2024-04-19T03:02:50.712 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2444999999999998e-05 2024-04-19T03:02:50.712 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.712 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.712 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:50.712 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634808+0000", 2024-04-19T03:02:50.712 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000169152 2024-04-19T03:02:50.712 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.712 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.712 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:50.712 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634999+0000", 2024-04-19T03:02:50.712 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00019098300000000001 2024-04-19T03:02:50.713 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.713 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.713 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:50.713 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.640458+0000", 2024-04-19T03:02:50.713 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0054586870000000003 2024-04-19T03:02:50.713 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.713 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.713 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:50.713 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.826949+0000", 2024-04-19T03:02:50.713 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.18649178299999999 2024-04-19T03:02:50.713 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.713 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.713 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:50.713 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.826982+0000", 2024-04-19T03:02:50.714 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2477000000000001e-05 2024-04-19T03:02:50.714 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.714 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.714 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:50.714 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.827019+0000", 2024-04-19T03:02:50.714 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7355999999999999e-05 2024-04-19T03:02:50.714 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:50.714 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:50.714 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:50.714 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.714 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.714 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:86616 5.e 5:72278f47:::benchmark_data_smithi096_19531_object86615:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:50.714 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:22.634609+0000", 2024-04-19T03:02:50.715 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 28.064890762000001, 2024-04-19T03:02:50.715 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.19472088900000001, 2024-04-19T03:02:50.715 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:50.715 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:50.715 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:50.715 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:50.715 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:50.715 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 86616 2024-04-19T03:02:50.715 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.715 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:50.715 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.715 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:50.715 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634609+0000", 2024-04-19T03:02:50.715 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:50.716 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.716 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.716 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:50.716 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634609+0000", 2024-04-19T03:02:50.716 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:50.716 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.716 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.716 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:50.716 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634609+0000", 2024-04-19T03:02:50.716 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:50.716 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.716 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.716 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:50.716 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634651+0000", 2024-04-19T03:02:50.717 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2589000000000002e-05 2024-04-19T03:02:50.717 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.717 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.717 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:50.717 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634659+0000", 2024-04-19T03:02:50.717 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5850000000000002e-06 2024-04-19T03:02:50.717 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.717 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.717 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:50.717 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634662+0000", 2024-04-19T03:02:50.717 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3620000000000002e-06 2024-04-19T03:02:50.717 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.717 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.717 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:50.718 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.637880+0000", 2024-04-19T03:02:50.718 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.003218149 2024-04-19T03:02:50.718 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.718 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.718 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:50.718 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.637999+0000", 2024-04-19T03:02:50.718 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000118643 2024-04-19T03:02:50.718 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.718 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.718 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:50.718 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.638102+0000", 2024-04-19T03:02:50.718 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010331 2024-04-19T03:02:50.718 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.718 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.719 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:50.719 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.640851+0000", 2024-04-19T03:02:50.719 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0027483310000000001 2024-04-19T03:02:50.719 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.719 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.719 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:50.719 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.829269+0000", 2024-04-19T03:02:50.719 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.188418319 2024-04-19T03:02:50.719 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.719 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.719 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:50.719 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.829299+0000", 2024-04-19T03:02:50.719 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0227e-05 2024-04-19T03:02:50.720 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.720 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.720 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:50.720 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.829330+0000", 2024-04-19T03:02:50.720 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0969000000000001e-05 2024-04-19T03:02:50.720 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:50.720 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:50.720 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:50.720 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.720 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.720 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:86618 5.0 5:09014b90:::benchmark_data_smithi096_19531_object86617:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:50.720 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:22.634894+0000", 2024-04-19T03:02:50.720 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 28.064606273999999, 2024-04-19T03:02:50.720 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.19413419800000001, 2024-04-19T03:02:50.720 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:50.721 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:50.721 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:50.721 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:50.721 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:50.721 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 86618 2024-04-19T03:02:50.721 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.721 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:50.721 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.721 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:50.721 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634894+0000", 2024-04-19T03:02:50.721 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:50.721 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.721 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.722 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:50.722 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634894+0000", 2024-04-19T03:02:50.722 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:50.722 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.722 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.722 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:50.722 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634893+0000", 2024-04-19T03:02:50.722 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:50.722 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.722 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.722 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:50.722 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634976+0000", 2024-04-19T03:02:50.722 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3231000000000003e-05 2024-04-19T03:02:50.722 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.723 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.723 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:50.723 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634983+0000", 2024-04-19T03:02:50.723 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5169999999999996e-06 2024-04-19T03:02:50.723 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.723 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.723 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:50.723 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634987+0000", 2024-04-19T03:02:50.723 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.425e-06 2024-04-19T03:02:50.723 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.723 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.723 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:50.723 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635030+0000", 2024-04-19T03:02:50.723 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.32e-05 2024-04-19T03:02:50.724 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.724 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.724 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:50.724 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635185+0000", 2024-04-19T03:02:50.724 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015471899999999999 2024-04-19T03:02:50.724 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.724 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.724 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:50.724 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635415+0000", 2024-04-19T03:02:50.724 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00023026500000000001 2024-04-19T03:02:50.724 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.724 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.724 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:50.724 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.640127+0000", 2024-04-19T03:02:50.725 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0047118890000000004 2024-04-19T03:02:50.725 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.725 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.725 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:50.725 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.828895+0000", 2024-04-19T03:02:50.725 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.18876802600000001 2024-04-19T03:02:50.725 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.725 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.725 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:50.725 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.828972+0000", 2024-04-19T03:02:50.725 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.6345000000000002e-05 2024-04-19T03:02:50.725 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.725 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.725 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:50.726 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.829028+0000", 2024-04-19T03:02:50.726 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6342999999999999e-05 2024-04-19T03:02:50.726 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:50.726 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:50.726 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:50.726 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.726 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.726 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:86620 5.b 5:d80faa68:::benchmark_data_smithi096_19531_object86619:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:50.726 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:22.635110+0000", 2024-04-19T03:02:50.726 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 28.064389714000001, 2024-04-19T03:02:50.726 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.193447275, 2024-04-19T03:02:50.726 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:50.726 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:50.727 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:50.727 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:50.727 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:50.727 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 86620 2024-04-19T03:02:50.727 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.727 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:50.727 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.727 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:50.727 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635110+0000", 2024-04-19T03:02:50.727 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:50.727 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.727 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.727 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:50.727 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635110+0000", 2024-04-19T03:02:50.728 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:50.728 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.728 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.728 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:50.728 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635110+0000", 2024-04-19T03:02:50.728 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:50.728 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.728 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.728 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:50.728 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635154+0000", 2024-04-19T03:02:50.728 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4681000000000001e-05 2024-04-19T03:02:50.728 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.728 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.728 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:50.729 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635166+0000", 2024-04-19T03:02:50.729 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1505000000000001e-05 2024-04-19T03:02:50.729 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.729 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.729 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:50.729 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635171+0000", 2024-04-19T03:02:50.729 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6040000000000003e-06 2024-04-19T03:02:50.729 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.729 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.729 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:50.729 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635221+0000", 2024-04-19T03:02:50.729 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9947000000000001e-05 2024-04-19T03:02:50.729 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.729 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.730 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:50.730 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635356+0000", 2024-04-19T03:02:50.730 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013576199999999999 2024-04-19T03:02:50.730 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.730 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.730 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:50.730 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635507+0000", 2024-04-19T03:02:50.730 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015072999999999999 2024-04-19T03:02:50.730 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.730 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.730 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:50.730 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.638488+0000", 2024-04-19T03:02:50.730 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0029813159999999999 2024-04-19T03:02:50.730 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.731 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.733 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:50.733 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.828341+0000", 2024-04-19T03:02:50.733 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.189852254 2024-04-19T03:02:50.733 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.733 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.734 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:50.734 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.828416+0000", 2024-04-19T03:02:50.734 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5344000000000002e-05 2024-04-19T03:02:50.734 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.734 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.734 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:50.734 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.828558+0000", 2024-04-19T03:02:50.734 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000141695 2024-04-19T03:02:50.734 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:50.734 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:50.734 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:50.734 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.734 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.735 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:86621 5.8 5:1597a420:::benchmark_data_smithi096_19531_object86620:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:50.735 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:22.635187+0000", 2024-04-19T03:02:50.735 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 28.064312854000001, 2024-04-19T03:02:50.735 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.194204878, 2024-04-19T03:02:50.735 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:50.735 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:50.735 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:50.735 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:50.735 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:50.735 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 86621 2024-04-19T03:02:50.735 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.735 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:50.735 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.735 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:50.736 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635187+0000", 2024-04-19T03:02:50.736 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:50.736 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.736 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.736 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:50.736 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635187+0000", 2024-04-19T03:02:50.736 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:50.736 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.736 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.736 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:50.736 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635187+0000", 2024-04-19T03:02:50.736 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:50.736 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.736 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.737 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:50.737 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635242+0000", 2024-04-19T03:02:50.737 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5158000000000003e-05 2024-04-19T03:02:50.737 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.737 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.737 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:50.737 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635249+0000", 2024-04-19T03:02:50.737 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.7000000000000008e-06 2024-04-19T03:02:50.737 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.737 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.737 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:50.737 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635256+0000", 2024-04-19T03:02:50.737 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2060000000000004e-06 2024-04-19T03:02:50.737 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.738 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.738 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:50.738 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635302+0000", 2024-04-19T03:02:50.738 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5954000000000001e-05 2024-04-19T03:02:50.738 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.738 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.738 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:50.738 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635427+0000", 2024-04-19T03:02:50.738 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012559299999999999 2024-04-19T03:02:50.738 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.738 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.738 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:50.738 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635596+0000", 2024-04-19T03:02:50.738 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000168615 2024-04-19T03:02:50.739 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.739 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.739 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:50.739 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.639320+0000", 2024-04-19T03:02:50.739 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0037244610000000001 2024-04-19T03:02:50.739 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.739 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.739 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:50.739 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.829277+0000", 2024-04-19T03:02:50.739 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.18995651099999999 2024-04-19T03:02:50.739 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.739 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.739 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:50.739 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.829341+0000", 2024-04-19T03:02:50.740 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3756000000000004e-05 2024-04-19T03:02:50.740 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.740 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.740 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:50.740 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.829392+0000", 2024-04-19T03:02:50.740 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1555999999999999e-05 2024-04-19T03:02:50.740 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:50.740 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:50.740 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:50.740 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.740 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.740 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87062 5.4 5:2d3b5d9a:::benchmark_data_smithi096_19531_object87061:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:50.740 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.136820+0000", 2024-04-19T03:02:50.740 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 27.562679701, 2024-04-19T03:02:50.741 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.066483741999999998, 2024-04-19T03:02:50.741 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:50.741 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:50.741 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:50.741 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:50.741 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:50.741 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87062 2024-04-19T03:02:50.741 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.741 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:50.741 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.741 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:50.741 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.136820+0000", 2024-04-19T03:02:50.741 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:50.741 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.742 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.742 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:50.742 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.136820+0000", 2024-04-19T03:02:50.742 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:50.742 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.742 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.742 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:50.742 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.136819+0000", 2024-04-19T03:02:50.742 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:50.742 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.742 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.742 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:50.742 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.136864+0000", 2024-04-19T03:02:50.742 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4855000000000003e-05 2024-04-19T03:02:50.743 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.743 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.743 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:50.743 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.136881+0000", 2024-04-19T03:02:50.743 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7521999999999999e-05 2024-04-19T03:02:50.743 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.743 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.743 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:50.743 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.136890+0000", 2024-04-19T03:02:50.743 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1039999999999996e-06 2024-04-19T03:02:50.743 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.743 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.743 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:50.743 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.136974+0000", 2024-04-19T03:02:50.743 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3735999999999999e-05 2024-04-19T03:02:50.744 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.744 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.744 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:50.744 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.137308+0000", 2024-04-19T03:02:50.744 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00033376100000000002 2024-04-19T03:02:50.744 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.744 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.744 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:50.744 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.137559+0000", 2024-04-19T03:02:50.744 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000250599 2024-04-19T03:02:50.744 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.744 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.744 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:50.744 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.145423+0000", 2024-04-19T03:02:50.745 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0078649589999999995 2024-04-19T03:02:50.745 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.745 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.745 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:50.745 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.203175+0000", 2024-04-19T03:02:50.745 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057751255000000001 2024-04-19T03:02:50.745 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.745 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.745 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:50.745 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.203250+0000", 2024-04-19T03:02:50.745 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5378999999999998e-05 2024-04-19T03:02:50.745 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.745 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.745 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:50.746 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.203304+0000", 2024-04-19T03:02:50.746 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4015999999999999e-05 2024-04-19T03:02:50.746 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:50.746 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:50.746 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:50.746 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.746 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.746 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87065 5.4 5:21d20a47:::benchmark_data_smithi096_19531_object87064:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:50.746 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.137482+0000", 2024-04-19T03:02:50.746 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 27.562017966999999, 2024-04-19T03:02:50.746 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.065988749999999999, 2024-04-19T03:02:50.746 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:50.746 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:50.747 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:50.747 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:50.747 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:50.747 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87065 2024-04-19T03:02:50.747 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.747 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:50.747 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.747 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:50.747 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.137482+0000", 2024-04-19T03:02:50.747 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:50.747 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.747 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.747 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:50.747 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.137482+0000", 2024-04-19T03:02:50.748 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:50.748 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.748 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.748 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:50.748 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.137481+0000", 2024-04-19T03:02:50.748 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:50.748 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.748 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.748 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:50.748 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.137530+0000", 2024-04-19T03:02:50.748 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9302000000000003e-05 2024-04-19T03:02:50.748 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.748 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.749 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:50.749 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.137540+0000", 2024-04-19T03:02:50.749 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.2010000000000005e-06 2024-04-19T03:02:50.749 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.749 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.749 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:50.749 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.137545+0000", 2024-04-19T03:02:50.749 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5910000000000003e-06 2024-04-19T03:02:50.749 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.749 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.749 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:50.749 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.140666+0000", 2024-04-19T03:02:50.749 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0031212710000000001 2024-04-19T03:02:50.749 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.750 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.750 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:50.750 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.140847+0000", 2024-04-19T03:02:50.750 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00018065600000000001 2024-04-19T03:02:50.750 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.750 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.750 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:50.750 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.140991+0000", 2024-04-19T03:02:50.750 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014433100000000001 2024-04-19T03:02:50.750 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.750 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.750 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:50.751 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.148053+0000", 2024-04-19T03:02:50.751 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.007061945 2024-04-19T03:02:50.751 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.751 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.751 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:50.751 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.203367+0000", 2024-04-19T03:02:50.751 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.055313703999999998 2024-04-19T03:02:50.751 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.751 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.751 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:50.751 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.203426+0000", 2024-04-19T03:02:50.751 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9024000000000003e-05 2024-04-19T03:02:50.751 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.751 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.752 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:50.752 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.203471+0000", 2024-04-19T03:02:50.752 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4818999999999999e-05 2024-04-19T03:02:50.752 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:50.752 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:50.752 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:50.752 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.752 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.752 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87067 5.b 5:d57af71a:::benchmark_data_smithi096_19531_object87066:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:50.752 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.142233+0000", 2024-04-19T03:02:50.752 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 27.557266990999999, 2024-04-19T03:02:50.752 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.071692405000000001, 2024-04-19T03:02:50.752 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:50.753 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:50.753 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:50.753 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:50.753 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:50.753 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87067 2024-04-19T03:02:50.753 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.753 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:50.753 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.753 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:50.753 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142233+0000", 2024-04-19T03:02:50.753 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:50.753 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.753 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.753 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:50.754 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142233+0000", 2024-04-19T03:02:50.754 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:50.754 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.754 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.754 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:50.754 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142232+0000", 2024-04-19T03:02:50.754 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:50.754 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.754 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.754 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:50.754 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142277+0000", 2024-04-19T03:02:50.754 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5837000000000002e-05 2024-04-19T03:02:50.754 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.754 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.755 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:50.755 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142297+0000", 2024-04-19T03:02:50.755 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9561000000000001e-05 2024-04-19T03:02:50.755 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.755 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.755 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:50.755 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142311+0000", 2024-04-19T03:02:50.755 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3654e-05 2024-04-19T03:02:50.755 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.755 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.755 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:50.755 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142391+0000", 2024-04-19T03:02:50.755 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0123999999999994e-05 2024-04-19T03:02:50.755 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.756 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.756 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:50.756 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142669+0000", 2024-04-19T03:02:50.756 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00027829800000000001 2024-04-19T03:02:50.756 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.756 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.756 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:50.756 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142859+0000", 2024-04-19T03:02:50.756 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000190051 2024-04-19T03:02:50.756 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.756 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.756 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:50.756 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.150597+0000", 2024-04-19T03:02:50.756 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0077380299999999999 2024-04-19T03:02:50.757 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.757 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.757 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:50.757 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.213855+0000", 2024-04-19T03:02:50.757 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.063257987000000002 2024-04-19T03:02:50.757 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.757 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.757 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:50.757 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.213898+0000", 2024-04-19T03:02:50.757 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2916e-05 2024-04-19T03:02:50.757 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.757 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.757 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:50.757 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.213925+0000", 2024-04-19T03:02:50.758 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7503000000000001e-05 2024-04-19T03:02:50.758 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:50.758 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:50.758 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:50.758 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.758 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.758 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87069 5.b 5:da0c93b5:::benchmark_data_smithi096_19531_object87068:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:50.758 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.143402+0000", 2024-04-19T03:02:50.758 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 27.556098029000001, 2024-04-19T03:02:50.758 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.070678598999999995, 2024-04-19T03:02:50.758 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:50.758 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:50.758 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:50.758 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:50.759 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:50.759 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87069 2024-04-19T03:02:50.759 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.759 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:50.759 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.759 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:50.759 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.143402+0000", 2024-04-19T03:02:50.759 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:50.759 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.759 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.759 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:50.759 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.143402+0000", 2024-04-19T03:02:50.759 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:50.760 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.760 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.760 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:50.760 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.143401+0000", 2024-04-19T03:02:50.760 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:50.760 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.760 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.760 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:50.760 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.143501+0000", 2024-04-19T03:02:50.760 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000100387 2024-04-19T03:02:50.760 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.760 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.760 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:50.760 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.143516+0000", 2024-04-19T03:02:50.760 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5369000000000001e-05 2024-04-19T03:02:50.761 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.761 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.761 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:50.761 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.143524+0000", 2024-04-19T03:02:50.761 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.7079999999999997e-06 2024-04-19T03:02:50.761 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.761 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.761 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:50.761 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.145550+0000", 2024-04-19T03:02:50.761 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0020259290000000001 2024-04-19T03:02:50.761 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.761 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.761 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:50.762 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.145676+0000", 2024-04-19T03:02:50.762 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000126406 2024-04-19T03:02:50.762 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.762 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.762 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:50.762 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.145802+0000", 2024-04-19T03:02:50.762 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000125974 2024-04-19T03:02:50.762 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.762 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.762 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:50.762 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.151030+0000", 2024-04-19T03:02:50.762 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0052276079999999999 2024-04-19T03:02:50.762 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.762 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.763 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:50.763 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.213998+0000", 2024-04-19T03:02:50.763 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.06296786 2024-04-19T03:02:50.763 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.763 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.763 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:50.763 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.214031+0000", 2024-04-19T03:02:50.763 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3387999999999999e-05 2024-04-19T03:02:50.763 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.763 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.763 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:50.763 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.214081+0000", 2024-04-19T03:02:50.763 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9316e-05 2024-04-19T03:02:50.763 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:50.764 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:50.764 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:50.764 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.764 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.764 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87073 5.0 5:0ca21233:::benchmark_data_smithi096_19531_object87072:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:50.764 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.145929+0000", 2024-04-19T03:02:50.764 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 27.553570769, 2024-04-19T03:02:50.764 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.062283234999999999, 2024-04-19T03:02:50.764 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:50.764 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:50.764 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:50.764 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:50.764 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:50.764 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87073 2024-04-19T03:02:50.765 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.765 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:50.765 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.765 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:50.765 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.145929+0000", 2024-04-19T03:02:50.765 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:50.765 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.765 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.765 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:50.765 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.145929+0000", 2024-04-19T03:02:50.765 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:50.765 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.765 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.765 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:50.766 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.145928+0000", 2024-04-19T03:02:50.766 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:50.766 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.766 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.766 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:50.766 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.146063+0000", 2024-04-19T03:02:50.766 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013541099999999999 2024-04-19T03:02:50.766 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.766 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.766 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:50.766 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.146079+0000", 2024-04-19T03:02:50.766 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5902000000000001e-05 2024-04-19T03:02:50.766 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.766 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.767 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:50.767 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.146100+0000", 2024-04-19T03:02:50.767 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0380000000000001e-05 2024-04-19T03:02:50.767 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.767 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.767 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:50.767 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.146193+0000", 2024-04-19T03:02:50.767 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.3669000000000001e-05 2024-04-19T03:02:50.767 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.767 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.767 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:50.767 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.146388+0000", 2024-04-19T03:02:50.767 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00019457799999999999 2024-04-19T03:02:50.767 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.768 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.768 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:50.768 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.146625+0000", 2024-04-19T03:02:50.768 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00023751999999999999 2024-04-19T03:02:50.768 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.768 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.768 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:50.768 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.151051+0000", 2024-04-19T03:02:50.768 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0044260039999999999 2024-04-19T03:02:50.768 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.768 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.768 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:50.768 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.207872+0000", 2024-04-19T03:02:50.768 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.056821114999999998 2024-04-19T03:02:50.769 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.769 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.769 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:50.769 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.208085+0000", 2024-04-19T03:02:50.769 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000212893 2024-04-19T03:02:50.769 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.769 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.769 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:50.769 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.208213+0000", 2024-04-19T03:02:50.769 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012714700000000001 2024-04-19T03:02:50.769 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:50.769 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:50.769 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:50.769 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.770 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.770 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87074 5.0 5:035614ac:::benchmark_data_smithi096_19531_object87073:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:50.770 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.151387+0000", 2024-04-19T03:02:50.770 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 27.548112838000002, 2024-04-19T03:02:50.770 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.063461771, 2024-04-19T03:02:50.770 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:50.770 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:50.770 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:50.770 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:50.770 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:50.770 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87074 2024-04-19T03:02:50.770 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.770 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:50.770 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.771 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:50.771 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.151387+0000", 2024-04-19T03:02:50.771 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:50.771 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.771 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.771 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:50.771 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.151387+0000", 2024-04-19T03:02:50.771 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:50.771 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.771 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.771 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:50.771 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.151386+0000", 2024-04-19T03:02:50.771 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:50.771 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.771 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.772 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:50.772 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.151428+0000", 2024-04-19T03:02:50.772 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.172e-05 2024-04-19T03:02:50.772 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.772 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.772 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:50.772 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.151442+0000", 2024-04-19T03:02:50.772 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4328000000000001e-05 2024-04-19T03:02:50.772 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.772 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.772 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:50.772 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.151451+0000", 2024-04-19T03:02:50.772 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.8400000000000001e-06 2024-04-19T03:02:50.772 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.773 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.773 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:50.773 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.151521+0000", 2024-04-19T03:02:50.773 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.9606999999999999e-05 2024-04-19T03:02:50.773 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.773 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.773 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:50.773 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.151749+0000", 2024-04-19T03:02:50.773 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00022818799999999999 2024-04-19T03:02:50.773 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.773 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.773 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:50.773 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.152006+0000", 2024-04-19T03:02:50.773 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00025687300000000002 2024-04-19T03:02:50.774 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.774 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.774 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:50.774 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.154887+0000", 2024-04-19T03:02:50.774 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0028812989999999999 2024-04-19T03:02:50.774 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.774 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.774 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:50.774 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.214733+0000", 2024-04-19T03:02:50.774 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.059846159000000003 2024-04-19T03:02:50.774 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.774 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.774 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:50.774 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.214788+0000", 2024-04-19T03:02:50.775 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4524000000000002e-05 2024-04-19T03:02:50.775 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.775 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.775 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:50.775 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.214849+0000", 2024-04-19T03:02:50.775 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1362e-05 2024-04-19T03:02:50.775 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:50.775 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:50.775 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:50.775 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.775 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.775 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87108 5.e 5:7e197adc:::benchmark_data_smithi096_19531_object87107:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:50.775 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.223103+0000", 2024-04-19T03:02:50.775 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 27.476396692000002, 2024-04-19T03:02:50.776 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.044946887, 2024-04-19T03:02:50.776 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:50.776 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-19T03:02:50.776 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:50.776 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:50.776 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:50.776 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87108 2024-04-19T03:02:50.776 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.776 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:50.776 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.776 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:50.776 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.223103+0000", 2024-04-19T03:02:50.776 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:50.776 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.777 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.777 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:50.777 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.223103+0000", 2024-04-19T03:02:50.777 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:50.777 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.777 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.777 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:50.777 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.223102+0000", 2024-04-19T03:02:50.777 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:50.777 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.777 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.777 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:50.777 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.223156+0000", 2024-04-19T03:02:50.777 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3958000000000001e-05 2024-04-19T03:02:50.778 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.778 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.778 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:50.778 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.223166+0000", 2024-04-19T03:02:50.778 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.4809999999999995e-06 2024-04-19T03:02:50.778 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.778 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.778 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:50.778 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.223172+0000", 2024-04-19T03:02:50.778 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0140000000000004e-06 2024-04-19T03:02:50.778 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.778 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.778 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:50.779 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.227295+0000", 2024-04-19T03:02:50.779 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0041233420000000003 2024-04-19T03:02:50.779 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.779 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.779 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:50.779 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.227495+0000", 2024-04-19T03:02:50.779 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00019955299999999999 2024-04-19T03:02:50.779 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.779 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.779 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:50.779 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.227717+0000", 2024-04-19T03:02:50.779 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000221902 2024-04-19T03:02:50.779 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.779 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.779 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:50.780 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233189+0000", 2024-04-19T03:02:50.780 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0054718889999999997 2024-04-19T03:02:50.780 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.780 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.780 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:50.780 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.250529+0000", 2024-04-19T03:02:50.780 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.017340298000000001 2024-04-19T03:02:50.780 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.780 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.780 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:02:50.780 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.250539+0000", 2024-04-19T03:02:50.780 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0501e-05 2024-04-19T03:02:50.780 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.781 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.781 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:50.781 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.268003+0000", 2024-04-19T03:02:50.781 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.017463429 2024-04-19T03:02:50.781 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.781 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.781 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:50.781 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.268050+0000", 2024-04-19T03:02:50.781 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7466000000000003e-05 2024-04-19T03:02:50.781 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:50.781 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:50.781 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:50.781 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.781 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.782 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87118 5.b 5:d1bb4f3c:::benchmark_data_smithi096_19531_object87117:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:50.782 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.231082+0000", 2024-04-19T03:02:50.782 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 27.468417857999999, 2024-04-19T03:02:50.782 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.035789004, 2024-04-19T03:02:50.782 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:50.782 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-19T03:02:50.782 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:50.782 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:50.782 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:50.782 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87118 2024-04-19T03:02:50.782 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.782 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:50.782 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.783 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:50.783 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231082+0000", 2024-04-19T03:02:50.783 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:50.783 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.783 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.783 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:50.783 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231082+0000", 2024-04-19T03:02:50.783 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:50.783 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.783 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.783 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:50.783 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231081+0000", 2024-04-19T03:02:50.783 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:50.783 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.783 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.784 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:50.784 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231159+0000", 2024-04-19T03:02:50.784 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.7819999999999997e-05 2024-04-19T03:02:50.784 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.784 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.784 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:50.784 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231186+0000", 2024-04-19T03:02:50.784 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7126000000000001e-05 2024-04-19T03:02:50.784 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.784 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.784 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:50.784 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231193+0000", 2024-04-19T03:02:50.784 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7259999999999996e-06 2024-04-19T03:02:50.784 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.785 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.785 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:50.785 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231241+0000", 2024-04-19T03:02:50.785 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8123e-05 2024-04-19T03:02:50.785 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.785 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.785 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:50.785 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231354+0000", 2024-04-19T03:02:50.785 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0001133 2024-04-19T03:02:50.785 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.785 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.785 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:50.785 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231443+0000", 2024-04-19T03:02:50.785 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9167999999999997e-05 2024-04-19T03:02:50.786 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.786 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.786 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:50.786 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236498+0000", 2024-04-19T03:02:50.786 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0050545160000000002 2024-04-19T03:02:50.786 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.786 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.786 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:50.786 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.249681+0000", 2024-04-19T03:02:50.786 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013183321 2024-04-19T03:02:50.786 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.786 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.786 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:02:50.786 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.249693+0000", 2024-04-19T03:02:50.787 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1834999999999999e-05 2024-04-19T03:02:50.787 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.787 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.787 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:50.787 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266733+0000", 2024-04-19T03:02:50.787 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.017040408 2024-04-19T03:02:50.787 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.787 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.787 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:50.787 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266871+0000", 2024-04-19T03:02:50.787 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000137849 2024-04-19T03:02:50.787 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:50.787 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:50.787 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:50.788 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.788 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.788 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87121 5.b 5:d01822b8:::benchmark_data_smithi096_19531_object87120:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:50.788 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.233319+0000", 2024-04-19T03:02:50.788 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 27.466180993999998, 2024-04-19T03:02:50.788 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.033624198, 2024-04-19T03:02:50.788 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:50.788 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-19T03:02:50.788 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:50.788 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:50.788 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:50.788 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87121 2024-04-19T03:02:50.788 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.788 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:50.789 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.789 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:50.789 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233319+0000", 2024-04-19T03:02:50.789 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:50.789 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.789 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.789 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:50.789 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233319+0000", 2024-04-19T03:02:50.789 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:50.789 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.789 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.789 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:50.789 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233319+0000", 2024-04-19T03:02:50.789 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:50.789 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.790 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.790 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:50.790 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233364+0000", 2024-04-19T03:02:50.790 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5460999999999997e-05 2024-04-19T03:02:50.790 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.790 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.790 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:50.790 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233382+0000", 2024-04-19T03:02:50.790 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8148e-05 2024-04-19T03:02:50.790 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.790 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.790 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:50.790 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233390+0000", 2024-04-19T03:02:50.791 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5340000000000002e-06 2024-04-19T03:02:50.791 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.791 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.791 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:50.791 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233712+0000", 2024-04-19T03:02:50.791 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00032260500000000001 2024-04-19T03:02:50.791 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.791 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.791 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:50.791 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233829+0000", 2024-04-19T03:02:50.791 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011638599999999999 2024-04-19T03:02:50.791 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.791 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.791 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:50.791 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233959+0000", 2024-04-19T03:02:50.792 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013013900000000001 2024-04-19T03:02:50.792 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.792 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.792 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:50.792 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236515+0000", 2024-04-19T03:02:50.792 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0025562750000000002 2024-04-19T03:02:50.792 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.792 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.792 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:50.792 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.249723+0000", 2024-04-19T03:02:50.792 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013208176 2024-04-19T03:02:50.792 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.792 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.792 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:02:50.793 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.249728+0000", 2024-04-19T03:02:50.793 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6519999999999997e-06 2024-04-19T03:02:50.793 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.793 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.793 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:50.793 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266837+0000", 2024-04-19T03:02:50.793 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0171087059999999 2024-04-19T03:02:50.793 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.793 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.793 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:50.793 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266943+0000", 2024-04-19T03:02:50.793 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000106604 2024-04-19T03:02:50.793 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:50.793 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:50.794 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:50.794 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.794 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.794 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87124 5.8 5:14819ad7:::benchmark_data_smithi096_19531_object87123:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:50.794 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.235886+0000", 2024-04-19T03:02:50.794 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 27.46361357, 2024-04-19T03:02:50.794 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0315451179999999, 2024-04-19T03:02:50.794 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:50.794 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-19T03:02:50.794 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:50.794 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:50.794 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:50.794 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87124 2024-04-19T03:02:50.794 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.795 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:50.795 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.795 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:50.795 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.235886+0000", 2024-04-19T03:02:50.795 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:50.795 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.795 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.795 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:50.795 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.235886+0000", 2024-04-19T03:02:50.795 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:50.795 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.795 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.795 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:50.796 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.235886+0000", 2024-04-19T03:02:50.796 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:50.796 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.796 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.796 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:50.796 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.235934+0000", 2024-04-19T03:02:50.796 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8384000000000003e-05 2024-04-19T03:02:50.796 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.796 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.796 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:50.796 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.235945+0000", 2024-04-19T03:02:50.796 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0671e-05 2024-04-19T03:02:50.796 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.796 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.797 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:50.797 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.235952+0000", 2024-04-19T03:02:50.797 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3089999999999998e-06 2024-04-19T03:02:50.797 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.797 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.797 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:50.797 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.237067+0000", 2024-04-19T03:02:50.797 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001115263 2024-04-19T03:02:50.797 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.797 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.797 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:50.797 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.237188+0000", 2024-04-19T03:02:50.797 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000121258 2024-04-19T03:02:50.797 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.798 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.798 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:50.798 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.237316+0000", 2024-04-19T03:02:50.798 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000128071 2024-04-19T03:02:50.798 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.798 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.798 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:50.798 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240744+0000", 2024-04-19T03:02:50.798 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0034275629999999998 2024-04-19T03:02:50.798 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.798 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.798 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:50.798 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.252517+0000", 2024-04-19T03:02:50.798 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011772991999999999 2024-04-19T03:02:50.799 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.799 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.799 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:02:50.799 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.252523+0000", 2024-04-19T03:02:50.799 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3640000000000004e-06 2024-04-19T03:02:50.799 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.799 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.799 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:50.799 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.267290+0000", 2024-04-19T03:02:50.799 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0147665690000001 2024-04-19T03:02:50.799 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.799 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.799 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:50.799 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.267432+0000", 2024-04-19T03:02:50.799 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014165299999999999 2024-04-19T03:02:50.800 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:50.800 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:50.800 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:50.800 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.800 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.800 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87129 5.0 5:02667e01:::benchmark_data_smithi096_19531_object87128:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:50.800 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.236466+0000", 2024-04-19T03:02:50.800 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 27.463033574000001, 2024-04-19T03:02:50.800 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0301534510000001, 2024-04-19T03:02:50.800 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:50.800 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-19T03:02:50.800 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:50.800 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:50.801 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:50.801 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87129 2024-04-19T03:02:50.801 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.801 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:50.801 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.801 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:50.801 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236466+0000", 2024-04-19T03:02:50.801 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:50.801 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.801 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.801 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:50.801 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236466+0000", 2024-04-19T03:02:50.801 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:50.801 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.802 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.802 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:50.802 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236465+0000", 2024-04-19T03:02:50.802 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:50.802 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.802 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.802 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:50.802 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236566+0000", 2024-04-19T03:02:50.802 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010047000000000001 2024-04-19T03:02:50.802 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.802 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.802 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:50.802 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236577+0000", 2024-04-19T03:02:50.802 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1772e-05 2024-04-19T03:02:50.803 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.803 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.803 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:50.803 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236584+0000", 2024-04-19T03:02:50.803 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0530000000000003e-06 2024-04-19T03:02:50.803 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.803 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.803 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:50.803 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.237023+0000", 2024-04-19T03:02:50.803 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000439703 2024-04-19T03:02:50.803 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.803 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.803 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:50.803 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.237207+0000", 2024-04-19T03:02:50.804 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000183692 2024-04-19T03:02:50.804 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.804 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.804 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:50.804 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.237373+0000", 2024-04-19T03:02:50.804 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016623500000000001 2024-04-19T03:02:50.804 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.804 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.804 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:50.804 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.241461+0000", 2024-04-19T03:02:50.804 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0040883050000000004 2024-04-19T03:02:50.804 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.804 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.804 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:50.805 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.252500+0000", 2024-04-19T03:02:50.805 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011038450999999999 2024-04-19T03:02:50.805 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.805 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.805 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:02:50.805 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.252507+0000", 2024-04-19T03:02:50.805 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2439999999999996e-06 2024-04-19T03:02:50.805 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.805 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.805 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:50.805 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266538+0000", 2024-04-19T03:02:50.805 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.014031184 2024-04-19T03:02:50.805 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.805 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.806 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:50.806 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266620+0000", 2024-04-19T03:02:50.806 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1600000000000005e-05 2024-04-19T03:02:50.806 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:50.806 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:50.806 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:50.806 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.806 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.806 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87135 5.4 5:2a97e7b7:::benchmark_data_smithi096_19531_object87134:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:50.806 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.240884+0000", 2024-04-19T03:02:50.806 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 27.458616116999998, 2024-04-19T03:02:50.806 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.025708931, 2024-04-19T03:02:50.806 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:50.807 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-19T03:02:50.807 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:50.807 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:50.807 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:50.807 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87135 2024-04-19T03:02:50.807 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.807 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:50.807 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.807 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:50.807 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240884+0000", 2024-04-19T03:02:50.807 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:50.807 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.807 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.807 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:50.808 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240884+0000", 2024-04-19T03:02:50.808 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:50.808 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.808 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.808 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:50.808 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240883+0000", 2024-04-19T03:02:50.808 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:50.808 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.808 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.808 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:50.808 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240933+0000", 2024-04-19T03:02:50.808 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9969999999999998e-05 2024-04-19T03:02:50.808 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.808 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.809 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:50.809 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240946+0000", 2024-04-19T03:02:50.809 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2943e-05 2024-04-19T03:02:50.809 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.809 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.809 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:50.809 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240952+0000", 2024-04-19T03:02:50.809 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8930000000000002e-06 2024-04-19T03:02:50.809 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.809 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.809 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:50.809 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240994+0000", 2024-04-19T03:02:50.809 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2753999999999998e-05 2024-04-19T03:02:50.809 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.810 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.810 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:50.810 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.241092+0000", 2024-04-19T03:02:50.810 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.7447000000000004e-05 2024-04-19T03:02:50.810 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.810 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.810 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:50.810 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.241183+0000", 2024-04-19T03:02:50.810 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1163999999999997e-05 2024-04-19T03:02:50.810 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.810 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.810 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:50.810 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.254672+0000", 2024-04-19T03:02:50.810 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.01348864 2024-04-19T03:02:50.811 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.811 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.811 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:02:50.811 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.254681+0000", 2024-04-19T03:02:50.811 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.3789999999999995e-06 2024-04-19T03:02:50.811 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.811 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.811 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:50.811 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266456+0000", 2024-04-19T03:02:50.811 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.011774621 2024-04-19T03:02:50.811 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.811 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.811 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:50.811 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266593+0000", 2024-04-19T03:02:50.811 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013737600000000001 2024-04-19T03:02:50.812 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:50.812 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:50.812 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:50.812 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.812 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.812 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87136 5.4 5:212411bc:::benchmark_data_smithi096_19531_object87135:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:50.812 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.240962+0000", 2024-04-19T03:02:50.812 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 27.458538240999999, 2024-04-19T03:02:50.812 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.025738, 2024-04-19T03:02:50.812 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:50.812 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-19T03:02:50.812 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:50.812 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:50.812 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:50.813 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87136 2024-04-19T03:02:50.813 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.813 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:50.813 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.813 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:50.813 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240962+0000", 2024-04-19T03:02:50.813 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:50.813 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.813 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.813 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:50.813 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240962+0000", 2024-04-19T03:02:50.813 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:50.813 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.813 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.814 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:50.814 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240961+0000", 2024-04-19T03:02:50.814 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:50.814 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.814 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.814 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:50.814 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240995+0000", 2024-04-19T03:02:50.814 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3868000000000002e-05 2024-04-19T03:02:50.814 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.814 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.814 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:50.814 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.241001+0000", 2024-04-19T03:02:50.814 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.322e-06 2024-04-19T03:02:50.814 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.815 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.815 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:50.815 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.241004+0000", 2024-04-19T03:02:50.815 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3510000000000002e-06 2024-04-19T03:02:50.815 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.815 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.815 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:50.815 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247131+0000", 2024-04-19T03:02:50.815 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0061270869999999998 2024-04-19T03:02:50.815 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.815 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.815 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:50.815 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247322+0000", 2024-04-19T03:02:50.815 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000191015 2024-04-19T03:02:50.816 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.816 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.816 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:50.816 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247542+0000", 2024-04-19T03:02:50.816 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00022030199999999999 2024-04-19T03:02:50.816 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.816 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.816 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:50.816 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.254709+0000", 2024-04-19T03:02:50.816 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0071662660000000001 2024-04-19T03:02:50.816 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.816 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.816 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:02:50.817 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.254716+0000", 2024-04-19T03:02:50.817 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3860000000000001e-06 2024-04-19T03:02:50.817 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.817 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.817 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:50.817 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266619+0000", 2024-04-19T03:02:50.817 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0119031030000001 2024-04-19T03:02:50.817 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.817 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.817 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:50.817 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266700+0000", 2024-04-19T03:02:50.817 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0764000000000001e-05 2024-04-19T03:02:50.817 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:50.817 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:50.817 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:50.818 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.818 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.818 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87138 5.e 5:7b1f1c20:::benchmark_data_smithi096_19531_object87137:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:50.818 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.247862+0000", 2024-04-19T03:02:50.818 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 27.451638166999999, 2024-04-19T03:02:50.818 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.024457079, 2024-04-19T03:02:50.818 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:50.818 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:50.818 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:50.818 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:50.818 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:50.818 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87138 2024-04-19T03:02:50.818 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.819 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:50.819 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.819 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:50.819 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247862+0000", 2024-04-19T03:02:50.819 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:50.819 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.819 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.819 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:50.819 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247862+0000", 2024-04-19T03:02:50.819 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:50.819 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.819 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.819 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:50.819 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247860+0000", 2024-04-19T03:02:50.820 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999981 2024-04-19T03:02:50.820 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.820 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.820 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:50.820 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247909+0000", 2024-04-19T03:02:50.820 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9150999999999997e-05 2024-04-19T03:02:50.820 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.820 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.820 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:50.820 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247925+0000", 2024-04-19T03:02:50.820 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5761999999999999e-05 2024-04-19T03:02:50.820 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.820 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.820 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:50.821 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247936+0000", 2024-04-19T03:02:50.821 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1144e-05 2024-04-19T03:02:50.821 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.821 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.821 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:50.821 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.250590+0000", 2024-04-19T03:02:50.821 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.002653678 2024-04-19T03:02:50.821 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.821 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.821 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:02:50.821 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.250599+0000", 2024-04-19T03:02:50.821 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9039999999999998e-06 2024-04-19T03:02:50.821 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.821 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.822 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:50.822 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.268151+0000", 2024-04-19T03:02:50.822 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0175523449999999 2024-04-19T03:02:50.822 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.822 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.822 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:50.822 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.268285+0000", 2024-04-19T03:02:50.822 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013415599999999999 2024-04-19T03:02:50.822 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.822 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.822 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:50.822 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.272238+0000", 2024-04-19T03:02:50.822 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0039533019999999997 2024-04-19T03:02:50.822 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.823 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.823 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:50.823 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.272274+0000", 2024-04-19T03:02:50.823 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5352000000000003e-05 2024-04-19T03:02:50.823 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:50.823 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:50.823 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:50.823 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.272319+0000", 2024-04-19T03:02:50.823 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5281999999999998e-05 2024-04-19T03:02:50.823 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:50.823 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:50.823 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:50.823 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:50.823 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:50.823 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-19T03:02:50.825 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T03:02:50.826 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:50.820+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:50.841 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-19T03:02:50.926 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:50.923+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:50.960 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-04-19T03:02:50.960 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [ 2024-04-19T03:02:50.960 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.960 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:140566 5.3 5:c4fb251d:::benchmark_data_smithi096_19531_object27116:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-19T03:02:50.960 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:50.957263+0000", 2024-04-19T03:02:50.960 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.00169557, 2024-04-19T03:02:50.960 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0017141179999999999, 2024-04-19T03:02:50.961 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:50.961 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-04-19T03:02:50.961 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:50.961 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:50.961 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:50.961 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 140566 2024-04-19T03:02:50.961 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.961 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:50.961 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.961 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:50.962 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:50.957263+0000", 2024-04-19T03:02:50.962 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:50.962 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.962 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.962 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:50.962 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:50.957263+0000", 2024-04-19T03:02:50.962 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:50.962 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.962 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.962 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:50.962 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:50.957262+0000", 2024-04-19T03:02:50.963 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:50.963 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.963 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.963 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:50.963 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:50.957270+0000", 2024-04-19T03:02:50.963 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.5269999999999998e-06 2024-04-19T03:02:50.963 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.963 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.963 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:50.963 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:50.957279+0000", 2024-04-19T03:02:50.963 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6109999999999994e-06 2024-04-19T03:02:50.963 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.963 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.964 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:50.964 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:50.957296+0000", 2024-04-19T03:02:50.964 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6750999999999999e-05 2024-04-19T03:02:50.964 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.964 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.964 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:50.964 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:50.957344+0000", 2024-04-19T03:02:50.964 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8130999999999997e-05 2024-04-19T03:02:50.964 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.964 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.964 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:50.964 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:50.957506+0000", 2024-04-19T03:02:50.965 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00016198300000000001 2024-04-19T03:02:50.965 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:50.965 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:50.965 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:50.965 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.965 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.965 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:140568 5.1 5.28121a41 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-19T03:02:50.965 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:50.958250+0000", 2024-04-19T03:02:50.965 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.00070830299999999997, 2024-04-19T03:02:50.965 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00076669399999999995, 2024-04-19T03:02:50.965 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:50.965 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-04-19T03:02:50.965 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:50.966 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:50.966 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:50.966 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 140568 2024-04-19T03:02:50.966 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.966 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:50.966 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.966 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:50.966 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:50.958250+0000", 2024-04-19T03:02:50.966 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:50.967 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.967 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.967 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:50.967 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:50.958250+0000", 2024-04-19T03:02:50.967 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:50.967 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.967 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.967 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:50.967 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:50.958249+0000", 2024-04-19T03:02:50.968 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:50.968 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.968 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.968 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:50.968 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:50.958255+0000", 2024-04-19T03:02:50.968 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9750000000000004e-06 2024-04-19T03:02:50.968 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.968 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.968 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:50.968 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:50.958268+0000", 2024-04-19T03:02:50.968 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3305999999999999e-05 2024-04-19T03:02:50.968 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.968 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.968 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:50.969 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:50.958278+0000", 2024-04-19T03:02:50.969 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.7790000000000007e-06 2024-04-19T03:02:50.969 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:50.969 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:50.969 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:50.969 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.969 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.969 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:140553 5.1 5:8f8c5383:::benchmark_data_smithi096_19531_object27103:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-19T03:02:50.969 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:50.950325+0000", 2024-04-19T03:02:50.969 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0086329040000000003, 2024-04-19T03:02:50.969 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0087217219999999995, 2024-04-19T03:02:50.969 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:50.969 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-04-19T03:02:50.970 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:50.970 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:50.970 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:50.970 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 140553 2024-04-19T03:02:50.970 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.970 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:50.970 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.970 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:50.970 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:50.950325+0000", 2024-04-19T03:02:50.970 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:50.970 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.970 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.971 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:50.971 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:50.950325+0000", 2024-04-19T03:02:50.971 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:50.971 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.971 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.971 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:50.971 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:50.950324+0000", 2024-04-19T03:02:50.971 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:50.971 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.971 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.971 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:50.971 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:50.950330+0000", 2024-04-19T03:02:50.971 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.378e-06 2024-04-19T03:02:50.971 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.972 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.972 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:50.972 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:50.950341+0000", 2024-04-19T03:02:50.972 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1124000000000001e-05 2024-04-19T03:02:50.972 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.972 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.972 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:50.973 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:50.950348+0000", 2024-04-19T03:02:50.973 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.1169999999999998e-06 2024-04-19T03:02:50.973 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.973 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.973 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:50.973 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:50.950384+0000", 2024-04-19T03:02:50.973 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6502999999999999e-05 2024-04-19T03:02:50.973 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.973 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.974 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:50.974 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:50.950552+0000", 2024-04-19T03:02:50.974 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00016754699999999999 2024-04-19T03:02:50.974 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:50.974 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:50.974 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:50.974 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.974 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.974 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:140555 5.9 5:98a05985:::benchmark_data_smithi096_19531_object27105:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-19T03:02:50.975 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:50.951789+0000", 2024-04-19T03:02:50.975 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0071690240000000004, 2024-04-19T03:02:50.975 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0072915580000000001, 2024-04-19T03:02:50.975 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:50.975 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:02:50.975 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:50.975 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:50.975 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:50.975 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 140555 2024-04-19T03:02:50.976 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.976 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:50.976 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.976 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:50.976 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:50.951789+0000", 2024-04-19T03:02:50.976 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:50.976 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.976 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.976 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:50.976 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:50.951789+0000", 2024-04-19T03:02:50.977 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:50.977 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.977 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.977 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:50.977 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:50.951788+0000", 2024-04-19T03:02:50.977 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:50.978 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.978 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.978 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:50.978 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:50.951794+0000", 2024-04-19T03:02:50.978 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9769999999999997e-06 2024-04-19T03:02:50.978 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.979 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.979 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:50.979 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:50.951803+0000", 2024-04-19T03:02:50.979 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9139999999999997e-06 2024-04-19T03:02:50.979 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.979 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.979 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:50.979 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:50.951812+0000", 2024-04-19T03:02:50.979 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.653e-06 2024-04-19T03:02:50.979 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.979 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.980 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:50.980 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:50.952732+0000", 2024-04-19T03:02:50.980 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000920728 2024-04-19T03:02:50.980 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.980 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.980 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:50.980 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:50.952923+0000", 2024-04-19T03:02:50.980 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00019055400000000001 2024-04-19T03:02:50.980 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.980 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.980 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:02:50.980 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:50.953064+0000", 2024-04-19T03:02:50.980 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00014048399999999999 2024-04-19T03:02:50.980 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:50.981 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:50.981 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:50.981 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.981 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.981 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:140556 5.9 5:93871b75:::benchmark_data_smithi096_19531_object27106:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-19T03:02:50.981 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:50.951835+0000", 2024-04-19T03:02:50.981 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0071228660000000003, 2024-04-19T03:02:50.981 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0072831679999999996, 2024-04-19T03:02:50.981 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:50.981 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:02:50.981 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:50.981 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:50.981 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:50.981 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 140556 2024-04-19T03:02:50.982 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.982 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:50.982 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.982 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:50.982 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:50.951835+0000", 2024-04-19T03:02:50.982 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:50.982 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.982 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.982 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:50.983 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:50.951835+0000", 2024-04-19T03:02:50.983 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:50.983 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.983 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.983 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:50.983 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:50.951835+0000", 2024-04-19T03:02:50.983 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:50.983 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.984 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.984 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:50.984 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:50.951842+0000", 2024-04-19T03:02:50.984 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8250000000000005e-06 2024-04-19T03:02:50.984 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.984 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.984 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:50.984 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:50.951850+0000", 2024-04-19T03:02:50.984 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.3869999999999997e-06 2024-04-19T03:02:50.984 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.984 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.984 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:50.985 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:50.951856+0000", 2024-04-19T03:02:50.985 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6189999999999999e-06 2024-04-19T03:02:50.985 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.985 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.985 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:50.985 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:50.955419+0000", 2024-04-19T03:02:50.985 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0035630829999999999 2024-04-19T03:02:50.985 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.985 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.985 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:50.986 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:50.955576+0000", 2024-04-19T03:02:50.986 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000157534 2024-04-19T03:02:50.986 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.986 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.986 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:02:50.986 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:50.955691+0000", 2024-04-19T03:02:50.986 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00011512500000000001 2024-04-19T03:02:50.987 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:50.987 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:50.987 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:50.987 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.987 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.987 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:140557 5.d 5:b612082b:::benchmark_data_smithi096_19531_object27107:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-19T03:02:50.987 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:50.951861+0000", 2024-04-19T03:02:50.988 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0070969809999999996, 2024-04-19T03:02:50.988 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.007292916, 2024-04-19T03:02:50.988 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:50.988 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:02:50.988 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:50.988 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:50.988 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:50.988 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 140557 2024-04-19T03:02:50.988 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.988 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:50.988 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.988 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:50.988 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:50.951861+0000", 2024-04-19T03:02:50.988 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:50.989 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.989 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.989 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:50.989 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:50.951861+0000", 2024-04-19T03:02:50.989 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:50.989 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.989 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.989 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:50.989 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:50.951861+0000", 2024-04-19T03:02:50.989 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:50.989 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.989 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.990 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:50.990 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:50.951864+0000", 2024-04-19T03:02:50.990 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.993e-06 2024-04-19T03:02:50.990 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.990 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.990 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:50.990 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:50.951869+0000", 2024-04-19T03:02:50.990 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7130000000000002e-06 2024-04-19T03:02:50.990 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.990 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.990 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:50.990 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:50.951875+0000", 2024-04-19T03:02:50.990 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7420000000000003e-06 2024-04-19T03:02:50.991 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.991 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.991 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:50.991 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:50.951906+0000", 2024-04-19T03:02:50.991 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0423999999999999e-05 2024-04-19T03:02:50.991 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.991 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.991 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:50.991 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:50.952094+0000", 2024-04-19T03:02:50.992 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000187942 2024-04-19T03:02:50.992 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.992 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.992 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:02:50.992 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:50.952175+0000", 2024-04-19T03:02:50.992 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.1408000000000004e-05 2024-04-19T03:02:50.992 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.992 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.992 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:50.992 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:50.958749+0000", 2024-04-19T03:02:50.992 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0065739930000000002 2024-04-19T03:02:50.992 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:50.993 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:50.993 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:50.993 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.993 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.993 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:140558 5.9 5:9d82d39a:::benchmark_data_smithi096_19531_object27108:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-19T03:02:50.993 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:50.952820+0000", 2024-04-19T03:02:50.993 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0061383000000000002, 2024-04-19T03:02:50.994 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0063728040000000001, 2024-04-19T03:02:50.994 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:50.994 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:02:50.994 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:50.994 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:50.994 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:50.995 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 140558 2024-04-19T03:02:50.995 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.995 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:50.995 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.995 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:50.995 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:50.952820+0000", 2024-04-19T03:02:50.995 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:50.996 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.996 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.996 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:50.996 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:50.952820+0000", 2024-04-19T03:02:50.996 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:50.996 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.996 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.996 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:50.996 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:50.952819+0000", 2024-04-19T03:02:50.996 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:50.996 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.997 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.997 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:50.997 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:50.952824+0000", 2024-04-19T03:02:50.998 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1070000000000004e-06 2024-04-19T03:02:50.998 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.998 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.998 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:50.998 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:50.952835+0000", 2024-04-19T03:02:50.998 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0570999999999999e-05 2024-04-19T03:02:50.998 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.998 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.998 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:50.998 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:50.952850+0000", 2024-04-19T03:02:50.998 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.5764999999999999e-05 2024-04-19T03:02:50.999 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.999 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.999 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:50.999 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:50.957496+0000", 2024-04-19T03:02:50.999 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0046457809999999999 2024-04-19T03:02:50.999 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.999 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:50.999 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:50.999 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:50.957634+0000", 2024-04-19T03:02:50.999 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000138083 2024-04-19T03:02:50.999 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:50.999 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:51.000 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:02:51.000 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:50.957745+0000", 2024-04-19T03:02:51.000 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00011080400000000001 2024-04-19T03:02:51.000 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:51.000 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:51.000 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:51.000 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:51.000 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:51.000 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:140560 5.d 5:b8e422f0:::benchmark_data_smithi096_19531_object27110:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-19T03:02:51.000 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:50.953534+0000", 2024-04-19T03:02:51.000 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0054246549999999996, 2024-04-19T03:02:51.000 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0056972669999999998, 2024-04-19T03:02:51.000 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:51.000 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:02:51.001 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:51.001 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:51.001 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:51.001 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 140560 2024-04-19T03:02:51.001 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:51.001 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:51.001 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:51.001 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:51.001 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:50.953534+0000", 2024-04-19T03:02:51.001 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:51.001 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:51.001 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:51.001 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:51.002 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:50.953534+0000", 2024-04-19T03:02:51.002 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:51.002 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:51.002 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:51.002 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:51.002 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:50.953533+0000", 2024-04-19T03:02:51.002 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:51.002 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:51.002 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:51.002 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:51.002 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:50.953538+0000", 2024-04-19T03:02:51.002 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3700000000000003e-06 2024-04-19T03:02:51.002 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:51.003 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:51.003 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:51.003 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:50.953549+0000", 2024-04-19T03:02:51.003 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0937e-05 2024-04-19T03:02:51.003 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:51.003 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:51.003 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:51.003 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:50.953556+0000", 2024-04-19T03:02:51.003 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2089999999999999e-06 2024-04-19T03:02:51.003 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:51.003 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:51.003 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:51.003 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:50.953831+0000", 2024-04-19T03:02:51.004 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000274541 2024-04-19T03:02:51.004 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:51.004 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:51.004 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:51.004 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:50.953955+0000", 2024-04-19T03:02:51.004 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000124005 2024-04-19T03:02:51.004 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:51.004 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:51.004 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:02:51.004 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:50.954089+0000", 2024-04-19T03:02:51.004 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000134704 2024-04-19T03:02:51.004 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:51.004 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:51.005 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:51.005 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:50.958754+0000", 2024-04-19T03:02:51.005 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0046649930000000001 2024-04-19T03:02:51.005 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:51.005 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:51.005 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:51.005 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:51.005 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:51.005 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:140561 5.9 5.768c969 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-19T03:02:51.005 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:50.953788+0000", 2024-04-19T03:02:51.005 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0051706169999999997, 2024-04-19T03:02:51.005 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0054813989999999996, 2024-04-19T03:02:51.005 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:51.006 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-04-19T03:02:51.006 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:51.006 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:51.006 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:51.006 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 140561 2024-04-19T03:02:51.006 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:51.006 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:51.006 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:51.006 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:51.006 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:50.953788+0000", 2024-04-19T03:02:51.006 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:51.006 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:51.006 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:51.007 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:51.007 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:50.953788+0000", 2024-04-19T03:02:51.007 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:51.007 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:51.007 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:51.007 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:51.007 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:50.953787+0000", 2024-04-19T03:02:51.007 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:51.007 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:51.007 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:51.007 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:51.007 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:50.953791+0000", 2024-04-19T03:02:51.008 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0570000000000003e-06 2024-04-19T03:02:51.008 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:51.008 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:51.008 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:51.008 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:50.953797+0000", 2024-04-19T03:02:51.008 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1279999999999996e-06 2024-04-19T03:02:51.008 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:51.008 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:51.008 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:51.008 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:50.953802+0000", 2024-04-19T03:02:51.008 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9439999999999996e-06 2024-04-19T03:02:51.008 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:51.008 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:51.008 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:51.009 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:51.009 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:51.009 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:140563 5.d 5:b18a4bc7:::benchmark_data_smithi096_19531_object27113:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-19T03:02:51.009 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:50.954010+0000", 2024-04-19T03:02:51.009 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0049485010000000001, 2024-04-19T03:02:51.009 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0052873579999999998, 2024-04-19T03:02:51.009 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:51.009 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:02:51.009 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:51.009 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:51.009 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:51.009 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 140563 2024-04-19T03:02:51.009 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:51.010 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:51.010 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:51.010 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:51.010 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:50.954010+0000", 2024-04-19T03:02:51.010 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:51.010 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:51.010 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:51.010 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:51.010 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:50.954010+0000", 2024-04-19T03:02:51.010 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:51.010 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:51.010 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:51.010 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:51.011 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:50.954009+0000", 2024-04-19T03:02:51.011 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:51.011 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:51.011 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:51.011 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:51.011 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:50.954015+0000", 2024-04-19T03:02:51.011 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3840000000000002e-06 2024-04-19T03:02:51.011 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:51.011 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:51.011 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:51.011 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:50.954025+0000", 2024-04-19T03:02:51.011 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0115999999999999e-05 2024-04-19T03:02:51.012 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:51.012 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:51.012 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:51.012 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:50.954048+0000", 2024-04-19T03:02:51.012 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2419e-05 2024-04-19T03:02:51.012 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:51.012 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:51.012 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:51.012 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:50.955419+0000", 2024-04-19T03:02:51.012 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0013713569999999999 2024-04-19T03:02:51.012 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:51.012 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:51.012 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:51.013 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:50.955576+0000", 2024-04-19T03:02:51.013 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000156766 2024-04-19T03:02:51.013 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:51.013 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:51.013 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:02:51.013 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:50.955691+0000", 2024-04-19T03:02:51.013 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00011547199999999999 2024-04-19T03:02:51.013 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:51.013 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:51.013 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:51.013 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:50.958769+0000", 2024-04-19T03:02:51.013 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.003078342 2024-04-19T03:02:51.013 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:51.014 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:51.014 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:51.014 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:51.014 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:51.014 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:140565 5.d 5:baeec22e:::benchmark_data_smithi096_19531_object27115:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2024-04-19T03:02:51.014 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:50.957090+0000", 2024-04-19T03:02:51.014 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0018679009999999999, 2024-04-19T03:02:51.014 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0022454739999999999, 2024-04-19T03:02:51.014 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:51.014 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:02:51.014 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:51.015 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:51.015 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:51.015 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 140565 2024-04-19T03:02:51.015 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:51.015 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:51.015 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:51.015 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:51.015 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:50.957090+0000", 2024-04-19T03:02:51.015 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:51.015 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:51.015 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:51.015 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:51.016 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:50.957090+0000", 2024-04-19T03:02:51.016 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:51.016 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:51.016 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:51.016 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:51.016 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:50.957089+0000", 2024-04-19T03:02:51.016 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:51.016 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:51.016 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:51.016 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:51.016 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:50.957094+0000", 2024-04-19T03:02:51.016 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9189999999999998e-06 2024-04-19T03:02:51.016 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:51.017 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:51.017 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:51.017 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:50.957103+0000", 2024-04-19T03:02:51.017 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2779999999999993e-06 2024-04-19T03:02:51.017 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:51.017 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:51.017 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:51.017 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:50.957119+0000", 2024-04-19T03:02:51.017 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6642000000000001e-05 2024-04-19T03:02:51.017 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:51.017 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:51.017 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:51.017 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:50.957358+0000", 2024-04-19T03:02:51.017 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00023893800000000001 2024-04-19T03:02:51.018 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:51.018 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:51.018 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:51.018 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:50.957486+0000", 2024-04-19T03:02:51.018 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000128155 2024-04-19T03:02:51.018 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:51.018 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:51.018 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:02:51.018 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:50.957607+0000", 2024-04-19T03:02:51.018 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000121136 2024-04-19T03:02:51.018 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:51.018 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:51.018 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:51.019 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:50.959053+0000", 2024-04-19T03:02:51.019 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0014460230000000001 2024-04-19T03:02:51.019 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:51.019 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:51.019 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:51.019 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:51.019 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-04-19T03:02:51.019 INFO:teuthology.orchestra.run.smithi144.stdout: "num_ops": 11 2024-04-19T03:02:51.019 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-04-19T03:02:51.020 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1: {} 2024-04-19T03:02:51.020 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2: {} 2024-04-19T03:02:51.021 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-19T03:02:51.021 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T03:02:51.022 INFO:teuthology.orchestra.run.smithi096.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-04-19T03:02:51.022 INFO:teuthology.orchestra.run.smithi096.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-19T03:02:51.022 INFO:teuthology.orchestra.run.smithi096.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-19T03:02:51.023 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-19T03:02:51.027 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:51.024+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:51.129 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:51.127+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:51.155 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-04-19T03:02:51.155 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:02:51.169 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T03:02:51.229 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:51.224+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:51.301 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-04-19T03:02:51.301 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:02:51.314 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T03:02:51.330 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:51.328+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:51.430 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:51.427+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:51.438 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-19T03:02:51.438 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:02:51.450 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T03:02:51.473 INFO:teuthology.orchestra.run.smithi096.stderr:nodeep-scrub is set 2024-04-19T03:02:51.531 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:51.527+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:51.572 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-19T03:02:51.572 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:02:51.584 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T03:02:51.632 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:51.628+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:51.703 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-19T03:02:51.704 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:02:51.714 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T03:02:51.758 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:51.756+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:51.834 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:51.831+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:51.839 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-04-19T03:02:51.839 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:02:51.850 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T03:02:51.935 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:51.931+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:51.979 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-04-19T03:02:51.979 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:02:51.990 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T03:02:52.035 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:52.035+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:52.110 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-04-19T03:02:52.110 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:02:52.121 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T03:02:52.170 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:52.167+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:52.237 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:52.235+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:52.247 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-19T03:02:52.247 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:02:52.259 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T03:02:52.338 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:52.335+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:52.378 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-19T03:02:52.378 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:02:52.389 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T03:02:52.439 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:52.436+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:52.512 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-19T03:02:52.512 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:02:52.524 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T03:02:52.570 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:52.568+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:52.606 DEBUG:teuthology.orchestra.console.smithi097:pexpect command: ipmitool -H smithi097.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-19T03:02:52.641 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:52.639+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:52.656 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-04-19T03:02:52.656 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:02:52.670 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T03:02:52.716 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~24s 2024-04-19T03:02:52.717 DEBUG:teuthology.orchestra.console.smithi097:check power output: Chassis Power is on 2024-04-19T03:02:52.742 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:52.739+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:52.792 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-04-19T03:02:52.792 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:02:52.805 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T03:02:52.818 INFO:teuthology.orchestra.console.smithi097:Power on completed 2024-04-19T03:02:52.850 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:52.848+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:52.920 DEBUG:teuthology.orchestra.console.smithi097:Waiting for login prompt 2024-04-19T03:02:52.920 DEBUG:teuthology.orchestra.console.smithi097:pexpect command: console -M conserver.front.sepia.ceph.com -p 3109 -f smithi097 2024-04-19T03:02:52.932 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-04-19T03:02:52.932 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:02:52.944 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:52.943+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:52.945 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T03:02:53.024 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-19T03:02:53.045 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:53.043+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:53.069 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-19T03:02:53.069 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:02:53.081 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T03:02:53.146 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:53.143+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:53.188 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1: {} 2024-04-19T03:02:53.201 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-19T03:02:53.201 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-04-19T03:02:53.201 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-04-19T03:02:53.201 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-04-19T03:02:53.201 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-19T03:02:53.208 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2: {} 2024-04-19T03:02:53.208 INFO:teuthology.orchestra.run.smithi096.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-04-19T03:02:53.208 INFO:teuthology.orchestra.run.smithi096.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-19T03:02:53.208 INFO:teuthology.orchestra.run.smithi096.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-19T03:02:53.212 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-19T03:02:53.213 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-19T03:02:53.215 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T03:02:53.264 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:53.263+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:53.346 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-19T03:02:53.346 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-04-19T03:02:53.346 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-04-19T03:02:53.346 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-04-19T03:02:53.346 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.346 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:79014 5.d 5:b5eee02c:::benchmark_data_smithi096_19531_object79013:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-19T03:02:53.346 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:18.032471+0000", 2024-04-19T03:02:53.346 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 35.310660259999999, 2024-04-19T03:02:53.347 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.041427629000000001, 2024-04-19T03:02:53.347 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:53.347 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:53.347 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:53.347 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:53.347 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:53.347 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 79014 2024-04-19T03:02:53.347 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.347 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:53.347 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.347 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:53.347 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:18.032471+0000", 2024-04-19T03:02:53.347 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:53.348 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.348 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.348 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:53.348 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:18.032471+0000", 2024-04-19T03:02:53.348 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:53.348 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.348 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.348 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:53.348 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:18.032470+0000", 2024-04-19T03:02:53.348 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:53.348 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.348 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.348 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:53.349 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:18.032525+0000", 2024-04-19T03:02:53.349 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5535999999999998e-05 2024-04-19T03:02:53.349 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.349 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.349 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:53.349 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:18.032537+0000", 2024-04-19T03:02:53.349 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1987999999999999e-05 2024-04-19T03:02:53.349 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.349 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.349 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:53.349 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:18.032546+0000", 2024-04-19T03:02:53.349 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9670000000000007e-06 2024-04-19T03:02:53.349 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.349 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.350 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:53.350 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:18.032613+0000", 2024-04-19T03:02:53.350 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6508999999999996e-05 2024-04-19T03:02:53.350 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.350 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.350 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:53.350 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:18.032738+0000", 2024-04-19T03:02:53.350 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000124912 2024-04-19T03:02:53.350 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.350 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.350 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-04-19T03:02:53.350 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:18.032867+0000", 2024-04-19T03:02:53.351 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012959399999999999 2024-04-19T03:02:53.351 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.351 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.351 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:53.351 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:18.035867+0000", 2024-04-19T03:02:53.351 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.002999378 2024-04-19T03:02:53.351 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.351 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.351 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:53.351 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:18.073705+0000", 2024-04-19T03:02:53.351 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.037838042000000002 2024-04-19T03:02:53.351 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.351 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.351 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:53.352 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:18.073813+0000", 2024-04-19T03:02:53.352 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010806099999999999 2024-04-19T03:02:53.352 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.352 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.352 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:53.352 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:18.073899+0000", 2024-04-19T03:02:53.352 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.5971999999999996e-05 2024-04-19T03:02:53.352 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:53.352 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:53.352 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:53.352 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.352 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.352 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:86615 5.e 5:7fef7288:::benchmark_data_smithi096_19531_object86614:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:53.352 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:22.634544+0000", 2024-04-19T03:02:53.353 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 30.708587281, 2024-04-19T03:02:53.353 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.192475071, 2024-04-19T03:02:53.353 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:53.353 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:53.353 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:53.353 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:53.353 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:53.353 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 86615 2024-04-19T03:02:53.353 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.353 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:53.353 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.353 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:53.353 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634544+0000", 2024-04-19T03:02:53.353 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:53.354 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.354 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.354 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:53.354 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634544+0000", 2024-04-19T03:02:53.354 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:53.354 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.354 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.354 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:53.354 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634542+0000", 2024-04-19T03:02:53.354 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999981 2024-04-19T03:02:53.354 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.354 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.355 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:53.355 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634585+0000", 2024-04-19T03:02:53.355 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2299000000000003e-05 2024-04-19T03:02:53.355 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.355 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.355 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:53.355 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634592+0000", 2024-04-19T03:02:53.355 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2350000000000002e-06 2024-04-19T03:02:53.355 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.355 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.355 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:53.355 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634596+0000", 2024-04-19T03:02:53.355 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5390000000000001e-06 2024-04-19T03:02:53.355 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.356 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.356 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:53.356 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634639+0000", 2024-04-19T03:02:53.356 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2444999999999998e-05 2024-04-19T03:02:53.356 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.356 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.356 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:53.356 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634808+0000", 2024-04-19T03:02:53.356 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000169152 2024-04-19T03:02:53.356 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.356 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.356 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:53.356 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634999+0000", 2024-04-19T03:02:53.356 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00019098300000000001 2024-04-19T03:02:53.356 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.357 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.357 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:53.357 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.640458+0000", 2024-04-19T03:02:53.357 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0054586870000000003 2024-04-19T03:02:53.357 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.357 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.357 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:53.357 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.826949+0000", 2024-04-19T03:02:53.357 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.18649178299999999 2024-04-19T03:02:53.357 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.357 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.357 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:53.358 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.826982+0000", 2024-04-19T03:02:53.358 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2477000000000001e-05 2024-04-19T03:02:53.358 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.358 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.358 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:53.358 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.827019+0000", 2024-04-19T03:02:53.358 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7355999999999999e-05 2024-04-19T03:02:53.358 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:53.358 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:53.358 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:53.358 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.358 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.358 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:86616 5.e 5:72278f47:::benchmark_data_smithi096_19531_object86615:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:53.359 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:22.634609+0000", 2024-04-19T03:02:53.359 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 30.708522131999999, 2024-04-19T03:02:53.359 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.19472088900000001, 2024-04-19T03:02:53.359 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:53.359 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:53.359 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:53.359 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:53.359 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:53.359 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 86616 2024-04-19T03:02:53.359 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.359 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:53.359 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.359 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:53.360 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634609+0000", 2024-04-19T03:02:53.360 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:53.360 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.360 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.360 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:53.360 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634609+0000", 2024-04-19T03:02:53.360 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:53.360 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.360 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.360 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:53.360 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634609+0000", 2024-04-19T03:02:53.360 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:53.360 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.361 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.361 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:53.361 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634651+0000", 2024-04-19T03:02:53.361 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2589000000000002e-05 2024-04-19T03:02:53.361 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.361 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.361 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:53.361 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634659+0000", 2024-04-19T03:02:53.361 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5850000000000002e-06 2024-04-19T03:02:53.361 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.361 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.361 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:53.361 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634662+0000", 2024-04-19T03:02:53.361 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3620000000000002e-06 2024-04-19T03:02:53.362 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.362 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.362 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:53.362 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.637880+0000", 2024-04-19T03:02:53.362 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.003218149 2024-04-19T03:02:53.362 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.362 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.362 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:53.362 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.637999+0000", 2024-04-19T03:02:53.362 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000118643 2024-04-19T03:02:53.362 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.363 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.363 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:53.363 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.638102+0000", 2024-04-19T03:02:53.363 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010331 2024-04-19T03:02:53.363 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.363 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.363 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:53.363 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.640851+0000", 2024-04-19T03:02:53.363 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0027483310000000001 2024-04-19T03:02:53.363 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.363 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.363 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:53.363 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.829269+0000", 2024-04-19T03:02:53.363 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.188418319 2024-04-19T03:02:53.364 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.364 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.364 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:53.364 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.829299+0000", 2024-04-19T03:02:53.364 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0227e-05 2024-04-19T03:02:53.364 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.364 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.364 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:53.364 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.829330+0000", 2024-04-19T03:02:53.364 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0969000000000001e-05 2024-04-19T03:02:53.364 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:53.364 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:53.364 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:53.364 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.364 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.365 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:86618 5.0 5:09014b90:::benchmark_data_smithi096_19531_object86617:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:53.365 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:22.634894+0000", 2024-04-19T03:02:53.365 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 30.708237644, 2024-04-19T03:02:53.365 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.19413419800000001, 2024-04-19T03:02:53.365 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:53.365 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:53.365 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:53.365 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:53.365 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:53.365 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 86618 2024-04-19T03:02:53.365 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.365 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:53.365 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.365 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:53.366 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634894+0000", 2024-04-19T03:02:53.366 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:53.366 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.366 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.366 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:53.366 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634894+0000", 2024-04-19T03:02:53.366 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:53.366 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.366 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.366 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:53.366 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634893+0000", 2024-04-19T03:02:53.366 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:53.366 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.367 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.367 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:53.367 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634976+0000", 2024-04-19T03:02:53.367 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3231000000000003e-05 2024-04-19T03:02:53.367 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.367 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.367 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:53.367 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634983+0000", 2024-04-19T03:02:53.367 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5169999999999996e-06 2024-04-19T03:02:53.367 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.367 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.367 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:53.367 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634987+0000", 2024-04-19T03:02:53.367 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.425e-06 2024-04-19T03:02:53.368 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.368 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.368 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:53.368 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635030+0000", 2024-04-19T03:02:53.368 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.32e-05 2024-04-19T03:02:53.368 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.368 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.368 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:53.368 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635185+0000", 2024-04-19T03:02:53.368 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015471899999999999 2024-04-19T03:02:53.368 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.368 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.368 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:53.368 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635415+0000", 2024-04-19T03:02:53.369 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00023026500000000001 2024-04-19T03:02:53.369 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.369 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.369 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:53.369 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.640127+0000", 2024-04-19T03:02:53.369 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0047118890000000004 2024-04-19T03:02:53.369 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.369 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.369 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:53.369 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.828895+0000", 2024-04-19T03:02:53.369 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.18876802600000001 2024-04-19T03:02:53.369 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.369 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.369 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:53.369 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.828972+0000", 2024-04-19T03:02:53.370 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.6345000000000002e-05 2024-04-19T03:02:53.370 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.370 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.370 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:53.370 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.829028+0000", 2024-04-19T03:02:53.370 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6342999999999999e-05 2024-04-19T03:02:53.370 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:53.370 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:53.370 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:53.370 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.370 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.370 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:86620 5.b 5:d80faa68:::benchmark_data_smithi096_19531_object86619:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:53.370 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:22.635110+0000", 2024-04-19T03:02:53.371 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 30.708021083999999, 2024-04-19T03:02:53.371 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.193447275, 2024-04-19T03:02:53.371 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:53.371 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:53.371 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:53.371 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:53.371 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:53.371 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 86620 2024-04-19T03:02:53.371 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.371 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:53.371 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.371 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:53.371 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635110+0000", 2024-04-19T03:02:53.371 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:53.371 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.372 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.372 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:53.372 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635110+0000", 2024-04-19T03:02:53.372 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:53.372 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.372 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.372 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:53.372 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635110+0000", 2024-04-19T03:02:53.372 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:53.372 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.372 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.372 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:53.372 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635154+0000", 2024-04-19T03:02:53.372 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4681000000000001e-05 2024-04-19T03:02:53.373 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.373 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.373 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:53.373 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635166+0000", 2024-04-19T03:02:53.373 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1505000000000001e-05 2024-04-19T03:02:53.373 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.373 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.373 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:53.373 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635171+0000", 2024-04-19T03:02:53.373 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6040000000000003e-06 2024-04-19T03:02:53.373 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.373 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.373 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:53.374 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635221+0000", 2024-04-19T03:02:53.374 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9947000000000001e-05 2024-04-19T03:02:53.374 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.374 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.374 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:53.374 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635356+0000", 2024-04-19T03:02:53.374 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013576199999999999 2024-04-19T03:02:53.374 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.374 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.374 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:53.375 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635507+0000", 2024-04-19T03:02:53.375 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015072999999999999 2024-04-19T03:02:53.375 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.375 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.375 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:53.375 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.638488+0000", 2024-04-19T03:02:53.375 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0029813159999999999 2024-04-19T03:02:53.375 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.375 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.375 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:53.375 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.828341+0000", 2024-04-19T03:02:53.375 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.189852254 2024-04-19T03:02:53.375 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.376 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.376 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:53.376 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.828416+0000", 2024-04-19T03:02:53.376 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5344000000000002e-05 2024-04-19T03:02:53.376 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.376 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.376 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:53.376 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.828558+0000", 2024-04-19T03:02:53.376 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000141695 2024-04-19T03:02:53.376 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:53.376 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:53.376 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:53.376 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.377 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.377 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:86621 5.8 5:1597a420:::benchmark_data_smithi096_19531_object86620:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:53.377 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:22.635187+0000", 2024-04-19T03:02:53.377 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 30.707944223999998, 2024-04-19T03:02:53.377 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.194204878, 2024-04-19T03:02:53.377 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:53.377 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:53.377 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:53.377 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:53.377 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:53.377 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 86621 2024-04-19T03:02:53.377 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.377 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:53.377 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.378 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:53.378 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635187+0000", 2024-04-19T03:02:53.378 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:53.378 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.378 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.378 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:53.378 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635187+0000", 2024-04-19T03:02:53.378 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:53.378 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.378 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.378 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:53.378 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635187+0000", 2024-04-19T03:02:53.379 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:53.379 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.379 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.379 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:53.379 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635242+0000", 2024-04-19T03:02:53.379 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5158000000000003e-05 2024-04-19T03:02:53.379 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.379 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.379 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:53.379 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635249+0000", 2024-04-19T03:02:53.379 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.7000000000000008e-06 2024-04-19T03:02:53.379 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.379 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.379 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:53.380 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635256+0000", 2024-04-19T03:02:53.380 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2060000000000004e-06 2024-04-19T03:02:53.380 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.380 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.380 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:53.380 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635302+0000", 2024-04-19T03:02:53.380 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5954000000000001e-05 2024-04-19T03:02:53.380 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.380 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.380 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:53.380 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635427+0000", 2024-04-19T03:02:53.380 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012559299999999999 2024-04-19T03:02:53.380 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.380 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.381 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:53.381 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635596+0000", 2024-04-19T03:02:53.381 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000168615 2024-04-19T03:02:53.381 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.381 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.381 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:53.381 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.639320+0000", 2024-04-19T03:02:53.381 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0037244610000000001 2024-04-19T03:02:53.381 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.381 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.381 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:53.381 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.829277+0000", 2024-04-19T03:02:53.381 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.18995651099999999 2024-04-19T03:02:53.381 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.381 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.382 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:53.382 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.829341+0000", 2024-04-19T03:02:53.382 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3756000000000004e-05 2024-04-19T03:02:53.382 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.382 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.382 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:53.382 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.829392+0000", 2024-04-19T03:02:53.382 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1555999999999999e-05 2024-04-19T03:02:53.382 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:53.382 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:53.382 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:53.382 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.382 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.383 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87062 5.4 5:2d3b5d9a:::benchmark_data_smithi096_19531_object87061:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:53.383 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.136820+0000", 2024-04-19T03:02:53.383 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 30.206311071000002, 2024-04-19T03:02:53.383 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.066483741999999998, 2024-04-19T03:02:53.383 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:53.383 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:53.383 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:53.383 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:53.383 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:53.383 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87062 2024-04-19T03:02:53.383 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.383 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:53.383 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.383 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:53.384 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.136820+0000", 2024-04-19T03:02:53.384 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:53.384 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.384 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.384 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:53.384 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.136820+0000", 2024-04-19T03:02:53.384 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:53.384 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.384 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.384 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:53.384 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.136819+0000", 2024-04-19T03:02:53.384 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:53.384 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.384 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.385 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:53.385 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.136864+0000", 2024-04-19T03:02:53.385 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4855000000000003e-05 2024-04-19T03:02:53.385 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.385 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.385 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:53.385 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.136881+0000", 2024-04-19T03:02:53.385 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7521999999999999e-05 2024-04-19T03:02:53.385 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.385 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.385 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:53.385 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.136890+0000", 2024-04-19T03:02:53.385 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1039999999999996e-06 2024-04-19T03:02:53.386 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.386 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.386 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:53.386 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.136974+0000", 2024-04-19T03:02:53.386 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3735999999999999e-05 2024-04-19T03:02:53.386 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.386 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.386 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:53.386 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.137308+0000", 2024-04-19T03:02:53.386 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00033376100000000002 2024-04-19T03:02:53.386 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.386 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.386 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:53.386 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.137559+0000", 2024-04-19T03:02:53.387 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000250599 2024-04-19T03:02:53.387 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.387 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.387 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:53.387 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.145423+0000", 2024-04-19T03:02:53.387 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0078649589999999995 2024-04-19T03:02:53.387 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.387 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.387 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:53.387 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.203175+0000", 2024-04-19T03:02:53.387 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057751255000000001 2024-04-19T03:02:53.387 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.387 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.387 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:53.388 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.203250+0000", 2024-04-19T03:02:53.388 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5378999999999998e-05 2024-04-19T03:02:53.388 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.388 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.388 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:53.388 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.203304+0000", 2024-04-19T03:02:53.388 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4015999999999999e-05 2024-04-19T03:02:53.388 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:53.388 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:53.388 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:53.388 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.388 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.389 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87065 5.4 5:21d20a47:::benchmark_data_smithi096_19531_object87064:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:53.389 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.137482+0000", 2024-04-19T03:02:53.389 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 30.205649337000001, 2024-04-19T03:02:53.389 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.065988749999999999, 2024-04-19T03:02:53.389 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:53.389 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:53.389 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:53.389 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:53.389 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:53.389 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87065 2024-04-19T03:02:53.389 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.389 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:53.389 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.390 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:53.390 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.137482+0000", 2024-04-19T03:02:53.390 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:53.390 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.390 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.390 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:53.390 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.137482+0000", 2024-04-19T03:02:53.390 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:53.390 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.390 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.390 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:53.390 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.137481+0000", 2024-04-19T03:02:53.390 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:53.391 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.391 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.391 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:53.391 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.137530+0000", 2024-04-19T03:02:53.391 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9302000000000003e-05 2024-04-19T03:02:53.391 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.391 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.391 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:53.391 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.137540+0000", 2024-04-19T03:02:53.391 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.2010000000000005e-06 2024-04-19T03:02:53.391 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.391 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.391 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:53.391 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.137545+0000", 2024-04-19T03:02:53.391 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5910000000000003e-06 2024-04-19T03:02:53.392 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.392 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.392 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:53.392 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.140666+0000", 2024-04-19T03:02:53.392 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0031212710000000001 2024-04-19T03:02:53.392 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.392 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.392 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:53.392 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.140847+0000", 2024-04-19T03:02:53.392 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00018065600000000001 2024-04-19T03:02:53.392 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.392 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.392 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:53.393 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.140991+0000", 2024-04-19T03:02:53.393 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014433100000000001 2024-04-19T03:02:53.393 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.393 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.393 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:53.393 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.148053+0000", 2024-04-19T03:02:53.393 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.007061945 2024-04-19T03:02:53.393 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.393 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.393 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:53.393 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.203367+0000", 2024-04-19T03:02:53.393 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.055313703999999998 2024-04-19T03:02:53.393 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.393 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.393 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:53.394 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.203426+0000", 2024-04-19T03:02:53.394 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9024000000000003e-05 2024-04-19T03:02:53.394 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.394 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.394 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:53.394 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.203471+0000", 2024-04-19T03:02:53.394 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4818999999999999e-05 2024-04-19T03:02:53.394 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:53.394 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:53.394 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:53.394 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.394 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.394 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87067 5.b 5:d57af71a:::benchmark_data_smithi096_19531_object87066:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:53.395 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.142233+0000", 2024-04-19T03:02:53.395 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 30.200898361, 2024-04-19T03:02:53.395 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.071692405000000001, 2024-04-19T03:02:53.395 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:53.395 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:53.395 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:53.395 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:53.395 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:53.395 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87067 2024-04-19T03:02:53.395 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.395 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:53.395 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.395 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:53.395 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142233+0000", 2024-04-19T03:02:53.395 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:53.396 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.396 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.396 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:53.396 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142233+0000", 2024-04-19T03:02:53.396 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:53.396 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.396 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.396 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:53.396 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142232+0000", 2024-04-19T03:02:53.396 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:53.396 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.396 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.396 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:53.397 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142277+0000", 2024-04-19T03:02:53.397 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5837000000000002e-05 2024-04-19T03:02:53.397 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.397 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.397 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:53.397 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142297+0000", 2024-04-19T03:02:53.397 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9561000000000001e-05 2024-04-19T03:02:53.397 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.397 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.397 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:53.397 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142311+0000", 2024-04-19T03:02:53.397 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3654e-05 2024-04-19T03:02:53.397 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.397 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.398 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:53.398 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142391+0000", 2024-04-19T03:02:53.398 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0123999999999994e-05 2024-04-19T03:02:53.398 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.398 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.398 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:53.398 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142669+0000", 2024-04-19T03:02:53.398 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00027829800000000001 2024-04-19T03:02:53.398 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.402 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.402 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:53.402 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142859+0000", 2024-04-19T03:02:53.402 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000190051 2024-04-19T03:02:53.402 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.402 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.402 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:53.402 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.150597+0000", 2024-04-19T03:02:53.402 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0077380299999999999 2024-04-19T03:02:53.402 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.402 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.402 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:53.402 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.213855+0000", 2024-04-19T03:02:53.403 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.063257987000000002 2024-04-19T03:02:53.403 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.403 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.403 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:53.403 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.213898+0000", 2024-04-19T03:02:53.403 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2916e-05 2024-04-19T03:02:53.403 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.403 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.403 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:53.403 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.213925+0000", 2024-04-19T03:02:53.403 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7503000000000001e-05 2024-04-19T03:02:53.403 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:53.403 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:53.403 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:53.404 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.404 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.404 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87069 5.b 5:da0c93b5:::benchmark_data_smithi096_19531_object87068:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:53.404 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.143402+0000", 2024-04-19T03:02:53.404 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 30.199729398999999, 2024-04-19T03:02:53.404 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.070678598999999995, 2024-04-19T03:02:53.404 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:53.404 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:53.404 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:53.404 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:53.404 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:53.404 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87069 2024-04-19T03:02:53.404 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.404 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:53.404 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.405 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:53.405 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.143402+0000", 2024-04-19T03:02:53.405 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:53.405 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.405 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.405 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:53.405 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.143402+0000", 2024-04-19T03:02:53.405 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:53.405 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.405 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.405 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:53.405 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.143401+0000", 2024-04-19T03:02:53.405 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:53.405 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.406 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.406 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:53.406 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.143501+0000", 2024-04-19T03:02:53.406 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000100387 2024-04-19T03:02:53.406 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.406 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.406 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:53.406 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.143516+0000", 2024-04-19T03:02:53.406 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5369000000000001e-05 2024-04-19T03:02:53.406 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.406 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.406 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:53.407 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.143524+0000", 2024-04-19T03:02:53.407 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.7079999999999997e-06 2024-04-19T03:02:53.407 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.407 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.407 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:53.407 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.145550+0000", 2024-04-19T03:02:53.407 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0020259290000000001 2024-04-19T03:02:53.407 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.407 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.407 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:53.407 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.145676+0000", 2024-04-19T03:02:53.407 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000126406 2024-04-19T03:02:53.407 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.407 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.408 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:53.408 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.145802+0000", 2024-04-19T03:02:53.408 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000125974 2024-04-19T03:02:53.408 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.408 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.408 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:53.408 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.151030+0000", 2024-04-19T03:02:53.408 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0052276079999999999 2024-04-19T03:02:53.408 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.408 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.408 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:53.408 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.213998+0000", 2024-04-19T03:02:53.408 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.06296786 2024-04-19T03:02:53.408 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.409 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.409 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:53.409 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.214031+0000", 2024-04-19T03:02:53.409 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3387999999999999e-05 2024-04-19T03:02:53.409 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.409 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.409 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:53.409 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.214081+0000", 2024-04-19T03:02:53.409 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9316e-05 2024-04-19T03:02:53.409 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:53.409 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:53.409 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:53.409 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.409 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.409 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87073 5.0 5:0ca21233:::benchmark_data_smithi096_19531_object87072:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:53.410 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.145929+0000", 2024-04-19T03:02:53.410 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 30.197202139000002, 2024-04-19T03:02:53.410 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.062283234999999999, 2024-04-19T03:02:53.410 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:53.410 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:53.410 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:53.410 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:53.410 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:53.410 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87073 2024-04-19T03:02:53.410 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.410 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:53.410 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.410 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:53.411 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.145929+0000", 2024-04-19T03:02:53.411 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:53.411 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.411 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.411 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:53.411 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.145929+0000", 2024-04-19T03:02:53.411 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:53.411 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.411 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.411 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:53.411 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.145928+0000", 2024-04-19T03:02:53.411 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:53.411 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.411 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.411 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:53.412 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.146063+0000", 2024-04-19T03:02:53.412 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013541099999999999 2024-04-19T03:02:53.412 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.412 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.412 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:53.412 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.146079+0000", 2024-04-19T03:02:53.412 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5902000000000001e-05 2024-04-19T03:02:53.412 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.412 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.412 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:53.412 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.146100+0000", 2024-04-19T03:02:53.412 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0380000000000001e-05 2024-04-19T03:02:53.412 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.412 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.412 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:53.413 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.146193+0000", 2024-04-19T03:02:53.413 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.3669000000000001e-05 2024-04-19T03:02:53.413 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.413 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.413 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:53.413 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.146388+0000", 2024-04-19T03:02:53.413 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00019457799999999999 2024-04-19T03:02:53.413 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.413 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.413 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:53.413 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.146625+0000", 2024-04-19T03:02:53.413 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00023751999999999999 2024-04-19T03:02:53.413 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.413 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.414 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:53.414 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.151051+0000", 2024-04-19T03:02:53.414 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0044260039999999999 2024-04-19T03:02:53.414 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.414 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.414 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:53.414 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.207872+0000", 2024-04-19T03:02:53.414 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.056821114999999998 2024-04-19T03:02:53.414 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.414 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.414 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:53.414 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.208085+0000", 2024-04-19T03:02:53.415 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000212893 2024-04-19T03:02:53.415 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.415 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.415 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:53.415 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.208213+0000", 2024-04-19T03:02:53.415 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012714700000000001 2024-04-19T03:02:53.415 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:53.415 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:53.415 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:53.415 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.415 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.415 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87074 5.0 5:035614ac:::benchmark_data_smithi096_19531_object87073:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:53.415 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.151387+0000", 2024-04-19T03:02:53.415 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 30.191744207999999, 2024-04-19T03:02:53.416 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.063461771, 2024-04-19T03:02:53.416 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:53.416 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:53.416 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:53.416 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:53.416 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:53.416 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87074 2024-04-19T03:02:53.416 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.416 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:53.416 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.416 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:53.416 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.151387+0000", 2024-04-19T03:02:53.416 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:53.417 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.417 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.417 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:53.417 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.151387+0000", 2024-04-19T03:02:53.417 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:53.417 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.417 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.417 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:53.417 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.151386+0000", 2024-04-19T03:02:53.417 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:53.417 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.417 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.417 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:53.418 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.151428+0000", 2024-04-19T03:02:53.418 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.172e-05 2024-04-19T03:02:53.418 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.418 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.418 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:53.418 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.151442+0000", 2024-04-19T03:02:53.418 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4328000000000001e-05 2024-04-19T03:02:53.418 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.418 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.418 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:53.418 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.151451+0000", 2024-04-19T03:02:53.418 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.8400000000000001e-06 2024-04-19T03:02:53.418 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.419 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.419 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:53.419 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.151521+0000", 2024-04-19T03:02:53.419 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.9606999999999999e-05 2024-04-19T03:02:53.419 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.419 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.419 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:53.419 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.151749+0000", 2024-04-19T03:02:53.419 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00022818799999999999 2024-04-19T03:02:53.419 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.419 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.419 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:53.419 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.152006+0000", 2024-04-19T03:02:53.419 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00025687300000000002 2024-04-19T03:02:53.420 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.420 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.420 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:53.420 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.154887+0000", 2024-04-19T03:02:53.420 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0028812989999999999 2024-04-19T03:02:53.420 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.420 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.420 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:53.420 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.214733+0000", 2024-04-19T03:02:53.420 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.059846159000000003 2024-04-19T03:02:53.420 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.420 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.420 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:53.421 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.214788+0000", 2024-04-19T03:02:53.421 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4524000000000002e-05 2024-04-19T03:02:53.421 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.421 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.421 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:53.421 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.214849+0000", 2024-04-19T03:02:53.421 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1362e-05 2024-04-19T03:02:53.421 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:53.421 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:53.421 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:53.421 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.421 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.421 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87108 5.e 5:7e197adc:::benchmark_data_smithi096_19531_object87107:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:53.421 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.223103+0000", 2024-04-19T03:02:53.422 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 30.120028061999999, 2024-04-19T03:02:53.422 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.044946887, 2024-04-19T03:02:53.422 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:53.422 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-19T03:02:53.422 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:53.422 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:53.422 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:53.422 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87108 2024-04-19T03:02:53.422 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.422 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:53.422 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.422 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:53.423 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.223103+0000", 2024-04-19T03:02:53.423 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:53.423 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.423 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.423 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:53.423 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.223103+0000", 2024-04-19T03:02:53.423 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:53.423 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.423 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.423 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:53.423 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.223102+0000", 2024-04-19T03:02:53.423 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:53.423 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.423 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.424 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:53.424 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.223156+0000", 2024-04-19T03:02:53.424 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3958000000000001e-05 2024-04-19T03:02:53.424 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.424 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.424 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:53.424 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.223166+0000", 2024-04-19T03:02:53.424 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.4809999999999995e-06 2024-04-19T03:02:53.424 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.424 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.424 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:53.424 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.223172+0000", 2024-04-19T03:02:53.424 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0140000000000004e-06 2024-04-19T03:02:53.424 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.425 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.425 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:53.425 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.227295+0000", 2024-04-19T03:02:53.425 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0041233420000000003 2024-04-19T03:02:53.425 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.425 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.425 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:53.425 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.227495+0000", 2024-04-19T03:02:53.425 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00019955299999999999 2024-04-19T03:02:53.425 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.425 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.425 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:53.425 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.227717+0000", 2024-04-19T03:02:53.425 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000221902 2024-04-19T03:02:53.426 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.426 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.426 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:53.426 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233189+0000", 2024-04-19T03:02:53.426 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0054718889999999997 2024-04-19T03:02:53.426 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.426 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.426 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:53.426 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.250529+0000", 2024-04-19T03:02:53.426 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.017340298000000001 2024-04-19T03:02:53.426 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.426 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.426 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:02:53.427 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.250539+0000", 2024-04-19T03:02:53.427 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0501e-05 2024-04-19T03:02:53.427 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.427 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.427 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:53.427 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.268003+0000", 2024-04-19T03:02:53.427 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.017463429 2024-04-19T03:02:53.427 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.427 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.427 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:53.427 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.268050+0000", 2024-04-19T03:02:53.427 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7466000000000003e-05 2024-04-19T03:02:53.427 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:53.427 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:53.428 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:53.428 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.428 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.428 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87118 5.b 5:d1bb4f3c:::benchmark_data_smithi096_19531_object87117:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:53.428 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.231082+0000", 2024-04-19T03:02:53.428 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 30.112049228, 2024-04-19T03:02:53.428 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.035789004, 2024-04-19T03:02:53.428 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:53.428 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-19T03:02:53.428 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:53.428 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:53.428 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:53.428 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87118 2024-04-19T03:02:53.428 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.428 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:53.429 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.429 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:53.429 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231082+0000", 2024-04-19T03:02:53.429 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:53.429 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.429 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.429 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:53.429 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231082+0000", 2024-04-19T03:02:53.429 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:53.429 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.429 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.429 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:53.429 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231081+0000", 2024-04-19T03:02:53.429 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:53.430 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.430 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.430 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:53.430 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231159+0000", 2024-04-19T03:02:53.430 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.7819999999999997e-05 2024-04-19T03:02:53.430 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.430 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.430 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:53.430 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231186+0000", 2024-04-19T03:02:53.430 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7126000000000001e-05 2024-04-19T03:02:53.430 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.430 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.430 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:53.430 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231193+0000", 2024-04-19T03:02:53.431 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7259999999999996e-06 2024-04-19T03:02:53.431 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.431 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.431 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:53.431 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231241+0000", 2024-04-19T03:02:53.431 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8123e-05 2024-04-19T03:02:53.431 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.431 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.431 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:53.431 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231354+0000", 2024-04-19T03:02:53.431 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0001133 2024-04-19T03:02:53.431 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.431 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.432 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:53.432 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231443+0000", 2024-04-19T03:02:53.432 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9167999999999997e-05 2024-04-19T03:02:53.432 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.432 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.432 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:53.432 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236498+0000", 2024-04-19T03:02:53.432 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0050545160000000002 2024-04-19T03:02:53.432 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.432 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.432 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:53.432 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.249681+0000", 2024-04-19T03:02:53.432 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013183321 2024-04-19T03:02:53.433 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.433 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.433 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:02:53.433 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.249693+0000", 2024-04-19T03:02:53.433 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1834999999999999e-05 2024-04-19T03:02:53.433 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.433 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.433 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:53.433 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266733+0000", 2024-04-19T03:02:53.433 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.017040408 2024-04-19T03:02:53.433 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.433 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.433 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:53.434 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266871+0000", 2024-04-19T03:02:53.434 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000137849 2024-04-19T03:02:53.434 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:53.434 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:53.434 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:53.434 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.434 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.434 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87121 5.b 5:d01822b8:::benchmark_data_smithi096_19531_object87120:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:53.434 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.233319+0000", 2024-04-19T03:02:53.434 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 30.109812364, 2024-04-19T03:02:53.434 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.033624198, 2024-04-19T03:02:53.434 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:53.434 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-19T03:02:53.435 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:53.435 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:53.435 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:53.435 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87121 2024-04-19T03:02:53.435 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.435 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:53.435 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.435 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:53.435 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233319+0000", 2024-04-19T03:02:53.435 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:53.435 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.435 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.435 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:53.435 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233319+0000", 2024-04-19T03:02:53.435 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:53.436 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.436 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.436 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:53.436 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233319+0000", 2024-04-19T03:02:53.436 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:53.436 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.436 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.436 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:53.436 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233364+0000", 2024-04-19T03:02:53.436 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5460999999999997e-05 2024-04-19T03:02:53.436 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.436 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.436 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:53.437 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233382+0000", 2024-04-19T03:02:53.437 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8148e-05 2024-04-19T03:02:53.437 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.437 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.437 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:53.437 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233390+0000", 2024-04-19T03:02:53.437 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5340000000000002e-06 2024-04-19T03:02:53.437 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.437 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.437 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:53.437 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233712+0000", 2024-04-19T03:02:53.437 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00032260500000000001 2024-04-19T03:02:53.437 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.437 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.438 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:53.438 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233829+0000", 2024-04-19T03:02:53.438 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011638599999999999 2024-04-19T03:02:53.438 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.438 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.438 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:53.438 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233959+0000", 2024-04-19T03:02:53.438 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013013900000000001 2024-04-19T03:02:53.438 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.438 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.438 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:53.438 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236515+0000", 2024-04-19T03:02:53.439 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0025562750000000002 2024-04-19T03:02:53.439 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.439 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.439 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:53.439 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.249723+0000", 2024-04-19T03:02:53.439 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013208176 2024-04-19T03:02:53.439 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.439 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.439 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:02:53.439 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.249728+0000", 2024-04-19T03:02:53.439 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6519999999999997e-06 2024-04-19T03:02:53.439 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.439 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.440 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:53.440 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266837+0000", 2024-04-19T03:02:53.440 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0171087059999999 2024-04-19T03:02:53.440 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.440 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.440 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:53.440 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266943+0000", 2024-04-19T03:02:53.440 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000106604 2024-04-19T03:02:53.440 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:53.440 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:53.440 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:53.440 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.440 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.441 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87124 5.8 5:14819ad7:::benchmark_data_smithi096_19531_object87123:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:53.441 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.235886+0000", 2024-04-19T03:02:53.441 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 30.107244940000001, 2024-04-19T03:02:53.441 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0315451179999999, 2024-04-19T03:02:53.441 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:53.441 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-19T03:02:53.441 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:53.441 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:53.441 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:53.441 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87124 2024-04-19T03:02:53.441 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.441 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:53.441 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.442 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:53.442 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.235886+0000", 2024-04-19T03:02:53.442 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:53.442 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.442 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.442 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:53.442 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.235886+0000", 2024-04-19T03:02:53.442 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:53.442 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.442 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.442 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:53.442 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.235886+0000", 2024-04-19T03:02:53.442 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:53.443 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.443 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.443 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:53.443 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.235934+0000", 2024-04-19T03:02:53.443 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8384000000000003e-05 2024-04-19T03:02:53.443 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.443 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.443 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:53.443 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.235945+0000", 2024-04-19T03:02:53.443 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0671e-05 2024-04-19T03:02:53.443 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.443 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.443 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:53.443 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.235952+0000", 2024-04-19T03:02:53.443 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3089999999999998e-06 2024-04-19T03:02:53.444 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.444 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.444 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:53.444 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.237067+0000", 2024-04-19T03:02:53.444 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001115263 2024-04-19T03:02:53.444 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.444 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.444 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:53.444 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.237188+0000", 2024-04-19T03:02:53.444 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000121258 2024-04-19T03:02:53.444 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.444 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.444 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:53.445 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.237316+0000", 2024-04-19T03:02:53.445 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000128071 2024-04-19T03:02:53.445 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.445 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.445 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:53.445 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240744+0000", 2024-04-19T03:02:53.445 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0034275629999999998 2024-04-19T03:02:53.445 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.445 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.445 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:53.445 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.252517+0000", 2024-04-19T03:02:53.445 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011772991999999999 2024-04-19T03:02:53.445 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.445 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.446 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:02:53.446 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.252523+0000", 2024-04-19T03:02:53.446 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3640000000000004e-06 2024-04-19T03:02:53.446 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.446 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.446 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:53.446 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.267290+0000", 2024-04-19T03:02:53.446 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0147665690000001 2024-04-19T03:02:53.446 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.446 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.446 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:53.446 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.267432+0000", 2024-04-19T03:02:53.446 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014165299999999999 2024-04-19T03:02:53.447 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:53.447 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:53.447 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:53.447 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.447 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.447 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87129 5.0 5:02667e01:::benchmark_data_smithi096_19531_object87128:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:53.447 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.236466+0000", 2024-04-19T03:02:53.447 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 30.106664943999998, 2024-04-19T03:02:53.447 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0301534510000001, 2024-04-19T03:02:53.447 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:53.447 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-19T03:02:53.447 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:53.447 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:53.447 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:53.448 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87129 2024-04-19T03:02:53.448 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.448 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:53.448 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.448 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:53.448 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236466+0000", 2024-04-19T03:02:53.448 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:53.448 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.448 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.448 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:53.448 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236466+0000", 2024-04-19T03:02:53.448 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:53.448 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.448 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.448 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:53.449 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236465+0000", 2024-04-19T03:02:53.449 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:53.449 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.449 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.449 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:53.449 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236566+0000", 2024-04-19T03:02:53.449 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010047000000000001 2024-04-19T03:02:53.449 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.449 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.449 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:53.449 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236577+0000", 2024-04-19T03:02:53.449 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1772e-05 2024-04-19T03:02:53.449 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.450 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.450 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:53.450 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236584+0000", 2024-04-19T03:02:53.450 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0530000000000003e-06 2024-04-19T03:02:53.450 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.450 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.450 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:53.450 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.237023+0000", 2024-04-19T03:02:53.450 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000439703 2024-04-19T03:02:53.450 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.450 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.450 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:53.450 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.237207+0000", 2024-04-19T03:02:53.451 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000183692 2024-04-19T03:02:53.451 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.451 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.451 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:53.451 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.237373+0000", 2024-04-19T03:02:53.451 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016623500000000001 2024-04-19T03:02:53.451 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.451 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.451 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:53.451 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.241461+0000", 2024-04-19T03:02:53.451 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0040883050000000004 2024-04-19T03:02:53.451 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.451 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.452 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:53.452 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.252500+0000", 2024-04-19T03:02:53.452 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011038450999999999 2024-04-19T03:02:53.452 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.452 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.452 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:02:53.452 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.252507+0000", 2024-04-19T03:02:53.452 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2439999999999996e-06 2024-04-19T03:02:53.452 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.452 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.452 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:53.452 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266538+0000", 2024-04-19T03:02:53.452 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.014031184 2024-04-19T03:02:53.452 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.453 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.453 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:53.453 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266620+0000", 2024-04-19T03:02:53.453 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1600000000000005e-05 2024-04-19T03:02:53.453 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:53.453 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:53.453 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:53.453 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.453 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.453 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87135 5.4 5:2a97e7b7:::benchmark_data_smithi096_19531_object87134:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:53.453 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.240884+0000", 2024-04-19T03:02:53.453 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 30.102247487, 2024-04-19T03:02:53.453 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.025708931, 2024-04-19T03:02:53.453 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:53.454 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-19T03:02:53.454 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:53.454 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:53.454 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:53.454 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87135 2024-04-19T03:02:53.454 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.454 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:53.454 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.454 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:53.454 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240884+0000", 2024-04-19T03:02:53.454 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:53.454 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.454 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.455 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:53.455 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240884+0000", 2024-04-19T03:02:53.455 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:53.455 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.455 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.455 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:53.455 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240883+0000", 2024-04-19T03:02:53.455 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:53.455 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.455 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.455 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:53.455 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240933+0000", 2024-04-19T03:02:53.455 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9969999999999998e-05 2024-04-19T03:02:53.456 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.456 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.456 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:53.456 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240946+0000", 2024-04-19T03:02:53.456 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2943e-05 2024-04-19T03:02:53.456 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.456 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.456 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:53.456 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240952+0000", 2024-04-19T03:02:53.456 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8930000000000002e-06 2024-04-19T03:02:53.456 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.456 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.456 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:53.456 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240994+0000", 2024-04-19T03:02:53.456 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2753999999999998e-05 2024-04-19T03:02:53.457 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.457 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.457 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:53.457 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.241092+0000", 2024-04-19T03:02:53.457 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.7447000000000004e-05 2024-04-19T03:02:53.457 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.457 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.457 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:53.457 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.241183+0000", 2024-04-19T03:02:53.457 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1163999999999997e-05 2024-04-19T03:02:53.457 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.457 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.457 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:53.458 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.254672+0000", 2024-04-19T03:02:53.458 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.01348864 2024-04-19T03:02:53.458 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.458 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.458 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:02:53.458 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.254681+0000", 2024-04-19T03:02:53.458 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.3789999999999995e-06 2024-04-19T03:02:53.458 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.458 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.458 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:53.458 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266456+0000", 2024-04-19T03:02:53.458 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.011774621 2024-04-19T03:02:53.458 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.458 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.459 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:53.459 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266593+0000", 2024-04-19T03:02:53.459 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013737600000000001 2024-04-19T03:02:53.459 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:53.459 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:53.459 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:53.459 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.459 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.459 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87136 5.4 5:212411bc:::benchmark_data_smithi096_19531_object87135:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:53.459 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.240962+0000", 2024-04-19T03:02:53.459 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 30.102169611000001, 2024-04-19T03:02:53.459 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.025738, 2024-04-19T03:02:53.459 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:53.459 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-19T03:02:53.460 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:53.460 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:53.460 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:53.460 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87136 2024-04-19T03:02:53.460 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.460 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:53.460 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.460 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:53.460 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240962+0000", 2024-04-19T03:02:53.460 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:53.460 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.460 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.460 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:53.461 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240962+0000", 2024-04-19T03:02:53.461 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:53.461 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.461 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.461 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:53.461 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240961+0000", 2024-04-19T03:02:53.461 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:53.461 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.461 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.461 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:53.461 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240995+0000", 2024-04-19T03:02:53.461 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3868000000000002e-05 2024-04-19T03:02:53.461 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.461 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.461 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:53.462 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.241001+0000", 2024-04-19T03:02:53.462 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.322e-06 2024-04-19T03:02:53.462 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.462 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.462 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:53.462 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.241004+0000", 2024-04-19T03:02:53.462 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3510000000000002e-06 2024-04-19T03:02:53.462 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.462 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.462 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:53.462 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247131+0000", 2024-04-19T03:02:53.462 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0061270869999999998 2024-04-19T03:02:53.462 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.462 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.463 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:53.463 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247322+0000", 2024-04-19T03:02:53.463 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000191015 2024-04-19T03:02:53.463 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.463 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.463 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:53.463 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247542+0000", 2024-04-19T03:02:53.463 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00022030199999999999 2024-04-19T03:02:53.463 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.463 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.463 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:53.464 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.254709+0000", 2024-04-19T03:02:53.464 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0071662660000000001 2024-04-19T03:02:53.464 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.464 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.464 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:02:53.464 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.254716+0000", 2024-04-19T03:02:53.464 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3860000000000001e-06 2024-04-19T03:02:53.464 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.464 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.464 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:53.464 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266619+0000", 2024-04-19T03:02:53.464 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0119031030000001 2024-04-19T03:02:53.464 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.465 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.465 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:53.465 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266700+0000", 2024-04-19T03:02:53.465 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0764000000000001e-05 2024-04-19T03:02:53.465 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:53.465 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:53.465 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:53.465 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.465 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.465 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87138 5.e 5:7b1f1c20:::benchmark_data_smithi096_19531_object87137:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:53.465 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.247862+0000", 2024-04-19T03:02:53.465 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 30.095269537, 2024-04-19T03:02:53.465 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.024457079, 2024-04-19T03:02:53.465 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:53.466 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:53.466 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:53.466 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:53.466 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:53.466 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87138 2024-04-19T03:02:53.466 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.466 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:53.466 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.466 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:53.466 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247862+0000", 2024-04-19T03:02:53.466 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:53.466 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.466 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.467 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:53.467 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247862+0000", 2024-04-19T03:02:53.467 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:53.467 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.467 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.467 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:53.467 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247860+0000", 2024-04-19T03:02:53.467 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999981 2024-04-19T03:02:53.467 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.467 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.467 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:53.467 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247909+0000", 2024-04-19T03:02:53.467 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9150999999999997e-05 2024-04-19T03:02:53.468 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.468 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.468 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:53.468 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247925+0000", 2024-04-19T03:02:53.468 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5761999999999999e-05 2024-04-19T03:02:53.468 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.468 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.468 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:53.468 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247936+0000", 2024-04-19T03:02:53.468 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1144e-05 2024-04-19T03:02:53.468 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.468 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.469 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:53.469 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.250590+0000", 2024-04-19T03:02:53.469 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.002653678 2024-04-19T03:02:53.469 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.469 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.469 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:02:53.469 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.250599+0000", 2024-04-19T03:02:53.469 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9039999999999998e-06 2024-04-19T03:02:53.469 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.469 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.469 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:53.469 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.268151+0000", 2024-04-19T03:02:53.469 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0175523449999999 2024-04-19T03:02:53.469 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.470 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.470 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:53.470 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.268285+0000", 2024-04-19T03:02:53.470 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013415599999999999 2024-04-19T03:02:53.470 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.470 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.470 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:53.470 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.272238+0000", 2024-04-19T03:02:53.470 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0039533019999999997 2024-04-19T03:02:53.470 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.470 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.470 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:53.471 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.272274+0000", 2024-04-19T03:02:53.471 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5352000000000003e-05 2024-04-19T03:02:53.471 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:53.471 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:53.471 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:53.471 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.272319+0000", 2024-04-19T03:02:53.471 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5281999999999998e-05 2024-04-19T03:02:53.471 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:53.471 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:53.471 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:53.471 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:53.471 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:53.471 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-19T03:02:53.473 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T03:02:53.473 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:53.471+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:53.488 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-19T03:02:53.573 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:53.571+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:53.599 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-04-19T03:02:53.600 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [ 2024-04-19T03:02:53.600 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.600 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:147065 5.f 5:fd8d5c7a:::benchmark_data_smithi096_19531_object33615:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-19T03:02:53.600 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:53.567832+0000", 2024-04-19T03:02:53.600 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.030289773999999998, 2024-04-19T03:02:53.600 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.030321052000000001, 2024-04-19T03:02:53.600 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:53.600 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:02:53.600 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:53.600 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:53.600 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:53.601 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 147065 2024-04-19T03:02:53.601 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.601 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:53.601 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.601 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:53.601 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:53.567832+0000", 2024-04-19T03:02:53.601 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:53.601 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.601 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.601 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:53.601 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:53.567832+0000", 2024-04-19T03:02:53.601 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:53.601 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.601 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.602 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:53.602 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:53.567831+0000", 2024-04-19T03:02:53.602 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:53.602 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.602 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.602 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:53.602 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:53.567836+0000", 2024-04-19T03:02:53.602 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6909999999999996e-06 2024-04-19T03:02:53.602 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.602 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.602 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:53.602 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:53.567843+0000", 2024-04-19T03:02:53.603 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5979999999999999e-06 2024-04-19T03:02:53.603 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.603 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.603 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:53.603 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:53.567850+0000", 2024-04-19T03:02:53.603 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7270000000000001e-06 2024-04-19T03:02:53.603 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.603 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.603 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:53.603 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:53.567889+0000", 2024-04-19T03:02:53.603 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9079999999999999e-05 2024-04-19T03:02:53.603 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.603 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.603 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:53.604 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:53.567992+0000", 2024-04-19T03:02:53.604 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000102942 2024-04-19T03:02:53.604 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.604 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.604 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:02:53.604 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:53.568085+0000", 2024-04-19T03:02:53.604 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.2995e-05 2024-04-19T03:02:53.604 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:53.604 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:53.604 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:53.604 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.604 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.604 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:147066 5.6 5.293289f6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-19T03:02:53.604 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:53.568658+0000", 2024-04-19T03:02:53.605 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.029463295, 2024-04-19T03:02:53.605 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.029565654, 2024-04-19T03:02:53.605 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:53.605 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-04-19T03:02:53.605 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:53.605 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:53.605 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:53.605 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 147066 2024-04-19T03:02:53.605 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.606 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:53.606 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.606 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:53.606 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:53.568658+0000", 2024-04-19T03:02:53.606 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:53.606 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.606 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.606 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:53.606 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:53.568658+0000", 2024-04-19T03:02:53.606 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:53.606 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.606 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.606 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:53.607 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:53.568658+0000", 2024-04-19T03:02:53.607 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:53.607 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.607 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.607 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:53.607 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:53.568662+0000", 2024-04-19T03:02:53.607 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8940000000000001e-06 2024-04-19T03:02:53.607 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.609 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.609 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:53.609 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:53.568670+0000", 2024-04-19T03:02:53.609 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0290000000000005e-06 2024-04-19T03:02:53.609 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.609 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.609 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:53.609 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:53.568676+0000", 2024-04-19T03:02:53.609 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5450000000000003e-06 2024-04-19T03:02:53.609 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:53.610 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:53.610 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:53.610 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.610 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.610 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:147047 5.f 5:f9b889e8:::benchmark_data_smithi096_19531_object33597:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-19T03:02:53.610 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:53.560984+0000", 2024-04-19T03:02:53.610 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.037138070000000002, 2024-04-19T03:02:53.610 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.037291754000000003, 2024-04-19T03:02:53.610 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:53.610 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:02:53.610 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:53.610 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:53.610 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:53.611 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 147047 2024-04-19T03:02:53.611 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.611 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:53.611 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.611 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:53.611 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:53.560984+0000", 2024-04-19T03:02:53.611 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:53.611 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.611 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.611 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:53.611 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:53.560984+0000", 2024-04-19T03:02:53.611 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:53.611 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.611 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.612 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:53.612 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:53.560983+0000", 2024-04-19T03:02:53.612 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:53.612 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.612 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.612 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:53.612 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:53.560992+0000", 2024-04-19T03:02:53.612 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4149999999999999e-06 2024-04-19T03:02:53.612 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.612 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.612 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:53.612 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:53.561005+0000", 2024-04-19T03:02:53.612 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3475000000000001e-05 2024-04-19T03:02:53.612 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.613 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.613 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:53.613 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:53.561019+0000", 2024-04-19T03:02:53.613 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3794999999999999e-05 2024-04-19T03:02:53.613 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.613 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.613 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:53.613 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:53.562353+0000", 2024-04-19T03:02:53.613 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0013345399999999999 2024-04-19T03:02:53.613 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.613 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.613 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:53.613 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:53.562475+0000", 2024-04-19T03:02:53.613 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00012129 2024-04-19T03:02:53.614 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.614 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.614 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:02:53.614 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:53.562574+0000", 2024-04-19T03:02:53.614 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.9689e-05 2024-04-19T03:02:53.614 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:53.614 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:53.614 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:53.614 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.614 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.614 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:147051 5.7 5:e06b1e77:::benchmark_data_smithi096_19531_object33601:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-19T03:02:53.614 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:53.562138+0000", 2024-04-19T03:02:53.614 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.035983920000000003, 2024-04-19T03:02:53.614 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.036217270000000003, 2024-04-19T03:02:53.615 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:53.615 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-04-19T03:02:53.615 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:53.615 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:53.615 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:53.615 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 147051 2024-04-19T03:02:53.615 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.615 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:53.615 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.615 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:53.615 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:53.562138+0000", 2024-04-19T03:02:53.615 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:53.615 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.616 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.616 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:53.616 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:53.562138+0000", 2024-04-19T03:02:53.616 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:53.616 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.616 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.616 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:53.616 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:53.562137+0000", 2024-04-19T03:02:53.616 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:53.616 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.616 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.616 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:53.616 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:53.562142+0000", 2024-04-19T03:02:53.617 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4e-06 2024-04-19T03:02:53.617 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.617 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.617 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:53.618 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:53.562156+0000", 2024-04-19T03:02:53.618 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3927000000000001e-05 2024-04-19T03:02:53.618 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.618 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.618 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:53.618 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:53.562168+0000", 2024-04-19T03:02:53.618 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1758e-05 2024-04-19T03:02:53.618 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.618 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.618 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:53.618 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:53.564589+0000", 2024-04-19T03:02:53.618 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0024208960000000001 2024-04-19T03:02:53.619 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.619 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.619 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:53.619 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:53.564710+0000", 2024-04-19T03:02:53.619 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000121192 2024-04-19T03:02:53.619 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:53.619 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:53.619 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:53.619 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.619 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.619 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:147055 5.7 5:e18d8a6c:::benchmark_data_smithi096_19531_object33605:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-19T03:02:53.619 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:53.562257+0000", 2024-04-19T03:02:53.619 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.035865226, 2024-04-19T03:02:53.620 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.036163320999999998, 2024-04-19T03:02:53.620 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:53.620 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-04-19T03:02:53.620 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:53.620 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:53.620 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:53.620 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 147055 2024-04-19T03:02:53.620 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.620 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:53.620 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.620 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:53.620 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:53.562257+0000", 2024-04-19T03:02:53.620 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:53.620 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.621 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.621 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:53.621 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:53.562257+0000", 2024-04-19T03:02:53.621 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:53.621 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.621 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.621 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:53.621 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:53.562256+0000", 2024-04-19T03:02:53.621 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:53.621 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.621 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.621 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:53.621 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:53.562259+0000", 2024-04-19T03:02:53.622 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.6369999999999999e-06 2024-04-19T03:02:53.622 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.622 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.622 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:53.622 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:53.562265+0000", 2024-04-19T03:02:53.622 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1129999999999997e-06 2024-04-19T03:02:53.622 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.622 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.622 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:53.622 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:53.562270+0000", 2024-04-19T03:02:53.622 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2320000000000001e-06 2024-04-19T03:02:53.623 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.623 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.623 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:53.623 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:53.566466+0000", 2024-04-19T03:02:53.623 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0041955940000000004 2024-04-19T03:02:53.623 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.623 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.623 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:53.623 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:53.566573+0000", 2024-04-19T03:02:53.623 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000107091 2024-04-19T03:02:53.623 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:53.623 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:53.623 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:53.624 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.624 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.624 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:147057 5.c 5:3d922840:::benchmark_data_smithi096_19531_object33607:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-19T03:02:53.624 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:53.564561+0000", 2024-04-19T03:02:53.624 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.033561215999999998, 2024-04-19T03:02:53.624 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.033922446000000002, 2024-04-19T03:02:53.624 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:53.624 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-04-19T03:02:53.624 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:53.624 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:53.624 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:53.624 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 147057 2024-04-19T03:02:53.624 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.625 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:53.625 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.625 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:53.625 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:53.564561+0000", 2024-04-19T03:02:53.625 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:53.625 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.625 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.625 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:53.625 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:53.564561+0000", 2024-04-19T03:02:53.625 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:53.625 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.625 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.625 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:53.625 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:53.564559+0000", 2024-04-19T03:02:53.626 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:53.626 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.626 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.626 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:53.626 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:53.564566+0000", 2024-04-19T03:02:53.626 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3749999999999999e-06 2024-04-19T03:02:53.626 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.626 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.626 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:53.626 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:53.564580+0000", 2024-04-19T03:02:53.626 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4073999999999999e-05 2024-04-19T03:02:53.626 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.626 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.626 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:53.627 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:53.564586+0000", 2024-04-19T03:02:53.627 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4160000000000001e-06 2024-04-19T03:02:53.627 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.627 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.627 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:53.627 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:53.564763+0000", 2024-04-19T03:02:53.627 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00017642999999999999 2024-04-19T03:02:53.627 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.627 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.627 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:53.627 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:53.564894+0000", 2024-04-19T03:02:53.627 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000131579 2024-04-19T03:02:53.627 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.627 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.628 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:53.628 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:53.569875+0000", 2024-04-19T03:02:53.628 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.004980394 2024-04-19T03:02:53.628 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:53.628 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:53.628 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:53.628 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.628 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.628 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:147058 5.2 5:40ed8407:::benchmark_data_smithi096_19531_object33608:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-19T03:02:53.628 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:53.565161+0000", 2024-04-19T03:02:53.628 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.032960696999999997, 2024-04-19T03:02:53.628 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.033389417999999997, 2024-04-19T03:02:53.628 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:53.628 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-04-19T03:02:53.629 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:53.629 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:53.629 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:53.629 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 147058 2024-04-19T03:02:53.629 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.629 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:53.629 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.629 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:53.629 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:53.565161+0000", 2024-04-19T03:02:53.629 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:53.629 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.629 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.629 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:53.629 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:53.565161+0000", 2024-04-19T03:02:53.630 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:53.630 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.630 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.630 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:53.630 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:53.565160+0000", 2024-04-19T03:02:53.630 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:53.630 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.630 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.630 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:53.630 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:53.565164+0000", 2024-04-19T03:02:53.630 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1840000000000001e-06 2024-04-19T03:02:53.630 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.630 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.631 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:53.631 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:53.565174+0000", 2024-04-19T03:02:53.631 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.5550000000000008e-06 2024-04-19T03:02:53.631 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.631 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.631 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:53.631 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:53.565179+0000", 2024-04-19T03:02:53.631 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7119999999999999e-06 2024-04-19T03:02:53.631 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.631 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.631 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:53.631 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:53.565221+0000", 2024-04-19T03:02:53.631 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2188000000000003e-05 2024-04-19T03:02:53.631 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.632 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.632 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:53.632 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:53.565357+0000", 2024-04-19T03:02:53.632 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00013648800000000001 2024-04-19T03:02:53.632 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.632 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.632 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:53.632 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:53.569857+0000", 2024-04-19T03:02:53.632 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0044997170000000003 2024-04-19T03:02:53.632 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:53.632 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:53.632 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:53.632 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.632 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.633 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:147059 5.1 5:87885301:::benchmark_data_smithi096_19531_object33609:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-19T03:02:53.633 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:53.565189+0000", 2024-04-19T03:02:53.633 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.032933183999999997, 2024-04-19T03:02:53.633 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.033431575999999998, 2024-04-19T03:02:53.633 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:53.633 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-04-19T03:02:53.633 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:53.633 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:53.633 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:53.633 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 147059 2024-04-19T03:02:53.633 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.633 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:53.633 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.633 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:53.634 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:53.565189+0000", 2024-04-19T03:02:53.634 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:53.634 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.634 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.634 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:53.634 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:53.565189+0000", 2024-04-19T03:02:53.634 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:53.634 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.634 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.634 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:53.635 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:53.565188+0000", 2024-04-19T03:02:53.635 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:53.635 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.635 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.635 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:53.635 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:53.565191+0000", 2024-04-19T03:02:53.635 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.8720000000000002e-06 2024-04-19T03:02:53.635 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.635 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.635 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:53.635 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:53.565198+0000", 2024-04-19T03:02:53.635 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8279999999999997e-06 2024-04-19T03:02:53.635 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.636 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.636 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:53.636 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:53.565201+0000", 2024-04-19T03:02:53.636 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3129999999999999e-06 2024-04-19T03:02:53.636 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.636 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.636 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:53.636 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:53.565485+0000", 2024-04-19T03:02:53.637 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000284078 2024-04-19T03:02:53.637 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.637 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.637 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:53.637 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:53.565597+0000", 2024-04-19T03:02:53.637 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00011121200000000001 2024-04-19T03:02:53.637 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:53.637 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:53.637 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:53.637 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.637 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.637 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:147060 5.d 5:bb261cc4:::benchmark_data_smithi096_19531_object33610:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-19T03:02:53.637 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:53.565454+0000", 2024-04-19T03:02:53.638 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.032668230999999999, 2024-04-19T03:02:53.638 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.033229974000000002, 2024-04-19T03:02:53.638 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:53.638 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:02:53.638 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:53.638 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:53.638 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:53.638 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 147060 2024-04-19T03:02:53.638 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.638 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:53.638 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.638 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:53.639 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:53.565454+0000", 2024-04-19T03:02:53.639 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:53.639 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.639 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.639 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:53.639 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:53.565454+0000", 2024-04-19T03:02:53.639 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:53.639 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.639 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.639 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:53.639 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:53.565453+0000", 2024-04-19T03:02:53.639 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:53.639 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.639 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.640 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:53.640 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:53.565456+0000", 2024-04-19T03:02:53.640 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.1829999999999998e-06 2024-04-19T03:02:53.640 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.640 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.640 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:53.640 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:53.565461+0000", 2024-04-19T03:02:53.640 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8799999999999999e-06 2024-04-19T03:02:53.640 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.640 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.640 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:53.640 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:53.565466+0000", 2024-04-19T03:02:53.640 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5009999999999998e-06 2024-04-19T03:02:53.641 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.641 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.641 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:53.641 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:53.565504+0000", 2024-04-19T03:02:53.641 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8442999999999998e-05 2024-04-19T03:02:53.641 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.641 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.641 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:53.641 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:53.565585+0000", 2024-04-19T03:02:53.641 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0821000000000004e-05 2024-04-19T03:02:53.641 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.641 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.641 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:02:53.642 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:53.565654+0000", 2024-04-19T03:02:53.642 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8886000000000004e-05 2024-04-19T03:02:53.642 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:53.642 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:53.642 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:53.642 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.642 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.642 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:147061 5.6 5:6196669e:::benchmark_data_smithi096_19531_object33611:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-19T03:02:53.642 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:53.567536+0000", 2024-04-19T03:02:53.642 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.030585852, 2024-04-19T03:02:53.642 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.031216071000000001, 2024-04-19T03:02:53.642 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:53.642 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-04-19T03:02:53.642 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:53.643 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:53.643 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:53.643 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 147061 2024-04-19T03:02:53.643 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.643 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:53.643 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.643 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:53.643 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:53.567536+0000", 2024-04-19T03:02:53.643 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:53.643 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.643 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.643 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:53.643 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:53.567536+0000", 2024-04-19T03:02:53.643 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:53.644 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.644 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.644 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:53.644 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:53.567535+0000", 2024-04-19T03:02:53.644 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:53.644 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.644 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.644 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:53.644 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:53.567540+0000", 2024-04-19T03:02:53.644 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7760000000000003e-06 2024-04-19T03:02:53.644 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.644 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.644 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:53.644 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:53.567551+0000", 2024-04-19T03:02:53.645 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0613e-05 2024-04-19T03:02:53.645 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.645 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.645 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:53.645 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:53.567559+0000", 2024-04-19T03:02:53.645 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6199999999999999e-06 2024-04-19T03:02:53.645 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.645 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.645 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:53.645 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:53.567603+0000", 2024-04-19T03:02:53.645 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4304999999999997e-05 2024-04-19T03:02:53.645 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.645 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.646 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:53.646 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:53.567714+0000", 2024-04-19T03:02:53.646 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00011091600000000001 2024-04-19T03:02:53.646 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:53.646 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:53.646 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:53.646 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.646 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.646 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:147063 5.6 5:6bdb2cdc:::benchmark_data_smithi096_19531_object33613:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-19T03:02:53.646 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:53.567576+0000", 2024-04-19T03:02:53.646 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.030545764, 2024-04-19T03:02:53.646 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.031238585999999999, 2024-04-19T03:02:53.647 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:53.647 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-04-19T03:02:53.647 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:53.647 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:53.647 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:53.647 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 147063 2024-04-19T03:02:53.647 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.647 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:53.647 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.647 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:53.647 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:53.567576+0000", 2024-04-19T03:02:53.647 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:53.648 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.648 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.648 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:53.648 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:53.567576+0000", 2024-04-19T03:02:53.648 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:53.648 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.648 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.648 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:53.648 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:53.567576+0000", 2024-04-19T03:02:53.648 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:53.648 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.648 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.648 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:53.648 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:53.567578+0000", 2024-04-19T03:02:53.649 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.6340000000000001e-06 2024-04-19T03:02:53.649 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.649 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.649 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:53.649 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:53.567583+0000", 2024-04-19T03:02:53.649 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4839999999999998e-06 2024-04-19T03:02:53.649 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.649 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.649 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:53.649 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:53.567586+0000", 2024-04-19T03:02:53.649 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0520000000000002e-06 2024-04-19T03:02:53.649 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.649 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.649 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:53.650 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:53.569453+0000", 2024-04-19T03:02:53.650 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0018671670000000001 2024-04-19T03:02:53.650 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.650 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.650 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:53.650 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:53.569519+0000", 2024-04-19T03:02:53.650 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5902999999999996e-05 2024-04-19T03:02:53.650 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:53.650 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:53.650 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:53.650 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.650 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.651 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:147064 5.9 5:9df1a98e:::benchmark_data_smithi096_19531_object33614:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-19T03:02:53.651 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:53.567612+0000", 2024-04-19T03:02:53.651 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.030509563999999999, 2024-04-19T03:02:53.651 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.031265407000000002, 2024-04-19T03:02:53.651 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:53.651 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:02:53.651 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:53.651 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:53.651 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:53.651 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 147064 2024-04-19T03:02:53.651 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.651 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:53.651 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.651 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:53.652 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:53.567612+0000", 2024-04-19T03:02:53.652 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:53.652 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.652 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.652 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:53.652 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:53.567612+0000", 2024-04-19T03:02:53.652 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:53.652 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.652 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.652 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:53.652 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:53.567612+0000", 2024-04-19T03:02:53.652 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:53.652 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.653 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.653 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:53.653 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:53.567614+0000", 2024-04-19T03:02:53.653 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.4490000000000002e-06 2024-04-19T03:02:53.653 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.653 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.653 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:53.653 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:53.567618+0000", 2024-04-19T03:02:53.653 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7579999999999998e-06 2024-04-19T03:02:53.653 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.653 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.653 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:53.653 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:53.567621+0000", 2024-04-19T03:02:53.653 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.1769999999999998e-06 2024-04-19T03:02:53.654 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.654 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.654 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:53.654 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:53.567663+0000", 2024-04-19T03:02:53.654 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2104999999999998e-05 2024-04-19T03:02:53.654 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.654 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.654 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:53.654 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:53.567741+0000", 2024-04-19T03:02:53.654 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7096999999999997e-05 2024-04-19T03:02:53.654 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.654 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.654 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:02:53.654 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:53.567799+0000", 2024-04-19T03:02:53.655 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8400000000000003e-05 2024-04-19T03:02:53.655 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:53.655 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:53.655 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:53.655 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:53.655 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-04-19T03:02:53.655 INFO:teuthology.orchestra.run.smithi144.stdout: "num_ops": 12 2024-04-19T03:02:53.655 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-04-19T03:02:53.656 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T03:02:53.702 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:53.700+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:53.776 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:53.772+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:53.784 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-04-19T03:02:53.784 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2024-04-19T03:02:53.785 INFO:teuthology.orchestra.run.smithi144.stdout: "complaint_time": 30, 2024-04-19T03:02:53.785 INFO:teuthology.orchestra.run.smithi144.stdout: "num_blocked_ops": 0 2024-04-19T03:02:53.785 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-04-19T03:02:53.798 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T03:02:53.877 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:53.872+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:53.930 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-04-19T03:02:53.930 INFO:teuthology.orchestra.run.smithi144.stdout: "size": 20, 2024-04-19T03:02:53.931 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 600, 2024-04-19T03:02:53.931 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [ 2024-04-19T03:02:53.931 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.931 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:78992 5.7 5:e6baa862:::benchmark_data_smithi096_19531_object78991:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-19T03:02:53.931 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:18.008888+0000", 2024-04-19T03:02:53.931 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 35.918966689000001, 2024-04-19T03:02:53.931 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.056375285999999997, 2024-04-19T03:02:53.931 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:53.931 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:53.931 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:53.931 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:53.931 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:53.931 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 78992 2024-04-19T03:02:53.932 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.932 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:53.932 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.932 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:53.932 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.008888+0000", 2024-04-19T03:02:53.932 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:53.932 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.932 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.932 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:53.932 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.008888+0000", 2024-04-19T03:02:53.932 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:53.932 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.932 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.933 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:53.933 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.008888+0000", 2024-04-19T03:02:53.933 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:53.933 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.933 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.933 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:53.933 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.008928+0000", 2024-04-19T03:02:53.933 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0361999999999997e-05 2024-04-19T03:02:53.933 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.933 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.933 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:53.933 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.008942+0000", 2024-04-19T03:02:53.933 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4365000000000001e-05 2024-04-19T03:02:53.933 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.934 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.934 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:53.934 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.008949+0000", 2024-04-19T03:02:53.934 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.212e-06 2024-04-19T03:02:53.934 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.934 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.934 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:53.934 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.012683+0000", 2024-04-19T03:02:53.934 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.003733934 2024-04-19T03:02:53.934 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.934 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.934 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:53.934 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.012798+0000", 2024-04-19T03:02:53.935 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00011574999999999999 2024-04-19T03:02:53.935 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.935 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.935 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:53.935 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.012896+0000", 2024-04-19T03:02:53.935 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.7848000000000002e-05 2024-04-19T03:02:53.935 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.935 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.935 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:53.935 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016423+0000", 2024-04-19T03:02:53.935 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0035270789999999998 2024-04-19T03:02:53.935 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.935 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.935 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:53.935 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.065098+0000", 2024-04-19T03:02:53.936 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.048674651999999999 2024-04-19T03:02:53.936 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.936 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.936 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:53.936 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.065193+0000", 2024-04-19T03:02:53.936 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.5087999999999995e-05 2024-04-19T03:02:53.936 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.936 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.936 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:53.936 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.065264+0000", 2024-04-19T03:02:53.936 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0666000000000004e-05 2024-04-19T03:02:53.936 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:53.936 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:53.936 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:53.937 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.937 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.937 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:78998 5.7 5:ee23c1bc:::benchmark_data_smithi096_19531_object78997:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-19T03:02:53.937 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:18.013165+0000", 2024-04-19T03:02:53.937 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 35.914689983000002, 2024-04-19T03:02:53.937 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.052410864000000001, 2024-04-19T03:02:53.937 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:53.937 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:53.937 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:53.937 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:53.937 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:53.937 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 78998 2024-04-19T03:02:53.937 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.937 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:53.938 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.938 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:53.938 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.013165+0000", 2024-04-19T03:02:53.938 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:53.938 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.938 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.938 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:53.938 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.013165+0000", 2024-04-19T03:02:53.938 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:53.938 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.938 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.938 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:53.938 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.013164+0000", 2024-04-19T03:02:53.939 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:53.939 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.939 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.939 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:53.939 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.013214+0000", 2024-04-19T03:02:53.939 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9636999999999999e-05 2024-04-19T03:02:53.939 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.939 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.939 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:53.939 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.013223+0000", 2024-04-19T03:02:53.939 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.3619999999999995e-06 2024-04-19T03:02:53.939 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.939 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.939 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:53.940 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.013229+0000", 2024-04-19T03:02:53.940 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6060000000000002e-06 2024-04-19T03:02:53.940 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.940 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.940 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:53.940 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.014882+0000", 2024-04-19T03:02:53.940 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001653257 2024-04-19T03:02:53.940 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.940 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.940 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:53.940 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.014958+0000", 2024-04-19T03:02:53.940 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6398999999999998e-05 2024-04-19T03:02:53.940 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.940 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.940 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:53.941 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.015036+0000", 2024-04-19T03:02:53.941 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8070000000000003e-05 2024-04-19T03:02:53.941 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.941 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.941 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:53.941 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018099+0000", 2024-04-19T03:02:53.941 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0030631149999999999 2024-04-19T03:02:53.941 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.941 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.941 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:53.941 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.065328+0000", 2024-04-19T03:02:53.941 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.047228349000000003 2024-04-19T03:02:53.941 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.941 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.941 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:53.942 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.065508+0000", 2024-04-19T03:02:53.942 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00018036899999999999 2024-04-19T03:02:53.942 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.942 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.942 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:53.942 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.065576+0000", 2024-04-19T03:02:53.942 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7785000000000002e-05 2024-04-19T03:02:53.942 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:53.943 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:53.943 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:53.943 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.943 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.943 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4755.0:78995 5.2 e40/39 5:42b55e12:::benchmark_data_smithi096_19531_object78994:head v 40'4934, mlcod=40'4932)", 2024-04-19T03:02:53.943 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:18.016247+0000", 2024-04-19T03:02:53.943 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 35.911608020999999, 2024-04-19T03:02:53.943 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.056240406, 2024-04-19T03:02:53.943 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:53.943 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:53.943 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:53.943 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.943 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:53.943 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016247+0000", 2024-04-19T03:02:53.944 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:53.944 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.944 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.944 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:53.944 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016247+0000", 2024-04-19T03:02:53.944 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:53.944 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.944 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.944 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:53.945 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016246+0000", 2024-04-19T03:02:53.945 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:53.945 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.945 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.945 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:53.945 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016315+0000", 2024-04-19T03:02:53.945 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8979000000000005e-05 2024-04-19T03:02:53.945 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.945 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.945 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:53.945 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016333+0000", 2024-04-19T03:02:53.945 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7586999999999999e-05 2024-04-19T03:02:53.945 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.945 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.946 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:53.946 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016340+0000", 2024-04-19T03:02:53.946 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4080000000000001e-06 2024-04-19T03:02:53.946 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.946 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.946 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:53.946 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016384+0000", 2024-04-19T03:02:53.946 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3656999999999999e-05 2024-04-19T03:02:53.946 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.946 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.946 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:53.946 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016403+0000", 2024-04-19T03:02:53.946 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9089e-05 2024-04-19T03:02:53.947 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.947 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.947 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:53.947 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.072448+0000", 2024-04-19T03:02:53.947 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.056045084000000002 2024-04-19T03:02:53.947 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.947 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.947 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:53.947 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.072487+0000", 2024-04-19T03:02:53.947 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9362e-05 2024-04-19T03:02:53.947 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:53.947 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:53.947 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:53.948 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.948 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.948 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4755.0:78994 5.c e40/22 5:3c60d55d:::benchmark_data_smithi096_19531_object78993:head v 40'4989, mlcod=40'4987)", 2024-04-19T03:02:53.948 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:18.016392+0000", 2024-04-19T03:02:53.948 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 35.911463380000001, 2024-04-19T03:02:53.948 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.052629620000000002, 2024-04-19T03:02:53.948 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:53.948 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:53.948 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:53.948 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.948 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:53.948 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016392+0000", 2024-04-19T03:02:53.948 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:53.948 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.949 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.949 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:53.949 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016392+0000", 2024-04-19T03:02:53.949 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:53.949 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.949 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.949 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:53.949 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016391+0000", 2024-04-19T03:02:53.949 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:53.949 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.949 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.949 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:53.949 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016471+0000", 2024-04-19T03:02:53.949 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9346999999999998e-05 2024-04-19T03:02:53.950 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.950 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.950 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:53.950 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016478+0000", 2024-04-19T03:02:53.950 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.593e-06 2024-04-19T03:02:53.950 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.950 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.950 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:53.950 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016495+0000", 2024-04-19T03:02:53.950 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6492999999999999e-05 2024-04-19T03:02:53.950 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.950 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.950 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:53.951 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016539+0000", 2024-04-19T03:02:53.951 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4715999999999997e-05 2024-04-19T03:02:53.951 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.951 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.951 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:53.951 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016551+0000", 2024-04-19T03:02:53.951 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2096000000000001e-05 2024-04-19T03:02:53.951 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.951 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.951 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:53.951 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.068985+0000", 2024-04-19T03:02:53.951 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.052433754999999999 2024-04-19T03:02:53.951 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.951 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.952 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:53.952 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.069021+0000", 2024-04-19T03:02:53.952 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6047000000000002e-05 2024-04-19T03:02:53.952 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:53.952 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:53.952 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:53.952 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.952 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.952 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4755.0:78996 5.1 e40/39 5:87f59708:::benchmark_data_smithi096_19531_object78995:head v 40'4940, mlcod=40'4938)", 2024-04-19T03:02:53.952 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:18.016581+0000", 2024-04-19T03:02:53.952 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 35.911274214999999, 2024-04-19T03:02:53.952 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.052051785000000003, 2024-04-19T03:02:53.952 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:53.952 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:53.953 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:53.953 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.953 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:53.953 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016581+0000", 2024-04-19T03:02:53.953 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:53.953 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.953 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.953 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:53.953 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016581+0000", 2024-04-19T03:02:53.953 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:53.953 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.953 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.953 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:53.954 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016581+0000", 2024-04-19T03:02:53.954 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:53.954 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.954 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.954 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:53.954 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016610+0000", 2024-04-19T03:02:53.954 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9556999999999998e-05 2024-04-19T03:02:53.954 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.954 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.954 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:53.954 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016616+0000", 2024-04-19T03:02:53.954 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1090000000000003e-06 2024-04-19T03:02:53.954 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.955 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.955 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:53.955 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016621+0000", 2024-04-19T03:02:53.955 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.454e-06 2024-04-19T03:02:53.955 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.955 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.955 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:53.955 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016663+0000", 2024-04-19T03:02:53.955 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2582e-05 2024-04-19T03:02:53.955 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.955 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.955 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:53.955 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016681+0000", 2024-04-19T03:02:53.955 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7680999999999999e-05 2024-04-19T03:02:53.956 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.956 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.956 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:53.956 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.068486+0000", 2024-04-19T03:02:53.956 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.051804624000000001 2024-04-19T03:02:53.956 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.956 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.956 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:53.956 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.068633+0000", 2024-04-19T03:02:53.956 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00014709099999999999 2024-04-19T03:02:53.956 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:53.956 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:53.956 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:53.957 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.957 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.957 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4755.0:78999 5.3 e40/22 5:c9ec5f7f:::benchmark_data_smithi096_19531_object78998:head v 40'4893, mlcod=40'4889)", 2024-04-19T03:02:53.957 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:18.016633+0000", 2024-04-19T03:02:53.957 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 35.911222359999996, 2024-04-19T03:02:53.957 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.051090469999999999, 2024-04-19T03:02:53.957 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:53.957 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:53.957 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:53.957 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.957 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:53.957 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016633+0000", 2024-04-19T03:02:53.957 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:53.957 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.957 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.958 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:53.958 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016633+0000", 2024-04-19T03:02:53.958 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:53.958 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.958 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.958 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:53.958 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016632+0000", 2024-04-19T03:02:53.958 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967296 2024-04-19T03:02:53.958 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.958 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.958 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:53.958 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016660+0000", 2024-04-19T03:02:53.958 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7869999999999999e-05 2024-04-19T03:02:53.959 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.959 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.959 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:53.959 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016667+0000", 2024-04-19T03:02:53.959 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0280000000000003e-06 2024-04-19T03:02:53.959 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.959 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.959 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:53.959 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016672+0000", 2024-04-19T03:02:53.960 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0069999999999997e-06 2024-04-19T03:02:53.960 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.960 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.960 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:53.960 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016725+0000", 2024-04-19T03:02:53.960 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2812000000000002e-05 2024-04-19T03:02:53.960 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.960 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.960 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:53.960 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016750+0000", 2024-04-19T03:02:53.960 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5038e-05 2024-04-19T03:02:53.960 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.960 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.960 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:53.961 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.067673+0000", 2024-04-19T03:02:53.961 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.050922350999999998 2024-04-19T03:02:53.961 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.961 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.961 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:53.961 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.067723+0000", 2024-04-19T03:02:53.961 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0586e-05 2024-04-19T03:02:53.961 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:53.961 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:53.961 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:53.961 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.961 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.961 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4755.0:79003 5.2 e40/39 5:4436e33f:::benchmark_data_smithi096_19531_object79002:head v 40'4935, mlcod=40'4932)", 2024-04-19T03:02:53.961 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:18.018102+0000", 2024-04-19T03:02:53.962 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 35.909752632999997, 2024-04-19T03:02:53.962 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.060023990999999999, 2024-04-19T03:02:53.962 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:53.962 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:53.962 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:53.962 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.962 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:53.962 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018102+0000", 2024-04-19T03:02:53.962 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:53.962 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.962 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.962 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:53.962 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018102+0000", 2024-04-19T03:02:53.963 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:53.963 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.963 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.963 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:53.963 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018102+0000", 2024-04-19T03:02:53.963 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:53.963 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.963 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.963 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:53.963 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018134+0000", 2024-04-19T03:02:53.963 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2722000000000003e-05 2024-04-19T03:02:53.963 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.963 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.963 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:53.963 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018145+0000", 2024-04-19T03:02:53.964 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0395e-05 2024-04-19T03:02:53.964 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.964 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.964 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:53.964 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018151+0000", 2024-04-19T03:02:53.964 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5300000000000002e-06 2024-04-19T03:02:53.964 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.964 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.964 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:53.964 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018489+0000", 2024-04-19T03:02:53.964 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00033731499999999998 2024-04-19T03:02:53.964 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.964 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.965 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:53.965 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018508+0000", 2024-04-19T03:02:53.965 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9775e-05 2024-04-19T03:02:53.965 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.965 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.965 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:53.965 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.078059+0000", 2024-04-19T03:02:53.965 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.059550171999999998 2024-04-19T03:02:53.965 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.965 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.965 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:53.965 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.078126+0000", 2024-04-19T03:02:53.965 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7773000000000003e-05 2024-04-19T03:02:53.965 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:53.966 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:53.966 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:53.966 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.966 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.966 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4755.0:79005 5.1 e40/39 5:85b46038:::benchmark_data_smithi096_19531_object79004:head v 40'4941, mlcod=40'4938)", 2024-04-19T03:02:53.966 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:18.018167+0000", 2024-04-19T03:02:53.966 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 35.909687914000003, 2024-04-19T03:02:53.966 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.052768941999999999, 2024-04-19T03:02:53.966 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:53.966 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:53.966 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:53.966 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.967 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:53.967 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018167+0000", 2024-04-19T03:02:53.967 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:53.967 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.967 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.967 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:53.967 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018167+0000", 2024-04-19T03:02:53.967 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:53.967 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.967 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.967 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:53.967 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018167+0000", 2024-04-19T03:02:53.967 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:53.968 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.968 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.968 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:53.968 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018196+0000", 2024-04-19T03:02:53.968 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9538000000000001e-05 2024-04-19T03:02:53.968 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.968 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.968 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:53.968 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018204+0000", 2024-04-19T03:02:53.968 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2599999999999999e-06 2024-04-19T03:02:53.968 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.968 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.968 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:53.968 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018208+0000", 2024-04-19T03:02:53.969 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8080000000000004e-06 2024-04-19T03:02:53.969 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.969 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.969 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:53.969 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.064933+0000", 2024-04-19T03:02:53.969 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.046725048999999998 2024-04-19T03:02:53.969 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.969 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.969 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:53.969 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.064964+0000", 2024-04-19T03:02:53.969 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0577000000000002e-05 2024-04-19T03:02:53.969 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.969 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.969 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:53.970 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.070815+0000", 2024-04-19T03:02:53.970 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0058510649999999999 2024-04-19T03:02:53.970 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.970 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.970 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:53.970 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.070936+0000", 2024-04-19T03:02:53.970 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00012095399999999999 2024-04-19T03:02:53.970 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:53.970 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:53.970 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:53.970 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.970 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.970 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:86612 5.7 5:e32e3c49:::benchmark_data_smithi096_19531_object86611:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:53.971 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:22.633560+0000", 2024-04-19T03:02:53.971 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 31.294294973, 2024-04-19T03:02:53.971 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.19135289, 2024-04-19T03:02:53.971 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:53.971 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:53.971 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:53.971 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:53.971 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:53.971 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 86612 2024-04-19T03:02:53.971 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.971 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:53.971 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.971 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:53.971 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633560+0000", 2024-04-19T03:02:53.972 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:53.972 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.972 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.972 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:53.972 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633560+0000", 2024-04-19T03:02:53.972 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:53.972 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.972 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.972 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:53.972 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633558+0000", 2024-04-19T03:02:53.972 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:53.972 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.972 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.972 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:53.973 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633609+0000", 2024-04-19T03:02:53.973 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0850999999999998e-05 2024-04-19T03:02:53.973 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.973 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.973 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:53.973 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633627+0000", 2024-04-19T03:02:53.973 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7951000000000001e-05 2024-04-19T03:02:53.973 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.973 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.973 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:53.973 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633635+0000", 2024-04-19T03:02:53.973 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2530000000000004e-06 2024-04-19T03:02:53.973 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.973 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.974 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:53.974 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633699+0000", 2024-04-19T03:02:53.974 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3901999999999999e-05 2024-04-19T03:02:53.974 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.974 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.974 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:53.974 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633992+0000", 2024-04-19T03:02:53.974 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00029283299999999999 2024-04-19T03:02:53.974 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.974 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.974 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:53.974 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.634223+0000", 2024-04-19T03:02:53.974 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00023084200000000001 2024-04-19T03:02:53.975 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.975 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.975 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:53.975 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.639085+0000", 2024-04-19T03:02:53.975 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0048624269999999999 2024-04-19T03:02:53.975 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.975 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.975 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:53.975 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.824635+0000", 2024-04-19T03:02:53.975 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.18554944700000001 2024-04-19T03:02:53.975 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.975 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.975 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:53.975 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.824793+0000", 2024-04-19T03:02:53.976 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000157959 2024-04-19T03:02:53.976 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.976 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.976 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:53.976 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.824913+0000", 2024-04-19T03:02:53.976 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000120093 2024-04-19T03:02:53.976 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:53.976 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:53.976 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:53.976 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.976 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.976 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:86625 5.7 5:e6d00488:::benchmark_data_smithi096_19531_object86624:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:53.976 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:22.643554+0000", 2024-04-19T03:02:53.976 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 31.284301206999999, 2024-04-19T03:02:53.977 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.18732841, 2024-04-19T03:02:53.977 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:53.977 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:53.977 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:53.977 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:53.977 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:53.977 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 86625 2024-04-19T03:02:53.977 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.977 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:53.977 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.977 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:53.977 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643554+0000", 2024-04-19T03:02:53.977 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:53.978 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.978 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.978 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:53.978 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643554+0000", 2024-04-19T03:02:53.978 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:53.978 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.978 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.978 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:53.978 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643552+0000", 2024-04-19T03:02:53.978 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:53.978 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.978 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.979 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:53.979 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643588+0000", 2024-04-19T03:02:53.979 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5855999999999997e-05 2024-04-19T03:02:53.979 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.979 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.979 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:53.979 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643606+0000", 2024-04-19T03:02:53.979 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8226000000000001e-05 2024-04-19T03:02:53.979 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.979 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.979 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:53.979 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643618+0000", 2024-04-19T03:02:53.979 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1868000000000001e-05 2024-04-19T03:02:53.980 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.980 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.980 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:53.980 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643676+0000", 2024-04-19T03:02:53.980 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8153999999999999e-05 2024-04-19T03:02:53.980 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.980 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.980 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:53.980 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643905+0000", 2024-04-19T03:02:53.980 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00022847500000000001 2024-04-19T03:02:53.980 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.980 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.980 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:53.980 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.644150+0000", 2024-04-19T03:02:53.981 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00024531800000000001 2024-04-19T03:02:53.981 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.981 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.981 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:53.981 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.647407+0000", 2024-04-19T03:02:53.981 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0032563190000000001 2024-04-19T03:02:53.981 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.981 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.981 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:53.981 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.830721+0000", 2024-04-19T03:02:53.981 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.18331468300000001 2024-04-19T03:02:53.981 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.981 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.982 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:53.982 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.830813+0000", 2024-04-19T03:02:53.982 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.2205000000000002e-05 2024-04-19T03:02:53.982 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.982 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.982 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:53.982 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.830882+0000", 2024-04-19T03:02:53.982 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8819999999999995e-05 2024-04-19T03:02:53.982 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:53.982 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:53.982 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:53.982 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.982 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.983 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87063 5.7 5:e502e824:::benchmark_data_smithi096_19531_object87062:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:53.983 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.136067+0000", 2024-04-19T03:02:53.983 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 30.791788338, 2024-04-19T03:02:53.983 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.065521159999999995, 2024-04-19T03:02:53.983 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:53.983 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:53.983 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:53.983 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:53.983 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:53.983 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87063 2024-04-19T03:02:53.983 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.983 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:53.983 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.983 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:53.984 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.136067+0000", 2024-04-19T03:02:53.984 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:53.984 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.984 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.984 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:53.984 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.136067+0000", 2024-04-19T03:02:53.984 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:53.984 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.984 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.984 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:53.984 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.136066+0000", 2024-04-19T03:02:53.984 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:53.984 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.984 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.984 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:53.985 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.136154+0000", 2024-04-19T03:02:53.985 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.8256000000000003e-05 2024-04-19T03:02:53.985 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.985 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.985 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:53.985 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.136162+0000", 2024-04-19T03:02:53.985 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.5099999999999998e-06 2024-04-19T03:02:53.985 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.985 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.985 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:53.985 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.136171+0000", 2024-04-19T03:02:53.985 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2830000000000001e-06 2024-04-19T03:02:53.985 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.985 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.985 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:53.986 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.138421+0000", 2024-04-19T03:02:53.986 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0022506620000000001 2024-04-19T03:02:53.986 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.986 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.986 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:53.986 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.138560+0000", 2024-04-19T03:02:53.986 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000138446 2024-04-19T03:02:53.986 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.986 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.986 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:53.986 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.138689+0000", 2024-04-19T03:02:53.986 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00012950700000000001 2024-04-19T03:02:53.986 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.987 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.987 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:53.987 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.141517+0000", 2024-04-19T03:02:53.987 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0028280860000000001 2024-04-19T03:02:53.987 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.987 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.987 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:53.987 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.201350+0000", 2024-04-19T03:02:53.987 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.059832418999999998 2024-04-19T03:02:53.987 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.987 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.987 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:53.987 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.201485+0000", 2024-04-19T03:02:53.987 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000135597 2024-04-19T03:02:53.987 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.988 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.988 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:53.988 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.201588+0000", 2024-04-19T03:02:53.988 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00010247900000000001 2024-04-19T03:02:53.988 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:53.988 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:53.988 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:53.988 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.988 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.988 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87072 5.7 5:e3c7809a:::benchmark_data_smithi096_19531_object87071:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:53.988 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.144224+0000", 2024-04-19T03:02:53.988 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 30.783631314000001, 2024-04-19T03:02:53.988 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.058179555000000001, 2024-04-19T03:02:53.988 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:53.989 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:53.989 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:53.989 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:53.989 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:53.989 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87072 2024-04-19T03:02:53.989 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.989 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:53.989 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.989 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:53.989 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144224+0000", 2024-04-19T03:02:53.989 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:53.989 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.989 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.989 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:53.990 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144224+0000", 2024-04-19T03:02:53.990 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:53.990 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.990 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.990 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:53.990 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144223+0000", 2024-04-19T03:02:53.990 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:53.990 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.990 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.990 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:53.990 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144320+0000", 2024-04-19T03:02:53.990 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.7075000000000001e-05 2024-04-19T03:02:53.991 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.991 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.991 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:53.991 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144331+0000", 2024-04-19T03:02:53.991 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1342000000000001e-05 2024-04-19T03:02:53.991 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.991 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.991 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:53.991 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144337+0000", 2024-04-19T03:02:53.991 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8390000000000003e-06 2024-04-19T03:02:53.991 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.991 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.991 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:53.991 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144369+0000", 2024-04-19T03:02:53.992 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2079000000000002e-05 2024-04-19T03:02:53.992 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.992 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.992 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:53.992 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144464+0000", 2024-04-19T03:02:53.992 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.4623000000000005e-05 2024-04-19T03:02:53.992 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.992 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.992 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:53.992 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144553+0000", 2024-04-19T03:02:53.992 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9171000000000004e-05 2024-04-19T03:02:53.992 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.992 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.992 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:53.993 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.147018+0000", 2024-04-19T03:02:53.993 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0024648370000000001 2024-04-19T03:02:53.993 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.993 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.993 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:53.993 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.202270+0000", 2024-04-19T03:02:53.993 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.055252018 2024-04-19T03:02:53.993 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.993 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.993 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:53.993 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.202356+0000", 2024-04-19T03:02:53.993 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6648000000000001e-05 2024-04-19T03:02:53.993 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.994 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.994 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:53.994 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.202403+0000", 2024-04-19T03:02:53.994 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6956999999999998e-05 2024-04-19T03:02:53.994 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:53.994 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:53.994 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:53.994 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.994 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.994 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87123 5.6 5:6d1bc3b9:::benchmark_data_smithi096_19531_object87122:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:02:53.994 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249233+0000", 2024-04-19T03:02:53.994 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 30.678622281999999, 2024-04-19T03:02:53.994 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0291700720000001, 2024-04-19T03:02:53.994 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:53.995 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-04-19T03:02:53.995 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:53.995 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:53.995 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:53.995 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87123 2024-04-19T03:02:53.995 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.995 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:53.995 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.995 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:53.995 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249233+0000", 2024-04-19T03:02:53.995 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:53.995 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.995 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.995 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:53.996 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249233+0000", 2024-04-19T03:02:53.996 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:53.996 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.996 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.996 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:53.996 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249231+0000", 2024-04-19T03:02:53.996 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:53.996 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.996 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.996 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:53.996 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249285+0000", 2024-04-19T03:02:53.996 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4005000000000002e-05 2024-04-19T03:02:53.996 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.997 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.997 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:53.997 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249300+0000", 2024-04-19T03:02:53.997 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4715999999999999e-05 2024-04-19T03:02:53.997 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.997 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.997 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:53.997 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249307+0000", 2024-04-19T03:02:53.997 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8399999999999997e-06 2024-04-19T03:02:53.997 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.997 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.997 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:53.997 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249366+0000", 2024-04-19T03:02:53.997 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9435999999999998e-05 2024-04-19T03:02:53.997 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.998 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.998 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op must wait for map", 2024-04-19T03:02:53.998 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249376+0000", 2024-04-19T03:02:53.998 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.4919999999999999e-06 2024-04-19T03:02:53.998 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.998 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.998 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:53.998 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263757+0000", 2024-04-19T03:02:53.998 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.014381461999999999 2024-04-19T03:02:53.998 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.998 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.998 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:02:53.998 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263875+0000", 2024-04-19T03:02:53.999 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000117166 2024-04-19T03:02:53.999 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.999 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.999 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:53.999 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.277136+0000", 2024-04-19T03:02:53.999 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.013261207 2024-04-19T03:02:53.999 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:53.999 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:53.999 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:53.999 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.278403+0000", 2024-04-19T03:02:53.999 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001267106 2024-04-19T03:02:53.999 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:53.999 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:53.999 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:54.000 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:54.000 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:54.000 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87128 5.6 5:6905c420:::benchmark_data_smithi096_19531_object87127:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:02:54.000 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249323+0000", 2024-04-19T03:02:54.000 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 30.678531535000001, 2024-04-19T03:02:54.000 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0292813249999999, 2024-04-19T03:02:54.000 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:54.000 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-04-19T03:02:54.000 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:54.000 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:54.000 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:54.000 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87128 2024-04-19T03:02:54.000 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:54.000 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:54.001 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:54.001 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:54.001 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249323+0000", 2024-04-19T03:02:54.001 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:54.001 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:54.001 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:54.001 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:54.001 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249323+0000", 2024-04-19T03:02:54.001 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:54.001 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:54.001 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:54.001 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:54.001 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249323+0000", 2024-04-19T03:02:54.001 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:54.002 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:54.002 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:54.002 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:54.002 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249385+0000", 2024-04-19T03:02:54.002 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1711999999999995e-05 2024-04-19T03:02:54.002 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:54.002 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:54.002 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:54.002 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249398+0000", 2024-04-19T03:02:54.002 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3022e-05 2024-04-19T03:02:54.002 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:54.002 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:54.003 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:54.003 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249402+0000", 2024-04-19T03:02:54.003 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4819999999999996e-06 2024-04-19T03:02:54.003 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:54.003 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:54.003 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:54.003 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249437+0000", 2024-04-19T03:02:54.003 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4702000000000001e-05 2024-04-19T03:02:54.003 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:54.003 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:54.003 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:02:54.003 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249442+0000", 2024-04-19T03:02:54.003 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8019999999999999e-06 2024-04-19T03:02:54.003 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:54.004 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:54.004 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:54.004 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263896+0000", 2024-04-19T03:02:54.004 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.014454679999999999 2024-04-19T03:02:54.004 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:54.004 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:54.004 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:02:54.004 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263900+0000", 2024-04-19T03:02:54.004 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9700000000000001e-06 2024-04-19T03:02:54.004 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:54.004 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:54.004 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:54.004 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.278557+0000", 2024-04-19T03:02:54.005 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0146566480000001 2024-04-19T03:02:54.005 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:54.005 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:54.005 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:54.005 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.278605+0000", 2024-04-19T03:02:54.005 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7735999999999998e-05 2024-04-19T03:02:54.005 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:54.005 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:54.005 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:54.005 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:54.005 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:54.005 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87130 5.3 5:c8c2d67b:::benchmark_data_smithi096_19531_object87129:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:02:54.005 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249418+0000", 2024-04-19T03:02:54.005 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 30.678436823999998, 2024-04-19T03:02:54.006 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.025414182, 2024-04-19T03:02:54.006 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:54.006 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-04-19T03:02:54.006 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:54.006 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:54.006 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:54.006 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87130 2024-04-19T03:02:54.006 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:54.006 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:54.006 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:54.006 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:54.006 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249418+0000", 2024-04-19T03:02:54.006 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:54.007 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:54.007 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:54.007 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:54.007 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249418+0000", 2024-04-19T03:02:54.007 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:54.007 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:54.007 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:54.007 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:54.007 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249409+0000", 2024-04-19T03:02:54.007 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999905 2024-04-19T03:02:54.007 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:54.007 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:54.007 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:54.007 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249464+0000", 2024-04-19T03:02:54.008 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5381999999999999e-05 2024-04-19T03:02:54.008 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:54.008 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:54.008 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:54.008 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249471+0000", 2024-04-19T03:02:54.008 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2609999999999996e-06 2024-04-19T03:02:54.008 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:54.008 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:54.008 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:54.008 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249475+0000", 2024-04-19T03:02:54.008 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2839999999999998e-06 2024-04-19T03:02:54.008 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:54.008 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:54.009 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:54.009 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249535+0000", 2024-04-19T03:02:54.009 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0545999999999999e-05 2024-04-19T03:02:54.009 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:54.009 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:54.009 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op must wait for map", 2024-04-19T03:02:54.009 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249540+0000", 2024-04-19T03:02:54.009 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2859999999999999e-06 2024-04-19T03:02:54.009 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:54.009 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:54.009 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:54.009 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263450+0000", 2024-04-19T03:02:54.009 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.013909585 2024-04-19T03:02:54.009 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:54.010 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:54.010 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:02:54.010 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263458+0000", 2024-04-19T03:02:54.010 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8089999999999993e-06 2024-04-19T03:02:54.010 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:54.010 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:54.010 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:54.010 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.273193+0000", 2024-04-19T03:02:54.010 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0097351379999999 2024-04-19T03:02:54.010 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:54.010 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:54.010 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:54.010 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.274832+0000", 2024-04-19T03:02:54.011 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0016394789999999999 2024-04-19T03:02:54.011 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:54.011 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:54.011 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:54.011 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:54.011 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:54.011 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87131 5.1 5:83756d55:::benchmark_data_smithi096_19531_object87130:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:02:54.011 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249491+0000", 2024-04-19T03:02:54.011 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 30.678364176999999, 2024-04-19T03:02:54.011 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0191489520000001, 2024-04-19T03:02:54.011 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:54.011 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-04-19T03:02:54.011 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:54.011 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:54.011 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:54.012 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87131 2024-04-19T03:02:54.012 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:54.012 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:54.012 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:54.012 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:54.012 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249491+0000", 2024-04-19T03:02:54.012 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:54.012 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:54.012 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:54.012 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:54.012 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249491+0000", 2024-04-19T03:02:54.012 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:54.012 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:54.012 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:54.013 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:54.013 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249491+0000", 2024-04-19T03:02:54.013 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:54.013 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:54.013 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:54.013 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:54.013 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249530+0000", 2024-04-19T03:02:54.013 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9589000000000003e-05 2024-04-19T03:02:54.013 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:54.013 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:54.013 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:54.013 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249544+0000", 2024-04-19T03:02:54.013 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4158000000000001e-05 2024-04-19T03:02:54.014 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:54.014 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:54.014 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:54.014 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249549+0000", 2024-04-19T03:02:54.014 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6809999999999997e-06 2024-04-19T03:02:54.014 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:54.014 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:54.014 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:54.014 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249592+0000", 2024-04-19T03:02:54.014 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3285999999999999e-05 2024-04-19T03:02:54.014 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:54.014 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:54.014 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op must wait for map", 2024-04-19T03:02:54.014 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249598+0000", 2024-04-19T03:02:54.014 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8329999999999999e-06 2024-04-19T03:02:54.015 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:54.015 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:54.015 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:54.015 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263331+0000", 2024-04-19T03:02:54.015 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.013733093 2024-04-19T03:02:54.015 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:54.015 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:54.015 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:02:54.015 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263343+0000", 2024-04-19T03:02:54.015 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.189e-05 2024-04-19T03:02:54.015 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:54.015 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:54.015 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:54.016 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.268541+0000", 2024-04-19T03:02:54.016 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0051983440000001 2024-04-19T03:02:54.016 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:54.016 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:54.016 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:54.016 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.268640+0000", 2024-04-19T03:02:54.016 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.8387999999999994e-05 2024-04-19T03:02:54.016 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:54.016 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:54.016 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:54.016 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:54.016 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:54.016 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87132 5.c 5:3e18b732:::benchmark_data_smithi096_19531_object87131:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:02:54.016 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249558+0000", 2024-04-19T03:02:54.017 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 30.678297275999999, 2024-04-19T03:02:54.017 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0241198380000001, 2024-04-19T03:02:54.017 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:54.017 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-04-19T03:02:54.017 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:54.017 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:54.017 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:54.017 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87132 2024-04-19T03:02:54.017 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:54.017 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:54.017 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:54.017 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:54.017 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249558+0000", 2024-04-19T03:02:54.017 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:54.018 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:54.018 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:54.018 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:54.018 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249558+0000", 2024-04-19T03:02:54.018 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:54.018 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:54.018 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:54.018 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:54.018 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249557+0000", 2024-04-19T03:02:54.018 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:54.018 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:54.018 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:54.018 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:54.019 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249625+0000", 2024-04-19T03:02:54.019 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7200999999999996e-05 2024-04-19T03:02:54.019 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:54.019 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:54.019 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:54.019 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249646+0000", 2024-04-19T03:02:54.019 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1053e-05 2024-04-19T03:02:54.019 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:54.019 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:54.019 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:54.019 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249650+0000", 2024-04-19T03:02:54.019 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2719999999999999e-06 2024-04-19T03:02:54.019 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:54.021 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:54.021 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:54.021 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249686+0000", 2024-04-19T03:02:54.021 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6430000000000002e-05 2024-04-19T03:02:54.021 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:54.021 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:54.021 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op must wait for map", 2024-04-19T03:02:54.021 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249690+0000", 2024-04-19T03:02:54.022 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.765e-06 2024-04-19T03:02:54.022 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:54.022 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:54.022 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:54.022 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261157+0000", 2024-04-19T03:02:54.022 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011467247999999999 2024-04-19T03:02:54.022 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:54.022 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:54.022 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:02:54.022 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261170+0000", 2024-04-19T03:02:54.022 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2833000000000001e-05 2024-04-19T03:02:54.022 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:54.022 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:54.023 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:54.023 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.272119+0000", 2024-04-19T03:02:54.023 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.010949313 2024-04-19T03:02:54.023 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:54.023 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:54.023 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:54.023 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.273678+0000", 2024-04-19T03:02:54.023 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0015581550000000001 2024-04-19T03:02:54.023 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:54.023 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:54.023 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:54.023 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:54.023 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:54.024 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87133 5.c 5:3f772a62:::benchmark_data_smithi096_19531_object87132:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:02:54.024 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249657+0000", 2024-04-19T03:02:54.024 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 30.678197897, 2024-04-19T03:02:54.024 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0242819409999999, 2024-04-19T03:02:54.024 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:54.024 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-04-19T03:02:54.024 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:54.024 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:54.024 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:54.024 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87133 2024-04-19T03:02:54.024 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:54.024 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:54.024 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:54.024 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:54.024 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249657+0000", 2024-04-19T03:02:54.025 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:54.025 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:54.025 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:54.025 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:54.025 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249657+0000", 2024-04-19T03:02:54.025 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:54.025 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:54.025 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:54.025 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:54.025 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249657+0000", 2024-04-19T03:02:54.025 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:54.025 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:54.025 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:54.026 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:54.026 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249690+0000", 2024-04-19T03:02:54.026 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3343000000000002e-05 2024-04-19T03:02:54.026 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:54.026 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:54.026 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:54.026 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249695+0000", 2024-04-19T03:02:54.026 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8600000000000001e-06 2024-04-19T03:02:54.026 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:54.026 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:54.026 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:54.026 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249698+0000", 2024-04-19T03:02:54.026 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.1700000000000001e-06 2024-04-19T03:02:54.027 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:54.027 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:54.027 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:54.027 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249741+0000", 2024-04-19T03:02:54.027 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2849999999999998e-05 2024-04-19T03:02:54.027 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:54.027 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:54.027 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:02:54.027 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249746+0000", 2024-04-19T03:02:54.027 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1019999999999996e-06 2024-04-19T03:02:54.027 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:54.027 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:54.027 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:54.027 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261209+0000", 2024-04-19T03:02:54.028 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011462447000000001 2024-04-19T03:02:54.028 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:54.028 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:54.028 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:02:54.028 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261216+0000", 2024-04-19T03:02:54.028 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8520000000000004e-06 2024-04-19T03:02:54.028 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:54.028 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:54.028 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:54.028 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.273872+0000", 2024-04-19T03:02:54.028 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0126558000000001 2024-04-19T03:02:54.028 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:54.028 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:54.028 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:54.028 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.273939+0000", 2024-04-19T03:02:54.029 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6822000000000005e-05 2024-04-19T03:02:54.029 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:54.029 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:54.029 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:54.029 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:54.029 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:54.029 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87134 5.5 5:a56c478f:::benchmark_data_smithi096_19531_object87133:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:02:54.029 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249708+0000", 2024-04-19T03:02:54.029 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 30.678146973, 2024-04-19T03:02:54.029 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0214677299999999, 2024-04-19T03:02:54.029 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:54.029 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-04-19T03:02:54.029 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:54.029 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:54.030 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:54.030 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87134 2024-04-19T03:02:54.030 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:54.030 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:54.030 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:54.030 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:54.030 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249708+0000", 2024-04-19T03:02:54.030 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:54.030 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:54.030 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:54.030 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:54.030 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249708+0000", 2024-04-19T03:02:54.030 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:54.031 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:54.031 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:54.031 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:54.031 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249706+0000", 2024-04-19T03:02:54.031 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999976 2024-04-19T03:02:54.031 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:54.031 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:54.031 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:54.031 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249740+0000", 2024-04-19T03:02:54.031 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4458000000000001e-05 2024-04-19T03:02:54.031 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:54.031 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:54.031 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:54.031 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249745+0000", 2024-04-19T03:02:54.032 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5020000000000003e-06 2024-04-19T03:02:54.032 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:54.032 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:54.032 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:54.032 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249748+0000", 2024-04-19T03:02:54.032 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2499999999999998e-06 2024-04-19T03:02:54.032 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:54.032 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:54.032 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:54.032 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249778+0000", 2024-04-19T03:02:54.032 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.006e-05 2024-04-19T03:02:54.032 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:54.032 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:54.032 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op must wait for map", 2024-04-19T03:02:54.033 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249782+0000", 2024-04-19T03:02:54.033 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2910000000000001e-06 2024-04-19T03:02:54.033 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:54.033 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:54.033 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:54.033 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261666+0000", 2024-04-19T03:02:54.033 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011883471 2024-04-19T03:02:54.033 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:54.033 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:54.033 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:02:54.033 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261674+0000", 2024-04-19T03:02:54.033 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6479999999999992e-06 2024-04-19T03:02:54.033 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:54.033 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:54.034 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:54.034 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.269323+0000", 2024-04-19T03:02:54.034 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.00764867 2024-04-19T03:02:54.034 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:54.034 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:54.034 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:54.034 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.271176+0000", 2024-04-19T03:02:54.034 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001852844 2024-04-19T03:02:54.034 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:54.034 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:54.034 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:54.034 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:54.034 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:54.035 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87137 5.c 5:30708c68:::benchmark_data_smithi096_19531_object87136:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:02:54.035 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249756+0000", 2024-04-19T03:02:54.035 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 30.678099267, 2024-04-19T03:02:54.035 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.033331752, 2024-04-19T03:02:54.035 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:54.035 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:54.035 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:54.035 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:54.035 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:54.035 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87137 2024-04-19T03:02:54.035 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:54.035 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:54.035 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:54.035 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:54.035 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249756+0000", 2024-04-19T03:02:54.036 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:54.036 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:54.036 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:54.036 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:54.036 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249756+0000", 2024-04-19T03:02:54.036 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:54.036 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:54.036 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:54.036 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:54.036 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249755+0000", 2024-04-19T03:02:54.036 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:54.036 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:54.036 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:54.036 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:54.037 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249777+0000", 2024-04-19T03:02:54.037 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1420000000000002e-05 2024-04-19T03:02:54.037 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:54.037 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:54.037 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:54.037 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249781+0000", 2024-04-19T03:02:54.037 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0609999999999997e-06 2024-04-19T03:02:54.037 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:54.037 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:54.037 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:54.037 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249787+0000", 2024-04-19T03:02:54.037 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.02e-06 2024-04-19T03:02:54.037 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:54.037 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:54.038 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:54.038 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249818+0000", 2024-04-19T03:02:54.038 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0947e-05 2024-04-19T03:02:54.038 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:54.038 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:54.038 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:02:54.038 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249821+0000", 2024-04-19T03:02:54.038 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.117e-06 2024-04-19T03:02:54.038 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:54.038 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:54.038 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:54.038 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261243+0000", 2024-04-19T03:02:54.038 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011421875999999999 2024-04-19T03:02:54.038 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:54.039 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:54.039 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:02:54.039 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261251+0000", 2024-04-19T03:02:54.039 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6120000000000001e-06 2024-04-19T03:02:54.039 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:54.039 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:54.039 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:54.039 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.274050+0000", 2024-04-19T03:02:54.039 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.012799405 2024-04-19T03:02:54.039 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:54.039 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:54.039 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:54.039 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.274529+0000", 2024-04-19T03:02:54.039 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00047867100000000001 2024-04-19T03:02:54.040 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:54.040 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:54.040 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:54.040 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.282972+0000", 2024-04-19T03:02:54.040 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0084436900000000002 2024-04-19T03:02:54.040 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:54.040 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:54.040 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:54.040 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.283022+0000", 2024-04-19T03:02:54.040 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9339000000000003e-05 2024-04-19T03:02:54.040 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:54.040 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:54.040 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:54.040 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.283088+0000", 2024-04-19T03:02:54.040 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5877999999999995e-05 2024-04-19T03:02:54.041 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:54.041 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:54.041 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:54.041 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:54.041 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:54.041 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-04-19T03:02:54.042 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T03:02:54.043 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:54.039+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:54.143 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:54.139+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:54.166 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-19T03:02:54.166 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-04-19T03:02:54.166 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.166 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4755.0:148432 5.f e54/22 5:fad19669:::benchmark_data_smithi096_19531_object34982:head v 54'9207, mlcod=54'9204)", 2024-04-19T03:02:54.166 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:54.164170+0000", 2024-04-19T03:02:54.166 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0015891099999999999, 2024-04-19T03:02:54.166 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0016133110000000001, 2024-04-19T03:02:54.166 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:54.166 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-19T03:02:54.166 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:54.167 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.167 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:54.167 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:54.164170+0000", 2024-04-19T03:02:54.167 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:54.167 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.167 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.167 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:54.167 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:54.164170+0000", 2024-04-19T03:02:54.167 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:54.167 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.167 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.167 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:54.167 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:54.164170+0000", 2024-04-19T03:02:54.167 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:54.168 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.168 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.168 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:54.168 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:54.164175+0000", 2024-04-19T03:02:54.168 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2769999999999996e-06 2024-04-19T03:02:54.168 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.168 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.168 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:54.168 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:54.164182+0000", 2024-04-19T03:02:54.168 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6710000000000002e-06 2024-04-19T03:02:54.168 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.168 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.168 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:54.168 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:54.164187+0000", 2024-04-19T03:02:54.169 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.651e-06 2024-04-19T03:02:54.169 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.169 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.169 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:54.169 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:54.164221+0000", 2024-04-19T03:02:54.169 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3958000000000003e-05 2024-04-19T03:02:54.169 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.169 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.169 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:54.169 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:54.164232+0000", 2024-04-19T03:02:54.169 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1841999999999999e-05 2024-04-19T03:02:54.169 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:54.169 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:54.169 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:54.170 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.170 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.170 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:148438 5.8 5:13bc9131:::benchmark_data_smithi096_19531_object34988:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-19T03:02:54.170 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:54.164767+0000", 2024-04-19T03:02:54.170 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.00099250100000000002, 2024-04-19T03:02:54.170 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0010912680000000001, 2024-04-19T03:02:54.170 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:54.170 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-19T03:02:54.170 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:54.170 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:54.170 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:54.170 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 148438 2024-04-19T03:02:54.170 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.171 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:54.171 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.171 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:54.171 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:54.164767+0000", 2024-04-19T03:02:54.171 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:54.171 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.171 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.171 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:54.171 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:54.164767+0000", 2024-04-19T03:02:54.171 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:54.171 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.171 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.171 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:54.171 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:54.164766+0000", 2024-04-19T03:02:54.172 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:54.172 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.172 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.172 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:54.172 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:54.164770+0000", 2024-04-19T03:02:54.172 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9890000000000003e-06 2024-04-19T03:02:54.172 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.172 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.172 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:54.172 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:54.164791+0000", 2024-04-19T03:02:54.172 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0307000000000001e-05 2024-04-19T03:02:54.172 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.172 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.172 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:54.173 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:54.164798+0000", 2024-04-19T03:02:54.173 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.8699999999999992e-06 2024-04-19T03:02:54.173 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.173 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.173 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:54.173 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:54.165284+0000", 2024-04-19T03:02:54.173 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00048526899999999998 2024-04-19T03:02:54.173 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.173 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.173 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:54.173 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:54.165544+0000", 2024-04-19T03:02:54.173 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00025982499999999999 2024-04-19T03:02:54.173 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:54.173 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:54.174 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:54.174 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.174 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.174 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:148439 5.4 5:232610a6:::benchmark_data_smithi096_19531_object34989:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-19T03:02:54.174 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:54.165610+0000", 2024-04-19T03:02:54.174 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.000149901, 2024-04-19T03:02:54.174 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00032357600000000001, 2024-04-19T03:02:54.174 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:54.174 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-19T03:02:54.174 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:54.174 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:54.174 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:54.174 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 148439 2024-04-19T03:02:54.174 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.175 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:54.175 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.175 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:54.175 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:54.165610+0000", 2024-04-19T03:02:54.175 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:54.175 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.175 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.175 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:54.175 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:54.165610+0000", 2024-04-19T03:02:54.175 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:54.175 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.175 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.175 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:54.175 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:54.165609+0000", 2024-04-19T03:02:54.175 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:54.176 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.176 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.176 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:54.176 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:54.165615+0000", 2024-04-19T03:02:54.176 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0270000000000001e-06 2024-04-19T03:02:54.176 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.176 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.176 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:54.176 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:54.165625+0000", 2024-04-19T03:02:54.176 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0662000000000001e-05 2024-04-19T03:02:54.176 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.176 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.176 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:54.176 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:54.165634+0000", 2024-04-19T03:02:54.177 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.7339999999999997e-06 2024-04-19T03:02:54.177 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.177 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.177 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:54.177 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:54.165723+0000", 2024-04-19T03:02:54.177 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.8473999999999994e-05 2024-04-19T03:02:54.177 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.177 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.177 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:54.177 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:54.165880+0000", 2024-04-19T03:02:54.177 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000156875 2024-04-19T03:02:54.177 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:54.177 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:54.177 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:54.177 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.178 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.178 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4755.0:148426 5.d e54/49 5:bd810781:::benchmark_data_smithi096_19531_object34976:head v 54'9413, mlcod=54'9410)", 2024-04-19T03:02:54.178 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:54.161807+0000", 2024-04-19T03:02:54.178 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0039528599999999999, 2024-04-19T03:02:54.178 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0041968149999999996, 2024-04-19T03:02:54.178 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:54.178 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-19T03:02:54.178 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:54.178 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.178 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:54.178 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:54.161807+0000", 2024-04-19T03:02:54.178 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:54.178 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.179 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.179 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:54.179 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:54.161807+0000", 2024-04-19T03:02:54.179 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:54.179 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.179 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.179 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:54.179 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:54.161806+0000", 2024-04-19T03:02:54.179 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:54.179 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.180 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.180 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:54.180 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:54.161812+0000", 2024-04-19T03:02:54.180 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2349999999999996e-06 2024-04-19T03:02:54.180 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.180 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.180 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:54.180 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:54.161822+0000", 2024-04-19T03:02:54.180 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.9029999999999999e-06 2024-04-19T03:02:54.180 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.180 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.180 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:54.180 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:54.161829+0000", 2024-04-19T03:02:54.180 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6610000000000003e-06 2024-04-19T03:02:54.181 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.181 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.181 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:54.181 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:54.161873+0000", 2024-04-19T03:02:54.181 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3925999999999999e-05 2024-04-19T03:02:54.181 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.181 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.181 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:54.181 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:54.161891+0000", 2024-04-19T03:02:54.181 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8182e-05 2024-04-19T03:02:54.181 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:54.181 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:54.181 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:54.182 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.182 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.182 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:148436 5.8 5:1cbf4a84:::benchmark_data_smithi096_19531_object34986:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-19T03:02:54.182 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:54.162546+0000", 2024-04-19T03:02:54.182 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.003213755, 2024-04-19T03:02:54.182 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.003525411, 2024-04-19T03:02:54.182 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:54.182 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-19T03:02:54.182 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:54.182 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:54.182 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:54.182 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 148436 2024-04-19T03:02:54.182 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.183 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:54.183 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.183 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:54.183 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:54.162546+0000", 2024-04-19T03:02:54.183 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:54.183 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.183 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.183 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:54.183 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:54.162546+0000", 2024-04-19T03:02:54.183 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:54.183 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.183 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.183 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:54.183 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:54.162545+0000", 2024-04-19T03:02:54.183 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:54.184 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.184 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.184 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:54.184 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:54.162552+0000", 2024-04-19T03:02:54.184 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.272e-06 2024-04-19T03:02:54.184 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.184 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.184 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:54.184 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:54.162580+0000", 2024-04-19T03:02:54.184 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8048e-05 2024-04-19T03:02:54.184 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.184 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.184 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:54.185 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:54.162587+0000", 2024-04-19T03:02:54.185 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3309999999999998e-06 2024-04-19T03:02:54.185 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.185 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.185 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:54.185 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:54.162641+0000", 2024-04-19T03:02:54.185 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4218999999999997e-05 2024-04-19T03:02:54.185 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.185 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.185 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:54.185 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:54.162799+0000", 2024-04-19T03:02:54.185 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015721600000000001 2024-04-19T03:02:54.185 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:54.185 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:54.186 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:54.186 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.186 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.186 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4755.0:148429 5.d e54/49)", 2024-04-19T03:02:54.186 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:54.163215+0000", 2024-04-19T03:02:54.186 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0025449829999999998, 2024-04-19T03:02:54.186 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.002921566, 2024-04-19T03:02:54.186 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:54.186 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-04-19T03:02:54.186 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:54.186 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.186 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:54.186 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:54.163215+0000", 2024-04-19T03:02:54.186 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:54.187 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.187 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.187 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:54.187 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:54.163215+0000", 2024-04-19T03:02:54.187 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:54.187 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.187 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.187 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:54.187 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:54.163214+0000", 2024-04-19T03:02:54.187 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:54.187 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.187 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.187 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:54.188 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:54.163219+0000", 2024-04-19T03:02:54.188 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5260000000000004e-06 2024-04-19T03:02:54.188 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.188 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.188 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:54.188 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:54.163226+0000", 2024-04-19T03:02:54.188 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5050000000000001e-06 2024-04-19T03:02:54.188 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.188 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.188 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:54.188 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:54.163232+0000", 2024-04-19T03:02:54.188 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.665e-06 2024-04-19T03:02:54.188 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:54.188 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:54.188 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:54.189 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.189 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.189 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:148437 5.a 5:5c8b1844:::benchmark_data_smithi096_19531_object34987:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2024-04-19T03:02:54.189 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:54.164039+0000", 2024-04-19T03:02:54.189 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0017205160000000001, 2024-04-19T03:02:54.189 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0021514759999999998, 2024-04-19T03:02:54.189 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:54.189 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-19T03:02:54.189 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:54.189 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:54.189 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:54.189 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 148437 2024-04-19T03:02:54.189 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.189 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:54.190 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.190 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:54.190 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:54.164039+0000", 2024-04-19T03:02:54.190 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:54.190 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.190 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.190 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:54.190 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:54.164039+0000", 2024-04-19T03:02:54.190 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:54.190 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.190 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.190 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:54.190 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:54.164038+0000", 2024-04-19T03:02:54.191 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:54.191 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.191 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.191 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:54.191 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:54.164044+0000", 2024-04-19T03:02:54.191 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1970000000000001e-06 2024-04-19T03:02:54.191 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.191 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.191 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:54.191 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:54.164058+0000", 2024-04-19T03:02:54.191 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3645999999999999e-05 2024-04-19T03:02:54.191 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.191 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.191 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:54.191 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:54.164064+0000", 2024-04-19T03:02:54.192 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6620000000000002e-06 2024-04-19T03:02:54.192 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.192 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.192 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:54.192 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:54.164130+0000", 2024-04-19T03:02:54.192 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6530000000000002e-05 2024-04-19T03:02:54.192 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.192 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.192 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:54.192 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:54.164290+0000", 2024-04-19T03:02:54.192 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016001599999999999 2024-04-19T03:02:54.192 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:54.192 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:54.192 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:54.193 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:54.193 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-04-19T03:02:54.193 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 7 2024-04-19T03:02:54.193 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-19T03:02:54.194 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T03:02:54.244 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:54.243+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:54.324 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-19T03:02:54.324 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-04-19T03:02:54.324 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-04-19T03:02:54.324 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-04-19T03:02:54.324 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-19T03:02:54.338 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T03:02:54.380 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:54.379+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:54.446 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:54.443+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:54.503 INFO:teuthology.orchestra.run.smithi096.stderr:noscrub is unset 2024-04-19T03:02:54.510 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-19T03:02:54.511 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-04-19T03:02:54.511 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-04-19T03:02:54.511 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-04-19T03:02:54.511 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.511 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:79014 5.d 5:b5eee02c:::benchmark_data_smithi096_19531_object79013:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-19T03:02:54.511 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:18.032471+0000", 2024-04-19T03:02:54.511 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 36.473101859000003, 2024-04-19T03:02:54.511 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.041427629000000001, 2024-04-19T03:02:54.511 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:54.511 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:54.511 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:54.511 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:54.512 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:54.512 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 79014 2024-04-19T03:02:54.512 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.512 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:54.512 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.512 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:54.512 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:18.032471+0000", 2024-04-19T03:02:54.512 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:54.512 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.512 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.512 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:54.512 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:18.032471+0000", 2024-04-19T03:02:54.512 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:54.513 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.513 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.513 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:54.513 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:18.032470+0000", 2024-04-19T03:02:54.513 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:54.513 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.513 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.513 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:54.513 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:18.032525+0000", 2024-04-19T03:02:54.513 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5535999999999998e-05 2024-04-19T03:02:54.513 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.513 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.513 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:54.513 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:18.032537+0000", 2024-04-19T03:02:54.514 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1987999999999999e-05 2024-04-19T03:02:54.514 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.514 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.514 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:54.514 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:18.032546+0000", 2024-04-19T03:02:54.514 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9670000000000007e-06 2024-04-19T03:02:54.514 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.514 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.514 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:54.514 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:18.032613+0000", 2024-04-19T03:02:54.514 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6508999999999996e-05 2024-04-19T03:02:54.514 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.515 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.515 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:54.515 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:18.032738+0000", 2024-04-19T03:02:54.515 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000124912 2024-04-19T03:02:54.515 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.515 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.515 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 2", 2024-04-19T03:02:54.515 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:18.032867+0000", 2024-04-19T03:02:54.515 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012959399999999999 2024-04-19T03:02:54.515 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.515 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.515 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:54.515 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:18.035867+0000", 2024-04-19T03:02:54.515 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.002999378 2024-04-19T03:02:54.516 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.516 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.516 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:54.516 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:18.073705+0000", 2024-04-19T03:02:54.516 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.037838042000000002 2024-04-19T03:02:54.516 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.516 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.516 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:54.516 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:18.073813+0000", 2024-04-19T03:02:54.516 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010806099999999999 2024-04-19T03:02:54.516 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.516 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.516 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:54.516 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:18.073899+0000", 2024-04-19T03:02:54.517 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.5971999999999996e-05 2024-04-19T03:02:54.517 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:54.517 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:54.517 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:54.517 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.517 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.517 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:86615 5.e 5:7fef7288:::benchmark_data_smithi096_19531_object86614:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:54.517 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:22.634544+0000", 2024-04-19T03:02:54.517 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 31.871028880000001, 2024-04-19T03:02:54.517 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.192475071, 2024-04-19T03:02:54.517 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:54.517 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:54.517 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:54.517 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:54.518 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:54.518 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 86615 2024-04-19T03:02:54.518 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.518 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:54.518 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.518 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:54.518 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634544+0000", 2024-04-19T03:02:54.518 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:54.518 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.518 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.518 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:54.518 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634544+0000", 2024-04-19T03:02:54.518 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:54.519 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.519 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.519 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:54.519 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634542+0000", 2024-04-19T03:02:54.519 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999981 2024-04-19T03:02:54.519 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.519 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.519 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:54.519 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634585+0000", 2024-04-19T03:02:54.519 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2299000000000003e-05 2024-04-19T03:02:54.519 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.519 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.519 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:54.519 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634592+0000", 2024-04-19T03:02:54.520 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2350000000000002e-06 2024-04-19T03:02:54.520 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.520 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.520 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:54.520 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634596+0000", 2024-04-19T03:02:54.520 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5390000000000001e-06 2024-04-19T03:02:54.520 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.520 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.520 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:54.520 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634639+0000", 2024-04-19T03:02:54.520 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2444999999999998e-05 2024-04-19T03:02:54.520 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.520 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.520 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:54.521 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634808+0000", 2024-04-19T03:02:54.521 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000169152 2024-04-19T03:02:54.521 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.521 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.521 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:54.521 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634999+0000", 2024-04-19T03:02:54.521 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00019098300000000001 2024-04-19T03:02:54.521 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.521 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.521 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:54.521 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.640458+0000", 2024-04-19T03:02:54.521 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0054586870000000003 2024-04-19T03:02:54.521 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.521 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.522 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:54.522 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.826949+0000", 2024-04-19T03:02:54.522 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.18649178299999999 2024-04-19T03:02:54.522 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.522 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.522 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:54.522 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.826982+0000", 2024-04-19T03:02:54.522 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2477000000000001e-05 2024-04-19T03:02:54.522 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.522 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.522 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:54.522 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.827019+0000", 2024-04-19T03:02:54.522 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7355999999999999e-05 2024-04-19T03:02:54.523 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:54.523 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:54.523 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:54.523 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.523 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.523 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:86616 5.e 5:72278f47:::benchmark_data_smithi096_19531_object86615:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:54.523 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:22.634609+0000", 2024-04-19T03:02:54.523 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 31.870963731, 2024-04-19T03:02:54.523 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.19472088900000001, 2024-04-19T03:02:54.523 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:54.523 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:54.523 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:54.523 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:54.524 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:54.524 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 86616 2024-04-19T03:02:54.524 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.524 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:54.524 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.524 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:54.524 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634609+0000", 2024-04-19T03:02:54.524 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:54.524 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.524 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.524 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:54.524 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634609+0000", 2024-04-19T03:02:54.524 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:54.525 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.525 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.525 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:54.525 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634609+0000", 2024-04-19T03:02:54.525 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:54.525 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.525 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.525 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:54.525 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634651+0000", 2024-04-19T03:02:54.525 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2589000000000002e-05 2024-04-19T03:02:54.525 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.525 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.525 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:54.525 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634659+0000", 2024-04-19T03:02:54.526 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5850000000000002e-06 2024-04-19T03:02:54.526 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.526 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.526 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:54.526 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634662+0000", 2024-04-19T03:02:54.526 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3620000000000002e-06 2024-04-19T03:02:54.526 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.526 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.526 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:54.526 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.637880+0000", 2024-04-19T03:02:54.526 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.003218149 2024-04-19T03:02:54.526 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.526 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.526 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:54.527 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.637999+0000", 2024-04-19T03:02:54.527 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000118643 2024-04-19T03:02:54.527 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.527 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.527 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:54.527 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.638102+0000", 2024-04-19T03:02:54.527 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010331 2024-04-19T03:02:54.527 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.527 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.527 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:54.527 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.640851+0000", 2024-04-19T03:02:54.527 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0027483310000000001 2024-04-19T03:02:54.527 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.528 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.528 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:54.528 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.829269+0000", 2024-04-19T03:02:54.528 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.188418319 2024-04-19T03:02:54.528 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.528 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.528 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:54.528 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.829299+0000", 2024-04-19T03:02:54.528 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0227e-05 2024-04-19T03:02:54.528 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.528 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.528 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:54.528 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.829330+0000", 2024-04-19T03:02:54.528 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0969000000000001e-05 2024-04-19T03:02:54.529 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:54.529 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:54.529 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:54.529 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.529 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.529 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:86618 5.0 5:09014b90:::benchmark_data_smithi096_19531_object86617:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:54.529 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:22.634894+0000", 2024-04-19T03:02:54.529 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 31.870679243000001, 2024-04-19T03:02:54.529 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.19413419800000001, 2024-04-19T03:02:54.529 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:54.529 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:54.529 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:54.529 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:54.529 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:54.530 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 86618 2024-04-19T03:02:54.530 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.530 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:54.530 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.530 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:54.530 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634894+0000", 2024-04-19T03:02:54.530 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:54.530 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.530 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.530 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:54.530 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634894+0000", 2024-04-19T03:02:54.530 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:54.530 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.531 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.531 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:54.531 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634893+0000", 2024-04-19T03:02:54.531 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:54.531 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.531 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.531 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:54.531 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634976+0000", 2024-04-19T03:02:54.531 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3231000000000003e-05 2024-04-19T03:02:54.531 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.531 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.531 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:54.532 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634983+0000", 2024-04-19T03:02:54.532 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5169999999999996e-06 2024-04-19T03:02:54.532 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.532 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.532 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:54.532 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634987+0000", 2024-04-19T03:02:54.532 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.425e-06 2024-04-19T03:02:54.532 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.532 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.532 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:54.532 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635030+0000", 2024-04-19T03:02:54.532 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.32e-05 2024-04-19T03:02:54.532 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.533 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.533 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:54.533 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635185+0000", 2024-04-19T03:02:54.533 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015471899999999999 2024-04-19T03:02:54.533 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.533 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.533 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:54.533 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635415+0000", 2024-04-19T03:02:54.533 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00023026500000000001 2024-04-19T03:02:54.533 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.533 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.533 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:54.533 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.640127+0000", 2024-04-19T03:02:54.533 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0047118890000000004 2024-04-19T03:02:54.534 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.534 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.534 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:54.534 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.828895+0000", 2024-04-19T03:02:54.534 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.18876802600000001 2024-04-19T03:02:54.534 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.534 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.534 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:54.534 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.828972+0000", 2024-04-19T03:02:54.534 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.6345000000000002e-05 2024-04-19T03:02:54.534 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.534 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.534 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:54.534 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.829028+0000", 2024-04-19T03:02:54.535 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6342999999999999e-05 2024-04-19T03:02:54.535 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:54.535 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:54.535 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:54.535 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.535 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.535 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:86620 5.b 5:d80faa68:::benchmark_data_smithi096_19531_object86619:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:54.535 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:22.635110+0000", 2024-04-19T03:02:54.535 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 31.870462683, 2024-04-19T03:02:54.535 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.193447275, 2024-04-19T03:02:54.535 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:54.535 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:54.535 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:54.536 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:54.536 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:54.536 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 86620 2024-04-19T03:02:54.536 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.536 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:54.536 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.536 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:54.536 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635110+0000", 2024-04-19T03:02:54.536 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:54.536 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.536 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.536 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:54.536 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635110+0000", 2024-04-19T03:02:54.536 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:54.536 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.537 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.537 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:54.537 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635110+0000", 2024-04-19T03:02:54.537 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:54.537 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.537 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.537 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:54.537 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635154+0000", 2024-04-19T03:02:54.537 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4681000000000001e-05 2024-04-19T03:02:54.537 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.537 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.537 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:54.537 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635166+0000", 2024-04-19T03:02:54.537 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1505000000000001e-05 2024-04-19T03:02:54.537 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.538 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.538 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:54.538 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635171+0000", 2024-04-19T03:02:54.538 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6040000000000003e-06 2024-04-19T03:02:54.538 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.538 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.538 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:54.538 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635221+0000", 2024-04-19T03:02:54.538 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9947000000000001e-05 2024-04-19T03:02:54.538 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.538 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.538 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:54.539 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635356+0000", 2024-04-19T03:02:54.539 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013576199999999999 2024-04-19T03:02:54.539 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.539 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.539 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:54.539 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635507+0000", 2024-04-19T03:02:54.539 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015072999999999999 2024-04-19T03:02:54.539 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.539 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.539 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:54.539 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.638488+0000", 2024-04-19T03:02:54.539 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0029813159999999999 2024-04-19T03:02:54.539 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.539 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.540 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:54.540 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.828341+0000", 2024-04-19T03:02:54.540 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.189852254 2024-04-19T03:02:54.540 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.540 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.540 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:54.540 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.828416+0000", 2024-04-19T03:02:54.540 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5344000000000002e-05 2024-04-19T03:02:54.540 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.540 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.540 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:54.540 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.828558+0000", 2024-04-19T03:02:54.540 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000141695 2024-04-19T03:02:54.540 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:54.541 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:54.541 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:54.541 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.541 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.541 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:86621 5.8 5:1597a420:::benchmark_data_smithi096_19531_object86620:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:54.541 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:22.635187+0000", 2024-04-19T03:02:54.541 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 31.870385822999999, 2024-04-19T03:02:54.541 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.194204878, 2024-04-19T03:02:54.541 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:54.541 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:54.541 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:54.541 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:54.541 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:54.541 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 86621 2024-04-19T03:02:54.542 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.542 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:54.542 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.542 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:54.542 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635187+0000", 2024-04-19T03:02:54.542 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:54.542 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.542 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.542 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:54.542 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635187+0000", 2024-04-19T03:02:54.542 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:54.542 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.543 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.543 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:54.543 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635187+0000", 2024-04-19T03:02:54.543 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:54.543 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.543 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.543 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:54.543 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635242+0000", 2024-04-19T03:02:54.543 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5158000000000003e-05 2024-04-19T03:02:54.543 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.543 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.543 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:54.543 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635249+0000", 2024-04-19T03:02:54.543 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.7000000000000008e-06 2024-04-19T03:02:54.544 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.544 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.544 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:54.544 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635256+0000", 2024-04-19T03:02:54.544 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2060000000000004e-06 2024-04-19T03:02:54.544 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.544 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.544 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:54.544 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635302+0000", 2024-04-19T03:02:54.544 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5954000000000001e-05 2024-04-19T03:02:54.544 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.544 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.544 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:54.544 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635427+0000", 2024-04-19T03:02:54.545 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012559299999999999 2024-04-19T03:02:54.545 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.545 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.545 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:54.545 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635596+0000", 2024-04-19T03:02:54.545 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000168615 2024-04-19T03:02:54.545 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.545 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.545 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:54.545 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.639320+0000", 2024-04-19T03:02:54.545 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0037244610000000001 2024-04-19T03:02:54.545 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.545 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.545 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:54.546 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.829277+0000", 2024-04-19T03:02:54.546 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.18995651099999999 2024-04-19T03:02:54.546 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.546 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.546 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:54.546 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.829341+0000", 2024-04-19T03:02:54.546 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3756000000000004e-05 2024-04-19T03:02:54.546 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.546 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.546 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:54.546 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.829392+0000", 2024-04-19T03:02:54.546 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1555999999999999e-05 2024-04-19T03:02:54.546 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:54.547 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:54.547 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:54.547 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.547 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.547 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87062 5.4 5:2d3b5d9a:::benchmark_data_smithi096_19531_object87061:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:54.547 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.136820+0000", 2024-04-19T03:02:54.547 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 31.368752669999999, 2024-04-19T03:02:54.547 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.066483741999999998, 2024-04-19T03:02:54.547 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:54.547 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:54.547 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:54.547 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:54.547 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:54.547 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87062 2024-04-19T03:02:54.547 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.548 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:54.548 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.548 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:54.548 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.136820+0000", 2024-04-19T03:02:54.548 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:54.548 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.548 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.548 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:54.548 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.136820+0000", 2024-04-19T03:02:54.548 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:54.548 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.548 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.548 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:54.548 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.136819+0000", 2024-04-19T03:02:54.549 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:54.549 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.549 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.549 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:54.549 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.136864+0000", 2024-04-19T03:02:54.549 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4855000000000003e-05 2024-04-19T03:02:54.549 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.549 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.549 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:54.549 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.136881+0000", 2024-04-19T03:02:54.549 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7521999999999999e-05 2024-04-19T03:02:54.549 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.549 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.549 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:54.550 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.136890+0000", 2024-04-19T03:02:54.550 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1039999999999996e-06 2024-04-19T03:02:54.550 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.550 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.550 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:54.550 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.136974+0000", 2024-04-19T03:02:54.550 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3735999999999999e-05 2024-04-19T03:02:54.550 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.550 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.550 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:54.550 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.137308+0000", 2024-04-19T03:02:54.550 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00033376100000000002 2024-04-19T03:02:54.550 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.551 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.551 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:54.551 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.137559+0000", 2024-04-19T03:02:54.551 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000250599 2024-04-19T03:02:54.551 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.551 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.551 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:54.551 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.145423+0000", 2024-04-19T03:02:54.551 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0078649589999999995 2024-04-19T03:02:54.551 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.551 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.551 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:54.551 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.203175+0000", 2024-04-19T03:02:54.551 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.057751255000000001 2024-04-19T03:02:54.552 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.552 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.552 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:54.552 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.203250+0000", 2024-04-19T03:02:54.552 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5378999999999998e-05 2024-04-19T03:02:54.552 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.552 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.552 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:54.552 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.203304+0000", 2024-04-19T03:02:54.552 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4015999999999999e-05 2024-04-19T03:02:54.552 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:54.552 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:54.552 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:54.552 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.553 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.553 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87065 5.4 5:21d20a47:::benchmark_data_smithi096_19531_object87064:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:54.553 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.137482+0000", 2024-04-19T03:02:54.553 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 31.368090936000002, 2024-04-19T03:02:54.553 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.065988749999999999, 2024-04-19T03:02:54.553 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:54.553 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:54.553 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:54.553 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:54.553 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:54.553 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87065 2024-04-19T03:02:54.553 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.553 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:54.553 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.554 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:54.554 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.137482+0000", 2024-04-19T03:02:54.554 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:54.554 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.554 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.554 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:54.554 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.137482+0000", 2024-04-19T03:02:54.554 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:54.554 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.554 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.554 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:54.554 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.137481+0000", 2024-04-19T03:02:54.554 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:54.555 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.555 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.555 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:54.555 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.137530+0000", 2024-04-19T03:02:54.555 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9302000000000003e-05 2024-04-19T03:02:54.555 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.555 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.555 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:54.555 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.137540+0000", 2024-04-19T03:02:54.555 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.2010000000000005e-06 2024-04-19T03:02:54.555 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.555 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.555 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:54.555 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.137545+0000", 2024-04-19T03:02:54.556 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5910000000000003e-06 2024-04-19T03:02:54.556 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.556 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.556 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:54.556 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.140666+0000", 2024-04-19T03:02:54.556 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0031212710000000001 2024-04-19T03:02:54.556 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.556 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.556 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:54.556 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.140847+0000", 2024-04-19T03:02:54.556 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00018065600000000001 2024-04-19T03:02:54.556 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.556 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.556 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:54.557 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.140991+0000", 2024-04-19T03:02:54.557 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014433100000000001 2024-04-19T03:02:54.557 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.557 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.557 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:54.557 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.148053+0000", 2024-04-19T03:02:54.557 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.007061945 2024-04-19T03:02:54.557 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.557 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.557 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:54.557 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.203367+0000", 2024-04-19T03:02:54.557 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.055313703999999998 2024-04-19T03:02:54.557 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.557 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.558 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:54.558 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.203426+0000", 2024-04-19T03:02:54.558 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9024000000000003e-05 2024-04-19T03:02:54.558 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.558 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.558 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:54.558 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.203471+0000", 2024-04-19T03:02:54.558 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4818999999999999e-05 2024-04-19T03:02:54.558 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:54.558 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:54.558 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:54.558 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.558 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.559 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87067 5.b 5:d57af71a:::benchmark_data_smithi096_19531_object87066:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:54.559 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.142233+0000", 2024-04-19T03:02:54.559 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 31.363339960000001, 2024-04-19T03:02:54.559 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.071692405000000001, 2024-04-19T03:02:54.559 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:54.559 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:54.559 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:54.559 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:54.559 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:54.559 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87067 2024-04-19T03:02:54.559 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.559 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:54.559 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.559 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:54.560 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142233+0000", 2024-04-19T03:02:54.560 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:54.560 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.560 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.560 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:54.560 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142233+0000", 2024-04-19T03:02:54.560 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:54.560 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.560 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.560 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:54.560 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142232+0000", 2024-04-19T03:02:54.560 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:54.560 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.561 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.561 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:54.561 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142277+0000", 2024-04-19T03:02:54.561 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5837000000000002e-05 2024-04-19T03:02:54.561 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.561 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.561 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:54.561 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142297+0000", 2024-04-19T03:02:54.561 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9561000000000001e-05 2024-04-19T03:02:54.561 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.561 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.561 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:54.561 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142311+0000", 2024-04-19T03:02:54.561 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3654e-05 2024-04-19T03:02:54.562 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.562 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.562 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:54.562 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142391+0000", 2024-04-19T03:02:54.562 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0123999999999994e-05 2024-04-19T03:02:54.562 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.562 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.562 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:54.562 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142669+0000", 2024-04-19T03:02:54.562 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00027829800000000001 2024-04-19T03:02:54.562 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.562 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.562 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:54.563 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142859+0000", 2024-04-19T03:02:54.563 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000190051 2024-04-19T03:02:54.563 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.563 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.563 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:54.563 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.150597+0000", 2024-04-19T03:02:54.563 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0077380299999999999 2024-04-19T03:02:54.563 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.563 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.563 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:54.563 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.213855+0000", 2024-04-19T03:02:54.563 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.063257987000000002 2024-04-19T03:02:54.563 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.563 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.563 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:54.564 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.213898+0000", 2024-04-19T03:02:54.564 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2916e-05 2024-04-19T03:02:54.564 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.564 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.564 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:54.564 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.213925+0000", 2024-04-19T03:02:54.564 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7503000000000001e-05 2024-04-19T03:02:54.564 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:54.564 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:54.564 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:54.564 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.564 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.564 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87069 5.b 5:da0c93b5:::benchmark_data_smithi096_19531_object87068:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:54.565 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.143402+0000", 2024-04-19T03:02:54.565 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 31.362170998, 2024-04-19T03:02:54.565 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.070678598999999995, 2024-04-19T03:02:54.565 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:54.565 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:54.565 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:54.565 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:54.565 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:54.565 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87069 2024-04-19T03:02:54.565 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.565 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:54.565 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.565 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:54.565 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.143402+0000", 2024-04-19T03:02:54.566 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:54.566 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.566 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.566 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:54.566 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.143402+0000", 2024-04-19T03:02:54.566 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:54.566 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.566 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.566 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:54.566 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.143401+0000", 2024-04-19T03:02:54.566 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:54.566 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.566 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.567 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:54.567 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.143501+0000", 2024-04-19T03:02:54.567 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000100387 2024-04-19T03:02:54.567 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.567 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.567 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:54.567 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.143516+0000", 2024-04-19T03:02:54.567 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5369000000000001e-05 2024-04-19T03:02:54.567 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.567 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.567 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:54.567 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.143524+0000", 2024-04-19T03:02:54.567 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.7079999999999997e-06 2024-04-19T03:02:54.567 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.568 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.568 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:54.568 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.145550+0000", 2024-04-19T03:02:54.568 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0020259290000000001 2024-04-19T03:02:54.568 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.568 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.568 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:54.568 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.145676+0000", 2024-04-19T03:02:54.568 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000126406 2024-04-19T03:02:54.568 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.568 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.568 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:54.568 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.145802+0000", 2024-04-19T03:02:54.568 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000125974 2024-04-19T03:02:54.569 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.569 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.569 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:54.569 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.151030+0000", 2024-04-19T03:02:54.569 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0052276079999999999 2024-04-19T03:02:54.569 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.569 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.569 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:54.569 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.213998+0000", 2024-04-19T03:02:54.569 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.06296786 2024-04-19T03:02:54.569 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.569 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.569 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:54.570 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.214031+0000", 2024-04-19T03:02:54.570 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3387999999999999e-05 2024-04-19T03:02:54.570 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.570 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.570 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:54.570 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.214081+0000", 2024-04-19T03:02:54.570 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9316e-05 2024-04-19T03:02:54.570 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:54.570 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:54.570 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:54.570 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.570 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.570 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87073 5.0 5:0ca21233:::benchmark_data_smithi096_19531_object87072:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:54.571 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.145929+0000", 2024-04-19T03:02:54.571 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 31.359643737999999, 2024-04-19T03:02:54.571 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.062283234999999999, 2024-04-19T03:02:54.571 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:54.571 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:54.571 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:54.571 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:54.571 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:54.571 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87073 2024-04-19T03:02:54.571 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.571 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:54.571 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.571 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:54.572 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.145929+0000", 2024-04-19T03:02:54.572 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:54.572 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.572 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.572 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:54.572 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.145929+0000", 2024-04-19T03:02:54.572 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:54.572 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.572 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.572 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:54.572 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.145928+0000", 2024-04-19T03:02:54.572 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:54.572 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.572 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.573 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:54.573 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.146063+0000", 2024-04-19T03:02:54.573 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013541099999999999 2024-04-19T03:02:54.573 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.573 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.573 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:54.573 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.146079+0000", 2024-04-19T03:02:54.573 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5902000000000001e-05 2024-04-19T03:02:54.573 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.573 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.573 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:54.573 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.146100+0000", 2024-04-19T03:02:54.573 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0380000000000001e-05 2024-04-19T03:02:54.573 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.574 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.574 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:54.574 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.146193+0000", 2024-04-19T03:02:54.574 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.3669000000000001e-05 2024-04-19T03:02:54.574 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.574 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.574 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:54.574 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.146388+0000", 2024-04-19T03:02:54.574 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00019457799999999999 2024-04-19T03:02:54.574 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.574 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.574 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:54.574 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.146625+0000", 2024-04-19T03:02:54.574 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00023751999999999999 2024-04-19T03:02:54.575 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.575 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.575 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:54.575 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.151051+0000", 2024-04-19T03:02:54.575 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0044260039999999999 2024-04-19T03:02:54.575 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.575 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.575 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:54.575 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.207872+0000", 2024-04-19T03:02:54.575 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.056821114999999998 2024-04-19T03:02:54.575 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.575 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.575 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:54.575 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.208085+0000", 2024-04-19T03:02:54.576 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000212893 2024-04-19T03:02:54.576 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.576 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.576 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:54.576 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.208213+0000", 2024-04-19T03:02:54.576 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012714700000000001 2024-04-19T03:02:54.576 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:54.576 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:54.576 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:54.576 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.576 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.576 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87074 5.0 5:035614ac:::benchmark_data_smithi096_19531_object87073:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:54.576 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.151387+0000", 2024-04-19T03:02:54.576 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 31.354185807, 2024-04-19T03:02:54.577 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.063461771, 2024-04-19T03:02:54.577 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:54.577 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:54.577 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:54.577 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:54.577 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:54.577 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87074 2024-04-19T03:02:54.577 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.577 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:54.577 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.577 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:54.577 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.151387+0000", 2024-04-19T03:02:54.577 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:54.577 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.578 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.578 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:54.578 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.151387+0000", 2024-04-19T03:02:54.578 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:54.578 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.578 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.578 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:54.578 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.151386+0000", 2024-04-19T03:02:54.578 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:54.578 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.578 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.578 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:54.578 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.151428+0000", 2024-04-19T03:02:54.579 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.172e-05 2024-04-19T03:02:54.579 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.579 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.579 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:54.579 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.151442+0000", 2024-04-19T03:02:54.579 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4328000000000001e-05 2024-04-19T03:02:54.579 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.579 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.579 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:54.579 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.151451+0000", 2024-04-19T03:02:54.579 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.8400000000000001e-06 2024-04-19T03:02:54.579 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.579 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.579 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:54.580 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.151521+0000", 2024-04-19T03:02:54.580 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.9606999999999999e-05 2024-04-19T03:02:54.580 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.580 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.580 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:54.580 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.151749+0000", 2024-04-19T03:02:54.580 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00022818799999999999 2024-04-19T03:02:54.580 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.580 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.580 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:54.580 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.152006+0000", 2024-04-19T03:02:54.580 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00025687300000000002 2024-04-19T03:02:54.580 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.580 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.581 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:54.581 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.154887+0000", 2024-04-19T03:02:54.581 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0028812989999999999 2024-04-19T03:02:54.581 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.581 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.581 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:54.581 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.214733+0000", 2024-04-19T03:02:54.581 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.059846159000000003 2024-04-19T03:02:54.581 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.581 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.581 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:54.581 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.214788+0000", 2024-04-19T03:02:54.581 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4524000000000002e-05 2024-04-19T03:02:54.582 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.582 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.582 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:54.582 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.214849+0000", 2024-04-19T03:02:54.582 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1362e-05 2024-04-19T03:02:54.582 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:54.582 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:54.582 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:54.582 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.582 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.582 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87108 5.e 5:7e197adc:::benchmark_data_smithi096_19531_object87107:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:54.582 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.223103+0000", 2024-04-19T03:02:54.582 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 31.282469661, 2024-04-19T03:02:54.583 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.044946887, 2024-04-19T03:02:54.583 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:54.583 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-19T03:02:54.583 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:54.583 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:54.583 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:54.583 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87108 2024-04-19T03:02:54.583 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.583 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:54.583 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.583 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:54.583 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.223103+0000", 2024-04-19T03:02:54.583 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:54.583 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.584 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.584 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:54.584 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.223103+0000", 2024-04-19T03:02:54.584 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:54.584 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.584 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.584 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:54.584 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.223102+0000", 2024-04-19T03:02:54.584 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:54.584 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.584 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.584 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:54.584 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.223156+0000", 2024-04-19T03:02:54.584 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3958000000000001e-05 2024-04-19T03:02:54.585 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.585 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.585 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:54.585 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.223166+0000", 2024-04-19T03:02:54.585 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.4809999999999995e-06 2024-04-19T03:02:54.585 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.585 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.585 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:54.585 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.223172+0000", 2024-04-19T03:02:54.585 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0140000000000004e-06 2024-04-19T03:02:54.585 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.585 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.585 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:54.586 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.227295+0000", 2024-04-19T03:02:54.586 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0041233420000000003 2024-04-19T03:02:54.586 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.586 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.586 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:54.586 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.227495+0000", 2024-04-19T03:02:54.586 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00019955299999999999 2024-04-19T03:02:54.586 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.586 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.586 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:54.586 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.227717+0000", 2024-04-19T03:02:54.586 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000221902 2024-04-19T03:02:54.587 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.587 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.587 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:54.587 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233189+0000", 2024-04-19T03:02:54.587 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0054718889999999997 2024-04-19T03:02:54.587 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.587 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.587 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:54.587 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.250529+0000", 2024-04-19T03:02:54.587 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.017340298000000001 2024-04-19T03:02:54.587 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.587 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.587 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:02:54.588 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.250539+0000", 2024-04-19T03:02:54.588 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0501e-05 2024-04-19T03:02:54.588 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.588 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.588 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:54.588 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.268003+0000", 2024-04-19T03:02:54.588 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.017463429 2024-04-19T03:02:54.588 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.588 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.588 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:54.588 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.268050+0000", 2024-04-19T03:02:54.588 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7466000000000003e-05 2024-04-19T03:02:54.588 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:54.588 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:54.589 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:54.589 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.589 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.589 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87118 5.b 5:d1bb4f3c:::benchmark_data_smithi096_19531_object87117:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:54.589 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.231082+0000", 2024-04-19T03:02:54.589 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 31.274490827000001, 2024-04-19T03:02:54.589 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.035789004, 2024-04-19T03:02:54.589 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:54.589 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-19T03:02:54.589 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:54.589 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:54.589 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:54.589 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87118 2024-04-19T03:02:54.590 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.590 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:54.590 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.590 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:54.590 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231082+0000", 2024-04-19T03:02:54.590 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:54.590 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.590 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.590 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:54.590 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231082+0000", 2024-04-19T03:02:54.590 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:54.590 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.590 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.590 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:54.591 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231081+0000", 2024-04-19T03:02:54.591 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:54.591 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.591 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.591 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:54.591 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231159+0000", 2024-04-19T03:02:54.591 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.7819999999999997e-05 2024-04-19T03:02:54.591 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.591 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.591 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:54.591 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231186+0000", 2024-04-19T03:02:54.591 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7126000000000001e-05 2024-04-19T03:02:54.591 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.591 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.592 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:54.592 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231193+0000", 2024-04-19T03:02:54.592 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7259999999999996e-06 2024-04-19T03:02:54.592 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.592 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.592 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:54.592 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231241+0000", 2024-04-19T03:02:54.592 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8123e-05 2024-04-19T03:02:54.592 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.592 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.592 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:54.592 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231354+0000", 2024-04-19T03:02:54.592 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0001133 2024-04-19T03:02:54.592 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.593 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.593 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:54.593 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231443+0000", 2024-04-19T03:02:54.593 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9167999999999997e-05 2024-04-19T03:02:54.593 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.593 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.593 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:54.593 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236498+0000", 2024-04-19T03:02:54.593 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0050545160000000002 2024-04-19T03:02:54.593 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.593 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.593 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:54.593 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.249681+0000", 2024-04-19T03:02:54.593 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013183321 2024-04-19T03:02:54.594 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.594 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.594 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:02:54.594 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.249693+0000", 2024-04-19T03:02:54.594 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1834999999999999e-05 2024-04-19T03:02:54.594 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.594 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.594 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:54.594 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266733+0000", 2024-04-19T03:02:54.594 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.017040408 2024-04-19T03:02:54.594 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.594 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.594 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:54.595 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266871+0000", 2024-04-19T03:02:54.595 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000137849 2024-04-19T03:02:54.595 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:54.595 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:54.595 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:54.595 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.595 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.595 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87121 5.b 5:d01822b8:::benchmark_data_smithi096_19531_object87120:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:54.595 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.233319+0000", 2024-04-19T03:02:54.595 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 31.272253963000001, 2024-04-19T03:02:54.595 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.033624198, 2024-04-19T03:02:54.595 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:54.595 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-19T03:02:54.595 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:54.596 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:54.596 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:54.596 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87121 2024-04-19T03:02:54.596 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.596 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:54.596 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.596 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:54.596 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233319+0000", 2024-04-19T03:02:54.596 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:54.596 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.596 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.596 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:54.596 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233319+0000", 2024-04-19T03:02:54.596 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:54.597 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.597 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.597 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:54.597 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233319+0000", 2024-04-19T03:02:54.597 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:54.597 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.597 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.597 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:54.597 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233364+0000", 2024-04-19T03:02:54.597 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5460999999999997e-05 2024-04-19T03:02:54.597 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.597 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.597 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:54.597 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233382+0000", 2024-04-19T03:02:54.598 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8148e-05 2024-04-19T03:02:54.598 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.598 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.598 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:54.598 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233390+0000", 2024-04-19T03:02:54.598 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5340000000000002e-06 2024-04-19T03:02:54.598 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.598 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.598 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:54.598 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233712+0000", 2024-04-19T03:02:54.598 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00032260500000000001 2024-04-19T03:02:54.598 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.599 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.599 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:54.599 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233829+0000", 2024-04-19T03:02:54.599 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011638599999999999 2024-04-19T03:02:54.599 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.599 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.599 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:54.599 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233959+0000", 2024-04-19T03:02:54.599 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013013900000000001 2024-04-19T03:02:54.599 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.599 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.599 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:54.599 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236515+0000", 2024-04-19T03:02:54.599 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0025562750000000002 2024-04-19T03:02:54.600 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.600 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.600 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:54.600 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.249723+0000", 2024-04-19T03:02:54.600 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013208176 2024-04-19T03:02:54.600 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.600 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.600 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:02:54.600 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.249728+0000", 2024-04-19T03:02:54.600 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6519999999999997e-06 2024-04-19T03:02:54.600 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.600 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.600 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:54.600 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266837+0000", 2024-04-19T03:02:54.600 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0171087059999999 2024-04-19T03:02:54.601 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.601 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.601 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:54.601 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266943+0000", 2024-04-19T03:02:54.601 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000106604 2024-04-19T03:02:54.601 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:54.601 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:54.601 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:54.601 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.601 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.601 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87124 5.8 5:14819ad7:::benchmark_data_smithi096_19531_object87123:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:54.601 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.235886+0000", 2024-04-19T03:02:54.601 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 31.269686538999999, 2024-04-19T03:02:54.601 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0315451179999999, 2024-04-19T03:02:54.602 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:54.602 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-19T03:02:54.602 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:54.602 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:54.602 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:54.602 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87124 2024-04-19T03:02:54.602 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.602 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:54.602 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.602 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:54.602 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.235886+0000", 2024-04-19T03:02:54.602 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:54.602 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.603 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.603 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:54.603 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.235886+0000", 2024-04-19T03:02:54.603 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:54.603 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.603 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.603 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:54.603 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.235886+0000", 2024-04-19T03:02:54.603 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:54.603 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.603 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.603 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:54.603 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.235934+0000", 2024-04-19T03:02:54.603 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8384000000000003e-05 2024-04-19T03:02:54.603 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.604 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.604 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:54.604 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.235945+0000", 2024-04-19T03:02:54.604 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0671e-05 2024-04-19T03:02:54.604 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.604 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.604 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:54.604 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.235952+0000", 2024-04-19T03:02:54.604 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3089999999999998e-06 2024-04-19T03:02:54.604 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.604 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.604 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:54.604 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.237067+0000", 2024-04-19T03:02:54.605 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001115263 2024-04-19T03:02:54.605 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.605 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.605 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:54.605 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.237188+0000", 2024-04-19T03:02:54.605 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000121258 2024-04-19T03:02:54.605 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.605 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.605 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:54.605 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.237316+0000", 2024-04-19T03:02:54.605 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000128071 2024-04-19T03:02:54.605 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.605 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.606 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:54.606 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240744+0000", 2024-04-19T03:02:54.606 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0034275629999999998 2024-04-19T03:02:54.606 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.606 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.606 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:54.606 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.252517+0000", 2024-04-19T03:02:54.606 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011772991999999999 2024-04-19T03:02:54.606 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.606 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.606 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:02:54.606 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.252523+0000", 2024-04-19T03:02:54.606 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3640000000000004e-06 2024-04-19T03:02:54.607 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.607 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.607 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:54.607 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.267290+0000", 2024-04-19T03:02:54.607 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0147665690000001 2024-04-19T03:02:54.607 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.607 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.607 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:54.607 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.267432+0000", 2024-04-19T03:02:54.607 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014165299999999999 2024-04-19T03:02:54.607 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:54.607 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:54.607 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:54.608 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.608 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.608 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87129 5.0 5:02667e01:::benchmark_data_smithi096_19531_object87128:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:54.608 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.236466+0000", 2024-04-19T03:02:54.608 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 31.269106542999999, 2024-04-19T03:02:54.608 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0301534510000001, 2024-04-19T03:02:54.608 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:54.608 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-19T03:02:54.608 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:54.608 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:54.608 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:54.608 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87129 2024-04-19T03:02:54.608 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.608 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:54.609 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.609 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:54.609 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236466+0000", 2024-04-19T03:02:54.609 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:54.609 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.609 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.609 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:54.609 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236466+0000", 2024-04-19T03:02:54.609 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:54.609 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.609 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.609 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:54.609 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236465+0000", 2024-04-19T03:02:54.609 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:54.610 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.610 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.610 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:54.610 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236566+0000", 2024-04-19T03:02:54.610 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010047000000000001 2024-04-19T03:02:54.610 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.610 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.610 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:54.610 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236577+0000", 2024-04-19T03:02:54.610 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1772e-05 2024-04-19T03:02:54.610 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.610 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.610 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:54.611 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236584+0000", 2024-04-19T03:02:54.611 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0530000000000003e-06 2024-04-19T03:02:54.611 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.611 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.611 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:54.611 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.237023+0000", 2024-04-19T03:02:54.611 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000439703 2024-04-19T03:02:54.611 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.611 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.611 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:54.611 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.237207+0000", 2024-04-19T03:02:54.611 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000183692 2024-04-19T03:02:54.611 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.611 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.612 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:54.612 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.237373+0000", 2024-04-19T03:02:54.612 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016623500000000001 2024-04-19T03:02:54.612 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.612 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.612 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:54.612 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.241461+0000", 2024-04-19T03:02:54.612 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0040883050000000004 2024-04-19T03:02:54.612 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.612 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.612 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:54.612 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.252500+0000", 2024-04-19T03:02:54.612 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011038450999999999 2024-04-19T03:02:54.612 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.613 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.613 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:02:54.613 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.252507+0000", 2024-04-19T03:02:54.613 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2439999999999996e-06 2024-04-19T03:02:54.613 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.613 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.613 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:54.613 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266538+0000", 2024-04-19T03:02:54.613 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.014031184 2024-04-19T03:02:54.613 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.613 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.613 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:54.613 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266620+0000", 2024-04-19T03:02:54.613 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1600000000000005e-05 2024-04-19T03:02:54.613 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:54.614 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:54.614 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:54.614 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.614 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.614 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87135 5.4 5:2a97e7b7:::benchmark_data_smithi096_19531_object87134:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:54.614 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.240884+0000", 2024-04-19T03:02:54.614 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 31.264689086000001, 2024-04-19T03:02:54.614 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.025708931, 2024-04-19T03:02:54.614 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:54.614 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-19T03:02:54.614 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:54.614 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:54.614 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:54.615 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87135 2024-04-19T03:02:54.615 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.615 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:54.615 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.615 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:54.615 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240884+0000", 2024-04-19T03:02:54.615 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:54.615 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.615 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.615 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:54.615 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240884+0000", 2024-04-19T03:02:54.615 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:54.615 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.615 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.616 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:54.616 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240883+0000", 2024-04-19T03:02:54.616 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:54.616 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.616 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.616 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:54.616 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240933+0000", 2024-04-19T03:02:54.616 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9969999999999998e-05 2024-04-19T03:02:54.616 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.616 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.616 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:54.616 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240946+0000", 2024-04-19T03:02:54.616 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2943e-05 2024-04-19T03:02:54.616 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.617 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.617 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:54.617 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240952+0000", 2024-04-19T03:02:54.617 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8930000000000002e-06 2024-04-19T03:02:54.617 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.617 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.617 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:54.617 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240994+0000", 2024-04-19T03:02:54.617 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2753999999999998e-05 2024-04-19T03:02:54.617 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.617 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.617 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:54.617 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.241092+0000", 2024-04-19T03:02:54.617 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.7447000000000004e-05 2024-04-19T03:02:54.617 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.618 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.618 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:54.618 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.241183+0000", 2024-04-19T03:02:54.618 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1163999999999997e-05 2024-04-19T03:02:54.618 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.618 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.618 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:54.618 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.254672+0000", 2024-04-19T03:02:54.618 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.01348864 2024-04-19T03:02:54.618 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.618 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.618 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:02:54.618 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.254681+0000", 2024-04-19T03:02:54.618 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.3789999999999995e-06 2024-04-19T03:02:54.619 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.619 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.619 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:54.619 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266456+0000", 2024-04-19T03:02:54.619 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.011774621 2024-04-19T03:02:54.619 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.619 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.619 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:54.619 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266593+0000", 2024-04-19T03:02:54.619 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013737600000000001 2024-04-19T03:02:54.619 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:54.619 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:54.619 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:54.619 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.620 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.620 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87136 5.4 5:212411bc:::benchmark_data_smithi096_19531_object87135:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:54.620 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.240962+0000", 2024-04-19T03:02:54.620 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 31.264611209999998, 2024-04-19T03:02:54.620 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.025738, 2024-04-19T03:02:54.620 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:54.620 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-19T03:02:54.620 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:54.620 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:54.620 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:54.620 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87136 2024-04-19T03:02:54.620 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.620 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:54.620 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.620 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:54.621 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240962+0000", 2024-04-19T03:02:54.621 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:54.621 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.621 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.621 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:54.621 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240962+0000", 2024-04-19T03:02:54.621 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:54.621 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.621 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.621 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:54.621 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240961+0000", 2024-04-19T03:02:54.621 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:54.621 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.622 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.622 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:54.622 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240995+0000", 2024-04-19T03:02:54.622 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3868000000000002e-05 2024-04-19T03:02:54.622 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.622 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.622 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:54.622 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.241001+0000", 2024-04-19T03:02:54.622 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.322e-06 2024-04-19T03:02:54.622 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.622 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.622 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:54.622 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.241004+0000", 2024-04-19T03:02:54.622 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3510000000000002e-06 2024-04-19T03:02:54.623 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.623 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.623 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:54.623 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247131+0000", 2024-04-19T03:02:54.623 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0061270869999999998 2024-04-19T03:02:54.623 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.623 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.623 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:54.623 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247322+0000", 2024-04-19T03:02:54.623 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000191015 2024-04-19T03:02:54.623 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.623 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.623 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:54.623 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247542+0000", 2024-04-19T03:02:54.624 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00022030199999999999 2024-04-19T03:02:54.624 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.624 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.624 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:54.624 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.254709+0000", 2024-04-19T03:02:54.624 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0071662660000000001 2024-04-19T03:02:54.624 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.624 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.624 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:02:54.624 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.254716+0000", 2024-04-19T03:02:54.624 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3860000000000001e-06 2024-04-19T03:02:54.624 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.624 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.624 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:54.625 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266619+0000", 2024-04-19T03:02:54.625 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0119031030000001 2024-04-19T03:02:54.625 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.625 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.625 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:54.625 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266700+0000", 2024-04-19T03:02:54.625 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0764000000000001e-05 2024-04-19T03:02:54.625 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:54.625 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:54.625 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:54.625 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.625 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.625 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87138 5.e 5:7b1f1c20:::benchmark_data_smithi096_19531_object87137:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:54.625 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.247862+0000", 2024-04-19T03:02:54.626 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 31.257711136000001, 2024-04-19T03:02:54.626 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.024457079, 2024-04-19T03:02:54.626 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:54.626 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:54.626 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:54.626 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:54.626 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:54.626 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87138 2024-04-19T03:02:54.626 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.626 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:54.626 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.626 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:54.626 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247862+0000", 2024-04-19T03:02:54.626 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:54.627 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.627 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.627 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:54.627 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247862+0000", 2024-04-19T03:02:54.627 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:54.627 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.627 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.627 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:54.627 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247860+0000", 2024-04-19T03:02:54.627 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999981 2024-04-19T03:02:54.627 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.627 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.627 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:54.627 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247909+0000", 2024-04-19T03:02:54.628 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9150999999999997e-05 2024-04-19T03:02:54.628 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.628 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.628 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:54.628 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247925+0000", 2024-04-19T03:02:54.628 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5761999999999999e-05 2024-04-19T03:02:54.628 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.628 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.628 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:54.628 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247936+0000", 2024-04-19T03:02:54.628 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1144e-05 2024-04-19T03:02:54.628 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.628 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.628 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:54.629 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.250590+0000", 2024-04-19T03:02:54.629 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.002653678 2024-04-19T03:02:54.629 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.629 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.629 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:02:54.629 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.250599+0000", 2024-04-19T03:02:54.629 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9039999999999998e-06 2024-04-19T03:02:54.629 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.629 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.629 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:54.629 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.268151+0000", 2024-04-19T03:02:54.629 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0175523449999999 2024-04-19T03:02:54.629 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.629 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.629 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:54.630 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.268285+0000", 2024-04-19T03:02:54.630 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013415599999999999 2024-04-19T03:02:54.630 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.630 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.630 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:54.630 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.272238+0000", 2024-04-19T03:02:54.630 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0039533019999999997 2024-04-19T03:02:54.630 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.630 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.630 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:54.630 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.272274+0000", 2024-04-19T03:02:54.630 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5352000000000003e-05 2024-04-19T03:02:54.630 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:54.630 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:54.631 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:54.631 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.272319+0000", 2024-04-19T03:02:54.631 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5281999999999998e-05 2024-04-19T03:02:54.631 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:54.631 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:54.631 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:54.631 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:54.631 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:54.631 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-19T03:02:54.633 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T03:02:54.634 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:54.631+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:54.733 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:54.731+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:54.763 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-04-19T03:02:54.763 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [ 2024-04-19T03:02:54.763 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:54.763 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:149938 5.9 5:9bea43c1:::benchmark_data_smithi096_19531_object36488:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T03:02:54.763 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:54.754353+0000", 2024-04-19T03:02:54.763 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0067327669999999997, 2024-04-19T03:02:54.763 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0067562940000000004, 2024-04-19T03:02:54.763 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:54.763 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:02:54.764 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:54.764 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:54.764 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:54.764 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 149938 2024-04-19T03:02:54.764 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:54.764 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:54.764 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:54.764 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:54.764 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:54.754353+0000", 2024-04-19T03:02:54.764 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:54.764 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:54.764 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:54.764 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:54.764 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:54.754353+0000", 2024-04-19T03:02:54.765 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:54.765 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:54.765 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:54.765 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:54.765 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:54.754352+0000", 2024-04-19T03:02:54.765 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:54.765 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:54.765 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:54.765 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:54.765 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:54.754358+0000", 2024-04-19T03:02:54.765 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5089999999999999e-06 2024-04-19T03:02:54.765 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:54.765 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:54.765 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:54.766 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:54.754370+0000", 2024-04-19T03:02:54.766 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2106000000000001e-05 2024-04-19T03:02:54.766 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:54.766 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:54.766 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:54.766 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:54.754379+0000", 2024-04-19T03:02:54.766 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.3890000000000005e-06 2024-04-19T03:02:54.766 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:54.766 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:54.766 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:54.766 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:54.754426+0000", 2024-04-19T03:02:54.766 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7846000000000002e-05 2024-04-19T03:02:54.766 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:54.767 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:54.767 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:54.767 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:54.754635+0000", 2024-04-19T03:02:54.767 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000209063 2024-04-19T03:02:54.767 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:54.767 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:54.767 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:02:54.767 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:54.754792+0000", 2024-04-19T03:02:54.767 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00015631299999999999 2024-04-19T03:02:54.767 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:54.767 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:54.767 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:54.767 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:54.767 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:54.768 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:149941 5.9 5:90701a9d:::benchmark_data_smithi096_19531_object36491:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T03:02:54.768 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:54.754892+0000", 2024-04-19T03:02:54.768 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0061937850000000003, 2024-04-19T03:02:54.768 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0062893510000000003, 2024-04-19T03:02:54.768 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:54.768 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:02:54.768 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:54.768 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:54.768 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:54.768 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 149941 2024-04-19T03:02:54.768 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:54.768 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:54.768 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:54.768 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:54.769 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:54.754892+0000", 2024-04-19T03:02:54.769 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:54.769 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:54.769 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:54.769 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:54.769 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:54.754892+0000", 2024-04-19T03:02:54.769 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:54.769 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:54.769 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:54.769 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:54.769 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:54.754891+0000", 2024-04-19T03:02:54.769 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:54.769 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:54.770 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:54.770 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:54.770 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:54.754895+0000", 2024-04-19T03:02:54.770 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.777e-06 2024-04-19T03:02:54.770 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:54.770 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:54.770 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:54.770 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:54.754906+0000", 2024-04-19T03:02:54.771 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1178999999999999e-05 2024-04-19T03:02:54.771 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:54.771 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:54.771 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:54.771 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:54.754912+0000", 2024-04-19T03:02:54.771 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7599999999999999e-06 2024-04-19T03:02:54.771 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:54.771 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:54.771 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:54.771 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:54.756811+0000", 2024-04-19T03:02:54.771 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0018993879999999999 2024-04-19T03:02:54.771 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:54.771 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:54.771 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:54.772 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:54.756899+0000", 2024-04-19T03:02:54.772 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.8010000000000006e-05 2024-04-19T03:02:54.772 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:54.772 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:54.772 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:02:54.772 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:54.757016+0000", 2024-04-19T03:02:54.772 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000116789 2024-04-19T03:02:54.772 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:54.772 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:54.772 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:54.772 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:54.772 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:54.772 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:149942 5.3 5:c590c58f:::benchmark_data_smithi096_19531_object36492:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T03:02:54.772 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:54.756077+0000", 2024-04-19T03:02:54.772 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0050081960000000003, 2024-04-19T03:02:54.773 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0051688259999999996, 2024-04-19T03:02:54.773 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:54.773 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-04-19T03:02:54.773 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:54.773 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:54.773 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:54.773 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 149942 2024-04-19T03:02:54.773 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:54.773 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:54.773 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:54.773 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:54.773 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:54.756077+0000", 2024-04-19T03:02:54.773 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:54.773 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:54.774 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:54.774 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:54.774 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:54.756077+0000", 2024-04-19T03:02:54.774 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:54.774 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:54.774 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:54.774 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:54.774 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:54.756076+0000", 2024-04-19T03:02:54.774 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:54.774 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:54.774 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:54.774 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:54.774 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:54.756082+0000", 2024-04-19T03:02:54.775 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2569999999999998e-06 2024-04-19T03:02:54.775 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:54.775 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:54.775 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:54.775 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:54.756089+0000", 2024-04-19T03:02:54.775 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6899999999999992e-06 2024-04-19T03:02:54.775 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:54.775 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:54.775 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:54.775 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:54.756095+0000", 2024-04-19T03:02:54.775 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.215e-06 2024-04-19T03:02:54.775 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:54.775 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:54.775 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:54.776 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:54.756920+0000", 2024-04-19T03:02:54.776 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00082487900000000004 2024-04-19T03:02:54.776 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:54.776 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:54.776 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:54.776 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:54.757048+0000", 2024-04-19T03:02:54.776 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00012824399999999999 2024-04-19T03:02:54.776 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:54.776 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:54.776 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:54.776 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:54.776 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:54.777 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:149944 5.5 5:afc0c179:::benchmark_data_smithi096_19531_object36494:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T03:02:54.777 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:54.756526+0000", 2024-04-19T03:02:54.777 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0045599000000000004, 2024-04-19T03:02:54.777 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0047951000000000001, 2024-04-19T03:02:54.777 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:54.777 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-04-19T03:02:54.777 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:54.777 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:54.777 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:54.777 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 149944 2024-04-19T03:02:54.777 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:54.777 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:54.778 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:54.778 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:54.778 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:54.756526+0000", 2024-04-19T03:02:54.778 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:54.778 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:54.778 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:54.778 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:54.778 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:54.756526+0000", 2024-04-19T03:02:54.778 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:54.778 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:54.778 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:54.778 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:54.778 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:54.756525+0000", 2024-04-19T03:02:54.779 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:54.779 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:54.779 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:54.779 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:54.779 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:54.756530+0000", 2024-04-19T03:02:54.779 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6330000000000001e-06 2024-04-19T03:02:54.779 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:54.779 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:54.779 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:54.779 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:54.756540+0000", 2024-04-19T03:02:54.779 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.8889999999999997e-06 2024-04-19T03:02:54.779 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:54.779 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:54.779 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:54.780 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:54.756547+0000", 2024-04-19T03:02:54.780 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0859999999999996e-06 2024-04-19T03:02:54.780 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:54.780 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:54.780 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:54.780 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:54.756794+0000", 2024-04-19T03:02:54.780 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00024707400000000001 2024-04-19T03:02:54.780 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:54.781 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:54.781 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:54.781 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:54.756920+0000", 2024-04-19T03:02:54.781 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000126138 2024-04-19T03:02:54.781 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:54.781 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:54.781 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:54.781 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:54.781 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:54.781 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:149946 5.1 5:8bce043a:::benchmark_data_smithi096_19531_object36496:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T03:02:54.781 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:54.757178+0000", 2024-04-19T03:02:54.781 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0039078439999999997, 2024-04-19T03:02:54.781 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00420259, 2024-04-19T03:02:54.781 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:54.782 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-04-19T03:02:54.782 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:54.782 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:54.782 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:54.782 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 149946 2024-04-19T03:02:54.782 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:54.782 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:54.782 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:54.782 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:54.782 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:54.757178+0000", 2024-04-19T03:02:54.782 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:54.782 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:54.782 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:54.782 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:54.783 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:54.757178+0000", 2024-04-19T03:02:54.783 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:54.783 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:54.783 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:54.783 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:54.783 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:54.757177+0000", 2024-04-19T03:02:54.783 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:54.783 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:54.783 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:54.783 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:54.783 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:54.757182+0000", 2024-04-19T03:02:54.783 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2190000000000003e-06 2024-04-19T03:02:54.783 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:54.783 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:54.784 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:54.784 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:54.757192+0000", 2024-04-19T03:02:54.784 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.7550000000000006e-06 2024-04-19T03:02:54.784 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:54.784 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:54.784 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:54.784 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:54.757199+0000", 2024-04-19T03:02:54.784 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.9229999999999996e-06 2024-04-19T03:02:54.784 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:54.784 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:54.784 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:54.784 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:54.757227+0000", 2024-04-19T03:02:54.784 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.8177000000000001e-05 2024-04-19T03:02:54.784 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:54.784 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:54.785 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:54.785 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:54.757297+0000", 2024-04-19T03:02:54.785 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0013999999999997e-05 2024-04-19T03:02:54.785 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:54.785 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:54.785 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:54.785 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:54.785 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:54.785 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:149947 5.1 5:835376ae:::benchmark_data_smithi096_19531_object36497:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T03:02:54.785 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:54.757210+0000", 2024-04-19T03:02:54.785 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.003875964, 2024-04-19T03:02:54.785 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0042284250000000001, 2024-04-19T03:02:54.785 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:54.785 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-04-19T03:02:54.786 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:54.786 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:54.786 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:54.786 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 149947 2024-04-19T03:02:54.786 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:54.786 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:54.786 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:54.786 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:54.786 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:54.757210+0000", 2024-04-19T03:02:54.786 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:54.786 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:54.786 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:54.786 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:54.786 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:54.757210+0000", 2024-04-19T03:02:54.787 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:54.787 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:54.787 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:54.787 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:54.787 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:54.757209+0000", 2024-04-19T03:02:54.787 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:54.787 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:54.787 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:54.787 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:54.787 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:54.757212+0000", 2024-04-19T03:02:54.787 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7939999999999998e-06 2024-04-19T03:02:54.787 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:54.787 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:54.787 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:54.788 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:54.757218+0000", 2024-04-19T03:02:54.788 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8359999999999997e-06 2024-04-19T03:02:54.788 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:54.788 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:54.788 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:54.788 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:54.757224+0000", 2024-04-19T03:02:54.788 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8760000000000002e-06 2024-04-19T03:02:54.788 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:54.788 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:54.788 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:54.788 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:54.759026+0000", 2024-04-19T03:02:54.788 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001802321 2024-04-19T03:02:54.788 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:54.788 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:54.788 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:54.789 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:54.759157+0000", 2024-04-19T03:02:54.789 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000130519 2024-04-19T03:02:54.789 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:54.789 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:54.789 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:54.789 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:54.789 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:54.789 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:149948 5.1 5:8714d49b:::benchmark_data_smithi096_19531_object36498:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T03:02:54.789 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:54.758388+0000", 2024-04-19T03:02:54.789 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.002697797, 2024-04-19T03:02:54.789 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0031071060000000001, 2024-04-19T03:02:54.789 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:54.789 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-04-19T03:02:54.789 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:54.790 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:54.790 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:54.790 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 149948 2024-04-19T03:02:54.790 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:54.790 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:54.790 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:54.790 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:54.790 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:54.758388+0000", 2024-04-19T03:02:54.790 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:54.790 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:54.791 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:54.791 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:54.791 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:54.758388+0000", 2024-04-19T03:02:54.791 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:54.791 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:54.791 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:54.791 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:54.791 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:54.758387+0000", 2024-04-19T03:02:54.791 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:54.791 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:54.791 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:54.791 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:54.791 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:54.758391+0000", 2024-04-19T03:02:54.792 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1370000000000004e-06 2024-04-19T03:02:54.792 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:54.792 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:54.792 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:54.792 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:54.758400+0000", 2024-04-19T03:02:54.792 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.8230000000000001e-06 2024-04-19T03:02:54.792 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:54.792 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:54.792 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:54.792 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:54.758406+0000", 2024-04-19T03:02:54.792 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2430000000000002e-06 2024-04-19T03:02:54.792 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:54.792 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:54.793 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:54.793 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:54.761225+0000", 2024-04-19T03:02:54.793 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0028185660000000002 2024-04-19T03:02:54.793 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:54.793 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:54.793 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:54.793 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:54.761373+0000", 2024-04-19T03:02:54.793 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000148121 2024-04-19T03:02:54.793 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:54.793 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:54.793 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:54.793 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:54.793 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:54.793 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:149949 5.9 5:961d9df9:::benchmark_data_smithi096_19531_object36499:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T03:02:54.794 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:54.759395+0000", 2024-04-19T03:02:54.794 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0016909379999999999, 2024-04-19T03:02:54.794 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.002163136, 2024-04-19T03:02:54.794 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:54.794 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:02:54.794 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:54.794 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:54.794 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:54.794 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 149949 2024-04-19T03:02:54.794 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:54.794 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:54.794 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:54.794 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:54.795 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:54.759395+0000", 2024-04-19T03:02:54.795 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:54.795 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:54.795 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:54.795 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:54.795 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:54.759395+0000", 2024-04-19T03:02:54.795 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:54.795 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:54.795 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:54.795 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:54.795 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:54.759394+0000", 2024-04-19T03:02:54.795 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:54.795 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:54.795 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:54.796 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:54.796 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:54.759398+0000", 2024-04-19T03:02:54.796 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3780000000000003e-06 2024-04-19T03:02:54.796 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:54.796 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:54.796 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:54.796 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:54.759405+0000", 2024-04-19T03:02:54.796 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.63e-06 2024-04-19T03:02:54.796 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:54.796 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:54.796 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:54.796 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:54.759410+0000", 2024-04-19T03:02:54.796 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6609999999999999e-06 2024-04-19T03:02:54.796 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:54.797 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:54.797 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:54.797 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:54.761214+0000", 2024-04-19T03:02:54.797 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0018041439999999999 2024-04-19T03:02:54.797 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:54.797 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:54.797 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:54.797 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:54.761379+0000", 2024-04-19T03:02:54.797 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00016556399999999999 2024-04-19T03:02:54.797 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:54.797 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:54.797 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:02:54.797 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:54.761494+0000", 2024-04-19T03:02:54.797 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000114597 2024-04-19T03:02:54.798 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:54.798 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:54.798 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:54.798 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:54.798 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:54.798 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:149950 5.6 5:6f498c68:::benchmark_data_smithi096_19531_object36500:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T03:02:54.798 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:54.759622+0000", 2024-04-19T03:02:54.798 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.001463902, 2024-04-19T03:02:54.798 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0019991950000000001, 2024-04-19T03:02:54.798 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:54.798 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-04-19T03:02:54.798 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:54.798 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:54.799 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:54.799 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 149950 2024-04-19T03:02:54.799 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:54.799 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:54.799 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:54.799 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:54.799 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:54.759622+0000", 2024-04-19T03:02:54.799 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:54.799 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:54.799 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:54.799 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:54.799 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:54.759622+0000", 2024-04-19T03:02:54.799 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:54.799 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:54.800 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:54.800 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:54.800 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:54.759621+0000", 2024-04-19T03:02:54.800 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:54.800 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:54.800 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:54.800 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:54.800 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:54.759625+0000", 2024-04-19T03:02:54.800 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.625e-06 2024-04-19T03:02:54.800 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:54.800 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:54.800 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:54.800 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:54.759632+0000", 2024-04-19T03:02:54.800 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8029999999999997e-06 2024-04-19T03:02:54.801 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:54.801 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:54.801 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:54.801 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:54.759637+0000", 2024-04-19T03:02:54.801 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.622e-06 2024-04-19T03:02:54.801 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:54.801 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:54.801 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:54.802 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:54.759680+0000", 2024-04-19T03:02:54.802 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3256000000000001e-05 2024-04-19T03:02:54.802 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:54.802 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:54.802 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:54.802 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:54.759777+0000", 2024-04-19T03:02:54.802 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.6651999999999996e-05 2024-04-19T03:02:54.802 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:54.802 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:54.802 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:54.802 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:54.802 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:54.802 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:149951 5.3 5:cf8bb8e3:::benchmark_data_smithi096_19531_object36501:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T03:02:54.803 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:54.759851+0000", 2024-04-19T03:02:54.803 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.001235026, 2024-04-19T03:02:54.803 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0018271819999999999, 2024-04-19T03:02:54.803 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:54.803 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-04-19T03:02:54.803 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:54.803 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:54.803 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:54.803 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 149951 2024-04-19T03:02:54.803 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:54.803 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:54.803 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:54.803 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:54.803 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:54.759851+0000", 2024-04-19T03:02:54.803 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:54.804 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:54.804 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:54.804 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:54.804 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:54.759851+0000", 2024-04-19T03:02:54.804 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:54.804 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:54.804 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:54.804 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:54.804 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:54.759850+0000", 2024-04-19T03:02:54.804 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:54.804 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:54.804 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:54.804 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:54.804 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:54.759854+0000", 2024-04-19T03:02:54.805 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1150000000000004e-06 2024-04-19T03:02:54.805 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:54.805 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:54.805 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:54.805 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:54.759861+0000", 2024-04-19T03:02:54.805 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.3780000000000003e-06 2024-04-19T03:02:54.805 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:54.805 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:54.805 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:54.805 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:54.759868+0000", 2024-04-19T03:02:54.805 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2269999999999998e-06 2024-04-19T03:02:54.805 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:54.805 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:54.805 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:54.806 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:54.759915+0000", 2024-04-19T03:02:54.806 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7704999999999998e-05 2024-04-19T03:02:54.806 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:54.806 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:54.806 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:54.806 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:54.760062+0000", 2024-04-19T03:02:54.806 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000146484 2024-04-19T03:02:54.806 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:54.806 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:54.806 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:54.806 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:54.806 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:54.806 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:149952 5.1 5.5725a071 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T03:02:54.807 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:54.760021+0000", 2024-04-19T03:02:54.807 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0010643499999999999, 2024-04-19T03:02:54.807 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001710544, 2024-04-19T03:02:54.807 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:54.807 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-04-19T03:02:54.807 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:54.807 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:54.807 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:54.807 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 149952 2024-04-19T03:02:54.807 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:54.807 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:54.807 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:54.807 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:54.807 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:54.760021+0000", 2024-04-19T03:02:54.808 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:54.808 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:54.808 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:54.808 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:54.808 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:54.760021+0000", 2024-04-19T03:02:54.808 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:54.808 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:54.808 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:54.808 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:54.808 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:54.760021+0000", 2024-04-19T03:02:54.808 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:54.808 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:54.808 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:54.809 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:54.809 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:54.760024+0000", 2024-04-19T03:02:54.809 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6040000000000001e-06 2024-04-19T03:02:54.809 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:54.809 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:54.809 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:54.809 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:54.760030+0000", 2024-04-19T03:02:54.809 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3299999999999998e-06 2024-04-19T03:02:54.809 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:54.809 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:54.809 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:54.809 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:54.760033+0000", 2024-04-19T03:02:54.809 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8240000000000001e-06 2024-04-19T03:02:54.809 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:54.810 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:54.810 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:54.810 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:54.810 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:54.810 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:149953 5.9 5.1e09dd9 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T03:02:54.810 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:54.760037+0000", 2024-04-19T03:02:54.810 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0010486849999999999, 2024-04-19T03:02:54.810 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0017399029999999999, 2024-04-19T03:02:54.810 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:54.810 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-04-19T03:02:54.810 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:54.810 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:54.810 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:54.811 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 149953 2024-04-19T03:02:54.811 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:54.811 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:54.811 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:54.811 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:54.811 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:54.760037+0000", 2024-04-19T03:02:54.811 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:54.811 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:54.812 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:54.812 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:54.812 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:54.760037+0000", 2024-04-19T03:02:54.812 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:54.812 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:54.812 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:54.812 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:54.812 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:54.760037+0000", 2024-04-19T03:02:54.812 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:54.812 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:54.812 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:54.812 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:54.812 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:54.760038+0000", 2024-04-19T03:02:54.813 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.595e-06 2024-04-19T03:02:54.813 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:54.813 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:54.813 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:54.813 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:54.760041+0000", 2024-04-19T03:02:54.813 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0369999999999999e-06 2024-04-19T03:02:54.813 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:54.813 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:54.813 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:54.813 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:54.760044+0000", 2024-04-19T03:02:54.813 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5359999999999999e-06 2024-04-19T03:02:54.813 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:54.813 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:54.813 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:54.813 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:54.814 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:54.814 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:149954 5.7 5:e08681d6:::benchmark_data_smithi096_19531_object36504:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T03:02:54.814 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:54.760053+0000", 2024-04-19T03:02:54.814 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.001032191, 2024-04-19T03:02:54.814 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0017708190000000001, 2024-04-19T03:02:54.814 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:54.814 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-04-19T03:02:54.814 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:54.814 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:54.814 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:54.814 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 149954 2024-04-19T03:02:54.814 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:54.814 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:54.815 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:54.815 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:54.815 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:54.760053+0000", 2024-04-19T03:02:54.815 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:54.815 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:54.815 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:54.815 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:54.815 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:54.760053+0000", 2024-04-19T03:02:54.815 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:54.815 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:54.815 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:54.815 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:54.815 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:54.760053+0000", 2024-04-19T03:02:54.816 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:54.816 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:54.816 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:54.816 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:54.816 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:54.760055+0000", 2024-04-19T03:02:54.816 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.88e-06 2024-04-19T03:02:54.816 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:54.816 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:54.816 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:54.816 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:54.760058+0000", 2024-04-19T03:02:54.816 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.348e-06 2024-04-19T03:02:54.816 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:54.816 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:54.816 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:54.816 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:54.760061+0000", 2024-04-19T03:02:54.817 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.6469999999999998e-06 2024-04-19T03:02:54.817 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:54.817 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:54.817 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:54.817 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:54.760099+0000", 2024-04-19T03:02:54.817 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8454999999999997e-05 2024-04-19T03:02:54.817 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:54.817 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:54.817 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:54.817 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:54.760193+0000", 2024-04-19T03:02:54.817 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.3084000000000005e-05 2024-04-19T03:02:54.817 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:54.817 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:54.817 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:54.818 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:54.818 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:54.818 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:149955 5.2 5:471b8a65:::benchmark_data_smithi096_19531_object36505:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2024-04-19T03:02:54.818 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:54.760281+0000", 2024-04-19T03:02:54.818 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.00080457300000000005, 2024-04-19T03:02:54.818 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0016000330000000001, 2024-04-19T03:02:54.818 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:54.818 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-04-19T03:02:54.818 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:54.818 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:54.818 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:54.818 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 149955 2024-04-19T03:02:54.818 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:54.819 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:54.819 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:54.819 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:54.819 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:54.760281+0000", 2024-04-19T03:02:54.819 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:54.819 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:54.819 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:54.819 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:54.819 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:54.760281+0000", 2024-04-19T03:02:54.819 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:54.819 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:54.819 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:54.819 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:54.819 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:54.760280+0000", 2024-04-19T03:02:54.820 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:54.820 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:54.820 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:54.820 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:54.820 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:54.760285+0000", 2024-04-19T03:02:54.820 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7550000000000002e-06 2024-04-19T03:02:54.820 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:54.820 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:54.820 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:54.820 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:54.760293+0000", 2024-04-19T03:02:54.820 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8490000000000006e-06 2024-04-19T03:02:54.820 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:54.820 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:54.820 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:54.821 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:54.760299+0000", 2024-04-19T03:02:54.821 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.511e-06 2024-04-19T03:02:54.821 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:54.821 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:54.821 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:54.821 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:54.760349+0000", 2024-04-19T03:02:54.821 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0018999999999997e-05 2024-04-19T03:02:54.821 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:54.821 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:54.821 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:54.821 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:54.760494+0000", 2024-04-19T03:02:54.821 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00014464299999999999 2024-04-19T03:02:54.822 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:54.822 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:54.822 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:54.822 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:54.822 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-04-19T03:02:54.822 INFO:teuthology.orchestra.run.smithi144.stdout: "num_ops": 14 2024-04-19T03:02:54.822 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-04-19T03:02:54.823 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T03:02:54.834 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:54.831+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:54.935 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:54.931+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:54.948 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-04-19T03:02:54.948 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2024-04-19T03:02:54.948 INFO:teuthology.orchestra.run.smithi144.stdout: "complaint_time": 30, 2024-04-19T03:02:54.948 INFO:teuthology.orchestra.run.smithi144.stdout: "num_blocked_ops": 0 2024-04-19T03:02:54.948 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-04-19T03:02:54.962 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T03:02:55.036 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:55.034+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:55.094 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-04-19T03:02:55.094 INFO:teuthology.orchestra.run.smithi144.stdout: "size": 20, 2024-04-19T03:02:55.094 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 600, 2024-04-19T03:02:55.094 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [ 2024-04-19T03:02:55.094 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.094 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:78992 5.7 5:e6baa862:::benchmark_data_smithi096_19531_object78991:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-19T03:02:55.094 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:18.008888+0000", 2024-04-19T03:02:55.094 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 37.082708668000002, 2024-04-19T03:02:55.095 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.056375285999999997, 2024-04-19T03:02:55.095 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:55.095 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:55.095 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:55.095 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:55.095 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:55.095 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 78992 2024-04-19T03:02:55.095 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.095 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:55.095 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.095 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:55.095 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.008888+0000", 2024-04-19T03:02:55.095 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:55.095 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.096 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.096 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:55.096 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.008888+0000", 2024-04-19T03:02:55.096 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:55.096 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.096 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.096 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:55.096 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.008888+0000", 2024-04-19T03:02:55.096 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:55.096 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.096 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.096 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:55.096 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.008928+0000", 2024-04-19T03:02:55.097 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0361999999999997e-05 2024-04-19T03:02:55.097 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.097 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.097 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:55.097 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.008942+0000", 2024-04-19T03:02:55.097 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4365000000000001e-05 2024-04-19T03:02:55.097 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.097 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.097 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:55.097 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.008949+0000", 2024-04-19T03:02:55.097 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.212e-06 2024-04-19T03:02:55.097 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.097 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.097 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:55.098 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.012683+0000", 2024-04-19T03:02:55.098 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.003733934 2024-04-19T03:02:55.098 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.098 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.098 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:55.098 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.012798+0000", 2024-04-19T03:02:55.098 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00011574999999999999 2024-04-19T03:02:55.098 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.098 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.098 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:55.098 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.012896+0000", 2024-04-19T03:02:55.098 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.7848000000000002e-05 2024-04-19T03:02:55.098 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.099 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.099 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:55.099 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016423+0000", 2024-04-19T03:02:55.099 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0035270789999999998 2024-04-19T03:02:55.099 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.099 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.099 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:55.099 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.065098+0000", 2024-04-19T03:02:55.099 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.048674651999999999 2024-04-19T03:02:55.099 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.099 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.099 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:55.099 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.065193+0000", 2024-04-19T03:02:55.099 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.5087999999999995e-05 2024-04-19T03:02:55.100 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.100 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.100 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:55.100 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.065264+0000", 2024-04-19T03:02:55.100 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0666000000000004e-05 2024-04-19T03:02:55.100 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:55.100 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:55.100 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:55.100 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.100 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.100 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:78998 5.7 5:ee23c1bc:::benchmark_data_smithi096_19531_object78997:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-19T03:02:55.100 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:18.013165+0000", 2024-04-19T03:02:55.100 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 37.078431962000003, 2024-04-19T03:02:55.100 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.052410864000000001, 2024-04-19T03:02:55.101 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:55.101 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:55.101 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:55.101 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:55.101 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:55.101 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 78998 2024-04-19T03:02:55.101 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.101 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:55.101 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.101 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:55.101 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.013165+0000", 2024-04-19T03:02:55.101 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:55.101 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.101 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.102 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:55.102 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.013165+0000", 2024-04-19T03:02:55.102 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:55.102 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.102 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.102 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:55.102 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.013164+0000", 2024-04-19T03:02:55.102 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:55.102 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.102 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.102 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:55.102 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.013214+0000", 2024-04-19T03:02:55.102 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9636999999999999e-05 2024-04-19T03:02:55.102 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.103 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.103 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:55.103 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.013223+0000", 2024-04-19T03:02:55.103 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.3619999999999995e-06 2024-04-19T03:02:55.103 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.103 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.103 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:55.103 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.013229+0000", 2024-04-19T03:02:55.103 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6060000000000002e-06 2024-04-19T03:02:55.103 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.103 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.103 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:55.103 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.014882+0000", 2024-04-19T03:02:55.103 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001653257 2024-04-19T03:02:55.104 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.104 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.104 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:55.104 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.014958+0000", 2024-04-19T03:02:55.104 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6398999999999998e-05 2024-04-19T03:02:55.104 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.104 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.104 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:55.104 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.015036+0000", 2024-04-19T03:02:55.104 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8070000000000003e-05 2024-04-19T03:02:55.104 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.104 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.104 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:55.104 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018099+0000", 2024-04-19T03:02:55.104 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0030631149999999999 2024-04-19T03:02:55.105 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.105 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.105 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:55.105 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.065328+0000", 2024-04-19T03:02:55.105 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.047228349000000003 2024-04-19T03:02:55.105 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.105 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.105 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:55.105 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.065508+0000", 2024-04-19T03:02:55.105 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00018036899999999999 2024-04-19T03:02:55.105 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.105 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.105 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:55.105 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.065576+0000", 2024-04-19T03:02:55.106 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7785000000000002e-05 2024-04-19T03:02:55.106 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:55.106 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:55.106 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:55.106 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.106 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.106 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4755.0:78995 5.2 e40/39 5:42b55e12:::benchmark_data_smithi096_19531_object78994:head v 40'4934, mlcod=40'4932)", 2024-04-19T03:02:55.106 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:18.016247+0000", 2024-04-19T03:02:55.106 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 37.07535, 2024-04-19T03:02:55.106 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.056240406, 2024-04-19T03:02:55.106 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:55.107 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:55.107 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:55.107 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.107 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:55.107 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016247+0000", 2024-04-19T03:02:55.107 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:55.107 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.107 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.107 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:55.107 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016247+0000", 2024-04-19T03:02:55.107 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:55.107 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.109 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.109 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:55.109 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016246+0000", 2024-04-19T03:02:55.109 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:55.109 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.109 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.109 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:55.109 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016315+0000", 2024-04-19T03:02:55.109 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8979000000000005e-05 2024-04-19T03:02:55.109 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.109 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.110 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:55.110 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016333+0000", 2024-04-19T03:02:55.110 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7586999999999999e-05 2024-04-19T03:02:55.110 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.110 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.110 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:55.110 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016340+0000", 2024-04-19T03:02:55.110 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4080000000000001e-06 2024-04-19T03:02:55.110 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.110 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.110 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:55.110 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016384+0000", 2024-04-19T03:02:55.110 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3656999999999999e-05 2024-04-19T03:02:55.111 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.111 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.111 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:55.111 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016403+0000", 2024-04-19T03:02:55.111 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9089e-05 2024-04-19T03:02:55.111 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.111 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.111 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:55.111 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.072448+0000", 2024-04-19T03:02:55.111 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.056045084000000002 2024-04-19T03:02:55.111 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.111 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.111 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:55.111 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.072487+0000", 2024-04-19T03:02:55.112 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9362e-05 2024-04-19T03:02:55.112 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:55.112 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:55.112 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:55.112 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.112 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.112 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4755.0:78994 5.c e40/22 5:3c60d55d:::benchmark_data_smithi096_19531_object78993:head v 40'4989, mlcod=40'4987)", 2024-04-19T03:02:55.112 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:18.016392+0000", 2024-04-19T03:02:55.112 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 37.075205359000002, 2024-04-19T03:02:55.112 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.052629620000000002, 2024-04-19T03:02:55.112 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:55.112 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:55.112 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:55.112 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.113 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:55.113 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016392+0000", 2024-04-19T03:02:55.113 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:55.113 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.113 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.113 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:55.113 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016392+0000", 2024-04-19T03:02:55.113 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:55.113 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.113 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.113 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:55.113 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016391+0000", 2024-04-19T03:02:55.113 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:55.113 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.114 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.114 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:55.114 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016471+0000", 2024-04-19T03:02:55.114 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9346999999999998e-05 2024-04-19T03:02:55.114 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.114 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.114 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:55.114 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016478+0000", 2024-04-19T03:02:55.114 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.593e-06 2024-04-19T03:02:55.114 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.114 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.114 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:55.114 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016495+0000", 2024-04-19T03:02:55.114 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6492999999999999e-05 2024-04-19T03:02:55.115 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.115 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.115 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:55.115 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016539+0000", 2024-04-19T03:02:55.115 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4715999999999997e-05 2024-04-19T03:02:55.115 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.115 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.115 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:55.115 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016551+0000", 2024-04-19T03:02:55.115 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2096000000000001e-05 2024-04-19T03:02:55.115 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.115 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.115 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:55.115 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.068985+0000", 2024-04-19T03:02:55.116 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.052433754999999999 2024-04-19T03:02:55.116 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.116 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.116 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:55.116 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.069021+0000", 2024-04-19T03:02:55.116 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6047000000000002e-05 2024-04-19T03:02:55.116 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:55.116 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:55.116 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:55.116 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.116 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.116 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4755.0:78996 5.1 e40/39 5:87f59708:::benchmark_data_smithi096_19531_object78995:head v 40'4940, mlcod=40'4938)", 2024-04-19T03:02:55.116 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:18.016581+0000", 2024-04-19T03:02:55.116 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 37.075016194, 2024-04-19T03:02:55.117 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.052051785000000003, 2024-04-19T03:02:55.117 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:55.117 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:55.117 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:55.117 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.117 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:55.117 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016581+0000", 2024-04-19T03:02:55.117 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:55.117 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.117 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.117 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:55.117 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016581+0000", 2024-04-19T03:02:55.117 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:55.117 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.118 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.118 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:55.118 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016581+0000", 2024-04-19T03:02:55.118 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:55.118 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.118 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.118 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:55.118 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016610+0000", 2024-04-19T03:02:55.118 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9556999999999998e-05 2024-04-19T03:02:55.118 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.118 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.118 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:55.118 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016616+0000", 2024-04-19T03:02:55.118 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1090000000000003e-06 2024-04-19T03:02:55.119 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.119 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.119 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:55.119 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016621+0000", 2024-04-19T03:02:55.119 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.454e-06 2024-04-19T03:02:55.119 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.119 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.119 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:55.119 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016663+0000", 2024-04-19T03:02:55.119 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2582e-05 2024-04-19T03:02:55.119 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.119 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.119 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:55.119 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016681+0000", 2024-04-19T03:02:55.120 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7680999999999999e-05 2024-04-19T03:02:55.120 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.120 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.120 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:55.120 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.068486+0000", 2024-04-19T03:02:55.120 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.051804624000000001 2024-04-19T03:02:55.120 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.120 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.120 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:55.120 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.068633+0000", 2024-04-19T03:02:55.120 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00014709099999999999 2024-04-19T03:02:55.120 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:55.120 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:55.120 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:55.121 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.121 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.121 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4755.0:78999 5.3 e40/22 5:c9ec5f7f:::benchmark_data_smithi096_19531_object78998:head v 40'4893, mlcod=40'4889)", 2024-04-19T03:02:55.121 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:18.016633+0000", 2024-04-19T03:02:55.121 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 37.074964338999997, 2024-04-19T03:02:55.121 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.051090469999999999, 2024-04-19T03:02:55.121 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:55.121 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:55.121 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:55.121 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.121 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:55.121 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016633+0000", 2024-04-19T03:02:55.121 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:55.121 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.121 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.122 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:55.122 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016633+0000", 2024-04-19T03:02:55.122 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:55.122 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.122 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.122 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:55.122 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016632+0000", 2024-04-19T03:02:55.122 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967296 2024-04-19T03:02:55.122 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.122 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.122 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:55.122 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016660+0000", 2024-04-19T03:02:55.122 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7869999999999999e-05 2024-04-19T03:02:55.123 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.123 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.123 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:55.123 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016667+0000", 2024-04-19T03:02:55.123 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0280000000000003e-06 2024-04-19T03:02:55.123 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.123 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.123 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:55.123 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016672+0000", 2024-04-19T03:02:55.123 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0069999999999997e-06 2024-04-19T03:02:55.123 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.123 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.123 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:55.124 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016725+0000", 2024-04-19T03:02:55.124 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2812000000000002e-05 2024-04-19T03:02:55.124 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.124 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.124 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:55.124 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016750+0000", 2024-04-19T03:02:55.124 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5038e-05 2024-04-19T03:02:55.124 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.124 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.124 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:55.124 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.067673+0000", 2024-04-19T03:02:55.124 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.050922350999999998 2024-04-19T03:02:55.124 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.124 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.125 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:55.125 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.067723+0000", 2024-04-19T03:02:55.125 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0586e-05 2024-04-19T03:02:55.125 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:55.125 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:55.125 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:55.125 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.125 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.125 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4755.0:79003 5.2 e40/39 5:4436e33f:::benchmark_data_smithi096_19531_object79002:head v 40'4935, mlcod=40'4932)", 2024-04-19T03:02:55.125 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:18.018102+0000", 2024-04-19T03:02:55.125 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 37.073494611999998, 2024-04-19T03:02:55.125 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.060023990999999999, 2024-04-19T03:02:55.125 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:55.125 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:55.126 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:55.126 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.126 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:55.126 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018102+0000", 2024-04-19T03:02:55.126 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:55.126 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.126 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.126 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:55.126 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018102+0000", 2024-04-19T03:02:55.126 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:55.126 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.126 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.126 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:55.126 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018102+0000", 2024-04-19T03:02:55.127 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:55.127 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.127 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.127 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:55.127 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018134+0000", 2024-04-19T03:02:55.127 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2722000000000003e-05 2024-04-19T03:02:55.127 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.127 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.127 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:55.127 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018145+0000", 2024-04-19T03:02:55.127 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0395e-05 2024-04-19T03:02:55.127 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.127 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.128 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:55.128 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018151+0000", 2024-04-19T03:02:55.128 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5300000000000002e-06 2024-04-19T03:02:55.128 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.128 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.128 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:55.128 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018489+0000", 2024-04-19T03:02:55.128 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00033731499999999998 2024-04-19T03:02:55.128 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.128 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.128 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:55.128 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018508+0000", 2024-04-19T03:02:55.128 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9775e-05 2024-04-19T03:02:55.128 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.129 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.129 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:55.129 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.078059+0000", 2024-04-19T03:02:55.129 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.059550171999999998 2024-04-19T03:02:55.129 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.129 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.129 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:55.129 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.078126+0000", 2024-04-19T03:02:55.129 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7773000000000003e-05 2024-04-19T03:02:55.129 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:55.129 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:55.129 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:55.129 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.129 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.130 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4755.0:79005 5.1 e40/39 5:85b46038:::benchmark_data_smithi096_19531_object79004:head v 40'4941, mlcod=40'4938)", 2024-04-19T03:02:55.130 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:18.018167+0000", 2024-04-19T03:02:55.130 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 37.073429892999997, 2024-04-19T03:02:55.130 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.052768941999999999, 2024-04-19T03:02:55.130 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:55.130 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:55.130 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:55.130 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.130 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:55.130 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018167+0000", 2024-04-19T03:02:55.130 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:55.130 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.130 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.131 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:55.131 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018167+0000", 2024-04-19T03:02:55.131 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:55.131 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.131 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.131 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:55.131 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018167+0000", 2024-04-19T03:02:55.131 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:55.131 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.131 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.131 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:55.132 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018196+0000", 2024-04-19T03:02:55.132 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9538000000000001e-05 2024-04-19T03:02:55.132 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.132 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.132 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:55.132 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018204+0000", 2024-04-19T03:02:55.132 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2599999999999999e-06 2024-04-19T03:02:55.132 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.132 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.132 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:55.132 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018208+0000", 2024-04-19T03:02:55.133 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8080000000000004e-06 2024-04-19T03:02:55.133 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.133 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.133 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:55.133 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.064933+0000", 2024-04-19T03:02:55.133 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.046725048999999998 2024-04-19T03:02:55.133 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.133 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.133 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:55.133 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.064964+0000", 2024-04-19T03:02:55.133 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0577000000000002e-05 2024-04-19T03:02:55.133 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.133 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.133 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:55.134 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.070815+0000", 2024-04-19T03:02:55.134 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0058510649999999999 2024-04-19T03:02:55.134 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.134 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.134 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:55.134 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.070936+0000", 2024-04-19T03:02:55.134 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00012095399999999999 2024-04-19T03:02:55.134 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:55.134 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:55.134 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:55.134 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.134 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.134 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:86612 5.7 5:e32e3c49:::benchmark_data_smithi096_19531_object86611:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:55.134 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:22.633560+0000", 2024-04-19T03:02:55.135 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 32.458036952, 2024-04-19T03:02:55.135 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.19135289, 2024-04-19T03:02:55.135 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:55.135 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:55.135 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:55.135 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:55.135 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:55.135 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 86612 2024-04-19T03:02:55.135 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.135 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:55.135 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.135 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:55.135 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633560+0000", 2024-04-19T03:02:55.135 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:55.135 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.136 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.136 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:55.136 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633560+0000", 2024-04-19T03:02:55.136 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:55.136 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.136 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.136 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:55.136 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633558+0000", 2024-04-19T03:02:55.136 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:55.136 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.136 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.136 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:55.136 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633609+0000", 2024-04-19T03:02:55.136 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0850999999999998e-05 2024-04-19T03:02:55.137 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.137 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.137 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:55.137 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633627+0000", 2024-04-19T03:02:55.137 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7951000000000001e-05 2024-04-19T03:02:55.137 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.137 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.137 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:55.137 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633635+0000", 2024-04-19T03:02:55.137 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2530000000000004e-06 2024-04-19T03:02:55.137 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.137 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.137 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:55.137 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633699+0000", 2024-04-19T03:02:55.138 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3901999999999999e-05 2024-04-19T03:02:55.138 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.138 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.138 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:55.138 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633992+0000", 2024-04-19T03:02:55.138 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00029283299999999999 2024-04-19T03:02:55.138 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.138 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.138 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:55.138 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.634223+0000", 2024-04-19T03:02:55.138 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00023084200000000001 2024-04-19T03:02:55.138 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.138 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.139 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:55.139 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.639085+0000", 2024-04-19T03:02:55.139 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0048624269999999999 2024-04-19T03:02:55.139 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.139 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.139 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:55.139 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.824635+0000", 2024-04-19T03:02:55.139 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.18554944700000001 2024-04-19T03:02:55.139 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.139 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.139 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:55.139 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.824793+0000", 2024-04-19T03:02:55.139 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000157959 2024-04-19T03:02:55.139 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.140 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.140 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:55.140 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.824913+0000", 2024-04-19T03:02:55.140 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000120093 2024-04-19T03:02:55.140 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:55.140 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:55.140 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:55.140 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.140 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.140 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:86625 5.7 5:e6d00488:::benchmark_data_smithi096_19531_object86624:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:55.140 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:22.643554+0000", 2024-04-19T03:02:55.140 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 32.448043186, 2024-04-19T03:02:55.140 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.18732841, 2024-04-19T03:02:55.140 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:55.141 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:55.141 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:55.141 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:55.141 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:55.141 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 86625 2024-04-19T03:02:55.141 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.141 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:55.141 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.141 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:55.141 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643554+0000", 2024-04-19T03:02:55.141 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:55.141 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.141 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.141 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:55.142 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643554+0000", 2024-04-19T03:02:55.142 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:55.142 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.142 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.142 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:55.142 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643552+0000", 2024-04-19T03:02:55.142 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:55.142 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.142 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.142 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:55.142 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643588+0000", 2024-04-19T03:02:55.142 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5855999999999997e-05 2024-04-19T03:02:55.142 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.143 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.143 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:55.143 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643606+0000", 2024-04-19T03:02:55.143 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8226000000000001e-05 2024-04-19T03:02:55.143 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.143 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.143 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:55.143 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643618+0000", 2024-04-19T03:02:55.143 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1868000000000001e-05 2024-04-19T03:02:55.143 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.143 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.143 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:55.143 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643676+0000", 2024-04-19T03:02:55.143 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8153999999999999e-05 2024-04-19T03:02:55.144 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.144 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.144 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:55.144 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643905+0000", 2024-04-19T03:02:55.144 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00022847500000000001 2024-04-19T03:02:55.144 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.144 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.144 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:55.144 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.644150+0000", 2024-04-19T03:02:55.144 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00024531800000000001 2024-04-19T03:02:55.144 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.144 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.144 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:55.144 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.647407+0000", 2024-04-19T03:02:55.145 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0032563190000000001 2024-04-19T03:02:55.145 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.145 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.145 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:55.145 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.830721+0000", 2024-04-19T03:02:55.145 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.18331468300000001 2024-04-19T03:02:55.145 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.145 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.145 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:55.145 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.830813+0000", 2024-04-19T03:02:55.145 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.2205000000000002e-05 2024-04-19T03:02:55.145 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.145 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.145 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:55.146 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.830882+0000", 2024-04-19T03:02:55.146 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8819999999999995e-05 2024-04-19T03:02:55.146 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:55.146 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:55.146 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:55.146 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.146 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.146 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87063 5.7 5:e502e824:::benchmark_data_smithi096_19531_object87062:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:55.146 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.136067+0000", 2024-04-19T03:02:55.146 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 31.955530317000001, 2024-04-19T03:02:55.146 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.065521159999999995, 2024-04-19T03:02:55.146 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:55.146 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:55.147 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:55.147 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:55.147 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:55.147 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87063 2024-04-19T03:02:55.147 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.147 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:55.147 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.147 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:55.147 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.136067+0000", 2024-04-19T03:02:55.147 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:55.147 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.147 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.147 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:55.147 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.136067+0000", 2024-04-19T03:02:55.148 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:55.148 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.148 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.148 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:55.148 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.136066+0000", 2024-04-19T03:02:55.148 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:55.148 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.148 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.148 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:55.148 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.136154+0000", 2024-04-19T03:02:55.148 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.8256000000000003e-05 2024-04-19T03:02:55.148 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.148 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.148 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:55.149 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.136162+0000", 2024-04-19T03:02:55.149 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.5099999999999998e-06 2024-04-19T03:02:55.149 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.149 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.149 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:55.149 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.136171+0000", 2024-04-19T03:02:55.149 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2830000000000001e-06 2024-04-19T03:02:55.149 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.149 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.149 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:55.149 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.138421+0000", 2024-04-19T03:02:55.149 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0022506620000000001 2024-04-19T03:02:55.149 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.149 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.149 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:55.150 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.138560+0000", 2024-04-19T03:02:55.150 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000138446 2024-04-19T03:02:55.150 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.150 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.150 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:55.150 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.138689+0000", 2024-04-19T03:02:55.150 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00012950700000000001 2024-04-19T03:02:55.150 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.150 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.150 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:55.150 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.141517+0000", 2024-04-19T03:02:55.150 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0028280860000000001 2024-04-19T03:02:55.150 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.151 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.151 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:55.151 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.201350+0000", 2024-04-19T03:02:55.151 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.059832418999999998 2024-04-19T03:02:55.151 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.151 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.151 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:55.151 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.201485+0000", 2024-04-19T03:02:55.151 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000135597 2024-04-19T03:02:55.151 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.151 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.151 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:55.151 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.201588+0000", 2024-04-19T03:02:55.152 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00010247900000000001 2024-04-19T03:02:55.152 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:55.152 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:55.152 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:55.152 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.152 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.152 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87072 5.7 5:e3c7809a:::benchmark_data_smithi096_19531_object87071:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:55.152 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.144224+0000", 2024-04-19T03:02:55.152 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 31.947373292999998, 2024-04-19T03:02:55.152 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.058179555000000001, 2024-04-19T03:02:55.152 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:55.152 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:55.152 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:55.152 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:55.153 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:55.153 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87072 2024-04-19T03:02:55.153 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.153 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:55.153 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.153 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:55.153 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144224+0000", 2024-04-19T03:02:55.153 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:55.153 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.153 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.153 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:55.153 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144224+0000", 2024-04-19T03:02:55.153 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:55.153 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.153 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.154 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:55.154 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144223+0000", 2024-04-19T03:02:55.154 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:55.154 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.154 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.154 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:55.154 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144320+0000", 2024-04-19T03:02:55.154 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.7075000000000001e-05 2024-04-19T03:02:55.154 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.154 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.154 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:55.154 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144331+0000", 2024-04-19T03:02:55.154 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1342000000000001e-05 2024-04-19T03:02:55.155 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.155 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.155 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:55.155 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144337+0000", 2024-04-19T03:02:55.155 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8390000000000003e-06 2024-04-19T03:02:55.155 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.155 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.155 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:55.155 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144369+0000", 2024-04-19T03:02:55.155 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2079000000000002e-05 2024-04-19T03:02:55.155 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.155 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.155 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:55.156 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144464+0000", 2024-04-19T03:02:55.156 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.4623000000000005e-05 2024-04-19T03:02:55.156 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.156 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.156 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:55.156 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144553+0000", 2024-04-19T03:02:55.156 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9171000000000004e-05 2024-04-19T03:02:55.156 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.156 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.156 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:55.156 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.147018+0000", 2024-04-19T03:02:55.156 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0024648370000000001 2024-04-19T03:02:55.156 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.156 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.157 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:55.157 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.202270+0000", 2024-04-19T03:02:55.157 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.055252018 2024-04-19T03:02:55.157 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.157 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.157 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:55.157 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.202356+0000", 2024-04-19T03:02:55.157 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6648000000000001e-05 2024-04-19T03:02:55.157 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.157 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.157 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:55.157 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.202403+0000", 2024-04-19T03:02:55.157 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6956999999999998e-05 2024-04-19T03:02:55.158 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:55.158 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:55.158 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:55.158 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.158 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.158 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87123 5.6 5:6d1bc3b9:::benchmark_data_smithi096_19531_object87122:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:02:55.158 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249233+0000", 2024-04-19T03:02:55.158 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 31.842364261, 2024-04-19T03:02:55.158 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0291700720000001, 2024-04-19T03:02:55.158 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:55.158 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-04-19T03:02:55.158 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:55.158 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:55.158 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:55.159 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87123 2024-04-19T03:02:55.159 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.159 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:55.159 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.159 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:55.159 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249233+0000", 2024-04-19T03:02:55.159 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:55.159 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.159 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.159 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:55.159 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249233+0000", 2024-04-19T03:02:55.159 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:55.159 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.159 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.160 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:55.160 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249231+0000", 2024-04-19T03:02:55.160 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:55.160 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.160 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.160 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:55.160 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249285+0000", 2024-04-19T03:02:55.160 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4005000000000002e-05 2024-04-19T03:02:55.160 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.160 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.160 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:55.160 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249300+0000", 2024-04-19T03:02:55.160 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4715999999999999e-05 2024-04-19T03:02:55.160 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.161 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.161 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:55.161 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249307+0000", 2024-04-19T03:02:55.161 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8399999999999997e-06 2024-04-19T03:02:55.161 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.161 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.161 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:55.161 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249366+0000", 2024-04-19T03:02:55.161 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9435999999999998e-05 2024-04-19T03:02:55.161 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.161 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.161 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op must wait for map", 2024-04-19T03:02:55.161 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249376+0000", 2024-04-19T03:02:55.162 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.4919999999999999e-06 2024-04-19T03:02:55.162 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.162 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.162 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:55.162 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263757+0000", 2024-04-19T03:02:55.162 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.014381461999999999 2024-04-19T03:02:55.162 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.162 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.162 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:02:55.162 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263875+0000", 2024-04-19T03:02:55.162 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000117166 2024-04-19T03:02:55.162 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.162 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.163 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:55.163 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.277136+0000", 2024-04-19T03:02:55.163 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.013261207 2024-04-19T03:02:55.163 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.163 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.163 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:55.163 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.278403+0000", 2024-04-19T03:02:55.163 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001267106 2024-04-19T03:02:55.163 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:55.163 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:55.163 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:55.163 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.163 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.163 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87128 5.6 5:6905c420:::benchmark_data_smithi096_19531_object87127:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:02:55.164 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249323+0000", 2024-04-19T03:02:55.164 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 31.842273513999999, 2024-04-19T03:02:55.164 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0292813249999999, 2024-04-19T03:02:55.164 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:55.164 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-04-19T03:02:55.164 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:55.164 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:55.164 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:55.164 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87128 2024-04-19T03:02:55.164 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.164 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:55.164 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.164 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:55.164 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249323+0000", 2024-04-19T03:02:55.165 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:55.165 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.165 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.165 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:55.165 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249323+0000", 2024-04-19T03:02:55.165 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:55.165 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.165 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.165 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:55.165 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249323+0000", 2024-04-19T03:02:55.165 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:55.165 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.165 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.166 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:55.166 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249385+0000", 2024-04-19T03:02:55.166 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1711999999999995e-05 2024-04-19T03:02:55.166 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.166 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.166 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:55.166 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249398+0000", 2024-04-19T03:02:55.166 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3022e-05 2024-04-19T03:02:55.166 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.166 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.166 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:55.166 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249402+0000", 2024-04-19T03:02:55.166 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4819999999999996e-06 2024-04-19T03:02:55.167 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.167 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.167 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:55.167 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249437+0000", 2024-04-19T03:02:55.167 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4702000000000001e-05 2024-04-19T03:02:55.167 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.167 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.167 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:02:55.167 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249442+0000", 2024-04-19T03:02:55.167 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8019999999999999e-06 2024-04-19T03:02:55.167 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.167 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.167 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:55.167 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263896+0000", 2024-04-19T03:02:55.168 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.014454679999999999 2024-04-19T03:02:55.168 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.168 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.168 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:02:55.168 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263900+0000", 2024-04-19T03:02:55.168 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9700000000000001e-06 2024-04-19T03:02:55.168 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.168 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.168 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:55.168 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.278557+0000", 2024-04-19T03:02:55.168 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0146566480000001 2024-04-19T03:02:55.168 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.168 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.168 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:55.169 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.278605+0000", 2024-04-19T03:02:55.169 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7735999999999998e-05 2024-04-19T03:02:55.169 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:55.169 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:55.169 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:55.169 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.169 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.169 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87130 5.3 5:c8c2d67b:::benchmark_data_smithi096_19531_object87129:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:02:55.169 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249418+0000", 2024-04-19T03:02:55.169 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 31.842178802999999, 2024-04-19T03:02:55.169 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.025414182, 2024-04-19T03:02:55.169 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:55.169 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-04-19T03:02:55.169 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:55.170 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:55.170 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:55.170 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87130 2024-04-19T03:02:55.170 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.170 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:55.170 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.170 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:55.170 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249418+0000", 2024-04-19T03:02:55.170 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:55.170 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.170 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.170 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:55.170 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249418+0000", 2024-04-19T03:02:55.170 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:55.171 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.171 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.171 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:55.171 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249409+0000", 2024-04-19T03:02:55.171 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999905 2024-04-19T03:02:55.171 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.171 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.171 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:55.171 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249464+0000", 2024-04-19T03:02:55.171 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5381999999999999e-05 2024-04-19T03:02:55.171 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.171 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.171 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:55.171 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249471+0000", 2024-04-19T03:02:55.172 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2609999999999996e-06 2024-04-19T03:02:55.172 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.172 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.172 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:55.172 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249475+0000", 2024-04-19T03:02:55.172 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2839999999999998e-06 2024-04-19T03:02:55.172 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.172 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.172 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:55.172 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249535+0000", 2024-04-19T03:02:55.172 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0545999999999999e-05 2024-04-19T03:02:55.172 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.172 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.172 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op must wait for map", 2024-04-19T03:02:55.173 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249540+0000", 2024-04-19T03:02:55.173 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2859999999999999e-06 2024-04-19T03:02:55.173 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.173 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.173 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:55.173 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263450+0000", 2024-04-19T03:02:55.173 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.013909585 2024-04-19T03:02:55.173 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.173 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.173 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:02:55.173 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263458+0000", 2024-04-19T03:02:55.173 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8089999999999993e-06 2024-04-19T03:02:55.173 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.173 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.174 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:55.174 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.273193+0000", 2024-04-19T03:02:55.174 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0097351379999999 2024-04-19T03:02:55.174 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.174 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.174 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:55.174 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.274832+0000", 2024-04-19T03:02:55.174 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0016394789999999999 2024-04-19T03:02:55.174 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:55.174 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:55.174 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:55.174 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.174 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.175 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87131 5.1 5:83756d55:::benchmark_data_smithi096_19531_object87130:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:02:55.175 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249491+0000", 2024-04-19T03:02:55.175 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 31.842106156, 2024-04-19T03:02:55.175 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0191489520000001, 2024-04-19T03:02:55.175 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:55.175 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-04-19T03:02:55.175 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:55.175 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:55.175 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:55.175 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87131 2024-04-19T03:02:55.175 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.175 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:55.175 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.175 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:55.176 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249491+0000", 2024-04-19T03:02:55.176 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:55.176 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.176 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.176 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:55.176 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249491+0000", 2024-04-19T03:02:55.176 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:55.176 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.176 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.176 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:55.176 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249491+0000", 2024-04-19T03:02:55.176 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:55.176 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.176 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.177 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:55.177 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249530+0000", 2024-04-19T03:02:55.177 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9589000000000003e-05 2024-04-19T03:02:55.177 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.177 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.177 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:55.177 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249544+0000", 2024-04-19T03:02:55.177 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4158000000000001e-05 2024-04-19T03:02:55.177 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.177 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.177 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:55.177 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249549+0000", 2024-04-19T03:02:55.177 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6809999999999997e-06 2024-04-19T03:02:55.178 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.178 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.178 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:55.178 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249592+0000", 2024-04-19T03:02:55.178 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3285999999999999e-05 2024-04-19T03:02:55.178 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.178 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.178 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op must wait for map", 2024-04-19T03:02:55.178 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249598+0000", 2024-04-19T03:02:55.178 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8329999999999999e-06 2024-04-19T03:02:55.178 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.178 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.178 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:55.178 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263331+0000", 2024-04-19T03:02:55.179 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.013733093 2024-04-19T03:02:55.179 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.179 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.179 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:02:55.179 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263343+0000", 2024-04-19T03:02:55.179 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.189e-05 2024-04-19T03:02:55.179 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.179 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.179 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:55.179 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.268541+0000", 2024-04-19T03:02:55.179 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0051983440000001 2024-04-19T03:02:55.179 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.179 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.179 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:55.180 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.268640+0000", 2024-04-19T03:02:55.180 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.8387999999999994e-05 2024-04-19T03:02:55.180 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:55.180 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:55.180 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:55.180 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.180 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.180 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87132 5.c 5:3e18b732:::benchmark_data_smithi096_19531_object87131:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:02:55.180 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249558+0000", 2024-04-19T03:02:55.180 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 31.842039255, 2024-04-19T03:02:55.180 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0241198380000001, 2024-04-19T03:02:55.180 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:55.180 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-04-19T03:02:55.180 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:55.181 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:55.181 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:55.181 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87132 2024-04-19T03:02:55.181 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.181 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:55.181 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.181 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:55.181 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249558+0000", 2024-04-19T03:02:55.181 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:55.181 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.181 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.181 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:55.181 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249558+0000", 2024-04-19T03:02:55.181 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:55.181 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.182 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.182 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:55.182 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249557+0000", 2024-04-19T03:02:55.182 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:55.182 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.182 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.182 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:55.182 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249625+0000", 2024-04-19T03:02:55.182 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7200999999999996e-05 2024-04-19T03:02:55.182 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.182 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.182 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:55.182 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249646+0000", 2024-04-19T03:02:55.183 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1053e-05 2024-04-19T03:02:55.183 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.183 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.183 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:55.183 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249650+0000", 2024-04-19T03:02:55.183 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2719999999999999e-06 2024-04-19T03:02:55.183 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.183 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.183 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:55.183 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249686+0000", 2024-04-19T03:02:55.183 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6430000000000002e-05 2024-04-19T03:02:55.183 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.183 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.183 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op must wait for map", 2024-04-19T03:02:55.184 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249690+0000", 2024-04-19T03:02:55.184 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.765e-06 2024-04-19T03:02:55.184 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.184 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.184 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:55.184 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261157+0000", 2024-04-19T03:02:55.184 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011467247999999999 2024-04-19T03:02:55.184 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.184 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.184 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:02:55.184 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261170+0000", 2024-04-19T03:02:55.184 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2833000000000001e-05 2024-04-19T03:02:55.184 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.184 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.185 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:55.185 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.272119+0000", 2024-04-19T03:02:55.185 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.010949313 2024-04-19T03:02:55.185 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.185 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.185 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:55.185 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.273678+0000", 2024-04-19T03:02:55.185 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0015581550000000001 2024-04-19T03:02:55.185 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:55.185 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:55.185 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:55.185 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.185 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.185 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87133 5.c 5:3f772a62:::benchmark_data_smithi096_19531_object87132:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:02:55.186 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249657+0000", 2024-04-19T03:02:55.186 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 31.841939876000001, 2024-04-19T03:02:55.186 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0242819409999999, 2024-04-19T03:02:55.186 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:55.186 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-04-19T03:02:55.186 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:55.186 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:55.186 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:55.186 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87133 2024-04-19T03:02:55.186 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.186 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:55.186 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.186 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:55.186 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249657+0000", 2024-04-19T03:02:55.187 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:55.187 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.187 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.187 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:55.187 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249657+0000", 2024-04-19T03:02:55.187 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:55.187 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.187 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.187 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:55.187 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249657+0000", 2024-04-19T03:02:55.187 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:55.187 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.187 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.187 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:55.188 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249690+0000", 2024-04-19T03:02:55.188 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3343000000000002e-05 2024-04-19T03:02:55.188 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.188 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.188 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:55.188 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249695+0000", 2024-04-19T03:02:55.188 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8600000000000001e-06 2024-04-19T03:02:55.188 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.188 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.188 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:55.188 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249698+0000", 2024-04-19T03:02:55.188 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.1700000000000001e-06 2024-04-19T03:02:55.188 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.188 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.189 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:55.189 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249741+0000", 2024-04-19T03:02:55.189 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2849999999999998e-05 2024-04-19T03:02:55.189 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.189 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.189 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:02:55.189 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249746+0000", 2024-04-19T03:02:55.189 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1019999999999996e-06 2024-04-19T03:02:55.189 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.189 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.189 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:55.189 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261209+0000", 2024-04-19T03:02:55.189 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011462447000000001 2024-04-19T03:02:55.189 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.190 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.190 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:02:55.190 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261216+0000", 2024-04-19T03:02:55.190 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8520000000000004e-06 2024-04-19T03:02:55.190 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.190 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.190 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:55.190 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.273872+0000", 2024-04-19T03:02:55.190 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0126558000000001 2024-04-19T03:02:55.190 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.190 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.190 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:55.190 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.273939+0000", 2024-04-19T03:02:55.190 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6822000000000005e-05 2024-04-19T03:02:55.191 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:55.191 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:55.191 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:55.191 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.191 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.191 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87134 5.5 5:a56c478f:::benchmark_data_smithi096_19531_object87133:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:02:55.191 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249708+0000", 2024-04-19T03:02:55.191 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 31.841888952000001, 2024-04-19T03:02:55.191 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0214677299999999, 2024-04-19T03:02:55.191 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:55.191 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-04-19T03:02:55.191 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:55.191 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:55.191 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:55.192 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87134 2024-04-19T03:02:55.192 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.192 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:55.192 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.192 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:55.192 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249708+0000", 2024-04-19T03:02:55.192 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:55.192 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.192 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.192 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:55.192 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249708+0000", 2024-04-19T03:02:55.192 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:55.192 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.193 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.193 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:55.193 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249706+0000", 2024-04-19T03:02:55.193 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999976 2024-04-19T03:02:55.193 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.193 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.193 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:55.193 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249740+0000", 2024-04-19T03:02:55.193 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4458000000000001e-05 2024-04-19T03:02:55.193 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.193 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.193 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:55.193 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249745+0000", 2024-04-19T03:02:55.193 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5020000000000003e-06 2024-04-19T03:02:55.193 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.194 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.194 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:55.194 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249748+0000", 2024-04-19T03:02:55.194 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2499999999999998e-06 2024-04-19T03:02:55.194 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.194 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.194 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:55.194 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249778+0000", 2024-04-19T03:02:55.194 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.006e-05 2024-04-19T03:02:55.194 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.194 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.194 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op must wait for map", 2024-04-19T03:02:55.194 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249782+0000", 2024-04-19T03:02:55.194 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2910000000000001e-06 2024-04-19T03:02:55.195 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.195 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.195 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:55.195 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261666+0000", 2024-04-19T03:02:55.195 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011883471 2024-04-19T03:02:55.195 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.195 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.195 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:02:55.195 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261674+0000", 2024-04-19T03:02:55.195 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6479999999999992e-06 2024-04-19T03:02:55.195 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.195 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.195 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:55.195 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.269323+0000", 2024-04-19T03:02:55.196 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.00764867 2024-04-19T03:02:55.196 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.196 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.196 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:55.196 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.271176+0000", 2024-04-19T03:02:55.196 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001852844 2024-04-19T03:02:55.196 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:55.196 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:55.196 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:55.196 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.196 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.196 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87137 5.c 5:30708c68:::benchmark_data_smithi096_19531_object87136:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:02:55.196 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249756+0000", 2024-04-19T03:02:55.197 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 31.841841246000001, 2024-04-19T03:02:55.197 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.033331752, 2024-04-19T03:02:55.197 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:55.197 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:55.197 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:55.197 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:55.197 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:55.197 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87137 2024-04-19T03:02:55.197 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.197 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:55.197 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.197 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:55.197 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249756+0000", 2024-04-19T03:02:55.198 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:55.198 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.198 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.198 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:55.198 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249756+0000", 2024-04-19T03:02:55.198 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:55.198 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.198 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.198 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:55.198 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249755+0000", 2024-04-19T03:02:55.198 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:55.198 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.198 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.198 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:55.199 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249777+0000", 2024-04-19T03:02:55.199 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1420000000000002e-05 2024-04-19T03:02:55.199 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.199 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.199 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:55.199 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249781+0000", 2024-04-19T03:02:55.199 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0609999999999997e-06 2024-04-19T03:02:55.199 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.199 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.199 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:55.199 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249787+0000", 2024-04-19T03:02:55.199 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.02e-06 2024-04-19T03:02:55.199 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.199 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.200 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:55.200 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249818+0000", 2024-04-19T03:02:55.200 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0947e-05 2024-04-19T03:02:55.200 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.200 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.200 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:02:55.200 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249821+0000", 2024-04-19T03:02:55.200 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.117e-06 2024-04-19T03:02:55.200 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.200 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.200 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:55.200 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261243+0000", 2024-04-19T03:02:55.200 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011421875999999999 2024-04-19T03:02:55.200 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.201 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.201 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:02:55.201 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261251+0000", 2024-04-19T03:02:55.201 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6120000000000001e-06 2024-04-19T03:02:55.201 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.201 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.201 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:55.201 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.274050+0000", 2024-04-19T03:02:55.201 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.012799405 2024-04-19T03:02:55.201 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.201 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.201 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:55.201 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.274529+0000", 2024-04-19T03:02:55.201 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00047867100000000001 2024-04-19T03:02:55.202 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.202 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.202 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:55.202 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.282972+0000", 2024-04-19T03:02:55.202 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0084436900000000002 2024-04-19T03:02:55.202 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.202 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.202 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:55.202 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.283022+0000", 2024-04-19T03:02:55.202 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9339000000000003e-05 2024-04-19T03:02:55.202 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:55.202 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:55.202 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:55.203 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.283088+0000", 2024-04-19T03:02:55.203 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5877999999999995e-05 2024-04-19T03:02:55.203 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:55.203 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:55.203 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:55.203 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:55.203 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:55.203 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-04-19T03:02:55.204 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T03:02:55.205 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:55.202+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:55.214 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-19T03:02:55.305 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:55.300+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:55.332 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-19T03:02:55.332 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-04-19T03:02:55.333 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:55.333 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4755.0:151394 5.9 e55/22 5:9c6899c7:::benchmark_data_smithi096_19531_object37944:head v 55'9248, mlcod=55'9244)", 2024-04-19T03:02:55.333 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:55.332510+0000", 2024-04-19T03:02:55.333 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.00066027000000000002, 2024-04-19T03:02:55.333 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00067789, 2024-04-19T03:02:55.333 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:55.333 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-19T03:02:55.333 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:55.333 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:55.333 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:55.333 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:55.332510+0000", 2024-04-19T03:02:55.333 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:55.333 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:55.334 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:55.334 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:55.334 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:55.332510+0000", 2024-04-19T03:02:55.334 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:55.334 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:55.334 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:55.334 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:55.334 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:55.332509+0000", 2024-04-19T03:02:55.334 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:55.334 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:55.335 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:55.335 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:55.335 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:55.332515+0000", 2024-04-19T03:02:55.335 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.383e-06 2024-04-19T03:02:55.335 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:55.335 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:55.335 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:55.335 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:55.332524+0000", 2024-04-19T03:02:55.335 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.2399999999999996e-06 2024-04-19T03:02:55.335 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:55.335 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:55.335 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:55.335 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:55.332529+0000", 2024-04-19T03:02:55.336 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7400000000000004e-06 2024-04-19T03:02:55.336 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:55.336 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:55.336 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:55.336 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:55.332571+0000", 2024-04-19T03:02:55.336 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2778000000000003e-05 2024-04-19T03:02:55.336 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:55.336 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:55.336 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:55.336 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:55.332592+0000", 2024-04-19T03:02:55.336 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0545999999999999e-05 2024-04-19T03:02:55.336 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:55.336 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:55.336 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:55.337 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:55.337 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-04-19T03:02:55.337 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 1 2024-04-19T03:02:55.337 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-19T03:02:55.343 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T03:02:55.365 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1: {} 2024-04-19T03:02:55.384 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2: {} 2024-04-19T03:02:55.384 INFO:teuthology.orchestra.run.smithi096.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-04-19T03:02:55.384 INFO:teuthology.orchestra.run.smithi096.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-19T03:02:55.385 INFO:teuthology.orchestra.run.smithi096.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-19T03:02:55.389 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-19T03:02:55.389 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-19T03:02:55.406 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:55.402+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:55.466 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-19T03:02:55.466 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:02:55.479 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T03:02:55.507 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:55.504+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:55.599 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-19T03:02:55.599 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:02:55.608 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:55.606+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:55.612 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T03:02:55.710 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:55.708+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:55.745 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-04-19T03:02:55.745 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:02:55.757 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T03:02:55.811 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:55.806+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:55.881 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-04-19T03:02:55.881 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:02:55.892 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T03:02:55.912 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:55.908+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:56.012 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:56.008+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:56.019 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-04-19T03:02:56.019 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:02:56.032 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T03:02:56.115 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:56.110+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:56.156 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-19T03:02:56.157 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:02:56.168 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T03:02:56.215 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:56.210+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:56.289 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-19T03:02:56.289 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:02:56.302 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T03:02:56.316 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:56.312+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:56.417 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:56.414+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:56.472 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-19T03:02:56.472 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:02:56.486 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T03:02:56.517 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:56.512+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:56.617 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-04-19T03:02:56.617 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:02:56.618 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:56.616+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:56.631 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T03:02:56.633 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-19T03:02:56.719 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:56.716+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:56.798 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-04-19T03:02:56.799 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:02:56.810 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T03:02:56.820 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:56.818+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:56.921 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:56.916+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:56.943 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-04-19T03:02:56.943 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:02:56.955 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T03:02:57.021 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:57.018+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:57.082 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-19T03:02:57.082 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:02:57.091 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T03:02:57.123 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:57.120+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:57.222 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-19T03:02:57.222 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:02:57.223 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:57.218+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:57.234 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T03:02:57.324 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:57.322+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:57.359 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-19T03:02:57.359 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:02:57.372 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T03:02:57.390 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-19T03:02:57.424 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:57.422+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:57.502 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-04-19T03:02:57.502 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:02:57.509 INFO:teuthology.orchestra.run.smithi096.stderr:nodeep-scrub is unset 2024-04-19T03:02:57.514 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T03:02:57.525 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:57.520+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:57.548 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1: {} 2024-04-19T03:02:57.568 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2: {} 2024-04-19T03:02:57.569 INFO:teuthology.orchestra.run.smithi096.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-04-19T03:02:57.569 INFO:teuthology.orchestra.run.smithi096.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-19T03:02:57.569 INFO:teuthology.orchestra.run.smithi096.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-19T03:02:57.572 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-19T03:02:57.573 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-19T03:02:57.626 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:57.622+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:57.648 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-04-19T03:02:57.648 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2024-04-19T03:02:57.649 INFO:teuthology.orchestra.run.smithi144.stdout: "complaint_time": 30, 2024-04-19T03:02:57.649 INFO:teuthology.orchestra.run.smithi144.stdout: "num_blocked_ops": 0 2024-04-19T03:02:57.649 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-04-19T03:02:57.661 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T03:02:57.727 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:57.722+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:57.790 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-04-19T03:02:57.790 INFO:teuthology.orchestra.run.smithi144.stdout: "size": 20, 2024-04-19T03:02:57.790 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 600, 2024-04-19T03:02:57.790 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [ 2024-04-19T03:02:57.790 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.790 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:78992 5.7 5:e6baa862:::benchmark_data_smithi096_19531_object78991:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-19T03:02:57.790 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:18.008888+0000", 2024-04-19T03:02:57.790 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 39.777883873, 2024-04-19T03:02:57.791 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.056375285999999997, 2024-04-19T03:02:57.791 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:57.791 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:57.791 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:57.791 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:57.791 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:57.791 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 78992 2024-04-19T03:02:57.791 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.791 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:57.791 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.791 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:57.791 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.008888+0000", 2024-04-19T03:02:57.791 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:57.791 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.792 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.792 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:57.792 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.008888+0000", 2024-04-19T03:02:57.792 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:57.792 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.792 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.792 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:57.792 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.008888+0000", 2024-04-19T03:02:57.792 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:57.792 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.792 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.792 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:57.792 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.008928+0000", 2024-04-19T03:02:57.792 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0361999999999997e-05 2024-04-19T03:02:57.793 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.793 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.793 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:57.793 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.008942+0000", 2024-04-19T03:02:57.793 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4365000000000001e-05 2024-04-19T03:02:57.793 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.793 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.793 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:57.793 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.008949+0000", 2024-04-19T03:02:57.793 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.212e-06 2024-04-19T03:02:57.793 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.793 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.793 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:57.793 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.012683+0000", 2024-04-19T03:02:57.794 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.003733934 2024-04-19T03:02:57.794 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.794 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.794 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:57.794 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.012798+0000", 2024-04-19T03:02:57.794 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00011574999999999999 2024-04-19T03:02:57.794 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.794 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.794 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:57.794 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.012896+0000", 2024-04-19T03:02:57.794 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.7848000000000002e-05 2024-04-19T03:02:57.794 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.794 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.795 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:57.795 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016423+0000", 2024-04-19T03:02:57.795 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0035270789999999998 2024-04-19T03:02:57.795 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.795 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.795 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:57.795 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.065098+0000", 2024-04-19T03:02:57.795 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.048674651999999999 2024-04-19T03:02:57.795 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.795 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.795 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:57.795 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.065193+0000", 2024-04-19T03:02:57.795 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.5087999999999995e-05 2024-04-19T03:02:57.795 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.795 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.796 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:57.796 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.065264+0000", 2024-04-19T03:02:57.796 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0666000000000004e-05 2024-04-19T03:02:57.796 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:57.796 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:57.796 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:57.796 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.796 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.796 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:78998 5.7 5:ee23c1bc:::benchmark_data_smithi096_19531_object78997:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-19T03:02:57.796 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:18.013165+0000", 2024-04-19T03:02:57.796 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 39.773607167000002, 2024-04-19T03:02:57.796 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.052410864000000001, 2024-04-19T03:02:57.796 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:57.796 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:57.797 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:57.797 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:57.797 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:57.797 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 78998 2024-04-19T03:02:57.797 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.797 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:57.797 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.797 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:57.797 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.013165+0000", 2024-04-19T03:02:57.797 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:57.797 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.797 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.797 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:57.798 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.013165+0000", 2024-04-19T03:02:57.798 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:57.798 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.798 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.798 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:57.798 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.013164+0000", 2024-04-19T03:02:57.798 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:57.798 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.798 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.798 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:57.798 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.013214+0000", 2024-04-19T03:02:57.798 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9636999999999999e-05 2024-04-19T03:02:57.798 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.798 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.799 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:57.799 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.013223+0000", 2024-04-19T03:02:57.799 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.3619999999999995e-06 2024-04-19T03:02:57.799 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.799 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.799 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:57.799 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.013229+0000", 2024-04-19T03:02:57.799 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6060000000000002e-06 2024-04-19T03:02:57.799 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.799 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.799 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:57.799 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.014882+0000", 2024-04-19T03:02:57.799 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001653257 2024-04-19T03:02:57.799 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.800 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.800 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:57.800 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.014958+0000", 2024-04-19T03:02:57.800 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6398999999999998e-05 2024-04-19T03:02:57.800 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.800 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.800 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:57.800 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.015036+0000", 2024-04-19T03:02:57.800 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8070000000000003e-05 2024-04-19T03:02:57.800 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.800 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.800 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:57.800 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018099+0000", 2024-04-19T03:02:57.800 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0030631149999999999 2024-04-19T03:02:57.801 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.801 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.801 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:57.801 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.065328+0000", 2024-04-19T03:02:57.801 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.047228349000000003 2024-04-19T03:02:57.801 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.801 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.801 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:57.801 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.065508+0000", 2024-04-19T03:02:57.801 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00018036899999999999 2024-04-19T03:02:57.801 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.801 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.801 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:57.802 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.065576+0000", 2024-04-19T03:02:57.802 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7785000000000002e-05 2024-04-19T03:02:57.802 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:57.802 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:57.802 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:57.802 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.802 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.802 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4755.0:78995 5.2 e40/39 5:42b55e12:::benchmark_data_smithi096_19531_object78994:head v 40'4934, mlcod=40'4932)", 2024-04-19T03:02:57.802 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:18.016247+0000", 2024-04-19T03:02:57.802 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 39.770525204999998, 2024-04-19T03:02:57.802 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.056240406, 2024-04-19T03:02:57.802 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:57.802 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:57.802 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:57.803 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.803 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:57.803 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016247+0000", 2024-04-19T03:02:57.803 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:57.803 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.803 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.803 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:57.803 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016247+0000", 2024-04-19T03:02:57.803 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:57.803 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.803 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.803 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:57.803 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016246+0000", 2024-04-19T03:02:57.803 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:57.803 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.804 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.804 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:57.804 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016315+0000", 2024-04-19T03:02:57.804 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8979000000000005e-05 2024-04-19T03:02:57.804 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.804 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.804 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:57.804 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016333+0000", 2024-04-19T03:02:57.804 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7586999999999999e-05 2024-04-19T03:02:57.804 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.804 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.804 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:57.804 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016340+0000", 2024-04-19T03:02:57.804 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4080000000000001e-06 2024-04-19T03:02:57.805 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.805 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.805 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:57.805 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016384+0000", 2024-04-19T03:02:57.805 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3656999999999999e-05 2024-04-19T03:02:57.805 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.805 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.805 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:57.805 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016403+0000", 2024-04-19T03:02:57.805 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9089e-05 2024-04-19T03:02:57.805 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.805 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.806 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:57.806 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.072448+0000", 2024-04-19T03:02:57.806 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.056045084000000002 2024-04-19T03:02:57.806 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.806 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.806 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:57.806 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.072487+0000", 2024-04-19T03:02:57.806 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9362e-05 2024-04-19T03:02:57.806 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:57.806 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:57.806 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:57.806 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.807 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.807 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4755.0:78994 5.c e40/22 5:3c60d55d:::benchmark_data_smithi096_19531_object78993:head v 40'4989, mlcod=40'4987)", 2024-04-19T03:02:57.807 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:18.016392+0000", 2024-04-19T03:02:57.807 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 39.770380564, 2024-04-19T03:02:57.807 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.052629620000000002, 2024-04-19T03:02:57.807 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:57.807 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:57.807 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:57.807 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.807 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:57.807 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016392+0000", 2024-04-19T03:02:57.807 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:57.808 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.808 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.808 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:57.808 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016392+0000", 2024-04-19T03:02:57.808 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:57.808 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.808 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.808 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:57.808 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016391+0000", 2024-04-19T03:02:57.808 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:57.808 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.808 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.808 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:57.808 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016471+0000", 2024-04-19T03:02:57.809 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9346999999999998e-05 2024-04-19T03:02:57.809 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.809 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.809 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:57.809 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016478+0000", 2024-04-19T03:02:57.809 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.593e-06 2024-04-19T03:02:57.809 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.809 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.809 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:57.809 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016495+0000", 2024-04-19T03:02:57.809 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6492999999999999e-05 2024-04-19T03:02:57.809 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.809 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.809 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:57.810 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016539+0000", 2024-04-19T03:02:57.810 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4715999999999997e-05 2024-04-19T03:02:57.810 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.810 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.810 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:57.810 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016551+0000", 2024-04-19T03:02:57.810 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2096000000000001e-05 2024-04-19T03:02:57.810 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.810 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.810 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:57.810 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.068985+0000", 2024-04-19T03:02:57.810 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.052433754999999999 2024-04-19T03:02:57.810 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.811 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.811 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:57.811 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.069021+0000", 2024-04-19T03:02:57.811 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6047000000000002e-05 2024-04-19T03:02:57.811 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:57.811 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:57.811 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:57.811 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.811 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.811 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4755.0:78996 5.1 e40/39 5:87f59708:::benchmark_data_smithi096_19531_object78995:head v 40'4940, mlcod=40'4938)", 2024-04-19T03:02:57.811 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:18.016581+0000", 2024-04-19T03:02:57.811 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 39.770191398999998, 2024-04-19T03:02:57.811 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.052051785000000003, 2024-04-19T03:02:57.812 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:57.812 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:57.812 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:57.812 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.812 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:57.812 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016581+0000", 2024-04-19T03:02:57.812 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:57.812 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.812 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.812 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:57.812 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016581+0000", 2024-04-19T03:02:57.812 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:57.812 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.813 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.813 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:57.813 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016581+0000", 2024-04-19T03:02:57.813 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:57.813 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.813 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.813 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:57.813 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016610+0000", 2024-04-19T03:02:57.813 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9556999999999998e-05 2024-04-19T03:02:57.813 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.813 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.813 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:57.813 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016616+0000", 2024-04-19T03:02:57.814 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1090000000000003e-06 2024-04-19T03:02:57.814 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.814 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.814 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:57.814 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016621+0000", 2024-04-19T03:02:57.814 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.454e-06 2024-04-19T03:02:57.814 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.814 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.814 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:57.814 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016663+0000", 2024-04-19T03:02:57.814 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2582e-05 2024-04-19T03:02:57.814 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.814 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.815 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:57.815 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016681+0000", 2024-04-19T03:02:57.815 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7680999999999999e-05 2024-04-19T03:02:57.815 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.815 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.815 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:57.815 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.068486+0000", 2024-04-19T03:02:57.815 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.051804624000000001 2024-04-19T03:02:57.815 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.815 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.815 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:57.815 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.068633+0000", 2024-04-19T03:02:57.815 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00014709099999999999 2024-04-19T03:02:57.815 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:57.816 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:57.816 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:57.816 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.816 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.816 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4755.0:78999 5.3 e40/22 5:c9ec5f7f:::benchmark_data_smithi096_19531_object78998:head v 40'4893, mlcod=40'4889)", 2024-04-19T03:02:57.816 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:18.016633+0000", 2024-04-19T03:02:57.816 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 39.770139544000003, 2024-04-19T03:02:57.816 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.051090469999999999, 2024-04-19T03:02:57.816 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:57.816 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:57.816 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:57.816 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.816 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:57.817 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016633+0000", 2024-04-19T03:02:57.817 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:57.817 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.818 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.818 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:57.818 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016633+0000", 2024-04-19T03:02:57.818 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:57.818 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.818 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.818 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:57.818 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016632+0000", 2024-04-19T03:02:57.818 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967296 2024-04-19T03:02:57.818 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.818 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.819 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:57.819 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016660+0000", 2024-04-19T03:02:57.819 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7869999999999999e-05 2024-04-19T03:02:57.819 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.819 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.819 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:57.819 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016667+0000", 2024-04-19T03:02:57.819 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0280000000000003e-06 2024-04-19T03:02:57.819 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.819 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.819 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:57.819 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016672+0000", 2024-04-19T03:02:57.819 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0069999999999997e-06 2024-04-19T03:02:57.820 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.820 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.820 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:57.820 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016725+0000", 2024-04-19T03:02:57.820 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2812000000000002e-05 2024-04-19T03:02:57.820 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.820 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.820 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:57.820 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016750+0000", 2024-04-19T03:02:57.820 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5038e-05 2024-04-19T03:02:57.820 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.820 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.820 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:57.821 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.067673+0000", 2024-04-19T03:02:57.821 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.050922350999999998 2024-04-19T03:02:57.821 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.821 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.821 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:57.821 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.067723+0000", 2024-04-19T03:02:57.821 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0586e-05 2024-04-19T03:02:57.821 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:57.821 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:57.821 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:57.821 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.821 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.821 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4755.0:79003 5.2 e40/39 5:4436e33f:::benchmark_data_smithi096_19531_object79002:head v 40'4935, mlcod=40'4932)", 2024-04-19T03:02:57.822 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:18.018102+0000", 2024-04-19T03:02:57.822 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 39.768669817000003, 2024-04-19T03:02:57.822 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.060023990999999999, 2024-04-19T03:02:57.822 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:57.822 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:57.822 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:57.822 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.822 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:57.822 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018102+0000", 2024-04-19T03:02:57.822 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:57.822 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.822 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.823 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:57.823 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018102+0000", 2024-04-19T03:02:57.823 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:57.823 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.823 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.823 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:57.823 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018102+0000", 2024-04-19T03:02:57.823 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:57.823 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.823 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.823 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:57.823 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018134+0000", 2024-04-19T03:02:57.823 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2722000000000003e-05 2024-04-19T03:02:57.824 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.824 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.824 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:57.824 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018145+0000", 2024-04-19T03:02:57.824 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0395e-05 2024-04-19T03:02:57.824 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.824 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.824 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:57.824 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018151+0000", 2024-04-19T03:02:57.824 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5300000000000002e-06 2024-04-19T03:02:57.824 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.824 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.825 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:57.825 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018489+0000", 2024-04-19T03:02:57.825 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00033731499999999998 2024-04-19T03:02:57.825 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.825 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.825 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:57.825 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018508+0000", 2024-04-19T03:02:57.825 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9775e-05 2024-04-19T03:02:57.825 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.825 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.825 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:57.825 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.078059+0000", 2024-04-19T03:02:57.825 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.059550171999999998 2024-04-19T03:02:57.826 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.826 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.826 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:57.826 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.078126+0000", 2024-04-19T03:02:57.826 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7773000000000003e-05 2024-04-19T03:02:57.826 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:57.826 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:57.826 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:57.826 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.826 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.826 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4755.0:79005 5.1 e40/39 5:85b46038:::benchmark_data_smithi096_19531_object79004:head v 40'4941, mlcod=40'4938)", 2024-04-19T03:02:57.827 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:18.018167+0000", 2024-04-19T03:02:57.827 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 39.768605098000002, 2024-04-19T03:02:57.827 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.052768941999999999, 2024-04-19T03:02:57.827 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:57.827 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:57.827 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:57.827 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.827 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:57.827 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018167+0000", 2024-04-19T03:02:57.827 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:57.827 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.827 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.827 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:57.828 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018167+0000", 2024-04-19T03:02:57.828 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:57.828 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.828 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.828 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:57.828 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018167+0000", 2024-04-19T03:02:57.828 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:57.828 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.828 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.828 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:57.828 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018196+0000", 2024-04-19T03:02:57.828 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9538000000000001e-05 2024-04-19T03:02:57.828 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.829 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.829 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:57.829 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018204+0000", 2024-04-19T03:02:57.829 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2599999999999999e-06 2024-04-19T03:02:57.829 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.829 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.829 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:57.829 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018208+0000", 2024-04-19T03:02:57.829 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8080000000000004e-06 2024-04-19T03:02:57.829 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.829 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.830 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:57.830 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.064933+0000", 2024-04-19T03:02:57.830 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.046725048999999998 2024-04-19T03:02:57.830 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.830 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.830 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:57.830 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.064964+0000", 2024-04-19T03:02:57.830 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0577000000000002e-05 2024-04-19T03:02:57.830 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.830 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.830 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:57.831 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.070815+0000", 2024-04-19T03:02:57.831 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0058510649999999999 2024-04-19T03:02:57.831 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.831 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.831 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:57.831 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.070936+0000", 2024-04-19T03:02:57.831 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00012095399999999999 2024-04-19T03:02:57.831 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:57.831 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:57.831 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:57.831 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.831 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.832 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:86612 5.7 5:e32e3c49:::benchmark_data_smithi096_19531_object86611:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:57.832 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:22.633560+0000", 2024-04-19T03:02:57.832 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 35.153212156999999, 2024-04-19T03:02:57.832 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.19135289, 2024-04-19T03:02:57.832 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:57.832 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:57.832 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:57.832 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:57.832 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:57.832 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 86612 2024-04-19T03:02:57.832 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.832 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:57.832 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.833 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:57.833 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633560+0000", 2024-04-19T03:02:57.833 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:57.833 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.833 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.833 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:57.833 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633560+0000", 2024-04-19T03:02:57.833 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:57.833 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.833 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.833 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:57.833 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633558+0000", 2024-04-19T03:02:57.833 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:57.834 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.834 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.834 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:57.834 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633609+0000", 2024-04-19T03:02:57.834 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0850999999999998e-05 2024-04-19T03:02:57.834 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.834 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.834 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:57.834 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633627+0000", 2024-04-19T03:02:57.834 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7951000000000001e-05 2024-04-19T03:02:57.834 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.834 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.834 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:57.835 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633635+0000", 2024-04-19T03:02:57.835 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2530000000000004e-06 2024-04-19T03:02:57.835 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.835 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.835 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:57.835 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633699+0000", 2024-04-19T03:02:57.835 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3901999999999999e-05 2024-04-19T03:02:57.835 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.835 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.835 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:57.835 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633992+0000", 2024-04-19T03:02:57.835 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00029283299999999999 2024-04-19T03:02:57.836 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.836 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.836 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:57.836 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.634223+0000", 2024-04-19T03:02:57.836 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00023084200000000001 2024-04-19T03:02:57.836 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.836 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.836 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:57.836 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.639085+0000", 2024-04-19T03:02:57.836 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0048624269999999999 2024-04-19T03:02:57.836 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.836 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.836 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:57.837 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.824635+0000", 2024-04-19T03:02:57.837 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.18554944700000001 2024-04-19T03:02:57.837 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.837 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.837 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:57.837 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.824793+0000", 2024-04-19T03:02:57.837 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000157959 2024-04-19T03:02:57.837 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.837 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.837 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:57.837 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.824913+0000", 2024-04-19T03:02:57.837 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000120093 2024-04-19T03:02:57.838 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:57.838 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:57.838 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:57.838 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.838 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.838 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:86625 5.7 5:e6d00488:::benchmark_data_smithi096_19531_object86624:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:57.838 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:22.643554+0000", 2024-04-19T03:02:57.838 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 35.143218390999998, 2024-04-19T03:02:57.838 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.18732841, 2024-04-19T03:02:57.838 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:57.838 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:57.838 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:57.838 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:57.839 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:57.839 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 86625 2024-04-19T03:02:57.839 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.839 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:57.839 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.839 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:57.839 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643554+0000", 2024-04-19T03:02:57.839 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:57.839 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.839 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.839 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:57.839 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643554+0000", 2024-04-19T03:02:57.839 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:57.840 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.840 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.840 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:57.840 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643552+0000", 2024-04-19T03:02:57.840 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:57.840 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.840 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.840 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:57.840 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643588+0000", 2024-04-19T03:02:57.840 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5855999999999997e-05 2024-04-19T03:02:57.840 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.840 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.840 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:57.841 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643606+0000", 2024-04-19T03:02:57.841 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8226000000000001e-05 2024-04-19T03:02:57.841 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.841 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.841 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:57.841 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643618+0000", 2024-04-19T03:02:57.841 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1868000000000001e-05 2024-04-19T03:02:57.841 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.841 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.841 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:57.841 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643676+0000", 2024-04-19T03:02:57.841 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8153999999999999e-05 2024-04-19T03:02:57.842 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.842 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.842 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:57.842 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643905+0000", 2024-04-19T03:02:57.842 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00022847500000000001 2024-04-19T03:02:57.842 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.842 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.842 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:57.842 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.644150+0000", 2024-04-19T03:02:57.842 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00024531800000000001 2024-04-19T03:02:57.842 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.842 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.842 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:57.842 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.647407+0000", 2024-04-19T03:02:57.843 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0032563190000000001 2024-04-19T03:02:57.843 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.843 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.843 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:57.843 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.830721+0000", 2024-04-19T03:02:57.843 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.18331468300000001 2024-04-19T03:02:57.843 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.843 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.843 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:57.843 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.830813+0000", 2024-04-19T03:02:57.843 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.2205000000000002e-05 2024-04-19T03:02:57.843 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.843 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.843 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:57.844 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.830882+0000", 2024-04-19T03:02:57.844 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8819999999999995e-05 2024-04-19T03:02:57.844 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:57.844 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:57.844 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:57.844 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.844 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.844 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87063 5.7 5:e502e824:::benchmark_data_smithi096_19531_object87062:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:57.844 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.136067+0000", 2024-04-19T03:02:57.844 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 34.650705522000003, 2024-04-19T03:02:57.844 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.065521159999999995, 2024-04-19T03:02:57.844 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:57.844 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:57.844 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:57.844 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:57.845 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:57.845 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87063 2024-04-19T03:02:57.845 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.845 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:57.845 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.845 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:57.845 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.136067+0000", 2024-04-19T03:02:57.845 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:57.845 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.845 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.845 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:57.845 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.136067+0000", 2024-04-19T03:02:57.845 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:57.846 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.846 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.846 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:57.846 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.136066+0000", 2024-04-19T03:02:57.846 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:57.846 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.846 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.846 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:57.846 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.136154+0000", 2024-04-19T03:02:57.846 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.8256000000000003e-05 2024-04-19T03:02:57.846 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.846 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.846 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:57.847 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.136162+0000", 2024-04-19T03:02:57.847 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.5099999999999998e-06 2024-04-19T03:02:57.847 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.847 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.847 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:57.847 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.136171+0000", 2024-04-19T03:02:57.847 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2830000000000001e-06 2024-04-19T03:02:57.847 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.847 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.847 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:57.847 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.138421+0000", 2024-04-19T03:02:57.848 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0022506620000000001 2024-04-19T03:02:57.848 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.848 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.848 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:57.848 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.138560+0000", 2024-04-19T03:02:57.848 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000138446 2024-04-19T03:02:57.848 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.848 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.848 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:57.848 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.138689+0000", 2024-04-19T03:02:57.848 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00012950700000000001 2024-04-19T03:02:57.848 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.848 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.849 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:57.849 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.141517+0000", 2024-04-19T03:02:57.849 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0028280860000000001 2024-04-19T03:02:57.849 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.849 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.849 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:57.849 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.201350+0000", 2024-04-19T03:02:57.849 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.059832418999999998 2024-04-19T03:02:57.849 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.849 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.849 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:57.849 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.201485+0000", 2024-04-19T03:02:57.849 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000135597 2024-04-19T03:02:57.849 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.850 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.850 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:57.850 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.201588+0000", 2024-04-19T03:02:57.850 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00010247900000000001 2024-04-19T03:02:57.850 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:57.850 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:57.850 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:57.850 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.850 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.850 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87072 5.7 5:e3c7809a:::benchmark_data_smithi096_19531_object87071:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:57.850 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.144224+0000", 2024-04-19T03:02:57.850 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 34.642548497999996, 2024-04-19T03:02:57.850 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.058179555000000001, 2024-04-19T03:02:57.850 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:57.851 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:57.851 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:57.851 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:57.851 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:57.851 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87072 2024-04-19T03:02:57.851 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.851 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:57.851 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.851 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:57.851 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144224+0000", 2024-04-19T03:02:57.851 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:57.851 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.852 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.852 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:57.852 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144224+0000", 2024-04-19T03:02:57.852 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:57.852 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.852 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.852 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:57.852 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144223+0000", 2024-04-19T03:02:57.852 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:57.852 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.852 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.852 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:57.852 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144320+0000", 2024-04-19T03:02:57.852 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.7075000000000001e-05 2024-04-19T03:02:57.853 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.853 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.853 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:57.853 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144331+0000", 2024-04-19T03:02:57.853 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1342000000000001e-05 2024-04-19T03:02:57.853 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.853 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.853 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:57.853 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144337+0000", 2024-04-19T03:02:57.853 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8390000000000003e-06 2024-04-19T03:02:57.853 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.853 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.854 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:57.854 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144369+0000", 2024-04-19T03:02:57.854 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2079000000000002e-05 2024-04-19T03:02:57.854 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.854 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.854 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:57.854 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144464+0000", 2024-04-19T03:02:57.854 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.4623000000000005e-05 2024-04-19T03:02:57.854 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.854 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.854 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:57.854 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144553+0000", 2024-04-19T03:02:57.854 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9171000000000004e-05 2024-04-19T03:02:57.855 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.855 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.855 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:57.855 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.147018+0000", 2024-04-19T03:02:57.855 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0024648370000000001 2024-04-19T03:02:57.855 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.855 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.855 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:57.855 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.202270+0000", 2024-04-19T03:02:57.855 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.055252018 2024-04-19T03:02:57.855 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.855 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.856 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:57.856 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.202356+0000", 2024-04-19T03:02:57.856 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6648000000000001e-05 2024-04-19T03:02:57.856 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.856 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.856 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:57.856 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.202403+0000", 2024-04-19T03:02:57.856 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6956999999999998e-05 2024-04-19T03:02:57.856 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:57.856 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:57.856 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:57.856 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.856 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.857 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87123 5.6 5:6d1bc3b9:::benchmark_data_smithi096_19531_object87122:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:02:57.857 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249233+0000", 2024-04-19T03:02:57.857 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 34.537539465999998, 2024-04-19T03:02:57.857 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0291700720000001, 2024-04-19T03:02:57.857 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:57.857 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-04-19T03:02:57.857 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:57.857 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:57.857 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:57.857 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87123 2024-04-19T03:02:57.857 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.857 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:57.858 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.858 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:57.858 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249233+0000", 2024-04-19T03:02:57.858 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:57.858 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.858 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.858 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:57.858 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249233+0000", 2024-04-19T03:02:57.858 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:57.858 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.858 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.858 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:57.858 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249231+0000", 2024-04-19T03:02:57.859 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:57.859 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.859 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.859 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:57.859 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249285+0000", 2024-04-19T03:02:57.859 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4005000000000002e-05 2024-04-19T03:02:57.859 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.859 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.859 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:57.859 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249300+0000", 2024-04-19T03:02:57.859 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4715999999999999e-05 2024-04-19T03:02:57.859 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.859 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.860 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:57.860 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249307+0000", 2024-04-19T03:02:57.860 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8399999999999997e-06 2024-04-19T03:02:57.860 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.860 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.860 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:57.860 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249366+0000", 2024-04-19T03:02:57.860 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9435999999999998e-05 2024-04-19T03:02:57.860 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.860 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.860 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op must wait for map", 2024-04-19T03:02:57.860 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249376+0000", 2024-04-19T03:02:57.860 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.4919999999999999e-06 2024-04-19T03:02:57.860 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.861 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.861 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:57.861 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263757+0000", 2024-04-19T03:02:57.861 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.014381461999999999 2024-04-19T03:02:57.861 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.861 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.861 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:02:57.861 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263875+0000", 2024-04-19T03:02:57.861 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000117166 2024-04-19T03:02:57.861 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.861 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.861 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:57.861 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.277136+0000", 2024-04-19T03:02:57.862 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.013261207 2024-04-19T03:02:57.862 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.862 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.862 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:57.862 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.278403+0000", 2024-04-19T03:02:57.862 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001267106 2024-04-19T03:02:57.862 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:57.862 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:57.862 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:57.862 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.862 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.862 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87128 5.6 5:6905c420:::benchmark_data_smithi096_19531_object87127:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:02:57.862 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249323+0000", 2024-04-19T03:02:57.863 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 34.537448718999997, 2024-04-19T03:02:57.863 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0292813249999999, 2024-04-19T03:02:57.863 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:57.863 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-04-19T03:02:57.863 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:57.863 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:57.863 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:57.863 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87128 2024-04-19T03:02:57.863 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.863 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:57.863 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.863 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:57.863 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249323+0000", 2024-04-19T03:02:57.864 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:57.864 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.864 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.864 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:57.864 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249323+0000", 2024-04-19T03:02:57.864 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:57.864 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.864 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.864 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:57.864 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249323+0000", 2024-04-19T03:02:57.864 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:57.864 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.865 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.865 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:57.865 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249385+0000", 2024-04-19T03:02:57.865 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1711999999999995e-05 2024-04-19T03:02:57.865 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.865 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.865 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:57.865 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249398+0000", 2024-04-19T03:02:57.865 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3022e-05 2024-04-19T03:02:57.865 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.865 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.865 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:57.865 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249402+0000", 2024-04-19T03:02:57.866 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4819999999999996e-06 2024-04-19T03:02:57.866 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.866 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.866 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:57.866 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249437+0000", 2024-04-19T03:02:57.866 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4702000000000001e-05 2024-04-19T03:02:57.866 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.866 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.866 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:02:57.866 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249442+0000", 2024-04-19T03:02:57.866 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8019999999999999e-06 2024-04-19T03:02:57.866 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.866 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.866 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:57.867 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263896+0000", 2024-04-19T03:02:57.867 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.014454679999999999 2024-04-19T03:02:57.867 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.867 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.867 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:02:57.867 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263900+0000", 2024-04-19T03:02:57.867 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9700000000000001e-06 2024-04-19T03:02:57.867 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.867 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.867 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:57.867 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.278557+0000", 2024-04-19T03:02:57.867 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0146566480000001 2024-04-19T03:02:57.867 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.868 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.868 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:57.868 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.278605+0000", 2024-04-19T03:02:57.868 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7735999999999998e-05 2024-04-19T03:02:57.868 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:57.868 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:57.868 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:57.868 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.868 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.868 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87130 5.3 5:c8c2d67b:::benchmark_data_smithi096_19531_object87129:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:02:57.868 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249418+0000", 2024-04-19T03:02:57.868 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 34.537354008000001, 2024-04-19T03:02:57.868 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.025414182, 2024-04-19T03:02:57.869 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:57.869 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-04-19T03:02:57.869 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:57.869 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:57.869 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:57.869 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87130 2024-04-19T03:02:57.869 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.869 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:57.869 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.869 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:57.869 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249418+0000", 2024-04-19T03:02:57.869 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:57.869 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.870 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.870 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:57.870 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249418+0000", 2024-04-19T03:02:57.870 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:57.870 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.870 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.870 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:57.870 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249409+0000", 2024-04-19T03:02:57.870 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999905 2024-04-19T03:02:57.870 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.870 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.870 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:57.870 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249464+0000", 2024-04-19T03:02:57.871 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5381999999999999e-05 2024-04-19T03:02:57.871 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.871 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.871 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:57.871 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249471+0000", 2024-04-19T03:02:57.871 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2609999999999996e-06 2024-04-19T03:02:57.871 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.871 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.871 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:57.871 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249475+0000", 2024-04-19T03:02:57.871 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2839999999999998e-06 2024-04-19T03:02:57.871 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.871 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.872 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:57.872 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249535+0000", 2024-04-19T03:02:57.872 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0545999999999999e-05 2024-04-19T03:02:57.872 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.872 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.872 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op must wait for map", 2024-04-19T03:02:57.872 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249540+0000", 2024-04-19T03:02:57.872 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2859999999999999e-06 2024-04-19T03:02:57.872 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.872 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.872 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:57.872 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263450+0000", 2024-04-19T03:02:57.872 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.013909585 2024-04-19T03:02:57.872 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.873 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.873 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:02:57.873 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263458+0000", 2024-04-19T03:02:57.873 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8089999999999993e-06 2024-04-19T03:02:57.873 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.873 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.873 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:57.873 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.273193+0000", 2024-04-19T03:02:57.873 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0097351379999999 2024-04-19T03:02:57.873 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.873 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.873 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:57.873 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.274832+0000", 2024-04-19T03:02:57.873 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0016394789999999999 2024-04-19T03:02:57.874 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:57.874 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:57.874 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:57.874 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.874 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.874 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87131 5.1 5:83756d55:::benchmark_data_smithi096_19531_object87130:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:02:57.874 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249491+0000", 2024-04-19T03:02:57.874 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 34.537281360999998, 2024-04-19T03:02:57.874 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0191489520000001, 2024-04-19T03:02:57.874 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:57.874 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-04-19T03:02:57.874 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:57.874 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:57.875 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:57.875 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87131 2024-04-19T03:02:57.875 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.875 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:57.875 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.875 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:57.875 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249491+0000", 2024-04-19T03:02:57.875 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:57.875 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.875 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.875 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:57.875 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249491+0000", 2024-04-19T03:02:57.875 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:57.876 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.876 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.876 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:57.876 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249491+0000", 2024-04-19T03:02:57.876 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:57.876 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.876 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.876 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:57.876 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249530+0000", 2024-04-19T03:02:57.876 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9589000000000003e-05 2024-04-19T03:02:57.876 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.876 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.876 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:57.877 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249544+0000", 2024-04-19T03:02:57.877 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4158000000000001e-05 2024-04-19T03:02:57.877 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.877 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.877 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:57.877 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249549+0000", 2024-04-19T03:02:57.877 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6809999999999997e-06 2024-04-19T03:02:57.877 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.877 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.877 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:57.877 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249592+0000", 2024-04-19T03:02:57.877 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3285999999999999e-05 2024-04-19T03:02:57.877 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.877 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.878 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op must wait for map", 2024-04-19T03:02:57.878 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249598+0000", 2024-04-19T03:02:57.878 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8329999999999999e-06 2024-04-19T03:02:57.878 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.878 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.878 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:57.878 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263331+0000", 2024-04-19T03:02:57.878 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.013733093 2024-04-19T03:02:57.878 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.878 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.878 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:02:57.878 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263343+0000", 2024-04-19T03:02:57.879 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.189e-05 2024-04-19T03:02:57.879 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.879 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.879 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:57.879 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.268541+0000", 2024-04-19T03:02:57.879 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0051983440000001 2024-04-19T03:02:57.879 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.879 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.879 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:57.879 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.268640+0000", 2024-04-19T03:02:57.879 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.8387999999999994e-05 2024-04-19T03:02:57.879 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:57.879 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:57.880 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:57.880 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.880 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.880 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87132 5.c 5:3e18b732:::benchmark_data_smithi096_19531_object87131:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:02:57.880 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249558+0000", 2024-04-19T03:02:57.880 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 34.537214460000001, 2024-04-19T03:02:57.880 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0241198380000001, 2024-04-19T03:02:57.880 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:57.880 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-04-19T03:02:57.880 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:57.880 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:57.880 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:57.880 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87132 2024-04-19T03:02:57.881 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.881 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:57.881 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.881 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:57.881 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249558+0000", 2024-04-19T03:02:57.881 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:57.881 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.881 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.881 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:57.881 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249558+0000", 2024-04-19T03:02:57.881 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:57.881 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.881 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.882 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:57.882 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249557+0000", 2024-04-19T03:02:57.882 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:57.882 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.882 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.882 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:57.882 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249625+0000", 2024-04-19T03:02:57.882 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7200999999999996e-05 2024-04-19T03:02:57.882 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.882 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.882 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:57.882 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249646+0000", 2024-04-19T03:02:57.882 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1053e-05 2024-04-19T03:02:57.883 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.883 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.883 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:57.883 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249650+0000", 2024-04-19T03:02:57.883 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2719999999999999e-06 2024-04-19T03:02:57.883 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.883 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.883 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:57.883 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249686+0000", 2024-04-19T03:02:57.883 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6430000000000002e-05 2024-04-19T03:02:57.883 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.883 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.883 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op must wait for map", 2024-04-19T03:02:57.884 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249690+0000", 2024-04-19T03:02:57.884 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.765e-06 2024-04-19T03:02:57.884 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.884 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.884 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:57.884 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261157+0000", 2024-04-19T03:02:57.884 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011467247999999999 2024-04-19T03:02:57.884 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.884 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.884 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:02:57.884 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261170+0000", 2024-04-19T03:02:57.884 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2833000000000001e-05 2024-04-19T03:02:57.884 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.884 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.885 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:57.885 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.272119+0000", 2024-04-19T03:02:57.885 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.010949313 2024-04-19T03:02:57.885 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.885 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.885 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:57.885 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.273678+0000", 2024-04-19T03:02:57.885 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0015581550000000001 2024-04-19T03:02:57.885 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:57.885 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:57.885 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:57.885 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.885 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.885 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87133 5.c 5:3f772a62:::benchmark_data_smithi096_19531_object87132:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:02:57.886 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249657+0000", 2024-04-19T03:02:57.886 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 34.537115081000003, 2024-04-19T03:02:57.886 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0242819409999999, 2024-04-19T03:02:57.886 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:57.886 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-04-19T03:02:57.886 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:57.886 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:57.886 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:57.886 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87133 2024-04-19T03:02:57.886 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.886 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:57.886 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.886 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:57.887 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249657+0000", 2024-04-19T03:02:57.887 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:57.887 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.887 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.887 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:57.887 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249657+0000", 2024-04-19T03:02:57.887 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:57.887 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.887 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.887 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:57.887 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249657+0000", 2024-04-19T03:02:57.887 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:57.887 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.888 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.888 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:57.888 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249690+0000", 2024-04-19T03:02:57.888 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3343000000000002e-05 2024-04-19T03:02:57.888 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.888 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.888 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:57.888 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249695+0000", 2024-04-19T03:02:57.888 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8600000000000001e-06 2024-04-19T03:02:57.888 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.888 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.888 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:57.888 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249698+0000", 2024-04-19T03:02:57.888 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.1700000000000001e-06 2024-04-19T03:02:57.888 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.889 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.889 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:57.889 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249741+0000", 2024-04-19T03:02:57.889 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2849999999999998e-05 2024-04-19T03:02:57.889 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.889 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.889 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:02:57.889 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249746+0000", 2024-04-19T03:02:57.889 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1019999999999996e-06 2024-04-19T03:02:57.889 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.889 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.889 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:57.889 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261209+0000", 2024-04-19T03:02:57.890 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011462447000000001 2024-04-19T03:02:57.890 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.890 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.890 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:02:57.890 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261216+0000", 2024-04-19T03:02:57.890 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8520000000000004e-06 2024-04-19T03:02:57.890 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.890 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.890 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:57.890 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.273872+0000", 2024-04-19T03:02:57.890 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0126558000000001 2024-04-19T03:02:57.890 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.890 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.890 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:57.891 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.273939+0000", 2024-04-19T03:02:57.891 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6822000000000005e-05 2024-04-19T03:02:57.891 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:57.891 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:57.891 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:57.891 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.891 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.891 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87134 5.5 5:a56c478f:::benchmark_data_smithi096_19531_object87133:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:02:57.891 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249708+0000", 2024-04-19T03:02:57.891 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 34.537064157000003, 2024-04-19T03:02:57.891 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0214677299999999, 2024-04-19T03:02:57.891 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:57.891 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-04-19T03:02:57.891 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:57.892 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:57.892 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:57.892 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87134 2024-04-19T03:02:57.892 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.892 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:57.892 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.892 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:57.892 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249708+0000", 2024-04-19T03:02:57.892 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:57.892 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.892 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.892 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:57.893 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249708+0000", 2024-04-19T03:02:57.893 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:57.893 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.893 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.893 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:57.893 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249706+0000", 2024-04-19T03:02:57.893 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999976 2024-04-19T03:02:57.893 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.893 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.893 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:57.893 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249740+0000", 2024-04-19T03:02:57.893 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4458000000000001e-05 2024-04-19T03:02:57.893 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.894 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.894 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:57.894 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249745+0000", 2024-04-19T03:02:57.894 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5020000000000003e-06 2024-04-19T03:02:57.894 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.894 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.894 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:57.894 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249748+0000", 2024-04-19T03:02:57.894 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2499999999999998e-06 2024-04-19T03:02:57.894 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.894 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.894 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:57.894 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249778+0000", 2024-04-19T03:02:57.895 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.006e-05 2024-04-19T03:02:57.895 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.895 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.895 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op must wait for map", 2024-04-19T03:02:57.895 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249782+0000", 2024-04-19T03:02:57.895 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2910000000000001e-06 2024-04-19T03:02:57.895 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.895 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.895 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:57.895 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261666+0000", 2024-04-19T03:02:57.895 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011883471 2024-04-19T03:02:57.895 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.895 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.895 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:02:57.896 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261674+0000", 2024-04-19T03:02:57.896 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6479999999999992e-06 2024-04-19T03:02:57.896 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.896 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.896 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:57.896 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.269323+0000", 2024-04-19T03:02:57.896 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.00764867 2024-04-19T03:02:57.896 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.896 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.896 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:57.896 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.271176+0000", 2024-04-19T03:02:57.896 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001852844 2024-04-19T03:02:57.896 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:57.897 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:57.897 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:57.897 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.897 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.897 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87137 5.c 5:30708c68:::benchmark_data_smithi096_19531_object87136:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:02:57.897 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249756+0000", 2024-04-19T03:02:57.897 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 34.537016451, 2024-04-19T03:02:57.897 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.033331752, 2024-04-19T03:02:57.897 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:57.897 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:57.897 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:57.897 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:57.897 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:57.897 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87137 2024-04-19T03:02:57.898 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.898 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:57.898 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.898 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:57.898 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249756+0000", 2024-04-19T03:02:57.898 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:57.898 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.898 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.898 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:57.898 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249756+0000", 2024-04-19T03:02:57.898 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:57.898 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.898 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.899 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:57.899 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249755+0000", 2024-04-19T03:02:57.899 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:57.899 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.899 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.899 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:57.899 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249777+0000", 2024-04-19T03:02:57.899 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1420000000000002e-05 2024-04-19T03:02:57.899 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.899 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.899 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:57.899 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249781+0000", 2024-04-19T03:02:57.899 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0609999999999997e-06 2024-04-19T03:02:57.899 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.900 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.900 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:57.900 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249787+0000", 2024-04-19T03:02:57.900 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.02e-06 2024-04-19T03:02:57.900 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.900 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.900 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:57.900 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249818+0000", 2024-04-19T03:02:57.900 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0947e-05 2024-04-19T03:02:57.900 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.900 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.900 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:02:57.900 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249821+0000", 2024-04-19T03:02:57.901 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.117e-06 2024-04-19T03:02:57.901 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.901 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.901 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:57.901 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261243+0000", 2024-04-19T03:02:57.901 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011421875999999999 2024-04-19T03:02:57.901 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.901 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.901 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:02:57.901 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261251+0000", 2024-04-19T03:02:57.901 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6120000000000001e-06 2024-04-19T03:02:57.901 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.901 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.901 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:57.902 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.274050+0000", 2024-04-19T03:02:57.902 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.012799405 2024-04-19T03:02:57.902 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.902 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.902 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:57.902 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.274529+0000", 2024-04-19T03:02:57.902 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00047867100000000001 2024-04-19T03:02:57.902 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.902 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.902 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:57.902 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.282972+0000", 2024-04-19T03:02:57.902 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0084436900000000002 2024-04-19T03:02:57.903 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.903 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.903 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:57.903 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.283022+0000", 2024-04-19T03:02:57.903 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9339000000000003e-05 2024-04-19T03:02:57.903 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:57.903 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:57.903 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:57.903 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.283088+0000", 2024-04-19T03:02:57.903 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5877999999999995e-05 2024-04-19T03:02:57.903 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:57.903 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:57.904 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:57.904 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:57.904 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:57.904 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-04-19T03:02:57.905 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:57.900+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:57.906 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T03:02:58.006 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:58.004+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:58.029 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-19T03:02:58.029 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-04-19T03:02:58.029 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.029 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:158096 5.8 5:1e693b0e:::benchmark_data_smithi096_19531_object44646:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-19T03:02:58.029 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:58.024941+0000", 2024-04-19T03:02:58.030 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0045069960000000001, 2024-04-19T03:02:58.030 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0045327379999999997, 2024-04-19T03:02:58.030 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:58.030 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-19T03:02:58.030 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:58.030 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:58.030 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:58.030 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 158096 2024-04-19T03:02:58.030 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.030 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:58.030 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.030 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:58.030 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.024941+0000", 2024-04-19T03:02:58.031 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:58.031 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.031 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.031 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:58.031 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.024941+0000", 2024-04-19T03:02:58.031 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:58.031 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.031 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.031 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:58.031 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.024940+0000", 2024-04-19T03:02:58.031 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:58.031 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.031 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.032 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:58.032 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.024945+0000", 2024-04-19T03:02:58.032 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1089999999999997e-06 2024-04-19T03:02:58.032 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.032 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.032 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:58.032 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.024980+0000", 2024-04-19T03:02:58.032 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4853e-05 2024-04-19T03:02:58.032 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.032 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.032 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:58.032 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.024991+0000", 2024-04-19T03:02:58.032 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0468e-05 2024-04-19T03:02:58.032 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.033 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.033 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:58.033 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.025041+0000", 2024-04-19T03:02:58.033 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0235000000000003e-05 2024-04-19T03:02:58.033 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.033 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.033 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:58.033 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.025177+0000", 2024-04-19T03:02:58.033 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013581800000000001 2024-04-19T03:02:58.033 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:58.033 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:58.033 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:58.033 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.034 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.034 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:158097 5.8 5:14a57410:::benchmark_data_smithi096_19531_object44647:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-19T03:02:58.034 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:58.025001+0000", 2024-04-19T03:02:58.034 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0044472950000000004, 2024-04-19T03:02:58.034 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0045321420000000003, 2024-04-19T03:02:58.034 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:58.034 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-19T03:02:58.034 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:58.034 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:58.034 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:58.034 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 158097 2024-04-19T03:02:58.034 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.034 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:58.034 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.035 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:58.035 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.025001+0000", 2024-04-19T03:02:58.035 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:58.035 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.035 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.035 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:58.035 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.025001+0000", 2024-04-19T03:02:58.035 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:58.035 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.035 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.035 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:58.035 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.025000+0000", 2024-04-19T03:02:58.035 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:58.036 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.036 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.036 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:58.036 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.025004+0000", 2024-04-19T03:02:58.036 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2849999999999999e-06 2024-04-19T03:02:58.036 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.036 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.036 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:58.036 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.025009+0000", 2024-04-19T03:02:58.036 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.113e-06 2024-04-19T03:02:58.036 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.036 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.036 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:58.037 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.025012+0000", 2024-04-19T03:02:58.037 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0450000000000001e-06 2024-04-19T03:02:58.037 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.037 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.037 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:58.037 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.027180+0000", 2024-04-19T03:02:58.037 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0021680689999999999 2024-04-19T03:02:58.037 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.037 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.037 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:58.037 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.027258+0000", 2024-04-19T03:02:58.037 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.8591999999999996e-05 2024-04-19T03:02:58.037 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:58.038 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:58.038 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:58.038 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.038 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.038 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:158099 5.b 5:d0613e2d:::benchmark_data_smithi096_19531_object44649:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-19T03:02:58.038 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:58.025028+0000", 2024-04-19T03:02:58.038 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0044199560000000001, 2024-04-19T03:02:58.038 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0045404709999999999, 2024-04-19T03:02:58.038 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:58.038 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-19T03:02:58.038 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:58.038 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:58.038 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:58.039 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 158099 2024-04-19T03:02:58.039 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.039 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:58.039 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.039 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:58.039 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.025028+0000", 2024-04-19T03:02:58.039 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:58.039 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.039 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.039 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:58.039 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.025028+0000", 2024-04-19T03:02:58.039 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:58.039 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.039 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.039 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:58.040 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.025028+0000", 2024-04-19T03:02:58.040 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:58.040 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.040 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.040 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:58.040 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.025030+0000", 2024-04-19T03:02:58.040 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5270000000000001e-06 2024-04-19T03:02:58.040 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.040 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.040 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:58.040 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.025037+0000", 2024-04-19T03:02:58.040 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5180000000000001e-06 2024-04-19T03:02:58.040 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.040 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.041 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:58.041 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.025044+0000", 2024-04-19T03:02:58.041 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.798e-06 2024-04-19T03:02:58.041 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.041 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.041 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:58.041 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.025072+0000", 2024-04-19T03:02:58.041 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.8212999999999999e-05 2024-04-19T03:02:58.041 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.041 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.041 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:58.041 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.025169+0000", 2024-04-19T03:02:58.042 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.7483000000000002e-05 2024-04-19T03:02:58.042 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:58.042 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:58.042 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:58.042 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.042 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.042 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4755.0:158100 5.d e56/49 5:ba3cbd7c:::benchmark_data_smithi096_19531_object44650:head v 56'10032, mlcod=56'10030)", 2024-04-19T03:02:58.042 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:58.025757+0000", 2024-04-19T03:02:58.042 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0036907889999999999, 2024-04-19T03:02:58.042 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0038444619999999999, 2024-04-19T03:02:58.042 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:58.042 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-19T03:02:58.042 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:58.043 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.043 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:58.043 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.025757+0000", 2024-04-19T03:02:58.043 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:58.043 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.043 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.043 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:58.043 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.025757+0000", 2024-04-19T03:02:58.043 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:58.043 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.043 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.043 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:58.043 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.025757+0000", 2024-04-19T03:02:58.043 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:58.043 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.044 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.044 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:58.044 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.025761+0000", 2024-04-19T03:02:58.044 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6569999999999996e-06 2024-04-19T03:02:58.044 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.044 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.044 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:58.044 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.025772+0000", 2024-04-19T03:02:58.044 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0882e-05 2024-04-19T03:02:58.044 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.044 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.044 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:58.044 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.025777+0000", 2024-04-19T03:02:58.045 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6079999999999998e-06 2024-04-19T03:02:58.045 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.045 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.045 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:58.045 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.025820+0000", 2024-04-19T03:02:58.045 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.286e-05 2024-04-19T03:02:58.045 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.045 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.045 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:58.045 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.025844+0000", 2024-04-19T03:02:58.045 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.446e-05 2024-04-19T03:02:58.045 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:58.045 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:58.046 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:58.046 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.046 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.046 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:158101 5.8 5:184762a9:::benchmark_data_smithi096_19531_object44651:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-19T03:02:58.046 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:58.027076+0000", 2024-04-19T03:02:58.046 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.002371761, 2024-04-19T03:02:58.046 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0025566590000000002, 2024-04-19T03:02:58.046 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:58.046 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-19T03:02:58.046 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:58.046 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:58.046 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:58.046 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 158101 2024-04-19T03:02:58.047 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.047 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:58.047 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.047 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:58.047 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.027076+0000", 2024-04-19T03:02:58.047 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:58.047 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.047 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.047 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:58.047 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.027076+0000", 2024-04-19T03:02:58.047 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:58.047 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.048 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.048 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:58.048 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.027076+0000", 2024-04-19T03:02:58.048 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:58.048 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.048 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.048 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:58.048 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.027081+0000", 2024-04-19T03:02:58.048 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2809999999999999e-06 2024-04-19T03:02:58.048 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.048 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.048 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:58.048 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.027101+0000", 2024-04-19T03:02:58.048 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0336e-05 2024-04-19T03:02:58.048 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.049 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.049 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:58.049 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.027107+0000", 2024-04-19T03:02:58.049 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8599999999999998e-06 2024-04-19T03:02:58.049 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.049 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.049 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:58.049 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.028771+0000", 2024-04-19T03:02:58.049 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0016636070000000001 2024-04-19T03:02:58.049 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.049 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.049 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:58.049 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.028921+0000", 2024-04-19T03:02:58.050 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015025100000000001 2024-04-19T03:02:58.050 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:58.050 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:58.050 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:58.050 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.050 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.050 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:158102 5.a 5:5524b5a3:::benchmark_data_smithi096_19531_object44652:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-19T03:02:58.050 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:58.027115+0000", 2024-04-19T03:02:58.050 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0023334749999999998, 2024-04-19T03:02:58.050 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0025509030000000002, 2024-04-19T03:02:58.050 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:58.050 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-19T03:02:58.050 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:58.050 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:58.051 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:58.051 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 158102 2024-04-19T03:02:58.051 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.051 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:58.051 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.051 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:58.051 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.027115+0000", 2024-04-19T03:02:58.051 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:58.051 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.051 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.051 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:58.051 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.027115+0000", 2024-04-19T03:02:58.051 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:58.052 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.052 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.052 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:58.052 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.027114+0000", 2024-04-19T03:02:58.052 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:58.052 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.052 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.052 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:58.052 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.027117+0000", 2024-04-19T03:02:58.052 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9699999999999999e-06 2024-04-19T03:02:58.052 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.052 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.053 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:58.053 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.027124+0000", 2024-04-19T03:02:58.053 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.331e-06 2024-04-19T03:02:58.053 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.053 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.053 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:58.053 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.027127+0000", 2024-04-19T03:02:58.053 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0259999999999999e-06 2024-04-19T03:02:58.053 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.053 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.053 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:58.053 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.027169+0000", 2024-04-19T03:02:58.054 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2534999999999998e-05 2024-04-19T03:02:58.054 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.054 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.054 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:58.054 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.027254+0000", 2024-04-19T03:02:58.054 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.5257e-05 2024-04-19T03:02:58.054 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:58.054 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:58.054 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:58.054 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.054 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.054 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4755.0:158098 5.f e56/22 5:f90cdbe2:::benchmark_data_smithi096_19531_object44648:head v 56'9842, mlcod=56'9837)", 2024-04-19T03:02:58.055 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:58.027715+0000", 2024-04-19T03:02:58.055 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0017326990000000001, 2024-04-19T03:02:58.055 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0019820480000000001, 2024-04-19T03:02:58.055 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:58.055 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-19T03:02:58.055 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:58.055 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.055 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:58.055 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.027715+0000", 2024-04-19T03:02:58.055 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:58.055 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.055 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.055 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:58.056 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.027715+0000", 2024-04-19T03:02:58.056 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:58.056 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.056 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.056 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:58.056 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.027715+0000", 2024-04-19T03:02:58.056 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:58.056 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.056 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.056 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:58.056 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.027721+0000", 2024-04-19T03:02:58.056 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.161e-06 2024-04-19T03:02:58.057 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.057 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.057 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:58.057 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.027738+0000", 2024-04-19T03:02:58.057 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6710000000000001e-05 2024-04-19T03:02:58.057 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.057 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.057 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:58.057 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.027745+0000", 2024-04-19T03:02:58.057 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.9809999999999997e-06 2024-04-19T03:02:58.057 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.057 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.058 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:58.058 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.027804+0000", 2024-04-19T03:02:58.058 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9110999999999997e-05 2024-04-19T03:02:58.058 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.058 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.058 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:58.058 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.027827+0000", 2024-04-19T03:02:58.058 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2969999999999999e-05 2024-04-19T03:02:58.058 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:58.058 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:58.058 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:58.059 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:58.059 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-04-19T03:02:58.059 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 7 2024-04-19T03:02:58.059 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-19T03:02:58.060 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T03:02:58.107 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:58.102+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:58.171 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-19T03:02:58.171 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-04-19T03:02:58.171 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-04-19T03:02:58.171 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-04-19T03:02:58.172 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-19T03:02:58.181 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T03:02:58.208 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:58.204+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:58.305 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-19T03:02:58.305 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-04-19T03:02:58.305 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-04-19T03:02:58.305 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-04-19T03:02:58.305 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.305 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:86615 5.e 5:7fef7288:::benchmark_data_smithi096_19531_object86614:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:58.305 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:22.634544+0000", 2024-04-19T03:02:58.306 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 35.668405258999996, 2024-04-19T03:02:58.306 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.192475071, 2024-04-19T03:02:58.306 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:58.306 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:58.306 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:58.306 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:58.306 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:58.306 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 86615 2024-04-19T03:02:58.306 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.306 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:58.306 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.307 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:58.307 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634544+0000", 2024-04-19T03:02:58.307 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:58.307 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.307 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.307 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:58.307 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634544+0000", 2024-04-19T03:02:58.307 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:58.307 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.307 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.307 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:58.307 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634542+0000", 2024-04-19T03:02:58.307 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999981 2024-04-19T03:02:58.307 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.308 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.308 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:58.308 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634585+0000", 2024-04-19T03:02:58.308 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2299000000000003e-05 2024-04-19T03:02:58.308 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.308 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.308 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:58.308 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634592+0000", 2024-04-19T03:02:58.308 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2350000000000002e-06 2024-04-19T03:02:58.308 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.308 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.308 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:58.308 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634596+0000", 2024-04-19T03:02:58.308 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5390000000000001e-06 2024-04-19T03:02:58.309 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.309 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.309 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:58.310 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634639+0000", 2024-04-19T03:02:58.310 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2444999999999998e-05 2024-04-19T03:02:58.310 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.310 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.310 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:58.310 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634808+0000", 2024-04-19T03:02:58.311 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000169152 2024-04-19T03:02:58.311 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.311 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.311 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:58.311 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634999+0000", 2024-04-19T03:02:58.311 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00019098300000000001 2024-04-19T03:02:58.311 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.311 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.311 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:58.311 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.640458+0000", 2024-04-19T03:02:58.311 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0054586870000000003 2024-04-19T03:02:58.311 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.311 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.311 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:58.311 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.826949+0000", 2024-04-19T03:02:58.312 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.18649178299999999 2024-04-19T03:02:58.312 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.312 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.312 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:58.312 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.826982+0000", 2024-04-19T03:02:58.312 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2477000000000001e-05 2024-04-19T03:02:58.312 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.312 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.312 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:58.312 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.827019+0000", 2024-04-19T03:02:58.312 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7355999999999999e-05 2024-04-19T03:02:58.312 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:58.313 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:58.313 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:58.313 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.313 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.313 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:86616 5.e 5:72278f47:::benchmark_data_smithi096_19531_object86615:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:58.313 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:22.634609+0000", 2024-04-19T03:02:58.313 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 35.668340110000003, 2024-04-19T03:02:58.313 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.19472088900000001, 2024-04-19T03:02:58.313 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:58.313 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:58.313 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:58.313 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:58.313 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:58.313 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 86616 2024-04-19T03:02:58.314 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.314 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:58.314 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.314 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:58.314 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634609+0000", 2024-04-19T03:02:58.314 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:58.314 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.314 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.314 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:58.314 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634609+0000", 2024-04-19T03:02:58.314 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:58.314 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.314 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.315 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:58.315 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634609+0000", 2024-04-19T03:02:58.315 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:58.315 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.315 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.315 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:58.315 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634651+0000", 2024-04-19T03:02:58.315 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2589000000000002e-05 2024-04-19T03:02:58.315 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.315 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.315 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:58.315 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634659+0000", 2024-04-19T03:02:58.315 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5850000000000002e-06 2024-04-19T03:02:58.315 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.316 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.316 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:58.316 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634662+0000", 2024-04-19T03:02:58.316 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3620000000000002e-06 2024-04-19T03:02:58.316 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.316 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.316 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:58.316 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.637880+0000", 2024-04-19T03:02:58.316 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.003218149 2024-04-19T03:02:58.316 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.317 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.317 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:58.317 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.637999+0000", 2024-04-19T03:02:58.317 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000118643 2024-04-19T03:02:58.317 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.317 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.317 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:58.317 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.638102+0000", 2024-04-19T03:02:58.317 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010331 2024-04-19T03:02:58.317 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.317 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.317 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:58.317 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.640851+0000", 2024-04-19T03:02:58.317 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0027483310000000001 2024-04-19T03:02:58.318 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.318 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.318 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:58.318 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.829269+0000", 2024-04-19T03:02:58.318 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.188418319 2024-04-19T03:02:58.318 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.318 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.318 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:58.318 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.829299+0000", 2024-04-19T03:02:58.318 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0227e-05 2024-04-19T03:02:58.318 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.318 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.318 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:58.319 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.829330+0000", 2024-04-19T03:02:58.319 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0969000000000001e-05 2024-04-19T03:02:58.319 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:58.319 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:58.319 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:58.319 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.319 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.319 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:86618 5.0 5:09014b90:::benchmark_data_smithi096_19531_object86617:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:58.319 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:22.634894+0000", 2024-04-19T03:02:58.319 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 35.668055621999997, 2024-04-19T03:02:58.319 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.19413419800000001, 2024-04-19T03:02:58.319 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:58.319 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:58.319 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:58.320 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:58.320 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:58.320 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 86618 2024-04-19T03:02:58.320 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.320 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:58.320 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.320 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:58.320 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634894+0000", 2024-04-19T03:02:58.320 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:58.320 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.320 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.320 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:58.321 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634894+0000", 2024-04-19T03:02:58.321 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:58.321 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.321 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.321 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:58.321 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634893+0000", 2024-04-19T03:02:58.321 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:58.321 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.321 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.321 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:58.321 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634976+0000", 2024-04-19T03:02:58.322 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3231000000000003e-05 2024-04-19T03:02:58.322 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.322 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.322 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:58.322 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634983+0000", 2024-04-19T03:02:58.322 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5169999999999996e-06 2024-04-19T03:02:58.322 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.322 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.322 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:58.322 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634987+0000", 2024-04-19T03:02:58.322 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.425e-06 2024-04-19T03:02:58.322 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.322 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.323 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:58.323 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635030+0000", 2024-04-19T03:02:58.323 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.32e-05 2024-04-19T03:02:58.323 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.323 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.323 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:58.323 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635185+0000", 2024-04-19T03:02:58.323 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015471899999999999 2024-04-19T03:02:58.323 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.323 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.323 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:58.323 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635415+0000", 2024-04-19T03:02:58.324 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00023026500000000001 2024-04-19T03:02:58.324 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.324 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.324 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:58.324 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.640127+0000", 2024-04-19T03:02:58.324 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0047118890000000004 2024-04-19T03:02:58.324 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.324 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.324 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:58.324 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.828895+0000", 2024-04-19T03:02:58.324 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.18876802600000001 2024-04-19T03:02:58.324 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.324 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.325 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:58.325 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.828972+0000", 2024-04-19T03:02:58.325 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.6345000000000002e-05 2024-04-19T03:02:58.325 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.325 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.325 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:58.325 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.829028+0000", 2024-04-19T03:02:58.325 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6342999999999999e-05 2024-04-19T03:02:58.325 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:58.326 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:58.326 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:58.326 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.326 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.326 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:86620 5.b 5:d80faa68:::benchmark_data_smithi096_19531_object86619:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:58.326 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:22.635110+0000", 2024-04-19T03:02:58.326 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 35.667839061999999, 2024-04-19T03:02:58.326 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.193447275, 2024-04-19T03:02:58.326 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:58.326 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:58.326 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:58.326 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:58.326 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:58.327 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 86620 2024-04-19T03:02:58.327 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.327 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:58.327 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.327 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:58.327 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635110+0000", 2024-04-19T03:02:58.327 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:58.327 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.327 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.327 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:58.327 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635110+0000", 2024-04-19T03:02:58.327 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:58.327 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.328 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.328 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:58.328 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635110+0000", 2024-04-19T03:02:58.328 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:58.328 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.328 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.328 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:58.328 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635154+0000", 2024-04-19T03:02:58.328 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4681000000000001e-05 2024-04-19T03:02:58.328 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.328 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.328 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:58.329 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635166+0000", 2024-04-19T03:02:58.329 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1505000000000001e-05 2024-04-19T03:02:58.329 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.329 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.329 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:58.329 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635171+0000", 2024-04-19T03:02:58.329 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6040000000000003e-06 2024-04-19T03:02:58.329 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.329 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.329 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:58.329 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635221+0000", 2024-04-19T03:02:58.329 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9947000000000001e-05 2024-04-19T03:02:58.329 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.330 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.330 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:58.330 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635356+0000", 2024-04-19T03:02:58.330 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013576199999999999 2024-04-19T03:02:58.330 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.330 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.330 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:58.330 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635507+0000", 2024-04-19T03:02:58.330 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015072999999999999 2024-04-19T03:02:58.330 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.330 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.330 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:58.330 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.638488+0000", 2024-04-19T03:02:58.331 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0029813159999999999 2024-04-19T03:02:58.331 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.331 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.331 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:58.331 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.828341+0000", 2024-04-19T03:02:58.331 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.189852254 2024-04-19T03:02:58.331 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.331 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.331 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:58.331 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.828416+0000", 2024-04-19T03:02:58.331 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5344000000000002e-05 2024-04-19T03:02:58.331 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.331 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.331 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:58.332 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.828558+0000", 2024-04-19T03:02:58.332 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000141695 2024-04-19T03:02:58.332 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:58.332 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:58.332 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:58.332 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.332 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.332 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:86621 5.8 5:1597a420:::benchmark_data_smithi096_19531_object86620:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:58.332 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:22.635187+0000", 2024-04-19T03:02:58.332 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 35.667762201999999, 2024-04-19T03:02:58.332 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.194204878, 2024-04-19T03:02:58.332 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:58.332 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:58.333 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:58.333 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:58.333 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:58.333 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 86621 2024-04-19T03:02:58.333 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.333 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:58.333 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.333 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:58.333 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635187+0000", 2024-04-19T03:02:58.333 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:58.333 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.333 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.333 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:58.333 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635187+0000", 2024-04-19T03:02:58.334 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:58.334 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.334 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.334 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:58.334 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635187+0000", 2024-04-19T03:02:58.334 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:58.334 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.334 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.334 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:58.334 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635242+0000", 2024-04-19T03:02:58.334 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5158000000000003e-05 2024-04-19T03:02:58.334 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.335 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.335 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:58.335 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635249+0000", 2024-04-19T03:02:58.335 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.7000000000000008e-06 2024-04-19T03:02:58.335 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.335 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.335 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:58.335 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635256+0000", 2024-04-19T03:02:58.335 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2060000000000004e-06 2024-04-19T03:02:58.335 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.335 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.335 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:58.335 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635302+0000", 2024-04-19T03:02:58.335 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5954000000000001e-05 2024-04-19T03:02:58.336 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.336 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.336 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:58.336 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635427+0000", 2024-04-19T03:02:58.337 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012559299999999999 2024-04-19T03:02:58.337 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.337 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.337 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:58.337 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635596+0000", 2024-04-19T03:02:58.337 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000168615 2024-04-19T03:02:58.337 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.337 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.337 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:58.337 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.639320+0000", 2024-04-19T03:02:58.337 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0037244610000000001 2024-04-19T03:02:58.338 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.338 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.338 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:58.338 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.829277+0000", 2024-04-19T03:02:58.338 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.18995651099999999 2024-04-19T03:02:58.338 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.338 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.338 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:58.338 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.829341+0000", 2024-04-19T03:02:58.338 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3756000000000004e-05 2024-04-19T03:02:58.338 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.338 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.338 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:58.338 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.829392+0000", 2024-04-19T03:02:58.339 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1555999999999999e-05 2024-04-19T03:02:58.339 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:58.339 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:58.339 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:58.339 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.339 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.339 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87067 5.b 5:d57af71a:::benchmark_data_smithi096_19531_object87066:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:58.339 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.142233+0000", 2024-04-19T03:02:58.339 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 35.160716338999997, 2024-04-19T03:02:58.339 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.071692405000000001, 2024-04-19T03:02:58.339 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:58.339 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:58.339 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:58.339 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:58.340 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:58.340 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87067 2024-04-19T03:02:58.340 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.340 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:58.340 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.340 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:58.340 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142233+0000", 2024-04-19T03:02:58.340 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:58.340 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.340 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.340 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:58.340 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142233+0000", 2024-04-19T03:02:58.341 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:58.341 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.341 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.341 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:58.341 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142232+0000", 2024-04-19T03:02:58.341 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:58.341 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.341 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.341 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:58.341 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142277+0000", 2024-04-19T03:02:58.341 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5837000000000002e-05 2024-04-19T03:02:58.341 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.341 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.341 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:58.342 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142297+0000", 2024-04-19T03:02:58.342 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9561000000000001e-05 2024-04-19T03:02:58.342 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.342 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.342 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:58.342 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142311+0000", 2024-04-19T03:02:58.342 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3654e-05 2024-04-19T03:02:58.342 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.342 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.342 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:58.342 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142391+0000", 2024-04-19T03:02:58.342 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0123999999999994e-05 2024-04-19T03:02:58.342 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.342 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.343 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:58.343 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142669+0000", 2024-04-19T03:02:58.343 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00027829800000000001 2024-04-19T03:02:58.343 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.343 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.343 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:58.343 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142859+0000", 2024-04-19T03:02:58.343 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000190051 2024-04-19T03:02:58.343 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.343 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.343 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:58.343 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.150597+0000", 2024-04-19T03:02:58.343 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0077380299999999999 2024-04-19T03:02:58.343 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.344 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.344 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:58.344 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.213855+0000", 2024-04-19T03:02:58.344 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.063257987000000002 2024-04-19T03:02:58.344 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.344 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.344 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:58.344 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.213898+0000", 2024-04-19T03:02:58.344 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2916e-05 2024-04-19T03:02:58.344 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.344 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.344 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:58.344 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.213925+0000", 2024-04-19T03:02:58.345 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7503000000000001e-05 2024-04-19T03:02:58.345 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:58.345 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:58.345 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:58.345 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.345 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.345 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87069 5.b 5:da0c93b5:::benchmark_data_smithi096_19531_object87068:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:58.345 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.143402+0000", 2024-04-19T03:02:58.345 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 35.159547377000003, 2024-04-19T03:02:58.345 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.070678598999999995, 2024-04-19T03:02:58.345 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:58.345 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:58.345 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:58.345 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:58.345 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:58.346 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87069 2024-04-19T03:02:58.346 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.346 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:58.346 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.346 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:58.346 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.143402+0000", 2024-04-19T03:02:58.346 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:58.346 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.346 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.346 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:58.346 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.143402+0000", 2024-04-19T03:02:58.346 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:58.346 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.347 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.347 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:58.347 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.143401+0000", 2024-04-19T03:02:58.347 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:58.347 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.347 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.347 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:58.347 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.143501+0000", 2024-04-19T03:02:58.347 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000100387 2024-04-19T03:02:58.347 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.347 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.347 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:58.347 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.143516+0000", 2024-04-19T03:02:58.347 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5369000000000001e-05 2024-04-19T03:02:58.348 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.348 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.348 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:58.348 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.143524+0000", 2024-04-19T03:02:58.348 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.7079999999999997e-06 2024-04-19T03:02:58.348 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.348 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.348 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:58.348 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.145550+0000", 2024-04-19T03:02:58.348 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0020259290000000001 2024-04-19T03:02:58.348 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.348 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.348 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:58.348 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.145676+0000", 2024-04-19T03:02:58.349 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000126406 2024-04-19T03:02:58.349 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.349 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.349 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:58.349 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.145802+0000", 2024-04-19T03:02:58.349 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000125974 2024-04-19T03:02:58.349 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.349 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.349 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:58.349 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.151030+0000", 2024-04-19T03:02:58.349 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0052276079999999999 2024-04-19T03:02:58.349 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.349 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.349 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:58.350 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.213998+0000", 2024-04-19T03:02:58.350 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.06296786 2024-04-19T03:02:58.350 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.350 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.350 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:58.350 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.214031+0000", 2024-04-19T03:02:58.350 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3387999999999999e-05 2024-04-19T03:02:58.350 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.350 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.350 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:58.350 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.214081+0000", 2024-04-19T03:02:58.350 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9316e-05 2024-04-19T03:02:58.351 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:58.351 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:58.351 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:58.351 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.351 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.351 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87108 5.e 5:7e197adc:::benchmark_data_smithi096_19531_object87107:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:58.351 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.223103+0000", 2024-04-19T03:02:58.351 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 35.07984604, 2024-04-19T03:02:58.351 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.044946887, 2024-04-19T03:02:58.351 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:58.351 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-19T03:02:58.351 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:58.351 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:58.352 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:58.352 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87108 2024-04-19T03:02:58.352 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.352 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:58.352 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.352 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:58.352 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.223103+0000", 2024-04-19T03:02:58.352 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:58.352 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.352 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.352 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:58.352 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.223103+0000", 2024-04-19T03:02:58.352 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:58.353 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.353 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.353 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:58.353 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.223102+0000", 2024-04-19T03:02:58.353 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:58.353 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.353 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.353 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:58.353 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.223156+0000", 2024-04-19T03:02:58.353 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3958000000000001e-05 2024-04-19T03:02:58.353 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.353 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.353 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:58.353 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.223166+0000", 2024-04-19T03:02:58.354 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.4809999999999995e-06 2024-04-19T03:02:58.354 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.354 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.354 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:58.354 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.223172+0000", 2024-04-19T03:02:58.354 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0140000000000004e-06 2024-04-19T03:02:58.354 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.354 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.354 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:58.354 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.227295+0000", 2024-04-19T03:02:58.354 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0041233420000000003 2024-04-19T03:02:58.354 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.354 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.355 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:58.355 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.227495+0000", 2024-04-19T03:02:58.355 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00019955299999999999 2024-04-19T03:02:58.355 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.355 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.355 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:58.355 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.227717+0000", 2024-04-19T03:02:58.355 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000221902 2024-04-19T03:02:58.355 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.355 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.355 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:58.355 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233189+0000", 2024-04-19T03:02:58.355 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0054718889999999997 2024-04-19T03:02:58.355 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.356 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.356 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:58.356 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.250529+0000", 2024-04-19T03:02:58.356 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.017340298000000001 2024-04-19T03:02:58.356 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.356 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.356 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:02:58.356 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.250539+0000", 2024-04-19T03:02:58.356 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0501e-05 2024-04-19T03:02:58.356 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.356 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.356 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:58.356 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.268003+0000", 2024-04-19T03:02:58.357 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.017463429 2024-04-19T03:02:58.357 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.357 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.357 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:58.357 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.268050+0000", 2024-04-19T03:02:58.357 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7466000000000003e-05 2024-04-19T03:02:58.357 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:58.357 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:58.357 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:58.357 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.357 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.357 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87118 5.b 5:d1bb4f3c:::benchmark_data_smithi096_19531_object87117:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:58.357 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.231082+0000", 2024-04-19T03:02:58.357 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 35.071867206, 2024-04-19T03:02:58.358 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.035789004, 2024-04-19T03:02:58.358 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:58.358 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-19T03:02:58.358 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:58.358 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:58.358 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:58.358 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87118 2024-04-19T03:02:58.358 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.358 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:58.358 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.358 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:58.358 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231082+0000", 2024-04-19T03:02:58.358 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:58.359 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.359 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.359 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:58.359 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231082+0000", 2024-04-19T03:02:58.359 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:58.359 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.359 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.359 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:58.359 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231081+0000", 2024-04-19T03:02:58.359 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:58.359 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.359 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.359 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:58.360 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231159+0000", 2024-04-19T03:02:58.360 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.7819999999999997e-05 2024-04-19T03:02:58.360 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.360 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.360 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:58.360 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231186+0000", 2024-04-19T03:02:58.360 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7126000000000001e-05 2024-04-19T03:02:58.360 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.360 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.360 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:58.360 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231193+0000", 2024-04-19T03:02:58.360 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7259999999999996e-06 2024-04-19T03:02:58.360 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.360 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.361 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:58.361 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231241+0000", 2024-04-19T03:02:58.361 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8123e-05 2024-04-19T03:02:58.361 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.361 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.361 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:58.361 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231354+0000", 2024-04-19T03:02:58.361 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0001133 2024-04-19T03:02:58.361 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.361 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.361 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:58.361 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231443+0000", 2024-04-19T03:02:58.362 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9167999999999997e-05 2024-04-19T03:02:58.362 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.362 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.362 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:58.362 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236498+0000", 2024-04-19T03:02:58.362 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0050545160000000002 2024-04-19T03:02:58.362 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.362 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.362 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:58.362 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.249681+0000", 2024-04-19T03:02:58.362 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013183321 2024-04-19T03:02:58.362 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.362 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.363 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:02:58.363 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.249693+0000", 2024-04-19T03:02:58.363 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1834999999999999e-05 2024-04-19T03:02:58.363 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.363 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.363 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:58.363 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266733+0000", 2024-04-19T03:02:58.363 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.017040408 2024-04-19T03:02:58.363 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.363 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.363 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:58.363 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266871+0000", 2024-04-19T03:02:58.363 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000137849 2024-04-19T03:02:58.364 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:58.364 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:58.364 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:58.364 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.364 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.364 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87121 5.b 5:d01822b8:::benchmark_data_smithi096_19531_object87120:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:58.364 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.233319+0000", 2024-04-19T03:02:58.364 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 35.069630342000004, 2024-04-19T03:02:58.364 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.033624198, 2024-04-19T03:02:58.364 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:58.364 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-19T03:02:58.364 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:58.365 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:58.365 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:58.365 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87121 2024-04-19T03:02:58.365 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.365 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:58.365 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.365 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:58.365 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233319+0000", 2024-04-19T03:02:58.365 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:58.365 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.365 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.365 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:58.365 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233319+0000", 2024-04-19T03:02:58.366 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:58.366 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.366 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.366 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:58.366 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233319+0000", 2024-04-19T03:02:58.366 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:58.366 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.366 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.366 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:58.366 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233364+0000", 2024-04-19T03:02:58.366 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5460999999999997e-05 2024-04-19T03:02:58.366 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.367 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.367 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:58.367 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233382+0000", 2024-04-19T03:02:58.367 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8148e-05 2024-04-19T03:02:58.367 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.367 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.367 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:58.367 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233390+0000", 2024-04-19T03:02:58.367 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5340000000000002e-06 2024-04-19T03:02:58.367 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.367 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.368 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:58.368 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233712+0000", 2024-04-19T03:02:58.368 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00032260500000000001 2024-04-19T03:02:58.368 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.368 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.368 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:58.368 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233829+0000", 2024-04-19T03:02:58.368 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011638599999999999 2024-04-19T03:02:58.368 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.368 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.368 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:58.368 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233959+0000", 2024-04-19T03:02:58.368 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013013900000000001 2024-04-19T03:02:58.368 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.369 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.369 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:58.369 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236515+0000", 2024-04-19T03:02:58.369 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0025562750000000002 2024-04-19T03:02:58.369 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.369 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.369 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:58.369 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.249723+0000", 2024-04-19T03:02:58.369 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013208176 2024-04-19T03:02:58.369 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.369 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.369 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:02:58.369 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.249728+0000", 2024-04-19T03:02:58.370 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6519999999999997e-06 2024-04-19T03:02:58.370 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.370 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.370 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:58.370 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266837+0000", 2024-04-19T03:02:58.370 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0171087059999999 2024-04-19T03:02:58.370 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.370 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.370 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:58.370 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266943+0000", 2024-04-19T03:02:58.370 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000106604 2024-04-19T03:02:58.370 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:58.370 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:58.371 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:58.371 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.371 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.371 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87124 5.8 5:14819ad7:::benchmark_data_smithi096_19531_object87123:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:58.371 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.235886+0000", 2024-04-19T03:02:58.371 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 35.067062917999998, 2024-04-19T03:02:58.371 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0315451179999999, 2024-04-19T03:02:58.371 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:58.371 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-19T03:02:58.371 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:58.371 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:58.371 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:58.371 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87124 2024-04-19T03:02:58.372 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.372 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:58.372 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.372 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:58.372 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.235886+0000", 2024-04-19T03:02:58.372 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:58.372 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.372 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.372 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:58.372 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.235886+0000", 2024-04-19T03:02:58.372 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:58.372 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.373 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.373 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:58.373 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.235886+0000", 2024-04-19T03:02:58.373 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:58.373 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.373 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.373 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:58.373 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.235934+0000", 2024-04-19T03:02:58.373 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8384000000000003e-05 2024-04-19T03:02:58.373 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.373 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.373 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:58.373 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.235945+0000", 2024-04-19T03:02:58.373 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0671e-05 2024-04-19T03:02:58.373 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.374 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.374 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:58.374 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.235952+0000", 2024-04-19T03:02:58.374 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3089999999999998e-06 2024-04-19T03:02:58.374 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.374 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.374 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:58.374 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.237067+0000", 2024-04-19T03:02:58.374 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001115263 2024-04-19T03:02:58.374 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.374 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.375 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:58.375 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.237188+0000", 2024-04-19T03:02:58.375 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000121258 2024-04-19T03:02:58.375 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.375 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.375 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:58.375 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.237316+0000", 2024-04-19T03:02:58.375 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000128071 2024-04-19T03:02:58.375 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.375 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.375 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:58.375 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240744+0000", 2024-04-19T03:02:58.375 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0034275629999999998 2024-04-19T03:02:58.376 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.376 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.376 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:58.376 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.252517+0000", 2024-04-19T03:02:58.376 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011772991999999999 2024-04-19T03:02:58.376 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.376 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.376 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:02:58.376 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.252523+0000", 2024-04-19T03:02:58.376 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3640000000000004e-06 2024-04-19T03:02:58.376 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.376 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.376 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:58.376 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.267290+0000", 2024-04-19T03:02:58.376 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0147665690000001 2024-04-19T03:02:58.377 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.377 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.377 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:58.377 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.267432+0000", 2024-04-19T03:02:58.377 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014165299999999999 2024-04-19T03:02:58.377 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:58.377 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:58.377 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:58.377 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.377 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.377 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87129 5.0 5:02667e01:::benchmark_data_smithi096_19531_object87128:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:58.377 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.236466+0000", 2024-04-19T03:02:58.377 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 35.066482921999999, 2024-04-19T03:02:58.377 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0301534510000001, 2024-04-19T03:02:58.378 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:58.378 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-19T03:02:58.378 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:58.378 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:58.378 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:58.378 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87129 2024-04-19T03:02:58.378 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.378 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:58.378 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.378 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:58.378 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236466+0000", 2024-04-19T03:02:58.378 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:58.378 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.378 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.379 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:58.379 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236466+0000", 2024-04-19T03:02:58.379 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:58.379 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.379 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.379 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:58.379 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236465+0000", 2024-04-19T03:02:58.379 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:58.379 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.379 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.379 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:58.379 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236566+0000", 2024-04-19T03:02:58.379 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010047000000000001 2024-04-19T03:02:58.380 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.380 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.380 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:58.380 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236577+0000", 2024-04-19T03:02:58.380 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1772e-05 2024-04-19T03:02:58.380 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.380 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.380 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:58.380 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236584+0000", 2024-04-19T03:02:58.380 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0530000000000003e-06 2024-04-19T03:02:58.380 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.380 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.381 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:58.381 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.237023+0000", 2024-04-19T03:02:58.381 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000439703 2024-04-19T03:02:58.381 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.381 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.381 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:58.381 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.237207+0000", 2024-04-19T03:02:58.381 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000183692 2024-04-19T03:02:58.381 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.381 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.381 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:58.381 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.237373+0000", 2024-04-19T03:02:58.381 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016623500000000001 2024-04-19T03:02:58.382 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.382 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.382 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:58.382 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.241461+0000", 2024-04-19T03:02:58.382 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0040883050000000004 2024-04-19T03:02:58.382 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.382 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.382 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:58.382 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.252500+0000", 2024-04-19T03:02:58.382 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011038450999999999 2024-04-19T03:02:58.382 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.382 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.383 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:02:58.383 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.252507+0000", 2024-04-19T03:02:58.383 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2439999999999996e-06 2024-04-19T03:02:58.383 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.383 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.383 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:58.383 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266538+0000", 2024-04-19T03:02:58.383 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.014031184 2024-04-19T03:02:58.383 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.383 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.383 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:58.383 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266620+0000", 2024-04-19T03:02:58.384 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1600000000000005e-05 2024-04-19T03:02:58.384 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:58.384 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:58.384 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:58.384 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.384 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.384 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87135 5.4 5:2a97e7b7:::benchmark_data_smithi096_19531_object87134:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:58.384 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.240884+0000", 2024-04-19T03:02:58.384 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 35.062065465000003, 2024-04-19T03:02:58.384 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.025708931, 2024-04-19T03:02:58.384 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:58.384 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-19T03:02:58.384 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:58.385 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:58.385 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:58.385 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87135 2024-04-19T03:02:58.385 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.385 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:58.385 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.385 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:58.385 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240884+0000", 2024-04-19T03:02:58.385 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:58.385 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.385 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.385 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:58.385 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240884+0000", 2024-04-19T03:02:58.385 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:58.386 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.386 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.386 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:58.386 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240883+0000", 2024-04-19T03:02:58.386 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:58.386 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.386 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.386 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:58.386 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240933+0000", 2024-04-19T03:02:58.386 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9969999999999998e-05 2024-04-19T03:02:58.386 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.386 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.386 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:58.386 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240946+0000", 2024-04-19T03:02:58.387 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2943e-05 2024-04-19T03:02:58.387 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.387 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.387 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:58.387 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240952+0000", 2024-04-19T03:02:58.387 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8930000000000002e-06 2024-04-19T03:02:58.387 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.387 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.387 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:58.387 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240994+0000", 2024-04-19T03:02:58.387 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2753999999999998e-05 2024-04-19T03:02:58.387 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.387 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.387 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:58.388 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.241092+0000", 2024-04-19T03:02:58.388 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.7447000000000004e-05 2024-04-19T03:02:58.388 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.388 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.388 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:58.388 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.241183+0000", 2024-04-19T03:02:58.388 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1163999999999997e-05 2024-04-19T03:02:58.388 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.388 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.388 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:58.388 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.254672+0000", 2024-04-19T03:02:58.388 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.01348864 2024-04-19T03:02:58.388 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.389 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.389 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:02:58.389 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.254681+0000", 2024-04-19T03:02:58.389 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.3789999999999995e-06 2024-04-19T03:02:58.389 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.389 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.389 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:58.389 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266456+0000", 2024-04-19T03:02:58.389 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.011774621 2024-04-19T03:02:58.389 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.389 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.389 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:58.389 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266593+0000", 2024-04-19T03:02:58.389 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013737600000000001 2024-04-19T03:02:58.390 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:58.390 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:58.390 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:58.390 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.390 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.390 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87136 5.4 5:212411bc:::benchmark_data_smithi096_19531_object87135:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:58.390 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.240962+0000", 2024-04-19T03:02:58.390 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 35.061987588999997, 2024-04-19T03:02:58.390 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.025738, 2024-04-19T03:02:58.390 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:58.390 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-19T03:02:58.390 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:58.390 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:58.391 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:58.391 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87136 2024-04-19T03:02:58.391 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.391 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:58.391 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.391 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:58.391 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240962+0000", 2024-04-19T03:02:58.391 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:58.391 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.391 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.391 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:58.391 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240962+0000", 2024-04-19T03:02:58.391 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:58.392 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.392 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.392 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:58.392 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240961+0000", 2024-04-19T03:02:58.392 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:58.392 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.392 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.392 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:58.392 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240995+0000", 2024-04-19T03:02:58.392 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3868000000000002e-05 2024-04-19T03:02:58.392 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.392 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.392 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:58.392 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.241001+0000", 2024-04-19T03:02:58.392 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.322e-06 2024-04-19T03:02:58.392 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.393 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.393 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:58.393 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.241004+0000", 2024-04-19T03:02:58.393 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3510000000000002e-06 2024-04-19T03:02:58.393 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.393 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.393 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:58.393 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247131+0000", 2024-04-19T03:02:58.393 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0061270869999999998 2024-04-19T03:02:58.393 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.393 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.393 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:58.393 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247322+0000", 2024-04-19T03:02:58.393 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000191015 2024-04-19T03:02:58.393 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.394 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.394 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:58.394 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247542+0000", 2024-04-19T03:02:58.394 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00022030199999999999 2024-04-19T03:02:58.394 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.394 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.394 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:58.394 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.254709+0000", 2024-04-19T03:02:58.394 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0071662660000000001 2024-04-19T03:02:58.394 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.394 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.394 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:02:58.394 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.254716+0000", 2024-04-19T03:02:58.395 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3860000000000001e-06 2024-04-19T03:02:58.395 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.395 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.395 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:58.395 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266619+0000", 2024-04-19T03:02:58.395 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0119031030000001 2024-04-19T03:02:58.395 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.395 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.395 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:58.395 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266700+0000", 2024-04-19T03:02:58.395 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0764000000000001e-05 2024-04-19T03:02:58.395 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:58.395 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:58.395 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:58.395 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.396 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.396 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87138 5.e 5:7b1f1c20:::benchmark_data_smithi096_19531_object87137:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:58.396 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.247862+0000", 2024-04-19T03:02:58.396 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 35.055087514999997, 2024-04-19T03:02:58.396 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.024457079, 2024-04-19T03:02:58.396 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:58.396 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:58.396 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:58.396 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:58.396 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:58.396 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87138 2024-04-19T03:02:58.396 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.396 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:58.396 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.397 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:58.397 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247862+0000", 2024-04-19T03:02:58.397 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:58.397 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.397 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.397 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:58.397 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247862+0000", 2024-04-19T03:02:58.397 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:58.397 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.397 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.397 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:58.397 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247860+0000", 2024-04-19T03:02:58.398 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999981 2024-04-19T03:02:58.398 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.398 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.398 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:58.398 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247909+0000", 2024-04-19T03:02:58.398 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9150999999999997e-05 2024-04-19T03:02:58.398 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.398 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.398 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:58.398 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247925+0000", 2024-04-19T03:02:58.398 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5761999999999999e-05 2024-04-19T03:02:58.398 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.398 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.398 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:58.399 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247936+0000", 2024-04-19T03:02:58.399 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1144e-05 2024-04-19T03:02:58.399 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.399 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.399 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:58.399 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.250590+0000", 2024-04-19T03:02:58.399 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.002653678 2024-04-19T03:02:58.399 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.399 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.399 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:02:58.399 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.250599+0000", 2024-04-19T03:02:58.399 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9039999999999998e-06 2024-04-19T03:02:58.399 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.399 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.400 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:58.400 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.268151+0000", 2024-04-19T03:02:58.400 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0175523449999999 2024-04-19T03:02:58.400 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.400 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.400 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:58.400 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.268285+0000", 2024-04-19T03:02:58.400 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013415599999999999 2024-04-19T03:02:58.400 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.400 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.400 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:58.400 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.272238+0000", 2024-04-19T03:02:58.400 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0039533019999999997 2024-04-19T03:02:58.400 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.401 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.401 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:58.401 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.272274+0000", 2024-04-19T03:02:58.401 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5352000000000003e-05 2024-04-19T03:02:58.401 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.401 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.401 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:58.401 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.272319+0000", 2024-04-19T03:02:58.401 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5281999999999998e-05 2024-04-19T03:02:58.401 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:58.401 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:58.401 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:58.401 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.401 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.402 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:158371 5.8 5:11a83024:::benchmark_data_smithi096_19531_object44921:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-19T03:02:58.402 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:58.125869+0000", 2024-04-19T03:02:58.402 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.17708065000000001, 2024-04-19T03:02:58.402 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074532857999999994, 2024-04-19T03:02:58.402 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:58.402 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:58.402 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:58.402 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:58.402 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:58.402 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 158371 2024-04-19T03:02:58.402 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.402 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:58.402 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.403 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:58.403 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125869+0000", 2024-04-19T03:02:58.403 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:58.403 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.403 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.403 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:58.403 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125869+0000", 2024-04-19T03:02:58.403 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:58.403 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.403 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.403 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:58.403 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125868+0000", 2024-04-19T03:02:58.403 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:58.404 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.404 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.404 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:58.404 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125874+0000", 2024-04-19T03:02:58.404 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7120000000000003e-06 2024-04-19T03:02:58.404 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.404 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.404 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:58.404 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125885+0000", 2024-04-19T03:02:58.404 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0665999999999999e-05 2024-04-19T03:02:58.404 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.404 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.404 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:58.405 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125901+0000", 2024-04-19T03:02:58.405 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6463000000000001e-05 2024-04-19T03:02:58.405 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.405 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.405 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:58.405 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125956+0000", 2024-04-19T03:02:58.405 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4728000000000002e-05 2024-04-19T03:02:58.405 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.405 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.405 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:58.405 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.126050+0000", 2024-04-19T03:02:58.405 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.3534000000000003e-05 2024-04-19T03:02:58.405 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.406 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.406 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:58.406 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.200187+0000", 2024-04-19T03:02:58.406 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074136933000000002 2024-04-19T03:02:58.406 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.406 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.406 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:58.406 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.200260+0000", 2024-04-19T03:02:58.406 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3090999999999995e-05 2024-04-19T03:02:58.406 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.406 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.407 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:58.407 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.200402+0000", 2024-04-19T03:02:58.407 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014193699999999999 2024-04-19T03:02:58.407 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:58.407 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:58.407 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:58.407 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.407 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.407 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:158372 5.0 5:0473aa5f:::benchmark_data_smithi096_19531_object44922:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-19T03:02:58.407 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:58.125924+0000", 2024-04-19T03:02:58.407 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.17702504299999999, 2024-04-19T03:02:58.407 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074247490999999999, 2024-04-19T03:02:58.407 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:58.408 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:58.408 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:58.408 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:58.408 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:58.408 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 158372 2024-04-19T03:02:58.408 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.408 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:58.408 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.408 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:58.408 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125924+0000", 2024-04-19T03:02:58.408 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:58.408 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.409 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.409 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:58.409 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125924+0000", 2024-04-19T03:02:58.409 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:58.409 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.409 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.409 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:58.409 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125924+0000", 2024-04-19T03:02:58.409 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:58.409 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.409 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.409 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:58.410 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125927+0000", 2024-04-19T03:02:58.410 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5389999999999999e-06 2024-04-19T03:02:58.410 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.410 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.410 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:58.410 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125935+0000", 2024-04-19T03:02:58.410 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3259999999999998e-06 2024-04-19T03:02:58.410 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.410 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.410 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:58.410 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125940+0000", 2024-04-19T03:02:58.410 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6980000000000003e-06 2024-04-19T03:02:58.411 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.411 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.411 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:58.411 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125982+0000", 2024-04-19T03:02:58.411 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1337000000000001e-05 2024-04-19T03:02:58.411 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.411 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.411 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:58.411 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.126075+0000", 2024-04-19T03:02:58.411 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.3579999999999995e-05 2024-04-19T03:02:58.411 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.411 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.411 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:58.411 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.199953+0000", 2024-04-19T03:02:58.412 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073877604999999999 2024-04-19T03:02:58.412 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.412 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.412 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:58.412 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.200022+0000", 2024-04-19T03:02:58.412 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.8824000000000004e-05 2024-04-19T03:02:58.412 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.412 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.412 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:58.412 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.200172+0000", 2024-04-19T03:02:58.412 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015017700000000001 2024-04-19T03:02:58.412 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:58.412 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:58.412 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:58.413 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.413 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.413 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:158374 5.e 5:76be57a5:::benchmark_data_smithi096_19531_object44924:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-19T03:02:58.413 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:58.125988+0000", 2024-04-19T03:02:58.413 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.176961544, 2024-04-19T03:02:58.413 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.067843332000000006, 2024-04-19T03:02:58.413 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:58.413 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:58.413 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:58.413 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:58.413 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:58.413 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 158374 2024-04-19T03:02:58.413 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.413 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:58.414 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.414 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:58.414 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125988+0000", 2024-04-19T03:02:58.414 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:58.414 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.414 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.414 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:58.414 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125988+0000", 2024-04-19T03:02:58.414 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:58.414 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.414 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.414 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:58.414 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125987+0000", 2024-04-19T03:02:58.415 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:58.415 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.415 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.415 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:58.415 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125990+0000", 2024-04-19T03:02:58.415 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7989999999999998e-06 2024-04-19T03:02:58.415 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.415 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.415 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:58.415 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125996+0000", 2024-04-19T03:02:58.415 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.302e-06 2024-04-19T03:02:58.415 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.415 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.416 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:58.416 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.126001+0000", 2024-04-19T03:02:58.416 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.843e-06 2024-04-19T03:02:58.416 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.416 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.416 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:58.416 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.126047+0000", 2024-04-19T03:02:58.416 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6066000000000002e-05 2024-04-19T03:02:58.416 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.416 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.416 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:58.416 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.126171+0000", 2024-04-19T03:02:58.416 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012359099999999999 2024-04-19T03:02:58.417 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.417 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.417 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:58.417 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.193709+0000", 2024-04-19T03:02:58.417 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.067538099000000004 2024-04-19T03:02:58.417 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.417 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.417 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:58.417 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.193766+0000", 2024-04-19T03:02:58.417 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6869e-05 2024-04-19T03:02:58.417 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.417 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.417 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:58.418 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.193831+0000", 2024-04-19T03:02:58.418 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5273999999999999e-05 2024-04-19T03:02:58.418 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:58.418 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:58.418 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:58.418 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.418 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.418 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4755.0:158376 5.9 e56/22 5:9e73c076:::benchmark_data_smithi096_19531_object44926:head v 56'9663, mlcod=56'9661)", 2024-04-19T03:02:58.418 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:58.127307+0000", 2024-04-19T03:02:58.418 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.17564231299999999, 2024-04-19T03:02:58.418 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069002716000000006, 2024-04-19T03:02:58.418 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:58.418 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:58.418 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:58.419 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.419 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:58.419 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.127307+0000", 2024-04-19T03:02:58.419 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:58.419 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.419 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.419 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:58.419 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.127307+0000", 2024-04-19T03:02:58.419 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:58.419 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.419 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.419 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:58.419 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.127306+0000", 2024-04-19T03:02:58.419 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:58.420 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.420 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.420 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:58.420 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.127316+0000", 2024-04-19T03:02:58.420 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.3039999999999994e-06 2024-04-19T03:02:58.420 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.420 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.420 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:58.420 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.127326+0000", 2024-04-19T03:02:58.420 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0009e-05 2024-04-19T03:02:58.420 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.420 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.420 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:58.420 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.127332+0000", 2024-04-19T03:02:58.421 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5880000000000003e-06 2024-04-19T03:02:58.421 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.421 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.421 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:58.421 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.127383+0000", 2024-04-19T03:02:58.421 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0516000000000002e-05 2024-04-19T03:02:58.421 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.421 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.421 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:58.421 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.127403+0000", 2024-04-19T03:02:58.421 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0547000000000002e-05 2024-04-19T03:02:58.421 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.422 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.422 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:58.422 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.196280+0000", 2024-04-19T03:02:58.422 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.068876863999999996 2024-04-19T03:02:58.422 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.422 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.422 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:58.422 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.196310+0000", 2024-04-19T03:02:58.422 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9762999999999999e-05 2024-04-19T03:02:58.422 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:58.422 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:58.422 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:58.423 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.423 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.423 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:158383 5.0 5:026717eb:::benchmark_data_smithi096_19531_object44933:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-19T03:02:58.423 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:58.130494+0000", 2024-04-19T03:02:58.423 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.17245518700000001, 2024-04-19T03:02:58.423 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.070135775999999997, 2024-04-19T03:02:58.423 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:58.423 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:58.423 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:58.423 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:58.423 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:58.423 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 158383 2024-04-19T03:02:58.423 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.423 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:58.424 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.424 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:58.424 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.130494+0000", 2024-04-19T03:02:58.424 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:58.424 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.424 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.424 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:58.424 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.130494+0000", 2024-04-19T03:02:58.424 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:58.424 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.424 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.424 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:58.424 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.130493+0000", 2024-04-19T03:02:58.425 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:58.425 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.425 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.425 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:58.425 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.130500+0000", 2024-04-19T03:02:58.425 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5490000000000003e-06 2024-04-19T03:02:58.425 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.425 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.425 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:58.425 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.190401+0000", 2024-04-19T03:02:58.425 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.059901668999999998 2024-04-19T03:02:58.425 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.425 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.425 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:58.426 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.190421+0000", 2024-04-19T03:02:58.426 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0288e-05 2024-04-19T03:02:58.426 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.426 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.426 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:58.426 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.190536+0000", 2024-04-19T03:02:58.426 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000114783 2024-04-19T03:02:58.426 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.426 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.426 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:58.426 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.190904+0000", 2024-04-19T03:02:58.426 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00036773900000000001 2024-04-19T03:02:58.426 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.427 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.427 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:58.427 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.200417+0000", 2024-04-19T03:02:58.427 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0095128899999999995 2024-04-19T03:02:58.427 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.427 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.427 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:58.427 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.200489+0000", 2024-04-19T03:02:58.427 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2554999999999999e-05 2024-04-19T03:02:58.427 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:58.427 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:58.427 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:58.427 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.200630+0000", 2024-04-19T03:02:58.427 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014055299999999999 2024-04-19T03:02:58.427 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:58.427 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:58.428 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:58.428 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:58.428 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:58.428 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-19T03:02:58.429 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T03:02:58.430 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:58.426+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:58.531 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:58.528+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:58.558 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-04-19T03:02:58.558 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [ 2024-04-19T03:02:58.558 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.558 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:159316 5.6 5:61c17edb:::benchmark_data_smithi096_19531_object45866:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-19T03:02:58.559 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:58.554190+0000", 2024-04-19T03:02:58.559 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.002982134, 2024-04-19T03:02:58.559 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0030064039999999998, 2024-04-19T03:02:58.559 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:58.559 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-04-19T03:02:58.559 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:58.559 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:58.559 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:58.559 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 159316 2024-04-19T03:02:58.559 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.559 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:58.559 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.560 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:58.560 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.554190+0000", 2024-04-19T03:02:58.560 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:58.560 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.560 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.560 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:58.560 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.554190+0000", 2024-04-19T03:02:58.560 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:58.560 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.560 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.560 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:58.560 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.554189+0000", 2024-04-19T03:02:58.560 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:58.561 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.561 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.561 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:58.561 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.554194+0000", 2024-04-19T03:02:58.561 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8679999999999998e-06 2024-04-19T03:02:58.561 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.561 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.561 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:58.561 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.554202+0000", 2024-04-19T03:02:58.561 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7330000000000003e-06 2024-04-19T03:02:58.561 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.561 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.562 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:58.562 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.554207+0000", 2024-04-19T03:02:58.562 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8030000000000002e-06 2024-04-19T03:02:58.562 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.562 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.562 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:58.562 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.554249+0000", 2024-04-19T03:02:58.562 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2117999999999999e-05 2024-04-19T03:02:58.562 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.562 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.562 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:58.562 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.554384+0000", 2024-04-19T03:02:58.563 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000134232 2024-04-19T03:02:58.563 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:58.563 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:58.563 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:58.563 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.563 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.563 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:159318 5.6 5:6b5feebc:::benchmark_data_smithi096_19531_object45868:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-19T03:02:58.563 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:58.554945+0000", 2024-04-19T03:02:58.563 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0022267849999999998, 2024-04-19T03:02:58.563 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0023221169999999998, 2024-04-19T03:02:58.563 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:58.563 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-04-19T03:02:58.563 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:58.564 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:58.564 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:58.564 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 159318 2024-04-19T03:02:58.564 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.564 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:58.564 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.564 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:58.564 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.554945+0000", 2024-04-19T03:02:58.564 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:58.564 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.564 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.564 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:58.565 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.554945+0000", 2024-04-19T03:02:58.565 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:58.565 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.565 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.565 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:58.565 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.554944+0000", 2024-04-19T03:02:58.565 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:58.565 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.565 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.565 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:58.565 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.554949+0000", 2024-04-19T03:02:58.565 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4100000000000001e-06 2024-04-19T03:02:58.565 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.565 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.566 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:58.566 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.554958+0000", 2024-04-19T03:02:58.566 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.3489999999999998e-06 2024-04-19T03:02:58.566 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.566 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.566 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:58.566 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.554963+0000", 2024-04-19T03:02:58.566 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7870000000000001e-06 2024-04-19T03:02:58.566 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.566 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.566 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:58.566 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.556260+0000", 2024-04-19T03:02:58.567 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001297514 2024-04-19T03:02:58.567 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.567 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.567 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:58.567 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.556383+0000", 2024-04-19T03:02:58.567 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000122333 2024-04-19T03:02:58.567 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:58.567 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:58.567 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:58.567 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.567 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.567 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:159319 5.6 5.878e7636 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-19T03:02:58.567 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:58.554969+0000", 2024-04-19T03:02:58.568 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0022025170000000002, 2024-04-19T03:02:58.568 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0023588260000000001, 2024-04-19T03:02:58.568 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:58.568 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-04-19T03:02:58.568 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:58.568 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:58.568 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:58.568 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 159319 2024-04-19T03:02:58.568 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.568 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:58.568 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.568 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:58.568 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.554969+0000", 2024-04-19T03:02:58.569 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:58.569 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.569 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.569 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:58.569 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.554969+0000", 2024-04-19T03:02:58.569 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:58.569 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.569 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.569 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:58.569 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.554969+0000", 2024-04-19T03:02:58.569 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:58.569 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.569 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.569 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:58.570 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.554972+0000", 2024-04-19T03:02:58.570 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.8789999999999999e-06 2024-04-19T03:02:58.570 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.570 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.570 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:58.570 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.554978+0000", 2024-04-19T03:02:58.570 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8969999999999996e-06 2024-04-19T03:02:58.570 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.570 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.570 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:58.570 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.554983+0000", 2024-04-19T03:02:58.570 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6979999999999997e-06 2024-04-19T03:02:58.570 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:58.570 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:58.571 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:58.571 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.571 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.571 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:159321 5.9 5:98bb04f6:::benchmark_data_smithi096_19531_object45871:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-19T03:02:58.571 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:58.556111+0000", 2024-04-19T03:02:58.571 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0010605059999999999, 2024-04-19T03:02:58.571 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001269858, 2024-04-19T03:02:58.571 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:58.571 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:02:58.571 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:58.571 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:58.571 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:58.571 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 159321 2024-04-19T03:02:58.571 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.571 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:58.572 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.572 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:58.572 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.556111+0000", 2024-04-19T03:02:58.572 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:58.572 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.572 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.572 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:58.572 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.556111+0000", 2024-04-19T03:02:58.572 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:58.572 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.572 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.572 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:58.572 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.556111+0000", 2024-04-19T03:02:58.572 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:58.573 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.573 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.573 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:58.573 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.556115+0000", 2024-04-19T03:02:58.573 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.442e-06 2024-04-19T03:02:58.573 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.573 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.573 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:58.573 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.556123+0000", 2024-04-19T03:02:58.573 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.3049999999999993e-06 2024-04-19T03:02:58.573 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.573 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.573 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:58.573 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.556130+0000", 2024-04-19T03:02:58.574 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.9210000000000003e-06 2024-04-19T03:02:58.574 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.574 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.574 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:58.574 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.556178+0000", 2024-04-19T03:02:58.574 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8019000000000002e-05 2024-04-19T03:02:58.574 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.574 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.574 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:58.574 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.556300+0000", 2024-04-19T03:02:58.574 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000121141 2024-04-19T03:02:58.574 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.574 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.574 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:02:58.575 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.556427+0000", 2024-04-19T03:02:58.575 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000127114 2024-04-19T03:02:58.575 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:58.575 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:58.575 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:58.575 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.575 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.575 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:159322 5.c 5:30fa4798:::benchmark_data_smithi096_19531_object45872:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-19T03:02:58.575 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:58.556181+0000", 2024-04-19T03:02:58.575 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.00099093899999999993, 2024-04-19T03:02:58.575 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001271115, 2024-04-19T03:02:58.575 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:58.575 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-04-19T03:02:58.575 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:58.576 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:58.576 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:58.576 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 159322 2024-04-19T03:02:58.576 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.576 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:58.576 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.576 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:58.576 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.556181+0000", 2024-04-19T03:02:58.576 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:58.576 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.576 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.576 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:58.576 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.556181+0000", 2024-04-19T03:02:58.576 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:58.576 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.577 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.577 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:58.577 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.556180+0000", 2024-04-19T03:02:58.577 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:58.577 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.577 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.577 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:58.577 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.556184+0000", 2024-04-19T03:02:58.577 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.1709999999999998e-06 2024-04-19T03:02:58.577 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.577 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.577 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:58.577 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.556192+0000", 2024-04-19T03:02:58.577 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6759999999999996e-06 2024-04-19T03:02:58.577 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.578 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.578 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:58.578 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.556197+0000", 2024-04-19T03:02:58.578 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4499999999999997e-06 2024-04-19T03:02:58.578 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.578 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.578 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:58.578 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.556237+0000", 2024-04-19T03:02:58.578 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0604e-05 2024-04-19T03:02:58.578 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.578 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.578 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:58.578 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.556361+0000", 2024-04-19T03:02:58.578 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00012416099999999999 2024-04-19T03:02:58.579 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:58.579 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:58.579 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:58.579 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.579 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.579 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:159323 5.5 5:a2ef19a0:::benchmark_data_smithi096_19531_object45873:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-19T03:02:58.579 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:58.556209+0000", 2024-04-19T03:02:58.579 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.00096276599999999999, 2024-04-19T03:02:58.579 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001307215, 2024-04-19T03:02:58.579 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:58.579 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-04-19T03:02:58.579 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:58.580 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:58.580 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:58.580 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 159323 2024-04-19T03:02:58.580 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.580 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:58.580 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.580 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:58.580 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.556209+0000", 2024-04-19T03:02:58.580 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:58.580 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.580 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.580 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:58.580 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.556209+0000", 2024-04-19T03:02:58.581 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:58.581 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.581 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.581 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:58.581 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.556208+0000", 2024-04-19T03:02:58.581 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:58.581 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.581 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.581 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:58.581 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.556212+0000", 2024-04-19T03:02:58.581 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.1530000000000001e-06 2024-04-19T03:02:58.581 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.581 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.581 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:58.582 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.556220+0000", 2024-04-19T03:02:58.582 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.1100000000000003e-06 2024-04-19T03:02:58.582 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.582 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.582 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:58.582 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.556226+0000", 2024-04-19T03:02:58.582 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0159999999999997e-06 2024-04-19T03:02:58.582 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.582 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.582 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:58.582 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.556303+0000", 2024-04-19T03:02:58.582 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7494e-05 2024-04-19T03:02:58.583 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.583 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.583 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:58.583 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.556424+0000", 2024-04-19T03:02:58.583 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000120413 2024-04-19T03:02:58.583 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:58.583 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:58.583 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:58.583 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.583 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.583 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:159325 5.1 5:850dc8b2:::benchmark_data_smithi096_19531_object45875:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-19T03:02:58.583 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:58.556424+0000", 2024-04-19T03:02:58.583 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.00074806799999999995, 2024-04-19T03:02:58.583 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001153622, 2024-04-19T03:02:58.583 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:58.584 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-04-19T03:02:58.584 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:58.584 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:58.584 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:58.584 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 159325 2024-04-19T03:02:58.584 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.584 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:58.584 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.584 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:58.584 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.556424+0000", 2024-04-19T03:02:58.584 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:58.584 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.584 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.584 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:58.585 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.556424+0000", 2024-04-19T03:02:58.585 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:58.585 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.585 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.585 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:58.585 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.556423+0000", 2024-04-19T03:02:58.585 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:58.585 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.585 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.585 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:58.585 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.556428+0000", 2024-04-19T03:02:58.585 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4670000000000003e-06 2024-04-19T03:02:58.585 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.585 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.586 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:58.586 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.556438+0000", 2024-04-19T03:02:58.586 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.4870000000000008e-06 2024-04-19T03:02:58.586 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.586 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.586 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:58.586 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.556444+0000", 2024-04-19T03:02:58.586 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4740000000000002e-06 2024-04-19T03:02:58.586 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.586 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.586 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:58.586 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.556489+0000", 2024-04-19T03:02:58.586 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4141000000000003e-05 2024-04-19T03:02:58.587 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.587 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.587 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:58.587 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.556614+0000", 2024-04-19T03:02:58.587 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00012501499999999999 2024-04-19T03:02:58.587 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:58.587 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:58.587 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:58.587 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.587 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.587 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:159327 5.9 5.34210fb9 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-19T03:02:58.587 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:58.557400+0000", 2024-04-19T03:02:58.587 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4294967295.9997721, 2024-04-19T03:02:58.587 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000239616, 2024-04-19T03:02:58.588 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:58.588 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-04-19T03:02:58.588 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:58.588 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:58.588 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:58.588 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 159327 2024-04-19T03:02:58.588 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.588 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:58.588 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.588 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:58.588 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.557400+0000", 2024-04-19T03:02:58.588 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:58.588 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.588 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.589 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:58.589 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.557400+0000", 2024-04-19T03:02:58.589 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:58.589 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.589 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.589 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:58.589 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.557399+0000", 2024-04-19T03:02:58.589 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:58.589 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.589 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.589 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:58.589 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.557408+0000", 2024-04-19T03:02:58.589 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9560000000000003e-06 2024-04-19T03:02:58.589 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.590 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.590 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:58.590 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.557420+0000", 2024-04-19T03:02:58.590 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2469e-05 2024-04-19T03:02:58.590 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.590 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.590 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:58.590 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.557428+0000", 2024-04-19T03:02:58.590 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8359999999999992e-06 2024-04-19T03:02:58.590 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:58.590 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:58.590 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:58.590 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.590 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.591 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:159328 5.6 5.acb5aec6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-19T03:02:58.591 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:58.557439+0000", 2024-04-19T03:02:58.591 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4294967295.9997334, 2024-04-19T03:02:58.591 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00025029799999999998, 2024-04-19T03:02:58.591 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:58.591 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-04-19T03:02:58.591 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:58.591 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:58.591 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:58.591 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 159328 2024-04-19T03:02:58.591 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.591 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:58.591 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.592 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:58.592 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.557439+0000", 2024-04-19T03:02:58.592 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:58.592 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.592 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.592 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:58.592 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.557439+0000", 2024-04-19T03:02:58.592 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:58.592 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.592 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.592 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:58.592 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.557438+0000", 2024-04-19T03:02:58.593 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:58.593 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.593 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.593 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:58.593 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.557442+0000", 2024-04-19T03:02:58.593 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5489999999999998e-06 2024-04-19T03:02:58.593 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.593 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.593 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:58.593 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.557450+0000", 2024-04-19T03:02:58.593 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6610000000000006e-06 2024-04-19T03:02:58.593 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.593 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.594 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:58.594 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.557456+0000", 2024-04-19T03:02:58.594 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4580000000000001e-06 2024-04-19T03:02:58.594 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:58.594 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:58.594 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:58.594 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:58.594 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-04-19T03:02:58.594 INFO:teuthology.orchestra.run.smithi144.stdout: "num_ops": 9 2024-04-19T03:02:58.594 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-04-19T03:02:58.596 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T03:02:58.631 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:58.626+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:58.724 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-04-19T03:02:58.724 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2024-04-19T03:02:58.725 INFO:teuthology.orchestra.run.smithi144.stdout: "complaint_time": 30, 2024-04-19T03:02:58.725 INFO:teuthology.orchestra.run.smithi144.stdout: "num_blocked_ops": 0 2024-04-19T03:02:58.725 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-04-19T03:02:58.731 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~29s 2024-04-19T03:02:58.732 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:58.730+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:58.739 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T03:02:58.833 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:58.828+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:58.876 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-04-19T03:02:58.876 INFO:teuthology.orchestra.run.smithi144.stdout: "size": 20, 2024-04-19T03:02:58.876 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 600, 2024-04-19T03:02:58.876 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [ 2024-04-19T03:02:58.876 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.876 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:78992 5.7 5:e6baa862:::benchmark_data_smithi096_19531_object78991:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-19T03:02:58.876 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:18.008888+0000", 2024-04-19T03:02:58.877 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 40.864152527999998, 2024-04-19T03:02:58.877 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.056375285999999997, 2024-04-19T03:02:58.877 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:58.877 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:58.877 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:58.877 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:58.877 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:58.877 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 78992 2024-04-19T03:02:58.877 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.877 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:58.877 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.877 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:58.877 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.008888+0000", 2024-04-19T03:02:58.878 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:58.878 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.878 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.878 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:58.878 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.008888+0000", 2024-04-19T03:02:58.878 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:58.878 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.878 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.878 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:58.878 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.008888+0000", 2024-04-19T03:02:58.878 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:58.878 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.878 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.878 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:58.879 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.008928+0000", 2024-04-19T03:02:58.879 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0361999999999997e-05 2024-04-19T03:02:58.879 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.879 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.879 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:58.879 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.008942+0000", 2024-04-19T03:02:58.879 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4365000000000001e-05 2024-04-19T03:02:58.879 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.879 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.879 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:58.879 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.008949+0000", 2024-04-19T03:02:58.879 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.212e-06 2024-04-19T03:02:58.880 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.880 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.880 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:58.880 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.012683+0000", 2024-04-19T03:02:58.880 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.003733934 2024-04-19T03:02:58.880 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.880 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.880 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:58.880 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.012798+0000", 2024-04-19T03:02:58.880 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00011574999999999999 2024-04-19T03:02:58.880 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.880 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.880 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:58.880 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.012896+0000", 2024-04-19T03:02:58.881 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.7848000000000002e-05 2024-04-19T03:02:58.881 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.881 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.881 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:58.881 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016423+0000", 2024-04-19T03:02:58.881 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0035270789999999998 2024-04-19T03:02:58.881 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.881 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.881 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:58.881 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.065098+0000", 2024-04-19T03:02:58.881 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.048674651999999999 2024-04-19T03:02:58.881 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.881 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.882 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:58.882 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.065193+0000", 2024-04-19T03:02:58.882 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.5087999999999995e-05 2024-04-19T03:02:58.882 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.882 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.882 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:58.882 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.065264+0000", 2024-04-19T03:02:58.882 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0666000000000004e-05 2024-04-19T03:02:58.882 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:58.882 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:58.882 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:58.882 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.883 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.883 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4755.0:79003 5.2 e40/39 5:4436e33f:::benchmark_data_smithi096_19531_object79002:head v 40'4935, mlcod=40'4932)", 2024-04-19T03:02:58.883 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:18.018102+0000", 2024-04-19T03:02:58.883 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 40.854938472000001, 2024-04-19T03:02:58.883 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.060023990999999999, 2024-04-19T03:02:58.883 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:58.883 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:58.883 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:58.883 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.883 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:58.883 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018102+0000", 2024-04-19T03:02:58.883 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:58.883 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.884 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.884 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:58.884 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018102+0000", 2024-04-19T03:02:58.884 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:58.884 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.884 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.884 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:58.884 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018102+0000", 2024-04-19T03:02:58.884 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:58.884 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.884 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.884 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:58.884 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018134+0000", 2024-04-19T03:02:58.884 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2722000000000003e-05 2024-04-19T03:02:58.885 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.885 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.885 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:58.885 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018145+0000", 2024-04-19T03:02:58.885 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0395e-05 2024-04-19T03:02:58.885 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.885 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.885 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:58.885 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018151+0000", 2024-04-19T03:02:58.885 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5300000000000002e-06 2024-04-19T03:02:58.885 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.885 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.886 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:58.886 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018489+0000", 2024-04-19T03:02:58.886 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00033731499999999998 2024-04-19T03:02:58.886 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.886 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.886 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:58.886 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018508+0000", 2024-04-19T03:02:58.886 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9775e-05 2024-04-19T03:02:58.886 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.886 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.886 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:58.886 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.078059+0000", 2024-04-19T03:02:58.887 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.059550171999999998 2024-04-19T03:02:58.887 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.887 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.887 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:58.887 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.078126+0000", 2024-04-19T03:02:58.887 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7773000000000003e-05 2024-04-19T03:02:58.887 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:58.887 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:58.887 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:58.887 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.887 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.887 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:86612 5.7 5:e32e3c49:::benchmark_data_smithi096_19531_object86611:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:58.888 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:22.633560+0000", 2024-04-19T03:02:58.888 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 36.239480811999996, 2024-04-19T03:02:58.888 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.19135289, 2024-04-19T03:02:58.888 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:58.888 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:58.888 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:58.888 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:58.888 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:58.888 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 86612 2024-04-19T03:02:58.888 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.888 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:58.888 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.888 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:58.889 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633560+0000", 2024-04-19T03:02:58.889 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:58.889 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.889 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.889 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:58.889 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633560+0000", 2024-04-19T03:02:58.889 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:58.889 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.889 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.889 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:58.889 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633558+0000", 2024-04-19T03:02:58.889 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:58.889 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.889 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.890 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:58.890 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633609+0000", 2024-04-19T03:02:58.890 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0850999999999998e-05 2024-04-19T03:02:58.890 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.890 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.890 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:58.890 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633627+0000", 2024-04-19T03:02:58.890 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7951000000000001e-05 2024-04-19T03:02:58.890 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.890 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.890 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:58.890 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633635+0000", 2024-04-19T03:02:58.890 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2530000000000004e-06 2024-04-19T03:02:58.890 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.891 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.891 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:58.891 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633699+0000", 2024-04-19T03:02:58.891 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3901999999999999e-05 2024-04-19T03:02:58.891 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.891 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.891 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:58.891 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633992+0000", 2024-04-19T03:02:58.891 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00029283299999999999 2024-04-19T03:02:58.891 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.891 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.891 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:58.891 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.634223+0000", 2024-04-19T03:02:58.891 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00023084200000000001 2024-04-19T03:02:58.891 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.892 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.892 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:58.892 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.639085+0000", 2024-04-19T03:02:58.892 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0048624269999999999 2024-04-19T03:02:58.892 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.892 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.892 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:58.892 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.824635+0000", 2024-04-19T03:02:58.892 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.18554944700000001 2024-04-19T03:02:58.892 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.892 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.892 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:58.892 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.824793+0000", 2024-04-19T03:02:58.892 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000157959 2024-04-19T03:02:58.893 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.893 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.893 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:58.893 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.824913+0000", 2024-04-19T03:02:58.893 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000120093 2024-04-19T03:02:58.893 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:58.893 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:58.893 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:58.893 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.893 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.893 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:86625 5.7 5:e6d00488:::benchmark_data_smithi096_19531_object86624:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:58.893 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:22.643554+0000", 2024-04-19T03:02:58.893 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 36.229487046000003, 2024-04-19T03:02:58.893 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.18732841, 2024-04-19T03:02:58.894 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:58.894 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:58.894 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:58.894 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:58.894 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:58.894 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 86625 2024-04-19T03:02:58.894 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.894 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:58.894 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.894 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:58.894 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643554+0000", 2024-04-19T03:02:58.894 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:58.894 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.895 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.895 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:58.895 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643554+0000", 2024-04-19T03:02:58.895 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:58.895 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.895 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.895 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:58.895 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643552+0000", 2024-04-19T03:02:58.895 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:58.895 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.895 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.895 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:58.895 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643588+0000", 2024-04-19T03:02:58.895 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5855999999999997e-05 2024-04-19T03:02:58.896 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.896 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.896 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:58.896 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643606+0000", 2024-04-19T03:02:58.896 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8226000000000001e-05 2024-04-19T03:02:58.896 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.896 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.896 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:58.896 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643618+0000", 2024-04-19T03:02:58.896 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1868000000000001e-05 2024-04-19T03:02:58.896 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.896 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.896 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:58.896 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643676+0000", 2024-04-19T03:02:58.897 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8153999999999999e-05 2024-04-19T03:02:58.897 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.897 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.897 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:58.897 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643905+0000", 2024-04-19T03:02:58.897 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00022847500000000001 2024-04-19T03:02:58.897 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.897 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.897 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:58.897 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.644150+0000", 2024-04-19T03:02:58.897 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00024531800000000001 2024-04-19T03:02:58.897 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.897 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.897 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:58.897 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.647407+0000", 2024-04-19T03:02:58.898 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0032563190000000001 2024-04-19T03:02:58.898 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.898 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.898 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:58.898 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.830721+0000", 2024-04-19T03:02:58.898 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.18331468300000001 2024-04-19T03:02:58.898 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.898 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.898 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:58.898 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.830813+0000", 2024-04-19T03:02:58.898 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.2205000000000002e-05 2024-04-19T03:02:58.898 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.899 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.899 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:58.899 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.830882+0000", 2024-04-19T03:02:58.899 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8819999999999995e-05 2024-04-19T03:02:58.899 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:58.899 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:58.899 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:58.899 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.899 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.899 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87063 5.7 5:e502e824:::benchmark_data_smithi096_19531_object87062:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:58.899 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.136067+0000", 2024-04-19T03:02:58.899 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 35.736974177, 2024-04-19T03:02:58.899 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.065521159999999995, 2024-04-19T03:02:58.900 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:58.900 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:58.900 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:58.900 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:58.900 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:58.900 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87063 2024-04-19T03:02:58.900 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.900 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:58.900 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.900 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:58.900 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.136067+0000", 2024-04-19T03:02:58.900 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:58.900 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.900 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.901 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:58.901 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.136067+0000", 2024-04-19T03:02:58.901 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:58.901 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.901 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.901 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:58.901 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.136066+0000", 2024-04-19T03:02:58.901 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:58.901 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.901 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.902 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:58.902 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.136154+0000", 2024-04-19T03:02:58.902 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.8256000000000003e-05 2024-04-19T03:02:58.902 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.902 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.902 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:58.902 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.136162+0000", 2024-04-19T03:02:58.902 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.5099999999999998e-06 2024-04-19T03:02:58.902 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.902 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.902 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:58.902 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.136171+0000", 2024-04-19T03:02:58.902 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2830000000000001e-06 2024-04-19T03:02:58.903 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.903 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.903 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:58.903 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.138421+0000", 2024-04-19T03:02:58.903 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0022506620000000001 2024-04-19T03:02:58.903 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.903 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.903 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:58.903 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.138560+0000", 2024-04-19T03:02:58.903 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000138446 2024-04-19T03:02:58.903 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.903 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.903 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:58.903 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.138689+0000", 2024-04-19T03:02:58.903 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00012950700000000001 2024-04-19T03:02:58.904 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.904 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.904 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:58.904 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.141517+0000", 2024-04-19T03:02:58.904 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0028280860000000001 2024-04-19T03:02:58.904 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.904 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.904 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:58.904 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.201350+0000", 2024-04-19T03:02:58.904 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.059832418999999998 2024-04-19T03:02:58.904 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.904 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.904 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:58.904 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.201485+0000", 2024-04-19T03:02:58.905 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000135597 2024-04-19T03:02:58.905 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.905 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.905 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:58.905 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.201588+0000", 2024-04-19T03:02:58.905 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00010247900000000001 2024-04-19T03:02:58.905 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:58.905 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:58.905 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:58.905 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.905 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.905 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87072 5.7 5:e3c7809a:::benchmark_data_smithi096_19531_object87071:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:58.905 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.144224+0000", 2024-04-19T03:02:58.906 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 35.728817153000001, 2024-04-19T03:02:58.906 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.058179555000000001, 2024-04-19T03:02:58.906 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:58.906 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:58.906 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:58.906 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:58.906 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:58.906 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87072 2024-04-19T03:02:58.906 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.906 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:58.906 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.906 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:58.907 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144224+0000", 2024-04-19T03:02:58.907 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:58.907 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.907 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.907 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:58.907 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144224+0000", 2024-04-19T03:02:58.907 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:58.907 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.907 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.907 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:58.907 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144223+0000", 2024-04-19T03:02:58.907 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:58.908 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.908 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.908 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:58.908 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144320+0000", 2024-04-19T03:02:58.908 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.7075000000000001e-05 2024-04-19T03:02:58.908 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.908 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.908 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:58.908 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144331+0000", 2024-04-19T03:02:58.908 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1342000000000001e-05 2024-04-19T03:02:58.908 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.908 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.908 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:58.909 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144337+0000", 2024-04-19T03:02:58.909 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8390000000000003e-06 2024-04-19T03:02:58.909 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.909 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.909 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:58.909 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144369+0000", 2024-04-19T03:02:58.909 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2079000000000002e-05 2024-04-19T03:02:58.909 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.909 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.909 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:58.909 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144464+0000", 2024-04-19T03:02:58.909 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.4623000000000005e-05 2024-04-19T03:02:58.909 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.910 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.910 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:58.910 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144553+0000", 2024-04-19T03:02:58.910 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9171000000000004e-05 2024-04-19T03:02:58.910 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.910 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.910 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:58.910 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.147018+0000", 2024-04-19T03:02:58.910 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0024648370000000001 2024-04-19T03:02:58.910 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.910 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.910 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:58.910 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.202270+0000", 2024-04-19T03:02:58.911 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.055252018 2024-04-19T03:02:58.911 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.911 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.911 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:58.911 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.202356+0000", 2024-04-19T03:02:58.911 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6648000000000001e-05 2024-04-19T03:02:58.911 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.911 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.911 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:58.911 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.202403+0000", 2024-04-19T03:02:58.911 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6956999999999998e-05 2024-04-19T03:02:58.911 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:58.911 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:58.911 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:58.912 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.912 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.912 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87123 5.6 5:6d1bc3b9:::benchmark_data_smithi096_19531_object87122:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:02:58.912 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249233+0000", 2024-04-19T03:02:58.912 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 35.623808121000003, 2024-04-19T03:02:58.912 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0291700720000001, 2024-04-19T03:02:58.912 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:58.912 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-04-19T03:02:58.912 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:58.912 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:58.912 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:58.912 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87123 2024-04-19T03:02:58.912 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.912 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:58.913 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.913 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:58.913 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249233+0000", 2024-04-19T03:02:58.913 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:58.913 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.913 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.913 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:58.913 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249233+0000", 2024-04-19T03:02:58.913 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:58.913 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.913 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.913 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:58.913 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249231+0000", 2024-04-19T03:02:58.913 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:58.914 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.914 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.914 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:58.914 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249285+0000", 2024-04-19T03:02:58.914 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4005000000000002e-05 2024-04-19T03:02:58.914 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.914 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.914 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:58.914 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249300+0000", 2024-04-19T03:02:58.914 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4715999999999999e-05 2024-04-19T03:02:58.914 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.914 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.914 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:58.915 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249307+0000", 2024-04-19T03:02:58.915 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8399999999999997e-06 2024-04-19T03:02:58.915 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.915 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.915 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:58.915 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249366+0000", 2024-04-19T03:02:58.915 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9435999999999998e-05 2024-04-19T03:02:58.915 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.915 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.915 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op must wait for map", 2024-04-19T03:02:58.915 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249376+0000", 2024-04-19T03:02:58.915 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.4919999999999999e-06 2024-04-19T03:02:58.915 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.915 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.915 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:58.916 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263757+0000", 2024-04-19T03:02:58.916 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.014381461999999999 2024-04-19T03:02:58.916 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.916 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.916 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:02:58.916 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263875+0000", 2024-04-19T03:02:58.916 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000117166 2024-04-19T03:02:58.916 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.916 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.916 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:58.916 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.277136+0000", 2024-04-19T03:02:58.916 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.013261207 2024-04-19T03:02:58.916 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.916 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.916 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:58.917 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.278403+0000", 2024-04-19T03:02:58.917 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001267106 2024-04-19T03:02:58.917 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:58.917 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:58.917 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:58.917 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.917 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.917 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87128 5.6 5:6905c420:::benchmark_data_smithi096_19531_object87127:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:02:58.917 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249323+0000", 2024-04-19T03:02:58.918 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 35.623717374000002, 2024-04-19T03:02:58.918 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0292813249999999, 2024-04-19T03:02:58.918 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:58.918 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-04-19T03:02:58.918 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:58.918 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:58.918 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:58.918 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87128 2024-04-19T03:02:58.918 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.918 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:58.918 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.918 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:58.918 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249323+0000", 2024-04-19T03:02:58.919 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:58.919 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.919 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.919 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:58.919 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249323+0000", 2024-04-19T03:02:58.919 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:58.919 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.919 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.919 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:58.919 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249323+0000", 2024-04-19T03:02:58.919 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:58.919 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.919 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.919 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:58.920 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249385+0000", 2024-04-19T03:02:58.920 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1711999999999995e-05 2024-04-19T03:02:58.920 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.920 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.920 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:58.920 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249398+0000", 2024-04-19T03:02:58.920 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3022e-05 2024-04-19T03:02:58.920 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.920 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.920 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:58.920 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249402+0000", 2024-04-19T03:02:58.920 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4819999999999996e-06 2024-04-19T03:02:58.921 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.921 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.921 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:58.921 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249437+0000", 2024-04-19T03:02:58.921 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4702000000000001e-05 2024-04-19T03:02:58.921 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.921 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.921 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:02:58.921 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249442+0000", 2024-04-19T03:02:58.921 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8019999999999999e-06 2024-04-19T03:02:58.921 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.921 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.921 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:58.921 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263896+0000", 2024-04-19T03:02:58.922 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.014454679999999999 2024-04-19T03:02:58.922 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.922 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.922 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:02:58.922 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263900+0000", 2024-04-19T03:02:58.922 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9700000000000001e-06 2024-04-19T03:02:58.922 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.922 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.922 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:58.922 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.278557+0000", 2024-04-19T03:02:58.922 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0146566480000001 2024-04-19T03:02:58.922 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.923 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.923 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:58.923 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.278605+0000", 2024-04-19T03:02:58.923 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7735999999999998e-05 2024-04-19T03:02:58.923 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:58.923 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:58.923 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:58.923 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.923 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.923 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87130 5.3 5:c8c2d67b:::benchmark_data_smithi096_19531_object87129:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:02:58.923 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249418+0000", 2024-04-19T03:02:58.923 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 35.623622662999999, 2024-04-19T03:02:58.924 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.025414182, 2024-04-19T03:02:58.924 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:58.924 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-04-19T03:02:58.924 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:58.924 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:58.924 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:58.924 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87130 2024-04-19T03:02:58.924 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.924 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:58.924 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.924 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:58.925 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249418+0000", 2024-04-19T03:02:58.925 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:58.925 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.925 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.925 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:58.926 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249418+0000", 2024-04-19T03:02:58.926 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:58.926 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.926 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.926 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:58.926 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249409+0000", 2024-04-19T03:02:58.926 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999905 2024-04-19T03:02:58.926 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.926 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.926 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:58.927 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249464+0000", 2024-04-19T03:02:58.927 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5381999999999999e-05 2024-04-19T03:02:58.927 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.927 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.927 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:58.927 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249471+0000", 2024-04-19T03:02:58.927 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2609999999999996e-06 2024-04-19T03:02:58.927 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.928 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.928 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:58.928 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249475+0000", 2024-04-19T03:02:58.928 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2839999999999998e-06 2024-04-19T03:02:58.928 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.928 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.928 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:58.928 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249535+0000", 2024-04-19T03:02:58.928 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0545999999999999e-05 2024-04-19T03:02:58.928 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.928 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.928 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op must wait for map", 2024-04-19T03:02:58.928 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249540+0000", 2024-04-19T03:02:58.928 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2859999999999999e-06 2024-04-19T03:02:58.929 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.929 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.929 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:58.929 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263450+0000", 2024-04-19T03:02:58.929 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.013909585 2024-04-19T03:02:58.929 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.929 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.929 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:02:58.929 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263458+0000", 2024-04-19T03:02:58.929 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8089999999999993e-06 2024-04-19T03:02:58.929 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.929 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.929 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:58.930 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.273193+0000", 2024-04-19T03:02:58.930 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0097351379999999 2024-04-19T03:02:58.930 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.930 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.930 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:58.930 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.274832+0000", 2024-04-19T03:02:58.930 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0016394789999999999 2024-04-19T03:02:58.930 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:58.930 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:58.930 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:58.930 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.930 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.930 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87131 5.1 5:83756d55:::benchmark_data_smithi096_19531_object87130:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:02:58.930 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249491+0000", 2024-04-19T03:02:58.931 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 35.623550016000003, 2024-04-19T03:02:58.931 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0191489520000001, 2024-04-19T03:02:58.931 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:58.931 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-04-19T03:02:58.931 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:58.931 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:58.931 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:58.931 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87131 2024-04-19T03:02:58.931 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.931 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:58.931 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.931 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:58.931 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249491+0000", 2024-04-19T03:02:58.931 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:58.932 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.932 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.932 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:58.932 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249491+0000", 2024-04-19T03:02:58.932 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:58.932 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.932 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.932 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:58.932 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249491+0000", 2024-04-19T03:02:58.932 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:58.932 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.932 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.932 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:58.932 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249530+0000", 2024-04-19T03:02:58.932 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9589000000000003e-05 2024-04-19T03:02:58.933 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.933 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.933 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:58.933 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249544+0000", 2024-04-19T03:02:58.933 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4158000000000001e-05 2024-04-19T03:02:58.933 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.933 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.933 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:58.933 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249549+0000", 2024-04-19T03:02:58.933 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6809999999999997e-06 2024-04-19T03:02:58.933 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.933 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.933 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:58.933 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249592+0000", 2024-04-19T03:02:58.934 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3285999999999999e-05 2024-04-19T03:02:58.934 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.934 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.934 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op must wait for map", 2024-04-19T03:02:58.934 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249598+0000", 2024-04-19T03:02:58.934 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8329999999999999e-06 2024-04-19T03:02:58.934 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.934 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.934 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:58.934 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263331+0000", 2024-04-19T03:02:58.934 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.013733093 2024-04-19T03:02:58.934 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.935 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.935 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:02:58.935 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263343+0000", 2024-04-19T03:02:58.935 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.189e-05 2024-04-19T03:02:58.935 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.935 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.935 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:58.935 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.268541+0000", 2024-04-19T03:02:58.935 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0051983440000001 2024-04-19T03:02:58.935 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.935 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.935 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:58.936 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.268640+0000", 2024-04-19T03:02:58.936 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.8387999999999994e-05 2024-04-19T03:02:58.936 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:58.936 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:58.936 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:58.936 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.936 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.936 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87132 5.c 5:3e18b732:::benchmark_data_smithi096_19531_object87131:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:02:58.936 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249558+0000", 2024-04-19T03:02:58.936 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 35.623483114999999, 2024-04-19T03:02:58.936 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0241198380000001, 2024-04-19T03:02:58.936 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:58.936 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-04-19T03:02:58.936 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:58.937 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:58.937 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:58.937 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87132 2024-04-19T03:02:58.937 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.937 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:58.937 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.937 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:58.937 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249558+0000", 2024-04-19T03:02:58.937 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:58.937 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.937 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.937 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:58.937 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249558+0000", 2024-04-19T03:02:58.938 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:58.938 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.938 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.938 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:58.938 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249557+0000", 2024-04-19T03:02:58.938 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:58.938 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.938 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.938 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:58.938 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249625+0000", 2024-04-19T03:02:58.938 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7200999999999996e-05 2024-04-19T03:02:58.938 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.939 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.939 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:58.939 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249646+0000", 2024-04-19T03:02:58.939 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1053e-05 2024-04-19T03:02:58.939 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.939 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.939 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:58.939 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249650+0000", 2024-04-19T03:02:58.939 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2719999999999999e-06 2024-04-19T03:02:58.939 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.939 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.939 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:58.940 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249686+0000", 2024-04-19T03:02:58.940 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6430000000000002e-05 2024-04-19T03:02:58.940 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.940 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.940 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op must wait for map", 2024-04-19T03:02:58.940 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249690+0000", 2024-04-19T03:02:58.940 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.765e-06 2024-04-19T03:02:58.940 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.940 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.940 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:58.940 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261157+0000", 2024-04-19T03:02:58.940 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011467247999999999 2024-04-19T03:02:58.940 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.940 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.941 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:02:58.941 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261170+0000", 2024-04-19T03:02:58.941 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2833000000000001e-05 2024-04-19T03:02:58.941 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.941 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.941 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:58.941 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.272119+0000", 2024-04-19T03:02:58.941 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.010949313 2024-04-19T03:02:58.941 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.941 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.941 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:58.941 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.273678+0000", 2024-04-19T03:02:58.941 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0015581550000000001 2024-04-19T03:02:58.942 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:58.942 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:58.942 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:58.942 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.942 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.942 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87133 5.c 5:3f772a62:::benchmark_data_smithi096_19531_object87132:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:02:58.942 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249657+0000", 2024-04-19T03:02:58.942 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 35.623383736000001, 2024-04-19T03:02:58.942 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0242819409999999, 2024-04-19T03:02:58.942 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:58.942 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-04-19T03:02:58.942 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:58.942 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:58.942 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:58.943 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87133 2024-04-19T03:02:58.943 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.943 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:58.943 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.943 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:58.943 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249657+0000", 2024-04-19T03:02:58.943 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:58.943 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.943 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.943 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:58.943 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249657+0000", 2024-04-19T03:02:58.943 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:58.943 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.944 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.944 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:58.944 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249657+0000", 2024-04-19T03:02:58.944 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:58.944 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.944 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.944 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:58.944 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249690+0000", 2024-04-19T03:02:58.944 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3343000000000002e-05 2024-04-19T03:02:58.944 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.944 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.944 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:58.944 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249695+0000", 2024-04-19T03:02:58.944 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8600000000000001e-06 2024-04-19T03:02:58.945 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.945 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.945 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:58.945 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249698+0000", 2024-04-19T03:02:58.945 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.1700000000000001e-06 2024-04-19T03:02:58.945 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.945 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.945 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:58.945 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249741+0000", 2024-04-19T03:02:58.945 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2849999999999998e-05 2024-04-19T03:02:58.945 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.945 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.945 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:02:58.946 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249746+0000", 2024-04-19T03:02:58.946 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1019999999999996e-06 2024-04-19T03:02:58.946 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.946 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.946 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:58.946 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261209+0000", 2024-04-19T03:02:58.946 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011462447000000001 2024-04-19T03:02:58.946 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.946 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.946 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:02:58.946 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261216+0000", 2024-04-19T03:02:58.946 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8520000000000004e-06 2024-04-19T03:02:58.946 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.947 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.947 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:58.947 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.273872+0000", 2024-04-19T03:02:58.947 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0126558000000001 2024-04-19T03:02:58.947 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.947 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.947 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:58.947 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.273939+0000", 2024-04-19T03:02:58.947 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6822000000000005e-05 2024-04-19T03:02:58.947 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:58.947 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:58.947 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:58.947 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.947 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.948 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87134 5.5 5:a56c478f:::benchmark_data_smithi096_19531_object87133:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:02:58.948 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249708+0000", 2024-04-19T03:02:58.948 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 35.623332812000001, 2024-04-19T03:02:58.948 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0214677299999999, 2024-04-19T03:02:58.948 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:58.948 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-04-19T03:02:58.948 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:58.948 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:58.948 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:58.948 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87134 2024-04-19T03:02:58.948 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.948 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:58.948 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.948 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:58.949 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249708+0000", 2024-04-19T03:02:58.949 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:58.949 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.949 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.949 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:58.949 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249708+0000", 2024-04-19T03:02:58.949 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:58.949 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.949 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.949 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:58.949 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249706+0000", 2024-04-19T03:02:58.949 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999976 2024-04-19T03:02:58.949 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.949 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.950 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:58.950 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249740+0000", 2024-04-19T03:02:58.950 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4458000000000001e-05 2024-04-19T03:02:58.950 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.950 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.950 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:58.950 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249745+0000", 2024-04-19T03:02:58.950 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5020000000000003e-06 2024-04-19T03:02:58.950 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.950 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.950 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:58.950 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249748+0000", 2024-04-19T03:02:58.950 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2499999999999998e-06 2024-04-19T03:02:58.951 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.951 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.951 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:58.951 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249778+0000", 2024-04-19T03:02:58.951 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.006e-05 2024-04-19T03:02:58.951 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.951 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.951 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op must wait for map", 2024-04-19T03:02:58.951 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249782+0000", 2024-04-19T03:02:58.951 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2910000000000001e-06 2024-04-19T03:02:58.951 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.951 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.951 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:58.952 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261666+0000", 2024-04-19T03:02:58.952 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011883471 2024-04-19T03:02:58.952 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.952 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.952 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:02:58.952 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261674+0000", 2024-04-19T03:02:58.952 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6479999999999992e-06 2024-04-19T03:02:58.952 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.952 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.952 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:58.952 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.269323+0000", 2024-04-19T03:02:58.952 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.00764867 2024-04-19T03:02:58.952 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.952 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.953 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:58.953 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.271176+0000", 2024-04-19T03:02:58.953 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001852844 2024-04-19T03:02:58.953 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:58.953 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:58.953 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:58.953 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.953 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.953 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87137 5.c 5:30708c68:::benchmark_data_smithi096_19531_object87136:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:02:58.953 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249756+0000", 2024-04-19T03:02:58.953 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 35.623285105999997, 2024-04-19T03:02:58.953 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.033331752, 2024-04-19T03:02:58.953 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:58.953 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:58.953 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:58.954 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:58.954 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:58.954 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87137 2024-04-19T03:02:58.954 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.954 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:58.954 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.954 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:58.954 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249756+0000", 2024-04-19T03:02:58.954 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:58.954 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.954 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.954 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:58.954 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249756+0000", 2024-04-19T03:02:58.955 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:58.955 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.955 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.955 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:58.955 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249755+0000", 2024-04-19T03:02:58.955 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:58.955 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.955 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.955 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:58.955 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249777+0000", 2024-04-19T03:02:58.955 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1420000000000002e-05 2024-04-19T03:02:58.955 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.955 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.956 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:58.956 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249781+0000", 2024-04-19T03:02:58.956 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0609999999999997e-06 2024-04-19T03:02:58.956 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.956 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.956 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:58.956 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249787+0000", 2024-04-19T03:02:58.956 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.02e-06 2024-04-19T03:02:58.956 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.956 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.956 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:58.956 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249818+0000", 2024-04-19T03:02:58.956 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0947e-05 2024-04-19T03:02:58.956 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.957 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.957 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:02:58.957 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249821+0000", 2024-04-19T03:02:58.957 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.117e-06 2024-04-19T03:02:58.957 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.957 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.957 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:58.957 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261243+0000", 2024-04-19T03:02:58.957 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011421875999999999 2024-04-19T03:02:58.957 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.957 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.957 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:02:58.957 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261251+0000", 2024-04-19T03:02:58.958 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6120000000000001e-06 2024-04-19T03:02:58.958 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.958 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.958 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:58.958 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.274050+0000", 2024-04-19T03:02:58.958 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.012799405 2024-04-19T03:02:58.958 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.958 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.958 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:58.958 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.274529+0000", 2024-04-19T03:02:58.958 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00047867100000000001 2024-04-19T03:02:58.958 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.958 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.958 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:58.959 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.282972+0000", 2024-04-19T03:02:58.959 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0084436900000000002 2024-04-19T03:02:58.959 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.959 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.959 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:58.959 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.283022+0000", 2024-04-19T03:02:58.959 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9339000000000003e-05 2024-04-19T03:02:58.959 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.959 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.959 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:58.959 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.283088+0000", 2024-04-19T03:02:58.959 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5877999999999995e-05 2024-04-19T03:02:58.959 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:58.959 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:58.960 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:58.960 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.960 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.960 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:158376 5.9 5:9e73c076:::benchmark_data_smithi096_19531_object44926:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-19T03:02:58.960 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:58.126227+0000", 2024-04-19T03:02:58.960 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.74681337299999995, 2024-04-19T03:02:58.960 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.069738668000000004, 2024-04-19T03:02:58.960 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:58.960 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:58.960 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:58.960 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:58.960 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:58.961 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 158376 2024-04-19T03:02:58.961 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.961 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:58.961 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.961 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:58.961 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.126227+0000", 2024-04-19T03:02:58.961 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:58.961 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.961 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.961 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:58.961 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.126227+0000", 2024-04-19T03:02:58.961 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:58.961 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.961 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.961 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:58.962 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.126226+0000", 2024-04-19T03:02:58.962 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:58.962 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.962 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.962 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:58.962 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.126236+0000", 2024-04-19T03:02:58.962 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.4199999999999996e-06 2024-04-19T03:02:58.962 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.962 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.962 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:58.962 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.126243+0000", 2024-04-19T03:02:58.962 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.199e-06 2024-04-19T03:02:58.963 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.963 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.963 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:58.963 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.126248+0000", 2024-04-19T03:02:58.963 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1320000000000002e-06 2024-04-19T03:02:58.963 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.963 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.963 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:58.963 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.126286+0000", 2024-04-19T03:02:58.963 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7401000000000003e-05 2024-04-19T03:02:58.963 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.963 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.963 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:58.963 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.126368+0000", 2024-04-19T03:02:58.964 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2113999999999993e-05 2024-04-19T03:02:58.964 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.964 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.964 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:02:58.964 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.126438+0000", 2024-04-19T03:02:58.964 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0337000000000001e-05 2024-04-19T03:02:58.964 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.964 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.964 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:58.964 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.130816+0000", 2024-04-19T03:02:58.964 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0043778330000000002 2024-04-19T03:02:58.964 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.964 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.964 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:58.964 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.195830+0000", 2024-04-19T03:02:58.965 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.065013933999999995 2024-04-19T03:02:58.965 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.965 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.965 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:58.965 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.195907+0000", 2024-04-19T03:02:58.965 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7397000000000005e-05 2024-04-19T03:02:58.965 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.965 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.965 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:58.965 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.195966+0000", 2024-04-19T03:02:58.965 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8906999999999997e-05 2024-04-19T03:02:58.965 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:58.965 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:58.965 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:58.965 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.965 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.966 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:158381 5.9 5:94dcd4a7:::benchmark_data_smithi096_19531_object44931:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-19T03:02:58.966 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:58.128712+0000", 2024-04-19T03:02:58.966 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.74432893, 2024-04-19T03:02:58.966 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.067497527000000002, 2024-04-19T03:02:58.966 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:58.966 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:58.966 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:58.966 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:58.966 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:58.966 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 158381 2024-04-19T03:02:58.966 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.966 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:58.966 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.967 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:58.967 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.128712+0000", 2024-04-19T03:02:58.967 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:58.967 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.967 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.967 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:58.967 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.128712+0000", 2024-04-19T03:02:58.967 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:58.967 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.967 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.967 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:58.967 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.128711+0000", 2024-04-19T03:02:58.967 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:58.967 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.967 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.967 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:58.968 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.128716+0000", 2024-04-19T03:02:58.968 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0610000000000003e-06 2024-04-19T03:02:58.968 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.968 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.968 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:58.968 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.128724+0000", 2024-04-19T03:02:58.968 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0120000000000005e-06 2024-04-19T03:02:58.968 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.968 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.968 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:58.968 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.128729+0000", 2024-04-19T03:02:58.968 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8899999999999998e-06 2024-04-19T03:02:58.968 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.968 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.968 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:58.969 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.128778+0000", 2024-04-19T03:02:58.969 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9110000000000002e-05 2024-04-19T03:02:58.969 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.969 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.969 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:58.969 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.128903+0000", 2024-04-19T03:02:58.969 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00012506799999999999 2024-04-19T03:02:58.969 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.969 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.969 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:02:58.969 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.129022+0000", 2024-04-19T03:02:58.969 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00011923599999999999 2024-04-19T03:02:58.969 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.969 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.970 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:58.970 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.132294+0000", 2024-04-19T03:02:58.970 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.003271244 2024-04-19T03:02:58.970 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.970 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.970 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:58.970 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.196045+0000", 2024-04-19T03:02:58.970 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.063751206000000005 2024-04-19T03:02:58.970 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.970 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.970 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:58.970 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.196133+0000", 2024-04-19T03:02:58.970 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.8213000000000004e-05 2024-04-19T03:02:58.970 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.971 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.971 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:58.971 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.196209+0000", 2024-04-19T03:02:58.971 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6335999999999996e-05 2024-04-19T03:02:58.971 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:58.971 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:58.971 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:58.971 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.971 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.971 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:158385 5.9 5:950ec749:::benchmark_data_smithi096_19531_object44935:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-19T03:02:58.971 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:58.129756+0000", 2024-04-19T03:02:58.971 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.74328499800000003, 2024-04-19T03:02:58.971 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.068998382999999996, 2024-04-19T03:02:58.971 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:58.971 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:58.972 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:58.972 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:58.972 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:58.972 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 158385 2024-04-19T03:02:58.972 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.972 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:58.972 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.972 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:58.972 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.129756+0000", 2024-04-19T03:02:58.972 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:58.972 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.972 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.973 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:58.973 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.129756+0000", 2024-04-19T03:02:58.973 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:58.973 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.973 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.973 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:58.973 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.129755+0000", 2024-04-19T03:02:58.973 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:58.973 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.973 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.973 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:58.973 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.129760+0000", 2024-04-19T03:02:58.973 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6030000000000004e-06 2024-04-19T03:02:58.974 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.974 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.974 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:58.974 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.129774+0000", 2024-04-19T03:02:58.974 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3131e-05 2024-04-19T03:02:58.974 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.974 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.974 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:58.974 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.129781+0000", 2024-04-19T03:02:58.974 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4030000000000001e-06 2024-04-19T03:02:58.974 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.974 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.974 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:58.975 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.130837+0000", 2024-04-19T03:02:58.975 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00105569 2024-04-19T03:02:58.975 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.975 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.975 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:58.975 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.130917+0000", 2024-04-19T03:02:58.975 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9929e-05 2024-04-19T03:02:58.975 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.975 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.975 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:02:58.975 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.130973+0000", 2024-04-19T03:02:58.975 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.664e-05 2024-04-19T03:02:58.975 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.975 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.976 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:58.976 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.132340+0000", 2024-04-19T03:02:58.976 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001366321 2024-04-19T03:02:58.976 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.976 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.976 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:58.976 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.198637+0000", 2024-04-19T03:02:58.976 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.066296888999999998 2024-04-19T03:02:58.976 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.976 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.976 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:58.976 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.198704+0000", 2024-04-19T03:02:58.977 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7333000000000001e-05 2024-04-19T03:02:58.977 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.977 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.977 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:58.977 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.198754+0000", 2024-04-19T03:02:58.977 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0421999999999999e-05 2024-04-19T03:02:58.977 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:58.977 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:58.977 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:58.977 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.977 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.977 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:158387 5.9 5:9e96f619:::benchmark_data_smithi096_19531_object44937:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-19T03:02:58.977 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:58.132457+0000", 2024-04-19T03:02:58.978 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.74058343400000004, 2024-04-19T03:02:58.978 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.066858091999999994, 2024-04-19T03:02:58.978 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:58.978 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:58.978 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:58.978 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:58.978 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:58.978 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 158387 2024-04-19T03:02:58.978 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.978 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:58.978 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.978 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:58.978 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.132457+0000", 2024-04-19T03:02:58.979 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:58.979 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.979 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.979 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:58.979 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.132457+0000", 2024-04-19T03:02:58.979 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:58.979 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.979 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.979 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:58.979 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.132457+0000", 2024-04-19T03:02:58.979 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:58.979 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.979 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.979 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:58.980 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.132460+0000", 2024-04-19T03:02:58.980 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.1949999999999999e-06 2024-04-19T03:02:58.980 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.980 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.980 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:58.980 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.132468+0000", 2024-04-19T03:02:58.980 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.1599999999999998e-06 2024-04-19T03:02:58.980 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.980 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.980 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:58.980 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.132473+0000", 2024-04-19T03:02:58.980 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9259999999999999e-06 2024-04-19T03:02:58.980 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.980 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.981 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:58.981 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.132504+0000", 2024-04-19T03:02:58.981 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0914000000000003e-05 2024-04-19T03:02:58.981 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.981 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.981 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:58.981 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.132646+0000", 2024-04-19T03:02:58.981 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00014214300000000001 2024-04-19T03:02:58.981 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.981 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.981 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:02:58.981 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.132741+0000", 2024-04-19T03:02:58.981 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.4344000000000003e-05 2024-04-19T03:02:58.981 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.982 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.982 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:58.982 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.135774+0000", 2024-04-19T03:02:58.982 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0030334960000000001 2024-04-19T03:02:58.982 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.982 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.982 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:58.982 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.199240+0000", 2024-04-19T03:02:58.982 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.063465695000000003 2024-04-19T03:02:58.982 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.982 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.982 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:58.982 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.199272+0000", 2024-04-19T03:02:58.983 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2412000000000001e-05 2024-04-19T03:02:58.983 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.983 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.983 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:58.983 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.199316+0000", 2024-04-19T03:02:58.983 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3275000000000002e-05 2024-04-19T03:02:58.983 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:58.983 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:58.983 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:58.983 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.983 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.983 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:158392 5.f 5:f462725f:::benchmark_data_smithi096_19531_object44942:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-19T03:02:58.983 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:58.135703+0000", 2024-04-19T03:02:58.983 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.73733765399999995, 2024-04-19T03:02:58.984 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.063132879000000003, 2024-04-19T03:02:58.984 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:58.984 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:58.984 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:58.984 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:58.984 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:58.984 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 158392 2024-04-19T03:02:58.984 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.984 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:58.984 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.984 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:58.984 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.135703+0000", 2024-04-19T03:02:58.984 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:58.984 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.985 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.985 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:58.985 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.135703+0000", 2024-04-19T03:02:58.985 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:58.985 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.985 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.985 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:58.985 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.135702+0000", 2024-04-19T03:02:58.985 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:58.985 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.985 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.985 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:58.985 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.135708+0000", 2024-04-19T03:02:58.985 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8270000000000003e-06 2024-04-19T03:02:58.986 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.986 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.986 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:58.986 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.135720+0000", 2024-04-19T03:02:58.986 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2057e-05 2024-04-19T03:02:58.986 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.986 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.986 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:58.986 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.135727+0000", 2024-04-19T03:02:58.986 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8090000000000004e-06 2024-04-19T03:02:58.986 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.986 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.986 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:58.986 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.135768+0000", 2024-04-19T03:02:58.987 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1548999999999998e-05 2024-04-19T03:02:58.987 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.987 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.987 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:58.987 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.135853+0000", 2024-04-19T03:02:58.987 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4845000000000005e-05 2024-04-19T03:02:58.987 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.987 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.987 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:02:58.987 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.135934+0000", 2024-04-19T03:02:58.987 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0315000000000006e-05 2024-04-19T03:02:58.987 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.987 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.988 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:58.988 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.138685+0000", 2024-04-19T03:02:58.988 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.002751042 2024-04-19T03:02:58.988 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.988 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.988 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:58.988 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.198747+0000", 2024-04-19T03:02:58.988 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.060062675000000003 2024-04-19T03:02:58.988 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.988 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.988 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:58.988 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.198802+0000", 2024-04-19T03:02:58.988 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4469000000000003e-05 2024-04-19T03:02:58.988 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.989 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.989 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:58.989 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.198836+0000", 2024-04-19T03:02:58.989 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4272e-05 2024-04-19T03:02:58.989 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:58.989 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:58.989 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:58.989 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.989 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.989 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:158397 5.d 5:b5d962e9:::benchmark_data_smithi096_19531_object44947:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-19T03:02:58.989 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:58.138717+0000", 2024-04-19T03:02:58.989 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.73432371100000005, 2024-04-19T03:02:58.989 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.057191467000000003, 2024-04-19T03:02:58.990 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:58.990 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:58.990 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:58.990 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:58.990 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:58.990 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 158397 2024-04-19T03:02:58.990 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.990 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:58.990 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.990 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:58.990 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.138717+0000", 2024-04-19T03:02:58.990 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:58.990 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.990 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.991 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:58.991 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.138717+0000", 2024-04-19T03:02:58.991 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:58.991 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.991 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.991 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:58.991 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.138716+0000", 2024-04-19T03:02:58.991 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:58.991 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.991 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.991 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:58.991 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.138722+0000", 2024-04-19T03:02:58.991 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1709999999999999e-06 2024-04-19T03:02:58.992 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.992 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.992 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:58.992 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.138731+0000", 2024-04-19T03:02:58.992 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.0310000000000004e-06 2024-04-19T03:02:58.992 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.992 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.992 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:58.992 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.138738+0000", 2024-04-19T03:02:58.992 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8430000000000004e-06 2024-04-19T03:02:58.992 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.992 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.992 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:58.993 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.138789+0000", 2024-04-19T03:02:58.993 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0623e-05 2024-04-19T03:02:58.993 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.993 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.993 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:58.993 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.138945+0000", 2024-04-19T03:02:58.993 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00015671899999999999 2024-04-19T03:02:58.993 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.993 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.993 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:02:58.993 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.139079+0000", 2024-04-19T03:02:58.993 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00013380099999999999 2024-04-19T03:02:58.993 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.993 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.994 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:02:58.994 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.141715+0000", 2024-04-19T03:02:58.994 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0026362849999999999 2024-04-19T03:02:58.994 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.994 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.994 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:58.994 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.195784+0000", 2024-04-19T03:02:58.994 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.054068353 2024-04-19T03:02:58.994 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.994 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.994 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:02:58.994 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.195852+0000", 2024-04-19T03:02:58.994 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8121999999999996e-05 2024-04-19T03:02:58.995 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:58.995 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:58.995 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:02:58.995 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.195909+0000", 2024-04-19T03:02:58.995 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6737999999999998e-05 2024-04-19T03:02:58.995 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:58.995 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:58.995 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:58.995 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:58.995 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:58.995 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-04-19T03:02:58.997 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:58.992+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:58.997 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T03:02:59.098 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:59.094+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:59.121 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-19T03:02:59.121 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-04-19T03:02:59.121 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.121 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4755.0:160736 5.f e56/22 5:f16851a9:::benchmark_data_smithi096_19531_object47286:head v 56'10000, mlcod=56'9998)", 2024-04-19T03:02:59.122 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:59.113524+0000", 2024-04-19T03:02:59.122 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0077710349999999999, 2024-04-19T03:02:59.122 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0077880309999999999, 2024-04-19T03:02:59.122 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:59.122 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-19T03:02:59.122 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:59.122 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.122 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:59.122 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:59.113524+0000", 2024-04-19T03:02:59.122 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:59.122 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.122 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.122 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:59.123 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:59.113524+0000", 2024-04-19T03:02:59.123 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:59.123 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.123 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.123 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:59.123 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:59.113524+0000", 2024-04-19T03:02:59.123 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:59.123 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.123 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.123 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:59.123 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:59.113531+0000", 2024-04-19T03:02:59.123 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.7919999999999993e-06 2024-04-19T03:02:59.123 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.124 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.124 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:59.124 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:59.113540+0000", 2024-04-19T03:02:59.124 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.8019999999999998e-06 2024-04-19T03:02:59.124 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.124 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.124 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:59.124 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:59.113546+0000", 2024-04-19T03:02:59.124 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3519999999999997e-06 2024-04-19T03:02:59.124 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.124 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.124 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:59.124 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:59.113583+0000", 2024-04-19T03:02:59.124 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7942999999999999e-05 2024-04-19T03:02:59.125 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.125 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.125 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:59.125 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:59.113600+0000", 2024-04-19T03:02:59.125 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7000999999999999e-05 2024-04-19T03:02:59.125 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:59.125 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:59.125 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:59.125 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.125 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.125 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:160739 5.4 5:29022d30:::benchmark_data_smithi096_19531_object47289:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-19T03:02:59.125 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:59.115651+0000", 2024-04-19T03:02:59.125 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0056445000000000002, 2024-04-19T03:02:59.125 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0057004739999999996, 2024-04-19T03:02:59.126 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:59.126 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-19T03:02:59.126 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:59.126 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:59.126 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:59.126 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160739 2024-04-19T03:02:59.126 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.126 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:59.126 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.126 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:59.126 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:59.115651+0000", 2024-04-19T03:02:59.126 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:59.126 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.127 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.127 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:59.127 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:59.115651+0000", 2024-04-19T03:02:59.127 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:59.127 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.127 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.127 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:59.127 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:59.115650+0000", 2024-04-19T03:02:59.127 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:59.127 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.127 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.127 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:59.128 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:59.115657+0000", 2024-04-19T03:02:59.128 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.204e-06 2024-04-19T03:02:59.128 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.128 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.128 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:59.128 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:59.115665+0000", 2024-04-19T03:02:59.128 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0800000000000006e-06 2024-04-19T03:02:59.128 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.128 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.128 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:59.128 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:59.115671+0000", 2024-04-19T03:02:59.128 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9529999999999996e-06 2024-04-19T03:02:59.128 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.128 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.129 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:59.129 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:59.117272+0000", 2024-04-19T03:02:59.129 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0016013729999999999 2024-04-19T03:02:59.129 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.129 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.129 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:59.129 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:59.117366+0000", 2024-04-19T03:02:59.129 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.3797999999999999e-05 2024-04-19T03:02:59.129 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:59.129 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:59.129 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:59.129 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.129 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.129 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4755.0:160745 5.d e56/49 5:b2dcb455:::benchmark_data_smithi096_19531_object47295:head v 56'10180, mlcod=56'10178)", 2024-04-19T03:02:59.129 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:59.117966+0000", 2024-04-19T03:02:59.130 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.003329388, 2024-04-19T03:02:59.130 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0034236789999999998, 2024-04-19T03:02:59.130 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:59.130 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-19T03:02:59.130 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:59.130 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.130 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:59.130 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:59.117966+0000", 2024-04-19T03:02:59.130 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:59.130 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.130 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.130 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:59.130 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:59.117966+0000", 2024-04-19T03:02:59.131 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:59.131 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.131 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.131 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:59.131 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:59.117965+0000", 2024-04-19T03:02:59.131 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:59.131 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.131 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.131 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:59.131 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:59.117975+0000", 2024-04-19T03:02:59.131 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.7459999999999995e-06 2024-04-19T03:02:59.131 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.131 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.131 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:59.132 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:59.117988+0000", 2024-04-19T03:02:59.132 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3106e-05 2024-04-19T03:02:59.132 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.132 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.132 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:59.132 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:59.117997+0000", 2024-04-19T03:02:59.132 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9800000000000004e-06 2024-04-19T03:02:59.132 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.132 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.132 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:59.132 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:59.118038+0000", 2024-04-19T03:02:59.132 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1004000000000002e-05 2024-04-19T03:02:59.132 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.132 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.133 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:59.133 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:59.118059+0000", 2024-04-19T03:02:59.133 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1336e-05 2024-04-19T03:02:59.133 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:59.133 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:59.133 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:59.133 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.133 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.133 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:160746 5.0 5:0c2dca0a:::benchmark_data_smithi096_19531_object47296:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-19T03:02:59.133 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:59.118113+0000", 2024-04-19T03:02:59.133 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0031817870000000002, 2024-04-19T03:02:59.133 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0033082680000000001, 2024-04-19T03:02:59.133 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:59.133 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-19T03:02:59.134 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:59.134 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:59.134 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:59.134 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160746 2024-04-19T03:02:59.134 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.134 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:59.134 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.134 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:59.134 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:59.118113+0000", 2024-04-19T03:02:59.134 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:59.134 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.134 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.134 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:59.135 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:59.118113+0000", 2024-04-19T03:02:59.135 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:59.135 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.135 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.135 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:59.137 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:59.118112+0000", 2024-04-19T03:02:59.137 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:59.137 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.137 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.138 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:59.138 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:59.118117+0000", 2024-04-19T03:02:59.138 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8960000000000002e-06 2024-04-19T03:02:59.138 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.138 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.138 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:59.138 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:59.118127+0000", 2024-04-19T03:02:59.138 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.5619999999999993e-06 2024-04-19T03:02:59.138 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.138 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.138 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:59.139 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:59.118133+0000", 2024-04-19T03:02:59.139 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7070000000000003e-06 2024-04-19T03:02:59.139 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.139 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.139 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:59.139 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:59.118170+0000", 2024-04-19T03:02:59.139 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6964e-05 2024-04-19T03:02:59.139 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.139 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.139 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:59.139 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:59.118259+0000", 2024-04-19T03:02:59.139 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.8923000000000002e-05 2024-04-19T03:02:59.140 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:59.140 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:59.140 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:59.140 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.140 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.140 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:160747 5.e 5:7298c84a:::benchmark_data_smithi096_19531_object47297:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-19T03:02:59.140 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:59.118155+0000", 2024-04-19T03:02:59.140 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0031399539999999999, 2024-04-19T03:02:59.140 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0033058649999999998, 2024-04-19T03:02:59.140 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:59.140 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-19T03:02:59.140 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:59.140 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:59.140 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:59.141 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160747 2024-04-19T03:02:59.141 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.141 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:59.141 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.141 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:59.141 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:59.118155+0000", 2024-04-19T03:02:59.141 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:59.141 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.141 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.141 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:59.141 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:59.118155+0000", 2024-04-19T03:02:59.141 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:59.141 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.141 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.142 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:59.142 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:59.118155+0000", 2024-04-19T03:02:59.142 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:59.142 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.142 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.142 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:59.142 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:59.118158+0000", 2024-04-19T03:02:59.142 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1259999999999998e-06 2024-04-19T03:02:59.142 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.142 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.142 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:59.142 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:59.118168+0000", 2024-04-19T03:02:59.142 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0407e-05 2024-04-19T03:02:59.142 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.143 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.143 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:59.143 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:59.118174+0000", 2024-04-19T03:02:59.143 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2959999999999998e-06 2024-04-19T03:02:59.143 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.143 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.143 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:59.143 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:59.118224+0000", 2024-04-19T03:02:59.143 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0695000000000002e-05 2024-04-19T03:02:59.143 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.143 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.143 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:59.143 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:59.118355+0000", 2024-04-19T03:02:59.144 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013106399999999999 2024-04-19T03:02:59.144 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:59.144 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:59.144 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:59.144 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.144 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.144 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:160750 5.0 5:09574597:::benchmark_data_smithi096_19531_object47300:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-19T03:02:59.144 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:59.119100+0000", 2024-04-19T03:02:59.144 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0021948789999999998, 2024-04-19T03:02:59.144 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.002395805, 2024-04-19T03:02:59.144 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:59.144 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-19T03:02:59.145 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:59.145 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:59.145 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:59.145 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160750 2024-04-19T03:02:59.145 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.145 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:59.145 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.145 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:59.145 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:59.119100+0000", 2024-04-19T03:02:59.145 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:59.145 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.145 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.145 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:59.145 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:59.119100+0000", 2024-04-19T03:02:59.146 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:59.146 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.146 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.146 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:59.146 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:59.119099+0000", 2024-04-19T03:02:59.146 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:59.146 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.146 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.146 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:59.146 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:59.119104+0000", 2024-04-19T03:02:59.146 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8319999999999996e-06 2024-04-19T03:02:59.146 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.147 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.147 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:59.147 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:59.119118+0000", 2024-04-19T03:02:59.147 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4087000000000001e-05 2024-04-19T03:02:59.147 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.147 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.147 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:59.147 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:59.119126+0000", 2024-04-19T03:02:59.147 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.6459999999999993e-06 2024-04-19T03:02:59.147 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.147 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.147 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:59.147 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:59.120815+0000", 2024-04-19T03:02:59.148 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001689411 2024-04-19T03:02:59.148 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.148 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.148 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:59.148 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:59.120988+0000", 2024-04-19T03:02:59.148 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00017249999999999999 2024-04-19T03:02:59.148 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:59.148 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:59.148 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:59.148 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.148 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.148 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4755.0:160751 5.f e56/22 5:f9b61bc1:::benchmark_data_smithi096_19531_object47301:head v 56'10001, mlcod=56'9998)", 2024-04-19T03:02:59.148 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:59.119552+0000", 2024-04-19T03:02:59.149 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0017432249999999999, 2024-04-19T03:02:59.149 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0019780940000000001, 2024-04-19T03:02:59.149 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:59.149 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-19T03:02:59.149 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:59.149 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.149 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:59.149 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:59.119552+0000", 2024-04-19T03:02:59.149 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:59.149 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.149 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.149 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:59.149 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:59.119552+0000", 2024-04-19T03:02:59.149 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:59.149 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.150 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.150 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:59.150 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:59.119551+0000", 2024-04-19T03:02:59.150 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:59.150 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.150 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.150 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:59.150 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:59.119561+0000", 2024-04-19T03:02:59.150 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.4320000000000005e-06 2024-04-19T03:02:59.150 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.150 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.150 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:59.150 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:59.119573+0000", 2024-04-19T03:02:59.151 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2777e-05 2024-04-19T03:02:59.151 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.151 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.151 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:59.151 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:59.119580+0000", 2024-04-19T03:02:59.151 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0759999999999999e-06 2024-04-19T03:02:59.151 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.151 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.151 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:59.151 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:59.119622+0000", 2024-04-19T03:02:59.151 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2797999999999999e-05 2024-04-19T03:02:59.151 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.151 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.152 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:59.152 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:59.119645+0000", 2024-04-19T03:02:59.152 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2331999999999999e-05 2024-04-19T03:02:59.152 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:59.152 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:59.152 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:59.152 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.152 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.152 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:160753 5.e 5:7689fc2c:::benchmark_data_smithi096_19531_object47303:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-19T03:02:59.152 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:59.120688+0000", 2024-04-19T03:02:59.152 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.00060671300000000004, 2024-04-19T03:02:59.152 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00087273400000000001, 2024-04-19T03:02:59.152 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:59.153 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-19T03:02:59.153 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:59.153 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:59.153 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:59.153 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 160753 2024-04-19T03:02:59.153 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.153 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:59.153 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.153 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:59.153 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:59.120688+0000", 2024-04-19T03:02:59.153 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:59.153 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.154 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.154 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:59.154 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:59.120688+0000", 2024-04-19T03:02:59.154 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:59.154 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.154 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.154 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:59.154 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:59.120687+0000", 2024-04-19T03:02:59.154 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:59.154 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.154 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.154 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:59.154 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:59.120693+0000", 2024-04-19T03:02:59.154 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5520000000000004e-06 2024-04-19T03:02:59.155 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.155 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.155 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:59.155 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:59.120707+0000", 2024-04-19T03:02:59.155 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3888e-05 2024-04-19T03:02:59.155 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.155 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.155 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:59.155 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:59.120717+0000", 2024-04-19T03:02:59.155 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.8130000000000007e-06 2024-04-19T03:02:59.155 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.155 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.155 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:59.155 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:59.120760+0000", 2024-04-19T03:02:59.155 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3603999999999998e-05 2024-04-19T03:02:59.156 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.156 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.156 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:59.156 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:59.120910+0000", 2024-04-19T03:02:59.156 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014994300000000001 2024-04-19T03:02:59.156 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:59.156 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:59.156 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:59.156 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:59.156 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-04-19T03:02:59.156 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 8 2024-04-19T03:02:59.156 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-19T03:02:59.157 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T03:02:59.198 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:59.196+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:59.278 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-19T03:02:59.278 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-04-19T03:02:59.278 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-04-19T03:02:59.278 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-04-19T03:02:59.279 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-19T03:02:59.290 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T03:02:59.301 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:59.294+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:59.400 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:59.398+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:59.420 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-19T03:02:59.421 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-04-19T03:02:59.421 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-04-19T03:02:59.421 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-04-19T03:02:59.421 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.421 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:86615 5.e 5:7fef7288:::benchmark_data_smithi096_19531_object86614:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:59.421 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:22.634544+0000", 2024-04-19T03:02:59.421 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 36.784242339999999, 2024-04-19T03:02:59.421 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.192475071, 2024-04-19T03:02:59.421 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:59.421 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:59.421 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:59.421 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:59.422 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:59.422 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 86615 2024-04-19T03:02:59.422 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.422 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:59.422 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.422 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:59.422 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634544+0000", 2024-04-19T03:02:59.422 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:59.422 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.422 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.422 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:59.422 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634544+0000", 2024-04-19T03:02:59.423 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:59.423 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.423 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.423 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:59.423 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634542+0000", 2024-04-19T03:02:59.423 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999981 2024-04-19T03:02:59.423 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.423 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.423 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:59.423 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634585+0000", 2024-04-19T03:02:59.423 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2299000000000003e-05 2024-04-19T03:02:59.423 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.424 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.424 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:59.424 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634592+0000", 2024-04-19T03:02:59.424 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2350000000000002e-06 2024-04-19T03:02:59.424 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.424 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.424 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:59.424 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634596+0000", 2024-04-19T03:02:59.424 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5390000000000001e-06 2024-04-19T03:02:59.424 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.424 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.424 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:59.424 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634639+0000", 2024-04-19T03:02:59.424 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2444999999999998e-05 2024-04-19T03:02:59.425 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.425 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.425 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:59.425 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634808+0000", 2024-04-19T03:02:59.425 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000169152 2024-04-19T03:02:59.425 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.425 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.425 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:59.425 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634999+0000", 2024-04-19T03:02:59.425 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00019098300000000001 2024-04-19T03:02:59.425 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.425 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.425 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:59.425 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.640458+0000", 2024-04-19T03:02:59.426 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0054586870000000003 2024-04-19T03:02:59.426 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.426 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.426 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:59.426 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.826949+0000", 2024-04-19T03:02:59.426 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.18649178299999999 2024-04-19T03:02:59.426 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.426 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.426 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:59.426 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.826982+0000", 2024-04-19T03:02:59.426 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2477000000000001e-05 2024-04-19T03:02:59.427 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.427 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.427 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:59.427 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.827019+0000", 2024-04-19T03:02:59.427 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7355999999999999e-05 2024-04-19T03:02:59.427 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:59.427 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:59.427 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:59.427 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.427 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.427 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:86616 5.e 5:72278f47:::benchmark_data_smithi096_19531_object86615:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:59.427 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:22.634609+0000", 2024-04-19T03:02:59.427 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 36.784177190999998, 2024-04-19T03:02:59.428 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.19472088900000001, 2024-04-19T03:02:59.428 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:59.428 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:59.428 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:59.428 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:59.428 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:59.428 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 86616 2024-04-19T03:02:59.428 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.428 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:59.428 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.428 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:59.428 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634609+0000", 2024-04-19T03:02:59.429 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:59.429 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.429 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.429 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:59.429 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634609+0000", 2024-04-19T03:02:59.429 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:59.429 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.429 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.429 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:59.429 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634609+0000", 2024-04-19T03:02:59.429 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:59.430 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.430 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.430 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:59.430 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634651+0000", 2024-04-19T03:02:59.430 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2589000000000002e-05 2024-04-19T03:02:59.430 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.430 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.430 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:59.430 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634659+0000", 2024-04-19T03:02:59.430 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5850000000000002e-06 2024-04-19T03:02:59.430 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.430 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.431 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:59.431 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634662+0000", 2024-04-19T03:02:59.431 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3620000000000002e-06 2024-04-19T03:02:59.431 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.431 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.431 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:59.431 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.637880+0000", 2024-04-19T03:02:59.431 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.003218149 2024-04-19T03:02:59.431 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.431 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.431 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:59.431 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.637999+0000", 2024-04-19T03:02:59.431 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000118643 2024-04-19T03:02:59.431 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.432 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.432 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:59.432 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.638102+0000", 2024-04-19T03:02:59.432 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010331 2024-04-19T03:02:59.432 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.432 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.432 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:59.432 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.640851+0000", 2024-04-19T03:02:59.432 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0027483310000000001 2024-04-19T03:02:59.432 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.432 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.432 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:59.432 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.829269+0000", 2024-04-19T03:02:59.433 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.188418319 2024-04-19T03:02:59.433 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.433 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.433 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:59.433 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.829299+0000", 2024-04-19T03:02:59.433 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0227e-05 2024-04-19T03:02:59.433 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.433 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.433 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:59.433 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.829330+0000", 2024-04-19T03:02:59.433 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0969000000000001e-05 2024-04-19T03:02:59.433 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:59.433 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:59.433 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:59.434 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.434 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.434 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:86618 5.0 5:09014b90:::benchmark_data_smithi096_19531_object86617:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:59.434 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:22.634894+0000", 2024-04-19T03:02:59.434 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 36.783892702999999, 2024-04-19T03:02:59.434 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.19413419800000001, 2024-04-19T03:02:59.434 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:59.434 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:59.434 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:59.434 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:59.434 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:59.434 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 86618 2024-04-19T03:02:59.435 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.435 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:59.435 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.435 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:59.435 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634894+0000", 2024-04-19T03:02:59.435 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:59.435 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.435 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.435 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:59.435 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634894+0000", 2024-04-19T03:02:59.435 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:59.435 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.435 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.436 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:59.436 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634893+0000", 2024-04-19T03:02:59.436 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:59.436 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.436 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.436 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:59.436 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634976+0000", 2024-04-19T03:02:59.436 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3231000000000003e-05 2024-04-19T03:02:59.436 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.436 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.436 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:59.436 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634983+0000", 2024-04-19T03:02:59.436 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5169999999999996e-06 2024-04-19T03:02:59.437 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.437 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.437 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:59.437 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634987+0000", 2024-04-19T03:02:59.437 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.425e-06 2024-04-19T03:02:59.437 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.437 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.437 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:59.437 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635030+0000", 2024-04-19T03:02:59.437 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.32e-05 2024-04-19T03:02:59.438 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.438 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.438 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:59.438 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635185+0000", 2024-04-19T03:02:59.438 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015471899999999999 2024-04-19T03:02:59.438 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.438 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.439 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:59.439 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635415+0000", 2024-04-19T03:02:59.439 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00023026500000000001 2024-04-19T03:02:59.439 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.439 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.439 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:59.439 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.640127+0000", 2024-04-19T03:02:59.439 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0047118890000000004 2024-04-19T03:02:59.439 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.439 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.439 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:59.440 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.828895+0000", 2024-04-19T03:02:59.440 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.18876802600000001 2024-04-19T03:02:59.440 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.440 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.440 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:59.440 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.828972+0000", 2024-04-19T03:02:59.440 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.6345000000000002e-05 2024-04-19T03:02:59.440 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.440 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.440 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:59.440 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.829028+0000", 2024-04-19T03:02:59.440 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6342999999999999e-05 2024-04-19T03:02:59.440 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:59.440 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:59.440 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:59.441 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.441 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.441 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:86620 5.b 5:d80faa68:::benchmark_data_smithi096_19531_object86619:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:59.441 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:22.635110+0000", 2024-04-19T03:02:59.441 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 36.783676143000001, 2024-04-19T03:02:59.441 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.193447275, 2024-04-19T03:02:59.441 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:59.441 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:59.441 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:59.441 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:59.441 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:59.441 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 86620 2024-04-19T03:02:59.441 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.441 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:59.442 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.442 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:59.442 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635110+0000", 2024-04-19T03:02:59.442 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:59.442 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.442 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.442 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:59.442 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635110+0000", 2024-04-19T03:02:59.442 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:59.442 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.442 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.442 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:59.442 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635110+0000", 2024-04-19T03:02:59.442 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:59.443 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.443 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.443 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:59.443 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635154+0000", 2024-04-19T03:02:59.443 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4681000000000001e-05 2024-04-19T03:02:59.443 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.443 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.443 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:59.443 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635166+0000", 2024-04-19T03:02:59.443 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1505000000000001e-05 2024-04-19T03:02:59.443 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.443 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.443 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:59.443 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635171+0000", 2024-04-19T03:02:59.443 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6040000000000003e-06 2024-04-19T03:02:59.444 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.444 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.444 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:59.444 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635221+0000", 2024-04-19T03:02:59.444 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9947000000000001e-05 2024-04-19T03:02:59.444 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.444 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.444 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:59.444 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635356+0000", 2024-04-19T03:02:59.444 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013576199999999999 2024-04-19T03:02:59.444 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.444 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.444 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:59.444 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635507+0000", 2024-04-19T03:02:59.444 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015072999999999999 2024-04-19T03:02:59.445 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.445 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.445 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:59.445 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.638488+0000", 2024-04-19T03:02:59.445 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0029813159999999999 2024-04-19T03:02:59.445 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.445 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.445 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:59.445 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.828341+0000", 2024-04-19T03:02:59.445 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.189852254 2024-04-19T03:02:59.445 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.445 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.445 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:59.445 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.828416+0000", 2024-04-19T03:02:59.445 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5344000000000002e-05 2024-04-19T03:02:59.446 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.446 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.446 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:59.446 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.828558+0000", 2024-04-19T03:02:59.446 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000141695 2024-04-19T03:02:59.446 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:59.446 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:59.446 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:59.446 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.446 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.446 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:86621 5.8 5:1597a420:::benchmark_data_smithi096_19531_object86620:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:59.446 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:22.635187+0000", 2024-04-19T03:02:59.446 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 36.783599283000001, 2024-04-19T03:02:59.446 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.194204878, 2024-04-19T03:02:59.447 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:59.447 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:59.447 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:59.447 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:59.447 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:59.447 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 86621 2024-04-19T03:02:59.447 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.447 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:59.447 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.447 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:59.447 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635187+0000", 2024-04-19T03:02:59.447 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:59.447 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.447 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.447 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:59.448 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635187+0000", 2024-04-19T03:02:59.448 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:59.448 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.448 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.448 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:59.448 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635187+0000", 2024-04-19T03:02:59.448 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:59.448 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.448 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.448 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:59.448 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635242+0000", 2024-04-19T03:02:59.448 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5158000000000003e-05 2024-04-19T03:02:59.448 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.448 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.448 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:59.449 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635249+0000", 2024-04-19T03:02:59.449 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.7000000000000008e-06 2024-04-19T03:02:59.449 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.449 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.449 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:59.449 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635256+0000", 2024-04-19T03:02:59.449 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2060000000000004e-06 2024-04-19T03:02:59.449 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.449 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.449 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:59.449 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635302+0000", 2024-04-19T03:02:59.449 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5954000000000001e-05 2024-04-19T03:02:59.449 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.449 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.450 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:59.450 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635427+0000", 2024-04-19T03:02:59.450 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012559299999999999 2024-04-19T03:02:59.450 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.450 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.450 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:59.450 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635596+0000", 2024-04-19T03:02:59.450 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000168615 2024-04-19T03:02:59.450 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.450 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.450 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:59.450 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.639320+0000", 2024-04-19T03:02:59.450 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0037244610000000001 2024-04-19T03:02:59.450 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.451 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.451 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:59.451 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.829277+0000", 2024-04-19T03:02:59.451 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.18995651099999999 2024-04-19T03:02:59.451 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.451 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.451 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:59.451 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.829341+0000", 2024-04-19T03:02:59.451 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3756000000000004e-05 2024-04-19T03:02:59.451 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.451 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.451 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:59.451 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.829392+0000", 2024-04-19T03:02:59.451 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1555999999999999e-05 2024-04-19T03:02:59.452 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:59.452 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:59.452 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:59.452 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.452 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.452 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87067 5.b 5:d57af71a:::benchmark_data_smithi096_19531_object87066:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:59.452 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.142233+0000", 2024-04-19T03:02:59.452 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 36.276553419999999, 2024-04-19T03:02:59.452 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.071692405000000001, 2024-04-19T03:02:59.452 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:59.452 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:59.452 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:59.452 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:59.452 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:59.453 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87067 2024-04-19T03:02:59.453 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.453 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:59.453 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.453 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:59.453 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142233+0000", 2024-04-19T03:02:59.453 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:59.453 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.453 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.453 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:59.453 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142233+0000", 2024-04-19T03:02:59.453 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:59.453 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.454 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.454 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:59.454 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142232+0000", 2024-04-19T03:02:59.454 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:59.454 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.454 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.454 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:59.454 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142277+0000", 2024-04-19T03:02:59.454 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5837000000000002e-05 2024-04-19T03:02:59.454 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.454 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.454 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:59.454 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142297+0000", 2024-04-19T03:02:59.454 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9561000000000001e-05 2024-04-19T03:02:59.454 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.455 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.455 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:59.455 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142311+0000", 2024-04-19T03:02:59.455 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3654e-05 2024-04-19T03:02:59.455 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.455 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.455 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:59.455 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142391+0000", 2024-04-19T03:02:59.455 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0123999999999994e-05 2024-04-19T03:02:59.455 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.455 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.455 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:59.455 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142669+0000", 2024-04-19T03:02:59.455 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00027829800000000001 2024-04-19T03:02:59.456 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.456 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.456 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:59.456 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142859+0000", 2024-04-19T03:02:59.456 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000190051 2024-04-19T03:02:59.456 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.456 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.456 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:59.456 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.150597+0000", 2024-04-19T03:02:59.456 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0077380299999999999 2024-04-19T03:02:59.456 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.456 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.456 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:59.456 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.213855+0000", 2024-04-19T03:02:59.457 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.063257987000000002 2024-04-19T03:02:59.457 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.457 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.457 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:59.457 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.213898+0000", 2024-04-19T03:02:59.457 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2916e-05 2024-04-19T03:02:59.457 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.457 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.457 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:59.457 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.213925+0000", 2024-04-19T03:02:59.457 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7503000000000001e-05 2024-04-19T03:02:59.457 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:59.457 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:59.457 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:59.457 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.458 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.458 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87069 5.b 5:da0c93b5:::benchmark_data_smithi096_19531_object87068:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:59.458 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.143402+0000", 2024-04-19T03:02:59.458 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 36.275384457999998, 2024-04-19T03:02:59.458 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.070678598999999995, 2024-04-19T03:02:59.458 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:59.458 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:59.458 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:59.458 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:59.458 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:59.458 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87069 2024-04-19T03:02:59.458 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.458 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:59.458 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.459 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:59.459 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.143402+0000", 2024-04-19T03:02:59.459 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:59.459 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.459 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.459 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:59.459 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.143402+0000", 2024-04-19T03:02:59.459 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:59.459 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.459 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.459 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:59.459 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.143401+0000", 2024-04-19T03:02:59.459 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:59.459 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.460 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.460 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:59.460 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.143501+0000", 2024-04-19T03:02:59.460 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000100387 2024-04-19T03:02:59.460 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.460 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.460 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:59.460 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.143516+0000", 2024-04-19T03:02:59.460 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5369000000000001e-05 2024-04-19T03:02:59.460 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.460 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.460 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:59.460 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.143524+0000", 2024-04-19T03:02:59.460 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.7079999999999997e-06 2024-04-19T03:02:59.461 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.461 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.461 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:59.461 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.145550+0000", 2024-04-19T03:02:59.461 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0020259290000000001 2024-04-19T03:02:59.461 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.461 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.461 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:59.461 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.145676+0000", 2024-04-19T03:02:59.461 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000126406 2024-04-19T03:02:59.461 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.461 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.461 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:59.461 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.145802+0000", 2024-04-19T03:02:59.462 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000125974 2024-04-19T03:02:59.462 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.462 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.462 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:59.462 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.151030+0000", 2024-04-19T03:02:59.462 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0052276079999999999 2024-04-19T03:02:59.462 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.462 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.462 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:02:59.462 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.213998+0000", 2024-04-19T03:02:59.462 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.06296786 2024-04-19T03:02:59.462 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.462 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.462 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:59.463 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.214031+0000", 2024-04-19T03:02:59.463 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3387999999999999e-05 2024-04-19T03:02:59.463 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.463 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.463 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:59.463 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.214081+0000", 2024-04-19T03:02:59.463 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9316e-05 2024-04-19T03:02:59.463 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:59.463 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:59.463 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:59.463 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.463 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.463 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87108 5.e 5:7e197adc:::benchmark_data_smithi096_19531_object87107:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:59.463 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.223103+0000", 2024-04-19T03:02:59.464 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 36.195683121000002, 2024-04-19T03:02:59.464 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.044946887, 2024-04-19T03:02:59.464 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:59.464 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-19T03:02:59.464 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:59.464 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:59.464 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:59.464 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87108 2024-04-19T03:02:59.464 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.464 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:59.464 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.464 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:59.464 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.223103+0000", 2024-04-19T03:02:59.465 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:59.465 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.465 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.465 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:59.465 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.223103+0000", 2024-04-19T03:02:59.465 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:59.465 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.465 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.465 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:59.465 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.223102+0000", 2024-04-19T03:02:59.465 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:59.465 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.465 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.465 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:59.466 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.223156+0000", 2024-04-19T03:02:59.466 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3958000000000001e-05 2024-04-19T03:02:59.466 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.466 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.466 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:59.466 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.223166+0000", 2024-04-19T03:02:59.466 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.4809999999999995e-06 2024-04-19T03:02:59.466 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.466 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.466 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:59.466 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.223172+0000", 2024-04-19T03:02:59.466 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0140000000000004e-06 2024-04-19T03:02:59.466 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.466 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.467 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:59.467 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.227295+0000", 2024-04-19T03:02:59.467 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0041233420000000003 2024-04-19T03:02:59.467 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.467 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.467 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:59.467 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.227495+0000", 2024-04-19T03:02:59.467 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00019955299999999999 2024-04-19T03:02:59.467 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.467 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.467 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:59.467 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.227717+0000", 2024-04-19T03:02:59.467 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000221902 2024-04-19T03:02:59.467 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.467 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.468 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:59.468 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233189+0000", 2024-04-19T03:02:59.468 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0054718889999999997 2024-04-19T03:02:59.468 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.468 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.468 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:59.468 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.250529+0000", 2024-04-19T03:02:59.468 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.017340298000000001 2024-04-19T03:02:59.468 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.468 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.468 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:02:59.468 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.250539+0000", 2024-04-19T03:02:59.468 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0501e-05 2024-04-19T03:02:59.468 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.468 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.469 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:59.469 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.268003+0000", 2024-04-19T03:02:59.469 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.017463429 2024-04-19T03:02:59.469 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.469 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.469 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:59.469 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.268050+0000", 2024-04-19T03:02:59.469 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7466000000000003e-05 2024-04-19T03:02:59.469 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:59.469 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:59.469 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:59.469 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.469 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.469 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87118 5.b 5:d1bb4f3c:::benchmark_data_smithi096_19531_object87117:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:59.470 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.231082+0000", 2024-04-19T03:02:59.470 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 36.187704287000003, 2024-04-19T03:02:59.470 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.035789004, 2024-04-19T03:02:59.470 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:59.470 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-19T03:02:59.470 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:59.470 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:59.470 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:59.470 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87118 2024-04-19T03:02:59.470 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.470 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:59.470 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.470 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:59.470 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231082+0000", 2024-04-19T03:02:59.471 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:59.471 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.471 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.471 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:59.471 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231082+0000", 2024-04-19T03:02:59.471 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:59.471 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.471 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.471 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:59.471 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231081+0000", 2024-04-19T03:02:59.471 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:59.471 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.471 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.471 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:59.471 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231159+0000", 2024-04-19T03:02:59.471 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.7819999999999997e-05 2024-04-19T03:02:59.472 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.472 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.472 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:59.472 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231186+0000", 2024-04-19T03:02:59.472 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7126000000000001e-05 2024-04-19T03:02:59.472 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.472 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.472 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:59.472 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231193+0000", 2024-04-19T03:02:59.472 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7259999999999996e-06 2024-04-19T03:02:59.472 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.472 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.472 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:59.472 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231241+0000", 2024-04-19T03:02:59.472 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8123e-05 2024-04-19T03:02:59.473 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.473 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.473 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:59.473 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231354+0000", 2024-04-19T03:02:59.473 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0001133 2024-04-19T03:02:59.473 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.473 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.473 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:59.473 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231443+0000", 2024-04-19T03:02:59.473 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9167999999999997e-05 2024-04-19T03:02:59.473 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.473 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.473 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:59.473 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236498+0000", 2024-04-19T03:02:59.473 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0050545160000000002 2024-04-19T03:02:59.473 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.474 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.474 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:59.474 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.249681+0000", 2024-04-19T03:02:59.474 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013183321 2024-04-19T03:02:59.474 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.474 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.474 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:02:59.474 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.249693+0000", 2024-04-19T03:02:59.474 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1834999999999999e-05 2024-04-19T03:02:59.474 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.474 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.474 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:59.475 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266733+0000", 2024-04-19T03:02:59.475 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.017040408 2024-04-19T03:02:59.475 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.475 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.475 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:59.475 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266871+0000", 2024-04-19T03:02:59.475 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000137849 2024-04-19T03:02:59.475 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:59.475 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:59.475 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:59.475 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.475 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.475 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87121 5.b 5:d01822b8:::benchmark_data_smithi096_19531_object87120:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:59.476 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.233319+0000", 2024-04-19T03:02:59.476 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 36.185467422999999, 2024-04-19T03:02:59.476 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.033624198, 2024-04-19T03:02:59.476 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:59.476 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-19T03:02:59.476 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:59.476 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:59.476 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:59.476 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87121 2024-04-19T03:02:59.477 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.477 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:59.477 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.477 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:59.477 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233319+0000", 2024-04-19T03:02:59.477 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:59.477 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.477 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.477 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:59.477 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233319+0000", 2024-04-19T03:02:59.477 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:59.477 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.477 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.477 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:59.477 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233319+0000", 2024-04-19T03:02:59.478 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:59.478 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.478 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.478 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:59.478 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233364+0000", 2024-04-19T03:02:59.478 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5460999999999997e-05 2024-04-19T03:02:59.478 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.478 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.478 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:59.478 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233382+0000", 2024-04-19T03:02:59.478 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8148e-05 2024-04-19T03:02:59.478 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.478 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.479 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:59.479 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233390+0000", 2024-04-19T03:02:59.479 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5340000000000002e-06 2024-04-19T03:02:59.479 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.479 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.479 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:59.479 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233712+0000", 2024-04-19T03:02:59.479 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00032260500000000001 2024-04-19T03:02:59.479 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.479 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.479 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:59.479 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233829+0000", 2024-04-19T03:02:59.479 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011638599999999999 2024-04-19T03:02:59.479 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.479 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.480 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:59.480 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233959+0000", 2024-04-19T03:02:59.480 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013013900000000001 2024-04-19T03:02:59.480 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.480 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.480 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:59.480 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236515+0000", 2024-04-19T03:02:59.480 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0025562750000000002 2024-04-19T03:02:59.480 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.480 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.480 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:59.480 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.249723+0000", 2024-04-19T03:02:59.480 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013208176 2024-04-19T03:02:59.481 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.481 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.481 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:02:59.481 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.249728+0000", 2024-04-19T03:02:59.481 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6519999999999997e-06 2024-04-19T03:02:59.481 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.481 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.481 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:59.481 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266837+0000", 2024-04-19T03:02:59.481 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0171087059999999 2024-04-19T03:02:59.481 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.481 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.481 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:59.481 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266943+0000", 2024-04-19T03:02:59.482 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000106604 2024-04-19T03:02:59.482 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:59.482 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:59.482 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:59.482 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.482 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.482 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87124 5.8 5:14819ad7:::benchmark_data_smithi096_19531_object87123:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:59.482 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.235886+0000", 2024-04-19T03:02:59.482 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 36.182899999, 2024-04-19T03:02:59.482 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0315451179999999, 2024-04-19T03:02:59.482 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:59.482 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-19T03:02:59.482 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:59.483 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:59.483 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:59.483 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87124 2024-04-19T03:02:59.483 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.483 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:59.483 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.483 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:59.483 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.235886+0000", 2024-04-19T03:02:59.483 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:59.483 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.483 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.483 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:59.483 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.235886+0000", 2024-04-19T03:02:59.483 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:59.484 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.484 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.484 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:59.484 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.235886+0000", 2024-04-19T03:02:59.484 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:59.484 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.484 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.484 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:59.484 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.235934+0000", 2024-04-19T03:02:59.484 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8384000000000003e-05 2024-04-19T03:02:59.484 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.484 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.484 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:59.484 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.235945+0000", 2024-04-19T03:02:59.485 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0671e-05 2024-04-19T03:02:59.485 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.485 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.485 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:59.485 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.235952+0000", 2024-04-19T03:02:59.485 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3089999999999998e-06 2024-04-19T03:02:59.485 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.485 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.485 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:59.485 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.237067+0000", 2024-04-19T03:02:59.485 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001115263 2024-04-19T03:02:59.485 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.485 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.485 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:59.486 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.237188+0000", 2024-04-19T03:02:59.486 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000121258 2024-04-19T03:02:59.486 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.486 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.486 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:59.486 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.237316+0000", 2024-04-19T03:02:59.486 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000128071 2024-04-19T03:02:59.486 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.486 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.486 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:59.486 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240744+0000", 2024-04-19T03:02:59.486 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0034275629999999998 2024-04-19T03:02:59.486 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.486 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.487 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:59.487 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.252517+0000", 2024-04-19T03:02:59.487 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011772991999999999 2024-04-19T03:02:59.487 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.487 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.487 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:02:59.487 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.252523+0000", 2024-04-19T03:02:59.487 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3640000000000004e-06 2024-04-19T03:02:59.487 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.487 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.487 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:59.487 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.267290+0000", 2024-04-19T03:02:59.487 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0147665690000001 2024-04-19T03:02:59.487 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.488 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.488 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:59.488 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.267432+0000", 2024-04-19T03:02:59.488 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014165299999999999 2024-04-19T03:02:59.488 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:59.488 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:59.488 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:59.488 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.488 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.488 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87129 5.0 5:02667e01:::benchmark_data_smithi096_19531_object87128:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:59.488 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.236466+0000", 2024-04-19T03:02:59.488 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 36.182320003000001, 2024-04-19T03:02:59.488 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0301534510000001, 2024-04-19T03:02:59.488 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:59.489 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-19T03:02:59.489 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:59.489 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:59.489 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:59.489 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87129 2024-04-19T03:02:59.489 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.489 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:59.489 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.489 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:59.489 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236466+0000", 2024-04-19T03:02:59.489 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:59.489 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.489 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.489 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:59.489 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236466+0000", 2024-04-19T03:02:59.490 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:59.490 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.490 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.490 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:59.490 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236465+0000", 2024-04-19T03:02:59.490 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:59.490 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.490 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.490 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:59.490 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236566+0000", 2024-04-19T03:02:59.491 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010047000000000001 2024-04-19T03:02:59.491 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.491 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.491 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:59.491 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236577+0000", 2024-04-19T03:02:59.491 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1772e-05 2024-04-19T03:02:59.491 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.491 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.491 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:59.491 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236584+0000", 2024-04-19T03:02:59.491 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0530000000000003e-06 2024-04-19T03:02:59.491 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.491 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.491 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:59.492 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.237023+0000", 2024-04-19T03:02:59.492 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000439703 2024-04-19T03:02:59.492 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.492 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.492 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:59.492 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.237207+0000", 2024-04-19T03:02:59.492 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000183692 2024-04-19T03:02:59.492 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.492 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.492 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:59.492 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.237373+0000", 2024-04-19T03:02:59.492 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016623500000000001 2024-04-19T03:02:59.492 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.493 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.493 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:59.493 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.241461+0000", 2024-04-19T03:02:59.493 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0040883050000000004 2024-04-19T03:02:59.493 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.493 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.493 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:59.493 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.252500+0000", 2024-04-19T03:02:59.493 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011038450999999999 2024-04-19T03:02:59.493 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.493 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.493 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:02:59.493 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.252507+0000", 2024-04-19T03:02:59.493 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2439999999999996e-06 2024-04-19T03:02:59.493 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.494 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.494 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:59.494 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266538+0000", 2024-04-19T03:02:59.494 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.014031184 2024-04-19T03:02:59.494 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.494 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.494 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:59.494 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266620+0000", 2024-04-19T03:02:59.494 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1600000000000005e-05 2024-04-19T03:02:59.494 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:59.494 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:59.494 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:59.494 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.494 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.495 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87135 5.4 5:2a97e7b7:::benchmark_data_smithi096_19531_object87134:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:59.495 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.240884+0000", 2024-04-19T03:02:59.495 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 36.177902545999999, 2024-04-19T03:02:59.495 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.025708931, 2024-04-19T03:02:59.495 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:59.495 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-19T03:02:59.495 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:59.495 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:59.495 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:59.495 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87135 2024-04-19T03:02:59.495 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.495 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:59.495 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.495 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:59.496 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240884+0000", 2024-04-19T03:02:59.496 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:59.496 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.496 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.496 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:59.496 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240884+0000", 2024-04-19T03:02:59.496 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:59.496 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.496 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.496 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:59.496 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240883+0000", 2024-04-19T03:02:59.496 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:59.496 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.496 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.496 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:59.497 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240933+0000", 2024-04-19T03:02:59.497 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9969999999999998e-05 2024-04-19T03:02:59.497 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.497 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.497 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:59.497 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240946+0000", 2024-04-19T03:02:59.497 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2943e-05 2024-04-19T03:02:59.497 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.497 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.497 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:59.497 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240952+0000", 2024-04-19T03:02:59.497 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8930000000000002e-06 2024-04-19T03:02:59.497 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.497 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.498 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:59.498 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240994+0000", 2024-04-19T03:02:59.498 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2753999999999998e-05 2024-04-19T03:02:59.498 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.498 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.498 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:59.498 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.241092+0000", 2024-04-19T03:02:59.498 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.7447000000000004e-05 2024-04-19T03:02:59.498 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.498 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.498 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:59.498 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.241183+0000", 2024-04-19T03:02:59.498 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1163999999999997e-05 2024-04-19T03:02:59.498 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.499 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.499 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:59.499 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.254672+0000", 2024-04-19T03:02:59.499 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.01348864 2024-04-19T03:02:59.499 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.499 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.499 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:02:59.499 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.254681+0000", 2024-04-19T03:02:59.499 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.3789999999999995e-06 2024-04-19T03:02:59.499 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.499 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.499 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:59.499 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266456+0000", 2024-04-19T03:02:59.499 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.011774621 2024-04-19T03:02:59.499 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.500 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.500 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:59.500 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266593+0000", 2024-04-19T03:02:59.500 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013737600000000001 2024-04-19T03:02:59.500 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:59.500 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:59.500 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:59.500 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.500 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.500 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87136 5.4 5:212411bc:::benchmark_data_smithi096_19531_object87135:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:59.500 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.240962+0000", 2024-04-19T03:02:59.500 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 36.17782467, 2024-04-19T03:02:59.500 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.025738, 2024-04-19T03:02:59.500 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:59.501 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-19T03:02:59.501 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:59.501 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:59.501 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:59.501 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87136 2024-04-19T03:02:59.501 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.501 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:59.501 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.501 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:59.501 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240962+0000", 2024-04-19T03:02:59.501 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:59.501 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.501 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.501 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:59.501 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240962+0000", 2024-04-19T03:02:59.501 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:59.502 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.502 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.502 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:59.502 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240961+0000", 2024-04-19T03:02:59.502 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:59.502 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.502 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.502 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:59.502 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240995+0000", 2024-04-19T03:02:59.502 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3868000000000002e-05 2024-04-19T03:02:59.502 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.502 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.502 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:59.503 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.241001+0000", 2024-04-19T03:02:59.503 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.322e-06 2024-04-19T03:02:59.503 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.503 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.503 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:59.503 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.241004+0000", 2024-04-19T03:02:59.503 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3510000000000002e-06 2024-04-19T03:02:59.503 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.503 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.503 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:59.503 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247131+0000", 2024-04-19T03:02:59.503 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0061270869999999998 2024-04-19T03:02:59.503 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.503 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.503 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:59.504 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247322+0000", 2024-04-19T03:02:59.504 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000191015 2024-04-19T03:02:59.504 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.504 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.504 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:02:59.504 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247542+0000", 2024-04-19T03:02:59.504 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00022030199999999999 2024-04-19T03:02:59.504 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.504 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.504 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:59.504 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.254709+0000", 2024-04-19T03:02:59.504 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0071662660000000001 2024-04-19T03:02:59.504 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.504 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.505 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:02:59.505 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.254716+0000", 2024-04-19T03:02:59.505 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3860000000000001e-06 2024-04-19T03:02:59.505 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.505 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.505 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:59.505 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266619+0000", 2024-04-19T03:02:59.505 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0119031030000001 2024-04-19T03:02:59.505 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.505 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.505 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:59.505 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266700+0000", 2024-04-19T03:02:59.505 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0764000000000001e-05 2024-04-19T03:02:59.505 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:59.506 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:59.506 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:59.506 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.506 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.506 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87138 5.e 5:7b1f1c20:::benchmark_data_smithi096_19531_object87137:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:02:59.506 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.247862+0000", 2024-04-19T03:02:59.506 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 36.170924595999999, 2024-04-19T03:02:59.506 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.024457079, 2024-04-19T03:02:59.506 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:59.506 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:59.506 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:59.506 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:59.506 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:59.506 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87138 2024-04-19T03:02:59.507 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.507 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:59.507 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.507 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:59.507 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247862+0000", 2024-04-19T03:02:59.507 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:59.507 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.507 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.507 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:59.507 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247862+0000", 2024-04-19T03:02:59.507 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:59.507 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.507 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.507 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:59.508 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247860+0000", 2024-04-19T03:02:59.508 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999981 2024-04-19T03:02:59.508 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.508 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.508 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:59.508 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247909+0000", 2024-04-19T03:02:59.508 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9150999999999997e-05 2024-04-19T03:02:59.508 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.508 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.508 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:59.508 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247925+0000", 2024-04-19T03:02:59.508 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5761999999999999e-05 2024-04-19T03:02:59.508 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.509 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.509 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:59.509 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247936+0000", 2024-04-19T03:02:59.509 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1144e-05 2024-04-19T03:02:59.509 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.509 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.509 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:59.509 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.250590+0000", 2024-04-19T03:02:59.509 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.002653678 2024-04-19T03:02:59.509 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.509 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.509 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:02:59.509 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.250599+0000", 2024-04-19T03:02:59.509 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9039999999999998e-06 2024-04-19T03:02:59.509 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.510 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.510 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:59.510 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.268151+0000", 2024-04-19T03:02:59.510 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0175523449999999 2024-04-19T03:02:59.510 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.510 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.510 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:59.510 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.268285+0000", 2024-04-19T03:02:59.510 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013415599999999999 2024-04-19T03:02:59.510 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.510 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.510 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:59.510 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.272238+0000", 2024-04-19T03:02:59.510 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0039533019999999997 2024-04-19T03:02:59.511 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.511 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.511 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:59.511 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.272274+0000", 2024-04-19T03:02:59.511 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5352000000000003e-05 2024-04-19T03:02:59.511 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.511 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.511 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:59.511 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.272319+0000", 2024-04-19T03:02:59.511 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5281999999999998e-05 2024-04-19T03:02:59.511 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:59.511 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:59.511 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:59.512 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.512 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.512 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:158371 5.8 5:11a83024:::benchmark_data_smithi096_19531_object44921:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-19T03:02:59.512 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:58.125869+0000", 2024-04-19T03:02:59.512 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 1.292917731, 2024-04-19T03:02:59.512 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074532857999999994, 2024-04-19T03:02:59.512 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:59.512 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:59.512 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:59.512 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:59.512 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:59.512 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 158371 2024-04-19T03:02:59.512 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.512 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:59.512 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.513 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:59.513 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125869+0000", 2024-04-19T03:02:59.513 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:59.513 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.513 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.513 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:59.513 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125869+0000", 2024-04-19T03:02:59.513 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:59.513 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.513 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.513 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:59.513 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125868+0000", 2024-04-19T03:02:59.513 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:59.513 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.514 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.514 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:59.514 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125874+0000", 2024-04-19T03:02:59.514 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7120000000000003e-06 2024-04-19T03:02:59.514 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.514 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.514 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:59.514 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125885+0000", 2024-04-19T03:02:59.514 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0665999999999999e-05 2024-04-19T03:02:59.514 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.514 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.514 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:59.514 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125901+0000", 2024-04-19T03:02:59.514 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6463000000000001e-05 2024-04-19T03:02:59.515 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.515 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.515 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:59.515 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125956+0000", 2024-04-19T03:02:59.515 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4728000000000002e-05 2024-04-19T03:02:59.515 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.515 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.515 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:59.515 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.126050+0000", 2024-04-19T03:02:59.515 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.3534000000000003e-05 2024-04-19T03:02:59.515 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.515 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.515 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:59.515 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.200187+0000", 2024-04-19T03:02:59.515 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074136933000000002 2024-04-19T03:02:59.516 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.516 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.516 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:59.516 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.200260+0000", 2024-04-19T03:02:59.516 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3090999999999995e-05 2024-04-19T03:02:59.516 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.516 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.516 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:59.516 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.200402+0000", 2024-04-19T03:02:59.516 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014193699999999999 2024-04-19T03:02:59.516 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:59.516 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:59.516 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:59.516 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.517 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.517 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:158372 5.0 5:0473aa5f:::benchmark_data_smithi096_19531_object44922:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-19T03:02:59.517 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:58.125924+0000", 2024-04-19T03:02:59.517 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 1.292862124, 2024-04-19T03:02:59.517 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074247490999999999, 2024-04-19T03:02:59.517 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:59.517 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:59.517 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:59.517 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:59.517 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:59.517 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 158372 2024-04-19T03:02:59.517 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.517 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:59.518 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.518 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:59.518 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125924+0000", 2024-04-19T03:02:59.518 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:59.518 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.518 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.518 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:59.518 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125924+0000", 2024-04-19T03:02:59.518 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:59.518 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.518 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.518 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:59.518 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125924+0000", 2024-04-19T03:02:59.518 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:59.519 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.519 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.519 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:59.519 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125927+0000", 2024-04-19T03:02:59.519 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5389999999999999e-06 2024-04-19T03:02:59.519 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.519 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.519 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:59.519 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125935+0000", 2024-04-19T03:02:59.519 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3259999999999998e-06 2024-04-19T03:02:59.519 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.519 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.519 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:59.520 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125940+0000", 2024-04-19T03:02:59.520 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6980000000000003e-06 2024-04-19T03:02:59.520 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.520 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.520 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:59.520 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125982+0000", 2024-04-19T03:02:59.520 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1337000000000001e-05 2024-04-19T03:02:59.520 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.520 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.520 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:59.520 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.126075+0000", 2024-04-19T03:02:59.520 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.3579999999999995e-05 2024-04-19T03:02:59.520 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.521 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.521 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:59.521 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.199953+0000", 2024-04-19T03:02:59.521 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073877604999999999 2024-04-19T03:02:59.521 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.521 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.521 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:59.521 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.200022+0000", 2024-04-19T03:02:59.521 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.8824000000000004e-05 2024-04-19T03:02:59.521 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.521 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.521 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:59.521 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.200172+0000", 2024-04-19T03:02:59.521 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015017700000000001 2024-04-19T03:02:59.522 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:59.522 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:59.522 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:59.522 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.522 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.522 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:158374 5.e 5:76be57a5:::benchmark_data_smithi096_19531_object44924:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-19T03:02:59.522 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:58.125988+0000", 2024-04-19T03:02:59.522 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 1.2927986250000001, 2024-04-19T03:02:59.522 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.067843332000000006, 2024-04-19T03:02:59.522 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:59.522 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:59.522 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:59.522 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:59.523 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:59.523 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 158374 2024-04-19T03:02:59.523 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.523 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:59.523 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.523 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:59.523 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125988+0000", 2024-04-19T03:02:59.523 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:59.523 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.523 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.523 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:59.523 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125988+0000", 2024-04-19T03:02:59.523 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:59.523 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.524 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.524 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:59.524 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125987+0000", 2024-04-19T03:02:59.524 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:59.524 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.524 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.524 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:59.524 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125990+0000", 2024-04-19T03:02:59.524 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7989999999999998e-06 2024-04-19T03:02:59.524 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.524 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.524 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:59.524 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125996+0000", 2024-04-19T03:02:59.524 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.302e-06 2024-04-19T03:02:59.525 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.525 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.525 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:59.525 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.126001+0000", 2024-04-19T03:02:59.525 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.843e-06 2024-04-19T03:02:59.525 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.525 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.525 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:59.525 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.126047+0000", 2024-04-19T03:02:59.525 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6066000000000002e-05 2024-04-19T03:02:59.525 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.525 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.525 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:59.525 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.126171+0000", 2024-04-19T03:02:59.525 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012359099999999999 2024-04-19T03:02:59.526 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.526 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.526 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:59.526 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.193709+0000", 2024-04-19T03:02:59.526 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.067538099000000004 2024-04-19T03:02:59.526 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.526 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.526 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:59.526 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.193766+0000", 2024-04-19T03:02:59.526 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6869e-05 2024-04-19T03:02:59.526 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.526 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.526 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:59.527 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.193831+0000", 2024-04-19T03:02:59.527 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5273999999999999e-05 2024-04-19T03:02:59.527 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:59.527 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:59.527 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:59.527 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.527 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.527 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4755.0:158376 5.9 e56/22 5:9e73c076:::benchmark_data_smithi096_19531_object44926:head v 56'9663, mlcod=56'9661)", 2024-04-19T03:02:59.527 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:58.127307+0000", 2024-04-19T03:02:59.527 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 1.291479394, 2024-04-19T03:02:59.527 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069002716000000006, 2024-04-19T03:02:59.527 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:59.527 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:59.527 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:59.527 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.528 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:59.528 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.127307+0000", 2024-04-19T03:02:59.528 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:59.528 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.528 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.528 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:59.528 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.127307+0000", 2024-04-19T03:02:59.528 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:59.528 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.528 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.528 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:59.528 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.127306+0000", 2024-04-19T03:02:59.528 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:02:59.528 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.528 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.529 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:59.529 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.127316+0000", 2024-04-19T03:02:59.529 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.3039999999999994e-06 2024-04-19T03:02:59.529 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.529 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.529 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:59.529 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.127326+0000", 2024-04-19T03:02:59.529 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0009e-05 2024-04-19T03:02:59.529 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.529 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.529 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:59.529 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.127332+0000", 2024-04-19T03:02:59.529 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5880000000000003e-06 2024-04-19T03:02:59.529 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.530 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.530 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:59.530 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.127383+0000", 2024-04-19T03:02:59.530 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0516000000000002e-05 2024-04-19T03:02:59.530 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.530 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.530 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:59.530 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.127403+0000", 2024-04-19T03:02:59.530 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0547000000000002e-05 2024-04-19T03:02:59.530 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.530 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.530 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:59.530 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.196280+0000", 2024-04-19T03:02:59.530 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.068876863999999996 2024-04-19T03:02:59.531 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.531 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.531 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:59.531 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.196310+0000", 2024-04-19T03:02:59.531 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9762999999999999e-05 2024-04-19T03:02:59.531 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:59.531 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:59.531 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:59.531 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.531 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.531 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:158383 5.0 5:026717eb:::benchmark_data_smithi096_19531_object44933:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-19T03:02:59.531 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:58.130494+0000", 2024-04-19T03:02:59.531 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 1.288292268, 2024-04-19T03:02:59.531 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.070135775999999997, 2024-04-19T03:02:59.531 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:02:59.531 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:02:59.532 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:02:59.532 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:02:59.532 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:59.532 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 158383 2024-04-19T03:02:59.532 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.532 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:02:59.532 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.532 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:02:59.532 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.130494+0000", 2024-04-19T03:02:59.532 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:59.532 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.532 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.532 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:02:59.532 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.130494+0000", 2024-04-19T03:02:59.533 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:02:59.533 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.533 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.533 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:02:59.533 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.130493+0000", 2024-04-19T03:02:59.533 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:02:59.533 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.533 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.533 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:02:59.533 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.130500+0000", 2024-04-19T03:02:59.533 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5490000000000003e-06 2024-04-19T03:02:59.533 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.533 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.533 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:02:59.534 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.190401+0000", 2024-04-19T03:02:59.534 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.059901668999999998 2024-04-19T03:02:59.534 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.534 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.534 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:02:59.534 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.190421+0000", 2024-04-19T03:02:59.534 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0288e-05 2024-04-19T03:02:59.534 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.534 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.534 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:02:59.534 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.190536+0000", 2024-04-19T03:02:59.534 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000114783 2024-04-19T03:02:59.534 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.534 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.535 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:02:59.535 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.190904+0000", 2024-04-19T03:02:59.535 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00036773900000000001 2024-04-19T03:02:59.535 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.535 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.535 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:02:59.535 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.200417+0000", 2024-04-19T03:02:59.535 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0095128899999999995 2024-04-19T03:02:59.535 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.535 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.535 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:02:59.535 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.200489+0000", 2024-04-19T03:02:59.535 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2554999999999999e-05 2024-04-19T03:02:59.535 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:02:59.535 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:02:59.536 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:02:59.536 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.200630+0000", 2024-04-19T03:02:59.536 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014055299999999999 2024-04-19T03:02:59.536 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:59.536 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:59.536 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:59.536 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:02:59.536 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:02:59.536 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-19T03:02:59.537 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-19T03:02:59.538 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T03:02:59.539 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:59.534+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:59.574 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-19T03:02:59.638 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:02:59.634+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:02:59.670 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-04-19T03:02:59.670 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [ 2024-04-19T03:02:59.670 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:59.670 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:162139 5.3 5:c4c8aaeb:::benchmark_data_smithi096_19531_object48689:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-19T03:02:59.670 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:59.662136+0000", 2024-04-19T03:02:59.670 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0070053540000000001, 2024-04-19T03:02:59.671 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0070228189999999996, 2024-04-19T03:02:59.671 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:59.671 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-04-19T03:02:59.671 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:59.671 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:59.671 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:59.671 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 162139 2024-04-19T03:02:59.671 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:59.671 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:59.671 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:59.671 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:59.671 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:59.662136+0000", 2024-04-19T03:02:59.671 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:59.671 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:59.672 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:59.672 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:59.672 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:59.662136+0000", 2024-04-19T03:02:59.672 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:59.672 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:59.672 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:59.672 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:59.672 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:59.662135+0000", 2024-04-19T03:02:59.672 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:59.672 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:59.672 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:59.672 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:59.672 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:59.662138+0000", 2024-04-19T03:02:59.672 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3060000000000002e-06 2024-04-19T03:02:59.673 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:59.673 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:59.673 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:59.673 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:59.662145+0000", 2024-04-19T03:02:59.673 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3090000000000001e-06 2024-04-19T03:02:59.673 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:59.673 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:59.673 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:59.673 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:59.662150+0000", 2024-04-19T03:02:59.673 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5289999999999999e-06 2024-04-19T03:02:59.673 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:59.673 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:59.673 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:59.673 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:59.664291+0000", 2024-04-19T03:02:59.673 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00214044 2024-04-19T03:02:59.674 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:59.674 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:59.674 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:59.674 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:59.664444+0000", 2024-04-19T03:02:59.674 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00015365499999999999 2024-04-19T03:02:59.674 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:59.674 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:59.674 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:59.674 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:59.674 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:59.674 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:162147 5.d 5:b5bfa81e:::benchmark_data_smithi096_19531_object48697:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-19T03:02:59.674 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:59.665409+0000", 2024-04-19T03:02:59.674 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.003731692, 2024-04-19T03:02:59.675 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0037905679999999998, 2024-04-19T03:02:59.675 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:59.675 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:02:59.675 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:59.675 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:59.675 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:59.675 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 162147 2024-04-19T03:02:59.675 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:59.675 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:59.675 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:59.675 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:59.675 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:59.665409+0000", 2024-04-19T03:02:59.675 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:59.675 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:59.676 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:59.676 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:59.676 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:59.665409+0000", 2024-04-19T03:02:59.676 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:59.676 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:59.676 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:59.676 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:59.676 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:59.665408+0000", 2024-04-19T03:02:59.676 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:59.676 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:59.676 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:59.676 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:59.676 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:59.665413+0000", 2024-04-19T03:02:59.676 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5600000000000004e-06 2024-04-19T03:02:59.677 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:59.677 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:59.677 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:59.677 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:59.665422+0000", 2024-04-19T03:02:59.677 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.2390000000000008e-06 2024-04-19T03:02:59.677 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:59.677 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:59.677 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:59.677 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:59.665427+0000", 2024-04-19T03:02:59.677 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.152e-06 2024-04-19T03:02:59.677 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:59.677 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:59.677 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:59.678 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:59.665464+0000", 2024-04-19T03:02:59.678 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6603999999999997e-05 2024-04-19T03:02:59.678 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:59.678 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:59.678 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:59.678 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:59.665622+0000", 2024-04-19T03:02:59.678 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00015762 2024-04-19T03:02:59.678 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:59.678 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:59.678 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:02:59.678 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:59.665751+0000", 2024-04-19T03:02:59.678 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000129414 2024-04-19T03:02:59.678 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:59.678 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:59.679 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:59.679 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:59.679 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:59.679 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:162148 5.3 5:c0f5253c:::benchmark_data_smithi096_19531_object48698:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-19T03:02:59.679 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:59.666076+0000", 2024-04-19T03:02:59.679 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0030654139999999998, 2024-04-19T03:02:59.679 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0031621349999999999, 2024-04-19T03:02:59.679 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:59.679 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-04-19T03:02:59.679 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:59.679 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:59.679 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:59.679 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 162148 2024-04-19T03:02:59.679 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:59.680 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:59.680 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:59.680 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:59.680 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:59.666076+0000", 2024-04-19T03:02:59.680 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:59.680 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:59.680 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:59.680 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:59.680 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:59.666076+0000", 2024-04-19T03:02:59.680 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:59.681 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:59.681 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:59.681 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:59.681 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:59.666075+0000", 2024-04-19T03:02:59.681 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:59.681 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:59.681 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:59.681 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:59.681 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:59.666079+0000", 2024-04-19T03:02:59.681 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7269999999999998e-06 2024-04-19T03:02:59.681 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:59.681 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:59.681 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:59.681 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:59.666086+0000", 2024-04-19T03:02:59.682 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4320000000000004e-06 2024-04-19T03:02:59.682 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:59.682 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:59.682 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:59.682 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:59.666091+0000", 2024-04-19T03:02:59.682 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9389999999999996e-06 2024-04-19T03:02:59.682 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:59.682 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:59.682 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:59.682 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:59.666221+0000", 2024-04-19T03:02:59.682 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000130316 2024-04-19T03:02:59.682 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:59.682 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:59.683 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:59.683 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:59.666307+0000", 2024-04-19T03:02:59.683 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.5747000000000004e-05 2024-04-19T03:02:59.683 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:59.683 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:59.683 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:59.683 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:59.683 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:59.683 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:162149 5.1 5:8112b69d:::benchmark_data_smithi096_19531_object48699:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-19T03:02:59.683 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:59.666300+0000", 2024-04-19T03:02:59.683 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0028410979999999998, 2024-04-19T03:02:59.683 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.002970416, 2024-04-19T03:02:59.683 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:59.683 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-04-19T03:02:59.684 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:59.684 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:59.684 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:59.684 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 162149 2024-04-19T03:02:59.684 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:59.684 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:59.684 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:59.684 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:59.684 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:59.666300+0000", 2024-04-19T03:02:59.684 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:59.684 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:59.684 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:59.684 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:59.685 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:59.666300+0000", 2024-04-19T03:02:59.685 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:59.685 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:59.685 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:59.685 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:59.685 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:59.666299+0000", 2024-04-19T03:02:59.685 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:59.685 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:59.685 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:59.685 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:59.685 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:59.666304+0000", 2024-04-19T03:02:59.685 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2440000000000001e-06 2024-04-19T03:02:59.685 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:59.685 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:59.686 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:59.686 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:59.666313+0000", 2024-04-19T03:02:59.686 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4430000000000003e-06 2024-04-19T03:02:59.686 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:59.686 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:59.686 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:59.686 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:59.666319+0000", 2024-04-19T03:02:59.686 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6270000000000002e-06 2024-04-19T03:02:59.686 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:59.686 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:59.686 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:59.686 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:59.666367+0000", 2024-04-19T03:02:59.686 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8242999999999999e-05 2024-04-19T03:02:59.687 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:59.687 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:59.687 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:59.687 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:59.666479+0000", 2024-04-19T03:02:59.687 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00011168 2024-04-19T03:02:59.687 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:59.687 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:59.687 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:59.687 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:59.687 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:59.687 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:162151 5.1 5:8bd2ba8f:::benchmark_data_smithi096_19531_object48701:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-19T03:02:59.687 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:59.666428+0000", 2024-04-19T03:02:59.687 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0027130539999999999, 2024-04-19T03:02:59.687 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0028764139999999999, 2024-04-19T03:02:59.688 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:59.688 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-04-19T03:02:59.688 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:59.688 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:59.688 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:59.688 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 162151 2024-04-19T03:02:59.688 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:59.688 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:59.688 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:59.688 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:59.688 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:59.666428+0000", 2024-04-19T03:02:59.688 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:59.688 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:59.688 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:59.688 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:59.689 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:59.666428+0000", 2024-04-19T03:02:59.689 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:59.689 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:59.689 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:59.689 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:59.689 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:59.666427+0000", 2024-04-19T03:02:59.689 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:02:59.689 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:59.689 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:59.689 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:59.689 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:59.666431+0000", 2024-04-19T03:02:59.689 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3959999999999999e-06 2024-04-19T03:02:59.689 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:59.689 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:59.690 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:59.690 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:59.666439+0000", 2024-04-19T03:02:59.690 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7680000000000008e-06 2024-04-19T03:02:59.690 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:59.690 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:59.690 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:59.690 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:59.666447+0000", 2024-04-19T03:02:59.690 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.038e-06 2024-04-19T03:02:59.690 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:59.690 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:59.690 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:59.690 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:59.668477+0000", 2024-04-19T03:02:59.690 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0020297900000000001 2024-04-19T03:02:59.690 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:59.691 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:59.691 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:59.691 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:59.668608+0000", 2024-04-19T03:02:59.691 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00013103499999999999 2024-04-19T03:02:59.691 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:59.691 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:59.691 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:59.691 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:59.691 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:59.691 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:162152 5.d 5:b1393e63:::benchmark_data_smithi096_19531_object48702:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-19T03:02:59.691 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:59.667884+0000", 2024-04-19T03:02:59.691 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0012573420000000001, 2024-04-19T03:02:59.691 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001453675, 2024-04-19T03:02:59.692 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:59.692 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:02:59.692 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:59.692 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:59.692 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:59.692 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 162152 2024-04-19T03:02:59.692 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:59.692 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:59.692 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:59.692 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:59.692 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:59.667884+0000", 2024-04-19T03:02:59.693 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:59.693 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:59.693 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:59.693 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:59.693 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:59.667884+0000", 2024-04-19T03:02:59.693 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:59.693 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:59.693 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:59.693 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:59.693 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:59.667883+0000", 2024-04-19T03:02:59.693 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:59.693 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:59.693 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:59.693 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:59.694 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:59.667887+0000", 2024-04-19T03:02:59.694 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9079999999999997e-06 2024-04-19T03:02:59.694 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:59.694 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:59.694 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:59.694 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:59.667894+0000", 2024-04-19T03:02:59.694 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8929999999999999e-06 2024-04-19T03:02:59.694 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:59.694 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:59.694 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:59.694 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:59.667898+0000", 2024-04-19T03:02:59.694 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6460000000000001e-06 2024-04-19T03:02:59.694 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:59.694 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:59.694 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:59.695 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:59.667934+0000", 2024-04-19T03:02:59.695 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5862000000000003e-05 2024-04-19T03:02:59.695 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:59.695 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:59.695 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:59.695 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:59.668051+0000", 2024-04-19T03:02:59.695 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000116755 2024-04-19T03:02:59.695 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:59.695 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:59.695 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:02:59.695 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:59.668123+0000", 2024-04-19T03:02:59.695 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2107000000000006e-05 2024-04-19T03:02:59.695 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:59.696 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:59.696 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:59.696 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:59.696 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:59.696 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop_reply(client.4755.0:162147 5.d e56/49)", 2024-04-19T03:02:59.696 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:59.667963+0000", 2024-04-19T03:02:59.696 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0011775959999999999, 2024-04-19T03:02:59.696 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0014102369999999999, 2024-04-19T03:02:59.696 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:59.696 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-04-19T03:02:59.696 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:59.696 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:59.696 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:59.696 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:59.667963+0000", 2024-04-19T03:02:59.697 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:59.697 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:59.697 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:59.697 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:59.697 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:59.667963+0000", 2024-04-19T03:02:59.697 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:59.697 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:59.697 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:59.697 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:59.697 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:59.667963+0000", 2024-04-19T03:02:59.697 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:59.697 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:59.698 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:59.698 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:59.698 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:59.667966+0000", 2024-04-19T03:02:59.698 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9280000000000002e-06 2024-04-19T03:02:59.698 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:59.698 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:59.698 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:59.698 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:59.667970+0000", 2024-04-19T03:02:59.698 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3470000000000001e-06 2024-04-19T03:02:59.698 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:59.698 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:59.698 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:59.698 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:59.667975+0000", 2024-04-19T03:02:59.699 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4240000000000003e-06 2024-04-19T03:02:59.699 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:59.699 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:59.699 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:59.699 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:59.699 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:59.699 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:162153 5.3 5:c158d54d:::benchmark_data_smithi096_19531_object48703:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-19T03:02:59.699 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:59.668020+0000", 2024-04-19T03:02:59.699 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0011212539999999999, 2024-04-19T03:02:59.699 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0014094909999999999, 2024-04-19T03:02:59.699 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:02:59.699 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-04-19T03:02:59.699 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:02:59.699 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:02:59.700 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:02:59.700 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 162153 2024-04-19T03:02:59.700 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:59.700 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:02:59.700 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:59.700 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:02:59.700 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:59.668020+0000", 2024-04-19T03:02:59.700 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:59.700 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:59.700 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:59.700 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:02:59.700 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:59.668020+0000", 2024-04-19T03:02:59.700 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:02:59.700 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:59.700 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:59.700 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:02:59.701 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:59.668019+0000", 2024-04-19T03:02:59.701 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:02:59.701 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:59.701 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:59.701 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:02:59.701 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:59.668023+0000", 2024-04-19T03:02:59.701 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7670000000000001e-06 2024-04-19T03:02:59.701 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:59.701 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:59.701 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:02:59.701 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:59.668032+0000", 2024-04-19T03:02:59.701 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.7350000000000002e-06 2024-04-19T03:02:59.701 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:59.701 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:59.702 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:02:59.702 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:59.668037+0000", 2024-04-19T03:02:59.702 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1529999999999996e-06 2024-04-19T03:02:59.702 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:59.702 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:59.702 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:02:59.702 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:59.668373+0000", 2024-04-19T03:02:59.702 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00033638 2024-04-19T03:02:59.702 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:02:59.702 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:02:59.702 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:02:59.702 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:59.668465+0000", 2024-04-19T03:02:59.702 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.2150000000000004e-05 2024-04-19T03:02:59.702 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:59.703 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:02:59.703 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:59.703 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:02:59.703 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-04-19T03:02:59.703 INFO:teuthology.orchestra.run.smithi144.stdout: "num_ops": 8 2024-04-19T03:02:59.703 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-04-19T03:02:59.704 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T03:02:59.718 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1: {} 2024-04-19T03:02:59.739 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2: {} 2024-04-19T03:02:59.739 INFO:teuthology.orchestra.run.smithi096.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-04-19T03:02:59.739 INFO:teuthology.orchestra.run.smithi096.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-19T03:02:59.739 INFO:teuthology.orchestra.run.smithi096.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-19T03:02:59.743 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-19T03:02:59.744 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-19T03:02:59.750 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:59.748+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:59.816 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-04-19T03:02:59.816 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:02:59.830 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T03:02:59.840 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:59.836+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:59.941 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:02:59.936+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:02:59.958 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-04-19T03:02:59.958 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:02:59.971 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T03:03:00.042 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:03:00.038+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:03:00.100 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-19T03:03:00.100 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:03:00.111 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T03:03:00.156 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:03:00.154+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:03:00.244 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:03:00.240+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:03:00.278 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-19T03:03:00.278 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:03:00.291 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T03:03:00.345 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:03:00.342+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:03:00.414 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-19T03:03:00.414 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:03:00.427 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T03:03:00.468 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:03:00.466+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:03:00.547 INFO:teuthology.orchestra.run.smithi096.stderr:noscrub is set 2024-04-19T03:03:00.548 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:03:00.544+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:03:00.556 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-04-19T03:03:00.556 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:03:00.569 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T03:03:00.648 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:03:00.644+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:03:00.749 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:03:00.746+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:03:00.749 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-04-19T03:03:00.749 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:03:00.763 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T03:03:00.850 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:03:00.848+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:03:00.890 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-04-19T03:03:00.890 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:03:00.902 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T03:03:00.951 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:03:00.948+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:03:01.025 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-19T03:03:01.025 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:03:01.037 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T03:03:01.053 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:03:01.050+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:03:01.154 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:03:01.152+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:03:01.163 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-19T03:03:01.163 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:03:01.176 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T03:03:01.255 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:03:01.252+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:03:01.297 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-19T03:03:01.297 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:03:01.309 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T03:03:01.356 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:03:01.354+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:03:01.435 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-04-19T03:03:01.435 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:03:01.447 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T03:03:01.457 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:03:01.452+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:03:01.558 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:03:01.554+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:03:01.573 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-04-19T03:03:01.573 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:03:01.585 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T03:03:01.660 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:03:01.658+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:03:01.716 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-04-19T03:03:01.716 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:03:01.728 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T03:03:01.745 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-19T03:03:01.761 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:03:01.756+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:03:01.853 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-19T03:03:01.853 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:03:01.862 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:03:01.858+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:03:01.866 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T03:03:01.900 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1: {} 2024-04-19T03:03:01.921 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2: {} 2024-04-19T03:03:01.922 INFO:teuthology.orchestra.run.smithi096.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-04-19T03:03:01.922 INFO:teuthology.orchestra.run.smithi096.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-19T03:03:01.922 INFO:teuthology.orchestra.run.smithi096.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-19T03:03:01.926 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-19T03:03:01.926 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-19T03:03:01.964 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:03:01.960+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:03:01.993 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-19T03:03:01.993 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-04-19T03:03:01.993 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-04-19T03:03:01.993 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-04-19T03:03:01.993 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-19T03:03:02.005 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T03:03:02.065 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:03:02.062+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:03:02.130 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-19T03:03:02.130 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-04-19T03:03:02.130 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-04-19T03:03:02.130 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-04-19T03:03:02.130 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.131 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:86615 5.e 5:7fef7288:::benchmark_data_smithi096_19531_object86614:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:02.131 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:22.634544+0000", 2024-04-19T03:03:02.131 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 39.493181434999997, 2024-04-19T03:03:02.131 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.192475071, 2024-04-19T03:03:02.131 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:02.131 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:02.131 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:02.131 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:02.131 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:02.131 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 86615 2024-04-19T03:03:02.131 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.131 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:02.131 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.131 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:02.132 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634544+0000", 2024-04-19T03:03:02.132 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:02.132 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.132 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.132 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:02.132 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634544+0000", 2024-04-19T03:03:02.132 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:02.132 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.132 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.132 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:02.132 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634542+0000", 2024-04-19T03:03:02.132 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999981 2024-04-19T03:03:02.132 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.132 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.133 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:02.133 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634585+0000", 2024-04-19T03:03:02.133 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2299000000000003e-05 2024-04-19T03:03:02.133 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.133 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.133 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:02.133 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634592+0000", 2024-04-19T03:03:02.133 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2350000000000002e-06 2024-04-19T03:03:02.133 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.133 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.133 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:02.133 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634596+0000", 2024-04-19T03:03:02.133 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5390000000000001e-06 2024-04-19T03:03:02.133 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.133 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.134 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:02.134 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634639+0000", 2024-04-19T03:03:02.134 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2444999999999998e-05 2024-04-19T03:03:02.134 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.134 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.134 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:02.134 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634808+0000", 2024-04-19T03:03:02.134 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000169152 2024-04-19T03:03:02.134 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.134 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.134 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:02.134 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634999+0000", 2024-04-19T03:03:02.134 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00019098300000000001 2024-04-19T03:03:02.134 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.135 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.135 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:02.135 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.640458+0000", 2024-04-19T03:03:02.135 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0054586870000000003 2024-04-19T03:03:02.135 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.135 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.135 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:02.135 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.826949+0000", 2024-04-19T03:03:02.135 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.18649178299999999 2024-04-19T03:03:02.135 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.135 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.135 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:03:02.135 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.826982+0000", 2024-04-19T03:03:02.135 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2477000000000001e-05 2024-04-19T03:03:02.136 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.136 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.136 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:02.136 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.827019+0000", 2024-04-19T03:03:02.136 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7355999999999999e-05 2024-04-19T03:03:02.136 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:02.136 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:02.136 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:02.136 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.136 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.136 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:86616 5.e 5:72278f47:::benchmark_data_smithi096_19531_object86615:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:02.136 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:22.634609+0000", 2024-04-19T03:03:02.136 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 39.493116286000003, 2024-04-19T03:03:02.136 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.19472088900000001, 2024-04-19T03:03:02.137 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:02.137 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:02.137 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:02.137 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:02.137 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:02.137 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 86616 2024-04-19T03:03:02.137 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.137 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:02.137 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.137 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:02.137 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634609+0000", 2024-04-19T03:03:02.137 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:02.137 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.137 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.138 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:02.138 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634609+0000", 2024-04-19T03:03:02.138 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:02.138 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.138 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.138 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:02.138 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634609+0000", 2024-04-19T03:03:02.138 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:02.138 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.138 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.138 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:02.138 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634651+0000", 2024-04-19T03:03:02.138 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2589000000000002e-05 2024-04-19T03:03:02.139 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.139 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.139 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:02.139 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634659+0000", 2024-04-19T03:03:02.139 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5850000000000002e-06 2024-04-19T03:03:02.139 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.139 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.139 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:02.139 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634662+0000", 2024-04-19T03:03:02.139 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3620000000000002e-06 2024-04-19T03:03:02.139 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.139 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.139 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:02.139 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.637880+0000", 2024-04-19T03:03:02.140 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.003218149 2024-04-19T03:03:02.140 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.140 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.140 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:02.140 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.637999+0000", 2024-04-19T03:03:02.140 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000118643 2024-04-19T03:03:02.140 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.140 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.140 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:02.140 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.638102+0000", 2024-04-19T03:03:02.140 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010331 2024-04-19T03:03:02.140 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.140 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.140 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:02.141 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.640851+0000", 2024-04-19T03:03:02.141 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0027483310000000001 2024-04-19T03:03:02.141 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.141 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.141 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:02.141 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.829269+0000", 2024-04-19T03:03:02.141 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.188418319 2024-04-19T03:03:02.141 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.141 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.141 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:03:02.141 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.829299+0000", 2024-04-19T03:03:02.141 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0227e-05 2024-04-19T03:03:02.141 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.141 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.141 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:02.142 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.829330+0000", 2024-04-19T03:03:02.142 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0969000000000001e-05 2024-04-19T03:03:02.142 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:02.142 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:02.142 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:02.142 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.142 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.142 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:86618 5.0 5:09014b90:::benchmark_data_smithi096_19531_object86617:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:02.142 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:22.634894+0000", 2024-04-19T03:03:02.142 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 39.492831797999997, 2024-04-19T03:03:02.142 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.19413419800000001, 2024-04-19T03:03:02.142 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:02.142 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:02.143 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:02.143 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:02.143 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:02.143 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 86618 2024-04-19T03:03:02.143 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.143 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:02.143 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.143 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:02.143 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634894+0000", 2024-04-19T03:03:02.143 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:02.143 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.143 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.143 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:02.143 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634894+0000", 2024-04-19T03:03:02.144 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:02.144 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.144 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.144 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:02.144 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634893+0000", 2024-04-19T03:03:02.144 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:03:02.144 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.144 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.144 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:02.144 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634976+0000", 2024-04-19T03:03:02.144 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3231000000000003e-05 2024-04-19T03:03:02.144 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.144 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.145 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:02.145 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634983+0000", 2024-04-19T03:03:02.145 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5169999999999996e-06 2024-04-19T03:03:02.145 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.145 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.145 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:02.145 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634987+0000", 2024-04-19T03:03:02.145 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.425e-06 2024-04-19T03:03:02.145 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.145 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.145 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:02.145 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635030+0000", 2024-04-19T03:03:02.145 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.32e-05 2024-04-19T03:03:02.145 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.145 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.146 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:02.146 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635185+0000", 2024-04-19T03:03:02.146 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015471899999999999 2024-04-19T03:03:02.146 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.146 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.146 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:02.146 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635415+0000", 2024-04-19T03:03:02.146 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00023026500000000001 2024-04-19T03:03:02.146 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.146 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.146 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:02.146 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.640127+0000", 2024-04-19T03:03:02.146 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0047118890000000004 2024-04-19T03:03:02.147 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.147 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.147 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:02.147 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.828895+0000", 2024-04-19T03:03:02.147 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.18876802600000001 2024-04-19T03:03:02.147 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.147 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.147 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:03:02.147 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.828972+0000", 2024-04-19T03:03:02.147 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.6345000000000002e-05 2024-04-19T03:03:02.147 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.147 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.147 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:02.147 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.829028+0000", 2024-04-19T03:03:02.147 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6342999999999999e-05 2024-04-19T03:03:02.148 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:02.148 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:02.148 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:02.148 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.148 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.148 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:86620 5.b 5:d80faa68:::benchmark_data_smithi096_19531_object86619:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:02.148 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:22.635110+0000", 2024-04-19T03:03:02.148 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 39.492615237999999, 2024-04-19T03:03:02.148 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.193447275, 2024-04-19T03:03:02.148 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:02.148 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:02.148 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:02.148 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:02.148 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:02.149 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 86620 2024-04-19T03:03:02.149 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.149 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:02.149 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.149 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:02.149 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635110+0000", 2024-04-19T03:03:02.149 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:02.149 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.149 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.149 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:02.149 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635110+0000", 2024-04-19T03:03:02.149 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:02.149 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.149 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.149 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:02.150 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635110+0000", 2024-04-19T03:03:02.150 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:02.150 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.150 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.150 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:02.150 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635154+0000", 2024-04-19T03:03:02.150 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4681000000000001e-05 2024-04-19T03:03:02.150 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.150 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.150 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:02.150 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635166+0000", 2024-04-19T03:03:02.150 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1505000000000001e-05 2024-04-19T03:03:02.151 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.151 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.151 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:02.151 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635171+0000", 2024-04-19T03:03:02.151 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6040000000000003e-06 2024-04-19T03:03:02.151 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.151 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.151 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:02.151 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635221+0000", 2024-04-19T03:03:02.151 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9947000000000001e-05 2024-04-19T03:03:02.151 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.151 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.151 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:02.151 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635356+0000", 2024-04-19T03:03:02.152 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013576199999999999 2024-04-19T03:03:02.152 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.152 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.152 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:02.152 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635507+0000", 2024-04-19T03:03:02.152 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015072999999999999 2024-04-19T03:03:02.152 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.152 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.152 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:02.152 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.638488+0000", 2024-04-19T03:03:02.152 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0029813159999999999 2024-04-19T03:03:02.152 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.152 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.152 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:02.153 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.828341+0000", 2024-04-19T03:03:02.153 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.189852254 2024-04-19T03:03:02.153 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.153 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.153 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:03:02.153 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.828416+0000", 2024-04-19T03:03:02.153 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5344000000000002e-05 2024-04-19T03:03:02.153 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.153 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.153 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:02.153 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.828558+0000", 2024-04-19T03:03:02.153 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000141695 2024-04-19T03:03:02.153 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:02.153 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:02.154 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:02.154 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.154 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.154 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:86621 5.8 5:1597a420:::benchmark_data_smithi096_19531_object86620:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:02.154 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:22.635187+0000", 2024-04-19T03:03:02.154 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 39.492538377999999, 2024-04-19T03:03:02.154 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.194204878, 2024-04-19T03:03:02.154 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:02.154 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:02.154 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:02.154 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:02.154 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:02.154 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 86621 2024-04-19T03:03:02.154 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.155 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:02.155 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.155 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:02.155 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635187+0000", 2024-04-19T03:03:02.155 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:02.155 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.155 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.155 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:02.155 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635187+0000", 2024-04-19T03:03:02.155 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:02.155 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.155 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.155 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:02.156 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635187+0000", 2024-04-19T03:03:02.156 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:02.156 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.156 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.156 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:02.156 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635242+0000", 2024-04-19T03:03:02.156 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5158000000000003e-05 2024-04-19T03:03:02.156 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.156 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.156 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:02.156 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635249+0000", 2024-04-19T03:03:02.156 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.7000000000000008e-06 2024-04-19T03:03:02.156 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.156 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.157 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:02.157 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635256+0000", 2024-04-19T03:03:02.157 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2060000000000004e-06 2024-04-19T03:03:02.157 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.157 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.157 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:02.157 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635302+0000", 2024-04-19T03:03:02.157 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5954000000000001e-05 2024-04-19T03:03:02.157 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.157 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.157 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:02.157 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635427+0000", 2024-04-19T03:03:02.157 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012559299999999999 2024-04-19T03:03:02.157 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.157 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.158 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:02.158 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635596+0000", 2024-04-19T03:03:02.158 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000168615 2024-04-19T03:03:02.158 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.158 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.158 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:02.158 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.639320+0000", 2024-04-19T03:03:02.158 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0037244610000000001 2024-04-19T03:03:02.158 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.158 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.158 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:02.158 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.829277+0000", 2024-04-19T03:03:02.158 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.18995651099999999 2024-04-19T03:03:02.159 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.159 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.159 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:03:02.159 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.829341+0000", 2024-04-19T03:03:02.159 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3756000000000004e-05 2024-04-19T03:03:02.159 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.159 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.159 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:02.159 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.829392+0000", 2024-04-19T03:03:02.159 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1555999999999999e-05 2024-04-19T03:03:02.159 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:02.159 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:02.159 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:02.159 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.159 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.160 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87067 5.b 5:d57af71a:::benchmark_data_smithi096_19531_object87066:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:02.160 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.142233+0000", 2024-04-19T03:03:02.160 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 38.985492514999997, 2024-04-19T03:03:02.160 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.071692405000000001, 2024-04-19T03:03:02.160 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:02.160 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:02.160 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:02.160 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:02.160 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:02.160 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87067 2024-04-19T03:03:02.160 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.160 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:02.160 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.160 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:02.160 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142233+0000", 2024-04-19T03:03:02.161 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:02.161 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.161 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.161 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:02.161 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142233+0000", 2024-04-19T03:03:02.161 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:02.161 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.161 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.161 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:02.161 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142232+0000", 2024-04-19T03:03:02.161 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:03:02.161 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.161 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.161 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:02.161 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142277+0000", 2024-04-19T03:03:02.162 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5837000000000002e-05 2024-04-19T03:03:02.162 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.162 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.162 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:02.162 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142297+0000", 2024-04-19T03:03:02.162 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9561000000000001e-05 2024-04-19T03:03:02.162 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.162 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.162 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:02.162 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142311+0000", 2024-04-19T03:03:02.162 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3654e-05 2024-04-19T03:03:02.162 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.162 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.162 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:02.163 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142391+0000", 2024-04-19T03:03:02.163 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0123999999999994e-05 2024-04-19T03:03:02.163 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.163 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.163 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:02.163 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142669+0000", 2024-04-19T03:03:02.163 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00027829800000000001 2024-04-19T03:03:02.163 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.163 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.163 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:02.163 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142859+0000", 2024-04-19T03:03:02.163 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000190051 2024-04-19T03:03:02.163 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.163 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.163 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:02.164 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.150597+0000", 2024-04-19T03:03:02.164 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0077380299999999999 2024-04-19T03:03:02.164 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.164 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.164 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:02.164 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.213855+0000", 2024-04-19T03:03:02.164 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.063257987000000002 2024-04-19T03:03:02.164 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.164 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.164 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:03:02.164 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.213898+0000", 2024-04-19T03:03:02.164 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2916e-05 2024-04-19T03:03:02.164 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.165 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.165 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:02.165 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.213925+0000", 2024-04-19T03:03:02.165 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7503000000000001e-05 2024-04-19T03:03:02.165 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:02.165 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:02.165 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:02.165 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.165 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.165 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87069 5.b 5:da0c93b5:::benchmark_data_smithi096_19531_object87068:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:02.165 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.143402+0000", 2024-04-19T03:03:02.165 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 38.984323553000003, 2024-04-19T03:03:02.165 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.070678598999999995, 2024-04-19T03:03:02.165 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:02.166 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:02.166 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:02.166 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:02.166 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:02.166 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87069 2024-04-19T03:03:02.166 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.166 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:02.166 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.166 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:02.166 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.143402+0000", 2024-04-19T03:03:02.166 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:02.166 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.166 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.167 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:02.167 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.143402+0000", 2024-04-19T03:03:02.167 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:02.167 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.167 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.167 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:02.167 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.143401+0000", 2024-04-19T03:03:02.167 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:03:02.167 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.167 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.167 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:02.167 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.143501+0000", 2024-04-19T03:03:02.167 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000100387 2024-04-19T03:03:02.167 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.168 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.168 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:02.168 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.143516+0000", 2024-04-19T03:03:02.168 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5369000000000001e-05 2024-04-19T03:03:02.168 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.168 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.168 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:02.168 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.143524+0000", 2024-04-19T03:03:02.168 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.7079999999999997e-06 2024-04-19T03:03:02.168 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.168 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.168 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:02.168 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.145550+0000", 2024-04-19T03:03:02.168 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0020259290000000001 2024-04-19T03:03:02.169 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.169 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.169 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:02.169 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.145676+0000", 2024-04-19T03:03:02.169 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000126406 2024-04-19T03:03:02.169 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.169 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.169 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:02.169 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.145802+0000", 2024-04-19T03:03:02.169 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000125974 2024-04-19T03:03:02.169 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.169 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.169 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:02.169 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.151030+0000", 2024-04-19T03:03:02.170 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0052276079999999999 2024-04-19T03:03:02.170 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.170 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.170 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:02.170 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.213998+0000", 2024-04-19T03:03:02.170 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.06296786 2024-04-19T03:03:02.170 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.170 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.170 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:03:02.170 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.214031+0000", 2024-04-19T03:03:02.170 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3387999999999999e-05 2024-04-19T03:03:02.170 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.170 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.171 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:02.171 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.214081+0000", 2024-04-19T03:03:02.171 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9316e-05 2024-04-19T03:03:02.171 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:02.171 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:02.171 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:02.171 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.171 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.171 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87108 5.e 5:7e197adc:::benchmark_data_smithi096_19531_object87107:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:02.171 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.223103+0000", 2024-04-19T03:03:02.171 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 38.904622216, 2024-04-19T03:03:02.171 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.044946887, 2024-04-19T03:03:02.171 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:02.171 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-19T03:03:02.172 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:02.172 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:02.172 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:02.172 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87108 2024-04-19T03:03:02.172 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.172 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:02.172 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.172 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:02.172 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.223103+0000", 2024-04-19T03:03:02.172 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:02.172 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.172 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.172 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:02.173 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.223103+0000", 2024-04-19T03:03:02.173 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:02.173 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.173 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.173 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:02.173 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.223102+0000", 2024-04-19T03:03:02.173 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:03:02.173 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.173 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.173 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:02.173 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.223156+0000", 2024-04-19T03:03:02.173 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3958000000000001e-05 2024-04-19T03:03:02.173 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.173 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.174 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:02.174 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.223166+0000", 2024-04-19T03:03:02.174 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.4809999999999995e-06 2024-04-19T03:03:02.174 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.174 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.174 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:02.174 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.223172+0000", 2024-04-19T03:03:02.174 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0140000000000004e-06 2024-04-19T03:03:02.174 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.174 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.174 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:02.174 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.227295+0000", 2024-04-19T03:03:02.174 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0041233420000000003 2024-04-19T03:03:02.175 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.175 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.175 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:02.175 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.227495+0000", 2024-04-19T03:03:02.175 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00019955299999999999 2024-04-19T03:03:02.175 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.175 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.175 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:02.175 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.227717+0000", 2024-04-19T03:03:02.175 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000221902 2024-04-19T03:03:02.175 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.175 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.175 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:02.175 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233189+0000", 2024-04-19T03:03:02.175 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0054718889999999997 2024-04-19T03:03:02.176 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.176 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.176 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:02.176 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.250529+0000", 2024-04-19T03:03:02.176 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.017340298000000001 2024-04-19T03:03:02.176 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.176 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.176 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:03:02.176 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.250539+0000", 2024-04-19T03:03:02.176 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0501e-05 2024-04-19T03:03:02.176 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.176 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.176 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:02.176 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.268003+0000", 2024-04-19T03:03:02.177 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.017463429 2024-04-19T03:03:02.177 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.177 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.177 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:02.177 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.268050+0000", 2024-04-19T03:03:02.177 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7466000000000003e-05 2024-04-19T03:03:02.177 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:02.177 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:02.177 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:02.177 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.177 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.177 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87118 5.b 5:d1bb4f3c:::benchmark_data_smithi096_19531_object87117:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:02.177 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.231082+0000", 2024-04-19T03:03:02.177 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 38.896643382000001, 2024-04-19T03:03:02.178 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.035789004, 2024-04-19T03:03:02.178 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:02.178 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-19T03:03:02.178 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:02.178 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:02.179 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:02.179 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87118 2024-04-19T03:03:02.179 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.179 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:02.179 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.179 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:02.180 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231082+0000", 2024-04-19T03:03:02.180 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:02.180 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.180 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.180 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:02.180 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231082+0000", 2024-04-19T03:03:02.180 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:02.180 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.180 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.180 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:02.180 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231081+0000", 2024-04-19T03:03:02.180 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:03:02.180 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.181 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.181 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:02.181 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231159+0000", 2024-04-19T03:03:02.181 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.7819999999999997e-05 2024-04-19T03:03:02.181 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.181 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.181 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:02.181 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231186+0000", 2024-04-19T03:03:02.181 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7126000000000001e-05 2024-04-19T03:03:02.181 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.181 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.181 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:02.181 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231193+0000", 2024-04-19T03:03:02.181 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7259999999999996e-06 2024-04-19T03:03:02.182 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.182 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.182 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:02.182 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231241+0000", 2024-04-19T03:03:02.182 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8123e-05 2024-04-19T03:03:02.182 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.182 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.182 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:02.182 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231354+0000", 2024-04-19T03:03:02.182 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0001133 2024-04-19T03:03:02.182 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.182 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.182 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:02.183 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231443+0000", 2024-04-19T03:03:02.183 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9167999999999997e-05 2024-04-19T03:03:02.183 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.183 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.183 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:02.183 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236498+0000", 2024-04-19T03:03:02.183 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0050545160000000002 2024-04-19T03:03:02.183 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.183 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.183 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:02.183 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.249681+0000", 2024-04-19T03:03:02.183 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013183321 2024-04-19T03:03:02.183 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.184 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.184 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:03:02.184 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.249693+0000", 2024-04-19T03:03:02.184 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1834999999999999e-05 2024-04-19T03:03:02.184 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.184 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.184 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:02.184 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266733+0000", 2024-04-19T03:03:02.184 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.017040408 2024-04-19T03:03:02.184 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.184 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.184 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:02.184 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266871+0000", 2024-04-19T03:03:02.184 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000137849 2024-04-19T03:03:02.184 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:02.184 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:02.185 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:02.185 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.185 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.185 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87121 5.b 5:d01822b8:::benchmark_data_smithi096_19531_object87120:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:02.185 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.233319+0000", 2024-04-19T03:03:02.185 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 38.894406517999997, 2024-04-19T03:03:02.185 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.033624198, 2024-04-19T03:03:02.185 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:02.185 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-19T03:03:02.185 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:02.185 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:02.185 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:02.185 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87121 2024-04-19T03:03:02.185 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.186 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:02.186 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.186 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:02.186 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233319+0000", 2024-04-19T03:03:02.186 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:02.186 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.186 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.186 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:02.186 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233319+0000", 2024-04-19T03:03:02.186 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:02.186 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.186 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.186 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:02.187 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233319+0000", 2024-04-19T03:03:02.187 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:02.187 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.187 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.187 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:02.187 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233364+0000", 2024-04-19T03:03:02.187 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5460999999999997e-05 2024-04-19T03:03:02.187 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.187 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.187 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:02.187 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233382+0000", 2024-04-19T03:03:02.187 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8148e-05 2024-04-19T03:03:02.187 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.187 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.188 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:02.188 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233390+0000", 2024-04-19T03:03:02.188 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5340000000000002e-06 2024-04-19T03:03:02.188 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.188 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.188 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:02.188 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233712+0000", 2024-04-19T03:03:02.188 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00032260500000000001 2024-04-19T03:03:02.188 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.188 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.188 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:02.188 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233829+0000", 2024-04-19T03:03:02.188 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011638599999999999 2024-04-19T03:03:02.188 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.188 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.189 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:02.189 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233959+0000", 2024-04-19T03:03:02.189 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013013900000000001 2024-04-19T03:03:02.189 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.189 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.189 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:02.189 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236515+0000", 2024-04-19T03:03:02.189 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0025562750000000002 2024-04-19T03:03:02.189 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.189 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.189 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:02.189 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.249723+0000", 2024-04-19T03:03:02.189 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013208176 2024-04-19T03:03:02.190 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.190 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.190 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:03:02.190 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.249728+0000", 2024-04-19T03:03:02.190 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6519999999999997e-06 2024-04-19T03:03:02.190 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.190 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.190 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:02.190 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266837+0000", 2024-04-19T03:03:02.190 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0171087059999999 2024-04-19T03:03:02.190 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.190 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.190 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:02.191 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266943+0000", 2024-04-19T03:03:02.191 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000106604 2024-04-19T03:03:02.191 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:02.191 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:02.191 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:02.191 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.191 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.191 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87124 5.8 5:14819ad7:::benchmark_data_smithi096_19531_object87123:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:02.191 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.235886+0000", 2024-04-19T03:03:02.191 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 38.891839093999998, 2024-04-19T03:03:02.191 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0315451179999999, 2024-04-19T03:03:02.191 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:02.191 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-19T03:03:02.191 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:02.191 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:02.192 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:02.192 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87124 2024-04-19T03:03:02.192 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.192 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:02.192 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.192 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:02.192 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.235886+0000", 2024-04-19T03:03:02.192 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:02.192 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.192 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.192 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:02.192 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.235886+0000", 2024-04-19T03:03:02.192 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:02.192 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.193 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.193 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:02.193 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.235886+0000", 2024-04-19T03:03:02.193 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:03:02.193 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.193 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.193 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:02.193 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.235934+0000", 2024-04-19T03:03:02.193 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8384000000000003e-05 2024-04-19T03:03:02.193 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.193 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.193 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:02.193 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.235945+0000", 2024-04-19T03:03:02.193 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0671e-05 2024-04-19T03:03:02.194 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.194 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.194 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:02.194 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.235952+0000", 2024-04-19T03:03:02.194 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3089999999999998e-06 2024-04-19T03:03:02.194 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.194 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.194 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:02.194 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.237067+0000", 2024-04-19T03:03:02.194 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001115263 2024-04-19T03:03:02.195 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.195 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.195 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:02.195 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.237188+0000", 2024-04-19T03:03:02.195 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000121258 2024-04-19T03:03:02.195 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.195 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.195 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:02.195 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.237316+0000", 2024-04-19T03:03:02.195 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000128071 2024-04-19T03:03:02.195 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.195 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.195 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:02.196 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240744+0000", 2024-04-19T03:03:02.196 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0034275629999999998 2024-04-19T03:03:02.196 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.196 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.196 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:02.196 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.252517+0000", 2024-04-19T03:03:02.196 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011772991999999999 2024-04-19T03:03:02.196 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.196 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.196 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:03:02.196 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.252523+0000", 2024-04-19T03:03:02.196 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3640000000000004e-06 2024-04-19T03:03:02.196 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.197 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.197 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:02.197 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.267290+0000", 2024-04-19T03:03:02.197 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0147665690000001 2024-04-19T03:03:02.197 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.197 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.197 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:02.197 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.267432+0000", 2024-04-19T03:03:02.197 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014165299999999999 2024-04-19T03:03:02.197 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:02.197 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:02.197 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:02.197 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.197 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.197 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87129 5.0 5:02667e01:::benchmark_data_smithi096_19531_object87128:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:02.198 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.236466+0000", 2024-04-19T03:03:02.198 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 38.891259097999999, 2024-04-19T03:03:02.198 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0301534510000001, 2024-04-19T03:03:02.198 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:02.198 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-19T03:03:02.198 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:02.198 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:02.198 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:02.198 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87129 2024-04-19T03:03:02.198 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.198 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:02.198 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.198 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:02.198 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236466+0000", 2024-04-19T03:03:02.198 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:02.199 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.199 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.199 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:02.199 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236466+0000", 2024-04-19T03:03:02.199 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:02.199 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.199 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.199 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:02.199 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236465+0000", 2024-04-19T03:03:02.199 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:03:02.199 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.199 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.199 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:02.199 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236566+0000", 2024-04-19T03:03:02.199 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010047000000000001 2024-04-19T03:03:02.200 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.200 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.200 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:02.200 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236577+0000", 2024-04-19T03:03:02.200 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1772e-05 2024-04-19T03:03:02.200 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.200 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.200 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:02.200 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236584+0000", 2024-04-19T03:03:02.200 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0530000000000003e-06 2024-04-19T03:03:02.200 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.200 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.200 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:02.200 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.237023+0000", 2024-04-19T03:03:02.200 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000439703 2024-04-19T03:03:02.201 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.201 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.201 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:02.201 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.237207+0000", 2024-04-19T03:03:02.201 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000183692 2024-04-19T03:03:02.201 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.201 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.201 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:02.201 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.237373+0000", 2024-04-19T03:03:02.201 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016623500000000001 2024-04-19T03:03:02.201 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.201 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.201 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:02.201 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.241461+0000", 2024-04-19T03:03:02.201 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0040883050000000004 2024-04-19T03:03:02.202 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.202 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.202 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:02.202 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.252500+0000", 2024-04-19T03:03:02.202 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011038450999999999 2024-04-19T03:03:02.202 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.202 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.202 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:03:02.202 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.252507+0000", 2024-04-19T03:03:02.202 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2439999999999996e-06 2024-04-19T03:03:02.202 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.202 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.202 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:02.203 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266538+0000", 2024-04-19T03:03:02.203 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.014031184 2024-04-19T03:03:02.203 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.203 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.203 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:02.203 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266620+0000", 2024-04-19T03:03:02.203 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1600000000000005e-05 2024-04-19T03:03:02.203 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:02.203 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:02.203 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:02.203 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.203 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.203 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87135 5.4 5:2a97e7b7:::benchmark_data_smithi096_19531_object87134:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:02.203 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.240884+0000", 2024-04-19T03:03:02.203 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 38.886841640999997, 2024-04-19T03:03:02.204 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.025708931, 2024-04-19T03:03:02.204 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:02.204 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-19T03:03:02.204 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:02.204 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:02.204 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:02.204 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87135 2024-04-19T03:03:02.204 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.204 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:02.204 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.204 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:02.204 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240884+0000", 2024-04-19T03:03:02.204 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:02.204 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.205 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.205 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:02.205 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240884+0000", 2024-04-19T03:03:02.205 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:02.205 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.205 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.205 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:02.205 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240883+0000", 2024-04-19T03:03:02.205 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:03:02.205 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.205 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.205 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:02.205 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240933+0000", 2024-04-19T03:03:02.205 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9969999999999998e-05 2024-04-19T03:03:02.206 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.206 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.206 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:02.206 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240946+0000", 2024-04-19T03:03:02.206 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2943e-05 2024-04-19T03:03:02.206 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.206 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.206 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:02.206 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240952+0000", 2024-04-19T03:03:02.206 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8930000000000002e-06 2024-04-19T03:03:02.206 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.206 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.206 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:02.207 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240994+0000", 2024-04-19T03:03:02.207 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2753999999999998e-05 2024-04-19T03:03:02.207 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.207 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.207 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:02.207 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.241092+0000", 2024-04-19T03:03:02.207 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.7447000000000004e-05 2024-04-19T03:03:02.207 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.207 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.207 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:02.207 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.241183+0000", 2024-04-19T03:03:02.207 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1163999999999997e-05 2024-04-19T03:03:02.207 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.207 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.207 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:02.208 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.254672+0000", 2024-04-19T03:03:02.208 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.01348864 2024-04-19T03:03:02.208 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.208 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.208 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:03:02.208 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.254681+0000", 2024-04-19T03:03:02.208 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.3789999999999995e-06 2024-04-19T03:03:02.208 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.208 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.208 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:02.208 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266456+0000", 2024-04-19T03:03:02.208 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.011774621 2024-04-19T03:03:02.208 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.208 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.208 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:02.209 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266593+0000", 2024-04-19T03:03:02.209 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013737600000000001 2024-04-19T03:03:02.209 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:02.209 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:02.209 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:02.209 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.209 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.209 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87136 5.4 5:212411bc:::benchmark_data_smithi096_19531_object87135:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:02.209 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.240962+0000", 2024-04-19T03:03:02.209 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 38.886763764999998, 2024-04-19T03:03:02.209 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.025738, 2024-04-19T03:03:02.209 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:02.209 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-19T03:03:02.209 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:02.209 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:02.210 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:02.210 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87136 2024-04-19T03:03:02.210 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.210 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:02.210 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.210 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:02.210 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240962+0000", 2024-04-19T03:03:02.210 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:02.210 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.210 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.210 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:02.210 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240962+0000", 2024-04-19T03:03:02.210 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:02.210 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.211 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.211 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:02.211 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240961+0000", 2024-04-19T03:03:02.211 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:02.211 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.211 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.211 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:02.211 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240995+0000", 2024-04-19T03:03:02.211 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3868000000000002e-05 2024-04-19T03:03:02.211 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.211 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.211 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:02.211 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.241001+0000", 2024-04-19T03:03:02.211 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.322e-06 2024-04-19T03:03:02.211 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.212 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.212 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:02.212 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.241004+0000", 2024-04-19T03:03:02.212 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3510000000000002e-06 2024-04-19T03:03:02.212 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.212 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.212 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:02.212 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247131+0000", 2024-04-19T03:03:02.212 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0061270869999999998 2024-04-19T03:03:02.212 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.212 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.212 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:02.212 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247322+0000", 2024-04-19T03:03:02.212 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000191015 2024-04-19T03:03:02.212 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.213 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.213 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:02.213 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247542+0000", 2024-04-19T03:03:02.213 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00022030199999999999 2024-04-19T03:03:02.213 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.213 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.213 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:02.213 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.254709+0000", 2024-04-19T03:03:02.213 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0071662660000000001 2024-04-19T03:03:02.213 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.213 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.213 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:03:02.213 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.254716+0000", 2024-04-19T03:03:02.213 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3860000000000001e-06 2024-04-19T03:03:02.213 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.214 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.214 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:02.214 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266619+0000", 2024-04-19T03:03:02.214 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0119031030000001 2024-04-19T03:03:02.214 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.214 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.214 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:02.214 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266700+0000", 2024-04-19T03:03:02.214 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0764000000000001e-05 2024-04-19T03:03:02.214 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:02.214 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:02.214 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:02.214 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.214 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.215 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87138 5.e 5:7b1f1c20:::benchmark_data_smithi096_19531_object87137:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:02.215 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.247862+0000", 2024-04-19T03:03:02.215 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 38.879863690999997, 2024-04-19T03:03:02.215 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.024457079, 2024-04-19T03:03:02.215 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:02.215 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:02.215 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:02.215 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:02.215 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:02.215 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87138 2024-04-19T03:03:02.215 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.215 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:02.215 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.215 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:02.215 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247862+0000", 2024-04-19T03:03:02.216 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:02.216 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.216 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.216 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:02.216 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247862+0000", 2024-04-19T03:03:02.216 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:02.216 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.216 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.216 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:02.216 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247860+0000", 2024-04-19T03:03:02.216 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999981 2024-04-19T03:03:02.216 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.216 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.216 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:02.216 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247909+0000", 2024-04-19T03:03:02.216 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9150999999999997e-05 2024-04-19T03:03:02.217 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.217 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.217 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:02.217 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247925+0000", 2024-04-19T03:03:02.217 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5761999999999999e-05 2024-04-19T03:03:02.217 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.217 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.217 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:02.217 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247936+0000", 2024-04-19T03:03:02.217 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1144e-05 2024-04-19T03:03:02.217 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.217 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.217 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:02.217 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.250590+0000", 2024-04-19T03:03:02.217 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.002653678 2024-04-19T03:03:02.218 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.218 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.218 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:03:02.218 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.250599+0000", 2024-04-19T03:03:02.218 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9039999999999998e-06 2024-04-19T03:03:02.218 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.218 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.218 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:02.218 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.268151+0000", 2024-04-19T03:03:02.218 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0175523449999999 2024-04-19T03:03:02.218 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.218 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.218 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:02.218 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.268285+0000", 2024-04-19T03:03:02.219 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013415599999999999 2024-04-19T03:03:02.219 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.219 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.219 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:02.219 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.272238+0000", 2024-04-19T03:03:02.219 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0039533019999999997 2024-04-19T03:03:02.219 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.219 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.219 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:03:02.219 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.272274+0000", 2024-04-19T03:03:02.219 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5352000000000003e-05 2024-04-19T03:03:02.219 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.219 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.219 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:02.219 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.272319+0000", 2024-04-19T03:03:02.220 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5281999999999998e-05 2024-04-19T03:03:02.220 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:02.220 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:02.220 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:02.220 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.220 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.220 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:158371 5.8 5:11a83024:::benchmark_data_smithi096_19531_object44921:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-19T03:03:02.220 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:58.125869+0000", 2024-04-19T03:03:02.220 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 4.001856826, 2024-04-19T03:03:02.220 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074532857999999994, 2024-04-19T03:03:02.220 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:02.220 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:02.220 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:02.220 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:02.221 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:02.221 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 158371 2024-04-19T03:03:02.221 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.221 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:02.221 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.221 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:02.221 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125869+0000", 2024-04-19T03:03:02.221 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:02.221 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.221 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.221 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:02.221 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125869+0000", 2024-04-19T03:03:02.221 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:02.221 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.222 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.222 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:02.222 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125868+0000", 2024-04-19T03:03:02.222 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:03:02.222 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.222 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.222 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:02.222 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125874+0000", 2024-04-19T03:03:02.222 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7120000000000003e-06 2024-04-19T03:03:02.222 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.222 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.222 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:02.222 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125885+0000", 2024-04-19T03:03:02.223 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0665999999999999e-05 2024-04-19T03:03:02.223 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.223 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.223 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:02.223 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125901+0000", 2024-04-19T03:03:02.223 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6463000000000001e-05 2024-04-19T03:03:02.223 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.223 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.223 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:02.223 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125956+0000", 2024-04-19T03:03:02.223 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4728000000000002e-05 2024-04-19T03:03:02.223 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.223 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.223 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:02.224 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.126050+0000", 2024-04-19T03:03:02.224 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.3534000000000003e-05 2024-04-19T03:03:02.224 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.224 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.224 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:02.224 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.200187+0000", 2024-04-19T03:03:02.224 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074136933000000002 2024-04-19T03:03:02.224 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.224 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.224 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:03:02.224 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.200260+0000", 2024-04-19T03:03:02.224 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3090999999999995e-05 2024-04-19T03:03:02.224 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.224 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.225 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:02.225 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.200402+0000", 2024-04-19T03:03:02.225 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014193699999999999 2024-04-19T03:03:02.225 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:02.225 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:02.225 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:02.225 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.225 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.225 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:158372 5.0 5:0473aa5f:::benchmark_data_smithi096_19531_object44922:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-19T03:03:02.225 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:58.125924+0000", 2024-04-19T03:03:02.225 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 4.0018012189999999, 2024-04-19T03:03:02.225 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074247490999999999, 2024-04-19T03:03:02.226 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:02.226 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:02.226 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:02.226 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:02.226 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:02.226 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 158372 2024-04-19T03:03:02.226 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.226 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:02.226 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.226 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:02.226 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125924+0000", 2024-04-19T03:03:02.226 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:02.227 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.229 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.229 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:02.229 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125924+0000", 2024-04-19T03:03:02.229 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:02.229 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.229 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.229 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:02.230 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125924+0000", 2024-04-19T03:03:02.230 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:02.230 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.230 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.230 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:02.230 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125927+0000", 2024-04-19T03:03:02.230 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5389999999999999e-06 2024-04-19T03:03:02.230 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.230 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.230 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:02.230 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125935+0000", 2024-04-19T03:03:02.230 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3259999999999998e-06 2024-04-19T03:03:02.230 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.231 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.231 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:02.231 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125940+0000", 2024-04-19T03:03:02.231 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6980000000000003e-06 2024-04-19T03:03:02.231 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.231 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.231 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:02.231 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125982+0000", 2024-04-19T03:03:02.231 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1337000000000001e-05 2024-04-19T03:03:02.231 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.231 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.231 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:02.231 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.126075+0000", 2024-04-19T03:03:02.231 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.3579999999999995e-05 2024-04-19T03:03:02.232 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.232 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.232 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:02.232 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.199953+0000", 2024-04-19T03:03:02.232 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073877604999999999 2024-04-19T03:03:02.232 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.232 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.232 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:03:02.232 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.200022+0000", 2024-04-19T03:03:02.232 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.8824000000000004e-05 2024-04-19T03:03:02.232 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.232 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.232 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:02.233 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.200172+0000", 2024-04-19T03:03:02.233 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015017700000000001 2024-04-19T03:03:02.233 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:02.233 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:02.233 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:02.233 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.233 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.233 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:158374 5.e 5:76be57a5:::benchmark_data_smithi096_19531_object44924:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-19T03:03:02.233 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:58.125988+0000", 2024-04-19T03:03:02.233 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 4.0017377200000004, 2024-04-19T03:03:02.233 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.067843332000000006, 2024-04-19T03:03:02.233 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:02.233 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:02.233 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:02.234 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:02.234 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:02.234 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 158374 2024-04-19T03:03:02.234 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.234 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:02.234 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.234 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:02.234 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125988+0000", 2024-04-19T03:03:02.234 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:02.234 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.234 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.234 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:02.234 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125988+0000", 2024-04-19T03:03:02.234 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:02.235 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.235 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.235 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:02.235 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125987+0000", 2024-04-19T03:03:02.235 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:02.235 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.235 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.235 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:02.235 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125990+0000", 2024-04-19T03:03:02.235 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7989999999999998e-06 2024-04-19T03:03:02.235 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.235 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.235 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:02.235 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125996+0000", 2024-04-19T03:03:02.236 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.302e-06 2024-04-19T03:03:02.236 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.236 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.236 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:02.236 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.126001+0000", 2024-04-19T03:03:02.236 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.843e-06 2024-04-19T03:03:02.236 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.236 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.236 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:02.236 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.126047+0000", 2024-04-19T03:03:02.236 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6066000000000002e-05 2024-04-19T03:03:02.236 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.236 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.237 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:02.237 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.126171+0000", 2024-04-19T03:03:02.237 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012359099999999999 2024-04-19T03:03:02.237 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.237 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.237 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:02.237 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.193709+0000", 2024-04-19T03:03:02.237 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.067538099000000004 2024-04-19T03:03:02.237 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.237 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.237 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:03:02.237 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.193766+0000", 2024-04-19T03:03:02.237 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6869e-05 2024-04-19T03:03:02.237 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.237 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.237 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:02.238 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.193831+0000", 2024-04-19T03:03:02.238 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5273999999999999e-05 2024-04-19T03:03:02.238 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:02.238 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:02.238 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:02.238 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.238 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.238 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4755.0:158376 5.9 e56/22 5:9e73c076:::benchmark_data_smithi096_19531_object44926:head v 56'9663, mlcod=56'9661)", 2024-04-19T03:03:02.238 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:58.127307+0000", 2024-04-19T03:03:02.238 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 4.0004184890000003, 2024-04-19T03:03:02.238 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069002716000000006, 2024-04-19T03:03:02.238 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:02.238 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:02.239 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:02.239 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.239 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:02.239 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.127307+0000", 2024-04-19T03:03:02.239 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:02.239 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.239 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.239 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:02.239 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.127307+0000", 2024-04-19T03:03:02.239 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:02.239 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.239 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.239 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:02.239 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.127306+0000", 2024-04-19T03:03:02.239 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:03:02.240 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.240 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.240 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:02.240 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.127316+0000", 2024-04-19T03:03:02.240 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.3039999999999994e-06 2024-04-19T03:03:02.240 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.240 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.240 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:02.240 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.127326+0000", 2024-04-19T03:03:02.240 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0009e-05 2024-04-19T03:03:02.240 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.240 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.240 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:02.240 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.127332+0000", 2024-04-19T03:03:02.240 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5880000000000003e-06 2024-04-19T03:03:02.241 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.241 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.241 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:02.241 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.127383+0000", 2024-04-19T03:03:02.241 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0516000000000002e-05 2024-04-19T03:03:02.241 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.241 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.241 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:02.241 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.127403+0000", 2024-04-19T03:03:02.241 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0547000000000002e-05 2024-04-19T03:03:02.241 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.241 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.241 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:03:02.241 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.196280+0000", 2024-04-19T03:03:02.241 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.068876863999999996 2024-04-19T03:03:02.241 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.242 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.242 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:02.242 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.196310+0000", 2024-04-19T03:03:02.242 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9762999999999999e-05 2024-04-19T03:03:02.242 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:02.242 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:02.242 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:02.242 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.242 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.242 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:158383 5.0 5:026717eb:::benchmark_data_smithi096_19531_object44933:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-19T03:03:02.242 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:58.130494+0000", 2024-04-19T03:03:02.242 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 3.997231363, 2024-04-19T03:03:02.242 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.070135775999999997, 2024-04-19T03:03:02.243 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:02.243 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:02.243 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:02.243 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:02.243 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:02.243 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 158383 2024-04-19T03:03:02.243 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.243 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:02.243 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.243 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:02.243 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.130494+0000", 2024-04-19T03:03:02.243 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:02.243 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.243 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.243 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:02.244 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.130494+0000", 2024-04-19T03:03:02.244 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:02.244 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.244 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.244 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:02.244 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.130493+0000", 2024-04-19T03:03:02.244 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:03:02.244 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.244 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.244 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:02.244 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.130500+0000", 2024-04-19T03:03:02.244 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5490000000000003e-06 2024-04-19T03:03:02.244 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.244 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.244 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:02.244 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.190401+0000", 2024-04-19T03:03:02.245 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.059901668999999998 2024-04-19T03:03:02.245 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.245 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.245 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:02.245 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.190421+0000", 2024-04-19T03:03:02.245 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0288e-05 2024-04-19T03:03:02.245 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.245 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.245 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:02.245 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.190536+0000", 2024-04-19T03:03:02.245 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000114783 2024-04-19T03:03:02.245 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.245 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.245 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:02.246 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.190904+0000", 2024-04-19T03:03:02.246 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00036773900000000001 2024-04-19T03:03:02.246 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.246 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.246 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:02.246 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.200417+0000", 2024-04-19T03:03:02.246 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0095128899999999995 2024-04-19T03:03:02.246 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.246 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.246 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:03:02.246 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.200489+0000", 2024-04-19T03:03:02.246 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2554999999999999e-05 2024-04-19T03:03:02.246 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.247 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.247 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:02.247 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.200630+0000", 2024-04-19T03:03:02.247 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014055299999999999 2024-04-19T03:03:02.247 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:02.247 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:02.247 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:02.247 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:02.247 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:02.247 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-19T03:03:02.248 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T03:03:02.249 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:03:02.244+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:03:02.349 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:03:02.346+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:03:02.376 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-04-19T03:03:02.376 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [ 2024-04-19T03:03:02.376 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.377 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:168800 5.7 5:e43f7280:::benchmark_data_smithi096_19531_object55350:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T03:03:02.377 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:03:02.372402+0000", 2024-04-19T03:03:02.377 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0032672880000000001, 2024-04-19T03:03:02.377 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0032838400000000001, 2024-04-19T03:03:02.377 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:02.377 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-04-19T03:03:02.377 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:02.377 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:02.377 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:02.377 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 168800 2024-04-19T03:03:02.377 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.377 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:02.377 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.378 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:02.378 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:02.372402+0000", 2024-04-19T03:03:02.378 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:02.378 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.378 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.378 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:02.378 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:02.372402+0000", 2024-04-19T03:03:02.378 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:02.378 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.378 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.378 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:02.378 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:02.372401+0000", 2024-04-19T03:03:02.378 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:03:02.378 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.379 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.379 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:02.379 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:02.372407+0000", 2024-04-19T03:03:02.379 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9780000000000002e-06 2024-04-19T03:03:02.379 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.379 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.379 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:02.379 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:02.372420+0000", 2024-04-19T03:03:02.379 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2687999999999999e-05 2024-04-19T03:03:02.379 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.379 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.379 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:02.379 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:02.372428+0000", 2024-04-19T03:03:02.380 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0730000000000005e-06 2024-04-19T03:03:02.380 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.380 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.380 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:02.380 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:02.373040+0000", 2024-04-19T03:03:02.380 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00061244900000000004 2024-04-19T03:03:02.380 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.380 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.380 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:02.380 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:02.373228+0000", 2024-04-19T03:03:02.380 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000188168 2024-04-19T03:03:02.380 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:02.380 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:02.380 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:02.381 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.381 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.381 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:168801 5.7 5:e7c0becd:::benchmark_data_smithi096_19531_object55351:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T03:03:02.381 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:03:02.372702+0000", 2024-04-19T03:03:02.381 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0029676149999999998, 2024-04-19T03:03:02.381 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0030421229999999999, 2024-04-19T03:03:02.381 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:02.381 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-04-19T03:03:02.381 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:02.381 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:02.381 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:02.381 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 168801 2024-04-19T03:03:02.381 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.381 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:02.382 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.382 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:02.382 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:02.372702+0000", 2024-04-19T03:03:02.382 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:02.382 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.382 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.382 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:02.382 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:02.372702+0000", 2024-04-19T03:03:02.382 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:02.382 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.382 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.382 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:02.382 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:02.372700+0000", 2024-04-19T03:03:02.382 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:03:02.383 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.383 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.383 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:02.383 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:02.372707+0000", 2024-04-19T03:03:02.383 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.054e-06 2024-04-19T03:03:02.383 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.383 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.383 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:02.383 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:02.372718+0000", 2024-04-19T03:03:02.383 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1212e-05 2024-04-19T03:03:02.383 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.383 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.383 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:02.383 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:02.372725+0000", 2024-04-19T03:03:02.384 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.464e-06 2024-04-19T03:03:02.384 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.384 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.384 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:02.384 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:02.375169+0000", 2024-04-19T03:03:02.384 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0024433969999999999 2024-04-19T03:03:02.384 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.384 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.384 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:02.384 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:02.375265+0000", 2024-04-19T03:03:02.384 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.6842000000000006e-05 2024-04-19T03:03:02.384 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:02.384 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:02.384 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:02.385 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.385 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.385 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:168804 5.7 5.104bea17 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T03:03:02.385 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:03:02.373060+0000", 2024-04-19T03:03:02.385 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.002609611, 2024-04-19T03:03:02.385 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0027186630000000001, 2024-04-19T03:03:02.385 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:02.385 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-04-19T03:03:02.385 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:02.385 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:02.385 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:02.385 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 168804 2024-04-19T03:03:02.385 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.385 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:02.386 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.386 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:02.386 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:02.373060+0000", 2024-04-19T03:03:02.386 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:02.386 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.386 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.386 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:02.386 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:02.373060+0000", 2024-04-19T03:03:02.386 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:02.386 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.386 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.386 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:02.386 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:02.373059+0000", 2024-04-19T03:03:02.386 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:02.387 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.387 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.387 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:02.387 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:02.373062+0000", 2024-04-19T03:03:02.387 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4640000000000002e-06 2024-04-19T03:03:02.387 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.387 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.387 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:02.387 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:02.373069+0000", 2024-04-19T03:03:02.387 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2879999999999998e-06 2024-04-19T03:03:02.387 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.387 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.387 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:02.387 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:02.373074+0000", 2024-04-19T03:03:02.387 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7799999999999997e-06 2024-04-19T03:03:02.388 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:02.388 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:02.388 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:02.389 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.389 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.389 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop_reply(client.4755.0:168784 5.f e57/22)", 2024-04-19T03:03:02.389 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:03:02.375186+0000", 2024-04-19T03:03:02.389 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.00048350299999999998, 2024-04-19T03:03:02.389 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00061873400000000002, 2024-04-19T03:03:02.389 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:02.389 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-04-19T03:03:02.389 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:02.389 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.389 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:02.389 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:02.375186+0000", 2024-04-19T03:03:02.389 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:02.390 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.390 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.390 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:02.390 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:02.375186+0000", 2024-04-19T03:03:02.390 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:02.390 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.390 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.390 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:02.390 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:02.375185+0000", 2024-04-19T03:03:02.390 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:03:02.390 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.390 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.390 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:02.390 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:02.375190+0000", 2024-04-19T03:03:02.391 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3279999999999996e-06 2024-04-19T03:03:02.391 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.391 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.391 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:02.391 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:02.375204+0000", 2024-04-19T03:03:02.391 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3642000000000001e-05 2024-04-19T03:03:02.391 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.391 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.391 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:02.391 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:02.375210+0000", 2024-04-19T03:03:02.391 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4670000000000001e-06 2024-04-19T03:03:02.391 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:02.391 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:02.391 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:02.392 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.392 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.392 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:168808 5.c 5:301cf108:::benchmark_data_smithi096_19531_object55358:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T03:03:02.392 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:03:02.375405+0000", 2024-04-19T03:03:02.392 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.000263923, 2024-04-19T03:03:02.392 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00042567700000000001, 2024-04-19T03:03:02.392 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:02.392 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-04-19T03:03:02.392 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:02.392 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:02.392 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:02.392 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 168808 2024-04-19T03:03:02.392 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.392 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:02.393 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.393 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:02.393 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:02.375405+0000", 2024-04-19T03:03:02.393 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:02.393 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.393 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.393 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:02.393 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:02.375405+0000", 2024-04-19T03:03:02.393 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:02.393 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.393 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.393 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:02.393 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:02.375404+0000", 2024-04-19T03:03:02.393 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:03:02.394 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.394 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.394 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:02.394 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:02.375410+0000", 2024-04-19T03:03:02.394 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1210000000000003e-06 2024-04-19T03:03:02.394 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.394 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.394 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:02.394 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:02.375420+0000", 2024-04-19T03:03:02.394 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0003999999999999e-05 2024-04-19T03:03:02.394 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.394 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.394 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:02.395 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:02.375428+0000", 2024-04-19T03:03:02.395 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2199999999999992e-06 2024-04-19T03:03:02.395 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.395 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.395 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:02.395 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:02.375548+0000", 2024-04-19T03:03:02.395 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000119054 2024-04-19T03:03:02.395 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.395 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.395 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:02.395 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:02.375711+0000", 2024-04-19T03:03:02.395 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00016353599999999999 2024-04-19T03:03:02.395 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:02.395 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:02.396 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:02.396 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.396 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.396 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:168809 5.7 5.23f93597 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T03:03:02.396 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:03:02.375673+0000", 2024-04-19T03:03:02.396 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4294967295.9999967, 2024-04-19T03:03:02.396 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00019086799999999999, 2024-04-19T03:03:02.396 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:02.396 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-04-19T03:03:02.396 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:02.396 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:02.396 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:02.396 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 168809 2024-04-19T03:03:02.396 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.397 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:02.397 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.397 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:02.397 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:02.375673+0000", 2024-04-19T03:03:02.397 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:02.397 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.397 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.397 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:02.397 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:02.375673+0000", 2024-04-19T03:03:02.397 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:02.397 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.397 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.397 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:02.397 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:02.375672+0000", 2024-04-19T03:03:02.398 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:03:02.398 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.398 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.398 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:02.398 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:02.375677+0000", 2024-04-19T03:03:02.398 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0069999999999997e-06 2024-04-19T03:03:02.398 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.398 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.398 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:02.399 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:02.375685+0000", 2024-04-19T03:03:02.399 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.3450000000000006e-06 2024-04-19T03:03:02.399 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.399 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.399 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:02.399 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:02.375691+0000", 2024-04-19T03:03:02.399 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4240000000000001e-06 2024-04-19T03:03:02.399 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:02.399 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:02.399 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:02.399 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.400 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.400 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:168784 5.f 5:f086e6a1:::benchmark_data_smithi096_19531_object55334:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T03:03:02.400 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:03:02.365157+0000", 2024-04-19T03:03:02.400 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.01051207, 2024-04-19T03:03:02.400 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.010735601000000001, 2024-04-19T03:03:02.400 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:02.400 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:03:02.400 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:02.400 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:02.400 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:02.400 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 168784 2024-04-19T03:03:02.400 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.400 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:02.400 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.401 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:02.401 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:02.365157+0000", 2024-04-19T03:03:02.401 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:02.401 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.401 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.401 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:02.401 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:02.365157+0000", 2024-04-19T03:03:02.401 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:02.401 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.401 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.401 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:02.401 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:02.365156+0000", 2024-04-19T03:03:02.401 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:02.401 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.402 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.402 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:02.402 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:02.365164+0000", 2024-04-19T03:03:02.402 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5870000000000004e-06 2024-04-19T03:03:02.402 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.402 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.402 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:02.403 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:02.365172+0000", 2024-04-19T03:03:02.403 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.1880000000000002e-06 2024-04-19T03:03:02.403 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.403 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.403 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:02.403 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:02.365179+0000", 2024-04-19T03:03:02.403 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2910000000000004e-06 2024-04-19T03:03:02.403 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.403 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.403 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:02.404 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:02.367631+0000", 2024-04-19T03:03:02.404 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0024528620000000001 2024-04-19T03:03:02.404 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.404 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.404 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:02.404 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:02.367809+0000", 2024-04-19T03:03:02.404 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00017766400000000001 2024-04-19T03:03:02.404 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.404 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.404 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:03:02.404 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:02.367999+0000", 2024-04-19T03:03:02.404 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00018994500000000001 2024-04-19T03:03:02.404 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.404 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.405 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:03:02.405 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:02.370153+0000", 2024-04-19T03:03:02.405 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0021543819999999998 2024-04-19T03:03:02.405 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:02.405 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:02.405 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:02.405 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.405 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.405 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:168795 5.d 5:b340baf3:::benchmark_data_smithi096_19531_object55345:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T03:03:02.405 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:03:02.370421+0000", 2024-04-19T03:03:02.405 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0052484749999999998, 2024-04-19T03:03:02.405 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0055163190000000004, 2024-04-19T03:03:02.405 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:02.406 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:03:02.406 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:02.406 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:02.406 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:02.406 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 168795 2024-04-19T03:03:02.406 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.406 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:02.406 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.406 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:02.406 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:02.370421+0000", 2024-04-19T03:03:02.406 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:02.406 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.406 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.407 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:02.407 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:02.370421+0000", 2024-04-19T03:03:02.407 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:02.407 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.407 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.407 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:02.407 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:02.370420+0000", 2024-04-19T03:03:02.407 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:03:02.407 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.407 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.407 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:02.407 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:02.370425+0000", 2024-04-19T03:03:02.407 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3750000000000002e-06 2024-04-19T03:03:02.407 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.408 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.408 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:02.408 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:02.370439+0000", 2024-04-19T03:03:02.408 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3738e-05 2024-04-19T03:03:02.408 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.408 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.408 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:02.408 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:02.370446+0000", 2024-04-19T03:03:02.408 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7710000000000001e-06 2024-04-19T03:03:02.408 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.408 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.408 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:02.408 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:02.370521+0000", 2024-04-19T03:03:02.408 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5761999999999997e-05 2024-04-19T03:03:02.409 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.409 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.409 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:02.409 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:02.370683+0000", 2024-04-19T03:03:02.409 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00016130699999999999 2024-04-19T03:03:02.409 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.409 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.409 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:03:02.409 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:02.370787+0000", 2024-04-19T03:03:02.409 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000104009 2024-04-19T03:03:02.409 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.409 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.409 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:03:02.410 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:02.372941+0000", 2024-04-19T03:03:02.410 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0021545850000000001 2024-04-19T03:03:02.410 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:02.410 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:02.410 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:02.410 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.410 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.410 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:168797 5.7 5:eb4e3cf3:::benchmark_data_smithi096_19531_object55347:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T03:03:02.410 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:03:02.370803+0000", 2024-04-19T03:03:02.410 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0048658360000000001, 2024-04-19T03:03:02.410 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0051738979999999997, 2024-04-19T03:03:02.410 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:02.410 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-04-19T03:03:02.410 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:02.411 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:02.411 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:02.411 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 168797 2024-04-19T03:03:02.411 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.411 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:02.411 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.411 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:02.411 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:02.370803+0000", 2024-04-19T03:03:02.411 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:02.411 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.411 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.411 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:02.411 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:02.370803+0000", 2024-04-19T03:03:02.411 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:02.412 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.412 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.412 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:02.412 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:02.370802+0000", 2024-04-19T03:03:02.412 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:03:02.412 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.412 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.412 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:02.412 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:02.370807+0000", 2024-04-19T03:03:02.412 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.775e-06 2024-04-19T03:03:02.412 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.412 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.412 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:02.412 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:02.370814+0000", 2024-04-19T03:03:02.412 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.844e-06 2024-04-19T03:03:02.413 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.413 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.413 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:02.413 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:02.370821+0000", 2024-04-19T03:03:02.413 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.1210000000000001e-06 2024-04-19T03:03:02.413 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.413 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.413 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:02.413 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:02.370857+0000", 2024-04-19T03:03:02.413 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5608000000000002e-05 2024-04-19T03:03:02.413 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.413 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.413 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:02.413 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:02.370988+0000", 2024-04-19T03:03:02.413 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00013125499999999999 2024-04-19T03:03:02.414 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:02.414 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:02.414 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:02.414 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.414 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.414 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:168798 5.f 5:fdaea47e:::benchmark_data_smithi096_19531_object55348:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T03:03:02.414 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:03:02.370833+0000", 2024-04-19T03:03:02.414 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.004835944, 2024-04-19T03:03:02.414 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0051762290000000001, 2024-04-19T03:03:02.414 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:02.414 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:03:02.414 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:02.414 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:02.415 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:02.415 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 168798 2024-04-19T03:03:02.415 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.415 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:02.415 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.415 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:02.415 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:02.370833+0000", 2024-04-19T03:03:02.415 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:02.415 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.415 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.415 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:02.415 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:02.370833+0000", 2024-04-19T03:03:02.415 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:02.415 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.415 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.416 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:02.416 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:02.370833+0000", 2024-04-19T03:03:02.416 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:02.416 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.416 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.416 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:02.416 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:02.370836+0000", 2024-04-19T03:03:02.416 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.1049999999999999e-06 2024-04-19T03:03:02.416 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.416 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.416 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:02.416 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:02.370844+0000", 2024-04-19T03:03:02.416 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.1450000000000008e-06 2024-04-19T03:03:02.416 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.416 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.416 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:02.417 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:02.370850+0000", 2024-04-19T03:03:02.417 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6130000000000003e-06 2024-04-19T03:03:02.417 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.417 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.417 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:02.417 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:02.370873+0000", 2024-04-19T03:03:02.417 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.3796999999999999e-05 2024-04-19T03:03:02.417 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.417 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.417 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:02.417 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:02.370973+0000", 2024-04-19T03:03:02.417 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.9882000000000004e-05 2024-04-19T03:03:02.417 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.417 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.417 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:03:02.418 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:02.371033+0000", 2024-04-19T03:03:02.418 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9385000000000001e-05 2024-04-19T03:03:02.418 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:02.418 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:02.418 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:02.418 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:02.418 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-04-19T03:03:02.418 INFO:teuthology.orchestra.run.smithi144.stdout: "num_ops": 10 2024-04-19T03:03:02.418 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-04-19T03:03:02.419 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T03:03:02.449 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:03:02.446+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:03:02.550 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:03:02.548+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:03:02.553 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-04-19T03:03:02.553 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2024-04-19T03:03:02.553 INFO:teuthology.orchestra.run.smithi144.stdout: "complaint_time": 30, 2024-04-19T03:03:02.553 INFO:teuthology.orchestra.run.smithi144.stdout: "num_blocked_ops": 0 2024-04-19T03:03:02.553 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-04-19T03:03:02.563 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-19T03:03:02.565 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T03:03:02.650 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:03:02.646+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:03:02.696 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-04-19T03:03:02.696 INFO:teuthology.orchestra.run.smithi144.stdout: "size": 20, 2024-04-19T03:03:02.696 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 600, 2024-04-19T03:03:02.696 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [ 2024-04-19T03:03:02.696 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.696 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:78992 5.7 5:e6baa862:::benchmark_data_smithi096_19531_object78991:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-19T03:03:02.696 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:18.008888+0000", 2024-04-19T03:03:02.697 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 44.683845394000002, 2024-04-19T03:03:02.697 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.056375285999999997, 2024-04-19T03:03:02.697 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:02.697 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:02.697 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:02.697 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:02.697 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:02.697 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 78992 2024-04-19T03:03:02.697 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.697 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:02.697 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.697 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:02.697 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.008888+0000", 2024-04-19T03:03:02.697 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:02.698 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.698 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.698 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:02.698 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.008888+0000", 2024-04-19T03:03:02.698 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:02.698 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.698 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.698 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:02.698 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.008888+0000", 2024-04-19T03:03:02.698 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:02.698 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.698 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.698 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:02.699 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.008928+0000", 2024-04-19T03:03:02.699 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0361999999999997e-05 2024-04-19T03:03:02.699 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.699 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.699 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:02.699 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.008942+0000", 2024-04-19T03:03:02.699 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4365000000000001e-05 2024-04-19T03:03:02.699 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.699 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.699 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:02.699 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.008949+0000", 2024-04-19T03:03:02.699 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.212e-06 2024-04-19T03:03:02.699 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.699 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.700 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:02.700 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.012683+0000", 2024-04-19T03:03:02.700 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.003733934 2024-04-19T03:03:02.700 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.700 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.700 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:02.700 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.012798+0000", 2024-04-19T03:03:02.700 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00011574999999999999 2024-04-19T03:03:02.700 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.700 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.700 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:02.700 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.012896+0000", 2024-04-19T03:03:02.700 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.7848000000000002e-05 2024-04-19T03:03:02.700 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.700 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.701 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:03:02.701 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016423+0000", 2024-04-19T03:03:02.701 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0035270789999999998 2024-04-19T03:03:02.701 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.701 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.701 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:02.701 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.065098+0000", 2024-04-19T03:03:02.701 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.048674651999999999 2024-04-19T03:03:02.701 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.701 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.701 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:03:02.701 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.065193+0000", 2024-04-19T03:03:02.701 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.5087999999999995e-05 2024-04-19T03:03:02.701 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.702 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.702 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:02.702 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.065264+0000", 2024-04-19T03:03:02.702 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0666000000000004e-05 2024-04-19T03:03:02.702 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:02.702 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:02.702 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:02.702 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.702 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.702 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4755.0:79003 5.2 e40/39 5:4436e33f:::benchmark_data_smithi096_19531_object79002:head v 40'4935, mlcod=40'4932)", 2024-04-19T03:03:02.702 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:18.018102+0000", 2024-04-19T03:03:02.702 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 44.674631337999998, 2024-04-19T03:03:02.702 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.060023990999999999, 2024-04-19T03:03:02.703 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:02.703 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:02.703 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:02.703 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.703 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:02.703 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018102+0000", 2024-04-19T03:03:02.703 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:02.703 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.703 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.703 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:02.703 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018102+0000", 2024-04-19T03:03:02.703 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:02.703 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.703 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.704 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:02.704 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018102+0000", 2024-04-19T03:03:02.704 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:02.704 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.704 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.704 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:02.704 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018134+0000", 2024-04-19T03:03:02.704 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2722000000000003e-05 2024-04-19T03:03:02.704 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.704 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.704 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:02.704 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018145+0000", 2024-04-19T03:03:02.704 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0395e-05 2024-04-19T03:03:02.704 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.704 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.705 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:02.705 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018151+0000", 2024-04-19T03:03:02.705 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5300000000000002e-06 2024-04-19T03:03:02.705 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.705 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.705 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:02.705 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018489+0000", 2024-04-19T03:03:02.705 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00033731499999999998 2024-04-19T03:03:02.705 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.705 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.705 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:02.705 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018508+0000", 2024-04-19T03:03:02.705 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9775e-05 2024-04-19T03:03:02.705 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.705 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.706 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:03:02.706 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.078059+0000", 2024-04-19T03:03:02.706 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.059550171999999998 2024-04-19T03:03:02.706 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.706 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.706 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:02.706 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.078126+0000", 2024-04-19T03:03:02.706 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7773000000000003e-05 2024-04-19T03:03:02.706 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:02.706 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:02.706 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:02.706 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.706 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.707 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:86612 5.7 5:e32e3c49:::benchmark_data_smithi096_19531_object86611:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:02.707 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:22.633560+0000", 2024-04-19T03:03:02.707 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 40.059173678000001, 2024-04-19T03:03:02.707 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.19135289, 2024-04-19T03:03:02.707 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:02.707 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:02.707 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:02.707 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:02.707 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:02.707 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 86612 2024-04-19T03:03:02.707 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.707 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:02.707 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.707 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:02.707 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633560+0000", 2024-04-19T03:03:02.707 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:02.708 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.708 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.708 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:02.708 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633560+0000", 2024-04-19T03:03:02.708 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:02.708 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.708 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.708 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:02.708 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633558+0000", 2024-04-19T03:03:02.708 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999986 2024-04-19T03:03:02.708 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.708 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.708 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:02.708 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633609+0000", 2024-04-19T03:03:02.708 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0850999999999998e-05 2024-04-19T03:03:02.708 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.709 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.709 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:02.709 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633627+0000", 2024-04-19T03:03:02.709 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7951000000000001e-05 2024-04-19T03:03:02.709 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.709 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.709 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:02.709 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633635+0000", 2024-04-19T03:03:02.709 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2530000000000004e-06 2024-04-19T03:03:02.709 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.709 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.709 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:02.709 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633699+0000", 2024-04-19T03:03:02.709 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3901999999999999e-05 2024-04-19T03:03:02.709 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.710 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.710 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:02.710 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633992+0000", 2024-04-19T03:03:02.710 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00029283299999999999 2024-04-19T03:03:02.710 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.710 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.710 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:02.710 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.634223+0000", 2024-04-19T03:03:02.710 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00023084200000000001 2024-04-19T03:03:02.710 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.710 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.710 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:03:02.710 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.639085+0000", 2024-04-19T03:03:02.710 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0048624269999999999 2024-04-19T03:03:02.711 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.711 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.711 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:02.711 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.824635+0000", 2024-04-19T03:03:02.711 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.18554944700000001 2024-04-19T03:03:02.711 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.711 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.711 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:03:02.711 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.824793+0000", 2024-04-19T03:03:02.711 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000157959 2024-04-19T03:03:02.711 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.712 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.712 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:02.712 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.824913+0000", 2024-04-19T03:03:02.712 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000120093 2024-04-19T03:03:02.712 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:02.712 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:02.712 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:02.712 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.712 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.712 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:86625 5.7 5:e6d00488:::benchmark_data_smithi096_19531_object86624:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:02.712 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:22.643554+0000", 2024-04-19T03:03:02.712 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 40.049179912, 2024-04-19T03:03:02.712 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.18732841, 2024-04-19T03:03:02.712 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:02.713 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:02.713 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:02.713 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:02.713 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:02.713 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 86625 2024-04-19T03:03:02.713 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.713 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:02.713 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.713 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:02.713 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643554+0000", 2024-04-19T03:03:02.713 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:02.713 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.713 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.713 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:02.713 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643554+0000", 2024-04-19T03:03:02.714 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:02.714 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.714 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.714 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:02.714 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643552+0000", 2024-04-19T03:03:02.714 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999986 2024-04-19T03:03:02.714 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.714 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.714 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:02.714 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643588+0000", 2024-04-19T03:03:02.714 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5855999999999997e-05 2024-04-19T03:03:02.714 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.714 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.715 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:02.715 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643606+0000", 2024-04-19T03:03:02.715 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8226000000000001e-05 2024-04-19T03:03:02.715 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.715 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.715 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:02.715 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643618+0000", 2024-04-19T03:03:02.715 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1868000000000001e-05 2024-04-19T03:03:02.715 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.715 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.715 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:02.715 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643676+0000", 2024-04-19T03:03:02.715 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8153999999999999e-05 2024-04-19T03:03:02.715 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.715 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.716 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:02.716 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643905+0000", 2024-04-19T03:03:02.716 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00022847500000000001 2024-04-19T03:03:02.716 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.716 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.716 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:02.716 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.644150+0000", 2024-04-19T03:03:02.716 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00024531800000000001 2024-04-19T03:03:02.716 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.716 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.716 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:03:02.716 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.647407+0000", 2024-04-19T03:03:02.716 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0032563190000000001 2024-04-19T03:03:02.717 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.717 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.717 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:02.717 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.830721+0000", 2024-04-19T03:03:02.717 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.18331468300000001 2024-04-19T03:03:02.717 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.717 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.717 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:03:02.717 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.830813+0000", 2024-04-19T03:03:02.717 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.2205000000000002e-05 2024-04-19T03:03:02.717 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.717 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.717 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:02.717 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.830882+0000", 2024-04-19T03:03:02.717 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8819999999999995e-05 2024-04-19T03:03:02.718 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:02.718 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:02.718 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:02.718 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.718 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.718 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87063 5.7 5:e502e824:::benchmark_data_smithi096_19531_object87062:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:02.718 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.136067+0000", 2024-04-19T03:03:02.718 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 39.556667042999997, 2024-04-19T03:03:02.718 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.065521159999999995, 2024-04-19T03:03:02.718 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:02.718 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:02.718 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:02.718 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:02.718 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:02.719 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87063 2024-04-19T03:03:02.719 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.719 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:02.719 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.719 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:02.719 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.136067+0000", 2024-04-19T03:03:02.719 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:02.719 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.719 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.719 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:02.719 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.136067+0000", 2024-04-19T03:03:02.719 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:02.719 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.719 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.719 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:02.720 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.136066+0000", 2024-04-19T03:03:02.720 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:03:02.720 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.720 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.720 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:02.720 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.136154+0000", 2024-04-19T03:03:02.720 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.8256000000000003e-05 2024-04-19T03:03:02.720 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.720 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.720 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:02.720 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.136162+0000", 2024-04-19T03:03:02.720 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.5099999999999998e-06 2024-04-19T03:03:02.720 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.720 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.720 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:02.721 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.136171+0000", 2024-04-19T03:03:02.721 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2830000000000001e-06 2024-04-19T03:03:02.721 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.721 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.721 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:02.721 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.138421+0000", 2024-04-19T03:03:02.721 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0022506620000000001 2024-04-19T03:03:02.721 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.721 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.721 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:02.721 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.138560+0000", 2024-04-19T03:03:02.721 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000138446 2024-04-19T03:03:02.721 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.721 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.721 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:02.721 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.138689+0000", 2024-04-19T03:03:02.722 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00012950700000000001 2024-04-19T03:03:02.722 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.722 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.722 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:03:02.722 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.141517+0000", 2024-04-19T03:03:02.722 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0028280860000000001 2024-04-19T03:03:02.722 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.722 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.722 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:02.722 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.201350+0000", 2024-04-19T03:03:02.722 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.059832418999999998 2024-04-19T03:03:02.722 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.722 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.723 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:03:02.723 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.201485+0000", 2024-04-19T03:03:02.723 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000135597 2024-04-19T03:03:02.723 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.723 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.723 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:02.723 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.201588+0000", 2024-04-19T03:03:02.723 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00010247900000000001 2024-04-19T03:03:02.723 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:02.723 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:02.723 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:02.723 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.723 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.723 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87072 5.7 5:e3c7809a:::benchmark_data_smithi096_19531_object87071:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:02.724 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.144224+0000", 2024-04-19T03:03:02.724 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 39.548510018999998, 2024-04-19T03:03:02.724 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.058179555000000001, 2024-04-19T03:03:02.724 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:02.724 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:02.724 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:02.724 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:02.724 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:02.724 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87072 2024-04-19T03:03:02.724 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.724 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:02.724 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.724 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:02.724 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144224+0000", 2024-04-19T03:03:02.725 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:02.725 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.725 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.725 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:02.725 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144224+0000", 2024-04-19T03:03:02.725 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:02.725 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.725 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.725 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:02.725 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144223+0000", 2024-04-19T03:03:02.725 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:03:02.725 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.725 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.725 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:02.725 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144320+0000", 2024-04-19T03:03:02.726 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.7075000000000001e-05 2024-04-19T03:03:02.726 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.726 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.726 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:02.726 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144331+0000", 2024-04-19T03:03:02.726 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1342000000000001e-05 2024-04-19T03:03:02.726 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.726 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.726 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:02.726 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144337+0000", 2024-04-19T03:03:02.726 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8390000000000003e-06 2024-04-19T03:03:02.726 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.726 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.727 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:02.727 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144369+0000", 2024-04-19T03:03:02.727 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2079000000000002e-05 2024-04-19T03:03:02.727 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.727 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.727 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:02.727 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144464+0000", 2024-04-19T03:03:02.727 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.4623000000000005e-05 2024-04-19T03:03:02.727 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.727 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.727 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:02.727 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144553+0000", 2024-04-19T03:03:02.727 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9171000000000004e-05 2024-04-19T03:03:02.728 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.728 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.728 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:03:02.728 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.147018+0000", 2024-04-19T03:03:02.728 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0024648370000000001 2024-04-19T03:03:02.728 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.728 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.728 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:02.728 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.202270+0000", 2024-04-19T03:03:02.728 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.055252018 2024-04-19T03:03:02.728 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.728 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.728 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:03:02.728 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.202356+0000", 2024-04-19T03:03:02.728 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6648000000000001e-05 2024-04-19T03:03:02.729 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.729 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.729 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:02.729 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.202403+0000", 2024-04-19T03:03:02.729 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6956999999999998e-05 2024-04-19T03:03:02.729 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:02.729 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:02.729 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:02.729 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.729 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.729 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87123 5.6 5:6d1bc3b9:::benchmark_data_smithi096_19531_object87122:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:03:02.729 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249233+0000", 2024-04-19T03:03:02.729 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 39.443500987, 2024-04-19T03:03:02.730 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0291700720000001, 2024-04-19T03:03:02.730 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:02.730 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-04-19T03:03:02.730 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:02.730 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:02.730 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:02.730 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87123 2024-04-19T03:03:02.730 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.730 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:02.730 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.730 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:02.730 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249233+0000", 2024-04-19T03:03:02.730 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:02.731 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.731 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.731 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:02.731 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249233+0000", 2024-04-19T03:03:02.731 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:02.731 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.731 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.731 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:02.731 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249231+0000", 2024-04-19T03:03:02.731 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999986 2024-04-19T03:03:02.731 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.731 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.731 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:02.731 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249285+0000", 2024-04-19T03:03:02.732 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4005000000000002e-05 2024-04-19T03:03:02.732 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.732 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.732 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:02.732 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249300+0000", 2024-04-19T03:03:02.732 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4715999999999999e-05 2024-04-19T03:03:02.732 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.732 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.732 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:02.732 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249307+0000", 2024-04-19T03:03:02.732 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8399999999999997e-06 2024-04-19T03:03:02.732 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.732 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.732 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:02.733 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249366+0000", 2024-04-19T03:03:02.733 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9435999999999998e-05 2024-04-19T03:03:02.733 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.733 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.733 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op must wait for map", 2024-04-19T03:03:02.733 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249376+0000", 2024-04-19T03:03:02.733 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.4919999999999999e-06 2024-04-19T03:03:02.733 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.733 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.733 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:02.733 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263757+0000", 2024-04-19T03:03:02.733 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.014381461999999999 2024-04-19T03:03:02.733 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.733 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.733 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:03:02.734 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263875+0000", 2024-04-19T03:03:02.734 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000117166 2024-04-19T03:03:02.734 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.734 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.734 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:02.734 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.277136+0000", 2024-04-19T03:03:02.734 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.013261207 2024-04-19T03:03:02.734 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.734 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.734 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:02.734 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.278403+0000", 2024-04-19T03:03:02.734 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001267106 2024-04-19T03:03:02.734 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:02.735 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:02.735 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:02.735 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.735 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.735 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87128 5.6 5:6905c420:::benchmark_data_smithi096_19531_object87127:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:03:02.735 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249323+0000", 2024-04-19T03:03:02.735 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 39.443410239999999, 2024-04-19T03:03:02.735 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0292813249999999, 2024-04-19T03:03:02.735 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:02.735 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-04-19T03:03:02.735 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:02.735 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:02.735 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:02.735 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87128 2024-04-19T03:03:02.736 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.736 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:02.736 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.736 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:02.736 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249323+0000", 2024-04-19T03:03:02.736 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:02.736 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.736 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.736 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:02.736 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249323+0000", 2024-04-19T03:03:02.736 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:02.736 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.736 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.737 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:02.737 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249323+0000", 2024-04-19T03:03:02.737 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:02.737 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.737 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.737 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:02.737 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249385+0000", 2024-04-19T03:03:02.737 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1711999999999995e-05 2024-04-19T03:03:02.737 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.737 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.737 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:02.737 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249398+0000", 2024-04-19T03:03:02.737 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3022e-05 2024-04-19T03:03:02.737 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.738 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.738 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:02.738 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249402+0000", 2024-04-19T03:03:02.738 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4819999999999996e-06 2024-04-19T03:03:02.738 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.738 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.738 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:02.738 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249437+0000", 2024-04-19T03:03:02.738 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4702000000000001e-05 2024-04-19T03:03:02.738 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.738 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.738 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:03:02.738 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249442+0000", 2024-04-19T03:03:02.739 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8019999999999999e-06 2024-04-19T03:03:02.739 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.739 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.739 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:02.739 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263896+0000", 2024-04-19T03:03:02.739 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.014454679999999999 2024-04-19T03:03:02.739 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.739 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.739 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:03:02.739 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263900+0000", 2024-04-19T03:03:02.739 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9700000000000001e-06 2024-04-19T03:03:02.739 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.739 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.739 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:02.739 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.278557+0000", 2024-04-19T03:03:02.740 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0146566480000001 2024-04-19T03:03:02.740 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.740 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.740 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:02.740 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.278605+0000", 2024-04-19T03:03:02.740 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7735999999999998e-05 2024-04-19T03:03:02.740 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:02.740 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:02.740 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:02.740 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.740 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.740 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87130 5.3 5:c8c2d67b:::benchmark_data_smithi096_19531_object87129:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:03:02.740 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249418+0000", 2024-04-19T03:03:02.740 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 39.443315529000003, 2024-04-19T03:03:02.740 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.025414182, 2024-04-19T03:03:02.741 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:02.741 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-04-19T03:03:02.741 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:02.741 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:02.741 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:02.741 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87130 2024-04-19T03:03:02.741 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.741 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:02.741 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.741 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:02.741 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249418+0000", 2024-04-19T03:03:02.741 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:02.741 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.741 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.742 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:02.742 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249418+0000", 2024-04-19T03:03:02.742 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:02.742 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.742 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.742 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:02.742 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249409+0000", 2024-04-19T03:03:02.742 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999905 2024-04-19T03:03:02.742 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.742 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.742 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:02.742 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249464+0000", 2024-04-19T03:03:02.742 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5381999999999999e-05 2024-04-19T03:03:02.742 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.743 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.743 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:02.743 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249471+0000", 2024-04-19T03:03:02.743 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2609999999999996e-06 2024-04-19T03:03:02.743 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.743 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.743 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:02.743 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249475+0000", 2024-04-19T03:03:02.743 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2839999999999998e-06 2024-04-19T03:03:02.743 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.743 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.743 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:02.743 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249535+0000", 2024-04-19T03:03:02.743 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0545999999999999e-05 2024-04-19T03:03:02.743 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.743 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.744 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op must wait for map", 2024-04-19T03:03:02.744 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249540+0000", 2024-04-19T03:03:02.744 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2859999999999999e-06 2024-04-19T03:03:02.744 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.744 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.744 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:02.744 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263450+0000", 2024-04-19T03:03:02.744 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.013909585 2024-04-19T03:03:02.744 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.744 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.744 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:03:02.744 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263458+0000", 2024-04-19T03:03:02.744 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8089999999999993e-06 2024-04-19T03:03:02.744 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.745 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.745 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:02.745 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.273193+0000", 2024-04-19T03:03:02.745 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0097351379999999 2024-04-19T03:03:02.745 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.745 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.745 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:02.745 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.274832+0000", 2024-04-19T03:03:02.745 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0016394789999999999 2024-04-19T03:03:02.745 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:02.745 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:02.745 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:02.745 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.745 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.745 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87131 5.1 5:83756d55:::benchmark_data_smithi096_19531_object87130:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:03:02.746 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249491+0000", 2024-04-19T03:03:02.746 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 39.443242882, 2024-04-19T03:03:02.746 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0191489520000001, 2024-04-19T03:03:02.746 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:02.746 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-04-19T03:03:02.746 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:02.746 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:02.746 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:02.746 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87131 2024-04-19T03:03:02.746 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.746 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:02.746 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.746 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:02.746 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249491+0000", 2024-04-19T03:03:02.747 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:02.747 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.747 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.747 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:02.747 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249491+0000", 2024-04-19T03:03:02.747 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:02.747 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.747 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.747 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:02.747 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249491+0000", 2024-04-19T03:03:02.747 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:02.747 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.747 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.747 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:02.747 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249530+0000", 2024-04-19T03:03:02.747 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9589000000000003e-05 2024-04-19T03:03:02.748 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.748 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.748 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:02.748 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249544+0000", 2024-04-19T03:03:02.748 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4158000000000001e-05 2024-04-19T03:03:02.748 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.748 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.748 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:02.748 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249549+0000", 2024-04-19T03:03:02.748 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6809999999999997e-06 2024-04-19T03:03:02.748 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.748 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.748 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:02.748 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249592+0000", 2024-04-19T03:03:02.748 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3285999999999999e-05 2024-04-19T03:03:02.749 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.749 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.749 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op must wait for map", 2024-04-19T03:03:02.749 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249598+0000", 2024-04-19T03:03:02.749 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8329999999999999e-06 2024-04-19T03:03:02.749 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.749 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.749 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:02.749 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263331+0000", 2024-04-19T03:03:02.749 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.013733093 2024-04-19T03:03:02.749 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.749 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.749 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:03:02.749 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263343+0000", 2024-04-19T03:03:02.750 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.189e-05 2024-04-19T03:03:02.750 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.750 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.750 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:02.750 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.268541+0000", 2024-04-19T03:03:02.750 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0051983440000001 2024-04-19T03:03:02.750 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.750 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.750 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:02.750 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.268640+0000", 2024-04-19T03:03:02.750 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.8387999999999994e-05 2024-04-19T03:03:02.750 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:02.750 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:02.750 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:02.751 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.751 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.751 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87132 5.c 5:3e18b732:::benchmark_data_smithi096_19531_object87131:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:03:02.751 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249558+0000", 2024-04-19T03:03:02.751 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 39.443175981000003, 2024-04-19T03:03:02.751 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0241198380000001, 2024-04-19T03:03:02.751 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:02.751 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-04-19T03:03:02.751 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:02.751 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:02.751 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:02.751 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87132 2024-04-19T03:03:02.751 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.751 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:02.752 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.752 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:02.752 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249558+0000", 2024-04-19T03:03:02.752 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:02.752 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.752 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.752 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:02.752 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249558+0000", 2024-04-19T03:03:02.752 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:02.752 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.752 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.752 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:02.752 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249557+0000", 2024-04-19T03:03:02.752 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:02.753 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.753 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.753 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:02.753 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249625+0000", 2024-04-19T03:03:02.753 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7200999999999996e-05 2024-04-19T03:03:02.753 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.753 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.753 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:02.753 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249646+0000", 2024-04-19T03:03:02.753 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1053e-05 2024-04-19T03:03:02.753 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.753 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.753 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:02.753 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249650+0000", 2024-04-19T03:03:02.753 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2719999999999999e-06 2024-04-19T03:03:02.754 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.754 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.754 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:02.754 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249686+0000", 2024-04-19T03:03:02.754 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6430000000000002e-05 2024-04-19T03:03:02.754 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.754 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.754 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op must wait for map", 2024-04-19T03:03:02.754 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249690+0000", 2024-04-19T03:03:02.754 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.765e-06 2024-04-19T03:03:02.754 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.754 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.754 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:02.754 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261157+0000", 2024-04-19T03:03:02.755 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011467247999999999 2024-04-19T03:03:02.755 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.755 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.755 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:03:02.755 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261170+0000", 2024-04-19T03:03:02.755 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2833000000000001e-05 2024-04-19T03:03:02.755 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.755 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.755 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:02.755 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.272119+0000", 2024-04-19T03:03:02.755 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.010949313 2024-04-19T03:03:02.755 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.755 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.755 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:02.755 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.273678+0000", 2024-04-19T03:03:02.756 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0015581550000000001 2024-04-19T03:03:02.756 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:02.756 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:02.756 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:02.756 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.756 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.756 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87133 5.c 5:3f772a62:::benchmark_data_smithi096_19531_object87132:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:03:02.756 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249657+0000", 2024-04-19T03:03:02.756 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 39.443076601999998, 2024-04-19T03:03:02.756 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0242819409999999, 2024-04-19T03:03:02.756 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:02.756 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-04-19T03:03:02.756 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:02.756 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:02.757 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:02.757 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87133 2024-04-19T03:03:02.757 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.757 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:02.757 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.757 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:02.757 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249657+0000", 2024-04-19T03:03:02.757 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:02.757 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.757 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.757 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:02.757 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249657+0000", 2024-04-19T03:03:02.757 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:02.757 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.757 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.757 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:02.757 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249657+0000", 2024-04-19T03:03:02.758 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:02.758 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.758 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.758 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:02.758 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249690+0000", 2024-04-19T03:03:02.758 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3343000000000002e-05 2024-04-19T03:03:02.758 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.758 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.758 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:02.758 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249695+0000", 2024-04-19T03:03:02.758 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8600000000000001e-06 2024-04-19T03:03:02.758 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.758 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.759 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:02.759 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249698+0000", 2024-04-19T03:03:02.759 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.1700000000000001e-06 2024-04-19T03:03:02.759 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.759 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.759 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:02.759 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249741+0000", 2024-04-19T03:03:02.759 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2849999999999998e-05 2024-04-19T03:03:02.759 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.759 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.759 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:03:02.759 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249746+0000", 2024-04-19T03:03:02.759 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1019999999999996e-06 2024-04-19T03:03:02.759 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.760 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.760 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:02.760 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261209+0000", 2024-04-19T03:03:02.760 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011462447000000001 2024-04-19T03:03:02.760 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.760 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.760 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:03:02.760 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261216+0000", 2024-04-19T03:03:02.760 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8520000000000004e-06 2024-04-19T03:03:02.760 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.760 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.760 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:02.760 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.273872+0000", 2024-04-19T03:03:02.760 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0126558000000001 2024-04-19T03:03:02.760 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.761 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.761 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:02.761 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.273939+0000", 2024-04-19T03:03:02.761 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6822000000000005e-05 2024-04-19T03:03:02.761 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:02.761 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:02.761 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:02.761 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.761 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.761 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87134 5.5 5:a56c478f:::benchmark_data_smithi096_19531_object87133:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:03:02.761 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249708+0000", 2024-04-19T03:03:02.761 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 39.443025677999998, 2024-04-19T03:03:02.761 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0214677299999999, 2024-04-19T03:03:02.761 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:02.761 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-04-19T03:03:02.762 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:02.762 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:02.762 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:02.762 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87134 2024-04-19T03:03:02.762 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.762 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:02.762 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.762 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:02.762 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249708+0000", 2024-04-19T03:03:02.762 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:02.762 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.762 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.762 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:02.763 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249708+0000", 2024-04-19T03:03:02.763 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:02.763 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.763 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.763 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:02.763 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249706+0000", 2024-04-19T03:03:02.763 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999976 2024-04-19T03:03:02.763 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.763 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.763 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:02.763 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249740+0000", 2024-04-19T03:03:02.763 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4458000000000001e-05 2024-04-19T03:03:02.763 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.763 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.763 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:02.764 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249745+0000", 2024-04-19T03:03:02.764 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5020000000000003e-06 2024-04-19T03:03:02.764 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.764 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.764 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:02.764 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249748+0000", 2024-04-19T03:03:02.764 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2499999999999998e-06 2024-04-19T03:03:02.764 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.764 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.764 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:02.764 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249778+0000", 2024-04-19T03:03:02.764 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.006e-05 2024-04-19T03:03:02.764 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.764 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.765 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op must wait for map", 2024-04-19T03:03:02.765 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249782+0000", 2024-04-19T03:03:02.765 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2910000000000001e-06 2024-04-19T03:03:02.765 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.765 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.765 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:02.765 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261666+0000", 2024-04-19T03:03:02.765 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011883471 2024-04-19T03:03:02.765 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.765 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.765 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:03:02.765 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261674+0000", 2024-04-19T03:03:02.765 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6479999999999992e-06 2024-04-19T03:03:02.765 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.766 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.766 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:02.766 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.269323+0000", 2024-04-19T03:03:02.766 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.00764867 2024-04-19T03:03:02.766 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.766 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.766 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:02.766 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.271176+0000", 2024-04-19T03:03:02.766 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001852844 2024-04-19T03:03:02.766 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:02.766 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:02.766 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:02.766 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.766 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.767 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87137 5.c 5:30708c68:::benchmark_data_smithi096_19531_object87136:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:03:02.767 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249756+0000", 2024-04-19T03:03:02.767 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 39.442977972000001, 2024-04-19T03:03:02.767 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.033331752, 2024-04-19T03:03:02.767 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:02.767 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:02.767 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:02.767 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:02.767 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:02.767 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87137 2024-04-19T03:03:02.767 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.767 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:02.767 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.768 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:02.768 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249756+0000", 2024-04-19T03:03:02.768 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:02.768 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.768 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.768 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:02.768 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249756+0000", 2024-04-19T03:03:02.768 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:02.768 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.768 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.768 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:02.768 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249755+0000", 2024-04-19T03:03:02.768 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:02.768 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.768 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.769 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:02.769 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249777+0000", 2024-04-19T03:03:02.769 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1420000000000002e-05 2024-04-19T03:03:02.769 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.769 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.769 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:02.769 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249781+0000", 2024-04-19T03:03:02.769 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0609999999999997e-06 2024-04-19T03:03:02.769 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.769 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.769 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:02.769 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249787+0000", 2024-04-19T03:03:02.769 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.02e-06 2024-04-19T03:03:02.769 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.770 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.770 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:02.770 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249818+0000", 2024-04-19T03:03:02.770 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0947e-05 2024-04-19T03:03:02.770 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.770 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.770 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:03:02.770 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249821+0000", 2024-04-19T03:03:02.770 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.117e-06 2024-04-19T03:03:02.770 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.770 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.770 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:02.770 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261243+0000", 2024-04-19T03:03:02.770 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011421875999999999 2024-04-19T03:03:02.770 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.771 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.771 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:03:02.771 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261251+0000", 2024-04-19T03:03:02.771 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6120000000000001e-06 2024-04-19T03:03:02.771 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.771 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.771 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:02.771 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.274050+0000", 2024-04-19T03:03:02.771 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.012799405 2024-04-19T03:03:02.771 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.771 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.771 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:02.771 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.274529+0000", 2024-04-19T03:03:02.771 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00047867100000000001 2024-04-19T03:03:02.772 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.772 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.772 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:03:02.772 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.282972+0000", 2024-04-19T03:03:02.772 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0084436900000000002 2024-04-19T03:03:02.772 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.772 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.772 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:03:02.772 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.283022+0000", 2024-04-19T03:03:02.772 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9339000000000003e-05 2024-04-19T03:03:02.772 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.772 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.772 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:02.772 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.283088+0000", 2024-04-19T03:03:02.772 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5877999999999995e-05 2024-04-19T03:03:02.773 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:02.773 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:02.773 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:02.773 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.773 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.773 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:158376 5.9 5:9e73c076:::benchmark_data_smithi096_19531_object44926:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-19T03:03:02.773 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:58.126227+0000", 2024-04-19T03:03:02.773 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4.5665062389999997, 2024-04-19T03:03:02.773 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.069738668000000004, 2024-04-19T03:03:02.773 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:02.773 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:02.773 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:02.773 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:02.773 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:02.773 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 158376 2024-04-19T03:03:02.774 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.774 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:02.774 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.774 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:02.774 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.126227+0000", 2024-04-19T03:03:02.774 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:02.774 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.774 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.774 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:02.774 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.126227+0000", 2024-04-19T03:03:02.774 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:02.774 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.774 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.774 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:02.775 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.126226+0000", 2024-04-19T03:03:02.775 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:03:02.775 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.775 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.775 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:02.775 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.126236+0000", 2024-04-19T03:03:02.775 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.4199999999999996e-06 2024-04-19T03:03:02.775 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.775 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.775 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:02.775 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.126243+0000", 2024-04-19T03:03:02.775 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.199e-06 2024-04-19T03:03:02.775 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.776 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.776 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:02.776 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.126248+0000", 2024-04-19T03:03:02.776 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1320000000000002e-06 2024-04-19T03:03:02.776 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.776 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.776 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:02.776 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.126286+0000", 2024-04-19T03:03:02.776 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7401000000000003e-05 2024-04-19T03:03:02.776 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.776 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.776 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:02.776 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.126368+0000", 2024-04-19T03:03:02.776 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2113999999999993e-05 2024-04-19T03:03:02.777 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.777 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.777 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:03:02.777 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.126438+0000", 2024-04-19T03:03:02.777 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0337000000000001e-05 2024-04-19T03:03:02.777 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.777 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.777 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:03:02.777 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.130816+0000", 2024-04-19T03:03:02.777 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0043778330000000002 2024-04-19T03:03:02.777 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.777 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.777 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:02.777 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.195830+0000", 2024-04-19T03:03:02.778 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.065013933999999995 2024-04-19T03:03:02.778 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.778 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.778 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:03:02.778 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.195907+0000", 2024-04-19T03:03:02.778 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7397000000000005e-05 2024-04-19T03:03:02.778 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.778 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.778 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:02.778 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.195966+0000", 2024-04-19T03:03:02.778 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8906999999999997e-05 2024-04-19T03:03:02.778 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:02.778 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:02.778 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:02.779 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.779 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.779 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:158381 5.9 5:94dcd4a7:::benchmark_data_smithi096_19531_object44931:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-19T03:03:02.779 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:58.128712+0000", 2024-04-19T03:03:02.779 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4.5640217960000005, 2024-04-19T03:03:02.779 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.067497527000000002, 2024-04-19T03:03:02.779 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:02.779 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:02.779 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:02.779 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:02.779 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:02.779 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 158381 2024-04-19T03:03:02.779 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.779 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:02.780 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.780 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:02.780 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.128712+0000", 2024-04-19T03:03:02.780 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:02.780 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.780 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.780 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:02.780 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.128712+0000", 2024-04-19T03:03:02.780 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:02.780 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.780 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.780 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:02.780 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.128711+0000", 2024-04-19T03:03:02.780 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:03:02.781 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.781 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.781 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:02.781 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.128716+0000", 2024-04-19T03:03:02.781 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0610000000000003e-06 2024-04-19T03:03:02.781 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.781 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.781 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:02.781 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.128724+0000", 2024-04-19T03:03:02.781 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0120000000000005e-06 2024-04-19T03:03:02.781 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.781 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.781 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:02.781 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.128729+0000", 2024-04-19T03:03:02.781 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8899999999999998e-06 2024-04-19T03:03:02.782 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.782 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.782 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:02.782 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.128778+0000", 2024-04-19T03:03:02.782 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9110000000000002e-05 2024-04-19T03:03:02.782 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.782 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.782 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:02.782 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.128903+0000", 2024-04-19T03:03:02.782 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00012506799999999999 2024-04-19T03:03:02.782 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.782 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.782 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:03:02.782 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.129022+0000", 2024-04-19T03:03:02.783 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00011923599999999999 2024-04-19T03:03:02.783 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.783 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.783 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:03:02.783 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.132294+0000", 2024-04-19T03:03:02.783 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.003271244 2024-04-19T03:03:02.783 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.783 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.783 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:02.783 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.196045+0000", 2024-04-19T03:03:02.783 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.063751206000000005 2024-04-19T03:03:02.783 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.783 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.783 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:03:02.783 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.196133+0000", 2024-04-19T03:03:02.784 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.8213000000000004e-05 2024-04-19T03:03:02.784 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.784 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.784 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:02.784 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.196209+0000", 2024-04-19T03:03:02.784 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6335999999999996e-05 2024-04-19T03:03:02.784 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:02.784 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:02.784 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:02.784 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.784 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.784 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:158385 5.9 5:950ec749:::benchmark_data_smithi096_19531_object44935:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-19T03:03:02.784 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:58.129756+0000", 2024-04-19T03:03:02.784 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4.5629778640000005, 2024-04-19T03:03:02.784 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.068998382999999996, 2024-04-19T03:03:02.785 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:02.785 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:02.785 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:02.785 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:02.785 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:02.785 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 158385 2024-04-19T03:03:02.785 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.785 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:02.785 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.785 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:02.785 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.129756+0000", 2024-04-19T03:03:02.785 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:02.785 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.785 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.785 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:02.786 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.129756+0000", 2024-04-19T03:03:02.786 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:02.786 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.786 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.786 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:02.786 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.129755+0000", 2024-04-19T03:03:02.786 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:03:02.786 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.786 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.786 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:02.786 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.129760+0000", 2024-04-19T03:03:02.786 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6030000000000004e-06 2024-04-19T03:03:02.786 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.786 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.786 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:02.787 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.129774+0000", 2024-04-19T03:03:02.787 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3131e-05 2024-04-19T03:03:02.787 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.787 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.787 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:02.787 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.129781+0000", 2024-04-19T03:03:02.787 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4030000000000001e-06 2024-04-19T03:03:02.787 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.787 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.787 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:02.787 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.130837+0000", 2024-04-19T03:03:02.787 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00105569 2024-04-19T03:03:02.787 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.787 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.787 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:02.788 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.130917+0000", 2024-04-19T03:03:02.788 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9929e-05 2024-04-19T03:03:02.788 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.788 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.788 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:03:02.788 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.130973+0000", 2024-04-19T03:03:02.788 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.664e-05 2024-04-19T03:03:02.788 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.788 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.788 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:03:02.788 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.132340+0000", 2024-04-19T03:03:02.788 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001366321 2024-04-19T03:03:02.788 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.788 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.788 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:02.789 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.198637+0000", 2024-04-19T03:03:02.789 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.066296888999999998 2024-04-19T03:03:02.789 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.789 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.789 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:03:02.789 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.198704+0000", 2024-04-19T03:03:02.789 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7333000000000001e-05 2024-04-19T03:03:02.789 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.789 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.789 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:02.789 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.198754+0000", 2024-04-19T03:03:02.789 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0421999999999999e-05 2024-04-19T03:03:02.789 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:02.790 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:02.790 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:02.790 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.790 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.790 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:158387 5.9 5:9e96f619:::benchmark_data_smithi096_19531_object44937:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-19T03:03:02.790 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:58.132457+0000", 2024-04-19T03:03:02.790 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4.5602762999999999, 2024-04-19T03:03:02.790 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.066858091999999994, 2024-04-19T03:03:02.790 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:02.790 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:02.790 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:02.790 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:02.790 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:02.790 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 158387 2024-04-19T03:03:02.790 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.791 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:02.791 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.791 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:02.791 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.132457+0000", 2024-04-19T03:03:02.791 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:02.791 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.791 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.791 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:02.791 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.132457+0000", 2024-04-19T03:03:02.791 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:02.791 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.791 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.791 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:02.791 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.132457+0000", 2024-04-19T03:03:02.792 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:02.792 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.792 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.792 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:02.792 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.132460+0000", 2024-04-19T03:03:02.792 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.1949999999999999e-06 2024-04-19T03:03:02.792 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.792 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.792 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:02.792 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.132468+0000", 2024-04-19T03:03:02.792 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.1599999999999998e-06 2024-04-19T03:03:02.792 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.792 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.792 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:02.793 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.132473+0000", 2024-04-19T03:03:02.793 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9259999999999999e-06 2024-04-19T03:03:02.793 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.793 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.793 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:02.793 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.132504+0000", 2024-04-19T03:03:02.793 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0914000000000003e-05 2024-04-19T03:03:02.793 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.793 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.793 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:02.793 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.132646+0000", 2024-04-19T03:03:02.793 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00014214300000000001 2024-04-19T03:03:02.793 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.793 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.794 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:03:02.794 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.132741+0000", 2024-04-19T03:03:02.794 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.4344000000000003e-05 2024-04-19T03:03:02.794 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.794 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.794 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:03:02.794 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.135774+0000", 2024-04-19T03:03:02.794 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0030334960000000001 2024-04-19T03:03:02.794 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.794 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.794 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:02.794 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.199240+0000", 2024-04-19T03:03:02.794 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.063465695000000003 2024-04-19T03:03:02.794 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.795 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.795 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:03:02.795 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.199272+0000", 2024-04-19T03:03:02.795 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2412000000000001e-05 2024-04-19T03:03:02.795 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.795 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.795 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:02.795 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.199316+0000", 2024-04-19T03:03:02.795 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3275000000000002e-05 2024-04-19T03:03:02.795 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:02.795 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:02.795 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:02.795 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.795 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.795 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:158392 5.f 5:f462725f:::benchmark_data_smithi096_19531_object44942:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-19T03:03:02.796 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:58.135703+0000", 2024-04-19T03:03:02.796 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4.5570305199999996, 2024-04-19T03:03:02.796 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.063132879000000003, 2024-04-19T03:03:02.796 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:02.796 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:02.796 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:02.796 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:02.796 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:02.796 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 158392 2024-04-19T03:03:02.796 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.796 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:02.796 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.796 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:02.796 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.135703+0000", 2024-04-19T03:03:02.796 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:02.797 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.797 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.797 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:02.797 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.135703+0000", 2024-04-19T03:03:02.797 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:02.797 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.797 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.797 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:02.797 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.135702+0000", 2024-04-19T03:03:02.797 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:03:02.797 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.797 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.797 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:02.797 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.135708+0000", 2024-04-19T03:03:02.798 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8270000000000003e-06 2024-04-19T03:03:02.798 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.798 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.798 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:02.798 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.135720+0000", 2024-04-19T03:03:02.798 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2057e-05 2024-04-19T03:03:02.798 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.798 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.798 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:02.798 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.135727+0000", 2024-04-19T03:03:02.798 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8090000000000004e-06 2024-04-19T03:03:02.798 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.798 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.798 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:02.798 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.135768+0000", 2024-04-19T03:03:02.799 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1548999999999998e-05 2024-04-19T03:03:02.799 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.799 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.799 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:02.799 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.135853+0000", 2024-04-19T03:03:02.799 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4845000000000005e-05 2024-04-19T03:03:02.799 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.799 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.799 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:03:02.799 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.135934+0000", 2024-04-19T03:03:02.799 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0315000000000006e-05 2024-04-19T03:03:02.799 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.799 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.799 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:03:02.799 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.138685+0000", 2024-04-19T03:03:02.800 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.002751042 2024-04-19T03:03:02.800 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.800 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.800 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:02.800 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.198747+0000", 2024-04-19T03:03:02.800 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.060062675000000003 2024-04-19T03:03:02.800 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.800 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.800 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:03:02.800 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.198802+0000", 2024-04-19T03:03:02.800 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4469000000000003e-05 2024-04-19T03:03:02.800 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.800 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.800 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:02.800 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.198836+0000", 2024-04-19T03:03:02.801 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4272e-05 2024-04-19T03:03:02.801 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:02.801 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:02.801 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:02.801 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.801 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.801 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:158397 5.d 5:b5d962e9:::benchmark_data_smithi096_19531_object44947:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-19T03:03:02.801 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:58.138717+0000", 2024-04-19T03:03:02.801 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4.5540165769999996, 2024-04-19T03:03:02.801 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.057191467000000003, 2024-04-19T03:03:02.801 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:02.801 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:02.801 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:02.801 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:02.802 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:02.802 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 158397 2024-04-19T03:03:02.802 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.802 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:02.802 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.802 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:02.802 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.138717+0000", 2024-04-19T03:03:02.802 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:02.802 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.802 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.802 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:02.802 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.138717+0000", 2024-04-19T03:03:02.802 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:02.802 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.803 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.803 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:02.803 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.138716+0000", 2024-04-19T03:03:02.803 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999986 2024-04-19T03:03:02.803 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.803 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.803 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:02.803 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.138722+0000", 2024-04-19T03:03:02.803 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1709999999999999e-06 2024-04-19T03:03:02.803 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.803 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.803 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:02.803 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.138731+0000", 2024-04-19T03:03:02.803 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.0310000000000004e-06 2024-04-19T03:03:02.803 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.804 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.804 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:02.804 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.138738+0000", 2024-04-19T03:03:02.804 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8430000000000004e-06 2024-04-19T03:03:02.804 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.804 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.804 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:02.804 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.138789+0000", 2024-04-19T03:03:02.804 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0623e-05 2024-04-19T03:03:02.804 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.804 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.804 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:02.804 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.138945+0000", 2024-04-19T03:03:02.804 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00015671899999999999 2024-04-19T03:03:02.805 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.805 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.805 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:03:02.805 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.139079+0000", 2024-04-19T03:03:02.805 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00013380099999999999 2024-04-19T03:03:02.805 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.805 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.805 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:03:02.805 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.141715+0000", 2024-04-19T03:03:02.805 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0026362849999999999 2024-04-19T03:03:02.805 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.805 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.805 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:02.806 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.195784+0000", 2024-04-19T03:03:02.806 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.054068353 2024-04-19T03:03:02.806 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.806 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.806 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:03:02.806 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.195852+0000", 2024-04-19T03:03:02.806 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8121999999999996e-05 2024-04-19T03:03:02.806 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:02.806 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:02.806 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:02.806 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.195909+0000", 2024-04-19T03:03:02.806 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6737999999999998e-05 2024-04-19T03:03:02.806 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:02.806 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:02.807 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:02.807 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:02.807 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:02.807 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-04-19T03:03:02.808 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:03:02.804+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:03:02.809 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T03:03:02.909 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:03:02.904+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:03:02.935 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-19T03:03:02.935 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-04-19T03:03:02.935 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.935 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:170210 5.4 5:2ffd59c4:::benchmark_data_smithi096_19531_object56760:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T03:03:02.935 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:03:02.933012+0000", 2024-04-19T03:03:02.935 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0026832470000000001, 2024-04-19T03:03:02.936 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0027048150000000002, 2024-04-19T03:03:02.936 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:02.936 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-19T03:03:02.936 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:02.936 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:02.936 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:02.936 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 170210 2024-04-19T03:03:02.936 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.936 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:02.936 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.937 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:02.937 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:02.933012+0000", 2024-04-19T03:03:02.937 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:02.937 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.937 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.937 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:02.937 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:02.933012+0000", 2024-04-19T03:03:02.937 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:02.937 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.937 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.937 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:02.937 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:02.933011+0000", 2024-04-19T03:03:02.937 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:03:02.937 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.938 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.938 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:02.938 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:02.933018+0000", 2024-04-19T03:03:02.938 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3880000000000002e-06 2024-04-19T03:03:02.938 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.938 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.938 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:02.938 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:02.933029+0000", 2024-04-19T03:03:02.938 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0805000000000001e-05 2024-04-19T03:03:02.938 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.938 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.938 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:02.938 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:02.933039+0000", 2024-04-19T03:03:02.939 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.5340000000000005e-06 2024-04-19T03:03:02.939 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.939 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.939 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:02.939 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:02.933107+0000", 2024-04-19T03:03:02.939 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.8326999999999998e-05 2024-04-19T03:03:02.939 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.939 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.939 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:02.939 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:02.933253+0000", 2024-04-19T03:03:02.939 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014637999999999999 2024-04-19T03:03:02.939 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:02.939 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:02.939 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:02.940 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.940 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.940 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:170213 5.4 5:2fefc2b5:::benchmark_data_smithi096_19531_object56763:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T03:03:02.940 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:03:02.933387+0000", 2024-04-19T03:03:02.940 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0023090060000000002, 2024-04-19T03:03:02.940 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0023862660000000002, 2024-04-19T03:03:02.940 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:02.940 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-19T03:03:02.940 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:02.940 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:02.940 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:02.940 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 170213 2024-04-19T03:03:02.940 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.940 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:02.941 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.941 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:02.941 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:02.933387+0000", 2024-04-19T03:03:02.941 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:02.941 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.941 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.941 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:02.941 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:02.933387+0000", 2024-04-19T03:03:02.941 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:02.941 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.941 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.941 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:02.941 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:02.933385+0000", 2024-04-19T03:03:02.941 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:03:02.942 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.942 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.942 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:02.942 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:02.933391+0000", 2024-04-19T03:03:02.942 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6180000000000003e-06 2024-04-19T03:03:02.942 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.942 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.942 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:02.942 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:02.933402+0000", 2024-04-19T03:03:02.942 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0530000000000001e-05 2024-04-19T03:03:02.942 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.942 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.942 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:02.943 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:02.933410+0000", 2024-04-19T03:03:02.943 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.6649999999999992e-06 2024-04-19T03:03:02.943 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.943 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.943 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:02.943 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:02.935219+0000", 2024-04-19T03:03:02.943 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001808687 2024-04-19T03:03:02.943 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.943 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.943 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:02.943 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:02.935385+0000", 2024-04-19T03:03:02.943 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000165594 2024-04-19T03:03:02.943 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:02.943 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:02.943 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:02.943 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.944 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.944 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:170216 5.4 5.a626eb94 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T03:03:02.944 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:03:02.933611+0000", 2024-04-19T03:03:02.944 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0020845859999999998, 2024-04-19T03:03:02.944 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0022077350000000002, 2024-04-19T03:03:02.944 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:02.944 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-04-19T03:03:02.944 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:02.944 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:02.944 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:02.944 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 170216 2024-04-19T03:03:02.944 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.944 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:02.944 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.944 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:02.944 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:02.933611+0000", 2024-04-19T03:03:02.945 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:02.945 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.945 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.945 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:02.945 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:02.933611+0000", 2024-04-19T03:03:02.945 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:02.945 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.945 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.945 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:02.945 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:02.933610+0000", 2024-04-19T03:03:02.945 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:03:02.945 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.945 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.945 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:02.946 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:02.933615+0000", 2024-04-19T03:03:02.946 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2089999999999996e-06 2024-04-19T03:03:02.946 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.946 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.946 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:02.946 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:02.933627+0000", 2024-04-19T03:03:02.946 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2125e-05 2024-04-19T03:03:02.946 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.946 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.946 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:02.946 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:02.933632+0000", 2024-04-19T03:03:02.946 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.549e-06 2024-04-19T03:03:02.946 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:02.947 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:02.947 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:02.947 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.947 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.947 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:170217 5.a 5:5208fffa:::benchmark_data_smithi096_19531_object56767:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T03:03:02.947 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:03:02.935102+0000", 2024-04-19T03:03:02.947 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.000593517, 2024-04-19T03:03:02.947 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00075512799999999998, 2024-04-19T03:03:02.947 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:02.947 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-19T03:03:02.947 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:02.947 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:02.947 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:02.947 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 170217 2024-04-19T03:03:02.947 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.948 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:02.948 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.948 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:02.948 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:02.935102+0000", 2024-04-19T03:03:02.948 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:02.948 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.948 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.948 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:02.948 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:02.935102+0000", 2024-04-19T03:03:02.948 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:02.948 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.948 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.948 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:02.948 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:02.935102+0000", 2024-04-19T03:03:02.948 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:02.949 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.949 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.949 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:02.949 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:02.935104+0000", 2024-04-19T03:03:02.949 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7259999999999998e-06 2024-04-19T03:03:02.949 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.949 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.949 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:02.949 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:02.935111+0000", 2024-04-19T03:03:02.949 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.1500000000000002e-06 2024-04-19T03:03:02.949 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.949 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.949 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:02.949 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:02.935115+0000", 2024-04-19T03:03:02.949 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.54e-06 2024-04-19T03:03:02.949 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.950 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.950 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:02.950 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:02.935144+0000", 2024-04-19T03:03:02.950 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9111999999999998e-05 2024-04-19T03:03:02.950 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:02.950 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:02.950 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:02.950 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:02.935252+0000", 2024-04-19T03:03:02.950 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010827099999999999 2024-04-19T03:03:02.950 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:02.950 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:02.950 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:02.950 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:02.950 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-04-19T03:03:02.951 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 4 2024-04-19T03:03:02.951 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-19T03:03:02.951 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T03:03:03.010 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:03:03.006+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:03:03.080 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-19T03:03:03.080 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-04-19T03:03:03.080 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-04-19T03:03:03.080 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-04-19T03:03:03.080 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-19T03:03:03.092 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T03:03:03.111 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:03:03.108+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:03:03.212 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:03:03.206+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:03:03.226 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-19T03:03:03.226 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-04-19T03:03:03.226 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-04-19T03:03:03.226 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-04-19T03:03:03.226 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.226 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:86615 5.e 5:7fef7288:::benchmark_data_smithi096_19531_object86614:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:03.226 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:22.634544+0000", 2024-04-19T03:03:03.226 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 40.589967117999997, 2024-04-19T03:03:03.226 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.192475071, 2024-04-19T03:03:03.226 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:03.227 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:03.227 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:03.227 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:03.227 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:03.227 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 86615 2024-04-19T03:03:03.227 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.227 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:03.227 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.227 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:03.227 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634544+0000", 2024-04-19T03:03:03.227 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:03.227 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.227 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.227 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:03.228 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634544+0000", 2024-04-19T03:03:03.228 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:03.228 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.228 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.228 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:03.228 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634542+0000", 2024-04-19T03:03:03.228 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999981 2024-04-19T03:03:03.228 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.228 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.228 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:03.228 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634585+0000", 2024-04-19T03:03:03.228 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2299000000000003e-05 2024-04-19T03:03:03.228 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.229 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.229 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:03.229 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634592+0000", 2024-04-19T03:03:03.229 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2350000000000002e-06 2024-04-19T03:03:03.229 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.229 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.229 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:03.229 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634596+0000", 2024-04-19T03:03:03.229 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5390000000000001e-06 2024-04-19T03:03:03.229 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.230 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.230 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:03.230 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634639+0000", 2024-04-19T03:03:03.230 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2444999999999998e-05 2024-04-19T03:03:03.230 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.230 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.230 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:03.230 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634808+0000", 2024-04-19T03:03:03.230 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000169152 2024-04-19T03:03:03.230 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.230 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.230 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:03.230 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634999+0000", 2024-04-19T03:03:03.230 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00019098300000000001 2024-04-19T03:03:03.231 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.231 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.231 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:03.231 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.640458+0000", 2024-04-19T03:03:03.231 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0054586870000000003 2024-04-19T03:03:03.231 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.231 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.231 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:03.231 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.826949+0000", 2024-04-19T03:03:03.231 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.18649178299999999 2024-04-19T03:03:03.231 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.231 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.231 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:03:03.231 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.826982+0000", 2024-04-19T03:03:03.232 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2477000000000001e-05 2024-04-19T03:03:03.232 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.232 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.232 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:03.232 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.827019+0000", 2024-04-19T03:03:03.232 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7355999999999999e-05 2024-04-19T03:03:03.232 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:03.232 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:03.232 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:03.232 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.232 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.232 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:86616 5.e 5:72278f47:::benchmark_data_smithi096_19531_object86615:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:03.232 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:22.634609+0000", 2024-04-19T03:03:03.232 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 40.589901969000003, 2024-04-19T03:03:03.233 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.19472088900000001, 2024-04-19T03:03:03.233 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:03.233 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:03.233 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:03.233 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:03.233 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:03.233 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 86616 2024-04-19T03:03:03.233 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.233 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:03.233 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.233 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:03.233 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634609+0000", 2024-04-19T03:03:03.233 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:03.234 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.234 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.234 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:03.234 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634609+0000", 2024-04-19T03:03:03.234 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:03.234 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.234 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.234 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:03.234 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634609+0000", 2024-04-19T03:03:03.234 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:03.234 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.234 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.234 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:03.235 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634651+0000", 2024-04-19T03:03:03.235 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2589000000000002e-05 2024-04-19T03:03:03.235 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.235 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.235 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:03.235 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634659+0000", 2024-04-19T03:03:03.235 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5850000000000002e-06 2024-04-19T03:03:03.235 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.235 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.235 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:03.235 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634662+0000", 2024-04-19T03:03:03.235 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3620000000000002e-06 2024-04-19T03:03:03.235 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.235 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.236 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:03.236 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.637880+0000", 2024-04-19T03:03:03.236 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.003218149 2024-04-19T03:03:03.236 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.236 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.236 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:03.236 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.637999+0000", 2024-04-19T03:03:03.236 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000118643 2024-04-19T03:03:03.236 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.236 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.236 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:03.236 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.638102+0000", 2024-04-19T03:03:03.236 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010331 2024-04-19T03:03:03.236 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.237 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.237 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:03.237 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.640851+0000", 2024-04-19T03:03:03.237 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0027483310000000001 2024-04-19T03:03:03.237 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.237 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.237 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:03.237 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.829269+0000", 2024-04-19T03:03:03.237 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.188418319 2024-04-19T03:03:03.237 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.237 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.237 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:03:03.237 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.829299+0000", 2024-04-19T03:03:03.237 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0227e-05 2024-04-19T03:03:03.238 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.238 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.238 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:03.238 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.829330+0000", 2024-04-19T03:03:03.238 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0969000000000001e-05 2024-04-19T03:03:03.238 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:03.238 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:03.238 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:03.238 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.238 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.238 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:86618 5.0 5:09014b90:::benchmark_data_smithi096_19531_object86617:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:03.238 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:22.634894+0000", 2024-04-19T03:03:03.238 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 40.589617480999998, 2024-04-19T03:03:03.239 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.19413419800000001, 2024-04-19T03:03:03.239 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:03.239 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:03.239 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:03.239 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:03.239 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:03.239 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 86618 2024-04-19T03:03:03.239 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.239 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:03.239 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.239 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:03.239 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634894+0000", 2024-04-19T03:03:03.239 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:03.239 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.239 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.240 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:03.240 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634894+0000", 2024-04-19T03:03:03.240 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:03.240 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.240 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.240 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:03.240 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634893+0000", 2024-04-19T03:03:03.240 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:03:03.240 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.240 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.240 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:03.240 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634976+0000", 2024-04-19T03:03:03.240 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3231000000000003e-05 2024-04-19T03:03:03.241 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.241 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.241 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:03.241 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634983+0000", 2024-04-19T03:03:03.241 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5169999999999996e-06 2024-04-19T03:03:03.241 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.241 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.241 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:03.241 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634987+0000", 2024-04-19T03:03:03.241 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.425e-06 2024-04-19T03:03:03.241 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.241 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.241 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:03.241 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635030+0000", 2024-04-19T03:03:03.242 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.32e-05 2024-04-19T03:03:03.242 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.242 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.242 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:03.242 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635185+0000", 2024-04-19T03:03:03.242 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015471899999999999 2024-04-19T03:03:03.242 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.242 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.242 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:03.242 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635415+0000", 2024-04-19T03:03:03.242 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00023026500000000001 2024-04-19T03:03:03.242 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.242 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.243 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:03.243 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.640127+0000", 2024-04-19T03:03:03.243 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0047118890000000004 2024-04-19T03:03:03.243 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.243 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.243 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:03.243 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.828895+0000", 2024-04-19T03:03:03.243 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.18876802600000001 2024-04-19T03:03:03.243 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.243 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.243 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:03:03.243 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.828972+0000", 2024-04-19T03:03:03.243 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.6345000000000002e-05 2024-04-19T03:03:03.243 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.243 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.244 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:03.244 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.829028+0000", 2024-04-19T03:03:03.244 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6342999999999999e-05 2024-04-19T03:03:03.244 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:03.244 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:03.244 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:03.244 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.244 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.244 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:86620 5.b 5:d80faa68:::benchmark_data_smithi096_19531_object86619:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:03.244 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:22.635110+0000", 2024-04-19T03:03:03.244 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 40.589400920999999, 2024-04-19T03:03:03.244 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.193447275, 2024-04-19T03:03:03.244 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:03.244 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:03.245 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:03.245 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:03.245 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:03.245 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 86620 2024-04-19T03:03:03.245 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.245 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:03.245 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.245 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:03.245 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635110+0000", 2024-04-19T03:03:03.245 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:03.245 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.245 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.245 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:03.246 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635110+0000", 2024-04-19T03:03:03.246 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:03.246 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.246 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.246 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:03.246 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635110+0000", 2024-04-19T03:03:03.246 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:03.246 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.246 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.246 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:03.246 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635154+0000", 2024-04-19T03:03:03.246 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4681000000000001e-05 2024-04-19T03:03:03.246 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.246 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.247 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:03.247 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635166+0000", 2024-04-19T03:03:03.247 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1505000000000001e-05 2024-04-19T03:03:03.247 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.247 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.247 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:03.247 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635171+0000", 2024-04-19T03:03:03.247 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6040000000000003e-06 2024-04-19T03:03:03.247 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.247 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.247 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:03.247 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635221+0000", 2024-04-19T03:03:03.247 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9947000000000001e-05 2024-04-19T03:03:03.248 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.248 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.248 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:03.248 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635356+0000", 2024-04-19T03:03:03.248 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013576199999999999 2024-04-19T03:03:03.248 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.248 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.248 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:03.248 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635507+0000", 2024-04-19T03:03:03.248 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015072999999999999 2024-04-19T03:03:03.248 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.248 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.248 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:03.249 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.638488+0000", 2024-04-19T03:03:03.249 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0029813159999999999 2024-04-19T03:03:03.249 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.249 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.249 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:03.249 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.828341+0000", 2024-04-19T03:03:03.249 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.189852254 2024-04-19T03:03:03.249 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.249 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.249 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:03:03.249 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.828416+0000", 2024-04-19T03:03:03.249 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5344000000000002e-05 2024-04-19T03:03:03.249 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.250 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.250 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:03.250 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.828558+0000", 2024-04-19T03:03:03.250 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000141695 2024-04-19T03:03:03.250 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:03.250 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:03.250 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:03.250 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.250 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.250 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:86621 5.8 5:1597a420:::benchmark_data_smithi096_19531_object86620:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:03.250 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:22.635187+0000", 2024-04-19T03:03:03.250 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 40.589324060999999, 2024-04-19T03:03:03.250 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.194204878, 2024-04-19T03:03:03.251 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:03.251 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:03.251 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:03.251 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:03.251 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:03.251 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 86621 2024-04-19T03:03:03.251 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.251 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:03.251 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.251 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:03.251 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635187+0000", 2024-04-19T03:03:03.251 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:03.251 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.251 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.252 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:03.252 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635187+0000", 2024-04-19T03:03:03.252 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:03.252 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.252 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.252 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:03.252 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635187+0000", 2024-04-19T03:03:03.252 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:03.252 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.252 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.252 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:03.252 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635242+0000", 2024-04-19T03:03:03.252 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5158000000000003e-05 2024-04-19T03:03:03.252 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.252 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.253 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:03.253 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635249+0000", 2024-04-19T03:03:03.253 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.7000000000000008e-06 2024-04-19T03:03:03.253 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.253 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.253 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:03.253 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635256+0000", 2024-04-19T03:03:03.253 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2060000000000004e-06 2024-04-19T03:03:03.253 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.253 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.253 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:03.253 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635302+0000", 2024-04-19T03:03:03.253 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5954000000000001e-05 2024-04-19T03:03:03.254 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.254 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.254 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:03.254 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635427+0000", 2024-04-19T03:03:03.254 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012559299999999999 2024-04-19T03:03:03.254 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.254 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.254 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:03.254 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635596+0000", 2024-04-19T03:03:03.254 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000168615 2024-04-19T03:03:03.254 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.254 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.254 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:03.255 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.639320+0000", 2024-04-19T03:03:03.255 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0037244610000000001 2024-04-19T03:03:03.255 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.255 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.255 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:03.255 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.829277+0000", 2024-04-19T03:03:03.255 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.18995651099999999 2024-04-19T03:03:03.255 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.255 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.255 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:03:03.255 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.829341+0000", 2024-04-19T03:03:03.255 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3756000000000004e-05 2024-04-19T03:03:03.255 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.255 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.256 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:03.256 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.829392+0000", 2024-04-19T03:03:03.256 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1555999999999999e-05 2024-04-19T03:03:03.256 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:03.256 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:03.256 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:03.256 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.256 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.256 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87067 5.b 5:d57af71a:::benchmark_data_smithi096_19531_object87066:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:03.256 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.142233+0000", 2024-04-19T03:03:03.256 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 40.082278197999997, 2024-04-19T03:03:03.256 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.071692405000000001, 2024-04-19T03:03:03.256 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:03.257 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:03.257 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:03.257 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:03.257 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:03.257 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87067 2024-04-19T03:03:03.257 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.257 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:03.257 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.257 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:03.257 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142233+0000", 2024-04-19T03:03:03.257 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:03.257 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.257 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.257 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:03.258 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142233+0000", 2024-04-19T03:03:03.258 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:03.258 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.258 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.258 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:03.258 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142232+0000", 2024-04-19T03:03:03.258 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:03:03.258 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.258 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.258 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:03.258 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142277+0000", 2024-04-19T03:03:03.258 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5837000000000002e-05 2024-04-19T03:03:03.258 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.258 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.259 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:03.259 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142297+0000", 2024-04-19T03:03:03.259 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9561000000000001e-05 2024-04-19T03:03:03.259 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.259 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.259 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:03.259 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142311+0000", 2024-04-19T03:03:03.259 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3654e-05 2024-04-19T03:03:03.259 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.259 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.259 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:03.259 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142391+0000", 2024-04-19T03:03:03.259 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0123999999999994e-05 2024-04-19T03:03:03.259 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.260 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.260 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:03.260 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142669+0000", 2024-04-19T03:03:03.260 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00027829800000000001 2024-04-19T03:03:03.260 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.260 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.260 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:03.260 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142859+0000", 2024-04-19T03:03:03.260 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000190051 2024-04-19T03:03:03.260 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.260 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.260 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:03.260 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.150597+0000", 2024-04-19T03:03:03.260 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0077380299999999999 2024-04-19T03:03:03.261 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.261 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.261 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:03.261 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.213855+0000", 2024-04-19T03:03:03.261 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.063257987000000002 2024-04-19T03:03:03.261 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.261 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.261 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:03:03.261 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.213898+0000", 2024-04-19T03:03:03.261 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2916e-05 2024-04-19T03:03:03.261 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.261 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.261 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:03.261 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.213925+0000", 2024-04-19T03:03:03.262 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7503000000000001e-05 2024-04-19T03:03:03.262 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:03.262 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:03.262 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:03.262 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.262 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.262 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87069 5.b 5:da0c93b5:::benchmark_data_smithi096_19531_object87068:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:03.262 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.143402+0000", 2024-04-19T03:03:03.262 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 40.081109236000003, 2024-04-19T03:03:03.262 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.070678598999999995, 2024-04-19T03:03:03.262 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:03.262 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:03.262 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:03.262 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:03.263 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:03.263 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87069 2024-04-19T03:03:03.263 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.263 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:03.263 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.263 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:03.263 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.143402+0000", 2024-04-19T03:03:03.263 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:03.263 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.263 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.263 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:03.263 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.143402+0000", 2024-04-19T03:03:03.263 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:03.263 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.264 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.264 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:03.264 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.143401+0000", 2024-04-19T03:03:03.264 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:03:03.264 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.264 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.264 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:03.264 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.143501+0000", 2024-04-19T03:03:03.264 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000100387 2024-04-19T03:03:03.264 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.264 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.264 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:03.264 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.143516+0000", 2024-04-19T03:03:03.264 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5369000000000001e-05 2024-04-19T03:03:03.265 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.265 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.265 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:03.265 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.143524+0000", 2024-04-19T03:03:03.265 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.7079999999999997e-06 2024-04-19T03:03:03.265 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.265 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.265 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:03.265 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.145550+0000", 2024-04-19T03:03:03.265 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0020259290000000001 2024-04-19T03:03:03.265 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.265 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.265 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:03.265 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.145676+0000", 2024-04-19T03:03:03.265 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000126406 2024-04-19T03:03:03.266 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.266 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.266 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:03.266 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.145802+0000", 2024-04-19T03:03:03.266 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000125974 2024-04-19T03:03:03.266 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.266 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.266 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:03.266 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.151030+0000", 2024-04-19T03:03:03.266 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0052276079999999999 2024-04-19T03:03:03.266 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.266 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.266 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:03.266 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.213998+0000", 2024-04-19T03:03:03.267 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.06296786 2024-04-19T03:03:03.267 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.267 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.267 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:03:03.267 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.214031+0000", 2024-04-19T03:03:03.267 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3387999999999999e-05 2024-04-19T03:03:03.267 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.267 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.267 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:03.267 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.214081+0000", 2024-04-19T03:03:03.267 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9316e-05 2024-04-19T03:03:03.267 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:03.267 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:03.268 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:03.268 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.268 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.268 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87108 5.e 5:7e197adc:::benchmark_data_smithi096_19531_object87107:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:03.268 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.223103+0000", 2024-04-19T03:03:03.268 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 40.001407899, 2024-04-19T03:03:03.268 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.044946887, 2024-04-19T03:03:03.268 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:03.268 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-19T03:03:03.268 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:03.268 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:03.268 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:03.268 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87108 2024-04-19T03:03:03.269 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.269 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:03.269 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.269 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:03.269 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.223103+0000", 2024-04-19T03:03:03.269 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:03.269 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.269 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.269 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:03.269 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.223103+0000", 2024-04-19T03:03:03.269 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:03.270 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.270 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.270 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:03.270 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.223102+0000", 2024-04-19T03:03:03.270 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:03:03.270 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.270 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.270 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:03.270 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.223156+0000", 2024-04-19T03:03:03.270 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3958000000000001e-05 2024-04-19T03:03:03.270 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.271 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.271 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:03.271 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.223166+0000", 2024-04-19T03:03:03.271 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.4809999999999995e-06 2024-04-19T03:03:03.271 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.271 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.271 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:03.271 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.223172+0000", 2024-04-19T03:03:03.271 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0140000000000004e-06 2024-04-19T03:03:03.271 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.271 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.271 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:03.271 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.227295+0000", 2024-04-19T03:03:03.271 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0041233420000000003 2024-04-19T03:03:03.272 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.272 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.272 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:03.272 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.227495+0000", 2024-04-19T03:03:03.272 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00019955299999999999 2024-04-19T03:03:03.272 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.272 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.272 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:03.272 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.227717+0000", 2024-04-19T03:03:03.272 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000221902 2024-04-19T03:03:03.272 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.272 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.272 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:03.272 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233189+0000", 2024-04-19T03:03:03.273 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0054718889999999997 2024-04-19T03:03:03.273 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.273 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.273 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:03.273 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.250529+0000", 2024-04-19T03:03:03.273 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.017340298000000001 2024-04-19T03:03:03.273 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.273 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.273 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:03:03.273 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.250539+0000", 2024-04-19T03:03:03.273 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0501e-05 2024-04-19T03:03:03.273 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.273 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.273 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:03.274 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.268003+0000", 2024-04-19T03:03:03.274 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.017463429 2024-04-19T03:03:03.274 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.274 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.274 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:03.274 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.268050+0000", 2024-04-19T03:03:03.274 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7466000000000003e-05 2024-04-19T03:03:03.274 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:03.274 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:03.274 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:03.274 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.274 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.274 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87118 5.b 5:d1bb4f3c:::benchmark_data_smithi096_19531_object87117:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:03.275 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.231082+0000", 2024-04-19T03:03:03.275 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 39.993429065000001, 2024-04-19T03:03:03.275 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.035789004, 2024-04-19T03:03:03.275 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:03.275 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-19T03:03:03.275 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:03.275 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:03.275 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:03.275 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87118 2024-04-19T03:03:03.275 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.275 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:03.275 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.275 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:03.275 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231082+0000", 2024-04-19T03:03:03.276 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:03.276 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.276 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.276 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:03.276 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231082+0000", 2024-04-19T03:03:03.276 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:03.276 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.276 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.276 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:03.276 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231081+0000", 2024-04-19T03:03:03.276 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:03:03.276 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.276 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.276 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:03.277 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231159+0000", 2024-04-19T03:03:03.277 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.7819999999999997e-05 2024-04-19T03:03:03.277 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.277 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.277 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:03.277 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231186+0000", 2024-04-19T03:03:03.277 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7126000000000001e-05 2024-04-19T03:03:03.277 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.277 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.277 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:03.278 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231193+0000", 2024-04-19T03:03:03.278 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7259999999999996e-06 2024-04-19T03:03:03.278 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.278 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.278 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:03.278 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231241+0000", 2024-04-19T03:03:03.278 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8123e-05 2024-04-19T03:03:03.278 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.278 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.278 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:03.278 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231354+0000", 2024-04-19T03:03:03.278 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0001133 2024-04-19T03:03:03.278 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.278 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.279 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:03.279 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231443+0000", 2024-04-19T03:03:03.279 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9167999999999997e-05 2024-04-19T03:03:03.279 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.279 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.279 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:03.279 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236498+0000", 2024-04-19T03:03:03.279 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0050545160000000002 2024-04-19T03:03:03.279 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.279 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.279 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:03.279 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.249681+0000", 2024-04-19T03:03:03.279 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013183321 2024-04-19T03:03:03.279 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.280 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.280 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:03:03.280 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.249693+0000", 2024-04-19T03:03:03.280 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1834999999999999e-05 2024-04-19T03:03:03.280 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.280 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.280 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:03.280 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266733+0000", 2024-04-19T03:03:03.280 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.017040408 2024-04-19T03:03:03.280 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.280 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.280 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:03.280 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266871+0000", 2024-04-19T03:03:03.280 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000137849 2024-04-19T03:03:03.281 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:03.281 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:03.281 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:03.281 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.281 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.281 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87121 5.b 5:d01822b8:::benchmark_data_smithi096_19531_object87120:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:03.281 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.233319+0000", 2024-04-19T03:03:03.281 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 39.991192200999997, 2024-04-19T03:03:03.281 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.033624198, 2024-04-19T03:03:03.281 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:03.281 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-19T03:03:03.281 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:03.282 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:03.282 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:03.282 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87121 2024-04-19T03:03:03.282 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.282 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:03.282 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.282 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:03.282 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233319+0000", 2024-04-19T03:03:03.282 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:03.282 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.282 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.282 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:03.282 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233319+0000", 2024-04-19T03:03:03.283 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:03.283 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.283 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.283 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:03.283 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233319+0000", 2024-04-19T03:03:03.283 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:03.283 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.283 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.283 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:03.283 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233364+0000", 2024-04-19T03:03:03.283 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5460999999999997e-05 2024-04-19T03:03:03.283 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.283 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.283 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:03.284 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233382+0000", 2024-04-19T03:03:03.284 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8148e-05 2024-04-19T03:03:03.284 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.284 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.284 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:03.284 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233390+0000", 2024-04-19T03:03:03.284 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5340000000000002e-06 2024-04-19T03:03:03.284 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.284 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.284 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:03.284 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233712+0000", 2024-04-19T03:03:03.284 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00032260500000000001 2024-04-19T03:03:03.284 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.284 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.285 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:03.285 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233829+0000", 2024-04-19T03:03:03.285 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011638599999999999 2024-04-19T03:03:03.285 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.285 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.285 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:03.285 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233959+0000", 2024-04-19T03:03:03.285 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013013900000000001 2024-04-19T03:03:03.285 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.285 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.285 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:03.285 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236515+0000", 2024-04-19T03:03:03.285 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0025562750000000002 2024-04-19T03:03:03.286 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.286 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.286 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:03.286 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.249723+0000", 2024-04-19T03:03:03.286 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013208176 2024-04-19T03:03:03.286 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.286 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.286 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:03:03.286 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.249728+0000", 2024-04-19T03:03:03.286 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6519999999999997e-06 2024-04-19T03:03:03.286 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.286 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.286 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:03.287 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266837+0000", 2024-04-19T03:03:03.287 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0171087059999999 2024-04-19T03:03:03.287 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.287 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.287 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:03.287 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266943+0000", 2024-04-19T03:03:03.287 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000106604 2024-04-19T03:03:03.287 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:03.287 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:03.287 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:03.287 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.287 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.287 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87124 5.8 5:14819ad7:::benchmark_data_smithi096_19531_object87123:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:03.288 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.235886+0000", 2024-04-19T03:03:03.288 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 39.988624776999998, 2024-04-19T03:03:03.288 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0315451179999999, 2024-04-19T03:03:03.288 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:03.288 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-19T03:03:03.288 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:03.288 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:03.288 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:03.288 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87124 2024-04-19T03:03:03.288 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.288 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:03.288 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.288 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:03.288 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.235886+0000", 2024-04-19T03:03:03.288 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:03.289 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.289 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.289 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:03.289 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.235886+0000", 2024-04-19T03:03:03.289 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:03.289 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.289 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.289 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:03.289 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.235886+0000", 2024-04-19T03:03:03.289 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:03:03.289 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.289 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.289 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:03.289 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.235934+0000", 2024-04-19T03:03:03.290 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8384000000000003e-05 2024-04-19T03:03:03.290 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.290 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.290 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:03.290 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.235945+0000", 2024-04-19T03:03:03.290 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0671e-05 2024-04-19T03:03:03.290 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.290 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.290 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:03.290 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.235952+0000", 2024-04-19T03:03:03.290 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3089999999999998e-06 2024-04-19T03:03:03.290 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.290 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.291 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:03.291 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.237067+0000", 2024-04-19T03:03:03.291 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001115263 2024-04-19T03:03:03.291 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.291 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.291 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:03.291 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.237188+0000", 2024-04-19T03:03:03.291 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000121258 2024-04-19T03:03:03.291 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.291 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.291 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:03.291 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.237316+0000", 2024-04-19T03:03:03.291 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000128071 2024-04-19T03:03:03.291 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.291 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.292 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:03.292 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240744+0000", 2024-04-19T03:03:03.292 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0034275629999999998 2024-04-19T03:03:03.292 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.292 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.292 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:03.292 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.252517+0000", 2024-04-19T03:03:03.292 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011772991999999999 2024-04-19T03:03:03.292 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.292 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.292 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:03:03.292 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.252523+0000", 2024-04-19T03:03:03.292 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3640000000000004e-06 2024-04-19T03:03:03.292 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.293 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.293 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:03.293 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.267290+0000", 2024-04-19T03:03:03.293 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0147665690000001 2024-04-19T03:03:03.293 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.293 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.293 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:03.293 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.267432+0000", 2024-04-19T03:03:03.293 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014165299999999999 2024-04-19T03:03:03.293 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:03.293 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:03.293 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:03.293 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.294 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.294 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87129 5.0 5:02667e01:::benchmark_data_smithi096_19531_object87128:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:03.294 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.236466+0000", 2024-04-19T03:03:03.294 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 39.988044780999999, 2024-04-19T03:03:03.294 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0301534510000001, 2024-04-19T03:03:03.294 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:03.294 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-19T03:03:03.294 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:03.294 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:03.294 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:03.294 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87129 2024-04-19T03:03:03.294 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.294 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:03.294 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.295 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:03.295 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236466+0000", 2024-04-19T03:03:03.295 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:03.295 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.295 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.295 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:03.295 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236466+0000", 2024-04-19T03:03:03.295 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:03.295 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.295 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.295 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:03.295 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236465+0000", 2024-04-19T03:03:03.295 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:03:03.295 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.296 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.296 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:03.296 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236566+0000", 2024-04-19T03:03:03.296 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010047000000000001 2024-04-19T03:03:03.296 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.296 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.296 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:03.296 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236577+0000", 2024-04-19T03:03:03.296 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1772e-05 2024-04-19T03:03:03.296 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.296 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.296 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:03.296 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236584+0000", 2024-04-19T03:03:03.296 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0530000000000003e-06 2024-04-19T03:03:03.297 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.297 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.297 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:03.297 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.237023+0000", 2024-04-19T03:03:03.297 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000439703 2024-04-19T03:03:03.297 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.297 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.297 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:03.297 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.237207+0000", 2024-04-19T03:03:03.297 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000183692 2024-04-19T03:03:03.297 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.297 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.297 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:03.298 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.237373+0000", 2024-04-19T03:03:03.298 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016623500000000001 2024-04-19T03:03:03.298 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.298 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.298 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:03.298 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.241461+0000", 2024-04-19T03:03:03.298 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0040883050000000004 2024-04-19T03:03:03.298 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.298 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.298 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:03.298 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.252500+0000", 2024-04-19T03:03:03.298 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011038450999999999 2024-04-19T03:03:03.298 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.298 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.299 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:03:03.299 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.252507+0000", 2024-04-19T03:03:03.299 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2439999999999996e-06 2024-04-19T03:03:03.299 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.299 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.299 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:03.299 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266538+0000", 2024-04-19T03:03:03.299 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.014031184 2024-04-19T03:03:03.299 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.299 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.299 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:03.299 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266620+0000", 2024-04-19T03:03:03.299 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1600000000000005e-05 2024-04-19T03:03:03.300 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:03.300 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:03.300 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:03.300 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.300 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.300 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87135 5.4 5:2a97e7b7:::benchmark_data_smithi096_19531_object87134:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:03.300 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.240884+0000", 2024-04-19T03:03:03.300 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 39.983627323999997, 2024-04-19T03:03:03.300 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.025708931, 2024-04-19T03:03:03.300 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:03.300 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-19T03:03:03.300 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:03.300 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:03.300 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:03.301 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87135 2024-04-19T03:03:03.301 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.301 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:03.301 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.301 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:03.301 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240884+0000", 2024-04-19T03:03:03.301 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:03.301 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.301 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.301 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:03.301 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240884+0000", 2024-04-19T03:03:03.301 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:03.301 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.301 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.302 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:03.302 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240883+0000", 2024-04-19T03:03:03.302 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:03:03.302 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.302 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.302 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:03.302 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240933+0000", 2024-04-19T03:03:03.302 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9969999999999998e-05 2024-04-19T03:03:03.302 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.302 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.302 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:03.302 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240946+0000", 2024-04-19T03:03:03.302 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2943e-05 2024-04-19T03:03:03.302 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.303 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.303 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:03.303 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240952+0000", 2024-04-19T03:03:03.303 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8930000000000002e-06 2024-04-19T03:03:03.303 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.303 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.303 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:03.303 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240994+0000", 2024-04-19T03:03:03.303 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2753999999999998e-05 2024-04-19T03:03:03.303 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.303 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.303 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:03.303 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.241092+0000", 2024-04-19T03:03:03.304 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.7447000000000004e-05 2024-04-19T03:03:03.304 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.304 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.304 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:03.304 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.241183+0000", 2024-04-19T03:03:03.304 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1163999999999997e-05 2024-04-19T03:03:03.304 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.304 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.304 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:03.304 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.254672+0000", 2024-04-19T03:03:03.304 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.01348864 2024-04-19T03:03:03.304 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.304 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.304 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:03:03.304 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.254681+0000", 2024-04-19T03:03:03.305 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.3789999999999995e-06 2024-04-19T03:03:03.305 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.305 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.305 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:03.305 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266456+0000", 2024-04-19T03:03:03.305 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.011774621 2024-04-19T03:03:03.305 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.305 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.305 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:03.305 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266593+0000", 2024-04-19T03:03:03.305 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013737600000000001 2024-04-19T03:03:03.305 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:03.305 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:03.305 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:03.306 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.306 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.306 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87136 5.4 5:212411bc:::benchmark_data_smithi096_19531_object87135:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:03.306 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.240962+0000", 2024-04-19T03:03:03.306 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 39.983549447999998, 2024-04-19T03:03:03.306 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.025738, 2024-04-19T03:03:03.306 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:03.306 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-19T03:03:03.306 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:03.306 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:03.306 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:03.306 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87136 2024-04-19T03:03:03.306 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.306 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:03.306 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.307 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:03.307 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240962+0000", 2024-04-19T03:03:03.307 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:03.307 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.307 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.307 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:03.307 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240962+0000", 2024-04-19T03:03:03.307 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:03.307 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.307 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.307 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:03.307 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240961+0000", 2024-04-19T03:03:03.307 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:03.307 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.308 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.308 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:03.308 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240995+0000", 2024-04-19T03:03:03.308 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3868000000000002e-05 2024-04-19T03:03:03.308 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.308 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.308 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:03.308 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.241001+0000", 2024-04-19T03:03:03.308 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.322e-06 2024-04-19T03:03:03.308 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.308 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.308 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:03.308 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.241004+0000", 2024-04-19T03:03:03.308 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3510000000000002e-06 2024-04-19T03:03:03.308 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.309 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.309 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:03.309 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247131+0000", 2024-04-19T03:03:03.309 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0061270869999999998 2024-04-19T03:03:03.309 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.309 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.309 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:03.309 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247322+0000", 2024-04-19T03:03:03.309 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000191015 2024-04-19T03:03:03.309 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.309 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.309 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:03.309 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247542+0000", 2024-04-19T03:03:03.310 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00022030199999999999 2024-04-19T03:03:03.310 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.310 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.310 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:03.310 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.254709+0000", 2024-04-19T03:03:03.310 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0071662660000000001 2024-04-19T03:03:03.310 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.310 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.310 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:03:03.310 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.254716+0000", 2024-04-19T03:03:03.310 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3860000000000001e-06 2024-04-19T03:03:03.310 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.310 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.310 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:03.311 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266619+0000", 2024-04-19T03:03:03.311 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0119031030000001 2024-04-19T03:03:03.311 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.311 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.311 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:03.311 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266700+0000", 2024-04-19T03:03:03.311 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0764000000000001e-05 2024-04-19T03:03:03.311 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:03.311 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:03.311 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:03.311 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.311 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.311 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87138 5.e 5:7b1f1c20:::benchmark_data_smithi096_19531_object87137:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:03.311 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.247862+0000", 2024-04-19T03:03:03.312 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 39.976649373999997, 2024-04-19T03:03:03.312 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.024457079, 2024-04-19T03:03:03.312 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:03.312 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:03.312 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:03.312 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:03.312 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:03.312 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87138 2024-04-19T03:03:03.312 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.312 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:03.312 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.312 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:03.312 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247862+0000", 2024-04-19T03:03:03.312 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:03.313 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.313 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.313 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:03.313 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247862+0000", 2024-04-19T03:03:03.313 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:03.313 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.313 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.313 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:03.313 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247860+0000", 2024-04-19T03:03:03.313 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999981 2024-04-19T03:03:03.313 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.313 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.313 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:03.313 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247909+0000", 2024-04-19T03:03:03.314 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9150999999999997e-05 2024-04-19T03:03:03.314 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.314 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.314 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:03.314 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247925+0000", 2024-04-19T03:03:03.314 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5761999999999999e-05 2024-04-19T03:03:03.314 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.314 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.314 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:03.314 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247936+0000", 2024-04-19T03:03:03.314 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1144e-05 2024-04-19T03:03:03.314 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.314 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.314 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:03.315 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.250590+0000", 2024-04-19T03:03:03.315 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.002653678 2024-04-19T03:03:03.315 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.315 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.315 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:03:03.315 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.250599+0000", 2024-04-19T03:03:03.315 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9039999999999998e-06 2024-04-19T03:03:03.315 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.315 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.315 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:03.315 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.268151+0000", 2024-04-19T03:03:03.315 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0175523449999999 2024-04-19T03:03:03.315 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.315 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.316 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:03.316 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.268285+0000", 2024-04-19T03:03:03.316 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013415599999999999 2024-04-19T03:03:03.316 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.316 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.316 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:03.316 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.272238+0000", 2024-04-19T03:03:03.316 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0039533019999999997 2024-04-19T03:03:03.316 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.316 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.316 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:03:03.316 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.272274+0000", 2024-04-19T03:03:03.316 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5352000000000003e-05 2024-04-19T03:03:03.316 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.317 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.317 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:03.317 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.272319+0000", 2024-04-19T03:03:03.317 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5281999999999998e-05 2024-04-19T03:03:03.317 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:03.317 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:03.317 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:03.317 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.317 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.317 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:158371 5.8 5:11a83024:::benchmark_data_smithi096_19531_object44921:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-19T03:03:03.317 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:58.125869+0000", 2024-04-19T03:03:03.317 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 5.0986425090000003, 2024-04-19T03:03:03.317 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074532857999999994, 2024-04-19T03:03:03.317 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:03.318 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:03.318 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:03.318 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:03.318 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:03.318 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 158371 2024-04-19T03:03:03.318 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.318 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:03.318 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.318 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:03.318 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125869+0000", 2024-04-19T03:03:03.318 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:03.318 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.318 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.318 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:03.319 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125869+0000", 2024-04-19T03:03:03.319 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:03.319 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.319 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.319 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:03.319 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125868+0000", 2024-04-19T03:03:03.319 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:03:03.319 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.319 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.319 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:03.319 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125874+0000", 2024-04-19T03:03:03.319 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7120000000000003e-06 2024-04-19T03:03:03.319 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.319 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.319 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:03.320 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125885+0000", 2024-04-19T03:03:03.320 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0665999999999999e-05 2024-04-19T03:03:03.320 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.320 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.320 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:03.320 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125901+0000", 2024-04-19T03:03:03.320 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6463000000000001e-05 2024-04-19T03:03:03.320 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.320 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.320 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:03.320 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125956+0000", 2024-04-19T03:03:03.320 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4728000000000002e-05 2024-04-19T03:03:03.320 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.320 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.321 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:03.321 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.126050+0000", 2024-04-19T03:03:03.321 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.3534000000000003e-05 2024-04-19T03:03:03.321 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.321 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.321 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:03.321 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.200187+0000", 2024-04-19T03:03:03.321 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074136933000000002 2024-04-19T03:03:03.321 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.321 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.321 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:03:03.321 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.200260+0000", 2024-04-19T03:03:03.321 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3090999999999995e-05 2024-04-19T03:03:03.321 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.322 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.322 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:03.322 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.200402+0000", 2024-04-19T03:03:03.322 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014193699999999999 2024-04-19T03:03:03.322 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:03.322 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:03.322 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:03.322 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.322 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.322 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:158372 5.0 5:0473aa5f:::benchmark_data_smithi096_19531_object44922:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-19T03:03:03.322 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:58.125924+0000", 2024-04-19T03:03:03.322 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 5.0985869020000001, 2024-04-19T03:03:03.322 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074247490999999999, 2024-04-19T03:03:03.322 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:03.323 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:03.323 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:03.323 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:03.323 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:03.323 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 158372 2024-04-19T03:03:03.323 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.323 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:03.323 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.323 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:03.323 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125924+0000", 2024-04-19T03:03:03.323 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:03.323 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.323 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.323 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:03.324 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125924+0000", 2024-04-19T03:03:03.324 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:03.324 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.324 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.324 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:03.324 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125924+0000", 2024-04-19T03:03:03.324 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:03.324 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.324 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.324 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:03.324 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125927+0000", 2024-04-19T03:03:03.324 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5389999999999999e-06 2024-04-19T03:03:03.324 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.324 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.325 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:03.325 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125935+0000", 2024-04-19T03:03:03.325 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3259999999999998e-06 2024-04-19T03:03:03.325 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.325 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.325 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:03.325 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125940+0000", 2024-04-19T03:03:03.325 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6980000000000003e-06 2024-04-19T03:03:03.325 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.325 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.325 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:03.325 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125982+0000", 2024-04-19T03:03:03.325 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1337000000000001e-05 2024-04-19T03:03:03.325 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.326 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.326 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:03.326 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.126075+0000", 2024-04-19T03:03:03.326 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.3579999999999995e-05 2024-04-19T03:03:03.326 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.326 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.326 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:03.326 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.199953+0000", 2024-04-19T03:03:03.326 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073877604999999999 2024-04-19T03:03:03.326 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.326 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.326 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:03:03.326 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.200022+0000", 2024-04-19T03:03:03.327 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.8824000000000004e-05 2024-04-19T03:03:03.327 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.327 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.327 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:03.327 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.200172+0000", 2024-04-19T03:03:03.327 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015017700000000001 2024-04-19T03:03:03.327 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:03.327 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:03.327 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:03.327 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.327 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.327 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:158374 5.e 5:76be57a5:::benchmark_data_smithi096_19531_object44924:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-19T03:03:03.327 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:58.125988+0000", 2024-04-19T03:03:03.327 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 5.0985234029999997, 2024-04-19T03:03:03.328 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.067843332000000006, 2024-04-19T03:03:03.328 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:03.328 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:03.328 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:03.328 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:03.328 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:03.328 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 158374 2024-04-19T03:03:03.328 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.328 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:03.328 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.328 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:03.328 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125988+0000", 2024-04-19T03:03:03.328 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:03.328 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.329 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.329 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:03.329 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125988+0000", 2024-04-19T03:03:03.329 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:03.329 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.329 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.329 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:03.329 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125987+0000", 2024-04-19T03:03:03.329 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:03.329 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.329 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.329 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:03.329 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125990+0000", 2024-04-19T03:03:03.329 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7989999999999998e-06 2024-04-19T03:03:03.330 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.330 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.330 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:03.330 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125996+0000", 2024-04-19T03:03:03.330 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.302e-06 2024-04-19T03:03:03.330 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.330 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.330 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:03.330 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.126001+0000", 2024-04-19T03:03:03.330 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.843e-06 2024-04-19T03:03:03.330 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.330 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.330 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:03.331 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.126047+0000", 2024-04-19T03:03:03.331 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6066000000000002e-05 2024-04-19T03:03:03.331 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.331 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.331 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:03.331 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.126171+0000", 2024-04-19T03:03:03.331 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012359099999999999 2024-04-19T03:03:03.331 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.331 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.331 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:03.331 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.193709+0000", 2024-04-19T03:03:03.331 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.067538099000000004 2024-04-19T03:03:03.331 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.331 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.332 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:03:03.332 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.193766+0000", 2024-04-19T03:03:03.332 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6869e-05 2024-04-19T03:03:03.332 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.332 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.332 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:03.332 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.193831+0000", 2024-04-19T03:03:03.332 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5273999999999999e-05 2024-04-19T03:03:03.332 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:03.332 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:03.332 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:03.332 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.332 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.333 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4755.0:158376 5.9 e56/22 5:9e73c076:::benchmark_data_smithi096_19531_object44926:head v 56'9663, mlcod=56'9661)", 2024-04-19T03:03:03.333 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:58.127307+0000", 2024-04-19T03:03:03.333 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 5.0972041719999996, 2024-04-19T03:03:03.333 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069002716000000006, 2024-04-19T03:03:03.333 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:03.333 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:03.333 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:03.333 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.333 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:03.333 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.127307+0000", 2024-04-19T03:03:03.333 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:03.333 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.333 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.333 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:03.333 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.127307+0000", 2024-04-19T03:03:03.334 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:03.334 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.334 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.334 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:03.334 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.127306+0000", 2024-04-19T03:03:03.334 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:03:03.334 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.334 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.334 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:03.334 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.127316+0000", 2024-04-19T03:03:03.334 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.3039999999999994e-06 2024-04-19T03:03:03.334 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.334 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.335 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:03.335 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.127326+0000", 2024-04-19T03:03:03.335 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0009e-05 2024-04-19T03:03:03.335 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.335 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.335 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:03.335 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.127332+0000", 2024-04-19T03:03:03.335 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5880000000000003e-06 2024-04-19T03:03:03.335 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.335 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.335 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:03.335 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.127383+0000", 2024-04-19T03:03:03.335 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0516000000000002e-05 2024-04-19T03:03:03.335 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.336 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.336 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:03.336 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.127403+0000", 2024-04-19T03:03:03.336 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0547000000000002e-05 2024-04-19T03:03:03.336 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.336 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.336 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:03:03.336 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.196280+0000", 2024-04-19T03:03:03.336 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.068876863999999996 2024-04-19T03:03:03.336 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.336 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.336 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:03.336 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.196310+0000", 2024-04-19T03:03:03.336 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9762999999999999e-05 2024-04-19T03:03:03.337 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:03.337 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:03.337 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:03.337 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.337 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.337 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:158383 5.0 5:026717eb:::benchmark_data_smithi096_19531_object44933:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-19T03:03:03.337 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:58.130494+0000", 2024-04-19T03:03:03.337 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 5.0940170460000003, 2024-04-19T03:03:03.337 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.070135775999999997, 2024-04-19T03:03:03.337 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:03.337 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:03.337 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:03.337 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:03.337 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:03.338 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 158383 2024-04-19T03:03:03.338 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.338 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:03.338 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.338 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:03.338 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.130494+0000", 2024-04-19T03:03:03.338 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:03.338 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.338 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.338 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:03.338 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.130494+0000", 2024-04-19T03:03:03.338 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:03.338 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.338 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.339 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:03.339 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.130493+0000", 2024-04-19T03:03:03.339 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:03:03.339 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.339 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.339 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:03.339 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.130500+0000", 2024-04-19T03:03:03.339 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5490000000000003e-06 2024-04-19T03:03:03.339 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.339 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.339 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:03.339 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.190401+0000", 2024-04-19T03:03:03.339 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.059901668999999998 2024-04-19T03:03:03.339 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.340 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.340 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:03.340 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.190421+0000", 2024-04-19T03:03:03.340 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0288e-05 2024-04-19T03:03:03.340 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.340 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.340 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:03.340 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.190536+0000", 2024-04-19T03:03:03.340 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000114783 2024-04-19T03:03:03.340 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.340 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.340 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:03.340 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.190904+0000", 2024-04-19T03:03:03.340 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00036773900000000001 2024-04-19T03:03:03.341 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.341 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.341 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:03.341 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.200417+0000", 2024-04-19T03:03:03.341 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0095128899999999995 2024-04-19T03:03:03.341 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.341 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.341 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:03:03.341 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.200489+0000", 2024-04-19T03:03:03.341 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2554999999999999e-05 2024-04-19T03:03:03.341 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:03.341 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:03.341 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:03.341 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.200630+0000", 2024-04-19T03:03:03.341 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014055299999999999 2024-04-19T03:03:03.342 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:03.342 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:03.342 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:03.342 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:03.342 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:03.342 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-19T03:03:03.343 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:03:03.340+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:03:03.344 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T03:03:03.445 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:03:03.442+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:03:03.475 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-04-19T03:03:03.475 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [ 2024-04-19T03:03:03.475 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.475 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:171585 5.2 5:4acf3993:::benchmark_data_smithi096_19531_object58135:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T03:03:03.475 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:03:03.469429+0000", 2024-04-19T03:03:03.475 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0042747289999999997, 2024-04-19T03:03:03.475 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0042983530000000004, 2024-04-19T03:03:03.476 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:03.476 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-04-19T03:03:03.476 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:03.476 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:03.476 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:03.476 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 171585 2024-04-19T03:03:03.476 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.476 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:03.476 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.476 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:03.476 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:03.469429+0000", 2024-04-19T03:03:03.477 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:03.477 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.477 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.477 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:03.477 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:03.469429+0000", 2024-04-19T03:03:03.477 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:03.477 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.477 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.477 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:03.477 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:03.469429+0000", 2024-04-19T03:03:03.477 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:03.477 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.477 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.478 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:03.478 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:03.469431+0000", 2024-04-19T03:03:03.478 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.514e-06 2024-04-19T03:03:03.478 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.478 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.478 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:03.478 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:03.469472+0000", 2024-04-19T03:03:03.478 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0862000000000003e-05 2024-04-19T03:03:03.479 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.479 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.479 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:03.479 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:03.469481+0000", 2024-04-19T03:03:03.479 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9779999999999994e-06 2024-04-19T03:03:03.479 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.479 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.479 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:03.479 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:03.472108+0000", 2024-04-19T03:03:03.479 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0026266729999999999 2024-04-19T03:03:03.480 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.480 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.480 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:03.480 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:03.472233+0000", 2024-04-19T03:03:03.480 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00012537200000000001 2024-04-19T03:03:03.480 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:03.480 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:03.480 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:03.480 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.480 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.480 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:171586 5.6 5:6b157713:::benchmark_data_smithi096_19531_object58136:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T03:03:03.481 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:03:03.469487+0000", 2024-04-19T03:03:03.481 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0042164979999999999, 2024-04-19T03:03:03.481 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0043083469999999997, 2024-04-19T03:03:03.481 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:03.481 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-04-19T03:03:03.481 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:03.481 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:03.481 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:03.481 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 171586 2024-04-19T03:03:03.481 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.481 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:03.481 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.481 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:03.482 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:03.469487+0000", 2024-04-19T03:03:03.482 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:03.482 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.482 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.482 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:03.482 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:03.469487+0000", 2024-04-19T03:03:03.482 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:03.482 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.482 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.482 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:03.482 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:03.469487+0000", 2024-04-19T03:03:03.482 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:03.482 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.482 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.483 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:03.483 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:03.469490+0000", 2024-04-19T03:03:03.483 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4960000000000001e-06 2024-04-19T03:03:03.483 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.483 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.483 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:03.483 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:03.469500+0000", 2024-04-19T03:03:03.483 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.7049999999999994e-06 2024-04-19T03:03:03.483 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.483 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.483 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:03.483 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:03.469506+0000", 2024-04-19T03:03:03.483 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1500000000000004e-06 2024-04-19T03:03:03.484 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.484 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.484 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:03.484 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:03.470618+0000", 2024-04-19T03:03:03.484 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001112238 2024-04-19T03:03:03.484 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.484 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.484 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:03.484 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:03.470730+0000", 2024-04-19T03:03:03.484 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00011136700000000001 2024-04-19T03:03:03.484 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:03.484 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:03.484 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:03.484 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.485 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.485 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:171588 5.9 5:9a9f4263:::benchmark_data_smithi096_19531_object58138:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T03:03:03.485 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:03:03.469529+0000", 2024-04-19T03:03:03.485 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0041746880000000002, 2024-04-19T03:03:03.485 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0043265179999999997, 2024-04-19T03:03:03.485 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:03.485 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:03:03.485 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:03.485 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:03.485 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:03.485 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 171588 2024-04-19T03:03:03.485 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.485 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:03.485 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.485 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:03.486 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:03.469529+0000", 2024-04-19T03:03:03.486 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:03.486 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.486 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.486 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:03.486 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:03.469529+0000", 2024-04-19T03:03:03.486 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:03.486 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.486 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.486 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:03.486 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:03.469529+0000", 2024-04-19T03:03:03.486 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:03.486 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.486 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.487 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:03.487 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:03.469545+0000", 2024-04-19T03:03:03.487 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6458999999999999e-05 2024-04-19T03:03:03.487 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.487 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.487 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:03.487 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:03.469552+0000", 2024-04-19T03:03:03.487 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2710000000000003e-06 2024-04-19T03:03:03.487 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.487 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.487 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:03.487 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:03.469593+0000", 2024-04-19T03:03:03.487 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0765e-05 2024-04-19T03:03:03.487 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.488 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.488 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:03.488 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:03.470076+0000", 2024-04-19T03:03:03.488 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00048287100000000001 2024-04-19T03:03:03.488 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.488 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.488 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:03.488 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:03.470199+0000", 2024-04-19T03:03:03.488 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000122464 2024-04-19T03:03:03.488 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.488 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.488 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:03:03.488 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:03.470301+0000", 2024-04-19T03:03:03.489 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000102551 2024-04-19T03:03:03.489 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.489 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.489 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:03.489 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:03.473547+0000", 2024-04-19T03:03:03.489 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.003246269 2024-04-19T03:03:03.489 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:03.489 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:03.489 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:03.489 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.489 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.489 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:171589 5.7 5:efcdf93b:::benchmark_data_smithi096_19531_object58139:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T03:03:03.489 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:03:03.471388+0000", 2024-04-19T03:03:03.489 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.002316205, 2024-04-19T03:03:03.490 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.002537114, 2024-04-19T03:03:03.490 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:03.490 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-04-19T03:03:03.490 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:03.490 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:03.490 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:03.490 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 171589 2024-04-19T03:03:03.490 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.490 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:03.490 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.490 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:03.490 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:03.471388+0000", 2024-04-19T03:03:03.490 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:03.490 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.491 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.491 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:03.491 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:03.471388+0000", 2024-04-19T03:03:03.491 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:03.491 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.491 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.491 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:03.491 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:03.471387+0000", 2024-04-19T03:03:03.491 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:03:03.491 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.491 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.491 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:03.491 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:03.471393+0000", 2024-04-19T03:03:03.491 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1419999999999998e-06 2024-04-19T03:03:03.492 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.492 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.492 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:03.492 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:03.471457+0000", 2024-04-19T03:03:03.492 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4132000000000002e-05 2024-04-19T03:03:03.492 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.492 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.492 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:03.492 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:03.471465+0000", 2024-04-19T03:03:03.492 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.3210000000000005e-06 2024-04-19T03:03:03.492 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.492 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.492 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:03.492 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:03.471512+0000", 2024-04-19T03:03:03.493 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6668000000000001e-05 2024-04-19T03:03:03.493 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.493 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.493 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:03.493 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:03.471679+0000", 2024-04-19T03:03:03.493 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00016670300000000001 2024-04-19T03:03:03.493 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:03.493 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:03.493 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:03.493 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.493 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.493 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:171590 5.d 5:b072d465:::benchmark_data_smithi096_19531_object58140:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T03:03:03.493 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:03:03.471479+0000", 2024-04-19T03:03:03.493 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0022248210000000001, 2024-04-19T03:03:03.494 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0025054790000000001, 2024-04-19T03:03:03.494 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:03.494 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:03:03.494 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:03.494 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:03.494 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:03.494 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 171590 2024-04-19T03:03:03.494 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.494 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:03.494 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.494 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:03.494 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:03.471479+0000", 2024-04-19T03:03:03.494 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:03.494 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.495 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.495 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:03.495 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:03.471479+0000", 2024-04-19T03:03:03.495 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:03.495 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.495 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.495 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:03.495 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:03.471479+0000", 2024-04-19T03:03:03.495 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:03.495 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.495 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.495 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:03.495 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:03.471482+0000", 2024-04-19T03:03:03.495 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7110000000000001e-06 2024-04-19T03:03:03.496 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.496 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.496 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:03.496 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:03.471491+0000", 2024-04-19T03:03:03.496 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2989999999999997e-06 2024-04-19T03:03:03.496 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.496 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.496 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:03.496 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:03.471496+0000", 2024-04-19T03:03:03.496 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8320000000000002e-06 2024-04-19T03:03:03.496 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.496 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.496 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:03.496 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:03.472123+0000", 2024-04-19T03:03:03.497 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000626473 2024-04-19T03:03:03.497 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.497 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.497 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:03.497 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:03.472246+0000", 2024-04-19T03:03:03.497 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00012318799999999999 2024-04-19T03:03:03.497 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.497 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.497 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:03:03.497 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:03.472385+0000", 2024-04-19T03:03:03.497 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00013941299999999999 2024-04-19T03:03:03.497 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:03.497 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:03.497 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:03.498 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.498 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.498 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:171592 5.f 5:f3219e75:::benchmark_data_smithi096_19531_object58142:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T03:03:03.498 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:03:03.471933+0000", 2024-04-19T03:03:03.498 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0017707000000000001, 2024-04-19T03:03:03.498 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0021330820000000001, 2024-04-19T03:03:03.498 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:03.498 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:03:03.498 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:03.498 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:03.498 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:03.498 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 171592 2024-04-19T03:03:03.498 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.499 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:03.499 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.499 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:03.499 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:03.471933+0000", 2024-04-19T03:03:03.499 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:03.499 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.499 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.499 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:03.499 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:03.471933+0000", 2024-04-19T03:03:03.499 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:03.499 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.499 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.499 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:03.499 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:03.471932+0000", 2024-04-19T03:03:03.499 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:03:03.500 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.500 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.500 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:03.500 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:03.471937+0000", 2024-04-19T03:03:03.500 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8520000000000003e-06 2024-04-19T03:03:03.500 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.500 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.500 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:03.500 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:03.471951+0000", 2024-04-19T03:03:03.500 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3601000000000001e-05 2024-04-19T03:03:03.500 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.500 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.500 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:03.500 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:03.471958+0000", 2024-04-19T03:03:03.501 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0469999999999996e-06 2024-04-19T03:03:03.501 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.501 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.501 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:03.501 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:03.472007+0000", 2024-04-19T03:03:03.501 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9067999999999998e-05 2024-04-19T03:03:03.501 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.501 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.501 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:03.501 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:03.472111+0000", 2024-04-19T03:03:03.501 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00010409200000000001 2024-04-19T03:03:03.501 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.501 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.501 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:03:03.502 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:03.472207+0000", 2024-04-19T03:03:03.502 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.5587000000000005e-05 2024-04-19T03:03:03.502 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:03.502 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:03.502 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:03.502 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.502 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.502 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:171593 5.6 5:6aeb30db:::benchmark_data_smithi096_19531_object58143:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T03:03:03.502 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:03:03.471978+0000", 2024-04-19T03:03:03.502 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0017263160000000001, 2024-04-19T03:03:03.502 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.002156678, 2024-04-19T03:03:03.502 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:03.502 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-04-19T03:03:03.502 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:03.503 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:03.503 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:03.503 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 171593 2024-04-19T03:03:03.503 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.503 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:03.503 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.503 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:03.503 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:03.471978+0000", 2024-04-19T03:03:03.503 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:03.503 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.503 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.503 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:03.503 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:03.471978+0000", 2024-04-19T03:03:03.503 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:03.503 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.504 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.504 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:03.504 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:03.471977+0000", 2024-04-19T03:03:03.504 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:03.504 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.504 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.504 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:03.504 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:03.471980+0000", 2024-04-19T03:03:03.504 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3220000000000001e-06 2024-04-19T03:03:03.504 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.504 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.504 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:03.504 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:03.471987+0000", 2024-04-19T03:03:03.504 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0140000000000001e-06 2024-04-19T03:03:03.505 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.505 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.505 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:03.505 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:03.471993+0000", 2024-04-19T03:03:03.505 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2689999999999999e-06 2024-04-19T03:03:03.505 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.505 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.505 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:03.505 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:03.472563+0000", 2024-04-19T03:03:03.505 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00057065100000000004 2024-04-19T03:03:03.505 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.505 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.505 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:03.505 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:03.472631+0000", 2024-04-19T03:03:03.506 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7181000000000006e-05 2024-04-19T03:03:03.506 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:03.506 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:03.506 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:03.506 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.506 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.506 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:171594 5.6 5.6fe0c406 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T03:03:03.506 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:03:03.473557+0000", 2024-04-19T03:03:03.506 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.00014731799999999999, 2024-04-19T03:03:03.506 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000640947, 2024-04-19T03:03:03.507 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:03.507 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-04-19T03:03:03.507 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:03.507 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:03.507 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:03.507 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 171594 2024-04-19T03:03:03.507 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.507 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:03.507 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.507 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:03.507 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:03.473557+0000", 2024-04-19T03:03:03.507 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:03.507 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.508 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.508 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:03.508 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:03.473557+0000", 2024-04-19T03:03:03.508 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:03.508 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.508 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.508 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:03.508 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:03.473556+0000", 2024-04-19T03:03:03.508 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:03:03.508 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.508 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.508 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:03.508 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:03.473561+0000", 2024-04-19T03:03:03.508 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4670000000000003e-06 2024-04-19T03:03:03.508 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.509 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.509 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:03.509 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:03.473570+0000", 2024-04-19T03:03:03.509 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.0990000000000005e-06 2024-04-19T03:03:03.509 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.509 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.509 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:03.509 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:03.473577+0000", 2024-04-19T03:03:03.509 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4559999999999997e-06 2024-04-19T03:03:03.509 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:03.509 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:03.509 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:03.509 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.509 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.510 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:171575 5.3 5:c0372f99:::benchmark_data_smithi096_19531_object58125:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T03:03:03.510 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:03:03.468411+0000", 2024-04-19T03:03:03.510 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0052933049999999999, 2024-04-19T03:03:03.510 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0058449579999999999, 2024-04-19T03:03:03.510 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:03.510 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-04-19T03:03:03.510 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:03.510 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:03.510 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:03.510 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 171575 2024-04-19T03:03:03.510 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.510 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:03.510 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.510 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:03.511 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:03.468411+0000", 2024-04-19T03:03:03.511 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:03.511 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.511 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.511 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:03.511 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:03.468411+0000", 2024-04-19T03:03:03.511 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:03.511 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.511 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.511 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:03.511 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:03.468410+0000", 2024-04-19T03:03:03.511 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:03:03.511 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.512 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.512 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:03.512 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:03.468415+0000", 2024-04-19T03:03:03.512 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4580000000000001e-06 2024-04-19T03:03:03.512 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.512 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.512 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:03.512 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:03.468426+0000", 2024-04-19T03:03:03.512 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0716999999999999e-05 2024-04-19T03:03:03.512 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.512 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.512 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:03.512 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:03.468443+0000", 2024-04-19T03:03:03.512 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7356000000000001e-05 2024-04-19T03:03:03.513 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.513 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.513 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:03.513 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:03.468502+0000", 2024-04-19T03:03:03.513 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9042000000000002e-05 2024-04-19T03:03:03.513 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.513 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.513 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:03.513 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:03.468623+0000", 2024-04-19T03:03:03.513 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00012058200000000001 2024-04-19T03:03:03.513 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:03.513 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:03.513 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:03.513 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.513 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.514 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:171576 5.2 5:4266a143:::benchmark_data_smithi096_19531_object58126:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T03:03:03.514 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:03:03.468466+0000", 2024-04-19T03:03:03.514 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0052383600000000001, 2024-04-19T03:03:03.514 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0058540049999999998, 2024-04-19T03:03:03.514 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:03.514 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:03.514 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:03.514 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:03.514 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:03.514 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 171576 2024-04-19T03:03:03.514 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.514 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:03.514 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.515 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:03.515 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:03.468466+0000", 2024-04-19T03:03:03.515 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:03.515 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.515 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.515 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:03.515 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:03.468466+0000", 2024-04-19T03:03:03.515 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:03.515 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.515 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.515 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:03.515 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:03.468465+0000", 2024-04-19T03:03:03.515 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:03.515 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.516 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.516 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:03.516 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:03.468469+0000", 2024-04-19T03:03:03.516 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.709e-06 2024-04-19T03:03:03.516 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.516 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.516 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:03.516 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:03.468487+0000", 2024-04-19T03:03:03.516 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8165e-05 2024-04-19T03:03:03.516 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.516 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.516 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:03.516 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:03.468493+0000", 2024-04-19T03:03:03.516 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1040000000000003e-06 2024-04-19T03:03:03.517 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.517 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.517 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:03.517 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:03.468595+0000", 2024-04-19T03:03:03.517 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00010178700000000001 2024-04-19T03:03:03.517 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.517 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.517 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:03.517 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:03.468757+0000", 2024-04-19T03:03:03.517 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00016187800000000001 2024-04-19T03:03:03.517 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.517 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.517 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:03:03.517 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:03.474157+0000", 2024-04-19T03:03:03.518 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0054005169999999996 2024-04-19T03:03:03.518 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.518 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.518 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:03:03.518 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:03.474250+0000", 2024-04-19T03:03:03.518 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.3196999999999996e-05 2024-04-19T03:03:03.518 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:03.518 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:03.518 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:03.518 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.518 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.518 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:171580 5.3 5:c56b4902:::benchmark_data_smithi096_19531_object58130:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T03:03:03.518 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:03:03.468745+0000", 2024-04-19T03:03:03.519 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0049592170000000001, 2024-04-19T03:03:03.519 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.005654381, 2024-04-19T03:03:03.519 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:03.519 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-04-19T03:03:03.519 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:03.519 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:03.519 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:03.519 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 171580 2024-04-19T03:03:03.519 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.519 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:03.519 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.519 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:03.519 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:03.468745+0000", 2024-04-19T03:03:03.519 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:03.520 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.520 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.520 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:03.520 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:03.468745+0000", 2024-04-19T03:03:03.520 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:03.520 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.520 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.520 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:03.520 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:03.468744+0000", 2024-04-19T03:03:03.520 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:03:03.520 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.520 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.520 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:03.520 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:03.468748+0000", 2024-04-19T03:03:03.521 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2869999999999998e-06 2024-04-19T03:03:03.521 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.521 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.521 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:03.521 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:03.468757+0000", 2024-04-19T03:03:03.521 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9230000000000008e-06 2024-04-19T03:03:03.521 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.521 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.521 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:03.521 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:03.468765+0000", 2024-04-19T03:03:03.521 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7009999999999996e-06 2024-04-19T03:03:03.521 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.521 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.521 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:03.521 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:03.470753+0000", 2024-04-19T03:03:03.522 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0019884730000000002 2024-04-19T03:03:03.522 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.522 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.522 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:03.522 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:03.470884+0000", 2024-04-19T03:03:03.522 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00013017000000000001 2024-04-19T03:03:03.522 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:03.522 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:03.522 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:03.522 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.522 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.522 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:171582 5.2 5:4d883fe8:::benchmark_data_smithi096_19531_object58132:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T03:03:03.522 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:03:03.469361+0000", 2024-04-19T03:03:03.523 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0043429949999999997, 2024-04-19T03:03:03.523 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0051027160000000002, 2024-04-19T03:03:03.523 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:03.523 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-04-19T03:03:03.523 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:03.523 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:03.523 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:03.523 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 171582 2024-04-19T03:03:03.523 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.523 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:03.523 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.523 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:03.523 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:03.469361+0000", 2024-04-19T03:03:03.523 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:03.523 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.524 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.524 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:03.524 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:03.469361+0000", 2024-04-19T03:03:03.524 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:03.524 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.524 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.524 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:03.524 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:03.469360+0000", 2024-04-19T03:03:03.524 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:03:03.524 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.524 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.524 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:03.524 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:03.469365+0000", 2024-04-19T03:03:03.524 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7990000000000001e-06 2024-04-19T03:03:03.525 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.525 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.525 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:03.525 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:03.469386+0000", 2024-04-19T03:03:03.525 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1257e-05 2024-04-19T03:03:03.525 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.525 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.525 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:03.525 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:03.469395+0000", 2024-04-19T03:03:03.525 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4470000000000006e-06 2024-04-19T03:03:03.525 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.525 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.525 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:03.525 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:03.470275+0000", 2024-04-19T03:03:03.526 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00088039100000000001 2024-04-19T03:03:03.526 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.526 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.526 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:03.526 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:03.470429+0000", 2024-04-19T03:03:03.526 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000154308 2024-04-19T03:03:03.526 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:03.526 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:03.526 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:03.526 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.526 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.526 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:171584 5.3 5:c0f60c10:::benchmark_data_smithi096_19531_object58134:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2024-04-19T03:03:03.526 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:03:03.469406+0000", 2024-04-19T03:03:03.526 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0042978410000000002, 2024-04-19T03:03:03.527 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0051228890000000003, 2024-04-19T03:03:03.527 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:03.527 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-04-19T03:03:03.527 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:03.527 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:03.527 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:03.527 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 171584 2024-04-19T03:03:03.527 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.527 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:03.527 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.527 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:03.527 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:03.469406+0000", 2024-04-19T03:03:03.527 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:03.527 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.528 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.528 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:03.528 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:03.469406+0000", 2024-04-19T03:03:03.528 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:03.528 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.528 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.528 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:03.528 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:03.469406+0000", 2024-04-19T03:03:03.528 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:03.528 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.528 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.528 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:03.528 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:03.469409+0000", 2024-04-19T03:03:03.528 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.49e-06 2024-04-19T03:03:03.529 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.529 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.529 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:03.529 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:03.469419+0000", 2024-04-19T03:03:03.529 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.4530000000000008e-06 2024-04-19T03:03:03.529 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.529 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.529 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:03.529 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:03.469424+0000", 2024-04-19T03:03:03.529 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7300000000000002e-06 2024-04-19T03:03:03.529 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.529 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.529 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:03.529 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:03.472619+0000", 2024-04-19T03:03:03.530 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0031949769999999999 2024-04-19T03:03:03.530 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.530 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.530 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:03.530 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:03.472725+0000", 2024-04-19T03:03:03.530 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000105234 2024-04-19T03:03:03.530 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:03.530 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:03.530 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:03.530 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:03.530 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-04-19T03:03:03.530 INFO:teuthology.orchestra.run.smithi144.stdout: "num_ops": 13 2024-04-19T03:03:03.530 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-04-19T03:03:03.531 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T03:03:03.545 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:03:03.540+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:03:03.560 INFO:teuthology.orchestra.run.smithi096.stderr:nodeep-scrub is set 2024-04-19T03:03:03.646 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:03:03.642+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:03:03.666 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-04-19T03:03:03.666 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2024-04-19T03:03:03.667 INFO:teuthology.orchestra.run.smithi144.stdout: "complaint_time": 30, 2024-04-19T03:03:03.667 INFO:teuthology.orchestra.run.smithi144.stdout: "num_blocked_ops": 0 2024-04-19T03:03:03.667 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-04-19T03:03:03.676 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T03:03:03.746 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:03:03.744+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:03:03.807 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-04-19T03:03:03.807 INFO:teuthology.orchestra.run.smithi144.stdout: "size": 20, 2024-04-19T03:03:03.807 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 600, 2024-04-19T03:03:03.807 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [ 2024-04-19T03:03:03.807 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.807 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:78992 5.7 5:e6baa862:::benchmark_data_smithi096_19531_object78991:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-19T03:03:03.807 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:18.008888+0000", 2024-04-19T03:03:03.807 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 45.795336452999997, 2024-04-19T03:03:03.807 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.056375285999999997, 2024-04-19T03:03:03.807 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:03.808 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:03.808 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:03.808 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:03.808 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:03.808 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 78992 2024-04-19T03:03:03.808 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.808 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:03.808 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.808 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:03.808 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.008888+0000", 2024-04-19T03:03:03.808 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:03.808 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.808 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.808 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:03.809 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.008888+0000", 2024-04-19T03:03:03.809 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:03.809 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.809 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.809 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:03.809 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.008888+0000", 2024-04-19T03:03:03.809 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:03.809 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.809 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.809 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:03.809 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.008928+0000", 2024-04-19T03:03:03.809 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0361999999999997e-05 2024-04-19T03:03:03.809 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.809 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.810 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:03.810 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.008942+0000", 2024-04-19T03:03:03.810 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4365000000000001e-05 2024-04-19T03:03:03.810 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.810 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.810 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:03.810 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.008949+0000", 2024-04-19T03:03:03.810 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.212e-06 2024-04-19T03:03:03.810 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.810 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.810 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:03.810 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.012683+0000", 2024-04-19T03:03:03.810 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.003733934 2024-04-19T03:03:03.811 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.811 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.811 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:03.811 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.012798+0000", 2024-04-19T03:03:03.811 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00011574999999999999 2024-04-19T03:03:03.811 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.811 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.811 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:03.811 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.012896+0000", 2024-04-19T03:03:03.811 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.7848000000000002e-05 2024-04-19T03:03:03.811 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.811 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.811 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:03:03.811 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016423+0000", 2024-04-19T03:03:03.812 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0035270789999999998 2024-04-19T03:03:03.812 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.812 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.812 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:03.812 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.065098+0000", 2024-04-19T03:03:03.812 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.048674651999999999 2024-04-19T03:03:03.812 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.812 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.812 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:03:03.812 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.065193+0000", 2024-04-19T03:03:03.812 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.5087999999999995e-05 2024-04-19T03:03:03.812 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.812 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.812 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:03.812 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.065264+0000", 2024-04-19T03:03:03.813 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0666000000000004e-05 2024-04-19T03:03:03.813 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:03.813 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:03.813 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:03.813 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.813 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.813 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4755.0:79003 5.2 e40/39 5:4436e33f:::benchmark_data_smithi096_19531_object79002:head v 40'4935, mlcod=40'4932)", 2024-04-19T03:03:03.813 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:18.018102+0000", 2024-04-19T03:03:03.813 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 45.786122397, 2024-04-19T03:03:03.813 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.060023990999999999, 2024-04-19T03:03:03.813 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:03.813 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:03.813 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:03.813 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.814 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:03.814 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018102+0000", 2024-04-19T03:03:03.814 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:03.814 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.814 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.814 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:03.814 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018102+0000", 2024-04-19T03:03:03.814 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:03.814 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.814 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.814 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:03.814 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018102+0000", 2024-04-19T03:03:03.815 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:03.815 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.815 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.815 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:03.815 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018134+0000", 2024-04-19T03:03:03.815 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2722000000000003e-05 2024-04-19T03:03:03.815 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.815 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.815 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:03.815 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018145+0000", 2024-04-19T03:03:03.815 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0395e-05 2024-04-19T03:03:03.815 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.815 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.815 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:03.815 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018151+0000", 2024-04-19T03:03:03.816 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5300000000000002e-06 2024-04-19T03:03:03.816 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.816 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.816 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:03.816 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018489+0000", 2024-04-19T03:03:03.816 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00033731499999999998 2024-04-19T03:03:03.816 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.816 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.816 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:03.816 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018508+0000", 2024-04-19T03:03:03.816 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9775e-05 2024-04-19T03:03:03.816 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.816 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.816 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:03:03.817 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.078059+0000", 2024-04-19T03:03:03.817 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.059550171999999998 2024-04-19T03:03:03.817 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.817 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.817 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:03.817 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.078126+0000", 2024-04-19T03:03:03.817 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7773000000000003e-05 2024-04-19T03:03:03.817 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:03.817 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:03.817 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:03.817 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.817 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.817 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:86612 5.7 5:e32e3c49:::benchmark_data_smithi096_19531_object86611:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:03.817 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:22.633560+0000", 2024-04-19T03:03:03.818 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 41.170664737000003, 2024-04-19T03:03:03.818 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.19135289, 2024-04-19T03:03:03.818 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:03.818 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:03.818 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:03.818 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:03.818 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:03.818 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 86612 2024-04-19T03:03:03.818 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.818 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:03.818 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.818 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:03.818 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633560+0000", 2024-04-19T03:03:03.818 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:03.819 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.819 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.819 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:03.819 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633560+0000", 2024-04-19T03:03:03.819 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:03.819 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.819 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.819 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:03.819 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633558+0000", 2024-04-19T03:03:03.819 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999986 2024-04-19T03:03:03.820 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.820 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.820 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:03.820 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633609+0000", 2024-04-19T03:03:03.820 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0850999999999998e-05 2024-04-19T03:03:03.820 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.820 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.820 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:03.820 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633627+0000", 2024-04-19T03:03:03.820 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7951000000000001e-05 2024-04-19T03:03:03.820 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.820 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.820 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:03.820 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633635+0000", 2024-04-19T03:03:03.820 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2530000000000004e-06 2024-04-19T03:03:03.821 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.821 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.821 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:03.821 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633699+0000", 2024-04-19T03:03:03.821 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3901999999999999e-05 2024-04-19T03:03:03.821 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.821 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.821 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:03.822 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633992+0000", 2024-04-19T03:03:03.822 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00029283299999999999 2024-04-19T03:03:03.822 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.822 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.822 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:03.822 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.634223+0000", 2024-04-19T03:03:03.822 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00023084200000000001 2024-04-19T03:03:03.822 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.822 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.822 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:03:03.822 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.639085+0000", 2024-04-19T03:03:03.823 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0048624269999999999 2024-04-19T03:03:03.823 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.823 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.823 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:03.823 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.824635+0000", 2024-04-19T03:03:03.823 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.18554944700000001 2024-04-19T03:03:03.823 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.823 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.823 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:03:03.823 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.824793+0000", 2024-04-19T03:03:03.823 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000157959 2024-04-19T03:03:03.823 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.823 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.823 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:03.824 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.824913+0000", 2024-04-19T03:03:03.824 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000120093 2024-04-19T03:03:03.824 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:03.824 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:03.824 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:03.824 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.824 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.824 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:86625 5.7 5:e6d00488:::benchmark_data_smithi096_19531_object86624:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:03.824 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:22.643554+0000", 2024-04-19T03:03:03.824 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 41.160670971000002, 2024-04-19T03:03:03.824 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.18732841, 2024-04-19T03:03:03.824 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:03.824 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:03.824 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:03.825 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:03.825 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:03.825 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 86625 2024-04-19T03:03:03.825 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.825 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:03.825 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.825 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:03.825 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643554+0000", 2024-04-19T03:03:03.825 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:03.825 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.825 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.825 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:03.825 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643554+0000", 2024-04-19T03:03:03.825 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:03.826 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.826 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.826 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:03.826 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643552+0000", 2024-04-19T03:03:03.826 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999986 2024-04-19T03:03:03.826 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.826 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.827 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:03.827 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643588+0000", 2024-04-19T03:03:03.827 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5855999999999997e-05 2024-04-19T03:03:03.827 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.827 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.827 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:03.828 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643606+0000", 2024-04-19T03:03:03.828 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8226000000000001e-05 2024-04-19T03:03:03.828 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.828 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.828 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:03.828 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643618+0000", 2024-04-19T03:03:03.828 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1868000000000001e-05 2024-04-19T03:03:03.828 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.828 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.828 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:03.828 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643676+0000", 2024-04-19T03:03:03.829 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8153999999999999e-05 2024-04-19T03:03:03.829 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.829 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.829 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:03.829 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643905+0000", 2024-04-19T03:03:03.829 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00022847500000000001 2024-04-19T03:03:03.829 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.829 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.829 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:03.829 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.644150+0000", 2024-04-19T03:03:03.829 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00024531800000000001 2024-04-19T03:03:03.830 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.830 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.830 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:03:03.830 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.647407+0000", 2024-04-19T03:03:03.830 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0032563190000000001 2024-04-19T03:03:03.830 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.830 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.830 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:03.830 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.830721+0000", 2024-04-19T03:03:03.830 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.18331468300000001 2024-04-19T03:03:03.830 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.830 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.831 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:03:03.831 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.830813+0000", 2024-04-19T03:03:03.831 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.2205000000000002e-05 2024-04-19T03:03:03.831 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.831 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.831 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:03.831 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.830882+0000", 2024-04-19T03:03:03.831 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8819999999999995e-05 2024-04-19T03:03:03.831 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:03.831 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:03.831 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:03.831 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.831 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.831 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87063 5.7 5:e502e824:::benchmark_data_smithi096_19531_object87062:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:03.831 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.136067+0000", 2024-04-19T03:03:03.832 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 40.668158102, 2024-04-19T03:03:03.832 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.065521159999999995, 2024-04-19T03:03:03.832 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:03.832 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:03.832 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:03.832 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:03.832 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:03.832 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87063 2024-04-19T03:03:03.832 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.832 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:03.832 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.832 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:03.832 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.136067+0000", 2024-04-19T03:03:03.832 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:03.833 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.833 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.833 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:03.833 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.136067+0000", 2024-04-19T03:03:03.833 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:03.833 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.833 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.833 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:03.833 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.136066+0000", 2024-04-19T03:03:03.833 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:03:03.833 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.833 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.833 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:03.833 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.136154+0000", 2024-04-19T03:03:03.834 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.8256000000000003e-05 2024-04-19T03:03:03.834 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.834 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.834 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:03.834 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.136162+0000", 2024-04-19T03:03:03.834 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.5099999999999998e-06 2024-04-19T03:03:03.834 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.834 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.834 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:03.834 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.136171+0000", 2024-04-19T03:03:03.834 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2830000000000001e-06 2024-04-19T03:03:03.834 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.834 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.834 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:03.835 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.138421+0000", 2024-04-19T03:03:03.835 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0022506620000000001 2024-04-19T03:03:03.835 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.835 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.835 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:03.835 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.138560+0000", 2024-04-19T03:03:03.835 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000138446 2024-04-19T03:03:03.835 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.835 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.835 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:03.835 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.138689+0000", 2024-04-19T03:03:03.835 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00012950700000000001 2024-04-19T03:03:03.835 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.835 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.835 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:03:03.836 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.141517+0000", 2024-04-19T03:03:03.836 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0028280860000000001 2024-04-19T03:03:03.836 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.836 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.836 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:03.836 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.201350+0000", 2024-04-19T03:03:03.836 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.059832418999999998 2024-04-19T03:03:03.836 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.836 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.836 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:03:03.836 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.201485+0000", 2024-04-19T03:03:03.836 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000135597 2024-04-19T03:03:03.836 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.837 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.837 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:03.837 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.201588+0000", 2024-04-19T03:03:03.837 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00010247900000000001 2024-04-19T03:03:03.837 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:03.837 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:03.837 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:03.837 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.837 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.837 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87072 5.7 5:e3c7809a:::benchmark_data_smithi096_19531_object87071:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:03.837 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.144224+0000", 2024-04-19T03:03:03.837 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 40.660001078000001, 2024-04-19T03:03:03.837 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.058179555000000001, 2024-04-19T03:03:03.838 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:03.838 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:03.838 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:03.838 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:03.838 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:03.838 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87072 2024-04-19T03:03:03.838 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.838 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:03.838 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.838 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:03.838 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144224+0000", 2024-04-19T03:03:03.838 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:03.838 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.838 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.839 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:03.839 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144224+0000", 2024-04-19T03:03:03.839 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:03.839 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.839 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.839 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:03.839 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144223+0000", 2024-04-19T03:03:03.839 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:03:03.839 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.839 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.839 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:03.839 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144320+0000", 2024-04-19T03:03:03.839 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.7075000000000001e-05 2024-04-19T03:03:03.839 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.840 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.840 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:03.840 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144331+0000", 2024-04-19T03:03:03.840 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1342000000000001e-05 2024-04-19T03:03:03.840 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.840 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.840 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:03.840 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144337+0000", 2024-04-19T03:03:03.840 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8390000000000003e-06 2024-04-19T03:03:03.840 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.840 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.840 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:03.840 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144369+0000", 2024-04-19T03:03:03.840 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2079000000000002e-05 2024-04-19T03:03:03.840 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.841 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.841 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:03.841 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144464+0000", 2024-04-19T03:03:03.841 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.4623000000000005e-05 2024-04-19T03:03:03.841 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.841 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.841 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:03.841 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144553+0000", 2024-04-19T03:03:03.841 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9171000000000004e-05 2024-04-19T03:03:03.841 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.841 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.841 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:03:03.841 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.147018+0000", 2024-04-19T03:03:03.841 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0024648370000000001 2024-04-19T03:03:03.842 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.842 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.842 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:03.842 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.202270+0000", 2024-04-19T03:03:03.842 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.055252018 2024-04-19T03:03:03.842 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.842 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.842 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:03:03.842 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.202356+0000", 2024-04-19T03:03:03.842 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6648000000000001e-05 2024-04-19T03:03:03.842 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.842 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.842 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:03.842 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.202403+0000", 2024-04-19T03:03:03.843 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6956999999999998e-05 2024-04-19T03:03:03.843 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:03.843 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:03.843 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:03.843 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.843 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.843 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87123 5.6 5:6d1bc3b9:::benchmark_data_smithi096_19531_object87122:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:03:03.843 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249233+0000", 2024-04-19T03:03:03.843 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 40.554992046000002, 2024-04-19T03:03:03.843 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0291700720000001, 2024-04-19T03:03:03.843 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:03.843 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-04-19T03:03:03.843 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:03.843 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:03.844 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:03.844 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87123 2024-04-19T03:03:03.844 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.844 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:03.844 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.844 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:03.844 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249233+0000", 2024-04-19T03:03:03.844 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:03.844 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.844 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.844 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:03.844 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249233+0000", 2024-04-19T03:03:03.844 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:03.844 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.845 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.845 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:03.845 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249231+0000", 2024-04-19T03:03:03.845 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999986 2024-04-19T03:03:03.845 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.845 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.845 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:03.845 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249285+0000", 2024-04-19T03:03:03.845 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4005000000000002e-05 2024-04-19T03:03:03.845 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.845 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.845 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:03.845 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249300+0000", 2024-04-19T03:03:03.845 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4715999999999999e-05 2024-04-19T03:03:03.845 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.846 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.846 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:03.846 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249307+0000", 2024-04-19T03:03:03.846 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8399999999999997e-06 2024-04-19T03:03:03.846 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.846 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.846 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:03.846 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249366+0000", 2024-04-19T03:03:03.846 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9435999999999998e-05 2024-04-19T03:03:03.846 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.846 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.846 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op must wait for map", 2024-04-19T03:03:03.846 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249376+0000", 2024-04-19T03:03:03.847 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.4919999999999999e-06 2024-04-19T03:03:03.847 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.847 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.847 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:03.847 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263757+0000", 2024-04-19T03:03:03.847 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.014381461999999999 2024-04-19T03:03:03.847 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.847 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.847 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:03:03.847 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263875+0000", 2024-04-19T03:03:03.847 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000117166 2024-04-19T03:03:03.847 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.847 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.847 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:03.848 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.277136+0000", 2024-04-19T03:03:03.848 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.013261207 2024-04-19T03:03:03.848 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.848 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.848 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:03.848 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.278403+0000", 2024-04-19T03:03:03.848 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001267106 2024-04-19T03:03:03.848 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:03.848 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:03.848 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:03.848 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.848 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.848 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87128 5.6 5:6905c420:::benchmark_data_smithi096_19531_object87127:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:03:03.848 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249323+0000", 2024-04-19T03:03:03.848 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 40.554901299000001, 2024-04-19T03:03:03.849 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0292813249999999, 2024-04-19T03:03:03.849 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:03.849 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-04-19T03:03:03.849 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:03.849 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:03.849 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:03.849 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87128 2024-04-19T03:03:03.849 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.849 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:03.849 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.849 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:03.849 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249323+0000", 2024-04-19T03:03:03.849 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:03.849 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.850 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.850 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:03.850 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249323+0000", 2024-04-19T03:03:03.850 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:03.850 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.850 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.850 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:03.850 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249323+0000", 2024-04-19T03:03:03.850 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:03.850 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.850 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.850 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:03.850 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249385+0000", 2024-04-19T03:03:03.850 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1711999999999995e-05 2024-04-19T03:03:03.851 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.851 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.851 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:03.851 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249398+0000", 2024-04-19T03:03:03.851 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3022e-05 2024-04-19T03:03:03.851 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.851 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.851 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:03.851 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249402+0000", 2024-04-19T03:03:03.851 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4819999999999996e-06 2024-04-19T03:03:03.851 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.851 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.851 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:03.851 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249437+0000", 2024-04-19T03:03:03.852 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4702000000000001e-05 2024-04-19T03:03:03.852 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.852 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.852 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:03:03.852 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249442+0000", 2024-04-19T03:03:03.852 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8019999999999999e-06 2024-04-19T03:03:03.852 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.852 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.852 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:03.852 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263896+0000", 2024-04-19T03:03:03.852 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.014454679999999999 2024-04-19T03:03:03.852 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.852 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.852 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:03:03.853 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263900+0000", 2024-04-19T03:03:03.853 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9700000000000001e-06 2024-04-19T03:03:03.853 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.853 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.853 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:03.853 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.278557+0000", 2024-04-19T03:03:03.853 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0146566480000001 2024-04-19T03:03:03.853 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.853 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.853 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:03.853 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.278605+0000", 2024-04-19T03:03:03.854 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7735999999999998e-05 2024-04-19T03:03:03.854 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:03.854 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:03.854 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:03.854 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.854 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.854 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87130 5.3 5:c8c2d67b:::benchmark_data_smithi096_19531_object87129:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:03:03.854 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249418+0000", 2024-04-19T03:03:03.854 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 40.554806587999998, 2024-04-19T03:03:03.854 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.025414182, 2024-04-19T03:03:03.854 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:03.854 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-04-19T03:03:03.854 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:03.855 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:03.855 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:03.855 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87130 2024-04-19T03:03:03.855 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.855 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:03.855 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.855 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:03.855 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249418+0000", 2024-04-19T03:03:03.855 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:03.855 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.855 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.856 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:03.856 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249418+0000", 2024-04-19T03:03:03.856 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:03.856 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.856 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.856 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:03.856 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249409+0000", 2024-04-19T03:03:03.856 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999905 2024-04-19T03:03:03.856 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.856 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.856 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:03.856 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249464+0000", 2024-04-19T03:03:03.856 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5381999999999999e-05 2024-04-19T03:03:03.856 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.857 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.857 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:03.857 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249471+0000", 2024-04-19T03:03:03.857 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2609999999999996e-06 2024-04-19T03:03:03.857 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.857 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.857 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:03.857 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249475+0000", 2024-04-19T03:03:03.857 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2839999999999998e-06 2024-04-19T03:03:03.857 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.857 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.857 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:03.857 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249535+0000", 2024-04-19T03:03:03.857 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0545999999999999e-05 2024-04-19T03:03:03.858 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.858 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.858 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op must wait for map", 2024-04-19T03:03:03.858 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249540+0000", 2024-04-19T03:03:03.858 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2859999999999999e-06 2024-04-19T03:03:03.858 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.858 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.858 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:03.858 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263450+0000", 2024-04-19T03:03:03.858 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.013909585 2024-04-19T03:03:03.858 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.858 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.858 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:03:03.858 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263458+0000", 2024-04-19T03:03:03.859 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8089999999999993e-06 2024-04-19T03:03:03.859 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.859 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.859 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:03.859 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.273193+0000", 2024-04-19T03:03:03.859 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0097351379999999 2024-04-19T03:03:03.859 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.859 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.859 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:03.859 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.274832+0000", 2024-04-19T03:03:03.859 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0016394789999999999 2024-04-19T03:03:03.859 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:03.859 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:03.860 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:03.860 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.860 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.860 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87131 5.1 5:83756d55:::benchmark_data_smithi096_19531_object87130:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:03:03.860 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249491+0000", 2024-04-19T03:03:03.860 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 40.554733941000002, 2024-04-19T03:03:03.860 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0191489520000001, 2024-04-19T03:03:03.860 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:03.861 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-04-19T03:03:03.861 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:03.861 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:03.861 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:03.861 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87131 2024-04-19T03:03:03.861 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.861 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:03.861 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.861 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:03.861 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249491+0000", 2024-04-19T03:03:03.861 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:03.862 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.862 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.862 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:03.862 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249491+0000", 2024-04-19T03:03:03.862 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:03.862 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.862 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.862 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:03.862 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249491+0000", 2024-04-19T03:03:03.862 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:03.862 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.862 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.862 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:03.863 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249530+0000", 2024-04-19T03:03:03.863 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9589000000000003e-05 2024-04-19T03:03:03.863 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.863 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.863 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:03.863 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249544+0000", 2024-04-19T03:03:03.863 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4158000000000001e-05 2024-04-19T03:03:03.863 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.863 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.863 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:03.863 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249549+0000", 2024-04-19T03:03:03.863 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6809999999999997e-06 2024-04-19T03:03:03.863 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.863 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.864 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:03.864 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249592+0000", 2024-04-19T03:03:03.864 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3285999999999999e-05 2024-04-19T03:03:03.864 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.864 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.864 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op must wait for map", 2024-04-19T03:03:03.864 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249598+0000", 2024-04-19T03:03:03.864 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8329999999999999e-06 2024-04-19T03:03:03.864 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.864 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.864 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:03.864 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263331+0000", 2024-04-19T03:03:03.864 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.013733093 2024-04-19T03:03:03.865 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.865 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.865 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:03:03.865 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263343+0000", 2024-04-19T03:03:03.865 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.189e-05 2024-04-19T03:03:03.865 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.865 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.865 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:03.865 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.268541+0000", 2024-04-19T03:03:03.865 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0051983440000001 2024-04-19T03:03:03.866 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.866 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.866 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:03.866 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.268640+0000", 2024-04-19T03:03:03.866 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.8387999999999994e-05 2024-04-19T03:03:03.866 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:03.866 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:03.866 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:03.866 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.866 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.866 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87132 5.c 5:3e18b732:::benchmark_data_smithi096_19531_object87131:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:03:03.866 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249558+0000", 2024-04-19T03:03:03.866 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 40.554667039999998, 2024-04-19T03:03:03.866 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0241198380000001, 2024-04-19T03:03:03.867 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:03.867 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-04-19T03:03:03.867 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:03.867 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:03.867 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:03.867 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87132 2024-04-19T03:03:03.867 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.867 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:03.867 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.867 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:03.867 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249558+0000", 2024-04-19T03:03:03.867 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:03.868 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.868 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.868 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:03.868 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249558+0000", 2024-04-19T03:03:03.868 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:03.868 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.869 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.869 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:03.869 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249557+0000", 2024-04-19T03:03:03.869 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:03.869 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.869 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.869 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:03.869 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249625+0000", 2024-04-19T03:03:03.869 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7200999999999996e-05 2024-04-19T03:03:03.869 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.869 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.870 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:03.871 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249646+0000", 2024-04-19T03:03:03.871 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1053e-05 2024-04-19T03:03:03.871 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.871 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.871 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:03.871 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249650+0000", 2024-04-19T03:03:03.871 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2719999999999999e-06 2024-04-19T03:03:03.872 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.873 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.873 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:03.873 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249686+0000", 2024-04-19T03:03:03.873 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6430000000000002e-05 2024-04-19T03:03:03.873 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.873 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.874 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op must wait for map", 2024-04-19T03:03:03.874 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249690+0000", 2024-04-19T03:03:03.874 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.765e-06 2024-04-19T03:03:03.874 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.874 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.874 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:03.874 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261157+0000", 2024-04-19T03:03:03.874 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011467247999999999 2024-04-19T03:03:03.874 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.874 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.874 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:03:03.874 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261170+0000", 2024-04-19T03:03:03.874 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2833000000000001e-05 2024-04-19T03:03:03.875 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.875 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.875 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:03.875 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.272119+0000", 2024-04-19T03:03:03.875 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.010949313 2024-04-19T03:03:03.875 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.875 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.875 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:03.875 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.273678+0000", 2024-04-19T03:03:03.875 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0015581550000000001 2024-04-19T03:03:03.875 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:03.875 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:03.875 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:03.876 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.876 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.876 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87133 5.c 5:3f772a62:::benchmark_data_smithi096_19531_object87132:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:03:03.876 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249657+0000", 2024-04-19T03:03:03.876 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 40.554567661, 2024-04-19T03:03:03.876 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0242819409999999, 2024-04-19T03:03:03.876 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:03.876 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-04-19T03:03:03.876 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:03.876 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:03.876 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:03.876 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87133 2024-04-19T03:03:03.876 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.876 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:03.877 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.877 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:03.877 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249657+0000", 2024-04-19T03:03:03.877 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:03.877 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.877 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.877 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:03.877 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249657+0000", 2024-04-19T03:03:03.877 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:03.877 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.877 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.877 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:03.877 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249657+0000", 2024-04-19T03:03:03.877 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:03.877 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.878 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.878 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:03.878 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249690+0000", 2024-04-19T03:03:03.878 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3343000000000002e-05 2024-04-19T03:03:03.878 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.878 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.878 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:03.878 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249695+0000", 2024-04-19T03:03:03.878 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8600000000000001e-06 2024-04-19T03:03:03.878 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.878 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.878 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:03.878 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249698+0000", 2024-04-19T03:03:03.878 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.1700000000000001e-06 2024-04-19T03:03:03.879 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.879 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.879 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:03.879 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249741+0000", 2024-04-19T03:03:03.879 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2849999999999998e-05 2024-04-19T03:03:03.879 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.879 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.879 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:03:03.879 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249746+0000", 2024-04-19T03:03:03.879 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1019999999999996e-06 2024-04-19T03:03:03.879 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.879 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.879 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:03.879 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261209+0000", 2024-04-19T03:03:03.879 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011462447000000001 2024-04-19T03:03:03.880 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.880 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.880 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:03:03.880 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261216+0000", 2024-04-19T03:03:03.880 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8520000000000004e-06 2024-04-19T03:03:03.880 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.880 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.880 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:03.880 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.273872+0000", 2024-04-19T03:03:03.880 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0126558000000001 2024-04-19T03:03:03.880 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.880 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.880 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:03.880 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.273939+0000", 2024-04-19T03:03:03.880 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6822000000000005e-05 2024-04-19T03:03:03.881 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:03.881 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:03.881 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:03.881 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.881 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.881 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87134 5.5 5:a56c478f:::benchmark_data_smithi096_19531_object87133:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:03:03.881 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249708+0000", 2024-04-19T03:03:03.881 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 40.554516737, 2024-04-19T03:03:03.881 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0214677299999999, 2024-04-19T03:03:03.881 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:03.881 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-04-19T03:03:03.881 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:03.881 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:03.882 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:03.882 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87134 2024-04-19T03:03:03.882 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.882 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:03.882 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.882 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:03.882 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249708+0000", 2024-04-19T03:03:03.882 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:03.882 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.882 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.882 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:03.882 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249708+0000", 2024-04-19T03:03:03.882 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:03.882 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.883 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.883 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:03.883 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249706+0000", 2024-04-19T03:03:03.883 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999976 2024-04-19T03:03:03.883 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.883 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.883 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:03.883 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249740+0000", 2024-04-19T03:03:03.883 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4458000000000001e-05 2024-04-19T03:03:03.883 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.883 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.883 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:03.883 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249745+0000", 2024-04-19T03:03:03.883 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5020000000000003e-06 2024-04-19T03:03:03.884 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.884 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.884 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:03.884 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249748+0000", 2024-04-19T03:03:03.884 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2499999999999998e-06 2024-04-19T03:03:03.884 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.884 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.884 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:03.884 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249778+0000", 2024-04-19T03:03:03.884 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.006e-05 2024-04-19T03:03:03.884 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.884 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.884 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op must wait for map", 2024-04-19T03:03:03.884 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249782+0000", 2024-04-19T03:03:03.885 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2910000000000001e-06 2024-04-19T03:03:03.885 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.885 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.885 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:03.885 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261666+0000", 2024-04-19T03:03:03.885 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011883471 2024-04-19T03:03:03.885 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.885 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.885 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:03:03.885 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261674+0000", 2024-04-19T03:03:03.885 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6479999999999992e-06 2024-04-19T03:03:03.885 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.885 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.885 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:03.886 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.269323+0000", 2024-04-19T03:03:03.886 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.00764867 2024-04-19T03:03:03.886 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.886 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.886 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:03.886 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.271176+0000", 2024-04-19T03:03:03.886 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001852844 2024-04-19T03:03:03.886 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:03.886 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:03.886 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:03.886 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.886 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.886 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87137 5.c 5:30708c68:::benchmark_data_smithi096_19531_object87136:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:03:03.886 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249756+0000", 2024-04-19T03:03:03.886 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 40.554469030999996, 2024-04-19T03:03:03.887 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.033331752, 2024-04-19T03:03:03.887 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:03.887 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:03.887 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:03.887 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:03.887 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:03.887 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87137 2024-04-19T03:03:03.887 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.887 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:03.887 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.887 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:03.887 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249756+0000", 2024-04-19T03:03:03.887 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:03.887 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.888 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.888 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:03.888 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249756+0000", 2024-04-19T03:03:03.888 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:03.888 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.888 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.888 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:03.888 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249755+0000", 2024-04-19T03:03:03.889 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:03.889 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.889 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.889 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:03.889 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249777+0000", 2024-04-19T03:03:03.889 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1420000000000002e-05 2024-04-19T03:03:03.889 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.889 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.889 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:03.889 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249781+0000", 2024-04-19T03:03:03.889 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0609999999999997e-06 2024-04-19T03:03:03.889 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.889 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.889 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:03.890 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249787+0000", 2024-04-19T03:03:03.890 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.02e-06 2024-04-19T03:03:03.890 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.890 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.890 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:03.890 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249818+0000", 2024-04-19T03:03:03.890 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0947e-05 2024-04-19T03:03:03.891 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.891 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.891 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:03:03.891 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249821+0000", 2024-04-19T03:03:03.891 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.117e-06 2024-04-19T03:03:03.891 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.891 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.891 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:03.891 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261243+0000", 2024-04-19T03:03:03.891 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011421875999999999 2024-04-19T03:03:03.891 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.891 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.891 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:03:03.892 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261251+0000", 2024-04-19T03:03:03.892 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6120000000000001e-06 2024-04-19T03:03:03.892 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.892 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.892 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:03.892 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.274050+0000", 2024-04-19T03:03:03.892 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.012799405 2024-04-19T03:03:03.892 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.892 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.892 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:03.892 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.274529+0000", 2024-04-19T03:03:03.892 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00047867100000000001 2024-04-19T03:03:03.892 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.892 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.893 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:03:03.893 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.282972+0000", 2024-04-19T03:03:03.893 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0084436900000000002 2024-04-19T03:03:03.893 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.893 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.893 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:03:03.893 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.283022+0000", 2024-04-19T03:03:03.893 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9339000000000003e-05 2024-04-19T03:03:03.893 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.893 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.893 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:03.893 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.283088+0000", 2024-04-19T03:03:03.893 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5877999999999995e-05 2024-04-19T03:03:03.893 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:03.893 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:03.894 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:03.894 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.894 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.894 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:158376 5.9 5:9e73c076:::benchmark_data_smithi096_19531_object44926:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-19T03:03:03.894 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:58.126227+0000", 2024-04-19T03:03:03.894 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 5.6779972980000002, 2024-04-19T03:03:03.894 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.069738668000000004, 2024-04-19T03:03:03.894 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:03.894 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:03.894 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:03.894 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:03.894 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:03.894 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 158376 2024-04-19T03:03:03.895 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.895 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:03.895 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.895 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:03.895 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.126227+0000", 2024-04-19T03:03:03.895 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:03.895 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.895 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.895 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:03.895 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.126227+0000", 2024-04-19T03:03:03.895 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:03.895 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.895 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.895 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:03.895 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.126226+0000", 2024-04-19T03:03:03.896 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:03:03.896 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.896 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.896 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:03.896 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.126236+0000", 2024-04-19T03:03:03.896 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.4199999999999996e-06 2024-04-19T03:03:03.896 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.896 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.896 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:03.896 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.126243+0000", 2024-04-19T03:03:03.896 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.199e-06 2024-04-19T03:03:03.896 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.896 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.897 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:03.897 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.126248+0000", 2024-04-19T03:03:03.897 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1320000000000002e-06 2024-04-19T03:03:03.897 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.897 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.897 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:03.897 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.126286+0000", 2024-04-19T03:03:03.897 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7401000000000003e-05 2024-04-19T03:03:03.897 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.897 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.897 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:03.897 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.126368+0000", 2024-04-19T03:03:03.897 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2113999999999993e-05 2024-04-19T03:03:03.897 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.897 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.898 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:03:03.898 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.126438+0000", 2024-04-19T03:03:03.898 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0337000000000001e-05 2024-04-19T03:03:03.898 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.898 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.898 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:03:03.898 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.130816+0000", 2024-04-19T03:03:03.898 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0043778330000000002 2024-04-19T03:03:03.898 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.898 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.898 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:03.898 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.195830+0000", 2024-04-19T03:03:03.898 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.065013933999999995 2024-04-19T03:03:03.899 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.899 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.899 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:03:03.899 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.195907+0000", 2024-04-19T03:03:03.899 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7397000000000005e-05 2024-04-19T03:03:03.899 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.899 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.899 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:03.899 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.195966+0000", 2024-04-19T03:03:03.899 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8906999999999997e-05 2024-04-19T03:03:03.899 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:03.899 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:03.899 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:03.899 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.899 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.900 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:158381 5.9 5:94dcd4a7:::benchmark_data_smithi096_19531_object44931:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-19T03:03:03.900 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:58.128712+0000", 2024-04-19T03:03:03.900 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 5.675512855, 2024-04-19T03:03:03.900 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.067497527000000002, 2024-04-19T03:03:03.900 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:03.900 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:03.900 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:03.900 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:03.900 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:03.900 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 158381 2024-04-19T03:03:03.900 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.900 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:03.901 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.901 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:03.901 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.128712+0000", 2024-04-19T03:03:03.901 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:03.901 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.901 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.901 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:03.901 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.128712+0000", 2024-04-19T03:03:03.901 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:03.901 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.901 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.901 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:03.901 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.128711+0000", 2024-04-19T03:03:03.901 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:03:03.902 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.902 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.902 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:03.902 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.128716+0000", 2024-04-19T03:03:03.902 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0610000000000003e-06 2024-04-19T03:03:03.902 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.902 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.902 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:03.902 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.128724+0000", 2024-04-19T03:03:03.903 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0120000000000005e-06 2024-04-19T03:03:03.903 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.903 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.903 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:03.903 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.128729+0000", 2024-04-19T03:03:03.903 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8899999999999998e-06 2024-04-19T03:03:03.904 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.904 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.904 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:03.904 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.128778+0000", 2024-04-19T03:03:03.904 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9110000000000002e-05 2024-04-19T03:03:03.904 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.904 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.904 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:03.905 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.128903+0000", 2024-04-19T03:03:03.905 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00012506799999999999 2024-04-19T03:03:03.905 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.905 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.905 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:03:03.905 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.129022+0000", 2024-04-19T03:03:03.905 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00011923599999999999 2024-04-19T03:03:03.905 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.905 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.906 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:03:03.906 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.132294+0000", 2024-04-19T03:03:03.906 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.003271244 2024-04-19T03:03:03.906 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.906 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.906 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:03.906 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.196045+0000", 2024-04-19T03:03:03.906 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.063751206000000005 2024-04-19T03:03:03.906 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.906 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.906 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:03:03.906 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.196133+0000", 2024-04-19T03:03:03.906 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.8213000000000004e-05 2024-04-19T03:03:03.907 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.907 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.907 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:03.907 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.196209+0000", 2024-04-19T03:03:03.907 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6335999999999996e-05 2024-04-19T03:03:03.907 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:03.907 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:03.907 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:03.907 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.908 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.908 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:158385 5.9 5:950ec749:::benchmark_data_smithi096_19531_object44935:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-19T03:03:03.908 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:58.129756+0000", 2024-04-19T03:03:03.908 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 5.6744689230000001, 2024-04-19T03:03:03.908 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.068998382999999996, 2024-04-19T03:03:03.908 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:03.908 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:03.908 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:03.908 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:03.908 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:03.908 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 158385 2024-04-19T03:03:03.908 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.908 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:03.908 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.908 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:03.909 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.129756+0000", 2024-04-19T03:03:03.909 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:03.909 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.909 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.909 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:03.909 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.129756+0000", 2024-04-19T03:03:03.909 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:03.909 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.909 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.909 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:03.909 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.129755+0000", 2024-04-19T03:03:03.910 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:03:03.910 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.910 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.910 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:03.910 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.129760+0000", 2024-04-19T03:03:03.910 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6030000000000004e-06 2024-04-19T03:03:03.910 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.911 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.911 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:03.911 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.129774+0000", 2024-04-19T03:03:03.911 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3131e-05 2024-04-19T03:03:03.911 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.911 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.911 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:03.911 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.129781+0000", 2024-04-19T03:03:03.911 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4030000000000001e-06 2024-04-19T03:03:03.912 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.912 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.912 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:03.912 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.130837+0000", 2024-04-19T03:03:03.912 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00105569 2024-04-19T03:03:03.912 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.912 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.912 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:03.912 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.130917+0000", 2024-04-19T03:03:03.912 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9929e-05 2024-04-19T03:03:03.912 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.912 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.912 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:03:03.912 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.130973+0000", 2024-04-19T03:03:03.913 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.664e-05 2024-04-19T03:03:03.913 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.913 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.913 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:03:03.913 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.132340+0000", 2024-04-19T03:03:03.913 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001366321 2024-04-19T03:03:03.913 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.913 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.913 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:03.913 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.198637+0000", 2024-04-19T03:03:03.913 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.066296888999999998 2024-04-19T03:03:03.913 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.913 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.914 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:03:03.914 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.198704+0000", 2024-04-19T03:03:03.914 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7333000000000001e-05 2024-04-19T03:03:03.914 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.914 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.914 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:03.914 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.198754+0000", 2024-04-19T03:03:03.914 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0421999999999999e-05 2024-04-19T03:03:03.914 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:03.914 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:03.914 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:03.914 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.915 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.915 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:158387 5.9 5:9e96f619:::benchmark_data_smithi096_19531_object44937:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-19T03:03:03.915 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:58.132457+0000", 2024-04-19T03:03:03.915 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 5.6717673590000004, 2024-04-19T03:03:03.915 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.066858091999999994, 2024-04-19T03:03:03.915 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:03.915 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:03.915 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:03.915 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:03.915 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:03.915 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 158387 2024-04-19T03:03:03.915 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.915 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:03.915 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.916 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:03.916 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.132457+0000", 2024-04-19T03:03:03.916 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:03.916 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.916 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.916 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:03.916 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.132457+0000", 2024-04-19T03:03:03.916 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:03.916 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.916 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.916 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:03.916 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.132457+0000", 2024-04-19T03:03:03.916 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:03.917 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.917 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.917 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:03.917 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.132460+0000", 2024-04-19T03:03:03.917 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.1949999999999999e-06 2024-04-19T03:03:03.917 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.917 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.917 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:03.917 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.132468+0000", 2024-04-19T03:03:03.917 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.1599999999999998e-06 2024-04-19T03:03:03.917 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.917 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.917 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:03.917 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.132473+0000", 2024-04-19T03:03:03.917 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9259999999999999e-06 2024-04-19T03:03:03.918 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.918 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.918 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:03.918 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.132504+0000", 2024-04-19T03:03:03.918 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0914000000000003e-05 2024-04-19T03:03:03.918 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.918 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.918 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:03.918 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.132646+0000", 2024-04-19T03:03:03.918 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00014214300000000001 2024-04-19T03:03:03.918 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.918 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.918 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:03:03.919 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.132741+0000", 2024-04-19T03:03:03.919 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.4344000000000003e-05 2024-04-19T03:03:03.919 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.919 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.919 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:03:03.919 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.135774+0000", 2024-04-19T03:03:03.919 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0030334960000000001 2024-04-19T03:03:03.919 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.919 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.919 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:03.919 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.199240+0000", 2024-04-19T03:03:03.920 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.063465695000000003 2024-04-19T03:03:03.920 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.920 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.920 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:03:03.920 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.199272+0000", 2024-04-19T03:03:03.920 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2412000000000001e-05 2024-04-19T03:03:03.920 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.920 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.920 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:03.920 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.199316+0000", 2024-04-19T03:03:03.920 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3275000000000002e-05 2024-04-19T03:03:03.920 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:03.921 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:03.921 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:03.921 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.921 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.921 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:158392 5.f 5:f462725f:::benchmark_data_smithi096_19531_object44942:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-19T03:03:03.921 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:58.135703+0000", 2024-04-19T03:03:03.921 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 5.6685215790000001, 2024-04-19T03:03:03.921 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.063132879000000003, 2024-04-19T03:03:03.921 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:03.921 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:03.921 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:03.921 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:03.921 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:03.921 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 158392 2024-04-19T03:03:03.921 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.922 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:03.922 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.922 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:03.922 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.135703+0000", 2024-04-19T03:03:03.922 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:03.922 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.922 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.922 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:03.922 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.135703+0000", 2024-04-19T03:03:03.922 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:03.922 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.922 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.922 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:03.922 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.135702+0000", 2024-04-19T03:03:03.923 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:03:03.923 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.923 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.923 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:03.923 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.135708+0000", 2024-04-19T03:03:03.923 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8270000000000003e-06 2024-04-19T03:03:03.923 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.923 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.923 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:03.923 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.135720+0000", 2024-04-19T03:03:03.923 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2057e-05 2024-04-19T03:03:03.923 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.923 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.923 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:03.923 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.135727+0000", 2024-04-19T03:03:03.924 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8090000000000004e-06 2024-04-19T03:03:03.924 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.924 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.924 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:03.924 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.135768+0000", 2024-04-19T03:03:03.924 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1548999999999998e-05 2024-04-19T03:03:03.924 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.924 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.924 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:03.924 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.135853+0000", 2024-04-19T03:03:03.924 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4845000000000005e-05 2024-04-19T03:03:03.924 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.924 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.925 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:03:03.925 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.135934+0000", 2024-04-19T03:03:03.925 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0315000000000006e-05 2024-04-19T03:03:03.925 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.925 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.925 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:03:03.925 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.138685+0000", 2024-04-19T03:03:03.925 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.002751042 2024-04-19T03:03:03.925 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.925 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.925 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:03.925 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.198747+0000", 2024-04-19T03:03:03.925 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.060062675000000003 2024-04-19T03:03:03.925 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.925 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.926 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:03:03.926 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.198802+0000", 2024-04-19T03:03:03.926 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4469000000000003e-05 2024-04-19T03:03:03.926 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.926 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.926 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:03.926 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.198836+0000", 2024-04-19T03:03:03.926 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4272e-05 2024-04-19T03:03:03.926 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:03.926 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:03.926 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:03.926 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.926 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.927 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:158397 5.d 5:b5d962e9:::benchmark_data_smithi096_19531_object44947:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-19T03:03:03.927 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:58.138717+0000", 2024-04-19T03:03:03.927 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 5.6655076360000001, 2024-04-19T03:03:03.927 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.057191467000000003, 2024-04-19T03:03:03.927 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:03.927 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:03.927 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:03.927 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:03.927 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:03.927 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 158397 2024-04-19T03:03:03.927 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.927 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:03.927 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.928 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:03.928 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.138717+0000", 2024-04-19T03:03:03.928 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:03.928 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.928 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.928 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:03.928 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.138717+0000", 2024-04-19T03:03:03.928 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:03.928 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.928 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.928 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:03.928 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.138716+0000", 2024-04-19T03:03:03.928 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999986 2024-04-19T03:03:03.928 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.929 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.929 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:03.929 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.138722+0000", 2024-04-19T03:03:03.929 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1709999999999999e-06 2024-04-19T03:03:03.929 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.929 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.929 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:03.929 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.138731+0000", 2024-04-19T03:03:03.929 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.0310000000000004e-06 2024-04-19T03:03:03.929 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.929 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.929 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:03.929 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.138738+0000", 2024-04-19T03:03:03.929 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8430000000000004e-06 2024-04-19T03:03:03.929 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.930 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.930 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:03.930 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.138789+0000", 2024-04-19T03:03:03.930 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0623e-05 2024-04-19T03:03:03.930 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.930 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.930 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:03.930 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.138945+0000", 2024-04-19T03:03:03.930 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00015671899999999999 2024-04-19T03:03:03.930 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.930 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.930 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:03:03.930 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.139079+0000", 2024-04-19T03:03:03.931 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00013380099999999999 2024-04-19T03:03:03.931 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.931 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.931 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:03:03.931 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.141715+0000", 2024-04-19T03:03:03.931 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0026362849999999999 2024-04-19T03:03:03.931 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.931 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.931 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:03.931 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.195784+0000", 2024-04-19T03:03:03.931 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.054068353 2024-04-19T03:03:03.931 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.931 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.931 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:03:03.931 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.195852+0000", 2024-04-19T03:03:03.931 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8121999999999996e-05 2024-04-19T03:03:03.932 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:03.932 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:03.932 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:03.932 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.195909+0000", 2024-04-19T03:03:03.932 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6737999999999998e-05 2024-04-19T03:03:03.932 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:03.932 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:03.932 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:03.932 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:03.932 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:03.932 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-04-19T03:03:03.933 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-19T03:03:03.935 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:03:03.928+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:03:03.935 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T03:03:04.035 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:03:04.030+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:03:04.066 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-19T03:03:04.066 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-04-19T03:03:04.066 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:04.066 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:173055 5.4 5:2aae37fa:::benchmark_data_smithi096_19531_object59605:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:03:04.066 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:03:04.057111+0000", 2024-04-19T03:03:04.066 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0083272989999999998, 2024-04-19T03:03:04.067 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0083516389999999992, 2024-04-19T03:03:04.067 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:04.067 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-19T03:03:04.067 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:04.067 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:04.067 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:04.067 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 173055 2024-04-19T03:03:04.067 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:04.067 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:04.067 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:04.067 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:04.067 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:04.057111+0000", 2024-04-19T03:03:04.067 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:04.067 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:04.068 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:04.068 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:04.068 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:04.057111+0000", 2024-04-19T03:03:04.068 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:04.068 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:04.068 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:04.068 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:04.068 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:04.057110+0000", 2024-04-19T03:03:04.068 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:03:04.068 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:04.068 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:04.068 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:04.068 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:04.057115+0000", 2024-04-19T03:03:04.068 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0019999999999997e-06 2024-04-19T03:03:04.069 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:04.069 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:04.069 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:04.069 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:04.057122+0000", 2024-04-19T03:03:04.069 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4019999999999996e-06 2024-04-19T03:03:04.069 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:04.069 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:04.069 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:04.069 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:04.057127+0000", 2024-04-19T03:03:04.069 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0270000000000003e-06 2024-04-19T03:03:04.069 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:04.069 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:04.069 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:04.069 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:04.057179+0000", 2024-04-19T03:03:04.070 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1508999999999998e-05 2024-04-19T03:03:04.070 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:04.070 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:04.070 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:04.070 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:04.057349+0000", 2024-04-19T03:03:04.070 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000169863 2024-04-19T03:03:04.070 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:04.070 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:04.070 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:04.070 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:04.070 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:04.070 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:173056 5.4 5:2b5f367e:::benchmark_data_smithi096_19531_object59606:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:03:04.070 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:03:04.057195+0000", 2024-04-19T03:03:04.071 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.00824306, 2024-04-19T03:03:04.071 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0083365060000000005, 2024-04-19T03:03:04.071 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:04.071 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-19T03:03:04.071 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:04.071 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:04.071 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:04.071 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 173056 2024-04-19T03:03:04.071 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:04.071 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:04.071 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:04.071 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:04.071 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:04.057195+0000", 2024-04-19T03:03:04.072 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:04.072 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:04.072 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:04.072 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:04.072 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:04.057195+0000", 2024-04-19T03:03:04.072 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:04.072 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:04.072 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:04.072 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:04.072 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:04.057194+0000", 2024-04-19T03:03:04.072 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:03:04.072 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:04.073 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:04.073 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:04.073 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:04.057200+0000", 2024-04-19T03:03:04.073 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2990000000000002e-06 2024-04-19T03:03:04.073 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:04.073 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:04.073 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:04.073 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:04.057209+0000", 2024-04-19T03:03:04.073 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.2720000000000003e-06 2024-04-19T03:03:04.073 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:04.073 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:04.073 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:04.073 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:04.057224+0000", 2024-04-19T03:03:04.074 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4431e-05 2024-04-19T03:03:04.074 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:04.074 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:04.074 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:04.074 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:04.059799+0000", 2024-04-19T03:03:04.074 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0025749700000000002 2024-04-19T03:03:04.074 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:04.074 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:04.074 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:04.074 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:04.059964+0000", 2024-04-19T03:03:04.074 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016549199999999999 2024-04-19T03:03:04.074 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:04.074 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:04.074 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:04.075 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:04.075 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:04.075 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:173069 5.4 5.632178b4 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:03:04.075 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:03:04.061625+0000", 2024-04-19T03:03:04.075 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.003813472, 2024-04-19T03:03:04.075 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.003964487, 2024-04-19T03:03:04.075 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:04.075 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-04-19T03:03:04.075 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:04.075 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:04.075 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:04.075 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 173069 2024-04-19T03:03:04.075 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:04.075 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:04.076 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:04.076 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:04.076 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:04.061625+0000", 2024-04-19T03:03:04.076 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:04.076 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:04.076 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:04.076 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:04.076 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:04.061625+0000", 2024-04-19T03:03:04.076 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:04.076 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:04.076 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:04.076 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:04.076 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:04.061623+0000", 2024-04-19T03:03:04.076 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:03:04.077 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:04.077 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:04.077 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:04.077 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:04.061630+0000", 2024-04-19T03:03:04.077 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1430000000000003e-06 2024-04-19T03:03:04.077 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:04.077 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:04.077 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:04.077 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:04.061640+0000", 2024-04-19T03:03:04.077 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0774999999999999e-05 2024-04-19T03:03:04.077 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:04.077 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:04.077 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:04.077 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:04.061658+0000", 2024-04-19T03:03:04.078 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7974000000000001e-05 2024-04-19T03:03:04.078 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:04.078 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:04.078 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:04.078 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:04.078 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:04.078 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:173070 5.0 5:04f3e4f4:::benchmark_data_smithi096_19531_object59620:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:03:04.078 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:03:04.061675+0000", 2024-04-19T03:03:04.078 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0037628010000000001, 2024-04-19T03:03:04.078 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0039625980000000003, 2024-04-19T03:03:04.078 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:04.079 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-19T03:03:04.079 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:04.079 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:04.079 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:04.079 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 173070 2024-04-19T03:03:04.079 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:04.079 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:04.079 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:04.079 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:04.079 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:04.061675+0000", 2024-04-19T03:03:04.079 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:04.079 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:04.079 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:04.079 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:04.080 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:04.061675+0000", 2024-04-19T03:03:04.080 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:04.080 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:04.080 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:04.080 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:04.080 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:04.061675+0000", 2024-04-19T03:03:04.080 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:04.080 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:04.080 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:04.080 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:04.080 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:04.061678+0000", 2024-04-19T03:03:04.080 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4520000000000002e-06 2024-04-19T03:03:04.080 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:04.080 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:04.081 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:04.081 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:04.061685+0000", 2024-04-19T03:03:04.081 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.9890000000000003e-06 2024-04-19T03:03:04.081 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:04.081 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:04.081 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:04.081 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:04.061691+0000", 2024-04-19T03:03:04.081 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5459999999999999e-06 2024-04-19T03:03:04.081 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:04.081 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:04.081 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:04.081 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:04.061737+0000", 2024-04-19T03:03:04.081 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6292999999999999e-05 2024-04-19T03:03:04.082 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:04.082 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:04.082 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:04.082 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:04.061930+0000", 2024-04-19T03:03:04.082 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000193308 2024-04-19T03:03:04.082 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:04.082 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:04.082 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:04.082 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:04.082 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:04.082 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:173071 5.b 5:d4f36696:::benchmark_data_smithi096_19531_object59621:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:03:04.082 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:03:04.062444+0000", 2024-04-19T03:03:04.082 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0029940639999999998, 2024-04-19T03:03:04.083 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0032519770000000001, 2024-04-19T03:03:04.083 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:04.083 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-19T03:03:04.083 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:04.083 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:04.083 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:04.083 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 173071 2024-04-19T03:03:04.083 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:04.083 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:04.083 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:04.083 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:04.083 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:04.062444+0000", 2024-04-19T03:03:04.083 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:04.083 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:04.084 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:04.084 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:04.084 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:04.062444+0000", 2024-04-19T03:03:04.084 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:04.084 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:04.084 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:04.084 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:04.084 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:04.062443+0000", 2024-04-19T03:03:04.084 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:03:04.084 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:04.084 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:04.084 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:04.084 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:04.062448+0000", 2024-04-19T03:03:04.085 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6809999999999997e-06 2024-04-19T03:03:04.085 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:04.085 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:04.085 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:04.085 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:04.062457+0000", 2024-04-19T03:03:04.085 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9409999999999996e-06 2024-04-19T03:03:04.085 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:04.085 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:04.085 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:04.085 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:04.062464+0000", 2024-04-19T03:03:04.085 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.1999999999999997e-06 2024-04-19T03:03:04.085 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:04.085 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:04.086 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:04.086 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:04.062507+0000", 2024-04-19T03:03:04.086 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2586000000000002e-05 2024-04-19T03:03:04.086 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:04.086 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:04.086 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:04.086 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:04.062637+0000", 2024-04-19T03:03:04.086 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013070599999999999 2024-04-19T03:03:04.086 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:04.086 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:04.086 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:04.086 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:04.086 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:04.087 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:173072 5.b 5:da0c5ac8:::benchmark_data_smithi096_19531_object59622:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:03:04.087 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:03:04.062618+0000", 2024-04-19T03:03:04.087 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0028201350000000001, 2024-04-19T03:03:04.087 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0031531670000000001, 2024-04-19T03:03:04.087 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:04.087 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-19T03:03:04.087 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:04.087 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:04.087 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:04.087 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 173072 2024-04-19T03:03:04.087 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:04.087 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:04.087 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:04.088 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:04.088 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:04.062618+0000", 2024-04-19T03:03:04.088 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:04.088 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:04.088 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:04.088 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:04.088 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:04.062618+0000", 2024-04-19T03:03:04.088 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:04.088 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:04.088 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:04.088 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:04.088 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:04.062617+0000", 2024-04-19T03:03:04.088 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:04.088 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:04.089 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:04.089 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:04.089 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:04.062622+0000", 2024-04-19T03:03:04.089 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6940000000000003e-06 2024-04-19T03:03:04.089 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:04.089 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:04.089 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:04.089 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:04.062629+0000", 2024-04-19T03:03:04.089 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4959999999999999e-06 2024-04-19T03:03:04.089 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:04.089 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:04.089 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:04.089 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:04.062636+0000", 2024-04-19T03:03:04.090 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3459999999999999e-06 2024-04-19T03:03:04.090 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:04.090 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:04.090 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:04.090 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:04.064867+0000", 2024-04-19T03:03:04.090 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0022308900000000001 2024-04-19T03:03:04.090 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:04.090 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:04.090 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:04.090 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:04.064979+0000", 2024-04-19T03:03:04.090 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011213999999999999 2024-04-19T03:03:04.090 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:04.090 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:04.091 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:04.091 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:04.091 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:04.091 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:173073 5.8 5:1247a24d:::benchmark_data_smithi096_19531_object59623:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:03:04.091 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:03:04.062799+0000", 2024-04-19T03:03:04.091 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0026392350000000002, 2024-04-19T03:03:04.091 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0030297000000000002, 2024-04-19T03:03:04.091 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:04.091 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-19T03:03:04.091 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:04.091 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:04.091 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:04.091 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 173073 2024-04-19T03:03:04.092 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:04.092 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:04.092 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:04.092 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:04.092 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:04.062799+0000", 2024-04-19T03:03:04.092 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:04.092 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:04.092 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:04.092 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:04.092 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:04.062799+0000", 2024-04-19T03:03:04.092 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:04.092 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:04.092 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:04.092 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:04.093 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:04.062798+0000", 2024-04-19T03:03:04.093 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:04.093 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:04.093 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:04.093 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:04.093 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:04.062803+0000", 2024-04-19T03:03:04.093 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3810000000000001e-06 2024-04-19T03:03:04.093 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:04.093 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:04.093 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:04.093 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:04.062810+0000", 2024-04-19T03:03:04.093 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2740000000000002e-06 2024-04-19T03:03:04.093 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:04.093 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:04.094 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:04.094 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:04.062815+0000", 2024-04-19T03:03:04.094 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5620000000000003e-06 2024-04-19T03:03:04.094 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:04.094 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:04.094 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:04.094 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:04.063391+0000", 2024-04-19T03:03:04.094 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00057522300000000003 2024-04-19T03:03:04.094 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:04.094 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:04.094 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:04.094 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:04.063504+0000", 2024-04-19T03:03:04.094 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011287599999999999 2024-04-19T03:03:04.094 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:04.095 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:04.095 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:04.095 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:04.095 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:04.095 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:173076 5.0 5:00ecf5a5:::benchmark_data_smithi096_19531_object59626:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:03:04.095 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:03:04.064206+0000", 2024-04-19T03:03:04.095 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0012316790000000001, 2024-04-19T03:03:04.095 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0016815669999999999, 2024-04-19T03:03:04.095 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:04.095 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-19T03:03:04.095 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:04.095 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:04.096 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:04.096 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 173076 2024-04-19T03:03:04.096 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:04.096 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:04.096 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:04.096 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:04.096 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:04.064206+0000", 2024-04-19T03:03:04.096 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:04.096 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:04.096 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:04.096 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:04.096 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:04.064206+0000", 2024-04-19T03:03:04.096 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:04.096 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:04.097 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:04.097 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:04.097 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:04.064206+0000", 2024-04-19T03:03:04.097 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:03:04.097 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:04.097 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:04.097 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:04.097 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:04.064210+0000", 2024-04-19T03:03:04.097 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4660000000000001e-06 2024-04-19T03:03:04.097 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:04.097 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:04.097 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:04.097 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:04.064220+0000", 2024-04-19T03:03:04.098 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.7960000000000007e-06 2024-04-19T03:03:04.098 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:04.098 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:04.098 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:04.098 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:04.064225+0000", 2024-04-19T03:03:04.098 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3530000000000002e-06 2024-04-19T03:03:04.098 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:04.098 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:04.098 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:04.098 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:04.064258+0000", 2024-04-19T03:03:04.098 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3142000000000002e-05 2024-04-19T03:03:04.098 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:04.098 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:04.098 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:04.099 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:04.064442+0000", 2024-04-19T03:03:04.099 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00018405799999999999 2024-04-19T03:03:04.099 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:04.099 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:04.099 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:04.099 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:04.099 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:04.099 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:173077 5.4 5.2f90f244 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:03:04.099 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:03:04.064394+0000", 2024-04-19T03:03:04.099 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.001044321, 2024-04-19T03:03:04.099 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0015486409999999999, 2024-04-19T03:03:04.099 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:04.099 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-04-19T03:03:04.099 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:04.100 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:04.100 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:04.100 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 173077 2024-04-19T03:03:04.100 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:04.100 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:04.100 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:04.100 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:04.100 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:04.064394+0000", 2024-04-19T03:03:04.100 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:04.100 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:04.100 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:04.100 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:04.100 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:04.064394+0000", 2024-04-19T03:03:04.100 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:04.101 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:04.101 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:04.101 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:04.101 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:04.064393+0000", 2024-04-19T03:03:04.101 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:03:04.101 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:04.101 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:04.101 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:04.101 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:04.064398+0000", 2024-04-19T03:03:04.101 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0300000000000001e-06 2024-04-19T03:03:04.101 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:04.101 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:04.101 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:04.101 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:04.064430+0000", 2024-04-19T03:03:04.102 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2094999999999997e-05 2024-04-19T03:03:04.102 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:04.102 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:04.102 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:04.102 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:04.064437+0000", 2024-04-19T03:03:04.102 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.0269999999999998e-06 2024-04-19T03:03:04.102 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:04.102 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:04.102 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:04.102 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:04.102 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:04.102 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:173079 5.a 5:5a37dac6:::benchmark_data_smithi096_19531_object59629:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:03:04.102 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:03:04.064740+0000", 2024-04-19T03:03:04.103 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.00069819299999999995, 2024-04-19T03:03:04.103 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0012501039999999999, 2024-04-19T03:03:04.103 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:04.103 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-19T03:03:04.103 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:04.103 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:04.103 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:04.103 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 173079 2024-04-19T03:03:04.103 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:04.103 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:04.103 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:04.103 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:04.103 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:04.064740+0000", 2024-04-19T03:03:04.104 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:04.104 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:04.104 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:04.104 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:04.104 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:04.064740+0000", 2024-04-19T03:03:04.104 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:04.104 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:04.104 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:04.104 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:04.104 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:04.064739+0000", 2024-04-19T03:03:04.104 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:04.104 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:04.104 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:04.105 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:04.105 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:04.064744+0000", 2024-04-19T03:03:04.105 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7539999999999997e-06 2024-04-19T03:03:04.105 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:04.105 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:04.105 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:04.105 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:04.064751+0000", 2024-04-19T03:03:04.105 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.362e-06 2024-04-19T03:03:04.105 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:04.105 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:04.105 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:04.105 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:04.064801+0000", 2024-04-19T03:03:04.105 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9659e-05 2024-04-19T03:03:04.105 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:04.106 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:04.106 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:04.106 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:04.064855+0000", 2024-04-19T03:03:04.106 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4468000000000001e-05 2024-04-19T03:03:04.106 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:04.106 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:04.106 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:04.106 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:04.064981+0000", 2024-04-19T03:03:04.106 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000125143 2024-04-19T03:03:04.106 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:04.106 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:04.106 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:04.107 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:04.107 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:04.107 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4755.0:173078 5.f e58/22 5:fdf0d6ef:::benchmark_data_smithi096_19531_object59628:head v 58'10732, mlcod=58'10730)", 2024-04-19T03:03:04.107 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:03:04.064752+0000", 2024-04-19T03:03:04.107 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.00068582799999999998, 2024-04-19T03:03:04.107 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0012947939999999999, 2024-04-19T03:03:04.107 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:04.107 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-19T03:03:04.107 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:04.107 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:04.107 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:04.107 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:04.064752+0000", 2024-04-19T03:03:04.107 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:04.108 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:04.108 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:04.108 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:04.108 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:04.064752+0000", 2024-04-19T03:03:04.108 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:04.108 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:04.108 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:04.108 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:04.108 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:04.064751+0000", 2024-04-19T03:03:04.108 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:03:04.108 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:04.108 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:04.108 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:04.108 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:04.064760+0000", 2024-04-19T03:03:04.108 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.7809999999999994e-06 2024-04-19T03:03:04.109 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:04.109 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:04.109 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:04.109 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:04.064768+0000", 2024-04-19T03:03:04.109 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0539999999999995e-06 2024-04-19T03:03:04.109 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:04.109 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:04.109 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:04.109 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:04.064781+0000", 2024-04-19T03:03:04.109 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3383e-05 2024-04-19T03:03:04.109 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:04.109 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:04.109 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:04.110 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:04.064820+0000", 2024-04-19T03:03:04.110 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8380000000000002e-05 2024-04-19T03:03:04.110 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:04.110 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:04.110 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:04.110 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:04.064840+0000", 2024-04-19T03:03:04.110 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0098e-05 2024-04-19T03:03:04.110 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:04.110 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:04.110 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:04.110 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:04.110 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:04.111 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4755.0:173080 5.9 e58/22 5:93f4f2b3:::benchmark_data_smithi096_19531_object59630:head v 58'10580, mlcod=58'10577)", 2024-04-19T03:03:04.111 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:03:04.065258+0000", 2024-04-19T03:03:04.111 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.00018041500000000001, 2024-04-19T03:03:04.111 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00083952799999999998, 2024-04-19T03:03:04.111 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:04.111 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-19T03:03:04.111 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:04.111 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:04.111 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:04.111 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:04.065258+0000", 2024-04-19T03:03:04.111 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:04.111 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:04.111 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:04.111 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:04.112 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:04.065258+0000", 2024-04-19T03:03:04.112 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:04.112 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:04.112 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:04.112 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:04.112 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:04.065257+0000", 2024-04-19T03:03:04.112 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:04.112 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:04.112 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:04.112 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:04.112 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:04.065262+0000", 2024-04-19T03:03:04.112 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2569999999999998e-06 2024-04-19T03:03:04.112 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:04.113 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:04.113 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:04.113 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:04.065268+0000", 2024-04-19T03:03:04.113 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9490000000000001e-06 2024-04-19T03:03:04.113 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:04.113 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:04.113 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:04.113 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:04.065273+0000", 2024-04-19T03:03:04.113 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5290000000000002e-06 2024-04-19T03:03:04.113 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:04.113 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:04.113 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:04.113 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:04.065321+0000", 2024-04-19T03:03:04.113 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8371000000000002e-05 2024-04-19T03:03:04.114 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:04.114 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:04.114 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:04.114 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:04.065333+0000", 2024-04-19T03:03:04.114 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1365e-05 2024-04-19T03:03:04.114 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:04.114 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:04.114 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:04.114 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:04.114 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:04.114 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:173081 5.0 5.10b93fb0 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e58)", 2024-04-19T03:03:04.114 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:03:04.065754+0000", 2024-04-19T03:03:04.114 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 4294967295.9996843, 2024-04-19T03:03:04.115 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00039315999999999998, 2024-04-19T03:03:04.115 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:04.115 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-04-19T03:03:04.115 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:04.115 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:04.115 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:04.115 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 173081 2024-04-19T03:03:04.115 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:04.115 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:04.115 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:04.115 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:04.115 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:04.065754+0000", 2024-04-19T03:03:04.115 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:04.115 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:04.116 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:04.116 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:04.116 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:04.065754+0000", 2024-04-19T03:03:04.116 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:04.116 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:04.116 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:04.116 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:04.116 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:04.065753+0000", 2024-04-19T03:03:04.116 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:03:04.116 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:04.116 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:04.117 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:04.117 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:04.065757+0000", 2024-04-19T03:03:04.117 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7060000000000003e-06 2024-04-19T03:03:04.117 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:04.117 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:04.117 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:04.117 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:04.065766+0000", 2024-04-19T03:03:04.117 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.0410000000000003e-06 2024-04-19T03:03:04.117 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:04.117 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:04.117 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:04.117 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:04.065773+0000", 2024-04-19T03:03:04.117 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6189999999999996e-06 2024-04-19T03:03:04.117 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:04.117 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:04.118 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:04.118 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:04.118 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-04-19T03:03:04.118 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 13 2024-04-19T03:03:04.118 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-19T03:03:04.119 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1: {} 2024-04-19T03:03:04.119 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2: {} 2024-04-19T03:03:04.119 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-19T03:03:04.120 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T03:03:04.121 INFO:teuthology.orchestra.run.smithi096.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-04-19T03:03:04.121 INFO:teuthology.orchestra.run.smithi096.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-19T03:03:04.121 INFO:teuthology.orchestra.run.smithi096.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-19T03:03:04.121 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-19T03:03:04.136 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:03:04.132+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:03:04.237 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:03:04.234+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:03:04.245 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-19T03:03:04.245 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:03:04.259 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T03:03:04.337 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:03:04.332+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:03:04.425 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-19T03:03:04.425 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:03:04.438 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T03:03:04.439 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:03:04.434+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:03:04.541 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:03:04.538+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:03:04.568 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-04-19T03:03:04.569 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:03:04.581 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T03:03:04.641 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~35s 2024-04-19T03:03:04.641 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:03:04.638+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:03:04.705 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-04-19T03:03:04.706 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:03:04.717 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T03:03:04.743 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:03:04.740+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:03:04.841 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-04-19T03:03:04.841 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:03:04.843 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:03:04.840+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:03:04.855 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T03:03:04.945 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:03:04.940+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:03:04.988 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-19T03:03:04.988 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:03:05.000 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T03:03:05.047 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:03:05.044+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:03:05.121 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-19T03:03:05.121 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:03:05.132 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T03:03:05.148 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:03:05.146+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:03:05.248 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:03:05.246+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:03:05.254 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-19T03:03:05.254 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:03:05.266 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T03:03:05.349 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:03:05.348+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:03:05.398 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-04-19T03:03:05.398 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:03:05.410 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T03:03:05.451 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:03:05.448+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:03:05.536 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-04-19T03:03:05.536 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:03:05.550 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T03:03:05.552 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:03:05.548+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:03:05.578 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-19T03:03:05.652 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:03:05.648+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:03:05.674 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-04-19T03:03:05.674 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:03:05.686 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T03:03:05.753 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:03:05.748+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:03:05.820 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-19T03:03:05.820 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:03:05.832 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T03:03:05.854 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:03:05.852+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:03:05.955 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:03:05.952+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:03:05.959 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-19T03:03:05.959 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:03:05.971 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T03:03:06.055 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:03:06.052+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:03:06.089 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-19T03:03:06.090 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:03:06.102 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T03:03:06.122 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-19T03:03:06.157 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:03:06.152+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:03:06.232 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-04-19T03:03:06.233 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:03:06.245 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T03:03:06.257 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:03:06.254+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:03:06.279 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1: {} 2024-04-19T03:03:06.299 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2: {} 2024-04-19T03:03:06.299 INFO:teuthology.orchestra.run.smithi096.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-04-19T03:03:06.299 INFO:teuthology.orchestra.run.smithi096.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-19T03:03:06.300 INFO:teuthology.orchestra.run.smithi096.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-19T03:03:06.301 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-19T03:03:06.302 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-19T03:03:06.358 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:03:06.356+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:03:06.369 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-04-19T03:03:06.369 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2024-04-19T03:03:06.369 INFO:teuthology.orchestra.run.smithi144.stdout: "complaint_time": 30, 2024-04-19T03:03:06.370 INFO:teuthology.orchestra.run.smithi144.stdout: "num_blocked_ops": 0 2024-04-19T03:03:06.370 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-04-19T03:03:06.381 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T03:03:06.459 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:03:06.456+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:03:06.555 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-04-19T03:03:06.555 INFO:teuthology.orchestra.run.smithi144.stdout: "size": 20, 2024-04-19T03:03:06.555 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 600, 2024-04-19T03:03:06.555 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [ 2024-04-19T03:03:06.555 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.555 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:78992 5.7 5:e6baa862:::benchmark_data_smithi096_19531_object78991:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-19T03:03:06.555 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:18.008888+0000", 2024-04-19T03:03:06.555 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 48.543120791, 2024-04-19T03:03:06.555 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.056375285999999997, 2024-04-19T03:03:06.555 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:06.556 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:06.556 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:06.556 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:06.556 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:06.556 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 78992 2024-04-19T03:03:06.556 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.556 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:06.556 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.556 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:06.556 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.008888+0000", 2024-04-19T03:03:06.556 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:06.556 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.556 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.556 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:06.557 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.008888+0000", 2024-04-19T03:03:06.557 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:06.557 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.557 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.557 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:06.557 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.008888+0000", 2024-04-19T03:03:06.557 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:06.557 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.557 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.557 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:06.557 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.008928+0000", 2024-04-19T03:03:06.557 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0361999999999997e-05 2024-04-19T03:03:06.557 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.557 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.557 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:06.558 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.008942+0000", 2024-04-19T03:03:06.558 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4365000000000001e-05 2024-04-19T03:03:06.558 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.558 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.558 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:06.558 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.008949+0000", 2024-04-19T03:03:06.558 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.212e-06 2024-04-19T03:03:06.558 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.558 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.558 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:06.558 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.012683+0000", 2024-04-19T03:03:06.558 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.003733934 2024-04-19T03:03:06.558 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.558 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.559 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:06.559 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.012798+0000", 2024-04-19T03:03:06.559 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00011574999999999999 2024-04-19T03:03:06.559 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.559 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.559 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:06.559 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.012896+0000", 2024-04-19T03:03:06.559 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.7848000000000002e-05 2024-04-19T03:03:06.559 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.559 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.559 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:03:06.559 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016423+0000", 2024-04-19T03:03:06.559 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0035270789999999998 2024-04-19T03:03:06.559 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.560 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.560 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:06.560 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.065098+0000", 2024-04-19T03:03:06.560 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.048674651999999999 2024-04-19T03:03:06.560 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.560 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.560 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:03:06.560 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.065193+0000", 2024-04-19T03:03:06.560 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.5087999999999995e-05 2024-04-19T03:03:06.560 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.560 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.560 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:06.560 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.065264+0000", 2024-04-19T03:03:06.560 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0666000000000004e-05 2024-04-19T03:03:06.561 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:06.561 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:06.561 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:06.561 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.561 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.561 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4755.0:79003 5.2 e40/39 5:4436e33f:::benchmark_data_smithi096_19531_object79002:head v 40'4935, mlcod=40'4932)", 2024-04-19T03:03:06.561 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:18.018102+0000", 2024-04-19T03:03:06.561 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 48.533906735000002, 2024-04-19T03:03:06.561 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.060023990999999999, 2024-04-19T03:03:06.561 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:06.561 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:06.561 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:06.561 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.561 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:06.562 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018102+0000", 2024-04-19T03:03:06.562 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:06.562 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.562 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.562 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:06.562 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018102+0000", 2024-04-19T03:03:06.562 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:06.562 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.562 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.562 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:06.562 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018102+0000", 2024-04-19T03:03:06.562 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:06.562 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.563 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.563 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:06.563 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018134+0000", 2024-04-19T03:03:06.563 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2722000000000003e-05 2024-04-19T03:03:06.563 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.563 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.563 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:06.563 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018145+0000", 2024-04-19T03:03:06.563 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0395e-05 2024-04-19T03:03:06.563 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.563 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.563 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:06.563 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018151+0000", 2024-04-19T03:03:06.563 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5300000000000002e-06 2024-04-19T03:03:06.563 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.564 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.564 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:06.564 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018489+0000", 2024-04-19T03:03:06.564 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00033731499999999998 2024-04-19T03:03:06.564 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.564 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.564 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:06.564 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018508+0000", 2024-04-19T03:03:06.564 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9775e-05 2024-04-19T03:03:06.564 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.564 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.564 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:03:06.564 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.078059+0000", 2024-04-19T03:03:06.564 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.059550171999999998 2024-04-19T03:03:06.565 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.565 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.565 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:06.565 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.078126+0000", 2024-04-19T03:03:06.565 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7773000000000003e-05 2024-04-19T03:03:06.565 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:06.565 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:06.565 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:06.565 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.565 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.565 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:86612 5.7 5:e32e3c49:::benchmark_data_smithi096_19531_object86611:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:06.565 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:22.633560+0000", 2024-04-19T03:03:06.565 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 43.918449074999998, 2024-04-19T03:03:06.565 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.19135289, 2024-04-19T03:03:06.565 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:06.566 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:06.566 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:06.566 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:06.566 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:06.566 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 86612 2024-04-19T03:03:06.566 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.566 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:06.566 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.566 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:06.566 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633560+0000", 2024-04-19T03:03:06.566 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:06.566 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.566 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.567 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:06.567 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633560+0000", 2024-04-19T03:03:06.567 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:06.567 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.567 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.567 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:06.567 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633558+0000", 2024-04-19T03:03:06.567 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999986 2024-04-19T03:03:06.567 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.567 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.567 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:06.567 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633609+0000", 2024-04-19T03:03:06.567 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0850999999999998e-05 2024-04-19T03:03:06.567 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.568 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.568 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:06.568 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633627+0000", 2024-04-19T03:03:06.568 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7951000000000001e-05 2024-04-19T03:03:06.568 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.568 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.568 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:06.568 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633635+0000", 2024-04-19T03:03:06.568 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2530000000000004e-06 2024-04-19T03:03:06.568 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.568 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.568 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:06.568 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633699+0000", 2024-04-19T03:03:06.568 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3901999999999999e-05 2024-04-19T03:03:06.569 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.569 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.569 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:06.569 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633992+0000", 2024-04-19T03:03:06.569 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00029283299999999999 2024-04-19T03:03:06.569 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.569 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.569 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:06.569 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.634223+0000", 2024-04-19T03:03:06.569 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00023084200000000001 2024-04-19T03:03:06.569 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.569 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.569 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:03:06.569 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.639085+0000", 2024-04-19T03:03:06.570 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0048624269999999999 2024-04-19T03:03:06.570 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.570 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.570 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:06.570 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.824635+0000", 2024-04-19T03:03:06.570 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.18554944700000001 2024-04-19T03:03:06.570 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.570 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.570 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:03:06.570 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.824793+0000", 2024-04-19T03:03:06.570 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000157959 2024-04-19T03:03:06.570 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.570 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.571 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:06.571 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.824913+0000", 2024-04-19T03:03:06.571 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000120093 2024-04-19T03:03:06.571 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:06.571 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:06.571 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:06.571 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.571 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.571 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:86625 5.7 5:e6d00488:::benchmark_data_smithi096_19531_object86624:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:06.571 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:22.643554+0000", 2024-04-19T03:03:06.571 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 43.908455308999997, 2024-04-19T03:03:06.571 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.18732841, 2024-04-19T03:03:06.571 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:06.571 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:06.571 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:06.572 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:06.572 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:06.572 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 86625 2024-04-19T03:03:06.572 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.572 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:06.572 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.572 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:06.572 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643554+0000", 2024-04-19T03:03:06.572 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:06.572 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.572 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.572 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:06.572 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643554+0000", 2024-04-19T03:03:06.572 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:06.573 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.573 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.573 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:06.573 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643552+0000", 2024-04-19T03:03:06.573 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999986 2024-04-19T03:03:06.573 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.573 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.573 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:06.573 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643588+0000", 2024-04-19T03:03:06.573 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5855999999999997e-05 2024-04-19T03:03:06.573 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.573 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.573 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:06.574 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643606+0000", 2024-04-19T03:03:06.574 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8226000000000001e-05 2024-04-19T03:03:06.574 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.574 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.574 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:06.574 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643618+0000", 2024-04-19T03:03:06.574 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1868000000000001e-05 2024-04-19T03:03:06.574 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.574 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.574 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:06.574 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643676+0000", 2024-04-19T03:03:06.574 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8153999999999999e-05 2024-04-19T03:03:06.574 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.575 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.575 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:06.575 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643905+0000", 2024-04-19T03:03:06.575 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00022847500000000001 2024-04-19T03:03:06.575 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.575 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.575 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:06.575 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.644150+0000", 2024-04-19T03:03:06.575 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00024531800000000001 2024-04-19T03:03:06.575 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.575 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.575 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:03:06.575 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.647407+0000", 2024-04-19T03:03:06.575 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0032563190000000001 2024-04-19T03:03:06.576 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.576 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.576 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:06.576 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.830721+0000", 2024-04-19T03:03:06.576 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.18331468300000001 2024-04-19T03:03:06.576 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.576 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.576 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:03:06.576 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.830813+0000", 2024-04-19T03:03:06.576 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.2205000000000002e-05 2024-04-19T03:03:06.576 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.576 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.576 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:06.576 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.830882+0000", 2024-04-19T03:03:06.577 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8819999999999995e-05 2024-04-19T03:03:06.577 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:06.577 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:06.577 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:06.577 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.577 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.577 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87063 5.7 5:e502e824:::benchmark_data_smithi096_19531_object87062:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:06.577 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.136067+0000", 2024-04-19T03:03:06.577 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 43.415942440000002, 2024-04-19T03:03:06.577 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.065521159999999995, 2024-04-19T03:03:06.577 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:06.577 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:06.577 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:06.577 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:06.578 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:06.578 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87063 2024-04-19T03:03:06.578 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.578 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:06.578 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.578 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:06.578 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.136067+0000", 2024-04-19T03:03:06.578 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:06.578 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.578 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.578 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:06.578 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.136067+0000", 2024-04-19T03:03:06.578 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:06.578 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.579 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.579 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:06.579 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.136066+0000", 2024-04-19T03:03:06.579 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:03:06.579 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.579 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.579 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:06.579 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.136154+0000", 2024-04-19T03:03:06.579 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.8256000000000003e-05 2024-04-19T03:03:06.579 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.579 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.579 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:06.579 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.136162+0000", 2024-04-19T03:03:06.579 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.5099999999999998e-06 2024-04-19T03:03:06.580 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.580 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.580 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:06.580 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.136171+0000", 2024-04-19T03:03:06.580 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2830000000000001e-06 2024-04-19T03:03:06.580 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.580 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.580 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:06.580 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.138421+0000", 2024-04-19T03:03:06.580 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0022506620000000001 2024-04-19T03:03:06.580 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.580 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.580 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:06.580 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.138560+0000", 2024-04-19T03:03:06.581 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000138446 2024-04-19T03:03:06.581 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.581 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.581 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:06.581 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.138689+0000", 2024-04-19T03:03:06.581 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00012950700000000001 2024-04-19T03:03:06.581 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.581 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.581 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:03:06.581 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.141517+0000", 2024-04-19T03:03:06.581 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0028280860000000001 2024-04-19T03:03:06.581 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.581 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.581 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:06.581 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.201350+0000", 2024-04-19T03:03:06.582 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.059832418999999998 2024-04-19T03:03:06.582 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.582 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.582 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:03:06.582 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.201485+0000", 2024-04-19T03:03:06.582 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000135597 2024-04-19T03:03:06.582 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.582 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.582 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:06.582 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.201588+0000", 2024-04-19T03:03:06.582 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00010247900000000001 2024-04-19T03:03:06.582 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:06.582 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:06.583 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:06.583 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.583 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.583 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87072 5.7 5:e3c7809a:::benchmark_data_smithi096_19531_object87071:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:06.583 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.144224+0000", 2024-04-19T03:03:06.583 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 43.407785416000003, 2024-04-19T03:03:06.583 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.058179555000000001, 2024-04-19T03:03:06.583 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:06.583 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:06.583 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:06.583 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:06.583 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:06.583 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87072 2024-04-19T03:03:06.583 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.584 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:06.584 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.584 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:06.584 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144224+0000", 2024-04-19T03:03:06.584 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:06.584 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.584 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.584 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:06.584 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144224+0000", 2024-04-19T03:03:06.584 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:06.584 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.584 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.584 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:06.584 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144223+0000", 2024-04-19T03:03:06.585 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:03:06.585 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.585 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.585 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:06.585 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144320+0000", 2024-04-19T03:03:06.585 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.7075000000000001e-05 2024-04-19T03:03:06.585 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.585 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.585 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:06.586 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144331+0000", 2024-04-19T03:03:06.586 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1342000000000001e-05 2024-04-19T03:03:06.586 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.586 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.586 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:06.586 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144337+0000", 2024-04-19T03:03:06.586 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8390000000000003e-06 2024-04-19T03:03:06.586 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.586 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.586 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:06.586 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144369+0000", 2024-04-19T03:03:06.586 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2079000000000002e-05 2024-04-19T03:03:06.586 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.587 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.587 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:06.587 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144464+0000", 2024-04-19T03:03:06.587 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.4623000000000005e-05 2024-04-19T03:03:06.587 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.587 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.587 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:06.587 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144553+0000", 2024-04-19T03:03:06.587 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9171000000000004e-05 2024-04-19T03:03:06.587 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.587 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.587 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:03:06.587 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.147018+0000", 2024-04-19T03:03:06.587 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0024648370000000001 2024-04-19T03:03:06.587 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.587 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.588 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:06.588 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.202270+0000", 2024-04-19T03:03:06.588 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.055252018 2024-04-19T03:03:06.588 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.588 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.588 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:03:06.588 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.202356+0000", 2024-04-19T03:03:06.588 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6648000000000001e-05 2024-04-19T03:03:06.588 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.588 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.588 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:06.588 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.202403+0000", 2024-04-19T03:03:06.588 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6956999999999998e-05 2024-04-19T03:03:06.588 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:06.589 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:06.589 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:06.589 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.589 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.589 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87123 5.6 5:6d1bc3b9:::benchmark_data_smithi096_19531_object87122:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:03:06.589 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249233+0000", 2024-04-19T03:03:06.589 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 43.302776383999998, 2024-04-19T03:03:06.589 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0291700720000001, 2024-04-19T03:03:06.589 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:06.589 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-04-19T03:03:06.589 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:06.589 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:06.589 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:06.590 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87123 2024-04-19T03:03:06.590 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.590 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:06.590 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.590 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:06.590 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249233+0000", 2024-04-19T03:03:06.590 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:06.590 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.590 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.590 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:06.590 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249233+0000", 2024-04-19T03:03:06.590 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:06.590 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.590 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.591 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:06.591 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249231+0000", 2024-04-19T03:03:06.591 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999986 2024-04-19T03:03:06.591 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.591 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.591 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:06.591 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249285+0000", 2024-04-19T03:03:06.591 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4005000000000002e-05 2024-04-19T03:03:06.591 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.591 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.591 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:06.591 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249300+0000", 2024-04-19T03:03:06.591 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4715999999999999e-05 2024-04-19T03:03:06.591 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.592 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.592 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:06.592 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249307+0000", 2024-04-19T03:03:06.592 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8399999999999997e-06 2024-04-19T03:03:06.592 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.592 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.592 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:06.592 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249366+0000", 2024-04-19T03:03:06.592 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9435999999999998e-05 2024-04-19T03:03:06.592 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.592 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.592 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op must wait for map", 2024-04-19T03:03:06.592 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249376+0000", 2024-04-19T03:03:06.592 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.4919999999999999e-06 2024-04-19T03:03:06.592 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.593 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.593 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:06.593 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263757+0000", 2024-04-19T03:03:06.593 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.014381461999999999 2024-04-19T03:03:06.593 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.593 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.593 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:03:06.593 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263875+0000", 2024-04-19T03:03:06.593 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000117166 2024-04-19T03:03:06.593 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.593 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.593 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:06.593 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.277136+0000", 2024-04-19T03:03:06.593 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.013261207 2024-04-19T03:03:06.594 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.594 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.594 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:06.594 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.278403+0000", 2024-04-19T03:03:06.594 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001267106 2024-04-19T03:03:06.594 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:06.594 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:06.594 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:06.594 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.594 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.594 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87128 5.6 5:6905c420:::benchmark_data_smithi096_19531_object87127:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:03:06.594 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249323+0000", 2024-04-19T03:03:06.594 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 43.302685637000003, 2024-04-19T03:03:06.594 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0292813249999999, 2024-04-19T03:03:06.595 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:06.595 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-04-19T03:03:06.595 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:06.595 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:06.595 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:06.595 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87128 2024-04-19T03:03:06.595 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.595 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:06.595 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.595 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:06.595 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249323+0000", 2024-04-19T03:03:06.595 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:06.595 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.595 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.596 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:06.596 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249323+0000", 2024-04-19T03:03:06.596 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:06.596 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.596 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.596 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:06.596 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249323+0000", 2024-04-19T03:03:06.596 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:06.596 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.596 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.596 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:06.596 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249385+0000", 2024-04-19T03:03:06.596 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1711999999999995e-05 2024-04-19T03:03:06.596 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.596 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.597 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:06.597 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249398+0000", 2024-04-19T03:03:06.597 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3022e-05 2024-04-19T03:03:06.597 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.597 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.597 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:06.597 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249402+0000", 2024-04-19T03:03:06.597 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4819999999999996e-06 2024-04-19T03:03:06.597 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.597 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.597 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:06.597 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249437+0000", 2024-04-19T03:03:06.597 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4702000000000001e-05 2024-04-19T03:03:06.597 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.598 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.598 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:03:06.598 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249442+0000", 2024-04-19T03:03:06.598 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8019999999999999e-06 2024-04-19T03:03:06.598 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.598 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.598 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:06.598 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263896+0000", 2024-04-19T03:03:06.598 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.014454679999999999 2024-04-19T03:03:06.598 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.598 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.598 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:03:06.599 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263900+0000", 2024-04-19T03:03:06.599 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9700000000000001e-06 2024-04-19T03:03:06.599 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.599 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.599 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:06.599 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.278557+0000", 2024-04-19T03:03:06.599 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0146566480000001 2024-04-19T03:03:06.599 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.599 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.599 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:06.599 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.278605+0000", 2024-04-19T03:03:06.599 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7735999999999998e-05 2024-04-19T03:03:06.599 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:06.599 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:06.600 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:06.600 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.600 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.600 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87130 5.3 5:c8c2d67b:::benchmark_data_smithi096_19531_object87129:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:03:06.600 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249418+0000", 2024-04-19T03:03:06.600 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 43.302590926000001, 2024-04-19T03:03:06.600 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.025414182, 2024-04-19T03:03:06.600 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:06.600 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-04-19T03:03:06.600 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:06.600 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:06.600 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:06.600 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87130 2024-04-19T03:03:06.600 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.601 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:06.601 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.601 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:06.601 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249418+0000", 2024-04-19T03:03:06.601 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:06.601 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.601 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.601 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:06.601 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249418+0000", 2024-04-19T03:03:06.601 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:06.601 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.601 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.601 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:06.601 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249409+0000", 2024-04-19T03:03:06.602 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999905 2024-04-19T03:03:06.602 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.602 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.602 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:06.602 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249464+0000", 2024-04-19T03:03:06.602 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5381999999999999e-05 2024-04-19T03:03:06.603 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.603 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.603 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:06.603 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249471+0000", 2024-04-19T03:03:06.603 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2609999999999996e-06 2024-04-19T03:03:06.603 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.603 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.603 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:06.603 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249475+0000", 2024-04-19T03:03:06.603 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2839999999999998e-06 2024-04-19T03:03:06.603 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.603 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.603 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:06.603 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249535+0000", 2024-04-19T03:03:06.604 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0545999999999999e-05 2024-04-19T03:03:06.604 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.604 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.604 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op must wait for map", 2024-04-19T03:03:06.604 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249540+0000", 2024-04-19T03:03:06.604 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2859999999999999e-06 2024-04-19T03:03:06.604 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.604 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.604 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:06.604 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263450+0000", 2024-04-19T03:03:06.604 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.013909585 2024-04-19T03:03:06.604 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.604 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.604 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:03:06.604 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263458+0000", 2024-04-19T03:03:06.605 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8089999999999993e-06 2024-04-19T03:03:06.605 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.605 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.605 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:06.605 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.273193+0000", 2024-04-19T03:03:06.605 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0097351379999999 2024-04-19T03:03:06.605 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.605 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.605 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:06.605 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.274832+0000", 2024-04-19T03:03:06.605 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0016394789999999999 2024-04-19T03:03:06.605 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:06.605 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:06.605 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:06.606 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.606 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.606 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87131 5.1 5:83756d55:::benchmark_data_smithi096_19531_object87130:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:03:06.606 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249491+0000", 2024-04-19T03:03:06.606 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 43.302518278999997, 2024-04-19T03:03:06.606 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0191489520000001, 2024-04-19T03:03:06.606 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:06.606 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-04-19T03:03:06.606 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:06.606 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:06.606 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:06.606 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87131 2024-04-19T03:03:06.606 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.606 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:06.607 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.607 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:06.607 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249491+0000", 2024-04-19T03:03:06.607 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:06.607 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.607 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.607 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:06.607 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249491+0000", 2024-04-19T03:03:06.607 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:06.607 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.607 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.607 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:06.607 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249491+0000", 2024-04-19T03:03:06.607 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:06.607 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.608 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.608 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:06.608 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249530+0000", 2024-04-19T03:03:06.608 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9589000000000003e-05 2024-04-19T03:03:06.608 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.608 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.608 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:06.608 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249544+0000", 2024-04-19T03:03:06.608 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4158000000000001e-05 2024-04-19T03:03:06.608 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.608 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.608 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:06.608 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249549+0000", 2024-04-19T03:03:06.608 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6809999999999997e-06 2024-04-19T03:03:06.608 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.609 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.609 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:06.609 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249592+0000", 2024-04-19T03:03:06.609 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3285999999999999e-05 2024-04-19T03:03:06.609 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.609 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.609 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op must wait for map", 2024-04-19T03:03:06.609 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249598+0000", 2024-04-19T03:03:06.609 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8329999999999999e-06 2024-04-19T03:03:06.609 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.609 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.609 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:06.609 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263331+0000", 2024-04-19T03:03:06.609 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.013733093 2024-04-19T03:03:06.610 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.610 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.610 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:03:06.610 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263343+0000", 2024-04-19T03:03:06.610 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.189e-05 2024-04-19T03:03:06.610 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.610 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.610 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:06.610 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.268541+0000", 2024-04-19T03:03:06.610 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0051983440000001 2024-04-19T03:03:06.610 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.610 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.610 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:06.611 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.268640+0000", 2024-04-19T03:03:06.611 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.8387999999999994e-05 2024-04-19T03:03:06.611 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:06.611 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:06.611 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:06.611 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.611 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.611 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87132 5.c 5:3e18b732:::benchmark_data_smithi096_19531_object87131:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:03:06.611 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249558+0000", 2024-04-19T03:03:06.611 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 43.302451378000001, 2024-04-19T03:03:06.611 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0241198380000001, 2024-04-19T03:03:06.611 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:06.611 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-04-19T03:03:06.612 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:06.612 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:06.612 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:06.612 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87132 2024-04-19T03:03:06.612 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.612 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:06.612 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.612 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:06.612 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249558+0000", 2024-04-19T03:03:06.612 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:06.612 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.612 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.612 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:06.612 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249558+0000", 2024-04-19T03:03:06.613 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:06.613 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.613 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.613 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:06.613 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249557+0000", 2024-04-19T03:03:06.613 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:06.613 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.613 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.613 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:06.613 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249625+0000", 2024-04-19T03:03:06.613 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7200999999999996e-05 2024-04-19T03:03:06.613 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.613 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.613 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:06.613 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249646+0000", 2024-04-19T03:03:06.614 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1053e-05 2024-04-19T03:03:06.614 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.614 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.614 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:06.614 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249650+0000", 2024-04-19T03:03:06.614 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2719999999999999e-06 2024-04-19T03:03:06.614 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.614 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.614 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:06.614 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249686+0000", 2024-04-19T03:03:06.615 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6430000000000002e-05 2024-04-19T03:03:06.615 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.615 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.615 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op must wait for map", 2024-04-19T03:03:06.615 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249690+0000", 2024-04-19T03:03:06.615 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.765e-06 2024-04-19T03:03:06.615 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.615 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.615 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:06.615 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261157+0000", 2024-04-19T03:03:06.615 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011467247999999999 2024-04-19T03:03:06.615 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.615 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.615 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:03:06.616 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261170+0000", 2024-04-19T03:03:06.616 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2833000000000001e-05 2024-04-19T03:03:06.616 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.616 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.616 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:06.616 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.272119+0000", 2024-04-19T03:03:06.616 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.010949313 2024-04-19T03:03:06.616 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.616 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.616 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:06.616 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.273678+0000", 2024-04-19T03:03:06.616 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0015581550000000001 2024-04-19T03:03:06.616 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:06.616 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:06.617 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:06.617 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.617 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.617 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87133 5.c 5:3f772a62:::benchmark_data_smithi096_19531_object87132:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:03:06.617 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249657+0000", 2024-04-19T03:03:06.617 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 43.302351999000003, 2024-04-19T03:03:06.617 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0242819409999999, 2024-04-19T03:03:06.617 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:06.617 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-04-19T03:03:06.617 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:06.617 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:06.617 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:06.617 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87133 2024-04-19T03:03:06.617 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.618 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:06.618 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.618 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:06.618 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249657+0000", 2024-04-19T03:03:06.618 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:06.618 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.618 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.618 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:06.618 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249657+0000", 2024-04-19T03:03:06.618 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:06.618 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.618 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.618 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:06.619 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249657+0000", 2024-04-19T03:03:06.619 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:06.619 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.619 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.619 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:06.619 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249690+0000", 2024-04-19T03:03:06.619 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3343000000000002e-05 2024-04-19T03:03:06.619 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.619 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.619 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:06.619 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249695+0000", 2024-04-19T03:03:06.619 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8600000000000001e-06 2024-04-19T03:03:06.619 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.619 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.619 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:06.620 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249698+0000", 2024-04-19T03:03:06.620 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.1700000000000001e-06 2024-04-19T03:03:06.620 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.620 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.620 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:06.620 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249741+0000", 2024-04-19T03:03:06.620 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2849999999999998e-05 2024-04-19T03:03:06.620 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.620 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.620 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:03:06.620 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249746+0000", 2024-04-19T03:03:06.620 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1019999999999996e-06 2024-04-19T03:03:06.620 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.620 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.621 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:06.621 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261209+0000", 2024-04-19T03:03:06.621 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011462447000000001 2024-04-19T03:03:06.621 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.621 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.621 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:03:06.621 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261216+0000", 2024-04-19T03:03:06.621 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8520000000000004e-06 2024-04-19T03:03:06.621 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.621 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.621 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:06.621 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.273872+0000", 2024-04-19T03:03:06.621 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0126558000000001 2024-04-19T03:03:06.621 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.621 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.622 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:06.622 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.273939+0000", 2024-04-19T03:03:06.622 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6822000000000005e-05 2024-04-19T03:03:06.622 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:06.622 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:06.622 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:06.622 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.622 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.622 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87134 5.5 5:a56c478f:::benchmark_data_smithi096_19531_object87133:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:03:06.622 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249708+0000", 2024-04-19T03:03:06.622 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 43.302301075000003, 2024-04-19T03:03:06.622 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0214677299999999, 2024-04-19T03:03:06.622 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:06.623 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-04-19T03:03:06.623 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:06.623 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:06.623 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:06.623 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87134 2024-04-19T03:03:06.623 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.623 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:06.623 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.623 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:06.623 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249708+0000", 2024-04-19T03:03:06.623 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:06.623 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.623 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.623 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:06.624 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249708+0000", 2024-04-19T03:03:06.624 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:06.624 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.624 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.624 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:06.624 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249706+0000", 2024-04-19T03:03:06.624 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999976 2024-04-19T03:03:06.624 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.624 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.624 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:06.624 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249740+0000", 2024-04-19T03:03:06.624 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4458000000000001e-05 2024-04-19T03:03:06.624 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.624 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.624 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:06.625 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249745+0000", 2024-04-19T03:03:06.625 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5020000000000003e-06 2024-04-19T03:03:06.625 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.625 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.625 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:06.625 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249748+0000", 2024-04-19T03:03:06.625 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2499999999999998e-06 2024-04-19T03:03:06.625 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.625 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.625 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:06.625 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249778+0000", 2024-04-19T03:03:06.625 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.006e-05 2024-04-19T03:03:06.625 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.626 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.626 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op must wait for map", 2024-04-19T03:03:06.626 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249782+0000", 2024-04-19T03:03:06.626 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2910000000000001e-06 2024-04-19T03:03:06.626 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.626 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.626 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:06.626 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261666+0000", 2024-04-19T03:03:06.626 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011883471 2024-04-19T03:03:06.626 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.626 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.626 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:03:06.626 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261674+0000", 2024-04-19T03:03:06.626 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6479999999999992e-06 2024-04-19T03:03:06.627 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.627 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.627 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:06.627 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.269323+0000", 2024-04-19T03:03:06.627 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.00764867 2024-04-19T03:03:06.627 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.627 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.627 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:06.627 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.271176+0000", 2024-04-19T03:03:06.627 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001852844 2024-04-19T03:03:06.627 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:06.627 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:06.627 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:06.628 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.628 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.628 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87137 5.c 5:30708c68:::benchmark_data_smithi096_19531_object87136:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:03:06.628 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249756+0000", 2024-04-19T03:03:06.628 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 43.302253368999999, 2024-04-19T03:03:06.628 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.033331752, 2024-04-19T03:03:06.628 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:06.628 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:06.628 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:06.628 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:06.628 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:06.628 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87137 2024-04-19T03:03:06.628 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.629 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:06.629 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.629 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:06.629 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249756+0000", 2024-04-19T03:03:06.629 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:06.629 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.629 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.629 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:06.629 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249756+0000", 2024-04-19T03:03:06.629 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:06.629 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.629 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.629 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:06.629 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249755+0000", 2024-04-19T03:03:06.630 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:06.630 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.630 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.630 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:06.630 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249777+0000", 2024-04-19T03:03:06.630 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1420000000000002e-05 2024-04-19T03:03:06.630 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.630 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.630 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:06.630 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249781+0000", 2024-04-19T03:03:06.630 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0609999999999997e-06 2024-04-19T03:03:06.630 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.630 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.630 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:06.631 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249787+0000", 2024-04-19T03:03:06.631 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.02e-06 2024-04-19T03:03:06.631 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.631 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.631 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:06.631 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249818+0000", 2024-04-19T03:03:06.631 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0947e-05 2024-04-19T03:03:06.631 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.631 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.631 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:03:06.631 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249821+0000", 2024-04-19T03:03:06.631 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.117e-06 2024-04-19T03:03:06.631 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.631 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.632 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:06.632 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261243+0000", 2024-04-19T03:03:06.632 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011421875999999999 2024-04-19T03:03:06.632 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.632 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.632 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:03:06.632 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261251+0000", 2024-04-19T03:03:06.632 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6120000000000001e-06 2024-04-19T03:03:06.632 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.632 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.632 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:06.632 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.274050+0000", 2024-04-19T03:03:06.632 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.012799405 2024-04-19T03:03:06.632 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.633 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.633 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:06.633 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.274529+0000", 2024-04-19T03:03:06.633 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00047867100000000001 2024-04-19T03:03:06.633 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.633 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.633 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:03:06.633 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.282972+0000", 2024-04-19T03:03:06.633 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0084436900000000002 2024-04-19T03:03:06.633 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.633 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.633 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:03:06.633 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.283022+0000", 2024-04-19T03:03:06.634 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9339000000000003e-05 2024-04-19T03:03:06.634 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.634 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.634 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:06.634 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.283088+0000", 2024-04-19T03:03:06.634 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5877999999999995e-05 2024-04-19T03:03:06.634 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:06.634 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:06.634 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:06.634 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.634 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.634 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:158376 5.9 5:9e73c076:::benchmark_data_smithi096_19531_object44926:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-19T03:03:06.634 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:58.126227+0000", 2024-04-19T03:03:06.634 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 8.425781636, 2024-04-19T03:03:06.635 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.069738668000000004, 2024-04-19T03:03:06.635 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:06.635 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:06.635 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:06.635 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:06.635 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:06.635 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 158376 2024-04-19T03:03:06.635 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.635 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:06.635 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.635 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:06.635 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.126227+0000", 2024-04-19T03:03:06.635 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:06.635 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.636 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.636 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:06.636 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.126227+0000", 2024-04-19T03:03:06.636 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:06.636 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.636 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.636 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:06.636 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.126226+0000", 2024-04-19T03:03:06.636 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:03:06.636 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.636 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.636 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:06.636 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.126236+0000", 2024-04-19T03:03:06.636 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.4199999999999996e-06 2024-04-19T03:03:06.637 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.637 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.637 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:06.637 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.126243+0000", 2024-04-19T03:03:06.637 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.199e-06 2024-04-19T03:03:06.637 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.637 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.637 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:06.637 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.126248+0000", 2024-04-19T03:03:06.637 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1320000000000002e-06 2024-04-19T03:03:06.637 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.638 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.638 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:06.638 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.126286+0000", 2024-04-19T03:03:06.638 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7401000000000003e-05 2024-04-19T03:03:06.638 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.638 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.638 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:06.638 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.126368+0000", 2024-04-19T03:03:06.638 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2113999999999993e-05 2024-04-19T03:03:06.638 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.638 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.638 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:03:06.638 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.126438+0000", 2024-04-19T03:03:06.639 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0337000000000001e-05 2024-04-19T03:03:06.639 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.639 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.639 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:03:06.639 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.130816+0000", 2024-04-19T03:03:06.639 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0043778330000000002 2024-04-19T03:03:06.639 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.639 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.639 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:06.639 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.195830+0000", 2024-04-19T03:03:06.639 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.065013933999999995 2024-04-19T03:03:06.639 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.639 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.640 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:03:06.640 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.195907+0000", 2024-04-19T03:03:06.640 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7397000000000005e-05 2024-04-19T03:03:06.640 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.640 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.640 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:06.640 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.195966+0000", 2024-04-19T03:03:06.640 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8906999999999997e-05 2024-04-19T03:03:06.640 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:06.640 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:06.640 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:06.640 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.640 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.640 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:158381 5.9 5:94dcd4a7:::benchmark_data_smithi096_19531_object44931:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-19T03:03:06.641 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:58.128712+0000", 2024-04-19T03:03:06.641 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 8.4232971929999998, 2024-04-19T03:03:06.641 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.067497527000000002, 2024-04-19T03:03:06.641 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:06.641 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:06.641 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:06.641 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:06.641 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:06.641 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 158381 2024-04-19T03:03:06.641 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.641 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:06.641 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.641 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:06.641 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.128712+0000", 2024-04-19T03:03:06.642 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:06.642 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.642 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.642 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:06.642 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.128712+0000", 2024-04-19T03:03:06.642 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:06.642 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.642 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.642 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:06.642 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.128711+0000", 2024-04-19T03:03:06.642 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:03:06.642 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.642 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.643 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:06.643 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.128716+0000", 2024-04-19T03:03:06.643 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0610000000000003e-06 2024-04-19T03:03:06.643 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.643 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.643 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:06.643 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.128724+0000", 2024-04-19T03:03:06.643 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0120000000000005e-06 2024-04-19T03:03:06.643 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.643 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.643 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:06.643 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.128729+0000", 2024-04-19T03:03:06.643 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8899999999999998e-06 2024-04-19T03:03:06.643 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.644 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.644 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:06.644 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.128778+0000", 2024-04-19T03:03:06.644 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9110000000000002e-05 2024-04-19T03:03:06.644 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.644 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.644 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:06.644 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.128903+0000", 2024-04-19T03:03:06.644 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00012506799999999999 2024-04-19T03:03:06.644 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.644 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.644 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:03:06.645 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.129022+0000", 2024-04-19T03:03:06.645 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00011923599999999999 2024-04-19T03:03:06.645 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.645 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.645 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:03:06.645 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.132294+0000", 2024-04-19T03:03:06.645 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.003271244 2024-04-19T03:03:06.645 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.645 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.645 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:06.645 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.196045+0000", 2024-04-19T03:03:06.645 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.063751206000000005 2024-04-19T03:03:06.645 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.646 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.646 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:03:06.646 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.196133+0000", 2024-04-19T03:03:06.646 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.8213000000000004e-05 2024-04-19T03:03:06.646 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.646 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.646 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:06.646 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.196209+0000", 2024-04-19T03:03:06.646 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6335999999999996e-05 2024-04-19T03:03:06.646 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:06.646 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:06.646 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:06.646 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.647 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.647 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:158385 5.9 5:950ec749:::benchmark_data_smithi096_19531_object44935:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-19T03:03:06.647 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:58.129756+0000", 2024-04-19T03:03:06.647 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 8.4222532609999998, 2024-04-19T03:03:06.647 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.068998382999999996, 2024-04-19T03:03:06.647 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:06.647 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:06.647 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:06.647 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:06.647 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:06.647 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 158385 2024-04-19T03:03:06.647 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.647 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:06.647 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.648 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:06.648 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.129756+0000", 2024-04-19T03:03:06.648 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:06.648 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.648 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.648 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:06.648 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.129756+0000", 2024-04-19T03:03:06.648 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:06.648 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.648 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.648 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:06.648 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.129755+0000", 2024-04-19T03:03:06.648 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:03:06.648 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.649 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.649 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:06.649 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.129760+0000", 2024-04-19T03:03:06.649 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6030000000000004e-06 2024-04-19T03:03:06.649 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.649 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.649 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:06.649 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.129774+0000", 2024-04-19T03:03:06.649 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3131e-05 2024-04-19T03:03:06.649 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.649 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.649 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:06.649 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.129781+0000", 2024-04-19T03:03:06.649 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4030000000000001e-06 2024-04-19T03:03:06.649 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.650 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.650 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:06.650 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.130837+0000", 2024-04-19T03:03:06.650 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00105569 2024-04-19T03:03:06.650 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.650 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.650 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:06.650 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.130917+0000", 2024-04-19T03:03:06.650 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9929e-05 2024-04-19T03:03:06.650 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.650 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.650 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:03:06.650 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.130973+0000", 2024-04-19T03:03:06.650 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.664e-05 2024-04-19T03:03:06.651 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.651 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.651 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:03:06.651 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.132340+0000", 2024-04-19T03:03:06.651 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001366321 2024-04-19T03:03:06.651 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.651 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.651 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:06.651 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.198637+0000", 2024-04-19T03:03:06.651 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.066296888999999998 2024-04-19T03:03:06.651 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.651 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.651 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:03:06.652 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.198704+0000", 2024-04-19T03:03:06.652 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7333000000000001e-05 2024-04-19T03:03:06.652 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.652 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.652 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:06.652 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.198754+0000", 2024-04-19T03:03:06.652 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0421999999999999e-05 2024-04-19T03:03:06.652 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:06.652 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:06.652 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:06.652 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.652 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.652 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:158387 5.9 5:9e96f619:::benchmark_data_smithi096_19531_object44937:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-19T03:03:06.653 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:58.132457+0000", 2024-04-19T03:03:06.653 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 8.4195516969999993, 2024-04-19T03:03:06.653 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.066858091999999994, 2024-04-19T03:03:06.653 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:06.653 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:06.653 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:06.653 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:06.653 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:06.653 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 158387 2024-04-19T03:03:06.653 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.653 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:06.653 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.653 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:06.653 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.132457+0000", 2024-04-19T03:03:06.654 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:06.654 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.654 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.654 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:06.654 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.132457+0000", 2024-04-19T03:03:06.654 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:06.654 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.654 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.654 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:06.654 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.132457+0000", 2024-04-19T03:03:06.654 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:06.654 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.654 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.654 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:06.654 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.132460+0000", 2024-04-19T03:03:06.655 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.1949999999999999e-06 2024-04-19T03:03:06.655 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.655 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.655 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:06.655 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.132468+0000", 2024-04-19T03:03:06.655 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.1599999999999998e-06 2024-04-19T03:03:06.655 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.655 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.655 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:06.655 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.132473+0000", 2024-04-19T03:03:06.655 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9259999999999999e-06 2024-04-19T03:03:06.655 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.655 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.655 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:06.656 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.132504+0000", 2024-04-19T03:03:06.656 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0914000000000003e-05 2024-04-19T03:03:06.656 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.656 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.656 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:06.656 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.132646+0000", 2024-04-19T03:03:06.656 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00014214300000000001 2024-04-19T03:03:06.656 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.656 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.656 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:03:06.656 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.132741+0000", 2024-04-19T03:03:06.656 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.4344000000000003e-05 2024-04-19T03:03:06.656 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.656 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.657 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:03:06.657 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.135774+0000", 2024-04-19T03:03:06.657 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0030334960000000001 2024-04-19T03:03:06.657 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.657 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.657 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:06.657 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.199240+0000", 2024-04-19T03:03:06.657 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.063465695000000003 2024-04-19T03:03:06.657 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.657 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.657 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:03:06.657 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.199272+0000", 2024-04-19T03:03:06.657 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2412000000000001e-05 2024-04-19T03:03:06.657 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.658 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.658 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:06.658 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.199316+0000", 2024-04-19T03:03:06.658 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3275000000000002e-05 2024-04-19T03:03:06.658 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:06.658 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:06.658 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:06.658 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.658 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.658 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:158392 5.f 5:f462725f:::benchmark_data_smithi096_19531_object44942:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-19T03:03:06.658 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:58.135703+0000", 2024-04-19T03:03:06.658 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 8.4163059170000007, 2024-04-19T03:03:06.658 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.063132879000000003, 2024-04-19T03:03:06.658 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:06.659 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:06.659 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:06.659 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:06.659 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:06.659 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 158392 2024-04-19T03:03:06.659 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.659 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:06.659 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.659 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:06.659 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.135703+0000", 2024-04-19T03:03:06.659 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:06.659 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.659 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.660 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:06.660 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.135703+0000", 2024-04-19T03:03:06.660 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:06.660 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.660 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.660 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:06.660 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.135702+0000", 2024-04-19T03:03:06.660 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:03:06.660 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.660 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.660 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:06.660 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.135708+0000", 2024-04-19T03:03:06.660 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8270000000000003e-06 2024-04-19T03:03:06.660 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.661 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.661 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:06.661 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.135720+0000", 2024-04-19T03:03:06.661 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2057e-05 2024-04-19T03:03:06.661 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.661 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.661 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:06.661 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.135727+0000", 2024-04-19T03:03:06.661 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8090000000000004e-06 2024-04-19T03:03:06.661 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.661 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.661 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:06.661 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.135768+0000", 2024-04-19T03:03:06.661 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1548999999999998e-05 2024-04-19T03:03:06.662 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.662 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.662 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:06.662 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.135853+0000", 2024-04-19T03:03:06.662 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4845000000000005e-05 2024-04-19T03:03:06.662 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.662 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.662 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:03:06.662 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.135934+0000", 2024-04-19T03:03:06.662 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0315000000000006e-05 2024-04-19T03:03:06.662 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.662 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.662 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:03:06.662 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.138685+0000", 2024-04-19T03:03:06.662 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.002751042 2024-04-19T03:03:06.663 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.663 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.663 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:06.663 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.198747+0000", 2024-04-19T03:03:06.663 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.060062675000000003 2024-04-19T03:03:06.663 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.663 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.663 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:03:06.663 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.198802+0000", 2024-04-19T03:03:06.663 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4469000000000003e-05 2024-04-19T03:03:06.663 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.663 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.663 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:06.663 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.198836+0000", 2024-04-19T03:03:06.664 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4272e-05 2024-04-19T03:03:06.664 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:06.664 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:06.664 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:06.664 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.664 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.664 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:158397 5.d 5:b5d962e9:::benchmark_data_smithi096_19531_object44947:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-19T03:03:06.664 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:58.138717+0000", 2024-04-19T03:03:06.664 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 8.4132919739999998, 2024-04-19T03:03:06.664 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.057191467000000003, 2024-04-19T03:03:06.664 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:06.664 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:06.664 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:06.664 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:06.664 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:06.665 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 158397 2024-04-19T03:03:06.665 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.665 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:06.665 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.665 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:06.665 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.138717+0000", 2024-04-19T03:03:06.665 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:06.665 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.665 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.665 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:06.665 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.138717+0000", 2024-04-19T03:03:06.665 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:06.665 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.665 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.666 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:06.666 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.138716+0000", 2024-04-19T03:03:06.666 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999986 2024-04-19T03:03:06.666 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.666 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.666 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:06.666 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.138722+0000", 2024-04-19T03:03:06.666 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1709999999999999e-06 2024-04-19T03:03:06.666 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.666 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.666 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:06.666 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.138731+0000", 2024-04-19T03:03:06.666 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.0310000000000004e-06 2024-04-19T03:03:06.666 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.667 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.667 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:06.667 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.138738+0000", 2024-04-19T03:03:06.667 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8430000000000004e-06 2024-04-19T03:03:06.667 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.667 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.667 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:06.667 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.138789+0000", 2024-04-19T03:03:06.667 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0623e-05 2024-04-19T03:03:06.667 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.667 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.667 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:06.667 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.138945+0000", 2024-04-19T03:03:06.667 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00015671899999999999 2024-04-19T03:03:06.667 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.668 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.668 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:03:06.668 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.139079+0000", 2024-04-19T03:03:06.668 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00013380099999999999 2024-04-19T03:03:06.668 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.668 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.668 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:03:06.668 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.141715+0000", 2024-04-19T03:03:06.668 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0026362849999999999 2024-04-19T03:03:06.668 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.668 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.668 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:06.668 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.195784+0000", 2024-04-19T03:03:06.668 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.054068353 2024-04-19T03:03:06.668 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.669 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.669 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:03:06.669 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.195852+0000", 2024-04-19T03:03:06.669 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8121999999999996e-05 2024-04-19T03:03:06.669 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:06.669 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:06.669 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:06.669 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.195909+0000", 2024-04-19T03:03:06.669 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6737999999999998e-05 2024-04-19T03:03:06.669 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:06.669 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:06.669 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:06.669 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:06.669 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:06.669 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-04-19T03:03:06.671 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:03:06.666+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:03:06.672 INFO:teuthology.orchestra.run.smithi096.stderr:noscrub is unset 2024-04-19T03:03:06.673 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T03:03:06.772 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:03:06.768+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:03:06.800 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-19T03:03:06.800 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-04-19T03:03:06.800 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:06.800 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:179782 5.8 5:1d3d9566:::benchmark_data_smithi096_19531_object66332:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-19T03:03:06.800 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:03:06.795080+0000", 2024-04-19T03:03:06.800 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0046950350000000002, 2024-04-19T03:03:06.800 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0047223270000000001, 2024-04-19T03:03:06.800 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:06.800 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-19T03:03:06.800 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:06.800 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:06.800 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:06.801 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 179782 2024-04-19T03:03:06.801 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:06.801 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:06.801 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:06.801 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:06.801 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:06.795080+0000", 2024-04-19T03:03:06.801 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:06.801 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:06.801 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:06.801 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:06.801 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:06.795080+0000", 2024-04-19T03:03:06.801 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:06.801 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:06.802 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:06.802 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:06.802 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:06.795079+0000", 2024-04-19T03:03:06.802 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:03:06.802 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:06.802 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:06.802 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:06.802 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:06.795084+0000", 2024-04-19T03:03:06.802 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5079999999999999e-06 2024-04-19T03:03:06.802 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:06.802 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:06.802 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:06.802 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:06.795091+0000", 2024-04-19T03:03:06.802 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.238e-06 2024-04-19T03:03:06.803 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:06.803 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:06.803 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:06.803 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:06.795098+0000", 2024-04-19T03:03:06.803 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5700000000000004e-06 2024-04-19T03:03:06.803 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:06.803 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:06.803 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:06.803 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:06.795145+0000", 2024-04-19T03:03:06.803 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6412000000000002e-05 2024-04-19T03:03:06.803 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:06.803 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:06.803 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:06.803 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:06.795233+0000", 2024-04-19T03:03:06.803 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.7785000000000001e-05 2024-04-19T03:03:06.804 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:06.804 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:06.804 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:06.804 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:06.804 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:06.804 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4755.0:179779 5.9 e59/22 5:9f88b0b2:::benchmark_data_smithi096_19531_object66329:head v 59'10975, mlcod=59'10973)", 2024-04-19T03:03:06.804 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:03:06.795308+0000", 2024-04-19T03:03:06.804 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0044665290000000003, 2024-04-19T03:03:06.804 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0045755709999999996, 2024-04-19T03:03:06.804 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:06.804 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-19T03:03:06.804 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:06.804 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:06.804 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:06.805 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:06.795308+0000", 2024-04-19T03:03:06.805 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:06.805 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:06.805 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:06.805 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:06.805 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:06.795308+0000", 2024-04-19T03:03:06.805 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:06.805 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:06.805 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:06.805 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:06.805 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:06.795308+0000", 2024-04-19T03:03:06.805 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:03:06.805 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:06.806 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:06.806 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:06.806 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:06.795315+0000", 2024-04-19T03:03:06.806 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.9800000000000001e-06 2024-04-19T03:03:06.806 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:06.806 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:06.806 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:06.806 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:06.795322+0000", 2024-04-19T03:03:06.806 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3470000000000001e-06 2024-04-19T03:03:06.806 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:06.806 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:06.806 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:06.806 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:06.795327+0000", 2024-04-19T03:03:06.807 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6079999999999998e-06 2024-04-19T03:03:06.807 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:06.807 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:06.807 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:06.807 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:06.795371+0000", 2024-04-19T03:03:06.807 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4718000000000001e-05 2024-04-19T03:03:06.807 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:06.807 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:06.807 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:06.807 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:06.795392+0000", 2024-04-19T03:03:06.807 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0346000000000001e-05 2024-04-19T03:03:06.807 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:06.807 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:06.807 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:06.808 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:06.808 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:06.808 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4755.0:179780 5.9 e59/22 5:9a1445da:::benchmark_data_smithi096_19531_object66330:head v 59'10976, mlcod=59'10973)", 2024-04-19T03:03:06.808 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:03:06.797041+0000", 2024-04-19T03:03:06.808 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0027344600000000002, 2024-04-19T03:03:06.808 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0029097910000000001, 2024-04-19T03:03:06.808 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:06.808 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-19T03:03:06.808 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:06.808 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:06.808 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:06.808 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:06.797041+0000", 2024-04-19T03:03:06.808 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:06.808 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:06.809 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:06.809 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:06.809 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:06.797041+0000", 2024-04-19T03:03:06.809 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:06.809 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:06.809 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:06.809 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:06.809 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:06.797040+0000", 2024-04-19T03:03:06.809 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:03:06.809 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:06.809 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:06.809 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:06.809 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:06.797047+0000", 2024-04-19T03:03:06.809 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5909999999999998e-06 2024-04-19T03:03:06.810 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:06.810 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:06.810 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:06.810 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:06.797079+0000", 2024-04-19T03:03:06.810 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1987999999999999e-05 2024-04-19T03:03:06.810 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:06.810 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:06.810 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:06.810 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:06.797088+0000", 2024-04-19T03:03:06.810 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.2109999999999998e-06 2024-04-19T03:03:06.810 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:06.810 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:06.810 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:06.810 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:06.797533+0000", 2024-04-19T03:03:06.811 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00044558 2024-04-19T03:03:06.811 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:06.811 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:06.811 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:06.811 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:06.797556+0000", 2024-04-19T03:03:06.811 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3030000000000001e-05 2024-04-19T03:03:06.811 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:06.811 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:06.811 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:06.811 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:06.811 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:06.811 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:179785 5.e 5:7bf052c8:::benchmark_data_smithi096_19531_object66335:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-19T03:03:06.811 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:03:06.797103+0000", 2024-04-19T03:03:06.811 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0026724209999999999, 2024-04-19T03:03:06.812 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0029170229999999999, 2024-04-19T03:03:06.812 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:06.812 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-19T03:03:06.812 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:06.812 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:06.812 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:06.812 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 179785 2024-04-19T03:03:06.812 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:06.812 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:06.812 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:06.812 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:06.812 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:06.797103+0000", 2024-04-19T03:03:06.812 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:06.812 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:06.813 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:06.813 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:06.813 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:06.797103+0000", 2024-04-19T03:03:06.813 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:06.813 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:06.813 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:06.813 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:06.813 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:06.797102+0000", 2024-04-19T03:03:06.813 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:03:06.813 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:06.813 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:06.813 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:06.813 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:06.797108+0000", 2024-04-19T03:03:06.813 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2099999999999998e-06 2024-04-19T03:03:06.813 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:06.814 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:06.814 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:06.814 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:06.797119+0000", 2024-04-19T03:03:06.814 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1277999999999999e-05 2024-04-19T03:03:06.814 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:06.814 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:06.814 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:06.814 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:06.797130+0000", 2024-04-19T03:03:06.814 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1433999999999999e-05 2024-04-19T03:03:06.814 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:06.814 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:06.814 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:06.814 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:06.797181+0000", 2024-04-19T03:03:06.815 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0773999999999999e-05 2024-04-19T03:03:06.815 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:06.815 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:06.815 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:06.815 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:06.797387+0000", 2024-04-19T03:03:06.815 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00020620100000000001 2024-04-19T03:03:06.815 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:06.815 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:06.815 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:06.815 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:06.815 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:06.816 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:179786 5.b 5:de8200a5:::benchmark_data_smithi096_19531_object66336:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-19T03:03:06.816 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:03:06.797374+0000", 2024-04-19T03:03:06.816 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.002400611, 2024-04-19T03:03:06.816 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0027224900000000002, 2024-04-19T03:03:06.816 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:06.816 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-19T03:03:06.816 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:06.816 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:06.816 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:06.816 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 179786 2024-04-19T03:03:06.816 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:06.816 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:06.817 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:06.817 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:06.817 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:06.797374+0000", 2024-04-19T03:03:06.817 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:06.817 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:06.817 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:06.817 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:06.817 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:06.797374+0000", 2024-04-19T03:03:06.817 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:06.817 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:06.817 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:06.817 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:06.817 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:06.797374+0000", 2024-04-19T03:03:06.818 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:03:06.818 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:06.818 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:06.818 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:06.818 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:06.797379+0000", 2024-04-19T03:03:06.818 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4389999999999999e-06 2024-04-19T03:03:06.818 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:06.818 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:06.818 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:06.818 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:06.797390+0000", 2024-04-19T03:03:06.818 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1334e-05 2024-04-19T03:03:06.818 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:06.818 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:06.818 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:06.819 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:06.797397+0000", 2024-04-19T03:03:06.819 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.8589999999999999e-06 2024-04-19T03:03:06.819 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:06.819 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:06.819 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:06.819 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:06.797475+0000", 2024-04-19T03:03:06.819 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.7861999999999994e-05 2024-04-19T03:03:06.819 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:06.819 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:06.819 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:06.819 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:06.797567+0000", 2024-04-19T03:03:06.819 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1629e-05 2024-04-19T03:03:06.819 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:06.819 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:06.820 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:06.820 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:06.820 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:06.820 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:179787 5.8 5:19ef3cd1:::benchmark_data_smithi096_19531_object66337:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-19T03:03:06.820 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:03:06.797538+0000", 2024-04-19T03:03:06.820 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0022366270000000001, 2024-04-19T03:03:06.820 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.002624478, 2024-04-19T03:03:06.820 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:06.820 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-19T03:03:06.820 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:06.820 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:06.820 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:06.820 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 179787 2024-04-19T03:03:06.820 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:06.820 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:06.821 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:06.821 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:06.821 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:06.797538+0000", 2024-04-19T03:03:06.821 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:06.821 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:06.821 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:06.821 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:06.821 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:06.797538+0000", 2024-04-19T03:03:06.821 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:06.821 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:06.821 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:06.821 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:06.821 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:06.797537+0000", 2024-04-19T03:03:06.821 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:03:06.822 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:06.822 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:06.822 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:06.822 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:06.797543+0000", 2024-04-19T03:03:06.822 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6960000000000002e-06 2024-04-19T03:03:06.822 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:06.822 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:06.822 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:06.822 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:06.797552+0000", 2024-04-19T03:03:06.822 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.8650000000000007e-06 2024-04-19T03:03:06.822 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:06.822 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:06.822 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:06.822 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:06.797561+0000", 2024-04-19T03:03:06.823 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.6710000000000005e-06 2024-04-19T03:03:06.823 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:06.823 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:06.823 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:06.823 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:06.797601+0000", 2024-04-19T03:03:06.823 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9842000000000002e-05 2024-04-19T03:03:06.823 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:06.823 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:06.823 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:06.823 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:06.797740+0000", 2024-04-19T03:03:06.823 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013907599999999999 2024-04-19T03:03:06.823 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:06.823 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:06.823 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:06.823 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:06.824 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-04-19T03:03:06.824 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 6 2024-04-19T03:03:06.824 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-19T03:03:06.825 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T03:03:06.872 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:03:06.868+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:03:06.940 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-19T03:03:06.941 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-04-19T03:03:06.941 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-04-19T03:03:06.941 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-04-19T03:03:06.941 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-19T03:03:06.953 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T03:03:06.974 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:03:06.972+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:03:07.075 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:03:07.072+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:03:07.076 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-19T03:03:07.076 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-04-19T03:03:07.076 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-04-19T03:03:07.076 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-04-19T03:03:07.076 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.076 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:86615 5.e 5:7fef7288:::benchmark_data_smithi096_19531_object86614:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:07.076 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:22.634544+0000", 2024-04-19T03:03:07.076 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 44.439297584999998, 2024-04-19T03:03:07.076 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.192475071, 2024-04-19T03:03:07.076 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:07.077 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:07.077 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:07.077 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:07.077 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:07.077 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 86615 2024-04-19T03:03:07.077 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.077 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:07.077 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.077 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:07.077 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634544+0000", 2024-04-19T03:03:07.077 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:07.077 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.077 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.078 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:07.078 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634544+0000", 2024-04-19T03:03:07.078 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:07.078 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.078 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.078 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:07.078 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634542+0000", 2024-04-19T03:03:07.078 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999981 2024-04-19T03:03:07.078 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.078 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.078 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:07.078 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634585+0000", 2024-04-19T03:03:07.078 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2299000000000003e-05 2024-04-19T03:03:07.079 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.079 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.079 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:07.079 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634592+0000", 2024-04-19T03:03:07.079 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2350000000000002e-06 2024-04-19T03:03:07.079 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.079 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.079 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:07.079 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634596+0000", 2024-04-19T03:03:07.079 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5390000000000001e-06 2024-04-19T03:03:07.079 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.079 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.079 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:07.080 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634639+0000", 2024-04-19T03:03:07.080 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2444999999999998e-05 2024-04-19T03:03:07.080 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.080 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.080 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:07.080 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634808+0000", 2024-04-19T03:03:07.080 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000169152 2024-04-19T03:03:07.080 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.080 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.080 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:07.080 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634999+0000", 2024-04-19T03:03:07.080 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00019098300000000001 2024-04-19T03:03:07.080 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.081 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.081 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:07.081 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.640458+0000", 2024-04-19T03:03:07.081 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0054586870000000003 2024-04-19T03:03:07.081 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.081 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.081 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:07.081 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.826949+0000", 2024-04-19T03:03:07.081 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.18649178299999999 2024-04-19T03:03:07.081 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.081 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.081 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:03:07.081 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.826982+0000", 2024-04-19T03:03:07.082 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2477000000000001e-05 2024-04-19T03:03:07.082 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.082 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.082 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:07.082 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.827019+0000", 2024-04-19T03:03:07.082 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7355999999999999e-05 2024-04-19T03:03:07.082 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:07.082 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:07.082 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:07.082 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.082 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.082 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:86616 5.e 5:72278f47:::benchmark_data_smithi096_19531_object86615:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:07.082 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:22.634609+0000", 2024-04-19T03:03:07.082 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 44.439232435999998, 2024-04-19T03:03:07.083 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.19472088900000001, 2024-04-19T03:03:07.083 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:07.083 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:07.083 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:07.083 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:07.083 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:07.083 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 86616 2024-04-19T03:03:07.083 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.083 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:07.083 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.083 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:07.083 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634609+0000", 2024-04-19T03:03:07.083 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:07.083 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.084 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.084 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:07.084 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634609+0000", 2024-04-19T03:03:07.084 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:07.084 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.084 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.084 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:07.084 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634609+0000", 2024-04-19T03:03:07.084 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:07.084 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.084 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.084 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:07.084 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634651+0000", 2024-04-19T03:03:07.085 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2589000000000002e-05 2024-04-19T03:03:07.085 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.085 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.085 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:07.085 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634659+0000", 2024-04-19T03:03:07.085 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5850000000000002e-06 2024-04-19T03:03:07.085 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.085 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.085 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:07.085 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634662+0000", 2024-04-19T03:03:07.085 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3620000000000002e-06 2024-04-19T03:03:07.085 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.085 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.085 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:07.086 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.637880+0000", 2024-04-19T03:03:07.086 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.003218149 2024-04-19T03:03:07.086 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.086 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.086 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:07.086 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.637999+0000", 2024-04-19T03:03:07.086 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000118643 2024-04-19T03:03:07.086 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.086 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.086 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:07.086 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.638102+0000", 2024-04-19T03:03:07.087 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010331 2024-04-19T03:03:07.087 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.087 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.087 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:07.087 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.640851+0000", 2024-04-19T03:03:07.087 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0027483310000000001 2024-04-19T03:03:07.087 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.087 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.087 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:07.087 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.829269+0000", 2024-04-19T03:03:07.087 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.188418319 2024-04-19T03:03:07.087 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.087 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.088 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:03:07.088 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.829299+0000", 2024-04-19T03:03:07.088 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0227e-05 2024-04-19T03:03:07.088 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.088 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.088 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:07.088 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.829330+0000", 2024-04-19T03:03:07.088 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0969000000000001e-05 2024-04-19T03:03:07.088 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:07.088 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:07.088 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:07.088 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.088 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.088 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:86618 5.0 5:09014b90:::benchmark_data_smithi096_19531_object86617:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:07.088 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:22.634894+0000", 2024-04-19T03:03:07.089 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 44.438947947999999, 2024-04-19T03:03:07.089 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.19413419800000001, 2024-04-19T03:03:07.089 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:07.089 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:07.089 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:07.089 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:07.089 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:07.089 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 86618 2024-04-19T03:03:07.089 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.089 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:07.089 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.089 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:07.089 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634894+0000", 2024-04-19T03:03:07.089 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:07.090 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.090 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.090 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:07.090 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634894+0000", 2024-04-19T03:03:07.090 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:07.090 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.090 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.090 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:07.090 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634893+0000", 2024-04-19T03:03:07.090 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:03:07.090 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.090 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.090 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:07.091 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634976+0000", 2024-04-19T03:03:07.091 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3231000000000003e-05 2024-04-19T03:03:07.091 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.091 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.091 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:07.091 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634983+0000", 2024-04-19T03:03:07.091 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5169999999999996e-06 2024-04-19T03:03:07.091 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.091 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.091 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:07.091 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634987+0000", 2024-04-19T03:03:07.091 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.425e-06 2024-04-19T03:03:07.091 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.091 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.092 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:07.092 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635030+0000", 2024-04-19T03:03:07.092 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.32e-05 2024-04-19T03:03:07.092 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.092 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.092 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:07.092 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635185+0000", 2024-04-19T03:03:07.092 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015471899999999999 2024-04-19T03:03:07.092 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.092 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.092 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:07.092 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635415+0000", 2024-04-19T03:03:07.092 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00023026500000000001 2024-04-19T03:03:07.093 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.093 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.093 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:07.093 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.640127+0000", 2024-04-19T03:03:07.093 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0047118890000000004 2024-04-19T03:03:07.093 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.093 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.093 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:07.093 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.828895+0000", 2024-04-19T03:03:07.093 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.18876802600000001 2024-04-19T03:03:07.093 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.093 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.093 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:03:07.093 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.828972+0000", 2024-04-19T03:03:07.093 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.6345000000000002e-05 2024-04-19T03:03:07.094 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.094 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.094 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:07.094 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.829028+0000", 2024-04-19T03:03:07.094 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6342999999999999e-05 2024-04-19T03:03:07.094 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:07.094 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:07.094 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:07.094 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.094 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.094 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:86620 5.b 5:d80faa68:::benchmark_data_smithi096_19531_object86619:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:07.094 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:22.635110+0000", 2024-04-19T03:03:07.094 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 44.438731388000001, 2024-04-19T03:03:07.095 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.193447275, 2024-04-19T03:03:07.095 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:07.095 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:07.095 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:07.095 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:07.095 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:07.095 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 86620 2024-04-19T03:03:07.095 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.095 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:07.095 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.095 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:07.095 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635110+0000", 2024-04-19T03:03:07.095 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:07.095 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.096 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.096 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:07.096 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635110+0000", 2024-04-19T03:03:07.096 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:07.096 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.096 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.096 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:07.096 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635110+0000", 2024-04-19T03:03:07.096 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:07.096 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.096 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.096 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:07.096 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635154+0000", 2024-04-19T03:03:07.097 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4681000000000001e-05 2024-04-19T03:03:07.097 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.097 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.097 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:07.097 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635166+0000", 2024-04-19T03:03:07.097 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1505000000000001e-05 2024-04-19T03:03:07.097 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.097 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.097 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:07.097 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635171+0000", 2024-04-19T03:03:07.097 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6040000000000003e-06 2024-04-19T03:03:07.097 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.097 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.097 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:07.098 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635221+0000", 2024-04-19T03:03:07.098 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9947000000000001e-05 2024-04-19T03:03:07.098 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.098 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.098 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:07.098 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635356+0000", 2024-04-19T03:03:07.098 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013576199999999999 2024-04-19T03:03:07.098 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.098 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.098 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:07.098 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635507+0000", 2024-04-19T03:03:07.098 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015072999999999999 2024-04-19T03:03:07.099 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.099 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.099 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:07.099 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.638488+0000", 2024-04-19T03:03:07.099 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0029813159999999999 2024-04-19T03:03:07.099 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.099 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.099 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:07.099 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.828341+0000", 2024-04-19T03:03:07.099 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.189852254 2024-04-19T03:03:07.100 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.100 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.100 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:03:07.100 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.828416+0000", 2024-04-19T03:03:07.100 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5344000000000002e-05 2024-04-19T03:03:07.100 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.100 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.100 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:07.100 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.828558+0000", 2024-04-19T03:03:07.100 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000141695 2024-04-19T03:03:07.100 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:07.100 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:07.100 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:07.100 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.101 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.101 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:86621 5.8 5:1597a420:::benchmark_data_smithi096_19531_object86620:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:07.101 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:22.635187+0000", 2024-04-19T03:03:07.101 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 44.438654528000001, 2024-04-19T03:03:07.101 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.194204878, 2024-04-19T03:03:07.101 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:07.101 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:07.101 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:07.101 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:07.101 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:07.101 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 86621 2024-04-19T03:03:07.101 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.101 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:07.101 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.102 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:07.102 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635187+0000", 2024-04-19T03:03:07.102 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:07.102 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.102 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.102 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:07.102 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635187+0000", 2024-04-19T03:03:07.102 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:07.102 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.102 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.102 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:07.102 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635187+0000", 2024-04-19T03:03:07.102 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:07.102 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.103 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.103 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:07.103 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635242+0000", 2024-04-19T03:03:07.103 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5158000000000003e-05 2024-04-19T03:03:07.103 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.103 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.103 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:07.103 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635249+0000", 2024-04-19T03:03:07.103 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.7000000000000008e-06 2024-04-19T03:03:07.103 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.103 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.103 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:07.103 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635256+0000", 2024-04-19T03:03:07.103 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2060000000000004e-06 2024-04-19T03:03:07.104 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.104 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.104 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:07.104 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635302+0000", 2024-04-19T03:03:07.104 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5954000000000001e-05 2024-04-19T03:03:07.104 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.104 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.104 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:07.104 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635427+0000", 2024-04-19T03:03:07.104 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012559299999999999 2024-04-19T03:03:07.104 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.104 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.104 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:07.104 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635596+0000", 2024-04-19T03:03:07.105 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000168615 2024-04-19T03:03:07.105 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.105 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.105 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:07.105 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.639320+0000", 2024-04-19T03:03:07.105 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0037244610000000001 2024-04-19T03:03:07.105 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.105 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.105 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:07.105 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.829277+0000", 2024-04-19T03:03:07.105 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.18995651099999999 2024-04-19T03:03:07.105 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.105 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.105 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:03:07.106 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.829341+0000", 2024-04-19T03:03:07.106 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3756000000000004e-05 2024-04-19T03:03:07.106 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.106 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.106 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:07.106 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.829392+0000", 2024-04-19T03:03:07.106 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1555999999999999e-05 2024-04-19T03:03:07.106 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:07.106 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:07.106 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:07.106 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.106 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.106 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87067 5.b 5:d57af71a:::benchmark_data_smithi096_19531_object87066:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:07.106 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.142233+0000", 2024-04-19T03:03:07.107 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 43.931608664999999, 2024-04-19T03:03:07.107 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.071692405000000001, 2024-04-19T03:03:07.107 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:07.107 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:07.107 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:07.107 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:07.107 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:07.107 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87067 2024-04-19T03:03:07.107 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.107 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:07.107 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.107 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:07.107 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142233+0000", 2024-04-19T03:03:07.107 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:07.108 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.108 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.108 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:07.108 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142233+0000", 2024-04-19T03:03:07.108 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:07.108 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.108 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.108 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:07.108 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142232+0000", 2024-04-19T03:03:07.108 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:03:07.108 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.108 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.108 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:07.108 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142277+0000", 2024-04-19T03:03:07.109 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5837000000000002e-05 2024-04-19T03:03:07.109 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.109 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.109 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:07.109 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142297+0000", 2024-04-19T03:03:07.109 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9561000000000001e-05 2024-04-19T03:03:07.109 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.109 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.109 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:07.109 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142311+0000", 2024-04-19T03:03:07.109 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3654e-05 2024-04-19T03:03:07.109 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.109 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.109 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:07.109 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142391+0000", 2024-04-19T03:03:07.110 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0123999999999994e-05 2024-04-19T03:03:07.110 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.110 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.110 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:07.110 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142669+0000", 2024-04-19T03:03:07.110 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00027829800000000001 2024-04-19T03:03:07.110 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.110 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.110 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:07.110 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142859+0000", 2024-04-19T03:03:07.110 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000190051 2024-04-19T03:03:07.110 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.110 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.110 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:07.111 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.150597+0000", 2024-04-19T03:03:07.111 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0077380299999999999 2024-04-19T03:03:07.111 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.111 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.111 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:07.111 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.213855+0000", 2024-04-19T03:03:07.111 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.063257987000000002 2024-04-19T03:03:07.111 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.111 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.111 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:03:07.111 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.213898+0000", 2024-04-19T03:03:07.111 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2916e-05 2024-04-19T03:03:07.112 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.112 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.112 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:07.112 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.213925+0000", 2024-04-19T03:03:07.112 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7503000000000001e-05 2024-04-19T03:03:07.112 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:07.112 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:07.112 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:07.112 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.112 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.112 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87069 5.b 5:da0c93b5:::benchmark_data_smithi096_19531_object87068:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:07.112 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.143402+0000", 2024-04-19T03:03:07.112 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 43.930439702999998, 2024-04-19T03:03:07.112 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.070678598999999995, 2024-04-19T03:03:07.112 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:07.113 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:07.113 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:07.113 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:07.113 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:07.113 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87069 2024-04-19T03:03:07.113 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.113 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:07.113 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.113 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:07.113 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.143402+0000", 2024-04-19T03:03:07.113 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:07.113 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.113 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.113 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:07.114 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.143402+0000", 2024-04-19T03:03:07.114 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:07.114 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.114 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.114 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:07.114 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.143401+0000", 2024-04-19T03:03:07.114 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:03:07.114 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.114 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.114 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:07.114 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.143501+0000", 2024-04-19T03:03:07.114 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000100387 2024-04-19T03:03:07.114 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.114 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.115 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:07.115 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.143516+0000", 2024-04-19T03:03:07.115 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5369000000000001e-05 2024-04-19T03:03:07.115 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.115 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.115 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:07.115 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.143524+0000", 2024-04-19T03:03:07.115 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.7079999999999997e-06 2024-04-19T03:03:07.115 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.115 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.115 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:07.115 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.145550+0000", 2024-04-19T03:03:07.115 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0020259290000000001 2024-04-19T03:03:07.115 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.116 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.116 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:07.116 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.145676+0000", 2024-04-19T03:03:07.116 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000126406 2024-04-19T03:03:07.116 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.116 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.116 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:07.116 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.145802+0000", 2024-04-19T03:03:07.116 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000125974 2024-04-19T03:03:07.116 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.116 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.116 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:07.116 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.151030+0000", 2024-04-19T03:03:07.116 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0052276079999999999 2024-04-19T03:03:07.117 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.117 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.117 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:07.117 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.213998+0000", 2024-04-19T03:03:07.117 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.06296786 2024-04-19T03:03:07.117 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.117 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.117 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:03:07.117 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.214031+0000", 2024-04-19T03:03:07.117 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3387999999999999e-05 2024-04-19T03:03:07.117 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.117 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.117 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:07.118 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.214081+0000", 2024-04-19T03:03:07.118 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9316e-05 2024-04-19T03:03:07.118 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:07.118 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:07.118 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:07.118 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.118 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.118 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87108 5.e 5:7e197adc:::benchmark_data_smithi096_19531_object87107:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:07.118 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.223103+0000", 2024-04-19T03:03:07.118 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 43.850738366000002, 2024-04-19T03:03:07.118 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.044946887, 2024-04-19T03:03:07.118 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:07.118 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-19T03:03:07.119 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:07.119 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:07.119 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:07.119 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87108 2024-04-19T03:03:07.119 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.119 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:07.119 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.119 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:07.119 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.223103+0000", 2024-04-19T03:03:07.119 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:07.119 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.119 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.119 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:07.120 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.223103+0000", 2024-04-19T03:03:07.120 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:07.120 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.120 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.120 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:07.120 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.223102+0000", 2024-04-19T03:03:07.120 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:03:07.120 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.120 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.120 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:07.120 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.223156+0000", 2024-04-19T03:03:07.120 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3958000000000001e-05 2024-04-19T03:03:07.120 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.120 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.121 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:07.121 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.223166+0000", 2024-04-19T03:03:07.121 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.4809999999999995e-06 2024-04-19T03:03:07.121 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.121 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.121 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:07.121 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.223172+0000", 2024-04-19T03:03:07.121 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0140000000000004e-06 2024-04-19T03:03:07.121 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.121 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.121 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:07.121 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.227295+0000", 2024-04-19T03:03:07.121 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0041233420000000003 2024-04-19T03:03:07.121 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.122 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.122 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:07.122 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.227495+0000", 2024-04-19T03:03:07.122 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00019955299999999999 2024-04-19T03:03:07.122 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.122 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.122 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:07.122 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.227717+0000", 2024-04-19T03:03:07.122 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000221902 2024-04-19T03:03:07.122 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.122 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.122 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:07.122 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233189+0000", 2024-04-19T03:03:07.122 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0054718889999999997 2024-04-19T03:03:07.123 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.123 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.123 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:07.123 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.250529+0000", 2024-04-19T03:03:07.123 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.017340298000000001 2024-04-19T03:03:07.123 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.123 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.123 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:03:07.123 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.250539+0000", 2024-04-19T03:03:07.123 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0501e-05 2024-04-19T03:03:07.123 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.123 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.123 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:07.123 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.268003+0000", 2024-04-19T03:03:07.124 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.017463429 2024-04-19T03:03:07.124 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.124 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.124 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:07.124 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.268050+0000", 2024-04-19T03:03:07.124 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7466000000000003e-05 2024-04-19T03:03:07.124 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:07.124 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:07.124 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:07.124 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.124 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.124 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87118 5.b 5:d1bb4f3c:::benchmark_data_smithi096_19531_object87117:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:07.124 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.231082+0000", 2024-04-19T03:03:07.125 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 43.842759532000002, 2024-04-19T03:03:07.125 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.035789004, 2024-04-19T03:03:07.125 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:07.125 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-19T03:03:07.125 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:07.125 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:07.125 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:07.125 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87118 2024-04-19T03:03:07.125 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.125 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:07.125 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.125 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:07.125 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231082+0000", 2024-04-19T03:03:07.125 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:07.126 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.126 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.126 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:07.126 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231082+0000", 2024-04-19T03:03:07.126 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:07.126 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.126 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.126 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:07.126 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231081+0000", 2024-04-19T03:03:07.126 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:03:07.126 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.126 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.126 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:07.126 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231159+0000", 2024-04-19T03:03:07.127 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.7819999999999997e-05 2024-04-19T03:03:07.127 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.127 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.127 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:07.127 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231186+0000", 2024-04-19T03:03:07.127 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7126000000000001e-05 2024-04-19T03:03:07.127 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.127 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.127 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:07.127 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231193+0000", 2024-04-19T03:03:07.127 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7259999999999996e-06 2024-04-19T03:03:07.127 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.127 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.127 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:07.127 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231241+0000", 2024-04-19T03:03:07.128 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8123e-05 2024-04-19T03:03:07.128 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.128 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.128 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:07.128 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231354+0000", 2024-04-19T03:03:07.128 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0001133 2024-04-19T03:03:07.128 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.128 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.128 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:07.128 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231443+0000", 2024-04-19T03:03:07.128 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9167999999999997e-05 2024-04-19T03:03:07.128 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.128 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.128 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:07.129 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236498+0000", 2024-04-19T03:03:07.129 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0050545160000000002 2024-04-19T03:03:07.129 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.129 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.129 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:07.129 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.249681+0000", 2024-04-19T03:03:07.129 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013183321 2024-04-19T03:03:07.129 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.129 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.129 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:03:07.129 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.249693+0000", 2024-04-19T03:03:07.129 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1834999999999999e-05 2024-04-19T03:03:07.129 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.129 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.130 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:07.130 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266733+0000", 2024-04-19T03:03:07.130 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.017040408 2024-04-19T03:03:07.130 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.130 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.130 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:07.130 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266871+0000", 2024-04-19T03:03:07.130 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000137849 2024-04-19T03:03:07.130 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:07.130 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:07.130 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:07.130 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.130 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.130 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87121 5.b 5:d01822b8:::benchmark_data_smithi096_19531_object87120:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:07.131 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.233319+0000", 2024-04-19T03:03:07.131 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 43.840522667999998, 2024-04-19T03:03:07.131 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.033624198, 2024-04-19T03:03:07.131 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:07.131 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-19T03:03:07.131 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:07.131 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:07.131 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:07.131 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87121 2024-04-19T03:03:07.131 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.131 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:07.131 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.131 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:07.132 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233319+0000", 2024-04-19T03:03:07.132 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:07.132 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.132 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.132 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:07.132 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233319+0000", 2024-04-19T03:03:07.132 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:07.132 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.132 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.132 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:07.132 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233319+0000", 2024-04-19T03:03:07.132 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:07.132 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.132 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.133 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:07.133 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233364+0000", 2024-04-19T03:03:07.133 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5460999999999997e-05 2024-04-19T03:03:07.133 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.133 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.133 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:07.133 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233382+0000", 2024-04-19T03:03:07.133 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8148e-05 2024-04-19T03:03:07.133 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.133 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.133 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:07.133 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233390+0000", 2024-04-19T03:03:07.133 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5340000000000002e-06 2024-04-19T03:03:07.134 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.134 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.134 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:07.134 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233712+0000", 2024-04-19T03:03:07.134 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00032260500000000001 2024-04-19T03:03:07.134 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.134 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.134 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:07.134 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233829+0000", 2024-04-19T03:03:07.134 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011638599999999999 2024-04-19T03:03:07.134 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.134 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.134 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:07.134 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233959+0000", 2024-04-19T03:03:07.135 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013013900000000001 2024-04-19T03:03:07.135 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.135 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.135 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:07.135 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236515+0000", 2024-04-19T03:03:07.135 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0025562750000000002 2024-04-19T03:03:07.135 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.135 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.135 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:07.135 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.249723+0000", 2024-04-19T03:03:07.135 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013208176 2024-04-19T03:03:07.135 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.135 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.135 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:03:07.136 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.249728+0000", 2024-04-19T03:03:07.136 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6519999999999997e-06 2024-04-19T03:03:07.136 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.136 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.136 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:07.136 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266837+0000", 2024-04-19T03:03:07.136 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0171087059999999 2024-04-19T03:03:07.136 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.136 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.136 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:07.136 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266943+0000", 2024-04-19T03:03:07.136 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000106604 2024-04-19T03:03:07.136 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:07.137 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:07.137 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:07.137 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.137 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.137 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87124 5.8 5:14819ad7:::benchmark_data_smithi096_19531_object87123:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:07.137 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.235886+0000", 2024-04-19T03:03:07.137 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 43.837955244, 2024-04-19T03:03:07.137 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0315451179999999, 2024-04-19T03:03:07.137 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:07.137 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-19T03:03:07.137 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:07.137 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:07.137 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:07.137 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87124 2024-04-19T03:03:07.138 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.138 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:07.138 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.138 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:07.138 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.235886+0000", 2024-04-19T03:03:07.138 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:07.138 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.138 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.138 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:07.138 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.235886+0000", 2024-04-19T03:03:07.138 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:07.138 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.138 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.138 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:07.139 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.235886+0000", 2024-04-19T03:03:07.139 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:03:07.139 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.139 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.139 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:07.139 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.235934+0000", 2024-04-19T03:03:07.139 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8384000000000003e-05 2024-04-19T03:03:07.139 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.139 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.139 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:07.139 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.235945+0000", 2024-04-19T03:03:07.139 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0671e-05 2024-04-19T03:03:07.139 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.139 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.140 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:07.140 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.235952+0000", 2024-04-19T03:03:07.140 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3089999999999998e-06 2024-04-19T03:03:07.140 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.140 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.140 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:07.140 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.237067+0000", 2024-04-19T03:03:07.140 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001115263 2024-04-19T03:03:07.140 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.140 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.140 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:07.140 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.237188+0000", 2024-04-19T03:03:07.140 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000121258 2024-04-19T03:03:07.140 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.140 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.141 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:07.141 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.237316+0000", 2024-04-19T03:03:07.141 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000128071 2024-04-19T03:03:07.141 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.141 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.141 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:07.141 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240744+0000", 2024-04-19T03:03:07.141 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0034275629999999998 2024-04-19T03:03:07.141 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.141 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.141 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:07.141 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.252517+0000", 2024-04-19T03:03:07.141 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011772991999999999 2024-04-19T03:03:07.141 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.142 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.142 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:03:07.142 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.252523+0000", 2024-04-19T03:03:07.142 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3640000000000004e-06 2024-04-19T03:03:07.142 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.142 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.142 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:07.142 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.267290+0000", 2024-04-19T03:03:07.142 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0147665690000001 2024-04-19T03:03:07.142 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.142 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.142 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:07.142 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.267432+0000", 2024-04-19T03:03:07.142 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014165299999999999 2024-04-19T03:03:07.143 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:07.143 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:07.143 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:07.143 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.143 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.143 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87129 5.0 5:02667e01:::benchmark_data_smithi096_19531_object87128:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:07.143 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.236466+0000", 2024-04-19T03:03:07.143 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 43.837375248000001, 2024-04-19T03:03:07.143 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0301534510000001, 2024-04-19T03:03:07.143 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:07.143 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-19T03:03:07.143 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:07.143 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:07.143 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:07.143 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87129 2024-04-19T03:03:07.144 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.144 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:07.144 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.144 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:07.144 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236466+0000", 2024-04-19T03:03:07.144 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:07.144 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.144 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.144 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:07.144 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236466+0000", 2024-04-19T03:03:07.144 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:07.144 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.144 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.145 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:07.145 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236465+0000", 2024-04-19T03:03:07.145 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:03:07.145 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.145 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.145 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:07.145 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236566+0000", 2024-04-19T03:03:07.145 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010047000000000001 2024-04-19T03:03:07.145 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.145 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.145 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:07.145 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236577+0000", 2024-04-19T03:03:07.145 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1772e-05 2024-04-19T03:03:07.145 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.146 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.146 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:07.146 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236584+0000", 2024-04-19T03:03:07.146 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0530000000000003e-06 2024-04-19T03:03:07.146 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.146 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.146 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:07.146 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.237023+0000", 2024-04-19T03:03:07.146 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000439703 2024-04-19T03:03:07.146 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.146 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.146 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:07.147 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.237207+0000", 2024-04-19T03:03:07.147 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000183692 2024-04-19T03:03:07.147 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.147 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.147 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:07.147 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.237373+0000", 2024-04-19T03:03:07.147 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016623500000000001 2024-04-19T03:03:07.147 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.147 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.147 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:07.147 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.241461+0000", 2024-04-19T03:03:07.147 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0040883050000000004 2024-04-19T03:03:07.147 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.147 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.148 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:07.148 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.252500+0000", 2024-04-19T03:03:07.148 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011038450999999999 2024-04-19T03:03:07.148 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.148 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.148 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:03:07.148 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.252507+0000", 2024-04-19T03:03:07.148 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2439999999999996e-06 2024-04-19T03:03:07.148 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.148 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.148 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:07.148 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266538+0000", 2024-04-19T03:03:07.148 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.014031184 2024-04-19T03:03:07.149 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.149 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.149 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:07.149 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266620+0000", 2024-04-19T03:03:07.149 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1600000000000005e-05 2024-04-19T03:03:07.149 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:07.149 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:07.149 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:07.149 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.149 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.149 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87135 5.4 5:2a97e7b7:::benchmark_data_smithi096_19531_object87134:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:07.149 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.240884+0000", 2024-04-19T03:03:07.149 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 43.832957790999998, 2024-04-19T03:03:07.150 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.025708931, 2024-04-19T03:03:07.150 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:07.150 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-19T03:03:07.150 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:07.150 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:07.150 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:07.150 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87135 2024-04-19T03:03:07.150 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.150 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:07.150 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.150 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:07.150 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240884+0000", 2024-04-19T03:03:07.150 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:07.151 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.151 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.151 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:07.151 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240884+0000", 2024-04-19T03:03:07.151 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:07.151 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.151 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.151 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:07.151 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240883+0000", 2024-04-19T03:03:07.151 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:03:07.151 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.151 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.151 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:07.152 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240933+0000", 2024-04-19T03:03:07.152 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9969999999999998e-05 2024-04-19T03:03:07.152 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.152 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.152 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:07.152 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240946+0000", 2024-04-19T03:03:07.152 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2943e-05 2024-04-19T03:03:07.153 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.153 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.153 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:07.153 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240952+0000", 2024-04-19T03:03:07.153 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8930000000000002e-06 2024-04-19T03:03:07.153 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.153 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.153 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:07.154 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240994+0000", 2024-04-19T03:03:07.154 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2753999999999998e-05 2024-04-19T03:03:07.154 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.154 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.154 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:07.154 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.241092+0000", 2024-04-19T03:03:07.154 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.7447000000000004e-05 2024-04-19T03:03:07.154 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.154 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.154 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:07.154 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.241183+0000", 2024-04-19T03:03:07.154 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1163999999999997e-05 2024-04-19T03:03:07.154 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.154 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.155 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:07.155 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.254672+0000", 2024-04-19T03:03:07.155 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.01348864 2024-04-19T03:03:07.155 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.155 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.155 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:03:07.155 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.254681+0000", 2024-04-19T03:03:07.155 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.3789999999999995e-06 2024-04-19T03:03:07.155 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.155 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.155 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:07.155 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266456+0000", 2024-04-19T03:03:07.155 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.011774621 2024-04-19T03:03:07.156 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.156 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.156 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:07.156 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266593+0000", 2024-04-19T03:03:07.156 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013737600000000001 2024-04-19T03:03:07.156 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:07.156 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:07.156 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:07.156 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.156 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.156 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87136 5.4 5:212411bc:::benchmark_data_smithi096_19531_object87135:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:07.156 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.240962+0000", 2024-04-19T03:03:07.156 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 43.832879914999999, 2024-04-19T03:03:07.157 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.025738, 2024-04-19T03:03:07.157 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:07.157 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-19T03:03:07.157 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:07.157 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:07.157 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:07.157 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87136 2024-04-19T03:03:07.157 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.157 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:07.157 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.157 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:07.157 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240962+0000", 2024-04-19T03:03:07.157 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:07.157 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.158 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.158 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:07.158 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240962+0000", 2024-04-19T03:03:07.158 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:07.158 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.158 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.158 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:07.158 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240961+0000", 2024-04-19T03:03:07.158 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:07.158 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.158 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.158 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:07.158 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240995+0000", 2024-04-19T03:03:07.159 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3868000000000002e-05 2024-04-19T03:03:07.159 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.159 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.159 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:07.159 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.241001+0000", 2024-04-19T03:03:07.159 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.322e-06 2024-04-19T03:03:07.159 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.159 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.159 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:07.159 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.241004+0000", 2024-04-19T03:03:07.159 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3510000000000002e-06 2024-04-19T03:03:07.159 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.159 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.159 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:07.160 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247131+0000", 2024-04-19T03:03:07.160 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0061270869999999998 2024-04-19T03:03:07.160 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.160 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.160 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:07.160 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247322+0000", 2024-04-19T03:03:07.160 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000191015 2024-04-19T03:03:07.160 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.160 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.160 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:07.160 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247542+0000", 2024-04-19T03:03:07.160 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00022030199999999999 2024-04-19T03:03:07.160 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.160 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.161 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:07.161 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.254709+0000", 2024-04-19T03:03:07.161 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0071662660000000001 2024-04-19T03:03:07.161 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.161 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.161 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:03:07.161 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.254716+0000", 2024-04-19T03:03:07.161 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3860000000000001e-06 2024-04-19T03:03:07.161 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.161 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.161 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:07.161 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266619+0000", 2024-04-19T03:03:07.161 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0119031030000001 2024-04-19T03:03:07.162 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.162 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.162 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:07.162 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266700+0000", 2024-04-19T03:03:07.162 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0764000000000001e-05 2024-04-19T03:03:07.162 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:07.162 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:07.162 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:07.162 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.162 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.162 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87138 5.e 5:7b1f1c20:::benchmark_data_smithi096_19531_object87137:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:07.162 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.247862+0000", 2024-04-19T03:03:07.162 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 43.825979840999999, 2024-04-19T03:03:07.162 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.024457079, 2024-04-19T03:03:07.163 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:07.163 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:07.163 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:07.163 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:07.163 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:07.163 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87138 2024-04-19T03:03:07.163 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.163 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:07.163 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.163 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:07.163 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247862+0000", 2024-04-19T03:03:07.163 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:07.163 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.163 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.164 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:07.164 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247862+0000", 2024-04-19T03:03:07.164 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:07.164 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.164 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.164 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:07.164 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247860+0000", 2024-04-19T03:03:07.164 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999981 2024-04-19T03:03:07.164 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.164 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.164 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:07.164 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247909+0000", 2024-04-19T03:03:07.164 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9150999999999997e-05 2024-04-19T03:03:07.164 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.165 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.165 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:07.165 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247925+0000", 2024-04-19T03:03:07.165 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5761999999999999e-05 2024-04-19T03:03:07.165 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.165 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.165 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:07.165 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247936+0000", 2024-04-19T03:03:07.165 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1144e-05 2024-04-19T03:03:07.165 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.165 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.165 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:07.165 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.250590+0000", 2024-04-19T03:03:07.166 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.002653678 2024-04-19T03:03:07.166 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.166 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.166 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:03:07.166 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.250599+0000", 2024-04-19T03:03:07.166 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9039999999999998e-06 2024-04-19T03:03:07.166 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.166 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.166 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:07.166 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.268151+0000", 2024-04-19T03:03:07.166 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0175523449999999 2024-04-19T03:03:07.166 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.166 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.166 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:07.167 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.268285+0000", 2024-04-19T03:03:07.167 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013415599999999999 2024-04-19T03:03:07.167 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.167 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.167 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:07.167 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.272238+0000", 2024-04-19T03:03:07.167 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0039533019999999997 2024-04-19T03:03:07.167 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.167 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.167 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:03:07.167 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.272274+0000", 2024-04-19T03:03:07.167 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5352000000000003e-05 2024-04-19T03:03:07.167 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.168 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.168 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:07.168 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.272319+0000", 2024-04-19T03:03:07.168 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5281999999999998e-05 2024-04-19T03:03:07.168 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:07.168 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:07.168 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:07.168 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.168 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.168 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:158371 5.8 5:11a83024:::benchmark_data_smithi096_19531_object44921:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-19T03:03:07.168 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:58.125869+0000", 2024-04-19T03:03:07.168 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 8.9479729759999991, 2024-04-19T03:03:07.168 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074532857999999994, 2024-04-19T03:03:07.169 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:07.169 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:07.169 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:07.169 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:07.169 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:07.169 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 158371 2024-04-19T03:03:07.169 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.169 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:07.169 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.169 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:07.169 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125869+0000", 2024-04-19T03:03:07.169 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:07.169 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.169 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.170 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:07.170 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125869+0000", 2024-04-19T03:03:07.170 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:07.170 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.170 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.170 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:07.170 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125868+0000", 2024-04-19T03:03:07.170 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:03:07.170 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.170 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.170 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:07.170 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125874+0000", 2024-04-19T03:03:07.170 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7120000000000003e-06 2024-04-19T03:03:07.170 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.171 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.171 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:07.171 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125885+0000", 2024-04-19T03:03:07.171 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0665999999999999e-05 2024-04-19T03:03:07.171 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.171 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.171 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:07.171 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125901+0000", 2024-04-19T03:03:07.171 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6463000000000001e-05 2024-04-19T03:03:07.171 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.171 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.171 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:07.171 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125956+0000", 2024-04-19T03:03:07.172 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4728000000000002e-05 2024-04-19T03:03:07.172 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.172 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.172 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:07.172 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.126050+0000", 2024-04-19T03:03:07.172 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.3534000000000003e-05 2024-04-19T03:03:07.172 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.172 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.172 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:07.172 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.200187+0000", 2024-04-19T03:03:07.172 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074136933000000002 2024-04-19T03:03:07.172 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.172 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.172 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:03:07.172 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.200260+0000", 2024-04-19T03:03:07.173 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3090999999999995e-05 2024-04-19T03:03:07.173 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.173 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.173 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:07.173 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.200402+0000", 2024-04-19T03:03:07.173 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014193699999999999 2024-04-19T03:03:07.173 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:07.173 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:07.173 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:07.173 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.173 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.173 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:158372 5.0 5:0473aa5f:::benchmark_data_smithi096_19531_object44922:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-19T03:03:07.173 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:58.125924+0000", 2024-04-19T03:03:07.174 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 8.9479173690000007, 2024-04-19T03:03:07.174 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074247490999999999, 2024-04-19T03:03:07.174 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:07.174 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:07.174 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:07.174 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:07.174 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:07.174 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 158372 2024-04-19T03:03:07.174 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.174 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:07.174 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.174 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:07.175 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125924+0000", 2024-04-19T03:03:07.175 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:07.175 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.175 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.175 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:07.175 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125924+0000", 2024-04-19T03:03:07.175 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:07.175 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.175 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.175 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:07.175 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125924+0000", 2024-04-19T03:03:07.175 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:07.175 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.176 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.176 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:07.176 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125927+0000", 2024-04-19T03:03:07.176 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5389999999999999e-06 2024-04-19T03:03:07.176 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.176 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.176 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:07.176 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125935+0000", 2024-04-19T03:03:07.176 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3259999999999998e-06 2024-04-19T03:03:07.176 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.176 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.176 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:07.176 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125940+0000", 2024-04-19T03:03:07.177 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6980000000000003e-06 2024-04-19T03:03:07.177 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.177 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.177 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:07.177 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125982+0000", 2024-04-19T03:03:07.177 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1337000000000001e-05 2024-04-19T03:03:07.177 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.177 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.177 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:07.177 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.126075+0000", 2024-04-19T03:03:07.177 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.3579999999999995e-05 2024-04-19T03:03:07.177 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.177 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.178 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:07.178 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.199953+0000", 2024-04-19T03:03:07.178 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073877604999999999 2024-04-19T03:03:07.178 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.178 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.178 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:03:07.178 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.200022+0000", 2024-04-19T03:03:07.178 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.8824000000000004e-05 2024-04-19T03:03:07.178 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.178 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.178 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:07.178 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.200172+0000", 2024-04-19T03:03:07.178 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015017700000000001 2024-04-19T03:03:07.178 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:07.179 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:07.179 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:07.179 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.179 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.179 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:158374 5.e 5:76be57a5:::benchmark_data_smithi096_19531_object44924:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-19T03:03:07.179 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:58.125988+0000", 2024-04-19T03:03:07.179 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 8.9478538699999994, 2024-04-19T03:03:07.179 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.067843332000000006, 2024-04-19T03:03:07.179 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:07.179 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:07.179 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:07.179 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:07.179 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:07.180 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 158374 2024-04-19T03:03:07.180 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.180 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:07.180 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.180 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:07.180 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125988+0000", 2024-04-19T03:03:07.180 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:07.180 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.180 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.180 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:07.180 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125988+0000", 2024-04-19T03:03:07.180 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:07.180 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.180 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.181 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:07.181 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125987+0000", 2024-04-19T03:03:07.181 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:07.181 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.181 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.181 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:07.181 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125990+0000", 2024-04-19T03:03:07.181 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7989999999999998e-06 2024-04-19T03:03:07.181 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.181 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.181 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:07.181 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125996+0000", 2024-04-19T03:03:07.181 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.302e-06 2024-04-19T03:03:07.182 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.182 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.182 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:07.182 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.126001+0000", 2024-04-19T03:03:07.182 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.843e-06 2024-04-19T03:03:07.182 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.182 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.182 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:07.182 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.126047+0000", 2024-04-19T03:03:07.182 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6066000000000002e-05 2024-04-19T03:03:07.182 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.182 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.183 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:07.183 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.126171+0000", 2024-04-19T03:03:07.183 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012359099999999999 2024-04-19T03:03:07.183 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.183 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.183 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:07.183 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.193709+0000", 2024-04-19T03:03:07.183 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.067538099000000004 2024-04-19T03:03:07.183 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.183 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.183 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:03:07.183 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.193766+0000", 2024-04-19T03:03:07.183 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6869e-05 2024-04-19T03:03:07.183 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.184 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.184 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:07.184 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.193831+0000", 2024-04-19T03:03:07.184 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5273999999999999e-05 2024-04-19T03:03:07.184 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:07.184 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:07.184 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:07.184 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.184 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.184 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4755.0:158376 5.9 e56/22 5:9e73c076:::benchmark_data_smithi096_19531_object44926:head v 56'9663, mlcod=56'9661)", 2024-04-19T03:03:07.184 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:58.127307+0000", 2024-04-19T03:03:07.184 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 8.9465346389999993, 2024-04-19T03:03:07.184 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069002716000000006, 2024-04-19T03:03:07.184 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:07.185 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:07.185 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:07.185 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.185 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:07.185 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.127307+0000", 2024-04-19T03:03:07.185 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:07.185 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.185 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.185 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:07.185 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.127307+0000", 2024-04-19T03:03:07.185 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:07.185 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.185 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.185 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:07.186 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.127306+0000", 2024-04-19T03:03:07.186 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:03:07.186 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.186 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.186 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:07.186 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.127316+0000", 2024-04-19T03:03:07.186 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.3039999999999994e-06 2024-04-19T03:03:07.186 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.186 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.186 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:07.186 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.127326+0000", 2024-04-19T03:03:07.186 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0009e-05 2024-04-19T03:03:07.186 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.187 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.187 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:07.187 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.127332+0000", 2024-04-19T03:03:07.187 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5880000000000003e-06 2024-04-19T03:03:07.187 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.187 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.187 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:07.187 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.127383+0000", 2024-04-19T03:03:07.187 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0516000000000002e-05 2024-04-19T03:03:07.187 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.187 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.187 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:07.187 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.127403+0000", 2024-04-19T03:03:07.188 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0547000000000002e-05 2024-04-19T03:03:07.188 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.188 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.188 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:03:07.188 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.196280+0000", 2024-04-19T03:03:07.188 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.068876863999999996 2024-04-19T03:03:07.188 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.188 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.188 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:07.188 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.196310+0000", 2024-04-19T03:03:07.188 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9762999999999999e-05 2024-04-19T03:03:07.188 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:07.188 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:07.188 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:07.189 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.189 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.189 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:158383 5.0 5:026717eb:::benchmark_data_smithi096_19531_object44933:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-19T03:03:07.189 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:58.130494+0000", 2024-04-19T03:03:07.189 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 8.9433475129999991, 2024-04-19T03:03:07.189 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.070135775999999997, 2024-04-19T03:03:07.189 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:07.189 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:07.189 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:07.189 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:07.189 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:07.189 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 158383 2024-04-19T03:03:07.189 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.189 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:07.190 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.190 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:07.190 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.130494+0000", 2024-04-19T03:03:07.190 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:07.190 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.190 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.190 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:07.190 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.130494+0000", 2024-04-19T03:03:07.190 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:07.190 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.190 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.190 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:07.190 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.130493+0000", 2024-04-19T03:03:07.191 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:03:07.191 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.191 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.191 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:07.191 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.130500+0000", 2024-04-19T03:03:07.191 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5490000000000003e-06 2024-04-19T03:03:07.191 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.191 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.191 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:07.191 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.190401+0000", 2024-04-19T03:03:07.191 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.059901668999999998 2024-04-19T03:03:07.191 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.191 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.191 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:07.192 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.190421+0000", 2024-04-19T03:03:07.192 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0288e-05 2024-04-19T03:03:07.192 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.192 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.192 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:07.192 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.190536+0000", 2024-04-19T03:03:07.192 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000114783 2024-04-19T03:03:07.192 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.192 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.192 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:07.192 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.190904+0000", 2024-04-19T03:03:07.192 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00036773900000000001 2024-04-19T03:03:07.192 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.192 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.193 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:07.193 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.200417+0000", 2024-04-19T03:03:07.193 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0095128899999999995 2024-04-19T03:03:07.193 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.193 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.193 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:03:07.193 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.200489+0000", 2024-04-19T03:03:07.193 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2554999999999999e-05 2024-04-19T03:03:07.193 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.193 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.193 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:07.193 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.200630+0000", 2024-04-19T03:03:07.193 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014055299999999999 2024-04-19T03:03:07.193 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:07.194 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:07.194 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:07.194 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:07.194 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:07.194 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-19T03:03:07.195 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:03:07.192+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:03:07.196 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T03:03:07.296 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:03:07.292+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:03:07.323 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-04-19T03:03:07.323 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [ 2024-04-19T03:03:07.323 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.323 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:181057 5.7 5:e4105246:::benchmark_data_smithi096_19531_object67607:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-19T03:03:07.323 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:03:07.319099+0000", 2024-04-19T03:03:07.323 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0030485400000000002, 2024-04-19T03:03:07.323 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0030709869999999998, 2024-04-19T03:03:07.323 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:07.323 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-04-19T03:03:07.323 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:07.324 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:07.324 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:07.324 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 181057 2024-04-19T03:03:07.324 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.324 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:07.324 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.324 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:07.324 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:07.319099+0000", 2024-04-19T03:03:07.324 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:07.324 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.324 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.324 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:07.324 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:07.319099+0000", 2024-04-19T03:03:07.325 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:07.325 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.325 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.325 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:07.325 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:07.319098+0000", 2024-04-19T03:03:07.325 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:03:07.325 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.325 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.325 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:07.325 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:07.319104+0000", 2024-04-19T03:03:07.325 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.48e-06 2024-04-19T03:03:07.325 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.325 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.325 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:07.326 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:07.319112+0000", 2024-04-19T03:03:07.326 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7479999999999993e-06 2024-04-19T03:03:07.326 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.326 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.326 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:07.326 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:07.319118+0000", 2024-04-19T03:03:07.326 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9549999999999997e-06 2024-04-19T03:03:07.326 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.326 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.326 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:07.326 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:07.319167+0000", 2024-04-19T03:03:07.326 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8860999999999999e-05 2024-04-19T03:03:07.326 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.327 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.327 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:07.327 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:07.319318+0000", 2024-04-19T03:03:07.327 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00015196 2024-04-19T03:03:07.327 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:07.327 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:07.327 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:07.327 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.327 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.327 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:181058 5.9 5:9831249a:::benchmark_data_smithi096_19531_object67608:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-19T03:03:07.327 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:03:07.319505+0000", 2024-04-19T03:03:07.327 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0026432090000000001, 2024-04-19T03:03:07.327 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0027314290000000001, 2024-04-19T03:03:07.328 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:07.328 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:03:07.328 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:07.328 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:07.328 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:07.328 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 181058 2024-04-19T03:03:07.328 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.328 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:07.328 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.328 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:07.328 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:07.319505+0000", 2024-04-19T03:03:07.328 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:07.328 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.328 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.329 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:07.329 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:07.319505+0000", 2024-04-19T03:03:07.329 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:07.329 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.329 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.329 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:07.329 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:07.319503+0000", 2024-04-19T03:03:07.329 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:03:07.329 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.329 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.329 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:07.329 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:07.319511+0000", 2024-04-19T03:03:07.329 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5460000000000003e-06 2024-04-19T03:03:07.329 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.330 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.330 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:07.330 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:07.319519+0000", 2024-04-19T03:03:07.330 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.1540000000000002e-06 2024-04-19T03:03:07.330 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.330 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.330 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:07.330 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:07.319526+0000", 2024-04-19T03:03:07.330 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5019999999999998e-06 2024-04-19T03:03:07.330 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.330 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.330 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:07.330 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:07.319564+0000", 2024-04-19T03:03:07.331 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8374000000000002e-05 2024-04-19T03:03:07.331 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.331 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.331 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:07.331 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:07.319723+0000", 2024-04-19T03:03:07.331 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000159056 2024-04-19T03:03:07.331 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.331 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.331 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:03:07.331 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:07.319832+0000", 2024-04-19T03:03:07.331 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00010937 2024-04-19T03:03:07.331 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:07.331 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:07.331 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:07.332 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.332 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.332 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:181059 5.7 5:e9b60d2b:::benchmark_data_smithi096_19531_object67609:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-19T03:03:07.332 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:03:07.319553+0000", 2024-04-19T03:03:07.332 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0025950750000000001, 2024-04-19T03:03:07.332 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0027649609999999998, 2024-04-19T03:03:07.332 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:07.332 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-04-19T03:03:07.332 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:07.332 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:07.332 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:07.332 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 181059 2024-04-19T03:03:07.332 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.333 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:07.333 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.333 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:07.333 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:07.319553+0000", 2024-04-19T03:03:07.333 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:07.333 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.333 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.333 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:07.333 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:07.319553+0000", 2024-04-19T03:03:07.333 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:07.333 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.333 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.333 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:07.333 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:07.319552+0000", 2024-04-19T03:03:07.334 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:07.334 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.334 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.334 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:07.334 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:07.319560+0000", 2024-04-19T03:03:07.334 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.259e-06 2024-04-19T03:03:07.334 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.334 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.334 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:07.334 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:07.319568+0000", 2024-04-19T03:03:07.334 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8439999999999998e-06 2024-04-19T03:03:07.334 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.334 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.335 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:07.335 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:07.319575+0000", 2024-04-19T03:03:07.335 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3960000000000003e-06 2024-04-19T03:03:07.335 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.335 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.335 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:07.335 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:07.321737+0000", 2024-04-19T03:03:07.335 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0021623499999999999 2024-04-19T03:03:07.335 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.335 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.335 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:07.335 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:07.321895+0000", 2024-04-19T03:03:07.335 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000158343 2024-04-19T03:03:07.335 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:07.336 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:07.336 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:07.336 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.336 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.336 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:181060 5.1 5:822cfbb6:::benchmark_data_smithi096_19531_object67610:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-19T03:03:07.336 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:03:07.319629+0000", 2024-04-19T03:03:07.336 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.002519351, 2024-04-19T03:03:07.336 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0027584469999999998, 2024-04-19T03:03:07.336 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:07.336 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-04-19T03:03:07.336 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:07.336 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:07.336 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:07.336 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 181060 2024-04-19T03:03:07.337 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.337 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:07.337 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.337 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:07.337 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:07.319629+0000", 2024-04-19T03:03:07.337 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:07.337 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.337 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.337 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:07.337 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:07.319629+0000", 2024-04-19T03:03:07.337 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:07.337 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.337 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.338 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:07.338 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:07.319628+0000", 2024-04-19T03:03:07.338 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:03:07.338 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.338 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.338 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:07.338 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:07.319632+0000", 2024-04-19T03:03:07.338 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8300000000000003e-06 2024-04-19T03:03:07.338 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.338 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.338 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:07.338 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:07.319643+0000", 2024-04-19T03:03:07.338 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.039e-05 2024-04-19T03:03:07.339 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.339 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.339 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:07.339 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:07.319650+0000", 2024-04-19T03:03:07.339 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.973e-06 2024-04-19T03:03:07.339 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.339 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.339 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:07.339 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:07.319687+0000", 2024-04-19T03:03:07.339 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7184999999999997e-05 2024-04-19T03:03:07.339 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.339 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.339 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:07.339 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:07.319822+0000", 2024-04-19T03:03:07.340 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00013462200000000001 2024-04-19T03:03:07.340 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:07.340 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:07.340 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:07.340 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.340 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.340 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:181064 5.3 5:c5c7cfad:::benchmark_data_smithi096_19531_object67614:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-19T03:03:07.340 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:03:07.322070+0000", 2024-04-19T03:03:07.340 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 7.8147999999999998e-05, 2024-04-19T03:03:07.340 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00038583600000000002, 2024-04-19T03:03:07.340 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:07.340 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-04-19T03:03:07.340 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:07.340 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:07.341 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:07.341 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 181064 2024-04-19T03:03:07.341 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.341 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:07.341 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.341 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:07.341 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:07.322070+0000", 2024-04-19T03:03:07.341 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:07.341 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.341 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.341 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:07.341 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:07.322070+0000", 2024-04-19T03:03:07.341 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:07.341 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.342 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.342 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:07.342 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:07.322069+0000", 2024-04-19T03:03:07.342 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:03:07.342 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.342 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.342 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:07.342 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:07.322075+0000", 2024-04-19T03:03:07.342 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6850000000000004e-06 2024-04-19T03:03:07.342 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.342 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.342 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:07.343 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:07.322097+0000", 2024-04-19T03:03:07.343 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1426000000000001e-05 2024-04-19T03:03:07.343 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.343 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.343 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:07.343 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:07.322106+0000", 2024-04-19T03:03:07.343 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.0000000000000002e-06 2024-04-19T03:03:07.343 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.343 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.343 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:07.343 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:07.322163+0000", 2024-04-19T03:03:07.343 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7102999999999999e-05 2024-04-19T03:03:07.344 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.344 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.344 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:07.344 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:07.322390+0000", 2024-04-19T03:03:07.344 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00022724600000000001 2024-04-19T03:03:07.344 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:07.344 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:07.344 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:07.344 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.344 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.344 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:181052 5.d 5:baeb8635:::benchmark_data_smithi096_19531_object67602:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-19T03:03:07.344 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:03:07.316639+0000", 2024-04-19T03:03:07.344 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0055086120000000004, 2024-04-19T03:03:07.345 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0058902479999999998, 2024-04-19T03:03:07.345 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:07.345 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:03:07.345 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:07.345 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:07.345 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:07.345 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 181052 2024-04-19T03:03:07.345 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.345 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:07.345 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.345 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:07.345 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:07.316639+0000", 2024-04-19T03:03:07.345 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:07.346 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.346 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.346 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:07.346 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:07.316639+0000", 2024-04-19T03:03:07.346 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:07.346 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.346 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.346 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:07.346 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:07.316639+0000", 2024-04-19T03:03:07.346 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:07.346 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.346 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.346 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:07.346 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:07.316641+0000", 2024-04-19T03:03:07.347 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.43e-06 2024-04-19T03:03:07.347 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.347 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.347 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:07.347 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:07.316646+0000", 2024-04-19T03:03:07.347 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.33e-06 2024-04-19T03:03:07.347 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.347 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.347 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:07.347 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:07.316649+0000", 2024-04-19T03:03:07.347 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3119999999999998e-06 2024-04-19T03:03:07.347 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.348 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.348 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:07.348 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:07.316685+0000", 2024-04-19T03:03:07.348 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6087000000000002e-05 2024-04-19T03:03:07.348 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.348 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.348 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:07.348 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:07.316772+0000", 2024-04-19T03:03:07.348 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.7151000000000006e-05 2024-04-19T03:03:07.348 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.348 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.348 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:03:07.348 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:07.316840+0000", 2024-04-19T03:03:07.349 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7322000000000004e-05 2024-04-19T03:03:07.349 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.349 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.349 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:03:07.349 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:07.319365+0000", 2024-04-19T03:03:07.349 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0025256079999999999 2024-04-19T03:03:07.349 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:07.349 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:07.349 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:07.349 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:07.349 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-04-19T03:03:07.349 INFO:teuthology.orchestra.run.smithi144.stdout: "num_ops": 6 2024-04-19T03:03:07.349 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-04-19T03:03:07.351 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T03:03:07.397 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:03:07.392+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:03:07.480 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-04-19T03:03:07.480 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2024-04-19T03:03:07.480 INFO:teuthology.orchestra.run.smithi144.stdout: "complaint_time": 30, 2024-04-19T03:03:07.480 INFO:teuthology.orchestra.run.smithi144.stdout: "num_blocked_ops": 0 2024-04-19T03:03:07.480 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-04-19T03:03:07.492 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T03:03:07.534 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:03:07.532+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:03:07.598 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:03:07.594+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:03:07.660 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-04-19T03:03:07.661 INFO:teuthology.orchestra.run.smithi144.stdout: "size": 20, 2024-04-19T03:03:07.661 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 600, 2024-04-19T03:03:07.661 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [ 2024-04-19T03:03:07.661 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.661 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:78992 5.7 5:e6baa862:::benchmark_data_smithi096_19531_object78991:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-19T03:03:07.661 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:18.008888+0000", 2024-04-19T03:03:07.661 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 49.649094441000003, 2024-04-19T03:03:07.661 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.056375285999999997, 2024-04-19T03:03:07.661 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:07.661 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:07.661 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:07.662 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:07.662 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:07.662 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 78992 2024-04-19T03:03:07.662 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.662 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:07.662 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.662 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:07.662 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.008888+0000", 2024-04-19T03:03:07.662 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:07.662 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.662 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.662 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:07.662 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.008888+0000", 2024-04-19T03:03:07.662 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:07.663 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.663 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.663 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:07.663 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.008888+0000", 2024-04-19T03:03:07.663 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:07.663 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.663 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.663 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:07.663 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.008928+0000", 2024-04-19T03:03:07.663 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0361999999999997e-05 2024-04-19T03:03:07.663 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.663 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.663 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:07.663 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.008942+0000", 2024-04-19T03:03:07.664 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4365000000000001e-05 2024-04-19T03:03:07.664 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.664 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.664 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:07.664 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.008949+0000", 2024-04-19T03:03:07.664 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.212e-06 2024-04-19T03:03:07.664 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.664 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.664 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:07.664 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.012683+0000", 2024-04-19T03:03:07.664 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.003733934 2024-04-19T03:03:07.664 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.664 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.664 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:07.665 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.012798+0000", 2024-04-19T03:03:07.665 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00011574999999999999 2024-04-19T03:03:07.665 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.665 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.665 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:07.665 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.012896+0000", 2024-04-19T03:03:07.665 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.7848000000000002e-05 2024-04-19T03:03:07.665 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.665 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.665 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:03:07.665 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016423+0000", 2024-04-19T03:03:07.665 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0035270789999999998 2024-04-19T03:03:07.665 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.665 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.666 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:07.666 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.065098+0000", 2024-04-19T03:03:07.666 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.048674651999999999 2024-04-19T03:03:07.666 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.666 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.666 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:03:07.666 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.065193+0000", 2024-04-19T03:03:07.666 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.5087999999999995e-05 2024-04-19T03:03:07.666 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.666 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.666 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:07.666 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.065264+0000", 2024-04-19T03:03:07.666 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0666000000000004e-05 2024-04-19T03:03:07.666 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:07.667 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:07.667 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:07.667 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.667 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.667 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4755.0:79003 5.2 e40/39 5:4436e33f:::benchmark_data_smithi096_19531_object79002:head v 40'4935, mlcod=40'4932)", 2024-04-19T03:03:07.667 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:18.018102+0000", 2024-04-19T03:03:07.667 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 49.639880384999998, 2024-04-19T03:03:07.667 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.060023990999999999, 2024-04-19T03:03:07.667 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:07.667 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:07.667 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:07.667 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.667 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:07.667 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018102+0000", 2024-04-19T03:03:07.668 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:07.668 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.668 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.668 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:07.668 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018102+0000", 2024-04-19T03:03:07.668 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:07.668 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.668 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.668 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:07.668 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018102+0000", 2024-04-19T03:03:07.668 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:07.668 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.668 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.668 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:07.669 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018134+0000", 2024-04-19T03:03:07.669 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2722000000000003e-05 2024-04-19T03:03:07.669 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.669 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.669 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:07.669 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018145+0000", 2024-04-19T03:03:07.669 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0395e-05 2024-04-19T03:03:07.669 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.669 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.669 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:07.669 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018151+0000", 2024-04-19T03:03:07.669 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5300000000000002e-06 2024-04-19T03:03:07.669 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.669 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.669 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:07.670 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018489+0000", 2024-04-19T03:03:07.670 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00033731499999999998 2024-04-19T03:03:07.670 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.670 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.670 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:07.670 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018508+0000", 2024-04-19T03:03:07.670 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9775e-05 2024-04-19T03:03:07.670 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.670 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.670 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:03:07.670 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.078059+0000", 2024-04-19T03:03:07.670 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.059550171999999998 2024-04-19T03:03:07.670 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.670 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.671 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:07.671 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.078126+0000", 2024-04-19T03:03:07.671 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7773000000000003e-05 2024-04-19T03:03:07.671 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:07.671 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:07.671 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:07.671 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.671 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.671 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:86612 5.7 5:e32e3c49:::benchmark_data_smithi096_19531_object86611:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:07.671 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:22.633560+0000", 2024-04-19T03:03:07.671 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 45.024422725000001, 2024-04-19T03:03:07.671 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.19135289, 2024-04-19T03:03:07.671 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:07.671 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:07.672 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:07.672 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:07.672 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:07.672 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 86612 2024-04-19T03:03:07.672 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.672 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:07.672 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.672 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:07.672 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633560+0000", 2024-04-19T03:03:07.672 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:07.672 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.672 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.672 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:07.672 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633560+0000", 2024-04-19T03:03:07.672 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:07.673 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.673 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.673 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:07.673 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633558+0000", 2024-04-19T03:03:07.673 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999986 2024-04-19T03:03:07.673 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.673 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.673 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:07.673 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633609+0000", 2024-04-19T03:03:07.673 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0850999999999998e-05 2024-04-19T03:03:07.673 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.673 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.673 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:07.673 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633627+0000", 2024-04-19T03:03:07.673 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7951000000000001e-05 2024-04-19T03:03:07.674 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.674 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.674 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:07.674 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633635+0000", 2024-04-19T03:03:07.674 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2530000000000004e-06 2024-04-19T03:03:07.674 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.674 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.674 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:07.674 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633699+0000", 2024-04-19T03:03:07.674 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3901999999999999e-05 2024-04-19T03:03:07.674 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.674 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.674 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:07.675 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633992+0000", 2024-04-19T03:03:07.675 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00029283299999999999 2024-04-19T03:03:07.675 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.675 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.675 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:07.675 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.634223+0000", 2024-04-19T03:03:07.675 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00023084200000000001 2024-04-19T03:03:07.675 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.675 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.675 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:03:07.675 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.639085+0000", 2024-04-19T03:03:07.675 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0048624269999999999 2024-04-19T03:03:07.675 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.675 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.675 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:07.676 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.824635+0000", 2024-04-19T03:03:07.676 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.18554944700000001 2024-04-19T03:03:07.676 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.676 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.676 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:03:07.676 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.824793+0000", 2024-04-19T03:03:07.676 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000157959 2024-04-19T03:03:07.676 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.676 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.676 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:07.676 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.824913+0000", 2024-04-19T03:03:07.676 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000120093 2024-04-19T03:03:07.676 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:07.676 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:07.677 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:07.677 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.677 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.677 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:86625 5.7 5:e6d00488:::benchmark_data_smithi096_19531_object86624:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:07.677 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:22.643554+0000", 2024-04-19T03:03:07.677 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 45.014428959, 2024-04-19T03:03:07.677 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.18732841, 2024-04-19T03:03:07.677 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:07.677 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:07.677 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:07.677 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:07.677 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:07.677 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 86625 2024-04-19T03:03:07.677 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.677 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:07.678 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.678 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:07.678 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643554+0000", 2024-04-19T03:03:07.678 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:07.678 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.678 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.678 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:07.678 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643554+0000", 2024-04-19T03:03:07.678 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:07.678 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.678 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.678 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:07.678 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643552+0000", 2024-04-19T03:03:07.678 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999986 2024-04-19T03:03:07.679 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.679 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.679 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:07.679 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643588+0000", 2024-04-19T03:03:07.679 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5855999999999997e-05 2024-04-19T03:03:07.679 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.679 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.679 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:07.679 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643606+0000", 2024-04-19T03:03:07.679 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8226000000000001e-05 2024-04-19T03:03:07.679 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.679 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.679 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:07.679 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643618+0000", 2024-04-19T03:03:07.679 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1868000000000001e-05 2024-04-19T03:03:07.680 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.680 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.680 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:07.680 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643676+0000", 2024-04-19T03:03:07.680 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8153999999999999e-05 2024-04-19T03:03:07.680 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.680 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.680 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:07.680 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643905+0000", 2024-04-19T03:03:07.680 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00022847500000000001 2024-04-19T03:03:07.680 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.680 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.680 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:07.680 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.644150+0000", 2024-04-19T03:03:07.680 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00024531800000000001 2024-04-19T03:03:07.681 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.681 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.681 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:03:07.681 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.647407+0000", 2024-04-19T03:03:07.681 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0032563190000000001 2024-04-19T03:03:07.681 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.681 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.681 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:07.681 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.830721+0000", 2024-04-19T03:03:07.681 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.18331468300000001 2024-04-19T03:03:07.681 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.681 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.681 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:03:07.681 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.830813+0000", 2024-04-19T03:03:07.682 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.2205000000000002e-05 2024-04-19T03:03:07.682 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.682 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.682 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:07.682 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.830882+0000", 2024-04-19T03:03:07.682 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8819999999999995e-05 2024-04-19T03:03:07.682 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:07.682 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:07.682 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:07.682 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.682 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.682 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87063 5.7 5:e502e824:::benchmark_data_smithi096_19531_object87062:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:07.682 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.136067+0000", 2024-04-19T03:03:07.682 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 44.521916089999998, 2024-04-19T03:03:07.683 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.065521159999999995, 2024-04-19T03:03:07.683 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:07.683 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:07.683 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:07.683 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:07.683 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:07.683 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87063 2024-04-19T03:03:07.683 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.683 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:07.683 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.683 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:07.683 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.136067+0000", 2024-04-19T03:03:07.683 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:07.683 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.683 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.684 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:07.684 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.136067+0000", 2024-04-19T03:03:07.684 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:07.684 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.684 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.684 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:07.684 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.136066+0000", 2024-04-19T03:03:07.684 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:03:07.684 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.684 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.684 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:07.684 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.136154+0000", 2024-04-19T03:03:07.684 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.8256000000000003e-05 2024-04-19T03:03:07.684 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.685 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.685 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:07.685 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.136162+0000", 2024-04-19T03:03:07.685 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.5099999999999998e-06 2024-04-19T03:03:07.685 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.685 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.685 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:07.685 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.136171+0000", 2024-04-19T03:03:07.685 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2830000000000001e-06 2024-04-19T03:03:07.685 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.685 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.685 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:07.685 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.138421+0000", 2024-04-19T03:03:07.685 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0022506620000000001 2024-04-19T03:03:07.685 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.686 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.686 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:07.686 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.138560+0000", 2024-04-19T03:03:07.686 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000138446 2024-04-19T03:03:07.686 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.686 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.686 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:07.686 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.138689+0000", 2024-04-19T03:03:07.686 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00012950700000000001 2024-04-19T03:03:07.686 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.686 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.686 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:03:07.686 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.141517+0000", 2024-04-19T03:03:07.686 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0028280860000000001 2024-04-19T03:03:07.687 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.687 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.687 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:07.687 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.201350+0000", 2024-04-19T03:03:07.687 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.059832418999999998 2024-04-19T03:03:07.687 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.687 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.687 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:03:07.687 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.201485+0000", 2024-04-19T03:03:07.687 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000135597 2024-04-19T03:03:07.687 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.687 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.687 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:07.688 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.201588+0000", 2024-04-19T03:03:07.688 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00010247900000000001 2024-04-19T03:03:07.688 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:07.688 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:07.688 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:07.688 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.688 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.688 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87072 5.7 5:e3c7809a:::benchmark_data_smithi096_19531_object87071:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:07.688 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.144224+0000", 2024-04-19T03:03:07.688 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 44.513759065999999, 2024-04-19T03:03:07.688 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.058179555000000001, 2024-04-19T03:03:07.688 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:07.688 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:07.688 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:07.688 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:07.689 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:07.689 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87072 2024-04-19T03:03:07.689 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.689 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:07.689 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.689 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:07.689 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144224+0000", 2024-04-19T03:03:07.689 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:07.689 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.689 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.689 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:07.689 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144224+0000", 2024-04-19T03:03:07.689 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:07.690 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.690 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.690 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:07.690 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144223+0000", 2024-04-19T03:03:07.690 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:03:07.690 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.690 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.690 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:07.690 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144320+0000", 2024-04-19T03:03:07.690 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.7075000000000001e-05 2024-04-19T03:03:07.690 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.690 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.690 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:07.690 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144331+0000", 2024-04-19T03:03:07.690 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1342000000000001e-05 2024-04-19T03:03:07.691 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.691 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.691 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:07.691 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144337+0000", 2024-04-19T03:03:07.691 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8390000000000003e-06 2024-04-19T03:03:07.691 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.691 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.691 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:07.691 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144369+0000", 2024-04-19T03:03:07.691 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2079000000000002e-05 2024-04-19T03:03:07.691 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.691 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.691 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:07.691 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144464+0000", 2024-04-19T03:03:07.692 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.4623000000000005e-05 2024-04-19T03:03:07.692 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.692 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.692 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:07.692 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144553+0000", 2024-04-19T03:03:07.692 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9171000000000004e-05 2024-04-19T03:03:07.692 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.692 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.692 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:03:07.692 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.147018+0000", 2024-04-19T03:03:07.692 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0024648370000000001 2024-04-19T03:03:07.692 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.692 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.692 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:07.693 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.202270+0000", 2024-04-19T03:03:07.693 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.055252018 2024-04-19T03:03:07.693 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.693 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.693 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:03:07.693 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.202356+0000", 2024-04-19T03:03:07.693 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6648000000000001e-05 2024-04-19T03:03:07.693 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.693 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.693 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:07.693 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.202403+0000", 2024-04-19T03:03:07.693 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6956999999999998e-05 2024-04-19T03:03:07.693 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:07.693 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:07.693 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:07.694 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.694 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.694 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87123 5.6 5:6d1bc3b9:::benchmark_data_smithi096_19531_object87122:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:03:07.694 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249233+0000", 2024-04-19T03:03:07.694 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 44.408750034000001, 2024-04-19T03:03:07.694 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0291700720000001, 2024-04-19T03:03:07.694 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:07.694 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-04-19T03:03:07.694 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:07.694 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:07.694 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:07.694 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87123 2024-04-19T03:03:07.694 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.695 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:07.695 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.695 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:07.695 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249233+0000", 2024-04-19T03:03:07.695 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:07.695 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.695 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.695 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:07.695 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249233+0000", 2024-04-19T03:03:07.695 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:07.695 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.695 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.695 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:07.695 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249231+0000", 2024-04-19T03:03:07.695 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999986 2024-04-19T03:03:07.696 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.696 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.696 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:07.696 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249285+0000", 2024-04-19T03:03:07.696 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4005000000000002e-05 2024-04-19T03:03:07.696 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.696 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.696 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:07.696 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249300+0000", 2024-04-19T03:03:07.696 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4715999999999999e-05 2024-04-19T03:03:07.696 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.696 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.696 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:07.696 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249307+0000", 2024-04-19T03:03:07.697 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8399999999999997e-06 2024-04-19T03:03:07.697 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.697 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.697 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:07.697 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249366+0000", 2024-04-19T03:03:07.697 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9435999999999998e-05 2024-04-19T03:03:07.697 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.697 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.697 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op must wait for map", 2024-04-19T03:03:07.697 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249376+0000", 2024-04-19T03:03:07.697 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.4919999999999999e-06 2024-04-19T03:03:07.697 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.697 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.697 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:07.698 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263757+0000", 2024-04-19T03:03:07.698 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.014381461999999999 2024-04-19T03:03:07.698 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.698 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.698 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:03:07.698 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263875+0000", 2024-04-19T03:03:07.698 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000117166 2024-04-19T03:03:07.698 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.698 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.698 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:07.698 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.277136+0000", 2024-04-19T03:03:07.698 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.013261207 2024-04-19T03:03:07.698 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.698 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.699 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:07.699 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.278403+0000", 2024-04-19T03:03:07.699 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001267106 2024-04-19T03:03:07.699 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:07.699 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:07.699 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:07.699 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.699 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.699 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87128 5.6 5:6905c420:::benchmark_data_smithi096_19531_object87127:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:03:07.699 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249323+0000", 2024-04-19T03:03:07.699 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 44.408659286999999, 2024-04-19T03:03:07.699 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0292813249999999, 2024-04-19T03:03:07.699 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:07.699 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-04-19T03:03:07.699 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:07.700 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:07.700 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:07.700 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87128 2024-04-19T03:03:07.700 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.700 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:07.700 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.700 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:07.700 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249323+0000", 2024-04-19T03:03:07.700 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:07.700 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.700 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.700 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:07.700 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249323+0000", 2024-04-19T03:03:07.700 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:07.701 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.701 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.701 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:07.701 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249323+0000", 2024-04-19T03:03:07.701 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:07.701 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.701 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.701 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:07.701 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249385+0000", 2024-04-19T03:03:07.701 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1711999999999995e-05 2024-04-19T03:03:07.701 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.701 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.701 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:07.701 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249398+0000", 2024-04-19T03:03:07.702 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3022e-05 2024-04-19T03:03:07.702 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.702 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.702 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:07.702 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249402+0000", 2024-04-19T03:03:07.702 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4819999999999996e-06 2024-04-19T03:03:07.702 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.702 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.702 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:07.702 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249437+0000", 2024-04-19T03:03:07.702 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4702000000000001e-05 2024-04-19T03:03:07.702 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.702 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.703 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:03:07.703 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249442+0000", 2024-04-19T03:03:07.703 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8019999999999999e-06 2024-04-19T03:03:07.703 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.703 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.703 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:07.703 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263896+0000", 2024-04-19T03:03:07.703 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.014454679999999999 2024-04-19T03:03:07.703 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.703 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.703 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:03:07.703 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263900+0000", 2024-04-19T03:03:07.703 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9700000000000001e-06 2024-04-19T03:03:07.703 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.704 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.704 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:07.704 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.278557+0000", 2024-04-19T03:03:07.704 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0146566480000001 2024-04-19T03:03:07.704 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.704 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.704 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:07.704 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.278605+0000", 2024-04-19T03:03:07.704 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7735999999999998e-05 2024-04-19T03:03:07.704 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:07.704 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:07.704 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:07.704 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.704 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.705 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87130 5.3 5:c8c2d67b:::benchmark_data_smithi096_19531_object87129:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:03:07.705 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249418+0000", 2024-04-19T03:03:07.705 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 44.408564576000003, 2024-04-19T03:03:07.705 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.025414182, 2024-04-19T03:03:07.705 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:07.705 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-04-19T03:03:07.705 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:07.705 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:07.705 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:07.705 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87130 2024-04-19T03:03:07.705 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.705 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:07.705 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.706 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:07.706 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249418+0000", 2024-04-19T03:03:07.706 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:07.706 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.706 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.706 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:07.706 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249418+0000", 2024-04-19T03:03:07.706 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:07.706 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.706 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.706 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:07.706 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249409+0000", 2024-04-19T03:03:07.706 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999905 2024-04-19T03:03:07.706 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.707 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.707 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:07.707 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249464+0000", 2024-04-19T03:03:07.707 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5381999999999999e-05 2024-04-19T03:03:07.707 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.707 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.707 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:07.707 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249471+0000", 2024-04-19T03:03:07.707 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2609999999999996e-06 2024-04-19T03:03:07.707 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.707 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.707 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:07.707 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249475+0000", 2024-04-19T03:03:07.707 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2839999999999998e-06 2024-04-19T03:03:07.708 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.708 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.708 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:07.708 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249535+0000", 2024-04-19T03:03:07.708 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0545999999999999e-05 2024-04-19T03:03:07.708 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.708 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.708 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op must wait for map", 2024-04-19T03:03:07.708 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249540+0000", 2024-04-19T03:03:07.708 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2859999999999999e-06 2024-04-19T03:03:07.708 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.708 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.708 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:07.708 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263450+0000", 2024-04-19T03:03:07.709 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.013909585 2024-04-19T03:03:07.709 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.709 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.709 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:03:07.709 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263458+0000", 2024-04-19T03:03:07.709 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8089999999999993e-06 2024-04-19T03:03:07.709 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.709 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.709 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:07.709 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.273193+0000", 2024-04-19T03:03:07.709 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0097351379999999 2024-04-19T03:03:07.709 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.709 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.709 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:07.709 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.274832+0000", 2024-04-19T03:03:07.710 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0016394789999999999 2024-04-19T03:03:07.710 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:07.710 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:07.710 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:07.710 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.710 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.710 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87131 5.1 5:83756d55:::benchmark_data_smithi096_19531_object87130:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:03:07.710 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249491+0000", 2024-04-19T03:03:07.710 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 44.408491929, 2024-04-19T03:03:07.710 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0191489520000001, 2024-04-19T03:03:07.710 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:07.710 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-04-19T03:03:07.710 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:07.711 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:07.711 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:07.711 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87131 2024-04-19T03:03:07.711 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.711 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:07.711 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.711 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:07.711 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249491+0000", 2024-04-19T03:03:07.711 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:07.711 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.711 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.711 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:07.711 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249491+0000", 2024-04-19T03:03:07.711 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:07.712 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.712 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.712 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:07.712 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249491+0000", 2024-04-19T03:03:07.712 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:07.712 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.712 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.712 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:07.712 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249530+0000", 2024-04-19T03:03:07.712 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9589000000000003e-05 2024-04-19T03:03:07.712 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.712 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.712 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:07.712 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249544+0000", 2024-04-19T03:03:07.712 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4158000000000001e-05 2024-04-19T03:03:07.713 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.713 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.713 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:07.713 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249549+0000", 2024-04-19T03:03:07.713 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6809999999999997e-06 2024-04-19T03:03:07.713 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.713 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.713 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:07.713 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249592+0000", 2024-04-19T03:03:07.713 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3285999999999999e-05 2024-04-19T03:03:07.713 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.713 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.713 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op must wait for map", 2024-04-19T03:03:07.713 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249598+0000", 2024-04-19T03:03:07.714 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8329999999999999e-06 2024-04-19T03:03:07.714 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.714 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.714 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:07.714 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263331+0000", 2024-04-19T03:03:07.714 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.013733093 2024-04-19T03:03:07.714 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.714 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.714 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:03:07.714 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263343+0000", 2024-04-19T03:03:07.714 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.189e-05 2024-04-19T03:03:07.714 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.714 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.714 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:07.715 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.268541+0000", 2024-04-19T03:03:07.715 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0051983440000001 2024-04-19T03:03:07.715 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.715 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.715 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:07.715 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.268640+0000", 2024-04-19T03:03:07.715 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.8387999999999994e-05 2024-04-19T03:03:07.715 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:07.715 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:07.715 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:07.715 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.715 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.715 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87132 5.c 5:3e18b732:::benchmark_data_smithi096_19531_object87131:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:03:07.716 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249558+0000", 2024-04-19T03:03:07.716 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 44.408425028000003, 2024-04-19T03:03:07.716 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0241198380000001, 2024-04-19T03:03:07.716 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:07.716 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-04-19T03:03:07.716 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:07.716 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:07.716 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:07.716 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87132 2024-04-19T03:03:07.716 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.716 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:07.716 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.716 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:07.716 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249558+0000", 2024-04-19T03:03:07.716 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:07.717 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.717 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.717 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:07.717 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249558+0000", 2024-04-19T03:03:07.717 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:07.717 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.717 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.717 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:07.717 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249557+0000", 2024-04-19T03:03:07.717 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:07.717 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.717 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.717 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:07.717 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249625+0000", 2024-04-19T03:03:07.718 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7200999999999996e-05 2024-04-19T03:03:07.718 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.718 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.718 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:07.718 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249646+0000", 2024-04-19T03:03:07.718 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1053e-05 2024-04-19T03:03:07.718 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.718 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.718 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:07.718 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249650+0000", 2024-04-19T03:03:07.718 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2719999999999999e-06 2024-04-19T03:03:07.718 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.718 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.718 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:07.719 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249686+0000", 2024-04-19T03:03:07.719 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6430000000000002e-05 2024-04-19T03:03:07.719 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.719 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.719 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op must wait for map", 2024-04-19T03:03:07.719 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249690+0000", 2024-04-19T03:03:07.719 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.765e-06 2024-04-19T03:03:07.719 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.719 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.719 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:07.719 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261157+0000", 2024-04-19T03:03:07.719 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011467247999999999 2024-04-19T03:03:07.719 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.719 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.720 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:03:07.720 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261170+0000", 2024-04-19T03:03:07.720 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2833000000000001e-05 2024-04-19T03:03:07.720 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.720 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.720 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:07.720 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.272119+0000", 2024-04-19T03:03:07.720 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.010949313 2024-04-19T03:03:07.720 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.720 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.720 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:07.720 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.273678+0000", 2024-04-19T03:03:07.720 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0015581550000000001 2024-04-19T03:03:07.720 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:07.721 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:07.721 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:07.721 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.721 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.721 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87133 5.c 5:3f772a62:::benchmark_data_smithi096_19531_object87132:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:03:07.721 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249657+0000", 2024-04-19T03:03:07.721 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 44.408325648999998, 2024-04-19T03:03:07.721 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0242819409999999, 2024-04-19T03:03:07.721 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:07.721 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-04-19T03:03:07.721 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:07.721 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:07.721 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:07.721 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87133 2024-04-19T03:03:07.722 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.722 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:07.722 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.722 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:07.722 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249657+0000", 2024-04-19T03:03:07.722 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:07.722 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.722 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.722 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:07.722 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249657+0000", 2024-04-19T03:03:07.722 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:07.722 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.722 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.722 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:07.723 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249657+0000", 2024-04-19T03:03:07.723 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:07.723 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.723 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.723 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:07.723 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249690+0000", 2024-04-19T03:03:07.723 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3343000000000002e-05 2024-04-19T03:03:07.723 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.723 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.723 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:07.723 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249695+0000", 2024-04-19T03:03:07.723 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8600000000000001e-06 2024-04-19T03:03:07.723 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.723 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.723 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:07.724 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249698+0000", 2024-04-19T03:03:07.724 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.1700000000000001e-06 2024-04-19T03:03:07.724 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.724 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.724 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:07.724 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249741+0000", 2024-04-19T03:03:07.724 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2849999999999998e-05 2024-04-19T03:03:07.724 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.724 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.724 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:03:07.724 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249746+0000", 2024-04-19T03:03:07.724 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1019999999999996e-06 2024-04-19T03:03:07.724 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.724 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.724 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:07.725 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261209+0000", 2024-04-19T03:03:07.725 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011462447000000001 2024-04-19T03:03:07.725 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.725 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.725 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:03:07.725 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261216+0000", 2024-04-19T03:03:07.725 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8520000000000004e-06 2024-04-19T03:03:07.725 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.725 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.725 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:07.725 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.273872+0000", 2024-04-19T03:03:07.725 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0126558000000001 2024-04-19T03:03:07.725 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.725 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.725 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:07.726 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.273939+0000", 2024-04-19T03:03:07.726 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6822000000000005e-05 2024-04-19T03:03:07.726 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:07.726 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:07.726 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:07.726 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.726 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.726 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87134 5.5 5:a56c478f:::benchmark_data_smithi096_19531_object87133:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:03:07.726 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249708+0000", 2024-04-19T03:03:07.726 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 44.408274724999998, 2024-04-19T03:03:07.726 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0214677299999999, 2024-04-19T03:03:07.726 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:07.726 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-04-19T03:03:07.726 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:07.727 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:07.727 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:07.727 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87134 2024-04-19T03:03:07.727 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.727 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:07.727 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.727 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:07.727 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249708+0000", 2024-04-19T03:03:07.727 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:07.727 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.727 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.727 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:07.727 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249708+0000", 2024-04-19T03:03:07.727 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:07.728 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.728 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.728 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:07.728 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249706+0000", 2024-04-19T03:03:07.728 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999976 2024-04-19T03:03:07.728 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.728 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.728 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:07.728 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249740+0000", 2024-04-19T03:03:07.728 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4458000000000001e-05 2024-04-19T03:03:07.728 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.728 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.728 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:07.728 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249745+0000", 2024-04-19T03:03:07.729 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5020000000000003e-06 2024-04-19T03:03:07.729 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.729 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.729 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:07.729 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249748+0000", 2024-04-19T03:03:07.729 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2499999999999998e-06 2024-04-19T03:03:07.729 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.729 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.729 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:07.729 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249778+0000", 2024-04-19T03:03:07.729 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.006e-05 2024-04-19T03:03:07.729 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.729 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.729 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op must wait for map", 2024-04-19T03:03:07.730 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249782+0000", 2024-04-19T03:03:07.730 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2910000000000001e-06 2024-04-19T03:03:07.730 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.730 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.730 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:07.730 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261666+0000", 2024-04-19T03:03:07.730 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011883471 2024-04-19T03:03:07.730 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.730 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.730 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:03:07.730 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261674+0000", 2024-04-19T03:03:07.730 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6479999999999992e-06 2024-04-19T03:03:07.730 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.730 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.731 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:07.731 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.269323+0000", 2024-04-19T03:03:07.731 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.00764867 2024-04-19T03:03:07.731 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.731 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.731 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:07.731 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.271176+0000", 2024-04-19T03:03:07.731 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001852844 2024-04-19T03:03:07.731 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:07.731 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:07.731 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:07.731 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.731 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.731 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87137 5.c 5:30708c68:::benchmark_data_smithi096_19531_object87136:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:03:07.731 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249756+0000", 2024-04-19T03:03:07.732 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 44.408227019000002, 2024-04-19T03:03:07.732 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.033331752, 2024-04-19T03:03:07.732 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:07.732 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:07.732 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:07.732 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:07.732 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:07.732 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87137 2024-04-19T03:03:07.732 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.732 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:07.732 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.732 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:07.732 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249756+0000", 2024-04-19T03:03:07.732 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:07.733 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.733 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.733 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:07.733 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249756+0000", 2024-04-19T03:03:07.733 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:07.733 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.733 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.733 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:07.733 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249755+0000", 2024-04-19T03:03:07.733 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:07.733 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.733 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.733 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:07.733 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249777+0000", 2024-04-19T03:03:07.733 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1420000000000002e-05 2024-04-19T03:03:07.734 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.734 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.734 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:07.734 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249781+0000", 2024-04-19T03:03:07.734 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0609999999999997e-06 2024-04-19T03:03:07.734 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.734 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.734 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:07.734 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249787+0000", 2024-04-19T03:03:07.734 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.02e-06 2024-04-19T03:03:07.734 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.734 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.734 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:07.735 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249818+0000", 2024-04-19T03:03:07.735 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0947e-05 2024-04-19T03:03:07.735 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.735 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.735 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:03:07.735 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249821+0000", 2024-04-19T03:03:07.735 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.117e-06 2024-04-19T03:03:07.735 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.735 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.735 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:07.735 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261243+0000", 2024-04-19T03:03:07.735 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011421875999999999 2024-04-19T03:03:07.735 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.735 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.735 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:03:07.736 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261251+0000", 2024-04-19T03:03:07.736 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6120000000000001e-06 2024-04-19T03:03:07.736 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.736 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.736 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:07.736 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.274050+0000", 2024-04-19T03:03:07.736 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.012799405 2024-04-19T03:03:07.736 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.736 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.736 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:07.736 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.274529+0000", 2024-04-19T03:03:07.736 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00047867100000000001 2024-04-19T03:03:07.736 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.736 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.737 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:03:07.737 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.282972+0000", 2024-04-19T03:03:07.737 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0084436900000000002 2024-04-19T03:03:07.737 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.737 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.737 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:03:07.737 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.283022+0000", 2024-04-19T03:03:07.737 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9339000000000003e-05 2024-04-19T03:03:07.737 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.737 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.737 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:07.737 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.283088+0000", 2024-04-19T03:03:07.737 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5877999999999995e-05 2024-04-19T03:03:07.737 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:07.737 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:07.738 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:07.738 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.738 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.738 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:158376 5.9 5:9e73c076:::benchmark_data_smithi096_19531_object44926:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-19T03:03:07.738 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:58.126227+0000", 2024-04-19T03:03:07.738 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 9.5317552859999992, 2024-04-19T03:03:07.738 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.069738668000000004, 2024-04-19T03:03:07.738 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:07.738 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:07.738 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:07.738 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:07.738 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:07.738 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 158376 2024-04-19T03:03:07.738 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.739 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:07.739 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.739 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:07.739 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.126227+0000", 2024-04-19T03:03:07.739 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:07.739 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.739 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.739 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:07.739 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.126227+0000", 2024-04-19T03:03:07.739 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:07.739 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.739 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.739 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:07.739 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.126226+0000", 2024-04-19T03:03:07.739 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:03:07.740 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.740 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.740 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:07.740 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.126236+0000", 2024-04-19T03:03:07.740 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.4199999999999996e-06 2024-04-19T03:03:07.740 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.740 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.740 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:07.740 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.126243+0000", 2024-04-19T03:03:07.740 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.199e-06 2024-04-19T03:03:07.740 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.740 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.740 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:07.740 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.126248+0000", 2024-04-19T03:03:07.741 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1320000000000002e-06 2024-04-19T03:03:07.741 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.741 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.741 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:07.741 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.126286+0000", 2024-04-19T03:03:07.741 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7401000000000003e-05 2024-04-19T03:03:07.741 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.741 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.741 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:07.741 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.126368+0000", 2024-04-19T03:03:07.741 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2113999999999993e-05 2024-04-19T03:03:07.741 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.741 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.741 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:03:07.741 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.126438+0000", 2024-04-19T03:03:07.742 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0337000000000001e-05 2024-04-19T03:03:07.742 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.742 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.742 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:03:07.742 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.130816+0000", 2024-04-19T03:03:07.742 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0043778330000000002 2024-04-19T03:03:07.742 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.742 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.742 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:07.742 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.195830+0000", 2024-04-19T03:03:07.742 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.065013933999999995 2024-04-19T03:03:07.742 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.742 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.743 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:03:07.743 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.195907+0000", 2024-04-19T03:03:07.743 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7397000000000005e-05 2024-04-19T03:03:07.743 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.743 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.743 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:07.743 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.195966+0000", 2024-04-19T03:03:07.743 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8906999999999997e-05 2024-04-19T03:03:07.743 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:07.743 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:07.743 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:07.743 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.743 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.743 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:158381 5.9 5:94dcd4a7:::benchmark_data_smithi096_19531_object44931:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-19T03:03:07.744 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:58.128712+0000", 2024-04-19T03:03:07.744 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 9.5292708430000008, 2024-04-19T03:03:07.744 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.067497527000000002, 2024-04-19T03:03:07.744 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:07.744 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:07.744 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:07.744 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:07.744 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:07.744 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 158381 2024-04-19T03:03:07.744 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.744 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:07.744 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.744 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:07.744 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.128712+0000", 2024-04-19T03:03:07.745 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:07.745 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.745 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.745 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:07.745 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.128712+0000", 2024-04-19T03:03:07.745 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:07.745 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.745 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.745 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:07.745 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.128711+0000", 2024-04-19T03:03:07.745 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:03:07.745 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.745 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.745 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:07.746 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.128716+0000", 2024-04-19T03:03:07.746 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0610000000000003e-06 2024-04-19T03:03:07.746 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.746 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.746 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:07.746 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.128724+0000", 2024-04-19T03:03:07.746 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0120000000000005e-06 2024-04-19T03:03:07.746 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.746 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.746 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:07.746 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.128729+0000", 2024-04-19T03:03:07.746 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8899999999999998e-06 2024-04-19T03:03:07.746 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.746 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.747 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:07.747 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.128778+0000", 2024-04-19T03:03:07.747 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9110000000000002e-05 2024-04-19T03:03:07.747 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.747 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.747 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:07.747 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.128903+0000", 2024-04-19T03:03:07.747 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00012506799999999999 2024-04-19T03:03:07.747 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.747 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.747 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:03:07.747 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.129022+0000", 2024-04-19T03:03:07.747 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00011923599999999999 2024-04-19T03:03:07.747 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.748 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.748 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:03:07.748 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.132294+0000", 2024-04-19T03:03:07.748 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.003271244 2024-04-19T03:03:07.748 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.748 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.748 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:07.748 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.196045+0000", 2024-04-19T03:03:07.748 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.063751206000000005 2024-04-19T03:03:07.748 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.748 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.748 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:03:07.748 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.196133+0000", 2024-04-19T03:03:07.749 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.8213000000000004e-05 2024-04-19T03:03:07.749 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.749 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.749 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:07.749 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.196209+0000", 2024-04-19T03:03:07.749 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6335999999999996e-05 2024-04-19T03:03:07.749 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:07.749 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:07.749 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:07.749 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.749 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.749 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:158385 5.9 5:950ec749:::benchmark_data_smithi096_19531_object44935:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-19T03:03:07.749 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:58.129756+0000", 2024-04-19T03:03:07.749 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 9.5282269110000009, 2024-04-19T03:03:07.749 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.068998382999999996, 2024-04-19T03:03:07.750 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:07.750 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:07.750 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:07.750 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:07.750 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:07.750 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 158385 2024-04-19T03:03:07.750 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.750 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:07.750 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.750 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:07.750 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.129756+0000", 2024-04-19T03:03:07.750 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:07.750 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.750 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.751 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:07.751 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.129756+0000", 2024-04-19T03:03:07.751 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:07.751 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.751 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.751 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:07.751 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.129755+0000", 2024-04-19T03:03:07.751 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:03:07.751 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.751 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.751 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:07.751 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.129760+0000", 2024-04-19T03:03:07.751 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6030000000000004e-06 2024-04-19T03:03:07.751 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.752 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.752 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:07.752 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.129774+0000", 2024-04-19T03:03:07.752 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3131e-05 2024-04-19T03:03:07.752 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.752 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.752 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:07.752 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.129781+0000", 2024-04-19T03:03:07.752 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4030000000000001e-06 2024-04-19T03:03:07.752 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.752 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.752 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:07.752 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.130837+0000", 2024-04-19T03:03:07.752 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00105569 2024-04-19T03:03:07.753 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.753 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.753 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:07.753 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.130917+0000", 2024-04-19T03:03:07.753 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9929e-05 2024-04-19T03:03:07.753 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.753 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.753 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:03:07.753 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.130973+0000", 2024-04-19T03:03:07.753 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.664e-05 2024-04-19T03:03:07.753 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.753 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.753 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:03:07.753 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.132340+0000", 2024-04-19T03:03:07.753 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001366321 2024-04-19T03:03:07.754 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.754 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.754 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:07.754 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.198637+0000", 2024-04-19T03:03:07.754 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.066296888999999998 2024-04-19T03:03:07.754 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.754 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.754 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:03:07.754 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.198704+0000", 2024-04-19T03:03:07.754 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7333000000000001e-05 2024-04-19T03:03:07.754 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.754 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.754 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:07.755 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.198754+0000", 2024-04-19T03:03:07.755 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0421999999999999e-05 2024-04-19T03:03:07.755 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:07.755 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:07.755 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:07.755 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.755 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.755 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:158387 5.9 5:9e96f619:::benchmark_data_smithi096_19531_object44937:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-19T03:03:07.755 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:58.132457+0000", 2024-04-19T03:03:07.755 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 9.5255253470000003, 2024-04-19T03:03:07.755 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.066858091999999994, 2024-04-19T03:03:07.755 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:07.755 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:07.756 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:07.756 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:07.756 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:07.756 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 158387 2024-04-19T03:03:07.756 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.756 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:07.756 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.756 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:07.756 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.132457+0000", 2024-04-19T03:03:07.756 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:07.756 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.756 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.756 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:07.756 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.132457+0000", 2024-04-19T03:03:07.757 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:07.757 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.757 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.757 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:07.757 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.132457+0000", 2024-04-19T03:03:07.757 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:07.757 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.757 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.757 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:07.757 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.132460+0000", 2024-04-19T03:03:07.757 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.1949999999999999e-06 2024-04-19T03:03:07.757 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.757 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.757 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:07.757 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.132468+0000", 2024-04-19T03:03:07.758 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.1599999999999998e-06 2024-04-19T03:03:07.758 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.758 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.758 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:07.758 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.132473+0000", 2024-04-19T03:03:07.758 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9259999999999999e-06 2024-04-19T03:03:07.758 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.758 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.758 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:07.758 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.132504+0000", 2024-04-19T03:03:07.758 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0914000000000003e-05 2024-04-19T03:03:07.758 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.758 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.758 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:07.759 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.132646+0000", 2024-04-19T03:03:07.759 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00014214300000000001 2024-04-19T03:03:07.759 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.759 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.759 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:03:07.759 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.132741+0000", 2024-04-19T03:03:07.759 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.4344000000000003e-05 2024-04-19T03:03:07.759 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.759 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.759 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:03:07.759 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.135774+0000", 2024-04-19T03:03:07.759 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0030334960000000001 2024-04-19T03:03:07.759 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.760 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.760 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:07.760 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.199240+0000", 2024-04-19T03:03:07.760 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.063465695000000003 2024-04-19T03:03:07.760 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.760 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.760 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:03:07.760 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.199272+0000", 2024-04-19T03:03:07.760 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2412000000000001e-05 2024-04-19T03:03:07.760 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.760 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.760 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:07.760 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.199316+0000", 2024-04-19T03:03:07.760 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3275000000000002e-05 2024-04-19T03:03:07.760 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:07.761 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:07.761 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:07.761 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.761 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.761 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:158392 5.f 5:f462725f:::benchmark_data_smithi096_19531_object44942:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-19T03:03:07.761 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:58.135703+0000", 2024-04-19T03:03:07.761 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 9.522279567, 2024-04-19T03:03:07.761 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.063132879000000003, 2024-04-19T03:03:07.761 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:07.761 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:07.761 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:07.761 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:07.761 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:07.761 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 158392 2024-04-19T03:03:07.762 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.762 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:07.762 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.762 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:07.762 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.135703+0000", 2024-04-19T03:03:07.762 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:07.762 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.762 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.762 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:07.762 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.135703+0000", 2024-04-19T03:03:07.762 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:07.762 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.762 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.762 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:07.763 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.135702+0000", 2024-04-19T03:03:07.763 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:03:07.763 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.763 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.763 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:07.763 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.135708+0000", 2024-04-19T03:03:07.763 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8270000000000003e-06 2024-04-19T03:03:07.763 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.763 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.763 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:07.763 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.135720+0000", 2024-04-19T03:03:07.763 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2057e-05 2024-04-19T03:03:07.763 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.763 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.763 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:07.764 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.135727+0000", 2024-04-19T03:03:07.764 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8090000000000004e-06 2024-04-19T03:03:07.764 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.764 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.764 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:07.764 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.135768+0000", 2024-04-19T03:03:07.764 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1548999999999998e-05 2024-04-19T03:03:07.764 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.764 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.764 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:07.764 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.135853+0000", 2024-04-19T03:03:07.764 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4845000000000005e-05 2024-04-19T03:03:07.764 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.764 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.764 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:03:07.765 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.135934+0000", 2024-04-19T03:03:07.765 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0315000000000006e-05 2024-04-19T03:03:07.765 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.765 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.765 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:03:07.765 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.138685+0000", 2024-04-19T03:03:07.765 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.002751042 2024-04-19T03:03:07.765 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.765 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.765 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:07.765 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.198747+0000", 2024-04-19T03:03:07.765 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.060062675000000003 2024-04-19T03:03:07.765 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.765 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.766 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:03:07.766 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.198802+0000", 2024-04-19T03:03:07.766 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4469000000000003e-05 2024-04-19T03:03:07.766 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.766 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.766 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:07.766 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.198836+0000", 2024-04-19T03:03:07.766 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4272e-05 2024-04-19T03:03:07.766 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:07.766 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:07.766 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:07.766 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.766 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.766 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:158397 5.d 5:b5d962e9:::benchmark_data_smithi096_19531_object44947:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-19T03:03:07.766 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:58.138717+0000", 2024-04-19T03:03:07.767 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 9.5192656239999991, 2024-04-19T03:03:07.767 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.057191467000000003, 2024-04-19T03:03:07.767 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:07.767 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:07.767 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:07.767 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:07.767 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:07.767 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 158397 2024-04-19T03:03:07.767 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.767 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:07.767 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.767 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:07.767 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.138717+0000", 2024-04-19T03:03:07.767 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:07.768 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.768 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.768 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:07.769 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.138717+0000", 2024-04-19T03:03:07.769 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:07.769 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.769 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.769 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:07.769 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.138716+0000", 2024-04-19T03:03:07.770 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999986 2024-04-19T03:03:07.770 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.770 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.770 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:07.770 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.138722+0000", 2024-04-19T03:03:07.770 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1709999999999999e-06 2024-04-19T03:03:07.770 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.770 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.770 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:07.770 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.138731+0000", 2024-04-19T03:03:07.770 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.0310000000000004e-06 2024-04-19T03:03:07.770 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.770 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.770 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:07.770 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.138738+0000", 2024-04-19T03:03:07.771 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8430000000000004e-06 2024-04-19T03:03:07.771 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.771 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.771 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:07.771 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.138789+0000", 2024-04-19T03:03:07.771 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0623e-05 2024-04-19T03:03:07.771 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.771 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.771 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:07.771 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.138945+0000", 2024-04-19T03:03:07.771 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00015671899999999999 2024-04-19T03:03:07.771 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.771 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.771 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:03:07.772 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.139079+0000", 2024-04-19T03:03:07.772 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00013380099999999999 2024-04-19T03:03:07.772 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.772 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.772 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:03:07.772 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.141715+0000", 2024-04-19T03:03:07.772 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0026362849999999999 2024-04-19T03:03:07.772 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.772 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.772 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:07.772 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.195784+0000", 2024-04-19T03:03:07.772 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.054068353 2024-04-19T03:03:07.772 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.772 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.772 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:03:07.773 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.195852+0000", 2024-04-19T03:03:07.773 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8121999999999996e-05 2024-04-19T03:03:07.773 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:07.773 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:07.773 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:07.773 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.195909+0000", 2024-04-19T03:03:07.773 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6737999999999998e-05 2024-04-19T03:03:07.773 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:07.773 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:07.773 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:07.773 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:07.773 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:07.773 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-04-19T03:03:07.775 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:03:07.770+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:03:07.775 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T03:03:07.875 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:03:07.870+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:03:07.902 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-19T03:03:07.902 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-04-19T03:03:07.902 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.902 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4755.0:182451 5.9 e59/22 5:9b7b07b9:::benchmark_data_smithi096_19531_object69001:head v 59'11148, mlcod=59'11146)", 2024-04-19T03:03:07.902 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:03:07.899500+0000", 2024-04-19T03:03:07.902 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0028143970000000002, 2024-04-19T03:03:07.902 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0028360350000000002, 2024-04-19T03:03:07.902 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:07.902 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-19T03:03:07.903 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:07.903 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.903 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:07.903 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:07.899500+0000", 2024-04-19T03:03:07.903 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:07.903 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.903 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.903 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:07.903 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:07.899500+0000", 2024-04-19T03:03:07.903 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:07.903 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.903 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.903 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:07.903 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:07.899499+0000", 2024-04-19T03:03:07.904 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:03:07.904 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.904 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.904 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:07.904 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:07.899506+0000", 2024-04-19T03:03:07.904 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3030000000000002e-06 2024-04-19T03:03:07.904 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.904 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.904 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:07.904 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:07.899516+0000", 2024-04-19T03:03:07.904 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.9369999999999999e-06 2024-04-19T03:03:07.904 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.904 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.904 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:07.905 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:07.899523+0000", 2024-04-19T03:03:07.905 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.9920000000000001e-06 2024-04-19T03:03:07.905 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.905 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.905 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:07.905 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:07.899565+0000", 2024-04-19T03:03:07.905 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2110000000000002e-05 2024-04-19T03:03:07.905 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.905 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.905 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:07.905 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:07.899585+0000", 2024-04-19T03:03:07.905 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0168000000000001e-05 2024-04-19T03:03:07.905 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:07.906 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:07.906 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:07.906 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.906 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.906 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:182452 5.4 5:2dc34c9d:::benchmark_data_smithi096_19531_object69002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-19T03:03:07.906 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:03:07.901052+0000", 2024-04-19T03:03:07.906 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.001262048, 2024-04-19T03:03:07.906 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0013463419999999999, 2024-04-19T03:03:07.906 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:07.906 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-19T03:03:07.906 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:07.906 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:07.906 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:07.907 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 182452 2024-04-19T03:03:07.907 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.907 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:07.907 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.907 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:07.907 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:07.901052+0000", 2024-04-19T03:03:07.907 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:07.907 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.907 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.907 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:07.907 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:07.901052+0000", 2024-04-19T03:03:07.907 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:07.907 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.907 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.908 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:07.908 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:07.901051+0000", 2024-04-19T03:03:07.908 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:03:07.908 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.908 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.908 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:07.908 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:07.901057+0000", 2024-04-19T03:03:07.908 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2219999999999999e-06 2024-04-19T03:03:07.908 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.908 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.908 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:07.908 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:07.901069+0000", 2024-04-19T03:03:07.908 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1694e-05 2024-04-19T03:03:07.908 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.909 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.909 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:07.909 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:07.901076+0000", 2024-04-19T03:03:07.909 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4490000000000002e-06 2024-04-19T03:03:07.909 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.909 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.909 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:07.909 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:07.901123+0000", 2024-04-19T03:03:07.909 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6875000000000001e-05 2024-04-19T03:03:07.909 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.909 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.909 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:07.909 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:07.901231+0000", 2024-04-19T03:03:07.910 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000108348 2024-04-19T03:03:07.910 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:07.910 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:07.910 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:07.910 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.910 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.910 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:182457 5.4 5.dea1f604 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-19T03:03:07.910 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:03:07.901366+0000", 2024-04-19T03:03:07.910 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.00094818799999999998, 2024-04-19T03:03:07.910 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001107053, 2024-04-19T03:03:07.910 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:07.911 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-04-19T03:03:07.911 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:07.911 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:07.911 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:07.911 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 182457 2024-04-19T03:03:07.911 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.911 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:07.911 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.911 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:07.911 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:07.901366+0000", 2024-04-19T03:03:07.911 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:07.911 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.911 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.911 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:07.911 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:07.901366+0000", 2024-04-19T03:03:07.912 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:07.912 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.912 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.912 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:07.912 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:07.901365+0000", 2024-04-19T03:03:07.912 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:07.912 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.912 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.912 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:07.912 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:07.901369+0000", 2024-04-19T03:03:07.912 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7239999999999998e-06 2024-04-19T03:03:07.912 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.912 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.912 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:07.913 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:07.901378+0000", 2024-04-19T03:03:07.913 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.7690000000000002e-06 2024-04-19T03:03:07.913 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.913 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.913 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:07.913 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:07.901382+0000", 2024-04-19T03:03:07.913 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7140000000000001e-06 2024-04-19T03:03:07.913 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:07.913 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:07.913 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:07.913 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.913 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.913 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4755.0:182456 5.f e59/22 5:f4b7e0d2:::benchmark_data_smithi096_19531_object69006:head v 59'11330, mlcod=59'11327)", 2024-04-19T03:03:07.913 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:03:07.901396+0000", 2024-04-19T03:03:07.914 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.00091830700000000004, 2024-04-19T03:03:07.914 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0011262799999999999, 2024-04-19T03:03:07.914 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:07.914 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-19T03:03:07.914 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:07.914 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.914 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:07.914 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:07.901396+0000", 2024-04-19T03:03:07.914 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:07.914 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.914 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.914 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:07.914 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:07.901396+0000", 2024-04-19T03:03:07.914 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:07.915 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.915 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.915 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:07.915 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:07.901395+0000", 2024-04-19T03:03:07.915 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:03:07.915 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.915 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.915 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:07.915 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:07.901402+0000", 2024-04-19T03:03:07.915 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2350000000000002e-06 2024-04-19T03:03:07.915 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.915 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.915 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:07.915 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:07.901411+0000", 2024-04-19T03:03:07.916 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.0710000000000001e-06 2024-04-19T03:03:07.916 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.916 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.916 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:07.916 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:07.901421+0000", 2024-04-19T03:03:07.916 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0183000000000001e-05 2024-04-19T03:03:07.916 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.916 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.916 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:07.916 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:07.901458+0000", 2024-04-19T03:03:07.916 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6554000000000003e-05 2024-04-19T03:03:07.916 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.916 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.916 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:07.917 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:07.901469+0000", 2024-04-19T03:03:07.917 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0898e-05 2024-04-19T03:03:07.917 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:07.917 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:07.917 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:07.917 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.917 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.917 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4755.0:182453 5.9 e59/22 5:994ff3ef:::benchmark_data_smithi096_19531_object69003:head v 59'11149, mlcod=59'11146)", 2024-04-19T03:03:07.917 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:03:07.901446+0000", 2024-04-19T03:03:07.917 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.00086813600000000004, 2024-04-19T03:03:07.917 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001129042, 2024-04-19T03:03:07.917 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:07.917 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-19T03:03:07.917 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:07.918 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.918 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:07.918 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:07.901446+0000", 2024-04-19T03:03:07.918 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:07.918 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.918 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.918 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:07.918 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:07.901446+0000", 2024-04-19T03:03:07.918 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:07.918 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.918 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.918 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:07.918 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:07.901445+0000", 2024-04-19T03:03:07.918 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:07.919 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.919 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.919 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:07.919 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:07.901451+0000", 2024-04-19T03:03:07.919 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4469999999999997e-06 2024-04-19T03:03:07.919 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.919 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.919 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:07.919 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:07.901458+0000", 2024-04-19T03:03:07.919 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3509999999999996e-06 2024-04-19T03:03:07.919 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.919 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.919 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:07.919 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:07.901463+0000", 2024-04-19T03:03:07.919 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0420000000000002e-06 2024-04-19T03:03:07.920 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.920 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.920 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:07.920 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:07.901510+0000", 2024-04-19T03:03:07.920 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6941999999999999e-05 2024-04-19T03:03:07.920 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:07.920 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:07.920 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:07.920 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:07.901530+0000", 2024-04-19T03:03:07.920 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0233000000000001e-05 2024-04-19T03:03:07.920 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:07.920 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:07.920 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:07.920 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:07.921 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-04-19T03:03:07.921 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 5 2024-04-19T03:03:07.921 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-19T03:03:07.922 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T03:03:07.976 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:03:07.972+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:03:08.052 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-19T03:03:08.053 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-04-19T03:03:08.053 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-04-19T03:03:08.053 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-04-19T03:03:08.053 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-19T03:03:08.066 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T03:03:08.077 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:03:08.074+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:03:08.178 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:03:08.174+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:03:08.189 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-19T03:03:08.189 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-04-19T03:03:08.189 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-04-19T03:03:08.189 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-04-19T03:03:08.189 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.189 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:86615 5.e 5:7fef7288:::benchmark_data_smithi096_19531_object86614:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:08.189 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:22.634544+0000", 2024-04-19T03:03:08.189 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 45.552446261, 2024-04-19T03:03:08.189 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.192475071, 2024-04-19T03:03:08.189 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:08.189 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:08.190 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:08.190 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:08.190 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:08.190 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 86615 2024-04-19T03:03:08.190 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.190 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:08.190 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.190 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:08.190 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634544+0000", 2024-04-19T03:03:08.190 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:08.190 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.190 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.190 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:08.191 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634544+0000", 2024-04-19T03:03:08.191 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:08.191 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.191 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.191 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:08.191 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634542+0000", 2024-04-19T03:03:08.191 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999981 2024-04-19T03:03:08.191 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.191 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.191 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:08.191 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634585+0000", 2024-04-19T03:03:08.191 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2299000000000003e-05 2024-04-19T03:03:08.191 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.191 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.191 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:08.192 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634592+0000", 2024-04-19T03:03:08.192 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2350000000000002e-06 2024-04-19T03:03:08.192 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.192 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.192 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:08.192 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634596+0000", 2024-04-19T03:03:08.192 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5390000000000001e-06 2024-04-19T03:03:08.192 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.192 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.192 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:08.192 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634639+0000", 2024-04-19T03:03:08.192 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2444999999999998e-05 2024-04-19T03:03:08.192 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.192 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.193 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:08.193 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634808+0000", 2024-04-19T03:03:08.193 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000169152 2024-04-19T03:03:08.193 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.193 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.193 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:08.193 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634999+0000", 2024-04-19T03:03:08.193 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00019098300000000001 2024-04-19T03:03:08.193 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.193 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.193 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:08.193 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.640458+0000", 2024-04-19T03:03:08.193 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0054586870000000003 2024-04-19T03:03:08.193 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.193 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.194 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:08.194 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.826949+0000", 2024-04-19T03:03:08.194 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.18649178299999999 2024-04-19T03:03:08.194 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.194 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.194 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:03:08.194 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.826982+0000", 2024-04-19T03:03:08.194 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2477000000000001e-05 2024-04-19T03:03:08.194 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.194 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.194 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:08.194 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.827019+0000", 2024-04-19T03:03:08.194 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7355999999999999e-05 2024-04-19T03:03:08.194 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:08.195 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:08.195 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:08.195 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.195 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.195 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:86616 5.e 5:72278f47:::benchmark_data_smithi096_19531_object86615:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:08.195 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:22.634609+0000", 2024-04-19T03:03:08.195 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 45.552381111999999, 2024-04-19T03:03:08.195 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.19472088900000001, 2024-04-19T03:03:08.195 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:08.195 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:08.195 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:08.195 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:08.195 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:08.195 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 86616 2024-04-19T03:03:08.196 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.196 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:08.196 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.196 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:08.196 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634609+0000", 2024-04-19T03:03:08.196 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:08.196 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.196 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.196 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:08.196 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634609+0000", 2024-04-19T03:03:08.196 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:08.196 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.196 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.196 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:08.196 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634609+0000", 2024-04-19T03:03:08.197 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:08.197 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.197 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.197 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:08.197 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634651+0000", 2024-04-19T03:03:08.197 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2589000000000002e-05 2024-04-19T03:03:08.197 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.197 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.197 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:08.197 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634659+0000", 2024-04-19T03:03:08.197 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5850000000000002e-06 2024-04-19T03:03:08.197 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.197 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.197 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:08.198 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634662+0000", 2024-04-19T03:03:08.198 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3620000000000002e-06 2024-04-19T03:03:08.198 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.198 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.198 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:08.198 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.637880+0000", 2024-04-19T03:03:08.198 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.003218149 2024-04-19T03:03:08.198 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.198 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.198 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:08.198 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.637999+0000", 2024-04-19T03:03:08.198 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000118643 2024-04-19T03:03:08.198 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.199 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.199 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:08.199 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.638102+0000", 2024-04-19T03:03:08.199 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010331 2024-04-19T03:03:08.199 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.199 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.199 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:08.199 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.640851+0000", 2024-04-19T03:03:08.199 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0027483310000000001 2024-04-19T03:03:08.199 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.199 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.199 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:08.199 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.829269+0000", 2024-04-19T03:03:08.199 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.188418319 2024-04-19T03:03:08.199 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.200 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.200 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:03:08.200 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.829299+0000", 2024-04-19T03:03:08.200 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0227e-05 2024-04-19T03:03:08.200 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.200 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.200 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:08.200 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.829330+0000", 2024-04-19T03:03:08.200 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0969000000000001e-05 2024-04-19T03:03:08.200 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:08.200 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:08.200 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:08.200 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.200 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.200 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:86618 5.0 5:09014b90:::benchmark_data_smithi096_19531_object86617:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:08.201 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:22.634894+0000", 2024-04-19T03:03:08.201 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 45.552096624000001, 2024-04-19T03:03:08.201 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.19413419800000001, 2024-04-19T03:03:08.201 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:08.201 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:08.201 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:08.201 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:08.201 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:08.201 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 86618 2024-04-19T03:03:08.201 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.201 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:08.201 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.201 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:08.201 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634894+0000", 2024-04-19T03:03:08.202 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:08.202 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.202 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.202 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:08.202 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634894+0000", 2024-04-19T03:03:08.202 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:08.202 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.202 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.202 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:08.202 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634893+0000", 2024-04-19T03:03:08.202 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:03:08.202 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.202 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.202 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:08.203 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634976+0000", 2024-04-19T03:03:08.203 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3231000000000003e-05 2024-04-19T03:03:08.203 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.203 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.203 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:08.203 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634983+0000", 2024-04-19T03:03:08.203 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5169999999999996e-06 2024-04-19T03:03:08.203 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.203 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.203 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:08.203 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634987+0000", 2024-04-19T03:03:08.203 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.425e-06 2024-04-19T03:03:08.203 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.203 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.204 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:08.204 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635030+0000", 2024-04-19T03:03:08.204 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.32e-05 2024-04-19T03:03:08.204 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.204 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.204 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:08.204 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635185+0000", 2024-04-19T03:03:08.204 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015471899999999999 2024-04-19T03:03:08.204 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.204 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.204 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:08.204 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635415+0000", 2024-04-19T03:03:08.204 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00023026500000000001 2024-04-19T03:03:08.204 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.204 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.205 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:08.205 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.640127+0000", 2024-04-19T03:03:08.205 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0047118890000000004 2024-04-19T03:03:08.205 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.205 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.205 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:08.205 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.828895+0000", 2024-04-19T03:03:08.205 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.18876802600000001 2024-04-19T03:03:08.205 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.205 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.205 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:03:08.205 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.828972+0000", 2024-04-19T03:03:08.205 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.6345000000000002e-05 2024-04-19T03:03:08.206 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.206 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.206 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:08.206 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.829028+0000", 2024-04-19T03:03:08.206 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6342999999999999e-05 2024-04-19T03:03:08.206 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:08.206 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:08.206 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:08.206 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.206 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.206 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:86620 5.b 5:d80faa68:::benchmark_data_smithi096_19531_object86619:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:08.206 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:22.635110+0000", 2024-04-19T03:03:08.206 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 45.551880064000002, 2024-04-19T03:03:08.206 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.193447275, 2024-04-19T03:03:08.207 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:08.207 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:08.207 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:08.207 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:08.207 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:08.207 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 86620 2024-04-19T03:03:08.207 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.207 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:08.207 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.207 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:08.207 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635110+0000", 2024-04-19T03:03:08.207 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:08.207 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.207 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.207 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:08.208 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635110+0000", 2024-04-19T03:03:08.208 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:08.208 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.208 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.208 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:08.208 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635110+0000", 2024-04-19T03:03:08.208 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:08.208 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.208 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.208 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:08.208 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635154+0000", 2024-04-19T03:03:08.208 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4681000000000001e-05 2024-04-19T03:03:08.208 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.208 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.209 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:08.209 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635166+0000", 2024-04-19T03:03:08.209 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1505000000000001e-05 2024-04-19T03:03:08.209 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.209 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.209 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:08.209 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635171+0000", 2024-04-19T03:03:08.209 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6040000000000003e-06 2024-04-19T03:03:08.209 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.209 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.209 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:08.209 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635221+0000", 2024-04-19T03:03:08.209 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9947000000000001e-05 2024-04-19T03:03:08.209 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.209 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.210 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:08.210 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635356+0000", 2024-04-19T03:03:08.210 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013576199999999999 2024-04-19T03:03:08.210 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.210 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.210 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:08.210 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635507+0000", 2024-04-19T03:03:08.210 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015072999999999999 2024-04-19T03:03:08.210 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.210 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.210 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:08.210 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.638488+0000", 2024-04-19T03:03:08.210 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0029813159999999999 2024-04-19T03:03:08.210 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.211 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.211 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:08.211 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.828341+0000", 2024-04-19T03:03:08.211 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.189852254 2024-04-19T03:03:08.211 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.211 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.211 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:03:08.211 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.828416+0000", 2024-04-19T03:03:08.211 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5344000000000002e-05 2024-04-19T03:03:08.211 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.211 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.211 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:08.211 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.828558+0000", 2024-04-19T03:03:08.211 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000141695 2024-04-19T03:03:08.212 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:08.212 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:08.212 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:08.212 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.212 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.212 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:86621 5.8 5:1597a420:::benchmark_data_smithi096_19531_object86620:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:08.212 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:22.635187+0000", 2024-04-19T03:03:08.212 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 45.551803204000002, 2024-04-19T03:03:08.212 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.194204878, 2024-04-19T03:03:08.212 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:08.212 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:08.212 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:08.212 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:08.212 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:08.212 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 86621 2024-04-19T03:03:08.213 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.213 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:08.213 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.213 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:08.213 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635187+0000", 2024-04-19T03:03:08.213 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:08.213 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.213 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.213 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:08.213 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635187+0000", 2024-04-19T03:03:08.213 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:08.213 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.213 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.213 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:08.213 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635187+0000", 2024-04-19T03:03:08.214 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:08.214 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.214 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.214 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:08.214 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635242+0000", 2024-04-19T03:03:08.214 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5158000000000003e-05 2024-04-19T03:03:08.214 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.214 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.214 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:08.214 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635249+0000", 2024-04-19T03:03:08.214 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.7000000000000008e-06 2024-04-19T03:03:08.214 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.214 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.214 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:08.214 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635256+0000", 2024-04-19T03:03:08.215 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2060000000000004e-06 2024-04-19T03:03:08.215 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.215 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.215 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:08.215 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635302+0000", 2024-04-19T03:03:08.215 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5954000000000001e-05 2024-04-19T03:03:08.215 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.215 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.215 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:08.215 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635427+0000", 2024-04-19T03:03:08.215 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012559299999999999 2024-04-19T03:03:08.215 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.215 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.215 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:08.216 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635596+0000", 2024-04-19T03:03:08.216 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000168615 2024-04-19T03:03:08.216 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.216 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.216 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:08.216 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.639320+0000", 2024-04-19T03:03:08.216 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0037244610000000001 2024-04-19T03:03:08.216 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.216 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.216 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:08.216 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.829277+0000", 2024-04-19T03:03:08.216 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.18995651099999999 2024-04-19T03:03:08.216 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.216 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.216 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:03:08.217 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.829341+0000", 2024-04-19T03:03:08.217 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3756000000000004e-05 2024-04-19T03:03:08.217 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.217 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.217 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:08.217 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.829392+0000", 2024-04-19T03:03:08.217 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1555999999999999e-05 2024-04-19T03:03:08.217 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:08.217 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:08.217 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:08.217 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.217 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.217 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87067 5.b 5:d57af71a:::benchmark_data_smithi096_19531_object87066:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:08.217 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.142233+0000", 2024-04-19T03:03:08.218 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 45.044757341, 2024-04-19T03:03:08.218 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.071692405000000001, 2024-04-19T03:03:08.218 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:08.218 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:08.218 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:08.218 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:08.218 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:08.218 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87067 2024-04-19T03:03:08.218 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.218 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:08.218 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.218 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:08.218 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142233+0000", 2024-04-19T03:03:08.218 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:08.218 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.219 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.219 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:08.219 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142233+0000", 2024-04-19T03:03:08.219 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:08.219 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.219 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.219 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:08.219 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142232+0000", 2024-04-19T03:03:08.219 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:03:08.219 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.219 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.219 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:08.219 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142277+0000", 2024-04-19T03:03:08.219 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5837000000000002e-05 2024-04-19T03:03:08.219 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.220 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.220 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:08.220 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142297+0000", 2024-04-19T03:03:08.220 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9561000000000001e-05 2024-04-19T03:03:08.220 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.220 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.220 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:08.220 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142311+0000", 2024-04-19T03:03:08.220 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3654e-05 2024-04-19T03:03:08.220 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.220 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.220 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:08.220 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142391+0000", 2024-04-19T03:03:08.220 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0123999999999994e-05 2024-04-19T03:03:08.221 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.221 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.221 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:08.221 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142669+0000", 2024-04-19T03:03:08.221 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00027829800000000001 2024-04-19T03:03:08.221 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.221 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.221 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:08.221 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142859+0000", 2024-04-19T03:03:08.221 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000190051 2024-04-19T03:03:08.221 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.221 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.221 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:08.221 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.150597+0000", 2024-04-19T03:03:08.221 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0077380299999999999 2024-04-19T03:03:08.222 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.222 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.222 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:08.222 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.213855+0000", 2024-04-19T03:03:08.222 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.063257987000000002 2024-04-19T03:03:08.222 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.222 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.222 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:03:08.222 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.213898+0000", 2024-04-19T03:03:08.222 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2916e-05 2024-04-19T03:03:08.222 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.222 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.222 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:08.222 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.213925+0000", 2024-04-19T03:03:08.223 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7503000000000001e-05 2024-04-19T03:03:08.223 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:08.223 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:08.223 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:08.223 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.223 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.223 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87069 5.b 5:da0c93b5:::benchmark_data_smithi096_19531_object87068:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:08.223 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.143402+0000", 2024-04-19T03:03:08.223 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 45.043588378999999, 2024-04-19T03:03:08.223 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.070678598999999995, 2024-04-19T03:03:08.223 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:08.223 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:08.223 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:08.223 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:08.223 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:08.224 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87069 2024-04-19T03:03:08.224 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.224 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:08.224 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.224 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:08.224 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.143402+0000", 2024-04-19T03:03:08.224 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:08.224 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.224 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.224 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:08.224 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.143402+0000", 2024-04-19T03:03:08.224 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:08.224 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.224 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.224 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:08.225 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.143401+0000", 2024-04-19T03:03:08.225 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:03:08.225 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.225 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.225 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:08.225 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.143501+0000", 2024-04-19T03:03:08.225 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000100387 2024-04-19T03:03:08.225 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.225 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.225 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:08.225 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.143516+0000", 2024-04-19T03:03:08.225 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5369000000000001e-05 2024-04-19T03:03:08.225 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.225 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.226 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:08.226 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.143524+0000", 2024-04-19T03:03:08.226 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.7079999999999997e-06 2024-04-19T03:03:08.226 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.226 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.226 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:08.226 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.145550+0000", 2024-04-19T03:03:08.226 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0020259290000000001 2024-04-19T03:03:08.226 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.226 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.226 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:08.226 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.145676+0000", 2024-04-19T03:03:08.226 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000126406 2024-04-19T03:03:08.226 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.226 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.227 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:08.227 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.145802+0000", 2024-04-19T03:03:08.227 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000125974 2024-04-19T03:03:08.227 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.227 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.227 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:08.227 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.151030+0000", 2024-04-19T03:03:08.227 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0052276079999999999 2024-04-19T03:03:08.227 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.227 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.227 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:08.227 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.213998+0000", 2024-04-19T03:03:08.227 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.06296786 2024-04-19T03:03:08.227 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.227 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.228 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:03:08.228 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.214031+0000", 2024-04-19T03:03:08.228 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3387999999999999e-05 2024-04-19T03:03:08.228 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.228 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.228 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:08.228 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.214081+0000", 2024-04-19T03:03:08.228 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9316e-05 2024-04-19T03:03:08.228 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:08.228 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:08.228 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:08.228 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.228 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.228 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87108 5.e 5:7e197adc:::benchmark_data_smithi096_19531_object87107:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:08.229 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.223103+0000", 2024-04-19T03:03:08.229 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 44.963887042000003, 2024-04-19T03:03:08.229 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.044946887, 2024-04-19T03:03:08.229 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:08.229 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-19T03:03:08.229 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:08.229 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:08.229 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:08.229 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87108 2024-04-19T03:03:08.229 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.229 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:08.229 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.229 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:08.229 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.223103+0000", 2024-04-19T03:03:08.229 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:08.230 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.230 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.230 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:08.230 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.223103+0000", 2024-04-19T03:03:08.230 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:08.230 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.230 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.230 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:08.230 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.223102+0000", 2024-04-19T03:03:08.230 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:03:08.230 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.230 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.230 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:08.230 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.223156+0000", 2024-04-19T03:03:08.231 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3958000000000001e-05 2024-04-19T03:03:08.231 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.231 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.231 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:08.231 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.223166+0000", 2024-04-19T03:03:08.231 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.4809999999999995e-06 2024-04-19T03:03:08.231 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.231 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.231 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:08.231 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.223172+0000", 2024-04-19T03:03:08.231 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0140000000000004e-06 2024-04-19T03:03:08.231 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.231 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.231 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:08.232 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.227295+0000", 2024-04-19T03:03:08.232 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0041233420000000003 2024-04-19T03:03:08.232 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.232 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.232 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:08.232 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.227495+0000", 2024-04-19T03:03:08.232 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00019955299999999999 2024-04-19T03:03:08.232 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.232 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.232 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:08.232 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.227717+0000", 2024-04-19T03:03:08.232 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000221902 2024-04-19T03:03:08.232 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.232 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.232 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:08.233 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233189+0000", 2024-04-19T03:03:08.233 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0054718889999999997 2024-04-19T03:03:08.233 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.233 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.233 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:08.233 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.250529+0000", 2024-04-19T03:03:08.233 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.017340298000000001 2024-04-19T03:03:08.233 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.233 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.233 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:03:08.233 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.250539+0000", 2024-04-19T03:03:08.233 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0501e-05 2024-04-19T03:03:08.233 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.233 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.234 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:08.234 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.268003+0000", 2024-04-19T03:03:08.234 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.017463429 2024-04-19T03:03:08.234 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.234 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.234 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:08.234 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.268050+0000", 2024-04-19T03:03:08.234 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7466000000000003e-05 2024-04-19T03:03:08.234 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:08.234 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:08.234 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:08.234 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.234 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.235 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87118 5.b 5:d1bb4f3c:::benchmark_data_smithi096_19531_object87117:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:08.235 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.231082+0000", 2024-04-19T03:03:08.235 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 44.955908207999997, 2024-04-19T03:03:08.235 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.035789004, 2024-04-19T03:03:08.235 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:08.235 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-19T03:03:08.235 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:08.235 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:08.235 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:08.235 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87118 2024-04-19T03:03:08.235 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.235 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:08.235 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.235 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:08.236 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231082+0000", 2024-04-19T03:03:08.236 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:08.236 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.236 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.236 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:08.236 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231082+0000", 2024-04-19T03:03:08.236 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:08.236 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.236 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.236 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:08.236 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231081+0000", 2024-04-19T03:03:08.236 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:03:08.236 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.237 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.237 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:08.237 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231159+0000", 2024-04-19T03:03:08.237 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.7819999999999997e-05 2024-04-19T03:03:08.237 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.237 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.237 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:08.237 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231186+0000", 2024-04-19T03:03:08.237 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7126000000000001e-05 2024-04-19T03:03:08.237 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.237 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.237 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:08.237 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231193+0000", 2024-04-19T03:03:08.237 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7259999999999996e-06 2024-04-19T03:03:08.238 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.238 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.238 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:08.238 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231241+0000", 2024-04-19T03:03:08.238 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8123e-05 2024-04-19T03:03:08.238 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.238 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.238 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:08.238 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231354+0000", 2024-04-19T03:03:08.238 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0001133 2024-04-19T03:03:08.238 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.238 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.239 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:08.239 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231443+0000", 2024-04-19T03:03:08.239 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9167999999999997e-05 2024-04-19T03:03:08.239 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.239 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.239 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:08.239 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236498+0000", 2024-04-19T03:03:08.239 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0050545160000000002 2024-04-19T03:03:08.239 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.239 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.239 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:08.239 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.249681+0000", 2024-04-19T03:03:08.239 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013183321 2024-04-19T03:03:08.239 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.240 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.240 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:03:08.240 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.249693+0000", 2024-04-19T03:03:08.240 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1834999999999999e-05 2024-04-19T03:03:08.240 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.240 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.240 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:08.240 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266733+0000", 2024-04-19T03:03:08.240 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.017040408 2024-04-19T03:03:08.240 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.240 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.240 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:08.240 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266871+0000", 2024-04-19T03:03:08.240 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000137849 2024-04-19T03:03:08.241 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:08.241 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:08.241 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:08.241 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.241 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.241 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87121 5.b 5:d01822b8:::benchmark_data_smithi096_19531_object87120:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:08.241 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.233319+0000", 2024-04-19T03:03:08.241 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 44.953671344, 2024-04-19T03:03:08.241 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.033624198, 2024-04-19T03:03:08.241 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:08.241 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-19T03:03:08.241 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:08.241 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:08.241 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:08.242 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87121 2024-04-19T03:03:08.242 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.242 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:08.242 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.242 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:08.242 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233319+0000", 2024-04-19T03:03:08.242 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:08.242 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.242 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.242 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:08.242 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233319+0000", 2024-04-19T03:03:08.242 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:08.242 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.242 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.243 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:08.243 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233319+0000", 2024-04-19T03:03:08.243 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:08.243 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.243 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.243 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:08.243 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233364+0000", 2024-04-19T03:03:08.243 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5460999999999997e-05 2024-04-19T03:03:08.243 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.243 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.243 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:08.243 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233382+0000", 2024-04-19T03:03:08.243 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8148e-05 2024-04-19T03:03:08.244 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.244 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.244 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:08.244 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233390+0000", 2024-04-19T03:03:08.244 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5340000000000002e-06 2024-04-19T03:03:08.244 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.244 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.244 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:08.244 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233712+0000", 2024-04-19T03:03:08.244 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00032260500000000001 2024-04-19T03:03:08.244 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.244 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.244 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:08.244 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233829+0000", 2024-04-19T03:03:08.244 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011638599999999999 2024-04-19T03:03:08.245 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.245 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.245 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:08.245 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233959+0000", 2024-04-19T03:03:08.245 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013013900000000001 2024-04-19T03:03:08.245 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.245 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.245 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:08.245 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236515+0000", 2024-04-19T03:03:08.245 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0025562750000000002 2024-04-19T03:03:08.245 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.245 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.245 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:08.245 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.249723+0000", 2024-04-19T03:03:08.246 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013208176 2024-04-19T03:03:08.246 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.246 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.246 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:03:08.246 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.249728+0000", 2024-04-19T03:03:08.246 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6519999999999997e-06 2024-04-19T03:03:08.246 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.246 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.246 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:08.246 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266837+0000", 2024-04-19T03:03:08.246 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0171087059999999 2024-04-19T03:03:08.246 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.246 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.246 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:08.247 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266943+0000", 2024-04-19T03:03:08.247 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000106604 2024-04-19T03:03:08.247 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:08.247 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:08.247 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:08.247 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.247 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.247 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87124 5.8 5:14819ad7:::benchmark_data_smithi096_19531_object87123:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:08.247 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.235886+0000", 2024-04-19T03:03:08.247 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 44.951103920000001, 2024-04-19T03:03:08.247 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0315451179999999, 2024-04-19T03:03:08.247 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:08.247 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-19T03:03:08.247 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:08.248 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:08.248 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:08.248 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87124 2024-04-19T03:03:08.248 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.248 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:08.248 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.248 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:08.248 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.235886+0000", 2024-04-19T03:03:08.248 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:08.248 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.248 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.248 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:08.248 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.235886+0000", 2024-04-19T03:03:08.248 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:08.248 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.249 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.249 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:08.249 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.235886+0000", 2024-04-19T03:03:08.249 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:03:08.249 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.249 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.249 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:08.249 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.235934+0000", 2024-04-19T03:03:08.249 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8384000000000003e-05 2024-04-19T03:03:08.249 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.249 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.249 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:08.249 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.235945+0000", 2024-04-19T03:03:08.249 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0671e-05 2024-04-19T03:03:08.249 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.250 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.250 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:08.250 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.235952+0000", 2024-04-19T03:03:08.250 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3089999999999998e-06 2024-04-19T03:03:08.250 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.250 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.250 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:08.250 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.237067+0000", 2024-04-19T03:03:08.250 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001115263 2024-04-19T03:03:08.250 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.250 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.250 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:08.250 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.237188+0000", 2024-04-19T03:03:08.250 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000121258 2024-04-19T03:03:08.251 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.251 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.251 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:08.251 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.237316+0000", 2024-04-19T03:03:08.251 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000128071 2024-04-19T03:03:08.251 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.251 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.251 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:08.251 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240744+0000", 2024-04-19T03:03:08.251 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0034275629999999998 2024-04-19T03:03:08.251 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.251 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.251 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:08.251 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.252517+0000", 2024-04-19T03:03:08.252 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011772991999999999 2024-04-19T03:03:08.252 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.252 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.252 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:03:08.252 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.252523+0000", 2024-04-19T03:03:08.252 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3640000000000004e-06 2024-04-19T03:03:08.252 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.252 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.252 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:08.252 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.267290+0000", 2024-04-19T03:03:08.252 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0147665690000001 2024-04-19T03:03:08.252 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.252 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.252 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:08.252 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.267432+0000", 2024-04-19T03:03:08.253 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014165299999999999 2024-04-19T03:03:08.253 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:08.253 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:08.253 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:08.253 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.253 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.253 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87129 5.0 5:02667e01:::benchmark_data_smithi096_19531_object87128:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:08.253 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.236466+0000", 2024-04-19T03:03:08.253 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 44.950523924000002, 2024-04-19T03:03:08.253 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0301534510000001, 2024-04-19T03:03:08.253 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:08.253 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-19T03:03:08.253 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:08.253 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:08.254 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:08.254 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87129 2024-04-19T03:03:08.254 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.254 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:08.254 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.254 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:08.254 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236466+0000", 2024-04-19T03:03:08.254 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:08.254 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.254 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.254 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:08.254 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236466+0000", 2024-04-19T03:03:08.254 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:08.254 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.254 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.255 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:08.255 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236465+0000", 2024-04-19T03:03:08.255 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:03:08.255 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.255 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.255 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:08.255 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236566+0000", 2024-04-19T03:03:08.255 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010047000000000001 2024-04-19T03:03:08.255 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.255 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.255 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:08.255 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236577+0000", 2024-04-19T03:03:08.255 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1772e-05 2024-04-19T03:03:08.255 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.256 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.256 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:08.256 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236584+0000", 2024-04-19T03:03:08.256 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0530000000000003e-06 2024-04-19T03:03:08.256 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.256 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.256 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:08.256 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.237023+0000", 2024-04-19T03:03:08.256 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000439703 2024-04-19T03:03:08.256 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.256 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.256 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:08.256 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.237207+0000", 2024-04-19T03:03:08.256 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000183692 2024-04-19T03:03:08.256 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.257 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.257 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:08.257 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.237373+0000", 2024-04-19T03:03:08.257 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016623500000000001 2024-04-19T03:03:08.257 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.257 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.257 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:08.257 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.241461+0000", 2024-04-19T03:03:08.257 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0040883050000000004 2024-04-19T03:03:08.257 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.257 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.257 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:08.257 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.252500+0000", 2024-04-19T03:03:08.257 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011038450999999999 2024-04-19T03:03:08.258 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.258 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.258 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:03:08.258 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.252507+0000", 2024-04-19T03:03:08.258 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2439999999999996e-06 2024-04-19T03:03:08.258 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.258 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.258 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:08.258 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266538+0000", 2024-04-19T03:03:08.258 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.014031184 2024-04-19T03:03:08.258 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.258 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.258 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:08.258 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266620+0000", 2024-04-19T03:03:08.259 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1600000000000005e-05 2024-04-19T03:03:08.259 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:08.259 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:08.259 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:08.259 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.259 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.259 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87135 5.4 5:2a97e7b7:::benchmark_data_smithi096_19531_object87134:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:08.259 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.240884+0000", 2024-04-19T03:03:08.259 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 44.946106467, 2024-04-19T03:03:08.259 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.025708931, 2024-04-19T03:03:08.259 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:08.259 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-19T03:03:08.259 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:08.259 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:08.259 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:08.260 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87135 2024-04-19T03:03:08.260 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.260 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:08.260 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.260 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:08.260 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240884+0000", 2024-04-19T03:03:08.260 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:08.260 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.260 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.260 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:08.260 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240884+0000", 2024-04-19T03:03:08.260 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:08.260 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.260 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.260 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:08.261 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240883+0000", 2024-04-19T03:03:08.261 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:03:08.261 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.261 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.261 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:08.261 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240933+0000", 2024-04-19T03:03:08.261 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9969999999999998e-05 2024-04-19T03:03:08.261 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.261 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.261 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:08.261 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240946+0000", 2024-04-19T03:03:08.261 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2943e-05 2024-04-19T03:03:08.261 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.261 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.262 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:08.262 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240952+0000", 2024-04-19T03:03:08.262 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8930000000000002e-06 2024-04-19T03:03:08.262 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.262 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.262 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:08.262 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240994+0000", 2024-04-19T03:03:08.262 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2753999999999998e-05 2024-04-19T03:03:08.262 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.262 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.262 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:08.262 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.241092+0000", 2024-04-19T03:03:08.262 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.7447000000000004e-05 2024-04-19T03:03:08.262 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.263 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.263 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:08.263 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.241183+0000", 2024-04-19T03:03:08.263 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1163999999999997e-05 2024-04-19T03:03:08.263 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.263 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.263 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:08.263 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.254672+0000", 2024-04-19T03:03:08.263 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.01348864 2024-04-19T03:03:08.263 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.263 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.263 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:03:08.263 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.254681+0000", 2024-04-19T03:03:08.263 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.3789999999999995e-06 2024-04-19T03:03:08.264 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.264 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.264 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:08.264 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266456+0000", 2024-04-19T03:03:08.264 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.011774621 2024-04-19T03:03:08.264 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.264 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.264 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:08.264 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266593+0000", 2024-04-19T03:03:08.264 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013737600000000001 2024-04-19T03:03:08.264 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:08.264 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:08.264 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:08.264 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.265 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.265 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87136 5.4 5:212411bc:::benchmark_data_smithi096_19531_object87135:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:08.265 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.240962+0000", 2024-04-19T03:03:08.265 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 44.946028591000001, 2024-04-19T03:03:08.265 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.025738, 2024-04-19T03:03:08.265 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:08.265 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-19T03:03:08.265 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:08.265 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:08.265 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:08.265 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87136 2024-04-19T03:03:08.265 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.266 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:08.266 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.266 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:08.266 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240962+0000", 2024-04-19T03:03:08.266 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:08.266 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.266 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.266 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:08.266 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240962+0000", 2024-04-19T03:03:08.267 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:08.267 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.267 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.267 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:08.267 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240961+0000", 2024-04-19T03:03:08.267 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:08.267 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.267 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.267 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:08.267 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240995+0000", 2024-04-19T03:03:08.267 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3868000000000002e-05 2024-04-19T03:03:08.267 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.267 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.267 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:08.267 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.241001+0000", 2024-04-19T03:03:08.268 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.322e-06 2024-04-19T03:03:08.268 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.268 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.268 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:08.268 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.241004+0000", 2024-04-19T03:03:08.268 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3510000000000002e-06 2024-04-19T03:03:08.268 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.268 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.268 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:08.268 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247131+0000", 2024-04-19T03:03:08.268 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0061270869999999998 2024-04-19T03:03:08.268 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.268 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.268 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:08.268 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247322+0000", 2024-04-19T03:03:08.269 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000191015 2024-04-19T03:03:08.269 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.269 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.269 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:08.269 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247542+0000", 2024-04-19T03:03:08.269 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00022030199999999999 2024-04-19T03:03:08.269 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.269 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.269 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:08.269 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.254709+0000", 2024-04-19T03:03:08.269 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0071662660000000001 2024-04-19T03:03:08.269 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.269 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.269 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:03:08.270 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.254716+0000", 2024-04-19T03:03:08.270 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3860000000000001e-06 2024-04-19T03:03:08.270 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.270 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.270 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:08.270 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266619+0000", 2024-04-19T03:03:08.270 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0119031030000001 2024-04-19T03:03:08.270 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.270 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.270 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:08.270 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266700+0000", 2024-04-19T03:03:08.270 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0764000000000001e-05 2024-04-19T03:03:08.270 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:08.270 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:08.271 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:08.271 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.271 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.271 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87138 5.e 5:7b1f1c20:::benchmark_data_smithi096_19531_object87137:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:08.271 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.247862+0000", 2024-04-19T03:03:08.271 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 44.939128517, 2024-04-19T03:03:08.271 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.024457079, 2024-04-19T03:03:08.271 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:08.271 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:08.271 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:08.271 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:08.271 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:08.271 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87138 2024-04-19T03:03:08.271 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.272 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:08.272 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.272 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:08.272 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247862+0000", 2024-04-19T03:03:08.272 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:08.272 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.272 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.272 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:08.272 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247862+0000", 2024-04-19T03:03:08.272 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:08.272 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.272 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.272 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:08.272 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247860+0000", 2024-04-19T03:03:08.273 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999981 2024-04-19T03:03:08.273 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.273 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.273 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:08.273 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247909+0000", 2024-04-19T03:03:08.273 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9150999999999997e-05 2024-04-19T03:03:08.273 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.273 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.273 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:08.273 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247925+0000", 2024-04-19T03:03:08.273 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5761999999999999e-05 2024-04-19T03:03:08.273 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.273 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.273 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:08.273 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247936+0000", 2024-04-19T03:03:08.274 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1144e-05 2024-04-19T03:03:08.274 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.274 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.274 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:08.274 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.250590+0000", 2024-04-19T03:03:08.274 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.002653678 2024-04-19T03:03:08.274 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.274 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.274 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:03:08.274 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.250599+0000", 2024-04-19T03:03:08.274 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9039999999999998e-06 2024-04-19T03:03:08.274 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.274 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.274 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:08.275 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.268151+0000", 2024-04-19T03:03:08.275 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0175523449999999 2024-04-19T03:03:08.275 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.275 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.275 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:08.275 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.268285+0000", 2024-04-19T03:03:08.275 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013415599999999999 2024-04-19T03:03:08.275 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.275 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.275 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:08.275 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.272238+0000", 2024-04-19T03:03:08.275 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0039533019999999997 2024-04-19T03:03:08.275 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.275 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.275 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:03:08.276 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.272274+0000", 2024-04-19T03:03:08.276 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5352000000000003e-05 2024-04-19T03:03:08.276 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.276 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.276 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:08.276 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.272319+0000", 2024-04-19T03:03:08.276 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5281999999999998e-05 2024-04-19T03:03:08.276 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:08.276 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:08.276 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:08.276 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.276 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.276 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:158371 5.8 5:11a83024:::benchmark_data_smithi096_19531_object44921:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-19T03:03:08.276 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:58.125869+0000", 2024-04-19T03:03:08.277 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 10.061121652000001, 2024-04-19T03:03:08.277 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074532857999999994, 2024-04-19T03:03:08.277 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:08.277 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:08.277 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:08.277 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:08.277 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:08.277 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 158371 2024-04-19T03:03:08.277 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.277 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:08.277 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.277 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:08.277 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125869+0000", 2024-04-19T03:03:08.277 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:08.277 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.278 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.278 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:08.278 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125869+0000", 2024-04-19T03:03:08.278 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:08.278 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.278 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.278 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:08.278 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125868+0000", 2024-04-19T03:03:08.278 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:03:08.278 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.278 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.278 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:08.278 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125874+0000", 2024-04-19T03:03:08.278 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7120000000000003e-06 2024-04-19T03:03:08.279 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.279 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.279 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:08.279 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125885+0000", 2024-04-19T03:03:08.279 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0665999999999999e-05 2024-04-19T03:03:08.279 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.279 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.279 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:08.279 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125901+0000", 2024-04-19T03:03:08.279 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6463000000000001e-05 2024-04-19T03:03:08.279 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.279 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.279 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:08.279 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125956+0000", 2024-04-19T03:03:08.279 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4728000000000002e-05 2024-04-19T03:03:08.280 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.280 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.280 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:08.280 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.126050+0000", 2024-04-19T03:03:08.280 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.3534000000000003e-05 2024-04-19T03:03:08.280 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.280 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.280 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:08.280 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.200187+0000", 2024-04-19T03:03:08.280 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074136933000000002 2024-04-19T03:03:08.280 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.280 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.280 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:03:08.280 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.200260+0000", 2024-04-19T03:03:08.280 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3090999999999995e-05 2024-04-19T03:03:08.281 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.281 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.281 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:08.281 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.200402+0000", 2024-04-19T03:03:08.281 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014193699999999999 2024-04-19T03:03:08.281 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:08.281 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:08.281 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:08.281 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.281 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.281 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:158372 5.0 5:0473aa5f:::benchmark_data_smithi096_19531_object44922:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-19T03:03:08.281 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:58.125924+0000", 2024-04-19T03:03:08.281 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 10.061066045, 2024-04-19T03:03:08.281 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074247490999999999, 2024-04-19T03:03:08.281 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:08.282 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:08.282 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:08.282 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:08.282 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:08.282 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 158372 2024-04-19T03:03:08.282 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.282 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:08.282 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.282 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:08.282 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125924+0000", 2024-04-19T03:03:08.282 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:08.282 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.282 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.282 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:08.282 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125924+0000", 2024-04-19T03:03:08.283 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:08.283 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.283 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.283 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:08.283 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125924+0000", 2024-04-19T03:03:08.283 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:08.283 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.283 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.283 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:08.283 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125927+0000", 2024-04-19T03:03:08.283 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5389999999999999e-06 2024-04-19T03:03:08.283 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.283 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.283 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:08.284 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125935+0000", 2024-04-19T03:03:08.284 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3259999999999998e-06 2024-04-19T03:03:08.284 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.284 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.284 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:08.284 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125940+0000", 2024-04-19T03:03:08.284 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6980000000000003e-06 2024-04-19T03:03:08.284 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.284 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.284 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:08.284 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125982+0000", 2024-04-19T03:03:08.284 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1337000000000001e-05 2024-04-19T03:03:08.284 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.284 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.284 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:08.285 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.126075+0000", 2024-04-19T03:03:08.285 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.3579999999999995e-05 2024-04-19T03:03:08.285 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.285 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.285 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:08.285 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.199953+0000", 2024-04-19T03:03:08.285 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073877604999999999 2024-04-19T03:03:08.285 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.285 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.285 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:03:08.285 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.200022+0000", 2024-04-19T03:03:08.285 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.8824000000000004e-05 2024-04-19T03:03:08.285 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.285 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.286 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:08.286 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.200172+0000", 2024-04-19T03:03:08.286 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015017700000000001 2024-04-19T03:03:08.286 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:08.286 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:08.286 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:08.286 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.286 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.286 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:158374 5.e 5:76be57a5:::benchmark_data_smithi096_19531_object44924:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-19T03:03:08.286 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:58.125988+0000", 2024-04-19T03:03:08.286 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 10.061002545999999, 2024-04-19T03:03:08.286 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.067843332000000006, 2024-04-19T03:03:08.286 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:08.286 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:08.287 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:08.287 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:08.287 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:08.287 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 158374 2024-04-19T03:03:08.287 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.287 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:08.287 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.287 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:08.287 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125988+0000", 2024-04-19T03:03:08.287 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:08.287 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.287 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.287 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:08.287 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125988+0000", 2024-04-19T03:03:08.288 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:08.288 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.288 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.288 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:08.288 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125987+0000", 2024-04-19T03:03:08.288 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:08.288 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.288 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.288 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:08.288 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125990+0000", 2024-04-19T03:03:08.288 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7989999999999998e-06 2024-04-19T03:03:08.288 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.288 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.288 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:08.288 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125996+0000", 2024-04-19T03:03:08.289 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.302e-06 2024-04-19T03:03:08.289 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.289 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.289 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:08.289 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.126001+0000", 2024-04-19T03:03:08.289 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.843e-06 2024-04-19T03:03:08.289 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.289 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.289 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:08.289 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.126047+0000", 2024-04-19T03:03:08.289 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6066000000000002e-05 2024-04-19T03:03:08.289 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.289 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.289 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:08.290 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.126171+0000", 2024-04-19T03:03:08.290 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012359099999999999 2024-04-19T03:03:08.290 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.290 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.290 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:08.290 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.193709+0000", 2024-04-19T03:03:08.290 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.067538099000000004 2024-04-19T03:03:08.290 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.290 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.290 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:03:08.290 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.193766+0000", 2024-04-19T03:03:08.290 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6869e-05 2024-04-19T03:03:08.290 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.290 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.291 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:08.291 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.193831+0000", 2024-04-19T03:03:08.291 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5273999999999999e-05 2024-04-19T03:03:08.291 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:08.291 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:08.291 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:08.291 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.291 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.291 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4755.0:158376 5.9 e56/22 5:9e73c076:::benchmark_data_smithi096_19531_object44926:head v 56'9663, mlcod=56'9661)", 2024-04-19T03:03:08.291 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:58.127307+0000", 2024-04-19T03:03:08.291 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 10.059683314999999, 2024-04-19T03:03:08.291 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069002716000000006, 2024-04-19T03:03:08.291 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:08.291 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:08.291 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:08.292 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.292 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:08.292 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.127307+0000", 2024-04-19T03:03:08.292 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:08.292 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.292 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.292 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:08.292 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.127307+0000", 2024-04-19T03:03:08.292 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:08.292 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.292 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.292 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:08.292 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.127306+0000", 2024-04-19T03:03:08.292 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:03:08.293 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.293 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.293 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:08.293 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.127316+0000", 2024-04-19T03:03:08.293 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.3039999999999994e-06 2024-04-19T03:03:08.293 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.293 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.293 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:08.293 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.127326+0000", 2024-04-19T03:03:08.293 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0009e-05 2024-04-19T03:03:08.293 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.293 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.293 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:08.293 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.127332+0000", 2024-04-19T03:03:08.293 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5880000000000003e-06 2024-04-19T03:03:08.294 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.294 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.294 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:08.294 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.127383+0000", 2024-04-19T03:03:08.294 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0516000000000002e-05 2024-04-19T03:03:08.294 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.294 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.294 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:08.294 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.127403+0000", 2024-04-19T03:03:08.294 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0547000000000002e-05 2024-04-19T03:03:08.294 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.294 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.294 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:03:08.294 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.196280+0000", 2024-04-19T03:03:08.295 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.068876863999999996 2024-04-19T03:03:08.295 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.295 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.295 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:08.295 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.196310+0000", 2024-04-19T03:03:08.295 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9762999999999999e-05 2024-04-19T03:03:08.295 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:08.295 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:08.295 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:08.295 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.295 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.295 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:158383 5.0 5:026717eb:::benchmark_data_smithi096_19531_object44933:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-19T03:03:08.295 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:58.130494+0000", 2024-04-19T03:03:08.295 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 10.056496189000001, 2024-04-19T03:03:08.296 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.070135775999999997, 2024-04-19T03:03:08.296 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:08.296 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:08.296 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:08.296 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:08.296 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:08.296 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 158383 2024-04-19T03:03:08.296 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.296 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:08.296 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.296 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:08.296 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.130494+0000", 2024-04-19T03:03:08.296 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:08.296 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.296 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.297 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:08.297 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.130494+0000", 2024-04-19T03:03:08.297 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:08.297 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.297 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.297 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:08.297 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.130493+0000", 2024-04-19T03:03:08.297 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:03:08.297 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.297 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.297 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:08.297 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.130500+0000", 2024-04-19T03:03:08.297 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5490000000000003e-06 2024-04-19T03:03:08.297 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.298 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.298 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:08.298 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.190401+0000", 2024-04-19T03:03:08.298 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.059901668999999998 2024-04-19T03:03:08.298 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.298 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.298 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:08.298 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.190421+0000", 2024-04-19T03:03:08.298 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0288e-05 2024-04-19T03:03:08.298 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.298 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.298 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:08.298 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.190536+0000", 2024-04-19T03:03:08.298 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000114783 2024-04-19T03:03:08.298 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.299 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.299 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:08.299 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.190904+0000", 2024-04-19T03:03:08.299 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00036773900000000001 2024-04-19T03:03:08.299 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.299 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.299 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:08.299 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.200417+0000", 2024-04-19T03:03:08.299 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0095128899999999995 2024-04-19T03:03:08.299 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.299 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.299 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:03:08.299 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.200489+0000", 2024-04-19T03:03:08.299 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2554999999999999e-05 2024-04-19T03:03:08.299 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:08.300 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:08.300 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:08.300 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.200630+0000", 2024-04-19T03:03:08.300 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014055299999999999 2024-04-19T03:03:08.300 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:08.300 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:08.300 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:08.300 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:08.300 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:08.300 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-19T03:03:08.302 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T03:03:08.302 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:03:08.298+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:03:08.302 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-19T03:03:08.402 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:03:08.400+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:03:08.431 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-04-19T03:03:08.431 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [ 2024-04-19T03:03:08.432 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:08.432 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:183681 5.9 5:968b56aa:::benchmark_data_smithi096_19531_object70231:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-19T03:03:08.432 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:03:08.421123+0000", 2024-04-19T03:03:08.432 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0092341530000000002, 2024-04-19T03:03:08.432 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0092506629999999992, 2024-04-19T03:03:08.432 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:08.432 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:03:08.432 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:08.432 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:08.432 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:08.432 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 183681 2024-04-19T03:03:08.432 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:08.432 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:08.433 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:08.433 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:08.433 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:08.421123+0000", 2024-04-19T03:03:08.433 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:08.433 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:08.433 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:08.433 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:08.433 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:08.421123+0000", 2024-04-19T03:03:08.433 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:08.433 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:08.433 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:08.433 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:08.433 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:08.421122+0000", 2024-04-19T03:03:08.433 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:03:08.434 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:08.434 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:08.434 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:08.434 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:08.421127+0000", 2024-04-19T03:03:08.434 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1220000000000003e-06 2024-04-19T03:03:08.434 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:08.434 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:08.434 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:08.434 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:08.421136+0000", 2024-04-19T03:03:08.434 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4849999999999992e-06 2024-04-19T03:03:08.434 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:08.434 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:08.434 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:08.434 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:08.421143+0000", 2024-04-19T03:03:08.435 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5020000000000003e-06 2024-04-19T03:03:08.435 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:08.435 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:08.435 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:08.435 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:08.425041+0000", 2024-04-19T03:03:08.435 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0038974629999999999 2024-04-19T03:03:08.435 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:08.435 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:08.435 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:08.435 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:08.425176+0000", 2024-04-19T03:03:08.435 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000134592 2024-04-19T03:03:08.435 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:08.435 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:08.435 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:03:08.436 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:08.425276+0000", 2024-04-19T03:03:08.436 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000100781 2024-04-19T03:03:08.436 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:08.436 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:08.436 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:08.436 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:08.428597+0000", 2024-04-19T03:03:08.436 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.003320295 2024-04-19T03:03:08.436 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:08.436 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:08.436 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:08.436 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:08.436 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:08.436 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:183684 5.1 5:8897420e:::benchmark_data_smithi096_19531_object70234:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-19T03:03:08.436 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:03:08.421276+0000", 2024-04-19T03:03:08.437 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0090811699999999995, 2024-04-19T03:03:08.437 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0091680860000000006, 2024-04-19T03:03:08.437 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:08.437 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-04-19T03:03:08.437 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:08.437 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:08.437 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:08.437 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 183684 2024-04-19T03:03:08.437 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:08.437 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:08.437 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:08.438 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:08.438 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:08.421276+0000", 2024-04-19T03:03:08.438 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:08.438 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:08.438 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:08.438 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:08.438 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:08.421276+0000", 2024-04-19T03:03:08.438 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:08.438 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:08.438 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:08.438 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:08.438 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:08.421276+0000", 2024-04-19T03:03:08.438 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:08.439 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:08.439 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:08.439 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:08.439 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:08.421279+0000", 2024-04-19T03:03:08.439 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.694e-06 2024-04-19T03:03:08.439 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:08.439 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:08.439 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:08.439 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:08.421285+0000", 2024-04-19T03:03:08.439 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2910000000000004e-06 2024-04-19T03:03:08.439 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:08.439 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:08.439 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:08.439 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:08.421290+0000", 2024-04-19T03:03:08.440 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4539999999999998e-06 2024-04-19T03:03:08.440 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:08.440 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:08.440 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:08.440 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:08.426791+0000", 2024-04-19T03:03:08.440 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0055002740000000003 2024-04-19T03:03:08.440 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:08.440 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:08.440 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:08.440 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:08.426873+0000", 2024-04-19T03:03:08.440 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.1855999999999997e-05 2024-04-19T03:03:08.440 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:08.440 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:08.440 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:08.440 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:08.441 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:08.441 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:183687 5.7 5:e8ffccd9:::benchmark_data_smithi096_19531_object70237:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-19T03:03:08.441 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:03:08.424103+0000", 2024-04-19T03:03:08.441 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.006254679, 2024-04-19T03:03:08.441 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0064061789999999997, 2024-04-19T03:03:08.441 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:08.441 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-04-19T03:03:08.441 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:08.441 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:08.441 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:08.441 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 183687 2024-04-19T03:03:08.441 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:08.441 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:08.441 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:08.442 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:08.442 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:08.424103+0000", 2024-04-19T03:03:08.442 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:08.442 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:08.442 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:08.442 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:08.442 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:08.424103+0000", 2024-04-19T03:03:08.442 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:08.442 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:08.442 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:08.442 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:08.442 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:08.424102+0000", 2024-04-19T03:03:08.442 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999986 2024-04-19T03:03:08.443 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:08.443 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:08.443 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:08.443 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:08.424108+0000", 2024-04-19T03:03:08.443 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6590000000000001e-06 2024-04-19T03:03:08.443 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:08.443 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:08.443 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:08.443 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:08.424124+0000", 2024-04-19T03:03:08.443 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.5752000000000001e-05 2024-04-19T03:03:08.443 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:08.443 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:08.443 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:08.443 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:08.424132+0000", 2024-04-19T03:03:08.443 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7079999999999997e-06 2024-04-19T03:03:08.444 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:08.444 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:08.444 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:08.444 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:08.424166+0000", 2024-04-19T03:03:08.444 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4743999999999998e-05 2024-04-19T03:03:08.444 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:08.444 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:08.444 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:08.444 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:08.424247+0000", 2024-04-19T03:03:08.444 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0947999999999998e-05 2024-04-19T03:03:08.444 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:08.444 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:08.444 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:08.444 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:08.445 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:08.445 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:183688 5.1 5:8cfb7fab:::benchmark_data_smithi096_19531_object70238:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-19T03:03:08.445 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:03:08.425738+0000", 2024-04-19T03:03:08.445 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0046196099999999997, 2024-04-19T03:03:08.445 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0048356839999999998, 2024-04-19T03:03:08.445 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:08.445 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-04-19T03:03:08.445 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:08.445 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:08.445 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:08.445 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 183688 2024-04-19T03:03:08.446 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:08.446 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:08.446 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:08.446 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:08.446 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:08.425738+0000", 2024-04-19T03:03:08.446 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:08.446 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:08.446 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:08.446 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:08.446 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:08.425738+0000", 2024-04-19T03:03:08.446 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:08.446 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:08.446 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:08.447 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:08.447 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:08.425737+0000", 2024-04-19T03:03:08.447 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:03:08.447 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:08.447 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:08.447 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:08.447 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:08.425742+0000", 2024-04-19T03:03:08.447 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2240000000000003e-06 2024-04-19T03:03:08.447 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:08.447 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:08.447 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:08.447 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:08.425756+0000", 2024-04-19T03:03:08.447 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4127999999999999e-05 2024-04-19T03:03:08.447 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:08.447 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:08.448 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:08.448 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:08.425764+0000", 2024-04-19T03:03:08.448 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9400000000000002e-06 2024-04-19T03:03:08.448 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:08.448 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:08.448 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:08.448 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:08.428566+0000", 2024-04-19T03:03:08.448 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0028017459999999999 2024-04-19T03:03:08.448 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:08.448 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:08.448 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:08.448 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:08.428676+0000", 2024-04-19T03:03:08.448 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000109979 2024-04-19T03:03:08.448 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:08.449 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:08.449 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:08.449 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:08.449 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:08.449 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:183689 5.d 5:b91fa74b:::benchmark_data_smithi096_19531_object70239:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-19T03:03:08.449 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:03:08.425771+0000", 2024-04-19T03:03:08.449 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0045862289999999998, 2024-04-19T03:03:08.449 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0048687340000000004, 2024-04-19T03:03:08.449 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:08.449 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:03:08.449 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:08.449 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:08.449 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:08.449 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 183689 2024-04-19T03:03:08.450 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:08.450 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:08.450 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:08.450 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:08.450 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:08.425771+0000", 2024-04-19T03:03:08.450 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:08.450 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:08.450 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:08.450 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:08.450 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:08.425771+0000", 2024-04-19T03:03:08.450 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:08.450 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:08.450 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:08.451 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:08.451 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:08.425771+0000", 2024-04-19T03:03:08.451 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:08.451 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:08.451 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:08.451 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:08.451 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:08.425774+0000", 2024-04-19T03:03:08.451 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.247e-06 2024-04-19T03:03:08.451 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:08.451 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:08.451 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:08.451 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:08.425784+0000", 2024-04-19T03:03:08.451 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.7429999999999997e-06 2024-04-19T03:03:08.451 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:08.451 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:08.452 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:08.452 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:08.425793+0000", 2024-04-19T03:03:08.452 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.0759999999999992e-06 2024-04-19T03:03:08.452 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:08.452 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:08.452 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:08.452 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:08.425839+0000", 2024-04-19T03:03:08.452 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5694e-05 2024-04-19T03:03:08.452 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:08.452 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:08.452 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:08.452 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:08.425938+0000", 2024-04-19T03:03:08.452 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.9386e-05 2024-04-19T03:03:08.452 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:08.453 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:08.453 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:03:08.453 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:08.426043+0000", 2024-04-19T03:03:08.453 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00010531600000000001 2024-04-19T03:03:08.453 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:08.453 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:08.453 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:08.453 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:08.453 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:08.453 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:183692 5.d 5:b787f922:::benchmark_data_smithi096_19531_object70242:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-19T03:03:08.453 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:03:08.426466+0000", 2024-04-19T03:03:08.453 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.003891444, 2024-04-19T03:03:08.453 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0042496280000000001, 2024-04-19T03:03:08.453 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:08.454 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:03:08.454 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:08.454 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:08.454 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:08.454 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 183692 2024-04-19T03:03:08.454 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:08.454 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:08.454 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:08.454 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:08.454 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:08.426466+0000", 2024-04-19T03:03:08.454 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:08.454 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:08.454 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:08.454 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:08.455 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:08.426466+0000", 2024-04-19T03:03:08.455 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:08.455 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:08.455 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:08.455 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:08.455 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:08.426465+0000", 2024-04-19T03:03:08.455 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:03:08.455 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:08.455 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:08.455 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:08.455 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:08.426471+0000", 2024-04-19T03:03:08.455 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5740000000000003e-06 2024-04-19T03:03:08.455 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:08.456 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:08.456 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:08.456 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:08.426485+0000", 2024-04-19T03:03:08.456 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4114000000000001e-05 2024-04-19T03:03:08.456 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:08.456 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:08.456 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:08.456 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:08.426492+0000", 2024-04-19T03:03:08.456 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5630000000000003e-06 2024-04-19T03:03:08.456 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:08.456 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:08.456 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:08.456 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:08.427758+0000", 2024-04-19T03:03:08.456 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0012655800000000001 2024-04-19T03:03:08.457 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:08.457 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:08.457 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:08.457 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:08.427834+0000", 2024-04-19T03:03:08.457 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6093000000000005e-05 2024-04-19T03:03:08.457 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:08.457 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:08.457 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:03:08.457 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:08.427892+0000", 2024-04-19T03:03:08.457 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7578000000000003e-05 2024-04-19T03:03:08.457 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:08.457 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:08.457 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:08.457 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:08.458 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:08.458 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:183693 5.3 5:cf9ff016:::benchmark_data_smithi096_19531_object70243:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-19T03:03:08.458 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:03:08.426502+0000", 2024-04-19T03:03:08.458 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.003855509, 2024-04-19T03:03:08.458 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0042832410000000001, 2024-04-19T03:03:08.458 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:08.458 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-04-19T03:03:08.458 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:08.458 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:08.458 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:08.458 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 183693 2024-04-19T03:03:08.458 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:08.458 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:08.458 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:08.459 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:08.459 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:08.426502+0000", 2024-04-19T03:03:08.459 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:08.459 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:08.459 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:08.459 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:08.459 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:08.426502+0000", 2024-04-19T03:03:08.459 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:08.459 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:08.459 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:08.459 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:08.459 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:08.426502+0000", 2024-04-19T03:03:08.459 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:08.459 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:08.460 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:08.460 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:08.460 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:08.426505+0000", 2024-04-19T03:03:08.460 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9270000000000001e-06 2024-04-19T03:03:08.460 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:08.460 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:08.460 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:08.460 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:08.426524+0000", 2024-04-19T03:03:08.460 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9700000000000001e-05 2024-04-19T03:03:08.460 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:08.460 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:08.460 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:08.460 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:08.426531+0000", 2024-04-19T03:03:08.461 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4960000000000001e-06 2024-04-19T03:03:08.461 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:08.461 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:08.461 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:08.461 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:08.426573+0000", 2024-04-19T03:03:08.461 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2286999999999997e-05 2024-04-19T03:03:08.461 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:08.461 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:08.461 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:08.461 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:08.426743+0000", 2024-04-19T03:03:08.461 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000170194 2024-04-19T03:03:08.461 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:08.461 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:08.461 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:08.461 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:08.462 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:08.462 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:183698 5.d 5:b0d07edf:::benchmark_data_smithi096_19531_object70248:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-19T03:03:08.462 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:03:08.429147+0000", 2024-04-19T03:03:08.462 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0012107019999999999, 2024-04-19T03:03:08.462 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001703612, 2024-04-19T03:03:08.462 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:08.462 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:03:08.462 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:08.462 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:08.462 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:08.462 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 183698 2024-04-19T03:03:08.462 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:08.462 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:08.462 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:08.463 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:08.463 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:08.429147+0000", 2024-04-19T03:03:08.463 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:08.463 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:08.463 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:08.463 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:08.463 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:08.429147+0000", 2024-04-19T03:03:08.463 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:08.463 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:08.463 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:08.463 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:08.463 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:08.429146+0000", 2024-04-19T03:03:08.463 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:03:08.463 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:08.463 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:08.464 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:08.464 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:08.429152+0000", 2024-04-19T03:03:08.464 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1999999999999999e-06 2024-04-19T03:03:08.464 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:08.464 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:08.464 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:08.464 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:08.429166+0000", 2024-04-19T03:03:08.464 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4042e-05 2024-04-19T03:03:08.464 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:08.464 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:08.464 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:08.464 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:08.429174+0000", 2024-04-19T03:03:08.464 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8779999999999998e-06 2024-04-19T03:03:08.464 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:08.465 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:08.465 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:08.465 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:08.429211+0000", 2024-04-19T03:03:08.465 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7320999999999997e-05 2024-04-19T03:03:08.465 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:08.465 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:08.465 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:08.465 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:08.429283+0000", 2024-04-19T03:03:08.465 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2101000000000006e-05 2024-04-19T03:03:08.465 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:08.465 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:08.465 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:03:08.465 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:08.429342+0000", 2024-04-19T03:03:08.465 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8520000000000002e-05 2024-04-19T03:03:08.466 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:08.466 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:08.466 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:08.466 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:08.466 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:08.466 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:183699 5.1 5:88cabb3e:::benchmark_data_smithi096_19531_object70249:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-19T03:03:08.466 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:03:08.429961+0000", 2024-04-19T03:03:08.466 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.000396473, 2024-04-19T03:03:08.466 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00095483700000000005, 2024-04-19T03:03:08.466 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:08.466 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-04-19T03:03:08.466 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:08.466 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:08.467 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:08.467 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 183699 2024-04-19T03:03:08.467 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:08.467 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:08.467 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:08.467 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:08.467 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:08.429961+0000", 2024-04-19T03:03:08.467 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:08.467 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:08.467 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:08.467 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:08.467 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:08.429961+0000", 2024-04-19T03:03:08.467 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:08.467 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:08.468 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:08.468 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:08.468 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:08.429960+0000", 2024-04-19T03:03:08.468 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:03:08.468 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:08.468 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:08.468 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:08.468 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:08.429968+0000", 2024-04-19T03:03:08.468 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0209999999999999e-06 2024-04-19T03:03:08.468 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:08.468 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:08.468 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:08.468 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:08.429979+0000", 2024-04-19T03:03:08.468 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0407e-05 2024-04-19T03:03:08.469 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:08.469 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:08.469 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:08.469 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:08.429986+0000", 2024-04-19T03:03:08.469 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6149999999999999e-06 2024-04-19T03:03:08.469 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:08.469 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:08.469 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:08.469 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:08.430018+0000", 2024-04-19T03:03:08.469 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.1297000000000002e-05 2024-04-19T03:03:08.469 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:08.469 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:08.469 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:08.469 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:08.430107+0000", 2024-04-19T03:03:08.469 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9242999999999999e-05 2024-04-19T03:03:08.470 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:08.470 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:08.470 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:08.470 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:08.470 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:08.470 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:183701 5.9 5:9ae4006f:::benchmark_data_smithi096_19531_object70251:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e59)", 2024-04-19T03:03:08.470 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:03:08.430369+0000", 2024-04-19T03:03:08.470 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4294967295.999989, 2024-04-19T03:03:08.470 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00060548199999999996, 2024-04-19T03:03:08.470 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:08.470 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:03:08.470 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:08.470 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:08.470 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:08.471 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 183701 2024-04-19T03:03:08.471 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:08.471 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:08.471 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:08.471 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:08.471 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:08.430369+0000", 2024-04-19T03:03:08.471 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:08.471 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:08.471 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:08.471 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:08.471 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:08.430369+0000", 2024-04-19T03:03:08.471 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:08.471 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:08.471 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:08.471 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:08.472 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:08.430368+0000", 2024-04-19T03:03:08.472 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:03:08.472 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:08.472 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:08.472 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:08.472 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:08.430373+0000", 2024-04-19T03:03:08.472 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8040000000000001e-06 2024-04-19T03:03:08.472 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:08.472 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:08.472 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:08.472 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:08.430384+0000", 2024-04-19T03:03:08.472 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1469e-05 2024-04-19T03:03:08.472 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:08.472 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:08.473 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:08.473 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:08.430390+0000", 2024-04-19T03:03:08.473 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7629999999999997e-06 2024-04-19T03:03:08.473 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:08.473 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:08.473 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:08.473 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:08.430430+0000", 2024-04-19T03:03:08.473 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0683000000000003e-05 2024-04-19T03:03:08.473 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:08.473 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:08.473 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:08.473 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:08.430581+0000", 2024-04-19T03:03:08.473 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00015065599999999999 2024-04-19T03:03:08.473 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:08.474 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:08.474 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:03:08.474 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:08.430712+0000", 2024-04-19T03:03:08.474 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00013036800000000001 2024-04-19T03:03:08.474 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:08.474 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:08.474 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:08.474 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:08.474 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-04-19T03:03:08.474 INFO:teuthology.orchestra.run.smithi144.stdout: "num_ops": 10 2024-04-19T03:03:08.474 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-04-19T03:03:08.475 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1: {} 2024-04-19T03:03:08.476 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T03:03:08.481 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2: {} 2024-04-19T03:03:08.481 INFO:teuthology.orchestra.run.smithi096.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-04-19T03:03:08.481 INFO:teuthology.orchestra.run.smithi096.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-19T03:03:08.481 INFO:teuthology.orchestra.run.smithi096.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-19T03:03:08.485 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-19T03:03:08.485 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-19T03:03:08.503 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:03:08.502+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:03:08.604 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-04-19T03:03:08.604 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:03:08.605 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:03:08.602+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:03:08.617 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T03:03:08.673 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-19T03:03:08.706 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:03:08.702+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:03:08.745 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-04-19T03:03:08.745 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:03:08.757 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T03:03:08.807 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:03:08.802+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:03:08.878 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-19T03:03:08.879 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:03:08.891 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T03:03:08.908 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:03:08.906+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:03:09.005 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-19T03:03:09.005 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:03:09.009 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:03:09.004+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:03:09.017 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T03:03:09.110 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:03:09.106+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:03:09.184 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-19T03:03:09.184 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:03:09.198 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T03:03:09.210 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:03:09.208+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:03:09.311 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:03:09.306+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:03:09.319 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-04-19T03:03:09.319 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:03:09.330 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T03:03:09.412 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:03:09.410+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:03:09.495 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-04-19T03:03:09.495 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:03:09.507 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T03:03:09.513 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:03:09.512+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:03:09.606 INFO:teuthology.orchestra.run.smithi096.stderr:nodeep-scrub is unset 2024-04-19T03:03:09.614 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:03:09.610+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:03:09.632 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-04-19T03:03:09.632 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:03:09.645 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T03:03:09.715 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:03:09.712+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:03:09.773 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-19T03:03:09.773 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:03:09.785 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T03:03:09.816 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:03:09.812+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:03:09.903 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-19T03:03:09.903 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:03:09.915 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T03:03:09.916 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:03:09.912+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:03:10.018 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:03:10.014+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:03:10.039 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-19T03:03:10.039 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:03:10.053 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T03:03:10.119 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:03:10.114+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:03:10.178 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-04-19T03:03:10.178 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:03:10.189 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T03:03:10.219 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:03:10.214+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:03:10.315 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-04-19T03:03:10.315 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:03:10.321 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:03:10.316+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:03:10.329 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T03:03:10.422 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:03:10.418+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:03:10.447 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~41s 2024-04-19T03:03:10.453 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-04-19T03:03:10.453 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:03:10.467 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T03:03:10.486 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-19T03:03:10.523 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:03:10.520+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:03:10.596 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-19T03:03:10.597 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:03:10.610 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T03:03:10.626 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:03:10.624+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:03:10.634 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1: {} 2024-04-19T03:03:10.653 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2: {} 2024-04-19T03:03:10.654 INFO:teuthology.orchestra.run.smithi096.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-04-19T03:03:10.654 INFO:teuthology.orchestra.run.smithi096.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-19T03:03:10.654 INFO:teuthology.orchestra.run.smithi096.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-19T03:03:10.657 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-19T03:03:10.658 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-19T03:03:10.727 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:03:10.724+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:03:10.732 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-19T03:03:10.732 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-04-19T03:03:10.732 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-04-19T03:03:10.732 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-04-19T03:03:10.732 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-19T03:03:10.743 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T03:03:10.830 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:03:10.826+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:03:10.867 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-19T03:03:10.867 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-04-19T03:03:10.867 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-04-19T03:03:10.867 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-04-19T03:03:10.868 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.868 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:86615 5.e 5:7fef7288:::benchmark_data_smithi096_19531_object86614:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:10.868 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:22.634544+0000", 2024-04-19T03:03:10.868 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 48.230265584999998, 2024-04-19T03:03:10.868 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.192475071, 2024-04-19T03:03:10.868 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:10.868 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:10.868 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:10.868 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:10.868 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:10.868 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 86615 2024-04-19T03:03:10.868 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.869 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:10.869 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.869 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:10.869 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634544+0000", 2024-04-19T03:03:10.869 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:10.869 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.869 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.869 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:10.869 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634544+0000", 2024-04-19T03:03:10.869 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:10.869 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.869 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.869 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:10.870 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634542+0000", 2024-04-19T03:03:10.870 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999981 2024-04-19T03:03:10.870 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.870 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.870 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:10.870 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634585+0000", 2024-04-19T03:03:10.870 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2299000000000003e-05 2024-04-19T03:03:10.870 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.870 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.871 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:10.871 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634592+0000", 2024-04-19T03:03:10.871 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2350000000000002e-06 2024-04-19T03:03:10.871 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.871 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.871 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:10.871 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634596+0000", 2024-04-19T03:03:10.871 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5390000000000001e-06 2024-04-19T03:03:10.871 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.871 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.871 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:10.871 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634639+0000", 2024-04-19T03:03:10.871 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2444999999999998e-05 2024-04-19T03:03:10.872 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.872 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.872 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:10.872 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634808+0000", 2024-04-19T03:03:10.872 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000169152 2024-04-19T03:03:10.872 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.872 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.872 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:10.872 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634999+0000", 2024-04-19T03:03:10.872 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00019098300000000001 2024-04-19T03:03:10.872 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.872 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.873 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:10.873 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.640458+0000", 2024-04-19T03:03:10.873 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0054586870000000003 2024-04-19T03:03:10.873 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.873 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.873 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:10.873 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.826949+0000", 2024-04-19T03:03:10.873 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.18649178299999999 2024-04-19T03:03:10.873 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.873 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.873 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:03:10.873 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.826982+0000", 2024-04-19T03:03:10.873 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2477000000000001e-05 2024-04-19T03:03:10.874 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.874 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.874 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:10.874 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.827019+0000", 2024-04-19T03:03:10.874 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7355999999999999e-05 2024-04-19T03:03:10.874 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:10.874 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:10.874 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:10.874 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.874 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.874 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:86616 5.e 5:72278f47:::benchmark_data_smithi096_19531_object86615:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:10.874 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:22.634609+0000", 2024-04-19T03:03:10.875 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 48.230200435999997, 2024-04-19T03:03:10.875 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.19472088900000001, 2024-04-19T03:03:10.875 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:10.875 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:10.875 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:10.875 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:10.875 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:10.875 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 86616 2024-04-19T03:03:10.875 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.875 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:10.875 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.875 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:10.875 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634609+0000", 2024-04-19T03:03:10.876 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:10.876 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.876 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.876 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:10.876 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634609+0000", 2024-04-19T03:03:10.876 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:10.876 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.876 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.876 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:10.876 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634609+0000", 2024-04-19T03:03:10.877 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:10.877 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.877 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.877 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:10.877 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634651+0000", 2024-04-19T03:03:10.877 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2589000000000002e-05 2024-04-19T03:03:10.877 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.877 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.877 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:10.877 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634659+0000", 2024-04-19T03:03:10.877 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5850000000000002e-06 2024-04-19T03:03:10.877 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.877 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.878 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:10.878 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634662+0000", 2024-04-19T03:03:10.878 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3620000000000002e-06 2024-04-19T03:03:10.878 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.878 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.878 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:10.878 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.637880+0000", 2024-04-19T03:03:10.878 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.003218149 2024-04-19T03:03:10.878 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.878 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.878 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:10.878 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.637999+0000", 2024-04-19T03:03:10.879 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000118643 2024-04-19T03:03:10.879 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.879 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.879 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:10.879 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.638102+0000", 2024-04-19T03:03:10.879 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010331 2024-04-19T03:03:10.879 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.879 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.879 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:10.879 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.640851+0000", 2024-04-19T03:03:10.879 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0027483310000000001 2024-04-19T03:03:10.879 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.879 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.879 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:10.880 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.829269+0000", 2024-04-19T03:03:10.880 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.188418319 2024-04-19T03:03:10.880 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.880 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.880 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:03:10.880 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.829299+0000", 2024-04-19T03:03:10.880 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0227e-05 2024-04-19T03:03:10.880 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.881 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.881 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:10.881 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.829330+0000", 2024-04-19T03:03:10.881 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0969000000000001e-05 2024-04-19T03:03:10.881 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:10.881 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:10.881 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:10.881 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.881 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.881 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:86618 5.0 5:09014b90:::benchmark_data_smithi096_19531_object86617:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:10.881 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:22.634894+0000", 2024-04-19T03:03:10.881 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 48.229915947999999, 2024-04-19T03:03:10.881 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.19413419800000001, 2024-04-19T03:03:10.881 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:10.882 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:10.882 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:10.882 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:10.882 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:10.882 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 86618 2024-04-19T03:03:10.882 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.882 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:10.882 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.882 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:10.883 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634894+0000", 2024-04-19T03:03:10.883 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:10.883 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.883 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.883 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:10.883 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634894+0000", 2024-04-19T03:03:10.883 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:10.883 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.883 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.883 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:10.883 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634893+0000", 2024-04-19T03:03:10.883 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:03:10.884 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.884 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.884 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:10.884 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634976+0000", 2024-04-19T03:03:10.884 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3231000000000003e-05 2024-04-19T03:03:10.884 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.884 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.884 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:10.884 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634983+0000", 2024-04-19T03:03:10.884 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5169999999999996e-06 2024-04-19T03:03:10.884 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.884 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.884 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:10.884 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634987+0000", 2024-04-19T03:03:10.884 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.425e-06 2024-04-19T03:03:10.885 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.885 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.885 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:10.885 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635030+0000", 2024-04-19T03:03:10.885 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.32e-05 2024-04-19T03:03:10.885 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.885 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.885 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:10.885 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635185+0000", 2024-04-19T03:03:10.885 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015471899999999999 2024-04-19T03:03:10.885 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.885 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.885 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:10.885 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635415+0000", 2024-04-19T03:03:10.886 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00023026500000000001 2024-04-19T03:03:10.886 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.886 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.886 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:10.886 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.640127+0000", 2024-04-19T03:03:10.886 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0047118890000000004 2024-04-19T03:03:10.886 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.886 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.886 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:10.886 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.828895+0000", 2024-04-19T03:03:10.886 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.18876802600000001 2024-04-19T03:03:10.886 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.886 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.886 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:03:10.887 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.828972+0000", 2024-04-19T03:03:10.887 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.6345000000000002e-05 2024-04-19T03:03:10.887 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.887 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.887 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:10.887 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.829028+0000", 2024-04-19T03:03:10.887 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6342999999999999e-05 2024-04-19T03:03:10.887 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:10.887 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:10.887 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:10.887 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.887 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.887 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:86620 5.b 5:d80faa68:::benchmark_data_smithi096_19531_object86619:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:10.887 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:22.635110+0000", 2024-04-19T03:03:10.887 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 48.229699388, 2024-04-19T03:03:10.888 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.193447275, 2024-04-19T03:03:10.888 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:10.888 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:10.888 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:10.888 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:10.888 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:10.888 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 86620 2024-04-19T03:03:10.888 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.888 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:10.888 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.888 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:10.888 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635110+0000", 2024-04-19T03:03:10.888 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:10.888 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.888 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.888 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:10.889 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635110+0000", 2024-04-19T03:03:10.889 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:10.889 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.889 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.889 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:10.889 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635110+0000", 2024-04-19T03:03:10.889 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:10.889 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.889 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.889 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:10.889 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635154+0000", 2024-04-19T03:03:10.889 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4681000000000001e-05 2024-04-19T03:03:10.889 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.889 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.889 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:10.890 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635166+0000", 2024-04-19T03:03:10.890 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1505000000000001e-05 2024-04-19T03:03:10.890 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.890 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.890 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:10.890 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635171+0000", 2024-04-19T03:03:10.890 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6040000000000003e-06 2024-04-19T03:03:10.890 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.890 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.890 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:10.890 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635221+0000", 2024-04-19T03:03:10.890 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9947000000000001e-05 2024-04-19T03:03:10.890 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.890 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.891 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:10.891 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635356+0000", 2024-04-19T03:03:10.891 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013576199999999999 2024-04-19T03:03:10.891 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.891 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.891 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:10.891 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635507+0000", 2024-04-19T03:03:10.891 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015072999999999999 2024-04-19T03:03:10.891 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.891 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.891 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:10.891 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.638488+0000", 2024-04-19T03:03:10.891 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0029813159999999999 2024-04-19T03:03:10.891 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.891 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.891 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:10.892 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.828341+0000", 2024-04-19T03:03:10.892 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.189852254 2024-04-19T03:03:10.892 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.892 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.892 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:03:10.892 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.828416+0000", 2024-04-19T03:03:10.892 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5344000000000002e-05 2024-04-19T03:03:10.892 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.892 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.892 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:10.892 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.828558+0000", 2024-04-19T03:03:10.892 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000141695 2024-04-19T03:03:10.892 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:10.892 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:10.892 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:10.893 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.893 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.893 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:86621 5.8 5:1597a420:::benchmark_data_smithi096_19531_object86620:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:10.893 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:22.635187+0000", 2024-04-19T03:03:10.893 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 48.229622528, 2024-04-19T03:03:10.893 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.194204878, 2024-04-19T03:03:10.893 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:10.893 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:10.893 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:10.893 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:10.893 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:10.893 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 86621 2024-04-19T03:03:10.893 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.893 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:10.894 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.894 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:10.894 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635187+0000", 2024-04-19T03:03:10.894 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:10.894 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.894 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.894 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:10.894 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635187+0000", 2024-04-19T03:03:10.894 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:10.894 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.894 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.894 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:10.894 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635187+0000", 2024-04-19T03:03:10.894 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:10.895 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.895 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.895 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:10.895 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635242+0000", 2024-04-19T03:03:10.895 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5158000000000003e-05 2024-04-19T03:03:10.895 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.895 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.895 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:10.895 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635249+0000", 2024-04-19T03:03:10.895 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.7000000000000008e-06 2024-04-19T03:03:10.895 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.895 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.895 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:10.896 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635256+0000", 2024-04-19T03:03:10.896 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2060000000000004e-06 2024-04-19T03:03:10.896 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.896 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.896 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:10.896 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635302+0000", 2024-04-19T03:03:10.896 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5954000000000001e-05 2024-04-19T03:03:10.896 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.896 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.896 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:10.896 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635427+0000", 2024-04-19T03:03:10.896 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012559299999999999 2024-04-19T03:03:10.896 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.896 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.896 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:10.897 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635596+0000", 2024-04-19T03:03:10.897 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000168615 2024-04-19T03:03:10.897 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.897 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.897 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:10.897 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.639320+0000", 2024-04-19T03:03:10.897 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0037244610000000001 2024-04-19T03:03:10.897 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.897 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.897 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:10.897 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.829277+0000", 2024-04-19T03:03:10.897 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.18995651099999999 2024-04-19T03:03:10.897 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.897 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.897 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:03:10.898 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.829341+0000", 2024-04-19T03:03:10.898 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3756000000000004e-05 2024-04-19T03:03:10.898 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.898 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.898 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:10.898 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.829392+0000", 2024-04-19T03:03:10.898 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1555999999999999e-05 2024-04-19T03:03:10.898 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:10.898 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:10.898 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:10.898 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.898 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.898 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87067 5.b 5:d57af71a:::benchmark_data_smithi096_19531_object87066:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:10.899 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.142233+0000", 2024-04-19T03:03:10.899 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 47.722576664999998, 2024-04-19T03:03:10.899 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.071692405000000001, 2024-04-19T03:03:10.899 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:10.899 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:10.899 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:10.899 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:10.899 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:10.899 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87067 2024-04-19T03:03:10.899 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.899 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:10.899 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.899 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:10.899 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142233+0000", 2024-04-19T03:03:10.900 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:10.900 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.900 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.900 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:10.900 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142233+0000", 2024-04-19T03:03:10.900 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:10.900 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.900 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.900 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:10.900 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142232+0000", 2024-04-19T03:03:10.900 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:03:10.900 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.901 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.901 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:10.901 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142277+0000", 2024-04-19T03:03:10.901 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5837000000000002e-05 2024-04-19T03:03:10.901 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.901 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.901 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:10.901 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142297+0000", 2024-04-19T03:03:10.901 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9561000000000001e-05 2024-04-19T03:03:10.901 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.901 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.901 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:10.901 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142311+0000", 2024-04-19T03:03:10.902 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3654e-05 2024-04-19T03:03:10.902 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.902 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.902 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:10.902 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142391+0000", 2024-04-19T03:03:10.902 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0123999999999994e-05 2024-04-19T03:03:10.902 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.902 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.902 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:10.902 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142669+0000", 2024-04-19T03:03:10.902 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00027829800000000001 2024-04-19T03:03:10.902 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.902 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.902 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:10.903 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142859+0000", 2024-04-19T03:03:10.903 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000190051 2024-04-19T03:03:10.903 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.903 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.903 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:10.903 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.150597+0000", 2024-04-19T03:03:10.903 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0077380299999999999 2024-04-19T03:03:10.903 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.903 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.903 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:10.903 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.213855+0000", 2024-04-19T03:03:10.903 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.063257987000000002 2024-04-19T03:03:10.903 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.903 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.903 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:03:10.904 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.213898+0000", 2024-04-19T03:03:10.904 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2916e-05 2024-04-19T03:03:10.904 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.904 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.904 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:10.904 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.213925+0000", 2024-04-19T03:03:10.904 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7503000000000001e-05 2024-04-19T03:03:10.904 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:10.904 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:10.904 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:10.904 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.904 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.904 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87069 5.b 5:da0c93b5:::benchmark_data_smithi096_19531_object87068:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:10.904 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.143402+0000", 2024-04-19T03:03:10.905 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 47.721407702999997, 2024-04-19T03:03:10.905 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.070678598999999995, 2024-04-19T03:03:10.905 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:10.905 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:10.905 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:10.905 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:10.905 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:10.905 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87069 2024-04-19T03:03:10.905 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.905 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:10.905 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.905 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:10.905 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.143402+0000", 2024-04-19T03:03:10.906 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:10.906 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.906 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.906 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:10.906 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.143402+0000", 2024-04-19T03:03:10.906 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:10.906 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.906 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.906 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:10.906 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.143401+0000", 2024-04-19T03:03:10.906 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:03:10.906 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.906 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.907 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:10.907 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.143501+0000", 2024-04-19T03:03:10.907 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000100387 2024-04-19T03:03:10.907 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.907 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.907 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:10.907 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.143516+0000", 2024-04-19T03:03:10.907 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5369000000000001e-05 2024-04-19T03:03:10.907 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.907 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.907 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:10.907 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.143524+0000", 2024-04-19T03:03:10.907 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.7079999999999997e-06 2024-04-19T03:03:10.907 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.907 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.908 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:10.908 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.145550+0000", 2024-04-19T03:03:10.908 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0020259290000000001 2024-04-19T03:03:10.908 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.908 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.908 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:10.908 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.145676+0000", 2024-04-19T03:03:10.908 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000126406 2024-04-19T03:03:10.908 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.908 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.908 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:10.908 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.145802+0000", 2024-04-19T03:03:10.908 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000125974 2024-04-19T03:03:10.908 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.909 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.909 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:10.909 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.151030+0000", 2024-04-19T03:03:10.909 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0052276079999999999 2024-04-19T03:03:10.909 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.909 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.909 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:10.909 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.213998+0000", 2024-04-19T03:03:10.909 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.06296786 2024-04-19T03:03:10.909 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.909 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.909 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:03:10.909 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.214031+0000", 2024-04-19T03:03:10.909 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3387999999999999e-05 2024-04-19T03:03:10.909 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.910 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.910 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:10.910 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.214081+0000", 2024-04-19T03:03:10.910 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9316e-05 2024-04-19T03:03:10.910 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:10.910 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:10.910 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:10.910 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.910 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.910 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87108 5.e 5:7e197adc:::benchmark_data_smithi096_19531_object87107:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:10.910 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.223103+0000", 2024-04-19T03:03:10.910 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 47.641706366000001, 2024-04-19T03:03:10.910 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.044946887, 2024-04-19T03:03:10.910 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:10.911 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-19T03:03:10.911 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:10.911 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:10.911 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:10.911 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87108 2024-04-19T03:03:10.911 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.911 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:10.911 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.911 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:10.911 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.223103+0000", 2024-04-19T03:03:10.911 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:10.911 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.911 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.911 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:10.912 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.223103+0000", 2024-04-19T03:03:10.912 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:10.912 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.912 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.912 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:10.912 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.223102+0000", 2024-04-19T03:03:10.912 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:03:10.912 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.912 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.912 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:10.912 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.223156+0000", 2024-04-19T03:03:10.913 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3958000000000001e-05 2024-04-19T03:03:10.913 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.913 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.913 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:10.913 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.223166+0000", 2024-04-19T03:03:10.913 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.4809999999999995e-06 2024-04-19T03:03:10.913 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.913 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.913 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:10.913 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.223172+0000", 2024-04-19T03:03:10.913 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0140000000000004e-06 2024-04-19T03:03:10.913 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.913 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.913 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:10.913 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.227295+0000", 2024-04-19T03:03:10.914 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0041233420000000003 2024-04-19T03:03:10.914 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.914 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.914 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:10.914 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.227495+0000", 2024-04-19T03:03:10.914 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00019955299999999999 2024-04-19T03:03:10.914 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.914 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.914 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:10.914 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.227717+0000", 2024-04-19T03:03:10.914 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000221902 2024-04-19T03:03:10.914 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.914 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.914 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:10.915 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233189+0000", 2024-04-19T03:03:10.915 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0054718889999999997 2024-04-19T03:03:10.915 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.915 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.915 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:10.915 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.250529+0000", 2024-04-19T03:03:10.915 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.017340298000000001 2024-04-19T03:03:10.915 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.915 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.915 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:03:10.915 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.250539+0000", 2024-04-19T03:03:10.915 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0501e-05 2024-04-19T03:03:10.915 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.915 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.916 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:10.916 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.268003+0000", 2024-04-19T03:03:10.916 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.017463429 2024-04-19T03:03:10.916 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.916 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.916 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:10.916 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.268050+0000", 2024-04-19T03:03:10.916 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7466000000000003e-05 2024-04-19T03:03:10.916 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:10.916 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:10.916 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:10.916 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.916 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.917 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87118 5.b 5:d1bb4f3c:::benchmark_data_smithi096_19531_object87117:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:10.917 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.231082+0000", 2024-04-19T03:03:10.917 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 47.633727532000002, 2024-04-19T03:03:10.917 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.035789004, 2024-04-19T03:03:10.917 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:10.917 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-19T03:03:10.917 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:10.917 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:10.917 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:10.917 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87118 2024-04-19T03:03:10.917 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.917 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:10.917 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.917 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:10.918 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231082+0000", 2024-04-19T03:03:10.918 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:10.918 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.918 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.918 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:10.918 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231082+0000", 2024-04-19T03:03:10.918 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:10.918 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.918 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.918 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:10.918 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231081+0000", 2024-04-19T03:03:10.918 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:03:10.918 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.918 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.919 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:10.919 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231159+0000", 2024-04-19T03:03:10.919 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.7819999999999997e-05 2024-04-19T03:03:10.919 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.919 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.919 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:10.919 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231186+0000", 2024-04-19T03:03:10.919 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7126000000000001e-05 2024-04-19T03:03:10.919 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.919 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.919 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:10.919 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231193+0000", 2024-04-19T03:03:10.919 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7259999999999996e-06 2024-04-19T03:03:10.920 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.920 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.920 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:10.920 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231241+0000", 2024-04-19T03:03:10.920 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8123e-05 2024-04-19T03:03:10.920 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.920 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.920 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:10.920 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231354+0000", 2024-04-19T03:03:10.920 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0001133 2024-04-19T03:03:10.920 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.920 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.920 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:10.920 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231443+0000", 2024-04-19T03:03:10.920 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9167999999999997e-05 2024-04-19T03:03:10.920 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.921 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.921 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:10.921 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236498+0000", 2024-04-19T03:03:10.921 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0050545160000000002 2024-04-19T03:03:10.921 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.921 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.921 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:10.921 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.249681+0000", 2024-04-19T03:03:10.921 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013183321 2024-04-19T03:03:10.921 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.921 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.921 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:03:10.921 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.249693+0000", 2024-04-19T03:03:10.921 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1834999999999999e-05 2024-04-19T03:03:10.921 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.922 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.922 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:10.922 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266733+0000", 2024-04-19T03:03:10.922 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.017040408 2024-04-19T03:03:10.922 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.922 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.922 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:10.922 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266871+0000", 2024-04-19T03:03:10.922 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000137849 2024-04-19T03:03:10.922 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:10.922 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:10.922 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:10.922 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.923 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.923 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87121 5.b 5:d01822b8:::benchmark_data_smithi096_19531_object87120:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:10.923 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.233319+0000", 2024-04-19T03:03:10.923 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 47.631490667999998, 2024-04-19T03:03:10.923 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.033624198, 2024-04-19T03:03:10.923 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:10.923 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-19T03:03:10.923 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:10.923 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:10.923 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:10.923 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87121 2024-04-19T03:03:10.923 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.923 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:10.923 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.924 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:10.924 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233319+0000", 2024-04-19T03:03:10.924 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:10.924 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.924 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.924 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:10.924 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233319+0000", 2024-04-19T03:03:10.924 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:10.924 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.924 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.924 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:10.924 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233319+0000", 2024-04-19T03:03:10.924 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:10.924 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.925 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.925 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:10.925 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233364+0000", 2024-04-19T03:03:10.925 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5460999999999997e-05 2024-04-19T03:03:10.925 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.925 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.925 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:10.925 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233382+0000", 2024-04-19T03:03:10.925 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8148e-05 2024-04-19T03:03:10.925 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.925 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.925 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:10.925 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233390+0000", 2024-04-19T03:03:10.926 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5340000000000002e-06 2024-04-19T03:03:10.926 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.926 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.926 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:10.926 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233712+0000", 2024-04-19T03:03:10.926 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00032260500000000001 2024-04-19T03:03:10.926 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.926 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.926 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:10.926 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233829+0000", 2024-04-19T03:03:10.926 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011638599999999999 2024-04-19T03:03:10.926 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.926 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.927 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:10.927 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233959+0000", 2024-04-19T03:03:10.927 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013013900000000001 2024-04-19T03:03:10.927 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.927 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.927 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:10.927 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236515+0000", 2024-04-19T03:03:10.927 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0025562750000000002 2024-04-19T03:03:10.927 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.927 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.927 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:10.927 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.249723+0000", 2024-04-19T03:03:10.927 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013208176 2024-04-19T03:03:10.928 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.928 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.928 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:03:10.928 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.249728+0000", 2024-04-19T03:03:10.928 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6519999999999997e-06 2024-04-19T03:03:10.928 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.928 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.928 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:10.928 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266837+0000", 2024-04-19T03:03:10.928 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0171087059999999 2024-04-19T03:03:10.928 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.928 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.929 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:10.929 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266943+0000", 2024-04-19T03:03:10.929 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000106604 2024-04-19T03:03:10.929 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:10.929 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:10.929 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:10.929 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.929 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.929 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87124 5.8 5:14819ad7:::benchmark_data_smithi096_19531_object87123:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:10.929 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.235886+0000", 2024-04-19T03:03:10.929 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 47.628923243999999, 2024-04-19T03:03:10.929 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0315451179999999, 2024-04-19T03:03:10.929 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:10.929 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-19T03:03:10.930 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:10.930 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:10.930 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:10.930 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87124 2024-04-19T03:03:10.930 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.930 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:10.930 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.930 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:10.930 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.235886+0000", 2024-04-19T03:03:10.930 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:10.930 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.930 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.930 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:10.931 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.235886+0000", 2024-04-19T03:03:10.931 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:10.931 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.931 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.931 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:10.931 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.235886+0000", 2024-04-19T03:03:10.931 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:03:10.931 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.931 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.931 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:10.931 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.235934+0000", 2024-04-19T03:03:10.931 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8384000000000003e-05 2024-04-19T03:03:10.931 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.931 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.932 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:10.932 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.235945+0000", 2024-04-19T03:03:10.932 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0671e-05 2024-04-19T03:03:10.932 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.932 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.932 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:10.932 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.235952+0000", 2024-04-19T03:03:10.932 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3089999999999998e-06 2024-04-19T03:03:10.932 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.932 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.932 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:10.932 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.237067+0000", 2024-04-19T03:03:10.932 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001115263 2024-04-19T03:03:10.933 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.933 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.933 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:10.933 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.237188+0000", 2024-04-19T03:03:10.933 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000121258 2024-04-19T03:03:10.933 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.933 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.933 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:10.933 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.237316+0000", 2024-04-19T03:03:10.933 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000128071 2024-04-19T03:03:10.933 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.934 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.934 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:10.934 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240744+0000", 2024-04-19T03:03:10.934 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0034275629999999998 2024-04-19T03:03:10.934 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.934 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.934 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:10.934 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.252517+0000", 2024-04-19T03:03:10.934 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011772991999999999 2024-04-19T03:03:10.934 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.934 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.934 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:03:10.934 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.252523+0000", 2024-04-19T03:03:10.935 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3640000000000004e-06 2024-04-19T03:03:10.935 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.935 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.935 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:10.935 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.267290+0000", 2024-04-19T03:03:10.935 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0147665690000001 2024-04-19T03:03:10.935 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.935 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.935 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:10.935 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.267432+0000", 2024-04-19T03:03:10.935 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014165299999999999 2024-04-19T03:03:10.935 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:10.935 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:10.935 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:10.936 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.936 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.936 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87129 5.0 5:02667e01:::benchmark_data_smithi096_19531_object87128:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:10.936 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.236466+0000", 2024-04-19T03:03:10.936 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 47.628343248, 2024-04-19T03:03:10.936 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0301534510000001, 2024-04-19T03:03:10.936 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:10.936 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-19T03:03:10.936 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:10.936 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:10.936 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:10.936 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87129 2024-04-19T03:03:10.936 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.936 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:10.936 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.937 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:10.937 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236466+0000", 2024-04-19T03:03:10.937 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:10.937 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.937 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.937 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:10.937 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236466+0000", 2024-04-19T03:03:10.937 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:10.937 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.937 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.937 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:10.937 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236465+0000", 2024-04-19T03:03:10.937 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:03:10.938 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.938 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.938 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:10.938 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236566+0000", 2024-04-19T03:03:10.938 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010047000000000001 2024-04-19T03:03:10.938 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.938 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.938 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:10.938 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236577+0000", 2024-04-19T03:03:10.938 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1772e-05 2024-04-19T03:03:10.938 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.938 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.938 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:10.938 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236584+0000", 2024-04-19T03:03:10.939 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0530000000000003e-06 2024-04-19T03:03:10.939 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.939 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.939 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:10.939 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.237023+0000", 2024-04-19T03:03:10.939 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000439703 2024-04-19T03:03:10.939 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.939 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.939 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:10.939 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.237207+0000", 2024-04-19T03:03:10.939 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000183692 2024-04-19T03:03:10.939 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.939 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.940 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:10.940 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.237373+0000", 2024-04-19T03:03:10.940 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016623500000000001 2024-04-19T03:03:10.940 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.940 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.940 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:10.940 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.241461+0000", 2024-04-19T03:03:10.940 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0040883050000000004 2024-04-19T03:03:10.940 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.940 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.940 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:10.940 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.252500+0000", 2024-04-19T03:03:10.941 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011038450999999999 2024-04-19T03:03:10.941 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.941 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.941 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:03:10.941 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.252507+0000", 2024-04-19T03:03:10.941 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2439999999999996e-06 2024-04-19T03:03:10.941 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.941 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.941 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:10.941 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266538+0000", 2024-04-19T03:03:10.941 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.014031184 2024-04-19T03:03:10.941 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.941 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.941 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:10.942 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266620+0000", 2024-04-19T03:03:10.942 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1600000000000005e-05 2024-04-19T03:03:10.942 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:10.942 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:10.942 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:10.942 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.942 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.942 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87135 5.4 5:2a97e7b7:::benchmark_data_smithi096_19531_object87134:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:10.942 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.240884+0000", 2024-04-19T03:03:10.942 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 47.623925790999998, 2024-04-19T03:03:10.942 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.025708931, 2024-04-19T03:03:10.942 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:10.942 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-19T03:03:10.943 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:10.943 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:10.943 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:10.943 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87135 2024-04-19T03:03:10.943 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.943 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:10.943 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.943 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:10.943 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240884+0000", 2024-04-19T03:03:10.943 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:10.943 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.943 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.943 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:10.943 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240884+0000", 2024-04-19T03:03:10.944 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:10.944 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.944 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.944 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:10.944 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240883+0000", 2024-04-19T03:03:10.944 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:03:10.944 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.944 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.944 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:10.944 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240933+0000", 2024-04-19T03:03:10.944 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9969999999999998e-05 2024-04-19T03:03:10.944 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.944 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.944 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:10.944 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240946+0000", 2024-04-19T03:03:10.945 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2943e-05 2024-04-19T03:03:10.945 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.945 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.945 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:10.945 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240952+0000", 2024-04-19T03:03:10.945 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8930000000000002e-06 2024-04-19T03:03:10.945 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.945 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.945 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:10.945 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240994+0000", 2024-04-19T03:03:10.945 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2753999999999998e-05 2024-04-19T03:03:10.945 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.945 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.945 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:10.946 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.241092+0000", 2024-04-19T03:03:10.946 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.7447000000000004e-05 2024-04-19T03:03:10.946 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.946 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.946 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:10.946 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.241183+0000", 2024-04-19T03:03:10.946 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1163999999999997e-05 2024-04-19T03:03:10.946 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.946 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.946 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:10.946 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.254672+0000", 2024-04-19T03:03:10.946 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.01348864 2024-04-19T03:03:10.946 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.947 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.947 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:03:10.947 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.254681+0000", 2024-04-19T03:03:10.947 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.3789999999999995e-06 2024-04-19T03:03:10.947 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.947 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.947 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:10.947 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266456+0000", 2024-04-19T03:03:10.947 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.011774621 2024-04-19T03:03:10.947 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.947 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.947 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:10.947 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266593+0000", 2024-04-19T03:03:10.947 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013737600000000001 2024-04-19T03:03:10.948 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:10.948 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:10.948 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:10.948 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.948 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.948 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87136 5.4 5:212411bc:::benchmark_data_smithi096_19531_object87135:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:10.948 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.240962+0000", 2024-04-19T03:03:10.948 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 47.623847914999999, 2024-04-19T03:03:10.948 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.025738, 2024-04-19T03:03:10.948 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:10.948 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-19T03:03:10.948 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:10.948 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:10.948 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:10.949 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87136 2024-04-19T03:03:10.949 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.949 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:10.949 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.949 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:10.949 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240962+0000", 2024-04-19T03:03:10.949 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:10.949 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.949 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.949 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:10.949 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240962+0000", 2024-04-19T03:03:10.949 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:10.949 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.949 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.950 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:10.950 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240961+0000", 2024-04-19T03:03:10.950 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:10.950 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.950 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.950 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:10.950 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240995+0000", 2024-04-19T03:03:10.950 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3868000000000002e-05 2024-04-19T03:03:10.950 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.950 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.950 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:10.950 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.241001+0000", 2024-04-19T03:03:10.950 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.322e-06 2024-04-19T03:03:10.951 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.951 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.951 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:10.951 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.241004+0000", 2024-04-19T03:03:10.951 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3510000000000002e-06 2024-04-19T03:03:10.951 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.951 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.951 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:10.951 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247131+0000", 2024-04-19T03:03:10.951 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0061270869999999998 2024-04-19T03:03:10.951 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.951 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.951 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:10.951 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247322+0000", 2024-04-19T03:03:10.952 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000191015 2024-04-19T03:03:10.952 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.952 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.952 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:10.952 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247542+0000", 2024-04-19T03:03:10.952 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00022030199999999999 2024-04-19T03:03:10.952 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.952 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.952 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:10.952 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.254709+0000", 2024-04-19T03:03:10.952 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0071662660000000001 2024-04-19T03:03:10.952 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.952 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.952 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:03:10.953 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.254716+0000", 2024-04-19T03:03:10.953 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3860000000000001e-06 2024-04-19T03:03:10.953 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.953 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.953 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:10.953 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266619+0000", 2024-04-19T03:03:10.953 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0119031030000001 2024-04-19T03:03:10.953 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.953 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.953 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:10.953 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266700+0000", 2024-04-19T03:03:10.953 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0764000000000001e-05 2024-04-19T03:03:10.953 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:10.954 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:10.954 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:10.954 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.954 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.954 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87138 5.e 5:7b1f1c20:::benchmark_data_smithi096_19531_object87137:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:10.954 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.247862+0000", 2024-04-19T03:03:10.954 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 47.616947840999998, 2024-04-19T03:03:10.954 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.024457079, 2024-04-19T03:03:10.954 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:10.954 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:10.954 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:10.954 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:10.955 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:10.955 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87138 2024-04-19T03:03:10.955 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.955 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:10.955 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.955 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:10.955 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247862+0000", 2024-04-19T03:03:10.955 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:10.955 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.955 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.955 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:10.955 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247862+0000", 2024-04-19T03:03:10.955 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:10.956 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.956 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.956 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:10.956 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247860+0000", 2024-04-19T03:03:10.956 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999981 2024-04-19T03:03:10.956 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.956 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.956 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:10.956 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247909+0000", 2024-04-19T03:03:10.956 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9150999999999997e-05 2024-04-19T03:03:10.956 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.956 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.956 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:10.956 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247925+0000", 2024-04-19T03:03:10.957 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5761999999999999e-05 2024-04-19T03:03:10.957 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.957 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.957 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:10.957 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247936+0000", 2024-04-19T03:03:10.957 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1144e-05 2024-04-19T03:03:10.957 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.957 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.957 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:10.957 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.250590+0000", 2024-04-19T03:03:10.957 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.002653678 2024-04-19T03:03:10.957 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.957 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.958 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:03:10.958 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.250599+0000", 2024-04-19T03:03:10.958 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9039999999999998e-06 2024-04-19T03:03:10.958 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.958 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.958 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:10.958 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.268151+0000", 2024-04-19T03:03:10.958 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0175523449999999 2024-04-19T03:03:10.958 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.958 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.958 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:10.959 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.268285+0000", 2024-04-19T03:03:10.959 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013415599999999999 2024-04-19T03:03:10.959 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.959 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.959 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:10.959 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.272238+0000", 2024-04-19T03:03:10.959 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0039533019999999997 2024-04-19T03:03:10.959 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.959 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.959 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:03:10.959 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.272274+0000", 2024-04-19T03:03:10.959 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5352000000000003e-05 2024-04-19T03:03:10.959 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.960 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.960 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:10.960 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.272319+0000", 2024-04-19T03:03:10.960 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5281999999999998e-05 2024-04-19T03:03:10.960 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:10.960 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:10.960 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:10.960 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.960 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.960 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:158371 5.8 5:11a83024:::benchmark_data_smithi096_19531_object44921:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-19T03:03:10.960 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:58.125869+0000", 2024-04-19T03:03:10.960 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 12.738940976, 2024-04-19T03:03:10.960 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074532857999999994, 2024-04-19T03:03:10.960 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:10.961 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:10.961 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:10.961 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:10.961 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:10.961 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 158371 2024-04-19T03:03:10.961 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.961 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:10.961 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.961 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:10.961 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125869+0000", 2024-04-19T03:03:10.961 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:10.961 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.961 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.961 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:10.962 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125869+0000", 2024-04-19T03:03:10.962 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:10.962 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.962 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.962 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:10.962 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125868+0000", 2024-04-19T03:03:10.962 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:03:10.962 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.962 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.962 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:10.962 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125874+0000", 2024-04-19T03:03:10.962 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7120000000000003e-06 2024-04-19T03:03:10.962 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.962 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.963 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:10.963 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125885+0000", 2024-04-19T03:03:10.963 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0665999999999999e-05 2024-04-19T03:03:10.963 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.963 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.963 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:10.963 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125901+0000", 2024-04-19T03:03:10.963 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6463000000000001e-05 2024-04-19T03:03:10.963 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.963 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.963 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:10.963 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125956+0000", 2024-04-19T03:03:10.963 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4728000000000002e-05 2024-04-19T03:03:10.964 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.964 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.964 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:10.964 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.126050+0000", 2024-04-19T03:03:10.964 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.3534000000000003e-05 2024-04-19T03:03:10.964 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.964 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.964 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:10.964 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.200187+0000", 2024-04-19T03:03:10.964 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074136933000000002 2024-04-19T03:03:10.964 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.964 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.964 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:03:10.964 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.200260+0000", 2024-04-19T03:03:10.964 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3090999999999995e-05 2024-04-19T03:03:10.965 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.965 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.965 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:10.965 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.200402+0000", 2024-04-19T03:03:10.965 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014193699999999999 2024-04-19T03:03:10.965 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:10.965 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:10.965 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:10.965 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.966 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.966 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:158372 5.0 5:0473aa5f:::benchmark_data_smithi096_19531_object44922:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-19T03:03:10.966 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:58.125924+0000", 2024-04-19T03:03:10.966 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 12.738885369, 2024-04-19T03:03:10.966 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074247490999999999, 2024-04-19T03:03:10.966 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:10.966 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:10.966 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:10.966 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:10.966 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:10.967 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 158372 2024-04-19T03:03:10.967 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.967 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:10.967 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.967 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:10.967 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125924+0000", 2024-04-19T03:03:10.967 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:10.967 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.967 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.967 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:10.967 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125924+0000", 2024-04-19T03:03:10.967 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:10.967 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.967 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.968 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:10.968 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125924+0000", 2024-04-19T03:03:10.968 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:10.968 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.968 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.968 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:10.968 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125927+0000", 2024-04-19T03:03:10.968 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5389999999999999e-06 2024-04-19T03:03:10.968 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.968 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.968 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:10.968 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125935+0000", 2024-04-19T03:03:10.968 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3259999999999998e-06 2024-04-19T03:03:10.968 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.968 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.969 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:10.969 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125940+0000", 2024-04-19T03:03:10.969 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6980000000000003e-06 2024-04-19T03:03:10.969 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.969 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.969 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:10.969 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125982+0000", 2024-04-19T03:03:10.969 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1337000000000001e-05 2024-04-19T03:03:10.969 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.969 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.969 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:10.969 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.126075+0000", 2024-04-19T03:03:10.969 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.3579999999999995e-05 2024-04-19T03:03:10.969 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.970 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.970 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:10.970 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.199953+0000", 2024-04-19T03:03:10.970 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073877604999999999 2024-04-19T03:03:10.970 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.970 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.970 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:03:10.970 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.200022+0000", 2024-04-19T03:03:10.970 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.8824000000000004e-05 2024-04-19T03:03:10.970 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.970 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.970 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:10.970 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.200172+0000", 2024-04-19T03:03:10.970 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015017700000000001 2024-04-19T03:03:10.971 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:10.971 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:10.971 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:10.971 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.971 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.971 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:158374 5.e 5:76be57a5:::benchmark_data_smithi096_19531_object44924:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-19T03:03:10.971 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:58.125988+0000", 2024-04-19T03:03:10.971 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 12.738821870000001, 2024-04-19T03:03:10.971 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.067843332000000006, 2024-04-19T03:03:10.971 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:10.971 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:10.971 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:10.971 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:10.971 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:10.972 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 158374 2024-04-19T03:03:10.972 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.972 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:10.972 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.972 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:10.972 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125988+0000", 2024-04-19T03:03:10.972 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:10.972 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.972 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.972 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:10.972 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125988+0000", 2024-04-19T03:03:10.972 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:10.972 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.972 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.973 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:10.973 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125987+0000", 2024-04-19T03:03:10.973 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:10.973 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.973 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.973 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:10.973 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125990+0000", 2024-04-19T03:03:10.973 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7989999999999998e-06 2024-04-19T03:03:10.973 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.973 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.973 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:10.973 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125996+0000", 2024-04-19T03:03:10.973 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.302e-06 2024-04-19T03:03:10.973 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.974 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.974 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:10.974 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.126001+0000", 2024-04-19T03:03:10.974 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.843e-06 2024-04-19T03:03:10.974 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.974 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.974 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:10.974 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.126047+0000", 2024-04-19T03:03:10.974 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6066000000000002e-05 2024-04-19T03:03:10.974 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.974 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.974 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:10.974 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.126171+0000", 2024-04-19T03:03:10.974 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012359099999999999 2024-04-19T03:03:10.975 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.975 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.975 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:10.975 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.193709+0000", 2024-04-19T03:03:10.975 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.067538099000000004 2024-04-19T03:03:10.975 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.975 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.975 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:03:10.975 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.193766+0000", 2024-04-19T03:03:10.975 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6869e-05 2024-04-19T03:03:10.975 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.975 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.975 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:10.975 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.193831+0000", 2024-04-19T03:03:10.976 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5273999999999999e-05 2024-04-19T03:03:10.976 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:10.976 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:10.976 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:10.976 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.976 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.976 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4755.0:158376 5.9 e56/22 5:9e73c076:::benchmark_data_smithi096_19531_object44926:head v 56'9663, mlcod=56'9661)", 2024-04-19T03:03:10.976 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:58.127307+0000", 2024-04-19T03:03:10.976 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 12.737502639000001, 2024-04-19T03:03:10.976 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069002716000000006, 2024-04-19T03:03:10.976 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:10.976 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:10.976 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:10.976 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.977 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:10.977 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.127307+0000", 2024-04-19T03:03:10.977 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:10.977 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.977 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.977 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:10.977 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.127307+0000", 2024-04-19T03:03:10.977 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:10.977 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.977 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.977 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:10.977 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.127306+0000", 2024-04-19T03:03:10.977 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:03:10.977 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.978 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.978 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:10.978 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.127316+0000", 2024-04-19T03:03:10.978 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.3039999999999994e-06 2024-04-19T03:03:10.978 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.978 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.978 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:10.978 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.127326+0000", 2024-04-19T03:03:10.978 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0009e-05 2024-04-19T03:03:10.978 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.978 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.978 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:10.978 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.127332+0000", 2024-04-19T03:03:10.978 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5880000000000003e-06 2024-04-19T03:03:10.979 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.979 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.979 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:10.979 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.127383+0000", 2024-04-19T03:03:10.979 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0516000000000002e-05 2024-04-19T03:03:10.979 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.979 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.979 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:10.979 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.127403+0000", 2024-04-19T03:03:10.979 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0547000000000002e-05 2024-04-19T03:03:10.979 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.979 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.979 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:03:10.979 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.196280+0000", 2024-04-19T03:03:10.979 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.068876863999999996 2024-04-19T03:03:10.979 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.980 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.980 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:10.980 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.196310+0000", 2024-04-19T03:03:10.980 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9762999999999999e-05 2024-04-19T03:03:10.980 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:10.980 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:10.980 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:10.980 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.980 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.980 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:158383 5.0 5:026717eb:::benchmark_data_smithi096_19531_object44933:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-19T03:03:10.980 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:58.130494+0000", 2024-04-19T03:03:10.980 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 12.734315513, 2024-04-19T03:03:10.980 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.070135775999999997, 2024-04-19T03:03:10.980 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:10.980 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:10.981 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:10.981 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:10.981 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:10.981 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 158383 2024-04-19T03:03:10.981 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.981 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:10.981 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.981 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:10.981 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.130494+0000", 2024-04-19T03:03:10.981 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:10.981 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.981 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.981 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:10.981 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.130494+0000", 2024-04-19T03:03:10.981 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:10.982 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.982 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.982 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:10.982 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.130493+0000", 2024-04-19T03:03:10.982 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:03:10.982 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.982 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.982 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:10.982 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.130500+0000", 2024-04-19T03:03:10.982 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5490000000000003e-06 2024-04-19T03:03:10.982 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.982 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.982 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:10.983 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.190401+0000", 2024-04-19T03:03:10.983 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.059901668999999998 2024-04-19T03:03:10.983 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.983 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.983 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:10.983 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.190421+0000", 2024-04-19T03:03:10.983 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0288e-05 2024-04-19T03:03:10.983 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.983 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.983 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:10.983 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.190536+0000", 2024-04-19T03:03:10.983 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000114783 2024-04-19T03:03:10.983 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.983 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.984 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:10.984 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.190904+0000", 2024-04-19T03:03:10.984 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00036773900000000001 2024-04-19T03:03:10.984 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.984 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.984 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:10.984 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.200417+0000", 2024-04-19T03:03:10.984 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0095128899999999995 2024-04-19T03:03:10.984 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.984 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.984 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:03:10.984 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.200489+0000", 2024-04-19T03:03:10.984 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2554999999999999e-05 2024-04-19T03:03:10.985 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:10.985 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:10.985 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:10.985 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.200630+0000", 2024-04-19T03:03:10.985 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014055299999999999 2024-04-19T03:03:10.985 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:10.985 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:10.985 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:10.985 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:10.985 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:10.985 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-19T03:03:10.987 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T03:03:10.987 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:03:10.984+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:03:11.087 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:03:11.084+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:03:11.111 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-04-19T03:03:11.112 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [ 2024-04-19T03:03:11.112 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.112 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:190098 5.f 5:f6b4721c:::benchmark_data_smithi096_19531_object76648:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-04-19T03:03:11.112 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:03:11.105274+0000", 2024-04-19T03:03:11.112 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0050745679999999998, 2024-04-19T03:03:11.112 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0051038029999999996, 2024-04-19T03:03:11.112 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:11.112 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:03:11.112 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:11.112 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:11.112 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:11.113 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 190098 2024-04-19T03:03:11.113 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.113 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:11.113 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.113 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:11.113 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:11.105274+0000", 2024-04-19T03:03:11.113 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:11.113 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.113 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.113 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:11.113 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:11.105274+0000", 2024-04-19T03:03:11.113 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:11.113 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.114 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.114 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:11.114 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:11.105273+0000", 2024-04-19T03:03:11.114 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:03:11.114 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.114 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.114 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:11.114 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:11.105278+0000", 2024-04-19T03:03:11.114 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.933e-06 2024-04-19T03:03:11.114 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.114 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.114 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:11.114 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:11.105292+0000", 2024-04-19T03:03:11.115 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3665e-05 2024-04-19T03:03:11.115 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.115 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.115 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:11.115 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:11.105298+0000", 2024-04-19T03:03:11.115 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4880000000000004e-06 2024-04-19T03:03:11.115 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.115 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.115 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:11.115 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:11.105340+0000", 2024-04-19T03:03:11.115 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1480999999999998e-05 2024-04-19T03:03:11.115 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.115 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.116 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:11.116 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:11.105489+0000", 2024-04-19T03:03:11.116 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00014906000000000001 2024-04-19T03:03:11.116 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.116 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.116 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:03:11.116 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:11.105597+0000", 2024-04-19T03:03:11.116 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000108204 2024-04-19T03:03:11.116 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.116 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.116 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:11.116 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:11.109953+0000", 2024-04-19T03:03:11.116 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0043561420000000003 2024-04-19T03:03:11.117 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:11.117 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:11.117 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:11.117 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.117 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.117 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:190099 5.7 5:e4a94df0:::benchmark_data_smithi096_19531_object76649:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-04-19T03:03:11.117 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:03:11.106418+0000", 2024-04-19T03:03:11.117 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0039307730000000003, 2024-04-19T03:03:11.117 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0040485829999999997, 2024-04-19T03:03:11.117 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:11.117 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-04-19T03:03:11.117 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:11.117 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:11.117 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:11.118 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 190099 2024-04-19T03:03:11.118 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.118 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:11.118 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.118 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:11.118 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:11.106418+0000", 2024-04-19T03:03:11.119 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:11.119 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.119 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.119 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:11.119 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:11.106418+0000", 2024-04-19T03:03:11.119 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:11.119 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.119 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.119 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:11.119 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:11.106417+0000", 2024-04-19T03:03:11.119 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:03:11.120 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.120 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.120 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:11.120 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:11.106422+0000", 2024-04-19T03:03:11.120 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2930000000000002e-06 2024-04-19T03:03:11.120 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.120 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.120 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:11.120 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:11.106431+0000", 2024-04-19T03:03:11.120 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.4930000000000004e-06 2024-04-19T03:03:11.121 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.121 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.121 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:11.121 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:11.106436+0000", 2024-04-19T03:03:11.121 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4739999999999999e-06 2024-04-19T03:03:11.121 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.121 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.121 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:11.121 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:11.106459+0000", 2024-04-19T03:03:11.121 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.3697e-05 2024-04-19T03:03:11.121 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.121 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.121 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:11.121 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:11.106530+0000", 2024-04-19T03:03:11.122 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0884999999999996e-05 2024-04-19T03:03:11.122 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:11.122 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:11.122 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:11.122 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.122 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.122 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:190100 5.3 5:c92b580a:::benchmark_data_smithi096_19531_object76650:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-04-19T03:03:11.122 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:03:11.106910+0000", 2024-04-19T03:03:11.122 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.003438651, 2024-04-19T03:03:11.122 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0036242499999999999, 2024-04-19T03:03:11.122 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:11.122 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-04-19T03:03:11.122 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:11.123 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:11.123 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:11.123 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 190100 2024-04-19T03:03:11.123 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.123 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:11.123 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.123 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:11.123 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:11.106910+0000", 2024-04-19T03:03:11.123 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:11.123 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.123 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.123 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:11.123 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:11.106910+0000", 2024-04-19T03:03:11.123 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:11.123 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.124 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.124 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:11.124 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:11.106909+0000", 2024-04-19T03:03:11.124 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:03:11.124 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.124 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.124 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:11.124 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:11.106914+0000", 2024-04-19T03:03:11.124 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9949999999999996e-06 2024-04-19T03:03:11.124 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.124 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.124 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:11.124 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:11.106925+0000", 2024-04-19T03:03:11.124 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0487e-05 2024-04-19T03:03:11.124 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.125 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.125 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:11.125 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:11.106931+0000", 2024-04-19T03:03:11.125 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4640000000000003e-06 2024-04-19T03:03:11.125 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.125 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.125 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:11.125 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:11.107001+0000", 2024-04-19T03:03:11.125 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0065000000000001e-05 2024-04-19T03:03:11.125 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.125 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.125 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:11.125 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:11.107138+0000", 2024-04-19T03:03:11.125 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000137007 2024-04-19T03:03:11.125 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:11.126 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:11.126 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:11.126 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.126 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.126 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:190101 5.f 5:f7ffd0bb:::benchmark_data_smithi096_19531_object76651:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-04-19T03:03:11.126 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:03:11.106958+0000", 2024-04-19T03:03:11.126 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0033912970000000001, 2024-04-19T03:03:11.126 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0036420469999999998, 2024-04-19T03:03:11.126 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:11.126 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:03:11.126 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:11.126 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:11.126 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:11.127 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 190101 2024-04-19T03:03:11.127 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.127 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:11.127 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.127 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:11.127 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:11.106958+0000", 2024-04-19T03:03:11.127 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:11.127 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.127 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.127 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:11.127 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:11.106958+0000", 2024-04-19T03:03:11.127 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:11.127 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.128 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.128 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:11.128 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:11.106957+0000", 2024-04-19T03:03:11.128 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:11.128 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.128 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.128 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:11.128 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:11.106960+0000", 2024-04-19T03:03:11.128 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0479999999999999e-06 2024-04-19T03:03:11.128 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.128 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.128 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:11.128 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:11.106967+0000", 2024-04-19T03:03:11.128 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2559999999999996e-06 2024-04-19T03:03:11.129 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.129 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.129 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:11.129 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:11.106973+0000", 2024-04-19T03:03:11.129 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.412e-06 2024-04-19T03:03:11.129 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.129 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.129 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:11.129 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:11.107398+0000", 2024-04-19T03:03:11.129 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00042554300000000001 2024-04-19T03:03:11.129 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.129 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.130 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:11.130 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:11.107477+0000", 2024-04-19T03:03:11.130 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8302999999999999e-05 2024-04-19T03:03:11.130 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.130 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.130 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:03:11.130 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:11.107542+0000", 2024-04-19T03:03:11.130 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5333999999999995e-05 2024-04-19T03:03:11.130 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:11.130 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:11.130 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:11.131 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.131 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.131 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:190104 5.7 5:e4c58186:::benchmark_data_smithi096_19531_object76654:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-04-19T03:03:11.131 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:03:11.107558+0000", 2024-04-19T03:03:11.131 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.002790744, 2024-04-19T03:03:11.131 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0031134819999999999, 2024-04-19T03:03:11.131 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:11.131 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-04-19T03:03:11.131 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:11.131 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:11.131 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:11.131 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 190104 2024-04-19T03:03:11.131 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.131 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:11.132 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.132 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:11.132 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:11.107558+0000", 2024-04-19T03:03:11.132 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:11.132 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.132 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.132 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:11.132 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:11.107558+0000", 2024-04-19T03:03:11.132 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:11.132 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.132 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.132 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:11.132 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:11.107557+0000", 2024-04-19T03:03:11.132 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:03:11.133 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.133 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.133 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:11.133 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:11.107562+0000", 2024-04-19T03:03:11.133 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3630000000000002e-06 2024-04-19T03:03:11.133 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.133 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.133 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:11.133 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:11.107570+0000", 2024-04-19T03:03:11.133 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5820000000000004e-06 2024-04-19T03:03:11.133 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.133 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.133 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:11.134 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:11.107576+0000", 2024-04-19T03:03:11.134 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3779999999999998e-06 2024-04-19T03:03:11.134 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.134 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.134 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:11.134 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:11.107950+0000", 2024-04-19T03:03:11.134 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000373192 2024-04-19T03:03:11.134 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.134 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.134 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:11.134 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:11.108102+0000", 2024-04-19T03:03:11.134 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000152645 2024-04-19T03:03:11.134 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:11.134 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:11.135 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:11.135 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.135 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.135 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:190110 5.7 5:e8ced0ad:::benchmark_data_smithi096_19531_object76660:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-04-19T03:03:11.135 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:03:11.109726+0000", 2024-04-19T03:03:11.135 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.00062253500000000002, 2024-04-19T03:03:11.135 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00100906, 2024-04-19T03:03:11.135 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:11.135 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-04-19T03:03:11.135 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:11.135 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:11.135 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:11.135 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 190110 2024-04-19T03:03:11.135 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.136 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:11.136 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.136 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:11.136 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:11.109726+0000", 2024-04-19T03:03:11.136 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:11.136 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.136 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.136 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:11.136 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:11.109726+0000", 2024-04-19T03:03:11.136 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:11.136 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.136 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.136 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:11.136 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:11.109725+0000", 2024-04-19T03:03:11.136 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:03:11.137 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.137 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.137 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:11.137 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:11.109732+0000", 2024-04-19T03:03:11.137 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4819999999999999e-06 2024-04-19T03:03:11.137 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.137 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.137 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:11.137 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:11.109743+0000", 2024-04-19T03:03:11.137 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1776999999999999e-05 2024-04-19T03:03:11.137 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.137 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.137 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:11.137 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:11.109751+0000", 2024-04-19T03:03:11.137 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.661e-06 2024-04-19T03:03:11.138 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.138 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.138 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:11.138 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:11.109952+0000", 2024-04-19T03:03:11.138 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00020116000000000001 2024-04-19T03:03:11.138 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.138 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.138 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:11.138 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:11.110031+0000", 2024-04-19T03:03:11.138 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9008e-05 2024-04-19T03:03:11.138 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:11.138 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:11.138 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:11.138 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.139 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.139 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:190111 5.2 5:4eca0d71:::benchmark_data_smithi096_19531_object76661:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-04-19T03:03:11.139 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:03:11.109764+0000", 2024-04-19T03:03:11.139 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.00058458900000000005, 2024-04-19T03:03:11.139 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001035572, 2024-04-19T03:03:11.139 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:11.139 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-04-19T03:03:11.139 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:11.139 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:11.139 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:11.139 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 190111 2024-04-19T03:03:11.139 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.139 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:11.140 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.140 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:11.140 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:11.109764+0000", 2024-04-19T03:03:11.140 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:11.140 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.140 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.140 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:11.140 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:11.109764+0000", 2024-04-19T03:03:11.140 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:11.140 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.140 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.140 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:11.140 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:11.109764+0000", 2024-04-19T03:03:11.140 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:11.140 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.141 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.141 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:11.141 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:11.109767+0000", 2024-04-19T03:03:11.141 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2329999999999998e-06 2024-04-19T03:03:11.141 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.141 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.141 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:11.141 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:11.109776+0000", 2024-04-19T03:03:11.141 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.1300000000000007e-06 2024-04-19T03:03:11.141 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.141 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.141 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:11.141 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:11.109782+0000", 2024-04-19T03:03:11.142 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8069999999999996e-06 2024-04-19T03:03:11.142 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.142 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.142 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:11.142 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:11.109823+0000", 2024-04-19T03:03:11.142 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0881999999999999e-05 2024-04-19T03:03:11.142 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.142 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.142 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:11.142 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:11.109947+0000", 2024-04-19T03:03:11.142 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00012479099999999999 2024-04-19T03:03:11.143 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:11.143 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:11.143 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:11.143 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.143 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.143 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:190112 5.9 5:97c21c5a:::benchmark_data_smithi096_19531_object76662:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-04-19T03:03:11.143 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:03:11.109803+0000", 2024-04-19T03:03:11.143 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.000545474, 2024-04-19T03:03:11.143 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0010629680000000001, 2024-04-19T03:03:11.143 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:11.143 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:03:11.143 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:11.144 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:11.144 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:11.144 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 190112 2024-04-19T03:03:11.144 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.144 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:11.144 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.144 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:11.144 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:11.109803+0000", 2024-04-19T03:03:11.144 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:11.144 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.144 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.144 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:11.145 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:11.109803+0000", 2024-04-19T03:03:11.145 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:11.145 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.145 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.145 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:11.145 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:11.109803+0000", 2024-04-19T03:03:11.145 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:11.145 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.145 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.145 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:11.145 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:11.109806+0000", 2024-04-19T03:03:11.145 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.005e-06 2024-04-19T03:03:11.146 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.146 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.146 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:11.146 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:11.109813+0000", 2024-04-19T03:03:11.146 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.3470000000000001e-06 2024-04-19T03:03:11.146 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.146 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.146 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:11.146 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:11.109820+0000", 2024-04-19T03:03:11.146 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5810000000000002e-06 2024-04-19T03:03:11.146 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.146 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.146 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:11.146 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:11.109866+0000", 2024-04-19T03:03:11.147 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6434999999999998e-05 2024-04-19T03:03:11.147 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.147 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.147 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:11.147 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:11.109996+0000", 2024-04-19T03:03:11.147 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00012929700000000001 2024-04-19T03:03:11.147 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.147 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.147 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:03:11.147 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:11.110122+0000", 2024-04-19T03:03:11.147 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00012601100000000001 2024-04-19T03:03:11.147 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:11.147 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:11.148 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:11.148 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.148 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.148 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:190113 5.7 5.a9b7277 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-04-19T03:03:11.148 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:03:11.110066+0000", 2024-04-19T03:03:11.148 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.00028274099999999998, 2024-04-19T03:03:11.148 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00086745500000000005, 2024-04-19T03:03:11.148 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:11.148 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-04-19T03:03:11.148 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:11.148 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:11.149 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:11.149 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 190113 2024-04-19T03:03:11.149 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.149 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:11.149 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.149 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:11.149 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:11.110066+0000", 2024-04-19T03:03:11.149 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:11.149 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.149 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.149 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:11.149 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:11.110066+0000", 2024-04-19T03:03:11.149 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:11.149 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.150 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.150 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:11.150 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:11.110065+0000", 2024-04-19T03:03:11.150 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:03:11.150 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.150 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.150 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:11.150 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:11.110070+0000", 2024-04-19T03:03:11.150 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.254e-06 2024-04-19T03:03:11.150 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.150 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.150 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:11.150 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:11.110086+0000", 2024-04-19T03:03:11.151 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.5364999999999999e-05 2024-04-19T03:03:11.151 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.151 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.151 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:11.151 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:11.110093+0000", 2024-04-19T03:03:11.151 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.413e-06 2024-04-19T03:03:11.151 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:11.151 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:11.151 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:11.151 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.151 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.151 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:190114 5.5 5:aa8a7a5f:::benchmark_data_smithi096_19531_object76664:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-04-19T03:03:11.151 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:03:11.110103+0000", 2024-04-19T03:03:11.152 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.00024572100000000001, 2024-04-19T03:03:11.152 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00088425000000000005, 2024-04-19T03:03:11.152 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:11.152 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-04-19T03:03:11.152 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:11.152 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:11.152 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:11.152 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 190114 2024-04-19T03:03:11.152 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.152 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:11.152 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.152 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:11.152 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:11.110103+0000", 2024-04-19T03:03:11.153 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:11.153 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.153 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.153 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:11.153 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:11.110103+0000", 2024-04-19T03:03:11.153 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:11.153 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.153 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.153 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:11.153 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:11.110103+0000", 2024-04-19T03:03:11.153 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:11.153 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.153 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.153 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:11.154 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:11.110106+0000", 2024-04-19T03:03:11.154 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5329999999999999e-06 2024-04-19T03:03:11.154 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.154 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.154 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:11.154 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:11.110113+0000", 2024-04-19T03:03:11.154 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.1239999999999999e-06 2024-04-19T03:03:11.154 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.154 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.154 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:11.154 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:11.110119+0000", 2024-04-19T03:03:11.154 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4389999999999999e-06 2024-04-19T03:03:11.154 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.155 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.155 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:11.155 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:11.110164+0000", 2024-04-19T03:03:11.155 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5274000000000001e-05 2024-04-19T03:03:11.155 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.155 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.155 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:11.155 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:11.110273+0000", 2024-04-19T03:03:11.155 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00010877700000000001 2024-04-19T03:03:11.155 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:11.155 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:11.155 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:11.155 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.155 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.155 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop_reply(client.4755.0:190101 5.f e60/22)", 2024-04-19T03:03:11.156 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:03:11.110317+0000", 2024-04-19T03:03:11.156 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 3.1522000000000001e-05, 2024-04-19T03:03:11.156 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00072964600000000003, 2024-04-19T03:03:11.156 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:11.156 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-04-19T03:03:11.156 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:11.156 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.156 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:11.156 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:11.110317+0000", 2024-04-19T03:03:11.156 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:11.156 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.156 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.156 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:11.157 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:11.110317+0000", 2024-04-19T03:03:11.157 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:11.157 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.157 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.157 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:11.157 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:11.110317+0000", 2024-04-19T03:03:11.157 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:11.157 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.157 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.157 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:11.157 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:11.110321+0000", 2024-04-19T03:03:11.157 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1930000000000003e-06 2024-04-19T03:03:11.157 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.157 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.158 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:11.158 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:11.110328+0000", 2024-04-19T03:03:11.158 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.9280000000000004e-06 2024-04-19T03:03:11.158 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.158 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.158 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:11.158 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:11.110332+0000", 2024-04-19T03:03:11.158 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3680000000000004e-06 2024-04-19T03:03:11.158 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:11.158 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:11.158 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:11.158 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:11.158 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-04-19T03:03:11.159 INFO:teuthology.orchestra.run.smithi144.stdout: "num_ops": 11 2024-04-19T03:03:11.159 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-04-19T03:03:11.160 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T03:03:11.188 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:03:11.186+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:03:11.288 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:03:11.284+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:03:11.292 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-04-19T03:03:11.292 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2024-04-19T03:03:11.292 INFO:teuthology.orchestra.run.smithi144.stdout: "complaint_time": 30, 2024-04-19T03:03:11.292 INFO:teuthology.orchestra.run.smithi144.stdout: "num_blocked_ops": 0 2024-04-19T03:03:11.292 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-04-19T03:03:11.305 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T03:03:11.389 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:03:11.384+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:03:11.481 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-04-19T03:03:11.482 INFO:teuthology.orchestra.run.smithi144.stdout: "size": 20, 2024-04-19T03:03:11.482 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 600, 2024-04-19T03:03:11.482 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [ 2024-04-19T03:03:11.482 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.482 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:78992 5.7 5:e6baa862:::benchmark_data_smithi096_19531_object78991:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-19T03:03:11.482 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:18.008888+0000", 2024-04-19T03:03:11.482 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 53.469885253000001, 2024-04-19T03:03:11.482 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.056375285999999997, 2024-04-19T03:03:11.482 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:11.482 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:11.482 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:11.483 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:11.483 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:11.483 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 78992 2024-04-19T03:03:11.483 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.483 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:11.483 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.483 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:11.483 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.008888+0000", 2024-04-19T03:03:11.483 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:11.483 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.483 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.483 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:11.484 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.008888+0000", 2024-04-19T03:03:11.484 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:11.484 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.484 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.484 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:11.484 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.008888+0000", 2024-04-19T03:03:11.484 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:11.484 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.484 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.484 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:11.484 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.008928+0000", 2024-04-19T03:03:11.484 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0361999999999997e-05 2024-04-19T03:03:11.484 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.485 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.485 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:11.485 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.008942+0000", 2024-04-19T03:03:11.485 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4365000000000001e-05 2024-04-19T03:03:11.485 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.485 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.485 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:11.485 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.008949+0000", 2024-04-19T03:03:11.485 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.212e-06 2024-04-19T03:03:11.485 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.485 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.485 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:11.485 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.012683+0000", 2024-04-19T03:03:11.486 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.003733934 2024-04-19T03:03:11.486 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.486 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.486 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:11.486 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.012798+0000", 2024-04-19T03:03:11.486 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00011574999999999999 2024-04-19T03:03:11.486 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.486 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.486 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:11.486 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.012896+0000", 2024-04-19T03:03:11.486 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.7848000000000002e-05 2024-04-19T03:03:11.486 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.486 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.487 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:03:11.487 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016423+0000", 2024-04-19T03:03:11.487 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0035270789999999998 2024-04-19T03:03:11.487 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.487 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.487 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:11.487 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.065098+0000", 2024-04-19T03:03:11.487 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.048674651999999999 2024-04-19T03:03:11.487 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.487 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.487 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:03:11.487 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.065193+0000", 2024-04-19T03:03:11.487 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.5087999999999995e-05 2024-04-19T03:03:11.488 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.488 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.488 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:11.488 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.065264+0000", 2024-04-19T03:03:11.488 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0666000000000004e-05 2024-04-19T03:03:11.488 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:11.488 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:11.488 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:11.488 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.488 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.488 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4755.0:79003 5.2 e40/39 5:4436e33f:::benchmark_data_smithi096_19531_object79002:head v 40'4935, mlcod=40'4932)", 2024-04-19T03:03:11.488 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:18.018102+0000", 2024-04-19T03:03:11.488 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 53.460671197000003, 2024-04-19T03:03:11.488 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.060023990999999999, 2024-04-19T03:03:11.489 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:11.489 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:11.489 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:11.489 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.489 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:11.489 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018102+0000", 2024-04-19T03:03:11.489 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:11.489 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.489 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.489 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:11.489 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018102+0000", 2024-04-19T03:03:11.490 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:11.490 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.490 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.490 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:11.490 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018102+0000", 2024-04-19T03:03:11.490 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:11.490 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.490 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.490 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:11.490 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018134+0000", 2024-04-19T03:03:11.490 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2722000000000003e-05 2024-04-19T03:03:11.490 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.491 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.491 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:11.491 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018145+0000", 2024-04-19T03:03:11.491 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0395e-05 2024-04-19T03:03:11.491 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.491 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.491 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:11.491 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018151+0000", 2024-04-19T03:03:11.491 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5300000000000002e-06 2024-04-19T03:03:11.491 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.491 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.491 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:11.492 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018489+0000", 2024-04-19T03:03:11.492 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00033731499999999998 2024-04-19T03:03:11.492 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.492 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.492 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:11.492 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018508+0000", 2024-04-19T03:03:11.492 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9775e-05 2024-04-19T03:03:11.492 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.492 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.492 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:03:11.492 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.078059+0000", 2024-04-19T03:03:11.492 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.059550171999999998 2024-04-19T03:03:11.492 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.492 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.493 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:11.493 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.078126+0000", 2024-04-19T03:03:11.493 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7773000000000003e-05 2024-04-19T03:03:11.493 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:11.493 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:11.493 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:11.493 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.493 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.493 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:86612 5.7 5:e32e3c49:::benchmark_data_smithi096_19531_object86611:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:11.493 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:22.633560+0000", 2024-04-19T03:03:11.493 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 48.845213536999999, 2024-04-19T03:03:11.493 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.19135289, 2024-04-19T03:03:11.494 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:11.494 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:11.494 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:11.494 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:11.494 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:11.494 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 86612 2024-04-19T03:03:11.494 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.494 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:11.494 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.494 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:11.494 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633560+0000", 2024-04-19T03:03:11.494 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:11.494 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.495 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.495 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:11.495 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633560+0000", 2024-04-19T03:03:11.495 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:11.495 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.495 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.495 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:11.495 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633558+0000", 2024-04-19T03:03:11.495 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999986 2024-04-19T03:03:11.495 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.495 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.495 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:11.495 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633609+0000", 2024-04-19T03:03:11.496 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0850999999999998e-05 2024-04-19T03:03:11.496 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.496 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.496 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:11.496 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633627+0000", 2024-04-19T03:03:11.496 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7951000000000001e-05 2024-04-19T03:03:11.496 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.496 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.496 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:11.496 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633635+0000", 2024-04-19T03:03:11.496 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2530000000000004e-06 2024-04-19T03:03:11.496 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.496 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.496 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:11.497 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633699+0000", 2024-04-19T03:03:11.497 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3901999999999999e-05 2024-04-19T03:03:11.497 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.497 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.497 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:11.497 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633992+0000", 2024-04-19T03:03:11.497 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00029283299999999999 2024-04-19T03:03:11.497 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.497 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.497 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:11.497 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.634223+0000", 2024-04-19T03:03:11.497 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00023084200000000001 2024-04-19T03:03:11.497 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.497 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.498 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:03:11.498 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.639085+0000", 2024-04-19T03:03:11.498 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0048624269999999999 2024-04-19T03:03:11.498 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.498 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.498 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:11.498 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.824635+0000", 2024-04-19T03:03:11.498 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.18554944700000001 2024-04-19T03:03:11.498 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.498 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.498 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:03:11.498 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.824793+0000", 2024-04-19T03:03:11.498 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000157959 2024-04-19T03:03:11.499 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.499 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.499 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:11.499 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.824913+0000", 2024-04-19T03:03:11.499 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000120093 2024-04-19T03:03:11.499 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:11.499 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:11.499 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:11.499 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.499 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.499 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:86625 5.7 5:e6d00488:::benchmark_data_smithi096_19531_object86624:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:11.499 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:22.643554+0000", 2024-04-19T03:03:11.499 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 48.835219770999998, 2024-04-19T03:03:11.500 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.18732841, 2024-04-19T03:03:11.500 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:11.500 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:11.500 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:11.500 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:11.500 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:11.500 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 86625 2024-04-19T03:03:11.500 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.500 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:11.500 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.500 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:11.500 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643554+0000", 2024-04-19T03:03:11.500 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:11.501 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.501 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.501 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:11.501 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643554+0000", 2024-04-19T03:03:11.501 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:11.501 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.501 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.501 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:11.501 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643552+0000", 2024-04-19T03:03:11.501 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999986 2024-04-19T03:03:11.501 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.501 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.501 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:11.502 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643588+0000", 2024-04-19T03:03:11.502 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5855999999999997e-05 2024-04-19T03:03:11.502 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.502 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.502 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:11.502 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643606+0000", 2024-04-19T03:03:11.502 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8226000000000001e-05 2024-04-19T03:03:11.502 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.502 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.502 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:11.502 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643618+0000", 2024-04-19T03:03:11.502 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1868000000000001e-05 2024-04-19T03:03:11.502 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.503 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.503 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:11.503 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643676+0000", 2024-04-19T03:03:11.503 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8153999999999999e-05 2024-04-19T03:03:11.503 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.503 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.503 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:11.503 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643905+0000", 2024-04-19T03:03:11.503 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00022847500000000001 2024-04-19T03:03:11.503 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.503 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.503 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:11.503 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.644150+0000", 2024-04-19T03:03:11.504 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00024531800000000001 2024-04-19T03:03:11.504 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.504 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.504 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:03:11.504 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.647407+0000", 2024-04-19T03:03:11.504 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0032563190000000001 2024-04-19T03:03:11.504 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.504 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.504 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:11.504 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.830721+0000", 2024-04-19T03:03:11.504 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.18331468300000001 2024-04-19T03:03:11.504 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.504 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.505 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:03:11.505 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.830813+0000", 2024-04-19T03:03:11.505 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.2205000000000002e-05 2024-04-19T03:03:11.505 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.505 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.505 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:11.505 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.830882+0000", 2024-04-19T03:03:11.505 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8819999999999995e-05 2024-04-19T03:03:11.505 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:11.505 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:11.505 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:11.505 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.505 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.506 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87063 5.7 5:e502e824:::benchmark_data_smithi096_19531_object87062:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:11.506 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.136067+0000", 2024-04-19T03:03:11.506 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 48.342706902000003, 2024-04-19T03:03:11.506 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.065521159999999995, 2024-04-19T03:03:11.506 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:11.506 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:11.506 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:11.506 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:11.506 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:11.506 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87063 2024-04-19T03:03:11.506 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.506 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:11.506 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.507 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:11.507 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.136067+0000", 2024-04-19T03:03:11.507 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:11.507 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.507 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.507 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:11.507 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.136067+0000", 2024-04-19T03:03:11.507 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:11.507 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.507 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.507 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:11.508 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.136066+0000", 2024-04-19T03:03:11.508 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:03:11.508 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.508 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.508 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:11.508 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.136154+0000", 2024-04-19T03:03:11.508 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.8256000000000003e-05 2024-04-19T03:03:11.508 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.508 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.508 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:11.508 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.136162+0000", 2024-04-19T03:03:11.508 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.5099999999999998e-06 2024-04-19T03:03:11.508 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.508 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.509 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:11.509 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.136171+0000", 2024-04-19T03:03:11.509 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2830000000000001e-06 2024-04-19T03:03:11.509 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.509 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.509 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:11.509 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.138421+0000", 2024-04-19T03:03:11.509 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0022506620000000001 2024-04-19T03:03:11.509 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.509 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.509 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:11.509 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.138560+0000", 2024-04-19T03:03:11.509 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000138446 2024-04-19T03:03:11.510 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.510 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.510 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:11.510 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.138689+0000", 2024-04-19T03:03:11.510 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00012950700000000001 2024-04-19T03:03:11.510 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.510 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.510 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:03:11.510 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.141517+0000", 2024-04-19T03:03:11.510 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0028280860000000001 2024-04-19T03:03:11.510 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.510 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.510 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:11.510 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.201350+0000", 2024-04-19T03:03:11.511 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.059832418999999998 2024-04-19T03:03:11.511 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.511 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.511 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:03:11.511 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.201485+0000", 2024-04-19T03:03:11.511 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000135597 2024-04-19T03:03:11.511 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.511 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.511 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:11.511 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.201588+0000", 2024-04-19T03:03:11.511 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00010247900000000001 2024-04-19T03:03:11.511 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:11.511 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:11.512 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:11.512 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.512 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.512 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87072 5.7 5:e3c7809a:::benchmark_data_smithi096_19531_object87071:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:11.512 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.144224+0000", 2024-04-19T03:03:11.512 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 48.334549877999997, 2024-04-19T03:03:11.512 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.058179555000000001, 2024-04-19T03:03:11.512 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:11.512 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:11.512 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:11.512 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:11.512 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:11.512 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87072 2024-04-19T03:03:11.513 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.513 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:11.513 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.513 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:11.513 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144224+0000", 2024-04-19T03:03:11.513 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:11.513 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.513 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.513 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:11.513 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144224+0000", 2024-04-19T03:03:11.513 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:11.513 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.513 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.514 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:11.514 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144223+0000", 2024-04-19T03:03:11.514 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:03:11.514 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.514 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.514 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:11.514 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144320+0000", 2024-04-19T03:03:11.514 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.7075000000000001e-05 2024-04-19T03:03:11.514 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.514 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.514 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:11.514 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144331+0000", 2024-04-19T03:03:11.514 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1342000000000001e-05 2024-04-19T03:03:11.515 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.515 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.515 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:11.515 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144337+0000", 2024-04-19T03:03:11.515 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8390000000000003e-06 2024-04-19T03:03:11.515 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.515 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.515 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:11.515 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144369+0000", 2024-04-19T03:03:11.515 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2079000000000002e-05 2024-04-19T03:03:11.515 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.515 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.515 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:11.515 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144464+0000", 2024-04-19T03:03:11.516 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.4623000000000005e-05 2024-04-19T03:03:11.516 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.516 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.516 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:11.516 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144553+0000", 2024-04-19T03:03:11.516 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9171000000000004e-05 2024-04-19T03:03:11.516 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.516 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.516 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:03:11.516 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.147018+0000", 2024-04-19T03:03:11.516 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0024648370000000001 2024-04-19T03:03:11.516 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.516 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.517 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:11.517 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.202270+0000", 2024-04-19T03:03:11.517 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.055252018 2024-04-19T03:03:11.517 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.517 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.517 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:03:11.517 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.202356+0000", 2024-04-19T03:03:11.517 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6648000000000001e-05 2024-04-19T03:03:11.517 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.517 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.517 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:11.517 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.202403+0000", 2024-04-19T03:03:11.517 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6956999999999998e-05 2024-04-19T03:03:11.518 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:11.518 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:11.518 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:11.518 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.518 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.518 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87123 5.6 5:6d1bc3b9:::benchmark_data_smithi096_19531_object87122:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:03:11.518 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249233+0000", 2024-04-19T03:03:11.518 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 48.229540845999999, 2024-04-19T03:03:11.518 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0291700720000001, 2024-04-19T03:03:11.518 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:11.518 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-04-19T03:03:11.518 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:11.519 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:11.519 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:11.519 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87123 2024-04-19T03:03:11.519 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.519 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:11.519 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.519 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:11.519 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249233+0000", 2024-04-19T03:03:11.519 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:11.519 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.519 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.519 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:11.519 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249233+0000", 2024-04-19T03:03:11.520 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:11.520 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.520 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.520 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:11.520 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249231+0000", 2024-04-19T03:03:11.520 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999986 2024-04-19T03:03:11.520 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.520 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.520 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:11.520 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249285+0000", 2024-04-19T03:03:11.520 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4005000000000002e-05 2024-04-19T03:03:11.520 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.520 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.520 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:11.521 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249300+0000", 2024-04-19T03:03:11.521 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4715999999999999e-05 2024-04-19T03:03:11.521 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.521 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.521 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:11.521 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249307+0000", 2024-04-19T03:03:11.521 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8399999999999997e-06 2024-04-19T03:03:11.521 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.521 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.521 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:11.521 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249366+0000", 2024-04-19T03:03:11.521 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9435999999999998e-05 2024-04-19T03:03:11.521 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.521 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.522 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op must wait for map", 2024-04-19T03:03:11.522 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249376+0000", 2024-04-19T03:03:11.522 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.4919999999999999e-06 2024-04-19T03:03:11.522 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.522 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.522 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:11.522 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263757+0000", 2024-04-19T03:03:11.522 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.014381461999999999 2024-04-19T03:03:11.522 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.522 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.522 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:03:11.522 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263875+0000", 2024-04-19T03:03:11.523 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000117166 2024-04-19T03:03:11.523 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.523 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.523 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:11.523 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.277136+0000", 2024-04-19T03:03:11.523 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.013261207 2024-04-19T03:03:11.523 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.523 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.523 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:11.523 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.278403+0000", 2024-04-19T03:03:11.523 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001267106 2024-04-19T03:03:11.523 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:11.523 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:11.524 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:11.524 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.524 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.524 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87128 5.6 5:6905c420:::benchmark_data_smithi096_19531_object87127:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:03:11.524 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249323+0000", 2024-04-19T03:03:11.524 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 48.229450098999997, 2024-04-19T03:03:11.524 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0292813249999999, 2024-04-19T03:03:11.524 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:11.524 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-04-19T03:03:11.524 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:11.524 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:11.524 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:11.524 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87128 2024-04-19T03:03:11.525 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.525 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:11.525 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.525 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:11.525 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249323+0000", 2024-04-19T03:03:11.525 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:11.525 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.525 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.525 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:11.525 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249323+0000", 2024-04-19T03:03:11.525 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:11.525 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.525 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.526 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:11.526 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249323+0000", 2024-04-19T03:03:11.526 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:11.526 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.526 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.526 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:11.526 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249385+0000", 2024-04-19T03:03:11.526 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1711999999999995e-05 2024-04-19T03:03:11.526 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.526 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.526 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:11.526 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249398+0000", 2024-04-19T03:03:11.526 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3022e-05 2024-04-19T03:03:11.527 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.527 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.527 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:11.527 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249402+0000", 2024-04-19T03:03:11.527 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4819999999999996e-06 2024-04-19T03:03:11.527 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.527 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.527 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:11.527 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249437+0000", 2024-04-19T03:03:11.527 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4702000000000001e-05 2024-04-19T03:03:11.527 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.527 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.527 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:03:11.528 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249442+0000", 2024-04-19T03:03:11.528 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8019999999999999e-06 2024-04-19T03:03:11.528 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.528 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.528 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:11.528 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263896+0000", 2024-04-19T03:03:11.528 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.014454679999999999 2024-04-19T03:03:11.528 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.528 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.528 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:03:11.528 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263900+0000", 2024-04-19T03:03:11.528 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9700000000000001e-06 2024-04-19T03:03:11.528 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.528 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.528 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:11.529 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.278557+0000", 2024-04-19T03:03:11.529 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0146566480000001 2024-04-19T03:03:11.529 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.529 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.529 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:11.529 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.278605+0000", 2024-04-19T03:03:11.529 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7735999999999998e-05 2024-04-19T03:03:11.529 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:11.529 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:11.529 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:11.529 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.529 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.529 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87130 5.3 5:c8c2d67b:::benchmark_data_smithi096_19531_object87129:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:03:11.529 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249418+0000", 2024-04-19T03:03:11.530 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 48.229355388000002, 2024-04-19T03:03:11.530 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.025414182, 2024-04-19T03:03:11.530 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:11.530 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-04-19T03:03:11.530 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:11.530 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:11.530 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:11.530 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87130 2024-04-19T03:03:11.530 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.530 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:11.530 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.530 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:11.530 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249418+0000", 2024-04-19T03:03:11.531 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:11.531 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.531 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.531 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:11.531 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249418+0000", 2024-04-19T03:03:11.531 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:11.531 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.531 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.531 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:11.531 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249409+0000", 2024-04-19T03:03:11.531 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999905 2024-04-19T03:03:11.531 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.531 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.532 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:11.532 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249464+0000", 2024-04-19T03:03:11.532 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5381999999999999e-05 2024-04-19T03:03:11.532 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.532 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.532 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:11.532 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249471+0000", 2024-04-19T03:03:11.532 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2609999999999996e-06 2024-04-19T03:03:11.532 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.532 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.532 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:11.532 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249475+0000", 2024-04-19T03:03:11.532 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2839999999999998e-06 2024-04-19T03:03:11.533 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.533 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.533 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:11.533 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249535+0000", 2024-04-19T03:03:11.533 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0545999999999999e-05 2024-04-19T03:03:11.533 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.533 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.533 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op must wait for map", 2024-04-19T03:03:11.533 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249540+0000", 2024-04-19T03:03:11.533 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2859999999999999e-06 2024-04-19T03:03:11.533 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.533 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.533 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:11.534 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263450+0000", 2024-04-19T03:03:11.534 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.013909585 2024-04-19T03:03:11.534 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.534 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.534 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:03:11.534 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263458+0000", 2024-04-19T03:03:11.534 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8089999999999993e-06 2024-04-19T03:03:11.534 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.534 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.534 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:11.534 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.273193+0000", 2024-04-19T03:03:11.534 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0097351379999999 2024-04-19T03:03:11.535 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.535 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.535 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:11.535 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.274832+0000", 2024-04-19T03:03:11.535 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0016394789999999999 2024-04-19T03:03:11.535 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:11.535 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:11.535 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:11.535 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.535 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.535 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87131 5.1 5:83756d55:::benchmark_data_smithi096_19531_object87130:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:03:11.535 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249491+0000", 2024-04-19T03:03:11.535 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 48.229282740999999, 2024-04-19T03:03:11.536 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0191489520000001, 2024-04-19T03:03:11.536 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:11.536 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-04-19T03:03:11.536 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:11.536 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:11.536 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:11.536 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87131 2024-04-19T03:03:11.536 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.536 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:11.536 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.536 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:11.536 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249491+0000", 2024-04-19T03:03:11.536 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:11.536 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.537 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.537 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:11.537 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249491+0000", 2024-04-19T03:03:11.537 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:11.537 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.537 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.537 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:11.537 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249491+0000", 2024-04-19T03:03:11.537 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:11.537 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.537 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.537 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:11.537 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249530+0000", 2024-04-19T03:03:11.537 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9589000000000003e-05 2024-04-19T03:03:11.538 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.538 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.538 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:11.538 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249544+0000", 2024-04-19T03:03:11.538 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4158000000000001e-05 2024-04-19T03:03:11.538 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.538 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.538 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:11.538 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249549+0000", 2024-04-19T03:03:11.538 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6809999999999997e-06 2024-04-19T03:03:11.538 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.538 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.538 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:11.538 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249592+0000", 2024-04-19T03:03:11.539 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3285999999999999e-05 2024-04-19T03:03:11.539 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.539 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.539 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op must wait for map", 2024-04-19T03:03:11.539 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249598+0000", 2024-04-19T03:03:11.539 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8329999999999999e-06 2024-04-19T03:03:11.539 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.539 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.539 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:11.539 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263331+0000", 2024-04-19T03:03:11.539 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.013733093 2024-04-19T03:03:11.539 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.539 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.539 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:03:11.540 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263343+0000", 2024-04-19T03:03:11.540 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.189e-05 2024-04-19T03:03:11.540 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.540 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.540 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:11.540 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.268541+0000", 2024-04-19T03:03:11.540 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0051983440000001 2024-04-19T03:03:11.540 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.540 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.540 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:11.540 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.268640+0000", 2024-04-19T03:03:11.540 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.8387999999999994e-05 2024-04-19T03:03:11.540 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:11.540 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:11.541 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:11.541 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.541 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.541 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87132 5.c 5:3e18b732:::benchmark_data_smithi096_19531_object87131:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:03:11.541 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249558+0000", 2024-04-19T03:03:11.541 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 48.229215840000002, 2024-04-19T03:03:11.541 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0241198380000001, 2024-04-19T03:03:11.541 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:11.541 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-04-19T03:03:11.541 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:11.541 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:11.541 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:11.541 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87132 2024-04-19T03:03:11.542 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.542 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:11.542 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.542 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:11.542 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249558+0000", 2024-04-19T03:03:11.542 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:11.542 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.542 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.542 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:11.542 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249558+0000", 2024-04-19T03:03:11.542 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:11.542 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.542 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.543 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:11.543 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249557+0000", 2024-04-19T03:03:11.543 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:11.543 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.543 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.543 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:11.543 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249625+0000", 2024-04-19T03:03:11.543 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7200999999999996e-05 2024-04-19T03:03:11.543 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.543 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.543 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:11.543 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249646+0000", 2024-04-19T03:03:11.544 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1053e-05 2024-04-19T03:03:11.544 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.544 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.544 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:11.544 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249650+0000", 2024-04-19T03:03:11.544 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2719999999999999e-06 2024-04-19T03:03:11.544 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.544 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.544 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:11.544 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249686+0000", 2024-04-19T03:03:11.544 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6430000000000002e-05 2024-04-19T03:03:11.544 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.544 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.544 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op must wait for map", 2024-04-19T03:03:11.545 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249690+0000", 2024-04-19T03:03:11.545 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.765e-06 2024-04-19T03:03:11.545 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.545 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.545 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:11.545 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261157+0000", 2024-04-19T03:03:11.545 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011467247999999999 2024-04-19T03:03:11.545 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.545 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.545 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:03:11.545 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261170+0000", 2024-04-19T03:03:11.546 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2833000000000001e-05 2024-04-19T03:03:11.546 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.546 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.546 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:11.546 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.272119+0000", 2024-04-19T03:03:11.546 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.010949313 2024-04-19T03:03:11.546 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.546 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.546 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:11.546 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.273678+0000", 2024-04-19T03:03:11.546 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0015581550000000001 2024-04-19T03:03:11.546 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:11.546 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:11.547 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:11.547 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.547 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.547 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87133 5.c 5:3f772a62:::benchmark_data_smithi096_19531_object87132:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:03:11.547 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249657+0000", 2024-04-19T03:03:11.547 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 48.229116460999997, 2024-04-19T03:03:11.547 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0242819409999999, 2024-04-19T03:03:11.547 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:11.547 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-04-19T03:03:11.547 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:11.547 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:11.547 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:11.547 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87133 2024-04-19T03:03:11.547 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.548 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:11.548 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.548 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:11.548 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249657+0000", 2024-04-19T03:03:11.548 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:11.548 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.548 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.548 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:11.548 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249657+0000", 2024-04-19T03:03:11.548 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:11.548 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.548 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.548 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:11.548 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249657+0000", 2024-04-19T03:03:11.549 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:11.549 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.549 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.549 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:11.549 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249690+0000", 2024-04-19T03:03:11.549 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3343000000000002e-05 2024-04-19T03:03:11.549 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.549 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.549 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:11.549 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249695+0000", 2024-04-19T03:03:11.549 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8600000000000001e-06 2024-04-19T03:03:11.549 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.549 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.549 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:11.550 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249698+0000", 2024-04-19T03:03:11.550 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.1700000000000001e-06 2024-04-19T03:03:11.550 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.550 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.550 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:11.550 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249741+0000", 2024-04-19T03:03:11.550 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2849999999999998e-05 2024-04-19T03:03:11.550 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.550 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.550 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:03:11.550 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249746+0000", 2024-04-19T03:03:11.550 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1019999999999996e-06 2024-04-19T03:03:11.551 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.551 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.551 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:11.551 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261209+0000", 2024-04-19T03:03:11.551 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011462447000000001 2024-04-19T03:03:11.551 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.551 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.551 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:03:11.551 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261216+0000", 2024-04-19T03:03:11.551 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8520000000000004e-06 2024-04-19T03:03:11.551 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.551 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.551 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:11.551 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.273872+0000", 2024-04-19T03:03:11.552 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0126558000000001 2024-04-19T03:03:11.552 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.552 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.552 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:11.552 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.273939+0000", 2024-04-19T03:03:11.552 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6822000000000005e-05 2024-04-19T03:03:11.552 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:11.552 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:11.552 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:11.552 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.552 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.552 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87134 5.5 5:a56c478f:::benchmark_data_smithi096_19531_object87133:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:03:11.552 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249708+0000", 2024-04-19T03:03:11.552 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 48.229065536999997, 2024-04-19T03:03:11.552 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0214677299999999, 2024-04-19T03:03:11.553 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:11.553 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-04-19T03:03:11.553 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:11.553 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:11.553 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:11.553 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87134 2024-04-19T03:03:11.553 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.553 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:11.553 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.553 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:11.553 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249708+0000", 2024-04-19T03:03:11.553 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:11.553 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.554 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.554 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:11.554 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249708+0000", 2024-04-19T03:03:11.554 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:11.554 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.554 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.554 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:11.554 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249706+0000", 2024-04-19T03:03:11.554 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999976 2024-04-19T03:03:11.554 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.554 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.554 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:11.554 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249740+0000", 2024-04-19T03:03:11.554 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4458000000000001e-05 2024-04-19T03:03:11.555 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.555 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.555 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:11.555 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249745+0000", 2024-04-19T03:03:11.555 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5020000000000003e-06 2024-04-19T03:03:11.555 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.555 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.555 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:11.555 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249748+0000", 2024-04-19T03:03:11.555 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2499999999999998e-06 2024-04-19T03:03:11.555 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.555 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.555 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:11.555 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249778+0000", 2024-04-19T03:03:11.556 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.006e-05 2024-04-19T03:03:11.556 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.556 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.556 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op must wait for map", 2024-04-19T03:03:11.556 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249782+0000", 2024-04-19T03:03:11.556 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2910000000000001e-06 2024-04-19T03:03:11.556 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.556 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.556 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:11.556 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261666+0000", 2024-04-19T03:03:11.556 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011883471 2024-04-19T03:03:11.556 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.556 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.556 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:03:11.557 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261674+0000", 2024-04-19T03:03:11.557 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6479999999999992e-06 2024-04-19T03:03:11.557 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.557 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.557 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:11.557 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.269323+0000", 2024-04-19T03:03:11.557 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.00764867 2024-04-19T03:03:11.557 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.557 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.557 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:11.557 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.271176+0000", 2024-04-19T03:03:11.557 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001852844 2024-04-19T03:03:11.557 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:11.557 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:11.558 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:11.558 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.558 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.558 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87137 5.c 5:30708c68:::benchmark_data_smithi096_19531_object87136:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:03:11.558 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249756+0000", 2024-04-19T03:03:11.558 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 48.229017831, 2024-04-19T03:03:11.558 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.033331752, 2024-04-19T03:03:11.558 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:11.558 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:11.558 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:11.558 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:11.558 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:11.558 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87137 2024-04-19T03:03:11.559 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.559 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:11.559 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.559 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:11.559 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249756+0000", 2024-04-19T03:03:11.559 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:11.559 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.559 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.559 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:11.559 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249756+0000", 2024-04-19T03:03:11.559 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:11.559 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.559 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.559 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:11.560 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249755+0000", 2024-04-19T03:03:11.560 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:11.560 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.560 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.560 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:11.560 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249777+0000", 2024-04-19T03:03:11.560 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1420000000000002e-05 2024-04-19T03:03:11.560 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.560 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.560 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:11.560 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249781+0000", 2024-04-19T03:03:11.560 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0609999999999997e-06 2024-04-19T03:03:11.560 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.560 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.561 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:11.561 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249787+0000", 2024-04-19T03:03:11.561 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.02e-06 2024-04-19T03:03:11.561 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.561 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.561 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:11.561 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249818+0000", 2024-04-19T03:03:11.561 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0947e-05 2024-04-19T03:03:11.561 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.561 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.561 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:03:11.562 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249821+0000", 2024-04-19T03:03:11.562 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.117e-06 2024-04-19T03:03:11.562 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.562 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.562 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:11.562 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261243+0000", 2024-04-19T03:03:11.562 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011421875999999999 2024-04-19T03:03:11.562 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.562 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.562 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:03:11.562 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261251+0000", 2024-04-19T03:03:11.562 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6120000000000001e-06 2024-04-19T03:03:11.562 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.563 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.563 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:11.563 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.274050+0000", 2024-04-19T03:03:11.563 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.012799405 2024-04-19T03:03:11.563 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.563 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.563 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:11.563 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.274529+0000", 2024-04-19T03:03:11.563 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00047867100000000001 2024-04-19T03:03:11.563 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.563 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.563 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:03:11.563 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.282972+0000", 2024-04-19T03:03:11.563 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0084436900000000002 2024-04-19T03:03:11.564 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.564 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.564 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:03:11.564 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.283022+0000", 2024-04-19T03:03:11.564 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9339000000000003e-05 2024-04-19T03:03:11.564 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.564 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.564 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:11.564 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.283088+0000", 2024-04-19T03:03:11.564 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5877999999999995e-05 2024-04-19T03:03:11.564 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:11.564 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:11.564 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:11.564 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.565 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.565 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:158376 5.9 5:9e73c076:::benchmark_data_smithi096_19531_object44926:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-19T03:03:11.565 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:58.126227+0000", 2024-04-19T03:03:11.565 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 13.352546097999999, 2024-04-19T03:03:11.565 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.069738668000000004, 2024-04-19T03:03:11.565 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:11.565 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:11.565 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:11.565 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:11.565 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:11.565 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 158376 2024-04-19T03:03:11.565 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.565 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:11.565 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.566 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:11.566 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.126227+0000", 2024-04-19T03:03:11.566 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:11.566 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.566 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.566 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:11.566 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.126227+0000", 2024-04-19T03:03:11.566 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:11.566 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.566 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.566 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:11.566 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.126226+0000", 2024-04-19T03:03:11.566 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:03:11.567 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.567 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.567 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:11.567 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.126236+0000", 2024-04-19T03:03:11.567 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.4199999999999996e-06 2024-04-19T03:03:11.567 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.567 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.567 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:11.567 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.126243+0000", 2024-04-19T03:03:11.567 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.199e-06 2024-04-19T03:03:11.567 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.567 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.567 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:11.567 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.126248+0000", 2024-04-19T03:03:11.568 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1320000000000002e-06 2024-04-19T03:03:11.568 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.568 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.568 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:11.568 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.126286+0000", 2024-04-19T03:03:11.568 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7401000000000003e-05 2024-04-19T03:03:11.568 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.568 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.568 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:11.568 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.126368+0000", 2024-04-19T03:03:11.568 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2113999999999993e-05 2024-04-19T03:03:11.568 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.568 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.569 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:03:11.569 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.126438+0000", 2024-04-19T03:03:11.569 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0337000000000001e-05 2024-04-19T03:03:11.569 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.569 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.569 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:03:11.569 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.130816+0000", 2024-04-19T03:03:11.569 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0043778330000000002 2024-04-19T03:03:11.569 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.569 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.569 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:11.570 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.195830+0000", 2024-04-19T03:03:11.570 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.065013933999999995 2024-04-19T03:03:11.570 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.570 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.570 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:03:11.570 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.195907+0000", 2024-04-19T03:03:11.570 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7397000000000005e-05 2024-04-19T03:03:11.570 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.570 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.570 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:11.570 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.195966+0000", 2024-04-19T03:03:11.570 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8906999999999997e-05 2024-04-19T03:03:11.570 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:11.571 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:11.571 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:11.571 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.571 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.571 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:158381 5.9 5:94dcd4a7:::benchmark_data_smithi096_19531_object44931:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-19T03:03:11.571 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:58.128712+0000", 2024-04-19T03:03:11.571 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 13.350061654999999, 2024-04-19T03:03:11.571 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.067497527000000002, 2024-04-19T03:03:11.571 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:11.571 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:11.571 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:11.571 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:11.571 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:11.571 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 158381 2024-04-19T03:03:11.572 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.572 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:11.572 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.572 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:11.572 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.128712+0000", 2024-04-19T03:03:11.572 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:11.572 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.572 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.572 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:11.572 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.128712+0000", 2024-04-19T03:03:11.572 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:11.572 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.572 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.572 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:11.573 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.128711+0000", 2024-04-19T03:03:11.573 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:03:11.573 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.573 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.573 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:11.573 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.128716+0000", 2024-04-19T03:03:11.573 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0610000000000003e-06 2024-04-19T03:03:11.573 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.573 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.573 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:11.573 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.128724+0000", 2024-04-19T03:03:11.573 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0120000000000005e-06 2024-04-19T03:03:11.573 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.573 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.573 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:11.574 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.128729+0000", 2024-04-19T03:03:11.574 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8899999999999998e-06 2024-04-19T03:03:11.574 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.574 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.574 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:11.574 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.128778+0000", 2024-04-19T03:03:11.574 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9110000000000002e-05 2024-04-19T03:03:11.574 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.574 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.574 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:11.574 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.128903+0000", 2024-04-19T03:03:11.574 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00012506799999999999 2024-04-19T03:03:11.574 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.575 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.575 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:03:11.575 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.129022+0000", 2024-04-19T03:03:11.575 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00011923599999999999 2024-04-19T03:03:11.575 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.575 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.575 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:03:11.575 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.132294+0000", 2024-04-19T03:03:11.575 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.003271244 2024-04-19T03:03:11.575 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.575 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.575 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:11.575 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.196045+0000", 2024-04-19T03:03:11.576 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.063751206000000005 2024-04-19T03:03:11.576 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.576 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.576 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:03:11.576 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.196133+0000", 2024-04-19T03:03:11.576 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.8213000000000004e-05 2024-04-19T03:03:11.576 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.576 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.576 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:11.576 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.196209+0000", 2024-04-19T03:03:11.576 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6335999999999996e-05 2024-04-19T03:03:11.576 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:11.576 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:11.576 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:11.577 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.577 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.577 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:158385 5.9 5:950ec749:::benchmark_data_smithi096_19531_object44935:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-19T03:03:11.577 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:58.129756+0000", 2024-04-19T03:03:11.577 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 13.349017722999999, 2024-04-19T03:03:11.577 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.068998382999999996, 2024-04-19T03:03:11.577 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:11.577 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:11.577 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:11.577 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:11.577 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:11.577 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 158385 2024-04-19T03:03:11.577 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.577 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:11.578 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.578 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:11.578 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.129756+0000", 2024-04-19T03:03:11.578 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:11.578 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.578 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.578 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:11.578 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.129756+0000", 2024-04-19T03:03:11.578 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:11.578 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.578 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.578 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:11.578 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.129755+0000", 2024-04-19T03:03:11.579 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:03:11.579 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.579 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.579 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:11.579 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.129760+0000", 2024-04-19T03:03:11.579 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6030000000000004e-06 2024-04-19T03:03:11.579 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.579 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.579 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:11.579 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.129774+0000", 2024-04-19T03:03:11.579 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3131e-05 2024-04-19T03:03:11.579 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.579 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.579 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:11.580 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.129781+0000", 2024-04-19T03:03:11.580 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4030000000000001e-06 2024-04-19T03:03:11.580 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.580 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.580 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:11.580 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.130837+0000", 2024-04-19T03:03:11.580 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00105569 2024-04-19T03:03:11.580 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.580 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.580 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:11.580 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.130917+0000", 2024-04-19T03:03:11.580 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9929e-05 2024-04-19T03:03:11.580 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.580 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.581 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:03:11.581 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.130973+0000", 2024-04-19T03:03:11.581 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.664e-05 2024-04-19T03:03:11.581 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.581 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.581 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:03:11.581 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.132340+0000", 2024-04-19T03:03:11.581 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001366321 2024-04-19T03:03:11.581 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.581 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.581 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:11.581 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.198637+0000", 2024-04-19T03:03:11.581 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.066296888999999998 2024-04-19T03:03:11.581 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.582 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.582 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:03:11.582 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.198704+0000", 2024-04-19T03:03:11.582 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7333000000000001e-05 2024-04-19T03:03:11.582 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.582 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.582 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:11.582 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.198754+0000", 2024-04-19T03:03:11.582 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0421999999999999e-05 2024-04-19T03:03:11.582 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:11.582 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:11.582 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:11.582 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.583 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.583 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:158387 5.9 5:9e96f619:::benchmark_data_smithi096_19531_object44937:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-19T03:03:11.583 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:58.132457+0000", 2024-04-19T03:03:11.583 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 13.346316159000001, 2024-04-19T03:03:11.583 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.066858091999999994, 2024-04-19T03:03:11.583 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:11.583 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:11.583 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:11.583 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:11.583 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:11.583 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 158387 2024-04-19T03:03:11.583 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.584 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:11.584 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.584 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:11.584 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.132457+0000", 2024-04-19T03:03:11.584 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:11.584 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.584 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.584 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:11.584 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.132457+0000", 2024-04-19T03:03:11.584 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:11.584 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.584 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.584 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:11.584 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.132457+0000", 2024-04-19T03:03:11.585 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:11.585 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.585 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.585 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:11.585 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.132460+0000", 2024-04-19T03:03:11.585 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.1949999999999999e-06 2024-04-19T03:03:11.585 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.585 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.585 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:11.585 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.132468+0000", 2024-04-19T03:03:11.585 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.1599999999999998e-06 2024-04-19T03:03:11.585 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.585 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.585 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:11.586 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.132473+0000", 2024-04-19T03:03:11.586 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9259999999999999e-06 2024-04-19T03:03:11.586 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.586 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.586 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:11.586 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.132504+0000", 2024-04-19T03:03:11.586 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0914000000000003e-05 2024-04-19T03:03:11.586 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.586 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.586 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:11.586 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.132646+0000", 2024-04-19T03:03:11.586 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00014214300000000001 2024-04-19T03:03:11.587 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.587 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.587 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:03:11.587 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.132741+0000", 2024-04-19T03:03:11.587 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.4344000000000003e-05 2024-04-19T03:03:11.587 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.587 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.587 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:03:11.587 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.135774+0000", 2024-04-19T03:03:11.587 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0030334960000000001 2024-04-19T03:03:11.587 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.587 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.587 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:11.587 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.199240+0000", 2024-04-19T03:03:11.588 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.063465695000000003 2024-04-19T03:03:11.588 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.588 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.588 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:03:11.588 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.199272+0000", 2024-04-19T03:03:11.588 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2412000000000001e-05 2024-04-19T03:03:11.588 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.588 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.588 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:11.588 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.199316+0000", 2024-04-19T03:03:11.588 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3275000000000002e-05 2024-04-19T03:03:11.588 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:11.588 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:11.588 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:11.589 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.589 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.589 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:158392 5.f 5:f462725f:::benchmark_data_smithi096_19531_object44942:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-19T03:03:11.589 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:58.135703+0000", 2024-04-19T03:03:11.589 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 13.343070379, 2024-04-19T03:03:11.589 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.063132879000000003, 2024-04-19T03:03:11.589 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:11.589 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:11.589 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:11.589 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:11.589 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:11.589 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 158392 2024-04-19T03:03:11.589 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.589 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:11.590 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.590 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:11.590 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.135703+0000", 2024-04-19T03:03:11.590 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:11.590 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.590 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.590 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:11.590 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.135703+0000", 2024-04-19T03:03:11.590 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:11.590 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.590 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.590 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:11.590 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.135702+0000", 2024-04-19T03:03:11.591 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:03:11.591 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.591 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.591 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:11.591 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.135708+0000", 2024-04-19T03:03:11.591 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8270000000000003e-06 2024-04-19T03:03:11.591 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.591 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.591 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:11.591 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.135720+0000", 2024-04-19T03:03:11.591 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2057e-05 2024-04-19T03:03:11.591 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.591 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.591 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:11.592 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.135727+0000", 2024-04-19T03:03:11.592 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8090000000000004e-06 2024-04-19T03:03:11.592 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.592 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.592 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:11.592 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.135768+0000", 2024-04-19T03:03:11.592 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1548999999999998e-05 2024-04-19T03:03:11.592 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.592 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.592 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:11.592 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.135853+0000", 2024-04-19T03:03:11.592 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4845000000000005e-05 2024-04-19T03:03:11.592 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.592 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.593 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:03:11.593 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.135934+0000", 2024-04-19T03:03:11.593 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0315000000000006e-05 2024-04-19T03:03:11.593 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.593 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.593 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:03:11.593 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.138685+0000", 2024-04-19T03:03:11.593 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.002751042 2024-04-19T03:03:11.593 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.593 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.593 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:11.593 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.198747+0000", 2024-04-19T03:03:11.593 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.060062675000000003 2024-04-19T03:03:11.593 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.593 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.594 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:03:11.594 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.198802+0000", 2024-04-19T03:03:11.594 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4469000000000003e-05 2024-04-19T03:03:11.594 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.594 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.594 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:11.594 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.198836+0000", 2024-04-19T03:03:11.594 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4272e-05 2024-04-19T03:03:11.594 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:11.594 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:11.594 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:11.594 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.595 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.595 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:158397 5.d 5:b5d962e9:::benchmark_data_smithi096_19531_object44947:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-19T03:03:11.595 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:58.138717+0000", 2024-04-19T03:03:11.595 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 13.340056435999999, 2024-04-19T03:03:11.595 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.057191467000000003, 2024-04-19T03:03:11.595 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:11.595 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:11.595 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:11.595 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:11.595 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:11.595 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 158397 2024-04-19T03:03:11.595 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.595 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:11.596 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.596 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:11.596 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.138717+0000", 2024-04-19T03:03:11.596 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:11.596 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.596 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.596 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:11.596 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.138717+0000", 2024-04-19T03:03:11.596 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:11.596 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.596 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.596 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:11.596 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.138716+0000", 2024-04-19T03:03:11.596 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999986 2024-04-19T03:03:11.597 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.597 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.597 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:11.597 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.138722+0000", 2024-04-19T03:03:11.597 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1709999999999999e-06 2024-04-19T03:03:11.597 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.597 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.597 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:11.597 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.138731+0000", 2024-04-19T03:03:11.597 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.0310000000000004e-06 2024-04-19T03:03:11.597 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.597 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.597 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:11.597 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.138738+0000", 2024-04-19T03:03:11.598 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8430000000000004e-06 2024-04-19T03:03:11.598 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.598 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.598 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:11.598 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.138789+0000", 2024-04-19T03:03:11.598 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0623e-05 2024-04-19T03:03:11.598 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.598 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.598 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:11.598 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.138945+0000", 2024-04-19T03:03:11.598 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00015671899999999999 2024-04-19T03:03:11.598 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.598 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.599 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:03:11.599 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.139079+0000", 2024-04-19T03:03:11.599 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00013380099999999999 2024-04-19T03:03:11.599 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.599 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.599 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:03:11.599 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.141715+0000", 2024-04-19T03:03:11.599 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0026362849999999999 2024-04-19T03:03:11.599 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.599 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.599 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:11.599 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.195784+0000", 2024-04-19T03:03:11.599 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.054068353 2024-04-19T03:03:11.599 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.600 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.600 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:03:11.600 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.195852+0000", 2024-04-19T03:03:11.600 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8121999999999996e-05 2024-04-19T03:03:11.600 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:11.600 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:11.600 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:11.600 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.195909+0000", 2024-04-19T03:03:11.600 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6737999999999998e-05 2024-04-19T03:03:11.600 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:11.600 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:11.600 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:11.600 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:11.600 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:11.600 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-04-19T03:03:11.602 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:03:11.600+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:03:11.602 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T03:03:11.617 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-19T03:03:11.702 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:03:11.700+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:03:11.729 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-19T03:03:11.730 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-04-19T03:03:11.730 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:11.730 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:191563 5.a 5:58f1f86f:::benchmark_data_smithi096_19531_object78113:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-04-19T03:03:11.730 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:03:11.729549+0000", 2024-04-19T03:03:11.730 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.00040024700000000001, 2024-04-19T03:03:11.730 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000422354, 2024-04-19T03:03:11.730 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:11.730 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-19T03:03:11.730 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:11.730 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:11.730 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:11.731 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191563 2024-04-19T03:03:11.731 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:11.731 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:11.731 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:11.731 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:11.731 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:11.729549+0000", 2024-04-19T03:03:11.731 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:11.731 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:11.731 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:11.731 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:11.731 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:11.729549+0000", 2024-04-19T03:03:11.731 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:11.731 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:11.732 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:11.732 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:11.732 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:11.729548+0000", 2024-04-19T03:03:11.732 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:11.732 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:11.732 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:11.732 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:11.732 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:11.729552+0000", 2024-04-19T03:03:11.732 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.298e-06 2024-04-19T03:03:11.732 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:11.732 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:11.732 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:11.732 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:11.729583+0000", 2024-04-19T03:03:11.733 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0914999999999998e-05 2024-04-19T03:03:11.733 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:11.733 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:11.733 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:11.733 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:11.729589+0000", 2024-04-19T03:03:11.733 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9580000000000004e-06 2024-04-19T03:03:11.733 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:11.733 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:11.733 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:11.733 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:11.729642+0000", 2024-04-19T03:03:11.733 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3260999999999997e-05 2024-04-19T03:03:11.733 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:11.733 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:11.733 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:11.733 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:11.729800+0000", 2024-04-19T03:03:11.733 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000158565 2024-04-19T03:03:11.734 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:11.734 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:11.734 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:11.734 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:11.734 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:11.734 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:191557 5.8 5:10f5cf72:::benchmark_data_smithi096_19531_object78107:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-04-19T03:03:11.734 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:03:11.726736+0000", 2024-04-19T03:03:11.734 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.003213601, 2024-04-19T03:03:11.734 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0032835500000000001, 2024-04-19T03:03:11.734 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:11.734 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-19T03:03:11.734 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:11.734 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:11.734 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:11.735 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191557 2024-04-19T03:03:11.735 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:11.735 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:11.735 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:11.736 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:11.736 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:11.726736+0000", 2024-04-19T03:03:11.736 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:11.736 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:11.736 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:11.736 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:11.736 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:11.726736+0000", 2024-04-19T03:03:11.736 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:11.736 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:11.736 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:11.737 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:11.737 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:11.726735+0000", 2024-04-19T03:03:11.737 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:11.737 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:11.737 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:11.737 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:11.737 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:11.726739+0000", 2024-04-19T03:03:11.737 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9269999999999998e-06 2024-04-19T03:03:11.737 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:11.737 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:11.737 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:11.737 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:11.726746+0000", 2024-04-19T03:03:11.737 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5950000000000004e-06 2024-04-19T03:03:11.738 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:11.738 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:11.738 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:11.738 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:11.726750+0000", 2024-04-19T03:03:11.738 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3939999999999998e-06 2024-04-19T03:03:11.738 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:11.738 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:11.738 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:11.738 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:11.726792+0000", 2024-04-19T03:03:11.738 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2456000000000001e-05 2024-04-19T03:03:11.738 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:11.738 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:11.738 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:11.739 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:11.726911+0000", 2024-04-19T03:03:11.739 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011845099999999999 2024-04-19T03:03:11.739 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:11.739 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:11.739 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:11.739 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:11.739 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:11.739 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4755.0:191559 5.9 e60/22 5:91865668:::benchmark_data_smithi096_19531_object78109:head v 60'11718, mlcod=60'11716)", 2024-04-19T03:03:11.739 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:03:11.727962+0000", 2024-04-19T03:03:11.739 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0019870589999999998, 2024-04-19T03:03:11.739 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0021149319999999999, 2024-04-19T03:03:11.739 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:11.739 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:11.739 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:11.740 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:11.740 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:11.740 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:11.727962+0000", 2024-04-19T03:03:11.740 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:11.740 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:11.740 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:11.740 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:11.740 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:11.727962+0000", 2024-04-19T03:03:11.740 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:11.740 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:11.740 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:11.740 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:11.740 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:11.727962+0000", 2024-04-19T03:03:11.740 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:11.741 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:11.741 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:11.741 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:11.741 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:11.727967+0000", 2024-04-19T03:03:11.741 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2830000000000001e-06 2024-04-19T03:03:11.741 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:11.741 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:11.741 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:11.741 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:11.727972+0000", 2024-04-19T03:03:11.741 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1420000000000001e-06 2024-04-19T03:03:11.741 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:11.741 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:11.741 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:11.742 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:11.727976+0000", 2024-04-19T03:03:11.742 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.4709999999999999e-06 2024-04-19T03:03:11.742 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:11.742 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:11.742 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:11.742 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:11.728006+0000", 2024-04-19T03:03:11.742 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0654000000000002e-05 2024-04-19T03:03:11.742 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:11.742 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:11.742 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:11.742 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:11.728019+0000", 2024-04-19T03:03:11.743 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2702e-05 2024-04-19T03:03:11.743 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:11.743 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:11.743 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:03:11.743 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:11.730066+0000", 2024-04-19T03:03:11.743 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0020470779999999999 2024-04-19T03:03:11.743 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:11.743 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:11.743 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:11.743 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:11.743 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:11.743 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:191560 5.8 5:1a0defcf:::benchmark_data_smithi096_19531_object78110:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-04-19T03:03:11.743 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:03:11.729372+0000", 2024-04-19T03:03:11.743 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.00057730300000000004, 2024-04-19T03:03:11.744 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00075138799999999997, 2024-04-19T03:03:11.744 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:11.744 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-19T03:03:11.744 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:11.744 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:11.744 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:11.744 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191560 2024-04-19T03:03:11.744 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:11.744 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:11.744 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:11.744 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:11.744 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:11.729372+0000", 2024-04-19T03:03:11.744 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:11.744 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:11.744 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:11.745 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:11.745 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:11.729372+0000", 2024-04-19T03:03:11.745 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:11.745 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:11.745 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:11.745 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:11.745 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:11.729371+0000", 2024-04-19T03:03:11.745 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:11.745 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:11.745 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:11.745 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:11.745 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:11.729376+0000", 2024-04-19T03:03:11.745 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9520000000000002e-06 2024-04-19T03:03:11.745 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:11.746 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:11.746 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:11.746 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:11.729386+0000", 2024-04-19T03:03:11.746 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0132000000000001e-05 2024-04-19T03:03:11.746 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:11.746 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:11.746 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:11.746 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:11.729392+0000", 2024-04-19T03:03:11.746 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.144e-06 2024-04-19T03:03:11.746 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:11.746 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:11.746 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:11.747 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:11.729425+0000", 2024-04-19T03:03:11.747 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2574999999999999e-05 2024-04-19T03:03:11.747 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:11.747 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:11.747 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:11.747 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:11.729599+0000", 2024-04-19T03:03:11.747 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00017351199999999999 2024-04-19T03:03:11.747 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:11.747 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:11.747 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:11.747 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:11.747 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:11.748 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:191561 5.8 5.85397318 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-04-19T03:03:11.748 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:03:11.729509+0000", 2024-04-19T03:03:11.748 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.00043978399999999998, 2024-04-19T03:03:11.748 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00065149700000000001, 2024-04-19T03:03:11.748 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:11.748 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-04-19T03:03:11.748 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:11.748 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:11.748 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:11.748 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 191561 2024-04-19T03:03:11.748 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:11.748 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:11.748 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:11.749 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:11.749 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:11.729509+0000", 2024-04-19T03:03:11.749 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:11.749 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:11.749 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:11.749 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:11.749 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:11.729509+0000", 2024-04-19T03:03:11.749 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:11.749 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:11.749 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:11.749 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:11.749 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:11.729509+0000", 2024-04-19T03:03:11.749 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:03:11.749 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:11.750 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:11.750 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:11.750 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:11.729514+0000", 2024-04-19T03:03:11.750 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4700000000000001e-06 2024-04-19T03:03:11.750 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:11.750 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:11.750 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:11.750 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:11.729532+0000", 2024-04-19T03:03:11.750 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8077e-05 2024-04-19T03:03:11.750 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:11.750 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:11.750 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:11.750 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:11.729539+0000", 2024-04-19T03:03:11.751 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2570000000000001e-06 2024-04-19T03:03:11.751 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:11.751 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:11.751 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:11.751 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:11.751 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-04-19T03:03:11.751 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 5 2024-04-19T03:03:11.751 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-19T03:03:11.752 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T03:03:11.804 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:03:11.800+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:03:11.877 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-19T03:03:11.877 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-04-19T03:03:11.877 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-04-19T03:03:11.877 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-04-19T03:03:11.878 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-19T03:03:11.889 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T03:03:11.905 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:03:11.900+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:03:12.005 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:03:12.004+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:03:12.010 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-19T03:03:12.010 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-04-19T03:03:12.010 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-04-19T03:03:12.010 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-04-19T03:03:12.010 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.010 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:86615 5.e 5:7fef7288:::benchmark_data_smithi096_19531_object86614:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:12.010 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:22.634544+0000", 2024-04-19T03:03:12.010 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 49.373429121999997, 2024-04-19T03:03:12.010 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.192475071, 2024-04-19T03:03:12.010 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:12.010 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:12.010 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:12.011 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:12.011 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:12.011 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 86615 2024-04-19T03:03:12.011 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.011 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:12.011 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.011 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:12.011 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634544+0000", 2024-04-19T03:03:12.011 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:12.011 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.011 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.011 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:12.011 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634544+0000", 2024-04-19T03:03:12.011 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:12.012 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.012 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.012 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:12.012 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634542+0000", 2024-04-19T03:03:12.012 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999981 2024-04-19T03:03:12.012 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.012 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.012 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:12.012 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634585+0000", 2024-04-19T03:03:12.012 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2299000000000003e-05 2024-04-19T03:03:12.012 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.012 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.012 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:12.013 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634592+0000", 2024-04-19T03:03:12.013 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2350000000000002e-06 2024-04-19T03:03:12.013 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.013 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.013 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:12.013 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634596+0000", 2024-04-19T03:03:12.013 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5390000000000001e-06 2024-04-19T03:03:12.013 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.013 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.013 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:12.013 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634639+0000", 2024-04-19T03:03:12.013 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2444999999999998e-05 2024-04-19T03:03:12.013 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.013 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.014 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:12.014 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634808+0000", 2024-04-19T03:03:12.014 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000169152 2024-04-19T03:03:12.014 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.014 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.014 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:12.014 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634999+0000", 2024-04-19T03:03:12.014 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00019098300000000001 2024-04-19T03:03:12.014 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.014 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.014 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:12.014 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.640458+0000", 2024-04-19T03:03:12.014 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0054586870000000003 2024-04-19T03:03:12.015 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.015 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.015 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:12.015 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.826949+0000", 2024-04-19T03:03:12.015 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.18649178299999999 2024-04-19T03:03:12.015 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.015 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.015 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:03:12.015 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.826982+0000", 2024-04-19T03:03:12.015 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2477000000000001e-05 2024-04-19T03:03:12.015 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.015 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.015 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:12.015 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.827019+0000", 2024-04-19T03:03:12.016 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7355999999999999e-05 2024-04-19T03:03:12.016 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:12.016 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:12.016 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:12.016 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.016 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.016 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:86616 5.e 5:72278f47:::benchmark_data_smithi096_19531_object86615:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:12.016 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:22.634609+0000", 2024-04-19T03:03:12.016 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 49.373363972999996, 2024-04-19T03:03:12.016 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.19472088900000001, 2024-04-19T03:03:12.016 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:12.016 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:12.016 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:12.017 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:12.017 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:12.017 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 86616 2024-04-19T03:03:12.017 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.017 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:12.017 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.017 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:12.017 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634609+0000", 2024-04-19T03:03:12.017 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:12.017 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.017 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.017 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:12.017 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634609+0000", 2024-04-19T03:03:12.017 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:12.018 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.018 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.018 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:12.018 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634609+0000", 2024-04-19T03:03:12.018 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:12.018 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.018 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.018 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:12.018 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634651+0000", 2024-04-19T03:03:12.018 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2589000000000002e-05 2024-04-19T03:03:12.018 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.018 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.018 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:12.019 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634659+0000", 2024-04-19T03:03:12.019 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5850000000000002e-06 2024-04-19T03:03:12.019 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.019 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.019 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:12.019 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634662+0000", 2024-04-19T03:03:12.019 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3620000000000002e-06 2024-04-19T03:03:12.019 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.019 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.019 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:12.019 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.637880+0000", 2024-04-19T03:03:12.019 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.003218149 2024-04-19T03:03:12.019 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.019 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.019 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:12.020 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.637999+0000", 2024-04-19T03:03:12.020 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000118643 2024-04-19T03:03:12.020 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.020 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.020 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:12.020 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.638102+0000", 2024-04-19T03:03:12.020 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010331 2024-04-19T03:03:12.020 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.020 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.020 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:12.020 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.640851+0000", 2024-04-19T03:03:12.020 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0027483310000000001 2024-04-19T03:03:12.020 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.020 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.021 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:12.021 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.829269+0000", 2024-04-19T03:03:12.021 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.188418319 2024-04-19T03:03:12.021 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.021 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.021 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:03:12.021 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.829299+0000", 2024-04-19T03:03:12.021 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0227e-05 2024-04-19T03:03:12.021 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.021 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.021 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:12.021 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.829330+0000", 2024-04-19T03:03:12.021 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0969000000000001e-05 2024-04-19T03:03:12.021 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:12.021 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:12.022 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:12.022 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.022 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.022 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:86618 5.0 5:09014b90:::benchmark_data_smithi096_19531_object86617:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:12.022 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:22.634894+0000", 2024-04-19T03:03:12.022 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 49.373079484999998, 2024-04-19T03:03:12.022 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.19413419800000001, 2024-04-19T03:03:12.022 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:12.022 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:12.022 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:12.022 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:12.022 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:12.022 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 86618 2024-04-19T03:03:12.022 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.023 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:12.023 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.023 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:12.023 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634894+0000", 2024-04-19T03:03:12.023 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:12.023 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.023 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.023 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:12.023 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634894+0000", 2024-04-19T03:03:12.023 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:12.023 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.023 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.023 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:12.023 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634893+0000", 2024-04-19T03:03:12.024 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:03:12.024 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.024 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.024 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:12.024 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634976+0000", 2024-04-19T03:03:12.024 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3231000000000003e-05 2024-04-19T03:03:12.024 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.024 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.024 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:12.024 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634983+0000", 2024-04-19T03:03:12.024 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5169999999999996e-06 2024-04-19T03:03:12.024 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.024 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.024 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:12.025 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634987+0000", 2024-04-19T03:03:12.025 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.425e-06 2024-04-19T03:03:12.025 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.025 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.025 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:12.025 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635030+0000", 2024-04-19T03:03:12.025 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.32e-05 2024-04-19T03:03:12.025 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.025 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.025 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:12.025 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635185+0000", 2024-04-19T03:03:12.025 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015471899999999999 2024-04-19T03:03:12.025 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.026 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.026 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:12.026 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635415+0000", 2024-04-19T03:03:12.026 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00023026500000000001 2024-04-19T03:03:12.026 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.026 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.026 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:12.026 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.640127+0000", 2024-04-19T03:03:12.026 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0047118890000000004 2024-04-19T03:03:12.026 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.026 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.026 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:12.026 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.828895+0000", 2024-04-19T03:03:12.026 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.18876802600000001 2024-04-19T03:03:12.027 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.027 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.027 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:03:12.027 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.828972+0000", 2024-04-19T03:03:12.027 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.6345000000000002e-05 2024-04-19T03:03:12.027 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.027 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.027 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:12.027 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.829028+0000", 2024-04-19T03:03:12.027 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6342999999999999e-05 2024-04-19T03:03:12.027 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:12.027 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:12.027 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:12.027 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.028 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.028 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:86620 5.b 5:d80faa68:::benchmark_data_smithi096_19531_object86619:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:12.028 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:22.635110+0000", 2024-04-19T03:03:12.028 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 49.372862925, 2024-04-19T03:03:12.028 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.193447275, 2024-04-19T03:03:12.028 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:12.028 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:12.028 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:12.028 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:12.028 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:12.028 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 86620 2024-04-19T03:03:12.028 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.028 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:12.028 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.029 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:12.029 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635110+0000", 2024-04-19T03:03:12.029 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:12.029 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.029 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.029 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:12.029 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635110+0000", 2024-04-19T03:03:12.029 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:12.029 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.029 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.029 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:12.029 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635110+0000", 2024-04-19T03:03:12.029 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:12.029 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.030 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.030 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:12.030 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635154+0000", 2024-04-19T03:03:12.030 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4681000000000001e-05 2024-04-19T03:03:12.030 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.030 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.030 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:12.030 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635166+0000", 2024-04-19T03:03:12.030 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1505000000000001e-05 2024-04-19T03:03:12.030 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.030 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.030 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:12.030 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635171+0000", 2024-04-19T03:03:12.031 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6040000000000003e-06 2024-04-19T03:03:12.031 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.031 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.031 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:12.031 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635221+0000", 2024-04-19T03:03:12.031 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9947000000000001e-05 2024-04-19T03:03:12.031 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.031 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.031 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:12.031 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635356+0000", 2024-04-19T03:03:12.031 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013576199999999999 2024-04-19T03:03:12.031 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.031 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.032 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:12.032 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635507+0000", 2024-04-19T03:03:12.032 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015072999999999999 2024-04-19T03:03:12.032 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.032 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.032 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:12.032 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.638488+0000", 2024-04-19T03:03:12.032 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0029813159999999999 2024-04-19T03:03:12.032 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.032 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.032 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:12.032 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.828341+0000", 2024-04-19T03:03:12.032 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.189852254 2024-04-19T03:03:12.032 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.032 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.033 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:03:12.033 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.828416+0000", 2024-04-19T03:03:12.033 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5344000000000002e-05 2024-04-19T03:03:12.033 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.033 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.033 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:12.033 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.828558+0000", 2024-04-19T03:03:12.033 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000141695 2024-04-19T03:03:12.033 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:12.033 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:12.033 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:12.033 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.033 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.033 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:86621 5.8 5:1597a420:::benchmark_data_smithi096_19531_object86620:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:12.034 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:22.635187+0000", 2024-04-19T03:03:12.034 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 49.372786065, 2024-04-19T03:03:12.034 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.194204878, 2024-04-19T03:03:12.034 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:12.034 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:12.034 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:12.034 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:12.034 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:12.034 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 86621 2024-04-19T03:03:12.034 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.034 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:12.034 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.034 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:12.035 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635187+0000", 2024-04-19T03:03:12.035 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:12.035 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.035 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.035 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:12.035 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635187+0000", 2024-04-19T03:03:12.035 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:12.035 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.035 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.035 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:12.035 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635187+0000", 2024-04-19T03:03:12.035 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:12.035 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.035 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.035 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:12.036 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635242+0000", 2024-04-19T03:03:12.036 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5158000000000003e-05 2024-04-19T03:03:12.036 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.036 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.036 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:12.036 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635249+0000", 2024-04-19T03:03:12.036 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.7000000000000008e-06 2024-04-19T03:03:12.036 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.036 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.036 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:12.036 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635256+0000", 2024-04-19T03:03:12.036 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2060000000000004e-06 2024-04-19T03:03:12.036 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.037 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.037 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:12.037 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635302+0000", 2024-04-19T03:03:12.037 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5954000000000001e-05 2024-04-19T03:03:12.037 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.037 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.037 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:12.037 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635427+0000", 2024-04-19T03:03:12.037 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012559299999999999 2024-04-19T03:03:12.037 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.037 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.037 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:12.037 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635596+0000", 2024-04-19T03:03:12.038 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000168615 2024-04-19T03:03:12.038 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.038 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.038 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:12.038 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.639320+0000", 2024-04-19T03:03:12.038 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0037244610000000001 2024-04-19T03:03:12.038 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.038 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.038 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:12.038 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.829277+0000", 2024-04-19T03:03:12.038 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.18995651099999999 2024-04-19T03:03:12.038 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.038 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.039 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:03:12.039 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.829341+0000", 2024-04-19T03:03:12.039 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3756000000000004e-05 2024-04-19T03:03:12.039 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.039 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.039 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:12.039 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.829392+0000", 2024-04-19T03:03:12.039 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1555999999999999e-05 2024-04-19T03:03:12.039 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:12.039 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:12.039 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:12.039 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.039 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.040 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87067 5.b 5:d57af71a:::benchmark_data_smithi096_19531_object87066:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:12.040 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.142233+0000", 2024-04-19T03:03:12.040 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 48.865740201999998, 2024-04-19T03:03:12.040 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.071692405000000001, 2024-04-19T03:03:12.040 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:12.040 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:12.040 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:12.040 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:12.040 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:12.040 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87067 2024-04-19T03:03:12.040 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.040 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:12.040 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.040 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:12.041 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142233+0000", 2024-04-19T03:03:12.041 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:12.041 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.041 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.041 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:12.041 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142233+0000", 2024-04-19T03:03:12.041 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:12.041 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.041 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.041 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:12.041 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142232+0000", 2024-04-19T03:03:12.041 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:03:12.041 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.041 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.041 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:12.042 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142277+0000", 2024-04-19T03:03:12.042 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5837000000000002e-05 2024-04-19T03:03:12.042 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.042 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.042 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:12.042 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142297+0000", 2024-04-19T03:03:12.042 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9561000000000001e-05 2024-04-19T03:03:12.042 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.042 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.042 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:12.042 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142311+0000", 2024-04-19T03:03:12.042 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3654e-05 2024-04-19T03:03:12.042 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.043 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.043 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:12.043 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142391+0000", 2024-04-19T03:03:12.043 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0123999999999994e-05 2024-04-19T03:03:12.043 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.043 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.043 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:12.043 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142669+0000", 2024-04-19T03:03:12.043 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00027829800000000001 2024-04-19T03:03:12.043 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.043 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.043 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:12.043 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142859+0000", 2024-04-19T03:03:12.043 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000190051 2024-04-19T03:03:12.044 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.044 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.044 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:12.044 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.150597+0000", 2024-04-19T03:03:12.044 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0077380299999999999 2024-04-19T03:03:12.044 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.044 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.044 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:12.044 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.213855+0000", 2024-04-19T03:03:12.044 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.063257987000000002 2024-04-19T03:03:12.044 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.044 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.044 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:03:12.044 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.213898+0000", 2024-04-19T03:03:12.045 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2916e-05 2024-04-19T03:03:12.045 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.045 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.045 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:12.045 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.213925+0000", 2024-04-19T03:03:12.045 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7503000000000001e-05 2024-04-19T03:03:12.045 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:12.045 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:12.045 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:12.045 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.045 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.045 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87069 5.b 5:da0c93b5:::benchmark_data_smithi096_19531_object87068:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:12.045 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.143402+0000", 2024-04-19T03:03:12.045 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 48.864571239999997, 2024-04-19T03:03:12.045 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.070678598999999995, 2024-04-19T03:03:12.046 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:12.046 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:12.046 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:12.046 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:12.046 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:12.046 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87069 2024-04-19T03:03:12.046 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.046 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:12.046 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.046 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:12.046 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.143402+0000", 2024-04-19T03:03:12.046 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:12.046 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.047 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.047 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:12.047 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.143402+0000", 2024-04-19T03:03:12.047 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:12.047 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.047 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.047 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:12.047 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.143401+0000", 2024-04-19T03:03:12.047 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:03:12.047 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.047 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.047 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:12.047 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.143501+0000", 2024-04-19T03:03:12.047 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000100387 2024-04-19T03:03:12.047 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.048 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.048 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:12.048 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.143516+0000", 2024-04-19T03:03:12.048 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5369000000000001e-05 2024-04-19T03:03:12.048 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.048 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.048 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:12.048 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.143524+0000", 2024-04-19T03:03:12.048 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.7079999999999997e-06 2024-04-19T03:03:12.048 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.048 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.048 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:12.048 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.145550+0000", 2024-04-19T03:03:12.048 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0020259290000000001 2024-04-19T03:03:12.049 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.049 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.049 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:12.049 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.145676+0000", 2024-04-19T03:03:12.049 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000126406 2024-04-19T03:03:12.049 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.049 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.049 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:12.050 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.145802+0000", 2024-04-19T03:03:12.050 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000125974 2024-04-19T03:03:12.050 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.050 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.050 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:12.050 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.151030+0000", 2024-04-19T03:03:12.050 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0052276079999999999 2024-04-19T03:03:12.050 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.050 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.050 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:12.050 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.213998+0000", 2024-04-19T03:03:12.050 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.06296786 2024-04-19T03:03:12.050 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.050 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.051 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:03:12.051 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.214031+0000", 2024-04-19T03:03:12.051 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3387999999999999e-05 2024-04-19T03:03:12.051 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.051 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.051 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:12.051 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.214081+0000", 2024-04-19T03:03:12.051 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9316e-05 2024-04-19T03:03:12.051 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:12.051 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:12.051 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:12.051 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.051 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.052 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87108 5.e 5:7e197adc:::benchmark_data_smithi096_19531_object87107:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:12.052 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.223103+0000", 2024-04-19T03:03:12.052 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 48.784869903000001, 2024-04-19T03:03:12.052 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.044946887, 2024-04-19T03:03:12.052 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:12.052 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-19T03:03:12.052 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:12.052 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:12.052 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:12.052 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87108 2024-04-19T03:03:12.052 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.052 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:12.052 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.052 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:12.053 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.223103+0000", 2024-04-19T03:03:12.053 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:12.053 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.053 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.053 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:12.053 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.223103+0000", 2024-04-19T03:03:12.053 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:12.053 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.053 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.053 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:12.053 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.223102+0000", 2024-04-19T03:03:12.053 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:03:12.053 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.054 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.054 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:12.054 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.223156+0000", 2024-04-19T03:03:12.054 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3958000000000001e-05 2024-04-19T03:03:12.054 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.054 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.054 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:12.054 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.223166+0000", 2024-04-19T03:03:12.054 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.4809999999999995e-06 2024-04-19T03:03:12.054 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.054 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.054 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:12.054 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.223172+0000", 2024-04-19T03:03:12.055 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0140000000000004e-06 2024-04-19T03:03:12.055 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.055 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.057 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:12.057 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.227295+0000", 2024-04-19T03:03:12.057 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0041233420000000003 2024-04-19T03:03:12.057 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.057 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.057 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:12.058 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.227495+0000", 2024-04-19T03:03:12.058 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00019955299999999999 2024-04-19T03:03:12.058 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.058 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.058 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:12.058 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.227717+0000", 2024-04-19T03:03:12.058 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000221902 2024-04-19T03:03:12.058 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.058 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.059 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:12.059 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233189+0000", 2024-04-19T03:03:12.059 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0054718889999999997 2024-04-19T03:03:12.059 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.059 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.059 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:12.059 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.250529+0000", 2024-04-19T03:03:12.059 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.017340298000000001 2024-04-19T03:03:12.059 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.059 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.059 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:03:12.059 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.250539+0000", 2024-04-19T03:03:12.059 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0501e-05 2024-04-19T03:03:12.060 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.060 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.060 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:12.060 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.268003+0000", 2024-04-19T03:03:12.060 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.017463429 2024-04-19T03:03:12.060 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.060 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.060 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:12.060 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.268050+0000", 2024-04-19T03:03:12.060 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7466000000000003e-05 2024-04-19T03:03:12.060 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:12.060 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:12.060 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:12.060 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.061 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.061 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87118 5.b 5:d1bb4f3c:::benchmark_data_smithi096_19531_object87117:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:12.061 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.231082+0000", 2024-04-19T03:03:12.061 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 48.776891069000001, 2024-04-19T03:03:12.061 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.035789004, 2024-04-19T03:03:12.061 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:12.061 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-19T03:03:12.061 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:12.061 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:12.061 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:12.061 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87118 2024-04-19T03:03:12.061 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.061 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:12.061 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.062 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:12.062 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231082+0000", 2024-04-19T03:03:12.062 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:12.062 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.062 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.062 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:12.062 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231082+0000", 2024-04-19T03:03:12.062 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:12.062 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.062 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.062 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:12.062 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231081+0000", 2024-04-19T03:03:12.062 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:03:12.063 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.063 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.063 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:12.063 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231159+0000", 2024-04-19T03:03:12.063 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.7819999999999997e-05 2024-04-19T03:03:12.063 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.063 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.063 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:12.063 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231186+0000", 2024-04-19T03:03:12.063 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7126000000000001e-05 2024-04-19T03:03:12.063 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.063 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.063 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:12.063 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231193+0000", 2024-04-19T03:03:12.064 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7259999999999996e-06 2024-04-19T03:03:12.064 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.064 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.064 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:12.064 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231241+0000", 2024-04-19T03:03:12.064 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8123e-05 2024-04-19T03:03:12.064 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.064 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.064 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:12.064 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231354+0000", 2024-04-19T03:03:12.064 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0001133 2024-04-19T03:03:12.064 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.064 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.064 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:12.065 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231443+0000", 2024-04-19T03:03:12.065 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9167999999999997e-05 2024-04-19T03:03:12.065 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.065 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.065 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:12.065 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236498+0000", 2024-04-19T03:03:12.065 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0050545160000000002 2024-04-19T03:03:12.065 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.065 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.065 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:12.066 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.249681+0000", 2024-04-19T03:03:12.066 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013183321 2024-04-19T03:03:12.066 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.066 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.066 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:03:12.066 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.249693+0000", 2024-04-19T03:03:12.066 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1834999999999999e-05 2024-04-19T03:03:12.066 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.066 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.066 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:12.066 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266733+0000", 2024-04-19T03:03:12.066 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.017040408 2024-04-19T03:03:12.066 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.067 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.067 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:12.067 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266871+0000", 2024-04-19T03:03:12.067 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000137849 2024-04-19T03:03:12.067 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:12.067 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:12.067 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:12.067 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.067 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.067 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87121 5.b 5:d01822b8:::benchmark_data_smithi096_19531_object87120:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:12.067 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.233319+0000", 2024-04-19T03:03:12.067 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 48.774654204999997, 2024-04-19T03:03:12.067 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.033624198, 2024-04-19T03:03:12.068 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:12.068 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-19T03:03:12.068 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:12.068 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:12.068 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:12.068 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87121 2024-04-19T03:03:12.068 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.068 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:12.068 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.068 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:12.068 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233319+0000", 2024-04-19T03:03:12.068 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:12.068 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.068 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.069 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:12.069 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233319+0000", 2024-04-19T03:03:12.069 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:12.069 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.069 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.069 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:12.069 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233319+0000", 2024-04-19T03:03:12.069 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:12.069 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.069 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.069 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:12.069 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233364+0000", 2024-04-19T03:03:12.069 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5460999999999997e-05 2024-04-19T03:03:12.070 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.070 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.070 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:12.070 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233382+0000", 2024-04-19T03:03:12.070 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8148e-05 2024-04-19T03:03:12.070 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.070 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.070 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:12.070 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233390+0000", 2024-04-19T03:03:12.070 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5340000000000002e-06 2024-04-19T03:03:12.070 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.070 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.070 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:12.071 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233712+0000", 2024-04-19T03:03:12.071 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00032260500000000001 2024-04-19T03:03:12.071 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.071 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.071 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:12.071 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233829+0000", 2024-04-19T03:03:12.071 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011638599999999999 2024-04-19T03:03:12.071 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.071 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.071 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:12.071 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233959+0000", 2024-04-19T03:03:12.071 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013013900000000001 2024-04-19T03:03:12.071 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.071 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.072 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:12.072 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236515+0000", 2024-04-19T03:03:12.072 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0025562750000000002 2024-04-19T03:03:12.072 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.072 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.072 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:12.072 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.249723+0000", 2024-04-19T03:03:12.072 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013208176 2024-04-19T03:03:12.072 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.072 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.072 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:03:12.072 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.249728+0000", 2024-04-19T03:03:12.072 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6519999999999997e-06 2024-04-19T03:03:12.072 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.072 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.073 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:12.073 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266837+0000", 2024-04-19T03:03:12.073 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0171087059999999 2024-04-19T03:03:12.073 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.073 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.073 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:12.073 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266943+0000", 2024-04-19T03:03:12.073 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000106604 2024-04-19T03:03:12.073 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:12.073 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:12.073 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:12.073 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.073 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.073 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87124 5.8 5:14819ad7:::benchmark_data_smithi096_19531_object87123:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:12.074 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.235886+0000", 2024-04-19T03:03:12.074 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 48.772086780999999, 2024-04-19T03:03:12.074 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0315451179999999, 2024-04-19T03:03:12.074 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:12.074 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-19T03:03:12.074 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:12.074 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:12.074 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:12.074 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87124 2024-04-19T03:03:12.074 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.074 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:12.074 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.074 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:12.075 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.235886+0000", 2024-04-19T03:03:12.075 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:12.075 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.075 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.075 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:12.075 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.235886+0000", 2024-04-19T03:03:12.075 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:12.075 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.075 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.075 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:12.075 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.235886+0000", 2024-04-19T03:03:12.075 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:03:12.075 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.076 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.076 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:12.076 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.235934+0000", 2024-04-19T03:03:12.076 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8384000000000003e-05 2024-04-19T03:03:12.076 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.076 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.076 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:12.076 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.235945+0000", 2024-04-19T03:03:12.076 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0671e-05 2024-04-19T03:03:12.076 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.076 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.076 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:12.076 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.235952+0000", 2024-04-19T03:03:12.076 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3089999999999998e-06 2024-04-19T03:03:12.077 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.077 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.077 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:12.077 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.237067+0000", 2024-04-19T03:03:12.077 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001115263 2024-04-19T03:03:12.077 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.077 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.077 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:12.077 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.237188+0000", 2024-04-19T03:03:12.077 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000121258 2024-04-19T03:03:12.077 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.077 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.077 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:12.077 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.237316+0000", 2024-04-19T03:03:12.078 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000128071 2024-04-19T03:03:12.078 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.078 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.078 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:12.078 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240744+0000", 2024-04-19T03:03:12.078 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0034275629999999998 2024-04-19T03:03:12.078 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.078 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.078 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:12.078 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.252517+0000", 2024-04-19T03:03:12.078 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011772991999999999 2024-04-19T03:03:12.078 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.078 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.079 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:03:12.079 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.252523+0000", 2024-04-19T03:03:12.079 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3640000000000004e-06 2024-04-19T03:03:12.079 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.079 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.079 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:12.079 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.267290+0000", 2024-04-19T03:03:12.079 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0147665690000001 2024-04-19T03:03:12.079 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.079 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.079 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:12.079 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.267432+0000", 2024-04-19T03:03:12.079 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014165299999999999 2024-04-19T03:03:12.079 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:12.079 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:12.080 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:12.080 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.080 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.080 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87129 5.0 5:02667e01:::benchmark_data_smithi096_19531_object87128:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:12.080 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.236466+0000", 2024-04-19T03:03:12.080 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 48.771506785, 2024-04-19T03:03:12.080 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0301534510000001, 2024-04-19T03:03:12.080 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:12.080 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-19T03:03:12.080 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:12.080 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:12.080 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:12.080 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87129 2024-04-19T03:03:12.080 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.081 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:12.081 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.081 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:12.081 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236466+0000", 2024-04-19T03:03:12.081 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:12.081 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.081 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.081 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:12.081 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236466+0000", 2024-04-19T03:03:12.081 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:12.081 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.081 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.081 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:12.081 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236465+0000", 2024-04-19T03:03:12.082 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:03:12.082 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.082 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.082 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:12.082 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236566+0000", 2024-04-19T03:03:12.082 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010047000000000001 2024-04-19T03:03:12.082 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.082 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.082 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:12.082 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236577+0000", 2024-04-19T03:03:12.082 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1772e-05 2024-04-19T03:03:12.082 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.082 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.082 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:12.083 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236584+0000", 2024-04-19T03:03:12.083 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0530000000000003e-06 2024-04-19T03:03:12.083 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.083 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.083 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:12.083 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.237023+0000", 2024-04-19T03:03:12.083 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000439703 2024-04-19T03:03:12.083 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.083 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.083 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:12.083 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.237207+0000", 2024-04-19T03:03:12.083 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000183692 2024-04-19T03:03:12.083 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.084 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.084 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:12.084 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.237373+0000", 2024-04-19T03:03:12.084 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016623500000000001 2024-04-19T03:03:12.084 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.084 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.084 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:12.084 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.241461+0000", 2024-04-19T03:03:12.084 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0040883050000000004 2024-04-19T03:03:12.084 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.084 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.084 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:12.084 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.252500+0000", 2024-04-19T03:03:12.084 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011038450999999999 2024-04-19T03:03:12.085 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.085 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.085 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:03:12.085 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.252507+0000", 2024-04-19T03:03:12.085 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2439999999999996e-06 2024-04-19T03:03:12.085 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.085 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.085 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:12.085 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266538+0000", 2024-04-19T03:03:12.085 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.014031184 2024-04-19T03:03:12.085 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.085 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.085 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:12.086 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266620+0000", 2024-04-19T03:03:12.086 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1600000000000005e-05 2024-04-19T03:03:12.086 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:12.086 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:12.086 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:12.086 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.086 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.086 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87135 5.4 5:2a97e7b7:::benchmark_data_smithi096_19531_object87134:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:12.086 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.240884+0000", 2024-04-19T03:03:12.086 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 48.767089327999997, 2024-04-19T03:03:12.086 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.025708931, 2024-04-19T03:03:12.086 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:12.086 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-19T03:03:12.087 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:12.087 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:12.087 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:12.087 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87135 2024-04-19T03:03:12.087 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.087 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:12.087 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.087 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:12.087 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240884+0000", 2024-04-19T03:03:12.087 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:12.087 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.088 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.088 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:12.088 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240884+0000", 2024-04-19T03:03:12.088 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:12.088 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.088 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.088 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:12.088 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240883+0000", 2024-04-19T03:03:12.088 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:03:12.088 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.088 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.088 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:12.089 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240933+0000", 2024-04-19T03:03:12.089 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9969999999999998e-05 2024-04-19T03:03:12.089 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.089 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.089 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:12.089 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240946+0000", 2024-04-19T03:03:12.089 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2943e-05 2024-04-19T03:03:12.089 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.089 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.089 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:12.089 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240952+0000", 2024-04-19T03:03:12.089 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8930000000000002e-06 2024-04-19T03:03:12.089 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.090 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.090 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:12.090 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240994+0000", 2024-04-19T03:03:12.090 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2753999999999998e-05 2024-04-19T03:03:12.090 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.090 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.090 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:12.090 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.241092+0000", 2024-04-19T03:03:12.090 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.7447000000000004e-05 2024-04-19T03:03:12.090 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.090 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.090 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:12.090 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.241183+0000", 2024-04-19T03:03:12.091 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1163999999999997e-05 2024-04-19T03:03:12.091 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.091 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.091 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:12.091 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.254672+0000", 2024-04-19T03:03:12.091 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.01348864 2024-04-19T03:03:12.091 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.091 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.091 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:03:12.091 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.254681+0000", 2024-04-19T03:03:12.091 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.3789999999999995e-06 2024-04-19T03:03:12.091 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.091 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.091 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:12.092 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266456+0000", 2024-04-19T03:03:12.092 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.011774621 2024-04-19T03:03:12.092 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.092 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.092 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:12.092 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266593+0000", 2024-04-19T03:03:12.092 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013737600000000001 2024-04-19T03:03:12.092 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:12.092 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:12.092 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:12.092 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.092 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.092 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87136 5.4 5:212411bc:::benchmark_data_smithi096_19531_object87135:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:12.092 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.240962+0000", 2024-04-19T03:03:12.093 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 48.767011451999998, 2024-04-19T03:03:12.093 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.025738, 2024-04-19T03:03:12.093 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:12.093 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-19T03:03:12.093 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:12.093 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:12.093 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:12.093 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87136 2024-04-19T03:03:12.093 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.093 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:12.093 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.093 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:12.093 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240962+0000", 2024-04-19T03:03:12.093 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:12.094 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.094 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.094 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:12.094 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240962+0000", 2024-04-19T03:03:12.094 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:12.094 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.094 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.094 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:12.094 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240961+0000", 2024-04-19T03:03:12.094 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:12.094 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.094 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.094 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:12.095 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240995+0000", 2024-04-19T03:03:12.095 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3868000000000002e-05 2024-04-19T03:03:12.095 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.095 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.095 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:12.095 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.241001+0000", 2024-04-19T03:03:12.095 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.322e-06 2024-04-19T03:03:12.095 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.095 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.095 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:12.095 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.241004+0000", 2024-04-19T03:03:12.095 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3510000000000002e-06 2024-04-19T03:03:12.095 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.095 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.096 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:12.096 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247131+0000", 2024-04-19T03:03:12.096 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0061270869999999998 2024-04-19T03:03:12.096 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.096 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.096 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:12.096 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247322+0000", 2024-04-19T03:03:12.096 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000191015 2024-04-19T03:03:12.096 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.096 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.096 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:12.096 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247542+0000", 2024-04-19T03:03:12.096 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00022030199999999999 2024-04-19T03:03:12.096 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.097 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.097 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:12.097 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.254709+0000", 2024-04-19T03:03:12.097 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0071662660000000001 2024-04-19T03:03:12.097 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.097 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.097 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:03:12.097 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.254716+0000", 2024-04-19T03:03:12.098 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3860000000000001e-06 2024-04-19T03:03:12.098 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.098 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.098 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:12.098 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266619+0000", 2024-04-19T03:03:12.098 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0119031030000001 2024-04-19T03:03:12.098 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.098 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.098 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:12.098 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266700+0000", 2024-04-19T03:03:12.098 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0764000000000001e-05 2024-04-19T03:03:12.098 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:12.098 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:12.099 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:12.099 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.099 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.099 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87138 5.e 5:7b1f1c20:::benchmark_data_smithi096_19531_object87137:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:12.099 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.247862+0000", 2024-04-19T03:03:12.099 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 48.760111377999998, 2024-04-19T03:03:12.099 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.024457079, 2024-04-19T03:03:12.099 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:12.099 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:12.099 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:12.099 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:12.099 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:12.099 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87138 2024-04-19T03:03:12.099 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.100 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:12.100 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.100 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:12.101 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247862+0000", 2024-04-19T03:03:12.101 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:12.101 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.101 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.101 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:12.101 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247862+0000", 2024-04-19T03:03:12.101 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:12.101 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.101 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.101 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:12.101 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247860+0000", 2024-04-19T03:03:12.101 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999981 2024-04-19T03:03:12.101 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.102 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.102 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:12.102 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247909+0000", 2024-04-19T03:03:12.102 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9150999999999997e-05 2024-04-19T03:03:12.102 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.102 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.102 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:12.102 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247925+0000", 2024-04-19T03:03:12.102 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5761999999999999e-05 2024-04-19T03:03:12.102 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.102 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.103 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:12.103 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247936+0000", 2024-04-19T03:03:12.103 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1144e-05 2024-04-19T03:03:12.103 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.103 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.103 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:12.103 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.250590+0000", 2024-04-19T03:03:12.103 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.002653678 2024-04-19T03:03:12.103 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.103 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.103 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:03:12.103 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.250599+0000", 2024-04-19T03:03:12.104 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9039999999999998e-06 2024-04-19T03:03:12.104 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.104 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.104 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:12.104 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.268151+0000", 2024-04-19T03:03:12.104 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0175523449999999 2024-04-19T03:03:12.104 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.104 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.104 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:12.104 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.268285+0000", 2024-04-19T03:03:12.105 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013415599999999999 2024-04-19T03:03:12.105 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.105 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.105 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:12.105 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.272238+0000", 2024-04-19T03:03:12.105 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0039533019999999997 2024-04-19T03:03:12.105 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.105 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.105 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:03:12.105 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.272274+0000", 2024-04-19T03:03:12.105 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5352000000000003e-05 2024-04-19T03:03:12.105 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.105 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.106 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:12.106 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.272319+0000", 2024-04-19T03:03:12.106 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5281999999999998e-05 2024-04-19T03:03:12.106 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:12.106 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:12.106 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:12.106 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.106 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.106 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:158371 5.8 5:11a83024:::benchmark_data_smithi096_19531_object44921:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-19T03:03:12.106 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:58.125869+0000", 2024-04-19T03:03:12.106 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 13.882104513, 2024-04-19T03:03:12.106 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074532857999999994, 2024-04-19T03:03:12.106 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:12.107 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:12.107 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:12.107 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:12.107 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:12.107 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 158371 2024-04-19T03:03:12.107 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.107 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:12.107 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.107 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:12.107 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125869+0000", 2024-04-19T03:03:12.107 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:12.107 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.107 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.107 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:12.107 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125869+0000", 2024-04-19T03:03:12.108 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:12.108 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.108 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.108 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:12.108 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125868+0000", 2024-04-19T03:03:12.108 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:03:12.108 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.108 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.108 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:12.108 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125874+0000", 2024-04-19T03:03:12.108 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7120000000000003e-06 2024-04-19T03:03:12.108 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.108 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.109 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:12.109 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125885+0000", 2024-04-19T03:03:12.109 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0665999999999999e-05 2024-04-19T03:03:12.109 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.109 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.109 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:12.109 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125901+0000", 2024-04-19T03:03:12.109 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6463000000000001e-05 2024-04-19T03:03:12.109 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.109 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.109 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:12.109 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125956+0000", 2024-04-19T03:03:12.109 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4728000000000002e-05 2024-04-19T03:03:12.109 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.110 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.110 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:12.110 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.126050+0000", 2024-04-19T03:03:12.110 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.3534000000000003e-05 2024-04-19T03:03:12.110 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.110 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.110 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:12.110 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.200187+0000", 2024-04-19T03:03:12.110 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074136933000000002 2024-04-19T03:03:12.110 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.110 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.110 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:03:12.110 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.200260+0000", 2024-04-19T03:03:12.110 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3090999999999995e-05 2024-04-19T03:03:12.111 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.111 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.111 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:12.111 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.200402+0000", 2024-04-19T03:03:12.111 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014193699999999999 2024-04-19T03:03:12.111 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:12.111 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:12.111 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:12.111 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.111 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.111 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:158372 5.0 5:0473aa5f:::benchmark_data_smithi096_19531_object44922:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-19T03:03:12.111 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:58.125924+0000", 2024-04-19T03:03:12.111 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 13.882048906, 2024-04-19T03:03:12.111 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074247490999999999, 2024-04-19T03:03:12.112 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:12.112 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:12.112 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:12.112 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:12.112 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:12.112 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 158372 2024-04-19T03:03:12.112 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.112 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:12.112 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.112 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:12.112 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125924+0000", 2024-04-19T03:03:12.112 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:12.112 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.112 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.113 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:12.113 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125924+0000", 2024-04-19T03:03:12.113 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:12.113 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.113 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.113 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:12.113 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125924+0000", 2024-04-19T03:03:12.113 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:12.113 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.113 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.113 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:12.113 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125927+0000", 2024-04-19T03:03:12.113 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5389999999999999e-06 2024-04-19T03:03:12.113 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.114 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.114 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:12.114 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125935+0000", 2024-04-19T03:03:12.114 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3259999999999998e-06 2024-04-19T03:03:12.114 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.114 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.114 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:12.114 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125940+0000", 2024-04-19T03:03:12.114 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6980000000000003e-06 2024-04-19T03:03:12.114 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.114 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.114 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:12.114 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125982+0000", 2024-04-19T03:03:12.115 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1337000000000001e-05 2024-04-19T03:03:12.115 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.115 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.115 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:12.115 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.126075+0000", 2024-04-19T03:03:12.115 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.3579999999999995e-05 2024-04-19T03:03:12.115 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.115 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.115 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:12.115 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.199953+0000", 2024-04-19T03:03:12.115 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073877604999999999 2024-04-19T03:03:12.115 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.115 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.115 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:03:12.115 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.200022+0000", 2024-04-19T03:03:12.116 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.8824000000000004e-05 2024-04-19T03:03:12.116 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.116 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.116 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:12.116 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.200172+0000", 2024-04-19T03:03:12.116 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015017700000000001 2024-04-19T03:03:12.116 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:12.116 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:12.116 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:12.116 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.116 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.116 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:158374 5.e 5:76be57a5:::benchmark_data_smithi096_19531_object44924:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-19T03:03:12.116 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:58.125988+0000", 2024-04-19T03:03:12.117 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 13.881985407, 2024-04-19T03:03:12.117 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.067843332000000006, 2024-04-19T03:03:12.117 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:12.117 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:12.117 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:12.117 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:12.117 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:12.117 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 158374 2024-04-19T03:03:12.117 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.117 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:12.117 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.117 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:12.117 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125988+0000", 2024-04-19T03:03:12.117 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:12.118 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.118 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.118 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:12.118 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125988+0000", 2024-04-19T03:03:12.118 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:12.118 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.118 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.118 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:12.118 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125987+0000", 2024-04-19T03:03:12.118 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:12.118 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.118 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.118 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:12.119 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125990+0000", 2024-04-19T03:03:12.119 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7989999999999998e-06 2024-04-19T03:03:12.119 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.119 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.119 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:12.119 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125996+0000", 2024-04-19T03:03:12.119 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.302e-06 2024-04-19T03:03:12.119 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.119 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.119 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:12.119 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.126001+0000", 2024-04-19T03:03:12.119 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.843e-06 2024-04-19T03:03:12.119 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.119 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.120 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:12.120 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.126047+0000", 2024-04-19T03:03:12.120 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6066000000000002e-05 2024-04-19T03:03:12.120 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.120 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.120 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:12.120 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.126171+0000", 2024-04-19T03:03:12.120 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012359099999999999 2024-04-19T03:03:12.120 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.120 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.120 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:12.120 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.193709+0000", 2024-04-19T03:03:12.120 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.067538099000000004 2024-04-19T03:03:12.120 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.121 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.121 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:03:12.121 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.193766+0000", 2024-04-19T03:03:12.121 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6869e-05 2024-04-19T03:03:12.121 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.121 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.121 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:12.121 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.193831+0000", 2024-04-19T03:03:12.121 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5273999999999999e-05 2024-04-19T03:03:12.121 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:12.121 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:12.121 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:12.121 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.121 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.122 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4755.0:158376 5.9 e56/22 5:9e73c076:::benchmark_data_smithi096_19531_object44926:head v 56'9663, mlcod=56'9661)", 2024-04-19T03:03:12.122 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:58.127307+0000", 2024-04-19T03:03:12.122 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 13.880666176, 2024-04-19T03:03:12.122 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069002716000000006, 2024-04-19T03:03:12.122 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:12.122 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:12.122 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:12.122 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.122 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:12.122 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.127307+0000", 2024-04-19T03:03:12.122 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:12.122 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.122 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.123 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:12.123 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.127307+0000", 2024-04-19T03:03:12.123 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:12.123 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.123 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.123 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:12.123 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.127306+0000", 2024-04-19T03:03:12.123 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:03:12.123 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.123 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.123 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:12.123 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.127316+0000", 2024-04-19T03:03:12.123 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.3039999999999994e-06 2024-04-19T03:03:12.123 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.124 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.124 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:12.124 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.127326+0000", 2024-04-19T03:03:12.124 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0009e-05 2024-04-19T03:03:12.124 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.124 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.124 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:12.124 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.127332+0000", 2024-04-19T03:03:12.124 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5880000000000003e-06 2024-04-19T03:03:12.124 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.124 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.124 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:12.124 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.127383+0000", 2024-04-19T03:03:12.124 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0516000000000002e-05 2024-04-19T03:03:12.125 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.125 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.125 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:12.125 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.127403+0000", 2024-04-19T03:03:12.125 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0547000000000002e-05 2024-04-19T03:03:12.125 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.125 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.125 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:03:12.125 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.196280+0000", 2024-04-19T03:03:12.125 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.068876863999999996 2024-04-19T03:03:12.125 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.125 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.125 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:12.125 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.196310+0000", 2024-04-19T03:03:12.126 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9762999999999999e-05 2024-04-19T03:03:12.126 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:12.126 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:12.126 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:12.126 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.126 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.126 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:158383 5.0 5:026717eb:::benchmark_data_smithi096_19531_object44933:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-19T03:03:12.126 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:58.130494+0000", 2024-04-19T03:03:12.126 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 13.87747905, 2024-04-19T03:03:12.126 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.070135775999999997, 2024-04-19T03:03:12.126 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:12.126 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:12.127 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:12.127 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:12.127 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:12.127 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 158383 2024-04-19T03:03:12.127 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.127 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:12.127 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.127 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:12.127 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.130494+0000", 2024-04-19T03:03:12.127 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:12.127 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.127 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.127 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:12.127 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.130494+0000", 2024-04-19T03:03:12.128 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:12.128 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.128 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.128 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:12.128 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.130493+0000", 2024-04-19T03:03:12.128 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:03:12.128 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.128 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.128 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:12.128 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.130500+0000", 2024-04-19T03:03:12.128 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5490000000000003e-06 2024-04-19T03:03:12.128 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.128 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.128 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:12.129 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.190401+0000", 2024-04-19T03:03:12.129 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.059901668999999998 2024-04-19T03:03:12.129 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.129 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.129 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:12.129 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.190421+0000", 2024-04-19T03:03:12.129 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0288e-05 2024-04-19T03:03:12.129 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.129 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.129 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:12.129 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.190536+0000", 2024-04-19T03:03:12.129 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000114783 2024-04-19T03:03:12.129 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.129 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.130 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:12.130 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.190904+0000", 2024-04-19T03:03:12.130 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00036773900000000001 2024-04-19T03:03:12.130 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.130 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.130 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:12.130 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.200417+0000", 2024-04-19T03:03:12.130 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0095128899999999995 2024-04-19T03:03:12.130 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.130 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.130 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:03:12.130 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.200489+0000", 2024-04-19T03:03:12.130 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2554999999999999e-05 2024-04-19T03:03:12.130 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.131 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.131 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:12.131 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.200630+0000", 2024-04-19T03:03:12.131 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014055299999999999 2024-04-19T03:03:12.131 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:12.131 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:12.131 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:12.131 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:12.131 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:12.131 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-19T03:03:12.133 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T03:03:12.133 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:03:12.130+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:03:12.233 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:03:12.228+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:03:12.261 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-04-19T03:03:12.261 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [ 2024-04-19T03:03:12.261 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.261 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:192799 5.9 5:9a2b2f13:::benchmark_data_smithi096_19531_object79349:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-04-19T03:03:12.261 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:03:12.248946+0000", 2024-04-19T03:03:12.261 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0085960770000000006, 2024-04-19T03:03:12.261 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0086222669999999994, 2024-04-19T03:03:12.261 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:12.261 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:03:12.262 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:12.262 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:12.262 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:12.262 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 192799 2024-04-19T03:03:12.262 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.262 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:12.262 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.262 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:12.262 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:12.248946+0000", 2024-04-19T03:03:12.262 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:12.262 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.265 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.265 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:12.265 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:12.248946+0000", 2024-04-19T03:03:12.265 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:12.265 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.266 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.266 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:12.266 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:12.248945+0000", 2024-04-19T03:03:12.266 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999986 2024-04-19T03:03:12.266 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.266 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.266 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:12.266 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:12.248952+0000", 2024-04-19T03:03:12.266 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7920000000000004e-06 2024-04-19T03:03:12.266 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.266 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.267 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:12.267 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:12.248964+0000", 2024-04-19T03:03:12.267 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2451e-05 2024-04-19T03:03:12.267 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.267 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.267 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:12.267 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:12.248983+0000", 2024-04-19T03:03:12.267 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.876e-05 2024-04-19T03:03:12.267 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.267 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.267 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:12.267 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:12.249025+0000", 2024-04-19T03:03:12.268 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2145999999999999e-05 2024-04-19T03:03:12.268 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.268 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.268 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:12.268 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:12.249119+0000", 2024-04-19T03:03:12.268 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.4066000000000004e-05 2024-04-19T03:03:12.268 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.268 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.268 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:03:12.268 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:12.249192+0000", 2024-04-19T03:03:12.268 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2837999999999996e-05 2024-04-19T03:03:12.268 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.269 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.269 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:12.269 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:12.251637+0000", 2024-04-19T03:03:12.269 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0024451479999999999 2024-04-19T03:03:12.269 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:12.269 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:12.269 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:12.269 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.269 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.269 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:192805 5.6 5:68ee8c1d:::benchmark_data_smithi096_19531_object79355:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-04-19T03:03:12.269 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:03:12.251061+0000", 2024-04-19T03:03:12.269 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0064816489999999999, 2024-04-19T03:03:12.270 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.006593397, 2024-04-19T03:03:12.270 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:12.270 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-04-19T03:03:12.270 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:12.270 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:12.270 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:12.270 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 192805 2024-04-19T03:03:12.270 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.270 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:12.270 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.270 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:12.270 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:12.251061+0000", 2024-04-19T03:03:12.271 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:12.271 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.271 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.271 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:12.271 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:12.251061+0000", 2024-04-19T03:03:12.271 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:12.271 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.271 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.271 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:12.271 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:12.251060+0000", 2024-04-19T03:03:12.271 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:03:12.271 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.272 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.272 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:12.272 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:12.251068+0000", 2024-04-19T03:03:12.272 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2959999999999999e-06 2024-04-19T03:03:12.272 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.272 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.272 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:12.272 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:12.251107+0000", 2024-04-19T03:03:12.272 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8773999999999998e-05 2024-04-19T03:03:12.272 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.272 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.273 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:12.273 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:12.251115+0000", 2024-04-19T03:03:12.273 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7819999999999994e-06 2024-04-19T03:03:12.273 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.273 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.273 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:12.273 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:12.252954+0000", 2024-04-19T03:03:12.273 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001839027 2024-04-19T03:03:12.273 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.273 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.273 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:12.273 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:12.253107+0000", 2024-04-19T03:03:12.274 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00015290099999999999 2024-04-19T03:03:12.274 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:12.274 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:12.274 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:12.274 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.274 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.274 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:192806 5.1 5:8785c3fb:::benchmark_data_smithi096_19531_object79356:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-04-19T03:03:12.274 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:03:12.251291+0000", 2024-04-19T03:03:12.274 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0062512419999999997, 2024-04-19T03:03:12.274 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0064312989999999997, 2024-04-19T03:03:12.274 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:12.274 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-04-19T03:03:12.275 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:12.275 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:12.275 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:12.275 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 192806 2024-04-19T03:03:12.275 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.275 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:12.275 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.275 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:12.275 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:12.251291+0000", 2024-04-19T03:03:12.275 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:12.275 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.275 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.275 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:12.276 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:12.251291+0000", 2024-04-19T03:03:12.276 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:12.276 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.276 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.276 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:12.276 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:12.251290+0000", 2024-04-19T03:03:12.276 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:03:12.276 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.276 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.276 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:12.276 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:12.251295+0000", 2024-04-19T03:03:12.276 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8709999999999996e-06 2024-04-19T03:03:12.277 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.277 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.277 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:12.277 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:12.251307+0000", 2024-04-19T03:03:12.277 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.202e-05 2024-04-19T03:03:12.277 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.277 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.277 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:12.277 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:12.251316+0000", 2024-04-19T03:03:12.277 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.7490000000000004e-06 2024-04-19T03:03:12.277 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.277 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.278 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:12.278 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:12.251391+0000", 2024-04-19T03:03:12.278 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4888000000000005e-05 2024-04-19T03:03:12.278 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.278 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.278 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:12.278 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:12.251564+0000", 2024-04-19T03:03:12.278 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00017353599999999999 2024-04-19T03:03:12.278 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:12.278 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:12.278 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:12.278 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.279 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.279 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:192810 5.1 5:832ce29b:::benchmark_data_smithi096_19531_object79360:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-04-19T03:03:12.279 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:03:12.252965+0000", 2024-04-19T03:03:12.279 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0045772199999999999, 2024-04-19T03:03:12.279 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.004824839, 2024-04-19T03:03:12.279 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:12.279 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-04-19T03:03:12.279 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:12.279 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:12.279 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:12.279 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 192810 2024-04-19T03:03:12.280 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.280 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:12.280 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.280 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:12.280 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:12.252965+0000", 2024-04-19T03:03:12.280 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:12.280 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.280 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.280 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:12.280 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:12.252965+0000", 2024-04-19T03:03:12.280 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:12.280 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.281 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.281 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:12.281 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:12.252964+0000", 2024-04-19T03:03:12.281 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:03:12.281 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.281 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.281 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:12.281 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:12.252975+0000", 2024-04-19T03:03:12.281 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0981999999999999e-05 2024-04-19T03:03:12.281 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.281 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.282 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:12.282 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:12.252991+0000", 2024-04-19T03:03:12.282 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.5999999999999999e-05 2024-04-19T03:03:12.282 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.282 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.282 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:12.282 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:12.253001+0000", 2024-04-19T03:03:12.282 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.9289999999999993e-06 2024-04-19T03:03:12.282 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.282 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.282 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:12.282 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:12.253635+0000", 2024-04-19T03:03:12.283 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00063407600000000002 2024-04-19T03:03:12.283 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.283 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.283 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:12.283 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:12.253725+0000", 2024-04-19T03:03:12.283 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9695000000000001e-05 2024-04-19T03:03:12.283 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:12.283 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:12.283 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:12.283 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.283 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.283 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:192811 5.5 5:a0918690:::benchmark_data_smithi096_19531_object79361:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-04-19T03:03:12.284 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:03:12.253014+0000", 2024-04-19T03:03:12.284 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0045287410000000002, 2024-04-19T03:03:12.284 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0048510999999999997, 2024-04-19T03:03:12.284 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:12.284 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-04-19T03:03:12.284 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:12.284 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:12.284 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:12.284 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 192811 2024-04-19T03:03:12.284 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.284 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:12.284 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.285 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:12.285 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:12.253014+0000", 2024-04-19T03:03:12.285 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:12.285 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.285 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.285 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:12.285 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:12.253014+0000", 2024-04-19T03:03:12.285 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:12.285 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.285 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.285 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:12.285 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:12.253013+0000", 2024-04-19T03:03:12.285 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:12.286 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.286 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.286 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:12.286 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:12.253017+0000", 2024-04-19T03:03:12.286 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7390000000000001e-06 2024-04-19T03:03:12.286 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.286 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.286 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:12.286 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:12.253029+0000", 2024-04-19T03:03:12.286 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2221999999999999e-05 2024-04-19T03:03:12.286 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.286 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.287 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:12.287 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:12.253039+0000", 2024-04-19T03:03:12.287 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0135999999999999e-05 2024-04-19T03:03:12.287 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.287 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.287 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:12.287 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:12.253912+0000", 2024-04-19T03:03:12.287 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00087281200000000005 2024-04-19T03:03:12.287 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.287 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.287 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:12.287 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:12.254072+0000", 2024-04-19T03:03:12.288 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00015961 2024-04-19T03:03:12.288 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:12.288 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:12.288 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:12.288 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.288 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.288 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:192812 5.6 5:677088cd:::benchmark_data_smithi096_19531_object79362:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-04-19T03:03:12.288 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:03:12.253139+0000", 2024-04-19T03:03:12.288 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0044030040000000003, 2024-04-19T03:03:12.288 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.004793149, 2024-04-19T03:03:12.288 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:12.288 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-04-19T03:03:12.289 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:12.289 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:12.289 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:12.289 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 192812 2024-04-19T03:03:12.289 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.289 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:12.289 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.289 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:12.289 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:12.253139+0000", 2024-04-19T03:03:12.289 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:12.289 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.289 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.289 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:12.290 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:12.253139+0000", 2024-04-19T03:03:12.290 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:12.290 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.290 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.290 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:12.290 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:12.253139+0000", 2024-04-19T03:03:12.290 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:03:12.290 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.290 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.290 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:12.290 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:12.253147+0000", 2024-04-19T03:03:12.291 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.5769999999999994e-06 2024-04-19T03:03:12.291 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.291 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.291 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:12.291 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:12.253157+0000", 2024-04-19T03:03:12.291 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.5400000000000001e-06 2024-04-19T03:03:12.291 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.291 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.291 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:12.291 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:12.253164+0000", 2024-04-19T03:03:12.291 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4590000000000001e-06 2024-04-19T03:03:12.291 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.292 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.292 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:12.292 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:12.254707+0000", 2024-04-19T03:03:12.292 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0015429199999999999 2024-04-19T03:03:12.292 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.292 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.292 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:12.292 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:12.254873+0000", 2024-04-19T03:03:12.292 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00016549100000000001 2024-04-19T03:03:12.292 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:12.292 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:12.292 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:12.293 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.293 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.293 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:192813 5.c 5:348e625c:::benchmark_data_smithi096_19531_object79363:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-04-19T03:03:12.293 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:03:12.253919+0000", 2024-04-19T03:03:12.293 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.003623636, 2024-04-19T03:03:12.293 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0040782209999999999, 2024-04-19T03:03:12.293 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:12.293 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-04-19T03:03:12.293 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:12.293 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:12.293 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:12.293 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 192813 2024-04-19T03:03:12.293 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.294 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:12.294 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.294 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:12.294 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:12.253919+0000", 2024-04-19T03:03:12.294 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:12.294 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.294 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.294 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:12.294 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:12.253919+0000", 2024-04-19T03:03:12.294 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:12.294 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.294 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.295 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:12.295 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:12.253918+0000", 2024-04-19T03:03:12.295 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:03:12.295 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.295 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.295 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:12.295 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:12.253924+0000", 2024-04-19T03:03:12.295 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.648e-06 2024-04-19T03:03:12.295 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.295 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.295 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:12.296 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:12.253935+0000", 2024-04-19T03:03:12.296 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1392e-05 2024-04-19T03:03:12.296 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.296 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.296 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:12.296 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:12.253943+0000", 2024-04-19T03:03:12.296 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9340000000000006e-06 2024-04-19T03:03:12.296 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.296 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.296 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:12.296 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:12.253989+0000", 2024-04-19T03:03:12.296 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5648000000000001e-05 2024-04-19T03:03:12.297 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.297 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.297 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:12.297 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:12.254084+0000", 2024-04-19T03:03:12.297 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.5246000000000003e-05 2024-04-19T03:03:12.297 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:12.297 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:12.297 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:12.297 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.297 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.297 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:192815 5.1 5:839394ed:::benchmark_data_smithi096_19531_object79365:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-04-19T03:03:12.297 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:03:12.254898+0000", 2024-04-19T03:03:12.297 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0026444039999999999, 2024-04-19T03:03:12.298 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0031750400000000001, 2024-04-19T03:03:12.298 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:12.298 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-04-19T03:03:12.298 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:12.298 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:12.298 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:12.298 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 192815 2024-04-19T03:03:12.298 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.298 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:12.298 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.298 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:12.299 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:12.254898+0000", 2024-04-19T03:03:12.299 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:12.299 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.299 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.299 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:12.299 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:12.254898+0000", 2024-04-19T03:03:12.299 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:12.299 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.299 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.299 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:12.299 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:12.254897+0000", 2024-04-19T03:03:12.299 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999986 2024-04-19T03:03:12.299 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.300 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.300 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:12.300 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:12.254904+0000", 2024-04-19T03:03:12.300 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5580000000000003e-06 2024-04-19T03:03:12.300 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.300 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.300 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:12.300 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:12.254917+0000", 2024-04-19T03:03:12.300 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2860000000000001e-05 2024-04-19T03:03:12.300 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.300 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.301 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:12.301 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:12.254927+0000", 2024-04-19T03:03:12.301 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.2390000000000008e-06 2024-04-19T03:03:12.301 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.301 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.301 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:12.301 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:12.256349+0000", 2024-04-19T03:03:12.301 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0014226200000000001 2024-04-19T03:03:12.301 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.301 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.301 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:12.301 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:12.256437+0000", 2024-04-19T03:03:12.301 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.7687000000000003e-05 2024-04-19T03:03:12.302 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:12.302 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:12.302 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:12.302 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.302 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.302 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:192816 5.d 5:bfdb8d63:::benchmark_data_smithi096_19531_object79366:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-04-19T03:03:12.302 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:03:12.254947+0000", 2024-04-19T03:03:12.302 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0025950460000000002, 2024-04-19T03:03:12.302 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0031916010000000001, 2024-04-19T03:03:12.302 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:12.302 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:03:12.303 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:12.303 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:12.303 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:12.303 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 192816 2024-04-19T03:03:12.303 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.303 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:12.303 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.303 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:12.303 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:12.254947+0000", 2024-04-19T03:03:12.303 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:12.303 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.304 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.304 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:12.304 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:12.254947+0000", 2024-04-19T03:03:12.304 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:12.304 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.304 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.304 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:12.304 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:12.254947+0000", 2024-04-19T03:03:12.304 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:12.304 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.304 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.304 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:12.305 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:12.254956+0000", 2024-04-19T03:03:12.305 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.4560000000000006e-06 2024-04-19T03:03:12.305 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.305 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.305 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:12.305 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:12.254965+0000", 2024-04-19T03:03:12.305 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.7479999999999999e-06 2024-04-19T03:03:12.305 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.305 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.305 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:12.305 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:12.254973+0000", 2024-04-19T03:03:12.305 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.486e-06 2024-04-19T03:03:12.306 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.306 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.306 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:12.306 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:12.255062+0000", 2024-04-19T03:03:12.306 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9697999999999994e-05 2024-04-19T03:03:12.306 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.306 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.306 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:12.306 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:12.255225+0000", 2024-04-19T03:03:12.306 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000162614 2024-04-19T03:03:12.306 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.306 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.307 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:03:12.307 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:12.255368+0000", 2024-04-19T03:03:12.307 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00014320199999999999 2024-04-19T03:03:12.307 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:12.307 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:12.307 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:12.307 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.307 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.307 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:192817 5.f 5:fbc3e9b8:::benchmark_data_smithi096_19531_object79367:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-04-19T03:03:12.307 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:03:12.255645+0000", 2024-04-19T03:03:12.307 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.001897319, 2024-04-19T03:03:12.307 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0025627079999999999, 2024-04-19T03:03:12.308 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:12.308 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:03:12.308 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:12.308 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:12.308 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:12.308 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 192817 2024-04-19T03:03:12.308 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.308 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:12.308 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.308 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:12.308 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:12.255645+0000", 2024-04-19T03:03:12.309 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:12.309 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.309 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.309 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:12.309 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:12.255645+0000", 2024-04-19T03:03:12.309 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:12.309 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.309 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.309 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:12.309 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:12.255644+0000", 2024-04-19T03:03:12.309 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:03:12.309 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.310 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.310 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:12.310 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:12.255650+0000", 2024-04-19T03:03:12.310 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7289999999999997e-06 2024-04-19T03:03:12.310 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.310 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.310 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:12.310 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:12.255665+0000", 2024-04-19T03:03:12.310 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.5315000000000002e-05 2024-04-19T03:03:12.310 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.310 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.310 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:12.311 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:12.255673+0000", 2024-04-19T03:03:12.311 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7249999999999997e-06 2024-04-19T03:03:12.311 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.311 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.311 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:12.311 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:12.256259+0000", 2024-04-19T03:03:12.311 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00058578799999999996 2024-04-19T03:03:12.311 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.311 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.311 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:12.311 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:12.256370+0000", 2024-04-19T03:03:12.311 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000111104 2024-04-19T03:03:12.312 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.312 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.312 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:03:12.312 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:12.256482+0000", 2024-04-19T03:03:12.312 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00011189899999999999 2024-04-19T03:03:12.312 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:12.312 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:12.312 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:12.312 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.312 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.312 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:192819 5.9 5:919444a8:::benchmark_data_smithi096_19531_object79369:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-04-19T03:03:12.312 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:03:12.256248+0000", 2024-04-19T03:03:12.313 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0012941680000000001, 2024-04-19T03:03:12.313 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0020288849999999998, 2024-04-19T03:03:12.313 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:12.313 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:03:12.313 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:12.313 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:12.313 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:12.313 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 192819 2024-04-19T03:03:12.313 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.313 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:12.313 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.313 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:12.314 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:12.256248+0000", 2024-04-19T03:03:12.314 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:12.314 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.314 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.314 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:12.314 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:12.256248+0000", 2024-04-19T03:03:12.314 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:12.314 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.314 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.314 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:12.314 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:12.256247+0000", 2024-04-19T03:03:12.315 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:03:12.315 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.315 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.315 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:12.315 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:12.256259+0000", 2024-04-19T03:03:12.315 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1547e-05 2024-04-19T03:03:12.315 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.315 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.315 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:12.315 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:12.256267+0000", 2024-04-19T03:03:12.315 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5870000000000004e-06 2024-04-19T03:03:12.316 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.316 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.316 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:12.316 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:12.256274+0000", 2024-04-19T03:03:12.316 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.3799999999999996e-06 2024-04-19T03:03:12.316 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.316 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.316 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:12.316 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:12.256330+0000", 2024-04-19T03:03:12.316 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5807999999999998e-05 2024-04-19T03:03:12.316 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.316 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.317 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:12.317 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:12.256462+0000", 2024-04-19T03:03:12.317 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00013244799999999999 2024-04-19T03:03:12.317 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.317 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.317 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:03:12.317 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:12.256601+0000", 2024-04-19T03:03:12.317 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000138522 2024-04-19T03:03:12.317 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:12.317 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:12.317 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:12.317 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.318 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.318 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:192820 5.d 5:b4a0129b:::benchmark_data_smithi096_19531_object79370:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60)", 2024-04-19T03:03:12.318 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:03:12.256282+0000", 2024-04-19T03:03:12.318 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.001260724, 2024-04-19T03:03:12.318 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0020642220000000001, 2024-04-19T03:03:12.318 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:12.318 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:03:12.318 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:12.318 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:12.318 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:12.318 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 192820 2024-04-19T03:03:12.318 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.319 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:12.319 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.319 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:12.319 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:12.256282+0000", 2024-04-19T03:03:12.319 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:12.319 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.319 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.319 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:12.319 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:12.256282+0000", 2024-04-19T03:03:12.319 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:12.319 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.319 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.320 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:12.320 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:12.256281+0000", 2024-04-19T03:03:12.320 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:12.320 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.320 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.320 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:12.320 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:12.256285+0000", 2024-04-19T03:03:12.320 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.168e-06 2024-04-19T03:03:12.320 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.320 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.320 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:12.320 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:12.256289+0000", 2024-04-19T03:03:12.321 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3699999999999997e-06 2024-04-19T03:03:12.321 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.321 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.321 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:12.321 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:12.256292+0000", 2024-04-19T03:03:12.321 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4020000000000002e-06 2024-04-19T03:03:12.321 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.321 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.321 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:12.321 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:12.257506+0000", 2024-04-19T03:03:12.321 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001214002 2024-04-19T03:03:12.321 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.321 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.322 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:12.322 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:12.257659+0000", 2024-04-19T03:03:12.322 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00015296900000000001 2024-04-19T03:03:12.322 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.322 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.322 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:03:12.322 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:12.257768+0000", 2024-04-19T03:03:12.322 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000108979 2024-04-19T03:03:12.322 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:12.322 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:12.322 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:12.322 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:12.323 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-04-19T03:03:12.323 INFO:teuthology.orchestra.run.smithi144.stdout: "num_ops": 12 2024-04-19T03:03:12.323 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-04-19T03:03:12.324 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T03:03:12.334 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:03:12.330+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:03:12.434 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:03:12.430+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:03:12.454 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-04-19T03:03:12.454 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2024-04-19T03:03:12.454 INFO:teuthology.orchestra.run.smithi144.stdout: "complaint_time": 30, 2024-04-19T03:03:12.454 INFO:teuthology.orchestra.run.smithi144.stdout: "num_blocked_ops": 0 2024-04-19T03:03:12.454 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-04-19T03:03:12.465 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T03:03:12.535 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:03:12.530+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:03:12.588 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-04-19T03:03:12.588 INFO:teuthology.orchestra.run.smithi144.stdout: "size": 20, 2024-04-19T03:03:12.588 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 600, 2024-04-19T03:03:12.588 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [ 2024-04-19T03:03:12.588 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.589 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:78992 5.7 5:e6baa862:::benchmark_data_smithi096_19531_object78991:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-19T03:03:12.589 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:18.008888+0000", 2024-04-19T03:03:12.589 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 54.576705101999998, 2024-04-19T03:03:12.589 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.056375285999999997, 2024-04-19T03:03:12.589 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:12.589 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:12.589 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:12.589 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:12.589 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:12.589 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 78992 2024-04-19T03:03:12.589 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.589 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:12.589 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.589 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:12.590 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.008888+0000", 2024-04-19T03:03:12.590 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:12.590 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.590 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.590 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:12.590 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.008888+0000", 2024-04-19T03:03:12.590 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:12.590 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.590 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.590 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:12.590 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.008888+0000", 2024-04-19T03:03:12.590 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:12.590 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.591 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.591 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:12.591 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.008928+0000", 2024-04-19T03:03:12.591 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0361999999999997e-05 2024-04-19T03:03:12.591 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.591 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.591 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:12.591 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.008942+0000", 2024-04-19T03:03:12.591 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4365000000000001e-05 2024-04-19T03:03:12.591 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.591 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.591 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:12.591 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.008949+0000", 2024-04-19T03:03:12.591 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.212e-06 2024-04-19T03:03:12.592 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.592 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.592 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:12.592 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.012683+0000", 2024-04-19T03:03:12.592 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.003733934 2024-04-19T03:03:12.592 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.592 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.592 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:12.592 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.012798+0000", 2024-04-19T03:03:12.592 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00011574999999999999 2024-04-19T03:03:12.592 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.592 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.592 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:12.593 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.012896+0000", 2024-04-19T03:03:12.593 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.7848000000000002e-05 2024-04-19T03:03:12.593 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.593 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.593 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:03:12.593 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016423+0000", 2024-04-19T03:03:12.593 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0035270789999999998 2024-04-19T03:03:12.593 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.593 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.593 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:12.594 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.065098+0000", 2024-04-19T03:03:12.594 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.048674651999999999 2024-04-19T03:03:12.594 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.594 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.594 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:03:12.594 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.065193+0000", 2024-04-19T03:03:12.594 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.5087999999999995e-05 2024-04-19T03:03:12.594 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.594 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.594 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:12.595 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.065264+0000", 2024-04-19T03:03:12.595 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0666000000000004e-05 2024-04-19T03:03:12.595 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:12.595 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:12.595 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:12.595 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.595 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.595 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4755.0:79003 5.2 e40/39 5:4436e33f:::benchmark_data_smithi096_19531_object79002:head v 40'4935, mlcod=40'4932)", 2024-04-19T03:03:12.595 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:18.018102+0000", 2024-04-19T03:03:12.595 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 54.567491046000001, 2024-04-19T03:03:12.595 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.060023990999999999, 2024-04-19T03:03:12.595 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:12.595 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:12.595 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:12.596 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.596 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:12.596 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018102+0000", 2024-04-19T03:03:12.596 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:12.596 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.596 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.596 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:12.596 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018102+0000", 2024-04-19T03:03:12.596 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:12.596 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.596 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.596 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:12.596 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018102+0000", 2024-04-19T03:03:12.597 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:12.597 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.597 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.597 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:12.597 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018134+0000", 2024-04-19T03:03:12.597 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2722000000000003e-05 2024-04-19T03:03:12.597 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.597 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.597 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:12.597 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018145+0000", 2024-04-19T03:03:12.597 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0395e-05 2024-04-19T03:03:12.597 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.597 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.597 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:12.597 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018151+0000", 2024-04-19T03:03:12.598 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5300000000000002e-06 2024-04-19T03:03:12.598 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.598 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.598 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:12.598 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018489+0000", 2024-04-19T03:03:12.598 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00033731499999999998 2024-04-19T03:03:12.598 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.598 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.598 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:12.598 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018508+0000", 2024-04-19T03:03:12.598 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9775e-05 2024-04-19T03:03:12.598 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.598 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.599 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:03:12.599 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.078059+0000", 2024-04-19T03:03:12.599 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.059550171999999998 2024-04-19T03:03:12.599 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.599 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.599 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:12.599 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.078126+0000", 2024-04-19T03:03:12.599 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7773000000000003e-05 2024-04-19T03:03:12.599 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:12.599 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:12.599 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:12.599 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.599 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.599 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:86612 5.7 5:e32e3c49:::benchmark_data_smithi096_19531_object86611:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:12.599 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:22.633560+0000", 2024-04-19T03:03:12.600 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 49.952033385999997, 2024-04-19T03:03:12.600 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.19135289, 2024-04-19T03:03:12.600 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:12.600 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:12.600 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:12.600 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:12.600 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:12.600 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 86612 2024-04-19T03:03:12.600 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.600 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:12.600 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.600 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:12.600 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633560+0000", 2024-04-19T03:03:12.600 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:12.601 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.601 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.601 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:12.602 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633560+0000", 2024-04-19T03:03:12.602 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:12.602 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.602 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.602 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:12.603 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633558+0000", 2024-04-19T03:03:12.603 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999986 2024-04-19T03:03:12.603 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.603 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.603 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:12.603 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633609+0000", 2024-04-19T03:03:12.603 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0850999999999998e-05 2024-04-19T03:03:12.603 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.604 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.604 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:12.604 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633627+0000", 2024-04-19T03:03:12.604 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7951000000000001e-05 2024-04-19T03:03:12.604 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.604 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.604 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:12.604 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633635+0000", 2024-04-19T03:03:12.604 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2530000000000004e-06 2024-04-19T03:03:12.604 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.605 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.605 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:12.605 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633699+0000", 2024-04-19T03:03:12.605 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3901999999999999e-05 2024-04-19T03:03:12.605 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.605 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.605 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:12.605 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633992+0000", 2024-04-19T03:03:12.605 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00029283299999999999 2024-04-19T03:03:12.606 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.606 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.606 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:12.606 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.634223+0000", 2024-04-19T03:03:12.606 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00023084200000000001 2024-04-19T03:03:12.606 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.606 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.606 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:03:12.606 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.639085+0000", 2024-04-19T03:03:12.606 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0048624269999999999 2024-04-19T03:03:12.606 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.606 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.606 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:12.607 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.824635+0000", 2024-04-19T03:03:12.607 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.18554944700000001 2024-04-19T03:03:12.607 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.607 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.607 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:03:12.607 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.824793+0000", 2024-04-19T03:03:12.607 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000157959 2024-04-19T03:03:12.607 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.607 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.607 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:12.607 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.824913+0000", 2024-04-19T03:03:12.608 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000120093 2024-04-19T03:03:12.608 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:12.608 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:12.608 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:12.608 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.608 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.608 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:86625 5.7 5:e6d00488:::benchmark_data_smithi096_19531_object86624:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:12.608 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:22.643554+0000", 2024-04-19T03:03:12.608 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 49.942039620000003, 2024-04-19T03:03:12.608 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.18732841, 2024-04-19T03:03:12.608 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:12.608 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:12.608 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:12.609 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:12.609 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:12.609 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 86625 2024-04-19T03:03:12.609 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.609 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:12.609 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.609 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:12.609 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643554+0000", 2024-04-19T03:03:12.609 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:12.609 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.609 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.609 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:12.609 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643554+0000", 2024-04-19T03:03:12.610 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:12.610 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.610 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.610 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:12.610 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643552+0000", 2024-04-19T03:03:12.610 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999986 2024-04-19T03:03:12.610 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.610 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.610 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:12.610 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643588+0000", 2024-04-19T03:03:12.610 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5855999999999997e-05 2024-04-19T03:03:12.610 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.610 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.611 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:12.611 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643606+0000", 2024-04-19T03:03:12.611 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8226000000000001e-05 2024-04-19T03:03:12.611 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.611 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.611 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:12.611 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643618+0000", 2024-04-19T03:03:12.611 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1868000000000001e-05 2024-04-19T03:03:12.611 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.611 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.611 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:12.611 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643676+0000", 2024-04-19T03:03:12.612 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8153999999999999e-05 2024-04-19T03:03:12.612 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.612 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.612 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:12.612 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643905+0000", 2024-04-19T03:03:12.612 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00022847500000000001 2024-04-19T03:03:12.612 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.612 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.612 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:12.612 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.644150+0000", 2024-04-19T03:03:12.612 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00024531800000000001 2024-04-19T03:03:12.613 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.613 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.613 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:03:12.613 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.647407+0000", 2024-04-19T03:03:12.613 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0032563190000000001 2024-04-19T03:03:12.613 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.613 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.613 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:12.613 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.830721+0000", 2024-04-19T03:03:12.613 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.18331468300000001 2024-04-19T03:03:12.613 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.613 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.614 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:03:12.614 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.830813+0000", 2024-04-19T03:03:12.614 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.2205000000000002e-05 2024-04-19T03:03:12.614 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.614 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.614 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:12.614 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.830882+0000", 2024-04-19T03:03:12.614 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8819999999999995e-05 2024-04-19T03:03:12.614 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:12.614 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:12.614 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:12.614 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.615 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.615 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87063 5.7 5:e502e824:::benchmark_data_smithi096_19531_object87062:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:12.615 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.136067+0000", 2024-04-19T03:03:12.615 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 49.449526751000001, 2024-04-19T03:03:12.615 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.065521159999999995, 2024-04-19T03:03:12.615 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:12.615 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:12.615 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:12.615 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:12.615 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:12.615 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87063 2024-04-19T03:03:12.615 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.615 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:12.616 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.616 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:12.616 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.136067+0000", 2024-04-19T03:03:12.616 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:12.616 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.616 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.616 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:12.616 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.136067+0000", 2024-04-19T03:03:12.616 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:12.616 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.616 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.616 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:12.616 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.136066+0000", 2024-04-19T03:03:12.617 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:03:12.617 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.617 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.617 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:12.617 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.136154+0000", 2024-04-19T03:03:12.617 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.8256000000000003e-05 2024-04-19T03:03:12.617 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.617 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.617 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:12.617 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.136162+0000", 2024-04-19T03:03:12.617 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.5099999999999998e-06 2024-04-19T03:03:12.617 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.617 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.618 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:12.618 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.136171+0000", 2024-04-19T03:03:12.618 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2830000000000001e-06 2024-04-19T03:03:12.618 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.618 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.618 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:12.618 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.138421+0000", 2024-04-19T03:03:12.618 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0022506620000000001 2024-04-19T03:03:12.618 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.618 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.618 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:12.618 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.138560+0000", 2024-04-19T03:03:12.619 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000138446 2024-04-19T03:03:12.619 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.619 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.619 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:12.619 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.138689+0000", 2024-04-19T03:03:12.619 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00012950700000000001 2024-04-19T03:03:12.619 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.619 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.619 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:03:12.619 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.141517+0000", 2024-04-19T03:03:12.619 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0028280860000000001 2024-04-19T03:03:12.619 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.619 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.619 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:12.620 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.201350+0000", 2024-04-19T03:03:12.620 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.059832418999999998 2024-04-19T03:03:12.620 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.620 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.620 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:03:12.620 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.201485+0000", 2024-04-19T03:03:12.620 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000135597 2024-04-19T03:03:12.620 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.620 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.620 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:12.620 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.201588+0000", 2024-04-19T03:03:12.620 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00010247900000000001 2024-04-19T03:03:12.620 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:12.621 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:12.621 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:12.621 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.621 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.621 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87072 5.7 5:e3c7809a:::benchmark_data_smithi096_19531_object87071:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:12.621 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.144224+0000", 2024-04-19T03:03:12.621 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 49.441369727000001, 2024-04-19T03:03:12.621 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.058179555000000001, 2024-04-19T03:03:12.621 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:12.621 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:12.621 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:12.621 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:12.621 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:12.621 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87072 2024-04-19T03:03:12.621 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.622 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:12.622 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.622 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:12.622 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144224+0000", 2024-04-19T03:03:12.622 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:12.622 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.622 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.622 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:12.622 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144224+0000", 2024-04-19T03:03:12.622 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:12.622 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.622 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.622 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:12.622 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144223+0000", 2024-04-19T03:03:12.623 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:03:12.623 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.623 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.623 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:12.623 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144320+0000", 2024-04-19T03:03:12.623 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.7075000000000001e-05 2024-04-19T03:03:12.623 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.623 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.623 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:12.623 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144331+0000", 2024-04-19T03:03:12.623 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1342000000000001e-05 2024-04-19T03:03:12.623 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.623 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.623 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:12.624 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144337+0000", 2024-04-19T03:03:12.624 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8390000000000003e-06 2024-04-19T03:03:12.624 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.624 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.624 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:12.624 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144369+0000", 2024-04-19T03:03:12.624 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2079000000000002e-05 2024-04-19T03:03:12.624 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.624 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.624 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:12.624 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144464+0000", 2024-04-19T03:03:12.624 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.4623000000000005e-05 2024-04-19T03:03:12.624 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.624 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.625 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:12.625 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144553+0000", 2024-04-19T03:03:12.625 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9171000000000004e-05 2024-04-19T03:03:12.625 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.625 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.625 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:03:12.625 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.147018+0000", 2024-04-19T03:03:12.625 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0024648370000000001 2024-04-19T03:03:12.625 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.625 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.625 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:12.625 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.202270+0000", 2024-04-19T03:03:12.625 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.055252018 2024-04-19T03:03:12.626 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.626 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.626 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:03:12.626 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.202356+0000", 2024-04-19T03:03:12.626 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6648000000000001e-05 2024-04-19T03:03:12.626 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.626 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.626 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:12.626 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.202403+0000", 2024-04-19T03:03:12.626 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6956999999999998e-05 2024-04-19T03:03:12.626 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:12.626 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:12.627 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:12.627 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.627 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.627 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87123 5.6 5:6d1bc3b9:::benchmark_data_smithi096_19531_object87122:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:03:12.627 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249233+0000", 2024-04-19T03:03:12.627 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 49.336360695000003, 2024-04-19T03:03:12.627 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0291700720000001, 2024-04-19T03:03:12.627 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:12.627 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-04-19T03:03:12.627 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:12.627 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:12.627 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:12.627 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87123 2024-04-19T03:03:12.627 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.628 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:12.628 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.628 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:12.628 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249233+0000", 2024-04-19T03:03:12.628 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:12.628 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.628 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.628 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:12.628 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249233+0000", 2024-04-19T03:03:12.628 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:12.628 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.628 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.628 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:12.629 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249231+0000", 2024-04-19T03:03:12.629 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999986 2024-04-19T03:03:12.629 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.629 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.629 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:12.629 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249285+0000", 2024-04-19T03:03:12.629 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4005000000000002e-05 2024-04-19T03:03:12.629 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.629 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.629 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:12.629 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249300+0000", 2024-04-19T03:03:12.629 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4715999999999999e-05 2024-04-19T03:03:12.629 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.629 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.630 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:12.630 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249307+0000", 2024-04-19T03:03:12.630 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8399999999999997e-06 2024-04-19T03:03:12.630 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.630 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.630 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:12.630 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249366+0000", 2024-04-19T03:03:12.630 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9435999999999998e-05 2024-04-19T03:03:12.630 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.630 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.630 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op must wait for map", 2024-04-19T03:03:12.631 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249376+0000", 2024-04-19T03:03:12.631 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.4919999999999999e-06 2024-04-19T03:03:12.631 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.631 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.631 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:12.631 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263757+0000", 2024-04-19T03:03:12.631 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.014381461999999999 2024-04-19T03:03:12.631 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.631 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.631 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:03:12.631 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263875+0000", 2024-04-19T03:03:12.631 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000117166 2024-04-19T03:03:12.631 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.631 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.632 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:12.632 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.277136+0000", 2024-04-19T03:03:12.632 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.013261207 2024-04-19T03:03:12.632 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.632 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.632 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:12.632 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.278403+0000", 2024-04-19T03:03:12.632 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001267106 2024-04-19T03:03:12.632 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:12.632 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:12.632 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:12.632 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.632 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.632 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87128 5.6 5:6905c420:::benchmark_data_smithi096_19531_object87127:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:03:12.633 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249323+0000", 2024-04-19T03:03:12.633 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 49.336269948000002, 2024-04-19T03:03:12.633 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0292813249999999, 2024-04-19T03:03:12.633 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:12.633 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-04-19T03:03:12.633 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:12.633 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:12.633 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:12.633 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87128 2024-04-19T03:03:12.633 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.633 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:12.633 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.633 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:12.634 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249323+0000", 2024-04-19T03:03:12.634 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:12.634 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.634 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.634 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:12.634 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249323+0000", 2024-04-19T03:03:12.634 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:12.634 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.634 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.634 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:12.634 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249323+0000", 2024-04-19T03:03:12.634 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:12.634 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.635 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.635 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:12.635 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249385+0000", 2024-04-19T03:03:12.635 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1711999999999995e-05 2024-04-19T03:03:12.635 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.635 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.635 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:12.635 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249398+0000", 2024-04-19T03:03:12.635 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3022e-05 2024-04-19T03:03:12.635 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.635 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.636 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:12.636 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249402+0000", 2024-04-19T03:03:12.636 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4819999999999996e-06 2024-04-19T03:03:12.636 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.636 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.636 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:12.636 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249437+0000", 2024-04-19T03:03:12.636 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4702000000000001e-05 2024-04-19T03:03:12.636 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.636 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.636 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:03:12.636 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249442+0000", 2024-04-19T03:03:12.636 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8019999999999999e-06 2024-04-19T03:03:12.636 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.637 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.637 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:12.637 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263896+0000", 2024-04-19T03:03:12.637 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.014454679999999999 2024-04-19T03:03:12.637 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.637 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.637 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:03:12.637 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263900+0000", 2024-04-19T03:03:12.637 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9700000000000001e-06 2024-04-19T03:03:12.637 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.637 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.637 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:12.638 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.278557+0000", 2024-04-19T03:03:12.638 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0146566480000001 2024-04-19T03:03:12.638 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.638 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.638 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:12.638 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.278605+0000", 2024-04-19T03:03:12.638 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7735999999999998e-05 2024-04-19T03:03:12.638 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:12.638 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:12.638 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:12.638 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.638 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.638 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87130 5.3 5:c8c2d67b:::benchmark_data_smithi096_19531_object87129:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:03:12.639 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249418+0000", 2024-04-19T03:03:12.639 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 49.336175236999999, 2024-04-19T03:03:12.639 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.025414182, 2024-04-19T03:03:12.639 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:12.639 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-04-19T03:03:12.639 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:12.639 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:12.639 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:12.639 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87130 2024-04-19T03:03:12.639 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.639 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:12.639 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.639 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:12.639 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249418+0000", 2024-04-19T03:03:12.640 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:12.640 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.640 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.640 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:12.640 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249418+0000", 2024-04-19T03:03:12.640 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:12.640 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.640 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.640 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:12.640 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249409+0000", 2024-04-19T03:03:12.640 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999905 2024-04-19T03:03:12.640 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.640 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.640 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:12.641 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249464+0000", 2024-04-19T03:03:12.641 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5381999999999999e-05 2024-04-19T03:03:12.641 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.641 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.641 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:12.641 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249471+0000", 2024-04-19T03:03:12.641 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2609999999999996e-06 2024-04-19T03:03:12.641 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.641 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.641 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:12.641 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249475+0000", 2024-04-19T03:03:12.641 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2839999999999998e-06 2024-04-19T03:03:12.641 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.641 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.642 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:12.642 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249535+0000", 2024-04-19T03:03:12.642 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0545999999999999e-05 2024-04-19T03:03:12.642 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.642 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.642 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op must wait for map", 2024-04-19T03:03:12.642 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249540+0000", 2024-04-19T03:03:12.642 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2859999999999999e-06 2024-04-19T03:03:12.642 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.642 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.642 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:12.642 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263450+0000", 2024-04-19T03:03:12.643 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.013909585 2024-04-19T03:03:12.643 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.643 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.643 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:03:12.643 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263458+0000", 2024-04-19T03:03:12.643 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8089999999999993e-06 2024-04-19T03:03:12.643 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.643 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.643 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:12.643 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.273193+0000", 2024-04-19T03:03:12.643 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0097351379999999 2024-04-19T03:03:12.643 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.643 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.643 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:12.644 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.274832+0000", 2024-04-19T03:03:12.644 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0016394789999999999 2024-04-19T03:03:12.644 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:12.644 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:12.644 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:12.644 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.644 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.644 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87131 5.1 5:83756d55:::benchmark_data_smithi096_19531_object87130:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:03:12.644 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249491+0000", 2024-04-19T03:03:12.644 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 49.336102590000003, 2024-04-19T03:03:12.644 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0191489520000001, 2024-04-19T03:03:12.644 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:12.644 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-04-19T03:03:12.644 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:12.645 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:12.645 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:12.645 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87131 2024-04-19T03:03:12.645 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.645 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:12.645 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.645 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:12.645 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249491+0000", 2024-04-19T03:03:12.645 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:12.645 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.645 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.645 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:12.646 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249491+0000", 2024-04-19T03:03:12.646 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:12.646 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.646 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.646 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:12.646 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249491+0000", 2024-04-19T03:03:12.646 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:12.646 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.646 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.646 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:12.646 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249530+0000", 2024-04-19T03:03:12.646 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9589000000000003e-05 2024-04-19T03:03:12.646 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.647 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.647 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:12.647 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249544+0000", 2024-04-19T03:03:12.647 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4158000000000001e-05 2024-04-19T03:03:12.647 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.647 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.647 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:12.647 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249549+0000", 2024-04-19T03:03:12.647 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6809999999999997e-06 2024-04-19T03:03:12.647 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.647 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.648 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:12.648 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249592+0000", 2024-04-19T03:03:12.648 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3285999999999999e-05 2024-04-19T03:03:12.648 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.648 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.648 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op must wait for map", 2024-04-19T03:03:12.648 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249598+0000", 2024-04-19T03:03:12.648 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8329999999999999e-06 2024-04-19T03:03:12.648 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.648 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.648 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:12.649 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263331+0000", 2024-04-19T03:03:12.649 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.013733093 2024-04-19T03:03:12.649 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.649 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.649 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:03:12.649 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263343+0000", 2024-04-19T03:03:12.649 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.189e-05 2024-04-19T03:03:12.649 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.649 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.649 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:12.649 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.268541+0000", 2024-04-19T03:03:12.649 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0051983440000001 2024-04-19T03:03:12.649 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.649 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.650 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:12.650 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.268640+0000", 2024-04-19T03:03:12.650 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.8387999999999994e-05 2024-04-19T03:03:12.650 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:12.650 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:12.650 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:12.650 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.650 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.650 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87132 5.c 5:3e18b732:::benchmark_data_smithi096_19531_object87131:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:03:12.650 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249558+0000", 2024-04-19T03:03:12.650 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 49.336035688999999, 2024-04-19T03:03:12.650 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0241198380000001, 2024-04-19T03:03:12.650 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:12.651 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-04-19T03:03:12.651 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:12.651 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:12.651 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:12.651 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87132 2024-04-19T03:03:12.651 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.651 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:12.651 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.651 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:12.651 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249558+0000", 2024-04-19T03:03:12.651 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:12.651 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.651 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.652 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:12.652 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249558+0000", 2024-04-19T03:03:12.652 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:12.652 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.652 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.652 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:12.652 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249557+0000", 2024-04-19T03:03:12.652 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:12.652 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.652 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.652 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:12.652 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249625+0000", 2024-04-19T03:03:12.653 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7200999999999996e-05 2024-04-19T03:03:12.653 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.653 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.653 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:12.653 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249646+0000", 2024-04-19T03:03:12.653 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1053e-05 2024-04-19T03:03:12.653 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.653 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.653 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:12.653 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249650+0000", 2024-04-19T03:03:12.653 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2719999999999999e-06 2024-04-19T03:03:12.653 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.653 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.653 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:12.654 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249686+0000", 2024-04-19T03:03:12.654 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6430000000000002e-05 2024-04-19T03:03:12.654 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.654 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.654 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op must wait for map", 2024-04-19T03:03:12.654 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249690+0000", 2024-04-19T03:03:12.654 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.765e-06 2024-04-19T03:03:12.654 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.654 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.654 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:12.654 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261157+0000", 2024-04-19T03:03:12.654 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011467247999999999 2024-04-19T03:03:12.655 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.655 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.655 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:03:12.655 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261170+0000", 2024-04-19T03:03:12.655 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2833000000000001e-05 2024-04-19T03:03:12.655 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.655 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.655 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:12.655 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.272119+0000", 2024-04-19T03:03:12.655 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.010949313 2024-04-19T03:03:12.655 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.655 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.655 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:12.655 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.273678+0000", 2024-04-19T03:03:12.656 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0015581550000000001 2024-04-19T03:03:12.656 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:12.656 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:12.656 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:12.656 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.656 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.656 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87133 5.c 5:3f772a62:::benchmark_data_smithi096_19531_object87132:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:03:12.656 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249657+0000", 2024-04-19T03:03:12.656 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 49.335936310000001, 2024-04-19T03:03:12.656 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0242819409999999, 2024-04-19T03:03:12.656 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:12.656 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-04-19T03:03:12.656 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:12.656 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:12.657 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:12.657 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87133 2024-04-19T03:03:12.657 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.657 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:12.657 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.657 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:12.657 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249657+0000", 2024-04-19T03:03:12.657 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:12.657 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.657 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.657 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:12.657 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249657+0000", 2024-04-19T03:03:12.657 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:12.658 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.658 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.658 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:12.658 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249657+0000", 2024-04-19T03:03:12.658 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:12.658 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.658 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.658 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:12.658 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249690+0000", 2024-04-19T03:03:12.658 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3343000000000002e-05 2024-04-19T03:03:12.658 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.658 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.659 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:12.659 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249695+0000", 2024-04-19T03:03:12.659 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8600000000000001e-06 2024-04-19T03:03:12.659 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.659 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.659 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:12.659 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249698+0000", 2024-04-19T03:03:12.659 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.1700000000000001e-06 2024-04-19T03:03:12.659 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.659 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.659 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:12.659 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249741+0000", 2024-04-19T03:03:12.659 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2849999999999998e-05 2024-04-19T03:03:12.659 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.660 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.660 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:03:12.660 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249746+0000", 2024-04-19T03:03:12.660 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1019999999999996e-06 2024-04-19T03:03:12.660 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.660 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.660 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:12.660 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261209+0000", 2024-04-19T03:03:12.660 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011462447000000001 2024-04-19T03:03:12.660 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.660 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.660 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:03:12.660 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261216+0000", 2024-04-19T03:03:12.661 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8520000000000004e-06 2024-04-19T03:03:12.661 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.661 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.661 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:12.661 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.273872+0000", 2024-04-19T03:03:12.661 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0126558000000001 2024-04-19T03:03:12.661 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.661 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.661 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:12.661 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.273939+0000", 2024-04-19T03:03:12.661 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6822000000000005e-05 2024-04-19T03:03:12.661 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:12.661 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:12.662 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:12.662 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.662 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.662 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87134 5.5 5:a56c478f:::benchmark_data_smithi096_19531_object87133:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:03:12.662 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249708+0000", 2024-04-19T03:03:12.662 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 49.335885386000001, 2024-04-19T03:03:12.662 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0214677299999999, 2024-04-19T03:03:12.662 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:12.662 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-04-19T03:03:12.662 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:12.662 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:12.662 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:12.663 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87134 2024-04-19T03:03:12.663 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.663 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:12.663 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.663 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:12.663 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249708+0000", 2024-04-19T03:03:12.663 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:12.663 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.663 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.663 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:12.663 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249708+0000", 2024-04-19T03:03:12.663 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:12.663 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.664 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.664 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:12.664 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249706+0000", 2024-04-19T03:03:12.664 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999976 2024-04-19T03:03:12.664 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.664 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.664 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:12.664 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249740+0000", 2024-04-19T03:03:12.664 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4458000000000001e-05 2024-04-19T03:03:12.664 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.664 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.664 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:12.665 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249745+0000", 2024-04-19T03:03:12.665 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5020000000000003e-06 2024-04-19T03:03:12.665 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.665 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.665 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:12.665 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249748+0000", 2024-04-19T03:03:12.665 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2499999999999998e-06 2024-04-19T03:03:12.665 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.665 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.665 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:12.665 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249778+0000", 2024-04-19T03:03:12.665 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.006e-05 2024-04-19T03:03:12.665 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.666 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.666 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op must wait for map", 2024-04-19T03:03:12.666 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249782+0000", 2024-04-19T03:03:12.666 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2910000000000001e-06 2024-04-19T03:03:12.666 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.666 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.666 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:12.666 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261666+0000", 2024-04-19T03:03:12.666 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011883471 2024-04-19T03:03:12.666 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.666 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.667 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:03:12.667 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261674+0000", 2024-04-19T03:03:12.667 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6479999999999992e-06 2024-04-19T03:03:12.667 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.667 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.667 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:12.667 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.269323+0000", 2024-04-19T03:03:12.667 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.00764867 2024-04-19T03:03:12.667 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.667 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.667 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:12.667 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.271176+0000", 2024-04-19T03:03:12.667 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001852844 2024-04-19T03:03:12.667 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:12.668 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:12.668 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:12.668 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.668 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.668 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87137 5.c 5:30708c68:::benchmark_data_smithi096_19531_object87136:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:03:12.668 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249756+0000", 2024-04-19T03:03:12.668 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 49.335837679999997, 2024-04-19T03:03:12.668 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.033331752, 2024-04-19T03:03:12.668 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:12.668 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:12.668 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:12.668 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:12.668 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:12.669 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87137 2024-04-19T03:03:12.669 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.669 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:12.669 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.669 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:12.669 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249756+0000", 2024-04-19T03:03:12.669 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:12.669 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.669 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.669 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:12.669 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249756+0000", 2024-04-19T03:03:12.669 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:12.669 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.669 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.670 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:12.670 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249755+0000", 2024-04-19T03:03:12.670 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:12.670 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.670 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.670 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:12.670 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249777+0000", 2024-04-19T03:03:12.670 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1420000000000002e-05 2024-04-19T03:03:12.670 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.670 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.670 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:12.670 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249781+0000", 2024-04-19T03:03:12.670 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0609999999999997e-06 2024-04-19T03:03:12.670 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.671 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.673 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:12.673 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249787+0000", 2024-04-19T03:03:12.673 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.02e-06 2024-04-19T03:03:12.673 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.673 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.674 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:12.674 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249818+0000", 2024-04-19T03:03:12.674 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0947e-05 2024-04-19T03:03:12.674 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.674 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.674 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:03:12.674 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249821+0000", 2024-04-19T03:03:12.674 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.117e-06 2024-04-19T03:03:12.674 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.674 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.674 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:12.674 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261243+0000", 2024-04-19T03:03:12.674 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011421875999999999 2024-04-19T03:03:12.675 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.675 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.675 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:03:12.675 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261251+0000", 2024-04-19T03:03:12.675 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6120000000000001e-06 2024-04-19T03:03:12.675 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.675 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.675 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:12.675 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.274050+0000", 2024-04-19T03:03:12.675 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.012799405 2024-04-19T03:03:12.675 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.675 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.675 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:12.676 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.274529+0000", 2024-04-19T03:03:12.676 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00047867100000000001 2024-04-19T03:03:12.676 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.676 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.676 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:03:12.676 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.282972+0000", 2024-04-19T03:03:12.676 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0084436900000000002 2024-04-19T03:03:12.676 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.676 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.676 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:03:12.676 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.283022+0000", 2024-04-19T03:03:12.676 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9339000000000003e-05 2024-04-19T03:03:12.676 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.677 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.677 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:12.677 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.283088+0000", 2024-04-19T03:03:12.677 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5877999999999995e-05 2024-04-19T03:03:12.677 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:12.677 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:12.677 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:12.677 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.677 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.677 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:158376 5.9 5:9e73c076:::benchmark_data_smithi096_19531_object44926:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-19T03:03:12.677 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:58.126227+0000", 2024-04-19T03:03:12.677 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 14.459365947, 2024-04-19T03:03:12.677 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.069738668000000004, 2024-04-19T03:03:12.677 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:12.678 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:12.678 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:12.678 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:12.678 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:12.678 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 158376 2024-04-19T03:03:12.678 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.678 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:12.678 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.678 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:12.678 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.126227+0000", 2024-04-19T03:03:12.678 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:12.678 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.679 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.679 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:12.679 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.126227+0000", 2024-04-19T03:03:12.679 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:12.679 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.679 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.680 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:12.680 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.126226+0000", 2024-04-19T03:03:12.680 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:03:12.680 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.680 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.680 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:12.680 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.126236+0000", 2024-04-19T03:03:12.681 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.4199999999999996e-06 2024-04-19T03:03:12.681 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.681 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.681 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:12.681 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.126243+0000", 2024-04-19T03:03:12.681 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.199e-06 2024-04-19T03:03:12.681 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.681 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.682 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:12.682 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.126248+0000", 2024-04-19T03:03:12.682 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1320000000000002e-06 2024-04-19T03:03:12.682 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.682 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.682 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:12.682 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.126286+0000", 2024-04-19T03:03:12.682 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7401000000000003e-05 2024-04-19T03:03:12.683 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.683 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.683 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:12.684 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.126368+0000", 2024-04-19T03:03:12.684 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2113999999999993e-05 2024-04-19T03:03:12.684 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.684 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.684 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:03:12.684 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.126438+0000", 2024-04-19T03:03:12.685 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0337000000000001e-05 2024-04-19T03:03:12.685 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.685 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.685 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:03:12.685 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.130816+0000", 2024-04-19T03:03:12.686 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0043778330000000002 2024-04-19T03:03:12.686 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.687 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.687 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:12.687 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.195830+0000", 2024-04-19T03:03:12.687 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.065013933999999995 2024-04-19T03:03:12.687 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.687 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.687 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:03:12.687 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.195907+0000", 2024-04-19T03:03:12.688 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7397000000000005e-05 2024-04-19T03:03:12.688 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.688 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.688 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:12.688 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.195966+0000", 2024-04-19T03:03:12.688 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8906999999999997e-05 2024-04-19T03:03:12.688 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:12.688 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:12.689 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:12.690 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.690 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.690 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:158381 5.9 5:94dcd4a7:::benchmark_data_smithi096_19531_object44931:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-19T03:03:12.690 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:58.128712+0000", 2024-04-19T03:03:12.690 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 14.456881504, 2024-04-19T03:03:12.690 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.067497527000000002, 2024-04-19T03:03:12.691 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:12.692 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:12.692 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:12.692 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:12.692 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:12.692 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 158381 2024-04-19T03:03:12.692 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.692 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:12.693 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.693 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:12.693 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.128712+0000", 2024-04-19T03:03:12.693 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:12.694 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.694 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.694 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:12.694 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.128712+0000", 2024-04-19T03:03:12.694 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:12.695 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.695 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.695 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:12.695 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.128711+0000", 2024-04-19T03:03:12.695 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:03:12.695 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.695 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.695 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:12.695 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.128716+0000", 2024-04-19T03:03:12.695 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0610000000000003e-06 2024-04-19T03:03:12.695 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.696 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.696 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:12.696 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.128724+0000", 2024-04-19T03:03:12.696 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0120000000000005e-06 2024-04-19T03:03:12.696 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.696 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.696 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:12.696 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.128729+0000", 2024-04-19T03:03:12.697 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8899999999999998e-06 2024-04-19T03:03:12.697 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.697 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.697 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:12.697 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.128778+0000", 2024-04-19T03:03:12.697 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9110000000000002e-05 2024-04-19T03:03:12.697 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.697 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.697 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:12.697 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.128903+0000", 2024-04-19T03:03:12.697 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00012506799999999999 2024-04-19T03:03:12.697 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.697 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.697 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:03:12.698 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.129022+0000", 2024-04-19T03:03:12.698 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00011923599999999999 2024-04-19T03:03:12.698 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.698 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.698 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:03:12.698 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.132294+0000", 2024-04-19T03:03:12.698 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.003271244 2024-04-19T03:03:12.698 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.698 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.698 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:12.698 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.196045+0000", 2024-04-19T03:03:12.699 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.063751206000000005 2024-04-19T03:03:12.699 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.699 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.699 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:03:12.699 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.196133+0000", 2024-04-19T03:03:12.699 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.8213000000000004e-05 2024-04-19T03:03:12.699 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.699 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.699 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:12.699 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.196209+0000", 2024-04-19T03:03:12.699 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6335999999999996e-05 2024-04-19T03:03:12.699 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:12.700 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:12.700 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:12.700 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.700 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.700 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:158385 5.9 5:950ec749:::benchmark_data_smithi096_19531_object44935:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-19T03:03:12.700 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:58.129756+0000", 2024-04-19T03:03:12.700 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 14.455837572, 2024-04-19T03:03:12.701 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.068998382999999996, 2024-04-19T03:03:12.701 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:12.701 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:12.701 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:12.701 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:12.701 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:12.701 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 158385 2024-04-19T03:03:12.701 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.701 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:12.701 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.701 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:12.702 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.129756+0000", 2024-04-19T03:03:12.702 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:12.702 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.702 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.702 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:12.702 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.129756+0000", 2024-04-19T03:03:12.702 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:12.702 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.702 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.702 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:12.702 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.129755+0000", 2024-04-19T03:03:12.702 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:03:12.703 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.703 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.703 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:12.703 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.129760+0000", 2024-04-19T03:03:12.703 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6030000000000004e-06 2024-04-19T03:03:12.703 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.703 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.703 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:12.703 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.129774+0000", 2024-04-19T03:03:12.703 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3131e-05 2024-04-19T03:03:12.703 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.704 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.704 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:12.704 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.129781+0000", 2024-04-19T03:03:12.704 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4030000000000001e-06 2024-04-19T03:03:12.704 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.704 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.704 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:12.704 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.130837+0000", 2024-04-19T03:03:12.704 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00105569 2024-04-19T03:03:12.704 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.704 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.704 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:12.704 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.130917+0000", 2024-04-19T03:03:12.705 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9929e-05 2024-04-19T03:03:12.705 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.705 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.705 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:03:12.705 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.130973+0000", 2024-04-19T03:03:12.705 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.664e-05 2024-04-19T03:03:12.705 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.705 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.705 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:03:12.705 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.132340+0000", 2024-04-19T03:03:12.705 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001366321 2024-04-19T03:03:12.705 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.706 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.706 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:12.706 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.198637+0000", 2024-04-19T03:03:12.706 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.066296888999999998 2024-04-19T03:03:12.706 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.706 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.706 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:03:12.706 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.198704+0000", 2024-04-19T03:03:12.706 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7333000000000001e-05 2024-04-19T03:03:12.706 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.707 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.707 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:12.707 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.198754+0000", 2024-04-19T03:03:12.707 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0421999999999999e-05 2024-04-19T03:03:12.707 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:12.707 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:12.707 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:12.707 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.707 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.707 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:158387 5.9 5:9e96f619:::benchmark_data_smithi096_19531_object44937:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-19T03:03:12.707 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:58.132457+0000", 2024-04-19T03:03:12.707 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 14.453136008, 2024-04-19T03:03:12.708 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.066858091999999994, 2024-04-19T03:03:12.708 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:12.708 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:12.708 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:12.708 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:12.708 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:12.708 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 158387 2024-04-19T03:03:12.708 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.708 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:12.708 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.708 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:12.708 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.132457+0000", 2024-04-19T03:03:12.708 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:12.709 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.709 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.709 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:12.709 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.132457+0000", 2024-04-19T03:03:12.709 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:12.709 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.709 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.709 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:12.709 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.132457+0000", 2024-04-19T03:03:12.709 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:12.709 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.709 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.709 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:12.710 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.132460+0000", 2024-04-19T03:03:12.710 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.1949999999999999e-06 2024-04-19T03:03:12.710 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.710 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.710 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:12.710 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.132468+0000", 2024-04-19T03:03:12.710 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.1599999999999998e-06 2024-04-19T03:03:12.710 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.710 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.710 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:12.710 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.132473+0000", 2024-04-19T03:03:12.711 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9259999999999999e-06 2024-04-19T03:03:12.711 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.711 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.711 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:12.711 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.132504+0000", 2024-04-19T03:03:12.711 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0914000000000003e-05 2024-04-19T03:03:12.711 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.711 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.711 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:12.711 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.132646+0000", 2024-04-19T03:03:12.711 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00014214300000000001 2024-04-19T03:03:12.711 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.712 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.712 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:03:12.712 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.132741+0000", 2024-04-19T03:03:12.712 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.4344000000000003e-05 2024-04-19T03:03:12.712 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.712 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.712 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:03:12.712 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.135774+0000", 2024-04-19T03:03:12.712 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0030334960000000001 2024-04-19T03:03:12.712 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.712 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.712 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:12.713 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.199240+0000", 2024-04-19T03:03:12.713 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.063465695000000003 2024-04-19T03:03:12.713 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.713 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.713 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:03:12.713 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.199272+0000", 2024-04-19T03:03:12.713 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2412000000000001e-05 2024-04-19T03:03:12.713 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.713 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.714 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:12.714 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.199316+0000", 2024-04-19T03:03:12.714 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3275000000000002e-05 2024-04-19T03:03:12.714 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:12.714 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:12.714 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:12.714 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.714 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.714 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:158392 5.f 5:f462725f:::benchmark_data_smithi096_19531_object44942:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-19T03:03:12.714 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:58.135703+0000", 2024-04-19T03:03:12.714 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 14.449890227999999, 2024-04-19T03:03:12.714 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.063132879000000003, 2024-04-19T03:03:12.715 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:12.715 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:12.715 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:12.715 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:12.715 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:12.715 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 158392 2024-04-19T03:03:12.715 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.715 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:12.715 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.715 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:12.715 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.135703+0000", 2024-04-19T03:03:12.715 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:12.715 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.716 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.716 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:12.716 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.135703+0000", 2024-04-19T03:03:12.716 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:12.716 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.716 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.716 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:12.716 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.135702+0000", 2024-04-19T03:03:12.716 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:03:12.716 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.716 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.716 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:12.716 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.135708+0000", 2024-04-19T03:03:12.717 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8270000000000003e-06 2024-04-19T03:03:12.717 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.717 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.717 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:12.717 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.135720+0000", 2024-04-19T03:03:12.717 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2057e-05 2024-04-19T03:03:12.717 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.717 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.717 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:12.717 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.135727+0000", 2024-04-19T03:03:12.717 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8090000000000004e-06 2024-04-19T03:03:12.717 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.717 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.717 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:12.718 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.135768+0000", 2024-04-19T03:03:12.718 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1548999999999998e-05 2024-04-19T03:03:12.718 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.718 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.718 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:12.718 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.135853+0000", 2024-04-19T03:03:12.718 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4845000000000005e-05 2024-04-19T03:03:12.718 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.718 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.718 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:03:12.718 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.135934+0000", 2024-04-19T03:03:12.718 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0315000000000006e-05 2024-04-19T03:03:12.719 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.719 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.719 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:03:12.719 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.138685+0000", 2024-04-19T03:03:12.719 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.002751042 2024-04-19T03:03:12.719 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.719 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.719 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:12.719 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.198747+0000", 2024-04-19T03:03:12.719 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.060062675000000003 2024-04-19T03:03:12.719 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.719 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.719 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:03:12.719 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.198802+0000", 2024-04-19T03:03:12.720 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4469000000000003e-05 2024-04-19T03:03:12.720 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.720 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.720 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:12.720 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.198836+0000", 2024-04-19T03:03:12.720 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4272e-05 2024-04-19T03:03:12.720 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:12.720 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:12.720 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:12.720 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.720 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.720 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:158397 5.d 5:b5d962e9:::benchmark_data_smithi096_19531_object44947:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-19T03:03:12.720 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:58.138717+0000", 2024-04-19T03:03:12.720 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 14.446876285, 2024-04-19T03:03:12.720 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.057191467000000003, 2024-04-19T03:03:12.721 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:12.721 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:12.721 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:12.721 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:12.721 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:12.721 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 158397 2024-04-19T03:03:12.721 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.721 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:12.721 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.721 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:12.721 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.138717+0000", 2024-04-19T03:03:12.721 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:12.721 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.721 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.722 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:12.722 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.138717+0000", 2024-04-19T03:03:12.722 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:12.722 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.722 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.722 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:12.722 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.138716+0000", 2024-04-19T03:03:12.722 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999986 2024-04-19T03:03:12.722 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.722 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.722 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:12.722 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.138722+0000", 2024-04-19T03:03:12.722 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1709999999999999e-06 2024-04-19T03:03:12.722 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.722 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.723 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:12.723 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.138731+0000", 2024-04-19T03:03:12.723 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.0310000000000004e-06 2024-04-19T03:03:12.723 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.723 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.723 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:12.723 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.138738+0000", 2024-04-19T03:03:12.723 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8430000000000004e-06 2024-04-19T03:03:12.723 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.723 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.723 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:12.723 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.138789+0000", 2024-04-19T03:03:12.723 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0623e-05 2024-04-19T03:03:12.723 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.723 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.724 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:12.724 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.138945+0000", 2024-04-19T03:03:12.724 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00015671899999999999 2024-04-19T03:03:12.724 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.724 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.724 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:03:12.724 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.139079+0000", 2024-04-19T03:03:12.724 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00013380099999999999 2024-04-19T03:03:12.724 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.724 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.724 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:03:12.724 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.141715+0000", 2024-04-19T03:03:12.724 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0026362849999999999 2024-04-19T03:03:12.724 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.724 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.725 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:12.725 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.195784+0000", 2024-04-19T03:03:12.725 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.054068353 2024-04-19T03:03:12.725 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.725 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.725 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:03:12.725 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.195852+0000", 2024-04-19T03:03:12.725 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8121999999999996e-05 2024-04-19T03:03:12.725 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:12.725 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:12.725 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:12.725 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.195909+0000", 2024-04-19T03:03:12.725 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6737999999999998e-05 2024-04-19T03:03:12.725 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:12.726 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:12.726 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:12.726 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:12.726 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:12.726 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-04-19T03:03:12.726 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-19T03:03:12.728 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:03:12.722+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:03:12.729 INFO:teuthology.orchestra.run.smithi096.stderr:noscrub is set 2024-04-19T03:03:12.729 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T03:03:12.828 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:03:12.824+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:03:12.857 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-19T03:03:12.857 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-04-19T03:03:12.857 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.857 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:194238 5.b 5:da08ac45:::benchmark_data_smithi096_19531_object80788:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-04-19T03:03:12.857 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:03:12.853998+0000", 2024-04-19T03:03:12.858 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.003342303, 2024-04-19T03:03:12.858 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.003367456, 2024-04-19T03:03:12.858 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:12.858 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-19T03:03:12.858 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:12.858 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:12.858 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:12.858 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 194238 2024-04-19T03:03:12.858 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.858 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:12.858 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.858 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:12.858 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:12.853998+0000", 2024-04-19T03:03:12.859 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:12.859 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.859 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.859 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:12.859 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:12.853998+0000", 2024-04-19T03:03:12.859 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:12.859 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.859 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.859 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:12.859 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:12.853997+0000", 2024-04-19T03:03:12.859 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:03:12.859 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.859 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.860 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:12.860 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:12.854003+0000", 2024-04-19T03:03:12.860 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.105e-06 2024-04-19T03:03:12.860 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.860 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.860 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:12.860 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:12.854017+0000", 2024-04-19T03:03:12.860 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3573e-05 2024-04-19T03:03:12.860 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.860 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.860 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:12.860 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:12.854037+0000", 2024-04-19T03:03:12.860 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0324000000000001e-05 2024-04-19T03:03:12.861 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.861 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.861 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:12.861 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:12.854059+0000", 2024-04-19T03:03:12.861 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2368999999999999e-05 2024-04-19T03:03:12.861 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.861 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.861 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:12.861 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:12.854137+0000", 2024-04-19T03:03:12.861 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.8015000000000004e-05 2024-04-19T03:03:12.861 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:12.861 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:12.861 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:12.861 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.862 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.862 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:194242 5.0 5:0690e0b3:::benchmark_data_smithi096_19531_object80792:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-04-19T03:03:12.862 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:03:12.855584+0000", 2024-04-19T03:03:12.862 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0017562630000000001, 2024-04-19T03:03:12.862 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0018530739999999999, 2024-04-19T03:03:12.862 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:12.862 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-19T03:03:12.862 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:12.862 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:12.862 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:12.862 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 194242 2024-04-19T03:03:12.862 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.862 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:12.863 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.863 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:12.863 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:12.855584+0000", 2024-04-19T03:03:12.863 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:12.863 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.863 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.863 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:12.863 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:12.855584+0000", 2024-04-19T03:03:12.863 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:12.863 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.863 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.863 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:12.864 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:12.855583+0000", 2024-04-19T03:03:12.864 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:03:12.864 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.864 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.864 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:12.864 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:12.855588+0000", 2024-04-19T03:03:12.864 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1139999999999999e-06 2024-04-19T03:03:12.864 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.864 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.864 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:12.864 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:12.855598+0000", 2024-04-19T03:03:12.864 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0437e-05 2024-04-19T03:03:12.864 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.864 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.865 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:12.865 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:12.855604+0000", 2024-04-19T03:03:12.865 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0000000000000002e-06 2024-04-19T03:03:12.865 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.865 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.865 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:12.865 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:12.855641+0000", 2024-04-19T03:03:12.865 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7360999999999997e-05 2024-04-19T03:03:12.865 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.865 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.865 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:12.865 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:12.855729+0000", 2024-04-19T03:03:12.865 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.7367999999999994e-05 2024-04-19T03:03:12.865 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:12.866 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:12.866 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:12.866 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.866 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.866 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:194244 5.e 5:79887fb4:::benchmark_data_smithi096_19531_object80794:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-04-19T03:03:12.866 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:03:12.856888+0000", 2024-04-19T03:03:12.866 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.00045209599999999998, 2024-04-19T03:03:12.866 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00061580599999999999, 2024-04-19T03:03:12.866 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:12.866 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-19T03:03:12.866 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:12.866 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:12.866 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:12.867 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 194244 2024-04-19T03:03:12.867 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.867 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:12.867 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.867 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:12.867 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:12.856888+0000", 2024-04-19T03:03:12.867 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:12.867 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.867 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.867 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:12.867 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:12.856888+0000", 2024-04-19T03:03:12.867 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:12.867 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.867 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.868 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:12.868 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:12.856888+0000", 2024-04-19T03:03:12.868 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:12.868 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.868 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.868 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:12.868 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:12.856891+0000", 2024-04-19T03:03:12.868 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1839999999999999e-06 2024-04-19T03:03:12.868 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.868 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.868 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:12.868 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:12.856903+0000", 2024-04-19T03:03:12.868 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1600000000000001e-05 2024-04-19T03:03:12.869 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.869 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.869 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:12.869 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:12.856907+0000", 2024-04-19T03:03:12.869 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3089999999999997e-06 2024-04-19T03:03:12.869 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.869 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.869 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:12.869 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:12.856955+0000", 2024-04-19T03:03:12.869 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7901000000000001e-05 2024-04-19T03:03:12.869 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.869 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.869 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:12.869 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:12.857146+0000", 2024-04-19T03:03:12.870 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00019078399999999999 2024-04-19T03:03:12.870 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:12.870 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:12.870 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:12.870 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.870 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.870 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:194245 5.8 5:1fe6e984:::benchmark_data_smithi096_19531_object80795:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-04-19T03:03:12.870 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:03:12.856915+0000", 2024-04-19T03:03:12.870 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.00042589899999999998, 2024-04-19T03:03:12.870 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00065268900000000003, 2024-04-19T03:03:12.870 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:12.870 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-19T03:03:12.870 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:12.871 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:12.871 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:12.871 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 194245 2024-04-19T03:03:12.871 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.871 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:12.871 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.871 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:12.871 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:12.856915+0000", 2024-04-19T03:03:12.871 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:12.871 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.871 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.872 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:12.872 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:12.856915+0000", 2024-04-19T03:03:12.872 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:12.872 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.872 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.872 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:12.872 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:12.856914+0000", 2024-04-19T03:03:12.872 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:12.872 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.872 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.872 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:12.872 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:12.856916+0000", 2024-04-19T03:03:12.873 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8530000000000001e-06 2024-04-19T03:03:12.873 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.873 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.873 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:12.873 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:12.856922+0000", 2024-04-19T03:03:12.873 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.49e-06 2024-04-19T03:03:12.873 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.873 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.873 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:12.873 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:12.856925+0000", 2024-04-19T03:03:12.873 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.861e-06 2024-04-19T03:03:12.873 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.873 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.873 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:12.874 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:12.856952+0000", 2024-04-19T03:03:12.874 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6693999999999999e-05 2024-04-19T03:03:12.874 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.874 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.874 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:12.874 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:12.857069+0000", 2024-04-19T03:03:12.874 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000117272 2024-04-19T03:03:12.874 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:12.874 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:12.874 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:12.874 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.874 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.874 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:194249 5.8 5.6aea6898 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-04-19T03:03:12.874 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:03:12.857499+0000", 2024-04-19T03:03:12.875 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 4294967295.9998417, 2024-04-19T03:03:12.875 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000105078, 2024-04-19T03:03:12.875 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:12.875 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-04-19T03:03:12.875 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:12.875 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:12.875 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:12.875 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 194249 2024-04-19T03:03:12.875 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.875 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:12.875 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.875 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:12.875 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:12.857499+0000", 2024-04-19T03:03:12.875 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:12.876 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.876 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.876 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:12.876 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:12.857499+0000", 2024-04-19T03:03:12.876 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:12.876 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.877 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.877 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:12.877 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:12.857498+0000", 2024-04-19T03:03:12.877 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:12.877 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.878 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.878 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:12.878 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:12.857503+0000", 2024-04-19T03:03:12.878 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6410000000000001e-06 2024-04-19T03:03:12.878 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.878 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.878 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:12.878 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:12.857513+0000", 2024-04-19T03:03:12.878 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0302999999999999e-05 2024-04-19T03:03:12.878 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.878 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.878 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:12.879 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:12.857518+0000", 2024-04-19T03:03:12.879 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.237e-06 2024-04-19T03:03:12.879 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:12.879 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:12.879 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:12.879 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.879 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.879 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:194251 5.b 5.efd9311b (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-04-19T03:03:12.879 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:03:12.857572+0000", 2024-04-19T03:03:12.879 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 4294967295.9997683, 2024-04-19T03:03:12.879 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9907000000000001e-05, 2024-04-19T03:03:12.879 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:12.879 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-04-19T03:03:12.880 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:12.880 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:12.880 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:12.880 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 194251 2024-04-19T03:03:12.880 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.880 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:12.880 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.880 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:12.880 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:12.857572+0000", 2024-04-19T03:03:12.880 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:12.880 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.880 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.880 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:12.881 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:12.857572+0000", 2024-04-19T03:03:12.881 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:12.881 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.881 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.881 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:12.881 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:12.857572+0000", 2024-04-19T03:03:12.881 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:12.881 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.881 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.881 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:12.881 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:12.857575+0000", 2024-04-19T03:03:12.881 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.134e-06 2024-04-19T03:03:12.881 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.882 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.882 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:12.882 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:12.857584+0000", 2024-04-19T03:03:12.882 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.2699999999999993e-06 2024-04-19T03:03:12.882 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.882 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.882 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:12.882 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:12.857587+0000", 2024-04-19T03:03:12.882 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3459999999999998e-06 2024-04-19T03:03:12.882 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:12.882 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:12.882 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:12.882 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.882 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.883 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:194236 5.b 5:dbc3eecc:::benchmark_data_smithi096_19531_object80786:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-04-19T03:03:12.883 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:03:12.851907+0000", 2024-04-19T03:03:12.883 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0054331680000000004, 2024-04-19T03:03:12.883 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0057545110000000003, 2024-04-19T03:03:12.883 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:12.883 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-19T03:03:12.883 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:12.883 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:12.883 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:12.883 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 194236 2024-04-19T03:03:12.883 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.883 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:12.883 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.883 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:12.884 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:12.851907+0000", 2024-04-19T03:03:12.884 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:12.884 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.884 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.884 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:12.884 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:12.851907+0000", 2024-04-19T03:03:12.884 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:12.884 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.884 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.884 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:12.884 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:12.851906+0000", 2024-04-19T03:03:12.884 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:03:12.884 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.885 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.885 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:12.885 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:12.851912+0000", 2024-04-19T03:03:12.885 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0299999999999999e-06 2024-04-19T03:03:12.885 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.885 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.885 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:12.885 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:12.851923+0000", 2024-04-19T03:03:12.885 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0647e-05 2024-04-19T03:03:12.885 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.885 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.885 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:12.885 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:12.851931+0000", 2024-04-19T03:03:12.886 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.8469999999999996e-06 2024-04-19T03:03:12.886 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.886 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.886 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:12.886 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:12.851975+0000", 2024-04-19T03:03:12.886 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3980999999999998e-05 2024-04-19T03:03:12.886 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:12.886 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:12.886 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:12.886 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:12.852106+0000", 2024-04-19T03:03:12.886 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000130963 2024-04-19T03:03:12.886 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:12.886 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:12.886 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:12.887 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:12.887 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-04-19T03:03:12.887 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 7 2024-04-19T03:03:12.887 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-19T03:03:12.888 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T03:03:12.928 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1: {} 2024-04-19T03:03:12.929 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:03:12.924+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:03:12.948 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2: {} 2024-04-19T03:03:12.948 INFO:teuthology.orchestra.run.smithi096.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-04-19T03:03:12.948 INFO:teuthology.orchestra.run.smithi096.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-19T03:03:12.948 INFO:teuthology.orchestra.run.smithi096.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-19T03:03:12.952 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-19T03:03:12.952 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-19T03:03:13.010 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-19T03:03:13.010 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:03:13.022 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T03:03:13.029 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:03:13.026+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:03:13.131 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:03:13.126+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:03:13.146 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-19T03:03:13.146 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:03:13.158 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T03:03:13.232 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:03:13.228+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:03:13.283 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-04-19T03:03:13.283 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:03:13.295 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T03:03:13.333 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:03:13.330+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:03:13.422 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-04-19T03:03:13.422 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:03:13.433 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:03:13.430+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:03:13.435 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T03:03:13.535 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:03:13.532+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:03:13.561 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-04-19T03:03:13.562 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:03:13.575 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T03:03:13.635 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:03:13.630+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:03:13.704 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-19T03:03:13.704 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:03:13.717 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T03:03:13.737 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:03:13.732+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:03:13.837 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:03:13.836+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:03:13.846 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-19T03:03:13.846 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:03:13.858 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T03:03:13.938 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:03:13.934+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:03:13.987 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-19T03:03:13.987 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:03:13.999 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T03:03:14.039 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:03:14.034+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:03:14.131 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-04-19T03:03:14.131 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:03:14.139 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:03:14.136+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:03:14.144 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T03:03:14.240 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:03:14.236+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:03:14.264 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-04-19T03:03:14.264 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:03:14.278 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T03:03:14.343 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:03:14.336+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:03:14.404 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-04-19T03:03:14.404 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:03:14.417 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T03:03:14.460 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:03:14.458+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:03:14.543 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:03:14.538+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:03:14.543 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-19T03:03:14.543 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:03:14.557 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T03:03:14.644 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:03:14.640+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:03:14.683 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-19T03:03:14.683 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:03:14.695 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T03:03:14.730 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-19T03:03:14.744 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:03:14.742+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:03:14.810 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-19T03:03:14.810 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:03:14.821 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T03:03:14.844 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:03:14.842+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:03:14.945 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:03:14.942+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:03:14.946 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-04-19T03:03:14.946 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:03:14.954 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-19T03:03:14.957 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T03:03:15.046 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:03:15.044+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:03:15.084 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-04-19T03:03:15.085 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:03:15.093 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1: {} 2024-04-19T03:03:15.097 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T03:03:15.115 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2: {} 2024-04-19T03:03:15.115 INFO:teuthology.orchestra.run.smithi096.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-04-19T03:03:15.115 INFO:teuthology.orchestra.run.smithi096.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-19T03:03:15.115 INFO:teuthology.orchestra.run.smithi096.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-19T03:03:15.119 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-19T03:03:15.120 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-19T03:03:15.147 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:03:15.142+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:03:15.227 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-04-19T03:03:15.227 INFO:teuthology.orchestra.run.smithi144.stdout: "size": 20, 2024-04-19T03:03:15.227 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 600, 2024-04-19T03:03:15.227 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [ 2024-04-19T03:03:15.227 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.228 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:78992 5.7 5:e6baa862:::benchmark_data_smithi096_19531_object78991:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-19T03:03:15.228 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:18.008888+0000", 2024-04-19T03:03:15.228 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 57.215420131000002, 2024-04-19T03:03:15.228 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.056375285999999997, 2024-04-19T03:03:15.228 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:15.228 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:15.228 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:15.228 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:15.228 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:15.228 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 78992 2024-04-19T03:03:15.228 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.228 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:15.228 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.228 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:15.229 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.008888+0000", 2024-04-19T03:03:15.229 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:15.229 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.229 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.229 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:15.229 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.008888+0000", 2024-04-19T03:03:15.229 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:15.229 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.229 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.229 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:15.229 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.008888+0000", 2024-04-19T03:03:15.229 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:15.229 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.230 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.230 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:15.230 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.008928+0000", 2024-04-19T03:03:15.230 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0361999999999997e-05 2024-04-19T03:03:15.230 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.230 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.230 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:15.230 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.008942+0000", 2024-04-19T03:03:15.230 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4365000000000001e-05 2024-04-19T03:03:15.230 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.230 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.230 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:15.230 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.008949+0000", 2024-04-19T03:03:15.231 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.212e-06 2024-04-19T03:03:15.231 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.231 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.231 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:15.231 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.012683+0000", 2024-04-19T03:03:15.231 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.003733934 2024-04-19T03:03:15.231 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.231 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.231 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:15.231 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.012798+0000", 2024-04-19T03:03:15.231 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00011574999999999999 2024-04-19T03:03:15.231 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.231 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.231 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:15.232 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.012896+0000", 2024-04-19T03:03:15.232 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.7848000000000002e-05 2024-04-19T03:03:15.232 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.232 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.232 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:03:15.232 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016423+0000", 2024-04-19T03:03:15.232 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0035270789999999998 2024-04-19T03:03:15.232 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.232 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.232 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:15.232 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.065098+0000", 2024-04-19T03:03:15.232 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.048674651999999999 2024-04-19T03:03:15.232 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.232 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.233 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:03:15.233 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.065193+0000", 2024-04-19T03:03:15.233 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.5087999999999995e-05 2024-04-19T03:03:15.233 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.233 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.233 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:15.233 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.065264+0000", 2024-04-19T03:03:15.233 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0666000000000004e-05 2024-04-19T03:03:15.233 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:15.233 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:15.233 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:15.233 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.233 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.234 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4755.0:79003 5.2 e40/39 5:4436e33f:::benchmark_data_smithi096_19531_object79002:head v 40'4935, mlcod=40'4932)", 2024-04-19T03:03:15.234 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:18.018102+0000", 2024-04-19T03:03:15.234 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 57.206206074999997, 2024-04-19T03:03:15.234 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.060023990999999999, 2024-04-19T03:03:15.234 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:15.234 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:15.234 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:15.234 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.234 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:15.234 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018102+0000", 2024-04-19T03:03:15.234 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:15.234 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.234 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.235 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:15.235 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018102+0000", 2024-04-19T03:03:15.235 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:15.235 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.235 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.235 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:15.235 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018102+0000", 2024-04-19T03:03:15.235 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:15.235 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.235 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.235 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:15.235 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018134+0000", 2024-04-19T03:03:15.235 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2722000000000003e-05 2024-04-19T03:03:15.236 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.236 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.236 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:15.236 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018145+0000", 2024-04-19T03:03:15.236 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0395e-05 2024-04-19T03:03:15.236 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.236 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.236 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:15.236 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018151+0000", 2024-04-19T03:03:15.236 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5300000000000002e-06 2024-04-19T03:03:15.236 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.236 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.236 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:15.236 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018489+0000", 2024-04-19T03:03:15.237 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00033731499999999998 2024-04-19T03:03:15.237 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.237 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.237 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:15.237 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018508+0000", 2024-04-19T03:03:15.237 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9775e-05 2024-04-19T03:03:15.237 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.237 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.237 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:03:15.237 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.078059+0000", 2024-04-19T03:03:15.237 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.059550171999999998 2024-04-19T03:03:15.237 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.237 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.238 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:15.238 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.078126+0000", 2024-04-19T03:03:15.238 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7773000000000003e-05 2024-04-19T03:03:15.238 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:15.238 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:15.238 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:15.238 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.238 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.238 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:86612 5.7 5:e32e3c49:::benchmark_data_smithi096_19531_object86611:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:15.238 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:22.633560+0000", 2024-04-19T03:03:15.238 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 52.590748415, 2024-04-19T03:03:15.238 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.19135289, 2024-04-19T03:03:15.238 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:15.239 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:15.239 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:15.239 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:15.239 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:15.239 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 86612 2024-04-19T03:03:15.239 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.239 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:15.239 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.239 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:15.239 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633560+0000", 2024-04-19T03:03:15.239 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:15.239 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.239 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.239 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:15.239 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633560+0000", 2024-04-19T03:03:15.240 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:15.240 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.240 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.240 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:15.240 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633558+0000", 2024-04-19T03:03:15.240 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999986 2024-04-19T03:03:15.240 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.240 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.240 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:15.240 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633609+0000", 2024-04-19T03:03:15.240 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0850999999999998e-05 2024-04-19T03:03:15.240 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.240 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.240 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:15.240 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633627+0000", 2024-04-19T03:03:15.241 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7951000000000001e-05 2024-04-19T03:03:15.241 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.241 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.241 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:15.241 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633635+0000", 2024-04-19T03:03:15.241 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2530000000000004e-06 2024-04-19T03:03:15.241 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.241 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.241 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:15.241 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633699+0000", 2024-04-19T03:03:15.241 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3901999999999999e-05 2024-04-19T03:03:15.241 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.241 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.242 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:15.242 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633992+0000", 2024-04-19T03:03:15.242 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00029283299999999999 2024-04-19T03:03:15.242 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.242 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.242 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:15.242 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.634223+0000", 2024-04-19T03:03:15.242 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00023084200000000001 2024-04-19T03:03:15.242 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.242 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.242 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:03:15.242 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.639085+0000", 2024-04-19T03:03:15.242 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0048624269999999999 2024-04-19T03:03:15.243 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.243 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.243 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:15.243 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.824635+0000", 2024-04-19T03:03:15.243 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.18554944700000001 2024-04-19T03:03:15.243 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.243 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.243 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:03:15.243 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.824793+0000", 2024-04-19T03:03:15.243 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000157959 2024-04-19T03:03:15.243 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.243 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.243 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:15.243 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.824913+0000", 2024-04-19T03:03:15.244 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000120093 2024-04-19T03:03:15.244 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:15.244 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:15.244 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:15.244 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.244 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.244 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:86625 5.7 5:e6d00488:::benchmark_data_smithi096_19531_object86624:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:15.244 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:22.643554+0000", 2024-04-19T03:03:15.244 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 52.580754648999999, 2024-04-19T03:03:15.244 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.18732841, 2024-04-19T03:03:15.244 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:15.244 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:15.244 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:15.244 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:15.245 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:15.245 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 86625 2024-04-19T03:03:15.245 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.245 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:15.245 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.245 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:15.245 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643554+0000", 2024-04-19T03:03:15.245 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:15.245 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.245 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.245 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:15.245 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643554+0000", 2024-04-19T03:03:15.245 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:15.245 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.246 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.246 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:15.246 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643552+0000", 2024-04-19T03:03:15.246 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999986 2024-04-19T03:03:15.246 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.246 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.246 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:15.246 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643588+0000", 2024-04-19T03:03:15.246 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5855999999999997e-05 2024-04-19T03:03:15.246 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.246 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.246 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:15.246 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643606+0000", 2024-04-19T03:03:15.246 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8226000000000001e-05 2024-04-19T03:03:15.247 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.247 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.247 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:15.247 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643618+0000", 2024-04-19T03:03:15.247 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1868000000000001e-05 2024-04-19T03:03:15.247 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.247 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.247 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:15.247 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643676+0000", 2024-04-19T03:03:15.247 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8153999999999999e-05 2024-04-19T03:03:15.247 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.247 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.247 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:15.247 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643905+0000", 2024-04-19T03:03:15.248 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00022847500000000001 2024-04-19T03:03:15.248 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.248 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.248 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:15.248 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.644150+0000", 2024-04-19T03:03:15.248 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00024531800000000001 2024-04-19T03:03:15.248 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.248 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.248 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:03:15.248 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.647407+0000", 2024-04-19T03:03:15.248 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0032563190000000001 2024-04-19T03:03:15.248 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.248 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.248 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:15.249 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.830721+0000", 2024-04-19T03:03:15.249 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.18331468300000001 2024-04-19T03:03:15.249 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.249 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.249 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:03:15.249 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.830813+0000", 2024-04-19T03:03:15.249 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.2205000000000002e-05 2024-04-19T03:03:15.249 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.249 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.249 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:15.249 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.830882+0000", 2024-04-19T03:03:15.249 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8819999999999995e-05 2024-04-19T03:03:15.249 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:15.249 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:15.250 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:15.250 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.250 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.250 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87063 5.7 5:e502e824:::benchmark_data_smithi096_19531_object87062:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:15.250 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.136067+0000", 2024-04-19T03:03:15.250 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 52.088241779999997, 2024-04-19T03:03:15.250 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.065521159999999995, 2024-04-19T03:03:15.250 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:15.250 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:15.250 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:15.250 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:15.250 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:15.250 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87063 2024-04-19T03:03:15.251 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.251 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:15.251 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.251 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:15.251 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.136067+0000", 2024-04-19T03:03:15.251 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:15.251 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.251 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.251 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:15.251 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.136067+0000", 2024-04-19T03:03:15.251 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:15.251 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.251 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.251 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:15.252 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.136066+0000", 2024-04-19T03:03:15.252 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:03:15.252 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.252 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.252 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:15.252 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.136154+0000", 2024-04-19T03:03:15.252 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.8256000000000003e-05 2024-04-19T03:03:15.252 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.252 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.252 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:15.252 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.136162+0000", 2024-04-19T03:03:15.252 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.5099999999999998e-06 2024-04-19T03:03:15.252 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.252 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.252 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:15.253 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.136171+0000", 2024-04-19T03:03:15.253 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2830000000000001e-06 2024-04-19T03:03:15.253 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.253 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.253 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:15.253 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.138421+0000", 2024-04-19T03:03:15.253 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0022506620000000001 2024-04-19T03:03:15.253 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.253 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.253 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:15.253 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.138560+0000", 2024-04-19T03:03:15.253 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000138446 2024-04-19T03:03:15.253 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.253 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.254 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:15.254 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.138689+0000", 2024-04-19T03:03:15.254 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00012950700000000001 2024-04-19T03:03:15.254 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.254 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.254 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:03:15.254 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.141517+0000", 2024-04-19T03:03:15.254 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0028280860000000001 2024-04-19T03:03:15.254 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.254 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.254 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:15.254 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.201350+0000", 2024-04-19T03:03:15.254 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.059832418999999998 2024-04-19T03:03:15.254 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.255 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.255 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:03:15.255 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.201485+0000", 2024-04-19T03:03:15.255 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000135597 2024-04-19T03:03:15.255 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.255 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.255 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:15.255 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.201588+0000", 2024-04-19T03:03:15.255 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00010247900000000001 2024-04-19T03:03:15.255 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:15.255 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:15.256 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:15.256 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.256 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.256 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87072 5.7 5:e3c7809a:::benchmark_data_smithi096_19531_object87071:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:15.256 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.144224+0000", 2024-04-19T03:03:15.256 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 52.080084755999998, 2024-04-19T03:03:15.256 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.058179555000000001, 2024-04-19T03:03:15.256 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:15.256 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:15.256 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:15.256 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:15.256 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:15.256 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87072 2024-04-19T03:03:15.256 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.257 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:15.257 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.257 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:15.257 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144224+0000", 2024-04-19T03:03:15.257 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:15.257 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.257 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.257 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:15.257 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144224+0000", 2024-04-19T03:03:15.257 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:15.257 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.257 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.257 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:15.257 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144223+0000", 2024-04-19T03:03:15.258 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:03:15.258 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.258 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.258 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:15.258 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144320+0000", 2024-04-19T03:03:15.258 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.7075000000000001e-05 2024-04-19T03:03:15.258 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.258 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.258 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:15.258 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144331+0000", 2024-04-19T03:03:15.258 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1342000000000001e-05 2024-04-19T03:03:15.258 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.258 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.259 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:15.259 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144337+0000", 2024-04-19T03:03:15.259 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8390000000000003e-06 2024-04-19T03:03:15.259 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.259 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.259 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:15.259 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144369+0000", 2024-04-19T03:03:15.259 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2079000000000002e-05 2024-04-19T03:03:15.259 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.259 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.259 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:15.259 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144464+0000", 2024-04-19T03:03:15.259 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.4623000000000005e-05 2024-04-19T03:03:15.259 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.260 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.260 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:15.260 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144553+0000", 2024-04-19T03:03:15.260 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9171000000000004e-05 2024-04-19T03:03:15.260 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.260 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.260 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:03:15.260 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.147018+0000", 2024-04-19T03:03:15.260 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0024648370000000001 2024-04-19T03:03:15.260 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.260 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.260 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:15.260 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.202270+0000", 2024-04-19T03:03:15.260 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.055252018 2024-04-19T03:03:15.261 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.261 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.261 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:03:15.261 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.202356+0000", 2024-04-19T03:03:15.261 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6648000000000001e-05 2024-04-19T03:03:15.261 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.261 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.261 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:15.261 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.202403+0000", 2024-04-19T03:03:15.261 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6956999999999998e-05 2024-04-19T03:03:15.261 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:15.261 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:15.261 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:15.262 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.262 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.262 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87123 5.6 5:6d1bc3b9:::benchmark_data_smithi096_19531_object87122:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:03:15.262 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249233+0000", 2024-04-19T03:03:15.262 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 51.975075724, 2024-04-19T03:03:15.262 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0291700720000001, 2024-04-19T03:03:15.262 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:15.262 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-04-19T03:03:15.262 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:15.262 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:15.262 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:15.262 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87123 2024-04-19T03:03:15.262 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.263 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:15.263 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.263 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:15.263 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249233+0000", 2024-04-19T03:03:15.263 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:15.263 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.263 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.263 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:15.263 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249233+0000", 2024-04-19T03:03:15.263 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:15.263 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.263 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.263 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:15.263 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249231+0000", 2024-04-19T03:03:15.263 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999986 2024-04-19T03:03:15.264 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.264 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.264 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:15.264 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249285+0000", 2024-04-19T03:03:15.264 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4005000000000002e-05 2024-04-19T03:03:15.264 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.264 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.264 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:15.264 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249300+0000", 2024-04-19T03:03:15.264 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4715999999999999e-05 2024-04-19T03:03:15.264 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.264 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.264 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:15.264 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249307+0000", 2024-04-19T03:03:15.265 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8399999999999997e-06 2024-04-19T03:03:15.265 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.265 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.265 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:15.265 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249366+0000", 2024-04-19T03:03:15.265 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9435999999999998e-05 2024-04-19T03:03:15.265 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.265 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.265 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op must wait for map", 2024-04-19T03:03:15.265 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249376+0000", 2024-04-19T03:03:15.265 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.4919999999999999e-06 2024-04-19T03:03:15.265 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.265 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.265 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:15.265 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263757+0000", 2024-04-19T03:03:15.266 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.014381461999999999 2024-04-19T03:03:15.266 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.266 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.266 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:03:15.266 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263875+0000", 2024-04-19T03:03:15.266 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000117166 2024-04-19T03:03:15.266 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.266 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.266 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:15.269 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.277136+0000", 2024-04-19T03:03:15.269 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.013261207 2024-04-19T03:03:15.269 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.269 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.269 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:15.269 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.278403+0000", 2024-04-19T03:03:15.270 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001267106 2024-04-19T03:03:15.270 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:15.270 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:15.270 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:15.270 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.270 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.270 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87128 5.6 5:6905c420:::benchmark_data_smithi096_19531_object87127:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:03:15.270 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249323+0000", 2024-04-19T03:03:15.270 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 51.974984976999998, 2024-04-19T03:03:15.270 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0292813249999999, 2024-04-19T03:03:15.270 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:15.270 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-04-19T03:03:15.270 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:15.270 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:15.271 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:15.271 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87128 2024-04-19T03:03:15.271 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.271 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:15.271 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.271 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:15.271 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249323+0000", 2024-04-19T03:03:15.271 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:15.271 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.271 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.271 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:15.271 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249323+0000", 2024-04-19T03:03:15.271 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:15.272 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.272 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.272 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:15.272 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249323+0000", 2024-04-19T03:03:15.272 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:15.272 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.272 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.272 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:15.272 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249385+0000", 2024-04-19T03:03:15.272 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1711999999999995e-05 2024-04-19T03:03:15.272 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.272 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.272 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:15.272 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249398+0000", 2024-04-19T03:03:15.273 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3022e-05 2024-04-19T03:03:15.273 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.273 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.273 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:15.273 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249402+0000", 2024-04-19T03:03:15.273 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4819999999999996e-06 2024-04-19T03:03:15.273 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.273 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.273 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:15.273 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249437+0000", 2024-04-19T03:03:15.273 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4702000000000001e-05 2024-04-19T03:03:15.273 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.273 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.273 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:03:15.273 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249442+0000", 2024-04-19T03:03:15.274 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8019999999999999e-06 2024-04-19T03:03:15.274 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.274 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.274 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:15.274 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263896+0000", 2024-04-19T03:03:15.274 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.014454679999999999 2024-04-19T03:03:15.274 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.274 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.274 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:03:15.274 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263900+0000", 2024-04-19T03:03:15.274 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9700000000000001e-06 2024-04-19T03:03:15.274 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.274 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.275 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:15.275 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.278557+0000", 2024-04-19T03:03:15.275 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0146566480000001 2024-04-19T03:03:15.275 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.275 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.275 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:15.275 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.278605+0000", 2024-04-19T03:03:15.275 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7735999999999998e-05 2024-04-19T03:03:15.275 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:15.275 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:15.275 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:15.275 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.275 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.275 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87130 5.3 5:c8c2d67b:::benchmark_data_smithi096_19531_object87129:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:03:15.275 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249418+0000", 2024-04-19T03:03:15.276 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 51.974890266000003, 2024-04-19T03:03:15.276 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.025414182, 2024-04-19T03:03:15.276 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:15.276 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-04-19T03:03:15.276 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:15.276 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:15.276 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:15.276 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87130 2024-04-19T03:03:15.276 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.276 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:15.276 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.276 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:15.276 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249418+0000", 2024-04-19T03:03:15.276 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:15.277 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.277 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.277 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:15.277 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249418+0000", 2024-04-19T03:03:15.277 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:15.277 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.277 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.277 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:15.277 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249409+0000", 2024-04-19T03:03:15.277 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999905 2024-04-19T03:03:15.277 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.277 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.277 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:15.277 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249464+0000", 2024-04-19T03:03:15.278 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5381999999999999e-05 2024-04-19T03:03:15.278 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.278 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.278 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:15.278 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249471+0000", 2024-04-19T03:03:15.278 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2609999999999996e-06 2024-04-19T03:03:15.278 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.278 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.278 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:15.278 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249475+0000", 2024-04-19T03:03:15.278 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2839999999999998e-06 2024-04-19T03:03:15.278 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.278 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.278 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:15.279 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249535+0000", 2024-04-19T03:03:15.279 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0545999999999999e-05 2024-04-19T03:03:15.279 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.279 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.279 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op must wait for map", 2024-04-19T03:03:15.279 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249540+0000", 2024-04-19T03:03:15.279 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2859999999999999e-06 2024-04-19T03:03:15.279 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.279 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.279 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:15.279 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263450+0000", 2024-04-19T03:03:15.279 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.013909585 2024-04-19T03:03:15.279 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.280 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.280 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:03:15.280 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263458+0000", 2024-04-19T03:03:15.280 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8089999999999993e-06 2024-04-19T03:03:15.280 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.280 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.280 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:15.280 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.273193+0000", 2024-04-19T03:03:15.280 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0097351379999999 2024-04-19T03:03:15.280 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.280 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.280 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:15.280 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.274832+0000", 2024-04-19T03:03:15.280 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0016394789999999999 2024-04-19T03:03:15.280 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:15.281 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:15.281 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:15.281 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.281 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.281 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87131 5.1 5:83756d55:::benchmark_data_smithi096_19531_object87130:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:03:15.281 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249491+0000", 2024-04-19T03:03:15.281 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 51.974817619, 2024-04-19T03:03:15.281 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0191489520000001, 2024-04-19T03:03:15.281 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:15.281 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-04-19T03:03:15.281 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:15.281 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:15.281 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:15.281 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87131 2024-04-19T03:03:15.282 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.282 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:15.282 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.282 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:15.282 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249491+0000", 2024-04-19T03:03:15.282 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:15.282 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.282 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.282 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:15.282 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249491+0000", 2024-04-19T03:03:15.282 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:15.282 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.282 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.282 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:15.283 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249491+0000", 2024-04-19T03:03:15.283 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:15.283 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.283 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.283 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:15.283 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249530+0000", 2024-04-19T03:03:15.283 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9589000000000003e-05 2024-04-19T03:03:15.283 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.283 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.283 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:15.283 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249544+0000", 2024-04-19T03:03:15.283 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4158000000000001e-05 2024-04-19T03:03:15.283 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.283 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.283 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:15.284 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249549+0000", 2024-04-19T03:03:15.284 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6809999999999997e-06 2024-04-19T03:03:15.284 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.284 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.284 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:15.284 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249592+0000", 2024-04-19T03:03:15.284 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3285999999999999e-05 2024-04-19T03:03:15.284 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.284 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.284 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op must wait for map", 2024-04-19T03:03:15.284 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249598+0000", 2024-04-19T03:03:15.284 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8329999999999999e-06 2024-04-19T03:03:15.284 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.284 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.285 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:15.285 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263331+0000", 2024-04-19T03:03:15.285 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.013733093 2024-04-19T03:03:15.285 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.285 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.285 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:03:15.285 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263343+0000", 2024-04-19T03:03:15.285 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.189e-05 2024-04-19T03:03:15.285 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.285 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.285 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:15.285 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.268541+0000", 2024-04-19T03:03:15.285 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0051983440000001 2024-04-19T03:03:15.285 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.286 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.286 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:15.286 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.268640+0000", 2024-04-19T03:03:15.286 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.8387999999999994e-05 2024-04-19T03:03:15.286 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:15.286 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:15.286 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:15.286 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.286 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.286 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87132 5.c 5:3e18b732:::benchmark_data_smithi096_19531_object87131:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:03:15.286 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249558+0000", 2024-04-19T03:03:15.286 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 51.974750718000003, 2024-04-19T03:03:15.286 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0241198380000001, 2024-04-19T03:03:15.286 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:15.287 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-04-19T03:03:15.287 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:15.287 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:15.287 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:15.287 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87132 2024-04-19T03:03:15.287 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.287 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:15.287 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.287 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:15.287 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249558+0000", 2024-04-19T03:03:15.287 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:15.287 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.287 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.287 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:15.288 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249558+0000", 2024-04-19T03:03:15.288 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:15.288 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.288 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.288 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:15.288 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249557+0000", 2024-04-19T03:03:15.288 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:15.288 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.288 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.288 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:15.288 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249625+0000", 2024-04-19T03:03:15.288 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7200999999999996e-05 2024-04-19T03:03:15.288 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.288 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.289 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:15.289 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249646+0000", 2024-04-19T03:03:15.289 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1053e-05 2024-04-19T03:03:15.289 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.289 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.289 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:15.289 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249650+0000", 2024-04-19T03:03:15.289 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2719999999999999e-06 2024-04-19T03:03:15.289 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.289 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.289 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:15.289 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249686+0000", 2024-04-19T03:03:15.289 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6430000000000002e-05 2024-04-19T03:03:15.289 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.289 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.290 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op must wait for map", 2024-04-19T03:03:15.290 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249690+0000", 2024-04-19T03:03:15.290 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.765e-06 2024-04-19T03:03:15.290 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.290 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.290 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:15.290 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261157+0000", 2024-04-19T03:03:15.290 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011467247999999999 2024-04-19T03:03:15.290 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.290 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.290 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:03:15.290 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261170+0000", 2024-04-19T03:03:15.290 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2833000000000001e-05 2024-04-19T03:03:15.290 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.291 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.291 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:15.291 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.272119+0000", 2024-04-19T03:03:15.291 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.010949313 2024-04-19T03:03:15.291 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.291 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.291 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:15.291 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.273678+0000", 2024-04-19T03:03:15.291 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0015581550000000001 2024-04-19T03:03:15.291 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:15.291 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:15.291 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:15.291 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.291 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.292 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87133 5.c 5:3f772a62:::benchmark_data_smithi096_19531_object87132:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:03:15.292 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249657+0000", 2024-04-19T03:03:15.292 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 51.974651338999998, 2024-04-19T03:03:15.292 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0242819409999999, 2024-04-19T03:03:15.292 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:15.292 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-04-19T03:03:15.292 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:15.292 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:15.292 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:15.292 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87133 2024-04-19T03:03:15.292 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.292 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:15.292 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.292 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:15.293 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249657+0000", 2024-04-19T03:03:15.293 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:15.293 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.293 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.293 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:15.293 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249657+0000", 2024-04-19T03:03:15.293 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:15.293 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.293 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.293 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:15.293 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249657+0000", 2024-04-19T03:03:15.293 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:15.293 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.293 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.293 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:15.294 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249690+0000", 2024-04-19T03:03:15.294 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3343000000000002e-05 2024-04-19T03:03:15.294 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.294 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.294 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:15.294 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249695+0000", 2024-04-19T03:03:15.294 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8600000000000001e-06 2024-04-19T03:03:15.294 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.294 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.294 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:15.294 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249698+0000", 2024-04-19T03:03:15.294 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.1700000000000001e-06 2024-04-19T03:03:15.294 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.295 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.295 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:15.295 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249741+0000", 2024-04-19T03:03:15.295 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2849999999999998e-05 2024-04-19T03:03:15.295 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.295 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.295 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:03:15.295 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249746+0000", 2024-04-19T03:03:15.295 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1019999999999996e-06 2024-04-19T03:03:15.295 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.295 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.295 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:15.295 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261209+0000", 2024-04-19T03:03:15.295 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011462447000000001 2024-04-19T03:03:15.295 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.296 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.296 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:03:15.296 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261216+0000", 2024-04-19T03:03:15.296 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8520000000000004e-06 2024-04-19T03:03:15.296 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.296 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.296 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:15.296 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.273872+0000", 2024-04-19T03:03:15.296 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0126558000000001 2024-04-19T03:03:15.296 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.296 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.296 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:15.296 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.273939+0000", 2024-04-19T03:03:15.296 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6822000000000005e-05 2024-04-19T03:03:15.296 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:15.297 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:15.297 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:15.297 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.297 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.297 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87134 5.5 5:a56c478f:::benchmark_data_smithi096_19531_object87133:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:03:15.297 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249708+0000", 2024-04-19T03:03:15.297 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 51.974600414999998, 2024-04-19T03:03:15.297 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0214677299999999, 2024-04-19T03:03:15.297 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:15.297 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-04-19T03:03:15.297 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:15.297 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:15.297 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:15.297 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87134 2024-04-19T03:03:15.298 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.298 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:15.298 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.298 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:15.298 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249708+0000", 2024-04-19T03:03:15.298 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:15.298 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.298 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.298 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:15.298 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249708+0000", 2024-04-19T03:03:15.298 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:15.298 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.298 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.298 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:15.299 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249706+0000", 2024-04-19T03:03:15.299 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999976 2024-04-19T03:03:15.299 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.299 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.299 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:15.299 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249740+0000", 2024-04-19T03:03:15.299 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4458000000000001e-05 2024-04-19T03:03:15.299 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.299 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.299 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:15.299 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249745+0000", 2024-04-19T03:03:15.299 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5020000000000003e-06 2024-04-19T03:03:15.299 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.299 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.300 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:15.300 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249748+0000", 2024-04-19T03:03:15.300 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2499999999999998e-06 2024-04-19T03:03:15.300 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.300 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.300 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:15.300 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249778+0000", 2024-04-19T03:03:15.300 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.006e-05 2024-04-19T03:03:15.300 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.300 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.300 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op must wait for map", 2024-04-19T03:03:15.300 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249782+0000", 2024-04-19T03:03:15.300 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2910000000000001e-06 2024-04-19T03:03:15.300 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.301 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.301 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:15.301 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261666+0000", 2024-04-19T03:03:15.301 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011883471 2024-04-19T03:03:15.301 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.301 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.301 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:03:15.301 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261674+0000", 2024-04-19T03:03:15.301 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6479999999999992e-06 2024-04-19T03:03:15.301 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.301 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.301 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:15.301 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.269323+0000", 2024-04-19T03:03:15.301 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.00764867 2024-04-19T03:03:15.302 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.302 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.302 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:15.302 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.271176+0000", 2024-04-19T03:03:15.302 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001852844 2024-04-19T03:03:15.302 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:15.302 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:15.302 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:15.302 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.302 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.302 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87137 5.c 5:30708c68:::benchmark_data_smithi096_19531_object87136:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:03:15.302 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249756+0000", 2024-04-19T03:03:15.302 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 51.974552709000001, 2024-04-19T03:03:15.302 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.033331752, 2024-04-19T03:03:15.303 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:15.303 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:15.303 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:15.303 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:15.303 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:15.303 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87137 2024-04-19T03:03:15.303 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.303 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:15.303 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.303 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:15.303 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249756+0000", 2024-04-19T03:03:15.303 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:15.303 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.303 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.304 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:15.304 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249756+0000", 2024-04-19T03:03:15.304 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:15.304 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.304 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.304 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:15.304 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249755+0000", 2024-04-19T03:03:15.304 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:15.304 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.304 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.304 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:15.304 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249777+0000", 2024-04-19T03:03:15.304 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1420000000000002e-05 2024-04-19T03:03:15.304 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.305 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.305 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:15.305 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249781+0000", 2024-04-19T03:03:15.305 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0609999999999997e-06 2024-04-19T03:03:15.305 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.305 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.305 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:15.305 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249787+0000", 2024-04-19T03:03:15.305 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.02e-06 2024-04-19T03:03:15.305 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.305 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.305 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:15.305 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249818+0000", 2024-04-19T03:03:15.305 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0947e-05 2024-04-19T03:03:15.305 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.306 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.306 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:03:15.306 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249821+0000", 2024-04-19T03:03:15.306 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.117e-06 2024-04-19T03:03:15.306 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.306 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.306 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:15.306 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261243+0000", 2024-04-19T03:03:15.306 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011421875999999999 2024-04-19T03:03:15.306 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.306 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.306 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:03:15.306 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261251+0000", 2024-04-19T03:03:15.306 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6120000000000001e-06 2024-04-19T03:03:15.307 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.307 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.307 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:15.307 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.274050+0000", 2024-04-19T03:03:15.307 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.012799405 2024-04-19T03:03:15.307 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.307 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.307 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:15.307 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.274529+0000", 2024-04-19T03:03:15.307 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00047867100000000001 2024-04-19T03:03:15.307 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.307 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.307 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:03:15.307 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.282972+0000", 2024-04-19T03:03:15.308 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0084436900000000002 2024-04-19T03:03:15.308 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.308 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.308 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:03:15.308 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.283022+0000", 2024-04-19T03:03:15.308 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9339000000000003e-05 2024-04-19T03:03:15.308 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.308 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.308 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:15.308 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.283088+0000", 2024-04-19T03:03:15.308 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5877999999999995e-05 2024-04-19T03:03:15.308 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:15.308 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:15.308 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:15.309 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.309 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.309 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:158376 5.9 5:9e73c076:::benchmark_data_smithi096_19531_object44926:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-19T03:03:15.309 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:58.126227+0000", 2024-04-19T03:03:15.309 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 17.098080975999999, 2024-04-19T03:03:15.309 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.069738668000000004, 2024-04-19T03:03:15.309 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:15.309 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:15.309 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:15.309 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:15.309 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:15.309 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 158376 2024-04-19T03:03:15.309 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.309 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:15.309 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.310 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:15.310 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.126227+0000", 2024-04-19T03:03:15.310 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:15.310 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.310 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.310 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:15.310 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.126227+0000", 2024-04-19T03:03:15.310 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:15.310 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.310 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.310 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:15.310 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.126226+0000", 2024-04-19T03:03:15.310 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:03:15.310 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.311 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.311 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:15.311 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.126236+0000", 2024-04-19T03:03:15.311 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.4199999999999996e-06 2024-04-19T03:03:15.311 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.311 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.311 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:15.311 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.126243+0000", 2024-04-19T03:03:15.311 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.199e-06 2024-04-19T03:03:15.311 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.311 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.311 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:15.311 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.126248+0000", 2024-04-19T03:03:15.312 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1320000000000002e-06 2024-04-19T03:03:15.312 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.312 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.312 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:15.312 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.126286+0000", 2024-04-19T03:03:15.312 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7401000000000003e-05 2024-04-19T03:03:15.312 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.312 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.312 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:15.312 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.126368+0000", 2024-04-19T03:03:15.312 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2113999999999993e-05 2024-04-19T03:03:15.312 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.312 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.312 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:03:15.313 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.126438+0000", 2024-04-19T03:03:15.313 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0337000000000001e-05 2024-04-19T03:03:15.313 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.313 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.313 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:03:15.313 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.130816+0000", 2024-04-19T03:03:15.313 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0043778330000000002 2024-04-19T03:03:15.313 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.313 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.313 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:15.313 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.195830+0000", 2024-04-19T03:03:15.313 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.065013933999999995 2024-04-19T03:03:15.313 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.313 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.314 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:03:15.314 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.195907+0000", 2024-04-19T03:03:15.314 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7397000000000005e-05 2024-04-19T03:03:15.314 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.314 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.314 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:15.314 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.195966+0000", 2024-04-19T03:03:15.314 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8906999999999997e-05 2024-04-19T03:03:15.314 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:15.314 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:15.314 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:15.314 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.314 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.315 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:158381 5.9 5:94dcd4a7:::benchmark_data_smithi096_19531_object44931:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-19T03:03:15.315 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:58.128712+0000", 2024-04-19T03:03:15.315 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 17.095596532999998, 2024-04-19T03:03:15.315 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.067497527000000002, 2024-04-19T03:03:15.315 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:15.315 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:15.315 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:15.315 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:15.315 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:15.315 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 158381 2024-04-19T03:03:15.315 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.315 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:15.315 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.315 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:15.316 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.128712+0000", 2024-04-19T03:03:15.316 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:15.316 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.316 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.316 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:15.316 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.128712+0000", 2024-04-19T03:03:15.316 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:15.316 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.316 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.316 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:15.316 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.128711+0000", 2024-04-19T03:03:15.316 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:03:15.316 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.316 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.316 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:15.317 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.128716+0000", 2024-04-19T03:03:15.317 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0610000000000003e-06 2024-04-19T03:03:15.317 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.317 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.317 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:15.317 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.128724+0000", 2024-04-19T03:03:15.317 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0120000000000005e-06 2024-04-19T03:03:15.317 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.317 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.317 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:15.317 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.128729+0000", 2024-04-19T03:03:15.317 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8899999999999998e-06 2024-04-19T03:03:15.317 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.317 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.318 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:15.318 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.128778+0000", 2024-04-19T03:03:15.318 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9110000000000002e-05 2024-04-19T03:03:15.318 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.318 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.318 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:15.318 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.128903+0000", 2024-04-19T03:03:15.318 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00012506799999999999 2024-04-19T03:03:15.318 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.318 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.318 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:03:15.318 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.129022+0000", 2024-04-19T03:03:15.318 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00011923599999999999 2024-04-19T03:03:15.318 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.319 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.319 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:03:15.319 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.132294+0000", 2024-04-19T03:03:15.319 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.003271244 2024-04-19T03:03:15.319 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.319 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.319 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:15.319 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.196045+0000", 2024-04-19T03:03:15.319 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.063751206000000005 2024-04-19T03:03:15.319 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.319 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.319 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:03:15.319 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.196133+0000", 2024-04-19T03:03:15.319 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.8213000000000004e-05 2024-04-19T03:03:15.320 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.320 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.320 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:15.320 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.196209+0000", 2024-04-19T03:03:15.320 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6335999999999996e-05 2024-04-19T03:03:15.320 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:15.320 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:15.320 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:15.320 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.320 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.320 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:158385 5.9 5:950ec749:::benchmark_data_smithi096_19531_object44935:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-19T03:03:15.320 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:58.129756+0000", 2024-04-19T03:03:15.320 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 17.094552601, 2024-04-19T03:03:15.320 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.068998382999999996, 2024-04-19T03:03:15.321 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:15.321 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:15.321 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:15.321 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:15.321 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:15.321 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 158385 2024-04-19T03:03:15.321 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.321 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:15.321 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.321 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:15.321 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.129756+0000", 2024-04-19T03:03:15.321 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:15.321 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.321 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.321 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:15.322 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.129756+0000", 2024-04-19T03:03:15.322 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:15.322 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.322 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.322 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:15.322 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.129755+0000", 2024-04-19T03:03:15.322 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:03:15.322 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.322 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.322 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:15.322 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.129760+0000", 2024-04-19T03:03:15.322 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6030000000000004e-06 2024-04-19T03:03:15.322 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.322 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.323 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:15.323 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.129774+0000", 2024-04-19T03:03:15.323 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3131e-05 2024-04-19T03:03:15.323 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.323 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.323 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:15.323 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.129781+0000", 2024-04-19T03:03:15.323 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4030000000000001e-06 2024-04-19T03:03:15.323 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.323 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.323 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:15.323 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.130837+0000", 2024-04-19T03:03:15.323 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00105569 2024-04-19T03:03:15.323 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.323 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.324 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:15.324 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.130917+0000", 2024-04-19T03:03:15.324 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9929e-05 2024-04-19T03:03:15.324 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.324 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.324 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:03:15.324 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.130973+0000", 2024-04-19T03:03:15.324 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.664e-05 2024-04-19T03:03:15.324 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.324 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.324 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:03:15.324 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.132340+0000", 2024-04-19T03:03:15.324 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001366321 2024-04-19T03:03:15.324 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.325 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.325 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:15.325 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.198637+0000", 2024-04-19T03:03:15.325 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.066296888999999998 2024-04-19T03:03:15.325 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.325 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.325 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:03:15.325 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.198704+0000", 2024-04-19T03:03:15.325 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7333000000000001e-05 2024-04-19T03:03:15.325 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.325 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.325 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:15.325 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.198754+0000", 2024-04-19T03:03:15.325 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0421999999999999e-05 2024-04-19T03:03:15.326 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:15.326 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:15.326 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:15.326 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.326 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.326 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:158387 5.9 5:9e96f619:::benchmark_data_smithi096_19531_object44937:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-19T03:03:15.326 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:58.132457+0000", 2024-04-19T03:03:15.326 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 17.091851037000001, 2024-04-19T03:03:15.326 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.066858091999999994, 2024-04-19T03:03:15.326 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:15.326 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:15.326 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:15.326 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:15.326 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:15.327 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 158387 2024-04-19T03:03:15.327 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.327 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:15.327 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.327 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:15.327 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.132457+0000", 2024-04-19T03:03:15.327 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:15.327 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.327 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.327 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:15.327 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.132457+0000", 2024-04-19T03:03:15.327 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:15.327 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.327 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.328 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:15.328 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.132457+0000", 2024-04-19T03:03:15.328 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:15.328 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.328 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.328 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:15.328 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.132460+0000", 2024-04-19T03:03:15.328 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.1949999999999999e-06 2024-04-19T03:03:15.328 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.328 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.328 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:15.328 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.132468+0000", 2024-04-19T03:03:15.328 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.1599999999999998e-06 2024-04-19T03:03:15.328 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.329 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.329 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:15.329 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.132473+0000", 2024-04-19T03:03:15.329 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9259999999999999e-06 2024-04-19T03:03:15.329 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.329 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.329 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:15.329 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.132504+0000", 2024-04-19T03:03:15.329 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0914000000000003e-05 2024-04-19T03:03:15.329 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.329 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.329 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:15.329 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.132646+0000", 2024-04-19T03:03:15.329 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00014214300000000001 2024-04-19T03:03:15.330 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.330 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.330 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:03:15.330 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.132741+0000", 2024-04-19T03:03:15.330 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.4344000000000003e-05 2024-04-19T03:03:15.330 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.330 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.330 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:03:15.330 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.135774+0000", 2024-04-19T03:03:15.330 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0030334960000000001 2024-04-19T03:03:15.330 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.330 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.330 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:15.330 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.199240+0000", 2024-04-19T03:03:15.331 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.063465695000000003 2024-04-19T03:03:15.331 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.331 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.331 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:03:15.331 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.199272+0000", 2024-04-19T03:03:15.331 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2412000000000001e-05 2024-04-19T03:03:15.331 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.331 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.331 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:15.331 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.199316+0000", 2024-04-19T03:03:15.331 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3275000000000002e-05 2024-04-19T03:03:15.331 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:15.331 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:15.331 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:15.332 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.332 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.332 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:158392 5.f 5:f462725f:::benchmark_data_smithi096_19531_object44942:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-19T03:03:15.332 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:58.135703+0000", 2024-04-19T03:03:15.332 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 17.088605257000001, 2024-04-19T03:03:15.332 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.063132879000000003, 2024-04-19T03:03:15.332 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:15.332 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:15.332 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:15.332 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:15.332 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:15.332 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 158392 2024-04-19T03:03:15.332 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.332 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:15.333 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.333 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:15.333 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.135703+0000", 2024-04-19T03:03:15.333 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:15.333 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.333 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.333 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:15.333 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.135703+0000", 2024-04-19T03:03:15.333 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:15.333 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.333 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.333 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:15.333 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.135702+0000", 2024-04-19T03:03:15.333 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:03:15.333 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.334 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.334 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:15.334 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.135708+0000", 2024-04-19T03:03:15.334 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8270000000000003e-06 2024-04-19T03:03:15.334 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.334 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.334 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:15.334 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.135720+0000", 2024-04-19T03:03:15.334 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2057e-05 2024-04-19T03:03:15.334 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.334 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.334 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:15.334 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.135727+0000", 2024-04-19T03:03:15.334 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8090000000000004e-06 2024-04-19T03:03:15.335 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.335 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.335 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:15.335 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.135768+0000", 2024-04-19T03:03:15.335 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1548999999999998e-05 2024-04-19T03:03:15.335 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.335 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.335 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:15.335 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.135853+0000", 2024-04-19T03:03:15.335 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4845000000000005e-05 2024-04-19T03:03:15.335 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.335 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.335 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:03:15.335 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.135934+0000", 2024-04-19T03:03:15.336 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0315000000000006e-05 2024-04-19T03:03:15.336 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.336 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.336 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:03:15.336 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.138685+0000", 2024-04-19T03:03:15.336 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.002751042 2024-04-19T03:03:15.336 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.336 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.336 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:15.336 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.198747+0000", 2024-04-19T03:03:15.336 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.060062675000000003 2024-04-19T03:03:15.336 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.336 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.336 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:03:15.336 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.198802+0000", 2024-04-19T03:03:15.337 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4469000000000003e-05 2024-04-19T03:03:15.337 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.337 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.337 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:15.337 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.198836+0000", 2024-04-19T03:03:15.337 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4272e-05 2024-04-19T03:03:15.337 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:15.337 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:15.337 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:15.337 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.337 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.337 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:158397 5.d 5:b5d962e9:::benchmark_data_smithi096_19531_object44947:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-19T03:03:15.337 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:58.138717+0000", 2024-04-19T03:03:15.337 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 17.085591313999998, 2024-04-19T03:03:15.338 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.057191467000000003, 2024-04-19T03:03:15.338 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:15.338 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:15.338 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:15.338 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:15.338 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:15.338 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 158397 2024-04-19T03:03:15.338 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.338 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:15.338 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.338 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:15.338 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.138717+0000", 2024-04-19T03:03:15.339 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:15.339 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.339 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.339 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:15.339 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.138717+0000", 2024-04-19T03:03:15.339 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:15.339 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.339 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.339 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:15.339 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.138716+0000", 2024-04-19T03:03:15.339 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999986 2024-04-19T03:03:15.339 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.339 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.339 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:15.340 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.138722+0000", 2024-04-19T03:03:15.340 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1709999999999999e-06 2024-04-19T03:03:15.340 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.340 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.340 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:15.340 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.138731+0000", 2024-04-19T03:03:15.340 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.0310000000000004e-06 2024-04-19T03:03:15.340 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.340 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.340 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:15.340 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.138738+0000", 2024-04-19T03:03:15.340 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8430000000000004e-06 2024-04-19T03:03:15.340 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.340 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.341 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:15.341 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.138789+0000", 2024-04-19T03:03:15.341 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0623e-05 2024-04-19T03:03:15.341 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.341 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.341 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:15.341 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.138945+0000", 2024-04-19T03:03:15.341 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00015671899999999999 2024-04-19T03:03:15.341 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.341 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.341 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:03:15.341 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.139079+0000", 2024-04-19T03:03:15.341 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00013380099999999999 2024-04-19T03:03:15.341 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.342 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.342 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:03:15.342 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.141715+0000", 2024-04-19T03:03:15.342 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0026362849999999999 2024-04-19T03:03:15.342 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.342 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.342 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:15.342 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.195784+0000", 2024-04-19T03:03:15.342 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.054068353 2024-04-19T03:03:15.342 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.342 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.342 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:03:15.342 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.195852+0000", 2024-04-19T03:03:15.342 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8121999999999996e-05 2024-04-19T03:03:15.343 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:15.343 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:15.343 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:15.343 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.195909+0000", 2024-04-19T03:03:15.343 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6737999999999998e-05 2024-04-19T03:03:15.343 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:15.343 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:15.343 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:15.343 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:15.343 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:15.343 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-04-19T03:03:15.345 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:03:15.340+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:03:15.345 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T03:03:15.446 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:03:15.442+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:03:15.473 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-19T03:03:15.473 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-04-19T03:03:15.473 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.473 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:200442 5.8 5:1051b0ec:::benchmark_data_smithi096_19531_object86992:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-04-19T03:03:15.473 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:03:15.462957+0000", 2024-04-19T03:03:15.473 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0099220149999999993, 2024-04-19T03:03:15.473 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0099391519999999997, 2024-04-19T03:03:15.473 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:15.473 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-19T03:03:15.473 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:15.474 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:15.474 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:15.474 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 200442 2024-04-19T03:03:15.474 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.474 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:15.474 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.474 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:15.474 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:15.462957+0000", 2024-04-19T03:03:15.474 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:15.474 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.474 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.474 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:15.475 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:15.462957+0000", 2024-04-19T03:03:15.475 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:15.475 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.475 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.475 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:15.475 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:15.462956+0000", 2024-04-19T03:03:15.475 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:15.475 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.475 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.475 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:15.475 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:15.462959+0000", 2024-04-19T03:03:15.475 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0730000000000001e-06 2024-04-19T03:03:15.475 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.475 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.476 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:15.476 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:15.462966+0000", 2024-04-19T03:03:15.476 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7700000000000004e-06 2024-04-19T03:03:15.476 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.476 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.476 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:15.476 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:15.462972+0000", 2024-04-19T03:03:15.476 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6520000000000003e-06 2024-04-19T03:03:15.476 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.476 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.476 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:15.476 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:15.467888+0000", 2024-04-19T03:03:15.476 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0049165939999999998 2024-04-19T03:03:15.476 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.477 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.477 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:15.477 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:15.468005+0000", 2024-04-19T03:03:15.477 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000116359 2024-04-19T03:03:15.477 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:15.477 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:15.477 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:15.477 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.477 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.477 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:200455 5.4 5:26745193:::benchmark_data_smithi096_19531_object87005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-04-19T03:03:15.477 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:03:15.467497+0000", 2024-04-19T03:03:15.477 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0053814229999999998, 2024-04-19T03:03:15.477 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0054395370000000004, 2024-04-19T03:03:15.477 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:15.478 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-19T03:03:15.478 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:15.478 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:15.478 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:15.478 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 200455 2024-04-19T03:03:15.478 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.478 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:15.478 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.478 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:15.478 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:15.467497+0000", 2024-04-19T03:03:15.478 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:15.478 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.478 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.478 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:15.479 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:15.467497+0000", 2024-04-19T03:03:15.479 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:15.479 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.479 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.479 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:15.479 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:15.467497+0000", 2024-04-19T03:03:15.479 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:15.479 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.479 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.479 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:15.479 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:15.467502+0000", 2024-04-19T03:03:15.479 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1680000000000003e-06 2024-04-19T03:03:15.479 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.479 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.480 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:15.480 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:15.467518+0000", 2024-04-19T03:03:15.480 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6288999999999999e-05 2024-04-19T03:03:15.480 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.480 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.480 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:15.480 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:15.467529+0000", 2024-04-19T03:03:15.480 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0474e-05 2024-04-19T03:03:15.480 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.480 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.480 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:15.480 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:15.469368+0000", 2024-04-19T03:03:15.480 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0018391600000000001 2024-04-19T03:03:15.481 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.481 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.481 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:15.481 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:15.469566+0000", 2024-04-19T03:03:15.481 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00019770599999999999 2024-04-19T03:03:15.481 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:15.481 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:15.481 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:15.481 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.481 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.481 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:200456 5.b 5:d54e9cc7:::benchmark_data_smithi096_19531_object87006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-04-19T03:03:15.481 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:03:15.467546+0000", 2024-04-19T03:03:15.481 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0053326429999999998, 2024-04-19T03:03:15.481 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0054252800000000002, 2024-04-19T03:03:15.482 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:15.482 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-19T03:03:15.482 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:15.482 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:15.482 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:15.482 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 200456 2024-04-19T03:03:15.482 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.482 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:15.482 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.482 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:15.482 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:15.467546+0000", 2024-04-19T03:03:15.482 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:15.482 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.483 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.483 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:15.483 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:15.467546+0000", 2024-04-19T03:03:15.483 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:15.483 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.483 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.483 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:15.483 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:15.467546+0000", 2024-04-19T03:03:15.483 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:15.483 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.483 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.483 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:15.483 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:15.467551+0000", 2024-04-19T03:03:15.483 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8949999999999997e-06 2024-04-19T03:03:15.484 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.484 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.484 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:15.484 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:15.467562+0000", 2024-04-19T03:03:15.484 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1048e-05 2024-04-19T03:03:15.484 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.484 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.484 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:15.484 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:15.467570+0000", 2024-04-19T03:03:15.484 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.6640000000000004e-06 2024-04-19T03:03:15.484 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.484 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.484 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:15.484 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:15.467634+0000", 2024-04-19T03:03:15.485 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3267000000000003e-05 2024-04-19T03:03:15.485 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.485 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.485 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:15.485 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:15.470215+0000", 2024-04-19T03:03:15.485 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0025817349999999999 2024-04-19T03:03:15.485 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:15.485 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:15.485 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:15.485 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.485 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.485 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:200458 5.0 5:0aa3b5a9:::benchmark_data_smithi096_19531_object87008:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-04-19T03:03:15.485 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:03:15.468332+0000", 2024-04-19T03:03:15.485 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0045468610000000001, 2024-04-19T03:03:15.486 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0046743059999999996, 2024-04-19T03:03:15.486 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:15.486 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-19T03:03:15.486 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:15.486 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:15.486 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:15.486 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 200458 2024-04-19T03:03:15.486 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.486 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:15.486 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.486 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:15.486 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:15.468332+0000", 2024-04-19T03:03:15.486 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:15.487 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.487 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.487 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:15.487 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:15.468332+0000", 2024-04-19T03:03:15.487 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:15.487 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.487 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.487 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:15.487 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:15.468331+0000", 2024-04-19T03:03:15.487 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:03:15.487 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.487 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.487 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:15.487 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:15.468337+0000", 2024-04-19T03:03:15.488 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.117e-06 2024-04-19T03:03:15.488 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.488 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.488 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:15.488 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:15.468352+0000", 2024-04-19T03:03:15.488 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5458e-05 2024-04-19T03:03:15.488 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.488 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.488 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:15.488 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:15.468365+0000", 2024-04-19T03:03:15.488 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2296999999999999e-05 2024-04-19T03:03:15.488 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.488 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.488 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:15.489 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:15.469930+0000", 2024-04-19T03:03:15.489 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0015650709999999999 2024-04-19T03:03:15.489 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.489 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.489 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:15.489 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:15.470033+0000", 2024-04-19T03:03:15.489 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010323 2024-04-19T03:03:15.489 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:15.489 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:15.489 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:15.489 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.489 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.489 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:200461 5.0 5:09da992f:::benchmark_data_smithi096_19531_object87011:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-04-19T03:03:15.489 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:03:15.470276+0000", 2024-04-19T03:03:15.490 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0026027950000000002, 2024-04-19T03:03:15.490 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0027642890000000001, 2024-04-19T03:03:15.490 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:15.490 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-19T03:03:15.490 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:15.490 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:15.490 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:15.490 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 200461 2024-04-19T03:03:15.490 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.490 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:15.490 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.490 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:15.490 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:15.470276+0000", 2024-04-19T03:03:15.491 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:15.491 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.491 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.491 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:15.491 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:15.470276+0000", 2024-04-19T03:03:15.491 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:15.491 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.491 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.491 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:15.491 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:15.470275+0000", 2024-04-19T03:03:15.491 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:03:15.491 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.491 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.491 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:15.491 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:15.470281+0000", 2024-04-19T03:03:15.492 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3840000000000002e-06 2024-04-19T03:03:15.492 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.492 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.492 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:15.492 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:15.470292+0000", 2024-04-19T03:03:15.492 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1032999999999999e-05 2024-04-19T03:03:15.492 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.492 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.492 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:15.492 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:15.470300+0000", 2024-04-19T03:03:15.492 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.8099999999999998e-06 2024-04-19T03:03:15.492 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.492 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.493 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:15.493 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:15.472224+0000", 2024-04-19T03:03:15.493 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0019238549999999999 2024-04-19T03:03:15.493 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.493 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.493 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:15.493 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:15.472346+0000", 2024-04-19T03:03:15.493 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000121999 2024-04-19T03:03:15.493 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:15.493 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:15.493 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:15.493 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.493 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.493 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:200463 5.4 5:28f710a3:::benchmark_data_smithi096_19531_object87013:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-04-19T03:03:15.493 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:03:15.470326+0000", 2024-04-19T03:03:15.494 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.002553334, 2024-04-19T03:03:15.494 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0027469780000000002, 2024-04-19T03:03:15.494 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:15.494 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-19T03:03:15.494 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:15.494 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:15.494 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:15.494 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 200463 2024-04-19T03:03:15.494 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.494 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:15.494 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.494 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:15.494 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:15.470326+0000", 2024-04-19T03:03:15.495 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:15.495 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.495 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.495 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:15.495 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:15.470326+0000", 2024-04-19T03:03:15.495 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:15.495 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.495 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.495 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:15.495 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:15.470325+0000", 2024-04-19T03:03:15.495 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:15.495 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.495 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.495 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:15.495 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:15.470334+0000", 2024-04-19T03:03:15.496 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9039999999999998e-06 2024-04-19T03:03:15.496 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.496 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.496 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:15.496 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:15.470343+0000", 2024-04-19T03:03:15.496 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9600000000000006e-06 2024-04-19T03:03:15.496 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.496 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.496 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:15.496 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:15.470351+0000", 2024-04-19T03:03:15.496 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.5629999999999992e-06 2024-04-19T03:03:15.496 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.496 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.497 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:15.497 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:15.472001+0000", 2024-04-19T03:03:15.497 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0016495170000000001 2024-04-19T03:03:15.497 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.497 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.497 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:15.497 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:15.472117+0000", 2024-04-19T03:03:15.497 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000116118 2024-04-19T03:03:15.497 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:15.497 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:15.497 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:15.497 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.498 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.498 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4755.0:200459 5.f e61/22 5:f33fbf37:::benchmark_data_smithi096_19531_object87009:head v 61'12452, mlcod=61'12449)", 2024-04-19T03:03:15.498 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:03:15.470541+0000", 2024-04-19T03:03:15.498 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.002338091, 2024-04-19T03:03:15.498 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0025652829999999998, 2024-04-19T03:03:15.498 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:15.498 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-19T03:03:15.498 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:15.498 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.498 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:15.498 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:15.470541+0000", 2024-04-19T03:03:15.498 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:15.498 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.499 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.499 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:15.499 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:15.470541+0000", 2024-04-19T03:03:15.499 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:15.499 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.499 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.499 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:15.499 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:15.470540+0000", 2024-04-19T03:03:15.499 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:03:15.499 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.500 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.500 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:15.500 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:15.470549+0000", 2024-04-19T03:03:15.500 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.6670000000000002e-06 2024-04-19T03:03:15.500 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.500 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.500 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:15.500 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:15.470558+0000", 2024-04-19T03:03:15.500 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.8969999999999997e-06 2024-04-19T03:03:15.500 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.500 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.500 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:15.500 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:15.470563+0000", 2024-04-19T03:03:15.500 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1050000000000003e-06 2024-04-19T03:03:15.500 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.501 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.501 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:15.501 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:15.470604+0000", 2024-04-19T03:03:15.501 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1316000000000002e-05 2024-04-19T03:03:15.501 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.501 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.501 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:15.501 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:15.470620+0000", 2024-04-19T03:03:15.501 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6354e-05 2024-04-19T03:03:15.501 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:15.501 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:15.501 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:15.501 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.501 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.502 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:200465 5.4 5.7862b9a4 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-04-19T03:03:15.502 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:03:15.472081+0000", 2024-04-19T03:03:15.502 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.00079818300000000005, 2024-04-19T03:03:15.502 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0010558799999999999, 2024-04-19T03:03:15.502 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:15.502 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-04-19T03:03:15.502 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:15.502 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:15.502 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:15.502 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 200465 2024-04-19T03:03:15.502 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.502 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:15.502 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.503 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:15.503 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:15.472081+0000", 2024-04-19T03:03:15.503 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:15.503 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.503 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.503 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:15.503 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:15.472081+0000", 2024-04-19T03:03:15.503 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:15.503 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.503 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.503 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:15.503 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:15.472080+0000", 2024-04-19T03:03:15.503 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:03:15.503 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.504 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.504 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:15.504 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:15.472086+0000", 2024-04-19T03:03:15.504 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3080000000000004e-06 2024-04-19T03:03:15.504 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.504 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.504 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:15.504 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:15.472097+0000", 2024-04-19T03:03:15.504 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1069e-05 2024-04-19T03:03:15.504 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.504 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.504 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:15.504 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:15.472105+0000", 2024-04-19T03:03:15.504 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5140000000000004e-06 2024-04-19T03:03:15.504 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:15.505 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:15.505 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:15.505 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.505 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.505 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:200467 5.0 5.d50d5850 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e61)", 2024-04-19T03:03:15.505 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:03:15.472840+0000", 2024-04-19T03:03:15.505 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 3.8779000000000003e-05, 2024-04-19T03:03:15.505 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00032255599999999999, 2024-04-19T03:03:15.505 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:15.505 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-04-19T03:03:15.505 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:15.505 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:15.505 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:15.505 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 200467 2024-04-19T03:03:15.506 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.506 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:15.506 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.506 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:15.506 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:15.472840+0000", 2024-04-19T03:03:15.506 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:15.506 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.506 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.506 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:15.506 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:15.472840+0000", 2024-04-19T03:03:15.506 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:15.506 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.506 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.506 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:15.507 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:15.472839+0000", 2024-04-19T03:03:15.507 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:03:15.507 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.507 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.507 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:15.507 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:15.472844+0000", 2024-04-19T03:03:15.507 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2530000000000004e-06 2024-04-19T03:03:15.507 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.507 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.507 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:15.507 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:15.472858+0000", 2024-04-19T03:03:15.507 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3106e-05 2024-04-19T03:03:15.507 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.507 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.508 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:15.508 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:15.472864+0000", 2024-04-19T03:03:15.508 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7599999999999997e-06 2024-04-19T03:03:15.508 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:15.508 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:15.508 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:15.508 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:15.508 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-04-19T03:03:15.508 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 9 2024-04-19T03:03:15.508 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-19T03:03:15.509 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T03:03:15.548 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:03:15.542+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:03:15.631 INFO:teuthology.orchestra.run.smithi096.stderr:nodeep-scrub is set 2024-04-19T03:03:15.635 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-19T03:03:15.635 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-04-19T03:03:15.635 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-04-19T03:03:15.635 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-04-19T03:03:15.635 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-19T03:03:15.648 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:03:15.642+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:03:15.649 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T03:03:15.750 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:03:15.744+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:03:15.821 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-19T03:03:15.821 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-04-19T03:03:15.821 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-04-19T03:03:15.821 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-04-19T03:03:15.821 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.821 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:86615 5.e 5:7fef7288:::benchmark_data_smithi096_19531_object86614:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:15.821 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:22.634544+0000", 2024-04-19T03:03:15.821 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 53.184171315999997, 2024-04-19T03:03:15.821 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.192475071, 2024-04-19T03:03:15.822 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:15.822 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:15.822 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:15.822 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:15.822 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:15.822 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 86615 2024-04-19T03:03:15.822 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.822 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:15.822 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.822 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:15.822 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634544+0000", 2024-04-19T03:03:15.822 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:15.822 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.823 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.823 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:15.823 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634544+0000", 2024-04-19T03:03:15.823 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:15.823 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.823 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.823 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:15.823 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634542+0000", 2024-04-19T03:03:15.823 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999981 2024-04-19T03:03:15.823 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.823 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.823 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:15.823 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634585+0000", 2024-04-19T03:03:15.823 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2299000000000003e-05 2024-04-19T03:03:15.823 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.824 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.824 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:15.824 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634592+0000", 2024-04-19T03:03:15.824 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2350000000000002e-06 2024-04-19T03:03:15.824 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.824 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.824 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:15.824 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634596+0000", 2024-04-19T03:03:15.824 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5390000000000001e-06 2024-04-19T03:03:15.824 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.824 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.824 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:15.824 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634639+0000", 2024-04-19T03:03:15.824 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2444999999999998e-05 2024-04-19T03:03:15.825 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.825 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.825 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:15.825 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634808+0000", 2024-04-19T03:03:15.825 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000169152 2024-04-19T03:03:15.825 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.825 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.825 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:15.825 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634999+0000", 2024-04-19T03:03:15.825 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00019098300000000001 2024-04-19T03:03:15.825 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.825 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.825 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:15.825 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.640458+0000", 2024-04-19T03:03:15.825 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0054586870000000003 2024-04-19T03:03:15.826 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.826 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.826 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:15.826 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.826949+0000", 2024-04-19T03:03:15.826 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.18649178299999999 2024-04-19T03:03:15.826 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.826 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.826 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:03:15.826 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.826982+0000", 2024-04-19T03:03:15.826 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2477000000000001e-05 2024-04-19T03:03:15.826 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.826 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.826 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:15.826 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.827019+0000", 2024-04-19T03:03:15.827 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7355999999999999e-05 2024-04-19T03:03:15.827 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:15.827 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:15.827 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:15.827 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.827 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.827 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:86616 5.e 5:72278f47:::benchmark_data_smithi096_19531_object86615:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:15.827 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:22.634609+0000", 2024-04-19T03:03:15.827 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 53.184106167000003, 2024-04-19T03:03:15.827 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.19472088900000001, 2024-04-19T03:03:15.827 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:15.827 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:15.828 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:15.828 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:15.828 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:15.828 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 86616 2024-04-19T03:03:15.828 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.828 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:15.828 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.828 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:15.829 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634609+0000", 2024-04-19T03:03:15.829 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:15.829 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.829 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.829 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:15.829 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634609+0000", 2024-04-19T03:03:15.829 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:15.829 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.829 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.829 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:15.829 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634609+0000", 2024-04-19T03:03:15.829 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:15.829 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.830 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.830 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:15.830 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634651+0000", 2024-04-19T03:03:15.830 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2589000000000002e-05 2024-04-19T03:03:15.830 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.830 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.830 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:15.830 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634659+0000", 2024-04-19T03:03:15.830 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5850000000000002e-06 2024-04-19T03:03:15.830 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.830 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.830 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:15.830 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634662+0000", 2024-04-19T03:03:15.830 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3620000000000002e-06 2024-04-19T03:03:15.831 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.831 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.831 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:15.831 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.637880+0000", 2024-04-19T03:03:15.831 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.003218149 2024-04-19T03:03:15.831 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.831 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.831 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:15.831 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.637999+0000", 2024-04-19T03:03:15.831 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000118643 2024-04-19T03:03:15.831 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.831 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.831 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:15.831 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.638102+0000", 2024-04-19T03:03:15.831 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010331 2024-04-19T03:03:15.832 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.832 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.832 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:15.832 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.640851+0000", 2024-04-19T03:03:15.832 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0027483310000000001 2024-04-19T03:03:15.832 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.832 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.832 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:15.832 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.829269+0000", 2024-04-19T03:03:15.832 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.188418319 2024-04-19T03:03:15.832 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.832 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.832 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:03:15.832 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.829299+0000", 2024-04-19T03:03:15.833 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0227e-05 2024-04-19T03:03:15.833 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.833 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.833 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:15.833 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.829330+0000", 2024-04-19T03:03:15.833 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0969000000000001e-05 2024-04-19T03:03:15.833 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:15.833 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:15.833 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:15.833 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.833 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.833 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:86618 5.0 5:09014b90:::benchmark_data_smithi096_19531_object86617:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:15.833 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:22.634894+0000", 2024-04-19T03:03:15.834 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 53.183821678999998, 2024-04-19T03:03:15.834 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.19413419800000001, 2024-04-19T03:03:15.834 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:15.834 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:15.834 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:15.834 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:15.834 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:15.834 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 86618 2024-04-19T03:03:15.834 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.834 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:15.834 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.834 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:15.834 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634894+0000", 2024-04-19T03:03:15.834 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:15.835 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.835 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.835 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:15.835 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634894+0000", 2024-04-19T03:03:15.835 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:15.835 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.835 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.835 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:15.835 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634893+0000", 2024-04-19T03:03:15.835 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:03:15.835 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.835 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.835 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:15.836 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634976+0000", 2024-04-19T03:03:15.836 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3231000000000003e-05 2024-04-19T03:03:15.836 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.836 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.836 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:15.836 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634983+0000", 2024-04-19T03:03:15.836 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5169999999999996e-06 2024-04-19T03:03:15.836 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.836 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.836 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:15.836 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634987+0000", 2024-04-19T03:03:15.836 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.425e-06 2024-04-19T03:03:15.837 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.837 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.837 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:15.837 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635030+0000", 2024-04-19T03:03:15.837 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.32e-05 2024-04-19T03:03:15.837 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.837 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.837 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:15.837 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635185+0000", 2024-04-19T03:03:15.837 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015471899999999999 2024-04-19T03:03:15.838 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.838 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.838 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:15.838 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635415+0000", 2024-04-19T03:03:15.838 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00023026500000000001 2024-04-19T03:03:15.838 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.838 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.838 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:15.838 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.640127+0000", 2024-04-19T03:03:15.838 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0047118890000000004 2024-04-19T03:03:15.838 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.838 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.838 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:15.838 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.828895+0000", 2024-04-19T03:03:15.839 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.18876802600000001 2024-04-19T03:03:15.839 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.839 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.839 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:03:15.839 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.828972+0000", 2024-04-19T03:03:15.839 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.6345000000000002e-05 2024-04-19T03:03:15.839 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.839 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.839 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:15.839 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.829028+0000", 2024-04-19T03:03:15.839 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6342999999999999e-05 2024-04-19T03:03:15.839 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:15.839 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:15.839 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:15.840 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.840 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.840 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:86620 5.b 5:d80faa68:::benchmark_data_smithi096_19531_object86619:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:15.840 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:22.635110+0000", 2024-04-19T03:03:15.840 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 53.183605118999999, 2024-04-19T03:03:15.840 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.193447275, 2024-04-19T03:03:15.840 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:15.840 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:15.840 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:15.840 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:15.840 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:15.840 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 86620 2024-04-19T03:03:15.840 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.840 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:15.841 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.841 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:15.841 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635110+0000", 2024-04-19T03:03:15.841 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:15.841 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.841 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.841 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:15.841 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635110+0000", 2024-04-19T03:03:15.841 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:15.841 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.841 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.841 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:15.841 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635110+0000", 2024-04-19T03:03:15.841 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:15.842 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.842 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.842 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:15.842 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635154+0000", 2024-04-19T03:03:15.842 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4681000000000001e-05 2024-04-19T03:03:15.842 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.842 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.842 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:15.842 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635166+0000", 2024-04-19T03:03:15.842 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1505000000000001e-05 2024-04-19T03:03:15.842 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.842 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.842 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:15.842 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635171+0000", 2024-04-19T03:03:15.843 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6040000000000003e-06 2024-04-19T03:03:15.843 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.843 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.843 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:15.843 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635221+0000", 2024-04-19T03:03:15.843 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9947000000000001e-05 2024-04-19T03:03:15.843 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.843 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.843 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:15.843 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635356+0000", 2024-04-19T03:03:15.843 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013576199999999999 2024-04-19T03:03:15.843 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.843 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.843 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:15.844 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635507+0000", 2024-04-19T03:03:15.844 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015072999999999999 2024-04-19T03:03:15.844 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.844 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.844 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:15.844 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.638488+0000", 2024-04-19T03:03:15.844 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0029813159999999999 2024-04-19T03:03:15.844 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.844 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.844 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:15.844 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.828341+0000", 2024-04-19T03:03:15.844 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.189852254 2024-04-19T03:03:15.844 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.844 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.845 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:03:15.845 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.828416+0000", 2024-04-19T03:03:15.845 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5344000000000002e-05 2024-04-19T03:03:15.845 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.845 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.845 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:15.845 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.828558+0000", 2024-04-19T03:03:15.845 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000141695 2024-04-19T03:03:15.845 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:15.845 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:15.845 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:15.845 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.845 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.846 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:86621 5.8 5:1597a420:::benchmark_data_smithi096_19531_object86620:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:15.846 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:22.635187+0000", 2024-04-19T03:03:15.846 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 53.183528258999999, 2024-04-19T03:03:15.846 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.194204878, 2024-04-19T03:03:15.846 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:15.846 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:15.846 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:15.846 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:15.846 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:15.846 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 86621 2024-04-19T03:03:15.846 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.846 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:15.846 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.846 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:15.846 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635187+0000", 2024-04-19T03:03:15.847 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:15.847 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.847 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.847 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:15.847 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635187+0000", 2024-04-19T03:03:15.847 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:15.847 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.847 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.847 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:15.847 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635187+0000", 2024-04-19T03:03:15.847 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:15.847 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.847 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.847 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:15.848 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635242+0000", 2024-04-19T03:03:15.848 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5158000000000003e-05 2024-04-19T03:03:15.848 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.848 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.848 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:15.848 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635249+0000", 2024-04-19T03:03:15.848 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.7000000000000008e-06 2024-04-19T03:03:15.848 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.848 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.848 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:15.848 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635256+0000", 2024-04-19T03:03:15.848 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2060000000000004e-06 2024-04-19T03:03:15.848 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.848 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.849 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:15.849 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635302+0000", 2024-04-19T03:03:15.849 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5954000000000001e-05 2024-04-19T03:03:15.849 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.849 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.849 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:15.849 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635427+0000", 2024-04-19T03:03:15.849 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012559299999999999 2024-04-19T03:03:15.849 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.849 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.849 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:15.849 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635596+0000", 2024-04-19T03:03:15.849 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000168615 2024-04-19T03:03:15.850 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.850 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.850 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:15.850 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.639320+0000", 2024-04-19T03:03:15.850 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0037244610000000001 2024-04-19T03:03:15.850 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.850 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.850 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:15.850 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.829277+0000", 2024-04-19T03:03:15.850 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.18995651099999999 2024-04-19T03:03:15.850 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.850 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.850 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:03:15.850 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.829341+0000", 2024-04-19T03:03:15.850 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3756000000000004e-05 2024-04-19T03:03:15.851 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.851 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.851 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:15.851 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.829392+0000", 2024-04-19T03:03:15.851 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1555999999999999e-05 2024-04-19T03:03:15.851 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:15.851 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:15.851 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:15.851 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.851 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.851 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87067 5.b 5:d57af71a:::benchmark_data_smithi096_19531_object87066:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:15.851 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.142233+0000", 2024-04-19T03:03:15.851 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 52.676482395999997, 2024-04-19T03:03:15.852 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.071692405000000001, 2024-04-19T03:03:15.852 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:15.852 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:15.852 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:15.852 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:15.852 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:15.852 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87067 2024-04-19T03:03:15.852 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.852 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:15.852 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.852 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:15.852 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142233+0000", 2024-04-19T03:03:15.852 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:15.852 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.852 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.853 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:15.853 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142233+0000", 2024-04-19T03:03:15.853 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:15.853 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.853 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.853 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:15.853 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142232+0000", 2024-04-19T03:03:15.853 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:03:15.853 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.853 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.853 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:15.853 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142277+0000", 2024-04-19T03:03:15.853 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5837000000000002e-05 2024-04-19T03:03:15.853 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.853 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.854 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:15.854 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142297+0000", 2024-04-19T03:03:15.854 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9561000000000001e-05 2024-04-19T03:03:15.854 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.854 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.854 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:15.854 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142311+0000", 2024-04-19T03:03:15.854 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3654e-05 2024-04-19T03:03:15.854 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.854 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.854 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:15.854 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142391+0000", 2024-04-19T03:03:15.855 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0123999999999994e-05 2024-04-19T03:03:15.855 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.855 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.855 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:15.855 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142669+0000", 2024-04-19T03:03:15.855 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00027829800000000001 2024-04-19T03:03:15.855 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.856 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.856 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:15.857 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142859+0000", 2024-04-19T03:03:15.857 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000190051 2024-04-19T03:03:15.857 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.857 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.857 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:15.857 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.150597+0000", 2024-04-19T03:03:15.857 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0077380299999999999 2024-04-19T03:03:15.857 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.857 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.857 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:15.857 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.213855+0000", 2024-04-19T03:03:15.857 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.063257987000000002 2024-04-19T03:03:15.857 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.858 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.858 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:03:15.858 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.213898+0000", 2024-04-19T03:03:15.858 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2916e-05 2024-04-19T03:03:15.858 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.858 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.858 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:15.858 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.213925+0000", 2024-04-19T03:03:15.858 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7503000000000001e-05 2024-04-19T03:03:15.858 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:15.858 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:15.858 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:15.858 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.859 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.859 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87069 5.b 5:da0c93b5:::benchmark_data_smithi096_19531_object87068:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:15.859 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.143402+0000", 2024-04-19T03:03:15.859 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 52.675313434000003, 2024-04-19T03:03:15.859 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.070678598999999995, 2024-04-19T03:03:15.859 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:15.859 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:15.859 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:15.859 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:15.859 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:15.859 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87069 2024-04-19T03:03:15.859 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.859 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:15.860 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.860 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:15.860 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.143402+0000", 2024-04-19T03:03:15.860 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:15.860 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.860 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.860 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:15.860 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.143402+0000", 2024-04-19T03:03:15.860 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:15.860 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.860 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.860 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:15.861 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.143401+0000", 2024-04-19T03:03:15.861 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:03:15.861 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.861 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.861 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:15.861 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.143501+0000", 2024-04-19T03:03:15.861 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000100387 2024-04-19T03:03:15.861 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.861 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.861 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:15.861 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.143516+0000", 2024-04-19T03:03:15.861 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5369000000000001e-05 2024-04-19T03:03:15.861 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.861 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.862 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:15.862 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.143524+0000", 2024-04-19T03:03:15.862 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.7079999999999997e-06 2024-04-19T03:03:15.862 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.862 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.862 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:15.862 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.145550+0000", 2024-04-19T03:03:15.862 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0020259290000000001 2024-04-19T03:03:15.862 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.862 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.862 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:15.862 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.145676+0000", 2024-04-19T03:03:15.863 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000126406 2024-04-19T03:03:15.863 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.863 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.863 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:15.863 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.145802+0000", 2024-04-19T03:03:15.863 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000125974 2024-04-19T03:03:15.863 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.863 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.863 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:15.863 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.151030+0000", 2024-04-19T03:03:15.864 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0052276079999999999 2024-04-19T03:03:15.864 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.864 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.864 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:15.864 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.213998+0000", 2024-04-19T03:03:15.864 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.06296786 2024-04-19T03:03:15.864 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.864 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.864 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:03:15.864 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.214031+0000", 2024-04-19T03:03:15.864 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3387999999999999e-05 2024-04-19T03:03:15.864 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.864 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.864 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:15.865 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.214081+0000", 2024-04-19T03:03:15.865 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9316e-05 2024-04-19T03:03:15.865 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:15.865 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:15.865 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:15.865 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.865 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.865 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87108 5.e 5:7e197adc:::benchmark_data_smithi096_19531_object87107:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:15.865 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.223103+0000", 2024-04-19T03:03:15.865 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 52.595612097, 2024-04-19T03:03:15.865 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.044946887, 2024-04-19T03:03:15.866 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:15.866 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-19T03:03:15.866 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:15.866 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:15.866 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:15.866 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87108 2024-04-19T03:03:15.866 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.866 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:15.866 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.866 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:15.866 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.223103+0000", 2024-04-19T03:03:15.866 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:15.866 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.867 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.867 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:15.867 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.223103+0000", 2024-04-19T03:03:15.867 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:15.867 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.867 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.867 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:15.867 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.223102+0000", 2024-04-19T03:03:15.868 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:03:15.868 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.868 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.868 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:15.868 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.223156+0000", 2024-04-19T03:03:15.868 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3958000000000001e-05 2024-04-19T03:03:15.868 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.868 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.868 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:15.868 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.223166+0000", 2024-04-19T03:03:15.868 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.4809999999999995e-06 2024-04-19T03:03:15.868 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.868 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.869 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:15.869 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.223172+0000", 2024-04-19T03:03:15.869 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0140000000000004e-06 2024-04-19T03:03:15.869 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.869 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.869 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:15.869 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.227295+0000", 2024-04-19T03:03:15.869 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0041233420000000003 2024-04-19T03:03:15.869 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.869 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.869 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:15.869 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.227495+0000", 2024-04-19T03:03:15.869 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00019955299999999999 2024-04-19T03:03:15.869 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.870 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.870 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:15.870 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.227717+0000", 2024-04-19T03:03:15.870 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000221902 2024-04-19T03:03:15.870 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.870 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.870 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:15.870 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233189+0000", 2024-04-19T03:03:15.870 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0054718889999999997 2024-04-19T03:03:15.870 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.870 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.870 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:15.870 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.250529+0000", 2024-04-19T03:03:15.871 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.017340298000000001 2024-04-19T03:03:15.871 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.871 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.871 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:03:15.871 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.250539+0000", 2024-04-19T03:03:15.871 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0501e-05 2024-04-19T03:03:15.871 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.871 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.871 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:15.871 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.268003+0000", 2024-04-19T03:03:15.871 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.017463429 2024-04-19T03:03:15.871 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.871 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.871 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:15.872 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.268050+0000", 2024-04-19T03:03:15.872 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7466000000000003e-05 2024-04-19T03:03:15.872 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:15.872 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:15.872 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:15.872 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.872 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.872 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87118 5.b 5:d1bb4f3c:::benchmark_data_smithi096_19531_object87117:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:15.872 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.231082+0000", 2024-04-19T03:03:15.872 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 52.587633263000001, 2024-04-19T03:03:15.872 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.035789004, 2024-04-19T03:03:15.872 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:15.872 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-19T03:03:15.873 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:15.873 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:15.873 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:15.873 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87118 2024-04-19T03:03:15.873 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.873 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:15.873 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.873 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:15.873 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231082+0000", 2024-04-19T03:03:15.873 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:15.873 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.873 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.873 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:15.873 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231082+0000", 2024-04-19T03:03:15.874 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:15.874 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.874 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.874 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:15.874 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231081+0000", 2024-04-19T03:03:15.874 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:03:15.874 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.874 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.874 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:15.874 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231159+0000", 2024-04-19T03:03:15.874 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.7819999999999997e-05 2024-04-19T03:03:15.874 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.874 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.874 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:15.875 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231186+0000", 2024-04-19T03:03:15.875 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7126000000000001e-05 2024-04-19T03:03:15.875 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.875 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.875 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:15.875 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231193+0000", 2024-04-19T03:03:15.875 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7259999999999996e-06 2024-04-19T03:03:15.875 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.875 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.875 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:15.875 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231241+0000", 2024-04-19T03:03:15.875 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8123e-05 2024-04-19T03:03:15.875 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.876 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.876 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:15.876 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231354+0000", 2024-04-19T03:03:15.876 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0001133 2024-04-19T03:03:15.876 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.876 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.876 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:15.876 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231443+0000", 2024-04-19T03:03:15.876 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9167999999999997e-05 2024-04-19T03:03:15.876 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.876 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.876 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:15.876 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236498+0000", 2024-04-19T03:03:15.876 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0050545160000000002 2024-04-19T03:03:15.877 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.877 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.877 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:15.877 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.249681+0000", 2024-04-19T03:03:15.877 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013183321 2024-04-19T03:03:15.877 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.877 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.877 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:03:15.877 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.249693+0000", 2024-04-19T03:03:15.877 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1834999999999999e-05 2024-04-19T03:03:15.877 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.877 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.877 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:15.877 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266733+0000", 2024-04-19T03:03:15.877 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.017040408 2024-04-19T03:03:15.878 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.878 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.878 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:15.878 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266871+0000", 2024-04-19T03:03:15.878 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000137849 2024-04-19T03:03:15.878 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:15.878 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:15.878 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:15.878 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.878 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.878 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87121 5.b 5:d01822b8:::benchmark_data_smithi096_19531_object87120:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:15.878 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.233319+0000", 2024-04-19T03:03:15.878 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 52.585396398999997, 2024-04-19T03:03:15.879 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.033624198, 2024-04-19T03:03:15.879 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:15.879 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-19T03:03:15.879 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:15.879 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:15.879 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:15.879 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87121 2024-04-19T03:03:15.879 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.879 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:15.879 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.879 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:15.879 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233319+0000", 2024-04-19T03:03:15.879 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:15.879 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.880 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.880 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:15.880 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233319+0000", 2024-04-19T03:03:15.880 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:15.880 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.880 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.880 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:15.880 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233319+0000", 2024-04-19T03:03:15.880 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:15.880 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.880 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.880 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:15.880 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233364+0000", 2024-04-19T03:03:15.880 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5460999999999997e-05 2024-04-19T03:03:15.881 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.881 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.881 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:15.881 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233382+0000", 2024-04-19T03:03:15.881 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8148e-05 2024-04-19T03:03:15.881 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.881 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.881 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:15.881 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233390+0000", 2024-04-19T03:03:15.881 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5340000000000002e-06 2024-04-19T03:03:15.881 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.881 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.881 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:15.882 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233712+0000", 2024-04-19T03:03:15.882 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00032260500000000001 2024-04-19T03:03:15.882 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.882 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.882 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:15.882 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233829+0000", 2024-04-19T03:03:15.882 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011638599999999999 2024-04-19T03:03:15.882 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.882 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.882 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:15.882 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233959+0000", 2024-04-19T03:03:15.882 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013013900000000001 2024-04-19T03:03:15.882 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.883 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.883 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:15.883 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236515+0000", 2024-04-19T03:03:15.883 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0025562750000000002 2024-04-19T03:03:15.883 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.883 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.883 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:15.883 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.249723+0000", 2024-04-19T03:03:15.883 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013208176 2024-04-19T03:03:15.883 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.883 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.883 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:03:15.883 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.249728+0000", 2024-04-19T03:03:15.883 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6519999999999997e-06 2024-04-19T03:03:15.884 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.884 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.884 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:15.884 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266837+0000", 2024-04-19T03:03:15.884 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0171087059999999 2024-04-19T03:03:15.884 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.884 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.884 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:15.884 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266943+0000", 2024-04-19T03:03:15.884 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000106604 2024-04-19T03:03:15.884 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:15.884 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:15.884 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:15.884 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.885 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.885 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87124 5.8 5:14819ad7:::benchmark_data_smithi096_19531_object87123:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:15.885 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.235886+0000", 2024-04-19T03:03:15.885 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 52.582828974999998, 2024-04-19T03:03:15.885 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0315451179999999, 2024-04-19T03:03:15.885 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:15.885 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-19T03:03:15.885 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:15.885 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:15.885 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:15.885 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87124 2024-04-19T03:03:15.885 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.885 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:15.885 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.886 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:15.886 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.235886+0000", 2024-04-19T03:03:15.886 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:15.886 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.886 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.886 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:15.886 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.235886+0000", 2024-04-19T03:03:15.886 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:15.886 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.886 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.886 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:15.886 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.235886+0000", 2024-04-19T03:03:15.886 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:03:15.887 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.887 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.887 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:15.887 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.235934+0000", 2024-04-19T03:03:15.887 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8384000000000003e-05 2024-04-19T03:03:15.887 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.887 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.887 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:15.887 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.235945+0000", 2024-04-19T03:03:15.887 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0671e-05 2024-04-19T03:03:15.887 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.887 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.887 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:15.887 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.235952+0000", 2024-04-19T03:03:15.888 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3089999999999998e-06 2024-04-19T03:03:15.888 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.888 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.888 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:15.888 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.237067+0000", 2024-04-19T03:03:15.888 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001115263 2024-04-19T03:03:15.888 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.888 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.888 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:15.888 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.237188+0000", 2024-04-19T03:03:15.888 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000121258 2024-04-19T03:03:15.888 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.888 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.888 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:15.889 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.237316+0000", 2024-04-19T03:03:15.889 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000128071 2024-04-19T03:03:15.889 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.889 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.889 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:15.889 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240744+0000", 2024-04-19T03:03:15.889 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0034275629999999998 2024-04-19T03:03:15.889 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.889 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.889 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:15.889 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.252517+0000", 2024-04-19T03:03:15.889 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011772991999999999 2024-04-19T03:03:15.889 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.889 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.890 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:03:15.890 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.252523+0000", 2024-04-19T03:03:15.890 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3640000000000004e-06 2024-04-19T03:03:15.890 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.890 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.890 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:15.890 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.267290+0000", 2024-04-19T03:03:15.890 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0147665690000001 2024-04-19T03:03:15.890 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.890 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.890 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:15.890 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.267432+0000", 2024-04-19T03:03:15.890 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014165299999999999 2024-04-19T03:03:15.890 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:15.891 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:15.891 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:15.891 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.891 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.891 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87129 5.0 5:02667e01:::benchmark_data_smithi096_19531_object87128:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:15.891 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.236466+0000", 2024-04-19T03:03:15.891 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 52.582248978999999, 2024-04-19T03:03:15.891 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0301534510000001, 2024-04-19T03:03:15.891 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:15.891 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-19T03:03:15.891 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:15.891 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:15.891 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:15.891 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87129 2024-04-19T03:03:15.891 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.892 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:15.892 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.892 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:15.892 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236466+0000", 2024-04-19T03:03:15.892 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:15.892 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.892 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.892 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:15.892 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236466+0000", 2024-04-19T03:03:15.892 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:15.892 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.892 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.892 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:15.892 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236465+0000", 2024-04-19T03:03:15.893 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:03:15.893 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.893 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.893 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:15.893 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236566+0000", 2024-04-19T03:03:15.893 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010047000000000001 2024-04-19T03:03:15.893 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.893 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.893 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:15.893 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236577+0000", 2024-04-19T03:03:15.893 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1772e-05 2024-04-19T03:03:15.893 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.893 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.894 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:15.894 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236584+0000", 2024-04-19T03:03:15.894 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0530000000000003e-06 2024-04-19T03:03:15.894 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.894 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.894 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:15.894 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.237023+0000", 2024-04-19T03:03:15.894 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000439703 2024-04-19T03:03:15.894 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.894 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.894 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:15.894 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.237207+0000", 2024-04-19T03:03:15.894 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000183692 2024-04-19T03:03:15.895 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.895 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.895 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:15.895 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.237373+0000", 2024-04-19T03:03:15.895 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016623500000000001 2024-04-19T03:03:15.895 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.895 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.895 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:15.895 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.241461+0000", 2024-04-19T03:03:15.895 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0040883050000000004 2024-04-19T03:03:15.895 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.895 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.895 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:15.896 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.252500+0000", 2024-04-19T03:03:15.896 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011038450999999999 2024-04-19T03:03:15.896 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.896 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.896 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:03:15.896 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.252507+0000", 2024-04-19T03:03:15.896 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2439999999999996e-06 2024-04-19T03:03:15.896 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.896 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.896 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:15.896 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266538+0000", 2024-04-19T03:03:15.896 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.014031184 2024-04-19T03:03:15.896 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.896 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.897 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:15.897 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266620+0000", 2024-04-19T03:03:15.897 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1600000000000005e-05 2024-04-19T03:03:15.897 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:15.897 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:15.897 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:15.897 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.897 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.897 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87135 5.4 5:2a97e7b7:::benchmark_data_smithi096_19531_object87134:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:15.897 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.240884+0000", 2024-04-19T03:03:15.897 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 52.577831521999997, 2024-04-19T03:03:15.897 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.025708931, 2024-04-19T03:03:15.897 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:15.897 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-19T03:03:15.898 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:15.898 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:15.898 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:15.898 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87135 2024-04-19T03:03:15.898 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.898 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:15.898 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.898 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:15.898 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240884+0000", 2024-04-19T03:03:15.898 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:15.898 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.898 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.898 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:15.899 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240884+0000", 2024-04-19T03:03:15.899 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:15.899 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.899 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.899 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:15.899 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240883+0000", 2024-04-19T03:03:15.899 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:03:15.899 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.899 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.899 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:15.899 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240933+0000", 2024-04-19T03:03:15.899 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9969999999999998e-05 2024-04-19T03:03:15.899 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.899 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.900 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:15.900 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240946+0000", 2024-04-19T03:03:15.900 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2943e-05 2024-04-19T03:03:15.900 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.900 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.900 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:15.900 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240952+0000", 2024-04-19T03:03:15.900 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8930000000000002e-06 2024-04-19T03:03:15.900 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.900 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.900 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:15.900 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240994+0000", 2024-04-19T03:03:15.900 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2753999999999998e-05 2024-04-19T03:03:15.900 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.901 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.901 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:15.901 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.241092+0000", 2024-04-19T03:03:15.901 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.7447000000000004e-05 2024-04-19T03:03:15.901 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.901 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.901 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:15.901 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.241183+0000", 2024-04-19T03:03:15.901 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1163999999999997e-05 2024-04-19T03:03:15.901 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.901 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.901 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:15.901 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.254672+0000", 2024-04-19T03:03:15.902 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.01348864 2024-04-19T03:03:15.902 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.902 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.902 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:03:15.902 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.254681+0000", 2024-04-19T03:03:15.902 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.3789999999999995e-06 2024-04-19T03:03:15.902 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.902 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.902 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:15.902 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266456+0000", 2024-04-19T03:03:15.902 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.011774621 2024-04-19T03:03:15.902 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.902 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.902 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:15.903 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266593+0000", 2024-04-19T03:03:15.903 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013737600000000001 2024-04-19T03:03:15.903 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:15.903 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:15.903 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:15.903 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.903 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.903 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87136 5.4 5:212411bc:::benchmark_data_smithi096_19531_object87135:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:15.903 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.240962+0000", 2024-04-19T03:03:15.903 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 52.577753645999998, 2024-04-19T03:03:15.903 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.025738, 2024-04-19T03:03:15.903 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:15.903 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-19T03:03:15.904 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:15.904 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:15.904 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:15.904 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87136 2024-04-19T03:03:15.904 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.904 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:15.904 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.904 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:15.904 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240962+0000", 2024-04-19T03:03:15.904 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:15.904 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.904 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.904 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:15.904 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240962+0000", 2024-04-19T03:03:15.904 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:15.905 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.905 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.905 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:15.905 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240961+0000", 2024-04-19T03:03:15.905 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:15.905 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.905 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.905 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:15.905 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240995+0000", 2024-04-19T03:03:15.905 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3868000000000002e-05 2024-04-19T03:03:15.905 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.905 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.905 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:15.906 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.241001+0000", 2024-04-19T03:03:15.906 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.322e-06 2024-04-19T03:03:15.906 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.906 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.906 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:15.906 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.241004+0000", 2024-04-19T03:03:15.906 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3510000000000002e-06 2024-04-19T03:03:15.906 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.906 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.906 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:15.906 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247131+0000", 2024-04-19T03:03:15.906 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0061270869999999998 2024-04-19T03:03:15.906 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.907 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.907 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:15.907 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247322+0000", 2024-04-19T03:03:15.907 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000191015 2024-04-19T03:03:15.907 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.907 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.907 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:15.907 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247542+0000", 2024-04-19T03:03:15.907 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00022030199999999999 2024-04-19T03:03:15.907 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.907 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.907 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:15.908 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.254709+0000", 2024-04-19T03:03:15.908 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0071662660000000001 2024-04-19T03:03:15.908 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.908 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.908 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:03:15.908 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.254716+0000", 2024-04-19T03:03:15.908 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3860000000000001e-06 2024-04-19T03:03:15.908 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.908 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.908 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:15.908 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266619+0000", 2024-04-19T03:03:15.908 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0119031030000001 2024-04-19T03:03:15.908 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.908 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.909 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:15.909 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266700+0000", 2024-04-19T03:03:15.909 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0764000000000001e-05 2024-04-19T03:03:15.909 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:15.909 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:15.909 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:15.909 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.909 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.909 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87138 5.e 5:7b1f1c20:::benchmark_data_smithi096_19531_object87137:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:15.909 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.247862+0000", 2024-04-19T03:03:15.909 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 52.570853571999997, 2024-04-19T03:03:15.909 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.024457079, 2024-04-19T03:03:15.909 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:15.909 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:15.910 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:15.910 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:15.910 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:15.910 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87138 2024-04-19T03:03:15.910 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.910 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:15.910 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.910 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:15.910 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247862+0000", 2024-04-19T03:03:15.910 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:15.910 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.910 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.910 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:15.910 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247862+0000", 2024-04-19T03:03:15.911 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:15.911 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.911 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.911 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:15.911 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247860+0000", 2024-04-19T03:03:15.911 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999981 2024-04-19T03:03:15.911 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.911 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.911 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:15.911 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247909+0000", 2024-04-19T03:03:15.911 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9150999999999997e-05 2024-04-19T03:03:15.911 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.911 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.911 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:15.911 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247925+0000", 2024-04-19T03:03:15.912 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5761999999999999e-05 2024-04-19T03:03:15.912 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.912 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.912 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:15.912 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247936+0000", 2024-04-19T03:03:15.912 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1144e-05 2024-04-19T03:03:15.912 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.912 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.912 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:15.912 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.250590+0000", 2024-04-19T03:03:15.912 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.002653678 2024-04-19T03:03:15.912 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.912 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.912 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:03:15.913 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.250599+0000", 2024-04-19T03:03:15.913 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9039999999999998e-06 2024-04-19T03:03:15.913 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.913 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.913 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:15.913 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.268151+0000", 2024-04-19T03:03:15.913 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0175523449999999 2024-04-19T03:03:15.913 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.913 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.913 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:15.913 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.268285+0000", 2024-04-19T03:03:15.913 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013415599999999999 2024-04-19T03:03:15.913 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.914 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.914 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:15.914 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.272238+0000", 2024-04-19T03:03:15.914 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0039533019999999997 2024-04-19T03:03:15.914 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.914 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.914 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:03:15.914 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.272274+0000", 2024-04-19T03:03:15.914 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5352000000000003e-05 2024-04-19T03:03:15.914 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.914 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.914 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:15.914 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.272319+0000", 2024-04-19T03:03:15.915 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5281999999999998e-05 2024-04-19T03:03:15.915 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:15.915 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:15.915 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:15.915 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.915 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.915 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:158371 5.8 5:11a83024:::benchmark_data_smithi096_19531_object44921:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-19T03:03:15.915 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:58.125869+0000", 2024-04-19T03:03:15.915 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 17.692846707000001, 2024-04-19T03:03:15.915 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074532857999999994, 2024-04-19T03:03:15.915 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:15.915 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:15.915 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:15.916 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:15.916 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:15.916 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 158371 2024-04-19T03:03:15.916 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.916 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:15.916 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.916 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:15.916 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125869+0000", 2024-04-19T03:03:15.916 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:15.916 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.916 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.916 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:15.916 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125869+0000", 2024-04-19T03:03:15.916 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:15.917 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.917 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.917 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:15.917 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125868+0000", 2024-04-19T03:03:15.917 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:03:15.917 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.917 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.917 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:15.917 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125874+0000", 2024-04-19T03:03:15.917 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7120000000000003e-06 2024-04-19T03:03:15.917 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.917 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.917 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:15.917 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125885+0000", 2024-04-19T03:03:15.918 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0665999999999999e-05 2024-04-19T03:03:15.918 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.918 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.918 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:15.918 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125901+0000", 2024-04-19T03:03:15.918 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6463000000000001e-05 2024-04-19T03:03:15.918 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.918 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.918 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:15.918 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125956+0000", 2024-04-19T03:03:15.918 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4728000000000002e-05 2024-04-19T03:03:15.918 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.918 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.918 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:15.919 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.126050+0000", 2024-04-19T03:03:15.919 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.3534000000000003e-05 2024-04-19T03:03:15.919 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.919 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.919 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:15.919 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.200187+0000", 2024-04-19T03:03:15.919 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074136933000000002 2024-04-19T03:03:15.919 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.919 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.919 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:03:15.919 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.200260+0000", 2024-04-19T03:03:15.919 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3090999999999995e-05 2024-04-19T03:03:15.919 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.919 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.920 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:15.920 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.200402+0000", 2024-04-19T03:03:15.920 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014193699999999999 2024-04-19T03:03:15.920 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:15.920 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:15.920 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:15.920 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.920 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.920 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:158372 5.0 5:0473aa5f:::benchmark_data_smithi096_19531_object44922:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-19T03:03:15.920 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:58.125924+0000", 2024-04-19T03:03:15.920 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 17.692791100000001, 2024-04-19T03:03:15.920 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074247490999999999, 2024-04-19T03:03:15.920 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:15.920 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:15.921 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:15.921 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:15.921 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:15.921 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 158372 2024-04-19T03:03:15.921 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.921 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:15.921 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.921 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:15.921 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125924+0000", 2024-04-19T03:03:15.921 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:15.921 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.921 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.921 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:15.921 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125924+0000", 2024-04-19T03:03:15.922 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:15.922 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.922 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.922 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:15.922 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125924+0000", 2024-04-19T03:03:15.922 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:15.922 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.922 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.922 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:15.922 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125927+0000", 2024-04-19T03:03:15.922 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5389999999999999e-06 2024-04-19T03:03:15.922 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.922 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.922 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:15.923 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125935+0000", 2024-04-19T03:03:15.923 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3259999999999998e-06 2024-04-19T03:03:15.923 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.923 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.923 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:15.923 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125940+0000", 2024-04-19T03:03:15.923 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6980000000000003e-06 2024-04-19T03:03:15.923 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.923 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.923 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:15.923 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125982+0000", 2024-04-19T03:03:15.923 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1337000000000001e-05 2024-04-19T03:03:15.923 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.924 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.924 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:15.924 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.126075+0000", 2024-04-19T03:03:15.924 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.3579999999999995e-05 2024-04-19T03:03:15.924 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.924 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.924 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:15.924 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.199953+0000", 2024-04-19T03:03:15.924 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073877604999999999 2024-04-19T03:03:15.924 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.924 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.924 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:03:15.924 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.200022+0000", 2024-04-19T03:03:15.925 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.8824000000000004e-05 2024-04-19T03:03:15.925 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.925 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.925 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:15.925 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.200172+0000", 2024-04-19T03:03:15.925 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015017700000000001 2024-04-19T03:03:15.925 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:15.925 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:15.925 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:15.925 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.925 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.925 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:158374 5.e 5:76be57a5:::benchmark_data_smithi096_19531_object44924:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-19T03:03:15.926 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:58.125988+0000", 2024-04-19T03:03:15.926 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 17.692727601000001, 2024-04-19T03:03:15.926 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.067843332000000006, 2024-04-19T03:03:15.926 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:15.926 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:15.926 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:15.926 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:15.926 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:15.926 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 158374 2024-04-19T03:03:15.926 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.926 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:15.926 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.926 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:15.927 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125988+0000", 2024-04-19T03:03:15.927 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:15.927 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.927 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.927 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:15.927 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125988+0000", 2024-04-19T03:03:15.927 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:15.927 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.927 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.927 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:15.927 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125987+0000", 2024-04-19T03:03:15.927 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:15.927 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.927 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.928 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:15.928 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125990+0000", 2024-04-19T03:03:15.928 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7989999999999998e-06 2024-04-19T03:03:15.928 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.928 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.928 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:15.928 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125996+0000", 2024-04-19T03:03:15.928 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.302e-06 2024-04-19T03:03:15.928 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.928 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.928 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:15.928 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.126001+0000", 2024-04-19T03:03:15.928 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.843e-06 2024-04-19T03:03:15.928 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.929 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.929 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:15.929 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.126047+0000", 2024-04-19T03:03:15.929 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6066000000000002e-05 2024-04-19T03:03:15.929 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.929 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.929 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:15.929 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.126171+0000", 2024-04-19T03:03:15.929 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012359099999999999 2024-04-19T03:03:15.929 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.929 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.929 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:15.929 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.193709+0000", 2024-04-19T03:03:15.930 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.067538099000000004 2024-04-19T03:03:15.930 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.930 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.930 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:03:15.930 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.193766+0000", 2024-04-19T03:03:15.930 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6869e-05 2024-04-19T03:03:15.930 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.930 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.930 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:15.930 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.193831+0000", 2024-04-19T03:03:15.930 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5273999999999999e-05 2024-04-19T03:03:15.930 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:15.930 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:15.931 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:15.931 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.931 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.931 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4755.0:158376 5.9 e56/22 5:9e73c076:::benchmark_data_smithi096_19531_object44926:head v 56'9663, mlcod=56'9661)", 2024-04-19T03:03:15.931 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:58.127307+0000", 2024-04-19T03:03:15.931 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 17.691408370000001, 2024-04-19T03:03:15.931 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069002716000000006, 2024-04-19T03:03:15.931 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:15.931 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:15.931 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:15.931 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.931 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:15.931 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.127307+0000", 2024-04-19T03:03:15.931 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:15.932 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.932 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.932 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:15.932 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.127307+0000", 2024-04-19T03:03:15.932 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:15.932 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.932 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.932 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:15.932 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.127306+0000", 2024-04-19T03:03:15.932 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:03:15.932 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.932 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.932 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:15.933 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.127316+0000", 2024-04-19T03:03:15.933 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.3039999999999994e-06 2024-04-19T03:03:15.933 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.933 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.933 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:15.933 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.127326+0000", 2024-04-19T03:03:15.933 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0009e-05 2024-04-19T03:03:15.933 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.933 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.933 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:15.933 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.127332+0000", 2024-04-19T03:03:15.933 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5880000000000003e-06 2024-04-19T03:03:15.933 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.934 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.934 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:15.934 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.127383+0000", 2024-04-19T03:03:15.934 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0516000000000002e-05 2024-04-19T03:03:15.934 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.934 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.934 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:15.934 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.127403+0000", 2024-04-19T03:03:15.934 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0547000000000002e-05 2024-04-19T03:03:15.934 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.934 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.934 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:03:15.934 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.196280+0000", 2024-04-19T03:03:15.934 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.068876863999999996 2024-04-19T03:03:15.935 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.935 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.935 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:15.935 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.196310+0000", 2024-04-19T03:03:15.935 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9762999999999999e-05 2024-04-19T03:03:15.935 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:15.935 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:15.935 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:15.935 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.935 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.935 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:158383 5.0 5:026717eb:::benchmark_data_smithi096_19531_object44933:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-19T03:03:15.935 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:58.130494+0000", 2024-04-19T03:03:15.935 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 17.688221244000001, 2024-04-19T03:03:15.936 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.070135775999999997, 2024-04-19T03:03:15.936 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:15.936 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:15.936 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:15.936 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:15.936 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:15.936 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 158383 2024-04-19T03:03:15.936 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.936 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:15.936 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.936 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:15.936 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.130494+0000", 2024-04-19T03:03:15.937 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:15.937 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.937 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.937 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:15.937 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.130494+0000", 2024-04-19T03:03:15.937 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:15.937 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.937 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.937 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:15.937 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.130493+0000", 2024-04-19T03:03:15.937 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:03:15.937 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.938 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.938 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:15.938 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.130500+0000", 2024-04-19T03:03:15.938 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5490000000000003e-06 2024-04-19T03:03:15.938 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.938 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.938 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:15.938 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.190401+0000", 2024-04-19T03:03:15.938 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.059901668999999998 2024-04-19T03:03:15.938 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.938 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.938 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:15.938 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.190421+0000", 2024-04-19T03:03:15.938 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0288e-05 2024-04-19T03:03:15.939 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.939 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.939 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:15.939 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.190536+0000", 2024-04-19T03:03:15.939 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000114783 2024-04-19T03:03:15.939 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.939 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.939 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:15.939 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.190904+0000", 2024-04-19T03:03:15.939 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00036773900000000001 2024-04-19T03:03:15.939 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.939 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.939 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:15.939 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.200417+0000", 2024-04-19T03:03:15.940 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0095128899999999995 2024-04-19T03:03:15.940 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.940 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.940 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:03:15.940 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.200489+0000", 2024-04-19T03:03:15.940 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2554999999999999e-05 2024-04-19T03:03:15.940 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:15.940 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:15.940 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:15.940 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.200630+0000", 2024-04-19T03:03:15.940 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014055299999999999 2024-04-19T03:03:15.940 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:15.940 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:15.941 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:15.941 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:15.941 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:15.941 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-19T03:03:15.942 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:03:15.940+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:03:15.943 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T03:03:16.043 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:03:16.038+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:03:16.072 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-04-19T03:03:16.072 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [ 2024-04-19T03:03:16.072 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.072 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:201933 5.9 5:9eccf1df:::benchmark_data_smithi096_19531_object88483:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T03:03:16.072 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:03:16.065301+0000", 2024-04-19T03:03:16.072 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0061761489999999997, 2024-04-19T03:03:16.072 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0062031250000000003, 2024-04-19T03:03:16.072 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:16.073 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:03:16.073 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:16.073 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:16.073 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:16.073 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 201933 2024-04-19T03:03:16.073 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.073 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:16.073 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.073 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:16.073 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:16.065301+0000", 2024-04-19T03:03:16.073 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:16.073 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.073 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.073 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:16.074 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:16.065301+0000", 2024-04-19T03:03:16.074 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:16.074 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.074 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.074 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:16.074 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:16.065300+0000", 2024-04-19T03:03:16.074 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:03:16.074 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.074 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.074 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:16.074 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:16.065305+0000", 2024-04-19T03:03:16.074 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8409999999999999e-06 2024-04-19T03:03:16.074 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.075 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.075 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:16.075 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:16.065314+0000", 2024-04-19T03:03:16.075 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.7739999999999993e-06 2024-04-19T03:03:16.075 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.075 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.075 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:16.075 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:16.065320+0000", 2024-04-19T03:03:16.075 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7089999999999996e-06 2024-04-19T03:03:16.075 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.075 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.075 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:16.075 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:16.067230+0000", 2024-04-19T03:03:16.076 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0019094470000000001 2024-04-19T03:03:16.076 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.076 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.076 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:16.076 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:16.067371+0000", 2024-04-19T03:03:16.076 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00014076900000000001 2024-04-19T03:03:16.076 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.076 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.076 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:03:16.076 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:16.067450+0000", 2024-04-19T03:03:16.076 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8914999999999999e-05 2024-04-19T03:03:16.077 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.077 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.077 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:16.077 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:16.070062+0000", 2024-04-19T03:03:16.077 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0026124410000000001 2024-04-19T03:03:16.077 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:16.077 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:16.077 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:16.077 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.077 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.077 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:201939 5.1 5:8775db88:::benchmark_data_smithi096_19531_object88489:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T03:03:16.077 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:03:16.067672+0000", 2024-04-19T03:03:16.077 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0038051560000000001, 2024-04-19T03:03:16.078 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0039330650000000003, 2024-04-19T03:03:16.078 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:16.078 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-04-19T03:03:16.078 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:16.078 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:16.078 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:16.078 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 201939 2024-04-19T03:03:16.078 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.078 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:16.078 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.078 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:16.078 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:16.067672+0000", 2024-04-19T03:03:16.078 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:16.078 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.079 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.079 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:16.079 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:16.067672+0000", 2024-04-19T03:03:16.079 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:16.079 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.079 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.079 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:16.079 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:16.067671+0000", 2024-04-19T03:03:16.079 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:03:16.079 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.079 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.079 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:16.079 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:16.067676+0000", 2024-04-19T03:03:16.079 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1630000000000004e-06 2024-04-19T03:03:16.080 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.080 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.080 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:16.080 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:16.067687+0000", 2024-04-19T03:03:16.080 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1347e-05 2024-04-19T03:03:16.080 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.080 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.080 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:16.080 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:16.067695+0000", 2024-04-19T03:03:16.080 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9070000000000007e-06 2024-04-19T03:03:16.080 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.080 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.080 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:16.080 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:16.069191+0000", 2024-04-19T03:03:16.081 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001495183 2024-04-19T03:03:16.081 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.081 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.081 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:16.081 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:16.069315+0000", 2024-04-19T03:03:16.081 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00012398899999999999 2024-04-19T03:03:16.081 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:16.081 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:16.081 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:16.081 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.081 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.081 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:201944 5.7 5:e615c890:::benchmark_data_smithi096_19531_object88494:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T03:03:16.081 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:03:16.070007+0000", 2024-04-19T03:03:16.081 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.00146974, 2024-04-19T03:03:16.082 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001676727, 2024-04-19T03:03:16.082 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:16.082 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-04-19T03:03:16.082 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:16.082 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:16.082 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:16.082 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 201944 2024-04-19T03:03:16.082 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.082 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:16.082 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.082 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:16.082 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:16.070007+0000", 2024-04-19T03:03:16.082 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:16.083 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.083 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.083 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:16.083 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:16.070007+0000", 2024-04-19T03:03:16.083 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:16.083 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.083 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.083 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:16.083 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:16.070006+0000", 2024-04-19T03:03:16.083 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:03:16.083 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.083 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.083 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:16.084 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:16.070012+0000", 2024-04-19T03:03:16.084 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9800000000000003e-06 2024-04-19T03:03:16.084 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.084 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.084 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:16.084 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:16.070020+0000", 2024-04-19T03:03:16.084 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.1159999999999999e-06 2024-04-19T03:03:16.084 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.084 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.084 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:16.085 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:16.070026+0000", 2024-04-19T03:03:16.085 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7370000000000003e-06 2024-04-19T03:03:16.085 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.085 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.085 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:16.085 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:16.070166+0000", 2024-04-19T03:03:16.085 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00013947800000000001 2024-04-19T03:03:16.085 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.085 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.085 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:16.085 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:16.070285+0000", 2024-04-19T03:03:16.086 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000119695 2024-04-19T03:03:16.086 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:16.086 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:16.086 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:16.086 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.086 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.086 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:201945 5.9 5:9e63f3fe:::benchmark_data_smithi096_19531_object88495:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T03:03:16.086 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:03:16.070057+0000", 2024-04-19T03:03:16.086 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0014204720000000001, 2024-04-19T03:03:16.086 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001704012, 2024-04-19T03:03:16.087 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:16.087 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:03:16.087 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:16.087 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:16.087 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:16.087 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 201945 2024-04-19T03:03:16.087 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.087 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:16.087 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.087 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:16.087 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:16.070057+0000", 2024-04-19T03:03:16.088 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:16.088 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.088 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.088 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:16.088 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:16.070057+0000", 2024-04-19T03:03:16.088 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:16.088 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.088 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.088 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:16.088 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:16.070056+0000", 2024-04-19T03:03:16.088 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:16.089 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.089 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.089 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:16.089 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:16.070060+0000", 2024-04-19T03:03:16.089 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7689999999999998e-06 2024-04-19T03:03:16.089 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.089 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.089 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:16.089 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:16.070068+0000", 2024-04-19T03:03:16.089 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.3499999999999997e-06 2024-04-19T03:03:16.089 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.089 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.089 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:16.090 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:16.070076+0000", 2024-04-19T03:03:16.090 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8949999999999998e-06 2024-04-19T03:03:16.090 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.090 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.090 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:16.090 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:16.070979+0000", 2024-04-19T03:03:16.090 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00090326999999999996 2024-04-19T03:03:16.090 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.090 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.090 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:16.090 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:16.071059+0000", 2024-04-19T03:03:16.090 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9738000000000001e-05 2024-04-19T03:03:16.090 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.091 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.091 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:03:16.091 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:16.071135+0000", 2024-04-19T03:03:16.091 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6087000000000005e-05 2024-04-19T03:03:16.091 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:16.091 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:16.091 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:16.091 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.091 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.091 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:201947 5.6 5:65f08da3:::benchmark_data_smithi096_19531_object88497:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T03:03:16.091 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:03:16.070096+0000", 2024-04-19T03:03:16.091 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0013807859999999999, 2024-04-19T03:03:16.091 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001750014, 2024-04-19T03:03:16.091 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:16.092 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-04-19T03:03:16.092 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:16.092 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:16.092 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:16.092 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 201947 2024-04-19T03:03:16.092 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.092 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:16.092 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.092 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:16.092 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:16.070096+0000", 2024-04-19T03:03:16.092 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:16.092 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.092 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.092 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:16.093 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:16.070096+0000", 2024-04-19T03:03:16.093 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:16.093 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.093 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.093 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:16.093 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:16.070095+0000", 2024-04-19T03:03:16.093 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:03:16.093 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.093 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.093 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:16.093 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:16.070105+0000", 2024-04-19T03:03:16.093 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.2480000000000002e-06 2024-04-19T03:03:16.093 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.094 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.094 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:16.094 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:16.070115+0000", 2024-04-19T03:03:16.094 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.8500000000000006e-06 2024-04-19T03:03:16.094 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.094 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.094 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:16.094 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:16.070122+0000", 2024-04-19T03:03:16.094 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.571e-06 2024-04-19T03:03:16.094 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.094 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.094 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:16.094 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:16.070173+0000", 2024-04-19T03:03:16.094 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1085999999999998e-05 2024-04-19T03:03:16.095 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.095 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.095 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:16.095 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:16.070314+0000", 2024-04-19T03:03:16.095 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00014118999999999999 2024-04-19T03:03:16.095 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:16.095 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:16.095 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:16.095 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:16.095 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-04-19T03:03:16.095 INFO:teuthology.orchestra.run.smithi144.stdout: "num_ops": 5 2024-04-19T03:03:16.095 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-04-19T03:03:16.096 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T03:03:16.144 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:03:16.142+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:03:16.223 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-04-19T03:03:16.223 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2024-04-19T03:03:16.223 INFO:teuthology.orchestra.run.smithi144.stdout: "complaint_time": 30, 2024-04-19T03:03:16.223 INFO:teuthology.orchestra.run.smithi144.stdout: "num_blocked_ops": 0 2024-04-19T03:03:16.223 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-04-19T03:03:16.239 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T03:03:16.245 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:03:16.242+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:03:16.345 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~47s 2024-04-19T03:03:16.346 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:03:16.344+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:03:16.372 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-04-19T03:03:16.372 INFO:teuthology.orchestra.run.smithi144.stdout: "size": 20, 2024-04-19T03:03:16.372 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 600, 2024-04-19T03:03:16.372 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [ 2024-04-19T03:03:16.372 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.373 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:78992 5.7 5:e6baa862:::benchmark_data_smithi096_19531_object78991:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-19T03:03:16.373 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:18.008888+0000", 2024-04-19T03:03:16.373 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 58.360573506999998, 2024-04-19T03:03:16.373 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.056375285999999997, 2024-04-19T03:03:16.373 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:16.373 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:16.373 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:16.373 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:16.373 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:16.373 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 78992 2024-04-19T03:03:16.373 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.373 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:16.373 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.373 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:16.374 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.008888+0000", 2024-04-19T03:03:16.374 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:16.374 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.374 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.374 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:16.374 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.008888+0000", 2024-04-19T03:03:16.374 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:16.374 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.374 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.374 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:16.374 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.008888+0000", 2024-04-19T03:03:16.374 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:16.374 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.375 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.375 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:16.375 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.008928+0000", 2024-04-19T03:03:16.375 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0361999999999997e-05 2024-04-19T03:03:16.375 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.375 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.375 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:16.375 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.008942+0000", 2024-04-19T03:03:16.375 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4365000000000001e-05 2024-04-19T03:03:16.375 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.375 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.375 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:16.375 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.008949+0000", 2024-04-19T03:03:16.375 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.212e-06 2024-04-19T03:03:16.376 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.376 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.376 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:16.376 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.012683+0000", 2024-04-19T03:03:16.376 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.003733934 2024-04-19T03:03:16.376 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.376 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.376 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:16.376 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.012798+0000", 2024-04-19T03:03:16.376 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00011574999999999999 2024-04-19T03:03:16.376 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.376 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.376 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:16.376 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.012896+0000", 2024-04-19T03:03:16.377 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.7848000000000002e-05 2024-04-19T03:03:16.377 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.377 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.377 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:03:16.377 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016423+0000", 2024-04-19T03:03:16.377 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0035270789999999998 2024-04-19T03:03:16.377 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.377 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.377 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:16.377 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.065098+0000", 2024-04-19T03:03:16.377 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.048674651999999999 2024-04-19T03:03:16.377 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.377 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.377 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:03:16.378 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.065193+0000", 2024-04-19T03:03:16.378 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.5087999999999995e-05 2024-04-19T03:03:16.378 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.378 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.378 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:16.378 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.065264+0000", 2024-04-19T03:03:16.378 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0666000000000004e-05 2024-04-19T03:03:16.378 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:16.378 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:16.378 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:16.378 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.378 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.378 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4755.0:79003 5.2 e40/39 5:4436e33f:::benchmark_data_smithi096_19531_object79002:head v 40'4935, mlcod=40'4932)", 2024-04-19T03:03:16.379 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:18.018102+0000", 2024-04-19T03:03:16.379 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 58.351359451, 2024-04-19T03:03:16.379 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.060023990999999999, 2024-04-19T03:03:16.379 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:16.379 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:16.379 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:16.379 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.379 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:16.379 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018102+0000", 2024-04-19T03:03:16.379 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:16.379 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.379 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.379 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:16.379 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018102+0000", 2024-04-19T03:03:16.380 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:16.380 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.380 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.380 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:16.380 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018102+0000", 2024-04-19T03:03:16.380 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:16.380 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.380 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.380 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:16.380 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018134+0000", 2024-04-19T03:03:16.380 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2722000000000003e-05 2024-04-19T03:03:16.380 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.380 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.380 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:16.381 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018145+0000", 2024-04-19T03:03:16.381 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0395e-05 2024-04-19T03:03:16.381 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.381 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.381 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:16.381 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018151+0000", 2024-04-19T03:03:16.381 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5300000000000002e-06 2024-04-19T03:03:16.381 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.381 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.381 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:16.381 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018489+0000", 2024-04-19T03:03:16.381 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00033731499999999998 2024-04-19T03:03:16.381 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.382 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.382 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:16.382 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018508+0000", 2024-04-19T03:03:16.382 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9775e-05 2024-04-19T03:03:16.382 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.382 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.382 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:03:16.382 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.078059+0000", 2024-04-19T03:03:16.382 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.059550171999999998 2024-04-19T03:03:16.382 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.382 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.382 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:16.382 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.078126+0000", 2024-04-19T03:03:16.382 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7773000000000003e-05 2024-04-19T03:03:16.383 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:16.383 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:16.383 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:16.383 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.383 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.383 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:86612 5.7 5:e32e3c49:::benchmark_data_smithi096_19531_object86611:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:16.383 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:22.633560+0000", 2024-04-19T03:03:16.383 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 53.735901791000003, 2024-04-19T03:03:16.383 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.19135289, 2024-04-19T03:03:16.383 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:16.383 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:16.383 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:16.383 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:16.383 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:16.384 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 86612 2024-04-19T03:03:16.384 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.384 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:16.384 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.384 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:16.384 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633560+0000", 2024-04-19T03:03:16.384 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:16.384 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.384 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.384 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:16.384 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633560+0000", 2024-04-19T03:03:16.384 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:16.384 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.385 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.385 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:16.385 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633558+0000", 2024-04-19T03:03:16.385 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999986 2024-04-19T03:03:16.385 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.385 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.385 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:16.385 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633609+0000", 2024-04-19T03:03:16.385 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0850999999999998e-05 2024-04-19T03:03:16.385 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.385 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.385 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:16.385 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633627+0000", 2024-04-19T03:03:16.386 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7951000000000001e-05 2024-04-19T03:03:16.386 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.386 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.386 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:16.386 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633635+0000", 2024-04-19T03:03:16.386 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2530000000000004e-06 2024-04-19T03:03:16.386 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.386 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.386 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:16.386 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633699+0000", 2024-04-19T03:03:16.386 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3901999999999999e-05 2024-04-19T03:03:16.386 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.386 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.387 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:16.387 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633992+0000", 2024-04-19T03:03:16.387 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00029283299999999999 2024-04-19T03:03:16.387 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.387 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.387 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:16.387 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.634223+0000", 2024-04-19T03:03:16.387 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00023084200000000001 2024-04-19T03:03:16.387 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.387 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.387 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:03:16.387 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.639085+0000", 2024-04-19T03:03:16.387 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0048624269999999999 2024-04-19T03:03:16.387 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.388 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.388 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:16.388 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.824635+0000", 2024-04-19T03:03:16.388 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.18554944700000001 2024-04-19T03:03:16.388 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.388 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.388 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:03:16.388 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.824793+0000", 2024-04-19T03:03:16.388 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000157959 2024-04-19T03:03:16.388 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.388 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.388 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:16.388 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.824913+0000", 2024-04-19T03:03:16.388 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000120093 2024-04-19T03:03:16.388 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:16.389 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:16.389 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:16.389 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.389 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.389 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:86625 5.7 5:e6d00488:::benchmark_data_smithi096_19531_object86624:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:16.389 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:22.643554+0000", 2024-04-19T03:03:16.389 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 53.725908025000003, 2024-04-19T03:03:16.389 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.18732841, 2024-04-19T03:03:16.389 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:16.389 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:16.389 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:16.389 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:16.389 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:16.389 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 86625 2024-04-19T03:03:16.390 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.390 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:16.390 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.390 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:16.390 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643554+0000", 2024-04-19T03:03:16.390 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:16.390 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.390 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.390 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:16.390 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643554+0000", 2024-04-19T03:03:16.390 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:16.390 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.390 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.391 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:16.391 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643552+0000", 2024-04-19T03:03:16.391 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999986 2024-04-19T03:03:16.391 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.391 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.391 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:16.391 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643588+0000", 2024-04-19T03:03:16.391 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5855999999999997e-05 2024-04-19T03:03:16.391 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.391 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.391 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:16.391 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643606+0000", 2024-04-19T03:03:16.391 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8226000000000001e-05 2024-04-19T03:03:16.391 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.392 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.392 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:16.392 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643618+0000", 2024-04-19T03:03:16.392 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1868000000000001e-05 2024-04-19T03:03:16.392 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.392 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.392 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:16.392 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643676+0000", 2024-04-19T03:03:16.392 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8153999999999999e-05 2024-04-19T03:03:16.392 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.392 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.392 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:16.392 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643905+0000", 2024-04-19T03:03:16.392 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00022847500000000001 2024-04-19T03:03:16.393 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.393 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.393 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:16.393 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.644150+0000", 2024-04-19T03:03:16.393 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00024531800000000001 2024-04-19T03:03:16.393 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.393 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.393 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:03:16.393 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.647407+0000", 2024-04-19T03:03:16.393 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0032563190000000001 2024-04-19T03:03:16.393 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.393 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.393 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:16.393 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.830721+0000", 2024-04-19T03:03:16.394 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.18331468300000001 2024-04-19T03:03:16.394 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.394 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.394 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:03:16.394 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.830813+0000", 2024-04-19T03:03:16.394 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.2205000000000002e-05 2024-04-19T03:03:16.394 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.394 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.394 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:16.394 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.830882+0000", 2024-04-19T03:03:16.394 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8819999999999995e-05 2024-04-19T03:03:16.394 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:16.394 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:16.395 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:16.395 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.395 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.395 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87063 5.7 5:e502e824:::benchmark_data_smithi096_19531_object87062:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:16.395 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.136067+0000", 2024-04-19T03:03:16.395 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 53.233395156, 2024-04-19T03:03:16.395 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.065521159999999995, 2024-04-19T03:03:16.395 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:16.395 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:16.395 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:16.395 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:16.395 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:16.395 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87063 2024-04-19T03:03:16.396 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.396 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:16.396 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.396 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:16.396 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.136067+0000", 2024-04-19T03:03:16.396 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:16.396 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.396 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.396 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:16.396 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.136067+0000", 2024-04-19T03:03:16.396 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:16.396 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.396 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.396 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:16.397 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.136066+0000", 2024-04-19T03:03:16.397 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:03:16.397 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.397 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.397 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:16.397 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.136154+0000", 2024-04-19T03:03:16.397 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.8256000000000003e-05 2024-04-19T03:03:16.397 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.397 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.397 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:16.397 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.136162+0000", 2024-04-19T03:03:16.397 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.5099999999999998e-06 2024-04-19T03:03:16.397 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.397 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.398 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:16.398 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.136171+0000", 2024-04-19T03:03:16.398 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2830000000000001e-06 2024-04-19T03:03:16.398 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.398 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.398 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:16.398 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.138421+0000", 2024-04-19T03:03:16.398 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0022506620000000001 2024-04-19T03:03:16.398 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.398 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.398 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:16.398 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.138560+0000", 2024-04-19T03:03:16.398 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000138446 2024-04-19T03:03:16.398 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.399 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.399 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:16.399 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.138689+0000", 2024-04-19T03:03:16.399 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00012950700000000001 2024-04-19T03:03:16.399 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.399 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.399 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:03:16.399 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.141517+0000", 2024-04-19T03:03:16.399 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0028280860000000001 2024-04-19T03:03:16.399 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.399 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.399 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:16.399 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.201350+0000", 2024-04-19T03:03:16.399 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.059832418999999998 2024-04-19T03:03:16.400 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.400 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.400 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:03:16.400 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.201485+0000", 2024-04-19T03:03:16.400 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000135597 2024-04-19T03:03:16.400 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.400 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.400 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:16.400 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.201588+0000", 2024-04-19T03:03:16.400 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00010247900000000001 2024-04-19T03:03:16.400 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:16.400 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:16.400 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:16.401 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.401 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.401 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87072 5.7 5:e3c7809a:::benchmark_data_smithi096_19531_object87071:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:16.401 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.144224+0000", 2024-04-19T03:03:16.401 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 53.225238132000001, 2024-04-19T03:03:16.401 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.058179555000000001, 2024-04-19T03:03:16.401 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:16.401 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:16.401 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:16.401 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:16.401 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:16.401 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87072 2024-04-19T03:03:16.401 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.401 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:16.402 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.402 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:16.402 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144224+0000", 2024-04-19T03:03:16.402 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:16.402 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.402 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.402 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:16.402 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144224+0000", 2024-04-19T03:03:16.402 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:16.402 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.402 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.402 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:16.402 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144223+0000", 2024-04-19T03:03:16.403 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:03:16.403 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.403 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.403 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:16.403 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144320+0000", 2024-04-19T03:03:16.403 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.7075000000000001e-05 2024-04-19T03:03:16.403 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.403 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.403 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:16.403 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144331+0000", 2024-04-19T03:03:16.403 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1342000000000001e-05 2024-04-19T03:03:16.403 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.403 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.403 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:16.404 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144337+0000", 2024-04-19T03:03:16.404 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8390000000000003e-06 2024-04-19T03:03:16.404 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.404 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.404 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:16.404 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144369+0000", 2024-04-19T03:03:16.404 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2079000000000002e-05 2024-04-19T03:03:16.404 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.404 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.404 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:16.404 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144464+0000", 2024-04-19T03:03:16.404 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.4623000000000005e-05 2024-04-19T03:03:16.404 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.404 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.405 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:16.405 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144553+0000", 2024-04-19T03:03:16.405 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9171000000000004e-05 2024-04-19T03:03:16.405 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.405 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.405 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:03:16.405 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.147018+0000", 2024-04-19T03:03:16.405 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0024648370000000001 2024-04-19T03:03:16.405 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.405 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.405 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:16.405 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.202270+0000", 2024-04-19T03:03:16.405 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.055252018 2024-04-19T03:03:16.406 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.406 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.406 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:03:16.406 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.202356+0000", 2024-04-19T03:03:16.406 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6648000000000001e-05 2024-04-19T03:03:16.406 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.406 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.406 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:16.406 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.202403+0000", 2024-04-19T03:03:16.406 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6956999999999998e-05 2024-04-19T03:03:16.406 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:16.406 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:16.406 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:16.407 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.407 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.407 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87123 5.6 5:6d1bc3b9:::benchmark_data_smithi096_19531_object87122:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:03:16.407 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249233+0000", 2024-04-19T03:03:16.407 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 53.120229100000003, 2024-04-19T03:03:16.407 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0291700720000001, 2024-04-19T03:03:16.407 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:16.407 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-04-19T03:03:16.407 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:16.407 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:16.407 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:16.407 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87123 2024-04-19T03:03:16.407 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.407 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:16.408 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.408 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:16.408 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249233+0000", 2024-04-19T03:03:16.408 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:16.408 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.408 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.408 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:16.408 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249233+0000", 2024-04-19T03:03:16.408 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:16.408 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.408 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.408 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:16.408 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249231+0000", 2024-04-19T03:03:16.409 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999986 2024-04-19T03:03:16.409 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.409 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.409 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:16.409 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249285+0000", 2024-04-19T03:03:16.409 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4005000000000002e-05 2024-04-19T03:03:16.409 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.409 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.409 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:16.409 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249300+0000", 2024-04-19T03:03:16.409 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4715999999999999e-05 2024-04-19T03:03:16.409 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.409 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.409 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:16.409 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249307+0000", 2024-04-19T03:03:16.410 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8399999999999997e-06 2024-04-19T03:03:16.410 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.410 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.410 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:16.410 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249366+0000", 2024-04-19T03:03:16.410 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9435999999999998e-05 2024-04-19T03:03:16.410 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.410 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.410 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op must wait for map", 2024-04-19T03:03:16.410 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249376+0000", 2024-04-19T03:03:16.410 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.4919999999999999e-06 2024-04-19T03:03:16.410 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.410 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.411 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:16.411 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263757+0000", 2024-04-19T03:03:16.411 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.014381461999999999 2024-04-19T03:03:16.411 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.411 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.411 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:03:16.411 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263875+0000", 2024-04-19T03:03:16.411 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000117166 2024-04-19T03:03:16.411 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.411 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.411 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:16.411 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.277136+0000", 2024-04-19T03:03:16.411 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.013261207 2024-04-19T03:03:16.411 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.411 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.412 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:16.412 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.278403+0000", 2024-04-19T03:03:16.412 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001267106 2024-04-19T03:03:16.412 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:16.412 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:16.412 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:16.412 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.412 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.412 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87128 5.6 5:6905c420:::benchmark_data_smithi096_19531_object87127:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:03:16.412 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249323+0000", 2024-04-19T03:03:16.412 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 53.120138353000002, 2024-04-19T03:03:16.412 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0292813249999999, 2024-04-19T03:03:16.412 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:16.412 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-04-19T03:03:16.413 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:16.413 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:16.413 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:16.413 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87128 2024-04-19T03:03:16.413 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.413 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:16.413 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.413 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:16.413 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249323+0000", 2024-04-19T03:03:16.413 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:16.413 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.413 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.413 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:16.413 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249323+0000", 2024-04-19T03:03:16.414 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:16.414 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.414 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.414 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:16.414 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249323+0000", 2024-04-19T03:03:16.414 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:16.414 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.414 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.414 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:16.414 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249385+0000", 2024-04-19T03:03:16.414 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1711999999999995e-05 2024-04-19T03:03:16.414 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.414 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.414 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:16.415 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249398+0000", 2024-04-19T03:03:16.415 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3022e-05 2024-04-19T03:03:16.415 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.415 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.415 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:16.415 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249402+0000", 2024-04-19T03:03:16.415 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4819999999999996e-06 2024-04-19T03:03:16.415 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.415 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.415 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:16.415 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249437+0000", 2024-04-19T03:03:16.415 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4702000000000001e-05 2024-04-19T03:03:16.415 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.415 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.416 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:03:16.416 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249442+0000", 2024-04-19T03:03:16.416 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8019999999999999e-06 2024-04-19T03:03:16.416 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.416 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.416 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:16.416 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263896+0000", 2024-04-19T03:03:16.416 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.014454679999999999 2024-04-19T03:03:16.416 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.416 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.416 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:03:16.416 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263900+0000", 2024-04-19T03:03:16.416 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9700000000000001e-06 2024-04-19T03:03:16.416 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.417 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.417 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:16.417 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.278557+0000", 2024-04-19T03:03:16.417 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0146566480000001 2024-04-19T03:03:16.417 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.417 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.417 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:16.417 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.278605+0000", 2024-04-19T03:03:16.417 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7735999999999998e-05 2024-04-19T03:03:16.417 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:16.417 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:16.417 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:16.417 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.417 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.418 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87130 5.3 5:c8c2d67b:::benchmark_data_smithi096_19531_object87129:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:03:16.418 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249418+0000", 2024-04-19T03:03:16.418 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 53.120043641999999, 2024-04-19T03:03:16.418 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.025414182, 2024-04-19T03:03:16.418 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:16.418 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-04-19T03:03:16.418 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:16.418 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:16.418 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:16.418 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87130 2024-04-19T03:03:16.418 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.418 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:16.418 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.419 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:16.419 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249418+0000", 2024-04-19T03:03:16.419 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:16.419 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.419 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.419 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:16.419 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249418+0000", 2024-04-19T03:03:16.419 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:16.419 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.419 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.419 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:16.419 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249409+0000", 2024-04-19T03:03:16.419 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999905 2024-04-19T03:03:16.419 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.420 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.420 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:16.420 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249464+0000", 2024-04-19T03:03:16.420 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5381999999999999e-05 2024-04-19T03:03:16.420 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.420 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.420 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:16.420 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249471+0000", 2024-04-19T03:03:16.420 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2609999999999996e-06 2024-04-19T03:03:16.420 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.420 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.420 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:16.420 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249475+0000", 2024-04-19T03:03:16.421 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2839999999999998e-06 2024-04-19T03:03:16.421 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.421 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.421 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:16.421 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249535+0000", 2024-04-19T03:03:16.421 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0545999999999999e-05 2024-04-19T03:03:16.421 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.421 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.421 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op must wait for map", 2024-04-19T03:03:16.421 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249540+0000", 2024-04-19T03:03:16.421 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2859999999999999e-06 2024-04-19T03:03:16.421 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.421 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.421 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:16.422 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263450+0000", 2024-04-19T03:03:16.422 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.013909585 2024-04-19T03:03:16.422 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.422 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.422 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:03:16.422 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263458+0000", 2024-04-19T03:03:16.422 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8089999999999993e-06 2024-04-19T03:03:16.422 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.422 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.422 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:16.422 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.273193+0000", 2024-04-19T03:03:16.422 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0097351379999999 2024-04-19T03:03:16.422 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.422 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.423 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:16.423 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.274832+0000", 2024-04-19T03:03:16.423 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0016394789999999999 2024-04-19T03:03:16.423 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:16.423 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:16.423 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:16.423 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.423 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.423 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87131 5.1 5:83756d55:::benchmark_data_smithi096_19531_object87130:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:03:16.423 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249491+0000", 2024-04-19T03:03:16.423 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 53.119970995000003, 2024-04-19T03:03:16.423 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0191489520000001, 2024-04-19T03:03:16.423 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:16.423 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-04-19T03:03:16.424 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:16.424 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:16.424 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:16.424 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87131 2024-04-19T03:03:16.424 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.424 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:16.424 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.424 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:16.424 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249491+0000", 2024-04-19T03:03:16.424 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:16.424 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.424 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.424 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:16.424 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249491+0000", 2024-04-19T03:03:16.425 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:16.425 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.425 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.425 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:16.425 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249491+0000", 2024-04-19T03:03:16.425 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:16.425 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.425 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.425 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:16.425 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249530+0000", 2024-04-19T03:03:16.425 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9589000000000003e-05 2024-04-19T03:03:16.425 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.425 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.425 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:16.426 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249544+0000", 2024-04-19T03:03:16.426 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4158000000000001e-05 2024-04-19T03:03:16.426 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.426 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.426 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:16.426 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249549+0000", 2024-04-19T03:03:16.426 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6809999999999997e-06 2024-04-19T03:03:16.426 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.426 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.426 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:16.426 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249592+0000", 2024-04-19T03:03:16.426 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3285999999999999e-05 2024-04-19T03:03:16.426 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.427 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.427 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op must wait for map", 2024-04-19T03:03:16.427 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249598+0000", 2024-04-19T03:03:16.427 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8329999999999999e-06 2024-04-19T03:03:16.427 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.427 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.427 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:16.427 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263331+0000", 2024-04-19T03:03:16.427 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.013733093 2024-04-19T03:03:16.427 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.427 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.427 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:03:16.427 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263343+0000", 2024-04-19T03:03:16.428 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.189e-05 2024-04-19T03:03:16.428 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.428 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.428 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:16.428 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.268541+0000", 2024-04-19T03:03:16.428 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0051983440000001 2024-04-19T03:03:16.428 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.428 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.428 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:16.428 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.268640+0000", 2024-04-19T03:03:16.428 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.8387999999999994e-05 2024-04-19T03:03:16.428 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:16.428 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:16.428 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:16.429 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.429 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.429 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87132 5.c 5:3e18b732:::benchmark_data_smithi096_19531_object87131:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:03:16.429 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249558+0000", 2024-04-19T03:03:16.429 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 53.119904093999999, 2024-04-19T03:03:16.429 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0241198380000001, 2024-04-19T03:03:16.429 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:16.429 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-04-19T03:03:16.429 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:16.429 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:16.429 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:16.429 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87132 2024-04-19T03:03:16.429 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.430 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:16.430 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.430 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:16.430 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249558+0000", 2024-04-19T03:03:16.430 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:16.430 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.430 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.430 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:16.430 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249558+0000", 2024-04-19T03:03:16.430 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:16.430 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.430 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.430 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:16.431 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249557+0000", 2024-04-19T03:03:16.431 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:16.431 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.431 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.431 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:16.431 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249625+0000", 2024-04-19T03:03:16.431 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7200999999999996e-05 2024-04-19T03:03:16.431 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.431 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.431 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:16.431 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249646+0000", 2024-04-19T03:03:16.431 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1053e-05 2024-04-19T03:03:16.431 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.431 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.432 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:16.432 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249650+0000", 2024-04-19T03:03:16.432 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2719999999999999e-06 2024-04-19T03:03:16.432 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.432 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.432 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:16.432 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249686+0000", 2024-04-19T03:03:16.432 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6430000000000002e-05 2024-04-19T03:03:16.432 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.432 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.432 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op must wait for map", 2024-04-19T03:03:16.432 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249690+0000", 2024-04-19T03:03:16.432 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.765e-06 2024-04-19T03:03:16.432 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.432 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.432 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:16.433 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261157+0000", 2024-04-19T03:03:16.433 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011467247999999999 2024-04-19T03:03:16.433 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.433 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.433 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:03:16.433 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261170+0000", 2024-04-19T03:03:16.433 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2833000000000001e-05 2024-04-19T03:03:16.433 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.433 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.433 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:16.433 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.272119+0000", 2024-04-19T03:03:16.433 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.010949313 2024-04-19T03:03:16.433 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.433 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.433 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:16.434 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.273678+0000", 2024-04-19T03:03:16.434 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0015581550000000001 2024-04-19T03:03:16.434 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:16.434 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:16.434 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:16.434 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.434 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.434 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87133 5.c 5:3f772a62:::benchmark_data_smithi096_19531_object87132:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:03:16.434 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249657+0000", 2024-04-19T03:03:16.434 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 53.119804715000001, 2024-04-19T03:03:16.434 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0242819409999999, 2024-04-19T03:03:16.434 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:16.434 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-04-19T03:03:16.435 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:16.435 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:16.435 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:16.435 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87133 2024-04-19T03:03:16.435 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.435 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:16.435 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.435 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:16.435 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249657+0000", 2024-04-19T03:03:16.435 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:16.435 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.435 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.435 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:16.436 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249657+0000", 2024-04-19T03:03:16.436 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:16.436 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.436 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.436 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:16.436 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249657+0000", 2024-04-19T03:03:16.436 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:16.436 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.436 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.436 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:16.436 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249690+0000", 2024-04-19T03:03:16.436 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3343000000000002e-05 2024-04-19T03:03:16.436 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.437 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.437 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:16.437 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249695+0000", 2024-04-19T03:03:16.437 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8600000000000001e-06 2024-04-19T03:03:16.437 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.437 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.437 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:16.437 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249698+0000", 2024-04-19T03:03:16.437 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.1700000000000001e-06 2024-04-19T03:03:16.437 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.437 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.437 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:16.437 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249741+0000", 2024-04-19T03:03:16.437 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2849999999999998e-05 2024-04-19T03:03:16.438 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.438 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.438 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:03:16.438 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249746+0000", 2024-04-19T03:03:16.438 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1019999999999996e-06 2024-04-19T03:03:16.438 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.438 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.438 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:16.438 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261209+0000", 2024-04-19T03:03:16.438 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011462447000000001 2024-04-19T03:03:16.438 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.438 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.438 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:03:16.439 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261216+0000", 2024-04-19T03:03:16.439 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8520000000000004e-06 2024-04-19T03:03:16.439 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.439 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.439 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:16.439 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.273872+0000", 2024-04-19T03:03:16.439 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0126558000000001 2024-04-19T03:03:16.439 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.439 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.439 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:16.439 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.273939+0000", 2024-04-19T03:03:16.439 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6822000000000005e-05 2024-04-19T03:03:16.439 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:16.439 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:16.440 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:16.440 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.440 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.440 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87134 5.5 5:a56c478f:::benchmark_data_smithi096_19531_object87133:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:03:16.440 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249708+0000", 2024-04-19T03:03:16.440 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 53.119753791000001, 2024-04-19T03:03:16.440 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0214677299999999, 2024-04-19T03:03:16.440 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:16.440 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-04-19T03:03:16.440 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:16.440 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:16.440 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:16.440 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87134 2024-04-19T03:03:16.440 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.441 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:16.441 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.441 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:16.441 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249708+0000", 2024-04-19T03:03:16.441 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:16.441 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.441 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.441 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:16.441 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249708+0000", 2024-04-19T03:03:16.441 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:16.441 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.441 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.441 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:16.441 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249706+0000", 2024-04-19T03:03:16.442 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999976 2024-04-19T03:03:16.442 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.442 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.442 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:16.442 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249740+0000", 2024-04-19T03:03:16.442 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4458000000000001e-05 2024-04-19T03:03:16.442 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.442 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.442 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:16.442 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249745+0000", 2024-04-19T03:03:16.442 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5020000000000003e-06 2024-04-19T03:03:16.442 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.442 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.442 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:16.443 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249748+0000", 2024-04-19T03:03:16.443 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2499999999999998e-06 2024-04-19T03:03:16.443 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.443 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.443 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:16.443 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249778+0000", 2024-04-19T03:03:16.443 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.006e-05 2024-04-19T03:03:16.443 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.443 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.443 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op must wait for map", 2024-04-19T03:03:16.443 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249782+0000", 2024-04-19T03:03:16.443 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2910000000000001e-06 2024-04-19T03:03:16.443 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.443 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.443 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:16.444 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261666+0000", 2024-04-19T03:03:16.444 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011883471 2024-04-19T03:03:16.444 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.444 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.444 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:03:16.444 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261674+0000", 2024-04-19T03:03:16.444 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6479999999999992e-06 2024-04-19T03:03:16.444 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.444 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.444 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:16.444 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.269323+0000", 2024-04-19T03:03:16.444 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.00764867 2024-04-19T03:03:16.444 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.444 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.444 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:16.445 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.271176+0000", 2024-04-19T03:03:16.445 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001852844 2024-04-19T03:03:16.445 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:16.445 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:16.445 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:16.445 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.445 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.445 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87137 5.c 5:30708c68:::benchmark_data_smithi096_19531_object87136:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:03:16.445 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249756+0000", 2024-04-19T03:03:16.445 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 53.119706084999997, 2024-04-19T03:03:16.445 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.033331752, 2024-04-19T03:03:16.445 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:16.445 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:16.446 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:16.446 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:16.446 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:16.446 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87137 2024-04-19T03:03:16.446 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.446 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:16.446 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.446 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:16.446 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249756+0000", 2024-04-19T03:03:16.446 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:16.446 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.446 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.446 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:16.447 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249756+0000", 2024-04-19T03:03:16.447 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:16.447 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.447 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.447 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:16.447 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249755+0000", 2024-04-19T03:03:16.447 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:16.447 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.447 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.447 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:16.447 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249777+0000", 2024-04-19T03:03:16.447 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1420000000000002e-05 2024-04-19T03:03:16.447 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.447 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.448 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:16.448 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249781+0000", 2024-04-19T03:03:16.448 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0609999999999997e-06 2024-04-19T03:03:16.448 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.448 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.448 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:16.448 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249787+0000", 2024-04-19T03:03:16.448 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.02e-06 2024-04-19T03:03:16.448 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.448 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.448 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:16.448 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249818+0000", 2024-04-19T03:03:16.448 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0947e-05 2024-04-19T03:03:16.449 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.449 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.449 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:03:16.449 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249821+0000", 2024-04-19T03:03:16.449 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.117e-06 2024-04-19T03:03:16.449 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.449 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.449 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:16.449 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261243+0000", 2024-04-19T03:03:16.449 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011421875999999999 2024-04-19T03:03:16.449 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.449 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.449 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:03:16.450 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261251+0000", 2024-04-19T03:03:16.450 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6120000000000001e-06 2024-04-19T03:03:16.450 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.450 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.450 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:16.450 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.274050+0000", 2024-04-19T03:03:16.450 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.012799405 2024-04-19T03:03:16.450 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.450 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.450 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:16.450 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.274529+0000", 2024-04-19T03:03:16.450 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00047867100000000001 2024-04-19T03:03:16.450 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.451 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.451 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:03:16.451 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.282972+0000", 2024-04-19T03:03:16.451 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0084436900000000002 2024-04-19T03:03:16.451 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.451 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.451 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:03:16.451 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.283022+0000", 2024-04-19T03:03:16.451 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9339000000000003e-05 2024-04-19T03:03:16.451 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.451 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.451 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:16.451 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.283088+0000", 2024-04-19T03:03:16.451 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5877999999999995e-05 2024-04-19T03:03:16.452 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:16.452 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:16.452 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:16.452 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.452 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.452 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:158376 5.9 5:9e73c076:::benchmark_data_smithi096_19531_object44926:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-19T03:03:16.452 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:58.126227+0000", 2024-04-19T03:03:16.452 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 18.243234352000002, 2024-04-19T03:03:16.452 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.069738668000000004, 2024-04-19T03:03:16.452 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:16.452 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:16.452 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:16.452 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:16.453 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:16.453 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 158376 2024-04-19T03:03:16.453 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.453 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:16.453 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.453 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:16.453 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.126227+0000", 2024-04-19T03:03:16.453 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:16.453 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.453 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.453 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:16.453 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.126227+0000", 2024-04-19T03:03:16.453 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:16.453 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.453 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.454 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:16.454 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.126226+0000", 2024-04-19T03:03:16.454 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:03:16.454 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.454 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.454 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:16.454 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.126236+0000", 2024-04-19T03:03:16.454 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.4199999999999996e-06 2024-04-19T03:03:16.454 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.454 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.454 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:16.454 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.126243+0000", 2024-04-19T03:03:16.454 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.199e-06 2024-04-19T03:03:16.455 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.455 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.455 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:16.455 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.126248+0000", 2024-04-19T03:03:16.455 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1320000000000002e-06 2024-04-19T03:03:16.455 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.455 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.455 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:16.455 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.126286+0000", 2024-04-19T03:03:16.455 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7401000000000003e-05 2024-04-19T03:03:16.455 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.455 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.455 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:16.456 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.126368+0000", 2024-04-19T03:03:16.456 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2113999999999993e-05 2024-04-19T03:03:16.456 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.456 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.456 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:03:16.456 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.126438+0000", 2024-04-19T03:03:16.456 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0337000000000001e-05 2024-04-19T03:03:16.456 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.456 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.456 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:03:16.456 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.130816+0000", 2024-04-19T03:03:16.456 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0043778330000000002 2024-04-19T03:03:16.456 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.456 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.457 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:16.457 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.195830+0000", 2024-04-19T03:03:16.457 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.065013933999999995 2024-04-19T03:03:16.457 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.457 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.457 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:03:16.457 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.195907+0000", 2024-04-19T03:03:16.457 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7397000000000005e-05 2024-04-19T03:03:16.457 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.457 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.457 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:16.457 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.195966+0000", 2024-04-19T03:03:16.457 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8906999999999997e-05 2024-04-19T03:03:16.458 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:16.458 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:16.458 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:16.458 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.458 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.458 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:158381 5.9 5:94dcd4a7:::benchmark_data_smithi096_19531_object44931:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-19T03:03:16.458 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:58.128712+0000", 2024-04-19T03:03:16.458 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 18.240749909000002, 2024-04-19T03:03:16.458 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.067497527000000002, 2024-04-19T03:03:16.458 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:16.458 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:16.458 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:16.458 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:16.459 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:16.459 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 158381 2024-04-19T03:03:16.459 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.459 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:16.459 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.459 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:16.459 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.128712+0000", 2024-04-19T03:03:16.459 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:16.459 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.459 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.459 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:16.459 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.128712+0000", 2024-04-19T03:03:16.459 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:16.459 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.460 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.460 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:16.460 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.128711+0000", 2024-04-19T03:03:16.460 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:03:16.460 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.460 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.460 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:16.460 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.128716+0000", 2024-04-19T03:03:16.460 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0610000000000003e-06 2024-04-19T03:03:16.460 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.460 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.460 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:16.460 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.128724+0000", 2024-04-19T03:03:16.460 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0120000000000005e-06 2024-04-19T03:03:16.461 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.461 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.461 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:16.461 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.128729+0000", 2024-04-19T03:03:16.461 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8899999999999998e-06 2024-04-19T03:03:16.461 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.461 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.461 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:16.461 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.128778+0000", 2024-04-19T03:03:16.461 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9110000000000002e-05 2024-04-19T03:03:16.461 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.461 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.461 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:16.461 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.128903+0000", 2024-04-19T03:03:16.462 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00012506799999999999 2024-04-19T03:03:16.462 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.462 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.462 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:03:16.462 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.129022+0000", 2024-04-19T03:03:16.462 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00011923599999999999 2024-04-19T03:03:16.462 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.462 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.462 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:03:16.462 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.132294+0000", 2024-04-19T03:03:16.462 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.003271244 2024-04-19T03:03:16.462 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.462 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.463 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:16.463 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.196045+0000", 2024-04-19T03:03:16.463 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.063751206000000005 2024-04-19T03:03:16.463 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.463 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.463 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:03:16.463 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.196133+0000", 2024-04-19T03:03:16.463 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.8213000000000004e-05 2024-04-19T03:03:16.463 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.463 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.463 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:16.463 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.196209+0000", 2024-04-19T03:03:16.463 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6335999999999996e-05 2024-04-19T03:03:16.463 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:16.464 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:16.464 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:16.464 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.464 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.464 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:158385 5.9 5:950ec749:::benchmark_data_smithi096_19531_object44935:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-19T03:03:16.464 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:58.129756+0000", 2024-04-19T03:03:16.464 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 18.239705977, 2024-04-19T03:03:16.464 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.068998382999999996, 2024-04-19T03:03:16.464 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:16.464 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:16.464 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:16.464 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:16.464 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:16.464 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 158385 2024-04-19T03:03:16.464 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.465 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:16.465 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.465 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:16.465 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.129756+0000", 2024-04-19T03:03:16.465 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:16.465 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.465 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.465 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:16.465 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.129756+0000", 2024-04-19T03:03:16.465 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:16.465 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.465 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.465 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:16.465 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.129755+0000", 2024-04-19T03:03:16.466 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:03:16.466 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.466 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.466 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:16.466 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.129760+0000", 2024-04-19T03:03:16.466 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6030000000000004e-06 2024-04-19T03:03:16.466 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.466 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.466 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:16.466 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.129774+0000", 2024-04-19T03:03:16.466 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3131e-05 2024-04-19T03:03:16.466 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.466 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.467 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:16.467 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.129781+0000", 2024-04-19T03:03:16.467 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4030000000000001e-06 2024-04-19T03:03:16.467 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.467 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.467 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:16.467 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.130837+0000", 2024-04-19T03:03:16.467 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00105569 2024-04-19T03:03:16.467 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.467 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.467 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:16.467 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.130917+0000", 2024-04-19T03:03:16.467 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9929e-05 2024-04-19T03:03:16.468 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.468 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.468 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:03:16.468 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.130973+0000", 2024-04-19T03:03:16.468 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.664e-05 2024-04-19T03:03:16.468 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.468 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.468 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:03:16.468 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.132340+0000", 2024-04-19T03:03:16.468 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001366321 2024-04-19T03:03:16.468 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.468 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.468 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:16.468 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.198637+0000", 2024-04-19T03:03:16.469 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.066296888999999998 2024-04-19T03:03:16.469 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.469 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.469 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:03:16.469 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.198704+0000", 2024-04-19T03:03:16.469 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7333000000000001e-05 2024-04-19T03:03:16.469 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.469 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.469 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:16.469 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.198754+0000", 2024-04-19T03:03:16.469 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0421999999999999e-05 2024-04-19T03:03:16.469 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:16.469 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:16.470 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:16.470 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.470 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.470 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:158387 5.9 5:9e96f619:::benchmark_data_smithi096_19531_object44937:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-19T03:03:16.470 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:58.132457+0000", 2024-04-19T03:03:16.470 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 18.237004413000001, 2024-04-19T03:03:16.470 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.066858091999999994, 2024-04-19T03:03:16.470 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:16.470 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:16.470 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:16.470 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:16.470 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:16.471 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 158387 2024-04-19T03:03:16.471 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.471 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:16.471 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.471 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:16.471 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.132457+0000", 2024-04-19T03:03:16.471 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:16.471 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.471 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.471 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:16.471 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.132457+0000", 2024-04-19T03:03:16.471 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:16.471 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.471 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.472 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:16.472 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.132457+0000", 2024-04-19T03:03:16.472 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:16.472 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.472 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.472 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:16.472 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.132460+0000", 2024-04-19T03:03:16.472 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.1949999999999999e-06 2024-04-19T03:03:16.472 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.472 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.472 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:16.472 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.132468+0000", 2024-04-19T03:03:16.472 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.1599999999999998e-06 2024-04-19T03:03:16.472 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.473 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.473 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:16.473 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.132473+0000", 2024-04-19T03:03:16.473 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9259999999999999e-06 2024-04-19T03:03:16.473 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.473 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.473 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:16.473 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.132504+0000", 2024-04-19T03:03:16.473 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0914000000000003e-05 2024-04-19T03:03:16.473 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.473 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.473 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:16.473 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.132646+0000", 2024-04-19T03:03:16.474 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00014214300000000001 2024-04-19T03:03:16.474 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.474 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.474 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:03:16.474 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.132741+0000", 2024-04-19T03:03:16.474 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.4344000000000003e-05 2024-04-19T03:03:16.474 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.474 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.474 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:03:16.474 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.135774+0000", 2024-04-19T03:03:16.474 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0030334960000000001 2024-04-19T03:03:16.474 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.474 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.475 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:16.475 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.199240+0000", 2024-04-19T03:03:16.475 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.063465695000000003 2024-04-19T03:03:16.475 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.475 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.475 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:03:16.475 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.199272+0000", 2024-04-19T03:03:16.475 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2412000000000001e-05 2024-04-19T03:03:16.475 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.475 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.475 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:16.475 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.199316+0000", 2024-04-19T03:03:16.475 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3275000000000002e-05 2024-04-19T03:03:16.475 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:16.476 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:16.476 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:16.476 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.476 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.476 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:158392 5.f 5:f462725f:::benchmark_data_smithi096_19531_object44942:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-19T03:03:16.476 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:58.135703+0000", 2024-04-19T03:03:16.476 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 18.233758633000001, 2024-04-19T03:03:16.476 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.063132879000000003, 2024-04-19T03:03:16.476 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:16.477 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:16.477 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:16.477 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:16.477 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:16.477 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 158392 2024-04-19T03:03:16.477 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.477 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:16.477 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.477 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:16.477 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.135703+0000", 2024-04-19T03:03:16.477 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:16.477 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.477 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.478 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:16.478 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.135703+0000", 2024-04-19T03:03:16.478 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:16.478 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.478 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.478 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:16.478 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.135702+0000", 2024-04-19T03:03:16.478 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:03:16.478 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.478 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.478 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:16.478 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.135708+0000", 2024-04-19T03:03:16.478 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8270000000000003e-06 2024-04-19T03:03:16.479 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.479 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.479 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:16.479 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.135720+0000", 2024-04-19T03:03:16.479 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2057e-05 2024-04-19T03:03:16.479 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.479 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.479 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:16.479 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.135727+0000", 2024-04-19T03:03:16.479 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8090000000000004e-06 2024-04-19T03:03:16.479 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.479 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.479 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:16.479 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.135768+0000", 2024-04-19T03:03:16.480 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1548999999999998e-05 2024-04-19T03:03:16.480 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.480 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.480 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:16.480 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.135853+0000", 2024-04-19T03:03:16.480 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4845000000000005e-05 2024-04-19T03:03:16.480 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.480 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.480 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:03:16.480 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.135934+0000", 2024-04-19T03:03:16.480 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0315000000000006e-05 2024-04-19T03:03:16.480 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.480 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.480 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:03:16.480 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.138685+0000", 2024-04-19T03:03:16.481 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.002751042 2024-04-19T03:03:16.481 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.481 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.481 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:16.481 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.198747+0000", 2024-04-19T03:03:16.481 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.060062675000000003 2024-04-19T03:03:16.481 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.481 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.481 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:03:16.481 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.198802+0000", 2024-04-19T03:03:16.481 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4469000000000003e-05 2024-04-19T03:03:16.481 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.481 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.481 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:16.482 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.198836+0000", 2024-04-19T03:03:16.482 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4272e-05 2024-04-19T03:03:16.482 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:16.482 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:16.482 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:16.482 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.482 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.482 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:158397 5.d 5:b5d962e9:::benchmark_data_smithi096_19531_object44947:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-19T03:03:16.482 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:58.138717+0000", 2024-04-19T03:03:16.482 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 18.230744690000002, 2024-04-19T03:03:16.482 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.057191467000000003, 2024-04-19T03:03:16.482 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:16.482 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:16.483 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:16.483 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:16.483 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:16.483 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 158397 2024-04-19T03:03:16.483 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.483 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:16.483 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.483 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:16.483 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.138717+0000", 2024-04-19T03:03:16.483 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:16.483 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.483 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.483 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:16.483 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.138717+0000", 2024-04-19T03:03:16.483 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:16.484 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.484 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.484 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:16.484 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.138716+0000", 2024-04-19T03:03:16.484 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999986 2024-04-19T03:03:16.484 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.484 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.484 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:16.484 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.138722+0000", 2024-04-19T03:03:16.484 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1709999999999999e-06 2024-04-19T03:03:16.484 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.484 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.484 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:16.484 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.138731+0000", 2024-04-19T03:03:16.484 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.0310000000000004e-06 2024-04-19T03:03:16.484 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.485 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.485 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:16.485 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.138738+0000", 2024-04-19T03:03:16.485 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8430000000000004e-06 2024-04-19T03:03:16.485 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.485 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.485 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:16.485 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.138789+0000", 2024-04-19T03:03:16.485 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0623e-05 2024-04-19T03:03:16.485 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.485 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.485 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:16.485 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.138945+0000", 2024-04-19T03:03:16.485 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00015671899999999999 2024-04-19T03:03:16.485 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.486 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.486 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:03:16.486 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.139079+0000", 2024-04-19T03:03:16.486 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00013380099999999999 2024-04-19T03:03:16.486 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.486 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.486 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:03:16.486 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.141715+0000", 2024-04-19T03:03:16.486 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0026362849999999999 2024-04-19T03:03:16.486 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.486 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.486 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:16.486 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.195784+0000", 2024-04-19T03:03:16.487 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.054068353 2024-04-19T03:03:16.487 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.487 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.487 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:03:16.487 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.195852+0000", 2024-04-19T03:03:16.487 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8121999999999996e-05 2024-04-19T03:03:16.487 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:16.487 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:16.487 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:16.487 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.195909+0000", 2024-04-19T03:03:16.487 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6737999999999998e-05 2024-04-19T03:03:16.487 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:16.487 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:16.487 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:16.487 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:16.488 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:16.488 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-04-19T03:03:16.489 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T03:03:16.490 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:03:16.486+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:03:16.589 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:03:16.586+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:03:16.612 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-19T03:03:16.612 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-04-19T03:03:16.613 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.613 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4755.0:203283 5.d e62/49 5:b1b00eb6:::benchmark_data_smithi096_19531_object89833:head v 62'12850, mlcod=62'12847)", 2024-04-19T03:03:16.613 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:03:16.606186+0000", 2024-04-19T03:03:16.613 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0056585979999999999, 2024-04-19T03:03:16.613 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0056854310000000003, 2024-04-19T03:03:16.613 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:16.613 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-19T03:03:16.613 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:16.613 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.613 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:16.613 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:16.606186+0000", 2024-04-19T03:03:16.613 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:16.613 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.614 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.614 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:16.614 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:16.606186+0000", 2024-04-19T03:03:16.614 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:16.614 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.614 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.614 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:16.614 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:16.606185+0000", 2024-04-19T03:03:16.614 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:16.614 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.614 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.614 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:16.614 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:16.606194+0000", 2024-04-19T03:03:16.615 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.0739999999999999e-06 2024-04-19T03:03:16.615 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.615 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.615 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:16.615 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:16.606206+0000", 2024-04-19T03:03:16.615 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2018000000000001e-05 2024-04-19T03:03:16.615 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.615 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.615 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:16.615 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:16.606213+0000", 2024-04-19T03:03:16.615 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.314e-06 2024-04-19T03:03:16.615 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.615 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.615 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:16.616 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:16.606265+0000", 2024-04-19T03:03:16.616 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.2816999999999999e-05 2024-04-19T03:03:16.616 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.616 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.616 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:16.616 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:16.606291+0000", 2024-04-19T03:03:16.616 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5228999999999998e-05 2024-04-19T03:03:16.616 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:16.616 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:16.616 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:16.616 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.616 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.616 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:203284 5.0 5:04388fec:::benchmark_data_smithi096_19531_object89834:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T03:03:16.617 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:03:16.607702+0000", 2024-04-19T03:03:16.617 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0041422000000000004, 2024-04-19T03:03:16.617 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.004253995, 2024-04-19T03:03:16.617 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:16.617 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-19T03:03:16.617 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:16.617 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:16.617 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:16.617 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 203284 2024-04-19T03:03:16.617 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.617 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:16.617 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.617 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:16.618 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:16.607702+0000", 2024-04-19T03:03:16.618 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:16.618 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.618 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.618 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:16.618 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:16.607702+0000", 2024-04-19T03:03:16.618 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:16.618 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.618 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.618 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:16.618 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:16.607701+0000", 2024-04-19T03:03:16.618 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:03:16.618 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.618 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.619 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:16.619 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:16.607707+0000", 2024-04-19T03:03:16.619 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3909999999999997e-06 2024-04-19T03:03:16.619 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.619 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.619 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:16.619 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:16.607726+0000", 2024-04-19T03:03:16.619 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8858000000000001e-05 2024-04-19T03:03:16.619 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.619 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.619 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:16.619 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:16.607736+0000", 2024-04-19T03:03:16.619 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0550000000000001e-05 2024-04-19T03:03:16.620 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.620 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.620 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:16.620 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:16.608951+0000", 2024-04-19T03:03:16.620 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001214775 2024-04-19T03:03:16.620 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.620 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.620 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:16.620 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:16.609036+0000", 2024-04-19T03:03:16.620 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.5523000000000001e-05 2024-04-19T03:03:16.620 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:16.620 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:16.620 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:16.620 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.620 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.621 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:203288 5.a 5:5dee5fe8:::benchmark_data_smithi096_19531_object89838:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T03:03:16.621 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:03:16.608635+0000", 2024-04-19T03:03:16.621 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0032094839999999999, 2024-04-19T03:03:16.621 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0034100879999999999, 2024-04-19T03:03:16.621 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:16.621 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-19T03:03:16.621 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:16.621 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:16.621 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:16.621 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 203288 2024-04-19T03:03:16.621 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.621 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:16.621 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.621 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:16.622 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:16.608635+0000", 2024-04-19T03:03:16.622 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:16.622 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.622 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.622 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:16.622 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:16.608635+0000", 2024-04-19T03:03:16.622 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:16.622 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.622 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.622 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:16.622 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:16.608634+0000", 2024-04-19T03:03:16.622 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:03:16.622 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.622 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.623 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:16.623 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:16.608639+0000", 2024-04-19T03:03:16.623 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9119999999999997e-06 2024-04-19T03:03:16.623 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.623 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.623 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:16.623 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:16.608649+0000", 2024-04-19T03:03:16.623 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0121e-05 2024-04-19T03:03:16.623 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.623 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.623 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:16.623 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:16.608655+0000", 2024-04-19T03:03:16.623 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7030000000000003e-06 2024-04-19T03:03:16.623 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.623 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.624 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:16.624 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:16.608691+0000", 2024-04-19T03:03:16.624 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6368999999999997e-05 2024-04-19T03:03:16.624 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.624 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.624 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:16.624 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:16.608799+0000", 2024-04-19T03:03:16.624 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000107425 2024-04-19T03:03:16.624 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:16.624 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:16.624 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:16.624 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.624 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.624 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4755.0:203285 5.9 e62/22 5:9d3fa723:::benchmark_data_smithi096_19531_object89835:head v 62'12455, mlcod=62'12452)", 2024-04-19T03:03:16.624 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:03:16.608900+0000", 2024-04-19T03:03:16.625 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0029442299999999999, 2024-04-19T03:03:16.625 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.003226507, 2024-04-19T03:03:16.625 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:16.625 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-19T03:03:16.625 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:16.625 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.625 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:16.625 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:16.608900+0000", 2024-04-19T03:03:16.625 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:16.625 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.625 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.625 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:16.625 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:16.608900+0000", 2024-04-19T03:03:16.625 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:16.625 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.626 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.626 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:16.626 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:16.608899+0000", 2024-04-19T03:03:16.626 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:03:16.626 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.626 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.626 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:16.626 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:16.608907+0000", 2024-04-19T03:03:16.626 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3170000000000004e-06 2024-04-19T03:03:16.626 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.626 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.626 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:16.626 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:16.608917+0000", 2024-04-19T03:03:16.626 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.7550000000000006e-06 2024-04-19T03:03:16.627 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.627 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.627 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:16.627 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:16.608923+0000", 2024-04-19T03:03:16.627 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5089999999999999e-06 2024-04-19T03:03:16.627 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.627 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.627 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:16.627 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:16.608968+0000", 2024-04-19T03:03:16.627 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5200000000000001e-05 2024-04-19T03:03:16.627 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.627 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.627 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:16.627 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:16.608983+0000", 2024-04-19T03:03:16.627 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4761e-05 2024-04-19T03:03:16.628 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:16.628 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:16.628 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:16.628 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.628 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.628 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4755.0:203289 5.d e62/49 5:b4903d0d:::benchmark_data_smithi096_19531_object89839:head v 62'12851, mlcod=62'12848)", 2024-04-19T03:03:16.628 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:03:16.609187+0000", 2024-04-19T03:03:16.628 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.002657703, 2024-04-19T03:03:16.628 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0030142910000000001, 2024-04-19T03:03:16.628 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:16.628 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-19T03:03:16.628 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:16.628 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.628 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:16.629 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:16.609187+0000", 2024-04-19T03:03:16.629 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:16.629 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.629 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.629 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:16.629 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:16.609187+0000", 2024-04-19T03:03:16.629 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:16.629 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.629 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.629 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:16.629 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:16.609186+0000", 2024-04-19T03:03:16.629 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:16.629 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.629 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.629 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:16.630 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:16.609192+0000", 2024-04-19T03:03:16.630 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7180000000000001e-06 2024-04-19T03:03:16.630 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.630 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.630 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:16.630 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:16.609204+0000", 2024-04-19T03:03:16.630 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1966e-05 2024-04-19T03:03:16.630 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.630 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.630 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:16.630 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:16.609210+0000", 2024-04-19T03:03:16.630 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7629999999999997e-06 2024-04-19T03:03:16.630 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.630 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.631 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:16.631 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:16.609269+0000", 2024-04-19T03:03:16.631 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8924e-05 2024-04-19T03:03:16.631 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.631 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.631 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:16.631 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:16.609294+0000", 2024-04-19T03:03:16.631 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5232000000000002e-05 2024-04-19T03:03:16.631 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:16.631 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:16.631 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:16.631 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.631 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.631 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4755.0:203291 5.9 e62/22 5:9b709c0d:::benchmark_data_smithi096_19531_object89841:head v 62'12456, mlcod=62'12452)", 2024-04-19T03:03:16.631 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:03:16.610412+0000", 2024-04-19T03:03:16.632 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0014321259999999999, 2024-04-19T03:03:16.632 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001862011, 2024-04-19T03:03:16.632 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:16.632 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-19T03:03:16.632 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:16.632 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.632 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:16.632 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:16.610412+0000", 2024-04-19T03:03:16.632 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:16.632 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.632 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.632 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:16.632 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:16.610412+0000", 2024-04-19T03:03:16.632 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:16.633 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.633 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.633 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:16.633 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:16.610412+0000", 2024-04-19T03:03:16.633 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:03:16.633 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.633 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.633 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:16.633 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:16.610418+0000", 2024-04-19T03:03:16.633 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8900000000000004e-06 2024-04-19T03:03:16.633 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.633 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.633 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:16.633 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:16.610430+0000", 2024-04-19T03:03:16.633 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2225999999999999e-05 2024-04-19T03:03:16.634 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.634 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.634 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:16.634 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:16.610436+0000", 2024-04-19T03:03:16.634 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7579999999999998e-06 2024-04-19T03:03:16.634 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.634 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.634 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:16.634 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:16.610761+0000", 2024-04-19T03:03:16.634 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00032558899999999999 2024-04-19T03:03:16.634 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.634 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.634 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:16.634 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:16.610776+0000", 2024-04-19T03:03:16.635 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.507e-05 2024-04-19T03:03:16.635 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:16.635 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:16.635 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:16.635 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.635 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.635 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:203296 5.e 5:7a491f6d:::benchmark_data_smithi096_19531_object89846:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T03:03:16.635 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:03:16.611252+0000", 2024-04-19T03:03:16.635 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.00059223000000000001, 2024-04-19T03:03:16.635 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001096734, 2024-04-19T03:03:16.635 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:16.635 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-19T03:03:16.635 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:16.635 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:16.635 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:16.636 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 203296 2024-04-19T03:03:16.636 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.636 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:16.636 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.636 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:16.636 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:16.611252+0000", 2024-04-19T03:03:16.636 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:16.636 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.636 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.636 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:16.636 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:16.611252+0000", 2024-04-19T03:03:16.636 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:16.636 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.636 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.637 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:16.637 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:16.611251+0000", 2024-04-19T03:03:16.637 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:03:16.637 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.637 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.637 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:16.637 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:16.611257+0000", 2024-04-19T03:03:16.637 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1770000000000003e-06 2024-04-19T03:03:16.637 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.637 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.637 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:16.637 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:16.611268+0000", 2024-04-19T03:03:16.637 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0692e-05 2024-04-19T03:03:16.637 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.637 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.638 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:16.638 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:16.611275+0000", 2024-04-19T03:03:16.638 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5859999999999999e-06 2024-04-19T03:03:16.638 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.638 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.638 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:16.638 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:16.611329+0000", 2024-04-19T03:03:16.638 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3440000000000003e-05 2024-04-19T03:03:16.638 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.638 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.638 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:16.638 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:16.611430+0000", 2024-04-19T03:03:16.638 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000100801 2024-04-19T03:03:16.638 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:16.638 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:16.639 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:16.639 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.639 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.639 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4755.0:203294 5.d e62/49 5:b1eeaa0c:::benchmark_data_smithi096_19531_object89844:head v 62'12852, mlcod=62'12848)", 2024-04-19T03:03:16.639 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:03:16.611640+0000", 2024-04-19T03:03:16.639 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.000204582, 2024-04-19T03:03:16.639 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00078990699999999996, 2024-04-19T03:03:16.639 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:16.639 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-19T03:03:16.639 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:16.639 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.639 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:16.639 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:16.611640+0000", 2024-04-19T03:03:16.640 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:16.640 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.640 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.640 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:16.640 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:16.611640+0000", 2024-04-19T03:03:16.640 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:16.640 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.640 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.640 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:16.640 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:16.611639+0000", 2024-04-19T03:03:16.640 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:16.640 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.640 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.640 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:16.640 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:16.611645+0000", 2024-04-19T03:03:16.641 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5339999999999999e-06 2024-04-19T03:03:16.641 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.641 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.641 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:16.641 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:16.611656+0000", 2024-04-19T03:03:16.641 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1148000000000001e-05 2024-04-19T03:03:16.641 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.641 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.641 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:16.641 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:16.611662+0000", 2024-04-19T03:03:16.641 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2960000000000004e-06 2024-04-19T03:03:16.641 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.641 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.641 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:16.642 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:16.611694+0000", 2024-04-19T03:03:16.642 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1605e-05 2024-04-19T03:03:16.642 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.642 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.642 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:16.642 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:16.611717+0000", 2024-04-19T03:03:16.642 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3002000000000001e-05 2024-04-19T03:03:16.642 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:16.642 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:16.642 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:16.642 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.642 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.642 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4755.0:203295 5.f e62/22)", 2024-04-19T03:03:16.642 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:03:16.611680+0000", 2024-04-19T03:03:16.643 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.00016438600000000001, 2024-04-19T03:03:16.643 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00082042200000000001, 2024-04-19T03:03:16.643 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:16.643 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-04-19T03:03:16.643 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:16.643 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.643 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:16.643 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:16.611680+0000", 2024-04-19T03:03:16.643 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:16.643 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.643 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.643 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:16.643 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:16.611680+0000", 2024-04-19T03:03:16.643 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:16.644 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.644 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.644 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:16.644 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:16.611680+0000", 2024-04-19T03:03:16.644 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:16.644 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.644 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.644 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:16.644 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:16.611684+0000", 2024-04-19T03:03:16.644 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.0300000000000004e-06 2024-04-19T03:03:16.644 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.644 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.644 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:16.644 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:16.611690+0000", 2024-04-19T03:03:16.645 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9850000000000003e-06 2024-04-19T03:03:16.645 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.645 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.645 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:16.645 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:16.611694+0000", 2024-04-19T03:03:16.645 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3680000000000004e-06 2024-04-19T03:03:16.645 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:16.645 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:16.645 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:16.645 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.645 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.645 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:203281 5.0 5:0ee87934:::benchmark_data_smithi096_19531_object89831:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T03:03:16.645 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:03:16.605582+0000", 2024-04-19T03:03:16.645 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0062626670000000004, 2024-04-19T03:03:16.645 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0069821049999999997, 2024-04-19T03:03:16.646 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:16.646 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-19T03:03:16.646 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:16.646 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:16.646 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:16.646 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 203281 2024-04-19T03:03:16.646 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.646 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:16.646 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.646 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:16.646 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:16.605582+0000", 2024-04-19T03:03:16.646 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:16.646 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.647 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.647 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:16.647 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:16.605582+0000", 2024-04-19T03:03:16.647 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:16.647 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.647 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.647 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:16.647 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:16.605581+0000", 2024-04-19T03:03:16.647 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:16.647 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.647 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.647 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:16.647 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:16.605584+0000", 2024-04-19T03:03:16.647 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.5560000000000002e-06 2024-04-19T03:03:16.647 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.648 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.648 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:16.648 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:16.605591+0000", 2024-04-19T03:03:16.648 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7190000000000004e-06 2024-04-19T03:03:16.648 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.648 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.648 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:16.648 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:16.605596+0000", 2024-04-19T03:03:16.648 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9779999999999996e-06 2024-04-19T03:03:16.648 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.648 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.648 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:16.648 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:16.607402+0000", 2024-04-19T03:03:16.648 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0018065480000000001 2024-04-19T03:03:16.649 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.649 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.649 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:16.649 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:16.607518+0000", 2024-04-19T03:03:16.649 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000115569 2024-04-19T03:03:16.649 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:16.649 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:16.649 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:16.649 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:16.649 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-04-19T03:03:16.649 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 10 2024-04-19T03:03:16.649 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-19T03:03:16.650 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T03:03:16.691 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:03:16.688+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:03:16.773 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-19T03:03:16.773 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-04-19T03:03:16.773 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-04-19T03:03:16.773 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-04-19T03:03:16.773 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-19T03:03:16.784 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T03:03:16.792 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:03:16.788+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:03:16.892 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:03:16.890+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:03:16.907 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-19T03:03:16.907 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-04-19T03:03:16.907 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-04-19T03:03:16.907 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-04-19T03:03:16.907 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.907 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:86615 5.e 5:7fef7288:::benchmark_data_smithi096_19531_object86614:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:16.907 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:22.634544+0000", 2024-04-19T03:03:16.908 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 54.270846347999999, 2024-04-19T03:03:16.908 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.192475071, 2024-04-19T03:03:16.908 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:16.908 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:16.908 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:16.908 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:16.908 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:16.908 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 86615 2024-04-19T03:03:16.908 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.908 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:16.908 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.908 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:16.908 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634544+0000", 2024-04-19T03:03:16.908 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:16.909 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.909 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.909 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:16.909 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634544+0000", 2024-04-19T03:03:16.909 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:16.909 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.909 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.909 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:16.909 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634542+0000", 2024-04-19T03:03:16.909 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999981 2024-04-19T03:03:16.909 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.909 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.909 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:16.909 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634585+0000", 2024-04-19T03:03:16.909 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2299000000000003e-05 2024-04-19T03:03:16.910 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.910 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.910 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:16.910 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634592+0000", 2024-04-19T03:03:16.910 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2350000000000002e-06 2024-04-19T03:03:16.910 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.910 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.910 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:16.910 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634596+0000", 2024-04-19T03:03:16.910 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5390000000000001e-06 2024-04-19T03:03:16.910 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.910 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.910 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:16.911 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634639+0000", 2024-04-19T03:03:16.911 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2444999999999998e-05 2024-04-19T03:03:16.911 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.911 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.911 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:16.911 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634808+0000", 2024-04-19T03:03:16.911 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000169152 2024-04-19T03:03:16.911 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.911 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.911 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:16.911 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634999+0000", 2024-04-19T03:03:16.911 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00019098300000000001 2024-04-19T03:03:16.911 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.911 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.912 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:16.912 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.640458+0000", 2024-04-19T03:03:16.912 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0054586870000000003 2024-04-19T03:03:16.912 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.912 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.912 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:16.912 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.826949+0000", 2024-04-19T03:03:16.912 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.18649178299999999 2024-04-19T03:03:16.912 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.912 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.912 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:03:16.912 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.826982+0000", 2024-04-19T03:03:16.912 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2477000000000001e-05 2024-04-19T03:03:16.912 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.913 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.913 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:16.913 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.827019+0000", 2024-04-19T03:03:16.913 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7355999999999999e-05 2024-04-19T03:03:16.913 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:16.913 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:16.913 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:16.913 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.913 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.913 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:86616 5.e 5:72278f47:::benchmark_data_smithi096_19531_object86615:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:16.913 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:22.634609+0000", 2024-04-19T03:03:16.913 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 54.270781198999998, 2024-04-19T03:03:16.913 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.19472088900000001, 2024-04-19T03:03:16.913 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:16.914 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:16.914 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:16.914 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:16.914 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:16.914 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 86616 2024-04-19T03:03:16.914 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.914 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:16.914 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.914 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:16.914 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634609+0000", 2024-04-19T03:03:16.914 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:16.914 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.914 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.915 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:16.915 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634609+0000", 2024-04-19T03:03:16.915 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:16.915 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.915 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.915 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:16.915 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634609+0000", 2024-04-19T03:03:16.915 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:16.915 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.915 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.915 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:16.915 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634651+0000", 2024-04-19T03:03:16.915 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2589000000000002e-05 2024-04-19T03:03:16.916 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.916 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.916 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:16.916 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634659+0000", 2024-04-19T03:03:16.916 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5850000000000002e-06 2024-04-19T03:03:16.916 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.916 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.916 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:16.916 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634662+0000", 2024-04-19T03:03:16.916 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3620000000000002e-06 2024-04-19T03:03:16.916 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.916 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.916 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:16.916 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.637880+0000", 2024-04-19T03:03:16.917 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.003218149 2024-04-19T03:03:16.917 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.917 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.917 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:16.917 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.637999+0000", 2024-04-19T03:03:16.917 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000118643 2024-04-19T03:03:16.917 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.917 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.917 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:16.917 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.638102+0000", 2024-04-19T03:03:16.917 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010331 2024-04-19T03:03:16.917 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.917 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.917 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:16.917 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.640851+0000", 2024-04-19T03:03:16.918 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0027483310000000001 2024-04-19T03:03:16.918 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.918 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.918 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:16.918 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.829269+0000", 2024-04-19T03:03:16.918 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.188418319 2024-04-19T03:03:16.918 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.918 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.918 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:03:16.918 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.829299+0000", 2024-04-19T03:03:16.918 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0227e-05 2024-04-19T03:03:16.918 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.918 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.918 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:16.919 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.829330+0000", 2024-04-19T03:03:16.919 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0969000000000001e-05 2024-04-19T03:03:16.919 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:16.919 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:16.919 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:16.919 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.919 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.919 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:86618 5.0 5:09014b90:::benchmark_data_smithi096_19531_object86617:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:16.919 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:22.634894+0000", 2024-04-19T03:03:16.919 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 54.270496711, 2024-04-19T03:03:16.919 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.19413419800000001, 2024-04-19T03:03:16.919 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:16.919 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:16.919 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:16.919 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:16.919 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:16.920 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 86618 2024-04-19T03:03:16.920 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.920 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:16.920 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.920 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:16.920 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634894+0000", 2024-04-19T03:03:16.920 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:16.920 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.920 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.920 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:16.920 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634894+0000", 2024-04-19T03:03:16.920 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:16.920 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.920 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.920 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:16.921 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634893+0000", 2024-04-19T03:03:16.921 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:03:16.921 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.921 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.921 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:16.921 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634976+0000", 2024-04-19T03:03:16.921 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3231000000000003e-05 2024-04-19T03:03:16.921 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.921 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.921 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:16.921 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634983+0000", 2024-04-19T03:03:16.921 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5169999999999996e-06 2024-04-19T03:03:16.921 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.921 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.922 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:16.922 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634987+0000", 2024-04-19T03:03:16.922 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.425e-06 2024-04-19T03:03:16.922 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.922 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.922 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:16.922 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635030+0000", 2024-04-19T03:03:16.922 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.32e-05 2024-04-19T03:03:16.922 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.922 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.922 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:16.922 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635185+0000", 2024-04-19T03:03:16.922 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015471899999999999 2024-04-19T03:03:16.922 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.922 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.923 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:16.923 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635415+0000", 2024-04-19T03:03:16.923 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00023026500000000001 2024-04-19T03:03:16.923 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.923 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.923 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:16.923 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.640127+0000", 2024-04-19T03:03:16.923 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0047118890000000004 2024-04-19T03:03:16.923 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.923 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.923 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:16.923 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.828895+0000", 2024-04-19T03:03:16.923 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.18876802600000001 2024-04-19T03:03:16.923 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.923 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.923 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:03:16.924 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.828972+0000", 2024-04-19T03:03:16.924 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.6345000000000002e-05 2024-04-19T03:03:16.924 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.924 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.924 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:16.924 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.829028+0000", 2024-04-19T03:03:16.924 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6342999999999999e-05 2024-04-19T03:03:16.924 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:16.924 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:16.924 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:16.924 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.924 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.924 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:86620 5.b 5:d80faa68:::benchmark_data_smithi096_19531_object86619:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:16.924 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:22.635110+0000", 2024-04-19T03:03:16.924 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 54.270280151000001, 2024-04-19T03:03:16.925 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.193447275, 2024-04-19T03:03:16.925 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:16.925 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:16.925 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:16.925 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:16.925 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:16.925 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 86620 2024-04-19T03:03:16.925 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.925 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:16.925 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.925 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:16.925 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635110+0000", 2024-04-19T03:03:16.925 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:16.926 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.926 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.926 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:16.926 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635110+0000", 2024-04-19T03:03:16.926 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:16.926 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.926 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.926 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:16.926 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635110+0000", 2024-04-19T03:03:16.926 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:16.926 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.926 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.926 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:16.927 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635154+0000", 2024-04-19T03:03:16.927 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4681000000000001e-05 2024-04-19T03:03:16.927 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.927 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.927 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:16.927 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635166+0000", 2024-04-19T03:03:16.927 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1505000000000001e-05 2024-04-19T03:03:16.927 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.927 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.927 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:16.927 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635171+0000", 2024-04-19T03:03:16.927 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6040000000000003e-06 2024-04-19T03:03:16.927 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.927 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.928 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:16.928 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635221+0000", 2024-04-19T03:03:16.928 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9947000000000001e-05 2024-04-19T03:03:16.928 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.928 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.928 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:16.928 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635356+0000", 2024-04-19T03:03:16.928 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013576199999999999 2024-04-19T03:03:16.928 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.928 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.928 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:16.928 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635507+0000", 2024-04-19T03:03:16.928 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015072999999999999 2024-04-19T03:03:16.928 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.928 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.928 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:16.929 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.638488+0000", 2024-04-19T03:03:16.929 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0029813159999999999 2024-04-19T03:03:16.929 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.929 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.929 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:16.929 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.828341+0000", 2024-04-19T03:03:16.929 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.189852254 2024-04-19T03:03:16.929 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.929 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.929 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:03:16.929 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.828416+0000", 2024-04-19T03:03:16.929 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5344000000000002e-05 2024-04-19T03:03:16.929 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.929 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.929 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:16.929 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.828558+0000", 2024-04-19T03:03:16.930 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000141695 2024-04-19T03:03:16.930 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:16.930 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:16.930 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:16.930 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.930 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.930 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:86621 5.8 5:1597a420:::benchmark_data_smithi096_19531_object86620:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:16.930 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:22.635187+0000", 2024-04-19T03:03:16.930 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 54.270203291000001, 2024-04-19T03:03:16.930 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.194204878, 2024-04-19T03:03:16.930 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:16.930 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:16.930 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:16.930 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:16.931 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:16.931 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 86621 2024-04-19T03:03:16.931 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.931 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:16.931 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.931 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:16.931 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635187+0000", 2024-04-19T03:03:16.931 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:16.931 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.931 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.931 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:16.931 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635187+0000", 2024-04-19T03:03:16.931 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:16.931 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.931 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.932 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:16.932 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635187+0000", 2024-04-19T03:03:16.932 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:16.932 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.932 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.932 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:16.932 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635242+0000", 2024-04-19T03:03:16.932 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5158000000000003e-05 2024-04-19T03:03:16.932 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.932 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.932 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:16.932 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635249+0000", 2024-04-19T03:03:16.932 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.7000000000000008e-06 2024-04-19T03:03:16.932 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.933 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.933 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:16.933 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635256+0000", 2024-04-19T03:03:16.933 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2060000000000004e-06 2024-04-19T03:03:16.933 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.933 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.933 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:16.933 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635302+0000", 2024-04-19T03:03:16.933 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5954000000000001e-05 2024-04-19T03:03:16.933 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.933 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.933 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:16.933 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635427+0000", 2024-04-19T03:03:16.933 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012559299999999999 2024-04-19T03:03:16.933 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.934 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.934 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:16.934 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635596+0000", 2024-04-19T03:03:16.934 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000168615 2024-04-19T03:03:16.934 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.934 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.934 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:16.934 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.639320+0000", 2024-04-19T03:03:16.934 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0037244610000000001 2024-04-19T03:03:16.934 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.934 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.934 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:16.934 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.829277+0000", 2024-04-19T03:03:16.934 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.18995651099999999 2024-04-19T03:03:16.934 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.935 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.935 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:03:16.935 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.829341+0000", 2024-04-19T03:03:16.935 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3756000000000004e-05 2024-04-19T03:03:16.935 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.935 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.935 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:16.935 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.829392+0000", 2024-04-19T03:03:16.935 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1555999999999999e-05 2024-04-19T03:03:16.935 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:16.935 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:16.935 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:16.935 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.935 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.936 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87067 5.b 5:d57af71a:::benchmark_data_smithi096_19531_object87066:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:16.936 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.142233+0000", 2024-04-19T03:03:16.936 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 53.763157428, 2024-04-19T03:03:16.936 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.071692405000000001, 2024-04-19T03:03:16.936 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:16.936 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:16.936 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:16.936 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:16.936 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:16.936 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87067 2024-04-19T03:03:16.936 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.936 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:16.936 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.937 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:16.937 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142233+0000", 2024-04-19T03:03:16.937 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:16.937 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.937 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.937 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:16.937 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142233+0000", 2024-04-19T03:03:16.937 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:16.937 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.937 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.937 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:16.937 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142232+0000", 2024-04-19T03:03:16.937 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:03:16.937 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.937 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.938 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:16.938 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142277+0000", 2024-04-19T03:03:16.938 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5837000000000002e-05 2024-04-19T03:03:16.938 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.938 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.938 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:16.938 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142297+0000", 2024-04-19T03:03:16.938 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9561000000000001e-05 2024-04-19T03:03:16.938 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.938 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.938 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:16.938 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142311+0000", 2024-04-19T03:03:16.939 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3654e-05 2024-04-19T03:03:16.939 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.939 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.939 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:16.939 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142391+0000", 2024-04-19T03:03:16.939 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0123999999999994e-05 2024-04-19T03:03:16.939 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.939 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.939 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:16.939 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142669+0000", 2024-04-19T03:03:16.939 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00027829800000000001 2024-04-19T03:03:16.939 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.939 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.939 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:16.939 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142859+0000", 2024-04-19T03:03:16.939 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000190051 2024-04-19T03:03:16.940 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.940 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.940 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:16.940 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.150597+0000", 2024-04-19T03:03:16.940 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0077380299999999999 2024-04-19T03:03:16.940 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.940 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.940 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:16.940 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.213855+0000", 2024-04-19T03:03:16.940 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.063257987000000002 2024-04-19T03:03:16.940 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.940 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.940 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:03:16.940 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.213898+0000", 2024-04-19T03:03:16.940 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2916e-05 2024-04-19T03:03:16.941 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.941 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.941 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:16.941 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.213925+0000", 2024-04-19T03:03:16.941 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7503000000000001e-05 2024-04-19T03:03:16.941 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:16.941 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:16.941 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:16.941 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.941 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.941 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87069 5.b 5:da0c93b5:::benchmark_data_smithi096_19531_object87068:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:16.941 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.143402+0000", 2024-04-19T03:03:16.941 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 53.761988465999998, 2024-04-19T03:03:16.941 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.070678598999999995, 2024-04-19T03:03:16.941 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:16.942 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:16.942 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:16.942 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:16.942 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:16.942 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87069 2024-04-19T03:03:16.942 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.942 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:16.942 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.942 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:16.942 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.143402+0000", 2024-04-19T03:03:16.942 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:16.942 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.942 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.942 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:16.943 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.143402+0000", 2024-04-19T03:03:16.943 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:16.943 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.943 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.943 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:16.943 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.143401+0000", 2024-04-19T03:03:16.943 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:03:16.943 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.943 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.943 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:16.943 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.143501+0000", 2024-04-19T03:03:16.943 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000100387 2024-04-19T03:03:16.943 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.943 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.943 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:16.944 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.143516+0000", 2024-04-19T03:03:16.944 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5369000000000001e-05 2024-04-19T03:03:16.944 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.944 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.944 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:16.944 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.143524+0000", 2024-04-19T03:03:16.944 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.7079999999999997e-06 2024-04-19T03:03:16.944 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.944 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.944 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:16.944 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.145550+0000", 2024-04-19T03:03:16.944 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0020259290000000001 2024-04-19T03:03:16.944 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.944 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.944 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:16.944 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.145676+0000", 2024-04-19T03:03:16.945 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000126406 2024-04-19T03:03:16.945 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.945 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.945 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:16.945 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.145802+0000", 2024-04-19T03:03:16.945 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000125974 2024-04-19T03:03:16.945 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.945 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.945 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:16.945 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.151030+0000", 2024-04-19T03:03:16.945 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0052276079999999999 2024-04-19T03:03:16.945 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.945 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.945 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:16.945 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.213998+0000", 2024-04-19T03:03:16.946 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.06296786 2024-04-19T03:03:16.946 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.946 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.946 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:03:16.946 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.214031+0000", 2024-04-19T03:03:16.946 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3387999999999999e-05 2024-04-19T03:03:16.946 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.946 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.946 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:16.946 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.214081+0000", 2024-04-19T03:03:16.946 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9316e-05 2024-04-19T03:03:16.946 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:16.946 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:16.947 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:16.947 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.947 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.947 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87108 5.e 5:7e197adc:::benchmark_data_smithi096_19531_object87107:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:16.947 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.223103+0000", 2024-04-19T03:03:16.947 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 53.682287129000002, 2024-04-19T03:03:16.947 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.044946887, 2024-04-19T03:03:16.947 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:16.947 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-19T03:03:16.947 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:16.947 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:16.947 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:16.947 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87108 2024-04-19T03:03:16.947 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.948 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:16.948 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.948 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:16.948 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.223103+0000", 2024-04-19T03:03:16.948 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:16.948 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.948 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.948 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:16.948 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.223103+0000", 2024-04-19T03:03:16.948 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:16.948 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.948 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.948 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:16.948 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.223102+0000", 2024-04-19T03:03:16.949 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:03:16.949 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.949 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.949 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:16.949 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.223156+0000", 2024-04-19T03:03:16.949 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3958000000000001e-05 2024-04-19T03:03:16.949 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.949 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.949 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:16.949 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.223166+0000", 2024-04-19T03:03:16.949 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.4809999999999995e-06 2024-04-19T03:03:16.949 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.949 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.949 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:16.950 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.223172+0000", 2024-04-19T03:03:16.950 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0140000000000004e-06 2024-04-19T03:03:16.950 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.950 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.950 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:16.950 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.227295+0000", 2024-04-19T03:03:16.950 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0041233420000000003 2024-04-19T03:03:16.950 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.950 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.950 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:16.950 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.227495+0000", 2024-04-19T03:03:16.950 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00019955299999999999 2024-04-19T03:03:16.950 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.950 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.951 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:16.951 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.227717+0000", 2024-04-19T03:03:16.951 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000221902 2024-04-19T03:03:16.951 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.951 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.951 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:16.951 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233189+0000", 2024-04-19T03:03:16.951 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0054718889999999997 2024-04-19T03:03:16.951 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.951 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.951 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:16.951 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.250529+0000", 2024-04-19T03:03:16.951 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.017340298000000001 2024-04-19T03:03:16.951 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.951 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.952 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:03:16.952 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.250539+0000", 2024-04-19T03:03:16.952 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0501e-05 2024-04-19T03:03:16.952 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.952 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.952 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:16.952 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.268003+0000", 2024-04-19T03:03:16.952 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.017463429 2024-04-19T03:03:16.952 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.952 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.952 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:16.952 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.268050+0000", 2024-04-19T03:03:16.952 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7466000000000003e-05 2024-04-19T03:03:16.952 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:16.952 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:16.953 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:16.953 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.953 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.953 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87118 5.b 5:d1bb4f3c:::benchmark_data_smithi096_19531_object87117:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:16.953 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.231082+0000", 2024-04-19T03:03:16.953 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 53.674308295000003, 2024-04-19T03:03:16.953 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.035789004, 2024-04-19T03:03:16.953 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:16.953 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-19T03:03:16.953 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:16.953 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:16.953 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:16.953 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87118 2024-04-19T03:03:16.953 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.954 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:16.954 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.954 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:16.954 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231082+0000", 2024-04-19T03:03:16.954 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:16.954 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.954 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.954 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:16.954 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231082+0000", 2024-04-19T03:03:16.954 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:16.954 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.954 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.954 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:16.954 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231081+0000", 2024-04-19T03:03:16.955 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:03:16.955 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.955 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.955 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:16.955 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231159+0000", 2024-04-19T03:03:16.955 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.7819999999999997e-05 2024-04-19T03:03:16.955 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.955 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.955 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:16.955 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231186+0000", 2024-04-19T03:03:16.955 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7126000000000001e-05 2024-04-19T03:03:16.955 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.955 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.955 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:16.956 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231193+0000", 2024-04-19T03:03:16.956 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7259999999999996e-06 2024-04-19T03:03:16.956 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.956 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.956 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:16.956 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231241+0000", 2024-04-19T03:03:16.956 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8123e-05 2024-04-19T03:03:16.956 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.956 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.956 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:16.956 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231354+0000", 2024-04-19T03:03:16.956 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0001133 2024-04-19T03:03:16.956 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.956 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.957 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:16.957 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231443+0000", 2024-04-19T03:03:16.957 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9167999999999997e-05 2024-04-19T03:03:16.957 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.957 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.957 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:16.957 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236498+0000", 2024-04-19T03:03:16.957 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0050545160000000002 2024-04-19T03:03:16.957 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.957 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.957 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:16.957 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.249681+0000", 2024-04-19T03:03:16.957 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013183321 2024-04-19T03:03:16.957 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.958 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.958 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:03:16.958 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.249693+0000", 2024-04-19T03:03:16.958 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1834999999999999e-05 2024-04-19T03:03:16.958 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.958 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.958 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:16.958 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266733+0000", 2024-04-19T03:03:16.958 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.017040408 2024-04-19T03:03:16.958 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.958 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.958 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:16.958 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266871+0000", 2024-04-19T03:03:16.958 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000137849 2024-04-19T03:03:16.959 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:16.959 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:16.959 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:16.959 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.959 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.959 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87121 5.b 5:d01822b8:::benchmark_data_smithi096_19531_object87120:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:16.959 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.233319+0000", 2024-04-19T03:03:16.959 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 53.672071430999999, 2024-04-19T03:03:16.959 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.033624198, 2024-04-19T03:03:16.959 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:16.959 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-19T03:03:16.959 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:16.959 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:16.959 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:16.960 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87121 2024-04-19T03:03:16.960 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.960 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:16.960 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.960 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:16.960 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233319+0000", 2024-04-19T03:03:16.960 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:16.960 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.960 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.960 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:16.960 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233319+0000", 2024-04-19T03:03:16.960 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:16.960 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.960 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.960 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:16.960 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233319+0000", 2024-04-19T03:03:16.961 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:16.961 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.961 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.961 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:16.961 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233364+0000", 2024-04-19T03:03:16.961 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5460999999999997e-05 2024-04-19T03:03:16.961 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.961 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.961 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:16.961 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233382+0000", 2024-04-19T03:03:16.961 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8148e-05 2024-04-19T03:03:16.961 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.961 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.961 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:16.961 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233390+0000", 2024-04-19T03:03:16.961 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5340000000000002e-06 2024-04-19T03:03:16.962 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.962 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.962 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:16.962 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233712+0000", 2024-04-19T03:03:16.962 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00032260500000000001 2024-04-19T03:03:16.962 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.962 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.962 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:16.962 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233829+0000", 2024-04-19T03:03:16.962 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011638599999999999 2024-04-19T03:03:16.962 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.962 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.962 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:16.962 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233959+0000", 2024-04-19T03:03:16.963 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013013900000000001 2024-04-19T03:03:16.963 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.963 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.963 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:16.963 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236515+0000", 2024-04-19T03:03:16.963 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0025562750000000002 2024-04-19T03:03:16.963 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.963 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.963 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:16.963 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.249723+0000", 2024-04-19T03:03:16.963 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013208176 2024-04-19T03:03:16.963 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.963 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.963 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:03:16.963 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.249728+0000", 2024-04-19T03:03:16.964 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6519999999999997e-06 2024-04-19T03:03:16.964 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.964 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.964 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:16.964 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266837+0000", 2024-04-19T03:03:16.964 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0171087059999999 2024-04-19T03:03:16.964 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.964 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.964 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:16.964 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266943+0000", 2024-04-19T03:03:16.964 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000106604 2024-04-19T03:03:16.964 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:16.964 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:16.964 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:16.964 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.964 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.965 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87124 5.8 5:14819ad7:::benchmark_data_smithi096_19531_object87123:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:16.965 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.235886+0000", 2024-04-19T03:03:16.965 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 53.669504007, 2024-04-19T03:03:16.965 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0315451179999999, 2024-04-19T03:03:16.965 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:16.965 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-19T03:03:16.965 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:16.965 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:16.965 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:16.965 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87124 2024-04-19T03:03:16.965 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.965 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:16.965 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.965 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:16.965 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.235886+0000", 2024-04-19T03:03:16.966 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:16.966 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.966 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.966 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:16.966 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.235886+0000", 2024-04-19T03:03:16.966 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:16.966 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.966 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.966 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:16.966 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.235886+0000", 2024-04-19T03:03:16.966 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:03:16.966 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.966 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.966 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:16.967 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.235934+0000", 2024-04-19T03:03:16.967 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8384000000000003e-05 2024-04-19T03:03:16.967 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.967 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.967 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:16.967 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.235945+0000", 2024-04-19T03:03:16.967 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0671e-05 2024-04-19T03:03:16.967 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.967 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.967 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:16.967 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.235952+0000", 2024-04-19T03:03:16.967 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3089999999999998e-06 2024-04-19T03:03:16.967 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.967 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.968 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:16.968 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.237067+0000", 2024-04-19T03:03:16.968 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001115263 2024-04-19T03:03:16.968 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.968 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.968 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:16.968 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.237188+0000", 2024-04-19T03:03:16.968 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000121258 2024-04-19T03:03:16.968 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.968 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.968 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:16.968 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.237316+0000", 2024-04-19T03:03:16.968 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000128071 2024-04-19T03:03:16.968 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.969 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.969 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:16.969 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240744+0000", 2024-04-19T03:03:16.969 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0034275629999999998 2024-04-19T03:03:16.969 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.969 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.969 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:16.969 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.252517+0000", 2024-04-19T03:03:16.969 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011772991999999999 2024-04-19T03:03:16.969 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.969 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.969 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:03:16.969 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.252523+0000", 2024-04-19T03:03:16.969 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3640000000000004e-06 2024-04-19T03:03:16.970 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.970 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.970 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:16.970 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.267290+0000", 2024-04-19T03:03:16.970 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0147665690000001 2024-04-19T03:03:16.970 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.970 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.970 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:16.970 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.267432+0000", 2024-04-19T03:03:16.970 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014165299999999999 2024-04-19T03:03:16.970 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:16.970 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:16.970 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:16.970 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.971 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.971 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87129 5.0 5:02667e01:::benchmark_data_smithi096_19531_object87128:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:16.971 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.236466+0000", 2024-04-19T03:03:16.971 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 53.668924011000001, 2024-04-19T03:03:16.971 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0301534510000001, 2024-04-19T03:03:16.971 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:16.971 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-19T03:03:16.971 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:16.971 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:16.971 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:16.971 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87129 2024-04-19T03:03:16.971 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.971 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:16.971 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.971 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:16.971 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236466+0000", 2024-04-19T03:03:16.972 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:16.972 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.972 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.972 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:16.972 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236466+0000", 2024-04-19T03:03:16.972 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:16.973 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.973 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.973 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:16.973 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236465+0000", 2024-04-19T03:03:16.973 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:03:16.973 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.973 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.973 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:16.973 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236566+0000", 2024-04-19T03:03:16.974 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010047000000000001 2024-04-19T03:03:16.974 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.974 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.974 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:16.974 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236577+0000", 2024-04-19T03:03:16.974 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1772e-05 2024-04-19T03:03:16.974 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.974 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.974 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:16.974 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236584+0000", 2024-04-19T03:03:16.974 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0530000000000003e-06 2024-04-19T03:03:16.974 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.974 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.975 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:16.975 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.237023+0000", 2024-04-19T03:03:16.975 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000439703 2024-04-19T03:03:16.975 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.975 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.975 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:16.975 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.237207+0000", 2024-04-19T03:03:16.975 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000183692 2024-04-19T03:03:16.975 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.975 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.975 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:16.975 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.237373+0000", 2024-04-19T03:03:16.975 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016623500000000001 2024-04-19T03:03:16.975 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.975 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.976 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:16.976 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.241461+0000", 2024-04-19T03:03:16.976 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0040883050000000004 2024-04-19T03:03:16.976 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.976 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.976 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:16.976 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.252500+0000", 2024-04-19T03:03:16.976 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011038450999999999 2024-04-19T03:03:16.976 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.976 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.976 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:03:16.976 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.252507+0000", 2024-04-19T03:03:16.976 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2439999999999996e-06 2024-04-19T03:03:16.976 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.976 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.977 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:16.977 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266538+0000", 2024-04-19T03:03:16.977 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.014031184 2024-04-19T03:03:16.977 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.977 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.977 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:16.977 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266620+0000", 2024-04-19T03:03:16.977 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1600000000000005e-05 2024-04-19T03:03:16.977 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:16.977 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:16.977 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:16.977 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.977 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.977 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87135 5.4 5:2a97e7b7:::benchmark_data_smithi096_19531_object87134:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:16.977 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.240884+0000", 2024-04-19T03:03:16.977 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 53.664506553999999, 2024-04-19T03:03:16.978 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.025708931, 2024-04-19T03:03:16.978 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:16.978 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-19T03:03:16.978 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:16.978 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:16.978 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:16.978 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87135 2024-04-19T03:03:16.978 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.978 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:16.978 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.978 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:16.978 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240884+0000", 2024-04-19T03:03:16.978 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:16.978 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.979 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.979 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:16.979 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240884+0000", 2024-04-19T03:03:16.979 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:16.979 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.979 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.979 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:16.979 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240883+0000", 2024-04-19T03:03:16.979 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:03:16.979 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.979 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.979 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:16.979 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240933+0000", 2024-04-19T03:03:16.979 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9969999999999998e-05 2024-04-19T03:03:16.979 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.980 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.980 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:16.980 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240946+0000", 2024-04-19T03:03:16.980 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2943e-05 2024-04-19T03:03:16.980 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.980 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.980 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:16.980 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240952+0000", 2024-04-19T03:03:16.980 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8930000000000002e-06 2024-04-19T03:03:16.980 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.980 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.980 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:16.980 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240994+0000", 2024-04-19T03:03:16.980 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2753999999999998e-05 2024-04-19T03:03:16.980 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.981 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.981 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:16.981 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.241092+0000", 2024-04-19T03:03:16.981 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.7447000000000004e-05 2024-04-19T03:03:16.981 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.981 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.981 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:16.981 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.241183+0000", 2024-04-19T03:03:16.981 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1163999999999997e-05 2024-04-19T03:03:16.981 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.981 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.981 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:16.981 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.254672+0000", 2024-04-19T03:03:16.981 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.01348864 2024-04-19T03:03:16.982 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.982 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.982 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:03:16.982 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.254681+0000", 2024-04-19T03:03:16.982 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.3789999999999995e-06 2024-04-19T03:03:16.982 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.982 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.982 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:16.982 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266456+0000", 2024-04-19T03:03:16.982 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.011774621 2024-04-19T03:03:16.982 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.982 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.982 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:16.982 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266593+0000", 2024-04-19T03:03:16.983 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013737600000000001 2024-04-19T03:03:16.983 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:16.983 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:16.983 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:16.983 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.983 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.983 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87136 5.4 5:212411bc:::benchmark_data_smithi096_19531_object87135:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:16.983 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.240962+0000", 2024-04-19T03:03:16.983 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 53.664428678, 2024-04-19T03:03:16.983 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.025738, 2024-04-19T03:03:16.983 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:16.983 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-19T03:03:16.983 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:16.983 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:16.983 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:16.984 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87136 2024-04-19T03:03:16.984 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.984 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:16.984 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.984 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:16.984 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240962+0000", 2024-04-19T03:03:16.984 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:16.984 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.984 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.984 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:16.984 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240962+0000", 2024-04-19T03:03:16.984 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:16.984 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.984 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.984 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:16.985 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240961+0000", 2024-04-19T03:03:16.985 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:16.985 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.985 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.985 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:16.985 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240995+0000", 2024-04-19T03:03:16.985 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3868000000000002e-05 2024-04-19T03:03:16.985 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.985 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.985 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:16.985 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.241001+0000", 2024-04-19T03:03:16.985 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.322e-06 2024-04-19T03:03:16.985 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.985 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.985 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:16.986 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.241004+0000", 2024-04-19T03:03:16.986 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3510000000000002e-06 2024-04-19T03:03:16.986 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.986 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.986 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:16.986 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247131+0000", 2024-04-19T03:03:16.986 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0061270869999999998 2024-04-19T03:03:16.986 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.986 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.986 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:16.986 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247322+0000", 2024-04-19T03:03:16.986 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000191015 2024-04-19T03:03:16.986 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.986 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.987 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:16.987 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247542+0000", 2024-04-19T03:03:16.987 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00022030199999999999 2024-04-19T03:03:16.987 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.987 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.987 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:16.987 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.254709+0000", 2024-04-19T03:03:16.987 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0071662660000000001 2024-04-19T03:03:16.987 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.987 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.987 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:03:16.987 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.254716+0000", 2024-04-19T03:03:16.987 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3860000000000001e-06 2024-04-19T03:03:16.987 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.988 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.988 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:16.988 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266619+0000", 2024-04-19T03:03:16.988 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0119031030000001 2024-04-19T03:03:16.988 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.988 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.988 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:16.988 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266700+0000", 2024-04-19T03:03:16.988 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0764000000000001e-05 2024-04-19T03:03:16.988 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:16.988 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:16.988 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:16.988 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.988 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.988 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87138 5.e 5:7b1f1c20:::benchmark_data_smithi096_19531_object87137:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:16.989 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.247862+0000", 2024-04-19T03:03:16.989 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 53.657528603999999, 2024-04-19T03:03:16.989 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.024457079, 2024-04-19T03:03:16.989 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:16.989 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:16.989 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:16.989 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:16.989 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:16.989 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87138 2024-04-19T03:03:16.989 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.989 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:16.989 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.989 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:16.990 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247862+0000", 2024-04-19T03:03:16.990 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:16.990 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.990 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.990 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:16.990 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247862+0000", 2024-04-19T03:03:16.990 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:16.990 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.990 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.990 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:16.990 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247860+0000", 2024-04-19T03:03:16.990 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999981 2024-04-19T03:03:16.990 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.991 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.991 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:16.991 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247909+0000", 2024-04-19T03:03:16.991 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9150999999999997e-05 2024-04-19T03:03:16.991 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.991 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.991 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:16.991 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247925+0000", 2024-04-19T03:03:16.991 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5761999999999999e-05 2024-04-19T03:03:16.991 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.991 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.991 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:16.991 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247936+0000", 2024-04-19T03:03:16.991 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1144e-05 2024-04-19T03:03:16.991 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.992 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.992 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:16.992 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.250590+0000", 2024-04-19T03:03:16.992 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.002653678 2024-04-19T03:03:16.992 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.992 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.992 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:03:16.992 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.250599+0000", 2024-04-19T03:03:16.992 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9039999999999998e-06 2024-04-19T03:03:16.992 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.992 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.992 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:16.992 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.268151+0000", 2024-04-19T03:03:16.992 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0175523449999999 2024-04-19T03:03:16.992 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.993 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.993 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:16.993 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.268285+0000", 2024-04-19T03:03:16.993 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013415599999999999 2024-04-19T03:03:16.993 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.993 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.993 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:16.993 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.272238+0000", 2024-04-19T03:03:16.993 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0039533019999999997 2024-04-19T03:03:16.993 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.993 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.993 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:03:16.993 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.272274+0000", 2024-04-19T03:03:16.993 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5352000000000003e-05 2024-04-19T03:03:16.993 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.993 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.994 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:16.994 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.272319+0000", 2024-04-19T03:03:16.994 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5281999999999998e-05 2024-04-19T03:03:16.994 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:16.994 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:16.994 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:16.994 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.994 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.994 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:158371 5.8 5:11a83024:::benchmark_data_smithi096_19531_object44921:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-19T03:03:16.994 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:58.125869+0000", 2024-04-19T03:03:16.994 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 18.779521739, 2024-04-19T03:03:16.994 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074532857999999994, 2024-04-19T03:03:16.994 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:16.994 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:16.995 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:16.995 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:16.995 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:16.995 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 158371 2024-04-19T03:03:16.995 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.995 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:16.995 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.995 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:16.995 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125869+0000", 2024-04-19T03:03:16.995 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:16.995 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.995 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.995 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:16.995 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125869+0000", 2024-04-19T03:03:16.996 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:16.996 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.996 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.996 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:16.996 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125868+0000", 2024-04-19T03:03:16.996 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:03:16.996 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.996 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.996 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:16.996 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125874+0000", 2024-04-19T03:03:16.996 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7120000000000003e-06 2024-04-19T03:03:16.996 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.996 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.996 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:16.996 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125885+0000", 2024-04-19T03:03:16.997 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0665999999999999e-05 2024-04-19T03:03:16.997 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.997 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.997 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:16.997 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125901+0000", 2024-04-19T03:03:16.997 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6463000000000001e-05 2024-04-19T03:03:16.997 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.997 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.997 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:16.997 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125956+0000", 2024-04-19T03:03:16.997 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4728000000000002e-05 2024-04-19T03:03:16.997 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.997 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.997 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:16.998 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.126050+0000", 2024-04-19T03:03:16.998 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.3534000000000003e-05 2024-04-19T03:03:16.998 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.998 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.998 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:16.998 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.200187+0000", 2024-04-19T03:03:16.998 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074136933000000002 2024-04-19T03:03:16.998 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.998 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.998 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:03:16.998 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.200260+0000", 2024-04-19T03:03:16.998 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3090999999999995e-05 2024-04-19T03:03:16.999 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.999 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.999 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:16.999 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.200402+0000", 2024-04-19T03:03:16.999 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014193699999999999 2024-04-19T03:03:16.999 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:16.999 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:16.999 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:16.999 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:16.999 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:16.999 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:158372 5.0 5:0473aa5f:::benchmark_data_smithi096_19531_object44922:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-19T03:03:16.999 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:58.125924+0000", 2024-04-19T03:03:16.999 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 18.779466132, 2024-04-19T03:03:16.999 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074247490999999999, 2024-04-19T03:03:16.999 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:17.000 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:17.000 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:17.000 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:17.000 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:17.000 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 158372 2024-04-19T03:03:17.000 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:17.000 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:17.000 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:17.000 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:17.000 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125924+0000", 2024-04-19T03:03:17.000 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:17.000 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:17.000 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:17.001 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:17.001 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125924+0000", 2024-04-19T03:03:17.001 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:17.001 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:17.001 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:17.001 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:17.001 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125924+0000", 2024-04-19T03:03:17.001 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:17.001 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:17.001 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:17.001 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:17.001 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125927+0000", 2024-04-19T03:03:17.001 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5389999999999999e-06 2024-04-19T03:03:17.001 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:17.002 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:17.002 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:17.002 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125935+0000", 2024-04-19T03:03:17.002 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3259999999999998e-06 2024-04-19T03:03:17.002 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:17.002 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:17.002 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:17.002 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125940+0000", 2024-04-19T03:03:17.002 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6980000000000003e-06 2024-04-19T03:03:17.002 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:17.002 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:17.002 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:17.002 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125982+0000", 2024-04-19T03:03:17.002 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1337000000000001e-05 2024-04-19T03:03:17.003 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:17.003 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:17.003 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:17.003 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.126075+0000", 2024-04-19T03:03:17.003 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.3579999999999995e-05 2024-04-19T03:03:17.003 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:17.003 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:17.003 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:17.003 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.199953+0000", 2024-04-19T03:03:17.003 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073877604999999999 2024-04-19T03:03:17.003 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:17.003 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:17.003 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:03:17.003 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.200022+0000", 2024-04-19T03:03:17.003 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.8824000000000004e-05 2024-04-19T03:03:17.004 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:17.004 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:17.004 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:17.004 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.200172+0000", 2024-04-19T03:03:17.004 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015017700000000001 2024-04-19T03:03:17.004 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:17.004 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:17.004 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:17.004 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:17.004 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:17.004 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:158374 5.e 5:76be57a5:::benchmark_data_smithi096_19531_object44924:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-19T03:03:17.004 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:58.125988+0000", 2024-04-19T03:03:17.004 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 18.779402633, 2024-04-19T03:03:17.004 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.067843332000000006, 2024-04-19T03:03:17.004 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:17.005 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:17.005 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:17.005 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:17.005 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:17.005 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 158374 2024-04-19T03:03:17.005 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:17.005 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:17.005 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:17.005 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:17.005 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125988+0000", 2024-04-19T03:03:17.005 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:17.005 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:17.005 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:17.005 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:17.006 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125988+0000", 2024-04-19T03:03:17.006 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:17.006 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:17.006 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:17.006 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:17.006 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125987+0000", 2024-04-19T03:03:17.006 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:17.006 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:17.006 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:17.006 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:17.006 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125990+0000", 2024-04-19T03:03:17.006 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7989999999999998e-06 2024-04-19T03:03:17.006 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:17.007 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:17.007 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:17.007 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125996+0000", 2024-04-19T03:03:17.007 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.302e-06 2024-04-19T03:03:17.007 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:17.007 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:17.007 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:17.007 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.126001+0000", 2024-04-19T03:03:17.007 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.843e-06 2024-04-19T03:03:17.007 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:17.007 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:17.007 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:17.007 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.126047+0000", 2024-04-19T03:03:17.007 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6066000000000002e-05 2024-04-19T03:03:17.007 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:17.008 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:17.008 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:17.008 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.126171+0000", 2024-04-19T03:03:17.008 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012359099999999999 2024-04-19T03:03:17.008 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:17.008 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:17.008 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:17.008 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.193709+0000", 2024-04-19T03:03:17.008 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.067538099000000004 2024-04-19T03:03:17.008 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:17.008 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:17.008 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:03:17.008 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.193766+0000", 2024-04-19T03:03:17.008 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6869e-05 2024-04-19T03:03:17.009 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:17.009 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:17.009 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:17.009 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.193831+0000", 2024-04-19T03:03:17.009 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5273999999999999e-05 2024-04-19T03:03:17.009 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:17.009 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:17.009 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:17.009 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:17.009 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:17.009 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4755.0:158376 5.9 e56/22 5:9e73c076:::benchmark_data_smithi096_19531_object44926:head v 56'9663, mlcod=56'9661)", 2024-04-19T03:03:17.009 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:58.127307+0000", 2024-04-19T03:03:17.009 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 18.778083402, 2024-04-19T03:03:17.010 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069002716000000006, 2024-04-19T03:03:17.010 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:17.010 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:17.010 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:17.010 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:17.010 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:17.010 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.127307+0000", 2024-04-19T03:03:17.010 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:17.010 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:17.010 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:17.010 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:17.010 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.127307+0000", 2024-04-19T03:03:17.010 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:17.011 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:17.011 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:17.011 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:17.011 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.127306+0000", 2024-04-19T03:03:17.011 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:03:17.011 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:17.011 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:17.011 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:17.011 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.127316+0000", 2024-04-19T03:03:17.011 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.3039999999999994e-06 2024-04-19T03:03:17.011 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:17.011 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:17.011 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:17.011 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.127326+0000", 2024-04-19T03:03:17.012 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0009e-05 2024-04-19T03:03:17.012 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:17.012 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:17.012 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:17.012 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.127332+0000", 2024-04-19T03:03:17.012 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5880000000000003e-06 2024-04-19T03:03:17.012 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:17.012 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:17.012 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:17.012 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.127383+0000", 2024-04-19T03:03:17.012 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0516000000000002e-05 2024-04-19T03:03:17.012 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:17.012 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:17.012 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:17.012 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.127403+0000", 2024-04-19T03:03:17.013 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0547000000000002e-05 2024-04-19T03:03:17.013 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:17.013 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:17.013 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:03:17.013 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.196280+0000", 2024-04-19T03:03:17.013 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.068876863999999996 2024-04-19T03:03:17.013 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:17.013 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:17.013 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:17.013 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.196310+0000", 2024-04-19T03:03:17.013 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9762999999999999e-05 2024-04-19T03:03:17.013 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:17.013 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:17.013 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:17.013 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:17.013 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:17.014 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:158383 5.0 5:026717eb:::benchmark_data_smithi096_19531_object44933:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-19T03:03:17.014 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:58.130494+0000", 2024-04-19T03:03:17.014 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 18.774896276, 2024-04-19T03:03:17.014 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.070135775999999997, 2024-04-19T03:03:17.014 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:17.014 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:17.014 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:17.014 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:17.014 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:17.014 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 158383 2024-04-19T03:03:17.014 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:17.014 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:17.014 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:17.014 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:17.015 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.130494+0000", 2024-04-19T03:03:17.015 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:17.015 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:17.015 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:17.015 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:17.015 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.130494+0000", 2024-04-19T03:03:17.015 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:17.015 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:17.015 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:17.015 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:17.015 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.130493+0000", 2024-04-19T03:03:17.015 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:03:17.015 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:17.015 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:17.016 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:17.016 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.130500+0000", 2024-04-19T03:03:17.016 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5490000000000003e-06 2024-04-19T03:03:17.016 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:17.016 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:17.016 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:17.016 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.190401+0000", 2024-04-19T03:03:17.016 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.059901668999999998 2024-04-19T03:03:17.016 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:17.016 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:17.016 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:17.016 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.190421+0000", 2024-04-19T03:03:17.016 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0288e-05 2024-04-19T03:03:17.016 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:17.017 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:17.017 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:17.017 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.190536+0000", 2024-04-19T03:03:17.017 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000114783 2024-04-19T03:03:17.017 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:17.017 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:17.017 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:17.017 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.190904+0000", 2024-04-19T03:03:17.017 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00036773900000000001 2024-04-19T03:03:17.017 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:17.017 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:17.017 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:17.017 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.200417+0000", 2024-04-19T03:03:17.017 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0095128899999999995 2024-04-19T03:03:17.018 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:17.018 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:17.018 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:03:17.018 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.200489+0000", 2024-04-19T03:03:17.018 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2554999999999999e-05 2024-04-19T03:03:17.018 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:17.018 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:17.018 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:17.018 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.200630+0000", 2024-04-19T03:03:17.018 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014055299999999999 2024-04-19T03:03:17.018 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:17.018 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:17.018 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:17.018 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:17.019 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:17.019 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-19T03:03:17.020 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T03:03:17.020 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:03:17.018+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:03:17.120 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:03:17.116+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:03:17.121 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-19T03:03:17.146 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-04-19T03:03:17.147 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [ 2024-04-19T03:03:17.147 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:17.147 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:204561 5.3 5:c64caea5:::benchmark_data_smithi096_19531_object91111:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T03:03:17.147 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:03:17.142988+0000", 2024-04-19T03:03:17.147 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0032456099999999999, 2024-04-19T03:03:17.147 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0032711060000000002, 2024-04-19T03:03:17.147 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:17.147 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-04-19T03:03:17.147 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:17.147 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:17.147 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:17.147 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 204561 2024-04-19T03:03:17.148 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:17.148 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:17.148 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:17.148 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:17.148 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:17.142988+0000", 2024-04-19T03:03:17.148 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:17.148 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:17.148 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:17.148 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:17.148 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:17.142988+0000", 2024-04-19T03:03:17.148 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:17.148 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:17.148 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:17.149 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:17.149 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:17.142987+0000", 2024-04-19T03:03:17.149 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:03:17.149 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:17.149 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:17.149 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:17.149 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:17.142992+0000", 2024-04-19T03:03:17.149 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3329999999999998e-06 2024-04-19T03:03:17.149 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:17.149 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:17.149 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:17.149 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:17.143000+0000", 2024-04-19T03:03:17.149 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.3559999999999993e-06 2024-04-19T03:03:17.149 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:17.149 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:17.150 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:17.150 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:17.143004+0000", 2024-04-19T03:03:17.150 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1450000000000001e-06 2024-04-19T03:03:17.150 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:17.150 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:17.150 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:17.150 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:17.143035+0000", 2024-04-19T03:03:17.150 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.1161999999999997e-05 2024-04-19T03:03:17.150 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:17.150 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:17.150 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:17.150 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:17.143174+0000", 2024-04-19T03:03:17.150 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00013915999999999999 2024-04-19T03:03:17.151 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:17.151 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:17.151 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:17.151 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:17.151 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:17.151 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:204562 5.2 5:40e98301:::benchmark_data_smithi096_19531_object91112:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T03:03:17.151 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:03:17.143064+0000", 2024-04-19T03:03:17.151 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0031696720000000001, 2024-04-19T03:03:17.151 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0032730290000000002, 2024-04-19T03:03:17.151 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:17.151 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-04-19T03:03:17.151 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:17.151 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:17.151 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:17.151 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 204562 2024-04-19T03:03:17.152 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:17.152 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:17.152 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:17.152 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:17.152 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:17.143064+0000", 2024-04-19T03:03:17.152 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:17.152 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:17.152 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:17.152 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:17.152 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:17.143064+0000", 2024-04-19T03:03:17.152 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:17.152 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:17.152 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:17.153 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:17.153 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:17.143063+0000", 2024-04-19T03:03:17.153 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:17.153 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:17.153 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:17.153 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:17.153 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:17.143067+0000", 2024-04-19T03:03:17.153 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0679999999999998e-06 2024-04-19T03:03:17.153 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:17.153 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:17.153 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:17.153 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:17.143087+0000", 2024-04-19T03:03:17.153 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9448000000000001e-05 2024-04-19T03:03:17.154 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:17.154 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:17.154 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:17.154 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:17.143093+0000", 2024-04-19T03:03:17.154 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6890000000000001e-06 2024-04-19T03:03:17.154 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:17.154 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:17.154 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:17.154 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:17.143145+0000", 2024-04-19T03:03:17.154 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2630000000000003e-05 2024-04-19T03:03:17.154 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:17.154 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:17.154 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:17.154 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:17.143284+0000", 2024-04-19T03:03:17.155 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00013850599999999999 2024-04-19T03:03:17.155 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:17.155 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:17.155 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:17.155 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:17.155 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:17.155 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:204563 5.7 5:e2f92660:::benchmark_data_smithi096_19531_object91113:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T03:03:17.155 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:03:17.143108+0000", 2024-04-19T03:03:17.155 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.003126242, 2024-04-19T03:03:17.155 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.003303715, 2024-04-19T03:03:17.155 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:17.155 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-04-19T03:03:17.155 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:17.155 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:17.156 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:17.156 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 204563 2024-04-19T03:03:17.156 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:17.156 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:17.156 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:17.156 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:17.156 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:17.143108+0000", 2024-04-19T03:03:17.156 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:17.156 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:17.156 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:17.156 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:17.156 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:17.143108+0000", 2024-04-19T03:03:17.156 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:17.156 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:17.157 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:17.157 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:17.157 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:17.143107+0000", 2024-04-19T03:03:17.157 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:17.157 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:17.157 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:17.157 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:17.157 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:17.143110+0000", 2024-04-19T03:03:17.157 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2890000000000002e-06 2024-04-19T03:03:17.157 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:17.157 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:17.157 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:17.157 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:17.143126+0000", 2024-04-19T03:03:17.158 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.5560999999999999e-05 2024-04-19T03:03:17.158 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:17.158 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:17.158 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:17.158 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:17.143132+0000", 2024-04-19T03:03:17.158 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3049999999999998e-06 2024-04-19T03:03:17.158 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:17.158 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:17.158 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:17.158 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:17.143172+0000", 2024-04-19T03:03:17.158 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0336999999999997e-05 2024-04-19T03:03:17.158 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:17.158 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:17.158 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:17.159 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:17.143294+0000", 2024-04-19T03:03:17.159 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000121716 2024-04-19T03:03:17.159 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:17.159 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:17.159 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:17.159 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:17.159 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:17.159 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:204564 5.7 5:e0d072af:::benchmark_data_smithi096_19531_object91114:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T03:03:17.159 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:03:17.143143+0000", 2024-04-19T03:03:17.159 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.003090424, 2024-04-19T03:03:17.159 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0033150229999999998, 2024-04-19T03:03:17.159 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:17.159 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-04-19T03:03:17.159 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:17.160 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:17.160 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:17.160 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 204564 2024-04-19T03:03:17.160 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:17.160 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:17.160 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:17.160 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:17.160 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:17.143143+0000", 2024-04-19T03:03:17.160 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:17.160 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:17.160 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:17.160 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:17.160 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:17.143143+0000", 2024-04-19T03:03:17.160 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:17.161 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:17.161 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:17.161 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:17.161 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:17.143143+0000", 2024-04-19T03:03:17.161 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:17.161 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:17.161 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:17.161 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:17.161 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:17.143146+0000", 2024-04-19T03:03:17.161 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9170000000000002e-06 2024-04-19T03:03:17.161 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:17.161 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:17.161 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:17.161 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:17.143153+0000", 2024-04-19T03:03:17.162 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.764e-06 2024-04-19T03:03:17.162 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:17.162 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:17.162 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:17.162 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:17.143158+0000", 2024-04-19T03:03:17.162 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5450000000000003e-06 2024-04-19T03:03:17.162 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:17.162 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:17.162 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:17.162 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:17.145790+0000", 2024-04-19T03:03:17.162 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00263175 2024-04-19T03:03:17.162 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:17.162 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:17.163 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:17.163 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:17.145915+0000", 2024-04-19T03:03:17.163 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00012480999999999999 2024-04-19T03:03:17.163 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:17.163 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:17.163 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:17.163 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:17.163 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:17.163 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:204565 5.1 5:80f1d483:::benchmark_data_smithi096_19531_object91115:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T03:03:17.163 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:03:17.145270+0000", 2024-04-19T03:03:17.163 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.00096396399999999999, 2024-04-19T03:03:17.163 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001225638, 2024-04-19T03:03:17.163 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:17.164 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-04-19T03:03:17.164 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:17.164 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:17.164 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:17.164 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 204565 2024-04-19T03:03:17.164 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:17.164 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:17.164 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:17.164 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:17.164 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:17.145270+0000", 2024-04-19T03:03:17.164 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:17.164 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:17.164 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:17.164 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:17.165 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:17.145270+0000", 2024-04-19T03:03:17.165 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:17.165 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:17.165 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:17.165 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:17.165 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:17.145269+0000", 2024-04-19T03:03:17.165 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:03:17.165 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:17.165 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:17.165 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:17.165 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:17.145277+0000", 2024-04-19T03:03:17.165 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6769999999999995e-06 2024-04-19T03:03:17.165 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:17.165 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:17.165 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:17.165 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:17.145287+0000", 2024-04-19T03:03:17.166 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0608000000000001e-05 2024-04-19T03:03:17.166 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:17.166 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:17.166 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:17.166 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:17.145292+0000", 2024-04-19T03:03:17.166 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7500000000000003e-06 2024-04-19T03:03:17.166 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:17.166 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:17.166 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:17.166 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:17.145330+0000", 2024-04-19T03:03:17.166 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.8537000000000001e-05 2024-04-19T03:03:17.166 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:17.166 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:17.166 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:17.167 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:17.145418+0000", 2024-04-19T03:03:17.167 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.7816000000000001e-05 2024-04-19T03:03:17.167 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:17.167 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:17.167 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:17.167 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:17.167 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:17.167 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:204554 5.d 5:ba559637:::benchmark_data_smithi096_19531_object91104:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e62)", 2024-04-19T03:03:17.167 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:03:17.138904+0000", 2024-04-19T03:03:17.167 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0073297709999999997, 2024-04-19T03:03:17.167 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0076349749999999996, 2024-04-19T03:03:17.167 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:17.167 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:03:17.167 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:17.168 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:17.168 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:17.168 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 204554 2024-04-19T03:03:17.168 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:17.168 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:17.168 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:17.168 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:17.168 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:17.138904+0000", 2024-04-19T03:03:17.168 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:17.168 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:17.168 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:17.168 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:17.168 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:17.138904+0000", 2024-04-19T03:03:17.168 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:17.169 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:17.169 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:17.169 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:17.169 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:17.138903+0000", 2024-04-19T03:03:17.169 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:17.169 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:17.169 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:17.169 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:17.169 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:17.138907+0000", 2024-04-19T03:03:17.169 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1160000000000001e-06 2024-04-19T03:03:17.169 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:17.169 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:17.169 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:17.169 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:17.138914+0000", 2024-04-19T03:03:17.170 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3119999999999999e-06 2024-04-19T03:03:17.170 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:17.170 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:17.170 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:17.170 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:17.138918+0000", 2024-04-19T03:03:17.170 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1989999999999999e-06 2024-04-19T03:03:17.170 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:17.170 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:17.170 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:17.170 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:17.138966+0000", 2024-04-19T03:03:17.170 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8037000000000001e-05 2024-04-19T03:03:17.170 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:17.170 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:17.171 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:17.171 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:17.139110+0000", 2024-04-19T03:03:17.171 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00014379900000000001 2024-04-19T03:03:17.171 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:17.171 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:17.171 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:03:17.171 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:17.139253+0000", 2024-04-19T03:03:17.171 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00014363000000000001 2024-04-19T03:03:17.171 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:17.171 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:17.171 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:03:17.171 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:17.143701+0000", 2024-04-19T03:03:17.171 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0044475360000000002 2024-04-19T03:03:17.171 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:17.172 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:17.172 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:17.172 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:17.172 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-04-19T03:03:17.172 INFO:teuthology.orchestra.run.smithi144.stdout: "num_ops": 6 2024-04-19T03:03:17.172 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-04-19T03:03:17.173 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T03:03:17.221 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:03:17.218+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:03:17.281 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1: {} 2024-04-19T03:03:17.303 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-04-19T03:03:17.303 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2024-04-19T03:03:17.303 INFO:teuthology.orchestra.run.smithi144.stdout: "complaint_time": 30, 2024-04-19T03:03:17.303 INFO:teuthology.orchestra.run.smithi144.stdout: "num_blocked_ops": 0 2024-04-19T03:03:17.303 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-04-19T03:03:17.307 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2: {} 2024-04-19T03:03:17.307 INFO:teuthology.orchestra.run.smithi096.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-04-19T03:03:17.307 INFO:teuthology.orchestra.run.smithi096.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-19T03:03:17.307 INFO:teuthology.orchestra.run.smithi096.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-19T03:03:17.312 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-19T03:03:17.312 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-19T03:03:17.316 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T03:03:17.322 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:03:17.318+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:03:17.422 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:03:17.420+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:03:17.442 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-04-19T03:03:17.442 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:03:17.454 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T03:03:17.524 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:03:17.520+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:03:17.587 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-19T03:03:17.587 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:03:17.596 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T03:03:17.624 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:03:17.622+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:03:17.647 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-19T03:03:17.719 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-19T03:03:17.719 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:03:17.725 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:03:17.722+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:03:17.730 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T03:03:17.826 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:03:17.822+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:03:17.901 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-19T03:03:17.901 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:03:17.915 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T03:03:17.927 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:03:17.922+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:03:18.028 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:03:18.024+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:03:18.044 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-04-19T03:03:18.044 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:03:18.057 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T03:03:18.129 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:03:18.124+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:03:18.228 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-04-19T03:03:18.229 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:03:18.230 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:03:18.226+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:03:18.239 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T03:03:18.330 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:03:18.328+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:03:18.362 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-04-19T03:03:18.362 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:03:18.374 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T03:03:18.431 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:03:18.426+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:03:18.500 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-19T03:03:18.500 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:03:18.513 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T03:03:18.532 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:03:18.528+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:03:18.633 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-19T03:03:18.633 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:03:18.634 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:03:18.630+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:03:18.649 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T03:03:18.669 INFO:teuthology.orchestra.run.smithi096.stderr:noscrub is unset 2024-04-19T03:03:18.733 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:03:18.728+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:03:18.774 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-19T03:03:18.774 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:03:18.786 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T03:03:18.834 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:03:18.830+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:03:18.915 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-04-19T03:03:18.915 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:03:18.929 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T03:03:18.935 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:03:18.932+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:03:19.038 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:03:19.034+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:03:19.060 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-04-19T03:03:19.061 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:03:19.072 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T03:03:19.138 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:03:19.136+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:03:19.203 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-04-19T03:03:19.203 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:03:19.215 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T03:03:19.258 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:03:19.256+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:03:19.313 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-19T03:03:19.340 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:03:19.336+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:03:19.341 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-19T03:03:19.341 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:03:19.352 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T03:03:19.445 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:03:19.440+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:03:19.464 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1: {} 2024-04-19T03:03:19.476 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-19T03:03:19.476 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-04-19T03:03:19.476 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-04-19T03:03:19.476 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-04-19T03:03:19.476 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-19T03:03:19.486 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2: {} 2024-04-19T03:03:19.486 INFO:teuthology.orchestra.run.smithi096.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-04-19T03:03:19.486 INFO:teuthology.orchestra.run.smithi096.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-19T03:03:19.486 INFO:teuthology.orchestra.run.smithi096.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-19T03:03:19.487 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T03:03:19.491 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-19T03:03:19.492 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-19T03:03:19.544 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:03:19.540+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:03:19.612 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-19T03:03:19.612 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-04-19T03:03:19.612 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-04-19T03:03:19.612 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-04-19T03:03:19.612 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.612 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:86615 5.e 5:7fef7288:::benchmark_data_smithi096_19531_object86614:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:19.612 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:22.634544+0000", 2024-04-19T03:03:19.612 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 56.975087721999998, 2024-04-19T03:03:19.613 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.192475071, 2024-04-19T03:03:19.613 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:19.613 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:19.613 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:19.613 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:19.613 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:19.613 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 86615 2024-04-19T03:03:19.613 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.613 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:19.613 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.613 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:19.613 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634544+0000", 2024-04-19T03:03:19.613 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:19.613 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.614 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.614 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:19.614 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634544+0000", 2024-04-19T03:03:19.614 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:19.614 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.614 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.614 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:19.614 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634542+0000", 2024-04-19T03:03:19.614 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999981 2024-04-19T03:03:19.614 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.614 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.614 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:19.614 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634585+0000", 2024-04-19T03:03:19.614 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2299000000000003e-05 2024-04-19T03:03:19.615 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.615 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.615 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:19.615 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634592+0000", 2024-04-19T03:03:19.615 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2350000000000002e-06 2024-04-19T03:03:19.615 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.615 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.615 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:19.615 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634596+0000", 2024-04-19T03:03:19.615 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5390000000000001e-06 2024-04-19T03:03:19.615 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.615 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.615 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:19.615 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634639+0000", 2024-04-19T03:03:19.616 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2444999999999998e-05 2024-04-19T03:03:19.616 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.616 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.616 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:19.616 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634808+0000", 2024-04-19T03:03:19.616 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000169152 2024-04-19T03:03:19.616 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.616 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.616 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:19.616 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634999+0000", 2024-04-19T03:03:19.616 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00019098300000000001 2024-04-19T03:03:19.616 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.616 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.616 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:19.617 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.640458+0000", 2024-04-19T03:03:19.617 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0054586870000000003 2024-04-19T03:03:19.617 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.617 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.617 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:19.617 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.826949+0000", 2024-04-19T03:03:19.617 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.18649178299999999 2024-04-19T03:03:19.617 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.617 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.617 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:03:19.617 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.826982+0000", 2024-04-19T03:03:19.617 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2477000000000001e-05 2024-04-19T03:03:19.617 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.617 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.618 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:19.618 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.827019+0000", 2024-04-19T03:03:19.618 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7355999999999999e-05 2024-04-19T03:03:19.618 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:19.618 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:19.618 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:19.618 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.618 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.618 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:86616 5.e 5:72278f47:::benchmark_data_smithi096_19531_object86615:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:19.618 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:22.634609+0000", 2024-04-19T03:03:19.618 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 56.975022572999997, 2024-04-19T03:03:19.618 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.19472088900000001, 2024-04-19T03:03:19.618 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:19.618 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:19.619 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:19.619 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:19.619 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:19.619 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 86616 2024-04-19T03:03:19.619 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.619 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:19.619 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.619 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:19.619 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634609+0000", 2024-04-19T03:03:19.619 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:19.619 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.619 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.619 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:19.619 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634609+0000", 2024-04-19T03:03:19.619 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:19.620 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.620 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.620 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:19.620 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634609+0000", 2024-04-19T03:03:19.620 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:19.620 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.620 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.620 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:19.620 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634651+0000", 2024-04-19T03:03:19.620 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2589000000000002e-05 2024-04-19T03:03:19.620 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.620 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.620 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:19.620 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634659+0000", 2024-04-19T03:03:19.621 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5850000000000002e-06 2024-04-19T03:03:19.621 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.621 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.621 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:19.621 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634662+0000", 2024-04-19T03:03:19.621 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3620000000000002e-06 2024-04-19T03:03:19.621 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.621 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.621 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:19.621 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.637880+0000", 2024-04-19T03:03:19.621 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.003218149 2024-04-19T03:03:19.621 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.621 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.621 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:19.622 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.637999+0000", 2024-04-19T03:03:19.622 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000118643 2024-04-19T03:03:19.622 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.622 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.622 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:19.622 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.638102+0000", 2024-04-19T03:03:19.622 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010331 2024-04-19T03:03:19.622 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.622 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.623 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:19.623 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.640851+0000", 2024-04-19T03:03:19.623 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0027483310000000001 2024-04-19T03:03:19.623 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.623 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.623 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:19.623 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.829269+0000", 2024-04-19T03:03:19.623 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.188418319 2024-04-19T03:03:19.623 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.623 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.623 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:03:19.623 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.829299+0000", 2024-04-19T03:03:19.623 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0227e-05 2024-04-19T03:03:19.624 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.624 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.624 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:19.624 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.829330+0000", 2024-04-19T03:03:19.624 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0969000000000001e-05 2024-04-19T03:03:19.624 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:19.624 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:19.624 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:19.624 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.624 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.624 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:86618 5.0 5:09014b90:::benchmark_data_smithi096_19531_object86617:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:19.624 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:22.634894+0000", 2024-04-19T03:03:19.624 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 56.974738084999998, 2024-04-19T03:03:19.624 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.19413419800000001, 2024-04-19T03:03:19.625 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:19.625 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:19.625 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:19.625 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:19.625 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:19.625 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 86618 2024-04-19T03:03:19.625 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.625 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:19.625 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.625 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:19.625 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634894+0000", 2024-04-19T03:03:19.625 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:19.625 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.625 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.625 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:19.625 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634894+0000", 2024-04-19T03:03:19.626 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:19.626 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.626 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.626 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:19.626 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634893+0000", 2024-04-19T03:03:19.626 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:03:19.626 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.626 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.626 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:19.626 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634976+0000", 2024-04-19T03:03:19.626 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3231000000000003e-05 2024-04-19T03:03:19.626 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.627 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.627 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:19.627 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634983+0000", 2024-04-19T03:03:19.627 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5169999999999996e-06 2024-04-19T03:03:19.627 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.627 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.627 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:19.627 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634987+0000", 2024-04-19T03:03:19.627 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.425e-06 2024-04-19T03:03:19.627 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.627 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.627 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:19.627 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635030+0000", 2024-04-19T03:03:19.627 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.32e-05 2024-04-19T03:03:19.628 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.628 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.628 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:19.628 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635185+0000", 2024-04-19T03:03:19.628 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015471899999999999 2024-04-19T03:03:19.628 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.628 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.628 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:19.628 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635415+0000", 2024-04-19T03:03:19.628 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00023026500000000001 2024-04-19T03:03:19.628 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.628 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.628 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:19.628 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.640127+0000", 2024-04-19T03:03:19.629 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0047118890000000004 2024-04-19T03:03:19.629 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.629 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.629 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:19.629 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.828895+0000", 2024-04-19T03:03:19.629 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.18876802600000001 2024-04-19T03:03:19.629 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.629 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.629 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:03:19.629 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.828972+0000", 2024-04-19T03:03:19.629 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.6345000000000002e-05 2024-04-19T03:03:19.629 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.629 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.630 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:19.630 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.829028+0000", 2024-04-19T03:03:19.630 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6342999999999999e-05 2024-04-19T03:03:19.630 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:19.630 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:19.630 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:19.630 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.630 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.630 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:86620 5.b 5:d80faa68:::benchmark_data_smithi096_19531_object86619:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:19.630 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:22.635110+0000", 2024-04-19T03:03:19.630 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 56.974521525, 2024-04-19T03:03:19.630 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.193447275, 2024-04-19T03:03:19.630 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:19.631 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:19.631 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:19.631 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:19.631 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:19.631 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 86620 2024-04-19T03:03:19.631 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.631 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:19.631 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.631 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:19.633 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635110+0000", 2024-04-19T03:03:19.633 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:19.633 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.633 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.634 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:19.634 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635110+0000", 2024-04-19T03:03:19.634 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:19.634 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.634 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.634 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:19.634 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635110+0000", 2024-04-19T03:03:19.634 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:19.634 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.634 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.634 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:19.634 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635154+0000", 2024-04-19T03:03:19.634 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4681000000000001e-05 2024-04-19T03:03:19.634 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.635 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.635 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:19.635 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635166+0000", 2024-04-19T03:03:19.635 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1505000000000001e-05 2024-04-19T03:03:19.635 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.635 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.635 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:19.635 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635171+0000", 2024-04-19T03:03:19.635 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6040000000000003e-06 2024-04-19T03:03:19.635 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.635 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.635 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:19.635 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635221+0000", 2024-04-19T03:03:19.635 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9947000000000001e-05 2024-04-19T03:03:19.636 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.636 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.636 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:19.636 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635356+0000", 2024-04-19T03:03:19.636 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013576199999999999 2024-04-19T03:03:19.636 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.636 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.636 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:19.636 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635507+0000", 2024-04-19T03:03:19.636 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015072999999999999 2024-04-19T03:03:19.636 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.636 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.636 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:19.636 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.638488+0000", 2024-04-19T03:03:19.637 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0029813159999999999 2024-04-19T03:03:19.637 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.637 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.637 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:19.637 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.828341+0000", 2024-04-19T03:03:19.637 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.189852254 2024-04-19T03:03:19.637 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.637 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.637 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:03:19.637 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.828416+0000", 2024-04-19T03:03:19.637 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5344000000000002e-05 2024-04-19T03:03:19.637 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.637 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.637 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:19.637 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.828558+0000", 2024-04-19T03:03:19.638 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000141695 2024-04-19T03:03:19.638 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:19.638 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:19.638 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:19.638 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.638 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.638 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:86621 5.8 5:1597a420:::benchmark_data_smithi096_19531_object86620:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:19.638 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:22.635187+0000", 2024-04-19T03:03:19.638 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 56.974444665, 2024-04-19T03:03:19.638 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.194204878, 2024-04-19T03:03:19.638 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:19.638 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:19.638 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:19.639 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:19.639 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:19.639 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 86621 2024-04-19T03:03:19.639 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.639 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:19.639 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.639 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:19.639 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635187+0000", 2024-04-19T03:03:19.639 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:19.639 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.639 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.639 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:19.639 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635187+0000", 2024-04-19T03:03:19.639 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:19.639 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.640 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.640 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:19.640 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635187+0000", 2024-04-19T03:03:19.640 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:19.640 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.640 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.640 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:19.640 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635242+0000", 2024-04-19T03:03:19.640 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5158000000000003e-05 2024-04-19T03:03:19.640 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.640 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.640 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:19.640 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635249+0000", 2024-04-19T03:03:19.640 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.7000000000000008e-06 2024-04-19T03:03:19.641 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.641 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.641 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:19.641 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635256+0000", 2024-04-19T03:03:19.641 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2060000000000004e-06 2024-04-19T03:03:19.641 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.641 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.641 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:19.641 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635302+0000", 2024-04-19T03:03:19.641 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5954000000000001e-05 2024-04-19T03:03:19.641 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.641 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.641 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:19.641 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635427+0000", 2024-04-19T03:03:19.642 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012559299999999999 2024-04-19T03:03:19.642 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.642 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.642 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:19.642 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635596+0000", 2024-04-19T03:03:19.642 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000168615 2024-04-19T03:03:19.642 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.642 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.642 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:19.642 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.639320+0000", 2024-04-19T03:03:19.642 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0037244610000000001 2024-04-19T03:03:19.642 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.642 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.643 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:19.643 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.829277+0000", 2024-04-19T03:03:19.643 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.18995651099999999 2024-04-19T03:03:19.643 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.643 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.643 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:03:19.643 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.829341+0000", 2024-04-19T03:03:19.643 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3756000000000004e-05 2024-04-19T03:03:19.643 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.643 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.643 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:19.643 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.829392+0000", 2024-04-19T03:03:19.643 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1555999999999999e-05 2024-04-19T03:03:19.643 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:19.644 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:19.644 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:19.644 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.644 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.644 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87067 5.b 5:d57af71a:::benchmark_data_smithi096_19531_object87066:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:19.644 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.142233+0000", 2024-04-19T03:03:19.644 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 56.467398801999998, 2024-04-19T03:03:19.644 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.071692405000000001, 2024-04-19T03:03:19.644 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:19.644 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:19.644 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:19.644 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:19.644 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:19.644 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87067 2024-04-19T03:03:19.645 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.645 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:19.645 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.645 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:19.645 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142233+0000", 2024-04-19T03:03:19.645 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:19.645 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.645 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.645 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:19.645 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142233+0000", 2024-04-19T03:03:19.645 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:19.645 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.645 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.645 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:19.646 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142232+0000", 2024-04-19T03:03:19.646 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:03:19.646 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.646 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.646 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:19.646 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142277+0000", 2024-04-19T03:03:19.646 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5837000000000002e-05 2024-04-19T03:03:19.646 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.646 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.646 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:19.646 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142297+0000", 2024-04-19T03:03:19.646 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9561000000000001e-05 2024-04-19T03:03:19.646 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.647 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.647 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:19.647 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142311+0000", 2024-04-19T03:03:19.647 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3654e-05 2024-04-19T03:03:19.647 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.647 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.647 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:19.647 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142391+0000", 2024-04-19T03:03:19.647 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0123999999999994e-05 2024-04-19T03:03:19.647 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.647 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.647 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:19.647 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142669+0000", 2024-04-19T03:03:19.648 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00027829800000000001 2024-04-19T03:03:19.648 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.648 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.648 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:19.648 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142859+0000", 2024-04-19T03:03:19.648 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000190051 2024-04-19T03:03:19.648 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.648 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.648 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:19.648 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.150597+0000", 2024-04-19T03:03:19.648 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0077380299999999999 2024-04-19T03:03:19.648 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.648 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.648 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:19.648 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.213855+0000", 2024-04-19T03:03:19.649 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.063257987000000002 2024-04-19T03:03:19.649 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.649 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.649 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:03:19.649 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.213898+0000", 2024-04-19T03:03:19.649 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2916e-05 2024-04-19T03:03:19.649 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.649 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.649 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:19.649 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.213925+0000", 2024-04-19T03:03:19.649 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7503000000000001e-05 2024-04-19T03:03:19.649 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:19.649 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:19.649 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:19.650 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.650 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.650 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87069 5.b 5:da0c93b5:::benchmark_data_smithi096_19531_object87068:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:19.650 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.143402+0000", 2024-04-19T03:03:19.650 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 56.466229839999997, 2024-04-19T03:03:19.650 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.070678598999999995, 2024-04-19T03:03:19.650 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:19.650 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:19.650 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:19.650 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:19.650 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:19.650 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87069 2024-04-19T03:03:19.650 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.651 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:19.651 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.651 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:19.651 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.143402+0000", 2024-04-19T03:03:19.651 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:19.651 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.651 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.651 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:19.651 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.143402+0000", 2024-04-19T03:03:19.651 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:19.651 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.651 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.651 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:19.651 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.143401+0000", 2024-04-19T03:03:19.652 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:03:19.652 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.652 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.652 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:19.652 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.143501+0000", 2024-04-19T03:03:19.652 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000100387 2024-04-19T03:03:19.652 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.652 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.652 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:19.652 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.143516+0000", 2024-04-19T03:03:19.652 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5369000000000001e-05 2024-04-19T03:03:19.652 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.652 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.652 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:19.653 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.143524+0000", 2024-04-19T03:03:19.653 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.7079999999999997e-06 2024-04-19T03:03:19.653 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.653 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.653 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:19.653 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.145550+0000", 2024-04-19T03:03:19.653 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0020259290000000001 2024-04-19T03:03:19.653 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.653 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.653 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:19.653 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.145676+0000", 2024-04-19T03:03:19.653 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000126406 2024-04-19T03:03:19.653 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.653 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.654 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:19.654 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.145802+0000", 2024-04-19T03:03:19.654 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000125974 2024-04-19T03:03:19.654 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.654 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.654 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:19.654 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.151030+0000", 2024-04-19T03:03:19.654 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0052276079999999999 2024-04-19T03:03:19.654 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.654 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.654 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:19.654 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.213998+0000", 2024-04-19T03:03:19.654 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.06296786 2024-04-19T03:03:19.654 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.655 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.655 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:03:19.655 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.214031+0000", 2024-04-19T03:03:19.655 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3387999999999999e-05 2024-04-19T03:03:19.655 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.655 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.655 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:19.655 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.214081+0000", 2024-04-19T03:03:19.655 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9316e-05 2024-04-19T03:03:19.655 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:19.655 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:19.655 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:19.655 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.656 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.656 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87108 5.e 5:7e197adc:::benchmark_data_smithi096_19531_object87107:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:19.656 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.223103+0000", 2024-04-19T03:03:19.656 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 56.386528503000001, 2024-04-19T03:03:19.656 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.044946887, 2024-04-19T03:03:19.656 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:19.656 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-19T03:03:19.656 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:19.656 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:19.656 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:19.656 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87108 2024-04-19T03:03:19.656 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.656 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:19.656 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.656 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:19.657 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.223103+0000", 2024-04-19T03:03:19.657 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:19.657 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.657 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.657 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:19.657 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.223103+0000", 2024-04-19T03:03:19.657 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:19.657 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.657 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.657 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:19.657 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.223102+0000", 2024-04-19T03:03:19.657 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:03:19.657 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.657 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.658 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:19.658 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.223156+0000", 2024-04-19T03:03:19.658 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3958000000000001e-05 2024-04-19T03:03:19.658 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.658 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.658 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:19.658 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.223166+0000", 2024-04-19T03:03:19.658 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.4809999999999995e-06 2024-04-19T03:03:19.658 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.658 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.658 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:19.658 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.223172+0000", 2024-04-19T03:03:19.658 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0140000000000004e-06 2024-04-19T03:03:19.659 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.659 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.659 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:19.659 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.227295+0000", 2024-04-19T03:03:19.659 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0041233420000000003 2024-04-19T03:03:19.659 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.659 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.659 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:19.659 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.227495+0000", 2024-04-19T03:03:19.659 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00019955299999999999 2024-04-19T03:03:19.659 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.659 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.659 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:19.659 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.227717+0000", 2024-04-19T03:03:19.660 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000221902 2024-04-19T03:03:19.660 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.660 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.660 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:19.660 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233189+0000", 2024-04-19T03:03:19.660 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0054718889999999997 2024-04-19T03:03:19.660 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.660 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.660 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:19.660 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.250529+0000", 2024-04-19T03:03:19.660 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.017340298000000001 2024-04-19T03:03:19.660 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.660 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.660 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:03:19.660 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.250539+0000", 2024-04-19T03:03:19.661 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0501e-05 2024-04-19T03:03:19.661 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.661 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.661 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:19.661 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.268003+0000", 2024-04-19T03:03:19.661 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.017463429 2024-04-19T03:03:19.661 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.661 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.661 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:19.661 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.268050+0000", 2024-04-19T03:03:19.661 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7466000000000003e-05 2024-04-19T03:03:19.661 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:19.661 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:19.661 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:19.662 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.662 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.662 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87118 5.b 5:d1bb4f3c:::benchmark_data_smithi096_19531_object87117:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:19.662 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.231082+0000", 2024-04-19T03:03:19.662 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 56.378549669000002, 2024-04-19T03:03:19.662 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.035789004, 2024-04-19T03:03:19.662 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:19.662 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-19T03:03:19.662 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:19.662 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:19.662 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:19.662 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87118 2024-04-19T03:03:19.663 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.663 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:19.663 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.663 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:19.663 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231082+0000", 2024-04-19T03:03:19.663 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:19.663 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.663 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.663 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:19.663 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231082+0000", 2024-04-19T03:03:19.663 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:19.663 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.663 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.663 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:19.664 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231081+0000", 2024-04-19T03:03:19.664 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:03:19.664 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.664 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.664 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:19.664 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231159+0000", 2024-04-19T03:03:19.664 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.7819999999999997e-05 2024-04-19T03:03:19.664 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.664 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.664 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:19.664 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231186+0000", 2024-04-19T03:03:19.664 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7126000000000001e-05 2024-04-19T03:03:19.664 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.664 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.664 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:19.665 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231193+0000", 2024-04-19T03:03:19.665 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7259999999999996e-06 2024-04-19T03:03:19.665 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.665 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.665 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:19.665 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231241+0000", 2024-04-19T03:03:19.665 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8123e-05 2024-04-19T03:03:19.665 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.665 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.665 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:19.665 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231354+0000", 2024-04-19T03:03:19.665 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0001133 2024-04-19T03:03:19.665 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.665 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.666 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:19.666 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231443+0000", 2024-04-19T03:03:19.666 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9167999999999997e-05 2024-04-19T03:03:19.666 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.666 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.666 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:19.666 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236498+0000", 2024-04-19T03:03:19.666 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0050545160000000002 2024-04-19T03:03:19.666 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.666 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.666 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:19.666 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.249681+0000", 2024-04-19T03:03:19.666 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013183321 2024-04-19T03:03:19.666 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.666 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.667 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:03:19.667 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.249693+0000", 2024-04-19T03:03:19.667 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1834999999999999e-05 2024-04-19T03:03:19.667 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.667 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.667 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:19.667 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266733+0000", 2024-04-19T03:03:19.667 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.017040408 2024-04-19T03:03:19.667 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.667 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.667 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:19.667 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266871+0000", 2024-04-19T03:03:19.667 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000137849 2024-04-19T03:03:19.667 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:19.668 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:19.668 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:19.668 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.668 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.668 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87121 5.b 5:d01822b8:::benchmark_data_smithi096_19531_object87120:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:19.668 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.233319+0000", 2024-04-19T03:03:19.668 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 56.376312804999998, 2024-04-19T03:03:19.668 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.033624198, 2024-04-19T03:03:19.668 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:19.668 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-19T03:03:19.668 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:19.668 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:19.668 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:19.668 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87121 2024-04-19T03:03:19.669 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.669 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:19.669 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.669 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:19.669 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233319+0000", 2024-04-19T03:03:19.669 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:19.669 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.669 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.669 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:19.669 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233319+0000", 2024-04-19T03:03:19.669 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:19.669 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.669 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.669 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:19.670 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233319+0000", 2024-04-19T03:03:19.670 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:19.670 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.670 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.670 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:19.670 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233364+0000", 2024-04-19T03:03:19.670 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5460999999999997e-05 2024-04-19T03:03:19.670 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.670 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.670 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:19.670 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233382+0000", 2024-04-19T03:03:19.670 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8148e-05 2024-04-19T03:03:19.670 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.670 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.671 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:19.671 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233390+0000", 2024-04-19T03:03:19.671 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5340000000000002e-06 2024-04-19T03:03:19.671 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.671 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.671 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:19.671 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233712+0000", 2024-04-19T03:03:19.671 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00032260500000000001 2024-04-19T03:03:19.671 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.671 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.671 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:19.671 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233829+0000", 2024-04-19T03:03:19.671 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011638599999999999 2024-04-19T03:03:19.671 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.671 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.672 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:19.672 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233959+0000", 2024-04-19T03:03:19.672 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013013900000000001 2024-04-19T03:03:19.672 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.672 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.672 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:19.672 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236515+0000", 2024-04-19T03:03:19.672 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0025562750000000002 2024-04-19T03:03:19.672 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.672 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.672 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:19.672 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.249723+0000", 2024-04-19T03:03:19.672 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013208176 2024-04-19T03:03:19.672 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.673 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.673 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:03:19.673 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.249728+0000", 2024-04-19T03:03:19.673 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6519999999999997e-06 2024-04-19T03:03:19.673 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.673 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.673 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:19.673 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266837+0000", 2024-04-19T03:03:19.673 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0171087059999999 2024-04-19T03:03:19.673 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.673 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.673 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:19.673 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266943+0000", 2024-04-19T03:03:19.673 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000106604 2024-04-19T03:03:19.673 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:19.674 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:19.674 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:19.674 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.674 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.674 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87124 5.8 5:14819ad7:::benchmark_data_smithi096_19531_object87123:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:19.674 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.235886+0000", 2024-04-19T03:03:19.674 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 56.373745380999999, 2024-04-19T03:03:19.674 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0315451179999999, 2024-04-19T03:03:19.674 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:19.674 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-19T03:03:19.674 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:19.674 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:19.674 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:19.674 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87124 2024-04-19T03:03:19.675 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.675 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:19.675 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.675 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:19.675 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.235886+0000", 2024-04-19T03:03:19.675 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:19.675 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.675 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.675 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:19.675 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.235886+0000", 2024-04-19T03:03:19.675 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:19.675 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.675 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.675 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:19.676 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.235886+0000", 2024-04-19T03:03:19.676 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:03:19.676 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.676 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.676 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:19.676 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.235934+0000", 2024-04-19T03:03:19.676 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8384000000000003e-05 2024-04-19T03:03:19.676 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.676 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.676 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:19.676 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.235945+0000", 2024-04-19T03:03:19.676 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0671e-05 2024-04-19T03:03:19.676 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.676 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.676 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:19.677 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.235952+0000", 2024-04-19T03:03:19.677 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3089999999999998e-06 2024-04-19T03:03:19.677 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.677 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.677 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:19.677 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.237067+0000", 2024-04-19T03:03:19.677 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001115263 2024-04-19T03:03:19.677 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.677 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.677 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:19.677 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.237188+0000", 2024-04-19T03:03:19.677 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000121258 2024-04-19T03:03:19.677 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.677 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.678 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:19.678 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.237316+0000", 2024-04-19T03:03:19.678 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000128071 2024-04-19T03:03:19.678 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.678 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.678 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:19.678 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240744+0000", 2024-04-19T03:03:19.678 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0034275629999999998 2024-04-19T03:03:19.678 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.678 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.678 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:19.678 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.252517+0000", 2024-04-19T03:03:19.678 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011772991999999999 2024-04-19T03:03:19.678 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.679 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.679 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:03:19.679 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.252523+0000", 2024-04-19T03:03:19.679 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3640000000000004e-06 2024-04-19T03:03:19.679 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.679 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.679 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:19.679 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.267290+0000", 2024-04-19T03:03:19.679 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0147665690000001 2024-04-19T03:03:19.679 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.679 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.680 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:19.680 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.267432+0000", 2024-04-19T03:03:19.680 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014165299999999999 2024-04-19T03:03:19.680 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:19.680 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:19.680 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:19.680 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.680 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.680 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87129 5.0 5:02667e01:::benchmark_data_smithi096_19531_object87128:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:19.680 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.236466+0000", 2024-04-19T03:03:19.680 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 56.373165385, 2024-04-19T03:03:19.680 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0301534510000001, 2024-04-19T03:03:19.680 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:19.680 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-19T03:03:19.680 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:19.681 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:19.681 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:19.681 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87129 2024-04-19T03:03:19.681 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.681 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:19.681 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.681 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:19.681 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236466+0000", 2024-04-19T03:03:19.681 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:19.681 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.681 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.681 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:19.681 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236466+0000", 2024-04-19T03:03:19.681 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:19.682 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.682 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.682 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:19.682 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236465+0000", 2024-04-19T03:03:19.682 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:03:19.682 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.682 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.682 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:19.682 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236566+0000", 2024-04-19T03:03:19.682 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010047000000000001 2024-04-19T03:03:19.682 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.682 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.683 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:19.683 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236577+0000", 2024-04-19T03:03:19.683 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1772e-05 2024-04-19T03:03:19.683 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.683 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.683 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:19.683 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236584+0000", 2024-04-19T03:03:19.683 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0530000000000003e-06 2024-04-19T03:03:19.683 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.683 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.683 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:19.683 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.237023+0000", 2024-04-19T03:03:19.683 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000439703 2024-04-19T03:03:19.683 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.684 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.684 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:19.684 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.237207+0000", 2024-04-19T03:03:19.684 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000183692 2024-04-19T03:03:19.684 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.684 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.684 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:19.684 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.237373+0000", 2024-04-19T03:03:19.684 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016623500000000001 2024-04-19T03:03:19.684 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.684 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.684 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:19.684 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.241461+0000", 2024-04-19T03:03:19.684 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0040883050000000004 2024-04-19T03:03:19.685 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.685 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.685 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:19.685 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.252500+0000", 2024-04-19T03:03:19.685 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011038450999999999 2024-04-19T03:03:19.685 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.685 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.685 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:03:19.685 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.252507+0000", 2024-04-19T03:03:19.685 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2439999999999996e-06 2024-04-19T03:03:19.685 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.685 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.685 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:19.685 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266538+0000", 2024-04-19T03:03:19.686 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.014031184 2024-04-19T03:03:19.686 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.686 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.686 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:19.686 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266620+0000", 2024-04-19T03:03:19.686 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1600000000000005e-05 2024-04-19T03:03:19.686 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:19.686 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:19.686 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:19.686 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.686 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.686 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87135 5.4 5:2a97e7b7:::benchmark_data_smithi096_19531_object87134:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:19.686 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.240884+0000", 2024-04-19T03:03:19.686 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 56.368747927999998, 2024-04-19T03:03:19.687 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.025708931, 2024-04-19T03:03:19.687 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:19.687 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-19T03:03:19.687 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:19.687 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:19.687 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:19.687 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87135 2024-04-19T03:03:19.687 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.687 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:19.687 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.687 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:19.687 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240884+0000", 2024-04-19T03:03:19.687 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:19.687 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.687 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.688 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:19.688 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240884+0000", 2024-04-19T03:03:19.688 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:19.688 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.688 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.688 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:19.688 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240883+0000", 2024-04-19T03:03:19.688 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:03:19.688 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.688 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.688 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:19.688 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240933+0000", 2024-04-19T03:03:19.688 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9969999999999998e-05 2024-04-19T03:03:19.688 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.688 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.689 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:19.689 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240946+0000", 2024-04-19T03:03:19.689 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2943e-05 2024-04-19T03:03:19.689 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.689 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.689 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:19.689 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240952+0000", 2024-04-19T03:03:19.689 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8930000000000002e-06 2024-04-19T03:03:19.689 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.689 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.689 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:19.689 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240994+0000", 2024-04-19T03:03:19.689 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2753999999999998e-05 2024-04-19T03:03:19.689 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.690 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.690 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:19.690 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.241092+0000", 2024-04-19T03:03:19.690 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.7447000000000004e-05 2024-04-19T03:03:19.690 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.690 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.690 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:19.690 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.241183+0000", 2024-04-19T03:03:19.690 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1163999999999997e-05 2024-04-19T03:03:19.690 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.690 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.690 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:19.690 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.254672+0000", 2024-04-19T03:03:19.690 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.01348864 2024-04-19T03:03:19.691 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.691 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.691 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:03:19.691 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.254681+0000", 2024-04-19T03:03:19.691 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.3789999999999995e-06 2024-04-19T03:03:19.691 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.691 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.691 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:19.691 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266456+0000", 2024-04-19T03:03:19.691 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.011774621 2024-04-19T03:03:19.691 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.691 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.691 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:19.691 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266593+0000", 2024-04-19T03:03:19.691 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013737600000000001 2024-04-19T03:03:19.692 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:19.692 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:19.692 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:19.692 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.692 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.692 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87136 5.4 5:212411bc:::benchmark_data_smithi096_19531_object87135:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:19.692 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.240962+0000", 2024-04-19T03:03:19.692 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 56.368670051999999, 2024-04-19T03:03:19.692 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.025738, 2024-04-19T03:03:19.692 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:19.692 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-19T03:03:19.692 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:19.692 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:19.692 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:19.692 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87136 2024-04-19T03:03:19.693 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.693 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:19.693 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.693 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:19.693 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240962+0000", 2024-04-19T03:03:19.693 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:19.693 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.693 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.693 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:19.693 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240962+0000", 2024-04-19T03:03:19.693 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:19.693 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.693 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.693 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:19.693 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240961+0000", 2024-04-19T03:03:19.694 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:19.694 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.694 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.694 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:19.694 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240995+0000", 2024-04-19T03:03:19.694 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3868000000000002e-05 2024-04-19T03:03:19.694 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.694 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.694 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:19.694 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.241001+0000", 2024-04-19T03:03:19.694 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.322e-06 2024-04-19T03:03:19.694 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.694 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.694 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:19.695 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.241004+0000", 2024-04-19T03:03:19.695 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3510000000000002e-06 2024-04-19T03:03:19.695 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.695 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.695 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:19.695 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247131+0000", 2024-04-19T03:03:19.695 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0061270869999999998 2024-04-19T03:03:19.695 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.695 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.695 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:19.695 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247322+0000", 2024-04-19T03:03:19.695 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000191015 2024-04-19T03:03:19.695 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.695 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.696 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:19.696 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247542+0000", 2024-04-19T03:03:19.696 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00022030199999999999 2024-04-19T03:03:19.696 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.696 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.696 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:19.696 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.254709+0000", 2024-04-19T03:03:19.696 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0071662660000000001 2024-04-19T03:03:19.696 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.696 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.696 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:03:19.696 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.254716+0000", 2024-04-19T03:03:19.696 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3860000000000001e-06 2024-04-19T03:03:19.696 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.696 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.697 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:19.697 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266619+0000", 2024-04-19T03:03:19.697 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0119031030000001 2024-04-19T03:03:19.697 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.697 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.697 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:19.697 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266700+0000", 2024-04-19T03:03:19.697 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0764000000000001e-05 2024-04-19T03:03:19.697 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:19.697 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:19.697 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:19.697 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.697 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.697 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87138 5.e 5:7b1f1c20:::benchmark_data_smithi096_19531_object87137:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:19.698 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.247862+0000", 2024-04-19T03:03:19.698 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 56.361769977999998, 2024-04-19T03:03:19.698 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.024457079, 2024-04-19T03:03:19.698 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:19.698 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:19.698 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:19.698 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:19.698 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:19.698 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87138 2024-04-19T03:03:19.698 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.698 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:19.698 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.698 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:19.699 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247862+0000", 2024-04-19T03:03:19.699 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:19.699 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.699 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.699 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:19.699 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247862+0000", 2024-04-19T03:03:19.699 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:19.699 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.699 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.699 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:19.699 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247860+0000", 2024-04-19T03:03:19.699 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999981 2024-04-19T03:03:19.699 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.699 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.700 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:19.700 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247909+0000", 2024-04-19T03:03:19.700 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9150999999999997e-05 2024-04-19T03:03:19.700 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.700 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.700 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:19.700 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247925+0000", 2024-04-19T03:03:19.700 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5761999999999999e-05 2024-04-19T03:03:19.700 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.700 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.700 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:19.700 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247936+0000", 2024-04-19T03:03:19.700 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1144e-05 2024-04-19T03:03:19.700 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.700 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.701 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:19.701 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.250590+0000", 2024-04-19T03:03:19.701 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.002653678 2024-04-19T03:03:19.701 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.701 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.701 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:03:19.701 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.250599+0000", 2024-04-19T03:03:19.701 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9039999999999998e-06 2024-04-19T03:03:19.701 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.701 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.701 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:19.701 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.268151+0000", 2024-04-19T03:03:19.701 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0175523449999999 2024-04-19T03:03:19.701 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.702 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.702 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:19.702 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.268285+0000", 2024-04-19T03:03:19.702 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013415599999999999 2024-04-19T03:03:19.702 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.702 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.702 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:19.702 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.272238+0000", 2024-04-19T03:03:19.702 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0039533019999999997 2024-04-19T03:03:19.702 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.702 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.702 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:03:19.702 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.272274+0000", 2024-04-19T03:03:19.702 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5352000000000003e-05 2024-04-19T03:03:19.703 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.703 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.703 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:19.703 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.272319+0000", 2024-04-19T03:03:19.703 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5281999999999998e-05 2024-04-19T03:03:19.703 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:19.703 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:19.703 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:19.703 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.703 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.703 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:158371 5.8 5:11a83024:::benchmark_data_smithi096_19531_object44921:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-19T03:03:19.703 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:58.125869+0000", 2024-04-19T03:03:19.703 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 21.483763112999998, 2024-04-19T03:03:19.703 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074532857999999994, 2024-04-19T03:03:19.704 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:19.704 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:19.704 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:19.704 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:19.704 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:19.704 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 158371 2024-04-19T03:03:19.704 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.704 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:19.704 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.704 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:19.704 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125869+0000", 2024-04-19T03:03:19.704 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:19.704 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.704 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.704 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:19.705 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125869+0000", 2024-04-19T03:03:19.705 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:19.705 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.705 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.705 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:19.705 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125868+0000", 2024-04-19T03:03:19.705 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:03:19.705 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.705 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.705 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:19.705 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125874+0000", 2024-04-19T03:03:19.705 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7120000000000003e-06 2024-04-19T03:03:19.705 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.705 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.706 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:19.706 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125885+0000", 2024-04-19T03:03:19.706 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0665999999999999e-05 2024-04-19T03:03:19.706 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.706 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.706 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:19.706 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125901+0000", 2024-04-19T03:03:19.706 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6463000000000001e-05 2024-04-19T03:03:19.706 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.706 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.706 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:19.706 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125956+0000", 2024-04-19T03:03:19.706 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4728000000000002e-05 2024-04-19T03:03:19.706 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.707 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.707 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:19.707 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.126050+0000", 2024-04-19T03:03:19.707 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.3534000000000003e-05 2024-04-19T03:03:19.707 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.707 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.707 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:19.707 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.200187+0000", 2024-04-19T03:03:19.707 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074136933000000002 2024-04-19T03:03:19.707 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.707 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.707 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:03:19.707 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.200260+0000", 2024-04-19T03:03:19.707 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3090999999999995e-05 2024-04-19T03:03:19.707 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.708 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.708 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:19.708 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.200402+0000", 2024-04-19T03:03:19.708 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014193699999999999 2024-04-19T03:03:19.708 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:19.708 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:19.708 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:19.708 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.708 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.708 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:158372 5.0 5:0473aa5f:::benchmark_data_smithi096_19531_object44922:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-19T03:03:19.708 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:58.125924+0000", 2024-04-19T03:03:19.708 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 21.483707506000002, 2024-04-19T03:03:19.708 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074247490999999999, 2024-04-19T03:03:19.709 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:19.709 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:19.709 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:19.709 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:19.709 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:19.709 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 158372 2024-04-19T03:03:19.709 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.709 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:19.709 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.709 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:19.709 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125924+0000", 2024-04-19T03:03:19.709 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:19.709 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.709 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.710 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:19.710 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125924+0000", 2024-04-19T03:03:19.710 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:19.710 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.710 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.710 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:19.710 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125924+0000", 2024-04-19T03:03:19.710 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:19.710 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.710 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.710 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:19.710 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125927+0000", 2024-04-19T03:03:19.710 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5389999999999999e-06 2024-04-19T03:03:19.710 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.711 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.711 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:19.711 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125935+0000", 2024-04-19T03:03:19.711 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3259999999999998e-06 2024-04-19T03:03:19.711 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.711 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.711 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:19.711 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125940+0000", 2024-04-19T03:03:19.711 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6980000000000003e-06 2024-04-19T03:03:19.711 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.711 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.711 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:19.711 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125982+0000", 2024-04-19T03:03:19.711 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1337000000000001e-05 2024-04-19T03:03:19.712 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.712 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.712 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:19.712 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.126075+0000", 2024-04-19T03:03:19.712 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.3579999999999995e-05 2024-04-19T03:03:19.712 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.712 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.712 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:19.712 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.199953+0000", 2024-04-19T03:03:19.712 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073877604999999999 2024-04-19T03:03:19.712 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.712 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.712 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:03:19.712 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.200022+0000", 2024-04-19T03:03:19.712 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.8824000000000004e-05 2024-04-19T03:03:19.713 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.713 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.713 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:19.713 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.200172+0000", 2024-04-19T03:03:19.713 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015017700000000001 2024-04-19T03:03:19.713 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:19.713 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:19.713 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:19.713 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.713 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.713 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:158374 5.e 5:76be57a5:::benchmark_data_smithi096_19531_object44924:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-19T03:03:19.713 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:58.125988+0000", 2024-04-19T03:03:19.713 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 21.483644006999999, 2024-04-19T03:03:19.714 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.067843332000000006, 2024-04-19T03:03:19.714 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:19.714 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:19.714 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:19.714 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:19.714 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:19.714 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 158374 2024-04-19T03:03:19.714 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.714 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:19.714 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.714 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:19.714 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125988+0000", 2024-04-19T03:03:19.714 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:19.714 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.715 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.715 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:19.715 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125988+0000", 2024-04-19T03:03:19.715 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:19.715 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.715 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.715 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:19.715 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125987+0000", 2024-04-19T03:03:19.715 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:19.715 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.715 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.715 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:19.715 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125990+0000", 2024-04-19T03:03:19.715 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7989999999999998e-06 2024-04-19T03:03:19.716 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.716 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.716 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:19.716 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125996+0000", 2024-04-19T03:03:19.716 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.302e-06 2024-04-19T03:03:19.716 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.716 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.716 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:19.716 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.126001+0000", 2024-04-19T03:03:19.716 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.843e-06 2024-04-19T03:03:19.716 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.716 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.716 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:19.716 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.126047+0000", 2024-04-19T03:03:19.717 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6066000000000002e-05 2024-04-19T03:03:19.717 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.717 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.717 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:19.717 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.126171+0000", 2024-04-19T03:03:19.717 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012359099999999999 2024-04-19T03:03:19.717 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.717 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.717 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:19.717 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.193709+0000", 2024-04-19T03:03:19.717 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.067538099000000004 2024-04-19T03:03:19.717 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.717 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.717 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:03:19.718 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.193766+0000", 2024-04-19T03:03:19.718 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6869e-05 2024-04-19T03:03:19.718 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.718 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.718 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:19.718 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.193831+0000", 2024-04-19T03:03:19.718 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5273999999999999e-05 2024-04-19T03:03:19.718 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:19.718 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:19.718 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:19.718 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.718 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.718 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4755.0:158376 5.9 e56/22 5:9e73c076:::benchmark_data_smithi096_19531_object44926:head v 56'9663, mlcod=56'9661)", 2024-04-19T03:03:19.719 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:58.127307+0000", 2024-04-19T03:03:19.719 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 21.482324775999999, 2024-04-19T03:03:19.719 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069002716000000006, 2024-04-19T03:03:19.719 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:19.719 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:19.719 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:19.719 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.719 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:19.719 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.127307+0000", 2024-04-19T03:03:19.719 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:19.719 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.719 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.719 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:19.719 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.127307+0000", 2024-04-19T03:03:19.720 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:19.720 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.720 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.720 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:19.720 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.127306+0000", 2024-04-19T03:03:19.720 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:03:19.720 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.720 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.720 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:19.720 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.127316+0000", 2024-04-19T03:03:19.720 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.3039999999999994e-06 2024-04-19T03:03:19.720 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.720 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.720 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:19.721 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.127326+0000", 2024-04-19T03:03:19.721 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0009e-05 2024-04-19T03:03:19.721 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.721 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.721 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:19.721 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.127332+0000", 2024-04-19T03:03:19.721 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5880000000000003e-06 2024-04-19T03:03:19.721 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.721 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.721 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:19.721 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.127383+0000", 2024-04-19T03:03:19.721 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0516000000000002e-05 2024-04-19T03:03:19.721 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.721 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.722 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:19.722 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.127403+0000", 2024-04-19T03:03:19.722 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0547000000000002e-05 2024-04-19T03:03:19.722 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.722 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.722 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:03:19.722 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.196280+0000", 2024-04-19T03:03:19.722 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.068876863999999996 2024-04-19T03:03:19.722 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.722 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.722 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:19.722 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.196310+0000", 2024-04-19T03:03:19.722 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9762999999999999e-05 2024-04-19T03:03:19.722 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:19.723 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:19.723 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:19.723 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.723 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.723 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:158383 5.0 5:026717eb:::benchmark_data_smithi096_19531_object44933:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-19T03:03:19.723 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:58.130494+0000", 2024-04-19T03:03:19.723 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 21.479137649999998, 2024-04-19T03:03:19.723 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.070135775999999997, 2024-04-19T03:03:19.723 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:19.723 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:19.723 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:19.723 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:19.723 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:19.723 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 158383 2024-04-19T03:03:19.724 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.724 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:19.724 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.724 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:19.724 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.130494+0000", 2024-04-19T03:03:19.724 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:19.724 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.724 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.724 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:19.724 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.130494+0000", 2024-04-19T03:03:19.724 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:19.724 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.724 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.724 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:19.725 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.130493+0000", 2024-04-19T03:03:19.725 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:03:19.725 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.725 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.725 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:19.725 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.130500+0000", 2024-04-19T03:03:19.725 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5490000000000003e-06 2024-04-19T03:03:19.725 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.725 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.725 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:19.725 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.190401+0000", 2024-04-19T03:03:19.725 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.059901668999999998 2024-04-19T03:03:19.725 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.725 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.726 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:19.726 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.190421+0000", 2024-04-19T03:03:19.726 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0288e-05 2024-04-19T03:03:19.726 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.726 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.726 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:19.726 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.190536+0000", 2024-04-19T03:03:19.726 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000114783 2024-04-19T03:03:19.726 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.726 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.726 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:19.726 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.190904+0000", 2024-04-19T03:03:19.726 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00036773900000000001 2024-04-19T03:03:19.726 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.726 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.727 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:19.727 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.200417+0000", 2024-04-19T03:03:19.727 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0095128899999999995 2024-04-19T03:03:19.727 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.727 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.727 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:03:19.727 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.200489+0000", 2024-04-19T03:03:19.727 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2554999999999999e-05 2024-04-19T03:03:19.727 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:19.727 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:19.727 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:19.727 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.200630+0000", 2024-04-19T03:03:19.727 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014055299999999999 2024-04-19T03:03:19.727 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:19.728 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:19.728 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:19.728 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:19.728 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:19.728 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-19T03:03:19.729 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T03:03:19.730 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:03:19.726+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:03:19.830 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:03:19.828+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:03:19.856 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-04-19T03:03:19.856 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [ 2024-04-19T03:03:19.856 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:19.856 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:211001 5.3 5:cca9c15f:::benchmark_data_smithi096_19531_object97551:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-19T03:03:19.856 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:03:19.854309+0000", 2024-04-19T03:03:19.857 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.001074883, 2024-04-19T03:03:19.857 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001090253, 2024-04-19T03:03:19.857 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:19.857 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-04-19T03:03:19.857 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:19.857 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:19.857 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:19.857 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 211001 2024-04-19T03:03:19.857 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:19.857 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:19.857 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:19.857 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:19.857 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:19.854309+0000", 2024-04-19T03:03:19.857 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:19.857 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:19.858 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:19.858 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:19.858 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:19.854309+0000", 2024-04-19T03:03:19.858 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:19.858 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:19.858 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:19.858 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:19.858 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:19.854308+0000", 2024-04-19T03:03:19.858 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:03:19.858 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:19.858 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:19.858 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:19.858 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:19.854314+0000", 2024-04-19T03:03:19.859 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7139999999999998e-06 2024-04-19T03:03:19.859 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:19.859 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:19.859 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:19.859 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:19.854329+0000", 2024-04-19T03:03:19.859 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4704e-05 2024-04-19T03:03:19.859 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:19.859 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:19.859 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:19.859 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:19.854336+0000", 2024-04-19T03:03:19.859 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7840000000000004e-06 2024-04-19T03:03:19.859 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:19.859 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:19.859 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:19.859 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:19.854385+0000", 2024-04-19T03:03:19.860 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9098000000000003e-05 2024-04-19T03:03:19.860 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:19.860 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:19.860 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:19.860 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:19.854512+0000", 2024-04-19T03:03:19.860 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00012682000000000001 2024-04-19T03:03:19.860 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:19.860 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:19.860 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:19.860 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:19.860 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:19.860 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop_reply(client.4755.0:210992 5.f e63/22)", 2024-04-19T03:03:19.860 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:03:19.854985+0000", 2024-04-19T03:03:19.860 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.00039835899999999999, 2024-04-19T03:03:19.861 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00045329700000000002, 2024-04-19T03:03:19.861 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:19.861 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-04-19T03:03:19.861 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:19.861 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:19.861 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:19.861 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:19.854985+0000", 2024-04-19T03:03:19.861 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:19.861 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:19.861 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:19.861 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:19.861 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:19.854985+0000", 2024-04-19T03:03:19.861 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:19.861 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:19.862 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:19.862 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:19.862 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:19.854985+0000", 2024-04-19T03:03:19.862 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:03:19.862 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:19.862 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:19.862 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:19.862 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:19.854990+0000", 2024-04-19T03:03:19.862 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.558e-06 2024-04-19T03:03:19.862 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:19.862 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:19.862 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:19.862 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:19.854998+0000", 2024-04-19T03:03:19.863 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6920000000000002e-06 2024-04-19T03:03:19.863 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:19.863 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:19.863 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:19.863 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:19.855004+0000", 2024-04-19T03:03:19.863 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.913e-06 2024-04-19T03:03:19.863 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:19.863 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:19.863 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:19.863 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:19.863 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:19.863 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:211002 5.9 5.7073dbf9 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-19T03:03:19.863 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:03:19.855395+0000", 2024-04-19T03:03:19.863 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4294967295.999989, 2024-04-19T03:03:19.863 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4876000000000005e-05, 2024-04-19T03:03:19.864 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:19.864 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-04-19T03:03:19.864 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:19.864 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:19.864 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:19.864 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 211002 2024-04-19T03:03:19.864 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:19.864 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:19.864 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:19.864 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:19.864 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:19.855395+0000", 2024-04-19T03:03:19.864 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:19.864 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:19.864 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:19.865 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:19.865 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:19.855395+0000", 2024-04-19T03:03:19.865 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:19.865 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:19.865 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:19.865 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:19.865 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:19.855394+0000", 2024-04-19T03:03:19.865 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:19.865 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:19.865 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:19.865 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:19.865 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:19.855399+0000", 2024-04-19T03:03:19.865 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9869999999999999e-06 2024-04-19T03:03:19.865 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:19.866 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:19.866 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:19.866 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:19.855408+0000", 2024-04-19T03:03:19.866 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.5629999999999992e-06 2024-04-19T03:03:19.866 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:19.866 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:19.866 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:19.866 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:19.855413+0000", 2024-04-19T03:03:19.866 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3040000000000004e-06 2024-04-19T03:03:19.866 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:19.866 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:19.866 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:19.866 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:19.866 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:19.867 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:211003 5.6 5:6a0b97b0:::benchmark_data_smithi096_19531_object97553:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-19T03:03:19.867 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:03:19.855422+0000", 2024-04-19T03:03:19.867 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 4294967295.9999614, 2024-04-19T03:03:19.867 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.7227999999999999e-05, 2024-04-19T03:03:19.867 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:19.867 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-04-19T03:03:19.867 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:19.867 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:19.867 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:19.867 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 211003 2024-04-19T03:03:19.867 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:19.867 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:19.867 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:19.867 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:19.868 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:19.855422+0000", 2024-04-19T03:03:19.868 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:19.868 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:19.868 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:19.868 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:19.868 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:19.855422+0000", 2024-04-19T03:03:19.868 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:19.868 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:19.868 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:19.868 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:19.868 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:19.855422+0000", 2024-04-19T03:03:19.868 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:19.868 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:19.868 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:19.868 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:19.869 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:19.855424+0000", 2024-04-19T03:03:19.869 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1890000000000001e-06 2024-04-19T03:03:19.869 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:19.869 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:19.869 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:19.869 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:19.855429+0000", 2024-04-19T03:03:19.869 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5920000000000002e-06 2024-04-19T03:03:19.869 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:19.869 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:19.869 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:19.869 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:19.855432+0000", 2024-04-19T03:03:19.869 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.1499999999999999e-06 2024-04-19T03:03:19.869 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:19.869 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:19.870 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:19.870 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:19.855469+0000", 2024-04-19T03:03:19.870 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6913999999999999e-05 2024-04-19T03:03:19.870 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:19.870 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:19.870 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:19.870 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:19.870 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:19.870 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:210987 5.9 5:9532abb6:::benchmark_data_smithi096_19531_object97537:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-19T03:03:19.870 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:03:19.846943+0000", 2024-04-19T03:03:19.870 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0084409110000000006, 2024-04-19T03:03:19.870 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0086021710000000005, 2024-04-19T03:03:19.870 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:19.870 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:03:19.871 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:19.871 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:19.871 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:19.871 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 210987 2024-04-19T03:03:19.871 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:19.871 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:19.871 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:19.871 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:19.871 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:19.846943+0000", 2024-04-19T03:03:19.871 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:19.871 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:19.871 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:19.871 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:19.872 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:19.846943+0000", 2024-04-19T03:03:19.872 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:19.872 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:19.872 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:19.872 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:19.872 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:19.846942+0000", 2024-04-19T03:03:19.872 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:19.872 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:19.872 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:19.872 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:19.872 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:19.846946+0000", 2024-04-19T03:03:19.872 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3289999999999998e-06 2024-04-19T03:03:19.872 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:19.872 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:19.872 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:19.873 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:19.846952+0000", 2024-04-19T03:03:19.873 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5969999999999997e-06 2024-04-19T03:03:19.873 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:19.873 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:19.873 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:19.873 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:19.846958+0000", 2024-04-19T03:03:19.873 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2979999999999999e-06 2024-04-19T03:03:19.873 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:19.873 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:19.873 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:19.873 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:19.849071+0000", 2024-04-19T03:03:19.873 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0021138250000000002 2024-04-19T03:03:19.873 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:19.873 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:19.874 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:19.874 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:19.849149+0000", 2024-04-19T03:03:19.874 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7442999999999997e-05 2024-04-19T03:03:19.874 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:19.874 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:19.874 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:03:19.874 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:19.849213+0000", 2024-04-19T03:03:19.874 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3676000000000005e-05 2024-04-19T03:03:19.874 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:19.874 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:19.874 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:03:19.874 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:19.855490+0000", 2024-04-19T03:03:19.874 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0062770129999999997 2024-04-19T03:03:19.874 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:19.875 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:19.875 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:19.875 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:19.875 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:19.875 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:210992 5.f 5:f5b04050:::benchmark_data_smithi096_19531_object97542:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-19T03:03:19.875 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:03:19.849356+0000", 2024-04-19T03:03:19.875 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0060281839999999998, 2024-04-19T03:03:19.875 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0062301889999999997, 2024-04-19T03:03:19.875 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:19.875 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:03:19.875 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:19.875 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:19.875 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:19.875 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 210992 2024-04-19T03:03:19.876 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:19.876 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:19.876 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:19.876 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:19.876 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:19.849356+0000", 2024-04-19T03:03:19.876 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:19.876 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:19.876 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:19.876 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:19.876 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:19.849356+0000", 2024-04-19T03:03:19.876 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:19.876 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:19.876 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:19.876 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:19.877 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:19.849355+0000", 2024-04-19T03:03:19.877 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:19.877 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:19.877 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:19.877 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:19.877 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:19.849360+0000", 2024-04-19T03:03:19.877 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7269999999999998e-06 2024-04-19T03:03:19.877 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:19.877 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:19.877 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:19.877 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:19.849370+0000", 2024-04-19T03:03:19.877 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0352e-05 2024-04-19T03:03:19.877 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:19.877 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:19.878 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:19.878 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:19.849375+0000", 2024-04-19T03:03:19.878 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9840000000000001e-06 2024-04-19T03:03:19.878 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:19.878 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:19.878 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:19.878 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:19.849418+0000", 2024-04-19T03:03:19.878 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2503999999999998e-05 2024-04-19T03:03:19.878 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:19.878 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:19.878 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:19.878 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:19.849565+0000", 2024-04-19T03:03:19.878 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00014701499999999999 2024-04-19T03:03:19.878 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:19.879 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:19.879 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:03:19.879 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:19.849681+0000", 2024-04-19T03:03:19.879 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00011633699999999999 2024-04-19T03:03:19.879 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:19.879 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:19.879 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:03:19.879 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:19.854570+0000", 2024-04-19T03:03:19.879 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0048889659999999998 2024-04-19T03:03:19.879 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:19.879 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:19.879 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:19.879 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:19.879 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:19.880 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:210993 5.f 5:f0b2d6ce:::benchmark_data_smithi096_19531_object97543:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-19T03:03:19.880 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:03:19.850920+0000", 2024-04-19T03:03:19.880 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0044638409999999996, 2024-04-19T03:03:19.880 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0047061120000000001, 2024-04-19T03:03:19.880 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:19.880 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:03:19.880 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:19.880 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:19.880 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:19.880 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 210993 2024-04-19T03:03:19.880 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:19.880 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:19.880 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:19.880 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:19.880 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:19.850920+0000", 2024-04-19T03:03:19.881 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:19.881 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:19.881 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:19.881 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:19.881 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:19.850920+0000", 2024-04-19T03:03:19.881 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:19.881 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:19.881 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:19.881 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:19.881 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:19.850919+0000", 2024-04-19T03:03:19.881 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:03:19.881 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:19.881 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:19.881 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:19.882 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:19.850925+0000", 2024-04-19T03:03:19.882 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3799999999999999e-06 2024-04-19T03:03:19.882 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:19.882 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:19.882 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:19.882 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:19.850941+0000", 2024-04-19T03:03:19.882 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.5814000000000001e-05 2024-04-19T03:03:19.882 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:19.882 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:19.882 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:19.882 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:19.850953+0000", 2024-04-19T03:03:19.882 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1704e-05 2024-04-19T03:03:19.882 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:19.882 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:19.882 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:19.883 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:19.851486+0000", 2024-04-19T03:03:19.883 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000533017 2024-04-19T03:03:19.883 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:19.883 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:19.883 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:19.883 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:19.851580+0000", 2024-04-19T03:03:19.883 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.4666999999999993e-05 2024-04-19T03:03:19.883 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:19.883 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:19.883 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:03:19.883 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:19.851682+0000", 2024-04-19T03:03:19.883 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00010190400000000001 2024-04-19T03:03:19.883 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:19.883 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:19.883 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:19.884 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:19.884 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:19.884 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:210994 5.2 5:48a6dc4a:::benchmark_data_smithi096_19531_object97544:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-19T03:03:19.884 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:03:19.851117+0000", 2024-04-19T03:03:19.884 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.004266911, 2024-04-19T03:03:19.884 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0045479689999999998, 2024-04-19T03:03:19.884 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:19.884 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-04-19T03:03:19.884 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:19.884 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:19.884 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:19.884 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 210994 2024-04-19T03:03:19.884 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:19.884 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:19.885 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:19.885 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:19.885 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:19.851117+0000", 2024-04-19T03:03:19.885 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:19.885 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:19.885 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:19.885 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:19.885 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:19.851117+0000", 2024-04-19T03:03:19.885 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:19.885 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:19.885 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:19.885 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:19.885 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:19.851116+0000", 2024-04-19T03:03:19.885 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:03:19.886 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:19.886 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:19.886 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:19.886 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:19.851121+0000", 2024-04-19T03:03:19.886 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7609999999999998e-06 2024-04-19T03:03:19.886 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:19.886 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:19.886 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:19.886 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:19.851134+0000", 2024-04-19T03:03:19.886 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3223e-05 2024-04-19T03:03:19.886 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:19.886 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:19.886 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:19.886 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:19.851144+0000", 2024-04-19T03:03:19.887 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.5699999999999999e-06 2024-04-19T03:03:19.887 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:19.887 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:19.887 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:19.887 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:19.851192+0000", 2024-04-19T03:03:19.887 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8727999999999998e-05 2024-04-19T03:03:19.887 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:19.887 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:19.887 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:19.887 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:19.851338+0000", 2024-04-19T03:03:19.887 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00014557700000000001 2024-04-19T03:03:19.887 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:19.887 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:19.887 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:19.888 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:19.888 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:19.888 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:210995 5.1 5:8e04aa34:::benchmark_data_smithi096_19531_object97545:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-19T03:03:19.888 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:03:19.851547+0000", 2024-04-19T03:03:19.888 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0038367399999999999, 2024-04-19T03:03:19.888 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0041528930000000004, 2024-04-19T03:03:19.888 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:19.888 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-04-19T03:03:19.888 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:19.888 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:19.888 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:19.888 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 210995 2024-04-19T03:03:19.888 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:19.888 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:19.889 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:19.889 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:19.889 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:19.851547+0000", 2024-04-19T03:03:19.889 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:19.889 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:19.889 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:19.889 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:19.889 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:19.851547+0000", 2024-04-19T03:03:19.889 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:19.889 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:19.889 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:19.889 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:19.889 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:19.851546+0000", 2024-04-19T03:03:19.889 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:03:19.889 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:19.890 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:19.890 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:19.890 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:19.851551+0000", 2024-04-19T03:03:19.890 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7380000000000002e-06 2024-04-19T03:03:19.890 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:19.890 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:19.890 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:19.890 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:19.851561+0000", 2024-04-19T03:03:19.890 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.8919999999999995e-06 2024-04-19T03:03:19.890 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:19.890 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:19.890 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:19.890 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:19.851568+0000", 2024-04-19T03:03:19.890 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8549999999999996e-06 2024-04-19T03:03:19.891 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:19.891 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:19.891 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:19.891 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:19.851614+0000", 2024-04-19T03:03:19.891 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6285999999999997e-05 2024-04-19T03:03:19.891 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:19.891 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:19.891 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:19.891 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:19.851738+0000", 2024-04-19T03:03:19.891 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000123919 2024-04-19T03:03:19.891 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:19.891 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:19.891 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:19.891 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:19.892 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:19.892 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:210997 5.c 5:3f9102f6:::benchmark_data_smithi096_19531_object97547:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-19T03:03:19.892 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:03:19.852834+0000", 2024-04-19T03:03:19.892 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.002550306, 2024-04-19T03:03:19.892 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0029023830000000001, 2024-04-19T03:03:19.892 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:19.892 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-04-19T03:03:19.892 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:19.892 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:19.892 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:19.892 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 210997 2024-04-19T03:03:19.892 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:19.892 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:19.892 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:19.892 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:19.893 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:19.852834+0000", 2024-04-19T03:03:19.893 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:19.893 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:19.893 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:19.893 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:19.893 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:19.852834+0000", 2024-04-19T03:03:19.893 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:19.893 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:19.893 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:19.893 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:19.893 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:19.852833+0000", 2024-04-19T03:03:19.893 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:03:19.893 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:19.893 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:19.893 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:19.894 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:19.852838+0000", 2024-04-19T03:03:19.894 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2209999999999996e-06 2024-04-19T03:03:19.894 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:19.894 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:19.894 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:19.894 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:19.852857+0000", 2024-04-19T03:03:19.894 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8768999999999999e-05 2024-04-19T03:03:19.894 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:19.894 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:19.894 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:19.894 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:19.852864+0000", 2024-04-19T03:03:19.894 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7130000000000005e-06 2024-04-19T03:03:19.894 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:19.894 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:19.895 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:19.895 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:19.852908+0000", 2024-04-19T03:03:19.895 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3433999999999998e-05 2024-04-19T03:03:19.895 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:19.895 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:19.895 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:19.895 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:19.853046+0000", 2024-04-19T03:03:19.895 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00013811300000000001 2024-04-19T03:03:19.895 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:19.895 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:19.895 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:19.895 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:19.895 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:19.895 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:210999 5.d 5:b064ca79:::benchmark_data_smithi096_19531_object97549:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-19T03:03:19.895 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:03:19.852881+0000", 2024-04-19T03:03:19.896 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0025030579999999998, 2024-04-19T03:03:19.896 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0028878770000000001, 2024-04-19T03:03:19.896 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:19.896 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:03:19.896 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:19.896 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:19.896 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:19.896 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 210999 2024-04-19T03:03:19.896 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:19.896 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:19.896 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:19.896 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:19.896 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:19.852881+0000", 2024-04-19T03:03:19.896 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:19.896 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:19.897 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:19.897 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:19.897 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:19.852881+0000", 2024-04-19T03:03:19.897 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:19.897 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:19.897 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:19.897 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:19.897 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:19.852880+0000", 2024-04-19T03:03:19.897 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:19.897 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:19.897 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:19.897 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:19.897 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:19.852884+0000", 2024-04-19T03:03:19.897 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3979999999999999e-06 2024-04-19T03:03:19.898 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:19.898 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:19.898 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:19.898 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:19.852891+0000", 2024-04-19T03:03:19.898 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5360000000000004e-06 2024-04-19T03:03:19.898 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:19.898 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:19.898 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:19.898 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:19.852897+0000", 2024-04-19T03:03:19.898 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9349999999999999e-06 2024-04-19T03:03:19.898 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:19.898 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:19.898 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:19.898 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:19.852929+0000", 2024-04-19T03:03:19.899 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2039000000000003e-05 2024-04-19T03:03:19.899 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:19.899 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:19.899 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:19.899 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:19.853083+0000", 2024-04-19T03:03:19.899 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00015374400000000001 2024-04-19T03:03:19.899 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:19.899 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:19.899 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:03:19.899 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:19.853181+0000", 2024-04-19T03:03:19.899 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.8584000000000003e-05 2024-04-19T03:03:19.899 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:19.899 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:19.899 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:19.900 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:19.900 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:19.900 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:211000 5.6 5:68842fcc:::benchmark_data_smithi096_19531_object97550:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-19T03:03:19.900 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:03:19.852909+0000", 2024-04-19T03:03:19.900 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0024746630000000002, 2024-04-19T03:03:19.900 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.002894953, 2024-04-19T03:03:19.900 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:19.900 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-04-19T03:03:19.900 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:19.900 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:19.900 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:19.900 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 211000 2024-04-19T03:03:19.900 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:19.900 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:19.900 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:19.901 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:19.901 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:19.852909+0000", 2024-04-19T03:03:19.901 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:19.901 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:19.901 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:19.901 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:19.901 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:19.852909+0000", 2024-04-19T03:03:19.901 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:19.901 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:19.901 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:19.901 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:19.901 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:19.852909+0000", 2024-04-19T03:03:19.901 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:19.901 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:19.902 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:19.902 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:19.902 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:19.852912+0000", 2024-04-19T03:03:19.902 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.039e-06 2024-04-19T03:03:19.902 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:19.902 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:19.902 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:19.902 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:19.852920+0000", 2024-04-19T03:03:19.902 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.5760000000000006e-06 2024-04-19T03:03:19.902 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:19.902 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:19.902 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:19.902 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:19.852928+0000", 2024-04-19T03:03:19.903 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9170000000000006e-06 2024-04-19T03:03:19.903 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:19.903 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:19.903 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:19.903 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:19.852981+0000", 2024-04-19T03:03:19.903 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3244e-05 2024-04-19T03:03:19.903 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:19.903 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:19.903 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:19.903 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:19.853115+0000", 2024-04-19T03:03:19.903 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00013383199999999999 2024-04-19T03:03:19.903 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:19.903 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:19.903 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:19.904 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:19.904 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-04-19T03:03:19.904 INFO:teuthology.orchestra.run.smithi144.stdout: "num_ops": 12 2024-04-19T03:03:19.904 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-04-19T03:03:19.905 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T03:03:19.931 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:03:19.928+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:03:20.030 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-04-19T03:03:20.031 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2024-04-19T03:03:20.031 INFO:teuthology.orchestra.run.smithi144.stdout: "complaint_time": 30, 2024-04-19T03:03:20.031 INFO:teuthology.orchestra.run.smithi144.stdout: "num_blocked_ops": 0 2024-04-19T03:03:20.031 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-04-19T03:03:20.032 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:03:20.028+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:03:20.041 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T03:03:20.133 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:03:20.130+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:03:20.215 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-04-19T03:03:20.215 INFO:teuthology.orchestra.run.smithi144.stdout: "size": 20, 2024-04-19T03:03:20.215 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 600, 2024-04-19T03:03:20.215 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [ 2024-04-19T03:03:20.215 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.215 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:78992 5.7 5:e6baa862:::benchmark_data_smithi096_19531_object78991:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-19T03:03:20.215 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:18.008888+0000", 2024-04-19T03:03:20.216 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 62.203167004999997, 2024-04-19T03:03:20.216 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.056375285999999997, 2024-04-19T03:03:20.216 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:20.216 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:20.216 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:20.216 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:20.216 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:20.216 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 78992 2024-04-19T03:03:20.216 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.216 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:20.216 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.216 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:20.216 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.008888+0000", 2024-04-19T03:03:20.217 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:20.217 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.217 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.217 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:20.217 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.008888+0000", 2024-04-19T03:03:20.217 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:20.217 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.217 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.217 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:20.217 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.008888+0000", 2024-04-19T03:03:20.217 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:20.217 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.217 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.218 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:20.218 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.008928+0000", 2024-04-19T03:03:20.218 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0361999999999997e-05 2024-04-19T03:03:20.218 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.218 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.218 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:20.218 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.008942+0000", 2024-04-19T03:03:20.218 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4365000000000001e-05 2024-04-19T03:03:20.218 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.218 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.218 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:20.218 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.008949+0000", 2024-04-19T03:03:20.218 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.212e-06 2024-04-19T03:03:20.219 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.219 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.219 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:20.219 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.012683+0000", 2024-04-19T03:03:20.219 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.003733934 2024-04-19T03:03:20.219 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.219 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.219 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:20.219 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.012798+0000", 2024-04-19T03:03:20.219 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00011574999999999999 2024-04-19T03:03:20.219 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.219 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.219 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:20.219 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.012896+0000", 2024-04-19T03:03:20.220 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.7848000000000002e-05 2024-04-19T03:03:20.220 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.220 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.220 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:03:20.220 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016423+0000", 2024-04-19T03:03:20.220 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0035270789999999998 2024-04-19T03:03:20.220 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.220 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.220 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:20.220 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.065098+0000", 2024-04-19T03:03:20.220 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.048674651999999999 2024-04-19T03:03:20.220 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.220 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.220 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:03:20.220 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.065193+0000", 2024-04-19T03:03:20.221 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.5087999999999995e-05 2024-04-19T03:03:20.221 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.221 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.221 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:20.221 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.065264+0000", 2024-04-19T03:03:20.221 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0666000000000004e-05 2024-04-19T03:03:20.221 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:20.221 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:20.221 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:20.221 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.221 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.221 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4755.0:79003 5.2 e40/39 5:4436e33f:::benchmark_data_smithi096_19531_object79002:head v 40'4935, mlcod=40'4932)", 2024-04-19T03:03:20.221 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:18.018102+0000", 2024-04-19T03:03:20.221 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 62.193952949, 2024-04-19T03:03:20.221 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.060023990999999999, 2024-04-19T03:03:20.222 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:20.222 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:20.222 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:20.222 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.222 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:20.222 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018102+0000", 2024-04-19T03:03:20.222 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:20.222 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.222 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.222 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:20.222 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018102+0000", 2024-04-19T03:03:20.222 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:20.223 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.223 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.223 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:20.223 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018102+0000", 2024-04-19T03:03:20.223 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:20.223 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.223 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.223 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:20.223 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018134+0000", 2024-04-19T03:03:20.223 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2722000000000003e-05 2024-04-19T03:03:20.223 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.223 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.223 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:20.223 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018145+0000", 2024-04-19T03:03:20.223 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0395e-05 2024-04-19T03:03:20.224 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.224 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.224 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:20.224 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018151+0000", 2024-04-19T03:03:20.224 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5300000000000002e-06 2024-04-19T03:03:20.224 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.224 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.224 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:20.224 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018489+0000", 2024-04-19T03:03:20.224 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00033731499999999998 2024-04-19T03:03:20.224 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.224 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.224 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:20.224 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018508+0000", 2024-04-19T03:03:20.225 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9775e-05 2024-04-19T03:03:20.225 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.225 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.225 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:03:20.225 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.078059+0000", 2024-04-19T03:03:20.225 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.059550171999999998 2024-04-19T03:03:20.225 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.225 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.225 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:20.225 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.078126+0000", 2024-04-19T03:03:20.225 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7773000000000003e-05 2024-04-19T03:03:20.225 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:20.225 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:20.226 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:20.226 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.226 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.226 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:86612 5.7 5:e32e3c49:::benchmark_data_smithi096_19531_object86611:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:20.226 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:22.633560+0000", 2024-04-19T03:03:20.226 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 57.578495289000003, 2024-04-19T03:03:20.226 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.19135289, 2024-04-19T03:03:20.226 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:20.226 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:20.226 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:20.226 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:20.226 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:20.226 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 86612 2024-04-19T03:03:20.226 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.227 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:20.227 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.227 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:20.227 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633560+0000", 2024-04-19T03:03:20.227 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:20.227 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.227 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.227 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:20.227 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633560+0000", 2024-04-19T03:03:20.227 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:20.227 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.227 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.227 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:20.227 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633558+0000", 2024-04-19T03:03:20.228 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999986 2024-04-19T03:03:20.228 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.228 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.228 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:20.228 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633609+0000", 2024-04-19T03:03:20.228 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0850999999999998e-05 2024-04-19T03:03:20.228 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.228 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.228 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:20.228 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633627+0000", 2024-04-19T03:03:20.228 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7951000000000001e-05 2024-04-19T03:03:20.228 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.228 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.228 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:20.228 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633635+0000", 2024-04-19T03:03:20.229 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2530000000000004e-06 2024-04-19T03:03:20.229 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.229 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.229 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:20.229 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633699+0000", 2024-04-19T03:03:20.229 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3901999999999999e-05 2024-04-19T03:03:20.229 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.229 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.229 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:20.229 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633992+0000", 2024-04-19T03:03:20.229 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00029283299999999999 2024-04-19T03:03:20.229 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.229 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.229 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:20.229 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.634223+0000", 2024-04-19T03:03:20.230 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00023084200000000001 2024-04-19T03:03:20.230 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.230 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.230 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:03:20.230 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.639085+0000", 2024-04-19T03:03:20.230 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0048624269999999999 2024-04-19T03:03:20.230 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.230 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.230 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:20.230 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.824635+0000", 2024-04-19T03:03:20.230 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.18554944700000001 2024-04-19T03:03:20.230 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.230 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.230 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:03:20.231 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.824793+0000", 2024-04-19T03:03:20.231 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000157959 2024-04-19T03:03:20.231 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.231 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.231 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:20.231 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.824913+0000", 2024-04-19T03:03:20.231 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000120093 2024-04-19T03:03:20.231 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:20.231 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:20.231 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:20.231 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.231 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.231 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:86625 5.7 5:e6d00488:::benchmark_data_smithi096_19531_object86624:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:20.231 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:22.643554+0000", 2024-04-19T03:03:20.232 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 57.568501523000002, 2024-04-19T03:03:20.232 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.18732841, 2024-04-19T03:03:20.232 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:20.232 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:20.232 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:20.232 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:20.232 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:20.232 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 86625 2024-04-19T03:03:20.232 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.232 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:20.232 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.232 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:20.232 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643554+0000", 2024-04-19T03:03:20.232 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:20.232 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.233 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.233 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:20.233 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643554+0000", 2024-04-19T03:03:20.233 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:20.233 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.233 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.233 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:20.233 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643552+0000", 2024-04-19T03:03:20.233 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999986 2024-04-19T03:03:20.233 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.233 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.233 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:20.233 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643588+0000", 2024-04-19T03:03:20.233 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5855999999999997e-05 2024-04-19T03:03:20.234 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.234 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.234 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:20.234 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643606+0000", 2024-04-19T03:03:20.234 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8226000000000001e-05 2024-04-19T03:03:20.234 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.234 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.234 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:20.234 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643618+0000", 2024-04-19T03:03:20.234 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1868000000000001e-05 2024-04-19T03:03:20.234 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.234 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.234 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:20.235 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643676+0000", 2024-04-19T03:03:20.235 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8153999999999999e-05 2024-04-19T03:03:20.235 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.235 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.235 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:20.235 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643905+0000", 2024-04-19T03:03:20.235 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00022847500000000001 2024-04-19T03:03:20.235 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.235 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.235 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:20.235 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.644150+0000", 2024-04-19T03:03:20.235 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00024531800000000001 2024-04-19T03:03:20.235 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.235 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.235 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:03:20.236 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.647407+0000", 2024-04-19T03:03:20.236 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0032563190000000001 2024-04-19T03:03:20.236 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.236 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.236 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:20.236 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.830721+0000", 2024-04-19T03:03:20.236 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.18331468300000001 2024-04-19T03:03:20.236 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.236 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.236 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:03:20.236 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.830813+0000", 2024-04-19T03:03:20.236 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.2205000000000002e-05 2024-04-19T03:03:20.236 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.236 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.237 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:20.237 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.830882+0000", 2024-04-19T03:03:20.237 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8819999999999995e-05 2024-04-19T03:03:20.237 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:20.237 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:20.237 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:20.237 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.237 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.237 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87063 5.7 5:e502e824:::benchmark_data_smithi096_19531_object87062:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:20.237 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.136067+0000", 2024-04-19T03:03:20.237 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 57.075988654, 2024-04-19T03:03:20.237 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.065521159999999995, 2024-04-19T03:03:20.237 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:20.237 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:20.238 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:20.238 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:20.238 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:20.238 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87063 2024-04-19T03:03:20.238 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.238 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:20.238 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.238 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:20.238 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.136067+0000", 2024-04-19T03:03:20.238 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:20.238 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.238 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.238 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:20.239 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.136067+0000", 2024-04-19T03:03:20.239 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:20.239 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.239 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.239 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:20.239 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.136066+0000", 2024-04-19T03:03:20.239 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:03:20.239 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.239 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.239 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:20.239 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.136154+0000", 2024-04-19T03:03:20.239 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.8256000000000003e-05 2024-04-19T03:03:20.239 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.239 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.239 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:20.240 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.136162+0000", 2024-04-19T03:03:20.240 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.5099999999999998e-06 2024-04-19T03:03:20.240 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.240 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.240 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:20.240 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.136171+0000", 2024-04-19T03:03:20.240 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2830000000000001e-06 2024-04-19T03:03:20.240 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.240 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.240 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:20.240 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.138421+0000", 2024-04-19T03:03:20.240 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0022506620000000001 2024-04-19T03:03:20.240 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.240 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.240 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:20.240 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.138560+0000", 2024-04-19T03:03:20.241 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000138446 2024-04-19T03:03:20.241 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.241 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.241 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:20.241 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.138689+0000", 2024-04-19T03:03:20.241 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00012950700000000001 2024-04-19T03:03:20.241 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.241 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.241 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:03:20.241 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.141517+0000", 2024-04-19T03:03:20.241 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0028280860000000001 2024-04-19T03:03:20.241 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.241 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.241 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:20.241 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.201350+0000", 2024-04-19T03:03:20.242 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.059832418999999998 2024-04-19T03:03:20.242 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.242 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.242 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:03:20.242 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.201485+0000", 2024-04-19T03:03:20.242 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000135597 2024-04-19T03:03:20.242 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.242 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.242 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:20.242 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.201588+0000", 2024-04-19T03:03:20.242 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00010247900000000001 2024-04-19T03:03:20.242 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:20.242 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:20.243 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:20.243 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.243 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.243 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87072 5.7 5:e3c7809a:::benchmark_data_smithi096_19531_object87071:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:20.243 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.144224+0000", 2024-04-19T03:03:20.243 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 57.067831630000001, 2024-04-19T03:03:20.243 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.058179555000000001, 2024-04-19T03:03:20.243 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:20.243 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:20.243 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:20.243 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:20.243 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:20.243 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87072 2024-04-19T03:03:20.243 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.243 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:20.244 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.244 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:20.244 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144224+0000", 2024-04-19T03:03:20.244 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:20.244 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.244 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.244 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:20.244 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144224+0000", 2024-04-19T03:03:20.244 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:20.244 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.244 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.244 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:20.245 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144223+0000", 2024-04-19T03:03:20.245 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:03:20.245 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.245 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.245 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:20.245 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144320+0000", 2024-04-19T03:03:20.245 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.7075000000000001e-05 2024-04-19T03:03:20.245 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.245 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.245 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:20.245 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144331+0000", 2024-04-19T03:03:20.245 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1342000000000001e-05 2024-04-19T03:03:20.245 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.245 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.246 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:20.246 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144337+0000", 2024-04-19T03:03:20.246 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8390000000000003e-06 2024-04-19T03:03:20.246 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.246 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.246 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:20.246 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144369+0000", 2024-04-19T03:03:20.246 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2079000000000002e-05 2024-04-19T03:03:20.246 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.246 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.246 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:20.246 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144464+0000", 2024-04-19T03:03:20.246 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.4623000000000005e-05 2024-04-19T03:03:20.246 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.247 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.247 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:20.247 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144553+0000", 2024-04-19T03:03:20.247 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9171000000000004e-05 2024-04-19T03:03:20.247 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.247 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.247 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:03:20.249 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.147018+0000", 2024-04-19T03:03:20.249 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0024648370000000001 2024-04-19T03:03:20.249 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.249 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.249 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:20.249 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.202270+0000", 2024-04-19T03:03:20.250 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.055252018 2024-04-19T03:03:20.250 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.250 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.250 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:03:20.250 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.202356+0000", 2024-04-19T03:03:20.250 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6648000000000001e-05 2024-04-19T03:03:20.250 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.250 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.250 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:20.250 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.202403+0000", 2024-04-19T03:03:20.250 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6956999999999998e-05 2024-04-19T03:03:20.250 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:20.250 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:20.251 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:20.251 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.251 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.251 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87123 5.6 5:6d1bc3b9:::benchmark_data_smithi096_19531_object87122:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:03:20.251 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249233+0000", 2024-04-19T03:03:20.251 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 56.962822598000002, 2024-04-19T03:03:20.251 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0291700720000001, 2024-04-19T03:03:20.251 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:20.251 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-04-19T03:03:20.251 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:20.251 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:20.251 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:20.251 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87123 2024-04-19T03:03:20.252 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.252 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:20.252 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.252 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:20.252 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249233+0000", 2024-04-19T03:03:20.252 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:20.252 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.252 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.252 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:20.252 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249233+0000", 2024-04-19T03:03:20.252 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:20.252 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.252 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.252 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:20.252 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249231+0000", 2024-04-19T03:03:20.253 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999986 2024-04-19T03:03:20.253 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.253 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.253 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:20.253 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249285+0000", 2024-04-19T03:03:20.253 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4005000000000002e-05 2024-04-19T03:03:20.253 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.253 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.253 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:20.253 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249300+0000", 2024-04-19T03:03:20.253 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4715999999999999e-05 2024-04-19T03:03:20.253 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.253 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.253 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:20.254 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249307+0000", 2024-04-19T03:03:20.254 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8399999999999997e-06 2024-04-19T03:03:20.254 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.254 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.254 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:20.254 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249366+0000", 2024-04-19T03:03:20.254 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9435999999999998e-05 2024-04-19T03:03:20.254 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.254 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.254 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op must wait for map", 2024-04-19T03:03:20.254 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249376+0000", 2024-04-19T03:03:20.254 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.4919999999999999e-06 2024-04-19T03:03:20.254 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.254 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.255 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:20.255 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263757+0000", 2024-04-19T03:03:20.255 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.014381461999999999 2024-04-19T03:03:20.255 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.255 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.255 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:03:20.255 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263875+0000", 2024-04-19T03:03:20.255 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000117166 2024-04-19T03:03:20.255 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.255 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.255 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:20.255 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.277136+0000", 2024-04-19T03:03:20.255 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.013261207 2024-04-19T03:03:20.255 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.255 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.256 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:20.256 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.278403+0000", 2024-04-19T03:03:20.256 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001267106 2024-04-19T03:03:20.256 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:20.256 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:20.256 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:20.256 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.256 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.256 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87128 5.6 5:6905c420:::benchmark_data_smithi096_19531_object87127:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:03:20.256 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249323+0000", 2024-04-19T03:03:20.256 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 56.962731851000001, 2024-04-19T03:03:20.256 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0292813249999999, 2024-04-19T03:03:20.256 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:20.256 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-04-19T03:03:20.257 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:20.257 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:20.257 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:20.257 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87128 2024-04-19T03:03:20.257 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.257 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:20.257 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.257 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:20.257 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249323+0000", 2024-04-19T03:03:20.257 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:20.257 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.257 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.257 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:20.257 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249323+0000", 2024-04-19T03:03:20.258 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:20.258 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.258 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.258 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:20.258 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249323+0000", 2024-04-19T03:03:20.258 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:20.258 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.258 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.258 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:20.258 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249385+0000", 2024-04-19T03:03:20.258 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1711999999999995e-05 2024-04-19T03:03:20.258 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.258 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.259 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:20.259 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249398+0000", 2024-04-19T03:03:20.259 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3022e-05 2024-04-19T03:03:20.259 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.259 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.259 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:20.259 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249402+0000", 2024-04-19T03:03:20.259 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4819999999999996e-06 2024-04-19T03:03:20.259 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.259 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.259 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:20.259 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249437+0000", 2024-04-19T03:03:20.259 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4702000000000001e-05 2024-04-19T03:03:20.259 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.259 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.260 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:03:20.260 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249442+0000", 2024-04-19T03:03:20.260 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8019999999999999e-06 2024-04-19T03:03:20.260 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.260 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.260 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:20.260 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263896+0000", 2024-04-19T03:03:20.260 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.014454679999999999 2024-04-19T03:03:20.260 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.260 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.260 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:03:20.260 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263900+0000", 2024-04-19T03:03:20.260 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9700000000000001e-06 2024-04-19T03:03:20.260 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.261 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.261 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:20.261 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.278557+0000", 2024-04-19T03:03:20.261 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0146566480000001 2024-04-19T03:03:20.261 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.261 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.261 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:20.261 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.278605+0000", 2024-04-19T03:03:20.261 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7735999999999998e-05 2024-04-19T03:03:20.261 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:20.261 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:20.261 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:20.261 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.262 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.262 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87130 5.3 5:c8c2d67b:::benchmark_data_smithi096_19531_object87129:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:03:20.262 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249418+0000", 2024-04-19T03:03:20.262 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 56.962637139999998, 2024-04-19T03:03:20.262 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.025414182, 2024-04-19T03:03:20.262 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:20.262 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-04-19T03:03:20.262 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:20.262 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:20.262 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:20.262 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87130 2024-04-19T03:03:20.262 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.262 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:20.263 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.263 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:20.263 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249418+0000", 2024-04-19T03:03:20.263 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:20.263 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.263 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.263 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:20.263 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249418+0000", 2024-04-19T03:03:20.263 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:20.263 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.263 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.263 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:20.263 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249409+0000", 2024-04-19T03:03:20.263 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999905 2024-04-19T03:03:20.263 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.264 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.264 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:20.264 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249464+0000", 2024-04-19T03:03:20.264 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5381999999999999e-05 2024-04-19T03:03:20.264 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.264 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.264 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:20.264 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249471+0000", 2024-04-19T03:03:20.264 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2609999999999996e-06 2024-04-19T03:03:20.264 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.264 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.264 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:20.264 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249475+0000", 2024-04-19T03:03:20.264 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2839999999999998e-06 2024-04-19T03:03:20.265 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.265 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.265 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:20.265 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249535+0000", 2024-04-19T03:03:20.265 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0545999999999999e-05 2024-04-19T03:03:20.265 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.265 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.265 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op must wait for map", 2024-04-19T03:03:20.265 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249540+0000", 2024-04-19T03:03:20.265 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2859999999999999e-06 2024-04-19T03:03:20.265 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.265 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.265 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:20.265 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263450+0000", 2024-04-19T03:03:20.266 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.013909585 2024-04-19T03:03:20.266 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.266 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.266 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:03:20.266 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263458+0000", 2024-04-19T03:03:20.266 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8089999999999993e-06 2024-04-19T03:03:20.266 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.266 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.266 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:20.266 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.273193+0000", 2024-04-19T03:03:20.266 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0097351379999999 2024-04-19T03:03:20.266 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.266 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.266 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:20.267 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.274832+0000", 2024-04-19T03:03:20.267 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0016394789999999999 2024-04-19T03:03:20.267 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:20.267 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:20.267 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:20.267 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.267 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.267 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87131 5.1 5:83756d55:::benchmark_data_smithi096_19531_object87130:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:03:20.267 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249491+0000", 2024-04-19T03:03:20.267 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 56.962564493000002, 2024-04-19T03:03:20.267 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0191489520000001, 2024-04-19T03:03:20.267 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:20.267 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-04-19T03:03:20.267 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:20.268 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:20.268 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:20.268 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87131 2024-04-19T03:03:20.268 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.268 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:20.268 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.268 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:20.268 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249491+0000", 2024-04-19T03:03:20.268 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:20.268 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.268 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.268 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:20.268 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249491+0000", 2024-04-19T03:03:20.268 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:20.269 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.269 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.269 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:20.269 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249491+0000", 2024-04-19T03:03:20.269 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:20.269 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.269 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.269 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:20.269 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249530+0000", 2024-04-19T03:03:20.269 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9589000000000003e-05 2024-04-19T03:03:20.269 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.269 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.269 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:20.269 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249544+0000", 2024-04-19T03:03:20.269 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4158000000000001e-05 2024-04-19T03:03:20.270 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.270 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.270 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:20.270 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249549+0000", 2024-04-19T03:03:20.270 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6809999999999997e-06 2024-04-19T03:03:20.270 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.270 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.270 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:20.270 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249592+0000", 2024-04-19T03:03:20.270 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3285999999999999e-05 2024-04-19T03:03:20.270 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.270 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.270 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op must wait for map", 2024-04-19T03:03:20.270 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249598+0000", 2024-04-19T03:03:20.270 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8329999999999999e-06 2024-04-19T03:03:20.271 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.271 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.271 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:20.271 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263331+0000", 2024-04-19T03:03:20.271 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.013733093 2024-04-19T03:03:20.271 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.271 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.271 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:03:20.271 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263343+0000", 2024-04-19T03:03:20.271 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.189e-05 2024-04-19T03:03:20.271 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.271 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.271 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:20.271 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.268541+0000", 2024-04-19T03:03:20.272 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0051983440000001 2024-04-19T03:03:20.272 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.272 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.272 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:20.272 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.268640+0000", 2024-04-19T03:03:20.272 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.8387999999999994e-05 2024-04-19T03:03:20.272 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:20.272 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:20.272 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:20.272 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.272 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.272 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87132 5.c 5:3e18b732:::benchmark_data_smithi096_19531_object87131:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:03:20.272 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249558+0000", 2024-04-19T03:03:20.272 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 56.962497591999998, 2024-04-19T03:03:20.273 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0241198380000001, 2024-04-19T03:03:20.273 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:20.273 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-04-19T03:03:20.273 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:20.273 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:20.273 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:20.273 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87132 2024-04-19T03:03:20.273 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.273 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:20.273 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.273 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:20.273 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249558+0000", 2024-04-19T03:03:20.273 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:20.273 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.274 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.274 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:20.274 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249558+0000", 2024-04-19T03:03:20.274 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:20.274 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.274 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.274 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:20.274 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249557+0000", 2024-04-19T03:03:20.274 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:20.274 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.274 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.274 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:20.274 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249625+0000", 2024-04-19T03:03:20.274 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7200999999999996e-05 2024-04-19T03:03:20.275 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.275 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.275 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:20.275 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249646+0000", 2024-04-19T03:03:20.275 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1053e-05 2024-04-19T03:03:20.275 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.275 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.275 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:20.275 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249650+0000", 2024-04-19T03:03:20.275 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2719999999999999e-06 2024-04-19T03:03:20.275 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.275 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.275 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:20.275 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249686+0000", 2024-04-19T03:03:20.276 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6430000000000002e-05 2024-04-19T03:03:20.276 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.276 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.276 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op must wait for map", 2024-04-19T03:03:20.276 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249690+0000", 2024-04-19T03:03:20.276 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.765e-06 2024-04-19T03:03:20.276 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.276 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.276 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:20.276 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261157+0000", 2024-04-19T03:03:20.276 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011467247999999999 2024-04-19T03:03:20.276 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.276 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.276 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:03:20.276 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261170+0000", 2024-04-19T03:03:20.277 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2833000000000001e-05 2024-04-19T03:03:20.277 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.277 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.277 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:20.277 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.272119+0000", 2024-04-19T03:03:20.277 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.010949313 2024-04-19T03:03:20.277 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.277 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.277 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:20.277 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.273678+0000", 2024-04-19T03:03:20.277 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0015581550000000001 2024-04-19T03:03:20.277 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:20.277 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:20.277 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:20.277 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.278 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.278 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87133 5.c 5:3f772a62:::benchmark_data_smithi096_19531_object87132:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:03:20.278 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249657+0000", 2024-04-19T03:03:20.278 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 56.962398213, 2024-04-19T03:03:20.278 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0242819409999999, 2024-04-19T03:03:20.278 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:20.278 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-04-19T03:03:20.278 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:20.278 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:20.278 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:20.278 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87133 2024-04-19T03:03:20.278 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.278 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:20.278 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.279 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:20.279 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249657+0000", 2024-04-19T03:03:20.279 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:20.279 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.279 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.279 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:20.279 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249657+0000", 2024-04-19T03:03:20.279 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:20.279 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.279 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.279 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:20.279 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249657+0000", 2024-04-19T03:03:20.279 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:20.280 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.280 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.280 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:20.280 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249690+0000", 2024-04-19T03:03:20.280 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3343000000000002e-05 2024-04-19T03:03:20.280 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.280 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.280 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:20.280 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249695+0000", 2024-04-19T03:03:20.280 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8600000000000001e-06 2024-04-19T03:03:20.280 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.280 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.280 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:20.281 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249698+0000", 2024-04-19T03:03:20.281 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.1700000000000001e-06 2024-04-19T03:03:20.281 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.281 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.281 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:20.281 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249741+0000", 2024-04-19T03:03:20.281 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2849999999999998e-05 2024-04-19T03:03:20.281 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.281 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.281 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:03:20.281 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249746+0000", 2024-04-19T03:03:20.281 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1019999999999996e-06 2024-04-19T03:03:20.281 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.281 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.282 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:20.282 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261209+0000", 2024-04-19T03:03:20.282 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011462447000000001 2024-04-19T03:03:20.282 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.282 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.282 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:03:20.282 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261216+0000", 2024-04-19T03:03:20.282 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8520000000000004e-06 2024-04-19T03:03:20.282 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.282 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.282 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:20.282 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.273872+0000", 2024-04-19T03:03:20.282 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0126558000000001 2024-04-19T03:03:20.282 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.283 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.283 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:20.283 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.273939+0000", 2024-04-19T03:03:20.283 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6822000000000005e-05 2024-04-19T03:03:20.283 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:20.283 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:20.283 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:20.283 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.283 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.283 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87134 5.5 5:a56c478f:::benchmark_data_smithi096_19531_object87133:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:03:20.283 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249708+0000", 2024-04-19T03:03:20.283 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 56.962347289, 2024-04-19T03:03:20.283 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0214677299999999, 2024-04-19T03:03:20.283 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:20.283 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-04-19T03:03:20.283 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:20.284 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:20.284 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:20.284 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87134 2024-04-19T03:03:20.284 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.284 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:20.284 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.284 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:20.284 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249708+0000", 2024-04-19T03:03:20.284 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:20.284 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.284 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.284 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:20.284 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249708+0000", 2024-04-19T03:03:20.284 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:20.284 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.284 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.285 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:20.285 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249706+0000", 2024-04-19T03:03:20.285 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999976 2024-04-19T03:03:20.285 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.285 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.285 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:20.285 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249740+0000", 2024-04-19T03:03:20.285 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4458000000000001e-05 2024-04-19T03:03:20.285 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.285 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.285 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:20.285 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249745+0000", 2024-04-19T03:03:20.285 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5020000000000003e-06 2024-04-19T03:03:20.285 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.286 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.286 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:20.286 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249748+0000", 2024-04-19T03:03:20.286 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2499999999999998e-06 2024-04-19T03:03:20.286 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.286 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.286 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:20.286 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249778+0000", 2024-04-19T03:03:20.286 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.006e-05 2024-04-19T03:03:20.286 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.286 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.286 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op must wait for map", 2024-04-19T03:03:20.286 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249782+0000", 2024-04-19T03:03:20.286 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2910000000000001e-06 2024-04-19T03:03:20.287 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.287 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.287 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:20.287 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261666+0000", 2024-04-19T03:03:20.287 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011883471 2024-04-19T03:03:20.287 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.287 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.287 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:03:20.287 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261674+0000", 2024-04-19T03:03:20.287 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6479999999999992e-06 2024-04-19T03:03:20.287 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.287 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.287 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:20.287 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.269323+0000", 2024-04-19T03:03:20.288 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.00764867 2024-04-19T03:03:20.288 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.288 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.288 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:20.288 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.271176+0000", 2024-04-19T03:03:20.288 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001852844 2024-04-19T03:03:20.288 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:20.288 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:20.288 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:20.288 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.288 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.288 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87137 5.c 5:30708c68:::benchmark_data_smithi096_19531_object87136:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:03:20.288 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249756+0000", 2024-04-19T03:03:20.288 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 56.962299582999997, 2024-04-19T03:03:20.289 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.033331752, 2024-04-19T03:03:20.289 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:20.289 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:20.289 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:20.289 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:20.289 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:20.289 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87137 2024-04-19T03:03:20.289 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.289 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:20.289 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.289 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:20.289 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249756+0000", 2024-04-19T03:03:20.289 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:20.289 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.289 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.290 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:20.290 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249756+0000", 2024-04-19T03:03:20.290 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:20.290 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.290 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.290 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:20.290 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249755+0000", 2024-04-19T03:03:20.290 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:20.290 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.290 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.290 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:20.290 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249777+0000", 2024-04-19T03:03:20.290 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1420000000000002e-05 2024-04-19T03:03:20.290 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.291 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.291 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:20.291 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249781+0000", 2024-04-19T03:03:20.291 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0609999999999997e-06 2024-04-19T03:03:20.291 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.291 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.291 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:20.291 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249787+0000", 2024-04-19T03:03:20.291 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.02e-06 2024-04-19T03:03:20.291 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.291 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.291 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:20.291 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249818+0000", 2024-04-19T03:03:20.291 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0947e-05 2024-04-19T03:03:20.292 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.292 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.292 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:03:20.292 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249821+0000", 2024-04-19T03:03:20.292 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.117e-06 2024-04-19T03:03:20.292 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.292 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.292 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:20.292 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261243+0000", 2024-04-19T03:03:20.292 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011421875999999999 2024-04-19T03:03:20.292 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.292 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.292 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:03:20.292 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261251+0000", 2024-04-19T03:03:20.293 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6120000000000001e-06 2024-04-19T03:03:20.293 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.293 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.293 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:20.293 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.274050+0000", 2024-04-19T03:03:20.293 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.012799405 2024-04-19T03:03:20.293 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.293 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.293 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:20.293 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.274529+0000", 2024-04-19T03:03:20.293 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00047867100000000001 2024-04-19T03:03:20.293 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.293 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.293 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:03:20.293 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.282972+0000", 2024-04-19T03:03:20.294 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0084436900000000002 2024-04-19T03:03:20.294 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.294 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.294 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:03:20.294 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.283022+0000", 2024-04-19T03:03:20.294 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9339000000000003e-05 2024-04-19T03:03:20.294 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.294 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.294 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:20.294 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.283088+0000", 2024-04-19T03:03:20.294 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5877999999999995e-05 2024-04-19T03:03:20.294 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:20.294 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:20.294 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:20.295 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.295 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.295 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:158376 5.9 5:9e73c076:::benchmark_data_smithi096_19531_object44926:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-19T03:03:20.295 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:58.126227+0000", 2024-04-19T03:03:20.295 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 22.085827850000001, 2024-04-19T03:03:20.295 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.069738668000000004, 2024-04-19T03:03:20.295 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:20.295 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:20.295 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:20.295 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:20.295 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:20.295 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 158376 2024-04-19T03:03:20.295 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.295 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:20.296 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.296 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:20.296 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.126227+0000", 2024-04-19T03:03:20.296 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:20.296 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.296 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.296 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:20.296 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.126227+0000", 2024-04-19T03:03:20.296 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:20.296 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.296 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.296 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:20.296 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.126226+0000", 2024-04-19T03:03:20.296 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:03:20.296 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.297 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.297 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:20.297 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.126236+0000", 2024-04-19T03:03:20.297 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.4199999999999996e-06 2024-04-19T03:03:20.297 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.297 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.297 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:20.297 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.126243+0000", 2024-04-19T03:03:20.297 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.199e-06 2024-04-19T03:03:20.297 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.297 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.297 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:20.297 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.126248+0000", 2024-04-19T03:03:20.297 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1320000000000002e-06 2024-04-19T03:03:20.298 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.298 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.298 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:20.298 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.126286+0000", 2024-04-19T03:03:20.298 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7401000000000003e-05 2024-04-19T03:03:20.298 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.298 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.298 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:20.298 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.126368+0000", 2024-04-19T03:03:20.298 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2113999999999993e-05 2024-04-19T03:03:20.298 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.298 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.298 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:03:20.299 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.126438+0000", 2024-04-19T03:03:20.299 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0337000000000001e-05 2024-04-19T03:03:20.299 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.299 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.299 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:03:20.299 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.130816+0000", 2024-04-19T03:03:20.299 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0043778330000000002 2024-04-19T03:03:20.299 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.299 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.299 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:20.299 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.195830+0000", 2024-04-19T03:03:20.299 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.065013933999999995 2024-04-19T03:03:20.299 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.299 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.300 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:03:20.300 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.195907+0000", 2024-04-19T03:03:20.300 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7397000000000005e-05 2024-04-19T03:03:20.300 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.300 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.300 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:20.300 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.195966+0000", 2024-04-19T03:03:20.300 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8906999999999997e-05 2024-04-19T03:03:20.300 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:20.300 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:20.300 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:20.300 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.300 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.300 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:158381 5.9 5:94dcd4a7:::benchmark_data_smithi096_19531_object44931:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-19T03:03:20.301 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:58.128712+0000", 2024-04-19T03:03:20.301 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 22.083343407000001, 2024-04-19T03:03:20.301 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.067497527000000002, 2024-04-19T03:03:20.301 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:20.301 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:20.301 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:20.301 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:20.301 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:20.301 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 158381 2024-04-19T03:03:20.301 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.301 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:20.301 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.301 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:20.301 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.128712+0000", 2024-04-19T03:03:20.301 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:20.302 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.302 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.302 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:20.302 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.128712+0000", 2024-04-19T03:03:20.302 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:20.302 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.302 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.302 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:20.302 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.128711+0000", 2024-04-19T03:03:20.302 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:03:20.302 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.302 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.302 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:20.302 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.128716+0000", 2024-04-19T03:03:20.303 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0610000000000003e-06 2024-04-19T03:03:20.303 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.303 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.303 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:20.303 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.128724+0000", 2024-04-19T03:03:20.303 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0120000000000005e-06 2024-04-19T03:03:20.303 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.303 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.303 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:20.303 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.128729+0000", 2024-04-19T03:03:20.303 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8899999999999998e-06 2024-04-19T03:03:20.303 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.303 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.303 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:20.304 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.128778+0000", 2024-04-19T03:03:20.304 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9110000000000002e-05 2024-04-19T03:03:20.304 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.304 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.304 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:20.304 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.128903+0000", 2024-04-19T03:03:20.304 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00012506799999999999 2024-04-19T03:03:20.304 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.304 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.304 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:03:20.304 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.129022+0000", 2024-04-19T03:03:20.304 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00011923599999999999 2024-04-19T03:03:20.304 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.304 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.304 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:03:20.305 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.132294+0000", 2024-04-19T03:03:20.305 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.003271244 2024-04-19T03:03:20.305 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.305 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.305 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:20.305 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.196045+0000", 2024-04-19T03:03:20.305 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.063751206000000005 2024-04-19T03:03:20.305 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.305 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.305 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:03:20.305 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.196133+0000", 2024-04-19T03:03:20.305 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.8213000000000004e-05 2024-04-19T03:03:20.305 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.305 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.305 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:20.306 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.196209+0000", 2024-04-19T03:03:20.306 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6335999999999996e-05 2024-04-19T03:03:20.306 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:20.306 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:20.306 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:20.306 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.306 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.306 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:158385 5.9 5:950ec749:::benchmark_data_smithi096_19531_object44935:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-19T03:03:20.306 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:58.129756+0000", 2024-04-19T03:03:20.306 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 22.082299474999999, 2024-04-19T03:03:20.306 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.068998382999999996, 2024-04-19T03:03:20.306 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:20.306 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:20.306 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:20.307 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:20.307 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:20.307 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 158385 2024-04-19T03:03:20.307 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.307 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:20.307 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.307 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:20.307 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.129756+0000", 2024-04-19T03:03:20.307 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:20.307 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.307 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.307 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:20.307 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.129756+0000", 2024-04-19T03:03:20.307 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:20.308 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.308 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.308 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:20.308 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.129755+0000", 2024-04-19T03:03:20.308 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:03:20.308 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.308 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.308 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:20.308 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.129760+0000", 2024-04-19T03:03:20.308 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6030000000000004e-06 2024-04-19T03:03:20.308 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.308 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.308 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:20.308 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.129774+0000", 2024-04-19T03:03:20.308 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3131e-05 2024-04-19T03:03:20.309 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.309 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.309 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:20.309 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.129781+0000", 2024-04-19T03:03:20.309 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4030000000000001e-06 2024-04-19T03:03:20.309 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.309 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.309 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:20.309 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.130837+0000", 2024-04-19T03:03:20.309 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00105569 2024-04-19T03:03:20.309 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.309 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.309 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:20.309 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.130917+0000", 2024-04-19T03:03:20.309 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9929e-05 2024-04-19T03:03:20.310 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.310 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.310 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:03:20.310 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.130973+0000", 2024-04-19T03:03:20.310 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.664e-05 2024-04-19T03:03:20.310 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.310 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.310 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:03:20.310 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.132340+0000", 2024-04-19T03:03:20.310 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001366321 2024-04-19T03:03:20.310 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.310 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.310 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:20.310 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.198637+0000", 2024-04-19T03:03:20.311 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.066296888999999998 2024-04-19T03:03:20.311 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.311 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.311 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:03:20.311 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.198704+0000", 2024-04-19T03:03:20.311 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7333000000000001e-05 2024-04-19T03:03:20.311 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.311 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.311 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:20.311 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.198754+0000", 2024-04-19T03:03:20.311 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0421999999999999e-05 2024-04-19T03:03:20.311 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:20.311 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:20.311 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:20.312 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.312 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.312 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:158387 5.9 5:9e96f619:::benchmark_data_smithi096_19531_object44937:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-19T03:03:20.312 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:58.132457+0000", 2024-04-19T03:03:20.312 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 22.079597911, 2024-04-19T03:03:20.312 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.066858091999999994, 2024-04-19T03:03:20.312 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:20.312 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:20.312 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:20.312 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:20.312 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:20.312 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 158387 2024-04-19T03:03:20.312 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.312 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:20.313 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.313 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:20.313 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.132457+0000", 2024-04-19T03:03:20.313 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:20.313 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.313 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.313 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:20.313 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.132457+0000", 2024-04-19T03:03:20.313 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:20.313 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.313 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.313 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:20.313 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.132457+0000", 2024-04-19T03:03:20.313 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:20.314 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.314 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.314 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:20.314 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.132460+0000", 2024-04-19T03:03:20.314 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.1949999999999999e-06 2024-04-19T03:03:20.314 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.314 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.314 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:20.314 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.132468+0000", 2024-04-19T03:03:20.314 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.1599999999999998e-06 2024-04-19T03:03:20.314 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.314 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.315 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:20.315 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.132473+0000", 2024-04-19T03:03:20.315 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9259999999999999e-06 2024-04-19T03:03:20.315 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.315 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.315 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:20.315 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.132504+0000", 2024-04-19T03:03:20.315 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0914000000000003e-05 2024-04-19T03:03:20.315 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.315 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.315 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:20.315 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.132646+0000", 2024-04-19T03:03:20.315 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00014214300000000001 2024-04-19T03:03:20.315 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.315 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.316 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:03:20.316 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.132741+0000", 2024-04-19T03:03:20.316 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.4344000000000003e-05 2024-04-19T03:03:20.316 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.316 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.316 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:03:20.316 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.135774+0000", 2024-04-19T03:03:20.316 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0030334960000000001 2024-04-19T03:03:20.316 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.316 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.316 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:20.316 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.199240+0000", 2024-04-19T03:03:20.316 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.063465695000000003 2024-04-19T03:03:20.316 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.317 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.317 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:03:20.317 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.199272+0000", 2024-04-19T03:03:20.317 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2412000000000001e-05 2024-04-19T03:03:20.317 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.317 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.317 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:20.317 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.199316+0000", 2024-04-19T03:03:20.317 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3275000000000002e-05 2024-04-19T03:03:20.317 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:20.317 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:20.317 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:20.317 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.317 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.317 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:158392 5.f 5:f462725f:::benchmark_data_smithi096_19531_object44942:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-19T03:03:20.318 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:58.135703+0000", 2024-04-19T03:03:20.318 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 22.076352131, 2024-04-19T03:03:20.318 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.063132879000000003, 2024-04-19T03:03:20.318 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:20.318 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:20.318 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:20.318 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:20.318 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:20.318 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 158392 2024-04-19T03:03:20.318 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.318 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:20.318 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.318 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:20.319 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.135703+0000", 2024-04-19T03:03:20.319 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:20.319 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.319 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.319 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:20.319 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.135703+0000", 2024-04-19T03:03:20.319 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:20.319 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.319 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.319 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:20.319 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.135702+0000", 2024-04-19T03:03:20.319 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:03:20.319 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.319 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.319 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:20.320 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.135708+0000", 2024-04-19T03:03:20.320 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8270000000000003e-06 2024-04-19T03:03:20.320 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.320 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.320 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:20.320 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.135720+0000", 2024-04-19T03:03:20.320 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2057e-05 2024-04-19T03:03:20.320 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.320 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.320 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:20.320 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.135727+0000", 2024-04-19T03:03:20.320 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8090000000000004e-06 2024-04-19T03:03:20.320 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.320 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.320 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:20.321 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.135768+0000", 2024-04-19T03:03:20.321 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1548999999999998e-05 2024-04-19T03:03:20.321 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.321 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.321 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:20.321 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.135853+0000", 2024-04-19T03:03:20.321 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4845000000000005e-05 2024-04-19T03:03:20.321 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.321 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.321 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:03:20.321 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.135934+0000", 2024-04-19T03:03:20.321 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0315000000000006e-05 2024-04-19T03:03:20.321 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.322 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.322 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:03:20.322 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.138685+0000", 2024-04-19T03:03:20.322 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.002751042 2024-04-19T03:03:20.322 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.322 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.322 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:20.322 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.198747+0000", 2024-04-19T03:03:20.322 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.060062675000000003 2024-04-19T03:03:20.322 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.322 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.322 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:03:20.322 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.198802+0000", 2024-04-19T03:03:20.322 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4469000000000003e-05 2024-04-19T03:03:20.323 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.323 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.323 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:20.323 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.198836+0000", 2024-04-19T03:03:20.323 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4272e-05 2024-04-19T03:03:20.323 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:20.323 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:20.323 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:20.323 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.323 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.323 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:158397 5.d 5:b5d962e9:::benchmark_data_smithi096_19531_object44947:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-19T03:03:20.323 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:58.138717+0000", 2024-04-19T03:03:20.323 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 22.073338188000001, 2024-04-19T03:03:20.323 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.057191467000000003, 2024-04-19T03:03:20.323 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:20.324 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:20.324 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:20.324 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:20.324 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:20.324 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 158397 2024-04-19T03:03:20.324 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.324 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:20.324 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.324 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:20.324 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.138717+0000", 2024-04-19T03:03:20.324 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:20.324 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.324 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.324 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:20.325 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.138717+0000", 2024-04-19T03:03:20.325 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:20.325 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.325 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.325 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:20.325 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.138716+0000", 2024-04-19T03:03:20.325 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999986 2024-04-19T03:03:20.325 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.325 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.325 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:20.325 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.138722+0000", 2024-04-19T03:03:20.325 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1709999999999999e-06 2024-04-19T03:03:20.326 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.326 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.326 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:20.326 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.138731+0000", 2024-04-19T03:03:20.326 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.0310000000000004e-06 2024-04-19T03:03:20.326 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.326 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.326 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:20.326 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.138738+0000", 2024-04-19T03:03:20.326 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8430000000000004e-06 2024-04-19T03:03:20.326 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.326 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.326 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:20.327 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.138789+0000", 2024-04-19T03:03:20.327 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0623e-05 2024-04-19T03:03:20.327 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.327 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.327 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:20.327 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.138945+0000", 2024-04-19T03:03:20.327 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00015671899999999999 2024-04-19T03:03:20.327 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.327 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.327 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:03:20.327 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.139079+0000", 2024-04-19T03:03:20.327 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00013380099999999999 2024-04-19T03:03:20.327 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.327 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.327 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:03:20.328 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.141715+0000", 2024-04-19T03:03:20.328 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0026362849999999999 2024-04-19T03:03:20.328 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.328 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.328 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:20.328 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.195784+0000", 2024-04-19T03:03:20.328 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.054068353 2024-04-19T03:03:20.328 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.328 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.328 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:03:20.328 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.195852+0000", 2024-04-19T03:03:20.328 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8121999999999996e-05 2024-04-19T03:03:20.328 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.328 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.328 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:20.329 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.195909+0000", 2024-04-19T03:03:20.329 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6737999999999998e-05 2024-04-19T03:03:20.329 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:20.329 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:20.329 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:20.329 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:20.329 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:20.329 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-04-19T03:03:20.330 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:03:20.328+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:03:20.331 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T03:03:20.431 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:03:20.428+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:03:20.458 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-19T03:03:20.458 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-04-19T03:03:20.459 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.459 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4755.0:212422 5.d e63/49 5:b392bc9c:::benchmark_data_smithi096_19531_object98972:head v 63'13454, mlcod=63'13450)", 2024-04-19T03:03:20.459 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:03:20.457403+0000", 2024-04-19T03:03:20.459 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.001418409, 2024-04-19T03:03:20.459 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001433962, 2024-04-19T03:03:20.459 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:20.459 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-19T03:03:20.459 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:20.459 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.459 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:20.459 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:20.457403+0000", 2024-04-19T03:03:20.459 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:20.459 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.459 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.460 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:20.460 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:20.457403+0000", 2024-04-19T03:03:20.460 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:20.460 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.460 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.460 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:20.460 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:20.457402+0000", 2024-04-19T03:03:20.460 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:03:20.460 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.460 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.460 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:20.460 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:20.457410+0000", 2024-04-19T03:03:20.460 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.2360000000000004e-06 2024-04-19T03:03:20.460 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.461 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.461 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:20.461 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:20.457430+0000", 2024-04-19T03:03:20.461 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0115e-05 2024-04-19T03:03:20.461 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.461 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.461 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:20.461 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:20.457438+0000", 2024-04-19T03:03:20.461 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.9529999999999999e-06 2024-04-19T03:03:20.461 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.461 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.461 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:20.461 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:20.457502+0000", 2024-04-19T03:03:20.461 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3629999999999999e-05 2024-04-19T03:03:20.461 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.462 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.462 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:20.462 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:20.457521+0000", 2024-04-19T03:03:20.462 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8773000000000001e-05 2024-04-19T03:03:20.462 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:20.462 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:20.462 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:20.462 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.462 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.462 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4755.0:212428 5.f e63/22 5:f4fc789d:::benchmark_data_smithi096_19531_object98978:head v 63'13135, mlcod=63'13133)", 2024-04-19T03:03:20.462 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:03:20.458477+0000", 2024-04-19T03:03:20.462 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.00034426299999999998, 2024-04-19T03:03:20.462 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000407477, 2024-04-19T03:03:20.462 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:20.463 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-19T03:03:20.463 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:20.463 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.463 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:20.463 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:20.458477+0000", 2024-04-19T03:03:20.463 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:20.463 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.463 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.463 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:20.463 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:20.458477+0000", 2024-04-19T03:03:20.463 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:20.463 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.463 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.463 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:20.463 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:20.458476+0000", 2024-04-19T03:03:20.464 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:03:20.464 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.464 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.464 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:20.464 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:20.458483+0000", 2024-04-19T03:03:20.464 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5139999999999998e-06 2024-04-19T03:03:20.464 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.464 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.464 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:20.464 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:20.458492+0000", 2024-04-19T03:03:20.464 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.2050000000000008e-06 2024-04-19T03:03:20.464 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.464 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.464 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:20.465 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:20.458499+0000", 2024-04-19T03:03:20.465 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5239999999999997e-06 2024-04-19T03:03:20.465 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.465 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.465 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:20.465 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:20.458537+0000", 2024-04-19T03:03:20.465 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8665999999999999e-05 2024-04-19T03:03:20.465 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.465 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.465 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:20.465 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:20.458552+0000", 2024-04-19T03:03:20.465 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5201999999999999e-05 2024-04-19T03:03:20.465 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:20.465 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:20.465 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:20.466 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.466 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.466 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:212429 5.e 5:779bfaed:::benchmark_data_smithi096_19531_object98979:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-19T03:03:20.466 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:03:20.458707+0000", 2024-04-19T03:03:20.466 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.000114145, 2024-04-19T03:03:20.466 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000210256, 2024-04-19T03:03:20.466 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:20.466 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-19T03:03:20.466 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:20.466 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:20.466 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:20.466 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 212429 2024-04-19T03:03:20.466 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.466 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:20.467 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.467 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:20.467 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:20.458707+0000", 2024-04-19T03:03:20.467 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:20.467 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.467 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.467 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:20.467 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:20.458707+0000", 2024-04-19T03:03:20.467 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:20.467 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.467 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.467 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:20.467 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:20.458706+0000", 2024-04-19T03:03:20.467 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:03:20.467 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.468 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.468 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:20.468 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:20.458712+0000", 2024-04-19T03:03:20.468 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4190000000000001e-06 2024-04-19T03:03:20.468 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.468 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.468 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:20.468 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:20.458724+0000", 2024-04-19T03:03:20.468 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2758000000000001e-05 2024-04-19T03:03:20.468 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.468 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.468 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:20.468 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:20.458730+0000", 2024-04-19T03:03:20.468 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3179999999999997e-06 2024-04-19T03:03:20.468 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.469 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.469 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:20.469 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:20.458775+0000", 2024-04-19T03:03:20.469 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5793e-05 2024-04-19T03:03:20.469 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.469 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.469 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:20.469 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:20.458922+0000", 2024-04-19T03:03:20.469 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014693200000000001 2024-04-19T03:03:20.469 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:20.469 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:20.469 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:20.469 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.469 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.469 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:212425 5.8 5:1945170f:::benchmark_data_smithi096_19531_object98975:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-19T03:03:20.470 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:03:20.455397+0000", 2024-04-19T03:03:20.470 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0034243400000000001, 2024-04-19T03:03:20.470 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0035613540000000001, 2024-04-19T03:03:20.470 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:20.470 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-19T03:03:20.470 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:20.470 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:20.470 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:20.470 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 212425 2024-04-19T03:03:20.470 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.470 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:20.470 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.470 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:20.470 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:20.455397+0000", 2024-04-19T03:03:20.471 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:20.471 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.471 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.471 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:20.471 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:20.455397+0000", 2024-04-19T03:03:20.471 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:20.471 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.471 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.471 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:20.471 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:20.455396+0000", 2024-04-19T03:03:20.471 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:03:20.471 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.471 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.471 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:20.471 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:20.455401+0000", 2024-04-19T03:03:20.472 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1170000000000003e-06 2024-04-19T03:03:20.472 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.472 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.472 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:20.472 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:20.455410+0000", 2024-04-19T03:03:20.472 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9150000000000002e-06 2024-04-19T03:03:20.472 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.472 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.472 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:20.472 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:20.455416+0000", 2024-04-19T03:03:20.472 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2720000000000003e-06 2024-04-19T03:03:20.472 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.472 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.472 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:20.472 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:20.455457+0000", 2024-04-19T03:03:20.473 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1094999999999999e-05 2024-04-19T03:03:20.473 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.473 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.473 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:20.473 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:20.455562+0000", 2024-04-19T03:03:20.473 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010473599999999999 2024-04-19T03:03:20.473 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:20.473 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:20.473 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:20.473 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.473 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.473 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4755.0:212424 5.9 e63/22 5:931f3f05:::benchmark_data_smithi096_19531_object98974:head v 63'13017, mlcod=63'13014)", 2024-04-19T03:03:20.473 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:03:20.455659+0000", 2024-04-19T03:03:20.473 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0031617820000000001, 2024-04-19T03:03:20.474 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0033436799999999999, 2024-04-19T03:03:20.474 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:20.474 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-19T03:03:20.474 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:20.474 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.474 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:20.474 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:20.455659+0000", 2024-04-19T03:03:20.474 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:20.474 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.474 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.474 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:20.474 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:20.455659+0000", 2024-04-19T03:03:20.474 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:20.474 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.474 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.475 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:20.475 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:20.455659+0000", 2024-04-19T03:03:20.475 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:20.475 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.475 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.475 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:20.475 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:20.455665+0000", 2024-04-19T03:03:20.475 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9279999999999998e-06 2024-04-19T03:03:20.475 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.475 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.475 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:20.475 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:20.455672+0000", 2024-04-19T03:03:20.475 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3649999999999998e-06 2024-04-19T03:03:20.475 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.475 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.476 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:20.476 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:20.455678+0000", 2024-04-19T03:03:20.476 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3310000000000003e-06 2024-04-19T03:03:20.476 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.476 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.476 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:20.476 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:20.455715+0000", 2024-04-19T03:03:20.476 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7523e-05 2024-04-19T03:03:20.476 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.476 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.476 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:20.476 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:20.455736+0000", 2024-04-19T03:03:20.476 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1101e-05 2024-04-19T03:03:20.476 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:20.476 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:20.477 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:20.477 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:20.477 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-04-19T03:03:20.477 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 5 2024-04-19T03:03:20.477 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-19T03:03:20.478 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T03:03:20.532 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:03:20.528+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:03:20.598 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-19T03:03:20.598 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-04-19T03:03:20.598 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-04-19T03:03:20.598 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-04-19T03:03:20.598 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-19T03:03:20.610 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T03:03:20.633 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:03:20.630+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:03:20.682 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-19T03:03:20.734 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:03:20.732+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:03:20.738 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-19T03:03:20.738 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-04-19T03:03:20.738 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-04-19T03:03:20.738 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-04-19T03:03:20.738 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.738 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:86615 5.e 5:7fef7288:::benchmark_data_smithi096_19531_object86614:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:20.738 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:22.634544+0000", 2024-04-19T03:03:20.738 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 58.101522901999999, 2024-04-19T03:03:20.738 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.192475071, 2024-04-19T03:03:20.738 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:20.739 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:20.739 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:20.739 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:20.739 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:20.739 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 86615 2024-04-19T03:03:20.739 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.739 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:20.739 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.739 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:20.739 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634544+0000", 2024-04-19T03:03:20.739 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:20.739 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.739 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.739 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:20.740 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634544+0000", 2024-04-19T03:03:20.740 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:20.740 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.740 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.740 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:20.740 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634542+0000", 2024-04-19T03:03:20.740 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999981 2024-04-19T03:03:20.740 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.740 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.740 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:20.740 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634585+0000", 2024-04-19T03:03:20.740 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2299000000000003e-05 2024-04-19T03:03:20.740 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.740 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.740 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:20.741 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634592+0000", 2024-04-19T03:03:20.741 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2350000000000002e-06 2024-04-19T03:03:20.741 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.741 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.741 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:20.741 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634596+0000", 2024-04-19T03:03:20.741 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5390000000000001e-06 2024-04-19T03:03:20.741 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.741 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.741 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:20.741 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634639+0000", 2024-04-19T03:03:20.741 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2444999999999998e-05 2024-04-19T03:03:20.741 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.741 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.742 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:20.742 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634808+0000", 2024-04-19T03:03:20.742 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000169152 2024-04-19T03:03:20.742 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.742 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.742 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:20.742 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634999+0000", 2024-04-19T03:03:20.742 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00019098300000000001 2024-04-19T03:03:20.742 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.742 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.742 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:20.742 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.640458+0000", 2024-04-19T03:03:20.742 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0054586870000000003 2024-04-19T03:03:20.742 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.742 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.743 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:20.743 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.826949+0000", 2024-04-19T03:03:20.743 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.18649178299999999 2024-04-19T03:03:20.743 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.743 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.743 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:03:20.743 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.826982+0000", 2024-04-19T03:03:20.743 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2477000000000001e-05 2024-04-19T03:03:20.743 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.743 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.743 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:20.743 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.827019+0000", 2024-04-19T03:03:20.743 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7355999999999999e-05 2024-04-19T03:03:20.743 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:20.744 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:20.744 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:20.744 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.744 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.744 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:86616 5.e 5:72278f47:::benchmark_data_smithi096_19531_object86615:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:20.744 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:22.634609+0000", 2024-04-19T03:03:20.744 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 58.101457752999998, 2024-04-19T03:03:20.744 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.19472088900000001, 2024-04-19T03:03:20.744 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:20.744 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:20.744 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:20.744 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:20.744 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:20.744 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 86616 2024-04-19T03:03:20.745 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.745 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:20.745 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.745 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:20.745 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634609+0000", 2024-04-19T03:03:20.745 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:20.745 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.745 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.745 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:20.745 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634609+0000", 2024-04-19T03:03:20.745 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:20.745 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.745 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.745 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:20.745 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634609+0000", 2024-04-19T03:03:20.746 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:20.746 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.746 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.746 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:20.746 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634651+0000", 2024-04-19T03:03:20.746 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2589000000000002e-05 2024-04-19T03:03:20.746 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.746 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.746 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:20.746 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634659+0000", 2024-04-19T03:03:20.746 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5850000000000002e-06 2024-04-19T03:03:20.746 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.746 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.746 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:20.747 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634662+0000", 2024-04-19T03:03:20.747 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3620000000000002e-06 2024-04-19T03:03:20.747 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.747 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.747 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:20.747 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.637880+0000", 2024-04-19T03:03:20.747 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.003218149 2024-04-19T03:03:20.747 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.747 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.747 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:20.747 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.637999+0000", 2024-04-19T03:03:20.747 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000118643 2024-04-19T03:03:20.747 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.747 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.748 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:20.748 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.638102+0000", 2024-04-19T03:03:20.748 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010331 2024-04-19T03:03:20.748 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.748 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.748 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:20.748 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.640851+0000", 2024-04-19T03:03:20.748 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0027483310000000001 2024-04-19T03:03:20.748 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.748 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.748 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:20.748 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.829269+0000", 2024-04-19T03:03:20.748 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.188418319 2024-04-19T03:03:20.748 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.748 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.749 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:03:20.749 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.829299+0000", 2024-04-19T03:03:20.749 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0227e-05 2024-04-19T03:03:20.749 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.749 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.749 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:20.749 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.829330+0000", 2024-04-19T03:03:20.749 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0969000000000001e-05 2024-04-19T03:03:20.749 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:20.749 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:20.749 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:20.749 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.749 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.749 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:86618 5.0 5:09014b90:::benchmark_data_smithi096_19531_object86617:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:20.750 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:22.634894+0000", 2024-04-19T03:03:20.750 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 58.101173265, 2024-04-19T03:03:20.750 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.19413419800000001, 2024-04-19T03:03:20.750 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:20.750 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:20.750 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:20.750 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:20.750 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:20.750 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 86618 2024-04-19T03:03:20.750 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.750 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:20.750 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.750 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:20.750 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634894+0000", 2024-04-19T03:03:20.751 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:20.751 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.751 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.751 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:20.751 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634894+0000", 2024-04-19T03:03:20.751 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:20.751 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.751 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.751 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:20.751 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634893+0000", 2024-04-19T03:03:20.751 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:03:20.751 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.751 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.752 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:20.752 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634976+0000", 2024-04-19T03:03:20.752 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3231000000000003e-05 2024-04-19T03:03:20.752 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.752 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.752 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:20.752 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634983+0000", 2024-04-19T03:03:20.752 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5169999999999996e-06 2024-04-19T03:03:20.752 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.752 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.752 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:20.752 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634987+0000", 2024-04-19T03:03:20.752 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.425e-06 2024-04-19T03:03:20.752 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.752 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.753 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:20.753 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635030+0000", 2024-04-19T03:03:20.753 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.32e-05 2024-04-19T03:03:20.753 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.753 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.753 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:20.753 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635185+0000", 2024-04-19T03:03:20.753 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015471899999999999 2024-04-19T03:03:20.753 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.753 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.753 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:20.753 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635415+0000", 2024-04-19T03:03:20.753 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00023026500000000001 2024-04-19T03:03:20.753 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.754 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.754 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:20.754 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.640127+0000", 2024-04-19T03:03:20.754 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0047118890000000004 2024-04-19T03:03:20.754 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.754 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.754 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:20.754 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.828895+0000", 2024-04-19T03:03:20.754 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.18876802600000001 2024-04-19T03:03:20.754 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.754 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.754 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:03:20.754 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.828972+0000", 2024-04-19T03:03:20.754 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.6345000000000002e-05 2024-04-19T03:03:20.755 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.755 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.755 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:20.755 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.829028+0000", 2024-04-19T03:03:20.755 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6342999999999999e-05 2024-04-19T03:03:20.755 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:20.755 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:20.755 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:20.755 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.755 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.755 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:86620 5.b 5:d80faa68:::benchmark_data_smithi096_19531_object86619:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:20.755 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:22.635110+0000", 2024-04-19T03:03:20.756 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 58.100956705000002, 2024-04-19T03:03:20.756 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.193447275, 2024-04-19T03:03:20.756 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:20.756 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:20.756 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:20.756 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:20.756 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:20.756 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 86620 2024-04-19T03:03:20.756 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.756 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:20.756 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.756 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:20.756 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635110+0000", 2024-04-19T03:03:20.756 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:20.756 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.757 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.757 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:20.757 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635110+0000", 2024-04-19T03:03:20.757 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:20.757 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.757 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.757 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:20.757 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635110+0000", 2024-04-19T03:03:20.757 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:20.757 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.757 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.757 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:20.757 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635154+0000", 2024-04-19T03:03:20.757 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4681000000000001e-05 2024-04-19T03:03:20.758 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.758 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.758 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:20.758 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635166+0000", 2024-04-19T03:03:20.758 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1505000000000001e-05 2024-04-19T03:03:20.758 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.758 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.758 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:20.758 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635171+0000", 2024-04-19T03:03:20.758 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6040000000000003e-06 2024-04-19T03:03:20.758 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.758 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.758 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:20.759 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635221+0000", 2024-04-19T03:03:20.759 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9947000000000001e-05 2024-04-19T03:03:20.759 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.759 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.759 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:20.759 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635356+0000", 2024-04-19T03:03:20.759 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013576199999999999 2024-04-19T03:03:20.759 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.759 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.759 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:20.759 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635507+0000", 2024-04-19T03:03:20.759 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015072999999999999 2024-04-19T03:03:20.759 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.759 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.759 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:20.760 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.638488+0000", 2024-04-19T03:03:20.760 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0029813159999999999 2024-04-19T03:03:20.760 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.760 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.760 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:20.760 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.828341+0000", 2024-04-19T03:03:20.760 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.189852254 2024-04-19T03:03:20.760 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.760 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.760 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:03:20.760 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.828416+0000", 2024-04-19T03:03:20.761 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5344000000000002e-05 2024-04-19T03:03:20.761 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.761 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.761 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:20.761 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.828558+0000", 2024-04-19T03:03:20.761 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000141695 2024-04-19T03:03:20.761 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:20.761 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:20.761 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:20.761 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.761 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.761 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:86621 5.8 5:1597a420:::benchmark_data_smithi096_19531_object86620:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:20.761 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:22.635187+0000", 2024-04-19T03:03:20.761 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 58.100879845000001, 2024-04-19T03:03:20.762 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.194204878, 2024-04-19T03:03:20.762 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:20.762 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:20.762 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:20.762 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:20.762 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:20.762 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 86621 2024-04-19T03:03:20.762 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.762 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:20.762 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.762 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:20.762 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635187+0000", 2024-04-19T03:03:20.762 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:20.762 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.762 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.763 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:20.763 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635187+0000", 2024-04-19T03:03:20.763 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:20.763 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.763 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.763 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:20.763 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635187+0000", 2024-04-19T03:03:20.763 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:20.763 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.763 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.763 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:20.763 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635242+0000", 2024-04-19T03:03:20.763 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5158000000000003e-05 2024-04-19T03:03:20.763 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.764 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.764 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:20.764 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635249+0000", 2024-04-19T03:03:20.764 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.7000000000000008e-06 2024-04-19T03:03:20.764 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.764 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.764 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:20.764 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635256+0000", 2024-04-19T03:03:20.764 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2060000000000004e-06 2024-04-19T03:03:20.764 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.764 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.764 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:20.764 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635302+0000", 2024-04-19T03:03:20.764 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5954000000000001e-05 2024-04-19T03:03:20.765 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.765 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.765 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:20.765 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635427+0000", 2024-04-19T03:03:20.765 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012559299999999999 2024-04-19T03:03:20.765 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.765 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.765 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:20.765 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635596+0000", 2024-04-19T03:03:20.765 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000168615 2024-04-19T03:03:20.765 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.765 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.765 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:20.765 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.639320+0000", 2024-04-19T03:03:20.765 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0037244610000000001 2024-04-19T03:03:20.766 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.766 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.766 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:20.766 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.829277+0000", 2024-04-19T03:03:20.766 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.18995651099999999 2024-04-19T03:03:20.766 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.766 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.766 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:03:20.766 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.829341+0000", 2024-04-19T03:03:20.766 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3756000000000004e-05 2024-04-19T03:03:20.766 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.766 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.766 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:20.767 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.829392+0000", 2024-04-19T03:03:20.767 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1555999999999999e-05 2024-04-19T03:03:20.767 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:20.767 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:20.767 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:20.767 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.767 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.767 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87067 5.b 5:d57af71a:::benchmark_data_smithi096_19531_object87066:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:20.767 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.142233+0000", 2024-04-19T03:03:20.767 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 57.593833982, 2024-04-19T03:03:20.767 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.071692405000000001, 2024-04-19T03:03:20.767 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:20.767 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:20.767 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:20.767 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:20.768 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:20.768 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87067 2024-04-19T03:03:20.768 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.768 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:20.768 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.768 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:20.768 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142233+0000", 2024-04-19T03:03:20.768 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:20.768 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.768 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.768 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:20.768 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142233+0000", 2024-04-19T03:03:20.768 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:20.768 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.769 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.769 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:20.769 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142232+0000", 2024-04-19T03:03:20.769 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:03:20.769 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.769 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.769 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:20.769 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142277+0000", 2024-04-19T03:03:20.769 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5837000000000002e-05 2024-04-19T03:03:20.769 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.769 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.769 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:20.769 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142297+0000", 2024-04-19T03:03:20.769 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9561000000000001e-05 2024-04-19T03:03:20.769 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.770 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.770 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:20.770 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142311+0000", 2024-04-19T03:03:20.770 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3654e-05 2024-04-19T03:03:20.770 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.770 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.770 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:20.770 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142391+0000", 2024-04-19T03:03:20.770 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0123999999999994e-05 2024-04-19T03:03:20.770 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.770 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.770 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:20.770 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142669+0000", 2024-04-19T03:03:20.771 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00027829800000000001 2024-04-19T03:03:20.771 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.771 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.771 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:20.771 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142859+0000", 2024-04-19T03:03:20.771 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000190051 2024-04-19T03:03:20.771 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.771 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.771 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:20.771 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.150597+0000", 2024-04-19T03:03:20.771 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0077380299999999999 2024-04-19T03:03:20.771 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.771 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.771 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:20.772 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.213855+0000", 2024-04-19T03:03:20.772 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.063257987000000002 2024-04-19T03:03:20.772 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.772 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.772 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:03:20.772 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.213898+0000", 2024-04-19T03:03:20.772 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2916e-05 2024-04-19T03:03:20.772 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.772 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.772 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:20.772 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.213925+0000", 2024-04-19T03:03:20.772 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7503000000000001e-05 2024-04-19T03:03:20.772 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:20.772 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:20.772 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:20.773 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.773 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.773 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87069 5.b 5:da0c93b5:::benchmark_data_smithi096_19531_object87068:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:20.773 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.143402+0000", 2024-04-19T03:03:20.773 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 57.592665019999998, 2024-04-19T03:03:20.773 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.070678598999999995, 2024-04-19T03:03:20.773 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:20.773 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:20.773 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:20.773 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:20.773 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:20.773 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87069 2024-04-19T03:03:20.773 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.773 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:20.774 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.774 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:20.774 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.143402+0000", 2024-04-19T03:03:20.774 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:20.774 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.774 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.774 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:20.774 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.143402+0000", 2024-04-19T03:03:20.774 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:20.774 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.774 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.774 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:20.774 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.143401+0000", 2024-04-19T03:03:20.774 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:03:20.775 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.775 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.775 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:20.775 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.143501+0000", 2024-04-19T03:03:20.775 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000100387 2024-04-19T03:03:20.775 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.775 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.775 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:20.775 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.143516+0000", 2024-04-19T03:03:20.775 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5369000000000001e-05 2024-04-19T03:03:20.775 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.775 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.775 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:20.775 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.143524+0000", 2024-04-19T03:03:20.775 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.7079999999999997e-06 2024-04-19T03:03:20.776 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.776 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.776 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:20.776 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.145550+0000", 2024-04-19T03:03:20.776 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0020259290000000001 2024-04-19T03:03:20.776 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.776 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.776 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:20.776 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.145676+0000", 2024-04-19T03:03:20.776 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000126406 2024-04-19T03:03:20.776 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.776 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.776 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:20.776 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.145802+0000", 2024-04-19T03:03:20.776 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000125974 2024-04-19T03:03:20.777 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.777 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.777 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:20.777 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.151030+0000", 2024-04-19T03:03:20.777 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0052276079999999999 2024-04-19T03:03:20.777 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.777 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.777 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:20.777 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.213998+0000", 2024-04-19T03:03:20.777 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.06296786 2024-04-19T03:03:20.777 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.777 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.777 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:03:20.777 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.214031+0000", 2024-04-19T03:03:20.777 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3387999999999999e-05 2024-04-19T03:03:20.778 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.778 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.778 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:20.778 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.214081+0000", 2024-04-19T03:03:20.778 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9316e-05 2024-04-19T03:03:20.778 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:20.778 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:20.778 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:20.778 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.778 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.778 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87108 5.e 5:7e197adc:::benchmark_data_smithi096_19531_object87107:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:20.778 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.223103+0000", 2024-04-19T03:03:20.778 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 57.512963683000002, 2024-04-19T03:03:20.779 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.044946887, 2024-04-19T03:03:20.779 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:20.779 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-19T03:03:20.779 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:20.779 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:20.779 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:20.779 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87108 2024-04-19T03:03:20.779 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.779 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:20.779 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.779 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:20.779 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.223103+0000", 2024-04-19T03:03:20.779 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:20.779 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.780 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.780 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:20.780 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.223103+0000", 2024-04-19T03:03:20.780 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:20.780 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.780 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.780 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:20.780 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.223102+0000", 2024-04-19T03:03:20.780 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:03:20.780 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.780 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.780 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:20.780 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.223156+0000", 2024-04-19T03:03:20.780 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3958000000000001e-05 2024-04-19T03:03:20.780 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.781 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.781 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:20.781 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.223166+0000", 2024-04-19T03:03:20.781 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.4809999999999995e-06 2024-04-19T03:03:20.781 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.781 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.781 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:20.781 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.223172+0000", 2024-04-19T03:03:20.781 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0140000000000004e-06 2024-04-19T03:03:20.781 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.781 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.781 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:20.781 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.227295+0000", 2024-04-19T03:03:20.781 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0041233420000000003 2024-04-19T03:03:20.782 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.782 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.782 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:20.782 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.227495+0000", 2024-04-19T03:03:20.782 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00019955299999999999 2024-04-19T03:03:20.782 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.782 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.782 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:20.782 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.227717+0000", 2024-04-19T03:03:20.782 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000221902 2024-04-19T03:03:20.782 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.782 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.782 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:20.782 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233189+0000", 2024-04-19T03:03:20.783 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0054718889999999997 2024-04-19T03:03:20.783 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.783 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.783 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:20.783 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.250529+0000", 2024-04-19T03:03:20.783 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.017340298000000001 2024-04-19T03:03:20.783 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.783 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.783 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:03:20.783 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.250539+0000", 2024-04-19T03:03:20.783 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0501e-05 2024-04-19T03:03:20.783 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.783 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.783 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:20.783 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.268003+0000", 2024-04-19T03:03:20.784 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.017463429 2024-04-19T03:03:20.784 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.784 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.784 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:20.784 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.268050+0000", 2024-04-19T03:03:20.784 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7466000000000003e-05 2024-04-19T03:03:20.784 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:20.784 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:20.784 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:20.784 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.784 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.784 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87118 5.b 5:d1bb4f3c:::benchmark_data_smithi096_19531_object87117:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:20.784 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.231082+0000", 2024-04-19T03:03:20.784 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 57.504984849000003, 2024-04-19T03:03:20.785 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.035789004, 2024-04-19T03:03:20.785 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:20.785 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-19T03:03:20.785 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:20.785 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:20.785 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:20.785 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87118 2024-04-19T03:03:20.785 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.785 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:20.785 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.785 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:20.785 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231082+0000", 2024-04-19T03:03:20.785 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:20.785 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.786 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.786 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:20.786 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231082+0000", 2024-04-19T03:03:20.786 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:20.786 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.786 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.786 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:20.786 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231081+0000", 2024-04-19T03:03:20.786 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:03:20.786 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.786 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.786 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:20.786 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231159+0000", 2024-04-19T03:03:20.786 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.7819999999999997e-05 2024-04-19T03:03:20.787 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.787 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.787 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:20.787 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231186+0000", 2024-04-19T03:03:20.787 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7126000000000001e-05 2024-04-19T03:03:20.787 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.787 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.787 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:20.787 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231193+0000", 2024-04-19T03:03:20.787 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7259999999999996e-06 2024-04-19T03:03:20.787 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.787 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.787 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:20.787 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231241+0000", 2024-04-19T03:03:20.788 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8123e-05 2024-04-19T03:03:20.788 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.788 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.788 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:20.788 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231354+0000", 2024-04-19T03:03:20.788 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0001133 2024-04-19T03:03:20.788 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.788 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.788 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:20.788 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231443+0000", 2024-04-19T03:03:20.788 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9167999999999997e-05 2024-04-19T03:03:20.788 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.788 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.788 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:20.788 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236498+0000", 2024-04-19T03:03:20.789 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0050545160000000002 2024-04-19T03:03:20.789 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.789 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.789 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:20.789 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.249681+0000", 2024-04-19T03:03:20.789 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013183321 2024-04-19T03:03:20.789 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.789 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.789 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:03:20.789 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.249693+0000", 2024-04-19T03:03:20.789 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1834999999999999e-05 2024-04-19T03:03:20.789 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.789 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.789 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:20.789 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266733+0000", 2024-04-19T03:03:20.790 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.017040408 2024-04-19T03:03:20.790 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.790 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.790 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:20.790 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266871+0000", 2024-04-19T03:03:20.790 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000137849 2024-04-19T03:03:20.790 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:20.790 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:20.790 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:20.790 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.790 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.790 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87121 5.b 5:d01822b8:::benchmark_data_smithi096_19531_object87120:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:20.790 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.233319+0000", 2024-04-19T03:03:20.791 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 57.502747984999999, 2024-04-19T03:03:20.791 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.033624198, 2024-04-19T03:03:20.791 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:20.791 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-19T03:03:20.791 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:20.791 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:20.791 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:20.791 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87121 2024-04-19T03:03:20.791 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.791 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:20.791 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.791 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:20.791 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233319+0000", 2024-04-19T03:03:20.792 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:20.792 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.792 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.792 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:20.792 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233319+0000", 2024-04-19T03:03:20.792 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:20.792 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.792 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.792 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:20.792 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233319+0000", 2024-04-19T03:03:20.792 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:20.792 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.792 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.792 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:20.792 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233364+0000", 2024-04-19T03:03:20.793 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5460999999999997e-05 2024-04-19T03:03:20.793 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.793 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.793 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:20.793 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233382+0000", 2024-04-19T03:03:20.793 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8148e-05 2024-04-19T03:03:20.793 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.793 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.793 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:20.793 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233390+0000", 2024-04-19T03:03:20.793 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5340000000000002e-06 2024-04-19T03:03:20.793 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.793 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.793 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:20.794 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233712+0000", 2024-04-19T03:03:20.794 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00032260500000000001 2024-04-19T03:03:20.794 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.794 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.794 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:20.794 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233829+0000", 2024-04-19T03:03:20.794 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011638599999999999 2024-04-19T03:03:20.794 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.794 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.794 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:20.794 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233959+0000", 2024-04-19T03:03:20.794 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013013900000000001 2024-04-19T03:03:20.794 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.794 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.795 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:20.795 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236515+0000", 2024-04-19T03:03:20.795 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0025562750000000002 2024-04-19T03:03:20.795 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.795 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.795 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:20.795 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.249723+0000", 2024-04-19T03:03:20.795 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013208176 2024-04-19T03:03:20.795 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.795 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.795 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:03:20.795 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.249728+0000", 2024-04-19T03:03:20.795 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6519999999999997e-06 2024-04-19T03:03:20.795 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.796 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.796 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:20.796 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266837+0000", 2024-04-19T03:03:20.796 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0171087059999999 2024-04-19T03:03:20.796 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.796 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.796 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:20.796 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266943+0000", 2024-04-19T03:03:20.796 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000106604 2024-04-19T03:03:20.796 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:20.796 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:20.796 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:20.796 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.796 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.796 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87124 5.8 5:14819ad7:::benchmark_data_smithi096_19531_object87123:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:20.797 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.235886+0000", 2024-04-19T03:03:20.797 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 57.500180561000001, 2024-04-19T03:03:20.797 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0315451179999999, 2024-04-19T03:03:20.797 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:20.797 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-19T03:03:20.797 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:20.797 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:20.797 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:20.797 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87124 2024-04-19T03:03:20.797 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.797 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:20.797 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.797 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:20.797 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.235886+0000", 2024-04-19T03:03:20.797 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:20.798 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.798 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.798 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:20.798 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.235886+0000", 2024-04-19T03:03:20.798 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:20.798 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.798 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.798 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:20.798 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.235886+0000", 2024-04-19T03:03:20.798 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:03:20.798 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.798 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.798 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:20.799 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.235934+0000", 2024-04-19T03:03:20.799 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8384000000000003e-05 2024-04-19T03:03:20.799 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.799 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.799 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:20.799 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.235945+0000", 2024-04-19T03:03:20.799 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0671e-05 2024-04-19T03:03:20.799 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.799 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.799 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:20.799 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.235952+0000", 2024-04-19T03:03:20.799 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3089999999999998e-06 2024-04-19T03:03:20.799 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.799 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.799 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:20.800 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.237067+0000", 2024-04-19T03:03:20.800 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001115263 2024-04-19T03:03:20.800 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.800 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.800 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:20.800 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.237188+0000", 2024-04-19T03:03:20.800 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000121258 2024-04-19T03:03:20.800 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.800 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.800 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:20.800 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.237316+0000", 2024-04-19T03:03:20.800 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000128071 2024-04-19T03:03:20.800 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.800 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.800 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:20.801 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240744+0000", 2024-04-19T03:03:20.801 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0034275629999999998 2024-04-19T03:03:20.801 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.801 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.801 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:20.801 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.252517+0000", 2024-04-19T03:03:20.801 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011772991999999999 2024-04-19T03:03:20.801 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.801 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.801 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:03:20.801 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.252523+0000", 2024-04-19T03:03:20.801 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3640000000000004e-06 2024-04-19T03:03:20.801 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.801 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.802 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:20.802 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.267290+0000", 2024-04-19T03:03:20.802 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0147665690000001 2024-04-19T03:03:20.802 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.802 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.802 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:20.802 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.267432+0000", 2024-04-19T03:03:20.802 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014165299999999999 2024-04-19T03:03:20.802 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:20.802 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:20.802 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:20.802 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.802 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.802 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87129 5.0 5:02667e01:::benchmark_data_smithi096_19531_object87128:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:20.803 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.236466+0000", 2024-04-19T03:03:20.803 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 57.499600565000001, 2024-04-19T03:03:20.803 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0301534510000001, 2024-04-19T03:03:20.803 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:20.803 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-19T03:03:20.803 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:20.803 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:20.803 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:20.803 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87129 2024-04-19T03:03:20.803 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.803 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:20.803 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.803 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:20.803 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236466+0000", 2024-04-19T03:03:20.803 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:20.804 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.804 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.804 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:20.804 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236466+0000", 2024-04-19T03:03:20.804 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:20.804 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.804 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.804 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:20.804 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236465+0000", 2024-04-19T03:03:20.804 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:03:20.804 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.804 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.804 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:20.804 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236566+0000", 2024-04-19T03:03:20.805 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010047000000000001 2024-04-19T03:03:20.805 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.805 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.805 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:20.805 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236577+0000", 2024-04-19T03:03:20.805 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1772e-05 2024-04-19T03:03:20.805 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.805 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.805 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:20.805 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236584+0000", 2024-04-19T03:03:20.805 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0530000000000003e-06 2024-04-19T03:03:20.805 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.805 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.805 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:20.805 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.237023+0000", 2024-04-19T03:03:20.806 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000439703 2024-04-19T03:03:20.806 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.806 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.806 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:20.806 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.237207+0000", 2024-04-19T03:03:20.806 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000183692 2024-04-19T03:03:20.806 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.806 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.806 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:20.806 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.237373+0000", 2024-04-19T03:03:20.806 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016623500000000001 2024-04-19T03:03:20.806 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.806 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.806 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:20.807 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.241461+0000", 2024-04-19T03:03:20.807 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0040883050000000004 2024-04-19T03:03:20.807 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.807 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.807 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:20.807 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.252500+0000", 2024-04-19T03:03:20.807 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011038450999999999 2024-04-19T03:03:20.807 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.807 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.807 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:03:20.807 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.252507+0000", 2024-04-19T03:03:20.807 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2439999999999996e-06 2024-04-19T03:03:20.807 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.807 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.808 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:20.808 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266538+0000", 2024-04-19T03:03:20.808 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.014031184 2024-04-19T03:03:20.808 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.808 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.808 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:20.808 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266620+0000", 2024-04-19T03:03:20.808 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1600000000000005e-05 2024-04-19T03:03:20.808 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:20.808 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:20.808 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:20.808 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.808 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.808 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87135 5.4 5:2a97e7b7:::benchmark_data_smithi096_19531_object87134:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:20.808 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.240884+0000", 2024-04-19T03:03:20.809 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 57.495183107999999, 2024-04-19T03:03:20.809 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.025708931, 2024-04-19T03:03:20.809 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:20.809 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-19T03:03:20.809 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:20.809 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:20.809 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:20.809 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87135 2024-04-19T03:03:20.809 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.809 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:20.809 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.809 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:20.809 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240884+0000", 2024-04-19T03:03:20.809 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:20.809 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.810 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.810 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:20.810 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240884+0000", 2024-04-19T03:03:20.810 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:20.810 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.810 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.810 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:20.810 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240883+0000", 2024-04-19T03:03:20.810 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:03:20.810 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.810 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.810 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:20.810 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240933+0000", 2024-04-19T03:03:20.811 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9969999999999998e-05 2024-04-19T03:03:20.811 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.811 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.811 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:20.811 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240946+0000", 2024-04-19T03:03:20.811 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2943e-05 2024-04-19T03:03:20.811 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.811 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.811 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:20.811 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240952+0000", 2024-04-19T03:03:20.811 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8930000000000002e-06 2024-04-19T03:03:20.811 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.811 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.812 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:20.812 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240994+0000", 2024-04-19T03:03:20.812 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2753999999999998e-05 2024-04-19T03:03:20.812 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.812 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.812 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:20.812 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.241092+0000", 2024-04-19T03:03:20.812 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.7447000000000004e-05 2024-04-19T03:03:20.812 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.812 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.812 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:20.812 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.241183+0000", 2024-04-19T03:03:20.812 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1163999999999997e-05 2024-04-19T03:03:20.812 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.813 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.813 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:20.813 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.254672+0000", 2024-04-19T03:03:20.813 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.01348864 2024-04-19T03:03:20.813 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.813 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.813 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:03:20.813 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.254681+0000", 2024-04-19T03:03:20.813 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.3789999999999995e-06 2024-04-19T03:03:20.813 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.813 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.813 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:20.813 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266456+0000", 2024-04-19T03:03:20.813 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.011774621 2024-04-19T03:03:20.814 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.814 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.814 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:20.814 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266593+0000", 2024-04-19T03:03:20.814 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013737600000000001 2024-04-19T03:03:20.814 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:20.814 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:20.814 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:20.814 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.814 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.814 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87136 5.4 5:212411bc:::benchmark_data_smithi096_19531_object87135:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:20.814 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.240962+0000", 2024-04-19T03:03:20.814 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 57.495105232, 2024-04-19T03:03:20.815 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.025738, 2024-04-19T03:03:20.815 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:20.815 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-19T03:03:20.815 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:20.815 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:20.815 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:20.815 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87136 2024-04-19T03:03:20.815 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.815 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:20.815 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.815 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:20.815 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240962+0000", 2024-04-19T03:03:20.815 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:20.815 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.816 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.816 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:20.816 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240962+0000", 2024-04-19T03:03:20.816 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:20.816 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.816 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.816 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:20.816 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240961+0000", 2024-04-19T03:03:20.816 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:20.816 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.816 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.816 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:20.816 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240995+0000", 2024-04-19T03:03:20.816 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3868000000000002e-05 2024-04-19T03:03:20.817 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.817 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.817 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:20.817 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.241001+0000", 2024-04-19T03:03:20.817 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.322e-06 2024-04-19T03:03:20.817 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.817 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.817 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:20.817 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.241004+0000", 2024-04-19T03:03:20.817 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3510000000000002e-06 2024-04-19T03:03:20.817 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.817 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.817 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:20.817 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247131+0000", 2024-04-19T03:03:20.817 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0061270869999999998 2024-04-19T03:03:20.818 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.818 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.818 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:20.818 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247322+0000", 2024-04-19T03:03:20.818 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000191015 2024-04-19T03:03:20.818 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.818 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.818 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:20.818 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247542+0000", 2024-04-19T03:03:20.818 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00022030199999999999 2024-04-19T03:03:20.818 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.818 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.818 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:20.819 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.254709+0000", 2024-04-19T03:03:20.819 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0071662660000000001 2024-04-19T03:03:20.819 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.819 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.819 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:03:20.819 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.254716+0000", 2024-04-19T03:03:20.819 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3860000000000001e-06 2024-04-19T03:03:20.819 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.819 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.819 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:20.819 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266619+0000", 2024-04-19T03:03:20.819 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0119031030000001 2024-04-19T03:03:20.819 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.819 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.820 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:20.820 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266700+0000", 2024-04-19T03:03:20.820 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0764000000000001e-05 2024-04-19T03:03:20.820 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:20.820 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:20.820 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:20.820 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.820 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.820 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87138 5.e 5:7b1f1c20:::benchmark_data_smithi096_19531_object87137:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:20.820 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.247862+0000", 2024-04-19T03:03:20.820 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 57.488205158, 2024-04-19T03:03:20.820 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.024457079, 2024-04-19T03:03:20.820 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:20.820 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:20.821 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:20.821 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:20.821 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:20.821 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87138 2024-04-19T03:03:20.821 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.821 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:20.821 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.821 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:20.821 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247862+0000", 2024-04-19T03:03:20.821 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:20.821 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.821 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.821 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:20.821 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247862+0000", 2024-04-19T03:03:20.822 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:20.822 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.822 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.822 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:20.822 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247860+0000", 2024-04-19T03:03:20.822 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999981 2024-04-19T03:03:20.822 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.822 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.822 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:20.822 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247909+0000", 2024-04-19T03:03:20.822 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9150999999999997e-05 2024-04-19T03:03:20.822 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.822 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.822 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:20.823 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247925+0000", 2024-04-19T03:03:20.823 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5761999999999999e-05 2024-04-19T03:03:20.823 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.823 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.823 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:20.823 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247936+0000", 2024-04-19T03:03:20.823 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1144e-05 2024-04-19T03:03:20.823 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.823 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.823 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:20.823 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.250590+0000", 2024-04-19T03:03:20.823 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.002653678 2024-04-19T03:03:20.823 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.823 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.824 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:03:20.824 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.250599+0000", 2024-04-19T03:03:20.824 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9039999999999998e-06 2024-04-19T03:03:20.824 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.824 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.824 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:20.824 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.268151+0000", 2024-04-19T03:03:20.824 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0175523449999999 2024-04-19T03:03:20.824 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.824 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.824 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:20.824 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.268285+0000", 2024-04-19T03:03:20.824 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013415599999999999 2024-04-19T03:03:20.824 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.825 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.825 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:20.825 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.272238+0000", 2024-04-19T03:03:20.825 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0039533019999999997 2024-04-19T03:03:20.825 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.825 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.825 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:03:20.825 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.272274+0000", 2024-04-19T03:03:20.825 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5352000000000003e-05 2024-04-19T03:03:20.825 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.825 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.825 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:20.825 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.272319+0000", 2024-04-19T03:03:20.825 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5281999999999998e-05 2024-04-19T03:03:20.826 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:20.826 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:20.826 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:20.826 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.826 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.826 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:158371 5.8 5:11a83024:::benchmark_data_smithi096_19531_object44921:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-19T03:03:20.826 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:58.125869+0000", 2024-04-19T03:03:20.826 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 22.610198293, 2024-04-19T03:03:20.826 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074532857999999994, 2024-04-19T03:03:20.826 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:20.826 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:20.826 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:20.826 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:20.826 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:20.827 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 158371 2024-04-19T03:03:20.827 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.827 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:20.827 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.827 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:20.827 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125869+0000", 2024-04-19T03:03:20.827 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:20.827 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.827 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.827 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:20.827 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125869+0000", 2024-04-19T03:03:20.827 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:20.827 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.827 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.828 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:20.828 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125868+0000", 2024-04-19T03:03:20.828 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:03:20.828 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.828 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.828 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:20.828 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125874+0000", 2024-04-19T03:03:20.828 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7120000000000003e-06 2024-04-19T03:03:20.828 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.828 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.828 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:20.828 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125885+0000", 2024-04-19T03:03:20.828 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0665999999999999e-05 2024-04-19T03:03:20.829 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.829 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.829 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:20.829 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125901+0000", 2024-04-19T03:03:20.829 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6463000000000001e-05 2024-04-19T03:03:20.829 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.829 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.829 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:20.829 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125956+0000", 2024-04-19T03:03:20.829 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4728000000000002e-05 2024-04-19T03:03:20.829 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.829 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.829 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:20.829 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.126050+0000", 2024-04-19T03:03:20.829 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.3534000000000003e-05 2024-04-19T03:03:20.830 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.830 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.830 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:20.830 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.200187+0000", 2024-04-19T03:03:20.830 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074136933000000002 2024-04-19T03:03:20.830 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.830 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.830 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:03:20.830 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.200260+0000", 2024-04-19T03:03:20.830 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3090999999999995e-05 2024-04-19T03:03:20.830 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.830 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.830 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:20.830 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.200402+0000", 2024-04-19T03:03:20.831 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014193699999999999 2024-04-19T03:03:20.831 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:20.831 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:20.831 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:20.831 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.831 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.831 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:158372 5.0 5:0473aa5f:::benchmark_data_smithi096_19531_object44922:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-19T03:03:20.831 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:58.125924+0000", 2024-04-19T03:03:20.831 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 22.610142686, 2024-04-19T03:03:20.831 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074247490999999999, 2024-04-19T03:03:20.831 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:20.831 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:20.831 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:20.831 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:20.832 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:20.832 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 158372 2024-04-19T03:03:20.832 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.832 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:20.832 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.832 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:20.832 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125924+0000", 2024-04-19T03:03:20.832 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:20.832 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.832 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.832 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:20.832 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125924+0000", 2024-04-19T03:03:20.832 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:20.832 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.833 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.833 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:20.833 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125924+0000", 2024-04-19T03:03:20.833 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:20.833 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.833 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.833 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:20.833 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125927+0000", 2024-04-19T03:03:20.833 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5389999999999999e-06 2024-04-19T03:03:20.833 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.833 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.833 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:20.833 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125935+0000", 2024-04-19T03:03:20.833 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3259999999999998e-06 2024-04-19T03:03:20.834 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.834 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.834 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:20.834 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125940+0000", 2024-04-19T03:03:20.834 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6980000000000003e-06 2024-04-19T03:03:20.834 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.834 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.834 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:20.834 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125982+0000", 2024-04-19T03:03:20.834 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1337000000000001e-05 2024-04-19T03:03:20.834 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.834 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.834 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:20.834 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.126075+0000", 2024-04-19T03:03:20.835 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.3579999999999995e-05 2024-04-19T03:03:20.835 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.835 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.835 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:20.835 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.199953+0000", 2024-04-19T03:03:20.835 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073877604999999999 2024-04-19T03:03:20.835 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.835 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.835 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:03:20.835 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.200022+0000", 2024-04-19T03:03:20.835 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.8824000000000004e-05 2024-04-19T03:03:20.835 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.835 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.835 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:20.836 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.200172+0000", 2024-04-19T03:03:20.836 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015017700000000001 2024-04-19T03:03:20.836 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:20.836 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:20.836 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:20.836 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.836 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.836 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:158374 5.e 5:76be57a5:::benchmark_data_smithi096_19531_object44924:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-19T03:03:20.836 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:58.125988+0000", 2024-04-19T03:03:20.836 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 22.610079187, 2024-04-19T03:03:20.836 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.067843332000000006, 2024-04-19T03:03:20.836 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:20.836 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:20.836 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:20.836 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:20.837 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:20.837 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 158374 2024-04-19T03:03:20.837 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.837 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:20.837 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.837 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:20.837 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125988+0000", 2024-04-19T03:03:20.837 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:20.837 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.837 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.837 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:20.837 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125988+0000", 2024-04-19T03:03:20.837 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:20.837 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.838 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.838 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:20.838 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125987+0000", 2024-04-19T03:03:20.838 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:20.838 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.838 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.838 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:20.838 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125990+0000", 2024-04-19T03:03:20.838 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7989999999999998e-06 2024-04-19T03:03:20.838 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.838 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.838 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:20.838 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125996+0000", 2024-04-19T03:03:20.838 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.302e-06 2024-04-19T03:03:20.838 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.839 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.839 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:20.839 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.126001+0000", 2024-04-19T03:03:20.839 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.843e-06 2024-04-19T03:03:20.839 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.839 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.839 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:20.839 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.126047+0000", 2024-04-19T03:03:20.839 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6066000000000002e-05 2024-04-19T03:03:20.839 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.839 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.839 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:20.839 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.126171+0000", 2024-04-19T03:03:20.839 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012359099999999999 2024-04-19T03:03:20.840 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.840 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.840 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:20.840 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.193709+0000", 2024-04-19T03:03:20.840 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.067538099000000004 2024-04-19T03:03:20.840 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.840 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.840 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:03:20.840 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.193766+0000", 2024-04-19T03:03:20.840 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6869e-05 2024-04-19T03:03:20.840 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.840 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.840 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:20.840 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.193831+0000", 2024-04-19T03:03:20.840 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5273999999999999e-05 2024-04-19T03:03:20.841 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:20.841 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:20.841 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:20.841 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.841 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.841 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4755.0:158376 5.9 e56/22 5:9e73c076:::benchmark_data_smithi096_19531_object44926:head v 56'9663, mlcod=56'9661)", 2024-04-19T03:03:20.841 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:58.127307+0000", 2024-04-19T03:03:20.841 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 22.608759956, 2024-04-19T03:03:20.841 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069002716000000006, 2024-04-19T03:03:20.841 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:20.841 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:20.841 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:20.841 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.841 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:20.842 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.127307+0000", 2024-04-19T03:03:20.842 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:20.842 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.842 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.842 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:20.842 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.127307+0000", 2024-04-19T03:03:20.842 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:20.842 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.842 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.842 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:20.842 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.127306+0000", 2024-04-19T03:03:20.842 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:03:20.842 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.842 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.843 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:20.843 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.127316+0000", 2024-04-19T03:03:20.843 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.3039999999999994e-06 2024-04-19T03:03:20.843 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.843 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.843 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:20.843 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.127326+0000", 2024-04-19T03:03:20.843 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0009e-05 2024-04-19T03:03:20.843 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.843 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.843 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:20.843 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.127332+0000", 2024-04-19T03:03:20.843 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5880000000000003e-06 2024-04-19T03:03:20.843 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.843 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.844 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:20.844 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.127383+0000", 2024-04-19T03:03:20.844 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0516000000000002e-05 2024-04-19T03:03:20.844 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.844 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.844 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:20.844 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.127403+0000", 2024-04-19T03:03:20.844 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0547000000000002e-05 2024-04-19T03:03:20.844 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.844 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.844 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:03:20.844 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.196280+0000", 2024-04-19T03:03:20.844 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.068876863999999996 2024-04-19T03:03:20.844 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.844 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.845 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:20.845 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.196310+0000", 2024-04-19T03:03:20.845 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9762999999999999e-05 2024-04-19T03:03:20.845 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:20.845 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:20.845 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:20.845 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.845 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.845 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:158383 5.0 5:026717eb:::benchmark_data_smithi096_19531_object44933:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-19T03:03:20.845 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:58.130494+0000", 2024-04-19T03:03:20.845 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 22.60557283, 2024-04-19T03:03:20.845 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.070135775999999997, 2024-04-19T03:03:20.845 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:20.846 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:20.846 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:20.846 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:20.846 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:20.846 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 158383 2024-04-19T03:03:20.846 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.846 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:20.846 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.846 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:20.846 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.130494+0000", 2024-04-19T03:03:20.846 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:20.846 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.847 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.847 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:20.847 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.130494+0000", 2024-04-19T03:03:20.847 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:20.847 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.847 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.847 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:20.847 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.130493+0000", 2024-04-19T03:03:20.847 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:03:20.847 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.847 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.847 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:20.847 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.130500+0000", 2024-04-19T03:03:20.847 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5490000000000003e-06 2024-04-19T03:03:20.847 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.848 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.848 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:20.848 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.190401+0000", 2024-04-19T03:03:20.848 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.059901668999999998 2024-04-19T03:03:20.848 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.848 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.848 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:20.848 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.190421+0000", 2024-04-19T03:03:20.848 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0288e-05 2024-04-19T03:03:20.848 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.848 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.848 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:20.848 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.190536+0000", 2024-04-19T03:03:20.848 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000114783 2024-04-19T03:03:20.849 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.849 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.849 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:20.849 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.190904+0000", 2024-04-19T03:03:20.849 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00036773900000000001 2024-04-19T03:03:20.849 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.849 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.849 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:20.849 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.200417+0000", 2024-04-19T03:03:20.849 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0095128899999999995 2024-04-19T03:03:20.849 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.849 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.849 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:03:20.849 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.200489+0000", 2024-04-19T03:03:20.850 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2554999999999999e-05 2024-04-19T03:03:20.850 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:20.850 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:20.850 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:20.850 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.200630+0000", 2024-04-19T03:03:20.850 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014055299999999999 2024-04-19T03:03:20.850 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:20.850 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:20.850 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:20.850 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:20.850 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:20.850 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-19T03:03:20.852 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T03:03:20.853 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:03:20.848+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:03:20.952 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:03:20.950+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:03:20.983 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-04-19T03:03:20.983 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [ 2024-04-19T03:03:20.983 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.983 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:213667 5.1 5.24a5b281 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-19T03:03:20.983 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:03:20.978623+0000", 2024-04-19T03:03:20.984 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0029401610000000002, 2024-04-19T03:03:20.984 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0029555699999999998, 2024-04-19T03:03:20.984 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:20.984 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-04-19T03:03:20.984 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:20.984 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:20.985 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:20.985 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 213667 2024-04-19T03:03:20.985 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.985 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:20.985 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.985 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:20.986 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:20.978623+0000", 2024-04-19T03:03:20.986 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:20.986 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.986 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.986 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:20.986 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:20.978623+0000", 2024-04-19T03:03:20.987 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:20.987 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.987 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.987 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:20.987 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:20.978622+0000", 2024-04-19T03:03:20.988 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:03:20.988 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.988 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.988 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:20.988 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:20.978627+0000", 2024-04-19T03:03:20.988 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8680000000000004e-06 2024-04-19T03:03:20.989 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.989 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.989 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:20.989 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:20.978641+0000", 2024-04-19T03:03:20.989 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3611999999999999e-05 2024-04-19T03:03:20.989 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.990 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.990 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:20.990 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:20.978649+0000", 2024-04-19T03:03:20.990 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6090000000000003e-06 2024-04-19T03:03:20.990 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:20.990 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:20.991 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:20.991 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.991 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.991 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:213669 5.2 5:4c67de4a:::benchmark_data_smithi096_19531_object100219:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-19T03:03:20.991 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:03:20.979420+0000", 2024-04-19T03:03:20.991 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0021428319999999999, 2024-04-19T03:03:20.992 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0021949090000000001, 2024-04-19T03:03:20.992 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:20.992 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-04-19T03:03:20.992 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:20.992 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:20.993 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:20.993 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 213669 2024-04-19T03:03:20.993 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.993 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:20.993 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.993 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:20.993 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:20.979420+0000", 2024-04-19T03:03:20.993 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:20.993 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.993 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.994 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:20.994 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:20.979420+0000", 2024-04-19T03:03:20.994 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:20.994 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.994 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.994 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:20.994 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:20.979419+0000", 2024-04-19T03:03:20.994 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:03:20.994 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.994 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.994 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:20.994 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:20.979424+0000", 2024-04-19T03:03:20.994 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8359999999999999e-06 2024-04-19T03:03:20.995 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.995 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.995 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:20.995 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:20.979439+0000", 2024-04-19T03:03:20.995 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.5101e-05 2024-04-19T03:03:20.995 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.995 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.995 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:20.995 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:20.979446+0000", 2024-04-19T03:03:20.995 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.9929999999999998e-06 2024-04-19T03:03:20.995 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.995 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.995 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:20.995 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:20.979501+0000", 2024-04-19T03:03:20.996 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4805000000000001e-05 2024-04-19T03:03:20.996 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.996 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.996 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:20.996 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:20.979623+0000", 2024-04-19T03:03:20.996 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00012211899999999999 2024-04-19T03:03:20.996 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:20.996 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:20.996 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:20.996 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.996 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.996 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:213671 5.6 5:69ce1da4:::benchmark_data_smithi096_19531_object100221:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-19T03:03:20.996 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:03:20.979722+0000", 2024-04-19T03:03:20.996 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0018402920000000001, 2024-04-19T03:03:20.997 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001927184, 2024-04-19T03:03:20.997 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:20.997 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-04-19T03:03:20.997 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:20.997 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:20.997 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:20.997 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 213671 2024-04-19T03:03:20.997 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.997 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:20.997 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.997 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:20.997 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:20.979722+0000", 2024-04-19T03:03:20.997 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:20.997 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.998 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.998 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:20.998 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:20.979722+0000", 2024-04-19T03:03:20.998 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:20.998 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.998 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.998 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:20.998 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:20.979722+0000", 2024-04-19T03:03:20.998 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:03:20.998 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.998 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.998 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:20.998 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:20.979727+0000", 2024-04-19T03:03:20.999 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0000000000000004e-06 2024-04-19T03:03:20.999 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.999 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.999 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:20.999 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:20.979736+0000", 2024-04-19T03:03:20.999 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.6500000000000008e-06 2024-04-19T03:03:20.999 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.999 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.999 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:20.999 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:20.979743+0000", 2024-04-19T03:03:20.999 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4389999999999997e-06 2024-04-19T03:03:20.999 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:20.999 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:20.999 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:21.000 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:20.981328+0000", 2024-04-19T03:03:21.000 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0015849149999999999 2024-04-19T03:03:21.000 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.000 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.000 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:21.000 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:20.981415+0000", 2024-04-19T03:03:21.000 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.7699000000000002e-05 2024-04-19T03:03:21.000 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:21.000 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:21.000 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:21.000 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.000 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.000 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:213672 5.3 5:c0a66b8b:::benchmark_data_smithi096_19531_object100222:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-19T03:03:21.000 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:03:20.980770+0000", 2024-04-19T03:03:21.000 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.00079288700000000004, 2024-04-19T03:03:21.001 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00091326099999999996, 2024-04-19T03:03:21.001 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:21.001 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-04-19T03:03:21.001 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:21.001 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:21.001 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:21.001 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 213672 2024-04-19T03:03:21.001 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.001 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:21.001 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.001 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:21.001 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:20.980770+0000", 2024-04-19T03:03:21.001 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:21.001 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.002 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.002 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:21.002 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:20.980770+0000", 2024-04-19T03:03:21.002 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:21.002 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.002 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.002 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:21.002 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:20.980769+0000", 2024-04-19T03:03:21.002 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:03:21.002 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.002 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.002 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:21.002 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:20.980774+0000", 2024-04-19T03:03:21.002 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7670000000000003e-06 2024-04-19T03:03:21.003 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.003 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.003 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:21.003 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:20.980786+0000", 2024-04-19T03:03:21.003 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2697000000000001e-05 2024-04-19T03:03:21.003 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.003 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.003 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:21.003 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:20.980793+0000", 2024-04-19T03:03:21.003 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2929999999999997e-06 2024-04-19T03:03:21.003 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.003 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.003 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:21.004 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:20.980829+0000", 2024-04-19T03:03:21.004 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6291000000000002e-05 2024-04-19T03:03:21.004 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.004 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.004 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:21.004 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:20.980948+0000", 2024-04-19T03:03:21.004 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000119072 2024-04-19T03:03:21.004 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:21.004 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:21.004 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:21.004 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.004 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.004 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:213673 5.3 5.4871d333 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-19T03:03:21.004 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:03:20.980804+0000", 2024-04-19T03:03:21.004 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.00075913100000000002, 2024-04-19T03:03:21.005 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000912238, 2024-04-19T03:03:21.005 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:21.005 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "queued for pg", 2024-04-19T03:03:21.005 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:21.005 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:21.005 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:21.005 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 213673 2024-04-19T03:03:21.005 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.005 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:21.005 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.005 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:21.005 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:20.980804+0000", 2024-04-19T03:03:21.005 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:21.005 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.006 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.006 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:21.006 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:20.980804+0000", 2024-04-19T03:03:21.006 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:21.006 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.006 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.006 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:21.006 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:20.980803+0000", 2024-04-19T03:03:21.006 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:21.006 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.006 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.006 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:21.006 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:20.980806+0000", 2024-04-19T03:03:21.007 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7549999999999999e-06 2024-04-19T03:03:21.007 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.007 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.007 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:21.007 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:20.980813+0000", 2024-04-19T03:03:21.007 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.9399999999999996e-06 2024-04-19T03:03:21.007 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.007 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.007 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:21.007 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:20.980818+0000", 2024-04-19T03:03:21.007 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.78e-06 2024-04-19T03:03:21.007 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:21.007 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:21.007 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:21.007 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.008 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.008 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:213658 5.3 5:cc49c416:::benchmark_data_smithi096_19531_object100208:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-19T03:03:21.008 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:03:20.975871+0000", 2024-04-19T03:03:21.008 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0056922099999999996, 2024-04-19T03:03:21.008 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0058737570000000003, 2024-04-19T03:03:21.008 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:21.008 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-04-19T03:03:21.008 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:21.008 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:21.008 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:21.008 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 213658 2024-04-19T03:03:21.008 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.008 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:21.008 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.009 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:21.009 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:20.975871+0000", 2024-04-19T03:03:21.009 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:21.009 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.009 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.009 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:21.009 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:20.975871+0000", 2024-04-19T03:03:21.009 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:21.009 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.009 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.009 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:21.009 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:20.975870+0000", 2024-04-19T03:03:21.009 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:21.009 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.010 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.010 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:21.010 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:20.975875+0000", 2024-04-19T03:03:21.010 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9309999999999999e-06 2024-04-19T03:03:21.010 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.010 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.010 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:21.010 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:20.975882+0000", 2024-04-19T03:03:21.010 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5660000000000001e-06 2024-04-19T03:03:21.010 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.010 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.010 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:21.010 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:20.975888+0000", 2024-04-19T03:03:21.010 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.186e-06 2024-04-19T03:03:21.011 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.011 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.011 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:21.011 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:20.975936+0000", 2024-04-19T03:03:21.011 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7966999999999997e-05 2024-04-19T03:03:21.011 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.011 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.011 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:21.011 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:20.976060+0000", 2024-04-19T03:03:21.011 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000124657 2024-04-19T03:03:21.011 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:21.011 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:21.011 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:21.011 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.012 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.012 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:213660 5.1 5:8583a033:::benchmark_data_smithi096_19531_object100210:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-19T03:03:21.012 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:03:20.977742+0000", 2024-04-19T03:03:21.012 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0038208489999999999, 2024-04-19T03:03:21.012 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0040353819999999997, 2024-04-19T03:03:21.012 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:21.012 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-04-19T03:03:21.012 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:21.012 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:21.012 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:21.012 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 213660 2024-04-19T03:03:21.012 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.012 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:21.012 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.013 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:21.013 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:20.977742+0000", 2024-04-19T03:03:21.013 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:21.013 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.013 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.013 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:21.013 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:20.977742+0000", 2024-04-19T03:03:21.013 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:21.013 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.013 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.013 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:21.013 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:20.977741+0000", 2024-04-19T03:03:21.013 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:03:21.013 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.013 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.014 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:21.014 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:20.977746+0000", 2024-04-19T03:03:21.014 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1359999999999996e-06 2024-04-19T03:03:21.014 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.014 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.014 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:21.014 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:20.977761+0000", 2024-04-19T03:03:21.014 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4367e-05 2024-04-19T03:03:21.014 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.014 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.014 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:21.014 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:20.977766+0000", 2024-04-19T03:03:21.014 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.091e-06 2024-04-19T03:03:21.014 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.015 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.015 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:21.015 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:20.977816+0000", 2024-04-19T03:03:21.015 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0587999999999997e-05 2024-04-19T03:03:21.015 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.015 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.015 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:21.015 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:20.977971+0000", 2024-04-19T03:03:21.015 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000154897 2024-04-19T03:03:21.015 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:21.015 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:21.015 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:21.015 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.015 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.016 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:213662 5.6 5:67bc6ee6:::benchmark_data_smithi096_19531_object100212:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-19T03:03:21.016 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:03:20.977774+0000", 2024-04-19T03:03:21.016 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0037883859999999999, 2024-04-19T03:03:21.016 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0040378690000000004, 2024-04-19T03:03:21.016 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:21.016 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-04-19T03:03:21.016 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:21.016 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:21.016 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:21.016 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 213662 2024-04-19T03:03:21.016 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.016 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:21.016 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.016 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:21.017 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:20.977774+0000", 2024-04-19T03:03:21.017 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:21.017 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.017 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.017 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:21.017 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:20.977774+0000", 2024-04-19T03:03:21.017 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:21.017 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.017 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.017 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:21.017 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:20.977774+0000", 2024-04-19T03:03:21.017 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:21.017 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.017 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.018 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:21.018 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:20.977777+0000", 2024-04-19T03:03:21.018 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4520000000000002e-06 2024-04-19T03:03:21.018 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.018 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.018 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:21.018 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:20.977793+0000", 2024-04-19T03:03:21.018 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6095000000000001e-05 2024-04-19T03:03:21.018 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.018 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.018 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:21.018 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:20.977797+0000", 2024-04-19T03:03:21.018 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5260000000000002e-06 2024-04-19T03:03:21.018 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.019 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.019 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:21.019 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:20.977855+0000", 2024-04-19T03:03:21.019 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7642999999999997e-05 2024-04-19T03:03:21.019 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.019 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.019 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:21.019 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:20.977936+0000", 2024-04-19T03:03:21.019 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.1485999999999999e-05 2024-04-19T03:03:21.019 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:21.019 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:21.019 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:21.019 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.019 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.020 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:213663 5.f 5:fd79dcd8:::benchmark_data_smithi096_19531_object100213:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-19T03:03:21.020 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:03:20.977915+0000", 2024-04-19T03:03:21.020 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0036477390000000001, 2024-04-19T03:03:21.020 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0039321360000000001, 2024-04-19T03:03:21.020 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:21.020 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:03:21.020 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:21.020 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:21.020 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:21.020 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 213663 2024-04-19T03:03:21.020 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.020 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:21.020 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.020 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:21.020 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:20.977915+0000", 2024-04-19T03:03:21.021 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:21.021 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.021 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.021 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:21.021 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:20.977915+0000", 2024-04-19T03:03:21.021 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:21.021 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.021 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.021 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:21.021 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:20.977914+0000", 2024-04-19T03:03:21.021 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999986 2024-04-19T03:03:21.021 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.021 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.021 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:21.022 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:20.977920+0000", 2024-04-19T03:03:21.022 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6390000000000003e-06 2024-04-19T03:03:21.022 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.022 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.022 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:21.022 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:20.977930+0000", 2024-04-19T03:03:21.022 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0051000000000001e-05 2024-04-19T03:03:21.022 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.022 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.022 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:21.022 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:20.977938+0000", 2024-04-19T03:03:21.022 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.3170000000000004e-06 2024-04-19T03:03:21.022 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.022 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.023 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:21.023 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:20.977983+0000", 2024-04-19T03:03:21.023 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5028000000000003e-05 2024-04-19T03:03:21.023 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.023 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.023 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:21.023 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:20.978110+0000", 2024-04-19T03:03:21.023 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000127121 2024-04-19T03:03:21.023 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.023 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.023 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:03:21.023 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:20.978220+0000", 2024-04-19T03:03:21.023 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00011062500000000001 2024-04-19T03:03:21.023 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.024 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.024 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:21.024 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:20.981006+0000", 2024-04-19T03:03:21.024 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0027853999999999999 2024-04-19T03:03:21.024 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:21.024 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:21.024 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:21.024 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.024 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.024 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:213664 5.7 5:eddbdf55:::benchmark_data_smithi096_19531_object100214:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-19T03:03:21.024 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:03:20.977953+0000", 2024-04-19T03:03:21.024 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0036101760000000001, 2024-04-19T03:03:21.024 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.003933415, 2024-04-19T03:03:21.024 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:21.025 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-04-19T03:03:21.025 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:21.025 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:21.025 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:21.025 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 213664 2024-04-19T03:03:21.025 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.025 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:21.025 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.025 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:21.025 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:20.977953+0000", 2024-04-19T03:03:21.025 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:21.025 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.025 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.025 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:21.026 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:20.977953+0000", 2024-04-19T03:03:21.026 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:21.026 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.026 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.026 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:21.026 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:20.977952+0000", 2024-04-19T03:03:21.026 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:21.026 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.026 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.026 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:21.026 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:20.977956+0000", 2024-04-19T03:03:21.026 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4000000000000001e-06 2024-04-19T03:03:21.026 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.026 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.027 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:21.027 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:20.977964+0000", 2024-04-19T03:03:21.027 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.1489999999999994e-06 2024-04-19T03:03:21.027 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.027 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.027 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:21.027 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:20.977969+0000", 2024-04-19T03:03:21.027 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.3000000000000001e-06 2024-04-19T03:03:21.027 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.027 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.027 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:21.027 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:20.977998+0000", 2024-04-19T03:03:21.027 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.8583999999999999e-05 2024-04-19T03:03:21.027 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.027 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.028 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:21.028 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:20.978114+0000", 2024-04-19T03:03:21.028 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000116742 2024-04-19T03:03:21.028 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:21.028 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:21.028 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:21.028 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.028 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.028 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:213665 5.3 5:c950e051:::benchmark_data_smithi096_19531_object100215:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-19T03:03:21.028 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:03:20.978041+0000", 2024-04-19T03:03:21.028 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0035215569999999998, 2024-04-19T03:03:21.028 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0038774119999999998, 2024-04-19T03:03:21.028 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:21.028 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-04-19T03:03:21.029 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:21.029 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:21.029 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:21.029 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 213665 2024-04-19T03:03:21.029 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.029 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:21.029 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.029 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:21.029 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:20.978041+0000", 2024-04-19T03:03:21.029 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:21.029 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.029 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.029 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:21.029 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:20.978041+0000", 2024-04-19T03:03:21.030 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:21.030 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.030 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.030 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:21.030 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:20.978032+0000", 2024-04-19T03:03:21.030 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999905 2024-04-19T03:03:21.030 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.030 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.030 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:21.030 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:20.978045+0000", 2024-04-19T03:03:21.030 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3356999999999999e-05 2024-04-19T03:03:21.030 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.030 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.030 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:21.031 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:20.978053+0000", 2024-04-19T03:03:21.031 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.1270000000000003e-06 2024-04-19T03:03:21.031 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.031 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.031 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:21.031 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:20.978059+0000", 2024-04-19T03:03:21.031 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9209999999999997e-06 2024-04-19T03:03:21.031 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.031 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.031 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:21.031 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:20.978116+0000", 2024-04-19T03:03:21.031 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6671e-05 2024-04-19T03:03:21.031 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.031 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.032 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:21.032 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:20.978246+0000", 2024-04-19T03:03:21.032 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00013065799999999999 2024-04-19T03:03:21.032 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:21.032 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:21.032 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:21.032 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.032 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.032 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:213666 5.c 5:32bcae1a:::benchmark_data_smithi096_19531_object100216:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-19T03:03:21.032 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:03:20.978100+0000", 2024-04-19T03:03:21.032 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.003463205, 2024-04-19T03:03:21.032 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0038513330000000002, 2024-04-19T03:03:21.032 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:21.032 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-04-19T03:03:21.032 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:21.033 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:21.033 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:21.033 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 213666 2024-04-19T03:03:21.033 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.033 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:21.033 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.033 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:21.033 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:20.978100+0000", 2024-04-19T03:03:21.033 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:21.033 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.033 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.033 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:21.033 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:20.978100+0000", 2024-04-19T03:03:21.033 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:21.034 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.034 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.034 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:21.034 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:20.978099+0000", 2024-04-19T03:03:21.034 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:21.034 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.034 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.034 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:21.034 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:20.978103+0000", 2024-04-19T03:03:21.034 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7809999999999999e-06 2024-04-19T03:03:21.034 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.034 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.034 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:21.034 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:20.978111+0000", 2024-04-19T03:03:21.035 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0360000000000006e-06 2024-04-19T03:03:21.035 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.035 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.035 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:21.035 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:20.978116+0000", 2024-04-19T03:03:21.035 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7239999999999997e-06 2024-04-19T03:03:21.035 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.035 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.035 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:21.035 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:20.978163+0000", 2024-04-19T03:03:21.035 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6629999999999999e-05 2024-04-19T03:03:21.035 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.035 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.035 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:21.035 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:20.978276+0000", 2024-04-19T03:03:21.036 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000112553 2024-04-19T03:03:21.036 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:21.036 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:21.036 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:21.036 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:21.036 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-04-19T03:03:21.036 INFO:teuthology.orchestra.run.smithi144.stdout: "num_ops": 12 2024-04-19T03:03:21.036 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-04-19T03:03:21.037 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T03:03:21.054 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:03:21.048+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:03:21.155 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:03:21.152+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:03:21.168 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-04-19T03:03:21.168 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2024-04-19T03:03:21.168 INFO:teuthology.orchestra.run.smithi144.stdout: "complaint_time": 30, 2024-04-19T03:03:21.169 INFO:teuthology.orchestra.run.smithi144.stdout: "num_blocked_ops": 0 2024-04-19T03:03:21.169 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-04-19T03:03:21.180 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T03:03:21.256 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:03:21.254+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:03:21.344 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-04-19T03:03:21.344 INFO:teuthology.orchestra.run.smithi144.stdout: "size": 20, 2024-04-19T03:03:21.344 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 600, 2024-04-19T03:03:21.344 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [ 2024-04-19T03:03:21.344 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.345 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:78992 5.7 5:e6baa862:::benchmark_data_smithi096_19531_object78991:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-19T03:03:21.345 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:18.008888+0000", 2024-04-19T03:03:21.345 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 63.333133463000003, 2024-04-19T03:03:21.345 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.056375285999999997, 2024-04-19T03:03:21.345 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:21.345 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:21.345 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:21.345 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:21.345 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:21.345 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 78992 2024-04-19T03:03:21.345 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.345 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:21.345 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.346 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:21.346 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.008888+0000", 2024-04-19T03:03:21.346 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:21.346 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.346 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.346 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:21.346 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.008888+0000", 2024-04-19T03:03:21.346 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:21.346 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.346 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.346 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:21.346 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.008888+0000", 2024-04-19T03:03:21.347 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:21.347 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.347 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.347 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:21.347 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.008928+0000", 2024-04-19T03:03:21.347 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0361999999999997e-05 2024-04-19T03:03:21.347 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.347 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.347 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:21.347 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.008942+0000", 2024-04-19T03:03:21.348 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4365000000000001e-05 2024-04-19T03:03:21.348 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.348 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.348 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:21.348 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.008949+0000", 2024-04-19T03:03:21.348 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.212e-06 2024-04-19T03:03:21.348 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.348 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.348 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:21.348 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.012683+0000", 2024-04-19T03:03:21.348 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.003733934 2024-04-19T03:03:21.348 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.348 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.348 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:21.349 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.012798+0000", 2024-04-19T03:03:21.349 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00011574999999999999 2024-04-19T03:03:21.349 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.349 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.349 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:21.349 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.012896+0000", 2024-04-19T03:03:21.349 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.7848000000000002e-05 2024-04-19T03:03:21.349 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.349 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.350 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:03:21.350 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016423+0000", 2024-04-19T03:03:21.350 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0035270789999999998 2024-04-19T03:03:21.350 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.350 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.350 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:21.350 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.065098+0000", 2024-04-19T03:03:21.350 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.048674651999999999 2024-04-19T03:03:21.350 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.350 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.351 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:03:21.351 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.065193+0000", 2024-04-19T03:03:21.351 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.5087999999999995e-05 2024-04-19T03:03:21.351 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.351 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.351 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:21.351 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.065264+0000", 2024-04-19T03:03:21.351 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0666000000000004e-05 2024-04-19T03:03:21.351 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:21.351 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:21.351 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:21.351 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.351 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.352 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4755.0:79003 5.2 e40/39 5:4436e33f:::benchmark_data_smithi096_19531_object79002:head v 40'4935, mlcod=40'4932)", 2024-04-19T03:03:21.352 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:18.018102+0000", 2024-04-19T03:03:21.352 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 63.323919406999998, 2024-04-19T03:03:21.352 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.060023990999999999, 2024-04-19T03:03:21.352 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:21.352 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:21.352 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:21.352 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.352 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:21.352 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018102+0000", 2024-04-19T03:03:21.352 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:21.352 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.352 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.353 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:21.353 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018102+0000", 2024-04-19T03:03:21.353 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:21.353 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.353 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.353 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:21.353 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018102+0000", 2024-04-19T03:03:21.353 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:21.353 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.353 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.353 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:21.353 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018134+0000", 2024-04-19T03:03:21.353 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2722000000000003e-05 2024-04-19T03:03:21.354 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.354 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.354 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:21.354 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018145+0000", 2024-04-19T03:03:21.354 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0395e-05 2024-04-19T03:03:21.354 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.354 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.355 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:21.355 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018151+0000", 2024-04-19T03:03:21.355 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5300000000000002e-06 2024-04-19T03:03:21.355 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.355 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.355 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:21.356 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018489+0000", 2024-04-19T03:03:21.356 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00033731499999999998 2024-04-19T03:03:21.356 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.356 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.356 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:21.356 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018508+0000", 2024-04-19T03:03:21.357 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9775e-05 2024-04-19T03:03:21.357 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.357 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.357 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:03:21.357 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.078059+0000", 2024-04-19T03:03:21.357 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.059550171999999998 2024-04-19T03:03:21.358 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.358 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.358 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:21.359 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.078126+0000", 2024-04-19T03:03:21.359 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7773000000000003e-05 2024-04-19T03:03:21.359 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:21.359 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:21.359 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:21.360 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.360 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.360 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:86612 5.7 5:e32e3c49:::benchmark_data_smithi096_19531_object86611:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:21.360 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:22.633560+0000", 2024-04-19T03:03:21.361 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 58.708461747000001, 2024-04-19T03:03:21.361 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.19135289, 2024-04-19T03:03:21.361 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:21.361 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:21.361 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:21.362 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:21.362 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:21.362 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 86612 2024-04-19T03:03:21.362 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.362 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:21.362 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.363 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:21.363 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633560+0000", 2024-04-19T03:03:21.363 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:21.363 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.363 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.363 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:21.364 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633560+0000", 2024-04-19T03:03:21.364 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:21.364 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.364 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.364 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:21.364 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633558+0000", 2024-04-19T03:03:21.365 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999986 2024-04-19T03:03:21.365 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.365 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.365 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:21.365 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633609+0000", 2024-04-19T03:03:21.365 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0850999999999998e-05 2024-04-19T03:03:21.365 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.366 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.366 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:21.366 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633627+0000", 2024-04-19T03:03:21.366 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7951000000000001e-05 2024-04-19T03:03:21.366 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.367 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.367 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:21.368 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633635+0000", 2024-04-19T03:03:21.368 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2530000000000004e-06 2024-04-19T03:03:21.368 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.368 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.368 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:21.369 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633699+0000", 2024-04-19T03:03:21.369 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3901999999999999e-05 2024-04-19T03:03:21.369 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.369 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.370 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:21.370 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633992+0000", 2024-04-19T03:03:21.370 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00029283299999999999 2024-04-19T03:03:21.370 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.370 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.370 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:21.371 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.634223+0000", 2024-04-19T03:03:21.371 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00023084200000000001 2024-04-19T03:03:21.371 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.371 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.371 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:03:21.372 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.639085+0000", 2024-04-19T03:03:21.372 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0048624269999999999 2024-04-19T03:03:21.372 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.372 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.372 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:21.372 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.824635+0000", 2024-04-19T03:03:21.372 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.18554944700000001 2024-04-19T03:03:21.373 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.373 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.373 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:03:21.373 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.824793+0000", 2024-04-19T03:03:21.373 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000157959 2024-04-19T03:03:21.373 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.374 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.374 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:21.374 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.824913+0000", 2024-04-19T03:03:21.374 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000120093 2024-04-19T03:03:21.374 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:21.374 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:21.375 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:21.375 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.375 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.375 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:86625 5.7 5:e6d00488:::benchmark_data_smithi096_19531_object86624:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:21.375 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:22.643554+0000", 2024-04-19T03:03:21.375 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 58.698467981, 2024-04-19T03:03:21.376 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.18732841, 2024-04-19T03:03:21.376 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:21.376 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:21.376 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:21.376 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:21.376 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:21.377 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 86625 2024-04-19T03:03:21.377 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.377 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:21.377 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.377 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:21.377 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643554+0000", 2024-04-19T03:03:21.377 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:21.378 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.378 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.378 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:21.378 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643554+0000", 2024-04-19T03:03:21.378 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:21.378 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.379 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.379 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:21.379 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643552+0000", 2024-04-19T03:03:21.379 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999986 2024-04-19T03:03:21.379 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.379 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.379 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:21.380 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643588+0000", 2024-04-19T03:03:21.380 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5855999999999997e-05 2024-04-19T03:03:21.380 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.380 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.380 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:21.380 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643606+0000", 2024-04-19T03:03:21.381 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8226000000000001e-05 2024-04-19T03:03:21.381 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.381 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.381 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:21.381 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643618+0000", 2024-04-19T03:03:21.381 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1868000000000001e-05 2024-04-19T03:03:21.382 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.382 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.382 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:21.382 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643676+0000", 2024-04-19T03:03:21.382 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8153999999999999e-05 2024-04-19T03:03:21.382 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.382 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.382 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:21.382 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643905+0000", 2024-04-19T03:03:21.382 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00022847500000000001 2024-04-19T03:03:21.382 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.382 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.383 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:21.383 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.644150+0000", 2024-04-19T03:03:21.383 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00024531800000000001 2024-04-19T03:03:21.383 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.383 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.383 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:03:21.383 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.647407+0000", 2024-04-19T03:03:21.383 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0032563190000000001 2024-04-19T03:03:21.383 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.383 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.383 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:21.383 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.830721+0000", 2024-04-19T03:03:21.384 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.18331468300000001 2024-04-19T03:03:21.384 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.384 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.384 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:03:21.384 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.830813+0000", 2024-04-19T03:03:21.384 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.2205000000000002e-05 2024-04-19T03:03:21.384 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.384 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.384 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:21.384 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.830882+0000", 2024-04-19T03:03:21.384 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8819999999999995e-05 2024-04-19T03:03:21.384 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:21.384 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:21.385 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:21.385 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.385 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.385 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87063 5.7 5:e502e824:::benchmark_data_smithi096_19531_object87062:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:21.385 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.136067+0000", 2024-04-19T03:03:21.385 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 58.205955111999998, 2024-04-19T03:03:21.385 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.065521159999999995, 2024-04-19T03:03:21.385 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:21.385 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:21.385 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:21.385 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:21.385 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:21.385 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87063 2024-04-19T03:03:21.385 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.386 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:21.386 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.386 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:21.386 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.136067+0000", 2024-04-19T03:03:21.386 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:21.386 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.386 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.386 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:21.386 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.136067+0000", 2024-04-19T03:03:21.386 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:21.386 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.386 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.386 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:21.387 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.136066+0000", 2024-04-19T03:03:21.387 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:03:21.387 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.387 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.387 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:21.387 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.136154+0000", 2024-04-19T03:03:21.387 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.8256000000000003e-05 2024-04-19T03:03:21.387 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.387 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.387 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:21.387 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.136162+0000", 2024-04-19T03:03:21.387 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.5099999999999998e-06 2024-04-19T03:03:21.387 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.388 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.388 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:21.388 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.136171+0000", 2024-04-19T03:03:21.388 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2830000000000001e-06 2024-04-19T03:03:21.388 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.388 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.388 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:21.388 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.138421+0000", 2024-04-19T03:03:21.388 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0022506620000000001 2024-04-19T03:03:21.388 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.388 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.388 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:21.388 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.138560+0000", 2024-04-19T03:03:21.389 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000138446 2024-04-19T03:03:21.389 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.389 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.389 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:21.389 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.138689+0000", 2024-04-19T03:03:21.389 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00012950700000000001 2024-04-19T03:03:21.389 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.389 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.389 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:03:21.389 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.141517+0000", 2024-04-19T03:03:21.389 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0028280860000000001 2024-04-19T03:03:21.389 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.389 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.389 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:21.389 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.201350+0000", 2024-04-19T03:03:21.390 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.059832418999999998 2024-04-19T03:03:21.390 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.390 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.390 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:03:21.390 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.201485+0000", 2024-04-19T03:03:21.390 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000135597 2024-04-19T03:03:21.390 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.390 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.390 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:21.390 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.201588+0000", 2024-04-19T03:03:21.390 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00010247900000000001 2024-04-19T03:03:21.390 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:21.391 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:21.391 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:21.391 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.391 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.391 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87072 5.7 5:e3c7809a:::benchmark_data_smithi096_19531_object87071:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:21.391 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.144224+0000", 2024-04-19T03:03:21.391 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 58.197798087999999, 2024-04-19T03:03:21.391 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.058179555000000001, 2024-04-19T03:03:21.391 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:21.391 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:21.391 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:21.391 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:21.391 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:21.391 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87072 2024-04-19T03:03:21.392 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.392 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:21.392 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.392 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:21.392 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144224+0000", 2024-04-19T03:03:21.392 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:21.392 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.392 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.392 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:21.392 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144224+0000", 2024-04-19T03:03:21.392 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:21.392 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.392 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.393 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:21.393 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144223+0000", 2024-04-19T03:03:21.393 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:03:21.393 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.393 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.393 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:21.393 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144320+0000", 2024-04-19T03:03:21.393 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.7075000000000001e-05 2024-04-19T03:03:21.393 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.393 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.393 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:21.393 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144331+0000", 2024-04-19T03:03:21.393 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1342000000000001e-05 2024-04-19T03:03:21.393 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.394 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.394 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:21.394 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144337+0000", 2024-04-19T03:03:21.394 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8390000000000003e-06 2024-04-19T03:03:21.394 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.394 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.394 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:21.394 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144369+0000", 2024-04-19T03:03:21.394 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2079000000000002e-05 2024-04-19T03:03:21.394 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.394 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.394 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:21.394 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144464+0000", 2024-04-19T03:03:21.395 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.4623000000000005e-05 2024-04-19T03:03:21.395 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.395 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.395 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:21.395 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144553+0000", 2024-04-19T03:03:21.395 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9171000000000004e-05 2024-04-19T03:03:21.395 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.395 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.396 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:03:21.396 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.147018+0000", 2024-04-19T03:03:21.396 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0024648370000000001 2024-04-19T03:03:21.396 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.396 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.396 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:21.396 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.202270+0000", 2024-04-19T03:03:21.396 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.055252018 2024-04-19T03:03:21.396 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.396 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.396 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:03:21.396 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.202356+0000", 2024-04-19T03:03:21.396 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6648000000000001e-05 2024-04-19T03:03:21.397 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.397 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.397 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:21.397 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.202403+0000", 2024-04-19T03:03:21.397 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6956999999999998e-05 2024-04-19T03:03:21.397 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:21.397 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:21.397 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:21.397 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.397 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.397 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87123 5.6 5:6d1bc3b9:::benchmark_data_smithi096_19531_object87122:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:03:21.397 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249233+0000", 2024-04-19T03:03:21.397 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 58.092789056000001, 2024-04-19T03:03:21.398 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0291700720000001, 2024-04-19T03:03:21.398 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:21.398 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-04-19T03:03:21.398 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:21.398 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:21.398 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:21.398 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87123 2024-04-19T03:03:21.398 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.398 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:21.398 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.398 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:21.398 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249233+0000", 2024-04-19T03:03:21.398 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:21.398 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.399 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.399 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:21.399 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249233+0000", 2024-04-19T03:03:21.399 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:21.399 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.399 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.399 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:21.399 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249231+0000", 2024-04-19T03:03:21.399 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999986 2024-04-19T03:03:21.399 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.399 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.399 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:21.399 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249285+0000", 2024-04-19T03:03:21.400 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4005000000000002e-05 2024-04-19T03:03:21.400 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.400 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.400 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:21.400 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249300+0000", 2024-04-19T03:03:21.400 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4715999999999999e-05 2024-04-19T03:03:21.400 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.400 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.400 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:21.400 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249307+0000", 2024-04-19T03:03:21.400 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8399999999999997e-06 2024-04-19T03:03:21.400 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.400 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.400 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:21.401 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249366+0000", 2024-04-19T03:03:21.401 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9435999999999998e-05 2024-04-19T03:03:21.401 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.401 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.401 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op must wait for map", 2024-04-19T03:03:21.401 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249376+0000", 2024-04-19T03:03:21.401 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.4919999999999999e-06 2024-04-19T03:03:21.401 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.401 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.401 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:21.401 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263757+0000", 2024-04-19T03:03:21.401 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.014381461999999999 2024-04-19T03:03:21.401 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.401 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.402 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:03:21.402 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263875+0000", 2024-04-19T03:03:21.402 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000117166 2024-04-19T03:03:21.402 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.402 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.402 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:21.402 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.277136+0000", 2024-04-19T03:03:21.402 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.013261207 2024-04-19T03:03:21.402 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.402 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.402 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:21.402 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.278403+0000", 2024-04-19T03:03:21.402 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001267106 2024-04-19T03:03:21.403 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:21.403 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:21.403 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:21.403 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.403 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.403 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87128 5.6 5:6905c420:::benchmark_data_smithi096_19531_object87127:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:03:21.403 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249323+0000", 2024-04-19T03:03:21.403 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 58.092698308999999, 2024-04-19T03:03:21.403 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0292813249999999, 2024-04-19T03:03:21.403 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:21.403 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-04-19T03:03:21.403 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:21.403 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:21.404 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:21.404 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87128 2024-04-19T03:03:21.404 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.404 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:21.404 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.404 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:21.404 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249323+0000", 2024-04-19T03:03:21.404 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:21.404 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.404 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.404 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:21.405 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249323+0000", 2024-04-19T03:03:21.405 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:21.405 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.405 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.405 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:21.405 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249323+0000", 2024-04-19T03:03:21.405 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:21.405 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.405 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.405 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:21.405 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249385+0000", 2024-04-19T03:03:21.405 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1711999999999995e-05 2024-04-19T03:03:21.405 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.405 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.406 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:21.406 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249398+0000", 2024-04-19T03:03:21.406 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3022e-05 2024-04-19T03:03:21.406 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.406 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.406 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:21.406 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249402+0000", 2024-04-19T03:03:21.406 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4819999999999996e-06 2024-04-19T03:03:21.406 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.406 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.406 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:21.406 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249437+0000", 2024-04-19T03:03:21.406 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4702000000000001e-05 2024-04-19T03:03:21.407 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.407 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.407 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:03:21.407 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249442+0000", 2024-04-19T03:03:21.407 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8019999999999999e-06 2024-04-19T03:03:21.407 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.407 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.407 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:21.407 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263896+0000", 2024-04-19T03:03:21.407 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.014454679999999999 2024-04-19T03:03:21.407 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.407 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.407 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:03:21.408 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263900+0000", 2024-04-19T03:03:21.408 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9700000000000001e-06 2024-04-19T03:03:21.408 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.408 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.408 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:21.408 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.278557+0000", 2024-04-19T03:03:21.408 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0146566480000001 2024-04-19T03:03:21.408 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.408 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.408 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:21.408 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.278605+0000", 2024-04-19T03:03:21.408 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7735999999999998e-05 2024-04-19T03:03:21.408 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:21.408 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:21.409 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:21.409 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.409 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.409 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87130 5.3 5:c8c2d67b:::benchmark_data_smithi096_19531_object87129:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:03:21.409 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249418+0000", 2024-04-19T03:03:21.409 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 58.092603597999997, 2024-04-19T03:03:21.409 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.025414182, 2024-04-19T03:03:21.409 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:21.409 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-04-19T03:03:21.409 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:21.409 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:21.409 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:21.409 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87130 2024-04-19T03:03:21.409 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.410 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:21.410 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.410 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:21.410 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249418+0000", 2024-04-19T03:03:21.410 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:21.410 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.410 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.410 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:21.410 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249418+0000", 2024-04-19T03:03:21.410 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:21.410 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.410 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.410 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:21.411 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249409+0000", 2024-04-19T03:03:21.411 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999905 2024-04-19T03:03:21.411 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.411 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.411 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:21.411 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249464+0000", 2024-04-19T03:03:21.411 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5381999999999999e-05 2024-04-19T03:03:21.411 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.411 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.411 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:21.411 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249471+0000", 2024-04-19T03:03:21.411 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2609999999999996e-06 2024-04-19T03:03:21.411 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.411 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.412 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:21.412 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249475+0000", 2024-04-19T03:03:21.412 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2839999999999998e-06 2024-04-19T03:03:21.412 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.412 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.412 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:21.412 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249535+0000", 2024-04-19T03:03:21.412 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0545999999999999e-05 2024-04-19T03:03:21.412 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.412 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.412 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op must wait for map", 2024-04-19T03:03:21.412 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249540+0000", 2024-04-19T03:03:21.412 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2859999999999999e-06 2024-04-19T03:03:21.413 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.413 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.413 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:21.413 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263450+0000", 2024-04-19T03:03:21.413 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.013909585 2024-04-19T03:03:21.413 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.413 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.413 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:03:21.413 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263458+0000", 2024-04-19T03:03:21.413 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8089999999999993e-06 2024-04-19T03:03:21.413 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.413 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.413 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:21.413 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.273193+0000", 2024-04-19T03:03:21.414 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0097351379999999 2024-04-19T03:03:21.414 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.414 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.414 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:21.414 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.274832+0000", 2024-04-19T03:03:21.414 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0016394789999999999 2024-04-19T03:03:21.414 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:21.414 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:21.414 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:21.414 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.414 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.414 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87131 5.1 5:83756d55:::benchmark_data_smithi096_19531_object87130:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:03:21.414 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249491+0000", 2024-04-19T03:03:21.415 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 58.092530951000001, 2024-04-19T03:03:21.415 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0191489520000001, 2024-04-19T03:03:21.415 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:21.415 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-04-19T03:03:21.415 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:21.415 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:21.415 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:21.415 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87131 2024-04-19T03:03:21.415 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.415 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:21.415 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.415 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:21.415 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249491+0000", 2024-04-19T03:03:21.415 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:21.416 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.416 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.416 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:21.416 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249491+0000", 2024-04-19T03:03:21.416 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:21.416 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.416 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.416 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:21.416 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249491+0000", 2024-04-19T03:03:21.416 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:21.416 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.416 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.416 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:21.416 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249530+0000", 2024-04-19T03:03:21.417 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9589000000000003e-05 2024-04-19T03:03:21.417 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.417 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.417 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:21.417 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249544+0000", 2024-04-19T03:03:21.417 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4158000000000001e-05 2024-04-19T03:03:21.417 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.417 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.417 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:21.417 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249549+0000", 2024-04-19T03:03:21.417 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6809999999999997e-06 2024-04-19T03:03:21.417 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.417 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.417 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:21.418 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249592+0000", 2024-04-19T03:03:21.418 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3285999999999999e-05 2024-04-19T03:03:21.418 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.418 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.418 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op must wait for map", 2024-04-19T03:03:21.418 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249598+0000", 2024-04-19T03:03:21.418 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8329999999999999e-06 2024-04-19T03:03:21.418 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.418 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.418 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:21.418 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263331+0000", 2024-04-19T03:03:21.418 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.013733093 2024-04-19T03:03:21.419 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.419 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.419 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:03:21.419 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263343+0000", 2024-04-19T03:03:21.419 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.189e-05 2024-04-19T03:03:21.419 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.419 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.419 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:21.419 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.268541+0000", 2024-04-19T03:03:21.419 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0051983440000001 2024-04-19T03:03:21.419 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.419 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.419 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:21.419 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.268640+0000", 2024-04-19T03:03:21.420 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.8387999999999994e-05 2024-04-19T03:03:21.420 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:21.420 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:21.420 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:21.420 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.420 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.420 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87132 5.c 5:3e18b732:::benchmark_data_smithi096_19531_object87131:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:03:21.420 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249558+0000", 2024-04-19T03:03:21.420 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 58.092464049999997, 2024-04-19T03:03:21.420 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0241198380000001, 2024-04-19T03:03:21.420 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:21.420 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-04-19T03:03:21.420 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:21.420 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:21.421 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:21.421 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87132 2024-04-19T03:03:21.421 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.421 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:21.421 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.421 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:21.421 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249558+0000", 2024-04-19T03:03:21.421 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:21.421 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.421 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.421 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:21.421 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249558+0000", 2024-04-19T03:03:21.421 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:21.422 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.422 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.422 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:21.422 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249557+0000", 2024-04-19T03:03:21.422 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:21.422 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.422 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.422 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:21.422 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249625+0000", 2024-04-19T03:03:21.422 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7200999999999996e-05 2024-04-19T03:03:21.422 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.422 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.422 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:21.422 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249646+0000", 2024-04-19T03:03:21.423 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1053e-05 2024-04-19T03:03:21.423 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.423 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.423 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:21.423 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249650+0000", 2024-04-19T03:03:21.423 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2719999999999999e-06 2024-04-19T03:03:21.423 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.423 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.423 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:21.423 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249686+0000", 2024-04-19T03:03:21.423 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6430000000000002e-05 2024-04-19T03:03:21.423 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.423 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.424 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op must wait for map", 2024-04-19T03:03:21.424 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249690+0000", 2024-04-19T03:03:21.424 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.765e-06 2024-04-19T03:03:21.424 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.424 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.424 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:21.424 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261157+0000", 2024-04-19T03:03:21.424 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011467247999999999 2024-04-19T03:03:21.424 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.424 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.424 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:03:21.424 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261170+0000", 2024-04-19T03:03:21.424 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2833000000000001e-05 2024-04-19T03:03:21.424 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.425 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.425 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:21.425 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.272119+0000", 2024-04-19T03:03:21.425 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.010949313 2024-04-19T03:03:21.425 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.425 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.425 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:21.425 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.273678+0000", 2024-04-19T03:03:21.425 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0015581550000000001 2024-04-19T03:03:21.425 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:21.425 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:21.425 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:21.425 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.425 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.426 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87133 5.c 5:3f772a62:::benchmark_data_smithi096_19531_object87132:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:03:21.426 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249657+0000", 2024-04-19T03:03:21.426 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 58.092364670999999, 2024-04-19T03:03:21.426 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0242819409999999, 2024-04-19T03:03:21.426 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:21.426 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-04-19T03:03:21.426 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:21.426 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:21.426 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:21.426 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87133 2024-04-19T03:03:21.426 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.426 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:21.426 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.427 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:21.427 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249657+0000", 2024-04-19T03:03:21.427 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:21.427 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.427 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.427 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:21.427 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249657+0000", 2024-04-19T03:03:21.427 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:21.427 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.427 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.427 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:21.427 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249657+0000", 2024-04-19T03:03:21.427 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:21.427 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.428 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.428 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:21.428 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249690+0000", 2024-04-19T03:03:21.428 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3343000000000002e-05 2024-04-19T03:03:21.428 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.428 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.428 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:21.428 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249695+0000", 2024-04-19T03:03:21.428 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8600000000000001e-06 2024-04-19T03:03:21.428 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.428 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.428 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:21.428 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249698+0000", 2024-04-19T03:03:21.429 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.1700000000000001e-06 2024-04-19T03:03:21.429 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.429 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.429 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:21.429 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249741+0000", 2024-04-19T03:03:21.429 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2849999999999998e-05 2024-04-19T03:03:21.429 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.429 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.429 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:03:21.429 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249746+0000", 2024-04-19T03:03:21.429 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1019999999999996e-06 2024-04-19T03:03:21.429 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.429 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.429 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:21.430 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261209+0000", 2024-04-19T03:03:21.430 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011462447000000001 2024-04-19T03:03:21.430 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.430 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.430 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:03:21.430 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261216+0000", 2024-04-19T03:03:21.430 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8520000000000004e-06 2024-04-19T03:03:21.430 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.430 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.430 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:21.430 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.273872+0000", 2024-04-19T03:03:21.430 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0126558000000001 2024-04-19T03:03:21.430 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.430 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.431 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:21.431 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.273939+0000", 2024-04-19T03:03:21.431 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6822000000000005e-05 2024-04-19T03:03:21.431 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:21.431 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:21.431 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:21.431 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.431 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.431 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87134 5.5 5:a56c478f:::benchmark_data_smithi096_19531_object87133:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:03:21.431 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249708+0000", 2024-04-19T03:03:21.431 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 58.092313746999999, 2024-04-19T03:03:21.431 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0214677299999999, 2024-04-19T03:03:21.431 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:21.431 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-04-19T03:03:21.432 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:21.432 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:21.432 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:21.432 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87134 2024-04-19T03:03:21.432 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.432 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:21.432 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.432 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:21.432 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249708+0000", 2024-04-19T03:03:21.432 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:21.432 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.432 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.432 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:21.433 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249708+0000", 2024-04-19T03:03:21.433 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:21.433 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.433 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.433 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:21.433 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249706+0000", 2024-04-19T03:03:21.433 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999976 2024-04-19T03:03:21.433 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.433 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.433 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:21.433 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249740+0000", 2024-04-19T03:03:21.433 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4458000000000001e-05 2024-04-19T03:03:21.433 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.434 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.434 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:21.434 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249745+0000", 2024-04-19T03:03:21.434 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5020000000000003e-06 2024-04-19T03:03:21.434 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.434 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.434 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:21.434 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249748+0000", 2024-04-19T03:03:21.434 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2499999999999998e-06 2024-04-19T03:03:21.434 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.434 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.434 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:21.434 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249778+0000", 2024-04-19T03:03:21.434 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.006e-05 2024-04-19T03:03:21.435 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.435 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.435 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op must wait for map", 2024-04-19T03:03:21.435 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249782+0000", 2024-04-19T03:03:21.435 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2910000000000001e-06 2024-04-19T03:03:21.435 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.435 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.435 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:21.435 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261666+0000", 2024-04-19T03:03:21.435 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011883471 2024-04-19T03:03:21.435 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.435 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.435 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:03:21.435 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261674+0000", 2024-04-19T03:03:21.436 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6479999999999992e-06 2024-04-19T03:03:21.436 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.436 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.436 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:21.436 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.269323+0000", 2024-04-19T03:03:21.436 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.00764867 2024-04-19T03:03:21.436 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.436 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.436 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:21.436 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.271176+0000", 2024-04-19T03:03:21.436 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001852844 2024-04-19T03:03:21.436 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:21.436 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:21.437 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:21.437 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.437 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.437 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87137 5.c 5:30708c68:::benchmark_data_smithi096_19531_object87136:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:03:21.437 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249756+0000", 2024-04-19T03:03:21.437 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 58.092266041000002, 2024-04-19T03:03:21.437 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.033331752, 2024-04-19T03:03:21.437 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:21.437 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:21.437 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:21.437 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:21.437 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:21.437 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87137 2024-04-19T03:03:21.437 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.438 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:21.438 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.438 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:21.438 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249756+0000", 2024-04-19T03:03:21.438 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:21.438 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.438 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.438 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:21.438 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249756+0000", 2024-04-19T03:03:21.438 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:21.438 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.438 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.438 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:21.439 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249755+0000", 2024-04-19T03:03:21.439 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:21.439 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.439 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.439 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:21.439 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249777+0000", 2024-04-19T03:03:21.439 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1420000000000002e-05 2024-04-19T03:03:21.439 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.439 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.439 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:21.439 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249781+0000", 2024-04-19T03:03:21.439 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0609999999999997e-06 2024-04-19T03:03:21.439 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.439 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.440 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:21.440 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249787+0000", 2024-04-19T03:03:21.440 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.02e-06 2024-04-19T03:03:21.440 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.440 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.440 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:21.440 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249818+0000", 2024-04-19T03:03:21.440 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0947e-05 2024-04-19T03:03:21.440 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.440 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.440 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:03:21.440 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249821+0000", 2024-04-19T03:03:21.440 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.117e-06 2024-04-19T03:03:21.440 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.441 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.441 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:21.441 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261243+0000", 2024-04-19T03:03:21.441 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011421875999999999 2024-04-19T03:03:21.441 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.441 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.441 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:03:21.441 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261251+0000", 2024-04-19T03:03:21.441 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6120000000000001e-06 2024-04-19T03:03:21.441 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.441 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.441 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:21.441 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.274050+0000", 2024-04-19T03:03:21.442 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.012799405 2024-04-19T03:03:21.442 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.442 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.442 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:21.442 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.274529+0000", 2024-04-19T03:03:21.442 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00047867100000000001 2024-04-19T03:03:21.442 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.442 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.442 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:03:21.442 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.282972+0000", 2024-04-19T03:03:21.442 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0084436900000000002 2024-04-19T03:03:21.442 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.442 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.442 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:03:21.443 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.283022+0000", 2024-04-19T03:03:21.443 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9339000000000003e-05 2024-04-19T03:03:21.443 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.443 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.443 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:21.443 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.283088+0000", 2024-04-19T03:03:21.443 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5877999999999995e-05 2024-04-19T03:03:21.443 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:21.443 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:21.443 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:21.443 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.443 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.443 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:158376 5.9 5:9e73c076:::benchmark_data_smithi096_19531_object44926:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-19T03:03:21.443 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:58.126227+0000", 2024-04-19T03:03:21.444 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 23.215794308, 2024-04-19T03:03:21.444 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.069738668000000004, 2024-04-19T03:03:21.444 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:21.444 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:21.444 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:21.444 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:21.444 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:21.444 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 158376 2024-04-19T03:03:21.444 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.444 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:21.444 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.444 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:21.444 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.126227+0000", 2024-04-19T03:03:21.444 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:21.445 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.445 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.445 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:21.445 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.126227+0000", 2024-04-19T03:03:21.445 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:21.445 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.445 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.445 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:21.445 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.126226+0000", 2024-04-19T03:03:21.445 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:03:21.445 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.445 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.445 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:21.445 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.126236+0000", 2024-04-19T03:03:21.446 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.4199999999999996e-06 2024-04-19T03:03:21.446 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.446 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.446 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:21.446 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.126243+0000", 2024-04-19T03:03:21.446 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.199e-06 2024-04-19T03:03:21.446 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.446 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.446 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:21.446 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.126248+0000", 2024-04-19T03:03:21.446 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1320000000000002e-06 2024-04-19T03:03:21.446 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.446 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.447 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:21.447 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.126286+0000", 2024-04-19T03:03:21.447 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7401000000000003e-05 2024-04-19T03:03:21.447 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.447 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.447 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:21.447 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.126368+0000", 2024-04-19T03:03:21.447 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2113999999999993e-05 2024-04-19T03:03:21.447 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.447 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.447 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:03:21.447 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.126438+0000", 2024-04-19T03:03:21.447 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0337000000000001e-05 2024-04-19T03:03:21.447 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.448 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.448 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:03:21.448 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.130816+0000", 2024-04-19T03:03:21.448 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0043778330000000002 2024-04-19T03:03:21.448 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.448 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.448 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:21.448 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.195830+0000", 2024-04-19T03:03:21.448 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.065013933999999995 2024-04-19T03:03:21.448 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.448 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.448 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:03:21.448 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.195907+0000", 2024-04-19T03:03:21.448 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7397000000000005e-05 2024-04-19T03:03:21.449 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.449 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.449 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:21.449 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.195966+0000", 2024-04-19T03:03:21.449 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8906999999999997e-05 2024-04-19T03:03:21.449 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:21.449 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:21.449 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:21.449 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.449 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.449 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:158381 5.9 5:94dcd4a7:::benchmark_data_smithi096_19531_object44931:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-19T03:03:21.449 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:58.128712+0000", 2024-04-19T03:03:21.449 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 23.213309864999999, 2024-04-19T03:03:21.450 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.067497527000000002, 2024-04-19T03:03:21.450 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:21.450 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:21.450 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:21.450 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:21.450 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:21.450 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 158381 2024-04-19T03:03:21.450 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.450 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:21.450 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.450 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:21.450 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.128712+0000", 2024-04-19T03:03:21.450 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:21.450 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.451 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.451 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:21.451 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.128712+0000", 2024-04-19T03:03:21.451 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:21.451 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.451 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.451 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:21.451 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.128711+0000", 2024-04-19T03:03:21.451 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:03:21.451 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.451 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.451 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:21.451 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.128716+0000", 2024-04-19T03:03:21.452 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0610000000000003e-06 2024-04-19T03:03:21.452 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.452 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.452 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:21.452 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.128724+0000", 2024-04-19T03:03:21.452 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0120000000000005e-06 2024-04-19T03:03:21.452 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.452 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.452 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:21.452 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.128729+0000", 2024-04-19T03:03:21.452 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8899999999999998e-06 2024-04-19T03:03:21.452 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.452 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.452 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:21.453 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.128778+0000", 2024-04-19T03:03:21.453 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9110000000000002e-05 2024-04-19T03:03:21.453 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.453 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.453 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:21.453 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.128903+0000", 2024-04-19T03:03:21.453 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00012506799999999999 2024-04-19T03:03:21.453 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.453 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.453 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:03:21.453 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.129022+0000", 2024-04-19T03:03:21.453 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00011923599999999999 2024-04-19T03:03:21.453 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.453 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.454 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:03:21.454 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.132294+0000", 2024-04-19T03:03:21.454 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.003271244 2024-04-19T03:03:21.454 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.454 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.454 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:21.454 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.196045+0000", 2024-04-19T03:03:21.454 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.063751206000000005 2024-04-19T03:03:21.454 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.454 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.454 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:03:21.454 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.196133+0000", 2024-04-19T03:03:21.454 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.8213000000000004e-05 2024-04-19T03:03:21.455 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.455 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.455 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:21.455 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.196209+0000", 2024-04-19T03:03:21.455 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6335999999999996e-05 2024-04-19T03:03:21.455 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:21.455 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:21.455 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:21.455 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.455 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.455 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:158385 5.9 5:950ec749:::benchmark_data_smithi096_19531_object44935:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-19T03:03:21.455 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:58.129756+0000", 2024-04-19T03:03:21.455 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 23.212265933000001, 2024-04-19T03:03:21.455 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.068998382999999996, 2024-04-19T03:03:21.456 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:21.456 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:21.456 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:21.456 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:21.456 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:21.456 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 158385 2024-04-19T03:03:21.456 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.456 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:21.456 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.456 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:21.456 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.129756+0000", 2024-04-19T03:03:21.456 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:21.456 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.456 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.457 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:21.457 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.129756+0000", 2024-04-19T03:03:21.457 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:21.457 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.457 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.457 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:21.457 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.129755+0000", 2024-04-19T03:03:21.457 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:03:21.457 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.457 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.457 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:21.457 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.129760+0000", 2024-04-19T03:03:21.457 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6030000000000004e-06 2024-04-19T03:03:21.457 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.458 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.458 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:21.458 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.129774+0000", 2024-04-19T03:03:21.458 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3131e-05 2024-04-19T03:03:21.458 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.458 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.458 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:21.458 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.129781+0000", 2024-04-19T03:03:21.458 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4030000000000001e-06 2024-04-19T03:03:21.458 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.458 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.458 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:21.458 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.130837+0000", 2024-04-19T03:03:21.459 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00105569 2024-04-19T03:03:21.459 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.459 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.459 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:21.459 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.130917+0000", 2024-04-19T03:03:21.459 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9929e-05 2024-04-19T03:03:21.459 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.459 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.459 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:03:21.459 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.130973+0000", 2024-04-19T03:03:21.459 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.664e-05 2024-04-19T03:03:21.459 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.459 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.459 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:03:21.460 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.132340+0000", 2024-04-19T03:03:21.460 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001366321 2024-04-19T03:03:21.460 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.460 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.460 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:21.460 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.198637+0000", 2024-04-19T03:03:21.460 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.066296888999999998 2024-04-19T03:03:21.460 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.460 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.460 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:03:21.460 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.198704+0000", 2024-04-19T03:03:21.460 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7333000000000001e-05 2024-04-19T03:03:21.460 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.461 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.461 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:21.461 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.198754+0000", 2024-04-19T03:03:21.461 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0421999999999999e-05 2024-04-19T03:03:21.461 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:21.461 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:21.461 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:21.461 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.461 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.461 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:158387 5.9 5:9e96f619:::benchmark_data_smithi096_19531_object44937:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-19T03:03:21.461 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:58.132457+0000", 2024-04-19T03:03:21.461 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 23.209564368999999, 2024-04-19T03:03:21.461 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.066858091999999994, 2024-04-19T03:03:21.461 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:21.462 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:21.462 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:21.462 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:21.462 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:21.462 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 158387 2024-04-19T03:03:21.462 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.462 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:21.462 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.462 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:21.462 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.132457+0000", 2024-04-19T03:03:21.462 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:21.462 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.462 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.462 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:21.463 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.132457+0000", 2024-04-19T03:03:21.463 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:21.463 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.463 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.463 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:21.463 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.132457+0000", 2024-04-19T03:03:21.463 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:21.463 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.463 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.463 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:21.463 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.132460+0000", 2024-04-19T03:03:21.463 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.1949999999999999e-06 2024-04-19T03:03:21.463 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.463 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.464 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:21.464 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.132468+0000", 2024-04-19T03:03:21.464 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.1599999999999998e-06 2024-04-19T03:03:21.464 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.464 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.464 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:21.464 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.132473+0000", 2024-04-19T03:03:21.464 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9259999999999999e-06 2024-04-19T03:03:21.464 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.464 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.464 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:21.464 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.132504+0000", 2024-04-19T03:03:21.464 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0914000000000003e-05 2024-04-19T03:03:21.464 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.465 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.465 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:21.465 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.132646+0000", 2024-04-19T03:03:21.465 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00014214300000000001 2024-04-19T03:03:21.465 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.465 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.465 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:03:21.465 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.132741+0000", 2024-04-19T03:03:21.465 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.4344000000000003e-05 2024-04-19T03:03:21.465 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.465 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.465 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:03:21.465 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.135774+0000", 2024-04-19T03:03:21.465 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0030334960000000001 2024-04-19T03:03:21.466 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.466 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.466 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:21.466 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.199240+0000", 2024-04-19T03:03:21.466 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.063465695000000003 2024-04-19T03:03:21.466 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.466 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.466 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:03:21.466 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.199272+0000", 2024-04-19T03:03:21.466 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2412000000000001e-05 2024-04-19T03:03:21.466 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.466 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.466 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:21.467 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.199316+0000", 2024-04-19T03:03:21.467 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3275000000000002e-05 2024-04-19T03:03:21.467 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:21.467 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:21.467 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:21.467 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.467 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.467 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:158392 5.f 5:f462725f:::benchmark_data_smithi096_19531_object44942:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-19T03:03:21.467 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:58.135703+0000", 2024-04-19T03:03:21.467 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 23.206318588999999, 2024-04-19T03:03:21.467 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.063132879000000003, 2024-04-19T03:03:21.467 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:21.467 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:21.467 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:21.468 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:21.468 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:21.468 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 158392 2024-04-19T03:03:21.468 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.468 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:21.468 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.468 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:21.468 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.135703+0000", 2024-04-19T03:03:21.468 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:21.468 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.468 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.468 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:21.468 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.135703+0000", 2024-04-19T03:03:21.469 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:21.469 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.469 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.469 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:21.469 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.135702+0000", 2024-04-19T03:03:21.469 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:03:21.469 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.469 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.469 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:21.469 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.135708+0000", 2024-04-19T03:03:21.469 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8270000000000003e-06 2024-04-19T03:03:21.469 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.469 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.470 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:21.470 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.135720+0000", 2024-04-19T03:03:21.470 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2057e-05 2024-04-19T03:03:21.470 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.470 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.470 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:21.470 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.135727+0000", 2024-04-19T03:03:21.470 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8090000000000004e-06 2024-04-19T03:03:21.470 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.470 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.470 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:21.470 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.135768+0000", 2024-04-19T03:03:21.471 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1548999999999998e-05 2024-04-19T03:03:21.471 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.471 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.471 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:21.471 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.135853+0000", 2024-04-19T03:03:21.471 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4845000000000005e-05 2024-04-19T03:03:21.471 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.471 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.471 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:03:21.471 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.135934+0000", 2024-04-19T03:03:21.471 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0315000000000006e-05 2024-04-19T03:03:21.471 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.471 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.471 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:03:21.472 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.138685+0000", 2024-04-19T03:03:21.472 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.002751042 2024-04-19T03:03:21.472 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.472 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.472 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:21.472 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.198747+0000", 2024-04-19T03:03:21.472 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.060062675000000003 2024-04-19T03:03:21.472 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.472 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.472 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:03:21.472 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.198802+0000", 2024-04-19T03:03:21.472 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4469000000000003e-05 2024-04-19T03:03:21.472 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.472 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.473 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:21.473 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.198836+0000", 2024-04-19T03:03:21.473 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4272e-05 2024-04-19T03:03:21.473 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:21.473 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:21.473 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:21.473 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.473 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.473 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:158397 5.d 5:b5d962e9:::benchmark_data_smithi096_19531_object44947:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-19T03:03:21.473 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:58.138717+0000", 2024-04-19T03:03:21.473 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 23.203304645999999, 2024-04-19T03:03:21.473 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.057191467000000003, 2024-04-19T03:03:21.473 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:21.473 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:21.474 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:21.474 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:21.474 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:21.474 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 158397 2024-04-19T03:03:21.474 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.474 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:21.474 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.474 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:21.474 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.138717+0000", 2024-04-19T03:03:21.474 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:21.474 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.474 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.474 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:21.475 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.138717+0000", 2024-04-19T03:03:21.475 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:21.475 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.475 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.475 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:21.475 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.138716+0000", 2024-04-19T03:03:21.475 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999986 2024-04-19T03:03:21.475 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.475 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.475 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:21.475 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.138722+0000", 2024-04-19T03:03:21.475 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1709999999999999e-06 2024-04-19T03:03:21.475 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.475 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.476 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:21.476 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.138731+0000", 2024-04-19T03:03:21.476 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.0310000000000004e-06 2024-04-19T03:03:21.476 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.476 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.476 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:21.476 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.138738+0000", 2024-04-19T03:03:21.476 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8430000000000004e-06 2024-04-19T03:03:21.476 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.476 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.476 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:21.476 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.138789+0000", 2024-04-19T03:03:21.476 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0623e-05 2024-04-19T03:03:21.476 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.477 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.477 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:21.477 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.138945+0000", 2024-04-19T03:03:21.477 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00015671899999999999 2024-04-19T03:03:21.477 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.477 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.477 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:03:21.477 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.139079+0000", 2024-04-19T03:03:21.477 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00013380099999999999 2024-04-19T03:03:21.477 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.477 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.477 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:03:21.477 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.141715+0000", 2024-04-19T03:03:21.477 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0026362849999999999 2024-04-19T03:03:21.478 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.478 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.478 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:21.478 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.195784+0000", 2024-04-19T03:03:21.478 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.054068353 2024-04-19T03:03:21.478 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.478 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.478 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:03:21.478 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.195852+0000", 2024-04-19T03:03:21.478 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8121999999999996e-05 2024-04-19T03:03:21.478 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:21.478 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:21.478 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:21.479 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.195909+0000", 2024-04-19T03:03:21.479 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6737999999999998e-05 2024-04-19T03:03:21.479 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:21.479 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:21.479 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:21.479 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:21.479 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:21.479 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-04-19T03:03:21.481 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:03:21.476+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:03:21.481 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T03:03:21.493 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-19T03:03:21.581 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:03:21.580+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:03:21.601 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-19T03:03:21.601 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-04-19T03:03:21.601 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:21.601 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:215163 5.0 5:04640a7b:::benchmark_data_smithi096_19531_object101713:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-19T03:03:21.601 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:03:21.595957+0000", 2024-04-19T03:03:21.601 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.005294048, 2024-04-19T03:03:21.601 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0053213360000000003, 2024-04-19T03:03:21.602 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:21.602 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-19T03:03:21.602 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:21.602 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:21.602 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:21.602 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 215163 2024-04-19T03:03:21.602 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:21.602 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:21.602 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:21.602 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:21.602 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:21.595957+0000", 2024-04-19T03:03:21.602 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:21.602 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:21.603 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:21.603 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:21.603 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:21.595957+0000", 2024-04-19T03:03:21.603 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:21.603 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:21.603 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:21.603 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:21.603 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:21.595957+0000", 2024-04-19T03:03:21.603 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:21.603 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:21.603 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:21.603 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:21.603 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:21.595960+0000", 2024-04-19T03:03:21.603 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6320000000000001e-06 2024-04-19T03:03:21.604 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:21.604 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:21.604 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:21.604 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:21.595968+0000", 2024-04-19T03:03:21.604 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2830000000000004e-06 2024-04-19T03:03:21.604 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:21.604 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:21.604 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:21.604 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:21.595973+0000", 2024-04-19T03:03:21.604 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4009999999999996e-06 2024-04-19T03:03:21.604 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:21.604 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:21.605 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:21.605 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:21.596017+0000", 2024-04-19T03:03:21.605 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4186e-05 2024-04-19T03:03:21.605 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:21.605 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:21.605 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:21.607 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:21.596103+0000", 2024-04-19T03:03:21.607 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.5360999999999998e-05 2024-04-19T03:03:21.607 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:21.607 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:21.607 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:21.607 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:21.607 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:21.607 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4755.0:215166 5.f e63/22 5:f7e3b927:::benchmark_data_smithi096_19531_object101716:head v 63'13304, mlcod=63'13301)", 2024-04-19T03:03:21.607 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:03:21.596904+0000", 2024-04-19T03:03:21.607 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.004347114, 2024-04-19T03:03:21.607 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0044640599999999997, 2024-04-19T03:03:21.607 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:21.607 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-19T03:03:21.608 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:21.608 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:21.608 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:21.608 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:21.596904+0000", 2024-04-19T03:03:21.608 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:21.609 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:21.609 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:21.609 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:21.609 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:21.596904+0000", 2024-04-19T03:03:21.609 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:21.609 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:21.610 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:21.610 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:21.610 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:21.596903+0000", 2024-04-19T03:03:21.610 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:03:21.610 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:21.610 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:21.610 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:21.610 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:21.596911+0000", 2024-04-19T03:03:21.610 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2599999999999999e-06 2024-04-19T03:03:21.610 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:21.611 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:21.611 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:21.611 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:21.596926+0000", 2024-04-19T03:03:21.611 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4919000000000001e-05 2024-04-19T03:03:21.611 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:21.611 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:21.611 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:21.611 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:21.596933+0000", 2024-04-19T03:03:21.611 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4510000000000003e-06 2024-04-19T03:03:21.611 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:21.611 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:21.612 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:21.612 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:21.596997+0000", 2024-04-19T03:03:21.612 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4364999999999998e-05 2024-04-19T03:03:21.612 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:21.612 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:21.612 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:21.612 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:21.597029+0000", 2024-04-19T03:03:21.612 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1236999999999999e-05 2024-04-19T03:03:21.612 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:21.612 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:21.612 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:21.612 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:21.612 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:21.613 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:215167 5.8 5:16b252de:::benchmark_data_smithi096_19531_object101717:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-19T03:03:21.613 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:03:21.598220+0000", 2024-04-19T03:03:21.613 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0030310369999999999, 2024-04-19T03:03:21.613 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0032436549999999998, 2024-04-19T03:03:21.613 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:21.613 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-19T03:03:21.614 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:21.614 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:21.614 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:21.614 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 215167 2024-04-19T03:03:21.614 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:21.614 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:21.614 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:21.614 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:21.614 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:21.598220+0000", 2024-04-19T03:03:21.614 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:21.614 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:21.614 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:21.615 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:21.615 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:21.598220+0000", 2024-04-19T03:03:21.615 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:21.615 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:21.615 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:21.615 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:21.615 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:21.598219+0000", 2024-04-19T03:03:21.615 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:03:21.615 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:21.615 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:21.615 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:21.615 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:21.598225+0000", 2024-04-19T03:03:21.615 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9830000000000001e-06 2024-04-19T03:03:21.615 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:21.616 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:21.616 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:21.616 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:21.598236+0000", 2024-04-19T03:03:21.616 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0380999999999999e-05 2024-04-19T03:03:21.616 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:21.616 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:21.616 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:21.616 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:21.598242+0000", 2024-04-19T03:03:21.616 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2859999999999996e-06 2024-04-19T03:03:21.616 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:21.616 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:21.616 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:21.616 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:21.598296+0000", 2024-04-19T03:03:21.616 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3727999999999998e-05 2024-04-19T03:03:21.617 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:21.617 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:21.617 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:21.617 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:21.598435+0000", 2024-04-19T03:03:21.617 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013984199999999999 2024-04-19T03:03:21.617 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:21.617 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:21.617 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:21.617 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:21.617 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:21.617 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:215171 5.0 5:04a4d7e8:::benchmark_data_smithi096_19531_object101721:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-19T03:03:21.617 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:03:21.600481+0000", 2024-04-19T03:03:21.618 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.00077015500000000001, 2024-04-19T03:03:21.618 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0010662969999999999, 2024-04-19T03:03:21.618 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:21.618 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-19T03:03:21.618 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:21.618 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:21.618 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:21.619 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 215171 2024-04-19T03:03:21.619 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:21.619 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:21.619 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:21.619 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:21.619 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:21.600481+0000", 2024-04-19T03:03:21.619 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:21.620 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:21.620 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:21.620 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:21.620 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:21.600481+0000", 2024-04-19T03:03:21.620 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:21.620 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:21.621 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:21.621 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:21.621 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:21.600480+0000", 2024-04-19T03:03:21.621 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:03:21.621 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:21.621 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:21.622 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:21.622 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:21.600486+0000", 2024-04-19T03:03:21.622 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.178e-06 2024-04-19T03:03:21.622 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:21.623 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:21.623 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:21.623 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:21.600501+0000", 2024-04-19T03:03:21.623 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4978e-05 2024-04-19T03:03:21.623 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:21.623 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:21.624 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:21.624 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:21.600509+0000", 2024-04-19T03:03:21.624 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.8150000000000006e-06 2024-04-19T03:03:21.624 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:21.624 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:21.624 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:21.625 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:21.600551+0000", 2024-04-19T03:03:21.625 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2437e-05 2024-04-19T03:03:21.625 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:21.625 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:21.625 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:21.625 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:21.600690+0000", 2024-04-19T03:03:21.625 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000138739 2024-04-19T03:03:21.626 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:21.626 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:21.626 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:21.626 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:21.626 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:21.626 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:215172 5.a 5:5f293c00:::benchmark_data_smithi096_19531_object101722:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-19T03:03:21.627 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:03:21.601031+0000", 2024-04-19T03:03:21.627 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.000220275, 2024-04-19T03:03:21.627 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00059835599999999997, 2024-04-19T03:03:21.628 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:21.628 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-19T03:03:21.628 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:21.628 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:21.628 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:21.628 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 215172 2024-04-19T03:03:21.629 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:21.629 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:21.629 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:21.629 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:21.629 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:21.601031+0000", 2024-04-19T03:03:21.629 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:21.630 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:21.630 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:21.630 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:21.630 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:21.601031+0000", 2024-04-19T03:03:21.630 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:21.630 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:21.631 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:21.631 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:21.631 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:21.601030+0000", 2024-04-19T03:03:21.631 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:03:21.631 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:21.631 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:21.631 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:21.632 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:21.601037+0000", 2024-04-19T03:03:21.632 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.097e-06 2024-04-19T03:03:21.632 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:21.632 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:21.632 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:21.632 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:21.601052+0000", 2024-04-19T03:03:21.632 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5421999999999999e-05 2024-04-19T03:03:21.632 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:21.633 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:21.633 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:21.633 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:21.601075+0000", 2024-04-19T03:03:21.633 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.2401000000000001e-05 2024-04-19T03:03:21.633 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:21.634 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:21.634 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:21.634 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:21.601142+0000", 2024-04-19T03:03:21.634 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7570999999999994e-05 2024-04-19T03:03:21.634 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:21.634 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:21.635 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:21.635 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:21.601398+0000", 2024-04-19T03:03:21.635 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00025564499999999998 2024-04-19T03:03:21.635 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:21.635 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:21.635 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:21.636 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:21.636 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:21.636 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:215175 5.0 5.7e559f70 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e63)", 2024-04-19T03:03:21.636 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:03:21.601286+0000", 2024-04-19T03:03:21.636 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 4294967295.9999657, 2024-04-19T03:03:21.636 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00042141999999999999, 2024-04-19T03:03:21.636 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:21.637 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-04-19T03:03:21.637 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:21.637 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:21.637 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:21.637 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 215175 2024-04-19T03:03:21.637 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:21.638 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:21.638 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:21.638 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:21.638 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:21.601286+0000", 2024-04-19T03:03:21.638 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:21.638 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:21.639 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:21.639 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:21.639 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:21.601286+0000", 2024-04-19T03:03:21.639 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:21.639 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:21.639 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:21.640 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:21.640 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:21.601285+0000", 2024-04-19T03:03:21.640 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:03:21.640 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:21.640 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:21.640 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:21.641 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:21.601290+0000", 2024-04-19T03:03:21.641 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9699999999999998e-06 2024-04-19T03:03:21.641 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:21.641 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:21.641 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:21.641 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:21.601297+0000", 2024-04-19T03:03:21.642 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5700000000000004e-06 2024-04-19T03:03:21.642 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:21.642 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:21.642 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:21.642 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:21.601302+0000", 2024-04-19T03:03:21.642 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1220000000000003e-06 2024-04-19T03:03:21.643 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:21.643 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:21.643 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:21.643 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:21.643 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-04-19T03:03:21.643 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 6 2024-04-19T03:03:21.644 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-19T03:03:21.645 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T03:03:21.655 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1: {} 2024-04-19T03:03:21.666 INFO:teuthology.orchestra.run.smithi096.stderr:nodeep-scrub is unset 2024-04-19T03:03:21.681 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2: {} 2024-04-19T03:03:21.681 INFO:teuthology.orchestra.run.smithi096.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-04-19T03:03:21.682 INFO:teuthology.orchestra.run.smithi096.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-19T03:03:21.682 INFO:teuthology.orchestra.run.smithi096.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-19T03:03:21.687 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-19T03:03:21.688 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-19T03:03:21.688 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:03:21.684+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:03:21.774 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-19T03:03:21.774 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:03:21.785 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T03:03:21.788 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:03:21.784+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:03:21.890 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:03:21.886+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:03:21.911 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-19T03:03:21.911 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:03:21.924 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T03:03:21.991 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:03:21.988+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:03:22.054 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-04-19T03:03:22.055 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:03:22.067 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T03:03:22.094 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:03:22.092+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:03:22.168 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-04-19T03:03:22.168 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:03:22.179 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T03:03:22.195 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:03:22.192+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:03:22.295 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~53s 2024-04-19T03:03:22.295 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:03:22.292+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:03:22.312 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-04-19T03:03:22.312 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:03:22.326 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T03:03:22.397 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:03:22.394+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:03:22.448 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-19T03:03:22.448 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:03:22.464 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T03:03:22.497 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:03:22.494+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:03:22.582 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-19T03:03:22.582 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:03:22.594 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T03:03:22.640 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:03:22.638+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:03:22.699 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:03:22.694+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:03:22.717 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-19T03:03:22.717 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:03:22.730 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T03:03:22.800 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:03:22.798+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:03:22.864 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-04-19T03:03:22.864 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:03:22.878 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T03:03:22.901 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:03:22.898+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:03:23.002 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:03:22.998+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:03:23.004 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-04-19T03:03:23.005 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:03:23.017 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T03:03:23.103 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:03:23.100+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:03:23.147 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-04-19T03:03:23.148 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:03:23.160 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T03:03:23.204 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:03:23.202+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:03:23.282 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-19T03:03:23.282 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:03:23.293 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T03:03:23.305 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:03:23.302+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:03:23.406 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:03:23.402+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:03:23.414 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-19T03:03:23.415 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:03:23.427 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T03:03:23.506 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:03:23.502+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:03:23.590 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-19T03:03:23.590 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:03:23.602 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T03:03:23.607 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:03:23.604+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:03:23.679 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-19T03:03:23.689 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-19T03:03:23.709 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:03:23.704+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:03:23.729 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-04-19T03:03:23.729 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:03:23.742 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T03:03:23.809 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:03:23.808+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:03:23.863 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1: {} 2024-04-19T03:03:23.883 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2: {} 2024-04-19T03:03:23.883 INFO:teuthology.orchestra.run.smithi096.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-04-19T03:03:23.884 INFO:teuthology.orchestra.run.smithi096.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-19T03:03:23.884 INFO:teuthology.orchestra.run.smithi096.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-19T03:03:23.887 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-19T03:03:23.888 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-19T03:03:23.908 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-04-19T03:03:23.909 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2024-04-19T03:03:23.909 INFO:teuthology.orchestra.run.smithi144.stdout: "complaint_time": 30, 2024-04-19T03:03:23.909 INFO:teuthology.orchestra.run.smithi144.stdout: "num_blocked_ops": 0 2024-04-19T03:03:23.909 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-04-19T03:03:23.910 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:03:23.908+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:03:23.920 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T03:03:24.011 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:03:24.006+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:03:24.098 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-04-19T03:03:24.098 INFO:teuthology.orchestra.run.smithi144.stdout: "size": 20, 2024-04-19T03:03:24.098 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 600, 2024-04-19T03:03:24.099 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [ 2024-04-19T03:03:24.099 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.099 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:78992 5.7 5:e6baa862:::benchmark_data_smithi096_19531_object78991:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-19T03:03:24.099 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:18.008888+0000", 2024-04-19T03:03:24.099 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 66.086784250999997, 2024-04-19T03:03:24.099 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.056375285999999997, 2024-04-19T03:03:24.099 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:24.099 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:24.099 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:24.099 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:24.099 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:24.099 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 78992 2024-04-19T03:03:24.099 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.100 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:24.100 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.100 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:24.100 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.008888+0000", 2024-04-19T03:03:24.100 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:24.100 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.100 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.100 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:24.100 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.008888+0000", 2024-04-19T03:03:24.100 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:24.100 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.100 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.100 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:24.100 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.008888+0000", 2024-04-19T03:03:24.101 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:24.101 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.101 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.101 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:24.101 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.008928+0000", 2024-04-19T03:03:24.101 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0361999999999997e-05 2024-04-19T03:03:24.101 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.101 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.101 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:24.101 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.008942+0000", 2024-04-19T03:03:24.101 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4365000000000001e-05 2024-04-19T03:03:24.101 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.101 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.101 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:24.102 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.008949+0000", 2024-04-19T03:03:24.102 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.212e-06 2024-04-19T03:03:24.102 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.102 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.102 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:24.102 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.012683+0000", 2024-04-19T03:03:24.102 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.003733934 2024-04-19T03:03:24.102 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.102 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.102 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:24.102 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.012798+0000", 2024-04-19T03:03:24.102 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00011574999999999999 2024-04-19T03:03:24.102 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.103 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.103 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:24.103 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.012896+0000", 2024-04-19T03:03:24.103 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.7848000000000002e-05 2024-04-19T03:03:24.103 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.103 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.103 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:03:24.103 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016423+0000", 2024-04-19T03:03:24.103 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0035270789999999998 2024-04-19T03:03:24.103 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.103 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.103 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:24.103 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.065098+0000", 2024-04-19T03:03:24.103 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.048674651999999999 2024-04-19T03:03:24.104 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.104 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.104 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:03:24.104 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.065193+0000", 2024-04-19T03:03:24.104 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.5087999999999995e-05 2024-04-19T03:03:24.104 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.104 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.104 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:24.104 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.065264+0000", 2024-04-19T03:03:24.104 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0666000000000004e-05 2024-04-19T03:03:24.104 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:24.104 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:24.104 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:24.104 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.104 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.105 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4755.0:79003 5.2 e40/39 5:4436e33f:::benchmark_data_smithi096_19531_object79002:head v 40'4935, mlcod=40'4932)", 2024-04-19T03:03:24.105 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:18.018102+0000", 2024-04-19T03:03:24.105 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 66.077570195000007, 2024-04-19T03:03:24.105 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.060023990999999999, 2024-04-19T03:03:24.105 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:24.105 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:24.105 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:24.105 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.105 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:24.105 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018102+0000", 2024-04-19T03:03:24.105 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:24.105 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.105 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.106 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:24.106 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018102+0000", 2024-04-19T03:03:24.106 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:24.106 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.106 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.106 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:24.106 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018102+0000", 2024-04-19T03:03:24.106 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:24.106 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.106 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.106 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:24.106 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018134+0000", 2024-04-19T03:03:24.106 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2722000000000003e-05 2024-04-19T03:03:24.107 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.107 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.107 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:24.107 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018145+0000", 2024-04-19T03:03:24.107 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0395e-05 2024-04-19T03:03:24.107 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.107 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.107 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:24.107 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018151+0000", 2024-04-19T03:03:24.107 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5300000000000002e-06 2024-04-19T03:03:24.107 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.107 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.107 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:24.107 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018489+0000", 2024-04-19T03:03:24.108 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00033731499999999998 2024-04-19T03:03:24.108 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.108 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.108 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:24.108 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018508+0000", 2024-04-19T03:03:24.108 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9775e-05 2024-04-19T03:03:24.108 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.108 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.108 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:03:24.108 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.078059+0000", 2024-04-19T03:03:24.108 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.059550171999999998 2024-04-19T03:03:24.108 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.108 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.108 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:24.109 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.078126+0000", 2024-04-19T03:03:24.109 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7773000000000003e-05 2024-04-19T03:03:24.109 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:24.109 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:24.109 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:24.109 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.109 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.109 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:86612 5.7 5:e32e3c49:::benchmark_data_smithi096_19531_object86611:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:24.109 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:22.633560+0000", 2024-04-19T03:03:24.109 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 61.462112535000003, 2024-04-19T03:03:24.109 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.19135289, 2024-04-19T03:03:24.109 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:24.109 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:24.109 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:24.110 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:24.110 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:24.110 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 86612 2024-04-19T03:03:24.110 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.110 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:24.110 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.110 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:24.110 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633560+0000", 2024-04-19T03:03:24.110 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:24.110 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.110 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.110 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:24.110 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633560+0000", 2024-04-19T03:03:24.111 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:24.111 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.111 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.111 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:24.111 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633558+0000", 2024-04-19T03:03:24.111 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999986 2024-04-19T03:03:24.111 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.111 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.111 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:24.111 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633609+0000", 2024-04-19T03:03:24.111 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0850999999999998e-05 2024-04-19T03:03:24.111 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.111 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.111 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:24.112 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633627+0000", 2024-04-19T03:03:24.112 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7951000000000001e-05 2024-04-19T03:03:24.112 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.112 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.112 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:24.112 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633635+0000", 2024-04-19T03:03:24.112 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2530000000000004e-06 2024-04-19T03:03:24.112 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.112 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.112 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:24.112 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633699+0000", 2024-04-19T03:03:24.112 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3901999999999999e-05 2024-04-19T03:03:24.112 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.112 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.113 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:24.113 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633992+0000", 2024-04-19T03:03:24.113 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00029283299999999999 2024-04-19T03:03:24.113 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.113 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.113 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:24.113 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.634223+0000", 2024-04-19T03:03:24.113 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00023084200000000001 2024-04-19T03:03:24.113 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.113 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.113 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:03:24.113 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.639085+0000", 2024-04-19T03:03:24.113 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0048624269999999999 2024-04-19T03:03:24.113 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.114 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.114 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:24.114 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.824635+0000", 2024-04-19T03:03:24.114 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.18554944700000001 2024-04-19T03:03:24.114 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.114 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.114 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:03:24.114 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.824793+0000", 2024-04-19T03:03:24.114 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000157959 2024-04-19T03:03:24.114 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.114 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.114 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:24.114 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.824913+0000", 2024-04-19T03:03:24.115 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000120093 2024-04-19T03:03:24.115 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:24.115 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:24.115 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:24.115 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.115 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.115 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:86625 5.7 5:e6d00488:::benchmark_data_smithi096_19531_object86624:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:24.115 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:22.643554+0000", 2024-04-19T03:03:24.115 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 61.452118769000002, 2024-04-19T03:03:24.115 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.18732841, 2024-04-19T03:03:24.115 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:24.115 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:24.115 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:24.115 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:24.116 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:24.116 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 86625 2024-04-19T03:03:24.116 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.116 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:24.116 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.116 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:24.116 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643554+0000", 2024-04-19T03:03:24.116 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:24.116 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.116 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.116 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:24.116 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643554+0000", 2024-04-19T03:03:24.116 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:24.117 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.117 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.117 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:24.117 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643552+0000", 2024-04-19T03:03:24.117 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999986 2024-04-19T03:03:24.117 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.117 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.117 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:24.117 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643588+0000", 2024-04-19T03:03:24.117 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5855999999999997e-05 2024-04-19T03:03:24.117 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.117 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.117 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:24.118 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643606+0000", 2024-04-19T03:03:24.118 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8226000000000001e-05 2024-04-19T03:03:24.118 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.118 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.118 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:24.118 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643618+0000", 2024-04-19T03:03:24.118 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1868000000000001e-05 2024-04-19T03:03:24.118 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.118 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.118 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:24.118 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643676+0000", 2024-04-19T03:03:24.118 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8153999999999999e-05 2024-04-19T03:03:24.119 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.119 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.119 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:24.119 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643905+0000", 2024-04-19T03:03:24.119 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00022847500000000001 2024-04-19T03:03:24.119 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.119 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.119 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:24.119 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.644150+0000", 2024-04-19T03:03:24.119 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00024531800000000001 2024-04-19T03:03:24.119 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.119 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.119 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:03:24.120 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.647407+0000", 2024-04-19T03:03:24.120 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0032563190000000001 2024-04-19T03:03:24.120 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.120 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.120 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:24.120 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.830721+0000", 2024-04-19T03:03:24.120 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.18331468300000001 2024-04-19T03:03:24.120 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.120 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.120 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:03:24.120 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.830813+0000", 2024-04-19T03:03:24.120 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.2205000000000002e-05 2024-04-19T03:03:24.120 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.121 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.121 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:24.121 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.830882+0000", 2024-04-19T03:03:24.121 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8819999999999995e-05 2024-04-19T03:03:24.121 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:24.121 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:24.121 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:24.121 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.121 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.121 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87063 5.7 5:e502e824:::benchmark_data_smithi096_19531_object87062:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:24.121 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.136067+0000", 2024-04-19T03:03:24.121 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 60.9596059, 2024-04-19T03:03:24.121 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.065521159999999995, 2024-04-19T03:03:24.121 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:24.122 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:24.122 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:24.122 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:24.122 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:24.122 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87063 2024-04-19T03:03:24.122 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.122 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:24.122 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.122 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:24.122 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.136067+0000", 2024-04-19T03:03:24.122 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:24.122 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.122 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.123 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:24.123 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.136067+0000", 2024-04-19T03:03:24.123 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:24.123 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.123 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.123 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:24.123 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.136066+0000", 2024-04-19T03:03:24.123 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:03:24.123 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.123 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.123 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:24.123 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.136154+0000", 2024-04-19T03:03:24.123 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.8256000000000003e-05 2024-04-19T03:03:24.123 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.124 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.124 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:24.124 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.136162+0000", 2024-04-19T03:03:24.124 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.5099999999999998e-06 2024-04-19T03:03:24.124 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.124 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.124 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:24.124 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.136171+0000", 2024-04-19T03:03:24.124 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2830000000000001e-06 2024-04-19T03:03:24.124 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.124 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.124 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:24.124 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.138421+0000", 2024-04-19T03:03:24.125 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0022506620000000001 2024-04-19T03:03:24.125 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.125 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.125 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:24.125 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.138560+0000", 2024-04-19T03:03:24.125 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000138446 2024-04-19T03:03:24.125 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.125 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.125 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:24.125 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.138689+0000", 2024-04-19T03:03:24.125 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00012950700000000001 2024-04-19T03:03:24.125 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.125 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.125 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:03:24.126 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.141517+0000", 2024-04-19T03:03:24.126 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0028280860000000001 2024-04-19T03:03:24.126 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.126 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.126 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:24.126 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.201350+0000", 2024-04-19T03:03:24.126 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.059832418999999998 2024-04-19T03:03:24.126 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.126 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.126 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:03:24.126 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.201485+0000", 2024-04-19T03:03:24.126 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000135597 2024-04-19T03:03:24.126 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.126 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.127 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:24.127 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.201588+0000", 2024-04-19T03:03:24.127 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00010247900000000001 2024-04-19T03:03:24.127 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:24.127 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:24.127 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:24.127 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.127 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.127 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87072 5.7 5:e3c7809a:::benchmark_data_smithi096_19531_object87071:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:24.127 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.144224+0000", 2024-04-19T03:03:24.127 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 60.951448876000001, 2024-04-19T03:03:24.127 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.058179555000000001, 2024-04-19T03:03:24.127 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:24.127 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:24.128 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:24.128 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:24.128 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:24.128 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87072 2024-04-19T03:03:24.128 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.128 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:24.128 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.128 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:24.128 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144224+0000", 2024-04-19T03:03:24.128 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:24.128 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.128 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.128 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:24.128 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144224+0000", 2024-04-19T03:03:24.128 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:24.129 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.129 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.129 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:24.129 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144223+0000", 2024-04-19T03:03:24.129 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:03:24.129 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.129 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.129 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:24.129 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144320+0000", 2024-04-19T03:03:24.129 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.7075000000000001e-05 2024-04-19T03:03:24.129 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.129 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.129 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:24.129 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144331+0000", 2024-04-19T03:03:24.130 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1342000000000001e-05 2024-04-19T03:03:24.130 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.130 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.130 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:24.130 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144337+0000", 2024-04-19T03:03:24.130 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8390000000000003e-06 2024-04-19T03:03:24.130 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.130 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.130 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:24.130 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144369+0000", 2024-04-19T03:03:24.130 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2079000000000002e-05 2024-04-19T03:03:24.130 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.130 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.131 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:24.131 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144464+0000", 2024-04-19T03:03:24.131 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.4623000000000005e-05 2024-04-19T03:03:24.131 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.131 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.131 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:24.131 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144553+0000", 2024-04-19T03:03:24.131 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9171000000000004e-05 2024-04-19T03:03:24.131 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.131 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.131 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:03:24.131 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.147018+0000", 2024-04-19T03:03:24.131 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0024648370000000001 2024-04-19T03:03:24.131 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.131 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.132 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:24.132 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.202270+0000", 2024-04-19T03:03:24.132 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.055252018 2024-04-19T03:03:24.132 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.132 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.132 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:03:24.132 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.202356+0000", 2024-04-19T03:03:24.132 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6648000000000001e-05 2024-04-19T03:03:24.132 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.132 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.132 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:24.132 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.202403+0000", 2024-04-19T03:03:24.132 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6956999999999998e-05 2024-04-19T03:03:24.133 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:24.133 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:24.133 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:24.133 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.133 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.133 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87123 5.6 5:6d1bc3b9:::benchmark_data_smithi096_19531_object87122:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:03:24.133 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249233+0000", 2024-04-19T03:03:24.133 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 60.846439844000002, 2024-04-19T03:03:24.133 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0291700720000001, 2024-04-19T03:03:24.133 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:24.133 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-04-19T03:03:24.133 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:24.133 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:24.134 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:24.134 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87123 2024-04-19T03:03:24.134 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.134 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:24.134 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.134 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:24.134 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249233+0000", 2024-04-19T03:03:24.134 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:24.134 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.134 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.134 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:24.134 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249233+0000", 2024-04-19T03:03:24.134 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:24.135 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.135 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.135 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:24.135 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249231+0000", 2024-04-19T03:03:24.135 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999986 2024-04-19T03:03:24.135 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.135 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.135 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:24.135 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249285+0000", 2024-04-19T03:03:24.135 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4005000000000002e-05 2024-04-19T03:03:24.135 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.135 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.135 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:24.135 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249300+0000", 2024-04-19T03:03:24.136 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4715999999999999e-05 2024-04-19T03:03:24.136 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.136 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.136 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:24.136 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249307+0000", 2024-04-19T03:03:24.136 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8399999999999997e-06 2024-04-19T03:03:24.136 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.136 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.136 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:24.136 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249366+0000", 2024-04-19T03:03:24.136 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9435999999999998e-05 2024-04-19T03:03:24.136 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.136 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.137 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op must wait for map", 2024-04-19T03:03:24.137 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249376+0000", 2024-04-19T03:03:24.137 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.4919999999999999e-06 2024-04-19T03:03:24.137 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.137 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.137 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:24.137 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263757+0000", 2024-04-19T03:03:24.137 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.014381461999999999 2024-04-19T03:03:24.137 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.137 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.137 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:03:24.137 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263875+0000", 2024-04-19T03:03:24.137 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000117166 2024-04-19T03:03:24.137 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.138 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.138 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:24.138 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.277136+0000", 2024-04-19T03:03:24.138 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.013261207 2024-04-19T03:03:24.138 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.138 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.138 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:24.138 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.278403+0000", 2024-04-19T03:03:24.138 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001267106 2024-04-19T03:03:24.138 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:24.138 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:24.138 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:24.138 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.139 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.139 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87128 5.6 5:6905c420:::benchmark_data_smithi096_19531_object87127:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:03:24.139 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249323+0000", 2024-04-19T03:03:24.139 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 60.846349097000001, 2024-04-19T03:03:24.139 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0292813249999999, 2024-04-19T03:03:24.139 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:24.139 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-04-19T03:03:24.139 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:24.139 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:24.139 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:24.139 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87128 2024-04-19T03:03:24.139 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.139 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:24.139 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.140 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:24.140 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249323+0000", 2024-04-19T03:03:24.140 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:24.140 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.140 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.140 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:24.140 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249323+0000", 2024-04-19T03:03:24.140 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:24.140 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.140 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.140 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:24.140 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249323+0000", 2024-04-19T03:03:24.140 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:24.141 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.141 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.141 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:24.141 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249385+0000", 2024-04-19T03:03:24.141 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1711999999999995e-05 2024-04-19T03:03:24.141 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.141 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.141 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:24.141 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249398+0000", 2024-04-19T03:03:24.141 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3022e-05 2024-04-19T03:03:24.141 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.141 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.141 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:24.141 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249402+0000", 2024-04-19T03:03:24.142 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4819999999999996e-06 2024-04-19T03:03:24.142 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.142 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.142 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:24.142 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249437+0000", 2024-04-19T03:03:24.142 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4702000000000001e-05 2024-04-19T03:03:24.142 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.142 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.142 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:03:24.142 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249442+0000", 2024-04-19T03:03:24.142 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8019999999999999e-06 2024-04-19T03:03:24.142 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.142 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.142 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:24.143 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263896+0000", 2024-04-19T03:03:24.143 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.014454679999999999 2024-04-19T03:03:24.143 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.143 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.143 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:03:24.143 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263900+0000", 2024-04-19T03:03:24.143 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9700000000000001e-06 2024-04-19T03:03:24.143 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.143 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.143 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:24.143 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.278557+0000", 2024-04-19T03:03:24.143 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0146566480000001 2024-04-19T03:03:24.143 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.143 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.144 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:24.144 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.278605+0000", 2024-04-19T03:03:24.144 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7735999999999998e-05 2024-04-19T03:03:24.144 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:24.144 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:24.144 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:24.144 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.144 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.144 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87130 5.3 5:c8c2d67b:::benchmark_data_smithi096_19531_object87129:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:03:24.144 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249418+0000", 2024-04-19T03:03:24.144 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 60.846254385999998, 2024-04-19T03:03:24.144 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.025414182, 2024-04-19T03:03:24.144 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:24.145 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-04-19T03:03:24.145 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:24.145 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:24.145 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:24.145 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87130 2024-04-19T03:03:24.145 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.145 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:24.145 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.145 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:24.145 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249418+0000", 2024-04-19T03:03:24.145 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:24.145 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.145 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.145 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:24.145 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249418+0000", 2024-04-19T03:03:24.146 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:24.146 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.146 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.146 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:24.146 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249409+0000", 2024-04-19T03:03:24.146 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999905 2024-04-19T03:03:24.146 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.146 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.146 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:24.146 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249464+0000", 2024-04-19T03:03:24.146 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5381999999999999e-05 2024-04-19T03:03:24.146 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.146 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.147 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:24.147 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249471+0000", 2024-04-19T03:03:24.147 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2609999999999996e-06 2024-04-19T03:03:24.147 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.147 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.147 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:24.147 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249475+0000", 2024-04-19T03:03:24.147 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2839999999999998e-06 2024-04-19T03:03:24.147 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.147 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.147 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:24.147 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249535+0000", 2024-04-19T03:03:24.147 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0545999999999999e-05 2024-04-19T03:03:24.148 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.148 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.148 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op must wait for map", 2024-04-19T03:03:24.148 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249540+0000", 2024-04-19T03:03:24.148 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2859999999999999e-06 2024-04-19T03:03:24.148 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.148 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.148 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:24.148 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263450+0000", 2024-04-19T03:03:24.148 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.013909585 2024-04-19T03:03:24.148 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.148 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.148 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:03:24.149 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263458+0000", 2024-04-19T03:03:24.149 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8089999999999993e-06 2024-04-19T03:03:24.149 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.149 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.149 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:24.149 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.273193+0000", 2024-04-19T03:03:24.149 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0097351379999999 2024-04-19T03:03:24.149 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.149 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.149 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:24.149 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.274832+0000", 2024-04-19T03:03:24.149 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0016394789999999999 2024-04-19T03:03:24.149 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:24.149 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:24.150 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:24.150 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.150 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.150 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87131 5.1 5:83756d55:::benchmark_data_smithi096_19531_object87130:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:03:24.150 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249491+0000", 2024-04-19T03:03:24.150 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 60.846181739000002, 2024-04-19T03:03:24.150 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0191489520000001, 2024-04-19T03:03:24.150 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:24.150 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-04-19T03:03:24.150 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:24.150 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:24.150 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:24.150 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87131 2024-04-19T03:03:24.150 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.151 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:24.151 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.151 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:24.151 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249491+0000", 2024-04-19T03:03:24.151 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:24.151 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.151 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.151 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:24.151 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249491+0000", 2024-04-19T03:03:24.151 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:24.151 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.151 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.151 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:24.151 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249491+0000", 2024-04-19T03:03:24.152 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:24.152 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.152 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.152 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:24.152 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249530+0000", 2024-04-19T03:03:24.152 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9589000000000003e-05 2024-04-19T03:03:24.152 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.153 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.153 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:24.153 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249544+0000", 2024-04-19T03:03:24.153 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4158000000000001e-05 2024-04-19T03:03:24.153 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.153 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.153 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:24.153 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249549+0000", 2024-04-19T03:03:24.153 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6809999999999997e-06 2024-04-19T03:03:24.153 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.154 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.154 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:24.154 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249592+0000", 2024-04-19T03:03:24.154 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3285999999999999e-05 2024-04-19T03:03:24.154 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.154 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.154 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op must wait for map", 2024-04-19T03:03:24.154 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249598+0000", 2024-04-19T03:03:24.154 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8329999999999999e-06 2024-04-19T03:03:24.154 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.154 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.154 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:24.154 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263331+0000", 2024-04-19T03:03:24.155 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.013733093 2024-04-19T03:03:24.155 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.155 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.155 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:03:24.155 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263343+0000", 2024-04-19T03:03:24.155 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.189e-05 2024-04-19T03:03:24.155 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.155 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.155 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:24.155 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.268541+0000", 2024-04-19T03:03:24.155 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0051983440000001 2024-04-19T03:03:24.155 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.155 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.156 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:24.156 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.268640+0000", 2024-04-19T03:03:24.156 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.8387999999999994e-05 2024-04-19T03:03:24.156 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:24.156 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:24.156 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:24.156 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.156 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.156 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87132 5.c 5:3e18b732:::benchmark_data_smithi096_19531_object87131:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:03:24.156 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249558+0000", 2024-04-19T03:03:24.156 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 60.846114837999998, 2024-04-19T03:03:24.156 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0241198380000001, 2024-04-19T03:03:24.156 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:24.157 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-04-19T03:03:24.157 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:24.157 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:24.157 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:24.157 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87132 2024-04-19T03:03:24.157 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.157 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:24.157 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.157 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:24.157 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249558+0000", 2024-04-19T03:03:24.157 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:24.157 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.157 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.157 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:24.158 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249558+0000", 2024-04-19T03:03:24.158 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:24.158 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.158 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.158 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:24.158 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249557+0000", 2024-04-19T03:03:24.158 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:24.158 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.158 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.158 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:24.158 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249625+0000", 2024-04-19T03:03:24.158 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7200999999999996e-05 2024-04-19T03:03:24.158 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.159 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.159 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:24.159 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249646+0000", 2024-04-19T03:03:24.159 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1053e-05 2024-04-19T03:03:24.159 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.159 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.159 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:24.159 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249650+0000", 2024-04-19T03:03:24.159 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2719999999999999e-06 2024-04-19T03:03:24.159 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.159 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.159 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:24.159 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249686+0000", 2024-04-19T03:03:24.159 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6430000000000002e-05 2024-04-19T03:03:24.159 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.160 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.160 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op must wait for map", 2024-04-19T03:03:24.160 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249690+0000", 2024-04-19T03:03:24.160 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.765e-06 2024-04-19T03:03:24.160 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.160 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.160 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:24.160 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261157+0000", 2024-04-19T03:03:24.160 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011467247999999999 2024-04-19T03:03:24.160 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.160 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.160 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:03:24.160 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261170+0000", 2024-04-19T03:03:24.161 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2833000000000001e-05 2024-04-19T03:03:24.161 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.161 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.161 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:24.161 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.272119+0000", 2024-04-19T03:03:24.161 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.010949313 2024-04-19T03:03:24.161 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.161 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.161 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:24.161 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.273678+0000", 2024-04-19T03:03:24.161 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0015581550000000001 2024-04-19T03:03:24.161 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:24.161 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:24.161 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:24.161 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.162 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.162 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87133 5.c 5:3f772a62:::benchmark_data_smithi096_19531_object87132:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:03:24.162 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249657+0000", 2024-04-19T03:03:24.162 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 60.846015459, 2024-04-19T03:03:24.162 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0242819409999999, 2024-04-19T03:03:24.162 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:24.162 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-04-19T03:03:24.162 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:24.162 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:24.162 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:24.162 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87133 2024-04-19T03:03:24.162 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.162 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:24.163 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.163 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:24.163 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249657+0000", 2024-04-19T03:03:24.163 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:24.163 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.163 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.163 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:24.163 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249657+0000", 2024-04-19T03:03:24.163 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:24.163 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.163 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.163 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:24.163 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249657+0000", 2024-04-19T03:03:24.164 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:24.164 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.164 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.164 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:24.164 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249690+0000", 2024-04-19T03:03:24.164 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3343000000000002e-05 2024-04-19T03:03:24.164 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.164 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.164 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:24.164 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249695+0000", 2024-04-19T03:03:24.164 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8600000000000001e-06 2024-04-19T03:03:24.164 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.164 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.165 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:24.165 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249698+0000", 2024-04-19T03:03:24.165 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.1700000000000001e-06 2024-04-19T03:03:24.165 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.165 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.165 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:24.165 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249741+0000", 2024-04-19T03:03:24.165 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2849999999999998e-05 2024-04-19T03:03:24.165 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.165 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.165 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:03:24.165 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249746+0000", 2024-04-19T03:03:24.165 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1019999999999996e-06 2024-04-19T03:03:24.166 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.166 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.166 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:24.166 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261209+0000", 2024-04-19T03:03:24.166 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011462447000000001 2024-04-19T03:03:24.166 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.166 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.166 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:03:24.166 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261216+0000", 2024-04-19T03:03:24.166 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8520000000000004e-06 2024-04-19T03:03:24.166 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.166 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.166 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:24.166 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.273872+0000", 2024-04-19T03:03:24.167 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0126558000000001 2024-04-19T03:03:24.167 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.167 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.167 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:24.167 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.273939+0000", 2024-04-19T03:03:24.167 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6822000000000005e-05 2024-04-19T03:03:24.167 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:24.167 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:24.167 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:24.167 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.167 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.167 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87134 5.5 5:a56c478f:::benchmark_data_smithi096_19531_object87133:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:03:24.167 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249708+0000", 2024-04-19T03:03:24.167 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 60.845964535, 2024-04-19T03:03:24.168 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0214677299999999, 2024-04-19T03:03:24.168 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:24.168 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-04-19T03:03:24.168 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:24.168 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:24.168 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:24.168 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87134 2024-04-19T03:03:24.168 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.168 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:24.168 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.168 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:24.168 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249708+0000", 2024-04-19T03:03:24.168 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:24.168 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.169 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.169 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:24.169 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249708+0000", 2024-04-19T03:03:24.169 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:24.169 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.169 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.169 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:24.169 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249706+0000", 2024-04-19T03:03:24.169 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999976 2024-04-19T03:03:24.169 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.169 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.169 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:24.169 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249740+0000", 2024-04-19T03:03:24.170 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4458000000000001e-05 2024-04-19T03:03:24.170 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.170 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.170 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:24.170 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249745+0000", 2024-04-19T03:03:24.170 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5020000000000003e-06 2024-04-19T03:03:24.170 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.170 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.170 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:24.170 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249748+0000", 2024-04-19T03:03:24.170 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2499999999999998e-06 2024-04-19T03:03:24.170 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.170 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.171 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:24.171 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249778+0000", 2024-04-19T03:03:24.171 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.006e-05 2024-04-19T03:03:24.171 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.171 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.171 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op must wait for map", 2024-04-19T03:03:24.171 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249782+0000", 2024-04-19T03:03:24.171 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2910000000000001e-06 2024-04-19T03:03:24.171 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.171 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.171 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:24.171 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261666+0000", 2024-04-19T03:03:24.171 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011883471 2024-04-19T03:03:24.171 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.172 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.172 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:03:24.172 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261674+0000", 2024-04-19T03:03:24.172 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6479999999999992e-06 2024-04-19T03:03:24.172 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.172 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.172 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:24.172 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.269323+0000", 2024-04-19T03:03:24.172 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.00764867 2024-04-19T03:03:24.172 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.172 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.172 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:24.172 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.271176+0000", 2024-04-19T03:03:24.173 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001852844 2024-04-19T03:03:24.173 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:24.173 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:24.173 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:24.173 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.173 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.173 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87137 5.c 5:30708c68:::benchmark_data_smithi096_19531_object87136:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:03:24.173 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249756+0000", 2024-04-19T03:03:24.173 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 60.845916828999997, 2024-04-19T03:03:24.173 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.033331752, 2024-04-19T03:03:24.173 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:24.173 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:24.173 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:24.174 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:24.174 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:24.174 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87137 2024-04-19T03:03:24.174 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.174 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:24.174 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.174 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:24.174 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249756+0000", 2024-04-19T03:03:24.174 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:24.174 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.174 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.174 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:24.174 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249756+0000", 2024-04-19T03:03:24.175 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:24.175 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.175 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.175 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:24.175 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249755+0000", 2024-04-19T03:03:24.175 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:24.175 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.175 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.175 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:24.175 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249777+0000", 2024-04-19T03:03:24.175 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1420000000000002e-05 2024-04-19T03:03:24.175 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.175 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.176 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:24.176 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249781+0000", 2024-04-19T03:03:24.176 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0609999999999997e-06 2024-04-19T03:03:24.176 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.176 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.176 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:24.176 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249787+0000", 2024-04-19T03:03:24.176 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.02e-06 2024-04-19T03:03:24.176 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.176 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.176 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:24.176 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249818+0000", 2024-04-19T03:03:24.176 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0947e-05 2024-04-19T03:03:24.176 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.177 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.177 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:03:24.177 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249821+0000", 2024-04-19T03:03:24.177 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.117e-06 2024-04-19T03:03:24.177 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.177 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.177 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:24.177 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261243+0000", 2024-04-19T03:03:24.177 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011421875999999999 2024-04-19T03:03:24.177 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.177 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.177 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:03:24.177 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261251+0000", 2024-04-19T03:03:24.178 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6120000000000001e-06 2024-04-19T03:03:24.178 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.178 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.178 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:24.178 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.274050+0000", 2024-04-19T03:03:24.178 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.012799405 2024-04-19T03:03:24.178 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.178 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.178 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:24.178 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.274529+0000", 2024-04-19T03:03:24.178 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00047867100000000001 2024-04-19T03:03:24.178 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.178 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.179 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:03:24.179 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.282972+0000", 2024-04-19T03:03:24.179 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0084436900000000002 2024-04-19T03:03:24.179 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.179 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.179 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:03:24.179 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.283022+0000", 2024-04-19T03:03:24.179 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9339000000000003e-05 2024-04-19T03:03:24.179 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.179 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.179 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:24.179 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.283088+0000", 2024-04-19T03:03:24.179 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5877999999999995e-05 2024-04-19T03:03:24.179 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:24.180 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:24.180 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:24.180 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.180 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.180 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:158376 5.9 5:9e73c076:::benchmark_data_smithi096_19531_object44926:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-19T03:03:24.180 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:58.126227+0000", 2024-04-19T03:03:24.180 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 25.969445096000001, 2024-04-19T03:03:24.180 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.069738668000000004, 2024-04-19T03:03:24.180 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:24.180 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:24.180 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:24.180 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:24.180 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:24.180 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 158376 2024-04-19T03:03:24.181 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.181 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:24.181 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.181 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:24.181 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.126227+0000", 2024-04-19T03:03:24.181 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:24.181 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.181 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.181 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:24.181 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.126227+0000", 2024-04-19T03:03:24.182 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:24.182 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.182 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.182 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:24.182 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.126226+0000", 2024-04-19T03:03:24.182 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:03:24.182 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.182 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.182 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:24.182 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.126236+0000", 2024-04-19T03:03:24.182 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.4199999999999996e-06 2024-04-19T03:03:24.182 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.183 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.183 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:24.183 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.126243+0000", 2024-04-19T03:03:24.183 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.199e-06 2024-04-19T03:03:24.183 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.183 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.183 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:24.183 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.126248+0000", 2024-04-19T03:03:24.183 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1320000000000002e-06 2024-04-19T03:03:24.183 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.183 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.183 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:24.183 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.126286+0000", 2024-04-19T03:03:24.183 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7401000000000003e-05 2024-04-19T03:03:24.184 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.184 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.184 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:24.184 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.126368+0000", 2024-04-19T03:03:24.184 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2113999999999993e-05 2024-04-19T03:03:24.184 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.184 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.184 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:03:24.184 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.126438+0000", 2024-04-19T03:03:24.184 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0337000000000001e-05 2024-04-19T03:03:24.184 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.184 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.184 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:03:24.185 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.130816+0000", 2024-04-19T03:03:24.185 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0043778330000000002 2024-04-19T03:03:24.185 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.185 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.185 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:24.185 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.195830+0000", 2024-04-19T03:03:24.185 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.065013933999999995 2024-04-19T03:03:24.185 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.185 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.185 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:03:24.185 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.195907+0000", 2024-04-19T03:03:24.185 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7397000000000005e-05 2024-04-19T03:03:24.185 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.185 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.186 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:24.186 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.195966+0000", 2024-04-19T03:03:24.186 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8906999999999997e-05 2024-04-19T03:03:24.186 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:24.186 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:24.186 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:24.186 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.186 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.186 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:158381 5.9 5:94dcd4a7:::benchmark_data_smithi096_19531_object44931:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-19T03:03:24.186 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:58.128712+0000", 2024-04-19T03:03:24.186 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 25.966960653000001, 2024-04-19T03:03:24.186 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.067497527000000002, 2024-04-19T03:03:24.186 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:24.187 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:24.187 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:24.187 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:24.187 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:24.187 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 158381 2024-04-19T03:03:24.187 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.187 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:24.187 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.187 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:24.187 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.128712+0000", 2024-04-19T03:03:24.187 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:24.187 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.187 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.187 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:24.188 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.128712+0000", 2024-04-19T03:03:24.188 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:24.188 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.188 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.188 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:24.188 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.128711+0000", 2024-04-19T03:03:24.188 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:03:24.188 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.188 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.188 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:24.188 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.128716+0000", 2024-04-19T03:03:24.188 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0610000000000003e-06 2024-04-19T03:03:24.188 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.189 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.189 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:24.189 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.128724+0000", 2024-04-19T03:03:24.189 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0120000000000005e-06 2024-04-19T03:03:24.189 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.189 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.189 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:24.189 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.128729+0000", 2024-04-19T03:03:24.189 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8899999999999998e-06 2024-04-19T03:03:24.189 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.189 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.189 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:24.189 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.128778+0000", 2024-04-19T03:03:24.189 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9110000000000002e-05 2024-04-19T03:03:24.189 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.190 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.190 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:24.190 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.128903+0000", 2024-04-19T03:03:24.190 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00012506799999999999 2024-04-19T03:03:24.190 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.190 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.190 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:03:24.190 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.129022+0000", 2024-04-19T03:03:24.190 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00011923599999999999 2024-04-19T03:03:24.190 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.190 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.190 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:03:24.190 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.132294+0000", 2024-04-19T03:03:24.191 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.003271244 2024-04-19T03:03:24.191 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.191 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.191 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:24.191 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.196045+0000", 2024-04-19T03:03:24.191 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.063751206000000005 2024-04-19T03:03:24.191 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.191 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.191 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:03:24.191 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.196133+0000", 2024-04-19T03:03:24.191 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.8213000000000004e-05 2024-04-19T03:03:24.191 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.191 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.192 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:24.192 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.196209+0000", 2024-04-19T03:03:24.192 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6335999999999996e-05 2024-04-19T03:03:24.192 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:24.192 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:24.192 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:24.192 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.192 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.192 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:158385 5.9 5:950ec749:::benchmark_data_smithi096_19531_object44935:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-19T03:03:24.192 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:58.129756+0000", 2024-04-19T03:03:24.192 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 25.965916720999999, 2024-04-19T03:03:24.192 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.068998382999999996, 2024-04-19T03:03:24.192 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:24.193 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:24.193 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:24.193 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:24.193 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:24.193 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 158385 2024-04-19T03:03:24.193 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.193 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:24.193 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.193 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:24.193 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.129756+0000", 2024-04-19T03:03:24.193 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:24.193 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.193 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.194 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:24.194 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.129756+0000", 2024-04-19T03:03:24.194 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:24.194 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.194 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.194 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:24.194 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.129755+0000", 2024-04-19T03:03:24.194 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:03:24.194 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.194 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.194 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:24.194 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.129760+0000", 2024-04-19T03:03:24.194 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6030000000000004e-06 2024-04-19T03:03:24.195 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.195 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.195 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:24.195 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.129774+0000", 2024-04-19T03:03:24.195 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3131e-05 2024-04-19T03:03:24.195 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.195 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.195 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:24.195 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.129781+0000", 2024-04-19T03:03:24.195 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4030000000000001e-06 2024-04-19T03:03:24.195 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.195 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.195 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:24.196 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.130837+0000", 2024-04-19T03:03:24.196 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00105569 2024-04-19T03:03:24.196 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.196 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.196 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:24.196 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.130917+0000", 2024-04-19T03:03:24.196 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9929e-05 2024-04-19T03:03:24.196 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.196 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.196 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:03:24.196 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.130973+0000", 2024-04-19T03:03:24.196 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.664e-05 2024-04-19T03:03:24.196 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.196 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.197 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:03:24.197 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.132340+0000", 2024-04-19T03:03:24.197 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001366321 2024-04-19T03:03:24.197 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.197 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.197 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:24.197 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.198637+0000", 2024-04-19T03:03:24.197 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.066296888999999998 2024-04-19T03:03:24.197 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.197 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.197 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:03:24.197 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.198704+0000", 2024-04-19T03:03:24.197 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7333000000000001e-05 2024-04-19T03:03:24.198 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.198 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.198 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:24.198 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.198754+0000", 2024-04-19T03:03:24.198 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0421999999999999e-05 2024-04-19T03:03:24.198 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:24.198 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:24.198 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:24.198 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.198 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.198 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:158387 5.9 5:9e96f619:::benchmark_data_smithi096_19531_object44937:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-19T03:03:24.198 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:58.132457+0000", 2024-04-19T03:03:24.199 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 25.963215157, 2024-04-19T03:03:24.199 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.066858091999999994, 2024-04-19T03:03:24.199 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:24.199 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:24.199 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:24.199 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:24.199 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:24.199 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 158387 2024-04-19T03:03:24.199 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.199 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:24.199 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.199 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:24.200 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.132457+0000", 2024-04-19T03:03:24.200 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:24.200 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.200 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.200 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:24.200 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.132457+0000", 2024-04-19T03:03:24.200 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:24.200 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.200 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.200 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:24.200 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.132457+0000", 2024-04-19T03:03:24.200 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:24.200 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.201 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.201 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:24.201 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.132460+0000", 2024-04-19T03:03:24.201 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.1949999999999999e-06 2024-04-19T03:03:24.201 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.201 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.201 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:24.201 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.132468+0000", 2024-04-19T03:03:24.201 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.1599999999999998e-06 2024-04-19T03:03:24.201 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.201 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.201 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:24.201 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.132473+0000", 2024-04-19T03:03:24.202 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9259999999999999e-06 2024-04-19T03:03:24.202 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.202 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.202 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:24.202 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.132504+0000", 2024-04-19T03:03:24.202 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0914000000000003e-05 2024-04-19T03:03:24.202 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.202 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.202 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:24.202 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.132646+0000", 2024-04-19T03:03:24.202 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00014214300000000001 2024-04-19T03:03:24.202 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.202 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.203 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:03:24.203 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.132741+0000", 2024-04-19T03:03:24.203 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.4344000000000003e-05 2024-04-19T03:03:24.203 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.203 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.203 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:03:24.203 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.135774+0000", 2024-04-19T03:03:24.203 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0030334960000000001 2024-04-19T03:03:24.203 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.203 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.203 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:24.203 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.199240+0000", 2024-04-19T03:03:24.203 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.063465695000000003 2024-04-19T03:03:24.204 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.204 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.204 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:03:24.204 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.199272+0000", 2024-04-19T03:03:24.204 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2412000000000001e-05 2024-04-19T03:03:24.204 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.204 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.204 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:24.204 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.199316+0000", 2024-04-19T03:03:24.204 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3275000000000002e-05 2024-04-19T03:03:24.204 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:24.204 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:24.204 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:24.205 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.205 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.205 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:158392 5.f 5:f462725f:::benchmark_data_smithi096_19531_object44942:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-19T03:03:24.205 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:58.135703+0000", 2024-04-19T03:03:24.205 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 25.959969377, 2024-04-19T03:03:24.205 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.063132879000000003, 2024-04-19T03:03:24.205 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:24.205 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:24.205 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:24.205 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:24.205 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:24.205 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 158392 2024-04-19T03:03:24.205 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.205 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:24.206 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.206 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:24.206 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.135703+0000", 2024-04-19T03:03:24.206 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:24.206 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.206 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.206 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:24.206 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.135703+0000", 2024-04-19T03:03:24.206 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:24.206 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.206 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.207 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:24.207 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.135702+0000", 2024-04-19T03:03:24.207 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:03:24.207 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.207 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.207 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:24.207 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.135708+0000", 2024-04-19T03:03:24.207 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8270000000000003e-06 2024-04-19T03:03:24.207 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.207 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.207 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:24.207 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.135720+0000", 2024-04-19T03:03:24.207 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2057e-05 2024-04-19T03:03:24.207 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.207 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.208 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:24.208 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.135727+0000", 2024-04-19T03:03:24.208 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8090000000000004e-06 2024-04-19T03:03:24.208 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.208 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.208 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:24.208 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.135768+0000", 2024-04-19T03:03:24.208 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1548999999999998e-05 2024-04-19T03:03:24.208 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.208 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.208 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:24.208 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.135853+0000", 2024-04-19T03:03:24.208 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4845000000000005e-05 2024-04-19T03:03:24.208 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.209 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.209 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:03:24.209 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.135934+0000", 2024-04-19T03:03:24.209 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0315000000000006e-05 2024-04-19T03:03:24.209 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.209 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.209 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:03:24.209 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.138685+0000", 2024-04-19T03:03:24.209 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.002751042 2024-04-19T03:03:24.209 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.209 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.209 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:24.209 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.198747+0000", 2024-04-19T03:03:24.209 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.060062675000000003 2024-04-19T03:03:24.209 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.210 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.210 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:03:24.210 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.198802+0000", 2024-04-19T03:03:24.210 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4469000000000003e-05 2024-04-19T03:03:24.210 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.210 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.210 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:24.210 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.198836+0000", 2024-04-19T03:03:24.210 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4272e-05 2024-04-19T03:03:24.210 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:24.210 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:24.210 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:24.210 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.210 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.211 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:158397 5.d 5:b5d962e9:::benchmark_data_smithi096_19531_object44947:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-19T03:03:24.211 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:58.138717+0000", 2024-04-19T03:03:24.211 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 25.956955434000001, 2024-04-19T03:03:24.211 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.057191467000000003, 2024-04-19T03:03:24.211 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:24.211 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:24.211 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:24.211 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:24.211 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:24.211 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 158397 2024-04-19T03:03:24.211 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.211 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:24.211 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.211 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:24.212 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.138717+0000", 2024-04-19T03:03:24.212 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:24.212 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.212 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.212 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:24.212 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.138717+0000", 2024-04-19T03:03:24.212 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:24.212 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.212 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.212 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:24.212 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.138716+0000", 2024-04-19T03:03:24.212 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999986 2024-04-19T03:03:24.212 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.212 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.212 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:24.213 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.138722+0000", 2024-04-19T03:03:24.213 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1709999999999999e-06 2024-04-19T03:03:24.213 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.213 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.213 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:24.213 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.138731+0000", 2024-04-19T03:03:24.213 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.0310000000000004e-06 2024-04-19T03:03:24.213 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.213 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.213 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:24.213 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.138738+0000", 2024-04-19T03:03:24.213 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8430000000000004e-06 2024-04-19T03:03:24.213 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.213 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.214 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:24.214 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.138789+0000", 2024-04-19T03:03:24.214 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0623e-05 2024-04-19T03:03:24.214 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.214 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.214 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:24.214 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.138945+0000", 2024-04-19T03:03:24.214 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00015671899999999999 2024-04-19T03:03:24.214 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.214 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.214 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:03:24.214 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.139079+0000", 2024-04-19T03:03:24.214 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00013380099999999999 2024-04-19T03:03:24.214 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.215 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.215 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:03:24.215 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.141715+0000", 2024-04-19T03:03:24.215 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0026362849999999999 2024-04-19T03:03:24.215 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.215 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.215 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:24.215 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.195784+0000", 2024-04-19T03:03:24.215 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.054068353 2024-04-19T03:03:24.215 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.215 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.215 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:03:24.215 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.195852+0000", 2024-04-19T03:03:24.215 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8121999999999996e-05 2024-04-19T03:03:24.215 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.216 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.216 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:24.216 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.195909+0000", 2024-04-19T03:03:24.216 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6737999999999998e-05 2024-04-19T03:03:24.216 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:24.216 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:24.216 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:24.216 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:24.216 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:24.216 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-04-19T03:03:24.218 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:03:24.216+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:03:24.218 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T03:03:24.318 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:03:24.316+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:03:24.344 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-19T03:03:24.344 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-04-19T03:03:24.344 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.344 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:221392 5.4 5:2c300986:::benchmark_data_smithi096_19531_object107942:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-19T03:03:24.344 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:03:24.339123+0000", 2024-04-19T03:03:24.344 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0048414950000000003, 2024-04-19T03:03:24.344 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0048613140000000003, 2024-04-19T03:03:24.345 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:24.345 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-19T03:03:24.345 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:24.345 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:24.345 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:24.345 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 221392 2024-04-19T03:03:24.345 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.345 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:24.345 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.345 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:24.345 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:24.339123+0000", 2024-04-19T03:03:24.345 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:24.345 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.346 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.346 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:24.346 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:24.339123+0000", 2024-04-19T03:03:24.346 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:24.346 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.346 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.346 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:24.346 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:24.339122+0000", 2024-04-19T03:03:24.346 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:03:24.346 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.346 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.346 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:24.347 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:24.339128+0000", 2024-04-19T03:03:24.347 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4920000000000001e-06 2024-04-19T03:03:24.347 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.347 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.347 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:24.347 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:24.339139+0000", 2024-04-19T03:03:24.347 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1103e-05 2024-04-19T03:03:24.347 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.347 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.347 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:24.347 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:24.339147+0000", 2024-04-19T03:03:24.347 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.6459999999999993e-06 2024-04-19T03:03:24.347 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.347 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.347 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:24.348 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:24.339978+0000", 2024-04-19T03:03:24.348 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00083105699999999995 2024-04-19T03:03:24.348 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.348 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.348 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:24.348 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:24.340105+0000", 2024-04-19T03:03:24.348 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012759499999999999 2024-04-19T03:03:24.348 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:24.348 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:24.348 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:24.348 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.348 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.348 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:221396 5.8 5:1f8e3da2:::benchmark_data_smithi096_19531_object107946:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-19T03:03:24.348 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:03:24.339450+0000", 2024-04-19T03:03:24.349 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0045150069999999997, 2024-04-19T03:03:24.349 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.004576241, 2024-04-19T03:03:24.349 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:24.349 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-19T03:03:24.349 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:24.349 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:24.349 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:24.349 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 221396 2024-04-19T03:03:24.349 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.349 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:24.349 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.349 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:24.349 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:24.339450+0000", 2024-04-19T03:03:24.349 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:24.349 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.350 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.350 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:24.350 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:24.339450+0000", 2024-04-19T03:03:24.350 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:24.350 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.350 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.350 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:24.350 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:24.339449+0000", 2024-04-19T03:03:24.350 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:03:24.350 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.350 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.350 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:24.350 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:24.339454+0000", 2024-04-19T03:03:24.350 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1970000000000004e-06 2024-04-19T03:03:24.351 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.351 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.351 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:24.351 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:24.339465+0000", 2024-04-19T03:03:24.351 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0698e-05 2024-04-19T03:03:24.351 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.351 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.352 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:24.352 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:24.339472+0000", 2024-04-19T03:03:24.352 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.905e-06 2024-04-19T03:03:24.352 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.352 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.352 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:24.352 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:24.342823+0000", 2024-04-19T03:03:24.352 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0033511359999999998 2024-04-19T03:03:24.353 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.353 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.353 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:24.353 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:24.342983+0000", 2024-04-19T03:03:24.353 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000160488 2024-04-19T03:03:24.353 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:24.353 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:24.353 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:24.353 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.353 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.353 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:221398 5.a 5:5b859a14:::benchmark_data_smithi096_19531_object107948:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-19T03:03:24.353 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:03:24.339573+0000", 2024-04-19T03:03:24.353 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.004392048, 2024-04-19T03:03:24.354 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0044957360000000002, 2024-04-19T03:03:24.354 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:24.354 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-19T03:03:24.354 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:24.354 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:24.354 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:24.354 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 221398 2024-04-19T03:03:24.354 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.354 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:24.354 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.354 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:24.354 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:24.339573+0000", 2024-04-19T03:03:24.354 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:24.355 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.355 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.355 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:24.355 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:24.339573+0000", 2024-04-19T03:03:24.355 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:24.355 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.355 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.355 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:24.355 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:24.339572+0000", 2024-04-19T03:03:24.355 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:24.355 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.355 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.355 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:24.355 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:24.339576+0000", 2024-04-19T03:03:24.355 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.495e-06 2024-04-19T03:03:24.356 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.356 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.356 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:24.356 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:24.339583+0000", 2024-04-19T03:03:24.356 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.6109999999999996e-06 2024-04-19T03:03:24.356 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.356 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.356 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:24.356 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:24.339589+0000", 2024-04-19T03:03:24.356 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7370000000000003e-06 2024-04-19T03:03:24.356 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.356 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.356 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:24.356 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:24.339758+0000", 2024-04-19T03:03:24.357 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016896500000000001 2024-04-19T03:03:24.357 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.357 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.357 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:24.357 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:24.339920+0000", 2024-04-19T03:03:24.357 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000161798 2024-04-19T03:03:24.357 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:24.357 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:24.357 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:24.357 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.357 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.357 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4755.0:221399 5.f e64/22 5:f01a873b:::benchmark_data_smithi096_19531_object107949:head v 64'13690, mlcod=64'13687)", 2024-04-19T03:03:24.357 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:03:24.340517+0000", 2024-04-19T03:03:24.358 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0034475280000000001, 2024-04-19T03:03:24.358 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0035856299999999998, 2024-04-19T03:03:24.358 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:24.358 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-19T03:03:24.358 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:24.358 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.358 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:24.358 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:24.340517+0000", 2024-04-19T03:03:24.358 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:24.358 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.358 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.358 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:24.358 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:24.340517+0000", 2024-04-19T03:03:24.358 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:24.359 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.359 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.359 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:24.359 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:24.340516+0000", 2024-04-19T03:03:24.359 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:03:24.359 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.359 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.359 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:24.359 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:24.340523+0000", 2024-04-19T03:03:24.359 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5119999999999997e-06 2024-04-19T03:03:24.359 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.359 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.359 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:24.359 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:24.340536+0000", 2024-04-19T03:03:24.360 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2594e-05 2024-04-19T03:03:24.360 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.360 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.360 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:24.360 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:24.340542+0000", 2024-04-19T03:03:24.360 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.438e-06 2024-04-19T03:03:24.360 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.360 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.360 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:24.360 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:24.340574+0000", 2024-04-19T03:03:24.360 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2409000000000001e-05 2024-04-19T03:03:24.360 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.360 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.361 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:24.361 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:24.340597+0000", 2024-04-19T03:03:24.361 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3047000000000001e-05 2024-04-19T03:03:24.361 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:24.361 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:24.361 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:24.361 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.361 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.361 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:221401 5.a 5:538fb933:::benchmark_data_smithi096_19531_object107951:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-19T03:03:24.361 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:03:24.340714+0000", 2024-04-19T03:03:24.361 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0032507399999999998, 2024-04-19T03:03:24.361 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0034201290000000001, 2024-04-19T03:03:24.361 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:24.361 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-19T03:03:24.362 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:24.362 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:24.362 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:24.362 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 221401 2024-04-19T03:03:24.362 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.362 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:24.362 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.362 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:24.362 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:24.340714+0000", 2024-04-19T03:03:24.362 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:24.362 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.362 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.362 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:24.362 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:24.340714+0000", 2024-04-19T03:03:24.363 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:24.363 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.363 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.363 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:24.363 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:24.340713+0000", 2024-04-19T03:03:24.363 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:03:24.363 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.363 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.363 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:24.363 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:24.340723+0000", 2024-04-19T03:03:24.363 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.8239999999999995e-06 2024-04-19T03:03:24.363 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.363 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.363 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:24.364 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:24.340735+0000", 2024-04-19T03:03:24.364 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2096000000000001e-05 2024-04-19T03:03:24.364 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.364 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.364 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:24.364 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:24.340741+0000", 2024-04-19T03:03:24.364 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.268e-06 2024-04-19T03:03:24.364 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.364 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.364 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:24.364 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:24.342121+0000", 2024-04-19T03:03:24.364 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0013791579999999999 2024-04-19T03:03:24.364 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.365 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.365 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:24.365 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:24.342253+0000", 2024-04-19T03:03:24.365 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013255400000000001 2024-04-19T03:03:24.365 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:24.365 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:24.365 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:24.365 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.365 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.365 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:221402 5.a 5.53f4b60a (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-19T03:03:24.365 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:03:24.342054+0000", 2024-04-19T03:03:24.365 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0019107659999999999, 2024-04-19T03:03:24.365 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0021115600000000002, 2024-04-19T03:03:24.365 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:24.366 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-04-19T03:03:24.366 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:24.366 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:24.366 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:24.366 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 221402 2024-04-19T03:03:24.366 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.366 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:24.366 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.366 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:24.366 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:24.342054+0000", 2024-04-19T03:03:24.366 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:24.366 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.367 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.367 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:24.367 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:24.342054+0000", 2024-04-19T03:03:24.367 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:24.367 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.367 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.367 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:24.367 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:24.342053+0000", 2024-04-19T03:03:24.367 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:03:24.367 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.367 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.367 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:24.367 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:24.342059+0000", 2024-04-19T03:03:24.367 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0990000000000004e-06 2024-04-19T03:03:24.368 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.368 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.368 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:24.368 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:24.342069+0000", 2024-04-19T03:03:24.368 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0343000000000001e-05 2024-04-19T03:03:24.368 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.368 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.368 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:24.368 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:24.342077+0000", 2024-04-19T03:03:24.368 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2219999999999996e-06 2024-04-19T03:03:24.368 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:24.368 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:24.368 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:24.369 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.369 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.369 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4755.0:221394 5.9 e64/22 5:9e9b7bc7:::benchmark_data_smithi096_19531_object107944:head v 64'13545, mlcod=64'13542)", 2024-04-19T03:03:24.369 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:03:24.342085+0000", 2024-04-19T03:03:24.369 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0018801460000000001, 2024-04-19T03:03:24.369 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.002107687, 2024-04-19T03:03:24.369 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:24.369 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-19T03:03:24.369 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:24.369 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.369 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:24.369 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:24.342085+0000", 2024-04-19T03:03:24.369 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:24.369 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.370 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.370 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:24.370 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:24.342085+0000", 2024-04-19T03:03:24.370 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:24.370 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.370 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.370 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:24.370 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:24.342084+0000", 2024-04-19T03:03:24.370 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:03:24.370 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.370 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.370 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:24.370 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:24.342095+0000", 2024-04-19T03:03:24.370 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1080000000000001e-05 2024-04-19T03:03:24.371 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.371 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.371 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:24.371 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:24.342104+0000", 2024-04-19T03:03:24.371 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.431e-06 2024-04-19T03:03:24.371 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.371 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.371 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:24.371 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:24.342111+0000", 2024-04-19T03:03:24.371 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.0480000000000001e-06 2024-04-19T03:03:24.371 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.371 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.371 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:24.371 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:24.342154+0000", 2024-04-19T03:03:24.372 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2710000000000003e-05 2024-04-19T03:03:24.372 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.372 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.372 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:24.372 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:24.342172+0000", 2024-04-19T03:03:24.372 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.7537000000000002e-05 2024-04-19T03:03:24.372 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:24.372 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:24.372 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:24.372 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.372 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.372 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:221404 5.4 5:22bce613:::benchmark_data_smithi096_19531_object107954:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e64)", 2024-04-19T03:03:24.372 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:03:24.342772+0000", 2024-04-19T03:03:24.372 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.001193097, 2024-04-19T03:03:24.373 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001449962, 2024-04-19T03:03:24.373 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:24.373 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-19T03:03:24.373 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:24.373 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:24.373 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:24.373 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 221404 2024-04-19T03:03:24.373 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.373 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:24.373 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.373 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:24.373 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:24.342772+0000", 2024-04-19T03:03:24.373 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:24.373 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.374 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.374 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:24.374 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:24.342772+0000", 2024-04-19T03:03:24.374 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:24.374 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.374 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.374 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:24.374 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:24.342771+0000", 2024-04-19T03:03:24.374 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:03:24.374 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.374 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.374 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:24.374 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:24.342777+0000", 2024-04-19T03:03:24.374 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9689999999999999e-06 2024-04-19T03:03:24.375 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.375 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.375 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:24.375 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:24.342787+0000", 2024-04-19T03:03:24.375 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.9350000000000006e-06 2024-04-19T03:03:24.375 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.375 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.375 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:24.375 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:24.342794+0000", 2024-04-19T03:03:24.375 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.1890000000000001e-06 2024-04-19T03:03:24.375 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.375 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.375 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:24.375 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:24.342841+0000", 2024-04-19T03:03:24.375 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7085000000000001e-05 2024-04-19T03:03:24.376 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.376 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.376 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:24.376 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:24.342987+0000", 2024-04-19T03:03:24.376 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014608000000000001 2024-04-19T03:03:24.376 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:24.376 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:24.376 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:24.376 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.376 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.376 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4755.0:221405 5.f e64/22)", 2024-04-19T03:03:24.376 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:03:24.343185+0000", 2024-04-19T03:03:24.376 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.00078026899999999999, 2024-04-19T03:03:24.376 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0010730640000000001, 2024-04-19T03:03:24.377 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:24.377 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "queued for pg", 2024-04-19T03:03:24.377 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:24.377 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.377 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:24.377 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:24.343185+0000", 2024-04-19T03:03:24.377 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:24.377 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.377 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.377 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:24.377 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:24.343185+0000", 2024-04-19T03:03:24.377 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:24.377 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.377 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.378 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:24.378 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:24.343184+0000", 2024-04-19T03:03:24.378 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:03:24.378 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.378 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.378 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:24.378 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:24.343191+0000", 2024-04-19T03:03:24.378 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7939999999999997e-06 2024-04-19T03:03:24.378 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.378 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.378 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:24.378 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:24.343200+0000", 2024-04-19T03:03:24.378 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1500000000000005e-06 2024-04-19T03:03:24.378 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.379 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.379 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:24.379 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:24.343206+0000", 2024-04-19T03:03:24.379 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1480000000000003e-06 2024-04-19T03:03:24.379 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:24.379 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:24.379 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:24.379 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:24.379 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-04-19T03:03:24.379 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 9 2024-04-19T03:03:24.379 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-19T03:03:24.380 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T03:03:24.420 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:03:24.416+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:03:24.509 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-19T03:03:24.509 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-04-19T03:03:24.509 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-04-19T03:03:24.509 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-04-19T03:03:24.509 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-19T03:03:24.521 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:03:24.518+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:03:24.521 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T03:03:24.623 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:03:24.620+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:03:24.643 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-19T03:03:24.643 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-04-19T03:03:24.643 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-04-19T03:03:24.643 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-04-19T03:03:24.643 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.643 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:86615 5.e 5:7fef7288:::benchmark_data_smithi096_19531_object86614:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:24.643 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:22.634544+0000", 2024-04-19T03:03:24.643 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 62.006836905999997, 2024-04-19T03:03:24.644 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.192475071, 2024-04-19T03:03:24.644 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:24.644 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:24.644 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:24.644 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:24.644 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:24.644 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 86615 2024-04-19T03:03:24.644 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.644 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:24.644 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.644 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:24.644 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634544+0000", 2024-04-19T03:03:24.644 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:24.644 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.645 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.645 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:24.645 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634544+0000", 2024-04-19T03:03:24.645 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:24.645 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.645 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.645 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:24.645 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634542+0000", 2024-04-19T03:03:24.645 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999981 2024-04-19T03:03:24.645 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.646 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.646 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:24.646 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634585+0000", 2024-04-19T03:03:24.646 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2299000000000003e-05 2024-04-19T03:03:24.646 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.646 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.646 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:24.646 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634592+0000", 2024-04-19T03:03:24.646 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2350000000000002e-06 2024-04-19T03:03:24.646 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.646 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.646 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:24.646 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634596+0000", 2024-04-19T03:03:24.646 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5390000000000001e-06 2024-04-19T03:03:24.647 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.647 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.647 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:24.647 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634639+0000", 2024-04-19T03:03:24.647 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2444999999999998e-05 2024-04-19T03:03:24.647 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.647 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.647 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:24.647 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634808+0000", 2024-04-19T03:03:24.647 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000169152 2024-04-19T03:03:24.647 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.647 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.647 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:24.648 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634999+0000", 2024-04-19T03:03:24.648 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00019098300000000001 2024-04-19T03:03:24.648 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.648 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.648 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:24.648 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.640458+0000", 2024-04-19T03:03:24.648 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0054586870000000003 2024-04-19T03:03:24.648 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.648 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.648 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:24.648 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.826949+0000", 2024-04-19T03:03:24.648 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.18649178299999999 2024-04-19T03:03:24.648 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.648 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.649 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:03:24.649 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.826982+0000", 2024-04-19T03:03:24.649 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2477000000000001e-05 2024-04-19T03:03:24.649 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.649 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.649 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:24.649 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.827019+0000", 2024-04-19T03:03:24.649 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7355999999999999e-05 2024-04-19T03:03:24.649 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:24.649 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:24.649 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:24.649 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.649 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.649 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:86616 5.e 5:72278f47:::benchmark_data_smithi096_19531_object86615:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:24.650 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:22.634609+0000", 2024-04-19T03:03:24.650 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 62.006771757000003, 2024-04-19T03:03:24.650 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.19472088900000001, 2024-04-19T03:03:24.650 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:24.650 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:24.650 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:24.650 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:24.650 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:24.650 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 86616 2024-04-19T03:03:24.650 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.650 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:24.650 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.650 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:24.651 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634609+0000", 2024-04-19T03:03:24.651 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:24.651 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.651 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.651 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:24.651 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634609+0000", 2024-04-19T03:03:24.651 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:24.651 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.651 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.651 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:24.651 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634609+0000", 2024-04-19T03:03:24.651 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:24.651 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.652 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.652 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:24.652 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634651+0000", 2024-04-19T03:03:24.652 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2589000000000002e-05 2024-04-19T03:03:24.652 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.652 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.652 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:24.652 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634659+0000", 2024-04-19T03:03:24.652 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5850000000000002e-06 2024-04-19T03:03:24.652 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.652 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.652 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:24.652 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634662+0000", 2024-04-19T03:03:24.653 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3620000000000002e-06 2024-04-19T03:03:24.653 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.653 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.653 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:24.653 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.637880+0000", 2024-04-19T03:03:24.653 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.003218149 2024-04-19T03:03:24.653 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.653 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.653 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:24.653 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.637999+0000", 2024-04-19T03:03:24.653 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000118643 2024-04-19T03:03:24.653 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.653 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.653 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:24.654 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.638102+0000", 2024-04-19T03:03:24.654 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010331 2024-04-19T03:03:24.654 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.654 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.654 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:24.654 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.640851+0000", 2024-04-19T03:03:24.654 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0027483310000000001 2024-04-19T03:03:24.654 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.654 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.654 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:24.654 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.829269+0000", 2024-04-19T03:03:24.654 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.188418319 2024-04-19T03:03:24.654 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.655 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.655 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:03:24.655 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.829299+0000", 2024-04-19T03:03:24.655 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0227e-05 2024-04-19T03:03:24.655 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.655 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.655 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:24.655 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.829330+0000", 2024-04-19T03:03:24.655 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0969000000000001e-05 2024-04-19T03:03:24.655 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:24.655 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:24.655 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:24.655 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.655 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.656 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:86618 5.0 5:09014b90:::benchmark_data_smithi096_19531_object86617:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:24.656 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:22.634894+0000", 2024-04-19T03:03:24.656 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 62.006487268999997, 2024-04-19T03:03:24.656 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.19413419800000001, 2024-04-19T03:03:24.656 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:24.656 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:24.656 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:24.656 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:24.656 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:24.656 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 86618 2024-04-19T03:03:24.656 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.656 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:24.656 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.656 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:24.657 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634894+0000", 2024-04-19T03:03:24.657 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:24.657 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.657 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.657 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:24.657 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634894+0000", 2024-04-19T03:03:24.657 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:24.657 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.657 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.657 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:24.657 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634893+0000", 2024-04-19T03:03:24.657 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:03:24.657 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.657 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.658 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:24.658 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634976+0000", 2024-04-19T03:03:24.658 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3231000000000003e-05 2024-04-19T03:03:24.658 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.658 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.658 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:24.658 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634983+0000", 2024-04-19T03:03:24.658 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5169999999999996e-06 2024-04-19T03:03:24.658 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.658 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.658 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:24.658 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634987+0000", 2024-04-19T03:03:24.658 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.425e-06 2024-04-19T03:03:24.658 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.659 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.659 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:24.659 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635030+0000", 2024-04-19T03:03:24.659 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.32e-05 2024-04-19T03:03:24.659 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.659 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.659 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:24.659 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635185+0000", 2024-04-19T03:03:24.659 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015471899999999999 2024-04-19T03:03:24.659 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.659 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.659 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:24.659 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635415+0000", 2024-04-19T03:03:24.660 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00023026500000000001 2024-04-19T03:03:24.660 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.660 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.660 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:24.660 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.640127+0000", 2024-04-19T03:03:24.660 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0047118890000000004 2024-04-19T03:03:24.660 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.660 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.660 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:24.660 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.828895+0000", 2024-04-19T03:03:24.660 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.18876802600000001 2024-04-19T03:03:24.660 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.660 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.660 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:03:24.661 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.828972+0000", 2024-04-19T03:03:24.661 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.6345000000000002e-05 2024-04-19T03:03:24.661 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.661 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.661 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:24.661 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.829028+0000", 2024-04-19T03:03:24.661 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6342999999999999e-05 2024-04-19T03:03:24.661 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:24.661 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:24.661 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:24.661 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.661 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.661 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:86620 5.b 5:d80faa68:::benchmark_data_smithi096_19531_object86619:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:24.661 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:22.635110+0000", 2024-04-19T03:03:24.662 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 62.006270708999999, 2024-04-19T03:03:24.662 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.193447275, 2024-04-19T03:03:24.662 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:24.662 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:24.662 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:24.662 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:24.662 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:24.662 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 86620 2024-04-19T03:03:24.662 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.662 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:24.662 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.662 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:24.662 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635110+0000", 2024-04-19T03:03:24.662 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:24.663 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.663 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.663 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:24.663 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635110+0000", 2024-04-19T03:03:24.663 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:24.663 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.663 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.663 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:24.663 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635110+0000", 2024-04-19T03:03:24.663 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:24.663 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.663 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.663 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:24.663 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635154+0000", 2024-04-19T03:03:24.664 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4681000000000001e-05 2024-04-19T03:03:24.664 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.664 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.664 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:24.664 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635166+0000", 2024-04-19T03:03:24.664 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1505000000000001e-05 2024-04-19T03:03:24.664 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.664 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.664 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:24.664 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635171+0000", 2024-04-19T03:03:24.664 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6040000000000003e-06 2024-04-19T03:03:24.664 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.664 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.664 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:24.665 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635221+0000", 2024-04-19T03:03:24.665 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9947000000000001e-05 2024-04-19T03:03:24.665 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.665 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.665 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:24.665 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635356+0000", 2024-04-19T03:03:24.665 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013576199999999999 2024-04-19T03:03:24.665 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.665 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.665 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:24.665 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635507+0000", 2024-04-19T03:03:24.665 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015072999999999999 2024-04-19T03:03:24.665 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.665 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.666 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:24.666 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.638488+0000", 2024-04-19T03:03:24.666 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0029813159999999999 2024-04-19T03:03:24.666 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.666 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.666 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:24.666 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.828341+0000", 2024-04-19T03:03:24.666 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.189852254 2024-04-19T03:03:24.666 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.666 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.666 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:03:24.666 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.828416+0000", 2024-04-19T03:03:24.666 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5344000000000002e-05 2024-04-19T03:03:24.666 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.667 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.667 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:24.667 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.828558+0000", 2024-04-19T03:03:24.667 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000141695 2024-04-19T03:03:24.667 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:24.667 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:24.667 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:24.667 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.667 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.667 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:86621 5.8 5:1597a420:::benchmark_data_smithi096_19531_object86620:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:24.667 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:22.635187+0000", 2024-04-19T03:03:24.667 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 62.006193848999999, 2024-04-19T03:03:24.667 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.194204878, 2024-04-19T03:03:24.667 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:24.668 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:24.668 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:24.668 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:24.668 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:24.668 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 86621 2024-04-19T03:03:24.668 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.668 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:24.668 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.668 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:24.668 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635187+0000", 2024-04-19T03:03:24.668 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:24.668 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.668 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.668 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:24.668 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635187+0000", 2024-04-19T03:03:24.669 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:24.669 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.669 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.669 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:24.669 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635187+0000", 2024-04-19T03:03:24.669 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:24.669 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.669 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.669 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:24.669 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635242+0000", 2024-04-19T03:03:24.669 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5158000000000003e-05 2024-04-19T03:03:24.669 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.669 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.669 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:24.670 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635249+0000", 2024-04-19T03:03:24.670 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.7000000000000008e-06 2024-04-19T03:03:24.670 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.670 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.670 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:24.670 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635256+0000", 2024-04-19T03:03:24.670 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2060000000000004e-06 2024-04-19T03:03:24.670 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.670 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.670 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:24.670 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635302+0000", 2024-04-19T03:03:24.670 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5954000000000001e-05 2024-04-19T03:03:24.670 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.670 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.671 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:24.671 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635427+0000", 2024-04-19T03:03:24.671 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012559299999999999 2024-04-19T03:03:24.671 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.671 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.671 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:24.671 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635596+0000", 2024-04-19T03:03:24.671 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000168615 2024-04-19T03:03:24.671 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.671 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.672 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:24.672 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.639320+0000", 2024-04-19T03:03:24.672 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0037244610000000001 2024-04-19T03:03:24.672 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.672 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.672 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:24.672 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.829277+0000", 2024-04-19T03:03:24.672 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.18995651099999999 2024-04-19T03:03:24.672 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.672 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.672 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:03:24.672 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.829341+0000", 2024-04-19T03:03:24.672 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3756000000000004e-05 2024-04-19T03:03:24.672 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.673 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.673 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:24.673 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.829392+0000", 2024-04-19T03:03:24.673 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1555999999999999e-05 2024-04-19T03:03:24.673 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:24.673 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:24.673 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:24.673 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.673 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.673 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87067 5.b 5:d57af71a:::benchmark_data_smithi096_19531_object87066:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:24.673 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.142233+0000", 2024-04-19T03:03:24.673 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 61.499147985999997, 2024-04-19T03:03:24.673 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.071692405000000001, 2024-04-19T03:03:24.673 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:24.674 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:24.674 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:24.674 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:24.674 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:24.674 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87067 2024-04-19T03:03:24.674 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.674 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:24.674 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.674 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:24.674 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142233+0000", 2024-04-19T03:03:24.674 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:24.674 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.674 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.674 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:24.675 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142233+0000", 2024-04-19T03:03:24.675 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:24.675 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.675 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.675 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:24.675 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142232+0000", 2024-04-19T03:03:24.675 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:03:24.675 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.675 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.675 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:24.675 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142277+0000", 2024-04-19T03:03:24.675 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5837000000000002e-05 2024-04-19T03:03:24.675 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.675 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.676 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:24.676 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142297+0000", 2024-04-19T03:03:24.676 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9561000000000001e-05 2024-04-19T03:03:24.676 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.676 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.676 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:24.676 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142311+0000", 2024-04-19T03:03:24.676 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3654e-05 2024-04-19T03:03:24.676 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.676 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.676 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:24.676 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142391+0000", 2024-04-19T03:03:24.676 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0123999999999994e-05 2024-04-19T03:03:24.676 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.676 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.677 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:24.677 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142669+0000", 2024-04-19T03:03:24.677 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00027829800000000001 2024-04-19T03:03:24.677 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.677 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.677 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:24.677 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142859+0000", 2024-04-19T03:03:24.677 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000190051 2024-04-19T03:03:24.677 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.677 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.677 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:24.677 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.150597+0000", 2024-04-19T03:03:24.677 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0077380299999999999 2024-04-19T03:03:24.677 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.678 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.678 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:24.678 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.213855+0000", 2024-04-19T03:03:24.678 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.063257987000000002 2024-04-19T03:03:24.678 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.678 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.678 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:03:24.678 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.213898+0000", 2024-04-19T03:03:24.678 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2916e-05 2024-04-19T03:03:24.678 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.678 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.678 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:24.678 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.213925+0000", 2024-04-19T03:03:24.679 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7503000000000001e-05 2024-04-19T03:03:24.679 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:24.679 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:24.679 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:24.679 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.679 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.679 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87069 5.b 5:da0c93b5:::benchmark_data_smithi096_19531_object87068:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:24.679 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.143402+0000", 2024-04-19T03:03:24.679 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 61.497979024000003, 2024-04-19T03:03:24.679 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.070678598999999995, 2024-04-19T03:03:24.679 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:24.679 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:24.679 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:24.680 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:24.680 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:24.680 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87069 2024-04-19T03:03:24.680 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.680 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:24.680 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.680 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:24.680 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.143402+0000", 2024-04-19T03:03:24.680 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:24.680 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.680 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.680 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:24.680 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.143402+0000", 2024-04-19T03:03:24.680 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:24.681 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.681 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.681 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:24.681 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.143401+0000", 2024-04-19T03:03:24.681 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:03:24.681 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.681 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.681 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:24.681 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.143501+0000", 2024-04-19T03:03:24.681 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000100387 2024-04-19T03:03:24.681 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.681 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.681 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:24.681 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.143516+0000", 2024-04-19T03:03:24.682 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5369000000000001e-05 2024-04-19T03:03:24.682 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.682 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.682 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:24.682 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.143524+0000", 2024-04-19T03:03:24.682 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.7079999999999997e-06 2024-04-19T03:03:24.682 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.682 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.682 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:24.682 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.145550+0000", 2024-04-19T03:03:24.682 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0020259290000000001 2024-04-19T03:03:24.682 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.682 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.683 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:24.683 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.145676+0000", 2024-04-19T03:03:24.683 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000126406 2024-04-19T03:03:24.683 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.683 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.683 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:24.683 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.145802+0000", 2024-04-19T03:03:24.683 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000125974 2024-04-19T03:03:24.683 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.683 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.683 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:24.683 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.151030+0000", 2024-04-19T03:03:24.683 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0052276079999999999 2024-04-19T03:03:24.683 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.684 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.684 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:24.684 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.213998+0000", 2024-04-19T03:03:24.684 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.06296786 2024-04-19T03:03:24.684 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.684 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.684 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:03:24.684 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.214031+0000", 2024-04-19T03:03:24.684 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3387999999999999e-05 2024-04-19T03:03:24.684 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.684 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.684 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:24.684 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.214081+0000", 2024-04-19T03:03:24.684 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9316e-05 2024-04-19T03:03:24.684 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:24.685 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:24.685 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:24.685 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.685 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.685 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87108 5.e 5:7e197adc:::benchmark_data_smithi096_19531_object87107:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:24.685 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.223103+0000", 2024-04-19T03:03:24.685 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 61.418277687, 2024-04-19T03:03:24.685 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.044946887, 2024-04-19T03:03:24.685 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:24.685 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-19T03:03:24.685 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:24.685 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:24.685 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:24.685 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87108 2024-04-19T03:03:24.686 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.686 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:24.686 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.686 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:24.686 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.223103+0000", 2024-04-19T03:03:24.686 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:24.686 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.686 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.686 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:24.686 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.223103+0000", 2024-04-19T03:03:24.686 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:24.686 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.686 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.687 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:24.687 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.223102+0000", 2024-04-19T03:03:24.687 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:03:24.687 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.687 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.687 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:24.687 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.223156+0000", 2024-04-19T03:03:24.687 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3958000000000001e-05 2024-04-19T03:03:24.687 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.687 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.687 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:24.687 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.223166+0000", 2024-04-19T03:03:24.687 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.4809999999999995e-06 2024-04-19T03:03:24.687 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.687 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.688 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:24.688 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.223172+0000", 2024-04-19T03:03:24.688 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0140000000000004e-06 2024-04-19T03:03:24.688 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.688 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.688 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:24.688 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.227295+0000", 2024-04-19T03:03:24.688 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0041233420000000003 2024-04-19T03:03:24.688 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.688 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.688 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:24.688 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.227495+0000", 2024-04-19T03:03:24.688 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00019955299999999999 2024-04-19T03:03:24.688 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.689 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.689 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:24.689 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.227717+0000", 2024-04-19T03:03:24.689 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000221902 2024-04-19T03:03:24.689 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.689 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.689 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:24.689 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233189+0000", 2024-04-19T03:03:24.689 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0054718889999999997 2024-04-19T03:03:24.689 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.689 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.689 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:24.689 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.250529+0000", 2024-04-19T03:03:24.689 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.017340298000000001 2024-04-19T03:03:24.690 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.690 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.690 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:03:24.690 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.250539+0000", 2024-04-19T03:03:24.690 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0501e-05 2024-04-19T03:03:24.690 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.690 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.690 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:24.690 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.268003+0000", 2024-04-19T03:03:24.690 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.017463429 2024-04-19T03:03:24.690 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.690 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.690 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:24.690 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.268050+0000", 2024-04-19T03:03:24.690 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7466000000000003e-05 2024-04-19T03:03:24.691 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:24.691 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:24.691 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:24.691 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.691 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.691 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87118 5.b 5:d1bb4f3c:::benchmark_data_smithi096_19531_object87117:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:24.691 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.231082+0000", 2024-04-19T03:03:24.691 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 61.410298853, 2024-04-19T03:03:24.691 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.035789004, 2024-04-19T03:03:24.691 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:24.691 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-19T03:03:24.691 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:24.691 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:24.691 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:24.692 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87118 2024-04-19T03:03:24.692 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.692 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:24.692 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.692 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:24.692 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231082+0000", 2024-04-19T03:03:24.692 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:24.692 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.692 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.692 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:24.692 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231082+0000", 2024-04-19T03:03:24.692 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:24.692 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.692 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.692 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:24.693 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231081+0000", 2024-04-19T03:03:24.693 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:03:24.693 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.693 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.693 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:24.693 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231159+0000", 2024-04-19T03:03:24.693 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.7819999999999997e-05 2024-04-19T03:03:24.693 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.693 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.693 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:24.693 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231186+0000", 2024-04-19T03:03:24.693 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7126000000000001e-05 2024-04-19T03:03:24.693 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.694 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.694 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:24.694 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231193+0000", 2024-04-19T03:03:24.694 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7259999999999996e-06 2024-04-19T03:03:24.694 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.694 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.694 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:24.694 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231241+0000", 2024-04-19T03:03:24.694 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8123e-05 2024-04-19T03:03:24.694 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.694 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.695 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:24.695 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231354+0000", 2024-04-19T03:03:24.695 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0001133 2024-04-19T03:03:24.695 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.695 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.695 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:24.695 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231443+0000", 2024-04-19T03:03:24.695 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9167999999999997e-05 2024-04-19T03:03:24.695 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.695 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.695 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:24.695 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236498+0000", 2024-04-19T03:03:24.695 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0050545160000000002 2024-04-19T03:03:24.695 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.696 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.696 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:24.696 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.249681+0000", 2024-04-19T03:03:24.696 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013183321 2024-04-19T03:03:24.696 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.696 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.696 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:03:24.696 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.249693+0000", 2024-04-19T03:03:24.696 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1834999999999999e-05 2024-04-19T03:03:24.696 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.696 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.696 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:24.697 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266733+0000", 2024-04-19T03:03:24.697 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.017040408 2024-04-19T03:03:24.697 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.697 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.697 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:24.697 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266871+0000", 2024-04-19T03:03:24.697 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000137849 2024-04-19T03:03:24.697 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:24.697 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:24.697 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:24.697 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.697 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.697 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87121 5.b 5:d01822b8:::benchmark_data_smithi096_19531_object87120:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:24.697 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.233319+0000", 2024-04-19T03:03:24.698 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 61.408061988999997, 2024-04-19T03:03:24.698 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.033624198, 2024-04-19T03:03:24.698 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:24.698 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-19T03:03:24.698 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:24.698 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:24.698 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:24.698 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87121 2024-04-19T03:03:24.698 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.699 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:24.699 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.699 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:24.699 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233319+0000", 2024-04-19T03:03:24.699 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:24.699 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.699 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.699 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:24.699 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233319+0000", 2024-04-19T03:03:24.699 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:24.699 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.699 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.699 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:24.699 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233319+0000", 2024-04-19T03:03:24.699 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:24.700 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.700 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.700 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:24.700 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233364+0000", 2024-04-19T03:03:24.700 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5460999999999997e-05 2024-04-19T03:03:24.700 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.700 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.700 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:24.700 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233382+0000", 2024-04-19T03:03:24.700 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8148e-05 2024-04-19T03:03:24.700 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.700 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.700 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:24.700 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233390+0000", 2024-04-19T03:03:24.701 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5340000000000002e-06 2024-04-19T03:03:24.701 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.701 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.701 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:24.701 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233712+0000", 2024-04-19T03:03:24.701 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00032260500000000001 2024-04-19T03:03:24.701 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.701 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.701 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:24.701 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233829+0000", 2024-04-19T03:03:24.701 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011638599999999999 2024-04-19T03:03:24.701 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.701 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.701 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:24.702 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233959+0000", 2024-04-19T03:03:24.702 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013013900000000001 2024-04-19T03:03:24.702 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.702 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.702 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:24.702 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236515+0000", 2024-04-19T03:03:24.702 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0025562750000000002 2024-04-19T03:03:24.702 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.702 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.702 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:24.702 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.249723+0000", 2024-04-19T03:03:24.702 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013208176 2024-04-19T03:03:24.702 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.702 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.703 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:03:24.703 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.249728+0000", 2024-04-19T03:03:24.703 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6519999999999997e-06 2024-04-19T03:03:24.703 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.703 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.703 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:24.703 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266837+0000", 2024-04-19T03:03:24.703 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0171087059999999 2024-04-19T03:03:24.703 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.703 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.703 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:24.703 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266943+0000", 2024-04-19T03:03:24.703 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000106604 2024-04-19T03:03:24.703 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:24.704 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:24.704 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:24.704 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.704 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.704 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87124 5.8 5:14819ad7:::benchmark_data_smithi096_19531_object87123:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:24.704 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.235886+0000", 2024-04-19T03:03:24.704 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 61.405494564999998, 2024-04-19T03:03:24.704 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0315451179999999, 2024-04-19T03:03:24.704 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:24.704 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-19T03:03:24.704 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:24.705 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:24.705 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:24.705 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87124 2024-04-19T03:03:24.705 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.705 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:24.705 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.705 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:24.705 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.235886+0000", 2024-04-19T03:03:24.705 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:24.705 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.705 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.705 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:24.705 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.235886+0000", 2024-04-19T03:03:24.705 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:24.705 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.706 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.706 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:24.706 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.235886+0000", 2024-04-19T03:03:24.706 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:03:24.706 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.706 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.706 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:24.706 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.235934+0000", 2024-04-19T03:03:24.706 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8384000000000003e-05 2024-04-19T03:03:24.706 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.706 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.706 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:24.706 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.235945+0000", 2024-04-19T03:03:24.707 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0671e-05 2024-04-19T03:03:24.707 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.707 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.707 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:24.707 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.235952+0000", 2024-04-19T03:03:24.707 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3089999999999998e-06 2024-04-19T03:03:24.707 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.707 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.707 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:24.707 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.237067+0000", 2024-04-19T03:03:24.707 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001115263 2024-04-19T03:03:24.707 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.707 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.707 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:24.708 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.237188+0000", 2024-04-19T03:03:24.708 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000121258 2024-04-19T03:03:24.708 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.708 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.708 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:24.708 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.237316+0000", 2024-04-19T03:03:24.708 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000128071 2024-04-19T03:03:24.708 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.708 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.708 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:24.708 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240744+0000", 2024-04-19T03:03:24.708 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0034275629999999998 2024-04-19T03:03:24.708 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.708 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.709 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:24.709 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.252517+0000", 2024-04-19T03:03:24.709 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011772991999999999 2024-04-19T03:03:24.709 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.709 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.709 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:03:24.709 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.252523+0000", 2024-04-19T03:03:24.709 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3640000000000004e-06 2024-04-19T03:03:24.709 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.709 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.709 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:24.709 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.267290+0000", 2024-04-19T03:03:24.709 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0147665690000001 2024-04-19T03:03:24.709 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.710 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.710 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:24.710 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.267432+0000", 2024-04-19T03:03:24.710 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014165299999999999 2024-04-19T03:03:24.710 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:24.710 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:24.710 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:24.710 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.710 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.710 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87129 5.0 5:02667e01:::benchmark_data_smithi096_19531_object87128:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:24.710 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.236466+0000", 2024-04-19T03:03:24.710 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 61.404914568999999, 2024-04-19T03:03:24.710 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0301534510000001, 2024-04-19T03:03:24.710 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:24.711 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-19T03:03:24.711 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:24.711 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:24.711 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:24.711 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87129 2024-04-19T03:03:24.711 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.711 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:24.711 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.711 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:24.711 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236466+0000", 2024-04-19T03:03:24.711 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:24.711 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.711 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.711 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:24.711 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236466+0000", 2024-04-19T03:03:24.712 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:24.712 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.712 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.712 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:24.712 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236465+0000", 2024-04-19T03:03:24.712 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:03:24.712 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.712 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.712 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:24.712 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236566+0000", 2024-04-19T03:03:24.712 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010047000000000001 2024-04-19T03:03:24.712 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.712 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.712 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:24.713 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236577+0000", 2024-04-19T03:03:24.713 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1772e-05 2024-04-19T03:03:24.713 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.713 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.713 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:24.713 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236584+0000", 2024-04-19T03:03:24.713 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0530000000000003e-06 2024-04-19T03:03:24.713 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.713 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.713 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:24.713 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.237023+0000", 2024-04-19T03:03:24.713 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000439703 2024-04-19T03:03:24.713 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.713 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.714 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:24.714 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.237207+0000", 2024-04-19T03:03:24.714 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000183692 2024-04-19T03:03:24.714 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.714 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.714 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:24.714 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.237373+0000", 2024-04-19T03:03:24.714 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016623500000000001 2024-04-19T03:03:24.714 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.714 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.714 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:24.714 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.241461+0000", 2024-04-19T03:03:24.714 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0040883050000000004 2024-04-19T03:03:24.715 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.715 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.715 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:24.715 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.252500+0000", 2024-04-19T03:03:24.715 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011038450999999999 2024-04-19T03:03:24.715 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.715 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.715 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:03:24.715 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.252507+0000", 2024-04-19T03:03:24.715 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2439999999999996e-06 2024-04-19T03:03:24.715 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.715 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.715 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:24.715 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266538+0000", 2024-04-19T03:03:24.715 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.014031184 2024-04-19T03:03:24.716 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.716 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.716 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:24.716 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266620+0000", 2024-04-19T03:03:24.716 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1600000000000005e-05 2024-04-19T03:03:24.716 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:24.716 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:24.716 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:24.716 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.716 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.716 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87135 5.4 5:2a97e7b7:::benchmark_data_smithi096_19531_object87134:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:24.716 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.240884+0000", 2024-04-19T03:03:24.716 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 61.400497111999996, 2024-04-19T03:03:24.716 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.025708931, 2024-04-19T03:03:24.717 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:24.717 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-19T03:03:24.717 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:24.717 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:24.717 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:24.717 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87135 2024-04-19T03:03:24.717 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.717 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:24.717 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.717 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:24.717 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240884+0000", 2024-04-19T03:03:24.717 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:24.717 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.718 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.718 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:24.718 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240884+0000", 2024-04-19T03:03:24.718 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:24.718 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.718 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.718 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:24.718 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240883+0000", 2024-04-19T03:03:24.718 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:03:24.718 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.718 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.718 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:24.718 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240933+0000", 2024-04-19T03:03:24.718 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9969999999999998e-05 2024-04-19T03:03:24.719 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.719 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.719 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:24.719 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240946+0000", 2024-04-19T03:03:24.719 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2943e-05 2024-04-19T03:03:24.719 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.719 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.719 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:24.719 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240952+0000", 2024-04-19T03:03:24.719 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8930000000000002e-06 2024-04-19T03:03:24.719 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.719 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.719 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:24.720 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240994+0000", 2024-04-19T03:03:24.720 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2753999999999998e-05 2024-04-19T03:03:24.720 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.720 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.720 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:24.720 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.241092+0000", 2024-04-19T03:03:24.720 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.7447000000000004e-05 2024-04-19T03:03:24.720 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.720 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.720 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:24.720 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.241183+0000", 2024-04-19T03:03:24.720 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1163999999999997e-05 2024-04-19T03:03:24.720 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.720 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.720 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:24.721 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.254672+0000", 2024-04-19T03:03:24.721 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.01348864 2024-04-19T03:03:24.721 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.721 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.721 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:03:24.721 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.254681+0000", 2024-04-19T03:03:24.721 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.3789999999999995e-06 2024-04-19T03:03:24.721 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.721 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.721 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:24.721 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266456+0000", 2024-04-19T03:03:24.721 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.011774621 2024-04-19T03:03:24.721 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.721 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.722 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:24.722 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266593+0000", 2024-04-19T03:03:24.722 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013737600000000001 2024-04-19T03:03:24.722 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:24.722 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:24.722 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:24.722 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.722 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.722 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87136 5.4 5:212411bc:::benchmark_data_smithi096_19531_object87135:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:24.722 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.240962+0000", 2024-04-19T03:03:24.722 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 61.400419235999998, 2024-04-19T03:03:24.722 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.025738, 2024-04-19T03:03:24.722 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:24.722 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-19T03:03:24.723 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:24.723 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:24.723 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:24.723 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87136 2024-04-19T03:03:24.723 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.723 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:24.723 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.723 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:24.723 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240962+0000", 2024-04-19T03:03:24.723 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:24.723 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.723 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.723 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:24.723 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240962+0000", 2024-04-19T03:03:24.724 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:24.724 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.724 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.724 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:24.724 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240961+0000", 2024-04-19T03:03:24.724 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:24.724 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.724 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.724 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:24.724 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240995+0000", 2024-04-19T03:03:24.724 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3868000000000002e-05 2024-04-19T03:03:24.724 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.724 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.725 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:24.725 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.241001+0000", 2024-04-19T03:03:24.725 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.322e-06 2024-04-19T03:03:24.725 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.725 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.725 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:24.725 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.241004+0000", 2024-04-19T03:03:24.725 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3510000000000002e-06 2024-04-19T03:03:24.725 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.725 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.725 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:24.725 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247131+0000", 2024-04-19T03:03:24.725 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0061270869999999998 2024-04-19T03:03:24.725 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.726 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.726 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:24.726 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247322+0000", 2024-04-19T03:03:24.726 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000191015 2024-04-19T03:03:24.726 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.726 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.726 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:24.726 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247542+0000", 2024-04-19T03:03:24.726 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00022030199999999999 2024-04-19T03:03:24.726 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.726 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.726 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:24.726 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.254709+0000", 2024-04-19T03:03:24.727 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0071662660000000001 2024-04-19T03:03:24.727 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.727 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.727 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:03:24.727 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.254716+0000", 2024-04-19T03:03:24.727 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3860000000000001e-06 2024-04-19T03:03:24.727 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.727 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.727 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:24.727 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266619+0000", 2024-04-19T03:03:24.727 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0119031030000001 2024-04-19T03:03:24.727 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.727 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.727 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:24.727 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266700+0000", 2024-04-19T03:03:24.728 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0764000000000001e-05 2024-04-19T03:03:24.728 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:24.728 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:24.728 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:24.728 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.728 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.728 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87138 5.e 5:7b1f1c20:::benchmark_data_smithi096_19531_object87137:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:24.728 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.247862+0000", 2024-04-19T03:03:24.728 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 61.393519161999997, 2024-04-19T03:03:24.728 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.024457079, 2024-04-19T03:03:24.728 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:24.728 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:24.728 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:24.728 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:24.729 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:24.729 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87138 2024-04-19T03:03:24.729 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.729 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:24.729 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.729 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:24.729 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247862+0000", 2024-04-19T03:03:24.729 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:24.729 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.729 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.729 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:24.729 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247862+0000", 2024-04-19T03:03:24.729 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:24.729 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.729 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.730 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:24.730 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247860+0000", 2024-04-19T03:03:24.730 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999981 2024-04-19T03:03:24.730 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.730 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.730 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:24.730 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247909+0000", 2024-04-19T03:03:24.730 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9150999999999997e-05 2024-04-19T03:03:24.730 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.730 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.730 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:24.730 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247925+0000", 2024-04-19T03:03:24.730 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5761999999999999e-05 2024-04-19T03:03:24.730 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.731 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.731 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:24.731 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247936+0000", 2024-04-19T03:03:24.731 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1144e-05 2024-04-19T03:03:24.731 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.731 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.731 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:24.731 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.250590+0000", 2024-04-19T03:03:24.731 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.002653678 2024-04-19T03:03:24.731 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.731 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.731 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:03:24.731 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.250599+0000", 2024-04-19T03:03:24.731 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9039999999999998e-06 2024-04-19T03:03:24.731 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.732 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.732 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:24.732 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.268151+0000", 2024-04-19T03:03:24.732 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0175523449999999 2024-04-19T03:03:24.732 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.732 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.732 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:24.732 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.268285+0000", 2024-04-19T03:03:24.732 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013415599999999999 2024-04-19T03:03:24.732 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.732 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.732 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:24.732 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.272238+0000", 2024-04-19T03:03:24.732 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0039533019999999997 2024-04-19T03:03:24.733 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.733 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.733 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:03:24.733 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.272274+0000", 2024-04-19T03:03:24.733 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5352000000000003e-05 2024-04-19T03:03:24.733 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.733 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.733 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:24.733 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.272319+0000", 2024-04-19T03:03:24.733 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5281999999999998e-05 2024-04-19T03:03:24.733 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:24.733 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:24.733 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:24.733 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.734 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.734 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:158371 5.8 5:11a83024:::benchmark_data_smithi096_19531_object44921:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-19T03:03:24.734 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:58.125869+0000", 2024-04-19T03:03:24.734 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 26.515512297000001, 2024-04-19T03:03:24.734 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074532857999999994, 2024-04-19T03:03:24.734 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:24.734 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:24.734 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:24.734 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:24.734 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:24.734 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 158371 2024-04-19T03:03:24.734 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.734 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:24.735 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.735 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:24.735 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125869+0000", 2024-04-19T03:03:24.735 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:24.735 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.735 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.735 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:24.735 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125869+0000", 2024-04-19T03:03:24.735 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:24.735 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.735 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.735 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:24.736 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125868+0000", 2024-04-19T03:03:24.736 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:03:24.736 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.736 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.736 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:24.736 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125874+0000", 2024-04-19T03:03:24.736 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7120000000000003e-06 2024-04-19T03:03:24.736 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.736 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.736 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:24.736 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125885+0000", 2024-04-19T03:03:24.736 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0665999999999999e-05 2024-04-19T03:03:24.736 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.737 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.737 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:24.737 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125901+0000", 2024-04-19T03:03:24.737 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6463000000000001e-05 2024-04-19T03:03:24.737 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.737 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.737 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:24.737 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125956+0000", 2024-04-19T03:03:24.737 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4728000000000002e-05 2024-04-19T03:03:24.737 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.737 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.737 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:24.737 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.126050+0000", 2024-04-19T03:03:24.738 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.3534000000000003e-05 2024-04-19T03:03:24.738 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.738 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.738 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:24.738 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.200187+0000", 2024-04-19T03:03:24.738 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074136933000000002 2024-04-19T03:03:24.738 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.738 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.738 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:03:24.738 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.200260+0000", 2024-04-19T03:03:24.738 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3090999999999995e-05 2024-04-19T03:03:24.738 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.738 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.739 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:24.739 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.200402+0000", 2024-04-19T03:03:24.739 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014193699999999999 2024-04-19T03:03:24.739 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:24.739 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:24.739 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:24.739 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.739 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.739 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:158372 5.0 5:0473aa5f:::benchmark_data_smithi096_19531_object44922:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-19T03:03:24.739 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:58.125924+0000", 2024-04-19T03:03:24.739 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 26.515456690000001, 2024-04-19T03:03:24.739 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074247490999999999, 2024-04-19T03:03:24.739 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:24.739 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:24.739 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:24.740 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:24.740 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:24.740 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 158372 2024-04-19T03:03:24.740 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.740 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:24.740 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.740 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:24.740 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125924+0000", 2024-04-19T03:03:24.740 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:24.740 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.740 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.740 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:24.740 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125924+0000", 2024-04-19T03:03:24.740 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:24.741 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.741 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.741 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:24.741 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125924+0000", 2024-04-19T03:03:24.741 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:24.741 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.741 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.741 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:24.741 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125927+0000", 2024-04-19T03:03:24.741 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5389999999999999e-06 2024-04-19T03:03:24.741 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.741 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.741 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:24.741 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125935+0000", 2024-04-19T03:03:24.742 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3259999999999998e-06 2024-04-19T03:03:24.742 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.742 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.742 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:24.742 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125940+0000", 2024-04-19T03:03:24.742 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6980000000000003e-06 2024-04-19T03:03:24.742 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.742 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.742 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:24.742 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125982+0000", 2024-04-19T03:03:24.742 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1337000000000001e-05 2024-04-19T03:03:24.742 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.743 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.743 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:24.743 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.126075+0000", 2024-04-19T03:03:24.743 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.3579999999999995e-05 2024-04-19T03:03:24.743 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.743 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.743 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:24.743 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.199953+0000", 2024-04-19T03:03:24.743 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073877604999999999 2024-04-19T03:03:24.743 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.743 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.743 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:03:24.743 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.200022+0000", 2024-04-19T03:03:24.743 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.8824000000000004e-05 2024-04-19T03:03:24.744 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.744 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.744 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:24.744 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.200172+0000", 2024-04-19T03:03:24.744 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015017700000000001 2024-04-19T03:03:24.744 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:24.744 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:24.744 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:24.744 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.744 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.744 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:158374 5.e 5:76be57a5:::benchmark_data_smithi096_19531_object44924:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-19T03:03:24.744 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:58.125988+0000", 2024-04-19T03:03:24.744 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 26.515393191000001, 2024-04-19T03:03:24.744 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.067843332000000006, 2024-04-19T03:03:24.744 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:24.744 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:24.745 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:24.745 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:24.745 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:24.745 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 158374 2024-04-19T03:03:24.745 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.745 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:24.745 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.745 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:24.745 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125988+0000", 2024-04-19T03:03:24.745 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:24.745 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.745 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.745 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:24.745 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125988+0000", 2024-04-19T03:03:24.745 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:24.746 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.746 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.746 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:24.746 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125987+0000", 2024-04-19T03:03:24.746 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:24.746 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.746 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.747 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:24.747 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125990+0000", 2024-04-19T03:03:24.747 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7989999999999998e-06 2024-04-19T03:03:24.747 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.747 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.747 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:24.747 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125996+0000", 2024-04-19T03:03:24.747 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.302e-06 2024-04-19T03:03:24.747 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.747 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.747 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:24.747 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.126001+0000", 2024-04-19T03:03:24.747 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.843e-06 2024-04-19T03:03:24.747 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.748 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.748 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:24.748 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.126047+0000", 2024-04-19T03:03:24.748 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6066000000000002e-05 2024-04-19T03:03:24.748 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.748 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.748 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:24.748 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.126171+0000", 2024-04-19T03:03:24.749 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012359099999999999 2024-04-19T03:03:24.749 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.749 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.749 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:24.749 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.193709+0000", 2024-04-19T03:03:24.749 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.067538099000000004 2024-04-19T03:03:24.750 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.750 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.750 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:03:24.750 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.193766+0000", 2024-04-19T03:03:24.750 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6869e-05 2024-04-19T03:03:24.750 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.750 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.750 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:24.750 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.193831+0000", 2024-04-19T03:03:24.750 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5273999999999999e-05 2024-04-19T03:03:24.750 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:24.750 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:24.750 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:24.751 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.751 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.751 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4755.0:158376 5.9 e56/22 5:9e73c076:::benchmark_data_smithi096_19531_object44926:head v 56'9663, mlcod=56'9661)", 2024-04-19T03:03:24.751 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:58.127307+0000", 2024-04-19T03:03:24.751 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 26.514073960000001, 2024-04-19T03:03:24.751 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069002716000000006, 2024-04-19T03:03:24.751 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:24.751 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:24.751 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:24.751 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.751 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:24.751 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.127307+0000", 2024-04-19T03:03:24.751 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:24.751 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.752 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.752 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:24.752 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.127307+0000", 2024-04-19T03:03:24.752 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:24.752 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.752 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.752 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:24.752 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.127306+0000", 2024-04-19T03:03:24.752 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:03:24.752 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.752 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.752 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:24.752 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.127316+0000", 2024-04-19T03:03:24.752 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.3039999999999994e-06 2024-04-19T03:03:24.753 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.753 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.753 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:24.753 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.127326+0000", 2024-04-19T03:03:24.753 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0009e-05 2024-04-19T03:03:24.753 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.753 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.753 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:24.753 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.127332+0000", 2024-04-19T03:03:24.753 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5880000000000003e-06 2024-04-19T03:03:24.753 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.753 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.753 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:24.753 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.127383+0000", 2024-04-19T03:03:24.754 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0516000000000002e-05 2024-04-19T03:03:24.754 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.754 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.754 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:24.754 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.127403+0000", 2024-04-19T03:03:24.754 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0547000000000002e-05 2024-04-19T03:03:24.754 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.754 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.755 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:03:24.755 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.196280+0000", 2024-04-19T03:03:24.755 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.068876863999999996 2024-04-19T03:03:24.755 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.755 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.755 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:24.755 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.196310+0000", 2024-04-19T03:03:24.755 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9762999999999999e-05 2024-04-19T03:03:24.755 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:24.756 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:24.756 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:24.756 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.756 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.756 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:158383 5.0 5:026717eb:::benchmark_data_smithi096_19531_object44933:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-19T03:03:24.756 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:58.130494+0000", 2024-04-19T03:03:24.756 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 26.510886834000001, 2024-04-19T03:03:24.756 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.070135775999999997, 2024-04-19T03:03:24.756 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:24.756 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:24.756 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:24.756 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:24.756 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:24.757 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 158383 2024-04-19T03:03:24.757 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.757 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:24.757 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.757 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:24.757 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.130494+0000", 2024-04-19T03:03:24.757 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:24.757 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.757 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.757 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:24.757 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.130494+0000", 2024-04-19T03:03:24.757 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:24.757 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.757 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.757 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:24.758 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.130493+0000", 2024-04-19T03:03:24.758 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:03:24.758 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.758 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.758 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:24.758 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.130500+0000", 2024-04-19T03:03:24.758 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5490000000000003e-06 2024-04-19T03:03:24.758 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.758 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.758 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:24.758 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.190401+0000", 2024-04-19T03:03:24.758 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.059901668999999998 2024-04-19T03:03:24.758 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.759 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.759 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:24.759 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.190421+0000", 2024-04-19T03:03:24.759 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0288e-05 2024-04-19T03:03:24.759 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.759 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.759 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:24.759 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.190536+0000", 2024-04-19T03:03:24.759 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000114783 2024-04-19T03:03:24.759 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.759 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.759 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:24.759 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.190904+0000", 2024-04-19T03:03:24.759 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00036773900000000001 2024-04-19T03:03:24.759 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.760 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.760 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:24.760 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.200417+0000", 2024-04-19T03:03:24.760 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0095128899999999995 2024-04-19T03:03:24.760 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.760 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.760 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:03:24.760 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.200489+0000", 2024-04-19T03:03:24.761 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2554999999999999e-05 2024-04-19T03:03:24.761 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:24.761 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:24.761 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:24.761 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.200630+0000", 2024-04-19T03:03:24.761 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014055299999999999 2024-04-19T03:03:24.761 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:24.761 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:24.761 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:24.761 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:24.761 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:24.761 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-19T03:03:24.763 INFO:teuthology.orchestra.run.smithi096.stderr:noscrub is set 2024-04-19T03:03:24.764 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T03:03:24.764 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:03:24.758+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:03:24.863 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:03:24.860+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:03:24.890 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-04-19T03:03:24.890 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [ 2024-04-19T03:03:24.890 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.890 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:222682 5.3 5:cfee9ddf:::benchmark_data_smithi096_19531_object109232:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-19T03:03:24.890 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:03:24.883177+0000", 2024-04-19T03:03:24.890 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.006559451, 2024-04-19T03:03:24.890 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.006578151, 2024-04-19T03:03:24.890 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:24.891 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-04-19T03:03:24.891 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:24.891 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:24.891 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:24.891 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 222682 2024-04-19T03:03:24.891 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.891 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:24.891 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.891 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:24.891 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:24.883177+0000", 2024-04-19T03:03:24.891 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:24.891 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.891 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.891 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:24.892 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:24.883177+0000", 2024-04-19T03:03:24.892 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:24.892 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.892 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.892 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:24.892 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:24.883176+0000", 2024-04-19T03:03:24.892 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:24.892 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.892 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.892 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:24.892 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:24.883179+0000", 2024-04-19T03:03:24.892 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9960000000000002e-06 2024-04-19T03:03:24.892 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.892 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.893 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:24.893 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:24.883186+0000", 2024-04-19T03:03:24.893 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2720000000000003e-06 2024-04-19T03:03:24.893 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.893 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.893 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:24.893 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:24.883191+0000", 2024-04-19T03:03:24.893 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4450000000000004e-06 2024-04-19T03:03:24.893 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.893 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.893 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:24.893 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:24.883227+0000", 2024-04-19T03:03:24.893 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6368000000000001e-05 2024-04-19T03:03:24.893 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.894 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.894 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:24.894 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:24.883351+0000", 2024-04-19T03:03:24.894 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000123433 2024-04-19T03:03:24.894 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:24.894 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:24.894 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:24.894 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.894 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.894 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:222684 5.1 5:80962f5f:::benchmark_data_smithi096_19531_object109234:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-19T03:03:24.894 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:03:24.883238+0000", 2024-04-19T03:03:24.894 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0064984910000000003, 2024-04-19T03:03:24.894 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0065586660000000003, 2024-04-19T03:03:24.894 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:24.895 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-04-19T03:03:24.895 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:24.895 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:24.895 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:24.895 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 222684 2024-04-19T03:03:24.895 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.895 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:24.895 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.895 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:24.895 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:24.883238+0000", 2024-04-19T03:03:24.895 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:24.895 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.895 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.896 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:24.896 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:24.883238+0000", 2024-04-19T03:03:24.896 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:24.896 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.896 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.896 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:24.896 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:24.883237+0000", 2024-04-19T03:03:24.896 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:24.897 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.897 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.897 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:24.897 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:24.883241+0000", 2024-04-19T03:03:24.897 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.32e-06 2024-04-19T03:03:24.897 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.897 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.897 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:24.898 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:24.883247+0000", 2024-04-19T03:03:24.898 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2430000000000002e-06 2024-04-19T03:03:24.898 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.898 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.898 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:24.898 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:24.883252+0000", 2024-04-19T03:03:24.898 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7770000000000002e-06 2024-04-19T03:03:24.898 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.899 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.899 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:24.899 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:24.884846+0000", 2024-04-19T03:03:24.899 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001594437 2024-04-19T03:03:24.899 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.899 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.899 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:24.899 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:24.884990+0000", 2024-04-19T03:03:24.899 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00014383500000000001 2024-04-19T03:03:24.899 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:24.899 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:24.899 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:24.899 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.899 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.899 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:222685 5.5 5:acd488c1:::benchmark_data_smithi096_19531_object109235:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-19T03:03:24.900 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:03:24.883260+0000", 2024-04-19T03:03:24.900 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.006476903, 2024-04-19T03:03:24.900 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0065860459999999999, 2024-04-19T03:03:24.900 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:24.900 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-04-19T03:03:24.900 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:24.900 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:24.900 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:24.900 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 222685 2024-04-19T03:03:24.900 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.900 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:24.900 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.900 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:24.900 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:24.883260+0000", 2024-04-19T03:03:24.901 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:24.901 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.901 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.901 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:24.901 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:24.883260+0000", 2024-04-19T03:03:24.901 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:24.901 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.901 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.901 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:24.901 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:24.883259+0000", 2024-04-19T03:03:24.901 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:24.901 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.901 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.901 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:24.901 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:24.883262+0000", 2024-04-19T03:03:24.902 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.8930000000000001e-06 2024-04-19T03:03:24.902 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.902 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.902 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:24.902 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:24.883270+0000", 2024-04-19T03:03:24.902 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8150000000000006e-06 2024-04-19T03:03:24.902 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.902 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.902 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:24.902 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:24.883276+0000", 2024-04-19T03:03:24.902 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9390000000000002e-06 2024-04-19T03:03:24.902 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.902 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.903 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:24.903 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:24.884615+0000", 2024-04-19T03:03:24.903 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00133898 2024-04-19T03:03:24.903 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.903 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.903 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:24.903 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:24.884829+0000", 2024-04-19T03:03:24.903 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00021422699999999999 2024-04-19T03:03:24.903 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:24.903 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:24.903 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:24.903 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.903 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.903 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:222686 5.1 5:83e29a57:::benchmark_data_smithi096_19531_object109236:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-19T03:03:24.903 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:03:24.883284+0000", 2024-04-19T03:03:24.904 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0064527439999999998, 2024-04-19T03:03:24.904 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0065978349999999998, 2024-04-19T03:03:24.904 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:24.904 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-04-19T03:03:24.904 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:24.904 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:24.904 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:24.904 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 222686 2024-04-19T03:03:24.904 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.904 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:24.904 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.904 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:24.904 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:24.883284+0000", 2024-04-19T03:03:24.904 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:24.904 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.905 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.905 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:24.905 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:24.883284+0000", 2024-04-19T03:03:24.905 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:24.905 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.905 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.905 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:24.905 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:24.883283+0000", 2024-04-19T03:03:24.905 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:24.905 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.905 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.905 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:24.905 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:24.883286+0000", 2024-04-19T03:03:24.905 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.8710000000000001e-06 2024-04-19T03:03:24.906 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.906 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.906 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:24.906 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:24.883293+0000", 2024-04-19T03:03:24.906 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4269999999999996e-06 2024-04-19T03:03:24.906 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.906 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.906 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:24.907 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:24.883298+0000", 2024-04-19T03:03:24.907 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.344e-06 2024-04-19T03:03:24.907 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.907 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.907 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:24.907 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:24.886921+0000", 2024-04-19T03:03:24.907 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0036233820000000001 2024-04-19T03:03:24.907 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.907 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.907 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:24.908 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:24.887066+0000", 2024-04-19T03:03:24.908 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00014495 2024-04-19T03:03:24.908 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:24.908 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:24.908 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:24.909 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.909 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.909 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:222687 5.5 5:a588867b:::benchmark_data_smithi096_19531_object109237:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-19T03:03:24.909 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:03:24.883611+0000", 2024-04-19T03:03:24.909 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0061250740000000003, 2024-04-19T03:03:24.909 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0063066509999999999, 2024-04-19T03:03:24.909 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:24.909 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-04-19T03:03:24.909 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:24.909 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:24.909 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:24.909 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 222687 2024-04-19T03:03:24.909 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.910 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:24.910 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.910 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:24.910 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:24.883611+0000", 2024-04-19T03:03:24.910 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:24.910 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.910 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.910 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:24.910 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:24.883611+0000", 2024-04-19T03:03:24.911 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:24.911 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.911 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.911 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:24.911 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:24.883611+0000", 2024-04-19T03:03:24.911 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:03:24.911 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.911 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.911 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:24.911 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:24.883615+0000", 2024-04-19T03:03:24.911 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1699999999999999e-06 2024-04-19T03:03:24.911 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.911 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.911 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:24.912 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:24.883623+0000", 2024-04-19T03:03:24.912 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2519999999999999e-06 2024-04-19T03:03:24.912 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.912 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.912 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:24.912 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:24.883629+0000", 2024-04-19T03:03:24.912 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.4420000000000003e-06 2024-04-19T03:03:24.912 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.912 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.912 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:24.912 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:24.886649+0000", 2024-04-19T03:03:24.912 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0030197599999999998 2024-04-19T03:03:24.912 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.912 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.913 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:24.913 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:24.886736+0000", 2024-04-19T03:03:24.913 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.7041999999999998e-05 2024-04-19T03:03:24.913 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:24.913 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:24.913 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:24.913 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.913 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.913 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:222691 5.c 5:38ff2cf9:::benchmark_data_smithi096_19531_object109241:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-19T03:03:24.913 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:03:24.888649+0000", 2024-04-19T03:03:24.913 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0010870820000000001, 2024-04-19T03:03:24.913 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001304319, 2024-04-19T03:03:24.913 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:24.913 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-04-19T03:03:24.914 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:24.914 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:24.914 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:24.914 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 222691 2024-04-19T03:03:24.914 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.914 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:24.914 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.914 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:24.914 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:24.888649+0000", 2024-04-19T03:03:24.914 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:24.914 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.914 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.914 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:24.914 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:24.888649+0000", 2024-04-19T03:03:24.915 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:24.915 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.915 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.915 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:24.915 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:24.888648+0000", 2024-04-19T03:03:24.915 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999986 2024-04-19T03:03:24.915 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.915 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.915 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:24.915 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:24.888654+0000", 2024-04-19T03:03:24.915 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2639999999999997e-06 2024-04-19T03:03:24.915 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.915 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.915 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:24.916 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:24.888670+0000", 2024-04-19T03:03:24.916 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.6263e-05 2024-04-19T03:03:24.916 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.916 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.916 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:24.916 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:24.888682+0000", 2024-04-19T03:03:24.916 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1195e-05 2024-04-19T03:03:24.916 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.916 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.916 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:24.916 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:24.888767+0000", 2024-04-19T03:03:24.916 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4995999999999997e-05 2024-04-19T03:03:24.916 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:24.916 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:24.917 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:24.917 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:24.888901+0000", 2024-04-19T03:03:24.917 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00013412600000000001 2024-04-19T03:03:24.917 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:24.917 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:24.917 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:24.917 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:24.917 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-04-19T03:03:24.918 INFO:teuthology.orchestra.run.smithi144.stdout: "num_ops": 6 2024-04-19T03:03:24.918 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-04-19T03:03:24.919 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T03:03:24.964 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:03:24.962+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:03:25.043 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-04-19T03:03:25.044 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2024-04-19T03:03:25.044 INFO:teuthology.orchestra.run.smithi144.stdout: "complaint_time": 30, 2024-04-19T03:03:25.044 INFO:teuthology.orchestra.run.smithi144.stdout: "num_blocked_ops": 0 2024-04-19T03:03:25.044 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-04-19T03:03:25.058 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T03:03:25.064 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:03:25.060+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:03:25.166 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:03:25.162+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:03:25.187 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-04-19T03:03:25.187 INFO:teuthology.orchestra.run.smithi144.stdout: "size": 20, 2024-04-19T03:03:25.187 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 600, 2024-04-19T03:03:25.187 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [ 2024-04-19T03:03:25.187 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.187 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:78992 5.7 5:e6baa862:::benchmark_data_smithi096_19531_object78991:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-19T03:03:25.187 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:18.008888+0000", 2024-04-19T03:03:25.187 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 67.175007325999999, 2024-04-19T03:03:25.188 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.056375285999999997, 2024-04-19T03:03:25.188 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:25.188 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:25.188 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:25.188 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:25.188 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:25.188 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 78992 2024-04-19T03:03:25.188 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.188 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:25.188 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.188 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:25.188 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.008888+0000", 2024-04-19T03:03:25.188 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:25.189 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.189 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.189 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:25.189 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.008888+0000", 2024-04-19T03:03:25.189 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:25.189 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.189 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.189 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:25.190 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.008888+0000", 2024-04-19T03:03:25.190 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:25.190 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.190 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.190 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:25.190 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.008928+0000", 2024-04-19T03:03:25.190 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0361999999999997e-05 2024-04-19T03:03:25.190 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.190 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.190 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:25.190 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.008942+0000", 2024-04-19T03:03:25.190 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4365000000000001e-05 2024-04-19T03:03:25.191 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.191 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.191 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:25.191 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.008949+0000", 2024-04-19T03:03:25.191 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.212e-06 2024-04-19T03:03:25.191 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.191 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.191 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:25.191 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.012683+0000", 2024-04-19T03:03:25.191 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.003733934 2024-04-19T03:03:25.191 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.191 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.191 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:25.192 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.012798+0000", 2024-04-19T03:03:25.192 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00011574999999999999 2024-04-19T03:03:25.192 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.192 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.192 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:25.192 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.012896+0000", 2024-04-19T03:03:25.192 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.7848000000000002e-05 2024-04-19T03:03:25.192 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.192 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.192 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:03:25.192 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016423+0000", 2024-04-19T03:03:25.192 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0035270789999999998 2024-04-19T03:03:25.192 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.193 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.193 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:25.193 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.065098+0000", 2024-04-19T03:03:25.193 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.048674651999999999 2024-04-19T03:03:25.193 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.193 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.193 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:03:25.193 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.065193+0000", 2024-04-19T03:03:25.193 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.5087999999999995e-05 2024-04-19T03:03:25.193 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.193 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.193 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:25.194 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.065264+0000", 2024-04-19T03:03:25.194 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0666000000000004e-05 2024-04-19T03:03:25.194 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:25.194 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:25.194 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:25.194 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.194 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.194 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4755.0:79003 5.2 e40/39 5:4436e33f:::benchmark_data_smithi096_19531_object79002:head v 40'4935, mlcod=40'4932)", 2024-04-19T03:03:25.194 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:18.018102+0000", 2024-04-19T03:03:25.194 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 67.165793269999995, 2024-04-19T03:03:25.194 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.060023990999999999, 2024-04-19T03:03:25.194 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:25.195 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:25.195 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:25.195 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.195 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:25.195 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018102+0000", 2024-04-19T03:03:25.195 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:25.195 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.195 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.195 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:25.195 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018102+0000", 2024-04-19T03:03:25.195 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:25.195 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.196 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.196 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:25.196 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018102+0000", 2024-04-19T03:03:25.196 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:25.196 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.196 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.196 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:25.196 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018134+0000", 2024-04-19T03:03:25.196 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2722000000000003e-05 2024-04-19T03:03:25.196 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.196 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.196 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:25.196 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018145+0000", 2024-04-19T03:03:25.196 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0395e-05 2024-04-19T03:03:25.197 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.197 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.197 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:25.197 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018151+0000", 2024-04-19T03:03:25.197 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5300000000000002e-06 2024-04-19T03:03:25.197 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.197 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.197 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:25.197 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018489+0000", 2024-04-19T03:03:25.197 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00033731499999999998 2024-04-19T03:03:25.197 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.197 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.197 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:25.198 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018508+0000", 2024-04-19T03:03:25.198 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9775e-05 2024-04-19T03:03:25.198 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.198 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.198 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:03:25.198 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.078059+0000", 2024-04-19T03:03:25.198 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.059550171999999998 2024-04-19T03:03:25.198 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.198 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.198 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:25.198 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.078126+0000", 2024-04-19T03:03:25.198 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7773000000000003e-05 2024-04-19T03:03:25.198 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:25.199 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:25.199 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:25.199 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.199 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.199 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:86612 5.7 5:e32e3c49:::benchmark_data_smithi096_19531_object86611:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:25.199 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:22.633560+0000", 2024-04-19T03:03:25.199 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 62.550335609999998, 2024-04-19T03:03:25.199 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.19135289, 2024-04-19T03:03:25.199 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:25.199 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:25.199 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:25.199 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:25.199 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:25.199 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 86612 2024-04-19T03:03:25.200 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.200 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:25.200 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.200 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:25.200 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633560+0000", 2024-04-19T03:03:25.200 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:25.200 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.200 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.200 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:25.200 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633560+0000", 2024-04-19T03:03:25.200 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:25.200 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.200 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.201 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:25.201 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633558+0000", 2024-04-19T03:03:25.201 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999986 2024-04-19T03:03:25.201 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.201 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.201 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:25.201 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633609+0000", 2024-04-19T03:03:25.201 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0850999999999998e-05 2024-04-19T03:03:25.201 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.201 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.201 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:25.201 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633627+0000", 2024-04-19T03:03:25.201 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7951000000000001e-05 2024-04-19T03:03:25.201 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.202 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.202 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:25.202 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633635+0000", 2024-04-19T03:03:25.202 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2530000000000004e-06 2024-04-19T03:03:25.202 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.202 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.202 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:25.202 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633699+0000", 2024-04-19T03:03:25.202 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3901999999999999e-05 2024-04-19T03:03:25.202 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.202 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.202 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:25.202 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633992+0000", 2024-04-19T03:03:25.203 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00029283299999999999 2024-04-19T03:03:25.203 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.203 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.203 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:25.203 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.634223+0000", 2024-04-19T03:03:25.203 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00023084200000000001 2024-04-19T03:03:25.203 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.203 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.203 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:03:25.203 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.639085+0000", 2024-04-19T03:03:25.203 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0048624269999999999 2024-04-19T03:03:25.203 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.203 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.203 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:25.203 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.824635+0000", 2024-04-19T03:03:25.203 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.18554944700000001 2024-04-19T03:03:25.204 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.204 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.204 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:03:25.204 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.824793+0000", 2024-04-19T03:03:25.204 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000157959 2024-04-19T03:03:25.204 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.204 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.204 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:25.204 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.824913+0000", 2024-04-19T03:03:25.204 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000120093 2024-04-19T03:03:25.204 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:25.204 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:25.204 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:25.204 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.204 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.205 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:86625 5.7 5:e6d00488:::benchmark_data_smithi096_19531_object86624:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:25.205 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:22.643554+0000", 2024-04-19T03:03:25.205 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 62.540341843999997, 2024-04-19T03:03:25.205 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.18732841, 2024-04-19T03:03:25.205 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:25.205 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:25.205 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:25.205 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:25.205 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:25.205 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 86625 2024-04-19T03:03:25.205 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.206 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:25.206 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.206 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:25.206 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643554+0000", 2024-04-19T03:03:25.206 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:25.206 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.206 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.206 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:25.206 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643554+0000", 2024-04-19T03:03:25.206 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:25.207 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.207 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.207 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:25.207 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643552+0000", 2024-04-19T03:03:25.207 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999986 2024-04-19T03:03:25.207 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.207 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.207 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:25.207 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643588+0000", 2024-04-19T03:03:25.207 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5855999999999997e-05 2024-04-19T03:03:25.207 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.208 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.208 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:25.208 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643606+0000", 2024-04-19T03:03:25.208 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8226000000000001e-05 2024-04-19T03:03:25.208 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.208 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.208 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:25.208 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643618+0000", 2024-04-19T03:03:25.208 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1868000000000001e-05 2024-04-19T03:03:25.208 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.209 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.209 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:25.209 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643676+0000", 2024-04-19T03:03:25.209 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8153999999999999e-05 2024-04-19T03:03:25.209 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.209 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.209 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:25.209 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643905+0000", 2024-04-19T03:03:25.209 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00022847500000000001 2024-04-19T03:03:25.209 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.209 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.210 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:25.210 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.644150+0000", 2024-04-19T03:03:25.210 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00024531800000000001 2024-04-19T03:03:25.210 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.210 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.210 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:03:25.210 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.647407+0000", 2024-04-19T03:03:25.210 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0032563190000000001 2024-04-19T03:03:25.210 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.210 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.210 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:25.210 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.830721+0000", 2024-04-19T03:03:25.210 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.18331468300000001 2024-04-19T03:03:25.211 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.211 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.211 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:03:25.211 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.830813+0000", 2024-04-19T03:03:25.211 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.2205000000000002e-05 2024-04-19T03:03:25.211 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.211 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.211 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:25.211 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.830882+0000", 2024-04-19T03:03:25.211 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8819999999999995e-05 2024-04-19T03:03:25.211 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:25.211 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:25.211 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:25.211 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.211 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.212 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87063 5.7 5:e502e824:::benchmark_data_smithi096_19531_object87062:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:25.212 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.136067+0000", 2024-04-19T03:03:25.212 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 62.047828975000002, 2024-04-19T03:03:25.212 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.065521159999999995, 2024-04-19T03:03:25.212 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:25.212 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:25.212 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:25.212 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:25.212 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:25.212 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87063 2024-04-19T03:03:25.212 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.212 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:25.212 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.212 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:25.213 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.136067+0000", 2024-04-19T03:03:25.213 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:25.213 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.213 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.213 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:25.213 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.136067+0000", 2024-04-19T03:03:25.213 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:25.213 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.213 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.213 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:25.213 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.136066+0000", 2024-04-19T03:03:25.213 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:03:25.213 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.213 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.213 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:25.214 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.136154+0000", 2024-04-19T03:03:25.214 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.8256000000000003e-05 2024-04-19T03:03:25.214 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.214 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.214 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:25.214 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.136162+0000", 2024-04-19T03:03:25.214 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.5099999999999998e-06 2024-04-19T03:03:25.214 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.214 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.214 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:25.214 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.136171+0000", 2024-04-19T03:03:25.214 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2830000000000001e-06 2024-04-19T03:03:25.214 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.215 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.215 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:25.215 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.138421+0000", 2024-04-19T03:03:25.215 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0022506620000000001 2024-04-19T03:03:25.215 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.215 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.215 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:25.215 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.138560+0000", 2024-04-19T03:03:25.215 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000138446 2024-04-19T03:03:25.215 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.215 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.215 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:25.215 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.138689+0000", 2024-04-19T03:03:25.216 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00012950700000000001 2024-04-19T03:03:25.216 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.216 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.216 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:03:25.216 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.141517+0000", 2024-04-19T03:03:25.216 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0028280860000000001 2024-04-19T03:03:25.216 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.216 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.216 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:25.216 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.201350+0000", 2024-04-19T03:03:25.216 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.059832418999999998 2024-04-19T03:03:25.216 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.216 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.217 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:03:25.217 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.201485+0000", 2024-04-19T03:03:25.217 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000135597 2024-04-19T03:03:25.217 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.217 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.217 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:25.217 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.201588+0000", 2024-04-19T03:03:25.217 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00010247900000000001 2024-04-19T03:03:25.217 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:25.217 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:25.217 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:25.217 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.217 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.217 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87072 5.7 5:e3c7809a:::benchmark_data_smithi096_19531_object87071:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:25.218 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.144224+0000", 2024-04-19T03:03:25.218 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 62.039671951000003, 2024-04-19T03:03:25.218 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.058179555000000001, 2024-04-19T03:03:25.218 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:25.218 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:25.218 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:25.218 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:25.218 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:25.218 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87072 2024-04-19T03:03:25.218 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.218 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:25.218 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.218 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:25.219 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144224+0000", 2024-04-19T03:03:25.219 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:25.219 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.219 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.219 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:25.219 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144224+0000", 2024-04-19T03:03:25.219 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:25.219 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.219 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.219 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:25.219 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144223+0000", 2024-04-19T03:03:25.219 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:03:25.219 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.220 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.220 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:25.220 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144320+0000", 2024-04-19T03:03:25.220 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.7075000000000001e-05 2024-04-19T03:03:25.220 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.220 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.220 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:25.220 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144331+0000", 2024-04-19T03:03:25.220 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1342000000000001e-05 2024-04-19T03:03:25.220 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.220 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.220 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:25.220 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144337+0000", 2024-04-19T03:03:25.220 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8390000000000003e-06 2024-04-19T03:03:25.221 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.221 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.221 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:25.221 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144369+0000", 2024-04-19T03:03:25.221 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2079000000000002e-05 2024-04-19T03:03:25.221 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.221 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.221 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:25.221 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144464+0000", 2024-04-19T03:03:25.221 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.4623000000000005e-05 2024-04-19T03:03:25.221 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.221 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.221 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:25.222 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144553+0000", 2024-04-19T03:03:25.222 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9171000000000004e-05 2024-04-19T03:03:25.222 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.222 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.222 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:03:25.222 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.147018+0000", 2024-04-19T03:03:25.222 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0024648370000000001 2024-04-19T03:03:25.222 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.222 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.222 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:25.222 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.202270+0000", 2024-04-19T03:03:25.222 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.055252018 2024-04-19T03:03:25.222 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.223 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.223 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:03:25.223 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.202356+0000", 2024-04-19T03:03:25.223 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6648000000000001e-05 2024-04-19T03:03:25.223 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.223 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.223 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:25.223 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.202403+0000", 2024-04-19T03:03:25.223 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6956999999999998e-05 2024-04-19T03:03:25.223 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:25.223 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:25.223 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:25.223 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.224 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.224 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87123 5.6 5:6d1bc3b9:::benchmark_data_smithi096_19531_object87122:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:03:25.224 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249233+0000", 2024-04-19T03:03:25.224 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 61.934662918999997, 2024-04-19T03:03:25.224 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0291700720000001, 2024-04-19T03:03:25.224 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:25.224 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-04-19T03:03:25.224 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:25.224 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:25.224 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:25.224 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87123 2024-04-19T03:03:25.224 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.225 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:25.225 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.225 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:25.225 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249233+0000", 2024-04-19T03:03:25.225 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:25.225 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.225 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.225 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:25.225 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249233+0000", 2024-04-19T03:03:25.225 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:25.225 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.225 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.226 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:25.226 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249231+0000", 2024-04-19T03:03:25.226 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999986 2024-04-19T03:03:25.226 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.226 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.226 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:25.226 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249285+0000", 2024-04-19T03:03:25.226 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4005000000000002e-05 2024-04-19T03:03:25.226 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.226 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.226 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:25.226 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249300+0000", 2024-04-19T03:03:25.226 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4715999999999999e-05 2024-04-19T03:03:25.227 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.227 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.227 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:25.227 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249307+0000", 2024-04-19T03:03:25.227 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8399999999999997e-06 2024-04-19T03:03:25.227 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.227 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.227 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:25.227 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249366+0000", 2024-04-19T03:03:25.227 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9435999999999998e-05 2024-04-19T03:03:25.227 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.227 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.227 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op must wait for map", 2024-04-19T03:03:25.228 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249376+0000", 2024-04-19T03:03:25.228 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.4919999999999999e-06 2024-04-19T03:03:25.228 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.228 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.228 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:25.228 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263757+0000", 2024-04-19T03:03:25.228 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.014381461999999999 2024-04-19T03:03:25.228 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.228 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.228 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:03:25.228 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263875+0000", 2024-04-19T03:03:25.228 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000117166 2024-04-19T03:03:25.228 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.229 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.229 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:25.229 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.277136+0000", 2024-04-19T03:03:25.229 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.013261207 2024-04-19T03:03:25.229 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.229 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.229 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:25.229 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.278403+0000", 2024-04-19T03:03:25.229 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001267106 2024-04-19T03:03:25.229 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:25.229 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:25.229 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:25.229 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.229 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.230 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87128 5.6 5:6905c420:::benchmark_data_smithi096_19531_object87127:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:03:25.230 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249323+0000", 2024-04-19T03:03:25.230 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 61.934572172000003, 2024-04-19T03:03:25.230 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0292813249999999, 2024-04-19T03:03:25.230 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:25.230 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-04-19T03:03:25.230 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:25.230 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:25.230 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:25.230 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87128 2024-04-19T03:03:25.230 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.230 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:25.231 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.231 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:25.231 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249323+0000", 2024-04-19T03:03:25.231 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:25.231 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.231 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.231 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:25.231 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249323+0000", 2024-04-19T03:03:25.231 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:25.231 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.231 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.231 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:25.232 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249323+0000", 2024-04-19T03:03:25.232 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:25.232 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.232 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.232 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:25.232 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249385+0000", 2024-04-19T03:03:25.232 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1711999999999995e-05 2024-04-19T03:03:25.232 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.232 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.232 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:25.232 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249398+0000", 2024-04-19T03:03:25.232 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3022e-05 2024-04-19T03:03:25.232 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.233 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.233 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:25.233 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249402+0000", 2024-04-19T03:03:25.233 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4819999999999996e-06 2024-04-19T03:03:25.233 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.233 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.233 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:25.233 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249437+0000", 2024-04-19T03:03:25.233 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4702000000000001e-05 2024-04-19T03:03:25.233 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.233 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.233 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:03:25.233 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249442+0000", 2024-04-19T03:03:25.233 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8019999999999999e-06 2024-04-19T03:03:25.233 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.233 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.234 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:25.234 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263896+0000", 2024-04-19T03:03:25.234 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.014454679999999999 2024-04-19T03:03:25.234 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.234 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.234 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:03:25.234 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263900+0000", 2024-04-19T03:03:25.234 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9700000000000001e-06 2024-04-19T03:03:25.234 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.234 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.234 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:25.234 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.278557+0000", 2024-04-19T03:03:25.234 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0146566480000001 2024-04-19T03:03:25.235 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.235 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.235 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:25.235 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.278605+0000", 2024-04-19T03:03:25.235 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7735999999999998e-05 2024-04-19T03:03:25.235 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:25.235 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:25.235 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:25.235 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.235 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.235 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87130 5.3 5:c8c2d67b:::benchmark_data_smithi096_19531_object87129:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:03:25.235 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249418+0000", 2024-04-19T03:03:25.236 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 61.934477461, 2024-04-19T03:03:25.236 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.025414182, 2024-04-19T03:03:25.236 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:25.236 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-04-19T03:03:25.236 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:25.236 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:25.236 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:25.236 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87130 2024-04-19T03:03:25.236 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.236 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:25.236 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.236 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:25.236 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249418+0000", 2024-04-19T03:03:25.236 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:25.237 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.237 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.237 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:25.237 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249418+0000", 2024-04-19T03:03:25.237 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:25.237 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.237 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.237 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:25.237 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249409+0000", 2024-04-19T03:03:25.237 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999905 2024-04-19T03:03:25.237 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.237 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.237 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:25.238 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249464+0000", 2024-04-19T03:03:25.238 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5381999999999999e-05 2024-04-19T03:03:25.238 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.238 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.238 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:25.238 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249471+0000", 2024-04-19T03:03:25.238 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2609999999999996e-06 2024-04-19T03:03:25.238 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.238 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.238 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:25.238 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249475+0000", 2024-04-19T03:03:25.238 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2839999999999998e-06 2024-04-19T03:03:25.238 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.238 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.239 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:25.239 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249535+0000", 2024-04-19T03:03:25.239 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0545999999999999e-05 2024-04-19T03:03:25.239 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.239 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.239 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op must wait for map", 2024-04-19T03:03:25.239 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249540+0000", 2024-04-19T03:03:25.239 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2859999999999999e-06 2024-04-19T03:03:25.239 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.239 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.239 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:25.240 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263450+0000", 2024-04-19T03:03:25.240 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.013909585 2024-04-19T03:03:25.240 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.240 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.240 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:03:25.240 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263458+0000", 2024-04-19T03:03:25.240 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8089999999999993e-06 2024-04-19T03:03:25.240 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.240 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.240 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:25.240 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.273193+0000", 2024-04-19T03:03:25.240 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0097351379999999 2024-04-19T03:03:25.240 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.241 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.241 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:25.241 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.274832+0000", 2024-04-19T03:03:25.241 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0016394789999999999 2024-04-19T03:03:25.241 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:25.241 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:25.241 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:25.241 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.241 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.241 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87131 5.1 5:83756d55:::benchmark_data_smithi096_19531_object87130:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:03:25.241 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249491+0000", 2024-04-19T03:03:25.241 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 61.934404813999997, 2024-04-19T03:03:25.242 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0191489520000001, 2024-04-19T03:03:25.242 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:25.242 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-04-19T03:03:25.242 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:25.242 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:25.242 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:25.242 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87131 2024-04-19T03:03:25.242 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.242 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:25.242 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.242 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:25.242 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249491+0000", 2024-04-19T03:03:25.243 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:25.243 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.243 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.243 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:25.243 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249491+0000", 2024-04-19T03:03:25.243 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:25.243 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.243 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.243 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:25.243 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249491+0000", 2024-04-19T03:03:25.243 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:25.243 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.243 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.244 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:25.244 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249530+0000", 2024-04-19T03:03:25.244 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9589000000000003e-05 2024-04-19T03:03:25.244 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.244 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.244 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:25.244 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249544+0000", 2024-04-19T03:03:25.244 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4158000000000001e-05 2024-04-19T03:03:25.244 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.244 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.244 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:25.244 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249549+0000", 2024-04-19T03:03:25.244 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6809999999999997e-06 2024-04-19T03:03:25.244 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.244 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.245 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:25.245 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249592+0000", 2024-04-19T03:03:25.245 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3285999999999999e-05 2024-04-19T03:03:25.245 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.245 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.245 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op must wait for map", 2024-04-19T03:03:25.245 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249598+0000", 2024-04-19T03:03:25.245 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8329999999999999e-06 2024-04-19T03:03:25.245 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.245 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.245 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:25.245 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263331+0000", 2024-04-19T03:03:25.245 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.013733093 2024-04-19T03:03:25.246 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.246 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.246 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:03:25.246 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263343+0000", 2024-04-19T03:03:25.246 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.189e-05 2024-04-19T03:03:25.246 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.246 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.246 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:25.246 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.268541+0000", 2024-04-19T03:03:25.246 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0051983440000001 2024-04-19T03:03:25.246 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.246 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.246 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:25.247 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.268640+0000", 2024-04-19T03:03:25.247 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.8387999999999994e-05 2024-04-19T03:03:25.247 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:25.247 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:25.247 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:25.247 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.247 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.247 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87132 5.c 5:3e18b732:::benchmark_data_smithi096_19531_object87131:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:03:25.247 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249558+0000", 2024-04-19T03:03:25.247 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 61.934337913, 2024-04-19T03:03:25.247 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0241198380000001, 2024-04-19T03:03:25.247 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:25.247 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-04-19T03:03:25.248 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:25.248 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:25.248 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:25.248 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87132 2024-04-19T03:03:25.248 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.248 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:25.248 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.248 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:25.248 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249558+0000", 2024-04-19T03:03:25.248 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:25.248 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.248 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.248 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:25.248 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249558+0000", 2024-04-19T03:03:25.249 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:25.249 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.249 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.249 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:25.249 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249557+0000", 2024-04-19T03:03:25.249 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:25.249 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.249 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.249 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:25.249 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249625+0000", 2024-04-19T03:03:25.249 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7200999999999996e-05 2024-04-19T03:03:25.249 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.250 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.250 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:25.250 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249646+0000", 2024-04-19T03:03:25.250 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1053e-05 2024-04-19T03:03:25.250 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.250 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.250 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:25.250 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249650+0000", 2024-04-19T03:03:25.250 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2719999999999999e-06 2024-04-19T03:03:25.250 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.250 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.250 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:25.251 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249686+0000", 2024-04-19T03:03:25.251 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6430000000000002e-05 2024-04-19T03:03:25.251 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.251 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.251 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op must wait for map", 2024-04-19T03:03:25.251 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249690+0000", 2024-04-19T03:03:25.251 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.765e-06 2024-04-19T03:03:25.251 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.251 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.251 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:25.251 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261157+0000", 2024-04-19T03:03:25.251 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011467247999999999 2024-04-19T03:03:25.251 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.251 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.252 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:03:25.252 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261170+0000", 2024-04-19T03:03:25.252 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2833000000000001e-05 2024-04-19T03:03:25.252 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.252 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.252 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:25.252 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.272119+0000", 2024-04-19T03:03:25.252 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.010949313 2024-04-19T03:03:25.252 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.252 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.252 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:25.252 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.273678+0000", 2024-04-19T03:03:25.252 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0015581550000000001 2024-04-19T03:03:25.252 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:25.252 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:25.253 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:25.253 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.253 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.253 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87133 5.c 5:3f772a62:::benchmark_data_smithi096_19531_object87132:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:03:25.253 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249657+0000", 2024-04-19T03:03:25.253 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 61.934238534000002, 2024-04-19T03:03:25.253 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0242819409999999, 2024-04-19T03:03:25.253 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:25.253 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-04-19T03:03:25.253 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:25.253 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:25.253 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:25.253 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87133 2024-04-19T03:03:25.253 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.254 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:25.254 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.254 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:25.254 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249657+0000", 2024-04-19T03:03:25.254 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:25.254 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.254 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.254 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:25.254 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249657+0000", 2024-04-19T03:03:25.254 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:25.254 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.254 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.254 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:25.255 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249657+0000", 2024-04-19T03:03:25.255 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:25.255 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.255 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.255 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:25.255 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249690+0000", 2024-04-19T03:03:25.255 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3343000000000002e-05 2024-04-19T03:03:25.255 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.255 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.255 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:25.255 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249695+0000", 2024-04-19T03:03:25.255 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8600000000000001e-06 2024-04-19T03:03:25.255 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.255 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.256 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:25.256 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249698+0000", 2024-04-19T03:03:25.256 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.1700000000000001e-06 2024-04-19T03:03:25.256 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.256 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.256 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:25.256 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249741+0000", 2024-04-19T03:03:25.256 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2849999999999998e-05 2024-04-19T03:03:25.256 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.256 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.256 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:03:25.256 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249746+0000", 2024-04-19T03:03:25.256 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1019999999999996e-06 2024-04-19T03:03:25.257 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.257 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.257 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:25.257 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261209+0000", 2024-04-19T03:03:25.257 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011462447000000001 2024-04-19T03:03:25.257 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.257 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.257 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:03:25.257 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261216+0000", 2024-04-19T03:03:25.257 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8520000000000004e-06 2024-04-19T03:03:25.257 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.258 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.258 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:25.258 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.273872+0000", 2024-04-19T03:03:25.258 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0126558000000001 2024-04-19T03:03:25.258 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.258 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.258 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:25.258 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.273939+0000", 2024-04-19T03:03:25.258 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6822000000000005e-05 2024-04-19T03:03:25.258 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:25.258 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:25.258 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:25.258 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.258 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.259 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87134 5.5 5:a56c478f:::benchmark_data_smithi096_19531_object87133:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:03:25.259 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249708+0000", 2024-04-19T03:03:25.259 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 61.934187610000002, 2024-04-19T03:03:25.259 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0214677299999999, 2024-04-19T03:03:25.259 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:25.259 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-04-19T03:03:25.259 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:25.259 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:25.259 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:25.259 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87134 2024-04-19T03:03:25.259 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.259 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:25.260 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.260 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:25.260 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249708+0000", 2024-04-19T03:03:25.260 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:25.260 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.260 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.260 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:25.260 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249708+0000", 2024-04-19T03:03:25.260 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:25.260 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.260 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.260 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:25.260 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249706+0000", 2024-04-19T03:03:25.260 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999976 2024-04-19T03:03:25.260 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.261 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.261 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:25.261 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249740+0000", 2024-04-19T03:03:25.261 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4458000000000001e-05 2024-04-19T03:03:25.261 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.261 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.261 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:25.261 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249745+0000", 2024-04-19T03:03:25.261 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5020000000000003e-06 2024-04-19T03:03:25.261 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.261 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.261 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:25.261 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249748+0000", 2024-04-19T03:03:25.262 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2499999999999998e-06 2024-04-19T03:03:25.262 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.262 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.262 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:25.262 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249778+0000", 2024-04-19T03:03:25.262 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.006e-05 2024-04-19T03:03:25.262 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.262 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.262 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op must wait for map", 2024-04-19T03:03:25.262 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249782+0000", 2024-04-19T03:03:25.262 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2910000000000001e-06 2024-04-19T03:03:25.262 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.262 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.263 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:25.263 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261666+0000", 2024-04-19T03:03:25.263 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011883471 2024-04-19T03:03:25.263 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.263 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.263 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:03:25.263 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261674+0000", 2024-04-19T03:03:25.263 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6479999999999992e-06 2024-04-19T03:03:25.263 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.263 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.263 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:25.263 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.269323+0000", 2024-04-19T03:03:25.263 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.00764867 2024-04-19T03:03:25.264 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.264 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.264 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:25.264 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.271176+0000", 2024-04-19T03:03:25.264 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001852844 2024-04-19T03:03:25.264 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:25.264 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:25.264 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:25.264 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.264 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.264 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87137 5.c 5:30708c68:::benchmark_data_smithi096_19531_object87136:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:03:25.264 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249756+0000", 2024-04-19T03:03:25.264 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 61.934139903999998, 2024-04-19T03:03:25.264 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.033331752, 2024-04-19T03:03:25.265 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:25.265 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:25.265 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:25.265 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:25.265 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:25.265 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87137 2024-04-19T03:03:25.265 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.265 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:25.265 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.265 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:25.265 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249756+0000", 2024-04-19T03:03:25.266 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:25.266 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.266 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.266 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:25.266 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249756+0000", 2024-04-19T03:03:25.266 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:25.266 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.266 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.266 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:25.266 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249755+0000", 2024-04-19T03:03:25.266 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:25.266 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.267 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.267 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:25.267 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249777+0000", 2024-04-19T03:03:25.267 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1420000000000002e-05 2024-04-19T03:03:25.267 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.267 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.267 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:25.267 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249781+0000", 2024-04-19T03:03:25.267 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0609999999999997e-06 2024-04-19T03:03:25.267 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.267 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.268 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:25.268 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249787+0000", 2024-04-19T03:03:25.268 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.02e-06 2024-04-19T03:03:25.268 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.268 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.268 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:25.268 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249818+0000", 2024-04-19T03:03:25.268 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0947e-05 2024-04-19T03:03:25.268 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.268 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.268 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:03:25.268 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249821+0000", 2024-04-19T03:03:25.268 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.117e-06 2024-04-19T03:03:25.268 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.269 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.269 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:25.269 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261243+0000", 2024-04-19T03:03:25.269 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011421875999999999 2024-04-19T03:03:25.269 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.269 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.269 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:03:25.269 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261251+0000", 2024-04-19T03:03:25.269 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6120000000000001e-06 2024-04-19T03:03:25.269 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.269 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.269 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:25.270 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.274050+0000", 2024-04-19T03:03:25.270 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.012799405 2024-04-19T03:03:25.270 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.270 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.270 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:25.270 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.274529+0000", 2024-04-19T03:03:25.270 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00047867100000000001 2024-04-19T03:03:25.270 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.270 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.270 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:03:25.270 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.282972+0000", 2024-04-19T03:03:25.270 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0084436900000000002 2024-04-19T03:03:25.271 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.271 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.271 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:03:25.271 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.283022+0000", 2024-04-19T03:03:25.271 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9339000000000003e-05 2024-04-19T03:03:25.271 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.271 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.271 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:25.271 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.283088+0000", 2024-04-19T03:03:25.271 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5877999999999995e-05 2024-04-19T03:03:25.271 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:25.271 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:25.272 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:25.272 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.272 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.272 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:158376 5.9 5:9e73c076:::benchmark_data_smithi096_19531_object44926:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-19T03:03:25.272 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:58.126227+0000", 2024-04-19T03:03:25.272 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 27.057668171, 2024-04-19T03:03:25.272 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.069738668000000004, 2024-04-19T03:03:25.272 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:25.272 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:25.272 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:25.272 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:25.272 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:25.272 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 158376 2024-04-19T03:03:25.273 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.273 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:25.273 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.273 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:25.273 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.126227+0000", 2024-04-19T03:03:25.273 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:25.273 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.273 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.273 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:25.273 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.126227+0000", 2024-04-19T03:03:25.273 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:25.273 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.273 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.274 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:25.274 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.126226+0000", 2024-04-19T03:03:25.274 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:03:25.274 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.274 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.274 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:25.274 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.126236+0000", 2024-04-19T03:03:25.274 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.4199999999999996e-06 2024-04-19T03:03:25.274 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.274 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.274 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:25.274 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.126243+0000", 2024-04-19T03:03:25.275 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.199e-06 2024-04-19T03:03:25.275 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.275 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.275 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:25.275 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.126248+0000", 2024-04-19T03:03:25.275 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1320000000000002e-06 2024-04-19T03:03:25.275 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.275 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.275 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:25.275 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.126286+0000", 2024-04-19T03:03:25.275 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7401000000000003e-05 2024-04-19T03:03:25.275 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.275 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.276 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:25.276 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.126368+0000", 2024-04-19T03:03:25.276 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2113999999999993e-05 2024-04-19T03:03:25.276 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.276 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.276 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:03:25.276 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.126438+0000", 2024-04-19T03:03:25.276 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0337000000000001e-05 2024-04-19T03:03:25.276 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.276 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.276 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:03:25.277 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.130816+0000", 2024-04-19T03:03:25.277 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0043778330000000002 2024-04-19T03:03:25.277 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.277 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.277 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:25.277 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.195830+0000", 2024-04-19T03:03:25.277 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.065013933999999995 2024-04-19T03:03:25.277 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.277 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.277 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:03:25.277 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.195907+0000", 2024-04-19T03:03:25.277 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7397000000000005e-05 2024-04-19T03:03:25.278 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.278 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.278 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:25.278 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.195966+0000", 2024-04-19T03:03:25.278 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8906999999999997e-05 2024-04-19T03:03:25.278 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:25.278 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:25.278 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:25.278 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.278 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.278 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:158381 5.9 5:94dcd4a7:::benchmark_data_smithi096_19531_object44931:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-19T03:03:25.279 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:58.128712+0000", 2024-04-19T03:03:25.279 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 27.055183727999999, 2024-04-19T03:03:25.279 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.067497527000000002, 2024-04-19T03:03:25.279 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:25.279 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:25.279 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:25.279 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:25.279 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:25.279 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 158381 2024-04-19T03:03:25.279 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.279 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:25.279 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.279 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:25.279 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.128712+0000", 2024-04-19T03:03:25.280 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:25.280 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.280 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.280 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:25.280 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.128712+0000", 2024-04-19T03:03:25.280 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:25.280 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.280 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.280 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:25.280 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.128711+0000", 2024-04-19T03:03:25.280 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:03:25.280 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.280 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.280 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:25.281 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.128716+0000", 2024-04-19T03:03:25.281 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0610000000000003e-06 2024-04-19T03:03:25.281 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.281 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.281 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:25.281 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.128724+0000", 2024-04-19T03:03:25.281 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0120000000000005e-06 2024-04-19T03:03:25.281 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.281 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.281 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:25.281 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.128729+0000", 2024-04-19T03:03:25.281 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8899999999999998e-06 2024-04-19T03:03:25.281 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.282 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.282 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:25.282 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.128778+0000", 2024-04-19T03:03:25.282 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9110000000000002e-05 2024-04-19T03:03:25.282 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.282 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.282 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:25.282 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.128903+0000", 2024-04-19T03:03:25.282 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00012506799999999999 2024-04-19T03:03:25.282 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.282 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.282 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:03:25.282 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.129022+0000", 2024-04-19T03:03:25.282 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00011923599999999999 2024-04-19T03:03:25.283 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.283 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.283 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:03:25.283 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.132294+0000", 2024-04-19T03:03:25.283 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.003271244 2024-04-19T03:03:25.283 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.283 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.283 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:25.283 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.196045+0000", 2024-04-19T03:03:25.283 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.063751206000000005 2024-04-19T03:03:25.283 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.283 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.283 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:03:25.283 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.196133+0000", 2024-04-19T03:03:25.283 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.8213000000000004e-05 2024-04-19T03:03:25.283 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.284 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.284 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:25.284 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.196209+0000", 2024-04-19T03:03:25.284 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6335999999999996e-05 2024-04-19T03:03:25.284 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:25.284 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:25.284 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:25.284 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.284 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.284 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:158385 5.9 5:950ec749:::benchmark_data_smithi096_19531_object44935:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-19T03:03:25.284 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:58.129756+0000", 2024-04-19T03:03:25.284 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 27.054139796000001, 2024-04-19T03:03:25.284 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.068998382999999996, 2024-04-19T03:03:25.285 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:25.285 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:25.285 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:25.285 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:25.285 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:25.285 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 158385 2024-04-19T03:03:25.285 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.285 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:25.285 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.285 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:25.285 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.129756+0000", 2024-04-19T03:03:25.285 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:25.286 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.286 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.286 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:25.286 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.129756+0000", 2024-04-19T03:03:25.286 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:25.286 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.286 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.286 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:25.286 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.129755+0000", 2024-04-19T03:03:25.286 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:03:25.286 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.286 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.287 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:25.287 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.129760+0000", 2024-04-19T03:03:25.287 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6030000000000004e-06 2024-04-19T03:03:25.287 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.287 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.287 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:25.287 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.129774+0000", 2024-04-19T03:03:25.287 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3131e-05 2024-04-19T03:03:25.287 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.287 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.287 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:25.287 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.129781+0000", 2024-04-19T03:03:25.287 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4030000000000001e-06 2024-04-19T03:03:25.287 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.288 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.288 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:25.288 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.130837+0000", 2024-04-19T03:03:25.288 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00105569 2024-04-19T03:03:25.288 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.288 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.288 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:25.288 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.130917+0000", 2024-04-19T03:03:25.288 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9929e-05 2024-04-19T03:03:25.288 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.288 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.288 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:03:25.288 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.130973+0000", 2024-04-19T03:03:25.289 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.664e-05 2024-04-19T03:03:25.289 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.289 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.289 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:03:25.289 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.132340+0000", 2024-04-19T03:03:25.289 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001366321 2024-04-19T03:03:25.289 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.289 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.289 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:25.289 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.198637+0000", 2024-04-19T03:03:25.289 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.066296888999999998 2024-04-19T03:03:25.289 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.289 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.290 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:03:25.290 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.198704+0000", 2024-04-19T03:03:25.290 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7333000000000001e-05 2024-04-19T03:03:25.290 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.290 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.290 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:25.290 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.198754+0000", 2024-04-19T03:03:25.290 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0421999999999999e-05 2024-04-19T03:03:25.290 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:25.290 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:25.290 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:25.290 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.291 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.291 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:158387 5.9 5:9e96f619:::benchmark_data_smithi096_19531_object44937:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-19T03:03:25.291 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:58.132457+0000", 2024-04-19T03:03:25.291 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 27.051438231999999, 2024-04-19T03:03:25.291 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.066858091999999994, 2024-04-19T03:03:25.291 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:25.291 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:25.291 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:25.291 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:25.291 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:25.291 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 158387 2024-04-19T03:03:25.291 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.291 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:25.291 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.291 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:25.292 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.132457+0000", 2024-04-19T03:03:25.292 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:25.292 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.292 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.292 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:25.292 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.132457+0000", 2024-04-19T03:03:25.292 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:25.292 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.292 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.292 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:25.292 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.132457+0000", 2024-04-19T03:03:25.292 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:25.293 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.293 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.293 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:25.293 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.132460+0000", 2024-04-19T03:03:25.293 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.1949999999999999e-06 2024-04-19T03:03:25.293 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.293 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.293 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:25.293 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.132468+0000", 2024-04-19T03:03:25.293 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.1599999999999998e-06 2024-04-19T03:03:25.293 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.293 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.293 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:25.294 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.132473+0000", 2024-04-19T03:03:25.294 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9259999999999999e-06 2024-04-19T03:03:25.294 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.294 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.294 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:25.294 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.132504+0000", 2024-04-19T03:03:25.294 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0914000000000003e-05 2024-04-19T03:03:25.294 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.294 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.294 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:25.294 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.132646+0000", 2024-04-19T03:03:25.294 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00014214300000000001 2024-04-19T03:03:25.295 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.295 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.295 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:03:25.295 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.132741+0000", 2024-04-19T03:03:25.295 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.4344000000000003e-05 2024-04-19T03:03:25.295 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.295 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.295 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:03:25.295 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.135774+0000", 2024-04-19T03:03:25.295 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0030334960000000001 2024-04-19T03:03:25.295 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.296 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.296 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:25.296 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.199240+0000", 2024-04-19T03:03:25.296 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.063465695000000003 2024-04-19T03:03:25.296 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.296 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.296 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:03:25.296 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.199272+0000", 2024-04-19T03:03:25.296 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2412000000000001e-05 2024-04-19T03:03:25.296 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.296 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.296 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:25.297 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.199316+0000", 2024-04-19T03:03:25.297 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3275000000000002e-05 2024-04-19T03:03:25.297 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:25.297 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:25.297 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:25.297 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.297 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.297 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:158392 5.f 5:f462725f:::benchmark_data_smithi096_19531_object44942:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-19T03:03:25.297 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:58.135703+0000", 2024-04-19T03:03:25.297 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 27.048192451999999, 2024-04-19T03:03:25.297 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.063132879000000003, 2024-04-19T03:03:25.297 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:25.297 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:25.298 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:25.298 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:25.298 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:25.298 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 158392 2024-04-19T03:03:25.298 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.298 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:25.298 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.298 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:25.298 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.135703+0000", 2024-04-19T03:03:25.298 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:25.298 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.298 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.299 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:25.299 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.135703+0000", 2024-04-19T03:03:25.299 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:25.299 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.299 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.299 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:25.299 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.135702+0000", 2024-04-19T03:03:25.299 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:03:25.299 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.299 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.299 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:25.300 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.135708+0000", 2024-04-19T03:03:25.300 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8270000000000003e-06 2024-04-19T03:03:25.300 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.300 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.300 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:25.300 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.135720+0000", 2024-04-19T03:03:25.300 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2057e-05 2024-04-19T03:03:25.300 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.300 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.300 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:25.300 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.135727+0000", 2024-04-19T03:03:25.300 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8090000000000004e-06 2024-04-19T03:03:25.300 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.301 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.301 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:25.301 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.135768+0000", 2024-04-19T03:03:25.301 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1548999999999998e-05 2024-04-19T03:03:25.301 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.301 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.301 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:25.301 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.135853+0000", 2024-04-19T03:03:25.301 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4845000000000005e-05 2024-04-19T03:03:25.301 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.301 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.302 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:03:25.302 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.135934+0000", 2024-04-19T03:03:25.302 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0315000000000006e-05 2024-04-19T03:03:25.302 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.302 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.302 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:03:25.302 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.138685+0000", 2024-04-19T03:03:25.302 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.002751042 2024-04-19T03:03:25.302 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.302 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.302 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:25.302 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.198747+0000", 2024-04-19T03:03:25.303 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.060062675000000003 2024-04-19T03:03:25.303 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.303 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.303 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:03:25.303 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.198802+0000", 2024-04-19T03:03:25.303 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4469000000000003e-05 2024-04-19T03:03:25.303 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.303 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.303 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:25.303 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.198836+0000", 2024-04-19T03:03:25.303 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4272e-05 2024-04-19T03:03:25.303 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:25.303 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:25.304 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:25.304 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.304 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.304 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:158397 5.d 5:b5d962e9:::benchmark_data_smithi096_19531_object44947:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-19T03:03:25.304 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:58.138717+0000", 2024-04-19T03:03:25.304 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 27.045178508999999, 2024-04-19T03:03:25.304 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.057191467000000003, 2024-04-19T03:03:25.304 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:25.304 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:25.304 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:25.304 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:25.304 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:25.304 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 158397 2024-04-19T03:03:25.304 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.304 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:25.304 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.305 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:25.305 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.138717+0000", 2024-04-19T03:03:25.305 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:25.305 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.305 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.305 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:25.305 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.138717+0000", 2024-04-19T03:03:25.305 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:25.305 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.305 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.305 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:25.305 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.138716+0000", 2024-04-19T03:03:25.305 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999986 2024-04-19T03:03:25.305 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.306 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.306 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:25.306 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.138722+0000", 2024-04-19T03:03:25.306 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1709999999999999e-06 2024-04-19T03:03:25.306 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.306 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.306 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:25.306 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.138731+0000", 2024-04-19T03:03:25.306 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.0310000000000004e-06 2024-04-19T03:03:25.306 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.306 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.306 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:25.307 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.138738+0000", 2024-04-19T03:03:25.307 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8430000000000004e-06 2024-04-19T03:03:25.307 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.307 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.307 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:25.307 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.138789+0000", 2024-04-19T03:03:25.307 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0623e-05 2024-04-19T03:03:25.307 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.307 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.307 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:25.307 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.138945+0000", 2024-04-19T03:03:25.307 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00015671899999999999 2024-04-19T03:03:25.307 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.307 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.308 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:03:25.308 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.139079+0000", 2024-04-19T03:03:25.308 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00013380099999999999 2024-04-19T03:03:25.308 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.308 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.308 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:03:25.308 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.141715+0000", 2024-04-19T03:03:25.308 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0026362849999999999 2024-04-19T03:03:25.308 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.308 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.308 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:25.308 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.195784+0000", 2024-04-19T03:03:25.308 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.054068353 2024-04-19T03:03:25.308 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.309 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.309 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:03:25.309 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.195852+0000", 2024-04-19T03:03:25.309 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8121999999999996e-05 2024-04-19T03:03:25.309 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:25.309 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:25.309 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:25.309 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.195909+0000", 2024-04-19T03:03:25.309 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6737999999999998e-05 2024-04-19T03:03:25.309 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:25.309 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:25.309 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:25.309 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:25.310 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:25.310 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-04-19T03:03:25.311 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:03:25.306+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:03:25.312 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T03:03:25.412 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:03:25.410+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:03:25.435 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-19T03:03:25.435 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-04-19T03:03:25.435 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.435 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4755.0:223967 5.d e65/49 5:bd28ce09:::benchmark_data_smithi096_19531_object110517:head v 65'14212, mlcod=65'14210)", 2024-04-19T03:03:25.435 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:03:25.429486+0000", 2024-04-19T03:03:25.435 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.005421225, 2024-04-19T03:03:25.436 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0054467639999999998, 2024-04-19T03:03:25.436 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:25.436 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-19T03:03:25.436 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:25.436 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.436 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:25.436 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:25.429486+0000", 2024-04-19T03:03:25.436 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:25.436 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.436 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.436 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:25.436 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:25.429486+0000", 2024-04-19T03:03:25.436 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:25.436 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.437 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.437 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:25.437 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:25.429485+0000", 2024-04-19T03:03:25.437 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:03:25.437 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.437 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.437 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:25.437 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:25.429494+0000", 2024-04-19T03:03:25.437 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1810000000000007e-06 2024-04-19T03:03:25.437 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.437 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.437 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:25.437 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:25.429509+0000", 2024-04-19T03:03:25.438 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4894e-05 2024-04-19T03:03:25.438 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.438 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.438 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:25.438 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:25.429517+0000", 2024-04-19T03:03:25.438 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5079999999999999e-06 2024-04-19T03:03:25.438 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.438 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.438 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:25.438 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:25.429573+0000", 2024-04-19T03:03:25.438 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6230000000000002e-05 2024-04-19T03:03:25.438 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.438 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.439 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:25.439 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:25.429618+0000", 2024-04-19T03:03:25.439 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5361999999999997e-05 2024-04-19T03:03:25.439 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:25.439 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:25.439 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:25.439 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.439 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.439 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:223978 5.8 5:1c7d101d:::benchmark_data_smithi096_19531_object110528:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-19T03:03:25.439 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:03:25.430179+0000", 2024-04-19T03:03:25.439 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0047286139999999999, 2024-04-19T03:03:25.439 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0048306119999999998, 2024-04-19T03:03:25.439 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:25.440 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-19T03:03:25.440 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:25.440 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:25.440 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:25.440 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 223978 2024-04-19T03:03:25.440 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.440 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:25.440 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.440 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:25.440 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:25.430179+0000", 2024-04-19T03:03:25.440 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:25.440 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.440 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.441 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:25.441 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:25.430179+0000", 2024-04-19T03:03:25.441 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:25.441 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.441 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.441 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:25.441 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:25.430178+0000", 2024-04-19T03:03:25.441 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:03:25.441 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.441 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.441 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:25.441 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:25.430184+0000", 2024-04-19T03:03:25.441 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7329999999999997e-06 2024-04-19T03:03:25.441 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.441 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.442 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:25.442 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:25.430196+0000", 2024-04-19T03:03:25.442 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1776999999999999e-05 2024-04-19T03:03:25.442 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.442 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.442 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:25.442 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:25.430205+0000", 2024-04-19T03:03:25.442 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.7870000000000007e-06 2024-04-19T03:03:25.442 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.442 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.442 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:25.442 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:25.430261+0000", 2024-04-19T03:03:25.442 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6473e-05 2024-04-19T03:03:25.443 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.443 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.443 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:25.443 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:25.430414+0000", 2024-04-19T03:03:25.443 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000152521 2024-04-19T03:03:25.443 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:25.443 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:25.443 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:25.443 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.443 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.443 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4755.0:223974 5.9 e65/22 5:968707c5:::benchmark_data_smithi096_19531_object110524:head v 65'13691, mlcod=65'13689)", 2024-04-19T03:03:25.443 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:03:25.430531+0000", 2024-04-19T03:03:25.443 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0043758460000000001, 2024-04-19T03:03:25.443 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0045556210000000001, 2024-04-19T03:03:25.444 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:25.444 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-19T03:03:25.444 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:25.444 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.444 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:25.444 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:25.430531+0000", 2024-04-19T03:03:25.444 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:25.444 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.444 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.444 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:25.444 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:25.430531+0000", 2024-04-19T03:03:25.444 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:25.445 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.445 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.445 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:25.445 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:25.430531+0000", 2024-04-19T03:03:25.445 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:03:25.445 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.445 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.445 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:25.445 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:25.430538+0000", 2024-04-19T03:03:25.445 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.1810000000000004e-06 2024-04-19T03:03:25.445 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.445 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.445 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:25.446 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:25.430554+0000", 2024-04-19T03:03:25.446 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6405e-05 2024-04-19T03:03:25.446 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.446 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.446 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:25.446 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:25.430561+0000", 2024-04-19T03:03:25.446 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7669999999999998e-06 2024-04-19T03:03:25.446 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.446 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.446 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:25.446 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:25.430613+0000", 2024-04-19T03:03:25.446 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1638999999999998e-05 2024-04-19T03:03:25.447 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.447 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.447 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:25.447 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:25.430637+0000", 2024-04-19T03:03:25.447 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4133000000000001e-05 2024-04-19T03:03:25.447 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:25.447 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:25.447 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:25.447 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.447 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.447 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4755.0:223973 5.f e65/22 5:f8b99fdf:::benchmark_data_smithi096_19531_object110523:head v 65'13832, mlcod=65'13830)", 2024-04-19T03:03:25.447 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:03:25.431102+0000", 2024-04-19T03:03:25.447 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.003805166, 2024-04-19T03:03:25.447 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0040500249999999996, 2024-04-19T03:03:25.448 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:25.448 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-19T03:03:25.448 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:25.448 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.448 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:25.448 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:25.431102+0000", 2024-04-19T03:03:25.448 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:25.448 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.448 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.448 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:25.448 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:25.431102+0000", 2024-04-19T03:03:25.449 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:25.449 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.449 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.449 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:25.449 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:25.431102+0000", 2024-04-19T03:03:25.449 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:25.449 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.449 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.449 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:25.449 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:25.431107+0000", 2024-04-19T03:03:25.449 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4330000000000003e-06 2024-04-19T03:03:25.449 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.449 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.450 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:25.450 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:25.431116+0000", 2024-04-19T03:03:25.450 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1980000000000007e-06 2024-04-19T03:03:25.450 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.450 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.450 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:25.450 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:25.431120+0000", 2024-04-19T03:03:25.450 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.963e-06 2024-04-19T03:03:25.450 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.450 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.450 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:25.450 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:25.431166+0000", 2024-04-19T03:03:25.450 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5445999999999998e-05 2024-04-19T03:03:25.451 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.451 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.451 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:25.451 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:25.431181+0000", 2024-04-19T03:03:25.451 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5458999999999999e-05 2024-04-19T03:03:25.451 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:25.451 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:25.451 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:25.451 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.451 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.451 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:223980 5.8 5:15b26932:::benchmark_data_smithi096_19531_object110530:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-19T03:03:25.452 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:03:25.432334+0000", 2024-04-19T03:03:25.452 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.002573044, 2024-04-19T03:03:25.452 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0028854589999999999, 2024-04-19T03:03:25.452 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:25.452 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-19T03:03:25.452 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:25.452 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:25.452 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:25.452 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 223980 2024-04-19T03:03:25.452 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.452 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:25.452 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.452 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:25.452 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:25.432334+0000", 2024-04-19T03:03:25.452 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:25.453 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.453 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.453 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:25.453 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:25.432334+0000", 2024-04-19T03:03:25.453 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:25.453 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.453 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.453 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:25.453 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:25.432333+0000", 2024-04-19T03:03:25.453 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:03:25.453 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.453 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.453 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:25.453 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:25.432340+0000", 2024-04-19T03:03:25.453 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.9859999999999997e-06 2024-04-19T03:03:25.454 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.454 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.454 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:25.454 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:25.432351+0000", 2024-04-19T03:03:25.454 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1114000000000001e-05 2024-04-19T03:03:25.454 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.454 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.454 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:25.454 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:25.432360+0000", 2024-04-19T03:03:25.454 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.276e-06 2024-04-19T03:03:25.454 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.454 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.454 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:25.455 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:25.432915+0000", 2024-04-19T03:03:25.455 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00055497800000000003 2024-04-19T03:03:25.455 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.455 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.455 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:25.455 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:25.433064+0000", 2024-04-19T03:03:25.455 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014951600000000001 2024-04-19T03:03:25.455 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:25.455 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:25.455 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:25.455 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.455 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.455 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:223981 5.b 5:dffbb37f:::benchmark_data_smithi096_19531_object110531:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-19T03:03:25.456 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:03:25.432516+0000", 2024-04-19T03:03:25.456 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.0023916419999999998, 2024-04-19T03:03:25.456 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0027794170000000002, 2024-04-19T03:03:25.456 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:25.456 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-19T03:03:25.456 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:25.456 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:25.456 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:25.456 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 223981 2024-04-19T03:03:25.456 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.456 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:25.456 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.456 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:25.456 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:25.432516+0000", 2024-04-19T03:03:25.457 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:25.457 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.457 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.457 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:25.457 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:25.432516+0000", 2024-04-19T03:03:25.457 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:25.457 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.457 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.457 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:25.457 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:25.432515+0000", 2024-04-19T03:03:25.457 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:03:25.457 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.457 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.457 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:25.458 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:25.432521+0000", 2024-04-19T03:03:25.458 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9920000000000004e-06 2024-04-19T03:03:25.458 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.458 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.458 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:25.458 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:25.432535+0000", 2024-04-19T03:03:25.458 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4472e-05 2024-04-19T03:03:25.458 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.458 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.458 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:25.458 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:25.432543+0000", 2024-04-19T03:03:25.458 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.9610000000000005e-06 2024-04-19T03:03:25.458 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.459 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.459 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:25.459 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:25.432592+0000", 2024-04-19T03:03:25.459 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9384e-05 2024-04-19T03:03:25.459 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.459 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.459 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:25.459 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:25.432811+0000", 2024-04-19T03:03:25.459 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00021869899999999999 2024-04-19T03:03:25.459 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:25.459 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:25.459 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:25.459 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.460 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.460 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4755.0:223975 5.9 e65/22 5:9718ac5a:::benchmark_data_smithi096_19531_object110525:head v 65'13692, mlcod=65'13689)", 2024-04-19T03:03:25.460 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:03:25.432972+0000", 2024-04-19T03:03:25.460 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.001935548, 2024-04-19T03:03:25.460 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0023943580000000001, 2024-04-19T03:03:25.460 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:25.460 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-19T03:03:25.460 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:25.460 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.460 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:25.460 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:25.432972+0000", 2024-04-19T03:03:25.460 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:25.460 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.460 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.460 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:25.461 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:25.432972+0000", 2024-04-19T03:03:25.461 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:25.461 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.461 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.461 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:25.461 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:25.432971+0000", 2024-04-19T03:03:25.461 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:03:25.461 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.461 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.461 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:25.461 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:25.432979+0000", 2024-04-19T03:03:25.461 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.2840000000000006e-06 2024-04-19T03:03:25.462 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.462 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.462 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:25.462 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:25.432989+0000", 2024-04-19T03:03:25.462 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0298e-05 2024-04-19T03:03:25.462 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.462 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.462 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:25.462 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:25.432997+0000", 2024-04-19T03:03:25.462 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.1300000000000003e-06 2024-04-19T03:03:25.462 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.462 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.462 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:25.463 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:25.433045+0000", 2024-04-19T03:03:25.463 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8464999999999998e-05 2024-04-19T03:03:25.463 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.463 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.463 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:25.463 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:25.433068+0000", 2024-04-19T03:03:25.463 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.3220000000000001e-05 2024-04-19T03:03:25.463 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:25.463 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:25.463 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:25.463 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.463 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.463 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4755.0:223976 5.d e65/49 5:b68d3c12:::benchmark_data_smithi096_19531_object110526:head v 65'14213, mlcod=65'14210)", 2024-04-19T03:03:25.463 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:03:25.434409+0000", 2024-04-19T03:03:25.463 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 0.00049782699999999995, 2024-04-19T03:03:25.463 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0010217830000000001, 2024-04-19T03:03:25.464 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:25.464 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-19T03:03:25.464 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:25.464 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.464 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:25.464 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:25.434409+0000", 2024-04-19T03:03:25.464 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:25.464 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.464 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.464 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:25.464 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:25.434409+0000", 2024-04-19T03:03:25.464 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:25.464 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.464 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.465 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:25.465 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:25.434409+0000", 2024-04-19T03:03:25.465 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:25.465 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.465 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.465 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:25.465 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:25.434415+0000", 2024-04-19T03:03:25.465 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3539999999999996e-06 2024-04-19T03:03:25.465 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.465 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.465 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:25.465 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:25.434432+0000", 2024-04-19T03:03:25.465 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6416e-05 2024-04-19T03:03:25.465 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.466 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.466 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:25.466 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:25.434437+0000", 2024-04-19T03:03:25.466 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.451e-06 2024-04-19T03:03:25.466 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.466 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.466 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:25.466 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:25.434481+0000", 2024-04-19T03:03:25.466 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3801000000000003e-05 2024-04-19T03:03:25.466 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.466 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.466 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:25.467 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:25.434502+0000", 2024-04-19T03:03:25.467 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1381000000000001e-05 2024-04-19T03:03:25.467 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:25.467 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:25.467 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:25.467 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.467 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.467 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:223982 5.a 5:5f5b0108:::benchmark_data_smithi096_19531_object110532:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-19T03:03:25.467 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:03:25.434956+0000", 2024-04-19T03:03:25.467 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 4294967295.9999514, 2024-04-19T03:03:25.467 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00054741000000000002, 2024-04-19T03:03:25.467 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:25.468 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2024-04-19T03:03:25.468 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:25.468 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:25.468 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:25.468 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 223982 2024-04-19T03:03:25.468 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.468 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:25.468 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.468 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:25.468 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:25.434956+0000", 2024-04-19T03:03:25.468 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:25.468 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.468 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.469 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:25.469 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:25.434956+0000", 2024-04-19T03:03:25.469 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:25.469 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.469 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.469 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:25.469 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:25.434955+0000", 2024-04-19T03:03:25.469 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:03:25.469 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.469 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.469 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:25.469 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:25.434960+0000", 2024-04-19T03:03:25.469 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.356e-06 2024-04-19T03:03:25.470 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.470 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.470 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:25.470 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:25.434973+0000", 2024-04-19T03:03:25.470 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2115e-05 2024-04-19T03:03:25.470 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.470 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.470 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:25.470 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:25.434982+0000", 2024-04-19T03:03:25.470 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.3570000000000004e-06 2024-04-19T03:03:25.470 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.470 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.470 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:25.470 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:25.435033+0000", 2024-04-19T03:03:25.471 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0974999999999999e-05 2024-04-19T03:03:25.471 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.471 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.471 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:25.471 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:03:25.435246+0000", 2024-04-19T03:03:25.471 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00021285 2024-04-19T03:03:25.471 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:25.471 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:25.471 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:25.471 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:25.471 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2024-04-19T03:03:25.471 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 9 2024-04-19T03:03:25.471 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-19T03:03:25.472 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T03:03:25.513 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:03:25.510+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:03:25.592 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-19T03:03:25.592 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-04-19T03:03:25.592 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-04-19T03:03:25.593 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-04-19T03:03:25.593 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-19T03:03:25.605 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T03:03:25.648 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:03:25.646+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:03:25.714 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:03:25.710+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:03:25.774 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-19T03:03:25.774 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-04-19T03:03:25.774 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-04-19T03:03:25.774 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-04-19T03:03:25.774 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.774 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:86615 5.e 5:7fef7288:::benchmark_data_smithi096_19531_object86614:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:25.775 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:22.634544+0000", 2024-04-19T03:03:25.775 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 63.137948719000001, 2024-04-19T03:03:25.775 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.192475071, 2024-04-19T03:03:25.775 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:25.775 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:25.775 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:25.775 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:25.775 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:25.775 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 86615 2024-04-19T03:03:25.775 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.775 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:25.775 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.775 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:25.775 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634544+0000", 2024-04-19T03:03:25.775 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:25.776 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.776 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.776 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:25.776 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634544+0000", 2024-04-19T03:03:25.776 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:25.776 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.776 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.776 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:25.776 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634542+0000", 2024-04-19T03:03:25.776 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999981 2024-04-19T03:03:25.776 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.776 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.776 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:25.776 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634585+0000", 2024-04-19T03:03:25.777 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2299000000000003e-05 2024-04-19T03:03:25.777 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.777 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.777 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:25.777 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634592+0000", 2024-04-19T03:03:25.777 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2350000000000002e-06 2024-04-19T03:03:25.777 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.777 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.777 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:25.777 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634596+0000", 2024-04-19T03:03:25.777 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5390000000000001e-06 2024-04-19T03:03:25.777 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.777 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.777 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:25.778 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634639+0000", 2024-04-19T03:03:25.778 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2444999999999998e-05 2024-04-19T03:03:25.778 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.778 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.778 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:25.778 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634808+0000", 2024-04-19T03:03:25.778 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000169152 2024-04-19T03:03:25.778 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.778 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.778 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:25.778 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634999+0000", 2024-04-19T03:03:25.778 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00019098300000000001 2024-04-19T03:03:25.778 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.779 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.779 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:25.779 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.640458+0000", 2024-04-19T03:03:25.779 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0054586870000000003 2024-04-19T03:03:25.779 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.779 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.779 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:25.779 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.826949+0000", 2024-04-19T03:03:25.779 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.18649178299999999 2024-04-19T03:03:25.779 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.779 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.779 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:03:25.779 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.826982+0000", 2024-04-19T03:03:25.779 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2477000000000001e-05 2024-04-19T03:03:25.780 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.780 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.780 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:25.780 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.827019+0000", 2024-04-19T03:03:25.780 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7355999999999999e-05 2024-04-19T03:03:25.780 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:25.780 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:25.780 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:25.780 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.780 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.780 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:86616 5.e 5:72278f47:::benchmark_data_smithi096_19531_object86615:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:25.780 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:22.634609+0000", 2024-04-19T03:03:25.780 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 63.13788357, 2024-04-19T03:03:25.781 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.19472088900000001, 2024-04-19T03:03:25.781 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:25.781 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:25.781 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:25.781 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:25.781 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:25.781 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 86616 2024-04-19T03:03:25.781 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.781 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:25.781 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.781 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:25.782 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634609+0000", 2024-04-19T03:03:25.782 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:25.782 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.782 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.782 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:25.782 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634609+0000", 2024-04-19T03:03:25.782 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:25.782 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.782 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.782 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:25.782 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634609+0000", 2024-04-19T03:03:25.782 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:25.783 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.783 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.783 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:25.783 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634651+0000", 2024-04-19T03:03:25.783 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2589000000000002e-05 2024-04-19T03:03:25.783 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.783 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.783 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:25.783 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634659+0000", 2024-04-19T03:03:25.783 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5850000000000002e-06 2024-04-19T03:03:25.783 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.784 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.784 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:25.784 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634662+0000", 2024-04-19T03:03:25.784 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3620000000000002e-06 2024-04-19T03:03:25.784 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.784 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.784 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:25.784 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.637880+0000", 2024-04-19T03:03:25.784 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.003218149 2024-04-19T03:03:25.784 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.784 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.784 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:25.784 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.637999+0000", 2024-04-19T03:03:25.785 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000118643 2024-04-19T03:03:25.785 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.785 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.785 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:25.785 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.638102+0000", 2024-04-19T03:03:25.785 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010331 2024-04-19T03:03:25.785 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.785 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.785 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:25.785 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.640851+0000", 2024-04-19T03:03:25.785 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0027483310000000001 2024-04-19T03:03:25.785 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.785 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.785 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:25.786 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.829269+0000", 2024-04-19T03:03:25.786 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.188418319 2024-04-19T03:03:25.786 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.786 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.786 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:03:25.786 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.829299+0000", 2024-04-19T03:03:25.786 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0227e-05 2024-04-19T03:03:25.786 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.786 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.786 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:25.786 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.829330+0000", 2024-04-19T03:03:25.786 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0969000000000001e-05 2024-04-19T03:03:25.786 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:25.787 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:25.787 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:25.787 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.787 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.787 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:86618 5.0 5:09014b90:::benchmark_data_smithi096_19531_object86617:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:25.787 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:22.634894+0000", 2024-04-19T03:03:25.787 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 63.137599082000001, 2024-04-19T03:03:25.787 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.19413419800000001, 2024-04-19T03:03:25.787 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:25.787 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:25.787 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:25.787 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:25.787 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:25.788 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 86618 2024-04-19T03:03:25.788 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.788 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:25.788 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.788 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:25.788 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634894+0000", 2024-04-19T03:03:25.788 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:25.788 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.788 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.788 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:25.788 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634894+0000", 2024-04-19T03:03:25.788 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:25.788 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.788 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.789 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:25.789 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634893+0000", 2024-04-19T03:03:25.789 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:03:25.789 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.789 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.789 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:25.789 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634976+0000", 2024-04-19T03:03:25.789 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3231000000000003e-05 2024-04-19T03:03:25.789 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.789 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.789 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:25.789 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634983+0000", 2024-04-19T03:03:25.789 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5169999999999996e-06 2024-04-19T03:03:25.790 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.790 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.790 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:25.790 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634987+0000", 2024-04-19T03:03:25.790 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.425e-06 2024-04-19T03:03:25.790 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.790 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.790 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:25.790 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635030+0000", 2024-04-19T03:03:25.790 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.32e-05 2024-04-19T03:03:25.790 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.790 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.790 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:25.791 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635185+0000", 2024-04-19T03:03:25.791 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015471899999999999 2024-04-19T03:03:25.791 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.791 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.791 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:25.791 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635415+0000", 2024-04-19T03:03:25.791 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00023026500000000001 2024-04-19T03:03:25.791 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.791 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.791 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:25.791 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.640127+0000", 2024-04-19T03:03:25.791 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0047118890000000004 2024-04-19T03:03:25.791 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.792 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.792 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:25.792 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.828895+0000", 2024-04-19T03:03:25.792 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.18876802600000001 2024-04-19T03:03:25.792 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.792 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.792 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:03:25.792 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.828972+0000", 2024-04-19T03:03:25.792 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.6345000000000002e-05 2024-04-19T03:03:25.792 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.792 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.792 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:25.792 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.829028+0000", 2024-04-19T03:03:25.792 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6342999999999999e-05 2024-04-19T03:03:25.793 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:25.793 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:25.793 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:25.793 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.793 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.793 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:86620 5.b 5:d80faa68:::benchmark_data_smithi096_19531_object86619:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:25.793 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:22.635110+0000", 2024-04-19T03:03:25.793 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 63.137382522000003, 2024-04-19T03:03:25.793 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.193447275, 2024-04-19T03:03:25.793 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:25.793 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:25.793 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:25.793 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:25.794 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:25.794 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 86620 2024-04-19T03:03:25.794 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.794 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:25.794 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.794 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:25.794 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635110+0000", 2024-04-19T03:03:25.794 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:25.794 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.794 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.794 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:25.794 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635110+0000", 2024-04-19T03:03:25.794 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:25.795 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.795 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.795 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:25.795 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635110+0000", 2024-04-19T03:03:25.795 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:25.795 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.795 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.795 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:25.795 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635154+0000", 2024-04-19T03:03:25.795 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4681000000000001e-05 2024-04-19T03:03:25.795 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.795 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.795 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:25.796 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635166+0000", 2024-04-19T03:03:25.796 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1505000000000001e-05 2024-04-19T03:03:25.796 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.796 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.796 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:25.796 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635171+0000", 2024-04-19T03:03:25.796 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6040000000000003e-06 2024-04-19T03:03:25.796 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.796 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.796 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:25.796 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635221+0000", 2024-04-19T03:03:25.796 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9947000000000001e-05 2024-04-19T03:03:25.797 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.797 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.797 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:25.797 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635356+0000", 2024-04-19T03:03:25.797 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013576199999999999 2024-04-19T03:03:25.797 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.797 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.797 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:25.797 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635507+0000", 2024-04-19T03:03:25.797 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015072999999999999 2024-04-19T03:03:25.797 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.798 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.798 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:25.798 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.638488+0000", 2024-04-19T03:03:25.798 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0029813159999999999 2024-04-19T03:03:25.798 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.798 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.798 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:25.798 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.828341+0000", 2024-04-19T03:03:25.798 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.189852254 2024-04-19T03:03:25.798 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.798 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.798 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:03:25.798 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.828416+0000", 2024-04-19T03:03:25.799 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5344000000000002e-05 2024-04-19T03:03:25.799 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.799 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.799 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:25.799 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.828558+0000", 2024-04-19T03:03:25.799 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000141695 2024-04-19T03:03:25.799 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:25.799 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:25.799 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:25.799 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.799 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.799 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:86621 5.8 5:1597a420:::benchmark_data_smithi096_19531_object86620:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:25.799 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:22.635187+0000", 2024-04-19T03:03:25.799 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 63.137305662000003, 2024-04-19T03:03:25.800 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.194204878, 2024-04-19T03:03:25.800 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:25.800 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:25.800 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:25.800 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:25.800 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:25.800 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 86621 2024-04-19T03:03:25.800 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.800 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:25.800 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.800 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:25.800 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635187+0000", 2024-04-19T03:03:25.800 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:25.800 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.800 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.801 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:25.801 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635187+0000", 2024-04-19T03:03:25.801 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:25.801 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.801 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.801 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:25.801 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635187+0000", 2024-04-19T03:03:25.801 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:25.801 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.801 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.801 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:25.801 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635242+0000", 2024-04-19T03:03:25.801 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5158000000000003e-05 2024-04-19T03:03:25.801 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.801 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.802 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:25.802 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635249+0000", 2024-04-19T03:03:25.802 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.7000000000000008e-06 2024-04-19T03:03:25.802 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.802 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.802 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:25.802 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635256+0000", 2024-04-19T03:03:25.802 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2060000000000004e-06 2024-04-19T03:03:25.802 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.802 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.802 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:25.802 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635302+0000", 2024-04-19T03:03:25.802 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5954000000000001e-05 2024-04-19T03:03:25.802 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.803 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.803 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:25.803 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635427+0000", 2024-04-19T03:03:25.803 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012559299999999999 2024-04-19T03:03:25.803 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.803 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.803 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:25.803 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635596+0000", 2024-04-19T03:03:25.803 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000168615 2024-04-19T03:03:25.803 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.803 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.803 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:25.803 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.639320+0000", 2024-04-19T03:03:25.803 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0037244610000000001 2024-04-19T03:03:25.804 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.804 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.804 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:25.804 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.829277+0000", 2024-04-19T03:03:25.804 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.18995651099999999 2024-04-19T03:03:25.804 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.804 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.804 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:03:25.804 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.829341+0000", 2024-04-19T03:03:25.804 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3756000000000004e-05 2024-04-19T03:03:25.804 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.804 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.805 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:25.805 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.829392+0000", 2024-04-19T03:03:25.805 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1555999999999999e-05 2024-04-19T03:03:25.805 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:25.805 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:25.805 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:25.805 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.805 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.805 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87067 5.b 5:d57af71a:::benchmark_data_smithi096_19531_object87066:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:25.805 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.142233+0000", 2024-04-19T03:03:25.805 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 62.630259799000001, 2024-04-19T03:03:25.805 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.071692405000000001, 2024-04-19T03:03:25.805 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:25.805 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:25.806 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:25.806 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:25.806 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:25.806 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87067 2024-04-19T03:03:25.806 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.806 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:25.806 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.806 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:25.806 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142233+0000", 2024-04-19T03:03:25.806 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:25.806 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.806 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.806 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:25.807 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142233+0000", 2024-04-19T03:03:25.807 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:25.807 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.807 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.807 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:25.807 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142232+0000", 2024-04-19T03:03:25.807 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:03:25.807 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.807 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.807 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:25.807 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142277+0000", 2024-04-19T03:03:25.807 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5837000000000002e-05 2024-04-19T03:03:25.808 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.808 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.808 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:25.808 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142297+0000", 2024-04-19T03:03:25.808 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9561000000000001e-05 2024-04-19T03:03:25.808 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.808 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.808 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:25.808 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142311+0000", 2024-04-19T03:03:25.808 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3654e-05 2024-04-19T03:03:25.808 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.808 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.808 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:25.808 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142391+0000", 2024-04-19T03:03:25.809 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0123999999999994e-05 2024-04-19T03:03:25.809 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.809 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.809 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:25.809 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142669+0000", 2024-04-19T03:03:25.809 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00027829800000000001 2024-04-19T03:03:25.809 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.809 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.809 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:25.809 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142859+0000", 2024-04-19T03:03:25.809 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000190051 2024-04-19T03:03:25.809 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.809 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.809 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:25.809 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.150597+0000", 2024-04-19T03:03:25.810 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0077380299999999999 2024-04-19T03:03:25.810 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.810 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.810 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:25.810 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.213855+0000", 2024-04-19T03:03:25.810 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.063257987000000002 2024-04-19T03:03:25.810 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.810 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.810 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:03:25.810 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.213898+0000", 2024-04-19T03:03:25.810 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2916e-05 2024-04-19T03:03:25.810 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.810 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.810 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:25.811 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.213925+0000", 2024-04-19T03:03:25.811 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7503000000000001e-05 2024-04-19T03:03:25.811 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:25.811 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:25.811 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:25.811 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.811 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.811 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87069 5.b 5:da0c93b5:::benchmark_data_smithi096_19531_object87068:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:25.811 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.143402+0000", 2024-04-19T03:03:25.811 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 62.629090837, 2024-04-19T03:03:25.811 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.070678598999999995, 2024-04-19T03:03:25.811 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:25.811 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:25.811 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:25.811 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:25.811 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:25.812 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87069 2024-04-19T03:03:25.812 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.812 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:25.812 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.812 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:25.812 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.143402+0000", 2024-04-19T03:03:25.812 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:25.812 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.812 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.812 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:25.812 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.143402+0000", 2024-04-19T03:03:25.812 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:25.812 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.813 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.813 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:25.813 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.143401+0000", 2024-04-19T03:03:25.813 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:03:25.813 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.813 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.813 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:25.813 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.143501+0000", 2024-04-19T03:03:25.813 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000100387 2024-04-19T03:03:25.813 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.813 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.813 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:25.813 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.143516+0000", 2024-04-19T03:03:25.814 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5369000000000001e-05 2024-04-19T03:03:25.814 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.814 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.814 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:25.814 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.143524+0000", 2024-04-19T03:03:25.814 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.7079999999999997e-06 2024-04-19T03:03:25.814 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.814 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.814 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:25.814 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.145550+0000", 2024-04-19T03:03:25.814 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0020259290000000001 2024-04-19T03:03:25.814 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.814 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.814 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:25.815 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.145676+0000", 2024-04-19T03:03:25.815 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000126406 2024-04-19T03:03:25.815 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.815 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.815 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:25.815 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.145802+0000", 2024-04-19T03:03:25.815 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000125974 2024-04-19T03:03:25.815 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.815 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.815 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:25.815 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.151030+0000", 2024-04-19T03:03:25.815 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0052276079999999999 2024-04-19T03:03:25.816 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.816 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.816 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:25.816 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.213998+0000", 2024-04-19T03:03:25.816 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.06296786 2024-04-19T03:03:25.816 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.816 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.816 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:03:25.816 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.214031+0000", 2024-04-19T03:03:25.816 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3387999999999999e-05 2024-04-19T03:03:25.816 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.816 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.816 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:25.817 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.214081+0000", 2024-04-19T03:03:25.817 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9316e-05 2024-04-19T03:03:25.817 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:25.817 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:25.817 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:25.817 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.817 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.817 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87108 5.e 5:7e197adc:::benchmark_data_smithi096_19531_object87107:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:25.817 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.223103+0000", 2024-04-19T03:03:25.817 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 62.549389499999997, 2024-04-19T03:03:25.817 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.044946887, 2024-04-19T03:03:25.817 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:25.817 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-19T03:03:25.818 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:25.818 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:25.818 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:25.818 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87108 2024-04-19T03:03:25.818 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.818 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:25.818 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.818 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:25.818 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.223103+0000", 2024-04-19T03:03:25.818 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:25.818 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.818 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.818 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:25.818 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.223103+0000", 2024-04-19T03:03:25.819 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:25.819 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.819 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.819 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:25.819 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.223102+0000", 2024-04-19T03:03:25.819 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:03:25.819 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.819 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.819 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:25.819 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.223156+0000", 2024-04-19T03:03:25.819 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3958000000000001e-05 2024-04-19T03:03:25.819 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.819 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.819 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:25.819 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.223166+0000", 2024-04-19T03:03:25.820 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.4809999999999995e-06 2024-04-19T03:03:25.820 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.820 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.820 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:25.820 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.223172+0000", 2024-04-19T03:03:25.820 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0140000000000004e-06 2024-04-19T03:03:25.820 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.820 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.820 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:25.820 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.227295+0000", 2024-04-19T03:03:25.820 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0041233420000000003 2024-04-19T03:03:25.820 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.820 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.820 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:25.821 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.227495+0000", 2024-04-19T03:03:25.821 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00019955299999999999 2024-04-19T03:03:25.821 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.821 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.821 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:25.821 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.227717+0000", 2024-04-19T03:03:25.821 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000221902 2024-04-19T03:03:25.821 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.821 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.821 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:25.821 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233189+0000", 2024-04-19T03:03:25.821 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0054718889999999997 2024-04-19T03:03:25.821 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.821 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.822 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:25.822 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.250529+0000", 2024-04-19T03:03:25.822 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.017340298000000001 2024-04-19T03:03:25.822 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.822 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.822 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:03:25.822 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.250539+0000", 2024-04-19T03:03:25.822 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0501e-05 2024-04-19T03:03:25.822 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.822 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.822 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:25.822 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.268003+0000", 2024-04-19T03:03:25.822 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.017463429 2024-04-19T03:03:25.822 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.823 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.823 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:25.823 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.268050+0000", 2024-04-19T03:03:25.823 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7466000000000003e-05 2024-04-19T03:03:25.823 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:25.823 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:25.823 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:25.823 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.823 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.823 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87118 5.b 5:d1bb4f3c:::benchmark_data_smithi096_19531_object87117:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:25.823 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.231082+0000", 2024-04-19T03:03:25.823 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 62.541410665999997, 2024-04-19T03:03:25.823 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.035789004, 2024-04-19T03:03:25.823 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:25.824 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-19T03:03:25.824 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:25.824 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:25.824 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:25.824 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87118 2024-04-19T03:03:25.824 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.824 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:25.824 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.824 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:25.824 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231082+0000", 2024-04-19T03:03:25.824 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:25.824 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.825 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.825 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:25.825 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231082+0000", 2024-04-19T03:03:25.825 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:25.825 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.825 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.825 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:25.825 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231081+0000", 2024-04-19T03:03:25.825 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:03:25.825 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.825 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.825 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:25.825 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231159+0000", 2024-04-19T03:03:25.826 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.7819999999999997e-05 2024-04-19T03:03:25.826 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.826 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.826 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:25.826 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231186+0000", 2024-04-19T03:03:25.826 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7126000000000001e-05 2024-04-19T03:03:25.826 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.826 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.826 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:25.826 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231193+0000", 2024-04-19T03:03:25.826 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7259999999999996e-06 2024-04-19T03:03:25.826 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.827 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.827 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:25.827 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231241+0000", 2024-04-19T03:03:25.827 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8123e-05 2024-04-19T03:03:25.827 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.827 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.827 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:25.827 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231354+0000", 2024-04-19T03:03:25.827 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0001133 2024-04-19T03:03:25.827 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.827 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.827 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:25.827 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231443+0000", 2024-04-19T03:03:25.828 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9167999999999997e-05 2024-04-19T03:03:25.828 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.828 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.828 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:25.828 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236498+0000", 2024-04-19T03:03:25.828 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0050545160000000002 2024-04-19T03:03:25.828 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.828 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.828 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:25.828 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.249681+0000", 2024-04-19T03:03:25.828 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013183321 2024-04-19T03:03:25.828 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.828 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.828 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:03:25.829 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.249693+0000", 2024-04-19T03:03:25.829 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1834999999999999e-05 2024-04-19T03:03:25.829 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.829 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.829 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:25.829 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266733+0000", 2024-04-19T03:03:25.829 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.017040408 2024-04-19T03:03:25.829 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.829 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.829 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:25.829 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266871+0000", 2024-04-19T03:03:25.829 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000137849 2024-04-19T03:03:25.829 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:25.829 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:25.830 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:25.830 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.830 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.830 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87121 5.b 5:d01822b8:::benchmark_data_smithi096_19531_object87120:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:25.830 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.233319+0000", 2024-04-19T03:03:25.830 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 62.539173802000001, 2024-04-19T03:03:25.830 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.033624198, 2024-04-19T03:03:25.830 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:25.830 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-19T03:03:25.830 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:25.830 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:25.830 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:25.831 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87121 2024-04-19T03:03:25.831 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.831 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:25.831 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.831 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:25.831 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233319+0000", 2024-04-19T03:03:25.831 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:25.831 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.831 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.831 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:25.831 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233319+0000", 2024-04-19T03:03:25.831 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:25.831 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.831 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.832 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:25.832 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233319+0000", 2024-04-19T03:03:25.832 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:25.832 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.832 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.832 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:25.832 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233364+0000", 2024-04-19T03:03:25.832 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5460999999999997e-05 2024-04-19T03:03:25.832 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.832 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.832 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:25.832 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233382+0000", 2024-04-19T03:03:25.833 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8148e-05 2024-04-19T03:03:25.833 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.833 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.833 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:25.833 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233390+0000", 2024-04-19T03:03:25.833 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5340000000000002e-06 2024-04-19T03:03:25.833 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.833 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.833 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:25.833 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233712+0000", 2024-04-19T03:03:25.833 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00032260500000000001 2024-04-19T03:03:25.833 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.834 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.834 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:25.834 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233829+0000", 2024-04-19T03:03:25.834 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011638599999999999 2024-04-19T03:03:25.834 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.834 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.834 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:25.834 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233959+0000", 2024-04-19T03:03:25.834 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013013900000000001 2024-04-19T03:03:25.834 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.834 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.834 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:25.834 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236515+0000", 2024-04-19T03:03:25.835 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0025562750000000002 2024-04-19T03:03:25.835 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.835 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.835 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:25.835 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.249723+0000", 2024-04-19T03:03:25.835 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013208176 2024-04-19T03:03:25.835 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.835 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.835 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:03:25.835 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.249728+0000", 2024-04-19T03:03:25.835 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6519999999999997e-06 2024-04-19T03:03:25.835 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.835 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.836 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:25.836 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266837+0000", 2024-04-19T03:03:25.836 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0171087059999999 2024-04-19T03:03:25.836 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.836 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.836 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:25.836 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266943+0000", 2024-04-19T03:03:25.836 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000106604 2024-04-19T03:03:25.836 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:25.836 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:25.836 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:25.836 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.836 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.837 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87124 5.8 5:14819ad7:::benchmark_data_smithi096_19531_object87123:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:25.837 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.235886+0000", 2024-04-19T03:03:25.837 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 62.536606378000002, 2024-04-19T03:03:25.837 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0315451179999999, 2024-04-19T03:03:25.837 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:25.837 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-19T03:03:25.837 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:25.837 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:25.837 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:25.837 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87124 2024-04-19T03:03:25.837 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.837 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:25.837 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.838 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:25.838 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.235886+0000", 2024-04-19T03:03:25.838 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:25.838 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.838 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.838 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:25.838 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.235886+0000", 2024-04-19T03:03:25.838 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:25.838 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.838 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.838 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:25.838 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.235886+0000", 2024-04-19T03:03:25.839 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:03:25.839 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.839 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.839 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:25.839 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.235934+0000", 2024-04-19T03:03:25.839 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8384000000000003e-05 2024-04-19T03:03:25.839 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.839 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.839 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:25.839 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.235945+0000", 2024-04-19T03:03:25.839 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0671e-05 2024-04-19T03:03:25.839 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.839 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.839 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:25.840 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.235952+0000", 2024-04-19T03:03:25.840 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3089999999999998e-06 2024-04-19T03:03:25.840 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.840 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.840 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:25.840 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.237067+0000", 2024-04-19T03:03:25.840 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001115263 2024-04-19T03:03:25.840 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.840 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.840 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:25.840 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.237188+0000", 2024-04-19T03:03:25.840 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000121258 2024-04-19T03:03:25.840 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.840 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.841 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:25.841 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.237316+0000", 2024-04-19T03:03:25.841 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000128071 2024-04-19T03:03:25.841 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.841 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.841 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:25.841 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240744+0000", 2024-04-19T03:03:25.841 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0034275629999999998 2024-04-19T03:03:25.841 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.841 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.841 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:25.841 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.252517+0000", 2024-04-19T03:03:25.841 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011772991999999999 2024-04-19T03:03:25.841 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.842 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.842 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:03:25.842 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.252523+0000", 2024-04-19T03:03:25.842 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3640000000000004e-06 2024-04-19T03:03:25.842 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.842 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.842 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:25.842 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.267290+0000", 2024-04-19T03:03:25.842 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0147665690000001 2024-04-19T03:03:25.842 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.842 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.842 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:25.842 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.267432+0000", 2024-04-19T03:03:25.843 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014165299999999999 2024-04-19T03:03:25.843 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:25.843 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:25.843 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:25.843 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.843 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.843 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87129 5.0 5:02667e01:::benchmark_data_smithi096_19531_object87128:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:25.843 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.236466+0000", 2024-04-19T03:03:25.843 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 62.536026382000003, 2024-04-19T03:03:25.843 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0301534510000001, 2024-04-19T03:03:25.843 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:25.843 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-19T03:03:25.843 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:25.844 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:25.844 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:25.844 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87129 2024-04-19T03:03:25.844 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.844 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:25.844 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.844 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:25.844 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236466+0000", 2024-04-19T03:03:25.844 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:25.844 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.844 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.844 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:25.844 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236466+0000", 2024-04-19T03:03:25.845 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:25.845 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.845 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.845 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:25.845 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236465+0000", 2024-04-19T03:03:25.845 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:03:25.845 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.845 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.845 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:25.845 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236566+0000", 2024-04-19T03:03:25.845 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010047000000000001 2024-04-19T03:03:25.845 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.845 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.846 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:25.846 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236577+0000", 2024-04-19T03:03:25.846 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1772e-05 2024-04-19T03:03:25.846 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.846 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.846 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:25.846 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236584+0000", 2024-04-19T03:03:25.846 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0530000000000003e-06 2024-04-19T03:03:25.846 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.846 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.846 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:25.846 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.237023+0000", 2024-04-19T03:03:25.846 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000439703 2024-04-19T03:03:25.847 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.847 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.847 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:25.847 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.237207+0000", 2024-04-19T03:03:25.847 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000183692 2024-04-19T03:03:25.847 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.847 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.847 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:25.847 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.237373+0000", 2024-04-19T03:03:25.847 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016623500000000001 2024-04-19T03:03:25.847 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.847 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.847 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:25.848 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.241461+0000", 2024-04-19T03:03:25.848 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0040883050000000004 2024-04-19T03:03:25.848 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.848 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.848 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:25.848 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.252500+0000", 2024-04-19T03:03:25.848 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011038450999999999 2024-04-19T03:03:25.848 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.848 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.848 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:03:25.848 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.252507+0000", 2024-04-19T03:03:25.848 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2439999999999996e-06 2024-04-19T03:03:25.849 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.849 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.849 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:25.849 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266538+0000", 2024-04-19T03:03:25.849 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.014031184 2024-04-19T03:03:25.849 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.849 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.849 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:25.849 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266620+0000", 2024-04-19T03:03:25.849 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1600000000000005e-05 2024-04-19T03:03:25.849 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:25.849 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:25.849 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:25.850 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.850 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.850 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87135 5.4 5:2a97e7b7:::benchmark_data_smithi096_19531_object87134:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:25.850 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.240884+0000", 2024-04-19T03:03:25.850 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 62.531608925, 2024-04-19T03:03:25.850 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.025708931, 2024-04-19T03:03:25.850 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:25.850 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-19T03:03:25.850 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:25.850 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:25.850 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:25.851 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87135 2024-04-19T03:03:25.851 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.851 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:25.851 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.851 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:25.851 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240884+0000", 2024-04-19T03:03:25.851 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:25.851 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.851 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.851 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:25.851 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240884+0000", 2024-04-19T03:03:25.851 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:25.852 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.852 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.852 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:25.852 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240883+0000", 2024-04-19T03:03:25.852 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:03:25.852 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.852 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.852 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:25.852 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240933+0000", 2024-04-19T03:03:25.852 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9969999999999998e-05 2024-04-19T03:03:25.852 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.852 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.853 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:25.853 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240946+0000", 2024-04-19T03:03:25.853 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2943e-05 2024-04-19T03:03:25.853 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.853 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.853 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:25.853 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240952+0000", 2024-04-19T03:03:25.853 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8930000000000002e-06 2024-04-19T03:03:25.853 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.853 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.853 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:25.853 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240994+0000", 2024-04-19T03:03:25.853 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2753999999999998e-05 2024-04-19T03:03:25.853 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.854 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.854 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:25.854 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.241092+0000", 2024-04-19T03:03:25.854 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.7447000000000004e-05 2024-04-19T03:03:25.854 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.854 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.854 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:25.854 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.241183+0000", 2024-04-19T03:03:25.854 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1163999999999997e-05 2024-04-19T03:03:25.854 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.854 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.854 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:25.855 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.254672+0000", 2024-04-19T03:03:25.855 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.01348864 2024-04-19T03:03:25.855 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.855 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.855 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:03:25.855 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.254681+0000", 2024-04-19T03:03:25.855 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.3789999999999995e-06 2024-04-19T03:03:25.855 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.855 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.855 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:25.855 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266456+0000", 2024-04-19T03:03:25.855 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.011774621 2024-04-19T03:03:25.855 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.855 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.856 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:25.856 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266593+0000", 2024-04-19T03:03:25.856 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013737600000000001 2024-04-19T03:03:25.856 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:25.856 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:25.856 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:25.856 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.856 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.856 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87136 5.4 5:212411bc:::benchmark_data_smithi096_19531_object87135:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:25.856 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.240962+0000", 2024-04-19T03:03:25.856 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 62.531531049000002, 2024-04-19T03:03:25.856 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.025738, 2024-04-19T03:03:25.856 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:25.857 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-19T03:03:25.857 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:25.857 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:25.857 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:25.857 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87136 2024-04-19T03:03:25.857 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.857 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:25.857 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.857 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:25.857 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240962+0000", 2024-04-19T03:03:25.857 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:25.857 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.857 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.858 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:25.858 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240962+0000", 2024-04-19T03:03:25.858 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:25.858 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.858 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.858 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:25.858 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240961+0000", 2024-04-19T03:03:25.858 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:25.858 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.858 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.858 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:25.858 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240995+0000", 2024-04-19T03:03:25.858 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3868000000000002e-05 2024-04-19T03:03:25.859 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.859 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.859 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:25.859 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.241001+0000", 2024-04-19T03:03:25.859 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.322e-06 2024-04-19T03:03:25.859 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.859 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.859 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:25.859 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.241004+0000", 2024-04-19T03:03:25.859 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3510000000000002e-06 2024-04-19T03:03:25.859 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.859 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.859 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:25.859 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247131+0000", 2024-04-19T03:03:25.859 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0061270869999999998 2024-04-19T03:03:25.860 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.860 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.860 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:25.860 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247322+0000", 2024-04-19T03:03:25.860 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000191015 2024-04-19T03:03:25.860 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.860 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.860 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:25.860 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247542+0000", 2024-04-19T03:03:25.860 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00022030199999999999 2024-04-19T03:03:25.860 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.860 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.860 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:25.861 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.254709+0000", 2024-04-19T03:03:25.861 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0071662660000000001 2024-04-19T03:03:25.861 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.861 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.861 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:03:25.861 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.254716+0000", 2024-04-19T03:03:25.861 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3860000000000001e-06 2024-04-19T03:03:25.861 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.861 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.861 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:25.861 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266619+0000", 2024-04-19T03:03:25.861 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0119031030000001 2024-04-19T03:03:25.861 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.861 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.862 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:25.862 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266700+0000", 2024-04-19T03:03:25.862 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0764000000000001e-05 2024-04-19T03:03:25.862 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:25.862 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:25.862 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:25.862 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.862 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.862 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87138 5.e 5:7b1f1c20:::benchmark_data_smithi096_19531_object87137:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:25.862 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.247862+0000", 2024-04-19T03:03:25.862 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 62.524630975000001, 2024-04-19T03:03:25.862 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.024457079, 2024-04-19T03:03:25.862 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:25.862 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:25.863 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:25.863 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:25.863 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:25.863 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87138 2024-04-19T03:03:25.863 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.863 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:25.863 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.863 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:25.863 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247862+0000", 2024-04-19T03:03:25.863 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:25.863 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.863 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.863 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:25.863 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247862+0000", 2024-04-19T03:03:25.864 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:25.864 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.864 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.864 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:25.864 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247860+0000", 2024-04-19T03:03:25.864 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999981 2024-04-19T03:03:25.864 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.864 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.864 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:25.864 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247909+0000", 2024-04-19T03:03:25.864 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9150999999999997e-05 2024-04-19T03:03:25.864 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.864 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.865 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:25.865 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247925+0000", 2024-04-19T03:03:25.865 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5761999999999999e-05 2024-04-19T03:03:25.865 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.865 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.865 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:25.865 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247936+0000", 2024-04-19T03:03:25.865 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1144e-05 2024-04-19T03:03:25.865 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.865 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.865 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:25.865 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.250590+0000", 2024-04-19T03:03:25.865 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.002653678 2024-04-19T03:03:25.865 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.866 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.866 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:03:25.866 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.250599+0000", 2024-04-19T03:03:25.866 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9039999999999998e-06 2024-04-19T03:03:25.866 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.866 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.866 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:25.866 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.268151+0000", 2024-04-19T03:03:25.866 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0175523449999999 2024-04-19T03:03:25.866 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.866 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.866 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:25.866 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.268285+0000", 2024-04-19T03:03:25.867 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013415599999999999 2024-04-19T03:03:25.867 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.867 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.867 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:25.867 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.272238+0000", 2024-04-19T03:03:25.867 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0039533019999999997 2024-04-19T03:03:25.867 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.867 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.867 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:03:25.867 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.272274+0000", 2024-04-19T03:03:25.867 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5352000000000003e-05 2024-04-19T03:03:25.868 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.868 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.868 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:25.868 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.272319+0000", 2024-04-19T03:03:25.868 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5281999999999998e-05 2024-04-19T03:03:25.868 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:25.868 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:25.868 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:25.868 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.868 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.868 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:158371 5.8 5:11a83024:::benchmark_data_smithi096_19531_object44921:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-19T03:03:25.868 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:58.125869+0000", 2024-04-19T03:03:25.868 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 27.646624110000001, 2024-04-19T03:03:25.868 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074532857999999994, 2024-04-19T03:03:25.869 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:25.869 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:25.869 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:25.869 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:25.869 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:25.869 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 158371 2024-04-19T03:03:25.869 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.869 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:25.869 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.869 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:25.869 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125869+0000", 2024-04-19T03:03:25.869 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:25.869 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.869 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.870 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:25.870 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125869+0000", 2024-04-19T03:03:25.870 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:25.870 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.870 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.870 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:25.870 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125868+0000", 2024-04-19T03:03:25.870 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:03:25.870 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.870 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.870 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:25.870 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125874+0000", 2024-04-19T03:03:25.870 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7120000000000003e-06 2024-04-19T03:03:25.870 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.871 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.871 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:25.871 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125885+0000", 2024-04-19T03:03:25.871 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0665999999999999e-05 2024-04-19T03:03:25.871 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.871 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.871 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:25.871 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125901+0000", 2024-04-19T03:03:25.871 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6463000000000001e-05 2024-04-19T03:03:25.871 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.871 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.871 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:25.871 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125956+0000", 2024-04-19T03:03:25.871 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4728000000000002e-05 2024-04-19T03:03:25.872 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.872 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.872 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:25.872 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.126050+0000", 2024-04-19T03:03:25.872 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.3534000000000003e-05 2024-04-19T03:03:25.872 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.872 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.872 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:25.872 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.200187+0000", 2024-04-19T03:03:25.872 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074136933000000002 2024-04-19T03:03:25.872 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.872 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.872 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:03:25.872 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.200260+0000", 2024-04-19T03:03:25.873 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3090999999999995e-05 2024-04-19T03:03:25.873 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.873 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.873 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:25.873 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.200402+0000", 2024-04-19T03:03:25.873 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014193699999999999 2024-04-19T03:03:25.873 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:25.873 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:25.873 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:25.873 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.873 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.873 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:158372 5.0 5:0473aa5f:::benchmark_data_smithi096_19531_object44922:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-19T03:03:25.873 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:58.125924+0000", 2024-04-19T03:03:25.873 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 27.646568503000001, 2024-04-19T03:03:25.873 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074247490999999999, 2024-04-19T03:03:25.874 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:25.874 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:25.874 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:25.874 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:25.874 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:25.874 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 158372 2024-04-19T03:03:25.874 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.874 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:25.874 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.874 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:25.874 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125924+0000", 2024-04-19T03:03:25.874 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:25.874 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.875 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.875 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:25.875 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125924+0000", 2024-04-19T03:03:25.875 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:25.875 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.875 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.875 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:25.875 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125924+0000", 2024-04-19T03:03:25.875 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:25.875 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.875 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.875 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:25.875 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125927+0000", 2024-04-19T03:03:25.875 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5389999999999999e-06 2024-04-19T03:03:25.876 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.876 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.876 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:25.876 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125935+0000", 2024-04-19T03:03:25.876 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3259999999999998e-06 2024-04-19T03:03:25.876 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.876 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.876 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:25.876 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125940+0000", 2024-04-19T03:03:25.876 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6980000000000003e-06 2024-04-19T03:03:25.876 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.876 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.876 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:25.876 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125982+0000", 2024-04-19T03:03:25.877 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1337000000000001e-05 2024-04-19T03:03:25.877 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.877 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.877 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:25.877 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.126075+0000", 2024-04-19T03:03:25.877 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.3579999999999995e-05 2024-04-19T03:03:25.877 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.877 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.877 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:25.877 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.199953+0000", 2024-04-19T03:03:25.877 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073877604999999999 2024-04-19T03:03:25.877 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.877 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.877 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:03:25.878 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.200022+0000", 2024-04-19T03:03:25.878 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.8824000000000004e-05 2024-04-19T03:03:25.878 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.878 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.878 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:25.878 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.200172+0000", 2024-04-19T03:03:25.878 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015017700000000001 2024-04-19T03:03:25.878 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:25.878 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:25.878 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:25.878 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.878 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.878 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:158374 5.e 5:76be57a5:::benchmark_data_smithi096_19531_object44924:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-19T03:03:25.878 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:58.125988+0000", 2024-04-19T03:03:25.879 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 27.646505004000002, 2024-04-19T03:03:25.879 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.067843332000000006, 2024-04-19T03:03:25.879 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:25.879 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:25.879 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:25.879 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:25.879 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:25.879 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 158374 2024-04-19T03:03:25.879 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.879 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:25.879 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.879 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:25.879 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125988+0000", 2024-04-19T03:03:25.880 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:25.880 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.880 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.880 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:25.880 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125988+0000", 2024-04-19T03:03:25.880 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:25.880 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.880 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.880 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:25.880 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125987+0000", 2024-04-19T03:03:25.880 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:25.880 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.880 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.881 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:25.881 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125990+0000", 2024-04-19T03:03:25.881 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7989999999999998e-06 2024-04-19T03:03:25.881 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.881 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.881 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:25.881 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125996+0000", 2024-04-19T03:03:25.881 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.302e-06 2024-04-19T03:03:25.881 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.881 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.881 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:25.882 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.126001+0000", 2024-04-19T03:03:25.882 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.843e-06 2024-04-19T03:03:25.882 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.882 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.882 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:25.882 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.126047+0000", 2024-04-19T03:03:25.882 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6066000000000002e-05 2024-04-19T03:03:25.882 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.882 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.882 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:25.883 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.126171+0000", 2024-04-19T03:03:25.883 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012359099999999999 2024-04-19T03:03:25.883 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.883 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.883 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:25.883 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.193709+0000", 2024-04-19T03:03:25.883 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.067538099000000004 2024-04-19T03:03:25.883 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.883 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.883 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:03:25.883 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.193766+0000", 2024-04-19T03:03:25.883 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6869e-05 2024-04-19T03:03:25.883 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.883 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.884 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:25.884 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.193831+0000", 2024-04-19T03:03:25.884 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5273999999999999e-05 2024-04-19T03:03:25.884 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:25.884 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:25.884 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:25.884 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.884 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.884 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4755.0:158376 5.9 e56/22 5:9e73c076:::benchmark_data_smithi096_19531_object44926:head v 56'9663, mlcod=56'9661)", 2024-04-19T03:03:25.884 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:58.127307+0000", 2024-04-19T03:03:25.884 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 27.645185773000001, 2024-04-19T03:03:25.885 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069002716000000006, 2024-04-19T03:03:25.885 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:25.885 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:25.885 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:25.885 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.885 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:25.885 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.127307+0000", 2024-04-19T03:03:25.885 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:25.885 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.885 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.885 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:25.885 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.127307+0000", 2024-04-19T03:03:25.885 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:25.886 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.886 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.886 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:25.886 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.127306+0000", 2024-04-19T03:03:25.886 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:03:25.886 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.886 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.886 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:25.886 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.127316+0000", 2024-04-19T03:03:25.886 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.3039999999999994e-06 2024-04-19T03:03:25.886 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.887 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.887 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:25.887 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.127326+0000", 2024-04-19T03:03:25.887 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0009e-05 2024-04-19T03:03:25.887 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.887 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.887 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:25.887 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.127332+0000", 2024-04-19T03:03:25.887 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5880000000000003e-06 2024-04-19T03:03:25.887 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.887 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.887 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:25.887 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.127383+0000", 2024-04-19T03:03:25.887 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0516000000000002e-05 2024-04-19T03:03:25.888 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.888 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.888 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:25.888 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.127403+0000", 2024-04-19T03:03:25.888 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0547000000000002e-05 2024-04-19T03:03:25.888 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.888 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.888 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:03:25.888 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.196280+0000", 2024-04-19T03:03:25.888 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.068876863999999996 2024-04-19T03:03:25.888 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.888 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.888 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:25.889 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.196310+0000", 2024-04-19T03:03:25.889 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9762999999999999e-05 2024-04-19T03:03:25.889 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:25.889 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:25.889 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:25.889 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.889 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.889 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:158383 5.0 5:026717eb:::benchmark_data_smithi096_19531_object44933:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-19T03:03:25.889 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:58.130494+0000", 2024-04-19T03:03:25.889 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 27.641998647000001, 2024-04-19T03:03:25.889 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.070135775999999997, 2024-04-19T03:03:25.889 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:25.890 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:25.890 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:25.890 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:25.890 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:25.890 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 158383 2024-04-19T03:03:25.890 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.890 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:25.890 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.890 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:25.890 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.130494+0000", 2024-04-19T03:03:25.890 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:25.890 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.891 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.891 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:25.891 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.130494+0000", 2024-04-19T03:03:25.891 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:25.891 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.891 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.891 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:25.891 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.130493+0000", 2024-04-19T03:03:25.891 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:03:25.891 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.891 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.891 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:25.891 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.130500+0000", 2024-04-19T03:03:25.891 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5490000000000003e-06 2024-04-19T03:03:25.892 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.892 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.892 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:25.892 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.190401+0000", 2024-04-19T03:03:25.892 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.059901668999999998 2024-04-19T03:03:25.892 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.892 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.892 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:25.892 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.190421+0000", 2024-04-19T03:03:25.892 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0288e-05 2024-04-19T03:03:25.892 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.892 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.892 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:25.893 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.190536+0000", 2024-04-19T03:03:25.893 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000114783 2024-04-19T03:03:25.893 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.893 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.893 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:25.893 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.190904+0000", 2024-04-19T03:03:25.893 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00036773900000000001 2024-04-19T03:03:25.893 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.893 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.893 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:25.893 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.200417+0000", 2024-04-19T03:03:25.893 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0095128899999999995 2024-04-19T03:03:25.894 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.894 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.894 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:03:25.894 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.200489+0000", 2024-04-19T03:03:25.894 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2554999999999999e-05 2024-04-19T03:03:25.894 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:25.894 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:25.894 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:25.894 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.200630+0000", 2024-04-19T03:03:25.894 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014055299999999999 2024-04-19T03:03:25.894 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:25.894 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:25.894 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:25.894 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:25.895 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:25.895 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-19T03:03:25.895 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-19T03:03:25.897 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T03:03:25.897 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:03:25.894+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:03:25.997 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:03:25.994+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:03:26.024 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-04-19T03:03:26.024 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [ 2024-04-19T03:03:26.025 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:26.025 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:225389 5.d 5:bc1ea2f7:::benchmark_data_smithi096_19531_object111939:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-19T03:03:26.025 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:03:26.016891+0000", 2024-04-19T03:03:26.025 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0068757619999999997, 2024-04-19T03:03:26.025 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0068934310000000002, 2024-04-19T03:03:26.025 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:26.025 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:03:26.025 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:26.025 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:26.025 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:26.025 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 225389 2024-04-19T03:03:26.025 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:26.026 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:26.026 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:26.026 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:26.026 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:26.016891+0000", 2024-04-19T03:03:26.026 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:26.026 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:26.026 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:26.026 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:26.026 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:26.016891+0000", 2024-04-19T03:03:26.026 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:26.026 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:26.027 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:26.027 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:26.027 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:26.016890+0000", 2024-04-19T03:03:26.027 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:26.027 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:26.027 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:26.027 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:26.027 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:26.016894+0000", 2024-04-19T03:03:26.027 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4620000000000001e-06 2024-04-19T03:03:26.027 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:26.027 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:26.027 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:26.027 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:26.016901+0000", 2024-04-19T03:03:26.027 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.841e-06 2024-04-19T03:03:26.028 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:26.028 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:26.028 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:26.028 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:26.016905+0000", 2024-04-19T03:03:26.028 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7510000000000002e-06 2024-04-19T03:03:26.028 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:26.028 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:26.028 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:26.028 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:26.017743+0000", 2024-04-19T03:03:26.028 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00083801299999999997 2024-04-19T03:03:26.028 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:26.028 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:26.028 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:26.029 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:26.017900+0000", 2024-04-19T03:03:26.029 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000156959 2024-04-19T03:03:26.029 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:26.029 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:26.029 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:03:26.029 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:26.018032+0000", 2024-04-19T03:03:26.029 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000131858 2024-04-19T03:03:26.029 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:26.030 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:26.030 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:26.030 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:26.023383+0000", 2024-04-19T03:03:26.030 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0053506939999999996 2024-04-19T03:03:26.030 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:26.030 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:26.030 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:26.030 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:26.030 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:26.030 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:225390 5.5 5:a0494bd0:::benchmark_data_smithi096_19531_object111940:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-19T03:03:26.030 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:03:26.016923+0000", 2024-04-19T03:03:26.030 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0068433649999999997, 2024-04-19T03:03:26.031 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0069099579999999999, 2024-04-19T03:03:26.031 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:26.031 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-04-19T03:03:26.031 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:26.031 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:26.031 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:26.031 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 225390 2024-04-19T03:03:26.031 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:26.031 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:26.031 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:26.031 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:26.031 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:26.016923+0000", 2024-04-19T03:03:26.031 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:26.032 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:26.032 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:26.032 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:26.032 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:26.016923+0000", 2024-04-19T03:03:26.032 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:26.032 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:26.032 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:26.032 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:26.032 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:26.016923+0000", 2024-04-19T03:03:26.032 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:26.032 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:26.032 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:26.033 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:26.033 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:26.016925+0000", 2024-04-19T03:03:26.033 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.2749999999999998e-06 2024-04-19T03:03:26.033 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:26.033 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:26.033 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:26.033 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:26.016929+0000", 2024-04-19T03:03:26.033 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4340000000000002e-06 2024-04-19T03:03:26.033 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:26.033 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:26.033 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:26.033 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:26.016933+0000", 2024-04-19T03:03:26.034 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.1080000000000001e-06 2024-04-19T03:03:26.034 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:26.034 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:26.034 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:26.034 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:26.017717+0000", 2024-04-19T03:03:26.034 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00078484799999999999 2024-04-19T03:03:26.034 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:26.034 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:26.034 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:26.034 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:26.017847+0000", 2024-04-19T03:03:26.034 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000129386 2024-04-19T03:03:26.034 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:26.035 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:26.035 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:26.035 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:26.035 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:26.035 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:225391 5.2 5:49291934:::benchmark_data_smithi096_19531_object111941:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-19T03:03:26.035 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:03:26.018398+0000", 2024-04-19T03:03:26.035 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.005368177, 2024-04-19T03:03:26.035 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0054697920000000002, 2024-04-19T03:03:26.035 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:26.035 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-04-19T03:03:26.035 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:26.035 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:26.036 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:26.036 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 225391 2024-04-19T03:03:26.036 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:26.036 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:26.036 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:26.036 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:26.036 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:26.018398+0000", 2024-04-19T03:03:26.036 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:26.036 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:26.036 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:26.036 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:26.036 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:26.018398+0000", 2024-04-19T03:03:26.037 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:26.037 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:26.037 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:26.037 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:26.037 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:26.018397+0000", 2024-04-19T03:03:26.037 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:03:26.037 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:26.037 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:26.037 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:26.037 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:26.018402+0000", 2024-04-19T03:03:26.037 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9840000000000001e-06 2024-04-19T03:03:26.037 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:26.038 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:26.038 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:26.038 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:26.018415+0000", 2024-04-19T03:03:26.038 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2308e-05 2024-04-19T03:03:26.038 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:26.038 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:26.038 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:26.038 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:26.018421+0000", 2024-04-19T03:03:26.038 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.2519999999999996e-06 2024-04-19T03:03:26.038 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:26.038 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:26.039 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:26.039 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:26.018477+0000", 2024-04-19T03:03:26.039 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5733999999999999e-05 2024-04-19T03:03:26.039 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:26.039 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:26.039 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:26.039 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:26.018611+0000", 2024-04-19T03:03:26.039 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00013460300000000001 2024-04-19T03:03:26.039 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:26.039 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:26.039 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:26.039 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:26.039 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:26.040 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:225392 5.1 5:8256447f:::benchmark_data_smithi096_19531_object111942:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-19T03:03:26.040 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:03:26.018433+0000", 2024-04-19T03:03:26.040 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0053338450000000003, 2024-04-19T03:03:26.040 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0054696670000000001, 2024-04-19T03:03:26.040 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:26.040 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-04-19T03:03:26.040 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:26.040 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:26.040 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:26.040 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 225392 2024-04-19T03:03:26.040 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:26.040 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:26.040 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:26.040 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:26.041 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:26.018433+0000", 2024-04-19T03:03:26.041 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:26.041 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:26.041 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:26.041 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:26.041 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:26.018433+0000", 2024-04-19T03:03:26.041 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:26.041 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:26.041 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:26.041 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:26.041 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:26.018432+0000", 2024-04-19T03:03:26.041 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:26.042 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:26.042 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:26.042 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:26.042 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:26.018435+0000", 2024-04-19T03:03:26.042 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.7310000000000002e-06 2024-04-19T03:03:26.042 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:26.042 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:26.042 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:26.042 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:26.018449+0000", 2024-04-19T03:03:26.042 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4365000000000001e-05 2024-04-19T03:03:26.042 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:26.042 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:26.042 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:26.043 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:26.018455+0000", 2024-04-19T03:03:26.043 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.614e-06 2024-04-19T03:03:26.043 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:26.043 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:26.043 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:26.043 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:26.020848+0000", 2024-04-19T03:03:26.043 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0023935179999999999 2024-04-19T03:03:26.043 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:26.043 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:26.043 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:26.043 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:26.021048+0000", 2024-04-19T03:03:26.043 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00019918 2024-04-19T03:03:26.043 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:26.043 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:26.044 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:26.044 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:26.044 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:26.044 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:225394 5.3 5:c1e27592:::benchmark_data_smithi096_19531_object111944:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-19T03:03:26.044 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:03:26.018467+0000", 2024-04-19T03:03:26.044 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0052990329999999999, 2024-04-19T03:03:26.044 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0054716779999999998, 2024-04-19T03:03:26.044 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:26.044 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-04-19T03:03:26.044 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:26.044 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:26.044 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:26.044 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 225394 2024-04-19T03:03:26.045 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:26.045 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:26.045 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:26.045 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:26.045 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:26.018467+0000", 2024-04-19T03:03:26.045 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:26.045 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:26.045 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:26.045 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:26.045 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:26.018467+0000", 2024-04-19T03:03:26.045 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:26.045 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:26.045 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:26.045 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:26.046 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:26.018467+0000", 2024-04-19T03:03:26.046 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:26.046 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:26.046 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:26.046 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:26.046 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:26.018470+0000", 2024-04-19T03:03:26.046 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.5689999999999999e-06 2024-04-19T03:03:26.046 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:26.046 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:26.046 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:26.046 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:26.018476+0000", 2024-04-19T03:03:26.046 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1840000000000004e-06 2024-04-19T03:03:26.046 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:26.047 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:26.047 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:26.047 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:26.018480+0000", 2024-04-19T03:03:26.047 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3769999999999998e-06 2024-04-19T03:03:26.047 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:26.047 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:26.047 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:26.047 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:26.018538+0000", 2024-04-19T03:03:26.047 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7705999999999999e-05 2024-04-19T03:03:26.047 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:26.047 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:26.047 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:26.047 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:26.018688+0000", 2024-04-19T03:03:26.047 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00015060799999999999 2024-04-19T03:03:26.047 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:26.048 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:26.048 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:26.048 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:26.048 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:26.048 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:225395 5.d 5:bbaa4bcf:::benchmark_data_smithi096_19531_object111945:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-19T03:03:26.048 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:03:26.019926+0000", 2024-04-19T03:03:26.048 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0038405800000000001, 2024-04-19T03:03:26.048 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0040503040000000002, 2024-04-19T03:03:26.048 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:26.048 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:03:26.048 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:26.048 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:26.048 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:26.048 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 225395 2024-04-19T03:03:26.048 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:26.049 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:26.049 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:26.049 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:26.049 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:26.019926+0000", 2024-04-19T03:03:26.049 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:26.049 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:26.049 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:26.049 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:26.049 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:26.019926+0000", 2024-04-19T03:03:26.049 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:26.049 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:26.050 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:26.050 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:26.050 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:26.019925+0000", 2024-04-19T03:03:26.050 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:03:26.050 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:26.050 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:26.050 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:26.050 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:26.019930+0000", 2024-04-19T03:03:26.050 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8999999999999997e-06 2024-04-19T03:03:26.050 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:26.050 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:26.050 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:26.050 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:26.019941+0000", 2024-04-19T03:03:26.051 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1070000000000001e-05 2024-04-19T03:03:26.051 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:26.051 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:26.051 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:26.051 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:26.019946+0000", 2024-04-19T03:03:26.051 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4550000000000003e-06 2024-04-19T03:03:26.051 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:26.051 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:26.051 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:26.051 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:26.019984+0000", 2024-04-19T03:03:26.051 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7526e-05 2024-04-19T03:03:26.051 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:26.052 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:26.052 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:26.052 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:26.020193+0000", 2024-04-19T03:03:26.052 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00020944 2024-04-19T03:03:26.052 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:26.052 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:26.052 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:03:26.052 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:26.020344+0000", 2024-04-19T03:03:26.052 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000150187 2024-04-19T03:03:26.052 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:26.052 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:26.052 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:26.052 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:26.052 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:26.053 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:225396 5.5 5:a61c982f:::benchmark_data_smithi096_19531_object111946:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-19T03:03:26.053 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:03:26.021078+0000", 2024-04-19T03:03:26.053 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0026888799999999998, 2024-04-19T03:03:26.053 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0029349710000000002, 2024-04-19T03:03:26.053 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:26.053 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-04-19T03:03:26.053 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:26.053 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:26.053 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:26.053 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 225396 2024-04-19T03:03:26.053 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:26.053 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:26.054 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:26.054 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:26.054 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:26.021078+0000", 2024-04-19T03:03:26.054 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:26.054 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:26.054 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:26.054 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:26.054 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:26.021078+0000", 2024-04-19T03:03:26.054 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:26.054 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:26.054 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:26.054 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:26.054 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:26.021076+0000", 2024-04-19T03:03:26.055 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:03:26.055 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:26.055 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:26.055 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:26.055 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:26.021082+0000", 2024-04-19T03:03:26.055 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.7169999999999996e-06 2024-04-19T03:03:26.055 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:26.055 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:26.055 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:26.055 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:26.021092+0000", 2024-04-19T03:03:26.055 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0196e-05 2024-04-19T03:03:26.055 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:26.056 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:26.056 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:26.056 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:26.021100+0000", 2024-04-19T03:03:26.056 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8849999999999999e-06 2024-04-19T03:03:26.056 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:26.056 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:26.056 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:26.056 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:26.021145+0000", 2024-04-19T03:03:26.056 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4650000000000001e-05 2024-04-19T03:03:26.056 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:26.057 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:26.057 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:26.057 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:26.021265+0000", 2024-04-19T03:03:26.057 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000120155 2024-04-19T03:03:26.057 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:26.057 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:26.057 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:26.057 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:26.057 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:26.057 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:225399 5.9 5:91c5a896:::benchmark_data_smithi096_19531_object111949:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-19T03:03:26.057 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:03:26.021248+0000", 2024-04-19T03:03:26.057 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.0025184920000000002, 2024-04-19T03:03:26.057 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.002800505, 2024-04-19T03:03:26.057 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:26.058 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "waiting for sub ops", 2024-04-19T03:03:26.058 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:26.058 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:26.058 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:26.058 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 225399 2024-04-19T03:03:26.058 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:26.058 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:26.058 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:26.058 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:26.058 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:26.021248+0000", 2024-04-19T03:03:26.058 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:26.058 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:26.059 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:26.059 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:26.059 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:26.021248+0000", 2024-04-19T03:03:26.059 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:26.059 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:26.059 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:26.059 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:26.059 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:26.021247+0000", 2024-04-19T03:03:26.059 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:26.059 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:26.059 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:26.059 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:26.059 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:26.021251+0000", 2024-04-19T03:03:26.059 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9609999999999999e-06 2024-04-19T03:03:26.059 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:26.060 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:26.060 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:26.060 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:26.021258+0000", 2024-04-19T03:03:26.060 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7039999999999997e-06 2024-04-19T03:03:26.060 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:26.060 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:26.060 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:26.060 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:26.021263+0000", 2024-04-19T03:03:26.060 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2950000000000001e-06 2024-04-19T03:03:26.060 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:26.060 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:26.060 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:26.060 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:26.021293+0000", 2024-04-19T03:03:26.060 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.9539e-05 2024-04-19T03:03:26.060 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:26.060 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:26.061 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:26.061 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:26.021385+0000", 2024-04-19T03:03:26.061 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.2561999999999999e-05 2024-04-19T03:03:26.061 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:26.061 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:26.061 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:03:26.061 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:26.021461+0000", 2024-04-19T03:03:26.061 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.5922999999999998e-05 2024-04-19T03:03:26.061 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:26.061 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:26.061 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:26.061 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:26.061 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:26.061 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:225400 5.2 5:43b53c9e:::benchmark_data_smithi096_19531_object111950:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-19T03:03:26.062 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:03:26.022609+0000", 2024-04-19T03:03:26.062 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 0.00115705, 2024-04-19T03:03:26.062 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0014774689999999999, 2024-04-19T03:03:26.062 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:26.062 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-04-19T03:03:26.062 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:26.062 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:26.062 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:26.062 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 225400 2024-04-19T03:03:26.062 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:26.062 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:26.062 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:26.062 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:26.062 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:26.022609+0000", 2024-04-19T03:03:26.063 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:26.063 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:26.063 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:26.063 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:26.063 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:26.022609+0000", 2024-04-19T03:03:26.063 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:26.063 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:26.063 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:26.063 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:26.063 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:26.022608+0000", 2024-04-19T03:03:26.063 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999986 2024-04-19T03:03:26.063 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:26.063 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:26.063 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:26.063 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:26.022615+0000", 2024-04-19T03:03:26.064 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8220000000000001e-06 2024-04-19T03:03:26.064 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:26.064 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:26.064 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:26.064 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:26.022631+0000", 2024-04-19T03:03:26.064 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.5585000000000001e-05 2024-04-19T03:03:26.064 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:26.064 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:26.064 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:26.064 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:26.022643+0000", 2024-04-19T03:03:26.064 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1983e-05 2024-04-19T03:03:26.064 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:26.064 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:26.064 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:26.065 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:26.022699+0000", 2024-04-19T03:03:26.065 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6014000000000003e-05 2024-04-19T03:03:26.065 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:26.065 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:26.065 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:26.066 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:26.022882+0000", 2024-04-19T03:03:26.066 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00018326900000000001 2024-04-19T03:03:26.066 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:26.066 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:26.066 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:26.066 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:26.066 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:26.066 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:225403 5.c 5:35ca77f1:::benchmark_data_smithi096_19531_object111953:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-19T03:03:26.066 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:03:26.023688+0000", 2024-04-19T03:03:26.066 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 7.8391000000000002e-05, 2024-04-19T03:03:26.066 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00043141000000000002, 2024-04-19T03:03:26.066 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:26.067 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-04-19T03:03:26.067 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:26.067 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:26.067 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:26.067 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 225403 2024-04-19T03:03:26.067 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:26.067 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:26.067 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:26.067 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:26.067 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:26.023688+0000", 2024-04-19T03:03:26.067 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:26.067 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:26.068 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:26.068 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:26.068 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:26.023688+0000", 2024-04-19T03:03:26.068 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:26.068 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:26.068 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:26.068 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:26.068 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:26.023687+0000", 2024-04-19T03:03:26.068 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:03:26.068 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:26.068 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:26.068 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:26.068 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:26.023693+0000", 2024-04-19T03:03:26.069 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5600000000000001e-06 2024-04-19T03:03:26.069 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:26.069 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:26.069 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:26.069 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:26.023704+0000", 2024-04-19T03:03:26.069 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1165000000000001e-05 2024-04-19T03:03:26.069 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:26.069 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:26.069 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:26.069 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:26.023710+0000", 2024-04-19T03:03:26.069 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5949999999999998e-06 2024-04-19T03:03:26.069 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:26.069 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:26.069 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:26.070 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:26.023769+0000", 2024-04-19T03:03:26.070 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9234000000000002e-05 2024-04-19T03:03:26.070 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:26.070 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:26.070 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:26.070 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:26.023888+0000", 2024-04-19T03:03:26.070 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000119277 2024-04-19T03:03:26.070 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:26.070 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:26.070 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:26.070 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:26.071 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:26.071 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:225404 5.6 5:6f41eb05:::benchmark_data_smithi096_19531_object111954:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e65)", 2024-04-19T03:03:26.071 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:03:26.023735+0000", 2024-04-19T03:03:26.071 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 3.1853999999999997e-05, 2024-04-19T03:03:26.071 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00041709599999999999, 2024-04-19T03:03:26.071 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:26.071 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "started", 2024-04-19T03:03:26.071 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:26.071 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:26.071 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:26.071 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 225404 2024-04-19T03:03:26.071 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:26.071 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:26.072 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:26.072 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:26.072 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:26.023735+0000", 2024-04-19T03:03:26.072 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:26.072 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:26.072 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:26.072 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:26.072 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:26.023735+0000", 2024-04-19T03:03:26.072 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:26.072 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:26.072 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:26.073 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:26.073 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:26.023734+0000", 2024-04-19T03:03:26.073 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:26.073 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:26.073 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:26.073 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:26.073 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:26.023738+0000", 2024-04-19T03:03:26.073 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1330000000000001e-06 2024-04-19T03:03:26.073 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:26.073 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:26.073 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:26.073 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:26.023753+0000", 2024-04-19T03:03:26.073 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.5387999999999999e-05 2024-04-19T03:03:26.073 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:26.074 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:26.074 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:26.074 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:26.023760+0000", 2024-04-19T03:03:26.074 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.776e-06 2024-04-19T03:03:26.074 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:26.074 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:26.074 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:26.074 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:26.023809+0000", 2024-04-19T03:03:26.074 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8573999999999999e-05 2024-04-19T03:03:26.074 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:26.074 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:26.074 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:26.074 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:03:26.023910+0000", 2024-04-19T03:03:26.075 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000100876 2024-04-19T03:03:26.075 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:26.075 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:26.075 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:26.075 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:26.075 INFO:teuthology.orchestra.run.smithi144.stdout: ], 2024-04-19T03:03:26.075 INFO:teuthology.orchestra.run.smithi144.stdout: "num_ops": 11 2024-04-19T03:03:26.075 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-04-19T03:03:26.076 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1: {} 2024-04-19T03:03:26.076 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2: {} 2024-04-19T03:03:26.077 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-19T03:03:26.078 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T03:03:26.078 INFO:teuthology.orchestra.run.smithi096.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-04-19T03:03:26.078 INFO:teuthology.orchestra.run.smithi096.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-19T03:03:26.078 INFO:teuthology.orchestra.run.smithi096.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-19T03:03:26.079 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-19T03:03:26.098 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:03:26.094+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:03:26.199 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:03:26.194+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:03:26.209 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-04-19T03:03:26.209 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:03:26.221 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T03:03:26.300 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:03:26.298+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:03:26.349 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-04-19T03:03:26.350 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:03:26.362 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T03:03:26.401 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:03:26.396+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:03:26.485 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-19T03:03:26.485 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:03:26.496 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T03:03:26.502 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:03:26.500+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:03:26.603 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:03:26.598+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:03:26.617 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-19T03:03:26.618 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:03:26.629 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T03:03:26.653 INFO:tasks.radosbench.radosbench.0.smithi096.stdout:Removed 113447 objects 2024-04-19T03:03:26.653 INFO:tasks.radosbench.radosbench.0.smithi096.stdout:Clean up completed and total clean up time :47.8179 2024-04-19T03:03:26.704 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:03:26.702+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:03:26.726 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-19T03:03:26.726 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:03:26.735 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T03:03:26.765 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-19T03:03:26.805 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:03:26.802+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:03:26.847 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-04-19T03:03:26.847 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:03:26.857 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T03:03:26.906 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:03:26.904+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:03:26.962 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-04-19T03:03:26.962 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:03:26.972 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T03:03:27.006 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:03:27.004+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:03:27.080 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-04-19T03:03:27.080 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:03:27.090 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T03:03:27.134 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:03:27.132+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:03:27.207 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-19T03:03:27.207 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:03:27.208 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:03:27.206+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:03:27.217 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T03:03:27.309 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:03:27.304+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:03:27.327 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-19T03:03:27.327 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:03:27.337 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T03:03:27.409 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:03:27.408+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:03:27.443 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-19T03:03:27.443 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:03:27.454 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T03:03:27.510 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:03:27.506+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:03:27.569 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-04-19T03:03:27.569 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:03:27.580 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T03:03:27.610 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:03:27.610+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:03:27.688 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-04-19T03:03:27.689 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:03:27.698 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T03:03:27.711 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:03:27.708+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:03:27.713 INFO:teuthology.orchestra.run.smithi096.stderr:nodeep-scrub is set 2024-04-19T03:03:27.801 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-04-19T03:03:27.801 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:03:27.811 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T03:03:27.812 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:03:27.808+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:03:27.913 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:03:27.908+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:03:27.925 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-19T03:03:27.925 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:03:27.935 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T03:03:28.014 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:03:28.012+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:03:28.040 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-19T03:03:28.040 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:03:28.051 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T03:03:28.079 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-19T03:03:28.101 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~59s 2024-04-19T03:03:28.114 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:03:28.112+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:03:28.154 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-19T03:03:28.155 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:03:28.164 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T03:03:28.215 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:03:28.210+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:03:28.232 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1: {} 2024-04-19T03:03:28.256 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2: {} 2024-04-19T03:03:28.256 INFO:teuthology.orchestra.run.smithi096.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-04-19T03:03:28.257 INFO:teuthology.orchestra.run.smithi096.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-19T03:03:28.257 INFO:teuthology.orchestra.run.smithi096.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-19T03:03:28.261 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-19T03:03:28.261 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-19T03:03:28.281 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-04-19T03:03:28.281 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2024-04-19T03:03:28.281 INFO:teuthology.orchestra.run.smithi144.stdout: "num_ops": 0 2024-04-19T03:03:28.281 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-04-19T03:03:28.291 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T03:03:28.316 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:03:28.314+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:03:28.396 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-04-19T03:03:28.396 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2024-04-19T03:03:28.396 INFO:teuthology.orchestra.run.smithi144.stdout: "complaint_time": 30, 2024-04-19T03:03:28.396 INFO:teuthology.orchestra.run.smithi144.stdout: "num_blocked_ops": 0 2024-04-19T03:03:28.397 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-04-19T03:03:28.406 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T03:03:28.416 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:03:28.414+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:03:28.516 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-04-19T03:03:28.516 INFO:teuthology.orchestra.run.smithi144.stdout: "size": 20, 2024-04-19T03:03:28.516 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 600, 2024-04-19T03:03:28.516 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [ 2024-04-19T03:03:28.516 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.517 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:78992 5.7 5:e6baa862:::benchmark_data_smithi096_19531_object78991:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-19T03:03:28.517 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:18.008888+0000", 2024-04-19T03:03:28.517 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 70.503706012999999, 2024-04-19T03:03:28.517 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.056375285999999997, 2024-04-19T03:03:28.517 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:28.517 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:28.517 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:28.517 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:28.517 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:28.517 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 78992 2024-04-19T03:03:28.517 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.517 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:28.517 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.517 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:28.518 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.008888+0000", 2024-04-19T03:03:28.518 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:28.518 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.518 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.518 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:28.518 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.008888+0000", 2024-04-19T03:03:28.518 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:28.518 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.518 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.518 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:28.518 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.008888+0000", 2024-04-19T03:03:28.518 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:28.518 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.519 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.519 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:28.519 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.008928+0000", 2024-04-19T03:03:28.519 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0361999999999997e-05 2024-04-19T03:03:28.519 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.519 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.519 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:28.519 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.008942+0000", 2024-04-19T03:03:28.519 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4365000000000001e-05 2024-04-19T03:03:28.519 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.519 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.519 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:28.519 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.008949+0000", 2024-04-19T03:03:28.519 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.212e-06 2024-04-19T03:03:28.520 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.520 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.520 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:28.520 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.012683+0000", 2024-04-19T03:03:28.520 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.003733934 2024-04-19T03:03:28.520 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.520 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.520 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:28.520 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.012798+0000", 2024-04-19T03:03:28.520 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00011574999999999999 2024-04-19T03:03:28.520 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.520 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.520 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:28.520 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.012896+0000", 2024-04-19T03:03:28.521 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.7848000000000002e-05 2024-04-19T03:03:28.521 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.521 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.521 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:03:28.521 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016423+0000", 2024-04-19T03:03:28.521 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0035270789999999998 2024-04-19T03:03:28.521 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.521 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.521 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:28.521 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.065098+0000", 2024-04-19T03:03:28.521 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.048674651999999999 2024-04-19T03:03:28.521 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.521 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.522 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:03:28.522 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.065193+0000", 2024-04-19T03:03:28.522 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.5087999999999995e-05 2024-04-19T03:03:28.522 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.522 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.522 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:28.522 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.065264+0000", 2024-04-19T03:03:28.522 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0666000000000004e-05 2024-04-19T03:03:28.522 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:28.522 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:28.522 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:28.522 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.522 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.522 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4755.0:79003 5.2 e40/39 5:4436e33f:::benchmark_data_smithi096_19531_object79002:head v 40'4935, mlcod=40'4932)", 2024-04-19T03:03:28.523 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:18.018102+0000", 2024-04-19T03:03:28.523 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 70.494491956999994, 2024-04-19T03:03:28.523 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.060023990999999999, 2024-04-19T03:03:28.523 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:28.523 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:28.523 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:28.523 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.523 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:28.523 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018102+0000", 2024-04-19T03:03:28.523 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:28.523 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.523 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.523 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:28.523 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018102+0000", 2024-04-19T03:03:28.524 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:28.524 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.524 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.524 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:28.524 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018102+0000", 2024-04-19T03:03:28.524 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:28.524 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.524 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.524 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:28.524 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018134+0000", 2024-04-19T03:03:28.524 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2722000000000003e-05 2024-04-19T03:03:28.524 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.524 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.524 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:28.525 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018145+0000", 2024-04-19T03:03:28.525 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0395e-05 2024-04-19T03:03:28.525 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.525 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.525 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:28.525 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018151+0000", 2024-04-19T03:03:28.525 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5300000000000002e-06 2024-04-19T03:03:28.525 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.525 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.525 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:28.525 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018489+0000", 2024-04-19T03:03:28.525 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00033731499999999998 2024-04-19T03:03:28.525 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.525 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.526 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:28.526 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018508+0000", 2024-04-19T03:03:28.526 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9775e-05 2024-04-19T03:03:28.526 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.526 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.526 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:03:28.526 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.078059+0000", 2024-04-19T03:03:28.526 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.059550171999999998 2024-04-19T03:03:28.526 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.526 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.526 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:28.526 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.078126+0000", 2024-04-19T03:03:28.526 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7773000000000003e-05 2024-04-19T03:03:28.526 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:28.527 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:28.527 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:28.527 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.527 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.527 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:86612 5.7 5:e32e3c49:::benchmark_data_smithi096_19531_object86611:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:28.527 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:22.633560+0000", 2024-04-19T03:03:28.527 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 65.879034297000004, 2024-04-19T03:03:28.527 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.19135289, 2024-04-19T03:03:28.527 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:28.527 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:28.527 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:28.527 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:28.527 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:28.527 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 86612 2024-04-19T03:03:28.528 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.528 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:28.528 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.528 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:28.528 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633560+0000", 2024-04-19T03:03:28.528 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:28.528 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.528 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.528 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:28.528 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633560+0000", 2024-04-19T03:03:28.528 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:28.528 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.528 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.528 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:28.529 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633558+0000", 2024-04-19T03:03:28.529 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999986 2024-04-19T03:03:28.529 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.529 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.529 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:28.529 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633609+0000", 2024-04-19T03:03:28.529 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0850999999999998e-05 2024-04-19T03:03:28.529 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.529 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.529 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:28.529 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633627+0000", 2024-04-19T03:03:28.529 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7951000000000001e-05 2024-04-19T03:03:28.529 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.529 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.530 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:28.530 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633635+0000", 2024-04-19T03:03:28.530 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2530000000000004e-06 2024-04-19T03:03:28.530 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.530 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.530 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:28.530 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633699+0000", 2024-04-19T03:03:28.530 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3901999999999999e-05 2024-04-19T03:03:28.530 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.530 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.530 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:28.530 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633992+0000", 2024-04-19T03:03:28.530 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00029283299999999999 2024-04-19T03:03:28.530 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.531 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.531 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:28.531 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.634223+0000", 2024-04-19T03:03:28.531 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00023084200000000001 2024-04-19T03:03:28.531 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.531 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.531 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:03:28.531 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.639085+0000", 2024-04-19T03:03:28.531 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0048624269999999999 2024-04-19T03:03:28.531 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.532 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.532 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:28.532 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.824635+0000", 2024-04-19T03:03:28.532 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.18554944700000001 2024-04-19T03:03:28.532 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.532 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.532 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:03:28.532 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.824793+0000", 2024-04-19T03:03:28.532 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000157959 2024-04-19T03:03:28.532 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.532 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.532 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:28.532 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.824913+0000", 2024-04-19T03:03:28.533 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000120093 2024-04-19T03:03:28.533 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:28.533 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:28.533 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:28.533 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.533 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.533 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:86625 5.7 5:e6d00488:::benchmark_data_smithi096_19531_object86624:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:28.533 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:22.643554+0000", 2024-04-19T03:03:28.533 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 65.869040530999996, 2024-04-19T03:03:28.533 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.18732841, 2024-04-19T03:03:28.533 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:28.533 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:28.533 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:28.533 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:28.534 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:28.534 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 86625 2024-04-19T03:03:28.534 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.534 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:28.534 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.534 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:28.534 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643554+0000", 2024-04-19T03:03:28.534 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:28.534 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.534 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.534 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:28.534 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643554+0000", 2024-04-19T03:03:28.534 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:28.534 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.535 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.535 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:28.535 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643552+0000", 2024-04-19T03:03:28.535 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999986 2024-04-19T03:03:28.535 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.535 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.535 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:28.535 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643588+0000", 2024-04-19T03:03:28.535 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5855999999999997e-05 2024-04-19T03:03:28.535 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.535 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.535 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:28.535 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643606+0000", 2024-04-19T03:03:28.536 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8226000000000001e-05 2024-04-19T03:03:28.536 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.536 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.536 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:28.536 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643618+0000", 2024-04-19T03:03:28.536 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1868000000000001e-05 2024-04-19T03:03:28.536 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.536 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.536 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:28.536 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643676+0000", 2024-04-19T03:03:28.536 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8153999999999999e-05 2024-04-19T03:03:28.536 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.536 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.536 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:28.537 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643905+0000", 2024-04-19T03:03:28.537 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00022847500000000001 2024-04-19T03:03:28.537 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.537 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.537 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:28.537 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.644150+0000", 2024-04-19T03:03:28.537 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00024531800000000001 2024-04-19T03:03:28.537 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.537 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.537 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:03:28.537 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.647407+0000", 2024-04-19T03:03:28.537 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0032563190000000001 2024-04-19T03:03:28.537 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.538 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.538 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:28.538 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.830721+0000", 2024-04-19T03:03:28.538 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.18331468300000001 2024-04-19T03:03:28.538 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.538 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.538 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:03:28.538 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.830813+0000", 2024-04-19T03:03:28.538 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.2205000000000002e-05 2024-04-19T03:03:28.538 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.538 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.538 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:28.538 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.830882+0000", 2024-04-19T03:03:28.539 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8819999999999995e-05 2024-04-19T03:03:28.539 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:28.539 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:28.539 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:28.539 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.539 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.539 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87063 5.7 5:e502e824:::benchmark_data_smithi096_19531_object87062:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:28.539 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.136067+0000", 2024-04-19T03:03:28.539 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 65.376527662000001, 2024-04-19T03:03:28.539 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.065521159999999995, 2024-04-19T03:03:28.539 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:28.539 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:28.539 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:28.540 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:28.540 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:28.540 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87063 2024-04-19T03:03:28.540 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.540 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:28.540 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.540 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:28.540 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.136067+0000", 2024-04-19T03:03:28.540 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:28.540 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.540 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.540 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:28.540 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.136067+0000", 2024-04-19T03:03:28.540 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:28.541 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.541 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.541 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:28.541 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.136066+0000", 2024-04-19T03:03:28.541 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:03:28.541 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.541 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.541 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:28.541 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.136154+0000", 2024-04-19T03:03:28.541 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.8256000000000003e-05 2024-04-19T03:03:28.541 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.541 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.541 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:28.542 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.136162+0000", 2024-04-19T03:03:28.542 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.5099999999999998e-06 2024-04-19T03:03:28.542 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.542 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.542 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:28.542 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.136171+0000", 2024-04-19T03:03:28.542 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2830000000000001e-06 2024-04-19T03:03:28.542 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.542 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.542 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:28.542 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.138421+0000", 2024-04-19T03:03:28.542 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0022506620000000001 2024-04-19T03:03:28.542 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.543 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.543 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:28.543 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.138560+0000", 2024-04-19T03:03:28.543 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000138446 2024-04-19T03:03:28.543 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.543 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.543 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:28.543 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.138689+0000", 2024-04-19T03:03:28.543 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00012950700000000001 2024-04-19T03:03:28.543 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.543 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.543 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:03:28.543 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.141517+0000", 2024-04-19T03:03:28.543 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0028280860000000001 2024-04-19T03:03:28.543 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.544 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.544 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:28.544 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.201350+0000", 2024-04-19T03:03:28.544 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.059832418999999998 2024-04-19T03:03:28.544 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.544 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.544 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:03:28.544 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.201485+0000", 2024-04-19T03:03:28.544 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000135597 2024-04-19T03:03:28.544 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.544 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.544 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:28.544 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.201588+0000", 2024-04-19T03:03:28.545 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00010247900000000001 2024-04-19T03:03:28.545 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:28.545 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:28.545 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:28.545 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.545 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.545 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87072 5.7 5:e3c7809a:::benchmark_data_smithi096_19531_object87071:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:28.545 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.144224+0000", 2024-04-19T03:03:28.545 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 65.368370638000002, 2024-04-19T03:03:28.545 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.058179555000000001, 2024-04-19T03:03:28.545 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:28.545 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:28.545 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:28.546 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:28.546 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:28.546 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87072 2024-04-19T03:03:28.546 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.546 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:28.546 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.546 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:28.546 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144224+0000", 2024-04-19T03:03:28.546 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:28.546 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.546 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.546 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:28.547 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144224+0000", 2024-04-19T03:03:28.547 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:28.547 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.547 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.547 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:28.547 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144223+0000", 2024-04-19T03:03:28.547 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:03:28.547 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.547 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.547 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:28.547 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144320+0000", 2024-04-19T03:03:28.547 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.7075000000000001e-05 2024-04-19T03:03:28.547 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.547 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.547 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:28.548 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144331+0000", 2024-04-19T03:03:28.548 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1342000000000001e-05 2024-04-19T03:03:28.548 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.548 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.548 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:28.548 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144337+0000", 2024-04-19T03:03:28.548 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8390000000000003e-06 2024-04-19T03:03:28.548 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.548 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.548 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:28.548 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144369+0000", 2024-04-19T03:03:28.548 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2079000000000002e-05 2024-04-19T03:03:28.548 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.548 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.549 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:28.549 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144464+0000", 2024-04-19T03:03:28.549 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.4623000000000005e-05 2024-04-19T03:03:28.549 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.549 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.549 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:28.549 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144553+0000", 2024-04-19T03:03:28.549 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9171000000000004e-05 2024-04-19T03:03:28.549 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.549 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.549 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:03:28.549 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.147018+0000", 2024-04-19T03:03:28.549 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0024648370000000001 2024-04-19T03:03:28.549 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.549 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.550 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:28.550 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.202270+0000", 2024-04-19T03:03:28.550 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.055252018 2024-04-19T03:03:28.550 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.550 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.550 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:03:28.550 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.202356+0000", 2024-04-19T03:03:28.550 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6648000000000001e-05 2024-04-19T03:03:28.550 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.550 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.550 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:28.550 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.202403+0000", 2024-04-19T03:03:28.550 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6956999999999998e-05 2024-04-19T03:03:28.551 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:28.551 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:28.551 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:28.551 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.551 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.551 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87123 5.6 5:6d1bc3b9:::benchmark_data_smithi096_19531_object87122:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:03:28.551 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249233+0000", 2024-04-19T03:03:28.551 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 65.263361606000004, 2024-04-19T03:03:28.551 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0291700720000001, 2024-04-19T03:03:28.551 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:28.551 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-04-19T03:03:28.551 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:28.551 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:28.551 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:28.552 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87123 2024-04-19T03:03:28.552 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.552 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:28.552 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.552 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:28.552 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249233+0000", 2024-04-19T03:03:28.552 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:28.552 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.552 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.552 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:28.552 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249233+0000", 2024-04-19T03:03:28.552 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:28.552 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.552 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.553 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:28.553 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249231+0000", 2024-04-19T03:03:28.553 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999986 2024-04-19T03:03:28.553 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.553 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.553 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:28.553 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249285+0000", 2024-04-19T03:03:28.553 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4005000000000002e-05 2024-04-19T03:03:28.553 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.553 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.553 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:28.553 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249300+0000", 2024-04-19T03:03:28.553 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4715999999999999e-05 2024-04-19T03:03:28.553 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.554 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.554 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:28.554 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249307+0000", 2024-04-19T03:03:28.554 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8399999999999997e-06 2024-04-19T03:03:28.554 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.554 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.554 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:28.554 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249366+0000", 2024-04-19T03:03:28.554 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9435999999999998e-05 2024-04-19T03:03:28.554 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.554 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.554 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op must wait for map", 2024-04-19T03:03:28.554 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249376+0000", 2024-04-19T03:03:28.554 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.4919999999999999e-06 2024-04-19T03:03:28.555 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.555 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.555 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:28.555 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263757+0000", 2024-04-19T03:03:28.555 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.014381461999999999 2024-04-19T03:03:28.555 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.555 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.555 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:03:28.555 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263875+0000", 2024-04-19T03:03:28.555 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000117166 2024-04-19T03:03:28.555 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.555 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.555 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:28.556 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.277136+0000", 2024-04-19T03:03:28.556 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.013261207 2024-04-19T03:03:28.556 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.556 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.556 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:28.556 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.278403+0000", 2024-04-19T03:03:28.556 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001267106 2024-04-19T03:03:28.556 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:28.556 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:28.556 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:28.556 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.556 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.556 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87128 5.6 5:6905c420:::benchmark_data_smithi096_19531_object87127:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:03:28.556 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249323+0000", 2024-04-19T03:03:28.556 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 65.263270859000002, 2024-04-19T03:03:28.557 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0292813249999999, 2024-04-19T03:03:28.557 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:28.557 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-04-19T03:03:28.557 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:28.557 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:28.557 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:28.557 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87128 2024-04-19T03:03:28.557 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.557 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:28.557 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.557 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:28.557 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249323+0000", 2024-04-19T03:03:28.557 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:28.557 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.557 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.557 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:28.558 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249323+0000", 2024-04-19T03:03:28.558 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:28.558 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.558 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.558 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:28.558 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249323+0000", 2024-04-19T03:03:28.558 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:28.558 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.558 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.558 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:28.558 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249385+0000", 2024-04-19T03:03:28.558 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1711999999999995e-05 2024-04-19T03:03:28.558 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.559 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.559 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:28.559 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249398+0000", 2024-04-19T03:03:28.559 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3022e-05 2024-04-19T03:03:28.559 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.559 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.559 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:28.559 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249402+0000", 2024-04-19T03:03:28.559 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4819999999999996e-06 2024-04-19T03:03:28.559 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.559 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.559 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:28.559 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249437+0000", 2024-04-19T03:03:28.560 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4702000000000001e-05 2024-04-19T03:03:28.560 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.560 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.560 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:03:28.560 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249442+0000", 2024-04-19T03:03:28.560 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8019999999999999e-06 2024-04-19T03:03:28.560 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.560 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.560 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:28.560 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263896+0000", 2024-04-19T03:03:28.560 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.014454679999999999 2024-04-19T03:03:28.560 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.560 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.561 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:03:28.561 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263900+0000", 2024-04-19T03:03:28.561 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9700000000000001e-06 2024-04-19T03:03:28.561 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.561 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.561 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:28.561 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.278557+0000", 2024-04-19T03:03:28.561 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0146566480000001 2024-04-19T03:03:28.561 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.561 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.561 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:28.561 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.278605+0000", 2024-04-19T03:03:28.561 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7735999999999998e-05 2024-04-19T03:03:28.562 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:28.562 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:28.562 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:28.562 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.562 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.562 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87130 5.3 5:c8c2d67b:::benchmark_data_smithi096_19531_object87129:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:03:28.562 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249418+0000", 2024-04-19T03:03:28.562 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 65.263176147999999, 2024-04-19T03:03:28.562 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.025414182, 2024-04-19T03:03:28.562 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:28.562 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-04-19T03:03:28.562 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:28.562 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:28.563 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:28.563 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87130 2024-04-19T03:03:28.563 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.563 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:28.563 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.563 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:28.563 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249418+0000", 2024-04-19T03:03:28.563 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:28.563 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.563 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.563 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:28.563 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249418+0000", 2024-04-19T03:03:28.563 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:28.564 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.564 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.564 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:28.564 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249409+0000", 2024-04-19T03:03:28.564 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999905 2024-04-19T03:03:28.564 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.564 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.564 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:28.564 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249464+0000", 2024-04-19T03:03:28.564 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5381999999999999e-05 2024-04-19T03:03:28.564 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.564 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.564 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:28.565 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249471+0000", 2024-04-19T03:03:28.565 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2609999999999996e-06 2024-04-19T03:03:28.565 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.565 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.565 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:28.565 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249475+0000", 2024-04-19T03:03:28.565 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2839999999999998e-06 2024-04-19T03:03:28.565 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.565 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.565 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:28.565 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249535+0000", 2024-04-19T03:03:28.565 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0545999999999999e-05 2024-04-19T03:03:28.565 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.565 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.566 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op must wait for map", 2024-04-19T03:03:28.566 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249540+0000", 2024-04-19T03:03:28.566 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2859999999999999e-06 2024-04-19T03:03:28.566 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.566 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.566 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:28.566 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263450+0000", 2024-04-19T03:03:28.566 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.013909585 2024-04-19T03:03:28.566 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.566 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.566 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:03:28.566 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263458+0000", 2024-04-19T03:03:28.566 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8089999999999993e-06 2024-04-19T03:03:28.567 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.567 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.567 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:28.567 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.273193+0000", 2024-04-19T03:03:28.567 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0097351379999999 2024-04-19T03:03:28.567 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.567 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.567 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:28.567 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.274832+0000", 2024-04-19T03:03:28.567 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0016394789999999999 2024-04-19T03:03:28.567 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:28.567 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:28.567 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:28.568 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.568 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.568 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87131 5.1 5:83756d55:::benchmark_data_smithi096_19531_object87130:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:03:28.568 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249491+0000", 2024-04-19T03:03:28.568 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 65.263103501000003, 2024-04-19T03:03:28.568 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0191489520000001, 2024-04-19T03:03:28.568 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:28.568 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-04-19T03:03:28.568 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:28.568 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:28.568 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:28.568 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87131 2024-04-19T03:03:28.568 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.568 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:28.568 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.569 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:28.569 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249491+0000", 2024-04-19T03:03:28.569 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:28.569 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.569 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.569 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:28.569 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249491+0000", 2024-04-19T03:03:28.569 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:28.569 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.569 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.569 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:28.569 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249491+0000", 2024-04-19T03:03:28.569 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:28.569 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.570 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.570 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:28.570 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249530+0000", 2024-04-19T03:03:28.570 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9589000000000003e-05 2024-04-19T03:03:28.570 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.570 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.570 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:28.570 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249544+0000", 2024-04-19T03:03:28.570 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4158000000000001e-05 2024-04-19T03:03:28.570 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.570 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.570 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:28.570 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249549+0000", 2024-04-19T03:03:28.570 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6809999999999997e-06 2024-04-19T03:03:28.570 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.571 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.571 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:28.571 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249592+0000", 2024-04-19T03:03:28.571 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3285999999999999e-05 2024-04-19T03:03:28.571 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.571 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.571 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op must wait for map", 2024-04-19T03:03:28.571 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249598+0000", 2024-04-19T03:03:28.571 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8329999999999999e-06 2024-04-19T03:03:28.571 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.571 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.571 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:28.571 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263331+0000", 2024-04-19T03:03:28.571 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.013733093 2024-04-19T03:03:28.571 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.572 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.572 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:03:28.572 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263343+0000", 2024-04-19T03:03:28.572 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.189e-05 2024-04-19T03:03:28.572 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.572 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.572 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:28.572 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.268541+0000", 2024-04-19T03:03:28.572 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0051983440000001 2024-04-19T03:03:28.572 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.572 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.572 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:28.572 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.268640+0000", 2024-04-19T03:03:28.572 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.8387999999999994e-05 2024-04-19T03:03:28.573 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:28.573 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:28.573 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:28.573 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.573 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.573 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87132 5.c 5:3e18b732:::benchmark_data_smithi096_19531_object87131:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:03:28.573 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249558+0000", 2024-04-19T03:03:28.573 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 65.263036600000007, 2024-04-19T03:03:28.573 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0241198380000001, 2024-04-19T03:03:28.573 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:28.573 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-04-19T03:03:28.573 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:28.573 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:28.573 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:28.573 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87132 2024-04-19T03:03:28.574 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.574 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:28.574 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.574 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:28.574 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249558+0000", 2024-04-19T03:03:28.574 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:28.574 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.574 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.574 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:28.574 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249558+0000", 2024-04-19T03:03:28.574 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:28.574 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.574 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.574 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:28.575 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249557+0000", 2024-04-19T03:03:28.575 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:28.575 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.575 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.575 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:28.575 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249625+0000", 2024-04-19T03:03:28.575 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7200999999999996e-05 2024-04-19T03:03:28.575 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.575 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.575 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:28.575 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249646+0000", 2024-04-19T03:03:28.575 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1053e-05 2024-04-19T03:03:28.575 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.575 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.576 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:28.576 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249650+0000", 2024-04-19T03:03:28.576 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2719999999999999e-06 2024-04-19T03:03:28.576 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.576 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.576 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:28.576 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249686+0000", 2024-04-19T03:03:28.576 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6430000000000002e-05 2024-04-19T03:03:28.576 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.576 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.576 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op must wait for map", 2024-04-19T03:03:28.576 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249690+0000", 2024-04-19T03:03:28.576 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.765e-06 2024-04-19T03:03:28.576 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.576 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.577 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:28.577 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261157+0000", 2024-04-19T03:03:28.577 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011467247999999999 2024-04-19T03:03:28.577 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.577 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.577 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:03:28.577 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261170+0000", 2024-04-19T03:03:28.577 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2833000000000001e-05 2024-04-19T03:03:28.577 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.577 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.577 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:28.577 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.272119+0000", 2024-04-19T03:03:28.577 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.010949313 2024-04-19T03:03:28.577 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.577 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.578 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:28.578 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.273678+0000", 2024-04-19T03:03:28.578 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0015581550000000001 2024-04-19T03:03:28.578 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:28.578 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:28.578 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:28.578 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.578 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.578 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87133 5.c 5:3f772a62:::benchmark_data_smithi096_19531_object87132:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:03:28.578 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249657+0000", 2024-04-19T03:03:28.578 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 65.262937221000001, 2024-04-19T03:03:28.578 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0242819409999999, 2024-04-19T03:03:28.578 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:28.578 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-04-19T03:03:28.579 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:28.579 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:28.579 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:28.579 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87133 2024-04-19T03:03:28.579 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.579 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:28.579 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.579 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:28.579 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249657+0000", 2024-04-19T03:03:28.579 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:28.579 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.579 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.579 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:28.579 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249657+0000", 2024-04-19T03:03:28.579 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:28.580 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.580 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.580 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:28.580 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249657+0000", 2024-04-19T03:03:28.580 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:28.580 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.580 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.580 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:28.580 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249690+0000", 2024-04-19T03:03:28.580 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3343000000000002e-05 2024-04-19T03:03:28.580 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.580 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.580 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:28.580 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249695+0000", 2024-04-19T03:03:28.580 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8600000000000001e-06 2024-04-19T03:03:28.581 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.581 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.581 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:28.581 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249698+0000", 2024-04-19T03:03:28.581 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.1700000000000001e-06 2024-04-19T03:03:28.581 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.581 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.581 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:28.581 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249741+0000", 2024-04-19T03:03:28.581 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2849999999999998e-05 2024-04-19T03:03:28.581 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.581 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.581 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:03:28.581 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249746+0000", 2024-04-19T03:03:28.581 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1019999999999996e-06 2024-04-19T03:03:28.582 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.582 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.582 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:28.582 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261209+0000", 2024-04-19T03:03:28.582 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011462447000000001 2024-04-19T03:03:28.582 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.582 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.582 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:03:28.582 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261216+0000", 2024-04-19T03:03:28.582 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8520000000000004e-06 2024-04-19T03:03:28.582 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.582 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.582 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:28.583 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.273872+0000", 2024-04-19T03:03:28.583 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0126558000000001 2024-04-19T03:03:28.583 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.583 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.583 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:28.583 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.273939+0000", 2024-04-19T03:03:28.583 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6822000000000005e-05 2024-04-19T03:03:28.583 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:28.583 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:28.583 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:28.583 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.583 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.583 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87134 5.5 5:a56c478f:::benchmark_data_smithi096_19531_object87133:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:03:28.583 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249708+0000", 2024-04-19T03:03:28.583 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 65.262886296999994, 2024-04-19T03:03:28.584 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0214677299999999, 2024-04-19T03:03:28.584 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:28.584 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-04-19T03:03:28.584 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:28.584 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:28.584 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:28.584 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87134 2024-04-19T03:03:28.584 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.584 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:28.584 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.584 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:28.584 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249708+0000", 2024-04-19T03:03:28.584 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:28.584 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.585 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.585 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:28.585 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249708+0000", 2024-04-19T03:03:28.585 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:28.585 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.585 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.585 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:28.585 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249706+0000", 2024-04-19T03:03:28.585 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999976 2024-04-19T03:03:28.585 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.585 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.585 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:28.585 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249740+0000", 2024-04-19T03:03:28.585 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4458000000000001e-05 2024-04-19T03:03:28.586 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.586 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.586 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:28.586 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249745+0000", 2024-04-19T03:03:28.586 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5020000000000003e-06 2024-04-19T03:03:28.586 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.586 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.586 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:28.586 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249748+0000", 2024-04-19T03:03:28.586 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2499999999999998e-06 2024-04-19T03:03:28.586 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.586 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.586 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:28.587 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249778+0000", 2024-04-19T03:03:28.587 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.006e-05 2024-04-19T03:03:28.587 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.587 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.587 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op must wait for map", 2024-04-19T03:03:28.587 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249782+0000", 2024-04-19T03:03:28.587 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2910000000000001e-06 2024-04-19T03:03:28.587 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.587 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.587 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:28.587 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261666+0000", 2024-04-19T03:03:28.587 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011883471 2024-04-19T03:03:28.587 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.587 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.588 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:03:28.588 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261674+0000", 2024-04-19T03:03:28.588 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6479999999999992e-06 2024-04-19T03:03:28.588 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.588 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.588 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:28.588 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.269323+0000", 2024-04-19T03:03:28.588 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.00764867 2024-04-19T03:03:28.588 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.588 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.588 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:28.588 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.271176+0000", 2024-04-19T03:03:28.588 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001852844 2024-04-19T03:03:28.588 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:28.588 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:28.589 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:28.589 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.589 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.589 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87137 5.c 5:30708c68:::benchmark_data_smithi096_19531_object87136:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:03:28.589 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249756+0000", 2024-04-19T03:03:28.589 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 65.262838591000005, 2024-04-19T03:03:28.589 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.033331752, 2024-04-19T03:03:28.589 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:28.589 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:28.589 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:28.589 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:28.589 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:28.589 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87137 2024-04-19T03:03:28.589 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.589 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:28.589 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.590 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:28.590 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249756+0000", 2024-04-19T03:03:28.590 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:28.590 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.590 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.590 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:28.590 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249756+0000", 2024-04-19T03:03:28.590 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:28.590 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.590 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.590 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:28.590 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249755+0000", 2024-04-19T03:03:28.590 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:28.591 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.591 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.591 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:28.591 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249777+0000", 2024-04-19T03:03:28.591 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1420000000000002e-05 2024-04-19T03:03:28.591 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.591 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.591 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:28.591 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249781+0000", 2024-04-19T03:03:28.591 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0609999999999997e-06 2024-04-19T03:03:28.591 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.591 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.591 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:28.592 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249787+0000", 2024-04-19T03:03:28.592 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.02e-06 2024-04-19T03:03:28.592 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.592 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.592 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:28.592 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249818+0000", 2024-04-19T03:03:28.592 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0947e-05 2024-04-19T03:03:28.592 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.592 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.592 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:03:28.592 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249821+0000", 2024-04-19T03:03:28.592 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.117e-06 2024-04-19T03:03:28.592 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.593 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.593 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:28.593 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261243+0000", 2024-04-19T03:03:28.593 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011421875999999999 2024-04-19T03:03:28.593 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.593 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.593 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:03:28.593 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261251+0000", 2024-04-19T03:03:28.593 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6120000000000001e-06 2024-04-19T03:03:28.593 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.593 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.593 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:28.593 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.274050+0000", 2024-04-19T03:03:28.593 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.012799405 2024-04-19T03:03:28.594 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.594 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.594 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:28.594 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.274529+0000", 2024-04-19T03:03:28.594 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00047867100000000001 2024-04-19T03:03:28.594 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.594 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.594 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:03:28.594 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.282972+0000", 2024-04-19T03:03:28.594 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0084436900000000002 2024-04-19T03:03:28.595 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.595 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.595 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:03:28.595 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.283022+0000", 2024-04-19T03:03:28.595 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9339000000000003e-05 2024-04-19T03:03:28.595 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.595 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.595 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:28.595 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.283088+0000", 2024-04-19T03:03:28.595 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5877999999999995e-05 2024-04-19T03:03:28.595 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:28.595 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:28.595 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:28.596 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.596 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.596 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:158376 5.9 5:9e73c076:::benchmark_data_smithi096_19531_object44926:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-19T03:03:28.596 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:58.126227+0000", 2024-04-19T03:03:28.596 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 30.386366857999999, 2024-04-19T03:03:28.596 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.069738668000000004, 2024-04-19T03:03:28.596 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:28.596 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:28.596 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:28.596 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:28.596 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:28.596 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 158376 2024-04-19T03:03:28.596 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.597 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:28.597 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.597 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:28.597 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.126227+0000", 2024-04-19T03:03:28.597 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:28.597 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.597 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.597 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:28.597 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.126227+0000", 2024-04-19T03:03:28.597 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:28.598 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.598 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.598 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:28.598 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.126226+0000", 2024-04-19T03:03:28.598 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:03:28.598 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.598 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.598 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:28.598 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.126236+0000", 2024-04-19T03:03:28.598 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.4199999999999996e-06 2024-04-19T03:03:28.598 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.598 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.598 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:28.598 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.126243+0000", 2024-04-19T03:03:28.599 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.199e-06 2024-04-19T03:03:28.599 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.599 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.599 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:28.599 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.126248+0000", 2024-04-19T03:03:28.599 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1320000000000002e-06 2024-04-19T03:03:28.599 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.599 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.599 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:28.599 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.126286+0000", 2024-04-19T03:03:28.599 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7401000000000003e-05 2024-04-19T03:03:28.599 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.599 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.600 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:28.600 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.126368+0000", 2024-04-19T03:03:28.600 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2113999999999993e-05 2024-04-19T03:03:28.600 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.600 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.600 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:03:28.600 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.126438+0000", 2024-04-19T03:03:28.600 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0337000000000001e-05 2024-04-19T03:03:28.600 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.600 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.600 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:03:28.600 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.130816+0000", 2024-04-19T03:03:28.600 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0043778330000000002 2024-04-19T03:03:28.601 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.601 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.601 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:28.601 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.195830+0000", 2024-04-19T03:03:28.601 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.065013933999999995 2024-04-19T03:03:28.601 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.601 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.601 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:03:28.601 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.195907+0000", 2024-04-19T03:03:28.601 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7397000000000005e-05 2024-04-19T03:03:28.601 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.601 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.601 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:28.602 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.195966+0000", 2024-04-19T03:03:28.602 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8906999999999997e-05 2024-04-19T03:03:28.602 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:28.602 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:28.602 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:28.602 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.602 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.602 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:158381 5.9 5:94dcd4a7:::benchmark_data_smithi096_19531_object44931:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-19T03:03:28.602 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:58.128712+0000", 2024-04-19T03:03:28.602 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 30.383882414999999, 2024-04-19T03:03:28.602 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.067497527000000002, 2024-04-19T03:03:28.602 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:28.602 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:28.603 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:28.603 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:28.603 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:28.603 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 158381 2024-04-19T03:03:28.603 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.603 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:28.603 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.603 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:28.603 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.128712+0000", 2024-04-19T03:03:28.603 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:28.603 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.603 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.603 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:28.603 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.128712+0000", 2024-04-19T03:03:28.604 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:28.604 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.604 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.604 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:28.604 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.128711+0000", 2024-04-19T03:03:28.604 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:03:28.604 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.604 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.604 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:28.604 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.128716+0000", 2024-04-19T03:03:28.604 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0610000000000003e-06 2024-04-19T03:03:28.604 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.604 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.605 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:28.605 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.128724+0000", 2024-04-19T03:03:28.605 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0120000000000005e-06 2024-04-19T03:03:28.605 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.605 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.605 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:28.605 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.128729+0000", 2024-04-19T03:03:28.605 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8899999999999998e-06 2024-04-19T03:03:28.605 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.605 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.605 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:28.605 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.128778+0000", 2024-04-19T03:03:28.605 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9110000000000002e-05 2024-04-19T03:03:28.605 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.606 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.606 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:28.606 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.128903+0000", 2024-04-19T03:03:28.606 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00012506799999999999 2024-04-19T03:03:28.606 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.606 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.606 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:03:28.606 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.129022+0000", 2024-04-19T03:03:28.606 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00011923599999999999 2024-04-19T03:03:28.606 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.606 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.606 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:03:28.606 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.132294+0000", 2024-04-19T03:03:28.607 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.003271244 2024-04-19T03:03:28.607 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.607 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.607 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:28.607 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.196045+0000", 2024-04-19T03:03:28.607 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.063751206000000005 2024-04-19T03:03:28.607 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.607 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.607 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:03:28.607 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.196133+0000", 2024-04-19T03:03:28.607 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.8213000000000004e-05 2024-04-19T03:03:28.607 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.607 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.608 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:28.608 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.196209+0000", 2024-04-19T03:03:28.608 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6335999999999996e-05 2024-04-19T03:03:28.608 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:28.608 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:28.608 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:28.608 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.608 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.608 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:158385 5.9 5:950ec749:::benchmark_data_smithi096_19531_object44935:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-19T03:03:28.608 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:58.129756+0000", 2024-04-19T03:03:28.608 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 30.382838483, 2024-04-19T03:03:28.608 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.068998382999999996, 2024-04-19T03:03:28.608 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:28.608 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:28.609 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:28.609 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:28.609 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:28.609 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 158385 2024-04-19T03:03:28.609 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.609 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:28.609 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.609 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:28.609 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.129756+0000", 2024-04-19T03:03:28.609 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:28.609 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.609 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.609 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:28.609 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.129756+0000", 2024-04-19T03:03:28.610 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:28.610 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.610 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.610 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:28.610 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.129755+0000", 2024-04-19T03:03:28.610 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:03:28.610 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.610 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.610 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:28.610 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.129760+0000", 2024-04-19T03:03:28.610 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6030000000000004e-06 2024-04-19T03:03:28.610 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.610 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.611 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:28.611 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.129774+0000", 2024-04-19T03:03:28.611 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3131e-05 2024-04-19T03:03:28.611 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.611 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.611 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:28.611 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.129781+0000", 2024-04-19T03:03:28.611 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4030000000000001e-06 2024-04-19T03:03:28.611 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.611 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.611 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:28.611 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.130837+0000", 2024-04-19T03:03:28.611 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00105569 2024-04-19T03:03:28.612 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.612 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.612 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:28.612 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.130917+0000", 2024-04-19T03:03:28.612 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9929e-05 2024-04-19T03:03:28.612 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.612 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.612 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:03:28.612 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.130973+0000", 2024-04-19T03:03:28.612 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.664e-05 2024-04-19T03:03:28.612 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.612 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.612 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:03:28.612 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.132340+0000", 2024-04-19T03:03:28.613 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001366321 2024-04-19T03:03:28.613 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.613 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.613 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:28.613 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.198637+0000", 2024-04-19T03:03:28.613 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.066296888999999998 2024-04-19T03:03:28.613 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.613 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.613 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:03:28.613 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.198704+0000", 2024-04-19T03:03:28.613 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7333000000000001e-05 2024-04-19T03:03:28.613 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.613 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.613 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:28.614 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.198754+0000", 2024-04-19T03:03:28.614 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0421999999999999e-05 2024-04-19T03:03:28.614 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:28.614 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:28.614 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:28.614 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.614 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.614 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:158387 5.9 5:9e96f619:::benchmark_data_smithi096_19531_object44937:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-19T03:03:28.614 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:58.132457+0000", 2024-04-19T03:03:28.614 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 30.380136919000002, 2024-04-19T03:03:28.614 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.066858091999999994, 2024-04-19T03:03:28.614 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:28.614 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:28.615 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:28.615 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:28.615 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:28.615 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 158387 2024-04-19T03:03:28.615 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.615 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:28.615 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.615 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:28.615 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.132457+0000", 2024-04-19T03:03:28.615 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:28.615 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.615 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.615 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:28.615 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.132457+0000", 2024-04-19T03:03:28.616 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:28.616 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.616 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.616 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:28.616 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.132457+0000", 2024-04-19T03:03:28.616 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:28.616 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.616 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.616 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:28.616 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.132460+0000", 2024-04-19T03:03:28.616 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.1949999999999999e-06 2024-04-19T03:03:28.616 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.617 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.617 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:28.617 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.132468+0000", 2024-04-19T03:03:28.617 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.1599999999999998e-06 2024-04-19T03:03:28.617 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.617 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.617 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:28.617 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.132473+0000", 2024-04-19T03:03:28.617 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9259999999999999e-06 2024-04-19T03:03:28.617 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.617 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.617 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:28.617 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.132504+0000", 2024-04-19T03:03:28.617 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0914000000000003e-05 2024-04-19T03:03:28.618 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.618 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.618 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:28.618 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.132646+0000", 2024-04-19T03:03:28.618 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00014214300000000001 2024-04-19T03:03:28.618 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.618 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.618 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:03:28.618 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.132741+0000", 2024-04-19T03:03:28.618 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.4344000000000003e-05 2024-04-19T03:03:28.618 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.618 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.618 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:03:28.618 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.135774+0000", 2024-04-19T03:03:28.619 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0030334960000000001 2024-04-19T03:03:28.619 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.619 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.619 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:28.619 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.199240+0000", 2024-04-19T03:03:28.619 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.063465695000000003 2024-04-19T03:03:28.619 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.619 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.619 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:03:28.619 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.199272+0000", 2024-04-19T03:03:28.619 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2412000000000001e-05 2024-04-19T03:03:28.619 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.619 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.619 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:28.620 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.199316+0000", 2024-04-19T03:03:28.620 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3275000000000002e-05 2024-04-19T03:03:28.620 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:28.620 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:28.620 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:28.620 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.620 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.620 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:158392 5.f 5:f462725f:::benchmark_data_smithi096_19531_object44942:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-19T03:03:28.620 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:58.135703+0000", 2024-04-19T03:03:28.620 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 30.376891139000001, 2024-04-19T03:03:28.620 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.063132879000000003, 2024-04-19T03:03:28.620 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:28.620 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:28.620 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:28.621 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:28.621 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:28.621 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 158392 2024-04-19T03:03:28.621 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.621 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:28.621 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.621 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:28.621 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.135703+0000", 2024-04-19T03:03:28.621 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:28.621 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.621 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.621 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:28.621 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.135703+0000", 2024-04-19T03:03:28.621 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:28.622 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.622 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.622 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:28.622 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.135702+0000", 2024-04-19T03:03:28.622 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:03:28.622 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.622 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.622 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:28.622 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.135708+0000", 2024-04-19T03:03:28.622 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8270000000000003e-06 2024-04-19T03:03:28.622 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.622 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.622 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:28.623 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.135720+0000", 2024-04-19T03:03:28.623 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2057e-05 2024-04-19T03:03:28.623 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.623 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.623 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:28.623 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.135727+0000", 2024-04-19T03:03:28.623 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8090000000000004e-06 2024-04-19T03:03:28.623 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.623 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.623 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:28.623 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.135768+0000", 2024-04-19T03:03:28.623 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1548999999999998e-05 2024-04-19T03:03:28.623 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.623 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.624 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:28.624 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.135853+0000", 2024-04-19T03:03:28.624 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4845000000000005e-05 2024-04-19T03:03:28.624 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.624 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.624 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:03:28.624 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.135934+0000", 2024-04-19T03:03:28.624 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0315000000000006e-05 2024-04-19T03:03:28.624 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.624 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.624 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:03:28.624 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.138685+0000", 2024-04-19T03:03:28.624 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.002751042 2024-04-19T03:03:28.625 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.625 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.625 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:28.625 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.198747+0000", 2024-04-19T03:03:28.625 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.060062675000000003 2024-04-19T03:03:28.625 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.625 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.625 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:03:28.625 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.198802+0000", 2024-04-19T03:03:28.625 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4469000000000003e-05 2024-04-19T03:03:28.625 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.625 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.625 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:28.626 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.198836+0000", 2024-04-19T03:03:28.626 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4272e-05 2024-04-19T03:03:28.626 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:28.626 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:28.626 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:28.626 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.626 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.626 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:158397 5.d 5:b5d962e9:::benchmark_data_smithi096_19531_object44947:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-19T03:03:28.626 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:58.138717+0000", 2024-04-19T03:03:28.626 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 30.373877195999999, 2024-04-19T03:03:28.626 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.057191467000000003, 2024-04-19T03:03:28.626 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:28.626 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:28.627 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:28.627 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:28.627 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:28.627 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 158397 2024-04-19T03:03:28.627 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.627 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:28.627 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.627 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:28.627 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.138717+0000", 2024-04-19T03:03:28.627 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:28.627 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.627 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.627 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:28.627 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.138717+0000", 2024-04-19T03:03:28.628 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:28.628 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.628 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.628 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:28.628 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.138716+0000", 2024-04-19T03:03:28.628 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999986 2024-04-19T03:03:28.628 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.628 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.628 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:28.628 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.138722+0000", 2024-04-19T03:03:28.628 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1709999999999999e-06 2024-04-19T03:03:28.628 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.628 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.628 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:28.629 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.138731+0000", 2024-04-19T03:03:28.629 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.0310000000000004e-06 2024-04-19T03:03:28.629 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.629 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.629 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:28.629 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.138738+0000", 2024-04-19T03:03:28.629 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8430000000000004e-06 2024-04-19T03:03:28.629 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.629 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.629 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:28.629 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.138789+0000", 2024-04-19T03:03:28.629 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0623e-05 2024-04-19T03:03:28.629 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.629 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.630 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:28.630 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.138945+0000", 2024-04-19T03:03:28.630 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00015671899999999999 2024-04-19T03:03:28.630 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.630 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.630 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:03:28.630 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.139079+0000", 2024-04-19T03:03:28.630 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00013380099999999999 2024-04-19T03:03:28.630 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.630 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.630 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:03:28.630 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.141715+0000", 2024-04-19T03:03:28.631 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0026362849999999999 2024-04-19T03:03:28.631 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.631 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.631 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:28.631 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.195784+0000", 2024-04-19T03:03:28.631 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.054068353 2024-04-19T03:03:28.631 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.631 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.631 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:03:28.631 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.195852+0000", 2024-04-19T03:03:28.631 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8121999999999996e-05 2024-04-19T03:03:28.631 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:28.631 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:28.631 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:28.631 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.195909+0000", 2024-04-19T03:03:28.632 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6737999999999998e-05 2024-04-19T03:03:28.632 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:28.632 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:28.632 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:28.632 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:28.632 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:28.632 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-04-19T03:03:28.633 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T03:03:28.634 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:03:28.630+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:03:28.735 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:03:28.732+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:03:28.750 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-19T03:03:28.750 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-04-19T03:03:28.750 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 0 2024-04-19T03:03:28.750 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-19T03:03:28.760 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T03:03:28.835 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:03:28.830+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:03:28.870 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-19T03:03:28.870 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-04-19T03:03:28.870 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-04-19T03:03:28.870 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-04-19T03:03:28.870 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-19T03:03:28.879 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T03:03:28.936 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:03:28.932+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:03:28.991 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-19T03:03:28.991 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-04-19T03:03:28.991 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-04-19T03:03:28.991 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-04-19T03:03:28.992 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:28.992 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:86615 5.e 5:7fef7288:::benchmark_data_smithi096_19531_object86614:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:28.992 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:22.634544+0000", 2024-04-19T03:03:28.992 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 66.353685029999994, 2024-04-19T03:03:28.992 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.192475071, 2024-04-19T03:03:28.992 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:28.992 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:28.992 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:28.992 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:28.992 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:28.992 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 86615 2024-04-19T03:03:28.992 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:28.992 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:28.993 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:28.993 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:28.993 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634544+0000", 2024-04-19T03:03:28.993 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:28.993 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:28.993 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:28.993 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:28.993 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634544+0000", 2024-04-19T03:03:28.993 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:28.993 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:28.993 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:28.993 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:28.993 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634542+0000", 2024-04-19T03:03:28.993 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999981 2024-04-19T03:03:28.993 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:28.994 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:28.994 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:28.994 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634585+0000", 2024-04-19T03:03:28.994 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2299000000000003e-05 2024-04-19T03:03:28.994 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:28.994 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:28.994 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:28.994 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634592+0000", 2024-04-19T03:03:28.994 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2350000000000002e-06 2024-04-19T03:03:28.994 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:28.994 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:28.994 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:28.995 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634596+0000", 2024-04-19T03:03:28.995 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5390000000000001e-06 2024-04-19T03:03:28.995 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:28.995 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:28.995 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:28.995 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634639+0000", 2024-04-19T03:03:28.995 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2444999999999998e-05 2024-04-19T03:03:28.995 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:28.995 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:28.995 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:28.995 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634808+0000", 2024-04-19T03:03:28.995 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000169152 2024-04-19T03:03:28.995 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:28.995 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:28.995 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:28.996 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634999+0000", 2024-04-19T03:03:28.996 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00019098300000000001 2024-04-19T03:03:28.996 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:28.996 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:28.996 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:28.996 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.640458+0000", 2024-04-19T03:03:28.996 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0054586870000000003 2024-04-19T03:03:28.996 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:28.996 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:28.996 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:28.996 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.826949+0000", 2024-04-19T03:03:28.996 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.18649178299999999 2024-04-19T03:03:28.996 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:28.997 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:28.997 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:03:28.997 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.826982+0000", 2024-04-19T03:03:28.997 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2477000000000001e-05 2024-04-19T03:03:28.997 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:28.997 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:28.997 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:28.997 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.827019+0000", 2024-04-19T03:03:28.997 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7355999999999999e-05 2024-04-19T03:03:28.997 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:28.997 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:28.997 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:28.997 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:28.997 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:28.998 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:86616 5.e 5:72278f47:::benchmark_data_smithi096_19531_object86615:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:28.998 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:22.634609+0000", 2024-04-19T03:03:28.998 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 66.353619881, 2024-04-19T03:03:28.998 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.19472088900000001, 2024-04-19T03:03:28.998 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:28.998 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:28.998 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:28.998 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:28.998 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:28.998 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 86616 2024-04-19T03:03:28.998 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:28.998 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:28.998 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:28.998 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:28.999 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634609+0000", 2024-04-19T03:03:28.999 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:28.999 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:28.999 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:28.999 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:28.999 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634609+0000", 2024-04-19T03:03:28.999 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:28.999 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:28.999 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:28.999 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:28.999 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634609+0000", 2024-04-19T03:03:28.999 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:28.999 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:28.999 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.000 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:29.000 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634651+0000", 2024-04-19T03:03:29.000 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2589000000000002e-05 2024-04-19T03:03:29.000 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.000 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.000 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:29.000 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634659+0000", 2024-04-19T03:03:29.000 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5850000000000002e-06 2024-04-19T03:03:29.000 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.000 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.000 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:29.000 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634662+0000", 2024-04-19T03:03:29.000 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3620000000000002e-06 2024-04-19T03:03:29.000 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.001 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.001 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:29.001 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.637880+0000", 2024-04-19T03:03:29.001 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.003218149 2024-04-19T03:03:29.001 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.001 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.001 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:29.001 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.637999+0000", 2024-04-19T03:03:29.001 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000118643 2024-04-19T03:03:29.001 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.001 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.001 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:29.001 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.638102+0000", 2024-04-19T03:03:29.001 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010331 2024-04-19T03:03:29.002 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.002 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.002 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:29.002 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.640851+0000", 2024-04-19T03:03:29.002 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0027483310000000001 2024-04-19T03:03:29.002 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.002 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.002 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:29.002 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.829269+0000", 2024-04-19T03:03:29.002 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.188418319 2024-04-19T03:03:29.002 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.002 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.002 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:03:29.002 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.829299+0000", 2024-04-19T03:03:29.003 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0227e-05 2024-04-19T03:03:29.003 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.003 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.003 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:29.003 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.829330+0000", 2024-04-19T03:03:29.003 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0969000000000001e-05 2024-04-19T03:03:29.003 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:29.003 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:29.003 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:29.003 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.003 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.003 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:86618 5.0 5:09014b90:::benchmark_data_smithi096_19531_object86617:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:29.003 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:22.634894+0000", 2024-04-19T03:03:29.003 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 66.353335392999995, 2024-04-19T03:03:29.004 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.19413419800000001, 2024-04-19T03:03:29.004 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:29.004 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:29.004 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:29.004 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:29.004 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:29.004 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 86618 2024-04-19T03:03:29.004 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.004 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:29.004 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.004 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:29.004 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634894+0000", 2024-04-19T03:03:29.004 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:29.004 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.004 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.005 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:29.005 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634894+0000", 2024-04-19T03:03:29.005 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:29.005 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.005 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.005 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:29.005 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634893+0000", 2024-04-19T03:03:29.005 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:03:29.005 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.005 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.005 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:29.005 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634976+0000", 2024-04-19T03:03:29.005 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3231000000000003e-05 2024-04-19T03:03:29.006 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.006 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.006 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:29.006 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634983+0000", 2024-04-19T03:03:29.006 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5169999999999996e-06 2024-04-19T03:03:29.006 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.006 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.006 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:29.006 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634987+0000", 2024-04-19T03:03:29.006 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.425e-06 2024-04-19T03:03:29.006 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.006 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.006 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:29.006 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635030+0000", 2024-04-19T03:03:29.007 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.32e-05 2024-04-19T03:03:29.007 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.007 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.007 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:29.007 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635185+0000", 2024-04-19T03:03:29.007 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015471899999999999 2024-04-19T03:03:29.007 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.007 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.007 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:29.007 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635415+0000", 2024-04-19T03:03:29.007 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00023026500000000001 2024-04-19T03:03:29.007 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.007 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.007 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:29.008 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.640127+0000", 2024-04-19T03:03:29.008 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0047118890000000004 2024-04-19T03:03:29.008 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.008 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.008 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:29.008 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.828895+0000", 2024-04-19T03:03:29.008 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.18876802600000001 2024-04-19T03:03:29.008 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.008 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.008 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:03:29.008 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.828972+0000", 2024-04-19T03:03:29.008 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.6345000000000002e-05 2024-04-19T03:03:29.008 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.008 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.009 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:29.009 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.829028+0000", 2024-04-19T03:03:29.009 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6342999999999999e-05 2024-04-19T03:03:29.009 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:29.009 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:29.009 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:29.009 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.009 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.009 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:86620 5.b 5:d80faa68:::benchmark_data_smithi096_19531_object86619:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:29.009 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:22.635110+0000", 2024-04-19T03:03:29.009 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 66.353118832999996, 2024-04-19T03:03:29.009 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.193447275, 2024-04-19T03:03:29.009 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:29.009 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:29.009 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:29.010 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:29.010 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:29.010 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 86620 2024-04-19T03:03:29.010 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.010 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:29.010 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.010 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:29.010 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635110+0000", 2024-04-19T03:03:29.010 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:29.010 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.010 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.010 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:29.010 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635110+0000", 2024-04-19T03:03:29.010 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:29.011 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.011 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.011 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:29.011 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635110+0000", 2024-04-19T03:03:29.011 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:29.011 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.011 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.011 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:29.011 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635154+0000", 2024-04-19T03:03:29.011 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4681000000000001e-05 2024-04-19T03:03:29.011 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.011 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.011 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:29.011 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635166+0000", 2024-04-19T03:03:29.012 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1505000000000001e-05 2024-04-19T03:03:29.012 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.012 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.012 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:29.012 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635171+0000", 2024-04-19T03:03:29.012 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6040000000000003e-06 2024-04-19T03:03:29.012 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.012 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.012 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:29.012 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635221+0000", 2024-04-19T03:03:29.012 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9947000000000001e-05 2024-04-19T03:03:29.012 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.012 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.012 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:29.012 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635356+0000", 2024-04-19T03:03:29.013 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013576199999999999 2024-04-19T03:03:29.013 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.013 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.013 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:29.013 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635507+0000", 2024-04-19T03:03:29.013 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015072999999999999 2024-04-19T03:03:29.013 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.013 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.013 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:29.013 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.638488+0000", 2024-04-19T03:03:29.013 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0029813159999999999 2024-04-19T03:03:29.013 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.013 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.013 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:29.014 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.828341+0000", 2024-04-19T03:03:29.014 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.189852254 2024-04-19T03:03:29.014 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.014 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.014 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:03:29.014 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.828416+0000", 2024-04-19T03:03:29.014 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5344000000000002e-05 2024-04-19T03:03:29.014 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.014 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.014 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:29.014 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.828558+0000", 2024-04-19T03:03:29.014 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000141695 2024-04-19T03:03:29.014 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:29.014 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:29.015 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:29.015 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.015 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.015 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:86621 5.8 5:1597a420:::benchmark_data_smithi096_19531_object86620:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:29.015 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:22.635187+0000", 2024-04-19T03:03:29.015 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 66.353041973000003, 2024-04-19T03:03:29.015 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.194204878, 2024-04-19T03:03:29.015 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:29.015 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:29.015 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:29.015 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:29.015 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:29.015 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 86621 2024-04-19T03:03:29.015 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.016 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:29.016 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.016 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:29.016 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635187+0000", 2024-04-19T03:03:29.016 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:29.016 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.016 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.016 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:29.016 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635187+0000", 2024-04-19T03:03:29.016 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:29.016 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.016 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.016 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:29.016 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635187+0000", 2024-04-19T03:03:29.017 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:29.017 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.017 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.017 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:29.017 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635242+0000", 2024-04-19T03:03:29.017 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5158000000000003e-05 2024-04-19T03:03:29.017 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.017 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.017 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:29.017 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635249+0000", 2024-04-19T03:03:29.017 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.7000000000000008e-06 2024-04-19T03:03:29.017 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.017 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.017 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:29.017 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635256+0000", 2024-04-19T03:03:29.018 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2060000000000004e-06 2024-04-19T03:03:29.018 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.018 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.018 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:29.018 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635302+0000", 2024-04-19T03:03:29.018 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5954000000000001e-05 2024-04-19T03:03:29.018 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.018 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.018 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:29.018 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635427+0000", 2024-04-19T03:03:29.018 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012559299999999999 2024-04-19T03:03:29.018 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.018 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.018 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:29.019 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635596+0000", 2024-04-19T03:03:29.019 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000168615 2024-04-19T03:03:29.019 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.019 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.019 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:29.019 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.639320+0000", 2024-04-19T03:03:29.019 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0037244610000000001 2024-04-19T03:03:29.019 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.019 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.019 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:29.019 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.829277+0000", 2024-04-19T03:03:29.019 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.18995651099999999 2024-04-19T03:03:29.019 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.019 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.019 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:03:29.020 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.829341+0000", 2024-04-19T03:03:29.020 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3756000000000004e-05 2024-04-19T03:03:29.020 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.020 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.020 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:29.020 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.829392+0000", 2024-04-19T03:03:29.020 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1555999999999999e-05 2024-04-19T03:03:29.020 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:29.020 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:29.020 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:29.020 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.020 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.020 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87067 5.b 5:d57af71a:::benchmark_data_smithi096_19531_object87066:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:29.020 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.142233+0000", 2024-04-19T03:03:29.021 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 65.845996110000002, 2024-04-19T03:03:29.021 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.071692405000000001, 2024-04-19T03:03:29.021 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:29.021 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:29.021 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:29.021 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:29.021 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:29.021 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87067 2024-04-19T03:03:29.021 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.021 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:29.021 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.021 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:29.021 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142233+0000", 2024-04-19T03:03:29.021 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:29.021 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.022 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.022 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:29.022 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142233+0000", 2024-04-19T03:03:29.022 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:29.022 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.022 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.022 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:29.022 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142232+0000", 2024-04-19T03:03:29.022 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:03:29.022 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.022 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.022 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:29.022 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142277+0000", 2024-04-19T03:03:29.022 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5837000000000002e-05 2024-04-19T03:03:29.023 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.023 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.023 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:29.023 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142297+0000", 2024-04-19T03:03:29.023 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9561000000000001e-05 2024-04-19T03:03:29.023 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.023 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.023 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:29.023 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142311+0000", 2024-04-19T03:03:29.023 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3654e-05 2024-04-19T03:03:29.023 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.023 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.023 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:29.023 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142391+0000", 2024-04-19T03:03:29.024 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0123999999999994e-05 2024-04-19T03:03:29.024 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.024 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.024 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:29.024 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142669+0000", 2024-04-19T03:03:29.024 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00027829800000000001 2024-04-19T03:03:29.024 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.024 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.024 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:29.024 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142859+0000", 2024-04-19T03:03:29.024 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000190051 2024-04-19T03:03:29.024 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.024 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.024 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:29.024 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.150597+0000", 2024-04-19T03:03:29.025 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0077380299999999999 2024-04-19T03:03:29.025 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.025 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.025 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:29.025 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.213855+0000", 2024-04-19T03:03:29.025 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.063257987000000002 2024-04-19T03:03:29.025 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.025 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.025 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:03:29.025 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.213898+0000", 2024-04-19T03:03:29.025 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2916e-05 2024-04-19T03:03:29.025 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.025 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.025 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:29.025 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.213925+0000", 2024-04-19T03:03:29.026 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7503000000000001e-05 2024-04-19T03:03:29.026 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:29.026 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:29.026 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:29.026 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.026 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.026 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87069 5.b 5:da0c93b5:::benchmark_data_smithi096_19531_object87068:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:29.026 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.143402+0000", 2024-04-19T03:03:29.026 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 65.844827147999993, 2024-04-19T03:03:29.026 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.070678598999999995, 2024-04-19T03:03:29.026 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:29.026 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:29.026 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:29.026 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:29.027 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:29.027 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87069 2024-04-19T03:03:29.027 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.027 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:29.027 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.027 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:29.027 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.143402+0000", 2024-04-19T03:03:29.027 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:29.027 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.027 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.027 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:29.027 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.143402+0000", 2024-04-19T03:03:29.027 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:29.027 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.027 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.028 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:29.028 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.143401+0000", 2024-04-19T03:03:29.028 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:03:29.028 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.028 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.028 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:29.028 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.143501+0000", 2024-04-19T03:03:29.028 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000100387 2024-04-19T03:03:29.028 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.028 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.028 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:29.028 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.143516+0000", 2024-04-19T03:03:29.028 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5369000000000001e-05 2024-04-19T03:03:29.028 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.028 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.029 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:29.029 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.143524+0000", 2024-04-19T03:03:29.029 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.7079999999999997e-06 2024-04-19T03:03:29.029 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.029 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.029 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:29.029 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.145550+0000", 2024-04-19T03:03:29.029 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0020259290000000001 2024-04-19T03:03:29.029 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.029 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.029 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:29.029 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.145676+0000", 2024-04-19T03:03:29.029 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000126406 2024-04-19T03:03:29.029 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.029 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.030 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:29.030 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.145802+0000", 2024-04-19T03:03:29.030 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000125974 2024-04-19T03:03:29.030 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.030 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.030 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:29.030 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.151030+0000", 2024-04-19T03:03:29.030 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0052276079999999999 2024-04-19T03:03:29.030 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.030 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.030 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:29.030 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.213998+0000", 2024-04-19T03:03:29.030 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.06296786 2024-04-19T03:03:29.030 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.030 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.031 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:03:29.031 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.214031+0000", 2024-04-19T03:03:29.031 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3387999999999999e-05 2024-04-19T03:03:29.031 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.031 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.031 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:29.032 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.214081+0000", 2024-04-19T03:03:29.032 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9316e-05 2024-04-19T03:03:29.032 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:29.032 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:29.032 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:29.033 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.033 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.033 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87108 5.e 5:7e197adc:::benchmark_data_smithi096_19531_object87107:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:29.033 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.223103+0000", 2024-04-19T03:03:29.033 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 65.765125811000004, 2024-04-19T03:03:29.033 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.044946887, 2024-04-19T03:03:29.033 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:29.033 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-19T03:03:29.033 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:29.033 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:29.034 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:29.034 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87108 2024-04-19T03:03:29.034 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.034 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:29.034 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.034 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:29.034 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.223103+0000", 2024-04-19T03:03:29.035 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:29.035 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.035 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.035 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:29.035 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.223103+0000", 2024-04-19T03:03:29.035 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:29.035 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.035 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.035 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:29.035 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.223102+0000", 2024-04-19T03:03:29.035 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:03:29.035 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.035 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.035 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:29.036 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.223156+0000", 2024-04-19T03:03:29.036 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3958000000000001e-05 2024-04-19T03:03:29.036 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.036 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.036 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:29.036 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.223166+0000", 2024-04-19T03:03:29.036 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.4809999999999995e-06 2024-04-19T03:03:29.036 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.036 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.036 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:29.036 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.223172+0000", 2024-04-19T03:03:29.036 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0140000000000004e-06 2024-04-19T03:03:29.036 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.036 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.036 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:29.037 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.227295+0000", 2024-04-19T03:03:29.037 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0041233420000000003 2024-04-19T03:03:29.037 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.037 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.037 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:29.037 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.227495+0000", 2024-04-19T03:03:29.037 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00019955299999999999 2024-04-19T03:03:29.037 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.037 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.037 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:29.037 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.227717+0000", 2024-04-19T03:03:29.037 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000221902 2024-04-19T03:03:29.037 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.038 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.038 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:29.038 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233189+0000", 2024-04-19T03:03:29.038 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0054718889999999997 2024-04-19T03:03:29.038 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.038 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.038 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:29.038 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.250529+0000", 2024-04-19T03:03:29.038 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.017340298000000001 2024-04-19T03:03:29.038 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.038 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.038 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:03:29.038 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.250539+0000", 2024-04-19T03:03:29.038 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0501e-05 2024-04-19T03:03:29.039 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.039 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.039 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:29.039 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.268003+0000", 2024-04-19T03:03:29.039 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.017463429 2024-04-19T03:03:29.039 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.039 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.039 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:29.039 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.268050+0000", 2024-04-19T03:03:29.039 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7466000000000003e-05 2024-04-19T03:03:29.039 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:29.040 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:29.040 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:29.040 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.041 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.041 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87118 5.b 5:d1bb4f3c:::benchmark_data_smithi096_19531_object87117:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:29.041 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.231082+0000", 2024-04-19T03:03:29.041 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 65.757146977000005, 2024-04-19T03:03:29.041 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.035789004, 2024-04-19T03:03:29.041 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:29.041 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-19T03:03:29.041 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:29.041 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:29.041 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:29.042 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87118 2024-04-19T03:03:29.042 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.042 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:29.042 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.042 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:29.042 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231082+0000", 2024-04-19T03:03:29.042 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:29.042 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.042 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.042 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:29.042 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231082+0000", 2024-04-19T03:03:29.043 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:29.043 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.043 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.043 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:29.043 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231081+0000", 2024-04-19T03:03:29.043 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:03:29.043 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.043 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.043 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:29.043 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231159+0000", 2024-04-19T03:03:29.043 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.7819999999999997e-05 2024-04-19T03:03:29.043 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.043 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.043 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:29.044 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231186+0000", 2024-04-19T03:03:29.044 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7126000000000001e-05 2024-04-19T03:03:29.044 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.044 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.044 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:29.044 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231193+0000", 2024-04-19T03:03:29.044 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7259999999999996e-06 2024-04-19T03:03:29.044 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.044 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.044 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:29.044 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231241+0000", 2024-04-19T03:03:29.044 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8123e-05 2024-04-19T03:03:29.044 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.045 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.045 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:29.045 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231354+0000", 2024-04-19T03:03:29.045 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0001133 2024-04-19T03:03:29.045 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.045 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.045 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:29.045 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231443+0000", 2024-04-19T03:03:29.045 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9167999999999997e-05 2024-04-19T03:03:29.045 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.045 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.045 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:29.045 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236498+0000", 2024-04-19T03:03:29.045 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0050545160000000002 2024-04-19T03:03:29.046 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.046 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.046 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:29.046 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.249681+0000", 2024-04-19T03:03:29.046 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013183321 2024-04-19T03:03:29.046 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.046 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.046 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:03:29.046 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.249693+0000", 2024-04-19T03:03:29.046 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1834999999999999e-05 2024-04-19T03:03:29.046 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.046 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.046 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:29.046 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266733+0000", 2024-04-19T03:03:29.047 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.017040408 2024-04-19T03:03:29.047 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.047 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.047 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:29.047 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266871+0000", 2024-04-19T03:03:29.047 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000137849 2024-04-19T03:03:29.047 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:29.047 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:29.047 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:29.047 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.047 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.047 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87121 5.b 5:d01822b8:::benchmark_data_smithi096_19531_object87120:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:29.047 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.233319+0000", 2024-04-19T03:03:29.047 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 65.754910112999994, 2024-04-19T03:03:29.047 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.033624198, 2024-04-19T03:03:29.048 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:29.048 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-19T03:03:29.048 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:29.048 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:29.048 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:29.048 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87121 2024-04-19T03:03:29.048 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.048 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:29.048 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.048 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:29.048 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233319+0000", 2024-04-19T03:03:29.048 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:29.048 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.049 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.049 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:29.049 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233319+0000", 2024-04-19T03:03:29.049 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:29.049 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.049 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.049 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:29.049 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233319+0000", 2024-04-19T03:03:29.049 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:29.049 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.049 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.049 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:29.049 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233364+0000", 2024-04-19T03:03:29.049 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5460999999999997e-05 2024-04-19T03:03:29.050 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.050 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.050 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:29.050 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233382+0000", 2024-04-19T03:03:29.050 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8148e-05 2024-04-19T03:03:29.050 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.050 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.050 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:29.050 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233390+0000", 2024-04-19T03:03:29.050 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5340000000000002e-06 2024-04-19T03:03:29.050 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.050 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.050 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:29.051 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233712+0000", 2024-04-19T03:03:29.051 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00032260500000000001 2024-04-19T03:03:29.051 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.051 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.051 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:29.051 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233829+0000", 2024-04-19T03:03:29.051 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011638599999999999 2024-04-19T03:03:29.051 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.051 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.051 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:29.051 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233959+0000", 2024-04-19T03:03:29.051 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013013900000000001 2024-04-19T03:03:29.051 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.051 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.051 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:29.052 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236515+0000", 2024-04-19T03:03:29.052 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0025562750000000002 2024-04-19T03:03:29.052 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.052 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.052 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:29.052 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.249723+0000", 2024-04-19T03:03:29.052 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013208176 2024-04-19T03:03:29.052 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.052 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.052 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:03:29.052 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.249728+0000", 2024-04-19T03:03:29.052 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6519999999999997e-06 2024-04-19T03:03:29.052 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.052 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.053 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:29.053 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266837+0000", 2024-04-19T03:03:29.053 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0171087059999999 2024-04-19T03:03:29.053 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.053 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.053 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:29.053 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266943+0000", 2024-04-19T03:03:29.053 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000106604 2024-04-19T03:03:29.053 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:29.053 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:29.053 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:29.053 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.053 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.053 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87124 5.8 5:14819ad7:::benchmark_data_smithi096_19531_object87123:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:29.053 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.235886+0000", 2024-04-19T03:03:29.053 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 65.752342689000002, 2024-04-19T03:03:29.054 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0315451179999999, 2024-04-19T03:03:29.054 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:29.054 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-19T03:03:29.054 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:29.054 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:29.054 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:29.054 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87124 2024-04-19T03:03:29.054 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.054 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:29.054 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.054 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:29.054 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.235886+0000", 2024-04-19T03:03:29.055 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:29.055 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.055 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.055 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:29.055 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.235886+0000", 2024-04-19T03:03:29.055 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:29.055 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.055 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.055 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:29.055 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.235886+0000", 2024-04-19T03:03:29.055 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:03:29.055 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.055 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.055 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:29.056 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.235934+0000", 2024-04-19T03:03:29.056 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8384000000000003e-05 2024-04-19T03:03:29.056 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.056 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.056 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:29.056 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.235945+0000", 2024-04-19T03:03:29.056 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0671e-05 2024-04-19T03:03:29.056 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.056 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.056 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:29.056 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.235952+0000", 2024-04-19T03:03:29.056 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3089999999999998e-06 2024-04-19T03:03:29.056 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.057 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.057 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:29.057 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.237067+0000", 2024-04-19T03:03:29.057 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001115263 2024-04-19T03:03:29.057 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.057 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.057 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:29.057 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.237188+0000", 2024-04-19T03:03:29.057 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000121258 2024-04-19T03:03:29.057 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.057 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.057 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:29.057 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.237316+0000", 2024-04-19T03:03:29.057 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000128071 2024-04-19T03:03:29.058 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.058 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.058 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:29.058 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240744+0000", 2024-04-19T03:03:29.058 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0034275629999999998 2024-04-19T03:03:29.058 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.058 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.058 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:29.058 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.252517+0000", 2024-04-19T03:03:29.058 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011772991999999999 2024-04-19T03:03:29.058 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.058 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.058 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:03:29.058 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.252523+0000", 2024-04-19T03:03:29.059 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3640000000000004e-06 2024-04-19T03:03:29.059 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.059 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.059 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:29.059 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.267290+0000", 2024-04-19T03:03:29.059 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0147665690000001 2024-04-19T03:03:29.059 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.059 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.059 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:29.059 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.267432+0000", 2024-04-19T03:03:29.059 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014165299999999999 2024-04-19T03:03:29.059 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:29.059 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:29.059 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:29.060 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.060 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.060 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87129 5.0 5:02667e01:::benchmark_data_smithi096_19531_object87128:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:29.060 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.236466+0000", 2024-04-19T03:03:29.060 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 65.751762693000003, 2024-04-19T03:03:29.060 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0301534510000001, 2024-04-19T03:03:29.060 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:29.060 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-19T03:03:29.060 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:29.060 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:29.060 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:29.060 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87129 2024-04-19T03:03:29.060 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.060 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:29.061 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.061 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:29.061 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236466+0000", 2024-04-19T03:03:29.061 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:29.061 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.061 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.061 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:29.061 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236466+0000", 2024-04-19T03:03:29.061 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:29.061 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.061 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.061 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:29.061 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236465+0000", 2024-04-19T03:03:29.061 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:03:29.062 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.062 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.062 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:29.062 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236566+0000", 2024-04-19T03:03:29.062 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010047000000000001 2024-04-19T03:03:29.062 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.062 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.062 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:29.062 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236577+0000", 2024-04-19T03:03:29.062 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1772e-05 2024-04-19T03:03:29.062 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.062 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.062 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:29.063 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236584+0000", 2024-04-19T03:03:29.063 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0530000000000003e-06 2024-04-19T03:03:29.063 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.063 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.063 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:29.063 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.237023+0000", 2024-04-19T03:03:29.063 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000439703 2024-04-19T03:03:29.063 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.063 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.063 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:29.063 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.237207+0000", 2024-04-19T03:03:29.063 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000183692 2024-04-19T03:03:29.063 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.063 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.063 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:29.064 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.237373+0000", 2024-04-19T03:03:29.064 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016623500000000001 2024-04-19T03:03:29.064 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.064 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.064 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:29.064 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.241461+0000", 2024-04-19T03:03:29.064 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0040883050000000004 2024-04-19T03:03:29.064 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.064 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.064 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:29.064 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.252500+0000", 2024-04-19T03:03:29.064 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011038450999999999 2024-04-19T03:03:29.064 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.064 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.065 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:03:29.065 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.252507+0000", 2024-04-19T03:03:29.065 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2439999999999996e-06 2024-04-19T03:03:29.065 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.065 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.065 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:29.065 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266538+0000", 2024-04-19T03:03:29.065 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.014031184 2024-04-19T03:03:29.065 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.065 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.065 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:29.065 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266620+0000", 2024-04-19T03:03:29.065 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1600000000000005e-05 2024-04-19T03:03:29.065 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:29.066 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:29.066 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:29.066 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.066 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.066 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87135 5.4 5:2a97e7b7:::benchmark_data_smithi096_19531_object87134:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:29.066 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.240884+0000", 2024-04-19T03:03:29.066 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 65.747345236000001, 2024-04-19T03:03:29.066 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.025708931, 2024-04-19T03:03:29.066 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:29.066 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-19T03:03:29.066 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:29.066 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:29.066 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:29.067 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87135 2024-04-19T03:03:29.067 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.067 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:29.067 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.067 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:29.067 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240884+0000", 2024-04-19T03:03:29.067 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:29.067 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.067 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.067 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:29.067 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240884+0000", 2024-04-19T03:03:29.067 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:29.067 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.067 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.068 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:29.068 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240883+0000", 2024-04-19T03:03:29.068 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:03:29.068 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.068 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.068 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:29.068 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240933+0000", 2024-04-19T03:03:29.068 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9969999999999998e-05 2024-04-19T03:03:29.068 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.068 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.068 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:29.068 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240946+0000", 2024-04-19T03:03:29.068 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2943e-05 2024-04-19T03:03:29.068 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.069 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.069 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:29.069 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240952+0000", 2024-04-19T03:03:29.069 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8930000000000002e-06 2024-04-19T03:03:29.069 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.069 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.069 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:29.069 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240994+0000", 2024-04-19T03:03:29.069 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2753999999999998e-05 2024-04-19T03:03:29.069 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.069 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.069 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:29.069 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.241092+0000", 2024-04-19T03:03:29.069 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.7447000000000004e-05 2024-04-19T03:03:29.070 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.070 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.070 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:29.070 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.241183+0000", 2024-04-19T03:03:29.070 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1163999999999997e-05 2024-04-19T03:03:29.070 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.070 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.070 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:29.070 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.254672+0000", 2024-04-19T03:03:29.070 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.01348864 2024-04-19T03:03:29.070 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.070 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.070 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:03:29.070 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.254681+0000", 2024-04-19T03:03:29.071 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.3789999999999995e-06 2024-04-19T03:03:29.071 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.071 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.071 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:29.071 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266456+0000", 2024-04-19T03:03:29.071 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.011774621 2024-04-19T03:03:29.071 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.071 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.071 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:29.071 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266593+0000", 2024-04-19T03:03:29.071 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013737600000000001 2024-04-19T03:03:29.071 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:29.072 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:29.072 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:29.072 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.072 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.072 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87136 5.4 5:212411bc:::benchmark_data_smithi096_19531_object87135:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:29.072 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.240962+0000", 2024-04-19T03:03:29.072 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 65.747267359999995, 2024-04-19T03:03:29.072 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.025738, 2024-04-19T03:03:29.072 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:29.072 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-19T03:03:29.072 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:29.072 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:29.072 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:29.073 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87136 2024-04-19T03:03:29.073 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.073 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:29.073 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.073 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:29.073 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240962+0000", 2024-04-19T03:03:29.073 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:29.073 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.073 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.073 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:29.073 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240962+0000", 2024-04-19T03:03:29.073 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:29.073 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.073 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.073 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:29.073 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240961+0000", 2024-04-19T03:03:29.074 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:29.074 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.074 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.074 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:29.074 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240995+0000", 2024-04-19T03:03:29.074 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3868000000000002e-05 2024-04-19T03:03:29.074 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.074 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.074 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:29.074 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.241001+0000", 2024-04-19T03:03:29.074 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.322e-06 2024-04-19T03:03:29.074 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.074 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.074 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:29.075 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.241004+0000", 2024-04-19T03:03:29.075 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3510000000000002e-06 2024-04-19T03:03:29.075 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.075 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.075 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:29.075 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247131+0000", 2024-04-19T03:03:29.075 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0061270869999999998 2024-04-19T03:03:29.075 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.075 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.075 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:29.075 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247322+0000", 2024-04-19T03:03:29.075 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000191015 2024-04-19T03:03:29.075 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.075 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.076 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:29.076 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247542+0000", 2024-04-19T03:03:29.076 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00022030199999999999 2024-04-19T03:03:29.076 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.076 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.076 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:29.076 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.254709+0000", 2024-04-19T03:03:29.076 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0071662660000000001 2024-04-19T03:03:29.076 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.076 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.076 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:03:29.076 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.254716+0000", 2024-04-19T03:03:29.077 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3860000000000001e-06 2024-04-19T03:03:29.077 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.077 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.077 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:29.077 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266619+0000", 2024-04-19T03:03:29.077 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0119031030000001 2024-04-19T03:03:29.077 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.077 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.077 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:29.077 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266700+0000", 2024-04-19T03:03:29.077 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0764000000000001e-05 2024-04-19T03:03:29.077 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:29.077 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:29.077 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:29.078 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.078 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.078 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87138 5.e 5:7b1f1c20:::benchmark_data_smithi096_19531_object87137:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:29.078 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.247862+0000", 2024-04-19T03:03:29.078 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 65.740367285999994, 2024-04-19T03:03:29.078 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.024457079, 2024-04-19T03:03:29.078 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:29.078 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:29.078 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:29.078 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:29.078 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:29.078 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87138 2024-04-19T03:03:29.078 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.079 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:29.079 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.079 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:29.079 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247862+0000", 2024-04-19T03:03:29.079 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:29.079 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.079 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.079 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:29.079 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247862+0000", 2024-04-19T03:03:29.079 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:29.079 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.079 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.079 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:29.079 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247860+0000", 2024-04-19T03:03:29.080 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999981 2024-04-19T03:03:29.080 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.080 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.080 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:29.080 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247909+0000", 2024-04-19T03:03:29.080 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9150999999999997e-05 2024-04-19T03:03:29.080 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.080 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.080 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:29.080 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247925+0000", 2024-04-19T03:03:29.080 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5761999999999999e-05 2024-04-19T03:03:29.080 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.080 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.080 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:29.081 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247936+0000", 2024-04-19T03:03:29.081 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1144e-05 2024-04-19T03:03:29.081 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.081 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.081 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:29.081 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.250590+0000", 2024-04-19T03:03:29.081 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.002653678 2024-04-19T03:03:29.081 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.081 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.081 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:03:29.081 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.250599+0000", 2024-04-19T03:03:29.081 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9039999999999998e-06 2024-04-19T03:03:29.081 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.081 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.082 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:29.082 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.268151+0000", 2024-04-19T03:03:29.082 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0175523449999999 2024-04-19T03:03:29.082 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.082 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.082 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:29.082 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.268285+0000", 2024-04-19T03:03:29.082 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013415599999999999 2024-04-19T03:03:29.082 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.082 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.082 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:29.082 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.272238+0000", 2024-04-19T03:03:29.082 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0039533019999999997 2024-04-19T03:03:29.083 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.083 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.083 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:03:29.083 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.272274+0000", 2024-04-19T03:03:29.083 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5352000000000003e-05 2024-04-19T03:03:29.083 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.083 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.083 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:29.083 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.272319+0000", 2024-04-19T03:03:29.083 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5281999999999998e-05 2024-04-19T03:03:29.083 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:29.083 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:29.083 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:29.083 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.083 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.084 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:158371 5.8 5:11a83024:::benchmark_data_smithi096_19531_object44921:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-19T03:03:29.084 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:58.125869+0000", 2024-04-19T03:03:29.084 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 30.862360420999998, 2024-04-19T03:03:29.084 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074532857999999994, 2024-04-19T03:03:29.084 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:29.084 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:29.084 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:29.084 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:29.084 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:29.084 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 158371 2024-04-19T03:03:29.084 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.084 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:29.084 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.085 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:29.085 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125869+0000", 2024-04-19T03:03:29.085 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:29.085 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.085 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.085 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:29.085 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125869+0000", 2024-04-19T03:03:29.085 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:29.085 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.085 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.085 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:29.085 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125868+0000", 2024-04-19T03:03:29.085 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:03:29.085 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.086 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.086 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:29.086 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125874+0000", 2024-04-19T03:03:29.086 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7120000000000003e-06 2024-04-19T03:03:29.086 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.086 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.086 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:29.086 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125885+0000", 2024-04-19T03:03:29.086 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0665999999999999e-05 2024-04-19T03:03:29.086 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.086 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.086 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:29.086 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125901+0000", 2024-04-19T03:03:29.087 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6463000000000001e-05 2024-04-19T03:03:29.087 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.087 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.087 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:29.087 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125956+0000", 2024-04-19T03:03:29.087 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4728000000000002e-05 2024-04-19T03:03:29.087 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.087 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.087 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:29.087 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.126050+0000", 2024-04-19T03:03:29.087 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.3534000000000003e-05 2024-04-19T03:03:29.087 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.087 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.087 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:29.088 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.200187+0000", 2024-04-19T03:03:29.088 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074136933000000002 2024-04-19T03:03:29.088 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.088 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.088 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:03:29.088 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.200260+0000", 2024-04-19T03:03:29.088 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3090999999999995e-05 2024-04-19T03:03:29.088 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.088 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.088 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:29.088 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.200402+0000", 2024-04-19T03:03:29.088 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014193699999999999 2024-04-19T03:03:29.088 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:29.088 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:29.089 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:29.089 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.089 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.089 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:158372 5.0 5:0473aa5f:::benchmark_data_smithi096_19531_object44922:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-19T03:03:29.089 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:58.125924+0000", 2024-04-19T03:03:29.089 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 30.862304814000002, 2024-04-19T03:03:29.089 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074247490999999999, 2024-04-19T03:03:29.089 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:29.089 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:29.089 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:29.089 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:29.089 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:29.089 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 158372 2024-04-19T03:03:29.090 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.090 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:29.090 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.090 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:29.090 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125924+0000", 2024-04-19T03:03:29.090 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:29.090 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.090 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.090 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:29.090 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125924+0000", 2024-04-19T03:03:29.090 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:29.090 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.090 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.091 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:29.091 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125924+0000", 2024-04-19T03:03:29.091 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:29.091 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.091 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.091 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:29.091 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125927+0000", 2024-04-19T03:03:29.091 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5389999999999999e-06 2024-04-19T03:03:29.091 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.091 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.091 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:29.091 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125935+0000", 2024-04-19T03:03:29.091 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3259999999999998e-06 2024-04-19T03:03:29.091 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.092 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.092 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:29.092 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125940+0000", 2024-04-19T03:03:29.092 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6980000000000003e-06 2024-04-19T03:03:29.092 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.092 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.092 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:29.092 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125982+0000", 2024-04-19T03:03:29.092 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1337000000000001e-05 2024-04-19T03:03:29.092 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.092 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.092 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:29.092 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.126075+0000", 2024-04-19T03:03:29.092 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.3579999999999995e-05 2024-04-19T03:03:29.093 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.093 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.093 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:29.093 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.199953+0000", 2024-04-19T03:03:29.093 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073877604999999999 2024-04-19T03:03:29.093 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.093 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.093 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:03:29.093 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.200022+0000", 2024-04-19T03:03:29.093 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.8824000000000004e-05 2024-04-19T03:03:29.093 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.093 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.093 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:29.094 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.200172+0000", 2024-04-19T03:03:29.094 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015017700000000001 2024-04-19T03:03:29.094 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:29.094 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:29.094 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:29.094 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.094 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.094 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:158374 5.e 5:76be57a5:::benchmark_data_smithi096_19531_object44924:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-19T03:03:29.094 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:58.125988+0000", 2024-04-19T03:03:29.094 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 30.862241314999999, 2024-04-19T03:03:29.094 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.067843332000000006, 2024-04-19T03:03:29.095 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:29.095 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:29.095 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:29.095 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:29.095 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:29.095 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 158374 2024-04-19T03:03:29.095 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.095 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:29.095 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.095 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:29.095 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125988+0000", 2024-04-19T03:03:29.095 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:29.095 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.095 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.096 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:29.096 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125988+0000", 2024-04-19T03:03:29.096 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:29.096 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.096 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.096 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:29.096 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125987+0000", 2024-04-19T03:03:29.096 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:29.096 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.096 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.096 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:29.096 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125990+0000", 2024-04-19T03:03:29.096 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7989999999999998e-06 2024-04-19T03:03:29.096 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.097 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.097 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:29.097 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125996+0000", 2024-04-19T03:03:29.097 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.302e-06 2024-04-19T03:03:29.097 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.097 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.097 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:29.097 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.126001+0000", 2024-04-19T03:03:29.097 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.843e-06 2024-04-19T03:03:29.097 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.097 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.097 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:29.097 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.126047+0000", 2024-04-19T03:03:29.098 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6066000000000002e-05 2024-04-19T03:03:29.098 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.098 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.098 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:29.098 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.126171+0000", 2024-04-19T03:03:29.098 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012359099999999999 2024-04-19T03:03:29.098 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.098 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.098 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:29.098 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.193709+0000", 2024-04-19T03:03:29.098 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.067538099000000004 2024-04-19T03:03:29.098 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.098 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.099 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:03:29.099 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.193766+0000", 2024-04-19T03:03:29.099 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6869e-05 2024-04-19T03:03:29.099 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.099 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.099 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:29.099 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.193831+0000", 2024-04-19T03:03:29.099 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5273999999999999e-05 2024-04-19T03:03:29.099 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:29.099 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:29.099 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:29.099 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.099 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.099 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4755.0:158376 5.9 e56/22 5:9e73c076:::benchmark_data_smithi096_19531_object44926:head v 56'9663, mlcod=56'9661)", 2024-04-19T03:03:29.100 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:58.127307+0000", 2024-04-19T03:03:29.100 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 30.860922083999998, 2024-04-19T03:03:29.100 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069002716000000006, 2024-04-19T03:03:29.100 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:29.100 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:29.100 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:29.100 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.100 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:29.100 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.127307+0000", 2024-04-19T03:03:29.100 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:29.100 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.100 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.101 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:29.101 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.127307+0000", 2024-04-19T03:03:29.101 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:29.101 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.101 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.101 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:29.101 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.127306+0000", 2024-04-19T03:03:29.101 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:03:29.101 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.101 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.101 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:29.101 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.127316+0000", 2024-04-19T03:03:29.101 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.3039999999999994e-06 2024-04-19T03:03:29.101 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.101 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.101 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:29.102 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.127326+0000", 2024-04-19T03:03:29.102 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0009e-05 2024-04-19T03:03:29.102 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.102 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.102 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:29.102 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.127332+0000", 2024-04-19T03:03:29.102 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5880000000000003e-06 2024-04-19T03:03:29.102 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.102 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.102 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:29.102 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.127383+0000", 2024-04-19T03:03:29.102 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0516000000000002e-05 2024-04-19T03:03:29.102 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.102 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.102 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:29.103 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.127403+0000", 2024-04-19T03:03:29.103 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0547000000000002e-05 2024-04-19T03:03:29.103 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.103 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.103 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:03:29.103 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.196280+0000", 2024-04-19T03:03:29.103 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.068876863999999996 2024-04-19T03:03:29.103 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.103 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.103 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:29.103 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.196310+0000", 2024-04-19T03:03:29.103 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9762999999999999e-05 2024-04-19T03:03:29.103 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:29.104 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:29.104 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:29.104 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.104 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.104 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:158383 5.0 5:026717eb:::benchmark_data_smithi096_19531_object44933:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-19T03:03:29.104 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:58.130494+0000", 2024-04-19T03:03:29.104 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 30.857734958000002, 2024-04-19T03:03:29.104 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.070135775999999997, 2024-04-19T03:03:29.104 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:29.104 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:29.104 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:29.104 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:29.104 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:29.105 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 158383 2024-04-19T03:03:29.105 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.105 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:29.105 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.105 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:29.105 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.130494+0000", 2024-04-19T03:03:29.105 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:29.105 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.105 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.105 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:29.105 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.130494+0000", 2024-04-19T03:03:29.105 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:29.105 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.106 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.106 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:29.106 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.130493+0000", 2024-04-19T03:03:29.106 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:03:29.106 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.106 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.106 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:29.106 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.130500+0000", 2024-04-19T03:03:29.106 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5490000000000003e-06 2024-04-19T03:03:29.106 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.106 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.106 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:29.107 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.190401+0000", 2024-04-19T03:03:29.107 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.059901668999999998 2024-04-19T03:03:29.107 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.107 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.107 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:29.107 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.190421+0000", 2024-04-19T03:03:29.107 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0288e-05 2024-04-19T03:03:29.107 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.107 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.107 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:29.107 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.190536+0000", 2024-04-19T03:03:29.107 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000114783 2024-04-19T03:03:29.107 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.107 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.108 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:29.108 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.190904+0000", 2024-04-19T03:03:29.108 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00036773900000000001 2024-04-19T03:03:29.108 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.108 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.108 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:29.108 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.200417+0000", 2024-04-19T03:03:29.108 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0095128899999999995 2024-04-19T03:03:29.108 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.108 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.108 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:03:29.108 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.200489+0000", 2024-04-19T03:03:29.108 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2554999999999999e-05 2024-04-19T03:03:29.108 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.108 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.109 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:29.109 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.200630+0000", 2024-04-19T03:03:29.109 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014055299999999999 2024-04-19T03:03:29.109 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:29.109 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:29.109 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:29.109 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:29.109 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:29.109 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-19T03:03:29.110 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T03:03:29.111 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:03:29.108+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:03:29.211 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:03:29.206+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:03:29.229 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-04-19T03:03:29.229 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2024-04-19T03:03:29.229 INFO:teuthology.orchestra.run.smithi144.stdout: "num_ops": 0 2024-04-19T03:03:29.229 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-04-19T03:03:29.239 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T03:03:29.313 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:03:29.310+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:03:29.344 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-04-19T03:03:29.345 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2024-04-19T03:03:29.345 INFO:teuthology.orchestra.run.smithi144.stdout: "complaint_time": 30, 2024-04-19T03:03:29.345 INFO:teuthology.orchestra.run.smithi144.stdout: "num_blocked_ops": 0 2024-04-19T03:03:29.345 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-04-19T03:03:29.354 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T03:03:29.414 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:03:29.414+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:03:29.470 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-04-19T03:03:29.470 INFO:teuthology.orchestra.run.smithi144.stdout: "size": 20, 2024-04-19T03:03:29.470 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 600, 2024-04-19T03:03:29.470 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [ 2024-04-19T03:03:29.470 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.470 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:78992 5.7 5:e6baa862:::benchmark_data_smithi096_19531_object78991:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-19T03:03:29.470 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:18.008888+0000", 2024-04-19T03:03:29.470 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 71.457386326000005, 2024-04-19T03:03:29.470 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.056375285999999997, 2024-04-19T03:03:29.470 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:29.471 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:29.471 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:29.471 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:29.471 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:29.471 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 78992 2024-04-19T03:03:29.471 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.471 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:29.471 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.471 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:29.471 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.008888+0000", 2024-04-19T03:03:29.471 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:29.471 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.472 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.472 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:29.472 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.008888+0000", 2024-04-19T03:03:29.472 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:29.472 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.472 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.472 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:29.472 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.008888+0000", 2024-04-19T03:03:29.472 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:29.472 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.472 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.472 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:29.472 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.008928+0000", 2024-04-19T03:03:29.472 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0361999999999997e-05 2024-04-19T03:03:29.473 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.473 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.473 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:29.473 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.008942+0000", 2024-04-19T03:03:29.473 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4365000000000001e-05 2024-04-19T03:03:29.473 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.473 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.473 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:29.473 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.008949+0000", 2024-04-19T03:03:29.473 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.212e-06 2024-04-19T03:03:29.473 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.473 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.473 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:29.474 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.012683+0000", 2024-04-19T03:03:29.474 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.003733934 2024-04-19T03:03:29.474 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.474 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.474 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:29.474 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.012798+0000", 2024-04-19T03:03:29.474 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00011574999999999999 2024-04-19T03:03:29.474 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.474 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.474 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:29.474 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.012896+0000", 2024-04-19T03:03:29.474 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.7848000000000002e-05 2024-04-19T03:03:29.474 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.474 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.475 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:03:29.475 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016423+0000", 2024-04-19T03:03:29.475 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0035270789999999998 2024-04-19T03:03:29.475 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.475 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.475 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:29.475 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.065098+0000", 2024-04-19T03:03:29.475 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.048674651999999999 2024-04-19T03:03:29.475 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.475 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.475 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:03:29.475 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.065193+0000", 2024-04-19T03:03:29.475 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.5087999999999995e-05 2024-04-19T03:03:29.476 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.476 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.476 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:29.476 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.065264+0000", 2024-04-19T03:03:29.476 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0666000000000004e-05 2024-04-19T03:03:29.476 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:29.476 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:29.476 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:29.476 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.476 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.476 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4755.0:79003 5.2 e40/39 5:4436e33f:::benchmark_data_smithi096_19531_object79002:head v 40'4935, mlcod=40'4932)", 2024-04-19T03:03:29.476 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:18.018102+0000", 2024-04-19T03:03:29.476 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 71.448172270000001, 2024-04-19T03:03:29.476 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.060023990999999999, 2024-04-19T03:03:29.477 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:29.477 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:29.477 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:29.477 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.477 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:29.477 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018102+0000", 2024-04-19T03:03:29.477 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:29.477 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.477 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.477 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:29.477 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018102+0000", 2024-04-19T03:03:29.477 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:29.477 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.478 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.478 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:29.478 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018102+0000", 2024-04-19T03:03:29.478 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:29.478 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.478 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.478 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:29.478 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018134+0000", 2024-04-19T03:03:29.478 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2722000000000003e-05 2024-04-19T03:03:29.478 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.478 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.478 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:29.479 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018145+0000", 2024-04-19T03:03:29.479 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0395e-05 2024-04-19T03:03:29.479 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.479 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.479 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:29.479 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018151+0000", 2024-04-19T03:03:29.479 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5300000000000002e-06 2024-04-19T03:03:29.479 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.479 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.479 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:29.479 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018489+0000", 2024-04-19T03:03:29.479 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00033731499999999998 2024-04-19T03:03:29.479 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.480 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.480 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:29.480 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018508+0000", 2024-04-19T03:03:29.480 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9775e-05 2024-04-19T03:03:29.480 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.480 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.480 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:03:29.480 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.078059+0000", 2024-04-19T03:03:29.480 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.059550171999999998 2024-04-19T03:03:29.480 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.480 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.480 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:29.480 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.078126+0000", 2024-04-19T03:03:29.480 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7773000000000003e-05 2024-04-19T03:03:29.481 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:29.481 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:29.481 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:29.481 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.481 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.481 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:86612 5.7 5:e32e3c49:::benchmark_data_smithi096_19531_object86611:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:29.481 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:22.633560+0000", 2024-04-19T03:03:29.481 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 66.832714609999996, 2024-04-19T03:03:29.481 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.19135289, 2024-04-19T03:03:29.481 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:29.481 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:29.481 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:29.481 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:29.481 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:29.482 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 86612 2024-04-19T03:03:29.482 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.482 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:29.482 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.482 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:29.482 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633560+0000", 2024-04-19T03:03:29.482 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:29.482 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.482 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.482 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:29.482 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633560+0000", 2024-04-19T03:03:29.482 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:29.482 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.483 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.483 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:29.483 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633558+0000", 2024-04-19T03:03:29.483 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999986 2024-04-19T03:03:29.483 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.483 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.483 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:29.483 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633609+0000", 2024-04-19T03:03:29.483 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0850999999999998e-05 2024-04-19T03:03:29.483 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.483 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.483 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:29.483 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633627+0000", 2024-04-19T03:03:29.483 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7951000000000001e-05 2024-04-19T03:03:29.484 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.484 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.484 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:29.484 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633635+0000", 2024-04-19T03:03:29.484 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2530000000000004e-06 2024-04-19T03:03:29.484 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.484 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.484 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:29.484 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633699+0000", 2024-04-19T03:03:29.484 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3901999999999999e-05 2024-04-19T03:03:29.484 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.484 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.484 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:29.485 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633992+0000", 2024-04-19T03:03:29.485 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00029283299999999999 2024-04-19T03:03:29.485 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.485 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.485 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:29.485 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.634223+0000", 2024-04-19T03:03:29.485 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00023084200000000001 2024-04-19T03:03:29.485 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.485 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.485 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:03:29.485 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.639085+0000", 2024-04-19T03:03:29.485 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0048624269999999999 2024-04-19T03:03:29.485 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.485 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.486 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:29.486 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.824635+0000", 2024-04-19T03:03:29.486 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.18554944700000001 2024-04-19T03:03:29.486 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.486 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.486 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:03:29.486 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.824793+0000", 2024-04-19T03:03:29.486 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000157959 2024-04-19T03:03:29.486 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.486 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.486 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:29.486 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.824913+0000", 2024-04-19T03:03:29.487 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000120093 2024-04-19T03:03:29.487 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:29.487 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:29.487 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:29.487 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.487 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.487 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:86625 5.7 5:e6d00488:::benchmark_data_smithi096_19531_object86624:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:29.487 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:22.643554+0000", 2024-04-19T03:03:29.487 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 66.822720844000003, 2024-04-19T03:03:29.487 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.18732841, 2024-04-19T03:03:29.487 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:29.487 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:29.487 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:29.487 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:29.488 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:29.488 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 86625 2024-04-19T03:03:29.488 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.488 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:29.488 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.488 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:29.488 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643554+0000", 2024-04-19T03:03:29.488 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:29.488 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.488 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.488 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:29.488 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643554+0000", 2024-04-19T03:03:29.488 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:29.489 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.489 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.489 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:29.489 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643552+0000", 2024-04-19T03:03:29.489 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999986 2024-04-19T03:03:29.489 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.489 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.489 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:29.489 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643588+0000", 2024-04-19T03:03:29.489 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5855999999999997e-05 2024-04-19T03:03:29.489 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.489 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.489 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:29.489 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643606+0000", 2024-04-19T03:03:29.490 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8226000000000001e-05 2024-04-19T03:03:29.490 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.490 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.490 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:29.490 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643618+0000", 2024-04-19T03:03:29.490 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1868000000000001e-05 2024-04-19T03:03:29.490 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.490 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.490 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:29.490 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643676+0000", 2024-04-19T03:03:29.490 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8153999999999999e-05 2024-04-19T03:03:29.490 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.490 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.490 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:29.491 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643905+0000", 2024-04-19T03:03:29.491 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00022847500000000001 2024-04-19T03:03:29.491 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.491 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.491 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:29.491 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.644150+0000", 2024-04-19T03:03:29.491 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00024531800000000001 2024-04-19T03:03:29.491 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.491 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.491 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:03:29.491 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.647407+0000", 2024-04-19T03:03:29.491 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0032563190000000001 2024-04-19T03:03:29.491 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.492 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.492 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:29.492 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.830721+0000", 2024-04-19T03:03:29.492 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.18331468300000001 2024-04-19T03:03:29.492 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.492 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.492 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:03:29.492 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.830813+0000", 2024-04-19T03:03:29.492 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.2205000000000002e-05 2024-04-19T03:03:29.492 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.492 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.492 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:29.492 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.830882+0000", 2024-04-19T03:03:29.493 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8819999999999995e-05 2024-04-19T03:03:29.493 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:29.493 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:29.493 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:29.493 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.493 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.493 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87063 5.7 5:e502e824:::benchmark_data_smithi096_19531_object87062:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:29.493 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.136067+0000", 2024-04-19T03:03:29.493 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 66.330207974999993, 2024-04-19T03:03:29.493 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.065521159999999995, 2024-04-19T03:03:29.493 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:29.493 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:29.493 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:29.493 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:29.494 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:29.494 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87063 2024-04-19T03:03:29.494 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.494 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:29.494 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.494 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:29.494 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.136067+0000", 2024-04-19T03:03:29.494 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:29.494 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.494 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.494 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:29.494 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.136067+0000", 2024-04-19T03:03:29.494 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:29.495 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.495 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.495 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:29.495 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.136066+0000", 2024-04-19T03:03:29.495 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:03:29.495 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.495 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.495 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:29.495 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.136154+0000", 2024-04-19T03:03:29.495 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.8256000000000003e-05 2024-04-19T03:03:29.495 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.496 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.496 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:29.496 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.136162+0000", 2024-04-19T03:03:29.496 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.5099999999999998e-06 2024-04-19T03:03:29.496 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.496 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.496 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:29.496 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.136171+0000", 2024-04-19T03:03:29.496 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2830000000000001e-06 2024-04-19T03:03:29.496 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.496 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.496 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:29.496 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.138421+0000", 2024-04-19T03:03:29.496 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0022506620000000001 2024-04-19T03:03:29.497 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.497 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.497 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:29.497 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.138560+0000", 2024-04-19T03:03:29.497 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000138446 2024-04-19T03:03:29.497 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.497 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.497 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:29.497 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.138689+0000", 2024-04-19T03:03:29.497 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00012950700000000001 2024-04-19T03:03:29.497 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.497 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.497 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:03:29.497 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.141517+0000", 2024-04-19T03:03:29.498 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0028280860000000001 2024-04-19T03:03:29.498 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.498 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.498 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:29.498 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.201350+0000", 2024-04-19T03:03:29.498 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.059832418999999998 2024-04-19T03:03:29.498 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.498 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.498 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:03:29.498 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.201485+0000", 2024-04-19T03:03:29.498 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000135597 2024-04-19T03:03:29.498 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.498 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.499 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:29.499 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.201588+0000", 2024-04-19T03:03:29.499 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00010247900000000001 2024-04-19T03:03:29.499 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:29.499 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:29.499 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:29.499 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.499 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.499 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87072 5.7 5:e3c7809a:::benchmark_data_smithi096_19531_object87071:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:29.499 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.144224+0000", 2024-04-19T03:03:29.499 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 66.322050950999994, 2024-04-19T03:03:29.499 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.058179555000000001, 2024-04-19T03:03:29.499 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:29.499 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:29.500 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:29.500 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:29.500 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:29.500 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87072 2024-04-19T03:03:29.500 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.500 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:29.500 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.500 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:29.500 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144224+0000", 2024-04-19T03:03:29.500 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:29.500 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.500 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.500 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:29.501 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144224+0000", 2024-04-19T03:03:29.501 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:29.501 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.501 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.501 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:29.501 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144223+0000", 2024-04-19T03:03:29.501 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:03:29.501 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.501 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.501 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:29.501 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144320+0000", 2024-04-19T03:03:29.501 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.7075000000000001e-05 2024-04-19T03:03:29.501 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.501 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.502 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:29.502 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144331+0000", 2024-04-19T03:03:29.502 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1342000000000001e-05 2024-04-19T03:03:29.502 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.502 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.502 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:29.502 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144337+0000", 2024-04-19T03:03:29.502 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8390000000000003e-06 2024-04-19T03:03:29.502 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.502 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.502 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:29.502 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144369+0000", 2024-04-19T03:03:29.502 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2079000000000002e-05 2024-04-19T03:03:29.503 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.503 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.503 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:29.503 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144464+0000", 2024-04-19T03:03:29.503 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.4623000000000005e-05 2024-04-19T03:03:29.503 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.503 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.503 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:29.503 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144553+0000", 2024-04-19T03:03:29.503 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9171000000000004e-05 2024-04-19T03:03:29.503 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.503 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.503 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:03:29.504 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.147018+0000", 2024-04-19T03:03:29.504 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0024648370000000001 2024-04-19T03:03:29.504 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.504 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.504 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:29.504 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.202270+0000", 2024-04-19T03:03:29.504 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.055252018 2024-04-19T03:03:29.504 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.504 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.504 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:03:29.504 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.202356+0000", 2024-04-19T03:03:29.504 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6648000000000001e-05 2024-04-19T03:03:29.504 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.504 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.505 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:29.505 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.202403+0000", 2024-04-19T03:03:29.505 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6956999999999998e-05 2024-04-19T03:03:29.505 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:29.505 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:29.505 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:29.505 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.505 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.505 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87123 5.6 5:6d1bc3b9:::benchmark_data_smithi096_19531_object87122:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:03:29.505 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249233+0000", 2024-04-19T03:03:29.505 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 66.217041918999996, 2024-04-19T03:03:29.505 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0291700720000001, 2024-04-19T03:03:29.505 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:29.505 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-04-19T03:03:29.506 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:29.506 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:29.506 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:29.506 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87123 2024-04-19T03:03:29.506 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.506 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:29.506 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.506 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:29.506 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249233+0000", 2024-04-19T03:03:29.506 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:29.506 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.506 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.506 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:29.506 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249233+0000", 2024-04-19T03:03:29.507 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:29.507 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.507 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.507 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:29.507 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249231+0000", 2024-04-19T03:03:29.507 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999986 2024-04-19T03:03:29.507 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.507 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.507 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:29.507 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249285+0000", 2024-04-19T03:03:29.507 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4005000000000002e-05 2024-04-19T03:03:29.507 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.507 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.507 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:29.508 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249300+0000", 2024-04-19T03:03:29.508 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4715999999999999e-05 2024-04-19T03:03:29.508 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.508 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.508 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:29.508 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249307+0000", 2024-04-19T03:03:29.508 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8399999999999997e-06 2024-04-19T03:03:29.508 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.508 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.508 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:29.508 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249366+0000", 2024-04-19T03:03:29.508 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9435999999999998e-05 2024-04-19T03:03:29.508 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.508 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.509 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op must wait for map", 2024-04-19T03:03:29.509 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249376+0000", 2024-04-19T03:03:29.509 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.4919999999999999e-06 2024-04-19T03:03:29.509 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.509 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.509 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:29.509 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263757+0000", 2024-04-19T03:03:29.509 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.014381461999999999 2024-04-19T03:03:29.509 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.509 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.509 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:03:29.509 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263875+0000", 2024-04-19T03:03:29.510 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000117166 2024-04-19T03:03:29.510 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.510 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.510 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:29.510 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.277136+0000", 2024-04-19T03:03:29.510 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.013261207 2024-04-19T03:03:29.510 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.510 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.510 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:29.510 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.278403+0000", 2024-04-19T03:03:29.510 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001267106 2024-04-19T03:03:29.510 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:29.510 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:29.511 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:29.511 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.511 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.511 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87128 5.6 5:6905c420:::benchmark_data_smithi096_19531_object87127:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:03:29.511 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249323+0000", 2024-04-19T03:03:29.511 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 66.216951171999995, 2024-04-19T03:03:29.511 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0292813249999999, 2024-04-19T03:03:29.511 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:29.511 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-04-19T03:03:29.511 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:29.511 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:29.511 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:29.511 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87128 2024-04-19T03:03:29.511 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.512 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:29.512 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.512 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:29.512 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249323+0000", 2024-04-19T03:03:29.512 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:29.512 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.512 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.512 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:29.512 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249323+0000", 2024-04-19T03:03:29.512 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:29.512 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.512 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.512 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:29.513 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249323+0000", 2024-04-19T03:03:29.513 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:29.513 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.513 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.513 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:29.513 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249385+0000", 2024-04-19T03:03:29.513 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1711999999999995e-05 2024-04-19T03:03:29.513 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.513 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.513 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:29.513 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249398+0000", 2024-04-19T03:03:29.513 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3022e-05 2024-04-19T03:03:29.513 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.513 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.514 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:29.514 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249402+0000", 2024-04-19T03:03:29.514 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4819999999999996e-06 2024-04-19T03:03:29.514 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.514 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.514 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:29.514 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249437+0000", 2024-04-19T03:03:29.514 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4702000000000001e-05 2024-04-19T03:03:29.514 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.514 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.514 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:03:29.514 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249442+0000", 2024-04-19T03:03:29.515 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8019999999999999e-06 2024-04-19T03:03:29.515 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.515 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.515 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:29.515 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263896+0000", 2024-04-19T03:03:29.515 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.014454679999999999 2024-04-19T03:03:29.515 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.515 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.515 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:03:29.515 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263900+0000", 2024-04-19T03:03:29.515 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9700000000000001e-06 2024-04-19T03:03:29.515 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.515 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.515 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:29.516 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.278557+0000", 2024-04-19T03:03:29.516 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0146566480000001 2024-04-19T03:03:29.516 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.516 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.516 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:29.516 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.278605+0000", 2024-04-19T03:03:29.516 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7735999999999998e-05 2024-04-19T03:03:29.516 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:29.516 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:29.516 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:29.516 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.516 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.516 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87130 5.3 5:c8c2d67b:::benchmark_data_smithi096_19531_object87129:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:03:29.516 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249418+0000", 2024-04-19T03:03:29.517 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 66.216856461000006, 2024-04-19T03:03:29.517 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.025414182, 2024-04-19T03:03:29.517 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:29.517 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-04-19T03:03:29.517 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:29.517 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:29.517 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:29.517 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87130 2024-04-19T03:03:29.517 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.517 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:29.517 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.517 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:29.517 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249418+0000", 2024-04-19T03:03:29.518 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:29.518 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.518 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.518 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:29.518 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249418+0000", 2024-04-19T03:03:29.518 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:29.518 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.518 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.518 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:29.518 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249409+0000", 2024-04-19T03:03:29.518 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999905 2024-04-19T03:03:29.518 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.518 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.518 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:29.519 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249464+0000", 2024-04-19T03:03:29.519 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5381999999999999e-05 2024-04-19T03:03:29.519 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.519 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.519 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:29.519 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249471+0000", 2024-04-19T03:03:29.519 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2609999999999996e-06 2024-04-19T03:03:29.519 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.519 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.519 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:29.519 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249475+0000", 2024-04-19T03:03:29.519 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2839999999999998e-06 2024-04-19T03:03:29.519 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.520 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.520 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:29.520 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249535+0000", 2024-04-19T03:03:29.520 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0545999999999999e-05 2024-04-19T03:03:29.520 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.520 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.520 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op must wait for map", 2024-04-19T03:03:29.520 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249540+0000", 2024-04-19T03:03:29.520 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2859999999999999e-06 2024-04-19T03:03:29.520 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.520 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.520 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:29.520 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263450+0000", 2024-04-19T03:03:29.520 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.013909585 2024-04-19T03:03:29.520 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.521 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.521 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:03:29.521 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263458+0000", 2024-04-19T03:03:29.521 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8089999999999993e-06 2024-04-19T03:03:29.521 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.521 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.521 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:29.521 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.273193+0000", 2024-04-19T03:03:29.521 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0097351379999999 2024-04-19T03:03:29.521 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.521 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.521 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:29.521 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.274832+0000", 2024-04-19T03:03:29.521 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0016394789999999999 2024-04-19T03:03:29.522 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:29.522 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:29.522 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:29.522 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.522 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.522 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87131 5.1 5:83756d55:::benchmark_data_smithi096_19531_object87130:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:03:29.522 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249491+0000", 2024-04-19T03:03:29.522 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 66.216783813999996, 2024-04-19T03:03:29.522 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0191489520000001, 2024-04-19T03:03:29.522 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:29.522 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-04-19T03:03:29.522 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:29.522 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:29.523 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:29.523 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87131 2024-04-19T03:03:29.523 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.523 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:29.523 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.523 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:29.523 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249491+0000", 2024-04-19T03:03:29.523 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:29.523 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.523 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.523 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:29.523 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249491+0000", 2024-04-19T03:03:29.523 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:29.523 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.523 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.524 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:29.524 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249491+0000", 2024-04-19T03:03:29.524 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:29.524 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.524 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.524 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:29.524 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249530+0000", 2024-04-19T03:03:29.524 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9589000000000003e-05 2024-04-19T03:03:29.524 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.524 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.524 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:29.524 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249544+0000", 2024-04-19T03:03:29.524 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4158000000000001e-05 2024-04-19T03:03:29.525 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.525 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.525 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:29.525 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249549+0000", 2024-04-19T03:03:29.525 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6809999999999997e-06 2024-04-19T03:03:29.525 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.525 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.525 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:29.525 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249592+0000", 2024-04-19T03:03:29.525 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3285999999999999e-05 2024-04-19T03:03:29.525 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.525 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.525 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op must wait for map", 2024-04-19T03:03:29.525 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249598+0000", 2024-04-19T03:03:29.526 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8329999999999999e-06 2024-04-19T03:03:29.526 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.526 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.526 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:29.526 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263331+0000", 2024-04-19T03:03:29.526 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.013733093 2024-04-19T03:03:29.526 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.526 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.526 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:03:29.526 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263343+0000", 2024-04-19T03:03:29.526 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.189e-05 2024-04-19T03:03:29.526 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.527 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.527 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:29.527 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.268541+0000", 2024-04-19T03:03:29.527 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0051983440000001 2024-04-19T03:03:29.527 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.527 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.527 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:29.527 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.268640+0000", 2024-04-19T03:03:29.527 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.8387999999999994e-05 2024-04-19T03:03:29.527 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:29.527 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:29.527 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:29.527 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.527 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.528 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87132 5.c 5:3e18b732:::benchmark_data_smithi096_19531_object87131:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:03:29.528 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249558+0000", 2024-04-19T03:03:29.528 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 66.216716912999999, 2024-04-19T03:03:29.528 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0241198380000001, 2024-04-19T03:03:29.528 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:29.528 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-04-19T03:03:29.528 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:29.528 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:29.528 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:29.528 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87132 2024-04-19T03:03:29.528 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.528 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:29.528 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.529 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:29.529 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249558+0000", 2024-04-19T03:03:29.529 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:29.529 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.529 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.529 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:29.529 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249558+0000", 2024-04-19T03:03:29.529 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:29.529 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.529 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.529 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:29.529 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249557+0000", 2024-04-19T03:03:29.529 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:29.529 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.530 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.530 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:29.530 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249625+0000", 2024-04-19T03:03:29.530 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7200999999999996e-05 2024-04-19T03:03:29.530 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.530 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.530 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:29.530 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249646+0000", 2024-04-19T03:03:29.530 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1053e-05 2024-04-19T03:03:29.530 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.530 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.530 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:29.530 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249650+0000", 2024-04-19T03:03:29.530 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2719999999999999e-06 2024-04-19T03:03:29.531 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.531 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.531 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:29.531 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249686+0000", 2024-04-19T03:03:29.531 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6430000000000002e-05 2024-04-19T03:03:29.531 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.531 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.531 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op must wait for map", 2024-04-19T03:03:29.531 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249690+0000", 2024-04-19T03:03:29.531 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.765e-06 2024-04-19T03:03:29.531 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.531 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.531 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:29.531 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261157+0000", 2024-04-19T03:03:29.532 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011467247999999999 2024-04-19T03:03:29.532 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.532 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.532 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:03:29.532 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261170+0000", 2024-04-19T03:03:29.532 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2833000000000001e-05 2024-04-19T03:03:29.532 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.532 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.532 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:29.532 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.272119+0000", 2024-04-19T03:03:29.532 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.010949313 2024-04-19T03:03:29.532 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.532 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.532 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:29.532 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.273678+0000", 2024-04-19T03:03:29.533 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0015581550000000001 2024-04-19T03:03:29.533 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:29.533 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:29.533 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:29.533 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.533 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.533 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87133 5.c 5:3f772a62:::benchmark_data_smithi096_19531_object87132:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:03:29.533 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249657+0000", 2024-04-19T03:03:29.533 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 66.216617533999994, 2024-04-19T03:03:29.533 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0242819409999999, 2024-04-19T03:03:29.533 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:29.533 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-04-19T03:03:29.533 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:29.534 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:29.534 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:29.534 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87133 2024-04-19T03:03:29.534 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.534 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:29.534 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.534 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:29.534 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249657+0000", 2024-04-19T03:03:29.534 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:29.534 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.534 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.534 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:29.534 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249657+0000", 2024-04-19T03:03:29.535 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:29.535 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.535 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.535 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:29.535 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249657+0000", 2024-04-19T03:03:29.535 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:29.535 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.535 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.535 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:29.535 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249690+0000", 2024-04-19T03:03:29.535 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3343000000000002e-05 2024-04-19T03:03:29.535 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.535 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.536 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:29.536 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249695+0000", 2024-04-19T03:03:29.536 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8600000000000001e-06 2024-04-19T03:03:29.536 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.536 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.536 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:29.536 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249698+0000", 2024-04-19T03:03:29.536 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.1700000000000001e-06 2024-04-19T03:03:29.536 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.536 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.536 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:29.536 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249741+0000", 2024-04-19T03:03:29.536 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2849999999999998e-05 2024-04-19T03:03:29.536 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.537 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.537 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:03:29.537 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249746+0000", 2024-04-19T03:03:29.537 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1019999999999996e-06 2024-04-19T03:03:29.537 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.537 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.537 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:29.537 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261209+0000", 2024-04-19T03:03:29.537 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011462447000000001 2024-04-19T03:03:29.537 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.537 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.537 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:03:29.537 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261216+0000", 2024-04-19T03:03:29.538 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8520000000000004e-06 2024-04-19T03:03:29.538 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.538 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.538 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:29.538 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.273872+0000", 2024-04-19T03:03:29.538 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0126558000000001 2024-04-19T03:03:29.538 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.538 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.538 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:29.538 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.273939+0000", 2024-04-19T03:03:29.538 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6822000000000005e-05 2024-04-19T03:03:29.538 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:29.538 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:29.539 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:29.539 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.539 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.539 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87134 5.5 5:a56c478f:::benchmark_data_smithi096_19531_object87133:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:03:29.539 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249708+0000", 2024-04-19T03:03:29.539 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 66.216566610000001, 2024-04-19T03:03:29.539 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0214677299999999, 2024-04-19T03:03:29.539 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:29.539 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-04-19T03:03:29.539 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:29.539 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:29.539 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:29.539 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87134 2024-04-19T03:03:29.539 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.540 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:29.540 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.540 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:29.540 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249708+0000", 2024-04-19T03:03:29.540 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:29.540 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.540 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.540 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:29.540 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249708+0000", 2024-04-19T03:03:29.540 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:29.540 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.540 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.540 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:29.541 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249706+0000", 2024-04-19T03:03:29.541 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999976 2024-04-19T03:03:29.541 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.541 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.541 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:29.541 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249740+0000", 2024-04-19T03:03:29.541 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4458000000000001e-05 2024-04-19T03:03:29.541 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.541 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.541 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:29.541 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249745+0000", 2024-04-19T03:03:29.541 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5020000000000003e-06 2024-04-19T03:03:29.541 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.541 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.542 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:29.542 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249748+0000", 2024-04-19T03:03:29.542 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2499999999999998e-06 2024-04-19T03:03:29.542 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.542 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.542 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:29.542 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249778+0000", 2024-04-19T03:03:29.542 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.006e-05 2024-04-19T03:03:29.542 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.542 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.542 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op must wait for map", 2024-04-19T03:03:29.542 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249782+0000", 2024-04-19T03:03:29.543 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2910000000000001e-06 2024-04-19T03:03:29.543 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.543 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.543 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:29.543 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261666+0000", 2024-04-19T03:03:29.543 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011883471 2024-04-19T03:03:29.543 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.543 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.543 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:03:29.543 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261674+0000", 2024-04-19T03:03:29.543 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6479999999999992e-06 2024-04-19T03:03:29.543 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.543 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.543 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:29.544 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.269323+0000", 2024-04-19T03:03:29.544 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.00764867 2024-04-19T03:03:29.544 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.544 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.544 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:29.544 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.271176+0000", 2024-04-19T03:03:29.544 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001852844 2024-04-19T03:03:29.544 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:29.544 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:29.544 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:29.544 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.544 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.544 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87137 5.c 5:30708c68:::benchmark_data_smithi096_19531_object87136:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:03:29.545 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249756+0000", 2024-04-19T03:03:29.545 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 66.216518903999997, 2024-04-19T03:03:29.545 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.033331752, 2024-04-19T03:03:29.545 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:29.545 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:29.545 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:29.545 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:29.545 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:29.545 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87137 2024-04-19T03:03:29.545 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.545 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:29.545 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.545 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:29.546 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249756+0000", 2024-04-19T03:03:29.546 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:29.546 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.546 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.546 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:29.546 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249756+0000", 2024-04-19T03:03:29.546 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:29.546 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.546 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.546 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:29.546 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249755+0000", 2024-04-19T03:03:29.546 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:29.546 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.547 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.547 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:29.547 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249777+0000", 2024-04-19T03:03:29.547 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1420000000000002e-05 2024-04-19T03:03:29.547 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.547 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.547 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:29.547 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249781+0000", 2024-04-19T03:03:29.547 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0609999999999997e-06 2024-04-19T03:03:29.547 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.547 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.547 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:29.547 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249787+0000", 2024-04-19T03:03:29.548 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.02e-06 2024-04-19T03:03:29.548 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.548 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.548 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:29.548 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249818+0000", 2024-04-19T03:03:29.548 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0947e-05 2024-04-19T03:03:29.548 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.548 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.548 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:03:29.548 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249821+0000", 2024-04-19T03:03:29.548 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.117e-06 2024-04-19T03:03:29.548 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.549 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.549 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:29.549 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261243+0000", 2024-04-19T03:03:29.549 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011421875999999999 2024-04-19T03:03:29.549 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.549 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.549 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:03:29.549 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261251+0000", 2024-04-19T03:03:29.549 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6120000000000001e-06 2024-04-19T03:03:29.549 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.549 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.549 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:29.549 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.274050+0000", 2024-04-19T03:03:29.549 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.012799405 2024-04-19T03:03:29.550 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.550 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.550 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:29.550 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.274529+0000", 2024-04-19T03:03:29.550 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00047867100000000001 2024-04-19T03:03:29.550 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.550 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.550 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:03:29.550 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.282972+0000", 2024-04-19T03:03:29.550 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0084436900000000002 2024-04-19T03:03:29.550 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.550 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.550 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:03:29.551 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.283022+0000", 2024-04-19T03:03:29.551 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9339000000000003e-05 2024-04-19T03:03:29.551 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.551 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.551 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:29.551 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.283088+0000", 2024-04-19T03:03:29.551 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5877999999999995e-05 2024-04-19T03:03:29.551 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:29.551 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:29.551 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:29.551 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.551 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.551 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:158376 5.9 5:9e73c076:::benchmark_data_smithi096_19531_object44926:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-19T03:03:29.551 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:58.126227+0000", 2024-04-19T03:03:29.551 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 31.340047170999998, 2024-04-19T03:03:29.552 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.069738668000000004, 2024-04-19T03:03:29.552 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:29.552 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:29.552 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:29.552 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:29.552 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:29.552 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 158376 2024-04-19T03:03:29.552 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.552 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:29.552 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.552 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:29.552 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.126227+0000", 2024-04-19T03:03:29.552 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:29.552 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.552 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.553 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:29.553 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.126227+0000", 2024-04-19T03:03:29.553 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:29.553 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.553 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.553 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:29.553 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.126226+0000", 2024-04-19T03:03:29.553 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:03:29.553 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.553 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.553 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:29.553 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.126236+0000", 2024-04-19T03:03:29.553 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.4199999999999996e-06 2024-04-19T03:03:29.554 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.554 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.554 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:29.554 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.126243+0000", 2024-04-19T03:03:29.554 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.199e-06 2024-04-19T03:03:29.554 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.554 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.554 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:29.554 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.126248+0000", 2024-04-19T03:03:29.554 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1320000000000002e-06 2024-04-19T03:03:29.554 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.554 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.554 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:29.555 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.126286+0000", 2024-04-19T03:03:29.555 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7401000000000003e-05 2024-04-19T03:03:29.555 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.555 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.555 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:29.555 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.126368+0000", 2024-04-19T03:03:29.555 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2113999999999993e-05 2024-04-19T03:03:29.555 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.555 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.555 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:03:29.555 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.126438+0000", 2024-04-19T03:03:29.555 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0337000000000001e-05 2024-04-19T03:03:29.555 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.556 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.556 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:03:29.556 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.130816+0000", 2024-04-19T03:03:29.556 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0043778330000000002 2024-04-19T03:03:29.556 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.556 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.556 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:29.556 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.195830+0000", 2024-04-19T03:03:29.556 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.065013933999999995 2024-04-19T03:03:29.556 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.556 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.556 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:03:29.556 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.195907+0000", 2024-04-19T03:03:29.556 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7397000000000005e-05 2024-04-19T03:03:29.557 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.557 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.557 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:29.557 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.195966+0000", 2024-04-19T03:03:29.557 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8906999999999997e-05 2024-04-19T03:03:29.557 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:29.557 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:29.557 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:29.557 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.557 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.557 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:158381 5.9 5:94dcd4a7:::benchmark_data_smithi096_19531_object44931:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-19T03:03:29.557 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:58.128712+0000", 2024-04-19T03:03:29.557 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 31.337562728000002, 2024-04-19T03:03:29.558 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.067497527000000002, 2024-04-19T03:03:29.558 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:29.558 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:29.558 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:29.558 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:29.558 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:29.558 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 158381 2024-04-19T03:03:29.558 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.558 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:29.558 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.558 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:29.558 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.128712+0000", 2024-04-19T03:03:29.558 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:29.559 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.559 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.559 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:29.559 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.128712+0000", 2024-04-19T03:03:29.559 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:29.559 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.559 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.559 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:29.559 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.128711+0000", 2024-04-19T03:03:29.559 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:03:29.559 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.559 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.559 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:29.559 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.128716+0000", 2024-04-19T03:03:29.560 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0610000000000003e-06 2024-04-19T03:03:29.560 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.560 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.560 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:29.560 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.128724+0000", 2024-04-19T03:03:29.560 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0120000000000005e-06 2024-04-19T03:03:29.560 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.560 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.560 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:29.560 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.128729+0000", 2024-04-19T03:03:29.560 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8899999999999998e-06 2024-04-19T03:03:29.560 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.560 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.561 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:29.561 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.128778+0000", 2024-04-19T03:03:29.561 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9110000000000002e-05 2024-04-19T03:03:29.561 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.561 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.561 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:29.561 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.128903+0000", 2024-04-19T03:03:29.561 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00012506799999999999 2024-04-19T03:03:29.561 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.561 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.561 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:03:29.561 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.129022+0000", 2024-04-19T03:03:29.561 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00011923599999999999 2024-04-19T03:03:29.561 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.561 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.562 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:03:29.562 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.132294+0000", 2024-04-19T03:03:29.562 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.003271244 2024-04-19T03:03:29.562 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.562 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.562 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:29.562 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.196045+0000", 2024-04-19T03:03:29.562 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.063751206000000005 2024-04-19T03:03:29.562 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.562 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.562 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:03:29.562 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.196133+0000", 2024-04-19T03:03:29.562 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.8213000000000004e-05 2024-04-19T03:03:29.562 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.562 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.563 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:29.563 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.196209+0000", 2024-04-19T03:03:29.563 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6335999999999996e-05 2024-04-19T03:03:29.563 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:29.563 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:29.563 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:29.563 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.563 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.563 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:158385 5.9 5:950ec749:::benchmark_data_smithi096_19531_object44935:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-19T03:03:29.563 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:58.129756+0000", 2024-04-19T03:03:29.563 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 31.336518796, 2024-04-19T03:03:29.563 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.068998382999999996, 2024-04-19T03:03:29.563 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:29.563 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:29.563 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:29.564 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:29.564 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:29.564 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 158385 2024-04-19T03:03:29.564 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.564 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:29.564 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.564 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:29.564 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.129756+0000", 2024-04-19T03:03:29.564 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:29.564 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.564 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.564 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:29.564 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.129756+0000", 2024-04-19T03:03:29.564 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:29.564 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.565 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.565 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:29.565 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.129755+0000", 2024-04-19T03:03:29.565 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:03:29.565 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.565 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.565 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:29.565 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.129760+0000", 2024-04-19T03:03:29.565 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6030000000000004e-06 2024-04-19T03:03:29.565 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.565 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.565 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:29.565 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.129774+0000", 2024-04-19T03:03:29.565 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3131e-05 2024-04-19T03:03:29.566 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.566 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.566 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:29.566 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.129781+0000", 2024-04-19T03:03:29.566 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4030000000000001e-06 2024-04-19T03:03:29.566 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.566 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.566 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:29.566 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.130837+0000", 2024-04-19T03:03:29.566 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00105569 2024-04-19T03:03:29.566 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.566 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.566 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:29.566 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.130917+0000", 2024-04-19T03:03:29.567 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9929e-05 2024-04-19T03:03:29.567 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.567 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.567 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:03:29.567 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.130973+0000", 2024-04-19T03:03:29.567 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.664e-05 2024-04-19T03:03:29.567 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.567 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.567 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:03:29.567 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.132340+0000", 2024-04-19T03:03:29.567 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001366321 2024-04-19T03:03:29.567 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.567 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.567 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:29.568 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.198637+0000", 2024-04-19T03:03:29.568 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.066296888999999998 2024-04-19T03:03:29.568 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.568 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.568 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:03:29.568 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.198704+0000", 2024-04-19T03:03:29.568 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7333000000000001e-05 2024-04-19T03:03:29.568 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.568 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.568 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:29.568 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.198754+0000", 2024-04-19T03:03:29.568 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0421999999999999e-05 2024-04-19T03:03:29.568 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:29.568 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:29.569 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:29.569 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.569 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.569 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:158387 5.9 5:9e96f619:::benchmark_data_smithi096_19531_object44937:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-19T03:03:29.569 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:58.132457+0000", 2024-04-19T03:03:29.569 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 31.333817232000001, 2024-04-19T03:03:29.569 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.066858091999999994, 2024-04-19T03:03:29.569 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:29.569 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:29.569 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:29.569 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:29.569 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:29.569 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 158387 2024-04-19T03:03:29.570 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.570 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:29.570 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.570 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:29.570 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.132457+0000", 2024-04-19T03:03:29.570 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:29.570 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.570 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.570 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:29.570 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.132457+0000", 2024-04-19T03:03:29.570 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:29.570 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.570 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.571 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:29.571 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.132457+0000", 2024-04-19T03:03:29.571 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:29.571 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.571 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.571 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:29.571 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.132460+0000", 2024-04-19T03:03:29.571 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.1949999999999999e-06 2024-04-19T03:03:29.571 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.571 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.571 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:29.571 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.132468+0000", 2024-04-19T03:03:29.571 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.1599999999999998e-06 2024-04-19T03:03:29.572 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.572 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.572 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:29.572 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.132473+0000", 2024-04-19T03:03:29.572 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9259999999999999e-06 2024-04-19T03:03:29.572 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.572 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.572 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:29.572 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.132504+0000", 2024-04-19T03:03:29.572 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0914000000000003e-05 2024-04-19T03:03:29.572 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.572 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.572 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:29.572 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.132646+0000", 2024-04-19T03:03:29.572 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00014214300000000001 2024-04-19T03:03:29.573 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.573 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.573 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:03:29.573 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.132741+0000", 2024-04-19T03:03:29.573 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.4344000000000003e-05 2024-04-19T03:03:29.573 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.573 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.573 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:03:29.573 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.135774+0000", 2024-04-19T03:03:29.573 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0030334960000000001 2024-04-19T03:03:29.573 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.573 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.573 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:29.573 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.199240+0000", 2024-04-19T03:03:29.573 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.063465695000000003 2024-04-19T03:03:29.574 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.574 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.574 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:03:29.574 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.199272+0000", 2024-04-19T03:03:29.574 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2412000000000001e-05 2024-04-19T03:03:29.574 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.574 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.574 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:29.574 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.199316+0000", 2024-04-19T03:03:29.574 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3275000000000002e-05 2024-04-19T03:03:29.574 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:29.574 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:29.575 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:29.575 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.575 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.575 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:158392 5.f 5:f462725f:::benchmark_data_smithi096_19531_object44942:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-19T03:03:29.575 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:58.135703+0000", 2024-04-19T03:03:29.575 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 31.330571452000001, 2024-04-19T03:03:29.575 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.063132879000000003, 2024-04-19T03:03:29.575 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:29.575 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:29.575 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:29.575 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:29.575 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:29.575 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 158392 2024-04-19T03:03:29.576 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.576 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:29.576 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.576 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:29.576 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.135703+0000", 2024-04-19T03:03:29.576 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:29.576 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.576 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.576 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:29.576 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.135703+0000", 2024-04-19T03:03:29.576 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:29.576 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.576 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.576 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:29.576 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.135702+0000", 2024-04-19T03:03:29.577 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:03:29.577 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.577 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.577 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:29.577 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.135708+0000", 2024-04-19T03:03:29.577 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8270000000000003e-06 2024-04-19T03:03:29.577 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.577 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.577 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:29.577 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.135720+0000", 2024-04-19T03:03:29.577 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2057e-05 2024-04-19T03:03:29.577 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.577 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.577 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:29.577 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.135727+0000", 2024-04-19T03:03:29.578 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8090000000000004e-06 2024-04-19T03:03:29.578 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.578 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.578 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:29.578 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.135768+0000", 2024-04-19T03:03:29.578 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1548999999999998e-05 2024-04-19T03:03:29.578 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.578 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.578 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:29.578 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.135853+0000", 2024-04-19T03:03:29.578 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4845000000000005e-05 2024-04-19T03:03:29.578 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.578 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.578 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:03:29.579 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.135934+0000", 2024-04-19T03:03:29.579 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0315000000000006e-05 2024-04-19T03:03:29.579 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.579 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.579 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:03:29.579 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.138685+0000", 2024-04-19T03:03:29.579 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.002751042 2024-04-19T03:03:29.579 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.579 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.579 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:29.579 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.198747+0000", 2024-04-19T03:03:29.579 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.060062675000000003 2024-04-19T03:03:29.579 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.579 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.579 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:03:29.580 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.198802+0000", 2024-04-19T03:03:29.580 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4469000000000003e-05 2024-04-19T03:03:29.580 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.580 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.580 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:29.580 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.198836+0000", 2024-04-19T03:03:29.580 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4272e-05 2024-04-19T03:03:29.580 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:29.580 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:29.580 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:29.580 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.580 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.580 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:158397 5.d 5:b5d962e9:::benchmark_data_smithi096_19531_object44947:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-19T03:03:29.580 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:58.138717+0000", 2024-04-19T03:03:29.581 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 31.327557509000002, 2024-04-19T03:03:29.581 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.057191467000000003, 2024-04-19T03:03:29.581 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:29.581 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:29.581 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:29.581 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:29.581 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:29.581 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 158397 2024-04-19T03:03:29.581 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.581 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:29.581 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.581 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:29.581 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.138717+0000", 2024-04-19T03:03:29.581 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:29.582 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.582 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.582 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:29.582 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.138717+0000", 2024-04-19T03:03:29.582 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:29.582 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.582 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.582 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:29.582 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.138716+0000", 2024-04-19T03:03:29.582 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999986 2024-04-19T03:03:29.582 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.582 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.582 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:29.583 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.138722+0000", 2024-04-19T03:03:29.583 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1709999999999999e-06 2024-04-19T03:03:29.583 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.583 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.583 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:29.583 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.138731+0000", 2024-04-19T03:03:29.583 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.0310000000000004e-06 2024-04-19T03:03:29.583 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.583 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.583 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:29.583 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.138738+0000", 2024-04-19T03:03:29.583 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8430000000000004e-06 2024-04-19T03:03:29.583 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.583 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.583 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:29.584 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.138789+0000", 2024-04-19T03:03:29.584 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0623e-05 2024-04-19T03:03:29.584 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.584 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.584 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:29.584 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.138945+0000", 2024-04-19T03:03:29.584 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00015671899999999999 2024-04-19T03:03:29.584 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.584 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.584 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:03:29.584 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.139079+0000", 2024-04-19T03:03:29.584 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00013380099999999999 2024-04-19T03:03:29.584 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.584 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.585 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:03:29.585 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.141715+0000", 2024-04-19T03:03:29.585 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0026362849999999999 2024-04-19T03:03:29.585 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.585 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.585 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:29.585 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.195784+0000", 2024-04-19T03:03:29.585 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.054068353 2024-04-19T03:03:29.585 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.585 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.585 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:03:29.585 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.195852+0000", 2024-04-19T03:03:29.585 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8121999999999996e-05 2024-04-19T03:03:29.585 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:29.586 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:29.586 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:29.586 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.195909+0000", 2024-04-19T03:03:29.586 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6737999999999998e-05 2024-04-19T03:03:29.586 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:29.586 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:29.586 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:29.586 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:29.586 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:29.586 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-04-19T03:03:29.588 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:03:29.584+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:03:29.588 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T03:03:29.689 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:03:29.688+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:03:29.706 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-19T03:03:29.706 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-04-19T03:03:29.706 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 0 2024-04-19T03:03:29.706 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-19T03:03:29.716 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T03:03:29.728 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-19T03:03:29.790 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:03:29.786+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:03:29.805 INFO:tasks.ceph.ceph_manager.ceph:removing pool_name unique_pool_0 2024-04-19T03:03:29.805 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm unique_pool_0 unique_pool_0 --yes-i-really-really-mean-it 2024-04-19T03:03:29.823 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-19T03:03:29.823 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2024-04-19T03:03:29.823 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2024-04-19T03:03:29.823 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2024-04-19T03:03:29.823 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-19T03:03:29.832 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T03:03:29.891 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:03:29.886+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:03:29.944 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-04-19T03:03:29.944 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2024-04-19T03:03:29.944 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2024-04-19T03:03:29.944 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2024-04-19T03:03:29.944 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.944 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:86615 5.e 5:7fef7288:::benchmark_data_smithi096_19531_object86614:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:29.944 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:22.634544+0000", 2024-04-19T03:03:29.944 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 67.306104691000002, 2024-04-19T03:03:29.944 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.192475071, 2024-04-19T03:03:29.944 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:29.944 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:29.944 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:29.945 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:29.945 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:29.945 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 86615 2024-04-19T03:03:29.945 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.945 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:29.945 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.945 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:29.945 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634544+0000", 2024-04-19T03:03:29.945 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:29.945 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.945 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.945 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:29.945 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634544+0000", 2024-04-19T03:03:29.945 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:29.946 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.946 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.946 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:29.946 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634542+0000", 2024-04-19T03:03:29.946 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999981 2024-04-19T03:03:29.946 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.946 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.946 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:29.946 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634585+0000", 2024-04-19T03:03:29.946 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2299000000000003e-05 2024-04-19T03:03:29.946 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.946 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.946 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:29.946 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634592+0000", 2024-04-19T03:03:29.947 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2350000000000002e-06 2024-04-19T03:03:29.947 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.947 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.947 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:29.947 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634596+0000", 2024-04-19T03:03:29.947 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5390000000000001e-06 2024-04-19T03:03:29.947 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.947 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.947 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:29.947 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634639+0000", 2024-04-19T03:03:29.947 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2444999999999998e-05 2024-04-19T03:03:29.947 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.947 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.947 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:29.948 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634808+0000", 2024-04-19T03:03:29.948 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000169152 2024-04-19T03:03:29.948 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.948 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.948 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:29.948 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634999+0000", 2024-04-19T03:03:29.948 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00019098300000000001 2024-04-19T03:03:29.948 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.948 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.948 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:29.948 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.640458+0000", 2024-04-19T03:03:29.948 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0054586870000000003 2024-04-19T03:03:29.948 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.948 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.949 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:29.949 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.826949+0000", 2024-04-19T03:03:29.949 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.18649178299999999 2024-04-19T03:03:29.949 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.949 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.949 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:03:29.949 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.826982+0000", 2024-04-19T03:03:29.949 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2477000000000001e-05 2024-04-19T03:03:29.949 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.949 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.949 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:29.949 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.827019+0000", 2024-04-19T03:03:29.949 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7355999999999999e-05 2024-04-19T03:03:29.949 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:29.950 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:29.950 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:29.950 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.950 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.950 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:86616 5.e 5:72278f47:::benchmark_data_smithi096_19531_object86615:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:29.950 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:22.634609+0000", 2024-04-19T03:03:29.950 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 67.306039541999994, 2024-04-19T03:03:29.950 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.19472088900000001, 2024-04-19T03:03:29.950 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:29.950 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:29.950 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:29.950 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:29.950 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:29.951 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 86616 2024-04-19T03:03:29.951 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.951 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:29.951 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.951 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:29.951 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634609+0000", 2024-04-19T03:03:29.951 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:29.951 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.951 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.951 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:29.951 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634609+0000", 2024-04-19T03:03:29.951 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:29.951 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.951 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.951 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:29.952 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634609+0000", 2024-04-19T03:03:29.952 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:29.952 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.952 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.952 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:29.952 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634651+0000", 2024-04-19T03:03:29.952 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2589000000000002e-05 2024-04-19T03:03:29.952 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.952 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.952 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:29.952 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634659+0000", 2024-04-19T03:03:29.952 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5850000000000002e-06 2024-04-19T03:03:29.952 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.952 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.952 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:29.952 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634662+0000", 2024-04-19T03:03:29.953 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3620000000000002e-06 2024-04-19T03:03:29.953 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.953 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.953 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:29.953 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.637880+0000", 2024-04-19T03:03:29.953 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.003218149 2024-04-19T03:03:29.953 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.953 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.953 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:29.953 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.637999+0000", 2024-04-19T03:03:29.953 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000118643 2024-04-19T03:03:29.953 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.953 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.953 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:29.953 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.638102+0000", 2024-04-19T03:03:29.953 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010331 2024-04-19T03:03:29.954 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.954 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.954 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:29.954 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.640851+0000", 2024-04-19T03:03:29.954 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0027483310000000001 2024-04-19T03:03:29.954 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.954 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.954 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:29.954 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.829269+0000", 2024-04-19T03:03:29.954 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.188418319 2024-04-19T03:03:29.954 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.954 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.954 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:03:29.955 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.829299+0000", 2024-04-19T03:03:29.955 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0227e-05 2024-04-19T03:03:29.955 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.955 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.955 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:29.955 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.829330+0000", 2024-04-19T03:03:29.955 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.0969000000000001e-05 2024-04-19T03:03:29.955 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:29.955 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:29.955 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:29.955 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.955 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.955 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:86618 5.0 5:09014b90:::benchmark_data_smithi096_19531_object86617:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:29.955 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:22.634894+0000", 2024-04-19T03:03:29.956 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 67.305755054000002, 2024-04-19T03:03:29.956 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.19413419800000001, 2024-04-19T03:03:29.956 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:29.956 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:29.956 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:29.956 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:29.956 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:29.956 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 86618 2024-04-19T03:03:29.956 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.956 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:29.956 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.956 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:29.956 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634894+0000", 2024-04-19T03:03:29.957 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:29.957 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.957 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.957 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:29.957 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634894+0000", 2024-04-19T03:03:29.957 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:29.957 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.957 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.957 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:29.957 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634893+0000", 2024-04-19T03:03:29.957 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:03:29.957 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.957 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.957 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:29.958 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634976+0000", 2024-04-19T03:03:29.958 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3231000000000003e-05 2024-04-19T03:03:29.958 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.958 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.958 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:29.958 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634983+0000", 2024-04-19T03:03:29.958 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5169999999999996e-06 2024-04-19T03:03:29.958 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.958 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.958 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:29.958 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.634987+0000", 2024-04-19T03:03:29.958 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.425e-06 2024-04-19T03:03:29.958 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.958 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.959 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:29.959 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635030+0000", 2024-04-19T03:03:29.959 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.32e-05 2024-04-19T03:03:29.959 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.959 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.959 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:29.959 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635185+0000", 2024-04-19T03:03:29.959 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015471899999999999 2024-04-19T03:03:29.959 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.959 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.959 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:29.959 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635415+0000", 2024-04-19T03:03:29.959 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00023026500000000001 2024-04-19T03:03:29.959 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.960 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.960 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:29.960 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.640127+0000", 2024-04-19T03:03:29.960 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0047118890000000004 2024-04-19T03:03:29.960 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.960 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.960 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:29.960 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.828895+0000", 2024-04-19T03:03:29.960 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.18876802600000001 2024-04-19T03:03:29.960 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.960 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.960 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:03:29.960 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.828972+0000", 2024-04-19T03:03:29.960 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.6345000000000002e-05 2024-04-19T03:03:29.960 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.961 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.961 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:29.961 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.829028+0000", 2024-04-19T03:03:29.961 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6342999999999999e-05 2024-04-19T03:03:29.961 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:29.961 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:29.961 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:29.961 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.961 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.961 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:86620 5.b 5:d80faa68:::benchmark_data_smithi096_19531_object86619:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:29.961 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:22.635110+0000", 2024-04-19T03:03:29.961 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 67.305538494000004, 2024-04-19T03:03:29.961 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.193447275, 2024-04-19T03:03:29.961 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:29.962 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:29.962 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:29.962 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:29.962 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:29.962 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 86620 2024-04-19T03:03:29.962 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.962 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:29.962 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.962 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:29.962 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635110+0000", 2024-04-19T03:03:29.963 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:29.963 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.963 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.963 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:29.963 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635110+0000", 2024-04-19T03:03:29.963 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:29.963 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.963 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.963 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:29.963 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635110+0000", 2024-04-19T03:03:29.963 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:29.963 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.963 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.963 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:29.964 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635154+0000", 2024-04-19T03:03:29.964 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4681000000000001e-05 2024-04-19T03:03:29.964 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.964 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.964 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:29.964 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635166+0000", 2024-04-19T03:03:29.964 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1505000000000001e-05 2024-04-19T03:03:29.964 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.964 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.964 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:29.964 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635171+0000", 2024-04-19T03:03:29.964 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6040000000000003e-06 2024-04-19T03:03:29.964 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.964 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.965 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:29.965 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635221+0000", 2024-04-19T03:03:29.965 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9947000000000001e-05 2024-04-19T03:03:29.965 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.965 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.965 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:29.965 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635356+0000", 2024-04-19T03:03:29.965 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013576199999999999 2024-04-19T03:03:29.965 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.965 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.965 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:29.965 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635507+0000", 2024-04-19T03:03:29.965 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015072999999999999 2024-04-19T03:03:29.966 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.966 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.966 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:29.966 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.638488+0000", 2024-04-19T03:03:29.966 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0029813159999999999 2024-04-19T03:03:29.966 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.966 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.966 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:29.966 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.828341+0000", 2024-04-19T03:03:29.966 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.189852254 2024-04-19T03:03:29.966 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.967 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.967 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:03:29.967 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.828416+0000", 2024-04-19T03:03:29.967 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5344000000000002e-05 2024-04-19T03:03:29.967 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.967 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.967 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:29.967 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.828558+0000", 2024-04-19T03:03:29.967 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000141695 2024-04-19T03:03:29.967 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:29.967 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:29.967 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:29.967 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.968 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.968 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:86621 5.8 5:1597a420:::benchmark_data_smithi096_19531_object86620:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:29.968 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:22.635187+0000", 2024-04-19T03:03:29.968 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 67.305461633999997, 2024-04-19T03:03:29.968 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.194204878, 2024-04-19T03:03:29.968 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:29.968 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:29.968 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:29.968 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:29.968 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:29.968 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 86621 2024-04-19T03:03:29.968 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.968 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:29.969 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.969 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:29.969 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635187+0000", 2024-04-19T03:03:29.969 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:29.969 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.969 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.969 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:29.969 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635187+0000", 2024-04-19T03:03:29.969 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:29.969 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.969 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.969 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:29.969 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635187+0000", 2024-04-19T03:03:29.970 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:29.970 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.970 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.970 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:29.970 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635242+0000", 2024-04-19T03:03:29.970 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5158000000000003e-05 2024-04-19T03:03:29.970 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.970 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.970 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:29.970 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635249+0000", 2024-04-19T03:03:29.970 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.7000000000000008e-06 2024-04-19T03:03:29.970 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.970 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.971 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:29.971 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635256+0000", 2024-04-19T03:03:29.971 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2060000000000004e-06 2024-04-19T03:03:29.971 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.971 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.971 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:29.971 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635302+0000", 2024-04-19T03:03:29.971 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5954000000000001e-05 2024-04-19T03:03:29.971 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.971 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.971 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:29.971 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635427+0000", 2024-04-19T03:03:29.971 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012559299999999999 2024-04-19T03:03:29.972 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.972 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.972 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:29.972 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.635596+0000", 2024-04-19T03:03:29.972 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000168615 2024-04-19T03:03:29.972 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.972 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.972 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:29.972 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.639320+0000", 2024-04-19T03:03:29.972 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0037244610000000001 2024-04-19T03:03:29.972 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.972 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.972 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:29.972 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.829277+0000", 2024-04-19T03:03:29.973 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.18995651099999999 2024-04-19T03:03:29.973 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.973 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.973 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:03:29.973 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.829341+0000", 2024-04-19T03:03:29.973 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3756000000000004e-05 2024-04-19T03:03:29.973 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.973 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.973 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:29.973 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:22.829392+0000", 2024-04-19T03:03:29.973 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1555999999999999e-05 2024-04-19T03:03:29.973 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:29.973 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:29.974 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:29.974 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.974 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.974 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87067 5.b 5:d57af71a:::benchmark_data_smithi096_19531_object87066:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:29.974 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.142233+0000", 2024-04-19T03:03:29.974 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 66.798415770999995, 2024-04-19T03:03:29.974 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.071692405000000001, 2024-04-19T03:03:29.974 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:29.974 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:29.974 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:29.974 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:29.974 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:29.975 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87067 2024-04-19T03:03:29.975 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.975 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:29.975 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.975 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:29.975 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142233+0000", 2024-04-19T03:03:29.975 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:29.975 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.975 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.975 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:29.975 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142233+0000", 2024-04-19T03:03:29.975 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:29.975 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.975 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.976 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:29.976 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142232+0000", 2024-04-19T03:03:29.976 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:03:29.976 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.976 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.976 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:29.976 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142277+0000", 2024-04-19T03:03:29.976 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5837000000000002e-05 2024-04-19T03:03:29.976 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.976 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.976 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:29.976 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142297+0000", 2024-04-19T03:03:29.976 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9561000000000001e-05 2024-04-19T03:03:29.976 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.977 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.977 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:29.977 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142311+0000", 2024-04-19T03:03:29.977 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3654e-05 2024-04-19T03:03:29.977 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.977 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.977 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:29.977 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142391+0000", 2024-04-19T03:03:29.977 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0123999999999994e-05 2024-04-19T03:03:29.977 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.977 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.977 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:29.977 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142669+0000", 2024-04-19T03:03:29.977 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00027829800000000001 2024-04-19T03:03:29.977 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.978 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.978 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:29.978 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.142859+0000", 2024-04-19T03:03:29.978 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000190051 2024-04-19T03:03:29.978 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.978 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.978 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:29.978 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.150597+0000", 2024-04-19T03:03:29.978 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0077380299999999999 2024-04-19T03:03:29.978 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.978 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.978 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:29.979 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.213855+0000", 2024-04-19T03:03:29.979 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.063257987000000002 2024-04-19T03:03:29.979 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.979 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.979 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:03:29.979 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.213898+0000", 2024-04-19T03:03:29.979 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2916e-05 2024-04-19T03:03:29.979 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.979 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.979 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:29.979 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.213925+0000", 2024-04-19T03:03:29.979 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7503000000000001e-05 2024-04-19T03:03:29.979 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:29.980 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:29.980 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:29.980 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.980 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.980 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87069 5.b 5:da0c93b5:::benchmark_data_smithi096_19531_object87068:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:29.980 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.143402+0000", 2024-04-19T03:03:29.980 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 66.797246809000001, 2024-04-19T03:03:29.980 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.070678598999999995, 2024-04-19T03:03:29.980 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:29.980 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:29.980 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:29.980 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:29.980 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:29.980 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87069 2024-04-19T03:03:29.981 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.981 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:29.981 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.981 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:29.981 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.143402+0000", 2024-04-19T03:03:29.981 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:29.981 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.981 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.981 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:29.981 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.143402+0000", 2024-04-19T03:03:29.981 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:29.981 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.981 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.981 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:29.982 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.143401+0000", 2024-04-19T03:03:29.982 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:03:29.982 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.982 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.982 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:29.982 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.143501+0000", 2024-04-19T03:03:29.982 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000100387 2024-04-19T03:03:29.982 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.982 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.982 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:29.982 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.143516+0000", 2024-04-19T03:03:29.982 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5369000000000001e-05 2024-04-19T03:03:29.982 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.982 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.983 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:29.983 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.143524+0000", 2024-04-19T03:03:29.983 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.7079999999999997e-06 2024-04-19T03:03:29.983 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.983 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.983 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:29.983 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.145550+0000", 2024-04-19T03:03:29.983 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0020259290000000001 2024-04-19T03:03:29.983 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.983 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.983 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:29.983 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.145676+0000", 2024-04-19T03:03:29.983 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000126406 2024-04-19T03:03:29.984 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.984 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.984 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:29.984 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.145802+0000", 2024-04-19T03:03:29.984 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000125974 2024-04-19T03:03:29.984 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.984 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.984 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:29.984 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.151030+0000", 2024-04-19T03:03:29.984 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0052276079999999999 2024-04-19T03:03:29.984 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.984 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.984 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:29.984 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.213998+0000", 2024-04-19T03:03:29.985 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.06296786 2024-04-19T03:03:29.985 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.985 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.985 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:03:29.985 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.214031+0000", 2024-04-19T03:03:29.985 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3387999999999999e-05 2024-04-19T03:03:29.985 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.985 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.985 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:29.985 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.214081+0000", 2024-04-19T03:03:29.985 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9316e-05 2024-04-19T03:03:29.985 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:29.985 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:29.986 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:29.986 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.986 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.986 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87108 5.e 5:7e197adc:::benchmark_data_smithi096_19531_object87107:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:29.986 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.223103+0000", 2024-04-19T03:03:29.986 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 66.717545471999998, 2024-04-19T03:03:29.986 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.044946887, 2024-04-19T03:03:29.986 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:29.986 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-19T03:03:29.986 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:29.986 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:29.986 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:29.986 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87108 2024-04-19T03:03:29.987 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.987 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:29.987 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.987 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:29.987 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.223103+0000", 2024-04-19T03:03:29.987 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:29.987 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.987 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.987 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:29.987 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.223103+0000", 2024-04-19T03:03:29.987 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:29.987 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.987 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.987 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:29.987 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.223102+0000", 2024-04-19T03:03:29.988 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:03:29.988 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.988 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.988 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:29.988 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.223156+0000", 2024-04-19T03:03:29.988 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3958000000000001e-05 2024-04-19T03:03:29.988 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.988 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.988 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:29.988 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.223166+0000", 2024-04-19T03:03:29.988 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.4809999999999995e-06 2024-04-19T03:03:29.988 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.988 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.988 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:29.988 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.223172+0000", 2024-04-19T03:03:29.988 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0140000000000004e-06 2024-04-19T03:03:29.989 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.989 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.989 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:29.989 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.227295+0000", 2024-04-19T03:03:29.989 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0041233420000000003 2024-04-19T03:03:29.989 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.989 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.989 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:29.989 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.227495+0000", 2024-04-19T03:03:29.989 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00019955299999999999 2024-04-19T03:03:29.989 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.989 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.989 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:29.989 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.227717+0000", 2024-04-19T03:03:29.990 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000221902 2024-04-19T03:03:29.990 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.990 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.990 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:29.990 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233189+0000", 2024-04-19T03:03:29.990 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0054718889999999997 2024-04-19T03:03:29.990 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.990 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.990 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:29.990 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.250529+0000", 2024-04-19T03:03:29.990 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.017340298000000001 2024-04-19T03:03:29.990 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.990 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.990 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:03:29.991 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.250539+0000", 2024-04-19T03:03:29.991 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0501e-05 2024-04-19T03:03:29.991 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.991 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.991 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:29.991 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.268003+0000", 2024-04-19T03:03:29.991 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.017463429 2024-04-19T03:03:29.991 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.991 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.991 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:29.991 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.268050+0000", 2024-04-19T03:03:29.991 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7466000000000003e-05 2024-04-19T03:03:29.991 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:29.991 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:29.992 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:29.992 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.992 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.992 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87118 5.b 5:d1bb4f3c:::benchmark_data_smithi096_19531_object87117:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:29.992 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.231082+0000", 2024-04-19T03:03:29.992 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 66.709566637999998, 2024-04-19T03:03:29.992 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.035789004, 2024-04-19T03:03:29.992 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:29.992 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-19T03:03:29.992 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:29.992 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:29.992 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:29.992 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87118 2024-04-19T03:03:29.992 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.993 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:29.993 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.993 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:29.993 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231082+0000", 2024-04-19T03:03:29.993 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:29.993 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.993 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.993 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:29.993 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231082+0000", 2024-04-19T03:03:29.993 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:29.993 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.993 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.993 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:29.993 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231081+0000", 2024-04-19T03:03:29.993 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:03:29.993 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.994 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.994 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:29.994 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231159+0000", 2024-04-19T03:03:29.994 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.7819999999999997e-05 2024-04-19T03:03:29.994 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.994 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.994 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:29.994 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231186+0000", 2024-04-19T03:03:29.994 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7126000000000001e-05 2024-04-19T03:03:29.994 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.994 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.994 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:29.994 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231193+0000", 2024-04-19T03:03:29.995 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7259999999999996e-06 2024-04-19T03:03:29.995 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.995 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.995 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:29.995 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231241+0000", 2024-04-19T03:03:29.995 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8123e-05 2024-04-19T03:03:29.995 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.995 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.995 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:29.995 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231354+0000", 2024-04-19T03:03:29.995 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0001133 2024-04-19T03:03:29.995 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.996 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.996 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:29.996 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.231443+0000", 2024-04-19T03:03:29.996 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9167999999999997e-05 2024-04-19T03:03:29.996 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.996 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.996 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:29.996 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236498+0000", 2024-04-19T03:03:29.996 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0050545160000000002 2024-04-19T03:03:29.996 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.996 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.996 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:29.996 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.249681+0000", 2024-04-19T03:03:29.996 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013183321 2024-04-19T03:03:29.997 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.997 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.997 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:03:29.997 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.249693+0000", 2024-04-19T03:03:29.997 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1834999999999999e-05 2024-04-19T03:03:29.997 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.997 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.997 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:29.997 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266733+0000", 2024-04-19T03:03:29.997 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.017040408 2024-04-19T03:03:29.997 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.997 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.997 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:29.998 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266871+0000", 2024-04-19T03:03:29.998 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000137849 2024-04-19T03:03:29.998 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:29.998 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:29.998 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:29.998 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.998 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.998 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87121 5.b 5:d01822b8:::benchmark_data_smithi096_19531_object87120:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:29.998 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.233319+0000", 2024-04-19T03:03:29.998 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 66.707329774000002, 2024-04-19T03:03:29.998 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.033624198, 2024-04-19T03:03:29.998 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:29.998 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-19T03:03:29.998 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:29.999 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:29.999 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:29.999 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87121 2024-04-19T03:03:29.999 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.999 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:29.999 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.999 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:29.999 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233319+0000", 2024-04-19T03:03:29.999 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:29.999 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:29.999 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:29.999 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:29.999 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233319+0000", 2024-04-19T03:03:30.000 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:30.000 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:30.000 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:30.000 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:30.000 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233319+0000", 2024-04-19T03:03:30.000 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:30.000 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:30.000 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:30.000 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:30.000 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233364+0000", 2024-04-19T03:03:30.000 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5460999999999997e-05 2024-04-19T03:03:30.000 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:30.000 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:30.000 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:30.000 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233382+0000", 2024-04-19T03:03:30.001 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8148e-05 2024-04-19T03:03:30.001 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:30.001 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:30.001 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:30.001 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233390+0000", 2024-04-19T03:03:30.001 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5340000000000002e-06 2024-04-19T03:03:30.001 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:30.001 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:30.001 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:30.001 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233712+0000", 2024-04-19T03:03:30.001 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00032260500000000001 2024-04-19T03:03:30.001 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:30.001 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:30.001 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:30.001 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233829+0000", 2024-04-19T03:03:30.002 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011638599999999999 2024-04-19T03:03:30.002 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:30.002 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:30.002 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:30.002 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.233959+0000", 2024-04-19T03:03:30.002 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013013900000000001 2024-04-19T03:03:30.002 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:30.002 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:30.002 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:30.002 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236515+0000", 2024-04-19T03:03:30.002 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0025562750000000002 2024-04-19T03:03:30.002 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:30.002 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:30.003 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:30.003 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.249723+0000", 2024-04-19T03:03:30.003 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013208176 2024-04-19T03:03:30.003 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:30.003 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:30.003 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:03:30.003 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.249728+0000", 2024-04-19T03:03:30.003 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6519999999999997e-06 2024-04-19T03:03:30.003 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:30.003 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:30.003 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:30.003 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266837+0000", 2024-04-19T03:03:30.003 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0171087059999999 2024-04-19T03:03:30.003 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:30.004 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:30.004 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:30.004 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266943+0000", 2024-04-19T03:03:30.004 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000106604 2024-04-19T03:03:30.004 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:30.004 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:30.004 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:30.004 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:30.004 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:30.004 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87124 5.8 5:14819ad7:::benchmark_data_smithi096_19531_object87123:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:30.004 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.235886+0000", 2024-04-19T03:03:30.004 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 66.704762349999996, 2024-04-19T03:03:30.004 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0315451179999999, 2024-04-19T03:03:30.004 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:30.005 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-19T03:03:30.005 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:30.005 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:30.005 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:30.005 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87124 2024-04-19T03:03:30.005 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:30.005 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:30.005 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:30.005 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:30.005 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.235886+0000", 2024-04-19T03:03:30.005 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:30.005 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:30.005 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:30.005 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:30.006 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.235886+0000", 2024-04-19T03:03:30.006 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:30.006 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:30.006 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:30.006 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:30.006 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.235886+0000", 2024-04-19T03:03:30.006 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:03:30.006 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:30.006 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:30.006 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:30.006 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.235934+0000", 2024-04-19T03:03:30.006 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8384000000000003e-05 2024-04-19T03:03:30.006 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:30.007 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:30.007 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:30.007 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.235945+0000", 2024-04-19T03:03:30.007 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0671e-05 2024-04-19T03:03:30.007 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:30.007 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:30.007 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:30.007 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.235952+0000", 2024-04-19T03:03:30.007 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3089999999999998e-06 2024-04-19T03:03:30.007 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:30.007 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:30.007 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:30.007 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.237067+0000", 2024-04-19T03:03:30.007 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001115263 2024-04-19T03:03:30.008 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:30.008 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:30.008 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:30.008 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.237188+0000", 2024-04-19T03:03:30.008 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000121258 2024-04-19T03:03:30.008 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:30.008 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:30.008 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:30.008 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.237316+0000", 2024-04-19T03:03:30.008 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000128071 2024-04-19T03:03:30.008 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:30.008 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:30.008 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:30.009 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240744+0000", 2024-04-19T03:03:30.009 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0034275629999999998 2024-04-19T03:03:30.009 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:30.009 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:30.009 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:30.009 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.252517+0000", 2024-04-19T03:03:30.009 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011772991999999999 2024-04-19T03:03:30.009 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:30.009 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:30.009 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:03:30.009 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.252523+0000", 2024-04-19T03:03:30.009 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.3640000000000004e-06 2024-04-19T03:03:30.009 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:30.010 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:30.010 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:30.010 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.267290+0000", 2024-04-19T03:03:30.010 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0147665690000001 2024-04-19T03:03:30.010 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:30.010 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:30.010 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:30.010 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.267432+0000", 2024-04-19T03:03:30.010 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014165299999999999 2024-04-19T03:03:30.010 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:30.010 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:30.010 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:30.010 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:30.010 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:30.011 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87129 5.0 5:02667e01:::benchmark_data_smithi096_19531_object87128:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:30.011 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.236466+0000", 2024-04-19T03:03:30.011 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 66.704182353999997, 2024-04-19T03:03:30.011 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0301534510000001, 2024-04-19T03:03:30.011 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:30.011 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-19T03:03:30.011 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:30.011 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:30.011 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:30.011 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87129 2024-04-19T03:03:30.011 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:30.011 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:30.011 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:30.011 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:30.012 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236466+0000", 2024-04-19T03:03:30.012 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:30.012 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:30.012 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:30.012 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:30.012 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236466+0000", 2024-04-19T03:03:30.012 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:30.012 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:30.012 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:30.012 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:30.012 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236465+0000", 2024-04-19T03:03:30.012 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:03:30.012 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:30.012 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:30.013 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:30.013 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236566+0000", 2024-04-19T03:03:30.013 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00010047000000000001 2024-04-19T03:03:30.013 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:30.013 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:30.013 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:30.013 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236577+0000", 2024-04-19T03:03:30.013 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1772e-05 2024-04-19T03:03:30.013 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:30.013 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:30.013 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:30.013 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.236584+0000", 2024-04-19T03:03:30.013 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0530000000000003e-06 2024-04-19T03:03:30.013 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:30.014 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:30.014 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:30.014 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.237023+0000", 2024-04-19T03:03:30.014 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000439703 2024-04-19T03:03:30.014 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:30.014 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:30.014 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:30.014 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.237207+0000", 2024-04-19T03:03:30.014 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000183692 2024-04-19T03:03:30.014 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:30.014 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:30.014 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:30.015 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.237373+0000", 2024-04-19T03:03:30.015 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016623500000000001 2024-04-19T03:03:30.015 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:30.015 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:30.015 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:30.015 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.241461+0000", 2024-04-19T03:03:30.015 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0040883050000000004 2024-04-19T03:03:30.015 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:30.015 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:30.015 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:30.015 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.252500+0000", 2024-04-19T03:03:30.015 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011038450999999999 2024-04-19T03:03:30.016 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:30.016 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:30.016 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:03:30.016 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.252507+0000", 2024-04-19T03:03:30.016 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2439999999999996e-06 2024-04-19T03:03:30.016 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:30.016 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:30.016 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:30.016 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266538+0000", 2024-04-19T03:03:30.016 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.014031184 2024-04-19T03:03:30.016 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:30.016 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:30.016 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:30.016 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266620+0000", 2024-04-19T03:03:30.017 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1600000000000005e-05 2024-04-19T03:03:30.017 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:30.017 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:30.017 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:30.017 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:30.017 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:30.017 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87135 5.4 5:2a97e7b7:::benchmark_data_smithi096_19531_object87134:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:30.017 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.240884+0000", 2024-04-19T03:03:30.017 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 66.699764896999994, 2024-04-19T03:03:30.017 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.025708931, 2024-04-19T03:03:30.017 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:30.017 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-19T03:03:30.017 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:30.017 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:30.018 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:30.018 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87135 2024-04-19T03:03:30.018 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:30.018 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:30.018 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:30.018 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:30.018 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240884+0000", 2024-04-19T03:03:30.018 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:30.018 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:30.018 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:30.018 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:30.018 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240884+0000", 2024-04-19T03:03:30.018 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:30.019 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:30.019 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:30.019 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:30.019 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240883+0000", 2024-04-19T03:03:30.019 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:03:30.019 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:30.019 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:30.019 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:30.019 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240933+0000", 2024-04-19T03:03:30.019 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9969999999999998e-05 2024-04-19T03:03:30.019 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:30.019 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:30.019 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:30.020 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240946+0000", 2024-04-19T03:03:30.020 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2943e-05 2024-04-19T03:03:30.020 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:30.020 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:30.020 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:30.020 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240952+0000", 2024-04-19T03:03:30.020 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8930000000000002e-06 2024-04-19T03:03:30.020 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:30.020 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:30.020 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:30.020 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240994+0000", 2024-04-19T03:03:30.020 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2753999999999998e-05 2024-04-19T03:03:30.020 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:30.020 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:30.021 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:30.021 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.241092+0000", 2024-04-19T03:03:30.021 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.7447000000000004e-05 2024-04-19T03:03:30.021 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:30.021 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:30.021 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:30.021 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.241183+0000", 2024-04-19T03:03:30.021 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1163999999999997e-05 2024-04-19T03:03:30.021 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:30.021 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:30.021 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:30.021 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.254672+0000", 2024-04-19T03:03:30.021 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.01348864 2024-04-19T03:03:30.022 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:30.022 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:30.022 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:03:30.022 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.254681+0000", 2024-04-19T03:03:30.022 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.3789999999999995e-06 2024-04-19T03:03:30.022 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:30.022 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:30.022 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:30.022 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266456+0000", 2024-04-19T03:03:30.022 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.011774621 2024-04-19T03:03:30.022 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:30.022 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:30.022 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:30.023 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266593+0000", 2024-04-19T03:03:30.023 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013737600000000001 2024-04-19T03:03:30.023 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:30.023 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:30.023 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:30.023 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:30.023 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:30.023 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87136 5.4 5:212411bc:::benchmark_data_smithi096_19531_object87135:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536 in=65536b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:30.023 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.240962+0000", 2024-04-19T03:03:30.023 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 66.699687021000003, 2024-04-19T03:03:30.023 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.025738, 2024-04-19T03:03:30.023 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:30.023 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "reached pg", 2024-04-19T03:03:30.023 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:30.024 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:30.024 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:30.024 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87136 2024-04-19T03:03:30.024 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:30.024 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:30.024 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:30.024 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:30.024 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240962+0000", 2024-04-19T03:03:30.024 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:30.024 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:30.024 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:30.024 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:30.024 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240962+0000", 2024-04-19T03:03:30.025 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:30.025 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:30.025 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:30.025 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:30.025 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240961+0000", 2024-04-19T03:03:30.025 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:30.025 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:30.025 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:30.025 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:30.025 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.240995+0000", 2024-04-19T03:03:30.025 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3868000000000002e-05 2024-04-19T03:03:30.025 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:30.025 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:30.026 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:30.026 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.241001+0000", 2024-04-19T03:03:30.026 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.322e-06 2024-04-19T03:03:30.026 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:30.026 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:30.026 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:30.026 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.241004+0000", 2024-04-19T03:03:30.026 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.3510000000000002e-06 2024-04-19T03:03:30.026 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:30.026 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:30.026 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:30.026 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247131+0000", 2024-04-19T03:03:30.026 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0061270869999999998 2024-04-19T03:03:30.026 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:30.027 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:30.027 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:30.027 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247322+0000", 2024-04-19T03:03:30.027 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000191015 2024-04-19T03:03:30.027 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:30.027 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:30.027 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:30.027 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247542+0000", 2024-04-19T03:03:30.027 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00022030199999999999 2024-04-19T03:03:30.027 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:30.027 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:30.027 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:30.027 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.254709+0000", 2024-04-19T03:03:30.028 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0071662660000000001 2024-04-19T03:03:30.028 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:30.028 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:30.028 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:03:30.028 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.254716+0000", 2024-04-19T03:03:30.028 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3860000000000001e-06 2024-04-19T03:03:30.028 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:30.028 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:30.028 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:30.028 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266619+0000", 2024-04-19T03:03:30.028 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0119031030000001 2024-04-19T03:03:30.028 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:30.028 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:30.028 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:30.029 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.266700+0000", 2024-04-19T03:03:30.029 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0764000000000001e-05 2024-04-19T03:03:30.029 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:30.029 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:30.029 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:30.029 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:30.029 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:30.029 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:87138 5.e 5:7b1f1c20:::benchmark_data_smithi096_19531_object87137:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:30.029 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:23.247862+0000", 2024-04-19T03:03:30.029 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 66.692786947000002, 2024-04-19T03:03:30.029 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.024457079, 2024-04-19T03:03:30.029 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:30.029 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:30.030 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:30.030 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:30.030 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:30.030 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 87138 2024-04-19T03:03:30.030 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:30.030 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:30.030 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:30.030 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:30.030 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247862+0000", 2024-04-19T03:03:30.030 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:30.030 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:30.030 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:30.030 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:30.031 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247862+0000", 2024-04-19T03:03:30.031 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:30.031 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:30.031 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:30.031 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:30.031 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247860+0000", 2024-04-19T03:03:30.031 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999981 2024-04-19T03:03:30.031 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:30.031 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:30.031 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:30.031 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247909+0000", 2024-04-19T03:03:30.031 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.9150999999999997e-05 2024-04-19T03:03:30.031 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:30.031 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:30.032 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:30.032 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247925+0000", 2024-04-19T03:03:30.032 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.5761999999999999e-05 2024-04-19T03:03:30.032 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:30.032 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:30.032 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:30.032 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.247936+0000", 2024-04-19T03:03:30.032 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1144e-05 2024-04-19T03:03:30.032 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:30.032 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:30.032 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:30.032 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.250590+0000", 2024-04-19T03:03:30.032 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.002653678 2024-04-19T03:03:30.032 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:30.033 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:30.033 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for peered", 2024-04-19T03:03:30.033 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:23.250599+0000", 2024-04-19T03:03:30.033 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.9039999999999998e-06 2024-04-19T03:03:30.033 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:30.033 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:30.033 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:30.033 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.268151+0000", 2024-04-19T03:03:30.033 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0175523449999999 2024-04-19T03:03:30.033 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:30.033 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:30.033 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:30.033 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.268285+0000", 2024-04-19T03:03:30.033 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013415599999999999 2024-04-19T03:03:30.034 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:30.034 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:30.034 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:30.034 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.272238+0000", 2024-04-19T03:03:30.034 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0039533019999999997 2024-04-19T03:03:30.034 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:30.034 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:30.034 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:03:30.034 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.272274+0000", 2024-04-19T03:03:30.034 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5352000000000003e-05 2024-04-19T03:03:30.034 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:30.034 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:30.035 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:30.035 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:24.272319+0000", 2024-04-19T03:03:30.035 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5281999999999998e-05 2024-04-19T03:03:30.035 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:30.035 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:30.035 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:30.035 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:30.035 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:30.035 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:158371 5.8 5:11a83024:::benchmark_data_smithi096_19531_object44921:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-19T03:03:30.035 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:58.125869+0000", 2024-04-19T03:03:30.035 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 31.814780081999999, 2024-04-19T03:03:30.035 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074532857999999994, 2024-04-19T03:03:30.035 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:30.035 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:30.036 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:30.036 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:30.036 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:30.036 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 158371 2024-04-19T03:03:30.036 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:30.036 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:30.036 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:30.036 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:30.036 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125869+0000", 2024-04-19T03:03:30.036 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:30.036 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:30.036 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:30.036 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:30.036 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125869+0000", 2024-04-19T03:03:30.037 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:30.037 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:30.037 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:30.037 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:30.037 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125868+0000", 2024-04-19T03:03:30.037 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:03:30.037 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:30.037 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:30.037 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:30.037 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125874+0000", 2024-04-19T03:03:30.037 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7120000000000003e-06 2024-04-19T03:03:30.037 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:30.037 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:30.038 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:30.038 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125885+0000", 2024-04-19T03:03:30.038 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0665999999999999e-05 2024-04-19T03:03:30.038 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:30.038 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:30.038 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:30.038 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125901+0000", 2024-04-19T03:03:30.038 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6463000000000001e-05 2024-04-19T03:03:30.038 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:30.038 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:30.038 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:30.038 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125956+0000", 2024-04-19T03:03:30.038 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.4728000000000002e-05 2024-04-19T03:03:30.038 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:30.039 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:30.039 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:30.039 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.126050+0000", 2024-04-19T03:03:30.039 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.3534000000000003e-05 2024-04-19T03:03:30.039 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:30.039 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:30.039 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:30.039 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.200187+0000", 2024-04-19T03:03:30.039 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074136933000000002 2024-04-19T03:03:30.039 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:30.039 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:30.039 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:03:30.039 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.200260+0000", 2024-04-19T03:03:30.039 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3090999999999995e-05 2024-04-19T03:03:30.040 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:30.040 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:30.040 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:30.040 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.200402+0000", 2024-04-19T03:03:30.040 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014193699999999999 2024-04-19T03:03:30.040 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:30.040 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:30.040 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:30.040 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:30.040 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:30.040 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:158372 5.0 5:0473aa5f:::benchmark_data_smithi096_19531_object44922:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-19T03:03:30.040 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:58.125924+0000", 2024-04-19T03:03:30.040 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 31.814724474999998, 2024-04-19T03:03:30.041 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.074247490999999999, 2024-04-19T03:03:30.041 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:30.041 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:30.041 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:30.041 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:30.041 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:30.041 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 158372 2024-04-19T03:03:30.041 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:30.041 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:30.041 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:30.041 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:30.041 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125924+0000", 2024-04-19T03:03:30.041 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:30.042 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:30.042 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:30.042 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:30.042 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125924+0000", 2024-04-19T03:03:30.042 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:30.042 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:30.042 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:30.042 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:30.042 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125924+0000", 2024-04-19T03:03:30.042 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:30.042 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:30.042 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:30.042 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:30.043 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125927+0000", 2024-04-19T03:03:30.043 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.5389999999999999e-06 2024-04-19T03:03:30.043 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:30.043 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:30.043 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:30.043 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125935+0000", 2024-04-19T03:03:30.043 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3259999999999998e-06 2024-04-19T03:03:30.043 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:30.043 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:30.043 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:30.043 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125940+0000", 2024-04-19T03:03:30.043 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6980000000000003e-06 2024-04-19T03:03:30.043 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:30.043 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:30.044 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:30.044 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125982+0000", 2024-04-19T03:03:30.044 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1337000000000001e-05 2024-04-19T03:03:30.044 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:30.044 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:30.044 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:30.044 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.126075+0000", 2024-04-19T03:03:30.044 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.3579999999999995e-05 2024-04-19T03:03:30.044 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:30.044 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:30.044 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:30.044 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.199953+0000", 2024-04-19T03:03:30.044 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.073877604999999999 2024-04-19T03:03:30.044 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:30.045 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:30.045 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:03:30.045 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.200022+0000", 2024-04-19T03:03:30.045 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.8824000000000004e-05 2024-04-19T03:03:30.045 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:30.045 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:30.045 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:30.045 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.200172+0000", 2024-04-19T03:03:30.045 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015017700000000001 2024-04-19T03:03:30.045 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:30.045 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:30.045 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:30.045 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:30.046 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:30.046 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:158374 5.e 5:76be57a5:::benchmark_data_smithi096_19531_object44924:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-19T03:03:30.046 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:58.125988+0000", 2024-04-19T03:03:30.046 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 31.814660975999999, 2024-04-19T03:03:30.046 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.067843332000000006, 2024-04-19T03:03:30.046 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:30.046 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:30.046 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:30.046 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:30.046 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:30.046 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 158374 2024-04-19T03:03:30.046 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:30.046 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:30.047 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:30.047 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:30.047 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125988+0000", 2024-04-19T03:03:30.047 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:30.047 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:30.047 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:30.047 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:30.047 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125988+0000", 2024-04-19T03:03:30.047 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:30.047 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:30.047 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:30.047 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:30.047 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125987+0000", 2024-04-19T03:03:30.047 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:30.048 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:30.048 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:30.048 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:30.048 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125990+0000", 2024-04-19T03:03:30.048 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7989999999999998e-06 2024-04-19T03:03:30.048 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:30.048 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:30.048 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:30.048 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.125996+0000", 2024-04-19T03:03:30.048 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.302e-06 2024-04-19T03:03:30.048 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:30.048 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:30.048 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:30.049 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.126001+0000", 2024-04-19T03:03:30.049 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.843e-06 2024-04-19T03:03:30.049 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:30.049 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:30.049 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:30.049 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.126047+0000", 2024-04-19T03:03:30.049 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6066000000000002e-05 2024-04-19T03:03:30.049 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:30.049 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:30.049 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:30.049 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.126171+0000", 2024-04-19T03:03:30.049 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012359099999999999 2024-04-19T03:03:30.049 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:30.049 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:30.050 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:30.050 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.193709+0000", 2024-04-19T03:03:30.050 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.067538099000000004 2024-04-19T03:03:30.050 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:30.050 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:30.050 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:03:30.050 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.193766+0000", 2024-04-19T03:03:30.050 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6869e-05 2024-04-19T03:03:30.050 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:30.050 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:30.050 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:30.050 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.193831+0000", 2024-04-19T03:03:30.050 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5273999999999999e-05 2024-04-19T03:03:30.050 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:30.051 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:30.051 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:30.051 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:30.051 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:30.051 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_repop(client.4755.0:158376 5.9 e56/22 5:9e73c076:::benchmark_data_smithi096_19531_object44926:head v 56'9663, mlcod=56'9661)", 2024-04-19T03:03:30.051 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:58.127307+0000", 2024-04-19T03:03:30.051 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 31.813341744999999, 2024-04-19T03:03:30.051 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.069002716000000006, 2024-04-19T03:03:30.051 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:30.051 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:30.051 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:30.051 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:30.051 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:30.052 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.127307+0000", 2024-04-19T03:03:30.052 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:30.052 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:30.052 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:30.052 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:30.052 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.127307+0000", 2024-04-19T03:03:30.052 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:30.052 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:30.052 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:30.052 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:30.052 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.127306+0000", 2024-04-19T03:03:30.052 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.999999 2024-04-19T03:03:30.052 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:30.052 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:30.052 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:30.053 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.127316+0000", 2024-04-19T03:03:30.053 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.3039999999999994e-06 2024-04-19T03:03:30.053 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:30.053 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:30.053 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:30.053 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.127326+0000", 2024-04-19T03:03:30.053 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0009e-05 2024-04-19T03:03:30.053 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:30.053 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:30.053 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:30.053 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.127332+0000", 2024-04-19T03:03:30.053 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5880000000000003e-06 2024-04-19T03:03:30.053 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:30.053 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:30.054 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:30.054 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.127383+0000", 2024-04-19T03:03:30.054 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0516000000000002e-05 2024-04-19T03:03:30.054 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:30.054 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:30.054 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:30.054 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.127403+0000", 2024-04-19T03:03:30.054 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0547000000000002e-05 2024-04-19T03:03:30.054 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:30.054 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:30.054 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:03:30.054 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.196280+0000", 2024-04-19T03:03:30.054 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.068876863999999996 2024-04-19T03:03:30.055 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:30.055 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:30.055 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:30.055 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.196310+0000", 2024-04-19T03:03:30.055 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9762999999999999e-05 2024-04-19T03:03:30.055 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:30.055 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:30.055 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:30.055 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:30.055 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:30.055 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4755.0:158383 5.0 5:026717eb:::benchmark_data_smithi096_19531_object44933:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-19T03:03:30.055 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2024-04-19T03:02:58.130494+0000", 2024-04-19T03:03:30.055 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 31.810154618999999, 2024-04-19T03:03:30.056 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.070135775999999997, 2024-04-19T03:03:30.056 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2024-04-19T03:03:30.056 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:30.056 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2024-04-19T03:03:30.056 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4755", 2024-04-19T03:03:30.056 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:30.056 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 158383 2024-04-19T03:03:30.056 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:30.056 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2024-04-19T03:03:30.056 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:30.056 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2024-04-19T03:03:30.056 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.130494+0000", 2024-04-19T03:03:30.056 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:30.056 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:30.057 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:30.057 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2024-04-19T03:03:30.057 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.130494+0000", 2024-04-19T03:03:30.057 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2024-04-19T03:03:30.057 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:30.057 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:30.057 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2024-04-19T03:03:30.057 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.130493+0000", 2024-04-19T03:03:30.057 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4294967295.9999986 2024-04-19T03:03:30.057 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:30.057 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:30.057 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2024-04-19T03:03:30.057 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.130500+0000", 2024-04-19T03:03:30.057 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5490000000000003e-06 2024-04-19T03:03:30.058 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:30.058 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:30.058 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2024-04-19T03:03:30.058 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.190401+0000", 2024-04-19T03:03:30.058 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.059901668999999998 2024-04-19T03:03:30.058 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:30.058 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:30.058 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2024-04-19T03:03:30.058 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.190421+0000", 2024-04-19T03:03:30.058 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.0288e-05 2024-04-19T03:03:30.058 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:30.058 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:30.058 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2024-04-19T03:03:30.059 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.190536+0000", 2024-04-19T03:03:30.059 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000114783 2024-04-19T03:03:30.059 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:30.059 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:30.059 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2024-04-19T03:03:30.059 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.190904+0000", 2024-04-19T03:03:30.059 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00036773900000000001 2024-04-19T03:03:30.059 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:30.059 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:30.059 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2024-04-19T03:03:30.059 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.200417+0000", 2024-04-19T03:03:30.059 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0095128899999999995 2024-04-19T03:03:30.059 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:30.059 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:30.060 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2024-04-19T03:03:30.060 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.200489+0000", 2024-04-19T03:03:30.060 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2554999999999999e-05 2024-04-19T03:03:30.060 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-04-19T03:03:30.060 INFO:teuthology.orchestra.run.smithi134.stdout: { 2024-04-19T03:03:30.060 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2024-04-19T03:03:30.060 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2024-04-19T03:02:58.200630+0000", 2024-04-19T03:03:30.060 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014055299999999999 2024-04-19T03:03:30.060 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:30.060 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:30.060 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:30.060 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-04-19T03:03:30.060 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-04-19T03:03:30.060 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-04-19T03:03:30.062 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T03:03:30.062 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:03:30.062+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:03:30.163 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:03:30.160+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:03:30.177 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-04-19T03:03:30.177 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2024-04-19T03:03:30.177 INFO:teuthology.orchestra.run.smithi144.stdout: "num_ops": 0 2024-04-19T03:03:30.177 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-04-19T03:03:30.187 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T03:03:30.262 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-19T03:03:30.264 INFO:tasks.ceph.osd.2.smithi144.stderr:2024-04-19T03:03:30.260+0000 7f2529542700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 18221) UID: 0 2024-04-19T03:03:30.290 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-04-19T03:03:30.290 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [], 2024-04-19T03:03:30.291 INFO:teuthology.orchestra.run.smithi144.stdout: "complaint_time": 30, 2024-04-19T03:03:30.291 INFO:teuthology.orchestra.run.smithi144.stdout: "num_blocked_ops": 0 2024-04-19T03:03:30.291 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-04-19T03:03:30.300 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T03:03:30.365 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:03:30.362+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:03:30.408 INFO:teuthology.orchestra.run.smithi144.stdout:{ 2024-04-19T03:03:30.408 INFO:teuthology.orchestra.run.smithi144.stdout: "size": 20, 2024-04-19T03:03:30.408 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 600, 2024-04-19T03:03:30.408 INFO:teuthology.orchestra.run.smithi144.stdout: "ops": [ 2024-04-19T03:03:30.408 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.408 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:78992 5.7 5:e6baa862:::benchmark_data_smithi096_19531_object78991:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2024-04-19T03:03:30.408 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:18.008888+0000", 2024-04-19T03:03:30.409 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 72.395492976, 2024-04-19T03:03:30.409 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.056375285999999997, 2024-04-19T03:03:30.409 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:30.409 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:30.409 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:30.409 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:30.409 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:30.409 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 78992 2024-04-19T03:03:30.409 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.409 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:30.409 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.409 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:30.409 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.008888+0000", 2024-04-19T03:03:30.410 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:30.410 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.410 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.410 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:30.410 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.008888+0000", 2024-04-19T03:03:30.410 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:30.410 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.410 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.410 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:30.410 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.008888+0000", 2024-04-19T03:03:30.411 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:30.411 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.411 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.411 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:30.411 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.008928+0000", 2024-04-19T03:03:30.411 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0361999999999997e-05 2024-04-19T03:03:30.411 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.411 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.411 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:30.411 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.008942+0000", 2024-04-19T03:03:30.411 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4365000000000001e-05 2024-04-19T03:03:30.411 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.411 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.411 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:30.412 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.008949+0000", 2024-04-19T03:03:30.412 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.212e-06 2024-04-19T03:03:30.412 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.412 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.412 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:30.412 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.012683+0000", 2024-04-19T03:03:30.412 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.003733934 2024-04-19T03:03:30.412 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.412 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.412 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:30.412 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.012798+0000", 2024-04-19T03:03:30.412 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00011574999999999999 2024-04-19T03:03:30.412 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.412 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.413 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:30.413 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.012896+0000", 2024-04-19T03:03:30.413 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.7848000000000002e-05 2024-04-19T03:03:30.413 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.413 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.413 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:03:30.413 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.016423+0000", 2024-04-19T03:03:30.413 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0035270789999999998 2024-04-19T03:03:30.413 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.413 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.413 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:30.413 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.065098+0000", 2024-04-19T03:03:30.413 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.048674651999999999 2024-04-19T03:03:30.413 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.413 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.414 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:03:30.414 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.065193+0000", 2024-04-19T03:03:30.414 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.5087999999999995e-05 2024-04-19T03:03:30.414 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.414 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.414 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:30.414 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.065264+0000", 2024-04-19T03:03:30.414 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0666000000000004e-05 2024-04-19T03:03:30.414 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:30.414 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:30.415 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:30.415 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.415 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.415 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_repop(client.4755.0:79003 5.2 e40/39 5:4436e33f:::benchmark_data_smithi096_19531_object79002:head v 40'4935, mlcod=40'4932)", 2024-04-19T03:03:30.415 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:18.018102+0000", 2024-04-19T03:03:30.415 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 72.386278919999995, 2024-04-19T03:03:30.415 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.060023990999999999, 2024-04-19T03:03:30.415 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:30.415 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:30.415 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:30.415 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.415 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:30.416 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018102+0000", 2024-04-19T03:03:30.416 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:30.416 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.416 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.416 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:30.416 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018102+0000", 2024-04-19T03:03:30.416 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:30.416 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.416 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.416 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:30.416 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018102+0000", 2024-04-19T03:03:30.416 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:30.416 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.416 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.417 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:30.417 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018134+0000", 2024-04-19T03:03:30.417 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2722000000000003e-05 2024-04-19T03:03:30.417 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.417 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.417 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:30.417 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018145+0000", 2024-04-19T03:03:30.417 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0395e-05 2024-04-19T03:03:30.417 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.417 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.417 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:30.417 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018151+0000", 2024-04-19T03:03:30.417 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5300000000000002e-06 2024-04-19T03:03:30.417 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.418 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.418 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:30.418 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018489+0000", 2024-04-19T03:03:30.418 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00033731499999999998 2024-04-19T03:03:30.418 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.418 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.418 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:30.418 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.018508+0000", 2024-04-19T03:03:30.418 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.9775e-05 2024-04-19T03:03:30.418 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.418 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.418 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:03:30.418 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.078059+0000", 2024-04-19T03:03:30.419 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.059550171999999998 2024-04-19T03:03:30.419 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.419 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.419 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:30.419 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:18.078126+0000", 2024-04-19T03:03:30.419 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7773000000000003e-05 2024-04-19T03:03:30.419 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:30.419 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:30.419 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:30.419 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.419 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.419 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:86612 5.7 5:e32e3c49:::benchmark_data_smithi096_19531_object86611:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:30.419 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:22.633560+0000", 2024-04-19T03:03:30.419 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 67.770821260000005, 2024-04-19T03:03:30.420 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.19135289, 2024-04-19T03:03:30.420 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:30.420 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:30.420 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:30.420 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:30.420 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:30.420 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 86612 2024-04-19T03:03:30.420 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.420 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:30.420 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.420 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:30.420 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633560+0000", 2024-04-19T03:03:30.420 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:30.421 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.421 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.421 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:30.421 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633560+0000", 2024-04-19T03:03:30.421 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:30.421 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.421 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.421 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:30.421 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633558+0000", 2024-04-19T03:03:30.421 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999986 2024-04-19T03:03:30.421 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.421 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.421 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:30.421 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633609+0000", 2024-04-19T03:03:30.421 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0850999999999998e-05 2024-04-19T03:03:30.422 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.422 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.422 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:30.422 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633627+0000", 2024-04-19T03:03:30.422 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.7951000000000001e-05 2024-04-19T03:03:30.422 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.422 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.422 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:30.422 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633635+0000", 2024-04-19T03:03:30.422 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2530000000000004e-06 2024-04-19T03:03:30.422 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.422 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.422 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:30.422 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633699+0000", 2024-04-19T03:03:30.423 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.3901999999999999e-05 2024-04-19T03:03:30.423 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.423 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.423 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:30.423 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.633992+0000", 2024-04-19T03:03:30.423 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00029283299999999999 2024-04-19T03:03:30.423 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.423 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.423 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:30.423 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.634223+0000", 2024-04-19T03:03:30.423 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00023084200000000001 2024-04-19T03:03:30.423 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.423 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.423 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:03:30.423 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.639085+0000", 2024-04-19T03:03:30.424 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0048624269999999999 2024-04-19T03:03:30.424 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.424 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.424 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:30.424 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.824635+0000", 2024-04-19T03:03:30.424 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.18554944700000001 2024-04-19T03:03:30.424 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.424 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.424 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:03:30.424 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.824793+0000", 2024-04-19T03:03:30.424 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000157959 2024-04-19T03:03:30.424 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.424 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.424 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:30.424 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.824913+0000", 2024-04-19T03:03:30.424 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000120093 2024-04-19T03:03:30.425 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:30.425 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:30.425 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:30.425 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.425 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.425 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:86625 5.7 5:e6d00488:::benchmark_data_smithi096_19531_object86624:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:30.425 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:22.643554+0000", 2024-04-19T03:03:30.425 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 67.760827493999997, 2024-04-19T03:03:30.425 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.18732841, 2024-04-19T03:03:30.425 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:30.425 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:30.425 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:30.425 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:30.425 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:30.425 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 86625 2024-04-19T03:03:30.425 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.426 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:30.426 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.426 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:30.426 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643554+0000", 2024-04-19T03:03:30.426 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:30.426 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.426 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.426 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:30.426 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643554+0000", 2024-04-19T03:03:30.426 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:30.426 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.426 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.426 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:30.426 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643552+0000", 2024-04-19T03:03:30.427 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999986 2024-04-19T03:03:30.427 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.427 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.427 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:30.427 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643588+0000", 2024-04-19T03:03:30.427 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.5855999999999997e-05 2024-04-19T03:03:30.427 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.427 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.427 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:30.427 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643606+0000", 2024-04-19T03:03:30.427 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.8226000000000001e-05 2024-04-19T03:03:30.427 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.427 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.427 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:30.428 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643618+0000", 2024-04-19T03:03:30.428 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1868000000000001e-05 2024-04-19T03:03:30.428 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.428 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.428 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:30.428 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643676+0000", 2024-04-19T03:03:30.428 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8153999999999999e-05 2024-04-19T03:03:30.428 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.428 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.428 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:30.428 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.643905+0000", 2024-04-19T03:03:30.428 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00022847500000000001 2024-04-19T03:03:30.428 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.428 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.429 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:30.429 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.644150+0000", 2024-04-19T03:03:30.429 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00024531800000000001 2024-04-19T03:03:30.429 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.429 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.429 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:03:30.429 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.647407+0000", 2024-04-19T03:03:30.429 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0032563190000000001 2024-04-19T03:03:30.429 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.429 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.429 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:30.429 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.830721+0000", 2024-04-19T03:03:30.429 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.18331468300000001 2024-04-19T03:03:30.429 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.429 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.429 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:03:30.430 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.830813+0000", 2024-04-19T03:03:30.430 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.2205000000000002e-05 2024-04-19T03:03:30.430 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.430 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.430 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:30.430 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:22.830882+0000", 2024-04-19T03:03:30.430 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8819999999999995e-05 2024-04-19T03:03:30.430 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:30.430 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:30.430 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:30.430 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.430 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.430 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87063 5.7 5:e502e824:::benchmark_data_smithi096_19531_object87062:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:30.430 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.136067+0000", 2024-04-19T03:03:30.431 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 67.268314625000002, 2024-04-19T03:03:30.431 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.065521159999999995, 2024-04-19T03:03:30.431 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:30.431 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:30.431 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:30.431 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:30.431 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:30.431 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87063 2024-04-19T03:03:30.431 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.431 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:30.431 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.431 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:30.431 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.136067+0000", 2024-04-19T03:03:30.431 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:30.432 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.432 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.432 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:30.432 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.136067+0000", 2024-04-19T03:03:30.432 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:30.432 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.432 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.432 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:30.432 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.136066+0000", 2024-04-19T03:03:30.432 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:03:30.432 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.432 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.432 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:30.432 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.136154+0000", 2024-04-19T03:03:30.433 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.8256000000000003e-05 2024-04-19T03:03:30.433 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.433 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.433 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:30.433 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.136162+0000", 2024-04-19T03:03:30.433 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.5099999999999998e-06 2024-04-19T03:03:30.433 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.433 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.433 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:30.433 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.136171+0000", 2024-04-19T03:03:30.433 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2830000000000001e-06 2024-04-19T03:03:30.433 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.433 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.433 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:30.433 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.138421+0000", 2024-04-19T03:03:30.434 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0022506620000000001 2024-04-19T03:03:30.434 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.434 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.434 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:30.434 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.138560+0000", 2024-04-19T03:03:30.434 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000138446 2024-04-19T03:03:30.434 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.434 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.434 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:30.434 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.138689+0000", 2024-04-19T03:03:30.434 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00012950700000000001 2024-04-19T03:03:30.434 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.434 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.434 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:03:30.435 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.141517+0000", 2024-04-19T03:03:30.435 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0028280860000000001 2024-04-19T03:03:30.435 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.435 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.435 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:30.435 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.201350+0000", 2024-04-19T03:03:30.435 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.059832418999999998 2024-04-19T03:03:30.435 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.435 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.435 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:03:30.435 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.201485+0000", 2024-04-19T03:03:30.435 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000135597 2024-04-19T03:03:30.435 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.436 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.436 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:30.436 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.201588+0000", 2024-04-19T03:03:30.436 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00010247900000000001 2024-04-19T03:03:30.436 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:30.436 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:30.436 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:30.436 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.436 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.436 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87072 5.7 5:e3c7809a:::benchmark_data_smithi096_19531_object87071:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2024-04-19T03:03:30.436 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.144224+0000", 2024-04-19T03:03:30.436 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 67.260157601000003, 2024-04-19T03:03:30.436 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.058179555000000001, 2024-04-19T03:03:30.436 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:30.437 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:30.437 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:30.437 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:30.437 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:30.437 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87072 2024-04-19T03:03:30.437 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.437 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:30.437 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.437 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:30.437 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144224+0000", 2024-04-19T03:03:30.437 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:30.437 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.437 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.437 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:30.438 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144224+0000", 2024-04-19T03:03:30.438 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:30.438 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.438 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.438 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:30.438 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144223+0000", 2024-04-19T03:03:30.438 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:03:30.438 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.438 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.438 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:30.438 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144320+0000", 2024-04-19T03:03:30.438 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.7075000000000001e-05 2024-04-19T03:03:30.438 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.439 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.439 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:30.439 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144331+0000", 2024-04-19T03:03:30.439 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.1342000000000001e-05 2024-04-19T03:03:30.439 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.439 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.439 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:30.439 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144337+0000", 2024-04-19T03:03:30.439 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8390000000000003e-06 2024-04-19T03:03:30.439 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.439 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.439 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:30.439 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144369+0000", 2024-04-19T03:03:30.439 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2079000000000002e-05 2024-04-19T03:03:30.440 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.440 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.440 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:30.440 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144464+0000", 2024-04-19T03:03:30.440 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.4623000000000005e-05 2024-04-19T03:03:30.440 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.440 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.440 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 0", 2024-04-19T03:03:30.440 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.144553+0000", 2024-04-19T03:03:30.440 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.9171000000000004e-05 2024-04-19T03:03:30.440 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.440 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.440 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:03:30.440 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.147018+0000", 2024-04-19T03:03:30.441 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0024648370000000001 2024-04-19T03:03:30.441 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.441 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.441 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:30.441 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.202270+0000", 2024-04-19T03:03:30.441 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.055252018 2024-04-19T03:03:30.441 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.441 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.441 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:03:30.441 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.202356+0000", 2024-04-19T03:03:30.442 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6648000000000001e-05 2024-04-19T03:03:30.442 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.442 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.442 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:30.442 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.202403+0000", 2024-04-19T03:03:30.442 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6956999999999998e-05 2024-04-19T03:03:30.442 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:30.442 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:30.442 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:30.442 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.442 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.442 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87123 5.6 5:6d1bc3b9:::benchmark_data_smithi096_19531_object87122:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:03:30.442 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249233+0000", 2024-04-19T03:03:30.442 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 67.155148569000005, 2024-04-19T03:03:30.443 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0291700720000001, 2024-04-19T03:03:30.443 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:30.443 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-04-19T03:03:30.443 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:30.443 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:30.443 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:30.443 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87123 2024-04-19T03:03:30.443 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.443 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:30.443 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.443 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:30.443 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249233+0000", 2024-04-19T03:03:30.443 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:30.443 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.444 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.444 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:30.444 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249233+0000", 2024-04-19T03:03:30.444 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:30.444 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.444 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.444 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:30.444 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249231+0000", 2024-04-19T03:03:30.444 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999986 2024-04-19T03:03:30.444 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.444 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.444 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:30.444 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249285+0000", 2024-04-19T03:03:30.444 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4005000000000002e-05 2024-04-19T03:03:30.445 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.445 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.445 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:30.445 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249300+0000", 2024-04-19T03:03:30.445 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4715999999999999e-05 2024-04-19T03:03:30.445 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.445 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.445 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:30.445 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249307+0000", 2024-04-19T03:03:30.445 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8399999999999997e-06 2024-04-19T03:03:30.445 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.445 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.445 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:30.445 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249366+0000", 2024-04-19T03:03:30.446 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.9435999999999998e-05 2024-04-19T03:03:30.446 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.446 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.446 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op must wait for map", 2024-04-19T03:03:30.446 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249376+0000", 2024-04-19T03:03:30.446 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.4919999999999999e-06 2024-04-19T03:03:30.446 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.446 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.446 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:30.446 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263757+0000", 2024-04-19T03:03:30.446 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.014381461999999999 2024-04-19T03:03:30.446 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.446 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.446 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:03:30.447 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263875+0000", 2024-04-19T03:03:30.447 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.000117166 2024-04-19T03:03:30.447 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.447 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.447 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:30.447 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.277136+0000", 2024-04-19T03:03:30.447 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.013261207 2024-04-19T03:03:30.447 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.447 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.447 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:30.447 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.278403+0000", 2024-04-19T03:03:30.447 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001267106 2024-04-19T03:03:30.447 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:30.447 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:30.448 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:30.448 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.448 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.448 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87128 5.6 5:6905c420:::benchmark_data_smithi096_19531_object87127:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:03:30.448 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249323+0000", 2024-04-19T03:03:30.448 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 67.155057822000003, 2024-04-19T03:03:30.448 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0292813249999999, 2024-04-19T03:03:30.448 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:30.448 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-04-19T03:03:30.448 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:30.448 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:30.448 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:30.448 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87128 2024-04-19T03:03:30.448 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.448 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:30.449 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.449 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:30.449 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249323+0000", 2024-04-19T03:03:30.449 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:30.449 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.449 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.449 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:30.449 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249323+0000", 2024-04-19T03:03:30.449 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:30.449 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.449 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.449 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:30.449 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249323+0000", 2024-04-19T03:03:30.449 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:30.450 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.450 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.450 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:30.450 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249385+0000", 2024-04-19T03:03:30.450 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1711999999999995e-05 2024-04-19T03:03:30.450 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.450 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.450 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:30.450 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249398+0000", 2024-04-19T03:03:30.450 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3022e-05 2024-04-19T03:03:30.450 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.450 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.450 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:30.451 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249402+0000", 2024-04-19T03:03:30.451 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.4819999999999996e-06 2024-04-19T03:03:30.451 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.451 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.451 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:30.451 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249437+0000", 2024-04-19T03:03:30.451 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4702000000000001e-05 2024-04-19T03:03:30.451 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.451 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.451 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:03:30.451 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249442+0000", 2024-04-19T03:03:30.451 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8019999999999999e-06 2024-04-19T03:03:30.451 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.451 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.452 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:30.452 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263896+0000", 2024-04-19T03:03:30.452 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.014454679999999999 2024-04-19T03:03:30.452 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.452 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.452 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:03:30.452 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263900+0000", 2024-04-19T03:03:30.452 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9700000000000001e-06 2024-04-19T03:03:30.452 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.452 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.452 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:30.452 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.278557+0000", 2024-04-19T03:03:30.452 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0146566480000001 2024-04-19T03:03:30.452 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.453 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.453 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:30.453 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.278605+0000", 2024-04-19T03:03:30.453 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.7735999999999998e-05 2024-04-19T03:03:30.453 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:30.453 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:30.453 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:30.453 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.453 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.453 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87130 5.3 5:c8c2d67b:::benchmark_data_smithi096_19531_object87129:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:03:30.453 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249418+0000", 2024-04-19T03:03:30.453 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 67.154963111000001, 2024-04-19T03:03:30.453 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.025414182, 2024-04-19T03:03:30.453 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:30.454 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-04-19T03:03:30.454 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:30.454 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:30.454 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:30.454 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87130 2024-04-19T03:03:30.454 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.454 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:30.454 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.454 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:30.454 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249418+0000", 2024-04-19T03:03:30.454 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:30.454 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.454 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.454 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:30.455 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249418+0000", 2024-04-19T03:03:30.455 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:30.455 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.455 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.455 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:30.455 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249409+0000", 2024-04-19T03:03:30.455 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999905 2024-04-19T03:03:30.455 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.455 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.455 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:30.455 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249464+0000", 2024-04-19T03:03:30.455 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.5381999999999999e-05 2024-04-19T03:03:30.455 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.455 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.456 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:30.456 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249471+0000", 2024-04-19T03:03:30.456 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.2609999999999996e-06 2024-04-19T03:03:30.456 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.456 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.456 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:30.456 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249475+0000", 2024-04-19T03:03:30.456 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2839999999999998e-06 2024-04-19T03:03:30.456 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.456 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.456 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:30.456 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249535+0000", 2024-04-19T03:03:30.456 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.0545999999999999e-05 2024-04-19T03:03:30.456 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.457 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.457 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op must wait for map", 2024-04-19T03:03:30.457 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249540+0000", 2024-04-19T03:03:30.457 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.2859999999999999e-06 2024-04-19T03:03:30.457 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.457 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.457 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:30.457 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263450+0000", 2024-04-19T03:03:30.457 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.013909585 2024-04-19T03:03:30.457 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.457 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.457 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:03:30.457 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263458+0000", 2024-04-19T03:03:30.457 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8089999999999993e-06 2024-04-19T03:03:30.457 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.458 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.458 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:30.458 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.273193+0000", 2024-04-19T03:03:30.458 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0097351379999999 2024-04-19T03:03:30.458 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.458 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.458 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:30.458 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.274832+0000", 2024-04-19T03:03:30.458 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0016394789999999999 2024-04-19T03:03:30.458 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:30.458 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:30.458 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:30.458 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.458 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.459 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87131 5.1 5:83756d55:::benchmark_data_smithi096_19531_object87130:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:03:30.459 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249491+0000", 2024-04-19T03:03:30.459 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 67.154890464000005, 2024-04-19T03:03:30.459 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0191489520000001, 2024-04-19T03:03:30.459 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:30.459 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-04-19T03:03:30.459 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:30.459 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:30.459 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:30.459 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87131 2024-04-19T03:03:30.459 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.459 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:30.459 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.459 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:30.459 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249491+0000", 2024-04-19T03:03:30.460 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:30.460 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.460 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.460 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:30.460 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249491+0000", 2024-04-19T03:03:30.460 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:30.460 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.460 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.460 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:30.460 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249491+0000", 2024-04-19T03:03:30.460 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:30.460 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.460 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.460 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:30.461 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249530+0000", 2024-04-19T03:03:30.461 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.9589000000000003e-05 2024-04-19T03:03:30.461 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.461 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.461 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:30.461 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249544+0000", 2024-04-19T03:03:30.461 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.4158000000000001e-05 2024-04-19T03:03:30.461 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.461 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.461 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:30.461 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249549+0000", 2024-04-19T03:03:30.461 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.6809999999999997e-06 2024-04-19T03:03:30.461 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.461 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.461 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:30.462 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249592+0000", 2024-04-19T03:03:30.462 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3285999999999999e-05 2024-04-19T03:03:30.462 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.462 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.462 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op must wait for map", 2024-04-19T03:03:30.462 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249598+0000", 2024-04-19T03:03:30.462 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8329999999999999e-06 2024-04-19T03:03:30.462 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.462 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.462 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:30.462 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263331+0000", 2024-04-19T03:03:30.462 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.013733093 2024-04-19T03:03:30.462 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.463 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.463 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:03:30.463 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.263343+0000", 2024-04-19T03:03:30.463 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.189e-05 2024-04-19T03:03:30.463 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.463 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.463 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:30.463 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.268541+0000", 2024-04-19T03:03:30.463 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0051983440000001 2024-04-19T03:03:30.463 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.463 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.463 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:30.463 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.268640+0000", 2024-04-19T03:03:30.463 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.8387999999999994e-05 2024-04-19T03:03:30.464 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:30.464 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:30.464 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:30.464 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.464 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.464 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87132 5.c 5:3e18b732:::benchmark_data_smithi096_19531_object87131:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:03:30.464 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249558+0000", 2024-04-19T03:03:30.464 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 67.154823562999994, 2024-04-19T03:03:30.464 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0241198380000001, 2024-04-19T03:03:30.464 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:30.464 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-04-19T03:03:30.464 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:30.464 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:30.465 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:30.465 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87132 2024-04-19T03:03:30.465 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.465 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:30.465 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.465 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:30.465 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249558+0000", 2024-04-19T03:03:30.465 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:30.465 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.465 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.465 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:30.465 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249558+0000", 2024-04-19T03:03:30.465 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:30.465 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.466 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.466 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:30.466 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249557+0000", 2024-04-19T03:03:30.466 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:30.466 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.466 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.466 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:30.466 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249625+0000", 2024-04-19T03:03:30.466 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7200999999999996e-05 2024-04-19T03:03:30.466 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.466 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.466 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:30.466 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249646+0000", 2024-04-19T03:03:30.466 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1053e-05 2024-04-19T03:03:30.467 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.467 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.467 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:30.467 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249650+0000", 2024-04-19T03:03:30.467 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2719999999999999e-06 2024-04-19T03:03:30.467 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.467 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.467 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:30.467 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249686+0000", 2024-04-19T03:03:30.467 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.6430000000000002e-05 2024-04-19T03:03:30.467 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.467 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.467 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op must wait for map", 2024-04-19T03:03:30.467 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249690+0000", 2024-04-19T03:03:30.468 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.765e-06 2024-04-19T03:03:30.468 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.468 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.468 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:30.468 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261157+0000", 2024-04-19T03:03:30.468 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011467247999999999 2024-04-19T03:03:30.468 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.468 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.468 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:03:30.468 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261170+0000", 2024-04-19T03:03:30.468 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2833000000000001e-05 2024-04-19T03:03:30.468 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.468 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.469 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:30.469 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.272119+0000", 2024-04-19T03:03:30.469 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.010949313 2024-04-19T03:03:30.469 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.469 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.469 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:30.469 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.273678+0000", 2024-04-19T03:03:30.469 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0015581550000000001 2024-04-19T03:03:30.469 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:30.469 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:30.469 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:30.469 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.469 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.469 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87133 5.c 5:3f772a62:::benchmark_data_smithi096_19531_object87132:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:03:30.470 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249657+0000", 2024-04-19T03:03:30.470 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 67.154724184000003, 2024-04-19T03:03:30.470 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0242819409999999, 2024-04-19T03:03:30.470 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:30.470 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-04-19T03:03:30.470 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:30.470 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:30.470 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:30.470 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87133 2024-04-19T03:03:30.470 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.470 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:30.470 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.470 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:30.470 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249657+0000", 2024-04-19T03:03:30.471 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:30.471 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.471 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.471 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:30.471 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249657+0000", 2024-04-19T03:03:30.471 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:30.471 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.471 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.471 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:30.471 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249657+0000", 2024-04-19T03:03:30.471 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:30.471 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.471 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.471 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:30.471 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249690+0000", 2024-04-19T03:03:30.472 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.3343000000000002e-05 2024-04-19T03:03:30.472 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.472 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.472 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:30.472 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249695+0000", 2024-04-19T03:03:30.472 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8600000000000001e-06 2024-04-19T03:03:30.472 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.472 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.472 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:30.472 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249698+0000", 2024-04-19T03:03:30.472 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.1700000000000001e-06 2024-04-19T03:03:30.472 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.472 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.472 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:30.473 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249741+0000", 2024-04-19T03:03:30.473 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2849999999999998e-05 2024-04-19T03:03:30.473 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.473 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.473 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:03:30.473 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249746+0000", 2024-04-19T03:03:30.473 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1019999999999996e-06 2024-04-19T03:03:30.473 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.473 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.473 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:30.473 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261209+0000", 2024-04-19T03:03:30.473 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011462447000000001 2024-04-19T03:03:30.473 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.473 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.473 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:03:30.474 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261216+0000", 2024-04-19T03:03:30.474 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.8520000000000004e-06 2024-04-19T03:03:30.474 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.474 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.474 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:30.474 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.273872+0000", 2024-04-19T03:03:30.474 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0126558000000001 2024-04-19T03:03:30.474 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.474 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.474 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:30.474 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.273939+0000", 2024-04-19T03:03:30.474 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.6822000000000005e-05 2024-04-19T03:03:30.475 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:30.475 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:30.475 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:30.475 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.475 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.475 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87134 5.5 5:a56c478f:::benchmark_data_smithi096_19531_object87133:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:03:30.475 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249708+0000", 2024-04-19T03:03:30.475 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 67.154673259999996, 2024-04-19T03:03:30.475 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.0214677299999999, 2024-04-19T03:03:30.475 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:30.475 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "reached pg", 2024-04-19T03:03:30.475 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:30.475 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:30.475 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:30.476 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87134 2024-04-19T03:03:30.476 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.476 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:30.476 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.476 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:30.476 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249708+0000", 2024-04-19T03:03:30.476 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:30.476 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.476 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.476 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:30.476 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249708+0000", 2024-04-19T03:03:30.476 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:30.476 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.477 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.477 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:30.477 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249706+0000", 2024-04-19T03:03:30.477 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999976 2024-04-19T03:03:30.477 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.477 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.477 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:30.477 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249740+0000", 2024-04-19T03:03:30.477 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4458000000000001e-05 2024-04-19T03:03:30.477 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.477 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.477 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:30.477 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249745+0000", 2024-04-19T03:03:30.478 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.5020000000000003e-06 2024-04-19T03:03:30.478 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.478 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.478 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:30.478 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249748+0000", 2024-04-19T03:03:30.478 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2499999999999998e-06 2024-04-19T03:03:30.478 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.478 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.478 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:30.478 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249778+0000", 2024-04-19T03:03:30.478 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.006e-05 2024-04-19T03:03:30.478 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.478 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.478 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op must wait for map", 2024-04-19T03:03:30.479 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249782+0000", 2024-04-19T03:03:30.479 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.2910000000000001e-06 2024-04-19T03:03:30.479 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.479 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.479 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:30.479 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261666+0000", 2024-04-19T03:03:30.479 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011883471 2024-04-19T03:03:30.479 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.479 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.479 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:03:30.479 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261674+0000", 2024-04-19T03:03:30.479 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.6479999999999992e-06 2024-04-19T03:03:30.479 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.480 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.480 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:30.480 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.269323+0000", 2024-04-19T03:03:30.480 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.00764867 2024-04-19T03:03:30.480 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.480 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.480 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:30.480 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.271176+0000", 2024-04-19T03:03:30.480 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001852844 2024-04-19T03:03:30.480 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:30.480 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:30.480 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:30.480 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.480 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.481 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:87137 5.c 5:30708c68:::benchmark_data_smithi096_19531_object87136:head [set-alloc-hint object_size 65536 write_size 65536,write 0~65536] snapc 0=[] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", 2024-04-19T03:03:30.481 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:23.249756+0000", 2024-04-19T03:03:30.481 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 67.154625554000006, 2024-04-19T03:03:30.481 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.033331752, 2024-04-19T03:03:30.481 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:30.481 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:30.481 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:30.481 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:30.481 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:30.481 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 87137 2024-04-19T03:03:30.481 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.481 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:30.481 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.481 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:30.481 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249756+0000", 2024-04-19T03:03:30.482 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:30.482 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.482 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.482 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:30.482 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249756+0000", 2024-04-19T03:03:30.482 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:30.482 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.482 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.482 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:30.482 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249755+0000", 2024-04-19T03:03:30.482 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:30.482 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.482 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.483 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:30.483 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249777+0000", 2024-04-19T03:03:30.483 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 2.1420000000000002e-05 2024-04-19T03:03:30.483 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.483 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.483 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:30.483 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249781+0000", 2024-04-19T03:03:30.483 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.0609999999999997e-06 2024-04-19T03:03:30.483 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.483 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.483 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:30.483 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249787+0000", 2024-04-19T03:03:30.483 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.02e-06 2024-04-19T03:03:30.483 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.484 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.484 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:30.484 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249818+0000", 2024-04-19T03:03:30.484 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0947e-05 2024-04-19T03:03:30.484 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.484 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.484 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting_for_map not empty", 2024-04-19T03:03:30.484 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.249821+0000", 2024-04-19T03:03:30.484 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.117e-06 2024-04-19T03:03:30.484 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.484 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.484 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:30.484 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261243+0000", 2024-04-19T03:03:30.484 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.011421875999999999 2024-04-19T03:03:30.485 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.485 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.485 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for peered", 2024-04-19T03:03:30.485 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:23.261251+0000", 2024-04-19T03:03:30.485 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6120000000000001e-06 2024-04-19T03:03:30.485 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.485 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.485 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:30.485 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.274050+0000", 2024-04-19T03:03:30.485 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.012799405 2024-04-19T03:03:30.485 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.485 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.485 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:30.486 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.274529+0000", 2024-04-19T03:03:30.486 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00047867100000000001 2024-04-19T03:03:30.486 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.486 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.486 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:03:30.486 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.282972+0000", 2024-04-19T03:03:30.486 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0084436900000000002 2024-04-19T03:03:30.486 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.486 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.486 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:03:30.486 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.283022+0000", 2024-04-19T03:03:30.487 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9339000000000003e-05 2024-04-19T03:03:30.487 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.487 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.487 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:30.487 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:24.283088+0000", 2024-04-19T03:03:30.487 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.5877999999999995e-05 2024-04-19T03:03:30.487 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:30.487 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:30.487 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:30.487 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.487 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.487 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:158376 5.9 5:9e73c076:::benchmark_data_smithi096_19531_object44926:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-19T03:03:30.487 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:58.126227+0000", 2024-04-19T03:03:30.488 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 32.278153820999997, 2024-04-19T03:03:30.488 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.069738668000000004, 2024-04-19T03:03:30.488 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:30.488 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:30.488 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:30.488 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:30.488 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:30.488 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 158376 2024-04-19T03:03:30.488 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.488 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:30.488 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.488 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:30.488 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.126227+0000", 2024-04-19T03:03:30.489 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:30.489 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.489 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.489 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:30.489 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.126227+0000", 2024-04-19T03:03:30.489 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:30.489 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.489 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.489 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:30.489 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.126226+0000", 2024-04-19T03:03:30.489 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:03:30.489 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.489 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.489 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:30.490 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.126236+0000", 2024-04-19T03:03:30.490 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.4199999999999996e-06 2024-04-19T03:03:30.490 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.490 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.490 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:30.490 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.126243+0000", 2024-04-19T03:03:30.490 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.199e-06 2024-04-19T03:03:30.490 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.490 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.490 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:30.490 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.126248+0000", 2024-04-19T03:03:30.490 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.1320000000000002e-06 2024-04-19T03:03:30.490 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.490 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.493 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:30.494 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.126286+0000", 2024-04-19T03:03:30.494 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.7401000000000003e-05 2024-04-19T03:03:30.494 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.494 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.494 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:30.494 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.126368+0000", 2024-04-19T03:03:30.494 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.2113999999999993e-05 2024-04-19T03:03:30.494 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.494 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.494 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:03:30.494 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.126438+0000", 2024-04-19T03:03:30.495 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.0337000000000001e-05 2024-04-19T03:03:30.495 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.495 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.495 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:03:30.495 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.130816+0000", 2024-04-19T03:03:30.495 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0043778330000000002 2024-04-19T03:03:30.495 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.495 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.495 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:30.495 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.195830+0000", 2024-04-19T03:03:30.495 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.065013933999999995 2024-04-19T03:03:30.495 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.495 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.495 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:03:30.496 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.195907+0000", 2024-04-19T03:03:30.496 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.7397000000000005e-05 2024-04-19T03:03:30.496 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.496 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.496 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:30.496 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.195966+0000", 2024-04-19T03:03:30.496 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8906999999999997e-05 2024-04-19T03:03:30.496 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:30.496 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:30.496 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:30.496 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.496 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.496 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:158381 5.9 5:94dcd4a7:::benchmark_data_smithi096_19531_object44931:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-19T03:03:30.496 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:58.128712+0000", 2024-04-19T03:03:30.497 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 32.275669378000003, 2024-04-19T03:03:30.497 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.067497527000000002, 2024-04-19T03:03:30.497 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:30.497 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:30.497 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:30.497 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:30.497 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:30.497 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 158381 2024-04-19T03:03:30.497 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.497 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:30.497 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.497 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:30.497 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.128712+0000", 2024-04-19T03:03:30.497 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:30.498 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.498 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.498 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:30.498 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.128712+0000", 2024-04-19T03:03:30.498 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:30.498 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.498 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.498 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:30.498 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.128711+0000", 2024-04-19T03:03:30.498 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:03:30.498 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.498 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.498 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:30.498 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.128716+0000", 2024-04-19T03:03:30.499 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0610000000000003e-06 2024-04-19T03:03:30.499 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.499 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.499 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:30.499 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.128724+0000", 2024-04-19T03:03:30.499 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0120000000000005e-06 2024-04-19T03:03:30.499 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.499 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.499 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:30.499 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.128729+0000", 2024-04-19T03:03:30.499 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.8899999999999998e-06 2024-04-19T03:03:30.499 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.499 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.499 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:30.500 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.128778+0000", 2024-04-19T03:03:30.500 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9110000000000002e-05 2024-04-19T03:03:30.500 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.500 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.500 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:30.500 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.128903+0000", 2024-04-19T03:03:30.500 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00012506799999999999 2024-04-19T03:03:30.500 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.500 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.500 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:03:30.500 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.129022+0000", 2024-04-19T03:03:30.500 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00011923599999999999 2024-04-19T03:03:30.500 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.500 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.501 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:03:30.501 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.132294+0000", 2024-04-19T03:03:30.501 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.003271244 2024-04-19T03:03:30.501 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.501 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.501 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:30.501 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.196045+0000", 2024-04-19T03:03:30.501 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.063751206000000005 2024-04-19T03:03:30.501 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.501 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.501 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:03:30.501 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.196133+0000", 2024-04-19T03:03:30.501 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.8213000000000004e-05 2024-04-19T03:03:30.501 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.502 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.502 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:30.502 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.196209+0000", 2024-04-19T03:03:30.502 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.6335999999999996e-05 2024-04-19T03:03:30.502 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:30.502 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:30.502 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:30.502 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.502 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.502 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:158385 5.9 5:950ec749:::benchmark_data_smithi096_19531_object44935:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-19T03:03:30.502 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:58.129756+0000", 2024-04-19T03:03:30.502 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 32.274625446000002, 2024-04-19T03:03:30.502 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.068998382999999996, 2024-04-19T03:03:30.503 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:30.503 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:30.503 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:30.503 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:30.503 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:30.503 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 158385 2024-04-19T03:03:30.503 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.503 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:30.503 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.503 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:30.503 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.129756+0000", 2024-04-19T03:03:30.503 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:30.503 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.503 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.504 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:30.504 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.129756+0000", 2024-04-19T03:03:30.504 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:30.504 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.504 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.504 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:30.504 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.129755+0000", 2024-04-19T03:03:30.504 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:03:30.504 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.504 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.504 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:30.504 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.129760+0000", 2024-04-19T03:03:30.504 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6030000000000004e-06 2024-04-19T03:03:30.505 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.505 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.505 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:30.505 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.129774+0000", 2024-04-19T03:03:30.505 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.3131e-05 2024-04-19T03:03:30.505 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.505 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.505 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:30.505 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.129781+0000", 2024-04-19T03:03:30.505 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.4030000000000001e-06 2024-04-19T03:03:30.505 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.505 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.505 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:30.505 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.130837+0000", 2024-04-19T03:03:30.506 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00105569 2024-04-19T03:03:30.506 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.506 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.506 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:30.506 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.130917+0000", 2024-04-19T03:03:30.506 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 7.9929e-05 2024-04-19T03:03:30.506 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.506 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.506 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:03:30.506 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.130973+0000", 2024-04-19T03:03:30.507 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.664e-05 2024-04-19T03:03:30.507 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.507 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.507 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:03:30.507 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.132340+0000", 2024-04-19T03:03:30.507 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.001366321 2024-04-19T03:03:30.507 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.507 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.507 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:30.507 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.198637+0000", 2024-04-19T03:03:30.507 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.066296888999999998 2024-04-19T03:03:30.507 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.507 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.507 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:03:30.508 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.198704+0000", 2024-04-19T03:03:30.508 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.7333000000000001e-05 2024-04-19T03:03:30.508 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.508 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.508 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:30.508 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.198754+0000", 2024-04-19T03:03:30.508 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0421999999999999e-05 2024-04-19T03:03:30.508 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:30.508 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:30.508 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:30.508 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.508 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.508 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:158387 5.9 5:9e96f619:::benchmark_data_smithi096_19531_object44937:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-19T03:03:30.508 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:58.132457+0000", 2024-04-19T03:03:30.509 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 32.271923882000003, 2024-04-19T03:03:30.509 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.066858091999999994, 2024-04-19T03:03:30.509 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:30.509 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:30.509 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:30.509 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:30.509 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:30.509 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 158387 2024-04-19T03:03:30.509 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.509 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:30.509 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.509 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:30.509 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.132457+0000", 2024-04-19T03:03:30.510 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:30.510 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.510 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.510 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:30.510 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.132457+0000", 2024-04-19T03:03:30.510 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:30.510 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.510 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.510 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:30.510 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.132457+0000", 2024-04-19T03:03:30.511 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999995 2024-04-19T03:03:30.511 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.511 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.511 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:30.511 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.132460+0000", 2024-04-19T03:03:30.511 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.1949999999999999e-06 2024-04-19T03:03:30.511 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.511 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.511 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:30.511 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.132468+0000", 2024-04-19T03:03:30.511 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.1599999999999998e-06 2024-04-19T03:03:30.511 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.511 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.511 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:30.512 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.132473+0000", 2024-04-19T03:03:30.512 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.9259999999999999e-06 2024-04-19T03:03:30.512 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.512 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.512 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:30.512 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.132504+0000", 2024-04-19T03:03:30.512 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.0914000000000003e-05 2024-04-19T03:03:30.512 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.512 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.512 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:30.512 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.132646+0000", 2024-04-19T03:03:30.512 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00014214300000000001 2024-04-19T03:03:30.512 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.512 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.513 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:03:30.513 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.132741+0000", 2024-04-19T03:03:30.513 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.4344000000000003e-05 2024-04-19T03:03:30.513 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.513 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.513 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:03:30.513 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.135774+0000", 2024-04-19T03:03:30.513 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0030334960000000001 2024-04-19T03:03:30.513 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.513 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.513 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:30.513 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.199240+0000", 2024-04-19T03:03:30.513 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.063465695000000003 2024-04-19T03:03:30.513 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.514 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.514 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:03:30.514 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.199272+0000", 2024-04-19T03:03:30.514 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.2412000000000001e-05 2024-04-19T03:03:30.514 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.514 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.514 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:30.514 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.199316+0000", 2024-04-19T03:03:30.514 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.3275000000000002e-05 2024-04-19T03:03:30.514 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:30.514 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:30.514 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:30.514 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.514 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.515 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:158392 5.f 5:f462725f:::benchmark_data_smithi096_19531_object44942:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-19T03:03:30.515 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:58.135703+0000", 2024-04-19T03:03:30.515 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 32.268678102000003, 2024-04-19T03:03:30.515 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.063132879000000003, 2024-04-19T03:03:30.515 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:30.515 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:30.515 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:30.515 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:30.515 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:30.515 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 158392 2024-04-19T03:03:30.515 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.515 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:30.515 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.515 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:30.516 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.135703+0000", 2024-04-19T03:03:30.516 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:30.516 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.516 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.516 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:30.516 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.135703+0000", 2024-04-19T03:03:30.516 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:30.516 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.516 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.516 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:30.516 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.135702+0000", 2024-04-19T03:03:30.516 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.999999 2024-04-19T03:03:30.516 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.517 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.517 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:30.517 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.135708+0000", 2024-04-19T03:03:30.517 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.8270000000000003e-06 2024-04-19T03:03:30.517 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.517 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.517 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:30.517 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.135720+0000", 2024-04-19T03:03:30.517 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 1.2057e-05 2024-04-19T03:03:30.517 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.517 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.517 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:30.517 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.135727+0000", 2024-04-19T03:03:30.518 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8090000000000004e-06 2024-04-19T03:03:30.518 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.518 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.518 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:30.518 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.135768+0000", 2024-04-19T03:03:30.518 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4.1548999999999998e-05 2024-04-19T03:03:30.518 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.518 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.518 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:30.518 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.135853+0000", 2024-04-19T03:03:30.518 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.4845000000000005e-05 2024-04-19T03:03:30.518 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.518 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.518 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:03:30.519 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.135934+0000", 2024-04-19T03:03:30.519 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 8.0315000000000006e-05 2024-04-19T03:03:30.519 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.519 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.519 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:03:30.519 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.138685+0000", 2024-04-19T03:03:30.519 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.002751042 2024-04-19T03:03:30.519 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.519 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.519 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:30.519 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.198747+0000", 2024-04-19T03:03:30.519 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.060062675000000003 2024-04-19T03:03:30.519 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.519 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.520 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:03:30.520 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.198802+0000", 2024-04-19T03:03:30.520 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.4469000000000003e-05 2024-04-19T03:03:30.520 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.520 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.520 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:30.520 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.198836+0000", 2024-04-19T03:03:30.520 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 3.4272e-05 2024-04-19T03:03:30.520 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:30.520 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:30.520 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:30.520 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.520 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.520 INFO:teuthology.orchestra.run.smithi144.stdout: "description": "osd_op(client.4755.0:158397 5.d 5:b5d962e9:::benchmark_data_smithi096_19531_object44947:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2024-04-19T03:03:30.521 INFO:teuthology.orchestra.run.smithi144.stdout: "initiated_at": "2024-04-19T03:02:58.138717+0000", 2024-04-19T03:03:30.521 INFO:teuthology.orchestra.run.smithi144.stdout: "age": 32.265664159000004, 2024-04-19T03:03:30.521 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.057191467000000003, 2024-04-19T03:03:30.521 INFO:teuthology.orchestra.run.smithi144.stdout: "type_data": { 2024-04-19T03:03:30.521 INFO:teuthology.orchestra.run.smithi144.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-19T03:03:30.521 INFO:teuthology.orchestra.run.smithi144.stdout: "client_info": { 2024-04-19T03:03:30.521 INFO:teuthology.orchestra.run.smithi144.stdout: "client": "client.4755", 2024-04-19T03:03:30.521 INFO:teuthology.orchestra.run.smithi144.stdout: "client_addr": "172.21.15.96:0/3026695898", 2024-04-19T03:03:30.521 INFO:teuthology.orchestra.run.smithi144.stdout: "tid": 158397 2024-04-19T03:03:30.521 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.521 INFO:teuthology.orchestra.run.smithi144.stdout: "events": [ 2024-04-19T03:03:30.521 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.521 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "initiated", 2024-04-19T03:03:30.522 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.138717+0000", 2024-04-19T03:03:30.522 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:30.522 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.522 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.522 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "throttled", 2024-04-19T03:03:30.522 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.138717+0000", 2024-04-19T03:03:30.522 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0 2024-04-19T03:03:30.522 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.522 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.522 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "header_read", 2024-04-19T03:03:30.522 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.138716+0000", 2024-04-19T03:03:30.522 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 4294967295.9999986 2024-04-19T03:03:30.522 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.522 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.523 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "all_read", 2024-04-19T03:03:30.523 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.138722+0000", 2024-04-19T03:03:30.523 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.1709999999999999e-06 2024-04-19T03:03:30.523 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.523 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.523 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "dispatched", 2024-04-19T03:03:30.523 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.138731+0000", 2024-04-19T03:03:30.523 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 9.0310000000000004e-06 2024-04-19T03:03:30.523 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.523 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.523 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "queued_for_pg", 2024-04-19T03:03:30.523 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.138738+0000", 2024-04-19T03:03:30.523 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8430000000000004e-06 2024-04-19T03:03:30.523 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.524 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.524 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "reached_pg", 2024-04-19T03:03:30.524 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.138789+0000", 2024-04-19T03:03:30.524 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.0623e-05 2024-04-19T03:03:30.524 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.524 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.524 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "started", 2024-04-19T03:03:30.524 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.138945+0000", 2024-04-19T03:03:30.524 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00015671899999999999 2024-04-19T03:03:30.524 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.524 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.524 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "waiting for subops from 1", 2024-04-19T03:03:30.524 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.139079+0000", 2024-04-19T03:03:30.524 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.00013380099999999999 2024-04-19T03:03:30.524 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.525 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.525 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "op_commit", 2024-04-19T03:03:30.525 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.141715+0000", 2024-04-19T03:03:30.525 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.0026362849999999999 2024-04-19T03:03:30.525 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.525 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.525 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "sub_op_commit_rec", 2024-04-19T03:03:30.525 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.195784+0000", 2024-04-19T03:03:30.525 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 0.054068353 2024-04-19T03:03:30.525 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.525 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.525 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "commit_sent", 2024-04-19T03:03:30.525 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.195852+0000", 2024-04-19T03:03:30.525 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 6.8121999999999996e-05 2024-04-19T03:03:30.526 INFO:teuthology.orchestra.run.smithi144.stdout: }, 2024-04-19T03:03:30.526 INFO:teuthology.orchestra.run.smithi144.stdout: { 2024-04-19T03:03:30.526 INFO:teuthology.orchestra.run.smithi144.stdout: "event": "done", 2024-04-19T03:03:30.526 INFO:teuthology.orchestra.run.smithi144.stdout: "time": "2024-04-19T03:02:58.195909+0000", 2024-04-19T03:03:30.526 INFO:teuthology.orchestra.run.smithi144.stdout: "duration": 5.6737999999999998e-05 2024-04-19T03:03:30.526 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:30.526 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:30.526 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:30.526 INFO:teuthology.orchestra.run.smithi144.stdout: } 2024-04-19T03:03:30.526 INFO:teuthology.orchestra.run.smithi144.stdout: ] 2024-04-19T03:03:30.526 INFO:teuthology.orchestra.run.smithi144.stdout:} 2024-04-19T03:03:30.528 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1: {} 2024-04-19T03:03:30.528 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2: {} 2024-04-19T03:03:30.528 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-04-19T03:03:30.529 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-19T03:03:30.529 INFO:teuthology.orchestra.run.smithi096.stderr:Error ENXIO: problem getting command descriptions from osd.0 2024-04-19T03:03:30.529 INFO:teuthology.orchestra.run.smithi096.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-19T03:03:30.530 INFO:teuthology.orchestra.run.smithi096.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-19T03:03:30.530 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2024-04-19T03:03:30.530 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:03:30.526+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:03:30.628 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:03:30.626+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:03:30.646 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-19T03:03:30.646 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:03:30.657 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-19T03:03:30.730 INFO:tasks.ceph.osd.1.smithi134.stderr:2024-04-19T03:03:30.726+0000 7fd8b1afe700 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 18143) UID: 0 2024-04-19T03:03:30.744 INFO:teuthology.orchestra.run.smithi096.stderr:noscrub is unset 2024-04-19T03:03:30.744 INFO:teuthology.orchestra.run.smithi096.stderr:pool 'unique_pool_0' removed 2024-04-19T03:03:30.756 DEBUG:teuthology.run_tasks:Unwinding manager thrashosds 2024-04-19T03:03:30.766 INFO:tasks.thrashosds:joining thrashosds 2024-04-19T03:03:30.840 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-19T03:03:30.840 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:03:30.852 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-19T03:03:30.956 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2024-04-19T03:03:30.956 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:03:30.965 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-19T03:03:31.083 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-04-19T03:03:31.084 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:03:31.093 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-19T03:03:31.204 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-04-19T03:03:31.204 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:03:31.214 DEBUG:teuthology.orchestra.run.smithi144:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-19T03:03:31.319 INFO:teuthology.orchestra.run.smithi144.stdout:ERROR: (22) Invalid argument 2024-04-19T03:03:31.320 INFO:teuthology.orchestra.run.smithi144.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-19T03:03:32.768 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-19T03:03:33.747 INFO:teuthology.orchestra.run.smithi096.stderr:noscrub is unset 2024-04-19T03:03:33.760 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-19T03:03:33.909 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~65s 2024-04-19T03:03:34.761 INFO:teuthology.orchestra.run.smithi096.stderr:nodeep-scrub is unset 2024-04-19T03:03:39.720 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~71s 2024-04-19T03:03:45.527 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~76s 2024-04-19T03:03:51.335 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~82s 2024-04-19T03:03:57.145 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~88s 2024-04-19T03:04:02.953 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~94s 2024-04-19T03:04:08.759 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~100s 2024-04-19T03:04:14.567 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~105s 2024-04-19T03:04:20.373 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~111s 2024-04-19T03:04:26.181 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~117s 2024-04-19T03:04:31.989 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~123s 2024-04-19T03:04:35.247 DEBUG:teuthology.orchestra.console.smithi097:expect before: [Enter `^Ec?' for help] \x80 \x80 \x80  t XE v2.1.60 PXE 2.1 Build 088 (WfM 2.0)  Press Ctrl+S to enter the Setup Menu.                      Initializing Intel(R) Boot Agent XE v2.1.60 Press Ctrl+S to enter the Setup Menu..  \x80 \x80 Initializing Intel(R) Boot Agent XE v2.1.60 PXE 2.1 Build 088 (WfM 2.0)  Press Ctrl+S to enter the Setup Menu.                      Press Ctrl+S to enter the Setup Menu..  \x80 \x80  el(R) Boot A t GE v1.5.13 PXE 2.1 Build 092 (WfM 2.0) Press Ctrl+S to enter the Setup Menu.                       Initializing Intel(R) Boot Agent GE v1.5.13 Press Ctrl+S to enter the Setup Menu..  \x80 \x80 \x80 \x80  Intel(R) Boot Agent XE v2.1.60 Copyright (C) 1997-2009, Intel Corporation  CLIENT MAC ADDR: 0C C4 7A 8F D8 05 GUID: 00000000 0000 0000 0000 0CC47AD8A20E DHCP.-                    DHCP.| DHCP./ DHCP.- DHCP.\ DHCP.| DHCP./  21.15.97 MAS 255.255.240.0 DHCP IP: 172.21.0.10 GATEWAY IP: 172.21.15.254 PXE->EB: !PXE at 96D3:0070, entry point at 96D3:0106  UNDI code segment 96D3:3E70, data segment 8F94:73F0 (574-619kB)  UNDI device is PCI 03:00.1, type DIX+802.3  574kB free base memory after PXE unload iPXE initialising devices... CLIENT IP: 172.21.15.97 MASK: 255.255.240.0 DHCP IP: 172.21.0.10 iPXE initialising devices...ok iPXE 1.20.1+ (g4bd0) -- Open Source Network Boot Firmware -- http://ipxe.org Features: DNS FTP HTTP HTTPS iSCSI NFS TFTP VLAN AoE ELF MBOOT PXE bzImage Menu PXEXT Configuring (net0 0c:c4:7a:8f:d8:05)... Configuring (net0 0c:c4:7a:8f:d8:05).... Configuring (net0 0c:c4:7a:8f:d8:05)..... Configuring (net0 0c:c4:7a:8f:d8:05)...... ok  GNU GRUB version 2.04   ******************************************************************************  * Ubuntu *  **Advanced options for Ubuntu *  * *  * *  * *  * *  * *  * *  * *  * *  * *  * *  * *  ******************************************************************************   Use the * and * keys to select which entry is highlighted.  Press enter to boot the selected OS, `e' to edit the commands  before booting or `c' for a command-line.  The highlighted entry will be executed automatically in 4s.  The highlighted entry will be executed automatically in 3s.  The highlighted entry will be executed automatically in 2s.  The highlighted entry will be executed automatically in 1s.                     [ 0.000000] microcode: microcode updated early to revision 0xb000040, date = 2021-05-19 [ 0.000000] Linux version 5.4.0-177-generic (buildd@lcy02-amd64-112) (gcc version 9.4.0 (Ubuntu 9.4.0-1ubuntu1~20.04.2)) #197-Ubuntu SMP Thu Mar 28 22:45:47 UTC 2024 (Ubuntu 5.4.0-177.197-generic 5.4.268) [ 0.000000] Command line: BOOT_IMAGE=/boot/vmlinuz-5.4.0-177-generic root=UUID=1168b92c-82ac-47e1-87d9-5d77414c7738 ro pci=realloc=off console=tty0 console=ttyS1,115200 [ 0.000000] KERNEL supported cpus: [ 0.000000] Intel GenuineIntel [ 0.000000] AMD AuthenticAMD [ 0.000000] Hygon HygonGenuine [ 0.000000] Centaur CentaurHauls [ 0.000000] zhaoxin Shanghai [ 0.000000] BIOS-provided physical RAM map: [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000008bbff] usable [ 0.000000] BIOS-e820: [mem 0x00000000000e0000-0x00000000000fffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x0000000078ec1fff] usable [ 0.000000] BIOS-e820: [mem 0x0000000078f74000-0x00000000798adfff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000798ae000-0x0000000079d4afff] ACPI NVS [ 0.000000] BIOS-e820: [mem 0x0000000079d4b000-0x000000008fffffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed44fff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000ff000000-0x00000000ffffffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x000000087fffffff] usable [ 0.000000] NX (Execute Disable) protection: active [ 0.000000] SMBIOS 3.0 present. [ 0.000000] DMI: Supermicro SYS-5018R-WR/X10SRW-F, BIOS 2.0 12/17/2015 [ 0.000000] tsc: Fast TSC calibration using PIT [ 0.000000] tsc: Detected 3499.945 MHz processor [ 0.001009] last_pfn = 0x880000 max_arch_pfn = 0x400000000 [ 0.001442] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT [ 0.001979] last_pfn = 0x78ec2 max_arch_pfn = 0x400000000 [ 0.007586] found SMP MP-table at [mem 0x000fda20-0x000fda2f] [ 0.007629] check: Scanning 1 areas for low memory corruption [ 0.007633] Using GB pages for direct mapping [ 0.007728] RAMDISK: [mem 0x3157d000-0x34ab5fff] [ 0.007733] ACPI: Early table checksum verification disabled [ 0.007736] ACPI: RSDP 0x00000000000F0580 000024 (v02 SUPERM) [ 0.007738] ACPI: XSDT 0x00000000798AE098 0000B4 (v01 01072009 AMI 00010013) [ 0.007742] ACPI: FACP 0x00000000798E15B0 00010C (v05 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.007746] ACPI: DSDT 0x00000000798AE1E8 0333C4 (v02 SUPERM SMCI--MB 01072009 INTL 20091013) [ 0.007748] ACPI: FACS 0x0000000079D49F80 000040 [ 0.007750] ACPI: APIC 0x00000000798E16C0 0000C8 (v03 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.007752] ACPI: FPDT 0x00000000798E1788 000044 (v01 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.007754] ACPI: FIDT 0x00000000798E17D0 00009C (v01 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.007756] ACPI: SPMI 0x00000000798E1870 000040 (v05 SUPERM SMCI--MB 00000000 AMI. 00000000) [ 0.007758] ACPI: MCFG 0x00000000798E18B0 00003C (v01 SUPERM SMCI--MB 01072009 MSFT 00000097) [ 0.007760] ACPI: UEFI 0x00000000798E18F0 000042 (v01 SUPERM SMCI--MB 01072009 00000000) [ 0.007762] ACPI: HPET 0x00000000798E1938 000038 (v01 SUPERM SMCI--MB 00000001 INTL 20091013) [ 0.007764] ACPI: WDDT 0x00000000798E1970 000040 (v01 SUPERM SMCI--MB 00000000 INTL 20091013) [ 0.007766] ACPI: SSDT 0x00000000798E19B0 01717F (v02 SUPERM PmMgt 00000001 INTL 20120913) [ 0.007768] ACPI: SSDT 0x00000000798F8B30 00264C (v02 SUPERM SpsNm 00000002 INTL 20120913) [ 0.007770] ACPI: SSDT 0x00000000798FB180 000064 (v02 SUPERM SpsNvs 00000002 INTL 20120913) [ 0.007772] ACPI: PRAD 0x00000000798FB1E8 000102 (v02 SUPERM SMCI--MB 00000002 INTL 20120913) [ 0.007774] ACPI: DMAR 0x00000000798FB2F0 0000BC (v01 SUPERM SMCI--MB 00000001 INTL 20091013) [ 0.007776] ACPI: HEST 0x00000000798FB3B0 00027C (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.007778] ACPI: BERT 0x00000000798FB630 000030 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.007780] ACPI: ERST 0x00000000798FB660 000230 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.007781] ACPI: EINJ 0x00000000798FB890 000130 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.007783] ACPI: Reserving FACP table memory at [mem 0x798e15b0-0x798e16bb] [ 0.007784] ACPI: Reserving DSDT table memory at [mem 0x798ae1e8-0x798e15ab] [ 0.007785] ACPI: Reserving FACS table memory at [mem 0x79d49f80-0x79d49fbf] [ 0.007786] ACPI: Reserving APIC table memory at [mem 0x798e16c0-0x798e1787] [ 0.007786] ACPI: Reserving FPDT table memory at [mem 0x798e1788-0x798e17cb] [ 0.007787] ACPI: Reserving FIDT table memory at [mem 0x798e17d0-0x798e186b] [ 0.007788] ACPI: Reserving SPMI table memory at [mem 0x798e1870-0x798e18af] [ 0.007788] ACPI: Reserving MCFG table memory at [mem 0x798e18b0-0x798e18eb] [ 0.007789] ACPI: Reserving UEFI table memory at [mem 0x798e18f0-0x798e1931] [ 0.007790] ACPI: Reserving HPET table memory at [mem 0x798e1938-0x798e196f] [ 0.007790] ACPI: Reserving WDDT table memory at [mem 0x798e1970-0x798e19af] [ 0.007791] ACPI: Reserving SSDT table memory at [mem 0x798e19b0-0x798f8b2e] [ 0.007792] ACPI: Reserving SSDT table memory at [mem 0x798f8b30-0x798fb17b] [ 0.007792] ACPI: Reserving SSDT table memory at [mem 0x798fb180-0x798fb1e3] [ 0.007793] ACPI: Reserving PRAD table memory at [mem 0x798fb1e8-0x798fb2e9] [ 0.007794] ACPI: Reserving DMAR table memory at [mem 0x798fb2f0-0x798fb3ab] [ 0.007794] ACPI: Reserving HEST table memory at [mem 0x798fb3b0-0x798fb62b] [ 0.007795] ACPI: Reserving BERT table memory at [mem 0x798fb630-0x798fb65f] [ 0.007796] ACPI: Reserving ERST table memory at [mem 0x798fb660-0x798fb88f] [ 0.007796] ACPI: Reserving EINJ table memory at [mem 0x798fb890-0x798fb9bf] [ 0.007867] No NUMA configuration found [ 0.007868] Faking a node at [mem 0x0000000000000000-0x000000087fffffff] [ 0.007876] NODE_DATA(0) allocated [mem 0x87ffd5000-0x87fffffff] [ 0.008046] Zone ranges: [ 0.008047] DMA [mem 0x0000000000001000-0x0000000000ffffff] [ 0.008048] DMA32 [mem 0x0000000001000000-0x00000000ffffffff] [ 0.008048] Normal [mem 0x0000000100000000-0x000000087fffffff] [ 0.008049] Device empty [ 0.008050] Movable zone start for each node [ 0.008053] Early memory node ranges [ 0.008054] node 0: [mem 0x0000000000001000-0x000000000008afff] [ 0.008054] node 0: [mem 0x0000000000100000-0x0000000078ec1fff] [ 0.008055] node 0: [mem 0x0000000100000000-0x000000087fffffff] [ 0.008287] Zeroed struct page in unavailable ranges: 29108 pages [ 0.008287] Initmem setup node 0 [mem 0x0000000000001000-0x000000087fffffff] [ 0.083827] ACPI: PM-Timer IO Port: 0x408 [ 0.083835] ACPI: LAPIC_NMI (acpi_id[0x00] high edge lint[0x1]) [ 0.083835] ACPI: LAPIC_NMI (acpi_id[0x02] high edge lint[0x1]) [ 0.083836] ACPI: LAPIC_NMI (acpi_id[0x04] high edge lint[0x1]) [ 0.083836] ACPI: LAPIC_NMI (acpi_id[0x06] high edge lint[0x1]) [ 0.083837] ACPI: LAPIC_NMI (acpi_id[0x01] high edge lint[0x1]) [ 0.083838] ACPI: LAPIC_NMI (acpi_id[0x03] high edge lint[0x1]) [ 0.083838] ACPI: LAPIC_NMI (acpi_id[0x05] high edge lint[0x1]) [ 0.083839] ACPI: LAPIC_NMI (acpi_id[0x07] high edge lint[0x1]) [ 0.083848] IOAPIC[0]: apic_id 1, version 32, address 0xfec00000, GSI 0-23 [ 0.083851] IOAPIC[1]: apic_id 2, version 32, address 0xfec01000, GSI 24-47 [ 0.083853] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) [ 0.083854] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) [ 0.083857] Using ACPI (MADT) for SMP configuration information [ 0.083858] ACPI: HPET id: 0x8086a701 base: 0xfed00000 [ 0.083862] TSC deadline timer available [ 0.083863] smpboot: Allowing 8 CPUs, 0 hotplug CPUs [ 0.083871] PM: Registered nosave memory: [mem 0x00000000-0x00000fff] [ 0.083872] PM: Registered nosave memory: [mem 0x0008b000-0x000dffff] [ 0.083873] PM: Registered nosave memory: [mem 0x000e0000-0x000fffff] [ 0.083874] PM: Registered nosave memory: [mem 0x78ec2000-0x78f73fff] [ 0.083874] PM: Registered nosave memory: [mem 0x78f74000-0x798adfff] [ 0.083875] PM: Registered nosave memory: [mem 0x798ae000-0x79d4afff] [ 0.083876] PM: Registered nosave memory: [mem 0x79d4b000-0x8fffffff] [ 0.083876] PM: Registered nosave memory: [mem 0x90000000-0xfed1bfff] [ 0.083877] PM: Registered nosave memory: [mem 0xfed1c000-0xfed44fff] [ 0.083877] PM: Registered nosave memory: [mem 0xfed45000-0xfeffffff] [ 0.083878] PM: Registered nosave memory: [mem 0xff000000-0xffffffff] [ 0.083879] [mem 0x90000000-0xfed1bfff] available for PCI devices [ 0.083880] Booting paravirtualized kernel on bare hardware [ 0.083883] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645519600211568 ns [ 0.083886] setup_percpu: NR_CPUS:8192 nr_cpumask_bits:8 nr_cpu_ids:8 nr_node_ids:1 [ 0.084092] percpu: Embedded 60 pages/cpu s208896 r8192 d28672 u262144 [ 0.084114] Built 1 zonelists, mobility grouping on. Total pages: 8228859 [ 0.084114] Policy zone: Normal [ 0.084116] Kernel command line: BOOT_IMAGE=/boot/vmlinuz-5.4.0-177-generic root=UUID=1168b92c-82ac-47e1-87d9-5d77414c7738 ro pci=realloc=off console=tty0 console=ttyS1,115200 [ 0.086309] Dentry cache hash table entries: 4194304 (order: 13, 33554432 bytes, linear) [ 0.087437] Inode-cache hash table entries: 2097152 (order: 12, 16777216 bytes, linear) [ 0.087516] mem auto-init: stack:off, heap alloc:on, heap free:off [ 0.164899] Memory: 32692632K/33438000K available (14339K kernel code, 2395K rwdata, 9292K rodata, 2768K init, 17228K bss, 745368K reserved, 0K cma-reserved) [ 0.165122] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=8, Nodes=1 [ 0.165135] Kernel/User page tables isolation: enabled [ 0.165162] ftrace: allocating 44725 entries in 175 pages [ 0.177476] ftrace: allocated 175 pages with 6 groups [ 0.177581] rcu: Hierarchical RCU implementation. [ 0.177583] rcu: RCU restricting CPUs from NR_CPUS=8192 to nr_cpu_ids=8. [ 0.177584] Tasks RCU enabled. [ 0.177584] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies. [ 0.177585] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=8 [ 0.179790] NR_IRQS: 524544, nr_irqs: 896, preallocated irqs: 16 [ 0.179971] random: crng init done [ 0.184831] Console: colour VGA+ 80x25 [ 0.195243] printk: console [tty0] enabled [ 1.126368] printk: console [ttyS1] enabled [ 1.130624] ACPI: Core revision 20190816 [ 1.134777] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 133484882848 ns [ 1.143999] APIC: Switch to symmetric I/O mode setup [ 1.149035] DMAR: Host address width 46 [ 1.152939] DMAR: DRHD base: 0x000000fbffc000 flags: 0x1 [ 1.158327] DMAR: dmar0: reg_base_addr fbffc000 ver 1:0 cap 8d2078c106f0466 ecap f020de [ 1.166415] DMAR: RMRR base: 0x0000007ba75000 end: 0x0000007ba84fff [ 1.172746] DMAR: ATSR flags: 0x0 [ 1.176128] DMAR: RHSA base: 0x000000fbffc000 proximity domain: 0x0 [ 1.182463] DMAR-IR: IOAPIC id 1 under DRHD base 0xfbffc000 IOMMU 0 [ 1.188885] DMAR-IR: IOAPIC id 2 under DRHD base 0xfbffc000 IOMMU 0 [ 1.195307] DMAR-IR: HPET id 0 under DRHD base 0xfbffc000 [ 1.200774] DMAR-IR: x2apic is disabled because BIOS sets x2apic opt out bit. [ 1.200774] DMAR-IR: Use 'intremap=no_x2apic_optout' to override the BIOS setting. [ 1.215897] DMAR-IR: Enabled IRQ remapping in xapic mode [ 1.221272] x2apic: IRQ remapping doesn't support X2APIC mode [ 1.227567] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 [ 1.252001] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x32731ca8b48, max_idle_ns: 440795250528 ns [ 1.262604] Calibrating delay loop (skipped), value calculated using timer frequency.. 6999.89 BogoMIPS (lpj=13999780) [ 1.266638] mce: CPU0: Thermal monitoring enabled (TM1) [ 1.270642] process: using mwait in idle threads [ 1.274604] Last level iTLB entries: 4KB 64, 2MB 8, 4MB 8 [ 1.278603] Last level dTLB entries: 4KB 64, 2MB 0, 4MB 0, 1GB 4 [ 1.282604] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization [ 1.286603] Spectre V2 : Mitigation: Retpolines [ 1.290602] Spectre V2 : Spectre v2 / SpectreRSB mitigation: Filling RSB on context switch [ 1.294602] Spectre V2 : Spectre v2 / SpectreRSB : Filling RSB on VMEXIT [ 1.298602] Spectre V2 : Enabling Restricted Speculation for firmware calls [ 1.302603] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier [ 1.306602] Spectre V2 : User space: Mitigation: STIBP via seccomp and prctl [ 1.310603] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl and seccomp [ 1.314606] MDS: Mitigation: Clear CPU buffers [ 1.318603] TAA: Mitigation: Clear CPU buffers [ 1.322602] MMIO Stale Data: Mitigation: Clear CPU buffers [ 1.326607] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' [ 1.330603] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' [ 1.334602] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' [ 1.338603] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 [ 1.342603] x86/fpu: Enabled xstate features 0x7, context size is 832 bytes, using 'standard' format. [ 1.346784] Freeing SMP alternatives memory: 40K [ 1.351927] pid_max: default: 32768 minimum: 301 [ 1.354624] LSM: Security Framework initializing [ 1.358609] Yama: becoming mindful. [ 1.362626] AppArmor: AppArmor initialized [ 1.366662] Mount-cache hash table entries: 65536 (order: 7, 524288 bytes, linear) [ 1.370642] Mountpoint-cache hash table entries: 65536 (order: 7, 524288 bytes, linear) [ 1.374612] *** VALIDATE tmpfs *** [ 1.378702] *** VALIDATE proc *** [ 1.382643] *** VALIDATE cgroup1 *** [ 1.386603] *** VALIDATE cgroup2 *** [ 1.390790] smpboot: CPU0: Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz (family: 0x6, model: 0x4f, stepping: 0x1) [ 1.394666] Performance Events: PEBS fmt2+, Broadwell events, 16-deep LBR, full-width counters, Intel PMU driver. [ 1.398604] ... version: 3 [ 1.402603] ... bit width: 48 [ 1.406603] ... generic registers: 4 [ 1.410603] ... value mask: 0000ffffffffffff [ 1.414603] ... max period: 00007fffffffffff [ 1.418603] ... fixed-purpose events: 3 [ 1.422603] ... event mask: 000000070000000f [ 1.426629] rcu: Hierarchical SRCU implementation. [ 1.431420] NMI watchdog: Enabled. Permanently consumes one hw-PMU counter. [ 1.434664] smp: Bringing up secondary CPUs ... [ 1.438673] x86: Booting SMP configuration: [ 1.442605] .... node #0, CPUs: #1 #2 #3 #4 [ 1.450815] MDS CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/mds.html for more details. [ 1.458603] TAA CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/tsx_async_abort.html for more details. [ 1.462603] MMIO Stale Data CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/processor_mmio_stale_data.html for more details. [ 1.466698] #5 #6 #7 [ 1.467145] smp: Brought up 1 node, 8 CPUs [ 1.474604] smpboot: Max logical packages: 1 [ 1.478603] smpboot: Total of 8 processors activated (55999.12 BogoMIPS) [ 1.484771] devtmpfs: initialized [ 1.486641] x86/mm: Memory block size: 128MB [ 1.493633] PM: Registering ACPI NVS region [mem 0x798ae000-0x79d4afff] (4837376 bytes) [ 1.494676] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns [ 1.498615] futex hash table entries: 2048 (order: 5, 131072 bytes, linear) [ 1.502644] pinctrl core: initialized pinctrl subsystem [ 1.506680] PM: RTC time: 03:04:15, date: 2024-04-19 [ 1.510690] NET: Registered protocol family 16 [ 1.514672] audit: initializing netlink subsys (disabled) [ 1.518609] audit: type=2000 audit(1713495853.332:1): state=initialized audit_enabled=0 res=1 [ 1.518683] EISA bus registered [ 1.525811] cpuidle: using governor ladder [ 1.526605] cpuidle: using governor menu [ 1.530615] ACPI FADT declares the system doesn't support PCIe ASPM, so disable it [ 1.534604] ACPI: bus type PCI registered [ 1.538603] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 [ 1.542650] PCI: MMCONFIG for domain 0000 [bus 00-ff] at [mem 0x80000000-0x8fffffff] (base 0x80000000) [ 1.546605] PCI: MMCONFIG at [mem 0x80000000-0x8fffffff] reserved in E820 [ 1.550613] PCI: Using configuration type 1 for base access [ 1.556599] HugeTLB registered 1.00 GiB page size, pre-allocated 0 pages [ 1.558605] HugeTLB registered 2.00 MiB page size, pre-allocated 0 pages [ 1.562663] ACPI: Added _OSI(Module Device) [ 1.566604] ACPI: Added _OSI(Processor Device) [ 1.570609] ACPI: Added _OSI(3.0 _SCP Extensions) [ 1.574603] ACPI: Added _OSI(Processor Aggregator Device) [ 1.578603] ACPI: Added _OSI(Linux-Dell-Video) [ 1.582603] ACPI: Added _OSI(Linux-Lenovo-NV-HDMI-Audio) [ 1.586603] ACPI: Added _OSI(Linux-HPI-Hybrid-Graphics) [ 1.632957] ACPI: 4 ACPI AML tables successfully acquired and loaded [ 1.637941] ACPI: [Firmware Bug]: BIOS _OSI(Linux) query ignored [ 1.642739] ACPI: Dynamic OEM Table Load: [ 1.670828] ACPI: Interpreter enabled [ 1.674560] ACPI: (supports S0 S4 S5) [ 1.674604] ACPI: Using IOAPIC for interrupt routing [ 1.678622] HEST: Enabling Firmware First mode for corrected errors. [ 1.682685] HEST: Table parsing has been initialized. [ 1.686604] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug [ 1.691269] ACPI: Enabled 5 GPEs in block 00 to 3F [ 1.724938] ACPI: PCI Root Bridge [UNC0] (domain 0000 [bus ff]) [ 1.730607] acpi PNP0A03:03: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3] [ 1.740620] acpi PNP0A03:03: _OSC: platform does not support [SHPCHotplug AER LTR] [ 1.747549] acpi PNP0A03:03: _OSC: OS now controls [PCIeHotplug PME PCIeCapability] [ 1.758603] acpi PNP0A03:03: FADT indicates ASPM is unsupported, using BIOS configuration [ 1.766637] PCI host bridge to bus 0000:ff [ 1.770604] pci_bus 0000:ff: root bus resource [bus ff] [ 1.774611] pci 0000:ff:0b.0: [8086:6f81] type 00 class 0x088000 [ 1.782662] pci 0000:ff:0b.1: [8086:6f36] type 00 class 0x110100 [ 1.786652] pci 0000:ff:0b.2: [8086:6f37] type 00 class 0x110100 [ 1.794651] pci 0000:ff:0b.3: [8086:6f76] type 00 class 0x088000 [ 1.798653] pci 0000:ff:0c.0: [8086:6fe0] type 00 class 0x088000 [ 1.806655] pci 0000:ff:0c.1: [8086:6fe1] type 00 class 0x088000 [ 1.810653] pci 0000:ff:0c.2: [8086:6fe2] type 00 class 0x088000 [ 1.818652] pci 0000:ff:0c.3: [8086:6fe3] type 00 class 0x088000 [ 1.822655] pci 0000:ff:0f.0: [8086:6ff8] type 00 class 0x088000 [ 1.830650] pci 0000:ff:0f.1: [8086:6ff9] type 00 class 0x088000 [ 1.834652] pci 0000:ff:0f.4: [8086:6ffc] type 00 class 0x088000 [ 1.842651] pci 0000:ff:0f.5: [8086:6ffd] type 00 class 0x088000 [ 1.846651] pci 0000:ff:0f.6: [8086:6ffe] type 00 class 0x088000 [ 1.854651] pci 0000:ff:10.0: [8086:6f1d] type 00 class 0x088000 [ 1.858651] pci 0000:ff:10.1: [8086:6f34] type 00 class 0x110100 [ 1.866652] pci 0000:ff:10.5: [8086:6f1e] type 00 class 0x088000 [ 1.874653] pci 0000:ff:10.6: [8086:6f7d] type 00 class 0x110100 [ 1.878650] pci 0000:ff:10.7: [8086:6f1f] type 00 class 0x088000 [ 1.886651] pci 0000:ff:12.0: [8086:6fa0] type 00 class 0x088000 [ 1.890624] pci 0000:ff:12.1: [8086:6f30] type 00 class 0x110100 [ 1.898656] pci 0000:ff:13.0: [8086:6fa8] type 00 class 0x088000 [ 1.902692] pci 0000:ff:13.1: [8086:6f71] type 00 class 0x088000 [ 1.910664] pci 0000:ff:13.2: [8086:6faa] type 00 class 0x088000 [ 1.914665] pci 0000:ff:13.3: [8086:6fab] type 00 class 0x088000 [ 1.922669] pci 0000:ff:13.4: [8086:6fac] type 00 class 0x088000 [ 1.926667] pci 0000:ff:13.5: [8086:6fad] type 00 class 0x088000 [ 1.934662] pci 0000:ff:13.6: [8086:6fae] type 00 class 0x088000 [ 1.938653] pci 0000:ff:13.7: [8086:6faf] type 00 class 0x088000 [ 1.946655] pci 0000:ff:14.0: [8086:6fb0] type 00 class 0x088000 [ 1.950663] pci 0000:ff:14.1: [8086:6fb1] type 00 class 0x088000 [ 1.958663] pci 0000:ff:14.2: [8086:6fb2] type 00 class 0x088000 [ 1.966663] pci 0000:ff:14.3: [8086:6fb3] type 00 class 0x088000 [ 1.970664] pci 0000:ff:14.4: [8086:6fbc] type 00 class 0x088000 [ 1.978653] pci 0000:ff:14.5: [8086:6fbd] type 00 class 0x088000 [ 1.982653] pci 0000:ff:14.6: [8086:6fbe] type 00 class 0x088000 [ 1.990653] pci 0000:ff:14.7: [8086:6fbf] type 00 class 0x088000 [ 1.994654] pci 0000:ff:15.0: [8086:6fb4] type 00 class 0x088000 [ 2.002666] pci 0000:ff:15.1: [8086:6fb5] type 00 class 0x088000 [ 2.006664] pci 0000:ff:15.2: [8086:6fb6] type 00 class 0x088000 [ 2.014663] pci 0000:ff:15.3: [8086:6fb7] type 00 class 0x088000 [ 2.018671] pci 0000:ff:16.0: [8086:6f68] type 00 class 0x088000 [ 2.026658] pci 0000:ff:16.6: [8086:6f6e] type 00 class 0x088000 [ 2.030653] pci 0000:ff:16.7: [8086:6f6f] type 00 class 0x088000 [ 2.038653] pci 0000:ff:17.0: [8086:6fd0] type 00 class 0x088000 [ 2.042656] pci 0000:ff:17.4: [8086:6fb8] type 00 class 0x088000 [ 2.050654] pci 0000:ff:17.5: [8086:6fb9] type 00 class 0x088000 [ 2.054653] pci 0000:ff:17.6: [8086:6fba] type 00 class 0x088000 [ 2.062653] pci 0000:ff:17.7: [8086:6fbb] type 00 class 0x088000 [ 2.070659] pci 0000:ff:1e.0: [8086:6f98] type 00 class 0x088000 [ 2.074653] pci 0000:ff:1e.1: [8086:6f99] type 00 class 0x088000 [ 2.082652] pci 0000:ff:1e.2: [8086:6f9a] type 00 class 0x088000 [ 2.086652] pci 0000:ff:1e.3: [8086:6fc0] type 00 class 0x088000 [ 2.094625] pci 0000:ff:1e.4: [8086:6f9c] type 00 class 0x088000 [ 2.098657] pci 0000:ff:1f.0: [8086:6f88] type 00 class 0x088000 [ 2.106653] pci 0000:ff:1f.2: [8086:6f8a] type 00 class 0x088000 [ 2.114410] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-fe]) [ 2.122606] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3] [ 2.130906] acpi PNP0A08:00: _OSC: platform does not support [SHPCHotplug AER LTR] [ 2.147020] acpi PNP0A08:00: _OSC: OS now controls [PCIeHotplug PME PCIeCapability] [ 2.154603] acpi PNP0A08:00: FADT indicates ASPM is unsupported, using BIOS configuration [ 2.162863] PCI host bridge to bus 0000:00 [ 2.166604] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] [ 2.174603] pci_bus 0000:00: root bus resource [io 0x1000-0xffff window] [ 2.182603] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] [ 2.186603] pci_bus 0000:00: root bus resource [mem 0xfedb0000-0xfedb000f window] [ 2.194604] pci_bus 0000:00: root bus resource [mem 0xfedc0000-0xfedc000f window] [ 2.202604] pci_bus 0000:00: root bus resource [mem 0x90000000-0xfbffbfff window] [ 2.210603] pci_bus 0000:00: root bus resource [bus 00-fe] [ 2.218609] pci 0000:00:00.0: [8086:6f00] type 00 class 0x060000 [ 2.222750] pci 0000:00:01.0: [8086:6f02] type 01 class 0x060400 [ 2.230673] pci 0000:00:01.0: PME# supported from D0 D3hot D3cold [ 2.234704] pci 0000:00:02.0: [8086:6f04] type 01 class 0x060400 [ 2.242673] pci 0000:00:02.0: PME# supported from D0 D3hot D3cold [ 2.246698] pci 0000:00:03.0: [8086:6f08] type 01 class 0x060400 [ 2.254671] pci 0000:00:03.0: PME# supported from D0 D3hot D3cold [ 2.258698] pci 0000:00:04.0: [8086:6f20] type 00 class 0x088000 [ 2.266622] pci 0000:00:04.0: reg 0x10: [mem 0xfb42c000-0xfb42ffff 64bit] [ 2.274739] pci 0000:00:04.1: [8086:6f21] type 00 class 0x088000 [ 2.278622] pci 0000:00:04.1: reg 0x10: [mem 0xfb428000-0xfb42bfff 64bit] [ 2.286738] pci 0000:00:04.2: [8086:6f22] type 00 class 0x088000 [ 2.290621] pci 0000:00:04.2: reg 0x10: [mem 0xfb424000-0xfb427fff 64bit] [ 2.298737] pci 0000:00:04.3: [8086:6f23] type 00 class 0x088000 [ 2.306622] pci 0000:00:04.3: reg 0x10: [mem 0xfb420000-0xfb423fff 64bit] [ 2.310736] pci 0000:00:04.4: [8086:6f24] type 00 class 0x088000 [ 2.318621] pci 0000:00:04.4: reg 0x10: [mem 0xfb41c000-0xfb41ffff 64bit] [ 2.326742] pci 0000:00:04.5: [8086:6f25] type 00 class 0x088000 [ 2.330622] pci 0000:00:04.5: reg 0x10: [mem 0xfb418000-0xfb41bfff 64bit] [ 2.338736] pci 0000:00:04.6: [8086:6f26] type 00 class 0x088000 [ 2.346621] pci 0000:00:04.6: reg 0x10: [mem 0xfb414000-0xfb417fff 64bit] [ 2.350736] pci 0000:00:04.7: [8086:6f27] type 00 class 0x088000 [ 2.358622] pci 0000:00:04.7: reg 0x10: [mem 0xfb410000-0xfb413fff 64bit] [ 2.362738] pci 0000:00:05.0: [8086:6f28] type 00 class 0x088000 [ 2.370719] pci 0000:00:05.1: [8086:6f29] type 00 class 0x088000 [ 2.378739] pci 0000:00:05.2: [8086:6f2a] type 00 class 0x088000 [ 2.382719] pci 0000:00:05.4: [8086:6f2c] type 00 class 0x080020 [ 2.390617] pci 0000:00:05.4: reg 0x10: [mem 0xfb439000-0xfb439fff] [ 2.394742] pci 0000:00:11.0: [8086:8d7c] type 00 class 0xff0000 [ 2.402829] pci 0000:00:11.4: [8086:8d62] type 00 class 0x010601 [ 2.406627] pci 0000:00:11.4: reg 0x10: [io 0xf110-0xf117] [ 2.414614] pci 0000:00:11.4: reg 0x14: [io 0xf100-0xf103] [ 2.418614] pci 0000:00:11.4: reg 0x18: [io 0xf0f0-0xf0f7] [ 2.426614] pci 0000:00:11.4: reg 0x1c: [io 0xf0e0-0xf0e3] [ 2.430614] pci 0000:00:11.4: reg 0x20: [io 0xf020-0xf03f] [ 2.434615] pci 0000:00:11.4: reg 0x24: [mem 0xfb438000-0xfb4387ff] [ 2.442645] pci 0000:00:11.4: PME# supported from D3hot [ 2.446698] pci 0000:00:14.0: [8086:8d31] type 00 class 0x0c0330 [ 2.454630] pci 0000:00:14.0: reg 0x10: [mem 0xfb400000-0xfb40ffff 64bit] [ 2.462681] pci 0000:00:14.0: PME# supported from D3hot D3cold [ 2.466688] pci 0000:00:16.0: [8086:8d3a] type 00 class 0x078000 [ 2.474630] pci 0000:00:16.0: reg 0x10: [mem 0xfb437000-0xfb43700f 64bit] [ 2.478681] pci 0000:00:16.0: PME# supported from D0 D3hot D3cold [ 2.486687] pci 0000:00:16.1: [8086:8d3b] type 00 class 0x078000 [ 2.490630] pci 0000:00:16.1: reg 0x10: [mem 0xfb436000-0xfb43600f 64bit] [ 2.498681] pci 0000:00:16.1: PME# supported from D0 D3hot D3cold [ 2.506698] pci 0000:00:1a.0: [8086:8d2d] type 00 class 0x0c0320 [ 2.510628] pci 0000:00:1a.0: reg 0x10: [mem 0xfb434000-0xfb4343ff] [ 2.518707] pci 0000:00:1a.0: PME# supported from D0 D3hot D3cold [ 2.522692] pci 0000:00:1c.0: [8086:8d10] type 01 class 0x060400 [ 2.530694] pci 0000:00:1c.0: PME# supported from D0 D3hot D3cold [ 2.538701] pci 0000:00:1c.2: [8086:8d14] type 01 class 0x060400 [ 2.542695] pci 0000:00:1c.2: PME# supported from D0 D3hot D3cold [ 2.550700] pci 0000:00:1c.4: [8086:8d18] type 01 class 0x060400 [ 2.554695] pci 0000:00:1c.4: PME# supported from D0 D3hot D3cold [ 2.562710] pci 0000:00:1d.0: [8086:8d26] type 00 class 0x0c0320 [ 2.566629] pci 0000:00:1d.0: reg 0x10: [mem 0xfb433000-0xfb4333ff] [ 2.574707] pci 0000:00:1d.0: PME# supported from D0 D3hot D3cold [ 2.578694] pci 0000:00:1f.0: [8086:8d44] type 00 class 0x060100 [ 2.586814] pci 0000:00:1f.2: [8086:8d02] type 00 class 0x010601 [ 2.594625] pci 0000:00:1f.2: reg 0x10: [io 0xf070-0xf077] [ 2.598613] pci 0000:00:1f.2: reg 0x14: [io 0xf060-0xf063] [ 2.602613] pci 0000:00:1f.2: reg 0x18: [io 0xf050-0xf057] [ 2.610613] pci 0000:00:1f.2: reg 0x1c: [io 0xf040-0xf043] [ 2.614613] pci 0000:00:1f.2: reg 0x20: [io 0xf000-0xf01f] [ 2.622613] pci 0000:00:1f.2: reg 0x24: [mem 0xfb432000-0xfb4327ff] [ 2.626639] pci 0000:00:1f.2: PME# supported from D3hot [ 2.634686] pci 0000:00:1f.3: [8086:8d22] type 00 class 0x0c0500 [ 2.638627] pci 0000:00:1f.3: reg 0x10: [mem 0xfb431000-0xfb4310ff 64bit] [ 2.646634] pci 0000:00:1f.3: reg 0x20: [io 0x0580-0x059f] [ 2.650836] acpiphp: Slot [1] registered [ 2.654620] pci 0000:00:01.0: PCI bridge to [bus 01] [ 2.662749] pci 0000:02:00.0: [8086:0953] type 00 class 0x010802 [ 2.666625] pci 0000:02:00.0: reg 0x10: [mem 0xfb310000-0xfb313fff 64bit] [ 2.674645] pci 0000:02:00.0: reg 0x30: [mem 0xfb300000-0xfb30ffff pref] [ 2.678606] pci 0000:02:00.0: enabling Extended Tags [ 2.686697] pci 0000:00:02.0: PCI bridge to [bus 02] [ 2.690605] pci 0000:00:02.0: bridge window [mem 0xfb300000-0xfb3fffff] [ 2.698749] pci 0000:03:00.0: [8086:10fb] type 00 class 0x020000 [ 2.702626] pci 0000:03:00.0: reg 0x10: [mem 0xfbd80000-0xfbdfffff 64bit pref] [ 2.710613] pci 0000:03:00.0: reg 0x18: [io 0xe020-0xe03f] [ 2.718626] pci 0000:03:00.0: reg 0x20: [mem 0xfbe04000-0xfbe07fff 64bit pref] [ 2.722613] pci 0000:03:00.0: reg 0x30: [mem 0xfb280000-0xfb2fffff pref] [ 2.730646] pci 0000:03:00.0: PME# supported from D0 D3hot D3cold [ 2.738624] pci 0000:03:00.0: reg 0x184: [mem 0x00000000-0x00003fff 64bit pref] [ 2.742604] pci 0000:03:00.0: VF(n) BAR0 space: [mem 0x00000000-0x000fffff 64bit pref] (contains BAR0 for 64 VFs) [ 2.754616] pci 0000:03:00.0: reg 0x190: [mem 0x00000000-0x00003fff 64bit pref] [ 2.762603] pci 0000:03:00.0: VF(n) BAR3 space: [mem 0x00000000-0x000fffff 64bit pref] (contains BAR3 for 64 VFs) [ 2.770734] pci 0000:03:00.1: [8086:10fb] type 00 class 0x020000 [ 2.778626] pci 0000:03:00.1: reg 0x10: [mem 0xfbd00000-0xfbd7ffff 64bit pref] [ 2.786612] pci 0000:03:00.1: reg 0x18: [io 0xe000-0xe01f] [ 2.790626] pci 0000:03:00.1: reg 0x20: [mem 0xfbe00000-0xfbe03fff 64bit pref] [ 2.798612] pci 0000:03:00.1: reg 0x30: [mem 0xfb200000-0xfb27ffff pref] [ 2.806646] pci 0000:03:00.1: PME# supported from D0 D3hot D3cold [ 2.810620] pci 0000:03:00.1: reg 0x184: [mem 0x00000000-0x00003fff 64bit pref] [ 2.818603] pci 0000:03:00.1: VF(n) BAR0 space: [mem 0x00000000-0x000fffff 64bit pref] (contains BAR0 for 64 VFs) [ 2.830616] pci 0000:03:00.1: reg 0x190: [mem 0x00000000-0x00003fff 64bit pref] [ 2.838603] pci 0000:03:00.1: VF(n) BAR3 space: [mem 0x00000000-0x000fffff 64bit pref] (contains BAR3 for 64 VFs) [ 2.846729] pci 0000:00:03.0: PCI bridge to [bus 03] [ 2.854605] pci 0000:00:03.0: bridge window [io 0xe000-0xefff] [ 2.858604] pci 0000:00:03.0: bridge window [mem 0xfb200000-0xfb2fffff] [ 2.866605] pci 0000:00:03.0: bridge window [mem 0xfbd00000-0xfbefffff 64bit pref] [ 2.874633] pci 0000:00:1c.0: PCI bridge to [bus 04] [ 2.878660] pci 0000:05:00.0: [1a03:1150] type 01 class 0x060400 [ 2.886694] pci 0000:05:00.0: enabling Extended Tags [ 2.890676] pci 0000:05:00.0: supports D1 D2 [ 2.894603] pci 0000:05:00.0: PME# supported from D0 D1 D2 D3hot D3cold [ 2.902687] pci 0000:00:1c.2: PCI bridge to [bus 05-06] [ 2.906605] pci 0000:00:1c.2: bridge window [io 0xd000-0xdfff] [ 2.910605] pci 0000:00:1c.2: bridge window [mem 0xfa000000-0xfb0fffff] [ 2.918683] pci_bus 0000:06: extended config space not accessible [ 2.926632] pci 0000:06:00.0: [1a03:2000] type 00 class 0x030000 [ 2.930633] pci 0000:06:00.0: reg 0x10: [mem 0xfa000000-0xfaffffff] [ 2.938620] pci 0000:06:00.0: reg 0x14: [mem 0xfb000000-0xfb01ffff] [ 2.942620] pci 0000:06:00.0: reg 0x18: [io 0xd000-0xd07f] [ 2.950722] pci 0000:06:00.0: supports D1 D2 [ 2.954603] pci 0000:06:00.0: PME# supported from D0 D1 D2 D3hot D3cold [ 2.962704] pci 0000:05:00.0: PCI bridge to [bus 06] [ 2.966609] pci 0000:05:00.0: bridge window [io 0xd000-0xdfff] [ 2.970606] pci 0000:05:00.0: bridge window [mem 0xfa000000-0xfb0fffff] [ 2.978680] pci 0000:07:00.0: [8086:1521] type 00 class 0x020000 [ 2.986640] pci 0000:07:00.0: reg 0x10: [mem 0xfb120000-0xfb13ffff] [ 2.990631] pci 0000:07:00.0: reg 0x18: [io 0xc020-0xc03f] [ 2.998617] pci 0000:07:00.0: reg 0x1c: [mem 0xfb144000-0xfb147fff] [ 3.002734] pci 0000:07:00.0: PME# supported from D0 D3hot D3cold [ 3.010652] pci 0000:07:00.0: reg 0x184: [mem 0x00000000-0x00003fff 64bit pref] [ 3.018604] pci 0000:07:00.0: VF(n) BAR0 space: [mem 0x00000000-0x0001ffff 64bit pref] (contains BAR0 for 8 VFs) [ 3.026629] pci 0000:07:00.0: reg 0x190: [mem 0x00000000-0x00003fff 64bit pref] [ 3.034603] pci 0000:07:00.0: VF(n) BAR3 space: [mem 0x00000000-0x0001ffff 64bit pref] (contains BAR3 for 8 VFs) [ 3.046681] pci 0000:07:00.1: [8086:1521] type 00 class 0x020000 [ 3.050639] pci 0000:07:00.1: reg 0x10: [mem 0xfb100000-0xfb11ffff] [ 3.058631] pci 0000:07:00.1: reg 0x18: [io 0xc000-0xc01f] [ 3.062617] pci 0000:07:00.1: reg 0x1c: [mem 0xfb140000-0xfb143fff] [ 3.070733] pci 0000:07:00.1: PME# supported from D0 D3hot D3cold [ 3.074641] pci 0000:07:00.1: reg 0x184: [mem 0x00000000-0x00003fff 64bit pref] [ 3.082603] pci 0000:07:00.1: VF(n) BAR0 space: [mem 0x00000000-0x0001ffff 64bit pref] (contains BAR0 for 8 VFs) [ 3.094629] pci 0000:07:00.1: reg 0x190: [mem 0x00000000-0x00003fff 64bit pref] [ 3.102603] pci 0000:07:00.1: VF(n) BAR3 space: [mem 0x00000000-0x0001ffff 64bit pref] (contains BAR3 for 8 VFs) [ 3.110734] pci 0000:00:1c.4: PCI bridge to [bus 07] [ 3.118605] pci 0000:00:1c.4: bridge window [io 0xc000-0xcfff] [ 3.122605] pci 0000:00:1c.4: bridge window [mem 0xfb100000-0xfb1fffff] [ 3.130606] pci 0000:00:1c.4: bridge has subordinate 07 but max busn 08 [ 3.135475] ACPI: PCI Interrupt Link [LNKA] (IRQs 3 4 5 6 7 10 *11 12 14 15) [ 3.150649] ACPI: PCI Interrupt Link [LNKB] (IRQs 3 4 5 6 7 *10 11 12 14 15) [ 3.158647] ACPI: PCI Interrupt Link [LNKC] (IRQs 3 4 *5 6 10 11 12 14 15) [ 3.166646] ACPI: PCI Interrupt Link [LNKD] (IRQs 3 4 5 6 10 *11 12 14 15) [ 3.174646] ACPI: PCI Interrupt Link [LNKE] (IRQs 3 4 5 6 7 10 11 12 14 15) *0, disabled. [ 3.182646] ACPI: PCI Interrupt Link [LNKF] (IRQs 3 4 5 6 7 10 11 12 14 15) *0, disabled. [ 3.190647] ACPI: PCI Interrupt Link [LNKG] (IRQs 3 4 5 6 7 10 11 12 14 15) *0, disabled. [ 3.198647] ACPI: PCI Interrupt Link [LNKH] (IRQs 3 4 5 6 7 10 11 12 14 15) *0, disabled. [ 3.206815] iommu: Default domain type: Translated [ 3.210730] SCSI subsystem initialized [ 3.214621] pci 0000:06:00.0: vgaarb: setting as boot VGA device [ 3.218602] pci 0000:06:00.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none [ 3.230604] pci 0000:06:00.0: vgaarb: bridge control possible [ 3.234603] vgaarb: loaded [ 3.237380] ACPI: bus type USB registered [ 3.242612] usbcore: registered new interface driver usbfs [ 3.246607] usbcore: registered new interface driver hub [ 3.254607] usbcore: registered new device driver usb [ 3.258622] pps_core: LinuxPPS API ver. 1 registered [ 3.262603] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti [ 3.274604] PTP clock support registered [ 3.278609] EDAC MC: Ver: 3.0.0 [ 3.282613] PCI: Using ACPI for IRQ routing [ 3.291912] NetLabel: Initializing [ 3.294603] NetLabel: domain hash size = 128 [ 3.298603] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO [ 3.302612] NetLabel: unlabeled traffic allowed by default [ 3.311333] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0, 0, 0, 0, 0, 0 [ 3.314604] hpet0: 8 comparators, 64-bit 14.318180 MHz counter [ 3.324634] clocksource: Switched to clocksource tsc-early [ 3.337117] *** VALIDATE bpf *** [ 3.340461] VFS: Disk quotas dquot_6.6.0 [ 3.344459] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) [ 3.351420] *** VALIDATE ramfs *** [ 3.354885] *** VALIDATE hugetlbfs *** [ 3.358759] AppArmor: AppArmor Filesystem Enabled [ 3.363549] pnp: PnP ACPI init [ 3.367101] system 00:01: [io 0x0500-0x057f] has been reserved [ 3.373082] system 00:01: [io 0x0400-0x047f] has been reserved [ 3.379069] system 00:01: [io 0x0580-0x059f] has been reserved [ 3.385050] system 00:01: [io 0x0600-0x061f] has been reserved [ 3.391030] system 00:01: [io 0x0880-0x0883] has been reserved [ 3.397008] system 00:01: [io 0x0800-0x081f] has been reserved [ 3.402990] system 00:01: [mem 0xfed1c000-0xfed3ffff] has been reserved [ 3.409667] system 00:01: [mem 0xfed45000-0xfed8bfff] has been reserved [ 3.416346] system 00:01: [mem 0xff000000-0xffffffff] has been reserved [ 3.423022] system 00:01: [mem 0xfee00000-0xfeefffff] has been reserved [ 3.429704] system 00:01: [mem 0xfed12000-0xfed1200f] has been reserved [ 3.436387] system 00:01: [mem 0xfed12010-0xfed1201f] has been reserved [ 3.443067] system 00:01: [mem 0xfed1b000-0xfed1bfff] has been reserved [ 3.449940] system 00:02: [io 0x0a00-0x0a0f] has been reserved [ 3.455920] system 00:02: [io 0x0a10-0x0a1f] has been reserved [ 3.461900] system 00:02: [io 0x0a20-0x0a2f] has been reserved [ 3.467881] system 00:02: [io 0x0a30-0x0a3f] has been reserved [ 3.473860] system 00:02: [io 0x0a40-0x0a4f] has been reserved [ 3.480736] pnp: PnP ACPI: found 5 devices [ 3.485800] thermal_sys: Registered thermal governor 'fair_share' [ 3.485801] thermal_sys: Registered thermal governor 'bang_bang' [ 3.491960] thermal_sys: Registered thermal governor 'step_wise' [ 3.498032] thermal_sys: Registered thermal governor 'user_space' [ 3.504099] thermal_sys: Registered thermal governor 'power_allocator' [ 3.514736] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns [ 3.530314] pci 0000:00:1c.4: bridge window [mem 0x00100000-0x000fffff 64bit pref] to [bus 07] add_size 100000 add_align 100000 [ 3.541883] pci 0000:00:1c.4: BAR 15: assigned [mem 0x90000000-0x900fffff 64bit pref] [ 3.549798] pci 0000:00:01.0: PCI bridge to [bus 01] [ 3.554841] pci 0000:00:02.0: PCI bridge to [bus 02] [ 3.559873] pci 0000:00:02.0: bridge window [mem 0xfb300000-0xfb3fffff] [ 3.566743] pci 0000:03:00.0: BAR 7: no space for [mem size 0x00100000 64bit pref] [ 3.574392] pci 0000:03:00.0: BAR 7: failed to assign [mem size 0x00100000 64bit pref] [ 3.582393] pci 0000:03:00.0: BAR 10: no space for [mem size 0x00100000 64bit pref] [ 3.590131] pci 0000:03:00.0: BAR 10: failed to assign [mem size 0x00100000 64bit pref] [ 3.598221] pci 0000:03:00.1: BAR 7: no space for [mem size 0x00100000 64bit pref] [ 3.605873] pci 0000:03:00.1: BAR 7: failed to assign [mem size 0x00100000 64bit pref] [ 3.613873] pci 0000:03:00.1: BAR 10: no space for [mem size 0x00100000 64bit pref] [ 3.621611] pci 0000:03:00.1: BAR 10: failed to assign [mem size 0x00100000 64bit pref] [ 3.629698] pci 0000:03:00.0: BAR 7: no space for [mem size 0x00100000 64bit pref] [ 3.637350] pci 0000:03:00.0: BAR 7: failed to assign [mem size 0x00100000 64bit pref] [ 3.645351] pci 0000:03:00.0: BAR 10: no space for [mem size 0x00100000 64bit pref] [ 3.653089] pci 0000:03:00.0: BAR 10: failed to assign [mem size 0x00100000 64bit pref] [ 3.661178] pci 0000:03:00.1: BAR 7: no space for [mem size 0x00100000 64bit pref] [ 3.668830] pci 0000:03:00.1: BAR 7: failed to assign [mem size 0x00100000 64bit pref] [ 3.676830] pci 0000:03:00.1: BAR 10: no space for [mem size 0x00100000 64bit pref] [ 3.684568] pci 0000:03:00.1: BAR 10: failed to assign [mem size 0x00100000 64bit pref] [ 3.692656] pci 0000:00:03.0: PCI bridge to [bus 03] [ 3.697683] pci 0000:00:03.0: bridge window [io 0xe000-0xefff] [ 3.703845] pci 0000:00:03.0: bridge window [mem 0xfb200000-0xfb2fffff] [ 3.710700] pci 0000:00:03.0: bridge window [mem 0xfbd00000-0xfbefffff 64bit pref] [ 3.718532] pci 0000:00:1c.0: PCI bridge to [bus 04] [ 3.723582] pci 0000:05:00.0: PCI bridge to [bus 06] [ 3.728607] pci 0000:05:00.0: bridge window [io 0xd000-0xdfff] [ 3.734771] pci 0000:05:00.0: bridge window [mem 0xfa000000-0xfb0fffff] [ 3.741637] pci 0000:00:1c.2: PCI bridge to [bus 05-06] [ 3.746921] pci 0000:00:1c.2: bridge window [io 0xd000-0xdfff] [ 3.753084] pci 0000:00:1c.2: bridge window [mem 0xfa000000-0xfb0fffff] [ 3.759947] pci 0000:07:00.0: BAR 7: assigned [mem 0x90000000-0x9001ffff 64bit pref] [ 3.767776] pci 0000:07:00.0: BAR 10: assigned [mem 0x90020000-0x9003ffff 64bit pref] [ 3.775687] pci 0000:07:00.1: BAR 7: assigned [mem 0x90040000-0x9005ffff 64bit pref] [ 3.783516] pci 0000:07:00.1: BAR 10: assigned [mem 0x90060000-0x9007ffff 64bit pref] [ 3.791428] pci 0000:00:1c.4: PCI bridge to [bus 07] [ 3.796453] pci 0000:00:1c.4: bridge window [io 0xc000-0xcfff] [ 3.802613] pci 0000:00:1c.4: bridge window [mem 0xfb100000-0xfb1fffff] [ 3.809469] pci 0000:00:1c.4: bridge window [mem 0x90000000-0x900fffff 64bit pref] [ 3.817304] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] [ 3.823549] pci_bus 0000:00: resource 5 [io 0x1000-0xffff window] [ 3.829787] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] [ 3.836722] pci_bus 0000:00: resource 7 [mem 0xfedb0000-0xfedb000f window] [ 3.843658] pci_bus 0000:00: resource 8 [mem 0xfedc0000-0xfedc000f window] [ 3.850599] pci_bus 0000:00: resource 9 [mem 0x90000000-0xfbffbfff window] [ 3.857532] pci_bus 0000:02: resource 1 [mem 0xfb300000-0xfb3fffff] [ 3.863859] pci_bus 0000:03: resource 0 [io 0xe000-0xefff] [ 3.869490] pci_bus 0000:03: resource 1 [mem 0xfb200000-0xfb2fffff] [ 3.875818] pci_bus 0000:03: resource 2 [mem 0xfbd00000-0xfbefffff 64bit pref] [ 3.883120] pci_bus 0000:05: resource 0 [io 0xd000-0xdfff] [ 3.888758] pci_bus 0000:05: resource 1 [mem 0xfa000000-0xfb0fffff] [ 3.895084] pci_bus 0000:06: resource 0 [io 0xd000-0xdfff] [ 3.900717] pci_bus 0000:06: resource 1 [mem 0xfa000000-0xfb0fffff] [ 3.907046] pci_bus 0000:07: resource 0 [io 0xc000-0xcfff] [ 3.912679] pci_bus 0000:07: resource 1 [mem 0xfb100000-0xfb1fffff] [ 3.919008] pci_bus 0000:07: resource 2 [mem 0x90000000-0x900fffff 64bit pref] [ 3.926430] NET: Registered protocol family 2 [ 3.931018] IP idents hash table entries: 262144 (order: 9, 2097152 bytes, linear) [ 3.940237] tcp_listen_portaddr_hash hash table entries: 16384 (order: 6, 262144 bytes, linear) [ 3.949219] TCP established hash table entries: 262144 (order: 9, 2097152 bytes, linear) [ 3.957621] TCP bind hash table entries: 65536 (order: 8, 1048576 bytes, linear) [ 3.965154] TCP: Hash tables configured (established 262144 bind 65536) [ 3.971904] UDP hash table entries: 16384 (order: 7, 524288 bytes, linear) [ 3.978921] UDP-Lite hash table entries: 16384 (order: 7, 524288 bytes, linear) [ 3.986370] NET: Registered protocol family 1 [ 3.990797] NET: Registered protocol family 44 [ 3.995367] pci 0000:00:05.0: disabled boot interrupts on device [8086:6f28] [ 4.026800] pci 0000:00:1a.0: quirk_usb_early_handoff+0x0/0x670 took 23568 usecs [ 4.058793] pci 0000:00:1d.0: quirk_usb_early_handoff+0x0/0x670 took 23923 usecs [ 4.066281] pci 0000:02:00.0: CLS mismatch (64 != 32), using 64 bytes [ 4.072801] pci 0000:06:00.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff] [ 4.081267] Trying to unpack rootfs image as initramfs... [ 4.187081] Freeing initrd memory: 54500K [ 4.218658] PCI-DMA: Using software bounce buffering for IO (SWIOTLB) [ 4.225164] software IO TLB: mapped [mem 0x74ec2000-0x78ec2000] (64MB) [ 4.232086] check: Scanning for low memory corruption every 60 seconds [ 4.239117] Initialise system trusted keyrings [ 4.251386] Key type blacklist registered [ 4.255474] workingset: timestamp_bits=36 max_order=23 bucket_order=0 [ 4.262879] zbud: loaded [ 4.265720] squashfs: version 4.0 (2009/01/31) Phillip Lougher [ 4.271718] fuse: init (API version 7.31) [ 4.275799] *** VALIDATE fuse *** [ 4.279177] *** VALIDATE fuse *** [ 4.282625] Platform Keyring initialized [ 4.289358] Key type asymmetric registered [ 4.293523] Asymmetric key parser 'x509' registered [ 4.298467] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 244) [ 4.305971] io scheduler mq-deadline registered [ 4.310925] pcieport 0000:00:01.0: PME: Signaling with IRQ 25 [ 4.316932] pcieport 0000:00:02.0: PME: Signaling with IRQ 27 [ 4.322933] pcieport 0000:00:03.0: PME: Signaling with IRQ 29 [ 4.328884] pcieport 0000:00:1c.0: PME: Signaling with IRQ 30 [ 4.334846] pcieport 0000:00:1c.2: PME: Signaling with IRQ 31 [ 4.340803] pcieport 0000:00:1c.4: PME: Signaling with IRQ 32 [ 4.346700] shpchp: Standard Hot Plug PCI Controller Driver version: 0.4 [ 4.354047] input: Power Button as /devices/LNXSYSTM:00/LNXSYBUS:00/PNP0C0C:00/input/input0 [ 4.362497] ACPI: Power Button [PWRB] [ 4.366244] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input1 [ 4.373747] ACPI: Power Button [PWRF] [ 4.378696] ERST: Error Record Serialization Table (ERST) support is initialized. [ 4.386260] pstore: Registered erst as persistent store backend [ 4.392419] GHES: APEI firmware first mode is enabled by APEI bit and WHEA _OSC. [ 4.400000] Serial: 8250/16550 driver, 32 ports, IRQ sharing enabled [ 4.426911] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A [ 4.454845] 00:04: ttyS1 at I/O 0x2f8 (irq = 3, base_baud = 115200) is a 16550A [ 4.463272] Linux agpgart interface v0.103 [ 4.598744] loop: module loaded [ 4.602141] tun: Universal TUN/TAP device driver, 1.6 [ 4.607307] PPP generic driver version 2.4.2 [ 4.611699] VFIO - User Level meta-driver version: 0.3 [ 4.616991] ehci_hcd: USB 2.0 'Enhanced' Host Controller (EHCI) Driver [ 4.623587] ehci-pci: EHCI PCI platform driver [ 4.628238] ehci-pci 0000:00:1a.0: EHCI Host Controller [ 4.633538] ehci-pci 0000:00:1a.0: new USB bus registered, assigned bus number 1 [ 4.641027] ehci-pci 0000:00:1a.0: debug port 2 [ 4.649508] ehci-pci 0000:00:1a.0: cache line size of 64 is not supported [ 4.656372] ehci-pci 0000:00:1a.0: irq 18, io mem 0xfb434000 [ 4.674738] ehci-pci 0000:00:1a.0: USB 2.0 started, EHCI 1.00 [ 4.680581] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.04 [ 4.688931] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 4.696234] usb usb1: Product: EHCI Host Controller [ 4.701178] usb usb1: Manufacturer: Linux 5.4.0-177-generic ehci_hcd [ 4.707592] usb usb1: SerialNumber: 0000:00:1a.0 [ 4.712361] hub 1-0:1.0: USB hub found [ 4.716181] hub 1-0:1.0: 2 ports detected [ 4.720460] ehci-pci 0000:00:1d.0: EHCI Host Controller [ 4.725752] ehci-pci 0000:00:1d.0: new USB bus registered, assigned bus number 2 [ 4.733240] ehci-pci 0000:00:1d.0: debug port 2 [ 4.741735] ehci-pci 0000:00:1d.0: cache line size of 64 is not supported [ 4.748594] ehci-pci 0000:00:1d.0: irq 18, io mem 0xfb433000 [ 4.766695] ehci-pci 0000:00:1d.0: USB 2.0 started, EHCI 1.00 [ 4.772534] usb usb2: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.04 [ 4.780888] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 4.788192] usb usb2: Product: EHCI Host Controller [ 4.793132] usb usb2: Manufacturer: Linux 5.4.0-177-generic ehci_hcd [ 4.799550] usb usb2: SerialNumber: 0000:00:1d.0 [ 4.804317] hub 2-0:1.0: USB hub found [ 4.808129] hub 2-0:1.0: 2 ports detected [ 4.812329] ehci-platform: EHCI generic platform driver [ 4.817627] ohci_hcd: USB 1.1 'Open' Host Controller (OHCI) Driver [ 4.823876] ohci-pci: OHCI PCI platform driver [ 4.828396] ohci-platform: OHCI generic platform driver [ 4.833693] uhci_hcd: USB Universal Host Controller Interface driver [ 4.840247] xhci_hcd 0000:00:14.0: xHCI Host Controller [ 4.845540] xhci_hcd 0000:00:14.0: new USB bus registered, assigned bus number 3 [ 4.854068] xhci_hcd 0000:00:14.0: hcc params 0x200077c1 hci version 0x100 quirks 0x0000000000009810 [ 4.863295] xhci_hcd 0000:00:14.0: cache line size of 64 is not supported [ 4.870289] xhci_hcd 0000:00:14.0: xHCI Host Controller [ 4.875576] xhci_hcd 0000:00:14.0: new USB bus registered, assigned bus number 4 [ 4.883052] xhci_hcd 0000:00:14.0: Host supports USB 3.0 SuperSpeed [ 4.889401] usb usb3: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.04 [ 4.897746] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 4.905048] usb usb3: Product: xHCI Host Controller [ 4.909991] usb usb3: Manufacturer: Linux 5.4.0-177-generic xhci-hcd [ 4.916406] usb usb3: SerialNumber: 0000:00:14.0 [ 4.921219] hub 3-0:1.0: USB hub found [ 4.925050] hub 3-0:1.0: 15 ports detected [ 4.931312] usb usb4: New USB device found, idVendor=1d6b, idProduct=0003, bcdDevice= 5.04 [ 4.939659] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 4.946962] usb usb4: Product: xHCI Host Controller [ 4.951904] usb usb4: Manufacturer: Linux 5.4.0-177-generic xhci-hcd [ 4.958323] usb usb4: SerialNumber: 0000:00:14.0 [ 4.963123] hub 4-0:1.0: USB hub found [ 4.966955] hub 4-0:1.0: 6 ports detected [ 4.972137] i8042: PNP: No PS/2 controller found. [ 4.976977] mousedev: PS/2 mouse device common for all mice [ 4.978674] usb 1-1: new high-speed USB device number 2 using ehci-pci [ 4.982721] rtc_cmos 00:00: RTC can wake from S4 [ 4.994059] rtc_cmos 00:00: registered as rtc0 [ 4.998581] rtc_cmos 00:00: alarms up to one month, y3k, 114 bytes nvram, hpet irqs [ 5.006326] i2c /dev entries driver [ 5.009901] device-mapper: uevent: version 1.0.3 [ 5.014652] device-mapper: ioctl: 4.41.0-ioctl (2019-09-16) initialised: dm-devel@redhat.com [ 5.023186] platform eisa.0: Probing EISA bus 0 [ 5.027785] platform eisa.0: EISA: Cannot allocate resource for mainboard [ 5.034635] platform eisa.0: Cannot allocate resource for EISA slot 1 [ 5.041144] platform eisa.0: Cannot allocate resource for EISA slot 2 [ 5.047652] platform eisa.0: Cannot allocate resource for EISA slot 3 [ 5.054161] platform eisa.0: Cannot allocate resource for EISA slot 4 [ 5.060670] platform eisa.0: Cannot allocate resource for EISA slot 5 [ 5.066670] usb 2-1: new high-speed USB device number 2 using ehci-pci [ 5.067178] platform eisa.0: Cannot allocate resource for EISA slot 6 [ 5.080275] platform eisa.0: Cannot allocate resource for EISA slot 7 [ 5.086783] platform eisa.0: Cannot allocate resource for EISA slot 8 [ 5.093285] platform eisa.0: EISA: Detected 0 cards [ 5.098235] intel_pstate: Intel P-state driver initializing [ 5.104609] ledtrig-cpu: registered to indicate activity on CPUs [ 5.110786] drop_monitor: Initializing network drop monitor service [ 5.117221] NET: Registered protocol family 10 [ 5.125904] Segment Routing with IPv6 [ 5.129640] NET: Registered protocol family 17 [ 5.134216] Key type dns_resolver registered [ 5.139157] RAS: Correctable Errors collector initialized. [ 5.143020] usb 1-1: New USB device found, idVendor=8087, idProduct=800a, bcdDevice= 0.05 [ 5.144741] microcode: sig=0x406f1, pf=0x1, revision=0xb000040 [ 5.152962] usb 1-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 5.166129] microcode: Microcode Update Driver: v2.2. [ 5.166195] *** VALIDATE rdt *** [ 5.166284] hub 1-1:1.0: USB hub found [ 5.171312] resctrl: L3 allocation detected [ 5.178647] hub 1-1:1.0: 6 ports detected [ 5.182713] resctrl: L3DATA allocation detected [ 5.182714] resctrl: L3CODE allocation detected [ 5.190649] usb 3-12: new high-speed USB device num 2 using xhci_hcd [ 5.191381] resctrl: L3 monitoring detected [ 5.191383] IPI shorthand broadcast: enabled [ 5.211261] sched_clock: Marking stable (4204608738, 1006637056)->(5541575874, -330330080) [ 5.219704] registered taskstats version 1 [ 5.223876] Loading compiled-in X.509 certificates [ 5.227036] usb 2-1: New USB device found, idVendor=8087, idProduct=8002, bcdDevice= 0.05 [ 5.229269] Loaded X.509 cert 'Build time autogenerated kernel key: 1224c9b81ccdd6d5fadad4fbd6b8ad2b6b069117' [ 5.236991] usb 2-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 5.247484] Loaded X.509 cert 'Canonical Ltd. Live Patch Signing: 14df34d1a87cf37625abec039ef2bf521249b969' [ 5.254408] hub 2-1:1.0: USB hub found [ 5.264098] tsc: Refined TSC clocksource calibration: 3499.996 MHz [ 5.264793] Loaded X.509 cert 'Canonical Ltd. Kernel Module Signing: 88f752e560a1e0737e31163a466ad7b70a850c19' [ 5.264793] blacklist: Loading compiled-in revocation X.509 certificates [ 5.264813] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing: 61482aa2830d0ab2ad5af10b7250da9033ddcef0' [ 5.264827] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (2017): 242ade75ac4a15e50d50c84b0d45ff3eae707a03' [ 5.264841] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (ESM 2018): 365188c1d374d6b07c3c8f240f8ef722433d6a8b' [ 5.264855] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (2019): c0746fd6c5da3ae827864651ad66ae47fe24b3e8' [ 5.264869] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (2021 v1): a8d54bbb3825cfb94fa13c9f8a594a195c107b8d' [ 5.264883] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (2021 v2): 4cf046892d6fd3c9a5b03f98d845f90851dc6a8c' [ 5.264897] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (2021 v3): 100437bb6de6e469b581e61cd66bce3ef4ed53af' [ 5.264911] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (Ubuntu Core 2019): c1d57b8f6b743f23ee41f4f7ee292f06eecadfb9' [ 5.264943] zswap: loaded using pool lzo/zbud [ 5.268021] hub 2-1:1.0: 8 ports detected [ 5.274167] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x32734d20948, max_idle_ns: 440795306379 ns [ 5.274243] Key type ._fscrypt registered [ 5.274243] Key type .fscrypt registered [ 5.274311] pstore: Using crash dump compression: deflate [ 5.277934] Key type big_key registered [ 5.279653] Key type encrypted registered [ 5.279655] AppArmor: AppArmor sha1 policy hashing enabled [ 5.279664] ima: No TPM chip found, activating TPM-bypass! [ 5.279667] ima: Allocated hash algorithm: sha1 [ 5.279671] ima: No architecture policies found [ 5.279676] evm: Initialising EVM extended attributes: [ 5.279676] evm: security.selinux [ 5.279676] evm: security.SMACK64 [ 5.279677] evm: security.SMACK64EXEC [ 5.279677] evm: security.SMACK64TRANSMUTE [ 5.279677] evm: security.SMACK64MMAP [ 5.279678] evm: security.apparmor [ 5.279678] evm: security.ima [ 5.279678] evm: security.capability [ 5.279679] evm: HMAC attrs: 0x1 [ 5.280047] PM: Magic number: 4:244:58 [ 5.284245] rtc_cmos 00:00: setting system clock to 2024-04-19T03:04:19 UTC (1713495859) [ 5.358874] usb 3-12: New USB device found, idVendor=0557, idProduct=7000, bcdDevice= 0.00 [ 5.502413] usb 3-12: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 5.509721] clocksource: Switched to clocksource tsc [ 5.509989] hub 3-12:1.0: USB hub found [ 5.518756] hub 3-12:1.0: 4 ports detected [ 5.523540] Freeing unused decrypted memory: 2040K [ 5.528800] Freeing unused kernel image memory: 2768K [ 5.554702] Write protecting the kernel read-only data: 26624k [ 5.560972] Freeing unused kernel image memory: 2036K [ 5.566260] Freeing unused kernel image memory: 948K [ 5.577743] x86/mm: Checked W+X mappings: passed, no W+X pages found. [ 5.584249] x86/mm: Checking user space page tables [ 5.595494] x86/mm: Checked W+X mappings: passed, no W+X pages found. [ 5.602000] Run /init as init process Loading, please wait... Starting version 245.4-4ubuntu3.17 [ 5.723887] dca service started, version 1.12.1 [ 5.728902] i801_smbus 0000:0t [ 5.736413:11.4: AHCI 0001.0300 32 slots 4 ports 6 Gbps 0xf impl SATA mode [ 5.744598] ahci 0000:00:11.4: flags: 64bit ncq pm led clo pio slum part ems apst [ 5.752647] nvme nvme0: pci function 0000:02:00.0 [ 5.779501] igb: Intel(R) Gigabit Ethernet Network Driver - version 5.6.0-k [ 5.786544] igb: Copyright (c) 2007-2014 Intel Corporation. [ 5.786977] scsi host0: ahci [ 5.795271] ixgbe: Intel(R) 10 Gigabit PCI Express Network Driver - version 5.1.0-k [ 5.795785] scsi host1: ahci [ 5.803013] ixgbe: Copyright (c) 1999-2016 Intel Corporation. [ 5.827562] scsi host2: ahci [ 5.830645] usb 3-12.1: new low-speed USB device number 3 using xhci_hcd [ 5.842221] si [ 5.8452182048@0xfb438000 port 0xfb438100 irq 34 [ 5.852701] ata2: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438180 irq 34 [ 5.860179] ata3: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438200 irq 34 [ 5.867657] ata4: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438280 irq 34 [ 5.871258] nvme nvme0: 8/0/0 default/read/poll queues [ 5.881360] ahci 0000:00:1f.2: AHCI 0001.0300 32 slots 6 ports 6 Gbps 0x3f impl SATA mode [ 5.889625] ahci 0000:00:1f.2: flags: 64bit ncq pm led clo pio slum part ems apst [ 5.900046] igb 0000:07:00.0: added PHC on eth0 [ 5.904660] igb 0000:07:00.0: Intel(R) Gigabit Ethernet Network Connection [ 5.911598] igb 0000:07:00.0: eth0: (PCIe:5.0Gb/s:Width x4) 0c:c4:7a:d8:a2:0e [ 5.918875] igb 0000:07:00.0: eth0: PBA No: 050B00-000 [ 5.924075] igb 0000:07:00.0: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s) [ 5.963201] usb 3-12.1: New USB device found, idVendor=0557, idProduct=2419, bcdDevice= 1.00 [ 5.971729] usb 3-12.1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 5.979001] scsi host4: ahci [ 5.984593] scsi host5: ahci [ 5.987645] hidraw: raw HID events driver (C) Jiri Kosina [ 5.987763] scsi host6: ahci [ 5.996354] scsi host7: ahci [ 5.999303] igb 0000:07:00.1: added PHC on eth1 [ 6.003926] igb 0000:07:00.1: Intel(R) Gigabit Ethernet Network Connection [ 6.010869] igb 0000:07:00.1: eth1: (PCIe:5.0Gb/s:Width x4) 0c:c4:7a:d8:a2:0f [ 6.018168] igb 0000:07:00.1: eth1: PBA No: 050B00-000 [ 6.023369] igb 0000:07:00.1: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s) [ 6.031153] scsi host8: ahci [ 6.034223] scsi host9: ahci [ 6.037190] ata5: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432100 irq 54 [ 6.044670] ata6: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432180 irq 54 [ 6.052149] ata7: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432200 irq 54 [ 6.059629] ata8: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432280 irq 54 [ 6.067109] ata9: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432300 irq 54 [ 6.074588] ata10: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432380 irq 54 [ 6.189704] ata2: SATA link down (SStatus 0 SControl 300) [ 6.195183] ata3: SATA link down (SStatus 0 SControl 300) [ 6.200660] ata1: SATA link down (SStatus 0 SControl 300) [ 6.206136] ata4: SATA link down (SStatus 0 SControl 300) [ 6.398026] ata7: SATA link down (SStatus 0 SControl 300) [ 6.403508] ata5: SATA link up 6.0 Gbps (SStatus 133 SControl 300) [ 6.409762] ata9: SATA link down (SStatus 0 SControl 300) [ 6.415240] ata8: SATA link down (SStatus 0 SControl 300) [ 6.420718] ata6: SATA link down (SStatus 0 SControl 300) [ 6.426192] ata10: SATA link down (SStatus 0 SControl 300) [ 6.432497] ata5.00: NCQ Send/Recv Log not supported [ 6.437529] ata5.00: ATA-9: ST1000NM0033-9ZM173, SN06, max UDMA/133 [ 6.443866] ata5.00: 1953525168 sectors, multi 16: LBA48 NCQ (depth 32), AA [ 6.452314] ata5.00: NCQ Send/Recv Log not supported [ 6.457350] ata5.00: configured for UDMA/133 [ 6.461775] scsi 4:0:0:0: Direct-Access ATA ST1000NM0033-9ZM SN06 PQ: 0 ANSI: 5 [ 6.470066] sd 4:0:0:0: Attached scsi generic sg0 type 0 [ 6.470130] sd 4:0:0:0: [sda] 1953525168 512-byte logical blocks: (1.00 TB/932 GiB) [ 6.483189] sd 4:0:0:0: [sda] Write Protect is off [ 6.488052] sd 4:0:0:0: [sda] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA [ 6.529845] sda: sda1 [ 6.546752] sd 4:0:0:0: [sda] Attached SCSI disk [ 6.552670] igb 0000:07:00.0 eno1: renamed from eth0 [ 6.558883] usbcore: registered new interface driver usbhid [ 6.564525] usbhid: USB HID core driver [ 6.570279] i HID 0557:2419 as /devices/pci0000:00/0000:00:14.0/usb3/3-12/3-12.1/3-12.1:1.0/0003:0557:2419.0001/input/input2 [ 6.586928] igb 0000:07:00.1 eno2: renamed from eth1 [ 6.642754] hid-generic 0003:0557:2419.0001: input,hidraw0: USB HID v1.00 Keyboard [HID 0557:2419] on usb-0000:00:14.0-12.1/input0 [ 6.654695] input: HID 0557:2419 as /devices/pci0000:00/0000:00:14.0/usb3/3-12/3-12.1/3-12.1:1.1/0003:0557:2419.0002/input/input3 [ 6.666519] hid-generic 0003:0557:2419.0002: input,hidraw1: USB HID v1.00 Mouse [HID 0557:2419] on usb-0000:00:14.0-12.1/input1 [ 7.026812] ixgbe 0000:03:00.0: Multiqueue Enabled: Rx Queue count = 8, Tx Queue count = 8 XDP Queue count = 0 [ 7.037180] ixgbe 0000:03:00.0: 32.000 Gb/s available PCIe bandwidth (5.0 GT/s PCIe x8 link) [ 7.045778] ixgbe 0000:03:00.0: MAC: 2, PHY: 1, PBA No: 0210FF-0FF [ 7.052020] ixgbe 0000:03:00.0: 0c:c4:7a:8f:d8:04 [ 7.059710] ixgbe 0000:03:00.0: Intel(R) 10 Gigabit Network Connection [ 7.226774] ixgbe 0000:03:00.1: Multiqueue Enabled: Rx Queue count = 8, Tx Queue count = 8 XDP Queue count = 0 [ 7.237143] ixgbe 0000:03:00.1: 32.000 Gb/s available PCIe bandwidth (5.0 GT/s PCIe x8 link) [ 7.245740] ixgbe 0000:03:00.1: MAC: 2, PHY: 14, SFP+: 4, PBA No: 0210FF-0FF [ 7.252847] ixgbe 0000:03:00.1: 0c:c4:7a:8f:d8:05 [ 7.260499] ixgbe 0000:03:00.1: Intel(R) 10 Gigabit Network Connection [ 7.267856] ixgbe 0000:03:00.0 enp3s0f0: renamed from eth0 [ 7.298865] ixgbe 0000:03:00.1 enp3s0f1: renamed from eth1 Begin: Loading essential drivers ... done. Begin: Running /scripts/init-premount ... done. Begin: Mounting root file system ... Begin: Running /scripts/local-top ... done. Begin: Running /scripts/local-premount ... done. Begin: Will now check root file system ... fsck from util-linux 2.34 [/usr/sbin/fsck.ext4 (1) -- /dev/sda1] fsck.ext4 -a -C0 /dev/sda1 /dev/sda1: clean, 303186/61054976 files, 8079014/244190336 blocks done. [ 7.466604] EXT4-fs (sda1): mounted filesystem with ordered data mode. Opts: (null) done. Begin: Running /scripts/local-bottom ... done. Begin: Running /scripts/init-bottom ... done. [ 8.190492] systemd[1]: Inserted module 'autofs4' [ 8.274726] systemd[1]: systemd 245.4-4ubuntu3.17 running in system mode. (+PAM +AUDIT +SELINUX +IMA +APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 +SECCOMP +BLKID +ELFUTILS +KMOD +IDN2 -IDN +PCRE2 default-hierarchy=hybrid) [ 8.314735] systemd[1]: Detected architecture x86-64. Welcome to Ubuntu 20.04.4 LTS! [ 8.364697] systemd[1]: Set hostname to . [ 9.626980] systemd[1]: Created slice system-modprobe.slice. [ OK ] Created slice system-modprobe.slice. [ 9.646977] systemd[1]: Created slice system-serial\x2dgetty.slice. [ OK ] Created slice system-serial\x2dgetty.slice. [ 9.670984] systemd[1]: Created slice User and Session Slice. [ OK ] Created slice User and Session Slice. [ 9.690870] systemd[1]: Started Forward Password Requests to Wall Directory Watch. [ OK ] Started Forward Password R…uests to Wall Directory Watch. [ 9.715193] systemd[1]: Set up automount Arbitrary Executable File Formats File System Automount Point. [ OK ] Set up automount Arbitrary…s File System Automount Point. [ 9.750806] systemd[1]: Reached target ceph target allowing to start/stop all ceph-fuse@.service instances at once. [ OK ] Reached target ceph target…se@.service instances at once. [ 9.778784] systemd[1]: Reached target ceph target allowing to start/stop all ceph-mon@.service instances at once. [ OK ] Reached target ceph target…on@.service instances at once. [ 9.806776] systemd[1]: Reached target ceph target allowing to start/stop all ceph-mds@.service instances at once. [ OK ] Reached target ceph target…ds@.service instances at once. [ 9.834769] systemd[1]: Reached target ceph target allowing to start/stop all ceph-mgr@.service instances at once. [ OK ] Reached target ceph target…gr@.service instances at once. [ 9.862762] systemd[1]: Reached target ceph target allowing to start/stop all ceph-osd@.service instances at once. [ OK ] Reached target ceph target…sd@.service instances at once. [ 9.890712] systemd[1]: Reached target ceph target allowing to start/stop all ceph-radosgw@.service instances at once. [ OK ] Reached target ceph target…gw@.service instances at once. [ 9.918803] systemd[1]: Reached target User and Group Name Lookups. [ OK ] Reached target User and Group Name Lookups. [ 9.942714] systemd[1]: Reached target Slices. [ OK ] Reached target Slices. [ 9.962881] systemd[1]: Listening on Device-mapper event daemon FIFOs. [ OK ] Listening on Device-mapper event daemon FIFOs. [ 9.986955] systemd[1]: Listening on LVM2 poll daemon socket. [ OK ] Listening on LVM2 poll daemon socket. [ 10.009846] systemd[1]: Listening on RPCbind Server Activation Socket. [ OK ] Listening on RPCbind Server Activation Socket. [ 10.034976] systemd[1]: Listening on Syslog Socket. [ OK ] Listening on Syslog Socket. [ 10.054800] systemd[1]: Listening on fsck to fsckd communication Socket. [ OK ] Listening on fsck to fsckd communication Socket. [ 10.078751] systemd[1]: Listening on initctl Compatibility Named Pipe. [ OK ] Listening on initctl Compatibility Named Pipe. [ 10.102860] systemd[1]: Listening on Journal Audit Socket. [ OK ] Listening on Journal Audit Socket. [ 10.122921] systemd[1]: Listening on Journal Socket (/dev/log). [ OK ] Listening on Journal Socket (/dev/log). [ 10.142992] systemd[1]: Listening on Journal Socket. [ OK ] Listening on Journal Socket. [ 10.162932] systemd[1]: Listening on udev Control Socket. [ OK ] Listening on udev Control Socket. [ 10.182824] systemd[1]: Listening on udev Kernel Socket. [ OK ] Listening on udev Kernel Socket. [ 10.203531] systemd[1]: Mounting Huge Pages File System... Mounting Huge Pages File System... [ 10.223711] systemd[1]: Mounting POSIX Message Queue File System... Mounting POSIX Message Queue File System... [ 10.247573] systemd[1]: Mounting NFSD configuration filesystem... Mounting NFSD configuration filesystem... [ 10.271411] systemd[1]: Mounting RPC Pipe File System... Mounting RPC Pipe File System... [ 10.291446] systemd[1]: Mounting Kernel Debug File System... Mounting Kernel Debug File System... [ 10.309467] RPC: Registered named UNIX socket transport module. [ 10.315462] RPC: Registered udp transport module. [ 10.316622] systemd[1]: Mounting Kernel Trace File System... [ 10.320241] RPC: Registered tcp transport module. [ 10.330739] RPC: Registered tcp NFSv4.1 backchannel transport module. Mounting Kernel Trace File System... [ 10.351714] systemd[1]: Starting Journal Service... Starting Journal Service... [ 10.370766] systemd[1]: Condition check resulted in Kernel Module supporting RPCSEC_GSS being skipped. [ 10.381977] systemd[1]: Starting Set the console keyboard layout... Startin[ 10.388755] Installing knfsd (copyright (C) 1996 okir@monad.swb.de). g Set the console keyboard layout... [ 10.411458] systemd[1]: Starting Create list of static device nodes for the current kernel... Starting Create list of st…odes for the current kernel... [ 10.439515] systemd[1]: Starting Monitoring of LVM2 mirrors, snapshots etc. using dmeventd or progress polling... Starting Monitoring of LVM…meventd or progress polling... [ 10.467394] systemd[1]: Starting Load Kernel Module drm... Starting Load Kernel Module drm... [ 10.486723] systemd[1]: Condition check resulted in OpenVSwitch configuration for cleanup being skipped. [ 10.498531] systemd[1]: Condition check resulted in Set Up Additional Binary Formats being skipped. [ 10.507709] systemd[1]: Condition check resulted in File System Check on Root Device being skipped. [ 10.518017] systemd[1]: Starting Load Kernel Modules... Starting Load Kernel Modules... [ 10.539319] systemd[1]: Starting Remount Root and Kernel File Systems... Starting Remount Root and Kernel File Systems... [ 10.551628] EXT4-fs (sda1): re-mounted. Opts: errors=remount-ro,user_xattr [ 10.563404] systemd[1]: Starting udev Coldplug all Devices... Starting udev Coldplug all Dev[ 10.572498] lp: driver loaded but no devices found ices... [ 10.587387] systemd[1]: Starting Uncomplicated firewall... Starting Uncomplicated firewall... [ 10.606833] Loading iSCSI transport class v2.0-870. [ 10.608097] systemd[1]: Started Journal Service. [ OK ] Started Journal Service. [ OK ] Mounted Huge Pages File System. [ OK ] Mounted POSIX Message Queue File System. [ OK ] Mounted NFSD configuration filesystem. [ OK ] Mounted RPC Pipe File System. [ OK ] Mounted Kernel Debug File System. [ OK ] Mounted Kernel Trace File System. [ OK ] Finished Set the console keyboard layout. [ OK ] Finished Create list of st… nodes for the current kernel. [ OK ] Finished Monitoring of LVM… dmeventd or progress polling. [ OK ] Finished Load Kernel Module drm. [ OK ] Finished Load Kernel Modules. [ OK ] Finished Remount Root and Kernel File Systems. [ OK ] Finished Uncomplicated firewall. Activating swap /swapfile... Mounting FUSE Control File System... Mounting Kernel Configuration File System... Starting pNFS block layout mapping daemon... [ 10.918717] Adding 2097148k swap on /swapfile. Priority:-2 extents:6 across:2260988k FS Starting Flush Journal to Persistent Storage... [ 10.939247] systemd-journald[364]: Received client request to flush runtime journal. Starting Load/Save Random Seed... Starting Apply Kernel Variables... Starting Create System Users... [ OK ] Activated swap /swapfile. [ OK ] Finished udev Coldplug all Devices. [ OK ] Mounted FUSE Control File System. [ OK ] Mounted Kernel Configuration File System. [ OK ] Started pNFS block layout mapping daemon. [ OK ] Reached target Swap. Starting Helper to synchronize boot up for ifupdown... [ OK ] Finished Load/Save Random Seed. [ OK ] Finished Create System Users. [ OK ] Finished Apply Kernel Variables. Starting Create Static Device Nodes in /dev... [ OK ] Finished Create Static Device Nodes in /dev. [ OK ] Reached target Local File Systems (Pre). [ OK ] Reached target Local File Systems. Starting Load AppArmor profiles... Starting Set console font and keymap... Starting Create final runt…dir for shutdown pivot root... Starting Preprocess NFS configuration... Starting Tell Plymouth To Write Out Runtime Data... Starting QEMU KVM preparation - module, ksm, hugepages... Starting udev Kernel Device Manager... [ OK ] Finished Set console font and keymap. [ OK ] Finished Create final runt…e dir for shutdown pivot root. [ OK ] Finished Preprocess NFS configuration. [ OK ] Finished Tell Plymouth To Write Out Runtime Data. Starting NFSv4 ID-name mapping service... [ OK ] Reached target NFS client services. [ OK ] Started NFSv4 ID-name mapping service. [ OK ] Finished QEMU KVM preparation - module, ksm, hugepages. [ OK ] Finished Flush Journal to Persistent Storage. [ OK ] Started udev Kernel Device Manager. [ OK ] Started Dispatch Password …ts to Console Directory Watch. [ OK ] Reached target Local Encrypted Volumes. [ OK ] Reached target Paths. Starting Network Service... Starting Create Volatile Files and Directories... [ OK ] Finished Load AppArmor profiles. [ OK ] Finished Create Volatile Files and Directories. Starting RPC bind portmap service... Starting Update UTMP about System Boot/Shutdown... [ OK ] Finished Update UTMP about System Boot/Shutdown. [ OK ] Reached target System Initialization. [ OK ] Started Daily apt download activities. [ OK ] Started Daily apt upgrade and clean activities. [ OK ] Started Periodic ext4 Onli…ata Check for All Filesystems. [ OK ] Started Discard unused blocks once a week. [ OK ] Started Daily rotation of log files. [ OK ] Started Daily man-db regeneration. [ OK ] Started Message of the Day. [ OK ] Started Daily Cleanup of Temporary Directories. [ OK ] Started Ubuntu Advantage Timer for running repeated jobs. [ OK ] Reached target Timers. [ OK ] Listening on D-Bus System Message Bus Socket. Starting Docker Socket for the API. [ OK ] Listening on Open-iSCSI iscsid Socket. [ OK ] Listening on UUID daemon activation socket. [ OK ] Listening on Docker Socket for the API. [ OK ] Found device /dev/ttyS1. [ OK ] Started Network Service. [ OK ] Found device /dev/vg_nvme/lv_5. [ OK ] Created slice system-lvm2\x2dpvscan.slice. [ OK ] Reached target Sockets. [ OK ] Reached target Basic System. [ OK ] Listening on Load/Save RF …itch Status /dev/rfkill Watch. Mounting /var/lib/ceph... Starting Accounts Service... [ OK ] Started Ceph crash dump collector. [ OK ] Reached target ceph target…h*@.service instances at once. [ OK ] Started D-Bus System Message Bus. [ OK ] Started Save initial kernel messages after boot. Starting Remove Stale Onli…t4 Metadata Check Snapshots... Starting Record successful boot for GRUB... [ OK ] Started irqbalance daemon. [ OK ] Started LTTng session daemon. Starting LVM event activation on device 259:0... Starting Dispatcher daemon for systemd-networkd... [ OK ] Started Set the CPU Frequency Scaling governor. Starting System Logging Service... Starting Self Monitoring a…g Technology (SMART) Daemon... Starting Resets System Activity Data Collector... Starting Login Service... Starting Wait for Network to be Configured... Starting Network Name Resolution... [ OK ] Started RPC bind portmap service. [ OK ] Mounted /var/lib/ceph. [ OK ] Finished Remove Stale Onli…ext4 Metadata Check Snapshots. [ OK ] Finished LVM event activation on device 259:0. [ OK ] Finished Resets System Activity Data Collector. [ OK ] Started Login Service. [ OK ] Reached target RPC Port Mapper. [ OK ] Found device 82599ES 10-Gi…ion (AOC-STGN-I2S [REV 1.01]). [ OK ] Started ifup for enp3s0f1. [ OK ] Started System Logging Service. [ OK ] Finished Record successful boot for GRUB. Starting GRUB failed boot detection... [ OK ] Finished GRUB failed boot detection. [ OK ] Finished Helper to synchronize boot up for ifupdown. Starting Raise network interfaces... [ OK ] Started Self Monitoring an…ing Technology (SMART) Daemon. [ OK ] Started Network Name Resolution. [ OK ] Reached target Host and Network Name Lookups. Starting Authorization Manager... [ OK ] Started Authorization Manager. [ OK ] Started Accounts Service. [ OK ] Started Dispatcher daemon for systemd-networkd. [* ] (1 of 2) A start job is running for… network interfaces (8s / 5min 4s) M [ OK ] Finished Wait for Network to be Configured.  Stopping Network Name Resolution... [ OK ] Stopped Network Name Resolution. Starting Network Name Resolution... [ OK ] Started Network Name Resolution. [ OK ] Finished Raise network interfaces. [ OK ] Reached target Network. [ OK ] Reached target Network is Online. Starting containerd container runtime... Starting NFS Mount Daemon... Starting Network Time Service... Starting Map RBD devices... Starting /etc/rc.local Compatibility... + '[' '!' -f /.cephlab_net_configured ']' + set +e + attempts=0 + myips= + '[' '' '!=' '' ']' + '[' 0 -ge 10 ']' ++ ip -4 addr ++ grep -oP '(?<=inet\s)\d+(\.\d+){3}' ++ grep -v '127.0.0.1\|127.0.1.1' + myips=172.21.15.97 + attempts=1 + sleep 1 Starting OpenBSD Secure Shell server... Starting (i)SCSI target daemon... Starting Ubuntu FAN network setup... [ OK ] Started Unattended Upgrades Shutdown. [ OK ] Started NFS Mount Daemon. [ OK ] Finished Map RBD devices. + '[' 172.21.15.97 '!=' '' ']' + set -e + '[' -n 172.21.15.97 ']' + for ip in $myips + timeout 1s ping -I 172.21.15.97 -nq -c1 172.21.0.1 ++ dig +short -x 172.21.15.97 @172.21.0.1 ++ sed 's/\.com.*/\.com/g' + newhostname=smithi097.front.sepia.ceph.com + '[' -n smithi097.front.sepia.ceph.com ']' + hostname smithi097.front.sepia.ceph.com ++ hostname -d + newdomain=front.sepia.ceph.com ++ hostname -s + shorthostname=smithi097 + echo smithi097 + grep -q front.sepia.ceph.com /etc/hosts + sed -i 's/.*front.sepia.ceph.com.*/172.21.15.97 smithi097.front.sepia.ceph.com smithi097/g' /etc/hosts + break + command -v zypper + command -v apt-get + '[' '!' -f /etc/ssh/ssh_host_rsa_key ']' + '[' -e /.cephlab_rc_local ']' + exit 0 [ OK ] Started /etc/rc.local Compatibility. Starting Hold until boot process finishes up... Starting Terminate Plymouth Boot Screen... [ OK ] Finished Hold until boot process finishes up. [ OK ] Finished Terminate Plymouth Boot Screen. [ OK ] Started Serial Getty on ttyS1. Starting Set console scheme... [ OK ] Finished Set console scheme. [ OK ] Created slice system-getty.slice. [ OK ] Started Getty on tty1. [ OK ] Reached target Login Prompts. [ OK ] Started containerd container runtime. Starting Docker Application Container Engine... [ OK ] Started LSB: Collectl monitors system performance.. Ubuntu 20.04.4 LTS smithi097.front.sepia.ceph.com ttyS1 2024-04-19T03:04:35.248 DEBUG:teuthology.orchestra.console.smithi097:expect after: smithi097 login: 2024-04-19T03:04:35.301 DEBUG:teuthology.orchestra.console.smithi097:console disconnect output: [Enter `^Ec?' for help] \x80 \x80 \x80  t XE v2.1.60 PXE 2.1 Build 088 (WfM 2.0)  Press Ctrl+S to enter the Setup Menu.                      Initializing Intel(R) Boot Agent XE v2.1.60 Press Ctrl+S to enter the Setup Menu..  \x80 \x80 Initializing Intel(R) Boot Agent XE v2.1.60 PXE 2.1 Build 088 (WfM 2.0)  Press Ctrl+S to enter the Setup Menu.                      Press Ctrl+S to enter the Setup Menu..  \x80 \x80  el(R) Boot A t GE v1.5.13 PXE 2.1 Build 092 (WfM 2.0) Press Ctrl+S to enter the Setup Menu.                       Initializing Intel(R) Boot Agent GE v1.5.13 Press Ctrl+S to enter the Setup Menu..  \x80 \x80 \x80 \x80  Intel(R) Boot Agent XE v2.1.60 Copyright (C) 1997-2009, Intel Corporation  CLIENT MAC ADDR: 0C C4 7A 8F D8 05 GUID: 00000000 0000 0000 0000 0CC47AD8A20E DHCP.-                    DHCP.| DHCP./ DHCP.- DHCP.\ DHCP.| DHCP./  21.15.97 MAS 255.255.240.0 DHCP IP: 172.21.0.10 GATEWAY IP: 172.21.15.254 PXE->EB: !PXE at 96D3:0070, entry point at 96D3:0106  UNDI code segment 96D3:3E70, data segment 8F94:73F0 (574-619kB)  UNDI device is PCI 03:00.1, type DIX+802.3  574kB free base memory after PXE unload iPXE initialising devices... CLIENT IP: 172.21.15.97 MASK: 255.255.240.0 DHCP IP: 172.21.0.10 iPXE initialising devices...ok iPXE 1.20.1+ (g4bd0) -- Open Source Network Boot Firmware -- http://ipxe.org Features: DNS FTP HTTP HTTPS iSCSI NFS TFTP VLAN AoE ELF MBOOT PXE bzImage Menu PXEXT Configuring (net0 0c:c4:7a:8f:d8:05)... Configuring (net0 0c:c4:7a:8f:d8:05).... Configuring (net0 0c:c4:7a:8f:d8:05)..... Configuring (net0 0c:c4:7a:8f:d8:05)...... ok  GNU GRUB version 2.04   ******************************************************************************  * Ubuntu *  **Advanced options for Ubuntu *  * *  * *  * *  * *  * *  * *  * *  * *  * *  * *  * *  ******************************************************************************   Use the * and * keys to select which entry is highlighted.  Press enter to boot the selected OS, `e' to edit the commands  before booting or `c' for a command-line.  The highlighted entry will be executed automatically in 4s.  The highlighted entry will be executed automatically in 3s.  The highlighted entry will be executed automatically in 2s.  The highlighted entry will be executed automatically in 1s.                     [ 0.000000] microcode: microcode updated early to revision 0xb000040, date = 2021-05-19 [ 0.000000] Linux version 5.4.0-177-generic (buildd@lcy02-amd64-112) (gcc version 9.4.0 (Ubuntu 9.4.0-1ubuntu1~20.04.2)) #197-Ubuntu SMP Thu Mar 28 22:45:47 UTC 2024 (Ubuntu 5.4.0-177.197-generic 5.4.268) [ 0.000000] Command line: BOOT_IMAGE=/boot/vmlinuz-5.4.0-177-generic root=UUID=1168b92c-82ac-47e1-87d9-5d77414c7738 ro pci=realloc=off console=tty0 console=ttyS1,115200 [ 0.000000] KERNEL supported cpus: [ 0.000000] Intel GenuineIntel [ 0.000000] AMD AuthenticAMD [ 0.000000] Hygon HygonGenuine [ 0.000000] Centaur CentaurHauls [ 0.000000] zhaoxin Shanghai [ 0.000000] BIOS-provided physical RAM map: [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000008bbff] usable [ 0.000000] BIOS-e820: [mem 0x00000000000e0000-0x00000000000fffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x0000000078ec1fff] usable [ 0.000000] BIOS-e820: [mem 0x0000000078f74000-0x00000000798adfff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000798ae000-0x0000000079d4afff] ACPI NVS [ 0.000000] BIOS-e820: [mem 0x0000000079d4b000-0x000000008fffffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed44fff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000ff000000-0x00000000ffffffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x000000087fffffff] usable [ 0.000000] NX (Execute Disable) protection: active [ 0.000000] SMBIOS 3.0 present. [ 0.000000] DMI: Supermicro SYS-5018R-WR/X10SRW-F, BIOS 2.0 12/17/2015 [ 0.000000] tsc: Fast TSC calibration using PIT [ 0.000000] tsc: Detected 3499.945 MHz processor [ 0.001009] last_pfn = 0x880000 max_arch_pfn = 0x400000000 [ 0.001442] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT [ 0.001979] last_pfn = 0x78ec2 max_arch_pfn = 0x400000000 [ 0.007586] found SMP MP-table at [mem 0x000fda20-0x000fda2f] [ 0.007629] check: Scanning 1 areas for low memory corruption [ 0.007633] Using GB pages for direct mapping [ 0.007728] RAMDISK: [mem 0x3157d000-0x34ab5fff] [ 0.007733] ACPI: Early table checksum verification disabled [ 0.007736] ACPI: RSDP 0x00000000000F0580 000024 (v02 SUPERM) [ 0.007738] ACPI: XSDT 0x00000000798AE098 0000B4 (v01 01072009 AMI 00010013) [ 0.007742] ACPI: FACP 0x00000000798E15B0 00010C (v05 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.007746] ACPI: DSDT 0x00000000798AE1E8 0333C4 (v02 SUPERM SMCI--MB 01072009 INTL 20091013) [ 0.007748] ACPI: FACS 0x0000000079D49F80 000040 [ 0.007750] ACPI: APIC 0x00000000798E16C0 0000C8 (v03 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.007752] ACPI: FPDT 0x00000000798E1788 000044 (v01 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.007754] ACPI: FIDT 0x00000000798E17D0 00009C (v01 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.007756] ACPI: SPMI 0x00000000798E1870 000040 (v05 SUPERM SMCI--MB 00000000 AMI. 00000000) [ 0.007758] ACPI: MCFG 0x00000000798E18B0 00003C (v01 SUPERM SMCI--MB 01072009 MSFT 00000097) [ 0.007760] ACPI: UEFI 0x00000000798E18F0 000042 (v01 SUPERM SMCI--MB 01072009 00000000) [ 0.007762] ACPI: HPET 0x00000000798E1938 000038 (v01 SUPERM SMCI--MB 00000001 INTL 20091013) [ 0.007764] ACPI: WDDT 0x00000000798E1970 000040 (v01 SUPERM SMCI--MB 00000000 INTL 20091013) [ 0.007766] ACPI: SSDT 0x00000000798E19B0 01717F (v02 SUPERM PmMgt 00000001 INTL 20120913) [ 0.007768] ACPI: SSDT 0x00000000798F8B30 00264C (v02 SUPERM SpsNm 00000002 INTL 20120913) [ 0.007770] ACPI: SSDT 0x00000000798FB180 000064 (v02 SUPERM SpsNvs 00000002 INTL 20120913) [ 0.007772] ACPI: PRAD 0x00000000798FB1E8 000102 (v02 SUPERM SMCI--MB 00000002 INTL 20120913) [ 0.007774] ACPI: DMAR 0x00000000798FB2F0 0000BC (v01 SUPERM SMCI--MB 00000001 INTL 20091013) [ 0.007776] ACPI: HEST 0x00000000798FB3B0 00027C (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.007778] ACPI: BERT 0x00000000798FB630 000030 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.007780] ACPI: ERST 0x00000000798FB660 000230 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.007781] ACPI: EINJ 0x00000000798FB890 000130 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.007783] ACPI: Reserving FACP table memory at [mem 0x798e15b0-0x798e16bb] [ 0.007784] ACPI: Reserving DSDT table memory at [mem 0x798ae1e8-0x798e15ab] [ 0.007785] ACPI: Reserving FACS table memory at [mem 0x79d49f80-0x79d49fbf] [ 0.007786] ACPI: Reserving APIC table memory at [mem 0x798e16c0-0x798e1787] [ 0.007786] ACPI: Reserving FPDT table memory at [mem 0x798e1788-0x798e17cb] [ 0.007787] ACPI: Reserving FIDT table memory at [mem 0x798e17d0-0x798e186b] [ 0.007788] ACPI: Reserving SPMI table memory at [mem 0x798e1870-0x798e18af] [ 0.007788] ACPI: Reserving MCFG table memory at [mem 0x798e18b0-0x798e18eb] [ 0.007789] ACPI: Reserving UEFI table memory at [mem 0x798e18f0-0x798e1931] [ 0.007790] ACPI: Reserving HPET table memory at [mem 0x798e1938-0x798e196f] [ 0.007790] ACPI: Reserving WDDT table memory at [mem 0x798e1970-0x798e19af] [ 0.007791] ACPI: Reserving SSDT table memory at [mem 0x798e19b0-0x798f8b2e] [ 0.007792] ACPI: Reserving SSDT table memory at [mem 0x798f8b30-0x798fb17b] [ 0.007792] ACPI: Reserving SSDT table memory at [mem 0x798fb180-0x798fb1e3] [ 0.007793] ACPI: Reserving PRAD table memory at [mem 0x798fb1e8-0x798fb2e9] [ 0.007794] ACPI: Reserving DMAR table memory at [mem 0x798fb2f0-0x798fb3ab] [ 0.007794] ACPI: Reserving HEST table memory at [mem 0x798fb3b0-0x798fb62b] [ 0.007795] ACPI: Reserving BERT table memory at [mem 0x798fb630-0x798fb65f] [ 0.007796] ACPI: Reserving ERST table memory at [mem 0x798fb660-0x798fb88f] [ 0.007796] ACPI: Reserving EINJ table memory at [mem 0x798fb890-0x798fb9bf] [ 0.007867] No NUMA configuration found [ 0.007868] Faking a node at [mem 0x0000000000000000-0x000000087fffffff] [ 0.007876] NODE_DATA(0) allocated [mem 0x87ffd5000-0x87fffffff] [ 0.008046] Zone ranges: [ 0.008047] DMA [mem 0x0000000000001000-0x0000000000ffffff] [ 0.008048] DMA32 [mem 0x0000000001000000-0x00000000ffffffff] [ 0.008048] Normal [mem 0x0000000100000000-0x000000087fffffff] [ 0.008049] Device empty [ 0.008050] Movable zone start for each node [ 0.008053] Early memory node ranges [ 0.008054] node 0: [mem 0x0000000000001000-0x000000000008afff] [ 0.008054] node 0: [mem 0x0000000000100000-0x0000000078ec1fff] [ 0.008055] node 0: [mem 0x0000000100000000-0x000000087fffffff] [ 0.008287] Zeroed struct page in unavailable ranges: 29108 pages [ 0.008287] Initmem setup node 0 [mem 0x0000000000001000-0x000000087fffffff] [ 0.083827] ACPI: PM-Timer IO Port: 0x408 [ 0.083835] ACPI: LAPIC_NMI (acpi_id[0x00] high edge lint[0x1]) [ 0.083835] ACPI: LAPIC_NMI (acpi_id[0x02] high edge lint[0x1]) [ 0.083836] ACPI: LAPIC_NMI (acpi_id[0x04] high edge lint[0x1]) [ 0.083836] ACPI: LAPIC_NMI (acpi_id[0x06] high edge lint[0x1]) [ 0.083837] ACPI: LAPIC_NMI (acpi_id[0x01] high edge lint[0x1]) [ 0.083838] ACPI: LAPIC_NMI (acpi_id[0x03] high edge lint[0x1]) [ 0.083838] ACPI: LAPIC_NMI (acpi_id[0x05] high edge lint[0x1]) [ 0.083839] ACPI: LAPIC_NMI (acpi_id[0x07] high edge lint[0x1]) [ 0.083848] IOAPIC[0]: apic_id 1, version 32, address 0xfec00000, GSI 0-23 [ 0.083851] IOAPIC[1]: apic_id 2, version 32, address 0xfec01000, GSI 24-47 [ 0.083853] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) [ 0.083854] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) [ 0.083857] Using ACPI (MADT) for SMP configuration information [ 0.083858] ACPI: HPET id: 0x8086a701 base: 0xfed00000 [ 0.083862] TSC deadline timer available [ 0.083863] smpboot: Allowing 8 CPUs, 0 hotplug CPUs [ 0.083871] PM: Registered nosave memory: [mem 0x00000000-0x00000fff] [ 0.083872] PM: Registered nosave memory: [mem 0x0008b000-0x000dffff] [ 0.083873] PM: Registered nosave memory: [mem 0x000e0000-0x000fffff] [ 0.083874] PM: Registered nosave memory: [mem 0x78ec2000-0x78f73fff] [ 0.083874] PM: Registered nosave memory: [mem 0x78f74000-0x798adfff] [ 0.083875] PM: Registered nosave memory: [mem 0x798ae000-0x79d4afff] [ 0.083876] PM: Registered nosave memory: [mem 0x79d4b000-0x8fffffff] [ 0.083876] PM: Registered nosave memory: [mem 0x90000000-0xfed1bfff] [ 0.083877] PM: Registered nosave memory: [mem 0xfed1c000-0xfed44fff] [ 0.083877] PM: Registered nosave memory: [mem 0xfed45000-0xfeffffff] [ 0.083878] PM: Registered nosave memory: [mem 0xff000000-0xffffffff] [ 0.083879] [mem 0x90000000-0xfed1bfff] available for PCI devices [ 0.083880] Booting paravirtualized kernel on bare hardware [ 0.083883] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645519600211568 ns [ 0.083886] setup_percpu: NR_CPUS:8192 nr_cpumask_bits:8 nr_cpu_ids:8 nr_node_ids:1 [ 0.084092] percpu: Embedded 60 pages/cpu s208896 r8192 d28672 u262144 [ 0.084114] Built 1 zonelists, mobility grouping on. Total pages: 8228859 [ 0.084114] Policy zone: Normal [ 0.084116] Kernel command line: BOOT_IMAGE=/boot/vmlinuz-5.4.0-177-generic root=UUID=1168b92c-82ac-47e1-87d9-5d77414c7738 ro pci=realloc=off console=tty0 console=ttyS1,115200 [ 0.086309] Dentry cache hash table entries: 4194304 (order: 13, 33554432 bytes, linear) [ 0.087437] Inode-cache hash table entries: 2097152 (order: 12, 16777216 bytes, linear) [ 0.087516] mem auto-init: stack:off, heap alloc:on, heap free:off [ 0.164899] Memory: 32692632K/33438000K available (14339K kernel code, 2395K rwdata, 9292K rodata, 2768K init, 17228K bss, 745368K reserved, 0K cma-reserved) [ 0.165122] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=8, Nodes=1 [ 0.165135] Kernel/User page tables isolation: enabled [ 0.165162] ftrace: allocating 44725 entries in 175 pages [ 0.177476] ftrace: allocated 175 pages with 6 groups [ 0.177581] rcu: Hierarchical RCU implementation. [ 0.177583] rcu: RCU restricting CPUs from NR_CPUS=8192 to nr_cpu_ids=8. [ 0.177584] Tasks RCU enabled. [ 0.177584] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies. [ 0.177585] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=8 [ 0.179790] NR_IRQS: 524544, nr_irqs: 896, preallocated irqs: 16 [ 0.179971] random: crng init done [ 0.184831] Console: colour VGA+ 80x25 [ 0.195243] printk: console [tty0] enabled [ 1.126368] printk: console [ttyS1] enabled [ 1.130624] ACPI: Core revision 20190816 [ 1.134777] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 133484882848 ns [ 1.143999] APIC: Switch to symmetric I/O mode setup [ 1.149035] DMAR: Host address width 46 [ 1.152939] DMAR: DRHD base: 0x000000fbffc000 flags: 0x1 [ 1.158327] DMAR: dmar0: reg_base_addr fbffc000 ver 1:0 cap 8d2078c106f0466 ecap f020de [ 1.166415] DMAR: RMRR base: 0x0000007ba75000 end: 0x0000007ba84fff [ 1.172746] DMAR: ATSR flags: 0x0 [ 1.176128] DMAR: RHSA base: 0x000000fbffc000 proximity domain: 0x0 [ 1.182463] DMAR-IR: IOAPIC id 1 under DRHD base 0xfbffc000 IOMMU 0 [ 1.188885] DMAR-IR: IOAPIC id 2 under DRHD base 0xfbffc000 IOMMU 0 [ 1.195307] DMAR-IR: HPET id 0 under DRHD base 0xfbffc000 [ 1.200774] DMAR-IR: x2apic is disabled because BIOS sets x2apic opt out bit. [ 1.200774] DMAR-IR: Use 'intremap=no_x2apic_optout' to override the BIOS setting. [ 1.215897] DMAR-IR: Enabled IRQ remapping in xapic mode [ 1.221272] x2apic: IRQ remapping doesn't support X2APIC mode [ 1.227567] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 [ 1.252001] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x32731ca8b48, max_idle_ns: 440795250528 ns [ 1.262604] Calibrating delay loop (skipped), value calculated using timer frequency.. 6999.89 BogoMIPS (lpj=13999780) [ 1.266638] mce: CPU0: Thermal monitoring enabled (TM1) [ 1.270642] process: using mwait in idle threads [ 1.274604] Last level iTLB entries: 4KB 64, 2MB 8, 4MB 8 [ 1.278603] Last level dTLB entries: 4KB 64, 2MB 0, 4MB 0, 1GB 4 [ 1.282604] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization [ 1.286603] Spectre V2 : Mitigation: Retpolines [ 1.290602] Spectre V2 : Spectre v2 / SpectreRSB mitigation: Filling RSB on context switch [ 1.294602] Spectre V2 : Spectre v2 / SpectreRSB : Filling RSB on VMEXIT [ 1.298602] Spectre V2 : Enabling Restricted Speculation for firmware calls [ 1.302603] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier [ 1.306602] Spectre V2 : User space: Mitigation: STIBP via seccomp and prctl [ 1.310603] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl and seccomp [ 1.314606] MDS: Mitigation: Clear CPU buffers [ 1.318603] TAA: Mitigation: Clear CPU buffers [ 1.322602] MMIO Stale Data: Mitigation: Clear CPU buffers [ 1.326607] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' [ 1.330603] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' [ 1.334602] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' [ 1.338603] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 [ 1.342603] x86/fpu: Enabled xstate features 0x7, context size is 832 bytes, using 'standard' format. [ 1.346784] Freeing SMP alternatives memory: 40K [ 1.351927] pid_max: default: 32768 minimum: 301 [ 1.354624] LSM: Security Framework initializing [ 1.358609] Yama: becoming mindful. [ 1.362626] AppArmor: AppArmor initialized [ 1.366662] Mount-cache hash table entries: 65536 (order: 7, 524288 bytes, linear) [ 1.370642] Mountpoint-cache hash table entries: 65536 (order: 7, 524288 bytes, linear) [ 1.374612] *** VALIDATE tmpfs *** [ 1.378702] *** VALIDATE proc *** [ 1.382643] *** VALIDATE cgroup1 *** [ 1.386603] *** VALIDATE cgroup2 *** [ 1.390790] smpboot: CPU0: Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz (family: 0x6, model: 0x4f, stepping: 0x1) [ 1.394666] Performance Events: PEBS fmt2+, Broadwell events, 16-deep LBR, full-width counters, Intel PMU driver. [ 1.398604] ... version: 3 [ 1.402603] ... bit width: 48 [ 1.406603] ... generic registers: 4 [ 1.410603] ... value mask: 0000ffffffffffff [ 1.414603] ... max period: 00007fffffffffff [ 1.418603] ... fixed-purpose events: 3 [ 1.422603] ... event mask: 000000070000000f [ 1.426629] rcu: Hierarchical SRCU implementation. [ 1.431420] NMI watchdog: Enabled. Permanently consumes one hw-PMU counter. [ 1.434664] smp: Bringing up secondary CPUs ... [ 1.438673] x86: Booting SMP configuration: [ 1.442605] .... node #0, CPUs: #1 #2 #3 #4 [ 1.450815] MDS CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/mds.html for more details. [ 1.458603] TAA CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/tsx_async_abort.html for more details. [ 1.462603] MMIO Stale Data CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/processor_mmio_stale_data.html for more details. [ 1.466698] #5 #6 #7 [ 1.467145] smp: Brought up 1 node, 8 CPUs [ 1.474604] smpboot: Max logical packages: 1 [ 1.478603] smpboot: Total of 8 processors activated (55999.12 BogoMIPS) [ 1.484771] devtmpfs: initialized [ 1.486641] x86/mm: Memory block size: 128MB [ 1.493633] PM: Registering ACPI NVS region [mem 0x798ae000-0x79d4afff] (4837376 bytes) [ 1.494676] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns [ 1.498615] futex hash table entries: 2048 (order: 5, 131072 bytes, linear) [ 1.502644] pinctrl core: initialized pinctrl subsystem [ 1.506680] PM: RTC time: 03:04:15, date: 2024-04-19 [ 1.510690] NET: Registered protocol family 16 [ 1.514672] audit: initializing netlink subsys (disabled) [ 1.518609] audit: type=2000 audit(1713495853.332:1): state=initialized audit_enabled=0 res=1 [ 1.518683] EISA bus registered [ 1.525811] cpuidle: using governor ladder [ 1.526605] cpuidle: using governor menu [ 1.530615] ACPI FADT declares the system doesn't support PCIe ASPM, so disable it [ 1.534604] ACPI: bus type PCI registered [ 1.538603] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 [ 1.542650] PCI: MMCONFIG for domain 0000 [bus 00-ff] at [mem 0x80000000-0x8fffffff] (base 0x80000000) [ 1.546605] PCI: MMCONFIG at [mem 0x80000000-0x8fffffff] reserved in E820 [ 1.550613] PCI: Using configuration type 1 for base access [ 1.556599] HugeTLB registered 1.00 GiB page size, pre-allocated 0 pages [ 1.558605] HugeTLB registered 2.00 MiB page size, pre-allocated 0 pages [ 1.562663] ACPI: Added _OSI(Module Device) [ 1.566604] ACPI: Added _OSI(Processor Device) [ 1.570609] ACPI: Added _OSI(3.0 _SCP Extensions) [ 1.574603] ACPI: Added _OSI(Processor Aggregator Device) [ 1.578603] ACPI: Added _OSI(Linux-Dell-Video) [ 1.582603] ACPI: Added _OSI(Linux-Lenovo-NV-HDMI-Audio) [ 1.586603] ACPI: Added _OSI(Linux-HPI-Hybrid-Graphics) [ 1.632957] ACPI: 4 ACPI AML tables successfully acquired and loaded [ 1.637941] ACPI: [Firmware Bug]: BIOS _OSI(Linux) query ignored [ 1.642739] ACPI: Dynamic OEM Table Load: [ 1.670828] ACPI: Interpreter enabled [ 1.674560] ACPI: (supports S0 S4 S5) [ 1.674604] ACPI: Using IOAPIC for interrupt routing [ 1.678622] HEST: Enabling Firmware First mode for corrected errors. [ 1.682685] HEST: Table parsing has been initialized. [ 1.686604] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug [ 1.691269] ACPI: Enabled 5 GPEs in block 00 to 3F [ 1.724938] ACPI: PCI Root Bridge [UNC0] (domain 0000 [bus ff]) [ 1.730607] acpi PNP0A03:03: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3] [ 1.740620] acpi PNP0A03:03: _OSC: platform does not support [SHPCHotplug AER LTR] [ 1.747549] acpi PNP0A03:03: _OSC: OS now controls [PCIeHotplug PME PCIeCapability] [ 1.758603] acpi PNP0A03:03: FADT indicates ASPM is unsupported, using BIOS configuration [ 1.766637] PCI host bridge to bus 0000:ff [ 1.770604] pci_bus 0000:ff: root bus resource [bus ff] [ 1.774611] pci 0000:ff:0b.0: [8086:6f81] type 00 class 0x088000 [ 1.782662] pci 0000:ff:0b.1: [8086:6f36] type 00 class 0x110100 [ 1.786652] pci 0000:ff:0b.2: [8086:6f37] type 00 class 0x110100 [ 1.794651] pci 0000:ff:0b.3: [8086:6f76] type 00 class 0x088000 [ 1.798653] pci 0000:ff:0c.0: [8086:6fe0] type 00 class 0x088000 [ 1.806655] pci 0000:ff:0c.1: [8086:6fe1] type 00 class 0x088000 [ 1.810653] pci 0000:ff:0c.2: [8086:6fe2] type 00 class 0x088000 [ 1.818652] pci 0000:ff:0c.3: [8086:6fe3] type 00 class 0x088000 [ 1.822655] pci 0000:ff:0f.0: [8086:6ff8] type 00 class 0x088000 [ 1.830650] pci 0000:ff:0f.1: [8086:6ff9] type 00 class 0x088000 [ 1.834652] pci 0000:ff:0f.4: [8086:6ffc] type 00 class 0x088000 [ 1.842651] pci 0000:ff:0f.5: [8086:6ffd] type 00 class 0x088000 [ 1.846651] pci 0000:ff:0f.6: [8086:6ffe] type 00 class 0x088000 [ 1.854651] pci 0000:ff:10.0: [8086:6f1d] type 00 class 0x088000 [ 1.858651] pci 0000:ff:10.1: [8086:6f34] type 00 class 0x110100 [ 1.866652] pci 0000:ff:10.5: [8086:6f1e] type 00 class 0x088000 [ 1.874653] pci 0000:ff:10.6: [8086:6f7d] type 00 class 0x110100 [ 1.878650] pci 0000:ff:10.7: [8086:6f1f] type 00 class 0x088000 [ 1.886651] pci 0000:ff:12.0: [8086:6fa0] type 00 class 0x088000 [ 1.890624] pci 0000:ff:12.1: [8086:6f30] type 00 class 0x110100 [ 1.898656] pci 0000:ff:13.0: [8086:6fa8] type 00 class 0x088000 [ 1.902692] pci 0000:ff:13.1: [8086:6f71] type 00 class 0x088000 [ 1.910664] pci 0000:ff:13.2: [8086:6faa] type 00 class 0x088000 [ 1.914665] pci 0000:ff:13.3: [8086:6fab] type 00 class 0x088000 [ 1.922669] pci 0000:ff:13.4: [8086:6fac] type 00 class 0x088000 [ 1.926667] pci 0000:ff:13.5: [8086:6fad] type 00 class 0x088000 [ 1.934662] pci 0000:ff:13.6: [8086:6fae] type 00 class 0x088000 [ 1.938653] pci 0000:ff:13.7: [8086:6faf] type 00 class 0x088000 [ 1.946655] pci 0000:ff:14.0: [8086:6fb0] type 00 class 0x088000 [ 1.950663] pci 0000:ff:14.1: [8086:6fb1] type 00 class 0x088000 [ 1.958663] pci 0000:ff:14.2: [8086:6fb2] type 00 class 0x088000 [ 1.966663] pci 0000:ff:14.3: [8086:6fb3] type 00 class 0x088000 [ 1.970664] pci 0000:ff:14.4: [8086:6fbc] type 00 class 0x088000 [ 1.978653] pci 0000:ff:14.5: [8086:6fbd] type 00 class 0x088000 [ 1.982653] pci 0000:ff:14.6: [8086:6fbe] type 00 class 0x088000 [ 1.990653] pci 0000:ff:14.7: [8086:6fbf] type 00 class 0x088000 [ 1.994654] pci 0000:ff:15.0: [8086:6fb4] type 00 class 0x088000 [ 2.002666] pci 0000:ff:15.1: [8086:6fb5] type 00 class 0x088000 [ 2.006664] pci 0000:ff:15.2: [8086:6fb6] type 00 class 0x088000 [ 2.014663] pci 0000:ff:15.3: [8086:6fb7] type 00 class 0x088000 [ 2.018671] pci 0000:ff:16.0: [8086:6f68] type 00 class 0x088000 [ 2.026658] pci 0000:ff:16.6: [8086:6f6e] type 00 class 0x088000 [ 2.030653] pci 0000:ff:16.7: [8086:6f6f] type 00 class 0x088000 [ 2.038653] pci 0000:ff:17.0: [8086:6fd0] type 00 class 0x088000 [ 2.042656] pci 0000:ff:17.4: [8086:6fb8] type 00 class 0x088000 [ 2.050654] pci 0000:ff:17.5: [8086:6fb9] type 00 class 0x088000 [ 2.054653] pci 0000:ff:17.6: [8086:6fba] type 00 class 0x088000 [ 2.062653] pci 0000:ff:17.7: [8086:6fbb] type 00 class 0x088000 [ 2.070659] pci 0000:ff:1e.0: [8086:6f98] type 00 class 0x088000 [ 2.074653] pci 0000:ff:1e.1: [8086:6f99] type 00 class 0x088000 [ 2.082652] pci 0000:ff:1e.2: [8086:6f9a] type 00 class 0x088000 [ 2.086652] pci 0000:ff:1e.3: [8086:6fc0] type 00 class 0x088000 [ 2.094625] pci 0000:ff:1e.4: [8086:6f9c] type 00 class 0x088000 [ 2.098657] pci 0000:ff:1f.0: [8086:6f88] type 00 class 0x088000 [ 2.106653] pci 0000:ff:1f.2: [8086:6f8a] type 00 class 0x088000 [ 2.114410] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-fe]) [ 2.122606] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI HPX-Type3] [ 2.130906] acpi PNP0A08:00: _OSC: platform does not support [SHPCHotplug AER LTR] [ 2.147020] acpi PNP0A08:00: _OSC: OS now controls [PCIeHotplug PME PCIeCapability] [ 2.154603] acpi PNP0A08:00: FADT indicates ASPM is unsupported, using BIOS configuration [ 2.162863] PCI host bridge to bus 0000:00 [ 2.166604] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] [ 2.174603] pci_bus 0000:00: root bus resource [io 0x1000-0xffff window] [ 2.182603] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] [ 2.186603] pci_bus 0000:00: root bus resource [mem 0xfedb0000-0xfedb000f window] [ 2.194604] pci_bus 0000:00: root bus resource [mem 0xfedc0000-0xfedc000f window] [ 2.202604] pci_bus 0000:00: root bus resource [mem 0x90000000-0xfbffbfff window] [ 2.210603] pci_bus 0000:00: root bus resource [bus 00-fe] [ 2.218609] pci 0000:00:00.0: [8086:6f00] type 00 class 0x060000 [ 2.222750] pci 0000:00:01.0: [8086:6f02] type 01 class 0x060400 [ 2.230673] pci 0000:00:01.0: PME# supported from D0 D3hot D3cold [ 2.234704] pci 0000:00:02.0: [8086:6f04] type 01 class 0x060400 [ 2.242673] pci 0000:00:02.0: PME# supported from D0 D3hot D3cold [ 2.246698] pci 0000:00:03.0: [8086:6f08] type 01 class 0x060400 [ 2.254671] pci 0000:00:03.0: PME# supported from D0 D3hot D3cold [ 2.258698] pci 0000:00:04.0: [8086:6f20] type 00 class 0x088000 [ 2.266622] pci 0000:00:04.0: reg 0x10: [mem 0xfb42c000-0xfb42ffff 64bit] [ 2.274739] pci 0000:00:04.1: [8086:6f21] type 00 class 0x088000 [ 2.278622] pci 0000:00:04.1: reg 0x10: [mem 0xfb428000-0xfb42bfff 64bit] [ 2.286738] pci 0000:00:04.2: [8086:6f22] type 00 class 0x088000 [ 2.290621] pci 0000:00:04.2: reg 0x10: [mem 0xfb424000-0xfb427fff 64bit] [ 2.298737] pci 0000:00:04.3: [8086:6f23] type 00 class 0x088000 [ 2.306622] pci 0000:00:04.3: reg 0x10: [mem 0xfb420000-0xfb423fff 64bit] [ 2.310736] pci 0000:00:04.4: [8086:6f24] type 00 class 0x088000 [ 2.318621] pci 0000:00:04.4: reg 0x10: [mem 0xfb41c000-0xfb41ffff 64bit] [ 2.326742] pci 0000:00:04.5: [8086:6f25] type 00 class 0x088000 [ 2.330622] pci 0000:00:04.5: reg 0x10: [mem 0xfb418000-0xfb41bfff 64bit] [ 2.338736] pci 0000:00:04.6: [8086:6f26] type 00 class 0x088000 [ 2.346621] pci 0000:00:04.6: reg 0x10: [mem 0xfb414000-0xfb417fff 64bit] [ 2.350736] pci 0000:00:04.7: [8086:6f27] type 00 class 0x088000 [ 2.358622] pci 0000:00:04.7: reg 0x10: [mem 0xfb410000-0xfb413fff 64bit] [ 2.362738] pci 0000:00:05.0: [8086:6f28] type 00 class 0x088000 [ 2.370719] pci 0000:00:05.1: [8086:6f29] type 00 class 0x088000 [ 2.378739] pci 0000:00:05.2: [8086:6f2a] type 00 class 0x088000 [ 2.382719] pci 0000:00:05.4: [8086:6f2c] type 00 class 0x080020 [ 2.390617] pci 0000:00:05.4: reg 0x10: [mem 0xfb439000-0xfb439fff] [ 2.394742] pci 0000:00:11.0: [8086:8d7c] type 00 class 0xff0000 [ 2.402829] pci 0000:00:11.4: [8086:8d62] type 00 class 0x010601 [ 2.406627] pci 0000:00:11.4: reg 0x10: [io 0xf110-0xf117] [ 2.414614] pci 0000:00:11.4: reg 0x14: [io 0xf100-0xf103] [ 2.418614] pci 0000:00:11.4: reg 0x18: [io 0xf0f0-0xf0f7] [ 2.426614] pci 0000:00:11.4: reg 0x1c: [io 0xf0e0-0xf0e3] [ 2.430614] pci 0000:00:11.4: reg 0x20: [io 0xf020-0xf03f] [ 2.434615] pci 0000:00:11.4: reg 0x24: [mem 0xfb438000-0xfb4387ff] [ 2.442645] pci 0000:00:11.4: PME# supported from D3hot [ 2.446698] pci 0000:00:14.0: [8086:8d31] type 00 class 0x0c0330 [ 2.454630] pci 0000:00:14.0: reg 0x10: [mem 0xfb400000-0xfb40ffff 64bit] [ 2.462681] pci 0000:00:14.0: PME# supported from D3hot D3cold [ 2.466688] pci 0000:00:16.0: [8086:8d3a] type 00 class 0x078000 [ 2.474630] pci 0000:00:16.0: reg 0x10: [mem 0xfb437000-0xfb43700f 64bit] [ 2.478681] pci 0000:00:16.0: PME# supported from D0 D3hot D3cold [ 2.486687] pci 0000:00:16.1: [8086:8d3b] type 00 class 0x078000 [ 2.490630] pci 0000:00:16.1: reg 0x10: [mem 0xfb436000-0xfb43600f 64bit] [ 2.498681] pci 0000:00:16.1: PME# supported from D0 D3hot D3cold [ 2.506698] pci 0000:00:1a.0: [8086:8d2d] type 00 class 0x0c0320 [ 2.510628] pci 0000:00:1a.0: reg 0x10: [mem 0xfb434000-0xfb4343ff] [ 2.518707] pci 0000:00:1a.0: PME# supported from D0 D3hot D3cold [ 2.522692] pci 0000:00:1c.0: [8086:8d10] type 01 class 0x060400 [ 2.530694] pci 0000:00:1c.0: PME# supported from D0 D3hot D3cold [ 2.538701] pci 0000:00:1c.2: [8086:8d14] type 01 class 0x060400 [ 2.542695] pci 0000:00:1c.2: PME# supported from D0 D3hot D3cold [ 2.550700] pci 0000:00:1c.4: [8086:8d18] type 01 class 0x060400 [ 2.554695] pci 0000:00:1c.4: PME# supported from D0 D3hot D3cold [ 2.562710] pci 0000:00:1d.0: [8086:8d26] type 00 class 0x0c0320 [ 2.566629] pci 0000:00:1d.0: reg 0x10: [mem 0xfb433000-0xfb4333ff] [ 2.574707] pci 0000:00:1d.0: PME# supported from D0 D3hot D3cold [ 2.578694] pci 0000:00:1f.0: [8086:8d44] type 00 class 0x060100 [ 2.586814] pci 0000:00:1f.2: [8086:8d02] type 00 class 0x010601 [ 2.594625] pci 0000:00:1f.2: reg 0x10: [io 0xf070-0xf077] [ 2.598613] pci 0000:00:1f.2: reg 0x14: [io 0xf060-0xf063] [ 2.602613] pci 0000:00:1f.2: reg 0x18: [io 0xf050-0xf057] [ 2.610613] pci 0000:00:1f.2: reg 0x1c: [io 0xf040-0xf043] [ 2.614613] pci 0000:00:1f.2: reg 0x20: [io 0xf000-0xf01f] [ 2.622613] pci 0000:00:1f.2: reg 0x24: [mem 0xfb432000-0xfb4327ff] [ 2.626639] pci 0000:00:1f.2: PME# supported from D3hot [ 2.634686] pci 0000:00:1f.3: [8086:8d22] type 00 class 0x0c0500 [ 2.638627] pci 0000:00:1f.3: reg 0x10: [mem 0xfb431000-0xfb4310ff 64bit] [ 2.646634] pci 0000:00:1f.3: reg 0x20: [io 0x0580-0x059f] [ 2.650836] acpiphp: Slot [1] registered [ 2.654620] pci 0000:00:01.0: PCI bridge to [bus 01] [ 2.662749] pci 0000:02:00.0: [8086:0953] type 00 class 0x010802 [ 2.666625] pci 0000:02:00.0: reg 0x10: [mem 0xfb310000-0xfb313fff 64bit] [ 2.674645] pci 0000:02:00.0: reg 0x30: [mem 0xfb300000-0xfb30ffff pref] [ 2.678606] pci 0000:02:00.0: enabling Extended Tags [ 2.686697] pci 0000:00:02.0: PCI bridge to [bus 02] [ 2.690605] pci 0000:00:02.0: bridge window [mem 0xfb300000-0xfb3fffff] [ 2.698749] pci 0000:03:00.0: [8086:10fb] type 00 class 0x020000 [ 2.702626] pci 0000:03:00.0: reg 0x10: [mem 0xfbd80000-0xfbdfffff 64bit pref] [ 2.710613] pci 0000:03:00.0: reg 0x18: [io 0xe020-0xe03f] [ 2.718626] pci 0000:03:00.0: reg 0x20: [mem 0xfbe04000-0xfbe07fff 64bit pref] [ 2.722613] pci 0000:03:00.0: reg 0x30: [mem 0xfb280000-0xfb2fffff pref] [ 2.730646] pci 0000:03:00.0: PME# supported from D0 D3hot D3cold [ 2.738624] pci 0000:03:00.0: reg 0x184: [mem 0x00000000-0x00003fff 64bit pref] [ 2.742604] pci 0000:03:00.0: VF(n) BAR0 space: [mem 0x00000000-0x000fffff 64bit pref] (contains BAR0 for 64 VFs) [ 2.754616] pci 0000:03:00.0: reg 0x190: [mem 0x00000000-0x00003fff 64bit pref] [ 2.762603] pci 0000:03:00.0: VF(n) BAR3 space: [mem 0x00000000-0x000fffff 64bit pref] (contains BAR3 for 64 VFs) [ 2.770734] pci 0000:03:00.1: [8086:10fb] type 00 class 0x020000 [ 2.778626] pci 0000:03:00.1: reg 0x10: [mem 0xfbd00000-0xfbd7ffff 64bit pref] [ 2.786612] pci 0000:03:00.1: reg 0x18: [io 0xe000-0xe01f] [ 2.790626] pci 0000:03:00.1: reg 0x20: [mem 0xfbe00000-0xfbe03fff 64bit pref] [ 2.798612] pci 0000:03:00.1: reg 0x30: [mem 0xfb200000-0xfb27ffff pref] [ 2.806646] pci 0000:03:00.1: PME# supported from D0 D3hot D3cold [ 2.810620] pci 0000:03:00.1: reg 0x184: [mem 0x00000000-0x00003fff 64bit pref] [ 2.818603] pci 0000:03:00.1: VF(n) BAR0 space: [mem 0x00000000-0x000fffff 64bit pref] (contains BAR0 for 64 VFs) [ 2.830616] pci 0000:03:00.1: reg 0x190: [mem 0x00000000-0x00003fff 64bit pref] [ 2.838603] pci 0000:03:00.1: VF(n) BAR3 space: [mem 0x00000000-0x000fffff 64bit pref] (contains BAR3 for 64 VFs) [ 2.846729] pci 0000:00:03.0: PCI bridge to [bus 03] [ 2.854605] pci 0000:00:03.0: bridge window [io 0xe000-0xefff] [ 2.858604] pci 0000:00:03.0: bridge window [mem 0xfb200000-0xfb2fffff] [ 2.866605] pci 0000:00:03.0: bridge window [mem 0xfbd00000-0xfbefffff 64bit pref] [ 2.874633] pci 0000:00:1c.0: PCI bridge to [bus 04] [ 2.878660] pci 0000:05:00.0: [1a03:1150] type 01 class 0x060400 [ 2.886694] pci 0000:05:00.0: enabling Extended Tags [ 2.890676] pci 0000:05:00.0: supports D1 D2 [ 2.894603] pci 0000:05:00.0: PME# supported from D0 D1 D2 D3hot D3cold [ 2.902687] pci 0000:00:1c.2: PCI bridge to [bus 05-06] [ 2.906605] pci 0000:00:1c.2: bridge window [io 0xd000-0xdfff] [ 2.910605] pci 0000:00:1c.2: bridge window [mem 0xfa000000-0xfb0fffff] [ 2.918683] pci_bus 0000:06: extended config space not accessible [ 2.926632] pci 0000:06:00.0: [1a03:2000] type 00 class 0x030000 [ 2.930633] pci 0000:06:00.0: reg 0x10: [mem 0xfa000000-0xfaffffff] [ 2.938620] pci 0000:06:00.0: reg 0x14: [mem 0xfb000000-0xfb01ffff] [ 2.942620] pci 0000:06:00.0: reg 0x18: [io 0xd000-0xd07f] [ 2.950722] pci 0000:06:00.0: supports D1 D2 [ 2.954603] pci 0000:06:00.0: PME# supported from D0 D1 D2 D3hot D3cold [ 2.962704] pci 0000:05:00.0: PCI bridge to [bus 06] [ 2.966609] pci 0000:05:00.0: bridge window [io 0xd000-0xdfff] [ 2.970606] pci 0000:05:00.0: bridge window [mem 0xfa000000-0xfb0fffff] [ 2.978680] pci 0000:07:00.0: [8086:1521] type 00 class 0x020000 [ 2.986640] pci 0000:07:00.0: reg 0x10: [mem 0xfb120000-0xfb13ffff] [ 2.990631] pci 0000:07:00.0: reg 0x18: [io 0xc020-0xc03f] [ 2.998617] pci 0000:07:00.0: reg 0x1c: [mem 0xfb144000-0xfb147fff] [ 3.002734] pci 0000:07:00.0: PME# supported from D0 D3hot D3cold [ 3.010652] pci 0000:07:00.0: reg 0x184: [mem 0x00000000-0x00003fff 64bit pref] [ 3.018604] pci 0000:07:00.0: VF(n) BAR0 space: [mem 0x00000000-0x0001ffff 64bit pref] (contains BAR0 for 8 VFs) [ 3.026629] pci 0000:07:00.0: reg 0x190: [mem 0x00000000-0x00003fff 64bit pref] [ 3.034603] pci 0000:07:00.0: VF(n) BAR3 space: [mem 0x00000000-0x0001ffff 64bit pref] (contains BAR3 for 8 VFs) [ 3.046681] pci 0000:07:00.1: [8086:1521] type 00 class 0x020000 [ 3.050639] pci 0000:07:00.1: reg 0x10: [mem 0xfb100000-0xfb11ffff] [ 3.058631] pci 0000:07:00.1: reg 0x18: [io 0xc000-0xc01f] [ 3.062617] pci 0000:07:00.1: reg 0x1c: [mem 0xfb140000-0xfb143fff] [ 3.070733] pci 0000:07:00.1: PME# supported from D0 D3hot D3cold [ 3.074641] pci 0000:07:00.1: reg 0x184: [mem 0x00000000-0x00003fff 64bit pref] [ 3.082603] pci 0000:07:00.1: VF(n) BAR0 space: [mem 0x00000000-0x0001ffff 64bit pref] (contains BAR0 for 8 VFs) [ 3.094629] pci 0000:07:00.1: reg 0x190: [mem 0x00000000-0x00003fff 64bit pref] [ 3.102603] pci 0000:07:00.1: VF(n) BAR3 space: [mem 0x00000000-0x0001ffff 64bit pref] (contains BAR3 for 8 VFs) [ 3.110734] pci 0000:00:1c.4: PCI bridge to [bus 07] [ 3.118605] pci 0000:00:1c.4: bridge window [io 0xc000-0xcfff] [ 3.122605] pci 0000:00:1c.4: bridge window [mem 0xfb100000-0xfb1fffff] [ 3.130606] pci 0000:00:1c.4: bridge has subordinate 07 but max busn 08 [ 3.135475] ACPI: PCI Interrupt Link [LNKA] (IRQs 3 4 5 6 7 10 *11 12 14 15) [ 3.150649] ACPI: PCI Interrupt Link [LNKB] (IRQs 3 4 5 6 7 *10 11 12 14 15) [ 3.158647] ACPI: PCI Interrupt Link [LNKC] (IRQs 3 4 *5 6 10 11 12 14 15) [ 3.166646] ACPI: PCI Interrupt Link [LNKD] (IRQs 3 4 5 6 10 *11 12 14 15) [ 3.174646] ACPI: PCI Interrupt Link [LNKE] (IRQs 3 4 5 6 7 10 11 12 14 15) *0, disabled. [ 3.182646] ACPI: PCI Interrupt Link [LNKF] (IRQs 3 4 5 6 7 10 11 12 14 15) *0, disabled. [ 3.190647] ACPI: PCI Interrupt Link [LNKG] (IRQs 3 4 5 6 7 10 11 12 14 15) *0, disabled. [ 3.198647] ACPI: PCI Interrupt Link [LNKH] (IRQs 3 4 5 6 7 10 11 12 14 15) *0, disabled. [ 3.206815] iommu: Default domain type: Translated [ 3.210730] SCSI subsystem initialized [ 3.214621] pci 0000:06:00.0: vgaarb: setting as boot VGA device [ 3.218602] pci 0000:06:00.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none [ 3.230604] pci 0000:06:00.0: vgaarb: bridge control possible [ 3.234603] vgaarb: loaded [ 3.237380] ACPI: bus type USB registered [ 3.242612] usbcore: registered new interface driver usbfs [ 3.246607] usbcore: registered new interface driver hub [ 3.254607] usbcore: registered new device driver usb [ 3.258622] pps_core: LinuxPPS API ver. 1 registered [ 3.262603] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti [ 3.274604] PTP clock support registered [ 3.278609] EDAC MC: Ver: 3.0.0 [ 3.282613] PCI: Using ACPI for IRQ routing [ 3.291912] NetLabel: Initializing [ 3.294603] NetLabel: domain hash size = 128 [ 3.298603] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO [ 3.302612] NetLabel: unlabeled traffic allowed by default [ 3.311333] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0, 0, 0, 0, 0, 0 [ 3.314604] hpet0: 8 comparators, 64-bit 14.318180 MHz counter [ 3.324634] clocksource: Switched to clocksource tsc-early [ 3.337117] *** VALIDATE bpf *** [ 3.340461] VFS: Disk quotas dquot_6.6.0 [ 3.344459] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) [ 3.351420] *** VALIDATE ramfs *** [ 3.354885] *** VALIDATE hugetlbfs *** [ 3.358759] AppArmor: AppArmor Filesystem Enabled [ 3.363549] pnp: PnP ACPI init [ 3.367101] system 00:01: [io 0x0500-0x057f] has been reserved [ 3.373082] system 00:01: [io 0x0400-0x047f] has been reserved [ 3.379069] system 00:01: [io 0x0580-0x059f] has been reserved [ 3.385050] system 00:01: [io 0x0600-0x061f] has been reserved [ 3.391030] system 00:01: [io 0x0880-0x0883] has been reserved [ 3.397008] system 00:01: [io 0x0800-0x081f] has been reserved [ 3.402990] system 00:01: [mem 0xfed1c000-0xfed3ffff] has been reserved [ 3.409667] system 00:01: [mem 0xfed45000-0xfed8bfff] has been reserved [ 3.416346] system 00:01: [mem 0xff000000-0xffffffff] has been reserved [ 3.423022] system 00:01: [mem 0xfee00000-0xfeefffff] has been reserved [ 3.429704] system 00:01: [mem 0xfed12000-0xfed1200f] has been reserved [ 3.436387] system 00:01: [mem 0xfed12010-0xfed1201f] has been reserved [ 3.443067] system 00:01: [mem 0xfed1b000-0xfed1bfff] has been reserved [ 3.449940] system 00:02: [io 0x0a00-0x0a0f] has been reserved [ 3.455920] system 00:02: [io 0x0a10-0x0a1f] has been reserved [ 3.461900] system 00:02: [io 0x0a20-0x0a2f] has been reserved [ 3.467881] system 00:02: [io 0x0a30-0x0a3f] has been reserved [ 3.473860] system 00:02: [io 0x0a40-0x0a4f] has been reserved [ 3.480736] pnp: PnP ACPI: found 5 devices [ 3.485800] thermal_sys: Registered thermal governor 'fair_share' [ 3.485801] thermal_sys: Registered thermal governor 'bang_bang' [ 3.491960] thermal_sys: Registered thermal governor 'step_wise' [ 3.498032] thermal_sys: Registered thermal governor 'user_space' [ 3.504099] thermal_sys: Registered thermal governor 'power_allocator' [ 3.514736] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns [ 3.530314] pci 0000:00:1c.4: bridge window [mem 0x00100000-0x000fffff 64bit pref] to [bus 07] add_size 100000 add_align 100000 [ 3.541883] pci 0000:00:1c.4: BAR 15: assigned [mem 0x90000000-0x900fffff 64bit pref] [ 3.549798] pci 0000:00:01.0: PCI bridge to [bus 01] [ 3.554841] pci 0000:00:02.0: PCI bridge to [bus 02] [ 3.559873] pci 0000:00:02.0: bridge window [mem 0xfb300000-0xfb3fffff] [ 3.566743] pci 0000:03:00.0: BAR 7: no space for [mem size 0x00100000 64bit pref] [ 3.574392] pci 0000:03:00.0: BAR 7: failed to assign [mem size 0x00100000 64bit pref] [ 3.582393] pci 0000:03:00.0: BAR 10: no space for [mem size 0x00100000 64bit pref] [ 3.590131] pci 0000:03:00.0: BAR 10: failed to assign [mem size 0x00100000 64bit pref] [ 3.598221] pci 0000:03:00.1: BAR 7: no space for [mem size 0x00100000 64bit pref] [ 3.605873] pci 0000:03:00.1: BAR 7: failed to assign [mem size 0x00100000 64bit pref] [ 3.613873] pci 0000:03:00.1: BAR 10: no space for [mem size 0x00100000 64bit pref] [ 3.621611] pci 0000:03:00.1: BAR 10: failed to assign [mem size 0x00100000 64bit pref] [ 3.629698] pci 0000:03:00.0: BAR 7: no space for [mem size 0x00100000 64bit pref] [ 3.637350] pci 0000:03:00.0: BAR 7: failed to assign [mem size 0x00100000 64bit pref] [ 3.645351] pci 0000:03:00.0: BAR 10: no space for [mem size 0x00100000 64bit pref] [ 3.653089] pci 0000:03:00.0: BAR 10: failed to assign [mem size 0x00100000 64bit pref] [ 3.661178] pci 0000:03:00.1: BAR 7: no space for [mem size 0x00100000 64bit pref] [ 3.668830] pci 0000:03:00.1: BAR 7: failed to assign [mem size 0x00100000 64bit pref] [ 3.676830] pci 0000:03:00.1: BAR 10: no space for [mem size 0x00100000 64bit pref] [ 3.684568] pci 0000:03:00.1: BAR 10: failed to assign [mem size 0x00100000 64bit pref] [ 3.692656] pci 0000:00:03.0: PCI bridge to [bus 03] [ 3.697683] pci 0000:00:03.0: bridge window [io 0xe000-0xefff] [ 3.703845] pci 0000:00:03.0: bridge window [mem 0xfb200000-0xfb2fffff] [ 3.710700] pci 0000:00:03.0: bridge window [mem 0xfbd00000-0xfbefffff 64bit pref] [ 3.718532] pci 0000:00:1c.0: PCI bridge to [bus 04] [ 3.723582] pci 0000:05:00.0: PCI bridge to [bus 06] [ 3.728607] pci 0000:05:00.0: bridge window [io 0xd000-0xdfff] [ 3.734771] pci 0000:05:00.0: bridge window [mem 0xfa000000-0xfb0fffff] [ 3.741637] pci 0000:00:1c.2: PCI bridge to [bus 05-06] [ 3.746921] pci 0000:00:1c.2: bridge window [io 0xd000-0xdfff] [ 3.753084] pci 0000:00:1c.2: bridge window [mem 0xfa000000-0xfb0fffff] [ 3.759947] pci 0000:07:00.0: BAR 7: assigned [mem 0x90000000-0x9001ffff 64bit pref] [ 3.767776] pci 0000:07:00.0: BAR 10: assigned [mem 0x90020000-0x9003ffff 64bit pref] [ 3.775687] pci 0000:07:00.1: BAR 7: assigned [mem 0x90040000-0x9005ffff 64bit pref] [ 3.783516] pci 0000:07:00.1: BAR 10: assigned [mem 0x90060000-0x9007ffff 64bit pref] [ 3.791428] pci 0000:00:1c.4: PCI bridge to [bus 07] [ 3.796453] pci 0000:00:1c.4: bridge window [io 0xc000-0xcfff] [ 3.802613] pci 0000:00:1c.4: bridge window [mem 0xfb100000-0xfb1fffff] [ 3.809469] pci 0000:00:1c.4: bridge window [mem 0x90000000-0x900fffff 64bit pref] [ 3.817304] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] [ 3.823549] pci_bus 0000:00: resource 5 [io 0x1000-0xffff window] [ 3.829787] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] [ 3.836722] pci_bus 0000:00: resource 7 [mem 0xfedb0000-0xfedb000f window] [ 3.843658] pci_bus 0000:00: resource 8 [mem 0xfedc0000-0xfedc000f window] [ 3.850599] pci_bus 0000:00: resource 9 [mem 0x90000000-0xfbffbfff window] [ 3.857532] pci_bus 0000:02: resource 1 [mem 0xfb300000-0xfb3fffff] [ 3.863859] pci_bus 0000:03: resource 0 [io 0xe000-0xefff] [ 3.869490] pci_bus 0000:03: resource 1 [mem 0xfb200000-0xfb2fffff] [ 3.875818] pci_bus 0000:03: resource 2 [mem 0xfbd00000-0xfbefffff 64bit pref] [ 3.883120] pci_bus 0000:05: resource 0 [io 0xd000-0xdfff] [ 3.888758] pci_bus 0000:05: resource 1 [mem 0xfa000000-0xfb0fffff] [ 3.895084] pci_bus 0000:06: resource 0 [io 0xd000-0xdfff] [ 3.900717] pci_bus 0000:06: resource 1 [mem 0xfa000000-0xfb0fffff] [ 3.907046] pci_bus 0000:07: resource 0 [io 0xc000-0xcfff] [ 3.912679] pci_bus 0000:07: resource 1 [mem 0xfb100000-0xfb1fffff] [ 3.919008] pci_bus 0000:07: resource 2 [mem 0x90000000-0x900fffff 64bit pref] [ 3.926430] NET: Registered protocol family 2 [ 3.931018] IP idents hash table entries: 262144 (order: 9, 2097152 bytes, linear) [ 3.940237] tcp_listen_portaddr_hash hash table entries: 16384 (order: 6, 262144 bytes, linear) [ 3.949219] TCP established hash table entries: 262144 (order: 9, 2097152 bytes, linear) [ 3.957621] TCP bind hash table entries: 65536 (order: 8, 1048576 bytes, linear) [ 3.965154] TCP: Hash tables configured (established 262144 bind 65536) [ 3.971904] UDP hash table entries: 16384 (order: 7, 524288 bytes, linear) [ 3.978921] UDP-Lite hash table entries: 16384 (order: 7, 524288 bytes, linear) [ 3.986370] NET: Registered protocol family 1 [ 3.990797] NET: Registered protocol family 44 [ 3.995367] pci 0000:00:05.0: disabled boot interrupts on device [8086:6f28] [ 4.026800] pci 0000:00:1a.0: quirk_usb_early_handoff+0x0/0x670 took 23568 usecs [ 4.058793] pci 0000:00:1d.0: quirk_usb_early_handoff+0x0/0x670 took 23923 usecs [ 4.066281] pci 0000:02:00.0: CLS mismatch (64 != 32), using 64 bytes [ 4.072801] pci 0000:06:00.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff] [ 4.081267] Trying to unpack rootfs image as initramfs... [ 4.187081] Freeing initrd memory: 54500K [ 4.218658] PCI-DMA: Using software bounce buffering for IO (SWIOTLB) [ 4.225164] software IO TLB: mapped [mem 0x74ec2000-0x78ec2000] (64MB) [ 4.232086] check: Scanning for low memory corruption every 60 seconds [ 4.239117] Initialise system trusted keyrings [ 4.251386] Key type blacklist registered [ 4.255474] workingset: timestamp_bits=36 max_order=23 bucket_order=0 [ 4.262879] zbud: loaded [ 4.265720] squashfs: version 4.0 (2009/01/31) Phillip Lougher [ 4.271718] fuse: init (API version 7.31) [ 4.275799] *** VALIDATE fuse *** [ 4.279177] *** VALIDATE fuse *** [ 4.282625] Platform Keyring initialized [ 4.289358] Key type asymmetric registered [ 4.293523] Asymmetric key parser 'x509' registered [ 4.298467] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 244) [ 4.305971] io scheduler mq-deadline registered [ 4.310925] pcieport 0000:00:01.0: PME: Signaling with IRQ 25 [ 4.316932] pcieport 0000:00:02.0: PME: Signaling with IRQ 27 [ 4.322933] pcieport 0000:00:03.0: PME: Signaling with IRQ 29 [ 4.328884] pcieport 0000:00:1c.0: PME: Signaling with IRQ 30 [ 4.334846] pcieport 0000:00:1c.2: PME: Signaling with IRQ 31 [ 4.340803] pcieport 0000:00:1c.4: PME: Signaling with IRQ 32 [ 4.346700] shpchp: Standard Hot Plug PCI Controller Driver version: 0.4 [ 4.354047] input: Power Button as /devices/LNXSYSTM:00/LNXSYBUS:00/PNP0C0C:00/input/input0 [ 4.362497] ACPI: Power Button [PWRB] [ 4.366244] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input1 [ 4.373747] ACPI: Power Button [PWRF] [ 4.378696] ERST: Error Record Serialization Table (ERST) support is initialized. [ 4.386260] pstore: Registered erst as persistent store backend [ 4.392419] GHES: APEI firmware first mode is enabled by APEI bit and WHEA _OSC. [ 4.400000] Serial: 8250/16550 driver, 32 ports, IRQ sharing enabled [ 4.426911] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A [ 4.454845] 00:04: ttyS1 at I/O 0x2f8 (irq = 3, base_baud = 115200) is a 16550A [ 4.463272] Linux agpgart interface v0.103 [ 4.598744] loop: module loaded [ 4.602141] tun: Universal TUN/TAP device driver, 1.6 [ 4.607307] PPP generic driver version 2.4.2 [ 4.611699] VFIO - User Level meta-driver version: 0.3 [ 4.616991] ehci_hcd: USB 2.0 'Enhanced' Host Controller (EHCI) Driver [ 4.623587] ehci-pci: EHCI PCI platform driver [ 4.628238] ehci-pci 0000:00:1a.0: EHCI Host Controller [ 4.633538] ehci-pci 0000:00:1a.0: new USB bus registered, assigned bus number 1 [ 4.641027] ehci-pci 0000:00:1a.0: debug port 2 [ 4.649508] ehci-pci 0000:00:1a.0: cache line size of 64 is not supported [ 4.656372] ehci-pci 0000:00:1a.0: irq 18, io mem 0xfb434000 [ 4.674738] ehci-pci 0000:00:1a.0: USB 2.0 started, EHCI 1.00 [ 4.680581] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.04 [ 4.688931] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 4.696234] usb usb1: Product: EHCI Host Controller [ 4.701178] usb usb1: Manufacturer: Linux 5.4.0-177-generic ehci_hcd [ 4.707592] usb usb1: SerialNumber: 0000:00:1a.0 [ 4.712361] hub 1-0:1.0: USB hub found [ 4.716181] hub 1-0:1.0: 2 ports detected [ 4.720460] ehci-pci 0000:00:1d.0: EHCI Host Controller [ 4.725752] ehci-pci 0000:00:1d.0: new USB bus registered, assigned bus number 2 [ 4.733240] ehci-pci 0000:00:1d.0: debug port 2 [ 4.741735] ehci-pci 0000:00:1d.0: cache line size of 64 is not supported [ 4.748594] ehci-pci 0000:00:1d.0: irq 18, io mem 0xfb433000 [ 4.766695] ehci-pci 0000:00:1d.0: USB 2.0 started, EHCI 1.00 [ 4.772534] usb usb2: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.04 [ 4.780888] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 4.788192] usb usb2: Product: EHCI Host Controller [ 4.793132] usb usb2: Manufacturer: Linux 5.4.0-177-generic ehci_hcd [ 4.799550] usb usb2: SerialNumber: 0000:00:1d.0 [ 4.804317] hub 2-0:1.0: USB hub found [ 4.808129] hub 2-0:1.0: 2 ports detected [ 4.812329] ehci-platform: EHCI generic platform driver [ 4.817627] ohci_hcd: USB 1.1 'Open' Host Controller (OHCI) Driver [ 4.823876] ohci-pci: OHCI PCI platform driver [ 4.828396] ohci-platform: OHCI generic platform driver [ 4.833693] uhci_hcd: USB Universal Host Controller Interface driver [ 4.840247] xhci_hcd 0000:00:14.0: xHCI Host Controller [ 4.845540] xhci_hcd 0000:00:14.0: new USB bus registered, assigned bus number 3 [ 4.854068] xhci_hcd 0000:00:14.0: hcc params 0x200077c1 hci version 0x100 quirks 0x0000000000009810 [ 4.863295] xhci_hcd 0000:00:14.0: cache line size of 64 is not supported [ 4.870289] xhci_hcd 0000:00:14.0: xHCI Host Controller [ 4.875576] xhci_hcd 0000:00:14.0: new USB bus registered, assigned bus number 4 [ 4.883052] xhci_hcd 0000:00:14.0: Host supports USB 3.0 SuperSpeed [ 4.889401] usb usb3: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.04 [ 4.897746] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 4.905048] usb usb3: Product: xHCI Host Controller [ 4.909991] usb usb3: Manufacturer: Linux 5.4.0-177-generic xhci-hcd [ 4.916406] usb usb3: SerialNumber: 0000:00:14.0 [ 4.921219] hub 3-0:1.0: USB hub found [ 4.925050] hub 3-0:1.0: 15 ports detected [ 4.931312] usb usb4: New USB device found, idVendor=1d6b, idProduct=0003, bcdDevice= 5.04 [ 4.939659] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 4.946962] usb usb4: Product: xHCI Host Controller [ 4.951904] usb usb4: Manufacturer: Linux 5.4.0-177-generic xhci-hcd [ 4.958323] usb usb4: SerialNumber: 0000:00:14.0 [ 4.963123] hub 4-0:1.0: USB hub found [ 4.966955] hub 4-0:1.0: 6 ports detected [ 4.972137] i8042: PNP: No PS/2 controller found. [ 4.976977] mousedev: PS/2 mouse device common for all mice [ 4.978674] usb 1-1: new high-speed USB device number 2 using ehci-pci [ 4.982721] rtc_cmos 00:00: RTC can wake from S4 [ 4.994059] rtc_cmos 00:00: registered as rtc0 [ 4.998581] rtc_cmos 00:00: alarms up to one month, y3k, 114 bytes nvram, hpet irqs [ 5.006326] i2c /dev entries driver [ 5.009901] device-mapper: uevent: version 1.0.3 [ 5.014652] device-mapper: ioctl: 4.41.0-ioctl (2019-09-16) initialised: dm-devel@redhat.com [ 5.023186] platform eisa.0: Probing EISA bus 0 [ 5.027785] platform eisa.0: EISA: Cannot allocate resource for mainboard [ 5.034635] platform eisa.0: Cannot allocate resource for EISA slot 1 [ 5.041144] platform eisa.0: Cannot allocate resource for EISA slot 2 [ 5.047652] platform eisa.0: Cannot allocate resource for EISA slot 3 [ 5.054161] platform eisa.0: Cannot allocate resource for EISA slot 4 [ 5.060670] platform eisa.0: Cannot allocate resource for EISA slot 5 [ 5.066670] usb 2-1: new high-speed USB device number 2 using ehci-pci [ 5.067178] platform eisa.0: Cannot allocate resource for EISA slot 6 [ 5.080275] platform eisa.0: Cannot allocate resource for EISA slot 7 [ 5.086783] platform eisa.0: Cannot allocate resource for EISA slot 8 [ 5.093285] platform eisa.0: EISA: Detected 0 cards [ 5.098235] intel_pstate: Intel P-state driver initializing [ 5.104609] ledtrig-cpu: registered to indicate activity on CPUs [ 5.110786] drop_monitor: Initializing network drop monitor service [ 5.117221] NET: Registered protocol family 10 [ 5.125904] Segment Routing with IPv6 [ 5.129640] NET: Registered protocol family 17 [ 5.134216] Key type dns_resolver registered [ 5.139157] RAS: Correctable Errors collector initialized. [ 5.143020] usb 1-1: New USB device found, idVendor=8087, idProduct=800a, bcdDevice= 0.05 [ 5.144741] microcode: sig=0x406f1, pf=0x1, revision=0xb000040 [ 5.152962] usb 1-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 5.166129] microcode: Microcode Update Driver: v2.2. [ 5.166195] *** VALIDATE rdt *** [ 5.166284] hub 1-1:1.0: USB hub found [ 5.171312] resctrl: L3 allocation detected [ 5.178647] hub 1-1:1.0: 6 ports detected [ 5.182713] resctrl: L3DATA allocation detected [ 5.182714] resctrl: L3CODE allocation detected [ 5.190649] usb 3-12: new high-speed USB device num 2 using xhci_hcd [ 5.191381] resctrl: L3 monitoring detected [ 5.191383] IPI shorthand broadcast: enabled [ 5.211261] sched_clock: Marking stable (4204608738, 1006637056)->(5541575874, -330330080) [ 5.219704] registered taskstats version 1 [ 5.223876] Loading compiled-in X.509 certificates [ 5.227036] usb 2-1: New USB device found, idVendor=8087, idProduct=8002, bcdDevice= 0.05 [ 5.229269] Loaded X.509 cert 'Build time autogenerated kernel key: 1224c9b81ccdd6d5fadad4fbd6b8ad2b6b069117' [ 5.236991] usb 2-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 5.247484] Loaded X.509 cert 'Canonical Ltd. Live Patch Signing: 14df34d1a87cf37625abec039ef2bf521249b969' [ 5.254408] hub 2-1:1.0: USB hub found [ 5.264098] tsc: Refined TSC clocksource calibration: 3499.996 MHz [ 5.264793] Loaded X.509 cert 'Canonical Ltd. Kernel Module Signing: 88f752e560a1e0737e31163a466ad7b70a850c19' [ 5.264793] blacklist: Loading compiled-in revocation X.509 certificates [ 5.264813] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing: 61482aa2830d0ab2ad5af10b7250da9033ddcef0' [ 5.264827] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (2017): 242ade75ac4a15e50d50c84b0d45ff3eae707a03' [ 5.264841] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (ESM 2018): 365188c1d374d6b07c3c8f240f8ef722433d6a8b' [ 5.264855] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (2019): c0746fd6c5da3ae827864651ad66ae47fe24b3e8' [ 5.264869] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (2021 v1): a8d54bbb3825cfb94fa13c9f8a594a195c107b8d' [ 5.264883] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (2021 v2): 4cf046892d6fd3c9a5b03f98d845f90851dc6a8c' [ 5.264897] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (2021 v3): 100437bb6de6e469b581e61cd66bce3ef4ed53af' [ 5.264911] Loaded X.509 cert 'Canonical Ltd. Secure Boot Signing (Ubuntu Core 2019): c1d57b8f6b743f23ee41f4f7ee292f06eecadfb9' [ 5.264943] zswap: loaded using pool lzo/zbud [ 5.268021] hub 2-1:1.0: 8 ports detected [ 5.274167] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x32734d20948, max_idle_ns: 440795306379 ns [ 5.274243] Key type ._fscrypt registered [ 5.274243] Key type .fscrypt registered [ 5.274311] pstore: Using crash dump compression: deflate [ 5.277934] Key type big_key registered [ 5.279653] Key type encrypted registered [ 5.279655] AppArmor: AppArmor sha1 policy hashing enabled [ 5.279664] ima: No TPM chip found, activating TPM-bypass! [ 5.279667] ima: Allocated hash algorithm: sha1 [ 5.279671] ima: No architecture policies found [ 5.279676] evm: Initialising EVM extended attributes: [ 5.279676] evm: security.selinux [ 5.279676] evm: security.SMACK64 [ 5.279677] evm: security.SMACK64EXEC [ 5.279677] evm: security.SMACK64TRANSMUTE [ 5.279677] evm: security.SMACK64MMAP [ 5.279678] evm: security.apparmor [ 5.279678] evm: security.ima [ 5.279678] evm: security.capability [ 5.279679] evm: HMAC attrs: 0x1 [ 5.280047] PM: Magic number: 4:244:58 [ 5.284245] rtc_cmos 00:00: setting system clock to 2024-04-19T03:04:19 UTC (1713495859) [ 5.358874] usb 3-12: New USB device found, idVendor=0557, idProduct=7000, bcdDevice= 0.00 [ 5.502413] usb 3-12: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 5.509721] clocksource: Switched to clocksource tsc [ 5.509989] hub 3-12:1.0: USB hub found [ 5.518756] hub 3-12:1.0: 4 ports detected [ 5.523540] Freeing unused decrypted memory: 2040K [ 5.528800] Freeing unused kernel image memory: 2768K [ 5.554702] Write protecting the kernel read-only data: 26624k [ 5.560972] Freeing unused kernel image memory: 2036K [ 5.566260] Freeing unused kernel image memory: 948K [ 5.577743] x86/mm: Checked W+X mappings: passed, no W+X pages found. [ 5.584249] x86/mm: Checking user space page tables [ 5.595494] x86/mm: Checked W+X mappings: passed, no W+X pages found. [ 5.602000] Run /init as init process Loading, please wait... Starting version 245.4-4ubuntu3.17 [ 5.723887] dca service started, version 1.12.1 [ 5.728902] i801_smbus 0000:0t [ 5.736413:11.4: AHCI 0001.0300 32 slots 4 ports 6 Gbps 0xf impl SATA mode [ 5.744598] ahci 0000:00:11.4: flags: 64bit ncq pm led clo pio slum part ems apst [ 5.752647] nvme nvme0: pci function 0000:02:00.0 [ 5.779501] igb: Intel(R) Gigabit Ethernet Network Driver - version 5.6.0-k [ 5.786544] igb: Copyright (c) 2007-2014 Intel Corporation. [ 5.786977] scsi host0: ahci [ 5.795271] ixgbe: Intel(R) 10 Gigabit PCI Express Network Driver - version 5.1.0-k [ 5.795785] scsi host1: ahci [ 5.803013] ixgbe: Copyright (c) 1999-2016 Intel Corporation. [ 5.827562] scsi host2: ahci [ 5.830645] usb 3-12.1: new low-speed USB device number 3 using xhci_hcd [ 5.842221] si [ 5.8452182048@0xfb438000 port 0xfb438100 irq 34 [ 5.852701] ata2: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438180 irq 34 [ 5.860179] ata3: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438200 irq 34 [ 5.867657] ata4: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438280 irq 34 [ 5.871258] nvme nvme0: 8/0/0 default/read/poll queues [ 5.881360] ahci 0000:00:1f.2: AHCI 0001.0300 32 slots 6 ports 6 Gbps 0x3f impl SATA mode [ 5.889625] ahci 0000:00:1f.2: flags: 64bit ncq pm led clo pio slum part ems apst [ 5.900046] igb 0000:07:00.0: added PHC on eth0 [ 5.904660] igb 0000:07:00.0: Intel(R) Gigabit Ethernet Network Connection [ 5.911598] igb 0000:07:00.0: eth0: (PCIe:5.0Gb/s:Width x4) 0c:c4:7a:d8:a2:0e [ 5.918875] igb 0000:07:00.0: eth0: PBA No: 050B00-000 [ 5.924075] igb 0000:07:00.0: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s) [ 5.963201] usb 3-12.1: New USB device found, idVendor=0557, idProduct=2419, bcdDevice= 1.00 [ 5.971729] usb 3-12.1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 5.979001] scsi host4: ahci [ 5.984593] scsi host5: ahci [ 5.987645] hidraw: raw HID events driver (C) Jiri Kosina [ 5.987763] scsi host6: ahci [ 5.996354] scsi host7: ahci [ 5.999303] igb 0000:07:00.1: added PHC on eth1 [ 6.003926] igb 0000:07:00.1: Intel(R) Gigabit Ethernet Network Connection [ 6.010869] igb 0000:07:00.1: eth1: (PCIe:5.0Gb/s:Width x4) 0c:c4:7a:d8:a2:0f [ 6.018168] igb 0000:07:00.1: eth1: PBA No: 050B00-000 [ 6.023369] igb 0000:07:00.1: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s) [ 6.031153] scsi host8: ahci [ 6.034223] scsi host9: ahci [ 6.037190] ata5: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432100 irq 54 [ 6.044670] ata6: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432180 irq 54 [ 6.052149] ata7: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432200 irq 54 [ 6.059629] ata8: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432280 irq 54 [ 6.067109] ata9: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432300 irq 54 [ 6.074588] ata10: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432380 irq 54 [ 6.189704] ata2: SATA link down (SStatus 0 SControl 300) [ 6.195183] ata3: SATA link down (SStatus 0 SControl 300) [ 6.200660] ata1: SATA link down (SStatus 0 SControl 300) [ 6.206136] ata4: SATA link down (SStatus 0 SControl 300) [ 6.398026] ata7: SATA link down (SStatus 0 SControl 300) [ 6.403508] ata5: SATA link up 6.0 Gbps (SStatus 133 SControl 300) [ 6.409762] ata9: SATA link down (SStatus 0 SControl 300) [ 6.415240] ata8: SATA link down (SStatus 0 SControl 300) [ 6.420718] ata6: SATA link down (SStatus 0 SControl 300) [ 6.426192] ata10: SATA link down (SStatus 0 SControl 300) [ 6.432497] ata5.00: NCQ Send/Recv Log not supported [ 6.437529] ata5.00: ATA-9: ST1000NM0033-9ZM173, SN06, max UDMA/133 [ 6.443866] ata5.00: 1953525168 sectors, multi 16: LBA48 NCQ (depth 32), AA [ 6.452314] ata5.00: NCQ Send/Recv Log not supported [ 6.457350] ata5.00: configured for UDMA/133 [ 6.461775] scsi 4:0:0:0: Direct-Access ATA ST1000NM0033-9ZM SN06 PQ: 0 ANSI: 5 [ 6.470066] sd 4:0:0:0: Attached scsi generic sg0 type 0 [ 6.470130] sd 4:0:0:0: [sda] 1953525168 512-byte logical blocks: (1.00 TB/932 GiB) [ 6.483189] sd 4:0:0:0: [sda] Write Protect is off [ 6.488052] sd 4:0:0:0: [sda] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA [ 6.529845] sda: sda1 [ 6.546752] sd 4:0:0:0: [sda] Attached SCSI disk [ 6.552670] igb 0000:07:00.0 eno1: renamed from eth0 [ 6.558883] usbcore: registered new interface driver usbhid [ 6.564525] usbhid: USB HID core driver [ 6.570279] i HID 0557:2419 as /devices/pci0000:00/0000:00:14.0/usb3/3-12/3-12.1/3-12.1:1.0/0003:0557:2419.0001/input/input2 [ 6.586928] igb 0000:07:00.1 eno2: renamed from eth1 [ 6.642754] hid-generic 0003:0557:2419.0001: input,hidraw0: USB HID v1.00 Keyboard [HID 0557:2419] on usb-0000:00:14.0-12.1/input0 [ 6.654695] input: HID 0557:2419 as /devices/pci0000:00/0000:00:14.0/usb3/3-12/3-12.1/3-12.1:1.1/0003:0557:2419.0002/input/input3 [ 6.666519] hid-generic 0003:0557:2419.0002: input,hidraw1: USB HID v1.00 Mouse [HID 0557:2419] on usb-0000:00:14.0-12.1/input1 [ 7.026812] ixgbe 0000:03:00.0: Multiqueue Enabled: Rx Queue count = 8, Tx Queue count = 8 XDP Queue count = 0 [ 7.037180] ixgbe 0000:03:00.0: 32.000 Gb/s available PCIe bandwidth (5.0 GT/s PCIe x8 link) [ 7.045778] ixgbe 0000:03:00.0: MAC: 2, PHY: 1, PBA No: 0210FF-0FF [ 7.052020] ixgbe 0000:03:00.0: 0c:c4:7a:8f:d8:04 [ 7.059710] ixgbe 0000:03:00.0: Intel(R) 10 Gigabit Network Connection [ 7.226774] ixgbe 0000:03:00.1: Multiqueue Enabled: Rx Queue count = 8, Tx Queue count = 8 XDP Queue count = 0 [ 7.237143] ixgbe 0000:03:00.1: 32.000 Gb/s available PCIe bandwidth (5.0 GT/s PCIe x8 link) [ 7.245740] ixgbe 0000:03:00.1: MAC: 2, PHY: 14, SFP+: 4, PBA No: 0210FF-0FF [ 7.252847] ixgbe 0000:03:00.1: 0c:c4:7a:8f:d8:05 [ 7.260499] ixgbe 0000:03:00.1: Intel(R) 10 Gigabit Network Connection [ 7.267856] ixgbe 0000:03:00.0 enp3s0f0: renamed from eth0 [ 7.298865] ixgbe 0000:03:00.1 enp3s0f1: renamed from eth1 Begin: Loading essential drivers ... done. Begin: Running /scripts/init-premount ... done. Begin: Mounting root file system ... Begin: Running /scripts/local-top ... done. Begin: Running /scripts/local-premount ... done. Begin: Will now check root file system ... fsck from util-linux 2.34 [/usr/sbin/fsck.ext4 (1) -- /dev/sda1] fsck.ext4 -a -C0 /dev/sda1 /dev/sda1: clean, 303186/61054976 files, 8079014/244190336 blocks done. [ 7.466604] EXT4-fs (sda1): mounted filesystem with ordered data mode. Opts: (null) done. Begin: Running /scripts/local-bottom ... done. Begin: Running /scripts/init-bottom ... done. [ 8.190492] systemd[1]: Inserted module 'autofs4' [ 8.274726] systemd[1]: systemd 245.4-4ubuntu3.17 running in system mode. (+PAM +AUDIT +SELINUX +IMA +APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 +SECCOMP +BLKID +ELFUTILS +KMOD +IDN2 -IDN +PCRE2 default-hierarchy=hybrid) [ 8.314735] systemd[1]: Detected architecture x86-64. Welcome to Ubuntu 20.04.4 LTS! [ 8.364697] systemd[1]: Set hostname to . [ 9.626980] systemd[1]: Created slice system-modprobe.slice. [ OK ] Created slice system-modprobe.slice. [ 9.646977] systemd[1]: Created slice system-serial\x2dgetty.slice. [ OK ] Created slice system-serial\x2dgetty.slice. [ 9.670984] systemd[1]: Created slice User and Session Slice. [ OK ] Created slice User and Session Slice. [ 9.690870] systemd[1]: Started Forward Password Requests to Wall Directory Watch. [ OK ] Started Forward Password R…uests to Wall Directory Watch. [ 9.715193] systemd[1]: Set up automount Arbitrary Executable File Formats File System Automount Point. [ OK ] Set up automount Arbitrary…s File System Automount Point. [ 9.750806] systemd[1]: Reached target ceph target allowing to start/stop all ceph-fuse@.service instances at once. [ OK ] Reached target ceph target…se@.service instances at once. [ 9.778784] systemd[1]: Reached target ceph target allowing to start/stop all ceph-mon@.service instances at once. [ OK ] Reached target ceph target…on@.service instances at once. [ 9.806776] systemd[1]: Reached target ceph target allowing to start/stop all ceph-mds@.service instances at once. [ OK ] Reached target ceph target…ds@.service instances at once. [ 9.834769] systemd[1]: Reached target ceph target allowing to start/stop all ceph-mgr@.service instances at once. [ OK ] Reached target ceph target…gr@.service instances at once. [ 9.862762] systemd[1]: Reached target ceph target allowing to start/stop all ceph-osd@.service instances at once. [ OK ] Reached target ceph target…sd@.service instances at once. [ 9.890712] systemd[1]: Reached target ceph target allowing to start/stop all ceph-radosgw@.service instances at once. [ OK ] Reached target ceph target…gw@.service instances at once. [ 9.918803] systemd[1]: Reached target User and Group Name Lookups. [ OK ] Reached target User and Group Name Lookups. [ 9.942714] systemd[1]: Reached target Slices. [ OK ] Reached target Slices. [ 9.962881] systemd[1]: Listening on Device-mapper event daemon FIFOs. [ OK ] Listening on Device-mapper event daemon FIFOs. [ 9.986955] systemd[1]: Listening on LVM2 poll daemon socket. [ OK ] Listening on LVM2 poll daemon socket. [ 10.009846] systemd[1]: Listening on RPCbind Server Activation Socket. [ OK ] Listening on RPCbind Server Activation Socket. [ 10.034976] systemd[1]: Listening on Syslog Socket. [ OK ] Listening on Syslog Socket. [ 10.054800] systemd[1]: Listening on fsck to fsckd communication Socket. [ OK ] Listening on fsck to fsckd communication Socket. [ 10.078751] systemd[1]: Listening on initctl Compatibility Named Pipe. [ OK ] Listening on initctl Compatibility Named Pipe. [ 10.102860] systemd[1]: Listening on Journal Audit Socket. [ OK ] Listening on Journal Audit Socket. [ 10.122921] systemd[1]: Listening on Journal Socket (/dev/log). [ OK ] Listening on Journal Socket (/dev/log). [ 10.142992] systemd[1]: Listening on Journal Socket. [ OK ] Listening on Journal Socket. [ 10.162932] systemd[1]: Listening on udev Control Socket. [ OK ] Listening on udev Control Socket. [ 10.182824] systemd[1]: Listening on udev Kernel Socket. [ OK ] Listening on udev Kernel Socket. [ 10.203531] systemd[1]: Mounting Huge Pages File System... Mounting Huge Pages File System... [ 10.223711] systemd[1]: Mounting POSIX Message Queue File System... Mounting POSIX Message Queue File System... [ 10.247573] systemd[1]: Mounting NFSD configuration filesystem... Mounting NFSD configuration filesystem... [ 10.271411] systemd[1]: Mounting RPC Pipe File System... Mounting RPC Pipe File System... [ 10.291446] systemd[1]: Mounting Kernel Debug File System... Mounting Kernel Debug File System... [ 10.309467] RPC: Registered named UNIX socket transport module. [ 10.315462] RPC: Registered udp transport module. [ 10.316622] systemd[1]: Mounting Kernel Trace File System... [ 10.320241] RPC: Registered tcp transport module. [ 10.330739] RPC: Registered tcp NFSv4.1 backchannel transport module. Mounting Kernel Trace File System... [ 10.351714] systemd[1]: Starting Journal Service... Starting Journal Service... [ 10.370766] systemd[1]: Condition check resulted in Kernel Module supporting RPCSEC_GSS being skipped. [ 10.381977] systemd[1]: Starting Set the console keyboard layout... Startin[ 10.388755] Installing knfsd (copyright (C) 1996 okir@monad.swb.de). g Set the console keyboard layout... [ 10.411458] systemd[1]: Starting Create list of static device nodes for the current kernel... Starting Create list of st…odes for the current kernel... [ 10.439515] systemd[1]: Starting Monitoring of LVM2 mirrors, snapshots etc. using dmeventd or progress polling... Starting Monitoring of LVM…meventd or progress polling... [ 10.467394] systemd[1]: Starting Load Kernel Module drm... Starting Load Kernel Module drm... [ 10.486723] systemd[1]: Condition check resulted in OpenVSwitch configuration for cleanup being skipped. [ 10.498531] systemd[1]: Condition check resulted in Set Up Additional Binary Formats being skipped. [ 10.507709] systemd[1]: Condition check resulted in File System Check on Root Device being skipped. [ 10.518017] systemd[1]: Starting Load Kernel Modules... Starting Load Kernel Modules... [ 10.539319] systemd[1]: Starting Remount Root and Kernel File Systems... Starting Remount Root and Kernel File Systems... [ 10.551628] EXT4-fs (sda1): re-mounted. Opts: errors=remount-ro,user_xattr [ 10.563404] systemd[1]: Starting udev Coldplug all Devices... Starting udev Coldplug all Dev[ 10.572498] lp: driver loaded but no devices found ices... [ 10.587387] systemd[1]: Starting Uncomplicated firewall... Starting Uncomplicated firewall... [ 10.606833] Loading iSCSI transport class v2.0-870. [ 10.608097] systemd[1]: Started Journal Service. [ OK ] Started Journal Service. [ OK ] Mounted Huge Pages File System. [ OK ] Mounted POSIX Message Queue File System. [ OK ] Mounted NFSD configuration filesystem. [ OK ] Mounted RPC Pipe File System. [ OK ] Mounted Kernel Debug File System. [ OK ] Mounted Kernel Trace File System. [ OK ] Finished Set the console keyboard layout. [ OK ] Finished Create list of st… nodes for the current kernel. [ OK ] Finished Monitoring of LVM… dmeventd or progress polling. [ OK ] Finished Load Kernel Module drm. [ OK ] Finished Load Kernel Modules. [ OK ] Finished Remount Root and Kernel File Systems. [ OK ] Finished Uncomplicated firewall. Activating swap /swapfile... Mounting FUSE Control File System... Mounting Kernel Configuration File System... Starting pNFS block layout mapping daemon... [ 10.918717] Adding 2097148k swap on /swapfile. Priority:-2 extents:6 across:2260988k FS Starting Flush Journal to Persistent Storage... [ 10.939247] systemd-journald[364]: Received client request to flush runtime journal. Starting Load/Save Random Seed... Starting Apply Kernel Variables... Starting Create System Users... [ OK ] Activated swap /swapfile. [ OK ] Finished udev Coldplug all Devices. [ OK ] Mounted FUSE Control File System. [ OK ] Mounted Kernel Configuration File System. [ OK ] Started pNFS block layout mapping daemon. [ OK ] Reached target Swap. Starting Helper to synchronize boot up for ifupdown... [ OK ] Finished Load/Save Random Seed. [ OK ] Finished Create System Users. [ OK ] Finished Apply Kernel Variables. Starting Create Static Device Nodes in /dev... [ OK ] Finished Create Static Device Nodes in /dev. [ OK ] Reached target Local File Systems (Pre). [ OK ] Reached target Local File Systems. Starting Load AppArmor profiles... Starting Set console font and keymap... Starting Create final runt…dir for shutdown pivot root... Starting Preprocess NFS configuration... Starting Tell Plymouth To Write Out Runtime Data... Starting QEMU KVM preparation - module, ksm, hugepages... Starting udev Kernel Device Manager... [ OK ] Finished Set console font and keymap. [ OK ] Finished Create final runt…e dir for shutdown pivot root. [ OK ] Finished Preprocess NFS configuration. [ OK ] Finished Tell Plymouth To Write Out Runtime Data. Starting NFSv4 ID-name mapping service... [ OK ] Reached target NFS client services. [ OK ] Started NFSv4 ID-name mapping service. [ OK ] Finished QEMU KVM preparation - module, ksm, hugepages. [ OK ] Finished Flush Journal to Persistent Storage. [ OK ] Started udev Kernel Device Manager. [ OK ] Started Dispatch Password …ts to Console Directory Watch. [ OK ] Reached target Local Encrypted Volumes. [ OK ] Reached target Paths. Starting Network Service... Starting Create Volatile Files and Directories... [ OK ] Finished Load AppArmor profiles. [ OK ] Finished Create Volatile Files and Directories. Starting RPC bind portmap service... Starting Update UTMP about System Boot/Shutdown... [ OK ] Finished Update UTMP about System Boot/Shutdown. [ OK ] Reached target System Initialization. [ OK ] Started Daily apt download activities. [ OK ] Started Daily apt upgrade and clean activities. [ OK ] Started Periodic ext4 Onli…ata Check for All Filesystems. [ OK ] Started Discard unused blocks once a week. [ OK ] Started Daily rotation of log files. [ OK ] Started Daily man-db regeneration. [ OK ] Started Message of the Day. [ OK ] Started Daily Cleanup of Temporary Directories. [ OK ] Started Ubuntu Advantage Timer for running repeated jobs. [ OK ] Reached target Timers. [ OK ] Listening on D-Bus System Message Bus Socket. Starting Docker Socket for the API. [ OK ] Listening on Open-iSCSI iscsid Socket. [ OK ] Listening on UUID daemon activation socket. [ OK ] Listening on Docker Socket for the API. [ OK ] Found device /dev/ttyS1. [ OK ] Started Network Service. [ OK ] Found device /dev/vg_nvme/lv_5. [ OK ] Created slice system-lvm2\x2dpvscan.slice. [ OK ] Reached target Sockets. [ OK ] Reached target Basic System. [ OK ] Listening on Load/Save RF …itch Status /dev/rfkill Watch. Mounting /var/lib/ceph... Starting Accounts Service... [ OK ] Started Ceph crash dump collector. [ OK ] Reached target ceph target…h*@.service instances at once. [ OK ] Started D-Bus System Message Bus. [ OK ] Started Save initial kernel messages after boot. Starting Remove Stale Onli…t4 Metadata Check Snapshots... Starting Record successful boot for GRUB... [ OK ] Started irqbalance daemon. [ OK ] Started LTTng session daemon. Starting LVM event activation on device 259:0... Starting Dispatcher daemon for systemd-networkd... [ OK ] Started Set the CPU Frequency Scaling governor. Starting System Logging Service... Starting Self Monitoring a…g Technology (SMART) Daemon... Starting Resets System Activity Data Collector... Starting Login Service... Starting Wait for Network to be Configured... Starting Network Name Resolution... [ OK ] Started RPC bind portmap service. [ OK ] Mounted /var/lib/ceph. [ OK ] Finished Remove Stale Onli…ext4 Metadata Check Snapshots. [ OK ] Finished LVM event activation on device 259:0. [ OK ] Finished Resets System Activity Data Collector. [ OK ] Started Login Service. [ OK ] Reached target RPC Port Mapper. [ OK ] Found device 82599ES 10-Gi…ion (AOC-STGN-I2S [REV 1.01]). [ OK ] Started ifup for enp3s0f1. [ OK ] Started System Logging Service. [ OK ] Finished Record successful boot for GRUB. Starting GRUB failed boot detection... [ OK ] Finished GRUB failed boot detection. [ OK ] Finished Helper to synchronize boot up for ifupdown. Starting Raise network interfaces... [ OK ] Started Self Monitoring an…ing Technology (SMART) Daemon. [ OK ] Started Network Name Resolution. [ OK ] Reached target Host and Network Name Lookups. Starting Authorization Manager... [ OK ] Started Authorization Manager. [ OK ] Started Accounts Service. [ OK ] Started Dispatcher daemon for systemd-networkd. [* ] (1 of 2) A start job is running for… network interfaces (8s / 5min 4s) M [ OK ] Finished Wait for Network to be Configured.  Stopping Network Name Resolution... [ OK ] Stopped Network Name Resolution. Starting Network Name Resolution... [ OK ] Started Network Name Resolution. [ OK ] Finished Raise network interfaces. [ OK ] Reached target Network. [ OK ] Reached target Network is Online. Starting containerd container runtime... Starting NFS Mount Daemon... Starting Network Time Service... Starting Map RBD devices... Starting /etc/rc.local Compatibility... + '[' '!' -f /.cephlab_net_configured ']' + set +e + attempts=0 + myips= + '[' '' '!=' '' ']' + '[' 0 -ge 10 ']' ++ ip -4 addr ++ grep -oP '(?<=inet\s)\d+(\.\d+){3}' ++ grep -v '127.0.0.1\|127.0.1.1' + myips=172.21.15.97 + attempts=1 + sleep 1 Starting OpenBSD Secure Shell server... Starting (i)SCSI target daemon... Starting Ubuntu FAN network setup... [ OK ] Started Unattended Upgrades Shutdown. [ OK ] Started NFS Mount Daemon. [ OK ] Finished Map RBD devices. + '[' 172.21.15.97 '!=' '' ']' + set -e + '[' -n 172.21.15.97 ']' + for ip in $myips + timeout 1s ping -I 172.21.15.97 -nq -c1 172.21.0.1 ++ dig +short -x 172.21.15.97 @172.21.0.1 ++ sed 's/\.com.*/\.com/g' + newhostname=smithi097.front.sepia.ceph.com + '[' -n smithi097.front.sepia.ceph.com ']' + hostname smithi097.front.sepia.ceph.com ++ hostname -d + newdomain=front.sepia.ceph.com ++ hostname -s + shorthostname=smithi097 + echo smithi097 + grep -q front.sepia.ceph.com /etc/hosts + sed -i 's/.*front.sepia.ceph.com.*/172.21.15.97 smithi097.front.sepia.ceph.com smithi097/g' /etc/hosts + break + command -v zypper + command -v apt-get + '[' '!' -f /etc/ssh/ssh_host_rsa_key ']' + '[' -e /.cephlab_rc_local ']' + exit 0 [ OK ] Started /etc/rc.local Compatibility. Starting Hold until boot process finishes up... Starting Terminate Plymouth Boot Screen... [ OK ] Finished Hold until boot process finishes up. [ OK ] Finished Terminate Plymouth Boot Screen. [ OK ] Started Serial Getty on ttyS1. Starting Set console scheme... [ OK ] Finished Set console scheme. [ OK ] Created slice system-getty.slice. [ OK ] Started Getty on tty1. [ OK ] Reached target Login Prompts. [ OK ] Started containerd container runtime. Starting Docker Application Container Engine... [ OK ] Started LSB: Collectl monitors system performance.. Ubuntu 20.04.4 LTS smithi097.front.sepia.ceph.com ttyS1 smithi097 login: [disconnect] 2024-04-19T03:04:35.403 INFO:teuthology.misc:Re-opening connections... 2024-04-19T03:04:35.403 INFO:teuthology.misc:trying to connect to ubuntu@smithi097.front.sepia.ceph.com 2024-04-19T03:04:35.403 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi097.front.sepia.ceph.com' 2024-04-19T03:04:35.404 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi097.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-19T03:04:35.836 DEBUG:teuthology.orchestra.run.smithi097:> true 2024-04-19T03:04:36.877 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi097.front.sepia.ceph.com' 2024-04-19T03:04:36.877 DEBUG:teuthology.misc:waited 1.4745123386383057 2024-04-19T03:04:37.794 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~129s 2024-04-19T03:04:37.879 DEBUG:tasks.ceph_manager:Mounting data for osd.0 on ubuntu@smithi097.front.sepia.ceph.com 2024-04-19T03:04:37.879 INFO:tasks.ceph_manager:Mounting osd.0: dev: ubuntu@smithi097.front.sepia.ceph.com, cluster: cephmountpoint: /var/lib/ceph/osd/ceph-0, type: xfs, options: ['noatime'] 2024-04-19T03:04:37.879 DEBUG:teuthology.orchestra.run.smithi097:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-04-19T03:04:38.008 DEBUG:teuthology.orchestra.run.smithi097:> sudo install -d -m0777 -- /var/run/ceph 2024-04-19T03:04:38.050 INFO:tasks.ceph.osd.0:Restarting daemon 2024-04-19T03:04:38.050 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-04-19T03:04:38.052 INFO:tasks.ceph.osd.0:Started 2024-04-19T03:04:38.053 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T03:04:38.167 INFO:teuthology.orchestra.run.smithi097.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2024-04-19T03:04:38.169 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-19T03:04:38.170 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-0, ['dump_ops_in_flight'] 2024-04-19T03:04:39.696 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-04-19T03:04:40.045+0000 7fa9cfef1880 -1 Falling back to public interface 2024-04-19T03:04:43.171 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T03:04:43.270 INFO:teuthology.orchestra.run.smithi097.stderr:no valid command found; 10 closest matches: 2024-04-19T03:04:43.270 INFO:teuthology.orchestra.run.smithi097.stderr:0 2024-04-19T03:04:43.270 INFO:teuthology.orchestra.run.smithi097.stderr:1 2024-04-19T03:04:43.270 INFO:teuthology.orchestra.run.smithi097.stderr:2 2024-04-19T03:04:43.270 INFO:teuthology.orchestra.run.smithi097.stderr:abort 2024-04-19T03:04:43.270 INFO:teuthology.orchestra.run.smithi097.stderr:assert 2024-04-19T03:04:43.270 INFO:teuthology.orchestra.run.smithi097.stderr:bluestore allocator dump block 2024-04-19T03:04:43.270 INFO:teuthology.orchestra.run.smithi097.stderr:bluestore allocator fragmentation block 2024-04-19T03:04:43.270 INFO:teuthology.orchestra.run.smithi097.stderr:bluestore allocator score block 2024-04-19T03:04:43.271 INFO:teuthology.orchestra.run.smithi097.stderr:config diff 2024-04-19T03:04:43.271 INFO:teuthology.orchestra.run.smithi097.stderr:config diff get 2024-04-19T03:04:43.271 INFO:teuthology.orchestra.run.smithi097.stderr:admin_socket: invalid command 2024-04-19T03:04:43.272 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-04-19T03:04:43.272 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-0, ['dump_ops_in_flight'] 2024-04-19T03:04:43.698 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 has been restored 2024-04-19T03:04:47.990 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-04-19T03:04:48.337+0000 7fa9cfef1880 -1 osd.0 42 log_to_monitors true 2024-04-19T03:04:48.273 DEBUG:teuthology.orchestra.run.smithi097:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-19T03:04:48.295 INFO:tasks.ceph.osd.0.smithi097.stderr:2024-04-19T03:04:48.645+0000 7fa9c37df700 -1 osd.0 42 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-19T03:04:48.377 INFO:teuthology.orchestra.run.smithi097.stdout:{ 2024-04-19T03:04:48.377 INFO:teuthology.orchestra.run.smithi097.stdout: "ops": [], 2024-04-19T03:04:48.377 INFO:teuthology.orchestra.run.smithi097.stdout: "num_ops": 0 2024-04-19T03:04:48.377 INFO:teuthology.orchestra.run.smithi097.stdout:} 2024-04-19T03:04:48.386 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-04-19T03:04:49.231 INFO:teuthology.orchestra.run.smithi096.stderr:reweighted osd.0 to 1 (10000) 2024-04-19T03:04:49.246 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-04-19T03:04:50.252 INFO:teuthology.orchestra.run.smithi096.stderr:reweighted osd.1 to 1 (10000) 2024-04-19T03:04:50.268 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-04-19T03:04:51.258 INFO:teuthology.orchestra.run.smithi096.stderr:reweighted osd.2 to 1 (10000) 2024-04-19T03:04:51.271 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-04-19T03:04:51.272 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-19T03:04:51.581 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-19T03:04:51.583 INFO:teuthology.orchestra.run.smithi096.stderr:dumped all 2024-04-19T03:04:51.597 INFO:teuthology.orchestra.run.smithi096.stdout:{"pg_ready":true,"pg_map":{"version":182,"stamp":"2024-04-19T03:04:51.249167+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":5,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":155,"acting":155,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":223,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":749964,"kb_used_data":285668,"kb_used_omap":9,"kb_used_meta":464246,"kb_avail":282365556,"statfs":{"total":289910292480,"available":289142329344,"internally_reserved":0,"allocated":292524032,"data_stored":4647586291,"data_compressed":8915781,"data_compressed_allocated":290426880,"data_compressed_original":4646797312,"omap_allocated":10071,"internal_metadata":475388073},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-3,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.210479"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":64,"reported_epoch":68,"state":"active+undersized","last_fresh":"2024-04-19T03:03:33.743192+0000","last_change":"2024-04-19T03:02:24.266182+0000","last_active":"2024-04-19T03:03:33.743192+0000","last_peered":"2024-04-19T03:03:33.743192+0000","last_clean":"2024-04-19T03:02:21.249547+0000","last_became_active":"2024-04-19T03:02:24.266182+0000","last_became_peered":"2024-04-19T03:02:24.266182+0000","last_unstale":"2024-04-19T03:03:33.743192+0000","last_undegraded":"2024-04-19T03:03:33.743192+0000","last_fullsized":"2024-04-19T03:02:24.261935+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:20:35.729791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":67,"reported_epoch":71,"state":"peering","last_fresh":"2024-04-19T03:04:49.228465+0000","last_change":"2024-04-19T03:04:49.229512+0000","last_active":"2024-04-19T03:04:49.228465+0000","last_peered":"2024-04-19T03:04:49.103074+0000","last_clean":"2024-04-19T03:02:21.248866+0000","last_became_active":"2024-04-19T03:02:24.268239+0000","last_became_peered":"2024-04-19T03:02:24.268239+0000","last_unstale":"2024-04-19T03:04:49.228465+0000","last_undegraded":"2024-04-19T03:04:49.228465+0000","last_fullsized":"2024-04-19T03:04:49.228465+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:33:34.879955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":61,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-19T03:04:48.225576+0000","last_change":"2024-04-19T03:01:15.015884+0000","last_active":"2024-04-19T03:04:48.225576+0000","last_peered":"2024-04-19T03:04:48.225576+0000","last_clean":"2024-04-19T03:04:48.225576+0000","last_became_active":"2024-04-19T03:01:15.014599+0000","last_became_peered":"2024-04-19T03:01:15.014599+0000","last_unstale":"2024-04-19T03:04:48.225576+0000","last_undegraded":"2024-04-19T03:04:48.225576+0000","last_fullsized":"2024-04-19T03:04:48.225576+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:35:19.436344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":67,"reported_epoch":71,"state":"peering","last_fresh":"2024-04-19T03:04:49.236427+0000","last_change":"2024-04-19T03:04:49.236807+0000","last_active":"2024-04-19T03:04:49.236427+0000","last_peered":"2024-04-19T03:04:48.226533+0000","last_clean":"2024-04-19T03:02:21.239010+0000","last_became_active":"2024-04-19T03:02:24.283312+0000","last_became_peered":"2024-04-19T03:02:24.283312+0000","last_unstale":"2024-04-19T03:04:49.236427+0000","last_undegraded":"2024-04-19T03:04:49.236427+0000","last_fullsized":"2024-04-19T03:04:49.236427+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:31:31.190200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":64,"reported_epoch":69,"state":"active+undersized","last_fresh":"2024-04-19T03:03:34.761083+0000","last_change":"2024-04-19T03:02:24.265793+0000","last_active":"2024-04-19T03:03:34.761083+0000","last_peered":"2024-04-19T03:03:34.761083+0000","last_clean":"2024-04-19T03:02:21.249126+0000","last_became_active":"2024-04-19T03:02:24.265793+0000","last_became_peered":"2024-04-19T03:02:24.265793+0000","last_unstale":"2024-04-19T03:03:34.761083+0000","last_undegraded":"2024-04-19T03:03:34.761083+0000","last_fullsized":"2024-04-19T03:02:24.253775+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:15:46.441415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":59,"reported_epoch":69,"state":"active+undersized","last_fresh":"2024-04-19T03:03:35.094241+0000","last_change":"2024-04-19T03:02:24.269520+0000","last_active":"2024-04-19T03:03:35.094241+0000","last_peered":"2024-04-19T03:03:35.094241+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"2024-04-19T03:02:24.269520+0000","last_became_peered":"2024-04-19T03:02:24.269520+0000","last_unstale":"2024-04-19T03:03:35.094241+0000","last_undegraded":"2024-04-19T03:03:35.094241+0000","last_fullsized":"2024-04-19T03:02:24.255694+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:45:46.332608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":59,"reported_epoch":69,"state":"active+undersized","last_fresh":"2024-04-19T03:03:35.095224+0000","last_change":"2024-04-19T03:02:24.271511+0000","last_active":"2024-04-19T03:03:35.095224+0000","last_peered":"2024-04-19T03:03:35.095224+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"2024-04-19T03:02:24.271511+0000","last_became_peered":"2024-04-19T03:02:24.271511+0000","last_unstale":"2024-04-19T03:03:35.095224+0000","last_undegraded":"2024-04-19T03:03:35.095224+0000","last_fullsized":"2024-04-19T03:02:24.257544+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:45:01.989501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":67,"reported_epoch":71,"state":"peering","last_fresh":"2024-04-19T03:04:49.244438+0000","last_change":"2024-04-19T03:04:49.244616+0000","last_active":"2024-04-19T03:04:49.244438+0000","last_peered":"2024-04-19T03:04:48.224532+0000","last_clean":"2024-04-19T03:02:21.238411+0000","last_became_active":"2024-04-19T03:02:24.261119+0000","last_became_peered":"2024-04-19T03:02:24.261119+0000","last_unstale":"2024-04-19T03:04:49.244438+0000","last_undegraded":"2024-04-19T03:04:49.244438+0000","last_fullsized":"2024-04-19T03:04:49.244438+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:57:01.109868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":33,"reported_epoch":68,"state":"active+undersized","last_fresh":"2024-04-19T03:03:33.742471+0000","last_change":"2024-04-19T03:02:24.263980+0000","last_active":"2024-04-19T03:03:33.742471+0000","last_peered":"2024-04-19T03:03:33.742471+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"2024-04-19T03:02:24.263980+0000","last_became_peered":"2024-04-19T03:02:24.263980+0000","last_unstale":"2024-04-19T03:03:33.742471+0000","last_undegraded":"2024-04-19T03:03:33.742471+0000","last_fullsized":"2024-04-19T03:02:24.256849+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:07:41.954531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":67,"reported_epoch":71,"state":"peering","last_fresh":"2024-04-19T03:04:49.227330+0000","last_change":"2024-04-19T03:04:49.227670+0000","last_active":"2024-04-19T03:04:49.227330+0000","last_peered":"2024-04-19T03:04:49.103387+0000","last_clean":"2024-04-19T03:02:21.249077+0000","last_became_active":"2024-04-19T03:02:24.268562+0000","last_became_peered":"2024-04-19T03:02:24.268562+0000","last_unstale":"2024-04-19T03:04:49.227330+0000","last_undegraded":"2024-04-19T03:04:49.227330+0000","last_fullsized":"2024-04-19T03:04:49.227330+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:43:17.397637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":59,"reported_epoch":69,"state":"active+undersized","last_fresh":"2024-04-19T03:03:35.095107+0000","last_change":"2024-04-19T03:02:24.273737+0000","last_active":"2024-04-19T03:03:35.095107+0000","last_peered":"2024-04-19T03:03:35.095107+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"2024-04-19T03:02:24.273737+0000","last_became_peered":"2024-04-19T03:02:24.273737+0000","last_unstale":"2024-04-19T03:03:35.095107+0000","last_undegraded":"2024-04-19T03:03:35.095107+0000","last_fullsized":"2024-04-19T03:02:24.262626+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:19:16.702009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":33,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-19T03:04:48.225620+0000","last_change":"2024-04-19T03:02:40.438738+0000","last_active":"2024-04-19T03:04:48.225620+0000","last_peered":"2024-04-19T03:04:48.225620+0000","last_clean":"2024-04-19T03:04:48.225620+0000","last_became_active":"2024-04-19T03:02:40.438000+0000","last_became_peered":"2024-04-19T03:02:40.438000+0000","last_unstale":"2024-04-19T03:04:48.225620+0000","last_undegraded":"2024-04-19T03:04:48.225620+0000","last_fullsized":"2024-04-19T03:04:48.225620+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:35:10.932021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":64,"reported_epoch":69,"state":"active+undersized","last_fresh":"2024-04-19T03:03:34.759201+0000","last_change":"2024-04-19T03:02:24.265275+0000","last_active":"2024-04-19T03:03:34.759201+0000","last_peered":"2024-04-19T03:03:34.759201+0000","last_clean":"2024-04-19T03:02:21.248908+0000","last_became_active":"2024-04-19T03:02:24.265275+0000","last_became_peered":"2024-04-19T03:02:24.265275+0000","last_unstale":"2024-04-19T03:03:34.759201+0000","last_undegraded":"2024-04-19T03:03:34.759201+0000","last_fullsized":"2024-04-19T03:02:24.253280+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:10:26.573207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":61,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-19T03:04:48.225063+0000","last_change":"2024-04-19T03:01:15.010960+0000","last_active":"2024-04-19T03:04:48.225063+0000","last_peered":"2024-04-19T03:04:48.225063+0000","last_clean":"2024-04-19T03:04:48.225063+0000","last_became_active":"2024-04-19T03:01:15.010472+0000","last_became_peered":"2024-04-19T03:01:15.010472+0000","last_unstale":"2024-04-19T03:04:48.225063+0000","last_undegraded":"2024-04-19T03:04:48.225063+0000","last_fullsized":"2024-04-19T03:04:48.225063+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:21:36.129346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":61,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-19T03:04:48.226314+0000","last_change":"2024-04-19T03:01:15.014574+0000","last_active":"2024-04-19T03:04:48.226314+0000","last_peered":"2024-04-19T03:04:48.226314+0000","last_clean":"2024-04-19T03:04:48.226314+0000","last_became_active":"2024-04-19T03:01:15.014096+0000","last_became_peered":"2024-04-19T03:01:15.014096+0000","last_unstale":"2024-04-19T03:04:48.226314+0000","last_undegraded":"2024-04-19T03:04:48.226314+0000","last_fullsized":"2024-04-19T03:04:48.226314+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:01:54.253963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":59,"reported_epoch":69,"state":"active+undersized","last_fresh":"2024-04-19T03:03:35.093776+0000","last_change":"2024-04-19T03:02:24.261536+0000","last_active":"2024-04-19T03:03:35.093776+0000","last_peered":"2024-04-19T03:03:35.093776+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"2024-04-19T03:02:24.261536+0000","last_became_peered":"2024-04-19T03:02:24.261536+0000","last_unstale":"2024-04-19T03:03:35.093776+0000","last_undegraded":"2024-04-19T03:03:35.093776+0000","last_fullsized":"2024-04-19T03:02:24.255185+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:22:34.583134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":34,"reported_epoch":69,"state":"active+undersized","last_fresh":"2024-04-19T03:03:34.761616+0000","last_change":"2024-04-19T03:02:24.264729+0000","last_active":"2024-04-19T03:03:34.761616+0000","last_peered":"2024-04-19T03:03:34.761616+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"2024-04-19T03:02:24.264729+0000","last_became_peered":"2024-04-19T03:02:24.264729+0000","last_unstale":"2024-04-19T03:03:34.761616+0000","last_undegraded":"2024-04-19T03:03:34.761616+0000","last_fullsized":"2024-04-19T03:02:24.258548+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:16:20.425626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":64,"reported_epoch":69,"state":"active+undersized","last_fresh":"2024-04-19T03:03:34.760976+0000","last_change":"2024-04-19T03:02:24.269142+0000","last_active":"2024-04-19T03:03:34.760976+0000","last_peered":"2024-04-19T03:03:34.760976+0000","last_clean":"2024-04-19T03:02:21.249343+0000","last_became_active":"2024-04-19T03:02:24.269142+0000","last_became_peered":"2024-04-19T03:02:24.269142+0000","last_unstale":"2024-04-19T03:03:34.760976+0000","last_undegraded":"2024-04-19T03:03:34.760976+0000","last_fullsized":"2024-04-19T03:02:24.257309+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:36:10.316727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":34,"reported_epoch":69,"state":"active+undersized","last_fresh":"2024-04-19T03:03:34.761984+0000","last_change":"2024-04-19T03:02:24.262871+0000","last_active":"2024-04-19T03:03:34.761984+0000","last_peered":"2024-04-19T03:03:34.761984+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"2024-04-19T03:02:24.262871+0000","last_became_peered":"2024-04-19T03:02:24.262871+0000","last_unstale":"2024-04-19T03:03:34.761984+0000","last_undegraded":"2024-04-19T03:03:34.761984+0000","last_fullsized":"2024-04-19T03:02:24.254723+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:19:25.662483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":67,"reported_epoch":71,"state":"peering","last_fresh":"2024-04-19T03:04:49.238473+0000","last_change":"2024-04-19T03:04:49.238833+0000","last_active":"2024-04-19T03:04:49.238473+0000","last_peered":"2024-04-19T03:04:48.226117+0000","last_clean":"2024-04-19T03:02:21.238883+0000","last_became_active":"2024-04-19T03:02:24.280097+0000","last_became_peered":"2024-04-19T03:02:24.280097+0000","last_unstale":"2024-04-19T03:04:49.238473+0000","last_undegraded":"2024-04-19T03:04:49.238473+0000","last_fullsized":"2024-04-19T03:04:49.238473+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:18:02.311663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":67,"reported_epoch":71,"state":"peering","last_fresh":"2024-04-19T03:04:49.243380+0000","last_change":"2024-04-19T03:04:49.243554+0000","last_active":"2024-04-19T03:04:49.243380+0000","last_peered":"2024-04-19T03:04:48.227227+0000","last_clean":"2024-04-19T03:02:21.239350+0000","last_became_active":"2024-04-19T03:02:24.265606+0000","last_became_peered":"2024-04-19T03:02:24.265606+0000","last_unstale":"2024-04-19T03:04:49.243380+0000","last_undegraded":"2024-04-19T03:04:49.243380+0000","last_fullsized":"2024-04-19T03:04:49.243380+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:26:01.458051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":61,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-19T03:04:49.101571+0000","last_change":"2024-04-19T03:01:15.020108+0000","last_active":"2024-04-19T03:04:49.101571+0000","last_peered":"2024-04-19T03:04:49.101571+0000","last_clean":"2024-04-19T03:04:49.101571+0000","last_became_active":"2024-04-19T03:01:15.018978+0000","last_became_peered":"2024-04-19T03:01:15.018978+0000","last_unstale":"2024-04-19T03:04:49.101571+0000","last_undegraded":"2024-04-19T03:04:49.101571+0000","last_fullsized":"2024-04-19T03:04:49.101571+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:30:22.360053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":34,"reported_epoch":69,"state":"active+undersized","last_fresh":"2024-04-19T03:03:35.093708+0000","last_change":"2024-04-19T03:02:24.260984+0000","last_active":"2024-04-19T03:03:35.093708+0000","last_peered":"2024-04-19T03:03:35.093708+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"2024-04-19T03:02:24.260984+0000","last_became_peered":"2024-04-19T03:02:24.260984+0000","last_unstale":"2024-04-19T03:03:35.093708+0000","last_undegraded":"2024-04-19T03:03:35.093708+0000","last_fullsized":"2024-04-19T03:02:24.254937+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:36:55.924337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":64,"reported_epoch":68,"state":"active+undersized","last_fresh":"2024-04-19T03:03:33.739131+0000","last_change":"2024-04-19T03:02:24.267695+0000","last_active":"2024-04-19T03:03:33.739131+0000","last_peered":"2024-04-19T03:03:33.739131+0000","last_clean":"2024-04-19T03:02:21.248328+0000","last_became_active":"2024-04-19T03:02:24.267695+0000","last_became_peered":"2024-04-19T03:02:24.267695+0000","last_unstale":"2024-04-19T03:03:33.739131+0000","last_undegraded":"2024-04-19T03:03:33.739131+0000","last_fullsized":"2024-04-19T03:02:24.251954+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:45:46.987421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":34,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-19T03:04:49.241504+0000","last_change":"2024-04-19T03:02:40.441681+0000","last_active":"2024-04-19T03:04:49.241504+0000","last_peered":"2024-04-19T03:04:49.241504+0000","last_clean":"2024-04-19T03:04:49.241504+0000","last_became_active":"2024-04-19T03:02:40.441170+0000","last_became_peered":"2024-04-19T03:02:40.441170+0000","last_unstale":"2024-04-19T03:04:49.241504+0000","last_undegraded":"2024-04-19T03:04:49.241504+0000","last_fullsized":"2024-04-19T03:04:49.241504+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:43:25.396638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":34,"reported_epoch":69,"state":"active+undersized","last_fresh":"2024-04-19T03:03:35.096362+0000","last_change":"2024-04-19T03:02:24.272073+0000","last_active":"2024-04-19T03:03:35.096362+0000","last_peered":"2024-04-19T03:03:35.096362+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"2024-04-19T03:02:24.272073+0000","last_became_peered":"2024-04-19T03:02:24.272073+0000","last_unstale":"2024-04-19T03:03:35.096362+0000","last_undegraded":"2024-04-19T03:03:35.096362+0000","last_fullsized":"2024-04-19T03:02:24.263402+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:53:27.352419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":44,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-19T03:04:49.103486+0000","last_change":"2024-04-19T03:02:15.206453+0000","last_active":"2024-04-19T03:04:49.103486+0000","last_peered":"2024-04-19T03:04:49.103486+0000","last_clean":"2024-04-19T03:04:49.103486+0000","last_became_active":"2024-04-19T03:02:15.205905+0000","last_became_peered":"2024-04-19T03:02:15.205905+0000","last_unstale":"2024-04-19T03:04:49.103486+0000","last_undegraded":"2024-04-19T03:04:49.103486+0000","last_fullsized":"2024-04-19T03:04:49.103486+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:48:06.646477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":61,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-19T03:04:49.103482+0000","last_change":"2024-04-19T03:01:15.020098+0000","last_active":"2024-04-19T03:04:49.103482+0000","last_peered":"2024-04-19T03:04:49.103482+0000","last_clean":"2024-04-19T03:04:49.103482+0000","last_became_active":"2024-04-19T03:01:15.019064+0000","last_became_peered":"2024-04-19T03:01:15.019064+0000","last_unstale":"2024-04-19T03:04:49.103482+0000","last_undegraded":"2024-04-19T03:04:49.103482+0000","last_fullsized":"2024-04-19T03:04:49.103482+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:50:06.490191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":34,"reported_epoch":69,"state":"active+undersized","last_fresh":"2024-04-19T03:03:34.759432+0000","last_change":"2024-04-19T03:02:24.259183+0000","last_active":"2024-04-19T03:03:34.759432+0000","last_peered":"2024-04-19T03:03:34.759432+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"2024-04-19T03:02:24.259183+0000","last_became_peered":"2024-04-19T03:02:24.259183+0000","last_unstale":"2024-04-19T03:03:34.759432+0000","last_undegraded":"2024-04-19T03:03:34.759432+0000","last_fullsized":"2024-04-19T03:02:24.252854+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:19:16.702009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":34,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-19T03:04:48.224820+0000","last_change":"2024-04-19T03:02:40.440907+0000","last_active":"2024-04-19T03:04:48.224820+0000","last_peered":"2024-04-19T03:04:48.224820+0000","last_clean":"2024-04-19T03:04:48.224820+0000","last_became_active":"2024-04-19T03:02:40.440351+0000","last_became_peered":"2024-04-19T03:02:40.440351+0000","last_unstale":"2024-04-19T03:04:48.224820+0000","last_undegraded":"2024-04-19T03:04:48.224820+0000","last_fullsized":"2024-04-19T03:04:48.224820+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:36:36.558329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":34,"reported_epoch":69,"state":"active+undersized","last_fresh":"2024-04-19T03:03:34.758656+0000","last_change":"2024-04-19T03:02:24.258688+0000","last_active":"2024-04-19T03:03:34.758656+0000","last_peered":"2024-04-19T03:03:34.758656+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"2024-04-19T03:02:24.258688+0000","last_became_peered":"2024-04-19T03:02:24.258688+0000","last_unstale":"2024-04-19T03:03:34.758656+0000","last_undegraded":"2024-04-19T03:03:34.758656+0000","last_fullsized":"2024-04-19T03:02:24.251480+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:16:44.560445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":67,"reported_epoch":71,"state":"peering","last_fresh":"2024-04-19T03:04:49.237705+0000","last_change":"2024-04-19T03:04:49.238125+0000","last_active":"2024-04-19T03:04:49.237705+0000","last_peered":"2024-04-19T03:04:48.225027+0000","last_clean":"2024-04-19T03:02:21.238487+0000","last_became_active":"2024-04-19T03:02:24.265187+0000","last_became_peered":"2024-04-19T03:02:24.265187+0000","last_unstale":"2024-04-19T03:04:49.237705+0000","last_undegraded":"2024-04-19T03:04:49.237705+0000","last_fullsized":"2024-04-19T03:04:49.237705+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:40:59.611995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":64,"reported_epoch":69,"state":"active+undersized","last_fresh":"2024-04-19T03:03:34.760124+0000","last_change":"2024-04-19T03:02:24.266012+0000","last_active":"2024-04-19T03:03:34.760124+0000","last_peered":"2024-04-19T03:03:34.760124+0000","last_clean":"2024-04-19T03:02:21.249385+0000","last_became_active":"2024-04-19T03:02:24.266012+0000","last_became_peered":"2024-04-19T03:02:24.266012+0000","last_unstale":"2024-04-19T03:03:34.760124+0000","last_undegraded":"2024-04-19T03:03:34.760124+0000","last_fullsized":"2024-04-19T03:02:24.254885+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:45:01.989501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"20'2","reported_seq":70,"reported_epoch":71,"state":"peering","last_fresh":"2024-04-19T03:04:49.244520+0000","last_change":"2024-04-19T03:04:49.244724+0000","last_active":"2024-04-19T03:04:49.244520+0000","last_peered":"2024-04-19T03:04:48.227587+0000","last_clean":"2024-04-19T03:02:21.239584+0000","last_became_active":"2024-04-19T03:02:24.265759+0000","last_became_peered":"2024-04-19T03:02:24.265759+0000","last_unstale":"2024-04-19T03:04:49.244520+0000","last_undegraded":"2024-04-19T03:04:49.244520+0000","last_fullsized":"2024-04-19T03:04:49.244520+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:35:18.996445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":64,"reported_epoch":69,"state":"active+undersized","last_fresh":"2024-04-19T03:03:34.762013+0000","last_change":"2024-04-19T03:02:24.263260+0000","last_active":"2024-04-19T03:03:34.762013+0000","last_peered":"2024-04-19T03:03:34.762013+0000","last_clean":"2024-04-19T03:02:21.249052+0000","last_became_active":"2024-04-19T03:02:24.263260+0000","last_became_peered":"2024-04-19T03:02:24.263260+0000","last_unstale":"2024-04-19T03:03:34.762013+0000","last_undegraded":"2024-04-19T03:03:34.762013+0000","last_fullsized":"2024-04-19T03:02:24.255863+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:25:50.459325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":35,"reported_epoch":69,"state":"active+undersized","last_fresh":"2024-04-19T03:03:35.094755+0000","last_change":"2024-04-19T03:02:24.269416+0000","last_active":"2024-04-19T03:03:35.094755+0000","last_peered":"2024-04-19T03:03:35.094755+0000","last_clean":"2024-04-19T03:01:13.604133+0000","last_became_active":"2024-04-19T03:02:24.269416+0000","last_became_peered":"2024-04-19T03:02:24.269416+0000","last_unstale":"2024-04-19T03:03:35.094755+0000","last_undegraded":"2024-04-19T03:03:35.094755+0000","last_fullsized":"2024-04-19T03:02:24.260076+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:13:11.249358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":33,"reported_epoch":68,"state":"active+undersized","last_fresh":"2024-04-19T03:03:34.574916+0000","last_change":"2024-04-19T03:02:24.271368+0000","last_active":"2024-04-19T03:03:34.574916+0000","last_peered":"2024-04-19T03:03:34.574916+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"2024-04-19T03:02:24.271368+0000","last_became_peered":"2024-04-19T03:02:24.271368+0000","last_unstale":"2024-04-19T03:03:34.574916+0000","last_undegraded":"2024-04-19T03:03:34.574916+0000","last_fullsized":"2024-04-19T03:02:24.258025+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:46:12.377589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":62,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-19T03:04:49.101742+0000","last_change":"2024-04-19T03:01:14.649074+0000","last_active":"2024-04-19T03:04:49.101742+0000","last_peered":"2024-04-19T03:04:49.101742+0000","last_clean":"2024-04-19T03:04:49.101742+0000","last_became_active":"2024-04-19T03:01:14.648217+0000","last_became_peered":"2024-04-19T03:01:14.648217+0000","last_unstale":"2024-04-19T03:04:49.101742+0000","last_undegraded":"2024-04-19T03:04:49.101742+0000","last_fullsized":"2024-04-19T03:04:49.101742+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:57:05.238043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":33,"reported_epoch":68,"state":"active+undersized","last_fresh":"2024-04-19T03:03:34.575765+0000","last_change":"2024-04-19T03:02:24.272925+0000","last_active":"2024-04-19T03:03:34.575765+0000","last_peered":"2024-04-19T03:03:34.575765+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"2024-04-19T03:02:24.272925+0000","last_became_peered":"2024-04-19T03:02:24.272925+0000","last_unstale":"2024-04-19T03:03:34.575765+0000","last_undegraded":"2024-04-19T03:03:34.575765+0000","last_fullsized":"2024-04-19T03:02:24.260913+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:33:59.041888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"20'8","reported_seq":70,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-19T03:04:48.225294+0000","last_change":"2024-04-19T03:01:14.649044+0000","last_active":"2024-04-19T03:04:48.225294+0000","last_peered":"2024-04-19T03:04:48.225294+0000","last_clean":"2024-04-19T03:04:48.225294+0000","last_became_active":"2024-04-19T03:01:14.648859+0000","last_became_peered":"2024-04-19T03:01:14.648859+0000","last_unstale":"2024-04-19T03:04:48.225294+0000","last_undegraded":"2024-04-19T03:04:48.225294+0000","last_fullsized":"2024-04-19T03:04:48.225294+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:30:45.925657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"20'1","reported_seq":63,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-19T03:04:48.226855+0000","last_change":"2024-04-19T03:01:14.649839+0000","last_active":"2024-04-19T03:04:48.226855+0000","last_peered":"2024-04-19T03:04:48.226855+0000","last_clean":"2024-04-19T03:04:48.226855+0000","last_became_active":"2024-04-19T03:01:14.649571+0000","last_became_peered":"2024-04-19T03:01:14.649571+0000","last_unstale":"2024-04-19T03:04:48.226855+0000","last_undegraded":"2024-04-19T03:04:48.226855+0000","last_fullsized":"2024-04-19T03:04:48.226855+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:03:57.839660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":34,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-19T03:04:49.242898+0000","last_change":"2024-04-19T03:02:40.438407+0000","last_active":"2024-04-19T03:04:49.242898+0000","last_peered":"2024-04-19T03:04:49.242898+0000","last_clean":"2024-04-19T03:04:49.242898+0000","last_became_active":"2024-04-19T03:02:40.437605+0000","last_became_peered":"2024-04-19T03:02:40.437605+0000","last_unstale":"2024-04-19T03:04:49.242898+0000","last_undegraded":"2024-04-19T03:04:49.242898+0000","last_fullsized":"2024-04-19T03:04:49.242898+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:00:03.630606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"20'2","reported_seq":64,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-19T03:04:49.105047+0000","last_change":"2024-04-19T03:01:14.645075+0000","last_active":"2024-04-19T03:04:49.105047+0000","last_peered":"2024-04-19T03:04:49.105047+0000","last_clean":"2024-04-19T03:04:49.105047+0000","last_became_active":"2024-04-19T03:01:14.644790+0000","last_became_peered":"2024-04-19T03:01:14.644790+0000","last_unstale":"2024-04-19T03:04:49.105047+0000","last_undegraded":"2024-04-19T03:04:49.105047+0000","last_fullsized":"2024-04-19T03:04:49.105047+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:55:15.035769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":64,"reported_epoch":68,"state":"active+undersized","last_fresh":"2024-04-19T03:03:33.739784+0000","last_change":"2024-04-19T03:02:24.262120+0000","last_active":"2024-04-19T03:03:33.739784+0000","last_peered":"2024-04-19T03:03:33.739784+0000","last_clean":"2024-04-19T03:02:21.248368+0000","last_became_active":"2024-04-19T03:02:24.262120+0000","last_became_peered":"2024-04-19T03:02:24.262120+0000","last_unstale":"2024-04-19T03:03:33.739784+0000","last_undegraded":"2024-04-19T03:03:33.739784+0000","last_fullsized":"2024-04-19T03:02:24.251780+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:09:48.754662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"20'1","reported_seq":52,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-19T03:04:49.102940+0000","last_change":"2024-04-19T03:02:15.207891+0000","last_active":"2024-04-19T03:04:49.102940+0000","last_peered":"2024-04-19T03:04:49.102940+0000","last_clean":"2024-04-19T03:04:49.102940+0000","last_became_active":"2024-04-19T03:02:15.207334+0000","last_became_peered":"2024-04-19T03:02:15.207334+0000","last_unstale":"2024-04-19T03:04:49.102940+0000","last_undegraded":"2024-04-19T03:04:49.102940+0000","last_fullsized":"2024-04-19T03:04:49.102940+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:29:49.714544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":67,"reported_epoch":71,"state":"peering","last_fresh":"2024-04-19T03:04:49.239135+0000","last_change":"2024-04-19T03:04:49.239520+0000","last_active":"2024-04-19T03:04:49.239135+0000","last_peered":"2024-04-19T03:04:48.225308+0000","last_clean":"2024-04-19T03:02:21.238896+0000","last_became_active":"2024-04-19T03:02:24.269285+0000","last_became_peered":"2024-04-19T03:02:24.269285+0000","last_unstale":"2024-04-19T03:04:49.239135+0000","last_undegraded":"2024-04-19T03:04:49.239135+0000","last_fullsized":"2024-04-19T03:04:49.239135+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:07:53.363452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":60,"reported_epoch":68,"state":"active+undersized","last_fresh":"2024-04-19T03:03:34.575435+0000","last_change":"2024-04-19T03:02:24.283528+0000","last_active":"2024-04-19T03:03:34.575435+0000","last_peered":"2024-04-19T03:03:34.575435+0000","last_clean":"2024-04-19T03:01:13.604133+0000","last_became_active":"2024-04-19T03:02:24.283528+0000","last_became_peered":"2024-04-19T03:02:24.283528+0000","last_unstale":"2024-04-19T03:03:34.575435+0000","last_undegraded":"2024-04-19T03:03:34.575435+0000","last_fullsized":"2024-04-19T03:02:24.265369+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:44:57.689246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":34,"reported_epoch":69,"state":"active+undersized","last_fresh":"2024-04-19T03:03:35.094733+0000","last_change":"2024-04-19T03:02:24.262486+0000","last_active":"2024-04-19T03:03:35.094733+0000","last_peered":"2024-04-19T03:03:35.094733+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"2024-04-19T03:02:24.262486+0000","last_became_peered":"2024-04-19T03:02:24.262486+0000","last_unstale":"2024-04-19T03:03:35.094733+0000","last_undegraded":"2024-04-19T03:03:35.094733+0000","last_fullsized":"2024-04-19T03:02:24.255034+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:10:59.997012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"20'2","reported_seq":43,"reported_epoch":69,"state":"active+undersized+degraded","last_fresh":"2024-04-19T03:03:35.095113+0000","last_change":"2024-04-19T03:02:24.265344+0000","last_active":"2024-04-19T03:03:35.095113+0000","last_peered":"2024-04-19T03:03:35.095113+0000","last_clean":"2024-04-19T03:01:15.001696+0000","last_became_active":"2024-04-19T03:02:24.265344+0000","last_became_peered":"2024-04-19T03:02:24.265344+0000","last_unstale":"2024-04-19T03:03:35.095113+0000","last_undegraded":"2024-04-19T03:02:24.257245+0000","last_fullsized":"2024-04-19T03:02:24.257097+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:10:25.561421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":1}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":67,"reported_epoch":71,"state":"peering","last_fresh":"2024-04-19T03:04:49.243232+0000","last_change":"2024-04-19T03:04:49.243391+0000","last_active":"2024-04-19T03:04:49.243232+0000","last_peered":"2024-04-19T03:04:48.227369+0000","last_clean":"2024-04-19T03:02:21.239001+0000","last_became_active":"2024-04-19T03:02:24.280840+0000","last_became_peered":"2024-04-19T03:02:24.280840+0000","last_unstale":"2024-04-19T03:04:49.243232+0000","last_undegraded":"2024-04-19T03:04:49.243232+0000","last_fullsized":"2024-04-19T03:04:49.243232+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:59:09.311702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":68,"reported_epoch":71,"state":"peering","last_fresh":"2024-04-19T03:04:49.244941+0000","last_change":"2024-04-19T03:04:49.245119+0000","last_active":"2024-04-19T03:04:49.244941+0000","last_peered":"2024-04-19T03:04:48.226445+0000","last_clean":"2024-04-19T03:02:21.239091+0000","last_became_active":"2024-04-19T03:02:24.269896+0000","last_became_peered":"2024-04-19T03:02:24.269896+0000","last_unstale":"2024-04-19T03:04:49.244941+0000","last_undegraded":"2024-04-19T03:04:49.244941+0000","last_fullsized":"2024-04-19T03:04:49.244941+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:59:28.203935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":61,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-19T03:04:48.227116+0000","last_change":"2024-04-19T03:01:15.015685+0000","last_active":"2024-04-19T03:04:48.227116+0000","last_peered":"2024-04-19T03:04:48.227116+0000","last_clean":"2024-04-19T03:04:48.227116+0000","last_became_active":"2024-04-19T03:01:15.014847+0000","last_became_peered":"2024-04-19T03:01:15.014847+0000","last_unstale":"2024-04-19T03:04:48.227116+0000","last_undegraded":"2024-04-19T03:04:48.227116+0000","last_fullsized":"2024-04-19T03:04:48.227116+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:51:06.208551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":33,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-19T03:04:49.247469+0000","last_change":"2024-04-19T03:02:40.440434+0000","last_active":"2024-04-19T03:04:49.247469+0000","last_peered":"2024-04-19T03:04:49.247469+0000","last_clean":"2024-04-19T03:04:49.247469+0000","last_became_active":"2024-04-19T03:02:40.439924+0000","last_became_peered":"2024-04-19T03:02:40.439924+0000","last_unstale":"2024-04-19T03:04:49.247469+0000","last_undegraded":"2024-04-19T03:04:49.247469+0000","last_fullsized":"2024-04-19T03:04:49.247469+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:33:16.864267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":61,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-19T03:04:48.226013+0000","last_change":"2024-04-19T03:01:15.014818+0000","last_active":"2024-04-19T03:04:48.226013+0000","last_peered":"2024-04-19T03:04:48.226013+0000","last_clean":"2024-04-19T03:04:48.226013+0000","last_became_active":"2024-04-19T03:01:15.014421+0000","last_became_peered":"2024-04-19T03:01:15.014421+0000","last_unstale":"2024-04-19T03:04:48.226013+0000","last_undegraded":"2024-04-19T03:04:48.226013+0000","last_fullsized":"2024-04-19T03:04:48.226013+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:16:20.475837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":65,"reported_epoch":68,"state":"active+undersized","last_fresh":"2024-04-19T03:03:33.739378+0000","last_change":"2024-04-19T03:02:24.270374+0000","last_active":"2024-04-19T03:03:33.739378+0000","last_peered":"2024-04-19T03:03:33.739378+0000","last_clean":"2024-04-19T03:02:21.248442+0000","last_became_active":"2024-04-19T03:02:24.270374+0000","last_became_peered":"2024-04-19T03:02:24.270374+0000","last_unstale":"2024-04-19T03:03:33.739378+0000","last_undegraded":"2024-04-19T03:03:33.739378+0000","last_fullsized":"2024-04-19T03:02:24.252696+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:36:04.345818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":34,"reported_epoch":69,"state":"active+undersized","last_fresh":"2024-04-19T03:03:34.760601+0000","last_change":"2024-04-19T03:02:24.263169+0000","last_active":"2024-04-19T03:03:34.760601+0000","last_peered":"2024-04-19T03:03:34.760601+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"2024-04-19T03:02:24.263169+0000","last_became_peered":"2024-04-19T03:02:24.263169+0000","last_unstale":"2024-04-19T03:03:34.760601+0000","last_undegraded":"2024-04-19T03:03:34.760601+0000","last_fullsized":"2024-04-19T03:02:24.256134+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:23:50.481462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"14'157","reported_seq":263,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-19T03:04:48.225736+0000","last_change":"2024-04-19T03:01:07.538434+0000","last_active":"2024-04-19T03:04:48.225736+0000","last_peered":"2024-04-19T03:04:48.225736+0000","last_clean":"2024-04-19T03:04:48.225736+0000","last_became_active":"2024-04-19T03:01:07.537856+0000","last_became_peered":"2024-04-19T03:01:07.537856+0000","last_unstale":"2024-04-19T03:04:48.225736+0000","last_undegraded":"2024-04-19T03:04:48.225736+0000","last_fullsized":"2024-04-19T03:04:48.225736+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:06.516863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:06.516863+0000","last_clean_scrub_stamp":"2024-04-19T03:01:06.516863+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:36:46.386286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":70,"reported_epoch":71,"state":"peering","last_fresh":"2024-04-19T03:04:49.246748+0000","last_change":"2024-04-19T03:04:49.246879+0000","last_active":"2024-04-19T03:04:49.246748+0000","last_peered":"2024-04-19T03:04:48.228146+0000","last_clean":"2024-04-19T03:02:21.239790+0000","last_became_active":"2024-04-19T03:02:24.268308+0000","last_became_peered":"2024-04-19T03:02:24.268308+0000","last_unstale":"2024-04-19T03:04:49.246748+0000","last_undegraded":"2024-04-19T03:04:49.246748+0000","last_fullsized":"2024-04-19T03:04:49.246748+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_clean_scrub_stamp":"2024-04-19T03:01:09.578660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:35:06.302425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":35,"reported_epoch":69,"state":"active+undersized","last_fresh":"2024-04-19T03:03:34.759125+0000","last_change":"2024-04-19T03:02:24.262992+0000","last_active":"2024-04-19T03:03:34.759125+0000","last_peered":"2024-04-19T03:03:34.759125+0000","last_clean":"2024-04-19T03:01:13.604133+0000","last_became_active":"2024-04-19T03:02:24.262992+0000","last_became_peered":"2024-04-19T03:02:24.262992+0000","last_unstale":"2024-04-19T03:03:34.759125+0000","last_undegraded":"2024-04-19T03:03:34.759125+0000","last_fullsized":"2024-04-19T03:02:24.252649+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:11:27.107247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":58,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-19T03:04:48.227313+0000","last_change":"2024-04-19T03:02:40.440550+0000","last_active":"2024-04-19T03:04:48.227313+0000","last_peered":"2024-04-19T03:04:48.227313+0000","last_clean":"2024-04-19T03:04:48.227313+0000","last_became_active":"2024-04-19T03:02:40.439621+0000","last_became_peered":"2024-04-19T03:02:40.439621+0000","last_unstale":"2024-04-19T03:04:48.227313+0000","last_undegraded":"2024-04-19T03:04:48.227313+0000","last_fullsized":"2024-04-19T03:04:48.227313+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:51:11.593632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":64,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-19T03:04:48.226674+0000","last_change":"2024-04-19T03:01:10.602194+0000","last_active":"2024-04-19T03:04:48.226674+0000","last_peered":"2024-04-19T03:04:48.226674+0000","last_clean":"2024-04-19T03:04:48.226674+0000","last_became_active":"2024-04-19T03:01:10.601381+0000","last_became_peered":"2024-04-19T03:01:10.601381+0000","last_unstale":"2024-04-19T03:04:48.226674+0000","last_undegraded":"2024-04-19T03:04:48.226674+0000","last_fullsized":"2024-04-19T03:04:48.226674+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_clean_scrub_stamp":"2024-04-19T03:01:09.578660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:42:26.594095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":35,"reported_epoch":69,"state":"active+undersized","last_fresh":"2024-04-19T03:03:35.094223+0000","last_change":"2024-04-19T03:02:24.269521+0000","last_active":"2024-04-19T03:03:35.094223+0000","last_peered":"2024-04-19T03:03:35.094223+0000","last_clean":"2024-04-19T03:01:13.604133+0000","last_became_active":"2024-04-19T03:02:24.269521+0000","last_became_peered":"2024-04-19T03:02:24.269521+0000","last_unstale":"2024-04-19T03:03:35.094223+0000","last_undegraded":"2024-04-19T03:03:35.094223+0000","last_fullsized":"2024-04-19T03:02:24.255992+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:14:18.946167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":64,"reported_epoch":68,"state":"active+undersized","last_fresh":"2024-04-19T03:03:33.741859+0000","last_change":"2024-04-19T03:02:24.268858+0000","last_active":"2024-04-19T03:03:33.741859+0000","last_peered":"2024-04-19T03:03:33.741859+0000","last_clean":"2024-04-19T03:02:21.249161+0000","last_became_active":"2024-04-19T03:02:24.268858+0000","last_became_peered":"2024-04-19T03:02:24.268858+0000","last_unstale":"2024-04-19T03:03:33.741859+0000","last_undegraded":"2024-04-19T03:03:33.741859+0000","last_fullsized":"2024-04-19T03:02:24.257061+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:42:00.465007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":34,"reported_epoch":69,"state":"active+undersized","last_fresh":"2024-04-19T03:03:34.759535+0000","last_change":"2024-04-19T03:02:24.262857+0000","last_active":"2024-04-19T03:03:34.759535+0000","last_peered":"2024-04-19T03:03:34.759535+0000","last_clean":"2024-04-19T03:01:09.578660+0000","last_became_active":"2024-04-19T03:02:24.262857+0000","last_became_peered":"2024-04-19T03:02:24.262857+0000","last_unstale":"2024-04-19T03:03:34.759535+0000","last_undegraded":"2024-04-19T03:03:34.759535+0000","last_fullsized":"2024-04-19T03:02:24.253233+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_clean_scrub_stamp":"2024-04-19T03:01:09.578660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:00:41.456639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":62,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-19T03:04:49.102435+0000","last_change":"2024-04-19T03:01:14.649068+0000","last_active":"2024-04-19T03:04:49.102435+0000","last_peered":"2024-04-19T03:04:49.102435+0000","last_clean":"2024-04-19T03:04:49.102435+0000","last_became_active":"2024-04-19T03:01:14.648082+0000","last_became_peered":"2024-04-19T03:01:14.648082+0000","last_unstale":"2024-04-19T03:04:49.102435+0000","last_undegraded":"2024-04-19T03:04:49.102435+0000","last_fullsized":"2024-04-19T03:04:49.102435+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:30:14.489117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":34,"reported_epoch":69,"state":"active+undersized","last_fresh":"2024-04-19T03:03:34.760620+0000","last_change":"2024-04-19T03:02:24.263823+0000","last_active":"2024-04-19T03:03:34.760620+0000","last_peered":"2024-04-19T03:03:34.760620+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"2024-04-19T03:02:24.263823+0000","last_became_peered":"2024-04-19T03:02:24.263823+0000","last_unstale":"2024-04-19T03:03:34.760620+0000","last_undegraded":"2024-04-19T03:03:34.760620+0000","last_fullsized":"2024-04-19T03:02:24.256773+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:13:12.261144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":70,"reported_epoch":71,"state":"peering","last_fresh":"2024-04-19T03:04:49.239248+0000","last_change":"2024-04-19T03:04:49.240780+0000","last_active":"2024-04-19T03:04:49.239248+0000","last_peered":"2024-04-19T03:04:48.226330+0000","last_clean":"2024-04-19T03:02:21.239177+0000","last_became_active":"2024-04-19T03:02:24.269783+0000","last_became_peered":"2024-04-19T03:02:24.269783+0000","last_unstale":"2024-04-19T03:04:49.239248+0000","last_undegraded":"2024-04-19T03:04:49.239248+0000","last_fullsized":"2024-04-19T03:04:49.239248+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_clean_scrub_stamp":"2024-04-19T03:01:09.578660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:50:22.833281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":68,"reported_epoch":71,"state":"peering","last_fresh":"2024-04-19T03:04:49.235047+0000","last_change":"2024-04-19T03:04:49.235470+0000","last_active":"2024-04-19T03:04:49.235047+0000","last_peered":"2024-04-19T03:04:48.228156+0000","last_clean":"2024-04-19T03:02:21.239666+0000","last_became_active":"2024-04-19T03:02:24.274962+0000","last_became_peered":"2024-04-19T03:02:24.274962+0000","last_unstale":"2024-04-19T03:04:49.235047+0000","last_undegraded":"2024-04-19T03:04:49.235047+0000","last_fullsized":"2024-04-19T03:04:49.235047+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:30:28.402079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":34,"reported_epoch":69,"state":"active+undersized","last_fresh":"2024-04-19T03:03:34.759233+0000","last_change":"2024-04-19T03:02:24.260888+0000","last_active":"2024-04-19T03:03:34.759233+0000","last_peered":"2024-04-19T03:03:34.759233+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"2024-04-19T03:02:24.260888+0000","last_became_peered":"2024-04-19T03:02:24.260888+0000","last_unstale":"2024-04-19T03:03:34.759233+0000","last_undegraded":"2024-04-19T03:03:34.759233+0000","last_fullsized":"2024-04-19T03:02:24.253375+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:24:49.913495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":60,"reported_epoch":68,"state":"active+undersized","last_fresh":"2024-04-19T03:03:34.575792+0000","last_change":"2024-04-19T03:02:24.273760+0000","last_active":"2024-04-19T03:03:34.575792+0000","last_peered":"2024-04-19T03:03:34.575792+0000","last_clean":"2024-04-19T03:01:13.604133+0000","last_became_active":"2024-04-19T03:02:24.273760+0000","last_became_peered":"2024-04-19T03:02:24.273760+0000","last_unstale":"2024-04-19T03:03:34.575792+0000","last_undegraded":"2024-04-19T03:03:34.575792+0000","last_fullsized":"2024-04-19T03:02:24.263483+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:29:38.352671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":34,"reported_epoch":69,"state":"active+undersized","last_fresh":"2024-04-19T03:03:34.760642+0000","last_change":"2024-04-19T03:02:24.266049+0000","last_active":"2024-04-19T03:03:34.760642+0000","last_peered":"2024-04-19T03:03:34.760642+0000","last_clean":"2024-04-19T03:01:09.578660+0000","last_became_active":"2024-04-19T03:02:24.266049+0000","last_became_peered":"2024-04-19T03:02:24.266049+0000","last_unstale":"2024-04-19T03:03:34.760642+0000","last_undegraded":"2024-04-19T03:03:34.760642+0000","last_fullsized":"2024-04-19T03:02:24.256038+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_clean_scrub_stamp":"2024-04-19T03:01:09.578660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:45:26.469448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":34,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-19T03:04:48.224637+0000","last_change":"2024-04-19T03:02:40.440057+0000","last_active":"2024-04-19T03:04:48.224637+0000","last_peered":"2024-04-19T03:04:48.224637+0000","last_clean":"2024-04-19T03:04:48.224637+0000","last_became_active":"2024-04-19T03:02:40.439752+0000","last_became_peered":"2024-04-19T03:02:40.439752+0000","last_unstale":"2024-04-19T03:04:48.224637+0000","last_undegraded":"2024-04-19T03:04:48.224637+0000","last_fullsized":"2024-04-19T03:04:48.224637+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:38:12.336658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":35,"reported_epoch":69,"state":"active+undersized","last_fresh":"2024-04-19T03:03:34.759788+0000","last_change":"2024-04-19T03:02:24.264727+0000","last_active":"2024-04-19T03:03:34.759788+0000","last_peered":"2024-04-19T03:03:34.759788+0000","last_clean":"2024-04-19T03:01:13.604133+0000","last_became_active":"2024-04-19T03:02:24.264727+0000","last_became_peered":"2024-04-19T03:02:24.264727+0000","last_unstale":"2024-04-19T03:03:34.759788+0000","last_undegraded":"2024-04-19T03:03:34.759788+0000","last_fullsized":"2024-04-19T03:02:24.253765+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:20:27.536142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":68,"reported_epoch":68,"state":"active+undersized","last_fresh":"2024-04-19T03:03:33.741524+0000","last_change":"2024-04-19T03:02:24.263894+0000","last_active":"2024-04-19T03:03:33.741524+0000","last_peered":"2024-04-19T03:03:33.741524+0000","last_clean":"2024-04-19T03:02:21.249599+0000","last_became_active":"2024-04-19T03:02:24.263894+0000","last_became_peered":"2024-04-19T03:02:24.263894+0000","last_unstale":"2024-04-19T03:03:33.741524+0000","last_undegraded":"2024-04-19T03:03:33.741524+0000","last_fullsized":"2024-04-19T03:02:24.256329+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_clean_scrub_stamp":"2024-04-19T03:01:09.578660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:14:49.692877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":34,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-19T03:04:48.226383+0000","last_change":"2024-04-19T03:02:40.440227+0000","last_active":"2024-04-19T03:04:48.226383+0000","last_peered":"2024-04-19T03:04:48.226383+0000","last_clean":"2024-04-19T03:04:48.226383+0000","last_became_active":"2024-04-19T03:02:40.439732+0000","last_became_peered":"2024-04-19T03:02:40.439732+0000","last_unstale":"2024-04-19T03:04:48.226383+0000","last_undegraded":"2024-04-19T03:04:48.226383+0000","last_fullsized":"2024-04-19T03:04:48.226383+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:29:33.660584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"20'2","reported_seq":43,"reported_epoch":69,"state":"active+undersized+degraded","last_fresh":"2024-04-19T03:03:34.761972+0000","last_change":"2024-04-19T03:02:24.265036+0000","last_active":"2024-04-19T03:03:34.761972+0000","last_peered":"2024-04-19T03:03:34.761972+0000","last_clean":"2024-04-19T03:01:15.007165+0000","last_became_active":"2024-04-19T03:02:24.265036+0000","last_became_peered":"2024-04-19T03:02:24.265036+0000","last_unstale":"2024-04-19T03:03:34.761972+0000","last_undegraded":"2024-04-19T03:02:24.258940+0000","last_fullsized":"2024-04-19T03:02:24.258736+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:36:29.647530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[{"shards":"1","objects":1}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":34,"reported_epoch":69,"state":"active+undersized","last_fresh":"2024-04-19T03:03:34.761865+0000","last_change":"2024-04-19T03:02:24.269833+0000","last_active":"2024-04-19T03:03:34.761865+0000","last_peered":"2024-04-19T03:03:34.761865+0000","last_clean":"2024-04-19T03:01:09.578660+0000","last_became_active":"2024-04-19T03:02:24.269833+0000","last_became_peered":"2024-04-19T03:02:24.269833+0000","last_unstale":"2024-04-19T03:03:34.761865+0000","last_undegraded":"2024-04-19T03:03:34.761865+0000","last_fullsized":"2024-04-19T03:02:24.262484+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_clean_scrub_stamp":"2024-04-19T03:01:09.578660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:14:33.574026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":34,"reported_epoch":69,"state":"active+undersized","last_fresh":"2024-04-19T03:03:35.093455+0000","last_change":"2024-04-19T03:02:24.257489+0000","last_active":"2024-04-19T03:03:35.093455+0000","last_peered":"2024-04-19T03:03:35.093455+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"2024-04-19T03:02:24.257489+0000","last_became_peered":"2024-04-19T03:02:24.257489+0000","last_unstale":"2024-04-19T03:03:35.093455+0000","last_undegraded":"2024-04-19T03:03:35.093455+0000","last_fullsized":"2024-04-19T03:02:24.254429+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:52:53.321136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"21'1","reported_seq":44,"reported_epoch":69,"state":"active+undersized+degraded","last_fresh":"2024-04-19T03:03:35.095906+0000","last_change":"2024-04-19T03:02:24.270935+0000","last_active":"2024-04-19T03:03:35.095906+0000","last_peered":"2024-04-19T03:03:35.095906+0000","last_clean":"2024-04-19T03:01:18.093734+0000","last_became_active":"2024-04-19T03:02:24.270935+0000","last_became_peered":"2024-04-19T03:02:24.270935+0000","last_unstale":"2024-04-19T03:03:35.095906+0000","last_undegraded":"2024-04-19T03:02:24.258098+0000","last_fullsized":"2024-04-19T03:02:24.257944+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:57:49.614725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":1}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":64,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-19T03:04:48.226551+0000","last_change":"2024-04-19T03:01:10.602274+0000","last_active":"2024-04-19T03:04:48.226551+0000","last_peered":"2024-04-19T03:04:48.226551+0000","last_clean":"2024-04-19T03:04:48.226551+0000","last_became_active":"2024-04-19T03:01:10.601487+0000","last_became_peered":"2024-04-19T03:01:10.601487+0000","last_unstale":"2024-04-19T03:04:48.226551+0000","last_undegraded":"2024-04-19T03:04:48.226551+0000","last_fullsized":"2024-04-19T03:04:48.226551+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_clean_scrub_stamp":"2024-04-19T03:01:09.578660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:26:16.712446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":61,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-19T03:04:49.101512+0000","last_change":"2024-04-19T03:01:15.018914+0000","last_active":"2024-04-19T03:04:49.101512+0000","last_peered":"2024-04-19T03:04:49.101512+0000","last_clean":"2024-04-19T03:04:49.101512+0000","last_became_active":"2024-04-19T03:01:15.018276+0000","last_became_peered":"2024-04-19T03:01:15.018276+0000","last_unstale":"2024-04-19T03:04:49.101512+0000","last_undegraded":"2024-04-19T03:04:49.101512+0000","last_fullsized":"2024-04-19T03:04:49.101512+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:40:59.453079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":61,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-19T03:04:48.225925+0000","last_change":"2024-04-19T03:01:15.015855+0000","last_active":"2024-04-19T03:04:48.225925+0000","last_peered":"2024-04-19T03:04:48.225925+0000","last_clean":"2024-04-19T03:04:48.225925+0000","last_became_active":"2024-04-19T03:01:15.015358+0000","last_became_peered":"2024-04-19T03:01:15.015358+0000","last_unstale":"2024-04-19T03:04:48.225925+0000","last_undegraded":"2024-04-19T03:04:48.225925+0000","last_fullsized":"2024-04-19T03:04:48.225925+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:59:49.270245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"20'6","reported_seq":68,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-19T03:04:48.227686+0000","last_change":"2024-04-19T03:01:14.649577+0000","last_active":"2024-04-19T03:04:48.227686+0000","last_peered":"2024-04-19T03:04:48.227686+0000","last_clean":"2024-04-19T03:04:48.227686+0000","last_became_active":"2024-04-19T03:01:14.649284+0000","last_became_peered":"2024-04-19T03:01:14.649284+0000","last_unstale":"2024-04-19T03:04:48.227686+0000","last_undegraded":"2024-04-19T03:04:48.227686+0000","last_fullsized":"2024-04-19T03:04:48.227686+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:01:22.214742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":34,"reported_epoch":69,"state":"active+undersized","last_fresh":"2024-04-19T03:03:34.758941+0000","last_change":"2024-04-19T03:02:24.262641+0000","last_active":"2024-04-19T03:03:34.758941+0000","last_peered":"2024-04-19T03:03:34.758941+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"2024-04-19T03:02:24.262641+0000","last_became_peered":"2024-04-19T03:02:24.262641+0000","last_unstale":"2024-04-19T03:03:34.758941+0000","last_undegraded":"2024-04-19T03:03:34.758941+0000","last_fullsized":"2024-04-19T03:02:24.251764+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:45:46.332608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"20'3","reported_seq":41,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-19T03:04:48.227379+0000","last_change":"2024-04-19T03:02:40.442253+0000","last_active":"2024-04-19T03:04:48.227379+0000","last_peered":"2024-04-19T03:04:48.227379+0000","last_clean":"2024-04-19T03:04:48.227379+0000","last_became_active":"2024-04-19T03:02:40.441225+0000","last_became_peered":"2024-04-19T03:02:40.441225+0000","last_unstale":"2024-04-19T03:04:48.227379+0000","last_undegraded":"2024-04-19T03:04:48.227379+0000","last_fullsized":"2024-04-19T03:04:48.227379+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:51:10.208584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":60,"reported_epoch":69,"state":"active+undersized","last_fresh":"2024-04-19T03:03:35.098550+0000","last_change":"2024-04-19T03:02:24.271840+0000","last_active":"2024-04-19T03:03:35.098550+0000","last_peered":"2024-04-19T03:03:35.098550+0000","last_clean":"2024-04-19T03:01:13.604133+0000","last_became_active":"2024-04-19T03:02:24.271840+0000","last_became_peered":"2024-04-19T03:02:24.271840+0000","last_unstale":"2024-04-19T03:03:35.098550+0000","last_undegraded":"2024-04-19T03:03:35.098550+0000","last_fullsized":"2024-04-19T03:02:24.263970+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:00:42.349089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":34,"reported_epoch":69,"state":"active+undersized","last_fresh":"2024-04-19T03:03:35.093733+0000","last_change":"2024-04-19T03:02:24.269277+0000","last_active":"2024-04-19T03:03:35.093733+0000","last_peered":"2024-04-19T03:03:35.093733+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"2024-04-19T03:02:24.269277+0000","last_became_peered":"2024-04-19T03:02:24.269277+0000","last_unstale":"2024-04-19T03:03:35.093733+0000","last_undegraded":"2024-04-19T03:03:35.093733+0000","last_fullsized":"2024-04-19T03:02:24.255461+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:25:57.346322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":34,"reported_epoch":68,"state":"active+undersized","last_fresh":"2024-04-19T03:03:34.576483+0000","last_change":"2024-04-19T03:02:24.276976+0000","last_active":"2024-04-19T03:03:34.576483+0000","last_peered":"2024-04-19T03:03:34.576483+0000","last_clean":"2024-04-19T03:01:13.604133+0000","last_became_active":"2024-04-19T03:02:24.276976+0000","last_became_peered":"2024-04-19T03:02:24.276976+0000","last_unstale":"2024-04-19T03:03:34.576483+0000","last_undegraded":"2024-04-19T03:03:34.576483+0000","last_fullsized":"2024-04-19T03:02:24.263866+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:44:03.338466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":34,"reported_epoch":69,"state":"active+undersized","last_fresh":"2024-04-19T03:03:34.758311+0000","last_change":"2024-04-19T03:02:24.254790+0000","last_active":"2024-04-19T03:03:34.758311+0000","last_peered":"2024-04-19T03:03:34.758311+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"2024-04-19T03:02:24.254790+0000","last_became_peered":"2024-04-19T03:02:24.254790+0000","last_unstale":"2024-04-19T03:03:34.758311+0000","last_undegraded":"2024-04-19T03:03:34.758311+0000","last_fullsized":"2024-04-19T03:02:24.251249+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:02:39.751984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":34,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-19T03:04:48.226019+0000","last_change":"2024-04-19T03:02:40.442421+0000","last_active":"2024-04-19T03:04:48.226019+0000","last_peered":"2024-04-19T03:04:48.226019+0000","last_clean":"2024-04-19T03:04:48.226019+0000","last_became_active":"2024-04-19T03:02:40.441746+0000","last_became_peered":"2024-04-19T03:02:40.441746+0000","last_unstale":"2024-04-19T03:04:48.226019+0000","last_undegraded":"2024-04-19T03:04:48.226019+0000","last_fullsized":"2024-04-19T03:04:48.226019+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:52:55.719264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":34,"reported_epoch":68,"state":"active+undersized","last_fresh":"2024-04-19T03:03:33.739852+0000","last_change":"2024-04-19T03:02:24.265626+0000","last_active":"2024-04-19T03:03:33.739852+0000","last_peered":"2024-04-19T03:03:33.739852+0000","last_clean":"2024-04-19T03:01:13.604133+0000","last_became_active":"2024-04-19T03:02:24.265626+0000","last_became_peered":"2024-04-19T03:02:24.265626+0000","last_unstale":"2024-04-19T03:03:33.739852+0000","last_undegraded":"2024-04-19T03:03:33.739852+0000","last_fullsized":"2024-04-19T03:02:24.253251+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:31:25.309764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":34,"reported_epoch":69,"state":"active+undersized","last_fresh":"2024-04-19T03:03:35.096107+0000","last_change":"2024-04-19T03:02:24.271602+0000","last_active":"2024-04-19T03:03:35.096107+0000","last_peered":"2024-04-19T03:03:35.096107+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"2024-04-19T03:02:24.271602+0000","last_became_peered":"2024-04-19T03:02:24.271602+0000","last_unstale":"2024-04-19T03:03:35.096107+0000","last_undegraded":"2024-04-19T03:03:35.096107+0000","last_fullsized":"2024-04-19T03:02:24.262475+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:01:44.111884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":34,"reported_epoch":68,"state":"active+undersized","last_fresh":"2024-04-19T03:03:34.572342+0000","last_change":"2024-04-19T03:02:24.271293+0000","last_active":"2024-04-19T03:03:34.572342+0000","last_peered":"2024-04-19T03:03:34.572342+0000","last_clean":"2024-04-19T03:01:13.604133+0000","last_became_active":"2024-04-19T03:02:24.271293+0000","last_became_peered":"2024-04-19T03:02:24.271293+0000","last_unstale":"2024-04-19T03:03:34.572342+0000","last_undegraded":"2024-04-19T03:03:34.572342+0000","last_fullsized":"2024-04-19T03:02:24.255695+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:08:42.859745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":33,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-19T03:04:48.225301+0000","last_change":"2024-04-19T03:02:40.441670+0000","last_active":"2024-04-19T03:04:48.225301+0000","last_peered":"2024-04-19T03:04:48.225301+0000","last_clean":"2024-04-19T03:04:48.225301+0000","last_became_active":"2024-04-19T03:02:40.441294+0000","last_became_peered":"2024-04-19T03:02:40.441294+0000","last_unstale":"2024-04-19T03:04:48.225301+0000","last_undegraded":"2024-04-19T03:04:48.225301+0000","last_fullsized":"2024-04-19T03:04:48.225301+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:59:32.330785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"20'1","reported_seq":66,"reported_epoch":69,"state":"active+undersized","last_fresh":"2024-04-19T03:03:34.759755+0000","last_change":"2024-04-19T03:02:24.263516+0000","last_active":"2024-04-19T03:03:34.759755+0000","last_peered":"2024-04-19T03:03:34.759755+0000","last_clean":"2024-04-19T03:02:21.248830+0000","last_became_active":"2024-04-19T03:02:24.263516+0000","last_became_peered":"2024-04-19T03:02:24.263516+0000","last_unstale":"2024-04-19T03:03:34.759755+0000","last_undegraded":"2024-04-19T03:03:34.759755+0000","last_fullsized":"2024-04-19T03:02:24.253942+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:21:08.378544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":64,"reported_epoch":69,"state":"active+undersized","last_fresh":"2024-04-19T03:03:34.760400+0000","last_change":"2024-04-19T03:02:24.265728+0000","last_active":"2024-04-19T03:03:34.760400+0000","last_peered":"2024-04-19T03:03:34.760400+0000","last_clean":"2024-04-19T03:02:21.249322+0000","last_became_active":"2024-04-19T03:02:24.265728+0000","last_became_peered":"2024-04-19T03:02:24.265728+0000","last_unstale":"2024-04-19T03:03:34.760400+0000","last_undegraded":"2024-04-19T03:03:34.760400+0000","last_fullsized":"2024-04-19T03:02:24.254256+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:18:31.651631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"20'1","reported_seq":74,"reported_epoch":69,"state":"active+undersized","last_fresh":"2024-04-19T03:03:34.761888+0000","last_change":"2024-04-19T03:02:24.266095+0000","last_active":"2024-04-19T03:03:34.761888+0000","last_peered":"2024-04-19T03:03:34.761888+0000","last_clean":"2024-04-19T03:02:21.249288+0000","last_became_active":"2024-04-19T03:02:24.266095+0000","last_became_peered":"2024-04-19T03:02:24.266095+0000","last_unstale":"2024-04-19T03:03:34.761888+0000","last_undegraded":"2024-04-19T03:03:34.761888+0000","last_fullsized":"2024-04-19T03:02:24.254088+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:02:11.243382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":67,"reported_epoch":71,"state":"peering","last_fresh":"2024-04-19T03:04:49.238423+0000","last_change":"2024-04-19T03:04:49.238858+0000","last_active":"2024-04-19T03:04:49.238423+0000","last_peered":"2024-04-19T03:04:48.225599+0000","last_clean":"2024-04-19T03:02:21.239100+0000","last_became_active":"2024-04-19T03:02:24.264906+0000","last_became_peered":"2024-04-19T03:02:24.264906+0000","last_unstale":"2024-04-19T03:04:49.238423+0000","last_undegraded":"2024-04-19T03:04:49.238423+0000","last_fullsized":"2024-04-19T03:04:49.238423+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:25:23.823410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"20'2","reported_seq":70,"reported_epoch":71,"state":"peering","last_fresh":"2024-04-19T03:04:49.244022+0000","last_change":"2024-04-19T03:04:49.244445+0000","last_active":"2024-04-19T03:04:49.244022+0000","last_peered":"2024-04-19T03:04:48.228171+0000","last_clean":"2024-04-19T03:02:21.239137+0000","last_became_active":"2024-04-19T03:02:24.283173+0000","last_became_peered":"2024-04-19T03:02:24.283173+0000","last_unstale":"2024-04-19T03:04:49.244022+0000","last_undegraded":"2024-04-19T03:04:49.244022+0000","last_fullsized":"2024-04-19T03:04:49.244022+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:48:15.865979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":67,"reported_epoch":71,"state":"peering","last_fresh":"2024-04-19T03:04:49.243751+0000","last_change":"2024-04-19T03:04:49.244452+0000","last_active":"2024-04-19T03:04:49.243751+0000","last_peered":"2024-04-19T03:04:48.225979+0000","last_clean":"2024-04-19T03:02:21.238991+0000","last_became_active":"2024-04-19T03:02:24.269672+0000","last_became_peered":"2024-04-19T03:02:24.269672+0000","last_unstale":"2024-04-19T03:04:49.243751+0000","last_undegraded":"2024-04-19T03:04:49.243751+0000","last_fullsized":"2024-04-19T03:04:49.243751+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:09:41.580252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"20'2","reported_seq":41,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-19T03:04:48.227071+0000","last_change":"2024-04-19T03:02:40.441689+0000","last_active":"2024-04-19T03:04:48.227071+0000","last_peered":"2024-04-19T03:04:48.227071+0000","last_clean":"2024-04-19T03:04:48.227071+0000","last_became_active":"2024-04-19T03:02:40.440206+0000","last_became_peered":"2024-04-19T03:02:40.440206+0000","last_unstale":"2024-04-19T03:04:48.227071+0000","last_undegraded":"2024-04-19T03:04:48.227071+0000","last_fullsized":"2024-04-19T03:04:48.227071+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:02:19.100804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":64,"reported_epoch":69,"state":"active+undersized","last_fresh":"2024-04-19T03:03:34.759439+0000","last_change":"2024-04-19T03:02:24.263202+0000","last_active":"2024-04-19T03:03:34.759439+0000","last_peered":"2024-04-19T03:03:34.759439+0000","last_clean":"2024-04-19T03:02:21.248674+0000","last_became_active":"2024-04-19T03:02:24.263202+0000","last_became_peered":"2024-04-19T03:02:24.263202+0000","last_unstale":"2024-04-19T03:03:34.759439+0000","last_undegraded":"2024-04-19T03:03:34.759439+0000","last_fullsized":"2024-04-19T03:02:24.252560+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:05:00.071308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"20'1","reported_seq":35,"reported_epoch":69,"state":"active+undersized","last_fresh":"2024-04-19T03:03:34.760417+0000","last_change":"2024-04-19T03:02:24.269410+0000","last_active":"2024-04-19T03:03:34.760417+0000","last_peered":"2024-04-19T03:03:34.760417+0000","last_clean":"2024-04-19T03:01:13.604133+0000","last_became_active":"2024-04-19T03:02:24.269410+0000","last_became_peered":"2024-04-19T03:02:24.269410+0000","last_unstale":"2024-04-19T03:03:34.760417+0000","last_undegraded":"2024-04-19T03:03:34.760417+0000","last_fullsized":"2024-04-19T03:02:24.257278+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:01:43.100098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":67,"reported_epoch":71,"state":"peering","last_fresh":"2024-04-19T03:04:49.238503+0000","last_change":"2024-04-19T03:04:49.238881+0000","last_active":"2024-04-19T03:04:49.238503+0000","last_peered":"2024-04-19T03:04:48.225407+0000","last_clean":"2024-04-19T03:02:21.238692+0000","last_became_active":"2024-04-19T03:02:24.264787+0000","last_became_peered":"2024-04-19T03:02:24.264787+0000","last_unstale":"2024-04-19T03:04:49.238503+0000","last_undegraded":"2024-04-19T03:04:49.238503+0000","last_fullsized":"2024-04-19T03:04:49.238503+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:45:33.989924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"20'4","reported_seq":43,"reported_epoch":69,"state":"active+undersized+degraded","last_fresh":"2024-04-19T03:03:35.098438+0000","last_change":"2024-04-19T03:02:24.276744+0000","last_active":"2024-04-19T03:03:35.098438+0000","last_peered":"2024-04-19T03:03:35.098438+0000","last_clean":"2024-04-19T03:01:15.006951+0000","last_became_active":"2024-04-19T03:02:24.276744+0000","last_became_peered":"2024-04-19T03:02:24.276744+0000","last_unstale":"2024-04-19T03:03:35.098438+0000","last_undegraded":"2024-04-19T03:02:24.263785+0000","last_fullsized":"2024-04-19T03:02:24.263676+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:27:16.968519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":2}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":95,"acting":95,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":5,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5289,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":46,"acting":46,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":12,"acting":12,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":14482,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":10,"seq":42949673011,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":220636,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":219774,"kb_avail":94151204,"statfs":{"total":96636764160,"available":96410832896,"internally_reserved":0,"allocated":864256,"data_stored":887137,"data_compressed":7241,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":225049030},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 19 03:02:08 2024","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":2.1379999999999999},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"last":0.33100000000000002}]},{"osd":1,"last update":"Fri Apr 19 03:04:11 2024","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.19900000000000001,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.87,"5min":2.5030000000000001,"15min":2.5030000000000001},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.57099999999999995,"15min":0.56299999999999994},"min":{"1min":0.23999999999999999,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.90400000000000003,"5min":2.6379999999999999,"15min":2.6379999999999999},"last":0.59099999999999997}]}]},{"osd":1,"up_from":10,"seq":42949673010,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":202584,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":201726,"kb_avail":94169256,"statfs":{"total":96636764160,"available":96429318144,"internally_reserved":0,"allocated":860160,"data_stored":888684,"data_compressed":7241,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":206567878},"hb_peers":[2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 19 03:02:04 2024","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.216},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":2.2349999999999999}]},{"osd":2,"last update":"Fri Apr 19 03:04:07 2024","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.47899999999999998,"15min":0.501},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":0.79400000000000004,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.623},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.48499999999999999,"15min":0.51400000000000001},"min":{"1min":0.26100000000000001,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.83899999999999997,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.68899999999999995}]}]},{"osd":0,"up_from":0,"seq":1,"num_pgs":86,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":326744,"kb_used_data":283984,"kb_used_omap":6,"kb_used_meta":42745,"kb_avail":94045096,"statfs":{"total":96636764160,"available":96302178304,"internally_reserved":0,"allocated":290799616,"data_stored":4645810470,"data_compressed":8901299,"data_compressed_allocated":290353152,"data_compressed_original":4645650432,"omap_allocated":6883,"internal_metadata":43771165},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":7241,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":7241,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5289,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-19T03:04:51.605 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-19T03:04:51.920 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-19T03:04:51.922 INFO:teuthology.orchestra.run.smithi096.stderr:dumped all 2024-04-19T03:04:51.934 INFO:teuthology.orchestra.run.smithi096.stdout:{"pg_ready":true,"pg_map":{"version":182,"stamp":"2024-04-19T03:04:51.249167+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":5,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":155,"acting":155,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":223,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":749964,"kb_used_data":285668,"kb_used_omap":9,"kb_used_meta":464246,"kb_avail":282365556,"statfs":{"total":289910292480,"available":289142329344,"internally_reserved":0,"allocated":292524032,"data_stored":4647586291,"data_compressed":8915781,"data_compressed_allocated":290426880,"data_compressed_original":4646797312,"omap_allocated":10071,"internal_metadata":475388073},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-3,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.210479"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":64,"reported_epoch":68,"state":"active+undersized","last_fresh":"2024-04-19T03:03:33.743192+0000","last_change":"2024-04-19T03:02:24.266182+0000","last_active":"2024-04-19T03:03:33.743192+0000","last_peered":"2024-04-19T03:03:33.743192+0000","last_clean":"2024-04-19T03:02:21.249547+0000","last_became_active":"2024-04-19T03:02:24.266182+0000","last_became_peered":"2024-04-19T03:02:24.266182+0000","last_unstale":"2024-04-19T03:03:33.743192+0000","last_undegraded":"2024-04-19T03:03:33.743192+0000","last_fullsized":"2024-04-19T03:02:24.261935+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:20:35.729791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":67,"reported_epoch":71,"state":"peering","last_fresh":"2024-04-19T03:04:49.228465+0000","last_change":"2024-04-19T03:04:49.229512+0000","last_active":"2024-04-19T03:04:49.228465+0000","last_peered":"2024-04-19T03:04:49.103074+0000","last_clean":"2024-04-19T03:02:21.248866+0000","last_became_active":"2024-04-19T03:02:24.268239+0000","last_became_peered":"2024-04-19T03:02:24.268239+0000","last_unstale":"2024-04-19T03:04:49.228465+0000","last_undegraded":"2024-04-19T03:04:49.228465+0000","last_fullsized":"2024-04-19T03:04:49.228465+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:33:34.879955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":61,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-19T03:04:48.225576+0000","last_change":"2024-04-19T03:01:15.015884+0000","last_active":"2024-04-19T03:04:48.225576+0000","last_peered":"2024-04-19T03:04:48.225576+0000","last_clean":"2024-04-19T03:04:48.225576+0000","last_became_active":"2024-04-19T03:01:15.014599+0000","last_became_peered":"2024-04-19T03:01:15.014599+0000","last_unstale":"2024-04-19T03:04:48.225576+0000","last_undegraded":"2024-04-19T03:04:48.225576+0000","last_fullsized":"2024-04-19T03:04:48.225576+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:35:19.436344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":67,"reported_epoch":71,"state":"peering","last_fresh":"2024-04-19T03:04:49.236427+0000","last_change":"2024-04-19T03:04:49.236807+0000","last_active":"2024-04-19T03:04:49.236427+0000","last_peered":"2024-04-19T03:04:48.226533+0000","last_clean":"2024-04-19T03:02:21.239010+0000","last_became_active":"2024-04-19T03:02:24.283312+0000","last_became_peered":"2024-04-19T03:02:24.283312+0000","last_unstale":"2024-04-19T03:04:49.236427+0000","last_undegraded":"2024-04-19T03:04:49.236427+0000","last_fullsized":"2024-04-19T03:04:49.236427+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:31:31.190200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":64,"reported_epoch":69,"state":"active+undersized","last_fresh":"2024-04-19T03:03:34.761083+0000","last_change":"2024-04-19T03:02:24.265793+0000","last_active":"2024-04-19T03:03:34.761083+0000","last_peered":"2024-04-19T03:03:34.761083+0000","last_clean":"2024-04-19T03:02:21.249126+0000","last_became_active":"2024-04-19T03:02:24.265793+0000","last_became_peered":"2024-04-19T03:02:24.265793+0000","last_unstale":"2024-04-19T03:03:34.761083+0000","last_undegraded":"2024-04-19T03:03:34.761083+0000","last_fullsized":"2024-04-19T03:02:24.253775+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:15:46.441415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":59,"reported_epoch":69,"state":"active+undersized","last_fresh":"2024-04-19T03:03:35.094241+0000","last_change":"2024-04-19T03:02:24.269520+0000","last_active":"2024-04-19T03:03:35.094241+0000","last_peered":"2024-04-19T03:03:35.094241+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"2024-04-19T03:02:24.269520+0000","last_became_peered":"2024-04-19T03:02:24.269520+0000","last_unstale":"2024-04-19T03:03:35.094241+0000","last_undegraded":"2024-04-19T03:03:35.094241+0000","last_fullsized":"2024-04-19T03:02:24.255694+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:45:46.332608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":59,"reported_epoch":69,"state":"active+undersized","last_fresh":"2024-04-19T03:03:35.095224+0000","last_change":"2024-04-19T03:02:24.271511+0000","last_active":"2024-04-19T03:03:35.095224+0000","last_peered":"2024-04-19T03:03:35.095224+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"2024-04-19T03:02:24.271511+0000","last_became_peered":"2024-04-19T03:02:24.271511+0000","last_unstale":"2024-04-19T03:03:35.095224+0000","last_undegraded":"2024-04-19T03:03:35.095224+0000","last_fullsized":"2024-04-19T03:02:24.257544+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:45:01.989501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":67,"reported_epoch":71,"state":"peering","last_fresh":"2024-04-19T03:04:49.244438+0000","last_change":"2024-04-19T03:04:49.244616+0000","last_active":"2024-04-19T03:04:49.244438+0000","last_peered":"2024-04-19T03:04:48.224532+0000","last_clean":"2024-04-19T03:02:21.238411+0000","last_became_active":"2024-04-19T03:02:24.261119+0000","last_became_peered":"2024-04-19T03:02:24.261119+0000","last_unstale":"2024-04-19T03:04:49.244438+0000","last_undegraded":"2024-04-19T03:04:49.244438+0000","last_fullsized":"2024-04-19T03:04:49.244438+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:57:01.109868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":33,"reported_epoch":68,"state":"active+undersized","last_fresh":"2024-04-19T03:03:33.742471+0000","last_change":"2024-04-19T03:02:24.263980+0000","last_active":"2024-04-19T03:03:33.742471+0000","last_peered":"2024-04-19T03:03:33.742471+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"2024-04-19T03:02:24.263980+0000","last_became_peered":"2024-04-19T03:02:24.263980+0000","last_unstale":"2024-04-19T03:03:33.742471+0000","last_undegraded":"2024-04-19T03:03:33.742471+0000","last_fullsized":"2024-04-19T03:02:24.256849+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:07:41.954531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":67,"reported_epoch":71,"state":"peering","last_fresh":"2024-04-19T03:04:49.227330+0000","last_change":"2024-04-19T03:04:49.227670+0000","last_active":"2024-04-19T03:04:49.227330+0000","last_peered":"2024-04-19T03:04:49.103387+0000","last_clean":"2024-04-19T03:02:21.249077+0000","last_became_active":"2024-04-19T03:02:24.268562+0000","last_became_peered":"2024-04-19T03:02:24.268562+0000","last_unstale":"2024-04-19T03:04:49.227330+0000","last_undegraded":"2024-04-19T03:04:49.227330+0000","last_fullsized":"2024-04-19T03:04:49.227330+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:43:17.397637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":59,"reported_epoch":69,"state":"active+undersized","last_fresh":"2024-04-19T03:03:35.095107+0000","last_change":"2024-04-19T03:02:24.273737+0000","last_active":"2024-04-19T03:03:35.095107+0000","last_peered":"2024-04-19T03:03:35.095107+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"2024-04-19T03:02:24.273737+0000","last_became_peered":"2024-04-19T03:02:24.273737+0000","last_unstale":"2024-04-19T03:03:35.095107+0000","last_undegraded":"2024-04-19T03:03:35.095107+0000","last_fullsized":"2024-04-19T03:02:24.262626+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:19:16.702009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":33,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-19T03:04:48.225620+0000","last_change":"2024-04-19T03:02:40.438738+0000","last_active":"2024-04-19T03:04:48.225620+0000","last_peered":"2024-04-19T03:04:48.225620+0000","last_clean":"2024-04-19T03:04:48.225620+0000","last_became_active":"2024-04-19T03:02:40.438000+0000","last_became_peered":"2024-04-19T03:02:40.438000+0000","last_unstale":"2024-04-19T03:04:48.225620+0000","last_undegraded":"2024-04-19T03:04:48.225620+0000","last_fullsized":"2024-04-19T03:04:48.225620+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:35:10.932021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":64,"reported_epoch":69,"state":"active+undersized","last_fresh":"2024-04-19T03:03:34.759201+0000","last_change":"2024-04-19T03:02:24.265275+0000","last_active":"2024-04-19T03:03:34.759201+0000","last_peered":"2024-04-19T03:03:34.759201+0000","last_clean":"2024-04-19T03:02:21.248908+0000","last_became_active":"2024-04-19T03:02:24.265275+0000","last_became_peered":"2024-04-19T03:02:24.265275+0000","last_unstale":"2024-04-19T03:03:34.759201+0000","last_undegraded":"2024-04-19T03:03:34.759201+0000","last_fullsized":"2024-04-19T03:02:24.253280+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:10:26.573207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":61,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-19T03:04:48.225063+0000","last_change":"2024-04-19T03:01:15.010960+0000","last_active":"2024-04-19T03:04:48.225063+0000","last_peered":"2024-04-19T03:04:48.225063+0000","last_clean":"2024-04-19T03:04:48.225063+0000","last_became_active":"2024-04-19T03:01:15.010472+0000","last_became_peered":"2024-04-19T03:01:15.010472+0000","last_unstale":"2024-04-19T03:04:48.225063+0000","last_undegraded":"2024-04-19T03:04:48.225063+0000","last_fullsized":"2024-04-19T03:04:48.225063+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:21:36.129346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":61,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-19T03:04:48.226314+0000","last_change":"2024-04-19T03:01:15.014574+0000","last_active":"2024-04-19T03:04:48.226314+0000","last_peered":"2024-04-19T03:04:48.226314+0000","last_clean":"2024-04-19T03:04:48.226314+0000","last_became_active":"2024-04-19T03:01:15.014096+0000","last_became_peered":"2024-04-19T03:01:15.014096+0000","last_unstale":"2024-04-19T03:04:48.226314+0000","last_undegraded":"2024-04-19T03:04:48.226314+0000","last_fullsized":"2024-04-19T03:04:48.226314+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:01:54.253963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":59,"reported_epoch":69,"state":"active+undersized","last_fresh":"2024-04-19T03:03:35.093776+0000","last_change":"2024-04-19T03:02:24.261536+0000","last_active":"2024-04-19T03:03:35.093776+0000","last_peered":"2024-04-19T03:03:35.093776+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"2024-04-19T03:02:24.261536+0000","last_became_peered":"2024-04-19T03:02:24.261536+0000","last_unstale":"2024-04-19T03:03:35.093776+0000","last_undegraded":"2024-04-19T03:03:35.093776+0000","last_fullsized":"2024-04-19T03:02:24.255185+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:22:34.583134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":34,"reported_epoch":69,"state":"active+undersized","last_fresh":"2024-04-19T03:03:34.761616+0000","last_change":"2024-04-19T03:02:24.264729+0000","last_active":"2024-04-19T03:03:34.761616+0000","last_peered":"2024-04-19T03:03:34.761616+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"2024-04-19T03:02:24.264729+0000","last_became_peered":"2024-04-19T03:02:24.264729+0000","last_unstale":"2024-04-19T03:03:34.761616+0000","last_undegraded":"2024-04-19T03:03:34.761616+0000","last_fullsized":"2024-04-19T03:02:24.258548+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:16:20.425626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":64,"reported_epoch":69,"state":"active+undersized","last_fresh":"2024-04-19T03:03:34.760976+0000","last_change":"2024-04-19T03:02:24.269142+0000","last_active":"2024-04-19T03:03:34.760976+0000","last_peered":"2024-04-19T03:03:34.760976+0000","last_clean":"2024-04-19T03:02:21.249343+0000","last_became_active":"2024-04-19T03:02:24.269142+0000","last_became_peered":"2024-04-19T03:02:24.269142+0000","last_unstale":"2024-04-19T03:03:34.760976+0000","last_undegraded":"2024-04-19T03:03:34.760976+0000","last_fullsized":"2024-04-19T03:02:24.257309+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:36:10.316727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":34,"reported_epoch":69,"state":"active+undersized","last_fresh":"2024-04-19T03:03:34.761984+0000","last_change":"2024-04-19T03:02:24.262871+0000","last_active":"2024-04-19T03:03:34.761984+0000","last_peered":"2024-04-19T03:03:34.761984+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"2024-04-19T03:02:24.262871+0000","last_became_peered":"2024-04-19T03:02:24.262871+0000","last_unstale":"2024-04-19T03:03:34.761984+0000","last_undegraded":"2024-04-19T03:03:34.761984+0000","last_fullsized":"2024-04-19T03:02:24.254723+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:19:25.662483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":67,"reported_epoch":71,"state":"peering","last_fresh":"2024-04-19T03:04:49.238473+0000","last_change":"2024-04-19T03:04:49.238833+0000","last_active":"2024-04-19T03:04:49.238473+0000","last_peered":"2024-04-19T03:04:48.226117+0000","last_clean":"2024-04-19T03:02:21.238883+0000","last_became_active":"2024-04-19T03:02:24.280097+0000","last_became_peered":"2024-04-19T03:02:24.280097+0000","last_unstale":"2024-04-19T03:04:49.238473+0000","last_undegraded":"2024-04-19T03:04:49.238473+0000","last_fullsized":"2024-04-19T03:04:49.238473+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:18:02.311663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":67,"reported_epoch":71,"state":"peering","last_fresh":"2024-04-19T03:04:49.243380+0000","last_change":"2024-04-19T03:04:49.243554+0000","last_active":"2024-04-19T03:04:49.243380+0000","last_peered":"2024-04-19T03:04:48.227227+0000","last_clean":"2024-04-19T03:02:21.239350+0000","last_became_active":"2024-04-19T03:02:24.265606+0000","last_became_peered":"2024-04-19T03:02:24.265606+0000","last_unstale":"2024-04-19T03:04:49.243380+0000","last_undegraded":"2024-04-19T03:04:49.243380+0000","last_fullsized":"2024-04-19T03:04:49.243380+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:26:01.458051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":61,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-19T03:04:49.101571+0000","last_change":"2024-04-19T03:01:15.020108+0000","last_active":"2024-04-19T03:04:49.101571+0000","last_peered":"2024-04-19T03:04:49.101571+0000","last_clean":"2024-04-19T03:04:49.101571+0000","last_became_active":"2024-04-19T03:01:15.018978+0000","last_became_peered":"2024-04-19T03:01:15.018978+0000","last_unstale":"2024-04-19T03:04:49.101571+0000","last_undegraded":"2024-04-19T03:04:49.101571+0000","last_fullsized":"2024-04-19T03:04:49.101571+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:30:22.360053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":34,"reported_epoch":69,"state":"active+undersized","last_fresh":"2024-04-19T03:03:35.093708+0000","last_change":"2024-04-19T03:02:24.260984+0000","last_active":"2024-04-19T03:03:35.093708+0000","last_peered":"2024-04-19T03:03:35.093708+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"2024-04-19T03:02:24.260984+0000","last_became_peered":"2024-04-19T03:02:24.260984+0000","last_unstale":"2024-04-19T03:03:35.093708+0000","last_undegraded":"2024-04-19T03:03:35.093708+0000","last_fullsized":"2024-04-19T03:02:24.254937+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:36:55.924337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":64,"reported_epoch":68,"state":"active+undersized","last_fresh":"2024-04-19T03:03:33.739131+0000","last_change":"2024-04-19T03:02:24.267695+0000","last_active":"2024-04-19T03:03:33.739131+0000","last_peered":"2024-04-19T03:03:33.739131+0000","last_clean":"2024-04-19T03:02:21.248328+0000","last_became_active":"2024-04-19T03:02:24.267695+0000","last_became_peered":"2024-04-19T03:02:24.267695+0000","last_unstale":"2024-04-19T03:03:33.739131+0000","last_undegraded":"2024-04-19T03:03:33.739131+0000","last_fullsized":"2024-04-19T03:02:24.251954+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:45:46.987421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":34,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-19T03:04:49.241504+0000","last_change":"2024-04-19T03:02:40.441681+0000","last_active":"2024-04-19T03:04:49.241504+0000","last_peered":"2024-04-19T03:04:49.241504+0000","last_clean":"2024-04-19T03:04:49.241504+0000","last_became_active":"2024-04-19T03:02:40.441170+0000","last_became_peered":"2024-04-19T03:02:40.441170+0000","last_unstale":"2024-04-19T03:04:49.241504+0000","last_undegraded":"2024-04-19T03:04:49.241504+0000","last_fullsized":"2024-04-19T03:04:49.241504+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:43:25.396638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":34,"reported_epoch":69,"state":"active+undersized","last_fresh":"2024-04-19T03:03:35.096362+0000","last_change":"2024-04-19T03:02:24.272073+0000","last_active":"2024-04-19T03:03:35.096362+0000","last_peered":"2024-04-19T03:03:35.096362+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"2024-04-19T03:02:24.272073+0000","last_became_peered":"2024-04-19T03:02:24.272073+0000","last_unstale":"2024-04-19T03:03:35.096362+0000","last_undegraded":"2024-04-19T03:03:35.096362+0000","last_fullsized":"2024-04-19T03:02:24.263402+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:53:27.352419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":44,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-19T03:04:49.103486+0000","last_change":"2024-04-19T03:02:15.206453+0000","last_active":"2024-04-19T03:04:49.103486+0000","last_peered":"2024-04-19T03:04:49.103486+0000","last_clean":"2024-04-19T03:04:49.103486+0000","last_became_active":"2024-04-19T03:02:15.205905+0000","last_became_peered":"2024-04-19T03:02:15.205905+0000","last_unstale":"2024-04-19T03:04:49.103486+0000","last_undegraded":"2024-04-19T03:04:49.103486+0000","last_fullsized":"2024-04-19T03:04:49.103486+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:48:06.646477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":61,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-19T03:04:49.103482+0000","last_change":"2024-04-19T03:01:15.020098+0000","last_active":"2024-04-19T03:04:49.103482+0000","last_peered":"2024-04-19T03:04:49.103482+0000","last_clean":"2024-04-19T03:04:49.103482+0000","last_became_active":"2024-04-19T03:01:15.019064+0000","last_became_peered":"2024-04-19T03:01:15.019064+0000","last_unstale":"2024-04-19T03:04:49.103482+0000","last_undegraded":"2024-04-19T03:04:49.103482+0000","last_fullsized":"2024-04-19T03:04:49.103482+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:50:06.490191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":34,"reported_epoch":69,"state":"active+undersized","last_fresh":"2024-04-19T03:03:34.759432+0000","last_change":"2024-04-19T03:02:24.259183+0000","last_active":"2024-04-19T03:03:34.759432+0000","last_peered":"2024-04-19T03:03:34.759432+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"2024-04-19T03:02:24.259183+0000","last_became_peered":"2024-04-19T03:02:24.259183+0000","last_unstale":"2024-04-19T03:03:34.759432+0000","last_undegraded":"2024-04-19T03:03:34.759432+0000","last_fullsized":"2024-04-19T03:02:24.252854+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:19:16.702009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":34,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-19T03:04:48.224820+0000","last_change":"2024-04-19T03:02:40.440907+0000","last_active":"2024-04-19T03:04:48.224820+0000","last_peered":"2024-04-19T03:04:48.224820+0000","last_clean":"2024-04-19T03:04:48.224820+0000","last_became_active":"2024-04-19T03:02:40.440351+0000","last_became_peered":"2024-04-19T03:02:40.440351+0000","last_unstale":"2024-04-19T03:04:48.224820+0000","last_undegraded":"2024-04-19T03:04:48.224820+0000","last_fullsized":"2024-04-19T03:04:48.224820+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:36:36.558329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":34,"reported_epoch":69,"state":"active+undersized","last_fresh":"2024-04-19T03:03:34.758656+0000","last_change":"2024-04-19T03:02:24.258688+0000","last_active":"2024-04-19T03:03:34.758656+0000","last_peered":"2024-04-19T03:03:34.758656+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"2024-04-19T03:02:24.258688+0000","last_became_peered":"2024-04-19T03:02:24.258688+0000","last_unstale":"2024-04-19T03:03:34.758656+0000","last_undegraded":"2024-04-19T03:03:34.758656+0000","last_fullsized":"2024-04-19T03:02:24.251480+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:16:44.560445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":67,"reported_epoch":71,"state":"peering","last_fresh":"2024-04-19T03:04:49.237705+0000","last_change":"2024-04-19T03:04:49.238125+0000","last_active":"2024-04-19T03:04:49.237705+0000","last_peered":"2024-04-19T03:04:48.225027+0000","last_clean":"2024-04-19T03:02:21.238487+0000","last_became_active":"2024-04-19T03:02:24.265187+0000","last_became_peered":"2024-04-19T03:02:24.265187+0000","last_unstale":"2024-04-19T03:04:49.237705+0000","last_undegraded":"2024-04-19T03:04:49.237705+0000","last_fullsized":"2024-04-19T03:04:49.237705+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:40:59.611995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":64,"reported_epoch":69,"state":"active+undersized","last_fresh":"2024-04-19T03:03:34.760124+0000","last_change":"2024-04-19T03:02:24.266012+0000","last_active":"2024-04-19T03:03:34.760124+0000","last_peered":"2024-04-19T03:03:34.760124+0000","last_clean":"2024-04-19T03:02:21.249385+0000","last_became_active":"2024-04-19T03:02:24.266012+0000","last_became_peered":"2024-04-19T03:02:24.266012+0000","last_unstale":"2024-04-19T03:03:34.760124+0000","last_undegraded":"2024-04-19T03:03:34.760124+0000","last_fullsized":"2024-04-19T03:02:24.254885+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:45:01.989501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"20'2","reported_seq":70,"reported_epoch":71,"state":"peering","last_fresh":"2024-04-19T03:04:49.244520+0000","last_change":"2024-04-19T03:04:49.244724+0000","last_active":"2024-04-19T03:04:49.244520+0000","last_peered":"2024-04-19T03:04:48.227587+0000","last_clean":"2024-04-19T03:02:21.239584+0000","last_became_active":"2024-04-19T03:02:24.265759+0000","last_became_peered":"2024-04-19T03:02:24.265759+0000","last_unstale":"2024-04-19T03:04:49.244520+0000","last_undegraded":"2024-04-19T03:04:49.244520+0000","last_fullsized":"2024-04-19T03:04:49.244520+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:35:18.996445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":64,"reported_epoch":69,"state":"active+undersized","last_fresh":"2024-04-19T03:03:34.762013+0000","last_change":"2024-04-19T03:02:24.263260+0000","last_active":"2024-04-19T03:03:34.762013+0000","last_peered":"2024-04-19T03:03:34.762013+0000","last_clean":"2024-04-19T03:02:21.249052+0000","last_became_active":"2024-04-19T03:02:24.263260+0000","last_became_peered":"2024-04-19T03:02:24.263260+0000","last_unstale":"2024-04-19T03:03:34.762013+0000","last_undegraded":"2024-04-19T03:03:34.762013+0000","last_fullsized":"2024-04-19T03:02:24.255863+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:25:50.459325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":35,"reported_epoch":69,"state":"active+undersized","last_fresh":"2024-04-19T03:03:35.094755+0000","last_change":"2024-04-19T03:02:24.269416+0000","last_active":"2024-04-19T03:03:35.094755+0000","last_peered":"2024-04-19T03:03:35.094755+0000","last_clean":"2024-04-19T03:01:13.604133+0000","last_became_active":"2024-04-19T03:02:24.269416+0000","last_became_peered":"2024-04-19T03:02:24.269416+0000","last_unstale":"2024-04-19T03:03:35.094755+0000","last_undegraded":"2024-04-19T03:03:35.094755+0000","last_fullsized":"2024-04-19T03:02:24.260076+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:13:11.249358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":33,"reported_epoch":68,"state":"active+undersized","last_fresh":"2024-04-19T03:03:34.574916+0000","last_change":"2024-04-19T03:02:24.271368+0000","last_active":"2024-04-19T03:03:34.574916+0000","last_peered":"2024-04-19T03:03:34.574916+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"2024-04-19T03:02:24.271368+0000","last_became_peered":"2024-04-19T03:02:24.271368+0000","last_unstale":"2024-04-19T03:03:34.574916+0000","last_undegraded":"2024-04-19T03:03:34.574916+0000","last_fullsized":"2024-04-19T03:02:24.258025+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:46:12.377589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":62,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-19T03:04:49.101742+0000","last_change":"2024-04-19T03:01:14.649074+0000","last_active":"2024-04-19T03:04:49.101742+0000","last_peered":"2024-04-19T03:04:49.101742+0000","last_clean":"2024-04-19T03:04:49.101742+0000","last_became_active":"2024-04-19T03:01:14.648217+0000","last_became_peered":"2024-04-19T03:01:14.648217+0000","last_unstale":"2024-04-19T03:04:49.101742+0000","last_undegraded":"2024-04-19T03:04:49.101742+0000","last_fullsized":"2024-04-19T03:04:49.101742+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:57:05.238043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":33,"reported_epoch":68,"state":"active+undersized","last_fresh":"2024-04-19T03:03:34.575765+0000","last_change":"2024-04-19T03:02:24.272925+0000","last_active":"2024-04-19T03:03:34.575765+0000","last_peered":"2024-04-19T03:03:34.575765+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"2024-04-19T03:02:24.272925+0000","last_became_peered":"2024-04-19T03:02:24.272925+0000","last_unstale":"2024-04-19T03:03:34.575765+0000","last_undegraded":"2024-04-19T03:03:34.575765+0000","last_fullsized":"2024-04-19T03:02:24.260913+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:33:59.041888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"20'8","reported_seq":70,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-19T03:04:48.225294+0000","last_change":"2024-04-19T03:01:14.649044+0000","last_active":"2024-04-19T03:04:48.225294+0000","last_peered":"2024-04-19T03:04:48.225294+0000","last_clean":"2024-04-19T03:04:48.225294+0000","last_became_active":"2024-04-19T03:01:14.648859+0000","last_became_peered":"2024-04-19T03:01:14.648859+0000","last_unstale":"2024-04-19T03:04:48.225294+0000","last_undegraded":"2024-04-19T03:04:48.225294+0000","last_fullsized":"2024-04-19T03:04:48.225294+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:30:45.925657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"20'1","reported_seq":63,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-19T03:04:48.226855+0000","last_change":"2024-04-19T03:01:14.649839+0000","last_active":"2024-04-19T03:04:48.226855+0000","last_peered":"2024-04-19T03:04:48.226855+0000","last_clean":"2024-04-19T03:04:48.226855+0000","last_became_active":"2024-04-19T03:01:14.649571+0000","last_became_peered":"2024-04-19T03:01:14.649571+0000","last_unstale":"2024-04-19T03:04:48.226855+0000","last_undegraded":"2024-04-19T03:04:48.226855+0000","last_fullsized":"2024-04-19T03:04:48.226855+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:03:57.839660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":34,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-19T03:04:49.242898+0000","last_change":"2024-04-19T03:02:40.438407+0000","last_active":"2024-04-19T03:04:49.242898+0000","last_peered":"2024-04-19T03:04:49.242898+0000","last_clean":"2024-04-19T03:04:49.242898+0000","last_became_active":"2024-04-19T03:02:40.437605+0000","last_became_peered":"2024-04-19T03:02:40.437605+0000","last_unstale":"2024-04-19T03:04:49.242898+0000","last_undegraded":"2024-04-19T03:04:49.242898+0000","last_fullsized":"2024-04-19T03:04:49.242898+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:00:03.630606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"20'2","reported_seq":64,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-19T03:04:49.105047+0000","last_change":"2024-04-19T03:01:14.645075+0000","last_active":"2024-04-19T03:04:49.105047+0000","last_peered":"2024-04-19T03:04:49.105047+0000","last_clean":"2024-04-19T03:04:49.105047+0000","last_became_active":"2024-04-19T03:01:14.644790+0000","last_became_peered":"2024-04-19T03:01:14.644790+0000","last_unstale":"2024-04-19T03:04:49.105047+0000","last_undegraded":"2024-04-19T03:04:49.105047+0000","last_fullsized":"2024-04-19T03:04:49.105047+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:55:15.035769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":64,"reported_epoch":68,"state":"active+undersized","last_fresh":"2024-04-19T03:03:33.739784+0000","last_change":"2024-04-19T03:02:24.262120+0000","last_active":"2024-04-19T03:03:33.739784+0000","last_peered":"2024-04-19T03:03:33.739784+0000","last_clean":"2024-04-19T03:02:21.248368+0000","last_became_active":"2024-04-19T03:02:24.262120+0000","last_became_peered":"2024-04-19T03:02:24.262120+0000","last_unstale":"2024-04-19T03:03:33.739784+0000","last_undegraded":"2024-04-19T03:03:33.739784+0000","last_fullsized":"2024-04-19T03:02:24.251780+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:09:48.754662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"20'1","reported_seq":52,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-19T03:04:49.102940+0000","last_change":"2024-04-19T03:02:15.207891+0000","last_active":"2024-04-19T03:04:49.102940+0000","last_peered":"2024-04-19T03:04:49.102940+0000","last_clean":"2024-04-19T03:04:49.102940+0000","last_became_active":"2024-04-19T03:02:15.207334+0000","last_became_peered":"2024-04-19T03:02:15.207334+0000","last_unstale":"2024-04-19T03:04:49.102940+0000","last_undegraded":"2024-04-19T03:04:49.102940+0000","last_fullsized":"2024-04-19T03:04:49.102940+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:29:49.714544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":67,"reported_epoch":71,"state":"peering","last_fresh":"2024-04-19T03:04:49.239135+0000","last_change":"2024-04-19T03:04:49.239520+0000","last_active":"2024-04-19T03:04:49.239135+0000","last_peered":"2024-04-19T03:04:48.225308+0000","last_clean":"2024-04-19T03:02:21.238896+0000","last_became_active":"2024-04-19T03:02:24.269285+0000","last_became_peered":"2024-04-19T03:02:24.269285+0000","last_unstale":"2024-04-19T03:04:49.239135+0000","last_undegraded":"2024-04-19T03:04:49.239135+0000","last_fullsized":"2024-04-19T03:04:49.239135+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:07:53.363452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":60,"reported_epoch":68,"state":"active+undersized","last_fresh":"2024-04-19T03:03:34.575435+0000","last_change":"2024-04-19T03:02:24.283528+0000","last_active":"2024-04-19T03:03:34.575435+0000","last_peered":"2024-04-19T03:03:34.575435+0000","last_clean":"2024-04-19T03:01:13.604133+0000","last_became_active":"2024-04-19T03:02:24.283528+0000","last_became_peered":"2024-04-19T03:02:24.283528+0000","last_unstale":"2024-04-19T03:03:34.575435+0000","last_undegraded":"2024-04-19T03:03:34.575435+0000","last_fullsized":"2024-04-19T03:02:24.265369+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:44:57.689246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":34,"reported_epoch":69,"state":"active+undersized","last_fresh":"2024-04-19T03:03:35.094733+0000","last_change":"2024-04-19T03:02:24.262486+0000","last_active":"2024-04-19T03:03:35.094733+0000","last_peered":"2024-04-19T03:03:35.094733+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"2024-04-19T03:02:24.262486+0000","last_became_peered":"2024-04-19T03:02:24.262486+0000","last_unstale":"2024-04-19T03:03:35.094733+0000","last_undegraded":"2024-04-19T03:03:35.094733+0000","last_fullsized":"2024-04-19T03:02:24.255034+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:10:59.997012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"20'2","reported_seq":43,"reported_epoch":69,"state":"active+undersized+degraded","last_fresh":"2024-04-19T03:03:35.095113+0000","last_change":"2024-04-19T03:02:24.265344+0000","last_active":"2024-04-19T03:03:35.095113+0000","last_peered":"2024-04-19T03:03:35.095113+0000","last_clean":"2024-04-19T03:01:15.001696+0000","last_became_active":"2024-04-19T03:02:24.265344+0000","last_became_peered":"2024-04-19T03:02:24.265344+0000","last_unstale":"2024-04-19T03:03:35.095113+0000","last_undegraded":"2024-04-19T03:02:24.257245+0000","last_fullsized":"2024-04-19T03:02:24.257097+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:10:25.561421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":1}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":67,"reported_epoch":71,"state":"peering","last_fresh":"2024-04-19T03:04:49.243232+0000","last_change":"2024-04-19T03:04:49.243391+0000","last_active":"2024-04-19T03:04:49.243232+0000","last_peered":"2024-04-19T03:04:48.227369+0000","last_clean":"2024-04-19T03:02:21.239001+0000","last_became_active":"2024-04-19T03:02:24.280840+0000","last_became_peered":"2024-04-19T03:02:24.280840+0000","last_unstale":"2024-04-19T03:04:49.243232+0000","last_undegraded":"2024-04-19T03:04:49.243232+0000","last_fullsized":"2024-04-19T03:04:49.243232+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:59:09.311702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":68,"reported_epoch":71,"state":"peering","last_fresh":"2024-04-19T03:04:49.244941+0000","last_change":"2024-04-19T03:04:49.245119+0000","last_active":"2024-04-19T03:04:49.244941+0000","last_peered":"2024-04-19T03:04:48.226445+0000","last_clean":"2024-04-19T03:02:21.239091+0000","last_became_active":"2024-04-19T03:02:24.269896+0000","last_became_peered":"2024-04-19T03:02:24.269896+0000","last_unstale":"2024-04-19T03:04:49.244941+0000","last_undegraded":"2024-04-19T03:04:49.244941+0000","last_fullsized":"2024-04-19T03:04:49.244941+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:59:28.203935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":61,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-19T03:04:48.227116+0000","last_change":"2024-04-19T03:01:15.015685+0000","last_active":"2024-04-19T03:04:48.227116+0000","last_peered":"2024-04-19T03:04:48.227116+0000","last_clean":"2024-04-19T03:04:48.227116+0000","last_became_active":"2024-04-19T03:01:15.014847+0000","last_became_peered":"2024-04-19T03:01:15.014847+0000","last_unstale":"2024-04-19T03:04:48.227116+0000","last_undegraded":"2024-04-19T03:04:48.227116+0000","last_fullsized":"2024-04-19T03:04:48.227116+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:51:06.208551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":33,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-19T03:04:49.247469+0000","last_change":"2024-04-19T03:02:40.440434+0000","last_active":"2024-04-19T03:04:49.247469+0000","last_peered":"2024-04-19T03:04:49.247469+0000","last_clean":"2024-04-19T03:04:49.247469+0000","last_became_active":"2024-04-19T03:02:40.439924+0000","last_became_peered":"2024-04-19T03:02:40.439924+0000","last_unstale":"2024-04-19T03:04:49.247469+0000","last_undegraded":"2024-04-19T03:04:49.247469+0000","last_fullsized":"2024-04-19T03:04:49.247469+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:33:16.864267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":61,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-19T03:04:48.226013+0000","last_change":"2024-04-19T03:01:15.014818+0000","last_active":"2024-04-19T03:04:48.226013+0000","last_peered":"2024-04-19T03:04:48.226013+0000","last_clean":"2024-04-19T03:04:48.226013+0000","last_became_active":"2024-04-19T03:01:15.014421+0000","last_became_peered":"2024-04-19T03:01:15.014421+0000","last_unstale":"2024-04-19T03:04:48.226013+0000","last_undegraded":"2024-04-19T03:04:48.226013+0000","last_fullsized":"2024-04-19T03:04:48.226013+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:16:20.475837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":65,"reported_epoch":68,"state":"active+undersized","last_fresh":"2024-04-19T03:03:33.739378+0000","last_change":"2024-04-19T03:02:24.270374+0000","last_active":"2024-04-19T03:03:33.739378+0000","last_peered":"2024-04-19T03:03:33.739378+0000","last_clean":"2024-04-19T03:02:21.248442+0000","last_became_active":"2024-04-19T03:02:24.270374+0000","last_became_peered":"2024-04-19T03:02:24.270374+0000","last_unstale":"2024-04-19T03:03:33.739378+0000","last_undegraded":"2024-04-19T03:03:33.739378+0000","last_fullsized":"2024-04-19T03:02:24.252696+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:36:04.345818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":34,"reported_epoch":69,"state":"active+undersized","last_fresh":"2024-04-19T03:03:34.760601+0000","last_change":"2024-04-19T03:02:24.263169+0000","last_active":"2024-04-19T03:03:34.760601+0000","last_peered":"2024-04-19T03:03:34.760601+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"2024-04-19T03:02:24.263169+0000","last_became_peered":"2024-04-19T03:02:24.263169+0000","last_unstale":"2024-04-19T03:03:34.760601+0000","last_undegraded":"2024-04-19T03:03:34.760601+0000","last_fullsized":"2024-04-19T03:02:24.256134+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:23:50.481462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"14'157","reported_seq":263,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-19T03:04:48.225736+0000","last_change":"2024-04-19T03:01:07.538434+0000","last_active":"2024-04-19T03:04:48.225736+0000","last_peered":"2024-04-19T03:04:48.225736+0000","last_clean":"2024-04-19T03:04:48.225736+0000","last_became_active":"2024-04-19T03:01:07.537856+0000","last_became_peered":"2024-04-19T03:01:07.537856+0000","last_unstale":"2024-04-19T03:04:48.225736+0000","last_undegraded":"2024-04-19T03:04:48.225736+0000","last_fullsized":"2024-04-19T03:04:48.225736+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:06.516863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:06.516863+0000","last_clean_scrub_stamp":"2024-04-19T03:01:06.516863+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:36:46.386286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":70,"reported_epoch":71,"state":"peering","last_fresh":"2024-04-19T03:04:49.246748+0000","last_change":"2024-04-19T03:04:49.246879+0000","last_active":"2024-04-19T03:04:49.246748+0000","last_peered":"2024-04-19T03:04:48.228146+0000","last_clean":"2024-04-19T03:02:21.239790+0000","last_became_active":"2024-04-19T03:02:24.268308+0000","last_became_peered":"2024-04-19T03:02:24.268308+0000","last_unstale":"2024-04-19T03:04:49.246748+0000","last_undegraded":"2024-04-19T03:04:49.246748+0000","last_fullsized":"2024-04-19T03:04:49.246748+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_clean_scrub_stamp":"2024-04-19T03:01:09.578660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:35:06.302425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":35,"reported_epoch":69,"state":"active+undersized","last_fresh":"2024-04-19T03:03:34.759125+0000","last_change":"2024-04-19T03:02:24.262992+0000","last_active":"2024-04-19T03:03:34.759125+0000","last_peered":"2024-04-19T03:03:34.759125+0000","last_clean":"2024-04-19T03:01:13.604133+0000","last_became_active":"2024-04-19T03:02:24.262992+0000","last_became_peered":"2024-04-19T03:02:24.262992+0000","last_unstale":"2024-04-19T03:03:34.759125+0000","last_undegraded":"2024-04-19T03:03:34.759125+0000","last_fullsized":"2024-04-19T03:02:24.252649+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:11:27.107247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":58,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-19T03:04:48.227313+0000","last_change":"2024-04-19T03:02:40.440550+0000","last_active":"2024-04-19T03:04:48.227313+0000","last_peered":"2024-04-19T03:04:48.227313+0000","last_clean":"2024-04-19T03:04:48.227313+0000","last_became_active":"2024-04-19T03:02:40.439621+0000","last_became_peered":"2024-04-19T03:02:40.439621+0000","last_unstale":"2024-04-19T03:04:48.227313+0000","last_undegraded":"2024-04-19T03:04:48.227313+0000","last_fullsized":"2024-04-19T03:04:48.227313+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:51:11.593632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":64,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-19T03:04:48.226674+0000","last_change":"2024-04-19T03:01:10.602194+0000","last_active":"2024-04-19T03:04:48.226674+0000","last_peered":"2024-04-19T03:04:48.226674+0000","last_clean":"2024-04-19T03:04:48.226674+0000","last_became_active":"2024-04-19T03:01:10.601381+0000","last_became_peered":"2024-04-19T03:01:10.601381+0000","last_unstale":"2024-04-19T03:04:48.226674+0000","last_undegraded":"2024-04-19T03:04:48.226674+0000","last_fullsized":"2024-04-19T03:04:48.226674+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_clean_scrub_stamp":"2024-04-19T03:01:09.578660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:42:26.594095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":35,"reported_epoch":69,"state":"active+undersized","last_fresh":"2024-04-19T03:03:35.094223+0000","last_change":"2024-04-19T03:02:24.269521+0000","last_active":"2024-04-19T03:03:35.094223+0000","last_peered":"2024-04-19T03:03:35.094223+0000","last_clean":"2024-04-19T03:01:13.604133+0000","last_became_active":"2024-04-19T03:02:24.269521+0000","last_became_peered":"2024-04-19T03:02:24.269521+0000","last_unstale":"2024-04-19T03:03:35.094223+0000","last_undegraded":"2024-04-19T03:03:35.094223+0000","last_fullsized":"2024-04-19T03:02:24.255992+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:14:18.946167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":64,"reported_epoch":68,"state":"active+undersized","last_fresh":"2024-04-19T03:03:33.741859+0000","last_change":"2024-04-19T03:02:24.268858+0000","last_active":"2024-04-19T03:03:33.741859+0000","last_peered":"2024-04-19T03:03:33.741859+0000","last_clean":"2024-04-19T03:02:21.249161+0000","last_became_active":"2024-04-19T03:02:24.268858+0000","last_became_peered":"2024-04-19T03:02:24.268858+0000","last_unstale":"2024-04-19T03:03:33.741859+0000","last_undegraded":"2024-04-19T03:03:33.741859+0000","last_fullsized":"2024-04-19T03:02:24.257061+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:42:00.465007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":34,"reported_epoch":69,"state":"active+undersized","last_fresh":"2024-04-19T03:03:34.759535+0000","last_change":"2024-04-19T03:02:24.262857+0000","last_active":"2024-04-19T03:03:34.759535+0000","last_peered":"2024-04-19T03:03:34.759535+0000","last_clean":"2024-04-19T03:01:09.578660+0000","last_became_active":"2024-04-19T03:02:24.262857+0000","last_became_peered":"2024-04-19T03:02:24.262857+0000","last_unstale":"2024-04-19T03:03:34.759535+0000","last_undegraded":"2024-04-19T03:03:34.759535+0000","last_fullsized":"2024-04-19T03:02:24.253233+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_clean_scrub_stamp":"2024-04-19T03:01:09.578660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:00:41.456639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":62,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-19T03:04:49.102435+0000","last_change":"2024-04-19T03:01:14.649068+0000","last_active":"2024-04-19T03:04:49.102435+0000","last_peered":"2024-04-19T03:04:49.102435+0000","last_clean":"2024-04-19T03:04:49.102435+0000","last_became_active":"2024-04-19T03:01:14.648082+0000","last_became_peered":"2024-04-19T03:01:14.648082+0000","last_unstale":"2024-04-19T03:04:49.102435+0000","last_undegraded":"2024-04-19T03:04:49.102435+0000","last_fullsized":"2024-04-19T03:04:49.102435+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:30:14.489117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":34,"reported_epoch":69,"state":"active+undersized","last_fresh":"2024-04-19T03:03:34.760620+0000","last_change":"2024-04-19T03:02:24.263823+0000","last_active":"2024-04-19T03:03:34.760620+0000","last_peered":"2024-04-19T03:03:34.760620+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"2024-04-19T03:02:24.263823+0000","last_became_peered":"2024-04-19T03:02:24.263823+0000","last_unstale":"2024-04-19T03:03:34.760620+0000","last_undegraded":"2024-04-19T03:03:34.760620+0000","last_fullsized":"2024-04-19T03:02:24.256773+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:13:12.261144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":70,"reported_epoch":71,"state":"peering","last_fresh":"2024-04-19T03:04:49.239248+0000","last_change":"2024-04-19T03:04:49.240780+0000","last_active":"2024-04-19T03:04:49.239248+0000","last_peered":"2024-04-19T03:04:48.226330+0000","last_clean":"2024-04-19T03:02:21.239177+0000","last_became_active":"2024-04-19T03:02:24.269783+0000","last_became_peered":"2024-04-19T03:02:24.269783+0000","last_unstale":"2024-04-19T03:04:49.239248+0000","last_undegraded":"2024-04-19T03:04:49.239248+0000","last_fullsized":"2024-04-19T03:04:49.239248+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_clean_scrub_stamp":"2024-04-19T03:01:09.578660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:50:22.833281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":68,"reported_epoch":71,"state":"peering","last_fresh":"2024-04-19T03:04:49.235047+0000","last_change":"2024-04-19T03:04:49.235470+0000","last_active":"2024-04-19T03:04:49.235047+0000","last_peered":"2024-04-19T03:04:48.228156+0000","last_clean":"2024-04-19T03:02:21.239666+0000","last_became_active":"2024-04-19T03:02:24.274962+0000","last_became_peered":"2024-04-19T03:02:24.274962+0000","last_unstale":"2024-04-19T03:04:49.235047+0000","last_undegraded":"2024-04-19T03:04:49.235047+0000","last_fullsized":"2024-04-19T03:04:49.235047+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:30:28.402079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":34,"reported_epoch":69,"state":"active+undersized","last_fresh":"2024-04-19T03:03:34.759233+0000","last_change":"2024-04-19T03:02:24.260888+0000","last_active":"2024-04-19T03:03:34.759233+0000","last_peered":"2024-04-19T03:03:34.759233+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"2024-04-19T03:02:24.260888+0000","last_became_peered":"2024-04-19T03:02:24.260888+0000","last_unstale":"2024-04-19T03:03:34.759233+0000","last_undegraded":"2024-04-19T03:03:34.759233+0000","last_fullsized":"2024-04-19T03:02:24.253375+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:24:49.913495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":60,"reported_epoch":68,"state":"active+undersized","last_fresh":"2024-04-19T03:03:34.575792+0000","last_change":"2024-04-19T03:02:24.273760+0000","last_active":"2024-04-19T03:03:34.575792+0000","last_peered":"2024-04-19T03:03:34.575792+0000","last_clean":"2024-04-19T03:01:13.604133+0000","last_became_active":"2024-04-19T03:02:24.273760+0000","last_became_peered":"2024-04-19T03:02:24.273760+0000","last_unstale":"2024-04-19T03:03:34.575792+0000","last_undegraded":"2024-04-19T03:03:34.575792+0000","last_fullsized":"2024-04-19T03:02:24.263483+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:29:38.352671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":34,"reported_epoch":69,"state":"active+undersized","last_fresh":"2024-04-19T03:03:34.760642+0000","last_change":"2024-04-19T03:02:24.266049+0000","last_active":"2024-04-19T03:03:34.760642+0000","last_peered":"2024-04-19T03:03:34.760642+0000","last_clean":"2024-04-19T03:01:09.578660+0000","last_became_active":"2024-04-19T03:02:24.266049+0000","last_became_peered":"2024-04-19T03:02:24.266049+0000","last_unstale":"2024-04-19T03:03:34.760642+0000","last_undegraded":"2024-04-19T03:03:34.760642+0000","last_fullsized":"2024-04-19T03:02:24.256038+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_clean_scrub_stamp":"2024-04-19T03:01:09.578660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:45:26.469448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":34,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-19T03:04:48.224637+0000","last_change":"2024-04-19T03:02:40.440057+0000","last_active":"2024-04-19T03:04:48.224637+0000","last_peered":"2024-04-19T03:04:48.224637+0000","last_clean":"2024-04-19T03:04:48.224637+0000","last_became_active":"2024-04-19T03:02:40.439752+0000","last_became_peered":"2024-04-19T03:02:40.439752+0000","last_unstale":"2024-04-19T03:04:48.224637+0000","last_undegraded":"2024-04-19T03:04:48.224637+0000","last_fullsized":"2024-04-19T03:04:48.224637+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:38:12.336658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":35,"reported_epoch":69,"state":"active+undersized","last_fresh":"2024-04-19T03:03:34.759788+0000","last_change":"2024-04-19T03:02:24.264727+0000","last_active":"2024-04-19T03:03:34.759788+0000","last_peered":"2024-04-19T03:03:34.759788+0000","last_clean":"2024-04-19T03:01:13.604133+0000","last_became_active":"2024-04-19T03:02:24.264727+0000","last_became_peered":"2024-04-19T03:02:24.264727+0000","last_unstale":"2024-04-19T03:03:34.759788+0000","last_undegraded":"2024-04-19T03:03:34.759788+0000","last_fullsized":"2024-04-19T03:02:24.253765+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:20:27.536142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":68,"reported_epoch":68,"state":"active+undersized","last_fresh":"2024-04-19T03:03:33.741524+0000","last_change":"2024-04-19T03:02:24.263894+0000","last_active":"2024-04-19T03:03:33.741524+0000","last_peered":"2024-04-19T03:03:33.741524+0000","last_clean":"2024-04-19T03:02:21.249599+0000","last_became_active":"2024-04-19T03:02:24.263894+0000","last_became_peered":"2024-04-19T03:02:24.263894+0000","last_unstale":"2024-04-19T03:03:33.741524+0000","last_undegraded":"2024-04-19T03:03:33.741524+0000","last_fullsized":"2024-04-19T03:02:24.256329+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_clean_scrub_stamp":"2024-04-19T03:01:09.578660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:14:49.692877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":34,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-19T03:04:48.226383+0000","last_change":"2024-04-19T03:02:40.440227+0000","last_active":"2024-04-19T03:04:48.226383+0000","last_peered":"2024-04-19T03:04:48.226383+0000","last_clean":"2024-04-19T03:04:48.226383+0000","last_became_active":"2024-04-19T03:02:40.439732+0000","last_became_peered":"2024-04-19T03:02:40.439732+0000","last_unstale":"2024-04-19T03:04:48.226383+0000","last_undegraded":"2024-04-19T03:04:48.226383+0000","last_fullsized":"2024-04-19T03:04:48.226383+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:29:33.660584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"20'2","reported_seq":43,"reported_epoch":69,"state":"active+undersized+degraded","last_fresh":"2024-04-19T03:03:34.761972+0000","last_change":"2024-04-19T03:02:24.265036+0000","last_active":"2024-04-19T03:03:34.761972+0000","last_peered":"2024-04-19T03:03:34.761972+0000","last_clean":"2024-04-19T03:01:15.007165+0000","last_became_active":"2024-04-19T03:02:24.265036+0000","last_became_peered":"2024-04-19T03:02:24.265036+0000","last_unstale":"2024-04-19T03:03:34.761972+0000","last_undegraded":"2024-04-19T03:02:24.258940+0000","last_fullsized":"2024-04-19T03:02:24.258736+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:36:29.647530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[{"shards":"1","objects":1}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":34,"reported_epoch":69,"state":"active+undersized","last_fresh":"2024-04-19T03:03:34.761865+0000","last_change":"2024-04-19T03:02:24.269833+0000","last_active":"2024-04-19T03:03:34.761865+0000","last_peered":"2024-04-19T03:03:34.761865+0000","last_clean":"2024-04-19T03:01:09.578660+0000","last_became_active":"2024-04-19T03:02:24.269833+0000","last_became_peered":"2024-04-19T03:02:24.269833+0000","last_unstale":"2024-04-19T03:03:34.761865+0000","last_undegraded":"2024-04-19T03:03:34.761865+0000","last_fullsized":"2024-04-19T03:02:24.262484+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_clean_scrub_stamp":"2024-04-19T03:01:09.578660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:14:33.574026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":34,"reported_epoch":69,"state":"active+undersized","last_fresh":"2024-04-19T03:03:35.093455+0000","last_change":"2024-04-19T03:02:24.257489+0000","last_active":"2024-04-19T03:03:35.093455+0000","last_peered":"2024-04-19T03:03:35.093455+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"2024-04-19T03:02:24.257489+0000","last_became_peered":"2024-04-19T03:02:24.257489+0000","last_unstale":"2024-04-19T03:03:35.093455+0000","last_undegraded":"2024-04-19T03:03:35.093455+0000","last_fullsized":"2024-04-19T03:02:24.254429+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:52:53.321136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"21'1","reported_seq":44,"reported_epoch":69,"state":"active+undersized+degraded","last_fresh":"2024-04-19T03:03:35.095906+0000","last_change":"2024-04-19T03:02:24.270935+0000","last_active":"2024-04-19T03:03:35.095906+0000","last_peered":"2024-04-19T03:03:35.095906+0000","last_clean":"2024-04-19T03:01:18.093734+0000","last_became_active":"2024-04-19T03:02:24.270935+0000","last_became_peered":"2024-04-19T03:02:24.270935+0000","last_unstale":"2024-04-19T03:03:35.095906+0000","last_undegraded":"2024-04-19T03:02:24.258098+0000","last_fullsized":"2024-04-19T03:02:24.257944+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:57:49.614725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":1}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":64,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-19T03:04:48.226551+0000","last_change":"2024-04-19T03:01:10.602274+0000","last_active":"2024-04-19T03:04:48.226551+0000","last_peered":"2024-04-19T03:04:48.226551+0000","last_clean":"2024-04-19T03:04:48.226551+0000","last_became_active":"2024-04-19T03:01:10.601487+0000","last_became_peered":"2024-04-19T03:01:10.601487+0000","last_unstale":"2024-04-19T03:04:48.226551+0000","last_undegraded":"2024-04-19T03:04:48.226551+0000","last_fullsized":"2024-04-19T03:04:48.226551+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_clean_scrub_stamp":"2024-04-19T03:01:09.578660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:26:16.712446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":61,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-19T03:04:49.101512+0000","last_change":"2024-04-19T03:01:15.018914+0000","last_active":"2024-04-19T03:04:49.101512+0000","last_peered":"2024-04-19T03:04:49.101512+0000","last_clean":"2024-04-19T03:04:49.101512+0000","last_became_active":"2024-04-19T03:01:15.018276+0000","last_became_peered":"2024-04-19T03:01:15.018276+0000","last_unstale":"2024-04-19T03:04:49.101512+0000","last_undegraded":"2024-04-19T03:04:49.101512+0000","last_fullsized":"2024-04-19T03:04:49.101512+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:40:59.453079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":61,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-19T03:04:48.225925+0000","last_change":"2024-04-19T03:01:15.015855+0000","last_active":"2024-04-19T03:04:48.225925+0000","last_peered":"2024-04-19T03:04:48.225925+0000","last_clean":"2024-04-19T03:04:48.225925+0000","last_became_active":"2024-04-19T03:01:15.015358+0000","last_became_peered":"2024-04-19T03:01:15.015358+0000","last_unstale":"2024-04-19T03:04:48.225925+0000","last_undegraded":"2024-04-19T03:04:48.225925+0000","last_fullsized":"2024-04-19T03:04:48.225925+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:59:49.270245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"20'6","reported_seq":68,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-19T03:04:48.227686+0000","last_change":"2024-04-19T03:01:14.649577+0000","last_active":"2024-04-19T03:04:48.227686+0000","last_peered":"2024-04-19T03:04:48.227686+0000","last_clean":"2024-04-19T03:04:48.227686+0000","last_became_active":"2024-04-19T03:01:14.649284+0000","last_became_peered":"2024-04-19T03:01:14.649284+0000","last_unstale":"2024-04-19T03:04:48.227686+0000","last_undegraded":"2024-04-19T03:04:48.227686+0000","last_fullsized":"2024-04-19T03:04:48.227686+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:01:22.214742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":34,"reported_epoch":69,"state":"active+undersized","last_fresh":"2024-04-19T03:03:34.758941+0000","last_change":"2024-04-19T03:02:24.262641+0000","last_active":"2024-04-19T03:03:34.758941+0000","last_peered":"2024-04-19T03:03:34.758941+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"2024-04-19T03:02:24.262641+0000","last_became_peered":"2024-04-19T03:02:24.262641+0000","last_unstale":"2024-04-19T03:03:34.758941+0000","last_undegraded":"2024-04-19T03:03:34.758941+0000","last_fullsized":"2024-04-19T03:02:24.251764+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:45:46.332608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"20'3","reported_seq":41,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-19T03:04:48.227379+0000","last_change":"2024-04-19T03:02:40.442253+0000","last_active":"2024-04-19T03:04:48.227379+0000","last_peered":"2024-04-19T03:04:48.227379+0000","last_clean":"2024-04-19T03:04:48.227379+0000","last_became_active":"2024-04-19T03:02:40.441225+0000","last_became_peered":"2024-04-19T03:02:40.441225+0000","last_unstale":"2024-04-19T03:04:48.227379+0000","last_undegraded":"2024-04-19T03:04:48.227379+0000","last_fullsized":"2024-04-19T03:04:48.227379+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:51:10.208584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":60,"reported_epoch":69,"state":"active+undersized","last_fresh":"2024-04-19T03:03:35.098550+0000","last_change":"2024-04-19T03:02:24.271840+0000","last_active":"2024-04-19T03:03:35.098550+0000","last_peered":"2024-04-19T03:03:35.098550+0000","last_clean":"2024-04-19T03:01:13.604133+0000","last_became_active":"2024-04-19T03:02:24.271840+0000","last_became_peered":"2024-04-19T03:02:24.271840+0000","last_unstale":"2024-04-19T03:03:35.098550+0000","last_undegraded":"2024-04-19T03:03:35.098550+0000","last_fullsized":"2024-04-19T03:02:24.263970+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:00:42.349089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":34,"reported_epoch":69,"state":"active+undersized","last_fresh":"2024-04-19T03:03:35.093733+0000","last_change":"2024-04-19T03:02:24.269277+0000","last_active":"2024-04-19T03:03:35.093733+0000","last_peered":"2024-04-19T03:03:35.093733+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"2024-04-19T03:02:24.269277+0000","last_became_peered":"2024-04-19T03:02:24.269277+0000","last_unstale":"2024-04-19T03:03:35.093733+0000","last_undegraded":"2024-04-19T03:03:35.093733+0000","last_fullsized":"2024-04-19T03:02:24.255461+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:25:57.346322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":34,"reported_epoch":68,"state":"active+undersized","last_fresh":"2024-04-19T03:03:34.576483+0000","last_change":"2024-04-19T03:02:24.276976+0000","last_active":"2024-04-19T03:03:34.576483+0000","last_peered":"2024-04-19T03:03:34.576483+0000","last_clean":"2024-04-19T03:01:13.604133+0000","last_became_active":"2024-04-19T03:02:24.276976+0000","last_became_peered":"2024-04-19T03:02:24.276976+0000","last_unstale":"2024-04-19T03:03:34.576483+0000","last_undegraded":"2024-04-19T03:03:34.576483+0000","last_fullsized":"2024-04-19T03:02:24.263866+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:44:03.338466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":34,"reported_epoch":69,"state":"active+undersized","last_fresh":"2024-04-19T03:03:34.758311+0000","last_change":"2024-04-19T03:02:24.254790+0000","last_active":"2024-04-19T03:03:34.758311+0000","last_peered":"2024-04-19T03:03:34.758311+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"2024-04-19T03:02:24.254790+0000","last_became_peered":"2024-04-19T03:02:24.254790+0000","last_unstale":"2024-04-19T03:03:34.758311+0000","last_undegraded":"2024-04-19T03:03:34.758311+0000","last_fullsized":"2024-04-19T03:02:24.251249+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:02:39.751984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":34,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-19T03:04:48.226019+0000","last_change":"2024-04-19T03:02:40.442421+0000","last_active":"2024-04-19T03:04:48.226019+0000","last_peered":"2024-04-19T03:04:48.226019+0000","last_clean":"2024-04-19T03:04:48.226019+0000","last_became_active":"2024-04-19T03:02:40.441746+0000","last_became_peered":"2024-04-19T03:02:40.441746+0000","last_unstale":"2024-04-19T03:04:48.226019+0000","last_undegraded":"2024-04-19T03:04:48.226019+0000","last_fullsized":"2024-04-19T03:04:48.226019+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:52:55.719264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":34,"reported_epoch":68,"state":"active+undersized","last_fresh":"2024-04-19T03:03:33.739852+0000","last_change":"2024-04-19T03:02:24.265626+0000","last_active":"2024-04-19T03:03:33.739852+0000","last_peered":"2024-04-19T03:03:33.739852+0000","last_clean":"2024-04-19T03:01:13.604133+0000","last_became_active":"2024-04-19T03:02:24.265626+0000","last_became_peered":"2024-04-19T03:02:24.265626+0000","last_unstale":"2024-04-19T03:03:33.739852+0000","last_undegraded":"2024-04-19T03:03:33.739852+0000","last_fullsized":"2024-04-19T03:02:24.253251+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:31:25.309764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":34,"reported_epoch":69,"state":"active+undersized","last_fresh":"2024-04-19T03:03:35.096107+0000","last_change":"2024-04-19T03:02:24.271602+0000","last_active":"2024-04-19T03:03:35.096107+0000","last_peered":"2024-04-19T03:03:35.096107+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"2024-04-19T03:02:24.271602+0000","last_became_peered":"2024-04-19T03:02:24.271602+0000","last_unstale":"2024-04-19T03:03:35.096107+0000","last_undegraded":"2024-04-19T03:03:35.096107+0000","last_fullsized":"2024-04-19T03:02:24.262475+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:01:44.111884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":34,"reported_epoch":68,"state":"active+undersized","last_fresh":"2024-04-19T03:03:34.572342+0000","last_change":"2024-04-19T03:02:24.271293+0000","last_active":"2024-04-19T03:03:34.572342+0000","last_peered":"2024-04-19T03:03:34.572342+0000","last_clean":"2024-04-19T03:01:13.604133+0000","last_became_active":"2024-04-19T03:02:24.271293+0000","last_became_peered":"2024-04-19T03:02:24.271293+0000","last_unstale":"2024-04-19T03:03:34.572342+0000","last_undegraded":"2024-04-19T03:03:34.572342+0000","last_fullsized":"2024-04-19T03:02:24.255695+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:08:42.859745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":33,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-19T03:04:48.225301+0000","last_change":"2024-04-19T03:02:40.441670+0000","last_active":"2024-04-19T03:04:48.225301+0000","last_peered":"2024-04-19T03:04:48.225301+0000","last_clean":"2024-04-19T03:04:48.225301+0000","last_became_active":"2024-04-19T03:02:40.441294+0000","last_became_peered":"2024-04-19T03:02:40.441294+0000","last_unstale":"2024-04-19T03:04:48.225301+0000","last_undegraded":"2024-04-19T03:04:48.225301+0000","last_fullsized":"2024-04-19T03:04:48.225301+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:59:32.330785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"20'1","reported_seq":66,"reported_epoch":69,"state":"active+undersized","last_fresh":"2024-04-19T03:03:34.759755+0000","last_change":"2024-04-19T03:02:24.263516+0000","last_active":"2024-04-19T03:03:34.759755+0000","last_peered":"2024-04-19T03:03:34.759755+0000","last_clean":"2024-04-19T03:02:21.248830+0000","last_became_active":"2024-04-19T03:02:24.263516+0000","last_became_peered":"2024-04-19T03:02:24.263516+0000","last_unstale":"2024-04-19T03:03:34.759755+0000","last_undegraded":"2024-04-19T03:03:34.759755+0000","last_fullsized":"2024-04-19T03:02:24.253942+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:21:08.378544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":64,"reported_epoch":69,"state":"active+undersized","last_fresh":"2024-04-19T03:03:34.760400+0000","last_change":"2024-04-19T03:02:24.265728+0000","last_active":"2024-04-19T03:03:34.760400+0000","last_peered":"2024-04-19T03:03:34.760400+0000","last_clean":"2024-04-19T03:02:21.249322+0000","last_became_active":"2024-04-19T03:02:24.265728+0000","last_became_peered":"2024-04-19T03:02:24.265728+0000","last_unstale":"2024-04-19T03:03:34.760400+0000","last_undegraded":"2024-04-19T03:03:34.760400+0000","last_fullsized":"2024-04-19T03:02:24.254256+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:18:31.651631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"20'1","reported_seq":74,"reported_epoch":69,"state":"active+undersized","last_fresh":"2024-04-19T03:03:34.761888+0000","last_change":"2024-04-19T03:02:24.266095+0000","last_active":"2024-04-19T03:03:34.761888+0000","last_peered":"2024-04-19T03:03:34.761888+0000","last_clean":"2024-04-19T03:02:21.249288+0000","last_became_active":"2024-04-19T03:02:24.266095+0000","last_became_peered":"2024-04-19T03:02:24.266095+0000","last_unstale":"2024-04-19T03:03:34.761888+0000","last_undegraded":"2024-04-19T03:03:34.761888+0000","last_fullsized":"2024-04-19T03:02:24.254088+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:02:11.243382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":67,"reported_epoch":71,"state":"peering","last_fresh":"2024-04-19T03:04:49.238423+0000","last_change":"2024-04-19T03:04:49.238858+0000","last_active":"2024-04-19T03:04:49.238423+0000","last_peered":"2024-04-19T03:04:48.225599+0000","last_clean":"2024-04-19T03:02:21.239100+0000","last_became_active":"2024-04-19T03:02:24.264906+0000","last_became_peered":"2024-04-19T03:02:24.264906+0000","last_unstale":"2024-04-19T03:04:49.238423+0000","last_undegraded":"2024-04-19T03:04:49.238423+0000","last_fullsized":"2024-04-19T03:04:49.238423+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:25:23.823410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"20'2","reported_seq":70,"reported_epoch":71,"state":"peering","last_fresh":"2024-04-19T03:04:49.244022+0000","last_change":"2024-04-19T03:04:49.244445+0000","last_active":"2024-04-19T03:04:49.244022+0000","last_peered":"2024-04-19T03:04:48.228171+0000","last_clean":"2024-04-19T03:02:21.239137+0000","last_became_active":"2024-04-19T03:02:24.283173+0000","last_became_peered":"2024-04-19T03:02:24.283173+0000","last_unstale":"2024-04-19T03:04:49.244022+0000","last_undegraded":"2024-04-19T03:04:49.244022+0000","last_fullsized":"2024-04-19T03:04:49.244022+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:48:15.865979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":67,"reported_epoch":71,"state":"peering","last_fresh":"2024-04-19T03:04:49.243751+0000","last_change":"2024-04-19T03:04:49.244452+0000","last_active":"2024-04-19T03:04:49.243751+0000","last_peered":"2024-04-19T03:04:48.225979+0000","last_clean":"2024-04-19T03:02:21.238991+0000","last_became_active":"2024-04-19T03:02:24.269672+0000","last_became_peered":"2024-04-19T03:02:24.269672+0000","last_unstale":"2024-04-19T03:04:49.243751+0000","last_undegraded":"2024-04-19T03:04:49.243751+0000","last_fullsized":"2024-04-19T03:04:49.243751+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:09:41.580252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"20'2","reported_seq":41,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-19T03:04:48.227071+0000","last_change":"2024-04-19T03:02:40.441689+0000","last_active":"2024-04-19T03:04:48.227071+0000","last_peered":"2024-04-19T03:04:48.227071+0000","last_clean":"2024-04-19T03:04:48.227071+0000","last_became_active":"2024-04-19T03:02:40.440206+0000","last_became_peered":"2024-04-19T03:02:40.440206+0000","last_unstale":"2024-04-19T03:04:48.227071+0000","last_undegraded":"2024-04-19T03:04:48.227071+0000","last_fullsized":"2024-04-19T03:04:48.227071+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:02:19.100804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":64,"reported_epoch":69,"state":"active+undersized","last_fresh":"2024-04-19T03:03:34.759439+0000","last_change":"2024-04-19T03:02:24.263202+0000","last_active":"2024-04-19T03:03:34.759439+0000","last_peered":"2024-04-19T03:03:34.759439+0000","last_clean":"2024-04-19T03:02:21.248674+0000","last_became_active":"2024-04-19T03:02:24.263202+0000","last_became_peered":"2024-04-19T03:02:24.263202+0000","last_unstale":"2024-04-19T03:03:34.759439+0000","last_undegraded":"2024-04-19T03:03:34.759439+0000","last_fullsized":"2024-04-19T03:02:24.252560+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:05:00.071308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"20'1","reported_seq":35,"reported_epoch":69,"state":"active+undersized","last_fresh":"2024-04-19T03:03:34.760417+0000","last_change":"2024-04-19T03:02:24.269410+0000","last_active":"2024-04-19T03:03:34.760417+0000","last_peered":"2024-04-19T03:03:34.760417+0000","last_clean":"2024-04-19T03:01:13.604133+0000","last_became_active":"2024-04-19T03:02:24.269410+0000","last_became_peered":"2024-04-19T03:02:24.269410+0000","last_unstale":"2024-04-19T03:03:34.760417+0000","last_undegraded":"2024-04-19T03:03:34.760417+0000","last_fullsized":"2024-04-19T03:02:24.257278+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:01:43.100098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":67,"reported_epoch":71,"state":"peering","last_fresh":"2024-04-19T03:04:49.238503+0000","last_change":"2024-04-19T03:04:49.238881+0000","last_active":"2024-04-19T03:04:49.238503+0000","last_peered":"2024-04-19T03:04:48.225407+0000","last_clean":"2024-04-19T03:02:21.238692+0000","last_became_active":"2024-04-19T03:02:24.264787+0000","last_became_peered":"2024-04-19T03:02:24.264787+0000","last_unstale":"2024-04-19T03:04:49.238503+0000","last_undegraded":"2024-04-19T03:04:49.238503+0000","last_fullsized":"2024-04-19T03:04:49.238503+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:45:33.989924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"20'4","reported_seq":43,"reported_epoch":69,"state":"active+undersized+degraded","last_fresh":"2024-04-19T03:03:35.098438+0000","last_change":"2024-04-19T03:02:24.276744+0000","last_active":"2024-04-19T03:03:35.098438+0000","last_peered":"2024-04-19T03:03:35.098438+0000","last_clean":"2024-04-19T03:01:15.006951+0000","last_became_active":"2024-04-19T03:02:24.276744+0000","last_became_peered":"2024-04-19T03:02:24.276744+0000","last_unstale":"2024-04-19T03:03:35.098438+0000","last_undegraded":"2024-04-19T03:02:24.263785+0000","last_fullsized":"2024-04-19T03:02:24.263676+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:27:16.968519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":2}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":95,"acting":95,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":5,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5289,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":46,"acting":46,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":12,"acting":12,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":14482,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":10,"seq":42949673011,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":220636,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":219774,"kb_avail":94151204,"statfs":{"total":96636764160,"available":96410832896,"internally_reserved":0,"allocated":864256,"data_stored":887137,"data_compressed":7241,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":225049030},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 19 03:02:08 2024","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":2.1379999999999999},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"last":0.33100000000000002}]},{"osd":1,"last update":"Fri Apr 19 03:04:11 2024","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.19900000000000001,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.87,"5min":2.5030000000000001,"15min":2.5030000000000001},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.57099999999999995,"15min":0.56299999999999994},"min":{"1min":0.23999999999999999,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.90400000000000003,"5min":2.6379999999999999,"15min":2.6379999999999999},"last":0.59099999999999997}]}]},{"osd":1,"up_from":10,"seq":42949673010,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":202584,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":201726,"kb_avail":94169256,"statfs":{"total":96636764160,"available":96429318144,"internally_reserved":0,"allocated":860160,"data_stored":888684,"data_compressed":7241,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":206567878},"hb_peers":[2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 19 03:02:04 2024","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.216},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":2.2349999999999999}]},{"osd":2,"last update":"Fri Apr 19 03:04:07 2024","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.47899999999999998,"15min":0.501},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":0.79400000000000004,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.623},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.48499999999999999,"15min":0.51400000000000001},"min":{"1min":0.26100000000000001,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.83899999999999997,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.68899999999999995}]}]},{"osd":0,"up_from":0,"seq":1,"num_pgs":86,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":326744,"kb_used_data":283984,"kb_used_omap":6,"kb_used_meta":42745,"kb_avail":94045096,"statfs":{"total":96636764160,"available":96302178304,"internally_reserved":0,"allocated":290799616,"data_stored":4645810470,"data_compressed":8901299,"data_compressed_allocated":290353152,"data_compressed_original":4645650432,"omap_allocated":6883,"internal_metadata":43771165},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":7241,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":7241,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5289,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-19T03:04:51.939 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-19T03:04:52.304 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-19T03:04:52.305 INFO:teuthology.orchestra.run.smithi096.stdout:{"fsid":"c6cc8e09-11d4-48de-9a6c-4d70ed3c3789","health":{"status":"HEALTH_WARN","checks":{"PG_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"Degraded data redundancy: 5/48 objects degraded (10.417%), 4 pgs degraded, 55 pgs undersized","count":59},"muted":false}},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":238,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":73,"num_osds":3,"num_up_osds":3,"osd_up_since":1713495889,"num_in_osds":3,"osd_in_since":1713495654,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+undersized","count":51},{"state_name":"active+clean","count":32},{"state_name":"peering","count":18},{"state_name":"active+undersized+degraded","count":4}],"num_pgs":105,"num_pools":4,"num_objects":24,"data_bytes":592730,"bytes_used":767963136,"bytes_avail":289142329344,"bytes_total":289910292480,"inactive_pgs_ratio":0.17142857611179352,"degraded_objects":5,"degraded_total":48,"degraded_ratio":0.10416666666666669},"fsmap":{"epoch":5,"id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"a","status":"up:active","gid":4202}],"up:standby":0},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":5,"modified":"2024-04-19T03:02:21.965605+0000","services":{}},"progress_events":{}} 2024-04-19T03:04:52.318 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-04-19T03:04:52.319 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-19T03:04:52.616 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-19T03:04:52.619 INFO:teuthology.orchestra.run.smithi096.stderr:dumped all 2024-04-19T03:04:52.631 INFO:teuthology.orchestra.run.smithi096.stdout:{"pg_ready":true,"pg_map":{"version":183,"stamp":"2024-04-19T03:04:52.042122+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":5,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":155,"acting":155,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":223,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":749964,"kb_used_data":285668,"kb_used_omap":9,"kb_used_meta":464246,"kb_avail":282365556,"statfs":{"total":289910292480,"available":289142329344,"internally_reserved":0,"allocated":292524032,"data_stored":4647586291,"data_compressed":8915781,"data_compressed_allocated":290426880,"data_compressed_original":4646797312,"omap_allocated":10071,"internal_metadata":475388073},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-3,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.002088"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":64,"reported_epoch":68,"state":"active+undersized","last_fresh":"2024-04-19T03:03:33.743192+0000","last_change":"2024-04-19T03:02:24.266182+0000","last_active":"2024-04-19T03:03:33.743192+0000","last_peered":"2024-04-19T03:03:33.743192+0000","last_clean":"2024-04-19T03:02:21.249547+0000","last_became_active":"2024-04-19T03:02:24.266182+0000","last_became_peered":"2024-04-19T03:02:24.266182+0000","last_unstale":"2024-04-19T03:03:33.743192+0000","last_undegraded":"2024-04-19T03:03:33.743192+0000","last_fullsized":"2024-04-19T03:02:24.261935+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:20:35.729791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":67,"reported_epoch":71,"state":"peering","last_fresh":"2024-04-19T03:04:49.228465+0000","last_change":"2024-04-19T03:04:49.229512+0000","last_active":"2024-04-19T03:04:49.228465+0000","last_peered":"2024-04-19T03:04:49.103074+0000","last_clean":"2024-04-19T03:02:21.248866+0000","last_became_active":"2024-04-19T03:02:24.268239+0000","last_became_peered":"2024-04-19T03:02:24.268239+0000","last_unstale":"2024-04-19T03:04:49.228465+0000","last_undegraded":"2024-04-19T03:04:49.228465+0000","last_fullsized":"2024-04-19T03:04:49.228465+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:33:34.879955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":61,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-19T03:04:48.225576+0000","last_change":"2024-04-19T03:01:15.015884+0000","last_active":"2024-04-19T03:04:48.225576+0000","last_peered":"2024-04-19T03:04:48.225576+0000","last_clean":"2024-04-19T03:04:48.225576+0000","last_became_active":"2024-04-19T03:01:15.014599+0000","last_became_peered":"2024-04-19T03:01:15.014599+0000","last_unstale":"2024-04-19T03:04:48.225576+0000","last_undegraded":"2024-04-19T03:04:48.225576+0000","last_fullsized":"2024-04-19T03:04:48.225576+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:35:19.436344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":67,"reported_epoch":71,"state":"peering","last_fresh":"2024-04-19T03:04:49.236427+0000","last_change":"2024-04-19T03:04:49.236807+0000","last_active":"2024-04-19T03:04:49.236427+0000","last_peered":"2024-04-19T03:04:48.226533+0000","last_clean":"2024-04-19T03:02:21.239010+0000","last_became_active":"2024-04-19T03:02:24.283312+0000","last_became_peered":"2024-04-19T03:02:24.283312+0000","last_unstale":"2024-04-19T03:04:49.236427+0000","last_undegraded":"2024-04-19T03:04:49.236427+0000","last_fullsized":"2024-04-19T03:04:49.236427+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:31:31.190200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":64,"reported_epoch":69,"state":"active+undersized","last_fresh":"2024-04-19T03:03:34.761083+0000","last_change":"2024-04-19T03:02:24.265793+0000","last_active":"2024-04-19T03:03:34.761083+0000","last_peered":"2024-04-19T03:03:34.761083+0000","last_clean":"2024-04-19T03:02:21.249126+0000","last_became_active":"2024-04-19T03:02:24.265793+0000","last_became_peered":"2024-04-19T03:02:24.265793+0000","last_unstale":"2024-04-19T03:03:34.761083+0000","last_undegraded":"2024-04-19T03:03:34.761083+0000","last_fullsized":"2024-04-19T03:02:24.253775+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:15:46.441415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":59,"reported_epoch":69,"state":"active+undersized","last_fresh":"2024-04-19T03:03:35.094241+0000","last_change":"2024-04-19T03:02:24.269520+0000","last_active":"2024-04-19T03:03:35.094241+0000","last_peered":"2024-04-19T03:03:35.094241+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"2024-04-19T03:02:24.269520+0000","last_became_peered":"2024-04-19T03:02:24.269520+0000","last_unstale":"2024-04-19T03:03:35.094241+0000","last_undegraded":"2024-04-19T03:03:35.094241+0000","last_fullsized":"2024-04-19T03:02:24.255694+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:45:46.332608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":59,"reported_epoch":69,"state":"active+undersized","last_fresh":"2024-04-19T03:03:35.095224+0000","last_change":"2024-04-19T03:02:24.271511+0000","last_active":"2024-04-19T03:03:35.095224+0000","last_peered":"2024-04-19T03:03:35.095224+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"2024-04-19T03:02:24.271511+0000","last_became_peered":"2024-04-19T03:02:24.271511+0000","last_unstale":"2024-04-19T03:03:35.095224+0000","last_undegraded":"2024-04-19T03:03:35.095224+0000","last_fullsized":"2024-04-19T03:02:24.257544+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:45:01.989501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":67,"reported_epoch":71,"state":"peering","last_fresh":"2024-04-19T03:04:49.244438+0000","last_change":"2024-04-19T03:04:49.244616+0000","last_active":"2024-04-19T03:04:49.244438+0000","last_peered":"2024-04-19T03:04:48.224532+0000","last_clean":"2024-04-19T03:02:21.238411+0000","last_became_active":"2024-04-19T03:02:24.261119+0000","last_became_peered":"2024-04-19T03:02:24.261119+0000","last_unstale":"2024-04-19T03:04:49.244438+0000","last_undegraded":"2024-04-19T03:04:49.244438+0000","last_fullsized":"2024-04-19T03:04:49.244438+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:57:01.109868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":33,"reported_epoch":68,"state":"active+undersized","last_fresh":"2024-04-19T03:03:33.742471+0000","last_change":"2024-04-19T03:02:24.263980+0000","last_active":"2024-04-19T03:03:33.742471+0000","last_peered":"2024-04-19T03:03:33.742471+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"2024-04-19T03:02:24.263980+0000","last_became_peered":"2024-04-19T03:02:24.263980+0000","last_unstale":"2024-04-19T03:03:33.742471+0000","last_undegraded":"2024-04-19T03:03:33.742471+0000","last_fullsized":"2024-04-19T03:02:24.256849+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:07:41.954531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":67,"reported_epoch":71,"state":"peering","last_fresh":"2024-04-19T03:04:49.227330+0000","last_change":"2024-04-19T03:04:49.227670+0000","last_active":"2024-04-19T03:04:49.227330+0000","last_peered":"2024-04-19T03:04:49.103387+0000","last_clean":"2024-04-19T03:02:21.249077+0000","last_became_active":"2024-04-19T03:02:24.268562+0000","last_became_peered":"2024-04-19T03:02:24.268562+0000","last_unstale":"2024-04-19T03:04:49.227330+0000","last_undegraded":"2024-04-19T03:04:49.227330+0000","last_fullsized":"2024-04-19T03:04:49.227330+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:43:17.397637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":59,"reported_epoch":69,"state":"active+undersized","last_fresh":"2024-04-19T03:03:35.095107+0000","last_change":"2024-04-19T03:02:24.273737+0000","last_active":"2024-04-19T03:03:35.095107+0000","last_peered":"2024-04-19T03:03:35.095107+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"2024-04-19T03:02:24.273737+0000","last_became_peered":"2024-04-19T03:02:24.273737+0000","last_unstale":"2024-04-19T03:03:35.095107+0000","last_undegraded":"2024-04-19T03:03:35.095107+0000","last_fullsized":"2024-04-19T03:02:24.262626+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:19:16.702009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":33,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-19T03:04:48.225620+0000","last_change":"2024-04-19T03:02:40.438738+0000","last_active":"2024-04-19T03:04:48.225620+0000","last_peered":"2024-04-19T03:04:48.225620+0000","last_clean":"2024-04-19T03:04:48.225620+0000","last_became_active":"2024-04-19T03:02:40.438000+0000","last_became_peered":"2024-04-19T03:02:40.438000+0000","last_unstale":"2024-04-19T03:04:48.225620+0000","last_undegraded":"2024-04-19T03:04:48.225620+0000","last_fullsized":"2024-04-19T03:04:48.225620+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:35:10.932021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":64,"reported_epoch":69,"state":"active+undersized","last_fresh":"2024-04-19T03:03:34.759201+0000","last_change":"2024-04-19T03:02:24.265275+0000","last_active":"2024-04-19T03:03:34.759201+0000","last_peered":"2024-04-19T03:03:34.759201+0000","last_clean":"2024-04-19T03:02:21.248908+0000","last_became_active":"2024-04-19T03:02:24.265275+0000","last_became_peered":"2024-04-19T03:02:24.265275+0000","last_unstale":"2024-04-19T03:03:34.759201+0000","last_undegraded":"2024-04-19T03:03:34.759201+0000","last_fullsized":"2024-04-19T03:02:24.253280+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:10:26.573207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":61,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-19T03:04:48.225063+0000","last_change":"2024-04-19T03:01:15.010960+0000","last_active":"2024-04-19T03:04:48.225063+0000","last_peered":"2024-04-19T03:04:48.225063+0000","last_clean":"2024-04-19T03:04:48.225063+0000","last_became_active":"2024-04-19T03:01:15.010472+0000","last_became_peered":"2024-04-19T03:01:15.010472+0000","last_unstale":"2024-04-19T03:04:48.225063+0000","last_undegraded":"2024-04-19T03:04:48.225063+0000","last_fullsized":"2024-04-19T03:04:48.225063+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:21:36.129346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":61,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-19T03:04:48.226314+0000","last_change":"2024-04-19T03:01:15.014574+0000","last_active":"2024-04-19T03:04:48.226314+0000","last_peered":"2024-04-19T03:04:48.226314+0000","last_clean":"2024-04-19T03:04:48.226314+0000","last_became_active":"2024-04-19T03:01:15.014096+0000","last_became_peered":"2024-04-19T03:01:15.014096+0000","last_unstale":"2024-04-19T03:04:48.226314+0000","last_undegraded":"2024-04-19T03:04:48.226314+0000","last_fullsized":"2024-04-19T03:04:48.226314+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:01:54.253963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":59,"reported_epoch":69,"state":"active+undersized","last_fresh":"2024-04-19T03:03:35.093776+0000","last_change":"2024-04-19T03:02:24.261536+0000","last_active":"2024-04-19T03:03:35.093776+0000","last_peered":"2024-04-19T03:03:35.093776+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"2024-04-19T03:02:24.261536+0000","last_became_peered":"2024-04-19T03:02:24.261536+0000","last_unstale":"2024-04-19T03:03:35.093776+0000","last_undegraded":"2024-04-19T03:03:35.093776+0000","last_fullsized":"2024-04-19T03:02:24.255185+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:22:34.583134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":34,"reported_epoch":69,"state":"active+undersized","last_fresh":"2024-04-19T03:03:34.761616+0000","last_change":"2024-04-19T03:02:24.264729+0000","last_active":"2024-04-19T03:03:34.761616+0000","last_peered":"2024-04-19T03:03:34.761616+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"2024-04-19T03:02:24.264729+0000","last_became_peered":"2024-04-19T03:02:24.264729+0000","last_unstale":"2024-04-19T03:03:34.761616+0000","last_undegraded":"2024-04-19T03:03:34.761616+0000","last_fullsized":"2024-04-19T03:02:24.258548+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:16:20.425626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":64,"reported_epoch":69,"state":"active+undersized","last_fresh":"2024-04-19T03:03:34.760976+0000","last_change":"2024-04-19T03:02:24.269142+0000","last_active":"2024-04-19T03:03:34.760976+0000","last_peered":"2024-04-19T03:03:34.760976+0000","last_clean":"2024-04-19T03:02:21.249343+0000","last_became_active":"2024-04-19T03:02:24.269142+0000","last_became_peered":"2024-04-19T03:02:24.269142+0000","last_unstale":"2024-04-19T03:03:34.760976+0000","last_undegraded":"2024-04-19T03:03:34.760976+0000","last_fullsized":"2024-04-19T03:02:24.257309+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:36:10.316727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":34,"reported_epoch":69,"state":"active+undersized","last_fresh":"2024-04-19T03:03:34.761984+0000","last_change":"2024-04-19T03:02:24.262871+0000","last_active":"2024-04-19T03:03:34.761984+0000","last_peered":"2024-04-19T03:03:34.761984+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"2024-04-19T03:02:24.262871+0000","last_became_peered":"2024-04-19T03:02:24.262871+0000","last_unstale":"2024-04-19T03:03:34.761984+0000","last_undegraded":"2024-04-19T03:03:34.761984+0000","last_fullsized":"2024-04-19T03:02:24.254723+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:19:25.662483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":67,"reported_epoch":71,"state":"peering","last_fresh":"2024-04-19T03:04:49.238473+0000","last_change":"2024-04-19T03:04:49.238833+0000","last_active":"2024-04-19T03:04:49.238473+0000","last_peered":"2024-04-19T03:04:48.226117+0000","last_clean":"2024-04-19T03:02:21.238883+0000","last_became_active":"2024-04-19T03:02:24.280097+0000","last_became_peered":"2024-04-19T03:02:24.280097+0000","last_unstale":"2024-04-19T03:04:49.238473+0000","last_undegraded":"2024-04-19T03:04:49.238473+0000","last_fullsized":"2024-04-19T03:04:49.238473+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:18:02.311663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":67,"reported_epoch":71,"state":"peering","last_fresh":"2024-04-19T03:04:49.243380+0000","last_change":"2024-04-19T03:04:49.243554+0000","last_active":"2024-04-19T03:04:49.243380+0000","last_peered":"2024-04-19T03:04:48.227227+0000","last_clean":"2024-04-19T03:02:21.239350+0000","last_became_active":"2024-04-19T03:02:24.265606+0000","last_became_peered":"2024-04-19T03:02:24.265606+0000","last_unstale":"2024-04-19T03:04:49.243380+0000","last_undegraded":"2024-04-19T03:04:49.243380+0000","last_fullsized":"2024-04-19T03:04:49.243380+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:26:01.458051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":61,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-19T03:04:49.101571+0000","last_change":"2024-04-19T03:01:15.020108+0000","last_active":"2024-04-19T03:04:49.101571+0000","last_peered":"2024-04-19T03:04:49.101571+0000","last_clean":"2024-04-19T03:04:49.101571+0000","last_became_active":"2024-04-19T03:01:15.018978+0000","last_became_peered":"2024-04-19T03:01:15.018978+0000","last_unstale":"2024-04-19T03:04:49.101571+0000","last_undegraded":"2024-04-19T03:04:49.101571+0000","last_fullsized":"2024-04-19T03:04:49.101571+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:30:22.360053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":34,"reported_epoch":69,"state":"active+undersized","last_fresh":"2024-04-19T03:03:35.093708+0000","last_change":"2024-04-19T03:02:24.260984+0000","last_active":"2024-04-19T03:03:35.093708+0000","last_peered":"2024-04-19T03:03:35.093708+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"2024-04-19T03:02:24.260984+0000","last_became_peered":"2024-04-19T03:02:24.260984+0000","last_unstale":"2024-04-19T03:03:35.093708+0000","last_undegraded":"2024-04-19T03:03:35.093708+0000","last_fullsized":"2024-04-19T03:02:24.254937+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:36:55.924337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":64,"reported_epoch":68,"state":"active+undersized","last_fresh":"2024-04-19T03:03:33.739131+0000","last_change":"2024-04-19T03:02:24.267695+0000","last_active":"2024-04-19T03:03:33.739131+0000","last_peered":"2024-04-19T03:03:33.739131+0000","last_clean":"2024-04-19T03:02:21.248328+0000","last_became_active":"2024-04-19T03:02:24.267695+0000","last_became_peered":"2024-04-19T03:02:24.267695+0000","last_unstale":"2024-04-19T03:03:33.739131+0000","last_undegraded":"2024-04-19T03:03:33.739131+0000","last_fullsized":"2024-04-19T03:02:24.251954+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:45:46.987421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":34,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-19T03:04:49.241504+0000","last_change":"2024-04-19T03:02:40.441681+0000","last_active":"2024-04-19T03:04:49.241504+0000","last_peered":"2024-04-19T03:04:49.241504+0000","last_clean":"2024-04-19T03:04:49.241504+0000","last_became_active":"2024-04-19T03:02:40.441170+0000","last_became_peered":"2024-04-19T03:02:40.441170+0000","last_unstale":"2024-04-19T03:04:49.241504+0000","last_undegraded":"2024-04-19T03:04:49.241504+0000","last_fullsized":"2024-04-19T03:04:49.241504+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:43:25.396638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":34,"reported_epoch":69,"state":"active+undersized","last_fresh":"2024-04-19T03:03:35.096362+0000","last_change":"2024-04-19T03:02:24.272073+0000","last_active":"2024-04-19T03:03:35.096362+0000","last_peered":"2024-04-19T03:03:35.096362+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"2024-04-19T03:02:24.272073+0000","last_became_peered":"2024-04-19T03:02:24.272073+0000","last_unstale":"2024-04-19T03:03:35.096362+0000","last_undegraded":"2024-04-19T03:03:35.096362+0000","last_fullsized":"2024-04-19T03:02:24.263402+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:53:27.352419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":44,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-19T03:04:49.103486+0000","last_change":"2024-04-19T03:02:15.206453+0000","last_active":"2024-04-19T03:04:49.103486+0000","last_peered":"2024-04-19T03:04:49.103486+0000","last_clean":"2024-04-19T03:04:49.103486+0000","last_became_active":"2024-04-19T03:02:15.205905+0000","last_became_peered":"2024-04-19T03:02:15.205905+0000","last_unstale":"2024-04-19T03:04:49.103486+0000","last_undegraded":"2024-04-19T03:04:49.103486+0000","last_fullsized":"2024-04-19T03:04:49.103486+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:48:06.646477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":61,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-19T03:04:49.103482+0000","last_change":"2024-04-19T03:01:15.020098+0000","last_active":"2024-04-19T03:04:49.103482+0000","last_peered":"2024-04-19T03:04:49.103482+0000","last_clean":"2024-04-19T03:04:49.103482+0000","last_became_active":"2024-04-19T03:01:15.019064+0000","last_became_peered":"2024-04-19T03:01:15.019064+0000","last_unstale":"2024-04-19T03:04:49.103482+0000","last_undegraded":"2024-04-19T03:04:49.103482+0000","last_fullsized":"2024-04-19T03:04:49.103482+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:50:06.490191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":34,"reported_epoch":69,"state":"active+undersized","last_fresh":"2024-04-19T03:03:34.759432+0000","last_change":"2024-04-19T03:02:24.259183+0000","last_active":"2024-04-19T03:03:34.759432+0000","last_peered":"2024-04-19T03:03:34.759432+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"2024-04-19T03:02:24.259183+0000","last_became_peered":"2024-04-19T03:02:24.259183+0000","last_unstale":"2024-04-19T03:03:34.759432+0000","last_undegraded":"2024-04-19T03:03:34.759432+0000","last_fullsized":"2024-04-19T03:02:24.252854+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:19:16.702009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":34,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-19T03:04:48.224820+0000","last_change":"2024-04-19T03:02:40.440907+0000","last_active":"2024-04-19T03:04:48.224820+0000","last_peered":"2024-04-19T03:04:48.224820+0000","last_clean":"2024-04-19T03:04:48.224820+0000","last_became_active":"2024-04-19T03:02:40.440351+0000","last_became_peered":"2024-04-19T03:02:40.440351+0000","last_unstale":"2024-04-19T03:04:48.224820+0000","last_undegraded":"2024-04-19T03:04:48.224820+0000","last_fullsized":"2024-04-19T03:04:48.224820+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:36:36.558329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":34,"reported_epoch":69,"state":"active+undersized","last_fresh":"2024-04-19T03:03:34.758656+0000","last_change":"2024-04-19T03:02:24.258688+0000","last_active":"2024-04-19T03:03:34.758656+0000","last_peered":"2024-04-19T03:03:34.758656+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"2024-04-19T03:02:24.258688+0000","last_became_peered":"2024-04-19T03:02:24.258688+0000","last_unstale":"2024-04-19T03:03:34.758656+0000","last_undegraded":"2024-04-19T03:03:34.758656+0000","last_fullsized":"2024-04-19T03:02:24.251480+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:16:44.560445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":67,"reported_epoch":71,"state":"peering","last_fresh":"2024-04-19T03:04:49.237705+0000","last_change":"2024-04-19T03:04:49.238125+0000","last_active":"2024-04-19T03:04:49.237705+0000","last_peered":"2024-04-19T03:04:48.225027+0000","last_clean":"2024-04-19T03:02:21.238487+0000","last_became_active":"2024-04-19T03:02:24.265187+0000","last_became_peered":"2024-04-19T03:02:24.265187+0000","last_unstale":"2024-04-19T03:04:49.237705+0000","last_undegraded":"2024-04-19T03:04:49.237705+0000","last_fullsized":"2024-04-19T03:04:49.237705+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:40:59.611995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":64,"reported_epoch":69,"state":"active+undersized","last_fresh":"2024-04-19T03:03:34.760124+0000","last_change":"2024-04-19T03:02:24.266012+0000","last_active":"2024-04-19T03:03:34.760124+0000","last_peered":"2024-04-19T03:03:34.760124+0000","last_clean":"2024-04-19T03:02:21.249385+0000","last_became_active":"2024-04-19T03:02:24.266012+0000","last_became_peered":"2024-04-19T03:02:24.266012+0000","last_unstale":"2024-04-19T03:03:34.760124+0000","last_undegraded":"2024-04-19T03:03:34.760124+0000","last_fullsized":"2024-04-19T03:02:24.254885+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:45:01.989501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"20'2","reported_seq":70,"reported_epoch":71,"state":"peering","last_fresh":"2024-04-19T03:04:49.244520+0000","last_change":"2024-04-19T03:04:49.244724+0000","last_active":"2024-04-19T03:04:49.244520+0000","last_peered":"2024-04-19T03:04:48.227587+0000","last_clean":"2024-04-19T03:02:21.239584+0000","last_became_active":"2024-04-19T03:02:24.265759+0000","last_became_peered":"2024-04-19T03:02:24.265759+0000","last_unstale":"2024-04-19T03:04:49.244520+0000","last_undegraded":"2024-04-19T03:04:49.244520+0000","last_fullsized":"2024-04-19T03:04:49.244520+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:35:18.996445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":64,"reported_epoch":69,"state":"active+undersized","last_fresh":"2024-04-19T03:03:34.762013+0000","last_change":"2024-04-19T03:02:24.263260+0000","last_active":"2024-04-19T03:03:34.762013+0000","last_peered":"2024-04-19T03:03:34.762013+0000","last_clean":"2024-04-19T03:02:21.249052+0000","last_became_active":"2024-04-19T03:02:24.263260+0000","last_became_peered":"2024-04-19T03:02:24.263260+0000","last_unstale":"2024-04-19T03:03:34.762013+0000","last_undegraded":"2024-04-19T03:03:34.762013+0000","last_fullsized":"2024-04-19T03:02:24.255863+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:25:50.459325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":35,"reported_epoch":69,"state":"active+undersized","last_fresh":"2024-04-19T03:03:35.094755+0000","last_change":"2024-04-19T03:02:24.269416+0000","last_active":"2024-04-19T03:03:35.094755+0000","last_peered":"2024-04-19T03:03:35.094755+0000","last_clean":"2024-04-19T03:01:13.604133+0000","last_became_active":"2024-04-19T03:02:24.269416+0000","last_became_peered":"2024-04-19T03:02:24.269416+0000","last_unstale":"2024-04-19T03:03:35.094755+0000","last_undegraded":"2024-04-19T03:03:35.094755+0000","last_fullsized":"2024-04-19T03:02:24.260076+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:13:11.249358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":33,"reported_epoch":68,"state":"active+undersized","last_fresh":"2024-04-19T03:03:34.574916+0000","last_change":"2024-04-19T03:02:24.271368+0000","last_active":"2024-04-19T03:03:34.574916+0000","last_peered":"2024-04-19T03:03:34.574916+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"2024-04-19T03:02:24.271368+0000","last_became_peered":"2024-04-19T03:02:24.271368+0000","last_unstale":"2024-04-19T03:03:34.574916+0000","last_undegraded":"2024-04-19T03:03:34.574916+0000","last_fullsized":"2024-04-19T03:02:24.258025+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:46:12.377589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":62,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-19T03:04:49.101742+0000","last_change":"2024-04-19T03:01:14.649074+0000","last_active":"2024-04-19T03:04:49.101742+0000","last_peered":"2024-04-19T03:04:49.101742+0000","last_clean":"2024-04-19T03:04:49.101742+0000","last_became_active":"2024-04-19T03:01:14.648217+0000","last_became_peered":"2024-04-19T03:01:14.648217+0000","last_unstale":"2024-04-19T03:04:49.101742+0000","last_undegraded":"2024-04-19T03:04:49.101742+0000","last_fullsized":"2024-04-19T03:04:49.101742+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:57:05.238043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":33,"reported_epoch":68,"state":"active+undersized","last_fresh":"2024-04-19T03:03:34.575765+0000","last_change":"2024-04-19T03:02:24.272925+0000","last_active":"2024-04-19T03:03:34.575765+0000","last_peered":"2024-04-19T03:03:34.575765+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"2024-04-19T03:02:24.272925+0000","last_became_peered":"2024-04-19T03:02:24.272925+0000","last_unstale":"2024-04-19T03:03:34.575765+0000","last_undegraded":"2024-04-19T03:03:34.575765+0000","last_fullsized":"2024-04-19T03:02:24.260913+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:33:59.041888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.10","version":"20'8","reported_seq":70,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-19T03:04:48.225294+0000","last_change":"2024-04-19T03:01:14.649044+0000","last_active":"2024-04-19T03:04:48.225294+0000","last_peered":"2024-04-19T03:04:48.225294+0000","last_clean":"2024-04-19T03:04:48.225294+0000","last_became_active":"2024-04-19T03:01:14.648859+0000","last_became_peered":"2024-04-19T03:01:14.648859+0000","last_unstale":"2024-04-19T03:04:48.225294+0000","last_undegraded":"2024-04-19T03:04:48.225294+0000","last_fullsized":"2024-04-19T03:04:48.225294+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:30:45.925657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"20'1","reported_seq":63,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-19T03:04:48.226855+0000","last_change":"2024-04-19T03:01:14.649839+0000","last_active":"2024-04-19T03:04:48.226855+0000","last_peered":"2024-04-19T03:04:48.226855+0000","last_clean":"2024-04-19T03:04:48.226855+0000","last_became_active":"2024-04-19T03:01:14.649571+0000","last_became_peered":"2024-04-19T03:01:14.649571+0000","last_unstale":"2024-04-19T03:04:48.226855+0000","last_undegraded":"2024-04-19T03:04:48.226855+0000","last_fullsized":"2024-04-19T03:04:48.226855+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:03:57.839660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":34,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-19T03:04:49.242898+0000","last_change":"2024-04-19T03:02:40.438407+0000","last_active":"2024-04-19T03:04:49.242898+0000","last_peered":"2024-04-19T03:04:49.242898+0000","last_clean":"2024-04-19T03:04:49.242898+0000","last_became_active":"2024-04-19T03:02:40.437605+0000","last_became_peered":"2024-04-19T03:02:40.437605+0000","last_unstale":"2024-04-19T03:04:49.242898+0000","last_undegraded":"2024-04-19T03:04:49.242898+0000","last_fullsized":"2024-04-19T03:04:49.242898+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:00:03.630606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"20'2","reported_seq":64,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-19T03:04:49.105047+0000","last_change":"2024-04-19T03:01:14.645075+0000","last_active":"2024-04-19T03:04:49.105047+0000","last_peered":"2024-04-19T03:04:49.105047+0000","last_clean":"2024-04-19T03:04:49.105047+0000","last_became_active":"2024-04-19T03:01:14.644790+0000","last_became_peered":"2024-04-19T03:01:14.644790+0000","last_unstale":"2024-04-19T03:04:49.105047+0000","last_undegraded":"2024-04-19T03:04:49.105047+0000","last_fullsized":"2024-04-19T03:04:49.105047+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:55:15.035769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":64,"reported_epoch":68,"state":"active+undersized","last_fresh":"2024-04-19T03:03:33.739784+0000","last_change":"2024-04-19T03:02:24.262120+0000","last_active":"2024-04-19T03:03:33.739784+0000","last_peered":"2024-04-19T03:03:33.739784+0000","last_clean":"2024-04-19T03:02:21.248368+0000","last_became_active":"2024-04-19T03:02:24.262120+0000","last_became_peered":"2024-04-19T03:02:24.262120+0000","last_unstale":"2024-04-19T03:03:33.739784+0000","last_undegraded":"2024-04-19T03:03:33.739784+0000","last_fullsized":"2024-04-19T03:02:24.251780+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:09:48.754662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"20'1","reported_seq":52,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-19T03:04:49.102940+0000","last_change":"2024-04-19T03:02:15.207891+0000","last_active":"2024-04-19T03:04:49.102940+0000","last_peered":"2024-04-19T03:04:49.102940+0000","last_clean":"2024-04-19T03:04:49.102940+0000","last_became_active":"2024-04-19T03:02:15.207334+0000","last_became_peered":"2024-04-19T03:02:15.207334+0000","last_unstale":"2024-04-19T03:04:49.102940+0000","last_undegraded":"2024-04-19T03:04:49.102940+0000","last_fullsized":"2024-04-19T03:04:49.102940+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:29:49.714544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":67,"reported_epoch":71,"state":"peering","last_fresh":"2024-04-19T03:04:49.239135+0000","last_change":"2024-04-19T03:04:49.239520+0000","last_active":"2024-04-19T03:04:49.239135+0000","last_peered":"2024-04-19T03:04:48.225308+0000","last_clean":"2024-04-19T03:02:21.238896+0000","last_became_active":"2024-04-19T03:02:24.269285+0000","last_became_peered":"2024-04-19T03:02:24.269285+0000","last_unstale":"2024-04-19T03:04:49.239135+0000","last_undegraded":"2024-04-19T03:04:49.239135+0000","last_fullsized":"2024-04-19T03:04:49.239135+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:07:53.363452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":60,"reported_epoch":68,"state":"active+undersized","last_fresh":"2024-04-19T03:03:34.575435+0000","last_change":"2024-04-19T03:02:24.283528+0000","last_active":"2024-04-19T03:03:34.575435+0000","last_peered":"2024-04-19T03:03:34.575435+0000","last_clean":"2024-04-19T03:01:13.604133+0000","last_became_active":"2024-04-19T03:02:24.283528+0000","last_became_peered":"2024-04-19T03:02:24.283528+0000","last_unstale":"2024-04-19T03:03:34.575435+0000","last_undegraded":"2024-04-19T03:03:34.575435+0000","last_fullsized":"2024-04-19T03:02:24.265369+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:44:57.689246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":34,"reported_epoch":69,"state":"active+undersized","last_fresh":"2024-04-19T03:03:35.094733+0000","last_change":"2024-04-19T03:02:24.262486+0000","last_active":"2024-04-19T03:03:35.094733+0000","last_peered":"2024-04-19T03:03:35.094733+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"2024-04-19T03:02:24.262486+0000","last_became_peered":"2024-04-19T03:02:24.262486+0000","last_unstale":"2024-04-19T03:03:35.094733+0000","last_undegraded":"2024-04-19T03:03:35.094733+0000","last_fullsized":"2024-04-19T03:02:24.255034+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:10:59.997012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"20'2","reported_seq":43,"reported_epoch":69,"state":"active+undersized+degraded","last_fresh":"2024-04-19T03:03:35.095113+0000","last_change":"2024-04-19T03:02:24.265344+0000","last_active":"2024-04-19T03:03:35.095113+0000","last_peered":"2024-04-19T03:03:35.095113+0000","last_clean":"2024-04-19T03:01:15.001696+0000","last_became_active":"2024-04-19T03:02:24.265344+0000","last_became_peered":"2024-04-19T03:02:24.265344+0000","last_unstale":"2024-04-19T03:03:35.095113+0000","last_undegraded":"2024-04-19T03:02:24.257245+0000","last_fullsized":"2024-04-19T03:02:24.257097+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:10:25.561421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":1}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":67,"reported_epoch":71,"state":"peering","last_fresh":"2024-04-19T03:04:49.243232+0000","last_change":"2024-04-19T03:04:49.243391+0000","last_active":"2024-04-19T03:04:49.243232+0000","last_peered":"2024-04-19T03:04:48.227369+0000","last_clean":"2024-04-19T03:02:21.239001+0000","last_became_active":"2024-04-19T03:02:24.280840+0000","last_became_peered":"2024-04-19T03:02:24.280840+0000","last_unstale":"2024-04-19T03:04:49.243232+0000","last_undegraded":"2024-04-19T03:04:49.243232+0000","last_fullsized":"2024-04-19T03:04:49.243232+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:59:09.311702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":68,"reported_epoch":71,"state":"peering","last_fresh":"2024-04-19T03:04:49.244941+0000","last_change":"2024-04-19T03:04:49.245119+0000","last_active":"2024-04-19T03:04:49.244941+0000","last_peered":"2024-04-19T03:04:48.226445+0000","last_clean":"2024-04-19T03:02:21.239091+0000","last_became_active":"2024-04-19T03:02:24.269896+0000","last_became_peered":"2024-04-19T03:02:24.269896+0000","last_unstale":"2024-04-19T03:04:49.244941+0000","last_undegraded":"2024-04-19T03:04:49.244941+0000","last_fullsized":"2024-04-19T03:04:49.244941+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:59:28.203935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":61,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-19T03:04:48.227116+0000","last_change":"2024-04-19T03:01:15.015685+0000","last_active":"2024-04-19T03:04:48.227116+0000","last_peered":"2024-04-19T03:04:48.227116+0000","last_clean":"2024-04-19T03:04:48.227116+0000","last_became_active":"2024-04-19T03:01:15.014847+0000","last_became_peered":"2024-04-19T03:01:15.014847+0000","last_unstale":"2024-04-19T03:04:48.227116+0000","last_undegraded":"2024-04-19T03:04:48.227116+0000","last_fullsized":"2024-04-19T03:04:48.227116+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:51:06.208551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":33,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-19T03:04:49.247469+0000","last_change":"2024-04-19T03:02:40.440434+0000","last_active":"2024-04-19T03:04:49.247469+0000","last_peered":"2024-04-19T03:04:49.247469+0000","last_clean":"2024-04-19T03:04:49.247469+0000","last_became_active":"2024-04-19T03:02:40.439924+0000","last_became_peered":"2024-04-19T03:02:40.439924+0000","last_unstale":"2024-04-19T03:04:49.247469+0000","last_undegraded":"2024-04-19T03:04:49.247469+0000","last_fullsized":"2024-04-19T03:04:49.247469+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:33:16.864267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":61,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-19T03:04:48.226013+0000","last_change":"2024-04-19T03:01:15.014818+0000","last_active":"2024-04-19T03:04:48.226013+0000","last_peered":"2024-04-19T03:04:48.226013+0000","last_clean":"2024-04-19T03:04:48.226013+0000","last_became_active":"2024-04-19T03:01:15.014421+0000","last_became_peered":"2024-04-19T03:01:15.014421+0000","last_unstale":"2024-04-19T03:04:48.226013+0000","last_undegraded":"2024-04-19T03:04:48.226013+0000","last_fullsized":"2024-04-19T03:04:48.226013+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:16:20.475837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":65,"reported_epoch":68,"state":"active+undersized","last_fresh":"2024-04-19T03:03:33.739378+0000","last_change":"2024-04-19T03:02:24.270374+0000","last_active":"2024-04-19T03:03:33.739378+0000","last_peered":"2024-04-19T03:03:33.739378+0000","last_clean":"2024-04-19T03:02:21.248442+0000","last_became_active":"2024-04-19T03:02:24.270374+0000","last_became_peered":"2024-04-19T03:02:24.270374+0000","last_unstale":"2024-04-19T03:03:33.739378+0000","last_undegraded":"2024-04-19T03:03:33.739378+0000","last_fullsized":"2024-04-19T03:02:24.252696+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:36:04.345818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":34,"reported_epoch":69,"state":"active+undersized","last_fresh":"2024-04-19T03:03:34.760601+0000","last_change":"2024-04-19T03:02:24.263169+0000","last_active":"2024-04-19T03:03:34.760601+0000","last_peered":"2024-04-19T03:03:34.760601+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"2024-04-19T03:02:24.263169+0000","last_became_peered":"2024-04-19T03:02:24.263169+0000","last_unstale":"2024-04-19T03:03:34.760601+0000","last_undegraded":"2024-04-19T03:03:34.760601+0000","last_fullsized":"2024-04-19T03:02:24.256134+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:23:50.481462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"14'157","reported_seq":263,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-19T03:04:48.225736+0000","last_change":"2024-04-19T03:01:07.538434+0000","last_active":"2024-04-19T03:04:48.225736+0000","last_peered":"2024-04-19T03:04:48.225736+0000","last_clean":"2024-04-19T03:04:48.225736+0000","last_became_active":"2024-04-19T03:01:07.537856+0000","last_became_peered":"2024-04-19T03:01:07.537856+0000","last_unstale":"2024-04-19T03:04:48.225736+0000","last_undegraded":"2024-04-19T03:04:48.225736+0000","last_fullsized":"2024-04-19T03:04:48.225736+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:06.516863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:06.516863+0000","last_clean_scrub_stamp":"2024-04-19T03:01:06.516863+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:36:46.386286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":70,"reported_epoch":71,"state":"peering","last_fresh":"2024-04-19T03:04:49.246748+0000","last_change":"2024-04-19T03:04:49.246879+0000","last_active":"2024-04-19T03:04:49.246748+0000","last_peered":"2024-04-19T03:04:48.228146+0000","last_clean":"2024-04-19T03:02:21.239790+0000","last_became_active":"2024-04-19T03:02:24.268308+0000","last_became_peered":"2024-04-19T03:02:24.268308+0000","last_unstale":"2024-04-19T03:04:49.246748+0000","last_undegraded":"2024-04-19T03:04:49.246748+0000","last_fullsized":"2024-04-19T03:04:49.246748+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_clean_scrub_stamp":"2024-04-19T03:01:09.578660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:35:06.302425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":35,"reported_epoch":69,"state":"active+undersized","last_fresh":"2024-04-19T03:03:34.759125+0000","last_change":"2024-04-19T03:02:24.262992+0000","last_active":"2024-04-19T03:03:34.759125+0000","last_peered":"2024-04-19T03:03:34.759125+0000","last_clean":"2024-04-19T03:01:13.604133+0000","last_became_active":"2024-04-19T03:02:24.262992+0000","last_became_peered":"2024-04-19T03:02:24.262992+0000","last_unstale":"2024-04-19T03:03:34.759125+0000","last_undegraded":"2024-04-19T03:03:34.759125+0000","last_fullsized":"2024-04-19T03:02:24.252649+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:11:27.107247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":58,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-19T03:04:48.227313+0000","last_change":"2024-04-19T03:02:40.440550+0000","last_active":"2024-04-19T03:04:48.227313+0000","last_peered":"2024-04-19T03:04:48.227313+0000","last_clean":"2024-04-19T03:04:48.227313+0000","last_became_active":"2024-04-19T03:02:40.439621+0000","last_became_peered":"2024-04-19T03:02:40.439621+0000","last_unstale":"2024-04-19T03:04:48.227313+0000","last_undegraded":"2024-04-19T03:04:48.227313+0000","last_fullsized":"2024-04-19T03:04:48.227313+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:51:11.593632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":64,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-19T03:04:48.226674+0000","last_change":"2024-04-19T03:01:10.602194+0000","last_active":"2024-04-19T03:04:48.226674+0000","last_peered":"2024-04-19T03:04:48.226674+0000","last_clean":"2024-04-19T03:04:48.226674+0000","last_became_active":"2024-04-19T03:01:10.601381+0000","last_became_peered":"2024-04-19T03:01:10.601381+0000","last_unstale":"2024-04-19T03:04:48.226674+0000","last_undegraded":"2024-04-19T03:04:48.226674+0000","last_fullsized":"2024-04-19T03:04:48.226674+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_clean_scrub_stamp":"2024-04-19T03:01:09.578660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:42:26.594095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":35,"reported_epoch":69,"state":"active+undersized","last_fresh":"2024-04-19T03:03:35.094223+0000","last_change":"2024-04-19T03:02:24.269521+0000","last_active":"2024-04-19T03:03:35.094223+0000","last_peered":"2024-04-19T03:03:35.094223+0000","last_clean":"2024-04-19T03:01:13.604133+0000","last_became_active":"2024-04-19T03:02:24.269521+0000","last_became_peered":"2024-04-19T03:02:24.269521+0000","last_unstale":"2024-04-19T03:03:35.094223+0000","last_undegraded":"2024-04-19T03:03:35.094223+0000","last_fullsized":"2024-04-19T03:02:24.255992+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:14:18.946167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":64,"reported_epoch":68,"state":"active+undersized","last_fresh":"2024-04-19T03:03:33.741859+0000","last_change":"2024-04-19T03:02:24.268858+0000","last_active":"2024-04-19T03:03:33.741859+0000","last_peered":"2024-04-19T03:03:33.741859+0000","last_clean":"2024-04-19T03:02:21.249161+0000","last_became_active":"2024-04-19T03:02:24.268858+0000","last_became_peered":"2024-04-19T03:02:24.268858+0000","last_unstale":"2024-04-19T03:03:33.741859+0000","last_undegraded":"2024-04-19T03:03:33.741859+0000","last_fullsized":"2024-04-19T03:02:24.257061+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:42:00.465007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":34,"reported_epoch":69,"state":"active+undersized","last_fresh":"2024-04-19T03:03:34.759535+0000","last_change":"2024-04-19T03:02:24.262857+0000","last_active":"2024-04-19T03:03:34.759535+0000","last_peered":"2024-04-19T03:03:34.759535+0000","last_clean":"2024-04-19T03:01:09.578660+0000","last_became_active":"2024-04-19T03:02:24.262857+0000","last_became_peered":"2024-04-19T03:02:24.262857+0000","last_unstale":"2024-04-19T03:03:34.759535+0000","last_undegraded":"2024-04-19T03:03:34.759535+0000","last_fullsized":"2024-04-19T03:02:24.253233+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_clean_scrub_stamp":"2024-04-19T03:01:09.578660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:00:41.456639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":62,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-19T03:04:49.102435+0000","last_change":"2024-04-19T03:01:14.649068+0000","last_active":"2024-04-19T03:04:49.102435+0000","last_peered":"2024-04-19T03:04:49.102435+0000","last_clean":"2024-04-19T03:04:49.102435+0000","last_became_active":"2024-04-19T03:01:14.648082+0000","last_became_peered":"2024-04-19T03:01:14.648082+0000","last_unstale":"2024-04-19T03:04:49.102435+0000","last_undegraded":"2024-04-19T03:04:49.102435+0000","last_fullsized":"2024-04-19T03:04:49.102435+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:30:14.489117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":34,"reported_epoch":69,"state":"active+undersized","last_fresh":"2024-04-19T03:03:34.760620+0000","last_change":"2024-04-19T03:02:24.263823+0000","last_active":"2024-04-19T03:03:34.760620+0000","last_peered":"2024-04-19T03:03:34.760620+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"2024-04-19T03:02:24.263823+0000","last_became_peered":"2024-04-19T03:02:24.263823+0000","last_unstale":"2024-04-19T03:03:34.760620+0000","last_undegraded":"2024-04-19T03:03:34.760620+0000","last_fullsized":"2024-04-19T03:02:24.256773+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:13:12.261144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":70,"reported_epoch":71,"state":"peering","last_fresh":"2024-04-19T03:04:49.239248+0000","last_change":"2024-04-19T03:04:49.240780+0000","last_active":"2024-04-19T03:04:49.239248+0000","last_peered":"2024-04-19T03:04:48.226330+0000","last_clean":"2024-04-19T03:02:21.239177+0000","last_became_active":"2024-04-19T03:02:24.269783+0000","last_became_peered":"2024-04-19T03:02:24.269783+0000","last_unstale":"2024-04-19T03:04:49.239248+0000","last_undegraded":"2024-04-19T03:04:49.239248+0000","last_fullsized":"2024-04-19T03:04:49.239248+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_clean_scrub_stamp":"2024-04-19T03:01:09.578660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:50:22.833281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":68,"reported_epoch":71,"state":"peering","last_fresh":"2024-04-19T03:04:49.235047+0000","last_change":"2024-04-19T03:04:49.235470+0000","last_active":"2024-04-19T03:04:49.235047+0000","last_peered":"2024-04-19T03:04:48.228156+0000","last_clean":"2024-04-19T03:02:21.239666+0000","last_became_active":"2024-04-19T03:02:24.274962+0000","last_became_peered":"2024-04-19T03:02:24.274962+0000","last_unstale":"2024-04-19T03:04:49.235047+0000","last_undegraded":"2024-04-19T03:04:49.235047+0000","last_fullsized":"2024-04-19T03:04:49.235047+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:30:28.402079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":34,"reported_epoch":69,"state":"active+undersized","last_fresh":"2024-04-19T03:03:34.759233+0000","last_change":"2024-04-19T03:02:24.260888+0000","last_active":"2024-04-19T03:03:34.759233+0000","last_peered":"2024-04-19T03:03:34.759233+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"2024-04-19T03:02:24.260888+0000","last_became_peered":"2024-04-19T03:02:24.260888+0000","last_unstale":"2024-04-19T03:03:34.759233+0000","last_undegraded":"2024-04-19T03:03:34.759233+0000","last_fullsized":"2024-04-19T03:02:24.253375+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:24:49.913495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":60,"reported_epoch":68,"state":"active+undersized","last_fresh":"2024-04-19T03:03:34.575792+0000","last_change":"2024-04-19T03:02:24.273760+0000","last_active":"2024-04-19T03:03:34.575792+0000","last_peered":"2024-04-19T03:03:34.575792+0000","last_clean":"2024-04-19T03:01:13.604133+0000","last_became_active":"2024-04-19T03:02:24.273760+0000","last_became_peered":"2024-04-19T03:02:24.273760+0000","last_unstale":"2024-04-19T03:03:34.575792+0000","last_undegraded":"2024-04-19T03:03:34.575792+0000","last_fullsized":"2024-04-19T03:02:24.263483+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:29:38.352671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":34,"reported_epoch":69,"state":"active+undersized","last_fresh":"2024-04-19T03:03:34.760642+0000","last_change":"2024-04-19T03:02:24.266049+0000","last_active":"2024-04-19T03:03:34.760642+0000","last_peered":"2024-04-19T03:03:34.760642+0000","last_clean":"2024-04-19T03:01:09.578660+0000","last_became_active":"2024-04-19T03:02:24.266049+0000","last_became_peered":"2024-04-19T03:02:24.266049+0000","last_unstale":"2024-04-19T03:03:34.760642+0000","last_undegraded":"2024-04-19T03:03:34.760642+0000","last_fullsized":"2024-04-19T03:02:24.256038+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_clean_scrub_stamp":"2024-04-19T03:01:09.578660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:45:26.469448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":34,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-19T03:04:48.224637+0000","last_change":"2024-04-19T03:02:40.440057+0000","last_active":"2024-04-19T03:04:48.224637+0000","last_peered":"2024-04-19T03:04:48.224637+0000","last_clean":"2024-04-19T03:04:48.224637+0000","last_became_active":"2024-04-19T03:02:40.439752+0000","last_became_peered":"2024-04-19T03:02:40.439752+0000","last_unstale":"2024-04-19T03:04:48.224637+0000","last_undegraded":"2024-04-19T03:04:48.224637+0000","last_fullsized":"2024-04-19T03:04:48.224637+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:38:12.336658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":35,"reported_epoch":69,"state":"active+undersized","last_fresh":"2024-04-19T03:03:34.759788+0000","last_change":"2024-04-19T03:02:24.264727+0000","last_active":"2024-04-19T03:03:34.759788+0000","last_peered":"2024-04-19T03:03:34.759788+0000","last_clean":"2024-04-19T03:01:13.604133+0000","last_became_active":"2024-04-19T03:02:24.264727+0000","last_became_peered":"2024-04-19T03:02:24.264727+0000","last_unstale":"2024-04-19T03:03:34.759788+0000","last_undegraded":"2024-04-19T03:03:34.759788+0000","last_fullsized":"2024-04-19T03:02:24.253765+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:20:27.536142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":68,"reported_epoch":68,"state":"active+undersized","last_fresh":"2024-04-19T03:03:33.741524+0000","last_change":"2024-04-19T03:02:24.263894+0000","last_active":"2024-04-19T03:03:33.741524+0000","last_peered":"2024-04-19T03:03:33.741524+0000","last_clean":"2024-04-19T03:02:21.249599+0000","last_became_active":"2024-04-19T03:02:24.263894+0000","last_became_peered":"2024-04-19T03:02:24.263894+0000","last_unstale":"2024-04-19T03:03:33.741524+0000","last_undegraded":"2024-04-19T03:03:33.741524+0000","last_fullsized":"2024-04-19T03:02:24.256329+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_clean_scrub_stamp":"2024-04-19T03:01:09.578660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:14:49.692877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":34,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-19T03:04:48.226383+0000","last_change":"2024-04-19T03:02:40.440227+0000","last_active":"2024-04-19T03:04:48.226383+0000","last_peered":"2024-04-19T03:04:48.226383+0000","last_clean":"2024-04-19T03:04:48.226383+0000","last_became_active":"2024-04-19T03:02:40.439732+0000","last_became_peered":"2024-04-19T03:02:40.439732+0000","last_unstale":"2024-04-19T03:04:48.226383+0000","last_undegraded":"2024-04-19T03:04:48.226383+0000","last_fullsized":"2024-04-19T03:04:48.226383+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:29:33.660584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"20'2","reported_seq":43,"reported_epoch":69,"state":"active+undersized+degraded","last_fresh":"2024-04-19T03:03:34.761972+0000","last_change":"2024-04-19T03:02:24.265036+0000","last_active":"2024-04-19T03:03:34.761972+0000","last_peered":"2024-04-19T03:03:34.761972+0000","last_clean":"2024-04-19T03:01:15.007165+0000","last_became_active":"2024-04-19T03:02:24.265036+0000","last_became_peered":"2024-04-19T03:02:24.265036+0000","last_unstale":"2024-04-19T03:03:34.761972+0000","last_undegraded":"2024-04-19T03:02:24.258940+0000","last_fullsized":"2024-04-19T03:02:24.258736+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:36:29.647530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[{"shards":"1","objects":1}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":34,"reported_epoch":69,"state":"active+undersized","last_fresh":"2024-04-19T03:03:34.761865+0000","last_change":"2024-04-19T03:02:24.269833+0000","last_active":"2024-04-19T03:03:34.761865+0000","last_peered":"2024-04-19T03:03:34.761865+0000","last_clean":"2024-04-19T03:01:09.578660+0000","last_became_active":"2024-04-19T03:02:24.269833+0000","last_became_peered":"2024-04-19T03:02:24.269833+0000","last_unstale":"2024-04-19T03:03:34.761865+0000","last_undegraded":"2024-04-19T03:03:34.761865+0000","last_fullsized":"2024-04-19T03:02:24.262484+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_clean_scrub_stamp":"2024-04-19T03:01:09.578660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:14:33.574026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":34,"reported_epoch":69,"state":"active+undersized","last_fresh":"2024-04-19T03:03:35.093455+0000","last_change":"2024-04-19T03:02:24.257489+0000","last_active":"2024-04-19T03:03:35.093455+0000","last_peered":"2024-04-19T03:03:35.093455+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"2024-04-19T03:02:24.257489+0000","last_became_peered":"2024-04-19T03:02:24.257489+0000","last_unstale":"2024-04-19T03:03:35.093455+0000","last_undegraded":"2024-04-19T03:03:35.093455+0000","last_fullsized":"2024-04-19T03:02:24.254429+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:52:53.321136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"21'1","reported_seq":44,"reported_epoch":69,"state":"active+undersized+degraded","last_fresh":"2024-04-19T03:03:35.095906+0000","last_change":"2024-04-19T03:02:24.270935+0000","last_active":"2024-04-19T03:03:35.095906+0000","last_peered":"2024-04-19T03:03:35.095906+0000","last_clean":"2024-04-19T03:01:18.093734+0000","last_became_active":"2024-04-19T03:02:24.270935+0000","last_became_peered":"2024-04-19T03:02:24.270935+0000","last_unstale":"2024-04-19T03:03:35.095906+0000","last_undegraded":"2024-04-19T03:02:24.258098+0000","last_fullsized":"2024-04-19T03:02:24.257944+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:57:49.614725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":1}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":64,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-19T03:04:48.226551+0000","last_change":"2024-04-19T03:01:10.602274+0000","last_active":"2024-04-19T03:04:48.226551+0000","last_peered":"2024-04-19T03:04:48.226551+0000","last_clean":"2024-04-19T03:04:48.226551+0000","last_became_active":"2024-04-19T03:01:10.601487+0000","last_became_peered":"2024-04-19T03:01:10.601487+0000","last_unstale":"2024-04-19T03:04:48.226551+0000","last_undegraded":"2024-04-19T03:04:48.226551+0000","last_fullsized":"2024-04-19T03:04:48.226551+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_clean_scrub_stamp":"2024-04-19T03:01:09.578660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:26:16.712446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":61,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-19T03:04:49.101512+0000","last_change":"2024-04-19T03:01:15.018914+0000","last_active":"2024-04-19T03:04:49.101512+0000","last_peered":"2024-04-19T03:04:49.101512+0000","last_clean":"2024-04-19T03:04:49.101512+0000","last_became_active":"2024-04-19T03:01:15.018276+0000","last_became_peered":"2024-04-19T03:01:15.018276+0000","last_unstale":"2024-04-19T03:04:49.101512+0000","last_undegraded":"2024-04-19T03:04:49.101512+0000","last_fullsized":"2024-04-19T03:04:49.101512+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:40:59.453079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":61,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-19T03:04:48.225925+0000","last_change":"2024-04-19T03:01:15.015855+0000","last_active":"2024-04-19T03:04:48.225925+0000","last_peered":"2024-04-19T03:04:48.225925+0000","last_clean":"2024-04-19T03:04:48.225925+0000","last_became_active":"2024-04-19T03:01:15.015358+0000","last_became_peered":"2024-04-19T03:01:15.015358+0000","last_unstale":"2024-04-19T03:04:48.225925+0000","last_undegraded":"2024-04-19T03:04:48.225925+0000","last_fullsized":"2024-04-19T03:04:48.225925+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:59:49.270245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"20'6","reported_seq":68,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-19T03:04:48.227686+0000","last_change":"2024-04-19T03:01:14.649577+0000","last_active":"2024-04-19T03:04:48.227686+0000","last_peered":"2024-04-19T03:04:48.227686+0000","last_clean":"2024-04-19T03:04:48.227686+0000","last_became_active":"2024-04-19T03:01:14.649284+0000","last_became_peered":"2024-04-19T03:01:14.649284+0000","last_unstale":"2024-04-19T03:04:48.227686+0000","last_undegraded":"2024-04-19T03:04:48.227686+0000","last_fullsized":"2024-04-19T03:04:48.227686+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:01:22.214742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":34,"reported_epoch":69,"state":"active+undersized","last_fresh":"2024-04-19T03:03:34.758941+0000","last_change":"2024-04-19T03:02:24.262641+0000","last_active":"2024-04-19T03:03:34.758941+0000","last_peered":"2024-04-19T03:03:34.758941+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"2024-04-19T03:02:24.262641+0000","last_became_peered":"2024-04-19T03:02:24.262641+0000","last_unstale":"2024-04-19T03:03:34.758941+0000","last_undegraded":"2024-04-19T03:03:34.758941+0000","last_fullsized":"2024-04-19T03:02:24.251764+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:45:46.332608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"20'3","reported_seq":41,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-19T03:04:48.227379+0000","last_change":"2024-04-19T03:02:40.442253+0000","last_active":"2024-04-19T03:04:48.227379+0000","last_peered":"2024-04-19T03:04:48.227379+0000","last_clean":"2024-04-19T03:04:48.227379+0000","last_became_active":"2024-04-19T03:02:40.441225+0000","last_became_peered":"2024-04-19T03:02:40.441225+0000","last_unstale":"2024-04-19T03:04:48.227379+0000","last_undegraded":"2024-04-19T03:04:48.227379+0000","last_fullsized":"2024-04-19T03:04:48.227379+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:51:10.208584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":60,"reported_epoch":69,"state":"active+undersized","last_fresh":"2024-04-19T03:03:35.098550+0000","last_change":"2024-04-19T03:02:24.271840+0000","last_active":"2024-04-19T03:03:35.098550+0000","last_peered":"2024-04-19T03:03:35.098550+0000","last_clean":"2024-04-19T03:01:13.604133+0000","last_became_active":"2024-04-19T03:02:24.271840+0000","last_became_peered":"2024-04-19T03:02:24.271840+0000","last_unstale":"2024-04-19T03:03:35.098550+0000","last_undegraded":"2024-04-19T03:03:35.098550+0000","last_fullsized":"2024-04-19T03:02:24.263970+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:00:42.349089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":34,"reported_epoch":69,"state":"active+undersized","last_fresh":"2024-04-19T03:03:35.093733+0000","last_change":"2024-04-19T03:02:24.269277+0000","last_active":"2024-04-19T03:03:35.093733+0000","last_peered":"2024-04-19T03:03:35.093733+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"2024-04-19T03:02:24.269277+0000","last_became_peered":"2024-04-19T03:02:24.269277+0000","last_unstale":"2024-04-19T03:03:35.093733+0000","last_undegraded":"2024-04-19T03:03:35.093733+0000","last_fullsized":"2024-04-19T03:02:24.255461+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:25:57.346322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":34,"reported_epoch":68,"state":"active+undersized","last_fresh":"2024-04-19T03:03:34.576483+0000","last_change":"2024-04-19T03:02:24.276976+0000","last_active":"2024-04-19T03:03:34.576483+0000","last_peered":"2024-04-19T03:03:34.576483+0000","last_clean":"2024-04-19T03:01:13.604133+0000","last_became_active":"2024-04-19T03:02:24.276976+0000","last_became_peered":"2024-04-19T03:02:24.276976+0000","last_unstale":"2024-04-19T03:03:34.576483+0000","last_undegraded":"2024-04-19T03:03:34.576483+0000","last_fullsized":"2024-04-19T03:02:24.263866+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:44:03.338466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":34,"reported_epoch":69,"state":"active+undersized","last_fresh":"2024-04-19T03:03:34.758311+0000","last_change":"2024-04-19T03:02:24.254790+0000","last_active":"2024-04-19T03:03:34.758311+0000","last_peered":"2024-04-19T03:03:34.758311+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"2024-04-19T03:02:24.254790+0000","last_became_peered":"2024-04-19T03:02:24.254790+0000","last_unstale":"2024-04-19T03:03:34.758311+0000","last_undegraded":"2024-04-19T03:03:34.758311+0000","last_fullsized":"2024-04-19T03:02:24.251249+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:02:39.751984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":34,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-19T03:04:48.226019+0000","last_change":"2024-04-19T03:02:40.442421+0000","last_active":"2024-04-19T03:04:48.226019+0000","last_peered":"2024-04-19T03:04:48.226019+0000","last_clean":"2024-04-19T03:04:48.226019+0000","last_became_active":"2024-04-19T03:02:40.441746+0000","last_became_peered":"2024-04-19T03:02:40.441746+0000","last_unstale":"2024-04-19T03:04:48.226019+0000","last_undegraded":"2024-04-19T03:04:48.226019+0000","last_fullsized":"2024-04-19T03:04:48.226019+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:52:55.719264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":34,"reported_epoch":68,"state":"active+undersized","last_fresh":"2024-04-19T03:03:33.739852+0000","last_change":"2024-04-19T03:02:24.265626+0000","last_active":"2024-04-19T03:03:33.739852+0000","last_peered":"2024-04-19T03:03:33.739852+0000","last_clean":"2024-04-19T03:01:13.604133+0000","last_became_active":"2024-04-19T03:02:24.265626+0000","last_became_peered":"2024-04-19T03:02:24.265626+0000","last_unstale":"2024-04-19T03:03:33.739852+0000","last_undegraded":"2024-04-19T03:03:33.739852+0000","last_fullsized":"2024-04-19T03:02:24.253251+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:31:25.309764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":34,"reported_epoch":69,"state":"active+undersized","last_fresh":"2024-04-19T03:03:35.096107+0000","last_change":"2024-04-19T03:02:24.271602+0000","last_active":"2024-04-19T03:03:35.096107+0000","last_peered":"2024-04-19T03:03:35.096107+0000","last_clean":"2024-04-19T03:01:14.615919+0000","last_became_active":"2024-04-19T03:02:24.271602+0000","last_became_peered":"2024-04-19T03:02:24.271602+0000","last_unstale":"2024-04-19T03:03:35.096107+0000","last_undegraded":"2024-04-19T03:03:35.096107+0000","last_fullsized":"2024-04-19T03:02:24.262475+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:01:44.111884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":34,"reported_epoch":68,"state":"active+undersized","last_fresh":"2024-04-19T03:03:34.572342+0000","last_change":"2024-04-19T03:02:24.271293+0000","last_active":"2024-04-19T03:03:34.572342+0000","last_peered":"2024-04-19T03:03:34.572342+0000","last_clean":"2024-04-19T03:01:13.604133+0000","last_became_active":"2024-04-19T03:02:24.271293+0000","last_became_peered":"2024-04-19T03:02:24.271293+0000","last_unstale":"2024-04-19T03:03:34.572342+0000","last_undegraded":"2024-04-19T03:03:34.572342+0000","last_fullsized":"2024-04-19T03:02:24.255695+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:08:42.859745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":33,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-19T03:04:48.225301+0000","last_change":"2024-04-19T03:02:40.441670+0000","last_active":"2024-04-19T03:04:48.225301+0000","last_peered":"2024-04-19T03:04:48.225301+0000","last_clean":"2024-04-19T03:04:48.225301+0000","last_became_active":"2024-04-19T03:02:40.441294+0000","last_became_peered":"2024-04-19T03:02:40.441294+0000","last_unstale":"2024-04-19T03:04:48.225301+0000","last_undegraded":"2024-04-19T03:04:48.225301+0000","last_fullsized":"2024-04-19T03:04:48.225301+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:59:32.330785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"20'1","reported_seq":66,"reported_epoch":69,"state":"active+undersized","last_fresh":"2024-04-19T03:03:34.759755+0000","last_change":"2024-04-19T03:02:24.263516+0000","last_active":"2024-04-19T03:03:34.759755+0000","last_peered":"2024-04-19T03:03:34.759755+0000","last_clean":"2024-04-19T03:02:21.248830+0000","last_became_active":"2024-04-19T03:02:24.263516+0000","last_became_peered":"2024-04-19T03:02:24.263516+0000","last_unstale":"2024-04-19T03:03:34.759755+0000","last_undegraded":"2024-04-19T03:03:34.759755+0000","last_fullsized":"2024-04-19T03:02:24.253942+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:21:08.378544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":64,"reported_epoch":69,"state":"active+undersized","last_fresh":"2024-04-19T03:03:34.760400+0000","last_change":"2024-04-19T03:02:24.265728+0000","last_active":"2024-04-19T03:03:34.760400+0000","last_peered":"2024-04-19T03:03:34.760400+0000","last_clean":"2024-04-19T03:02:21.249322+0000","last_became_active":"2024-04-19T03:02:24.265728+0000","last_became_peered":"2024-04-19T03:02:24.265728+0000","last_unstale":"2024-04-19T03:03:34.760400+0000","last_undegraded":"2024-04-19T03:03:34.760400+0000","last_fullsized":"2024-04-19T03:02:24.254256+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:18:31.651631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"20'1","reported_seq":74,"reported_epoch":69,"state":"active+undersized","last_fresh":"2024-04-19T03:03:34.761888+0000","last_change":"2024-04-19T03:02:24.266095+0000","last_active":"2024-04-19T03:03:34.761888+0000","last_peered":"2024-04-19T03:03:34.761888+0000","last_clean":"2024-04-19T03:02:21.249288+0000","last_became_active":"2024-04-19T03:02:24.266095+0000","last_became_peered":"2024-04-19T03:02:24.266095+0000","last_unstale":"2024-04-19T03:03:34.761888+0000","last_undegraded":"2024-04-19T03:03:34.761888+0000","last_fullsized":"2024-04-19T03:02:24.254088+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:02:11.243382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":67,"reported_epoch":71,"state":"peering","last_fresh":"2024-04-19T03:04:49.238423+0000","last_change":"2024-04-19T03:04:49.238858+0000","last_active":"2024-04-19T03:04:49.238423+0000","last_peered":"2024-04-19T03:04:48.225599+0000","last_clean":"2024-04-19T03:02:21.239100+0000","last_became_active":"2024-04-19T03:02:24.264906+0000","last_became_peered":"2024-04-19T03:02:24.264906+0000","last_unstale":"2024-04-19T03:04:49.238423+0000","last_undegraded":"2024-04-19T03:04:49.238423+0000","last_fullsized":"2024-04-19T03:04:49.238423+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:25:23.823410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"20'2","reported_seq":70,"reported_epoch":71,"state":"peering","last_fresh":"2024-04-19T03:04:49.244022+0000","last_change":"2024-04-19T03:04:49.244445+0000","last_active":"2024-04-19T03:04:49.244022+0000","last_peered":"2024-04-19T03:04:48.228171+0000","last_clean":"2024-04-19T03:02:21.239137+0000","last_became_active":"2024-04-19T03:02:24.283173+0000","last_became_peered":"2024-04-19T03:02:24.283173+0000","last_unstale":"2024-04-19T03:04:49.244022+0000","last_undegraded":"2024-04-19T03:04:49.244022+0000","last_fullsized":"2024-04-19T03:04:49.244022+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:48:15.865979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":67,"reported_epoch":71,"state":"peering","last_fresh":"2024-04-19T03:04:49.243751+0000","last_change":"2024-04-19T03:04:49.244452+0000","last_active":"2024-04-19T03:04:49.243751+0000","last_peered":"2024-04-19T03:04:48.225979+0000","last_clean":"2024-04-19T03:02:21.238991+0000","last_became_active":"2024-04-19T03:02:24.269672+0000","last_became_peered":"2024-04-19T03:02:24.269672+0000","last_unstale":"2024-04-19T03:04:49.243751+0000","last_undegraded":"2024-04-19T03:04:49.243751+0000","last_fullsized":"2024-04-19T03:04:49.243751+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:09:41.580252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"20'2","reported_seq":41,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-19T03:04:48.227071+0000","last_change":"2024-04-19T03:02:40.441689+0000","last_active":"2024-04-19T03:04:48.227071+0000","last_peered":"2024-04-19T03:04:48.227071+0000","last_clean":"2024-04-19T03:04:48.227071+0000","last_became_active":"2024-04-19T03:02:40.440206+0000","last_became_peered":"2024-04-19T03:02:40.440206+0000","last_unstale":"2024-04-19T03:04:48.227071+0000","last_undegraded":"2024-04-19T03:04:48.227071+0000","last_fullsized":"2024-04-19T03:04:48.227071+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:02:19.100804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":64,"reported_epoch":69,"state":"active+undersized","last_fresh":"2024-04-19T03:03:34.759439+0000","last_change":"2024-04-19T03:02:24.263202+0000","last_active":"2024-04-19T03:03:34.759439+0000","last_peered":"2024-04-19T03:03:34.759439+0000","last_clean":"2024-04-19T03:02:21.248674+0000","last_became_active":"2024-04-19T03:02:24.263202+0000","last_became_peered":"2024-04-19T03:02:24.263202+0000","last_unstale":"2024-04-19T03:03:34.759439+0000","last_undegraded":"2024-04-19T03:03:34.759439+0000","last_fullsized":"2024-04-19T03:02:24.252560+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:05:00.071308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"20'1","reported_seq":35,"reported_epoch":69,"state":"active+undersized","last_fresh":"2024-04-19T03:03:34.760417+0000","last_change":"2024-04-19T03:02:24.269410+0000","last_active":"2024-04-19T03:03:34.760417+0000","last_peered":"2024-04-19T03:03:34.760417+0000","last_clean":"2024-04-19T03:01:13.604133+0000","last_became_active":"2024-04-19T03:02:24.269410+0000","last_became_peered":"2024-04-19T03:02:24.269410+0000","last_unstale":"2024-04-19T03:03:34.760417+0000","last_undegraded":"2024-04-19T03:03:34.760417+0000","last_fullsized":"2024-04-19T03:02:24.257278+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:01:43.100098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":67,"reported_epoch":71,"state":"peering","last_fresh":"2024-04-19T03:04:49.238503+0000","last_change":"2024-04-19T03:04:49.238881+0000","last_active":"2024-04-19T03:04:49.238503+0000","last_peered":"2024-04-19T03:04:48.225407+0000","last_clean":"2024-04-19T03:02:21.238692+0000","last_became_active":"2024-04-19T03:02:24.264787+0000","last_became_peered":"2024-04-19T03:02:24.264787+0000","last_unstale":"2024-04-19T03:04:49.238503+0000","last_undegraded":"2024-04-19T03:04:49.238503+0000","last_fullsized":"2024-04-19T03:04:49.238503+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:45:33.989924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"20'4","reported_seq":43,"reported_epoch":69,"state":"active+undersized+degraded","last_fresh":"2024-04-19T03:03:35.098438+0000","last_change":"2024-04-19T03:02:24.276744+0000","last_active":"2024-04-19T03:03:35.098438+0000","last_peered":"2024-04-19T03:03:35.098438+0000","last_clean":"2024-04-19T03:01:15.006951+0000","last_became_active":"2024-04-19T03:02:24.276744+0000","last_became_peered":"2024-04-19T03:02:24.276744+0000","last_unstale":"2024-04-19T03:03:35.098438+0000","last_undegraded":"2024-04-19T03:02:24.263785+0000","last_fullsized":"2024-04-19T03:02:24.263676+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:27:16.968519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2],"acting":[2],"avail_no_missing":["2"],"object_location_counts":[{"shards":"2","objects":2}],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":95,"acting":95,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":5,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5289,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":46,"acting":46,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":12,"acting":12,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":14482,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":10,"seq":42949673011,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":220636,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":219774,"kb_avail":94151204,"statfs":{"total":96636764160,"available":96410832896,"internally_reserved":0,"allocated":864256,"data_stored":887137,"data_compressed":7241,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":225049030},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 19 03:02:08 2024","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":2.1379999999999999},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"last":0.33100000000000002}]},{"osd":1,"last update":"Fri Apr 19 03:04:11 2024","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.19900000000000001,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.87,"5min":2.5030000000000001,"15min":2.5030000000000001},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.57099999999999995,"15min":0.56299999999999994},"min":{"1min":0.23999999999999999,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.90400000000000003,"5min":2.6379999999999999,"15min":2.6379999999999999},"last":0.59099999999999997}]}]},{"osd":1,"up_from":10,"seq":42949673010,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":202584,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":201726,"kb_avail":94169256,"statfs":{"total":96636764160,"available":96429318144,"internally_reserved":0,"allocated":860160,"data_stored":888684,"data_compressed":7241,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":206567878},"hb_peers":[2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 19 03:02:04 2024","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.216},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":2.2349999999999999}]},{"osd":2,"last update":"Fri Apr 19 03:04:07 2024","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.47899999999999998,"15min":0.501},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":0.79400000000000004,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.623},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.48499999999999999,"15min":0.51400000000000001},"min":{"1min":0.26100000000000001,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.83899999999999997,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.68899999999999995}]}]},{"osd":0,"up_from":0,"seq":1,"num_pgs":86,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":326744,"kb_used_data":283984,"kb_used_omap":6,"kb_used_meta":42745,"kb_avail":94045096,"statfs":{"total":96636764160,"available":96302178304,"internally_reserved":0,"allocated":290799616,"data_stored":4645810470,"data_compressed":8901299,"data_compressed_allocated":290353152,"data_compressed_original":4645650432,"omap_allocated":6883,"internal_metadata":43771165},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":7241,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":7241,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5289,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-19T03:04:55.636 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-19T03:04:55.956 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-19T03:04:55.958 INFO:teuthology.orchestra.run.smithi096.stderr:dumped all 2024-04-19T03:04:55.969 INFO:teuthology.orchestra.run.smithi096.stdout:{"pg_ready":true,"pg_map":{"version":184,"stamp":"2024-04-19T03:04:54.043220+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":470868,"kb_used_data":2468,"kb_used_omap":9,"kb_used_meta":468342,"kb_avail":282644652,"statfs":{"total":289910292480,"available":289428123648,"internally_reserved":0,"allocated":2527232,"data_stored":2081553,"data_compressed":14482,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":10071,"internal_metadata":479582377},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-8,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.821910"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":15,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-19T03:04:51.605216+0000","last_change":"2024-04-19T03:04:50.612508+0000","last_active":"2024-04-19T03:04:51.605216+0000","last_peered":"2024-04-19T03:04:51.605216+0000","last_clean":"2024-04-19T03:04:51.605216+0000","last_became_active":"2024-04-19T03:04:50.612040+0000","last_became_peered":"2024-04-19T03:04:50.612040+0000","last_unstale":"2024-04-19T03:04:51.605216+0000","last_undegraded":"2024-04-19T03:04:51.605216+0000","last_fullsized":"2024-04-19T03:04:51.605216+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:18:02.587927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":67,"reported_epoch":71,"state":"peering","last_fresh":"2024-04-19T03:04:49.228465+0000","last_change":"2024-04-19T03:04:49.229512+0000","last_active":"2024-04-19T03:04:49.228465+0000","last_peered":"2024-04-19T03:04:49.103074+0000","last_clean":"2024-04-19T03:02:21.248866+0000","last_became_active":"2024-04-19T03:02:24.268239+0000","last_became_peered":"2024-04-19T03:02:24.268239+0000","last_unstale":"2024-04-19T03:04:49.228465+0000","last_undegraded":"2024-04-19T03:04:49.228465+0000","last_fullsized":"2024-04-19T03:04:49.228465+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:33:34.879955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":61,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-19T03:04:48.225576+0000","last_change":"2024-04-19T03:01:15.015884+0000","last_active":"2024-04-19T03:04:48.225576+0000","last_peered":"2024-04-19T03:04:48.225576+0000","last_clean":"2024-04-19T03:04:48.225576+0000","last_became_active":"2024-04-19T03:01:15.014599+0000","last_became_peered":"2024-04-19T03:01:15.014599+0000","last_unstale":"2024-04-19T03:04:48.225576+0000","last_undegraded":"2024-04-19T03:04:48.225576+0000","last_fullsized":"2024-04-19T03:04:48.225576+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:35:19.436344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":67,"reported_epoch":71,"state":"peering","last_fresh":"2024-04-19T03:04:49.236427+0000","last_change":"2024-04-19T03:04:49.236807+0000","last_active":"2024-04-19T03:04:49.236427+0000","last_peered":"2024-04-19T03:04:48.226533+0000","last_clean":"2024-04-19T03:02:21.239010+0000","last_became_active":"2024-04-19T03:02:24.283312+0000","last_became_peered":"2024-04-19T03:02:24.283312+0000","last_unstale":"2024-04-19T03:04:49.236427+0000","last_undegraded":"2024-04-19T03:04:49.236427+0000","last_fullsized":"2024-04-19T03:04:49.236427+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:31:31.190200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":15,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-19T03:04:51.604382+0000","last_change":"2024-04-19T03:04:50.626581+0000","last_active":"2024-04-19T03:04:51.604382+0000","last_peered":"2024-04-19T03:04:51.604382+0000","last_clean":"2024-04-19T03:04:51.604382+0000","last_became_active":"2024-04-19T03:04:50.618669+0000","last_became_peered":"2024-04-19T03:04:50.618669+0000","last_unstale":"2024-04-19T03:04:51.604382+0000","last_undegraded":"2024-04-19T03:04:51.604382+0000","last_fullsized":"2024-04-19T03:04:51.604382+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:27:58.006985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":24,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-19T03:04:50.638678+0000","last_change":"2024-04-19T03:04:50.628582+0000","last_active":"2024-04-19T03:04:50.638678+0000","last_peered":"2024-04-19T03:04:50.638678+0000","last_clean":"2024-04-19T03:04:50.638678+0000","last_became_active":"2024-04-19T03:04:50.627684+0000","last_became_peered":"2024-04-19T03:04:50.627684+0000","last_unstale":"2024-04-19T03:04:50.638678+0000","last_undegraded":"2024-04-19T03:04:50.638678+0000","last_fullsized":"2024-04-19T03:04:50.638678+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:10:23.005064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":24,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-19T03:04:50.639395+0000","last_change":"2024-04-19T03:04:50.635434+0000","last_active":"2024-04-19T03:04:50.639395+0000","last_peered":"2024-04-19T03:04:50.639395+0000","last_clean":"2024-04-19T03:04:50.639395+0000","last_became_active":"2024-04-19T03:04:50.633594+0000","last_became_peered":"2024-04-19T03:04:50.633594+0000","last_unstale":"2024-04-19T03:04:50.639395+0000","last_undegraded":"2024-04-19T03:04:50.639395+0000","last_fullsized":"2024-04-19T03:04:50.639395+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:18:54.877499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":67,"reported_epoch":71,"state":"peering","last_fresh":"2024-04-19T03:04:49.244438+0000","last_change":"2024-04-19T03:04:49.244616+0000","last_active":"2024-04-19T03:04:49.244438+0000","last_peered":"2024-04-19T03:04:48.224532+0000","last_clean":"2024-04-19T03:02:21.238411+0000","last_became_active":"2024-04-19T03:02:24.261119+0000","last_became_peered":"2024-04-19T03:02:24.261119+0000","last_unstale":"2024-04-19T03:04:49.244438+0000","last_undegraded":"2024-04-19T03:04:49.244438+0000","last_fullsized":"2024-04-19T03:04:49.244438+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:57:01.109868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":21,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-19T03:04:50.626163+0000","last_change":"2024-04-19T03:04:50.611854+0000","last_active":"2024-04-19T03:04:50.626163+0000","last_peered":"2024-04-19T03:04:50.626163+0000","last_clean":"2024-04-19T03:04:50.626163+0000","last_became_active":"2024-04-19T03:04:50.611400+0000","last_became_peered":"2024-04-19T03:04:50.611400+0000","last_unstale":"2024-04-19T03:04:50.626163+0000","last_undegraded":"2024-04-19T03:04:50.626163+0000","last_fullsized":"2024-04-19T03:04:50.626163+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:33:58.731162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":67,"reported_epoch":71,"state":"peering","last_fresh":"2024-04-19T03:04:49.227330+0000","last_change":"2024-04-19T03:04:49.227670+0000","last_active":"2024-04-19T03:04:49.227330+0000","last_peered":"2024-04-19T03:04:49.103387+0000","last_clean":"2024-04-19T03:02:21.249077+0000","last_became_active":"2024-04-19T03:02:24.268562+0000","last_became_peered":"2024-04-19T03:02:24.268562+0000","last_unstale":"2024-04-19T03:04:49.227330+0000","last_undegraded":"2024-04-19T03:04:49.227330+0000","last_fullsized":"2024-04-19T03:04:49.227330+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:43:17.397637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":24,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-19T03:04:50.618809+0000","last_change":"2024-04-19T03:04:50.612405+0000","last_active":"2024-04-19T03:04:50.618809+0000","last_peered":"2024-04-19T03:04:50.618809+0000","last_clean":"2024-04-19T03:04:50.618809+0000","last_became_active":"2024-04-19T03:04:50.611103+0000","last_became_peered":"2024-04-19T03:04:50.611103+0000","last_unstale":"2024-04-19T03:04:50.618809+0000","last_undegraded":"2024-04-19T03:04:50.618809+0000","last_fullsized":"2024-04-19T03:04:50.618809+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:19:06.653369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":33,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-19T03:04:48.225620+0000","last_change":"2024-04-19T03:02:40.438738+0000","last_active":"2024-04-19T03:04:48.225620+0000","last_peered":"2024-04-19T03:04:48.225620+0000","last_clean":"2024-04-19T03:04:48.225620+0000","last_became_active":"2024-04-19T03:02:40.438000+0000","last_became_peered":"2024-04-19T03:02:40.438000+0000","last_unstale":"2024-04-19T03:04:48.225620+0000","last_undegraded":"2024-04-19T03:04:48.225620+0000","last_fullsized":"2024-04-19T03:04:48.225620+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:35:10.932021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":15,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-19T03:04:51.604818+0000","last_change":"2024-04-19T03:04:50.628927+0000","last_active":"2024-04-19T03:04:51.604818+0000","last_peered":"2024-04-19T03:04:51.604818+0000","last_clean":"2024-04-19T03:04:51.604818+0000","last_became_active":"2024-04-19T03:04:50.626854+0000","last_became_peered":"2024-04-19T03:04:50.626854+0000","last_unstale":"2024-04-19T03:04:51.604818+0000","last_undegraded":"2024-04-19T03:04:51.604818+0000","last_fullsized":"2024-04-19T03:04:51.604818+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:41:04.929370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":61,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-19T03:04:48.225063+0000","last_change":"2024-04-19T03:01:15.010960+0000","last_active":"2024-04-19T03:04:48.225063+0000","last_peered":"2024-04-19T03:04:48.225063+0000","last_clean":"2024-04-19T03:04:48.225063+0000","last_became_active":"2024-04-19T03:01:15.010472+0000","last_became_peered":"2024-04-19T03:01:15.010472+0000","last_unstale":"2024-04-19T03:04:48.225063+0000","last_undegraded":"2024-04-19T03:04:48.225063+0000","last_fullsized":"2024-04-19T03:04:48.225063+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:21:36.129346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":61,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-19T03:04:48.226314+0000","last_change":"2024-04-19T03:01:15.014574+0000","last_active":"2024-04-19T03:04:48.226314+0000","last_peered":"2024-04-19T03:04:48.226314+0000","last_clean":"2024-04-19T03:04:48.226314+0000","last_became_active":"2024-04-19T03:01:15.014096+0000","last_became_peered":"2024-04-19T03:01:15.014096+0000","last_unstale":"2024-04-19T03:04:48.226314+0000","last_undegraded":"2024-04-19T03:04:48.226314+0000","last_fullsized":"2024-04-19T03:04:48.226314+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:01:54.253963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":24,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-19T03:04:50.629821+0000","last_change":"2024-04-19T03:04:50.615462+0000","last_active":"2024-04-19T03:04:50.629821+0000","last_peered":"2024-04-19T03:04:50.629821+0000","last_clean":"2024-04-19T03:04:50.629821+0000","last_became_active":"2024-04-19T03:04:50.612853+0000","last_became_peered":"2024-04-19T03:04:50.612853+0000","last_unstale":"2024-04-19T03:04:50.629821+0000","last_undegraded":"2024-04-19T03:04:50.629821+0000","last_fullsized":"2024-04-19T03:04:50.629821+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:47:30.389938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":21,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-19T03:04:50.626128+0000","last_change":"2024-04-19T03:04:50.611757+0000","last_active":"2024-04-19T03:04:50.626128+0000","last_peered":"2024-04-19T03:04:50.626128+0000","last_clean":"2024-04-19T03:04:50.626128+0000","last_became_active":"2024-04-19T03:04:50.611392+0000","last_became_peered":"2024-04-19T03:04:50.611392+0000","last_unstale":"2024-04-19T03:04:50.626128+0000","last_undegraded":"2024-04-19T03:04:50.626128+0000","last_fullsized":"2024-04-19T03:04:50.626128+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:51:50.768612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":15,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-19T03:04:51.605414+0000","last_change":"2024-04-19T03:04:50.629165+0000","last_active":"2024-04-19T03:04:51.605414+0000","last_peered":"2024-04-19T03:04:51.605414+0000","last_clean":"2024-04-19T03:04:51.605414+0000","last_became_active":"2024-04-19T03:04:50.628394+0000","last_became_peered":"2024-04-19T03:04:50.628394+0000","last_unstale":"2024-04-19T03:04:51.605414+0000","last_undegraded":"2024-04-19T03:04:51.605414+0000","last_fullsized":"2024-04-19T03:04:51.605414+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:17:06.173248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":21,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-19T03:04:50.618909+0000","last_change":"2024-04-19T03:04:50.613858+0000","last_active":"2024-04-19T03:04:50.618909+0000","last_peered":"2024-04-19T03:04:50.618909+0000","last_clean":"2024-04-19T03:04:50.618909+0000","last_became_active":"2024-04-19T03:04:50.613481+0000","last_became_peered":"2024-04-19T03:04:50.613481+0000","last_unstale":"2024-04-19T03:04:50.618909+0000","last_undegraded":"2024-04-19T03:04:50.618909+0000","last_fullsized":"2024-04-19T03:04:50.618909+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:55:45.686937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":67,"reported_epoch":71,"state":"peering","last_fresh":"2024-04-19T03:04:49.238473+0000","last_change":"2024-04-19T03:04:49.238833+0000","last_active":"2024-04-19T03:04:49.238473+0000","last_peered":"2024-04-19T03:04:48.226117+0000","last_clean":"2024-04-19T03:02:21.238883+0000","last_became_active":"2024-04-19T03:02:24.280097+0000","last_became_peered":"2024-04-19T03:02:24.280097+0000","last_unstale":"2024-04-19T03:04:49.238473+0000","last_undegraded":"2024-04-19T03:04:49.238473+0000","last_fullsized":"2024-04-19T03:04:49.238473+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:18:02.311663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":67,"reported_epoch":71,"state":"peering","last_fresh":"2024-04-19T03:04:49.243380+0000","last_change":"2024-04-19T03:04:49.243554+0000","last_active":"2024-04-19T03:04:49.243380+0000","last_peered":"2024-04-19T03:04:48.227227+0000","last_clean":"2024-04-19T03:02:21.239350+0000","last_became_active":"2024-04-19T03:02:24.265606+0000","last_became_peered":"2024-04-19T03:02:24.265606+0000","last_unstale":"2024-04-19T03:04:49.243380+0000","last_undegraded":"2024-04-19T03:04:49.243380+0000","last_fullsized":"2024-04-19T03:04:49.243380+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:26:01.458051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":61,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-19T03:04:49.101571+0000","last_change":"2024-04-19T03:01:15.020108+0000","last_active":"2024-04-19T03:04:49.101571+0000","last_peered":"2024-04-19T03:04:49.101571+0000","last_clean":"2024-04-19T03:04:49.101571+0000","last_became_active":"2024-04-19T03:01:15.018978+0000","last_became_peered":"2024-04-19T03:01:15.018978+0000","last_unstale":"2024-04-19T03:04:49.101571+0000","last_undegraded":"2024-04-19T03:04:49.101571+0000","last_fullsized":"2024-04-19T03:04:49.101571+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:30:22.360053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":21,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-19T03:04:50.637968+0000","last_change":"2024-04-19T03:04:50.633855+0000","last_active":"2024-04-19T03:04:50.637968+0000","last_peered":"2024-04-19T03:04:50.637968+0000","last_clean":"2024-04-19T03:04:50.637968+0000","last_became_active":"2024-04-19T03:04:50.630948+0000","last_became_peered":"2024-04-19T03:04:50.630948+0000","last_unstale":"2024-04-19T03:04:50.637968+0000","last_undegraded":"2024-04-19T03:04:50.637968+0000","last_fullsized":"2024-04-19T03:04:50.637968+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:41:31.676439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":15,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-19T03:04:51.604438+0000","last_change":"2024-04-19T03:04:50.617131+0000","last_active":"2024-04-19T03:04:51.604438+0000","last_peered":"2024-04-19T03:04:51.604438+0000","last_clean":"2024-04-19T03:04:51.604438+0000","last_became_active":"2024-04-19T03:04:50.616716+0000","last_became_peered":"2024-04-19T03:04:50.616716+0000","last_unstale":"2024-04-19T03:04:51.604438+0000","last_undegraded":"2024-04-19T03:04:51.604438+0000","last_fullsized":"2024-04-19T03:04:51.604438+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:25:16.749292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":34,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-19T03:04:49.241504+0000","last_change":"2024-04-19T03:02:40.441681+0000","last_active":"2024-04-19T03:04:49.241504+0000","last_peered":"2024-04-19T03:04:49.241504+0000","last_clean":"2024-04-19T03:04:49.241504+0000","last_became_active":"2024-04-19T03:02:40.441170+0000","last_became_peered":"2024-04-19T03:02:40.441170+0000","last_unstale":"2024-04-19T03:04:49.241504+0000","last_undegraded":"2024-04-19T03:04:49.241504+0000","last_fullsized":"2024-04-19T03:04:49.241504+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:43:25.396638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":21,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-19T03:04:50.634948+0000","last_change":"2024-04-19T03:04:50.626923+0000","last_active":"2024-04-19T03:04:50.634948+0000","last_peered":"2024-04-19T03:04:50.634948+0000","last_clean":"2024-04-19T03:04:50.634948+0000","last_became_active":"2024-04-19T03:04:50.617603+0000","last_became_peered":"2024-04-19T03:04:50.617603+0000","last_unstale":"2024-04-19T03:04:50.634948+0000","last_undegraded":"2024-04-19T03:04:50.634948+0000","last_fullsized":"2024-04-19T03:04:50.634948+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:26:56.826024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":44,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-19T03:04:49.103486+0000","last_change":"2024-04-19T03:02:15.206453+0000","last_active":"2024-04-19T03:04:49.103486+0000","last_peered":"2024-04-19T03:04:49.103486+0000","last_clean":"2024-04-19T03:04:49.103486+0000","last_became_active":"2024-04-19T03:02:15.205905+0000","last_became_peered":"2024-04-19T03:02:15.205905+0000","last_unstale":"2024-04-19T03:04:49.103486+0000","last_undegraded":"2024-04-19T03:04:49.103486+0000","last_fullsized":"2024-04-19T03:04:49.103486+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:48:06.646477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":61,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-19T03:04:49.103482+0000","last_change":"2024-04-19T03:01:15.020098+0000","last_active":"2024-04-19T03:04:49.103482+0000","last_peered":"2024-04-19T03:04:49.103482+0000","last_clean":"2024-04-19T03:04:49.103482+0000","last_became_active":"2024-04-19T03:01:15.019064+0000","last_became_peered":"2024-04-19T03:01:15.019064+0000","last_unstale":"2024-04-19T03:04:49.103482+0000","last_undegraded":"2024-04-19T03:04:49.103482+0000","last_fullsized":"2024-04-19T03:04:49.103482+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:50:06.490191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":21,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-19T03:04:50.626095+0000","last_change":"2024-04-19T03:04:50.616823+0000","last_active":"2024-04-19T03:04:50.626095+0000","last_peered":"2024-04-19T03:04:50.626095+0000","last_clean":"2024-04-19T03:04:50.626095+0000","last_became_active":"2024-04-19T03:04:50.616550+0000","last_became_peered":"2024-04-19T03:04:50.616550+0000","last_unstale":"2024-04-19T03:04:50.626095+0000","last_undegraded":"2024-04-19T03:04:50.626095+0000","last_fullsized":"2024-04-19T03:04:50.626095+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:46:25.096677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":34,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-19T03:04:48.224820+0000","last_change":"2024-04-19T03:02:40.440907+0000","last_active":"2024-04-19T03:04:48.224820+0000","last_peered":"2024-04-19T03:04:48.224820+0000","last_clean":"2024-04-19T03:04:48.224820+0000","last_became_active":"2024-04-19T03:02:40.440351+0000","last_became_peered":"2024-04-19T03:02:40.440351+0000","last_unstale":"2024-04-19T03:04:48.224820+0000","last_undegraded":"2024-04-19T03:04:48.224820+0000","last_fullsized":"2024-04-19T03:04:48.224820+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:36:36.558329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":21,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-19T03:04:50.639360+0000","last_change":"2024-04-19T03:04:50.635141+0000","last_active":"2024-04-19T03:04:50.639360+0000","last_peered":"2024-04-19T03:04:50.639360+0000","last_clean":"2024-04-19T03:04:50.639360+0000","last_became_active":"2024-04-19T03:04:50.633033+0000","last_became_peered":"2024-04-19T03:04:50.633033+0000","last_unstale":"2024-04-19T03:04:50.639360+0000","last_undegraded":"2024-04-19T03:04:50.639360+0000","last_fullsized":"2024-04-19T03:04:50.639360+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:42:01.712749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":67,"reported_epoch":71,"state":"peering","last_fresh":"2024-04-19T03:04:49.237705+0000","last_change":"2024-04-19T03:04:49.238125+0000","last_active":"2024-04-19T03:04:49.237705+0000","last_peered":"2024-04-19T03:04:48.225027+0000","last_clean":"2024-04-19T03:02:21.238487+0000","last_became_active":"2024-04-19T03:02:24.265187+0000","last_became_peered":"2024-04-19T03:02:24.265187+0000","last_unstale":"2024-04-19T03:04:49.237705+0000","last_undegraded":"2024-04-19T03:04:49.237705+0000","last_fullsized":"2024-04-19T03:04:49.237705+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:40:59.611995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":15,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-19T03:04:51.604834+0000","last_change":"2024-04-19T03:04:50.617533+0000","last_active":"2024-04-19T03:04:51.604834+0000","last_peered":"2024-04-19T03:04:51.604834+0000","last_clean":"2024-04-19T03:04:51.604834+0000","last_became_active":"2024-04-19T03:04:50.617272+0000","last_became_peered":"2024-04-19T03:04:50.617272+0000","last_unstale":"2024-04-19T03:04:51.604834+0000","last_undegraded":"2024-04-19T03:04:51.604834+0000","last_fullsized":"2024-04-19T03:04:51.604834+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:11:32.650035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"20'2","reported_seq":70,"reported_epoch":71,"state":"peering","last_fresh":"2024-04-19T03:04:49.244520+0000","last_change":"2024-04-19T03:04:49.244724+0000","last_active":"2024-04-19T03:04:49.244520+0000","last_peered":"2024-04-19T03:04:48.227587+0000","last_clean":"2024-04-19T03:02:21.239584+0000","last_became_active":"2024-04-19T03:02:24.265759+0000","last_became_peered":"2024-04-19T03:02:24.265759+0000","last_unstale":"2024-04-19T03:04:49.244520+0000","last_undegraded":"2024-04-19T03:04:49.244520+0000","last_fullsized":"2024-04-19T03:04:49.244520+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:35:18.996445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":15,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-19T03:04:51.604153+0000","last_change":"2024-04-19T03:04:50.612555+0000","last_active":"2024-04-19T03:04:51.604153+0000","last_peered":"2024-04-19T03:04:51.604153+0000","last_clean":"2024-04-19T03:04:51.604153+0000","last_became_active":"2024-04-19T03:04:50.611785+0000","last_became_peered":"2024-04-19T03:04:50.611785+0000","last_unstale":"2024-04-19T03:04:51.604153+0000","last_undegraded":"2024-04-19T03:04:51.604153+0000","last_fullsized":"2024-04-19T03:04:51.604153+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:07:27.548013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":22,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-19T03:04:50.638732+0000","last_change":"2024-04-19T03:04:50.628801+0000","last_active":"2024-04-19T03:04:50.638732+0000","last_peered":"2024-04-19T03:04:50.638732+0000","last_clean":"2024-04-19T03:04:50.638732+0000","last_became_active":"2024-04-19T03:04:50.628023+0000","last_became_peered":"2024-04-19T03:04:50.628023+0000","last_unstale":"2024-04-19T03:04:50.638732+0000","last_undegraded":"2024-04-19T03:04:50.638732+0000","last_fullsized":"2024-04-19T03:04:50.638732+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:52:41.731698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":21,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-19T03:04:50.628261+0000","last_change":"2024-04-19T03:04:50.616471+0000","last_active":"2024-04-19T03:04:50.628261+0000","last_peered":"2024-04-19T03:04:50.628261+0000","last_clean":"2024-04-19T03:04:50.628261+0000","last_became_active":"2024-04-19T03:04:50.613860+0000","last_became_peered":"2024-04-19T03:04:50.613860+0000","last_unstale":"2024-04-19T03:04:50.628261+0000","last_undegraded":"2024-04-19T03:04:50.628261+0000","last_fullsized":"2024-04-19T03:04:50.628261+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:26:24.246287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":62,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-19T03:04:49.101742+0000","last_change":"2024-04-19T03:01:14.649074+0000","last_active":"2024-04-19T03:04:49.101742+0000","last_peered":"2024-04-19T03:04:49.101742+0000","last_clean":"2024-04-19T03:04:49.101742+0000","last_became_active":"2024-04-19T03:01:14.648217+0000","last_became_peered":"2024-04-19T03:01:14.648217+0000","last_unstale":"2024-04-19T03:04:49.101742+0000","last_undegraded":"2024-04-19T03:04:49.101742+0000","last_fullsized":"2024-04-19T03:04:49.101742+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:57:05.238043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":21,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-19T03:04:50.626078+0000","last_change":"2024-04-19T03:04:50.611026+0000","last_active":"2024-04-19T03:04:50.626078+0000","last_peered":"2024-04-19T03:04:50.626078+0000","last_clean":"2024-04-19T03:04:50.626078+0000","last_became_active":"2024-04-19T03:04:50.610659+0000","last_became_peered":"2024-04-19T03:04:50.610659+0000","last_unstale":"2024-04-19T03:04:50.626078+0000","last_undegraded":"2024-04-19T03:04:50.626078+0000","last_fullsized":"2024-04-19T03:04:50.626078+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:57:17.231684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"20'8","reported_seq":70,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-19T03:04:48.225294+0000","last_change":"2024-04-19T03:01:14.649044+0000","last_active":"2024-04-19T03:04:48.225294+0000","last_peered":"2024-04-19T03:04:48.225294+0000","last_clean":"2024-04-19T03:04:48.225294+0000","last_became_active":"2024-04-19T03:01:14.648859+0000","last_became_peered":"2024-04-19T03:01:14.648859+0000","last_unstale":"2024-04-19T03:04:48.225294+0000","last_undegraded":"2024-04-19T03:04:48.225294+0000","last_fullsized":"2024-04-19T03:04:48.225294+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:30:45.925657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"20'1","reported_seq":63,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-19T03:04:48.226855+0000","last_change":"2024-04-19T03:01:14.649839+0000","last_active":"2024-04-19T03:04:48.226855+0000","last_peered":"2024-04-19T03:04:48.226855+0000","last_clean":"2024-04-19T03:04:48.226855+0000","last_became_active":"2024-04-19T03:01:14.649571+0000","last_became_peered":"2024-04-19T03:01:14.649571+0000","last_unstale":"2024-04-19T03:04:48.226855+0000","last_undegraded":"2024-04-19T03:04:48.226855+0000","last_fullsized":"2024-04-19T03:04:48.226855+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:03:57.839660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":34,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-19T03:04:49.242898+0000","last_change":"2024-04-19T03:02:40.438407+0000","last_active":"2024-04-19T03:04:49.242898+0000","last_peered":"2024-04-19T03:04:49.242898+0000","last_clean":"2024-04-19T03:04:49.242898+0000","last_became_active":"2024-04-19T03:02:40.437605+0000","last_became_peered":"2024-04-19T03:02:40.437605+0000","last_unstale":"2024-04-19T03:04:49.242898+0000","last_undegraded":"2024-04-19T03:04:49.242898+0000","last_fullsized":"2024-04-19T03:04:49.242898+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:00:03.630606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"20'2","reported_seq":64,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-19T03:04:49.105047+0000","last_change":"2024-04-19T03:01:14.645075+0000","last_active":"2024-04-19T03:04:49.105047+0000","last_peered":"2024-04-19T03:04:49.105047+0000","last_clean":"2024-04-19T03:04:49.105047+0000","last_became_active":"2024-04-19T03:01:14.644790+0000","last_became_peered":"2024-04-19T03:01:14.644790+0000","last_unstale":"2024-04-19T03:04:49.105047+0000","last_undegraded":"2024-04-19T03:04:49.105047+0000","last_fullsized":"2024-04-19T03:04:49.105047+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:55:15.035769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-19T03:04:51.603475+0000","last_change":"2024-04-19T03:04:50.634586+0000","last_active":"2024-04-19T03:04:51.603475+0000","last_peered":"2024-04-19T03:04:51.603475+0000","last_clean":"2024-04-19T03:04:51.603475+0000","last_became_active":"2024-04-19T03:04:50.632146+0000","last_became_peered":"2024-04-19T03:04:50.632146+0000","last_unstale":"2024-04-19T03:04:51.603475+0000","last_undegraded":"2024-04-19T03:04:51.603475+0000","last_fullsized":"2024-04-19T03:04:51.603475+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:02:24.584512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"20'1","reported_seq":52,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-19T03:04:49.102940+0000","last_change":"2024-04-19T03:02:15.207891+0000","last_active":"2024-04-19T03:04:49.102940+0000","last_peered":"2024-04-19T03:04:49.102940+0000","last_clean":"2024-04-19T03:04:49.102940+0000","last_became_active":"2024-04-19T03:02:15.207334+0000","last_became_peered":"2024-04-19T03:02:15.207334+0000","last_unstale":"2024-04-19T03:04:49.102940+0000","last_undegraded":"2024-04-19T03:04:49.102940+0000","last_fullsized":"2024-04-19T03:04:49.102940+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:29:49.714544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":67,"reported_epoch":71,"state":"peering","last_fresh":"2024-04-19T03:04:49.239135+0000","last_change":"2024-04-19T03:04:49.239520+0000","last_active":"2024-04-19T03:04:49.239135+0000","last_peered":"2024-04-19T03:04:48.225308+0000","last_clean":"2024-04-19T03:02:21.238896+0000","last_became_active":"2024-04-19T03:02:24.269285+0000","last_became_peered":"2024-04-19T03:02:24.269285+0000","last_unstale":"2024-04-19T03:04:49.239135+0000","last_undegraded":"2024-04-19T03:04:49.239135+0000","last_fullsized":"2024-04-19T03:04:49.239135+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:07:53.363452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":23,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-19T03:04:50.625963+0000","last_change":"2024-04-19T03:04:50.617209+0000","last_active":"2024-04-19T03:04:50.625963+0000","last_peered":"2024-04-19T03:04:50.625963+0000","last_clean":"2024-04-19T03:04:50.625963+0000","last_became_active":"2024-04-19T03:04:50.615518+0000","last_became_peered":"2024-04-19T03:04:50.615518+0000","last_unstale":"2024-04-19T03:04:50.625963+0000","last_undegraded":"2024-04-19T03:04:50.625963+0000","last_fullsized":"2024-04-19T03:04:50.625963+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:13:34.297697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":21,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-19T03:04:50.635317+0000","last_change":"2024-04-19T03:04:50.627120+0000","last_active":"2024-04-19T03:04:50.635317+0000","last_peered":"2024-04-19T03:04:50.635317+0000","last_clean":"2024-04-19T03:04:50.635317+0000","last_became_active":"2024-04-19T03:04:50.625919+0000","last_became_peered":"2024-04-19T03:04:50.625919+0000","last_unstale":"2024-04-19T03:04:50.635317+0000","last_undegraded":"2024-04-19T03:04:50.635317+0000","last_fullsized":"2024-04-19T03:04:50.635317+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:56:19.822304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"20'2","reported_seq":24,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-19T03:04:50.635340+0000","last_change":"2024-04-19T03:04:50.627277+0000","last_active":"2024-04-19T03:04:50.635340+0000","last_peered":"2024-04-19T03:04:50.635340+0000","last_clean":"2024-04-19T03:04:50.635340+0000","last_became_active":"2024-04-19T03:04:50.625931+0000","last_became_peered":"2024-04-19T03:04:50.625931+0000","last_unstale":"2024-04-19T03:04:50.635340+0000","last_undegraded":"2024-04-19T03:04:50.635340+0000","last_fullsized":"2024-04-19T03:04:50.635340+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:30:32.408349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":67,"reported_epoch":71,"state":"peering","last_fresh":"2024-04-19T03:04:49.243232+0000","last_change":"2024-04-19T03:04:49.243391+0000","last_active":"2024-04-19T03:04:49.243232+0000","last_peered":"2024-04-19T03:04:48.227369+0000","last_clean":"2024-04-19T03:02:21.239001+0000","last_became_active":"2024-04-19T03:02:24.280840+0000","last_became_peered":"2024-04-19T03:02:24.280840+0000","last_unstale":"2024-04-19T03:04:49.243232+0000","last_undegraded":"2024-04-19T03:04:49.243232+0000","last_fullsized":"2024-04-19T03:04:49.243232+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:59:09.311702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":68,"reported_epoch":71,"state":"peering","last_fresh":"2024-04-19T03:04:49.244941+0000","last_change":"2024-04-19T03:04:49.245119+0000","last_active":"2024-04-19T03:04:49.244941+0000","last_peered":"2024-04-19T03:04:48.226445+0000","last_clean":"2024-04-19T03:02:21.239091+0000","last_became_active":"2024-04-19T03:02:24.269896+0000","last_became_peered":"2024-04-19T03:02:24.269896+0000","last_unstale":"2024-04-19T03:04:49.244941+0000","last_undegraded":"2024-04-19T03:04:49.244941+0000","last_fullsized":"2024-04-19T03:04:49.244941+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:59:28.203935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":61,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-19T03:04:48.227116+0000","last_change":"2024-04-19T03:01:15.015685+0000","last_active":"2024-04-19T03:04:48.227116+0000","last_peered":"2024-04-19T03:04:48.227116+0000","last_clean":"2024-04-19T03:04:48.227116+0000","last_became_active":"2024-04-19T03:01:15.014847+0000","last_became_peered":"2024-04-19T03:01:15.014847+0000","last_unstale":"2024-04-19T03:04:48.227116+0000","last_undegraded":"2024-04-19T03:04:48.227116+0000","last_fullsized":"2024-04-19T03:04:48.227116+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:51:06.208551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":33,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-19T03:04:49.247469+0000","last_change":"2024-04-19T03:02:40.440434+0000","last_active":"2024-04-19T03:04:49.247469+0000","last_peered":"2024-04-19T03:04:49.247469+0000","last_clean":"2024-04-19T03:04:49.247469+0000","last_became_active":"2024-04-19T03:02:40.439924+0000","last_became_peered":"2024-04-19T03:02:40.439924+0000","last_unstale":"2024-04-19T03:04:49.247469+0000","last_undegraded":"2024-04-19T03:04:49.247469+0000","last_fullsized":"2024-04-19T03:04:49.247469+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:33:16.864267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":61,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-19T03:04:48.226013+0000","last_change":"2024-04-19T03:01:15.014818+0000","last_active":"2024-04-19T03:04:48.226013+0000","last_peered":"2024-04-19T03:04:48.226013+0000","last_clean":"2024-04-19T03:04:48.226013+0000","last_became_active":"2024-04-19T03:01:15.014421+0000","last_became_peered":"2024-04-19T03:01:15.014421+0000","last_unstale":"2024-04-19T03:04:48.226013+0000","last_undegraded":"2024-04-19T03:04:48.226013+0000","last_fullsized":"2024-04-19T03:04:48.226013+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:16:20.475837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-19T03:04:51.603521+0000","last_change":"2024-04-19T03:04:50.616513+0000","last_active":"2024-04-19T03:04:51.603521+0000","last_peered":"2024-04-19T03:04:51.603521+0000","last_clean":"2024-04-19T03:04:51.603521+0000","last_became_active":"2024-04-19T03:04:50.614604+0000","last_became_peered":"2024-04-19T03:04:50.614604+0000","last_unstale":"2024-04-19T03:04:51.603521+0000","last_undegraded":"2024-04-19T03:04:51.603521+0000","last_fullsized":"2024-04-19T03:04:51.603521+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:52:21.648858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":21,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-19T03:04:50.632059+0000","last_change":"2024-04-19T03:04:50.617641+0000","last_active":"2024-04-19T03:04:50.632059+0000","last_peered":"2024-04-19T03:04:50.632059+0000","last_clean":"2024-04-19T03:04:50.632059+0000","last_became_active":"2024-04-19T03:04:50.617323+0000","last_became_peered":"2024-04-19T03:04:50.617323+0000","last_unstale":"2024-04-19T03:04:50.632059+0000","last_undegraded":"2024-04-19T03:04:50.632059+0000","last_fullsized":"2024-04-19T03:04:50.632059+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:26:09.566534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"14'157","reported_seq":263,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-19T03:04:48.225736+0000","last_change":"2024-04-19T03:01:07.538434+0000","last_active":"2024-04-19T03:04:48.225736+0000","last_peered":"2024-04-19T03:04:48.225736+0000","last_clean":"2024-04-19T03:04:48.225736+0000","last_became_active":"2024-04-19T03:01:07.537856+0000","last_became_peered":"2024-04-19T03:01:07.537856+0000","last_unstale":"2024-04-19T03:04:48.225736+0000","last_undegraded":"2024-04-19T03:04:48.225736+0000","last_fullsized":"2024-04-19T03:04:48.225736+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:06.516863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:06.516863+0000","last_clean_scrub_stamp":"2024-04-19T03:01:06.516863+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:36:46.386286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":70,"reported_epoch":71,"state":"peering","last_fresh":"2024-04-19T03:04:49.246748+0000","last_change":"2024-04-19T03:04:49.246879+0000","last_active":"2024-04-19T03:04:49.246748+0000","last_peered":"2024-04-19T03:04:48.228146+0000","last_clean":"2024-04-19T03:02:21.239790+0000","last_became_active":"2024-04-19T03:02:24.268308+0000","last_became_peered":"2024-04-19T03:02:24.268308+0000","last_unstale":"2024-04-19T03:04:49.246748+0000","last_undegraded":"2024-04-19T03:04:49.246748+0000","last_fullsized":"2024-04-19T03:04:49.246748+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_clean_scrub_stamp":"2024-04-19T03:01:09.578660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:35:06.302425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":22,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-19T03:04:50.638701+0000","last_change":"2024-04-19T03:04:50.629139+0000","last_active":"2024-04-19T03:04:50.638701+0000","last_peered":"2024-04-19T03:04:50.638701+0000","last_clean":"2024-04-19T03:04:50.638701+0000","last_became_active":"2024-04-19T03:04:50.628741+0000","last_became_peered":"2024-04-19T03:04:50.628741+0000","last_unstale":"2024-04-19T03:04:50.638701+0000","last_undegraded":"2024-04-19T03:04:50.638701+0000","last_fullsized":"2024-04-19T03:04:50.638701+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:17:48.413908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":58,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-19T03:04:48.227313+0000","last_change":"2024-04-19T03:02:40.440550+0000","last_active":"2024-04-19T03:04:48.227313+0000","last_peered":"2024-04-19T03:04:48.227313+0000","last_clean":"2024-04-19T03:04:48.227313+0000","last_became_active":"2024-04-19T03:02:40.439621+0000","last_became_peered":"2024-04-19T03:02:40.439621+0000","last_unstale":"2024-04-19T03:04:48.227313+0000","last_undegraded":"2024-04-19T03:04:48.227313+0000","last_fullsized":"2024-04-19T03:04:48.227313+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:51:11.593632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":64,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-19T03:04:48.226674+0000","last_change":"2024-04-19T03:01:10.602194+0000","last_active":"2024-04-19T03:04:48.226674+0000","last_peered":"2024-04-19T03:04:48.226674+0000","last_clean":"2024-04-19T03:04:48.226674+0000","last_became_active":"2024-04-19T03:01:10.601381+0000","last_became_peered":"2024-04-19T03:01:10.601381+0000","last_unstale":"2024-04-19T03:04:48.226674+0000","last_undegraded":"2024-04-19T03:04:48.226674+0000","last_fullsized":"2024-04-19T03:04:48.226674+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_clean_scrub_stamp":"2024-04-19T03:01:09.578660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:42:26.594095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":22,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-19T03:04:50.638028+0000","last_change":"2024-04-19T03:04:50.634401+0000","last_active":"2024-04-19T03:04:50.638028+0000","last_peered":"2024-04-19T03:04:50.638028+0000","last_clean":"2024-04-19T03:04:50.638028+0000","last_became_active":"2024-04-19T03:04:50.631721+0000","last_became_peered":"2024-04-19T03:04:50.631721+0000","last_unstale":"2024-04-19T03:04:50.638028+0000","last_undegraded":"2024-04-19T03:04:50.638028+0000","last_fullsized":"2024-04-19T03:04:50.638028+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:40:03.144776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":15,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-19T03:04:51.604952+0000","last_change":"2024-04-19T03:04:50.616635+0000","last_active":"2024-04-19T03:04:51.604952+0000","last_peered":"2024-04-19T03:04:51.604952+0000","last_clean":"2024-04-19T03:04:51.604952+0000","last_became_active":"2024-04-19T03:04:50.614587+0000","last_became_peered":"2024-04-19T03:04:50.614587+0000","last_unstale":"2024-04-19T03:04:51.604952+0000","last_undegraded":"2024-04-19T03:04:51.604952+0000","last_fullsized":"2024-04-19T03:04:51.604952+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:07:13.329439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":21,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-19T03:04:50.639378+0000","last_change":"2024-04-19T03:04:50.635352+0000","last_active":"2024-04-19T03:04:50.639378+0000","last_peered":"2024-04-19T03:04:50.639378+0000","last_clean":"2024-04-19T03:04:50.639378+0000","last_became_active":"2024-04-19T03:04:50.633457+0000","last_became_peered":"2024-04-19T03:04:50.633457+0000","last_unstale":"2024-04-19T03:04:50.639378+0000","last_undegraded":"2024-04-19T03:04:50.639378+0000","last_fullsized":"2024-04-19T03:04:50.639378+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_clean_scrub_stamp":"2024-04-19T03:01:09.578660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:17:18.884148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":62,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-19T03:04:49.102435+0000","last_change":"2024-04-19T03:01:14.649068+0000","last_active":"2024-04-19T03:04:49.102435+0000","last_peered":"2024-04-19T03:04:49.102435+0000","last_clean":"2024-04-19T03:04:49.102435+0000","last_became_active":"2024-04-19T03:01:14.648082+0000","last_became_peered":"2024-04-19T03:01:14.648082+0000","last_unstale":"2024-04-19T03:04:49.102435+0000","last_undegraded":"2024-04-19T03:04:49.102435+0000","last_fullsized":"2024-04-19T03:04:49.102435+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:30:14.489117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":21,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-19T03:04:50.634816+0000","last_change":"2024-04-19T03:04:50.625932+0000","last_active":"2024-04-19T03:04:50.634816+0000","last_peered":"2024-04-19T03:04:50.634816+0000","last_clean":"2024-04-19T03:04:50.634816+0000","last_became_active":"2024-04-19T03:04:50.617628+0000","last_became_peered":"2024-04-19T03:04:50.617628+0000","last_unstale":"2024-04-19T03:04:50.634816+0000","last_undegraded":"2024-04-19T03:04:50.634816+0000","last_fullsized":"2024-04-19T03:04:50.634816+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:52:52.957579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":70,"reported_epoch":71,"state":"peering","last_fresh":"2024-04-19T03:04:49.239248+0000","last_change":"2024-04-19T03:04:49.240780+0000","last_active":"2024-04-19T03:04:49.239248+0000","last_peered":"2024-04-19T03:04:48.226330+0000","last_clean":"2024-04-19T03:02:21.239177+0000","last_became_active":"2024-04-19T03:02:24.269783+0000","last_became_peered":"2024-04-19T03:02:24.269783+0000","last_unstale":"2024-04-19T03:04:49.239248+0000","last_undegraded":"2024-04-19T03:04:49.239248+0000","last_fullsized":"2024-04-19T03:04:49.239248+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_clean_scrub_stamp":"2024-04-19T03:01:09.578660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:50:22.833281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":68,"reported_epoch":71,"state":"peering","last_fresh":"2024-04-19T03:04:49.235047+0000","last_change":"2024-04-19T03:04:49.235470+0000","last_active":"2024-04-19T03:04:49.235047+0000","last_peered":"2024-04-19T03:04:48.228156+0000","last_clean":"2024-04-19T03:02:21.239666+0000","last_became_active":"2024-04-19T03:02:24.274962+0000","last_became_peered":"2024-04-19T03:02:24.274962+0000","last_unstale":"2024-04-19T03:04:49.235047+0000","last_undegraded":"2024-04-19T03:04:49.235047+0000","last_fullsized":"2024-04-19T03:04:49.235047+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:30:28.402079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":21,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-19T03:04:50.625916+0000","last_change":"2024-04-19T03:04:50.616475+0000","last_active":"2024-04-19T03:04:50.625916+0000","last_peered":"2024-04-19T03:04:50.625916+0000","last_clean":"2024-04-19T03:04:50.625916+0000","last_became_active":"2024-04-19T03:04:50.614774+0000","last_became_peered":"2024-04-19T03:04:50.614774+0000","last_unstale":"2024-04-19T03:04:50.625916+0000","last_undegraded":"2024-04-19T03:04:50.625916+0000","last_fullsized":"2024-04-19T03:04:50.625916+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:51:07.142010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":23,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-19T03:04:50.618862+0000","last_change":"2024-04-19T03:04:50.612055+0000","last_active":"2024-04-19T03:04:50.618862+0000","last_peered":"2024-04-19T03:04:50.618862+0000","last_clean":"2024-04-19T03:04:50.618862+0000","last_became_active":"2024-04-19T03:04:50.611010+0000","last_became_peered":"2024-04-19T03:04:50.611010+0000","last_unstale":"2024-04-19T03:04:50.618862+0000","last_undegraded":"2024-04-19T03:04:50.618862+0000","last_fullsized":"2024-04-19T03:04:50.618862+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:24:46.459920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":21,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-19T03:04:50.625870+0000","last_change":"2024-04-19T03:04:50.615925+0000","last_active":"2024-04-19T03:04:50.625870+0000","last_peered":"2024-04-19T03:04:50.625870+0000","last_clean":"2024-04-19T03:04:50.625870+0000","last_became_active":"2024-04-19T03:04:50.614498+0000","last_became_peered":"2024-04-19T03:04:50.614498+0000","last_unstale":"2024-04-19T03:04:50.625870+0000","last_undegraded":"2024-04-19T03:04:50.625870+0000","last_fullsized":"2024-04-19T03:04:50.625870+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_clean_scrub_stamp":"2024-04-19T03:01:09.578660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:41:52.085259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":34,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-19T03:04:48.224637+0000","last_change":"2024-04-19T03:02:40.440057+0000","last_active":"2024-04-19T03:04:48.224637+0000","last_peered":"2024-04-19T03:04:48.224637+0000","last_clean":"2024-04-19T03:04:48.224637+0000","last_became_active":"2024-04-19T03:02:40.439752+0000","last_became_peered":"2024-04-19T03:02:40.439752+0000","last_unstale":"2024-04-19T03:04:48.224637+0000","last_undegraded":"2024-04-19T03:04:48.224637+0000","last_fullsized":"2024-04-19T03:04:48.224637+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:38:12.336658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":22,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-19T03:04:50.625939+0000","last_change":"2024-04-19T03:04:50.616970+0000","last_active":"2024-04-19T03:04:50.625939+0000","last_peered":"2024-04-19T03:04:50.625939+0000","last_clean":"2024-04-19T03:04:50.625939+0000","last_became_active":"2024-04-19T03:04:50.615238+0000","last_became_peered":"2024-04-19T03:04:50.615238+0000","last_unstale":"2024-04-19T03:04:50.625939+0000","last_undegraded":"2024-04-19T03:04:50.625939+0000","last_fullsized":"2024-04-19T03:04:50.625939+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:55:14.049921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-19T03:04:51.604135+0000","last_change":"2024-04-19T03:04:50.612749+0000","last_active":"2024-04-19T03:04:51.604135+0000","last_peered":"2024-04-19T03:04:51.604135+0000","last_clean":"2024-04-19T03:04:51.604135+0000","last_became_active":"2024-04-19T03:04:50.612029+0000","last_became_peered":"2024-04-19T03:04:50.612029+0000","last_unstale":"2024-04-19T03:04:51.604135+0000","last_undegraded":"2024-04-19T03:04:51.604135+0000","last_fullsized":"2024-04-19T03:04:51.604135+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_clean_scrub_stamp":"2024-04-19T03:01:09.578660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:08:24.466181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":34,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-19T03:04:48.226383+0000","last_change":"2024-04-19T03:02:40.440227+0000","last_active":"2024-04-19T03:04:48.226383+0000","last_peered":"2024-04-19T03:04:48.226383+0000","last_clean":"2024-04-19T03:04:48.226383+0000","last_became_active":"2024-04-19T03:02:40.439732+0000","last_became_peered":"2024-04-19T03:02:40.439732+0000","last_unstale":"2024-04-19T03:04:48.226383+0000","last_undegraded":"2024-04-19T03:04:48.226383+0000","last_fullsized":"2024-04-19T03:04:48.226383+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:29:33.660584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"20'2","reported_seq":24,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-19T03:04:50.626103+0000","last_change":"2024-04-19T03:04:50.611678+0000","last_active":"2024-04-19T03:04:50.626103+0000","last_peered":"2024-04-19T03:04:50.626103+0000","last_clean":"2024-04-19T03:04:50.626103+0000","last_became_active":"2024-04-19T03:04:50.611024+0000","last_became_peered":"2024-04-19T03:04:50.611024+0000","last_unstale":"2024-04-19T03:04:50.626103+0000","last_undegraded":"2024-04-19T03:04:50.626103+0000","last_fullsized":"2024-04-19T03:04:50.626103+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:08:43.323149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":21,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-19T03:04:50.628208+0000","last_change":"2024-04-19T03:04:50.616003+0000","last_active":"2024-04-19T03:04:50.628208+0000","last_peered":"2024-04-19T03:04:50.628208+0000","last_clean":"2024-04-19T03:04:50.628208+0000","last_became_active":"2024-04-19T03:04:50.612403+0000","last_became_peered":"2024-04-19T03:04:50.612403+0000","last_unstale":"2024-04-19T03:04:50.628208+0000","last_undegraded":"2024-04-19T03:04:50.628208+0000","last_fullsized":"2024-04-19T03:04:50.628208+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_clean_scrub_stamp":"2024-04-19T03:01:09.578660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:16:44.156874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":21,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-19T03:04:50.629849+0000","last_change":"2024-04-19T03:04:50.615936+0000","last_active":"2024-04-19T03:04:50.629849+0000","last_peered":"2024-04-19T03:04:50.629849+0000","last_clean":"2024-04-19T03:04:50.629849+0000","last_became_active":"2024-04-19T03:04:50.612987+0000","last_became_peered":"2024-04-19T03:04:50.612987+0000","last_unstale":"2024-04-19T03:04:50.629849+0000","last_undegraded":"2024-04-19T03:04:50.629849+0000","last_fullsized":"2024-04-19T03:04:50.629849+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:17:39.989639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"21'1","reported_seq":25,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-19T03:04:50.628236+0000","last_change":"2024-04-19T03:04:50.616200+0000","last_active":"2024-04-19T03:04:50.628236+0000","last_peered":"2024-04-19T03:04:50.628236+0000","last_clean":"2024-04-19T03:04:50.628236+0000","last_became_active":"2024-04-19T03:04:50.612697+0000","last_became_peered":"2024-04-19T03:04:50.612697+0000","last_unstale":"2024-04-19T03:04:50.628236+0000","last_undegraded":"2024-04-19T03:04:50.628236+0000","last_fullsized":"2024-04-19T03:04:50.628236+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:28:55.970411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":64,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-19T03:04:48.226551+0000","last_change":"2024-04-19T03:01:10.602274+0000","last_active":"2024-04-19T03:04:48.226551+0000","last_peered":"2024-04-19T03:04:48.226551+0000","last_clean":"2024-04-19T03:04:48.226551+0000","last_became_active":"2024-04-19T03:01:10.601487+0000","last_became_peered":"2024-04-19T03:01:10.601487+0000","last_unstale":"2024-04-19T03:04:48.226551+0000","last_undegraded":"2024-04-19T03:04:48.226551+0000","last_fullsized":"2024-04-19T03:04:48.226551+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_clean_scrub_stamp":"2024-04-19T03:01:09.578660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:26:16.712446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":61,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-19T03:04:49.101512+0000","last_change":"2024-04-19T03:01:15.018914+0000","last_active":"2024-04-19T03:04:49.101512+0000","last_peered":"2024-04-19T03:04:49.101512+0000","last_clean":"2024-04-19T03:04:49.101512+0000","last_became_active":"2024-04-19T03:01:15.018276+0000","last_became_peered":"2024-04-19T03:01:15.018276+0000","last_unstale":"2024-04-19T03:04:49.101512+0000","last_undegraded":"2024-04-19T03:04:49.101512+0000","last_fullsized":"2024-04-19T03:04:49.101512+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:40:59.453079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":61,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-19T03:04:48.225925+0000","last_change":"2024-04-19T03:01:15.015855+0000","last_active":"2024-04-19T03:04:48.225925+0000","last_peered":"2024-04-19T03:04:48.225925+0000","last_clean":"2024-04-19T03:04:48.225925+0000","last_became_active":"2024-04-19T03:01:15.015358+0000","last_became_peered":"2024-04-19T03:01:15.015358+0000","last_unstale":"2024-04-19T03:04:48.225925+0000","last_undegraded":"2024-04-19T03:04:48.225925+0000","last_fullsized":"2024-04-19T03:04:48.225925+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:59:49.270245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"20'6","reported_seq":68,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-19T03:04:48.227686+0000","last_change":"2024-04-19T03:01:14.649577+0000","last_active":"2024-04-19T03:04:48.227686+0000","last_peered":"2024-04-19T03:04:48.227686+0000","last_clean":"2024-04-19T03:04:48.227686+0000","last_became_active":"2024-04-19T03:01:14.649284+0000","last_became_peered":"2024-04-19T03:01:14.649284+0000","last_unstale":"2024-04-19T03:04:48.227686+0000","last_undegraded":"2024-04-19T03:04:48.227686+0000","last_fullsized":"2024-04-19T03:04:48.227686+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:01:22.214742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":21,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-19T03:04:50.638647+0000","last_change":"2024-04-19T03:04:50.628406+0000","last_active":"2024-04-19T03:04:50.638647+0000","last_peered":"2024-04-19T03:04:50.638647+0000","last_clean":"2024-04-19T03:04:50.638647+0000","last_became_active":"2024-04-19T03:04:50.627654+0000","last_became_peered":"2024-04-19T03:04:50.627654+0000","last_unstale":"2024-04-19T03:04:50.638647+0000","last_undegraded":"2024-04-19T03:04:50.638647+0000","last_fullsized":"2024-04-19T03:04:50.638647+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:17:57.101098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"20'3","reported_seq":41,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-19T03:04:48.227379+0000","last_change":"2024-04-19T03:02:40.442253+0000","last_active":"2024-04-19T03:04:48.227379+0000","last_peered":"2024-04-19T03:04:48.227379+0000","last_clean":"2024-04-19T03:04:48.227379+0000","last_became_active":"2024-04-19T03:02:40.441225+0000","last_became_peered":"2024-04-19T03:02:40.441225+0000","last_unstale":"2024-04-19T03:04:48.227379+0000","last_undegraded":"2024-04-19T03:04:48.227379+0000","last_fullsized":"2024-04-19T03:04:48.227379+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:51:10.208584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":23,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-19T03:04:50.628323+0000","last_change":"2024-04-19T03:04:50.617205+0000","last_active":"2024-04-19T03:04:50.628323+0000","last_peered":"2024-04-19T03:04:50.628323+0000","last_clean":"2024-04-19T03:04:50.628323+0000","last_became_active":"2024-04-19T03:04:50.616879+0000","last_became_peered":"2024-04-19T03:04:50.616879+0000","last_unstale":"2024-04-19T03:04:50.628323+0000","last_undegraded":"2024-04-19T03:04:50.628323+0000","last_fullsized":"2024-04-19T03:04:50.628323+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:58:21.203090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":21,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-19T03:04:50.637983+0000","last_change":"2024-04-19T03:04:50.634026+0000","last_active":"2024-04-19T03:04:50.637983+0000","last_peered":"2024-04-19T03:04:50.637983+0000","last_clean":"2024-04-19T03:04:50.637983+0000","last_became_active":"2024-04-19T03:04:50.630873+0000","last_became_peered":"2024-04-19T03:04:50.630873+0000","last_unstale":"2024-04-19T03:04:50.637983+0000","last_undegraded":"2024-04-19T03:04:50.637983+0000","last_fullsized":"2024-04-19T03:04:50.637983+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:41:25.674376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":22,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-19T03:04:50.626181+0000","last_change":"2024-04-19T03:04:50.612483+0000","last_active":"2024-04-19T03:04:50.626181+0000","last_peered":"2024-04-19T03:04:50.626181+0000","last_clean":"2024-04-19T03:04:50.626181+0000","last_became_active":"2024-04-19T03:04:50.612005+0000","last_became_peered":"2024-04-19T03:04:50.612005+0000","last_unstale":"2024-04-19T03:04:50.626181+0000","last_undegraded":"2024-04-19T03:04:50.626181+0000","last_fullsized":"2024-04-19T03:04:50.626181+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:56:45.629955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":21,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-19T03:04:50.629878+0000","last_change":"2024-04-19T03:04:50.616158+0000","last_active":"2024-04-19T03:04:50.629878+0000","last_peered":"2024-04-19T03:04:50.629878+0000","last_clean":"2024-04-19T03:04:50.629878+0000","last_became_active":"2024-04-19T03:04:50.613735+0000","last_became_peered":"2024-04-19T03:04:50.613735+0000","last_unstale":"2024-04-19T03:04:50.629878+0000","last_undegraded":"2024-04-19T03:04:50.629878+0000","last_fullsized":"2024-04-19T03:04:50.629878+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:25:58.128503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":34,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-19T03:04:48.226019+0000","last_change":"2024-04-19T03:02:40.442421+0000","last_active":"2024-04-19T03:04:48.226019+0000","last_peered":"2024-04-19T03:04:48.226019+0000","last_clean":"2024-04-19T03:04:48.226019+0000","last_became_active":"2024-04-19T03:02:40.441746+0000","last_became_peered":"2024-04-19T03:02:40.441746+0000","last_unstale":"2024-04-19T03:04:48.226019+0000","last_undegraded":"2024-04-19T03:04:48.226019+0000","last_fullsized":"2024-04-19T03:04:48.226019+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:52:55.719264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":22,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-19T03:04:50.629924+0000","last_change":"2024-04-19T03:04:50.616430+0000","last_active":"2024-04-19T03:04:50.629924+0000","last_peered":"2024-04-19T03:04:50.629924+0000","last_clean":"2024-04-19T03:04:50.629924+0000","last_became_active":"2024-04-19T03:04:50.613523+0000","last_became_peered":"2024-04-19T03:04:50.613523+0000","last_unstale":"2024-04-19T03:04:50.629924+0000","last_undegraded":"2024-04-19T03:04:50.629924+0000","last_fullsized":"2024-04-19T03:04:50.629924+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:22:43.207543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":21,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-19T03:04:50.628304+0000","last_change":"2024-04-19T03:04:50.616829+0000","last_active":"2024-04-19T03:04:50.628304+0000","last_peered":"2024-04-19T03:04:50.628304+0000","last_clean":"2024-04-19T03:04:50.628304+0000","last_became_active":"2024-04-19T03:04:50.616545+0000","last_became_peered":"2024-04-19T03:04:50.616545+0000","last_unstale":"2024-04-19T03:04:50.628304+0000","last_undegraded":"2024-04-19T03:04:50.628304+0000","last_fullsized":"2024-04-19T03:04:50.628304+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:07:32.515729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":22,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-19T03:04:50.637999+0000","last_change":"2024-04-19T03:04:50.634214+0000","last_active":"2024-04-19T03:04:50.637999+0000","last_peered":"2024-04-19T03:04:50.637999+0000","last_clean":"2024-04-19T03:04:50.637999+0000","last_became_active":"2024-04-19T03:04:50.631699+0000","last_became_peered":"2024-04-19T03:04:50.631699+0000","last_unstale":"2024-04-19T03:04:50.637999+0000","last_undegraded":"2024-04-19T03:04:50.637999+0000","last_fullsized":"2024-04-19T03:04:50.637999+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:43:10.184280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":33,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-19T03:04:48.225301+0000","last_change":"2024-04-19T03:02:40.441670+0000","last_active":"2024-04-19T03:04:48.225301+0000","last_peered":"2024-04-19T03:04:48.225301+0000","last_clean":"2024-04-19T03:04:48.225301+0000","last_became_active":"2024-04-19T03:02:40.441294+0000","last_became_peered":"2024-04-19T03:02:40.441294+0000","last_unstale":"2024-04-19T03:04:48.225301+0000","last_undegraded":"2024-04-19T03:04:48.225301+0000","last_fullsized":"2024-04-19T03:04:48.225301+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:59:32.330785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"20'1","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-19T03:04:51.603581+0000","last_change":"2024-04-19T03:04:50.612263+0000","last_active":"2024-04-19T03:04:51.603581+0000","last_peered":"2024-04-19T03:04:51.603581+0000","last_clean":"2024-04-19T03:04:51.603581+0000","last_became_active":"2024-04-19T03:04:50.611850+0000","last_became_peered":"2024-04-19T03:04:50.611850+0000","last_unstale":"2024-04-19T03:04:51.603581+0000","last_undegraded":"2024-04-19T03:04:51.603581+0000","last_fullsized":"2024-04-19T03:04:51.603581+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:26:47.367018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":15,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-19T03:04:51.605315+0000","last_change":"2024-04-19T03:04:50.627129+0000","last_active":"2024-04-19T03:04:51.605315+0000","last_peered":"2024-04-19T03:04:51.605315+0000","last_clean":"2024-04-19T03:04:51.605315+0000","last_became_active":"2024-04-19T03:04:50.626547+0000","last_became_peered":"2024-04-19T03:04:50.626547+0000","last_unstale":"2024-04-19T03:04:51.605315+0000","last_undegraded":"2024-04-19T03:04:51.605315+0000","last_fullsized":"2024-04-19T03:04:51.605315+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:43:35.716650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"20'1","reported_seq":38,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-19T03:04:51.604262+0000","last_change":"2024-04-19T03:04:50.626274+0000","last_active":"2024-04-19T03:04:51.604262+0000","last_peered":"2024-04-19T03:04:51.604262+0000","last_clean":"2024-04-19T03:04:51.604262+0000","last_became_active":"2024-04-19T03:04:50.618516+0000","last_became_peered":"2024-04-19T03:04:50.618516+0000","last_unstale":"2024-04-19T03:04:51.604262+0000","last_undegraded":"2024-04-19T03:04:51.604262+0000","last_fullsized":"2024-04-19T03:04:51.604262+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:18:07.170476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":67,"reported_epoch":71,"state":"peering","last_fresh":"2024-04-19T03:04:49.238423+0000","last_change":"2024-04-19T03:04:49.238858+0000","last_active":"2024-04-19T03:04:49.238423+0000","last_peered":"2024-04-19T03:04:48.225599+0000","last_clean":"2024-04-19T03:02:21.239100+0000","last_became_active":"2024-04-19T03:02:24.264906+0000","last_became_peered":"2024-04-19T03:02:24.264906+0000","last_unstale":"2024-04-19T03:04:49.238423+0000","last_undegraded":"2024-04-19T03:04:49.238423+0000","last_fullsized":"2024-04-19T03:04:49.238423+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:25:23.823410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"20'2","reported_seq":70,"reported_epoch":71,"state":"peering","last_fresh":"2024-04-19T03:04:49.244022+0000","last_change":"2024-04-19T03:04:49.244445+0000","last_active":"2024-04-19T03:04:49.244022+0000","last_peered":"2024-04-19T03:04:48.228171+0000","last_clean":"2024-04-19T03:02:21.239137+0000","last_became_active":"2024-04-19T03:02:24.283173+0000","last_became_peered":"2024-04-19T03:02:24.283173+0000","last_unstale":"2024-04-19T03:04:49.244022+0000","last_undegraded":"2024-04-19T03:04:49.244022+0000","last_fullsized":"2024-04-19T03:04:49.244022+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:48:15.865979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":67,"reported_epoch":71,"state":"peering","last_fresh":"2024-04-19T03:04:49.243751+0000","last_change":"2024-04-19T03:04:49.244452+0000","last_active":"2024-04-19T03:04:49.243751+0000","last_peered":"2024-04-19T03:04:48.225979+0000","last_clean":"2024-04-19T03:02:21.238991+0000","last_became_active":"2024-04-19T03:02:24.269672+0000","last_became_peered":"2024-04-19T03:02:24.269672+0000","last_unstale":"2024-04-19T03:04:49.243751+0000","last_undegraded":"2024-04-19T03:04:49.243751+0000","last_fullsized":"2024-04-19T03:04:49.243751+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:09:41.580252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"20'2","reported_seq":41,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-19T03:04:48.227071+0000","last_change":"2024-04-19T03:02:40.441689+0000","last_active":"2024-04-19T03:04:48.227071+0000","last_peered":"2024-04-19T03:04:48.227071+0000","last_clean":"2024-04-19T03:04:48.227071+0000","last_became_active":"2024-04-19T03:02:40.440206+0000","last_became_peered":"2024-04-19T03:02:40.440206+0000","last_unstale":"2024-04-19T03:04:48.227071+0000","last_undegraded":"2024-04-19T03:04:48.227071+0000","last_fullsized":"2024-04-19T03:04:48.227071+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:02:19.100804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-19T03:04:51.603775+0000","last_change":"2024-04-19T03:04:50.634940+0000","last_active":"2024-04-19T03:04:51.603775+0000","last_peered":"2024-04-19T03:04:51.603775+0000","last_clean":"2024-04-19T03:04:51.603775+0000","last_became_active":"2024-04-19T03:04:50.632660+0000","last_became_peered":"2024-04-19T03:04:50.632660+0000","last_unstale":"2024-04-19T03:04:51.603775+0000","last_undegraded":"2024-04-19T03:04:51.603775+0000","last_fullsized":"2024-04-19T03:04:51.603775+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:23:26.030101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"20'1","reported_seq":24,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-19T03:04:50.635670+0000","last_change":"2024-04-19T03:04:50.627670+0000","last_active":"2024-04-19T03:04:50.635670+0000","last_peered":"2024-04-19T03:04:50.635670+0000","last_clean":"2024-04-19T03:04:50.635670+0000","last_became_active":"2024-04-19T03:04:50.627304+0000","last_became_peered":"2024-04-19T03:04:50.627304+0000","last_unstale":"2024-04-19T03:04:50.635670+0000","last_undegraded":"2024-04-19T03:04:50.635670+0000","last_fullsized":"2024-04-19T03:04:50.635670+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:29:08.875911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":67,"reported_epoch":71,"state":"peering","last_fresh":"2024-04-19T03:04:49.238503+0000","last_change":"2024-04-19T03:04:49.238881+0000","last_active":"2024-04-19T03:04:49.238503+0000","last_peered":"2024-04-19T03:04:48.225407+0000","last_clean":"2024-04-19T03:02:21.238692+0000","last_became_active":"2024-04-19T03:02:24.264787+0000","last_became_peered":"2024-04-19T03:02:24.264787+0000","last_unstale":"2024-04-19T03:04:49.238503+0000","last_undegraded":"2024-04-19T03:04:49.238503+0000","last_fullsized":"2024-04-19T03:04:49.238503+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:45:33.989924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"20'4","reported_seq":24,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-19T03:04:50.635019+0000","last_change":"2024-04-19T03:04:50.627070+0000","last_active":"2024-04-19T03:04:50.635019+0000","last_peered":"2024-04-19T03:04:50.635019+0000","last_clean":"2024-04-19T03:04:50.635019+0000","last_became_active":"2024-04-19T03:04:50.626334+0000","last_became_peered":"2024-04-19T03:04:50.626334+0000","last_unstale":"2024-04-19T03:04:50.635019+0000","last_undegraded":"2024-04-19T03:04:50.635019+0000","last_fullsized":"2024-04-19T03:04:50.635019+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:24:58.586175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5289,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":14482,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":10,"seq":42949673011,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":220636,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":219774,"kb_avail":94151204,"statfs":{"total":96636764160,"available":96410832896,"internally_reserved":0,"allocated":864256,"data_stored":887137,"data_compressed":7241,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":225049030},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 19 03:02:08 2024","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":2.1379999999999999},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"last":0.33100000000000002}]},{"osd":1,"last update":"Fri Apr 19 03:04:11 2024","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.19900000000000001,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.87,"5min":2.5030000000000001,"15min":2.5030000000000001},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.57099999999999995,"15min":0.56299999999999994},"min":{"1min":0.23999999999999999,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.90400000000000003,"5min":2.6379999999999999,"15min":2.6379999999999999},"last":0.59099999999999997}]}]},{"osd":1,"up_from":10,"seq":42949673010,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":202584,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":201726,"kb_avail":94169256,"statfs":{"total":96636764160,"available":96429318144,"internally_reserved":0,"allocated":860160,"data_stored":888684,"data_compressed":7241,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":206567878},"hb_peers":[2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 19 03:02:04 2024","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.216},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":2.2349999999999999}]},{"osd":2,"last update":"Fri Apr 19 03:04:07 2024","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.47899999999999998,"15min":0.501},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":0.79400000000000004,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.623},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.48499999999999999,"15min":0.51400000000000001},"min":{"1min":0.26100000000000001,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.83899999999999997,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.68899999999999995}]}]},{"osd":0,"up_from":71,"seq":304942678018,"num_pgs":73,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47648,"kb_used_data":784,"kb_used_omap":6,"kb_used_meta":46841,"kb_avail":94324192,"statfs":{"total":96636764160,"available":96587972608,"internally_reserved":0,"allocated":802816,"data_stored":305732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6883,"internal_metadata":47965469},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59099999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67600000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":7241,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":7241,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5289,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-19T03:04:55.974 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-19T03:04:56.366 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-19T03:04:56.366 INFO:teuthology.orchestra.run.smithi096.stdout:{"fsid":"c6cc8e09-11d4-48de-9a6c-4d70ed3c3789","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":242,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":73,"num_osds":3,"num_up_osds":3,"osd_up_since":1713495889,"num_in_osds":3,"osd_in_since":1713495654,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":105}],"num_pgs":105,"num_pools":4,"num_objects":24,"data_bytes":592730,"bytes_used":482205696,"bytes_avail":289428086784,"bytes_total":289910292480},"fsmap":{"epoch":5,"id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"a","status":"up:active","gid":4202}],"up:standby":0},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":5,"modified":"2024-04-19T03:02:21.965605+0000","services":{}},"progress_events":{}} 2024-04-19T03:04:56.385 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-04-19T03:04:56.385 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-19T03:04:56.692 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-19T03:04:56.695 INFO:teuthology.orchestra.run.smithi096.stderr:dumped all 2024-04-19T03:04:56.706 INFO:teuthology.orchestra.run.smithi096.stdout:{"pg_ready":true,"pg_map":{"version":185,"stamp":"2024-04-19T03:04:56.044070+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":470904,"kb_used_data":2500,"kb_used_omap":9,"kb_used_meta":468342,"kb_avail":282644616,"statfs":{"total":289910292480,"available":289428086784,"internally_reserved":0,"allocated":2560000,"data_stored":2098645,"data_compressed":14482,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":10071,"internal_metadata":479582377},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-8,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.820406"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":15,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-19T03:04:51.605216+0000","last_change":"2024-04-19T03:04:50.612508+0000","last_active":"2024-04-19T03:04:51.605216+0000","last_peered":"2024-04-19T03:04:51.605216+0000","last_clean":"2024-04-19T03:04:51.605216+0000","last_became_active":"2024-04-19T03:04:50.612040+0000","last_became_peered":"2024-04-19T03:04:50.612040+0000","last_unstale":"2024-04-19T03:04:51.605216+0000","last_undegraded":"2024-04-19T03:04:51.605216+0000","last_fullsized":"2024-04-19T03:04:51.605216+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:18:02.587927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":76,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-19T03:04:50.283861+0000","last_change":"2024-04-19T03:04:50.278334+0000","last_active":"2024-04-19T03:04:50.283861+0000","last_peered":"2024-04-19T03:04:50.283861+0000","last_clean":"2024-04-19T03:04:50.283861+0000","last_became_active":"2024-04-19T03:04:50.277848+0000","last_became_peered":"2024-04-19T03:04:50.277848+0000","last_unstale":"2024-04-19T03:04:50.283861+0000","last_undegraded":"2024-04-19T03:04:50.283861+0000","last_fullsized":"2024-04-19T03:04:50.283861+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:57:39.589383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":63,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-19T03:04:50.252427+0000","last_change":"2024-04-19T03:01:15.015884+0000","last_active":"2024-04-19T03:04:50.252427+0000","last_peered":"2024-04-19T03:04:50.252427+0000","last_clean":"2024-04-19T03:04:50.252427+0000","last_became_active":"2024-04-19T03:01:15.014599+0000","last_became_peered":"2024-04-19T03:01:15.014599+0000","last_unstale":"2024-04-19T03:04:50.252427+0000","last_undegraded":"2024-04-19T03:04:50.252427+0000","last_fullsized":"2024-04-19T03:04:50.252427+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:35:19.436344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":76,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-19T03:04:50.276611+0000","last_change":"2024-04-19T03:04:50.275017+0000","last_active":"2024-04-19T03:04:50.276611+0000","last_peered":"2024-04-19T03:04:50.276611+0000","last_clean":"2024-04-19T03:04:50.276611+0000","last_became_active":"2024-04-19T03:04:50.274600+0000","last_became_peered":"2024-04-19T03:04:50.274600+0000","last_unstale":"2024-04-19T03:04:50.276611+0000","last_undegraded":"2024-04-19T03:04:50.276611+0000","last_fullsized":"2024-04-19T03:04:50.276611+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:21:44.006351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":15,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-19T03:04:51.604382+0000","last_change":"2024-04-19T03:04:50.626581+0000","last_active":"2024-04-19T03:04:51.604382+0000","last_peered":"2024-04-19T03:04:51.604382+0000","last_clean":"2024-04-19T03:04:51.604382+0000","last_became_active":"2024-04-19T03:04:50.618669+0000","last_became_peered":"2024-04-19T03:04:50.618669+0000","last_unstale":"2024-04-19T03:04:51.604382+0000","last_undegraded":"2024-04-19T03:04:51.604382+0000","last_fullsized":"2024-04-19T03:04:51.604382+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:27:58.006985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":24,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-19T03:04:50.638678+0000","last_change":"2024-04-19T03:04:50.628582+0000","last_active":"2024-04-19T03:04:50.638678+0000","last_peered":"2024-04-19T03:04:50.638678+0000","last_clean":"2024-04-19T03:04:50.638678+0000","last_became_active":"2024-04-19T03:04:50.627684+0000","last_became_peered":"2024-04-19T03:04:50.627684+0000","last_unstale":"2024-04-19T03:04:50.638678+0000","last_undegraded":"2024-04-19T03:04:50.638678+0000","last_fullsized":"2024-04-19T03:04:50.638678+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:10:23.005064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":24,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-19T03:04:50.639395+0000","last_change":"2024-04-19T03:04:50.635434+0000","last_active":"2024-04-19T03:04:50.639395+0000","last_peered":"2024-04-19T03:04:50.639395+0000","last_clean":"2024-04-19T03:04:50.639395+0000","last_became_active":"2024-04-19T03:04:50.633594+0000","last_became_peered":"2024-04-19T03:04:50.633594+0000","last_unstale":"2024-04-19T03:04:50.639395+0000","last_undegraded":"2024-04-19T03:04:50.639395+0000","last_fullsized":"2024-04-19T03:04:50.639395+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:18:54.877499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":76,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-19T03:04:50.263132+0000","last_change":"2024-04-19T03:04:50.261359+0000","last_active":"2024-04-19T03:04:50.263132+0000","last_peered":"2024-04-19T03:04:50.263132+0000","last_clean":"2024-04-19T03:04:50.263132+0000","last_became_active":"2024-04-19T03:04:50.261155+0000","last_became_peered":"2024-04-19T03:04:50.261155+0000","last_unstale":"2024-04-19T03:04:50.263132+0000","last_undegraded":"2024-04-19T03:04:50.263132+0000","last_fullsized":"2024-04-19T03:04:50.263132+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:09:37.911709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":21,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-19T03:04:50.626163+0000","last_change":"2024-04-19T03:04:50.611854+0000","last_active":"2024-04-19T03:04:50.626163+0000","last_peered":"2024-04-19T03:04:50.626163+0000","last_clean":"2024-04-19T03:04:50.626163+0000","last_became_active":"2024-04-19T03:04:50.611400+0000","last_became_peered":"2024-04-19T03:04:50.611400+0000","last_unstale":"2024-04-19T03:04:50.626163+0000","last_undegraded":"2024-04-19T03:04:50.626163+0000","last_fullsized":"2024-04-19T03:04:50.626163+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:33:58.731162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":76,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-19T03:04:50.283894+0000","last_change":"2024-04-19T03:04:50.278337+0000","last_active":"2024-04-19T03:04:50.283894+0000","last_peered":"2024-04-19T03:04:50.283894+0000","last_clean":"2024-04-19T03:04:50.283894+0000","last_became_active":"2024-04-19T03:04:50.277899+0000","last_became_peered":"2024-04-19T03:04:50.277899+0000","last_unstale":"2024-04-19T03:04:50.283894+0000","last_undegraded":"2024-04-19T03:04:50.283894+0000","last_fullsized":"2024-04-19T03:04:50.283894+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:32:49.546687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":24,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-19T03:04:50.618809+0000","last_change":"2024-04-19T03:04:50.612405+0000","last_active":"2024-04-19T03:04:50.618809+0000","last_peered":"2024-04-19T03:04:50.618809+0000","last_clean":"2024-04-19T03:04:50.618809+0000","last_became_active":"2024-04-19T03:04:50.611103+0000","last_became_peered":"2024-04-19T03:04:50.611103+0000","last_unstale":"2024-04-19T03:04:50.618809+0000","last_undegraded":"2024-04-19T03:04:50.618809+0000","last_fullsized":"2024-04-19T03:04:50.618809+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:19:06.653369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":35,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-19T03:04:50.248889+0000","last_change":"2024-04-19T03:02:40.438738+0000","last_active":"2024-04-19T03:04:50.248889+0000","last_peered":"2024-04-19T03:04:50.248889+0000","last_clean":"2024-04-19T03:04:50.248889+0000","last_became_active":"2024-04-19T03:02:40.438000+0000","last_became_peered":"2024-04-19T03:02:40.438000+0000","last_unstale":"2024-04-19T03:04:50.248889+0000","last_undegraded":"2024-04-19T03:04:50.248889+0000","last_fullsized":"2024-04-19T03:04:50.248889+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:35:10.932021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":15,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-19T03:04:51.604818+0000","last_change":"2024-04-19T03:04:50.628927+0000","last_active":"2024-04-19T03:04:51.604818+0000","last_peered":"2024-04-19T03:04:51.604818+0000","last_clean":"2024-04-19T03:04:51.604818+0000","last_became_active":"2024-04-19T03:04:50.626854+0000","last_became_peered":"2024-04-19T03:04:50.626854+0000","last_unstale":"2024-04-19T03:04:51.604818+0000","last_undegraded":"2024-04-19T03:04:51.604818+0000","last_fullsized":"2024-04-19T03:04:51.604818+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:41:04.929370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":63,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-19T03:04:50.249506+0000","last_change":"2024-04-19T03:01:15.010960+0000","last_active":"2024-04-19T03:04:50.249506+0000","last_peered":"2024-04-19T03:04:50.249506+0000","last_clean":"2024-04-19T03:04:50.249506+0000","last_became_active":"2024-04-19T03:01:15.010472+0000","last_became_peered":"2024-04-19T03:01:15.010472+0000","last_unstale":"2024-04-19T03:04:50.249506+0000","last_undegraded":"2024-04-19T03:04:50.249506+0000","last_fullsized":"2024-04-19T03:04:50.249506+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:21:36.129346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":63,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-19T03:04:50.249694+0000","last_change":"2024-04-19T03:01:15.014574+0000","last_active":"2024-04-19T03:04:50.249694+0000","last_peered":"2024-04-19T03:04:50.249694+0000","last_clean":"2024-04-19T03:04:50.249694+0000","last_became_active":"2024-04-19T03:01:15.014096+0000","last_became_peered":"2024-04-19T03:01:15.014096+0000","last_unstale":"2024-04-19T03:04:50.249694+0000","last_undegraded":"2024-04-19T03:04:50.249694+0000","last_fullsized":"2024-04-19T03:04:50.249694+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:01:54.253963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":24,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-19T03:04:50.629821+0000","last_change":"2024-04-19T03:04:50.615462+0000","last_active":"2024-04-19T03:04:50.629821+0000","last_peered":"2024-04-19T03:04:50.629821+0000","last_clean":"2024-04-19T03:04:50.629821+0000","last_became_active":"2024-04-19T03:04:50.612853+0000","last_became_peered":"2024-04-19T03:04:50.612853+0000","last_unstale":"2024-04-19T03:04:50.629821+0000","last_undegraded":"2024-04-19T03:04:50.629821+0000","last_fullsized":"2024-04-19T03:04:50.629821+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:47:30.389938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":21,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-19T03:04:50.626128+0000","last_change":"2024-04-19T03:04:50.611757+0000","last_active":"2024-04-19T03:04:50.626128+0000","last_peered":"2024-04-19T03:04:50.626128+0000","last_clean":"2024-04-19T03:04:50.626128+0000","last_became_active":"2024-04-19T03:04:50.611392+0000","last_became_peered":"2024-04-19T03:04:50.611392+0000","last_unstale":"2024-04-19T03:04:50.626128+0000","last_undegraded":"2024-04-19T03:04:50.626128+0000","last_fullsized":"2024-04-19T03:04:50.626128+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:51:50.768612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":15,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-19T03:04:51.605414+0000","last_change":"2024-04-19T03:04:50.629165+0000","last_active":"2024-04-19T03:04:51.605414+0000","last_peered":"2024-04-19T03:04:51.605414+0000","last_clean":"2024-04-19T03:04:51.605414+0000","last_became_active":"2024-04-19T03:04:50.628394+0000","last_became_peered":"2024-04-19T03:04:50.628394+0000","last_unstale":"2024-04-19T03:04:51.605414+0000","last_undegraded":"2024-04-19T03:04:51.605414+0000","last_fullsized":"2024-04-19T03:04:51.605414+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:17:06.173248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":21,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-19T03:04:50.618909+0000","last_change":"2024-04-19T03:04:50.613858+0000","last_active":"2024-04-19T03:04:50.618909+0000","last_peered":"2024-04-19T03:04:50.618909+0000","last_clean":"2024-04-19T03:04:50.618909+0000","last_became_active":"2024-04-19T03:04:50.613481+0000","last_became_peered":"2024-04-19T03:04:50.613481+0000","last_unstale":"2024-04-19T03:04:50.618909+0000","last_undegraded":"2024-04-19T03:04:50.618909+0000","last_fullsized":"2024-04-19T03:04:50.618909+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:55:45.686937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":76,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-19T03:04:50.276645+0000","last_change":"2024-04-19T03:04:50.275339+0000","last_active":"2024-04-19T03:04:50.276645+0000","last_peered":"2024-04-19T03:04:50.276645+0000","last_clean":"2024-04-19T03:04:50.276645+0000","last_became_active":"2024-04-19T03:04:50.274854+0000","last_became_peered":"2024-04-19T03:04:50.274854+0000","last_unstale":"2024-04-19T03:04:50.276645+0000","last_undegraded":"2024-04-19T03:04:50.276645+0000","last_fullsized":"2024-04-19T03:04:50.276645+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:29:12.816763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":76,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-19T03:04:50.279456+0000","last_change":"2024-04-19T03:04:50.276678+0000","last_active":"2024-04-19T03:04:50.279456+0000","last_peered":"2024-04-19T03:04:50.279456+0000","last_clean":"2024-04-19T03:04:50.279456+0000","last_became_active":"2024-04-19T03:04:50.275510+0000","last_became_peered":"2024-04-19T03:04:50.275510+0000","last_unstale":"2024-04-19T03:04:50.279456+0000","last_undegraded":"2024-04-19T03:04:50.279456+0000","last_fullsized":"2024-04-19T03:04:50.279456+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:17:24.832346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":63,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-19T03:04:50.252238+0000","last_change":"2024-04-19T03:01:15.020108+0000","last_active":"2024-04-19T03:04:50.252238+0000","last_peered":"2024-04-19T03:04:50.252238+0000","last_clean":"2024-04-19T03:04:50.252238+0000","last_became_active":"2024-04-19T03:01:15.018978+0000","last_became_peered":"2024-04-19T03:01:15.018978+0000","last_unstale":"2024-04-19T03:04:50.252238+0000","last_undegraded":"2024-04-19T03:04:50.252238+0000","last_fullsized":"2024-04-19T03:04:50.252238+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:30:22.360053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":21,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-19T03:04:50.637968+0000","last_change":"2024-04-19T03:04:50.633855+0000","last_active":"2024-04-19T03:04:50.637968+0000","last_peered":"2024-04-19T03:04:50.637968+0000","last_clean":"2024-04-19T03:04:50.637968+0000","last_became_active":"2024-04-19T03:04:50.630948+0000","last_became_peered":"2024-04-19T03:04:50.630948+0000","last_unstale":"2024-04-19T03:04:50.637968+0000","last_undegraded":"2024-04-19T03:04:50.637968+0000","last_fullsized":"2024-04-19T03:04:50.637968+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:41:31.676439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":15,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-19T03:04:51.604438+0000","last_change":"2024-04-19T03:04:50.617131+0000","last_active":"2024-04-19T03:04:51.604438+0000","last_peered":"2024-04-19T03:04:51.604438+0000","last_clean":"2024-04-19T03:04:51.604438+0000","last_became_active":"2024-04-19T03:04:50.616716+0000","last_became_peered":"2024-04-19T03:04:50.616716+0000","last_unstale":"2024-04-19T03:04:51.604438+0000","last_undegraded":"2024-04-19T03:04:51.604438+0000","last_fullsized":"2024-04-19T03:04:51.604438+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:25:16.749292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":36,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-19T03:04:50.250721+0000","last_change":"2024-04-19T03:02:40.441681+0000","last_active":"2024-04-19T03:04:50.250721+0000","last_peered":"2024-04-19T03:04:50.250721+0000","last_clean":"2024-04-19T03:04:50.250721+0000","last_became_active":"2024-04-19T03:02:40.441170+0000","last_became_peered":"2024-04-19T03:02:40.441170+0000","last_unstale":"2024-04-19T03:04:50.250721+0000","last_undegraded":"2024-04-19T03:04:50.250721+0000","last_fullsized":"2024-04-19T03:04:50.250721+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:43:25.396638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":21,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-19T03:04:50.634948+0000","last_change":"2024-04-19T03:04:50.626923+0000","last_active":"2024-04-19T03:04:50.634948+0000","last_peered":"2024-04-19T03:04:50.634948+0000","last_clean":"2024-04-19T03:04:50.634948+0000","last_became_active":"2024-04-19T03:04:50.617603+0000","last_became_peered":"2024-04-19T03:04:50.617603+0000","last_unstale":"2024-04-19T03:04:50.634948+0000","last_undegraded":"2024-04-19T03:04:50.634948+0000","last_fullsized":"2024-04-19T03:04:50.634948+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:26:56.826024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":46,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-19T03:04:50.255567+0000","last_change":"2024-04-19T03:02:15.206453+0000","last_active":"2024-04-19T03:04:50.255567+0000","last_peered":"2024-04-19T03:04:50.255567+0000","last_clean":"2024-04-19T03:04:50.255567+0000","last_became_active":"2024-04-19T03:02:15.205905+0000","last_became_peered":"2024-04-19T03:02:15.205905+0000","last_unstale":"2024-04-19T03:04:50.255567+0000","last_undegraded":"2024-04-19T03:04:50.255567+0000","last_fullsized":"2024-04-19T03:04:50.255567+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:48:06.646477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":63,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-19T03:04:50.253230+0000","last_change":"2024-04-19T03:01:15.020098+0000","last_active":"2024-04-19T03:04:50.253230+0000","last_peered":"2024-04-19T03:04:50.253230+0000","last_clean":"2024-04-19T03:04:50.253230+0000","last_became_active":"2024-04-19T03:01:15.019064+0000","last_became_peered":"2024-04-19T03:01:15.019064+0000","last_unstale":"2024-04-19T03:04:50.253230+0000","last_undegraded":"2024-04-19T03:04:50.253230+0000","last_fullsized":"2024-04-19T03:04:50.253230+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:50:06.490191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":21,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-19T03:04:50.626095+0000","last_change":"2024-04-19T03:04:50.616823+0000","last_active":"2024-04-19T03:04:50.626095+0000","last_peered":"2024-04-19T03:04:50.626095+0000","last_clean":"2024-04-19T03:04:50.626095+0000","last_became_active":"2024-04-19T03:04:50.616550+0000","last_became_peered":"2024-04-19T03:04:50.616550+0000","last_unstale":"2024-04-19T03:04:50.626095+0000","last_undegraded":"2024-04-19T03:04:50.626095+0000","last_fullsized":"2024-04-19T03:04:50.626095+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:46:25.096677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":36,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-19T03:04:50.249011+0000","last_change":"2024-04-19T03:02:40.440907+0000","last_active":"2024-04-19T03:04:50.249011+0000","last_peered":"2024-04-19T03:04:50.249011+0000","last_clean":"2024-04-19T03:04:50.249011+0000","last_became_active":"2024-04-19T03:02:40.440351+0000","last_became_peered":"2024-04-19T03:02:40.440351+0000","last_unstale":"2024-04-19T03:04:50.249011+0000","last_undegraded":"2024-04-19T03:04:50.249011+0000","last_fullsized":"2024-04-19T03:04:50.249011+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:36:36.558329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":21,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-19T03:04:50.639360+0000","last_change":"2024-04-19T03:04:50.635141+0000","last_active":"2024-04-19T03:04:50.639360+0000","last_peered":"2024-04-19T03:04:50.639360+0000","last_clean":"2024-04-19T03:04:50.639360+0000","last_became_active":"2024-04-19T03:04:50.633033+0000","last_became_peered":"2024-04-19T03:04:50.633033+0000","last_unstale":"2024-04-19T03:04:50.639360+0000","last_undegraded":"2024-04-19T03:04:50.639360+0000","last_fullsized":"2024-04-19T03:04:50.639360+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:42:01.712749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":76,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-19T03:04:50.280492+0000","last_change":"2024-04-19T03:04:50.279507+0000","last_active":"2024-04-19T03:04:50.280492+0000","last_peered":"2024-04-19T03:04:50.280492+0000","last_clean":"2024-04-19T03:04:50.280492+0000","last_became_active":"2024-04-19T03:04:50.278996+0000","last_became_peered":"2024-04-19T03:04:50.278996+0000","last_unstale":"2024-04-19T03:04:50.280492+0000","last_undegraded":"2024-04-19T03:04:50.280492+0000","last_fullsized":"2024-04-19T03:04:50.280492+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:09:09.816660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":15,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-19T03:04:51.604834+0000","last_change":"2024-04-19T03:04:50.617533+0000","last_active":"2024-04-19T03:04:51.604834+0000","last_peered":"2024-04-19T03:04:51.604834+0000","last_clean":"2024-04-19T03:04:51.604834+0000","last_became_active":"2024-04-19T03:04:50.617272+0000","last_became_peered":"2024-04-19T03:04:50.617272+0000","last_unstale":"2024-04-19T03:04:51.604834+0000","last_undegraded":"2024-04-19T03:04:51.604834+0000","last_fullsized":"2024-04-19T03:04:51.604834+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:11:32.650035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"20'2","reported_seq":79,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-19T03:04:50.279552+0000","last_change":"2024-04-19T03:04:50.277421+0000","last_active":"2024-04-19T03:04:50.279552+0000","last_peered":"2024-04-19T03:04:50.279552+0000","last_clean":"2024-04-19T03:04:50.279552+0000","last_became_active":"2024-04-19T03:04:50.276732+0000","last_became_peered":"2024-04-19T03:04:50.276732+0000","last_unstale":"2024-04-19T03:04:50.279552+0000","last_undegraded":"2024-04-19T03:04:50.279552+0000","last_fullsized":"2024-04-19T03:04:50.279552+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:23:27.191496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":15,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-19T03:04:51.604153+0000","last_change":"2024-04-19T03:04:50.612555+0000","last_active":"2024-04-19T03:04:51.604153+0000","last_peered":"2024-04-19T03:04:51.604153+0000","last_clean":"2024-04-19T03:04:51.604153+0000","last_became_active":"2024-04-19T03:04:50.611785+0000","last_became_peered":"2024-04-19T03:04:50.611785+0000","last_unstale":"2024-04-19T03:04:51.604153+0000","last_undegraded":"2024-04-19T03:04:51.604153+0000","last_fullsized":"2024-04-19T03:04:51.604153+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:07:27.548013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":22,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-19T03:04:50.638732+0000","last_change":"2024-04-19T03:04:50.628801+0000","last_active":"2024-04-19T03:04:50.638732+0000","last_peered":"2024-04-19T03:04:50.638732+0000","last_clean":"2024-04-19T03:04:50.638732+0000","last_became_active":"2024-04-19T03:04:50.628023+0000","last_became_peered":"2024-04-19T03:04:50.628023+0000","last_unstale":"2024-04-19T03:04:50.638732+0000","last_undegraded":"2024-04-19T03:04:50.638732+0000","last_fullsized":"2024-04-19T03:04:50.638732+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:52:41.731698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":21,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-19T03:04:50.628261+0000","last_change":"2024-04-19T03:04:50.616471+0000","last_active":"2024-04-19T03:04:50.628261+0000","last_peered":"2024-04-19T03:04:50.628261+0000","last_clean":"2024-04-19T03:04:50.628261+0000","last_became_active":"2024-04-19T03:04:50.613860+0000","last_became_peered":"2024-04-19T03:04:50.613860+0000","last_unstale":"2024-04-19T03:04:50.628261+0000","last_undegraded":"2024-04-19T03:04:50.628261+0000","last_fullsized":"2024-04-19T03:04:50.628261+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:26:24.246287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":64,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-19T03:04:50.252936+0000","last_change":"2024-04-19T03:01:14.649074+0000","last_active":"2024-04-19T03:04:50.252936+0000","last_peered":"2024-04-19T03:04:50.252936+0000","last_clean":"2024-04-19T03:04:50.252936+0000","last_became_active":"2024-04-19T03:01:14.648217+0000","last_became_peered":"2024-04-19T03:01:14.648217+0000","last_unstale":"2024-04-19T03:04:50.252936+0000","last_undegraded":"2024-04-19T03:04:50.252936+0000","last_fullsized":"2024-04-19T03:04:50.252936+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:57:05.238043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":21,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-19T03:04:50.626078+0000","last_change":"2024-04-19T03:04:50.611026+0000","last_active":"2024-04-19T03:04:50.626078+0000","last_peered":"2024-04-19T03:04:50.626078+0000","last_clean":"2024-04-19T03:04:50.626078+0000","last_became_active":"2024-04-19T03:04:50.610659+0000","last_became_peered":"2024-04-19T03:04:50.610659+0000","last_unstale":"2024-04-19T03:04:50.626078+0000","last_undegraded":"2024-04-19T03:04:50.626078+0000","last_fullsized":"2024-04-19T03:04:50.626078+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:57:17.231684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"20'8","reported_seq":72,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-19T03:04:50.251061+0000","last_change":"2024-04-19T03:01:14.649044+0000","last_active":"2024-04-19T03:04:50.251061+0000","last_peered":"2024-04-19T03:04:50.251061+0000","last_clean":"2024-04-19T03:04:50.251061+0000","last_became_active":"2024-04-19T03:01:14.648859+0000","last_became_peered":"2024-04-19T03:01:14.648859+0000","last_unstale":"2024-04-19T03:04:50.251061+0000","last_undegraded":"2024-04-19T03:04:50.251061+0000","last_fullsized":"2024-04-19T03:04:50.251061+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:30:45.925657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"20'1","reported_seq":65,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-19T03:04:50.251844+0000","last_change":"2024-04-19T03:01:14.649839+0000","last_active":"2024-04-19T03:04:50.251844+0000","last_peered":"2024-04-19T03:04:50.251844+0000","last_clean":"2024-04-19T03:04:50.251844+0000","last_became_active":"2024-04-19T03:01:14.649571+0000","last_became_peered":"2024-04-19T03:01:14.649571+0000","last_unstale":"2024-04-19T03:04:50.251844+0000","last_undegraded":"2024-04-19T03:04:50.251844+0000","last_fullsized":"2024-04-19T03:04:50.251844+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:03:57.839660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":36,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-19T03:04:50.248164+0000","last_change":"2024-04-19T03:02:40.438407+0000","last_active":"2024-04-19T03:04:50.248164+0000","last_peered":"2024-04-19T03:04:50.248164+0000","last_clean":"2024-04-19T03:04:50.248164+0000","last_became_active":"2024-04-19T03:02:40.437605+0000","last_became_peered":"2024-04-19T03:02:40.437605+0000","last_unstale":"2024-04-19T03:04:50.248164+0000","last_undegraded":"2024-04-19T03:04:50.248164+0000","last_fullsized":"2024-04-19T03:04:50.248164+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:00:03.630606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"20'2","reported_seq":66,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-19T03:04:50.255777+0000","last_change":"2024-04-19T03:01:14.645075+0000","last_active":"2024-04-19T03:04:50.255777+0000","last_peered":"2024-04-19T03:04:50.255777+0000","last_clean":"2024-04-19T03:04:50.255777+0000","last_became_active":"2024-04-19T03:01:14.644790+0000","last_became_peered":"2024-04-19T03:01:14.644790+0000","last_unstale":"2024-04-19T03:04:50.255777+0000","last_undegraded":"2024-04-19T03:04:50.255777+0000","last_fullsized":"2024-04-19T03:04:50.255777+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:55:15.035769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-19T03:04:51.603475+0000","last_change":"2024-04-19T03:04:50.634586+0000","last_active":"2024-04-19T03:04:51.603475+0000","last_peered":"2024-04-19T03:04:51.603475+0000","last_clean":"2024-04-19T03:04:51.603475+0000","last_became_active":"2024-04-19T03:04:50.632146+0000","last_became_peered":"2024-04-19T03:04:50.632146+0000","last_unstale":"2024-04-19T03:04:51.603475+0000","last_undegraded":"2024-04-19T03:04:51.603475+0000","last_fullsized":"2024-04-19T03:04:51.603475+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:02:24.584512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"20'1","reported_seq":54,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-19T03:04:50.253270+0000","last_change":"2024-04-19T03:02:15.207891+0000","last_active":"2024-04-19T03:04:50.253270+0000","last_peered":"2024-04-19T03:04:50.253270+0000","last_clean":"2024-04-19T03:04:50.253270+0000","last_became_active":"2024-04-19T03:02:15.207334+0000","last_became_peered":"2024-04-19T03:02:15.207334+0000","last_unstale":"2024-04-19T03:04:50.253270+0000","last_undegraded":"2024-04-19T03:04:50.253270+0000","last_fullsized":"2024-04-19T03:04:50.253270+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:29:49.714544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":76,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-19T03:04:50.279259+0000","last_change":"2024-04-19T03:04:50.277960+0000","last_active":"2024-04-19T03:04:50.279259+0000","last_peered":"2024-04-19T03:04:50.279259+0000","last_clean":"2024-04-19T03:04:50.279259+0000","last_became_active":"2024-04-19T03:04:50.277126+0000","last_became_peered":"2024-04-19T03:04:50.277126+0000","last_unstale":"2024-04-19T03:04:50.279259+0000","last_undegraded":"2024-04-19T03:04:50.279259+0000","last_fullsized":"2024-04-19T03:04:50.279259+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:08:49.146373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":23,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-19T03:04:50.625963+0000","last_change":"2024-04-19T03:04:50.617209+0000","last_active":"2024-04-19T03:04:50.625963+0000","last_peered":"2024-04-19T03:04:50.625963+0000","last_clean":"2024-04-19T03:04:50.625963+0000","last_became_active":"2024-04-19T03:04:50.615518+0000","last_became_peered":"2024-04-19T03:04:50.615518+0000","last_unstale":"2024-04-19T03:04:50.625963+0000","last_undegraded":"2024-04-19T03:04:50.625963+0000","last_fullsized":"2024-04-19T03:04:50.625963+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:13:34.297697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":21,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-19T03:04:50.635317+0000","last_change":"2024-04-19T03:04:50.627120+0000","last_active":"2024-04-19T03:04:50.635317+0000","last_peered":"2024-04-19T03:04:50.635317+0000","last_clean":"2024-04-19T03:04:50.635317+0000","last_became_active":"2024-04-19T03:04:50.625919+0000","last_became_peered":"2024-04-19T03:04:50.625919+0000","last_unstale":"2024-04-19T03:04:50.635317+0000","last_undegraded":"2024-04-19T03:04:50.635317+0000","last_fullsized":"2024-04-19T03:04:50.635317+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:56:19.822304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"20'2","reported_seq":24,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-19T03:04:50.635340+0000","last_change":"2024-04-19T03:04:50.627277+0000","last_active":"2024-04-19T03:04:50.635340+0000","last_peered":"2024-04-19T03:04:50.635340+0000","last_clean":"2024-04-19T03:04:50.635340+0000","last_became_active":"2024-04-19T03:04:50.625931+0000","last_became_peered":"2024-04-19T03:04:50.625931+0000","last_unstale":"2024-04-19T03:04:50.635340+0000","last_undegraded":"2024-04-19T03:04:50.635340+0000","last_fullsized":"2024-04-19T03:04:50.635340+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:30:32.408349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":76,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-19T03:04:50.278364+0000","last_change":"2024-04-19T03:04:50.276253+0000","last_active":"2024-04-19T03:04:50.278364+0000","last_peered":"2024-04-19T03:04:50.278364+0000","last_clean":"2024-04-19T03:04:50.278364+0000","last_became_active":"2024-04-19T03:04:50.275790+0000","last_became_peered":"2024-04-19T03:04:50.275790+0000","last_unstale":"2024-04-19T03:04:50.278364+0000","last_undegraded":"2024-04-19T03:04:50.278364+0000","last_fullsized":"2024-04-19T03:04:50.278364+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:27:05.740505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":77,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-19T03:04:50.279687+0000","last_change":"2024-04-19T03:04:50.278491+0000","last_active":"2024-04-19T03:04:50.279687+0000","last_peered":"2024-04-19T03:04:50.279687+0000","last_clean":"2024-04-19T03:04:50.279687+0000","last_became_active":"2024-04-19T03:04:50.277603+0000","last_became_peered":"2024-04-19T03:04:50.277603+0000","last_unstale":"2024-04-19T03:04:50.279687+0000","last_undegraded":"2024-04-19T03:04:50.279687+0000","last_fullsized":"2024-04-19T03:04:50.279687+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:04:26.211975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":63,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-19T03:04:50.250258+0000","last_change":"2024-04-19T03:01:15.015685+0000","last_active":"2024-04-19T03:04:50.250258+0000","last_peered":"2024-04-19T03:04:50.250258+0000","last_clean":"2024-04-19T03:04:50.250258+0000","last_became_active":"2024-04-19T03:01:15.014847+0000","last_became_peered":"2024-04-19T03:01:15.014847+0000","last_unstale":"2024-04-19T03:04:50.250258+0000","last_undegraded":"2024-04-19T03:04:50.250258+0000","last_fullsized":"2024-04-19T03:04:50.250258+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:51:06.208551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":35,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-19T03:04:50.250322+0000","last_change":"2024-04-19T03:02:40.440434+0000","last_active":"2024-04-19T03:04:50.250322+0000","last_peered":"2024-04-19T03:04:50.250322+0000","last_clean":"2024-04-19T03:04:50.250322+0000","last_became_active":"2024-04-19T03:02:40.439924+0000","last_became_peered":"2024-04-19T03:02:40.439924+0000","last_unstale":"2024-04-19T03:04:50.250322+0000","last_undegraded":"2024-04-19T03:04:50.250322+0000","last_fullsized":"2024-04-19T03:04:50.250322+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:33:16.864267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":63,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-19T03:04:50.250167+0000","last_change":"2024-04-19T03:01:15.014818+0000","last_active":"2024-04-19T03:04:50.250167+0000","last_peered":"2024-04-19T03:04:50.250167+0000","last_clean":"2024-04-19T03:04:50.250167+0000","last_became_active":"2024-04-19T03:01:15.014421+0000","last_became_peered":"2024-04-19T03:01:15.014421+0000","last_unstale":"2024-04-19T03:04:50.250167+0000","last_undegraded":"2024-04-19T03:04:50.250167+0000","last_fullsized":"2024-04-19T03:04:50.250167+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:16:20.475837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-19T03:04:51.603521+0000","last_change":"2024-04-19T03:04:50.616513+0000","last_active":"2024-04-19T03:04:51.603521+0000","last_peered":"2024-04-19T03:04:51.603521+0000","last_clean":"2024-04-19T03:04:51.603521+0000","last_became_active":"2024-04-19T03:04:50.614604+0000","last_became_peered":"2024-04-19T03:04:50.614604+0000","last_unstale":"2024-04-19T03:04:51.603521+0000","last_undegraded":"2024-04-19T03:04:51.603521+0000","last_fullsized":"2024-04-19T03:04:51.603521+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:52:21.648858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":21,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-19T03:04:50.632059+0000","last_change":"2024-04-19T03:04:50.617641+0000","last_active":"2024-04-19T03:04:50.632059+0000","last_peered":"2024-04-19T03:04:50.632059+0000","last_clean":"2024-04-19T03:04:50.632059+0000","last_became_active":"2024-04-19T03:04:50.617323+0000","last_became_peered":"2024-04-19T03:04:50.617323+0000","last_unstale":"2024-04-19T03:04:50.632059+0000","last_undegraded":"2024-04-19T03:04:50.632059+0000","last_fullsized":"2024-04-19T03:04:50.632059+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:26:09.566534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"14'157","reported_seq":265,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-19T03:04:50.252365+0000","last_change":"2024-04-19T03:01:07.538434+0000","last_active":"2024-04-19T03:04:50.252365+0000","last_peered":"2024-04-19T03:04:50.252365+0000","last_clean":"2024-04-19T03:04:50.252365+0000","last_became_active":"2024-04-19T03:01:07.537856+0000","last_became_peered":"2024-04-19T03:01:07.537856+0000","last_unstale":"2024-04-19T03:04:50.252365+0000","last_undegraded":"2024-04-19T03:04:50.252365+0000","last_fullsized":"2024-04-19T03:04:50.252365+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:06.516863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:06.516863+0000","last_clean_scrub_stamp":"2024-04-19T03:01:06.516863+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:36:46.386286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":79,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-19T03:04:50.279524+0000","last_change":"2024-04-19T03:04:50.277227+0000","last_active":"2024-04-19T03:04:50.279524+0000","last_peered":"2024-04-19T03:04:50.279524+0000","last_clean":"2024-04-19T03:04:50.279524+0000","last_became_active":"2024-04-19T03:04:50.276132+0000","last_became_peered":"2024-04-19T03:04:50.276132+0000","last_unstale":"2024-04-19T03:04:50.279524+0000","last_undegraded":"2024-04-19T03:04:50.279524+0000","last_fullsized":"2024-04-19T03:04:50.279524+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_clean_scrub_stamp":"2024-04-19T03:01:09.578660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:36:07.077967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":22,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-19T03:04:50.638701+0000","last_change":"2024-04-19T03:04:50.629139+0000","last_active":"2024-04-19T03:04:50.638701+0000","last_peered":"2024-04-19T03:04:50.638701+0000","last_clean":"2024-04-19T03:04:50.638701+0000","last_became_active":"2024-04-19T03:04:50.628741+0000","last_became_peered":"2024-04-19T03:04:50.628741+0000","last_unstale":"2024-04-19T03:04:50.638701+0000","last_undegraded":"2024-04-19T03:04:50.638701+0000","last_fullsized":"2024-04-19T03:04:50.638701+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:17:48.413908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":60,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-19T03:04:50.250718+0000","last_change":"2024-04-19T03:02:40.440550+0000","last_active":"2024-04-19T03:04:50.250718+0000","last_peered":"2024-04-19T03:04:50.250718+0000","last_clean":"2024-04-19T03:04:50.250718+0000","last_became_active":"2024-04-19T03:02:40.439621+0000","last_became_peered":"2024-04-19T03:02:40.439621+0000","last_unstale":"2024-04-19T03:04:50.250718+0000","last_undegraded":"2024-04-19T03:04:50.250718+0000","last_fullsized":"2024-04-19T03:04:50.250718+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:51:11.593632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":66,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-19T03:04:50.252506+0000","last_change":"2024-04-19T03:01:10.602194+0000","last_active":"2024-04-19T03:04:50.252506+0000","last_peered":"2024-04-19T03:04:50.252506+0000","last_clean":"2024-04-19T03:04:50.252506+0000","last_became_active":"2024-04-19T03:01:10.601381+0000","last_became_peered":"2024-04-19T03:01:10.601381+0000","last_unstale":"2024-04-19T03:04:50.252506+0000","last_undegraded":"2024-04-19T03:04:50.252506+0000","last_fullsized":"2024-04-19T03:04:50.252506+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_clean_scrub_stamp":"2024-04-19T03:01:09.578660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:42:26.594095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":22,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-19T03:04:50.638028+0000","last_change":"2024-04-19T03:04:50.634401+0000","last_active":"2024-04-19T03:04:50.638028+0000","last_peered":"2024-04-19T03:04:50.638028+0000","last_clean":"2024-04-19T03:04:50.638028+0000","last_became_active":"2024-04-19T03:04:50.631721+0000","last_became_peered":"2024-04-19T03:04:50.631721+0000","last_unstale":"2024-04-19T03:04:50.638028+0000","last_undegraded":"2024-04-19T03:04:50.638028+0000","last_fullsized":"2024-04-19T03:04:50.638028+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:40:03.144776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":15,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-19T03:04:51.604952+0000","last_change":"2024-04-19T03:04:50.616635+0000","last_active":"2024-04-19T03:04:51.604952+0000","last_peered":"2024-04-19T03:04:51.604952+0000","last_clean":"2024-04-19T03:04:51.604952+0000","last_became_active":"2024-04-19T03:04:50.614587+0000","last_became_peered":"2024-04-19T03:04:50.614587+0000","last_unstale":"2024-04-19T03:04:51.604952+0000","last_undegraded":"2024-04-19T03:04:51.604952+0000","last_fullsized":"2024-04-19T03:04:51.604952+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:07:13.329439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":21,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-19T03:04:50.639378+0000","last_change":"2024-04-19T03:04:50.635352+0000","last_active":"2024-04-19T03:04:50.639378+0000","last_peered":"2024-04-19T03:04:50.639378+0000","last_clean":"2024-04-19T03:04:50.639378+0000","last_became_active":"2024-04-19T03:04:50.633457+0000","last_became_peered":"2024-04-19T03:04:50.633457+0000","last_unstale":"2024-04-19T03:04:50.639378+0000","last_undegraded":"2024-04-19T03:04:50.639378+0000","last_fullsized":"2024-04-19T03:04:50.639378+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_clean_scrub_stamp":"2024-04-19T03:01:09.578660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:17:18.884148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":64,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-19T03:04:50.252977+0000","last_change":"2024-04-19T03:01:14.649068+0000","last_active":"2024-04-19T03:04:50.252977+0000","last_peered":"2024-04-19T03:04:50.252977+0000","last_clean":"2024-04-19T03:04:50.252977+0000","last_became_active":"2024-04-19T03:01:14.648082+0000","last_became_peered":"2024-04-19T03:01:14.648082+0000","last_unstale":"2024-04-19T03:04:50.252977+0000","last_undegraded":"2024-04-19T03:04:50.252977+0000","last_fullsized":"2024-04-19T03:04:50.252977+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:30:14.489117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":21,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-19T03:04:50.634816+0000","last_change":"2024-04-19T03:04:50.625932+0000","last_active":"2024-04-19T03:04:50.634816+0000","last_peered":"2024-04-19T03:04:50.634816+0000","last_clean":"2024-04-19T03:04:50.634816+0000","last_became_active":"2024-04-19T03:04:50.617628+0000","last_became_peered":"2024-04-19T03:04:50.617628+0000","last_unstale":"2024-04-19T03:04:50.634816+0000","last_undegraded":"2024-04-19T03:04:50.634816+0000","last_fullsized":"2024-04-19T03:04:50.634816+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:52:52.957579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":79,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-19T03:04:50.279712+0000","last_change":"2024-04-19T03:04:50.278737+0000","last_active":"2024-04-19T03:04:50.279712+0000","last_peered":"2024-04-19T03:04:50.279712+0000","last_clean":"2024-04-19T03:04:50.279712+0000","last_became_active":"2024-04-19T03:04:50.277804+0000","last_became_peered":"2024-04-19T03:04:50.277804+0000","last_unstale":"2024-04-19T03:04:50.279712+0000","last_undegraded":"2024-04-19T03:04:50.279712+0000","last_fullsized":"2024-04-19T03:04:50.279712+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_clean_scrub_stamp":"2024-04-19T03:01:09.578660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:00:20.440389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":77,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-19T03:04:50.279495+0000","last_change":"2024-04-19T03:04:50.277141+0000","last_active":"2024-04-19T03:04:50.279495+0000","last_peered":"2024-04-19T03:04:50.279495+0000","last_clean":"2024-04-19T03:04:50.279495+0000","last_became_active":"2024-04-19T03:04:50.275812+0000","last_became_peered":"2024-04-19T03:04:50.275812+0000","last_unstale":"2024-04-19T03:04:50.279495+0000","last_undegraded":"2024-04-19T03:04:50.279495+0000","last_fullsized":"2024-04-19T03:04:50.279495+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:16:29.209241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":21,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-19T03:04:50.625916+0000","last_change":"2024-04-19T03:04:50.616475+0000","last_active":"2024-04-19T03:04:50.625916+0000","last_peered":"2024-04-19T03:04:50.625916+0000","last_clean":"2024-04-19T03:04:50.625916+0000","last_became_active":"2024-04-19T03:04:50.614774+0000","last_became_peered":"2024-04-19T03:04:50.614774+0000","last_unstale":"2024-04-19T03:04:50.625916+0000","last_undegraded":"2024-04-19T03:04:50.625916+0000","last_fullsized":"2024-04-19T03:04:50.625916+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:51:07.142010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":23,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-19T03:04:50.618862+0000","last_change":"2024-04-19T03:04:50.612055+0000","last_active":"2024-04-19T03:04:50.618862+0000","last_peered":"2024-04-19T03:04:50.618862+0000","last_clean":"2024-04-19T03:04:50.618862+0000","last_became_active":"2024-04-19T03:04:50.611010+0000","last_became_peered":"2024-04-19T03:04:50.611010+0000","last_unstale":"2024-04-19T03:04:50.618862+0000","last_undegraded":"2024-04-19T03:04:50.618862+0000","last_fullsized":"2024-04-19T03:04:50.618862+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:24:46.459920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":21,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-19T03:04:50.625870+0000","last_change":"2024-04-19T03:04:50.615925+0000","last_active":"2024-04-19T03:04:50.625870+0000","last_peered":"2024-04-19T03:04:50.625870+0000","last_clean":"2024-04-19T03:04:50.625870+0000","last_became_active":"2024-04-19T03:04:50.614498+0000","last_became_peered":"2024-04-19T03:04:50.614498+0000","last_unstale":"2024-04-19T03:04:50.625870+0000","last_undegraded":"2024-04-19T03:04:50.625870+0000","last_fullsized":"2024-04-19T03:04:50.625870+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_clean_scrub_stamp":"2024-04-19T03:01:09.578660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:41:52.085259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":36,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-19T03:04:50.248802+0000","last_change":"2024-04-19T03:02:40.440057+0000","last_active":"2024-04-19T03:04:50.248802+0000","last_peered":"2024-04-19T03:04:50.248802+0000","last_clean":"2024-04-19T03:04:50.248802+0000","last_became_active":"2024-04-19T03:02:40.439752+0000","last_became_peered":"2024-04-19T03:02:40.439752+0000","last_unstale":"2024-04-19T03:04:50.248802+0000","last_undegraded":"2024-04-19T03:04:50.248802+0000","last_fullsized":"2024-04-19T03:04:50.248802+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:38:12.336658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":22,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-19T03:04:50.625939+0000","last_change":"2024-04-19T03:04:50.616970+0000","last_active":"2024-04-19T03:04:50.625939+0000","last_peered":"2024-04-19T03:04:50.625939+0000","last_clean":"2024-04-19T03:04:50.625939+0000","last_became_active":"2024-04-19T03:04:50.615238+0000","last_became_peered":"2024-04-19T03:04:50.615238+0000","last_unstale":"2024-04-19T03:04:50.625939+0000","last_undegraded":"2024-04-19T03:04:50.625939+0000","last_fullsized":"2024-04-19T03:04:50.625939+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:55:14.049921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-19T03:04:51.604135+0000","last_change":"2024-04-19T03:04:50.612749+0000","last_active":"2024-04-19T03:04:51.604135+0000","last_peered":"2024-04-19T03:04:51.604135+0000","last_clean":"2024-04-19T03:04:51.604135+0000","last_became_active":"2024-04-19T03:04:50.612029+0000","last_became_peered":"2024-04-19T03:04:50.612029+0000","last_unstale":"2024-04-19T03:04:51.604135+0000","last_undegraded":"2024-04-19T03:04:51.604135+0000","last_fullsized":"2024-04-19T03:04:51.604135+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_clean_scrub_stamp":"2024-04-19T03:01:09.578660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:08:24.466181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":36,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-19T03:04:50.251337+0000","last_change":"2024-04-19T03:02:40.440227+0000","last_active":"2024-04-19T03:04:50.251337+0000","last_peered":"2024-04-19T03:04:50.251337+0000","last_clean":"2024-04-19T03:04:50.251337+0000","last_became_active":"2024-04-19T03:02:40.439732+0000","last_became_peered":"2024-04-19T03:02:40.439732+0000","last_unstale":"2024-04-19T03:04:50.251337+0000","last_undegraded":"2024-04-19T03:04:50.251337+0000","last_fullsized":"2024-04-19T03:04:50.251337+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:29:33.660584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"20'2","reported_seq":24,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-19T03:04:50.626103+0000","last_change":"2024-04-19T03:04:50.611678+0000","last_active":"2024-04-19T03:04:50.626103+0000","last_peered":"2024-04-19T03:04:50.626103+0000","last_clean":"2024-04-19T03:04:50.626103+0000","last_became_active":"2024-04-19T03:04:50.611024+0000","last_became_peered":"2024-04-19T03:04:50.611024+0000","last_unstale":"2024-04-19T03:04:50.626103+0000","last_undegraded":"2024-04-19T03:04:50.626103+0000","last_fullsized":"2024-04-19T03:04:50.626103+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:08:43.323149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":21,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-19T03:04:50.628208+0000","last_change":"2024-04-19T03:04:50.616003+0000","last_active":"2024-04-19T03:04:50.628208+0000","last_peered":"2024-04-19T03:04:50.628208+0000","last_clean":"2024-04-19T03:04:50.628208+0000","last_became_active":"2024-04-19T03:04:50.612403+0000","last_became_peered":"2024-04-19T03:04:50.612403+0000","last_unstale":"2024-04-19T03:04:50.628208+0000","last_undegraded":"2024-04-19T03:04:50.628208+0000","last_fullsized":"2024-04-19T03:04:50.628208+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_clean_scrub_stamp":"2024-04-19T03:01:09.578660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:16:44.156874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":21,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-19T03:04:50.629849+0000","last_change":"2024-04-19T03:04:50.615936+0000","last_active":"2024-04-19T03:04:50.629849+0000","last_peered":"2024-04-19T03:04:50.629849+0000","last_clean":"2024-04-19T03:04:50.629849+0000","last_became_active":"2024-04-19T03:04:50.612987+0000","last_became_peered":"2024-04-19T03:04:50.612987+0000","last_unstale":"2024-04-19T03:04:50.629849+0000","last_undegraded":"2024-04-19T03:04:50.629849+0000","last_fullsized":"2024-04-19T03:04:50.629849+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:17:39.989639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"21'1","reported_seq":25,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-19T03:04:50.628236+0000","last_change":"2024-04-19T03:04:50.616200+0000","last_active":"2024-04-19T03:04:50.628236+0000","last_peered":"2024-04-19T03:04:50.628236+0000","last_clean":"2024-04-19T03:04:50.628236+0000","last_became_active":"2024-04-19T03:04:50.612697+0000","last_became_peered":"2024-04-19T03:04:50.612697+0000","last_unstale":"2024-04-19T03:04:50.628236+0000","last_undegraded":"2024-04-19T03:04:50.628236+0000","last_fullsized":"2024-04-19T03:04:50.628236+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:28:55.970411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":66,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-19T03:04:50.251786+0000","last_change":"2024-04-19T03:01:10.602274+0000","last_active":"2024-04-19T03:04:50.251786+0000","last_peered":"2024-04-19T03:04:50.251786+0000","last_clean":"2024-04-19T03:04:50.251786+0000","last_became_active":"2024-04-19T03:01:10.601487+0000","last_became_peered":"2024-04-19T03:01:10.601487+0000","last_unstale":"2024-04-19T03:04:50.251786+0000","last_undegraded":"2024-04-19T03:04:50.251786+0000","last_fullsized":"2024-04-19T03:04:50.251786+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_clean_scrub_stamp":"2024-04-19T03:01:09.578660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:26:16.712446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":63,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-19T03:04:50.251878+0000","last_change":"2024-04-19T03:01:15.018914+0000","last_active":"2024-04-19T03:04:50.251878+0000","last_peered":"2024-04-19T03:04:50.251878+0000","last_clean":"2024-04-19T03:04:50.251878+0000","last_became_active":"2024-04-19T03:01:15.018276+0000","last_became_peered":"2024-04-19T03:01:15.018276+0000","last_unstale":"2024-04-19T03:04:50.251878+0000","last_undegraded":"2024-04-19T03:04:50.251878+0000","last_fullsized":"2024-04-19T03:04:50.251878+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:40:59.453079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":63,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-19T03:04:50.251626+0000","last_change":"2024-04-19T03:01:15.015855+0000","last_active":"2024-04-19T03:04:50.251626+0000","last_peered":"2024-04-19T03:04:50.251626+0000","last_clean":"2024-04-19T03:04:50.251626+0000","last_became_active":"2024-04-19T03:01:15.015358+0000","last_became_peered":"2024-04-19T03:01:15.015358+0000","last_unstale":"2024-04-19T03:04:50.251626+0000","last_undegraded":"2024-04-19T03:04:50.251626+0000","last_fullsized":"2024-04-19T03:04:50.251626+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:59:49.270245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"20'6","reported_seq":70,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-19T03:04:50.251556+0000","last_change":"2024-04-19T03:01:14.649577+0000","last_active":"2024-04-19T03:04:50.251556+0000","last_peered":"2024-04-19T03:04:50.251556+0000","last_clean":"2024-04-19T03:04:50.251556+0000","last_became_active":"2024-04-19T03:01:14.649284+0000","last_became_peered":"2024-04-19T03:01:14.649284+0000","last_unstale":"2024-04-19T03:04:50.251556+0000","last_undegraded":"2024-04-19T03:04:50.251556+0000","last_fullsized":"2024-04-19T03:04:50.251556+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:01:22.214742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":21,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-19T03:04:50.638647+0000","last_change":"2024-04-19T03:04:50.628406+0000","last_active":"2024-04-19T03:04:50.638647+0000","last_peered":"2024-04-19T03:04:50.638647+0000","last_clean":"2024-04-19T03:04:50.638647+0000","last_became_active":"2024-04-19T03:04:50.627654+0000","last_became_peered":"2024-04-19T03:04:50.627654+0000","last_unstale":"2024-04-19T03:04:50.638647+0000","last_undegraded":"2024-04-19T03:04:50.638647+0000","last_fullsized":"2024-04-19T03:04:50.638647+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:17:57.101098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"20'3","reported_seq":43,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-19T03:04:50.250516+0000","last_change":"2024-04-19T03:02:40.442253+0000","last_active":"2024-04-19T03:04:50.250516+0000","last_peered":"2024-04-19T03:04:50.250516+0000","last_clean":"2024-04-19T03:04:50.250516+0000","last_became_active":"2024-04-19T03:02:40.441225+0000","last_became_peered":"2024-04-19T03:02:40.441225+0000","last_unstale":"2024-04-19T03:04:50.250516+0000","last_undegraded":"2024-04-19T03:04:50.250516+0000","last_fullsized":"2024-04-19T03:04:50.250516+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:51:10.208584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":23,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-19T03:04:50.628323+0000","last_change":"2024-04-19T03:04:50.617205+0000","last_active":"2024-04-19T03:04:50.628323+0000","last_peered":"2024-04-19T03:04:50.628323+0000","last_clean":"2024-04-19T03:04:50.628323+0000","last_became_active":"2024-04-19T03:04:50.616879+0000","last_became_peered":"2024-04-19T03:04:50.616879+0000","last_unstale":"2024-04-19T03:04:50.628323+0000","last_undegraded":"2024-04-19T03:04:50.628323+0000","last_fullsized":"2024-04-19T03:04:50.628323+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:58:21.203090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":21,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-19T03:04:50.637983+0000","last_change":"2024-04-19T03:04:50.634026+0000","last_active":"2024-04-19T03:04:50.637983+0000","last_peered":"2024-04-19T03:04:50.637983+0000","last_clean":"2024-04-19T03:04:50.637983+0000","last_became_active":"2024-04-19T03:04:50.630873+0000","last_became_peered":"2024-04-19T03:04:50.630873+0000","last_unstale":"2024-04-19T03:04:50.637983+0000","last_undegraded":"2024-04-19T03:04:50.637983+0000","last_fullsized":"2024-04-19T03:04:50.637983+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:41:25.674376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":22,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-19T03:04:50.626181+0000","last_change":"2024-04-19T03:04:50.612483+0000","last_active":"2024-04-19T03:04:50.626181+0000","last_peered":"2024-04-19T03:04:50.626181+0000","last_clean":"2024-04-19T03:04:50.626181+0000","last_became_active":"2024-04-19T03:04:50.612005+0000","last_became_peered":"2024-04-19T03:04:50.612005+0000","last_unstale":"2024-04-19T03:04:50.626181+0000","last_undegraded":"2024-04-19T03:04:50.626181+0000","last_fullsized":"2024-04-19T03:04:50.626181+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:56:45.629955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":21,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-19T03:04:50.629878+0000","last_change":"2024-04-19T03:04:50.616158+0000","last_active":"2024-04-19T03:04:50.629878+0000","last_peered":"2024-04-19T03:04:50.629878+0000","last_clean":"2024-04-19T03:04:50.629878+0000","last_became_active":"2024-04-19T03:04:50.613735+0000","last_became_peered":"2024-04-19T03:04:50.613735+0000","last_unstale":"2024-04-19T03:04:50.629878+0000","last_undegraded":"2024-04-19T03:04:50.629878+0000","last_fullsized":"2024-04-19T03:04:50.629878+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:25:58.128503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":36,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-19T03:04:50.250938+0000","last_change":"2024-04-19T03:02:40.442421+0000","last_active":"2024-04-19T03:04:50.250938+0000","last_peered":"2024-04-19T03:04:50.250938+0000","last_clean":"2024-04-19T03:04:50.250938+0000","last_became_active":"2024-04-19T03:02:40.441746+0000","last_became_peered":"2024-04-19T03:02:40.441746+0000","last_unstale":"2024-04-19T03:04:50.250938+0000","last_undegraded":"2024-04-19T03:04:50.250938+0000","last_fullsized":"2024-04-19T03:04:50.250938+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:52:55.719264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":22,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-19T03:04:50.629924+0000","last_change":"2024-04-19T03:04:50.616430+0000","last_active":"2024-04-19T03:04:50.629924+0000","last_peered":"2024-04-19T03:04:50.629924+0000","last_clean":"2024-04-19T03:04:50.629924+0000","last_became_active":"2024-04-19T03:04:50.613523+0000","last_became_peered":"2024-04-19T03:04:50.613523+0000","last_unstale":"2024-04-19T03:04:50.629924+0000","last_undegraded":"2024-04-19T03:04:50.629924+0000","last_fullsized":"2024-04-19T03:04:50.629924+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:22:43.207543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":21,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-19T03:04:50.628304+0000","last_change":"2024-04-19T03:04:50.616829+0000","last_active":"2024-04-19T03:04:50.628304+0000","last_peered":"2024-04-19T03:04:50.628304+0000","last_clean":"2024-04-19T03:04:50.628304+0000","last_became_active":"2024-04-19T03:04:50.616545+0000","last_became_peered":"2024-04-19T03:04:50.616545+0000","last_unstale":"2024-04-19T03:04:50.628304+0000","last_undegraded":"2024-04-19T03:04:50.628304+0000","last_fullsized":"2024-04-19T03:04:50.628304+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:07:32.515729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":22,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-19T03:04:50.637999+0000","last_change":"2024-04-19T03:04:50.634214+0000","last_active":"2024-04-19T03:04:50.637999+0000","last_peered":"2024-04-19T03:04:50.637999+0000","last_clean":"2024-04-19T03:04:50.637999+0000","last_became_active":"2024-04-19T03:04:50.631699+0000","last_became_peered":"2024-04-19T03:04:50.631699+0000","last_unstale":"2024-04-19T03:04:50.637999+0000","last_undegraded":"2024-04-19T03:04:50.637999+0000","last_fullsized":"2024-04-19T03:04:50.637999+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:43:10.184280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":35,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-19T03:04:50.249331+0000","last_change":"2024-04-19T03:02:40.441670+0000","last_active":"2024-04-19T03:04:50.249331+0000","last_peered":"2024-04-19T03:04:50.249331+0000","last_clean":"2024-04-19T03:04:50.249331+0000","last_became_active":"2024-04-19T03:02:40.441294+0000","last_became_peered":"2024-04-19T03:02:40.441294+0000","last_unstale":"2024-04-19T03:04:50.249331+0000","last_undegraded":"2024-04-19T03:04:50.249331+0000","last_fullsized":"2024-04-19T03:04:50.249331+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:59:32.330785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"20'1","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-19T03:04:51.603581+0000","last_change":"2024-04-19T03:04:50.612263+0000","last_active":"2024-04-19T03:04:51.603581+0000","last_peered":"2024-04-19T03:04:51.603581+0000","last_clean":"2024-04-19T03:04:51.603581+0000","last_became_active":"2024-04-19T03:04:50.611850+0000","last_became_peered":"2024-04-19T03:04:50.611850+0000","last_unstale":"2024-04-19T03:04:51.603581+0000","last_undegraded":"2024-04-19T03:04:51.603581+0000","last_fullsized":"2024-04-19T03:04:51.603581+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:26:47.367018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":15,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-19T03:04:51.605315+0000","last_change":"2024-04-19T03:04:50.627129+0000","last_active":"2024-04-19T03:04:51.605315+0000","last_peered":"2024-04-19T03:04:51.605315+0000","last_clean":"2024-04-19T03:04:51.605315+0000","last_became_active":"2024-04-19T03:04:50.626547+0000","last_became_peered":"2024-04-19T03:04:50.626547+0000","last_unstale":"2024-04-19T03:04:51.605315+0000","last_undegraded":"2024-04-19T03:04:51.605315+0000","last_fullsized":"2024-04-19T03:04:51.605315+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:43:35.716650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"20'1","reported_seq":38,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-19T03:04:51.604262+0000","last_change":"2024-04-19T03:04:50.626274+0000","last_active":"2024-04-19T03:04:51.604262+0000","last_peered":"2024-04-19T03:04:51.604262+0000","last_clean":"2024-04-19T03:04:51.604262+0000","last_became_active":"2024-04-19T03:04:50.618516+0000","last_became_peered":"2024-04-19T03:04:50.618516+0000","last_unstale":"2024-04-19T03:04:51.604262+0000","last_undegraded":"2024-04-19T03:04:51.604262+0000","last_fullsized":"2024-04-19T03:04:51.604262+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:18:07.170476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":76,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-19T03:04:50.278594+0000","last_change":"2024-04-19T03:04:50.276250+0000","last_active":"2024-04-19T03:04:50.278594+0000","last_peered":"2024-04-19T03:04:50.278594+0000","last_clean":"2024-04-19T03:04:50.278594+0000","last_became_active":"2024-04-19T03:04:50.275226+0000","last_became_peered":"2024-04-19T03:04:50.275226+0000","last_unstale":"2024-04-19T03:04:50.278594+0000","last_undegraded":"2024-04-19T03:04:50.278594+0000","last_fullsized":"2024-04-19T03:04:50.278594+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:22:34.069251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"20'2","reported_seq":79,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-19T03:04:50.278322+0000","last_change":"2024-04-19T03:04:50.276105+0000","last_active":"2024-04-19T03:04:50.278322+0000","last_peered":"2024-04-19T03:04:50.278322+0000","last_clean":"2024-04-19T03:04:50.278322+0000","last_became_active":"2024-04-19T03:04:50.275533+0000","last_became_peered":"2024-04-19T03:04:50.275533+0000","last_unstale":"2024-04-19T03:04:50.278322+0000","last_undegraded":"2024-04-19T03:04:50.278322+0000","last_fullsized":"2024-04-19T03:04:50.278322+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:38:13.683481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":76,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-19T03:04:50.279654+0000","last_change":"2024-04-19T03:04:50.278401+0000","last_active":"2024-04-19T03:04:50.279654+0000","last_peered":"2024-04-19T03:04:50.279654+0000","last_clean":"2024-04-19T03:04:50.279654+0000","last_became_active":"2024-04-19T03:04:50.277348+0000","last_became_peered":"2024-04-19T03:04:50.277348+0000","last_unstale":"2024-04-19T03:04:50.279654+0000","last_undegraded":"2024-04-19T03:04:50.279654+0000","last_fullsized":"2024-04-19T03:04:50.279654+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:19:35.891753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"20'2","reported_seq":43,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-19T03:04:50.249995+0000","last_change":"2024-04-19T03:02:40.441689+0000","last_active":"2024-04-19T03:04:50.249995+0000","last_peered":"2024-04-19T03:04:50.249995+0000","last_clean":"2024-04-19T03:04:50.249995+0000","last_became_active":"2024-04-19T03:02:40.440206+0000","last_became_peered":"2024-04-19T03:02:40.440206+0000","last_unstale":"2024-04-19T03:04:50.249995+0000","last_undegraded":"2024-04-19T03:04:50.249995+0000","last_fullsized":"2024-04-19T03:04:50.249995+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:02:19.100804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-19T03:04:51.603775+0000","last_change":"2024-04-19T03:04:50.634940+0000","last_active":"2024-04-19T03:04:51.603775+0000","last_peered":"2024-04-19T03:04:51.603775+0000","last_clean":"2024-04-19T03:04:51.603775+0000","last_became_active":"2024-04-19T03:04:50.632660+0000","last_became_peered":"2024-04-19T03:04:50.632660+0000","last_unstale":"2024-04-19T03:04:51.603775+0000","last_undegraded":"2024-04-19T03:04:51.603775+0000","last_fullsized":"2024-04-19T03:04:51.603775+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:23:26.030101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"20'1","reported_seq":24,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-19T03:04:50.635670+0000","last_change":"2024-04-19T03:04:50.627670+0000","last_active":"2024-04-19T03:04:50.635670+0000","last_peered":"2024-04-19T03:04:50.635670+0000","last_clean":"2024-04-19T03:04:50.635670+0000","last_became_active":"2024-04-19T03:04:50.627304+0000","last_became_peered":"2024-04-19T03:04:50.627304+0000","last_unstale":"2024-04-19T03:04:50.635670+0000","last_undegraded":"2024-04-19T03:04:50.635670+0000","last_fullsized":"2024-04-19T03:04:50.635670+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:29:08.875911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":76,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-19T03:04:50.280167+0000","last_change":"2024-04-19T03:04:50.279334+0000","last_active":"2024-04-19T03:04:50.280167+0000","last_peered":"2024-04-19T03:04:50.280167+0000","last_clean":"2024-04-19T03:04:50.280167+0000","last_became_active":"2024-04-19T03:04:50.278874+0000","last_became_peered":"2024-04-19T03:04:50.278874+0000","last_unstale":"2024-04-19T03:04:50.280167+0000","last_undegraded":"2024-04-19T03:04:50.280167+0000","last_fullsized":"2024-04-19T03:04:50.280167+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:51:33.707741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"20'4","reported_seq":24,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-19T03:04:50.635019+0000","last_change":"2024-04-19T03:04:50.627070+0000","last_active":"2024-04-19T03:04:50.635019+0000","last_peered":"2024-04-19T03:04:50.635019+0000","last_clean":"2024-04-19T03:04:50.635019+0000","last_became_active":"2024-04-19T03:04:50.626334+0000","last_became_peered":"2024-04-19T03:04:50.626334+0000","last_unstale":"2024-04-19T03:04:50.635019+0000","last_undegraded":"2024-04-19T03:04:50.635019+0000","last_fullsized":"2024-04-19T03:04:50.635019+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:24:58.586175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5289,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":14482,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":10,"seq":42949673012,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":220648,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":219774,"kb_avail":94151192,"statfs":{"total":96636764160,"available":96410820608,"internally_reserved":0,"allocated":880640,"data_stored":895683,"data_compressed":7241,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":225049030},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 19 03:02:08 2024","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"last":0.70299999999999996}]},{"osd":1,"last update":"Fri Apr 19 03:04:11 2024","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.19900000000000001,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.87,"5min":2.5030000000000001,"15min":2.5030000000000001},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.57099999999999995,"15min":0.56299999999999994},"min":{"1min":0.23999999999999999,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.90400000000000003,"5min":2.6379999999999999,"15min":2.6379999999999999},"last":0.63900000000000001}]}]},{"osd":1,"up_from":10,"seq":42949673011,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":202608,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":201726,"kb_avail":94169232,"statfs":{"total":96636764160,"available":96429293568,"internally_reserved":0,"allocated":876544,"data_stored":897230,"data_compressed":7241,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":206567878},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 19 03:02:04 2024","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.63500000000000001}]},{"osd":2,"last update":"Fri Apr 19 03:04:07 2024","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.47899999999999998,"15min":0.501},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":0.79400000000000004,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.48499999999999999,"15min":0.51400000000000001},"min":{"1min":0.26100000000000001,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.83899999999999997,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.66400000000000003}]}]},{"osd":0,"up_from":71,"seq":304942678018,"num_pgs":73,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47648,"kb_used_data":784,"kb_used_omap":6,"kb_used_meta":46841,"kb_avail":94324192,"statfs":{"total":96636764160,"available":96587972608,"internally_reserved":0,"allocated":802816,"data_stored":305732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6883,"internal_metadata":47965469},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59099999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67600000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":7241,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":7241,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5289,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-19T03:04:59.712 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-19T03:05:00.039 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-19T03:05:00.041 INFO:teuthology.orchestra.run.smithi096.stderr:dumped all 2024-04-19T03:05:00.055 INFO:teuthology.orchestra.run.smithi096.stdout:{"pg_ready":true,"pg_map":{"version":186,"stamp":"2024-04-19T03:04:58.044904+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":470904,"kb_used_data":2500,"kb_used_omap":9,"kb_used_meta":468342,"kb_avail":282644616,"statfs":{"total":289910292480,"available":289428086784,"internally_reserved":0,"allocated":2560000,"data_stored":2098645,"data_compressed":14482,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":10071,"internal_metadata":479582377},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-8,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.003834"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":15,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-19T03:04:51.605216+0000","last_change":"2024-04-19T03:04:50.612508+0000","last_active":"2024-04-19T03:04:51.605216+0000","last_peered":"2024-04-19T03:04:51.605216+0000","last_clean":"2024-04-19T03:04:51.605216+0000","last_became_active":"2024-04-19T03:04:50.612040+0000","last_became_peered":"2024-04-19T03:04:50.612040+0000","last_unstale":"2024-04-19T03:04:51.605216+0000","last_undegraded":"2024-04-19T03:04:51.605216+0000","last_fullsized":"2024-04-19T03:04:51.605216+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:18:02.587927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":76,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-19T03:04:50.283861+0000","last_change":"2024-04-19T03:04:50.278334+0000","last_active":"2024-04-19T03:04:50.283861+0000","last_peered":"2024-04-19T03:04:50.283861+0000","last_clean":"2024-04-19T03:04:50.283861+0000","last_became_active":"2024-04-19T03:04:50.277848+0000","last_became_peered":"2024-04-19T03:04:50.277848+0000","last_unstale":"2024-04-19T03:04:50.283861+0000","last_undegraded":"2024-04-19T03:04:50.283861+0000","last_fullsized":"2024-04-19T03:04:50.283861+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:57:39.589383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":63,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-19T03:04:50.252427+0000","last_change":"2024-04-19T03:01:15.015884+0000","last_active":"2024-04-19T03:04:50.252427+0000","last_peered":"2024-04-19T03:04:50.252427+0000","last_clean":"2024-04-19T03:04:50.252427+0000","last_became_active":"2024-04-19T03:01:15.014599+0000","last_became_peered":"2024-04-19T03:01:15.014599+0000","last_unstale":"2024-04-19T03:04:50.252427+0000","last_undegraded":"2024-04-19T03:04:50.252427+0000","last_fullsized":"2024-04-19T03:04:50.252427+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:35:19.436344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":76,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-19T03:04:50.276611+0000","last_change":"2024-04-19T03:04:50.275017+0000","last_active":"2024-04-19T03:04:50.276611+0000","last_peered":"2024-04-19T03:04:50.276611+0000","last_clean":"2024-04-19T03:04:50.276611+0000","last_became_active":"2024-04-19T03:04:50.274600+0000","last_became_peered":"2024-04-19T03:04:50.274600+0000","last_unstale":"2024-04-19T03:04:50.276611+0000","last_undegraded":"2024-04-19T03:04:50.276611+0000","last_fullsized":"2024-04-19T03:04:50.276611+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:21:44.006351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":15,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-19T03:04:51.604382+0000","last_change":"2024-04-19T03:04:50.626581+0000","last_active":"2024-04-19T03:04:51.604382+0000","last_peered":"2024-04-19T03:04:51.604382+0000","last_clean":"2024-04-19T03:04:51.604382+0000","last_became_active":"2024-04-19T03:04:50.618669+0000","last_became_peered":"2024-04-19T03:04:50.618669+0000","last_unstale":"2024-04-19T03:04:51.604382+0000","last_undegraded":"2024-04-19T03:04:51.604382+0000","last_fullsized":"2024-04-19T03:04:51.604382+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:27:58.006985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":24,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-19T03:04:50.638678+0000","last_change":"2024-04-19T03:04:50.628582+0000","last_active":"2024-04-19T03:04:50.638678+0000","last_peered":"2024-04-19T03:04:50.638678+0000","last_clean":"2024-04-19T03:04:50.638678+0000","last_became_active":"2024-04-19T03:04:50.627684+0000","last_became_peered":"2024-04-19T03:04:50.627684+0000","last_unstale":"2024-04-19T03:04:50.638678+0000","last_undegraded":"2024-04-19T03:04:50.638678+0000","last_fullsized":"2024-04-19T03:04:50.638678+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:10:23.005064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":24,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-19T03:04:50.639395+0000","last_change":"2024-04-19T03:04:50.635434+0000","last_active":"2024-04-19T03:04:50.639395+0000","last_peered":"2024-04-19T03:04:50.639395+0000","last_clean":"2024-04-19T03:04:50.639395+0000","last_became_active":"2024-04-19T03:04:50.633594+0000","last_became_peered":"2024-04-19T03:04:50.633594+0000","last_unstale":"2024-04-19T03:04:50.639395+0000","last_undegraded":"2024-04-19T03:04:50.639395+0000","last_fullsized":"2024-04-19T03:04:50.639395+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:18:54.877499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":76,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-19T03:04:50.263132+0000","last_change":"2024-04-19T03:04:50.261359+0000","last_active":"2024-04-19T03:04:50.263132+0000","last_peered":"2024-04-19T03:04:50.263132+0000","last_clean":"2024-04-19T03:04:50.263132+0000","last_became_active":"2024-04-19T03:04:50.261155+0000","last_became_peered":"2024-04-19T03:04:50.261155+0000","last_unstale":"2024-04-19T03:04:50.263132+0000","last_undegraded":"2024-04-19T03:04:50.263132+0000","last_fullsized":"2024-04-19T03:04:50.263132+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:09:37.911709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":21,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-19T03:04:50.626163+0000","last_change":"2024-04-19T03:04:50.611854+0000","last_active":"2024-04-19T03:04:50.626163+0000","last_peered":"2024-04-19T03:04:50.626163+0000","last_clean":"2024-04-19T03:04:50.626163+0000","last_became_active":"2024-04-19T03:04:50.611400+0000","last_became_peered":"2024-04-19T03:04:50.611400+0000","last_unstale":"2024-04-19T03:04:50.626163+0000","last_undegraded":"2024-04-19T03:04:50.626163+0000","last_fullsized":"2024-04-19T03:04:50.626163+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:33:58.731162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":76,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-19T03:04:50.283894+0000","last_change":"2024-04-19T03:04:50.278337+0000","last_active":"2024-04-19T03:04:50.283894+0000","last_peered":"2024-04-19T03:04:50.283894+0000","last_clean":"2024-04-19T03:04:50.283894+0000","last_became_active":"2024-04-19T03:04:50.277899+0000","last_became_peered":"2024-04-19T03:04:50.277899+0000","last_unstale":"2024-04-19T03:04:50.283894+0000","last_undegraded":"2024-04-19T03:04:50.283894+0000","last_fullsized":"2024-04-19T03:04:50.283894+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:32:49.546687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":24,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-19T03:04:50.618809+0000","last_change":"2024-04-19T03:04:50.612405+0000","last_active":"2024-04-19T03:04:50.618809+0000","last_peered":"2024-04-19T03:04:50.618809+0000","last_clean":"2024-04-19T03:04:50.618809+0000","last_became_active":"2024-04-19T03:04:50.611103+0000","last_became_peered":"2024-04-19T03:04:50.611103+0000","last_unstale":"2024-04-19T03:04:50.618809+0000","last_undegraded":"2024-04-19T03:04:50.618809+0000","last_fullsized":"2024-04-19T03:04:50.618809+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:19:06.653369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":35,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-19T03:04:50.248889+0000","last_change":"2024-04-19T03:02:40.438738+0000","last_active":"2024-04-19T03:04:50.248889+0000","last_peered":"2024-04-19T03:04:50.248889+0000","last_clean":"2024-04-19T03:04:50.248889+0000","last_became_active":"2024-04-19T03:02:40.438000+0000","last_became_peered":"2024-04-19T03:02:40.438000+0000","last_unstale":"2024-04-19T03:04:50.248889+0000","last_undegraded":"2024-04-19T03:04:50.248889+0000","last_fullsized":"2024-04-19T03:04:50.248889+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:35:10.932021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":15,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-19T03:04:51.604818+0000","last_change":"2024-04-19T03:04:50.628927+0000","last_active":"2024-04-19T03:04:51.604818+0000","last_peered":"2024-04-19T03:04:51.604818+0000","last_clean":"2024-04-19T03:04:51.604818+0000","last_became_active":"2024-04-19T03:04:50.626854+0000","last_became_peered":"2024-04-19T03:04:50.626854+0000","last_unstale":"2024-04-19T03:04:51.604818+0000","last_undegraded":"2024-04-19T03:04:51.604818+0000","last_fullsized":"2024-04-19T03:04:51.604818+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:41:04.929370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":63,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-19T03:04:50.249506+0000","last_change":"2024-04-19T03:01:15.010960+0000","last_active":"2024-04-19T03:04:50.249506+0000","last_peered":"2024-04-19T03:04:50.249506+0000","last_clean":"2024-04-19T03:04:50.249506+0000","last_became_active":"2024-04-19T03:01:15.010472+0000","last_became_peered":"2024-04-19T03:01:15.010472+0000","last_unstale":"2024-04-19T03:04:50.249506+0000","last_undegraded":"2024-04-19T03:04:50.249506+0000","last_fullsized":"2024-04-19T03:04:50.249506+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:21:36.129346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":63,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-19T03:04:50.249694+0000","last_change":"2024-04-19T03:01:15.014574+0000","last_active":"2024-04-19T03:04:50.249694+0000","last_peered":"2024-04-19T03:04:50.249694+0000","last_clean":"2024-04-19T03:04:50.249694+0000","last_became_active":"2024-04-19T03:01:15.014096+0000","last_became_peered":"2024-04-19T03:01:15.014096+0000","last_unstale":"2024-04-19T03:04:50.249694+0000","last_undegraded":"2024-04-19T03:04:50.249694+0000","last_fullsized":"2024-04-19T03:04:50.249694+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:01:54.253963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":24,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-19T03:04:50.629821+0000","last_change":"2024-04-19T03:04:50.615462+0000","last_active":"2024-04-19T03:04:50.629821+0000","last_peered":"2024-04-19T03:04:50.629821+0000","last_clean":"2024-04-19T03:04:50.629821+0000","last_became_active":"2024-04-19T03:04:50.612853+0000","last_became_peered":"2024-04-19T03:04:50.612853+0000","last_unstale":"2024-04-19T03:04:50.629821+0000","last_undegraded":"2024-04-19T03:04:50.629821+0000","last_fullsized":"2024-04-19T03:04:50.629821+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:47:30.389938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":21,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-19T03:04:50.626128+0000","last_change":"2024-04-19T03:04:50.611757+0000","last_active":"2024-04-19T03:04:50.626128+0000","last_peered":"2024-04-19T03:04:50.626128+0000","last_clean":"2024-04-19T03:04:50.626128+0000","last_became_active":"2024-04-19T03:04:50.611392+0000","last_became_peered":"2024-04-19T03:04:50.611392+0000","last_unstale":"2024-04-19T03:04:50.626128+0000","last_undegraded":"2024-04-19T03:04:50.626128+0000","last_fullsized":"2024-04-19T03:04:50.626128+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:51:50.768612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":15,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-19T03:04:51.605414+0000","last_change":"2024-04-19T03:04:50.629165+0000","last_active":"2024-04-19T03:04:51.605414+0000","last_peered":"2024-04-19T03:04:51.605414+0000","last_clean":"2024-04-19T03:04:51.605414+0000","last_became_active":"2024-04-19T03:04:50.628394+0000","last_became_peered":"2024-04-19T03:04:50.628394+0000","last_unstale":"2024-04-19T03:04:51.605414+0000","last_undegraded":"2024-04-19T03:04:51.605414+0000","last_fullsized":"2024-04-19T03:04:51.605414+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:17:06.173248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":21,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-19T03:04:50.618909+0000","last_change":"2024-04-19T03:04:50.613858+0000","last_active":"2024-04-19T03:04:50.618909+0000","last_peered":"2024-04-19T03:04:50.618909+0000","last_clean":"2024-04-19T03:04:50.618909+0000","last_became_active":"2024-04-19T03:04:50.613481+0000","last_became_peered":"2024-04-19T03:04:50.613481+0000","last_unstale":"2024-04-19T03:04:50.618909+0000","last_undegraded":"2024-04-19T03:04:50.618909+0000","last_fullsized":"2024-04-19T03:04:50.618909+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:55:45.686937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":76,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-19T03:04:50.276645+0000","last_change":"2024-04-19T03:04:50.275339+0000","last_active":"2024-04-19T03:04:50.276645+0000","last_peered":"2024-04-19T03:04:50.276645+0000","last_clean":"2024-04-19T03:04:50.276645+0000","last_became_active":"2024-04-19T03:04:50.274854+0000","last_became_peered":"2024-04-19T03:04:50.274854+0000","last_unstale":"2024-04-19T03:04:50.276645+0000","last_undegraded":"2024-04-19T03:04:50.276645+0000","last_fullsized":"2024-04-19T03:04:50.276645+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:29:12.816763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":76,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-19T03:04:50.279456+0000","last_change":"2024-04-19T03:04:50.276678+0000","last_active":"2024-04-19T03:04:50.279456+0000","last_peered":"2024-04-19T03:04:50.279456+0000","last_clean":"2024-04-19T03:04:50.279456+0000","last_became_active":"2024-04-19T03:04:50.275510+0000","last_became_peered":"2024-04-19T03:04:50.275510+0000","last_unstale":"2024-04-19T03:04:50.279456+0000","last_undegraded":"2024-04-19T03:04:50.279456+0000","last_fullsized":"2024-04-19T03:04:50.279456+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:17:24.832346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":63,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-19T03:04:50.252238+0000","last_change":"2024-04-19T03:01:15.020108+0000","last_active":"2024-04-19T03:04:50.252238+0000","last_peered":"2024-04-19T03:04:50.252238+0000","last_clean":"2024-04-19T03:04:50.252238+0000","last_became_active":"2024-04-19T03:01:15.018978+0000","last_became_peered":"2024-04-19T03:01:15.018978+0000","last_unstale":"2024-04-19T03:04:50.252238+0000","last_undegraded":"2024-04-19T03:04:50.252238+0000","last_fullsized":"2024-04-19T03:04:50.252238+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:30:22.360053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":21,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-19T03:04:50.637968+0000","last_change":"2024-04-19T03:04:50.633855+0000","last_active":"2024-04-19T03:04:50.637968+0000","last_peered":"2024-04-19T03:04:50.637968+0000","last_clean":"2024-04-19T03:04:50.637968+0000","last_became_active":"2024-04-19T03:04:50.630948+0000","last_became_peered":"2024-04-19T03:04:50.630948+0000","last_unstale":"2024-04-19T03:04:50.637968+0000","last_undegraded":"2024-04-19T03:04:50.637968+0000","last_fullsized":"2024-04-19T03:04:50.637968+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:41:31.676439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":15,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-19T03:04:51.604438+0000","last_change":"2024-04-19T03:04:50.617131+0000","last_active":"2024-04-19T03:04:51.604438+0000","last_peered":"2024-04-19T03:04:51.604438+0000","last_clean":"2024-04-19T03:04:51.604438+0000","last_became_active":"2024-04-19T03:04:50.616716+0000","last_became_peered":"2024-04-19T03:04:50.616716+0000","last_unstale":"2024-04-19T03:04:51.604438+0000","last_undegraded":"2024-04-19T03:04:51.604438+0000","last_fullsized":"2024-04-19T03:04:51.604438+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:25:16.749292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":36,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-19T03:04:50.250721+0000","last_change":"2024-04-19T03:02:40.441681+0000","last_active":"2024-04-19T03:04:50.250721+0000","last_peered":"2024-04-19T03:04:50.250721+0000","last_clean":"2024-04-19T03:04:50.250721+0000","last_became_active":"2024-04-19T03:02:40.441170+0000","last_became_peered":"2024-04-19T03:02:40.441170+0000","last_unstale":"2024-04-19T03:04:50.250721+0000","last_undegraded":"2024-04-19T03:04:50.250721+0000","last_fullsized":"2024-04-19T03:04:50.250721+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:43:25.396638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":21,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-19T03:04:50.634948+0000","last_change":"2024-04-19T03:04:50.626923+0000","last_active":"2024-04-19T03:04:50.634948+0000","last_peered":"2024-04-19T03:04:50.634948+0000","last_clean":"2024-04-19T03:04:50.634948+0000","last_became_active":"2024-04-19T03:04:50.617603+0000","last_became_peered":"2024-04-19T03:04:50.617603+0000","last_unstale":"2024-04-19T03:04:50.634948+0000","last_undegraded":"2024-04-19T03:04:50.634948+0000","last_fullsized":"2024-04-19T03:04:50.634948+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:26:56.826024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":46,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-19T03:04:50.255567+0000","last_change":"2024-04-19T03:02:15.206453+0000","last_active":"2024-04-19T03:04:50.255567+0000","last_peered":"2024-04-19T03:04:50.255567+0000","last_clean":"2024-04-19T03:04:50.255567+0000","last_became_active":"2024-04-19T03:02:15.205905+0000","last_became_peered":"2024-04-19T03:02:15.205905+0000","last_unstale":"2024-04-19T03:04:50.255567+0000","last_undegraded":"2024-04-19T03:04:50.255567+0000","last_fullsized":"2024-04-19T03:04:50.255567+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:48:06.646477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":63,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-19T03:04:50.253230+0000","last_change":"2024-04-19T03:01:15.020098+0000","last_active":"2024-04-19T03:04:50.253230+0000","last_peered":"2024-04-19T03:04:50.253230+0000","last_clean":"2024-04-19T03:04:50.253230+0000","last_became_active":"2024-04-19T03:01:15.019064+0000","last_became_peered":"2024-04-19T03:01:15.019064+0000","last_unstale":"2024-04-19T03:04:50.253230+0000","last_undegraded":"2024-04-19T03:04:50.253230+0000","last_fullsized":"2024-04-19T03:04:50.253230+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:50:06.490191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":21,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-19T03:04:50.626095+0000","last_change":"2024-04-19T03:04:50.616823+0000","last_active":"2024-04-19T03:04:50.626095+0000","last_peered":"2024-04-19T03:04:50.626095+0000","last_clean":"2024-04-19T03:04:50.626095+0000","last_became_active":"2024-04-19T03:04:50.616550+0000","last_became_peered":"2024-04-19T03:04:50.616550+0000","last_unstale":"2024-04-19T03:04:50.626095+0000","last_undegraded":"2024-04-19T03:04:50.626095+0000","last_fullsized":"2024-04-19T03:04:50.626095+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:46:25.096677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":36,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-19T03:04:50.249011+0000","last_change":"2024-04-19T03:02:40.440907+0000","last_active":"2024-04-19T03:04:50.249011+0000","last_peered":"2024-04-19T03:04:50.249011+0000","last_clean":"2024-04-19T03:04:50.249011+0000","last_became_active":"2024-04-19T03:02:40.440351+0000","last_became_peered":"2024-04-19T03:02:40.440351+0000","last_unstale":"2024-04-19T03:04:50.249011+0000","last_undegraded":"2024-04-19T03:04:50.249011+0000","last_fullsized":"2024-04-19T03:04:50.249011+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:36:36.558329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":21,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-19T03:04:50.639360+0000","last_change":"2024-04-19T03:04:50.635141+0000","last_active":"2024-04-19T03:04:50.639360+0000","last_peered":"2024-04-19T03:04:50.639360+0000","last_clean":"2024-04-19T03:04:50.639360+0000","last_became_active":"2024-04-19T03:04:50.633033+0000","last_became_peered":"2024-04-19T03:04:50.633033+0000","last_unstale":"2024-04-19T03:04:50.639360+0000","last_undegraded":"2024-04-19T03:04:50.639360+0000","last_fullsized":"2024-04-19T03:04:50.639360+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:42:01.712749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":76,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-19T03:04:50.280492+0000","last_change":"2024-04-19T03:04:50.279507+0000","last_active":"2024-04-19T03:04:50.280492+0000","last_peered":"2024-04-19T03:04:50.280492+0000","last_clean":"2024-04-19T03:04:50.280492+0000","last_became_active":"2024-04-19T03:04:50.278996+0000","last_became_peered":"2024-04-19T03:04:50.278996+0000","last_unstale":"2024-04-19T03:04:50.280492+0000","last_undegraded":"2024-04-19T03:04:50.280492+0000","last_fullsized":"2024-04-19T03:04:50.280492+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:09:09.816660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":15,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-19T03:04:51.604834+0000","last_change":"2024-04-19T03:04:50.617533+0000","last_active":"2024-04-19T03:04:51.604834+0000","last_peered":"2024-04-19T03:04:51.604834+0000","last_clean":"2024-04-19T03:04:51.604834+0000","last_became_active":"2024-04-19T03:04:50.617272+0000","last_became_peered":"2024-04-19T03:04:50.617272+0000","last_unstale":"2024-04-19T03:04:51.604834+0000","last_undegraded":"2024-04-19T03:04:51.604834+0000","last_fullsized":"2024-04-19T03:04:51.604834+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:11:32.650035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"20'2","reported_seq":79,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-19T03:04:50.279552+0000","last_change":"2024-04-19T03:04:50.277421+0000","last_active":"2024-04-19T03:04:50.279552+0000","last_peered":"2024-04-19T03:04:50.279552+0000","last_clean":"2024-04-19T03:04:50.279552+0000","last_became_active":"2024-04-19T03:04:50.276732+0000","last_became_peered":"2024-04-19T03:04:50.276732+0000","last_unstale":"2024-04-19T03:04:50.279552+0000","last_undegraded":"2024-04-19T03:04:50.279552+0000","last_fullsized":"2024-04-19T03:04:50.279552+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:23:27.191496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":15,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-19T03:04:51.604153+0000","last_change":"2024-04-19T03:04:50.612555+0000","last_active":"2024-04-19T03:04:51.604153+0000","last_peered":"2024-04-19T03:04:51.604153+0000","last_clean":"2024-04-19T03:04:51.604153+0000","last_became_active":"2024-04-19T03:04:50.611785+0000","last_became_peered":"2024-04-19T03:04:50.611785+0000","last_unstale":"2024-04-19T03:04:51.604153+0000","last_undegraded":"2024-04-19T03:04:51.604153+0000","last_fullsized":"2024-04-19T03:04:51.604153+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:07:27.548013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":22,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-19T03:04:50.638732+0000","last_change":"2024-04-19T03:04:50.628801+0000","last_active":"2024-04-19T03:04:50.638732+0000","last_peered":"2024-04-19T03:04:50.638732+0000","last_clean":"2024-04-19T03:04:50.638732+0000","last_became_active":"2024-04-19T03:04:50.628023+0000","last_became_peered":"2024-04-19T03:04:50.628023+0000","last_unstale":"2024-04-19T03:04:50.638732+0000","last_undegraded":"2024-04-19T03:04:50.638732+0000","last_fullsized":"2024-04-19T03:04:50.638732+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:52:41.731698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":21,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-19T03:04:50.628261+0000","last_change":"2024-04-19T03:04:50.616471+0000","last_active":"2024-04-19T03:04:50.628261+0000","last_peered":"2024-04-19T03:04:50.628261+0000","last_clean":"2024-04-19T03:04:50.628261+0000","last_became_active":"2024-04-19T03:04:50.613860+0000","last_became_peered":"2024-04-19T03:04:50.613860+0000","last_unstale":"2024-04-19T03:04:50.628261+0000","last_undegraded":"2024-04-19T03:04:50.628261+0000","last_fullsized":"2024-04-19T03:04:50.628261+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:26:24.246287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":64,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-19T03:04:50.252936+0000","last_change":"2024-04-19T03:01:14.649074+0000","last_active":"2024-04-19T03:04:50.252936+0000","last_peered":"2024-04-19T03:04:50.252936+0000","last_clean":"2024-04-19T03:04:50.252936+0000","last_became_active":"2024-04-19T03:01:14.648217+0000","last_became_peered":"2024-04-19T03:01:14.648217+0000","last_unstale":"2024-04-19T03:04:50.252936+0000","last_undegraded":"2024-04-19T03:04:50.252936+0000","last_fullsized":"2024-04-19T03:04:50.252936+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:57:05.238043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":21,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-19T03:04:50.626078+0000","last_change":"2024-04-19T03:04:50.611026+0000","last_active":"2024-04-19T03:04:50.626078+0000","last_peered":"2024-04-19T03:04:50.626078+0000","last_clean":"2024-04-19T03:04:50.626078+0000","last_became_active":"2024-04-19T03:04:50.610659+0000","last_became_peered":"2024-04-19T03:04:50.610659+0000","last_unstale":"2024-04-19T03:04:50.626078+0000","last_undegraded":"2024-04-19T03:04:50.626078+0000","last_fullsized":"2024-04-19T03:04:50.626078+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:57:17.231684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"20'8","reported_seq":72,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-19T03:04:50.251061+0000","last_change":"2024-04-19T03:01:14.649044+0000","last_active":"2024-04-19T03:04:50.251061+0000","last_peered":"2024-04-19T03:04:50.251061+0000","last_clean":"2024-04-19T03:04:50.251061+0000","last_became_active":"2024-04-19T03:01:14.648859+0000","last_became_peered":"2024-04-19T03:01:14.648859+0000","last_unstale":"2024-04-19T03:04:50.251061+0000","last_undegraded":"2024-04-19T03:04:50.251061+0000","last_fullsized":"2024-04-19T03:04:50.251061+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:30:45.925657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"20'1","reported_seq":65,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-19T03:04:50.251844+0000","last_change":"2024-04-19T03:01:14.649839+0000","last_active":"2024-04-19T03:04:50.251844+0000","last_peered":"2024-04-19T03:04:50.251844+0000","last_clean":"2024-04-19T03:04:50.251844+0000","last_became_active":"2024-04-19T03:01:14.649571+0000","last_became_peered":"2024-04-19T03:01:14.649571+0000","last_unstale":"2024-04-19T03:04:50.251844+0000","last_undegraded":"2024-04-19T03:04:50.251844+0000","last_fullsized":"2024-04-19T03:04:50.251844+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:03:57.839660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":36,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-19T03:04:50.248164+0000","last_change":"2024-04-19T03:02:40.438407+0000","last_active":"2024-04-19T03:04:50.248164+0000","last_peered":"2024-04-19T03:04:50.248164+0000","last_clean":"2024-04-19T03:04:50.248164+0000","last_became_active":"2024-04-19T03:02:40.437605+0000","last_became_peered":"2024-04-19T03:02:40.437605+0000","last_unstale":"2024-04-19T03:04:50.248164+0000","last_undegraded":"2024-04-19T03:04:50.248164+0000","last_fullsized":"2024-04-19T03:04:50.248164+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:00:03.630606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.e","version":"20'2","reported_seq":66,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-19T03:04:50.255777+0000","last_change":"2024-04-19T03:01:14.645075+0000","last_active":"2024-04-19T03:04:50.255777+0000","last_peered":"2024-04-19T03:04:50.255777+0000","last_clean":"2024-04-19T03:04:50.255777+0000","last_became_active":"2024-04-19T03:01:14.644790+0000","last_became_peered":"2024-04-19T03:01:14.644790+0000","last_unstale":"2024-04-19T03:04:50.255777+0000","last_undegraded":"2024-04-19T03:04:50.255777+0000","last_fullsized":"2024-04-19T03:04:50.255777+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:55:15.035769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-19T03:04:51.603475+0000","last_change":"2024-04-19T03:04:50.634586+0000","last_active":"2024-04-19T03:04:51.603475+0000","last_peered":"2024-04-19T03:04:51.603475+0000","last_clean":"2024-04-19T03:04:51.603475+0000","last_became_active":"2024-04-19T03:04:50.632146+0000","last_became_peered":"2024-04-19T03:04:50.632146+0000","last_unstale":"2024-04-19T03:04:51.603475+0000","last_undegraded":"2024-04-19T03:04:51.603475+0000","last_fullsized":"2024-04-19T03:04:51.603475+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:02:24.584512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"20'1","reported_seq":54,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-19T03:04:50.253270+0000","last_change":"2024-04-19T03:02:15.207891+0000","last_active":"2024-04-19T03:04:50.253270+0000","last_peered":"2024-04-19T03:04:50.253270+0000","last_clean":"2024-04-19T03:04:50.253270+0000","last_became_active":"2024-04-19T03:02:15.207334+0000","last_became_peered":"2024-04-19T03:02:15.207334+0000","last_unstale":"2024-04-19T03:04:50.253270+0000","last_undegraded":"2024-04-19T03:04:50.253270+0000","last_fullsized":"2024-04-19T03:04:50.253270+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:29:49.714544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":76,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-19T03:04:50.279259+0000","last_change":"2024-04-19T03:04:50.277960+0000","last_active":"2024-04-19T03:04:50.279259+0000","last_peered":"2024-04-19T03:04:50.279259+0000","last_clean":"2024-04-19T03:04:50.279259+0000","last_became_active":"2024-04-19T03:04:50.277126+0000","last_became_peered":"2024-04-19T03:04:50.277126+0000","last_unstale":"2024-04-19T03:04:50.279259+0000","last_undegraded":"2024-04-19T03:04:50.279259+0000","last_fullsized":"2024-04-19T03:04:50.279259+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:08:49.146373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":23,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-19T03:04:50.625963+0000","last_change":"2024-04-19T03:04:50.617209+0000","last_active":"2024-04-19T03:04:50.625963+0000","last_peered":"2024-04-19T03:04:50.625963+0000","last_clean":"2024-04-19T03:04:50.625963+0000","last_became_active":"2024-04-19T03:04:50.615518+0000","last_became_peered":"2024-04-19T03:04:50.615518+0000","last_unstale":"2024-04-19T03:04:50.625963+0000","last_undegraded":"2024-04-19T03:04:50.625963+0000","last_fullsized":"2024-04-19T03:04:50.625963+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:13:34.297697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":21,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-19T03:04:50.635317+0000","last_change":"2024-04-19T03:04:50.627120+0000","last_active":"2024-04-19T03:04:50.635317+0000","last_peered":"2024-04-19T03:04:50.635317+0000","last_clean":"2024-04-19T03:04:50.635317+0000","last_became_active":"2024-04-19T03:04:50.625919+0000","last_became_peered":"2024-04-19T03:04:50.625919+0000","last_unstale":"2024-04-19T03:04:50.635317+0000","last_undegraded":"2024-04-19T03:04:50.635317+0000","last_fullsized":"2024-04-19T03:04:50.635317+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:56:19.822304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"20'2","reported_seq":24,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-19T03:04:50.635340+0000","last_change":"2024-04-19T03:04:50.627277+0000","last_active":"2024-04-19T03:04:50.635340+0000","last_peered":"2024-04-19T03:04:50.635340+0000","last_clean":"2024-04-19T03:04:50.635340+0000","last_became_active":"2024-04-19T03:04:50.625931+0000","last_became_peered":"2024-04-19T03:04:50.625931+0000","last_unstale":"2024-04-19T03:04:50.635340+0000","last_undegraded":"2024-04-19T03:04:50.635340+0000","last_fullsized":"2024-04-19T03:04:50.635340+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:30:32.408349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":76,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-19T03:04:50.278364+0000","last_change":"2024-04-19T03:04:50.276253+0000","last_active":"2024-04-19T03:04:50.278364+0000","last_peered":"2024-04-19T03:04:50.278364+0000","last_clean":"2024-04-19T03:04:50.278364+0000","last_became_active":"2024-04-19T03:04:50.275790+0000","last_became_peered":"2024-04-19T03:04:50.275790+0000","last_unstale":"2024-04-19T03:04:50.278364+0000","last_undegraded":"2024-04-19T03:04:50.278364+0000","last_fullsized":"2024-04-19T03:04:50.278364+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:27:05.740505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":77,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-19T03:04:50.279687+0000","last_change":"2024-04-19T03:04:50.278491+0000","last_active":"2024-04-19T03:04:50.279687+0000","last_peered":"2024-04-19T03:04:50.279687+0000","last_clean":"2024-04-19T03:04:50.279687+0000","last_became_active":"2024-04-19T03:04:50.277603+0000","last_became_peered":"2024-04-19T03:04:50.277603+0000","last_unstale":"2024-04-19T03:04:50.279687+0000","last_undegraded":"2024-04-19T03:04:50.279687+0000","last_fullsized":"2024-04-19T03:04:50.279687+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:04:26.211975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":63,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-19T03:04:50.250258+0000","last_change":"2024-04-19T03:01:15.015685+0000","last_active":"2024-04-19T03:04:50.250258+0000","last_peered":"2024-04-19T03:04:50.250258+0000","last_clean":"2024-04-19T03:04:50.250258+0000","last_became_active":"2024-04-19T03:01:15.014847+0000","last_became_peered":"2024-04-19T03:01:15.014847+0000","last_unstale":"2024-04-19T03:04:50.250258+0000","last_undegraded":"2024-04-19T03:04:50.250258+0000","last_fullsized":"2024-04-19T03:04:50.250258+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:51:06.208551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":35,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-19T03:04:50.250322+0000","last_change":"2024-04-19T03:02:40.440434+0000","last_active":"2024-04-19T03:04:50.250322+0000","last_peered":"2024-04-19T03:04:50.250322+0000","last_clean":"2024-04-19T03:04:50.250322+0000","last_became_active":"2024-04-19T03:02:40.439924+0000","last_became_peered":"2024-04-19T03:02:40.439924+0000","last_unstale":"2024-04-19T03:04:50.250322+0000","last_undegraded":"2024-04-19T03:04:50.250322+0000","last_fullsized":"2024-04-19T03:04:50.250322+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:33:16.864267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":63,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-19T03:04:50.250167+0000","last_change":"2024-04-19T03:01:15.014818+0000","last_active":"2024-04-19T03:04:50.250167+0000","last_peered":"2024-04-19T03:04:50.250167+0000","last_clean":"2024-04-19T03:04:50.250167+0000","last_became_active":"2024-04-19T03:01:15.014421+0000","last_became_peered":"2024-04-19T03:01:15.014421+0000","last_unstale":"2024-04-19T03:04:50.250167+0000","last_undegraded":"2024-04-19T03:04:50.250167+0000","last_fullsized":"2024-04-19T03:04:50.250167+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:16:20.475837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-19T03:04:51.603521+0000","last_change":"2024-04-19T03:04:50.616513+0000","last_active":"2024-04-19T03:04:51.603521+0000","last_peered":"2024-04-19T03:04:51.603521+0000","last_clean":"2024-04-19T03:04:51.603521+0000","last_became_active":"2024-04-19T03:04:50.614604+0000","last_became_peered":"2024-04-19T03:04:50.614604+0000","last_unstale":"2024-04-19T03:04:51.603521+0000","last_undegraded":"2024-04-19T03:04:51.603521+0000","last_fullsized":"2024-04-19T03:04:51.603521+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:52:21.648858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":21,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-19T03:04:50.632059+0000","last_change":"2024-04-19T03:04:50.617641+0000","last_active":"2024-04-19T03:04:50.632059+0000","last_peered":"2024-04-19T03:04:50.632059+0000","last_clean":"2024-04-19T03:04:50.632059+0000","last_became_active":"2024-04-19T03:04:50.617323+0000","last_became_peered":"2024-04-19T03:04:50.617323+0000","last_unstale":"2024-04-19T03:04:50.632059+0000","last_undegraded":"2024-04-19T03:04:50.632059+0000","last_fullsized":"2024-04-19T03:04:50.632059+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:26:09.566534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"14'157","reported_seq":265,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-19T03:04:50.252365+0000","last_change":"2024-04-19T03:01:07.538434+0000","last_active":"2024-04-19T03:04:50.252365+0000","last_peered":"2024-04-19T03:04:50.252365+0000","last_clean":"2024-04-19T03:04:50.252365+0000","last_became_active":"2024-04-19T03:01:07.537856+0000","last_became_peered":"2024-04-19T03:01:07.537856+0000","last_unstale":"2024-04-19T03:04:50.252365+0000","last_undegraded":"2024-04-19T03:04:50.252365+0000","last_fullsized":"2024-04-19T03:04:50.252365+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:06.516863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:06.516863+0000","last_clean_scrub_stamp":"2024-04-19T03:01:06.516863+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:36:46.386286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":79,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-19T03:04:50.279524+0000","last_change":"2024-04-19T03:04:50.277227+0000","last_active":"2024-04-19T03:04:50.279524+0000","last_peered":"2024-04-19T03:04:50.279524+0000","last_clean":"2024-04-19T03:04:50.279524+0000","last_became_active":"2024-04-19T03:04:50.276132+0000","last_became_peered":"2024-04-19T03:04:50.276132+0000","last_unstale":"2024-04-19T03:04:50.279524+0000","last_undegraded":"2024-04-19T03:04:50.279524+0000","last_fullsized":"2024-04-19T03:04:50.279524+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_clean_scrub_stamp":"2024-04-19T03:01:09.578660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:36:07.077967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":22,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-19T03:04:50.638701+0000","last_change":"2024-04-19T03:04:50.629139+0000","last_active":"2024-04-19T03:04:50.638701+0000","last_peered":"2024-04-19T03:04:50.638701+0000","last_clean":"2024-04-19T03:04:50.638701+0000","last_became_active":"2024-04-19T03:04:50.628741+0000","last_became_peered":"2024-04-19T03:04:50.628741+0000","last_unstale":"2024-04-19T03:04:50.638701+0000","last_undegraded":"2024-04-19T03:04:50.638701+0000","last_fullsized":"2024-04-19T03:04:50.638701+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:17:48.413908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":60,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-19T03:04:50.250718+0000","last_change":"2024-04-19T03:02:40.440550+0000","last_active":"2024-04-19T03:04:50.250718+0000","last_peered":"2024-04-19T03:04:50.250718+0000","last_clean":"2024-04-19T03:04:50.250718+0000","last_became_active":"2024-04-19T03:02:40.439621+0000","last_became_peered":"2024-04-19T03:02:40.439621+0000","last_unstale":"2024-04-19T03:04:50.250718+0000","last_undegraded":"2024-04-19T03:04:50.250718+0000","last_fullsized":"2024-04-19T03:04:50.250718+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:51:11.593632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":66,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-19T03:04:50.252506+0000","last_change":"2024-04-19T03:01:10.602194+0000","last_active":"2024-04-19T03:04:50.252506+0000","last_peered":"2024-04-19T03:04:50.252506+0000","last_clean":"2024-04-19T03:04:50.252506+0000","last_became_active":"2024-04-19T03:01:10.601381+0000","last_became_peered":"2024-04-19T03:01:10.601381+0000","last_unstale":"2024-04-19T03:04:50.252506+0000","last_undegraded":"2024-04-19T03:04:50.252506+0000","last_fullsized":"2024-04-19T03:04:50.252506+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_clean_scrub_stamp":"2024-04-19T03:01:09.578660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:42:26.594095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":22,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-19T03:04:50.638028+0000","last_change":"2024-04-19T03:04:50.634401+0000","last_active":"2024-04-19T03:04:50.638028+0000","last_peered":"2024-04-19T03:04:50.638028+0000","last_clean":"2024-04-19T03:04:50.638028+0000","last_became_active":"2024-04-19T03:04:50.631721+0000","last_became_peered":"2024-04-19T03:04:50.631721+0000","last_unstale":"2024-04-19T03:04:50.638028+0000","last_undegraded":"2024-04-19T03:04:50.638028+0000","last_fullsized":"2024-04-19T03:04:50.638028+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:40:03.144776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":15,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-19T03:04:51.604952+0000","last_change":"2024-04-19T03:04:50.616635+0000","last_active":"2024-04-19T03:04:51.604952+0000","last_peered":"2024-04-19T03:04:51.604952+0000","last_clean":"2024-04-19T03:04:51.604952+0000","last_became_active":"2024-04-19T03:04:50.614587+0000","last_became_peered":"2024-04-19T03:04:50.614587+0000","last_unstale":"2024-04-19T03:04:51.604952+0000","last_undegraded":"2024-04-19T03:04:51.604952+0000","last_fullsized":"2024-04-19T03:04:51.604952+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:07:13.329439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":21,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-19T03:04:50.639378+0000","last_change":"2024-04-19T03:04:50.635352+0000","last_active":"2024-04-19T03:04:50.639378+0000","last_peered":"2024-04-19T03:04:50.639378+0000","last_clean":"2024-04-19T03:04:50.639378+0000","last_became_active":"2024-04-19T03:04:50.633457+0000","last_became_peered":"2024-04-19T03:04:50.633457+0000","last_unstale":"2024-04-19T03:04:50.639378+0000","last_undegraded":"2024-04-19T03:04:50.639378+0000","last_fullsized":"2024-04-19T03:04:50.639378+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_clean_scrub_stamp":"2024-04-19T03:01:09.578660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:17:18.884148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":64,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-19T03:04:50.252977+0000","last_change":"2024-04-19T03:01:14.649068+0000","last_active":"2024-04-19T03:04:50.252977+0000","last_peered":"2024-04-19T03:04:50.252977+0000","last_clean":"2024-04-19T03:04:50.252977+0000","last_became_active":"2024-04-19T03:01:14.648082+0000","last_became_peered":"2024-04-19T03:01:14.648082+0000","last_unstale":"2024-04-19T03:04:50.252977+0000","last_undegraded":"2024-04-19T03:04:50.252977+0000","last_fullsized":"2024-04-19T03:04:50.252977+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:30:14.489117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":21,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-19T03:04:50.634816+0000","last_change":"2024-04-19T03:04:50.625932+0000","last_active":"2024-04-19T03:04:50.634816+0000","last_peered":"2024-04-19T03:04:50.634816+0000","last_clean":"2024-04-19T03:04:50.634816+0000","last_became_active":"2024-04-19T03:04:50.617628+0000","last_became_peered":"2024-04-19T03:04:50.617628+0000","last_unstale":"2024-04-19T03:04:50.634816+0000","last_undegraded":"2024-04-19T03:04:50.634816+0000","last_fullsized":"2024-04-19T03:04:50.634816+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:52:52.957579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":79,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-19T03:04:50.279712+0000","last_change":"2024-04-19T03:04:50.278737+0000","last_active":"2024-04-19T03:04:50.279712+0000","last_peered":"2024-04-19T03:04:50.279712+0000","last_clean":"2024-04-19T03:04:50.279712+0000","last_became_active":"2024-04-19T03:04:50.277804+0000","last_became_peered":"2024-04-19T03:04:50.277804+0000","last_unstale":"2024-04-19T03:04:50.279712+0000","last_undegraded":"2024-04-19T03:04:50.279712+0000","last_fullsized":"2024-04-19T03:04:50.279712+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_clean_scrub_stamp":"2024-04-19T03:01:09.578660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:00:20.440389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":77,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-19T03:04:50.279495+0000","last_change":"2024-04-19T03:04:50.277141+0000","last_active":"2024-04-19T03:04:50.279495+0000","last_peered":"2024-04-19T03:04:50.279495+0000","last_clean":"2024-04-19T03:04:50.279495+0000","last_became_active":"2024-04-19T03:04:50.275812+0000","last_became_peered":"2024-04-19T03:04:50.275812+0000","last_unstale":"2024-04-19T03:04:50.279495+0000","last_undegraded":"2024-04-19T03:04:50.279495+0000","last_fullsized":"2024-04-19T03:04:50.279495+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:16:29.209241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":21,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-19T03:04:50.625916+0000","last_change":"2024-04-19T03:04:50.616475+0000","last_active":"2024-04-19T03:04:50.625916+0000","last_peered":"2024-04-19T03:04:50.625916+0000","last_clean":"2024-04-19T03:04:50.625916+0000","last_became_active":"2024-04-19T03:04:50.614774+0000","last_became_peered":"2024-04-19T03:04:50.614774+0000","last_unstale":"2024-04-19T03:04:50.625916+0000","last_undegraded":"2024-04-19T03:04:50.625916+0000","last_fullsized":"2024-04-19T03:04:50.625916+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:51:07.142010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":23,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-19T03:04:50.618862+0000","last_change":"2024-04-19T03:04:50.612055+0000","last_active":"2024-04-19T03:04:50.618862+0000","last_peered":"2024-04-19T03:04:50.618862+0000","last_clean":"2024-04-19T03:04:50.618862+0000","last_became_active":"2024-04-19T03:04:50.611010+0000","last_became_peered":"2024-04-19T03:04:50.611010+0000","last_unstale":"2024-04-19T03:04:50.618862+0000","last_undegraded":"2024-04-19T03:04:50.618862+0000","last_fullsized":"2024-04-19T03:04:50.618862+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:24:46.459920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":21,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-19T03:04:50.625870+0000","last_change":"2024-04-19T03:04:50.615925+0000","last_active":"2024-04-19T03:04:50.625870+0000","last_peered":"2024-04-19T03:04:50.625870+0000","last_clean":"2024-04-19T03:04:50.625870+0000","last_became_active":"2024-04-19T03:04:50.614498+0000","last_became_peered":"2024-04-19T03:04:50.614498+0000","last_unstale":"2024-04-19T03:04:50.625870+0000","last_undegraded":"2024-04-19T03:04:50.625870+0000","last_fullsized":"2024-04-19T03:04:50.625870+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_clean_scrub_stamp":"2024-04-19T03:01:09.578660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:41:52.085259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":36,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-19T03:04:50.248802+0000","last_change":"2024-04-19T03:02:40.440057+0000","last_active":"2024-04-19T03:04:50.248802+0000","last_peered":"2024-04-19T03:04:50.248802+0000","last_clean":"2024-04-19T03:04:50.248802+0000","last_became_active":"2024-04-19T03:02:40.439752+0000","last_became_peered":"2024-04-19T03:02:40.439752+0000","last_unstale":"2024-04-19T03:04:50.248802+0000","last_undegraded":"2024-04-19T03:04:50.248802+0000","last_fullsized":"2024-04-19T03:04:50.248802+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:38:12.336658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":22,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-19T03:04:50.625939+0000","last_change":"2024-04-19T03:04:50.616970+0000","last_active":"2024-04-19T03:04:50.625939+0000","last_peered":"2024-04-19T03:04:50.625939+0000","last_clean":"2024-04-19T03:04:50.625939+0000","last_became_active":"2024-04-19T03:04:50.615238+0000","last_became_peered":"2024-04-19T03:04:50.615238+0000","last_unstale":"2024-04-19T03:04:50.625939+0000","last_undegraded":"2024-04-19T03:04:50.625939+0000","last_fullsized":"2024-04-19T03:04:50.625939+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:55:14.049921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-19T03:04:51.604135+0000","last_change":"2024-04-19T03:04:50.612749+0000","last_active":"2024-04-19T03:04:51.604135+0000","last_peered":"2024-04-19T03:04:51.604135+0000","last_clean":"2024-04-19T03:04:51.604135+0000","last_became_active":"2024-04-19T03:04:50.612029+0000","last_became_peered":"2024-04-19T03:04:50.612029+0000","last_unstale":"2024-04-19T03:04:51.604135+0000","last_undegraded":"2024-04-19T03:04:51.604135+0000","last_fullsized":"2024-04-19T03:04:51.604135+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_clean_scrub_stamp":"2024-04-19T03:01:09.578660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:08:24.466181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":36,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-19T03:04:50.251337+0000","last_change":"2024-04-19T03:02:40.440227+0000","last_active":"2024-04-19T03:04:50.251337+0000","last_peered":"2024-04-19T03:04:50.251337+0000","last_clean":"2024-04-19T03:04:50.251337+0000","last_became_active":"2024-04-19T03:02:40.439732+0000","last_became_peered":"2024-04-19T03:02:40.439732+0000","last_unstale":"2024-04-19T03:04:50.251337+0000","last_undegraded":"2024-04-19T03:04:50.251337+0000","last_fullsized":"2024-04-19T03:04:50.251337+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:29:33.660584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"20'2","reported_seq":24,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-19T03:04:50.626103+0000","last_change":"2024-04-19T03:04:50.611678+0000","last_active":"2024-04-19T03:04:50.626103+0000","last_peered":"2024-04-19T03:04:50.626103+0000","last_clean":"2024-04-19T03:04:50.626103+0000","last_became_active":"2024-04-19T03:04:50.611024+0000","last_became_peered":"2024-04-19T03:04:50.611024+0000","last_unstale":"2024-04-19T03:04:50.626103+0000","last_undegraded":"2024-04-19T03:04:50.626103+0000","last_fullsized":"2024-04-19T03:04:50.626103+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:08:43.323149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":21,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-19T03:04:50.628208+0000","last_change":"2024-04-19T03:04:50.616003+0000","last_active":"2024-04-19T03:04:50.628208+0000","last_peered":"2024-04-19T03:04:50.628208+0000","last_clean":"2024-04-19T03:04:50.628208+0000","last_became_active":"2024-04-19T03:04:50.612403+0000","last_became_peered":"2024-04-19T03:04:50.612403+0000","last_unstale":"2024-04-19T03:04:50.628208+0000","last_undegraded":"2024-04-19T03:04:50.628208+0000","last_fullsized":"2024-04-19T03:04:50.628208+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_clean_scrub_stamp":"2024-04-19T03:01:09.578660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:16:44.156874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":21,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-19T03:04:50.629849+0000","last_change":"2024-04-19T03:04:50.615936+0000","last_active":"2024-04-19T03:04:50.629849+0000","last_peered":"2024-04-19T03:04:50.629849+0000","last_clean":"2024-04-19T03:04:50.629849+0000","last_became_active":"2024-04-19T03:04:50.612987+0000","last_became_peered":"2024-04-19T03:04:50.612987+0000","last_unstale":"2024-04-19T03:04:50.629849+0000","last_undegraded":"2024-04-19T03:04:50.629849+0000","last_fullsized":"2024-04-19T03:04:50.629849+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:17:39.989639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"21'1","reported_seq":25,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-19T03:04:50.628236+0000","last_change":"2024-04-19T03:04:50.616200+0000","last_active":"2024-04-19T03:04:50.628236+0000","last_peered":"2024-04-19T03:04:50.628236+0000","last_clean":"2024-04-19T03:04:50.628236+0000","last_became_active":"2024-04-19T03:04:50.612697+0000","last_became_peered":"2024-04-19T03:04:50.612697+0000","last_unstale":"2024-04-19T03:04:50.628236+0000","last_undegraded":"2024-04-19T03:04:50.628236+0000","last_fullsized":"2024-04-19T03:04:50.628236+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:28:55.970411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":66,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-19T03:04:50.251786+0000","last_change":"2024-04-19T03:01:10.602274+0000","last_active":"2024-04-19T03:04:50.251786+0000","last_peered":"2024-04-19T03:04:50.251786+0000","last_clean":"2024-04-19T03:04:50.251786+0000","last_became_active":"2024-04-19T03:01:10.601487+0000","last_became_peered":"2024-04-19T03:01:10.601487+0000","last_unstale":"2024-04-19T03:04:50.251786+0000","last_undegraded":"2024-04-19T03:04:50.251786+0000","last_fullsized":"2024-04-19T03:04:50.251786+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_clean_scrub_stamp":"2024-04-19T03:01:09.578660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:26:16.712446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":63,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-19T03:04:50.251878+0000","last_change":"2024-04-19T03:01:15.018914+0000","last_active":"2024-04-19T03:04:50.251878+0000","last_peered":"2024-04-19T03:04:50.251878+0000","last_clean":"2024-04-19T03:04:50.251878+0000","last_became_active":"2024-04-19T03:01:15.018276+0000","last_became_peered":"2024-04-19T03:01:15.018276+0000","last_unstale":"2024-04-19T03:04:50.251878+0000","last_undegraded":"2024-04-19T03:04:50.251878+0000","last_fullsized":"2024-04-19T03:04:50.251878+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:40:59.453079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":63,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-19T03:04:50.251626+0000","last_change":"2024-04-19T03:01:15.015855+0000","last_active":"2024-04-19T03:04:50.251626+0000","last_peered":"2024-04-19T03:04:50.251626+0000","last_clean":"2024-04-19T03:04:50.251626+0000","last_became_active":"2024-04-19T03:01:15.015358+0000","last_became_peered":"2024-04-19T03:01:15.015358+0000","last_unstale":"2024-04-19T03:04:50.251626+0000","last_undegraded":"2024-04-19T03:04:50.251626+0000","last_fullsized":"2024-04-19T03:04:50.251626+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:59:49.270245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"20'6","reported_seq":70,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-19T03:04:50.251556+0000","last_change":"2024-04-19T03:01:14.649577+0000","last_active":"2024-04-19T03:04:50.251556+0000","last_peered":"2024-04-19T03:04:50.251556+0000","last_clean":"2024-04-19T03:04:50.251556+0000","last_became_active":"2024-04-19T03:01:14.649284+0000","last_became_peered":"2024-04-19T03:01:14.649284+0000","last_unstale":"2024-04-19T03:04:50.251556+0000","last_undegraded":"2024-04-19T03:04:50.251556+0000","last_fullsized":"2024-04-19T03:04:50.251556+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:01:22.214742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":21,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-19T03:04:50.638647+0000","last_change":"2024-04-19T03:04:50.628406+0000","last_active":"2024-04-19T03:04:50.638647+0000","last_peered":"2024-04-19T03:04:50.638647+0000","last_clean":"2024-04-19T03:04:50.638647+0000","last_became_active":"2024-04-19T03:04:50.627654+0000","last_became_peered":"2024-04-19T03:04:50.627654+0000","last_unstale":"2024-04-19T03:04:50.638647+0000","last_undegraded":"2024-04-19T03:04:50.638647+0000","last_fullsized":"2024-04-19T03:04:50.638647+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:17:57.101098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"20'3","reported_seq":43,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-19T03:04:50.250516+0000","last_change":"2024-04-19T03:02:40.442253+0000","last_active":"2024-04-19T03:04:50.250516+0000","last_peered":"2024-04-19T03:04:50.250516+0000","last_clean":"2024-04-19T03:04:50.250516+0000","last_became_active":"2024-04-19T03:02:40.441225+0000","last_became_peered":"2024-04-19T03:02:40.441225+0000","last_unstale":"2024-04-19T03:04:50.250516+0000","last_undegraded":"2024-04-19T03:04:50.250516+0000","last_fullsized":"2024-04-19T03:04:50.250516+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:51:10.208584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":23,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-19T03:04:50.628323+0000","last_change":"2024-04-19T03:04:50.617205+0000","last_active":"2024-04-19T03:04:50.628323+0000","last_peered":"2024-04-19T03:04:50.628323+0000","last_clean":"2024-04-19T03:04:50.628323+0000","last_became_active":"2024-04-19T03:04:50.616879+0000","last_became_peered":"2024-04-19T03:04:50.616879+0000","last_unstale":"2024-04-19T03:04:50.628323+0000","last_undegraded":"2024-04-19T03:04:50.628323+0000","last_fullsized":"2024-04-19T03:04:50.628323+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:58:21.203090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":21,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-19T03:04:50.637983+0000","last_change":"2024-04-19T03:04:50.634026+0000","last_active":"2024-04-19T03:04:50.637983+0000","last_peered":"2024-04-19T03:04:50.637983+0000","last_clean":"2024-04-19T03:04:50.637983+0000","last_became_active":"2024-04-19T03:04:50.630873+0000","last_became_peered":"2024-04-19T03:04:50.630873+0000","last_unstale":"2024-04-19T03:04:50.637983+0000","last_undegraded":"2024-04-19T03:04:50.637983+0000","last_fullsized":"2024-04-19T03:04:50.637983+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:41:25.674376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":22,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-19T03:04:50.626181+0000","last_change":"2024-04-19T03:04:50.612483+0000","last_active":"2024-04-19T03:04:50.626181+0000","last_peered":"2024-04-19T03:04:50.626181+0000","last_clean":"2024-04-19T03:04:50.626181+0000","last_became_active":"2024-04-19T03:04:50.612005+0000","last_became_peered":"2024-04-19T03:04:50.612005+0000","last_unstale":"2024-04-19T03:04:50.626181+0000","last_undegraded":"2024-04-19T03:04:50.626181+0000","last_fullsized":"2024-04-19T03:04:50.626181+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:56:45.629955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":21,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-19T03:04:50.629878+0000","last_change":"2024-04-19T03:04:50.616158+0000","last_active":"2024-04-19T03:04:50.629878+0000","last_peered":"2024-04-19T03:04:50.629878+0000","last_clean":"2024-04-19T03:04:50.629878+0000","last_became_active":"2024-04-19T03:04:50.613735+0000","last_became_peered":"2024-04-19T03:04:50.613735+0000","last_unstale":"2024-04-19T03:04:50.629878+0000","last_undegraded":"2024-04-19T03:04:50.629878+0000","last_fullsized":"2024-04-19T03:04:50.629878+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:25:58.128503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":36,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-19T03:04:50.250938+0000","last_change":"2024-04-19T03:02:40.442421+0000","last_active":"2024-04-19T03:04:50.250938+0000","last_peered":"2024-04-19T03:04:50.250938+0000","last_clean":"2024-04-19T03:04:50.250938+0000","last_became_active":"2024-04-19T03:02:40.441746+0000","last_became_peered":"2024-04-19T03:02:40.441746+0000","last_unstale":"2024-04-19T03:04:50.250938+0000","last_undegraded":"2024-04-19T03:04:50.250938+0000","last_fullsized":"2024-04-19T03:04:50.250938+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:52:55.719264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":22,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-19T03:04:50.629924+0000","last_change":"2024-04-19T03:04:50.616430+0000","last_active":"2024-04-19T03:04:50.629924+0000","last_peered":"2024-04-19T03:04:50.629924+0000","last_clean":"2024-04-19T03:04:50.629924+0000","last_became_active":"2024-04-19T03:04:50.613523+0000","last_became_peered":"2024-04-19T03:04:50.613523+0000","last_unstale":"2024-04-19T03:04:50.629924+0000","last_undegraded":"2024-04-19T03:04:50.629924+0000","last_fullsized":"2024-04-19T03:04:50.629924+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:22:43.207543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":21,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-19T03:04:50.628304+0000","last_change":"2024-04-19T03:04:50.616829+0000","last_active":"2024-04-19T03:04:50.628304+0000","last_peered":"2024-04-19T03:04:50.628304+0000","last_clean":"2024-04-19T03:04:50.628304+0000","last_became_active":"2024-04-19T03:04:50.616545+0000","last_became_peered":"2024-04-19T03:04:50.616545+0000","last_unstale":"2024-04-19T03:04:50.628304+0000","last_undegraded":"2024-04-19T03:04:50.628304+0000","last_fullsized":"2024-04-19T03:04:50.628304+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:07:32.515729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":22,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-19T03:04:50.637999+0000","last_change":"2024-04-19T03:04:50.634214+0000","last_active":"2024-04-19T03:04:50.637999+0000","last_peered":"2024-04-19T03:04:50.637999+0000","last_clean":"2024-04-19T03:04:50.637999+0000","last_became_active":"2024-04-19T03:04:50.631699+0000","last_became_peered":"2024-04-19T03:04:50.631699+0000","last_unstale":"2024-04-19T03:04:50.637999+0000","last_undegraded":"2024-04-19T03:04:50.637999+0000","last_fullsized":"2024-04-19T03:04:50.637999+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:43:10.184280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":35,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-19T03:04:50.249331+0000","last_change":"2024-04-19T03:02:40.441670+0000","last_active":"2024-04-19T03:04:50.249331+0000","last_peered":"2024-04-19T03:04:50.249331+0000","last_clean":"2024-04-19T03:04:50.249331+0000","last_became_active":"2024-04-19T03:02:40.441294+0000","last_became_peered":"2024-04-19T03:02:40.441294+0000","last_unstale":"2024-04-19T03:04:50.249331+0000","last_undegraded":"2024-04-19T03:04:50.249331+0000","last_fullsized":"2024-04-19T03:04:50.249331+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:59:32.330785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"20'1","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-19T03:04:51.603581+0000","last_change":"2024-04-19T03:04:50.612263+0000","last_active":"2024-04-19T03:04:51.603581+0000","last_peered":"2024-04-19T03:04:51.603581+0000","last_clean":"2024-04-19T03:04:51.603581+0000","last_became_active":"2024-04-19T03:04:50.611850+0000","last_became_peered":"2024-04-19T03:04:50.611850+0000","last_unstale":"2024-04-19T03:04:51.603581+0000","last_undegraded":"2024-04-19T03:04:51.603581+0000","last_fullsized":"2024-04-19T03:04:51.603581+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:26:47.367018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":15,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-19T03:04:51.605315+0000","last_change":"2024-04-19T03:04:50.627129+0000","last_active":"2024-04-19T03:04:51.605315+0000","last_peered":"2024-04-19T03:04:51.605315+0000","last_clean":"2024-04-19T03:04:51.605315+0000","last_became_active":"2024-04-19T03:04:50.626547+0000","last_became_peered":"2024-04-19T03:04:50.626547+0000","last_unstale":"2024-04-19T03:04:51.605315+0000","last_undegraded":"2024-04-19T03:04:51.605315+0000","last_fullsized":"2024-04-19T03:04:51.605315+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:43:35.716650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"20'1","reported_seq":38,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-19T03:04:51.604262+0000","last_change":"2024-04-19T03:04:50.626274+0000","last_active":"2024-04-19T03:04:51.604262+0000","last_peered":"2024-04-19T03:04:51.604262+0000","last_clean":"2024-04-19T03:04:51.604262+0000","last_became_active":"2024-04-19T03:04:50.618516+0000","last_became_peered":"2024-04-19T03:04:50.618516+0000","last_unstale":"2024-04-19T03:04:51.604262+0000","last_undegraded":"2024-04-19T03:04:51.604262+0000","last_fullsized":"2024-04-19T03:04:51.604262+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:18:07.170476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":76,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-19T03:04:50.278594+0000","last_change":"2024-04-19T03:04:50.276250+0000","last_active":"2024-04-19T03:04:50.278594+0000","last_peered":"2024-04-19T03:04:50.278594+0000","last_clean":"2024-04-19T03:04:50.278594+0000","last_became_active":"2024-04-19T03:04:50.275226+0000","last_became_peered":"2024-04-19T03:04:50.275226+0000","last_unstale":"2024-04-19T03:04:50.278594+0000","last_undegraded":"2024-04-19T03:04:50.278594+0000","last_fullsized":"2024-04-19T03:04:50.278594+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:22:34.069251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"20'2","reported_seq":79,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-19T03:04:50.278322+0000","last_change":"2024-04-19T03:04:50.276105+0000","last_active":"2024-04-19T03:04:50.278322+0000","last_peered":"2024-04-19T03:04:50.278322+0000","last_clean":"2024-04-19T03:04:50.278322+0000","last_became_active":"2024-04-19T03:04:50.275533+0000","last_became_peered":"2024-04-19T03:04:50.275533+0000","last_unstale":"2024-04-19T03:04:50.278322+0000","last_undegraded":"2024-04-19T03:04:50.278322+0000","last_fullsized":"2024-04-19T03:04:50.278322+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:38:13.683481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":76,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-19T03:04:50.279654+0000","last_change":"2024-04-19T03:04:50.278401+0000","last_active":"2024-04-19T03:04:50.279654+0000","last_peered":"2024-04-19T03:04:50.279654+0000","last_clean":"2024-04-19T03:04:50.279654+0000","last_became_active":"2024-04-19T03:04:50.277348+0000","last_became_peered":"2024-04-19T03:04:50.277348+0000","last_unstale":"2024-04-19T03:04:50.279654+0000","last_undegraded":"2024-04-19T03:04:50.279654+0000","last_fullsized":"2024-04-19T03:04:50.279654+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:19:35.891753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"20'2","reported_seq":43,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-19T03:04:50.249995+0000","last_change":"2024-04-19T03:02:40.441689+0000","last_active":"2024-04-19T03:04:50.249995+0000","last_peered":"2024-04-19T03:04:50.249995+0000","last_clean":"2024-04-19T03:04:50.249995+0000","last_became_active":"2024-04-19T03:02:40.440206+0000","last_became_peered":"2024-04-19T03:02:40.440206+0000","last_unstale":"2024-04-19T03:04:50.249995+0000","last_undegraded":"2024-04-19T03:04:50.249995+0000","last_fullsized":"2024-04-19T03:04:50.249995+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:02:19.100804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-04-19T03:04:51.603775+0000","last_change":"2024-04-19T03:04:50.634940+0000","last_active":"2024-04-19T03:04:51.603775+0000","last_peered":"2024-04-19T03:04:51.603775+0000","last_clean":"2024-04-19T03:04:51.603775+0000","last_became_active":"2024-04-19T03:04:50.632660+0000","last_became_peered":"2024-04-19T03:04:50.632660+0000","last_unstale":"2024-04-19T03:04:51.603775+0000","last_undegraded":"2024-04-19T03:04:51.603775+0000","last_fullsized":"2024-04-19T03:04:51.603775+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:23:26.030101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"20'1","reported_seq":24,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-19T03:04:50.635670+0000","last_change":"2024-04-19T03:04:50.627670+0000","last_active":"2024-04-19T03:04:50.635670+0000","last_peered":"2024-04-19T03:04:50.635670+0000","last_clean":"2024-04-19T03:04:50.635670+0000","last_became_active":"2024-04-19T03:04:50.627304+0000","last_became_peered":"2024-04-19T03:04:50.627304+0000","last_unstale":"2024-04-19T03:04:50.635670+0000","last_undegraded":"2024-04-19T03:04:50.635670+0000","last_fullsized":"2024-04-19T03:04:50.635670+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:29:08.875911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":76,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-19T03:04:50.280167+0000","last_change":"2024-04-19T03:04:50.279334+0000","last_active":"2024-04-19T03:04:50.280167+0000","last_peered":"2024-04-19T03:04:50.280167+0000","last_clean":"2024-04-19T03:04:50.280167+0000","last_became_active":"2024-04-19T03:04:50.278874+0000","last_became_peered":"2024-04-19T03:04:50.278874+0000","last_unstale":"2024-04-19T03:04:50.280167+0000","last_undegraded":"2024-04-19T03:04:50.280167+0000","last_fullsized":"2024-04-19T03:04:50.280167+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:51:33.707741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"20'4","reported_seq":24,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-04-19T03:04:50.635019+0000","last_change":"2024-04-19T03:04:50.627070+0000","last_active":"2024-04-19T03:04:50.635019+0000","last_peered":"2024-04-19T03:04:50.635019+0000","last_clean":"2024-04-19T03:04:50.635019+0000","last_became_active":"2024-04-19T03:04:50.626334+0000","last_became_peered":"2024-04-19T03:04:50.626334+0000","last_unstale":"2024-04-19T03:04:50.635019+0000","last_undegraded":"2024-04-19T03:04:50.635019+0000","last_fullsized":"2024-04-19T03:04:50.635019+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:24:58.586175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5289,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":14482,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":10,"seq":42949673012,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":220648,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":219774,"kb_avail":94151192,"statfs":{"total":96636764160,"available":96410820608,"internally_reserved":0,"allocated":880640,"data_stored":895683,"data_compressed":7241,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":225049030},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 19 03:02:08 2024","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"last":0.70299999999999996}]},{"osd":1,"last update":"Fri Apr 19 03:04:11 2024","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.19900000000000001,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.87,"5min":2.5030000000000001,"15min":2.5030000000000001},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.57099999999999995,"15min":0.56299999999999994},"min":{"1min":0.23999999999999999,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.90400000000000003,"5min":2.6379999999999999,"15min":2.6379999999999999},"last":0.63900000000000001}]}]},{"osd":1,"up_from":10,"seq":42949673011,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":202608,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":201726,"kb_avail":94169232,"statfs":{"total":96636764160,"available":96429293568,"internally_reserved":0,"allocated":876544,"data_stored":897230,"data_compressed":7241,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":206567878},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 19 03:02:04 2024","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.63500000000000001}]},{"osd":2,"last update":"Fri Apr 19 03:04:07 2024","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.47899999999999998,"15min":0.501},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":0.79400000000000004,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.48499999999999999,"15min":0.51400000000000001},"min":{"1min":0.26100000000000001,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.83899999999999997,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.66400000000000003}]}]},{"osd":0,"up_from":71,"seq":304942678018,"num_pgs":73,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47648,"kb_used_data":784,"kb_used_omap":6,"kb_used_meta":46841,"kb_avail":94324192,"statfs":{"total":96636764160,"available":96587972608,"internally_reserved":0,"allocated":802816,"data_stored":305732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6883,"internal_metadata":47965469},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59099999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67600000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":7241,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":7241,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5289,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-19T03:05:00.061 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-04-19T03:05:00.061 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2024-04-19T03:05:00.061 INFO:tasks.thrashosds.thrasher:primary_affinity 2024-04-19T03:05:00.061 INFO:tasks.thrashosds.thrasher:Setting osd 2 primary_affinity to 0.528802 2024-04-19T03:05:00.062 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 2 0.5288017588324743 2024-04-19T03:05:01.347 INFO:teuthology.orchestra.run.smithi096.stderr:set osd.2 primary-affinity to 0.528802 (8346552) 2024-04-19T03:05:06.359 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=600 2024-04-19T03:05:06.500 INFO:teuthology.orchestra.run.smithi096.stdout:mon.a: {} 2024-04-19T03:05:06.518 INFO:teuthology.orchestra.run.smithi096.stdout:mon.b: {} 2024-04-19T03:05:06.529 INFO:teuthology.orchestra.run.smithi096.stdout:mon.c: {} 2024-04-19T03:05:06.531 INFO:teuthology.orchestra.run.smithi096.stderr:mon.a: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-04-19T03:05:06.531 INFO:teuthology.orchestra.run.smithi096.stderr:mon.b: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-04-19T03:05:06.531 INFO:teuthology.orchestra.run.smithi096.stderr:mon.c: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-04-19T03:05:06.548 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-04-19T03:05:07.371 INFO:teuthology.orchestra.run.smithi096.stderr:reweighted osd.1 to 1 (10000) 2024-04-19T03:05:07.384 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 1 1 2024-04-19T03:05:08.385 INFO:teuthology.orchestra.run.smithi096.stderr:set osd.1 primary-affinity to 1 (8655362) 2024-04-19T03:05:08.398 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-04-19T03:05:09.389 INFO:teuthology.orchestra.run.smithi096.stderr:reweighted osd.2 to 1 (10000) 2024-04-19T03:05:09.402 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 2 1 2024-04-19T03:05:10.411 INFO:teuthology.orchestra.run.smithi096.stderr:set osd.2 primary-affinity to 1 (8655362) 2024-04-19T03:05:10.426 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-04-19T03:05:11.419 INFO:teuthology.orchestra.run.smithi096.stderr:reweighted osd.0 to 1 (10000) 2024-04-19T03:05:11.433 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 0 1 2024-04-19T03:05:12.424 INFO:teuthology.orchestra.run.smithi096.stderr:set osd.0 primary-affinity to 1 (8655362) 2024-04-19T03:05:12.439 INFO:tasks.thrashosds.thrasher:joining the do_sighup greenlet 2024-04-19T03:05:12.439 INFO:tasks.thrashosds.thrasher:joining the do_optrack_toggle greenlet 2024-04-19T03:05:12.439 INFO:tasks.thrashosds.thrasher:joining the do_dump_ops greenlet 2024-04-19T03:05:12.439 INFO:tasks.thrashosds.thrasher:joining the do_noscrub_toggle greenlet 2024-04-19T03:05:12.439 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-04-19T03:05:12.439 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-19T03:05:12.739 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-19T03:05:12.740 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":81,"fsid":"c6cc8e09-11d4-48de-9a6c-4d70ed3c3789","created":"2024-04-19T03:00:53.746146+0000","modified":"2024-04-19T03:05:12.407719+0000","last_up_change":"2024-04-19T03:04:49.214889+0000","last_in_change":"2024-04-19T03:00:54.640172+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-19T03:01:05.999591+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-19T03:01:09.051757+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-19T03:01:13.479163+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-19T03:01:13.992441+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"05ecb884-2c30-44f7-aa14-90154f9bbe9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":42,"up_from":71,"up_thru":74,"down_at":43,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":1402},{"type":"v1","addr":"172.21.15.97:6801","nonce":1402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":1402},{"type":"v1","addr":"172.21.15.97:6803","nonce":1402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":1402},{"type":"v1","addr":"172.21.15.97:6807","nonce":1402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6804","nonce":1402},{"type":"v1","addr":"172.21.15.97:6805","nonce":1402}]},"public_addr":"172.21.15.97:6801/1402","cluster_addr":"172.21.15.97:6803/1402","heartbeat_back_addr":"172.21.15.97:6807/1402","heartbeat_front_addr":"172.21.15.97:6805/1402","state":["exists","up"]},{"osd":1,"uuid":"efc873e0-69c3-4a57-8ee5-41f836b65f47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":18145},{"type":"v1","addr":"172.21.15.134:6801","nonce":18145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":18145},{"type":"v1","addr":"172.21.15.134:6803","nonce":18145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":18145},{"type":"v1","addr":"172.21.15.134:6807","nonce":18145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":18145},{"type":"v1","addr":"172.21.15.134:6805","nonce":18145}]},"public_addr":"172.21.15.134:6801/18145","cluster_addr":"172.21.15.134:6803/18145","heartbeat_back_addr":"172.21.15.134:6807/18145","heartbeat_front_addr":"172.21.15.134:6805/18145","state":["exists","up"]},{"osd":2,"uuid":"229278a0-dd93-4234-9065-e4f2f6188ef2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":18223},{"type":"v1","addr":"172.21.15.144:6801","nonce":18223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":18223},{"type":"v1","addr":"172.21.15.144:6803","nonce":18223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":18223},{"type":"v1","addr":"172.21.15.144:6807","nonce":18223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":18223},{"type":"v1","addr":"172.21.15.144:6805","nonce":18223}]},"public_addr":"172.21.15.144:6801/18223","cluster_addr":"172.21.15.144:6803/18223","heartbeat_back_addr":"172.21.15.144:6807/18223","heartbeat_front_addr":"172.21.15.144:6805/18223","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T03:00:59.302574+0000","dead_epoch":42},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T03:01:00.064174+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T03:00:59.735582+0000","dead_epoch":0}],"pg_upmap":[{"pgid":"3.1b","osds":[1,0]}],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-19T03:05:12.754 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-04-19T03:05:12.754 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-19T03:05:13.051 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-19T03:05:13.051 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":81,"fsid":"c6cc8e09-11d4-48de-9a6c-4d70ed3c3789","created":"2024-04-19T03:00:53.746146+0000","modified":"2024-04-19T03:05:12.407719+0000","last_up_change":"2024-04-19T03:04:49.214889+0000","last_in_change":"2024-04-19T03:00:54.640172+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-19T03:01:05.999591+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-19T03:01:09.051757+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-19T03:01:13.479163+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-19T03:01:13.992441+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"05ecb884-2c30-44f7-aa14-90154f9bbe9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":42,"up_from":71,"up_thru":74,"down_at":43,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":1402},{"type":"v1","addr":"172.21.15.97:6801","nonce":1402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":1402},{"type":"v1","addr":"172.21.15.97:6803","nonce":1402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":1402},{"type":"v1","addr":"172.21.15.97:6807","nonce":1402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6804","nonce":1402},{"type":"v1","addr":"172.21.15.97:6805","nonce":1402}]},"public_addr":"172.21.15.97:6801/1402","cluster_addr":"172.21.15.97:6803/1402","heartbeat_back_addr":"172.21.15.97:6807/1402","heartbeat_front_addr":"172.21.15.97:6805/1402","state":["exists","up"]},{"osd":1,"uuid":"efc873e0-69c3-4a57-8ee5-41f836b65f47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":18145},{"type":"v1","addr":"172.21.15.134:6801","nonce":18145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":18145},{"type":"v1","addr":"172.21.15.134:6803","nonce":18145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":18145},{"type":"v1","addr":"172.21.15.134:6807","nonce":18145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":18145},{"type":"v1","addr":"172.21.15.134:6805","nonce":18145}]},"public_addr":"172.21.15.134:6801/18145","cluster_addr":"172.21.15.134:6803/18145","heartbeat_back_addr":"172.21.15.134:6807/18145","heartbeat_front_addr":"172.21.15.134:6805/18145","state":["exists","up"]},{"osd":2,"uuid":"229278a0-dd93-4234-9065-e4f2f6188ef2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":18223},{"type":"v1","addr":"172.21.15.144:6801","nonce":18223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":18223},{"type":"v1","addr":"172.21.15.144:6803","nonce":18223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":18223},{"type":"v1","addr":"172.21.15.144:6807","nonce":18223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":18223},{"type":"v1","addr":"172.21.15.144:6805","nonce":18223}]},"public_addr":"172.21.15.144:6801/18223","cluster_addr":"172.21.15.144:6803/18223","heartbeat_back_addr":"172.21.15.144:6807/18223","heartbeat_front_addr":"172.21.15.144:6805/18223","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T03:00:59.302574+0000","dead_epoch":42},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T03:01:00.064174+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T03:00:59.735582+0000","dead_epoch":0}],"pg_upmap":[{"pgid":"3.1b","osds":[1,0]}],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-19T03:05:13.066 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-04-19T03:05:13.067 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-04-19T03:05:13.067 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-04-19T03:05:13.213 INFO:teuthology.orchestra.run.smithi096.stdout:42949673016 2024-04-19T03:05:13.213 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-19T03:05:13.227 INFO:teuthology.orchestra.run.smithi096.stdout:42949673015 2024-04-19T03:05:13.227 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-19T03:05:13.228 INFO:teuthology.orchestra.run.smithi096.stdout:304942678022 2024-04-19T03:05:13.228 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-19T03:05:13.559 INFO:teuthology.orchestra.run.smithi096.stdout:42949673015 2024-04-19T03:05:13.576 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949673016 got 42949673015 for osd.2 2024-04-19T03:05:13.578 INFO:teuthology.orchestra.run.smithi096.stdout:304942678021 2024-04-19T03:05:13.591 INFO:tasks.ceph.ceph_manager.ceph:need seq 304942678022 got 304942678021 for osd.0 2024-04-19T03:05:13.606 INFO:teuthology.orchestra.run.smithi096.stdout:42949673014 2024-04-19T03:05:13.620 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949673015 got 42949673014 for osd.1 2024-04-19T03:05:14.577 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-19T03:05:14.592 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-19T03:05:14.621 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-19T03:05:14.894 INFO:teuthology.orchestra.run.smithi096.stdout:42949673016 2024-04-19T03:05:14.905 INFO:teuthology.orchestra.run.smithi096.stdout:304942678023 2024-04-19T03:05:14.914 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949673016 got 42949673016 for osd.2 2024-04-19T03:05:14.914 DEBUG:teuthology.parallel:result is None 2024-04-19T03:05:14.918 INFO:tasks.ceph.ceph_manager.ceph:need seq 304942678022 got 304942678023 for osd.0 2024-04-19T03:05:14.918 DEBUG:teuthology.parallel:result is None 2024-04-19T03:05:14.940 INFO:teuthology.orchestra.run.smithi096.stdout:42949673015 2024-04-19T03:05:14.954 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949673015 got 42949673015 for osd.1 2024-04-19T03:05:14.954 DEBUG:teuthology.parallel:result is None 2024-04-19T03:05:14.954 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-04-19T03:05:14.954 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-19T03:05:15.268 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-19T03:05:15.270 INFO:teuthology.orchestra.run.smithi096.stderr:dumped all 2024-04-19T03:05:15.283 INFO:teuthology.orchestra.run.smithi096.stdout:{"pg_ready":true,"pg_map":{"version":202,"stamp":"2024-04-19T03:05:14.049966+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":471080,"kb_used_data":2684,"kb_used_omap":9,"kb_used_meta":468342,"kb_avail":282644440,"statfs":{"total":289910292480,"available":289427906560,"internally_reserved":0,"allocated":2748416,"data_stored":2196720,"data_compressed":14482,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":10071,"internal_metadata":479582377},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.671652"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":77,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.419575+0000","last_change":"2024-04-19T03:05:09.396661+0000","last_active":"2024-04-19T03:05:11.419575+0000","last_peered":"2024-04-19T03:05:11.419575+0000","last_clean":"2024-04-19T03:05:11.419575+0000","last_became_active":"2024-04-19T03:05:09.396279+0000","last_became_peered":"2024-04-19T03:05:09.396279+0000","last_unstale":"2024-04-19T03:05:11.419575+0000","last_undegraded":"2024-04-19T03:05:11.419575+0000","last_fullsized":"2024-04-19T03:05:11.419575+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:20:04.982562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":84,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.418854+0000","last_change":"2024-04-19T03:04:50.278334+0000","last_active":"2024-04-19T03:05:11.418854+0000","last_peered":"2024-04-19T03:05:11.418854+0000","last_clean":"2024-04-19T03:05:11.418854+0000","last_became_active":"2024-04-19T03:04:50.277848+0000","last_became_peered":"2024-04-19T03:04:50.277848+0000","last_unstale":"2024-04-19T03:05:11.418854+0000","last_undegraded":"2024-04-19T03:05:11.418854+0000","last_fullsized":"2024-04-19T03:05:11.418854+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:57:39.589383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":71,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.425858+0000","last_change":"2024-04-19T03:01:15.015884+0000","last_active":"2024-04-19T03:05:11.425858+0000","last_peered":"2024-04-19T03:05:11.425858+0000","last_clean":"2024-04-19T03:05:11.425858+0000","last_became_active":"2024-04-19T03:01:15.014599+0000","last_became_peered":"2024-04-19T03:01:15.014599+0000","last_unstale":"2024-04-19T03:05:11.425858+0000","last_undegraded":"2024-04-19T03:05:11.425858+0000","last_fullsized":"2024-04-19T03:05:11.425858+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:35:19.436344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":84,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.425776+0000","last_change":"2024-04-19T03:04:50.275017+0000","last_active":"2024-04-19T03:05:11.425776+0000","last_peered":"2024-04-19T03:05:11.425776+0000","last_clean":"2024-04-19T03:05:11.425776+0000","last_became_active":"2024-04-19T03:04:50.274600+0000","last_became_peered":"2024-04-19T03:04:50.274600+0000","last_unstale":"2024-04-19T03:05:11.425776+0000","last_undegraded":"2024-04-19T03:05:11.425776+0000","last_fullsized":"2024-04-19T03:05:11.425776+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:21:44.006351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":77,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.418426+0000","last_change":"2024-04-19T03:05:09.397682+0000","last_active":"2024-04-19T03:05:11.418426+0000","last_peered":"2024-04-19T03:05:11.418426+0000","last_clean":"2024-04-19T03:05:11.418426+0000","last_became_active":"2024-04-19T03:05:09.395929+0000","last_became_peered":"2024-04-19T03:05:09.395929+0000","last_unstale":"2024-04-19T03:05:11.418426+0000","last_undegraded":"2024-04-19T03:05:11.418426+0000","last_fullsized":"2024-04-19T03:05:11.418426+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:57:03.617383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":70,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.430738+0000","last_change":"2024-04-19T03:05:11.428461+0000","last_active":"2024-04-19T03:05:11.430738+0000","last_peered":"2024-04-19T03:05:11.430738+0000","last_clean":"2024-04-19T03:05:11.430738+0000","last_became_active":"2024-04-19T03:05:11.426617+0000","last_became_peered":"2024-04-19T03:05:11.426617+0000","last_unstale":"2024-04-19T03:05:11.430738+0000","last_undegraded":"2024-04-19T03:05:11.430738+0000","last_fullsized":"2024-04-19T03:05:11.430738+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:18:53.462220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":70,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.429888+0000","last_change":"2024-04-19T03:05:11.424581+0000","last_active":"2024-04-19T03:05:11.429888+0000","last_peered":"2024-04-19T03:05:11.429888+0000","last_clean":"2024-04-19T03:05:11.429888+0000","last_became_active":"2024-04-19T03:05:11.422727+0000","last_became_peered":"2024-04-19T03:05:11.422727+0000","last_unstale":"2024-04-19T03:05:11.429888+0000","last_undegraded":"2024-04-19T03:05:11.429888+0000","last_fullsized":"2024-04-19T03:05:11.429888+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:48:53.502161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":84,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.422960+0000","last_change":"2024-04-19T03:04:50.261359+0000","last_active":"2024-04-19T03:05:11.422960+0000","last_peered":"2024-04-19T03:05:11.422960+0000","last_clean":"2024-04-19T03:05:11.422960+0000","last_became_active":"2024-04-19T03:04:50.261155+0000","last_became_peered":"2024-04-19T03:04:50.261155+0000","last_unstale":"2024-04-19T03:05:11.422960+0000","last_undegraded":"2024-04-19T03:05:11.422960+0000","last_fullsized":"2024-04-19T03:05:11.422960+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:09:37.911709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.770311+0000","last_change":"2024-04-19T03:04:50.611854+0000","last_active":"2024-04-19T03:05:11.770311+0000","last_peered":"2024-04-19T03:05:11.770311+0000","last_clean":"2024-04-19T03:05:11.770311+0000","last_became_active":"2024-04-19T03:04:50.611400+0000","last_became_peered":"2024-04-19T03:04:50.611400+0000","last_unstale":"2024-04-19T03:05:11.770311+0000","last_undegraded":"2024-04-19T03:05:11.770311+0000","last_fullsized":"2024-04-19T03:05:11.770311+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:33:58.731162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":84,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.418911+0000","last_change":"2024-04-19T03:04:50.278337+0000","last_active":"2024-04-19T03:05:11.418911+0000","last_peered":"2024-04-19T03:05:11.418911+0000","last_clean":"2024-04-19T03:05:11.418911+0000","last_became_active":"2024-04-19T03:04:50.277899+0000","last_became_peered":"2024-04-19T03:04:50.277899+0000","last_unstale":"2024-04-19T03:05:11.418911+0000","last_undegraded":"2024-04-19T03:05:11.418911+0000","last_fullsized":"2024-04-19T03:05:11.418911+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:32:49.546687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":70,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.431939+0000","last_change":"2024-04-19T03:05:11.430574+0000","last_active":"2024-04-19T03:05:11.431939+0000","last_peered":"2024-04-19T03:05:11.431939+0000","last_clean":"2024-04-19T03:05:11.431939+0000","last_became_active":"2024-04-19T03:05:11.430243+0000","last_became_peered":"2024-04-19T03:05:11.430243+0000","last_unstale":"2024-04-19T03:05:11.431939+0000","last_undegraded":"2024-04-19T03:05:11.431939+0000","last_fullsized":"2024-04-19T03:05:11.431939+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:37:37.372803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":50,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.418696+0000","last_change":"2024-04-19T03:05:09.394405+0000","last_active":"2024-04-19T03:05:11.418696+0000","last_peered":"2024-04-19T03:05:11.418696+0000","last_clean":"2024-04-19T03:05:11.418696+0000","last_became_active":"2024-04-19T03:05:09.392822+0000","last_became_peered":"2024-04-19T03:05:09.392822+0000","last_unstale":"2024-04-19T03:05:11.418696+0000","last_undegraded":"2024-04-19T03:05:11.418696+0000","last_fullsized":"2024-04-19T03:05:11.418696+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:33:27.982343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":77,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.417984+0000","last_change":"2024-04-19T03:05:09.397000+0000","last_active":"2024-04-19T03:05:11.417984+0000","last_peered":"2024-04-19T03:05:11.417984+0000","last_clean":"2024-04-19T03:05:11.417984+0000","last_became_active":"2024-04-19T03:05:09.395749+0000","last_became_peered":"2024-04-19T03:05:09.395749+0000","last_unstale":"2024-04-19T03:05:11.417984+0000","last_undegraded":"2024-04-19T03:05:11.417984+0000","last_fullsized":"2024-04-19T03:05:11.417984+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:21:26.436890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":71,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.423871+0000","last_change":"2024-04-19T03:01:15.010960+0000","last_active":"2024-04-19T03:05:11.423871+0000","last_peered":"2024-04-19T03:05:11.423871+0000","last_clean":"2024-04-19T03:05:11.423871+0000","last_became_active":"2024-04-19T03:01:15.010472+0000","last_became_peered":"2024-04-19T03:01:15.010472+0000","last_unstale":"2024-04-19T03:05:11.423871+0000","last_undegraded":"2024-04-19T03:05:11.423871+0000","last_fullsized":"2024-04-19T03:05:11.423871+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:21:36.129346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":73,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.430581+0000","last_change":"2024-04-19T03:05:11.428285+0000","last_active":"2024-04-19T03:05:11.430581+0000","last_peered":"2024-04-19T03:05:11.430581+0000","last_clean":"2024-04-19T03:05:11.430581+0000","last_became_active":"2024-04-19T03:05:11.425921+0000","last_became_peered":"2024-04-19T03:05:11.425921+0000","last_unstale":"2024-04-19T03:05:11.430581+0000","last_undegraded":"2024-04-19T03:05:11.430581+0000","last_fullsized":"2024-04-19T03:05:11.430581+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:38:49.965677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":70,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.430778+0000","last_change":"2024-04-19T03:05:11.429030+0000","last_active":"2024-04-19T03:05:11.430778+0000","last_peered":"2024-04-19T03:05:11.430778+0000","last_clean":"2024-04-19T03:05:11.430778+0000","last_became_active":"2024-04-19T03:05:11.425921+0000","last_became_peered":"2024-04-19T03:05:11.425921+0000","last_unstale":"2024-04-19T03:05:11.430778+0000","last_undegraded":"2024-04-19T03:05:11.430778+0000","last_fullsized":"2024-04-19T03:05:11.430778+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:53:07.351904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.770126+0000","last_change":"2024-04-19T03:04:50.611757+0000","last_active":"2024-04-19T03:05:11.770126+0000","last_peered":"2024-04-19T03:05:11.770126+0000","last_clean":"2024-04-19T03:05:11.770126+0000","last_became_active":"2024-04-19T03:04:50.611392+0000","last_became_peered":"2024-04-19T03:04:50.611392+0000","last_unstale":"2024-04-19T03:05:11.770126+0000","last_undegraded":"2024-04-19T03:05:11.770126+0000","last_fullsized":"2024-04-19T03:05:11.770126+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:51:50.768612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":77,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.419368+0000","last_change":"2024-04-19T03:05:09.397114+0000","last_active":"2024-04-19T03:05:11.419368+0000","last_peered":"2024-04-19T03:05:11.419368+0000","last_clean":"2024-04-19T03:05:11.419368+0000","last_became_active":"2024-04-19T03:05:09.395682+0000","last_became_peered":"2024-04-19T03:05:09.395682+0000","last_unstale":"2024-04-19T03:05:11.419368+0000","last_undegraded":"2024-04-19T03:05:11.419368+0000","last_fullsized":"2024-04-19T03:05:11.419368+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:55:53.897442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.769589+0000","last_change":"2024-04-19T03:04:50.613858+0000","last_active":"2024-04-19T03:05:11.769589+0000","last_peered":"2024-04-19T03:05:11.769589+0000","last_clean":"2024-04-19T03:05:11.769589+0000","last_became_active":"2024-04-19T03:04:50.613481+0000","last_became_peered":"2024-04-19T03:04:50.613481+0000","last_unstale":"2024-04-19T03:05:11.769589+0000","last_undegraded":"2024-04-19T03:05:11.769589+0000","last_fullsized":"2024-04-19T03:05:11.769589+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:55:45.686937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":86,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.432386+0000","last_change":"2024-04-19T03:05:11.431719+0000","last_active":"2024-04-19T03:05:11.432386+0000","last_peered":"2024-04-19T03:05:11.432386+0000","last_clean":"2024-04-19T03:05:11.432386+0000","last_became_active":"2024-04-19T03:05:11.431352+0000","last_became_peered":"2024-04-19T03:05:11.431352+0000","last_unstale":"2024-04-19T03:05:11.432386+0000","last_undegraded":"2024-04-19T03:05:11.432386+0000","last_fullsized":"2024-04-19T03:05:11.432386+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:54:50.052460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":84,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.424051+0000","last_change":"2024-04-19T03:04:50.276678+0000","last_active":"2024-04-19T03:05:11.424051+0000","last_peered":"2024-04-19T03:05:11.424051+0000","last_clean":"2024-04-19T03:05:11.424051+0000","last_became_active":"2024-04-19T03:04:50.275510+0000","last_became_peered":"2024-04-19T03:04:50.275510+0000","last_unstale":"2024-04-19T03:05:11.424051+0000","last_undegraded":"2024-04-19T03:05:11.424051+0000","last_fullsized":"2024-04-19T03:05:11.424051+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:17:24.832346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":71,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.417759+0000","last_change":"2024-04-19T03:01:15.020108+0000","last_active":"2024-04-19T03:05:11.417759+0000","last_peered":"2024-04-19T03:05:11.417759+0000","last_clean":"2024-04-19T03:05:11.417759+0000","last_became_active":"2024-04-19T03:01:15.018978+0000","last_became_peered":"2024-04-19T03:01:15.018978+0000","last_unstale":"2024-04-19T03:05:11.417759+0000","last_undegraded":"2024-04-19T03:05:11.417759+0000","last_fullsized":"2024-04-19T03:05:11.417759+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:30:22.360053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.768605+0000","last_change":"2024-04-19T03:04:50.633855+0000","last_active":"2024-04-19T03:05:11.768605+0000","last_peered":"2024-04-19T03:05:11.768605+0000","last_clean":"2024-04-19T03:05:11.768605+0000","last_became_active":"2024-04-19T03:04:50.630948+0000","last_became_peered":"2024-04-19T03:04:50.630948+0000","last_unstale":"2024-04-19T03:05:11.768605+0000","last_undegraded":"2024-04-19T03:05:11.768605+0000","last_fullsized":"2024-04-19T03:05:11.768605+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:41:31.676439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":77,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.417346+0000","last_change":"2024-04-19T03:05:09.391159+0000","last_active":"2024-04-19T03:05:11.417346+0000","last_peered":"2024-04-19T03:05:11.417346+0000","last_clean":"2024-04-19T03:05:11.417346+0000","last_became_active":"2024-04-19T03:05:09.390922+0000","last_became_peered":"2024-04-19T03:05:09.390922+0000","last_unstale":"2024-04-19T03:05:11.417346+0000","last_undegraded":"2024-04-19T03:05:11.417346+0000","last_fullsized":"2024-04-19T03:05:11.417346+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:32:01.116711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":50,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.419689+0000","last_change":"2024-04-19T03:05:09.393923+0000","last_active":"2024-04-19T03:05:11.419689+0000","last_peered":"2024-04-19T03:05:11.419689+0000","last_clean":"2024-04-19T03:05:11.419689+0000","last_became_active":"2024-04-19T03:05:09.393108+0000","last_became_peered":"2024-04-19T03:05:09.393108+0000","last_unstale":"2024-04-19T03:05:11.419689+0000","last_undegraded":"2024-04-19T03:05:11.419689+0000","last_fullsized":"2024-04-19T03:05:11.419689+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:29:37.674820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.770633+0000","last_change":"2024-04-19T03:04:50.626923+0000","last_active":"2024-04-19T03:05:11.770633+0000","last_peered":"2024-04-19T03:05:11.770633+0000","last_clean":"2024-04-19T03:05:11.770633+0000","last_became_active":"2024-04-19T03:04:50.617603+0000","last_became_peered":"2024-04-19T03:04:50.617603+0000","last_unstale":"2024-04-19T03:05:11.770633+0000","last_undegraded":"2024-04-19T03:05:11.770633+0000","last_fullsized":"2024-04-19T03:05:11.770633+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:26:56.826024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:12.905140+0000","last_change":"2024-04-19T03:05:11.431713+0000","last_active":"2024-04-19T03:05:12.905140+0000","last_peered":"2024-04-19T03:05:12.905140+0000","last_clean":"2024-04-19T03:05:12.905140+0000","last_became_active":"2024-04-19T03:05:11.431129+0000","last_became_peered":"2024-04-19T03:05:11.431129+0000","last_unstale":"2024-04-19T03:05:12.905140+0000","last_undegraded":"2024-04-19T03:05:12.905140+0000","last_fullsized":"2024-04-19T03:05:12.905140+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:00:07.623146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":71,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.419121+0000","last_change":"2024-04-19T03:01:15.020098+0000","last_active":"2024-04-19T03:05:11.419121+0000","last_peered":"2024-04-19T03:05:11.419121+0000","last_clean":"2024-04-19T03:05:11.419121+0000","last_became_active":"2024-04-19T03:01:15.019064+0000","last_became_peered":"2024-04-19T03:01:15.019064+0000","last_unstale":"2024-04-19T03:05:11.419121+0000","last_undegraded":"2024-04-19T03:05:11.419121+0000","last_fullsized":"2024-04-19T03:05:11.419121+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:50:06.490191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.769012+0000","last_change":"2024-04-19T03:04:50.616823+0000","last_active":"2024-04-19T03:05:11.769012+0000","last_peered":"2024-04-19T03:05:11.769012+0000","last_clean":"2024-04-19T03:05:11.769012+0000","last_became_active":"2024-04-19T03:04:50.616550+0000","last_became_peered":"2024-04-19T03:04:50.616550+0000","last_unstale":"2024-04-19T03:05:11.769012+0000","last_undegraded":"2024-04-19T03:05:11.769012+0000","last_fullsized":"2024-04-19T03:05:11.769012+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:46:25.096677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":50,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.418068+0000","last_change":"2024-04-19T03:05:09.394074+0000","last_active":"2024-04-19T03:05:11.418068+0000","last_peered":"2024-04-19T03:05:11.418068+0000","last_clean":"2024-04-19T03:05:11.418068+0000","last_became_active":"2024-04-19T03:05:09.393178+0000","last_became_peered":"2024-04-19T03:05:09.393178+0000","last_unstale":"2024-04-19T03:05:11.418068+0000","last_undegraded":"2024-04-19T03:05:11.418068+0000","last_fullsized":"2024-04-19T03:05:11.418068+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:53:27.695302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.769044+0000","last_change":"2024-04-19T03:04:50.635141+0000","last_active":"2024-04-19T03:05:11.769044+0000","last_peered":"2024-04-19T03:05:11.769044+0000","last_clean":"2024-04-19T03:05:11.769044+0000","last_became_active":"2024-04-19T03:04:50.633033+0000","last_became_peered":"2024-04-19T03:04:50.633033+0000","last_unstale":"2024-04-19T03:05:11.769044+0000","last_undegraded":"2024-04-19T03:05:11.769044+0000","last_fullsized":"2024-04-19T03:05:11.769044+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:42:01.712749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":84,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.423252+0000","last_change":"2024-04-19T03:04:50.279507+0000","last_active":"2024-04-19T03:05:11.423252+0000","last_peered":"2024-04-19T03:05:11.423252+0000","last_clean":"2024-04-19T03:05:11.423252+0000","last_became_active":"2024-04-19T03:04:50.278996+0000","last_became_peered":"2024-04-19T03:04:50.278996+0000","last_unstale":"2024-04-19T03:05:11.423252+0000","last_undegraded":"2024-04-19T03:05:11.423252+0000","last_fullsized":"2024-04-19T03:05:11.423252+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:09:09.816660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":77,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.419122+0000","last_change":"2024-04-19T03:05:09.396527+0000","last_active":"2024-04-19T03:05:11.419122+0000","last_peered":"2024-04-19T03:05:11.419122+0000","last_clean":"2024-04-19T03:05:11.419122+0000","last_became_active":"2024-04-19T03:05:09.395920+0000","last_became_peered":"2024-04-19T03:05:09.395920+0000","last_unstale":"2024-04-19T03:05:11.419122+0000","last_undegraded":"2024-04-19T03:05:11.419122+0000","last_fullsized":"2024-04-19T03:05:11.419122+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:23:05.984746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"20'2","reported_seq":87,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.424713+0000","last_change":"2024-04-19T03:04:50.277421+0000","last_active":"2024-04-19T03:05:11.424713+0000","last_peered":"2024-04-19T03:05:11.424713+0000","last_clean":"2024-04-19T03:05:11.424713+0000","last_became_active":"2024-04-19T03:04:50.276732+0000","last_became_peered":"2024-04-19T03:04:50.276732+0000","last_unstale":"2024-04-19T03:05:11.424713+0000","last_undegraded":"2024-04-19T03:05:11.424713+0000","last_fullsized":"2024-04-19T03:05:11.424713+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:23:27.191496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":77,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.419051+0000","last_change":"2024-04-19T03:05:09.395454+0000","last_active":"2024-04-19T03:05:11.419051+0000","last_peered":"2024-04-19T03:05:11.419051+0000","last_clean":"2024-04-19T03:05:11.419051+0000","last_became_active":"2024-04-19T03:05:09.394288+0000","last_became_peered":"2024-04-19T03:05:09.394288+0000","last_unstale":"2024-04-19T03:05:11.419051+0000","last_undegraded":"2024-04-19T03:05:11.419051+0000","last_fullsized":"2024-04-19T03:05:11.419051+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:32:14.358374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":30,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.768860+0000","last_change":"2024-04-19T03:04:50.628801+0000","last_active":"2024-04-19T03:05:11.768860+0000","last_peered":"2024-04-19T03:05:11.768860+0000","last_clean":"2024-04-19T03:05:11.768860+0000","last_became_active":"2024-04-19T03:04:50.628023+0000","last_became_peered":"2024-04-19T03:04:50.628023+0000","last_unstale":"2024-04-19T03:05:11.768860+0000","last_undegraded":"2024-04-19T03:05:11.768860+0000","last_fullsized":"2024-04-19T03:05:11.768860+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:52:41.731698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.770121+0000","last_change":"2024-04-19T03:04:50.616471+0000","last_active":"2024-04-19T03:05:11.770121+0000","last_peered":"2024-04-19T03:05:11.770121+0000","last_clean":"2024-04-19T03:05:11.770121+0000","last_became_active":"2024-04-19T03:04:50.613860+0000","last_became_peered":"2024-04-19T03:04:50.613860+0000","last_unstale":"2024-04-19T03:05:11.770121+0000","last_undegraded":"2024-04-19T03:05:11.770121+0000","last_fullsized":"2024-04-19T03:05:11.770121+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:26:24.246287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":72,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.417986+0000","last_change":"2024-04-19T03:01:14.649074+0000","last_active":"2024-04-19T03:05:11.417986+0000","last_peered":"2024-04-19T03:05:11.417986+0000","last_clean":"2024-04-19T03:05:11.417986+0000","last_became_active":"2024-04-19T03:01:14.648217+0000","last_became_peered":"2024-04-19T03:01:14.648217+0000","last_unstale":"2024-04-19T03:05:11.417986+0000","last_undegraded":"2024-04-19T03:05:11.417986+0000","last_fullsized":"2024-04-19T03:05:11.417986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:57:05.238043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.769706+0000","last_change":"2024-04-19T03:04:50.611026+0000","last_active":"2024-04-19T03:05:11.769706+0000","last_peered":"2024-04-19T03:05:11.769706+0000","last_clean":"2024-04-19T03:05:11.769706+0000","last_became_active":"2024-04-19T03:04:50.610659+0000","last_became_peered":"2024-04-19T03:04:50.610659+0000","last_unstale":"2024-04-19T03:05:11.769706+0000","last_undegraded":"2024-04-19T03:05:11.769706+0000","last_fullsized":"2024-04-19T03:05:11.769706+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:57:17.231684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"20'8","reported_seq":85,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.431442+0000","last_change":"2024-04-19T03:05:11.429829+0000","last_active":"2024-04-19T03:05:11.431442+0000","last_peered":"2024-04-19T03:05:11.431442+0000","last_clean":"2024-04-19T03:05:11.431442+0000","last_became_active":"2024-04-19T03:05:11.428668+0000","last_became_peered":"2024-04-19T03:05:11.428668+0000","last_unstale":"2024-04-19T03:05:11.431442+0000","last_undegraded":"2024-04-19T03:05:11.431442+0000","last_fullsized":"2024-04-19T03:05:11.431442+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:14:21.956275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"20'1","reported_seq":73,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.428642+0000","last_change":"2024-04-19T03:01:14.649839+0000","last_active":"2024-04-19T03:05:11.428642+0000","last_peered":"2024-04-19T03:05:11.428642+0000","last_clean":"2024-04-19T03:05:11.428642+0000","last_became_active":"2024-04-19T03:01:14.649571+0000","last_became_peered":"2024-04-19T03:01:14.649571+0000","last_unstale":"2024-04-19T03:05:11.428642+0000","last_undegraded":"2024-04-19T03:05:11.428642+0000","last_fullsized":"2024-04-19T03:05:11.428642+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:03:57.839660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":53,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.417983+0000","last_change":"2024-04-19T03:05:02.362526+0000","last_active":"2024-04-19T03:05:11.417983+0000","last_peered":"2024-04-19T03:05:11.417983+0000","last_clean":"2024-04-19T03:05:11.417983+0000","last_became_active":"2024-04-19T03:05:02.362227+0000","last_became_peered":"2024-04-19T03:05:02.362227+0000","last_unstale":"2024-04-19T03:05:11.417983+0000","last_undegraded":"2024-04-19T03:05:11.417983+0000","last_fullsized":"2024-04-19T03:05:11.417983+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:00:25.584557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"20'2","reported_seq":74,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.419401+0000","last_change":"2024-04-19T03:01:14.645075+0000","last_active":"2024-04-19T03:05:11.419401+0000","last_peered":"2024-04-19T03:05:11.419401+0000","last_clean":"2024-04-19T03:05:11.419401+0000","last_became_active":"2024-04-19T03:01:14.644790+0000","last_became_peered":"2024-04-19T03:01:14.644790+0000","last_unstale":"2024-04-19T03:05:11.419401+0000","last_undegraded":"2024-04-19T03:05:11.419401+0000","last_fullsized":"2024-04-19T03:05:11.419401+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:55:15.035769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":77,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.417574+0000","last_change":"2024-04-19T03:05:09.393128+0000","last_active":"2024-04-19T03:05:11.417574+0000","last_peered":"2024-04-19T03:05:11.417574+0000","last_clean":"2024-04-19T03:05:11.417574+0000","last_became_active":"2024-04-19T03:05:09.392736+0000","last_became_peered":"2024-04-19T03:05:09.392736+0000","last_unstale":"2024-04-19T03:05:11.417574+0000","last_undegraded":"2024-04-19T03:05:11.417574+0000","last_fullsized":"2024-04-19T03:05:11.417574+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:04:56.310628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"20'1","reported_seq":40,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:12.905624+0000","last_change":"2024-04-19T03:05:11.431892+0000","last_active":"2024-04-19T03:05:12.905624+0000","last_peered":"2024-04-19T03:05:12.905624+0000","last_clean":"2024-04-19T03:05:12.905624+0000","last_became_active":"2024-04-19T03:05:11.431552+0000","last_became_peered":"2024-04-19T03:05:11.431552+0000","last_unstale":"2024-04-19T03:05:12.905624+0000","last_undegraded":"2024-04-19T03:05:12.905624+0000","last_fullsized":"2024-04-19T03:05:12.905624+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:38:26.843094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":84,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.424141+0000","last_change":"2024-04-19T03:04:50.277960+0000","last_active":"2024-04-19T03:05:11.424141+0000","last_peered":"2024-04-19T03:05:11.424141+0000","last_clean":"2024-04-19T03:05:11.424141+0000","last_became_active":"2024-04-19T03:04:50.277126+0000","last_became_peered":"2024-04-19T03:04:50.277126+0000","last_unstale":"2024-04-19T03:05:11.424141+0000","last_undegraded":"2024-04-19T03:05:11.424141+0000","last_fullsized":"2024-04-19T03:05:11.424141+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:08:49.146373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":71,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.431622+0000","last_change":"2024-04-19T03:05:11.429040+0000","last_active":"2024-04-19T03:05:11.431622+0000","last_peered":"2024-04-19T03:05:11.431622+0000","last_clean":"2024-04-19T03:05:11.431622+0000","last_became_active":"2024-04-19T03:05:11.428722+0000","last_became_peered":"2024-04-19T03:05:11.428722+0000","last_unstale":"2024-04-19T03:05:11.431622+0000","last_undegraded":"2024-04-19T03:05:11.431622+0000","last_fullsized":"2024-04-19T03:05:11.431622+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:52:42.089565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.770183+0000","last_change":"2024-04-19T03:04:50.627120+0000","last_active":"2024-04-19T03:05:11.770183+0000","last_peered":"2024-04-19T03:05:11.770183+0000","last_clean":"2024-04-19T03:05:11.770183+0000","last_became_active":"2024-04-19T03:04:50.625919+0000","last_became_peered":"2024-04-19T03:04:50.625919+0000","last_unstale":"2024-04-19T03:05:11.770183+0000","last_undegraded":"2024-04-19T03:05:11.770183+0000","last_fullsized":"2024-04-19T03:05:11.770183+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:56:19.822304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"20'2","reported_seq":32,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.769746+0000","last_change":"2024-04-19T03:04:50.627277+0000","last_active":"2024-04-19T03:05:11.769746+0000","last_peered":"2024-04-19T03:05:11.769746+0000","last_clean":"2024-04-19T03:05:11.769746+0000","last_became_active":"2024-04-19T03:04:50.625931+0000","last_became_peered":"2024-04-19T03:04:50.625931+0000","last_unstale":"2024-04-19T03:05:11.769746+0000","last_undegraded":"2024-04-19T03:05:11.769746+0000","last_fullsized":"2024-04-19T03:05:11.769746+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:30:32.408349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":86,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.431933+0000","last_change":"2024-04-19T03:05:11.430496+0000","last_active":"2024-04-19T03:05:11.431933+0000","last_peered":"2024-04-19T03:05:11.431933+0000","last_clean":"2024-04-19T03:05:11.431933+0000","last_became_active":"2024-04-19T03:05:11.430149+0000","last_became_peered":"2024-04-19T03:05:11.430149+0000","last_unstale":"2024-04-19T03:05:11.431933+0000","last_undegraded":"2024-04-19T03:05:11.431933+0000","last_fullsized":"2024-04-19T03:05:11.431933+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:55:24.828882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":85,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.424643+0000","last_change":"2024-04-19T03:04:50.278491+0000","last_active":"2024-04-19T03:05:11.424643+0000","last_peered":"2024-04-19T03:05:11.424643+0000","last_clean":"2024-04-19T03:05:11.424643+0000","last_became_active":"2024-04-19T03:04:50.277603+0000","last_became_peered":"2024-04-19T03:04:50.277603+0000","last_unstale":"2024-04-19T03:05:11.424643+0000","last_undegraded":"2024-04-19T03:05:11.424643+0000","last_fullsized":"2024-04-19T03:05:11.424643+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:04:26.211975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":71,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.426785+0000","last_change":"2024-04-19T03:01:15.015685+0000","last_active":"2024-04-19T03:05:11.426785+0000","last_peered":"2024-04-19T03:05:11.426785+0000","last_clean":"2024-04-19T03:05:11.426785+0000","last_became_active":"2024-04-19T03:01:15.014847+0000","last_became_peered":"2024-04-19T03:01:15.014847+0000","last_unstale":"2024-04-19T03:05:11.426785+0000","last_undegraded":"2024-04-19T03:05:11.426785+0000","last_fullsized":"2024-04-19T03:05:11.426785+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:51:06.208551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":51,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.418053+0000","last_change":"2024-04-19T03:05:09.392582+0000","last_active":"2024-04-19T03:05:11.418053+0000","last_peered":"2024-04-19T03:05:11.418053+0000","last_clean":"2024-04-19T03:05:11.418053+0000","last_became_active":"2024-04-19T03:05:09.391218+0000","last_became_peered":"2024-04-19T03:05:09.391218+0000","last_unstale":"2024-04-19T03:05:11.418053+0000","last_undegraded":"2024-04-19T03:05:11.418053+0000","last_fullsized":"2024-04-19T03:05:11.418053+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:06:11.612173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":71,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.426219+0000","last_change":"2024-04-19T03:01:15.014818+0000","last_active":"2024-04-19T03:05:11.426219+0000","last_peered":"2024-04-19T03:05:11.426219+0000","last_clean":"2024-04-19T03:05:11.426219+0000","last_became_active":"2024-04-19T03:01:15.014421+0000","last_became_peered":"2024-04-19T03:01:15.014421+0000","last_unstale":"2024-04-19T03:05:11.426219+0000","last_undegraded":"2024-04-19T03:05:11.426219+0000","last_fullsized":"2024-04-19T03:05:11.426219+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:16:20.475837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":78,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.417679+0000","last_change":"2024-04-19T03:05:09.395629+0000","last_active":"2024-04-19T03:05:11.417679+0000","last_peered":"2024-04-19T03:05:11.417679+0000","last_clean":"2024-04-19T03:05:11.417679+0000","last_became_active":"2024-04-19T03:05:09.395294+0000","last_became_peered":"2024-04-19T03:05:09.395294+0000","last_unstale":"2024-04-19T03:05:11.417679+0000","last_undegraded":"2024-04-19T03:05:11.417679+0000","last_fullsized":"2024-04-19T03:05:11.417679+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:38:03.627366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.770660+0000","last_change":"2024-04-19T03:04:50.617641+0000","last_active":"2024-04-19T03:05:11.770660+0000","last_peered":"2024-04-19T03:05:11.770660+0000","last_clean":"2024-04-19T03:05:11.770660+0000","last_became_active":"2024-04-19T03:04:50.617323+0000","last_became_peered":"2024-04-19T03:04:50.617323+0000","last_unstale":"2024-04-19T03:05:11.770660+0000","last_undegraded":"2024-04-19T03:05:11.770660+0000","last_fullsized":"2024-04-19T03:05:11.770660+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:26:09.566534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"14'157","reported_seq":279,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:12.903628+0000","last_change":"2024-04-19T03:05:11.429096+0000","last_active":"2024-04-19T03:05:12.903628+0000","last_peered":"2024-04-19T03:05:12.903628+0000","last_clean":"2024-04-19T03:05:12.903628+0000","last_became_active":"2024-04-19T03:05:11.426859+0000","last_became_peered":"2024-04-19T03:05:11.426859+0000","last_unstale":"2024-04-19T03:05:12.903628+0000","last_undegraded":"2024-04-19T03:05:12.903628+0000","last_fullsized":"2024-04-19T03:05:12.903628+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:06.516863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:06.516863+0000","last_clean_scrub_stamp":"2024-04-19T03:01:06.516863+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:34:42.107839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":87,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.425366+0000","last_change":"2024-04-19T03:04:50.277227+0000","last_active":"2024-04-19T03:05:11.425366+0000","last_peered":"2024-04-19T03:05:11.425366+0000","last_clean":"2024-04-19T03:05:11.425366+0000","last_became_active":"2024-04-19T03:04:50.276132+0000","last_became_peered":"2024-04-19T03:04:50.276132+0000","last_unstale":"2024-04-19T03:05:11.425366+0000","last_undegraded":"2024-04-19T03:05:11.425366+0000","last_fullsized":"2024-04-19T03:05:11.425366+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_clean_scrub_stamp":"2024-04-19T03:01:09.578660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:36:07.077967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":30,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.769259+0000","last_change":"2024-04-19T03:04:50.629139+0000","last_active":"2024-04-19T03:05:11.769259+0000","last_peered":"2024-04-19T03:05:11.769259+0000","last_clean":"2024-04-19T03:05:11.769259+0000","last_became_active":"2024-04-19T03:04:50.628741+0000","last_became_peered":"2024-04-19T03:04:50.628741+0000","last_unstale":"2024-04-19T03:05:11.769259+0000","last_undegraded":"2024-04-19T03:05:11.769259+0000","last_fullsized":"2024-04-19T03:05:11.769259+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:17:48.413908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":73,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.432341+0000","last_change":"2024-04-19T03:05:11.431455+0000","last_active":"2024-04-19T03:05:11.432341+0000","last_peered":"2024-04-19T03:05:11.432341+0000","last_clean":"2024-04-19T03:05:11.432341+0000","last_became_active":"2024-04-19T03:05:11.430881+0000","last_became_peered":"2024-04-19T03:05:11.430881+0000","last_unstale":"2024-04-19T03:05:11.432341+0000","last_undegraded":"2024-04-19T03:05:11.432341+0000","last_fullsized":"2024-04-19T03:05:11.432341+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:34:50.356698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":75,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.423910+0000","last_change":"2024-04-19T03:01:10.602194+0000","last_active":"2024-04-19T03:05:11.423910+0000","last_peered":"2024-04-19T03:05:11.423910+0000","last_clean":"2024-04-19T03:05:11.423910+0000","last_became_active":"2024-04-19T03:01:10.601381+0000","last_became_peered":"2024-04-19T03:01:10.601381+0000","last_unstale":"2024-04-19T03:05:11.423910+0000","last_undegraded":"2024-04-19T03:05:11.423910+0000","last_fullsized":"2024-04-19T03:05:11.423910+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_clean_scrub_stamp":"2024-04-19T03:01:09.578660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:42:26.594095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":30,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.768286+0000","last_change":"2024-04-19T03:04:50.634401+0000","last_active":"2024-04-19T03:05:11.768286+0000","last_peered":"2024-04-19T03:05:11.768286+0000","last_clean":"2024-04-19T03:05:11.768286+0000","last_became_active":"2024-04-19T03:04:50.631721+0000","last_became_peered":"2024-04-19T03:04:50.631721+0000","last_unstale":"2024-04-19T03:05:11.768286+0000","last_undegraded":"2024-04-19T03:05:11.768286+0000","last_fullsized":"2024-04-19T03:05:11.768286+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:40:03.144776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":77,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.419116+0000","last_change":"2024-04-19T03:05:09.395868+0000","last_active":"2024-04-19T03:05:11.419116+0000","last_peered":"2024-04-19T03:05:11.419116+0000","last_clean":"2024-04-19T03:05:11.419116+0000","last_became_active":"2024-04-19T03:05:09.395167+0000","last_became_peered":"2024-04-19T03:05:09.395167+0000","last_unstale":"2024-04-19T03:05:11.419116+0000","last_undegraded":"2024-04-19T03:05:11.419116+0000","last_fullsized":"2024-04-19T03:05:11.419116+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:40:00.629037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.768794+0000","last_change":"2024-04-19T03:04:50.635352+0000","last_active":"2024-04-19T03:05:11.768794+0000","last_peered":"2024-04-19T03:05:11.768794+0000","last_clean":"2024-04-19T03:05:11.768794+0000","last_became_active":"2024-04-19T03:04:50.633457+0000","last_became_peered":"2024-04-19T03:04:50.633457+0000","last_unstale":"2024-04-19T03:05:11.768794+0000","last_undegraded":"2024-04-19T03:05:11.768794+0000","last_fullsized":"2024-04-19T03:05:11.768794+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_clean_scrub_stamp":"2024-04-19T03:01:09.578660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:17:18.884148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":72,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.417996+0000","last_change":"2024-04-19T03:01:14.649068+0000","last_active":"2024-04-19T03:05:11.417996+0000","last_peered":"2024-04-19T03:05:11.417996+0000","last_clean":"2024-04-19T03:05:11.417996+0000","last_became_active":"2024-04-19T03:01:14.648082+0000","last_became_peered":"2024-04-19T03:01:14.648082+0000","last_unstale":"2024-04-19T03:05:11.417996+0000","last_undegraded":"2024-04-19T03:05:11.417996+0000","last_fullsized":"2024-04-19T03:05:11.417996+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:30:14.489117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.770578+0000","last_change":"2024-04-19T03:04:50.625932+0000","last_active":"2024-04-19T03:05:11.770578+0000","last_peered":"2024-04-19T03:05:11.770578+0000","last_clean":"2024-04-19T03:05:11.770578+0000","last_became_active":"2024-04-19T03:04:50.617628+0000","last_became_peered":"2024-04-19T03:04:50.617628+0000","last_unstale":"2024-04-19T03:05:11.770578+0000","last_undegraded":"2024-04-19T03:05:11.770578+0000","last_fullsized":"2024-04-19T03:05:11.770578+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:52:52.957579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":87,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.425331+0000","last_change":"2024-04-19T03:04:50.278737+0000","last_active":"2024-04-19T03:05:11.425331+0000","last_peered":"2024-04-19T03:05:11.425331+0000","last_clean":"2024-04-19T03:05:11.425331+0000","last_became_active":"2024-04-19T03:04:50.277804+0000","last_became_peered":"2024-04-19T03:04:50.277804+0000","last_unstale":"2024-04-19T03:05:11.425331+0000","last_undegraded":"2024-04-19T03:05:11.425331+0000","last_fullsized":"2024-04-19T03:05:11.425331+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_clean_scrub_stamp":"2024-04-19T03:01:09.578660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:00:20.440389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":85,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.424660+0000","last_change":"2024-04-19T03:04:50.277141+0000","last_active":"2024-04-19T03:05:11.424660+0000","last_peered":"2024-04-19T03:05:11.424660+0000","last_clean":"2024-04-19T03:05:11.424660+0000","last_became_active":"2024-04-19T03:04:50.275812+0000","last_became_peered":"2024-04-19T03:04:50.275812+0000","last_unstale":"2024-04-19T03:05:11.424660+0000","last_undegraded":"2024-04-19T03:05:11.424660+0000","last_fullsized":"2024-04-19T03:05:11.424660+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:16:29.209241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.769258+0000","last_change":"2024-04-19T03:04:50.616475+0000","last_active":"2024-04-19T03:05:11.769258+0000","last_peered":"2024-04-19T03:05:11.769258+0000","last_clean":"2024-04-19T03:05:11.769258+0000","last_became_active":"2024-04-19T03:04:50.614774+0000","last_became_peered":"2024-04-19T03:04:50.614774+0000","last_unstale":"2024-04-19T03:05:11.769258+0000","last_undegraded":"2024-04-19T03:05:11.769258+0000","last_fullsized":"2024-04-19T03:05:11.769258+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:51:07.142010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":71,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.431817+0000","last_change":"2024-04-19T03:05:11.430250+0000","last_active":"2024-04-19T03:05:11.431817+0000","last_peered":"2024-04-19T03:05:11.431817+0000","last_clean":"2024-04-19T03:05:11.431817+0000","last_became_active":"2024-04-19T03:05:11.429941+0000","last_became_peered":"2024-04-19T03:05:11.429941+0000","last_unstale":"2024-04-19T03:05:11.431817+0000","last_undegraded":"2024-04-19T03:05:11.431817+0000","last_fullsized":"2024-04-19T03:05:11.431817+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:28:17.231621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.769485+0000","last_change":"2024-04-19T03:04:50.615925+0000","last_active":"2024-04-19T03:05:11.769485+0000","last_peered":"2024-04-19T03:05:11.769485+0000","last_clean":"2024-04-19T03:05:11.769485+0000","last_became_active":"2024-04-19T03:04:50.614498+0000","last_became_peered":"2024-04-19T03:04:50.614498+0000","last_unstale":"2024-04-19T03:05:11.769485+0000","last_undegraded":"2024-04-19T03:05:11.769485+0000","last_fullsized":"2024-04-19T03:05:11.769485+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_clean_scrub_stamp":"2024-04-19T03:01:09.578660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:41:52.085259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":50,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.418555+0000","last_change":"2024-04-19T03:05:09.395750+0000","last_active":"2024-04-19T03:05:11.418555+0000","last_peered":"2024-04-19T03:05:11.418555+0000","last_clean":"2024-04-19T03:05:11.418555+0000","last_became_active":"2024-04-19T03:05:09.394024+0000","last_became_peered":"2024-04-19T03:05:09.394024+0000","last_unstale":"2024-04-19T03:05:11.418555+0000","last_undegraded":"2024-04-19T03:05:11.418555+0000","last_fullsized":"2024-04-19T03:05:11.418555+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:59:29.215722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":30,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.769894+0000","last_change":"2024-04-19T03:04:50.616970+0000","last_active":"2024-04-19T03:05:11.769894+0000","last_peered":"2024-04-19T03:05:11.769894+0000","last_clean":"2024-04-19T03:05:11.769894+0000","last_became_active":"2024-04-19T03:04:50.615238+0000","last_became_peered":"2024-04-19T03:04:50.615238+0000","last_unstale":"2024-04-19T03:05:11.769894+0000","last_undegraded":"2024-04-19T03:05:11.769894+0000","last_fullsized":"2024-04-19T03:05:11.769894+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:55:14.049921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":81,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.419750+0000","last_change":"2024-04-19T03:05:09.397542+0000","last_active":"2024-04-19T03:05:11.419750+0000","last_peered":"2024-04-19T03:05:11.419750+0000","last_clean":"2024-04-19T03:05:11.419750+0000","last_became_active":"2024-04-19T03:05:09.396378+0000","last_became_peered":"2024-04-19T03:05:09.396378+0000","last_unstale":"2024-04-19T03:05:11.419750+0000","last_undegraded":"2024-04-19T03:05:11.419750+0000","last_fullsized":"2024-04-19T03:05:11.419750+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_clean_scrub_stamp":"2024-04-19T03:01:09.578660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:22:24.885555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":50,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.418216+0000","last_change":"2024-04-19T03:05:09.392910+0000","last_active":"2024-04-19T03:05:11.418216+0000","last_peered":"2024-04-19T03:05:11.418216+0000","last_clean":"2024-04-19T03:05:11.418216+0000","last_became_active":"2024-04-19T03:05:09.392437+0000","last_became_peered":"2024-04-19T03:05:09.392437+0000","last_unstale":"2024-04-19T03:05:11.418216+0000","last_undegraded":"2024-04-19T03:05:11.418216+0000","last_fullsized":"2024-04-19T03:05:11.418216+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:23:28.203282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"20'2","reported_seq":32,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.769920+0000","last_change":"2024-04-19T03:04:50.611678+0000","last_active":"2024-04-19T03:05:11.769920+0000","last_peered":"2024-04-19T03:05:11.769920+0000","last_clean":"2024-04-19T03:05:11.769920+0000","last_became_active":"2024-04-19T03:04:50.611024+0000","last_became_peered":"2024-04-19T03:04:50.611024+0000","last_unstale":"2024-04-19T03:05:11.769920+0000","last_undegraded":"2024-04-19T03:05:11.769920+0000","last_fullsized":"2024-04-19T03:05:11.769920+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:08:43.323149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.769690+0000","last_change":"2024-04-19T03:04:50.616003+0000","last_active":"2024-04-19T03:05:11.769690+0000","last_peered":"2024-04-19T03:05:11.769690+0000","last_clean":"2024-04-19T03:05:11.769690+0000","last_became_active":"2024-04-19T03:04:50.612403+0000","last_became_peered":"2024-04-19T03:04:50.612403+0000","last_unstale":"2024-04-19T03:05:11.769690+0000","last_undegraded":"2024-04-19T03:05:11.769690+0000","last_fullsized":"2024-04-19T03:05:11.769690+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_clean_scrub_stamp":"2024-04-19T03:01:09.578660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:16:44.156874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.768524+0000","last_change":"2024-04-19T03:04:50.615936+0000","last_active":"2024-04-19T03:05:11.768524+0000","last_peered":"2024-04-19T03:05:11.768524+0000","last_clean":"2024-04-19T03:05:11.768524+0000","last_became_active":"2024-04-19T03:04:50.612987+0000","last_became_peered":"2024-04-19T03:04:50.612987+0000","last_unstale":"2024-04-19T03:05:11.768524+0000","last_undegraded":"2024-04-19T03:05:11.768524+0000","last_fullsized":"2024-04-19T03:05:11.768524+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:17:39.989639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"21'1","reported_seq":33,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.769909+0000","last_change":"2024-04-19T03:04:50.616200+0000","last_active":"2024-04-19T03:05:11.769909+0000","last_peered":"2024-04-19T03:05:11.769909+0000","last_clean":"2024-04-19T03:05:11.769909+0000","last_became_active":"2024-04-19T03:04:50.612697+0000","last_became_peered":"2024-04-19T03:04:50.612697+0000","last_unstale":"2024-04-19T03:05:11.769909+0000","last_undegraded":"2024-04-19T03:05:11.769909+0000","last_fullsized":"2024-04-19T03:05:11.769909+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:28:55.970411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":74,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.428574+0000","last_change":"2024-04-19T03:01:10.602274+0000","last_active":"2024-04-19T03:05:11.428574+0000","last_peered":"2024-04-19T03:05:11.428574+0000","last_clean":"2024-04-19T03:05:11.428574+0000","last_became_active":"2024-04-19T03:01:10.601487+0000","last_became_peered":"2024-04-19T03:01:10.601487+0000","last_unstale":"2024-04-19T03:05:11.428574+0000","last_undegraded":"2024-04-19T03:05:11.428574+0000","last_fullsized":"2024-04-19T03:05:11.428574+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_clean_scrub_stamp":"2024-04-19T03:01:09.578660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:26:16.712446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":71,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.417696+0000","last_change":"2024-04-19T03:01:15.018914+0000","last_active":"2024-04-19T03:05:11.417696+0000","last_peered":"2024-04-19T03:05:11.417696+0000","last_clean":"2024-04-19T03:05:11.417696+0000","last_became_active":"2024-04-19T03:01:15.018276+0000","last_became_peered":"2024-04-19T03:01:15.018276+0000","last_unstale":"2024-04-19T03:05:11.417696+0000","last_undegraded":"2024-04-19T03:05:11.417696+0000","last_fullsized":"2024-04-19T03:05:11.417696+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:40:59.453079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":76,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.431580+0000","last_change":"2024-04-19T03:05:11.430020+0000","last_active":"2024-04-19T03:05:11.431580+0000","last_peered":"2024-04-19T03:05:11.431580+0000","last_clean":"2024-04-19T03:05:11.431580+0000","last_became_active":"2024-04-19T03:05:11.429214+0000","last_became_peered":"2024-04-19T03:05:11.429214+0000","last_unstale":"2024-04-19T03:05:11.431580+0000","last_undegraded":"2024-04-19T03:05:11.431580+0000","last_fullsized":"2024-04-19T03:05:11.431580+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:06:34.608828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"20'6","reported_seq":83,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.432314+0000","last_change":"2024-04-19T03:05:11.431454+0000","last_active":"2024-04-19T03:05:11.432314+0000","last_peered":"2024-04-19T03:05:11.432314+0000","last_clean":"2024-04-19T03:05:11.432314+0000","last_became_active":"2024-04-19T03:05:11.430906+0000","last_became_peered":"2024-04-19T03:05:11.430906+0000","last_unstale":"2024-04-19T03:05:11.432314+0000","last_undegraded":"2024-04-19T03:05:11.432314+0000","last_fullsized":"2024-04-19T03:05:11.432314+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:24:28.008875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.768781+0000","last_change":"2024-04-19T03:04:50.628406+0000","last_active":"2024-04-19T03:05:11.768781+0000","last_peered":"2024-04-19T03:05:11.768781+0000","last_clean":"2024-04-19T03:05:11.768781+0000","last_became_active":"2024-04-19T03:04:50.627654+0000","last_became_peered":"2024-04-19T03:04:50.627654+0000","last_unstale":"2024-04-19T03:05:11.768781+0000","last_undegraded":"2024-04-19T03:05:11.768781+0000","last_fullsized":"2024-04-19T03:05:11.768781+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:17:57.101098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"20'3","reported_seq":54,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.419554+0000","last_change":"2024-04-19T03:05:09.398110+0000","last_active":"2024-04-19T03:05:11.419554+0000","last_peered":"2024-04-19T03:05:11.419554+0000","last_clean":"2024-04-19T03:05:11.419554+0000","last_became_active":"2024-04-19T03:05:09.397555+0000","last_became_peered":"2024-04-19T03:05:09.397555+0000","last_unstale":"2024-04-19T03:05:11.419554+0000","last_undegraded":"2024-04-19T03:05:11.419554+0000","last_fullsized":"2024-04-19T03:05:11.419554+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:27:00.017189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":71,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.431390+0000","last_change":"2024-04-19T03:05:11.429290+0000","last_active":"2024-04-19T03:05:11.431390+0000","last_peered":"2024-04-19T03:05:11.431390+0000","last_clean":"2024-04-19T03:05:11.431390+0000","last_became_active":"2024-04-19T03:05:11.428904+0000","last_became_peered":"2024-04-19T03:05:11.428904+0000","last_unstale":"2024-04-19T03:05:11.431390+0000","last_undegraded":"2024-04-19T03:05:11.431390+0000","last_fullsized":"2024-04-19T03:05:11.431390+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:16:47.688907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.768791+0000","last_change":"2024-04-19T03:04:50.634026+0000","last_active":"2024-04-19T03:05:11.768791+0000","last_peered":"2024-04-19T03:05:11.768791+0000","last_clean":"2024-04-19T03:05:11.768791+0000","last_became_active":"2024-04-19T03:04:50.630873+0000","last_became_peered":"2024-04-19T03:04:50.630873+0000","last_unstale":"2024-04-19T03:05:11.768791+0000","last_undegraded":"2024-04-19T03:05:11.768791+0000","last_fullsized":"2024-04-19T03:05:11.768791+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:41:25.674376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":30,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.770364+0000","last_change":"2024-04-19T03:04:50.612483+0000","last_active":"2024-04-19T03:05:11.770364+0000","last_peered":"2024-04-19T03:05:11.770364+0000","last_clean":"2024-04-19T03:05:11.770364+0000","last_became_active":"2024-04-19T03:04:50.612005+0000","last_became_peered":"2024-04-19T03:04:50.612005+0000","last_unstale":"2024-04-19T03:05:11.770364+0000","last_undegraded":"2024-04-19T03:05:11.770364+0000","last_fullsized":"2024-04-19T03:05:11.770364+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:56:45.629955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.768295+0000","last_change":"2024-04-19T03:04:50.616158+0000","last_active":"2024-04-19T03:05:11.768295+0000","last_peered":"2024-04-19T03:05:11.768295+0000","last_clean":"2024-04-19T03:05:11.768295+0000","last_became_active":"2024-04-19T03:04:50.613735+0000","last_became_peered":"2024-04-19T03:04:50.613735+0000","last_unstale":"2024-04-19T03:05:11.768295+0000","last_undegraded":"2024-04-19T03:05:11.768295+0000","last_fullsized":"2024-04-19T03:05:11.768295+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:25:58.128503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":50,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.419690+0000","last_change":"2024-04-19T03:05:09.394054+0000","last_active":"2024-04-19T03:05:11.419690+0000","last_peered":"2024-04-19T03:05:11.419690+0000","last_clean":"2024-04-19T03:05:11.419690+0000","last_became_active":"2024-04-19T03:05:09.392982+0000","last_became_peered":"2024-04-19T03:05:09.392982+0000","last_unstale":"2024-04-19T03:05:11.419690+0000","last_undegraded":"2024-04-19T03:05:11.419690+0000","last_fullsized":"2024-04-19T03:05:11.419690+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:09:41.580252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":30,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.768114+0000","last_change":"2024-04-19T03:04:50.616430+0000","last_active":"2024-04-19T03:05:11.768114+0000","last_peered":"2024-04-19T03:05:11.768114+0000","last_clean":"2024-04-19T03:05:11.768114+0000","last_became_active":"2024-04-19T03:04:50.613523+0000","last_became_peered":"2024-04-19T03:04:50.613523+0000","last_unstale":"2024-04-19T03:05:11.768114+0000","last_undegraded":"2024-04-19T03:05:11.768114+0000","last_fullsized":"2024-04-19T03:05:11.768114+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:22:43.207543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.770394+0000","last_change":"2024-04-19T03:04:50.616829+0000","last_active":"2024-04-19T03:05:11.770394+0000","last_peered":"2024-04-19T03:05:11.770394+0000","last_clean":"2024-04-19T03:05:11.770394+0000","last_became_active":"2024-04-19T03:04:50.616545+0000","last_became_peered":"2024-04-19T03:04:50.616545+0000","last_unstale":"2024-04-19T03:05:11.770394+0000","last_undegraded":"2024-04-19T03:05:11.770394+0000","last_fullsized":"2024-04-19T03:05:11.770394+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:07:32.515729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":30,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.768318+0000","last_change":"2024-04-19T03:04:50.634214+0000","last_active":"2024-04-19T03:05:11.768318+0000","last_peered":"2024-04-19T03:05:11.768318+0000","last_clean":"2024-04-19T03:05:11.768318+0000","last_became_active":"2024-04-19T03:04:50.631699+0000","last_became_peered":"2024-04-19T03:04:50.631699+0000","last_unstale":"2024-04-19T03:05:11.768318+0000","last_undegraded":"2024-04-19T03:05:11.768318+0000","last_fullsized":"2024-04-19T03:05:11.768318+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:43:10.184280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":53,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.418846+0000","last_change":"2024-04-19T03:05:02.361377+0000","last_active":"2024-04-19T03:05:11.418846+0000","last_peered":"2024-04-19T03:05:11.418846+0000","last_clean":"2024-04-19T03:05:11.418846+0000","last_became_active":"2024-04-19T03:05:02.360924+0000","last_became_peered":"2024-04-19T03:05:02.360924+0000","last_unstale":"2024-04-19T03:05:11.418846+0000","last_undegraded":"2024-04-19T03:05:11.418846+0000","last_fullsized":"2024-04-19T03:05:11.418846+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:39:56.940892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"20'1","reported_seq":79,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.418313+0000","last_change":"2024-04-19T03:05:09.395934+0000","last_active":"2024-04-19T03:05:11.418313+0000","last_peered":"2024-04-19T03:05:11.418313+0000","last_clean":"2024-04-19T03:05:11.418313+0000","last_became_active":"2024-04-19T03:05:09.395508+0000","last_became_peered":"2024-04-19T03:05:09.395508+0000","last_unstale":"2024-04-19T03:05:11.418313+0000","last_undegraded":"2024-04-19T03:05:11.418313+0000","last_fullsized":"2024-04-19T03:05:11.418313+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:50:26.858754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":77,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.418889+0000","last_change":"2024-04-19T03:05:09.396327+0000","last_active":"2024-04-19T03:05:11.418889+0000","last_peered":"2024-04-19T03:05:11.418889+0000","last_clean":"2024-04-19T03:05:11.418889+0000","last_became_active":"2024-04-19T03:05:09.395753+0000","last_became_peered":"2024-04-19T03:05:09.395753+0000","last_unstale":"2024-04-19T03:05:11.418889+0000","last_undegraded":"2024-04-19T03:05:11.418889+0000","last_fullsized":"2024-04-19T03:05:11.418889+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:00:12.449987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"20'1","reported_seq":87,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.418640+0000","last_change":"2024-04-19T03:05:09.398142+0000","last_active":"2024-04-19T03:05:11.418640+0000","last_peered":"2024-04-19T03:05:11.418640+0000","last_clean":"2024-04-19T03:05:11.418640+0000","last_became_active":"2024-04-19T03:05:09.397183+0000","last_became_peered":"2024-04-19T03:05:09.397183+0000","last_unstale":"2024-04-19T03:05:11.418640+0000","last_undegraded":"2024-04-19T03:05:11.418640+0000","last_fullsized":"2024-04-19T03:05:11.418640+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:45:32.978138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":86,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.431626+0000","last_change":"2024-04-19T03:05:11.430243+0000","last_active":"2024-04-19T03:05:11.431626+0000","last_peered":"2024-04-19T03:05:11.431626+0000","last_clean":"2024-04-19T03:05:11.431626+0000","last_became_active":"2024-04-19T03:05:11.429247+0000","last_became_peered":"2024-04-19T03:05:11.429247+0000","last_unstale":"2024-04-19T03:05:11.431626+0000","last_undegraded":"2024-04-19T03:05:11.431626+0000","last_fullsized":"2024-04-19T03:05:11.431626+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:41:16.915398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"20'2","reported_seq":87,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.426718+0000","last_change":"2024-04-19T03:04:50.276105+0000","last_active":"2024-04-19T03:05:11.426718+0000","last_peered":"2024-04-19T03:05:11.426718+0000","last_clean":"2024-04-19T03:05:11.426718+0000","last_became_active":"2024-04-19T03:04:50.275533+0000","last_became_peered":"2024-04-19T03:04:50.275533+0000","last_unstale":"2024-04-19T03:05:11.426718+0000","last_undegraded":"2024-04-19T03:05:11.426718+0000","last_fullsized":"2024-04-19T03:05:11.426718+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:38:13.683481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":84,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.424718+0000","last_change":"2024-04-19T03:04:50.278401+0000","last_active":"2024-04-19T03:05:11.424718+0000","last_peered":"2024-04-19T03:05:11.424718+0000","last_clean":"2024-04-19T03:05:11.424718+0000","last_became_active":"2024-04-19T03:04:50.277348+0000","last_became_peered":"2024-04-19T03:04:50.277348+0000","last_unstale":"2024-04-19T03:05:11.424718+0000","last_undegraded":"2024-04-19T03:05:11.424718+0000","last_fullsized":"2024-04-19T03:05:11.424718+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:19:35.891753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"20'2","reported_seq":56,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.419282+0000","last_change":"2024-04-19T03:05:02.363600+0000","last_active":"2024-04-19T03:05:11.419282+0000","last_peered":"2024-04-19T03:05:11.419282+0000","last_clean":"2024-04-19T03:05:11.419282+0000","last_became_active":"2024-04-19T03:05:02.363167+0000","last_became_peered":"2024-04-19T03:05:02.363167+0000","last_unstale":"2024-04-19T03:05:11.419282+0000","last_undegraded":"2024-04-19T03:05:11.419282+0000","last_fullsized":"2024-04-19T03:05:11.419282+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:49:54.288998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":77,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.418217+0000","last_change":"2024-04-19T03:05:09.394500+0000","last_active":"2024-04-19T03:05:11.418217+0000","last_peered":"2024-04-19T03:05:11.418217+0000","last_clean":"2024-04-19T03:05:11.418217+0000","last_became_active":"2024-04-19T03:05:09.393975+0000","last_became_peered":"2024-04-19T03:05:09.393975+0000","last_unstale":"2024-04-19T03:05:11.418217+0000","last_undegraded":"2024-04-19T03:05:11.418217+0000","last_fullsized":"2024-04-19T03:05:11.418217+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:00:55.706542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"20'1","reported_seq":32,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.770844+0000","last_change":"2024-04-19T03:04:50.627670+0000","last_active":"2024-04-19T03:05:11.770844+0000","last_peered":"2024-04-19T03:05:11.770844+0000","last_clean":"2024-04-19T03:05:11.770844+0000","last_became_active":"2024-04-19T03:04:50.627304+0000","last_became_peered":"2024-04-19T03:04:50.627304+0000","last_unstale":"2024-04-19T03:05:11.770844+0000","last_undegraded":"2024-04-19T03:05:11.770844+0000","last_fullsized":"2024-04-19T03:05:11.770844+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:29:08.875911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":84,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.423682+0000","last_change":"2024-04-19T03:04:50.279334+0000","last_active":"2024-04-19T03:05:11.423682+0000","last_peered":"2024-04-19T03:05:11.423682+0000","last_clean":"2024-04-19T03:05:11.423682+0000","last_became_active":"2024-04-19T03:04:50.278874+0000","last_became_peered":"2024-04-19T03:04:50.278874+0000","last_unstale":"2024-04-19T03:05:11.423682+0000","last_undegraded":"2024-04-19T03:05:11.423682+0000","last_fullsized":"2024-04-19T03:05:11.423682+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:51:33.707741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"20'4","reported_seq":32,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.770772+0000","last_change":"2024-04-19T03:04:50.627070+0000","last_active":"2024-04-19T03:05:11.770772+0000","last_peered":"2024-04-19T03:05:11.770772+0000","last_clean":"2024-04-19T03:05:11.770772+0000","last_became_active":"2024-04-19T03:04:50.626334+0000","last_became_peered":"2024-04-19T03:04:50.626334+0000","last_unstale":"2024-04-19T03:05:11.770772+0000","last_undegraded":"2024-04-19T03:05:11.770772+0000","last_fullsized":"2024-04-19T03:05:11.770772+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:24:58.586175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5289,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":14482,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":10,"seq":42949673016,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":220712,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":219774,"kb_avail":94151128,"statfs":{"total":96636764160,"available":96410755072,"internally_reserved":0,"allocated":946176,"data_stored":929795,"data_compressed":7241,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":225049030},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 19 03:02:08 2024","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"last":0.53400000000000003}]},{"osd":1,"last update":"Fri Apr 19 03:04:11 2024","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.19900000000000001,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.87,"5min":2.5030000000000001,"15min":2.5030000000000001},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.57099999999999995,"15min":0.56299999999999994},"min":{"1min":0.23999999999999999,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.90400000000000003,"5min":2.6379999999999999,"15min":2.6379999999999999},"last":0.65000000000000002}]}]},{"osd":1,"up_from":10,"seq":42949673015,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":202656,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":201726,"kb_avail":94169184,"statfs":{"total":96636764160,"available":96429244416,"internally_reserved":0,"allocated":933888,"data_stored":927081,"data_compressed":7241,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":206567878},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 19 03:02:04 2024","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.58699999999999997}]},{"osd":2,"last update":"Fri Apr 19 03:05:08 2024","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.501,"15min":0.50800000000000001},"min":{"1min":0.46999999999999997,"5min":0.224,"15min":0.224},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.50700000000000001,"15min":0.52100000000000002},"min":{"1min":0.52100000000000002,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.94899999999999995}]}]},{"osd":0,"up_from":71,"seq":304942678023,"num_pgs":73,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47712,"kb_used_data":848,"kb_used_omap":6,"kb_used_meta":46841,"kb_avail":94324128,"statfs":{"total":96636764160,"available":96587907072,"internally_reserved":0,"allocated":868352,"data_stored":339844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6883,"internal_metadata":47965469},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61799999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69199999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":7241,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":7241,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5289,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-19T03:05:15.288 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-19T03:05:15.603 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-19T03:05:15.605 INFO:teuthology.orchestra.run.smithi096.stderr:dumped all 2024-04-19T03:05:15.618 INFO:teuthology.orchestra.run.smithi096.stdout:{"pg_ready":true,"pg_map":{"version":202,"stamp":"2024-04-19T03:05:14.049966+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":471080,"kb_used_data":2684,"kb_used_omap":9,"kb_used_meta":468342,"kb_avail":282644440,"statfs":{"total":289910292480,"available":289427906560,"internally_reserved":0,"allocated":2748416,"data_stored":2196720,"data_compressed":14482,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":10071,"internal_metadata":479582377},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.671652"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":77,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.419575+0000","last_change":"2024-04-19T03:05:09.396661+0000","last_active":"2024-04-19T03:05:11.419575+0000","last_peered":"2024-04-19T03:05:11.419575+0000","last_clean":"2024-04-19T03:05:11.419575+0000","last_became_active":"2024-04-19T03:05:09.396279+0000","last_became_peered":"2024-04-19T03:05:09.396279+0000","last_unstale":"2024-04-19T03:05:11.419575+0000","last_undegraded":"2024-04-19T03:05:11.419575+0000","last_fullsized":"2024-04-19T03:05:11.419575+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:20:04.982562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":84,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.418854+0000","last_change":"2024-04-19T03:04:50.278334+0000","last_active":"2024-04-19T03:05:11.418854+0000","last_peered":"2024-04-19T03:05:11.418854+0000","last_clean":"2024-04-19T03:05:11.418854+0000","last_became_active":"2024-04-19T03:04:50.277848+0000","last_became_peered":"2024-04-19T03:04:50.277848+0000","last_unstale":"2024-04-19T03:05:11.418854+0000","last_undegraded":"2024-04-19T03:05:11.418854+0000","last_fullsized":"2024-04-19T03:05:11.418854+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:57:39.589383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":71,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.425858+0000","last_change":"2024-04-19T03:01:15.015884+0000","last_active":"2024-04-19T03:05:11.425858+0000","last_peered":"2024-04-19T03:05:11.425858+0000","last_clean":"2024-04-19T03:05:11.425858+0000","last_became_active":"2024-04-19T03:01:15.014599+0000","last_became_peered":"2024-04-19T03:01:15.014599+0000","last_unstale":"2024-04-19T03:05:11.425858+0000","last_undegraded":"2024-04-19T03:05:11.425858+0000","last_fullsized":"2024-04-19T03:05:11.425858+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:35:19.436344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":84,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.425776+0000","last_change":"2024-04-19T03:04:50.275017+0000","last_active":"2024-04-19T03:05:11.425776+0000","last_peered":"2024-04-19T03:05:11.425776+0000","last_clean":"2024-04-19T03:05:11.425776+0000","last_became_active":"2024-04-19T03:04:50.274600+0000","last_became_peered":"2024-04-19T03:04:50.274600+0000","last_unstale":"2024-04-19T03:05:11.425776+0000","last_undegraded":"2024-04-19T03:05:11.425776+0000","last_fullsized":"2024-04-19T03:05:11.425776+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:21:44.006351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":77,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.418426+0000","last_change":"2024-04-19T03:05:09.397682+0000","last_active":"2024-04-19T03:05:11.418426+0000","last_peered":"2024-04-19T03:05:11.418426+0000","last_clean":"2024-04-19T03:05:11.418426+0000","last_became_active":"2024-04-19T03:05:09.395929+0000","last_became_peered":"2024-04-19T03:05:09.395929+0000","last_unstale":"2024-04-19T03:05:11.418426+0000","last_undegraded":"2024-04-19T03:05:11.418426+0000","last_fullsized":"2024-04-19T03:05:11.418426+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:57:03.617383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":70,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.430738+0000","last_change":"2024-04-19T03:05:11.428461+0000","last_active":"2024-04-19T03:05:11.430738+0000","last_peered":"2024-04-19T03:05:11.430738+0000","last_clean":"2024-04-19T03:05:11.430738+0000","last_became_active":"2024-04-19T03:05:11.426617+0000","last_became_peered":"2024-04-19T03:05:11.426617+0000","last_unstale":"2024-04-19T03:05:11.430738+0000","last_undegraded":"2024-04-19T03:05:11.430738+0000","last_fullsized":"2024-04-19T03:05:11.430738+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:18:53.462220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":70,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.429888+0000","last_change":"2024-04-19T03:05:11.424581+0000","last_active":"2024-04-19T03:05:11.429888+0000","last_peered":"2024-04-19T03:05:11.429888+0000","last_clean":"2024-04-19T03:05:11.429888+0000","last_became_active":"2024-04-19T03:05:11.422727+0000","last_became_peered":"2024-04-19T03:05:11.422727+0000","last_unstale":"2024-04-19T03:05:11.429888+0000","last_undegraded":"2024-04-19T03:05:11.429888+0000","last_fullsized":"2024-04-19T03:05:11.429888+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:48:53.502161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":84,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.422960+0000","last_change":"2024-04-19T03:04:50.261359+0000","last_active":"2024-04-19T03:05:11.422960+0000","last_peered":"2024-04-19T03:05:11.422960+0000","last_clean":"2024-04-19T03:05:11.422960+0000","last_became_active":"2024-04-19T03:04:50.261155+0000","last_became_peered":"2024-04-19T03:04:50.261155+0000","last_unstale":"2024-04-19T03:05:11.422960+0000","last_undegraded":"2024-04-19T03:05:11.422960+0000","last_fullsized":"2024-04-19T03:05:11.422960+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:09:37.911709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.770311+0000","last_change":"2024-04-19T03:04:50.611854+0000","last_active":"2024-04-19T03:05:11.770311+0000","last_peered":"2024-04-19T03:05:11.770311+0000","last_clean":"2024-04-19T03:05:11.770311+0000","last_became_active":"2024-04-19T03:04:50.611400+0000","last_became_peered":"2024-04-19T03:04:50.611400+0000","last_unstale":"2024-04-19T03:05:11.770311+0000","last_undegraded":"2024-04-19T03:05:11.770311+0000","last_fullsized":"2024-04-19T03:05:11.770311+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:33:58.731162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":84,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.418911+0000","last_change":"2024-04-19T03:04:50.278337+0000","last_active":"2024-04-19T03:05:11.418911+0000","last_peered":"2024-04-19T03:05:11.418911+0000","last_clean":"2024-04-19T03:05:11.418911+0000","last_became_active":"2024-04-19T03:04:50.277899+0000","last_became_peered":"2024-04-19T03:04:50.277899+0000","last_unstale":"2024-04-19T03:05:11.418911+0000","last_undegraded":"2024-04-19T03:05:11.418911+0000","last_fullsized":"2024-04-19T03:05:11.418911+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:32:49.546687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":70,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.431939+0000","last_change":"2024-04-19T03:05:11.430574+0000","last_active":"2024-04-19T03:05:11.431939+0000","last_peered":"2024-04-19T03:05:11.431939+0000","last_clean":"2024-04-19T03:05:11.431939+0000","last_became_active":"2024-04-19T03:05:11.430243+0000","last_became_peered":"2024-04-19T03:05:11.430243+0000","last_unstale":"2024-04-19T03:05:11.431939+0000","last_undegraded":"2024-04-19T03:05:11.431939+0000","last_fullsized":"2024-04-19T03:05:11.431939+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:37:37.372803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":50,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.418696+0000","last_change":"2024-04-19T03:05:09.394405+0000","last_active":"2024-04-19T03:05:11.418696+0000","last_peered":"2024-04-19T03:05:11.418696+0000","last_clean":"2024-04-19T03:05:11.418696+0000","last_became_active":"2024-04-19T03:05:09.392822+0000","last_became_peered":"2024-04-19T03:05:09.392822+0000","last_unstale":"2024-04-19T03:05:11.418696+0000","last_undegraded":"2024-04-19T03:05:11.418696+0000","last_fullsized":"2024-04-19T03:05:11.418696+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:33:27.982343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":77,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.417984+0000","last_change":"2024-04-19T03:05:09.397000+0000","last_active":"2024-04-19T03:05:11.417984+0000","last_peered":"2024-04-19T03:05:11.417984+0000","last_clean":"2024-04-19T03:05:11.417984+0000","last_became_active":"2024-04-19T03:05:09.395749+0000","last_became_peered":"2024-04-19T03:05:09.395749+0000","last_unstale":"2024-04-19T03:05:11.417984+0000","last_undegraded":"2024-04-19T03:05:11.417984+0000","last_fullsized":"2024-04-19T03:05:11.417984+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:21:26.436890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":71,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.423871+0000","last_change":"2024-04-19T03:01:15.010960+0000","last_active":"2024-04-19T03:05:11.423871+0000","last_peered":"2024-04-19T03:05:11.423871+0000","last_clean":"2024-04-19T03:05:11.423871+0000","last_became_active":"2024-04-19T03:01:15.010472+0000","last_became_peered":"2024-04-19T03:01:15.010472+0000","last_unstale":"2024-04-19T03:05:11.423871+0000","last_undegraded":"2024-04-19T03:05:11.423871+0000","last_fullsized":"2024-04-19T03:05:11.423871+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:21:36.129346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":73,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.430581+0000","last_change":"2024-04-19T03:05:11.428285+0000","last_active":"2024-04-19T03:05:11.430581+0000","last_peered":"2024-04-19T03:05:11.430581+0000","last_clean":"2024-04-19T03:05:11.430581+0000","last_became_active":"2024-04-19T03:05:11.425921+0000","last_became_peered":"2024-04-19T03:05:11.425921+0000","last_unstale":"2024-04-19T03:05:11.430581+0000","last_undegraded":"2024-04-19T03:05:11.430581+0000","last_fullsized":"2024-04-19T03:05:11.430581+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:38:49.965677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":70,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.430778+0000","last_change":"2024-04-19T03:05:11.429030+0000","last_active":"2024-04-19T03:05:11.430778+0000","last_peered":"2024-04-19T03:05:11.430778+0000","last_clean":"2024-04-19T03:05:11.430778+0000","last_became_active":"2024-04-19T03:05:11.425921+0000","last_became_peered":"2024-04-19T03:05:11.425921+0000","last_unstale":"2024-04-19T03:05:11.430778+0000","last_undegraded":"2024-04-19T03:05:11.430778+0000","last_fullsized":"2024-04-19T03:05:11.430778+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:53:07.351904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.770126+0000","last_change":"2024-04-19T03:04:50.611757+0000","last_active":"2024-04-19T03:05:11.770126+0000","last_peered":"2024-04-19T03:05:11.770126+0000","last_clean":"2024-04-19T03:05:11.770126+0000","last_became_active":"2024-04-19T03:04:50.611392+0000","last_became_peered":"2024-04-19T03:04:50.611392+0000","last_unstale":"2024-04-19T03:05:11.770126+0000","last_undegraded":"2024-04-19T03:05:11.770126+0000","last_fullsized":"2024-04-19T03:05:11.770126+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:51:50.768612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":77,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.419368+0000","last_change":"2024-04-19T03:05:09.397114+0000","last_active":"2024-04-19T03:05:11.419368+0000","last_peered":"2024-04-19T03:05:11.419368+0000","last_clean":"2024-04-19T03:05:11.419368+0000","last_became_active":"2024-04-19T03:05:09.395682+0000","last_became_peered":"2024-04-19T03:05:09.395682+0000","last_unstale":"2024-04-19T03:05:11.419368+0000","last_undegraded":"2024-04-19T03:05:11.419368+0000","last_fullsized":"2024-04-19T03:05:11.419368+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:55:53.897442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.769589+0000","last_change":"2024-04-19T03:04:50.613858+0000","last_active":"2024-04-19T03:05:11.769589+0000","last_peered":"2024-04-19T03:05:11.769589+0000","last_clean":"2024-04-19T03:05:11.769589+0000","last_became_active":"2024-04-19T03:04:50.613481+0000","last_became_peered":"2024-04-19T03:04:50.613481+0000","last_unstale":"2024-04-19T03:05:11.769589+0000","last_undegraded":"2024-04-19T03:05:11.769589+0000","last_fullsized":"2024-04-19T03:05:11.769589+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:55:45.686937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":86,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.432386+0000","last_change":"2024-04-19T03:05:11.431719+0000","last_active":"2024-04-19T03:05:11.432386+0000","last_peered":"2024-04-19T03:05:11.432386+0000","last_clean":"2024-04-19T03:05:11.432386+0000","last_became_active":"2024-04-19T03:05:11.431352+0000","last_became_peered":"2024-04-19T03:05:11.431352+0000","last_unstale":"2024-04-19T03:05:11.432386+0000","last_undegraded":"2024-04-19T03:05:11.432386+0000","last_fullsized":"2024-04-19T03:05:11.432386+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:54:50.052460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":84,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.424051+0000","last_change":"2024-04-19T03:04:50.276678+0000","last_active":"2024-04-19T03:05:11.424051+0000","last_peered":"2024-04-19T03:05:11.424051+0000","last_clean":"2024-04-19T03:05:11.424051+0000","last_became_active":"2024-04-19T03:04:50.275510+0000","last_became_peered":"2024-04-19T03:04:50.275510+0000","last_unstale":"2024-04-19T03:05:11.424051+0000","last_undegraded":"2024-04-19T03:05:11.424051+0000","last_fullsized":"2024-04-19T03:05:11.424051+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:17:24.832346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":71,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.417759+0000","last_change":"2024-04-19T03:01:15.020108+0000","last_active":"2024-04-19T03:05:11.417759+0000","last_peered":"2024-04-19T03:05:11.417759+0000","last_clean":"2024-04-19T03:05:11.417759+0000","last_became_active":"2024-04-19T03:01:15.018978+0000","last_became_peered":"2024-04-19T03:01:15.018978+0000","last_unstale":"2024-04-19T03:05:11.417759+0000","last_undegraded":"2024-04-19T03:05:11.417759+0000","last_fullsized":"2024-04-19T03:05:11.417759+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:30:22.360053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.768605+0000","last_change":"2024-04-19T03:04:50.633855+0000","last_active":"2024-04-19T03:05:11.768605+0000","last_peered":"2024-04-19T03:05:11.768605+0000","last_clean":"2024-04-19T03:05:11.768605+0000","last_became_active":"2024-04-19T03:04:50.630948+0000","last_became_peered":"2024-04-19T03:04:50.630948+0000","last_unstale":"2024-04-19T03:05:11.768605+0000","last_undegraded":"2024-04-19T03:05:11.768605+0000","last_fullsized":"2024-04-19T03:05:11.768605+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:41:31.676439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":77,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.417346+0000","last_change":"2024-04-19T03:05:09.391159+0000","last_active":"2024-04-19T03:05:11.417346+0000","last_peered":"2024-04-19T03:05:11.417346+0000","last_clean":"2024-04-19T03:05:11.417346+0000","last_became_active":"2024-04-19T03:05:09.390922+0000","last_became_peered":"2024-04-19T03:05:09.390922+0000","last_unstale":"2024-04-19T03:05:11.417346+0000","last_undegraded":"2024-04-19T03:05:11.417346+0000","last_fullsized":"2024-04-19T03:05:11.417346+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:32:01.116711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":50,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.419689+0000","last_change":"2024-04-19T03:05:09.393923+0000","last_active":"2024-04-19T03:05:11.419689+0000","last_peered":"2024-04-19T03:05:11.419689+0000","last_clean":"2024-04-19T03:05:11.419689+0000","last_became_active":"2024-04-19T03:05:09.393108+0000","last_became_peered":"2024-04-19T03:05:09.393108+0000","last_unstale":"2024-04-19T03:05:11.419689+0000","last_undegraded":"2024-04-19T03:05:11.419689+0000","last_fullsized":"2024-04-19T03:05:11.419689+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:29:37.674820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.770633+0000","last_change":"2024-04-19T03:04:50.626923+0000","last_active":"2024-04-19T03:05:11.770633+0000","last_peered":"2024-04-19T03:05:11.770633+0000","last_clean":"2024-04-19T03:05:11.770633+0000","last_became_active":"2024-04-19T03:04:50.617603+0000","last_became_peered":"2024-04-19T03:04:50.617603+0000","last_unstale":"2024-04-19T03:05:11.770633+0000","last_undegraded":"2024-04-19T03:05:11.770633+0000","last_fullsized":"2024-04-19T03:05:11.770633+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:26:56.826024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:12.905140+0000","last_change":"2024-04-19T03:05:11.431713+0000","last_active":"2024-04-19T03:05:12.905140+0000","last_peered":"2024-04-19T03:05:12.905140+0000","last_clean":"2024-04-19T03:05:12.905140+0000","last_became_active":"2024-04-19T03:05:11.431129+0000","last_became_peered":"2024-04-19T03:05:11.431129+0000","last_unstale":"2024-04-19T03:05:12.905140+0000","last_undegraded":"2024-04-19T03:05:12.905140+0000","last_fullsized":"2024-04-19T03:05:12.905140+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:00:07.623146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":71,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.419121+0000","last_change":"2024-04-19T03:01:15.020098+0000","last_active":"2024-04-19T03:05:11.419121+0000","last_peered":"2024-04-19T03:05:11.419121+0000","last_clean":"2024-04-19T03:05:11.419121+0000","last_became_active":"2024-04-19T03:01:15.019064+0000","last_became_peered":"2024-04-19T03:01:15.019064+0000","last_unstale":"2024-04-19T03:05:11.419121+0000","last_undegraded":"2024-04-19T03:05:11.419121+0000","last_fullsized":"2024-04-19T03:05:11.419121+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:50:06.490191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.769012+0000","last_change":"2024-04-19T03:04:50.616823+0000","last_active":"2024-04-19T03:05:11.769012+0000","last_peered":"2024-04-19T03:05:11.769012+0000","last_clean":"2024-04-19T03:05:11.769012+0000","last_became_active":"2024-04-19T03:04:50.616550+0000","last_became_peered":"2024-04-19T03:04:50.616550+0000","last_unstale":"2024-04-19T03:05:11.769012+0000","last_undegraded":"2024-04-19T03:05:11.769012+0000","last_fullsized":"2024-04-19T03:05:11.769012+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:46:25.096677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":50,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.418068+0000","last_change":"2024-04-19T03:05:09.394074+0000","last_active":"2024-04-19T03:05:11.418068+0000","last_peered":"2024-04-19T03:05:11.418068+0000","last_clean":"2024-04-19T03:05:11.418068+0000","last_became_active":"2024-04-19T03:05:09.393178+0000","last_became_peered":"2024-04-19T03:05:09.393178+0000","last_unstale":"2024-04-19T03:05:11.418068+0000","last_undegraded":"2024-04-19T03:05:11.418068+0000","last_fullsized":"2024-04-19T03:05:11.418068+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:53:27.695302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.769044+0000","last_change":"2024-04-19T03:04:50.635141+0000","last_active":"2024-04-19T03:05:11.769044+0000","last_peered":"2024-04-19T03:05:11.769044+0000","last_clean":"2024-04-19T03:05:11.769044+0000","last_became_active":"2024-04-19T03:04:50.633033+0000","last_became_peered":"2024-04-19T03:04:50.633033+0000","last_unstale":"2024-04-19T03:05:11.769044+0000","last_undegraded":"2024-04-19T03:05:11.769044+0000","last_fullsized":"2024-04-19T03:05:11.769044+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:42:01.712749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":84,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.423252+0000","last_change":"2024-04-19T03:04:50.279507+0000","last_active":"2024-04-19T03:05:11.423252+0000","last_peered":"2024-04-19T03:05:11.423252+0000","last_clean":"2024-04-19T03:05:11.423252+0000","last_became_active":"2024-04-19T03:04:50.278996+0000","last_became_peered":"2024-04-19T03:04:50.278996+0000","last_unstale":"2024-04-19T03:05:11.423252+0000","last_undegraded":"2024-04-19T03:05:11.423252+0000","last_fullsized":"2024-04-19T03:05:11.423252+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:09:09.816660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":77,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.419122+0000","last_change":"2024-04-19T03:05:09.396527+0000","last_active":"2024-04-19T03:05:11.419122+0000","last_peered":"2024-04-19T03:05:11.419122+0000","last_clean":"2024-04-19T03:05:11.419122+0000","last_became_active":"2024-04-19T03:05:09.395920+0000","last_became_peered":"2024-04-19T03:05:09.395920+0000","last_unstale":"2024-04-19T03:05:11.419122+0000","last_undegraded":"2024-04-19T03:05:11.419122+0000","last_fullsized":"2024-04-19T03:05:11.419122+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:23:05.984746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"20'2","reported_seq":87,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.424713+0000","last_change":"2024-04-19T03:04:50.277421+0000","last_active":"2024-04-19T03:05:11.424713+0000","last_peered":"2024-04-19T03:05:11.424713+0000","last_clean":"2024-04-19T03:05:11.424713+0000","last_became_active":"2024-04-19T03:04:50.276732+0000","last_became_peered":"2024-04-19T03:04:50.276732+0000","last_unstale":"2024-04-19T03:05:11.424713+0000","last_undegraded":"2024-04-19T03:05:11.424713+0000","last_fullsized":"2024-04-19T03:05:11.424713+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:23:27.191496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":77,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.419051+0000","last_change":"2024-04-19T03:05:09.395454+0000","last_active":"2024-04-19T03:05:11.419051+0000","last_peered":"2024-04-19T03:05:11.419051+0000","last_clean":"2024-04-19T03:05:11.419051+0000","last_became_active":"2024-04-19T03:05:09.394288+0000","last_became_peered":"2024-04-19T03:05:09.394288+0000","last_unstale":"2024-04-19T03:05:11.419051+0000","last_undegraded":"2024-04-19T03:05:11.419051+0000","last_fullsized":"2024-04-19T03:05:11.419051+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:32:14.358374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":30,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.768860+0000","last_change":"2024-04-19T03:04:50.628801+0000","last_active":"2024-04-19T03:05:11.768860+0000","last_peered":"2024-04-19T03:05:11.768860+0000","last_clean":"2024-04-19T03:05:11.768860+0000","last_became_active":"2024-04-19T03:04:50.628023+0000","last_became_peered":"2024-04-19T03:04:50.628023+0000","last_unstale":"2024-04-19T03:05:11.768860+0000","last_undegraded":"2024-04-19T03:05:11.768860+0000","last_fullsized":"2024-04-19T03:05:11.768860+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:52:41.731698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.770121+0000","last_change":"2024-04-19T03:04:50.616471+0000","last_active":"2024-04-19T03:05:11.770121+0000","last_peered":"2024-04-19T03:05:11.770121+0000","last_clean":"2024-04-19T03:05:11.770121+0000","last_became_active":"2024-04-19T03:04:50.613860+0000","last_became_peered":"2024-04-19T03:04:50.613860+0000","last_unstale":"2024-04-19T03:05:11.770121+0000","last_undegraded":"2024-04-19T03:05:11.770121+0000","last_fullsized":"2024-04-19T03:05:11.770121+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:26:24.246287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":72,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.417986+0000","last_change":"2024-04-19T03:01:14.649074+0000","last_active":"2024-04-19T03:05:11.417986+0000","last_peered":"2024-04-19T03:05:11.417986+0000","last_clean":"2024-04-19T03:05:11.417986+0000","last_became_active":"2024-04-19T03:01:14.648217+0000","last_became_peered":"2024-04-19T03:01:14.648217+0000","last_unstale":"2024-04-19T03:05:11.417986+0000","last_undegraded":"2024-04-19T03:05:11.417986+0000","last_fullsized":"2024-04-19T03:05:11.417986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:57:05.238043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.769706+0000","last_change":"2024-04-19T03:04:50.611026+0000","last_active":"2024-04-19T03:05:11.769706+0000","last_peered":"2024-04-19T03:05:11.769706+0000","last_clean":"2024-04-19T03:05:11.769706+0000","last_became_active":"2024-04-19T03:04:50.610659+0000","last_became_peered":"2024-04-19T03:04:50.610659+0000","last_unstale":"2024-04-19T03:05:11.769706+0000","last_undegraded":"2024-04-19T03:05:11.769706+0000","last_fullsized":"2024-04-19T03:05:11.769706+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:57:17.231684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"20'8","reported_seq":85,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.431442+0000","last_change":"2024-04-19T03:05:11.429829+0000","last_active":"2024-04-19T03:05:11.431442+0000","last_peered":"2024-04-19T03:05:11.431442+0000","last_clean":"2024-04-19T03:05:11.431442+0000","last_became_active":"2024-04-19T03:05:11.428668+0000","last_became_peered":"2024-04-19T03:05:11.428668+0000","last_unstale":"2024-04-19T03:05:11.431442+0000","last_undegraded":"2024-04-19T03:05:11.431442+0000","last_fullsized":"2024-04-19T03:05:11.431442+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:14:21.956275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"20'1","reported_seq":73,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.428642+0000","last_change":"2024-04-19T03:01:14.649839+0000","last_active":"2024-04-19T03:05:11.428642+0000","last_peered":"2024-04-19T03:05:11.428642+0000","last_clean":"2024-04-19T03:05:11.428642+0000","last_became_active":"2024-04-19T03:01:14.649571+0000","last_became_peered":"2024-04-19T03:01:14.649571+0000","last_unstale":"2024-04-19T03:05:11.428642+0000","last_undegraded":"2024-04-19T03:05:11.428642+0000","last_fullsized":"2024-04-19T03:05:11.428642+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:03:57.839660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":53,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.417983+0000","last_change":"2024-04-19T03:05:02.362526+0000","last_active":"2024-04-19T03:05:11.417983+0000","last_peered":"2024-04-19T03:05:11.417983+0000","last_clean":"2024-04-19T03:05:11.417983+0000","last_became_active":"2024-04-19T03:05:02.362227+0000","last_became_peered":"2024-04-19T03:05:02.362227+0000","last_unstale":"2024-04-19T03:05:11.417983+0000","last_undegraded":"2024-04-19T03:05:11.417983+0000","last_fullsized":"2024-04-19T03:05:11.417983+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:00:25.584557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"20'2","reported_seq":74,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.419401+0000","last_change":"2024-04-19T03:01:14.645075+0000","last_active":"2024-04-19T03:05:11.419401+0000","last_peered":"2024-04-19T03:05:11.419401+0000","last_clean":"2024-04-19T03:05:11.419401+0000","last_became_active":"2024-04-19T03:01:14.644790+0000","last_became_peered":"2024-04-19T03:01:14.644790+0000","last_unstale":"2024-04-19T03:05:11.419401+0000","last_undegraded":"2024-04-19T03:05:11.419401+0000","last_fullsized":"2024-04-19T03:05:11.419401+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:55:15.035769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":77,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.417574+0000","last_change":"2024-04-19T03:05:09.393128+0000","last_active":"2024-04-19T03:05:11.417574+0000","last_peered":"2024-04-19T03:05:11.417574+0000","last_clean":"2024-04-19T03:05:11.417574+0000","last_became_active":"2024-04-19T03:05:09.392736+0000","last_became_peered":"2024-04-19T03:05:09.392736+0000","last_unstale":"2024-04-19T03:05:11.417574+0000","last_undegraded":"2024-04-19T03:05:11.417574+0000","last_fullsized":"2024-04-19T03:05:11.417574+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:04:56.310628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"20'1","reported_seq":40,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:12.905624+0000","last_change":"2024-04-19T03:05:11.431892+0000","last_active":"2024-04-19T03:05:12.905624+0000","last_peered":"2024-04-19T03:05:12.905624+0000","last_clean":"2024-04-19T03:05:12.905624+0000","last_became_active":"2024-04-19T03:05:11.431552+0000","last_became_peered":"2024-04-19T03:05:11.431552+0000","last_unstale":"2024-04-19T03:05:12.905624+0000","last_undegraded":"2024-04-19T03:05:12.905624+0000","last_fullsized":"2024-04-19T03:05:12.905624+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:38:26.843094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":84,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.424141+0000","last_change":"2024-04-19T03:04:50.277960+0000","last_active":"2024-04-19T03:05:11.424141+0000","last_peered":"2024-04-19T03:05:11.424141+0000","last_clean":"2024-04-19T03:05:11.424141+0000","last_became_active":"2024-04-19T03:04:50.277126+0000","last_became_peered":"2024-04-19T03:04:50.277126+0000","last_unstale":"2024-04-19T03:05:11.424141+0000","last_undegraded":"2024-04-19T03:05:11.424141+0000","last_fullsized":"2024-04-19T03:05:11.424141+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:08:49.146373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":71,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.431622+0000","last_change":"2024-04-19T03:05:11.429040+0000","last_active":"2024-04-19T03:05:11.431622+0000","last_peered":"2024-04-19T03:05:11.431622+0000","last_clean":"2024-04-19T03:05:11.431622+0000","last_became_active":"2024-04-19T03:05:11.428722+0000","last_became_peered":"2024-04-19T03:05:11.428722+0000","last_unstale":"2024-04-19T03:05:11.431622+0000","last_undegraded":"2024-04-19T03:05:11.431622+0000","last_fullsized":"2024-04-19T03:05:11.431622+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:52:42.089565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.770183+0000","last_change":"2024-04-19T03:04:50.627120+0000","last_active":"2024-04-19T03:05:11.770183+0000","last_peered":"2024-04-19T03:05:11.770183+0000","last_clean":"2024-04-19T03:05:11.770183+0000","last_became_active":"2024-04-19T03:04:50.625919+0000","last_became_peered":"2024-04-19T03:04:50.625919+0000","last_unstale":"2024-04-19T03:05:11.770183+0000","last_undegraded":"2024-04-19T03:05:11.770183+0000","last_fullsized":"2024-04-19T03:05:11.770183+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:56:19.822304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"20'2","reported_seq":32,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.769746+0000","last_change":"2024-04-19T03:04:50.627277+0000","last_active":"2024-04-19T03:05:11.769746+0000","last_peered":"2024-04-19T03:05:11.769746+0000","last_clean":"2024-04-19T03:05:11.769746+0000","last_became_active":"2024-04-19T03:04:50.625931+0000","last_became_peered":"2024-04-19T03:04:50.625931+0000","last_unstale":"2024-04-19T03:05:11.769746+0000","last_undegraded":"2024-04-19T03:05:11.769746+0000","last_fullsized":"2024-04-19T03:05:11.769746+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:30:32.408349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":86,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.431933+0000","last_change":"2024-04-19T03:05:11.430496+0000","last_active":"2024-04-19T03:05:11.431933+0000","last_peered":"2024-04-19T03:05:11.431933+0000","last_clean":"2024-04-19T03:05:11.431933+0000","last_became_active":"2024-04-19T03:05:11.430149+0000","last_became_peered":"2024-04-19T03:05:11.430149+0000","last_unstale":"2024-04-19T03:05:11.431933+0000","last_undegraded":"2024-04-19T03:05:11.431933+0000","last_fullsized":"2024-04-19T03:05:11.431933+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:55:24.828882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":85,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.424643+0000","last_change":"2024-04-19T03:04:50.278491+0000","last_active":"2024-04-19T03:05:11.424643+0000","last_peered":"2024-04-19T03:05:11.424643+0000","last_clean":"2024-04-19T03:05:11.424643+0000","last_became_active":"2024-04-19T03:04:50.277603+0000","last_became_peered":"2024-04-19T03:04:50.277603+0000","last_unstale":"2024-04-19T03:05:11.424643+0000","last_undegraded":"2024-04-19T03:05:11.424643+0000","last_fullsized":"2024-04-19T03:05:11.424643+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:04:26.211975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":71,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.426785+0000","last_change":"2024-04-19T03:01:15.015685+0000","last_active":"2024-04-19T03:05:11.426785+0000","last_peered":"2024-04-19T03:05:11.426785+0000","last_clean":"2024-04-19T03:05:11.426785+0000","last_became_active":"2024-04-19T03:01:15.014847+0000","last_became_peered":"2024-04-19T03:01:15.014847+0000","last_unstale":"2024-04-19T03:05:11.426785+0000","last_undegraded":"2024-04-19T03:05:11.426785+0000","last_fullsized":"2024-04-19T03:05:11.426785+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:51:06.208551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":51,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.418053+0000","last_change":"2024-04-19T03:05:09.392582+0000","last_active":"2024-04-19T03:05:11.418053+0000","last_peered":"2024-04-19T03:05:11.418053+0000","last_clean":"2024-04-19T03:05:11.418053+0000","last_became_active":"2024-04-19T03:05:09.391218+0000","last_became_peered":"2024-04-19T03:05:09.391218+0000","last_unstale":"2024-04-19T03:05:11.418053+0000","last_undegraded":"2024-04-19T03:05:11.418053+0000","last_fullsized":"2024-04-19T03:05:11.418053+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:06:11.612173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":71,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.426219+0000","last_change":"2024-04-19T03:01:15.014818+0000","last_active":"2024-04-19T03:05:11.426219+0000","last_peered":"2024-04-19T03:05:11.426219+0000","last_clean":"2024-04-19T03:05:11.426219+0000","last_became_active":"2024-04-19T03:01:15.014421+0000","last_became_peered":"2024-04-19T03:01:15.014421+0000","last_unstale":"2024-04-19T03:05:11.426219+0000","last_undegraded":"2024-04-19T03:05:11.426219+0000","last_fullsized":"2024-04-19T03:05:11.426219+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:16:20.475837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":78,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.417679+0000","last_change":"2024-04-19T03:05:09.395629+0000","last_active":"2024-04-19T03:05:11.417679+0000","last_peered":"2024-04-19T03:05:11.417679+0000","last_clean":"2024-04-19T03:05:11.417679+0000","last_became_active":"2024-04-19T03:05:09.395294+0000","last_became_peered":"2024-04-19T03:05:09.395294+0000","last_unstale":"2024-04-19T03:05:11.417679+0000","last_undegraded":"2024-04-19T03:05:11.417679+0000","last_fullsized":"2024-04-19T03:05:11.417679+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:38:03.627366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.770660+0000","last_change":"2024-04-19T03:04:50.617641+0000","last_active":"2024-04-19T03:05:11.770660+0000","last_peered":"2024-04-19T03:05:11.770660+0000","last_clean":"2024-04-19T03:05:11.770660+0000","last_became_active":"2024-04-19T03:04:50.617323+0000","last_became_peered":"2024-04-19T03:04:50.617323+0000","last_unstale":"2024-04-19T03:05:11.770660+0000","last_undegraded":"2024-04-19T03:05:11.770660+0000","last_fullsized":"2024-04-19T03:05:11.770660+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:26:09.566534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"14'157","reported_seq":279,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:12.903628+0000","last_change":"2024-04-19T03:05:11.429096+0000","last_active":"2024-04-19T03:05:12.903628+0000","last_peered":"2024-04-19T03:05:12.903628+0000","last_clean":"2024-04-19T03:05:12.903628+0000","last_became_active":"2024-04-19T03:05:11.426859+0000","last_became_peered":"2024-04-19T03:05:11.426859+0000","last_unstale":"2024-04-19T03:05:12.903628+0000","last_undegraded":"2024-04-19T03:05:12.903628+0000","last_fullsized":"2024-04-19T03:05:12.903628+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:06.516863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:06.516863+0000","last_clean_scrub_stamp":"2024-04-19T03:01:06.516863+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:34:42.107839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":87,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.425366+0000","last_change":"2024-04-19T03:04:50.277227+0000","last_active":"2024-04-19T03:05:11.425366+0000","last_peered":"2024-04-19T03:05:11.425366+0000","last_clean":"2024-04-19T03:05:11.425366+0000","last_became_active":"2024-04-19T03:04:50.276132+0000","last_became_peered":"2024-04-19T03:04:50.276132+0000","last_unstale":"2024-04-19T03:05:11.425366+0000","last_undegraded":"2024-04-19T03:05:11.425366+0000","last_fullsized":"2024-04-19T03:05:11.425366+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_clean_scrub_stamp":"2024-04-19T03:01:09.578660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:36:07.077967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":30,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.769259+0000","last_change":"2024-04-19T03:04:50.629139+0000","last_active":"2024-04-19T03:05:11.769259+0000","last_peered":"2024-04-19T03:05:11.769259+0000","last_clean":"2024-04-19T03:05:11.769259+0000","last_became_active":"2024-04-19T03:04:50.628741+0000","last_became_peered":"2024-04-19T03:04:50.628741+0000","last_unstale":"2024-04-19T03:05:11.769259+0000","last_undegraded":"2024-04-19T03:05:11.769259+0000","last_fullsized":"2024-04-19T03:05:11.769259+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:17:48.413908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":73,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.432341+0000","last_change":"2024-04-19T03:05:11.431455+0000","last_active":"2024-04-19T03:05:11.432341+0000","last_peered":"2024-04-19T03:05:11.432341+0000","last_clean":"2024-04-19T03:05:11.432341+0000","last_became_active":"2024-04-19T03:05:11.430881+0000","last_became_peered":"2024-04-19T03:05:11.430881+0000","last_unstale":"2024-04-19T03:05:11.432341+0000","last_undegraded":"2024-04-19T03:05:11.432341+0000","last_fullsized":"2024-04-19T03:05:11.432341+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:34:50.356698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":75,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.423910+0000","last_change":"2024-04-19T03:01:10.602194+0000","last_active":"2024-04-19T03:05:11.423910+0000","last_peered":"2024-04-19T03:05:11.423910+0000","last_clean":"2024-04-19T03:05:11.423910+0000","last_became_active":"2024-04-19T03:01:10.601381+0000","last_became_peered":"2024-04-19T03:01:10.601381+0000","last_unstale":"2024-04-19T03:05:11.423910+0000","last_undegraded":"2024-04-19T03:05:11.423910+0000","last_fullsized":"2024-04-19T03:05:11.423910+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_clean_scrub_stamp":"2024-04-19T03:01:09.578660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:42:26.594095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":30,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.768286+0000","last_change":"2024-04-19T03:04:50.634401+0000","last_active":"2024-04-19T03:05:11.768286+0000","last_peered":"2024-04-19T03:05:11.768286+0000","last_clean":"2024-04-19T03:05:11.768286+0000","last_became_active":"2024-04-19T03:04:50.631721+0000","last_became_peered":"2024-04-19T03:04:50.631721+0000","last_unstale":"2024-04-19T03:05:11.768286+0000","last_undegraded":"2024-04-19T03:05:11.768286+0000","last_fullsized":"2024-04-19T03:05:11.768286+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:40:03.144776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":77,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.419116+0000","last_change":"2024-04-19T03:05:09.395868+0000","last_active":"2024-04-19T03:05:11.419116+0000","last_peered":"2024-04-19T03:05:11.419116+0000","last_clean":"2024-04-19T03:05:11.419116+0000","last_became_active":"2024-04-19T03:05:09.395167+0000","last_became_peered":"2024-04-19T03:05:09.395167+0000","last_unstale":"2024-04-19T03:05:11.419116+0000","last_undegraded":"2024-04-19T03:05:11.419116+0000","last_fullsized":"2024-04-19T03:05:11.419116+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:40:00.629037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.768794+0000","last_change":"2024-04-19T03:04:50.635352+0000","last_active":"2024-04-19T03:05:11.768794+0000","last_peered":"2024-04-19T03:05:11.768794+0000","last_clean":"2024-04-19T03:05:11.768794+0000","last_became_active":"2024-04-19T03:04:50.633457+0000","last_became_peered":"2024-04-19T03:04:50.633457+0000","last_unstale":"2024-04-19T03:05:11.768794+0000","last_undegraded":"2024-04-19T03:05:11.768794+0000","last_fullsized":"2024-04-19T03:05:11.768794+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_clean_scrub_stamp":"2024-04-19T03:01:09.578660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:17:18.884148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":72,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.417996+0000","last_change":"2024-04-19T03:01:14.649068+0000","last_active":"2024-04-19T03:05:11.417996+0000","last_peered":"2024-04-19T03:05:11.417996+0000","last_clean":"2024-04-19T03:05:11.417996+0000","last_became_active":"2024-04-19T03:01:14.648082+0000","last_became_peered":"2024-04-19T03:01:14.648082+0000","last_unstale":"2024-04-19T03:05:11.417996+0000","last_undegraded":"2024-04-19T03:05:11.417996+0000","last_fullsized":"2024-04-19T03:05:11.417996+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:30:14.489117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.770578+0000","last_change":"2024-04-19T03:04:50.625932+0000","last_active":"2024-04-19T03:05:11.770578+0000","last_peered":"2024-04-19T03:05:11.770578+0000","last_clean":"2024-04-19T03:05:11.770578+0000","last_became_active":"2024-04-19T03:04:50.617628+0000","last_became_peered":"2024-04-19T03:04:50.617628+0000","last_unstale":"2024-04-19T03:05:11.770578+0000","last_undegraded":"2024-04-19T03:05:11.770578+0000","last_fullsized":"2024-04-19T03:05:11.770578+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:52:52.957579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":87,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.425331+0000","last_change":"2024-04-19T03:04:50.278737+0000","last_active":"2024-04-19T03:05:11.425331+0000","last_peered":"2024-04-19T03:05:11.425331+0000","last_clean":"2024-04-19T03:05:11.425331+0000","last_became_active":"2024-04-19T03:04:50.277804+0000","last_became_peered":"2024-04-19T03:04:50.277804+0000","last_unstale":"2024-04-19T03:05:11.425331+0000","last_undegraded":"2024-04-19T03:05:11.425331+0000","last_fullsized":"2024-04-19T03:05:11.425331+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_clean_scrub_stamp":"2024-04-19T03:01:09.578660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:00:20.440389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":85,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.424660+0000","last_change":"2024-04-19T03:04:50.277141+0000","last_active":"2024-04-19T03:05:11.424660+0000","last_peered":"2024-04-19T03:05:11.424660+0000","last_clean":"2024-04-19T03:05:11.424660+0000","last_became_active":"2024-04-19T03:04:50.275812+0000","last_became_peered":"2024-04-19T03:04:50.275812+0000","last_unstale":"2024-04-19T03:05:11.424660+0000","last_undegraded":"2024-04-19T03:05:11.424660+0000","last_fullsized":"2024-04-19T03:05:11.424660+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:16:29.209241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.769258+0000","last_change":"2024-04-19T03:04:50.616475+0000","last_active":"2024-04-19T03:05:11.769258+0000","last_peered":"2024-04-19T03:05:11.769258+0000","last_clean":"2024-04-19T03:05:11.769258+0000","last_became_active":"2024-04-19T03:04:50.614774+0000","last_became_peered":"2024-04-19T03:04:50.614774+0000","last_unstale":"2024-04-19T03:05:11.769258+0000","last_undegraded":"2024-04-19T03:05:11.769258+0000","last_fullsized":"2024-04-19T03:05:11.769258+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:51:07.142010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":71,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.431817+0000","last_change":"2024-04-19T03:05:11.430250+0000","last_active":"2024-04-19T03:05:11.431817+0000","last_peered":"2024-04-19T03:05:11.431817+0000","last_clean":"2024-04-19T03:05:11.431817+0000","last_became_active":"2024-04-19T03:05:11.429941+0000","last_became_peered":"2024-04-19T03:05:11.429941+0000","last_unstale":"2024-04-19T03:05:11.431817+0000","last_undegraded":"2024-04-19T03:05:11.431817+0000","last_fullsized":"2024-04-19T03:05:11.431817+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:28:17.231621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.769485+0000","last_change":"2024-04-19T03:04:50.615925+0000","last_active":"2024-04-19T03:05:11.769485+0000","last_peered":"2024-04-19T03:05:11.769485+0000","last_clean":"2024-04-19T03:05:11.769485+0000","last_became_active":"2024-04-19T03:04:50.614498+0000","last_became_peered":"2024-04-19T03:04:50.614498+0000","last_unstale":"2024-04-19T03:05:11.769485+0000","last_undegraded":"2024-04-19T03:05:11.769485+0000","last_fullsized":"2024-04-19T03:05:11.769485+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_clean_scrub_stamp":"2024-04-19T03:01:09.578660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:41:52.085259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":50,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.418555+0000","last_change":"2024-04-19T03:05:09.395750+0000","last_active":"2024-04-19T03:05:11.418555+0000","last_peered":"2024-04-19T03:05:11.418555+0000","last_clean":"2024-04-19T03:05:11.418555+0000","last_became_active":"2024-04-19T03:05:09.394024+0000","last_became_peered":"2024-04-19T03:05:09.394024+0000","last_unstale":"2024-04-19T03:05:11.418555+0000","last_undegraded":"2024-04-19T03:05:11.418555+0000","last_fullsized":"2024-04-19T03:05:11.418555+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:59:29.215722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":30,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.769894+0000","last_change":"2024-04-19T03:04:50.616970+0000","last_active":"2024-04-19T03:05:11.769894+0000","last_peered":"2024-04-19T03:05:11.769894+0000","last_clean":"2024-04-19T03:05:11.769894+0000","last_became_active":"2024-04-19T03:04:50.615238+0000","last_became_peered":"2024-04-19T03:04:50.615238+0000","last_unstale":"2024-04-19T03:05:11.769894+0000","last_undegraded":"2024-04-19T03:05:11.769894+0000","last_fullsized":"2024-04-19T03:05:11.769894+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:55:14.049921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":81,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.419750+0000","last_change":"2024-04-19T03:05:09.397542+0000","last_active":"2024-04-19T03:05:11.419750+0000","last_peered":"2024-04-19T03:05:11.419750+0000","last_clean":"2024-04-19T03:05:11.419750+0000","last_became_active":"2024-04-19T03:05:09.396378+0000","last_became_peered":"2024-04-19T03:05:09.396378+0000","last_unstale":"2024-04-19T03:05:11.419750+0000","last_undegraded":"2024-04-19T03:05:11.419750+0000","last_fullsized":"2024-04-19T03:05:11.419750+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_clean_scrub_stamp":"2024-04-19T03:01:09.578660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:22:24.885555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":50,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.418216+0000","last_change":"2024-04-19T03:05:09.392910+0000","last_active":"2024-04-19T03:05:11.418216+0000","last_peered":"2024-04-19T03:05:11.418216+0000","last_clean":"2024-04-19T03:05:11.418216+0000","last_became_active":"2024-04-19T03:05:09.392437+0000","last_became_peered":"2024-04-19T03:05:09.392437+0000","last_unstale":"2024-04-19T03:05:11.418216+0000","last_undegraded":"2024-04-19T03:05:11.418216+0000","last_fullsized":"2024-04-19T03:05:11.418216+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:23:28.203282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"20'2","reported_seq":32,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.769920+0000","last_change":"2024-04-19T03:04:50.611678+0000","last_active":"2024-04-19T03:05:11.769920+0000","last_peered":"2024-04-19T03:05:11.769920+0000","last_clean":"2024-04-19T03:05:11.769920+0000","last_became_active":"2024-04-19T03:04:50.611024+0000","last_became_peered":"2024-04-19T03:04:50.611024+0000","last_unstale":"2024-04-19T03:05:11.769920+0000","last_undegraded":"2024-04-19T03:05:11.769920+0000","last_fullsized":"2024-04-19T03:05:11.769920+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:08:43.323149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.769690+0000","last_change":"2024-04-19T03:04:50.616003+0000","last_active":"2024-04-19T03:05:11.769690+0000","last_peered":"2024-04-19T03:05:11.769690+0000","last_clean":"2024-04-19T03:05:11.769690+0000","last_became_active":"2024-04-19T03:04:50.612403+0000","last_became_peered":"2024-04-19T03:04:50.612403+0000","last_unstale":"2024-04-19T03:05:11.769690+0000","last_undegraded":"2024-04-19T03:05:11.769690+0000","last_fullsized":"2024-04-19T03:05:11.769690+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_clean_scrub_stamp":"2024-04-19T03:01:09.578660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:16:44.156874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.768524+0000","last_change":"2024-04-19T03:04:50.615936+0000","last_active":"2024-04-19T03:05:11.768524+0000","last_peered":"2024-04-19T03:05:11.768524+0000","last_clean":"2024-04-19T03:05:11.768524+0000","last_became_active":"2024-04-19T03:04:50.612987+0000","last_became_peered":"2024-04-19T03:04:50.612987+0000","last_unstale":"2024-04-19T03:05:11.768524+0000","last_undegraded":"2024-04-19T03:05:11.768524+0000","last_fullsized":"2024-04-19T03:05:11.768524+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:17:39.989639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"21'1","reported_seq":33,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.769909+0000","last_change":"2024-04-19T03:04:50.616200+0000","last_active":"2024-04-19T03:05:11.769909+0000","last_peered":"2024-04-19T03:05:11.769909+0000","last_clean":"2024-04-19T03:05:11.769909+0000","last_became_active":"2024-04-19T03:04:50.612697+0000","last_became_peered":"2024-04-19T03:04:50.612697+0000","last_unstale":"2024-04-19T03:05:11.769909+0000","last_undegraded":"2024-04-19T03:05:11.769909+0000","last_fullsized":"2024-04-19T03:05:11.769909+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:28:55.970411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":74,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.428574+0000","last_change":"2024-04-19T03:01:10.602274+0000","last_active":"2024-04-19T03:05:11.428574+0000","last_peered":"2024-04-19T03:05:11.428574+0000","last_clean":"2024-04-19T03:05:11.428574+0000","last_became_active":"2024-04-19T03:01:10.601487+0000","last_became_peered":"2024-04-19T03:01:10.601487+0000","last_unstale":"2024-04-19T03:05:11.428574+0000","last_undegraded":"2024-04-19T03:05:11.428574+0000","last_fullsized":"2024-04-19T03:05:11.428574+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_clean_scrub_stamp":"2024-04-19T03:01:09.578660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:26:16.712446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":71,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.417696+0000","last_change":"2024-04-19T03:01:15.018914+0000","last_active":"2024-04-19T03:05:11.417696+0000","last_peered":"2024-04-19T03:05:11.417696+0000","last_clean":"2024-04-19T03:05:11.417696+0000","last_became_active":"2024-04-19T03:01:15.018276+0000","last_became_peered":"2024-04-19T03:01:15.018276+0000","last_unstale":"2024-04-19T03:05:11.417696+0000","last_undegraded":"2024-04-19T03:05:11.417696+0000","last_fullsized":"2024-04-19T03:05:11.417696+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:40:59.453079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":76,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.431580+0000","last_change":"2024-04-19T03:05:11.430020+0000","last_active":"2024-04-19T03:05:11.431580+0000","last_peered":"2024-04-19T03:05:11.431580+0000","last_clean":"2024-04-19T03:05:11.431580+0000","last_became_active":"2024-04-19T03:05:11.429214+0000","last_became_peered":"2024-04-19T03:05:11.429214+0000","last_unstale":"2024-04-19T03:05:11.431580+0000","last_undegraded":"2024-04-19T03:05:11.431580+0000","last_fullsized":"2024-04-19T03:05:11.431580+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:06:34.608828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"20'6","reported_seq":83,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.432314+0000","last_change":"2024-04-19T03:05:11.431454+0000","last_active":"2024-04-19T03:05:11.432314+0000","last_peered":"2024-04-19T03:05:11.432314+0000","last_clean":"2024-04-19T03:05:11.432314+0000","last_became_active":"2024-04-19T03:05:11.430906+0000","last_became_peered":"2024-04-19T03:05:11.430906+0000","last_unstale":"2024-04-19T03:05:11.432314+0000","last_undegraded":"2024-04-19T03:05:11.432314+0000","last_fullsized":"2024-04-19T03:05:11.432314+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:24:28.008875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.768781+0000","last_change":"2024-04-19T03:04:50.628406+0000","last_active":"2024-04-19T03:05:11.768781+0000","last_peered":"2024-04-19T03:05:11.768781+0000","last_clean":"2024-04-19T03:05:11.768781+0000","last_became_active":"2024-04-19T03:04:50.627654+0000","last_became_peered":"2024-04-19T03:04:50.627654+0000","last_unstale":"2024-04-19T03:05:11.768781+0000","last_undegraded":"2024-04-19T03:05:11.768781+0000","last_fullsized":"2024-04-19T03:05:11.768781+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:17:57.101098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"20'3","reported_seq":54,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.419554+0000","last_change":"2024-04-19T03:05:09.398110+0000","last_active":"2024-04-19T03:05:11.419554+0000","last_peered":"2024-04-19T03:05:11.419554+0000","last_clean":"2024-04-19T03:05:11.419554+0000","last_became_active":"2024-04-19T03:05:09.397555+0000","last_became_peered":"2024-04-19T03:05:09.397555+0000","last_unstale":"2024-04-19T03:05:11.419554+0000","last_undegraded":"2024-04-19T03:05:11.419554+0000","last_fullsized":"2024-04-19T03:05:11.419554+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:27:00.017189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":71,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.431390+0000","last_change":"2024-04-19T03:05:11.429290+0000","last_active":"2024-04-19T03:05:11.431390+0000","last_peered":"2024-04-19T03:05:11.431390+0000","last_clean":"2024-04-19T03:05:11.431390+0000","last_became_active":"2024-04-19T03:05:11.428904+0000","last_became_peered":"2024-04-19T03:05:11.428904+0000","last_unstale":"2024-04-19T03:05:11.431390+0000","last_undegraded":"2024-04-19T03:05:11.431390+0000","last_fullsized":"2024-04-19T03:05:11.431390+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:16:47.688907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.768791+0000","last_change":"2024-04-19T03:04:50.634026+0000","last_active":"2024-04-19T03:05:11.768791+0000","last_peered":"2024-04-19T03:05:11.768791+0000","last_clean":"2024-04-19T03:05:11.768791+0000","last_became_active":"2024-04-19T03:04:50.630873+0000","last_became_peered":"2024-04-19T03:04:50.630873+0000","last_unstale":"2024-04-19T03:05:11.768791+0000","last_undegraded":"2024-04-19T03:05:11.768791+0000","last_fullsized":"2024-04-19T03:05:11.768791+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:41:25.674376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":30,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.770364+0000","last_change":"2024-04-19T03:04:50.612483+0000","last_active":"2024-04-19T03:05:11.770364+0000","last_peered":"2024-04-19T03:05:11.770364+0000","last_clean":"2024-04-19T03:05:11.770364+0000","last_became_active":"2024-04-19T03:04:50.612005+0000","last_became_peered":"2024-04-19T03:04:50.612005+0000","last_unstale":"2024-04-19T03:05:11.770364+0000","last_undegraded":"2024-04-19T03:05:11.770364+0000","last_fullsized":"2024-04-19T03:05:11.770364+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:56:45.629955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.768295+0000","last_change":"2024-04-19T03:04:50.616158+0000","last_active":"2024-04-19T03:05:11.768295+0000","last_peered":"2024-04-19T03:05:11.768295+0000","last_clean":"2024-04-19T03:05:11.768295+0000","last_became_active":"2024-04-19T03:04:50.613735+0000","last_became_peered":"2024-04-19T03:04:50.613735+0000","last_unstale":"2024-04-19T03:05:11.768295+0000","last_undegraded":"2024-04-19T03:05:11.768295+0000","last_fullsized":"2024-04-19T03:05:11.768295+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:25:58.128503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":50,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.419690+0000","last_change":"2024-04-19T03:05:09.394054+0000","last_active":"2024-04-19T03:05:11.419690+0000","last_peered":"2024-04-19T03:05:11.419690+0000","last_clean":"2024-04-19T03:05:11.419690+0000","last_became_active":"2024-04-19T03:05:09.392982+0000","last_became_peered":"2024-04-19T03:05:09.392982+0000","last_unstale":"2024-04-19T03:05:11.419690+0000","last_undegraded":"2024-04-19T03:05:11.419690+0000","last_fullsized":"2024-04-19T03:05:11.419690+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:09:41.580252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":30,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.768114+0000","last_change":"2024-04-19T03:04:50.616430+0000","last_active":"2024-04-19T03:05:11.768114+0000","last_peered":"2024-04-19T03:05:11.768114+0000","last_clean":"2024-04-19T03:05:11.768114+0000","last_became_active":"2024-04-19T03:04:50.613523+0000","last_became_peered":"2024-04-19T03:04:50.613523+0000","last_unstale":"2024-04-19T03:05:11.768114+0000","last_undegraded":"2024-04-19T03:05:11.768114+0000","last_fullsized":"2024-04-19T03:05:11.768114+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:22:43.207543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.770394+0000","last_change":"2024-04-19T03:04:50.616829+0000","last_active":"2024-04-19T03:05:11.770394+0000","last_peered":"2024-04-19T03:05:11.770394+0000","last_clean":"2024-04-19T03:05:11.770394+0000","last_became_active":"2024-04-19T03:04:50.616545+0000","last_became_peered":"2024-04-19T03:04:50.616545+0000","last_unstale":"2024-04-19T03:05:11.770394+0000","last_undegraded":"2024-04-19T03:05:11.770394+0000","last_fullsized":"2024-04-19T03:05:11.770394+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:07:32.515729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":30,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.768318+0000","last_change":"2024-04-19T03:04:50.634214+0000","last_active":"2024-04-19T03:05:11.768318+0000","last_peered":"2024-04-19T03:05:11.768318+0000","last_clean":"2024-04-19T03:05:11.768318+0000","last_became_active":"2024-04-19T03:04:50.631699+0000","last_became_peered":"2024-04-19T03:04:50.631699+0000","last_unstale":"2024-04-19T03:05:11.768318+0000","last_undegraded":"2024-04-19T03:05:11.768318+0000","last_fullsized":"2024-04-19T03:05:11.768318+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:43:10.184280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":53,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.418846+0000","last_change":"2024-04-19T03:05:02.361377+0000","last_active":"2024-04-19T03:05:11.418846+0000","last_peered":"2024-04-19T03:05:11.418846+0000","last_clean":"2024-04-19T03:05:11.418846+0000","last_became_active":"2024-04-19T03:05:02.360924+0000","last_became_peered":"2024-04-19T03:05:02.360924+0000","last_unstale":"2024-04-19T03:05:11.418846+0000","last_undegraded":"2024-04-19T03:05:11.418846+0000","last_fullsized":"2024-04-19T03:05:11.418846+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:39:56.940892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"20'1","reported_seq":79,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.418313+0000","last_change":"2024-04-19T03:05:09.395934+0000","last_active":"2024-04-19T03:05:11.418313+0000","last_peered":"2024-04-19T03:05:11.418313+0000","last_clean":"2024-04-19T03:05:11.418313+0000","last_became_active":"2024-04-19T03:05:09.395508+0000","last_became_peered":"2024-04-19T03:05:09.395508+0000","last_unstale":"2024-04-19T03:05:11.418313+0000","last_undegraded":"2024-04-19T03:05:11.418313+0000","last_fullsized":"2024-04-19T03:05:11.418313+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:50:26.858754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":77,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.418889+0000","last_change":"2024-04-19T03:05:09.396327+0000","last_active":"2024-04-19T03:05:11.418889+0000","last_peered":"2024-04-19T03:05:11.418889+0000","last_clean":"2024-04-19T03:05:11.418889+0000","last_became_active":"2024-04-19T03:05:09.395753+0000","last_became_peered":"2024-04-19T03:05:09.395753+0000","last_unstale":"2024-04-19T03:05:11.418889+0000","last_undegraded":"2024-04-19T03:05:11.418889+0000","last_fullsized":"2024-04-19T03:05:11.418889+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:00:12.449987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"20'1","reported_seq":87,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.418640+0000","last_change":"2024-04-19T03:05:09.398142+0000","last_active":"2024-04-19T03:05:11.418640+0000","last_peered":"2024-04-19T03:05:11.418640+0000","last_clean":"2024-04-19T03:05:11.418640+0000","last_became_active":"2024-04-19T03:05:09.397183+0000","last_became_peered":"2024-04-19T03:05:09.397183+0000","last_unstale":"2024-04-19T03:05:11.418640+0000","last_undegraded":"2024-04-19T03:05:11.418640+0000","last_fullsized":"2024-04-19T03:05:11.418640+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:45:32.978138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":86,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.431626+0000","last_change":"2024-04-19T03:05:11.430243+0000","last_active":"2024-04-19T03:05:11.431626+0000","last_peered":"2024-04-19T03:05:11.431626+0000","last_clean":"2024-04-19T03:05:11.431626+0000","last_became_active":"2024-04-19T03:05:11.429247+0000","last_became_peered":"2024-04-19T03:05:11.429247+0000","last_unstale":"2024-04-19T03:05:11.431626+0000","last_undegraded":"2024-04-19T03:05:11.431626+0000","last_fullsized":"2024-04-19T03:05:11.431626+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:41:16.915398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"20'2","reported_seq":87,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.426718+0000","last_change":"2024-04-19T03:04:50.276105+0000","last_active":"2024-04-19T03:05:11.426718+0000","last_peered":"2024-04-19T03:05:11.426718+0000","last_clean":"2024-04-19T03:05:11.426718+0000","last_became_active":"2024-04-19T03:04:50.275533+0000","last_became_peered":"2024-04-19T03:04:50.275533+0000","last_unstale":"2024-04-19T03:05:11.426718+0000","last_undegraded":"2024-04-19T03:05:11.426718+0000","last_fullsized":"2024-04-19T03:05:11.426718+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:38:13.683481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":84,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.424718+0000","last_change":"2024-04-19T03:04:50.278401+0000","last_active":"2024-04-19T03:05:11.424718+0000","last_peered":"2024-04-19T03:05:11.424718+0000","last_clean":"2024-04-19T03:05:11.424718+0000","last_became_active":"2024-04-19T03:04:50.277348+0000","last_became_peered":"2024-04-19T03:04:50.277348+0000","last_unstale":"2024-04-19T03:05:11.424718+0000","last_undegraded":"2024-04-19T03:05:11.424718+0000","last_fullsized":"2024-04-19T03:05:11.424718+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:19:35.891753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"20'2","reported_seq":56,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.419282+0000","last_change":"2024-04-19T03:05:02.363600+0000","last_active":"2024-04-19T03:05:11.419282+0000","last_peered":"2024-04-19T03:05:11.419282+0000","last_clean":"2024-04-19T03:05:11.419282+0000","last_became_active":"2024-04-19T03:05:02.363167+0000","last_became_peered":"2024-04-19T03:05:02.363167+0000","last_unstale":"2024-04-19T03:05:11.419282+0000","last_undegraded":"2024-04-19T03:05:11.419282+0000","last_fullsized":"2024-04-19T03:05:11.419282+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:49:54.288998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":77,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.418217+0000","last_change":"2024-04-19T03:05:09.394500+0000","last_active":"2024-04-19T03:05:11.418217+0000","last_peered":"2024-04-19T03:05:11.418217+0000","last_clean":"2024-04-19T03:05:11.418217+0000","last_became_active":"2024-04-19T03:05:09.393975+0000","last_became_peered":"2024-04-19T03:05:09.393975+0000","last_unstale":"2024-04-19T03:05:11.418217+0000","last_undegraded":"2024-04-19T03:05:11.418217+0000","last_fullsized":"2024-04-19T03:05:11.418217+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:00:55.706542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"20'1","reported_seq":32,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.770844+0000","last_change":"2024-04-19T03:04:50.627670+0000","last_active":"2024-04-19T03:05:11.770844+0000","last_peered":"2024-04-19T03:05:11.770844+0000","last_clean":"2024-04-19T03:05:11.770844+0000","last_became_active":"2024-04-19T03:04:50.627304+0000","last_became_peered":"2024-04-19T03:04:50.627304+0000","last_unstale":"2024-04-19T03:05:11.770844+0000","last_undegraded":"2024-04-19T03:05:11.770844+0000","last_fullsized":"2024-04-19T03:05:11.770844+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:29:08.875911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":84,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.423682+0000","last_change":"2024-04-19T03:04:50.279334+0000","last_active":"2024-04-19T03:05:11.423682+0000","last_peered":"2024-04-19T03:05:11.423682+0000","last_clean":"2024-04-19T03:05:11.423682+0000","last_became_active":"2024-04-19T03:04:50.278874+0000","last_became_peered":"2024-04-19T03:04:50.278874+0000","last_unstale":"2024-04-19T03:05:11.423682+0000","last_undegraded":"2024-04-19T03:05:11.423682+0000","last_fullsized":"2024-04-19T03:05:11.423682+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:51:33.707741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"20'4","reported_seq":32,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.770772+0000","last_change":"2024-04-19T03:04:50.627070+0000","last_active":"2024-04-19T03:05:11.770772+0000","last_peered":"2024-04-19T03:05:11.770772+0000","last_clean":"2024-04-19T03:05:11.770772+0000","last_became_active":"2024-04-19T03:04:50.626334+0000","last_became_peered":"2024-04-19T03:04:50.626334+0000","last_unstale":"2024-04-19T03:05:11.770772+0000","last_undegraded":"2024-04-19T03:05:11.770772+0000","last_fullsized":"2024-04-19T03:05:11.770772+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:24:58.586175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5289,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":14482,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":10,"seq":42949673016,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":220712,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":219774,"kb_avail":94151128,"statfs":{"total":96636764160,"available":96410755072,"internally_reserved":0,"allocated":946176,"data_stored":929795,"data_compressed":7241,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":225049030},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 19 03:02:08 2024","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"last":0.53400000000000003}]},{"osd":1,"last update":"Fri Apr 19 03:04:11 2024","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.19900000000000001,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.87,"5min":2.5030000000000001,"15min":2.5030000000000001},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.57099999999999995,"15min":0.56299999999999994},"min":{"1min":0.23999999999999999,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.90400000000000003,"5min":2.6379999999999999,"15min":2.6379999999999999},"last":0.65000000000000002}]}]},{"osd":1,"up_from":10,"seq":42949673015,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":202656,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":201726,"kb_avail":94169184,"statfs":{"total":96636764160,"available":96429244416,"internally_reserved":0,"allocated":933888,"data_stored":927081,"data_compressed":7241,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":206567878},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 19 03:02:04 2024","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.58699999999999997}]},{"osd":2,"last update":"Fri Apr 19 03:05:08 2024","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.501,"15min":0.50800000000000001},"min":{"1min":0.46999999999999997,"5min":0.224,"15min":0.224},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.50700000000000001,"15min":0.52100000000000002},"min":{"1min":0.52100000000000002,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.94899999999999995}]}]},{"osd":0,"up_from":71,"seq":304942678023,"num_pgs":73,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47712,"kb_used_data":848,"kb_used_omap":6,"kb_used_meta":46841,"kb_avail":94324128,"statfs":{"total":96636764160,"available":96587907072,"internally_reserved":0,"allocated":868352,"data_stored":339844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6883,"internal_metadata":47965469},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61799999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69199999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":7241,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":7241,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5289,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-19T03:05:15.622 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-04-19T03:05:15.623 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr_debug_aggressive_pg_num_changes 2024-04-19T03:05:15.960 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-04-19T03:05:15.970 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-19T03:05:15.970 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-19T03:05:16.280 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-19T03:05:16.283 INFO:teuthology.orchestra.run.smithi096.stderr:dumped all 2024-04-19T03:05:16.295 INFO:teuthology.orchestra.run.smithi096.stdout:{"pg_ready":true,"pg_map":{"version":203,"stamp":"2024-04-19T03:05:16.051011+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":471092,"kb_used_data":2692,"kb_used_omap":9,"kb_used_meta":468342,"kb_avail":282644428,"statfs":{"total":289910292480,"available":289427894272,"internally_reserved":0,"allocated":2756608,"data_stored":2200981,"data_compressed":14482,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":10071,"internal_metadata":479582377},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.002175"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":77,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.419575+0000","last_change":"2024-04-19T03:05:09.396661+0000","last_active":"2024-04-19T03:05:11.419575+0000","last_peered":"2024-04-19T03:05:11.419575+0000","last_clean":"2024-04-19T03:05:11.419575+0000","last_became_active":"2024-04-19T03:05:09.396279+0000","last_became_peered":"2024-04-19T03:05:09.396279+0000","last_unstale":"2024-04-19T03:05:11.419575+0000","last_undegraded":"2024-04-19T03:05:11.419575+0000","last_fullsized":"2024-04-19T03:05:11.419575+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:20:04.982562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":84,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.418854+0000","last_change":"2024-04-19T03:04:50.278334+0000","last_active":"2024-04-19T03:05:11.418854+0000","last_peered":"2024-04-19T03:05:11.418854+0000","last_clean":"2024-04-19T03:05:11.418854+0000","last_became_active":"2024-04-19T03:04:50.277848+0000","last_became_peered":"2024-04-19T03:04:50.277848+0000","last_unstale":"2024-04-19T03:05:11.418854+0000","last_undegraded":"2024-04-19T03:05:11.418854+0000","last_fullsized":"2024-04-19T03:05:11.418854+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:57:39.589383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":71,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.425858+0000","last_change":"2024-04-19T03:01:15.015884+0000","last_active":"2024-04-19T03:05:11.425858+0000","last_peered":"2024-04-19T03:05:11.425858+0000","last_clean":"2024-04-19T03:05:11.425858+0000","last_became_active":"2024-04-19T03:01:15.014599+0000","last_became_peered":"2024-04-19T03:01:15.014599+0000","last_unstale":"2024-04-19T03:05:11.425858+0000","last_undegraded":"2024-04-19T03:05:11.425858+0000","last_fullsized":"2024-04-19T03:05:11.425858+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:35:19.436344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":85,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:12.904164+0000","last_change":"2024-04-19T03:04:50.275017+0000","last_active":"2024-04-19T03:05:12.904164+0000","last_peered":"2024-04-19T03:05:12.904164+0000","last_clean":"2024-04-19T03:05:12.904164+0000","last_became_active":"2024-04-19T03:04:50.274600+0000","last_became_peered":"2024-04-19T03:04:50.274600+0000","last_unstale":"2024-04-19T03:05:12.904164+0000","last_undegraded":"2024-04-19T03:05:12.904164+0000","last_fullsized":"2024-04-19T03:05:12.904164+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:21:44.006351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":77,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.418426+0000","last_change":"2024-04-19T03:05:09.397682+0000","last_active":"2024-04-19T03:05:11.418426+0000","last_peered":"2024-04-19T03:05:11.418426+0000","last_clean":"2024-04-19T03:05:11.418426+0000","last_became_active":"2024-04-19T03:05:09.395929+0000","last_became_peered":"2024-04-19T03:05:09.395929+0000","last_unstale":"2024-04-19T03:05:11.418426+0000","last_undegraded":"2024-04-19T03:05:11.418426+0000","last_fullsized":"2024-04-19T03:05:11.418426+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:57:03.617383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":70,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.430738+0000","last_change":"2024-04-19T03:05:11.428461+0000","last_active":"2024-04-19T03:05:11.430738+0000","last_peered":"2024-04-19T03:05:11.430738+0000","last_clean":"2024-04-19T03:05:11.430738+0000","last_became_active":"2024-04-19T03:05:11.426617+0000","last_became_peered":"2024-04-19T03:05:11.426617+0000","last_unstale":"2024-04-19T03:05:11.430738+0000","last_undegraded":"2024-04-19T03:05:11.430738+0000","last_fullsized":"2024-04-19T03:05:11.430738+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:18:53.462220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":70,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.429888+0000","last_change":"2024-04-19T03:05:11.424581+0000","last_active":"2024-04-19T03:05:11.429888+0000","last_peered":"2024-04-19T03:05:11.429888+0000","last_clean":"2024-04-19T03:05:11.429888+0000","last_became_active":"2024-04-19T03:05:11.422727+0000","last_became_peered":"2024-04-19T03:05:11.422727+0000","last_unstale":"2024-04-19T03:05:11.429888+0000","last_undegraded":"2024-04-19T03:05:11.429888+0000","last_fullsized":"2024-04-19T03:05:11.429888+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:48:53.502161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":84,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.422960+0000","last_change":"2024-04-19T03:04:50.261359+0000","last_active":"2024-04-19T03:05:11.422960+0000","last_peered":"2024-04-19T03:05:11.422960+0000","last_clean":"2024-04-19T03:05:11.422960+0000","last_became_active":"2024-04-19T03:04:50.261155+0000","last_became_peered":"2024-04-19T03:04:50.261155+0000","last_unstale":"2024-04-19T03:05:11.422960+0000","last_undegraded":"2024-04-19T03:05:11.422960+0000","last_fullsized":"2024-04-19T03:05:11.422960+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:09:37.911709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.770311+0000","last_change":"2024-04-19T03:04:50.611854+0000","last_active":"2024-04-19T03:05:11.770311+0000","last_peered":"2024-04-19T03:05:11.770311+0000","last_clean":"2024-04-19T03:05:11.770311+0000","last_became_active":"2024-04-19T03:04:50.611400+0000","last_became_peered":"2024-04-19T03:04:50.611400+0000","last_unstale":"2024-04-19T03:05:11.770311+0000","last_undegraded":"2024-04-19T03:05:11.770311+0000","last_fullsized":"2024-04-19T03:05:11.770311+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:33:58.731162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":84,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.418911+0000","last_change":"2024-04-19T03:04:50.278337+0000","last_active":"2024-04-19T03:05:11.418911+0000","last_peered":"2024-04-19T03:05:11.418911+0000","last_clean":"2024-04-19T03:05:11.418911+0000","last_became_active":"2024-04-19T03:04:50.277899+0000","last_became_peered":"2024-04-19T03:04:50.277899+0000","last_unstale":"2024-04-19T03:05:11.418911+0000","last_undegraded":"2024-04-19T03:05:11.418911+0000","last_fullsized":"2024-04-19T03:05:11.418911+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:32:49.546687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":70,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.431939+0000","last_change":"2024-04-19T03:05:11.430574+0000","last_active":"2024-04-19T03:05:11.431939+0000","last_peered":"2024-04-19T03:05:11.431939+0000","last_clean":"2024-04-19T03:05:11.431939+0000","last_became_active":"2024-04-19T03:05:11.430243+0000","last_became_peered":"2024-04-19T03:05:11.430243+0000","last_unstale":"2024-04-19T03:05:11.431939+0000","last_undegraded":"2024-04-19T03:05:11.431939+0000","last_fullsized":"2024-04-19T03:05:11.431939+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:37:37.372803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":50,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.418696+0000","last_change":"2024-04-19T03:05:09.394405+0000","last_active":"2024-04-19T03:05:11.418696+0000","last_peered":"2024-04-19T03:05:11.418696+0000","last_clean":"2024-04-19T03:05:11.418696+0000","last_became_active":"2024-04-19T03:05:09.392822+0000","last_became_peered":"2024-04-19T03:05:09.392822+0000","last_unstale":"2024-04-19T03:05:11.418696+0000","last_undegraded":"2024-04-19T03:05:11.418696+0000","last_fullsized":"2024-04-19T03:05:11.418696+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:33:27.982343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":77,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.417984+0000","last_change":"2024-04-19T03:05:09.397000+0000","last_active":"2024-04-19T03:05:11.417984+0000","last_peered":"2024-04-19T03:05:11.417984+0000","last_clean":"2024-04-19T03:05:11.417984+0000","last_became_active":"2024-04-19T03:05:09.395749+0000","last_became_peered":"2024-04-19T03:05:09.395749+0000","last_unstale":"2024-04-19T03:05:11.417984+0000","last_undegraded":"2024-04-19T03:05:11.417984+0000","last_fullsized":"2024-04-19T03:05:11.417984+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:21:26.436890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":71,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.423871+0000","last_change":"2024-04-19T03:01:15.010960+0000","last_active":"2024-04-19T03:05:11.423871+0000","last_peered":"2024-04-19T03:05:11.423871+0000","last_clean":"2024-04-19T03:05:11.423871+0000","last_became_active":"2024-04-19T03:01:15.010472+0000","last_became_peered":"2024-04-19T03:01:15.010472+0000","last_unstale":"2024-04-19T03:05:11.423871+0000","last_undegraded":"2024-04-19T03:05:11.423871+0000","last_fullsized":"2024-04-19T03:05:11.423871+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:21:36.129346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":73,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.430581+0000","last_change":"2024-04-19T03:05:11.428285+0000","last_active":"2024-04-19T03:05:11.430581+0000","last_peered":"2024-04-19T03:05:11.430581+0000","last_clean":"2024-04-19T03:05:11.430581+0000","last_became_active":"2024-04-19T03:05:11.425921+0000","last_became_peered":"2024-04-19T03:05:11.425921+0000","last_unstale":"2024-04-19T03:05:11.430581+0000","last_undegraded":"2024-04-19T03:05:11.430581+0000","last_fullsized":"2024-04-19T03:05:11.430581+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:38:49.965677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":70,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.430778+0000","last_change":"2024-04-19T03:05:11.429030+0000","last_active":"2024-04-19T03:05:11.430778+0000","last_peered":"2024-04-19T03:05:11.430778+0000","last_clean":"2024-04-19T03:05:11.430778+0000","last_became_active":"2024-04-19T03:05:11.425921+0000","last_became_peered":"2024-04-19T03:05:11.425921+0000","last_unstale":"2024-04-19T03:05:11.430778+0000","last_undegraded":"2024-04-19T03:05:11.430778+0000","last_fullsized":"2024-04-19T03:05:11.430778+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:53:07.351904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.770126+0000","last_change":"2024-04-19T03:04:50.611757+0000","last_active":"2024-04-19T03:05:11.770126+0000","last_peered":"2024-04-19T03:05:11.770126+0000","last_clean":"2024-04-19T03:05:11.770126+0000","last_became_active":"2024-04-19T03:04:50.611392+0000","last_became_peered":"2024-04-19T03:04:50.611392+0000","last_unstale":"2024-04-19T03:05:11.770126+0000","last_undegraded":"2024-04-19T03:05:11.770126+0000","last_fullsized":"2024-04-19T03:05:11.770126+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:51:50.768612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":77,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.419368+0000","last_change":"2024-04-19T03:05:09.397114+0000","last_active":"2024-04-19T03:05:11.419368+0000","last_peered":"2024-04-19T03:05:11.419368+0000","last_clean":"2024-04-19T03:05:11.419368+0000","last_became_active":"2024-04-19T03:05:09.395682+0000","last_became_peered":"2024-04-19T03:05:09.395682+0000","last_unstale":"2024-04-19T03:05:11.419368+0000","last_undegraded":"2024-04-19T03:05:11.419368+0000","last_fullsized":"2024-04-19T03:05:11.419368+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:55:53.897442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.769589+0000","last_change":"2024-04-19T03:04:50.613858+0000","last_active":"2024-04-19T03:05:11.769589+0000","last_peered":"2024-04-19T03:05:11.769589+0000","last_clean":"2024-04-19T03:05:11.769589+0000","last_became_active":"2024-04-19T03:04:50.613481+0000","last_became_peered":"2024-04-19T03:04:50.613481+0000","last_unstale":"2024-04-19T03:05:11.769589+0000","last_undegraded":"2024-04-19T03:05:11.769589+0000","last_fullsized":"2024-04-19T03:05:11.769589+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:55:45.686937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":86,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.432386+0000","last_change":"2024-04-19T03:05:11.431719+0000","last_active":"2024-04-19T03:05:11.432386+0000","last_peered":"2024-04-19T03:05:11.432386+0000","last_clean":"2024-04-19T03:05:11.432386+0000","last_became_active":"2024-04-19T03:05:11.431352+0000","last_became_peered":"2024-04-19T03:05:11.431352+0000","last_unstale":"2024-04-19T03:05:11.432386+0000","last_undegraded":"2024-04-19T03:05:11.432386+0000","last_fullsized":"2024-04-19T03:05:11.432386+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:54:50.052460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":84,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.424051+0000","last_change":"2024-04-19T03:04:50.276678+0000","last_active":"2024-04-19T03:05:11.424051+0000","last_peered":"2024-04-19T03:05:11.424051+0000","last_clean":"2024-04-19T03:05:11.424051+0000","last_became_active":"2024-04-19T03:04:50.275510+0000","last_became_peered":"2024-04-19T03:04:50.275510+0000","last_unstale":"2024-04-19T03:05:11.424051+0000","last_undegraded":"2024-04-19T03:05:11.424051+0000","last_fullsized":"2024-04-19T03:05:11.424051+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:17:24.832346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":71,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.417759+0000","last_change":"2024-04-19T03:01:15.020108+0000","last_active":"2024-04-19T03:05:11.417759+0000","last_peered":"2024-04-19T03:05:11.417759+0000","last_clean":"2024-04-19T03:05:11.417759+0000","last_became_active":"2024-04-19T03:01:15.018978+0000","last_became_peered":"2024-04-19T03:01:15.018978+0000","last_unstale":"2024-04-19T03:05:11.417759+0000","last_undegraded":"2024-04-19T03:05:11.417759+0000","last_fullsized":"2024-04-19T03:05:11.417759+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:30:22.360053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.768605+0000","last_change":"2024-04-19T03:04:50.633855+0000","last_active":"2024-04-19T03:05:11.768605+0000","last_peered":"2024-04-19T03:05:11.768605+0000","last_clean":"2024-04-19T03:05:11.768605+0000","last_became_active":"2024-04-19T03:04:50.630948+0000","last_became_peered":"2024-04-19T03:04:50.630948+0000","last_unstale":"2024-04-19T03:05:11.768605+0000","last_undegraded":"2024-04-19T03:05:11.768605+0000","last_fullsized":"2024-04-19T03:05:11.768605+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:41:31.676439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":77,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.417346+0000","last_change":"2024-04-19T03:05:09.391159+0000","last_active":"2024-04-19T03:05:11.417346+0000","last_peered":"2024-04-19T03:05:11.417346+0000","last_clean":"2024-04-19T03:05:11.417346+0000","last_became_active":"2024-04-19T03:05:09.390922+0000","last_became_peered":"2024-04-19T03:05:09.390922+0000","last_unstale":"2024-04-19T03:05:11.417346+0000","last_undegraded":"2024-04-19T03:05:11.417346+0000","last_fullsized":"2024-04-19T03:05:11.417346+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:32:01.116711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":50,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.419689+0000","last_change":"2024-04-19T03:05:09.393923+0000","last_active":"2024-04-19T03:05:11.419689+0000","last_peered":"2024-04-19T03:05:11.419689+0000","last_clean":"2024-04-19T03:05:11.419689+0000","last_became_active":"2024-04-19T03:05:09.393108+0000","last_became_peered":"2024-04-19T03:05:09.393108+0000","last_unstale":"2024-04-19T03:05:11.419689+0000","last_undegraded":"2024-04-19T03:05:11.419689+0000","last_fullsized":"2024-04-19T03:05:11.419689+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:29:37.674820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.770633+0000","last_change":"2024-04-19T03:04:50.626923+0000","last_active":"2024-04-19T03:05:11.770633+0000","last_peered":"2024-04-19T03:05:11.770633+0000","last_clean":"2024-04-19T03:05:11.770633+0000","last_became_active":"2024-04-19T03:04:50.617603+0000","last_became_peered":"2024-04-19T03:04:50.617603+0000","last_unstale":"2024-04-19T03:05:11.770633+0000","last_undegraded":"2024-04-19T03:05:11.770633+0000","last_fullsized":"2024-04-19T03:05:11.770633+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:26:56.826024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:12.905140+0000","last_change":"2024-04-19T03:05:11.431713+0000","last_active":"2024-04-19T03:05:12.905140+0000","last_peered":"2024-04-19T03:05:12.905140+0000","last_clean":"2024-04-19T03:05:12.905140+0000","last_became_active":"2024-04-19T03:05:11.431129+0000","last_became_peered":"2024-04-19T03:05:11.431129+0000","last_unstale":"2024-04-19T03:05:12.905140+0000","last_undegraded":"2024-04-19T03:05:12.905140+0000","last_fullsized":"2024-04-19T03:05:12.905140+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:00:07.623146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":71,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.419121+0000","last_change":"2024-04-19T03:01:15.020098+0000","last_active":"2024-04-19T03:05:11.419121+0000","last_peered":"2024-04-19T03:05:11.419121+0000","last_clean":"2024-04-19T03:05:11.419121+0000","last_became_active":"2024-04-19T03:01:15.019064+0000","last_became_peered":"2024-04-19T03:01:15.019064+0000","last_unstale":"2024-04-19T03:05:11.419121+0000","last_undegraded":"2024-04-19T03:05:11.419121+0000","last_fullsized":"2024-04-19T03:05:11.419121+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:50:06.490191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.769012+0000","last_change":"2024-04-19T03:04:50.616823+0000","last_active":"2024-04-19T03:05:11.769012+0000","last_peered":"2024-04-19T03:05:11.769012+0000","last_clean":"2024-04-19T03:05:11.769012+0000","last_became_active":"2024-04-19T03:04:50.616550+0000","last_became_peered":"2024-04-19T03:04:50.616550+0000","last_unstale":"2024-04-19T03:05:11.769012+0000","last_undegraded":"2024-04-19T03:05:11.769012+0000","last_fullsized":"2024-04-19T03:05:11.769012+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:46:25.096677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":50,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.418068+0000","last_change":"2024-04-19T03:05:09.394074+0000","last_active":"2024-04-19T03:05:11.418068+0000","last_peered":"2024-04-19T03:05:11.418068+0000","last_clean":"2024-04-19T03:05:11.418068+0000","last_became_active":"2024-04-19T03:05:09.393178+0000","last_became_peered":"2024-04-19T03:05:09.393178+0000","last_unstale":"2024-04-19T03:05:11.418068+0000","last_undegraded":"2024-04-19T03:05:11.418068+0000","last_fullsized":"2024-04-19T03:05:11.418068+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:53:27.695302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.769044+0000","last_change":"2024-04-19T03:04:50.635141+0000","last_active":"2024-04-19T03:05:11.769044+0000","last_peered":"2024-04-19T03:05:11.769044+0000","last_clean":"2024-04-19T03:05:11.769044+0000","last_became_active":"2024-04-19T03:04:50.633033+0000","last_became_peered":"2024-04-19T03:04:50.633033+0000","last_unstale":"2024-04-19T03:05:11.769044+0000","last_undegraded":"2024-04-19T03:05:11.769044+0000","last_fullsized":"2024-04-19T03:05:11.769044+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:42:01.712749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":84,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.423252+0000","last_change":"2024-04-19T03:04:50.279507+0000","last_active":"2024-04-19T03:05:11.423252+0000","last_peered":"2024-04-19T03:05:11.423252+0000","last_clean":"2024-04-19T03:05:11.423252+0000","last_became_active":"2024-04-19T03:04:50.278996+0000","last_became_peered":"2024-04-19T03:04:50.278996+0000","last_unstale":"2024-04-19T03:05:11.423252+0000","last_undegraded":"2024-04-19T03:05:11.423252+0000","last_fullsized":"2024-04-19T03:05:11.423252+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:09:09.816660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":77,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.419122+0000","last_change":"2024-04-19T03:05:09.396527+0000","last_active":"2024-04-19T03:05:11.419122+0000","last_peered":"2024-04-19T03:05:11.419122+0000","last_clean":"2024-04-19T03:05:11.419122+0000","last_became_active":"2024-04-19T03:05:09.395920+0000","last_became_peered":"2024-04-19T03:05:09.395920+0000","last_unstale":"2024-04-19T03:05:11.419122+0000","last_undegraded":"2024-04-19T03:05:11.419122+0000","last_fullsized":"2024-04-19T03:05:11.419122+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:23:05.984746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"20'2","reported_seq":87,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.424713+0000","last_change":"2024-04-19T03:04:50.277421+0000","last_active":"2024-04-19T03:05:11.424713+0000","last_peered":"2024-04-19T03:05:11.424713+0000","last_clean":"2024-04-19T03:05:11.424713+0000","last_became_active":"2024-04-19T03:04:50.276732+0000","last_became_peered":"2024-04-19T03:04:50.276732+0000","last_unstale":"2024-04-19T03:05:11.424713+0000","last_undegraded":"2024-04-19T03:05:11.424713+0000","last_fullsized":"2024-04-19T03:05:11.424713+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:23:27.191496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":77,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.419051+0000","last_change":"2024-04-19T03:05:09.395454+0000","last_active":"2024-04-19T03:05:11.419051+0000","last_peered":"2024-04-19T03:05:11.419051+0000","last_clean":"2024-04-19T03:05:11.419051+0000","last_became_active":"2024-04-19T03:05:09.394288+0000","last_became_peered":"2024-04-19T03:05:09.394288+0000","last_unstale":"2024-04-19T03:05:11.419051+0000","last_undegraded":"2024-04-19T03:05:11.419051+0000","last_fullsized":"2024-04-19T03:05:11.419051+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:32:14.358374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":30,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.768860+0000","last_change":"2024-04-19T03:04:50.628801+0000","last_active":"2024-04-19T03:05:11.768860+0000","last_peered":"2024-04-19T03:05:11.768860+0000","last_clean":"2024-04-19T03:05:11.768860+0000","last_became_active":"2024-04-19T03:04:50.628023+0000","last_became_peered":"2024-04-19T03:04:50.628023+0000","last_unstale":"2024-04-19T03:05:11.768860+0000","last_undegraded":"2024-04-19T03:05:11.768860+0000","last_fullsized":"2024-04-19T03:05:11.768860+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:52:41.731698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.770121+0000","last_change":"2024-04-19T03:04:50.616471+0000","last_active":"2024-04-19T03:05:11.770121+0000","last_peered":"2024-04-19T03:05:11.770121+0000","last_clean":"2024-04-19T03:05:11.770121+0000","last_became_active":"2024-04-19T03:04:50.613860+0000","last_became_peered":"2024-04-19T03:04:50.613860+0000","last_unstale":"2024-04-19T03:05:11.770121+0000","last_undegraded":"2024-04-19T03:05:11.770121+0000","last_fullsized":"2024-04-19T03:05:11.770121+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:26:24.246287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":72,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.417986+0000","last_change":"2024-04-19T03:01:14.649074+0000","last_active":"2024-04-19T03:05:11.417986+0000","last_peered":"2024-04-19T03:05:11.417986+0000","last_clean":"2024-04-19T03:05:11.417986+0000","last_became_active":"2024-04-19T03:01:14.648217+0000","last_became_peered":"2024-04-19T03:01:14.648217+0000","last_unstale":"2024-04-19T03:05:11.417986+0000","last_undegraded":"2024-04-19T03:05:11.417986+0000","last_fullsized":"2024-04-19T03:05:11.417986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:57:05.238043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.769706+0000","last_change":"2024-04-19T03:04:50.611026+0000","last_active":"2024-04-19T03:05:11.769706+0000","last_peered":"2024-04-19T03:05:11.769706+0000","last_clean":"2024-04-19T03:05:11.769706+0000","last_became_active":"2024-04-19T03:04:50.610659+0000","last_became_peered":"2024-04-19T03:04:50.610659+0000","last_unstale":"2024-04-19T03:05:11.769706+0000","last_undegraded":"2024-04-19T03:05:11.769706+0000","last_fullsized":"2024-04-19T03:05:11.769706+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:57:17.231684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"20'8","reported_seq":85,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.431442+0000","last_change":"2024-04-19T03:05:11.429829+0000","last_active":"2024-04-19T03:05:11.431442+0000","last_peered":"2024-04-19T03:05:11.431442+0000","last_clean":"2024-04-19T03:05:11.431442+0000","last_became_active":"2024-04-19T03:05:11.428668+0000","last_became_peered":"2024-04-19T03:05:11.428668+0000","last_unstale":"2024-04-19T03:05:11.431442+0000","last_undegraded":"2024-04-19T03:05:11.431442+0000","last_fullsized":"2024-04-19T03:05:11.431442+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:14:21.956275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"20'1","reported_seq":73,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.428642+0000","last_change":"2024-04-19T03:01:14.649839+0000","last_active":"2024-04-19T03:05:11.428642+0000","last_peered":"2024-04-19T03:05:11.428642+0000","last_clean":"2024-04-19T03:05:11.428642+0000","last_became_active":"2024-04-19T03:01:14.649571+0000","last_became_peered":"2024-04-19T03:01:14.649571+0000","last_unstale":"2024-04-19T03:05:11.428642+0000","last_undegraded":"2024-04-19T03:05:11.428642+0000","last_fullsized":"2024-04-19T03:05:11.428642+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:03:57.839660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":53,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.417983+0000","last_change":"2024-04-19T03:05:02.362526+0000","last_active":"2024-04-19T03:05:11.417983+0000","last_peered":"2024-04-19T03:05:11.417983+0000","last_clean":"2024-04-19T03:05:11.417983+0000","last_became_active":"2024-04-19T03:05:02.362227+0000","last_became_peered":"2024-04-19T03:05:02.362227+0000","last_unstale":"2024-04-19T03:05:11.417983+0000","last_undegraded":"2024-04-19T03:05:11.417983+0000","last_fullsized":"2024-04-19T03:05:11.417983+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:00:25.584557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"20'2","reported_seq":74,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.419401+0000","last_change":"2024-04-19T03:01:14.645075+0000","last_active":"2024-04-19T03:05:11.419401+0000","last_peered":"2024-04-19T03:05:11.419401+0000","last_clean":"2024-04-19T03:05:11.419401+0000","last_became_active":"2024-04-19T03:01:14.644790+0000","last_became_peered":"2024-04-19T03:01:14.644790+0000","last_unstale":"2024-04-19T03:05:11.419401+0000","last_undegraded":"2024-04-19T03:05:11.419401+0000","last_fullsized":"2024-04-19T03:05:11.419401+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:55:15.035769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":77,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.417574+0000","last_change":"2024-04-19T03:05:09.393128+0000","last_active":"2024-04-19T03:05:11.417574+0000","last_peered":"2024-04-19T03:05:11.417574+0000","last_clean":"2024-04-19T03:05:11.417574+0000","last_became_active":"2024-04-19T03:05:09.392736+0000","last_became_peered":"2024-04-19T03:05:09.392736+0000","last_unstale":"2024-04-19T03:05:11.417574+0000","last_undegraded":"2024-04-19T03:05:11.417574+0000","last_fullsized":"2024-04-19T03:05:11.417574+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:04:56.310628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"20'1","reported_seq":40,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:12.905624+0000","last_change":"2024-04-19T03:05:11.431892+0000","last_active":"2024-04-19T03:05:12.905624+0000","last_peered":"2024-04-19T03:05:12.905624+0000","last_clean":"2024-04-19T03:05:12.905624+0000","last_became_active":"2024-04-19T03:05:11.431552+0000","last_became_peered":"2024-04-19T03:05:11.431552+0000","last_unstale":"2024-04-19T03:05:12.905624+0000","last_undegraded":"2024-04-19T03:05:12.905624+0000","last_fullsized":"2024-04-19T03:05:12.905624+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:38:26.843094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":84,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.424141+0000","last_change":"2024-04-19T03:04:50.277960+0000","last_active":"2024-04-19T03:05:11.424141+0000","last_peered":"2024-04-19T03:05:11.424141+0000","last_clean":"2024-04-19T03:05:11.424141+0000","last_became_active":"2024-04-19T03:04:50.277126+0000","last_became_peered":"2024-04-19T03:04:50.277126+0000","last_unstale":"2024-04-19T03:05:11.424141+0000","last_undegraded":"2024-04-19T03:05:11.424141+0000","last_fullsized":"2024-04-19T03:05:11.424141+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:08:49.146373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":71,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.431622+0000","last_change":"2024-04-19T03:05:11.429040+0000","last_active":"2024-04-19T03:05:11.431622+0000","last_peered":"2024-04-19T03:05:11.431622+0000","last_clean":"2024-04-19T03:05:11.431622+0000","last_became_active":"2024-04-19T03:05:11.428722+0000","last_became_peered":"2024-04-19T03:05:11.428722+0000","last_unstale":"2024-04-19T03:05:11.431622+0000","last_undegraded":"2024-04-19T03:05:11.431622+0000","last_fullsized":"2024-04-19T03:05:11.431622+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:52:42.089565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.770183+0000","last_change":"2024-04-19T03:04:50.627120+0000","last_active":"2024-04-19T03:05:11.770183+0000","last_peered":"2024-04-19T03:05:11.770183+0000","last_clean":"2024-04-19T03:05:11.770183+0000","last_became_active":"2024-04-19T03:04:50.625919+0000","last_became_peered":"2024-04-19T03:04:50.625919+0000","last_unstale":"2024-04-19T03:05:11.770183+0000","last_undegraded":"2024-04-19T03:05:11.770183+0000","last_fullsized":"2024-04-19T03:05:11.770183+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:56:19.822304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"20'2","reported_seq":32,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.769746+0000","last_change":"2024-04-19T03:04:50.627277+0000","last_active":"2024-04-19T03:05:11.769746+0000","last_peered":"2024-04-19T03:05:11.769746+0000","last_clean":"2024-04-19T03:05:11.769746+0000","last_became_active":"2024-04-19T03:04:50.625931+0000","last_became_peered":"2024-04-19T03:04:50.625931+0000","last_unstale":"2024-04-19T03:05:11.769746+0000","last_undegraded":"2024-04-19T03:05:11.769746+0000","last_fullsized":"2024-04-19T03:05:11.769746+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:30:32.408349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":86,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.431933+0000","last_change":"2024-04-19T03:05:11.430496+0000","last_active":"2024-04-19T03:05:11.431933+0000","last_peered":"2024-04-19T03:05:11.431933+0000","last_clean":"2024-04-19T03:05:11.431933+0000","last_became_active":"2024-04-19T03:05:11.430149+0000","last_became_peered":"2024-04-19T03:05:11.430149+0000","last_unstale":"2024-04-19T03:05:11.431933+0000","last_undegraded":"2024-04-19T03:05:11.431933+0000","last_fullsized":"2024-04-19T03:05:11.431933+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:55:24.828882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":85,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.424643+0000","last_change":"2024-04-19T03:04:50.278491+0000","last_active":"2024-04-19T03:05:11.424643+0000","last_peered":"2024-04-19T03:05:11.424643+0000","last_clean":"2024-04-19T03:05:11.424643+0000","last_became_active":"2024-04-19T03:04:50.277603+0000","last_became_peered":"2024-04-19T03:04:50.277603+0000","last_unstale":"2024-04-19T03:05:11.424643+0000","last_undegraded":"2024-04-19T03:05:11.424643+0000","last_fullsized":"2024-04-19T03:05:11.424643+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:04:26.211975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":71,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.426785+0000","last_change":"2024-04-19T03:01:15.015685+0000","last_active":"2024-04-19T03:05:11.426785+0000","last_peered":"2024-04-19T03:05:11.426785+0000","last_clean":"2024-04-19T03:05:11.426785+0000","last_became_active":"2024-04-19T03:01:15.014847+0000","last_became_peered":"2024-04-19T03:01:15.014847+0000","last_unstale":"2024-04-19T03:05:11.426785+0000","last_undegraded":"2024-04-19T03:05:11.426785+0000","last_fullsized":"2024-04-19T03:05:11.426785+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:51:06.208551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":51,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.418053+0000","last_change":"2024-04-19T03:05:09.392582+0000","last_active":"2024-04-19T03:05:11.418053+0000","last_peered":"2024-04-19T03:05:11.418053+0000","last_clean":"2024-04-19T03:05:11.418053+0000","last_became_active":"2024-04-19T03:05:09.391218+0000","last_became_peered":"2024-04-19T03:05:09.391218+0000","last_unstale":"2024-04-19T03:05:11.418053+0000","last_undegraded":"2024-04-19T03:05:11.418053+0000","last_fullsized":"2024-04-19T03:05:11.418053+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:06:11.612173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":71,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.426219+0000","last_change":"2024-04-19T03:01:15.014818+0000","last_active":"2024-04-19T03:05:11.426219+0000","last_peered":"2024-04-19T03:05:11.426219+0000","last_clean":"2024-04-19T03:05:11.426219+0000","last_became_active":"2024-04-19T03:01:15.014421+0000","last_became_peered":"2024-04-19T03:01:15.014421+0000","last_unstale":"2024-04-19T03:05:11.426219+0000","last_undegraded":"2024-04-19T03:05:11.426219+0000","last_fullsized":"2024-04-19T03:05:11.426219+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:16:20.475837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":78,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.417679+0000","last_change":"2024-04-19T03:05:09.395629+0000","last_active":"2024-04-19T03:05:11.417679+0000","last_peered":"2024-04-19T03:05:11.417679+0000","last_clean":"2024-04-19T03:05:11.417679+0000","last_became_active":"2024-04-19T03:05:09.395294+0000","last_became_peered":"2024-04-19T03:05:09.395294+0000","last_unstale":"2024-04-19T03:05:11.417679+0000","last_undegraded":"2024-04-19T03:05:11.417679+0000","last_fullsized":"2024-04-19T03:05:11.417679+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:38:03.627366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.770660+0000","last_change":"2024-04-19T03:04:50.617641+0000","last_active":"2024-04-19T03:05:11.770660+0000","last_peered":"2024-04-19T03:05:11.770660+0000","last_clean":"2024-04-19T03:05:11.770660+0000","last_became_active":"2024-04-19T03:04:50.617323+0000","last_became_peered":"2024-04-19T03:04:50.617323+0000","last_unstale":"2024-04-19T03:05:11.770660+0000","last_undegraded":"2024-04-19T03:05:11.770660+0000","last_fullsized":"2024-04-19T03:05:11.770660+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:26:09.566534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"14'157","reported_seq":279,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:12.903628+0000","last_change":"2024-04-19T03:05:11.429096+0000","last_active":"2024-04-19T03:05:12.903628+0000","last_peered":"2024-04-19T03:05:12.903628+0000","last_clean":"2024-04-19T03:05:12.903628+0000","last_became_active":"2024-04-19T03:05:11.426859+0000","last_became_peered":"2024-04-19T03:05:11.426859+0000","last_unstale":"2024-04-19T03:05:12.903628+0000","last_undegraded":"2024-04-19T03:05:12.903628+0000","last_fullsized":"2024-04-19T03:05:12.903628+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:06.516863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:06.516863+0000","last_clean_scrub_stamp":"2024-04-19T03:01:06.516863+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:34:42.107839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":87,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.425366+0000","last_change":"2024-04-19T03:04:50.277227+0000","last_active":"2024-04-19T03:05:11.425366+0000","last_peered":"2024-04-19T03:05:11.425366+0000","last_clean":"2024-04-19T03:05:11.425366+0000","last_became_active":"2024-04-19T03:04:50.276132+0000","last_became_peered":"2024-04-19T03:04:50.276132+0000","last_unstale":"2024-04-19T03:05:11.425366+0000","last_undegraded":"2024-04-19T03:05:11.425366+0000","last_fullsized":"2024-04-19T03:05:11.425366+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_clean_scrub_stamp":"2024-04-19T03:01:09.578660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:36:07.077967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":30,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.769259+0000","last_change":"2024-04-19T03:04:50.629139+0000","last_active":"2024-04-19T03:05:11.769259+0000","last_peered":"2024-04-19T03:05:11.769259+0000","last_clean":"2024-04-19T03:05:11.769259+0000","last_became_active":"2024-04-19T03:04:50.628741+0000","last_became_peered":"2024-04-19T03:04:50.628741+0000","last_unstale":"2024-04-19T03:05:11.769259+0000","last_undegraded":"2024-04-19T03:05:11.769259+0000","last_fullsized":"2024-04-19T03:05:11.769259+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:17:48.413908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":73,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.432341+0000","last_change":"2024-04-19T03:05:11.431455+0000","last_active":"2024-04-19T03:05:11.432341+0000","last_peered":"2024-04-19T03:05:11.432341+0000","last_clean":"2024-04-19T03:05:11.432341+0000","last_became_active":"2024-04-19T03:05:11.430881+0000","last_became_peered":"2024-04-19T03:05:11.430881+0000","last_unstale":"2024-04-19T03:05:11.432341+0000","last_undegraded":"2024-04-19T03:05:11.432341+0000","last_fullsized":"2024-04-19T03:05:11.432341+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:34:50.356698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":75,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.423910+0000","last_change":"2024-04-19T03:01:10.602194+0000","last_active":"2024-04-19T03:05:11.423910+0000","last_peered":"2024-04-19T03:05:11.423910+0000","last_clean":"2024-04-19T03:05:11.423910+0000","last_became_active":"2024-04-19T03:01:10.601381+0000","last_became_peered":"2024-04-19T03:01:10.601381+0000","last_unstale":"2024-04-19T03:05:11.423910+0000","last_undegraded":"2024-04-19T03:05:11.423910+0000","last_fullsized":"2024-04-19T03:05:11.423910+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_clean_scrub_stamp":"2024-04-19T03:01:09.578660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:42:26.594095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":30,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.768286+0000","last_change":"2024-04-19T03:04:50.634401+0000","last_active":"2024-04-19T03:05:11.768286+0000","last_peered":"2024-04-19T03:05:11.768286+0000","last_clean":"2024-04-19T03:05:11.768286+0000","last_became_active":"2024-04-19T03:04:50.631721+0000","last_became_peered":"2024-04-19T03:04:50.631721+0000","last_unstale":"2024-04-19T03:05:11.768286+0000","last_undegraded":"2024-04-19T03:05:11.768286+0000","last_fullsized":"2024-04-19T03:05:11.768286+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:40:03.144776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":77,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.419116+0000","last_change":"2024-04-19T03:05:09.395868+0000","last_active":"2024-04-19T03:05:11.419116+0000","last_peered":"2024-04-19T03:05:11.419116+0000","last_clean":"2024-04-19T03:05:11.419116+0000","last_became_active":"2024-04-19T03:05:09.395167+0000","last_became_peered":"2024-04-19T03:05:09.395167+0000","last_unstale":"2024-04-19T03:05:11.419116+0000","last_undegraded":"2024-04-19T03:05:11.419116+0000","last_fullsized":"2024-04-19T03:05:11.419116+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:40:00.629037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.768794+0000","last_change":"2024-04-19T03:04:50.635352+0000","last_active":"2024-04-19T03:05:11.768794+0000","last_peered":"2024-04-19T03:05:11.768794+0000","last_clean":"2024-04-19T03:05:11.768794+0000","last_became_active":"2024-04-19T03:04:50.633457+0000","last_became_peered":"2024-04-19T03:04:50.633457+0000","last_unstale":"2024-04-19T03:05:11.768794+0000","last_undegraded":"2024-04-19T03:05:11.768794+0000","last_fullsized":"2024-04-19T03:05:11.768794+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_clean_scrub_stamp":"2024-04-19T03:01:09.578660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:17:18.884148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":73,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:12.420122+0000","last_change":"2024-04-19T03:01:14.649068+0000","last_active":"2024-04-19T03:05:12.420122+0000","last_peered":"2024-04-19T03:05:12.420122+0000","last_clean":"2024-04-19T03:05:12.420122+0000","last_became_active":"2024-04-19T03:01:14.648082+0000","last_became_peered":"2024-04-19T03:01:14.648082+0000","last_unstale":"2024-04-19T03:05:12.420122+0000","last_undegraded":"2024-04-19T03:05:12.420122+0000","last_fullsized":"2024-04-19T03:05:12.420122+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:30:14.489117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.770578+0000","last_change":"2024-04-19T03:04:50.625932+0000","last_active":"2024-04-19T03:05:11.770578+0000","last_peered":"2024-04-19T03:05:11.770578+0000","last_clean":"2024-04-19T03:05:11.770578+0000","last_became_active":"2024-04-19T03:04:50.617628+0000","last_became_peered":"2024-04-19T03:04:50.617628+0000","last_unstale":"2024-04-19T03:05:11.770578+0000","last_undegraded":"2024-04-19T03:05:11.770578+0000","last_fullsized":"2024-04-19T03:05:11.770578+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:52:52.957579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":87,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.425331+0000","last_change":"2024-04-19T03:04:50.278737+0000","last_active":"2024-04-19T03:05:11.425331+0000","last_peered":"2024-04-19T03:05:11.425331+0000","last_clean":"2024-04-19T03:05:11.425331+0000","last_became_active":"2024-04-19T03:04:50.277804+0000","last_became_peered":"2024-04-19T03:04:50.277804+0000","last_unstale":"2024-04-19T03:05:11.425331+0000","last_undegraded":"2024-04-19T03:05:11.425331+0000","last_fullsized":"2024-04-19T03:05:11.425331+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_clean_scrub_stamp":"2024-04-19T03:01:09.578660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:00:20.440389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":85,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.424660+0000","last_change":"2024-04-19T03:04:50.277141+0000","last_active":"2024-04-19T03:05:11.424660+0000","last_peered":"2024-04-19T03:05:11.424660+0000","last_clean":"2024-04-19T03:05:11.424660+0000","last_became_active":"2024-04-19T03:04:50.275812+0000","last_became_peered":"2024-04-19T03:04:50.275812+0000","last_unstale":"2024-04-19T03:05:11.424660+0000","last_undegraded":"2024-04-19T03:05:11.424660+0000","last_fullsized":"2024-04-19T03:05:11.424660+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:16:29.209241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.769258+0000","last_change":"2024-04-19T03:04:50.616475+0000","last_active":"2024-04-19T03:05:11.769258+0000","last_peered":"2024-04-19T03:05:11.769258+0000","last_clean":"2024-04-19T03:05:11.769258+0000","last_became_active":"2024-04-19T03:04:50.614774+0000","last_became_peered":"2024-04-19T03:04:50.614774+0000","last_unstale":"2024-04-19T03:05:11.769258+0000","last_undegraded":"2024-04-19T03:05:11.769258+0000","last_fullsized":"2024-04-19T03:05:11.769258+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:51:07.142010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":71,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.431817+0000","last_change":"2024-04-19T03:05:11.430250+0000","last_active":"2024-04-19T03:05:11.431817+0000","last_peered":"2024-04-19T03:05:11.431817+0000","last_clean":"2024-04-19T03:05:11.431817+0000","last_became_active":"2024-04-19T03:05:11.429941+0000","last_became_peered":"2024-04-19T03:05:11.429941+0000","last_unstale":"2024-04-19T03:05:11.431817+0000","last_undegraded":"2024-04-19T03:05:11.431817+0000","last_fullsized":"2024-04-19T03:05:11.431817+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:28:17.231621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.769485+0000","last_change":"2024-04-19T03:04:50.615925+0000","last_active":"2024-04-19T03:05:11.769485+0000","last_peered":"2024-04-19T03:05:11.769485+0000","last_clean":"2024-04-19T03:05:11.769485+0000","last_became_active":"2024-04-19T03:04:50.614498+0000","last_became_peered":"2024-04-19T03:04:50.614498+0000","last_unstale":"2024-04-19T03:05:11.769485+0000","last_undegraded":"2024-04-19T03:05:11.769485+0000","last_fullsized":"2024-04-19T03:05:11.769485+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_clean_scrub_stamp":"2024-04-19T03:01:09.578660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:41:52.085259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":50,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.418555+0000","last_change":"2024-04-19T03:05:09.395750+0000","last_active":"2024-04-19T03:05:11.418555+0000","last_peered":"2024-04-19T03:05:11.418555+0000","last_clean":"2024-04-19T03:05:11.418555+0000","last_became_active":"2024-04-19T03:05:09.394024+0000","last_became_peered":"2024-04-19T03:05:09.394024+0000","last_unstale":"2024-04-19T03:05:11.418555+0000","last_undegraded":"2024-04-19T03:05:11.418555+0000","last_fullsized":"2024-04-19T03:05:11.418555+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:59:29.215722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":30,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.769894+0000","last_change":"2024-04-19T03:04:50.616970+0000","last_active":"2024-04-19T03:05:11.769894+0000","last_peered":"2024-04-19T03:05:11.769894+0000","last_clean":"2024-04-19T03:05:11.769894+0000","last_became_active":"2024-04-19T03:04:50.615238+0000","last_became_peered":"2024-04-19T03:04:50.615238+0000","last_unstale":"2024-04-19T03:05:11.769894+0000","last_undegraded":"2024-04-19T03:05:11.769894+0000","last_fullsized":"2024-04-19T03:05:11.769894+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:55:14.049921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":81,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.419750+0000","last_change":"2024-04-19T03:05:09.397542+0000","last_active":"2024-04-19T03:05:11.419750+0000","last_peered":"2024-04-19T03:05:11.419750+0000","last_clean":"2024-04-19T03:05:11.419750+0000","last_became_active":"2024-04-19T03:05:09.396378+0000","last_became_peered":"2024-04-19T03:05:09.396378+0000","last_unstale":"2024-04-19T03:05:11.419750+0000","last_undegraded":"2024-04-19T03:05:11.419750+0000","last_fullsized":"2024-04-19T03:05:11.419750+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_clean_scrub_stamp":"2024-04-19T03:01:09.578660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:22:24.885555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":50,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.418216+0000","last_change":"2024-04-19T03:05:09.392910+0000","last_active":"2024-04-19T03:05:11.418216+0000","last_peered":"2024-04-19T03:05:11.418216+0000","last_clean":"2024-04-19T03:05:11.418216+0000","last_became_active":"2024-04-19T03:05:09.392437+0000","last_became_peered":"2024-04-19T03:05:09.392437+0000","last_unstale":"2024-04-19T03:05:11.418216+0000","last_undegraded":"2024-04-19T03:05:11.418216+0000","last_fullsized":"2024-04-19T03:05:11.418216+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:23:28.203282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"20'2","reported_seq":32,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.769920+0000","last_change":"2024-04-19T03:04:50.611678+0000","last_active":"2024-04-19T03:05:11.769920+0000","last_peered":"2024-04-19T03:05:11.769920+0000","last_clean":"2024-04-19T03:05:11.769920+0000","last_became_active":"2024-04-19T03:04:50.611024+0000","last_became_peered":"2024-04-19T03:04:50.611024+0000","last_unstale":"2024-04-19T03:05:11.769920+0000","last_undegraded":"2024-04-19T03:05:11.769920+0000","last_fullsized":"2024-04-19T03:05:11.769920+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:08:43.323149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.769690+0000","last_change":"2024-04-19T03:04:50.616003+0000","last_active":"2024-04-19T03:05:11.769690+0000","last_peered":"2024-04-19T03:05:11.769690+0000","last_clean":"2024-04-19T03:05:11.769690+0000","last_became_active":"2024-04-19T03:04:50.612403+0000","last_became_peered":"2024-04-19T03:04:50.612403+0000","last_unstale":"2024-04-19T03:05:11.769690+0000","last_undegraded":"2024-04-19T03:05:11.769690+0000","last_fullsized":"2024-04-19T03:05:11.769690+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_clean_scrub_stamp":"2024-04-19T03:01:09.578660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:16:44.156874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.768524+0000","last_change":"2024-04-19T03:04:50.615936+0000","last_active":"2024-04-19T03:05:11.768524+0000","last_peered":"2024-04-19T03:05:11.768524+0000","last_clean":"2024-04-19T03:05:11.768524+0000","last_became_active":"2024-04-19T03:04:50.612987+0000","last_became_peered":"2024-04-19T03:04:50.612987+0000","last_unstale":"2024-04-19T03:05:11.768524+0000","last_undegraded":"2024-04-19T03:05:11.768524+0000","last_fullsized":"2024-04-19T03:05:11.768524+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:17:39.989639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"21'1","reported_seq":33,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.769909+0000","last_change":"2024-04-19T03:04:50.616200+0000","last_active":"2024-04-19T03:05:11.769909+0000","last_peered":"2024-04-19T03:05:11.769909+0000","last_clean":"2024-04-19T03:05:11.769909+0000","last_became_active":"2024-04-19T03:04:50.612697+0000","last_became_peered":"2024-04-19T03:04:50.612697+0000","last_unstale":"2024-04-19T03:05:11.769909+0000","last_undegraded":"2024-04-19T03:05:11.769909+0000","last_fullsized":"2024-04-19T03:05:11.769909+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:28:55.970411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":74,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.428574+0000","last_change":"2024-04-19T03:01:10.602274+0000","last_active":"2024-04-19T03:05:11.428574+0000","last_peered":"2024-04-19T03:05:11.428574+0000","last_clean":"2024-04-19T03:05:11.428574+0000","last_became_active":"2024-04-19T03:01:10.601487+0000","last_became_peered":"2024-04-19T03:01:10.601487+0000","last_unstale":"2024-04-19T03:05:11.428574+0000","last_undegraded":"2024-04-19T03:05:11.428574+0000","last_fullsized":"2024-04-19T03:05:11.428574+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_clean_scrub_stamp":"2024-04-19T03:01:09.578660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:26:16.712446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":71,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.417696+0000","last_change":"2024-04-19T03:01:15.018914+0000","last_active":"2024-04-19T03:05:11.417696+0000","last_peered":"2024-04-19T03:05:11.417696+0000","last_clean":"2024-04-19T03:05:11.417696+0000","last_became_active":"2024-04-19T03:01:15.018276+0000","last_became_peered":"2024-04-19T03:01:15.018276+0000","last_unstale":"2024-04-19T03:05:11.417696+0000","last_undegraded":"2024-04-19T03:05:11.417696+0000","last_fullsized":"2024-04-19T03:05:11.417696+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:40:59.453079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":76,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.431580+0000","last_change":"2024-04-19T03:05:11.430020+0000","last_active":"2024-04-19T03:05:11.431580+0000","last_peered":"2024-04-19T03:05:11.431580+0000","last_clean":"2024-04-19T03:05:11.431580+0000","last_became_active":"2024-04-19T03:05:11.429214+0000","last_became_peered":"2024-04-19T03:05:11.429214+0000","last_unstale":"2024-04-19T03:05:11.431580+0000","last_undegraded":"2024-04-19T03:05:11.431580+0000","last_fullsized":"2024-04-19T03:05:11.431580+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:06:34.608828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"20'6","reported_seq":83,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.432314+0000","last_change":"2024-04-19T03:05:11.431454+0000","last_active":"2024-04-19T03:05:11.432314+0000","last_peered":"2024-04-19T03:05:11.432314+0000","last_clean":"2024-04-19T03:05:11.432314+0000","last_became_active":"2024-04-19T03:05:11.430906+0000","last_became_peered":"2024-04-19T03:05:11.430906+0000","last_unstale":"2024-04-19T03:05:11.432314+0000","last_undegraded":"2024-04-19T03:05:11.432314+0000","last_fullsized":"2024-04-19T03:05:11.432314+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:24:28.008875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.768781+0000","last_change":"2024-04-19T03:04:50.628406+0000","last_active":"2024-04-19T03:05:11.768781+0000","last_peered":"2024-04-19T03:05:11.768781+0000","last_clean":"2024-04-19T03:05:11.768781+0000","last_became_active":"2024-04-19T03:04:50.627654+0000","last_became_peered":"2024-04-19T03:04:50.627654+0000","last_unstale":"2024-04-19T03:05:11.768781+0000","last_undegraded":"2024-04-19T03:05:11.768781+0000","last_fullsized":"2024-04-19T03:05:11.768781+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:17:57.101098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"20'3","reported_seq":54,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.419554+0000","last_change":"2024-04-19T03:05:09.398110+0000","last_active":"2024-04-19T03:05:11.419554+0000","last_peered":"2024-04-19T03:05:11.419554+0000","last_clean":"2024-04-19T03:05:11.419554+0000","last_became_active":"2024-04-19T03:05:09.397555+0000","last_became_peered":"2024-04-19T03:05:09.397555+0000","last_unstale":"2024-04-19T03:05:11.419554+0000","last_undegraded":"2024-04-19T03:05:11.419554+0000","last_fullsized":"2024-04-19T03:05:11.419554+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:27:00.017189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":71,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.431390+0000","last_change":"2024-04-19T03:05:11.429290+0000","last_active":"2024-04-19T03:05:11.431390+0000","last_peered":"2024-04-19T03:05:11.431390+0000","last_clean":"2024-04-19T03:05:11.431390+0000","last_became_active":"2024-04-19T03:05:11.428904+0000","last_became_peered":"2024-04-19T03:05:11.428904+0000","last_unstale":"2024-04-19T03:05:11.431390+0000","last_undegraded":"2024-04-19T03:05:11.431390+0000","last_fullsized":"2024-04-19T03:05:11.431390+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:16:47.688907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.768791+0000","last_change":"2024-04-19T03:04:50.634026+0000","last_active":"2024-04-19T03:05:11.768791+0000","last_peered":"2024-04-19T03:05:11.768791+0000","last_clean":"2024-04-19T03:05:11.768791+0000","last_became_active":"2024-04-19T03:04:50.630873+0000","last_became_peered":"2024-04-19T03:04:50.630873+0000","last_unstale":"2024-04-19T03:05:11.768791+0000","last_undegraded":"2024-04-19T03:05:11.768791+0000","last_fullsized":"2024-04-19T03:05:11.768791+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:41:25.674376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":30,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.770364+0000","last_change":"2024-04-19T03:04:50.612483+0000","last_active":"2024-04-19T03:05:11.770364+0000","last_peered":"2024-04-19T03:05:11.770364+0000","last_clean":"2024-04-19T03:05:11.770364+0000","last_became_active":"2024-04-19T03:04:50.612005+0000","last_became_peered":"2024-04-19T03:04:50.612005+0000","last_unstale":"2024-04-19T03:05:11.770364+0000","last_undegraded":"2024-04-19T03:05:11.770364+0000","last_fullsized":"2024-04-19T03:05:11.770364+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:56:45.629955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.768295+0000","last_change":"2024-04-19T03:04:50.616158+0000","last_active":"2024-04-19T03:05:11.768295+0000","last_peered":"2024-04-19T03:05:11.768295+0000","last_clean":"2024-04-19T03:05:11.768295+0000","last_became_active":"2024-04-19T03:04:50.613735+0000","last_became_peered":"2024-04-19T03:04:50.613735+0000","last_unstale":"2024-04-19T03:05:11.768295+0000","last_undegraded":"2024-04-19T03:05:11.768295+0000","last_fullsized":"2024-04-19T03:05:11.768295+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:25:58.128503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":50,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.419690+0000","last_change":"2024-04-19T03:05:09.394054+0000","last_active":"2024-04-19T03:05:11.419690+0000","last_peered":"2024-04-19T03:05:11.419690+0000","last_clean":"2024-04-19T03:05:11.419690+0000","last_became_active":"2024-04-19T03:05:09.392982+0000","last_became_peered":"2024-04-19T03:05:09.392982+0000","last_unstale":"2024-04-19T03:05:11.419690+0000","last_undegraded":"2024-04-19T03:05:11.419690+0000","last_fullsized":"2024-04-19T03:05:11.419690+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:09:41.580252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":30,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.768114+0000","last_change":"2024-04-19T03:04:50.616430+0000","last_active":"2024-04-19T03:05:11.768114+0000","last_peered":"2024-04-19T03:05:11.768114+0000","last_clean":"2024-04-19T03:05:11.768114+0000","last_became_active":"2024-04-19T03:04:50.613523+0000","last_became_peered":"2024-04-19T03:04:50.613523+0000","last_unstale":"2024-04-19T03:05:11.768114+0000","last_undegraded":"2024-04-19T03:05:11.768114+0000","last_fullsized":"2024-04-19T03:05:11.768114+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:22:43.207543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.770394+0000","last_change":"2024-04-19T03:04:50.616829+0000","last_active":"2024-04-19T03:05:11.770394+0000","last_peered":"2024-04-19T03:05:11.770394+0000","last_clean":"2024-04-19T03:05:11.770394+0000","last_became_active":"2024-04-19T03:04:50.616545+0000","last_became_peered":"2024-04-19T03:04:50.616545+0000","last_unstale":"2024-04-19T03:05:11.770394+0000","last_undegraded":"2024-04-19T03:05:11.770394+0000","last_fullsized":"2024-04-19T03:05:11.770394+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:07:32.515729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":30,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.768318+0000","last_change":"2024-04-19T03:04:50.634214+0000","last_active":"2024-04-19T03:05:11.768318+0000","last_peered":"2024-04-19T03:05:11.768318+0000","last_clean":"2024-04-19T03:05:11.768318+0000","last_became_active":"2024-04-19T03:04:50.631699+0000","last_became_peered":"2024-04-19T03:04:50.631699+0000","last_unstale":"2024-04-19T03:05:11.768318+0000","last_undegraded":"2024-04-19T03:05:11.768318+0000","last_fullsized":"2024-04-19T03:05:11.768318+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:43:10.184280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":53,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.418846+0000","last_change":"2024-04-19T03:05:02.361377+0000","last_active":"2024-04-19T03:05:11.418846+0000","last_peered":"2024-04-19T03:05:11.418846+0000","last_clean":"2024-04-19T03:05:11.418846+0000","last_became_active":"2024-04-19T03:05:02.360924+0000","last_became_peered":"2024-04-19T03:05:02.360924+0000","last_unstale":"2024-04-19T03:05:11.418846+0000","last_undegraded":"2024-04-19T03:05:11.418846+0000","last_fullsized":"2024-04-19T03:05:11.418846+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:39:56.940892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"20'1","reported_seq":79,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.418313+0000","last_change":"2024-04-19T03:05:09.395934+0000","last_active":"2024-04-19T03:05:11.418313+0000","last_peered":"2024-04-19T03:05:11.418313+0000","last_clean":"2024-04-19T03:05:11.418313+0000","last_became_active":"2024-04-19T03:05:09.395508+0000","last_became_peered":"2024-04-19T03:05:09.395508+0000","last_unstale":"2024-04-19T03:05:11.418313+0000","last_undegraded":"2024-04-19T03:05:11.418313+0000","last_fullsized":"2024-04-19T03:05:11.418313+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:50:26.858754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":77,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.418889+0000","last_change":"2024-04-19T03:05:09.396327+0000","last_active":"2024-04-19T03:05:11.418889+0000","last_peered":"2024-04-19T03:05:11.418889+0000","last_clean":"2024-04-19T03:05:11.418889+0000","last_became_active":"2024-04-19T03:05:09.395753+0000","last_became_peered":"2024-04-19T03:05:09.395753+0000","last_unstale":"2024-04-19T03:05:11.418889+0000","last_undegraded":"2024-04-19T03:05:11.418889+0000","last_fullsized":"2024-04-19T03:05:11.418889+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:00:12.449987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"20'1","reported_seq":87,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.418640+0000","last_change":"2024-04-19T03:05:09.398142+0000","last_active":"2024-04-19T03:05:11.418640+0000","last_peered":"2024-04-19T03:05:11.418640+0000","last_clean":"2024-04-19T03:05:11.418640+0000","last_became_active":"2024-04-19T03:05:09.397183+0000","last_became_peered":"2024-04-19T03:05:09.397183+0000","last_unstale":"2024-04-19T03:05:11.418640+0000","last_undegraded":"2024-04-19T03:05:11.418640+0000","last_fullsized":"2024-04-19T03:05:11.418640+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:45:32.978138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":86,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.431626+0000","last_change":"2024-04-19T03:05:11.430243+0000","last_active":"2024-04-19T03:05:11.431626+0000","last_peered":"2024-04-19T03:05:11.431626+0000","last_clean":"2024-04-19T03:05:11.431626+0000","last_became_active":"2024-04-19T03:05:11.429247+0000","last_became_peered":"2024-04-19T03:05:11.429247+0000","last_unstale":"2024-04-19T03:05:11.431626+0000","last_undegraded":"2024-04-19T03:05:11.431626+0000","last_fullsized":"2024-04-19T03:05:11.431626+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:41:16.915398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"20'2","reported_seq":87,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.426718+0000","last_change":"2024-04-19T03:04:50.276105+0000","last_active":"2024-04-19T03:05:11.426718+0000","last_peered":"2024-04-19T03:05:11.426718+0000","last_clean":"2024-04-19T03:05:11.426718+0000","last_became_active":"2024-04-19T03:04:50.275533+0000","last_became_peered":"2024-04-19T03:04:50.275533+0000","last_unstale":"2024-04-19T03:05:11.426718+0000","last_undegraded":"2024-04-19T03:05:11.426718+0000","last_fullsized":"2024-04-19T03:05:11.426718+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:38:13.683481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":84,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.424718+0000","last_change":"2024-04-19T03:04:50.278401+0000","last_active":"2024-04-19T03:05:11.424718+0000","last_peered":"2024-04-19T03:05:11.424718+0000","last_clean":"2024-04-19T03:05:11.424718+0000","last_became_active":"2024-04-19T03:04:50.277348+0000","last_became_peered":"2024-04-19T03:04:50.277348+0000","last_unstale":"2024-04-19T03:05:11.424718+0000","last_undegraded":"2024-04-19T03:05:11.424718+0000","last_fullsized":"2024-04-19T03:05:11.424718+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:19:35.891753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"20'2","reported_seq":56,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.419282+0000","last_change":"2024-04-19T03:05:02.363600+0000","last_active":"2024-04-19T03:05:11.419282+0000","last_peered":"2024-04-19T03:05:11.419282+0000","last_clean":"2024-04-19T03:05:11.419282+0000","last_became_active":"2024-04-19T03:05:02.363167+0000","last_became_peered":"2024-04-19T03:05:02.363167+0000","last_unstale":"2024-04-19T03:05:11.419282+0000","last_undegraded":"2024-04-19T03:05:11.419282+0000","last_fullsized":"2024-04-19T03:05:11.419282+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:49:54.288998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":77,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.418217+0000","last_change":"2024-04-19T03:05:09.394500+0000","last_active":"2024-04-19T03:05:11.418217+0000","last_peered":"2024-04-19T03:05:11.418217+0000","last_clean":"2024-04-19T03:05:11.418217+0000","last_became_active":"2024-04-19T03:05:09.393975+0000","last_became_peered":"2024-04-19T03:05:09.393975+0000","last_unstale":"2024-04-19T03:05:11.418217+0000","last_undegraded":"2024-04-19T03:05:11.418217+0000","last_fullsized":"2024-04-19T03:05:11.418217+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:00:55.706542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"20'1","reported_seq":32,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.770844+0000","last_change":"2024-04-19T03:04:50.627670+0000","last_active":"2024-04-19T03:05:11.770844+0000","last_peered":"2024-04-19T03:05:11.770844+0000","last_clean":"2024-04-19T03:05:11.770844+0000","last_became_active":"2024-04-19T03:04:50.627304+0000","last_became_peered":"2024-04-19T03:04:50.627304+0000","last_unstale":"2024-04-19T03:05:11.770844+0000","last_undegraded":"2024-04-19T03:05:11.770844+0000","last_fullsized":"2024-04-19T03:05:11.770844+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:29:08.875911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":84,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.423682+0000","last_change":"2024-04-19T03:04:50.279334+0000","last_active":"2024-04-19T03:05:11.423682+0000","last_peered":"2024-04-19T03:05:11.423682+0000","last_clean":"2024-04-19T03:05:11.423682+0000","last_became_active":"2024-04-19T03:04:50.278874+0000","last_became_peered":"2024-04-19T03:04:50.278874+0000","last_unstale":"2024-04-19T03:05:11.423682+0000","last_undegraded":"2024-04-19T03:05:11.423682+0000","last_fullsized":"2024-04-19T03:05:11.423682+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:51:33.707741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"20'4","reported_seq":32,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.770772+0000","last_change":"2024-04-19T03:04:50.627070+0000","last_active":"2024-04-19T03:05:11.770772+0000","last_peered":"2024-04-19T03:05:11.770772+0000","last_clean":"2024-04-19T03:05:11.770772+0000","last_became_active":"2024-04-19T03:04:50.626334+0000","last_became_peered":"2024-04-19T03:04:50.626334+0000","last_unstale":"2024-04-19T03:05:11.770772+0000","last_undegraded":"2024-04-19T03:05:11.770772+0000","last_fullsized":"2024-04-19T03:05:11.770772+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:24:58.586175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5289,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":14482,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":10,"seq":42949673017,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":220712,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":219774,"kb_avail":94151128,"statfs":{"total":96636764160,"available":96410755072,"internally_reserved":0,"allocated":946176,"data_stored":929795,"data_compressed":7241,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":225049030},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 19 03:02:08 2024","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"last":0.53400000000000003}]},{"osd":1,"last update":"Fri Apr 19 03:04:11 2024","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.19900000000000001,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.87,"5min":2.5030000000000001,"15min":2.5030000000000001},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.57099999999999995,"15min":0.56299999999999994},"min":{"1min":0.23999999999999999,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.90400000000000003,"5min":2.6379999999999999,"15min":2.6379999999999999},"last":0.65000000000000002}]}]},{"osd":1,"up_from":10,"seq":42949673016,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":202668,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":201726,"kb_avail":94169172,"statfs":{"total":96636764160,"available":96429232128,"internally_reserved":0,"allocated":942080,"data_stored":931342,"data_compressed":7241,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":206567878},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 19 03:02:04 2024","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.58699999999999997}]},{"osd":2,"last update":"Fri Apr 19 03:05:08 2024","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.501,"15min":0.50800000000000001},"min":{"1min":0.46999999999999997,"5min":0.224,"15min":0.224},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.50700000000000001,"15min":0.52100000000000002},"min":{"1min":0.52100000000000002,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.94899999999999995}]}]},{"osd":0,"up_from":71,"seq":304942678023,"num_pgs":73,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47712,"kb_used_data":848,"kb_used_omap":6,"kb_used_meta":46841,"kb_avail":94324128,"statfs":{"total":96636764160,"available":96587907072,"internally_reserved":0,"allocated":868352,"data_stored":339844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6883,"internal_metadata":47965469},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61799999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69199999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":7241,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":7241,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5289,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-19T03:05:16.300 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-19T03:05:16.616 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-19T03:05:16.618 INFO:teuthology.orchestra.run.smithi096.stderr:dumped all 2024-04-19T03:05:16.630 INFO:teuthology.orchestra.run.smithi096.stdout:{"pg_ready":true,"pg_map":{"version":203,"stamp":"2024-04-19T03:05:16.051011+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":471092,"kb_used_data":2692,"kb_used_omap":9,"kb_used_meta":468342,"kb_avail":282644428,"statfs":{"total":289910292480,"available":289427894272,"internally_reserved":0,"allocated":2756608,"data_stored":2200981,"data_compressed":14482,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":10071,"internal_metadata":479582377},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.002175"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":77,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.419575+0000","last_change":"2024-04-19T03:05:09.396661+0000","last_active":"2024-04-19T03:05:11.419575+0000","last_peered":"2024-04-19T03:05:11.419575+0000","last_clean":"2024-04-19T03:05:11.419575+0000","last_became_active":"2024-04-19T03:05:09.396279+0000","last_became_peered":"2024-04-19T03:05:09.396279+0000","last_unstale":"2024-04-19T03:05:11.419575+0000","last_undegraded":"2024-04-19T03:05:11.419575+0000","last_fullsized":"2024-04-19T03:05:11.419575+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:20:04.982562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":84,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.418854+0000","last_change":"2024-04-19T03:04:50.278334+0000","last_active":"2024-04-19T03:05:11.418854+0000","last_peered":"2024-04-19T03:05:11.418854+0000","last_clean":"2024-04-19T03:05:11.418854+0000","last_became_active":"2024-04-19T03:04:50.277848+0000","last_became_peered":"2024-04-19T03:04:50.277848+0000","last_unstale":"2024-04-19T03:05:11.418854+0000","last_undegraded":"2024-04-19T03:05:11.418854+0000","last_fullsized":"2024-04-19T03:05:11.418854+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:57:39.589383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":71,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.425858+0000","last_change":"2024-04-19T03:01:15.015884+0000","last_active":"2024-04-19T03:05:11.425858+0000","last_peered":"2024-04-19T03:05:11.425858+0000","last_clean":"2024-04-19T03:05:11.425858+0000","last_became_active":"2024-04-19T03:01:15.014599+0000","last_became_peered":"2024-04-19T03:01:15.014599+0000","last_unstale":"2024-04-19T03:05:11.425858+0000","last_undegraded":"2024-04-19T03:05:11.425858+0000","last_fullsized":"2024-04-19T03:05:11.425858+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:35:19.436344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":85,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:12.904164+0000","last_change":"2024-04-19T03:04:50.275017+0000","last_active":"2024-04-19T03:05:12.904164+0000","last_peered":"2024-04-19T03:05:12.904164+0000","last_clean":"2024-04-19T03:05:12.904164+0000","last_became_active":"2024-04-19T03:04:50.274600+0000","last_became_peered":"2024-04-19T03:04:50.274600+0000","last_unstale":"2024-04-19T03:05:12.904164+0000","last_undegraded":"2024-04-19T03:05:12.904164+0000","last_fullsized":"2024-04-19T03:05:12.904164+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:21:44.006351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":77,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.418426+0000","last_change":"2024-04-19T03:05:09.397682+0000","last_active":"2024-04-19T03:05:11.418426+0000","last_peered":"2024-04-19T03:05:11.418426+0000","last_clean":"2024-04-19T03:05:11.418426+0000","last_became_active":"2024-04-19T03:05:09.395929+0000","last_became_peered":"2024-04-19T03:05:09.395929+0000","last_unstale":"2024-04-19T03:05:11.418426+0000","last_undegraded":"2024-04-19T03:05:11.418426+0000","last_fullsized":"2024-04-19T03:05:11.418426+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:57:03.617383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":70,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.430738+0000","last_change":"2024-04-19T03:05:11.428461+0000","last_active":"2024-04-19T03:05:11.430738+0000","last_peered":"2024-04-19T03:05:11.430738+0000","last_clean":"2024-04-19T03:05:11.430738+0000","last_became_active":"2024-04-19T03:05:11.426617+0000","last_became_peered":"2024-04-19T03:05:11.426617+0000","last_unstale":"2024-04-19T03:05:11.430738+0000","last_undegraded":"2024-04-19T03:05:11.430738+0000","last_fullsized":"2024-04-19T03:05:11.430738+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:18:53.462220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":70,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.429888+0000","last_change":"2024-04-19T03:05:11.424581+0000","last_active":"2024-04-19T03:05:11.429888+0000","last_peered":"2024-04-19T03:05:11.429888+0000","last_clean":"2024-04-19T03:05:11.429888+0000","last_became_active":"2024-04-19T03:05:11.422727+0000","last_became_peered":"2024-04-19T03:05:11.422727+0000","last_unstale":"2024-04-19T03:05:11.429888+0000","last_undegraded":"2024-04-19T03:05:11.429888+0000","last_fullsized":"2024-04-19T03:05:11.429888+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:48:53.502161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":84,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.422960+0000","last_change":"2024-04-19T03:04:50.261359+0000","last_active":"2024-04-19T03:05:11.422960+0000","last_peered":"2024-04-19T03:05:11.422960+0000","last_clean":"2024-04-19T03:05:11.422960+0000","last_became_active":"2024-04-19T03:04:50.261155+0000","last_became_peered":"2024-04-19T03:04:50.261155+0000","last_unstale":"2024-04-19T03:05:11.422960+0000","last_undegraded":"2024-04-19T03:05:11.422960+0000","last_fullsized":"2024-04-19T03:05:11.422960+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:09:37.911709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.770311+0000","last_change":"2024-04-19T03:04:50.611854+0000","last_active":"2024-04-19T03:05:11.770311+0000","last_peered":"2024-04-19T03:05:11.770311+0000","last_clean":"2024-04-19T03:05:11.770311+0000","last_became_active":"2024-04-19T03:04:50.611400+0000","last_became_peered":"2024-04-19T03:04:50.611400+0000","last_unstale":"2024-04-19T03:05:11.770311+0000","last_undegraded":"2024-04-19T03:05:11.770311+0000","last_fullsized":"2024-04-19T03:05:11.770311+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:33:58.731162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":84,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.418911+0000","last_change":"2024-04-19T03:04:50.278337+0000","last_active":"2024-04-19T03:05:11.418911+0000","last_peered":"2024-04-19T03:05:11.418911+0000","last_clean":"2024-04-19T03:05:11.418911+0000","last_became_active":"2024-04-19T03:04:50.277899+0000","last_became_peered":"2024-04-19T03:04:50.277899+0000","last_unstale":"2024-04-19T03:05:11.418911+0000","last_undegraded":"2024-04-19T03:05:11.418911+0000","last_fullsized":"2024-04-19T03:05:11.418911+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:32:49.546687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":70,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.431939+0000","last_change":"2024-04-19T03:05:11.430574+0000","last_active":"2024-04-19T03:05:11.431939+0000","last_peered":"2024-04-19T03:05:11.431939+0000","last_clean":"2024-04-19T03:05:11.431939+0000","last_became_active":"2024-04-19T03:05:11.430243+0000","last_became_peered":"2024-04-19T03:05:11.430243+0000","last_unstale":"2024-04-19T03:05:11.431939+0000","last_undegraded":"2024-04-19T03:05:11.431939+0000","last_fullsized":"2024-04-19T03:05:11.431939+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:37:37.372803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":50,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.418696+0000","last_change":"2024-04-19T03:05:09.394405+0000","last_active":"2024-04-19T03:05:11.418696+0000","last_peered":"2024-04-19T03:05:11.418696+0000","last_clean":"2024-04-19T03:05:11.418696+0000","last_became_active":"2024-04-19T03:05:09.392822+0000","last_became_peered":"2024-04-19T03:05:09.392822+0000","last_unstale":"2024-04-19T03:05:11.418696+0000","last_undegraded":"2024-04-19T03:05:11.418696+0000","last_fullsized":"2024-04-19T03:05:11.418696+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:33:27.982343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":77,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.417984+0000","last_change":"2024-04-19T03:05:09.397000+0000","last_active":"2024-04-19T03:05:11.417984+0000","last_peered":"2024-04-19T03:05:11.417984+0000","last_clean":"2024-04-19T03:05:11.417984+0000","last_became_active":"2024-04-19T03:05:09.395749+0000","last_became_peered":"2024-04-19T03:05:09.395749+0000","last_unstale":"2024-04-19T03:05:11.417984+0000","last_undegraded":"2024-04-19T03:05:11.417984+0000","last_fullsized":"2024-04-19T03:05:11.417984+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:21:26.436890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":71,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.423871+0000","last_change":"2024-04-19T03:01:15.010960+0000","last_active":"2024-04-19T03:05:11.423871+0000","last_peered":"2024-04-19T03:05:11.423871+0000","last_clean":"2024-04-19T03:05:11.423871+0000","last_became_active":"2024-04-19T03:01:15.010472+0000","last_became_peered":"2024-04-19T03:01:15.010472+0000","last_unstale":"2024-04-19T03:05:11.423871+0000","last_undegraded":"2024-04-19T03:05:11.423871+0000","last_fullsized":"2024-04-19T03:05:11.423871+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:21:36.129346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":73,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.430581+0000","last_change":"2024-04-19T03:05:11.428285+0000","last_active":"2024-04-19T03:05:11.430581+0000","last_peered":"2024-04-19T03:05:11.430581+0000","last_clean":"2024-04-19T03:05:11.430581+0000","last_became_active":"2024-04-19T03:05:11.425921+0000","last_became_peered":"2024-04-19T03:05:11.425921+0000","last_unstale":"2024-04-19T03:05:11.430581+0000","last_undegraded":"2024-04-19T03:05:11.430581+0000","last_fullsized":"2024-04-19T03:05:11.430581+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:38:49.965677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":70,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.430778+0000","last_change":"2024-04-19T03:05:11.429030+0000","last_active":"2024-04-19T03:05:11.430778+0000","last_peered":"2024-04-19T03:05:11.430778+0000","last_clean":"2024-04-19T03:05:11.430778+0000","last_became_active":"2024-04-19T03:05:11.425921+0000","last_became_peered":"2024-04-19T03:05:11.425921+0000","last_unstale":"2024-04-19T03:05:11.430778+0000","last_undegraded":"2024-04-19T03:05:11.430778+0000","last_fullsized":"2024-04-19T03:05:11.430778+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:53:07.351904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.770126+0000","last_change":"2024-04-19T03:04:50.611757+0000","last_active":"2024-04-19T03:05:11.770126+0000","last_peered":"2024-04-19T03:05:11.770126+0000","last_clean":"2024-04-19T03:05:11.770126+0000","last_became_active":"2024-04-19T03:04:50.611392+0000","last_became_peered":"2024-04-19T03:04:50.611392+0000","last_unstale":"2024-04-19T03:05:11.770126+0000","last_undegraded":"2024-04-19T03:05:11.770126+0000","last_fullsized":"2024-04-19T03:05:11.770126+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:51:50.768612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":77,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.419368+0000","last_change":"2024-04-19T03:05:09.397114+0000","last_active":"2024-04-19T03:05:11.419368+0000","last_peered":"2024-04-19T03:05:11.419368+0000","last_clean":"2024-04-19T03:05:11.419368+0000","last_became_active":"2024-04-19T03:05:09.395682+0000","last_became_peered":"2024-04-19T03:05:09.395682+0000","last_unstale":"2024-04-19T03:05:11.419368+0000","last_undegraded":"2024-04-19T03:05:11.419368+0000","last_fullsized":"2024-04-19T03:05:11.419368+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:55:53.897442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.769589+0000","last_change":"2024-04-19T03:04:50.613858+0000","last_active":"2024-04-19T03:05:11.769589+0000","last_peered":"2024-04-19T03:05:11.769589+0000","last_clean":"2024-04-19T03:05:11.769589+0000","last_became_active":"2024-04-19T03:04:50.613481+0000","last_became_peered":"2024-04-19T03:04:50.613481+0000","last_unstale":"2024-04-19T03:05:11.769589+0000","last_undegraded":"2024-04-19T03:05:11.769589+0000","last_fullsized":"2024-04-19T03:05:11.769589+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:55:45.686937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":86,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.432386+0000","last_change":"2024-04-19T03:05:11.431719+0000","last_active":"2024-04-19T03:05:11.432386+0000","last_peered":"2024-04-19T03:05:11.432386+0000","last_clean":"2024-04-19T03:05:11.432386+0000","last_became_active":"2024-04-19T03:05:11.431352+0000","last_became_peered":"2024-04-19T03:05:11.431352+0000","last_unstale":"2024-04-19T03:05:11.432386+0000","last_undegraded":"2024-04-19T03:05:11.432386+0000","last_fullsized":"2024-04-19T03:05:11.432386+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:54:50.052460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":84,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.424051+0000","last_change":"2024-04-19T03:04:50.276678+0000","last_active":"2024-04-19T03:05:11.424051+0000","last_peered":"2024-04-19T03:05:11.424051+0000","last_clean":"2024-04-19T03:05:11.424051+0000","last_became_active":"2024-04-19T03:04:50.275510+0000","last_became_peered":"2024-04-19T03:04:50.275510+0000","last_unstale":"2024-04-19T03:05:11.424051+0000","last_undegraded":"2024-04-19T03:05:11.424051+0000","last_fullsized":"2024-04-19T03:05:11.424051+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:17:24.832346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":71,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.417759+0000","last_change":"2024-04-19T03:01:15.020108+0000","last_active":"2024-04-19T03:05:11.417759+0000","last_peered":"2024-04-19T03:05:11.417759+0000","last_clean":"2024-04-19T03:05:11.417759+0000","last_became_active":"2024-04-19T03:01:15.018978+0000","last_became_peered":"2024-04-19T03:01:15.018978+0000","last_unstale":"2024-04-19T03:05:11.417759+0000","last_undegraded":"2024-04-19T03:05:11.417759+0000","last_fullsized":"2024-04-19T03:05:11.417759+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:30:22.360053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.768605+0000","last_change":"2024-04-19T03:04:50.633855+0000","last_active":"2024-04-19T03:05:11.768605+0000","last_peered":"2024-04-19T03:05:11.768605+0000","last_clean":"2024-04-19T03:05:11.768605+0000","last_became_active":"2024-04-19T03:04:50.630948+0000","last_became_peered":"2024-04-19T03:04:50.630948+0000","last_unstale":"2024-04-19T03:05:11.768605+0000","last_undegraded":"2024-04-19T03:05:11.768605+0000","last_fullsized":"2024-04-19T03:05:11.768605+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:41:31.676439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":77,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.417346+0000","last_change":"2024-04-19T03:05:09.391159+0000","last_active":"2024-04-19T03:05:11.417346+0000","last_peered":"2024-04-19T03:05:11.417346+0000","last_clean":"2024-04-19T03:05:11.417346+0000","last_became_active":"2024-04-19T03:05:09.390922+0000","last_became_peered":"2024-04-19T03:05:09.390922+0000","last_unstale":"2024-04-19T03:05:11.417346+0000","last_undegraded":"2024-04-19T03:05:11.417346+0000","last_fullsized":"2024-04-19T03:05:11.417346+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:32:01.116711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":50,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.419689+0000","last_change":"2024-04-19T03:05:09.393923+0000","last_active":"2024-04-19T03:05:11.419689+0000","last_peered":"2024-04-19T03:05:11.419689+0000","last_clean":"2024-04-19T03:05:11.419689+0000","last_became_active":"2024-04-19T03:05:09.393108+0000","last_became_peered":"2024-04-19T03:05:09.393108+0000","last_unstale":"2024-04-19T03:05:11.419689+0000","last_undegraded":"2024-04-19T03:05:11.419689+0000","last_fullsized":"2024-04-19T03:05:11.419689+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:29:37.674820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.770633+0000","last_change":"2024-04-19T03:04:50.626923+0000","last_active":"2024-04-19T03:05:11.770633+0000","last_peered":"2024-04-19T03:05:11.770633+0000","last_clean":"2024-04-19T03:05:11.770633+0000","last_became_active":"2024-04-19T03:04:50.617603+0000","last_became_peered":"2024-04-19T03:04:50.617603+0000","last_unstale":"2024-04-19T03:05:11.770633+0000","last_undegraded":"2024-04-19T03:05:11.770633+0000","last_fullsized":"2024-04-19T03:05:11.770633+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:26:56.826024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:12.905140+0000","last_change":"2024-04-19T03:05:11.431713+0000","last_active":"2024-04-19T03:05:12.905140+0000","last_peered":"2024-04-19T03:05:12.905140+0000","last_clean":"2024-04-19T03:05:12.905140+0000","last_became_active":"2024-04-19T03:05:11.431129+0000","last_became_peered":"2024-04-19T03:05:11.431129+0000","last_unstale":"2024-04-19T03:05:12.905140+0000","last_undegraded":"2024-04-19T03:05:12.905140+0000","last_fullsized":"2024-04-19T03:05:12.905140+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:00:07.623146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":71,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.419121+0000","last_change":"2024-04-19T03:01:15.020098+0000","last_active":"2024-04-19T03:05:11.419121+0000","last_peered":"2024-04-19T03:05:11.419121+0000","last_clean":"2024-04-19T03:05:11.419121+0000","last_became_active":"2024-04-19T03:01:15.019064+0000","last_became_peered":"2024-04-19T03:01:15.019064+0000","last_unstale":"2024-04-19T03:05:11.419121+0000","last_undegraded":"2024-04-19T03:05:11.419121+0000","last_fullsized":"2024-04-19T03:05:11.419121+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:50:06.490191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.769012+0000","last_change":"2024-04-19T03:04:50.616823+0000","last_active":"2024-04-19T03:05:11.769012+0000","last_peered":"2024-04-19T03:05:11.769012+0000","last_clean":"2024-04-19T03:05:11.769012+0000","last_became_active":"2024-04-19T03:04:50.616550+0000","last_became_peered":"2024-04-19T03:04:50.616550+0000","last_unstale":"2024-04-19T03:05:11.769012+0000","last_undegraded":"2024-04-19T03:05:11.769012+0000","last_fullsized":"2024-04-19T03:05:11.769012+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:46:25.096677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":50,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.418068+0000","last_change":"2024-04-19T03:05:09.394074+0000","last_active":"2024-04-19T03:05:11.418068+0000","last_peered":"2024-04-19T03:05:11.418068+0000","last_clean":"2024-04-19T03:05:11.418068+0000","last_became_active":"2024-04-19T03:05:09.393178+0000","last_became_peered":"2024-04-19T03:05:09.393178+0000","last_unstale":"2024-04-19T03:05:11.418068+0000","last_undegraded":"2024-04-19T03:05:11.418068+0000","last_fullsized":"2024-04-19T03:05:11.418068+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:53:27.695302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.769044+0000","last_change":"2024-04-19T03:04:50.635141+0000","last_active":"2024-04-19T03:05:11.769044+0000","last_peered":"2024-04-19T03:05:11.769044+0000","last_clean":"2024-04-19T03:05:11.769044+0000","last_became_active":"2024-04-19T03:04:50.633033+0000","last_became_peered":"2024-04-19T03:04:50.633033+0000","last_unstale":"2024-04-19T03:05:11.769044+0000","last_undegraded":"2024-04-19T03:05:11.769044+0000","last_fullsized":"2024-04-19T03:05:11.769044+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:42:01.712749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":84,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.423252+0000","last_change":"2024-04-19T03:04:50.279507+0000","last_active":"2024-04-19T03:05:11.423252+0000","last_peered":"2024-04-19T03:05:11.423252+0000","last_clean":"2024-04-19T03:05:11.423252+0000","last_became_active":"2024-04-19T03:04:50.278996+0000","last_became_peered":"2024-04-19T03:04:50.278996+0000","last_unstale":"2024-04-19T03:05:11.423252+0000","last_undegraded":"2024-04-19T03:05:11.423252+0000","last_fullsized":"2024-04-19T03:05:11.423252+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:09:09.816660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":77,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.419122+0000","last_change":"2024-04-19T03:05:09.396527+0000","last_active":"2024-04-19T03:05:11.419122+0000","last_peered":"2024-04-19T03:05:11.419122+0000","last_clean":"2024-04-19T03:05:11.419122+0000","last_became_active":"2024-04-19T03:05:09.395920+0000","last_became_peered":"2024-04-19T03:05:09.395920+0000","last_unstale":"2024-04-19T03:05:11.419122+0000","last_undegraded":"2024-04-19T03:05:11.419122+0000","last_fullsized":"2024-04-19T03:05:11.419122+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:23:05.984746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"20'2","reported_seq":87,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.424713+0000","last_change":"2024-04-19T03:04:50.277421+0000","last_active":"2024-04-19T03:05:11.424713+0000","last_peered":"2024-04-19T03:05:11.424713+0000","last_clean":"2024-04-19T03:05:11.424713+0000","last_became_active":"2024-04-19T03:04:50.276732+0000","last_became_peered":"2024-04-19T03:04:50.276732+0000","last_unstale":"2024-04-19T03:05:11.424713+0000","last_undegraded":"2024-04-19T03:05:11.424713+0000","last_fullsized":"2024-04-19T03:05:11.424713+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:23:27.191496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":77,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.419051+0000","last_change":"2024-04-19T03:05:09.395454+0000","last_active":"2024-04-19T03:05:11.419051+0000","last_peered":"2024-04-19T03:05:11.419051+0000","last_clean":"2024-04-19T03:05:11.419051+0000","last_became_active":"2024-04-19T03:05:09.394288+0000","last_became_peered":"2024-04-19T03:05:09.394288+0000","last_unstale":"2024-04-19T03:05:11.419051+0000","last_undegraded":"2024-04-19T03:05:11.419051+0000","last_fullsized":"2024-04-19T03:05:11.419051+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:32:14.358374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":30,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.768860+0000","last_change":"2024-04-19T03:04:50.628801+0000","last_active":"2024-04-19T03:05:11.768860+0000","last_peered":"2024-04-19T03:05:11.768860+0000","last_clean":"2024-04-19T03:05:11.768860+0000","last_became_active":"2024-04-19T03:04:50.628023+0000","last_became_peered":"2024-04-19T03:04:50.628023+0000","last_unstale":"2024-04-19T03:05:11.768860+0000","last_undegraded":"2024-04-19T03:05:11.768860+0000","last_fullsized":"2024-04-19T03:05:11.768860+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:52:41.731698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.770121+0000","last_change":"2024-04-19T03:04:50.616471+0000","last_active":"2024-04-19T03:05:11.770121+0000","last_peered":"2024-04-19T03:05:11.770121+0000","last_clean":"2024-04-19T03:05:11.770121+0000","last_became_active":"2024-04-19T03:04:50.613860+0000","last_became_peered":"2024-04-19T03:04:50.613860+0000","last_unstale":"2024-04-19T03:05:11.770121+0000","last_undegraded":"2024-04-19T03:05:11.770121+0000","last_fullsized":"2024-04-19T03:05:11.770121+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:26:24.246287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":72,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.417986+0000","last_change":"2024-04-19T03:01:14.649074+0000","last_active":"2024-04-19T03:05:11.417986+0000","last_peered":"2024-04-19T03:05:11.417986+0000","last_clean":"2024-04-19T03:05:11.417986+0000","last_became_active":"2024-04-19T03:01:14.648217+0000","last_became_peered":"2024-04-19T03:01:14.648217+0000","last_unstale":"2024-04-19T03:05:11.417986+0000","last_undegraded":"2024-04-19T03:05:11.417986+0000","last_fullsized":"2024-04-19T03:05:11.417986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:57:05.238043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.769706+0000","last_change":"2024-04-19T03:04:50.611026+0000","last_active":"2024-04-19T03:05:11.769706+0000","last_peered":"2024-04-19T03:05:11.769706+0000","last_clean":"2024-04-19T03:05:11.769706+0000","last_became_active":"2024-04-19T03:04:50.610659+0000","last_became_peered":"2024-04-19T03:04:50.610659+0000","last_unstale":"2024-04-19T03:05:11.769706+0000","last_undegraded":"2024-04-19T03:05:11.769706+0000","last_fullsized":"2024-04-19T03:05:11.769706+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:57:17.231684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"20'8","reported_seq":85,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.431442+0000","last_change":"2024-04-19T03:05:11.429829+0000","last_active":"2024-04-19T03:05:11.431442+0000","last_peered":"2024-04-19T03:05:11.431442+0000","last_clean":"2024-04-19T03:05:11.431442+0000","last_became_active":"2024-04-19T03:05:11.428668+0000","last_became_peered":"2024-04-19T03:05:11.428668+0000","last_unstale":"2024-04-19T03:05:11.431442+0000","last_undegraded":"2024-04-19T03:05:11.431442+0000","last_fullsized":"2024-04-19T03:05:11.431442+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:14:21.956275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"20'1","reported_seq":73,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.428642+0000","last_change":"2024-04-19T03:01:14.649839+0000","last_active":"2024-04-19T03:05:11.428642+0000","last_peered":"2024-04-19T03:05:11.428642+0000","last_clean":"2024-04-19T03:05:11.428642+0000","last_became_active":"2024-04-19T03:01:14.649571+0000","last_became_peered":"2024-04-19T03:01:14.649571+0000","last_unstale":"2024-04-19T03:05:11.428642+0000","last_undegraded":"2024-04-19T03:05:11.428642+0000","last_fullsized":"2024-04-19T03:05:11.428642+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:03:57.839660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":53,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.417983+0000","last_change":"2024-04-19T03:05:02.362526+0000","last_active":"2024-04-19T03:05:11.417983+0000","last_peered":"2024-04-19T03:05:11.417983+0000","last_clean":"2024-04-19T03:05:11.417983+0000","last_became_active":"2024-04-19T03:05:02.362227+0000","last_became_peered":"2024-04-19T03:05:02.362227+0000","last_unstale":"2024-04-19T03:05:11.417983+0000","last_undegraded":"2024-04-19T03:05:11.417983+0000","last_fullsized":"2024-04-19T03:05:11.417983+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:00:25.584557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"20'2","reported_seq":74,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.419401+0000","last_change":"2024-04-19T03:01:14.645075+0000","last_active":"2024-04-19T03:05:11.419401+0000","last_peered":"2024-04-19T03:05:11.419401+0000","last_clean":"2024-04-19T03:05:11.419401+0000","last_became_active":"2024-04-19T03:01:14.644790+0000","last_became_peered":"2024-04-19T03:01:14.644790+0000","last_unstale":"2024-04-19T03:05:11.419401+0000","last_undegraded":"2024-04-19T03:05:11.419401+0000","last_fullsized":"2024-04-19T03:05:11.419401+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:55:15.035769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":77,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.417574+0000","last_change":"2024-04-19T03:05:09.393128+0000","last_active":"2024-04-19T03:05:11.417574+0000","last_peered":"2024-04-19T03:05:11.417574+0000","last_clean":"2024-04-19T03:05:11.417574+0000","last_became_active":"2024-04-19T03:05:09.392736+0000","last_became_peered":"2024-04-19T03:05:09.392736+0000","last_unstale":"2024-04-19T03:05:11.417574+0000","last_undegraded":"2024-04-19T03:05:11.417574+0000","last_fullsized":"2024-04-19T03:05:11.417574+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:04:56.310628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"20'1","reported_seq":40,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:12.905624+0000","last_change":"2024-04-19T03:05:11.431892+0000","last_active":"2024-04-19T03:05:12.905624+0000","last_peered":"2024-04-19T03:05:12.905624+0000","last_clean":"2024-04-19T03:05:12.905624+0000","last_became_active":"2024-04-19T03:05:11.431552+0000","last_became_peered":"2024-04-19T03:05:11.431552+0000","last_unstale":"2024-04-19T03:05:12.905624+0000","last_undegraded":"2024-04-19T03:05:12.905624+0000","last_fullsized":"2024-04-19T03:05:12.905624+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:38:26.843094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":84,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.424141+0000","last_change":"2024-04-19T03:04:50.277960+0000","last_active":"2024-04-19T03:05:11.424141+0000","last_peered":"2024-04-19T03:05:11.424141+0000","last_clean":"2024-04-19T03:05:11.424141+0000","last_became_active":"2024-04-19T03:04:50.277126+0000","last_became_peered":"2024-04-19T03:04:50.277126+0000","last_unstale":"2024-04-19T03:05:11.424141+0000","last_undegraded":"2024-04-19T03:05:11.424141+0000","last_fullsized":"2024-04-19T03:05:11.424141+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:08:49.146373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":71,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.431622+0000","last_change":"2024-04-19T03:05:11.429040+0000","last_active":"2024-04-19T03:05:11.431622+0000","last_peered":"2024-04-19T03:05:11.431622+0000","last_clean":"2024-04-19T03:05:11.431622+0000","last_became_active":"2024-04-19T03:05:11.428722+0000","last_became_peered":"2024-04-19T03:05:11.428722+0000","last_unstale":"2024-04-19T03:05:11.431622+0000","last_undegraded":"2024-04-19T03:05:11.431622+0000","last_fullsized":"2024-04-19T03:05:11.431622+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:52:42.089565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.770183+0000","last_change":"2024-04-19T03:04:50.627120+0000","last_active":"2024-04-19T03:05:11.770183+0000","last_peered":"2024-04-19T03:05:11.770183+0000","last_clean":"2024-04-19T03:05:11.770183+0000","last_became_active":"2024-04-19T03:04:50.625919+0000","last_became_peered":"2024-04-19T03:04:50.625919+0000","last_unstale":"2024-04-19T03:05:11.770183+0000","last_undegraded":"2024-04-19T03:05:11.770183+0000","last_fullsized":"2024-04-19T03:05:11.770183+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:56:19.822304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"20'2","reported_seq":32,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.769746+0000","last_change":"2024-04-19T03:04:50.627277+0000","last_active":"2024-04-19T03:05:11.769746+0000","last_peered":"2024-04-19T03:05:11.769746+0000","last_clean":"2024-04-19T03:05:11.769746+0000","last_became_active":"2024-04-19T03:04:50.625931+0000","last_became_peered":"2024-04-19T03:04:50.625931+0000","last_unstale":"2024-04-19T03:05:11.769746+0000","last_undegraded":"2024-04-19T03:05:11.769746+0000","last_fullsized":"2024-04-19T03:05:11.769746+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:30:32.408349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":86,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.431933+0000","last_change":"2024-04-19T03:05:11.430496+0000","last_active":"2024-04-19T03:05:11.431933+0000","last_peered":"2024-04-19T03:05:11.431933+0000","last_clean":"2024-04-19T03:05:11.431933+0000","last_became_active":"2024-04-19T03:05:11.430149+0000","last_became_peered":"2024-04-19T03:05:11.430149+0000","last_unstale":"2024-04-19T03:05:11.431933+0000","last_undegraded":"2024-04-19T03:05:11.431933+0000","last_fullsized":"2024-04-19T03:05:11.431933+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:55:24.828882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":85,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.424643+0000","last_change":"2024-04-19T03:04:50.278491+0000","last_active":"2024-04-19T03:05:11.424643+0000","last_peered":"2024-04-19T03:05:11.424643+0000","last_clean":"2024-04-19T03:05:11.424643+0000","last_became_active":"2024-04-19T03:04:50.277603+0000","last_became_peered":"2024-04-19T03:04:50.277603+0000","last_unstale":"2024-04-19T03:05:11.424643+0000","last_undegraded":"2024-04-19T03:05:11.424643+0000","last_fullsized":"2024-04-19T03:05:11.424643+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:04:26.211975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":71,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.426785+0000","last_change":"2024-04-19T03:01:15.015685+0000","last_active":"2024-04-19T03:05:11.426785+0000","last_peered":"2024-04-19T03:05:11.426785+0000","last_clean":"2024-04-19T03:05:11.426785+0000","last_became_active":"2024-04-19T03:01:15.014847+0000","last_became_peered":"2024-04-19T03:01:15.014847+0000","last_unstale":"2024-04-19T03:05:11.426785+0000","last_undegraded":"2024-04-19T03:05:11.426785+0000","last_fullsized":"2024-04-19T03:05:11.426785+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:51:06.208551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":51,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.418053+0000","last_change":"2024-04-19T03:05:09.392582+0000","last_active":"2024-04-19T03:05:11.418053+0000","last_peered":"2024-04-19T03:05:11.418053+0000","last_clean":"2024-04-19T03:05:11.418053+0000","last_became_active":"2024-04-19T03:05:09.391218+0000","last_became_peered":"2024-04-19T03:05:09.391218+0000","last_unstale":"2024-04-19T03:05:11.418053+0000","last_undegraded":"2024-04-19T03:05:11.418053+0000","last_fullsized":"2024-04-19T03:05:11.418053+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:06:11.612173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":71,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.426219+0000","last_change":"2024-04-19T03:01:15.014818+0000","last_active":"2024-04-19T03:05:11.426219+0000","last_peered":"2024-04-19T03:05:11.426219+0000","last_clean":"2024-04-19T03:05:11.426219+0000","last_became_active":"2024-04-19T03:01:15.014421+0000","last_became_peered":"2024-04-19T03:01:15.014421+0000","last_unstale":"2024-04-19T03:05:11.426219+0000","last_undegraded":"2024-04-19T03:05:11.426219+0000","last_fullsized":"2024-04-19T03:05:11.426219+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:16:20.475837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":78,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.417679+0000","last_change":"2024-04-19T03:05:09.395629+0000","last_active":"2024-04-19T03:05:11.417679+0000","last_peered":"2024-04-19T03:05:11.417679+0000","last_clean":"2024-04-19T03:05:11.417679+0000","last_became_active":"2024-04-19T03:05:09.395294+0000","last_became_peered":"2024-04-19T03:05:09.395294+0000","last_unstale":"2024-04-19T03:05:11.417679+0000","last_undegraded":"2024-04-19T03:05:11.417679+0000","last_fullsized":"2024-04-19T03:05:11.417679+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:38:03.627366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.770660+0000","last_change":"2024-04-19T03:04:50.617641+0000","last_active":"2024-04-19T03:05:11.770660+0000","last_peered":"2024-04-19T03:05:11.770660+0000","last_clean":"2024-04-19T03:05:11.770660+0000","last_became_active":"2024-04-19T03:04:50.617323+0000","last_became_peered":"2024-04-19T03:04:50.617323+0000","last_unstale":"2024-04-19T03:05:11.770660+0000","last_undegraded":"2024-04-19T03:05:11.770660+0000","last_fullsized":"2024-04-19T03:05:11.770660+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:26:09.566534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"14'157","reported_seq":279,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:12.903628+0000","last_change":"2024-04-19T03:05:11.429096+0000","last_active":"2024-04-19T03:05:12.903628+0000","last_peered":"2024-04-19T03:05:12.903628+0000","last_clean":"2024-04-19T03:05:12.903628+0000","last_became_active":"2024-04-19T03:05:11.426859+0000","last_became_peered":"2024-04-19T03:05:11.426859+0000","last_unstale":"2024-04-19T03:05:12.903628+0000","last_undegraded":"2024-04-19T03:05:12.903628+0000","last_fullsized":"2024-04-19T03:05:12.903628+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:06.516863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:06.516863+0000","last_clean_scrub_stamp":"2024-04-19T03:01:06.516863+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:34:42.107839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":87,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.425366+0000","last_change":"2024-04-19T03:04:50.277227+0000","last_active":"2024-04-19T03:05:11.425366+0000","last_peered":"2024-04-19T03:05:11.425366+0000","last_clean":"2024-04-19T03:05:11.425366+0000","last_became_active":"2024-04-19T03:04:50.276132+0000","last_became_peered":"2024-04-19T03:04:50.276132+0000","last_unstale":"2024-04-19T03:05:11.425366+0000","last_undegraded":"2024-04-19T03:05:11.425366+0000","last_fullsized":"2024-04-19T03:05:11.425366+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_clean_scrub_stamp":"2024-04-19T03:01:09.578660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:36:07.077967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":30,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.769259+0000","last_change":"2024-04-19T03:04:50.629139+0000","last_active":"2024-04-19T03:05:11.769259+0000","last_peered":"2024-04-19T03:05:11.769259+0000","last_clean":"2024-04-19T03:05:11.769259+0000","last_became_active":"2024-04-19T03:04:50.628741+0000","last_became_peered":"2024-04-19T03:04:50.628741+0000","last_unstale":"2024-04-19T03:05:11.769259+0000","last_undegraded":"2024-04-19T03:05:11.769259+0000","last_fullsized":"2024-04-19T03:05:11.769259+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:17:48.413908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":73,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.432341+0000","last_change":"2024-04-19T03:05:11.431455+0000","last_active":"2024-04-19T03:05:11.432341+0000","last_peered":"2024-04-19T03:05:11.432341+0000","last_clean":"2024-04-19T03:05:11.432341+0000","last_became_active":"2024-04-19T03:05:11.430881+0000","last_became_peered":"2024-04-19T03:05:11.430881+0000","last_unstale":"2024-04-19T03:05:11.432341+0000","last_undegraded":"2024-04-19T03:05:11.432341+0000","last_fullsized":"2024-04-19T03:05:11.432341+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:34:50.356698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":75,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.423910+0000","last_change":"2024-04-19T03:01:10.602194+0000","last_active":"2024-04-19T03:05:11.423910+0000","last_peered":"2024-04-19T03:05:11.423910+0000","last_clean":"2024-04-19T03:05:11.423910+0000","last_became_active":"2024-04-19T03:01:10.601381+0000","last_became_peered":"2024-04-19T03:01:10.601381+0000","last_unstale":"2024-04-19T03:05:11.423910+0000","last_undegraded":"2024-04-19T03:05:11.423910+0000","last_fullsized":"2024-04-19T03:05:11.423910+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_clean_scrub_stamp":"2024-04-19T03:01:09.578660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:42:26.594095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":30,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.768286+0000","last_change":"2024-04-19T03:04:50.634401+0000","last_active":"2024-04-19T03:05:11.768286+0000","last_peered":"2024-04-19T03:05:11.768286+0000","last_clean":"2024-04-19T03:05:11.768286+0000","last_became_active":"2024-04-19T03:04:50.631721+0000","last_became_peered":"2024-04-19T03:04:50.631721+0000","last_unstale":"2024-04-19T03:05:11.768286+0000","last_undegraded":"2024-04-19T03:05:11.768286+0000","last_fullsized":"2024-04-19T03:05:11.768286+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:40:03.144776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":77,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.419116+0000","last_change":"2024-04-19T03:05:09.395868+0000","last_active":"2024-04-19T03:05:11.419116+0000","last_peered":"2024-04-19T03:05:11.419116+0000","last_clean":"2024-04-19T03:05:11.419116+0000","last_became_active":"2024-04-19T03:05:09.395167+0000","last_became_peered":"2024-04-19T03:05:09.395167+0000","last_unstale":"2024-04-19T03:05:11.419116+0000","last_undegraded":"2024-04-19T03:05:11.419116+0000","last_fullsized":"2024-04-19T03:05:11.419116+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:40:00.629037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.768794+0000","last_change":"2024-04-19T03:04:50.635352+0000","last_active":"2024-04-19T03:05:11.768794+0000","last_peered":"2024-04-19T03:05:11.768794+0000","last_clean":"2024-04-19T03:05:11.768794+0000","last_became_active":"2024-04-19T03:04:50.633457+0000","last_became_peered":"2024-04-19T03:04:50.633457+0000","last_unstale":"2024-04-19T03:05:11.768794+0000","last_undegraded":"2024-04-19T03:05:11.768794+0000","last_fullsized":"2024-04-19T03:05:11.768794+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_clean_scrub_stamp":"2024-04-19T03:01:09.578660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:17:18.884148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":73,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:12.420122+0000","last_change":"2024-04-19T03:01:14.649068+0000","last_active":"2024-04-19T03:05:12.420122+0000","last_peered":"2024-04-19T03:05:12.420122+0000","last_clean":"2024-04-19T03:05:12.420122+0000","last_became_active":"2024-04-19T03:01:14.648082+0000","last_became_peered":"2024-04-19T03:01:14.648082+0000","last_unstale":"2024-04-19T03:05:12.420122+0000","last_undegraded":"2024-04-19T03:05:12.420122+0000","last_fullsized":"2024-04-19T03:05:12.420122+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:30:14.489117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.770578+0000","last_change":"2024-04-19T03:04:50.625932+0000","last_active":"2024-04-19T03:05:11.770578+0000","last_peered":"2024-04-19T03:05:11.770578+0000","last_clean":"2024-04-19T03:05:11.770578+0000","last_became_active":"2024-04-19T03:04:50.617628+0000","last_became_peered":"2024-04-19T03:04:50.617628+0000","last_unstale":"2024-04-19T03:05:11.770578+0000","last_undegraded":"2024-04-19T03:05:11.770578+0000","last_fullsized":"2024-04-19T03:05:11.770578+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:52:52.957579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":87,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.425331+0000","last_change":"2024-04-19T03:04:50.278737+0000","last_active":"2024-04-19T03:05:11.425331+0000","last_peered":"2024-04-19T03:05:11.425331+0000","last_clean":"2024-04-19T03:05:11.425331+0000","last_became_active":"2024-04-19T03:04:50.277804+0000","last_became_peered":"2024-04-19T03:04:50.277804+0000","last_unstale":"2024-04-19T03:05:11.425331+0000","last_undegraded":"2024-04-19T03:05:11.425331+0000","last_fullsized":"2024-04-19T03:05:11.425331+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_clean_scrub_stamp":"2024-04-19T03:01:09.578660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:00:20.440389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":85,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.424660+0000","last_change":"2024-04-19T03:04:50.277141+0000","last_active":"2024-04-19T03:05:11.424660+0000","last_peered":"2024-04-19T03:05:11.424660+0000","last_clean":"2024-04-19T03:05:11.424660+0000","last_became_active":"2024-04-19T03:04:50.275812+0000","last_became_peered":"2024-04-19T03:04:50.275812+0000","last_unstale":"2024-04-19T03:05:11.424660+0000","last_undegraded":"2024-04-19T03:05:11.424660+0000","last_fullsized":"2024-04-19T03:05:11.424660+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:16:29.209241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.769258+0000","last_change":"2024-04-19T03:04:50.616475+0000","last_active":"2024-04-19T03:05:11.769258+0000","last_peered":"2024-04-19T03:05:11.769258+0000","last_clean":"2024-04-19T03:05:11.769258+0000","last_became_active":"2024-04-19T03:04:50.614774+0000","last_became_peered":"2024-04-19T03:04:50.614774+0000","last_unstale":"2024-04-19T03:05:11.769258+0000","last_undegraded":"2024-04-19T03:05:11.769258+0000","last_fullsized":"2024-04-19T03:05:11.769258+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:51:07.142010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":71,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.431817+0000","last_change":"2024-04-19T03:05:11.430250+0000","last_active":"2024-04-19T03:05:11.431817+0000","last_peered":"2024-04-19T03:05:11.431817+0000","last_clean":"2024-04-19T03:05:11.431817+0000","last_became_active":"2024-04-19T03:05:11.429941+0000","last_became_peered":"2024-04-19T03:05:11.429941+0000","last_unstale":"2024-04-19T03:05:11.431817+0000","last_undegraded":"2024-04-19T03:05:11.431817+0000","last_fullsized":"2024-04-19T03:05:11.431817+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:28:17.231621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.769485+0000","last_change":"2024-04-19T03:04:50.615925+0000","last_active":"2024-04-19T03:05:11.769485+0000","last_peered":"2024-04-19T03:05:11.769485+0000","last_clean":"2024-04-19T03:05:11.769485+0000","last_became_active":"2024-04-19T03:04:50.614498+0000","last_became_peered":"2024-04-19T03:04:50.614498+0000","last_unstale":"2024-04-19T03:05:11.769485+0000","last_undegraded":"2024-04-19T03:05:11.769485+0000","last_fullsized":"2024-04-19T03:05:11.769485+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_clean_scrub_stamp":"2024-04-19T03:01:09.578660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:41:52.085259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":50,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.418555+0000","last_change":"2024-04-19T03:05:09.395750+0000","last_active":"2024-04-19T03:05:11.418555+0000","last_peered":"2024-04-19T03:05:11.418555+0000","last_clean":"2024-04-19T03:05:11.418555+0000","last_became_active":"2024-04-19T03:05:09.394024+0000","last_became_peered":"2024-04-19T03:05:09.394024+0000","last_unstale":"2024-04-19T03:05:11.418555+0000","last_undegraded":"2024-04-19T03:05:11.418555+0000","last_fullsized":"2024-04-19T03:05:11.418555+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:59:29.215722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":30,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.769894+0000","last_change":"2024-04-19T03:04:50.616970+0000","last_active":"2024-04-19T03:05:11.769894+0000","last_peered":"2024-04-19T03:05:11.769894+0000","last_clean":"2024-04-19T03:05:11.769894+0000","last_became_active":"2024-04-19T03:04:50.615238+0000","last_became_peered":"2024-04-19T03:04:50.615238+0000","last_unstale":"2024-04-19T03:05:11.769894+0000","last_undegraded":"2024-04-19T03:05:11.769894+0000","last_fullsized":"2024-04-19T03:05:11.769894+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:55:14.049921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":81,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.419750+0000","last_change":"2024-04-19T03:05:09.397542+0000","last_active":"2024-04-19T03:05:11.419750+0000","last_peered":"2024-04-19T03:05:11.419750+0000","last_clean":"2024-04-19T03:05:11.419750+0000","last_became_active":"2024-04-19T03:05:09.396378+0000","last_became_peered":"2024-04-19T03:05:09.396378+0000","last_unstale":"2024-04-19T03:05:11.419750+0000","last_undegraded":"2024-04-19T03:05:11.419750+0000","last_fullsized":"2024-04-19T03:05:11.419750+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_clean_scrub_stamp":"2024-04-19T03:01:09.578660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:22:24.885555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":50,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.418216+0000","last_change":"2024-04-19T03:05:09.392910+0000","last_active":"2024-04-19T03:05:11.418216+0000","last_peered":"2024-04-19T03:05:11.418216+0000","last_clean":"2024-04-19T03:05:11.418216+0000","last_became_active":"2024-04-19T03:05:09.392437+0000","last_became_peered":"2024-04-19T03:05:09.392437+0000","last_unstale":"2024-04-19T03:05:11.418216+0000","last_undegraded":"2024-04-19T03:05:11.418216+0000","last_fullsized":"2024-04-19T03:05:11.418216+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:23:28.203282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"20'2","reported_seq":32,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.769920+0000","last_change":"2024-04-19T03:04:50.611678+0000","last_active":"2024-04-19T03:05:11.769920+0000","last_peered":"2024-04-19T03:05:11.769920+0000","last_clean":"2024-04-19T03:05:11.769920+0000","last_became_active":"2024-04-19T03:04:50.611024+0000","last_became_peered":"2024-04-19T03:04:50.611024+0000","last_unstale":"2024-04-19T03:05:11.769920+0000","last_undegraded":"2024-04-19T03:05:11.769920+0000","last_fullsized":"2024-04-19T03:05:11.769920+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:08:43.323149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.769690+0000","last_change":"2024-04-19T03:04:50.616003+0000","last_active":"2024-04-19T03:05:11.769690+0000","last_peered":"2024-04-19T03:05:11.769690+0000","last_clean":"2024-04-19T03:05:11.769690+0000","last_became_active":"2024-04-19T03:04:50.612403+0000","last_became_peered":"2024-04-19T03:04:50.612403+0000","last_unstale":"2024-04-19T03:05:11.769690+0000","last_undegraded":"2024-04-19T03:05:11.769690+0000","last_fullsized":"2024-04-19T03:05:11.769690+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_clean_scrub_stamp":"2024-04-19T03:01:09.578660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:16:44.156874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.768524+0000","last_change":"2024-04-19T03:04:50.615936+0000","last_active":"2024-04-19T03:05:11.768524+0000","last_peered":"2024-04-19T03:05:11.768524+0000","last_clean":"2024-04-19T03:05:11.768524+0000","last_became_active":"2024-04-19T03:04:50.612987+0000","last_became_peered":"2024-04-19T03:04:50.612987+0000","last_unstale":"2024-04-19T03:05:11.768524+0000","last_undegraded":"2024-04-19T03:05:11.768524+0000","last_fullsized":"2024-04-19T03:05:11.768524+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:17:39.989639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"21'1","reported_seq":33,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.769909+0000","last_change":"2024-04-19T03:04:50.616200+0000","last_active":"2024-04-19T03:05:11.769909+0000","last_peered":"2024-04-19T03:05:11.769909+0000","last_clean":"2024-04-19T03:05:11.769909+0000","last_became_active":"2024-04-19T03:04:50.612697+0000","last_became_peered":"2024-04-19T03:04:50.612697+0000","last_unstale":"2024-04-19T03:05:11.769909+0000","last_undegraded":"2024-04-19T03:05:11.769909+0000","last_fullsized":"2024-04-19T03:05:11.769909+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:28:55.970411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":74,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.428574+0000","last_change":"2024-04-19T03:01:10.602274+0000","last_active":"2024-04-19T03:05:11.428574+0000","last_peered":"2024-04-19T03:05:11.428574+0000","last_clean":"2024-04-19T03:05:11.428574+0000","last_became_active":"2024-04-19T03:01:10.601487+0000","last_became_peered":"2024-04-19T03:01:10.601487+0000","last_unstale":"2024-04-19T03:05:11.428574+0000","last_undegraded":"2024-04-19T03:05:11.428574+0000","last_fullsized":"2024-04-19T03:05:11.428574+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_clean_scrub_stamp":"2024-04-19T03:01:09.578660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:26:16.712446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":71,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.417696+0000","last_change":"2024-04-19T03:01:15.018914+0000","last_active":"2024-04-19T03:05:11.417696+0000","last_peered":"2024-04-19T03:05:11.417696+0000","last_clean":"2024-04-19T03:05:11.417696+0000","last_became_active":"2024-04-19T03:01:15.018276+0000","last_became_peered":"2024-04-19T03:01:15.018276+0000","last_unstale":"2024-04-19T03:05:11.417696+0000","last_undegraded":"2024-04-19T03:05:11.417696+0000","last_fullsized":"2024-04-19T03:05:11.417696+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:40:59.453079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":76,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.431580+0000","last_change":"2024-04-19T03:05:11.430020+0000","last_active":"2024-04-19T03:05:11.431580+0000","last_peered":"2024-04-19T03:05:11.431580+0000","last_clean":"2024-04-19T03:05:11.431580+0000","last_became_active":"2024-04-19T03:05:11.429214+0000","last_became_peered":"2024-04-19T03:05:11.429214+0000","last_unstale":"2024-04-19T03:05:11.431580+0000","last_undegraded":"2024-04-19T03:05:11.431580+0000","last_fullsized":"2024-04-19T03:05:11.431580+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:06:34.608828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"20'6","reported_seq":83,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.432314+0000","last_change":"2024-04-19T03:05:11.431454+0000","last_active":"2024-04-19T03:05:11.432314+0000","last_peered":"2024-04-19T03:05:11.432314+0000","last_clean":"2024-04-19T03:05:11.432314+0000","last_became_active":"2024-04-19T03:05:11.430906+0000","last_became_peered":"2024-04-19T03:05:11.430906+0000","last_unstale":"2024-04-19T03:05:11.432314+0000","last_undegraded":"2024-04-19T03:05:11.432314+0000","last_fullsized":"2024-04-19T03:05:11.432314+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:24:28.008875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.768781+0000","last_change":"2024-04-19T03:04:50.628406+0000","last_active":"2024-04-19T03:05:11.768781+0000","last_peered":"2024-04-19T03:05:11.768781+0000","last_clean":"2024-04-19T03:05:11.768781+0000","last_became_active":"2024-04-19T03:04:50.627654+0000","last_became_peered":"2024-04-19T03:04:50.627654+0000","last_unstale":"2024-04-19T03:05:11.768781+0000","last_undegraded":"2024-04-19T03:05:11.768781+0000","last_fullsized":"2024-04-19T03:05:11.768781+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:17:57.101098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"20'3","reported_seq":54,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.419554+0000","last_change":"2024-04-19T03:05:09.398110+0000","last_active":"2024-04-19T03:05:11.419554+0000","last_peered":"2024-04-19T03:05:11.419554+0000","last_clean":"2024-04-19T03:05:11.419554+0000","last_became_active":"2024-04-19T03:05:09.397555+0000","last_became_peered":"2024-04-19T03:05:09.397555+0000","last_unstale":"2024-04-19T03:05:11.419554+0000","last_undegraded":"2024-04-19T03:05:11.419554+0000","last_fullsized":"2024-04-19T03:05:11.419554+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:27:00.017189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":71,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.431390+0000","last_change":"2024-04-19T03:05:11.429290+0000","last_active":"2024-04-19T03:05:11.431390+0000","last_peered":"2024-04-19T03:05:11.431390+0000","last_clean":"2024-04-19T03:05:11.431390+0000","last_became_active":"2024-04-19T03:05:11.428904+0000","last_became_peered":"2024-04-19T03:05:11.428904+0000","last_unstale":"2024-04-19T03:05:11.431390+0000","last_undegraded":"2024-04-19T03:05:11.431390+0000","last_fullsized":"2024-04-19T03:05:11.431390+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:16:47.688907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.768791+0000","last_change":"2024-04-19T03:04:50.634026+0000","last_active":"2024-04-19T03:05:11.768791+0000","last_peered":"2024-04-19T03:05:11.768791+0000","last_clean":"2024-04-19T03:05:11.768791+0000","last_became_active":"2024-04-19T03:04:50.630873+0000","last_became_peered":"2024-04-19T03:04:50.630873+0000","last_unstale":"2024-04-19T03:05:11.768791+0000","last_undegraded":"2024-04-19T03:05:11.768791+0000","last_fullsized":"2024-04-19T03:05:11.768791+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:41:25.674376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":30,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.770364+0000","last_change":"2024-04-19T03:04:50.612483+0000","last_active":"2024-04-19T03:05:11.770364+0000","last_peered":"2024-04-19T03:05:11.770364+0000","last_clean":"2024-04-19T03:05:11.770364+0000","last_became_active":"2024-04-19T03:04:50.612005+0000","last_became_peered":"2024-04-19T03:04:50.612005+0000","last_unstale":"2024-04-19T03:05:11.770364+0000","last_undegraded":"2024-04-19T03:05:11.770364+0000","last_fullsized":"2024-04-19T03:05:11.770364+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:56:45.629955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.768295+0000","last_change":"2024-04-19T03:04:50.616158+0000","last_active":"2024-04-19T03:05:11.768295+0000","last_peered":"2024-04-19T03:05:11.768295+0000","last_clean":"2024-04-19T03:05:11.768295+0000","last_became_active":"2024-04-19T03:04:50.613735+0000","last_became_peered":"2024-04-19T03:04:50.613735+0000","last_unstale":"2024-04-19T03:05:11.768295+0000","last_undegraded":"2024-04-19T03:05:11.768295+0000","last_fullsized":"2024-04-19T03:05:11.768295+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:25:58.128503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":50,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.419690+0000","last_change":"2024-04-19T03:05:09.394054+0000","last_active":"2024-04-19T03:05:11.419690+0000","last_peered":"2024-04-19T03:05:11.419690+0000","last_clean":"2024-04-19T03:05:11.419690+0000","last_became_active":"2024-04-19T03:05:09.392982+0000","last_became_peered":"2024-04-19T03:05:09.392982+0000","last_unstale":"2024-04-19T03:05:11.419690+0000","last_undegraded":"2024-04-19T03:05:11.419690+0000","last_fullsized":"2024-04-19T03:05:11.419690+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:09:41.580252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":30,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.768114+0000","last_change":"2024-04-19T03:04:50.616430+0000","last_active":"2024-04-19T03:05:11.768114+0000","last_peered":"2024-04-19T03:05:11.768114+0000","last_clean":"2024-04-19T03:05:11.768114+0000","last_became_active":"2024-04-19T03:04:50.613523+0000","last_became_peered":"2024-04-19T03:04:50.613523+0000","last_unstale":"2024-04-19T03:05:11.768114+0000","last_undegraded":"2024-04-19T03:05:11.768114+0000","last_fullsized":"2024-04-19T03:05:11.768114+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:22:43.207543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.770394+0000","last_change":"2024-04-19T03:04:50.616829+0000","last_active":"2024-04-19T03:05:11.770394+0000","last_peered":"2024-04-19T03:05:11.770394+0000","last_clean":"2024-04-19T03:05:11.770394+0000","last_became_active":"2024-04-19T03:04:50.616545+0000","last_became_peered":"2024-04-19T03:04:50.616545+0000","last_unstale":"2024-04-19T03:05:11.770394+0000","last_undegraded":"2024-04-19T03:05:11.770394+0000","last_fullsized":"2024-04-19T03:05:11.770394+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:07:32.515729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":30,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.768318+0000","last_change":"2024-04-19T03:04:50.634214+0000","last_active":"2024-04-19T03:05:11.768318+0000","last_peered":"2024-04-19T03:05:11.768318+0000","last_clean":"2024-04-19T03:05:11.768318+0000","last_became_active":"2024-04-19T03:04:50.631699+0000","last_became_peered":"2024-04-19T03:04:50.631699+0000","last_unstale":"2024-04-19T03:05:11.768318+0000","last_undegraded":"2024-04-19T03:05:11.768318+0000","last_fullsized":"2024-04-19T03:05:11.768318+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:43:10.184280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":53,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.418846+0000","last_change":"2024-04-19T03:05:02.361377+0000","last_active":"2024-04-19T03:05:11.418846+0000","last_peered":"2024-04-19T03:05:11.418846+0000","last_clean":"2024-04-19T03:05:11.418846+0000","last_became_active":"2024-04-19T03:05:02.360924+0000","last_became_peered":"2024-04-19T03:05:02.360924+0000","last_unstale":"2024-04-19T03:05:11.418846+0000","last_undegraded":"2024-04-19T03:05:11.418846+0000","last_fullsized":"2024-04-19T03:05:11.418846+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:39:56.940892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"20'1","reported_seq":79,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.418313+0000","last_change":"2024-04-19T03:05:09.395934+0000","last_active":"2024-04-19T03:05:11.418313+0000","last_peered":"2024-04-19T03:05:11.418313+0000","last_clean":"2024-04-19T03:05:11.418313+0000","last_became_active":"2024-04-19T03:05:09.395508+0000","last_became_peered":"2024-04-19T03:05:09.395508+0000","last_unstale":"2024-04-19T03:05:11.418313+0000","last_undegraded":"2024-04-19T03:05:11.418313+0000","last_fullsized":"2024-04-19T03:05:11.418313+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:50:26.858754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":77,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.418889+0000","last_change":"2024-04-19T03:05:09.396327+0000","last_active":"2024-04-19T03:05:11.418889+0000","last_peered":"2024-04-19T03:05:11.418889+0000","last_clean":"2024-04-19T03:05:11.418889+0000","last_became_active":"2024-04-19T03:05:09.395753+0000","last_became_peered":"2024-04-19T03:05:09.395753+0000","last_unstale":"2024-04-19T03:05:11.418889+0000","last_undegraded":"2024-04-19T03:05:11.418889+0000","last_fullsized":"2024-04-19T03:05:11.418889+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:00:12.449987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"20'1","reported_seq":87,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.418640+0000","last_change":"2024-04-19T03:05:09.398142+0000","last_active":"2024-04-19T03:05:11.418640+0000","last_peered":"2024-04-19T03:05:11.418640+0000","last_clean":"2024-04-19T03:05:11.418640+0000","last_became_active":"2024-04-19T03:05:09.397183+0000","last_became_peered":"2024-04-19T03:05:09.397183+0000","last_unstale":"2024-04-19T03:05:11.418640+0000","last_undegraded":"2024-04-19T03:05:11.418640+0000","last_fullsized":"2024-04-19T03:05:11.418640+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:45:32.978138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":86,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.431626+0000","last_change":"2024-04-19T03:05:11.430243+0000","last_active":"2024-04-19T03:05:11.431626+0000","last_peered":"2024-04-19T03:05:11.431626+0000","last_clean":"2024-04-19T03:05:11.431626+0000","last_became_active":"2024-04-19T03:05:11.429247+0000","last_became_peered":"2024-04-19T03:05:11.429247+0000","last_unstale":"2024-04-19T03:05:11.431626+0000","last_undegraded":"2024-04-19T03:05:11.431626+0000","last_fullsized":"2024-04-19T03:05:11.431626+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:41:16.915398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"20'2","reported_seq":87,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.426718+0000","last_change":"2024-04-19T03:04:50.276105+0000","last_active":"2024-04-19T03:05:11.426718+0000","last_peered":"2024-04-19T03:05:11.426718+0000","last_clean":"2024-04-19T03:05:11.426718+0000","last_became_active":"2024-04-19T03:04:50.275533+0000","last_became_peered":"2024-04-19T03:04:50.275533+0000","last_unstale":"2024-04-19T03:05:11.426718+0000","last_undegraded":"2024-04-19T03:05:11.426718+0000","last_fullsized":"2024-04-19T03:05:11.426718+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:38:13.683481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":84,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.424718+0000","last_change":"2024-04-19T03:04:50.278401+0000","last_active":"2024-04-19T03:05:11.424718+0000","last_peered":"2024-04-19T03:05:11.424718+0000","last_clean":"2024-04-19T03:05:11.424718+0000","last_became_active":"2024-04-19T03:04:50.277348+0000","last_became_peered":"2024-04-19T03:04:50.277348+0000","last_unstale":"2024-04-19T03:05:11.424718+0000","last_undegraded":"2024-04-19T03:05:11.424718+0000","last_fullsized":"2024-04-19T03:05:11.424718+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:19:35.891753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"20'2","reported_seq":56,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.419282+0000","last_change":"2024-04-19T03:05:02.363600+0000","last_active":"2024-04-19T03:05:11.419282+0000","last_peered":"2024-04-19T03:05:11.419282+0000","last_clean":"2024-04-19T03:05:11.419282+0000","last_became_active":"2024-04-19T03:05:02.363167+0000","last_became_peered":"2024-04-19T03:05:02.363167+0000","last_unstale":"2024-04-19T03:05:11.419282+0000","last_undegraded":"2024-04-19T03:05:11.419282+0000","last_fullsized":"2024-04-19T03:05:11.419282+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:49:54.288998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":77,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.418217+0000","last_change":"2024-04-19T03:05:09.394500+0000","last_active":"2024-04-19T03:05:11.418217+0000","last_peered":"2024-04-19T03:05:11.418217+0000","last_clean":"2024-04-19T03:05:11.418217+0000","last_became_active":"2024-04-19T03:05:09.393975+0000","last_became_peered":"2024-04-19T03:05:09.393975+0000","last_unstale":"2024-04-19T03:05:11.418217+0000","last_undegraded":"2024-04-19T03:05:11.418217+0000","last_fullsized":"2024-04-19T03:05:11.418217+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:00:55.706542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"20'1","reported_seq":32,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.770844+0000","last_change":"2024-04-19T03:04:50.627670+0000","last_active":"2024-04-19T03:05:11.770844+0000","last_peered":"2024-04-19T03:05:11.770844+0000","last_clean":"2024-04-19T03:05:11.770844+0000","last_became_active":"2024-04-19T03:04:50.627304+0000","last_became_peered":"2024-04-19T03:04:50.627304+0000","last_unstale":"2024-04-19T03:05:11.770844+0000","last_undegraded":"2024-04-19T03:05:11.770844+0000","last_fullsized":"2024-04-19T03:05:11.770844+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:29:08.875911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":84,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.423682+0000","last_change":"2024-04-19T03:04:50.279334+0000","last_active":"2024-04-19T03:05:11.423682+0000","last_peered":"2024-04-19T03:05:11.423682+0000","last_clean":"2024-04-19T03:05:11.423682+0000","last_became_active":"2024-04-19T03:04:50.278874+0000","last_became_peered":"2024-04-19T03:04:50.278874+0000","last_unstale":"2024-04-19T03:05:11.423682+0000","last_undegraded":"2024-04-19T03:05:11.423682+0000","last_fullsized":"2024-04-19T03:05:11.423682+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:51:33.707741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"20'4","reported_seq":32,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.770772+0000","last_change":"2024-04-19T03:04:50.627070+0000","last_active":"2024-04-19T03:05:11.770772+0000","last_peered":"2024-04-19T03:05:11.770772+0000","last_clean":"2024-04-19T03:05:11.770772+0000","last_became_active":"2024-04-19T03:04:50.626334+0000","last_became_peered":"2024-04-19T03:04:50.626334+0000","last_unstale":"2024-04-19T03:05:11.770772+0000","last_undegraded":"2024-04-19T03:05:11.770772+0000","last_fullsized":"2024-04-19T03:05:11.770772+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:24:58.586175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5289,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":14482,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":10,"seq":42949673017,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":220712,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":219774,"kb_avail":94151128,"statfs":{"total":96636764160,"available":96410755072,"internally_reserved":0,"allocated":946176,"data_stored":929795,"data_compressed":7241,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":225049030},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 19 03:02:08 2024","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"last":0.53400000000000003}]},{"osd":1,"last update":"Fri Apr 19 03:04:11 2024","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.19900000000000001,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.87,"5min":2.5030000000000001,"15min":2.5030000000000001},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.57099999999999995,"15min":0.56299999999999994},"min":{"1min":0.23999999999999999,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.90400000000000003,"5min":2.6379999999999999,"15min":2.6379999999999999},"last":0.65000000000000002}]}]},{"osd":1,"up_from":10,"seq":42949673016,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":202668,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":201726,"kb_avail":94169172,"statfs":{"total":96636764160,"available":96429232128,"internally_reserved":0,"allocated":942080,"data_stored":931342,"data_compressed":7241,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":206567878},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 19 03:02:04 2024","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.58699999999999997}]},{"osd":2,"last update":"Fri Apr 19 03:05:08 2024","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.501,"15min":0.50800000000000001},"min":{"1min":0.46999999999999997,"5min":0.224,"15min":0.224},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.50700000000000001,"15min":0.52100000000000002},"min":{"1min":0.52100000000000002,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.94899999999999995}]}]},{"osd":0,"up_from":71,"seq":304942678023,"num_pgs":73,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47712,"kb_used_data":848,"kb_used_omap":6,"kb_used_meta":46841,"kb_avail":94324128,"statfs":{"total":96636764160,"available":96587907072,"internally_reserved":0,"allocated":868352,"data_stored":339844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6883,"internal_metadata":47965469},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61799999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69199999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":7241,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":7241,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5289,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-19T03:05:16.634 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-19T03:05:16.635 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-19T03:05:16.935 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-19T03:05:16.938 INFO:teuthology.orchestra.run.smithi096.stderr:dumped all 2024-04-19T03:05:16.953 INFO:teuthology.orchestra.run.smithi096.stdout:{"pg_ready":true,"pg_map":{"version":203,"stamp":"2024-04-19T03:05:16.051011+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":471092,"kb_used_data":2692,"kb_used_omap":9,"kb_used_meta":468342,"kb_avail":282644428,"statfs":{"total":289910292480,"available":289427894272,"internally_reserved":0,"allocated":2756608,"data_stored":2200981,"data_compressed":14482,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":10071,"internal_metadata":479582377},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.002175"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":77,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.419575+0000","last_change":"2024-04-19T03:05:09.396661+0000","last_active":"2024-04-19T03:05:11.419575+0000","last_peered":"2024-04-19T03:05:11.419575+0000","last_clean":"2024-04-19T03:05:11.419575+0000","last_became_active":"2024-04-19T03:05:09.396279+0000","last_became_peered":"2024-04-19T03:05:09.396279+0000","last_unstale":"2024-04-19T03:05:11.419575+0000","last_undegraded":"2024-04-19T03:05:11.419575+0000","last_fullsized":"2024-04-19T03:05:11.419575+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:20:04.982562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":84,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.418854+0000","last_change":"2024-04-19T03:04:50.278334+0000","last_active":"2024-04-19T03:05:11.418854+0000","last_peered":"2024-04-19T03:05:11.418854+0000","last_clean":"2024-04-19T03:05:11.418854+0000","last_became_active":"2024-04-19T03:04:50.277848+0000","last_became_peered":"2024-04-19T03:04:50.277848+0000","last_unstale":"2024-04-19T03:05:11.418854+0000","last_undegraded":"2024-04-19T03:05:11.418854+0000","last_fullsized":"2024-04-19T03:05:11.418854+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:57:39.589383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":71,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.425858+0000","last_change":"2024-04-19T03:01:15.015884+0000","last_active":"2024-04-19T03:05:11.425858+0000","last_peered":"2024-04-19T03:05:11.425858+0000","last_clean":"2024-04-19T03:05:11.425858+0000","last_became_active":"2024-04-19T03:01:15.014599+0000","last_became_peered":"2024-04-19T03:01:15.014599+0000","last_unstale":"2024-04-19T03:05:11.425858+0000","last_undegraded":"2024-04-19T03:05:11.425858+0000","last_fullsized":"2024-04-19T03:05:11.425858+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:35:19.436344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":85,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:12.904164+0000","last_change":"2024-04-19T03:04:50.275017+0000","last_active":"2024-04-19T03:05:12.904164+0000","last_peered":"2024-04-19T03:05:12.904164+0000","last_clean":"2024-04-19T03:05:12.904164+0000","last_became_active":"2024-04-19T03:04:50.274600+0000","last_became_peered":"2024-04-19T03:04:50.274600+0000","last_unstale":"2024-04-19T03:05:12.904164+0000","last_undegraded":"2024-04-19T03:05:12.904164+0000","last_fullsized":"2024-04-19T03:05:12.904164+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:21:44.006351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":77,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.418426+0000","last_change":"2024-04-19T03:05:09.397682+0000","last_active":"2024-04-19T03:05:11.418426+0000","last_peered":"2024-04-19T03:05:11.418426+0000","last_clean":"2024-04-19T03:05:11.418426+0000","last_became_active":"2024-04-19T03:05:09.395929+0000","last_became_peered":"2024-04-19T03:05:09.395929+0000","last_unstale":"2024-04-19T03:05:11.418426+0000","last_undegraded":"2024-04-19T03:05:11.418426+0000","last_fullsized":"2024-04-19T03:05:11.418426+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:57:03.617383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":70,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.430738+0000","last_change":"2024-04-19T03:05:11.428461+0000","last_active":"2024-04-19T03:05:11.430738+0000","last_peered":"2024-04-19T03:05:11.430738+0000","last_clean":"2024-04-19T03:05:11.430738+0000","last_became_active":"2024-04-19T03:05:11.426617+0000","last_became_peered":"2024-04-19T03:05:11.426617+0000","last_unstale":"2024-04-19T03:05:11.430738+0000","last_undegraded":"2024-04-19T03:05:11.430738+0000","last_fullsized":"2024-04-19T03:05:11.430738+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:18:53.462220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":70,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.429888+0000","last_change":"2024-04-19T03:05:11.424581+0000","last_active":"2024-04-19T03:05:11.429888+0000","last_peered":"2024-04-19T03:05:11.429888+0000","last_clean":"2024-04-19T03:05:11.429888+0000","last_became_active":"2024-04-19T03:05:11.422727+0000","last_became_peered":"2024-04-19T03:05:11.422727+0000","last_unstale":"2024-04-19T03:05:11.429888+0000","last_undegraded":"2024-04-19T03:05:11.429888+0000","last_fullsized":"2024-04-19T03:05:11.429888+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:48:53.502161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":84,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.422960+0000","last_change":"2024-04-19T03:04:50.261359+0000","last_active":"2024-04-19T03:05:11.422960+0000","last_peered":"2024-04-19T03:05:11.422960+0000","last_clean":"2024-04-19T03:05:11.422960+0000","last_became_active":"2024-04-19T03:04:50.261155+0000","last_became_peered":"2024-04-19T03:04:50.261155+0000","last_unstale":"2024-04-19T03:05:11.422960+0000","last_undegraded":"2024-04-19T03:05:11.422960+0000","last_fullsized":"2024-04-19T03:05:11.422960+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:09:37.911709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.770311+0000","last_change":"2024-04-19T03:04:50.611854+0000","last_active":"2024-04-19T03:05:11.770311+0000","last_peered":"2024-04-19T03:05:11.770311+0000","last_clean":"2024-04-19T03:05:11.770311+0000","last_became_active":"2024-04-19T03:04:50.611400+0000","last_became_peered":"2024-04-19T03:04:50.611400+0000","last_unstale":"2024-04-19T03:05:11.770311+0000","last_undegraded":"2024-04-19T03:05:11.770311+0000","last_fullsized":"2024-04-19T03:05:11.770311+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:33:58.731162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":84,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.418911+0000","last_change":"2024-04-19T03:04:50.278337+0000","last_active":"2024-04-19T03:05:11.418911+0000","last_peered":"2024-04-19T03:05:11.418911+0000","last_clean":"2024-04-19T03:05:11.418911+0000","last_became_active":"2024-04-19T03:04:50.277899+0000","last_became_peered":"2024-04-19T03:04:50.277899+0000","last_unstale":"2024-04-19T03:05:11.418911+0000","last_undegraded":"2024-04-19T03:05:11.418911+0000","last_fullsized":"2024-04-19T03:05:11.418911+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:32:49.546687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":70,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.431939+0000","last_change":"2024-04-19T03:05:11.430574+0000","last_active":"2024-04-19T03:05:11.431939+0000","last_peered":"2024-04-19T03:05:11.431939+0000","last_clean":"2024-04-19T03:05:11.431939+0000","last_became_active":"2024-04-19T03:05:11.430243+0000","last_became_peered":"2024-04-19T03:05:11.430243+0000","last_unstale":"2024-04-19T03:05:11.431939+0000","last_undegraded":"2024-04-19T03:05:11.431939+0000","last_fullsized":"2024-04-19T03:05:11.431939+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:37:37.372803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":50,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.418696+0000","last_change":"2024-04-19T03:05:09.394405+0000","last_active":"2024-04-19T03:05:11.418696+0000","last_peered":"2024-04-19T03:05:11.418696+0000","last_clean":"2024-04-19T03:05:11.418696+0000","last_became_active":"2024-04-19T03:05:09.392822+0000","last_became_peered":"2024-04-19T03:05:09.392822+0000","last_unstale":"2024-04-19T03:05:11.418696+0000","last_undegraded":"2024-04-19T03:05:11.418696+0000","last_fullsized":"2024-04-19T03:05:11.418696+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:33:27.982343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":77,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.417984+0000","last_change":"2024-04-19T03:05:09.397000+0000","last_active":"2024-04-19T03:05:11.417984+0000","last_peered":"2024-04-19T03:05:11.417984+0000","last_clean":"2024-04-19T03:05:11.417984+0000","last_became_active":"2024-04-19T03:05:09.395749+0000","last_became_peered":"2024-04-19T03:05:09.395749+0000","last_unstale":"2024-04-19T03:05:11.417984+0000","last_undegraded":"2024-04-19T03:05:11.417984+0000","last_fullsized":"2024-04-19T03:05:11.417984+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:21:26.436890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":71,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.423871+0000","last_change":"2024-04-19T03:01:15.010960+0000","last_active":"2024-04-19T03:05:11.423871+0000","last_peered":"2024-04-19T03:05:11.423871+0000","last_clean":"2024-04-19T03:05:11.423871+0000","last_became_active":"2024-04-19T03:01:15.010472+0000","last_became_peered":"2024-04-19T03:01:15.010472+0000","last_unstale":"2024-04-19T03:05:11.423871+0000","last_undegraded":"2024-04-19T03:05:11.423871+0000","last_fullsized":"2024-04-19T03:05:11.423871+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:21:36.129346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":73,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.430581+0000","last_change":"2024-04-19T03:05:11.428285+0000","last_active":"2024-04-19T03:05:11.430581+0000","last_peered":"2024-04-19T03:05:11.430581+0000","last_clean":"2024-04-19T03:05:11.430581+0000","last_became_active":"2024-04-19T03:05:11.425921+0000","last_became_peered":"2024-04-19T03:05:11.425921+0000","last_unstale":"2024-04-19T03:05:11.430581+0000","last_undegraded":"2024-04-19T03:05:11.430581+0000","last_fullsized":"2024-04-19T03:05:11.430581+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:38:49.965677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":70,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.430778+0000","last_change":"2024-04-19T03:05:11.429030+0000","last_active":"2024-04-19T03:05:11.430778+0000","last_peered":"2024-04-19T03:05:11.430778+0000","last_clean":"2024-04-19T03:05:11.430778+0000","last_became_active":"2024-04-19T03:05:11.425921+0000","last_became_peered":"2024-04-19T03:05:11.425921+0000","last_unstale":"2024-04-19T03:05:11.430778+0000","last_undegraded":"2024-04-19T03:05:11.430778+0000","last_fullsized":"2024-04-19T03:05:11.430778+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:53:07.351904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.770126+0000","last_change":"2024-04-19T03:04:50.611757+0000","last_active":"2024-04-19T03:05:11.770126+0000","last_peered":"2024-04-19T03:05:11.770126+0000","last_clean":"2024-04-19T03:05:11.770126+0000","last_became_active":"2024-04-19T03:04:50.611392+0000","last_became_peered":"2024-04-19T03:04:50.611392+0000","last_unstale":"2024-04-19T03:05:11.770126+0000","last_undegraded":"2024-04-19T03:05:11.770126+0000","last_fullsized":"2024-04-19T03:05:11.770126+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:51:50.768612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":77,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.419368+0000","last_change":"2024-04-19T03:05:09.397114+0000","last_active":"2024-04-19T03:05:11.419368+0000","last_peered":"2024-04-19T03:05:11.419368+0000","last_clean":"2024-04-19T03:05:11.419368+0000","last_became_active":"2024-04-19T03:05:09.395682+0000","last_became_peered":"2024-04-19T03:05:09.395682+0000","last_unstale":"2024-04-19T03:05:11.419368+0000","last_undegraded":"2024-04-19T03:05:11.419368+0000","last_fullsized":"2024-04-19T03:05:11.419368+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:55:53.897442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.769589+0000","last_change":"2024-04-19T03:04:50.613858+0000","last_active":"2024-04-19T03:05:11.769589+0000","last_peered":"2024-04-19T03:05:11.769589+0000","last_clean":"2024-04-19T03:05:11.769589+0000","last_became_active":"2024-04-19T03:04:50.613481+0000","last_became_peered":"2024-04-19T03:04:50.613481+0000","last_unstale":"2024-04-19T03:05:11.769589+0000","last_undegraded":"2024-04-19T03:05:11.769589+0000","last_fullsized":"2024-04-19T03:05:11.769589+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:55:45.686937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":86,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.432386+0000","last_change":"2024-04-19T03:05:11.431719+0000","last_active":"2024-04-19T03:05:11.432386+0000","last_peered":"2024-04-19T03:05:11.432386+0000","last_clean":"2024-04-19T03:05:11.432386+0000","last_became_active":"2024-04-19T03:05:11.431352+0000","last_became_peered":"2024-04-19T03:05:11.431352+0000","last_unstale":"2024-04-19T03:05:11.432386+0000","last_undegraded":"2024-04-19T03:05:11.432386+0000","last_fullsized":"2024-04-19T03:05:11.432386+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:54:50.052460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":84,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.424051+0000","last_change":"2024-04-19T03:04:50.276678+0000","last_active":"2024-04-19T03:05:11.424051+0000","last_peered":"2024-04-19T03:05:11.424051+0000","last_clean":"2024-04-19T03:05:11.424051+0000","last_became_active":"2024-04-19T03:04:50.275510+0000","last_became_peered":"2024-04-19T03:04:50.275510+0000","last_unstale":"2024-04-19T03:05:11.424051+0000","last_undegraded":"2024-04-19T03:05:11.424051+0000","last_fullsized":"2024-04-19T03:05:11.424051+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:17:24.832346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":71,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.417759+0000","last_change":"2024-04-19T03:01:15.020108+0000","last_active":"2024-04-19T03:05:11.417759+0000","last_peered":"2024-04-19T03:05:11.417759+0000","last_clean":"2024-04-19T03:05:11.417759+0000","last_became_active":"2024-04-19T03:01:15.018978+0000","last_became_peered":"2024-04-19T03:01:15.018978+0000","last_unstale":"2024-04-19T03:05:11.417759+0000","last_undegraded":"2024-04-19T03:05:11.417759+0000","last_fullsized":"2024-04-19T03:05:11.417759+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:30:22.360053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.768605+0000","last_change":"2024-04-19T03:04:50.633855+0000","last_active":"2024-04-19T03:05:11.768605+0000","last_peered":"2024-04-19T03:05:11.768605+0000","last_clean":"2024-04-19T03:05:11.768605+0000","last_became_active":"2024-04-19T03:04:50.630948+0000","last_became_peered":"2024-04-19T03:04:50.630948+0000","last_unstale":"2024-04-19T03:05:11.768605+0000","last_undegraded":"2024-04-19T03:05:11.768605+0000","last_fullsized":"2024-04-19T03:05:11.768605+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:41:31.676439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":77,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.417346+0000","last_change":"2024-04-19T03:05:09.391159+0000","last_active":"2024-04-19T03:05:11.417346+0000","last_peered":"2024-04-19T03:05:11.417346+0000","last_clean":"2024-04-19T03:05:11.417346+0000","last_became_active":"2024-04-19T03:05:09.390922+0000","last_became_peered":"2024-04-19T03:05:09.390922+0000","last_unstale":"2024-04-19T03:05:11.417346+0000","last_undegraded":"2024-04-19T03:05:11.417346+0000","last_fullsized":"2024-04-19T03:05:11.417346+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:32:01.116711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":50,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.419689+0000","last_change":"2024-04-19T03:05:09.393923+0000","last_active":"2024-04-19T03:05:11.419689+0000","last_peered":"2024-04-19T03:05:11.419689+0000","last_clean":"2024-04-19T03:05:11.419689+0000","last_became_active":"2024-04-19T03:05:09.393108+0000","last_became_peered":"2024-04-19T03:05:09.393108+0000","last_unstale":"2024-04-19T03:05:11.419689+0000","last_undegraded":"2024-04-19T03:05:11.419689+0000","last_fullsized":"2024-04-19T03:05:11.419689+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:29:37.674820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.770633+0000","last_change":"2024-04-19T03:04:50.626923+0000","last_active":"2024-04-19T03:05:11.770633+0000","last_peered":"2024-04-19T03:05:11.770633+0000","last_clean":"2024-04-19T03:05:11.770633+0000","last_became_active":"2024-04-19T03:04:50.617603+0000","last_became_peered":"2024-04-19T03:04:50.617603+0000","last_unstale":"2024-04-19T03:05:11.770633+0000","last_undegraded":"2024-04-19T03:05:11.770633+0000","last_fullsized":"2024-04-19T03:05:11.770633+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:26:56.826024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:12.905140+0000","last_change":"2024-04-19T03:05:11.431713+0000","last_active":"2024-04-19T03:05:12.905140+0000","last_peered":"2024-04-19T03:05:12.905140+0000","last_clean":"2024-04-19T03:05:12.905140+0000","last_became_active":"2024-04-19T03:05:11.431129+0000","last_became_peered":"2024-04-19T03:05:11.431129+0000","last_unstale":"2024-04-19T03:05:12.905140+0000","last_undegraded":"2024-04-19T03:05:12.905140+0000","last_fullsized":"2024-04-19T03:05:12.905140+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:00:07.623146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":71,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.419121+0000","last_change":"2024-04-19T03:01:15.020098+0000","last_active":"2024-04-19T03:05:11.419121+0000","last_peered":"2024-04-19T03:05:11.419121+0000","last_clean":"2024-04-19T03:05:11.419121+0000","last_became_active":"2024-04-19T03:01:15.019064+0000","last_became_peered":"2024-04-19T03:01:15.019064+0000","last_unstale":"2024-04-19T03:05:11.419121+0000","last_undegraded":"2024-04-19T03:05:11.419121+0000","last_fullsized":"2024-04-19T03:05:11.419121+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:50:06.490191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.769012+0000","last_change":"2024-04-19T03:04:50.616823+0000","last_active":"2024-04-19T03:05:11.769012+0000","last_peered":"2024-04-19T03:05:11.769012+0000","last_clean":"2024-04-19T03:05:11.769012+0000","last_became_active":"2024-04-19T03:04:50.616550+0000","last_became_peered":"2024-04-19T03:04:50.616550+0000","last_unstale":"2024-04-19T03:05:11.769012+0000","last_undegraded":"2024-04-19T03:05:11.769012+0000","last_fullsized":"2024-04-19T03:05:11.769012+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:46:25.096677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":50,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.418068+0000","last_change":"2024-04-19T03:05:09.394074+0000","last_active":"2024-04-19T03:05:11.418068+0000","last_peered":"2024-04-19T03:05:11.418068+0000","last_clean":"2024-04-19T03:05:11.418068+0000","last_became_active":"2024-04-19T03:05:09.393178+0000","last_became_peered":"2024-04-19T03:05:09.393178+0000","last_unstale":"2024-04-19T03:05:11.418068+0000","last_undegraded":"2024-04-19T03:05:11.418068+0000","last_fullsized":"2024-04-19T03:05:11.418068+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:53:27.695302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.769044+0000","last_change":"2024-04-19T03:04:50.635141+0000","last_active":"2024-04-19T03:05:11.769044+0000","last_peered":"2024-04-19T03:05:11.769044+0000","last_clean":"2024-04-19T03:05:11.769044+0000","last_became_active":"2024-04-19T03:04:50.633033+0000","last_became_peered":"2024-04-19T03:04:50.633033+0000","last_unstale":"2024-04-19T03:05:11.769044+0000","last_undegraded":"2024-04-19T03:05:11.769044+0000","last_fullsized":"2024-04-19T03:05:11.769044+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:42:01.712749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":84,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.423252+0000","last_change":"2024-04-19T03:04:50.279507+0000","last_active":"2024-04-19T03:05:11.423252+0000","last_peered":"2024-04-19T03:05:11.423252+0000","last_clean":"2024-04-19T03:05:11.423252+0000","last_became_active":"2024-04-19T03:04:50.278996+0000","last_became_peered":"2024-04-19T03:04:50.278996+0000","last_unstale":"2024-04-19T03:05:11.423252+0000","last_undegraded":"2024-04-19T03:05:11.423252+0000","last_fullsized":"2024-04-19T03:05:11.423252+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:09:09.816660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":77,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.419122+0000","last_change":"2024-04-19T03:05:09.396527+0000","last_active":"2024-04-19T03:05:11.419122+0000","last_peered":"2024-04-19T03:05:11.419122+0000","last_clean":"2024-04-19T03:05:11.419122+0000","last_became_active":"2024-04-19T03:05:09.395920+0000","last_became_peered":"2024-04-19T03:05:09.395920+0000","last_unstale":"2024-04-19T03:05:11.419122+0000","last_undegraded":"2024-04-19T03:05:11.419122+0000","last_fullsized":"2024-04-19T03:05:11.419122+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:23:05.984746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"20'2","reported_seq":87,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.424713+0000","last_change":"2024-04-19T03:04:50.277421+0000","last_active":"2024-04-19T03:05:11.424713+0000","last_peered":"2024-04-19T03:05:11.424713+0000","last_clean":"2024-04-19T03:05:11.424713+0000","last_became_active":"2024-04-19T03:04:50.276732+0000","last_became_peered":"2024-04-19T03:04:50.276732+0000","last_unstale":"2024-04-19T03:05:11.424713+0000","last_undegraded":"2024-04-19T03:05:11.424713+0000","last_fullsized":"2024-04-19T03:05:11.424713+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:23:27.191496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":77,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.419051+0000","last_change":"2024-04-19T03:05:09.395454+0000","last_active":"2024-04-19T03:05:11.419051+0000","last_peered":"2024-04-19T03:05:11.419051+0000","last_clean":"2024-04-19T03:05:11.419051+0000","last_became_active":"2024-04-19T03:05:09.394288+0000","last_became_peered":"2024-04-19T03:05:09.394288+0000","last_unstale":"2024-04-19T03:05:11.419051+0000","last_undegraded":"2024-04-19T03:05:11.419051+0000","last_fullsized":"2024-04-19T03:05:11.419051+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:32:14.358374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":30,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.768860+0000","last_change":"2024-04-19T03:04:50.628801+0000","last_active":"2024-04-19T03:05:11.768860+0000","last_peered":"2024-04-19T03:05:11.768860+0000","last_clean":"2024-04-19T03:05:11.768860+0000","last_became_active":"2024-04-19T03:04:50.628023+0000","last_became_peered":"2024-04-19T03:04:50.628023+0000","last_unstale":"2024-04-19T03:05:11.768860+0000","last_undegraded":"2024-04-19T03:05:11.768860+0000","last_fullsized":"2024-04-19T03:05:11.768860+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:52:41.731698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.770121+0000","last_change":"2024-04-19T03:04:50.616471+0000","last_active":"2024-04-19T03:05:11.770121+0000","last_peered":"2024-04-19T03:05:11.770121+0000","last_clean":"2024-04-19T03:05:11.770121+0000","last_became_active":"2024-04-19T03:04:50.613860+0000","last_became_peered":"2024-04-19T03:04:50.613860+0000","last_unstale":"2024-04-19T03:05:11.770121+0000","last_undegraded":"2024-04-19T03:05:11.770121+0000","last_fullsized":"2024-04-19T03:05:11.770121+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:26:24.246287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":72,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.417986+0000","last_change":"2024-04-19T03:01:14.649074+0000","last_active":"2024-04-19T03:05:11.417986+0000","last_peered":"2024-04-19T03:05:11.417986+0000","last_clean":"2024-04-19T03:05:11.417986+0000","last_became_active":"2024-04-19T03:01:14.648217+0000","last_became_peered":"2024-04-19T03:01:14.648217+0000","last_unstale":"2024-04-19T03:05:11.417986+0000","last_undegraded":"2024-04-19T03:05:11.417986+0000","last_fullsized":"2024-04-19T03:05:11.417986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:57:05.238043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.769706+0000","last_change":"2024-04-19T03:04:50.611026+0000","last_active":"2024-04-19T03:05:11.769706+0000","last_peered":"2024-04-19T03:05:11.769706+0000","last_clean":"2024-04-19T03:05:11.769706+0000","last_became_active":"2024-04-19T03:04:50.610659+0000","last_became_peered":"2024-04-19T03:04:50.610659+0000","last_unstale":"2024-04-19T03:05:11.769706+0000","last_undegraded":"2024-04-19T03:05:11.769706+0000","last_fullsized":"2024-04-19T03:05:11.769706+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:57:17.231684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"20'8","reported_seq":85,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.431442+0000","last_change":"2024-04-19T03:05:11.429829+0000","last_active":"2024-04-19T03:05:11.431442+0000","last_peered":"2024-04-19T03:05:11.431442+0000","last_clean":"2024-04-19T03:05:11.431442+0000","last_became_active":"2024-04-19T03:05:11.428668+0000","last_became_peered":"2024-04-19T03:05:11.428668+0000","last_unstale":"2024-04-19T03:05:11.431442+0000","last_undegraded":"2024-04-19T03:05:11.431442+0000","last_fullsized":"2024-04-19T03:05:11.431442+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:14:21.956275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"20'1","reported_seq":73,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.428642+0000","last_change":"2024-04-19T03:01:14.649839+0000","last_active":"2024-04-19T03:05:11.428642+0000","last_peered":"2024-04-19T03:05:11.428642+0000","last_clean":"2024-04-19T03:05:11.428642+0000","last_became_active":"2024-04-19T03:01:14.649571+0000","last_became_peered":"2024-04-19T03:01:14.649571+0000","last_unstale":"2024-04-19T03:05:11.428642+0000","last_undegraded":"2024-04-19T03:05:11.428642+0000","last_fullsized":"2024-04-19T03:05:11.428642+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:03:57.839660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":53,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.417983+0000","last_change":"2024-04-19T03:05:02.362526+0000","last_active":"2024-04-19T03:05:11.417983+0000","last_peered":"2024-04-19T03:05:11.417983+0000","last_clean":"2024-04-19T03:05:11.417983+0000","last_became_active":"2024-04-19T03:05:02.362227+0000","last_became_peered":"2024-04-19T03:05:02.362227+0000","last_unstale":"2024-04-19T03:05:11.417983+0000","last_undegraded":"2024-04-19T03:05:11.417983+0000","last_fullsized":"2024-04-19T03:05:11.417983+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:00:25.584557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"20'2","reported_seq":74,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.419401+0000","last_change":"2024-04-19T03:01:14.645075+0000","last_active":"2024-04-19T03:05:11.419401+0000","last_peered":"2024-04-19T03:05:11.419401+0000","last_clean":"2024-04-19T03:05:11.419401+0000","last_became_active":"2024-04-19T03:01:14.644790+0000","last_became_peered":"2024-04-19T03:01:14.644790+0000","last_unstale":"2024-04-19T03:05:11.419401+0000","last_undegraded":"2024-04-19T03:05:11.419401+0000","last_fullsized":"2024-04-19T03:05:11.419401+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:55:15.035769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":77,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.417574+0000","last_change":"2024-04-19T03:05:09.393128+0000","last_active":"2024-04-19T03:05:11.417574+0000","last_peered":"2024-04-19T03:05:11.417574+0000","last_clean":"2024-04-19T03:05:11.417574+0000","last_became_active":"2024-04-19T03:05:09.392736+0000","last_became_peered":"2024-04-19T03:05:09.392736+0000","last_unstale":"2024-04-19T03:05:11.417574+0000","last_undegraded":"2024-04-19T03:05:11.417574+0000","last_fullsized":"2024-04-19T03:05:11.417574+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:04:56.310628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"20'1","reported_seq":40,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:12.905624+0000","last_change":"2024-04-19T03:05:11.431892+0000","last_active":"2024-04-19T03:05:12.905624+0000","last_peered":"2024-04-19T03:05:12.905624+0000","last_clean":"2024-04-19T03:05:12.905624+0000","last_became_active":"2024-04-19T03:05:11.431552+0000","last_became_peered":"2024-04-19T03:05:11.431552+0000","last_unstale":"2024-04-19T03:05:12.905624+0000","last_undegraded":"2024-04-19T03:05:12.905624+0000","last_fullsized":"2024-04-19T03:05:12.905624+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:38:26.843094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":84,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.424141+0000","last_change":"2024-04-19T03:04:50.277960+0000","last_active":"2024-04-19T03:05:11.424141+0000","last_peered":"2024-04-19T03:05:11.424141+0000","last_clean":"2024-04-19T03:05:11.424141+0000","last_became_active":"2024-04-19T03:04:50.277126+0000","last_became_peered":"2024-04-19T03:04:50.277126+0000","last_unstale":"2024-04-19T03:05:11.424141+0000","last_undegraded":"2024-04-19T03:05:11.424141+0000","last_fullsized":"2024-04-19T03:05:11.424141+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:08:49.146373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":71,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.431622+0000","last_change":"2024-04-19T03:05:11.429040+0000","last_active":"2024-04-19T03:05:11.431622+0000","last_peered":"2024-04-19T03:05:11.431622+0000","last_clean":"2024-04-19T03:05:11.431622+0000","last_became_active":"2024-04-19T03:05:11.428722+0000","last_became_peered":"2024-04-19T03:05:11.428722+0000","last_unstale":"2024-04-19T03:05:11.431622+0000","last_undegraded":"2024-04-19T03:05:11.431622+0000","last_fullsized":"2024-04-19T03:05:11.431622+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:52:42.089565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.770183+0000","last_change":"2024-04-19T03:04:50.627120+0000","last_active":"2024-04-19T03:05:11.770183+0000","last_peered":"2024-04-19T03:05:11.770183+0000","last_clean":"2024-04-19T03:05:11.770183+0000","last_became_active":"2024-04-19T03:04:50.625919+0000","last_became_peered":"2024-04-19T03:04:50.625919+0000","last_unstale":"2024-04-19T03:05:11.770183+0000","last_undegraded":"2024-04-19T03:05:11.770183+0000","last_fullsized":"2024-04-19T03:05:11.770183+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:56:19.822304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"20'2","reported_seq":32,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.769746+0000","last_change":"2024-04-19T03:04:50.627277+0000","last_active":"2024-04-19T03:05:11.769746+0000","last_peered":"2024-04-19T03:05:11.769746+0000","last_clean":"2024-04-19T03:05:11.769746+0000","last_became_active":"2024-04-19T03:04:50.625931+0000","last_became_peered":"2024-04-19T03:04:50.625931+0000","last_unstale":"2024-04-19T03:05:11.769746+0000","last_undegraded":"2024-04-19T03:05:11.769746+0000","last_fullsized":"2024-04-19T03:05:11.769746+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:30:32.408349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":86,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.431933+0000","last_change":"2024-04-19T03:05:11.430496+0000","last_active":"2024-04-19T03:05:11.431933+0000","last_peered":"2024-04-19T03:05:11.431933+0000","last_clean":"2024-04-19T03:05:11.431933+0000","last_became_active":"2024-04-19T03:05:11.430149+0000","last_became_peered":"2024-04-19T03:05:11.430149+0000","last_unstale":"2024-04-19T03:05:11.431933+0000","last_undegraded":"2024-04-19T03:05:11.431933+0000","last_fullsized":"2024-04-19T03:05:11.431933+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:55:24.828882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":85,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.424643+0000","last_change":"2024-04-19T03:04:50.278491+0000","last_active":"2024-04-19T03:05:11.424643+0000","last_peered":"2024-04-19T03:05:11.424643+0000","last_clean":"2024-04-19T03:05:11.424643+0000","last_became_active":"2024-04-19T03:04:50.277603+0000","last_became_peered":"2024-04-19T03:04:50.277603+0000","last_unstale":"2024-04-19T03:05:11.424643+0000","last_undegraded":"2024-04-19T03:05:11.424643+0000","last_fullsized":"2024-04-19T03:05:11.424643+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:04:26.211975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":71,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.426785+0000","last_change":"2024-04-19T03:01:15.015685+0000","last_active":"2024-04-19T03:05:11.426785+0000","last_peered":"2024-04-19T03:05:11.426785+0000","last_clean":"2024-04-19T03:05:11.426785+0000","last_became_active":"2024-04-19T03:01:15.014847+0000","last_became_peered":"2024-04-19T03:01:15.014847+0000","last_unstale":"2024-04-19T03:05:11.426785+0000","last_undegraded":"2024-04-19T03:05:11.426785+0000","last_fullsized":"2024-04-19T03:05:11.426785+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:51:06.208551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":51,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.418053+0000","last_change":"2024-04-19T03:05:09.392582+0000","last_active":"2024-04-19T03:05:11.418053+0000","last_peered":"2024-04-19T03:05:11.418053+0000","last_clean":"2024-04-19T03:05:11.418053+0000","last_became_active":"2024-04-19T03:05:09.391218+0000","last_became_peered":"2024-04-19T03:05:09.391218+0000","last_unstale":"2024-04-19T03:05:11.418053+0000","last_undegraded":"2024-04-19T03:05:11.418053+0000","last_fullsized":"2024-04-19T03:05:11.418053+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:06:11.612173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":71,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.426219+0000","last_change":"2024-04-19T03:01:15.014818+0000","last_active":"2024-04-19T03:05:11.426219+0000","last_peered":"2024-04-19T03:05:11.426219+0000","last_clean":"2024-04-19T03:05:11.426219+0000","last_became_active":"2024-04-19T03:01:15.014421+0000","last_became_peered":"2024-04-19T03:01:15.014421+0000","last_unstale":"2024-04-19T03:05:11.426219+0000","last_undegraded":"2024-04-19T03:05:11.426219+0000","last_fullsized":"2024-04-19T03:05:11.426219+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:16:20.475837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":78,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.417679+0000","last_change":"2024-04-19T03:05:09.395629+0000","last_active":"2024-04-19T03:05:11.417679+0000","last_peered":"2024-04-19T03:05:11.417679+0000","last_clean":"2024-04-19T03:05:11.417679+0000","last_became_active":"2024-04-19T03:05:09.395294+0000","last_became_peered":"2024-04-19T03:05:09.395294+0000","last_unstale":"2024-04-19T03:05:11.417679+0000","last_undegraded":"2024-04-19T03:05:11.417679+0000","last_fullsized":"2024-04-19T03:05:11.417679+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:38:03.627366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.770660+0000","last_change":"2024-04-19T03:04:50.617641+0000","last_active":"2024-04-19T03:05:11.770660+0000","last_peered":"2024-04-19T03:05:11.770660+0000","last_clean":"2024-04-19T03:05:11.770660+0000","last_became_active":"2024-04-19T03:04:50.617323+0000","last_became_peered":"2024-04-19T03:04:50.617323+0000","last_unstale":"2024-04-19T03:05:11.770660+0000","last_undegraded":"2024-04-19T03:05:11.770660+0000","last_fullsized":"2024-04-19T03:05:11.770660+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:26:09.566534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"14'157","reported_seq":279,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:12.903628+0000","last_change":"2024-04-19T03:05:11.429096+0000","last_active":"2024-04-19T03:05:12.903628+0000","last_peered":"2024-04-19T03:05:12.903628+0000","last_clean":"2024-04-19T03:05:12.903628+0000","last_became_active":"2024-04-19T03:05:11.426859+0000","last_became_peered":"2024-04-19T03:05:11.426859+0000","last_unstale":"2024-04-19T03:05:12.903628+0000","last_undegraded":"2024-04-19T03:05:12.903628+0000","last_fullsized":"2024-04-19T03:05:12.903628+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:06.516863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:06.516863+0000","last_clean_scrub_stamp":"2024-04-19T03:01:06.516863+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:34:42.107839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":87,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.425366+0000","last_change":"2024-04-19T03:04:50.277227+0000","last_active":"2024-04-19T03:05:11.425366+0000","last_peered":"2024-04-19T03:05:11.425366+0000","last_clean":"2024-04-19T03:05:11.425366+0000","last_became_active":"2024-04-19T03:04:50.276132+0000","last_became_peered":"2024-04-19T03:04:50.276132+0000","last_unstale":"2024-04-19T03:05:11.425366+0000","last_undegraded":"2024-04-19T03:05:11.425366+0000","last_fullsized":"2024-04-19T03:05:11.425366+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_clean_scrub_stamp":"2024-04-19T03:01:09.578660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:36:07.077967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":30,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.769259+0000","last_change":"2024-04-19T03:04:50.629139+0000","last_active":"2024-04-19T03:05:11.769259+0000","last_peered":"2024-04-19T03:05:11.769259+0000","last_clean":"2024-04-19T03:05:11.769259+0000","last_became_active":"2024-04-19T03:04:50.628741+0000","last_became_peered":"2024-04-19T03:04:50.628741+0000","last_unstale":"2024-04-19T03:05:11.769259+0000","last_undegraded":"2024-04-19T03:05:11.769259+0000","last_fullsized":"2024-04-19T03:05:11.769259+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:17:48.413908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":73,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.432341+0000","last_change":"2024-04-19T03:05:11.431455+0000","last_active":"2024-04-19T03:05:11.432341+0000","last_peered":"2024-04-19T03:05:11.432341+0000","last_clean":"2024-04-19T03:05:11.432341+0000","last_became_active":"2024-04-19T03:05:11.430881+0000","last_became_peered":"2024-04-19T03:05:11.430881+0000","last_unstale":"2024-04-19T03:05:11.432341+0000","last_undegraded":"2024-04-19T03:05:11.432341+0000","last_fullsized":"2024-04-19T03:05:11.432341+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:34:50.356698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":75,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.423910+0000","last_change":"2024-04-19T03:01:10.602194+0000","last_active":"2024-04-19T03:05:11.423910+0000","last_peered":"2024-04-19T03:05:11.423910+0000","last_clean":"2024-04-19T03:05:11.423910+0000","last_became_active":"2024-04-19T03:01:10.601381+0000","last_became_peered":"2024-04-19T03:01:10.601381+0000","last_unstale":"2024-04-19T03:05:11.423910+0000","last_undegraded":"2024-04-19T03:05:11.423910+0000","last_fullsized":"2024-04-19T03:05:11.423910+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_clean_scrub_stamp":"2024-04-19T03:01:09.578660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:42:26.594095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":30,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.768286+0000","last_change":"2024-04-19T03:04:50.634401+0000","last_active":"2024-04-19T03:05:11.768286+0000","last_peered":"2024-04-19T03:05:11.768286+0000","last_clean":"2024-04-19T03:05:11.768286+0000","last_became_active":"2024-04-19T03:04:50.631721+0000","last_became_peered":"2024-04-19T03:04:50.631721+0000","last_unstale":"2024-04-19T03:05:11.768286+0000","last_undegraded":"2024-04-19T03:05:11.768286+0000","last_fullsized":"2024-04-19T03:05:11.768286+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:40:03.144776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":77,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.419116+0000","last_change":"2024-04-19T03:05:09.395868+0000","last_active":"2024-04-19T03:05:11.419116+0000","last_peered":"2024-04-19T03:05:11.419116+0000","last_clean":"2024-04-19T03:05:11.419116+0000","last_became_active":"2024-04-19T03:05:09.395167+0000","last_became_peered":"2024-04-19T03:05:09.395167+0000","last_unstale":"2024-04-19T03:05:11.419116+0000","last_undegraded":"2024-04-19T03:05:11.419116+0000","last_fullsized":"2024-04-19T03:05:11.419116+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:40:00.629037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.768794+0000","last_change":"2024-04-19T03:04:50.635352+0000","last_active":"2024-04-19T03:05:11.768794+0000","last_peered":"2024-04-19T03:05:11.768794+0000","last_clean":"2024-04-19T03:05:11.768794+0000","last_became_active":"2024-04-19T03:04:50.633457+0000","last_became_peered":"2024-04-19T03:04:50.633457+0000","last_unstale":"2024-04-19T03:05:11.768794+0000","last_undegraded":"2024-04-19T03:05:11.768794+0000","last_fullsized":"2024-04-19T03:05:11.768794+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_clean_scrub_stamp":"2024-04-19T03:01:09.578660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:17:18.884148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":73,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:12.420122+0000","last_change":"2024-04-19T03:01:14.649068+0000","last_active":"2024-04-19T03:05:12.420122+0000","last_peered":"2024-04-19T03:05:12.420122+0000","last_clean":"2024-04-19T03:05:12.420122+0000","last_became_active":"2024-04-19T03:01:14.648082+0000","last_became_peered":"2024-04-19T03:01:14.648082+0000","last_unstale":"2024-04-19T03:05:12.420122+0000","last_undegraded":"2024-04-19T03:05:12.420122+0000","last_fullsized":"2024-04-19T03:05:12.420122+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:30:14.489117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.770578+0000","last_change":"2024-04-19T03:04:50.625932+0000","last_active":"2024-04-19T03:05:11.770578+0000","last_peered":"2024-04-19T03:05:11.770578+0000","last_clean":"2024-04-19T03:05:11.770578+0000","last_became_active":"2024-04-19T03:04:50.617628+0000","last_became_peered":"2024-04-19T03:04:50.617628+0000","last_unstale":"2024-04-19T03:05:11.770578+0000","last_undegraded":"2024-04-19T03:05:11.770578+0000","last_fullsized":"2024-04-19T03:05:11.770578+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:52:52.957579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":87,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.425331+0000","last_change":"2024-04-19T03:04:50.278737+0000","last_active":"2024-04-19T03:05:11.425331+0000","last_peered":"2024-04-19T03:05:11.425331+0000","last_clean":"2024-04-19T03:05:11.425331+0000","last_became_active":"2024-04-19T03:04:50.277804+0000","last_became_peered":"2024-04-19T03:04:50.277804+0000","last_unstale":"2024-04-19T03:05:11.425331+0000","last_undegraded":"2024-04-19T03:05:11.425331+0000","last_fullsized":"2024-04-19T03:05:11.425331+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_clean_scrub_stamp":"2024-04-19T03:01:09.578660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:00:20.440389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":85,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.424660+0000","last_change":"2024-04-19T03:04:50.277141+0000","last_active":"2024-04-19T03:05:11.424660+0000","last_peered":"2024-04-19T03:05:11.424660+0000","last_clean":"2024-04-19T03:05:11.424660+0000","last_became_active":"2024-04-19T03:04:50.275812+0000","last_became_peered":"2024-04-19T03:04:50.275812+0000","last_unstale":"2024-04-19T03:05:11.424660+0000","last_undegraded":"2024-04-19T03:05:11.424660+0000","last_fullsized":"2024-04-19T03:05:11.424660+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:16:29.209241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.769258+0000","last_change":"2024-04-19T03:04:50.616475+0000","last_active":"2024-04-19T03:05:11.769258+0000","last_peered":"2024-04-19T03:05:11.769258+0000","last_clean":"2024-04-19T03:05:11.769258+0000","last_became_active":"2024-04-19T03:04:50.614774+0000","last_became_peered":"2024-04-19T03:04:50.614774+0000","last_unstale":"2024-04-19T03:05:11.769258+0000","last_undegraded":"2024-04-19T03:05:11.769258+0000","last_fullsized":"2024-04-19T03:05:11.769258+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:51:07.142010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":71,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.431817+0000","last_change":"2024-04-19T03:05:11.430250+0000","last_active":"2024-04-19T03:05:11.431817+0000","last_peered":"2024-04-19T03:05:11.431817+0000","last_clean":"2024-04-19T03:05:11.431817+0000","last_became_active":"2024-04-19T03:05:11.429941+0000","last_became_peered":"2024-04-19T03:05:11.429941+0000","last_unstale":"2024-04-19T03:05:11.431817+0000","last_undegraded":"2024-04-19T03:05:11.431817+0000","last_fullsized":"2024-04-19T03:05:11.431817+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:28:17.231621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.769485+0000","last_change":"2024-04-19T03:04:50.615925+0000","last_active":"2024-04-19T03:05:11.769485+0000","last_peered":"2024-04-19T03:05:11.769485+0000","last_clean":"2024-04-19T03:05:11.769485+0000","last_became_active":"2024-04-19T03:04:50.614498+0000","last_became_peered":"2024-04-19T03:04:50.614498+0000","last_unstale":"2024-04-19T03:05:11.769485+0000","last_undegraded":"2024-04-19T03:05:11.769485+0000","last_fullsized":"2024-04-19T03:05:11.769485+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_clean_scrub_stamp":"2024-04-19T03:01:09.578660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:41:52.085259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":50,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.418555+0000","last_change":"2024-04-19T03:05:09.395750+0000","last_active":"2024-04-19T03:05:11.418555+0000","last_peered":"2024-04-19T03:05:11.418555+0000","last_clean":"2024-04-19T03:05:11.418555+0000","last_became_active":"2024-04-19T03:05:09.394024+0000","last_became_peered":"2024-04-19T03:05:09.394024+0000","last_unstale":"2024-04-19T03:05:11.418555+0000","last_undegraded":"2024-04-19T03:05:11.418555+0000","last_fullsized":"2024-04-19T03:05:11.418555+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:59:29.215722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":30,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.769894+0000","last_change":"2024-04-19T03:04:50.616970+0000","last_active":"2024-04-19T03:05:11.769894+0000","last_peered":"2024-04-19T03:05:11.769894+0000","last_clean":"2024-04-19T03:05:11.769894+0000","last_became_active":"2024-04-19T03:04:50.615238+0000","last_became_peered":"2024-04-19T03:04:50.615238+0000","last_unstale":"2024-04-19T03:05:11.769894+0000","last_undegraded":"2024-04-19T03:05:11.769894+0000","last_fullsized":"2024-04-19T03:05:11.769894+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:55:14.049921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":81,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.419750+0000","last_change":"2024-04-19T03:05:09.397542+0000","last_active":"2024-04-19T03:05:11.419750+0000","last_peered":"2024-04-19T03:05:11.419750+0000","last_clean":"2024-04-19T03:05:11.419750+0000","last_became_active":"2024-04-19T03:05:09.396378+0000","last_became_peered":"2024-04-19T03:05:09.396378+0000","last_unstale":"2024-04-19T03:05:11.419750+0000","last_undegraded":"2024-04-19T03:05:11.419750+0000","last_fullsized":"2024-04-19T03:05:11.419750+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_clean_scrub_stamp":"2024-04-19T03:01:09.578660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:22:24.885555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":50,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.418216+0000","last_change":"2024-04-19T03:05:09.392910+0000","last_active":"2024-04-19T03:05:11.418216+0000","last_peered":"2024-04-19T03:05:11.418216+0000","last_clean":"2024-04-19T03:05:11.418216+0000","last_became_active":"2024-04-19T03:05:09.392437+0000","last_became_peered":"2024-04-19T03:05:09.392437+0000","last_unstale":"2024-04-19T03:05:11.418216+0000","last_undegraded":"2024-04-19T03:05:11.418216+0000","last_fullsized":"2024-04-19T03:05:11.418216+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:23:28.203282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"20'2","reported_seq":32,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.769920+0000","last_change":"2024-04-19T03:04:50.611678+0000","last_active":"2024-04-19T03:05:11.769920+0000","last_peered":"2024-04-19T03:05:11.769920+0000","last_clean":"2024-04-19T03:05:11.769920+0000","last_became_active":"2024-04-19T03:04:50.611024+0000","last_became_peered":"2024-04-19T03:04:50.611024+0000","last_unstale":"2024-04-19T03:05:11.769920+0000","last_undegraded":"2024-04-19T03:05:11.769920+0000","last_fullsized":"2024-04-19T03:05:11.769920+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:08:43.323149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.769690+0000","last_change":"2024-04-19T03:04:50.616003+0000","last_active":"2024-04-19T03:05:11.769690+0000","last_peered":"2024-04-19T03:05:11.769690+0000","last_clean":"2024-04-19T03:05:11.769690+0000","last_became_active":"2024-04-19T03:04:50.612403+0000","last_became_peered":"2024-04-19T03:04:50.612403+0000","last_unstale":"2024-04-19T03:05:11.769690+0000","last_undegraded":"2024-04-19T03:05:11.769690+0000","last_fullsized":"2024-04-19T03:05:11.769690+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_clean_scrub_stamp":"2024-04-19T03:01:09.578660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:16:44.156874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.768524+0000","last_change":"2024-04-19T03:04:50.615936+0000","last_active":"2024-04-19T03:05:11.768524+0000","last_peered":"2024-04-19T03:05:11.768524+0000","last_clean":"2024-04-19T03:05:11.768524+0000","last_became_active":"2024-04-19T03:04:50.612987+0000","last_became_peered":"2024-04-19T03:04:50.612987+0000","last_unstale":"2024-04-19T03:05:11.768524+0000","last_undegraded":"2024-04-19T03:05:11.768524+0000","last_fullsized":"2024-04-19T03:05:11.768524+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:17:39.989639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"21'1","reported_seq":33,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.769909+0000","last_change":"2024-04-19T03:04:50.616200+0000","last_active":"2024-04-19T03:05:11.769909+0000","last_peered":"2024-04-19T03:05:11.769909+0000","last_clean":"2024-04-19T03:05:11.769909+0000","last_became_active":"2024-04-19T03:04:50.612697+0000","last_became_peered":"2024-04-19T03:04:50.612697+0000","last_unstale":"2024-04-19T03:05:11.769909+0000","last_undegraded":"2024-04-19T03:05:11.769909+0000","last_fullsized":"2024-04-19T03:05:11.769909+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:28:55.970411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":74,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.428574+0000","last_change":"2024-04-19T03:01:10.602274+0000","last_active":"2024-04-19T03:05:11.428574+0000","last_peered":"2024-04-19T03:05:11.428574+0000","last_clean":"2024-04-19T03:05:11.428574+0000","last_became_active":"2024-04-19T03:01:10.601487+0000","last_became_peered":"2024-04-19T03:01:10.601487+0000","last_unstale":"2024-04-19T03:05:11.428574+0000","last_undegraded":"2024-04-19T03:05:11.428574+0000","last_fullsized":"2024-04-19T03:05:11.428574+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_clean_scrub_stamp":"2024-04-19T03:01:09.578660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:26:16.712446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":71,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.417696+0000","last_change":"2024-04-19T03:01:15.018914+0000","last_active":"2024-04-19T03:05:11.417696+0000","last_peered":"2024-04-19T03:05:11.417696+0000","last_clean":"2024-04-19T03:05:11.417696+0000","last_became_active":"2024-04-19T03:01:15.018276+0000","last_became_peered":"2024-04-19T03:01:15.018276+0000","last_unstale":"2024-04-19T03:05:11.417696+0000","last_undegraded":"2024-04-19T03:05:11.417696+0000","last_fullsized":"2024-04-19T03:05:11.417696+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:40:59.453079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":76,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.431580+0000","last_change":"2024-04-19T03:05:11.430020+0000","last_active":"2024-04-19T03:05:11.431580+0000","last_peered":"2024-04-19T03:05:11.431580+0000","last_clean":"2024-04-19T03:05:11.431580+0000","last_became_active":"2024-04-19T03:05:11.429214+0000","last_became_peered":"2024-04-19T03:05:11.429214+0000","last_unstale":"2024-04-19T03:05:11.431580+0000","last_undegraded":"2024-04-19T03:05:11.431580+0000","last_fullsized":"2024-04-19T03:05:11.431580+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:06:34.608828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"20'6","reported_seq":83,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.432314+0000","last_change":"2024-04-19T03:05:11.431454+0000","last_active":"2024-04-19T03:05:11.432314+0000","last_peered":"2024-04-19T03:05:11.432314+0000","last_clean":"2024-04-19T03:05:11.432314+0000","last_became_active":"2024-04-19T03:05:11.430906+0000","last_became_peered":"2024-04-19T03:05:11.430906+0000","last_unstale":"2024-04-19T03:05:11.432314+0000","last_undegraded":"2024-04-19T03:05:11.432314+0000","last_fullsized":"2024-04-19T03:05:11.432314+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:24:28.008875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.768781+0000","last_change":"2024-04-19T03:04:50.628406+0000","last_active":"2024-04-19T03:05:11.768781+0000","last_peered":"2024-04-19T03:05:11.768781+0000","last_clean":"2024-04-19T03:05:11.768781+0000","last_became_active":"2024-04-19T03:04:50.627654+0000","last_became_peered":"2024-04-19T03:04:50.627654+0000","last_unstale":"2024-04-19T03:05:11.768781+0000","last_undegraded":"2024-04-19T03:05:11.768781+0000","last_fullsized":"2024-04-19T03:05:11.768781+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:17:57.101098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"20'3","reported_seq":54,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.419554+0000","last_change":"2024-04-19T03:05:09.398110+0000","last_active":"2024-04-19T03:05:11.419554+0000","last_peered":"2024-04-19T03:05:11.419554+0000","last_clean":"2024-04-19T03:05:11.419554+0000","last_became_active":"2024-04-19T03:05:09.397555+0000","last_became_peered":"2024-04-19T03:05:09.397555+0000","last_unstale":"2024-04-19T03:05:11.419554+0000","last_undegraded":"2024-04-19T03:05:11.419554+0000","last_fullsized":"2024-04-19T03:05:11.419554+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:27:00.017189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":71,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.431390+0000","last_change":"2024-04-19T03:05:11.429290+0000","last_active":"2024-04-19T03:05:11.431390+0000","last_peered":"2024-04-19T03:05:11.431390+0000","last_clean":"2024-04-19T03:05:11.431390+0000","last_became_active":"2024-04-19T03:05:11.428904+0000","last_became_peered":"2024-04-19T03:05:11.428904+0000","last_unstale":"2024-04-19T03:05:11.431390+0000","last_undegraded":"2024-04-19T03:05:11.431390+0000","last_fullsized":"2024-04-19T03:05:11.431390+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:16:47.688907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.768791+0000","last_change":"2024-04-19T03:04:50.634026+0000","last_active":"2024-04-19T03:05:11.768791+0000","last_peered":"2024-04-19T03:05:11.768791+0000","last_clean":"2024-04-19T03:05:11.768791+0000","last_became_active":"2024-04-19T03:04:50.630873+0000","last_became_peered":"2024-04-19T03:04:50.630873+0000","last_unstale":"2024-04-19T03:05:11.768791+0000","last_undegraded":"2024-04-19T03:05:11.768791+0000","last_fullsized":"2024-04-19T03:05:11.768791+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:41:25.674376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":30,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.770364+0000","last_change":"2024-04-19T03:04:50.612483+0000","last_active":"2024-04-19T03:05:11.770364+0000","last_peered":"2024-04-19T03:05:11.770364+0000","last_clean":"2024-04-19T03:05:11.770364+0000","last_became_active":"2024-04-19T03:04:50.612005+0000","last_became_peered":"2024-04-19T03:04:50.612005+0000","last_unstale":"2024-04-19T03:05:11.770364+0000","last_undegraded":"2024-04-19T03:05:11.770364+0000","last_fullsized":"2024-04-19T03:05:11.770364+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:56:45.629955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.768295+0000","last_change":"2024-04-19T03:04:50.616158+0000","last_active":"2024-04-19T03:05:11.768295+0000","last_peered":"2024-04-19T03:05:11.768295+0000","last_clean":"2024-04-19T03:05:11.768295+0000","last_became_active":"2024-04-19T03:04:50.613735+0000","last_became_peered":"2024-04-19T03:04:50.613735+0000","last_unstale":"2024-04-19T03:05:11.768295+0000","last_undegraded":"2024-04-19T03:05:11.768295+0000","last_fullsized":"2024-04-19T03:05:11.768295+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:25:58.128503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":50,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.419690+0000","last_change":"2024-04-19T03:05:09.394054+0000","last_active":"2024-04-19T03:05:11.419690+0000","last_peered":"2024-04-19T03:05:11.419690+0000","last_clean":"2024-04-19T03:05:11.419690+0000","last_became_active":"2024-04-19T03:05:09.392982+0000","last_became_peered":"2024-04-19T03:05:09.392982+0000","last_unstale":"2024-04-19T03:05:11.419690+0000","last_undegraded":"2024-04-19T03:05:11.419690+0000","last_fullsized":"2024-04-19T03:05:11.419690+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:09:41.580252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":30,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.768114+0000","last_change":"2024-04-19T03:04:50.616430+0000","last_active":"2024-04-19T03:05:11.768114+0000","last_peered":"2024-04-19T03:05:11.768114+0000","last_clean":"2024-04-19T03:05:11.768114+0000","last_became_active":"2024-04-19T03:04:50.613523+0000","last_became_peered":"2024-04-19T03:04:50.613523+0000","last_unstale":"2024-04-19T03:05:11.768114+0000","last_undegraded":"2024-04-19T03:05:11.768114+0000","last_fullsized":"2024-04-19T03:05:11.768114+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:22:43.207543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.770394+0000","last_change":"2024-04-19T03:04:50.616829+0000","last_active":"2024-04-19T03:05:11.770394+0000","last_peered":"2024-04-19T03:05:11.770394+0000","last_clean":"2024-04-19T03:05:11.770394+0000","last_became_active":"2024-04-19T03:04:50.616545+0000","last_became_peered":"2024-04-19T03:04:50.616545+0000","last_unstale":"2024-04-19T03:05:11.770394+0000","last_undegraded":"2024-04-19T03:05:11.770394+0000","last_fullsized":"2024-04-19T03:05:11.770394+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:07:32.515729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":30,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.768318+0000","last_change":"2024-04-19T03:04:50.634214+0000","last_active":"2024-04-19T03:05:11.768318+0000","last_peered":"2024-04-19T03:05:11.768318+0000","last_clean":"2024-04-19T03:05:11.768318+0000","last_became_active":"2024-04-19T03:04:50.631699+0000","last_became_peered":"2024-04-19T03:04:50.631699+0000","last_unstale":"2024-04-19T03:05:11.768318+0000","last_undegraded":"2024-04-19T03:05:11.768318+0000","last_fullsized":"2024-04-19T03:05:11.768318+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:43:10.184280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":53,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.418846+0000","last_change":"2024-04-19T03:05:02.361377+0000","last_active":"2024-04-19T03:05:11.418846+0000","last_peered":"2024-04-19T03:05:11.418846+0000","last_clean":"2024-04-19T03:05:11.418846+0000","last_became_active":"2024-04-19T03:05:02.360924+0000","last_became_peered":"2024-04-19T03:05:02.360924+0000","last_unstale":"2024-04-19T03:05:11.418846+0000","last_undegraded":"2024-04-19T03:05:11.418846+0000","last_fullsized":"2024-04-19T03:05:11.418846+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:39:56.940892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"20'1","reported_seq":79,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.418313+0000","last_change":"2024-04-19T03:05:09.395934+0000","last_active":"2024-04-19T03:05:11.418313+0000","last_peered":"2024-04-19T03:05:11.418313+0000","last_clean":"2024-04-19T03:05:11.418313+0000","last_became_active":"2024-04-19T03:05:09.395508+0000","last_became_peered":"2024-04-19T03:05:09.395508+0000","last_unstale":"2024-04-19T03:05:11.418313+0000","last_undegraded":"2024-04-19T03:05:11.418313+0000","last_fullsized":"2024-04-19T03:05:11.418313+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:50:26.858754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":77,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.418889+0000","last_change":"2024-04-19T03:05:09.396327+0000","last_active":"2024-04-19T03:05:11.418889+0000","last_peered":"2024-04-19T03:05:11.418889+0000","last_clean":"2024-04-19T03:05:11.418889+0000","last_became_active":"2024-04-19T03:05:09.395753+0000","last_became_peered":"2024-04-19T03:05:09.395753+0000","last_unstale":"2024-04-19T03:05:11.418889+0000","last_undegraded":"2024-04-19T03:05:11.418889+0000","last_fullsized":"2024-04-19T03:05:11.418889+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:00:12.449987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"20'1","reported_seq":87,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.418640+0000","last_change":"2024-04-19T03:05:09.398142+0000","last_active":"2024-04-19T03:05:11.418640+0000","last_peered":"2024-04-19T03:05:11.418640+0000","last_clean":"2024-04-19T03:05:11.418640+0000","last_became_active":"2024-04-19T03:05:09.397183+0000","last_became_peered":"2024-04-19T03:05:09.397183+0000","last_unstale":"2024-04-19T03:05:11.418640+0000","last_undegraded":"2024-04-19T03:05:11.418640+0000","last_fullsized":"2024-04-19T03:05:11.418640+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:45:32.978138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":86,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.431626+0000","last_change":"2024-04-19T03:05:11.430243+0000","last_active":"2024-04-19T03:05:11.431626+0000","last_peered":"2024-04-19T03:05:11.431626+0000","last_clean":"2024-04-19T03:05:11.431626+0000","last_became_active":"2024-04-19T03:05:11.429247+0000","last_became_peered":"2024-04-19T03:05:11.429247+0000","last_unstale":"2024-04-19T03:05:11.431626+0000","last_undegraded":"2024-04-19T03:05:11.431626+0000","last_fullsized":"2024-04-19T03:05:11.431626+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:41:16.915398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"20'2","reported_seq":87,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.426718+0000","last_change":"2024-04-19T03:04:50.276105+0000","last_active":"2024-04-19T03:05:11.426718+0000","last_peered":"2024-04-19T03:05:11.426718+0000","last_clean":"2024-04-19T03:05:11.426718+0000","last_became_active":"2024-04-19T03:04:50.275533+0000","last_became_peered":"2024-04-19T03:04:50.275533+0000","last_unstale":"2024-04-19T03:05:11.426718+0000","last_undegraded":"2024-04-19T03:05:11.426718+0000","last_fullsized":"2024-04-19T03:05:11.426718+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:38:13.683481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":84,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.424718+0000","last_change":"2024-04-19T03:04:50.278401+0000","last_active":"2024-04-19T03:05:11.424718+0000","last_peered":"2024-04-19T03:05:11.424718+0000","last_clean":"2024-04-19T03:05:11.424718+0000","last_became_active":"2024-04-19T03:04:50.277348+0000","last_became_peered":"2024-04-19T03:04:50.277348+0000","last_unstale":"2024-04-19T03:05:11.424718+0000","last_undegraded":"2024-04-19T03:05:11.424718+0000","last_fullsized":"2024-04-19T03:05:11.424718+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:19:35.891753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"20'2","reported_seq":56,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.419282+0000","last_change":"2024-04-19T03:05:02.363600+0000","last_active":"2024-04-19T03:05:11.419282+0000","last_peered":"2024-04-19T03:05:11.419282+0000","last_clean":"2024-04-19T03:05:11.419282+0000","last_became_active":"2024-04-19T03:05:02.363167+0000","last_became_peered":"2024-04-19T03:05:02.363167+0000","last_unstale":"2024-04-19T03:05:11.419282+0000","last_undegraded":"2024-04-19T03:05:11.419282+0000","last_fullsized":"2024-04-19T03:05:11.419282+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:49:54.288998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":77,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.418217+0000","last_change":"2024-04-19T03:05:09.394500+0000","last_active":"2024-04-19T03:05:11.418217+0000","last_peered":"2024-04-19T03:05:11.418217+0000","last_clean":"2024-04-19T03:05:11.418217+0000","last_became_active":"2024-04-19T03:05:09.393975+0000","last_became_peered":"2024-04-19T03:05:09.393975+0000","last_unstale":"2024-04-19T03:05:11.418217+0000","last_undegraded":"2024-04-19T03:05:11.418217+0000","last_fullsized":"2024-04-19T03:05:11.418217+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:00:55.706542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"20'1","reported_seq":32,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.770844+0000","last_change":"2024-04-19T03:04:50.627670+0000","last_active":"2024-04-19T03:05:11.770844+0000","last_peered":"2024-04-19T03:05:11.770844+0000","last_clean":"2024-04-19T03:05:11.770844+0000","last_became_active":"2024-04-19T03:04:50.627304+0000","last_became_peered":"2024-04-19T03:04:50.627304+0000","last_unstale":"2024-04-19T03:05:11.770844+0000","last_undegraded":"2024-04-19T03:05:11.770844+0000","last_fullsized":"2024-04-19T03:05:11.770844+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:29:08.875911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":84,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.423682+0000","last_change":"2024-04-19T03:04:50.279334+0000","last_active":"2024-04-19T03:05:11.423682+0000","last_peered":"2024-04-19T03:05:11.423682+0000","last_clean":"2024-04-19T03:05:11.423682+0000","last_became_active":"2024-04-19T03:04:50.278874+0000","last_became_peered":"2024-04-19T03:04:50.278874+0000","last_unstale":"2024-04-19T03:05:11.423682+0000","last_undegraded":"2024-04-19T03:05:11.423682+0000","last_fullsized":"2024-04-19T03:05:11.423682+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:51:33.707741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"20'4","reported_seq":32,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.770772+0000","last_change":"2024-04-19T03:04:50.627070+0000","last_active":"2024-04-19T03:05:11.770772+0000","last_peered":"2024-04-19T03:05:11.770772+0000","last_clean":"2024-04-19T03:05:11.770772+0000","last_became_active":"2024-04-19T03:04:50.626334+0000","last_became_peered":"2024-04-19T03:04:50.626334+0000","last_unstale":"2024-04-19T03:05:11.770772+0000","last_undegraded":"2024-04-19T03:05:11.770772+0000","last_fullsized":"2024-04-19T03:05:11.770772+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:24:58.586175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5289,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":14482,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":10,"seq":42949673017,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":220712,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":219774,"kb_avail":94151128,"statfs":{"total":96636764160,"available":96410755072,"internally_reserved":0,"allocated":946176,"data_stored":929795,"data_compressed":7241,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":225049030},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 19 03:02:08 2024","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"last":0.53400000000000003}]},{"osd":1,"last update":"Fri Apr 19 03:04:11 2024","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.19900000000000001,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.87,"5min":2.5030000000000001,"15min":2.5030000000000001},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.57099999999999995,"15min":0.56299999999999994},"min":{"1min":0.23999999999999999,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.90400000000000003,"5min":2.6379999999999999,"15min":2.6379999999999999},"last":0.65000000000000002}]}]},{"osd":1,"up_from":10,"seq":42949673016,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":202668,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":201726,"kb_avail":94169172,"statfs":{"total":96636764160,"available":96429232128,"internally_reserved":0,"allocated":942080,"data_stored":931342,"data_compressed":7241,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":206567878},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 19 03:02:04 2024","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.58699999999999997}]},{"osd":2,"last update":"Fri Apr 19 03:05:08 2024","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.501,"15min":0.50800000000000001},"min":{"1min":0.46999999999999997,"5min":0.224,"15min":0.224},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.50700000000000001,"15min":0.52100000000000002},"min":{"1min":0.52100000000000002,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.94899999999999995}]}]},{"osd":0,"up_from":71,"seq":304942678023,"num_pgs":73,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47712,"kb_used_data":848,"kb_used_omap":6,"kb_used_meta":46841,"kb_avail":94324128,"statfs":{"total":96636764160,"available":96587907072,"internally_reserved":0,"allocated":868352,"data_stored":339844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6883,"internal_metadata":47965469},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61799999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69199999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":7241,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":7241,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5289,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-19T03:05:16.957 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-19T03:05:17.257 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-19T03:05:17.257 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":81,"fsid":"c6cc8e09-11d4-48de-9a6c-4d70ed3c3789","created":"2024-04-19T03:00:53.746146+0000","modified":"2024-04-19T03:05:12.407719+0000","last_up_change":"2024-04-19T03:04:49.214889+0000","last_in_change":"2024-04-19T03:00:54.640172+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-19T03:01:05.999591+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-19T03:01:09.051757+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-19T03:01:13.479163+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-19T03:01:13.992441+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"05ecb884-2c30-44f7-aa14-90154f9bbe9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":42,"up_from":71,"up_thru":74,"down_at":43,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":1402},{"type":"v1","addr":"172.21.15.97:6801","nonce":1402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":1402},{"type":"v1","addr":"172.21.15.97:6803","nonce":1402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":1402},{"type":"v1","addr":"172.21.15.97:6807","nonce":1402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6804","nonce":1402},{"type":"v1","addr":"172.21.15.97:6805","nonce":1402}]},"public_addr":"172.21.15.97:6801/1402","cluster_addr":"172.21.15.97:6803/1402","heartbeat_back_addr":"172.21.15.97:6807/1402","heartbeat_front_addr":"172.21.15.97:6805/1402","state":["exists","up"]},{"osd":1,"uuid":"efc873e0-69c3-4a57-8ee5-41f836b65f47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":18145},{"type":"v1","addr":"172.21.15.134:6801","nonce":18145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":18145},{"type":"v1","addr":"172.21.15.134:6803","nonce":18145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":18145},{"type":"v1","addr":"172.21.15.134:6807","nonce":18145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":18145},{"type":"v1","addr":"172.21.15.134:6805","nonce":18145}]},"public_addr":"172.21.15.134:6801/18145","cluster_addr":"172.21.15.134:6803/18145","heartbeat_back_addr":"172.21.15.134:6807/18145","heartbeat_front_addr":"172.21.15.134:6805/18145","state":["exists","up"]},{"osd":2,"uuid":"229278a0-dd93-4234-9065-e4f2f6188ef2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":18223},{"type":"v1","addr":"172.21.15.144:6801","nonce":18223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":18223},{"type":"v1","addr":"172.21.15.144:6803","nonce":18223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":18223},{"type":"v1","addr":"172.21.15.144:6807","nonce":18223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":18223},{"type":"v1","addr":"172.21.15.144:6805","nonce":18223}]},"public_addr":"172.21.15.144:6801/18223","cluster_addr":"172.21.15.144:6803/18223","heartbeat_back_addr":"172.21.15.144:6807/18223","heartbeat_front_addr":"172.21.15.144:6805/18223","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T03:00:59.302574+0000","dead_epoch":42},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T03:01:00.064174+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T03:00:59.735582+0000","dead_epoch":0}],"pg_upmap":[{"pgid":"3.1b","osds":[1,0]}],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-19T03:05:18.276 INFO:tasks.ceph:Scrubbing osd.0 2024-04-19T03:05:18.276 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-04-19T03:05:18.440 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-04-19T03:05:18.440 INFO:teuthology.orchestra.run.smithi096.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) osd_delete_sleep = '' osd_delete_sleep_hdd = '' osd_delete_sleep_hybrid = '' osd_delete_sleep_ssd = '' osd_max_backfills = '' osd_pg_delete_cost = '' (not observed, change may require restart) osd_recovery_max_active = '' osd_recovery_max_active_hdd = '' osd_recovery_max_active_ssd = '' osd_recovery_sleep = '' osd_recovery_sleep_hdd = '' osd_recovery_sleep_hybrid = '' osd_recovery_sleep_ssd = '' osd_scrub_sleep = '' osd_snap_trim_sleep = '' osd_snap_trim_sleep_hdd = '' osd_snap_trim_sleep_hybrid = '' osd_snap_trim_sleep_ssd = '' " 2024-04-19T03:05:18.441 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-04-19T03:05:18.455 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-04-19T03:05:18.760 INFO:teuthology.orchestra.run.smithi096.stderr:instructed osd(s) 0 to deep-scrub 2024-04-19T03:05:18.770 INFO:tasks.ceph:Scrubbing osd.1 2024-04-19T03:05:18.770 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-04-19T03:05:18.919 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-04-19T03:05:18.920 INFO:teuthology.orchestra.run.smithi096.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-19T03:05:18.920 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-04-19T03:05:18.932 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-04-19T03:05:19.243 INFO:teuthology.orchestra.run.smithi096.stderr:instructed osd(s) 1 to deep-scrub 2024-04-19T03:05:19.253 INFO:tasks.ceph:Scrubbing osd.2 2024-04-19T03:05:19.253 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-04-19T03:05:19.401 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2024-04-19T03:05:19.401 INFO:teuthology.orchestra.run.smithi096.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-19T03:05:19.402 INFO:teuthology.orchestra.run.smithi096.stdout:} 2024-04-19T03:05:19.414 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-04-19T03:05:19.717 INFO:teuthology.orchestra.run.smithi096.stderr:instructed osd(s) 2 to deep-scrub 2024-04-19T03:05:19.732 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-19T03:05:20.037 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-19T03:05:20.040 INFO:teuthology.orchestra.run.smithi096.stderr:dumped all 2024-04-19T03:05:20.054 INFO:teuthology.orchestra.run.smithi096.stdout:{"pg_ready":true,"pg_map":{"version":204,"stamp":"2024-04-19T03:05:18.052121+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":471092,"kb_used_data":2692,"kb_used_omap":9,"kb_used_meta":468342,"kb_avail":282644428,"statfs":{"total":289910292480,"available":289427894272,"internally_reserved":0,"allocated":2756608,"data_stored":2200981,"data_compressed":14482,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":10071,"internal_metadata":479582377},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.649905"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":77,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.419575+0000","last_change":"2024-04-19T03:05:09.396661+0000","last_active":"2024-04-19T03:05:11.419575+0000","last_peered":"2024-04-19T03:05:11.419575+0000","last_clean":"2024-04-19T03:05:11.419575+0000","last_became_active":"2024-04-19T03:05:09.396279+0000","last_became_peered":"2024-04-19T03:05:09.396279+0000","last_unstale":"2024-04-19T03:05:11.419575+0000","last_undegraded":"2024-04-19T03:05:11.419575+0000","last_fullsized":"2024-04-19T03:05:11.419575+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:20:04.982562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":84,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.418854+0000","last_change":"2024-04-19T03:04:50.278334+0000","last_active":"2024-04-19T03:05:11.418854+0000","last_peered":"2024-04-19T03:05:11.418854+0000","last_clean":"2024-04-19T03:05:11.418854+0000","last_became_active":"2024-04-19T03:04:50.277848+0000","last_became_peered":"2024-04-19T03:04:50.277848+0000","last_unstale":"2024-04-19T03:05:11.418854+0000","last_undegraded":"2024-04-19T03:05:11.418854+0000","last_fullsized":"2024-04-19T03:05:11.418854+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:57:39.589383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":71,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.425858+0000","last_change":"2024-04-19T03:01:15.015884+0000","last_active":"2024-04-19T03:05:11.425858+0000","last_peered":"2024-04-19T03:05:11.425858+0000","last_clean":"2024-04-19T03:05:11.425858+0000","last_became_active":"2024-04-19T03:01:15.014599+0000","last_became_peered":"2024-04-19T03:01:15.014599+0000","last_unstale":"2024-04-19T03:05:11.425858+0000","last_undegraded":"2024-04-19T03:05:11.425858+0000","last_fullsized":"2024-04-19T03:05:11.425858+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:35:19.436344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":85,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:12.904164+0000","last_change":"2024-04-19T03:04:50.275017+0000","last_active":"2024-04-19T03:05:12.904164+0000","last_peered":"2024-04-19T03:05:12.904164+0000","last_clean":"2024-04-19T03:05:12.904164+0000","last_became_active":"2024-04-19T03:04:50.274600+0000","last_became_peered":"2024-04-19T03:04:50.274600+0000","last_unstale":"2024-04-19T03:05:12.904164+0000","last_undegraded":"2024-04-19T03:05:12.904164+0000","last_fullsized":"2024-04-19T03:05:12.904164+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:21:44.006351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":77,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.418426+0000","last_change":"2024-04-19T03:05:09.397682+0000","last_active":"2024-04-19T03:05:11.418426+0000","last_peered":"2024-04-19T03:05:11.418426+0000","last_clean":"2024-04-19T03:05:11.418426+0000","last_became_active":"2024-04-19T03:05:09.395929+0000","last_became_peered":"2024-04-19T03:05:09.395929+0000","last_unstale":"2024-04-19T03:05:11.418426+0000","last_undegraded":"2024-04-19T03:05:11.418426+0000","last_fullsized":"2024-04-19T03:05:11.418426+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:57:03.617383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":70,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.430738+0000","last_change":"2024-04-19T03:05:11.428461+0000","last_active":"2024-04-19T03:05:11.430738+0000","last_peered":"2024-04-19T03:05:11.430738+0000","last_clean":"2024-04-19T03:05:11.430738+0000","last_became_active":"2024-04-19T03:05:11.426617+0000","last_became_peered":"2024-04-19T03:05:11.426617+0000","last_unstale":"2024-04-19T03:05:11.430738+0000","last_undegraded":"2024-04-19T03:05:11.430738+0000","last_fullsized":"2024-04-19T03:05:11.430738+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:18:53.462220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":70,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.429888+0000","last_change":"2024-04-19T03:05:11.424581+0000","last_active":"2024-04-19T03:05:11.429888+0000","last_peered":"2024-04-19T03:05:11.429888+0000","last_clean":"2024-04-19T03:05:11.429888+0000","last_became_active":"2024-04-19T03:05:11.422727+0000","last_became_peered":"2024-04-19T03:05:11.422727+0000","last_unstale":"2024-04-19T03:05:11.429888+0000","last_undegraded":"2024-04-19T03:05:11.429888+0000","last_fullsized":"2024-04-19T03:05:11.429888+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:48:53.502161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":84,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.422960+0000","last_change":"2024-04-19T03:04:50.261359+0000","last_active":"2024-04-19T03:05:11.422960+0000","last_peered":"2024-04-19T03:05:11.422960+0000","last_clean":"2024-04-19T03:05:11.422960+0000","last_became_active":"2024-04-19T03:04:50.261155+0000","last_became_peered":"2024-04-19T03:04:50.261155+0000","last_unstale":"2024-04-19T03:05:11.422960+0000","last_undegraded":"2024-04-19T03:05:11.422960+0000","last_fullsized":"2024-04-19T03:05:11.422960+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:09:37.911709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.770311+0000","last_change":"2024-04-19T03:04:50.611854+0000","last_active":"2024-04-19T03:05:11.770311+0000","last_peered":"2024-04-19T03:05:11.770311+0000","last_clean":"2024-04-19T03:05:11.770311+0000","last_became_active":"2024-04-19T03:04:50.611400+0000","last_became_peered":"2024-04-19T03:04:50.611400+0000","last_unstale":"2024-04-19T03:05:11.770311+0000","last_undegraded":"2024-04-19T03:05:11.770311+0000","last_fullsized":"2024-04-19T03:05:11.770311+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:33:58.731162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":84,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.418911+0000","last_change":"2024-04-19T03:04:50.278337+0000","last_active":"2024-04-19T03:05:11.418911+0000","last_peered":"2024-04-19T03:05:11.418911+0000","last_clean":"2024-04-19T03:05:11.418911+0000","last_became_active":"2024-04-19T03:04:50.277899+0000","last_became_peered":"2024-04-19T03:04:50.277899+0000","last_unstale":"2024-04-19T03:05:11.418911+0000","last_undegraded":"2024-04-19T03:05:11.418911+0000","last_fullsized":"2024-04-19T03:05:11.418911+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:32:49.546687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":70,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.431939+0000","last_change":"2024-04-19T03:05:11.430574+0000","last_active":"2024-04-19T03:05:11.431939+0000","last_peered":"2024-04-19T03:05:11.431939+0000","last_clean":"2024-04-19T03:05:11.431939+0000","last_became_active":"2024-04-19T03:05:11.430243+0000","last_became_peered":"2024-04-19T03:05:11.430243+0000","last_unstale":"2024-04-19T03:05:11.431939+0000","last_undegraded":"2024-04-19T03:05:11.431939+0000","last_fullsized":"2024-04-19T03:05:11.431939+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:37:37.372803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":50,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.418696+0000","last_change":"2024-04-19T03:05:09.394405+0000","last_active":"2024-04-19T03:05:11.418696+0000","last_peered":"2024-04-19T03:05:11.418696+0000","last_clean":"2024-04-19T03:05:11.418696+0000","last_became_active":"2024-04-19T03:05:09.392822+0000","last_became_peered":"2024-04-19T03:05:09.392822+0000","last_unstale":"2024-04-19T03:05:11.418696+0000","last_undegraded":"2024-04-19T03:05:11.418696+0000","last_fullsized":"2024-04-19T03:05:11.418696+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:33:27.982343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":77,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.417984+0000","last_change":"2024-04-19T03:05:09.397000+0000","last_active":"2024-04-19T03:05:11.417984+0000","last_peered":"2024-04-19T03:05:11.417984+0000","last_clean":"2024-04-19T03:05:11.417984+0000","last_became_active":"2024-04-19T03:05:09.395749+0000","last_became_peered":"2024-04-19T03:05:09.395749+0000","last_unstale":"2024-04-19T03:05:11.417984+0000","last_undegraded":"2024-04-19T03:05:11.417984+0000","last_fullsized":"2024-04-19T03:05:11.417984+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:21:26.436890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":71,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.423871+0000","last_change":"2024-04-19T03:01:15.010960+0000","last_active":"2024-04-19T03:05:11.423871+0000","last_peered":"2024-04-19T03:05:11.423871+0000","last_clean":"2024-04-19T03:05:11.423871+0000","last_became_active":"2024-04-19T03:01:15.010472+0000","last_became_peered":"2024-04-19T03:01:15.010472+0000","last_unstale":"2024-04-19T03:05:11.423871+0000","last_undegraded":"2024-04-19T03:05:11.423871+0000","last_fullsized":"2024-04-19T03:05:11.423871+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:21:36.129346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":73,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.430581+0000","last_change":"2024-04-19T03:05:11.428285+0000","last_active":"2024-04-19T03:05:11.430581+0000","last_peered":"2024-04-19T03:05:11.430581+0000","last_clean":"2024-04-19T03:05:11.430581+0000","last_became_active":"2024-04-19T03:05:11.425921+0000","last_became_peered":"2024-04-19T03:05:11.425921+0000","last_unstale":"2024-04-19T03:05:11.430581+0000","last_undegraded":"2024-04-19T03:05:11.430581+0000","last_fullsized":"2024-04-19T03:05:11.430581+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:38:49.965677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":70,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.430778+0000","last_change":"2024-04-19T03:05:11.429030+0000","last_active":"2024-04-19T03:05:11.430778+0000","last_peered":"2024-04-19T03:05:11.430778+0000","last_clean":"2024-04-19T03:05:11.430778+0000","last_became_active":"2024-04-19T03:05:11.425921+0000","last_became_peered":"2024-04-19T03:05:11.425921+0000","last_unstale":"2024-04-19T03:05:11.430778+0000","last_undegraded":"2024-04-19T03:05:11.430778+0000","last_fullsized":"2024-04-19T03:05:11.430778+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:53:07.351904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.770126+0000","last_change":"2024-04-19T03:04:50.611757+0000","last_active":"2024-04-19T03:05:11.770126+0000","last_peered":"2024-04-19T03:05:11.770126+0000","last_clean":"2024-04-19T03:05:11.770126+0000","last_became_active":"2024-04-19T03:04:50.611392+0000","last_became_peered":"2024-04-19T03:04:50.611392+0000","last_unstale":"2024-04-19T03:05:11.770126+0000","last_undegraded":"2024-04-19T03:05:11.770126+0000","last_fullsized":"2024-04-19T03:05:11.770126+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:51:50.768612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":77,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.419368+0000","last_change":"2024-04-19T03:05:09.397114+0000","last_active":"2024-04-19T03:05:11.419368+0000","last_peered":"2024-04-19T03:05:11.419368+0000","last_clean":"2024-04-19T03:05:11.419368+0000","last_became_active":"2024-04-19T03:05:09.395682+0000","last_became_peered":"2024-04-19T03:05:09.395682+0000","last_unstale":"2024-04-19T03:05:11.419368+0000","last_undegraded":"2024-04-19T03:05:11.419368+0000","last_fullsized":"2024-04-19T03:05:11.419368+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:55:53.897442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.769589+0000","last_change":"2024-04-19T03:04:50.613858+0000","last_active":"2024-04-19T03:05:11.769589+0000","last_peered":"2024-04-19T03:05:11.769589+0000","last_clean":"2024-04-19T03:05:11.769589+0000","last_became_active":"2024-04-19T03:04:50.613481+0000","last_became_peered":"2024-04-19T03:04:50.613481+0000","last_unstale":"2024-04-19T03:05:11.769589+0000","last_undegraded":"2024-04-19T03:05:11.769589+0000","last_fullsized":"2024-04-19T03:05:11.769589+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:55:45.686937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":86,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.432386+0000","last_change":"2024-04-19T03:05:11.431719+0000","last_active":"2024-04-19T03:05:11.432386+0000","last_peered":"2024-04-19T03:05:11.432386+0000","last_clean":"2024-04-19T03:05:11.432386+0000","last_became_active":"2024-04-19T03:05:11.431352+0000","last_became_peered":"2024-04-19T03:05:11.431352+0000","last_unstale":"2024-04-19T03:05:11.432386+0000","last_undegraded":"2024-04-19T03:05:11.432386+0000","last_fullsized":"2024-04-19T03:05:11.432386+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:54:50.052460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":84,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.424051+0000","last_change":"2024-04-19T03:04:50.276678+0000","last_active":"2024-04-19T03:05:11.424051+0000","last_peered":"2024-04-19T03:05:11.424051+0000","last_clean":"2024-04-19T03:05:11.424051+0000","last_became_active":"2024-04-19T03:04:50.275510+0000","last_became_peered":"2024-04-19T03:04:50.275510+0000","last_unstale":"2024-04-19T03:05:11.424051+0000","last_undegraded":"2024-04-19T03:05:11.424051+0000","last_fullsized":"2024-04-19T03:05:11.424051+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:17:24.832346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":71,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.417759+0000","last_change":"2024-04-19T03:01:15.020108+0000","last_active":"2024-04-19T03:05:11.417759+0000","last_peered":"2024-04-19T03:05:11.417759+0000","last_clean":"2024-04-19T03:05:11.417759+0000","last_became_active":"2024-04-19T03:01:15.018978+0000","last_became_peered":"2024-04-19T03:01:15.018978+0000","last_unstale":"2024-04-19T03:05:11.417759+0000","last_undegraded":"2024-04-19T03:05:11.417759+0000","last_fullsized":"2024-04-19T03:05:11.417759+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:30:22.360053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.768605+0000","last_change":"2024-04-19T03:04:50.633855+0000","last_active":"2024-04-19T03:05:11.768605+0000","last_peered":"2024-04-19T03:05:11.768605+0000","last_clean":"2024-04-19T03:05:11.768605+0000","last_became_active":"2024-04-19T03:04:50.630948+0000","last_became_peered":"2024-04-19T03:04:50.630948+0000","last_unstale":"2024-04-19T03:05:11.768605+0000","last_undegraded":"2024-04-19T03:05:11.768605+0000","last_fullsized":"2024-04-19T03:05:11.768605+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:41:31.676439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":77,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.417346+0000","last_change":"2024-04-19T03:05:09.391159+0000","last_active":"2024-04-19T03:05:11.417346+0000","last_peered":"2024-04-19T03:05:11.417346+0000","last_clean":"2024-04-19T03:05:11.417346+0000","last_became_active":"2024-04-19T03:05:09.390922+0000","last_became_peered":"2024-04-19T03:05:09.390922+0000","last_unstale":"2024-04-19T03:05:11.417346+0000","last_undegraded":"2024-04-19T03:05:11.417346+0000","last_fullsized":"2024-04-19T03:05:11.417346+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:32:01.116711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":50,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.419689+0000","last_change":"2024-04-19T03:05:09.393923+0000","last_active":"2024-04-19T03:05:11.419689+0000","last_peered":"2024-04-19T03:05:11.419689+0000","last_clean":"2024-04-19T03:05:11.419689+0000","last_became_active":"2024-04-19T03:05:09.393108+0000","last_became_peered":"2024-04-19T03:05:09.393108+0000","last_unstale":"2024-04-19T03:05:11.419689+0000","last_undegraded":"2024-04-19T03:05:11.419689+0000","last_fullsized":"2024-04-19T03:05:11.419689+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:29:37.674820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.770633+0000","last_change":"2024-04-19T03:04:50.626923+0000","last_active":"2024-04-19T03:05:11.770633+0000","last_peered":"2024-04-19T03:05:11.770633+0000","last_clean":"2024-04-19T03:05:11.770633+0000","last_became_active":"2024-04-19T03:04:50.617603+0000","last_became_peered":"2024-04-19T03:04:50.617603+0000","last_unstale":"2024-04-19T03:05:11.770633+0000","last_undegraded":"2024-04-19T03:05:11.770633+0000","last_fullsized":"2024-04-19T03:05:11.770633+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:26:56.826024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":38,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:12.905140+0000","last_change":"2024-04-19T03:05:11.431713+0000","last_active":"2024-04-19T03:05:12.905140+0000","last_peered":"2024-04-19T03:05:12.905140+0000","last_clean":"2024-04-19T03:05:12.905140+0000","last_became_active":"2024-04-19T03:05:11.431129+0000","last_became_peered":"2024-04-19T03:05:11.431129+0000","last_unstale":"2024-04-19T03:05:12.905140+0000","last_undegraded":"2024-04-19T03:05:12.905140+0000","last_fullsized":"2024-04-19T03:05:12.905140+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:00:07.623146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":71,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.419121+0000","last_change":"2024-04-19T03:01:15.020098+0000","last_active":"2024-04-19T03:05:11.419121+0000","last_peered":"2024-04-19T03:05:11.419121+0000","last_clean":"2024-04-19T03:05:11.419121+0000","last_became_active":"2024-04-19T03:01:15.019064+0000","last_became_peered":"2024-04-19T03:01:15.019064+0000","last_unstale":"2024-04-19T03:05:11.419121+0000","last_undegraded":"2024-04-19T03:05:11.419121+0000","last_fullsized":"2024-04-19T03:05:11.419121+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:50:06.490191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.769012+0000","last_change":"2024-04-19T03:04:50.616823+0000","last_active":"2024-04-19T03:05:11.769012+0000","last_peered":"2024-04-19T03:05:11.769012+0000","last_clean":"2024-04-19T03:05:11.769012+0000","last_became_active":"2024-04-19T03:04:50.616550+0000","last_became_peered":"2024-04-19T03:04:50.616550+0000","last_unstale":"2024-04-19T03:05:11.769012+0000","last_undegraded":"2024-04-19T03:05:11.769012+0000","last_fullsized":"2024-04-19T03:05:11.769012+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:46:25.096677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":50,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.418068+0000","last_change":"2024-04-19T03:05:09.394074+0000","last_active":"2024-04-19T03:05:11.418068+0000","last_peered":"2024-04-19T03:05:11.418068+0000","last_clean":"2024-04-19T03:05:11.418068+0000","last_became_active":"2024-04-19T03:05:09.393178+0000","last_became_peered":"2024-04-19T03:05:09.393178+0000","last_unstale":"2024-04-19T03:05:11.418068+0000","last_undegraded":"2024-04-19T03:05:11.418068+0000","last_fullsized":"2024-04-19T03:05:11.418068+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:53:27.695302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.769044+0000","last_change":"2024-04-19T03:04:50.635141+0000","last_active":"2024-04-19T03:05:11.769044+0000","last_peered":"2024-04-19T03:05:11.769044+0000","last_clean":"2024-04-19T03:05:11.769044+0000","last_became_active":"2024-04-19T03:04:50.633033+0000","last_became_peered":"2024-04-19T03:04:50.633033+0000","last_unstale":"2024-04-19T03:05:11.769044+0000","last_undegraded":"2024-04-19T03:05:11.769044+0000","last_fullsized":"2024-04-19T03:05:11.769044+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:42:01.712749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":84,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.423252+0000","last_change":"2024-04-19T03:04:50.279507+0000","last_active":"2024-04-19T03:05:11.423252+0000","last_peered":"2024-04-19T03:05:11.423252+0000","last_clean":"2024-04-19T03:05:11.423252+0000","last_became_active":"2024-04-19T03:04:50.278996+0000","last_became_peered":"2024-04-19T03:04:50.278996+0000","last_unstale":"2024-04-19T03:05:11.423252+0000","last_undegraded":"2024-04-19T03:05:11.423252+0000","last_fullsized":"2024-04-19T03:05:11.423252+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:09:09.816660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":77,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.419122+0000","last_change":"2024-04-19T03:05:09.396527+0000","last_active":"2024-04-19T03:05:11.419122+0000","last_peered":"2024-04-19T03:05:11.419122+0000","last_clean":"2024-04-19T03:05:11.419122+0000","last_became_active":"2024-04-19T03:05:09.395920+0000","last_became_peered":"2024-04-19T03:05:09.395920+0000","last_unstale":"2024-04-19T03:05:11.419122+0000","last_undegraded":"2024-04-19T03:05:11.419122+0000","last_fullsized":"2024-04-19T03:05:11.419122+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:23:05.984746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"20'2","reported_seq":87,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.424713+0000","last_change":"2024-04-19T03:04:50.277421+0000","last_active":"2024-04-19T03:05:11.424713+0000","last_peered":"2024-04-19T03:05:11.424713+0000","last_clean":"2024-04-19T03:05:11.424713+0000","last_became_active":"2024-04-19T03:04:50.276732+0000","last_became_peered":"2024-04-19T03:04:50.276732+0000","last_unstale":"2024-04-19T03:05:11.424713+0000","last_undegraded":"2024-04-19T03:05:11.424713+0000","last_fullsized":"2024-04-19T03:05:11.424713+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:23:27.191496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":77,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.419051+0000","last_change":"2024-04-19T03:05:09.395454+0000","last_active":"2024-04-19T03:05:11.419051+0000","last_peered":"2024-04-19T03:05:11.419051+0000","last_clean":"2024-04-19T03:05:11.419051+0000","last_became_active":"2024-04-19T03:05:09.394288+0000","last_became_peered":"2024-04-19T03:05:09.394288+0000","last_unstale":"2024-04-19T03:05:11.419051+0000","last_undegraded":"2024-04-19T03:05:11.419051+0000","last_fullsized":"2024-04-19T03:05:11.419051+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:32:14.358374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":30,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.768860+0000","last_change":"2024-04-19T03:04:50.628801+0000","last_active":"2024-04-19T03:05:11.768860+0000","last_peered":"2024-04-19T03:05:11.768860+0000","last_clean":"2024-04-19T03:05:11.768860+0000","last_became_active":"2024-04-19T03:04:50.628023+0000","last_became_peered":"2024-04-19T03:04:50.628023+0000","last_unstale":"2024-04-19T03:05:11.768860+0000","last_undegraded":"2024-04-19T03:05:11.768860+0000","last_fullsized":"2024-04-19T03:05:11.768860+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:52:41.731698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.770121+0000","last_change":"2024-04-19T03:04:50.616471+0000","last_active":"2024-04-19T03:05:11.770121+0000","last_peered":"2024-04-19T03:05:11.770121+0000","last_clean":"2024-04-19T03:05:11.770121+0000","last_became_active":"2024-04-19T03:04:50.613860+0000","last_became_peered":"2024-04-19T03:04:50.613860+0000","last_unstale":"2024-04-19T03:05:11.770121+0000","last_undegraded":"2024-04-19T03:05:11.770121+0000","last_fullsized":"2024-04-19T03:05:11.770121+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:26:24.246287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":72,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.417986+0000","last_change":"2024-04-19T03:01:14.649074+0000","last_active":"2024-04-19T03:05:11.417986+0000","last_peered":"2024-04-19T03:05:11.417986+0000","last_clean":"2024-04-19T03:05:11.417986+0000","last_became_active":"2024-04-19T03:01:14.648217+0000","last_became_peered":"2024-04-19T03:01:14.648217+0000","last_unstale":"2024-04-19T03:05:11.417986+0000","last_undegraded":"2024-04-19T03:05:11.417986+0000","last_fullsized":"2024-04-19T03:05:11.417986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:57:05.238043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.769706+0000","last_change":"2024-04-19T03:04:50.611026+0000","last_active":"2024-04-19T03:05:11.769706+0000","last_peered":"2024-04-19T03:05:11.769706+0000","last_clean":"2024-04-19T03:05:11.769706+0000","last_became_active":"2024-04-19T03:04:50.610659+0000","last_became_peered":"2024-04-19T03:04:50.610659+0000","last_unstale":"2024-04-19T03:05:11.769706+0000","last_undegraded":"2024-04-19T03:05:11.769706+0000","last_fullsized":"2024-04-19T03:05:11.769706+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:57:17.231684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"20'8","reported_seq":85,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.431442+0000","last_change":"2024-04-19T03:05:11.429829+0000","last_active":"2024-04-19T03:05:11.431442+0000","last_peered":"2024-04-19T03:05:11.431442+0000","last_clean":"2024-04-19T03:05:11.431442+0000","last_became_active":"2024-04-19T03:05:11.428668+0000","last_became_peered":"2024-04-19T03:05:11.428668+0000","last_unstale":"2024-04-19T03:05:11.431442+0000","last_undegraded":"2024-04-19T03:05:11.431442+0000","last_fullsized":"2024-04-19T03:05:11.431442+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:14:21.956275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"20'1","reported_seq":73,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.428642+0000","last_change":"2024-04-19T03:01:14.649839+0000","last_active":"2024-04-19T03:05:11.428642+0000","last_peered":"2024-04-19T03:05:11.428642+0000","last_clean":"2024-04-19T03:05:11.428642+0000","last_became_active":"2024-04-19T03:01:14.649571+0000","last_became_peered":"2024-04-19T03:01:14.649571+0000","last_unstale":"2024-04-19T03:05:11.428642+0000","last_undegraded":"2024-04-19T03:05:11.428642+0000","last_fullsized":"2024-04-19T03:05:11.428642+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:03:57.839660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":53,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.417983+0000","last_change":"2024-04-19T03:05:02.362526+0000","last_active":"2024-04-19T03:05:11.417983+0000","last_peered":"2024-04-19T03:05:11.417983+0000","last_clean":"2024-04-19T03:05:11.417983+0000","last_became_active":"2024-04-19T03:05:02.362227+0000","last_became_peered":"2024-04-19T03:05:02.362227+0000","last_unstale":"2024-04-19T03:05:11.417983+0000","last_undegraded":"2024-04-19T03:05:11.417983+0000","last_fullsized":"2024-04-19T03:05:11.417983+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:00:25.584557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"20'2","reported_seq":74,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.419401+0000","last_change":"2024-04-19T03:01:14.645075+0000","last_active":"2024-04-19T03:05:11.419401+0000","last_peered":"2024-04-19T03:05:11.419401+0000","last_clean":"2024-04-19T03:05:11.419401+0000","last_became_active":"2024-04-19T03:01:14.644790+0000","last_became_peered":"2024-04-19T03:01:14.644790+0000","last_unstale":"2024-04-19T03:05:11.419401+0000","last_undegraded":"2024-04-19T03:05:11.419401+0000","last_fullsized":"2024-04-19T03:05:11.419401+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:55:15.035769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":77,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.417574+0000","last_change":"2024-04-19T03:05:09.393128+0000","last_active":"2024-04-19T03:05:11.417574+0000","last_peered":"2024-04-19T03:05:11.417574+0000","last_clean":"2024-04-19T03:05:11.417574+0000","last_became_active":"2024-04-19T03:05:09.392736+0000","last_became_peered":"2024-04-19T03:05:09.392736+0000","last_unstale":"2024-04-19T03:05:11.417574+0000","last_undegraded":"2024-04-19T03:05:11.417574+0000","last_fullsized":"2024-04-19T03:05:11.417574+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:04:56.310628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"20'1","reported_seq":40,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:12.905624+0000","last_change":"2024-04-19T03:05:11.431892+0000","last_active":"2024-04-19T03:05:12.905624+0000","last_peered":"2024-04-19T03:05:12.905624+0000","last_clean":"2024-04-19T03:05:12.905624+0000","last_became_active":"2024-04-19T03:05:11.431552+0000","last_became_peered":"2024-04-19T03:05:11.431552+0000","last_unstale":"2024-04-19T03:05:12.905624+0000","last_undegraded":"2024-04-19T03:05:12.905624+0000","last_fullsized":"2024-04-19T03:05:12.905624+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:38:26.843094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":84,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.424141+0000","last_change":"2024-04-19T03:04:50.277960+0000","last_active":"2024-04-19T03:05:11.424141+0000","last_peered":"2024-04-19T03:05:11.424141+0000","last_clean":"2024-04-19T03:05:11.424141+0000","last_became_active":"2024-04-19T03:04:50.277126+0000","last_became_peered":"2024-04-19T03:04:50.277126+0000","last_unstale":"2024-04-19T03:05:11.424141+0000","last_undegraded":"2024-04-19T03:05:11.424141+0000","last_fullsized":"2024-04-19T03:05:11.424141+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:08:49.146373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":71,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.431622+0000","last_change":"2024-04-19T03:05:11.429040+0000","last_active":"2024-04-19T03:05:11.431622+0000","last_peered":"2024-04-19T03:05:11.431622+0000","last_clean":"2024-04-19T03:05:11.431622+0000","last_became_active":"2024-04-19T03:05:11.428722+0000","last_became_peered":"2024-04-19T03:05:11.428722+0000","last_unstale":"2024-04-19T03:05:11.431622+0000","last_undegraded":"2024-04-19T03:05:11.431622+0000","last_fullsized":"2024-04-19T03:05:11.431622+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:52:42.089565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.770183+0000","last_change":"2024-04-19T03:04:50.627120+0000","last_active":"2024-04-19T03:05:11.770183+0000","last_peered":"2024-04-19T03:05:11.770183+0000","last_clean":"2024-04-19T03:05:11.770183+0000","last_became_active":"2024-04-19T03:04:50.625919+0000","last_became_peered":"2024-04-19T03:04:50.625919+0000","last_unstale":"2024-04-19T03:05:11.770183+0000","last_undegraded":"2024-04-19T03:05:11.770183+0000","last_fullsized":"2024-04-19T03:05:11.770183+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:56:19.822304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"20'2","reported_seq":32,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.769746+0000","last_change":"2024-04-19T03:04:50.627277+0000","last_active":"2024-04-19T03:05:11.769746+0000","last_peered":"2024-04-19T03:05:11.769746+0000","last_clean":"2024-04-19T03:05:11.769746+0000","last_became_active":"2024-04-19T03:04:50.625931+0000","last_became_peered":"2024-04-19T03:04:50.625931+0000","last_unstale":"2024-04-19T03:05:11.769746+0000","last_undegraded":"2024-04-19T03:05:11.769746+0000","last_fullsized":"2024-04-19T03:05:11.769746+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:30:32.408349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":86,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.431933+0000","last_change":"2024-04-19T03:05:11.430496+0000","last_active":"2024-04-19T03:05:11.431933+0000","last_peered":"2024-04-19T03:05:11.431933+0000","last_clean":"2024-04-19T03:05:11.431933+0000","last_became_active":"2024-04-19T03:05:11.430149+0000","last_became_peered":"2024-04-19T03:05:11.430149+0000","last_unstale":"2024-04-19T03:05:11.431933+0000","last_undegraded":"2024-04-19T03:05:11.431933+0000","last_fullsized":"2024-04-19T03:05:11.431933+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:55:24.828882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":85,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.424643+0000","last_change":"2024-04-19T03:04:50.278491+0000","last_active":"2024-04-19T03:05:11.424643+0000","last_peered":"2024-04-19T03:05:11.424643+0000","last_clean":"2024-04-19T03:05:11.424643+0000","last_became_active":"2024-04-19T03:04:50.277603+0000","last_became_peered":"2024-04-19T03:04:50.277603+0000","last_unstale":"2024-04-19T03:05:11.424643+0000","last_undegraded":"2024-04-19T03:05:11.424643+0000","last_fullsized":"2024-04-19T03:05:11.424643+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:04:26.211975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":71,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.426785+0000","last_change":"2024-04-19T03:01:15.015685+0000","last_active":"2024-04-19T03:05:11.426785+0000","last_peered":"2024-04-19T03:05:11.426785+0000","last_clean":"2024-04-19T03:05:11.426785+0000","last_became_active":"2024-04-19T03:01:15.014847+0000","last_became_peered":"2024-04-19T03:01:15.014847+0000","last_unstale":"2024-04-19T03:05:11.426785+0000","last_undegraded":"2024-04-19T03:05:11.426785+0000","last_fullsized":"2024-04-19T03:05:11.426785+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:51:06.208551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":51,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.418053+0000","last_change":"2024-04-19T03:05:09.392582+0000","last_active":"2024-04-19T03:05:11.418053+0000","last_peered":"2024-04-19T03:05:11.418053+0000","last_clean":"2024-04-19T03:05:11.418053+0000","last_became_active":"2024-04-19T03:05:09.391218+0000","last_became_peered":"2024-04-19T03:05:09.391218+0000","last_unstale":"2024-04-19T03:05:11.418053+0000","last_undegraded":"2024-04-19T03:05:11.418053+0000","last_fullsized":"2024-04-19T03:05:11.418053+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:06:11.612173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":71,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.426219+0000","last_change":"2024-04-19T03:01:15.014818+0000","last_active":"2024-04-19T03:05:11.426219+0000","last_peered":"2024-04-19T03:05:11.426219+0000","last_clean":"2024-04-19T03:05:11.426219+0000","last_became_active":"2024-04-19T03:01:15.014421+0000","last_became_peered":"2024-04-19T03:01:15.014421+0000","last_unstale":"2024-04-19T03:05:11.426219+0000","last_undegraded":"2024-04-19T03:05:11.426219+0000","last_fullsized":"2024-04-19T03:05:11.426219+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:16:20.475837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":78,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.417679+0000","last_change":"2024-04-19T03:05:09.395629+0000","last_active":"2024-04-19T03:05:11.417679+0000","last_peered":"2024-04-19T03:05:11.417679+0000","last_clean":"2024-04-19T03:05:11.417679+0000","last_became_active":"2024-04-19T03:05:09.395294+0000","last_became_peered":"2024-04-19T03:05:09.395294+0000","last_unstale":"2024-04-19T03:05:11.417679+0000","last_undegraded":"2024-04-19T03:05:11.417679+0000","last_fullsized":"2024-04-19T03:05:11.417679+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:38:03.627366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.770660+0000","last_change":"2024-04-19T03:04:50.617641+0000","last_active":"2024-04-19T03:05:11.770660+0000","last_peered":"2024-04-19T03:05:11.770660+0000","last_clean":"2024-04-19T03:05:11.770660+0000","last_became_active":"2024-04-19T03:04:50.617323+0000","last_became_peered":"2024-04-19T03:04:50.617323+0000","last_unstale":"2024-04-19T03:05:11.770660+0000","last_undegraded":"2024-04-19T03:05:11.770660+0000","last_fullsized":"2024-04-19T03:05:11.770660+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:26:09.566534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"14'157","reported_seq":279,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:12.903628+0000","last_change":"2024-04-19T03:05:11.429096+0000","last_active":"2024-04-19T03:05:12.903628+0000","last_peered":"2024-04-19T03:05:12.903628+0000","last_clean":"2024-04-19T03:05:12.903628+0000","last_became_active":"2024-04-19T03:05:11.426859+0000","last_became_peered":"2024-04-19T03:05:11.426859+0000","last_unstale":"2024-04-19T03:05:12.903628+0000","last_undegraded":"2024-04-19T03:05:12.903628+0000","last_fullsized":"2024-04-19T03:05:12.903628+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:06.516863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:06.516863+0000","last_clean_scrub_stamp":"2024-04-19T03:01:06.516863+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:34:42.107839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":87,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.425366+0000","last_change":"2024-04-19T03:04:50.277227+0000","last_active":"2024-04-19T03:05:11.425366+0000","last_peered":"2024-04-19T03:05:11.425366+0000","last_clean":"2024-04-19T03:05:11.425366+0000","last_became_active":"2024-04-19T03:04:50.276132+0000","last_became_peered":"2024-04-19T03:04:50.276132+0000","last_unstale":"2024-04-19T03:05:11.425366+0000","last_undegraded":"2024-04-19T03:05:11.425366+0000","last_fullsized":"2024-04-19T03:05:11.425366+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_clean_scrub_stamp":"2024-04-19T03:01:09.578660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:36:07.077967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":30,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.769259+0000","last_change":"2024-04-19T03:04:50.629139+0000","last_active":"2024-04-19T03:05:11.769259+0000","last_peered":"2024-04-19T03:05:11.769259+0000","last_clean":"2024-04-19T03:05:11.769259+0000","last_became_active":"2024-04-19T03:04:50.628741+0000","last_became_peered":"2024-04-19T03:04:50.628741+0000","last_unstale":"2024-04-19T03:05:11.769259+0000","last_undegraded":"2024-04-19T03:05:11.769259+0000","last_fullsized":"2024-04-19T03:05:11.769259+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:17:48.413908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":73,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.432341+0000","last_change":"2024-04-19T03:05:11.431455+0000","last_active":"2024-04-19T03:05:11.432341+0000","last_peered":"2024-04-19T03:05:11.432341+0000","last_clean":"2024-04-19T03:05:11.432341+0000","last_became_active":"2024-04-19T03:05:11.430881+0000","last_became_peered":"2024-04-19T03:05:11.430881+0000","last_unstale":"2024-04-19T03:05:11.432341+0000","last_undegraded":"2024-04-19T03:05:11.432341+0000","last_fullsized":"2024-04-19T03:05:11.432341+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:34:50.356698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":75,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.423910+0000","last_change":"2024-04-19T03:01:10.602194+0000","last_active":"2024-04-19T03:05:11.423910+0000","last_peered":"2024-04-19T03:05:11.423910+0000","last_clean":"2024-04-19T03:05:11.423910+0000","last_became_active":"2024-04-19T03:01:10.601381+0000","last_became_peered":"2024-04-19T03:01:10.601381+0000","last_unstale":"2024-04-19T03:05:11.423910+0000","last_undegraded":"2024-04-19T03:05:11.423910+0000","last_fullsized":"2024-04-19T03:05:11.423910+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_clean_scrub_stamp":"2024-04-19T03:01:09.578660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:42:26.594095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":30,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.768286+0000","last_change":"2024-04-19T03:04:50.634401+0000","last_active":"2024-04-19T03:05:11.768286+0000","last_peered":"2024-04-19T03:05:11.768286+0000","last_clean":"2024-04-19T03:05:11.768286+0000","last_became_active":"2024-04-19T03:04:50.631721+0000","last_became_peered":"2024-04-19T03:04:50.631721+0000","last_unstale":"2024-04-19T03:05:11.768286+0000","last_undegraded":"2024-04-19T03:05:11.768286+0000","last_fullsized":"2024-04-19T03:05:11.768286+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:40:03.144776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":77,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.419116+0000","last_change":"2024-04-19T03:05:09.395868+0000","last_active":"2024-04-19T03:05:11.419116+0000","last_peered":"2024-04-19T03:05:11.419116+0000","last_clean":"2024-04-19T03:05:11.419116+0000","last_became_active":"2024-04-19T03:05:09.395167+0000","last_became_peered":"2024-04-19T03:05:09.395167+0000","last_unstale":"2024-04-19T03:05:11.419116+0000","last_undegraded":"2024-04-19T03:05:11.419116+0000","last_fullsized":"2024-04-19T03:05:11.419116+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:40:00.629037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.768794+0000","last_change":"2024-04-19T03:04:50.635352+0000","last_active":"2024-04-19T03:05:11.768794+0000","last_peered":"2024-04-19T03:05:11.768794+0000","last_clean":"2024-04-19T03:05:11.768794+0000","last_became_active":"2024-04-19T03:04:50.633457+0000","last_became_peered":"2024-04-19T03:04:50.633457+0000","last_unstale":"2024-04-19T03:05:11.768794+0000","last_undegraded":"2024-04-19T03:05:11.768794+0000","last_fullsized":"2024-04-19T03:05:11.768794+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_clean_scrub_stamp":"2024-04-19T03:01:09.578660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:17:18.884148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":73,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:12.420122+0000","last_change":"2024-04-19T03:01:14.649068+0000","last_active":"2024-04-19T03:05:12.420122+0000","last_peered":"2024-04-19T03:05:12.420122+0000","last_clean":"2024-04-19T03:05:12.420122+0000","last_became_active":"2024-04-19T03:01:14.648082+0000","last_became_peered":"2024-04-19T03:01:14.648082+0000","last_unstale":"2024-04-19T03:05:12.420122+0000","last_undegraded":"2024-04-19T03:05:12.420122+0000","last_fullsized":"2024-04-19T03:05:12.420122+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:30:14.489117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.770578+0000","last_change":"2024-04-19T03:04:50.625932+0000","last_active":"2024-04-19T03:05:11.770578+0000","last_peered":"2024-04-19T03:05:11.770578+0000","last_clean":"2024-04-19T03:05:11.770578+0000","last_became_active":"2024-04-19T03:04:50.617628+0000","last_became_peered":"2024-04-19T03:04:50.617628+0000","last_unstale":"2024-04-19T03:05:11.770578+0000","last_undegraded":"2024-04-19T03:05:11.770578+0000","last_fullsized":"2024-04-19T03:05:11.770578+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:52:52.957579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":87,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.425331+0000","last_change":"2024-04-19T03:04:50.278737+0000","last_active":"2024-04-19T03:05:11.425331+0000","last_peered":"2024-04-19T03:05:11.425331+0000","last_clean":"2024-04-19T03:05:11.425331+0000","last_became_active":"2024-04-19T03:04:50.277804+0000","last_became_peered":"2024-04-19T03:04:50.277804+0000","last_unstale":"2024-04-19T03:05:11.425331+0000","last_undegraded":"2024-04-19T03:05:11.425331+0000","last_fullsized":"2024-04-19T03:05:11.425331+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_clean_scrub_stamp":"2024-04-19T03:01:09.578660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:00:20.440389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":85,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.424660+0000","last_change":"2024-04-19T03:04:50.277141+0000","last_active":"2024-04-19T03:05:11.424660+0000","last_peered":"2024-04-19T03:05:11.424660+0000","last_clean":"2024-04-19T03:05:11.424660+0000","last_became_active":"2024-04-19T03:04:50.275812+0000","last_became_peered":"2024-04-19T03:04:50.275812+0000","last_unstale":"2024-04-19T03:05:11.424660+0000","last_undegraded":"2024-04-19T03:05:11.424660+0000","last_fullsized":"2024-04-19T03:05:11.424660+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:16:29.209241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.769258+0000","last_change":"2024-04-19T03:04:50.616475+0000","last_active":"2024-04-19T03:05:11.769258+0000","last_peered":"2024-04-19T03:05:11.769258+0000","last_clean":"2024-04-19T03:05:11.769258+0000","last_became_active":"2024-04-19T03:04:50.614774+0000","last_became_peered":"2024-04-19T03:04:50.614774+0000","last_unstale":"2024-04-19T03:05:11.769258+0000","last_undegraded":"2024-04-19T03:05:11.769258+0000","last_fullsized":"2024-04-19T03:05:11.769258+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:51:07.142010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":71,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.431817+0000","last_change":"2024-04-19T03:05:11.430250+0000","last_active":"2024-04-19T03:05:11.431817+0000","last_peered":"2024-04-19T03:05:11.431817+0000","last_clean":"2024-04-19T03:05:11.431817+0000","last_became_active":"2024-04-19T03:05:11.429941+0000","last_became_peered":"2024-04-19T03:05:11.429941+0000","last_unstale":"2024-04-19T03:05:11.431817+0000","last_undegraded":"2024-04-19T03:05:11.431817+0000","last_fullsized":"2024-04-19T03:05:11.431817+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:28:17.231621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.769485+0000","last_change":"2024-04-19T03:04:50.615925+0000","last_active":"2024-04-19T03:05:11.769485+0000","last_peered":"2024-04-19T03:05:11.769485+0000","last_clean":"2024-04-19T03:05:11.769485+0000","last_became_active":"2024-04-19T03:04:50.614498+0000","last_became_peered":"2024-04-19T03:04:50.614498+0000","last_unstale":"2024-04-19T03:05:11.769485+0000","last_undegraded":"2024-04-19T03:05:11.769485+0000","last_fullsized":"2024-04-19T03:05:11.769485+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_clean_scrub_stamp":"2024-04-19T03:01:09.578660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:41:52.085259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":50,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.418555+0000","last_change":"2024-04-19T03:05:09.395750+0000","last_active":"2024-04-19T03:05:11.418555+0000","last_peered":"2024-04-19T03:05:11.418555+0000","last_clean":"2024-04-19T03:05:11.418555+0000","last_became_active":"2024-04-19T03:05:09.394024+0000","last_became_peered":"2024-04-19T03:05:09.394024+0000","last_unstale":"2024-04-19T03:05:11.418555+0000","last_undegraded":"2024-04-19T03:05:11.418555+0000","last_fullsized":"2024-04-19T03:05:11.418555+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:59:29.215722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":30,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.769894+0000","last_change":"2024-04-19T03:04:50.616970+0000","last_active":"2024-04-19T03:05:11.769894+0000","last_peered":"2024-04-19T03:05:11.769894+0000","last_clean":"2024-04-19T03:05:11.769894+0000","last_became_active":"2024-04-19T03:04:50.615238+0000","last_became_peered":"2024-04-19T03:04:50.615238+0000","last_unstale":"2024-04-19T03:05:11.769894+0000","last_undegraded":"2024-04-19T03:05:11.769894+0000","last_fullsized":"2024-04-19T03:05:11.769894+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:55:14.049921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":81,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.419750+0000","last_change":"2024-04-19T03:05:09.397542+0000","last_active":"2024-04-19T03:05:11.419750+0000","last_peered":"2024-04-19T03:05:11.419750+0000","last_clean":"2024-04-19T03:05:11.419750+0000","last_became_active":"2024-04-19T03:05:09.396378+0000","last_became_peered":"2024-04-19T03:05:09.396378+0000","last_unstale":"2024-04-19T03:05:11.419750+0000","last_undegraded":"2024-04-19T03:05:11.419750+0000","last_fullsized":"2024-04-19T03:05:11.419750+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_clean_scrub_stamp":"2024-04-19T03:01:09.578660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:22:24.885555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":50,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.418216+0000","last_change":"2024-04-19T03:05:09.392910+0000","last_active":"2024-04-19T03:05:11.418216+0000","last_peered":"2024-04-19T03:05:11.418216+0000","last_clean":"2024-04-19T03:05:11.418216+0000","last_became_active":"2024-04-19T03:05:09.392437+0000","last_became_peered":"2024-04-19T03:05:09.392437+0000","last_unstale":"2024-04-19T03:05:11.418216+0000","last_undegraded":"2024-04-19T03:05:11.418216+0000","last_fullsized":"2024-04-19T03:05:11.418216+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:23:28.203282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"20'2","reported_seq":32,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.769920+0000","last_change":"2024-04-19T03:04:50.611678+0000","last_active":"2024-04-19T03:05:11.769920+0000","last_peered":"2024-04-19T03:05:11.769920+0000","last_clean":"2024-04-19T03:05:11.769920+0000","last_became_active":"2024-04-19T03:04:50.611024+0000","last_became_peered":"2024-04-19T03:04:50.611024+0000","last_unstale":"2024-04-19T03:05:11.769920+0000","last_undegraded":"2024-04-19T03:05:11.769920+0000","last_fullsized":"2024-04-19T03:05:11.769920+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:08:43.323149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.769690+0000","last_change":"2024-04-19T03:04:50.616003+0000","last_active":"2024-04-19T03:05:11.769690+0000","last_peered":"2024-04-19T03:05:11.769690+0000","last_clean":"2024-04-19T03:05:11.769690+0000","last_became_active":"2024-04-19T03:04:50.612403+0000","last_became_peered":"2024-04-19T03:04:50.612403+0000","last_unstale":"2024-04-19T03:05:11.769690+0000","last_undegraded":"2024-04-19T03:05:11.769690+0000","last_fullsized":"2024-04-19T03:05:11.769690+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_clean_scrub_stamp":"2024-04-19T03:01:09.578660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:16:44.156874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.768524+0000","last_change":"2024-04-19T03:04:50.615936+0000","last_active":"2024-04-19T03:05:11.768524+0000","last_peered":"2024-04-19T03:05:11.768524+0000","last_clean":"2024-04-19T03:05:11.768524+0000","last_became_active":"2024-04-19T03:04:50.612987+0000","last_became_peered":"2024-04-19T03:04:50.612987+0000","last_unstale":"2024-04-19T03:05:11.768524+0000","last_undegraded":"2024-04-19T03:05:11.768524+0000","last_fullsized":"2024-04-19T03:05:11.768524+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:17:39.989639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"21'1","reported_seq":33,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.769909+0000","last_change":"2024-04-19T03:04:50.616200+0000","last_active":"2024-04-19T03:05:11.769909+0000","last_peered":"2024-04-19T03:05:11.769909+0000","last_clean":"2024-04-19T03:05:11.769909+0000","last_became_active":"2024-04-19T03:04:50.612697+0000","last_became_peered":"2024-04-19T03:04:50.612697+0000","last_unstale":"2024-04-19T03:05:11.769909+0000","last_undegraded":"2024-04-19T03:05:11.769909+0000","last_fullsized":"2024-04-19T03:05:11.769909+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:28:55.970411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":74,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.428574+0000","last_change":"2024-04-19T03:01:10.602274+0000","last_active":"2024-04-19T03:05:11.428574+0000","last_peered":"2024-04-19T03:05:11.428574+0000","last_clean":"2024-04-19T03:05:11.428574+0000","last_became_active":"2024-04-19T03:01:10.601487+0000","last_became_peered":"2024-04-19T03:01:10.601487+0000","last_unstale":"2024-04-19T03:05:11.428574+0000","last_undegraded":"2024-04-19T03:05:11.428574+0000","last_fullsized":"2024-04-19T03:05:11.428574+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_clean_scrub_stamp":"2024-04-19T03:01:09.578660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:26:16.712446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":71,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.417696+0000","last_change":"2024-04-19T03:01:15.018914+0000","last_active":"2024-04-19T03:05:11.417696+0000","last_peered":"2024-04-19T03:05:11.417696+0000","last_clean":"2024-04-19T03:05:11.417696+0000","last_became_active":"2024-04-19T03:01:15.018276+0000","last_became_peered":"2024-04-19T03:01:15.018276+0000","last_unstale":"2024-04-19T03:05:11.417696+0000","last_undegraded":"2024-04-19T03:05:11.417696+0000","last_fullsized":"2024-04-19T03:05:11.417696+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:40:59.453079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":76,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.431580+0000","last_change":"2024-04-19T03:05:11.430020+0000","last_active":"2024-04-19T03:05:11.431580+0000","last_peered":"2024-04-19T03:05:11.431580+0000","last_clean":"2024-04-19T03:05:11.431580+0000","last_became_active":"2024-04-19T03:05:11.429214+0000","last_became_peered":"2024-04-19T03:05:11.429214+0000","last_unstale":"2024-04-19T03:05:11.431580+0000","last_undegraded":"2024-04-19T03:05:11.431580+0000","last_fullsized":"2024-04-19T03:05:11.431580+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:06:34.608828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"20'6","reported_seq":83,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.432314+0000","last_change":"2024-04-19T03:05:11.431454+0000","last_active":"2024-04-19T03:05:11.432314+0000","last_peered":"2024-04-19T03:05:11.432314+0000","last_clean":"2024-04-19T03:05:11.432314+0000","last_became_active":"2024-04-19T03:05:11.430906+0000","last_became_peered":"2024-04-19T03:05:11.430906+0000","last_unstale":"2024-04-19T03:05:11.432314+0000","last_undegraded":"2024-04-19T03:05:11.432314+0000","last_fullsized":"2024-04-19T03:05:11.432314+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:24:28.008875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.768781+0000","last_change":"2024-04-19T03:04:50.628406+0000","last_active":"2024-04-19T03:05:11.768781+0000","last_peered":"2024-04-19T03:05:11.768781+0000","last_clean":"2024-04-19T03:05:11.768781+0000","last_became_active":"2024-04-19T03:04:50.627654+0000","last_became_peered":"2024-04-19T03:04:50.627654+0000","last_unstale":"2024-04-19T03:05:11.768781+0000","last_undegraded":"2024-04-19T03:05:11.768781+0000","last_fullsized":"2024-04-19T03:05:11.768781+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:17:57.101098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"20'3","reported_seq":54,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.419554+0000","last_change":"2024-04-19T03:05:09.398110+0000","last_active":"2024-04-19T03:05:11.419554+0000","last_peered":"2024-04-19T03:05:11.419554+0000","last_clean":"2024-04-19T03:05:11.419554+0000","last_became_active":"2024-04-19T03:05:09.397555+0000","last_became_peered":"2024-04-19T03:05:09.397555+0000","last_unstale":"2024-04-19T03:05:11.419554+0000","last_undegraded":"2024-04-19T03:05:11.419554+0000","last_fullsized":"2024-04-19T03:05:11.419554+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:27:00.017189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":71,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.431390+0000","last_change":"2024-04-19T03:05:11.429290+0000","last_active":"2024-04-19T03:05:11.431390+0000","last_peered":"2024-04-19T03:05:11.431390+0000","last_clean":"2024-04-19T03:05:11.431390+0000","last_became_active":"2024-04-19T03:05:11.428904+0000","last_became_peered":"2024-04-19T03:05:11.428904+0000","last_unstale":"2024-04-19T03:05:11.431390+0000","last_undegraded":"2024-04-19T03:05:11.431390+0000","last_fullsized":"2024-04-19T03:05:11.431390+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:16:47.688907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.768791+0000","last_change":"2024-04-19T03:04:50.634026+0000","last_active":"2024-04-19T03:05:11.768791+0000","last_peered":"2024-04-19T03:05:11.768791+0000","last_clean":"2024-04-19T03:05:11.768791+0000","last_became_active":"2024-04-19T03:04:50.630873+0000","last_became_peered":"2024-04-19T03:04:50.630873+0000","last_unstale":"2024-04-19T03:05:11.768791+0000","last_undegraded":"2024-04-19T03:05:11.768791+0000","last_fullsized":"2024-04-19T03:05:11.768791+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:41:25.674376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":30,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.770364+0000","last_change":"2024-04-19T03:04:50.612483+0000","last_active":"2024-04-19T03:05:11.770364+0000","last_peered":"2024-04-19T03:05:11.770364+0000","last_clean":"2024-04-19T03:05:11.770364+0000","last_became_active":"2024-04-19T03:04:50.612005+0000","last_became_peered":"2024-04-19T03:04:50.612005+0000","last_unstale":"2024-04-19T03:05:11.770364+0000","last_undegraded":"2024-04-19T03:05:11.770364+0000","last_fullsized":"2024-04-19T03:05:11.770364+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:56:45.629955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.768295+0000","last_change":"2024-04-19T03:04:50.616158+0000","last_active":"2024-04-19T03:05:11.768295+0000","last_peered":"2024-04-19T03:05:11.768295+0000","last_clean":"2024-04-19T03:05:11.768295+0000","last_became_active":"2024-04-19T03:04:50.613735+0000","last_became_peered":"2024-04-19T03:04:50.613735+0000","last_unstale":"2024-04-19T03:05:11.768295+0000","last_undegraded":"2024-04-19T03:05:11.768295+0000","last_fullsized":"2024-04-19T03:05:11.768295+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:25:58.128503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":50,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.419690+0000","last_change":"2024-04-19T03:05:09.394054+0000","last_active":"2024-04-19T03:05:11.419690+0000","last_peered":"2024-04-19T03:05:11.419690+0000","last_clean":"2024-04-19T03:05:11.419690+0000","last_became_active":"2024-04-19T03:05:09.392982+0000","last_became_peered":"2024-04-19T03:05:09.392982+0000","last_unstale":"2024-04-19T03:05:11.419690+0000","last_undegraded":"2024-04-19T03:05:11.419690+0000","last_fullsized":"2024-04-19T03:05:11.419690+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:09:41.580252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":30,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.768114+0000","last_change":"2024-04-19T03:04:50.616430+0000","last_active":"2024-04-19T03:05:11.768114+0000","last_peered":"2024-04-19T03:05:11.768114+0000","last_clean":"2024-04-19T03:05:11.768114+0000","last_became_active":"2024-04-19T03:04:50.613523+0000","last_became_peered":"2024-04-19T03:04:50.613523+0000","last_unstale":"2024-04-19T03:05:11.768114+0000","last_undegraded":"2024-04-19T03:05:11.768114+0000","last_fullsized":"2024-04-19T03:05:11.768114+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:22:43.207543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":29,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.770394+0000","last_change":"2024-04-19T03:04:50.616829+0000","last_active":"2024-04-19T03:05:11.770394+0000","last_peered":"2024-04-19T03:05:11.770394+0000","last_clean":"2024-04-19T03:05:11.770394+0000","last_became_active":"2024-04-19T03:04:50.616545+0000","last_became_peered":"2024-04-19T03:04:50.616545+0000","last_unstale":"2024-04-19T03:05:11.770394+0000","last_undegraded":"2024-04-19T03:05:11.770394+0000","last_fullsized":"2024-04-19T03:05:11.770394+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:07:32.515729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":30,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.768318+0000","last_change":"2024-04-19T03:04:50.634214+0000","last_active":"2024-04-19T03:05:11.768318+0000","last_peered":"2024-04-19T03:05:11.768318+0000","last_clean":"2024-04-19T03:05:11.768318+0000","last_became_active":"2024-04-19T03:04:50.631699+0000","last_became_peered":"2024-04-19T03:04:50.631699+0000","last_unstale":"2024-04-19T03:05:11.768318+0000","last_undegraded":"2024-04-19T03:05:11.768318+0000","last_fullsized":"2024-04-19T03:05:11.768318+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:43:10.184280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":53,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.418846+0000","last_change":"2024-04-19T03:05:02.361377+0000","last_active":"2024-04-19T03:05:11.418846+0000","last_peered":"2024-04-19T03:05:11.418846+0000","last_clean":"2024-04-19T03:05:11.418846+0000","last_became_active":"2024-04-19T03:05:02.360924+0000","last_became_peered":"2024-04-19T03:05:02.360924+0000","last_unstale":"2024-04-19T03:05:11.418846+0000","last_undegraded":"2024-04-19T03:05:11.418846+0000","last_fullsized":"2024-04-19T03:05:11.418846+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:39:56.940892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"20'1","reported_seq":79,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.418313+0000","last_change":"2024-04-19T03:05:09.395934+0000","last_active":"2024-04-19T03:05:11.418313+0000","last_peered":"2024-04-19T03:05:11.418313+0000","last_clean":"2024-04-19T03:05:11.418313+0000","last_became_active":"2024-04-19T03:05:09.395508+0000","last_became_peered":"2024-04-19T03:05:09.395508+0000","last_unstale":"2024-04-19T03:05:11.418313+0000","last_undegraded":"2024-04-19T03:05:11.418313+0000","last_fullsized":"2024-04-19T03:05:11.418313+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:50:26.858754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":77,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.418889+0000","last_change":"2024-04-19T03:05:09.396327+0000","last_active":"2024-04-19T03:05:11.418889+0000","last_peered":"2024-04-19T03:05:11.418889+0000","last_clean":"2024-04-19T03:05:11.418889+0000","last_became_active":"2024-04-19T03:05:09.395753+0000","last_became_peered":"2024-04-19T03:05:09.395753+0000","last_unstale":"2024-04-19T03:05:11.418889+0000","last_undegraded":"2024-04-19T03:05:11.418889+0000","last_fullsized":"2024-04-19T03:05:11.418889+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:00:12.449987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"20'1","reported_seq":87,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.418640+0000","last_change":"2024-04-19T03:05:09.398142+0000","last_active":"2024-04-19T03:05:11.418640+0000","last_peered":"2024-04-19T03:05:11.418640+0000","last_clean":"2024-04-19T03:05:11.418640+0000","last_became_active":"2024-04-19T03:05:09.397183+0000","last_became_peered":"2024-04-19T03:05:09.397183+0000","last_unstale":"2024-04-19T03:05:11.418640+0000","last_undegraded":"2024-04-19T03:05:11.418640+0000","last_fullsized":"2024-04-19T03:05:11.418640+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:45:32.978138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":86,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.431626+0000","last_change":"2024-04-19T03:05:11.430243+0000","last_active":"2024-04-19T03:05:11.431626+0000","last_peered":"2024-04-19T03:05:11.431626+0000","last_clean":"2024-04-19T03:05:11.431626+0000","last_became_active":"2024-04-19T03:05:11.429247+0000","last_became_peered":"2024-04-19T03:05:11.429247+0000","last_unstale":"2024-04-19T03:05:11.431626+0000","last_undegraded":"2024-04-19T03:05:11.431626+0000","last_fullsized":"2024-04-19T03:05:11.431626+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:41:16.915398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"20'2","reported_seq":87,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.426718+0000","last_change":"2024-04-19T03:04:50.276105+0000","last_active":"2024-04-19T03:05:11.426718+0000","last_peered":"2024-04-19T03:05:11.426718+0000","last_clean":"2024-04-19T03:05:11.426718+0000","last_became_active":"2024-04-19T03:04:50.275533+0000","last_became_peered":"2024-04-19T03:04:50.275533+0000","last_unstale":"2024-04-19T03:05:11.426718+0000","last_undegraded":"2024-04-19T03:05:11.426718+0000","last_fullsized":"2024-04-19T03:05:11.426718+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:38:13.683481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":84,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.424718+0000","last_change":"2024-04-19T03:04:50.278401+0000","last_active":"2024-04-19T03:05:11.424718+0000","last_peered":"2024-04-19T03:05:11.424718+0000","last_clean":"2024-04-19T03:05:11.424718+0000","last_became_active":"2024-04-19T03:04:50.277348+0000","last_became_peered":"2024-04-19T03:04:50.277348+0000","last_unstale":"2024-04-19T03:05:11.424718+0000","last_undegraded":"2024-04-19T03:05:11.424718+0000","last_fullsized":"2024-04-19T03:05:11.424718+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:19:35.891753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"20'2","reported_seq":56,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.419282+0000","last_change":"2024-04-19T03:05:02.363600+0000","last_active":"2024-04-19T03:05:11.419282+0000","last_peered":"2024-04-19T03:05:11.419282+0000","last_clean":"2024-04-19T03:05:11.419282+0000","last_became_active":"2024-04-19T03:05:02.363167+0000","last_became_peered":"2024-04-19T03:05:02.363167+0000","last_unstale":"2024-04-19T03:05:11.419282+0000","last_undegraded":"2024-04-19T03:05:11.419282+0000","last_fullsized":"2024-04-19T03:05:11.419282+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:49:54.288998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":77,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.418217+0000","last_change":"2024-04-19T03:05:09.394500+0000","last_active":"2024-04-19T03:05:11.418217+0000","last_peered":"2024-04-19T03:05:11.418217+0000","last_clean":"2024-04-19T03:05:11.418217+0000","last_became_active":"2024-04-19T03:05:09.393975+0000","last_became_peered":"2024-04-19T03:05:09.393975+0000","last_unstale":"2024-04-19T03:05:11.418217+0000","last_undegraded":"2024-04-19T03:05:11.418217+0000","last_fullsized":"2024-04-19T03:05:11.418217+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:00:55.706542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"20'1","reported_seq":32,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.770844+0000","last_change":"2024-04-19T03:04:50.627670+0000","last_active":"2024-04-19T03:05:11.770844+0000","last_peered":"2024-04-19T03:05:11.770844+0000","last_clean":"2024-04-19T03:05:11.770844+0000","last_became_active":"2024-04-19T03:04:50.627304+0000","last_became_peered":"2024-04-19T03:04:50.627304+0000","last_unstale":"2024-04-19T03:05:11.770844+0000","last_undegraded":"2024-04-19T03:05:11.770844+0000","last_fullsized":"2024-04-19T03:05:11.770844+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:29:08.875911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":84,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.423682+0000","last_change":"2024-04-19T03:04:50.279334+0000","last_active":"2024-04-19T03:05:11.423682+0000","last_peered":"2024-04-19T03:05:11.423682+0000","last_clean":"2024-04-19T03:05:11.423682+0000","last_became_active":"2024-04-19T03:04:50.278874+0000","last_became_peered":"2024-04-19T03:04:50.278874+0000","last_unstale":"2024-04-19T03:05:11.423682+0000","last_undegraded":"2024-04-19T03:05:11.423682+0000","last_fullsized":"2024-04-19T03:05:11.423682+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:51:33.707741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"20'4","reported_seq":32,"reported_epoch":80,"state":"active+clean","last_fresh":"2024-04-19T03:05:11.770772+0000","last_change":"2024-04-19T03:04:50.627070+0000","last_active":"2024-04-19T03:05:11.770772+0000","last_peered":"2024-04-19T03:05:11.770772+0000","last_clean":"2024-04-19T03:05:11.770772+0000","last_became_active":"2024-04-19T03:04:50.626334+0000","last_became_peered":"2024-04-19T03:04:50.626334+0000","last_unstale":"2024-04-19T03:05:11.770772+0000","last_undegraded":"2024-04-19T03:05:11.770772+0000","last_fullsized":"2024-04-19T03:05:11.770772+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:24:58.586175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5289,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":14482,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":10,"seq":42949673017,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":220712,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":219774,"kb_avail":94151128,"statfs":{"total":96636764160,"available":96410755072,"internally_reserved":0,"allocated":946176,"data_stored":929795,"data_compressed":7241,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":225049030},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 19 03:02:08 2024","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"last":0.53400000000000003}]},{"osd":1,"last update":"Fri Apr 19 03:04:11 2024","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.19900000000000001,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.87,"5min":2.5030000000000001,"15min":2.5030000000000001},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.57099999999999995,"15min":0.56299999999999994},"min":{"1min":0.23999999999999999,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.90400000000000003,"5min":2.6379999999999999,"15min":2.6379999999999999},"last":0.65000000000000002}]}]},{"osd":1,"up_from":10,"seq":42949673016,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":202668,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":201726,"kb_avail":94169172,"statfs":{"total":96636764160,"available":96429232128,"internally_reserved":0,"allocated":942080,"data_stored":931342,"data_compressed":7241,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":206567878},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 19 03:02:04 2024","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.58699999999999997}]},{"osd":2,"last update":"Fri Apr 19 03:05:08 2024","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.501,"15min":0.50800000000000001},"min":{"1min":0.46999999999999997,"5min":0.224,"15min":0.224},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.50700000000000001,"15min":0.52100000000000002},"min":{"1min":0.52100000000000002,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.94899999999999995}]}]},{"osd":0,"up_from":71,"seq":304942678023,"num_pgs":73,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47712,"kb_used_data":848,"kb_used_omap":6,"kb_used_meta":46841,"kb_avail":94324128,"statfs":{"total":96636764160,"available":96587907072,"internally_reserved":0,"allocated":868352,"data_stored":339844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6883,"internal_metadata":47965469},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61799999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69199999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":7241,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":7241,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5289,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-19T03:05:20.062 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-04-19T03:01:14.615919+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=14, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:05:20.062 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-04-19T03:01:14.615919+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=14, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:05:20.062 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-04-19T03:01:14.615919+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=14, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:05:20.062 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-04-19T03:01:14.615919+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=14, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:05:20.062 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-04-19T03:01:14.615919+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=14, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:05:20.063 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-04-19T03:01:14.615919+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=14, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:05:20.063 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-04-19T03:01:14.615919+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=14, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:05:20.063 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-04-19T03:01:14.615919+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=14, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:05:20.063 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-04-19T03:01:14.615919+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=14, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:05:20.063 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-04-19T03:01:14.615919+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=14, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:05:20.063 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-04-19T03:01:14.615919+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=14, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:05:20.063 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-04-19T03:01:14.615919+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=14, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:05:20.063 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-04-19T03:01:14.615919+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=14, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:05:20.063 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-04-19T03:01:14.615919+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=14, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:05:20.063 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-04-19T03:01:14.615919+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=14, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:05:20.064 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-04-19T03:01:14.615919+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=14, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:05:20.064 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-04-19T03:01:14.615919+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=14, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:05:20.064 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-04-19T03:01:14.615919+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=14, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:05:20.064 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-04-19T03:01:14.615919+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=14, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:05:20.064 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-04-19T03:01:14.615919+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=14, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:05:20.064 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-04-19T03:01:14.615919+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=14, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:05:20.064 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-04-19T03:01:14.615919+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=14, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:05:20.064 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-04-19T03:01:14.615919+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=14, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:05:20.065 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-04-19T03:01:14.615919+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=14, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:05:20.065 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-04-19T03:01:14.615919+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=14, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:05:20.065 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-04-19T03:01:14.615919+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=14, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:05:20.065 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-04-19T03:01:14.615919+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=14, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:05:20.065 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-04-19T03:01:14.615919+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=14, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:05:20.065 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-04-19T03:01:14.615919+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=14, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:05:20.065 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-04-19T03:01:14.615919+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=14, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:05:20.065 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-04-19T03:01:14.615919+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=14, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:05:20.065 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-04-19T03:01:14.615919+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=14, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:05:20.066 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-04-19T03:01:14.615919+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=14, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:05:20.066 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-04-19T03:01:13.604133+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=13, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:05:20.066 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-04-19T03:01:14.615919+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=14, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:05:20.066 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-04-19T03:01:13.604133+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=13, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:05:20.066 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-04-19T03:01:14.615919+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=14, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:05:20.066 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-04-19T03:01:13.604133+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=13, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:05:20.066 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-04-19T03:01:14.615919+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=14, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:05:20.066 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-04-19T03:01:13.604133+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=13, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:05:20.066 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-04-19T03:01:13.604133+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=13, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:05:20.067 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-04-19T03:01:14.615919+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=14, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:05:20.067 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-04-19T03:01:13.604133+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=13, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:05:20.067 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-04-19T03:01:14.615919+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=14, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:05:20.067 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-04-19T03:01:13.604133+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=13, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:05:20.067 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-04-19T03:01:14.615919+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=14, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:05:20.067 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-04-19T03:01:13.604133+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=13, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:05:20.067 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-04-19T03:01:14.615919+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=14, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:05:20.067 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-04-19T03:01:13.604133+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=13, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:05:20.067 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-04-19T03:01:14.615919+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=14, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:05:20.067 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-04-19T03:01:13.604133+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=13, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:05:20.068 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-04-19T03:01:14.615919+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=14, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:05:20.068 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-04-19T03:01:13.604133+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=13, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:05:20.068 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-04-19T03:01:14.615919+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=14, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:05:20.068 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-04-19T03:01:13.604133+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=13, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:05:20.068 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-04-19T03:01:14.615919+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=14, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:05:20.068 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-04-19T03:01:06.516863+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=6, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:05:20.068 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-04-19T03:01:09.578660+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=9, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:05:20.068 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-04-19T03:01:13.604133+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=13, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:05:20.068 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-04-19T03:01:14.615919+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=14, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:05:20.069 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-04-19T03:01:09.578660+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=9, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:05:20.069 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-04-19T03:01:13.604133+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=13, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:05:20.069 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-04-19T03:01:14.615919+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=14, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:05:20.069 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-04-19T03:01:09.578660+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=9, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:05:20.069 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-04-19T03:01:13.604133+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=13, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:05:20.069 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-04-19T03:01:14.615919+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=14, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:05:20.069 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-04-19T03:01:09.578660+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=9, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:05:20.069 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-04-19T03:01:13.604133+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=13, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:05:20.070 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-04-19T03:01:14.615919+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=14, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:05:20.070 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-04-19T03:01:13.604133+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=13, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:05:20.070 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-04-19T03:01:09.578660+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=9, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:05:20.070 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-04-19T03:01:14.615919+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=14, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:05:20.070 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-04-19T03:01:13.604133+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=13, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:05:20.070 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-04-19T03:01:09.578660+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=9, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:05:20.070 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-04-19T03:01:14.615919+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=14, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:05:20.070 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-04-19T03:01:13.604133+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=13, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:05:20.071 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-04-19T03:01:09.578660+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=9, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:05:20.071 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-04-19T03:01:14.615919+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=14, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:05:20.071 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-04-19T03:01:13.604133+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=13, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:05:20.071 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-04-19T03:01:09.578660+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=9, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:05:20.071 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-04-19T03:01:14.615919+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=14, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:05:20.071 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-04-19T03:01:14.615919+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=14, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:05:20.071 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-04-19T03:01:13.604133+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=13, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:05:20.071 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-04-19T03:01:14.615919+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=14, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:05:20.072 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-04-19T03:01:13.604133+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=13, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:05:20.072 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-04-19T03:01:13.604133+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=13, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:05:20.072 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-04-19T03:01:14.615919+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=14, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:05:20.072 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-04-19T03:01:13.604133+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=13, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:05:20.072 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-04-19T03:01:14.615919+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=14, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:05:20.072 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-04-19T03:01:14.615919+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=14, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:05:20.072 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-04-19T03:01:13.604133+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=13, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:05:20.072 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-04-19T03:01:14.615919+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=14, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:05:20.072 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-04-19T03:01:13.604133+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=13, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:05:20.073 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-04-19T03:01:14.615919+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=14, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:05:20.073 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-04-19T03:01:13.604133+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=13, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:05:20.073 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-04-19T03:01:14.615919+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=14, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:05:20.073 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-04-19T03:01:13.604133+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=13, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:05:20.073 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-04-19T03:01:14.615919+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=14, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:05:20.073 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-04-19T03:01:13.604133+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=13, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:05:20.073 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-04-19T03:01:14.615919+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=14, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:05:20.073 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-04-19T03:01:13.604133+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=13, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:05:20.074 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-04-19T03:01:14.615919+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=14, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:05:20.074 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-04-19T03:01:13.604133+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=13, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:05:20.074 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-04-19T03:01:14.615919+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=14, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:05:20.074 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-04-19T03:01:13.604133+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=13, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:05:20.074 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-19T03:05:40.075 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-19T03:05:40.385 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-19T03:05:40.387 INFO:teuthology.orchestra.run.smithi096.stderr:dumped all 2024-04-19T03:05:40.403 INFO:teuthology.orchestra.run.smithi096.stdout:{"pg_ready":true,"pg_map":{"version":215,"stamp":"2024-04-19T03:05:40.060039+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":200,"ondisk_log_size":200,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":475164,"kb_used_data":2692,"kb_used_omap":9,"kb_used_meta":472438,"kb_avail":282640356,"statfs":{"total":289910292480,"available":289423724544,"internally_reserved":0,"allocated":2756608,"data_stored":2200981,"data_compressed":14482,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":10071,"internal_metadata":483776681},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004175"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":79,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:19.241382+0000","last_change":"2024-04-19T03:05:09.396661+0000","last_active":"2024-04-19T03:05:19.241382+0000","last_peered":"2024-04-19T03:05:19.241382+0000","last_clean":"2024-04-19T03:05:19.241382+0000","last_became_active":"2024-04-19T03:05:09.396279+0000","last_became_peered":"2024-04-19T03:05:09.396279+0000","last_unstale":"2024-04-19T03:05:19.241382+0000","last_undegraded":"2024-04-19T03:05:19.241382+0000","last_fullsized":"2024-04-19T03:05:19.241382+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":86,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:19.241391+0000","last_change":"2024-04-19T03:04:50.278334+0000","last_active":"2024-04-19T03:05:19.241391+0000","last_peered":"2024-04-19T03:05:19.241391+0000","last_clean":"2024-04-19T03:05:19.241391+0000","last_became_active":"2024-04-19T03:04:50.277848+0000","last_became_peered":"2024-04-19T03:04:50.277848+0000","last_unstale":"2024-04-19T03:05:19.241391+0000","last_undegraded":"2024-04-19T03:05:19.241391+0000","last_fullsized":"2024-04-19T03:05:19.241391+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":73,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:19.714830+0000","last_change":"2024-04-19T03:01:15.015884+0000","last_active":"2024-04-19T03:05:19.714830+0000","last_peered":"2024-04-19T03:05:19.714830+0000","last_clean":"2024-04-19T03:05:19.714830+0000","last_became_active":"2024-04-19T03:01:15.014599+0000","last_became_peered":"2024-04-19T03:01:15.014599+0000","last_unstale":"2024-04-19T03:05:19.714830+0000","last_undegraded":"2024-04-19T03:05:19.714830+0000","last_fullsized":"2024-04-19T03:05:19.714830+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":86,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:15.175568+0000","last_change":"2024-04-19T03:04:50.275017+0000","last_active":"2024-04-19T03:05:15.175568+0000","last_peered":"2024-04-19T03:05:15.175568+0000","last_clean":"2024-04-19T03:05:15.175568+0000","last_became_active":"2024-04-19T03:04:50.274600+0000","last_became_peered":"2024-04-19T03:04:50.274600+0000","last_unstale":"2024-04-19T03:05:15.175568+0000","last_undegraded":"2024-04-19T03:05:15.175568+0000","last_fullsized":"2024-04-19T03:05:15.175568+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":78,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:12.420738+0000","last_change":"2024-04-19T03:05:09.397682+0000","last_active":"2024-04-19T03:05:12.420738+0000","last_peered":"2024-04-19T03:05:12.420738+0000","last_clean":"2024-04-19T03:05:12.420738+0000","last_became_active":"2024-04-19T03:05:09.395929+0000","last_became_peered":"2024-04-19T03:05:09.395929+0000","last_unstale":"2024-04-19T03:05:12.420738+0000","last_undegraded":"2024-04-19T03:05:12.420738+0000","last_fullsized":"2024-04-19T03:05:12.420738+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":71,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:12.903702+0000","last_change":"2024-04-19T03:05:11.428461+0000","last_active":"2024-04-19T03:05:12.903702+0000","last_peered":"2024-04-19T03:05:12.903702+0000","last_clean":"2024-04-19T03:05:12.903702+0000","last_became_active":"2024-04-19T03:05:11.426617+0000","last_became_peered":"2024-04-19T03:05:11.426617+0000","last_unstale":"2024-04-19T03:05:12.903702+0000","last_undegraded":"2024-04-19T03:05:12.903702+0000","last_fullsized":"2024-04-19T03:05:12.903702+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":71,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:12.903777+0000","last_change":"2024-04-19T03:05:11.424581+0000","last_active":"2024-04-19T03:05:12.903777+0000","last_peered":"2024-04-19T03:05:12.903777+0000","last_clean":"2024-04-19T03:05:12.903777+0000","last_became_active":"2024-04-19T03:05:11.422727+0000","last_became_peered":"2024-04-19T03:05:11.422727+0000","last_unstale":"2024-04-19T03:05:12.903777+0000","last_undegraded":"2024-04-19T03:05:12.903777+0000","last_fullsized":"2024-04-19T03:05:12.903777+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":85,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:12.902860+0000","last_change":"2024-04-19T03:04:50.261359+0000","last_active":"2024-04-19T03:05:12.902860+0000","last_peered":"2024-04-19T03:05:12.902860+0000","last_clean":"2024-04-19T03:05:12.902860+0000","last_became_active":"2024-04-19T03:04:50.261155+0000","last_became_peered":"2024-04-19T03:04:50.261155+0000","last_unstale":"2024-04-19T03:05:12.902860+0000","last_undegraded":"2024-04-19T03:05:12.902860+0000","last_fullsized":"2024-04-19T03:05:12.902860+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":41,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:23.156874+0000","last_change":"2024-04-19T03:05:23.156992+0000","last_active":"2024-04-19T03:05:23.156874+0000","last_peered":"2024-04-19T03:05:23.156874+0000","last_clean":"2024-04-19T03:05:23.156874+0000","last_became_active":"2024-04-19T03:04:50.611400+0000","last_became_peered":"2024-04-19T03:04:50.611400+0000","last_unstale":"2024-04-19T03:05:23.156874+0000","last_undegraded":"2024-04-19T03:05:23.156874+0000","last_fullsized":"2024-04-19T03:05:23.156874+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:05:23.156852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:05:23.156852+0000","last_clean_scrub_stamp":"2024-04-19T03:05:23.156852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:00:45.201755+0000","scrub_duration":0.036684305,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":85,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:12.421779+0000","last_change":"2024-04-19T03:04:50.278337+0000","last_active":"2024-04-19T03:05:12.421779+0000","last_peered":"2024-04-19T03:05:12.421779+0000","last_clean":"2024-04-19T03:05:12.421779+0000","last_became_active":"2024-04-19T03:04:50.277899+0000","last_became_peered":"2024-04-19T03:04:50.277899+0000","last_unstale":"2024-04-19T03:05:12.421779+0000","last_undegraded":"2024-04-19T03:05:12.421779+0000","last_fullsized":"2024-04-19T03:05:12.421779+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":71,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:12.904951+0000","last_change":"2024-04-19T03:05:11.430574+0000","last_active":"2024-04-19T03:05:12.904951+0000","last_peered":"2024-04-19T03:05:12.904951+0000","last_clean":"2024-04-19T03:05:12.904951+0000","last_became_active":"2024-04-19T03:05:11.430243+0000","last_became_peered":"2024-04-19T03:05:11.430243+0000","last_unstale":"2024-04-19T03:05:12.904951+0000","last_undegraded":"2024-04-19T03:05:12.904951+0000","last_fullsized":"2024-04-19T03:05:12.904951+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":62,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:30.443577+0000","last_change":"2024-04-19T03:05:30.443804+0000","last_active":"2024-04-19T03:05:30.443577+0000","last_peered":"2024-04-19T03:05:30.443577+0000","last_clean":"2024-04-19T03:05:30.443577+0000","last_became_active":"2024-04-19T03:05:09.392822+0000","last_became_peered":"2024-04-19T03:05:09.392822+0000","last_unstale":"2024-04-19T03:05:30.443577+0000","last_undegraded":"2024-04-19T03:05:30.443577+0000","last_fullsized":"2024-04-19T03:05:30.443577+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:05:30.443531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:05:30.443531+0000","last_clean_scrub_stamp":"2024-04-19T03:05:30.443531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:43:21.406385+0000","scrub_duration":0.0030470290000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":78,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:12.420621+0000","last_change":"2024-04-19T03:05:09.397000+0000","last_active":"2024-04-19T03:05:12.420621+0000","last_peered":"2024-04-19T03:05:12.420621+0000","last_clean":"2024-04-19T03:05:12.420621+0000","last_became_active":"2024-04-19T03:05:09.395749+0000","last_became_peered":"2024-04-19T03:05:09.395749+0000","last_unstale":"2024-04-19T03:05:12.420621+0000","last_undegraded":"2024-04-19T03:05:12.420621+0000","last_fullsized":"2024-04-19T03:05:12.420621+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":72,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:12.903837+0000","last_change":"2024-04-19T03:01:15.010960+0000","last_active":"2024-04-19T03:05:12.903837+0000","last_peered":"2024-04-19T03:05:12.903837+0000","last_clean":"2024-04-19T03:05:12.903837+0000","last_became_active":"2024-04-19T03:01:15.010472+0000","last_became_peered":"2024-04-19T03:01:15.010472+0000","last_unstale":"2024-04-19T03:05:12.903837+0000","last_undegraded":"2024-04-19T03:05:12.903837+0000","last_fullsized":"2024-04-19T03:05:12.903837+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":74,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:12.903995+0000","last_change":"2024-04-19T03:05:11.428285+0000","last_active":"2024-04-19T03:05:12.903995+0000","last_peered":"2024-04-19T03:05:12.903995+0000","last_clean":"2024-04-19T03:05:12.903995+0000","last_became_active":"2024-04-19T03:05:11.425921+0000","last_became_peered":"2024-04-19T03:05:11.425921+0000","last_unstale":"2024-04-19T03:05:12.903995+0000","last_undegraded":"2024-04-19T03:05:12.903995+0000","last_fullsized":"2024-04-19T03:05:12.903995+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":71,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:12.903032+0000","last_change":"2024-04-19T03:05:11.429030+0000","last_active":"2024-04-19T03:05:12.903032+0000","last_peered":"2024-04-19T03:05:12.903032+0000","last_clean":"2024-04-19T03:05:12.903032+0000","last_became_active":"2024-04-19T03:05:11.425921+0000","last_became_peered":"2024-04-19T03:05:11.425921+0000","last_unstale":"2024-04-19T03:05:12.903032+0000","last_undegraded":"2024-04-19T03:05:12.903032+0000","last_fullsized":"2024-04-19T03:05:12.903032+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:12.769683+0000","last_change":"2024-04-19T03:04:50.611757+0000","last_active":"2024-04-19T03:05:12.769683+0000","last_peered":"2024-04-19T03:05:12.769683+0000","last_clean":"2024-04-19T03:05:12.769683+0000","last_became_active":"2024-04-19T03:04:50.611392+0000","last_became_peered":"2024-04-19T03:04:50.611392+0000","last_unstale":"2024-04-19T03:05:12.769683+0000","last_undegraded":"2024-04-19T03:05:12.769683+0000","last_fullsized":"2024-04-19T03:05:12.769683+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":89,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:19.348648+0000","last_change":"2024-04-19T03:05:19.348906+0000","last_active":"2024-04-19T03:05:19.348648+0000","last_peered":"2024-04-19T03:05:19.348648+0000","last_clean":"2024-04-19T03:05:19.348648+0000","last_became_active":"2024-04-19T03:05:09.395682+0000","last_became_peered":"2024-04-19T03:05:09.395682+0000","last_unstale":"2024-04-19T03:05:19.348648+0000","last_undegraded":"2024-04-19T03:05:19.348648+0000","last_fullsized":"2024-04-19T03:05:19.348648+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:05:19.348599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:05:19.348599+0000","last_clean_scrub_stamp":"2024-04-19T03:05:19.348599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:22:58.194899+0000","scrub_duration":0.0032195190000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:12.769025+0000","last_change":"2024-04-19T03:04:50.613858+0000","last_active":"2024-04-19T03:05:12.769025+0000","last_peered":"2024-04-19T03:05:12.769025+0000","last_clean":"2024-04-19T03:05:12.769025+0000","last_became_active":"2024-04-19T03:04:50.613481+0000","last_became_peered":"2024-04-19T03:04:50.613481+0000","last_unstale":"2024-04-19T03:05:12.769025+0000","last_undegraded":"2024-04-19T03:05:12.769025+0000","last_fullsized":"2024-04-19T03:05:12.769025+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":87,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:12.904372+0000","last_change":"2024-04-19T03:05:11.431719+0000","last_active":"2024-04-19T03:05:12.904372+0000","last_peered":"2024-04-19T03:05:12.904372+0000","last_clean":"2024-04-19T03:05:12.904372+0000","last_became_active":"2024-04-19T03:05:11.431352+0000","last_became_peered":"2024-04-19T03:05:11.431352+0000","last_unstale":"2024-04-19T03:05:12.904372+0000","last_undegraded":"2024-04-19T03:05:12.904372+0000","last_fullsized":"2024-04-19T03:05:12.904372+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":85,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:12.904263+0000","last_change":"2024-04-19T03:04:50.276678+0000","last_active":"2024-04-19T03:05:12.904263+0000","last_peered":"2024-04-19T03:05:12.904263+0000","last_clean":"2024-04-19T03:05:12.904263+0000","last_became_active":"2024-04-19T03:04:50.275510+0000","last_became_peered":"2024-04-19T03:04:50.275510+0000","last_unstale":"2024-04-19T03:05:12.904263+0000","last_undegraded":"2024-04-19T03:05:12.904263+0000","last_fullsized":"2024-04-19T03:05:12.904263+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":72,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:12.420428+0000","last_change":"2024-04-19T03:01:15.020108+0000","last_active":"2024-04-19T03:05:12.420428+0000","last_peered":"2024-04-19T03:05:12.420428+0000","last_clean":"2024-04-19T03:05:12.420428+0000","last_became_active":"2024-04-19T03:01:15.018978+0000","last_became_peered":"2024-04-19T03:01:15.018978+0000","last_unstale":"2024-04-19T03:05:12.420428+0000","last_undegraded":"2024-04-19T03:05:12.420428+0000","last_fullsized":"2024-04-19T03:05:12.420428+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":41,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:27.084506+0000","last_change":"2024-04-19T03:05:27.084833+0000","last_active":"2024-04-19T03:05:27.084506+0000","last_peered":"2024-04-19T03:05:27.084506+0000","last_clean":"2024-04-19T03:05:27.084506+0000","last_became_active":"2024-04-19T03:04:50.630948+0000","last_became_peered":"2024-04-19T03:04:50.630948+0000","last_unstale":"2024-04-19T03:05:27.084506+0000","last_undegraded":"2024-04-19T03:05:27.084506+0000","last_fullsized":"2024-04-19T03:05:27.084506+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:05:27.084457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:05:27.084457+0000","last_clean_scrub_stamp":"2024-04-19T03:05:27.084457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:43:47.014628+0000","scrub_duration":0.0031579899999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":79,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:19.241161+0000","last_change":"2024-04-19T03:05:09.391159+0000","last_active":"2024-04-19T03:05:19.241161+0000","last_peered":"2024-04-19T03:05:19.241161+0000","last_clean":"2024-04-19T03:05:19.241161+0000","last_became_active":"2024-04-19T03:05:09.390922+0000","last_became_peered":"2024-04-19T03:05:09.390922+0000","last_unstale":"2024-04-19T03:05:19.241161+0000","last_undegraded":"2024-04-19T03:05:19.241161+0000","last_fullsized":"2024-04-19T03:05:19.241161+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":62,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:21.387816+0000","last_change":"2024-04-19T03:05:21.387930+0000","last_active":"2024-04-19T03:05:21.387816+0000","last_peered":"2024-04-19T03:05:21.387816+0000","last_clean":"2024-04-19T03:05:21.387816+0000","last_became_active":"2024-04-19T03:05:09.393108+0000","last_became_peered":"2024-04-19T03:05:09.393108+0000","last_unstale":"2024-04-19T03:05:21.387816+0000","last_undegraded":"2024-04-19T03:05:21.387816+0000","last_fullsized":"2024-04-19T03:05:21.387816+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:05:21.387796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:05:21.387796+0000","last_clean_scrub_stamp":"2024-04-19T03:05:21.387796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:19:53.306617+0000","scrub_duration":0.042477411999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:12.769547+0000","last_change":"2024-04-19T03:04:50.626923+0000","last_active":"2024-04-19T03:05:12.769547+0000","last_peered":"2024-04-19T03:05:12.769547+0000","last_clean":"2024-04-19T03:05:12.769547+0000","last_became_active":"2024-04-19T03:04:50.617603+0000","last_became_peered":"2024-04-19T03:04:50.617603+0000","last_unstale":"2024-04-19T03:05:12.769547+0000","last_undegraded":"2024-04-19T03:05:12.769547+0000","last_fullsized":"2024-04-19T03:05:12.769547+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":39,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:13.201146+0000","last_change":"2024-04-19T03:05:11.431713+0000","last_active":"2024-04-19T03:05:13.201146+0000","last_peered":"2024-04-19T03:05:13.201146+0000","last_clean":"2024-04-19T03:05:13.201146+0000","last_became_active":"2024-04-19T03:05:11.431129+0000","last_became_peered":"2024-04-19T03:05:11.431129+0000","last_unstale":"2024-04-19T03:05:13.201146+0000","last_undegraded":"2024-04-19T03:05:13.201146+0000","last_fullsized":"2024-04-19T03:05:13.201146+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":73,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:19.241426+0000","last_change":"2024-04-19T03:01:15.020098+0000","last_active":"2024-04-19T03:05:19.241426+0000","last_peered":"2024-04-19T03:05:19.241426+0000","last_clean":"2024-04-19T03:05:19.241426+0000","last_became_active":"2024-04-19T03:01:15.019064+0000","last_became_peered":"2024-04-19T03:01:15.019064+0000","last_unstale":"2024-04-19T03:05:19.241426+0000","last_undegraded":"2024-04-19T03:05:19.241426+0000","last_fullsized":"2024-04-19T03:05:19.241426+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:12.768539+0000","last_change":"2024-04-19T03:04:50.616823+0000","last_active":"2024-04-19T03:05:12.768539+0000","last_peered":"2024-04-19T03:05:12.768539+0000","last_clean":"2024-04-19T03:05:12.768539+0000","last_became_active":"2024-04-19T03:04:50.616550+0000","last_became_peered":"2024-04-19T03:04:50.616550+0000","last_unstale":"2024-04-19T03:05:12.768539+0000","last_undegraded":"2024-04-19T03:05:12.768539+0000","last_fullsized":"2024-04-19T03:05:12.768539+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":51,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:12.420658+0000","last_change":"2024-04-19T03:05:09.394074+0000","last_active":"2024-04-19T03:05:12.420658+0000","last_peered":"2024-04-19T03:05:12.420658+0000","last_clean":"2024-04-19T03:05:12.420658+0000","last_became_active":"2024-04-19T03:05:09.393178+0000","last_became_peered":"2024-04-19T03:05:09.393178+0000","last_unstale":"2024-04-19T03:05:12.420658+0000","last_undegraded":"2024-04-19T03:05:12.420658+0000","last_fullsized":"2024-04-19T03:05:12.420658+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:12.768806+0000","last_change":"2024-04-19T03:04:50.635141+0000","last_active":"2024-04-19T03:05:12.768806+0000","last_peered":"2024-04-19T03:05:12.768806+0000","last_clean":"2024-04-19T03:05:12.768806+0000","last_became_active":"2024-04-19T03:04:50.633033+0000","last_became_peered":"2024-04-19T03:04:50.633033+0000","last_unstale":"2024-04-19T03:05:12.768806+0000","last_undegraded":"2024-04-19T03:05:12.768806+0000","last_fullsized":"2024-04-19T03:05:12.768806+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":86,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:19.714333+0000","last_change":"2024-04-19T03:04:50.279507+0000","last_active":"2024-04-19T03:05:19.714333+0000","last_peered":"2024-04-19T03:05:19.714333+0000","last_clean":"2024-04-19T03:05:19.714333+0000","last_became_active":"2024-04-19T03:04:50.278996+0000","last_became_peered":"2024-04-19T03:04:50.278996+0000","last_unstale":"2024-04-19T03:05:19.714333+0000","last_undegraded":"2024-04-19T03:05:19.714333+0000","last_fullsized":"2024-04-19T03:05:19.714333+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":89,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:34.468350+0000","last_change":"2024-04-19T03:05:34.468578+0000","last_active":"2024-04-19T03:05:34.468350+0000","last_peered":"2024-04-19T03:05:34.468350+0000","last_clean":"2024-04-19T03:05:34.468350+0000","last_became_active":"2024-04-19T03:05:09.395920+0000","last_became_peered":"2024-04-19T03:05:09.395920+0000","last_unstale":"2024-04-19T03:05:34.468350+0000","last_undegraded":"2024-04-19T03:05:34.468350+0000","last_fullsized":"2024-04-19T03:05:34.468350+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:05:34.468305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:05:34.468305+0000","last_clean_scrub_stamp":"2024-04-19T03:05:34.468305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:54:24.688379+0000","scrub_duration":0.003618422,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"20'2","reported_seq":88,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:12.904323+0000","last_change":"2024-04-19T03:04:50.277421+0000","last_active":"2024-04-19T03:05:12.904323+0000","last_peered":"2024-04-19T03:05:12.904323+0000","last_clean":"2024-04-19T03:05:12.904323+0000","last_became_active":"2024-04-19T03:04:50.276732+0000","last_became_peered":"2024-04-19T03:04:50.276732+0000","last_unstale":"2024-04-19T03:05:12.904323+0000","last_undegraded":"2024-04-19T03:05:12.904323+0000","last_fullsized":"2024-04-19T03:05:12.904323+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":78,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:12.421558+0000","last_change":"2024-04-19T03:05:09.395454+0000","last_active":"2024-04-19T03:05:12.421558+0000","last_peered":"2024-04-19T03:05:12.421558+0000","last_clean":"2024-04-19T03:05:12.421558+0000","last_became_active":"2024-04-19T03:05:09.394288+0000","last_became_peered":"2024-04-19T03:05:09.394288+0000","last_unstale":"2024-04-19T03:05:12.421558+0000","last_undegraded":"2024-04-19T03:05:12.421558+0000","last_fullsized":"2024-04-19T03:05:12.421558+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":31,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:12.768520+0000","last_change":"2024-04-19T03:04:50.628801+0000","last_active":"2024-04-19T03:05:12.768520+0000","last_peered":"2024-04-19T03:05:12.768520+0000","last_clean":"2024-04-19T03:05:12.768520+0000","last_became_active":"2024-04-19T03:04:50.628023+0000","last_became_peered":"2024-04-19T03:04:50.628023+0000","last_unstale":"2024-04-19T03:05:12.768520+0000","last_undegraded":"2024-04-19T03:05:12.768520+0000","last_fullsized":"2024-04-19T03:05:12.768520+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":41,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:22.156343+0000","last_change":"2024-04-19T03:05:22.156583+0000","last_active":"2024-04-19T03:05:22.156343+0000","last_peered":"2024-04-19T03:05:22.156343+0000","last_clean":"2024-04-19T03:05:22.156343+0000","last_became_active":"2024-04-19T03:04:50.613860+0000","last_became_peered":"2024-04-19T03:04:50.613860+0000","last_unstale":"2024-04-19T03:05:22.156343+0000","last_undegraded":"2024-04-19T03:05:22.156343+0000","last_fullsized":"2024-04-19T03:05:22.156343+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:05:22.156296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:05:22.156296+0000","last_clean_scrub_stamp":"2024-04-19T03:05:22.156296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:47:31.989944+0000","scrub_duration":0.0031789600000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":73,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:12.420274+0000","last_change":"2024-04-19T03:01:14.649074+0000","last_active":"2024-04-19T03:05:12.420274+0000","last_peered":"2024-04-19T03:05:12.420274+0000","last_clean":"2024-04-19T03:05:12.420274+0000","last_became_active":"2024-04-19T03:01:14.648217+0000","last_became_peered":"2024-04-19T03:01:14.648217+0000","last_unstale":"2024-04-19T03:05:12.420274+0000","last_undegraded":"2024-04-19T03:05:12.420274+0000","last_fullsized":"2024-04-19T03:05:12.420274+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:12.769444+0000","last_change":"2024-04-19T03:04:50.611026+0000","last_active":"2024-04-19T03:05:12.769444+0000","last_peered":"2024-04-19T03:05:12.769444+0000","last_clean":"2024-04-19T03:05:12.769444+0000","last_became_active":"2024-04-19T03:04:50.610659+0000","last_became_peered":"2024-04-19T03:04:50.610659+0000","last_unstale":"2024-04-19T03:05:12.769444+0000","last_undegraded":"2024-04-19T03:05:12.769444+0000","last_fullsized":"2024-04-19T03:05:12.769444+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"20'8","reported_seq":86,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:12.903366+0000","last_change":"2024-04-19T03:05:11.429829+0000","last_active":"2024-04-19T03:05:12.903366+0000","last_peered":"2024-04-19T03:05:12.903366+0000","last_clean":"2024-04-19T03:05:12.903366+0000","last_became_active":"2024-04-19T03:05:11.428668+0000","last_became_peered":"2024-04-19T03:05:11.428668+0000","last_unstale":"2024-04-19T03:05:12.903366+0000","last_undegraded":"2024-04-19T03:05:12.903366+0000","last_fullsized":"2024-04-19T03:05:12.903366+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"20'1","reported_seq":74,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:12.905376+0000","last_change":"2024-04-19T03:01:14.649839+0000","last_active":"2024-04-19T03:05:12.905376+0000","last_peered":"2024-04-19T03:05:12.905376+0000","last_clean":"2024-04-19T03:05:12.905376+0000","last_became_active":"2024-04-19T03:01:14.649571+0000","last_became_peered":"2024-04-19T03:01:14.649571+0000","last_unstale":"2024-04-19T03:05:12.905376+0000","last_undegraded":"2024-04-19T03:05:12.905376+0000","last_fullsized":"2024-04-19T03:05:12.905376+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":54,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:12.419874+0000","last_change":"2024-04-19T03:05:02.362526+0000","last_active":"2024-04-19T03:05:12.419874+0000","last_peered":"2024-04-19T03:05:12.419874+0000","last_clean":"2024-04-19T03:05:12.419874+0000","last_became_active":"2024-04-19T03:05:02.362227+0000","last_became_peered":"2024-04-19T03:05:02.362227+0000","last_unstale":"2024-04-19T03:05:12.419874+0000","last_undegraded":"2024-04-19T03:05:12.419874+0000","last_fullsized":"2024-04-19T03:05:12.419874+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"20'2","reported_seq":75,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:12.422123+0000","last_change":"2024-04-19T03:01:14.645075+0000","last_active":"2024-04-19T03:05:12.422123+0000","last_peered":"2024-04-19T03:05:12.422123+0000","last_clean":"2024-04-19T03:05:12.422123+0000","last_became_active":"2024-04-19T03:01:14.644790+0000","last_became_peered":"2024-04-19T03:01:14.644790+0000","last_unstale":"2024-04-19T03:05:12.422123+0000","last_undegraded":"2024-04-19T03:05:12.422123+0000","last_fullsized":"2024-04-19T03:05:12.422123+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":79,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:19.240928+0000","last_change":"2024-04-19T03:05:09.393128+0000","last_active":"2024-04-19T03:05:19.240928+0000","last_peered":"2024-04-19T03:05:19.240928+0000","last_clean":"2024-04-19T03:05:19.240928+0000","last_became_active":"2024-04-19T03:05:09.392736+0000","last_became_peered":"2024-04-19T03:05:09.392736+0000","last_unstale":"2024-04-19T03:05:19.240928+0000","last_undegraded":"2024-04-19T03:05:19.240928+0000","last_fullsized":"2024-04-19T03:05:19.240928+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"20'1","reported_seq":41,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:13.201186+0000","last_change":"2024-04-19T03:05:11.431892+0000","last_active":"2024-04-19T03:05:13.201186+0000","last_peered":"2024-04-19T03:05:13.201186+0000","last_clean":"2024-04-19T03:05:13.201186+0000","last_became_active":"2024-04-19T03:05:11.431552+0000","last_became_peered":"2024-04-19T03:05:11.431552+0000","last_unstale":"2024-04-19T03:05:13.201186+0000","last_undegraded":"2024-04-19T03:05:13.201186+0000","last_fullsized":"2024-04-19T03:05:13.201186+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":86,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:19.714139+0000","last_change":"2024-04-19T03:04:50.277960+0000","last_active":"2024-04-19T03:05:19.714139+0000","last_peered":"2024-04-19T03:05:19.714139+0000","last_clean":"2024-04-19T03:05:19.714139+0000","last_became_active":"2024-04-19T03:04:50.277126+0000","last_became_peered":"2024-04-19T03:04:50.277126+0000","last_unstale":"2024-04-19T03:05:19.714139+0000","last_undegraded":"2024-04-19T03:05:19.714139+0000","last_fullsized":"2024-04-19T03:05:19.714139+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":72,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:12.904828+0000","last_change":"2024-04-19T03:05:11.429040+0000","last_active":"2024-04-19T03:05:12.904828+0000","last_peered":"2024-04-19T03:05:12.904828+0000","last_clean":"2024-04-19T03:05:12.904828+0000","last_became_active":"2024-04-19T03:05:11.428722+0000","last_became_peered":"2024-04-19T03:05:11.428722+0000","last_unstale":"2024-04-19T03:05:12.904828+0000","last_undegraded":"2024-04-19T03:05:12.904828+0000","last_fullsized":"2024-04-19T03:05:12.904828+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:12.770284+0000","last_change":"2024-04-19T03:04:50.627120+0000","last_active":"2024-04-19T03:05:12.770284+0000","last_peered":"2024-04-19T03:05:12.770284+0000","last_clean":"2024-04-19T03:05:12.770284+0000","last_became_active":"2024-04-19T03:04:50.625919+0000","last_became_peered":"2024-04-19T03:04:50.625919+0000","last_unstale":"2024-04-19T03:05:12.770284+0000","last_undegraded":"2024-04-19T03:05:12.770284+0000","last_fullsized":"2024-04-19T03:05:12.770284+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"20'2","reported_seq":33,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:12.769661+0000","last_change":"2024-04-19T03:04:50.627277+0000","last_active":"2024-04-19T03:05:12.769661+0000","last_peered":"2024-04-19T03:05:12.769661+0000","last_clean":"2024-04-19T03:05:12.769661+0000","last_became_active":"2024-04-19T03:04:50.625931+0000","last_became_peered":"2024-04-19T03:04:50.625931+0000","last_unstale":"2024-04-19T03:05:12.769661+0000","last_undegraded":"2024-04-19T03:05:12.769661+0000","last_fullsized":"2024-04-19T03:05:12.769661+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":87,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:12.904466+0000","last_change":"2024-04-19T03:05:11.430496+0000","last_active":"2024-04-19T03:05:12.904466+0000","last_peered":"2024-04-19T03:05:12.904466+0000","last_clean":"2024-04-19T03:05:12.904466+0000","last_became_active":"2024-04-19T03:05:11.430149+0000","last_became_peered":"2024-04-19T03:05:11.430149+0000","last_unstale":"2024-04-19T03:05:12.904466+0000","last_undegraded":"2024-04-19T03:05:12.904466+0000","last_fullsized":"2024-04-19T03:05:12.904466+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":87,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:19.713774+0000","last_change":"2024-04-19T03:04:50.278491+0000","last_active":"2024-04-19T03:05:19.713774+0000","last_peered":"2024-04-19T03:05:19.713774+0000","last_clean":"2024-04-19T03:05:19.713774+0000","last_became_active":"2024-04-19T03:04:50.277603+0000","last_became_peered":"2024-04-19T03:04:50.277603+0000","last_unstale":"2024-04-19T03:05:19.713774+0000","last_undegraded":"2024-04-19T03:05:19.713774+0000","last_fullsized":"2024-04-19T03:05:19.713774+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":72,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:12.905472+0000","last_change":"2024-04-19T03:01:15.015685+0000","last_active":"2024-04-19T03:05:12.905472+0000","last_peered":"2024-04-19T03:05:12.905472+0000","last_clean":"2024-04-19T03:05:12.905472+0000","last_became_active":"2024-04-19T03:01:15.014847+0000","last_became_peered":"2024-04-19T03:01:15.014847+0000","last_unstale":"2024-04-19T03:05:12.905472+0000","last_undegraded":"2024-04-19T03:05:12.905472+0000","last_fullsized":"2024-04-19T03:05:12.905472+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":52,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:12.421001+0000","last_change":"2024-04-19T03:05:09.392582+0000","last_active":"2024-04-19T03:05:12.421001+0000","last_peered":"2024-04-19T03:05:12.421001+0000","last_clean":"2024-04-19T03:05:12.421001+0000","last_became_active":"2024-04-19T03:05:09.391218+0000","last_became_peered":"2024-04-19T03:05:09.391218+0000","last_unstale":"2024-04-19T03:05:12.421001+0000","last_undegraded":"2024-04-19T03:05:12.421001+0000","last_fullsized":"2024-04-19T03:05:12.421001+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":72,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:12.904680+0000","last_change":"2024-04-19T03:01:15.014818+0000","last_active":"2024-04-19T03:05:12.904680+0000","last_peered":"2024-04-19T03:05:12.904680+0000","last_clean":"2024-04-19T03:05:12.904680+0000","last_became_active":"2024-04-19T03:01:15.014421+0000","last_became_peered":"2024-04-19T03:01:15.014421+0000","last_unstale":"2024-04-19T03:05:12.904680+0000","last_undegraded":"2024-04-19T03:05:12.904680+0000","last_fullsized":"2024-04-19T03:05:12.904680+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":80,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:19.240401+0000","last_change":"2024-04-19T03:05:09.395629+0000","last_active":"2024-04-19T03:05:19.240401+0000","last_peered":"2024-04-19T03:05:19.240401+0000","last_clean":"2024-04-19T03:05:19.240401+0000","last_became_active":"2024-04-19T03:05:09.395294+0000","last_became_peered":"2024-04-19T03:05:09.395294+0000","last_unstale":"2024-04-19T03:05:19.240401+0000","last_undegraded":"2024-04-19T03:05:19.240401+0000","last_fullsized":"2024-04-19T03:05:19.240401+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:12.770112+0000","last_change":"2024-04-19T03:04:50.617641+0000","last_active":"2024-04-19T03:05:12.770112+0000","last_peered":"2024-04-19T03:05:12.770112+0000","last_clean":"2024-04-19T03:05:12.770112+0000","last_became_active":"2024-04-19T03:04:50.617323+0000","last_became_peered":"2024-04-19T03:04:50.617323+0000","last_unstale":"2024-04-19T03:05:12.770112+0000","last_undegraded":"2024-04-19T03:05:12.770112+0000","last_fullsized":"2024-04-19T03:05:12.770112+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"14'157","reported_seq":280,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:13.200849+0000","last_change":"2024-04-19T03:05:11.429096+0000","last_active":"2024-04-19T03:05:13.200849+0000","last_peered":"2024-04-19T03:05:13.200849+0000","last_clean":"2024-04-19T03:05:13.200849+0000","last_became_active":"2024-04-19T03:05:11.426859+0000","last_became_peered":"2024-04-19T03:05:11.426859+0000","last_unstale":"2024-04-19T03:05:13.200849+0000","last_undegraded":"2024-04-19T03:05:13.200849+0000","last_fullsized":"2024-04-19T03:05:13.200849+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:06.516863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:06.516863+0000","last_clean_scrub_stamp":"2024-04-19T03:01:06.516863+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":89,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:19.713590+0000","last_change":"2024-04-19T03:04:50.277227+0000","last_active":"2024-04-19T03:05:19.713590+0000","last_peered":"2024-04-19T03:05:19.713590+0000","last_clean":"2024-04-19T03:05:19.713590+0000","last_became_active":"2024-04-19T03:04:50.276132+0000","last_became_peered":"2024-04-19T03:04:50.276132+0000","last_unstale":"2024-04-19T03:05:19.713590+0000","last_undegraded":"2024-04-19T03:05:19.713590+0000","last_fullsized":"2024-04-19T03:05:19.713590+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_clean_scrub_stamp":"2024-04-19T03:01:09.578660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":31,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:12.768952+0000","last_change":"2024-04-19T03:04:50.629139+0000","last_active":"2024-04-19T03:05:12.768952+0000","last_peered":"2024-04-19T03:05:12.768952+0000","last_clean":"2024-04-19T03:05:12.768952+0000","last_became_active":"2024-04-19T03:04:50.628741+0000","last_became_peered":"2024-04-19T03:04:50.628741+0000","last_unstale":"2024-04-19T03:05:12.768952+0000","last_undegraded":"2024-04-19T03:05:12.768952+0000","last_fullsized":"2024-04-19T03:05:12.768952+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":75,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:19.714098+0000","last_change":"2024-04-19T03:05:11.431455+0000","last_active":"2024-04-19T03:05:19.714098+0000","last_peered":"2024-04-19T03:05:19.714098+0000","last_clean":"2024-04-19T03:05:19.714098+0000","last_became_active":"2024-04-19T03:05:11.430881+0000","last_became_peered":"2024-04-19T03:05:11.430881+0000","last_unstale":"2024-04-19T03:05:19.714098+0000","last_undegraded":"2024-04-19T03:05:19.714098+0000","last_fullsized":"2024-04-19T03:05:19.714098+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":76,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:12.903561+0000","last_change":"2024-04-19T03:01:10.602194+0000","last_active":"2024-04-19T03:05:12.903561+0000","last_peered":"2024-04-19T03:05:12.903561+0000","last_clean":"2024-04-19T03:05:12.903561+0000","last_became_active":"2024-04-19T03:01:10.601381+0000","last_became_peered":"2024-04-19T03:01:10.601381+0000","last_unstale":"2024-04-19T03:05:12.903561+0000","last_undegraded":"2024-04-19T03:05:12.903561+0000","last_fullsized":"2024-04-19T03:05:12.903561+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_clean_scrub_stamp":"2024-04-19T03:01:09.578660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":31,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:12.767978+0000","last_change":"2024-04-19T03:04:50.634401+0000","last_active":"2024-04-19T03:05:12.767978+0000","last_peered":"2024-04-19T03:05:12.767978+0000","last_clean":"2024-04-19T03:05:12.767978+0000","last_became_active":"2024-04-19T03:04:50.631721+0000","last_became_peered":"2024-04-19T03:04:50.631721+0000","last_unstale":"2024-04-19T03:05:12.767978+0000","last_undegraded":"2024-04-19T03:05:12.767978+0000","last_fullsized":"2024-04-19T03:05:12.767978+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":79,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:19.240822+0000","last_change":"2024-04-19T03:05:09.395868+0000","last_active":"2024-04-19T03:05:19.240822+0000","last_peered":"2024-04-19T03:05:19.240822+0000","last_clean":"2024-04-19T03:05:19.240822+0000","last_became_active":"2024-04-19T03:05:09.395167+0000","last_became_peered":"2024-04-19T03:05:09.395167+0000","last_unstale":"2024-04-19T03:05:19.240822+0000","last_undegraded":"2024-04-19T03:05:19.240822+0000","last_fullsized":"2024-04-19T03:05:19.240822+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":41,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:19.154051+0000","last_change":"2024-04-19T03:05:19.169049+0000","last_active":"2024-04-19T03:05:19.154051+0000","last_peered":"2024-04-19T03:05:19.154051+0000","last_clean":"2024-04-19T03:05:19.154051+0000","last_became_active":"2024-04-19T03:04:50.633457+0000","last_became_peered":"2024-04-19T03:04:50.633457+0000","last_unstale":"2024-04-19T03:05:19.154051+0000","last_undegraded":"2024-04-19T03:05:19.154051+0000","last_fullsized":"2024-04-19T03:05:19.154051+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:05:19.154005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:05:19.154005+0000","last_clean_scrub_stamp":"2024-04-19T03:05:19.154005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:23:03.401654+0000","scrub_duration":0.0034373889999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":74,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:15.172674+0000","last_change":"2024-04-19T03:01:14.649068+0000","last_active":"2024-04-19T03:05:15.172674+0000","last_peered":"2024-04-19T03:05:15.172674+0000","last_clean":"2024-04-19T03:05:15.172674+0000","last_became_active":"2024-04-19T03:01:14.648082+0000","last_became_peered":"2024-04-19T03:01:14.648082+0000","last_unstale":"2024-04-19T03:05:15.172674+0000","last_undegraded":"2024-04-19T03:05:15.172674+0000","last_fullsized":"2024-04-19T03:05:15.172674+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":41,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:34.130919+0000","last_change":"2024-04-19T03:05:34.131042+0000","last_active":"2024-04-19T03:05:34.130919+0000","last_peered":"2024-04-19T03:05:34.130919+0000","last_clean":"2024-04-19T03:05:34.130919+0000","last_became_active":"2024-04-19T03:04:50.617628+0000","last_became_peered":"2024-04-19T03:04:50.617628+0000","last_unstale":"2024-04-19T03:05:34.130919+0000","last_undegraded":"2024-04-19T03:05:34.130919+0000","last_fullsized":"2024-04-19T03:05:34.130919+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:05:34.130897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:05:34.130897+0000","last_clean_scrub_stamp":"2024-04-19T03:05:34.130897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:03:56.628506+0000","scrub_duration":0.037678018000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":89,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:19.713612+0000","last_change":"2024-04-19T03:04:50.278737+0000","last_active":"2024-04-19T03:05:19.713612+0000","last_peered":"2024-04-19T03:05:19.713612+0000","last_clean":"2024-04-19T03:05:19.713612+0000","last_became_active":"2024-04-19T03:04:50.277804+0000","last_became_peered":"2024-04-19T03:04:50.277804+0000","last_unstale":"2024-04-19T03:05:19.713612+0000","last_undegraded":"2024-04-19T03:05:19.713612+0000","last_fullsized":"2024-04-19T03:05:19.713612+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_clean_scrub_stamp":"2024-04-19T03:01:09.578660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":87,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:19.713697+0000","last_change":"2024-04-19T03:04:50.277141+0000","last_active":"2024-04-19T03:05:19.713697+0000","last_peered":"2024-04-19T03:05:19.713697+0000","last_clean":"2024-04-19T03:05:19.713697+0000","last_became_active":"2024-04-19T03:04:50.275812+0000","last_became_peered":"2024-04-19T03:04:50.275812+0000","last_unstale":"2024-04-19T03:05:19.713697+0000","last_undegraded":"2024-04-19T03:05:19.713697+0000","last_fullsized":"2024-04-19T03:05:19.713697+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:12.769412+0000","last_change":"2024-04-19T03:04:50.616475+0000","last_active":"2024-04-19T03:05:12.769412+0000","last_peered":"2024-04-19T03:05:12.769412+0000","last_clean":"2024-04-19T03:05:12.769412+0000","last_became_active":"2024-04-19T03:04:50.614774+0000","last_became_peered":"2024-04-19T03:04:50.614774+0000","last_unstale":"2024-04-19T03:05:12.769412+0000","last_undegraded":"2024-04-19T03:05:12.769412+0000","last_fullsized":"2024-04-19T03:05:12.769412+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":84,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:22.163334+0000","last_change":"2024-04-19T03:05:22.163334+0000","last_active":"2024-04-19T03:05:22.163334+0000","last_peered":"2024-04-19T03:05:22.163334+0000","last_clean":"2024-04-19T03:05:22.163334+0000","last_became_active":"2024-04-19T03:05:11.429941+0000","last_became_peered":"2024-04-19T03:05:11.429941+0000","last_unstale":"2024-04-19T03:05:22.163334+0000","last_undegraded":"2024-04-19T03:05:22.163334+0000","last_fullsized":"2024-04-19T03:05:22.163334+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:05:22.163031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:05:22.163031+0000","last_clean_scrub_stamp":"2024-04-19T03:05:22.163031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:21:13.259886+0000","scrub_duration":0.0032565699999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":41,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:26.113178+0000","last_change":"2024-04-19T03:05:26.113394+0000","last_active":"2024-04-19T03:05:26.113178+0000","last_peered":"2024-04-19T03:05:26.113178+0000","last_clean":"2024-04-19T03:05:26.113178+0000","last_became_active":"2024-04-19T03:04:50.614498+0000","last_became_peered":"2024-04-19T03:04:50.614498+0000","last_unstale":"2024-04-19T03:05:26.113178+0000","last_undegraded":"2024-04-19T03:05:26.113178+0000","last_fullsized":"2024-04-19T03:05:26.113178+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:05:26.113130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:05:26.113130+0000","last_clean_scrub_stamp":"2024-04-19T03:05:26.113130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:38:46.443254+0000","scrub_duration":0.0031920770000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":51,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:12.420579+0000","last_change":"2024-04-19T03:05:09.395750+0000","last_active":"2024-04-19T03:05:12.420579+0000","last_peered":"2024-04-19T03:05:12.420579+0000","last_clean":"2024-04-19T03:05:12.420579+0000","last_became_active":"2024-04-19T03:05:09.394024+0000","last_became_peered":"2024-04-19T03:05:09.394024+0000","last_unstale":"2024-04-19T03:05:12.420579+0000","last_undegraded":"2024-04-19T03:05:12.420579+0000","last_fullsized":"2024-04-19T03:05:12.420579+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":42,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:33.132538+0000","last_change":"2024-04-19T03:05:33.132791+0000","last_active":"2024-04-19T03:05:33.132538+0000","last_peered":"2024-04-19T03:05:33.132538+0000","last_clean":"2024-04-19T03:05:33.132538+0000","last_became_active":"2024-04-19T03:04:50.615238+0000","last_became_peered":"2024-04-19T03:04:50.615238+0000","last_unstale":"2024-04-19T03:05:33.132538+0000","last_undegraded":"2024-04-19T03:05:33.132538+0000","last_fullsized":"2024-04-19T03:05:33.132538+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:05:33.132481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:05:33.132481+0000","last_clean_scrub_stamp":"2024-04-19T03:05:33.132481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:12:12.823889+0000","scrub_duration":0.0033373280000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":83,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:19.240328+0000","last_change":"2024-04-19T03:05:09.397542+0000","last_active":"2024-04-19T03:05:19.240328+0000","last_peered":"2024-04-19T03:05:19.240328+0000","last_clean":"2024-04-19T03:05:19.240328+0000","last_became_active":"2024-04-19T03:05:09.396378+0000","last_became_peered":"2024-04-19T03:05:09.396378+0000","last_unstale":"2024-04-19T03:05:19.240328+0000","last_undegraded":"2024-04-19T03:05:19.240328+0000","last_fullsized":"2024-04-19T03:05:19.240328+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_clean_scrub_stamp":"2024-04-19T03:01:09.578660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":51,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:12.420654+0000","last_change":"2024-04-19T03:05:09.392910+0000","last_active":"2024-04-19T03:05:12.420654+0000","last_peered":"2024-04-19T03:05:12.420654+0000","last_clean":"2024-04-19T03:05:12.420654+0000","last_became_active":"2024-04-19T03:05:09.392437+0000","last_became_peered":"2024-04-19T03:05:09.392437+0000","last_unstale":"2024-04-19T03:05:12.420654+0000","last_undegraded":"2024-04-19T03:05:12.420654+0000","last_fullsized":"2024-04-19T03:05:12.420654+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"20'2","reported_seq":33,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:12.769472+0000","last_change":"2024-04-19T03:04:50.611678+0000","last_active":"2024-04-19T03:05:12.769472+0000","last_peered":"2024-04-19T03:05:12.769472+0000","last_clean":"2024-04-19T03:05:12.769472+0000","last_became_active":"2024-04-19T03:04:50.611024+0000","last_became_peered":"2024-04-19T03:04:50.611024+0000","last_unstale":"2024-04-19T03:05:12.769472+0000","last_undegraded":"2024-04-19T03:05:12.769472+0000","last_fullsized":"2024-04-19T03:05:12.769472+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:12.768966+0000","last_change":"2024-04-19T03:04:50.616003+0000","last_active":"2024-04-19T03:05:12.768966+0000","last_peered":"2024-04-19T03:05:12.768966+0000","last_clean":"2024-04-19T03:05:12.768966+0000","last_became_active":"2024-04-19T03:04:50.612403+0000","last_became_peered":"2024-04-19T03:04:50.612403+0000","last_unstale":"2024-04-19T03:05:12.768966+0000","last_undegraded":"2024-04-19T03:05:12.768966+0000","last_fullsized":"2024-04-19T03:05:12.768966+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_clean_scrub_stamp":"2024-04-19T03:01:09.578660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:12.768119+0000","last_change":"2024-04-19T03:04:50.615936+0000","last_active":"2024-04-19T03:05:12.768119+0000","last_peered":"2024-04-19T03:05:12.768119+0000","last_clean":"2024-04-19T03:05:12.768119+0000","last_became_active":"2024-04-19T03:04:50.612987+0000","last_became_peered":"2024-04-19T03:04:50.612987+0000","last_unstale":"2024-04-19T03:05:12.768119+0000","last_undegraded":"2024-04-19T03:05:12.768119+0000","last_fullsized":"2024-04-19T03:05:12.768119+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"21'1","reported_seq":34,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:12.769082+0000","last_change":"2024-04-19T03:04:50.616200+0000","last_active":"2024-04-19T03:05:12.769082+0000","last_peered":"2024-04-19T03:05:12.769082+0000","last_clean":"2024-04-19T03:05:12.769082+0000","last_became_active":"2024-04-19T03:04:50.612697+0000","last_became_peered":"2024-04-19T03:04:50.612697+0000","last_unstale":"2024-04-19T03:05:12.769082+0000","last_undegraded":"2024-04-19T03:05:12.769082+0000","last_fullsized":"2024-04-19T03:05:12.769082+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":76,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:19.713587+0000","last_change":"2024-04-19T03:01:10.602274+0000","last_active":"2024-04-19T03:05:19.713587+0000","last_peered":"2024-04-19T03:05:19.713587+0000","last_clean":"2024-04-19T03:05:19.713587+0000","last_became_active":"2024-04-19T03:01:10.601487+0000","last_became_peered":"2024-04-19T03:01:10.601487+0000","last_unstale":"2024-04-19T03:05:19.713587+0000","last_undegraded":"2024-04-19T03:05:19.713587+0000","last_fullsized":"2024-04-19T03:05:19.713587+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_clean_scrub_stamp":"2024-04-19T03:01:09.578660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":73,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:19.240645+0000","last_change":"2024-04-19T03:01:15.018914+0000","last_active":"2024-04-19T03:05:19.240645+0000","last_peered":"2024-04-19T03:05:19.240645+0000","last_clean":"2024-04-19T03:05:19.240645+0000","last_became_active":"2024-04-19T03:01:15.018276+0000","last_became_peered":"2024-04-19T03:01:15.018276+0000","last_unstale":"2024-04-19T03:05:19.240645+0000","last_undegraded":"2024-04-19T03:05:19.240645+0000","last_fullsized":"2024-04-19T03:05:19.240645+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":77,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:12.903943+0000","last_change":"2024-04-19T03:05:11.430020+0000","last_active":"2024-04-19T03:05:12.903943+0000","last_peered":"2024-04-19T03:05:12.903943+0000","last_clean":"2024-04-19T03:05:12.903943+0000","last_became_active":"2024-04-19T03:05:11.429214+0000","last_became_peered":"2024-04-19T03:05:11.429214+0000","last_unstale":"2024-04-19T03:05:12.903943+0000","last_undegraded":"2024-04-19T03:05:12.903943+0000","last_fullsized":"2024-04-19T03:05:12.903943+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"81'10","reported_seq":99,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:29.314926+0000","last_change":"2024-04-19T03:05:29.315169+0000","last_active":"2024-04-19T03:05:29.314926+0000","last_peered":"2024-04-19T03:05:29.314926+0000","last_clean":"2024-04-19T03:05:29.314926+0000","last_became_active":"2024-04-19T03:05:11.430906+0000","last_became_peered":"2024-04-19T03:05:11.430906+0000","last_unstale":"2024-04-19T03:05:29.314926+0000","last_undegraded":"2024-04-19T03:05:29.314926+0000","last_fullsized":"2024-04-19T03:05:29.314926+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'10","last_scrub_stamp":"2024-04-19T03:05:29.314872+0000","last_deep_scrub":"81'10","last_deep_scrub_stamp":"2024-04-19T03:05:29.314872+0000","last_clean_scrub_stamp":"2024-04-19T03:05:29.314872+0000","objects_scrubbed":4,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:09:13.123950+0000","scrub_duration":0.0096666670000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:12.768543+0000","last_change":"2024-04-19T03:04:50.628406+0000","last_active":"2024-04-19T03:05:12.768543+0000","last_peered":"2024-04-19T03:05:12.768543+0000","last_clean":"2024-04-19T03:05:12.768543+0000","last_became_active":"2024-04-19T03:04:50.627654+0000","last_became_peered":"2024-04-19T03:04:50.627654+0000","last_unstale":"2024-04-19T03:05:12.768543+0000","last_undegraded":"2024-04-19T03:05:12.768543+0000","last_fullsized":"2024-04-19T03:05:12.768543+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"20'3","reported_seq":55,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:12.421900+0000","last_change":"2024-04-19T03:05:09.398110+0000","last_active":"2024-04-19T03:05:12.421900+0000","last_peered":"2024-04-19T03:05:12.421900+0000","last_clean":"2024-04-19T03:05:12.421900+0000","last_became_active":"2024-04-19T03:05:09.397555+0000","last_became_peered":"2024-04-19T03:05:09.397555+0000","last_unstale":"2024-04-19T03:05:12.421900+0000","last_undegraded":"2024-04-19T03:05:12.421900+0000","last_fullsized":"2024-04-19T03:05:12.421900+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":83,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:30.280877+0000","last_change":"2024-04-19T03:05:30.281124+0000","last_active":"2024-04-19T03:05:30.280877+0000","last_peered":"2024-04-19T03:05:30.280877+0000","last_clean":"2024-04-19T03:05:30.280877+0000","last_became_active":"2024-04-19T03:05:11.428904+0000","last_became_peered":"2024-04-19T03:05:11.428904+0000","last_unstale":"2024-04-19T03:05:30.280877+0000","last_undegraded":"2024-04-19T03:05:30.280877+0000","last_fullsized":"2024-04-19T03:05:30.280877+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:05:30.280817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:05:30.280817+0000","last_clean_scrub_stamp":"2024-04-19T03:05:30.280817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:49:02.715913+0000","scrub_duration":0.0034631390000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:12.769162+0000","last_change":"2024-04-19T03:04:50.634026+0000","last_active":"2024-04-19T03:05:12.769162+0000","last_peered":"2024-04-19T03:05:12.769162+0000","last_clean":"2024-04-19T03:05:12.769162+0000","last_became_active":"2024-04-19T03:04:50.630873+0000","last_became_peered":"2024-04-19T03:04:50.630873+0000","last_unstale":"2024-04-19T03:05:12.769162+0000","last_undegraded":"2024-04-19T03:05:12.769162+0000","last_fullsized":"2024-04-19T03:05:12.769162+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":42,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:25.154192+0000","last_change":"2024-04-19T03:05:25.154574+0000","last_active":"2024-04-19T03:05:25.154192+0000","last_peered":"2024-04-19T03:05:25.154192+0000","last_clean":"2024-04-19T03:05:25.154192+0000","last_became_active":"2024-04-19T03:04:50.612005+0000","last_became_peered":"2024-04-19T03:04:50.612005+0000","last_unstale":"2024-04-19T03:05:25.154192+0000","last_undegraded":"2024-04-19T03:05:25.154192+0000","last_fullsized":"2024-04-19T03:05:25.154192+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:05:25.154094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:05:25.154094+0000","last_clean_scrub_stamp":"2024-04-19T03:05:25.154094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:35:43.914350+0000","scrub_duration":0.0032290930000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":41,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:36.159462+0000","last_change":"2024-04-19T03:05:36.159687+0000","last_active":"2024-04-19T03:05:36.159462+0000","last_peered":"2024-04-19T03:05:36.159462+0000","last_clean":"2024-04-19T03:05:36.159462+0000","last_became_active":"2024-04-19T03:04:50.613735+0000","last_became_peered":"2024-04-19T03:04:50.613735+0000","last_unstale":"2024-04-19T03:05:36.159462+0000","last_undegraded":"2024-04-19T03:05:36.159462+0000","last_fullsized":"2024-04-19T03:05:36.159462+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:05:36.159417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:05:36.159417+0000","last_clean_scrub_stamp":"2024-04-19T03:05:36.159417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:03:12.881177+0000","scrub_duration":0.0033805229999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":51,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:12.422425+0000","last_change":"2024-04-19T03:05:09.394054+0000","last_active":"2024-04-19T03:05:12.422425+0000","last_peered":"2024-04-19T03:05:12.422425+0000","last_clean":"2024-04-19T03:05:12.422425+0000","last_became_active":"2024-04-19T03:05:09.392982+0000","last_became_peered":"2024-04-19T03:05:09.392982+0000","last_unstale":"2024-04-19T03:05:12.422425+0000","last_undegraded":"2024-04-19T03:05:12.422425+0000","last_fullsized":"2024-04-19T03:05:12.422425+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":31,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:12.767702+0000","last_change":"2024-04-19T03:04:50.616430+0000","last_active":"2024-04-19T03:05:12.767702+0000","last_peered":"2024-04-19T03:05:12.767702+0000","last_clean":"2024-04-19T03:05:12.767702+0000","last_became_active":"2024-04-19T03:04:50.613523+0000","last_became_peered":"2024-04-19T03:04:50.613523+0000","last_unstale":"2024-04-19T03:05:12.767702+0000","last_undegraded":"2024-04-19T03:05:12.767702+0000","last_fullsized":"2024-04-19T03:05:12.767702+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:12.769377+0000","last_change":"2024-04-19T03:04:50.616829+0000","last_active":"2024-04-19T03:05:12.769377+0000","last_peered":"2024-04-19T03:05:12.769377+0000","last_clean":"2024-04-19T03:05:12.769377+0000","last_became_active":"2024-04-19T03:04:50.616545+0000","last_became_peered":"2024-04-19T03:04:50.616545+0000","last_unstale":"2024-04-19T03:05:12.769377+0000","last_undegraded":"2024-04-19T03:05:12.769377+0000","last_fullsized":"2024-04-19T03:05:12.769377+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":31,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:12.767980+0000","last_change":"2024-04-19T03:04:50.634214+0000","last_active":"2024-04-19T03:05:12.767980+0000","last_peered":"2024-04-19T03:05:12.767980+0000","last_clean":"2024-04-19T03:05:12.767980+0000","last_became_active":"2024-04-19T03:04:50.631699+0000","last_became_peered":"2024-04-19T03:04:50.631699+0000","last_unstale":"2024-04-19T03:05:12.767980+0000","last_undegraded":"2024-04-19T03:05:12.767980+0000","last_fullsized":"2024-04-19T03:05:12.767980+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":54,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:12.421501+0000","last_change":"2024-04-19T03:05:02.361377+0000","last_active":"2024-04-19T03:05:12.421501+0000","last_peered":"2024-04-19T03:05:12.421501+0000","last_clean":"2024-04-19T03:05:12.421501+0000","last_became_active":"2024-04-19T03:05:02.360924+0000","last_became_peered":"2024-04-19T03:05:02.360924+0000","last_unstale":"2024-04-19T03:05:12.421501+0000","last_undegraded":"2024-04-19T03:05:12.421501+0000","last_fullsized":"2024-04-19T03:05:12.421501+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"20'1","reported_seq":91,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:27.386975+0000","last_change":"2024-04-19T03:05:27.387324+0000","last_active":"2024-04-19T03:05:27.386975+0000","last_peered":"2024-04-19T03:05:27.386975+0000","last_clean":"2024-04-19T03:05:27.386975+0000","last_became_active":"2024-04-19T03:05:09.395508+0000","last_became_peered":"2024-04-19T03:05:09.395508+0000","last_unstale":"2024-04-19T03:05:27.386975+0000","last_undegraded":"2024-04-19T03:05:27.386975+0000","last_fullsized":"2024-04-19T03:05:27.386975+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"20'1","last_scrub_stamp":"2024-04-19T03:05:27.386920+0000","last_deep_scrub":"20'1","last_deep_scrub_stamp":"2024-04-19T03:05:27.386920+0000","last_clean_scrub_stamp":"2024-04-19T03:05:27.386920+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:30:55.863683+0000","scrub_duration":0.0033146569999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":78,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:12.421171+0000","last_change":"2024-04-19T03:05:09.396327+0000","last_active":"2024-04-19T03:05:12.421171+0000","last_peered":"2024-04-19T03:05:12.421171+0000","last_clean":"2024-04-19T03:05:12.421171+0000","last_became_active":"2024-04-19T03:05:09.395753+0000","last_became_peered":"2024-04-19T03:05:09.395753+0000","last_unstale":"2024-04-19T03:05:12.421171+0000","last_undegraded":"2024-04-19T03:05:12.421171+0000","last_fullsized":"2024-04-19T03:05:12.421171+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"20'1","reported_seq":88,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:12.420914+0000","last_change":"2024-04-19T03:05:09.398142+0000","last_active":"2024-04-19T03:05:12.420914+0000","last_peered":"2024-04-19T03:05:12.420914+0000","last_clean":"2024-04-19T03:05:12.420914+0000","last_became_active":"2024-04-19T03:05:09.397183+0000","last_became_peered":"2024-04-19T03:05:09.397183+0000","last_unstale":"2024-04-19T03:05:12.420914+0000","last_undegraded":"2024-04-19T03:05:12.420914+0000","last_fullsized":"2024-04-19T03:05:12.420914+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":87,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:12.903824+0000","last_change":"2024-04-19T03:05:11.430243+0000","last_active":"2024-04-19T03:05:12.903824+0000","last_peered":"2024-04-19T03:05:12.903824+0000","last_clean":"2024-04-19T03:05:12.903824+0000","last_became_active":"2024-04-19T03:05:11.429247+0000","last_became_peered":"2024-04-19T03:05:11.429247+0000","last_unstale":"2024-04-19T03:05:12.903824+0000","last_undegraded":"2024-04-19T03:05:12.903824+0000","last_fullsized":"2024-04-19T03:05:12.903824+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"20'2","reported_seq":88,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:12.904614+0000","last_change":"2024-04-19T03:04:50.276105+0000","last_active":"2024-04-19T03:05:12.904614+0000","last_peered":"2024-04-19T03:05:12.904614+0000","last_clean":"2024-04-19T03:05:12.904614+0000","last_became_active":"2024-04-19T03:04:50.275533+0000","last_became_peered":"2024-04-19T03:04:50.275533+0000","last_unstale":"2024-04-19T03:05:12.904614+0000","last_undegraded":"2024-04-19T03:05:12.904614+0000","last_fullsized":"2024-04-19T03:05:12.904614+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":85,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:12.904153+0000","last_change":"2024-04-19T03:04:50.278401+0000","last_active":"2024-04-19T03:05:12.904153+0000","last_peered":"2024-04-19T03:05:12.904153+0000","last_clean":"2024-04-19T03:05:12.904153+0000","last_became_active":"2024-04-19T03:04:50.277348+0000","last_became_peered":"2024-04-19T03:04:50.277348+0000","last_unstale":"2024-04-19T03:05:12.904153+0000","last_undegraded":"2024-04-19T03:05:12.904153+0000","last_fullsized":"2024-04-19T03:05:12.904153+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"20'2","reported_seq":57,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:12.421733+0000","last_change":"2024-04-19T03:05:02.363600+0000","last_active":"2024-04-19T03:05:12.421733+0000","last_peered":"2024-04-19T03:05:12.421733+0000","last_clean":"2024-04-19T03:05:12.421733+0000","last_became_active":"2024-04-19T03:05:02.363167+0000","last_became_peered":"2024-04-19T03:05:02.363167+0000","last_unstale":"2024-04-19T03:05:12.421733+0000","last_undegraded":"2024-04-19T03:05:12.421733+0000","last_fullsized":"2024-04-19T03:05:12.421733+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":89,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:22.325309+0000","last_change":"2024-04-19T03:05:22.325552+0000","last_active":"2024-04-19T03:05:22.325309+0000","last_peered":"2024-04-19T03:05:22.325309+0000","last_clean":"2024-04-19T03:05:22.325309+0000","last_became_active":"2024-04-19T03:05:09.393975+0000","last_became_peered":"2024-04-19T03:05:09.393975+0000","last_unstale":"2024-04-19T03:05:22.325309+0000","last_undegraded":"2024-04-19T03:05:22.325309+0000","last_fullsized":"2024-04-19T03:05:22.325309+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:05:22.325265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:05:22.325265+0000","last_clean_scrub_stamp":"2024-04-19T03:05:22.325265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:46:17.944097+0000","scrub_duration":0.022749259000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"20'1","reported_seq":33,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:12.769806+0000","last_change":"2024-04-19T03:04:50.627670+0000","last_active":"2024-04-19T03:05:12.769806+0000","last_peered":"2024-04-19T03:05:12.769806+0000","last_clean":"2024-04-19T03:05:12.769806+0000","last_became_active":"2024-04-19T03:04:50.627304+0000","last_became_peered":"2024-04-19T03:04:50.627304+0000","last_unstale":"2024-04-19T03:05:12.769806+0000","last_undegraded":"2024-04-19T03:05:12.769806+0000","last_fullsized":"2024-04-19T03:05:12.769806+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":85,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:12.903346+0000","last_change":"2024-04-19T03:04:50.279334+0000","last_active":"2024-04-19T03:05:12.903346+0000","last_peered":"2024-04-19T03:05:12.903346+0000","last_clean":"2024-04-19T03:05:12.903346+0000","last_became_active":"2024-04-19T03:04:50.278874+0000","last_became_peered":"2024-04-19T03:04:50.278874+0000","last_unstale":"2024-04-19T03:05:12.903346+0000","last_undegraded":"2024-04-19T03:05:12.903346+0000","last_fullsized":"2024-04-19T03:05:12.903346+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"20'4","reported_seq":33,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:12.770306+0000","last_change":"2024-04-19T03:04:50.627070+0000","last_active":"2024-04-19T03:05:12.770306+0000","last_peered":"2024-04-19T03:05:12.770306+0000","last_clean":"2024-04-19T03:05:12.770306+0000","last_became_active":"2024-04-19T03:04:50.626334+0000","last_became_peered":"2024-04-19T03:04:50.626334+0000","last_unstale":"2024-04-19T03:05:12.770306+0000","last_undegraded":"2024-04-19T03:05:12.770306+0000","last_fullsized":"2024-04-19T03:05:12.770306+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5289,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":14482,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":10,"seq":42949673021,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":224804,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":223870,"kb_avail":94147036,"statfs":{"total":96636764160,"available":96406564864,"internally_reserved":0,"allocated":946176,"data_stored":929795,"data_compressed":7241,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":229243334},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 19 03:02:08 2024","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"last":0.621}]},{"osd":1,"last update":"Fri Apr 19 03:05:16 2024","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.56699999999999995,"15min":0.55500000000000005},"min":{"1min":0.53600000000000003,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.76900000000000002,"5min":2.5030000000000001,"15min":2.5030000000000001},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.628,"5min":0.58399999999999996,"15min":0.56699999999999995},"min":{"1min":0.54700000000000004,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.74199999999999999,"5min":2.6379999999999999,"15min":2.6379999999999999},"last":0.69899999999999995}]}]},{"osd":1,"up_from":10,"seq":42949673020,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":202656,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":201726,"kb_avail":94169184,"statfs":{"total":96636764160,"available":96429244416,"internally_reserved":0,"allocated":942080,"data_stored":931342,"data_compressed":7241,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":206567878},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 19 03:02:04 2024","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.64400000000000002}]},{"osd":2,"last update":"Fri Apr 19 03:05:08 2024","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.501,"15min":0.50800000000000001},"min":{"1min":0.46999999999999997,"5min":0.224,"15min":0.224},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.50700000000000001,"15min":0.52100000000000002},"min":{"1min":0.52100000000000002,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.77900000000000003}]}]},{"osd":0,"up_from":71,"seq":304942678028,"num_pgs":73,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47704,"kb_used_data":848,"kb_used_omap":6,"kb_used_meta":46841,"kb_avail":94324136,"statfs":{"total":96636764160,"available":96587915264,"internally_reserved":0,"allocated":868352,"data_stored":339844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6883,"internal_metadata":47965469},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66300000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60499999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":7241,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":7241,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5289,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-19T03:05:40.409 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-04-19T03:01:14.615919+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=14, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:05:40.409 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-04-19T03:01:14.615919+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=14, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:05:40.409 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-04-19T03:01:14.615919+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=14, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:05:40.409 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-04-19T03:01:14.615919+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=14, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:05:40.409 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-04-19T03:01:14.615919+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=14, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:05:40.409 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-04-19T03:01:14.615919+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=14, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:05:40.409 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-04-19T03:01:14.615919+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=14, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:05:40.409 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-04-19T03:01:14.615919+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=14, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:05:40.410 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-04-19T03:01:14.615919+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=14, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:05:40.410 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-04-19T03:01:14.615919+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=14, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:05:40.410 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-04-19T03:01:14.615919+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=14, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:05:40.410 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-04-19T03:01:14.615919+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=14, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:05:40.410 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-04-19T03:01:14.615919+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=14, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:05:40.410 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-04-19T03:01:14.615919+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=14, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:05:40.410 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-04-19T03:01:14.615919+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=14, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:05:40.410 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-04-19T03:01:14.615919+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=14, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:05:40.410 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-04-19T03:01:14.615919+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=14, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:05:40.411 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-04-19T03:01:14.615919+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=14, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:05:40.411 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-04-19T03:01:14.615919+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=14, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:05:40.411 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-04-19T03:01:14.615919+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=14, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:05:40.411 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-04-19T03:01:14.615919+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=14, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:05:40.411 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-04-19T03:01:14.615919+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=14, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:05:40.411 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-04-19T03:01:14.615919+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=14, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:05:40.411 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-04-19T03:01:14.615919+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=14, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:05:40.411 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-04-19T03:01:14.615919+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=14, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:05:40.411 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-04-19T03:01:14.615919+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=14, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:05:40.412 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-04-19T03:01:14.615919+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=14, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:05:40.412 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-04-19T03:01:13.604133+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=13, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:05:40.412 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-04-19T03:01:14.615919+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=14, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:05:40.412 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-04-19T03:01:13.604133+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=13, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:05:40.412 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-04-19T03:01:13.604133+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=13, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:05:40.412 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-04-19T03:01:14.615919+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=14, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:05:40.412 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-04-19T03:01:13.604133+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=13, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:05:40.412 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-04-19T03:01:13.604133+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=13, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:05:40.413 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-04-19T03:01:14.615919+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=14, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:05:40.413 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-04-19T03:01:13.604133+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=13, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:05:40.413 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-04-19T03:01:14.615919+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=14, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:05:40.413 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-04-19T03:01:13.604133+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=13, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:05:40.413 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-04-19T03:01:14.615919+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=14, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:05:40.413 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-04-19T03:01:13.604133+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=13, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:05:40.413 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-04-19T03:01:14.615919+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=14, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:05:40.413 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-04-19T03:01:13.604133+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=13, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:05:40.413 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-04-19T03:01:14.615919+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=14, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:05:40.413 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-04-19T03:01:13.604133+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=13, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:05:40.414 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-04-19T03:01:14.615919+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=14, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:05:40.414 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-04-19T03:01:13.604133+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=13, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:05:40.414 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-04-19T03:01:14.615919+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=14, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:05:40.414 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-04-19T03:01:13.604133+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=13, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:05:40.414 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-04-19T03:01:14.615919+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=14, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:05:40.414 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-04-19T03:01:06.516863+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=6, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:05:40.414 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-04-19T03:01:09.578660+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=9, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:05:40.414 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-04-19T03:01:13.604133+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=13, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:05:40.415 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-04-19T03:01:14.615919+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=14, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:05:40.415 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-04-19T03:01:09.578660+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=9, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:05:40.415 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-04-19T03:01:13.604133+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=13, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:05:40.415 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-04-19T03:01:14.615919+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=14, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:05:40.415 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-04-19T03:01:13.604133+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=13, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:05:40.415 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-04-19T03:01:09.578660+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=9, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:05:40.415 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-04-19T03:01:13.604133+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=13, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:05:40.415 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-04-19T03:01:14.615919+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=14, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:05:40.415 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-04-19T03:01:14.615919+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=14, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:05:40.416 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-04-19T03:01:09.578660+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=9, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:05:40.416 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-04-19T03:01:14.615919+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=14, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:05:40.416 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-04-19T03:01:13.604133+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=13, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:05:40.416 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-04-19T03:01:09.578660+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=9, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:05:40.416 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-04-19T03:01:14.615919+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=14, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:05:40.416 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-04-19T03:01:13.604133+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=13, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:05:40.416 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-04-19T03:01:09.578660+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=9, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:05:40.416 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-04-19T03:01:14.615919+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=14, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:05:40.416 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-04-19T03:01:14.615919+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=14, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:05:40.417 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-04-19T03:01:14.615919+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=14, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:05:40.417 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-04-19T03:01:13.604133+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=13, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:05:40.417 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-04-19T03:01:14.615919+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=14, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:05:40.417 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-04-19T03:01:14.615919+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=14, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:05:40.417 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-04-19T03:01:13.604133+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=13, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:05:40.417 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-04-19T03:01:14.615919+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=14, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:05:40.417 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-04-19T03:01:13.604133+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=13, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:05:40.417 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-04-19T03:01:14.615919+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=14, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:05:40.418 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-04-19T03:01:14.615919+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=14, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:05:40.418 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-04-19T03:01:13.604133+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=13, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:05:40.418 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-04-19T03:01:14.615919+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=14, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:05:40.418 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-04-19T03:01:13.604133+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=13, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:05:40.418 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-04-19T03:01:14.615919+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=14, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:05:40.418 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-04-19T03:01:13.604133+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=13, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:05:40.418 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-04-19T03:01:13.604133+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=13, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:05:40.418 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-04-19T03:01:14.615919+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=14, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:05:40.418 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-04-19T03:01:13.604133+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=13, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:05:40.418 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-19T03:06:00.419 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-19T03:06:00.732 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-19T03:06:00.734 INFO:teuthology.orchestra.run.smithi096.stderr:dumped all 2024-04-19T03:06:00.750 INFO:teuthology.orchestra.run.smithi096.stdout:{"pg_ready":true,"pg_map":{"version":225,"stamp":"2024-04-19T03:06:00.067254+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":205,"ondisk_log_size":205,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":475164,"kb_used_data":2692,"kb_used_omap":9,"kb_used_meta":472438,"kb_avail":282640356,"statfs":{"total":289910292480,"available":289423724544,"internally_reserved":0,"allocated":2756608,"data_stored":2200981,"data_compressed":14482,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":10071,"internal_metadata":483776681},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003990"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":79,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:19.241382+0000","last_change":"2024-04-19T03:05:09.396661+0000","last_active":"2024-04-19T03:05:19.241382+0000","last_peered":"2024-04-19T03:05:19.241382+0000","last_clean":"2024-04-19T03:05:19.241382+0000","last_became_active":"2024-04-19T03:05:09.396279+0000","last_became_peered":"2024-04-19T03:05:09.396279+0000","last_unstale":"2024-04-19T03:05:19.241382+0000","last_undegraded":"2024-04-19T03:05:19.241382+0000","last_fullsized":"2024-04-19T03:05:19.241382+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":86,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:19.241391+0000","last_change":"2024-04-19T03:04:50.278334+0000","last_active":"2024-04-19T03:05:19.241391+0000","last_peered":"2024-04-19T03:05:19.241391+0000","last_clean":"2024-04-19T03:05:19.241391+0000","last_became_active":"2024-04-19T03:04:50.277848+0000","last_became_peered":"2024-04-19T03:04:50.277848+0000","last_unstale":"2024-04-19T03:05:19.241391+0000","last_undegraded":"2024-04-19T03:05:19.241391+0000","last_fullsized":"2024-04-19T03:05:19.241391+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":73,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:19.714830+0000","last_change":"2024-04-19T03:01:15.015884+0000","last_active":"2024-04-19T03:05:19.714830+0000","last_peered":"2024-04-19T03:05:19.714830+0000","last_clean":"2024-04-19T03:05:19.714830+0000","last_became_active":"2024-04-19T03:01:15.014599+0000","last_became_peered":"2024-04-19T03:01:15.014599+0000","last_unstale":"2024-04-19T03:05:19.714830+0000","last_undegraded":"2024-04-19T03:05:19.714830+0000","last_fullsized":"2024-04-19T03:05:19.714830+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":97,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:49.097798+0000","last_change":"2024-04-19T03:05:49.098069+0000","last_active":"2024-04-19T03:05:49.097798+0000","last_peered":"2024-04-19T03:05:49.097798+0000","last_clean":"2024-04-19T03:05:49.097798+0000","last_became_active":"2024-04-19T03:04:50.274600+0000","last_became_peered":"2024-04-19T03:04:50.274600+0000","last_unstale":"2024-04-19T03:05:49.097798+0000","last_undegraded":"2024-04-19T03:05:49.097798+0000","last_fullsized":"2024-04-19T03:05:49.097798+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:05:49.097746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:05:49.097746+0000","last_clean_scrub_stamp":"2024-04-19T03:05:49.097746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:07:18.276599+0000","scrub_duration":0.0032259770000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":89,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:39.452100+0000","last_change":"2024-04-19T03:05:39.452420+0000","last_active":"2024-04-19T03:05:39.452100+0000","last_peered":"2024-04-19T03:05:39.452100+0000","last_clean":"2024-04-19T03:05:39.452100+0000","last_became_active":"2024-04-19T03:05:09.395929+0000","last_became_peered":"2024-04-19T03:05:09.395929+0000","last_unstale":"2024-04-19T03:05:39.452100+0000","last_undegraded":"2024-04-19T03:05:39.452100+0000","last_fullsized":"2024-04-19T03:05:39.452100+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:05:39.452007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:05:39.452007+0000","last_clean_scrub_stamp":"2024-04-19T03:05:39.452007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:45:27.478454+0000","scrub_duration":0.026485411,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":71,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:12.903702+0000","last_change":"2024-04-19T03:05:11.428461+0000","last_active":"2024-04-19T03:05:12.903702+0000","last_peered":"2024-04-19T03:05:12.903702+0000","last_clean":"2024-04-19T03:05:12.903702+0000","last_became_active":"2024-04-19T03:05:11.426617+0000","last_became_peered":"2024-04-19T03:05:11.426617+0000","last_unstale":"2024-04-19T03:05:12.903702+0000","last_undegraded":"2024-04-19T03:05:12.903702+0000","last_fullsized":"2024-04-19T03:05:12.903702+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":71,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:12.903777+0000","last_change":"2024-04-19T03:05:11.424581+0000","last_active":"2024-04-19T03:05:12.903777+0000","last_peered":"2024-04-19T03:05:12.903777+0000","last_clean":"2024-04-19T03:05:12.903777+0000","last_became_active":"2024-04-19T03:05:11.422727+0000","last_became_peered":"2024-04-19T03:05:11.422727+0000","last_unstale":"2024-04-19T03:05:12.903777+0000","last_undegraded":"2024-04-19T03:05:12.903777+0000","last_fullsized":"2024-04-19T03:05:12.903777+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":96,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:54.075519+0000","last_change":"2024-04-19T03:05:54.075857+0000","last_active":"2024-04-19T03:05:54.075519+0000","last_peered":"2024-04-19T03:05:54.075519+0000","last_clean":"2024-04-19T03:05:54.075519+0000","last_became_active":"2024-04-19T03:04:50.261155+0000","last_became_peered":"2024-04-19T03:04:50.261155+0000","last_unstale":"2024-04-19T03:05:54.075519+0000","last_undegraded":"2024-04-19T03:05:54.075519+0000","last_fullsized":"2024-04-19T03:05:54.075519+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:05:54.075422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:05:54.075422+0000","last_clean_scrub_stamp":"2024-04-19T03:05:54.075422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:12:16.121405+0000","scrub_duration":0.0036127419999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":41,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:23.156874+0000","last_change":"2024-04-19T03:05:23.156992+0000","last_active":"2024-04-19T03:05:23.156874+0000","last_peered":"2024-04-19T03:05:23.156874+0000","last_clean":"2024-04-19T03:05:23.156874+0000","last_became_active":"2024-04-19T03:04:50.611400+0000","last_became_peered":"2024-04-19T03:04:50.611400+0000","last_unstale":"2024-04-19T03:05:23.156874+0000","last_undegraded":"2024-04-19T03:05:23.156874+0000","last_fullsized":"2024-04-19T03:05:23.156874+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:05:23.156852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:05:23.156852+0000","last_clean_scrub_stamp":"2024-04-19T03:05:23.156852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:00:45.201755+0000","scrub_duration":0.036684305,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":85,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:12.421779+0000","last_change":"2024-04-19T03:04:50.278337+0000","last_active":"2024-04-19T03:05:12.421779+0000","last_peered":"2024-04-19T03:05:12.421779+0000","last_clean":"2024-04-19T03:05:12.421779+0000","last_became_active":"2024-04-19T03:04:50.277899+0000","last_became_peered":"2024-04-19T03:04:50.277899+0000","last_unstale":"2024-04-19T03:05:12.421779+0000","last_undegraded":"2024-04-19T03:05:12.421779+0000","last_fullsized":"2024-04-19T03:05:12.421779+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":71,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:12.904951+0000","last_change":"2024-04-19T03:05:11.430574+0000","last_active":"2024-04-19T03:05:12.904951+0000","last_peered":"2024-04-19T03:05:12.904951+0000","last_clean":"2024-04-19T03:05:12.904951+0000","last_became_active":"2024-04-19T03:05:11.430243+0000","last_became_peered":"2024-04-19T03:05:11.430243+0000","last_unstale":"2024-04-19T03:05:12.904951+0000","last_undegraded":"2024-04-19T03:05:12.904951+0000","last_fullsized":"2024-04-19T03:05:12.904951+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":62,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:30.443577+0000","last_change":"2024-04-19T03:05:30.443804+0000","last_active":"2024-04-19T03:05:30.443577+0000","last_peered":"2024-04-19T03:05:30.443577+0000","last_clean":"2024-04-19T03:05:30.443577+0000","last_became_active":"2024-04-19T03:05:09.392822+0000","last_became_peered":"2024-04-19T03:05:09.392822+0000","last_unstale":"2024-04-19T03:05:30.443577+0000","last_undegraded":"2024-04-19T03:05:30.443577+0000","last_fullsized":"2024-04-19T03:05:30.443577+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:05:30.443531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:05:30.443531+0000","last_clean_scrub_stamp":"2024-04-19T03:05:30.443531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:43:21.406385+0000","scrub_duration":0.0030470290000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":78,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:12.420621+0000","last_change":"2024-04-19T03:05:09.397000+0000","last_active":"2024-04-19T03:05:12.420621+0000","last_peered":"2024-04-19T03:05:12.420621+0000","last_clean":"2024-04-19T03:05:12.420621+0000","last_became_active":"2024-04-19T03:05:09.395749+0000","last_became_peered":"2024-04-19T03:05:09.395749+0000","last_unstale":"2024-04-19T03:05:12.420621+0000","last_undegraded":"2024-04-19T03:05:12.420621+0000","last_fullsized":"2024-04-19T03:05:12.420621+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":84,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:50.122363+0000","last_change":"2024-04-19T03:05:50.122363+0000","last_active":"2024-04-19T03:05:50.122363+0000","last_peered":"2024-04-19T03:05:50.122363+0000","last_clean":"2024-04-19T03:05:50.122363+0000","last_became_active":"2024-04-19T03:01:15.010472+0000","last_became_peered":"2024-04-19T03:01:15.010472+0000","last_unstale":"2024-04-19T03:05:50.122363+0000","last_undegraded":"2024-04-19T03:05:50.122363+0000","last_fullsized":"2024-04-19T03:05:50.122363+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:05:50.122017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:05:50.122017+0000","last_clean_scrub_stamp":"2024-04-19T03:05:50.122017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:38:58.698089+0000","scrub_duration":0.0034044829999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":75,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:19.714625+0000","last_change":"2024-04-19T03:05:11.428285+0000","last_active":"2024-04-19T03:05:19.714625+0000","last_peered":"2024-04-19T03:05:19.714625+0000","last_clean":"2024-04-19T03:05:19.714625+0000","last_became_active":"2024-04-19T03:05:11.425921+0000","last_became_peered":"2024-04-19T03:05:11.425921+0000","last_unstale":"2024-04-19T03:05:19.714625+0000","last_undegraded":"2024-04-19T03:05:19.714625+0000","last_fullsized":"2024-04-19T03:05:19.714625+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":83,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:39.150013+0000","last_change":"2024-04-19T03:05:39.150013+0000","last_active":"2024-04-19T03:05:39.150013+0000","last_peered":"2024-04-19T03:05:39.150013+0000","last_clean":"2024-04-19T03:05:39.150013+0000","last_became_active":"2024-04-19T03:05:11.425921+0000","last_became_peered":"2024-04-19T03:05:11.425921+0000","last_unstale":"2024-04-19T03:05:39.150013+0000","last_undegraded":"2024-04-19T03:05:39.150013+0000","last_fullsized":"2024-04-19T03:05:39.150013+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:05:39.149625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:05:39.149625+0000","last_clean_scrub_stamp":"2024-04-19T03:05:39.149625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:18:40.192906+0000","scrub_duration":0.0038324209999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":41,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:49.126663+0000","last_change":"2024-04-19T03:05:49.126778+0000","last_active":"2024-04-19T03:05:49.126663+0000","last_peered":"2024-04-19T03:05:49.126663+0000","last_clean":"2024-04-19T03:05:49.126663+0000","last_became_active":"2024-04-19T03:04:50.611392+0000","last_became_peered":"2024-04-19T03:04:50.611392+0000","last_unstale":"2024-04-19T03:05:49.126663+0000","last_undegraded":"2024-04-19T03:05:49.126663+0000","last_fullsized":"2024-04-19T03:05:49.126663+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:05:49.126640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:05:49.126640+0000","last_clean_scrub_stamp":"2024-04-19T03:05:49.126640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:45:17.738767+0000","scrub_duration":0.087429018999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":90,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:19.348906+0000","last_change":"2024-04-19T03:05:19.348906+0000","last_active":"2024-04-19T03:05:19.348906+0000","last_peered":"2024-04-19T03:05:19.348906+0000","last_clean":"2024-04-19T03:05:19.348906+0000","last_became_active":"2024-04-19T03:05:09.395682+0000","last_became_peered":"2024-04-19T03:05:09.395682+0000","last_unstale":"2024-04-19T03:05:19.348906+0000","last_undegraded":"2024-04-19T03:05:19.348906+0000","last_fullsized":"2024-04-19T03:05:19.348906+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:05:19.348599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:05:19.348599+0000","last_clean_scrub_stamp":"2024-04-19T03:05:19.348599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:22:58.194899+0000","scrub_duration":0.0032195190000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:12.769025+0000","last_change":"2024-04-19T03:04:50.613858+0000","last_active":"2024-04-19T03:05:12.769025+0000","last_peered":"2024-04-19T03:05:12.769025+0000","last_clean":"2024-04-19T03:05:12.769025+0000","last_became_active":"2024-04-19T03:04:50.613481+0000","last_became_peered":"2024-04-19T03:04:50.613481+0000","last_unstale":"2024-04-19T03:05:12.769025+0000","last_undegraded":"2024-04-19T03:05:12.769025+0000","last_fullsized":"2024-04-19T03:05:12.769025+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":88,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:19.714585+0000","last_change":"2024-04-19T03:05:11.431719+0000","last_active":"2024-04-19T03:05:19.714585+0000","last_peered":"2024-04-19T03:05:19.714585+0000","last_clean":"2024-04-19T03:05:19.714585+0000","last_became_active":"2024-04-19T03:05:11.431352+0000","last_became_peered":"2024-04-19T03:05:11.431352+0000","last_unstale":"2024-04-19T03:05:19.714585+0000","last_undegraded":"2024-04-19T03:05:19.714585+0000","last_fullsized":"2024-04-19T03:05:19.714585+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":86,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:19.714549+0000","last_change":"2024-04-19T03:04:50.276678+0000","last_active":"2024-04-19T03:05:19.714549+0000","last_peered":"2024-04-19T03:05:19.714549+0000","last_clean":"2024-04-19T03:05:19.714549+0000","last_became_active":"2024-04-19T03:04:50.275510+0000","last_became_peered":"2024-04-19T03:04:50.275510+0000","last_unstale":"2024-04-19T03:05:19.714549+0000","last_undegraded":"2024-04-19T03:05:19.714549+0000","last_fullsized":"2024-04-19T03:05:19.714549+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":73,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:19.241193+0000","last_change":"2024-04-19T03:01:15.020108+0000","last_active":"2024-04-19T03:05:19.241193+0000","last_peered":"2024-04-19T03:05:19.241193+0000","last_clean":"2024-04-19T03:05:19.241193+0000","last_became_active":"2024-04-19T03:01:15.018978+0000","last_became_peered":"2024-04-19T03:01:15.018978+0000","last_unstale":"2024-04-19T03:05:19.241193+0000","last_undegraded":"2024-04-19T03:05:19.241193+0000","last_fullsized":"2024-04-19T03:05:19.241193+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":41,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:27.084506+0000","last_change":"2024-04-19T03:05:27.084833+0000","last_active":"2024-04-19T03:05:27.084506+0000","last_peered":"2024-04-19T03:05:27.084506+0000","last_clean":"2024-04-19T03:05:27.084506+0000","last_became_active":"2024-04-19T03:04:50.630948+0000","last_became_peered":"2024-04-19T03:04:50.630948+0000","last_unstale":"2024-04-19T03:05:27.084506+0000","last_undegraded":"2024-04-19T03:05:27.084506+0000","last_fullsized":"2024-04-19T03:05:27.084506+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:05:27.084457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:05:27.084457+0000","last_clean_scrub_stamp":"2024-04-19T03:05:27.084457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:43:47.014628+0000","scrub_duration":0.0031579899999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":79,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:19.241161+0000","last_change":"2024-04-19T03:05:09.391159+0000","last_active":"2024-04-19T03:05:19.241161+0000","last_peered":"2024-04-19T03:05:19.241161+0000","last_clean":"2024-04-19T03:05:19.241161+0000","last_became_active":"2024-04-19T03:05:09.390922+0000","last_became_peered":"2024-04-19T03:05:09.390922+0000","last_unstale":"2024-04-19T03:05:19.241161+0000","last_undegraded":"2024-04-19T03:05:19.241161+0000","last_fullsized":"2024-04-19T03:05:19.241161+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":62,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:21.387816+0000","last_change":"2024-04-19T03:05:21.387930+0000","last_active":"2024-04-19T03:05:21.387816+0000","last_peered":"2024-04-19T03:05:21.387816+0000","last_clean":"2024-04-19T03:05:21.387816+0000","last_became_active":"2024-04-19T03:05:09.393108+0000","last_became_peered":"2024-04-19T03:05:09.393108+0000","last_unstale":"2024-04-19T03:05:21.387816+0000","last_undegraded":"2024-04-19T03:05:21.387816+0000","last_fullsized":"2024-04-19T03:05:21.387816+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:05:21.387796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:05:21.387796+0000","last_clean_scrub_stamp":"2024-04-19T03:05:21.387796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:19:53.306617+0000","scrub_duration":0.042477411999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:12.769547+0000","last_change":"2024-04-19T03:04:50.626923+0000","last_active":"2024-04-19T03:05:12.769547+0000","last_peered":"2024-04-19T03:05:12.769547+0000","last_clean":"2024-04-19T03:05:12.769547+0000","last_became_active":"2024-04-19T03:04:50.617603+0000","last_became_peered":"2024-04-19T03:04:50.617603+0000","last_unstale":"2024-04-19T03:05:12.769547+0000","last_undegraded":"2024-04-19T03:05:12.769547+0000","last_fullsized":"2024-04-19T03:05:12.769547+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":39,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:13.201146+0000","last_change":"2024-04-19T03:05:11.431713+0000","last_active":"2024-04-19T03:05:13.201146+0000","last_peered":"2024-04-19T03:05:13.201146+0000","last_clean":"2024-04-19T03:05:13.201146+0000","last_became_active":"2024-04-19T03:05:11.431129+0000","last_became_peered":"2024-04-19T03:05:11.431129+0000","last_unstale":"2024-04-19T03:05:13.201146+0000","last_undegraded":"2024-04-19T03:05:13.201146+0000","last_fullsized":"2024-04-19T03:05:13.201146+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":73,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:19.241426+0000","last_change":"2024-04-19T03:01:15.020098+0000","last_active":"2024-04-19T03:05:19.241426+0000","last_peered":"2024-04-19T03:05:19.241426+0000","last_clean":"2024-04-19T03:05:19.241426+0000","last_became_active":"2024-04-19T03:01:15.019064+0000","last_became_peered":"2024-04-19T03:01:15.019064+0000","last_unstale":"2024-04-19T03:05:19.241426+0000","last_undegraded":"2024-04-19T03:05:19.241426+0000","last_fullsized":"2024-04-19T03:05:19.241426+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:12.768539+0000","last_change":"2024-04-19T03:04:50.616823+0000","last_active":"2024-04-19T03:05:12.768539+0000","last_peered":"2024-04-19T03:05:12.768539+0000","last_clean":"2024-04-19T03:05:12.768539+0000","last_became_active":"2024-04-19T03:04:50.616550+0000","last_became_peered":"2024-04-19T03:04:50.616550+0000","last_unstale":"2024-04-19T03:05:12.768539+0000","last_undegraded":"2024-04-19T03:05:12.768539+0000","last_fullsized":"2024-04-19T03:05:12.768539+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":62,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:41.381935+0000","last_change":"2024-04-19T03:05:41.382171+0000","last_active":"2024-04-19T03:05:41.381935+0000","last_peered":"2024-04-19T03:05:41.381935+0000","last_clean":"2024-04-19T03:05:41.381935+0000","last_became_active":"2024-04-19T03:05:09.393178+0000","last_became_peered":"2024-04-19T03:05:09.393178+0000","last_unstale":"2024-04-19T03:05:41.381935+0000","last_undegraded":"2024-04-19T03:05:41.381935+0000","last_fullsized":"2024-04-19T03:05:41.381935+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:05:41.381892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:05:41.381892+0000","last_clean_scrub_stamp":"2024-04-19T03:05:41.381892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:26:44.553697+0000","scrub_duration":0.0032496449999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":41,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:40.160084+0000","last_change":"2024-04-19T03:05:40.160372+0000","last_active":"2024-04-19T03:05:40.160084+0000","last_peered":"2024-04-19T03:05:40.160084+0000","last_clean":"2024-04-19T03:05:40.160084+0000","last_became_active":"2024-04-19T03:04:50.633033+0000","last_became_peered":"2024-04-19T03:04:50.633033+0000","last_unstale":"2024-04-19T03:05:40.160084+0000","last_undegraded":"2024-04-19T03:05:40.160084+0000","last_fullsized":"2024-04-19T03:05:40.160084+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:05:40.160035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:05:40.160035+0000","last_clean_scrub_stamp":"2024-04-19T03:05:40.160035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:22:24.075162+0000","scrub_duration":0.0035144400000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":97,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:45.098945+0000","last_change":"2024-04-19T03:05:45.099168+0000","last_active":"2024-04-19T03:05:45.098945+0000","last_peered":"2024-04-19T03:05:45.098945+0000","last_clean":"2024-04-19T03:05:45.098945+0000","last_became_active":"2024-04-19T03:04:50.278996+0000","last_became_peered":"2024-04-19T03:04:50.278996+0000","last_unstale":"2024-04-19T03:05:45.098945+0000","last_undegraded":"2024-04-19T03:05:45.098945+0000","last_fullsized":"2024-04-19T03:05:45.098945+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:05:45.098897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:05:45.098897+0000","last_clean_scrub_stamp":"2024-04-19T03:05:45.098897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:59:51.710788+0000","scrub_duration":0.0034812490000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":90,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:34.468578+0000","last_change":"2024-04-19T03:05:34.468578+0000","last_active":"2024-04-19T03:05:34.468578+0000","last_peered":"2024-04-19T03:05:34.468578+0000","last_clean":"2024-04-19T03:05:34.468578+0000","last_became_active":"2024-04-19T03:05:09.395920+0000","last_became_peered":"2024-04-19T03:05:09.395920+0000","last_unstale":"2024-04-19T03:05:34.468578+0000","last_undegraded":"2024-04-19T03:05:34.468578+0000","last_fullsized":"2024-04-19T03:05:34.468578+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:05:34.468305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:05:34.468305+0000","last_clean_scrub_stamp":"2024-04-19T03:05:34.468305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:54:24.688379+0000","scrub_duration":0.003618422,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"20'2","reported_seq":89,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:19.713827+0000","last_change":"2024-04-19T03:04:50.277421+0000","last_active":"2024-04-19T03:05:19.713827+0000","last_peered":"2024-04-19T03:05:19.713827+0000","last_clean":"2024-04-19T03:05:19.713827+0000","last_became_active":"2024-04-19T03:04:50.276732+0000","last_became_peered":"2024-04-19T03:04:50.276732+0000","last_unstale":"2024-04-19T03:05:19.713827+0000","last_undegraded":"2024-04-19T03:05:19.713827+0000","last_fullsized":"2024-04-19T03:05:19.713827+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":78,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:12.421558+0000","last_change":"2024-04-19T03:05:09.395454+0000","last_active":"2024-04-19T03:05:12.421558+0000","last_peered":"2024-04-19T03:05:12.421558+0000","last_clean":"2024-04-19T03:05:12.421558+0000","last_became_active":"2024-04-19T03:05:09.394288+0000","last_became_peered":"2024-04-19T03:05:09.394288+0000","last_unstale":"2024-04-19T03:05:12.421558+0000","last_undegraded":"2024-04-19T03:05:12.421558+0000","last_fullsized":"2024-04-19T03:05:12.421558+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":31,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:12.768520+0000","last_change":"2024-04-19T03:04:50.628801+0000","last_active":"2024-04-19T03:05:12.768520+0000","last_peered":"2024-04-19T03:05:12.768520+0000","last_clean":"2024-04-19T03:05:12.768520+0000","last_became_active":"2024-04-19T03:04:50.628023+0000","last_became_peered":"2024-04-19T03:04:50.628023+0000","last_unstale":"2024-04-19T03:05:12.768520+0000","last_undegraded":"2024-04-19T03:05:12.768520+0000","last_fullsized":"2024-04-19T03:05:12.768520+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":41,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:22.156343+0000","last_change":"2024-04-19T03:05:22.156583+0000","last_active":"2024-04-19T03:05:22.156343+0000","last_peered":"2024-04-19T03:05:22.156343+0000","last_clean":"2024-04-19T03:05:22.156343+0000","last_became_active":"2024-04-19T03:04:50.613860+0000","last_became_peered":"2024-04-19T03:04:50.613860+0000","last_unstale":"2024-04-19T03:05:22.156343+0000","last_undegraded":"2024-04-19T03:05:22.156343+0000","last_fullsized":"2024-04-19T03:05:22.156343+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:05:22.156296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:05:22.156296+0000","last_clean_scrub_stamp":"2024-04-19T03:05:22.156296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:47:31.989944+0000","scrub_duration":0.0031789600000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":74,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:19.240488+0000","last_change":"2024-04-19T03:01:14.649074+0000","last_active":"2024-04-19T03:05:19.240488+0000","last_peered":"2024-04-19T03:05:19.240488+0000","last_clean":"2024-04-19T03:05:19.240488+0000","last_became_active":"2024-04-19T03:01:14.648217+0000","last_became_peered":"2024-04-19T03:01:14.648217+0000","last_unstale":"2024-04-19T03:05:19.240488+0000","last_undegraded":"2024-04-19T03:05:19.240488+0000","last_fullsized":"2024-04-19T03:05:19.240488+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:12.769444+0000","last_change":"2024-04-19T03:04:50.611026+0000","last_active":"2024-04-19T03:05:12.769444+0000","last_peered":"2024-04-19T03:05:12.769444+0000","last_clean":"2024-04-19T03:05:12.769444+0000","last_became_active":"2024-04-19T03:04:50.610659+0000","last_became_peered":"2024-04-19T03:04:50.610659+0000","last_unstale":"2024-04-19T03:05:12.769444+0000","last_undegraded":"2024-04-19T03:05:12.769444+0000","last_fullsized":"2024-04-19T03:05:12.769444+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"20'8","reported_seq":87,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:19.713849+0000","last_change":"2024-04-19T03:05:11.429829+0000","last_active":"2024-04-19T03:05:19.713849+0000","last_peered":"2024-04-19T03:05:19.713849+0000","last_clean":"2024-04-19T03:05:19.713849+0000","last_became_active":"2024-04-19T03:05:11.428668+0000","last_became_peered":"2024-04-19T03:05:11.428668+0000","last_unstale":"2024-04-19T03:05:19.713849+0000","last_undegraded":"2024-04-19T03:05:19.713849+0000","last_fullsized":"2024-04-19T03:05:19.713849+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"20'1","reported_seq":75,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:19.713750+0000","last_change":"2024-04-19T03:01:14.649839+0000","last_active":"2024-04-19T03:05:19.713750+0000","last_peered":"2024-04-19T03:05:19.713750+0000","last_clean":"2024-04-19T03:05:19.713750+0000","last_became_active":"2024-04-19T03:01:14.649571+0000","last_became_peered":"2024-04-19T03:01:14.649571+0000","last_unstale":"2024-04-19T03:05:19.713750+0000","last_undegraded":"2024-04-19T03:05:19.713750+0000","last_fullsized":"2024-04-19T03:05:19.713750+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":54,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:12.419874+0000","last_change":"2024-04-19T03:05:02.362526+0000","last_active":"2024-04-19T03:05:12.419874+0000","last_peered":"2024-04-19T03:05:12.419874+0000","last_clean":"2024-04-19T03:05:12.419874+0000","last_became_active":"2024-04-19T03:05:02.362227+0000","last_became_peered":"2024-04-19T03:05:02.362227+0000","last_unstale":"2024-04-19T03:05:12.419874+0000","last_undegraded":"2024-04-19T03:05:12.419874+0000","last_fullsized":"2024-04-19T03:05:12.419874+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"20'2","reported_seq":76,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:19.240408+0000","last_change":"2024-04-19T03:01:14.645075+0000","last_active":"2024-04-19T03:05:19.240408+0000","last_peered":"2024-04-19T03:05:19.240408+0000","last_clean":"2024-04-19T03:05:19.240408+0000","last_became_active":"2024-04-19T03:01:14.644790+0000","last_became_peered":"2024-04-19T03:01:14.644790+0000","last_unstale":"2024-04-19T03:05:19.240408+0000","last_undegraded":"2024-04-19T03:05:19.240408+0000","last_fullsized":"2024-04-19T03:05:19.240408+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":79,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:19.240928+0000","last_change":"2024-04-19T03:05:09.393128+0000","last_active":"2024-04-19T03:05:19.240928+0000","last_peered":"2024-04-19T03:05:19.240928+0000","last_clean":"2024-04-19T03:05:19.240928+0000","last_became_active":"2024-04-19T03:05:09.392736+0000","last_became_peered":"2024-04-19T03:05:09.392736+0000","last_unstale":"2024-04-19T03:05:19.240928+0000","last_undegraded":"2024-04-19T03:05:19.240928+0000","last_fullsized":"2024-04-19T03:05:19.240928+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"20'1","reported_seq":41,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:13.201186+0000","last_change":"2024-04-19T03:05:11.431892+0000","last_active":"2024-04-19T03:05:13.201186+0000","last_peered":"2024-04-19T03:05:13.201186+0000","last_clean":"2024-04-19T03:05:13.201186+0000","last_became_active":"2024-04-19T03:05:11.431552+0000","last_became_peered":"2024-04-19T03:05:11.431552+0000","last_unstale":"2024-04-19T03:05:13.201186+0000","last_undegraded":"2024-04-19T03:05:13.201186+0000","last_fullsized":"2024-04-19T03:05:13.201186+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":86,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:19.714139+0000","last_change":"2024-04-19T03:04:50.277960+0000","last_active":"2024-04-19T03:05:19.714139+0000","last_peered":"2024-04-19T03:05:19.714139+0000","last_clean":"2024-04-19T03:05:19.714139+0000","last_became_active":"2024-04-19T03:04:50.277126+0000","last_became_peered":"2024-04-19T03:04:50.277126+0000","last_unstale":"2024-04-19T03:05:19.714139+0000","last_undegraded":"2024-04-19T03:05:19.714139+0000","last_fullsized":"2024-04-19T03:05:19.714139+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":73,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:19.713832+0000","last_change":"2024-04-19T03:05:11.429040+0000","last_active":"2024-04-19T03:05:19.713832+0000","last_peered":"2024-04-19T03:05:19.713832+0000","last_clean":"2024-04-19T03:05:19.713832+0000","last_became_active":"2024-04-19T03:05:11.428722+0000","last_became_peered":"2024-04-19T03:05:11.428722+0000","last_unstale":"2024-04-19T03:05:19.713832+0000","last_undegraded":"2024-04-19T03:05:19.713832+0000","last_fullsized":"2024-04-19T03:05:19.713832+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:12.770284+0000","last_change":"2024-04-19T03:04:50.627120+0000","last_active":"2024-04-19T03:05:12.770284+0000","last_peered":"2024-04-19T03:05:12.770284+0000","last_clean":"2024-04-19T03:05:12.770284+0000","last_became_active":"2024-04-19T03:04:50.625919+0000","last_became_peered":"2024-04-19T03:04:50.625919+0000","last_unstale":"2024-04-19T03:05:12.770284+0000","last_undegraded":"2024-04-19T03:05:12.770284+0000","last_fullsized":"2024-04-19T03:05:12.770284+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"20'2","reported_seq":33,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:12.769661+0000","last_change":"2024-04-19T03:04:50.627277+0000","last_active":"2024-04-19T03:05:12.769661+0000","last_peered":"2024-04-19T03:05:12.769661+0000","last_clean":"2024-04-19T03:05:12.769661+0000","last_became_active":"2024-04-19T03:04:50.625931+0000","last_became_peered":"2024-04-19T03:04:50.625931+0000","last_unstale":"2024-04-19T03:05:12.769661+0000","last_undegraded":"2024-04-19T03:05:12.769661+0000","last_fullsized":"2024-04-19T03:05:12.769661+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":88,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:19.714149+0000","last_change":"2024-04-19T03:05:11.430496+0000","last_active":"2024-04-19T03:05:19.714149+0000","last_peered":"2024-04-19T03:05:19.714149+0000","last_clean":"2024-04-19T03:05:19.714149+0000","last_became_active":"2024-04-19T03:05:11.430149+0000","last_became_peered":"2024-04-19T03:05:11.430149+0000","last_unstale":"2024-04-19T03:05:19.714149+0000","last_undegraded":"2024-04-19T03:05:19.714149+0000","last_fullsized":"2024-04-19T03:05:19.714149+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":87,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:19.713774+0000","last_change":"2024-04-19T03:04:50.278491+0000","last_active":"2024-04-19T03:05:19.713774+0000","last_peered":"2024-04-19T03:05:19.713774+0000","last_clean":"2024-04-19T03:05:19.713774+0000","last_became_active":"2024-04-19T03:04:50.277603+0000","last_became_peered":"2024-04-19T03:04:50.277603+0000","last_unstale":"2024-04-19T03:05:19.713774+0000","last_undegraded":"2024-04-19T03:05:19.713774+0000","last_fullsized":"2024-04-19T03:05:19.713774+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":84,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:46.144344+0000","last_change":"2024-04-19T03:05:46.144560+0000","last_active":"2024-04-19T03:05:46.144344+0000","last_peered":"2024-04-19T03:05:46.144344+0000","last_clean":"2024-04-19T03:05:46.144344+0000","last_became_active":"2024-04-19T03:01:15.014847+0000","last_became_peered":"2024-04-19T03:01:15.014847+0000","last_unstale":"2024-04-19T03:05:46.144344+0000","last_undegraded":"2024-04-19T03:05:46.144344+0000","last_fullsized":"2024-04-19T03:05:46.144344+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:05:46.144300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:05:46.144300+0000","last_clean_scrub_stamp":"2024-04-19T03:05:46.144300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:43:25.191286+0000","scrub_duration":0.0032320750000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":63,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:42.387222+0000","last_change":"2024-04-19T03:05:42.387451+0000","last_active":"2024-04-19T03:05:42.387222+0000","last_peered":"2024-04-19T03:05:42.387222+0000","last_clean":"2024-04-19T03:05:42.387222+0000","last_became_active":"2024-04-19T03:05:09.391218+0000","last_became_peered":"2024-04-19T03:05:09.391218+0000","last_unstale":"2024-04-19T03:05:42.387222+0000","last_undegraded":"2024-04-19T03:05:42.387222+0000","last_fullsized":"2024-04-19T03:05:42.387222+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:05:42.387178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:05:42.387178+0000","last_clean_scrub_stamp":"2024-04-19T03:05:42.387178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:52:14.035747+0000","scrub_duration":0.003459981,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":73,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:19.714183+0000","last_change":"2024-04-19T03:01:15.014818+0000","last_active":"2024-04-19T03:05:19.714183+0000","last_peered":"2024-04-19T03:05:19.714183+0000","last_clean":"2024-04-19T03:05:19.714183+0000","last_became_active":"2024-04-19T03:01:15.014421+0000","last_became_peered":"2024-04-19T03:01:15.014421+0000","last_unstale":"2024-04-19T03:05:19.714183+0000","last_undegraded":"2024-04-19T03:05:19.714183+0000","last_fullsized":"2024-04-19T03:05:19.714183+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":91,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:50.475678+0000","last_change":"2024-04-19T03:05:50.475892+0000","last_active":"2024-04-19T03:05:50.475678+0000","last_peered":"2024-04-19T03:05:50.475678+0000","last_clean":"2024-04-19T03:05:50.475678+0000","last_became_active":"2024-04-19T03:05:09.395294+0000","last_became_peered":"2024-04-19T03:05:09.395294+0000","last_unstale":"2024-04-19T03:05:50.475678+0000","last_undegraded":"2024-04-19T03:05:50.475678+0000","last_fullsized":"2024-04-19T03:05:50.475678+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:05:50.475630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:05:50.475630+0000","last_clean_scrub_stamp":"2024-04-19T03:05:50.475630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:03:15.099595+0000","scrub_duration":0.0034712469999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":41,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:50.148906+0000","last_change":"2024-04-19T03:05:50.149020+0000","last_active":"2024-04-19T03:05:50.148906+0000","last_peered":"2024-04-19T03:05:50.148906+0000","last_clean":"2024-04-19T03:05:50.148906+0000","last_became_active":"2024-04-19T03:04:50.617323+0000","last_became_peered":"2024-04-19T03:04:50.617323+0000","last_unstale":"2024-04-19T03:05:50.148906+0000","last_undegraded":"2024-04-19T03:05:50.148906+0000","last_fullsized":"2024-04-19T03:05:50.148906+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:05:50.148885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:05:50.148885+0000","last_clean_scrub_stamp":"2024-04-19T03:05:50.148885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:47:33.437890+0000","scrub_duration":0.061933355000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"14'157","reported_seq":280,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:13.200849+0000","last_change":"2024-04-19T03:05:11.429096+0000","last_active":"2024-04-19T03:05:13.200849+0000","last_peered":"2024-04-19T03:05:13.200849+0000","last_clean":"2024-04-19T03:05:13.200849+0000","last_became_active":"2024-04-19T03:05:11.426859+0000","last_became_peered":"2024-04-19T03:05:11.426859+0000","last_unstale":"2024-04-19T03:05:13.200849+0000","last_undegraded":"2024-04-19T03:05:13.200849+0000","last_fullsized":"2024-04-19T03:05:13.200849+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:06.516863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:06.516863+0000","last_clean_scrub_stamp":"2024-04-19T03:01:06.516863+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":89,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:19.713590+0000","last_change":"2024-04-19T03:04:50.277227+0000","last_active":"2024-04-19T03:05:19.713590+0000","last_peered":"2024-04-19T03:05:19.713590+0000","last_clean":"2024-04-19T03:05:19.713590+0000","last_became_active":"2024-04-19T03:04:50.276132+0000","last_became_peered":"2024-04-19T03:04:50.276132+0000","last_unstale":"2024-04-19T03:05:19.713590+0000","last_undegraded":"2024-04-19T03:05:19.713590+0000","last_fullsized":"2024-04-19T03:05:19.713590+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_clean_scrub_stamp":"2024-04-19T03:01:09.578660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":31,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:12.768952+0000","last_change":"2024-04-19T03:04:50.629139+0000","last_active":"2024-04-19T03:05:12.768952+0000","last_peered":"2024-04-19T03:05:12.768952+0000","last_clean":"2024-04-19T03:05:12.768952+0000","last_became_active":"2024-04-19T03:04:50.628741+0000","last_became_peered":"2024-04-19T03:04:50.628741+0000","last_unstale":"2024-04-19T03:05:12.768952+0000","last_undegraded":"2024-04-19T03:05:12.768952+0000","last_fullsized":"2024-04-19T03:05:12.768952+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":86,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:37.209852+0000","last_change":"2024-04-19T03:05:37.210309+0000","last_active":"2024-04-19T03:05:37.209852+0000","last_peered":"2024-04-19T03:05:37.209852+0000","last_clean":"2024-04-19T03:05:37.209852+0000","last_became_active":"2024-04-19T03:05:11.430881+0000","last_became_peered":"2024-04-19T03:05:11.430881+0000","last_unstale":"2024-04-19T03:05:37.209852+0000","last_undegraded":"2024-04-19T03:05:37.209852+0000","last_fullsized":"2024-04-19T03:05:37.209852+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:05:37.209759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:05:37.209759+0000","last_clean_scrub_stamp":"2024-04-19T03:05:37.209759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:52:10.997951+0000","scrub_duration":0.0033919810000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":76,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:12.903561+0000","last_change":"2024-04-19T03:01:10.602194+0000","last_active":"2024-04-19T03:05:12.903561+0000","last_peered":"2024-04-19T03:05:12.903561+0000","last_clean":"2024-04-19T03:05:12.903561+0000","last_became_active":"2024-04-19T03:01:10.601381+0000","last_became_peered":"2024-04-19T03:01:10.601381+0000","last_unstale":"2024-04-19T03:05:12.903561+0000","last_undegraded":"2024-04-19T03:05:12.903561+0000","last_fullsized":"2024-04-19T03:05:12.903561+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_clean_scrub_stamp":"2024-04-19T03:01:09.578660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":31,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:12.767978+0000","last_change":"2024-04-19T03:04:50.634401+0000","last_active":"2024-04-19T03:05:12.767978+0000","last_peered":"2024-04-19T03:05:12.767978+0000","last_clean":"2024-04-19T03:05:12.767978+0000","last_became_active":"2024-04-19T03:04:50.631721+0000","last_became_peered":"2024-04-19T03:04:50.631721+0000","last_unstale":"2024-04-19T03:05:12.767978+0000","last_undegraded":"2024-04-19T03:05:12.767978+0000","last_fullsized":"2024-04-19T03:05:12.767978+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":90,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:45.465307+0000","last_change":"2024-04-19T03:05:45.465610+0000","last_active":"2024-04-19T03:05:45.465307+0000","last_peered":"2024-04-19T03:05:45.465307+0000","last_clean":"2024-04-19T03:05:45.465307+0000","last_became_active":"2024-04-19T03:05:09.395167+0000","last_became_peered":"2024-04-19T03:05:09.395167+0000","last_unstale":"2024-04-19T03:05:45.465307+0000","last_undegraded":"2024-04-19T03:05:45.465307+0000","last_fullsized":"2024-04-19T03:05:45.465307+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:05:45.465258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:05:45.465258+0000","last_clean_scrub_stamp":"2024-04-19T03:05:45.465258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:21:36.562113+0000","scrub_duration":0.0030148670000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":41,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:19.154051+0000","last_change":"2024-04-19T03:05:19.169049+0000","last_active":"2024-04-19T03:05:19.154051+0000","last_peered":"2024-04-19T03:05:19.154051+0000","last_clean":"2024-04-19T03:05:19.154051+0000","last_became_active":"2024-04-19T03:04:50.633457+0000","last_became_peered":"2024-04-19T03:04:50.633457+0000","last_unstale":"2024-04-19T03:05:19.154051+0000","last_undegraded":"2024-04-19T03:05:19.154051+0000","last_fullsized":"2024-04-19T03:05:19.154051+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:05:19.154005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:05:19.154005+0000","last_clean_scrub_stamp":"2024-04-19T03:05:19.154005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:23:03.401654+0000","scrub_duration":0.0034373889999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":74,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:15.172674+0000","last_change":"2024-04-19T03:01:14.649068+0000","last_active":"2024-04-19T03:05:15.172674+0000","last_peered":"2024-04-19T03:05:15.172674+0000","last_clean":"2024-04-19T03:05:15.172674+0000","last_became_active":"2024-04-19T03:01:14.648082+0000","last_became_peered":"2024-04-19T03:01:14.648082+0000","last_unstale":"2024-04-19T03:05:15.172674+0000","last_undegraded":"2024-04-19T03:05:15.172674+0000","last_fullsized":"2024-04-19T03:05:15.172674+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":41,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:34.130919+0000","last_change":"2024-04-19T03:05:34.131042+0000","last_active":"2024-04-19T03:05:34.130919+0000","last_peered":"2024-04-19T03:05:34.130919+0000","last_clean":"2024-04-19T03:05:34.130919+0000","last_became_active":"2024-04-19T03:04:50.617628+0000","last_became_peered":"2024-04-19T03:04:50.617628+0000","last_unstale":"2024-04-19T03:05:34.130919+0000","last_undegraded":"2024-04-19T03:05:34.130919+0000","last_fullsized":"2024-04-19T03:05:34.130919+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:05:34.130897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:05:34.130897+0000","last_clean_scrub_stamp":"2024-04-19T03:05:34.130897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:03:56.628506+0000","scrub_duration":0.037678018000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":89,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:19.713612+0000","last_change":"2024-04-19T03:04:50.278737+0000","last_active":"2024-04-19T03:05:19.713612+0000","last_peered":"2024-04-19T03:05:19.713612+0000","last_clean":"2024-04-19T03:05:19.713612+0000","last_became_active":"2024-04-19T03:04:50.277804+0000","last_became_peered":"2024-04-19T03:04:50.277804+0000","last_unstale":"2024-04-19T03:05:19.713612+0000","last_undegraded":"2024-04-19T03:05:19.713612+0000","last_fullsized":"2024-04-19T03:05:19.713612+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_clean_scrub_stamp":"2024-04-19T03:01:09.578660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":87,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:19.713697+0000","last_change":"2024-04-19T03:04:50.277141+0000","last_active":"2024-04-19T03:05:19.713697+0000","last_peered":"2024-04-19T03:05:19.713697+0000","last_clean":"2024-04-19T03:05:19.713697+0000","last_became_active":"2024-04-19T03:04:50.275812+0000","last_became_peered":"2024-04-19T03:04:50.275812+0000","last_unstale":"2024-04-19T03:05:19.713697+0000","last_undegraded":"2024-04-19T03:05:19.713697+0000","last_fullsized":"2024-04-19T03:05:19.713697+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:12.769412+0000","last_change":"2024-04-19T03:04:50.616475+0000","last_active":"2024-04-19T03:05:12.769412+0000","last_peered":"2024-04-19T03:05:12.769412+0000","last_clean":"2024-04-19T03:05:12.769412+0000","last_became_active":"2024-04-19T03:04:50.614774+0000","last_became_peered":"2024-04-19T03:04:50.614774+0000","last_unstale":"2024-04-19T03:05:12.769412+0000","last_undegraded":"2024-04-19T03:05:12.769412+0000","last_fullsized":"2024-04-19T03:05:12.769412+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":84,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:22.163334+0000","last_change":"2024-04-19T03:05:22.163334+0000","last_active":"2024-04-19T03:05:22.163334+0000","last_peered":"2024-04-19T03:05:22.163334+0000","last_clean":"2024-04-19T03:05:22.163334+0000","last_became_active":"2024-04-19T03:05:11.429941+0000","last_became_peered":"2024-04-19T03:05:11.429941+0000","last_unstale":"2024-04-19T03:05:22.163334+0000","last_undegraded":"2024-04-19T03:05:22.163334+0000","last_fullsized":"2024-04-19T03:05:22.163334+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:05:22.163031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:05:22.163031+0000","last_clean_scrub_stamp":"2024-04-19T03:05:22.163031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:21:13.259886+0000","scrub_duration":0.0032565699999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":41,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:26.113178+0000","last_change":"2024-04-19T03:05:26.113394+0000","last_active":"2024-04-19T03:05:26.113178+0000","last_peered":"2024-04-19T03:05:26.113178+0000","last_clean":"2024-04-19T03:05:26.113178+0000","last_became_active":"2024-04-19T03:04:50.614498+0000","last_became_peered":"2024-04-19T03:04:50.614498+0000","last_unstale":"2024-04-19T03:05:26.113178+0000","last_undegraded":"2024-04-19T03:05:26.113178+0000","last_fullsized":"2024-04-19T03:05:26.113178+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:05:26.113130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:05:26.113130+0000","last_clean_scrub_stamp":"2024-04-19T03:05:26.113130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:38:46.443254+0000","scrub_duration":0.0031920770000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":51,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:12.420579+0000","last_change":"2024-04-19T03:05:09.395750+0000","last_active":"2024-04-19T03:05:12.420579+0000","last_peered":"2024-04-19T03:05:12.420579+0000","last_clean":"2024-04-19T03:05:12.420579+0000","last_became_active":"2024-04-19T03:05:09.394024+0000","last_became_peered":"2024-04-19T03:05:09.394024+0000","last_unstale":"2024-04-19T03:05:12.420579+0000","last_undegraded":"2024-04-19T03:05:12.420579+0000","last_fullsized":"2024-04-19T03:05:12.420579+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":42,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:33.132538+0000","last_change":"2024-04-19T03:05:33.132791+0000","last_active":"2024-04-19T03:05:33.132538+0000","last_peered":"2024-04-19T03:05:33.132538+0000","last_clean":"2024-04-19T03:05:33.132538+0000","last_became_active":"2024-04-19T03:04:50.615238+0000","last_became_peered":"2024-04-19T03:04:50.615238+0000","last_unstale":"2024-04-19T03:05:33.132538+0000","last_undegraded":"2024-04-19T03:05:33.132538+0000","last_fullsized":"2024-04-19T03:05:33.132538+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:05:33.132481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:05:33.132481+0000","last_clean_scrub_stamp":"2024-04-19T03:05:33.132481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:12:12.823889+0000","scrub_duration":0.0033373280000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":83,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:19.240328+0000","last_change":"2024-04-19T03:05:09.397542+0000","last_active":"2024-04-19T03:05:19.240328+0000","last_peered":"2024-04-19T03:05:19.240328+0000","last_clean":"2024-04-19T03:05:19.240328+0000","last_became_active":"2024-04-19T03:05:09.396378+0000","last_became_peered":"2024-04-19T03:05:09.396378+0000","last_unstale":"2024-04-19T03:05:19.240328+0000","last_undegraded":"2024-04-19T03:05:19.240328+0000","last_fullsized":"2024-04-19T03:05:19.240328+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_clean_scrub_stamp":"2024-04-19T03:01:09.578660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":51,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:12.420654+0000","last_change":"2024-04-19T03:05:09.392910+0000","last_active":"2024-04-19T03:05:12.420654+0000","last_peered":"2024-04-19T03:05:12.420654+0000","last_clean":"2024-04-19T03:05:12.420654+0000","last_became_active":"2024-04-19T03:05:09.392437+0000","last_became_peered":"2024-04-19T03:05:09.392437+0000","last_unstale":"2024-04-19T03:05:12.420654+0000","last_undegraded":"2024-04-19T03:05:12.420654+0000","last_fullsized":"2024-04-19T03:05:12.420654+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"81'3","reported_seq":45,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:57.905939+0000","last_change":"2024-04-19T03:05:57.906283+0000","last_active":"2024-04-19T03:05:57.905939+0000","last_peered":"2024-04-19T03:05:57.905939+0000","last_clean":"2024-04-19T03:05:57.905939+0000","last_became_active":"2024-04-19T03:04:50.611024+0000","last_became_peered":"2024-04-19T03:04:50.611024+0000","last_unstale":"2024-04-19T03:05:57.905939+0000","last_undegraded":"2024-04-19T03:05:57.905939+0000","last_fullsized":"2024-04-19T03:05:57.905939+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'3","last_scrub_stamp":"2024-04-19T03:05:57.905886+0000","last_deep_scrub":"81'3","last_deep_scrub_stamp":"2024-04-19T03:05:57.905886+0000","last_clean_scrub_stamp":"2024-04-19T03:05:57.905886+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:53:22.931871+0000","scrub_duration":0.006376273,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:12.768966+0000","last_change":"2024-04-19T03:04:50.616003+0000","last_active":"2024-04-19T03:05:12.768966+0000","last_peered":"2024-04-19T03:05:12.768966+0000","last_clean":"2024-04-19T03:05:12.768966+0000","last_became_active":"2024-04-19T03:04:50.612403+0000","last_became_peered":"2024-04-19T03:04:50.612403+0000","last_unstale":"2024-04-19T03:05:12.768966+0000","last_undegraded":"2024-04-19T03:05:12.768966+0000","last_fullsized":"2024-04-19T03:05:12.768966+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_clean_scrub_stamp":"2024-04-19T03:01:09.578660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":41,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:47.097742+0000","last_change":"2024-04-19T03:05:47.097999+0000","last_active":"2024-04-19T03:05:47.097742+0000","last_peered":"2024-04-19T03:05:47.097742+0000","last_clean":"2024-04-19T03:05:47.097742+0000","last_became_active":"2024-04-19T03:04:50.612987+0000","last_became_peered":"2024-04-19T03:04:50.612987+0000","last_unstale":"2024-04-19T03:05:47.097742+0000","last_undegraded":"2024-04-19T03:05:47.097742+0000","last_fullsized":"2024-04-19T03:05:47.097742+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:05:47.097698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:05:47.097698+0000","last_clean_scrub_stamp":"2024-04-19T03:05:47.097698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:08:39.534725+0000","scrub_duration":0.0032086129999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"81'2","reported_seq":46,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:46.119148+0000","last_change":"2024-04-19T03:05:46.119402+0000","last_active":"2024-04-19T03:05:46.119148+0000","last_peered":"2024-04-19T03:05:46.119148+0000","last_clean":"2024-04-19T03:05:46.119148+0000","last_became_active":"2024-04-19T03:04:50.612697+0000","last_became_peered":"2024-04-19T03:04:50.612697+0000","last_unstale":"2024-04-19T03:05:46.119148+0000","last_undegraded":"2024-04-19T03:05:46.119148+0000","last_fullsized":"2024-04-19T03:05:46.119148+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'2","last_scrub_stamp":"2024-04-19T03:05:46.119093+0000","last_deep_scrub":"81'2","last_deep_scrub_stamp":"2024-04-19T03:05:46.119093+0000","last_clean_scrub_stamp":"2024-04-19T03:05:46.119093+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:47:01.115618+0000","scrub_duration":0.0063348040000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":76,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:19.713587+0000","last_change":"2024-04-19T03:01:10.602274+0000","last_active":"2024-04-19T03:05:19.713587+0000","last_peered":"2024-04-19T03:05:19.713587+0000","last_clean":"2024-04-19T03:05:19.713587+0000","last_became_active":"2024-04-19T03:01:10.601487+0000","last_became_peered":"2024-04-19T03:01:10.601487+0000","last_unstale":"2024-04-19T03:05:19.713587+0000","last_undegraded":"2024-04-19T03:05:19.713587+0000","last_fullsized":"2024-04-19T03:05:19.713587+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_clean_scrub_stamp":"2024-04-19T03:01:09.578660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":73,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:19.240645+0000","last_change":"2024-04-19T03:01:15.018914+0000","last_active":"2024-04-19T03:05:19.240645+0000","last_peered":"2024-04-19T03:05:19.240645+0000","last_clean":"2024-04-19T03:05:19.240645+0000","last_became_active":"2024-04-19T03:01:15.018276+0000","last_became_peered":"2024-04-19T03:01:15.018276+0000","last_unstale":"2024-04-19T03:05:19.240645+0000","last_undegraded":"2024-04-19T03:05:19.240645+0000","last_fullsized":"2024-04-19T03:05:19.240645+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":78,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:19.714252+0000","last_change":"2024-04-19T03:05:11.430020+0000","last_active":"2024-04-19T03:05:19.714252+0000","last_peered":"2024-04-19T03:05:19.714252+0000","last_clean":"2024-04-19T03:05:19.714252+0000","last_became_active":"2024-04-19T03:05:11.429214+0000","last_became_peered":"2024-04-19T03:05:11.429214+0000","last_unstale":"2024-04-19T03:05:19.714252+0000","last_undegraded":"2024-04-19T03:05:19.714252+0000","last_fullsized":"2024-04-19T03:05:19.714252+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"81'10","reported_seq":100,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:29.315169+0000","last_change":"2024-04-19T03:05:29.315169+0000","last_active":"2024-04-19T03:05:29.315169+0000","last_peered":"2024-04-19T03:05:29.315169+0000","last_clean":"2024-04-19T03:05:29.315169+0000","last_became_active":"2024-04-19T03:05:11.430906+0000","last_became_peered":"2024-04-19T03:05:11.430906+0000","last_unstale":"2024-04-19T03:05:29.315169+0000","last_undegraded":"2024-04-19T03:05:29.315169+0000","last_fullsized":"2024-04-19T03:05:29.315169+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'10","last_scrub_stamp":"2024-04-19T03:05:29.314872+0000","last_deep_scrub":"81'10","last_deep_scrub_stamp":"2024-04-19T03:05:29.314872+0000","last_clean_scrub_stamp":"2024-04-19T03:05:29.314872+0000","objects_scrubbed":4,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:09:13.123950+0000","scrub_duration":0.0096666670000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":41,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:51.052208+0000","last_change":"2024-04-19T03:05:51.052464+0000","last_active":"2024-04-19T03:05:51.052208+0000","last_peered":"2024-04-19T03:05:51.052208+0000","last_clean":"2024-04-19T03:05:51.052208+0000","last_became_active":"2024-04-19T03:04:50.627654+0000","last_became_peered":"2024-04-19T03:04:50.627654+0000","last_unstale":"2024-04-19T03:05:51.052208+0000","last_undegraded":"2024-04-19T03:05:51.052208+0000","last_fullsized":"2024-04-19T03:05:51.052208+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:05:51.052162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:05:51.052162+0000","last_clean_scrub_stamp":"2024-04-19T03:05:51.052162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:45:11.062907+0000","scrub_duration":0.0030909259999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"20'3","reported_seq":55,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:12.421900+0000","last_change":"2024-04-19T03:05:09.398110+0000","last_active":"2024-04-19T03:05:12.421900+0000","last_peered":"2024-04-19T03:05:12.421900+0000","last_clean":"2024-04-19T03:05:12.421900+0000","last_became_active":"2024-04-19T03:05:09.397555+0000","last_became_peered":"2024-04-19T03:05:09.397555+0000","last_unstale":"2024-04-19T03:05:12.421900+0000","last_undegraded":"2024-04-19T03:05:12.421900+0000","last_fullsized":"2024-04-19T03:05:12.421900+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":83,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:30.280877+0000","last_change":"2024-04-19T03:05:30.281124+0000","last_active":"2024-04-19T03:05:30.280877+0000","last_peered":"2024-04-19T03:05:30.280877+0000","last_clean":"2024-04-19T03:05:30.280877+0000","last_became_active":"2024-04-19T03:05:11.428904+0000","last_became_peered":"2024-04-19T03:05:11.428904+0000","last_unstale":"2024-04-19T03:05:30.280877+0000","last_undegraded":"2024-04-19T03:05:30.280877+0000","last_fullsized":"2024-04-19T03:05:30.280877+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:05:30.280817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:05:30.280817+0000","last_clean_scrub_stamp":"2024-04-19T03:05:30.280817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:49:02.715913+0000","scrub_duration":0.0034631390000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:12.769162+0000","last_change":"2024-04-19T03:04:50.634026+0000","last_active":"2024-04-19T03:05:12.769162+0000","last_peered":"2024-04-19T03:05:12.769162+0000","last_clean":"2024-04-19T03:05:12.769162+0000","last_became_active":"2024-04-19T03:04:50.630873+0000","last_became_peered":"2024-04-19T03:04:50.630873+0000","last_unstale":"2024-04-19T03:05:12.769162+0000","last_undegraded":"2024-04-19T03:05:12.769162+0000","last_fullsized":"2024-04-19T03:05:12.769162+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":42,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:25.154192+0000","last_change":"2024-04-19T03:05:25.154574+0000","last_active":"2024-04-19T03:05:25.154192+0000","last_peered":"2024-04-19T03:05:25.154192+0000","last_clean":"2024-04-19T03:05:25.154192+0000","last_became_active":"2024-04-19T03:04:50.612005+0000","last_became_peered":"2024-04-19T03:04:50.612005+0000","last_unstale":"2024-04-19T03:05:25.154192+0000","last_undegraded":"2024-04-19T03:05:25.154192+0000","last_fullsized":"2024-04-19T03:05:25.154192+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:05:25.154094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:05:25.154094+0000","last_clean_scrub_stamp":"2024-04-19T03:05:25.154094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:35:43.914350+0000","scrub_duration":0.0032290930000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":41,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:36.159462+0000","last_change":"2024-04-19T03:05:36.159687+0000","last_active":"2024-04-19T03:05:36.159462+0000","last_peered":"2024-04-19T03:05:36.159462+0000","last_clean":"2024-04-19T03:05:36.159462+0000","last_became_active":"2024-04-19T03:04:50.613735+0000","last_became_peered":"2024-04-19T03:04:50.613735+0000","last_unstale":"2024-04-19T03:05:36.159462+0000","last_undegraded":"2024-04-19T03:05:36.159462+0000","last_fullsized":"2024-04-19T03:05:36.159462+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:05:36.159417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:05:36.159417+0000","last_clean_scrub_stamp":"2024-04-19T03:05:36.159417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:03:12.881177+0000","scrub_duration":0.0033805229999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":62,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:51.504587+0000","last_change":"2024-04-19T03:05:51.504706+0000","last_active":"2024-04-19T03:05:51.504587+0000","last_peered":"2024-04-19T03:05:51.504587+0000","last_clean":"2024-04-19T03:05:51.504587+0000","last_became_active":"2024-04-19T03:05:09.392982+0000","last_became_peered":"2024-04-19T03:05:09.392982+0000","last_unstale":"2024-04-19T03:05:51.504587+0000","last_undegraded":"2024-04-19T03:05:51.504587+0000","last_fullsized":"2024-04-19T03:05:51.504587+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:05:51.504568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:05:51.504568+0000","last_clean_scrub_stamp":"2024-04-19T03:05:51.504568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:09:35.313645+0000","scrub_duration":0.075784133000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":31,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:12.767702+0000","last_change":"2024-04-19T03:04:50.616430+0000","last_active":"2024-04-19T03:05:12.767702+0000","last_peered":"2024-04-19T03:05:12.767702+0000","last_clean":"2024-04-19T03:05:12.767702+0000","last_became_active":"2024-04-19T03:04:50.613523+0000","last_became_peered":"2024-04-19T03:04:50.613523+0000","last_unstale":"2024-04-19T03:05:12.767702+0000","last_undegraded":"2024-04-19T03:05:12.767702+0000","last_fullsized":"2024-04-19T03:05:12.767702+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:12.769377+0000","last_change":"2024-04-19T03:04:50.616829+0000","last_active":"2024-04-19T03:05:12.769377+0000","last_peered":"2024-04-19T03:05:12.769377+0000","last_clean":"2024-04-19T03:05:12.769377+0000","last_became_active":"2024-04-19T03:04:50.616545+0000","last_became_peered":"2024-04-19T03:04:50.616545+0000","last_unstale":"2024-04-19T03:05:12.769377+0000","last_undegraded":"2024-04-19T03:05:12.769377+0000","last_fullsized":"2024-04-19T03:05:12.769377+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":31,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:12.767980+0000","last_change":"2024-04-19T03:04:50.634214+0000","last_active":"2024-04-19T03:05:12.767980+0000","last_peered":"2024-04-19T03:05:12.767980+0000","last_clean":"2024-04-19T03:05:12.767980+0000","last_became_active":"2024-04-19T03:04:50.631699+0000","last_became_peered":"2024-04-19T03:04:50.631699+0000","last_unstale":"2024-04-19T03:05:12.767980+0000","last_undegraded":"2024-04-19T03:05:12.767980+0000","last_fullsized":"2024-04-19T03:05:12.767980+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":54,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:12.421501+0000","last_change":"2024-04-19T03:05:02.361377+0000","last_active":"2024-04-19T03:05:12.421501+0000","last_peered":"2024-04-19T03:05:12.421501+0000","last_clean":"2024-04-19T03:05:12.421501+0000","last_became_active":"2024-04-19T03:05:02.360924+0000","last_became_peered":"2024-04-19T03:05:02.360924+0000","last_unstale":"2024-04-19T03:05:12.421501+0000","last_undegraded":"2024-04-19T03:05:12.421501+0000","last_fullsized":"2024-04-19T03:05:12.421501+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"20'1","reported_seq":91,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:27.386975+0000","last_change":"2024-04-19T03:05:27.387324+0000","last_active":"2024-04-19T03:05:27.386975+0000","last_peered":"2024-04-19T03:05:27.386975+0000","last_clean":"2024-04-19T03:05:27.386975+0000","last_became_active":"2024-04-19T03:05:09.395508+0000","last_became_peered":"2024-04-19T03:05:09.395508+0000","last_unstale":"2024-04-19T03:05:27.386975+0000","last_undegraded":"2024-04-19T03:05:27.386975+0000","last_fullsized":"2024-04-19T03:05:27.386975+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"20'1","last_scrub_stamp":"2024-04-19T03:05:27.386920+0000","last_deep_scrub":"20'1","last_deep_scrub_stamp":"2024-04-19T03:05:27.386920+0000","last_clean_scrub_stamp":"2024-04-19T03:05:27.386920+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:30:55.863683+0000","scrub_duration":0.0033146569999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":78,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:12.421171+0000","last_change":"2024-04-19T03:05:09.396327+0000","last_active":"2024-04-19T03:05:12.421171+0000","last_peered":"2024-04-19T03:05:12.421171+0000","last_clean":"2024-04-19T03:05:12.421171+0000","last_became_active":"2024-04-19T03:05:09.395753+0000","last_became_peered":"2024-04-19T03:05:09.395753+0000","last_unstale":"2024-04-19T03:05:12.421171+0000","last_undegraded":"2024-04-19T03:05:12.421171+0000","last_fullsized":"2024-04-19T03:05:12.421171+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"20'1","reported_seq":99,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:40.414816+0000","last_change":"2024-04-19T03:05:40.415059+0000","last_active":"2024-04-19T03:05:40.414816+0000","last_peered":"2024-04-19T03:05:40.414816+0000","last_clean":"2024-04-19T03:05:40.414816+0000","last_became_active":"2024-04-19T03:05:09.397183+0000","last_became_peered":"2024-04-19T03:05:09.397183+0000","last_unstale":"2024-04-19T03:05:40.414816+0000","last_undegraded":"2024-04-19T03:05:40.414816+0000","last_fullsized":"2024-04-19T03:05:40.414816+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"20'1","last_scrub_stamp":"2024-04-19T03:05:40.414768+0000","last_deep_scrub":"20'1","last_deep_scrub_stamp":"2024-04-19T03:05:40.414768+0000","last_clean_scrub_stamp":"2024-04-19T03:05:40.414768+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:13:49.641736+0000","scrub_duration":0.0037583510000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":98,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:42.226067+0000","last_change":"2024-04-19T03:05:42.226248+0000","last_active":"2024-04-19T03:05:42.226067+0000","last_peered":"2024-04-19T03:05:42.226067+0000","last_clean":"2024-04-19T03:05:42.226067+0000","last_became_active":"2024-04-19T03:05:11.429247+0000","last_became_peered":"2024-04-19T03:05:11.429247+0000","last_unstale":"2024-04-19T03:05:42.226067+0000","last_undegraded":"2024-04-19T03:05:42.226067+0000","last_fullsized":"2024-04-19T03:05:42.226067+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:05:42.226018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:05:42.226018+0000","last_clean_scrub_stamp":"2024-04-19T03:05:42.226018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:33:09.655667+0000","scrub_duration":0.049267652000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"20'2","reported_seq":88,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:12.904614+0000","last_change":"2024-04-19T03:04:50.276105+0000","last_active":"2024-04-19T03:05:12.904614+0000","last_peered":"2024-04-19T03:05:12.904614+0000","last_clean":"2024-04-19T03:05:12.904614+0000","last_became_active":"2024-04-19T03:04:50.275533+0000","last_became_peered":"2024-04-19T03:04:50.275533+0000","last_unstale":"2024-04-19T03:05:12.904614+0000","last_undegraded":"2024-04-19T03:05:12.904614+0000","last_fullsized":"2024-04-19T03:05:12.904614+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":85,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:12.904153+0000","last_change":"2024-04-19T03:04:50.278401+0000","last_active":"2024-04-19T03:05:12.904153+0000","last_peered":"2024-04-19T03:05:12.904153+0000","last_clean":"2024-04-19T03:05:12.904153+0000","last_became_active":"2024-04-19T03:04:50.277348+0000","last_became_peered":"2024-04-19T03:04:50.277348+0000","last_unstale":"2024-04-19T03:05:12.904153+0000","last_undegraded":"2024-04-19T03:05:12.904153+0000","last_fullsized":"2024-04-19T03:05:12.904153+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"81'3","reported_seq":69,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:52.394857+0000","last_change":"2024-04-19T03:05:52.395104+0000","last_active":"2024-04-19T03:05:52.394857+0000","last_peered":"2024-04-19T03:05:52.394857+0000","last_clean":"2024-04-19T03:05:52.394857+0000","last_became_active":"2024-04-19T03:05:02.363167+0000","last_became_peered":"2024-04-19T03:05:02.363167+0000","last_unstale":"2024-04-19T03:05:52.394857+0000","last_undegraded":"2024-04-19T03:05:52.394857+0000","last_fullsized":"2024-04-19T03:05:52.394857+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'3","last_scrub_stamp":"2024-04-19T03:05:52.394809+0000","last_deep_scrub":"81'3","last_deep_scrub_stamp":"2024-04-19T03:05:52.394809+0000","last_clean_scrub_stamp":"2024-04-19T03:05:52.394809+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:49:24.829905+0000","scrub_duration":0.0064588550000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":89,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:22.325309+0000","last_change":"2024-04-19T03:05:22.325552+0000","last_active":"2024-04-19T03:05:22.325309+0000","last_peered":"2024-04-19T03:05:22.325309+0000","last_clean":"2024-04-19T03:05:22.325309+0000","last_became_active":"2024-04-19T03:05:09.393975+0000","last_became_peered":"2024-04-19T03:05:09.393975+0000","last_unstale":"2024-04-19T03:05:22.325309+0000","last_undegraded":"2024-04-19T03:05:22.325309+0000","last_fullsized":"2024-04-19T03:05:22.325309+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:05:22.325265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:05:22.325265+0000","last_clean_scrub_stamp":"2024-04-19T03:05:22.325265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:46:17.944097+0000","scrub_duration":0.022749259000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"20'1","reported_seq":33,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:12.769806+0000","last_change":"2024-04-19T03:04:50.627670+0000","last_active":"2024-04-19T03:05:12.769806+0000","last_peered":"2024-04-19T03:05:12.769806+0000","last_clean":"2024-04-19T03:05:12.769806+0000","last_became_active":"2024-04-19T03:04:50.627304+0000","last_became_peered":"2024-04-19T03:04:50.627304+0000","last_unstale":"2024-04-19T03:05:12.769806+0000","last_undegraded":"2024-04-19T03:05:12.769806+0000","last_fullsized":"2024-04-19T03:05:12.769806+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":85,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:12.903346+0000","last_change":"2024-04-19T03:04:50.279334+0000","last_active":"2024-04-19T03:05:12.903346+0000","last_peered":"2024-04-19T03:05:12.903346+0000","last_clean":"2024-04-19T03:05:12.903346+0000","last_became_active":"2024-04-19T03:04:50.278874+0000","last_became_peered":"2024-04-19T03:04:50.278874+0000","last_unstale":"2024-04-19T03:05:12.903346+0000","last_undegraded":"2024-04-19T03:05:12.903346+0000","last_fullsized":"2024-04-19T03:05:12.903346+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"81'6","reported_seq":46,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:54.008711+0000","last_change":"2024-04-19T03:05:54.009000+0000","last_active":"2024-04-19T03:05:54.008711+0000","last_peered":"2024-04-19T03:05:54.008711+0000","last_clean":"2024-04-19T03:05:54.008711+0000","last_became_active":"2024-04-19T03:04:50.626334+0000","last_became_peered":"2024-04-19T03:04:50.626334+0000","last_unstale":"2024-04-19T03:05:54.008711+0000","last_undegraded":"2024-04-19T03:05:54.008711+0000","last_fullsized":"2024-04-19T03:05:54.008711+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'6","last_scrub_stamp":"2024-04-19T03:05:54.008658+0000","last_deep_scrub":"81'6","last_deep_scrub_stamp":"2024-04-19T03:05:54.008658+0000","last_clean_scrub_stamp":"2024-04-19T03:05:54.008658+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:39:11.277372+0000","scrub_duration":0.0079365890000000008,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5289,"internal_metadata":0},"log_size":48,"ondisk_log_size":48,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":14482,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":10,"seq":42949673025,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":224804,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":223870,"kb_avail":94147036,"statfs":{"total":96636764160,"available":96406564864,"internally_reserved":0,"allocated":946176,"data_stored":929795,"data_compressed":7241,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":229243334},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 19 03:05:49 2024","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.624}]},{"osd":1,"last update":"Fri Apr 19 03:05:16 2024","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.56699999999999995,"15min":0.55500000000000005},"min":{"1min":0.53600000000000003,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.76900000000000002,"5min":2.5030000000000001,"15min":2.5030000000000001},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.628,"5min":0.58399999999999996,"15min":0.56699999999999995},"min":{"1min":0.54700000000000004,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.74199999999999999,"5min":2.6379999999999999,"15min":2.6379999999999999},"last":0.72199999999999998}]}]},{"osd":1,"up_from":10,"seq":42949673024,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":202656,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":201726,"kb_avail":94169184,"statfs":{"total":96636764160,"available":96429244416,"internally_reserved":0,"allocated":942080,"data_stored":931342,"data_compressed":7241,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":206567878},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 19 03:05:50 2024","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.61199999999999999}]},{"osd":2,"last update":"Fri Apr 19 03:05:08 2024","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.501,"15min":0.50800000000000001},"min":{"1min":0.46999999999999997,"5min":0.224,"15min":0.224},"max":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.50700000000000001,"15min":0.52100000000000002},"min":{"1min":0.52100000000000002,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.65700000000000003}]}]},{"osd":0,"up_from":71,"seq":304942678032,"num_pgs":73,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47704,"kb_used_data":848,"kb_used_omap":6,"kb_used_meta":46841,"kb_avail":94324136,"statfs":{"total":96636764160,"available":96587915264,"internally_reserved":0,"allocated":868352,"data_stored":339844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6883,"internal_metadata":47965469},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Apr 19 03:05:51 2024","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.67200000000000004}]},{"osd":2,"last update":"Fri Apr 19 03:05:51 2024","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.59399999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":7241,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":7241,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5289,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-19T03:06:00.758 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-04-19T03:01:14.615919+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=14, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:06:00.758 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-04-19T03:01:14.615919+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=14, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:06:00.758 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-04-19T03:01:14.615919+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=14, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:06:00.758 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-04-19T03:01:14.615919+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=14, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:06:00.759 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-04-19T03:01:14.615919+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=14, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:06:00.759 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-04-19T03:01:14.615919+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=14, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:06:00.759 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-04-19T03:01:14.615919+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=14, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:06:00.759 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-04-19T03:01:14.615919+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=14, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:06:00.760 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-04-19T03:01:14.615919+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=14, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:06:00.760 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-04-19T03:01:14.615919+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=14, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:06:00.760 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-04-19T03:01:14.615919+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=14, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:06:00.760 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-04-19T03:01:14.615919+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=14, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:06:00.760 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-04-19T03:01:14.615919+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=14, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:06:00.761 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-04-19T03:01:14.615919+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=14, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:06:00.761 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-04-19T03:01:14.615919+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=14, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:06:00.761 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-04-19T03:01:14.615919+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=14, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:06:00.761 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-04-19T03:01:14.615919+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=14, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:06:00.761 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-04-19T03:01:14.615919+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=14, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:06:00.762 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-04-19T03:01:13.604133+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=13, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:06:00.762 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-04-19T03:01:14.615919+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=14, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:06:00.762 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-04-19T03:01:13.604133+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=13, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:06:00.762 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-04-19T03:01:13.604133+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=13, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:06:00.762 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-04-19T03:01:14.615919+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=14, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:06:00.762 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-04-19T03:01:13.604133+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=13, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:06:00.763 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-04-19T03:01:13.604133+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=13, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:06:00.763 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-04-19T03:01:14.615919+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=14, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:06:00.763 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-04-19T03:01:13.604133+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=13, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:06:00.763 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-04-19T03:01:14.615919+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=14, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:06:00.763 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-04-19T03:01:13.604133+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=13, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:06:00.764 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-04-19T03:01:14.615919+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=14, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:06:00.764 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-04-19T03:01:13.604133+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=13, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:06:00.764 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-04-19T03:01:14.615919+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=14, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:06:00.764 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-04-19T03:01:13.604133+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=13, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:06:00.764 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-04-19T03:01:14.615919+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=14, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:06:00.764 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-04-19T03:01:13.604133+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=13, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:06:00.765 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-04-19T03:01:14.615919+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=14, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:06:00.765 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-04-19T03:01:06.516863+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=6, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:06:00.765 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-04-19T03:01:09.578660+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=9, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:06:00.765 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-04-19T03:01:13.604133+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=13, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:06:00.765 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-04-19T03:01:09.578660+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=9, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:06:00.765 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-04-19T03:01:13.604133+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=13, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:06:00.765 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-04-19T03:01:13.604133+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=13, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:06:00.765 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-04-19T03:01:09.578660+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=9, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:06:00.766 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-04-19T03:01:13.604133+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=13, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:06:00.766 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-04-19T03:01:14.615919+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=14, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:06:00.766 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-04-19T03:01:14.615919+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=14, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:06:00.766 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-04-19T03:01:09.578660+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=9, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:06:00.766 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-04-19T03:01:14.615919+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=14, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:06:00.766 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-04-19T03:01:09.578660+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=9, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:06:00.766 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-04-19T03:01:09.578660+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=9, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:06:00.766 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-04-19T03:01:14.615919+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=14, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:06:00.767 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-04-19T03:01:14.615919+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=14, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:06:00.767 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-04-19T03:01:13.604133+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=13, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:06:00.767 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-04-19T03:01:14.615919+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=14, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:06:00.767 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-04-19T03:01:13.604133+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=13, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:06:00.767 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-04-19T03:01:14.615919+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=14, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:06:00.767 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-04-19T03:01:13.604133+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=13, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:06:00.767 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-04-19T03:01:14.615919+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=14, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:06:00.767 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-04-19T03:01:14.615919+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=14, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:06:00.768 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-04-19T03:01:13.604133+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=13, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:06:00.768 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-04-19T03:01:14.615919+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=14, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:06:00.768 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-04-19T03:01:13.604133+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=13, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:06:00.768 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-04-19T03:01:14.615919+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=14, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:06:00.768 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-19T03:06:20.769 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-19T03:06:21.087 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-19T03:06:21.089 INFO:teuthology.orchestra.run.smithi096.stderr:dumped all 2024-04-19T03:06:21.099 INFO:teuthology.orchestra.run.smithi096.stdout:{"pg_ready":true,"pg_map":{"version":235,"stamp":"2024-04-19T03:06:20.074788+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":205,"ondisk_log_size":205,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":475164,"kb_used_data":2692,"kb_used_omap":9,"kb_used_meta":472438,"kb_avail":282640356,"statfs":{"total":289910292480,"available":289423724544,"internally_reserved":0,"allocated":2756608,"data_stored":2200981,"data_compressed":14482,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":10071,"internal_metadata":483776681},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004349"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":79,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:19.241382+0000","last_change":"2024-04-19T03:05:09.396661+0000","last_active":"2024-04-19T03:05:19.241382+0000","last_peered":"2024-04-19T03:05:19.241382+0000","last_clean":"2024-04-19T03:05:19.241382+0000","last_became_active":"2024-04-19T03:05:09.396279+0000","last_became_peered":"2024-04-19T03:05:09.396279+0000","last_unstale":"2024-04-19T03:05:19.241382+0000","last_undegraded":"2024-04-19T03:05:19.241382+0000","last_fullsized":"2024-04-19T03:05:19.241382+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":86,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:19.241391+0000","last_change":"2024-04-19T03:04:50.278334+0000","last_active":"2024-04-19T03:05:19.241391+0000","last_peered":"2024-04-19T03:05:19.241391+0000","last_clean":"2024-04-19T03:05:19.241391+0000","last_became_active":"2024-04-19T03:04:50.277848+0000","last_became_peered":"2024-04-19T03:04:50.277848+0000","last_unstale":"2024-04-19T03:05:19.241391+0000","last_undegraded":"2024-04-19T03:05:19.241391+0000","last_fullsized":"2024-04-19T03:05:19.241391+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":84,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:06:04.985436+0000","last_change":"2024-04-19T03:06:04.985743+0000","last_active":"2024-04-19T03:06:04.985436+0000","last_peered":"2024-04-19T03:06:04.985436+0000","last_clean":"2024-04-19T03:06:04.985436+0000","last_became_active":"2024-04-19T03:01:15.014599+0000","last_became_peered":"2024-04-19T03:01:15.014599+0000","last_unstale":"2024-04-19T03:06:04.985436+0000","last_undegraded":"2024-04-19T03:06:04.985436+0000","last_fullsized":"2024-04-19T03:06:04.985436+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:06:04.985390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:06:04.985390+0000","last_clean_scrub_stamp":"2024-04-19T03:06:04.985390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:34:15.507303+0000","scrub_duration":0.0034078440000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":97,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:49.097798+0000","last_change":"2024-04-19T03:05:49.098069+0000","last_active":"2024-04-19T03:05:49.097798+0000","last_peered":"2024-04-19T03:05:49.097798+0000","last_clean":"2024-04-19T03:05:49.097798+0000","last_became_active":"2024-04-19T03:04:50.274600+0000","last_became_peered":"2024-04-19T03:04:50.274600+0000","last_unstale":"2024-04-19T03:05:49.097798+0000","last_undegraded":"2024-04-19T03:05:49.097798+0000","last_fullsized":"2024-04-19T03:05:49.097798+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:05:49.097746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:05:49.097746+0000","last_clean_scrub_stamp":"2024-04-19T03:05:49.097746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:07:18.276599+0000","scrub_duration":0.0032259770000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":90,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:39.452420+0000","last_change":"2024-04-19T03:05:39.452420+0000","last_active":"2024-04-19T03:05:39.452420+0000","last_peered":"2024-04-19T03:05:39.452420+0000","last_clean":"2024-04-19T03:05:39.452420+0000","last_became_active":"2024-04-19T03:05:09.395929+0000","last_became_peered":"2024-04-19T03:05:09.395929+0000","last_unstale":"2024-04-19T03:05:39.452420+0000","last_undegraded":"2024-04-19T03:05:39.452420+0000","last_fullsized":"2024-04-19T03:05:39.452420+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:05:39.452007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:05:39.452007+0000","last_clean_scrub_stamp":"2024-04-19T03:05:39.452007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:45:27.478454+0000","scrub_duration":0.026485411,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":83,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:06:06.951780+0000","last_change":"2024-04-19T03:06:06.951780+0000","last_active":"2024-04-19T03:06:06.951780+0000","last_peered":"2024-04-19T03:06:06.951780+0000","last_clean":"2024-04-19T03:06:06.951780+0000","last_became_active":"2024-04-19T03:05:11.426617+0000","last_became_peered":"2024-04-19T03:05:11.426617+0000","last_unstale":"2024-04-19T03:06:06.951780+0000","last_undegraded":"2024-04-19T03:06:06.951780+0000","last_fullsized":"2024-04-19T03:06:06.951780+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:06:06.951457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:06:06.951457+0000","last_clean_scrub_stamp":"2024-04-19T03:06:06.951457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:57:21.385487+0000","scrub_duration":0.0032635160000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":72,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:19.714785+0000","last_change":"2024-04-19T03:05:11.424581+0000","last_active":"2024-04-19T03:05:19.714785+0000","last_peered":"2024-04-19T03:05:19.714785+0000","last_clean":"2024-04-19T03:05:19.714785+0000","last_became_active":"2024-04-19T03:05:11.422727+0000","last_became_peered":"2024-04-19T03:05:11.422727+0000","last_unstale":"2024-04-19T03:05:19.714785+0000","last_undegraded":"2024-04-19T03:05:19.714785+0000","last_fullsized":"2024-04-19T03:05:19.714785+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":97,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:54.075857+0000","last_change":"2024-04-19T03:05:54.075857+0000","last_active":"2024-04-19T03:05:54.075857+0000","last_peered":"2024-04-19T03:05:54.075857+0000","last_clean":"2024-04-19T03:05:54.075857+0000","last_became_active":"2024-04-19T03:04:50.261155+0000","last_became_peered":"2024-04-19T03:04:50.261155+0000","last_unstale":"2024-04-19T03:05:54.075857+0000","last_undegraded":"2024-04-19T03:05:54.075857+0000","last_fullsized":"2024-04-19T03:05:54.075857+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:05:54.075422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:05:54.075422+0000","last_clean_scrub_stamp":"2024-04-19T03:05:54.075422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:12:16.121405+0000","scrub_duration":0.0036127419999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":41,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:23.156874+0000","last_change":"2024-04-19T03:05:23.156992+0000","last_active":"2024-04-19T03:05:23.156874+0000","last_peered":"2024-04-19T03:05:23.156874+0000","last_clean":"2024-04-19T03:05:23.156874+0000","last_became_active":"2024-04-19T03:04:50.611400+0000","last_became_peered":"2024-04-19T03:04:50.611400+0000","last_unstale":"2024-04-19T03:05:23.156874+0000","last_undegraded":"2024-04-19T03:05:23.156874+0000","last_fullsized":"2024-04-19T03:05:23.156874+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:05:23.156852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:05:23.156852+0000","last_clean_scrub_stamp":"2024-04-19T03:05:23.156852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:00:45.201755+0000","scrub_duration":0.036684305,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":86,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:19.241317+0000","last_change":"2024-04-19T03:04:50.278337+0000","last_active":"2024-04-19T03:05:19.241317+0000","last_peered":"2024-04-19T03:05:19.241317+0000","last_clean":"2024-04-19T03:05:19.241317+0000","last_became_active":"2024-04-19T03:04:50.277899+0000","last_became_peered":"2024-04-19T03:04:50.277899+0000","last_unstale":"2024-04-19T03:05:19.241317+0000","last_undegraded":"2024-04-19T03:05:19.241317+0000","last_fullsized":"2024-04-19T03:05:19.241317+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":72,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:19.714661+0000","last_change":"2024-04-19T03:05:11.430574+0000","last_active":"2024-04-19T03:05:19.714661+0000","last_peered":"2024-04-19T03:05:19.714661+0000","last_clean":"2024-04-19T03:05:19.714661+0000","last_became_active":"2024-04-19T03:05:11.430243+0000","last_became_peered":"2024-04-19T03:05:11.430243+0000","last_unstale":"2024-04-19T03:05:19.714661+0000","last_undegraded":"2024-04-19T03:05:19.714661+0000","last_fullsized":"2024-04-19T03:05:19.714661+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":62,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:30.443577+0000","last_change":"2024-04-19T03:05:30.443804+0000","last_active":"2024-04-19T03:05:30.443577+0000","last_peered":"2024-04-19T03:05:30.443577+0000","last_clean":"2024-04-19T03:05:30.443577+0000","last_became_active":"2024-04-19T03:05:09.392822+0000","last_became_peered":"2024-04-19T03:05:09.392822+0000","last_unstale":"2024-04-19T03:05:30.443577+0000","last_undegraded":"2024-04-19T03:05:30.443577+0000","last_fullsized":"2024-04-19T03:05:30.443577+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:05:30.443531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:05:30.443531+0000","last_clean_scrub_stamp":"2024-04-19T03:05:30.443531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:43:21.406385+0000","scrub_duration":0.0030470290000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":79,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:19.241308+0000","last_change":"2024-04-19T03:05:09.397000+0000","last_active":"2024-04-19T03:05:19.241308+0000","last_peered":"2024-04-19T03:05:19.241308+0000","last_clean":"2024-04-19T03:05:19.241308+0000","last_became_active":"2024-04-19T03:05:09.395749+0000","last_became_peered":"2024-04-19T03:05:09.395749+0000","last_unstale":"2024-04-19T03:05:19.241308+0000","last_undegraded":"2024-04-19T03:05:19.241308+0000","last_fullsized":"2024-04-19T03:05:19.241308+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":84,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:50.122363+0000","last_change":"2024-04-19T03:05:50.122363+0000","last_active":"2024-04-19T03:05:50.122363+0000","last_peered":"2024-04-19T03:05:50.122363+0000","last_clean":"2024-04-19T03:05:50.122363+0000","last_became_active":"2024-04-19T03:01:15.010472+0000","last_became_peered":"2024-04-19T03:01:15.010472+0000","last_unstale":"2024-04-19T03:05:50.122363+0000","last_undegraded":"2024-04-19T03:05:50.122363+0000","last_fullsized":"2024-04-19T03:05:50.122363+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:05:50.122017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:05:50.122017+0000","last_clean_scrub_stamp":"2024-04-19T03:05:50.122017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:38:58.698089+0000","scrub_duration":0.0034044829999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":86,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:06:14.987825+0000","last_change":"2024-04-19T03:06:14.988052+0000","last_active":"2024-04-19T03:06:14.987825+0000","last_peered":"2024-04-19T03:06:14.987825+0000","last_clean":"2024-04-19T03:06:14.987825+0000","last_became_active":"2024-04-19T03:05:11.425921+0000","last_became_peered":"2024-04-19T03:05:11.425921+0000","last_unstale":"2024-04-19T03:06:14.987825+0000","last_undegraded":"2024-04-19T03:06:14.987825+0000","last_fullsized":"2024-04-19T03:06:14.987825+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:06:14.987781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:06:14.987781+0000","last_clean_scrub_stamp":"2024-04-19T03:06:14.987781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:38:20.700993+0000","scrub_duration":0.0031418100000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":83,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:39.150013+0000","last_change":"2024-04-19T03:05:39.150013+0000","last_active":"2024-04-19T03:05:39.150013+0000","last_peered":"2024-04-19T03:05:39.150013+0000","last_clean":"2024-04-19T03:05:39.150013+0000","last_became_active":"2024-04-19T03:05:11.425921+0000","last_became_peered":"2024-04-19T03:05:11.425921+0000","last_unstale":"2024-04-19T03:05:39.150013+0000","last_undegraded":"2024-04-19T03:05:39.150013+0000","last_fullsized":"2024-04-19T03:05:39.150013+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:05:39.149625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:05:39.149625+0000","last_clean_scrub_stamp":"2024-04-19T03:05:39.149625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:18:40.192906+0000","scrub_duration":0.0038324209999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":41,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:49.126663+0000","last_change":"2024-04-19T03:05:49.126778+0000","last_active":"2024-04-19T03:05:49.126663+0000","last_peered":"2024-04-19T03:05:49.126663+0000","last_clean":"2024-04-19T03:05:49.126663+0000","last_became_active":"2024-04-19T03:04:50.611392+0000","last_became_peered":"2024-04-19T03:04:50.611392+0000","last_unstale":"2024-04-19T03:05:49.126663+0000","last_undegraded":"2024-04-19T03:05:49.126663+0000","last_fullsized":"2024-04-19T03:05:49.126663+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:05:49.126640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:05:49.126640+0000","last_clean_scrub_stamp":"2024-04-19T03:05:49.126640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:45:17.738767+0000","scrub_duration":0.087429018999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":90,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:19.348906+0000","last_change":"2024-04-19T03:05:19.348906+0000","last_active":"2024-04-19T03:05:19.348906+0000","last_peered":"2024-04-19T03:05:19.348906+0000","last_clean":"2024-04-19T03:05:19.348906+0000","last_became_active":"2024-04-19T03:05:09.395682+0000","last_became_peered":"2024-04-19T03:05:09.395682+0000","last_unstale":"2024-04-19T03:05:19.348906+0000","last_undegraded":"2024-04-19T03:05:19.348906+0000","last_fullsized":"2024-04-19T03:05:19.348906+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:05:19.348599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:05:19.348599+0000","last_clean_scrub_stamp":"2024-04-19T03:05:19.348599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:22:58.194899+0000","scrub_duration":0.0032195190000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":41,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:06:00.979479+0000","last_change":"2024-04-19T03:06:00.979616+0000","last_active":"2024-04-19T03:06:00.979479+0000","last_peered":"2024-04-19T03:06:00.979479+0000","last_clean":"2024-04-19T03:06:00.979479+0000","last_became_active":"2024-04-19T03:04:50.613481+0000","last_became_peered":"2024-04-19T03:04:50.613481+0000","last_unstale":"2024-04-19T03:06:00.979479+0000","last_undegraded":"2024-04-19T03:06:00.979479+0000","last_fullsized":"2024-04-19T03:06:00.979479+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:06:00.979457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:06:00.979457+0000","last_clean_scrub_stamp":"2024-04-19T03:06:00.979457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:40:54.944550+0000","scrub_duration":0.035927225,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":88,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:19.714585+0000","last_change":"2024-04-19T03:05:11.431719+0000","last_active":"2024-04-19T03:05:19.714585+0000","last_peered":"2024-04-19T03:05:19.714585+0000","last_clean":"2024-04-19T03:05:19.714585+0000","last_became_active":"2024-04-19T03:05:11.431352+0000","last_became_peered":"2024-04-19T03:05:11.431352+0000","last_unstale":"2024-04-19T03:05:19.714585+0000","last_undegraded":"2024-04-19T03:05:19.714585+0000","last_fullsized":"2024-04-19T03:05:19.714585+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":97,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:06:13.000039+0000","last_change":"2024-04-19T03:06:13.000335+0000","last_active":"2024-04-19T03:06:13.000039+0000","last_peered":"2024-04-19T03:06:13.000039+0000","last_clean":"2024-04-19T03:06:13.000039+0000","last_became_active":"2024-04-19T03:04:50.275510+0000","last_became_peered":"2024-04-19T03:04:50.275510+0000","last_unstale":"2024-04-19T03:06:13.000039+0000","last_undegraded":"2024-04-19T03:06:13.000039+0000","last_fullsized":"2024-04-19T03:06:13.000039+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:06:12.999972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:06:12.999972+0000","last_clean_scrub_stamp":"2024-04-19T03:06:12.999972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:22:40.705332+0000","scrub_duration":0.036220484999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":73,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:19.241193+0000","last_change":"2024-04-19T03:01:15.020108+0000","last_active":"2024-04-19T03:05:19.241193+0000","last_peered":"2024-04-19T03:05:19.241193+0000","last_clean":"2024-04-19T03:05:19.241193+0000","last_became_active":"2024-04-19T03:01:15.018978+0000","last_became_peered":"2024-04-19T03:01:15.018978+0000","last_unstale":"2024-04-19T03:05:19.241193+0000","last_undegraded":"2024-04-19T03:05:19.241193+0000","last_fullsized":"2024-04-19T03:05:19.241193+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":41,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:27.084506+0000","last_change":"2024-04-19T03:05:27.084833+0000","last_active":"2024-04-19T03:05:27.084506+0000","last_peered":"2024-04-19T03:05:27.084506+0000","last_clean":"2024-04-19T03:05:27.084506+0000","last_became_active":"2024-04-19T03:04:50.630948+0000","last_became_peered":"2024-04-19T03:04:50.630948+0000","last_unstale":"2024-04-19T03:05:27.084506+0000","last_undegraded":"2024-04-19T03:05:27.084506+0000","last_fullsized":"2024-04-19T03:05:27.084506+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:05:27.084457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:05:27.084457+0000","last_clean_scrub_stamp":"2024-04-19T03:05:27.084457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:43:47.014628+0000","scrub_duration":0.0031579899999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":79,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:19.241161+0000","last_change":"2024-04-19T03:05:09.391159+0000","last_active":"2024-04-19T03:05:19.241161+0000","last_peered":"2024-04-19T03:05:19.241161+0000","last_clean":"2024-04-19T03:05:19.241161+0000","last_became_active":"2024-04-19T03:05:09.390922+0000","last_became_peered":"2024-04-19T03:05:09.390922+0000","last_unstale":"2024-04-19T03:05:19.241161+0000","last_undegraded":"2024-04-19T03:05:19.241161+0000","last_fullsized":"2024-04-19T03:05:19.241161+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":62,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:21.387816+0000","last_change":"2024-04-19T03:05:21.387930+0000","last_active":"2024-04-19T03:05:21.387816+0000","last_peered":"2024-04-19T03:05:21.387816+0000","last_clean":"2024-04-19T03:05:21.387816+0000","last_became_active":"2024-04-19T03:05:09.393108+0000","last_became_peered":"2024-04-19T03:05:09.393108+0000","last_unstale":"2024-04-19T03:05:21.387816+0000","last_undegraded":"2024-04-19T03:05:21.387816+0000","last_fullsized":"2024-04-19T03:05:21.387816+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:05:21.387796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:05:21.387796+0000","last_clean_scrub_stamp":"2024-04-19T03:05:21.387796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:19:53.306617+0000","scrub_duration":0.042477411999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:12.769547+0000","last_change":"2024-04-19T03:04:50.626923+0000","last_active":"2024-04-19T03:05:12.769547+0000","last_peered":"2024-04-19T03:05:12.769547+0000","last_clean":"2024-04-19T03:05:12.769547+0000","last_became_active":"2024-04-19T03:04:50.617603+0000","last_became_peered":"2024-04-19T03:04:50.617603+0000","last_unstale":"2024-04-19T03:05:12.769547+0000","last_undegraded":"2024-04-19T03:05:12.769547+0000","last_fullsized":"2024-04-19T03:05:12.769547+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":39,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:13.201146+0000","last_change":"2024-04-19T03:05:11.431713+0000","last_active":"2024-04-19T03:05:13.201146+0000","last_peered":"2024-04-19T03:05:13.201146+0000","last_clean":"2024-04-19T03:05:13.201146+0000","last_became_active":"2024-04-19T03:05:11.431129+0000","last_became_peered":"2024-04-19T03:05:11.431129+0000","last_unstale":"2024-04-19T03:05:13.201146+0000","last_undegraded":"2024-04-19T03:05:13.201146+0000","last_fullsized":"2024-04-19T03:05:13.201146+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":73,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:19.241426+0000","last_change":"2024-04-19T03:01:15.020098+0000","last_active":"2024-04-19T03:05:19.241426+0000","last_peered":"2024-04-19T03:05:19.241426+0000","last_clean":"2024-04-19T03:05:19.241426+0000","last_became_active":"2024-04-19T03:01:15.019064+0000","last_became_peered":"2024-04-19T03:01:15.019064+0000","last_unstale":"2024-04-19T03:05:19.241426+0000","last_undegraded":"2024-04-19T03:05:19.241426+0000","last_fullsized":"2024-04-19T03:05:19.241426+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":41,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:06:07.960609+0000","last_change":"2024-04-19T03:06:07.960749+0000","last_active":"2024-04-19T03:06:07.960609+0000","last_peered":"2024-04-19T03:06:07.960609+0000","last_clean":"2024-04-19T03:06:07.960609+0000","last_became_active":"2024-04-19T03:04:50.616550+0000","last_became_peered":"2024-04-19T03:04:50.616550+0000","last_unstale":"2024-04-19T03:06:07.960609+0000","last_undegraded":"2024-04-19T03:06:07.960609+0000","last_fullsized":"2024-04-19T03:06:07.960609+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:06:07.960587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:06:07.960587+0000","last_clean_scrub_stamp":"2024-04-19T03:06:07.960587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:55:45.489295+0000","scrub_duration":0.038393915000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":62,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:41.381935+0000","last_change":"2024-04-19T03:05:41.382171+0000","last_active":"2024-04-19T03:05:41.381935+0000","last_peered":"2024-04-19T03:05:41.381935+0000","last_clean":"2024-04-19T03:05:41.381935+0000","last_became_active":"2024-04-19T03:05:09.393178+0000","last_became_peered":"2024-04-19T03:05:09.393178+0000","last_unstale":"2024-04-19T03:05:41.381935+0000","last_undegraded":"2024-04-19T03:05:41.381935+0000","last_fullsized":"2024-04-19T03:05:41.381935+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:05:41.381892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:05:41.381892+0000","last_clean_scrub_stamp":"2024-04-19T03:05:41.381892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:26:44.553697+0000","scrub_duration":0.0032496449999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":41,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:40.160084+0000","last_change":"2024-04-19T03:05:40.160372+0000","last_active":"2024-04-19T03:05:40.160084+0000","last_peered":"2024-04-19T03:05:40.160084+0000","last_clean":"2024-04-19T03:05:40.160084+0000","last_became_active":"2024-04-19T03:04:50.633033+0000","last_became_peered":"2024-04-19T03:04:50.633033+0000","last_unstale":"2024-04-19T03:05:40.160084+0000","last_undegraded":"2024-04-19T03:05:40.160084+0000","last_fullsized":"2024-04-19T03:05:40.160084+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:05:40.160035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:05:40.160035+0000","last_clean_scrub_stamp":"2024-04-19T03:05:40.160035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:22:24.075162+0000","scrub_duration":0.0035144400000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":97,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:45.098945+0000","last_change":"2024-04-19T03:05:45.099168+0000","last_active":"2024-04-19T03:05:45.098945+0000","last_peered":"2024-04-19T03:05:45.098945+0000","last_clean":"2024-04-19T03:05:45.098945+0000","last_became_active":"2024-04-19T03:04:50.278996+0000","last_became_peered":"2024-04-19T03:04:50.278996+0000","last_unstale":"2024-04-19T03:05:45.098945+0000","last_undegraded":"2024-04-19T03:05:45.098945+0000","last_fullsized":"2024-04-19T03:05:45.098945+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:05:45.098897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:05:45.098897+0000","last_clean_scrub_stamp":"2024-04-19T03:05:45.098897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:59:51.710788+0000","scrub_duration":0.0034812490000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":90,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:34.468578+0000","last_change":"2024-04-19T03:05:34.468578+0000","last_active":"2024-04-19T03:05:34.468578+0000","last_peered":"2024-04-19T03:05:34.468578+0000","last_clean":"2024-04-19T03:05:34.468578+0000","last_became_active":"2024-04-19T03:05:09.395920+0000","last_became_peered":"2024-04-19T03:05:09.395920+0000","last_unstale":"2024-04-19T03:05:34.468578+0000","last_undegraded":"2024-04-19T03:05:34.468578+0000","last_fullsized":"2024-04-19T03:05:34.468578+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:05:34.468305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:05:34.468305+0000","last_clean_scrub_stamp":"2024-04-19T03:05:34.468305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:54:24.688379+0000","scrub_duration":0.003618422,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"20'2","reported_seq":89,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:19.713827+0000","last_change":"2024-04-19T03:04:50.277421+0000","last_active":"2024-04-19T03:05:19.713827+0000","last_peered":"2024-04-19T03:05:19.713827+0000","last_clean":"2024-04-19T03:05:19.713827+0000","last_became_active":"2024-04-19T03:04:50.276732+0000","last_became_peered":"2024-04-19T03:04:50.276732+0000","last_unstale":"2024-04-19T03:05:19.713827+0000","last_undegraded":"2024-04-19T03:05:19.713827+0000","last_fullsized":"2024-04-19T03:05:19.713827+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":79,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:19.240956+0000","last_change":"2024-04-19T03:05:09.395454+0000","last_active":"2024-04-19T03:05:19.240956+0000","last_peered":"2024-04-19T03:05:19.240956+0000","last_clean":"2024-04-19T03:05:19.240956+0000","last_became_active":"2024-04-19T03:05:09.394288+0000","last_became_peered":"2024-04-19T03:05:09.394288+0000","last_unstale":"2024-04-19T03:05:19.240956+0000","last_undegraded":"2024-04-19T03:05:19.240956+0000","last_fullsized":"2024-04-19T03:05:19.240956+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":31,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:12.768520+0000","last_change":"2024-04-19T03:04:50.628801+0000","last_active":"2024-04-19T03:05:12.768520+0000","last_peered":"2024-04-19T03:05:12.768520+0000","last_clean":"2024-04-19T03:05:12.768520+0000","last_became_active":"2024-04-19T03:04:50.628023+0000","last_became_peered":"2024-04-19T03:04:50.628023+0000","last_unstale":"2024-04-19T03:05:12.768520+0000","last_undegraded":"2024-04-19T03:05:12.768520+0000","last_fullsized":"2024-04-19T03:05:12.768520+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":41,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:22.156343+0000","last_change":"2024-04-19T03:05:22.156583+0000","last_active":"2024-04-19T03:05:22.156343+0000","last_peered":"2024-04-19T03:05:22.156343+0000","last_clean":"2024-04-19T03:05:22.156343+0000","last_became_active":"2024-04-19T03:04:50.613860+0000","last_became_peered":"2024-04-19T03:04:50.613860+0000","last_unstale":"2024-04-19T03:05:22.156343+0000","last_undegraded":"2024-04-19T03:05:22.156343+0000","last_fullsized":"2024-04-19T03:05:22.156343+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:05:22.156296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:05:22.156296+0000","last_clean_scrub_stamp":"2024-04-19T03:05:22.156296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:47:31.989944+0000","scrub_duration":0.0031789600000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":74,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:19.240488+0000","last_change":"2024-04-19T03:01:14.649074+0000","last_active":"2024-04-19T03:05:19.240488+0000","last_peered":"2024-04-19T03:05:19.240488+0000","last_clean":"2024-04-19T03:05:19.240488+0000","last_became_active":"2024-04-19T03:01:14.648217+0000","last_became_peered":"2024-04-19T03:01:14.648217+0000","last_unstale":"2024-04-19T03:05:19.240488+0000","last_undegraded":"2024-04-19T03:05:19.240488+0000","last_fullsized":"2024-04-19T03:05:19.240488+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":41,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:06:09.016060+0000","last_change":"2024-04-19T03:06:09.016173+0000","last_active":"2024-04-19T03:06:09.016060+0000","last_peered":"2024-04-19T03:06:09.016060+0000","last_clean":"2024-04-19T03:06:09.016060+0000","last_became_active":"2024-04-19T03:04:50.610659+0000","last_became_peered":"2024-04-19T03:04:50.610659+0000","last_unstale":"2024-04-19T03:06:09.016060+0000","last_undegraded":"2024-04-19T03:06:09.016060+0000","last_fullsized":"2024-04-19T03:06:09.016060+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:06:09.016037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:06:09.016037+0000","last_clean_scrub_stamp":"2024-04-19T03:06:09.016037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:53:27.685552+0000","scrub_duration":0.059919361999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"20'8","reported_seq":87,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:19.713849+0000","last_change":"2024-04-19T03:05:11.429829+0000","last_active":"2024-04-19T03:05:19.713849+0000","last_peered":"2024-04-19T03:05:19.713849+0000","last_clean":"2024-04-19T03:05:19.713849+0000","last_became_active":"2024-04-19T03:05:11.428668+0000","last_became_peered":"2024-04-19T03:05:11.428668+0000","last_unstale":"2024-04-19T03:05:19.713849+0000","last_undegraded":"2024-04-19T03:05:19.713849+0000","last_fullsized":"2024-04-19T03:05:19.713849+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"20'1","reported_seq":75,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:19.713750+0000","last_change":"2024-04-19T03:01:14.649839+0000","last_active":"2024-04-19T03:05:19.713750+0000","last_peered":"2024-04-19T03:05:19.713750+0000","last_clean":"2024-04-19T03:05:19.713750+0000","last_became_active":"2024-04-19T03:01:14.649571+0000","last_became_peered":"2024-04-19T03:01:14.649571+0000","last_unstale":"2024-04-19T03:05:19.713750+0000","last_undegraded":"2024-04-19T03:05:19.713750+0000","last_fullsized":"2024-04-19T03:05:19.713750+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":65,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:06:14.509847+0000","last_change":"2024-04-19T03:06:14.510089+0000","last_active":"2024-04-19T03:06:14.509847+0000","last_peered":"2024-04-19T03:06:14.509847+0000","last_clean":"2024-04-19T03:06:14.509847+0000","last_became_active":"2024-04-19T03:05:02.362227+0000","last_became_peered":"2024-04-19T03:05:02.362227+0000","last_unstale":"2024-04-19T03:06:14.509847+0000","last_undegraded":"2024-04-19T03:06:14.509847+0000","last_fullsized":"2024-04-19T03:06:14.509847+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:06:14.509801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:06:14.509801+0000","last_clean_scrub_stamp":"2024-04-19T03:06:14.509801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:30:22.470364+0000","scrub_duration":0.0034446279999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"20'2","reported_seq":76,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:19.240408+0000","last_change":"2024-04-19T03:01:14.645075+0000","last_active":"2024-04-19T03:05:19.240408+0000","last_peered":"2024-04-19T03:05:19.240408+0000","last_clean":"2024-04-19T03:05:19.240408+0000","last_became_active":"2024-04-19T03:01:14.644790+0000","last_became_peered":"2024-04-19T03:01:14.644790+0000","last_unstale":"2024-04-19T03:05:19.240408+0000","last_undegraded":"2024-04-19T03:05:19.240408+0000","last_fullsized":"2024-04-19T03:05:19.240408+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":90,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:06:04.548975+0000","last_change":"2024-04-19T03:06:04.549223+0000","last_active":"2024-04-19T03:06:04.548975+0000","last_peered":"2024-04-19T03:06:04.548975+0000","last_clean":"2024-04-19T03:06:04.548975+0000","last_became_active":"2024-04-19T03:05:09.392736+0000","last_became_peered":"2024-04-19T03:05:09.392736+0000","last_unstale":"2024-04-19T03:06:04.548975+0000","last_undegraded":"2024-04-19T03:06:04.548975+0000","last_fullsized":"2024-04-19T03:06:04.548975+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:06:04.548929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:06:04.548929+0000","last_clean_scrub_stamp":"2024-04-19T03:06:04.548929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:15:59.783247+0000","scrub_duration":0.0033845059999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"20'1","reported_seq":41,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:13.201186+0000","last_change":"2024-04-19T03:05:11.431892+0000","last_active":"2024-04-19T03:05:13.201186+0000","last_peered":"2024-04-19T03:05:13.201186+0000","last_clean":"2024-04-19T03:05:13.201186+0000","last_became_active":"2024-04-19T03:05:11.431552+0000","last_became_peered":"2024-04-19T03:05:11.431552+0000","last_unstale":"2024-04-19T03:05:13.201186+0000","last_undegraded":"2024-04-19T03:05:13.201186+0000","last_fullsized":"2024-04-19T03:05:13.201186+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":97,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:06:05.975879+0000","last_change":"2024-04-19T03:06:05.976137+0000","last_active":"2024-04-19T03:06:05.975879+0000","last_peered":"2024-04-19T03:06:05.975879+0000","last_clean":"2024-04-19T03:06:05.975879+0000","last_became_active":"2024-04-19T03:04:50.277126+0000","last_became_peered":"2024-04-19T03:04:50.277126+0000","last_unstale":"2024-04-19T03:06:05.975879+0000","last_undegraded":"2024-04-19T03:06:05.975879+0000","last_fullsized":"2024-04-19T03:06:05.975879+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:06:05.975834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:06:05.975834+0000","last_clean_scrub_stamp":"2024-04-19T03:06:05.975834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:20:51.285647+0000","scrub_duration":0.003132653,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":73,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:19.713832+0000","last_change":"2024-04-19T03:05:11.429040+0000","last_active":"2024-04-19T03:05:19.713832+0000","last_peered":"2024-04-19T03:05:19.713832+0000","last_clean":"2024-04-19T03:05:19.713832+0000","last_became_active":"2024-04-19T03:05:11.428722+0000","last_became_peered":"2024-04-19T03:05:11.428722+0000","last_unstale":"2024-04-19T03:05:19.713832+0000","last_undegraded":"2024-04-19T03:05:19.713832+0000","last_fullsized":"2024-04-19T03:05:19.713832+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:12.770284+0000","last_change":"2024-04-19T03:04:50.627120+0000","last_active":"2024-04-19T03:05:12.770284+0000","last_peered":"2024-04-19T03:05:12.770284+0000","last_clean":"2024-04-19T03:05:12.770284+0000","last_became_active":"2024-04-19T03:04:50.625919+0000","last_became_peered":"2024-04-19T03:04:50.625919+0000","last_unstale":"2024-04-19T03:05:12.770284+0000","last_undegraded":"2024-04-19T03:05:12.770284+0000","last_fullsized":"2024-04-19T03:05:12.770284+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"20'2","reported_seq":33,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:12.769661+0000","last_change":"2024-04-19T03:04:50.627277+0000","last_active":"2024-04-19T03:05:12.769661+0000","last_peered":"2024-04-19T03:05:12.769661+0000","last_clean":"2024-04-19T03:05:12.769661+0000","last_became_active":"2024-04-19T03:04:50.625931+0000","last_became_peered":"2024-04-19T03:04:50.625931+0000","last_unstale":"2024-04-19T03:05:12.769661+0000","last_undegraded":"2024-04-19T03:05:12.769661+0000","last_fullsized":"2024-04-19T03:05:12.769661+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":88,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:19.714149+0000","last_change":"2024-04-19T03:05:11.430496+0000","last_active":"2024-04-19T03:05:19.714149+0000","last_peered":"2024-04-19T03:05:19.714149+0000","last_clean":"2024-04-19T03:05:19.714149+0000","last_became_active":"2024-04-19T03:05:11.430149+0000","last_became_peered":"2024-04-19T03:05:11.430149+0000","last_unstale":"2024-04-19T03:05:19.714149+0000","last_undegraded":"2024-04-19T03:05:19.714149+0000","last_fullsized":"2024-04-19T03:05:19.714149+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":87,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:19.713774+0000","last_change":"2024-04-19T03:04:50.278491+0000","last_active":"2024-04-19T03:05:19.713774+0000","last_peered":"2024-04-19T03:05:19.713774+0000","last_clean":"2024-04-19T03:05:19.713774+0000","last_became_active":"2024-04-19T03:04:50.277603+0000","last_became_peered":"2024-04-19T03:04:50.277603+0000","last_unstale":"2024-04-19T03:05:19.713774+0000","last_undegraded":"2024-04-19T03:05:19.713774+0000","last_fullsized":"2024-04-19T03:05:19.713774+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":84,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:46.144344+0000","last_change":"2024-04-19T03:05:46.144560+0000","last_active":"2024-04-19T03:05:46.144344+0000","last_peered":"2024-04-19T03:05:46.144344+0000","last_clean":"2024-04-19T03:05:46.144344+0000","last_became_active":"2024-04-19T03:01:15.014847+0000","last_became_peered":"2024-04-19T03:01:15.014847+0000","last_unstale":"2024-04-19T03:05:46.144344+0000","last_undegraded":"2024-04-19T03:05:46.144344+0000","last_fullsized":"2024-04-19T03:05:46.144344+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:05:46.144300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:05:46.144300+0000","last_clean_scrub_stamp":"2024-04-19T03:05:46.144300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:43:25.191286+0000","scrub_duration":0.0032320750000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":63,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:42.387222+0000","last_change":"2024-04-19T03:05:42.387451+0000","last_active":"2024-04-19T03:05:42.387222+0000","last_peered":"2024-04-19T03:05:42.387222+0000","last_clean":"2024-04-19T03:05:42.387222+0000","last_became_active":"2024-04-19T03:05:09.391218+0000","last_became_peered":"2024-04-19T03:05:09.391218+0000","last_unstale":"2024-04-19T03:05:42.387222+0000","last_undegraded":"2024-04-19T03:05:42.387222+0000","last_fullsized":"2024-04-19T03:05:42.387222+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:05:42.387178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:05:42.387178+0000","last_clean_scrub_stamp":"2024-04-19T03:05:42.387178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:52:14.035747+0000","scrub_duration":0.003459981,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":84,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:06:01.981674+0000","last_change":"2024-04-19T03:06:01.981909+0000","last_active":"2024-04-19T03:06:01.981674+0000","last_peered":"2024-04-19T03:06:01.981674+0000","last_clean":"2024-04-19T03:06:01.981674+0000","last_became_active":"2024-04-19T03:01:15.014421+0000","last_became_peered":"2024-04-19T03:01:15.014421+0000","last_unstale":"2024-04-19T03:06:01.981674+0000","last_undegraded":"2024-04-19T03:06:01.981674+0000","last_fullsized":"2024-04-19T03:06:01.981674+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:06:01.981618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:06:01.981618+0000","last_clean_scrub_stamp":"2024-04-19T03:06:01.981618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:06:28.035993+0000","scrub_duration":0.0033942379999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":91,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:50.475678+0000","last_change":"2024-04-19T03:05:50.475892+0000","last_active":"2024-04-19T03:05:50.475678+0000","last_peered":"2024-04-19T03:05:50.475678+0000","last_clean":"2024-04-19T03:05:50.475678+0000","last_became_active":"2024-04-19T03:05:09.395294+0000","last_became_peered":"2024-04-19T03:05:09.395294+0000","last_unstale":"2024-04-19T03:05:50.475678+0000","last_undegraded":"2024-04-19T03:05:50.475678+0000","last_fullsized":"2024-04-19T03:05:50.475678+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:05:50.475630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:05:50.475630+0000","last_clean_scrub_stamp":"2024-04-19T03:05:50.475630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:03:15.099595+0000","scrub_duration":0.0034712469999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":41,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:50.148906+0000","last_change":"2024-04-19T03:05:50.149020+0000","last_active":"2024-04-19T03:05:50.148906+0000","last_peered":"2024-04-19T03:05:50.148906+0000","last_clean":"2024-04-19T03:05:50.148906+0000","last_became_active":"2024-04-19T03:04:50.617323+0000","last_became_peered":"2024-04-19T03:04:50.617323+0000","last_unstale":"2024-04-19T03:05:50.148906+0000","last_undegraded":"2024-04-19T03:05:50.148906+0000","last_fullsized":"2024-04-19T03:05:50.148906+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:05:50.148885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:05:50.148885+0000","last_clean_scrub_stamp":"2024-04-19T03:05:50.148885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:47:33.437890+0000","scrub_duration":0.061933355000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"14'157","reported_seq":280,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:13.200849+0000","last_change":"2024-04-19T03:05:11.429096+0000","last_active":"2024-04-19T03:05:13.200849+0000","last_peered":"2024-04-19T03:05:13.200849+0000","last_clean":"2024-04-19T03:05:13.200849+0000","last_became_active":"2024-04-19T03:05:11.426859+0000","last_became_peered":"2024-04-19T03:05:11.426859+0000","last_unstale":"2024-04-19T03:05:13.200849+0000","last_undegraded":"2024-04-19T03:05:13.200849+0000","last_fullsized":"2024-04-19T03:05:13.200849+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:06.516863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:06.516863+0000","last_clean_scrub_stamp":"2024-04-19T03:01:06.516863+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":89,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:19.713590+0000","last_change":"2024-04-19T03:04:50.277227+0000","last_active":"2024-04-19T03:05:19.713590+0000","last_peered":"2024-04-19T03:05:19.713590+0000","last_clean":"2024-04-19T03:05:19.713590+0000","last_became_active":"2024-04-19T03:04:50.276132+0000","last_became_peered":"2024-04-19T03:04:50.276132+0000","last_unstale":"2024-04-19T03:05:19.713590+0000","last_undegraded":"2024-04-19T03:05:19.713590+0000","last_fullsized":"2024-04-19T03:05:19.713590+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_clean_scrub_stamp":"2024-04-19T03:01:09.578660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":31,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:12.768952+0000","last_change":"2024-04-19T03:04:50.629139+0000","last_active":"2024-04-19T03:05:12.768952+0000","last_peered":"2024-04-19T03:05:12.768952+0000","last_clean":"2024-04-19T03:05:12.768952+0000","last_became_active":"2024-04-19T03:04:50.628741+0000","last_became_peered":"2024-04-19T03:04:50.628741+0000","last_unstale":"2024-04-19T03:05:12.768952+0000","last_undegraded":"2024-04-19T03:05:12.768952+0000","last_fullsized":"2024-04-19T03:05:12.768952+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":86,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:37.209852+0000","last_change":"2024-04-19T03:05:37.210309+0000","last_active":"2024-04-19T03:05:37.209852+0000","last_peered":"2024-04-19T03:05:37.209852+0000","last_clean":"2024-04-19T03:05:37.209852+0000","last_became_active":"2024-04-19T03:05:11.430881+0000","last_became_peered":"2024-04-19T03:05:11.430881+0000","last_unstale":"2024-04-19T03:05:37.209852+0000","last_undegraded":"2024-04-19T03:05:37.209852+0000","last_fullsized":"2024-04-19T03:05:37.209852+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:05:37.209759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:05:37.209759+0000","last_clean_scrub_stamp":"2024-04-19T03:05:37.209759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:52:10.997951+0000","scrub_duration":0.0033919810000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":76,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:12.903561+0000","last_change":"2024-04-19T03:01:10.602194+0000","last_active":"2024-04-19T03:05:12.903561+0000","last_peered":"2024-04-19T03:05:12.903561+0000","last_clean":"2024-04-19T03:05:12.903561+0000","last_became_active":"2024-04-19T03:01:10.601381+0000","last_became_peered":"2024-04-19T03:01:10.601381+0000","last_unstale":"2024-04-19T03:05:12.903561+0000","last_undegraded":"2024-04-19T03:05:12.903561+0000","last_fullsized":"2024-04-19T03:05:12.903561+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_clean_scrub_stamp":"2024-04-19T03:01:09.578660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":42,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:58.945625+0000","last_change":"2024-04-19T03:05:58.945975+0000","last_active":"2024-04-19T03:05:58.945625+0000","last_peered":"2024-04-19T03:05:58.945625+0000","last_clean":"2024-04-19T03:05:58.945625+0000","last_became_active":"2024-04-19T03:04:50.631721+0000","last_became_peered":"2024-04-19T03:04:50.631721+0000","last_unstale":"2024-04-19T03:05:58.945625+0000","last_undegraded":"2024-04-19T03:05:58.945625+0000","last_fullsized":"2024-04-19T03:05:58.945625+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:05:58.945528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:05:58.945528+0000","last_clean_scrub_stamp":"2024-04-19T03:05:58.945528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:00:41.372378+0000","scrub_duration":0.0034170619999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":90,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:45.465307+0000","last_change":"2024-04-19T03:05:45.465610+0000","last_active":"2024-04-19T03:05:45.465307+0000","last_peered":"2024-04-19T03:05:45.465307+0000","last_clean":"2024-04-19T03:05:45.465307+0000","last_became_active":"2024-04-19T03:05:09.395167+0000","last_became_peered":"2024-04-19T03:05:09.395167+0000","last_unstale":"2024-04-19T03:05:45.465307+0000","last_undegraded":"2024-04-19T03:05:45.465307+0000","last_fullsized":"2024-04-19T03:05:45.465307+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:05:45.465258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:05:45.465258+0000","last_clean_scrub_stamp":"2024-04-19T03:05:45.465258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:21:36.562113+0000","scrub_duration":0.0030148670000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":41,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:19.154051+0000","last_change":"2024-04-19T03:05:19.169049+0000","last_active":"2024-04-19T03:05:19.154051+0000","last_peered":"2024-04-19T03:05:19.154051+0000","last_clean":"2024-04-19T03:05:19.154051+0000","last_became_active":"2024-04-19T03:04:50.633457+0000","last_became_peered":"2024-04-19T03:04:50.633457+0000","last_unstale":"2024-04-19T03:05:19.154051+0000","last_undegraded":"2024-04-19T03:05:19.154051+0000","last_fullsized":"2024-04-19T03:05:19.154051+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:05:19.154005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:05:19.154005+0000","last_clean_scrub_stamp":"2024-04-19T03:05:19.154005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:23:03.401654+0000","scrub_duration":0.0034373889999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":74,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:15.172674+0000","last_change":"2024-04-19T03:01:14.649068+0000","last_active":"2024-04-19T03:05:15.172674+0000","last_peered":"2024-04-19T03:05:15.172674+0000","last_clean":"2024-04-19T03:05:15.172674+0000","last_became_active":"2024-04-19T03:01:14.648082+0000","last_became_peered":"2024-04-19T03:01:14.648082+0000","last_unstale":"2024-04-19T03:05:15.172674+0000","last_undegraded":"2024-04-19T03:05:15.172674+0000","last_fullsized":"2024-04-19T03:05:15.172674+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":41,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:34.130919+0000","last_change":"2024-04-19T03:05:34.131042+0000","last_active":"2024-04-19T03:05:34.130919+0000","last_peered":"2024-04-19T03:05:34.130919+0000","last_clean":"2024-04-19T03:05:34.130919+0000","last_became_active":"2024-04-19T03:04:50.617628+0000","last_became_peered":"2024-04-19T03:04:50.617628+0000","last_unstale":"2024-04-19T03:05:34.130919+0000","last_undegraded":"2024-04-19T03:05:34.130919+0000","last_fullsized":"2024-04-19T03:05:34.130919+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:05:34.130897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:05:34.130897+0000","last_clean_scrub_stamp":"2024-04-19T03:05:34.130897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:03:56.628506+0000","scrub_duration":0.037678018000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":89,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:19.713612+0000","last_change":"2024-04-19T03:04:50.278737+0000","last_active":"2024-04-19T03:05:19.713612+0000","last_peered":"2024-04-19T03:05:19.713612+0000","last_clean":"2024-04-19T03:05:19.713612+0000","last_became_active":"2024-04-19T03:04:50.277804+0000","last_became_peered":"2024-04-19T03:04:50.277804+0000","last_unstale":"2024-04-19T03:05:19.713612+0000","last_undegraded":"2024-04-19T03:05:19.713612+0000","last_fullsized":"2024-04-19T03:05:19.713612+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_clean_scrub_stamp":"2024-04-19T03:01:09.578660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":87,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:19.713697+0000","last_change":"2024-04-19T03:04:50.277141+0000","last_active":"2024-04-19T03:05:19.713697+0000","last_peered":"2024-04-19T03:05:19.713697+0000","last_clean":"2024-04-19T03:05:19.713697+0000","last_became_active":"2024-04-19T03:04:50.275812+0000","last_became_peered":"2024-04-19T03:04:50.275812+0000","last_unstale":"2024-04-19T03:05:19.713697+0000","last_undegraded":"2024-04-19T03:05:19.713697+0000","last_fullsized":"2024-04-19T03:05:19.713697+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":41,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:06:03.930170+0000","last_change":"2024-04-19T03:06:03.930425+0000","last_active":"2024-04-19T03:06:03.930170+0000","last_peered":"2024-04-19T03:06:03.930170+0000","last_clean":"2024-04-19T03:06:03.930170+0000","last_became_active":"2024-04-19T03:04:50.614774+0000","last_became_peered":"2024-04-19T03:04:50.614774+0000","last_unstale":"2024-04-19T03:06:03.930170+0000","last_undegraded":"2024-04-19T03:06:03.930170+0000","last_fullsized":"2024-04-19T03:06:03.930170+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:06:03.930122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:06:03.930122+0000","last_clean_scrub_stamp":"2024-04-19T03:06:03.930122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:28:52.187857+0000","scrub_duration":0.003163627,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":84,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:22.163334+0000","last_change":"2024-04-19T03:05:22.163334+0000","last_active":"2024-04-19T03:05:22.163334+0000","last_peered":"2024-04-19T03:05:22.163334+0000","last_clean":"2024-04-19T03:05:22.163334+0000","last_became_active":"2024-04-19T03:05:11.429941+0000","last_became_peered":"2024-04-19T03:05:11.429941+0000","last_unstale":"2024-04-19T03:05:22.163334+0000","last_undegraded":"2024-04-19T03:05:22.163334+0000","last_fullsized":"2024-04-19T03:05:22.163334+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:05:22.163031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:05:22.163031+0000","last_clean_scrub_stamp":"2024-04-19T03:05:22.163031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:21:13.259886+0000","scrub_duration":0.0032565699999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":41,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:26.113178+0000","last_change":"2024-04-19T03:05:26.113394+0000","last_active":"2024-04-19T03:05:26.113178+0000","last_peered":"2024-04-19T03:05:26.113178+0000","last_clean":"2024-04-19T03:05:26.113178+0000","last_became_active":"2024-04-19T03:04:50.614498+0000","last_became_peered":"2024-04-19T03:04:50.614498+0000","last_unstale":"2024-04-19T03:05:26.113178+0000","last_undegraded":"2024-04-19T03:05:26.113178+0000","last_fullsized":"2024-04-19T03:05:26.113178+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:05:26.113130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:05:26.113130+0000","last_clean_scrub_stamp":"2024-04-19T03:05:26.113130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:38:46.443254+0000","scrub_duration":0.0031920770000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":62,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:06:10.525215+0000","last_change":"2024-04-19T03:06:10.525475+0000","last_active":"2024-04-19T03:06:10.525215+0000","last_peered":"2024-04-19T03:06:10.525215+0000","last_clean":"2024-04-19T03:06:10.525215+0000","last_became_active":"2024-04-19T03:05:09.394024+0000","last_became_peered":"2024-04-19T03:05:09.394024+0000","last_unstale":"2024-04-19T03:06:10.525215+0000","last_undegraded":"2024-04-19T03:06:10.525215+0000","last_fullsized":"2024-04-19T03:06:10.525215+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:06:10.525171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:06:10.525171+0000","last_clean_scrub_stamp":"2024-04-19T03:06:10.525171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:00:17.137062+0000","scrub_duration":0.00337156,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":42,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:33.132538+0000","last_change":"2024-04-19T03:05:33.132791+0000","last_active":"2024-04-19T03:05:33.132538+0000","last_peered":"2024-04-19T03:05:33.132538+0000","last_clean":"2024-04-19T03:05:33.132538+0000","last_became_active":"2024-04-19T03:04:50.615238+0000","last_became_peered":"2024-04-19T03:04:50.615238+0000","last_unstale":"2024-04-19T03:05:33.132538+0000","last_undegraded":"2024-04-19T03:05:33.132538+0000","last_fullsized":"2024-04-19T03:05:33.132538+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:05:33.132481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:05:33.132481+0000","last_clean_scrub_stamp":"2024-04-19T03:05:33.132481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:12:12.823889+0000","scrub_duration":0.0033373280000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":83,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:19.240328+0000","last_change":"2024-04-19T03:05:09.397542+0000","last_active":"2024-04-19T03:05:19.240328+0000","last_peered":"2024-04-19T03:05:19.240328+0000","last_clean":"2024-04-19T03:05:19.240328+0000","last_became_active":"2024-04-19T03:05:09.396378+0000","last_became_peered":"2024-04-19T03:05:09.396378+0000","last_unstale":"2024-04-19T03:05:19.240328+0000","last_undegraded":"2024-04-19T03:05:19.240328+0000","last_fullsized":"2024-04-19T03:05:19.240328+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_clean_scrub_stamp":"2024-04-19T03:01:09.578660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":51,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:12.420654+0000","last_change":"2024-04-19T03:05:09.392910+0000","last_active":"2024-04-19T03:05:12.420654+0000","last_peered":"2024-04-19T03:05:12.420654+0000","last_clean":"2024-04-19T03:05:12.420654+0000","last_became_active":"2024-04-19T03:05:09.392437+0000","last_became_peered":"2024-04-19T03:05:09.392437+0000","last_unstale":"2024-04-19T03:05:12.420654+0000","last_undegraded":"2024-04-19T03:05:12.420654+0000","last_fullsized":"2024-04-19T03:05:12.420654+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"81'3","reported_seq":45,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:57.905939+0000","last_change":"2024-04-19T03:05:57.906283+0000","last_active":"2024-04-19T03:05:57.905939+0000","last_peered":"2024-04-19T03:05:57.905939+0000","last_clean":"2024-04-19T03:05:57.905939+0000","last_became_active":"2024-04-19T03:04:50.611024+0000","last_became_peered":"2024-04-19T03:04:50.611024+0000","last_unstale":"2024-04-19T03:05:57.905939+0000","last_undegraded":"2024-04-19T03:05:57.905939+0000","last_fullsized":"2024-04-19T03:05:57.905939+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'3","last_scrub_stamp":"2024-04-19T03:05:57.905886+0000","last_deep_scrub":"81'3","last_deep_scrub_stamp":"2024-04-19T03:05:57.905886+0000","last_clean_scrub_stamp":"2024-04-19T03:05:57.905886+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:53:22.931871+0000","scrub_duration":0.006376273,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":41,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:06:14.878469+0000","last_change":"2024-04-19T03:06:14.878807+0000","last_active":"2024-04-19T03:06:14.878469+0000","last_peered":"2024-04-19T03:06:14.878469+0000","last_clean":"2024-04-19T03:06:14.878469+0000","last_became_active":"2024-04-19T03:04:50.612403+0000","last_became_peered":"2024-04-19T03:04:50.612403+0000","last_unstale":"2024-04-19T03:06:14.878469+0000","last_undegraded":"2024-04-19T03:06:14.878469+0000","last_fullsized":"2024-04-19T03:06:14.878469+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:06:14.878362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:06:14.878362+0000","last_clean_scrub_stamp":"2024-04-19T03:06:14.878362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:28:51.544909+0000","scrub_duration":0.0036263469999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":41,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:47.097742+0000","last_change":"2024-04-19T03:05:47.097999+0000","last_active":"2024-04-19T03:05:47.097742+0000","last_peered":"2024-04-19T03:05:47.097742+0000","last_clean":"2024-04-19T03:05:47.097742+0000","last_became_active":"2024-04-19T03:04:50.612987+0000","last_became_peered":"2024-04-19T03:04:50.612987+0000","last_unstale":"2024-04-19T03:05:47.097742+0000","last_undegraded":"2024-04-19T03:05:47.097742+0000","last_fullsized":"2024-04-19T03:05:47.097742+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:05:47.097698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:05:47.097698+0000","last_clean_scrub_stamp":"2024-04-19T03:05:47.097698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:08:39.534725+0000","scrub_duration":0.0032086129999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"81'2","reported_seq":46,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:46.119148+0000","last_change":"2024-04-19T03:05:46.119402+0000","last_active":"2024-04-19T03:05:46.119148+0000","last_peered":"2024-04-19T03:05:46.119148+0000","last_clean":"2024-04-19T03:05:46.119148+0000","last_became_active":"2024-04-19T03:04:50.612697+0000","last_became_peered":"2024-04-19T03:04:50.612697+0000","last_unstale":"2024-04-19T03:05:46.119148+0000","last_undegraded":"2024-04-19T03:05:46.119148+0000","last_fullsized":"2024-04-19T03:05:46.119148+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'2","last_scrub_stamp":"2024-04-19T03:05:46.119093+0000","last_deep_scrub":"81'2","last_deep_scrub_stamp":"2024-04-19T03:05:46.119093+0000","last_clean_scrub_stamp":"2024-04-19T03:05:46.119093+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:47:01.115618+0000","scrub_duration":0.0063348040000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":76,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:19.713587+0000","last_change":"2024-04-19T03:01:10.602274+0000","last_active":"2024-04-19T03:05:19.713587+0000","last_peered":"2024-04-19T03:05:19.713587+0000","last_clean":"2024-04-19T03:05:19.713587+0000","last_became_active":"2024-04-19T03:01:10.601487+0000","last_became_peered":"2024-04-19T03:01:10.601487+0000","last_unstale":"2024-04-19T03:05:19.713587+0000","last_undegraded":"2024-04-19T03:05:19.713587+0000","last_fullsized":"2024-04-19T03:05:19.713587+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_clean_scrub_stamp":"2024-04-19T03:01:09.578660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":73,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:19.240645+0000","last_change":"2024-04-19T03:01:15.018914+0000","last_active":"2024-04-19T03:05:19.240645+0000","last_peered":"2024-04-19T03:05:19.240645+0000","last_clean":"2024-04-19T03:05:19.240645+0000","last_became_active":"2024-04-19T03:01:15.018276+0000","last_became_peered":"2024-04-19T03:01:15.018276+0000","last_unstale":"2024-04-19T03:05:19.240645+0000","last_undegraded":"2024-04-19T03:05:19.240645+0000","last_fullsized":"2024-04-19T03:05:19.240645+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":78,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:19.714252+0000","last_change":"2024-04-19T03:05:11.430020+0000","last_active":"2024-04-19T03:05:19.714252+0000","last_peered":"2024-04-19T03:05:19.714252+0000","last_clean":"2024-04-19T03:05:19.714252+0000","last_became_active":"2024-04-19T03:05:11.429214+0000","last_became_peered":"2024-04-19T03:05:11.429214+0000","last_unstale":"2024-04-19T03:05:19.714252+0000","last_undegraded":"2024-04-19T03:05:19.714252+0000","last_fullsized":"2024-04-19T03:05:19.714252+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"81'10","reported_seq":100,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:29.315169+0000","last_change":"2024-04-19T03:05:29.315169+0000","last_active":"2024-04-19T03:05:29.315169+0000","last_peered":"2024-04-19T03:05:29.315169+0000","last_clean":"2024-04-19T03:05:29.315169+0000","last_became_active":"2024-04-19T03:05:11.430906+0000","last_became_peered":"2024-04-19T03:05:11.430906+0000","last_unstale":"2024-04-19T03:05:29.315169+0000","last_undegraded":"2024-04-19T03:05:29.315169+0000","last_fullsized":"2024-04-19T03:05:29.315169+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'10","last_scrub_stamp":"2024-04-19T03:05:29.314872+0000","last_deep_scrub":"81'10","last_deep_scrub_stamp":"2024-04-19T03:05:29.314872+0000","last_clean_scrub_stamp":"2024-04-19T03:05:29.314872+0000","objects_scrubbed":4,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:09:13.123950+0000","scrub_duration":0.0096666670000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":41,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:51.052208+0000","last_change":"2024-04-19T03:05:51.052464+0000","last_active":"2024-04-19T03:05:51.052208+0000","last_peered":"2024-04-19T03:05:51.052208+0000","last_clean":"2024-04-19T03:05:51.052208+0000","last_became_active":"2024-04-19T03:04:50.627654+0000","last_became_peered":"2024-04-19T03:04:50.627654+0000","last_unstale":"2024-04-19T03:05:51.052208+0000","last_undegraded":"2024-04-19T03:05:51.052208+0000","last_fullsized":"2024-04-19T03:05:51.052208+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:05:51.052162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:05:51.052162+0000","last_clean_scrub_stamp":"2024-04-19T03:05:51.052162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:45:11.062907+0000","scrub_duration":0.0030909259999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"20'3","reported_seq":55,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:12.421900+0000","last_change":"2024-04-19T03:05:09.398110+0000","last_active":"2024-04-19T03:05:12.421900+0000","last_peered":"2024-04-19T03:05:12.421900+0000","last_clean":"2024-04-19T03:05:12.421900+0000","last_became_active":"2024-04-19T03:05:09.397555+0000","last_became_peered":"2024-04-19T03:05:09.397555+0000","last_unstale":"2024-04-19T03:05:12.421900+0000","last_undegraded":"2024-04-19T03:05:12.421900+0000","last_fullsized":"2024-04-19T03:05:12.421900+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":84,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:30.281124+0000","last_change":"2024-04-19T03:05:30.281124+0000","last_active":"2024-04-19T03:05:30.281124+0000","last_peered":"2024-04-19T03:05:30.281124+0000","last_clean":"2024-04-19T03:05:30.281124+0000","last_became_active":"2024-04-19T03:05:11.428904+0000","last_became_peered":"2024-04-19T03:05:11.428904+0000","last_unstale":"2024-04-19T03:05:30.281124+0000","last_undegraded":"2024-04-19T03:05:30.281124+0000","last_fullsized":"2024-04-19T03:05:30.281124+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:05:30.280817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:05:30.280817+0000","last_clean_scrub_stamp":"2024-04-19T03:05:30.280817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:49:02.715913+0000","scrub_duration":0.0034631390000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:12.769162+0000","last_change":"2024-04-19T03:04:50.634026+0000","last_active":"2024-04-19T03:05:12.769162+0000","last_peered":"2024-04-19T03:05:12.769162+0000","last_clean":"2024-04-19T03:05:12.769162+0000","last_became_active":"2024-04-19T03:04:50.630873+0000","last_became_peered":"2024-04-19T03:04:50.630873+0000","last_unstale":"2024-04-19T03:05:12.769162+0000","last_undegraded":"2024-04-19T03:05:12.769162+0000","last_fullsized":"2024-04-19T03:05:12.769162+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":42,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:25.154192+0000","last_change":"2024-04-19T03:05:25.154574+0000","last_active":"2024-04-19T03:05:25.154192+0000","last_peered":"2024-04-19T03:05:25.154192+0000","last_clean":"2024-04-19T03:05:25.154192+0000","last_became_active":"2024-04-19T03:04:50.612005+0000","last_became_peered":"2024-04-19T03:04:50.612005+0000","last_unstale":"2024-04-19T03:05:25.154192+0000","last_undegraded":"2024-04-19T03:05:25.154192+0000","last_fullsized":"2024-04-19T03:05:25.154192+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:05:25.154094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:05:25.154094+0000","last_clean_scrub_stamp":"2024-04-19T03:05:25.154094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:35:43.914350+0000","scrub_duration":0.0032290930000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":41,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:36.159462+0000","last_change":"2024-04-19T03:05:36.159687+0000","last_active":"2024-04-19T03:05:36.159462+0000","last_peered":"2024-04-19T03:05:36.159462+0000","last_clean":"2024-04-19T03:05:36.159462+0000","last_became_active":"2024-04-19T03:04:50.613735+0000","last_became_peered":"2024-04-19T03:04:50.613735+0000","last_unstale":"2024-04-19T03:05:36.159462+0000","last_undegraded":"2024-04-19T03:05:36.159462+0000","last_fullsized":"2024-04-19T03:05:36.159462+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:05:36.159417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:05:36.159417+0000","last_clean_scrub_stamp":"2024-04-19T03:05:36.159417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:03:12.881177+0000","scrub_duration":0.0033805229999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":62,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:51.504587+0000","last_change":"2024-04-19T03:05:51.504706+0000","last_active":"2024-04-19T03:05:51.504587+0000","last_peered":"2024-04-19T03:05:51.504587+0000","last_clean":"2024-04-19T03:05:51.504587+0000","last_became_active":"2024-04-19T03:05:09.392982+0000","last_became_peered":"2024-04-19T03:05:09.392982+0000","last_unstale":"2024-04-19T03:05:51.504587+0000","last_undegraded":"2024-04-19T03:05:51.504587+0000","last_fullsized":"2024-04-19T03:05:51.504587+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:05:51.504568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:05:51.504568+0000","last_clean_scrub_stamp":"2024-04-19T03:05:51.504568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:09:35.313645+0000","scrub_duration":0.075784133000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":42,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:06:04.942245+0000","last_change":"2024-04-19T03:06:04.942510+0000","last_active":"2024-04-19T03:06:04.942245+0000","last_peered":"2024-04-19T03:06:04.942245+0000","last_clean":"2024-04-19T03:06:04.942245+0000","last_became_active":"2024-04-19T03:04:50.613523+0000","last_became_peered":"2024-04-19T03:04:50.613523+0000","last_unstale":"2024-04-19T03:06:04.942245+0000","last_undegraded":"2024-04-19T03:06:04.942245+0000","last_fullsized":"2024-04-19T03:06:04.942245+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:06:04.942199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:06:04.942199+0000","last_clean_scrub_stamp":"2024-04-19T03:06:04.942199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:28:55.349289+0000","scrub_duration":0.0030863319999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":30,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:12.769377+0000","last_change":"2024-04-19T03:04:50.616829+0000","last_active":"2024-04-19T03:05:12.769377+0000","last_peered":"2024-04-19T03:05:12.769377+0000","last_clean":"2024-04-19T03:05:12.769377+0000","last_became_active":"2024-04-19T03:04:50.616545+0000","last_became_peered":"2024-04-19T03:04:50.616545+0000","last_unstale":"2024-04-19T03:05:12.769377+0000","last_undegraded":"2024-04-19T03:05:12.769377+0000","last_fullsized":"2024-04-19T03:05:12.769377+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":42,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:06:12.924266+0000","last_change":"2024-04-19T03:06:12.924499+0000","last_active":"2024-04-19T03:06:12.924266+0000","last_peered":"2024-04-19T03:06:12.924266+0000","last_clean":"2024-04-19T03:06:12.924266+0000","last_became_active":"2024-04-19T03:04:50.631699+0000","last_became_peered":"2024-04-19T03:04:50.631699+0000","last_unstale":"2024-04-19T03:06:12.924266+0000","last_undegraded":"2024-04-19T03:06:12.924266+0000","last_fullsized":"2024-04-19T03:06:12.924266+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:06:12.924210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:06:12.924210+0000","last_clean_scrub_stamp":"2024-04-19T03:06:12.924210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:14:21.020517+0000","scrub_duration":0.0036518229999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":65,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:06:05.526393+0000","last_change":"2024-04-19T03:06:05.526625+0000","last_active":"2024-04-19T03:06:05.526393+0000","last_peered":"2024-04-19T03:06:05.526393+0000","last_clean":"2024-04-19T03:06:05.526393+0000","last_became_active":"2024-04-19T03:05:02.360924+0000","last_became_peered":"2024-04-19T03:05:02.360924+0000","last_unstale":"2024-04-19T03:06:05.526393+0000","last_undegraded":"2024-04-19T03:06:05.526393+0000","last_fullsized":"2024-04-19T03:06:05.526393+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:06:05.526344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:06:05.526344+0000","last_clean_scrub_stamp":"2024-04-19T03:06:05.526344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:51:30.876593+0000","scrub_duration":0.003457187,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"20'1","reported_seq":92,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:27.387324+0000","last_change":"2024-04-19T03:05:27.387324+0000","last_active":"2024-04-19T03:05:27.387324+0000","last_peered":"2024-04-19T03:05:27.387324+0000","last_clean":"2024-04-19T03:05:27.387324+0000","last_became_active":"2024-04-19T03:05:09.395508+0000","last_became_peered":"2024-04-19T03:05:09.395508+0000","last_unstale":"2024-04-19T03:05:27.387324+0000","last_undegraded":"2024-04-19T03:05:27.387324+0000","last_fullsized":"2024-04-19T03:05:27.387324+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"20'1","last_scrub_stamp":"2024-04-19T03:05:27.386920+0000","last_deep_scrub":"20'1","last_deep_scrub_stamp":"2024-04-19T03:05:27.386920+0000","last_clean_scrub_stamp":"2024-04-19T03:05:27.386920+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:30:55.863683+0000","scrub_duration":0.0033146569999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":79,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:19.240972+0000","last_change":"2024-04-19T03:05:09.396327+0000","last_active":"2024-04-19T03:05:19.240972+0000","last_peered":"2024-04-19T03:05:19.240972+0000","last_clean":"2024-04-19T03:05:19.240972+0000","last_became_active":"2024-04-19T03:05:09.395753+0000","last_became_peered":"2024-04-19T03:05:09.395753+0000","last_unstale":"2024-04-19T03:05:19.240972+0000","last_undegraded":"2024-04-19T03:05:19.240972+0000","last_fullsized":"2024-04-19T03:05:19.240972+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"20'1","reported_seq":100,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:40.415059+0000","last_change":"2024-04-19T03:05:40.415059+0000","last_active":"2024-04-19T03:05:40.415059+0000","last_peered":"2024-04-19T03:05:40.415059+0000","last_clean":"2024-04-19T03:05:40.415059+0000","last_became_active":"2024-04-19T03:05:09.397183+0000","last_became_peered":"2024-04-19T03:05:09.397183+0000","last_unstale":"2024-04-19T03:05:40.415059+0000","last_undegraded":"2024-04-19T03:05:40.415059+0000","last_fullsized":"2024-04-19T03:05:40.415059+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"20'1","last_scrub_stamp":"2024-04-19T03:05:40.414768+0000","last_deep_scrub":"20'1","last_deep_scrub_stamp":"2024-04-19T03:05:40.414768+0000","last_clean_scrub_stamp":"2024-04-19T03:05:40.414768+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:13:49.641736+0000","scrub_duration":0.0037583510000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":99,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:42.226248+0000","last_change":"2024-04-19T03:05:42.226248+0000","last_active":"2024-04-19T03:05:42.226248+0000","last_peered":"2024-04-19T03:05:42.226248+0000","last_clean":"2024-04-19T03:05:42.226248+0000","last_became_active":"2024-04-19T03:05:11.429247+0000","last_became_peered":"2024-04-19T03:05:11.429247+0000","last_unstale":"2024-04-19T03:05:42.226248+0000","last_undegraded":"2024-04-19T03:05:42.226248+0000","last_fullsized":"2024-04-19T03:05:42.226248+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:05:42.226018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:05:42.226018+0000","last_clean_scrub_stamp":"2024-04-19T03:05:42.226018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:33:09.655667+0000","scrub_duration":0.049267652000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"20'2","reported_seq":89,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:19.714079+0000","last_change":"2024-04-19T03:04:50.276105+0000","last_active":"2024-04-19T03:05:19.714079+0000","last_peered":"2024-04-19T03:05:19.714079+0000","last_clean":"2024-04-19T03:05:19.714079+0000","last_became_active":"2024-04-19T03:04:50.275533+0000","last_became_peered":"2024-04-19T03:04:50.275533+0000","last_unstale":"2024-04-19T03:05:19.714079+0000","last_undegraded":"2024-04-19T03:05:19.714079+0000","last_fullsized":"2024-04-19T03:05:19.714079+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":86,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:19.714216+0000","last_change":"2024-04-19T03:04:50.278401+0000","last_active":"2024-04-19T03:05:19.714216+0000","last_peered":"2024-04-19T03:05:19.714216+0000","last_clean":"2024-04-19T03:05:19.714216+0000","last_became_active":"2024-04-19T03:04:50.277348+0000","last_became_peered":"2024-04-19T03:04:50.277348+0000","last_unstale":"2024-04-19T03:05:19.714216+0000","last_undegraded":"2024-04-19T03:05:19.714216+0000","last_fullsized":"2024-04-19T03:05:19.714216+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"81'3","reported_seq":69,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:52.394857+0000","last_change":"2024-04-19T03:05:52.395104+0000","last_active":"2024-04-19T03:05:52.394857+0000","last_peered":"2024-04-19T03:05:52.394857+0000","last_clean":"2024-04-19T03:05:52.394857+0000","last_became_active":"2024-04-19T03:05:02.363167+0000","last_became_peered":"2024-04-19T03:05:02.363167+0000","last_unstale":"2024-04-19T03:05:52.394857+0000","last_undegraded":"2024-04-19T03:05:52.394857+0000","last_fullsized":"2024-04-19T03:05:52.394857+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'3","last_scrub_stamp":"2024-04-19T03:05:52.394809+0000","last_deep_scrub":"81'3","last_deep_scrub_stamp":"2024-04-19T03:05:52.394809+0000","last_clean_scrub_stamp":"2024-04-19T03:05:52.394809+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:49:24.829905+0000","scrub_duration":0.0064588550000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":90,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:22.325552+0000","last_change":"2024-04-19T03:05:22.325552+0000","last_active":"2024-04-19T03:05:22.325552+0000","last_peered":"2024-04-19T03:05:22.325552+0000","last_clean":"2024-04-19T03:05:22.325552+0000","last_became_active":"2024-04-19T03:05:09.393975+0000","last_became_peered":"2024-04-19T03:05:09.393975+0000","last_unstale":"2024-04-19T03:05:22.325552+0000","last_undegraded":"2024-04-19T03:05:22.325552+0000","last_fullsized":"2024-04-19T03:05:22.325552+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:05:22.325265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:05:22.325265+0000","last_clean_scrub_stamp":"2024-04-19T03:05:22.325265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:46:17.944097+0000","scrub_duration":0.022749259000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"20'1","reported_seq":33,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:12.769806+0000","last_change":"2024-04-19T03:04:50.627670+0000","last_active":"2024-04-19T03:05:12.769806+0000","last_peered":"2024-04-19T03:05:12.769806+0000","last_clean":"2024-04-19T03:05:12.769806+0000","last_became_active":"2024-04-19T03:04:50.627304+0000","last_became_peered":"2024-04-19T03:04:50.627304+0000","last_unstale":"2024-04-19T03:05:12.769806+0000","last_undegraded":"2024-04-19T03:05:12.769806+0000","last_fullsized":"2024-04-19T03:05:12.769806+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":86,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:19.714259+0000","last_change":"2024-04-19T03:04:50.279334+0000","last_active":"2024-04-19T03:05:19.714259+0000","last_peered":"2024-04-19T03:05:19.714259+0000","last_clean":"2024-04-19T03:05:19.714259+0000","last_became_active":"2024-04-19T03:04:50.278874+0000","last_became_peered":"2024-04-19T03:04:50.278874+0000","last_unstale":"2024-04-19T03:05:19.714259+0000","last_undegraded":"2024-04-19T03:05:19.714259+0000","last_fullsized":"2024-04-19T03:05:19.714259+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"81'6","reported_seq":46,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:54.008711+0000","last_change":"2024-04-19T03:05:54.009000+0000","last_active":"2024-04-19T03:05:54.008711+0000","last_peered":"2024-04-19T03:05:54.008711+0000","last_clean":"2024-04-19T03:05:54.008711+0000","last_became_active":"2024-04-19T03:04:50.626334+0000","last_became_peered":"2024-04-19T03:04:50.626334+0000","last_unstale":"2024-04-19T03:05:54.008711+0000","last_undegraded":"2024-04-19T03:05:54.008711+0000","last_fullsized":"2024-04-19T03:05:54.008711+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'6","last_scrub_stamp":"2024-04-19T03:05:54.008658+0000","last_deep_scrub":"81'6","last_deep_scrub_stamp":"2024-04-19T03:05:54.008658+0000","last_clean_scrub_stamp":"2024-04-19T03:05:54.008658+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:39:11.277372+0000","scrub_duration":0.0079365890000000008,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5289,"internal_metadata":0},"log_size":48,"ondisk_log_size":48,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":14482,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":10,"seq":42949673029,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":224804,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":223870,"kb_avail":94147036,"statfs":{"total":96636764160,"available":96406564864,"internally_reserved":0,"allocated":946176,"data_stored":929795,"data_compressed":7241,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":229243334},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 19 03:05:49 2024","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.63900000000000001}]},{"osd":1,"last update":"Fri Apr 19 03:05:16 2024","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.56699999999999995,"15min":0.55500000000000005},"min":{"1min":0.53600000000000003,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.76900000000000002,"5min":2.5030000000000001,"15min":2.5030000000000001},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.628,"5min":0.58399999999999996,"15min":0.56699999999999995},"min":{"1min":0.54700000000000004,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.74199999999999999,"5min":2.6379999999999999,"15min":2.6379999999999999},"last":0.58899999999999997}]}]},{"osd":1,"up_from":10,"seq":42949673028,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":202656,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":201726,"kb_avail":94169184,"statfs":{"total":96636764160,"available":96429244416,"internally_reserved":0,"allocated":942080,"data_stored":931342,"data_compressed":7241,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":206567878},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 19 03:05:50 2024","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.60599999999999998}]},{"osd":2,"last update":"Fri Apr 19 03:06:10 2024","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.53700000000000003,"15min":0.52000000000000002},"min":{"1min":0.59999999999999998,"5min":0.224,"15min":0.224},"max":{"1min":0.81599999999999995,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.628},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.54400000000000004,"15min":0.53400000000000003},"min":{"1min":0.60399999999999998,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.94899999999999995,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.72299999999999998}]}]},{"osd":0,"up_from":71,"seq":304942678036,"num_pgs":73,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47704,"kb_used_data":848,"kb_used_omap":6,"kb_used_meta":46841,"kb_avail":94324136,"statfs":{"total":96636764160,"available":96587915264,"internally_reserved":0,"allocated":868352,"data_stored":339844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6883,"internal_metadata":47965469},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Apr 19 03:05:51 2024","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.69699999999999995}]},{"osd":2,"last update":"Fri Apr 19 03:05:51 2024","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.64500000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":7241,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":7241,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5289,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-19T03:06:21.104 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-04-19T03:01:14.615919+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=14, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:06:21.104 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-04-19T03:01:14.615919+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=14, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:06:21.104 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-04-19T03:01:14.615919+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=14, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:06:21.104 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-04-19T03:01:14.615919+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=14, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:06:21.104 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-04-19T03:01:14.615919+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=14, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:06:21.104 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-04-19T03:01:14.615919+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=14, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:06:21.105 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-04-19T03:01:14.615919+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=14, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:06:21.105 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-04-19T03:01:14.615919+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=14, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:06:21.105 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-04-19T03:01:14.615919+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=14, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:06:21.105 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-04-19T03:01:14.615919+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=14, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:06:21.105 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-04-19T03:01:14.615919+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=14, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:06:21.105 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-04-19T03:01:14.615919+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=14, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:06:21.105 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-04-19T03:01:13.604133+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=13, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:06:21.105 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-04-19T03:01:14.615919+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=14, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:06:21.106 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-04-19T03:01:13.604133+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=13, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:06:21.106 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-04-19T03:01:13.604133+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=13, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:06:21.106 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-04-19T03:01:13.604133+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=13, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:06:21.106 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-04-19T03:01:13.604133+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=13, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:06:21.106 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-04-19T03:01:13.604133+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=13, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:06:21.106 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-04-19T03:01:13.604133+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=13, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:06:21.106 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-04-19T03:01:13.604133+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=13, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:06:21.106 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-04-19T03:01:14.615919+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=14, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:06:21.107 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-04-19T03:01:13.604133+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=13, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:06:21.107 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-04-19T03:01:14.615919+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=14, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:06:21.107 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-04-19T03:01:13.604133+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=13, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:06:21.107 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-04-19T03:01:06.516863+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=6, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:06:21.107 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-04-19T03:01:09.578660+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=9, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:06:21.107 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-04-19T03:01:13.604133+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=13, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:06:21.107 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-04-19T03:01:09.578660+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=9, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:06:21.107 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-04-19T03:01:13.604133+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=13, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:06:21.108 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-04-19T03:01:09.578660+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=9, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:06:21.108 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-04-19T03:01:13.604133+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=13, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:06:21.108 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-04-19T03:01:09.578660+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=9, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:06:21.108 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-04-19T03:01:14.615919+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=14, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:06:21.108 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-04-19T03:01:09.578660+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=9, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:06:21.108 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-04-19T03:01:14.615919+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=14, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:06:21.108 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-04-19T03:01:14.615919+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=14, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:06:21.108 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-04-19T03:01:13.604133+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=13, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:06:21.109 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-04-19T03:01:14.615919+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=14, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:06:21.109 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-04-19T03:01:14.615919+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=14, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:06:21.109 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-04-19T03:01:14.615919+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=14, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:06:21.109 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-04-19T03:01:13.604133+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=13, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:06:21.109 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-04-19T03:01:14.615919+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=14, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:06:21.109 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-04-19T03:01:13.604133+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=13, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:06:21.109 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-04-19T03:01:14.615919+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=14, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:06:21.109 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-19T03:06:41.111 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-19T03:06:41.439 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-19T03:06:41.441 INFO:teuthology.orchestra.run.smithi096.stderr:dumped all 2024-04-19T03:06:41.453 INFO:teuthology.orchestra.run.smithi096.stdout:{"pg_ready":true,"pg_map":{"version":245,"stamp":"2024-04-19T03:06:40.082022+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":212,"ondisk_log_size":212,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":479260,"kb_used_data":2692,"kb_used_omap":9,"kb_used_meta":476534,"kb_avail":282636260,"statfs":{"total":289910292480,"available":289419530240,"internally_reserved":0,"allocated":2756608,"data_stored":2200981,"data_compressed":14482,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":10071,"internal_metadata":487970985},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004168"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":79,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:19.241382+0000","last_change":"2024-04-19T03:05:09.396661+0000","last_active":"2024-04-19T03:05:19.241382+0000","last_peered":"2024-04-19T03:05:19.241382+0000","last_clean":"2024-04-19T03:05:19.241382+0000","last_became_active":"2024-04-19T03:05:09.396279+0000","last_became_peered":"2024-04-19T03:05:09.396279+0000","last_unstale":"2024-04-19T03:05:19.241382+0000","last_undegraded":"2024-04-19T03:05:19.241382+0000","last_fullsized":"2024-04-19T03:05:19.241382+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":86,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:19.241391+0000","last_change":"2024-04-19T03:04:50.278334+0000","last_active":"2024-04-19T03:05:19.241391+0000","last_peered":"2024-04-19T03:05:19.241391+0000","last_clean":"2024-04-19T03:05:19.241391+0000","last_became_active":"2024-04-19T03:04:50.277848+0000","last_became_peered":"2024-04-19T03:04:50.277848+0000","last_unstale":"2024-04-19T03:05:19.241391+0000","last_undegraded":"2024-04-19T03:05:19.241391+0000","last_fullsized":"2024-04-19T03:05:19.241391+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":84,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:06:04.985436+0000","last_change":"2024-04-19T03:06:04.985743+0000","last_active":"2024-04-19T03:06:04.985436+0000","last_peered":"2024-04-19T03:06:04.985436+0000","last_clean":"2024-04-19T03:06:04.985436+0000","last_became_active":"2024-04-19T03:01:15.014599+0000","last_became_peered":"2024-04-19T03:01:15.014599+0000","last_unstale":"2024-04-19T03:06:04.985436+0000","last_undegraded":"2024-04-19T03:06:04.985436+0000","last_fullsized":"2024-04-19T03:06:04.985436+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:06:04.985390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:06:04.985390+0000","last_clean_scrub_stamp":"2024-04-19T03:06:04.985390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:34:15.507303+0000","scrub_duration":0.0034078440000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":97,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:49.097798+0000","last_change":"2024-04-19T03:05:49.098069+0000","last_active":"2024-04-19T03:05:49.097798+0000","last_peered":"2024-04-19T03:05:49.097798+0000","last_clean":"2024-04-19T03:05:49.097798+0000","last_became_active":"2024-04-19T03:04:50.274600+0000","last_became_peered":"2024-04-19T03:04:50.274600+0000","last_unstale":"2024-04-19T03:05:49.097798+0000","last_undegraded":"2024-04-19T03:05:49.097798+0000","last_fullsized":"2024-04-19T03:05:49.097798+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:05:49.097746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:05:49.097746+0000","last_clean_scrub_stamp":"2024-04-19T03:05:49.097746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:07:18.276599+0000","scrub_duration":0.0032259770000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":90,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:39.452420+0000","last_change":"2024-04-19T03:05:39.452420+0000","last_active":"2024-04-19T03:05:39.452420+0000","last_peered":"2024-04-19T03:05:39.452420+0000","last_clean":"2024-04-19T03:05:39.452420+0000","last_became_active":"2024-04-19T03:05:09.395929+0000","last_became_peered":"2024-04-19T03:05:09.395929+0000","last_unstale":"2024-04-19T03:05:39.452420+0000","last_undegraded":"2024-04-19T03:05:39.452420+0000","last_fullsized":"2024-04-19T03:05:39.452420+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:05:39.452007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:05:39.452007+0000","last_clean_scrub_stamp":"2024-04-19T03:05:39.452007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:45:27.478454+0000","scrub_duration":0.026485411,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":83,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:06:06.951780+0000","last_change":"2024-04-19T03:06:06.951780+0000","last_active":"2024-04-19T03:06:06.951780+0000","last_peered":"2024-04-19T03:06:06.951780+0000","last_clean":"2024-04-19T03:06:06.951780+0000","last_became_active":"2024-04-19T03:05:11.426617+0000","last_became_peered":"2024-04-19T03:05:11.426617+0000","last_unstale":"2024-04-19T03:06:06.951780+0000","last_undegraded":"2024-04-19T03:06:06.951780+0000","last_fullsized":"2024-04-19T03:06:06.951780+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:06:06.951457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:06:06.951457+0000","last_clean_scrub_stamp":"2024-04-19T03:06:06.951457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:57:21.385487+0000","scrub_duration":0.0032635160000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":72,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:19.714785+0000","last_change":"2024-04-19T03:05:11.424581+0000","last_active":"2024-04-19T03:05:19.714785+0000","last_peered":"2024-04-19T03:05:19.714785+0000","last_clean":"2024-04-19T03:05:19.714785+0000","last_became_active":"2024-04-19T03:05:11.422727+0000","last_became_peered":"2024-04-19T03:05:11.422727+0000","last_unstale":"2024-04-19T03:05:19.714785+0000","last_undegraded":"2024-04-19T03:05:19.714785+0000","last_fullsized":"2024-04-19T03:05:19.714785+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":97,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:54.075857+0000","last_change":"2024-04-19T03:05:54.075857+0000","last_active":"2024-04-19T03:05:54.075857+0000","last_peered":"2024-04-19T03:05:54.075857+0000","last_clean":"2024-04-19T03:05:54.075857+0000","last_became_active":"2024-04-19T03:04:50.261155+0000","last_became_peered":"2024-04-19T03:04:50.261155+0000","last_unstale":"2024-04-19T03:05:54.075857+0000","last_undegraded":"2024-04-19T03:05:54.075857+0000","last_fullsized":"2024-04-19T03:05:54.075857+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:05:54.075422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:05:54.075422+0000","last_clean_scrub_stamp":"2024-04-19T03:05:54.075422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:12:16.121405+0000","scrub_duration":0.0036127419999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":41,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:23.156874+0000","last_change":"2024-04-19T03:05:23.156992+0000","last_active":"2024-04-19T03:05:23.156874+0000","last_peered":"2024-04-19T03:05:23.156874+0000","last_clean":"2024-04-19T03:05:23.156874+0000","last_became_active":"2024-04-19T03:04:50.611400+0000","last_became_peered":"2024-04-19T03:04:50.611400+0000","last_unstale":"2024-04-19T03:05:23.156874+0000","last_undegraded":"2024-04-19T03:05:23.156874+0000","last_fullsized":"2024-04-19T03:05:23.156874+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:05:23.156852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:05:23.156852+0000","last_clean_scrub_stamp":"2024-04-19T03:05:23.156852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:00:45.201755+0000","scrub_duration":0.036684305,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":86,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:19.241317+0000","last_change":"2024-04-19T03:04:50.278337+0000","last_active":"2024-04-19T03:05:19.241317+0000","last_peered":"2024-04-19T03:05:19.241317+0000","last_clean":"2024-04-19T03:05:19.241317+0000","last_became_active":"2024-04-19T03:04:50.277899+0000","last_became_peered":"2024-04-19T03:04:50.277899+0000","last_unstale":"2024-04-19T03:05:19.241317+0000","last_undegraded":"2024-04-19T03:05:19.241317+0000","last_fullsized":"2024-04-19T03:05:19.241317+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":72,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:19.714661+0000","last_change":"2024-04-19T03:05:11.430574+0000","last_active":"2024-04-19T03:05:19.714661+0000","last_peered":"2024-04-19T03:05:19.714661+0000","last_clean":"2024-04-19T03:05:19.714661+0000","last_became_active":"2024-04-19T03:05:11.430243+0000","last_became_peered":"2024-04-19T03:05:11.430243+0000","last_unstale":"2024-04-19T03:05:19.714661+0000","last_undegraded":"2024-04-19T03:05:19.714661+0000","last_fullsized":"2024-04-19T03:05:19.714661+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":62,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:30.443577+0000","last_change":"2024-04-19T03:05:30.443804+0000","last_active":"2024-04-19T03:05:30.443577+0000","last_peered":"2024-04-19T03:05:30.443577+0000","last_clean":"2024-04-19T03:05:30.443577+0000","last_became_active":"2024-04-19T03:05:09.392822+0000","last_became_peered":"2024-04-19T03:05:09.392822+0000","last_unstale":"2024-04-19T03:05:30.443577+0000","last_undegraded":"2024-04-19T03:05:30.443577+0000","last_fullsized":"2024-04-19T03:05:30.443577+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:05:30.443531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:05:30.443531+0000","last_clean_scrub_stamp":"2024-04-19T03:05:30.443531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:43:21.406385+0000","scrub_duration":0.0030470290000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":79,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:19.241308+0000","last_change":"2024-04-19T03:05:09.397000+0000","last_active":"2024-04-19T03:05:19.241308+0000","last_peered":"2024-04-19T03:05:19.241308+0000","last_clean":"2024-04-19T03:05:19.241308+0000","last_became_active":"2024-04-19T03:05:09.395749+0000","last_became_peered":"2024-04-19T03:05:09.395749+0000","last_unstale":"2024-04-19T03:05:19.241308+0000","last_undegraded":"2024-04-19T03:05:19.241308+0000","last_fullsized":"2024-04-19T03:05:19.241308+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":84,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:50.122363+0000","last_change":"2024-04-19T03:05:50.122363+0000","last_active":"2024-04-19T03:05:50.122363+0000","last_peered":"2024-04-19T03:05:50.122363+0000","last_clean":"2024-04-19T03:05:50.122363+0000","last_became_active":"2024-04-19T03:01:15.010472+0000","last_became_peered":"2024-04-19T03:01:15.010472+0000","last_unstale":"2024-04-19T03:05:50.122363+0000","last_undegraded":"2024-04-19T03:05:50.122363+0000","last_fullsized":"2024-04-19T03:05:50.122363+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:05:50.122017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:05:50.122017+0000","last_clean_scrub_stamp":"2024-04-19T03:05:50.122017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:38:58.698089+0000","scrub_duration":0.0034044829999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":86,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:06:14.987825+0000","last_change":"2024-04-19T03:06:14.988052+0000","last_active":"2024-04-19T03:06:14.987825+0000","last_peered":"2024-04-19T03:06:14.987825+0000","last_clean":"2024-04-19T03:06:14.987825+0000","last_became_active":"2024-04-19T03:05:11.425921+0000","last_became_peered":"2024-04-19T03:05:11.425921+0000","last_unstale":"2024-04-19T03:06:14.987825+0000","last_undegraded":"2024-04-19T03:06:14.987825+0000","last_fullsized":"2024-04-19T03:06:14.987825+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:06:14.987781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:06:14.987781+0000","last_clean_scrub_stamp":"2024-04-19T03:06:14.987781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:38:20.700993+0000","scrub_duration":0.0031418100000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":83,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:39.150013+0000","last_change":"2024-04-19T03:05:39.150013+0000","last_active":"2024-04-19T03:05:39.150013+0000","last_peered":"2024-04-19T03:05:39.150013+0000","last_clean":"2024-04-19T03:05:39.150013+0000","last_became_active":"2024-04-19T03:05:11.425921+0000","last_became_peered":"2024-04-19T03:05:11.425921+0000","last_unstale":"2024-04-19T03:05:39.150013+0000","last_undegraded":"2024-04-19T03:05:39.150013+0000","last_fullsized":"2024-04-19T03:05:39.150013+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:05:39.149625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:05:39.149625+0000","last_clean_scrub_stamp":"2024-04-19T03:05:39.149625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:18:40.192906+0000","scrub_duration":0.0038324209999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":41,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:49.126663+0000","last_change":"2024-04-19T03:05:49.126778+0000","last_active":"2024-04-19T03:05:49.126663+0000","last_peered":"2024-04-19T03:05:49.126663+0000","last_clean":"2024-04-19T03:05:49.126663+0000","last_became_active":"2024-04-19T03:04:50.611392+0000","last_became_peered":"2024-04-19T03:04:50.611392+0000","last_unstale":"2024-04-19T03:05:49.126663+0000","last_undegraded":"2024-04-19T03:05:49.126663+0000","last_fullsized":"2024-04-19T03:05:49.126663+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:05:49.126640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:05:49.126640+0000","last_clean_scrub_stamp":"2024-04-19T03:05:49.126640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:45:17.738767+0000","scrub_duration":0.087429018999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":90,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:19.348906+0000","last_change":"2024-04-19T03:05:19.348906+0000","last_active":"2024-04-19T03:05:19.348906+0000","last_peered":"2024-04-19T03:05:19.348906+0000","last_clean":"2024-04-19T03:05:19.348906+0000","last_became_active":"2024-04-19T03:05:09.395682+0000","last_became_peered":"2024-04-19T03:05:09.395682+0000","last_unstale":"2024-04-19T03:05:19.348906+0000","last_undegraded":"2024-04-19T03:05:19.348906+0000","last_fullsized":"2024-04-19T03:05:19.348906+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:05:19.348599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:05:19.348599+0000","last_clean_scrub_stamp":"2024-04-19T03:05:19.348599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:22:58.194899+0000","scrub_duration":0.0032195190000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":41,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:06:00.979479+0000","last_change":"2024-04-19T03:06:00.979616+0000","last_active":"2024-04-19T03:06:00.979479+0000","last_peered":"2024-04-19T03:06:00.979479+0000","last_clean":"2024-04-19T03:06:00.979479+0000","last_became_active":"2024-04-19T03:04:50.613481+0000","last_became_peered":"2024-04-19T03:04:50.613481+0000","last_unstale":"2024-04-19T03:06:00.979479+0000","last_undegraded":"2024-04-19T03:06:00.979479+0000","last_fullsized":"2024-04-19T03:06:00.979479+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:06:00.979457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:06:00.979457+0000","last_clean_scrub_stamp":"2024-04-19T03:06:00.979457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:40:54.944550+0000","scrub_duration":0.035927225,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":88,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:19.714585+0000","last_change":"2024-04-19T03:05:11.431719+0000","last_active":"2024-04-19T03:05:19.714585+0000","last_peered":"2024-04-19T03:05:19.714585+0000","last_clean":"2024-04-19T03:05:19.714585+0000","last_became_active":"2024-04-19T03:05:11.431352+0000","last_became_peered":"2024-04-19T03:05:11.431352+0000","last_unstale":"2024-04-19T03:05:19.714585+0000","last_undegraded":"2024-04-19T03:05:19.714585+0000","last_fullsized":"2024-04-19T03:05:19.714585+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":97,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:06:13.000039+0000","last_change":"2024-04-19T03:06:13.000335+0000","last_active":"2024-04-19T03:06:13.000039+0000","last_peered":"2024-04-19T03:06:13.000039+0000","last_clean":"2024-04-19T03:06:13.000039+0000","last_became_active":"2024-04-19T03:04:50.275510+0000","last_became_peered":"2024-04-19T03:04:50.275510+0000","last_unstale":"2024-04-19T03:06:13.000039+0000","last_undegraded":"2024-04-19T03:06:13.000039+0000","last_fullsized":"2024-04-19T03:06:13.000039+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:06:12.999972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:06:12.999972+0000","last_clean_scrub_stamp":"2024-04-19T03:06:12.999972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:22:40.705332+0000","scrub_duration":0.036220484999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":84,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:06:34.444326+0000","last_change":"2024-04-19T03:06:34.444624+0000","last_active":"2024-04-19T03:06:34.444326+0000","last_peered":"2024-04-19T03:06:34.444326+0000","last_clean":"2024-04-19T03:06:34.444326+0000","last_became_active":"2024-04-19T03:01:15.018978+0000","last_became_peered":"2024-04-19T03:01:15.018978+0000","last_unstale":"2024-04-19T03:06:34.444326+0000","last_undegraded":"2024-04-19T03:06:34.444326+0000","last_fullsized":"2024-04-19T03:06:34.444326+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:06:34.444282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:06:34.444282+0000","last_clean_scrub_stamp":"2024-04-19T03:06:34.444282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:57:48.878312+0000","scrub_duration":0.0032201650000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":41,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:27.084506+0000","last_change":"2024-04-19T03:05:27.084833+0000","last_active":"2024-04-19T03:05:27.084506+0000","last_peered":"2024-04-19T03:05:27.084506+0000","last_clean":"2024-04-19T03:05:27.084506+0000","last_became_active":"2024-04-19T03:04:50.630948+0000","last_became_peered":"2024-04-19T03:04:50.630948+0000","last_unstale":"2024-04-19T03:05:27.084506+0000","last_undegraded":"2024-04-19T03:05:27.084506+0000","last_fullsized":"2024-04-19T03:05:27.084506+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:05:27.084457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:05:27.084457+0000","last_clean_scrub_stamp":"2024-04-19T03:05:27.084457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:43:47.014628+0000","scrub_duration":0.0031579899999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":79,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:19.241161+0000","last_change":"2024-04-19T03:05:09.391159+0000","last_active":"2024-04-19T03:05:19.241161+0000","last_peered":"2024-04-19T03:05:19.241161+0000","last_clean":"2024-04-19T03:05:19.241161+0000","last_became_active":"2024-04-19T03:05:09.390922+0000","last_became_peered":"2024-04-19T03:05:09.390922+0000","last_unstale":"2024-04-19T03:05:19.241161+0000","last_undegraded":"2024-04-19T03:05:19.241161+0000","last_fullsized":"2024-04-19T03:05:19.241161+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":62,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:21.387816+0000","last_change":"2024-04-19T03:05:21.387930+0000","last_active":"2024-04-19T03:05:21.387816+0000","last_peered":"2024-04-19T03:05:21.387816+0000","last_clean":"2024-04-19T03:05:21.387816+0000","last_became_active":"2024-04-19T03:05:09.393108+0000","last_became_peered":"2024-04-19T03:05:09.393108+0000","last_unstale":"2024-04-19T03:05:21.387816+0000","last_undegraded":"2024-04-19T03:05:21.387816+0000","last_fullsized":"2024-04-19T03:05:21.387816+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:05:21.387796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:05:21.387796+0000","last_clean_scrub_stamp":"2024-04-19T03:05:21.387796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:19:53.306617+0000","scrub_duration":0.042477411999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":41,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:06:33.811270+0000","last_change":"2024-04-19T03:06:33.811525+0000","last_active":"2024-04-19T03:06:33.811270+0000","last_peered":"2024-04-19T03:06:33.811270+0000","last_clean":"2024-04-19T03:06:33.811270+0000","last_became_active":"2024-04-19T03:04:50.617603+0000","last_became_peered":"2024-04-19T03:04:50.617603+0000","last_unstale":"2024-04-19T03:06:33.811270+0000","last_undegraded":"2024-04-19T03:06:33.811270+0000","last_fullsized":"2024-04-19T03:06:33.811270+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:06:33.811226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:06:33.811226+0000","last_clean_scrub_stamp":"2024-04-19T03:06:33.811226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:21:48.264717+0000","scrub_duration":0.0037391880000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":39,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:13.201146+0000","last_change":"2024-04-19T03:05:11.431713+0000","last_active":"2024-04-19T03:05:13.201146+0000","last_peered":"2024-04-19T03:05:13.201146+0000","last_clean":"2024-04-19T03:05:13.201146+0000","last_became_active":"2024-04-19T03:05:11.431129+0000","last_became_peered":"2024-04-19T03:05:11.431129+0000","last_unstale":"2024-04-19T03:05:13.201146+0000","last_undegraded":"2024-04-19T03:05:13.201146+0000","last_fullsized":"2024-04-19T03:05:13.201146+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":84,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:06:32.430270+0000","last_change":"2024-04-19T03:06:32.430512+0000","last_active":"2024-04-19T03:06:32.430270+0000","last_peered":"2024-04-19T03:06:32.430270+0000","last_clean":"2024-04-19T03:06:32.430270+0000","last_became_active":"2024-04-19T03:01:15.019064+0000","last_became_peered":"2024-04-19T03:01:15.019064+0000","last_unstale":"2024-04-19T03:06:32.430270+0000","last_undegraded":"2024-04-19T03:06:32.430270+0000","last_fullsized":"2024-04-19T03:06:32.430270+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:06:32.430223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:06:32.430223+0000","last_clean_scrub_stamp":"2024-04-19T03:06:32.430223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:34:42.952137+0000","scrub_duration":0.0035361289999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":41,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:06:07.960609+0000","last_change":"2024-04-19T03:06:07.960749+0000","last_active":"2024-04-19T03:06:07.960609+0000","last_peered":"2024-04-19T03:06:07.960609+0000","last_clean":"2024-04-19T03:06:07.960609+0000","last_became_active":"2024-04-19T03:04:50.616550+0000","last_became_peered":"2024-04-19T03:04:50.616550+0000","last_unstale":"2024-04-19T03:06:07.960609+0000","last_undegraded":"2024-04-19T03:06:07.960609+0000","last_fullsized":"2024-04-19T03:06:07.960609+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:06:07.960587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:06:07.960587+0000","last_clean_scrub_stamp":"2024-04-19T03:06:07.960587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:55:45.489295+0000","scrub_duration":0.038393915000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":62,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:41.381935+0000","last_change":"2024-04-19T03:05:41.382171+0000","last_active":"2024-04-19T03:05:41.381935+0000","last_peered":"2024-04-19T03:05:41.381935+0000","last_clean":"2024-04-19T03:05:41.381935+0000","last_became_active":"2024-04-19T03:05:09.393178+0000","last_became_peered":"2024-04-19T03:05:09.393178+0000","last_unstale":"2024-04-19T03:05:41.381935+0000","last_undegraded":"2024-04-19T03:05:41.381935+0000","last_fullsized":"2024-04-19T03:05:41.381935+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:05:41.381892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:05:41.381892+0000","last_clean_scrub_stamp":"2024-04-19T03:05:41.381892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:26:44.553697+0000","scrub_duration":0.0032496449999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":41,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:40.160084+0000","last_change":"2024-04-19T03:05:40.160372+0000","last_active":"2024-04-19T03:05:40.160084+0000","last_peered":"2024-04-19T03:05:40.160084+0000","last_clean":"2024-04-19T03:05:40.160084+0000","last_became_active":"2024-04-19T03:04:50.633033+0000","last_became_peered":"2024-04-19T03:04:50.633033+0000","last_unstale":"2024-04-19T03:05:40.160084+0000","last_undegraded":"2024-04-19T03:05:40.160084+0000","last_fullsized":"2024-04-19T03:05:40.160084+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:05:40.160035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:05:40.160035+0000","last_clean_scrub_stamp":"2024-04-19T03:05:40.160035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:22:24.075162+0000","scrub_duration":0.0035144400000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":97,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:45.098945+0000","last_change":"2024-04-19T03:05:45.099168+0000","last_active":"2024-04-19T03:05:45.098945+0000","last_peered":"2024-04-19T03:05:45.098945+0000","last_clean":"2024-04-19T03:05:45.098945+0000","last_became_active":"2024-04-19T03:04:50.278996+0000","last_became_peered":"2024-04-19T03:04:50.278996+0000","last_unstale":"2024-04-19T03:05:45.098945+0000","last_undegraded":"2024-04-19T03:05:45.098945+0000","last_fullsized":"2024-04-19T03:05:45.098945+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:05:45.098897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:05:45.098897+0000","last_clean_scrub_stamp":"2024-04-19T03:05:45.098897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:59:51.710788+0000","scrub_duration":0.0034812490000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":90,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:34.468578+0000","last_change":"2024-04-19T03:05:34.468578+0000","last_active":"2024-04-19T03:05:34.468578+0000","last_peered":"2024-04-19T03:05:34.468578+0000","last_clean":"2024-04-19T03:05:34.468578+0000","last_became_active":"2024-04-19T03:05:09.395920+0000","last_became_peered":"2024-04-19T03:05:09.395920+0000","last_unstale":"2024-04-19T03:05:34.468578+0000","last_undegraded":"2024-04-19T03:05:34.468578+0000","last_fullsized":"2024-04-19T03:05:34.468578+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:05:34.468305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:05:34.468305+0000","last_clean_scrub_stamp":"2024-04-19T03:05:34.468305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:54:24.688379+0000","scrub_duration":0.003618422,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"20'2","reported_seq":89,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:19.713827+0000","last_change":"2024-04-19T03:04:50.277421+0000","last_active":"2024-04-19T03:05:19.713827+0000","last_peered":"2024-04-19T03:05:19.713827+0000","last_clean":"2024-04-19T03:05:19.713827+0000","last_became_active":"2024-04-19T03:04:50.276732+0000","last_became_peered":"2024-04-19T03:04:50.276732+0000","last_unstale":"2024-04-19T03:05:19.713827+0000","last_undegraded":"2024-04-19T03:05:19.713827+0000","last_fullsized":"2024-04-19T03:05:19.713827+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":79,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:19.240956+0000","last_change":"2024-04-19T03:05:09.395454+0000","last_active":"2024-04-19T03:05:19.240956+0000","last_peered":"2024-04-19T03:05:19.240956+0000","last_clean":"2024-04-19T03:05:19.240956+0000","last_became_active":"2024-04-19T03:05:09.394288+0000","last_became_peered":"2024-04-19T03:05:09.394288+0000","last_unstale":"2024-04-19T03:05:19.240956+0000","last_undegraded":"2024-04-19T03:05:19.240956+0000","last_fullsized":"2024-04-19T03:05:19.240956+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":42,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:06:25.884128+0000","last_change":"2024-04-19T03:06:25.884362+0000","last_active":"2024-04-19T03:06:25.884128+0000","last_peered":"2024-04-19T03:06:25.884128+0000","last_clean":"2024-04-19T03:06:25.884128+0000","last_became_active":"2024-04-19T03:04:50.628023+0000","last_became_peered":"2024-04-19T03:04:50.628023+0000","last_unstale":"2024-04-19T03:06:25.884128+0000","last_undegraded":"2024-04-19T03:06:25.884128+0000","last_fullsized":"2024-04-19T03:06:25.884128+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:06:25.884074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:06:25.884074+0000","last_clean_scrub_stamp":"2024-04-19T03:06:25.884074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:52:59.822891+0000","scrub_duration":0.003424585,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":41,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:22.156343+0000","last_change":"2024-04-19T03:05:22.156583+0000","last_active":"2024-04-19T03:05:22.156343+0000","last_peered":"2024-04-19T03:05:22.156343+0000","last_clean":"2024-04-19T03:05:22.156343+0000","last_became_active":"2024-04-19T03:04:50.613860+0000","last_became_peered":"2024-04-19T03:04:50.613860+0000","last_unstale":"2024-04-19T03:05:22.156343+0000","last_undegraded":"2024-04-19T03:05:22.156343+0000","last_fullsized":"2024-04-19T03:05:22.156343+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:05:22.156296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:05:22.156296+0000","last_clean_scrub_stamp":"2024-04-19T03:05:22.156296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:47:31.989944+0000","scrub_duration":0.0031789600000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":85,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:06:29.458856+0000","last_change":"2024-04-19T03:06:29.459075+0000","last_active":"2024-04-19T03:06:29.458856+0000","last_peered":"2024-04-19T03:06:29.458856+0000","last_clean":"2024-04-19T03:06:29.458856+0000","last_became_active":"2024-04-19T03:01:14.648217+0000","last_became_peered":"2024-04-19T03:01:14.648217+0000","last_unstale":"2024-04-19T03:06:29.458856+0000","last_undegraded":"2024-04-19T03:06:29.458856+0000","last_fullsized":"2024-04-19T03:06:29.458856+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:06:29.458807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:06:29.458807+0000","last_clean_scrub_stamp":"2024-04-19T03:06:29.458807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:06:55.513182+0000","scrub_duration":0.0031327,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":41,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:06:09.016060+0000","last_change":"2024-04-19T03:06:09.016173+0000","last_active":"2024-04-19T03:06:09.016060+0000","last_peered":"2024-04-19T03:06:09.016060+0000","last_clean":"2024-04-19T03:06:09.016060+0000","last_became_active":"2024-04-19T03:04:50.610659+0000","last_became_peered":"2024-04-19T03:04:50.610659+0000","last_unstale":"2024-04-19T03:06:09.016060+0000","last_undegraded":"2024-04-19T03:06:09.016060+0000","last_fullsized":"2024-04-19T03:06:09.016060+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:06:09.016037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:06:09.016037+0000","last_clean_scrub_stamp":"2024-04-19T03:06:09.016037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:53:27.685552+0000","scrub_duration":0.059919361999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"81'12","reported_seq":102,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:06:20.048514+0000","last_change":"2024-04-19T03:06:20.048753+0000","last_active":"2024-04-19T03:06:20.048514+0000","last_peered":"2024-04-19T03:06:20.048514+0000","last_clean":"2024-04-19T03:06:20.048514+0000","last_became_active":"2024-04-19T03:05:11.428668+0000","last_became_peered":"2024-04-19T03:05:11.428668+0000","last_unstale":"2024-04-19T03:06:20.048514+0000","last_undegraded":"2024-04-19T03:06:20.048514+0000","last_fullsized":"2024-04-19T03:06:20.048514+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'12","last_scrub_stamp":"2024-04-19T03:06:20.048463+0000","last_deep_scrub":"81'12","last_deep_scrub_stamp":"2024-04-19T03:06:20.048463+0000","last_clean_scrub_stamp":"2024-04-19T03:06:20.048463+0000","objects_scrubbed":4,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:09:17.651320+0000","scrub_duration":0.0095854819999999993,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"20'1","reported_seq":75,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:19.713750+0000","last_change":"2024-04-19T03:01:14.649839+0000","last_active":"2024-04-19T03:05:19.713750+0000","last_peered":"2024-04-19T03:05:19.713750+0000","last_clean":"2024-04-19T03:05:19.713750+0000","last_became_active":"2024-04-19T03:01:14.649571+0000","last_became_peered":"2024-04-19T03:01:14.649571+0000","last_unstale":"2024-04-19T03:05:19.713750+0000","last_undegraded":"2024-04-19T03:05:19.713750+0000","last_fullsized":"2024-04-19T03:05:19.713750+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":65,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:06:14.509847+0000","last_change":"2024-04-19T03:06:14.510089+0000","last_active":"2024-04-19T03:06:14.509847+0000","last_peered":"2024-04-19T03:06:14.509847+0000","last_clean":"2024-04-19T03:06:14.509847+0000","last_became_active":"2024-04-19T03:05:02.362227+0000","last_became_peered":"2024-04-19T03:05:02.362227+0000","last_unstale":"2024-04-19T03:06:14.509847+0000","last_undegraded":"2024-04-19T03:06:14.509847+0000","last_fullsized":"2024-04-19T03:06:14.509847+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:06:14.509801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:06:14.509801+0000","last_clean_scrub_stamp":"2024-04-19T03:06:14.509801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:30:22.470364+0000","scrub_duration":0.0034446279999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"81'3","reported_seq":88,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:06:20.473744+0000","last_change":"2024-04-19T03:06:20.474018+0000","last_active":"2024-04-19T03:06:20.473744+0000","last_peered":"2024-04-19T03:06:20.473744+0000","last_clean":"2024-04-19T03:06:20.473744+0000","last_became_active":"2024-04-19T03:01:14.644790+0000","last_became_peered":"2024-04-19T03:01:14.644790+0000","last_unstale":"2024-04-19T03:06:20.473744+0000","last_undegraded":"2024-04-19T03:06:20.473744+0000","last_fullsized":"2024-04-19T03:06:20.473744+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'3","last_scrub_stamp":"2024-04-19T03:06:20.473693+0000","last_deep_scrub":"81'3","last_deep_scrub_stamp":"2024-04-19T03:06:20.473693+0000","last_clean_scrub_stamp":"2024-04-19T03:06:20.473693+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:12:42.519676+0000","scrub_duration":0.0061567130000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":90,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:06:04.548975+0000","last_change":"2024-04-19T03:06:04.549223+0000","last_active":"2024-04-19T03:06:04.548975+0000","last_peered":"2024-04-19T03:06:04.548975+0000","last_clean":"2024-04-19T03:06:04.548975+0000","last_became_active":"2024-04-19T03:05:09.392736+0000","last_became_peered":"2024-04-19T03:05:09.392736+0000","last_unstale":"2024-04-19T03:06:04.548975+0000","last_undegraded":"2024-04-19T03:06:04.548975+0000","last_fullsized":"2024-04-19T03:06:04.548975+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:06:04.548929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:06:04.548929+0000","last_clean_scrub_stamp":"2024-04-19T03:06:04.548929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:15:59.783247+0000","scrub_duration":0.0033845059999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"20'1","reported_seq":41,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:13.201186+0000","last_change":"2024-04-19T03:05:11.431892+0000","last_active":"2024-04-19T03:05:13.201186+0000","last_peered":"2024-04-19T03:05:13.201186+0000","last_clean":"2024-04-19T03:05:13.201186+0000","last_became_active":"2024-04-19T03:05:11.431552+0000","last_became_peered":"2024-04-19T03:05:11.431552+0000","last_unstale":"2024-04-19T03:05:13.201186+0000","last_undegraded":"2024-04-19T03:05:13.201186+0000","last_fullsized":"2024-04-19T03:05:13.201186+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":97,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:06:05.975879+0000","last_change":"2024-04-19T03:06:05.976137+0000","last_active":"2024-04-19T03:06:05.975879+0000","last_peered":"2024-04-19T03:06:05.975879+0000","last_clean":"2024-04-19T03:06:05.975879+0000","last_became_active":"2024-04-19T03:04:50.277126+0000","last_became_peered":"2024-04-19T03:04:50.277126+0000","last_unstale":"2024-04-19T03:06:05.975879+0000","last_undegraded":"2024-04-19T03:06:05.975879+0000","last_fullsized":"2024-04-19T03:06:05.975879+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:06:05.975834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:06:05.975834+0000","last_clean_scrub_stamp":"2024-04-19T03:06:05.975834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:20:51.285647+0000","scrub_duration":0.003132653,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":73,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:19.713832+0000","last_change":"2024-04-19T03:05:11.429040+0000","last_active":"2024-04-19T03:05:19.713832+0000","last_peered":"2024-04-19T03:05:19.713832+0000","last_clean":"2024-04-19T03:05:19.713832+0000","last_became_active":"2024-04-19T03:05:11.428722+0000","last_became_peered":"2024-04-19T03:05:11.428722+0000","last_unstale":"2024-04-19T03:05:19.713832+0000","last_undegraded":"2024-04-19T03:05:19.713832+0000","last_fullsized":"2024-04-19T03:05:19.713832+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":41,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:06:37.889374+0000","last_change":"2024-04-19T03:06:37.889743+0000","last_active":"2024-04-19T03:06:37.889374+0000","last_peered":"2024-04-19T03:06:37.889374+0000","last_clean":"2024-04-19T03:06:37.889374+0000","last_became_active":"2024-04-19T03:04:50.625919+0000","last_became_peered":"2024-04-19T03:04:50.625919+0000","last_unstale":"2024-04-19T03:06:37.889374+0000","last_undegraded":"2024-04-19T03:06:37.889374+0000","last_fullsized":"2024-04-19T03:06:37.889374+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:06:37.889307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:06:37.889307+0000","last_clean_scrub_stamp":"2024-04-19T03:06:37.889307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:07:23.625279+0000","scrub_duration":0.033935805999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"81'3","reported_seq":45,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:06:29.761366+0000","last_change":"2024-04-19T03:06:29.761629+0000","last_active":"2024-04-19T03:06:29.761366+0000","last_peered":"2024-04-19T03:06:29.761366+0000","last_clean":"2024-04-19T03:06:29.761366+0000","last_became_active":"2024-04-19T03:04:50.625931+0000","last_became_peered":"2024-04-19T03:04:50.625931+0000","last_unstale":"2024-04-19T03:06:29.761366+0000","last_undegraded":"2024-04-19T03:06:29.761366+0000","last_fullsized":"2024-04-19T03:06:29.761366+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'3","last_scrub_stamp":"2024-04-19T03:06:29.761304+0000","last_deep_scrub":"81'3","last_deep_scrub_stamp":"2024-04-19T03:06:29.761304+0000","last_clean_scrub_stamp":"2024-04-19T03:06:29.761304+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:21:37.427888+0000","scrub_duration":0.0062219290000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":88,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:19.714149+0000","last_change":"2024-04-19T03:05:11.430496+0000","last_active":"2024-04-19T03:05:19.714149+0000","last_peered":"2024-04-19T03:05:19.714149+0000","last_clean":"2024-04-19T03:05:19.714149+0000","last_became_active":"2024-04-19T03:05:11.430149+0000","last_became_peered":"2024-04-19T03:05:11.430149+0000","last_unstale":"2024-04-19T03:05:19.714149+0000","last_undegraded":"2024-04-19T03:05:19.714149+0000","last_fullsized":"2024-04-19T03:05:19.714149+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":87,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:19.713774+0000","last_change":"2024-04-19T03:04:50.278491+0000","last_active":"2024-04-19T03:05:19.713774+0000","last_peered":"2024-04-19T03:05:19.713774+0000","last_clean":"2024-04-19T03:05:19.713774+0000","last_became_active":"2024-04-19T03:04:50.277603+0000","last_became_peered":"2024-04-19T03:04:50.277603+0000","last_unstale":"2024-04-19T03:05:19.713774+0000","last_undegraded":"2024-04-19T03:05:19.713774+0000","last_fullsized":"2024-04-19T03:05:19.713774+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":84,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:46.144344+0000","last_change":"2024-04-19T03:05:46.144560+0000","last_active":"2024-04-19T03:05:46.144344+0000","last_peered":"2024-04-19T03:05:46.144344+0000","last_clean":"2024-04-19T03:05:46.144344+0000","last_became_active":"2024-04-19T03:01:15.014847+0000","last_became_peered":"2024-04-19T03:01:15.014847+0000","last_unstale":"2024-04-19T03:05:46.144344+0000","last_undegraded":"2024-04-19T03:05:46.144344+0000","last_fullsized":"2024-04-19T03:05:46.144344+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:05:46.144300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:05:46.144300+0000","last_clean_scrub_stamp":"2024-04-19T03:05:46.144300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:43:25.191286+0000","scrub_duration":0.0032320750000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":63,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:42.387222+0000","last_change":"2024-04-19T03:05:42.387451+0000","last_active":"2024-04-19T03:05:42.387222+0000","last_peered":"2024-04-19T03:05:42.387222+0000","last_clean":"2024-04-19T03:05:42.387222+0000","last_became_active":"2024-04-19T03:05:09.391218+0000","last_became_peered":"2024-04-19T03:05:09.391218+0000","last_unstale":"2024-04-19T03:05:42.387222+0000","last_undegraded":"2024-04-19T03:05:42.387222+0000","last_fullsized":"2024-04-19T03:05:42.387222+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:05:42.387178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:05:42.387178+0000","last_clean_scrub_stamp":"2024-04-19T03:05:42.387178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:52:14.035747+0000","scrub_duration":0.003459981,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":84,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:06:01.981674+0000","last_change":"2024-04-19T03:06:01.981909+0000","last_active":"2024-04-19T03:06:01.981674+0000","last_peered":"2024-04-19T03:06:01.981674+0000","last_clean":"2024-04-19T03:06:01.981674+0000","last_became_active":"2024-04-19T03:01:15.014421+0000","last_became_peered":"2024-04-19T03:01:15.014421+0000","last_unstale":"2024-04-19T03:06:01.981674+0000","last_undegraded":"2024-04-19T03:06:01.981674+0000","last_fullsized":"2024-04-19T03:06:01.981674+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:06:01.981618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:06:01.981618+0000","last_clean_scrub_stamp":"2024-04-19T03:06:01.981618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:06:28.035993+0000","scrub_duration":0.0033942379999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":91,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:50.475678+0000","last_change":"2024-04-19T03:05:50.475892+0000","last_active":"2024-04-19T03:05:50.475678+0000","last_peered":"2024-04-19T03:05:50.475678+0000","last_clean":"2024-04-19T03:05:50.475678+0000","last_became_active":"2024-04-19T03:05:09.395294+0000","last_became_peered":"2024-04-19T03:05:09.395294+0000","last_unstale":"2024-04-19T03:05:50.475678+0000","last_undegraded":"2024-04-19T03:05:50.475678+0000","last_fullsized":"2024-04-19T03:05:50.475678+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:05:50.475630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:05:50.475630+0000","last_clean_scrub_stamp":"2024-04-19T03:05:50.475630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:03:15.099595+0000","scrub_duration":0.0034712469999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":41,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:50.148906+0000","last_change":"2024-04-19T03:05:50.149020+0000","last_active":"2024-04-19T03:05:50.148906+0000","last_peered":"2024-04-19T03:05:50.148906+0000","last_clean":"2024-04-19T03:05:50.148906+0000","last_became_active":"2024-04-19T03:04:50.617323+0000","last_became_peered":"2024-04-19T03:04:50.617323+0000","last_unstale":"2024-04-19T03:05:50.148906+0000","last_undegraded":"2024-04-19T03:05:50.148906+0000","last_fullsized":"2024-04-19T03:05:50.148906+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:05:50.148885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:05:50.148885+0000","last_clean_scrub_stamp":"2024-04-19T03:05:50.148885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:47:33.437890+0000","scrub_duration":0.061933355000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"14'157","reported_seq":280,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:13.200849+0000","last_change":"2024-04-19T03:05:11.429096+0000","last_active":"2024-04-19T03:05:13.200849+0000","last_peered":"2024-04-19T03:05:13.200849+0000","last_clean":"2024-04-19T03:05:13.200849+0000","last_became_active":"2024-04-19T03:05:11.426859+0000","last_became_peered":"2024-04-19T03:05:11.426859+0000","last_unstale":"2024-04-19T03:05:13.200849+0000","last_undegraded":"2024-04-19T03:05:13.200849+0000","last_fullsized":"2024-04-19T03:05:13.200849+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:06.516863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:06.516863+0000","last_clean_scrub_stamp":"2024-04-19T03:01:06.516863+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":89,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:19.713590+0000","last_change":"2024-04-19T03:04:50.277227+0000","last_active":"2024-04-19T03:05:19.713590+0000","last_peered":"2024-04-19T03:05:19.713590+0000","last_clean":"2024-04-19T03:05:19.713590+0000","last_became_active":"2024-04-19T03:04:50.276132+0000","last_became_peered":"2024-04-19T03:04:50.276132+0000","last_unstale":"2024-04-19T03:05:19.713590+0000","last_undegraded":"2024-04-19T03:05:19.713590+0000","last_fullsized":"2024-04-19T03:05:19.713590+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_clean_scrub_stamp":"2024-04-19T03:01:09.578660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":31,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:12.768952+0000","last_change":"2024-04-19T03:04:50.629139+0000","last_active":"2024-04-19T03:05:12.768952+0000","last_peered":"2024-04-19T03:05:12.768952+0000","last_clean":"2024-04-19T03:05:12.768952+0000","last_became_active":"2024-04-19T03:04:50.628741+0000","last_became_peered":"2024-04-19T03:04:50.628741+0000","last_unstale":"2024-04-19T03:05:12.768952+0000","last_undegraded":"2024-04-19T03:05:12.768952+0000","last_fullsized":"2024-04-19T03:05:12.768952+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":86,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:37.209852+0000","last_change":"2024-04-19T03:05:37.210309+0000","last_active":"2024-04-19T03:05:37.209852+0000","last_peered":"2024-04-19T03:05:37.209852+0000","last_clean":"2024-04-19T03:05:37.209852+0000","last_became_active":"2024-04-19T03:05:11.430881+0000","last_became_peered":"2024-04-19T03:05:11.430881+0000","last_unstale":"2024-04-19T03:05:37.209852+0000","last_undegraded":"2024-04-19T03:05:37.209852+0000","last_fullsized":"2024-04-19T03:05:37.209852+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:05:37.209759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:05:37.209759+0000","last_clean_scrub_stamp":"2024-04-19T03:05:37.209759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:52:10.997951+0000","scrub_duration":0.0033919810000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":76,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:12.903561+0000","last_change":"2024-04-19T03:01:10.602194+0000","last_active":"2024-04-19T03:05:12.903561+0000","last_peered":"2024-04-19T03:05:12.903561+0000","last_clean":"2024-04-19T03:05:12.903561+0000","last_became_active":"2024-04-19T03:01:10.601381+0000","last_became_peered":"2024-04-19T03:01:10.601381+0000","last_unstale":"2024-04-19T03:05:12.903561+0000","last_undegraded":"2024-04-19T03:05:12.903561+0000","last_fullsized":"2024-04-19T03:05:12.903561+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_clean_scrub_stamp":"2024-04-19T03:01:09.578660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":42,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:58.945625+0000","last_change":"2024-04-19T03:05:58.945975+0000","last_active":"2024-04-19T03:05:58.945625+0000","last_peered":"2024-04-19T03:05:58.945625+0000","last_clean":"2024-04-19T03:05:58.945625+0000","last_became_active":"2024-04-19T03:04:50.631721+0000","last_became_peered":"2024-04-19T03:04:50.631721+0000","last_unstale":"2024-04-19T03:05:58.945625+0000","last_undegraded":"2024-04-19T03:05:58.945625+0000","last_fullsized":"2024-04-19T03:05:58.945625+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:05:58.945528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:05:58.945528+0000","last_clean_scrub_stamp":"2024-04-19T03:05:58.945528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:00:41.372378+0000","scrub_duration":0.0034170619999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":90,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:45.465307+0000","last_change":"2024-04-19T03:05:45.465610+0000","last_active":"2024-04-19T03:05:45.465307+0000","last_peered":"2024-04-19T03:05:45.465307+0000","last_clean":"2024-04-19T03:05:45.465307+0000","last_became_active":"2024-04-19T03:05:09.395167+0000","last_became_peered":"2024-04-19T03:05:09.395167+0000","last_unstale":"2024-04-19T03:05:45.465307+0000","last_undegraded":"2024-04-19T03:05:45.465307+0000","last_fullsized":"2024-04-19T03:05:45.465307+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:05:45.465258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:05:45.465258+0000","last_clean_scrub_stamp":"2024-04-19T03:05:45.465258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:21:36.562113+0000","scrub_duration":0.0030148670000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":41,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:19.154051+0000","last_change":"2024-04-19T03:05:19.169049+0000","last_active":"2024-04-19T03:05:19.154051+0000","last_peered":"2024-04-19T03:05:19.154051+0000","last_clean":"2024-04-19T03:05:19.154051+0000","last_became_active":"2024-04-19T03:04:50.633457+0000","last_became_peered":"2024-04-19T03:04:50.633457+0000","last_unstale":"2024-04-19T03:05:19.154051+0000","last_undegraded":"2024-04-19T03:05:19.154051+0000","last_fullsized":"2024-04-19T03:05:19.154051+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:05:19.154005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:05:19.154005+0000","last_clean_scrub_stamp":"2024-04-19T03:05:19.154005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:23:03.401654+0000","scrub_duration":0.0034373889999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":85,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:06:17.477003+0000","last_change":"2024-04-19T03:06:17.477233+0000","last_active":"2024-04-19T03:06:17.477003+0000","last_peered":"2024-04-19T03:06:17.477003+0000","last_clean":"2024-04-19T03:06:17.477003+0000","last_became_active":"2024-04-19T03:01:14.648082+0000","last_became_peered":"2024-04-19T03:01:14.648082+0000","last_unstale":"2024-04-19T03:06:17.477003+0000","last_undegraded":"2024-04-19T03:06:17.477003+0000","last_fullsized":"2024-04-19T03:06:17.477003+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:06:17.476956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:06:17.476956+0000","last_clean_scrub_stamp":"2024-04-19T03:06:17.476956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:39:26.053028+0000","scrub_duration":0.0037432979999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":41,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:34.130919+0000","last_change":"2024-04-19T03:05:34.131042+0000","last_active":"2024-04-19T03:05:34.130919+0000","last_peered":"2024-04-19T03:05:34.130919+0000","last_clean":"2024-04-19T03:05:34.130919+0000","last_became_active":"2024-04-19T03:04:50.617628+0000","last_became_peered":"2024-04-19T03:04:50.617628+0000","last_unstale":"2024-04-19T03:05:34.130919+0000","last_undegraded":"2024-04-19T03:05:34.130919+0000","last_fullsized":"2024-04-19T03:05:34.130919+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:05:34.130897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:05:34.130897+0000","last_clean_scrub_stamp":"2024-04-19T03:05:34.130897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:03:56.628506+0000","scrub_duration":0.037678018000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":89,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:19.713612+0000","last_change":"2024-04-19T03:04:50.278737+0000","last_active":"2024-04-19T03:05:19.713612+0000","last_peered":"2024-04-19T03:05:19.713612+0000","last_clean":"2024-04-19T03:05:19.713612+0000","last_became_active":"2024-04-19T03:04:50.277804+0000","last_became_peered":"2024-04-19T03:04:50.277804+0000","last_unstale":"2024-04-19T03:05:19.713612+0000","last_undegraded":"2024-04-19T03:05:19.713612+0000","last_fullsized":"2024-04-19T03:05:19.713612+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_clean_scrub_stamp":"2024-04-19T03:01:09.578660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":87,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:19.713697+0000","last_change":"2024-04-19T03:04:50.277141+0000","last_active":"2024-04-19T03:05:19.713697+0000","last_peered":"2024-04-19T03:05:19.713697+0000","last_clean":"2024-04-19T03:05:19.713697+0000","last_became_active":"2024-04-19T03:04:50.275812+0000","last_became_peered":"2024-04-19T03:04:50.275812+0000","last_unstale":"2024-04-19T03:05:19.713697+0000","last_undegraded":"2024-04-19T03:05:19.713697+0000","last_fullsized":"2024-04-19T03:05:19.713697+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":41,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:06:03.930170+0000","last_change":"2024-04-19T03:06:03.930425+0000","last_active":"2024-04-19T03:06:03.930170+0000","last_peered":"2024-04-19T03:06:03.930170+0000","last_clean":"2024-04-19T03:06:03.930170+0000","last_became_active":"2024-04-19T03:04:50.614774+0000","last_became_peered":"2024-04-19T03:04:50.614774+0000","last_unstale":"2024-04-19T03:06:03.930170+0000","last_undegraded":"2024-04-19T03:06:03.930170+0000","last_fullsized":"2024-04-19T03:06:03.930170+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:06:03.930122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:06:03.930122+0000","last_clean_scrub_stamp":"2024-04-19T03:06:03.930122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:28:52.187857+0000","scrub_duration":0.003163627,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":84,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:22.163334+0000","last_change":"2024-04-19T03:05:22.163334+0000","last_active":"2024-04-19T03:05:22.163334+0000","last_peered":"2024-04-19T03:05:22.163334+0000","last_clean":"2024-04-19T03:05:22.163334+0000","last_became_active":"2024-04-19T03:05:11.429941+0000","last_became_peered":"2024-04-19T03:05:11.429941+0000","last_unstale":"2024-04-19T03:05:22.163334+0000","last_undegraded":"2024-04-19T03:05:22.163334+0000","last_fullsized":"2024-04-19T03:05:22.163334+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:05:22.163031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:05:22.163031+0000","last_clean_scrub_stamp":"2024-04-19T03:05:22.163031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:21:13.259886+0000","scrub_duration":0.0032565699999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":41,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:26.113178+0000","last_change":"2024-04-19T03:05:26.113394+0000","last_active":"2024-04-19T03:05:26.113178+0000","last_peered":"2024-04-19T03:05:26.113178+0000","last_clean":"2024-04-19T03:05:26.113178+0000","last_became_active":"2024-04-19T03:04:50.614498+0000","last_became_peered":"2024-04-19T03:04:50.614498+0000","last_unstale":"2024-04-19T03:05:26.113178+0000","last_undegraded":"2024-04-19T03:05:26.113178+0000","last_fullsized":"2024-04-19T03:05:26.113178+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:05:26.113130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:05:26.113130+0000","last_clean_scrub_stamp":"2024-04-19T03:05:26.113130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:38:46.443254+0000","scrub_duration":0.0031920770000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":62,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:06:10.525215+0000","last_change":"2024-04-19T03:06:10.525475+0000","last_active":"2024-04-19T03:06:10.525215+0000","last_peered":"2024-04-19T03:06:10.525215+0000","last_clean":"2024-04-19T03:06:10.525215+0000","last_became_active":"2024-04-19T03:05:09.394024+0000","last_became_peered":"2024-04-19T03:05:09.394024+0000","last_unstale":"2024-04-19T03:06:10.525215+0000","last_undegraded":"2024-04-19T03:06:10.525215+0000","last_fullsized":"2024-04-19T03:06:10.525215+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:06:10.525171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:06:10.525171+0000","last_clean_scrub_stamp":"2024-04-19T03:06:10.525171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:00:17.137062+0000","scrub_duration":0.00337156,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":42,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:33.132538+0000","last_change":"2024-04-19T03:05:33.132791+0000","last_active":"2024-04-19T03:05:33.132538+0000","last_peered":"2024-04-19T03:05:33.132538+0000","last_clean":"2024-04-19T03:05:33.132538+0000","last_became_active":"2024-04-19T03:04:50.615238+0000","last_became_peered":"2024-04-19T03:04:50.615238+0000","last_unstale":"2024-04-19T03:05:33.132538+0000","last_undegraded":"2024-04-19T03:05:33.132538+0000","last_fullsized":"2024-04-19T03:05:33.132538+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:05:33.132481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:05:33.132481+0000","last_clean_scrub_stamp":"2024-04-19T03:05:33.132481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:12:12.823889+0000","scrub_duration":0.0033373280000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":83,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:19.240328+0000","last_change":"2024-04-19T03:05:09.397542+0000","last_active":"2024-04-19T03:05:19.240328+0000","last_peered":"2024-04-19T03:05:19.240328+0000","last_clean":"2024-04-19T03:05:19.240328+0000","last_became_active":"2024-04-19T03:05:09.396378+0000","last_became_peered":"2024-04-19T03:05:09.396378+0000","last_unstale":"2024-04-19T03:05:19.240328+0000","last_undegraded":"2024-04-19T03:05:19.240328+0000","last_fullsized":"2024-04-19T03:05:19.240328+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_clean_scrub_stamp":"2024-04-19T03:01:09.578660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":51,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:12.420654+0000","last_change":"2024-04-19T03:05:09.392910+0000","last_active":"2024-04-19T03:05:12.420654+0000","last_peered":"2024-04-19T03:05:12.420654+0000","last_clean":"2024-04-19T03:05:12.420654+0000","last_became_active":"2024-04-19T03:05:09.392437+0000","last_became_peered":"2024-04-19T03:05:09.392437+0000","last_unstale":"2024-04-19T03:05:12.420654+0000","last_undegraded":"2024-04-19T03:05:12.420654+0000","last_fullsized":"2024-04-19T03:05:12.420654+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"81'3","reported_seq":45,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:57.905939+0000","last_change":"2024-04-19T03:05:57.906283+0000","last_active":"2024-04-19T03:05:57.905939+0000","last_peered":"2024-04-19T03:05:57.905939+0000","last_clean":"2024-04-19T03:05:57.905939+0000","last_became_active":"2024-04-19T03:04:50.611024+0000","last_became_peered":"2024-04-19T03:04:50.611024+0000","last_unstale":"2024-04-19T03:05:57.905939+0000","last_undegraded":"2024-04-19T03:05:57.905939+0000","last_fullsized":"2024-04-19T03:05:57.905939+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'3","last_scrub_stamp":"2024-04-19T03:05:57.905886+0000","last_deep_scrub":"81'3","last_deep_scrub_stamp":"2024-04-19T03:05:57.905886+0000","last_clean_scrub_stamp":"2024-04-19T03:05:57.905886+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:53:22.931871+0000","scrub_duration":0.006376273,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":41,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:06:14.878469+0000","last_change":"2024-04-19T03:06:14.878807+0000","last_active":"2024-04-19T03:06:14.878469+0000","last_peered":"2024-04-19T03:06:14.878469+0000","last_clean":"2024-04-19T03:06:14.878469+0000","last_became_active":"2024-04-19T03:04:50.612403+0000","last_became_peered":"2024-04-19T03:04:50.612403+0000","last_unstale":"2024-04-19T03:06:14.878469+0000","last_undegraded":"2024-04-19T03:06:14.878469+0000","last_fullsized":"2024-04-19T03:06:14.878469+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:06:14.878362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:06:14.878362+0000","last_clean_scrub_stamp":"2024-04-19T03:06:14.878362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:28:51.544909+0000","scrub_duration":0.0036263469999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":41,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:47.097742+0000","last_change":"2024-04-19T03:05:47.097999+0000","last_active":"2024-04-19T03:05:47.097742+0000","last_peered":"2024-04-19T03:05:47.097742+0000","last_clean":"2024-04-19T03:05:47.097742+0000","last_became_active":"2024-04-19T03:04:50.612987+0000","last_became_peered":"2024-04-19T03:04:50.612987+0000","last_unstale":"2024-04-19T03:05:47.097742+0000","last_undegraded":"2024-04-19T03:05:47.097742+0000","last_fullsized":"2024-04-19T03:05:47.097742+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:05:47.097698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:05:47.097698+0000","last_clean_scrub_stamp":"2024-04-19T03:05:47.097698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:08:39.534725+0000","scrub_duration":0.0032086129999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"81'2","reported_seq":46,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:46.119148+0000","last_change":"2024-04-19T03:05:46.119402+0000","last_active":"2024-04-19T03:05:46.119148+0000","last_peered":"2024-04-19T03:05:46.119148+0000","last_clean":"2024-04-19T03:05:46.119148+0000","last_became_active":"2024-04-19T03:04:50.612697+0000","last_became_peered":"2024-04-19T03:04:50.612697+0000","last_unstale":"2024-04-19T03:05:46.119148+0000","last_undegraded":"2024-04-19T03:05:46.119148+0000","last_fullsized":"2024-04-19T03:05:46.119148+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'2","last_scrub_stamp":"2024-04-19T03:05:46.119093+0000","last_deep_scrub":"81'2","last_deep_scrub_stamp":"2024-04-19T03:05:46.119093+0000","last_clean_scrub_stamp":"2024-04-19T03:05:46.119093+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:47:01.115618+0000","scrub_duration":0.0063348040000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":76,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:19.713587+0000","last_change":"2024-04-19T03:01:10.602274+0000","last_active":"2024-04-19T03:05:19.713587+0000","last_peered":"2024-04-19T03:05:19.713587+0000","last_clean":"2024-04-19T03:05:19.713587+0000","last_became_active":"2024-04-19T03:01:10.601487+0000","last_became_peered":"2024-04-19T03:01:10.601487+0000","last_unstale":"2024-04-19T03:05:19.713587+0000","last_undegraded":"2024-04-19T03:05:19.713587+0000","last_fullsized":"2024-04-19T03:05:19.713587+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_clean_scrub_stamp":"2024-04-19T03:01:09.578660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":84,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:06:33.414929+0000","last_change":"2024-04-19T03:06:33.415299+0000","last_active":"2024-04-19T03:06:33.414929+0000","last_peered":"2024-04-19T03:06:33.414929+0000","last_clean":"2024-04-19T03:06:33.414929+0000","last_became_active":"2024-04-19T03:01:15.018276+0000","last_became_peered":"2024-04-19T03:01:15.018276+0000","last_unstale":"2024-04-19T03:06:33.414929+0000","last_undegraded":"2024-04-19T03:06:33.414929+0000","last_fullsized":"2024-04-19T03:06:33.414929+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:06:33.414881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:06:33.414881+0000","last_clean_scrub_stamp":"2024-04-19T03:06:33.414881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:21:18.724694+0000","scrub_duration":0.0030956999999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":89,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:06:28.974256+0000","last_change":"2024-04-19T03:06:28.974608+0000","last_active":"2024-04-19T03:06:28.974256+0000","last_peered":"2024-04-19T03:06:28.974256+0000","last_clean":"2024-04-19T03:06:28.974256+0000","last_became_active":"2024-04-19T03:05:11.429214+0000","last_became_peered":"2024-04-19T03:05:11.429214+0000","last_unstale":"2024-04-19T03:06:28.974256+0000","last_undegraded":"2024-04-19T03:06:28.974256+0000","last_fullsized":"2024-04-19T03:06:28.974256+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:06:28.974167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:06:28.974167+0000","last_clean_scrub_stamp":"2024-04-19T03:06:28.974167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:45:50.999463+0000","scrub_duration":0.0034688119999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"81'10","reported_seq":100,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:29.315169+0000","last_change":"2024-04-19T03:05:29.315169+0000","last_active":"2024-04-19T03:05:29.315169+0000","last_peered":"2024-04-19T03:05:29.315169+0000","last_clean":"2024-04-19T03:05:29.315169+0000","last_became_active":"2024-04-19T03:05:11.430906+0000","last_became_peered":"2024-04-19T03:05:11.430906+0000","last_unstale":"2024-04-19T03:05:29.315169+0000","last_undegraded":"2024-04-19T03:05:29.315169+0000","last_fullsized":"2024-04-19T03:05:29.315169+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'10","last_scrub_stamp":"2024-04-19T03:05:29.314872+0000","last_deep_scrub":"81'10","last_deep_scrub_stamp":"2024-04-19T03:05:29.314872+0000","last_clean_scrub_stamp":"2024-04-19T03:05:29.314872+0000","objects_scrubbed":4,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:09:13.123950+0000","scrub_duration":0.0096666670000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":41,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:51.052208+0000","last_change":"2024-04-19T03:05:51.052464+0000","last_active":"2024-04-19T03:05:51.052208+0000","last_peered":"2024-04-19T03:05:51.052208+0000","last_clean":"2024-04-19T03:05:51.052208+0000","last_became_active":"2024-04-19T03:04:50.627654+0000","last_became_peered":"2024-04-19T03:04:50.627654+0000","last_unstale":"2024-04-19T03:05:51.052208+0000","last_undegraded":"2024-04-19T03:05:51.052208+0000","last_fullsized":"2024-04-19T03:05:51.052208+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:05:51.052162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:05:51.052162+0000","last_clean_scrub_stamp":"2024-04-19T03:05:51.052162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:45:11.062907+0000","scrub_duration":0.0030909259999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"20'3","reported_seq":55,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:12.421900+0000","last_change":"2024-04-19T03:05:09.398110+0000","last_active":"2024-04-19T03:05:12.421900+0000","last_peered":"2024-04-19T03:05:12.421900+0000","last_clean":"2024-04-19T03:05:12.421900+0000","last_became_active":"2024-04-19T03:05:09.397555+0000","last_became_peered":"2024-04-19T03:05:09.397555+0000","last_unstale":"2024-04-19T03:05:12.421900+0000","last_undegraded":"2024-04-19T03:05:12.421900+0000","last_fullsized":"2024-04-19T03:05:12.421900+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":84,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:30.281124+0000","last_change":"2024-04-19T03:05:30.281124+0000","last_active":"2024-04-19T03:05:30.281124+0000","last_peered":"2024-04-19T03:05:30.281124+0000","last_clean":"2024-04-19T03:05:30.281124+0000","last_became_active":"2024-04-19T03:05:11.428904+0000","last_became_peered":"2024-04-19T03:05:11.428904+0000","last_unstale":"2024-04-19T03:05:30.281124+0000","last_undegraded":"2024-04-19T03:05:30.281124+0000","last_fullsized":"2024-04-19T03:05:30.281124+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:05:30.280817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:05:30.280817+0000","last_clean_scrub_stamp":"2024-04-19T03:05:30.280817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:49:02.715913+0000","scrub_duration":0.0034631390000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":41,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:06:18.911655+0000","last_change":"2024-04-19T03:06:18.911905+0000","last_active":"2024-04-19T03:06:18.911655+0000","last_peered":"2024-04-19T03:06:18.911655+0000","last_clean":"2024-04-19T03:06:18.911655+0000","last_became_active":"2024-04-19T03:04:50.630873+0000","last_became_peered":"2024-04-19T03:04:50.630873+0000","last_unstale":"2024-04-19T03:06:18.911655+0000","last_undegraded":"2024-04-19T03:06:18.911655+0000","last_fullsized":"2024-04-19T03:06:18.911655+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:06:18.911610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:06:18.911610+0000","last_clean_scrub_stamp":"2024-04-19T03:06:18.911610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:32:53.446952+0000","scrub_duration":0.0033747260000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":42,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:25.154192+0000","last_change":"2024-04-19T03:05:25.154574+0000","last_active":"2024-04-19T03:05:25.154192+0000","last_peered":"2024-04-19T03:05:25.154192+0000","last_clean":"2024-04-19T03:05:25.154192+0000","last_became_active":"2024-04-19T03:04:50.612005+0000","last_became_peered":"2024-04-19T03:04:50.612005+0000","last_unstale":"2024-04-19T03:05:25.154192+0000","last_undegraded":"2024-04-19T03:05:25.154192+0000","last_fullsized":"2024-04-19T03:05:25.154192+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:05:25.154094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:05:25.154094+0000","last_clean_scrub_stamp":"2024-04-19T03:05:25.154094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:35:43.914350+0000","scrub_duration":0.0032290930000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":41,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:36.159462+0000","last_change":"2024-04-19T03:05:36.159687+0000","last_active":"2024-04-19T03:05:36.159462+0000","last_peered":"2024-04-19T03:05:36.159462+0000","last_clean":"2024-04-19T03:05:36.159462+0000","last_became_active":"2024-04-19T03:04:50.613735+0000","last_became_peered":"2024-04-19T03:04:50.613735+0000","last_unstale":"2024-04-19T03:05:36.159462+0000","last_undegraded":"2024-04-19T03:05:36.159462+0000","last_fullsized":"2024-04-19T03:05:36.159462+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:05:36.159417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:05:36.159417+0000","last_clean_scrub_stamp":"2024-04-19T03:05:36.159417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:03:12.881177+0000","scrub_duration":0.0033805229999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":62,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:51.504587+0000","last_change":"2024-04-19T03:05:51.504706+0000","last_active":"2024-04-19T03:05:51.504587+0000","last_peered":"2024-04-19T03:05:51.504587+0000","last_clean":"2024-04-19T03:05:51.504587+0000","last_became_active":"2024-04-19T03:05:09.392982+0000","last_became_peered":"2024-04-19T03:05:09.392982+0000","last_unstale":"2024-04-19T03:05:51.504587+0000","last_undegraded":"2024-04-19T03:05:51.504587+0000","last_fullsized":"2024-04-19T03:05:51.504587+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:05:51.504568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:05:51.504568+0000","last_clean_scrub_stamp":"2024-04-19T03:05:51.504568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:09:35.313645+0000","scrub_duration":0.075784133000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":42,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:06:04.942245+0000","last_change":"2024-04-19T03:06:04.942510+0000","last_active":"2024-04-19T03:06:04.942245+0000","last_peered":"2024-04-19T03:06:04.942245+0000","last_clean":"2024-04-19T03:06:04.942245+0000","last_became_active":"2024-04-19T03:04:50.613523+0000","last_became_peered":"2024-04-19T03:04:50.613523+0000","last_unstale":"2024-04-19T03:06:04.942245+0000","last_undegraded":"2024-04-19T03:06:04.942245+0000","last_fullsized":"2024-04-19T03:06:04.942245+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:06:04.942199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:06:04.942199+0000","last_clean_scrub_stamp":"2024-04-19T03:06:04.942199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:28:55.349289+0000","scrub_duration":0.0030863319999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":41,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:06:19.959527+0000","last_change":"2024-04-19T03:06:19.959763+0000","last_active":"2024-04-19T03:06:19.959527+0000","last_peered":"2024-04-19T03:06:19.959527+0000","last_clean":"2024-04-19T03:06:19.959527+0000","last_became_active":"2024-04-19T03:04:50.616545+0000","last_became_peered":"2024-04-19T03:04:50.616545+0000","last_unstale":"2024-04-19T03:06:19.959527+0000","last_undegraded":"2024-04-19T03:06:19.959527+0000","last_fullsized":"2024-04-19T03:06:19.959527+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:06:19.959480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:06:19.959480+0000","last_clean_scrub_stamp":"2024-04-19T03:06:19.959480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:55:44.901892+0000","scrub_duration":0.0032722350000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":42,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:06:12.924266+0000","last_change":"2024-04-19T03:06:12.924499+0000","last_active":"2024-04-19T03:06:12.924266+0000","last_peered":"2024-04-19T03:06:12.924266+0000","last_clean":"2024-04-19T03:06:12.924266+0000","last_became_active":"2024-04-19T03:04:50.631699+0000","last_became_peered":"2024-04-19T03:04:50.631699+0000","last_unstale":"2024-04-19T03:06:12.924266+0000","last_undegraded":"2024-04-19T03:06:12.924266+0000","last_fullsized":"2024-04-19T03:06:12.924266+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:06:12.924210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:06:12.924210+0000","last_clean_scrub_stamp":"2024-04-19T03:06:12.924210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:14:21.020517+0000","scrub_duration":0.0036518229999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":65,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:06:05.526393+0000","last_change":"2024-04-19T03:06:05.526625+0000","last_active":"2024-04-19T03:06:05.526393+0000","last_peered":"2024-04-19T03:06:05.526393+0000","last_clean":"2024-04-19T03:06:05.526393+0000","last_became_active":"2024-04-19T03:05:02.360924+0000","last_became_peered":"2024-04-19T03:05:02.360924+0000","last_unstale":"2024-04-19T03:06:05.526393+0000","last_undegraded":"2024-04-19T03:06:05.526393+0000","last_fullsized":"2024-04-19T03:06:05.526393+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:06:05.526344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:06:05.526344+0000","last_clean_scrub_stamp":"2024-04-19T03:06:05.526344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:51:30.876593+0000","scrub_duration":0.003457187,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"20'1","reported_seq":92,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:27.387324+0000","last_change":"2024-04-19T03:05:27.387324+0000","last_active":"2024-04-19T03:05:27.387324+0000","last_peered":"2024-04-19T03:05:27.387324+0000","last_clean":"2024-04-19T03:05:27.387324+0000","last_became_active":"2024-04-19T03:05:09.395508+0000","last_became_peered":"2024-04-19T03:05:09.395508+0000","last_unstale":"2024-04-19T03:05:27.387324+0000","last_undegraded":"2024-04-19T03:05:27.387324+0000","last_fullsized":"2024-04-19T03:05:27.387324+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"20'1","last_scrub_stamp":"2024-04-19T03:05:27.386920+0000","last_deep_scrub":"20'1","last_deep_scrub_stamp":"2024-04-19T03:05:27.386920+0000","last_clean_scrub_stamp":"2024-04-19T03:05:27.386920+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:30:55.863683+0000","scrub_duration":0.0033146569999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":79,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:19.240972+0000","last_change":"2024-04-19T03:05:09.396327+0000","last_active":"2024-04-19T03:05:19.240972+0000","last_peered":"2024-04-19T03:05:19.240972+0000","last_clean":"2024-04-19T03:05:19.240972+0000","last_became_active":"2024-04-19T03:05:09.395753+0000","last_became_peered":"2024-04-19T03:05:09.395753+0000","last_unstale":"2024-04-19T03:05:19.240972+0000","last_undegraded":"2024-04-19T03:05:19.240972+0000","last_fullsized":"2024-04-19T03:05:19.240972+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"20'1","reported_seq":100,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:40.415059+0000","last_change":"2024-04-19T03:05:40.415059+0000","last_active":"2024-04-19T03:05:40.415059+0000","last_peered":"2024-04-19T03:05:40.415059+0000","last_clean":"2024-04-19T03:05:40.415059+0000","last_became_active":"2024-04-19T03:05:09.397183+0000","last_became_peered":"2024-04-19T03:05:09.397183+0000","last_unstale":"2024-04-19T03:05:40.415059+0000","last_undegraded":"2024-04-19T03:05:40.415059+0000","last_fullsized":"2024-04-19T03:05:40.415059+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"20'1","last_scrub_stamp":"2024-04-19T03:05:40.414768+0000","last_deep_scrub":"20'1","last_deep_scrub_stamp":"2024-04-19T03:05:40.414768+0000","last_clean_scrub_stamp":"2024-04-19T03:05:40.414768+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:13:49.641736+0000","scrub_duration":0.0037583510000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":99,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:42.226248+0000","last_change":"2024-04-19T03:05:42.226248+0000","last_active":"2024-04-19T03:05:42.226248+0000","last_peered":"2024-04-19T03:05:42.226248+0000","last_clean":"2024-04-19T03:05:42.226248+0000","last_became_active":"2024-04-19T03:05:11.429247+0000","last_became_peered":"2024-04-19T03:05:11.429247+0000","last_unstale":"2024-04-19T03:05:42.226248+0000","last_undegraded":"2024-04-19T03:05:42.226248+0000","last_fullsized":"2024-04-19T03:05:42.226248+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:05:42.226018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:05:42.226018+0000","last_clean_scrub_stamp":"2024-04-19T03:05:42.226018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:33:09.655667+0000","scrub_duration":0.049267652000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"81'3","reported_seq":101,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:06:33.960133+0000","last_change":"2024-04-19T03:06:33.960359+0000","last_active":"2024-04-19T03:06:33.960133+0000","last_peered":"2024-04-19T03:06:33.960133+0000","last_clean":"2024-04-19T03:06:33.960133+0000","last_became_active":"2024-04-19T03:04:50.275533+0000","last_became_peered":"2024-04-19T03:04:50.275533+0000","last_unstale":"2024-04-19T03:06:33.960133+0000","last_undegraded":"2024-04-19T03:06:33.960133+0000","last_fullsized":"2024-04-19T03:06:33.960133+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'3","last_scrub_stamp":"2024-04-19T03:06:33.960084+0000","last_deep_scrub":"81'3","last_deep_scrub_stamp":"2024-04-19T03:06:33.960084+0000","last_clean_scrub_stamp":"2024-04-19T03:06:33.960084+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:46:27.406011+0000","scrub_duration":0.0062949520000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":97,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:06:17.006595+0000","last_change":"2024-04-19T03:06:17.006832+0000","last_active":"2024-04-19T03:06:17.006595+0000","last_peered":"2024-04-19T03:06:17.006595+0000","last_clean":"2024-04-19T03:06:17.006595+0000","last_became_active":"2024-04-19T03:04:50.277348+0000","last_became_peered":"2024-04-19T03:04:50.277348+0000","last_unstale":"2024-04-19T03:06:17.006595+0000","last_undegraded":"2024-04-19T03:06:17.006595+0000","last_fullsized":"2024-04-19T03:06:17.006595+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:06:17.006549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:06:17.006549+0000","last_clean_scrub_stamp":"2024-04-19T03:06:17.006549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:24:47.387136+0000","scrub_duration":0.0032758610000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"81'3","reported_seq":69,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:52.394857+0000","last_change":"2024-04-19T03:05:52.395104+0000","last_active":"2024-04-19T03:05:52.394857+0000","last_peered":"2024-04-19T03:05:52.394857+0000","last_clean":"2024-04-19T03:05:52.394857+0000","last_became_active":"2024-04-19T03:05:02.363167+0000","last_became_peered":"2024-04-19T03:05:02.363167+0000","last_unstale":"2024-04-19T03:05:52.394857+0000","last_undegraded":"2024-04-19T03:05:52.394857+0000","last_fullsized":"2024-04-19T03:05:52.394857+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'3","last_scrub_stamp":"2024-04-19T03:05:52.394809+0000","last_deep_scrub":"81'3","last_deep_scrub_stamp":"2024-04-19T03:05:52.394809+0000","last_clean_scrub_stamp":"2024-04-19T03:05:52.394809+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:49:24.829905+0000","scrub_duration":0.0064588550000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":90,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:22.325552+0000","last_change":"2024-04-19T03:05:22.325552+0000","last_active":"2024-04-19T03:05:22.325552+0000","last_peered":"2024-04-19T03:05:22.325552+0000","last_clean":"2024-04-19T03:05:22.325552+0000","last_became_active":"2024-04-19T03:05:09.393975+0000","last_became_peered":"2024-04-19T03:05:09.393975+0000","last_unstale":"2024-04-19T03:05:22.325552+0000","last_undegraded":"2024-04-19T03:05:22.325552+0000","last_fullsized":"2024-04-19T03:05:22.325552+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:05:22.325265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:05:22.325265+0000","last_clean_scrub_stamp":"2024-04-19T03:05:22.325265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:46:17.944097+0000","scrub_duration":0.022749259000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"20'1","reported_seq":33,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:12.769806+0000","last_change":"2024-04-19T03:04:50.627670+0000","last_active":"2024-04-19T03:05:12.769806+0000","last_peered":"2024-04-19T03:05:12.769806+0000","last_clean":"2024-04-19T03:05:12.769806+0000","last_became_active":"2024-04-19T03:04:50.627304+0000","last_became_peered":"2024-04-19T03:04:50.627304+0000","last_unstale":"2024-04-19T03:05:12.769806+0000","last_undegraded":"2024-04-19T03:05:12.769806+0000","last_fullsized":"2024-04-19T03:05:12.769806+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":97,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:06:23.052583+0000","last_change":"2024-04-19T03:06:23.052797+0000","last_active":"2024-04-19T03:06:23.052583+0000","last_peered":"2024-04-19T03:06:23.052583+0000","last_clean":"2024-04-19T03:06:23.052583+0000","last_became_active":"2024-04-19T03:04:50.278874+0000","last_became_peered":"2024-04-19T03:04:50.278874+0000","last_unstale":"2024-04-19T03:06:23.052583+0000","last_undegraded":"2024-04-19T03:06:23.052583+0000","last_fullsized":"2024-04-19T03:06:23.052583+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:06:23.052539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:06:23.052539+0000","last_clean_scrub_stamp":"2024-04-19T03:06:23.052539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:26:31.884047+0000","scrub_duration":0.0029952630000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"81'6","reported_seq":46,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:54.008711+0000","last_change":"2024-04-19T03:05:54.009000+0000","last_active":"2024-04-19T03:05:54.008711+0000","last_peered":"2024-04-19T03:05:54.008711+0000","last_clean":"2024-04-19T03:05:54.008711+0000","last_became_active":"2024-04-19T03:04:50.626334+0000","last_became_peered":"2024-04-19T03:04:50.626334+0000","last_unstale":"2024-04-19T03:05:54.008711+0000","last_undegraded":"2024-04-19T03:05:54.008711+0000","last_fullsized":"2024-04-19T03:05:54.008711+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'6","last_scrub_stamp":"2024-04-19T03:05:54.008658+0000","last_deep_scrub":"81'6","last_deep_scrub_stamp":"2024-04-19T03:05:54.008658+0000","last_clean_scrub_stamp":"2024-04-19T03:05:54.008658+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:39:11.277372+0000","scrub_duration":0.0079365890000000008,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5289,"internal_metadata":0},"log_size":55,"ondisk_log_size":55,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":14482,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":10,"seq":42949673033,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":224804,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":223870,"kb_avail":94147036,"statfs":{"total":96636764160,"available":96406564864,"internally_reserved":0,"allocated":946176,"data_stored":929795,"data_compressed":7241,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":229243334},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 19 03:05:49 2024","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.69199999999999995}]},{"osd":1,"last update":"Fri Apr 19 03:06:19 2024","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.58999999999999997,"15min":0.56200000000000006},"min":{"1min":0.58299999999999996,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.77200000000000002,"5min":2.5030000000000001,"15min":2.5030000000000001},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.60699999999999998,"15min":0.57499999999999996},"min":{"1min":0.51900000000000002,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.79200000000000004,"5min":2.6379999999999999,"15min":2.6379999999999999},"last":0.60399999999999998}]}]},{"osd":1,"up_from":10,"seq":42949673032,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":202656,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":201726,"kb_avail":94169184,"statfs":{"total":96636764160,"available":96429244416,"internally_reserved":0,"allocated":942080,"data_stored":931342,"data_compressed":7241,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":206567878},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 19 03:05:50 2024","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.60899999999999999}]},{"osd":2,"last update":"Fri Apr 19 03:06:10 2024","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.53700000000000003,"15min":0.52000000000000002},"min":{"1min":0.59999999999999998,"5min":0.224,"15min":0.224},"max":{"1min":0.81599999999999995,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.54400000000000004,"15min":0.53400000000000003},"min":{"1min":0.60399999999999998,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.94899999999999995,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.749}]}]},{"osd":0,"up_from":71,"seq":304942678040,"num_pgs":73,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51800,"kb_used_data":848,"kb_used_omap":6,"kb_used_meta":50937,"kb_avail":94320040,"statfs":{"total":96636764160,"available":96583720960,"internally_reserved":0,"allocated":868352,"data_stored":339844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6883,"internal_metadata":52159773},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Apr 19 03:05:51 2024","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.61199999999999999}]},{"osd":2,"last update":"Fri Apr 19 03:05:51 2024","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.57599999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":7241,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":7241,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5289,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-19T03:06:41.458 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-04-19T03:01:14.615919+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=14, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:06:41.458 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-04-19T03:01:14.615919+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=14, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:06:41.459 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-04-19T03:01:14.615919+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=14, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:06:41.459 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-04-19T03:01:14.615919+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=14, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:06:41.459 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-04-19T03:01:14.615919+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=14, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:06:41.459 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-04-19T03:01:14.615919+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=14, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:06:41.459 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-04-19T03:01:14.615919+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=14, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:06:41.460 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-04-19T03:01:14.615919+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=14, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:06:41.460 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-04-19T03:01:14.615919+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=14, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:06:41.460 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-04-19T03:01:13.604133+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=13, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:06:41.460 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-04-19T03:01:14.615919+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=14, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:06:41.460 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-04-19T03:01:13.604133+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=13, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:06:41.460 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-04-19T03:01:13.604133+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=13, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:06:41.461 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-04-19T03:01:13.604133+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=13, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:06:41.461 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-04-19T03:01:14.615919+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=14, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:06:41.461 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-04-19T03:01:13.604133+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=13, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:06:41.461 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-04-19T03:01:06.516863+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=6, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:06:41.461 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-04-19T03:01:09.578660+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=9, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:06:41.461 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-04-19T03:01:13.604133+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=13, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:06:41.461 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-04-19T03:01:09.578660+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=9, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:06:41.462 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-04-19T03:01:09.578660+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=9, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:06:41.462 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-04-19T03:01:13.604133+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=13, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:06:41.462 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-04-19T03:01:09.578660+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=9, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:06:41.462 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-04-19T03:01:14.615919+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=14, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:06:41.462 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-04-19T03:01:09.578660+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=9, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:06:41.462 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-04-19T03:01:13.604133+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=13, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:06:41.463 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-04-19T03:01:14.615919+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=14, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:06:41.463 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-04-19T03:01:13.604133+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=13, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:06:41.463 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-19T03:07:01.465 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-19T03:07:01.785 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-19T03:07:01.787 INFO:teuthology.orchestra.run.smithi096.stderr:dumped all 2024-04-19T03:07:01.801 INFO:teuthology.orchestra.run.smithi096.stdout:{"pg_ready":true,"pg_map":{"version":255,"stamp":"2024-04-19T03:07:00.089136+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":215,"ondisk_log_size":215,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":479260,"kb_used_data":2692,"kb_used_omap":9,"kb_used_meta":476534,"kb_avail":282636260,"statfs":{"total":289910292480,"available":289419530240,"internally_reserved":0,"allocated":2756608,"data_stored":2200981,"data_compressed":14482,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":10071,"internal_metadata":487970985},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004046"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":90,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:06:50.704497+0000","last_change":"2024-04-19T03:06:50.704611+0000","last_active":"2024-04-19T03:06:50.704497+0000","last_peered":"2024-04-19T03:06:50.704497+0000","last_clean":"2024-04-19T03:06:50.704497+0000","last_became_active":"2024-04-19T03:05:09.396279+0000","last_became_peered":"2024-04-19T03:05:09.396279+0000","last_unstale":"2024-04-19T03:06:50.704497+0000","last_undegraded":"2024-04-19T03:06:50.704497+0000","last_fullsized":"2024-04-19T03:06:50.704497+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:06:50.704479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:06:50.704479+0000","last_clean_scrub_stamp":"2024-04-19T03:06:50.704479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:26:59.535986+0000","scrub_duration":0.088289039,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":97,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:06:42.529963+0000","last_change":"2024-04-19T03:06:42.530233+0000","last_active":"2024-04-19T03:06:42.529963+0000","last_peered":"2024-04-19T03:06:42.529963+0000","last_clean":"2024-04-19T03:06:42.529963+0000","last_became_active":"2024-04-19T03:04:50.277848+0000","last_became_peered":"2024-04-19T03:04:50.277848+0000","last_unstale":"2024-04-19T03:06:42.529963+0000","last_undegraded":"2024-04-19T03:06:42.529963+0000","last_fullsized":"2024-04-19T03:06:42.529963+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:06:42.529920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:06:42.529920+0000","last_clean_scrub_stamp":"2024-04-19T03:06:42.529920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:38:48.243133+0000","scrub_duration":0.0029622009999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":84,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:06:04.985436+0000","last_change":"2024-04-19T03:06:04.985743+0000","last_active":"2024-04-19T03:06:04.985436+0000","last_peered":"2024-04-19T03:06:04.985436+0000","last_clean":"2024-04-19T03:06:04.985436+0000","last_became_active":"2024-04-19T03:01:15.014599+0000","last_became_peered":"2024-04-19T03:01:15.014599+0000","last_unstale":"2024-04-19T03:06:04.985436+0000","last_undegraded":"2024-04-19T03:06:04.985436+0000","last_fullsized":"2024-04-19T03:06:04.985436+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:06:04.985390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:06:04.985390+0000","last_clean_scrub_stamp":"2024-04-19T03:06:04.985390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:34:15.507303+0000","scrub_duration":0.0034078440000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":97,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:49.097798+0000","last_change":"2024-04-19T03:05:49.098069+0000","last_active":"2024-04-19T03:05:49.097798+0000","last_peered":"2024-04-19T03:05:49.097798+0000","last_clean":"2024-04-19T03:05:49.097798+0000","last_became_active":"2024-04-19T03:04:50.274600+0000","last_became_peered":"2024-04-19T03:04:50.274600+0000","last_unstale":"2024-04-19T03:05:49.097798+0000","last_undegraded":"2024-04-19T03:05:49.097798+0000","last_fullsized":"2024-04-19T03:05:49.097798+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:05:49.097746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:05:49.097746+0000","last_clean_scrub_stamp":"2024-04-19T03:05:49.097746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:07:18.276599+0000","scrub_duration":0.0032259770000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":90,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:39.452420+0000","last_change":"2024-04-19T03:05:39.452420+0000","last_active":"2024-04-19T03:05:39.452420+0000","last_peered":"2024-04-19T03:05:39.452420+0000","last_clean":"2024-04-19T03:05:39.452420+0000","last_became_active":"2024-04-19T03:05:09.395929+0000","last_became_peered":"2024-04-19T03:05:09.395929+0000","last_unstale":"2024-04-19T03:05:39.452420+0000","last_undegraded":"2024-04-19T03:05:39.452420+0000","last_fullsized":"2024-04-19T03:05:39.452420+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:05:39.452007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:05:39.452007+0000","last_clean_scrub_stamp":"2024-04-19T03:05:39.452007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:45:27.478454+0000","scrub_duration":0.026485411,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":83,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:06:06.951780+0000","last_change":"2024-04-19T03:06:06.951780+0000","last_active":"2024-04-19T03:06:06.951780+0000","last_peered":"2024-04-19T03:06:06.951780+0000","last_clean":"2024-04-19T03:06:06.951780+0000","last_became_active":"2024-04-19T03:05:11.426617+0000","last_became_peered":"2024-04-19T03:05:11.426617+0000","last_unstale":"2024-04-19T03:06:06.951780+0000","last_undegraded":"2024-04-19T03:06:06.951780+0000","last_fullsized":"2024-04-19T03:06:06.951780+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:06:06.951457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:06:06.951457+0000","last_clean_scrub_stamp":"2024-04-19T03:06:06.951457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:57:21.385487+0000","scrub_duration":0.0032635160000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":83,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:06:54.039416+0000","last_change":"2024-04-19T03:06:54.039766+0000","last_active":"2024-04-19T03:06:54.039416+0000","last_peered":"2024-04-19T03:06:54.039416+0000","last_clean":"2024-04-19T03:06:54.039416+0000","last_became_active":"2024-04-19T03:05:11.422727+0000","last_became_peered":"2024-04-19T03:05:11.422727+0000","last_unstale":"2024-04-19T03:06:54.039416+0000","last_undegraded":"2024-04-19T03:06:54.039416+0000","last_fullsized":"2024-04-19T03:06:54.039416+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:06:54.039371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:06:54.039371+0000","last_clean_scrub_stamp":"2024-04-19T03:06:54.039371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:16:53.031730+0000","scrub_duration":0.023072017,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":97,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:54.075857+0000","last_change":"2024-04-19T03:05:54.075857+0000","last_active":"2024-04-19T03:05:54.075857+0000","last_peered":"2024-04-19T03:05:54.075857+0000","last_clean":"2024-04-19T03:05:54.075857+0000","last_became_active":"2024-04-19T03:04:50.261155+0000","last_became_peered":"2024-04-19T03:04:50.261155+0000","last_unstale":"2024-04-19T03:05:54.075857+0000","last_undegraded":"2024-04-19T03:05:54.075857+0000","last_fullsized":"2024-04-19T03:05:54.075857+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:05:54.075422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:05:54.075422+0000","last_clean_scrub_stamp":"2024-04-19T03:05:54.075422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:12:16.121405+0000","scrub_duration":0.0036127419999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":41,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:23.156874+0000","last_change":"2024-04-19T03:05:23.156992+0000","last_active":"2024-04-19T03:05:23.156874+0000","last_peered":"2024-04-19T03:05:23.156874+0000","last_clean":"2024-04-19T03:05:23.156874+0000","last_became_active":"2024-04-19T03:04:50.611400+0000","last_became_peered":"2024-04-19T03:04:50.611400+0000","last_unstale":"2024-04-19T03:05:23.156874+0000","last_undegraded":"2024-04-19T03:05:23.156874+0000","last_fullsized":"2024-04-19T03:05:23.156874+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:05:23.156852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:05:23.156852+0000","last_clean_scrub_stamp":"2024-04-19T03:05:23.156852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:00:45.201755+0000","scrub_duration":0.036684305,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":97,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:06:40.468677+0000","last_change":"2024-04-19T03:06:40.468923+0000","last_active":"2024-04-19T03:06:40.468677+0000","last_peered":"2024-04-19T03:06:40.468677+0000","last_clean":"2024-04-19T03:06:40.468677+0000","last_became_active":"2024-04-19T03:04:50.277899+0000","last_became_peered":"2024-04-19T03:04:50.277899+0000","last_unstale":"2024-04-19T03:06:40.468677+0000","last_undegraded":"2024-04-19T03:06:40.468677+0000","last_fullsized":"2024-04-19T03:06:40.468677+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:06:40.468629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:06:40.468629+0000","last_clean_scrub_stamp":"2024-04-19T03:06:40.468629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:23:08.173990+0000","scrub_duration":0.0031597769999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":72,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:19.714661+0000","last_change":"2024-04-19T03:05:11.430574+0000","last_active":"2024-04-19T03:05:19.714661+0000","last_peered":"2024-04-19T03:05:19.714661+0000","last_clean":"2024-04-19T03:05:19.714661+0000","last_became_active":"2024-04-19T03:05:11.430243+0000","last_became_peered":"2024-04-19T03:05:11.430243+0000","last_unstale":"2024-04-19T03:05:19.714661+0000","last_undegraded":"2024-04-19T03:05:19.714661+0000","last_fullsized":"2024-04-19T03:05:19.714661+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":62,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:30.443577+0000","last_change":"2024-04-19T03:05:30.443804+0000","last_active":"2024-04-19T03:05:30.443577+0000","last_peered":"2024-04-19T03:05:30.443577+0000","last_clean":"2024-04-19T03:05:30.443577+0000","last_became_active":"2024-04-19T03:05:09.392822+0000","last_became_peered":"2024-04-19T03:05:09.392822+0000","last_unstale":"2024-04-19T03:05:30.443577+0000","last_undegraded":"2024-04-19T03:05:30.443577+0000","last_fullsized":"2024-04-19T03:05:30.443577+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:05:30.443531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:05:30.443531+0000","last_clean_scrub_stamp":"2024-04-19T03:05:30.443531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:43:21.406385+0000","scrub_duration":0.0030470290000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":79,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:19.241308+0000","last_change":"2024-04-19T03:05:09.397000+0000","last_active":"2024-04-19T03:05:19.241308+0000","last_peered":"2024-04-19T03:05:19.241308+0000","last_clean":"2024-04-19T03:05:19.241308+0000","last_became_active":"2024-04-19T03:05:09.395749+0000","last_became_peered":"2024-04-19T03:05:09.395749+0000","last_unstale":"2024-04-19T03:05:19.241308+0000","last_undegraded":"2024-04-19T03:05:19.241308+0000","last_fullsized":"2024-04-19T03:05:19.241308+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":84,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:50.122363+0000","last_change":"2024-04-19T03:05:50.122363+0000","last_active":"2024-04-19T03:05:50.122363+0000","last_peered":"2024-04-19T03:05:50.122363+0000","last_clean":"2024-04-19T03:05:50.122363+0000","last_became_active":"2024-04-19T03:01:15.010472+0000","last_became_peered":"2024-04-19T03:01:15.010472+0000","last_unstale":"2024-04-19T03:05:50.122363+0000","last_undegraded":"2024-04-19T03:05:50.122363+0000","last_fullsized":"2024-04-19T03:05:50.122363+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:05:50.122017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:05:50.122017+0000","last_clean_scrub_stamp":"2024-04-19T03:05:50.122017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:38:58.698089+0000","scrub_duration":0.0034044829999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":86,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:06:14.987825+0000","last_change":"2024-04-19T03:06:14.988052+0000","last_active":"2024-04-19T03:06:14.987825+0000","last_peered":"2024-04-19T03:06:14.987825+0000","last_clean":"2024-04-19T03:06:14.987825+0000","last_became_active":"2024-04-19T03:05:11.425921+0000","last_became_peered":"2024-04-19T03:05:11.425921+0000","last_unstale":"2024-04-19T03:06:14.987825+0000","last_undegraded":"2024-04-19T03:06:14.987825+0000","last_fullsized":"2024-04-19T03:06:14.987825+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:06:14.987781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:06:14.987781+0000","last_clean_scrub_stamp":"2024-04-19T03:06:14.987781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:38:20.700993+0000","scrub_duration":0.0031418100000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":83,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:39.150013+0000","last_change":"2024-04-19T03:05:39.150013+0000","last_active":"2024-04-19T03:05:39.150013+0000","last_peered":"2024-04-19T03:05:39.150013+0000","last_clean":"2024-04-19T03:05:39.150013+0000","last_became_active":"2024-04-19T03:05:11.425921+0000","last_became_peered":"2024-04-19T03:05:11.425921+0000","last_unstale":"2024-04-19T03:05:39.150013+0000","last_undegraded":"2024-04-19T03:05:39.150013+0000","last_fullsized":"2024-04-19T03:05:39.150013+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:05:39.149625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:05:39.149625+0000","last_clean_scrub_stamp":"2024-04-19T03:05:39.149625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:18:40.192906+0000","scrub_duration":0.0038324209999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":41,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:49.126663+0000","last_change":"2024-04-19T03:05:49.126778+0000","last_active":"2024-04-19T03:05:49.126663+0000","last_peered":"2024-04-19T03:05:49.126663+0000","last_clean":"2024-04-19T03:05:49.126663+0000","last_became_active":"2024-04-19T03:04:50.611392+0000","last_became_peered":"2024-04-19T03:04:50.611392+0000","last_unstale":"2024-04-19T03:05:49.126663+0000","last_undegraded":"2024-04-19T03:05:49.126663+0000","last_fullsized":"2024-04-19T03:05:49.126663+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:05:49.126640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:05:49.126640+0000","last_clean_scrub_stamp":"2024-04-19T03:05:49.126640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:45:17.738767+0000","scrub_duration":0.087429018999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":90,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:19.348906+0000","last_change":"2024-04-19T03:05:19.348906+0000","last_active":"2024-04-19T03:05:19.348906+0000","last_peered":"2024-04-19T03:05:19.348906+0000","last_clean":"2024-04-19T03:05:19.348906+0000","last_became_active":"2024-04-19T03:05:09.395682+0000","last_became_peered":"2024-04-19T03:05:09.395682+0000","last_unstale":"2024-04-19T03:05:19.348906+0000","last_undegraded":"2024-04-19T03:05:19.348906+0000","last_fullsized":"2024-04-19T03:05:19.348906+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:05:19.348599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:05:19.348599+0000","last_clean_scrub_stamp":"2024-04-19T03:05:19.348599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:22:58.194899+0000","scrub_duration":0.0032195190000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":41,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:06:00.979479+0000","last_change":"2024-04-19T03:06:00.979616+0000","last_active":"2024-04-19T03:06:00.979479+0000","last_peered":"2024-04-19T03:06:00.979479+0000","last_clean":"2024-04-19T03:06:00.979479+0000","last_became_active":"2024-04-19T03:04:50.613481+0000","last_became_peered":"2024-04-19T03:04:50.613481+0000","last_unstale":"2024-04-19T03:06:00.979479+0000","last_undegraded":"2024-04-19T03:06:00.979479+0000","last_fullsized":"2024-04-19T03:06:00.979479+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:06:00.979457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:06:00.979457+0000","last_clean_scrub_stamp":"2024-04-19T03:06:00.979457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:40:54.944550+0000","scrub_duration":0.035927225,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":88,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:19.714585+0000","last_change":"2024-04-19T03:05:11.431719+0000","last_active":"2024-04-19T03:05:19.714585+0000","last_peered":"2024-04-19T03:05:19.714585+0000","last_clean":"2024-04-19T03:05:19.714585+0000","last_became_active":"2024-04-19T03:05:11.431352+0000","last_became_peered":"2024-04-19T03:05:11.431352+0000","last_unstale":"2024-04-19T03:05:19.714585+0000","last_undegraded":"2024-04-19T03:05:19.714585+0000","last_fullsized":"2024-04-19T03:05:19.714585+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":97,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:06:13.000039+0000","last_change":"2024-04-19T03:06:13.000335+0000","last_active":"2024-04-19T03:06:13.000039+0000","last_peered":"2024-04-19T03:06:13.000039+0000","last_clean":"2024-04-19T03:06:13.000039+0000","last_became_active":"2024-04-19T03:04:50.275510+0000","last_became_peered":"2024-04-19T03:04:50.275510+0000","last_unstale":"2024-04-19T03:06:13.000039+0000","last_undegraded":"2024-04-19T03:06:13.000039+0000","last_fullsized":"2024-04-19T03:06:13.000039+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:06:12.999972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:06:12.999972+0000","last_clean_scrub_stamp":"2024-04-19T03:06:12.999972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:22:40.705332+0000","scrub_duration":0.036220484999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":84,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:06:34.444326+0000","last_change":"2024-04-19T03:06:34.444624+0000","last_active":"2024-04-19T03:06:34.444326+0000","last_peered":"2024-04-19T03:06:34.444326+0000","last_clean":"2024-04-19T03:06:34.444326+0000","last_became_active":"2024-04-19T03:01:15.018978+0000","last_became_peered":"2024-04-19T03:01:15.018978+0000","last_unstale":"2024-04-19T03:06:34.444326+0000","last_undegraded":"2024-04-19T03:06:34.444326+0000","last_fullsized":"2024-04-19T03:06:34.444326+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:06:34.444282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:06:34.444282+0000","last_clean_scrub_stamp":"2024-04-19T03:06:34.444282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:57:48.878312+0000","scrub_duration":0.0032201650000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":41,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:27.084506+0000","last_change":"2024-04-19T03:05:27.084833+0000","last_active":"2024-04-19T03:05:27.084506+0000","last_peered":"2024-04-19T03:05:27.084506+0000","last_clean":"2024-04-19T03:05:27.084506+0000","last_became_active":"2024-04-19T03:04:50.630948+0000","last_became_peered":"2024-04-19T03:04:50.630948+0000","last_unstale":"2024-04-19T03:05:27.084506+0000","last_undegraded":"2024-04-19T03:05:27.084506+0000","last_fullsized":"2024-04-19T03:05:27.084506+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:05:27.084457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:05:27.084457+0000","last_clean_scrub_stamp":"2024-04-19T03:05:27.084457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:43:47.014628+0000","scrub_duration":0.0031579899999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":90,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:06:47.638006+0000","last_change":"2024-04-19T03:06:47.638287+0000","last_active":"2024-04-19T03:06:47.638006+0000","last_peered":"2024-04-19T03:06:47.638006+0000","last_clean":"2024-04-19T03:06:47.638006+0000","last_became_active":"2024-04-19T03:05:09.390922+0000","last_became_peered":"2024-04-19T03:05:09.390922+0000","last_unstale":"2024-04-19T03:06:47.638006+0000","last_undegraded":"2024-04-19T03:06:47.638006+0000","last_fullsized":"2024-04-19T03:06:47.638006+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:06:47.637955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:06:47.637955+0000","last_clean_scrub_stamp":"2024-04-19T03:06:47.637955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:09:45.240812+0000","scrub_duration":0.0031891229999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":62,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:21.387816+0000","last_change":"2024-04-19T03:05:21.387930+0000","last_active":"2024-04-19T03:05:21.387816+0000","last_peered":"2024-04-19T03:05:21.387816+0000","last_clean":"2024-04-19T03:05:21.387816+0000","last_became_active":"2024-04-19T03:05:09.393108+0000","last_became_peered":"2024-04-19T03:05:09.393108+0000","last_unstale":"2024-04-19T03:05:21.387816+0000","last_undegraded":"2024-04-19T03:05:21.387816+0000","last_fullsized":"2024-04-19T03:05:21.387816+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:05:21.387796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:05:21.387796+0000","last_clean_scrub_stamp":"2024-04-19T03:05:21.387796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:19:53.306617+0000","scrub_duration":0.042477411999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":42,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:06:33.811525+0000","last_change":"2024-04-19T03:06:33.811525+0000","last_active":"2024-04-19T03:06:33.811525+0000","last_peered":"2024-04-19T03:06:33.811525+0000","last_clean":"2024-04-19T03:06:33.811525+0000","last_became_active":"2024-04-19T03:04:50.617603+0000","last_became_peered":"2024-04-19T03:04:50.617603+0000","last_unstale":"2024-04-19T03:06:33.811525+0000","last_undegraded":"2024-04-19T03:06:33.811525+0000","last_fullsized":"2024-04-19T03:06:33.811525+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:06:33.811226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:06:33.811226+0000","last_clean_scrub_stamp":"2024-04-19T03:06:33.811226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:21:48.264717+0000","scrub_duration":0.0037391880000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":39,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:13.201146+0000","last_change":"2024-04-19T03:05:11.431713+0000","last_active":"2024-04-19T03:05:13.201146+0000","last_peered":"2024-04-19T03:05:13.201146+0000","last_clean":"2024-04-19T03:05:13.201146+0000","last_became_active":"2024-04-19T03:05:11.431129+0000","last_became_peered":"2024-04-19T03:05:11.431129+0000","last_unstale":"2024-04-19T03:05:13.201146+0000","last_undegraded":"2024-04-19T03:05:13.201146+0000","last_fullsized":"2024-04-19T03:05:13.201146+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":84,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:06:32.430270+0000","last_change":"2024-04-19T03:06:32.430512+0000","last_active":"2024-04-19T03:06:32.430270+0000","last_peered":"2024-04-19T03:06:32.430270+0000","last_clean":"2024-04-19T03:06:32.430270+0000","last_became_active":"2024-04-19T03:01:15.019064+0000","last_became_peered":"2024-04-19T03:01:15.019064+0000","last_unstale":"2024-04-19T03:06:32.430270+0000","last_undegraded":"2024-04-19T03:06:32.430270+0000","last_fullsized":"2024-04-19T03:06:32.430270+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:06:32.430223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:06:32.430223+0000","last_clean_scrub_stamp":"2024-04-19T03:06:32.430223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:34:42.952137+0000","scrub_duration":0.0035361289999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":42,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:06:07.960749+0000","last_change":"2024-04-19T03:06:07.960749+0000","last_active":"2024-04-19T03:06:07.960749+0000","last_peered":"2024-04-19T03:06:07.960749+0000","last_clean":"2024-04-19T03:06:07.960749+0000","last_became_active":"2024-04-19T03:04:50.616550+0000","last_became_peered":"2024-04-19T03:04:50.616550+0000","last_unstale":"2024-04-19T03:06:07.960749+0000","last_undegraded":"2024-04-19T03:06:07.960749+0000","last_fullsized":"2024-04-19T03:06:07.960749+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:06:07.960587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:06:07.960587+0000","last_clean_scrub_stamp":"2024-04-19T03:06:07.960587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:55:45.489295+0000","scrub_duration":0.038393915000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":62,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:41.381935+0000","last_change":"2024-04-19T03:05:41.382171+0000","last_active":"2024-04-19T03:05:41.381935+0000","last_peered":"2024-04-19T03:05:41.381935+0000","last_clean":"2024-04-19T03:05:41.381935+0000","last_became_active":"2024-04-19T03:05:09.393178+0000","last_became_peered":"2024-04-19T03:05:09.393178+0000","last_unstale":"2024-04-19T03:05:41.381935+0000","last_undegraded":"2024-04-19T03:05:41.381935+0000","last_fullsized":"2024-04-19T03:05:41.381935+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:05:41.381892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:05:41.381892+0000","last_clean_scrub_stamp":"2024-04-19T03:05:41.381892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:26:44.553697+0000","scrub_duration":0.0032496449999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":42,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:40.160372+0000","last_change":"2024-04-19T03:05:40.160372+0000","last_active":"2024-04-19T03:05:40.160372+0000","last_peered":"2024-04-19T03:05:40.160372+0000","last_clean":"2024-04-19T03:05:40.160372+0000","last_became_active":"2024-04-19T03:04:50.633033+0000","last_became_peered":"2024-04-19T03:04:50.633033+0000","last_unstale":"2024-04-19T03:05:40.160372+0000","last_undegraded":"2024-04-19T03:05:40.160372+0000","last_fullsized":"2024-04-19T03:05:40.160372+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:05:40.160035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:05:40.160035+0000","last_clean_scrub_stamp":"2024-04-19T03:05:40.160035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:22:24.075162+0000","scrub_duration":0.0035144400000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":97,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:45.098945+0000","last_change":"2024-04-19T03:05:45.099168+0000","last_active":"2024-04-19T03:05:45.098945+0000","last_peered":"2024-04-19T03:05:45.098945+0000","last_clean":"2024-04-19T03:05:45.098945+0000","last_became_active":"2024-04-19T03:04:50.278996+0000","last_became_peered":"2024-04-19T03:04:50.278996+0000","last_unstale":"2024-04-19T03:05:45.098945+0000","last_undegraded":"2024-04-19T03:05:45.098945+0000","last_fullsized":"2024-04-19T03:05:45.098945+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:05:45.098897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:05:45.098897+0000","last_clean_scrub_stamp":"2024-04-19T03:05:45.098897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:59:51.710788+0000","scrub_duration":0.0034812490000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":90,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:34.468578+0000","last_change":"2024-04-19T03:05:34.468578+0000","last_active":"2024-04-19T03:05:34.468578+0000","last_peered":"2024-04-19T03:05:34.468578+0000","last_clean":"2024-04-19T03:05:34.468578+0000","last_became_active":"2024-04-19T03:05:09.395920+0000","last_became_peered":"2024-04-19T03:05:09.395920+0000","last_unstale":"2024-04-19T03:05:34.468578+0000","last_undegraded":"2024-04-19T03:05:34.468578+0000","last_fullsized":"2024-04-19T03:05:34.468578+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:05:34.468305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:05:34.468305+0000","last_clean_scrub_stamp":"2024-04-19T03:05:34.468305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:54:24.688379+0000","scrub_duration":0.003618422,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"81'4","reported_seq":102,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:06:51.983417+0000","last_change":"2024-04-19T03:06:51.983662+0000","last_active":"2024-04-19T03:06:51.983417+0000","last_peered":"2024-04-19T03:06:51.983417+0000","last_clean":"2024-04-19T03:06:51.983417+0000","last_became_active":"2024-04-19T03:04:50.276732+0000","last_became_peered":"2024-04-19T03:04:50.276732+0000","last_unstale":"2024-04-19T03:06:51.983417+0000","last_undegraded":"2024-04-19T03:06:51.983417+0000","last_fullsized":"2024-04-19T03:06:51.983417+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'4","last_scrub_stamp":"2024-04-19T03:06:51.983369+0000","last_deep_scrub":"81'4","last_deep_scrub_stamp":"2024-04-19T03:06:51.983369+0000","last_clean_scrub_stamp":"2024-04-19T03:06:51.983369+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:57:39.432677+0000","scrub_duration":0.0081890490000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":79,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:19.240956+0000","last_change":"2024-04-19T03:05:09.395454+0000","last_active":"2024-04-19T03:05:19.240956+0000","last_peered":"2024-04-19T03:05:19.240956+0000","last_clean":"2024-04-19T03:05:19.240956+0000","last_became_active":"2024-04-19T03:05:09.394288+0000","last_became_peered":"2024-04-19T03:05:09.394288+0000","last_unstale":"2024-04-19T03:05:19.240956+0000","last_undegraded":"2024-04-19T03:05:19.240956+0000","last_fullsized":"2024-04-19T03:05:19.240956+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":42,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:06:25.884128+0000","last_change":"2024-04-19T03:06:25.884362+0000","last_active":"2024-04-19T03:06:25.884128+0000","last_peered":"2024-04-19T03:06:25.884128+0000","last_clean":"2024-04-19T03:06:25.884128+0000","last_became_active":"2024-04-19T03:04:50.628023+0000","last_became_peered":"2024-04-19T03:04:50.628023+0000","last_unstale":"2024-04-19T03:06:25.884128+0000","last_undegraded":"2024-04-19T03:06:25.884128+0000","last_fullsized":"2024-04-19T03:06:25.884128+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:06:25.884074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:06:25.884074+0000","last_clean_scrub_stamp":"2024-04-19T03:06:25.884074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:52:59.822891+0000","scrub_duration":0.003424585,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":41,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:22.156343+0000","last_change":"2024-04-19T03:05:22.156583+0000","last_active":"2024-04-19T03:05:22.156343+0000","last_peered":"2024-04-19T03:05:22.156343+0000","last_clean":"2024-04-19T03:05:22.156343+0000","last_became_active":"2024-04-19T03:04:50.613860+0000","last_became_peered":"2024-04-19T03:04:50.613860+0000","last_unstale":"2024-04-19T03:05:22.156343+0000","last_undegraded":"2024-04-19T03:05:22.156343+0000","last_fullsized":"2024-04-19T03:05:22.156343+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:05:22.156296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:05:22.156296+0000","last_clean_scrub_stamp":"2024-04-19T03:05:22.156296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:47:31.989944+0000","scrub_duration":0.0031789600000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":85,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:06:29.458856+0000","last_change":"2024-04-19T03:06:29.459075+0000","last_active":"2024-04-19T03:06:29.458856+0000","last_peered":"2024-04-19T03:06:29.458856+0000","last_clean":"2024-04-19T03:06:29.458856+0000","last_became_active":"2024-04-19T03:01:14.648217+0000","last_became_peered":"2024-04-19T03:01:14.648217+0000","last_unstale":"2024-04-19T03:06:29.458856+0000","last_undegraded":"2024-04-19T03:06:29.458856+0000","last_fullsized":"2024-04-19T03:06:29.458856+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:06:29.458807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:06:29.458807+0000","last_clean_scrub_stamp":"2024-04-19T03:06:29.458807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:06:55.513182+0000","scrub_duration":0.0031327,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":41,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:06:09.016060+0000","last_change":"2024-04-19T03:06:09.016173+0000","last_active":"2024-04-19T03:06:09.016060+0000","last_peered":"2024-04-19T03:06:09.016060+0000","last_clean":"2024-04-19T03:06:09.016060+0000","last_became_active":"2024-04-19T03:04:50.610659+0000","last_became_peered":"2024-04-19T03:04:50.610659+0000","last_unstale":"2024-04-19T03:06:09.016060+0000","last_undegraded":"2024-04-19T03:06:09.016060+0000","last_fullsized":"2024-04-19T03:06:09.016060+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:06:09.016037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:06:09.016037+0000","last_clean_scrub_stamp":"2024-04-19T03:06:09.016037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:53:27.685552+0000","scrub_duration":0.059919361999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"81'12","reported_seq":102,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:06:20.048514+0000","last_change":"2024-04-19T03:06:20.048753+0000","last_active":"2024-04-19T03:06:20.048514+0000","last_peered":"2024-04-19T03:06:20.048514+0000","last_clean":"2024-04-19T03:06:20.048514+0000","last_became_active":"2024-04-19T03:05:11.428668+0000","last_became_peered":"2024-04-19T03:05:11.428668+0000","last_unstale":"2024-04-19T03:06:20.048514+0000","last_undegraded":"2024-04-19T03:06:20.048514+0000","last_fullsized":"2024-04-19T03:06:20.048514+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'12","last_scrub_stamp":"2024-04-19T03:06:20.048463+0000","last_deep_scrub":"81'12","last_deep_scrub_stamp":"2024-04-19T03:06:20.048463+0000","last_clean_scrub_stamp":"2024-04-19T03:06:20.048463+0000","objects_scrubbed":4,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:09:17.651320+0000","scrub_duration":0.0095854819999999993,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"81'2","reported_seq":87,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:06:50.939516+0000","last_change":"2024-04-19T03:06:50.939859+0000","last_active":"2024-04-19T03:06:50.939516+0000","last_peered":"2024-04-19T03:06:50.939516+0000","last_clean":"2024-04-19T03:06:50.939516+0000","last_became_active":"2024-04-19T03:01:14.649571+0000","last_became_peered":"2024-04-19T03:01:14.649571+0000","last_unstale":"2024-04-19T03:06:50.939516+0000","last_undegraded":"2024-04-19T03:06:50.939516+0000","last_fullsized":"2024-04-19T03:06:50.939516+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'2","last_scrub_stamp":"2024-04-19T03:06:50.939465+0000","last_deep_scrub":"81'2","last_deep_scrub_stamp":"2024-04-19T03:06:50.939465+0000","last_clean_scrub_stamp":"2024-04-19T03:06:50.939465+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:42:55.713909+0000","scrub_duration":0.0063370750000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":65,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:06:14.509847+0000","last_change":"2024-04-19T03:06:14.510089+0000","last_active":"2024-04-19T03:06:14.509847+0000","last_peered":"2024-04-19T03:06:14.509847+0000","last_clean":"2024-04-19T03:06:14.509847+0000","last_became_active":"2024-04-19T03:05:02.362227+0000","last_became_peered":"2024-04-19T03:05:02.362227+0000","last_unstale":"2024-04-19T03:06:14.509847+0000","last_undegraded":"2024-04-19T03:06:14.509847+0000","last_fullsized":"2024-04-19T03:06:14.509847+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:06:14.509801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:06:14.509801+0000","last_clean_scrub_stamp":"2024-04-19T03:06:14.509801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:30:22.470364+0000","scrub_duration":0.0034446279999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"81'3","reported_seq":88,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:06:20.473744+0000","last_change":"2024-04-19T03:06:20.474018+0000","last_active":"2024-04-19T03:06:20.473744+0000","last_peered":"2024-04-19T03:06:20.473744+0000","last_clean":"2024-04-19T03:06:20.473744+0000","last_became_active":"2024-04-19T03:01:14.644790+0000","last_became_peered":"2024-04-19T03:01:14.644790+0000","last_unstale":"2024-04-19T03:06:20.473744+0000","last_undegraded":"2024-04-19T03:06:20.473744+0000","last_fullsized":"2024-04-19T03:06:20.473744+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'3","last_scrub_stamp":"2024-04-19T03:06:20.473693+0000","last_deep_scrub":"81'3","last_deep_scrub_stamp":"2024-04-19T03:06:20.473693+0000","last_clean_scrub_stamp":"2024-04-19T03:06:20.473693+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:12:42.519676+0000","scrub_duration":0.0061567130000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":90,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:06:04.548975+0000","last_change":"2024-04-19T03:06:04.549223+0000","last_active":"2024-04-19T03:06:04.548975+0000","last_peered":"2024-04-19T03:06:04.548975+0000","last_clean":"2024-04-19T03:06:04.548975+0000","last_became_active":"2024-04-19T03:05:09.392736+0000","last_became_peered":"2024-04-19T03:05:09.392736+0000","last_unstale":"2024-04-19T03:06:04.548975+0000","last_undegraded":"2024-04-19T03:06:04.548975+0000","last_fullsized":"2024-04-19T03:06:04.548975+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:06:04.548929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:06:04.548929+0000","last_clean_scrub_stamp":"2024-04-19T03:06:04.548929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:15:59.783247+0000","scrub_duration":0.0033845059999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"20'1","reported_seq":41,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:13.201186+0000","last_change":"2024-04-19T03:05:11.431892+0000","last_active":"2024-04-19T03:05:13.201186+0000","last_peered":"2024-04-19T03:05:13.201186+0000","last_clean":"2024-04-19T03:05:13.201186+0000","last_became_active":"2024-04-19T03:05:11.431552+0000","last_became_peered":"2024-04-19T03:05:11.431552+0000","last_unstale":"2024-04-19T03:05:13.201186+0000","last_undegraded":"2024-04-19T03:05:13.201186+0000","last_fullsized":"2024-04-19T03:05:13.201186+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":97,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:06:05.975879+0000","last_change":"2024-04-19T03:06:05.976137+0000","last_active":"2024-04-19T03:06:05.975879+0000","last_peered":"2024-04-19T03:06:05.975879+0000","last_clean":"2024-04-19T03:06:05.975879+0000","last_became_active":"2024-04-19T03:04:50.277126+0000","last_became_peered":"2024-04-19T03:04:50.277126+0000","last_unstale":"2024-04-19T03:06:05.975879+0000","last_undegraded":"2024-04-19T03:06:05.975879+0000","last_fullsized":"2024-04-19T03:06:05.975879+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:06:05.975834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:06:05.975834+0000","last_clean_scrub_stamp":"2024-04-19T03:06:05.975834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:20:51.285647+0000","scrub_duration":0.003132653,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":73,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:19.713832+0000","last_change":"2024-04-19T03:05:11.429040+0000","last_active":"2024-04-19T03:05:19.713832+0000","last_peered":"2024-04-19T03:05:19.713832+0000","last_clean":"2024-04-19T03:05:19.713832+0000","last_became_active":"2024-04-19T03:05:11.428722+0000","last_became_peered":"2024-04-19T03:05:11.428722+0000","last_unstale":"2024-04-19T03:05:19.713832+0000","last_undegraded":"2024-04-19T03:05:19.713832+0000","last_fullsized":"2024-04-19T03:05:19.713832+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":41,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:06:37.889374+0000","last_change":"2024-04-19T03:06:37.889743+0000","last_active":"2024-04-19T03:06:37.889374+0000","last_peered":"2024-04-19T03:06:37.889374+0000","last_clean":"2024-04-19T03:06:37.889374+0000","last_became_active":"2024-04-19T03:04:50.625919+0000","last_became_peered":"2024-04-19T03:04:50.625919+0000","last_unstale":"2024-04-19T03:06:37.889374+0000","last_undegraded":"2024-04-19T03:06:37.889374+0000","last_fullsized":"2024-04-19T03:06:37.889374+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:06:37.889307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:06:37.889307+0000","last_clean_scrub_stamp":"2024-04-19T03:06:37.889307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:07:23.625279+0000","scrub_duration":0.033935805999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"81'3","reported_seq":45,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:06:29.761366+0000","last_change":"2024-04-19T03:06:29.761629+0000","last_active":"2024-04-19T03:06:29.761366+0000","last_peered":"2024-04-19T03:06:29.761366+0000","last_clean":"2024-04-19T03:06:29.761366+0000","last_became_active":"2024-04-19T03:04:50.625931+0000","last_became_peered":"2024-04-19T03:04:50.625931+0000","last_unstale":"2024-04-19T03:06:29.761366+0000","last_undegraded":"2024-04-19T03:06:29.761366+0000","last_fullsized":"2024-04-19T03:06:29.761366+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'3","last_scrub_stamp":"2024-04-19T03:06:29.761304+0000","last_deep_scrub":"81'3","last_deep_scrub_stamp":"2024-04-19T03:06:29.761304+0000","last_clean_scrub_stamp":"2024-04-19T03:06:29.761304+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:21:37.427888+0000","scrub_duration":0.0062219290000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":88,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:19.714149+0000","last_change":"2024-04-19T03:05:11.430496+0000","last_active":"2024-04-19T03:05:19.714149+0000","last_peered":"2024-04-19T03:05:19.714149+0000","last_clean":"2024-04-19T03:05:19.714149+0000","last_became_active":"2024-04-19T03:05:11.430149+0000","last_became_peered":"2024-04-19T03:05:11.430149+0000","last_unstale":"2024-04-19T03:05:19.714149+0000","last_undegraded":"2024-04-19T03:05:19.714149+0000","last_fullsized":"2024-04-19T03:05:19.714149+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":98,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:06:41.856003+0000","last_change":"2024-04-19T03:06:41.856220+0000","last_active":"2024-04-19T03:06:41.856003+0000","last_peered":"2024-04-19T03:06:41.856003+0000","last_clean":"2024-04-19T03:06:41.856003+0000","last_became_active":"2024-04-19T03:04:50.277603+0000","last_became_peered":"2024-04-19T03:04:50.277603+0000","last_unstale":"2024-04-19T03:06:41.856003+0000","last_undegraded":"2024-04-19T03:06:41.856003+0000","last_fullsized":"2024-04-19T03:06:41.856003+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:06:41.855956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:06:41.855956+0000","last_clean_scrub_stamp":"2024-04-19T03:06:41.855956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:11:30.543967+0000","scrub_duration":0.003228828,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":84,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:46.144344+0000","last_change":"2024-04-19T03:05:46.144560+0000","last_active":"2024-04-19T03:05:46.144344+0000","last_peered":"2024-04-19T03:05:46.144344+0000","last_clean":"2024-04-19T03:05:46.144344+0000","last_became_active":"2024-04-19T03:01:15.014847+0000","last_became_peered":"2024-04-19T03:01:15.014847+0000","last_unstale":"2024-04-19T03:05:46.144344+0000","last_undegraded":"2024-04-19T03:05:46.144344+0000","last_fullsized":"2024-04-19T03:05:46.144344+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:05:46.144300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:05:46.144300+0000","last_clean_scrub_stamp":"2024-04-19T03:05:46.144300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:43:25.191286+0000","scrub_duration":0.0032320750000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":63,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:42.387222+0000","last_change":"2024-04-19T03:05:42.387451+0000","last_active":"2024-04-19T03:05:42.387222+0000","last_peered":"2024-04-19T03:05:42.387222+0000","last_clean":"2024-04-19T03:05:42.387222+0000","last_became_active":"2024-04-19T03:05:09.391218+0000","last_became_peered":"2024-04-19T03:05:09.391218+0000","last_unstale":"2024-04-19T03:05:42.387222+0000","last_undegraded":"2024-04-19T03:05:42.387222+0000","last_fullsized":"2024-04-19T03:05:42.387222+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:05:42.387178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:05:42.387178+0000","last_clean_scrub_stamp":"2024-04-19T03:05:42.387178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:52:14.035747+0000","scrub_duration":0.003459981,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":84,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:06:01.981674+0000","last_change":"2024-04-19T03:06:01.981909+0000","last_active":"2024-04-19T03:06:01.981674+0000","last_peered":"2024-04-19T03:06:01.981674+0000","last_clean":"2024-04-19T03:06:01.981674+0000","last_became_active":"2024-04-19T03:01:15.014421+0000","last_became_peered":"2024-04-19T03:01:15.014421+0000","last_unstale":"2024-04-19T03:06:01.981674+0000","last_undegraded":"2024-04-19T03:06:01.981674+0000","last_fullsized":"2024-04-19T03:06:01.981674+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:06:01.981618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:06:01.981618+0000","last_clean_scrub_stamp":"2024-04-19T03:06:01.981618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:06:28.035993+0000","scrub_duration":0.0033942379999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":91,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:50.475678+0000","last_change":"2024-04-19T03:05:50.475892+0000","last_active":"2024-04-19T03:05:50.475678+0000","last_peered":"2024-04-19T03:05:50.475678+0000","last_clean":"2024-04-19T03:05:50.475678+0000","last_became_active":"2024-04-19T03:05:09.395294+0000","last_became_peered":"2024-04-19T03:05:09.395294+0000","last_unstale":"2024-04-19T03:05:50.475678+0000","last_undegraded":"2024-04-19T03:05:50.475678+0000","last_fullsized":"2024-04-19T03:05:50.475678+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:05:50.475630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:05:50.475630+0000","last_clean_scrub_stamp":"2024-04-19T03:05:50.475630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:03:15.099595+0000","scrub_duration":0.0034712469999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":41,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:50.148906+0000","last_change":"2024-04-19T03:05:50.149020+0000","last_active":"2024-04-19T03:05:50.148906+0000","last_peered":"2024-04-19T03:05:50.148906+0000","last_clean":"2024-04-19T03:05:50.148906+0000","last_became_active":"2024-04-19T03:04:50.617323+0000","last_became_peered":"2024-04-19T03:04:50.617323+0000","last_unstale":"2024-04-19T03:05:50.148906+0000","last_undegraded":"2024-04-19T03:05:50.148906+0000","last_fullsized":"2024-04-19T03:05:50.148906+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:05:50.148885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:05:50.148885+0000","last_clean_scrub_stamp":"2024-04-19T03:05:50.148885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:47:33.437890+0000","scrub_duration":0.061933355000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"14'157","reported_seq":280,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:13.200849+0000","last_change":"2024-04-19T03:05:11.429096+0000","last_active":"2024-04-19T03:05:13.200849+0000","last_peered":"2024-04-19T03:05:13.200849+0000","last_clean":"2024-04-19T03:05:13.200849+0000","last_became_active":"2024-04-19T03:05:11.426859+0000","last_became_peered":"2024-04-19T03:05:11.426859+0000","last_unstale":"2024-04-19T03:05:13.200849+0000","last_undegraded":"2024-04-19T03:05:13.200849+0000","last_fullsized":"2024-04-19T03:05:13.200849+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:06.516863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:06.516863+0000","last_clean_scrub_stamp":"2024-04-19T03:01:06.516863+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":100,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:06:39.925326+0000","last_change":"2024-04-19T03:06:39.925555+0000","last_active":"2024-04-19T03:06:39.925326+0000","last_peered":"2024-04-19T03:06:39.925326+0000","last_clean":"2024-04-19T03:06:39.925326+0000","last_became_active":"2024-04-19T03:04:50.276132+0000","last_became_peered":"2024-04-19T03:04:50.276132+0000","last_unstale":"2024-04-19T03:06:39.925326+0000","last_undegraded":"2024-04-19T03:06:39.925326+0000","last_fullsized":"2024-04-19T03:06:39.925326+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:06:39.925283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:06:39.925283+0000","last_clean_scrub_stamp":"2024-04-19T03:06:39.925283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:33:03.142481+0000","scrub_duration":0.003497624,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":43,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:06:39.867467+0000","last_change":"2024-04-19T03:06:39.867467+0000","last_active":"2024-04-19T03:06:39.867467+0000","last_peered":"2024-04-19T03:06:39.867467+0000","last_clean":"2024-04-19T03:06:39.867467+0000","last_became_active":"2024-04-19T03:04:50.628741+0000","last_became_peered":"2024-04-19T03:04:50.628741+0000","last_unstale":"2024-04-19T03:06:39.867467+0000","last_undegraded":"2024-04-19T03:06:39.867467+0000","last_fullsized":"2024-04-19T03:06:39.867467+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:06:39.867164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:06:39.867164+0000","last_clean_scrub_stamp":"2024-04-19T03:06:39.867164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:23:45.017629+0000","scrub_duration":0.0032584530000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":86,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:37.209852+0000","last_change":"2024-04-19T03:05:37.210309+0000","last_active":"2024-04-19T03:05:37.209852+0000","last_peered":"2024-04-19T03:05:37.209852+0000","last_clean":"2024-04-19T03:05:37.209852+0000","last_became_active":"2024-04-19T03:05:11.430881+0000","last_became_peered":"2024-04-19T03:05:11.430881+0000","last_unstale":"2024-04-19T03:05:37.209852+0000","last_undegraded":"2024-04-19T03:05:37.209852+0000","last_fullsized":"2024-04-19T03:05:37.209852+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:05:37.209759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:05:37.209759+0000","last_clean_scrub_stamp":"2024-04-19T03:05:37.209759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:52:10.997951+0000","scrub_duration":0.0033919810000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":87,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:06:37.919350+0000","last_change":"2024-04-19T03:06:37.919668+0000","last_active":"2024-04-19T03:06:37.919350+0000","last_peered":"2024-04-19T03:06:37.919350+0000","last_clean":"2024-04-19T03:06:37.919350+0000","last_became_active":"2024-04-19T03:01:10.601381+0000","last_became_peered":"2024-04-19T03:01:10.601381+0000","last_unstale":"2024-04-19T03:06:37.919350+0000","last_undegraded":"2024-04-19T03:06:37.919350+0000","last_fullsized":"2024-04-19T03:06:37.919350+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:06:37.919255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:06:37.919255+0000","last_clean_scrub_stamp":"2024-04-19T03:06:37.919255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:21:20.594119+0000","scrub_duration":0.0035509640000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":43,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:58.945975+0000","last_change":"2024-04-19T03:05:58.945975+0000","last_active":"2024-04-19T03:05:58.945975+0000","last_peered":"2024-04-19T03:05:58.945975+0000","last_clean":"2024-04-19T03:05:58.945975+0000","last_became_active":"2024-04-19T03:04:50.631721+0000","last_became_peered":"2024-04-19T03:04:50.631721+0000","last_unstale":"2024-04-19T03:05:58.945975+0000","last_undegraded":"2024-04-19T03:05:58.945975+0000","last_fullsized":"2024-04-19T03:05:58.945975+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:05:58.945528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:05:58.945528+0000","last_clean_scrub_stamp":"2024-04-19T03:05:58.945528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:00:41.372378+0000","scrub_duration":0.0034170619999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":90,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:45.465307+0000","last_change":"2024-04-19T03:05:45.465610+0000","last_active":"2024-04-19T03:05:45.465307+0000","last_peered":"2024-04-19T03:05:45.465307+0000","last_clean":"2024-04-19T03:05:45.465307+0000","last_became_active":"2024-04-19T03:05:09.395167+0000","last_became_peered":"2024-04-19T03:05:09.395167+0000","last_unstale":"2024-04-19T03:05:45.465307+0000","last_undegraded":"2024-04-19T03:05:45.465307+0000","last_fullsized":"2024-04-19T03:05:45.465307+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:05:45.465258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:05:45.465258+0000","last_clean_scrub_stamp":"2024-04-19T03:05:45.465258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:21:36.562113+0000","scrub_duration":0.0030148670000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":42,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:19.169049+0000","last_change":"2024-04-19T03:05:19.169049+0000","last_active":"2024-04-19T03:05:19.169049+0000","last_peered":"2024-04-19T03:05:19.169049+0000","last_clean":"2024-04-19T03:05:19.169049+0000","last_became_active":"2024-04-19T03:04:50.633457+0000","last_became_peered":"2024-04-19T03:04:50.633457+0000","last_unstale":"2024-04-19T03:05:19.169049+0000","last_undegraded":"2024-04-19T03:05:19.169049+0000","last_fullsized":"2024-04-19T03:05:19.169049+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:05:19.154005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:05:19.154005+0000","last_clean_scrub_stamp":"2024-04-19T03:05:19.154005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:23:03.401654+0000","scrub_duration":0.0034373889999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":85,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:06:17.477003+0000","last_change":"2024-04-19T03:06:17.477233+0000","last_active":"2024-04-19T03:06:17.477003+0000","last_peered":"2024-04-19T03:06:17.477003+0000","last_clean":"2024-04-19T03:06:17.477003+0000","last_became_active":"2024-04-19T03:01:14.648082+0000","last_became_peered":"2024-04-19T03:01:14.648082+0000","last_unstale":"2024-04-19T03:06:17.477003+0000","last_undegraded":"2024-04-19T03:06:17.477003+0000","last_fullsized":"2024-04-19T03:06:17.477003+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:06:17.476956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:06:17.476956+0000","last_clean_scrub_stamp":"2024-04-19T03:06:17.476956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:39:26.053028+0000","scrub_duration":0.0037432979999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":42,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:34.131042+0000","last_change":"2024-04-19T03:05:34.131042+0000","last_active":"2024-04-19T03:05:34.131042+0000","last_peered":"2024-04-19T03:05:34.131042+0000","last_clean":"2024-04-19T03:05:34.131042+0000","last_became_active":"2024-04-19T03:04:50.617628+0000","last_became_peered":"2024-04-19T03:04:50.617628+0000","last_unstale":"2024-04-19T03:05:34.131042+0000","last_undegraded":"2024-04-19T03:05:34.131042+0000","last_fullsized":"2024-04-19T03:05:34.131042+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:05:34.130897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:05:34.130897+0000","last_clean_scrub_stamp":"2024-04-19T03:05:34.130897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:03:56.628506+0000","scrub_duration":0.037678018000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":100,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:06:35.980673+0000","last_change":"2024-04-19T03:06:35.980893+0000","last_active":"2024-04-19T03:06:35.980673+0000","last_peered":"2024-04-19T03:06:35.980673+0000","last_clean":"2024-04-19T03:06:35.980673+0000","last_became_active":"2024-04-19T03:04:50.277804+0000","last_became_peered":"2024-04-19T03:04:50.277804+0000","last_unstale":"2024-04-19T03:06:35.980673+0000","last_undegraded":"2024-04-19T03:06:35.980673+0000","last_fullsized":"2024-04-19T03:06:35.980673+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:06:35.980623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:06:35.980623+0000","last_clean_scrub_stamp":"2024-04-19T03:06:35.980623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:26:56.354414+0000","scrub_duration":0.0034104700000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":98,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:06:45.892733+0000","last_change":"2024-04-19T03:06:45.892978+0000","last_active":"2024-04-19T03:06:45.892733+0000","last_peered":"2024-04-19T03:06:45.892733+0000","last_clean":"2024-04-19T03:06:45.892733+0000","last_became_active":"2024-04-19T03:04:50.275812+0000","last_became_peered":"2024-04-19T03:04:50.275812+0000","last_unstale":"2024-04-19T03:06:45.892733+0000","last_undegraded":"2024-04-19T03:06:45.892733+0000","last_fullsized":"2024-04-19T03:06:45.892733+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:06:45.892689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:06:45.892689+0000","last_clean_scrub_stamp":"2024-04-19T03:06:45.892689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:11:00.296153+0000","scrub_duration":0.0034004870000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":42,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:06:03.930425+0000","last_change":"2024-04-19T03:06:03.930425+0000","last_active":"2024-04-19T03:06:03.930425+0000","last_peered":"2024-04-19T03:06:03.930425+0000","last_clean":"2024-04-19T03:06:03.930425+0000","last_became_active":"2024-04-19T03:04:50.614774+0000","last_became_peered":"2024-04-19T03:04:50.614774+0000","last_unstale":"2024-04-19T03:06:03.930425+0000","last_undegraded":"2024-04-19T03:06:03.930425+0000","last_fullsized":"2024-04-19T03:06:03.930425+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:06:03.930122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:06:03.930122+0000","last_clean_scrub_stamp":"2024-04-19T03:06:03.930122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:28:52.187857+0000","scrub_duration":0.003163627,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":84,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:22.163334+0000","last_change":"2024-04-19T03:05:22.163334+0000","last_active":"2024-04-19T03:05:22.163334+0000","last_peered":"2024-04-19T03:05:22.163334+0000","last_clean":"2024-04-19T03:05:22.163334+0000","last_became_active":"2024-04-19T03:05:11.429941+0000","last_became_peered":"2024-04-19T03:05:11.429941+0000","last_unstale":"2024-04-19T03:05:22.163334+0000","last_undegraded":"2024-04-19T03:05:22.163334+0000","last_fullsized":"2024-04-19T03:05:22.163334+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:05:22.163031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:05:22.163031+0000","last_clean_scrub_stamp":"2024-04-19T03:05:22.163031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:21:13.259886+0000","scrub_duration":0.0032565699999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":42,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:26.113394+0000","last_change":"2024-04-19T03:05:26.113394+0000","last_active":"2024-04-19T03:05:26.113394+0000","last_peered":"2024-04-19T03:05:26.113394+0000","last_clean":"2024-04-19T03:05:26.113394+0000","last_became_active":"2024-04-19T03:04:50.614498+0000","last_became_peered":"2024-04-19T03:04:50.614498+0000","last_unstale":"2024-04-19T03:05:26.113394+0000","last_undegraded":"2024-04-19T03:05:26.113394+0000","last_fullsized":"2024-04-19T03:05:26.113394+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:05:26.113130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:05:26.113130+0000","last_clean_scrub_stamp":"2024-04-19T03:05:26.113130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:38:46.443254+0000","scrub_duration":0.0031920770000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":62,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:06:10.525215+0000","last_change":"2024-04-19T03:06:10.525475+0000","last_active":"2024-04-19T03:06:10.525215+0000","last_peered":"2024-04-19T03:06:10.525215+0000","last_clean":"2024-04-19T03:06:10.525215+0000","last_became_active":"2024-04-19T03:05:09.394024+0000","last_became_peered":"2024-04-19T03:05:09.394024+0000","last_unstale":"2024-04-19T03:06:10.525215+0000","last_undegraded":"2024-04-19T03:06:10.525215+0000","last_fullsized":"2024-04-19T03:06:10.525215+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:06:10.525171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:06:10.525171+0000","last_clean_scrub_stamp":"2024-04-19T03:06:10.525171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:00:17.137062+0000","scrub_duration":0.00337156,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":43,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:33.132791+0000","last_change":"2024-04-19T03:05:33.132791+0000","last_active":"2024-04-19T03:05:33.132791+0000","last_peered":"2024-04-19T03:05:33.132791+0000","last_clean":"2024-04-19T03:05:33.132791+0000","last_became_active":"2024-04-19T03:04:50.615238+0000","last_became_peered":"2024-04-19T03:04:50.615238+0000","last_unstale":"2024-04-19T03:05:33.132791+0000","last_undegraded":"2024-04-19T03:05:33.132791+0000","last_fullsized":"2024-04-19T03:05:33.132791+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:05:33.132481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:05:33.132481+0000","last_clean_scrub_stamp":"2024-04-19T03:05:33.132481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:12:12.823889+0000","scrub_duration":0.0033373280000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":83,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:19.240328+0000","last_change":"2024-04-19T03:05:09.397542+0000","last_active":"2024-04-19T03:05:19.240328+0000","last_peered":"2024-04-19T03:05:19.240328+0000","last_clean":"2024-04-19T03:05:19.240328+0000","last_became_active":"2024-04-19T03:05:09.396378+0000","last_became_peered":"2024-04-19T03:05:09.396378+0000","last_unstale":"2024-04-19T03:05:19.240328+0000","last_undegraded":"2024-04-19T03:05:19.240328+0000","last_fullsized":"2024-04-19T03:05:19.240328+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:09.578660+0000","last_clean_scrub_stamp":"2024-04-19T03:01:09.578660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":62,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:06:44.564903+0000","last_change":"2024-04-19T03:06:44.565127+0000","last_active":"2024-04-19T03:06:44.564903+0000","last_peered":"2024-04-19T03:06:44.564903+0000","last_clean":"2024-04-19T03:06:44.564903+0000","last_became_active":"2024-04-19T03:05:09.392437+0000","last_became_peered":"2024-04-19T03:05:09.392437+0000","last_unstale":"2024-04-19T03:06:44.564903+0000","last_undegraded":"2024-04-19T03:06:44.564903+0000","last_fullsized":"2024-04-19T03:06:44.564903+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:06:44.564859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:06:44.564859+0000","last_clean_scrub_stamp":"2024-04-19T03:06:44.564859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:25:14.945445+0000","scrub_duration":0.0033522159999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"81'3","reported_seq":46,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:57.906283+0000","last_change":"2024-04-19T03:05:57.906283+0000","last_active":"2024-04-19T03:05:57.906283+0000","last_peered":"2024-04-19T03:05:57.906283+0000","last_clean":"2024-04-19T03:05:57.906283+0000","last_became_active":"2024-04-19T03:04:50.611024+0000","last_became_peered":"2024-04-19T03:04:50.611024+0000","last_unstale":"2024-04-19T03:05:57.906283+0000","last_undegraded":"2024-04-19T03:05:57.906283+0000","last_fullsized":"2024-04-19T03:05:57.906283+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'3","last_scrub_stamp":"2024-04-19T03:05:57.905886+0000","last_deep_scrub":"81'3","last_deep_scrub_stamp":"2024-04-19T03:05:57.905886+0000","last_clean_scrub_stamp":"2024-04-19T03:05:57.905886+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:53:22.931871+0000","scrub_duration":0.006376273,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":42,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:06:14.878807+0000","last_change":"2024-04-19T03:06:14.878807+0000","last_active":"2024-04-19T03:06:14.878807+0000","last_peered":"2024-04-19T03:06:14.878807+0000","last_clean":"2024-04-19T03:06:14.878807+0000","last_became_active":"2024-04-19T03:04:50.612403+0000","last_became_peered":"2024-04-19T03:04:50.612403+0000","last_unstale":"2024-04-19T03:06:14.878807+0000","last_undegraded":"2024-04-19T03:06:14.878807+0000","last_fullsized":"2024-04-19T03:06:14.878807+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:06:14.878362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:06:14.878362+0000","last_clean_scrub_stamp":"2024-04-19T03:06:14.878362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:28:51.544909+0000","scrub_duration":0.0036263469999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":42,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:47.097999+0000","last_change":"2024-04-19T03:05:47.097999+0000","last_active":"2024-04-19T03:05:47.097999+0000","last_peered":"2024-04-19T03:05:47.097999+0000","last_clean":"2024-04-19T03:05:47.097999+0000","last_became_active":"2024-04-19T03:04:50.612987+0000","last_became_peered":"2024-04-19T03:04:50.612987+0000","last_unstale":"2024-04-19T03:05:47.097999+0000","last_undegraded":"2024-04-19T03:05:47.097999+0000","last_fullsized":"2024-04-19T03:05:47.097999+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:05:47.097698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:05:47.097698+0000","last_clean_scrub_stamp":"2024-04-19T03:05:47.097698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:08:39.534725+0000","scrub_duration":0.0032086129999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"81'2","reported_seq":47,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:46.119402+0000","last_change":"2024-04-19T03:05:46.119402+0000","last_active":"2024-04-19T03:05:46.119402+0000","last_peered":"2024-04-19T03:05:46.119402+0000","last_clean":"2024-04-19T03:05:46.119402+0000","last_became_active":"2024-04-19T03:04:50.612697+0000","last_became_peered":"2024-04-19T03:04:50.612697+0000","last_unstale":"2024-04-19T03:05:46.119402+0000","last_undegraded":"2024-04-19T03:05:46.119402+0000","last_fullsized":"2024-04-19T03:05:46.119402+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'2","last_scrub_stamp":"2024-04-19T03:05:46.119093+0000","last_deep_scrub":"81'2","last_deep_scrub_stamp":"2024-04-19T03:05:46.119093+0000","last_clean_scrub_stamp":"2024-04-19T03:05:46.119093+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:47:01.115618+0000","scrub_duration":0.0063348040000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":87,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:06:38.898941+0000","last_change":"2024-04-19T03:06:38.899164+0000","last_active":"2024-04-19T03:06:38.898941+0000","last_peered":"2024-04-19T03:06:38.898941+0000","last_clean":"2024-04-19T03:06:38.898941+0000","last_became_active":"2024-04-19T03:01:10.601487+0000","last_became_peered":"2024-04-19T03:01:10.601487+0000","last_unstale":"2024-04-19T03:06:38.898941+0000","last_undegraded":"2024-04-19T03:06:38.898941+0000","last_fullsized":"2024-04-19T03:06:38.898941+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:06:38.898894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:06:38.898894+0000","last_clean_scrub_stamp":"2024-04-19T03:06:38.898894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:34:09.708130+0000","scrub_duration":0.0032282109999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":84,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:06:33.414929+0000","last_change":"2024-04-19T03:06:33.415299+0000","last_active":"2024-04-19T03:06:33.414929+0000","last_peered":"2024-04-19T03:06:33.414929+0000","last_clean":"2024-04-19T03:06:33.414929+0000","last_became_active":"2024-04-19T03:01:15.018276+0000","last_became_peered":"2024-04-19T03:01:15.018276+0000","last_unstale":"2024-04-19T03:06:33.414929+0000","last_undegraded":"2024-04-19T03:06:33.414929+0000","last_fullsized":"2024-04-19T03:06:33.414929+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:06:33.414881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:06:33.414881+0000","last_clean_scrub_stamp":"2024-04-19T03:06:33.414881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:21:18.724694+0000","scrub_duration":0.0030956999999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":89,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:06:28.974256+0000","last_change":"2024-04-19T03:06:28.974608+0000","last_active":"2024-04-19T03:06:28.974256+0000","last_peered":"2024-04-19T03:06:28.974256+0000","last_clean":"2024-04-19T03:06:28.974256+0000","last_became_active":"2024-04-19T03:05:11.429214+0000","last_became_peered":"2024-04-19T03:05:11.429214+0000","last_unstale":"2024-04-19T03:06:28.974256+0000","last_undegraded":"2024-04-19T03:06:28.974256+0000","last_fullsized":"2024-04-19T03:06:28.974256+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:06:28.974167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:06:28.974167+0000","last_clean_scrub_stamp":"2024-04-19T03:06:28.974167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:45:50.999463+0000","scrub_duration":0.0034688119999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"81'10","reported_seq":100,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:29.315169+0000","last_change":"2024-04-19T03:05:29.315169+0000","last_active":"2024-04-19T03:05:29.315169+0000","last_peered":"2024-04-19T03:05:29.315169+0000","last_clean":"2024-04-19T03:05:29.315169+0000","last_became_active":"2024-04-19T03:05:11.430906+0000","last_became_peered":"2024-04-19T03:05:11.430906+0000","last_unstale":"2024-04-19T03:05:29.315169+0000","last_undegraded":"2024-04-19T03:05:29.315169+0000","last_fullsized":"2024-04-19T03:05:29.315169+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'10","last_scrub_stamp":"2024-04-19T03:05:29.314872+0000","last_deep_scrub":"81'10","last_deep_scrub_stamp":"2024-04-19T03:05:29.314872+0000","last_clean_scrub_stamp":"2024-04-19T03:05:29.314872+0000","objects_scrubbed":4,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:09:13.123950+0000","scrub_duration":0.0096666670000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":41,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:51.052208+0000","last_change":"2024-04-19T03:05:51.052464+0000","last_active":"2024-04-19T03:05:51.052208+0000","last_peered":"2024-04-19T03:05:51.052208+0000","last_clean":"2024-04-19T03:05:51.052208+0000","last_became_active":"2024-04-19T03:04:50.627654+0000","last_became_peered":"2024-04-19T03:04:50.627654+0000","last_unstale":"2024-04-19T03:05:51.052208+0000","last_undegraded":"2024-04-19T03:05:51.052208+0000","last_fullsized":"2024-04-19T03:05:51.052208+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:05:51.052162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:05:51.052162+0000","last_clean_scrub_stamp":"2024-04-19T03:05:51.052162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:45:11.062907+0000","scrub_duration":0.0030909259999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"20'3","reported_seq":55,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:12.421900+0000","last_change":"2024-04-19T03:05:09.398110+0000","last_active":"2024-04-19T03:05:12.421900+0000","last_peered":"2024-04-19T03:05:12.421900+0000","last_clean":"2024-04-19T03:05:12.421900+0000","last_became_active":"2024-04-19T03:05:09.397555+0000","last_became_peered":"2024-04-19T03:05:09.397555+0000","last_unstale":"2024-04-19T03:05:12.421900+0000","last_undegraded":"2024-04-19T03:05:12.421900+0000","last_fullsized":"2024-04-19T03:05:12.421900+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:13.604133+0000","last_clean_scrub_stamp":"2024-04-19T03:01:13.604133+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":84,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:30.281124+0000","last_change":"2024-04-19T03:05:30.281124+0000","last_active":"2024-04-19T03:05:30.281124+0000","last_peered":"2024-04-19T03:05:30.281124+0000","last_clean":"2024-04-19T03:05:30.281124+0000","last_became_active":"2024-04-19T03:05:11.428904+0000","last_became_peered":"2024-04-19T03:05:11.428904+0000","last_unstale":"2024-04-19T03:05:30.281124+0000","last_undegraded":"2024-04-19T03:05:30.281124+0000","last_fullsized":"2024-04-19T03:05:30.281124+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:05:30.280817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:05:30.280817+0000","last_clean_scrub_stamp":"2024-04-19T03:05:30.280817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:49:02.715913+0000","scrub_duration":0.0034631390000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":41,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:06:18.911655+0000","last_change":"2024-04-19T03:06:18.911905+0000","last_active":"2024-04-19T03:06:18.911655+0000","last_peered":"2024-04-19T03:06:18.911655+0000","last_clean":"2024-04-19T03:06:18.911655+0000","last_became_active":"2024-04-19T03:04:50.630873+0000","last_became_peered":"2024-04-19T03:04:50.630873+0000","last_unstale":"2024-04-19T03:06:18.911655+0000","last_undegraded":"2024-04-19T03:06:18.911655+0000","last_fullsized":"2024-04-19T03:06:18.911655+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:06:18.911610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:06:18.911610+0000","last_clean_scrub_stamp":"2024-04-19T03:06:18.911610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:32:53.446952+0000","scrub_duration":0.0033747260000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":42,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:25.154192+0000","last_change":"2024-04-19T03:05:25.154574+0000","last_active":"2024-04-19T03:05:25.154192+0000","last_peered":"2024-04-19T03:05:25.154192+0000","last_clean":"2024-04-19T03:05:25.154192+0000","last_became_active":"2024-04-19T03:04:50.612005+0000","last_became_peered":"2024-04-19T03:04:50.612005+0000","last_unstale":"2024-04-19T03:05:25.154192+0000","last_undegraded":"2024-04-19T03:05:25.154192+0000","last_fullsized":"2024-04-19T03:05:25.154192+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:05:25.154094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:05:25.154094+0000","last_clean_scrub_stamp":"2024-04-19T03:05:25.154094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:35:43.914350+0000","scrub_duration":0.0032290930000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":41,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:36.159462+0000","last_change":"2024-04-19T03:05:36.159687+0000","last_active":"2024-04-19T03:05:36.159462+0000","last_peered":"2024-04-19T03:05:36.159462+0000","last_clean":"2024-04-19T03:05:36.159462+0000","last_became_active":"2024-04-19T03:04:50.613735+0000","last_became_peered":"2024-04-19T03:04:50.613735+0000","last_unstale":"2024-04-19T03:05:36.159462+0000","last_undegraded":"2024-04-19T03:05:36.159462+0000","last_fullsized":"2024-04-19T03:05:36.159462+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:05:36.159417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:05:36.159417+0000","last_clean_scrub_stamp":"2024-04-19T03:05:36.159417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:03:12.881177+0000","scrub_duration":0.0033805229999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":62,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:51.504587+0000","last_change":"2024-04-19T03:05:51.504706+0000","last_active":"2024-04-19T03:05:51.504587+0000","last_peered":"2024-04-19T03:05:51.504587+0000","last_clean":"2024-04-19T03:05:51.504587+0000","last_became_active":"2024-04-19T03:05:09.392982+0000","last_became_peered":"2024-04-19T03:05:09.392982+0000","last_unstale":"2024-04-19T03:05:51.504587+0000","last_undegraded":"2024-04-19T03:05:51.504587+0000","last_fullsized":"2024-04-19T03:05:51.504587+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:05:51.504568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:05:51.504568+0000","last_clean_scrub_stamp":"2024-04-19T03:05:51.504568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:09:35.313645+0000","scrub_duration":0.075784133000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":42,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:06:04.942245+0000","last_change":"2024-04-19T03:06:04.942510+0000","last_active":"2024-04-19T03:06:04.942245+0000","last_peered":"2024-04-19T03:06:04.942245+0000","last_clean":"2024-04-19T03:06:04.942245+0000","last_became_active":"2024-04-19T03:04:50.613523+0000","last_became_peered":"2024-04-19T03:04:50.613523+0000","last_unstale":"2024-04-19T03:06:04.942245+0000","last_undegraded":"2024-04-19T03:06:04.942245+0000","last_fullsized":"2024-04-19T03:06:04.942245+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:06:04.942199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:06:04.942199+0000","last_clean_scrub_stamp":"2024-04-19T03:06:04.942199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:28:55.349289+0000","scrub_duration":0.0030863319999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":42,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:06:19.959763+0000","last_change":"2024-04-19T03:06:19.959763+0000","last_active":"2024-04-19T03:06:19.959763+0000","last_peered":"2024-04-19T03:06:19.959763+0000","last_clean":"2024-04-19T03:06:19.959763+0000","last_became_active":"2024-04-19T03:04:50.616545+0000","last_became_peered":"2024-04-19T03:04:50.616545+0000","last_unstale":"2024-04-19T03:06:19.959763+0000","last_undegraded":"2024-04-19T03:06:19.959763+0000","last_fullsized":"2024-04-19T03:06:19.959763+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:06:19.959480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:06:19.959480+0000","last_clean_scrub_stamp":"2024-04-19T03:06:19.959480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:55:44.901892+0000","scrub_duration":0.0032722350000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":42,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:06:12.924266+0000","last_change":"2024-04-19T03:06:12.924499+0000","last_active":"2024-04-19T03:06:12.924266+0000","last_peered":"2024-04-19T03:06:12.924266+0000","last_clean":"2024-04-19T03:06:12.924266+0000","last_became_active":"2024-04-19T03:04:50.631699+0000","last_became_peered":"2024-04-19T03:04:50.631699+0000","last_unstale":"2024-04-19T03:06:12.924266+0000","last_undegraded":"2024-04-19T03:06:12.924266+0000","last_fullsized":"2024-04-19T03:06:12.924266+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:06:12.924210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:06:12.924210+0000","last_clean_scrub_stamp":"2024-04-19T03:06:12.924210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:14:21.020517+0000","scrub_duration":0.0036518229999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":65,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:06:05.526393+0000","last_change":"2024-04-19T03:06:05.526625+0000","last_active":"2024-04-19T03:06:05.526393+0000","last_peered":"2024-04-19T03:06:05.526393+0000","last_clean":"2024-04-19T03:06:05.526393+0000","last_became_active":"2024-04-19T03:05:02.360924+0000","last_became_peered":"2024-04-19T03:05:02.360924+0000","last_unstale":"2024-04-19T03:06:05.526393+0000","last_undegraded":"2024-04-19T03:06:05.526393+0000","last_fullsized":"2024-04-19T03:06:05.526393+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:06:05.526344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:06:05.526344+0000","last_clean_scrub_stamp":"2024-04-19T03:06:05.526344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:51:30.876593+0000","scrub_duration":0.003457187,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"20'1","reported_seq":92,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:27.387324+0000","last_change":"2024-04-19T03:05:27.387324+0000","last_active":"2024-04-19T03:05:27.387324+0000","last_peered":"2024-04-19T03:05:27.387324+0000","last_clean":"2024-04-19T03:05:27.387324+0000","last_became_active":"2024-04-19T03:05:09.395508+0000","last_became_peered":"2024-04-19T03:05:09.395508+0000","last_unstale":"2024-04-19T03:05:27.387324+0000","last_undegraded":"2024-04-19T03:05:27.387324+0000","last_fullsized":"2024-04-19T03:05:27.387324+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"20'1","last_scrub_stamp":"2024-04-19T03:05:27.386920+0000","last_deep_scrub":"20'1","last_deep_scrub_stamp":"2024-04-19T03:05:27.386920+0000","last_clean_scrub_stamp":"2024-04-19T03:05:27.386920+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:30:55.863683+0000","scrub_duration":0.0033146569999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":79,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:19.240972+0000","last_change":"2024-04-19T03:05:09.396327+0000","last_active":"2024-04-19T03:05:19.240972+0000","last_peered":"2024-04-19T03:05:19.240972+0000","last_clean":"2024-04-19T03:05:19.240972+0000","last_became_active":"2024-04-19T03:05:09.395753+0000","last_became_peered":"2024-04-19T03:05:09.395753+0000","last_unstale":"2024-04-19T03:05:19.240972+0000","last_undegraded":"2024-04-19T03:05:19.240972+0000","last_fullsized":"2024-04-19T03:05:19.240972+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:01:14.615919+0000","last_clean_scrub_stamp":"2024-04-19T03:01:14.615919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"20'1","reported_seq":100,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:40.415059+0000","last_change":"2024-04-19T03:05:40.415059+0000","last_active":"2024-04-19T03:05:40.415059+0000","last_peered":"2024-04-19T03:05:40.415059+0000","last_clean":"2024-04-19T03:05:40.415059+0000","last_became_active":"2024-04-19T03:05:09.397183+0000","last_became_peered":"2024-04-19T03:05:09.397183+0000","last_unstale":"2024-04-19T03:05:40.415059+0000","last_undegraded":"2024-04-19T03:05:40.415059+0000","last_fullsized":"2024-04-19T03:05:40.415059+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"20'1","last_scrub_stamp":"2024-04-19T03:05:40.414768+0000","last_deep_scrub":"20'1","last_deep_scrub_stamp":"2024-04-19T03:05:40.414768+0000","last_clean_scrub_stamp":"2024-04-19T03:05:40.414768+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:13:49.641736+0000","scrub_duration":0.0037583510000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":99,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:42.226248+0000","last_change":"2024-04-19T03:05:42.226248+0000","last_active":"2024-04-19T03:05:42.226248+0000","last_peered":"2024-04-19T03:05:42.226248+0000","last_clean":"2024-04-19T03:05:42.226248+0000","last_became_active":"2024-04-19T03:05:11.429247+0000","last_became_peered":"2024-04-19T03:05:11.429247+0000","last_unstale":"2024-04-19T03:05:42.226248+0000","last_undegraded":"2024-04-19T03:05:42.226248+0000","last_fullsized":"2024-04-19T03:05:42.226248+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:05:42.226018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:05:42.226018+0000","last_clean_scrub_stamp":"2024-04-19T03:05:42.226018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:33:09.655667+0000","scrub_duration":0.049267652000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"81'3","reported_seq":101,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:06:33.960133+0000","last_change":"2024-04-19T03:06:33.960359+0000","last_active":"2024-04-19T03:06:33.960133+0000","last_peered":"2024-04-19T03:06:33.960133+0000","last_clean":"2024-04-19T03:06:33.960133+0000","last_became_active":"2024-04-19T03:04:50.275533+0000","last_became_peered":"2024-04-19T03:04:50.275533+0000","last_unstale":"2024-04-19T03:06:33.960133+0000","last_undegraded":"2024-04-19T03:06:33.960133+0000","last_fullsized":"2024-04-19T03:06:33.960133+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'3","last_scrub_stamp":"2024-04-19T03:06:33.960084+0000","last_deep_scrub":"81'3","last_deep_scrub_stamp":"2024-04-19T03:06:33.960084+0000","last_clean_scrub_stamp":"2024-04-19T03:06:33.960084+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:46:27.406011+0000","scrub_duration":0.0062949520000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":97,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:06:17.006595+0000","last_change":"2024-04-19T03:06:17.006832+0000","last_active":"2024-04-19T03:06:17.006595+0000","last_peered":"2024-04-19T03:06:17.006595+0000","last_clean":"2024-04-19T03:06:17.006595+0000","last_became_active":"2024-04-19T03:04:50.277348+0000","last_became_peered":"2024-04-19T03:04:50.277348+0000","last_unstale":"2024-04-19T03:06:17.006595+0000","last_undegraded":"2024-04-19T03:06:17.006595+0000","last_fullsized":"2024-04-19T03:06:17.006595+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:06:17.006549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:06:17.006549+0000","last_clean_scrub_stamp":"2024-04-19T03:06:17.006549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:24:47.387136+0000","scrub_duration":0.0032758610000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"81'3","reported_seq":69,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:52.394857+0000","last_change":"2024-04-19T03:05:52.395104+0000","last_active":"2024-04-19T03:05:52.394857+0000","last_peered":"2024-04-19T03:05:52.394857+0000","last_clean":"2024-04-19T03:05:52.394857+0000","last_became_active":"2024-04-19T03:05:02.363167+0000","last_became_peered":"2024-04-19T03:05:02.363167+0000","last_unstale":"2024-04-19T03:05:52.394857+0000","last_undegraded":"2024-04-19T03:05:52.394857+0000","last_fullsized":"2024-04-19T03:05:52.394857+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'3","last_scrub_stamp":"2024-04-19T03:05:52.394809+0000","last_deep_scrub":"81'3","last_deep_scrub_stamp":"2024-04-19T03:05:52.394809+0000","last_clean_scrub_stamp":"2024-04-19T03:05:52.394809+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:49:24.829905+0000","scrub_duration":0.0064588550000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":90,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:22.325552+0000","last_change":"2024-04-19T03:05:22.325552+0000","last_active":"2024-04-19T03:05:22.325552+0000","last_peered":"2024-04-19T03:05:22.325552+0000","last_clean":"2024-04-19T03:05:22.325552+0000","last_became_active":"2024-04-19T03:05:09.393975+0000","last_became_peered":"2024-04-19T03:05:09.393975+0000","last_unstale":"2024-04-19T03:05:22.325552+0000","last_undegraded":"2024-04-19T03:05:22.325552+0000","last_fullsized":"2024-04-19T03:05:22.325552+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:05:22.325265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:05:22.325265+0000","last_clean_scrub_stamp":"2024-04-19T03:05:22.325265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:46:17.944097+0000","scrub_duration":0.022749259000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"20'1","reported_seq":45,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:06:41.881970+0000","last_change":"2024-04-19T03:06:41.881970+0000","last_active":"2024-04-19T03:06:41.881970+0000","last_peered":"2024-04-19T03:06:41.881970+0000","last_clean":"2024-04-19T03:06:41.881970+0000","last_became_active":"2024-04-19T03:04:50.627304+0000","last_became_peered":"2024-04-19T03:04:50.627304+0000","last_unstale":"2024-04-19T03:06:41.881970+0000","last_undegraded":"2024-04-19T03:06:41.881970+0000","last_fullsized":"2024-04-19T03:06:41.881970+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"20'1","last_scrub_stamp":"2024-04-19T03:06:41.881677+0000","last_deep_scrub":"20'1","last_deep_scrub_stamp":"2024-04-19T03:06:41.881677+0000","last_clean_scrub_stamp":"2024-04-19T03:06:41.881677+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:18:27.879318+0000","scrub_duration":0.00321937,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":97,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:06:23.052583+0000","last_change":"2024-04-19T03:06:23.052797+0000","last_active":"2024-04-19T03:06:23.052583+0000","last_peered":"2024-04-19T03:06:23.052583+0000","last_clean":"2024-04-19T03:06:23.052583+0000","last_became_active":"2024-04-19T03:04:50.278874+0000","last_became_peered":"2024-04-19T03:04:50.278874+0000","last_unstale":"2024-04-19T03:06:23.052583+0000","last_undegraded":"2024-04-19T03:06:23.052583+0000","last_fullsized":"2024-04-19T03:06:23.052583+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:06:23.052539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:06:23.052539+0000","last_clean_scrub_stamp":"2024-04-19T03:06:23.052539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:26:31.884047+0000","scrub_duration":0.0029952630000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"81'6","reported_seq":47,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:54.009000+0000","last_change":"2024-04-19T03:05:54.009000+0000","last_active":"2024-04-19T03:05:54.009000+0000","last_peered":"2024-04-19T03:05:54.009000+0000","last_clean":"2024-04-19T03:05:54.009000+0000","last_became_active":"2024-04-19T03:04:50.626334+0000","last_became_peered":"2024-04-19T03:04:50.626334+0000","last_unstale":"2024-04-19T03:05:54.009000+0000","last_undegraded":"2024-04-19T03:05:54.009000+0000","last_fullsized":"2024-04-19T03:05:54.009000+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'6","last_scrub_stamp":"2024-04-19T03:05:54.008658+0000","last_deep_scrub":"81'6","last_deep_scrub_stamp":"2024-04-19T03:05:54.008658+0000","last_clean_scrub_stamp":"2024-04-19T03:05:54.008658+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:39:11.277372+0000","scrub_duration":0.0079365890000000008,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5289,"internal_metadata":0},"log_size":58,"ondisk_log_size":58,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":14482,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":10,"seq":42949673037,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":224804,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":223870,"kb_avail":94147036,"statfs":{"total":96636764160,"available":96406564864,"internally_reserved":0,"allocated":946176,"data_stored":929795,"data_compressed":7241,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":229243334},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 19 03:06:49 2024","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.61699999999999999,"15min":0.61499999999999999},"min":{"1min":0.55500000000000005,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.626,"15min":0.61799999999999999},"min":{"1min":0.57299999999999995,"5min":0.439,"15min":0.439},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.67500000000000004}]},{"osd":1,"last update":"Fri Apr 19 03:06:19 2024","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.58999999999999997,"15min":0.56200000000000006},"min":{"1min":0.58299999999999996,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.77200000000000002,"5min":2.5030000000000001,"15min":2.5030000000000001},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.60699999999999998,"15min":0.57499999999999996},"min":{"1min":0.51900000000000002,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.79200000000000004,"5min":2.6379999999999999,"15min":2.6379999999999999},"last":0.58199999999999996}]}]},{"osd":1,"up_from":10,"seq":42949673036,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":202656,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":201726,"kb_avail":94169184,"statfs":{"total":96636764160,"available":96429244416,"internally_reserved":0,"allocated":942080,"data_stored":931342,"data_compressed":7241,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":206567878},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 19 03:06:50 2024","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.64600000000000002,"15min":0.64500000000000002},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.77100000000000002,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.64000000000000001,"15min":0.64100000000000001},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":0.79400000000000004,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.64800000000000002}]},{"osd":2,"last update":"Fri Apr 19 03:06:10 2024","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.53700000000000003,"15min":0.52000000000000002},"min":{"1min":0.59999999999999998,"5min":0.224,"15min":0.224},"max":{"1min":0.81599999999999995,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.54400000000000004,"15min":0.53400000000000003},"min":{"1min":0.60399999999999998,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.94899999999999995,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.72399999999999998}]}]},{"osd":0,"up_from":71,"seq":304942678044,"num_pgs":73,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51800,"kb_used_data":848,"kb_used_omap":6,"kb_used_meta":50937,"kb_avail":94320040,"statfs":{"total":96636764160,"available":96583720960,"internally_reserved":0,"allocated":868352,"data_stored":339844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6883,"internal_metadata":52159773},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Apr 19 03:06:54 2024","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.67100000000000004,"15min":0.66900000000000004},"min":{"1min":0.58799999999999997,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.75900000000000001,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.67400000000000004,"15min":0.67600000000000005},"min":{"1min":0.60899999999999999,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.753,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.63200000000000001}]},{"osd":2,"last update":"Fri Apr 19 03:06:54 2024","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.70599999999999996,"15min":0.70999999999999996},"min":{"1min":0.56599999999999995,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.77200000000000002,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.67000000000000004,"15min":0.67600000000000005},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":0.79000000000000004,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.57499999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":7241,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":7241,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5289,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-19T03:07:01.809 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-04-19T03:01:14.615919+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=14, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:07:01.809 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-04-19T03:01:14.615919+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=14, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:07:01.809 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-04-19T03:01:14.615919+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=14, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:07:01.809 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-04-19T03:01:14.615919+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=14, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:07:01.809 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-04-19T03:01:14.615919+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=14, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:07:01.810 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-04-19T03:01:13.604133+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=13, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:07:01.810 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-04-19T03:01:13.604133+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=13, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:07:01.810 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-04-19T03:01:14.615919+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=14, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:07:01.810 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-04-19T03:01:06.516863+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=6, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:07:01.810 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-04-19T03:01:09.578660+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=9, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:07:01.811 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-04-19T03:01:13.604133+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=13, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:07:01.811 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-04-19T03:01:14.615919+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=1, tm_sec=14, tm_wday=4, tm_yday=110, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=19, tm_hour=3, tm_min=5, tm_sec=17, tm_wday=4, tm_yday=110, tm_isdst=0) 2024-04-19T03:07:01.811 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-19T03:07:21.812 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-19T03:07:22.136 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-19T03:07:22.138 INFO:teuthology.orchestra.run.smithi096.stderr:dumped all 2024-04-19T03:07:22.149 INFO:teuthology.orchestra.run.smithi096.stdout:{"pg_ready":true,"pg_map":{"version":266,"stamp":"2024-04-19T03:07:22.097038+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":220,"ondisk_log_size":220,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":479260,"kb_used_data":2692,"kb_used_omap":9,"kb_used_meta":476534,"kb_avail":282636260,"statfs":{"total":289910292480,"available":289419530240,"internally_reserved":0,"allocated":2756608,"data_stored":2200981,"data_compressed":14482,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":10071,"internal_metadata":487970985},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004308"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":90,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:06:50.704497+0000","last_change":"2024-04-19T03:06:50.704611+0000","last_active":"2024-04-19T03:06:50.704497+0000","last_peered":"2024-04-19T03:06:50.704497+0000","last_clean":"2024-04-19T03:06:50.704497+0000","last_became_active":"2024-04-19T03:05:09.396279+0000","last_became_peered":"2024-04-19T03:05:09.396279+0000","last_unstale":"2024-04-19T03:06:50.704497+0000","last_undegraded":"2024-04-19T03:06:50.704497+0000","last_fullsized":"2024-04-19T03:06:50.704497+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:06:50.704479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:06:50.704479+0000","last_clean_scrub_stamp":"2024-04-19T03:06:50.704479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:26:59.535986+0000","scrub_duration":0.088289039,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":97,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:06:42.529963+0000","last_change":"2024-04-19T03:06:42.530233+0000","last_active":"2024-04-19T03:06:42.529963+0000","last_peered":"2024-04-19T03:06:42.529963+0000","last_clean":"2024-04-19T03:06:42.529963+0000","last_became_active":"2024-04-19T03:04:50.277848+0000","last_became_peered":"2024-04-19T03:04:50.277848+0000","last_unstale":"2024-04-19T03:06:42.529963+0000","last_undegraded":"2024-04-19T03:06:42.529963+0000","last_fullsized":"2024-04-19T03:06:42.529963+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:06:42.529920+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:06:42.529920+0000","last_clean_scrub_stamp":"2024-04-19T03:06:42.529920+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:38:48.243133+0000","scrub_duration":0.0029622009999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":84,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:06:04.985436+0000","last_change":"2024-04-19T03:06:04.985743+0000","last_active":"2024-04-19T03:06:04.985436+0000","last_peered":"2024-04-19T03:06:04.985436+0000","last_clean":"2024-04-19T03:06:04.985436+0000","last_became_active":"2024-04-19T03:01:15.014599+0000","last_became_peered":"2024-04-19T03:01:15.014599+0000","last_unstale":"2024-04-19T03:06:04.985436+0000","last_undegraded":"2024-04-19T03:06:04.985436+0000","last_fullsized":"2024-04-19T03:06:04.985436+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:06:04.985390+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:06:04.985390+0000","last_clean_scrub_stamp":"2024-04-19T03:06:04.985390+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:34:15.507303+0000","scrub_duration":0.0034078440000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":98,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:49.098069+0000","last_change":"2024-04-19T03:05:49.098069+0000","last_active":"2024-04-19T03:05:49.098069+0000","last_peered":"2024-04-19T03:05:49.098069+0000","last_clean":"2024-04-19T03:05:49.098069+0000","last_became_active":"2024-04-19T03:04:50.274600+0000","last_became_peered":"2024-04-19T03:04:50.274600+0000","last_unstale":"2024-04-19T03:05:49.098069+0000","last_undegraded":"2024-04-19T03:05:49.098069+0000","last_fullsized":"2024-04-19T03:05:49.098069+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:05:49.097746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:05:49.097746+0000","last_clean_scrub_stamp":"2024-04-19T03:05:49.097746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:07:18.276599+0000","scrub_duration":0.0032259770000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":90,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:39.452420+0000","last_change":"2024-04-19T03:05:39.452420+0000","last_active":"2024-04-19T03:05:39.452420+0000","last_peered":"2024-04-19T03:05:39.452420+0000","last_clean":"2024-04-19T03:05:39.452420+0000","last_became_active":"2024-04-19T03:05:09.395929+0000","last_became_peered":"2024-04-19T03:05:09.395929+0000","last_unstale":"2024-04-19T03:05:39.452420+0000","last_undegraded":"2024-04-19T03:05:39.452420+0000","last_fullsized":"2024-04-19T03:05:39.452420+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:05:39.452007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:05:39.452007+0000","last_clean_scrub_stamp":"2024-04-19T03:05:39.452007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:45:27.478454+0000","scrub_duration":0.026485411,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":83,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:06:06.951780+0000","last_change":"2024-04-19T03:06:06.951780+0000","last_active":"2024-04-19T03:06:06.951780+0000","last_peered":"2024-04-19T03:06:06.951780+0000","last_clean":"2024-04-19T03:06:06.951780+0000","last_became_active":"2024-04-19T03:05:11.426617+0000","last_became_peered":"2024-04-19T03:05:11.426617+0000","last_unstale":"2024-04-19T03:06:06.951780+0000","last_undegraded":"2024-04-19T03:06:06.951780+0000","last_fullsized":"2024-04-19T03:06:06.951780+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:06:06.951457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:06:06.951457+0000","last_clean_scrub_stamp":"2024-04-19T03:06:06.951457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:57:21.385487+0000","scrub_duration":0.0032635160000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":83,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:06:54.039416+0000","last_change":"2024-04-19T03:06:54.039766+0000","last_active":"2024-04-19T03:06:54.039416+0000","last_peered":"2024-04-19T03:06:54.039416+0000","last_clean":"2024-04-19T03:06:54.039416+0000","last_became_active":"2024-04-19T03:05:11.422727+0000","last_became_peered":"2024-04-19T03:05:11.422727+0000","last_unstale":"2024-04-19T03:06:54.039416+0000","last_undegraded":"2024-04-19T03:06:54.039416+0000","last_fullsized":"2024-04-19T03:06:54.039416+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:06:54.039371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:06:54.039371+0000","last_clean_scrub_stamp":"2024-04-19T03:06:54.039371+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:16:53.031730+0000","scrub_duration":0.023072017,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":97,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:54.075857+0000","last_change":"2024-04-19T03:05:54.075857+0000","last_active":"2024-04-19T03:05:54.075857+0000","last_peered":"2024-04-19T03:05:54.075857+0000","last_clean":"2024-04-19T03:05:54.075857+0000","last_became_active":"2024-04-19T03:04:50.261155+0000","last_became_peered":"2024-04-19T03:04:50.261155+0000","last_unstale":"2024-04-19T03:05:54.075857+0000","last_undegraded":"2024-04-19T03:05:54.075857+0000","last_fullsized":"2024-04-19T03:05:54.075857+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:05:54.075422+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:05:54.075422+0000","last_clean_scrub_stamp":"2024-04-19T03:05:54.075422+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:12:16.121405+0000","scrub_duration":0.0036127419999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":42,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:23.156992+0000","last_change":"2024-04-19T03:05:23.156992+0000","last_active":"2024-04-19T03:05:23.156992+0000","last_peered":"2024-04-19T03:05:23.156992+0000","last_clean":"2024-04-19T03:05:23.156992+0000","last_became_active":"2024-04-19T03:04:50.611400+0000","last_became_peered":"2024-04-19T03:04:50.611400+0000","last_unstale":"2024-04-19T03:05:23.156992+0000","last_undegraded":"2024-04-19T03:05:23.156992+0000","last_fullsized":"2024-04-19T03:05:23.156992+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:05:23.156852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:05:23.156852+0000","last_clean_scrub_stamp":"2024-04-19T03:05:23.156852+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:00:45.201755+0000","scrub_duration":0.036684305,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":97,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:06:40.468677+0000","last_change":"2024-04-19T03:06:40.468923+0000","last_active":"2024-04-19T03:06:40.468677+0000","last_peered":"2024-04-19T03:06:40.468677+0000","last_clean":"2024-04-19T03:06:40.468677+0000","last_became_active":"2024-04-19T03:04:50.277899+0000","last_became_peered":"2024-04-19T03:04:50.277899+0000","last_unstale":"2024-04-19T03:06:40.468677+0000","last_undegraded":"2024-04-19T03:06:40.468677+0000","last_fullsized":"2024-04-19T03:06:40.468677+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:06:40.468629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:06:40.468629+0000","last_clean_scrub_stamp":"2024-04-19T03:06:40.468629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:23:08.173990+0000","scrub_duration":0.0031597769999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":83,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:06:58.127903+0000","last_change":"2024-04-19T03:06:58.128154+0000","last_active":"2024-04-19T03:06:58.127903+0000","last_peered":"2024-04-19T03:06:58.127903+0000","last_clean":"2024-04-19T03:06:58.127903+0000","last_became_active":"2024-04-19T03:05:11.430243+0000","last_became_peered":"2024-04-19T03:05:11.430243+0000","last_unstale":"2024-04-19T03:06:58.127903+0000","last_undegraded":"2024-04-19T03:06:58.127903+0000","last_fullsized":"2024-04-19T03:06:58.127903+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:06:58.127856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:06:58.127856+0000","last_clean_scrub_stamp":"2024-04-19T03:06:58.127856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:25:26.046703+0000","scrub_duration":0.024902375000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":62,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:30.443577+0000","last_change":"2024-04-19T03:05:30.443804+0000","last_active":"2024-04-19T03:05:30.443577+0000","last_peered":"2024-04-19T03:05:30.443577+0000","last_clean":"2024-04-19T03:05:30.443577+0000","last_became_active":"2024-04-19T03:05:09.392822+0000","last_became_peered":"2024-04-19T03:05:09.392822+0000","last_unstale":"2024-04-19T03:05:30.443577+0000","last_undegraded":"2024-04-19T03:05:30.443577+0000","last_fullsized":"2024-04-19T03:05:30.443577+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:05:30.443531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:05:30.443531+0000","last_clean_scrub_stamp":"2024-04-19T03:05:30.443531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:43:21.406385+0000","scrub_duration":0.0030470290000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":90,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:07:01.660629+0000","last_change":"2024-04-19T03:07:01.660909+0000","last_active":"2024-04-19T03:07:01.660629+0000","last_peered":"2024-04-19T03:07:01.660629+0000","last_clean":"2024-04-19T03:07:01.660629+0000","last_became_active":"2024-04-19T03:05:09.395749+0000","last_became_peered":"2024-04-19T03:05:09.395749+0000","last_unstale":"2024-04-19T03:07:01.660629+0000","last_undegraded":"2024-04-19T03:07:01.660629+0000","last_fullsized":"2024-04-19T03:07:01.660629+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:07:01.660584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:07:01.660584+0000","last_clean_scrub_stamp":"2024-04-19T03:07:01.660584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:46:55.106511+0000","scrub_duration":0.023007542999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":84,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:50.122363+0000","last_change":"2024-04-19T03:05:50.122363+0000","last_active":"2024-04-19T03:05:50.122363+0000","last_peered":"2024-04-19T03:05:50.122363+0000","last_clean":"2024-04-19T03:05:50.122363+0000","last_became_active":"2024-04-19T03:01:15.010472+0000","last_became_peered":"2024-04-19T03:01:15.010472+0000","last_unstale":"2024-04-19T03:05:50.122363+0000","last_undegraded":"2024-04-19T03:05:50.122363+0000","last_fullsized":"2024-04-19T03:05:50.122363+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:05:50.122017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:05:50.122017+0000","last_clean_scrub_stamp":"2024-04-19T03:05:50.122017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:38:58.698089+0000","scrub_duration":0.0034044829999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":86,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:06:14.987825+0000","last_change":"2024-04-19T03:06:14.988052+0000","last_active":"2024-04-19T03:06:14.987825+0000","last_peered":"2024-04-19T03:06:14.987825+0000","last_clean":"2024-04-19T03:06:14.987825+0000","last_became_active":"2024-04-19T03:05:11.425921+0000","last_became_peered":"2024-04-19T03:05:11.425921+0000","last_unstale":"2024-04-19T03:06:14.987825+0000","last_undegraded":"2024-04-19T03:06:14.987825+0000","last_fullsized":"2024-04-19T03:06:14.987825+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:06:14.987781+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:06:14.987781+0000","last_clean_scrub_stamp":"2024-04-19T03:06:14.987781+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:38:20.700993+0000","scrub_duration":0.0031418100000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":83,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:39.150013+0000","last_change":"2024-04-19T03:05:39.150013+0000","last_active":"2024-04-19T03:05:39.150013+0000","last_peered":"2024-04-19T03:05:39.150013+0000","last_clean":"2024-04-19T03:05:39.150013+0000","last_became_active":"2024-04-19T03:05:11.425921+0000","last_became_peered":"2024-04-19T03:05:11.425921+0000","last_unstale":"2024-04-19T03:05:39.150013+0000","last_undegraded":"2024-04-19T03:05:39.150013+0000","last_fullsized":"2024-04-19T03:05:39.150013+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:05:39.149625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:05:39.149625+0000","last_clean_scrub_stamp":"2024-04-19T03:05:39.149625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:18:40.192906+0000","scrub_duration":0.0038324209999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":42,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:49.126778+0000","last_change":"2024-04-19T03:05:49.126778+0000","last_active":"2024-04-19T03:05:49.126778+0000","last_peered":"2024-04-19T03:05:49.126778+0000","last_clean":"2024-04-19T03:05:49.126778+0000","last_became_active":"2024-04-19T03:04:50.611392+0000","last_became_peered":"2024-04-19T03:04:50.611392+0000","last_unstale":"2024-04-19T03:05:49.126778+0000","last_undegraded":"2024-04-19T03:05:49.126778+0000","last_fullsized":"2024-04-19T03:05:49.126778+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:05:49.126640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:05:49.126640+0000","last_clean_scrub_stamp":"2024-04-19T03:05:49.126640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:45:17.738767+0000","scrub_duration":0.087429018999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":90,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:19.348906+0000","last_change":"2024-04-19T03:05:19.348906+0000","last_active":"2024-04-19T03:05:19.348906+0000","last_peered":"2024-04-19T03:05:19.348906+0000","last_clean":"2024-04-19T03:05:19.348906+0000","last_became_active":"2024-04-19T03:05:09.395682+0000","last_became_peered":"2024-04-19T03:05:09.395682+0000","last_unstale":"2024-04-19T03:05:19.348906+0000","last_undegraded":"2024-04-19T03:05:19.348906+0000","last_fullsized":"2024-04-19T03:05:19.348906+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:05:19.348599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:05:19.348599+0000","last_clean_scrub_stamp":"2024-04-19T03:05:19.348599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:22:58.194899+0000","scrub_duration":0.0032195190000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":42,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:06:00.979616+0000","last_change":"2024-04-19T03:06:00.979616+0000","last_active":"2024-04-19T03:06:00.979616+0000","last_peered":"2024-04-19T03:06:00.979616+0000","last_clean":"2024-04-19T03:06:00.979616+0000","last_became_active":"2024-04-19T03:04:50.613481+0000","last_became_peered":"2024-04-19T03:04:50.613481+0000","last_unstale":"2024-04-19T03:06:00.979616+0000","last_undegraded":"2024-04-19T03:06:00.979616+0000","last_fullsized":"2024-04-19T03:06:00.979616+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:06:00.979457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:06:00.979457+0000","last_clean_scrub_stamp":"2024-04-19T03:06:00.979457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:40:54.944550+0000","scrub_duration":0.035927225,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":99,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:06:57.094359+0000","last_change":"2024-04-19T03:06:57.094623+0000","last_active":"2024-04-19T03:06:57.094359+0000","last_peered":"2024-04-19T03:06:57.094359+0000","last_clean":"2024-04-19T03:06:57.094359+0000","last_became_active":"2024-04-19T03:05:11.431352+0000","last_became_peered":"2024-04-19T03:05:11.431352+0000","last_unstale":"2024-04-19T03:06:57.094359+0000","last_undegraded":"2024-04-19T03:06:57.094359+0000","last_fullsized":"2024-04-19T03:06:57.094359+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:06:57.094315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:06:57.094315+0000","last_clean_scrub_stamp":"2024-04-19T03:06:57.094315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:52:11.971674+0000","scrub_duration":0.003256194,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":97,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:06:13.000039+0000","last_change":"2024-04-19T03:06:13.000335+0000","last_active":"2024-04-19T03:06:13.000039+0000","last_peered":"2024-04-19T03:06:13.000039+0000","last_clean":"2024-04-19T03:06:13.000039+0000","last_became_active":"2024-04-19T03:04:50.275510+0000","last_became_peered":"2024-04-19T03:04:50.275510+0000","last_unstale":"2024-04-19T03:06:13.000039+0000","last_undegraded":"2024-04-19T03:06:13.000039+0000","last_fullsized":"2024-04-19T03:06:13.000039+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:06:12.999972+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:06:12.999972+0000","last_clean_scrub_stamp":"2024-04-19T03:06:12.999972+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:22:40.705332+0000","scrub_duration":0.036220484999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":84,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:06:34.444326+0000","last_change":"2024-04-19T03:06:34.444624+0000","last_active":"2024-04-19T03:06:34.444326+0000","last_peered":"2024-04-19T03:06:34.444326+0000","last_clean":"2024-04-19T03:06:34.444326+0000","last_became_active":"2024-04-19T03:01:15.018978+0000","last_became_peered":"2024-04-19T03:01:15.018978+0000","last_unstale":"2024-04-19T03:06:34.444326+0000","last_undegraded":"2024-04-19T03:06:34.444326+0000","last_fullsized":"2024-04-19T03:06:34.444326+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:06:34.444282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:06:34.444282+0000","last_clean_scrub_stamp":"2024-04-19T03:06:34.444282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:57:48.878312+0000","scrub_duration":0.0032201650000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":42,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:27.084833+0000","last_change":"2024-04-19T03:05:27.084833+0000","last_active":"2024-04-19T03:05:27.084833+0000","last_peered":"2024-04-19T03:05:27.084833+0000","last_clean":"2024-04-19T03:05:27.084833+0000","last_became_active":"2024-04-19T03:04:50.630948+0000","last_became_peered":"2024-04-19T03:04:50.630948+0000","last_unstale":"2024-04-19T03:05:27.084833+0000","last_undegraded":"2024-04-19T03:05:27.084833+0000","last_fullsized":"2024-04-19T03:05:27.084833+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:05:27.084457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:05:27.084457+0000","last_clean_scrub_stamp":"2024-04-19T03:05:27.084457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:43:47.014628+0000","scrub_duration":0.0031579899999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":90,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:06:47.638006+0000","last_change":"2024-04-19T03:06:47.638287+0000","last_active":"2024-04-19T03:06:47.638006+0000","last_peered":"2024-04-19T03:06:47.638006+0000","last_clean":"2024-04-19T03:06:47.638006+0000","last_became_active":"2024-04-19T03:05:09.390922+0000","last_became_peered":"2024-04-19T03:05:09.390922+0000","last_unstale":"2024-04-19T03:06:47.638006+0000","last_undegraded":"2024-04-19T03:06:47.638006+0000","last_fullsized":"2024-04-19T03:06:47.638006+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:06:47.637955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:06:47.637955+0000","last_clean_scrub_stamp":"2024-04-19T03:06:47.637955+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:09:45.240812+0000","scrub_duration":0.0031891229999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":63,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:21.387930+0000","last_change":"2024-04-19T03:05:21.387930+0000","last_active":"2024-04-19T03:05:21.387930+0000","last_peered":"2024-04-19T03:05:21.387930+0000","last_clean":"2024-04-19T03:05:21.387930+0000","last_became_active":"2024-04-19T03:05:09.393108+0000","last_became_peered":"2024-04-19T03:05:09.393108+0000","last_unstale":"2024-04-19T03:05:21.387930+0000","last_undegraded":"2024-04-19T03:05:21.387930+0000","last_fullsized":"2024-04-19T03:05:21.387930+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:05:21.387796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:05:21.387796+0000","last_clean_scrub_stamp":"2024-04-19T03:05:21.387796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:19:53.306617+0000","scrub_duration":0.042477411999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":42,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:06:33.811525+0000","last_change":"2024-04-19T03:06:33.811525+0000","last_active":"2024-04-19T03:06:33.811525+0000","last_peered":"2024-04-19T03:06:33.811525+0000","last_clean":"2024-04-19T03:06:33.811525+0000","last_became_active":"2024-04-19T03:04:50.617603+0000","last_became_peered":"2024-04-19T03:04:50.617603+0000","last_unstale":"2024-04-19T03:06:33.811525+0000","last_undegraded":"2024-04-19T03:06:33.811525+0000","last_fullsized":"2024-04-19T03:06:33.811525+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:06:33.811226+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:06:33.811226+0000","last_clean_scrub_stamp":"2024-04-19T03:06:33.811226+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:21:48.264717+0000","scrub_duration":0.0037391880000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":51,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:07:05.112380+0000","last_change":"2024-04-19T03:07:05.112380+0000","last_active":"2024-04-19T03:07:05.112380+0000","last_peered":"2024-04-19T03:07:05.112380+0000","last_clean":"2024-04-19T03:07:05.112380+0000","last_became_active":"2024-04-19T03:05:11.431129+0000","last_became_peered":"2024-04-19T03:05:11.431129+0000","last_unstale":"2024-04-19T03:07:05.112380+0000","last_undegraded":"2024-04-19T03:07:05.112380+0000","last_fullsized":"2024-04-19T03:07:05.112380+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:07:05.112066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:07:05.112066+0000","last_clean_scrub_stamp":"2024-04-19T03:07:05.112066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:00:47.877906+0000","scrub_duration":0.0032787670000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":84,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:06:32.430270+0000","last_change":"2024-04-19T03:06:32.430512+0000","last_active":"2024-04-19T03:06:32.430270+0000","last_peered":"2024-04-19T03:06:32.430270+0000","last_clean":"2024-04-19T03:06:32.430270+0000","last_became_active":"2024-04-19T03:01:15.019064+0000","last_became_peered":"2024-04-19T03:01:15.019064+0000","last_unstale":"2024-04-19T03:06:32.430270+0000","last_undegraded":"2024-04-19T03:06:32.430270+0000","last_fullsized":"2024-04-19T03:06:32.430270+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:06:32.430223+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:06:32.430223+0000","last_clean_scrub_stamp":"2024-04-19T03:06:32.430223+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:34:42.952137+0000","scrub_duration":0.0035361289999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":42,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:06:07.960749+0000","last_change":"2024-04-19T03:06:07.960749+0000","last_active":"2024-04-19T03:06:07.960749+0000","last_peered":"2024-04-19T03:06:07.960749+0000","last_clean":"2024-04-19T03:06:07.960749+0000","last_became_active":"2024-04-19T03:04:50.616550+0000","last_became_peered":"2024-04-19T03:04:50.616550+0000","last_unstale":"2024-04-19T03:06:07.960749+0000","last_undegraded":"2024-04-19T03:06:07.960749+0000","last_fullsized":"2024-04-19T03:06:07.960749+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:06:07.960587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:06:07.960587+0000","last_clean_scrub_stamp":"2024-04-19T03:06:07.960587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:55:45.489295+0000","scrub_duration":0.038393915000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":63,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:41.382171+0000","last_change":"2024-04-19T03:05:41.382171+0000","last_active":"2024-04-19T03:05:41.382171+0000","last_peered":"2024-04-19T03:05:41.382171+0000","last_clean":"2024-04-19T03:05:41.382171+0000","last_became_active":"2024-04-19T03:05:09.393178+0000","last_became_peered":"2024-04-19T03:05:09.393178+0000","last_unstale":"2024-04-19T03:05:41.382171+0000","last_undegraded":"2024-04-19T03:05:41.382171+0000","last_fullsized":"2024-04-19T03:05:41.382171+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:05:41.381892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:05:41.381892+0000","last_clean_scrub_stamp":"2024-04-19T03:05:41.381892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:26:44.553697+0000","scrub_duration":0.0032496449999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":42,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:40.160372+0000","last_change":"2024-04-19T03:05:40.160372+0000","last_active":"2024-04-19T03:05:40.160372+0000","last_peered":"2024-04-19T03:05:40.160372+0000","last_clean":"2024-04-19T03:05:40.160372+0000","last_became_active":"2024-04-19T03:04:50.633033+0000","last_became_peered":"2024-04-19T03:04:50.633033+0000","last_unstale":"2024-04-19T03:05:40.160372+0000","last_undegraded":"2024-04-19T03:05:40.160372+0000","last_fullsized":"2024-04-19T03:05:40.160372+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:05:40.160035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:05:40.160035+0000","last_clean_scrub_stamp":"2024-04-19T03:05:40.160035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:22:24.075162+0000","scrub_duration":0.0035144400000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":97,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:45.098945+0000","last_change":"2024-04-19T03:05:45.099168+0000","last_active":"2024-04-19T03:05:45.098945+0000","last_peered":"2024-04-19T03:05:45.098945+0000","last_clean":"2024-04-19T03:05:45.098945+0000","last_became_active":"2024-04-19T03:04:50.278996+0000","last_became_peered":"2024-04-19T03:04:50.278996+0000","last_unstale":"2024-04-19T03:05:45.098945+0000","last_undegraded":"2024-04-19T03:05:45.098945+0000","last_fullsized":"2024-04-19T03:05:45.098945+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:05:45.098897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:05:45.098897+0000","last_clean_scrub_stamp":"2024-04-19T03:05:45.098897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:59:51.710788+0000","scrub_duration":0.0034812490000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":90,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:34.468578+0000","last_change":"2024-04-19T03:05:34.468578+0000","last_active":"2024-04-19T03:05:34.468578+0000","last_peered":"2024-04-19T03:05:34.468578+0000","last_clean":"2024-04-19T03:05:34.468578+0000","last_became_active":"2024-04-19T03:05:09.395920+0000","last_became_peered":"2024-04-19T03:05:09.395920+0000","last_unstale":"2024-04-19T03:05:34.468578+0000","last_undegraded":"2024-04-19T03:05:34.468578+0000","last_fullsized":"2024-04-19T03:05:34.468578+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:05:34.468305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:05:34.468305+0000","last_clean_scrub_stamp":"2024-04-19T03:05:34.468305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:54:24.688379+0000","scrub_duration":0.003618422,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.13","version":"81'4","reported_seq":102,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:06:51.983417+0000","last_change":"2024-04-19T03:06:51.983662+0000","last_active":"2024-04-19T03:06:51.983417+0000","last_peered":"2024-04-19T03:06:51.983417+0000","last_clean":"2024-04-19T03:06:51.983417+0000","last_became_active":"2024-04-19T03:04:50.276732+0000","last_became_peered":"2024-04-19T03:04:50.276732+0000","last_unstale":"2024-04-19T03:06:51.983417+0000","last_undegraded":"2024-04-19T03:06:51.983417+0000","last_fullsized":"2024-04-19T03:06:51.983417+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'4","last_scrub_stamp":"2024-04-19T03:06:51.983369+0000","last_deep_scrub":"81'4","last_deep_scrub_stamp":"2024-04-19T03:06:51.983369+0000","last_clean_scrub_stamp":"2024-04-19T03:06:51.983369+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:57:39.432677+0000","scrub_duration":0.0081890490000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":90,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:07:03.609732+0000","last_change":"2024-04-19T03:07:03.609978+0000","last_active":"2024-04-19T03:07:03.609732+0000","last_peered":"2024-04-19T03:07:03.609732+0000","last_clean":"2024-04-19T03:07:03.609732+0000","last_became_active":"2024-04-19T03:05:09.394288+0000","last_became_peered":"2024-04-19T03:05:09.394288+0000","last_unstale":"2024-04-19T03:07:03.609732+0000","last_undegraded":"2024-04-19T03:07:03.609732+0000","last_fullsized":"2024-04-19T03:07:03.609732+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:07:03.609684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:07:03.609684+0000","last_clean_scrub_stamp":"2024-04-19T03:07:03.609684+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:27:23.983475+0000","scrub_duration":0.023443272000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":43,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:06:25.884362+0000","last_change":"2024-04-19T03:06:25.884362+0000","last_active":"2024-04-19T03:06:25.884362+0000","last_peered":"2024-04-19T03:06:25.884362+0000","last_clean":"2024-04-19T03:06:25.884362+0000","last_became_active":"2024-04-19T03:04:50.628023+0000","last_became_peered":"2024-04-19T03:04:50.628023+0000","last_unstale":"2024-04-19T03:06:25.884362+0000","last_undegraded":"2024-04-19T03:06:25.884362+0000","last_fullsized":"2024-04-19T03:06:25.884362+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:06:25.884074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:06:25.884074+0000","last_clean_scrub_stamp":"2024-04-19T03:06:25.884074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:52:59.822891+0000","scrub_duration":0.003424585,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":42,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:22.156583+0000","last_change":"2024-04-19T03:05:22.156583+0000","last_active":"2024-04-19T03:05:22.156583+0000","last_peered":"2024-04-19T03:05:22.156583+0000","last_clean":"2024-04-19T03:05:22.156583+0000","last_became_active":"2024-04-19T03:04:50.613860+0000","last_became_peered":"2024-04-19T03:04:50.613860+0000","last_unstale":"2024-04-19T03:05:22.156583+0000","last_undegraded":"2024-04-19T03:05:22.156583+0000","last_fullsized":"2024-04-19T03:05:22.156583+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:05:22.156296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:05:22.156296+0000","last_clean_scrub_stamp":"2024-04-19T03:05:22.156296+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:47:31.989944+0000","scrub_duration":0.0031789600000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":85,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:06:29.458856+0000","last_change":"2024-04-19T03:06:29.459075+0000","last_active":"2024-04-19T03:06:29.458856+0000","last_peered":"2024-04-19T03:06:29.458856+0000","last_clean":"2024-04-19T03:06:29.458856+0000","last_became_active":"2024-04-19T03:01:14.648217+0000","last_became_peered":"2024-04-19T03:01:14.648217+0000","last_unstale":"2024-04-19T03:06:29.458856+0000","last_undegraded":"2024-04-19T03:06:29.458856+0000","last_fullsized":"2024-04-19T03:06:29.458856+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:06:29.458807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:06:29.458807+0000","last_clean_scrub_stamp":"2024-04-19T03:06:29.458807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:06:55.513182+0000","scrub_duration":0.0031327,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":42,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:06:09.016173+0000","last_change":"2024-04-19T03:06:09.016173+0000","last_active":"2024-04-19T03:06:09.016173+0000","last_peered":"2024-04-19T03:06:09.016173+0000","last_clean":"2024-04-19T03:06:09.016173+0000","last_became_active":"2024-04-19T03:04:50.610659+0000","last_became_peered":"2024-04-19T03:04:50.610659+0000","last_unstale":"2024-04-19T03:06:09.016173+0000","last_undegraded":"2024-04-19T03:06:09.016173+0000","last_fullsized":"2024-04-19T03:06:09.016173+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:06:09.016037+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:06:09.016037+0000","last_clean_scrub_stamp":"2024-04-19T03:06:09.016037+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:53:27.685552+0000","scrub_duration":0.059919361999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"81'12","reported_seq":102,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:06:20.048514+0000","last_change":"2024-04-19T03:06:20.048753+0000","last_active":"2024-04-19T03:06:20.048514+0000","last_peered":"2024-04-19T03:06:20.048514+0000","last_clean":"2024-04-19T03:06:20.048514+0000","last_became_active":"2024-04-19T03:05:11.428668+0000","last_became_peered":"2024-04-19T03:05:11.428668+0000","last_unstale":"2024-04-19T03:06:20.048514+0000","last_undegraded":"2024-04-19T03:06:20.048514+0000","last_fullsized":"2024-04-19T03:06:20.048514+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'12","last_scrub_stamp":"2024-04-19T03:06:20.048463+0000","last_deep_scrub":"81'12","last_deep_scrub_stamp":"2024-04-19T03:06:20.048463+0000","last_clean_scrub_stamp":"2024-04-19T03:06:20.048463+0000","objects_scrubbed":4,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:09:17.651320+0000","scrub_duration":0.0095854819999999993,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"81'2","reported_seq":87,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:06:50.939516+0000","last_change":"2024-04-19T03:06:50.939859+0000","last_active":"2024-04-19T03:06:50.939516+0000","last_peered":"2024-04-19T03:06:50.939516+0000","last_clean":"2024-04-19T03:06:50.939516+0000","last_became_active":"2024-04-19T03:01:14.649571+0000","last_became_peered":"2024-04-19T03:01:14.649571+0000","last_unstale":"2024-04-19T03:06:50.939516+0000","last_undegraded":"2024-04-19T03:06:50.939516+0000","last_fullsized":"2024-04-19T03:06:50.939516+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'2","last_scrub_stamp":"2024-04-19T03:06:50.939465+0000","last_deep_scrub":"81'2","last_deep_scrub_stamp":"2024-04-19T03:06:50.939465+0000","last_clean_scrub_stamp":"2024-04-19T03:06:50.939465+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:42:55.713909+0000","scrub_duration":0.0063370750000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":66,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:06:14.510089+0000","last_change":"2024-04-19T03:06:14.510089+0000","last_active":"2024-04-19T03:06:14.510089+0000","last_peered":"2024-04-19T03:06:14.510089+0000","last_clean":"2024-04-19T03:06:14.510089+0000","last_became_active":"2024-04-19T03:05:02.362227+0000","last_became_peered":"2024-04-19T03:05:02.362227+0000","last_unstale":"2024-04-19T03:06:14.510089+0000","last_undegraded":"2024-04-19T03:06:14.510089+0000","last_fullsized":"2024-04-19T03:06:14.510089+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:06:14.509801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:06:14.509801+0000","last_clean_scrub_stamp":"2024-04-19T03:06:14.509801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:30:22.470364+0000","scrub_duration":0.0034446279999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"81'3","reported_seq":88,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:06:20.473744+0000","last_change":"2024-04-19T03:06:20.474018+0000","last_active":"2024-04-19T03:06:20.473744+0000","last_peered":"2024-04-19T03:06:20.473744+0000","last_clean":"2024-04-19T03:06:20.473744+0000","last_became_active":"2024-04-19T03:01:14.644790+0000","last_became_peered":"2024-04-19T03:01:14.644790+0000","last_unstale":"2024-04-19T03:06:20.473744+0000","last_undegraded":"2024-04-19T03:06:20.473744+0000","last_fullsized":"2024-04-19T03:06:20.473744+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'3","last_scrub_stamp":"2024-04-19T03:06:20.473693+0000","last_deep_scrub":"81'3","last_deep_scrub_stamp":"2024-04-19T03:06:20.473693+0000","last_clean_scrub_stamp":"2024-04-19T03:06:20.473693+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:12:42.519676+0000","scrub_duration":0.0061567130000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":90,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:06:04.548975+0000","last_change":"2024-04-19T03:06:04.549223+0000","last_active":"2024-04-19T03:06:04.548975+0000","last_peered":"2024-04-19T03:06:04.548975+0000","last_clean":"2024-04-19T03:06:04.548975+0000","last_became_active":"2024-04-19T03:05:09.392736+0000","last_became_peered":"2024-04-19T03:05:09.392736+0000","last_unstale":"2024-04-19T03:06:04.548975+0000","last_undegraded":"2024-04-19T03:06:04.548975+0000","last_fullsized":"2024-04-19T03:06:04.548975+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:06:04.548929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:06:04.548929+0000","last_clean_scrub_stamp":"2024-04-19T03:06:04.548929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:15:59.783247+0000","scrub_duration":0.0033845059999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"81'2","reported_seq":53,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:07:14.220970+0000","last_change":"2024-04-19T03:07:14.221208+0000","last_active":"2024-04-19T03:07:14.220970+0000","last_peered":"2024-04-19T03:07:14.220970+0000","last_clean":"2024-04-19T03:07:14.220970+0000","last_became_active":"2024-04-19T03:05:11.431552+0000","last_became_peered":"2024-04-19T03:05:11.431552+0000","last_unstale":"2024-04-19T03:07:14.220970+0000","last_undegraded":"2024-04-19T03:07:14.220970+0000","last_fullsized":"2024-04-19T03:07:14.220970+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'2","last_scrub_stamp":"2024-04-19T03:07:14.220914+0000","last_deep_scrub":"81'2","last_deep_scrub_stamp":"2024-04-19T03:07:14.220914+0000","last_clean_scrub_stamp":"2024-04-19T03:07:14.220914+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:58:04.538715+0000","scrub_duration":0.0068203769999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":97,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:06:05.975879+0000","last_change":"2024-04-19T03:06:05.976137+0000","last_active":"2024-04-19T03:06:05.975879+0000","last_peered":"2024-04-19T03:06:05.975879+0000","last_clean":"2024-04-19T03:06:05.975879+0000","last_became_active":"2024-04-19T03:04:50.277126+0000","last_became_peered":"2024-04-19T03:04:50.277126+0000","last_unstale":"2024-04-19T03:06:05.975879+0000","last_undegraded":"2024-04-19T03:06:05.975879+0000","last_fullsized":"2024-04-19T03:06:05.975879+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:06:05.975834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:06:05.975834+0000","last_clean_scrub_stamp":"2024-04-19T03:06:05.975834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:20:51.285647+0000","scrub_duration":0.003132653,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":84,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:07:02.090374+0000","last_change":"2024-04-19T03:07:02.090631+0000","last_active":"2024-04-19T03:07:02.090374+0000","last_peered":"2024-04-19T03:07:02.090374+0000","last_clean":"2024-04-19T03:07:02.090374+0000","last_became_active":"2024-04-19T03:05:11.428722+0000","last_became_peered":"2024-04-19T03:05:11.428722+0000","last_unstale":"2024-04-19T03:07:02.090374+0000","last_undegraded":"2024-04-19T03:07:02.090374+0000","last_fullsized":"2024-04-19T03:07:02.090374+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:07:02.090329+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:07:02.090329+0000","last_clean_scrub_stamp":"2024-04-19T03:07:02.090329+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:15:52.170460+0000","scrub_duration":0.003192411,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":42,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:06:37.889743+0000","last_change":"2024-04-19T03:06:37.889743+0000","last_active":"2024-04-19T03:06:37.889743+0000","last_peered":"2024-04-19T03:06:37.889743+0000","last_clean":"2024-04-19T03:06:37.889743+0000","last_became_active":"2024-04-19T03:04:50.625919+0000","last_became_peered":"2024-04-19T03:04:50.625919+0000","last_unstale":"2024-04-19T03:06:37.889743+0000","last_undegraded":"2024-04-19T03:06:37.889743+0000","last_fullsized":"2024-04-19T03:06:37.889743+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:06:37.889307+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:06:37.889307+0000","last_clean_scrub_stamp":"2024-04-19T03:06:37.889307+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:07:23.625279+0000","scrub_duration":0.033935805999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"81'3","reported_seq":46,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:06:29.761629+0000","last_change":"2024-04-19T03:06:29.761629+0000","last_active":"2024-04-19T03:06:29.761629+0000","last_peered":"2024-04-19T03:06:29.761629+0000","last_clean":"2024-04-19T03:06:29.761629+0000","last_became_active":"2024-04-19T03:04:50.625931+0000","last_became_peered":"2024-04-19T03:04:50.625931+0000","last_unstale":"2024-04-19T03:06:29.761629+0000","last_undegraded":"2024-04-19T03:06:29.761629+0000","last_fullsized":"2024-04-19T03:06:29.761629+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'3","last_scrub_stamp":"2024-04-19T03:06:29.761304+0000","last_deep_scrub":"81'3","last_deep_scrub_stamp":"2024-04-19T03:06:29.761304+0000","last_clean_scrub_stamp":"2024-04-19T03:06:29.761304+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:21:37.427888+0000","scrub_duration":0.0062219290000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":99,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:07:04.101600+0000","last_change":"2024-04-19T03:07:04.101945+0000","last_active":"2024-04-19T03:07:04.101600+0000","last_peered":"2024-04-19T03:07:04.101600+0000","last_clean":"2024-04-19T03:07:04.101600+0000","last_became_active":"2024-04-19T03:05:11.430149+0000","last_became_peered":"2024-04-19T03:05:11.430149+0000","last_unstale":"2024-04-19T03:07:04.101600+0000","last_undegraded":"2024-04-19T03:07:04.101600+0000","last_fullsized":"2024-04-19T03:07:04.101600+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:07:04.101516+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:07:04.101516+0000","last_clean_scrub_stamp":"2024-04-19T03:07:04.101516+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:04:21.227818+0000","scrub_duration":0.0036905309999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":98,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:06:41.856003+0000","last_change":"2024-04-19T03:06:41.856220+0000","last_active":"2024-04-19T03:06:41.856003+0000","last_peered":"2024-04-19T03:06:41.856003+0000","last_clean":"2024-04-19T03:06:41.856003+0000","last_became_active":"2024-04-19T03:04:50.277603+0000","last_became_peered":"2024-04-19T03:04:50.277603+0000","last_unstale":"2024-04-19T03:06:41.856003+0000","last_undegraded":"2024-04-19T03:06:41.856003+0000","last_fullsized":"2024-04-19T03:06:41.856003+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:06:41.855956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:06:41.855956+0000","last_clean_scrub_stamp":"2024-04-19T03:06:41.855956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:11:30.543967+0000","scrub_duration":0.003228828,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":84,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:46.144344+0000","last_change":"2024-04-19T03:05:46.144560+0000","last_active":"2024-04-19T03:05:46.144344+0000","last_peered":"2024-04-19T03:05:46.144344+0000","last_clean":"2024-04-19T03:05:46.144344+0000","last_became_active":"2024-04-19T03:01:15.014847+0000","last_became_peered":"2024-04-19T03:01:15.014847+0000","last_unstale":"2024-04-19T03:05:46.144344+0000","last_undegraded":"2024-04-19T03:05:46.144344+0000","last_fullsized":"2024-04-19T03:05:46.144344+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:05:46.144300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:05:46.144300+0000","last_clean_scrub_stamp":"2024-04-19T03:05:46.144300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:43:25.191286+0000","scrub_duration":0.0032320750000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":64,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:42.387451+0000","last_change":"2024-04-19T03:05:42.387451+0000","last_active":"2024-04-19T03:05:42.387451+0000","last_peered":"2024-04-19T03:05:42.387451+0000","last_clean":"2024-04-19T03:05:42.387451+0000","last_became_active":"2024-04-19T03:05:09.391218+0000","last_became_peered":"2024-04-19T03:05:09.391218+0000","last_unstale":"2024-04-19T03:05:42.387451+0000","last_undegraded":"2024-04-19T03:05:42.387451+0000","last_fullsized":"2024-04-19T03:05:42.387451+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:05:42.387178+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:05:42.387178+0000","last_clean_scrub_stamp":"2024-04-19T03:05:42.387178+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:52:14.035747+0000","scrub_duration":0.003459981,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":84,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:06:01.981674+0000","last_change":"2024-04-19T03:06:01.981909+0000","last_active":"2024-04-19T03:06:01.981674+0000","last_peered":"2024-04-19T03:06:01.981674+0000","last_clean":"2024-04-19T03:06:01.981674+0000","last_became_active":"2024-04-19T03:01:15.014421+0000","last_became_peered":"2024-04-19T03:01:15.014421+0000","last_unstale":"2024-04-19T03:06:01.981674+0000","last_undegraded":"2024-04-19T03:06:01.981674+0000","last_fullsized":"2024-04-19T03:06:01.981674+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:06:01.981618+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:06:01.981618+0000","last_clean_scrub_stamp":"2024-04-19T03:06:01.981618+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:06:28.035993+0000","scrub_duration":0.0033942379999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":91,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:50.475678+0000","last_change":"2024-04-19T03:05:50.475892+0000","last_active":"2024-04-19T03:05:50.475678+0000","last_peered":"2024-04-19T03:05:50.475678+0000","last_clean":"2024-04-19T03:05:50.475678+0000","last_became_active":"2024-04-19T03:05:09.395294+0000","last_became_peered":"2024-04-19T03:05:09.395294+0000","last_unstale":"2024-04-19T03:05:50.475678+0000","last_undegraded":"2024-04-19T03:05:50.475678+0000","last_fullsized":"2024-04-19T03:05:50.475678+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:05:50.475630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:05:50.475630+0000","last_clean_scrub_stamp":"2024-04-19T03:05:50.475630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:03:15.099595+0000","scrub_duration":0.0034712469999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":42,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:50.149020+0000","last_change":"2024-04-19T03:05:50.149020+0000","last_active":"2024-04-19T03:05:50.149020+0000","last_peered":"2024-04-19T03:05:50.149020+0000","last_clean":"2024-04-19T03:05:50.149020+0000","last_became_active":"2024-04-19T03:04:50.617323+0000","last_became_peered":"2024-04-19T03:04:50.617323+0000","last_unstale":"2024-04-19T03:05:50.149020+0000","last_undegraded":"2024-04-19T03:05:50.149020+0000","last_fullsized":"2024-04-19T03:05:50.149020+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:05:50.148885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:05:50.148885+0000","last_clean_scrub_stamp":"2024-04-19T03:05:50.148885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:47:33.437890+0000","scrub_duration":0.061933355000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"81'159","reported_seq":294,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:07:08.198547+0000","last_change":"2024-04-19T03:07:08.198547+0000","last_active":"2024-04-19T03:07:08.198547+0000","last_peered":"2024-04-19T03:07:08.198547+0000","last_clean":"2024-04-19T03:07:08.198547+0000","last_became_active":"2024-04-19T03:05:11.426859+0000","last_became_peered":"2024-04-19T03:05:11.426859+0000","last_unstale":"2024-04-19T03:07:08.198547+0000","last_undegraded":"2024-04-19T03:07:08.198547+0000","last_fullsized":"2024-04-19T03:07:08.198547+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'159","last_scrub_stamp":"2024-04-19T03:07:08.198155+0000","last_deep_scrub":"81'159","last_deep_scrub_stamp":"2024-04-19T03:07:08.198155+0000","last_clean_scrub_stamp":"2024-04-19T03:07:08.198155+0000","objects_scrubbed":2,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:27:22.438951+0000","scrub_duration":0.013809979,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":100,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:06:39.925326+0000","last_change":"2024-04-19T03:06:39.925555+0000","last_active":"2024-04-19T03:06:39.925326+0000","last_peered":"2024-04-19T03:06:39.925326+0000","last_clean":"2024-04-19T03:06:39.925326+0000","last_became_active":"2024-04-19T03:04:50.276132+0000","last_became_peered":"2024-04-19T03:04:50.276132+0000","last_unstale":"2024-04-19T03:06:39.925326+0000","last_undegraded":"2024-04-19T03:06:39.925326+0000","last_fullsized":"2024-04-19T03:06:39.925326+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:06:39.925283+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:06:39.925283+0000","last_clean_scrub_stamp":"2024-04-19T03:06:39.925283+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:33:03.142481+0000","scrub_duration":0.003497624,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":43,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:06:39.867467+0000","last_change":"2024-04-19T03:06:39.867467+0000","last_active":"2024-04-19T03:06:39.867467+0000","last_peered":"2024-04-19T03:06:39.867467+0000","last_clean":"2024-04-19T03:06:39.867467+0000","last_became_active":"2024-04-19T03:04:50.628741+0000","last_became_peered":"2024-04-19T03:04:50.628741+0000","last_unstale":"2024-04-19T03:06:39.867467+0000","last_undegraded":"2024-04-19T03:06:39.867467+0000","last_fullsized":"2024-04-19T03:06:39.867467+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:06:39.867164+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:06:39.867164+0000","last_clean_scrub_stamp":"2024-04-19T03:06:39.867164+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:23:45.017629+0000","scrub_duration":0.0032584530000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":86,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:37.209852+0000","last_change":"2024-04-19T03:05:37.210309+0000","last_active":"2024-04-19T03:05:37.209852+0000","last_peered":"2024-04-19T03:05:37.209852+0000","last_clean":"2024-04-19T03:05:37.209852+0000","last_became_active":"2024-04-19T03:05:11.430881+0000","last_became_peered":"2024-04-19T03:05:11.430881+0000","last_unstale":"2024-04-19T03:05:37.209852+0000","last_undegraded":"2024-04-19T03:05:37.209852+0000","last_fullsized":"2024-04-19T03:05:37.209852+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:05:37.209759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:05:37.209759+0000","last_clean_scrub_stamp":"2024-04-19T03:05:37.209759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:52:10.997951+0000","scrub_duration":0.0033919810000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":88,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:06:37.919668+0000","last_change":"2024-04-19T03:06:37.919668+0000","last_active":"2024-04-19T03:06:37.919668+0000","last_peered":"2024-04-19T03:06:37.919668+0000","last_clean":"2024-04-19T03:06:37.919668+0000","last_became_active":"2024-04-19T03:01:10.601381+0000","last_became_peered":"2024-04-19T03:01:10.601381+0000","last_unstale":"2024-04-19T03:06:37.919668+0000","last_undegraded":"2024-04-19T03:06:37.919668+0000","last_fullsized":"2024-04-19T03:06:37.919668+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:06:37.919255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:06:37.919255+0000","last_clean_scrub_stamp":"2024-04-19T03:06:37.919255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:21:20.594119+0000","scrub_duration":0.0035509640000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":43,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:58.945975+0000","last_change":"2024-04-19T03:05:58.945975+0000","last_active":"2024-04-19T03:05:58.945975+0000","last_peered":"2024-04-19T03:05:58.945975+0000","last_clean":"2024-04-19T03:05:58.945975+0000","last_became_active":"2024-04-19T03:04:50.631721+0000","last_became_peered":"2024-04-19T03:04:50.631721+0000","last_unstale":"2024-04-19T03:05:58.945975+0000","last_undegraded":"2024-04-19T03:05:58.945975+0000","last_fullsized":"2024-04-19T03:05:58.945975+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:05:58.945528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:05:58.945528+0000","last_clean_scrub_stamp":"2024-04-19T03:05:58.945528+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:00:41.372378+0000","scrub_duration":0.0034170619999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":90,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:45.465307+0000","last_change":"2024-04-19T03:05:45.465610+0000","last_active":"2024-04-19T03:05:45.465307+0000","last_peered":"2024-04-19T03:05:45.465307+0000","last_clean":"2024-04-19T03:05:45.465307+0000","last_became_active":"2024-04-19T03:05:09.395167+0000","last_became_peered":"2024-04-19T03:05:09.395167+0000","last_unstale":"2024-04-19T03:05:45.465307+0000","last_undegraded":"2024-04-19T03:05:45.465307+0000","last_fullsized":"2024-04-19T03:05:45.465307+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:05:45.465258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:05:45.465258+0000","last_clean_scrub_stamp":"2024-04-19T03:05:45.465258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:21:36.562113+0000","scrub_duration":0.0030148670000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":42,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:19.169049+0000","last_change":"2024-04-19T03:05:19.169049+0000","last_active":"2024-04-19T03:05:19.169049+0000","last_peered":"2024-04-19T03:05:19.169049+0000","last_clean":"2024-04-19T03:05:19.169049+0000","last_became_active":"2024-04-19T03:04:50.633457+0000","last_became_peered":"2024-04-19T03:04:50.633457+0000","last_unstale":"2024-04-19T03:05:19.169049+0000","last_undegraded":"2024-04-19T03:05:19.169049+0000","last_fullsized":"2024-04-19T03:05:19.169049+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:05:19.154005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:05:19.154005+0000","last_clean_scrub_stamp":"2024-04-19T03:05:19.154005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:23:03.401654+0000","scrub_duration":0.0034373889999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":86,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:06:17.477233+0000","last_change":"2024-04-19T03:06:17.477233+0000","last_active":"2024-04-19T03:06:17.477233+0000","last_peered":"2024-04-19T03:06:17.477233+0000","last_clean":"2024-04-19T03:06:17.477233+0000","last_became_active":"2024-04-19T03:01:14.648082+0000","last_became_peered":"2024-04-19T03:01:14.648082+0000","last_unstale":"2024-04-19T03:06:17.477233+0000","last_undegraded":"2024-04-19T03:06:17.477233+0000","last_fullsized":"2024-04-19T03:06:17.477233+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:06:17.476956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:06:17.476956+0000","last_clean_scrub_stamp":"2024-04-19T03:06:17.476956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:39:26.053028+0000","scrub_duration":0.0037432979999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":42,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:34.131042+0000","last_change":"2024-04-19T03:05:34.131042+0000","last_active":"2024-04-19T03:05:34.131042+0000","last_peered":"2024-04-19T03:05:34.131042+0000","last_clean":"2024-04-19T03:05:34.131042+0000","last_became_active":"2024-04-19T03:04:50.617628+0000","last_became_peered":"2024-04-19T03:04:50.617628+0000","last_unstale":"2024-04-19T03:05:34.131042+0000","last_undegraded":"2024-04-19T03:05:34.131042+0000","last_fullsized":"2024-04-19T03:05:34.131042+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:05:34.130897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:05:34.130897+0000","last_clean_scrub_stamp":"2024-04-19T03:05:34.130897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:03:56.628506+0000","scrub_duration":0.037678018000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":100,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:06:35.980673+0000","last_change":"2024-04-19T03:06:35.980893+0000","last_active":"2024-04-19T03:06:35.980673+0000","last_peered":"2024-04-19T03:06:35.980673+0000","last_clean":"2024-04-19T03:06:35.980673+0000","last_became_active":"2024-04-19T03:04:50.277804+0000","last_became_peered":"2024-04-19T03:04:50.277804+0000","last_unstale":"2024-04-19T03:06:35.980673+0000","last_undegraded":"2024-04-19T03:06:35.980673+0000","last_fullsized":"2024-04-19T03:06:35.980673+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:06:35.980623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:06:35.980623+0000","last_clean_scrub_stamp":"2024-04-19T03:06:35.980623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:26:56.354414+0000","scrub_duration":0.0034104700000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":98,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:06:45.892733+0000","last_change":"2024-04-19T03:06:45.892978+0000","last_active":"2024-04-19T03:06:45.892733+0000","last_peered":"2024-04-19T03:06:45.892733+0000","last_clean":"2024-04-19T03:06:45.892733+0000","last_became_active":"2024-04-19T03:04:50.275812+0000","last_became_peered":"2024-04-19T03:04:50.275812+0000","last_unstale":"2024-04-19T03:06:45.892733+0000","last_undegraded":"2024-04-19T03:06:45.892733+0000","last_fullsized":"2024-04-19T03:06:45.892733+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:06:45.892689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:06:45.892689+0000","last_clean_scrub_stamp":"2024-04-19T03:06:45.892689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:11:00.296153+0000","scrub_duration":0.0034004870000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":42,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:06:03.930425+0000","last_change":"2024-04-19T03:06:03.930425+0000","last_active":"2024-04-19T03:06:03.930425+0000","last_peered":"2024-04-19T03:06:03.930425+0000","last_clean":"2024-04-19T03:06:03.930425+0000","last_became_active":"2024-04-19T03:04:50.614774+0000","last_became_peered":"2024-04-19T03:04:50.614774+0000","last_unstale":"2024-04-19T03:06:03.930425+0000","last_undegraded":"2024-04-19T03:06:03.930425+0000","last_fullsized":"2024-04-19T03:06:03.930425+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:06:03.930122+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:06:03.930122+0000","last_clean_scrub_stamp":"2024-04-19T03:06:03.930122+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:28:52.187857+0000","scrub_duration":0.003163627,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":84,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:22.163334+0000","last_change":"2024-04-19T03:05:22.163334+0000","last_active":"2024-04-19T03:05:22.163334+0000","last_peered":"2024-04-19T03:05:22.163334+0000","last_clean":"2024-04-19T03:05:22.163334+0000","last_became_active":"2024-04-19T03:05:11.429941+0000","last_became_peered":"2024-04-19T03:05:11.429941+0000","last_unstale":"2024-04-19T03:05:22.163334+0000","last_undegraded":"2024-04-19T03:05:22.163334+0000","last_fullsized":"2024-04-19T03:05:22.163334+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:05:22.163031+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:05:22.163031+0000","last_clean_scrub_stamp":"2024-04-19T03:05:22.163031+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:21:13.259886+0000","scrub_duration":0.0032565699999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":42,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:26.113394+0000","last_change":"2024-04-19T03:05:26.113394+0000","last_active":"2024-04-19T03:05:26.113394+0000","last_peered":"2024-04-19T03:05:26.113394+0000","last_clean":"2024-04-19T03:05:26.113394+0000","last_became_active":"2024-04-19T03:04:50.614498+0000","last_became_peered":"2024-04-19T03:04:50.614498+0000","last_unstale":"2024-04-19T03:05:26.113394+0000","last_undegraded":"2024-04-19T03:05:26.113394+0000","last_fullsized":"2024-04-19T03:05:26.113394+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:05:26.113130+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:05:26.113130+0000","last_clean_scrub_stamp":"2024-04-19T03:05:26.113130+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:38:46.443254+0000","scrub_duration":0.0031920770000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":63,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:06:10.525475+0000","last_change":"2024-04-19T03:06:10.525475+0000","last_active":"2024-04-19T03:06:10.525475+0000","last_peered":"2024-04-19T03:06:10.525475+0000","last_clean":"2024-04-19T03:06:10.525475+0000","last_became_active":"2024-04-19T03:05:09.394024+0000","last_became_peered":"2024-04-19T03:05:09.394024+0000","last_unstale":"2024-04-19T03:06:10.525475+0000","last_undegraded":"2024-04-19T03:06:10.525475+0000","last_fullsized":"2024-04-19T03:06:10.525475+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:06:10.525171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:06:10.525171+0000","last_clean_scrub_stamp":"2024-04-19T03:06:10.525171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:00:17.137062+0000","scrub_duration":0.00337156,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":43,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:33.132791+0000","last_change":"2024-04-19T03:05:33.132791+0000","last_active":"2024-04-19T03:05:33.132791+0000","last_peered":"2024-04-19T03:05:33.132791+0000","last_clean":"2024-04-19T03:05:33.132791+0000","last_became_active":"2024-04-19T03:04:50.615238+0000","last_became_peered":"2024-04-19T03:04:50.615238+0000","last_unstale":"2024-04-19T03:05:33.132791+0000","last_undegraded":"2024-04-19T03:05:33.132791+0000","last_fullsized":"2024-04-19T03:05:33.132791+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:05:33.132481+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:05:33.132481+0000","last_clean_scrub_stamp":"2024-04-19T03:05:33.132481+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:12:12.823889+0000","scrub_duration":0.0033373280000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":94,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:06:56.656148+0000","last_change":"2024-04-19T03:06:56.656528+0000","last_active":"2024-04-19T03:06:56.656148+0000","last_peered":"2024-04-19T03:06:56.656148+0000","last_clean":"2024-04-19T03:06:56.656148+0000","last_became_active":"2024-04-19T03:05:09.396378+0000","last_became_peered":"2024-04-19T03:05:09.396378+0000","last_unstale":"2024-04-19T03:06:56.656148+0000","last_undegraded":"2024-04-19T03:06:56.656148+0000","last_fullsized":"2024-04-19T03:06:56.656148+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:06:56.656053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:06:56.656053+0000","last_clean_scrub_stamp":"2024-04-19T03:06:56.656053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:46:18.681349+0000","scrub_duration":0.003262348,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":63,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:06:44.565127+0000","last_change":"2024-04-19T03:06:44.565127+0000","last_active":"2024-04-19T03:06:44.565127+0000","last_peered":"2024-04-19T03:06:44.565127+0000","last_clean":"2024-04-19T03:06:44.565127+0000","last_became_active":"2024-04-19T03:05:09.392437+0000","last_became_peered":"2024-04-19T03:05:09.392437+0000","last_unstale":"2024-04-19T03:06:44.565127+0000","last_undegraded":"2024-04-19T03:06:44.565127+0000","last_fullsized":"2024-04-19T03:06:44.565127+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:06:44.564859+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:06:44.564859+0000","last_clean_scrub_stamp":"2024-04-19T03:06:44.564859+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:25:14.945445+0000","scrub_duration":0.0033522159999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"81'3","reported_seq":46,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:57.906283+0000","last_change":"2024-04-19T03:05:57.906283+0000","last_active":"2024-04-19T03:05:57.906283+0000","last_peered":"2024-04-19T03:05:57.906283+0000","last_clean":"2024-04-19T03:05:57.906283+0000","last_became_active":"2024-04-19T03:04:50.611024+0000","last_became_peered":"2024-04-19T03:04:50.611024+0000","last_unstale":"2024-04-19T03:05:57.906283+0000","last_undegraded":"2024-04-19T03:05:57.906283+0000","last_fullsized":"2024-04-19T03:05:57.906283+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'3","last_scrub_stamp":"2024-04-19T03:05:57.905886+0000","last_deep_scrub":"81'3","last_deep_scrub_stamp":"2024-04-19T03:05:57.905886+0000","last_clean_scrub_stamp":"2024-04-19T03:05:57.905886+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:53:22.931871+0000","scrub_duration":0.006376273,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":42,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:06:14.878807+0000","last_change":"2024-04-19T03:06:14.878807+0000","last_active":"2024-04-19T03:06:14.878807+0000","last_peered":"2024-04-19T03:06:14.878807+0000","last_clean":"2024-04-19T03:06:14.878807+0000","last_became_active":"2024-04-19T03:04:50.612403+0000","last_became_peered":"2024-04-19T03:04:50.612403+0000","last_unstale":"2024-04-19T03:06:14.878807+0000","last_undegraded":"2024-04-19T03:06:14.878807+0000","last_fullsized":"2024-04-19T03:06:14.878807+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:06:14.878362+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:06:14.878362+0000","last_clean_scrub_stamp":"2024-04-19T03:06:14.878362+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T05:28:51.544909+0000","scrub_duration":0.0036263469999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":42,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:47.097999+0000","last_change":"2024-04-19T03:05:47.097999+0000","last_active":"2024-04-19T03:05:47.097999+0000","last_peered":"2024-04-19T03:05:47.097999+0000","last_clean":"2024-04-19T03:05:47.097999+0000","last_became_active":"2024-04-19T03:04:50.612987+0000","last_became_peered":"2024-04-19T03:04:50.612987+0000","last_unstale":"2024-04-19T03:05:47.097999+0000","last_undegraded":"2024-04-19T03:05:47.097999+0000","last_fullsized":"2024-04-19T03:05:47.097999+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:05:47.097698+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:05:47.097698+0000","last_clean_scrub_stamp":"2024-04-19T03:05:47.097698+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:08:39.534725+0000","scrub_duration":0.0032086129999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"81'2","reported_seq":47,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:46.119402+0000","last_change":"2024-04-19T03:05:46.119402+0000","last_active":"2024-04-19T03:05:46.119402+0000","last_peered":"2024-04-19T03:05:46.119402+0000","last_clean":"2024-04-19T03:05:46.119402+0000","last_became_active":"2024-04-19T03:04:50.612697+0000","last_became_peered":"2024-04-19T03:04:50.612697+0000","last_unstale":"2024-04-19T03:05:46.119402+0000","last_undegraded":"2024-04-19T03:05:46.119402+0000","last_fullsized":"2024-04-19T03:05:46.119402+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'2","last_scrub_stamp":"2024-04-19T03:05:46.119093+0000","last_deep_scrub":"81'2","last_deep_scrub_stamp":"2024-04-19T03:05:46.119093+0000","last_clean_scrub_stamp":"2024-04-19T03:05:46.119093+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:47:01.115618+0000","scrub_duration":0.0063348040000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":87,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:06:38.898941+0000","last_change":"2024-04-19T03:06:38.899164+0000","last_active":"2024-04-19T03:06:38.898941+0000","last_peered":"2024-04-19T03:06:38.898941+0000","last_clean":"2024-04-19T03:06:38.898941+0000","last_became_active":"2024-04-19T03:01:10.601487+0000","last_became_peered":"2024-04-19T03:01:10.601487+0000","last_unstale":"2024-04-19T03:06:38.898941+0000","last_undegraded":"2024-04-19T03:06:38.898941+0000","last_fullsized":"2024-04-19T03:06:38.898941+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:06:38.898894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:06:38.898894+0000","last_clean_scrub_stamp":"2024-04-19T03:06:38.898894+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:34:09.708130+0000","scrub_duration":0.0032282109999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":84,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:06:33.414929+0000","last_change":"2024-04-19T03:06:33.415299+0000","last_active":"2024-04-19T03:06:33.414929+0000","last_peered":"2024-04-19T03:06:33.414929+0000","last_clean":"2024-04-19T03:06:33.414929+0000","last_became_active":"2024-04-19T03:01:15.018276+0000","last_became_peered":"2024-04-19T03:01:15.018276+0000","last_unstale":"2024-04-19T03:06:33.414929+0000","last_undegraded":"2024-04-19T03:06:33.414929+0000","last_fullsized":"2024-04-19T03:06:33.414929+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:06:33.414881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:06:33.414881+0000","last_clean_scrub_stamp":"2024-04-19T03:06:33.414881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:21:18.724694+0000","scrub_duration":0.0030956999999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":89,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:06:28.974256+0000","last_change":"2024-04-19T03:06:28.974608+0000","last_active":"2024-04-19T03:06:28.974256+0000","last_peered":"2024-04-19T03:06:28.974256+0000","last_clean":"2024-04-19T03:06:28.974256+0000","last_became_active":"2024-04-19T03:05:11.429214+0000","last_became_peered":"2024-04-19T03:05:11.429214+0000","last_unstale":"2024-04-19T03:06:28.974256+0000","last_undegraded":"2024-04-19T03:06:28.974256+0000","last_fullsized":"2024-04-19T03:06:28.974256+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:06:28.974167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:06:28.974167+0000","last_clean_scrub_stamp":"2024-04-19T03:06:28.974167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:45:50.999463+0000","scrub_duration":0.0034688119999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"81'10","reported_seq":100,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:29.315169+0000","last_change":"2024-04-19T03:05:29.315169+0000","last_active":"2024-04-19T03:05:29.315169+0000","last_peered":"2024-04-19T03:05:29.315169+0000","last_clean":"2024-04-19T03:05:29.315169+0000","last_became_active":"2024-04-19T03:05:11.430906+0000","last_became_peered":"2024-04-19T03:05:11.430906+0000","last_unstale":"2024-04-19T03:05:29.315169+0000","last_undegraded":"2024-04-19T03:05:29.315169+0000","last_fullsized":"2024-04-19T03:05:29.315169+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'10","last_scrub_stamp":"2024-04-19T03:05:29.314872+0000","last_deep_scrub":"81'10","last_deep_scrub_stamp":"2024-04-19T03:05:29.314872+0000","last_clean_scrub_stamp":"2024-04-19T03:05:29.314872+0000","objects_scrubbed":4,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:09:13.123950+0000","scrub_duration":0.0096666670000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":42,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:51.052464+0000","last_change":"2024-04-19T03:05:51.052464+0000","last_active":"2024-04-19T03:05:51.052464+0000","last_peered":"2024-04-19T03:05:51.052464+0000","last_clean":"2024-04-19T03:05:51.052464+0000","last_became_active":"2024-04-19T03:04:50.627654+0000","last_became_peered":"2024-04-19T03:04:50.627654+0000","last_unstale":"2024-04-19T03:05:51.052464+0000","last_undegraded":"2024-04-19T03:05:51.052464+0000","last_fullsized":"2024-04-19T03:05:51.052464+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:05:51.052162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:05:51.052162+0000","last_clean_scrub_stamp":"2024-04-19T03:05:51.052162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T04:45:11.062907+0000","scrub_duration":0.0030909259999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.15","version":"81'5","reported_seq":68,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:07:06.647958+0000","last_change":"2024-04-19T03:07:06.648249+0000","last_active":"2024-04-19T03:07:06.647958+0000","last_peered":"2024-04-19T03:07:06.647958+0000","last_clean":"2024-04-19T03:07:06.647958+0000","last_became_active":"2024-04-19T03:05:09.397555+0000","last_became_peered":"2024-04-19T03:05:09.397555+0000","last_unstale":"2024-04-19T03:07:06.647958+0000","last_undegraded":"2024-04-19T03:07:06.647958+0000","last_fullsized":"2024-04-19T03:07:06.647958+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'5","last_scrub_stamp":"2024-04-19T03:07:06.647911+0000","last_deep_scrub":"81'5","last_deep_scrub_stamp":"2024-04-19T03:07:06.647911+0000","last_clean_scrub_stamp":"2024-04-19T03:07:06.647911+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:34:37.457146+0000","scrub_duration":0.0075590910000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":84,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:30.281124+0000","last_change":"2024-04-19T03:05:30.281124+0000","last_active":"2024-04-19T03:05:30.281124+0000","last_peered":"2024-04-19T03:05:30.281124+0000","last_clean":"2024-04-19T03:05:30.281124+0000","last_became_active":"2024-04-19T03:05:11.428904+0000","last_became_peered":"2024-04-19T03:05:11.428904+0000","last_unstale":"2024-04-19T03:05:30.281124+0000","last_undegraded":"2024-04-19T03:05:30.281124+0000","last_fullsized":"2024-04-19T03:05:30.281124+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:05:30.280817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:05:30.280817+0000","last_clean_scrub_stamp":"2024-04-19T03:05:30.280817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:49:02.715913+0000","scrub_duration":0.0034631390000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":42,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:06:18.911905+0000","last_change":"2024-04-19T03:06:18.911905+0000","last_active":"2024-04-19T03:06:18.911905+0000","last_peered":"2024-04-19T03:06:18.911905+0000","last_clean":"2024-04-19T03:06:18.911905+0000","last_became_active":"2024-04-19T03:04:50.630873+0000","last_became_peered":"2024-04-19T03:04:50.630873+0000","last_unstale":"2024-04-19T03:06:18.911905+0000","last_undegraded":"2024-04-19T03:06:18.911905+0000","last_fullsized":"2024-04-19T03:06:18.911905+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:06:18.911610+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:06:18.911610+0000","last_clean_scrub_stamp":"2024-04-19T03:06:18.911610+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T12:32:53.446952+0000","scrub_duration":0.0033747260000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":43,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:25.154574+0000","last_change":"2024-04-19T03:05:25.154574+0000","last_active":"2024-04-19T03:05:25.154574+0000","last_peered":"2024-04-19T03:05:25.154574+0000","last_clean":"2024-04-19T03:05:25.154574+0000","last_became_active":"2024-04-19T03:04:50.612005+0000","last_became_peered":"2024-04-19T03:04:50.612005+0000","last_unstale":"2024-04-19T03:05:25.154574+0000","last_undegraded":"2024-04-19T03:05:25.154574+0000","last_fullsized":"2024-04-19T03:05:25.154574+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:05:25.154094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:05:25.154094+0000","last_clean_scrub_stamp":"2024-04-19T03:05:25.154094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:35:43.914350+0000","scrub_duration":0.0032290930000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":42,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:36.159687+0000","last_change":"2024-04-19T03:05:36.159687+0000","last_active":"2024-04-19T03:05:36.159687+0000","last_peered":"2024-04-19T03:05:36.159687+0000","last_clean":"2024-04-19T03:05:36.159687+0000","last_became_active":"2024-04-19T03:04:50.613735+0000","last_became_peered":"2024-04-19T03:04:50.613735+0000","last_unstale":"2024-04-19T03:05:36.159687+0000","last_undegraded":"2024-04-19T03:05:36.159687+0000","last_fullsized":"2024-04-19T03:05:36.159687+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:05:36.159417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:05:36.159417+0000","last_clean_scrub_stamp":"2024-04-19T03:05:36.159417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:03:12.881177+0000","scrub_duration":0.0033805229999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":63,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:51.504706+0000","last_change":"2024-04-19T03:05:51.504706+0000","last_active":"2024-04-19T03:05:51.504706+0000","last_peered":"2024-04-19T03:05:51.504706+0000","last_clean":"2024-04-19T03:05:51.504706+0000","last_became_active":"2024-04-19T03:05:09.392982+0000","last_became_peered":"2024-04-19T03:05:09.392982+0000","last_unstale":"2024-04-19T03:05:51.504706+0000","last_undegraded":"2024-04-19T03:05:51.504706+0000","last_fullsized":"2024-04-19T03:05:51.504706+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:05:51.504568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:05:51.504568+0000","last_clean_scrub_stamp":"2024-04-19T03:05:51.504568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T14:09:35.313645+0000","scrub_duration":0.075784133000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":43,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:06:04.942510+0000","last_change":"2024-04-19T03:06:04.942510+0000","last_active":"2024-04-19T03:06:04.942510+0000","last_peered":"2024-04-19T03:06:04.942510+0000","last_clean":"2024-04-19T03:06:04.942510+0000","last_became_active":"2024-04-19T03:04:50.613523+0000","last_became_peered":"2024-04-19T03:04:50.613523+0000","last_unstale":"2024-04-19T03:06:04.942510+0000","last_undegraded":"2024-04-19T03:06:04.942510+0000","last_fullsized":"2024-04-19T03:06:04.942510+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:06:04.942199+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:06:04.942199+0000","last_clean_scrub_stamp":"2024-04-19T03:06:04.942199+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:28:55.349289+0000","scrub_duration":0.0030863319999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":42,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:06:19.959763+0000","last_change":"2024-04-19T03:06:19.959763+0000","last_active":"2024-04-19T03:06:19.959763+0000","last_peered":"2024-04-19T03:06:19.959763+0000","last_clean":"2024-04-19T03:06:19.959763+0000","last_became_active":"2024-04-19T03:04:50.616545+0000","last_became_peered":"2024-04-19T03:04:50.616545+0000","last_unstale":"2024-04-19T03:06:19.959763+0000","last_undegraded":"2024-04-19T03:06:19.959763+0000","last_fullsized":"2024-04-19T03:06:19.959763+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:06:19.959480+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:06:19.959480+0000","last_clean_scrub_stamp":"2024-04-19T03:06:19.959480+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:55:44.901892+0000","scrub_duration":0.0032722350000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":43,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:06:12.924499+0000","last_change":"2024-04-19T03:06:12.924499+0000","last_active":"2024-04-19T03:06:12.924499+0000","last_peered":"2024-04-19T03:06:12.924499+0000","last_clean":"2024-04-19T03:06:12.924499+0000","last_became_active":"2024-04-19T03:04:50.631699+0000","last_became_peered":"2024-04-19T03:04:50.631699+0000","last_unstale":"2024-04-19T03:06:12.924499+0000","last_undegraded":"2024-04-19T03:06:12.924499+0000","last_fullsized":"2024-04-19T03:06:12.924499+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:06:12.924210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:06:12.924210+0000","last_clean_scrub_stamp":"2024-04-19T03:06:12.924210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:14:21.020517+0000","scrub_duration":0.0036518229999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":65,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:06:05.526393+0000","last_change":"2024-04-19T03:06:05.526625+0000","last_active":"2024-04-19T03:06:05.526393+0000","last_peered":"2024-04-19T03:06:05.526393+0000","last_clean":"2024-04-19T03:06:05.526393+0000","last_became_active":"2024-04-19T03:05:02.360924+0000","last_became_peered":"2024-04-19T03:05:02.360924+0000","last_unstale":"2024-04-19T03:06:05.526393+0000","last_undegraded":"2024-04-19T03:06:05.526393+0000","last_fullsized":"2024-04-19T03:06:05.526393+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:06:05.526344+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:06:05.526344+0000","last_clean_scrub_stamp":"2024-04-19T03:06:05.526344+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T07:51:30.876593+0000","scrub_duration":0.003457187,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1a","version":"20'1","reported_seq":92,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:27.387324+0000","last_change":"2024-04-19T03:05:27.387324+0000","last_active":"2024-04-19T03:05:27.387324+0000","last_peered":"2024-04-19T03:05:27.387324+0000","last_clean":"2024-04-19T03:05:27.387324+0000","last_became_active":"2024-04-19T03:05:09.395508+0000","last_became_peered":"2024-04-19T03:05:09.395508+0000","last_unstale":"2024-04-19T03:05:27.387324+0000","last_undegraded":"2024-04-19T03:05:27.387324+0000","last_fullsized":"2024-04-19T03:05:27.387324+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"20'1","last_scrub_stamp":"2024-04-19T03:05:27.386920+0000","last_deep_scrub":"20'1","last_deep_scrub_stamp":"2024-04-19T03:05:27.386920+0000","last_clean_scrub_stamp":"2024-04-19T03:05:27.386920+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:30:55.863683+0000","scrub_duration":0.0033146569999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":90,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:07:05.636471+0000","last_change":"2024-04-19T03:07:05.637621+0000","last_active":"2024-04-19T03:07:05.636471+0000","last_peered":"2024-04-19T03:07:05.636471+0000","last_clean":"2024-04-19T03:07:05.636471+0000","last_became_active":"2024-04-19T03:05:09.395753+0000","last_became_peered":"2024-04-19T03:05:09.395753+0000","last_unstale":"2024-04-19T03:07:05.636471+0000","last_undegraded":"2024-04-19T03:07:05.636471+0000","last_fullsized":"2024-04-19T03:07:05.636471+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:07:05.636427+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:07:05.636427+0000","last_clean_scrub_stamp":"2024-04-19T03:07:05.636427+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:21:48.311292+0000","scrub_duration":0.0032131590000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1b","version":"20'1","reported_seq":100,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:40.415059+0000","last_change":"2024-04-19T03:05:40.415059+0000","last_active":"2024-04-19T03:05:40.415059+0000","last_peered":"2024-04-19T03:05:40.415059+0000","last_clean":"2024-04-19T03:05:40.415059+0000","last_became_active":"2024-04-19T03:05:09.397183+0000","last_became_peered":"2024-04-19T03:05:09.397183+0000","last_unstale":"2024-04-19T03:05:40.415059+0000","last_undegraded":"2024-04-19T03:05:40.415059+0000","last_fullsized":"2024-04-19T03:05:40.415059+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"20'1","last_scrub_stamp":"2024-04-19T03:05:40.414768+0000","last_deep_scrub":"20'1","last_deep_scrub_stamp":"2024-04-19T03:05:40.414768+0000","last_clean_scrub_stamp":"2024-04-19T03:05:40.414768+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T09:13:49.641736+0000","scrub_duration":0.0037583510000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":99,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:42.226248+0000","last_change":"2024-04-19T03:05:42.226248+0000","last_active":"2024-04-19T03:05:42.226248+0000","last_peered":"2024-04-19T03:05:42.226248+0000","last_clean":"2024-04-19T03:05:42.226248+0000","last_became_active":"2024-04-19T03:05:11.429247+0000","last_became_peered":"2024-04-19T03:05:11.429247+0000","last_unstale":"2024-04-19T03:05:42.226248+0000","last_undegraded":"2024-04-19T03:05:42.226248+0000","last_fullsized":"2024-04-19T03:05:42.226248+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:05:42.226018+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:05:42.226018+0000","last_clean_scrub_stamp":"2024-04-19T03:05:42.226018+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T03:33:09.655667+0000","scrub_duration":0.049267652000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"81'3","reported_seq":101,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:06:33.960133+0000","last_change":"2024-04-19T03:06:33.960359+0000","last_active":"2024-04-19T03:06:33.960133+0000","last_peered":"2024-04-19T03:06:33.960133+0000","last_clean":"2024-04-19T03:06:33.960133+0000","last_became_active":"2024-04-19T03:04:50.275533+0000","last_became_peered":"2024-04-19T03:04:50.275533+0000","last_unstale":"2024-04-19T03:06:33.960133+0000","last_undegraded":"2024-04-19T03:06:33.960133+0000","last_fullsized":"2024-04-19T03:06:33.960133+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'3","last_scrub_stamp":"2024-04-19T03:06:33.960084+0000","last_deep_scrub":"81'3","last_deep_scrub_stamp":"2024-04-19T03:06:33.960084+0000","last_clean_scrub_stamp":"2024-04-19T03:06:33.960084+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:46:27.406011+0000","scrub_duration":0.0062949520000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":97,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:06:17.006595+0000","last_change":"2024-04-19T03:06:17.006832+0000","last_active":"2024-04-19T03:06:17.006595+0000","last_peered":"2024-04-19T03:06:17.006595+0000","last_clean":"2024-04-19T03:06:17.006595+0000","last_became_active":"2024-04-19T03:04:50.277348+0000","last_became_peered":"2024-04-19T03:04:50.277348+0000","last_unstale":"2024-04-19T03:06:17.006595+0000","last_undegraded":"2024-04-19T03:06:17.006595+0000","last_fullsized":"2024-04-19T03:06:17.006595+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:06:17.006549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:06:17.006549+0000","last_clean_scrub_stamp":"2024-04-19T03:06:17.006549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T11:24:47.387136+0000","scrub_duration":0.0032758610000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"81'3","reported_seq":69,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:52.394857+0000","last_change":"2024-04-19T03:05:52.395104+0000","last_active":"2024-04-19T03:05:52.394857+0000","last_peered":"2024-04-19T03:05:52.394857+0000","last_clean":"2024-04-19T03:05:52.394857+0000","last_became_active":"2024-04-19T03:05:02.363167+0000","last_became_peered":"2024-04-19T03:05:02.363167+0000","last_unstale":"2024-04-19T03:05:52.394857+0000","last_undegraded":"2024-04-19T03:05:52.394857+0000","last_fullsized":"2024-04-19T03:05:52.394857+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'3","last_scrub_stamp":"2024-04-19T03:05:52.394809+0000","last_deep_scrub":"81'3","last_deep_scrub_stamp":"2024-04-19T03:05:52.394809+0000","last_clean_scrub_stamp":"2024-04-19T03:05:52.394809+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T10:49:24.829905+0000","scrub_duration":0.0064588550000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":90,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:22.325552+0000","last_change":"2024-04-19T03:05:22.325552+0000","last_active":"2024-04-19T03:05:22.325552+0000","last_peered":"2024-04-19T03:05:22.325552+0000","last_clean":"2024-04-19T03:05:22.325552+0000","last_became_active":"2024-04-19T03:05:09.393975+0000","last_became_peered":"2024-04-19T03:05:09.393975+0000","last_unstale":"2024-04-19T03:05:22.325552+0000","last_undegraded":"2024-04-19T03:05:22.325552+0000","last_fullsized":"2024-04-19T03:05:22.325552+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:05:22.325265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:05:22.325265+0000","last_clean_scrub_stamp":"2024-04-19T03:05:22.325265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:46:17.944097+0000","scrub_duration":0.022749259000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"20'1","reported_seq":45,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:06:41.881970+0000","last_change":"2024-04-19T03:06:41.881970+0000","last_active":"2024-04-19T03:06:41.881970+0000","last_peered":"2024-04-19T03:06:41.881970+0000","last_clean":"2024-04-19T03:06:41.881970+0000","last_became_active":"2024-04-19T03:04:50.627304+0000","last_became_peered":"2024-04-19T03:04:50.627304+0000","last_unstale":"2024-04-19T03:06:41.881970+0000","last_undegraded":"2024-04-19T03:06:41.881970+0000","last_fullsized":"2024-04-19T03:06:41.881970+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"20'1","last_scrub_stamp":"2024-04-19T03:06:41.881677+0000","last_deep_scrub":"20'1","last_deep_scrub_stamp":"2024-04-19T03:06:41.881677+0000","last_clean_scrub_stamp":"2024-04-19T03:06:41.881677+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T08:18:27.879318+0000","scrub_duration":0.00321937,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":97,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:06:23.052583+0000","last_change":"2024-04-19T03:06:23.052797+0000","last_active":"2024-04-19T03:06:23.052583+0000","last_peered":"2024-04-19T03:06:23.052583+0000","last_clean":"2024-04-19T03:06:23.052583+0000","last_became_active":"2024-04-19T03:04:50.278874+0000","last_became_peered":"2024-04-19T03:04:50.278874+0000","last_unstale":"2024-04-19T03:06:23.052583+0000","last_undegraded":"2024-04-19T03:06:23.052583+0000","last_fullsized":"2024-04-19T03:06:23.052583+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-19T03:06:23.052539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-19T03:06:23.052539+0000","last_clean_scrub_stamp":"2024-04-19T03:06:23.052539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T13:26:31.884047+0000","scrub_duration":0.0029952630000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"81'6","reported_seq":47,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-04-19T03:05:54.009000+0000","last_change":"2024-04-19T03:05:54.009000+0000","last_active":"2024-04-19T03:05:54.009000+0000","last_peered":"2024-04-19T03:05:54.009000+0000","last_clean":"2024-04-19T03:05:54.009000+0000","last_became_active":"2024-04-19T03:04:50.626334+0000","last_became_peered":"2024-04-19T03:04:50.626334+0000","last_unstale":"2024-04-19T03:05:54.009000+0000","last_undegraded":"2024-04-19T03:05:54.009000+0000","last_fullsized":"2024-04-19T03:05:54.009000+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'6","last_scrub_stamp":"2024-04-19T03:05:54.008658+0000","last_deep_scrub":"81'6","last_deep_scrub_stamp":"2024-04-19T03:05:54.008658+0000","last_clean_scrub_stamp":"2024-04-19T03:05:54.008658+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-20T06:39:11.277372+0000","scrub_duration":0.0079365890000000008,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5289,"internal_metadata":0},"log_size":61,"ondisk_log_size":61,"up":64,"acting":64,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":1180736,"data_compressed":14482,"data_compressed_allocated":73728,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":10,"seq":42949673042,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":224804,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":223870,"kb_avail":94147036,"statfs":{"total":96636764160,"available":96406564864,"internally_reserved":0,"allocated":946176,"data_stored":929795,"data_compressed":7241,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":229243334},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 19 03:06:49 2024","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.61699999999999999,"15min":0.61499999999999999},"min":{"1min":0.55500000000000005,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.626,"15min":0.61799999999999999},"min":{"1min":0.57299999999999995,"5min":0.439,"15min":0.439},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.56999999999999995}]},{"osd":1,"last update":"Fri Apr 19 03:06:19 2024","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.58999999999999997,"15min":0.56200000000000006},"min":{"1min":0.58299999999999996,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.77200000000000002,"5min":2.5030000000000001,"15min":2.5030000000000001},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.60699999999999998,"15min":0.57499999999999996},"min":{"1min":0.51900000000000002,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.79200000000000004,"5min":2.6379999999999999,"15min":2.6379999999999999},"last":0.63500000000000001}]}]},{"osd":1,"up_from":10,"seq":42949673041,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":202656,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":201726,"kb_avail":94169184,"statfs":{"total":96636764160,"available":96429244416,"internally_reserved":0,"allocated":942080,"data_stored":931342,"data_compressed":7241,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":1594,"internal_metadata":206567878},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Apr 19 03:06:50 2024","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.64600000000000002,"15min":0.64500000000000002},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.77100000000000002,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.64000000000000001,"15min":0.64100000000000001},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":0.79400000000000004,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.70299999999999996}]},{"osd":2,"last update":"Fri Apr 19 03:07:15 2024","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.56999999999999995,"15min":0.53100000000000003},"min":{"1min":0.621,"5min":0.224,"15min":0.224},"max":{"1min":0.73899999999999999,"5min":0.91700000000000004,"15min":0.91700000000000004},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.58099999999999996,"15min":0.54600000000000004},"min":{"1min":0.622,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.81799999999999995,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.73899999999999999}]}]},{"osd":0,"up_from":71,"seq":304942678048,"num_pgs":73,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":51800,"kb_used_data":848,"kb_used_omap":6,"kb_used_meta":50937,"kb_avail":94320040,"statfs":{"total":96636764160,"available":96583720960,"internally_reserved":0,"allocated":868352,"data_stored":339844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6883,"internal_metadata":52159773},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Apr 19 03:06:54 2024","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.67100000000000004,"15min":0.66900000000000004},"min":{"1min":0.58799999999999997,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.75900000000000001,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.67400000000000004,"15min":0.67600000000000005},"min":{"1min":0.60899999999999999,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.753,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.61399999999999999}]},{"osd":2,"last update":"Fri Apr 19 03:06:54 2024","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.70599999999999996,"15min":0.70999999999999996},"min":{"1min":0.56599999999999995,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.77200000000000002,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.67000000000000004,"15min":0.67600000000000005},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":0.79000000000000004,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.58699999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":7241,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":590368,"data_compressed":7241,"data_compressed_allocated":36864,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5289,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-19T03:07:22.156 DEBUG:teuthology.orchestra.run.smithi096:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-04-19T03:07:22.474 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-19T03:07:22.474 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-19T03:07:22.796 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-19T03:07:22.796 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":5,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-19T03:01:14.989437+0000","modified":"2024-04-19T03:01:17.001353+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4202},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4202":{"gid":4202,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.96:6803/3386968674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":3386968674},{"type":"v1","addr":"172.21.15.96:6803","nonce":3386968674}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-19T03:07:22.799 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 5 2024-04-19T03:07:22.810 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-19T03:07:23.138 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-19T03:07:23.139 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":5,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-19T03:01:14.989437+0000","modified":"2024-04-19T03:01:17.001353+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4202},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4202":{"gid":4202,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.96:6803/3386968674","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":3386968674},{"type":"v1","addr":"172.21.15.96:6803","nonce":3386968674}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-19T03:07:23.142 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 5 2024-04-19T03:07:23.152 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-19T03:07:23.449 INFO:teuthology.orchestra.run.smithi096.stdout: 2024-04-19T03:07:23.450 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":81,"fsid":"c6cc8e09-11d4-48de-9a6c-4d70ed3c3789","created":"2024-04-19T03:00:53.746146+0000","modified":"2024-04-19T03:05:12.407719+0000","last_up_change":"2024-04-19T03:04:49.214889+0000","last_in_change":"2024-04-19T03:00:54.640172+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-19T03:01:05.999591+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-19T03:01:09.051757+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-19T03:01:13.479163+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-19T03:01:13.992441+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"05ecb884-2c30-44f7-aa14-90154f9bbe9a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":42,"up_from":71,"up_thru":74,"down_at":43,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6800","nonce":1402},{"type":"v1","addr":"172.21.15.97:6801","nonce":1402}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6802","nonce":1402},{"type":"v1","addr":"172.21.15.97:6803","nonce":1402}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6806","nonce":1402},{"type":"v1","addr":"172.21.15.97:6807","nonce":1402}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.97:6804","nonce":1402},{"type":"v1","addr":"172.21.15.97:6805","nonce":1402}]},"public_addr":"172.21.15.97:6801/1402","cluster_addr":"172.21.15.97:6803/1402","heartbeat_back_addr":"172.21.15.97:6807/1402","heartbeat_front_addr":"172.21.15.97:6805/1402","state":["exists","up"]},{"osd":1,"uuid":"efc873e0-69c3-4a57-8ee5-41f836b65f47","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":18145},{"type":"v1","addr":"172.21.15.134:6801","nonce":18145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":18145},{"type":"v1","addr":"172.21.15.134:6803","nonce":18145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":18145},{"type":"v1","addr":"172.21.15.134:6807","nonce":18145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":18145},{"type":"v1","addr":"172.21.15.134:6805","nonce":18145}]},"public_addr":"172.21.15.134:6801/18145","cluster_addr":"172.21.15.134:6803/18145","heartbeat_back_addr":"172.21.15.134:6807/18145","heartbeat_front_addr":"172.21.15.134:6805/18145","state":["exists","up"]},{"osd":2,"uuid":"229278a0-dd93-4234-9065-e4f2f6188ef2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6800","nonce":18223},{"type":"v1","addr":"172.21.15.144:6801","nonce":18223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6802","nonce":18223},{"type":"v1","addr":"172.21.15.144:6803","nonce":18223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6806","nonce":18223},{"type":"v1","addr":"172.21.15.144:6807","nonce":18223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.144:6804","nonce":18223},{"type":"v1","addr":"172.21.15.144:6805","nonce":18223}]},"public_addr":"172.21.15.144:6801/18223","cluster_addr":"172.21.15.144:6803/18223","heartbeat_back_addr":"172.21.15.144:6807/18223","heartbeat_front_addr":"172.21.15.144:6805/18223","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T03:00:59.302574+0000","dead_epoch":42},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T03:01:00.064174+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-19T03:00:59.735582+0000","dead_epoch":0}],"pg_upmap":[{"pgid":"3.1b","osds":[1,0]}],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-19T03:07:23.465 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-19T03:07:23.817 INFO:teuthology.orchestra.run.smithi096.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-19T03:07:23.830 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-19T03:07:23.841 INFO:tasks.ceph.mds.a.smithi096.stdout:starting mds.a at 2024-04-19T03:07:24.837 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-19T03:07:25.830 INFO:teuthology.orchestra.run.smithi096.stderr:pool 'cephfs_metadata' removed 2024-04-19T03:07:25.844 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-19T03:07:26.839 INFO:teuthology.orchestra.run.smithi096.stderr:pool 'cephfs_data' removed 2024-04-19T03:07:26.851 INFO:teuthology.misc:Shutting down mds daemons... 2024-04-19T03:07:26.851 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-19T03:07:26.851 INFO:teuthology.orchestra.run:waiting for 300 2024-04-19T03:07:26.867 INFO:tasks.ceph.mds.a:Stopped 2024-04-19T03:07:26.867 INFO:teuthology.misc:Shutting down osd daemons... 2024-04-19T03:07:26.867 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-04-19T03:07:26.867 INFO:teuthology.orchestra.run:waiting for 300 2024-04-19T03:07:26.949 INFO:tasks.ceph.osd.0:Stopped 2024-04-19T03:07:26.950 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-04-19T03:07:26.950 INFO:teuthology.orchestra.run:waiting for 300 2024-04-19T03:07:28.792 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~0s 2024-04-19T03:07:33.052 INFO:tasks.ceph.osd.1:Stopped 2024-04-19T03:07:33.052 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-04-19T03:07:33.052 INFO:teuthology.orchestra.run:waiting for 300 2024-04-19T03:07:33.141 INFO:tasks.ceph.osd.2:Stopped 2024-04-19T03:07:33.142 INFO:teuthology.misc:Shutting down mgr daemons... 2024-04-19T03:07:33.142 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-04-19T03:07:33.142 INFO:teuthology.orchestra.run:waiting for 300 2024-04-19T03:07:33.172 INFO:tasks.ceph.mgr.x:Stopped 2024-04-19T03:07:33.172 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-04-19T03:07:33.172 INFO:teuthology.orchestra.run:waiting for 300 2024-04-19T03:07:33.205 INFO:tasks.ceph.mgr.y:Stopped 2024-04-19T03:07:33.205 INFO:teuthology.misc:Shutting down mon daemons... 2024-04-19T03:07:33.205 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-04-19T03:07:33.206 INFO:teuthology.orchestra.run:waiting for 300 2024-04-19T03:07:33.268 INFO:tasks.ceph.mon.a:Stopped 2024-04-19T03:07:33.269 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-04-19T03:07:33.269 INFO:teuthology.orchestra.run:waiting for 300 2024-04-19T03:07:33.306 INFO:tasks.ceph.mon.b:Stopped 2024-04-19T03:07:33.306 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-04-19T03:07:33.306 INFO:teuthology.orchestra.run:waiting for 300 2024-04-19T03:07:33.350 INFO:tasks.ceph.mon.c:Stopped 2024-04-19T03:07:33.351 INFO:tasks.ceph:Checking cluster log for badness... 2024-04-19T03:07:33.351 DEBUG:teuthology.orchestra.run.smithi096:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(MDS_TRIM\)' | egrep -v '\(MDS_SLOW_REQUEST\)' | egrep -v MDS_SLOW_METADATA_IO | egrep -v 'Behind on trimming' | egrep -v 'overall HEALTH_' | egrep -v '\(OSDMAP_FLAGS\)' | egrep -v '\(OSD_' | egrep -v '\(PG_' | egrep -v '\(POOL_' | egrep -v '\(CACHE_POOL_' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(OBJECT_' | egrep -v '\(SLOW_OPS\)' | egrep -v '\(REQUEST_SLOW\)' | egrep -v '\(TOO_FEW_PGS\)' | egrep -v 'slow request' | egrep -v 'timeout on replica' | egrep -v 'late reservation from' | head -n 1 2024-04-19T03:07:33.372 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi097.front.sepia.ceph.com 2024-04-19T03:07:33.373 DEBUG:teuthology.orchestra.run.smithi097:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-04-19T03:07:33.472 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi134.front.sepia.ceph.com 2024-04-19T03:07:33.472 DEBUG:teuthology.orchestra.run.smithi134:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-04-19T03:07:33.691 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi144.front.sepia.ceph.com 2024-04-19T03:07:33.691 DEBUG:teuthology.orchestra.run.smithi144:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-04-19T03:07:33.792 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 has been restored 2024-04-19T03:07:33.867 INFO:tasks.ceph:Archiving mon data... 2024-04-19T03:07:33.868 DEBUG:teuthology.misc:Transferring archived files from smithi096:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/teuthology-2024-04-18_22:32:02-powercycle-reef-distro-default-smithi/7662873/data/mon.a.tgz 2024-04-19T03:07:33.869 DEBUG:teuthology.orchestra.run.smithi096:> mktemp 2024-04-19T03:07:33.875 INFO:teuthology.orchestra.run.smithi096.stdout:/tmp/tmp.4UyAYAguTv 2024-04-19T03:07:33.876 DEBUG:teuthology.orchestra.run.smithi096:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.4UyAYAguTv 2024-04-19T03:07:33.974 DEBUG:teuthology.orchestra.run.smithi096:> sudo chmod 0666 /tmp/tmp.4UyAYAguTv 2024-04-19T03:07:34.041 DEBUG:teuthology.orchestra.remote:smithi096:/tmp/tmp.4UyAYAguTv is 398KB 2024-04-19T03:07:34.104 DEBUG:teuthology.orchestra.run.smithi096:> rm -fr /tmp/tmp.4UyAYAguTv 2024-04-19T03:07:34.111 DEBUG:teuthology.misc:Transferring archived files from smithi096:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/teuthology-2024-04-18_22:32:02-powercycle-reef-distro-default-smithi/7662873/data/mon.b.tgz 2024-04-19T03:07:34.111 DEBUG:teuthology.orchestra.run.smithi096:> mktemp 2024-04-19T03:07:34.118 INFO:teuthology.orchestra.run.smithi096.stdout:/tmp/tmp.22dOHfy8zY 2024-04-19T03:07:34.119 DEBUG:teuthology.orchestra.run.smithi096:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.22dOHfy8zY 2024-04-19T03:07:34.252 DEBUG:teuthology.orchestra.run.smithi096:> sudo chmod 0666 /tmp/tmp.22dOHfy8zY 2024-04-19T03:07:34.268 DEBUG:teuthology.orchestra.remote:smithi096:/tmp/tmp.22dOHfy8zY is 551KB 2024-04-19T03:07:34.294 DEBUG:teuthology.orchestra.run.smithi096:> rm -fr /tmp/tmp.22dOHfy8zY 2024-04-19T03:07:34.300 DEBUG:teuthology.misc:Transferring archived files from smithi096:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/teuthology-2024-04-18_22:32:02-powercycle-reef-distro-default-smithi/7662873/data/mon.c.tgz 2024-04-19T03:07:34.300 DEBUG:teuthology.orchestra.run.smithi096:> mktemp 2024-04-19T03:07:34.349 INFO:teuthology.orchestra.run.smithi096.stdout:/tmp/tmp.ecf75m5wcu 2024-04-19T03:07:34.384 DEBUG:teuthology.orchestra.run.smithi096:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.ecf75m5wcu 2024-04-19T03:07:34.516 DEBUG:teuthology.orchestra.run.smithi096:> sudo chmod 0666 /tmp/tmp.ecf75m5wcu 2024-04-19T03:07:34.537 DEBUG:teuthology.orchestra.remote:smithi096:/tmp/tmp.ecf75m5wcu is 550KB 2024-04-19T03:07:34.559 DEBUG:teuthology.orchestra.run.smithi096:> rm -fr /tmp/tmp.ecf75m5wcu 2024-04-19T03:07:34.566 INFO:tasks.ceph:Cleaning ceph cluster... 2024-04-19T03:07:34.566 DEBUG:teuthology.orchestra.run.smithi096:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-19T03:07:34.616 DEBUG:teuthology.orchestra.run.smithi097:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-19T03:07:34.618 DEBUG:teuthology.orchestra.run.smithi134:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-19T03:07:34.620 DEBUG:teuthology.orchestra.run.smithi144:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-19T03:07:34.658 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2024-04-19T03:07:34.658 DEBUG:teuthology.orchestra.run.smithi096:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2024-04-19T03:07:34.660 DEBUG:teuthology.orchestra.run.smithi097:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2024-04-19T03:07:34.662 DEBUG:teuthology.orchestra.run.smithi134:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2024-04-19T03:07:34.677 DEBUG:teuthology.orchestra.run.smithi144:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2024-04-19T03:07:34.686 INFO:teuthology.orchestra.run.smithi096.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2024-04-19T03:07:34.689 INFO:teuthology.orchestra.run.smithi097.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2024-04-19T03:07:34.705 INFO:teuthology.orchestra.run.smithi134.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2024-04-19T03:07:34.708 INFO:teuthology.orchestra.run.smithi144.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2024-04-19T03:07:34.714 INFO:tasks.ceph:Archiving crash dumps... 2024-04-19T03:07:34.716 DEBUG:teuthology.misc:Transferring archived files from smithi096:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-04-18_22:32:02-powercycle-reef-distro-default-smithi/7662873/remote/smithi096/crash 2024-04-19T03:07:34.716 DEBUG:teuthology.orchestra.run.smithi096:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-19T03:07:34.732 DEBUG:teuthology.misc:Transferring archived files from smithi097:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-04-18_22:32:02-powercycle-reef-distro-default-smithi/7662873/remote/smithi097/crash 2024-04-19T03:07:34.733 DEBUG:teuthology.orchestra.run.smithi097:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-19T03:07:34.771 DEBUG:teuthology.misc:Transferring archived files from smithi134:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-04-18_22:32:02-powercycle-reef-distro-default-smithi/7662873/remote/smithi134/crash 2024-04-19T03:07:34.772 DEBUG:teuthology.orchestra.run.smithi134:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-19T03:07:34.789 DEBUG:teuthology.misc:Transferring archived files from smithi144:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-04-18_22:32:02-powercycle-reef-distro-default-smithi/7662873/remote/smithi144/crash 2024-04-19T03:07:34.790 DEBUG:teuthology.orchestra.run.smithi144:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-19T03:07:34.807 INFO:tasks.ceph:Compressing logs... 2024-04-19T03:07:34.807 DEBUG:teuthology.orchestra.run.smithi096:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-19T03:07:34.811 DEBUG:teuthology.orchestra.run.smithi097:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-19T03:07:34.813 DEBUG:teuthology.orchestra.run.smithi134:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-19T03:07:34.815 DEBUG:teuthology.orchestra.run.smithi144:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-19T03:08:03.774 INFO:tasks.ceph:Archiving logs... 2024-04-19T03:08:03.775 DEBUG:teuthology.misc:Transferring archived files from smithi096:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-04-18_22:32:02-powercycle-reef-distro-default-smithi/7662873/remote/smithi096/log 2024-04-19T03:08:03.776 DEBUG:teuthology.orchestra.run.smithi096:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-19T03:08:04.082 DEBUG:teuthology.misc:Transferring archived files from smithi097:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-04-18_22:32:02-powercycle-reef-distro-default-smithi/7662873/remote/smithi097/log 2024-04-19T03:08:04.083 DEBUG:teuthology.orchestra.run.smithi097:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-19T03:08:05.486 DEBUG:teuthology.misc:Transferring archived files from smithi134:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-04-18_22:32:02-powercycle-reef-distro-default-smithi/7662873/remote/smithi134/log 2024-04-19T03:08:05.487 DEBUG:teuthology.orchestra.run.smithi134:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-19T03:08:08.487 DEBUG:teuthology.misc:Transferring archived files from smithi144:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-04-18_22:32:02-powercycle-reef-distro-default-smithi/7662873/remote/smithi144/log 2024-04-19T03:08:08.489 DEBUG:teuthology.orchestra.run.smithi144:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-19T03:08:12.107 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-04-19T03:08:12.116 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-04-19T03:08:12.116 DEBUG:teuthology.orchestra.run.smithi096:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-19T03:08:12.119 DEBUG:teuthology.orchestra.run.smithi097:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-19T03:08:12.121 DEBUG:teuthology.orchestra.run.smithi134:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-19T03:08:12.123 DEBUG:teuthology.orchestra.run.smithi144:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-19T03:08:12.235 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-04-19T03:08:12.244 INFO:teuthology.task.clock:Checking final clock skew... 2024-04-19T03:08:12.244 DEBUG:teuthology.orchestra.run.smithi096:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-19T03:08:12.247 DEBUG:teuthology.orchestra.run.smithi097:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-19T03:08:12.249 DEBUG:teuthology.orchestra.run.smithi134:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-19T03:08:12.251 DEBUG:teuthology.orchestra.run.smithi144:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-19T03:08:12.267 INFO:teuthology.orchestra.run.smithi096.stdout: remote refid st t when poll reach delay offset jitter 2024-04-19T03:08:12.267 INFO:teuthology.orchestra.run.smithi096.stdout:============================================================================== 2024-04-19T03:08:12.268 INFO:teuthology.orchestra.run.smithi096.stdout:+hv01.front.sepi 67.205.162.81 3 u 62 64 377 0.081 -1.178 0.284 2024-04-19T03:08:12.268 INFO:teuthology.orchestra.run.smithi096.stdout:*hv02.front.sepi 63.231.80.2 3 u 65 64 377 0.080 1.493 0.171 2024-04-19T03:08:12.268 INFO:teuthology.orchestra.run.smithi096.stdout:+hv03.front.sepi 74.6.168.72 3 u 62 64 377 0.089 -0.381 0.237 2024-04-19T03:08:12.268 INFO:teuthology.orchestra.run.smithi096.stdout: hv04.front.sepi .INIT. 16 u - 128 0 0.000 0.000 0.000 2024-04-19T03:08:12.272 INFO:teuthology.orchestra.run.smithi134.stdout: remote refid st t when poll reach delay offset jitter 2024-04-19T03:08:12.272 INFO:teuthology.orchestra.run.smithi134.stdout:============================================================================== 2024-04-19T03:08:12.272 INFO:teuthology.orchestra.run.smithi134.stdout:+hv01.front.sepi 67.205.162.81 3 u 61 64 377 0.071 -0.834 0.747 2024-04-19T03:08:12.272 INFO:teuthology.orchestra.run.smithi134.stdout:*hv02.front.sepi 63.231.80.2 3 u 64 64 377 0.067 0.961 0.322 2024-04-19T03:08:12.272 INFO:teuthology.orchestra.run.smithi134.stdout:+hv03.front.sepi 74.6.168.72 3 u 66 64 377 0.081 -0.353 0.392 2024-04-19T03:08:12.272 INFO:teuthology.orchestra.run.smithi134.stdout: hv04.front.sepi .INIT. 16 u - 128 0 0.000 0.000 0.000 2024-04-19T03:08:12.274 INFO:teuthology.orchestra.run.smithi144.stdout: remote refid st t when poll reach delay offset jitter 2024-04-19T03:08:12.274 INFO:teuthology.orchestra.run.smithi144.stdout:============================================================================== 2024-04-19T03:08:12.274 INFO:teuthology.orchestra.run.smithi144.stdout:*hv01.front.sepi 67.205.162.81 3 u 58 64 377 0.074 0.352 0.755 2024-04-19T03:08:12.274 INFO:teuthology.orchestra.run.smithi144.stdout:+hv02.front.sepi 63.231.80.2 3 u 56 64 377 0.047 2.802 0.655 2024-04-19T03:08:12.274 INFO:teuthology.orchestra.run.smithi144.stdout:+hv03.front.sepi 74.6.168.72 3 u 54 64 377 0.078 1.140 0.699 2024-04-19T03:08:12.274 INFO:teuthology.orchestra.run.smithi144.stdout: hv04.front.sepi .INIT. 16 u - 128 0 0.000 0.000 0.000 2024-04-19T03:08:12.287 INFO:teuthology.orchestra.run.smithi097.stdout: remote refid st t when poll reach delay offset jitter 2024-04-19T03:08:12.288 INFO:teuthology.orchestra.run.smithi097.stdout:============================================================================== 2024-04-19T03:08:12.288 INFO:teuthology.orchestra.run.smithi097.stdout: hv01.front.sepi 67.205.162.81 3 u 20 64 1 0.142 -1.015 0.000 2024-04-19T03:08:12.288 INFO:teuthology.orchestra.run.smithi097.stdout: hv02.front.sepi 63.231.80.2 3 u 21 64 1 0.074 1.787 0.000 2024-04-19T03:08:12.288 INFO:teuthology.orchestra.run.smithi097.stdout: hv03.front.sepi 74.6.168.72 3 u 22 64 1 0.104 -0.020 0.000 2024-04-19T03:08:12.288 INFO:teuthology.orchestra.run.smithi097.stdout: hv04.front.sepi .STEP. 16 u - 64 0 0.000 0.000 0.000 2024-04-19T03:08:12.289 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-04-19T03:08:12.298 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-04-19T03:08:12.299 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-04-19T03:08:12.310 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-04-19T03:08:12.322 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-04-19T03:08:12.333 INFO:teuthology.task.internal:Duration was 1001.206340 seconds 2024-04-19T03:08:12.334 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-04-19T03:08:12.345 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-04-19T03:08:12.345 DEBUG:teuthology.orchestra.run.smithi096:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-19T03:08:12.347 DEBUG:teuthology.orchestra.run.smithi097:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-19T03:08:12.349 DEBUG:teuthology.orchestra.run.smithi134:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-19T03:08:12.352 DEBUG:teuthology.orchestra.run.smithi144:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-19T03:08:12.418 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-04-19T03:08:12.419 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi096.front.sepia.ceph.com 2024-04-19T03:08:12.419 DEBUG:teuthology.orchestra.run.smithi096:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-19T03:08:12.432 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi097.front.sepia.ceph.com 2024-04-19T03:08:12.433 DEBUG:teuthology.orchestra.run.smithi097:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-19T03:08:12.447 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi134.front.sepia.ceph.com 2024-04-19T03:08:12.447 DEBUG:teuthology.orchestra.run.smithi134:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-19T03:08:12.463 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi144.front.sepia.ceph.com 2024-04-19T03:08:12.463 DEBUG:teuthology.orchestra.run.smithi144:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-19T03:08:12.478 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-04-19T03:08:12.479 DEBUG:teuthology.orchestra.run.smithi096:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-19T03:08:12.481 DEBUG:teuthology.orchestra.run.smithi097:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-19T03:08:12.483 DEBUG:teuthology.orchestra.run.smithi134:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-19T03:08:12.485 DEBUG:teuthology.orchestra.run.smithi144:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-19T03:08:12.561 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-04-19T03:08:12.562 DEBUG:teuthology.orchestra.run.smithi096:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-19T03:08:12.564 DEBUG:teuthology.orchestra.run.smithi097:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-19T03:08:12.566 DEBUG:teuthology.orchestra.run.smithi134:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-19T03:08:12.568 DEBUG:teuthology.orchestra.run.smithi144:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-19T03:08:12.658 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-04-19T03:08:12.668 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-04-19T03:08:12.669 DEBUG:teuthology.orchestra.run.smithi096:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-19T03:08:12.683 DEBUG:teuthology.orchestra.run.smithi097:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-19T03:08:12.699 DEBUG:teuthology.orchestra.run.smithi134:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-19T03:08:12.716 DEBUG:teuthology.orchestra.run.smithi144:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-19T03:08:12.733 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-04-19T03:08:12.746 DEBUG:teuthology.orchestra.run.smithi096:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-19T03:08:12.749 DEBUG:teuthology.orchestra.run.smithi097:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-19T03:08:12.751 DEBUG:teuthology.orchestra.run.smithi134:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-19T03:08:12.761 DEBUG:teuthology.orchestra.run.smithi144:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-19T03:08:12.761 INFO:teuthology.orchestra.run.smithi096.stdout:kernel.core_pattern = core 2024-04-19T03:08:12.773 INFO:teuthology.orchestra.run.smithi134.stdout:kernel.core_pattern = core 2024-04-19T03:08:12.776 INFO:teuthology.orchestra.run.smithi144.stdout:kernel.core_pattern = core 2024-04-19T03:08:12.782 INFO:teuthology.orchestra.run.smithi097.stdout:kernel.core_pattern = core 2024-04-19T03:08:12.813 DEBUG:teuthology.orchestra.run.smithi096:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-19T03:08:12.818 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-19T03:08:12.819 DEBUG:teuthology.orchestra.run.smithi097:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-19T03:08:12.856 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-19T03:08:12.857 DEBUG:teuthology.orchestra.run.smithi134:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-19T03:08:12.862 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-19T03:08:12.863 DEBUG:teuthology.orchestra.run.smithi144:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-19T03:08:12.868 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-19T03:08:12.868 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-04-19T03:08:12.879 INFO:teuthology.task.internal:Transferring archived files... 2024-04-19T03:08:12.880 DEBUG:teuthology.misc:Transferring archived files from smithi096:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-04-18_22:32:02-powercycle-reef-distro-default-smithi/7662873/remote/smithi096 2024-04-19T03:08:12.880 DEBUG:teuthology.orchestra.run.smithi096:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-19T03:08:12.906 DEBUG:teuthology.misc:Transferring archived files from smithi097:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-04-18_22:32:02-powercycle-reef-distro-default-smithi/7662873/remote/smithi097 2024-04-19T03:08:12.906 DEBUG:teuthology.orchestra.run.smithi097:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-19T03:08:12.930 DEBUG:teuthology.misc:Transferring archived files from smithi134:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-04-18_22:32:02-powercycle-reef-distro-default-smithi/7662873/remote/smithi134 2024-04-19T03:08:12.930 DEBUG:teuthology.orchestra.run.smithi134:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-19T03:08:12.956 DEBUG:teuthology.misc:Transferring archived files from smithi144:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-04-18_22:32:02-powercycle-reef-distro-default-smithi/7662873/remote/smithi144 2024-04-19T03:08:12.956 DEBUG:teuthology.orchestra.run.smithi144:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-19T03:08:12.982 INFO:teuthology.task.internal:Removing archive directory... 2024-04-19T03:08:12.982 DEBUG:teuthology.orchestra.run.smithi096:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-19T03:08:12.984 DEBUG:teuthology.orchestra.run.smithi097:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-19T03:08:12.986 DEBUG:teuthology.orchestra.run.smithi134:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-19T03:08:12.988 DEBUG:teuthology.orchestra.run.smithi144:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-19T03:08:13.029 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-04-19T03:08:13.042 INFO:teuthology.task.internal:Not uploading archives. 2024-04-19T03:08:13.042 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-04-19T03:08:13.058 INFO:teuthology.task.internal:Tidying up after the test... 2024-04-19T03:08:13.058 DEBUG:teuthology.orchestra.run.smithi096:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-19T03:08:13.060 DEBUG:teuthology.orchestra.run.smithi097:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-19T03:08:13.063 DEBUG:teuthology.orchestra.run.smithi134:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-19T03:08:13.065 DEBUG:teuthology.orchestra.run.smithi144:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-19T03:08:13.066 INFO:teuthology.orchestra.run.smithi096.stdout: 924112 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 19 03:08 /home/ubuntu/cephtest 2024-04-19T03:08:13.069 INFO:teuthology.orchestra.run.smithi097.stdout: 924112 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 19 03:08 /home/ubuntu/cephtest 2024-04-19T03:08:13.070 INFO:teuthology.orchestra.run.smithi134.stdout: 924112 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 19 03:08 /home/ubuntu/cephtest 2024-04-19T03:08:13.073 INFO:teuthology.orchestra.run.smithi144.stdout: 924112 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 19 03:08 /home/ubuntu/cephtest 2024-04-19T03:08:13.075 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-04-19T03:08:13.088 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-04-19T03:08:13.122 INFO:teuthology.run:Summary data: description: powercycle/osd/{clusters/3osd-1per-target ignorelist_health objectstore/bluestore-comp-zlib powercycle/default supported-all-distro/ubuntu_20.04 tasks/admin_socket_objecter_requests thrashosds-health} duration: 1001.2063400745392 flavor: default owner: scheduled_teuthology@teuthology success: true 2024-04-19T03:08:13.122 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-19T03:08:13.186 INFO:teuthology.run:pass